-- Logs begin at Thu 2022-08-04 15:57:39 UTC, end at Thu 2022-08-04 18:45:20 UTC. -- Aug 04 16:43:46.947451 n-d-851359-3 systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 16:43:46.957722 n-d-851359-3 devstack@n-api.service[115768]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 16:43:46.960461 n-d-851359-3 devstack@n-api.service[115768]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 16:43:46 2022] *** Aug 04 16:43:46.960461 n-d-851359-3 devstack@n-api.service[115768]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 16:43:46.960461 n-d-851359-3 devstack@n-api.service[115768]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 16:43:46.960461 n-d-851359-3 devstack@n-api.service[115768]: nodename: n-d-851359-3 Aug 04 16:43:46.960461 n-d-851359-3 devstack@n-api.service[115768]: machine: x86_64 Aug 04 16:43:46.960461 n-d-851359-3 devstack@n-api.service[115768]: clock source: unix Aug 04 16:43:46.960461 n-d-851359-3 devstack@n-api.service[115768]: pcre jit disabled Aug 04 16:43:46.960461 n-d-851359-3 devstack@n-api.service[115768]: detected number of CPU cores: 4 Aug 04 16:43:46.960461 n-d-851359-3 devstack@n-api.service[115768]: current working directory: / Aug 04 16:43:46.960461 n-d-851359-3 devstack@n-api.service[115768]: detected binary path: /usr/bin/uwsgi-core Aug 04 16:43:46.960461 n-d-851359-3 devstack@n-api.service[115768]: your processes number limit is 47680 Aug 04 16:43:46.960461 n-d-851359-3 devstack@n-api.service[115768]: your memory page size is 4096 bytes Aug 04 16:43:46.960461 n-d-851359-3 devstack@n-api.service[115768]: detected max file descriptor number: 2048 Aug 04 16:43:46.960461 n-d-851359-3 devstack@n-api.service[115768]: lock engine: pthread robust mutexes Aug 04 16:43:46.960461 n-d-851359-3 devstack@n-api.service[115768]: thunder lock: enabled Aug 04 16:43:46.960461 n-d-851359-3 devstack@n-api.service[115768]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 16:43:46.960461 n-d-851359-3 devstack@n-api.service[115768]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 16:43:47.001452 n-d-851359-3 devstack@n-api.service[115768]: Python main interpreter initialized at 0x55685dbf79c0 Aug 04 16:43:47.001452 n-d-851359-3 devstack@n-api.service[115768]: python threads support enabled Aug 04 16:43:47.001452 n-d-851359-3 devstack@n-api.service[115768]: your server socket listen backlog is limited to 100 connections Aug 04 16:43:47.001452 n-d-851359-3 devstack@n-api.service[115768]: your mercy for graceful operations on workers is 90 seconds Aug 04 16:43:47.002140 n-d-851359-3 devstack@n-api.service[115768]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 16:43:47.002140 n-d-851359-3 devstack@n-api.service[115768]: *** Operational MODE: preforking *** Aug 04 16:43:47.002391 n-d-851359-3 devstack@n-api.service[115768]: *** uWSGI is running in multiple interpreter mode *** Aug 04 16:43:47.002391 n-d-851359-3 devstack@n-api.service[115768]: spawned uWSGI master process (pid: 115768) Aug 04 16:43:47.005653 n-d-851359-3 devstack@n-api.service[115768]: spawned uWSGI worker 1 (pid: 115769, cores: 1) Aug 04 16:43:47.005653 n-d-851359-3 devstack@n-api.service[115768]: spawned uWSGI worker 2 (pid: 115770, cores: 1) Aug 04 16:43:47.005653 n-d-851359-3 devstack@n-api.service[115768]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 16:43:47.002467 n-d-851359-3 systemd[1]: Started Devstack devstack@n-api.service. Aug 04 16:43:47.687498 n-d-851359-3 devstack@n-api.service[115770]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 16:43:47.746170 n-d-851359-3 devstack@n-api.service[115769]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 16:43:48.800678 n-d-851359-3 devstack@n-api.service[115770]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 16:43:48.800678 n-d-851359-3 devstack@n-api.service[115770]: from cryptography.utils import int_from_bytes Aug 04 16:43:48.801325 n-d-851359-3 devstack@n-api.service[115770]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 16:43:48.801325 n-d-851359-3 devstack@n-api.service[115770]: from cryptography.utils import int_from_bytes Aug 04 16:43:48.879304 n-d-851359-3 devstack@n-api.service[115769]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 16:43:48.879304 n-d-851359-3 devstack@n-api.service[115769]: from cryptography.utils import int_from_bytes Aug 04 16:43:48.879873 n-d-851359-3 devstack@n-api.service[115769]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 16:43:48.879873 n-d-851359-3 devstack@n-api.service[115769]: from cryptography.utils import int_from_bytes Aug 04 16:43:51.387421 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 16:43:51.387978 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 16:43:51.388176 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 16:43:51.388550 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 16:43:51.388787 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 16:43:51.389165 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.389487 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.389807 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.390147 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.390476 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.390574 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 16:43:51.390918 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.390999 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 16:43:51.391100 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.391281 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 16:43:51.391378 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.391651 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 16:43:51.391743 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.391910 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 16:43:51.392004 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.392225 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.392310 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.392544 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-851359-3 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.392638 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.392860 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.392958 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.393161 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.393247 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.393464 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.393553 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.393776 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.393862 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.394099 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.394197 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.394417 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.394510 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.394729 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.394880 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.395058 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.395222 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.395373 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.396876 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.397020 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-851359-3 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.397135 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.397230 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.397311 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.397436 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.397533 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.397614 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.397743 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.397833 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.397923 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.398077 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.398219 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.398302 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.398386 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.398510 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.398600 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.398862 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.398966 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.399176 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.399265 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-851359-3 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.399487 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.399586 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.399799 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.399891 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.400141 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.400238 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.400456 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.400547 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.400767 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.400853 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.401093 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.401191 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.401404 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.401495 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.401731 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.401820 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.402054 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.402164 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.402379 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.402482 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-851359-3 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.402765 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.402859 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.403080 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.403175 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.403394 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.403540 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.403692 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.403811 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.403998 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.404126 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.404303 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.404437 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.404618 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.404762 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.404923 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.405090 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.405225 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.405401 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.405501 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.405730 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.405827 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.406075 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.406230 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.406393 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.406483 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.406713 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.406815 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.406963 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.407057 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.407210 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.407309 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.407523 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.407618 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.407839 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.407944 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.408147 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.408252 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.408449 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.408557 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.408734 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.408832 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.409039 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.409128 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.409339 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.409437 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.409647 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.409742 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.409947 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.410102 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.410244 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.410414 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.410497 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.410577 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.410807 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.410902 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.411131 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.411220 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.411443 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.411536 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.411751 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.411848 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.412631 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.412739 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.93 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.412940 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.93 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.413026 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.413244 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.413337 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.413550 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.413643 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.413860 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.413956 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.414197 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.414292 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.414511 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.414608 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.414826 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.414917 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.415127 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.415224 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.415475 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.415590 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.415723 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.415810 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.416039 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.416203 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.93 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.416367 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.416492 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.93 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.416664 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.416806 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.416912 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.417152 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.417239 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.417476 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.417562 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.417794 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.417878 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.418120 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.418214 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.418423 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.418514 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.418725 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.418822 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.419023 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.419131 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.419325 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.419444 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.419637 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.419764 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.419937 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.420094 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.420239 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.420419 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.420539 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.420697 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.420839 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.421022 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.421138 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.421354 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.421439 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.421699 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.421798 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.422034 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.422124 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.422347 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.422433 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.422649 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.422743 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.422950 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.423036 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.423249 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.423342 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.423549 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.423642 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.423853 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.423937 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.424151 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.424235 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.424451 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.424544 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.424752 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.424837 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.425055 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.425153 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.425355 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.425460 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.425656 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.425744 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.425958 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.426080 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.426277 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.426365 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.426589 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.426675 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.426885 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.426980 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.427185 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.427272 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.427514 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.427600 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.427850 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.427945 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.428152 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.428243 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.428449 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.428536 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.428745 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.428840 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.429044 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.429182 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.429342 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.429436 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.429644 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.429742 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.429941 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.430055 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.430258 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.430347 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.430571 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.430659 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.430872 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.430962 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.431176 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.431260 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.431478 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.431564 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.431777 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.431862 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.432080 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.432164 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.432386 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.432473 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.432691 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.432775 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.432997 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.433084 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.433303 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.433418 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.433607 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.433693 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.433911 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.434067 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.434243 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.434355 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.434564 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.434663 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.434877 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.434976 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.435187 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.435281 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.435491 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.435592 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.435797 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.435906 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.436099 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.436194 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:43:51.436411 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.436507 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.436722 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.436817 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.437045 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.437139 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.437353 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.437441 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.437661 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.437751 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.437990 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.438082 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.438295 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.438393 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.438609 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.438710 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.438931 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.439028 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.439245 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.439344 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.439551 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.439651 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.439888 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.439976 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.440198 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.440311 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.440519 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.440623 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.441102 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.441195 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.441413 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.441500 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.441718 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.441808 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.442045 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.442149 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.442352 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.442445 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.442669 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.442774 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.442986 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.443073 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.443314 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.443408 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.443629 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.443717 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.443935 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.444036 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.444242 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.444339 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.444546 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.444634 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.444852 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.444940 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.445174 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.445272 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.445487 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.445583 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.445794 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.445881 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.446124 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.446215 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.446431 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.446526 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.446742 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.446829 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.447049 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.447139 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.447355 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.447442 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.447660 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.447747 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.447959 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.448048 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.448258 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.448345 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.448557 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.448658 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.448864 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.448970 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.449160 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.449268 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.449481 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.449577 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.449802 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.449889 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.450123 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.450214 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.450448 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.450548 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.450747 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.450834 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.451053 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.451152 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.451359 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.451464 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.451661 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.451755 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.451960 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.452048 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.452264 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.452363 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.452567 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.452655 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.452869 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.452956 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.453172 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.453268 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.453483 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.453569 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.453786 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.453882 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.454126 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.454219 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.454430 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.454528 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.454730 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.454817 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.455040 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.455129 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.455349 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.455443 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.455653 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.455752 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.455958 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.456052 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.456265 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.456352 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.456574 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.456661 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.456880 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.456967 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.457187 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.457280 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.457501 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.457597 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.457809 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.457897 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.458142 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.458232 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.458451 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.458551 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.459294 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.459431 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.459614 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.459716 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.459913 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.460010 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.460219 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.460308 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.460521 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.460653 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.460822 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.461006 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.461101 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.461183 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.461408 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.461509 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.461707 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.461797 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.462026 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.462121 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.462330 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.462418 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.462629 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.462727 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.462928 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.463016 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.463248 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.463337 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.463551 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.463640 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.463851 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.463939 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.464152 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.464239 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.464451 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.464539 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.464787 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.464877 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.465086 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.465182 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.465401 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.465487 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.465708 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.465802 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.466048 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.466155 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.466361 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.466449 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.466667 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.466767 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.466973 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.467071 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.467277 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.467364 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.467584 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.467680 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.467890 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.468042 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.468182 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.468327 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.468498 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.468645 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.468797 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.468936 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.469103 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.469242 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.469422 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.469605 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.469780 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.470016 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.470157 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.470337 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.470474 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.470640 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.470795 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.470947 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.471085 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.471273 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.471413 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.471603 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.471751 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.471914 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.472052 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.472233 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.472372 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.472541 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.472693 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.472837 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.472980 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.473141 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.473280 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.473439 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.473577 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.473741 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.473880 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.474146 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.474295 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.475063 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.475208 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.475379 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.475507 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.475690 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.475829 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.475998 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.476107 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.476321 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.476463 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.476630 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.476769 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.476946 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.477086 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.477249 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.477388 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.477560 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.477707 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.477887 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.478076 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.478222 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.478359 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.478530 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.478682 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.479259 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.479535 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.479607 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.479776 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.479856 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.479935 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.480003 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.480069 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.480141 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.480321 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.480407 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.480623 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.480707 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.480930 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.481007 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.481240 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.481326 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.482087 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.482179 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.482252 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.482335 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.482406 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.482484 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.482554 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.482628 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.482741 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.482982 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.483078 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.483254 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.483351 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.483569 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.483657 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.483897 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.483982 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.484212 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.484312 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.484524 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.484622 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.484840 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.484925 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.485140 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.485229 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.485440 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.485573 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.485749 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.485848 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.486118 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.486225 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.486381 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.486614 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.486770 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.486923 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.487072 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.487213 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.487351 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.487489 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.487633 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.487778 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.487915 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.488060 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.488240 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.488386 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.488525 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.488672 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.488809 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.488943 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.489087 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.489223 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.489368 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.489506 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.489643 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.489777 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.489915 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.490099 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.490301 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.490439 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.490581 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.490715 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.490882 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.491017 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.491188 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.491327 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.491493 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.491645 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.491798 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.491937 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.492116 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.492259 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.492421 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.492555 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.492727 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.492878 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.493014 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.493156 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.493316 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.493456 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.493621 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.493764 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.495547 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.495706 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.495706 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.495862 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.495957 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.496051 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.496133 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.496222 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.496305 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.496384 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.496508 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.496606 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.496689 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.496768 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.496848 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.496927 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.497019 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.497102 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.497181 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.497261 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.497381 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.497543 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.497691 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.498011 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.498183 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.498317 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.498642 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.498730 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.500671 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.500806 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.500806 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.500967 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.501048 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.501129 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.501209 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.501304 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.501393 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.501393 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.501558 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.501640 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.501709 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.501854 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.501941 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.502161 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.502247 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.502388 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.502488 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.502570 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.502650 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.502730 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.502817 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.502899 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.502987 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.503069 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.503204 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.503294 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.503503 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.503802 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.503903 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.504141 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.504391 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.504479 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.504767 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.504978 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.505093 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.505432 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.505568 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.505802 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.505966 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.506131 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.506314 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.506456 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.506638 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.506759 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.506958 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.507049 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.507280 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.509768 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.510028 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.510105 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.510186 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.510281 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.510359 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.510429 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.510495 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.510561 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.510640 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.510708 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.510791 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.510859 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.510859 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.511053 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.511131 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.511198 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.511274 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.511342 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.511409 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.511474 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.511539 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.511604 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.511677 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.511768 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.511839 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.511906 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.511971 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.512047 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.512724 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.512805 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.512872 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.512938 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.513028 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.513028 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.513167 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.513242 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.513309 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.513384 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.513458 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.513533 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.513601 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.513819 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.513908 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.514186 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.514288 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.514588 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.514672 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.514740 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.515406 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.515498 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.515646 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.515718 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.515813 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.515887 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.515962 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.516028 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.516102 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.516176 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.516330 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.516575 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.516672 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.516761 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.516918 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.517074 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.517216 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.517366 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.517506 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.517632 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.517814 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.517942 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.518159 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.518325 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.518458 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.518605 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.518770 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.518922 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.519060 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.519197 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.519373 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.519516 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.519687 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.519820 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.519982 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.520198 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.520360 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.520507 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.520647 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.520810 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.520967 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.521106 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.521744 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.521909 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.522064 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.522149 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.522380 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.522471 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.522697 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.522806 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.523012 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.523100 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.523312 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.523398 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.523637 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.523726 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.523942 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.524031 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.524250 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.524337 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.524560 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.524651 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.524873 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.524961 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.525181 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.525268 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.525487 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.525575 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.525793 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.525951 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.526126 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.526230 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.526427 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.526516 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.526737 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.526833 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.527044 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.527140 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.527348 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.527436 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.527646 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.527733 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.527944 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.528041 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.528251 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.528346 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.528554 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.528641 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.528861 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.528958 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.529164 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.529251 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.529470 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.529559 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.529777 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.529873 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.530105 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.530221 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.530414 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.530551 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.530717 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.530813 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.531017 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.531104 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.531321 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.531409 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.531625 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.531714 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.531946 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.532075 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.532237 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.532326 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.532542 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.532639 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.532845 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.532932 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.533148 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.533245 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.533450 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.533545 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.533754 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.533868 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.534079 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.534251 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.534404 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.534570 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.534687 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.534915 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.535002 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.535252 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.535349 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.535564 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.535657 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.535864 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.535951 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.536167 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.536259 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.536466 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.536562 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.536793 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.537559 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.537660 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.537872 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.538005 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.538203 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.538332 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.538506 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.538663 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.538811 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.538978 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.539117 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.539292 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.539426 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.539608 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.539739 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.539922 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.540037 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.540237 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.540454 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.540586 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.540762 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.540865 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.541065 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.541153 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.541370 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.541460 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.541669 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.541763 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.541966 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.542099 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.542291 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.542386 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.542611 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.542707 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.542909 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.543006 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.543207 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.543305 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.543507 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.543594 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.543825 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.543920 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.544124 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.544211 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.544438 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.544536 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.544780 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.544874 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.545093 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.545188 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.545400 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.545488 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.545830 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.545917 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.546160 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.546264 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.546467 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.546554 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.546772 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.546866 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.547085 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.547172 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.547396 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.547490 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.547698 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.547810 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.548008 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.548110 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.548309 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.548408 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.548625 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.548737 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.548944 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.549038 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.549251 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.549346 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.549560 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.549649 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.549865 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.549952 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.550211 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.550316 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.550530 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.550613 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.550841 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.550998 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.551161 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.551306 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.551469 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.551617 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.551776 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.551944 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.552091 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.552264 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.552397 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.552565 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.552735 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.552869 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.553092 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.553229 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.553374 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.553514 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.553683 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.553830 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.554027 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.554289 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.554397 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.554607 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.554703 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.554906 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.554996 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.555212 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.555376 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.555519 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.555642 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.555822 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.556013 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.556109 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.556349 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.556441 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.556705 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.556794 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.557001 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.557098 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.557316 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.557408 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.557626 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.557722 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.557949 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.558086 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.558290 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.558423 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.558590 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.558762 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.558908 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.559143 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.559233 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.559496 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.559586 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.559800 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.559887 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.560099 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.560195 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.560501 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.560671 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.560803 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.561030 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.561126 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.561396 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.561483 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.561741 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.561836 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.562070 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.562163 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.562404 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.562503 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.562723 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.562819 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.563034 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.563123 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.563348 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.563436 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.563670 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.563757 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.563971 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.564067 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.564271 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.564389 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.564576 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.564750 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.564878 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.565092 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.565183 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.565428 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.565523 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.566027 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.566198 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.566335 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.566452 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.566637 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.566755 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.566939 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.567063 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.567258 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.567389 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.567561 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.567676 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.567880 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.567997 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.568210 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.568371 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.568513 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.568684 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.568799 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.569045 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.569166 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.569347 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.569469 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.569675 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.569791 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.570032 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.570150 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.570353 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.570468 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.570700 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.570818 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.571430 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.571528 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.571613 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.571702 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.571784 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.571863 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.571950 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.572031 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.572203 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.572294 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.572514 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.572621 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.572823 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.572918 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.573130 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.573219 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.573438 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.573526 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.573747 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.573837 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.574138 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.574249 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.574439 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.574642 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.574738 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.574964 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.575062 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.575273 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.575365 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.575581 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.575669 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.575889 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.575978 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.576198 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.576331 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.576507 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.576602 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.576811 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.576899 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.577115 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.577203 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.577421 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.577517 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.577726 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.577839 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.578065 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.578171 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.578377 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.578464 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.578684 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.578774 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.578995 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.579090 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.579313 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.579408 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.579622 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.579711 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.579934 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.580021 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.580242 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.580339 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.580569 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.580655 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.580890 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.581016 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.581190 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.581280 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.581496 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.581583 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.581806 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.581900 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.582136 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.582228 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.582444 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.582545 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.582752 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.582851 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.583057 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.583146 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.583363 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.583450 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.583666 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.584258 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.584517 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.584626 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.584939 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.585122 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.585335 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.585513 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.585599 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.585774 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.585951 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.586122 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.586290 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.586458 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.586601 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.586746 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.586910 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.587064 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.587221 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.587383 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.587697 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.587784 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.588013 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.588100 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.588332 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.588457 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.588667 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.588768 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.588987 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.589087 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.589299 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.589407 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.589611 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.589710 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.589933 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.590052 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.590258 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.590356 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.590559 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.590648 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.590864 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.590961 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.591170 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.591331 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.591478 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.591638 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.591789 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.591945 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.592086 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.592225 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.592372 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.592511 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.592650 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.592892 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.593040 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.593190 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.593329 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.593466 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.593644 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.593798 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.593962 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.594132 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.594298 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.594454 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.594604 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.594743 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.594911 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.595069 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.595208 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.595354 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.595541 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.595688 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.595879 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.596034 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.596206 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.596361 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.596528 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.596737 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.596868 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.596954 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.597087 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.597181 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.597375 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.597664 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.597752 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.598004 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.598095 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.598328 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.598428 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.598594 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.598683 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.598893 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.598989 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.599289 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.599386 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.599678 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.599809 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.599910 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.600137 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.600233 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.600451 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.600613 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.600750 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.600877 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.601053 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.601212 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.601443 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.601561 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.601650 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.601911 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.602078 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.602262 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.602383 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.602567 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.602670 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.602868 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.602966 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.603174 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.603274 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.603471 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.603560 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.603777 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.604075 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.604172 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.604395 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.604494 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.604693 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.604805 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.605044 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.605142 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.605357 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.605456 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.605660 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.605767 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.606010 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.606111 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.606304 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.606394 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.606612 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.606723 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.606960 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.607062 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.607272 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.607360 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.607627 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.607807 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.607937 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.608142 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.608238 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.608460 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.608564 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.608790 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.608881 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.609118 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.609206 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.609425 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.609597 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.609740 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.609878 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.610028 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.610132 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.610355 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.610453 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.610662 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.610751 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.610969 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.611055 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.611272 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.611359 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.611576 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.611667 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.611880 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.611967 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.612182 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.612278 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.612485 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.612572 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.612787 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.612874 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.613091 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.613180 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.613394 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.613482 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.613698 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.613785 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.614027 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.614120 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.614323 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.614411 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.614627 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.614809 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.614938 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.615522 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.615795 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.615961 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.616105 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.616203 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.616417 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.616505 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.616728 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.616823 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.617041 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.617137 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.617348 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.617435 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.617651 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.617738 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.617955 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.618103 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.618278 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.618366 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.618588 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.618688 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.618913 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.619181 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.619275 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.619511 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.619597 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.619838 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.619933 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.620176 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.620263 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.620513 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.620607 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.620832 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.620926 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.621137 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.621232 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.621457 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.621581 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.621777 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.621876 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.622105 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.622208 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.622424 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.622512 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.622728 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.622817 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.623051 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.623176 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.623374 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.623460 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.623689 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.623778 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.624007 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.624101 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.624309 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.624412 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.624607 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.624696 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.624906 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.624995 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.625208 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.625312 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.625522 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.625610 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.625827 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.625914 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.626148 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.626248 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.626447 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.626544 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.626752 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.626845 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.627050 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.627184 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.627348 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.627468 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.627647 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.627790 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.627945 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.628112 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.628246 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.628427 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.628526 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.628741 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.628837 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.629053 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.629148 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.629370 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.629457 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.629671 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.629765 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.629967 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.630091 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.630290 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.630378 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.630602 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.630751 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.630938 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.631112 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.631235 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.631429 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.631528 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.631753 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.631849 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.632077 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.632166 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.632391 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.632487 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.632719 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.632814 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.633040 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.633133 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.633345 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.633442 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.633662 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.633750 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.633965 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.634074 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.634336 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.634433 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.634627 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.634728 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.634937 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.635032 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.635242 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.635331 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.635570 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.635658 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.635875 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.635963 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.636181 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.636270 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.636486 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.636573 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.636791 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.636893 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.637094 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.637182 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.637505 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.637735 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.637866 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.638006 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.638134 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.638244 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.638349 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.638437 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.638647 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.638749 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.638960 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.639050 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.639275 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.639362 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.639586 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.639675 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.639892 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.639988 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.640218 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.640305 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.640527 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.640615 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.640833 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.640920 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.641137 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.641222 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.641439 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.641534 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.641743 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.641832 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.642074 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.642184 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.642378 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.642474 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.642680 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.642781 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.642985 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.643081 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.643291 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.643424 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.643610 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.643696 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.643930 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.644091 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.644235 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.644324 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.644554 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.644644 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.644863 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.644963 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.645191 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.645279 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.645496 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.645582 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.645819 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.645909 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.646168 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.646757 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.647004 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.647093 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.647310 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.647399 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.647610 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.647698 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.647851 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 16:43:51.648010 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.648342 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.648680 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.649022 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.649358 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.649697 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.650083 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.650419 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.650752 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.651120 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.651465 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.651812 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.652156 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.652472 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.652806 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.653121 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.653435 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.653747 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.654085 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.654400 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.654720 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.655032 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.655346 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.655664 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.655982 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.656311 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.656639 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.656952 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.657281 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.657610 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.657960 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.658297 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.658645 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.658998 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.659319 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.659648 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.659983 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:43:51.660253 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 16:43:51.802603 n-d-851359-3 devstack@n-api.service[115770]: INFO dbcounter [None req-f65423aa-7a2e-4d16-9537-1d830e92c7af None None] Registered counter for database nova_api Aug 04 16:43:51.820466 n-d-851359-3 devstack@n-api.service[115769]: INFO dbcounter [None req-f4dde8fe-a2db-441d-9205-f49ff8572ba1 None None] Registered counter for database nova_api Aug 04 16:43:51.824986 n-d-851359-3 devstack@n-api.service[115770]: DEBUG oslo_db.sqlalchemy.engines [None req-f65423aa-7a2e-4d16-9537-1d830e92c7af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115770) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:43:51.831668 n-d-851359-3 devstack@n-api.service[115770]: DEBUG dbcounter [-] [115770] Writer thread running {{(pid=115770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 16:43:51.840850 n-d-851359-3 devstack@n-api.service[115769]: DEBUG oslo_db.sqlalchemy.engines [None req-f4dde8fe-a2db-441d-9205-f49ff8572ba1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115769) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:43:51.847754 n-d-851359-3 devstack@n-api.service[115769]: DEBUG dbcounter [-] [115769] Writer thread running {{(pid=115769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 16:43:51.888569 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.context [None req-f65423aa-7a2e-4d16-9537-1d830e92c7af None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),435e901d-6672-4284-ad57-58e647e6e99d(cell1) {{(pid=115770) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 16:43:51.892409 n-d-851359-3 devstack@n-api.service[115770]: DEBUG oslo_concurrency.lockutils [None req-f65423aa-7a2e-4d16-9537-1d830e92c7af None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:43:51.892882 n-d-851359-3 devstack@n-api.service[115770]: DEBUG oslo_concurrency.lockutils [None req-f65423aa-7a2e-4d16-9537-1d830e92c7af None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:43:51.894471 n-d-851359-3 devstack@n-api.service[115770]: DEBUG oslo_concurrency.lockutils [None req-f65423aa-7a2e-4d16-9537-1d830e92c7af None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:43:51.895207 n-d-851359-3 devstack@n-api.service[115770]: DEBUG oslo_concurrency.lockutils [None req-f65423aa-7a2e-4d16-9537-1d830e92c7af None None] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:43:51.895658 n-d-851359-3 devstack@n-api.service[115770]: DEBUG oslo_concurrency.lockutils [None req-f65423aa-7a2e-4d16-9537-1d830e92c7af None None] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:43:51.897733 n-d-851359-3 devstack@n-api.service[115770]: DEBUG oslo_concurrency.lockutils [None req-f65423aa-7a2e-4d16-9537-1d830e92c7af None None] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:43:51.899887 n-d-851359-3 devstack@n-api.service[115770]: INFO dbcounter [None req-f65423aa-7a2e-4d16-9537-1d830e92c7af None None] Registered counter for database nova_cell0 Aug 04 16:43:51.905686 n-d-851359-3 devstack@n-api.service[115770]: INFO dbcounter [None req-f65423aa-7a2e-4d16-9537-1d830e92c7af None None] Registered counter for database nova_cell1 Aug 04 16:43:51.906871 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.context [None req-f4dde8fe-a2db-441d-9205-f49ff8572ba1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),435e901d-6672-4284-ad57-58e647e6e99d(cell1) {{(pid=115769) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 16:43:51.911037 n-d-851359-3 devstack@n-api.service[115769]: DEBUG oslo_concurrency.lockutils [None req-f4dde8fe-a2db-441d-9205-f49ff8572ba1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:43:51.911554 n-d-851359-3 devstack@n-api.service[115769]: DEBUG oslo_concurrency.lockutils [None req-f4dde8fe-a2db-441d-9205-f49ff8572ba1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:43:51.913724 n-d-851359-3 devstack@n-api.service[115769]: DEBUG oslo_concurrency.lockutils [None req-f4dde8fe-a2db-441d-9205-f49ff8572ba1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:43:51.914563 n-d-851359-3 devstack@n-api.service[115769]: DEBUG oslo_concurrency.lockutils [None req-f4dde8fe-a2db-441d-9205-f49ff8572ba1 None None] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:43:51.914738 n-d-851359-3 devstack@n-api.service[115770]: DEBUG oslo_db.sqlalchemy.engines [None req-f65423aa-7a2e-4d16-9537-1d830e92c7af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115770) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:43:51.915073 n-d-851359-3 devstack@n-api.service[115769]: DEBUG oslo_concurrency.lockutils [None req-f4dde8fe-a2db-441d-9205-f49ff8572ba1 None None] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:43:51.915574 n-d-851359-3 devstack@n-api.service[115770]: DEBUG oslo_db.sqlalchemy.engines [None req-f65423aa-7a2e-4d16-9537-1d830e92c7af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115770) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:43:51.917116 n-d-851359-3 devstack@n-api.service[115769]: DEBUG oslo_concurrency.lockutils [None req-f4dde8fe-a2db-441d-9205-f49ff8572ba1 None None] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:43:51.919257 n-d-851359-3 devstack@n-api.service[115769]: INFO dbcounter [None req-f4dde8fe-a2db-441d-9205-f49ff8572ba1 None None] Registered counter for database nova_cell0 Aug 04 16:43:51.922727 n-d-851359-3 devstack@n-api.service[115770]: DEBUG dbcounter [-] [115770] Writer thread running {{(pid=115770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 16:43:51.924206 n-d-851359-3 devstack@n-api.service[115770]: DEBUG dbcounter [-] [115770] Writer thread running {{(pid=115770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 16:43:51.925289 n-d-851359-3 devstack@n-api.service[115769]: INFO dbcounter [None req-f4dde8fe-a2db-441d-9205-f49ff8572ba1 None None] Registered counter for database nova_cell1 Aug 04 16:43:51.933698 n-d-851359-3 devstack@n-api.service[115769]: DEBUG oslo_db.sqlalchemy.engines [None req-f4dde8fe-a2db-441d-9205-f49ff8572ba1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115769) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:43:51.937253 n-d-851359-3 devstack@n-api.service[115769]: DEBUG oslo_db.sqlalchemy.engines [None req-f4dde8fe-a2db-441d-9205-f49ff8572ba1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115769) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:43:51.941376 n-d-851359-3 devstack@n-api.service[115769]: DEBUG dbcounter [-] [115769] Writer thread running {{(pid=115769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 16:43:51.948007 n-d-851359-3 devstack@n-api.service[115769]: DEBUG dbcounter [-] [115769] Writer thread running {{(pid=115769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 16:43:52.072129 n-d-851359-3 devstack@n-api.service[115770]: INFO dbcounter [None req-f65423aa-7a2e-4d16-9537-1d830e92c7af None None] Registered counter for database nova_cell0 Aug 04 16:43:52.078924 n-d-851359-3 devstack@n-api.service[115770]: DEBUG oslo_db.sqlalchemy.engines [None req-f65423aa-7a2e-4d16-9537-1d830e92c7af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115770) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:43:52.083627 n-d-851359-3 devstack@n-api.service[115770]: DEBUG dbcounter [-] [115770] Writer thread running {{(pid=115770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 16:43:52.100752 n-d-851359-3 devstack@n-api.service[115769]: INFO dbcounter [None req-f4dde8fe-a2db-441d-9205-f49ff8572ba1 None None] Registered counter for database nova_cell0 Aug 04 16:43:52.110508 n-d-851359-3 devstack@n-api.service[115769]: DEBUG oslo_db.sqlalchemy.engines [None req-f4dde8fe-a2db-441d-9205-f49ff8572ba1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115769) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:43:52.115414 n-d-851359-3 devstack@n-api.service[115769]: DEBUG dbcounter [-] [115769] Writer thread running {{(pid=115769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 16:43:52.423686 n-d-851359-3 devstack@n-api.service[115770]: WARNING keystonemiddleware.auth_token [None req-f65423aa-7a2e-4d16-9537-1d830e92c7af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 16:43:52.428281 n-d-851359-3 devstack@n-api.service[115769]: WARNING keystonemiddleware.auth_token [None req-f4dde8fe-a2db-441d-9205-f49ff8572ba1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 16:43:52.432089 n-d-851359-3 devstack@n-api.service[115770]: WARNING keystonemiddleware.auth_token [None req-f65423aa-7a2e-4d16-9537-1d830e92c7af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 16:43:52.435533 n-d-851359-3 devstack@n-api.service[115769]: WARNING keystonemiddleware.auth_token [None req-f4dde8fe-a2db-441d-9205-f49ff8572ba1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 16:43:52.777533 n-d-851359-3 devstack@n-api.service[115769]: WARNING keystonemiddleware.auth_token [None req-f4dde8fe-a2db-441d-9205-f49ff8572ba1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 16:43:52.778994 n-d-851359-3 devstack@n-api.service[115770]: WARNING keystonemiddleware.auth_token [None req-f65423aa-7a2e-4d16-9537-1d830e92c7af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 16:43:52.783480 n-d-851359-3 devstack@n-api.service[115769]: WARNING keystonemiddleware.auth_token [None req-f4dde8fe-a2db-441d-9205-f49ff8572ba1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 16:43:52.786085 n-d-851359-3 devstack@n-api.service[115770]: WARNING keystonemiddleware.auth_token [None req-f65423aa-7a2e-4d16-9537-1d830e92c7af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 16:43:52.788868 n-d-851359-3 devstack@n-api.service[115769]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55685dbf79c0 pid: 115769 (default app) Aug 04 16:43:52.790367 n-d-851359-3 devstack@n-api.service[115770]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55685dbf79c0 pid: 115770 (default app) Aug 04 16:43:52.791054 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-f4dde8fe-a2db-441d-9205-f49ff8572ba1 None None] Calling method '>' {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:43:52.792306 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-f4dde8fe-a2db-441d-9205-f49ff8572ba1 None None] 10.222.0.93 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001897 Aug 04 16:43:52.792720 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 1/1] 10.222.0.93 () {50 vars in 788 bytes} [Thu Aug 4 16:43:52 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:13.646013 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-f65423aa-7a2e-4d16-9537-1d830e92c7af None None] Calling method '>' {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:13.647250 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-f65423aa-7a2e-4d16-9537-1d830e92c7af None None] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002004 Aug 04 16:45:13.647670 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 1/2] 10.222.0.93 () {54 vars in 931 bytes} [Thu Aug 4 16:45:13 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:13.660194 n-d-851359-3 devstack@n-api.service[115769]: DEBUG dbcounter [-] [115769] Writing DB stats nova_api:SELECT=3 {{(pid=115769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:45:13.661635 n-d-851359-3 devstack@n-api.service[115769]: DEBUG dbcounter [-] [115769] Writing DB stats nova_cell0:SELECT=3 {{(pid=115769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:45:13.662915 n-d-851359-3 devstack@n-api.service[115769]: DEBUG dbcounter [-] [115769] Writing DB stats nova_cell1:SELECT=3 {{(pid=115769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:45:13.663747 n-d-851359-3 devstack@n-api.service[115769]: DEBUG dbcounter [-] [115769] Writing DB stats nova_cell0:SELECT=3 {{(pid=115769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:45:14.615252 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-3029c98f-42fa-40d6-844c-dc00c5ab186b admin admin] Calling method '>' {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:14.648309 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-3029c98f-42fa-40d6-844c-dc00c5ab186b admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.993769 Aug 04 16:45:14.649075 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 2/3] 10.222.0.93 () {60 vars in 1292 bytes} [Thu Aug 4 16:45:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:17.007912 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-f65423aa-7a2e-4d16-9537-1d830e92c7af None None] Calling method '>' {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:17.008923 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-f65423aa-7a2e-4d16-9537-1d830e92c7af None None] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 04 16:45:17.010249 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 2/4] 10.222.0.93 () {54 vars in 931 bytes} [Thu Aug 4 16:45:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:17.525878 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-1b303ec2-2320-4766-8f81-f77208f1038f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "cirros256", "id": "c1", "rxtx_factor": 1.0, "disk": 1, "ram": 256, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:17.547266 n-d-851359-3 devstack@n-api.service[115769]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:45:17.547266 n-d-851359-3 devstack@n-api.service[115769]: warnings.warn(msg) Aug 04 16:45:17.583650 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-1b303ec2-2320-4766-8f81-f77208f1038f admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.567437 Aug 04 16:45:17.584411 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 3/5] 10.222.0.93 () {64 vars in 1283 bytes} [Thu Aug 4 16:45:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:45:17.807204 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-32a90896-ed9b-4d4a-9422-07e4178b4495 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:17.812405 n-d-851359-3 devstack@n-api.service[115770]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:45:17.812405 n-d-851359-3 devstack@n-api.service[115770]: warnings.warn(msg) Aug 04 16:45:17.816862 n-d-851359-3 devstack@n-api.service[115770]: DEBUG dbcounter [-] [115770] Writing DB stats nova_api:SELECT=3 {{(pid=115770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:45:17.817878 n-d-851359-3 devstack@n-api.service[115770]: DEBUG dbcounter [-] [115770] Writing DB stats nova_cell0:SELECT=3 {{(pid=115770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:45:17.819288 n-d-851359-3 devstack@n-api.service[115770]: DEBUG dbcounter [-] [115770] Writing DB stats nova_cell1:SELECT=3 {{(pid=115770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:45:17.820164 n-d-851359-3 devstack@n-api.service[115770]: DEBUG dbcounter [-] [115770] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:45:17.897068 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-32a90896-ed9b-4d4a-9422-07e4178b4495 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.301322 Aug 04 16:45:17.911474 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 3/6] 10.222.0.93 () {64 vars in 1336 bytes} [Thu Aug 4 16:45:17 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:20.201599 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-1b303ec2-2320-4766-8f81-f77208f1038f admin admin] Calling method '>' {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:20.202806 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-1b303ec2-2320-4766-8f81-f77208f1038f admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001735 Aug 04 16:45:20.203344 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 4/7] 10.222.0.93 () {54 vars in 931 bytes} [Thu Aug 4 16:45:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:20.972468 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-1a4796fd-5b18-4ac4-bd4b-0087811ce0a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "os-flavor-access:is_public": true, "swap": 0, "ram": 512, "vcpus": 1, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "rxtx_factor": 1.0}} {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:20.992989 n-d-851359-3 devstack@n-api.service[115770]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:45:20.992989 n-d-851359-3 devstack@n-api.service[115770]: warnings.warn(msg) Aug 04 16:45:21.014467 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-1a4796fd-5b18-4ac4-bd4b-0087811ce0a0 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.804188 Aug 04 16:45:21.015402 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 4/8] 10.222.0.93 () {64 vars in 1283 bytes} [Thu Aug 4 16:45:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:45:21.028325 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-d16b46e6-b5b2-42e4-ad39-bb452c2f7796 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:21.031382 n-d-851359-3 devstack@n-api.service[115769]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:45:21.031382 n-d-851359-3 devstack@n-api.service[115769]: warnings.warn(msg) Aug 04 16:45:21.067927 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-d16b46e6-b5b2-42e4-ad39-bb452c2f7796 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043113 Aug 04 16:45:21.086024 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 5/9] 10.222.0.93 () {64 vars in 1336 bytes} [Thu Aug 4 16:45:21 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:23.787663 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-1a4796fd-5b18-4ac4-bd4b-0087811ce0a0 admin admin] Calling method '>' {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:23.788712 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-1a4796fd-5b18-4ac4-bd4b-0087811ce0a0 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Aug 04 16:45:23.789374 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 5/10] 10.222.0.93 () {54 vars in 931 bytes} [Thu Aug 4 16:45:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:24.261453 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-249269e3-6375-4db7-bdd0-9f0fa161490f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "ds1G", "id": "d2", "ram": 1024, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 10}} {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:24.294348 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-249269e3-6375-4db7-bdd0-9f0fa161490f admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.498052 Aug 04 16:45:24.295939 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 6/11] 10.222.0.93 () {64 vars in 1283 bytes} [Thu Aug 4 16:45:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:45:24.308540 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-5633f992-c32d-45a4-a93a-fa0ddbc61b20 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:24.336549 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-5633f992-c32d-45a4-a93a-fa0ddbc61b20 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031950 Aug 04 16:45:24.347134 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 6/12] 10.222.0.93 () {64 vars in 1336 bytes} [Thu Aug 4 16:45:24 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:26.759930 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-249269e3-6375-4db7-bdd0-9f0fa161490f admin admin] Calling method '>' {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:26.761473 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-249269e3-6375-4db7-bdd0-9f0fa161490f admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002333 Aug 04 16:45:26.762781 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 7/13] 10.222.0.93 () {54 vars in 931 bytes} [Thu Aug 4 16:45:26 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:27.165779 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-724d614c-6c25-4833-8ffe-4b157a9734ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 2, "swap": 0, "name": "ds2G", "rxtx_factor": 1.0}} {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:27.189212 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-724d614c-6c25-4833-8ffe-4b157a9734ae admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.420140 Aug 04 16:45:27.197020 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 7/14] 10.222.0.93 () {64 vars in 1283 bytes} [Thu Aug 4 16:45:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 16:45:27.203265 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-dc19e67d-d916-4313-9195-614acc66232a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:27.239462 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-dc19e67d-d916-4313-9195-614acc66232a admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040352 Aug 04 16:45:27.254076 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 8/15] 10.222.0.93 () {64 vars in 1336 bytes} [Thu Aug 4 16:45:27 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:29.602045 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-724d614c-6c25-4833-8ffe-4b157a9734ae admin admin] Calling method '>' {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:29.602045 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-724d614c-6c25-4833-8ffe-4b157a9734ae admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 04 16:45:29.607315 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 8/16] 10.222.0.93 () {54 vars in 931 bytes} [Thu Aug 4 16:45:29 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:30.138744 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-3d8cc903-659b-4cdd-95f4-021b02f94945 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "name": "ds4G", "disk": 20, "ram": 4096, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0}} {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:30.160406 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-3d8cc903-659b-4cdd-95f4-021b02f94945 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.552234 Aug 04 16:45:30.161284 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 9/17] 10.222.0.93 () {64 vars in 1283 bytes} [Thu Aug 4 16:45:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 16:45:30.173919 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-9a5f468a-986b-449f-9005-1ae3f8479cfd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:30.205655 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-9a5f468a-986b-449f-9005-1ae3f8479cfd admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036079 Aug 04 16:45:30.206632 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 9/18] 10.222.0.93 () {64 vars in 1336 bytes} [Thu Aug 4 16:45:30 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:45:32.618182 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-3d8cc903-659b-4cdd-95f4-021b02f94945 admin admin] Calling method '>' {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:32.619212 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-3d8cc903-659b-4cdd-95f4-021b02f94945 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Aug 04 16:45:32.619624 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 10/19] 10.222.0.93 () {54 vars in 931 bytes} [Thu Aug 4 16:45:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:33.167593 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-199716f9-b0a2-4eaf-8e81-19446ba80d07 admin admin] Calling method '>' {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:33.200248 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-199716f9-b0a2-4eaf-8e81-19446ba80d07 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.573141 Aug 04 16:45:33.200814 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 10/20] 10.222.0.93 () {60 vars in 1292 bytes} [Thu Aug 4 16:45:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:45:35.584755 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-3d8cc903-659b-4cdd-95f4-021b02f94945 admin admin] Calling method '>' {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:35.585935 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-3d8cc903-659b-4cdd-95f4-021b02f94945 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 04 16:45:35.586238 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 11/21] 10.222.0.93 () {54 vars in 931 bytes} [Thu Aug 4 16:45:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:36.046967 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-e2113eaf-2d1d-4393-95a1-a55fc48fa709 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "name": "m1.tiny", "os-flavor-access:is_public": true, "id": "1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:36.068400 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-e2113eaf-2d1d-4393-95a1-a55fc48fa709 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.475314 Aug 04 16:45:36.069310 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 11/22] 10.222.0.93 () {64 vars in 1283 bytes} [Thu Aug 4 16:45:35 2022] POST /compute/v2.1/flavors => generated 402 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:45:36.086097 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-811f8605-8295-4838-a61c-d3c8422c040e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:36.120229 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-811f8605-8295-4838-a61c-d3c8422c040e admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038255 Aug 04 16:45:36.121384 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 12/23] 10.222.0.93 () {64 vars in 1333 bytes} [Thu Aug 4 16:45:36 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:45:38.570149 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-e2113eaf-2d1d-4393-95a1-a55fc48fa709 admin admin] Calling method '>' {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:38.571335 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-e2113eaf-2d1d-4393-95a1-a55fc48fa709 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001692 Aug 04 16:45:38.571769 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 12/24] 10.222.0.93 () {54 vars in 931 bytes} [Thu Aug 4 16:45:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:39.038985 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-e23d87a1-5248-4a72-97ba-0e52abc9b10c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.small", "swap": 0, "ram": 2048, "rxtx_factor": 1.0, "disk": 20}} {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:39.061553 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-e23d87a1-5248-4a72-97ba-0e52abc9b10c admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.482485 Aug 04 16:45:39.062322 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 13/25] 10.222.0.93 () {64 vars in 1283 bytes} [Thu Aug 4 16:45:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 16:45:39.075000 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-c4f4df5b-def6-4f17-bd5a-976136893d9f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:39.103373 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-c4f4df5b-def6-4f17-bd5a-976136893d9f admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031998 Aug 04 16:45:39.104203 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 13/26] 10.222.0.93 () {64 vars in 1333 bytes} [Thu Aug 4 16:45:39 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:41.648216 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-e23d87a1-5248-4a72-97ba-0e52abc9b10c admin admin] Calling method '>' {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:41.649244 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-e23d87a1-5248-4a72-97ba-0e52abc9b10c admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Aug 04 16:45:41.649809 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 14/27] 10.222.0.93 () {54 vars in 931 bytes} [Thu Aug 4 16:45:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:42.094787 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-98c0815e-e9f9-45e1-8e6a-dcad054cc194 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "disk": 40, "swap": 0, "name": "m1.medium", "id": "3"}} {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:42.113470 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-98c0815e-e9f9-45e1-8e6a-dcad054cc194 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.457133 Aug 04 16:45:42.114052 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 14/28] 10.222.0.93 () {64 vars in 1283 bytes} [Thu Aug 4 16:45:41 2022] POST /compute/v2.1/flavors => generated 406 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:45:42.126586 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-58dc20ea-1958-482c-a1a3-2c79e95d74cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:42.152278 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-58dc20ea-1958-482c-a1a3-2c79e95d74cf admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029826 Aug 04 16:45:42.152867 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 15/29] 10.222.0.93 () {64 vars in 1333 bytes} [Thu Aug 4 16:45:42 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:44.449411 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-98c0815e-e9f9-45e1-8e6a-dcad054cc194 admin admin] Calling method '>' {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:44.450454 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-98c0815e-e9f9-45e1-8e6a-dcad054cc194 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 04 16:45:44.450924 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 15/30] 10.222.0.93 () {54 vars in 931 bytes} [Thu Aug 4 16:45:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:44.841997 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-89e5300a-261f-408c-9256-99cd61ba46e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "vcpus": 4, "name": "m1.large", "rxtx_factor": 1.0, "id": "4", "disk": 80, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:44.849335 n-d-851359-3 devstack@n-api.service[115769]: DEBUG dbcounter [-] [115769] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=115769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:45:44.866743 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-89e5300a-261f-408c-9256-99cd61ba46e8 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.409601 Aug 04 16:45:44.867314 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 16/31] 10.222.0.93 () {64 vars in 1283 bytes} [Thu Aug 4 16:45:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:45:44.880193 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-2528265a-6ab3-4373-bb03-69206c1f3efa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:44.918221 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-2528265a-6ab3-4373-bb03-69206c1f3efa admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042088 Aug 04 16:45:44.918586 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 16/32] 10.222.0.93 () {64 vars in 1333 bytes} [Thu Aug 4 16:45:44 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:45:47.291510 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-89e5300a-261f-408c-9256-99cd61ba46e8 admin admin] Calling method '>' {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:45:47.293754 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-89e5300a-261f-408c-9256-99cd61ba46e8 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003110 Aug 04 16:45:47.294782 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 17/33] 10.222.0.93 () {54 vars in 931 bytes} [Thu Aug 4 16:45:47 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:45:47.825047 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-5dfa90e0-62c6-4bd2-a484-9a6af9b09b31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "disk": 160, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 8, "swap": 0}} {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:47.857063 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-5dfa90e0-62c6-4bd2-a484-9a6af9b09b31 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.551400 Aug 04 16:45:47.857651 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 17/34] 10.222.0.93 () {64 vars in 1283 bytes} [Thu Aug 4 16:45:47 2022] POST /compute/v2.1/flavors => generated 408 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:45:47.871437 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-ae8131b7-5a30-466f-b205-a142437fd0b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:45:47.902620 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-ae8131b7-5a30-466f-b205-a142437fd0b6 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035353 Aug 04 16:45:47.903583 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 18/35] 10.222.0.93 () {64 vars in 1333 bytes} [Thu Aug 4 16:45:47 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:46:11.912053 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-5dfa90e0-62c6-4bd2-a484-9a6af9b09b31 admin admin] Calling method '>' {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:11.913079 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-5dfa90e0-62c6-4bd2-a484-9a6af9b09b31 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001583 Aug 04 16:46:11.913487 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 18/36] 10.222.0.93 () {54 vars in 931 bytes} [Thu Aug 4 16:46:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:46:11.924493 n-d-851359-3 devstack@n-api.service[115769]: DEBUG dbcounter [-] [115769] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=115769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:46:12.338106 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-071a3fd3-5346-4cf2-b3a7-e97ac7a71006 admin admin] Calling method '>' {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:12.356478 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-071a3fd3-5346-4cf2-b3a7-e97ac7a71006 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.436344 Aug 04 16:46:12.356934 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 19/37] 10.222.0.93 () {60 vars in 1292 bytes} [Thu Aug 4 16:46:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:46:13.454043 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-5dfa90e0-62c6-4bd2-a484-9a6af9b09b31 admin admin] Calling method '>' {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:13.455050 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-5dfa90e0-62c6-4bd2-a484-9a6af9b09b31 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 04 16:46:13.455442 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 19/38] 10.222.0.93 () {56 vars in 1074 bytes} [Thu Aug 4 16:46:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:46:14.074207 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-b3d02646-8c77-4a73-a968-02c7a721f40d admin admin] Calling method '>' {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:14.081132 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.wsgi [None req-b3d02646-8c77-4a73-a968-02c7a721f40d admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 16:46:14.084458 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-b3d02646-8c77-4a73-a968-02c7a721f40d admin admin] Request method failure captured: Aug 04 16:46:14.084458 n-d-851359-3 devstack@n-api.service[115769]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 16:46:14.084458 n-d-851359-3 devstack@n-api.service[115769]: Accept: application/json Aug 04 16:46:14.084458 n-d-851359-3 devstack@n-api.service[115769]: Accept-Encoding: gzip, deflate Aug 04 16:46:14.084458 n-d-851359-3 devstack@n-api.service[115769]: Connection: keep-alive Aug 04 16:46:14.084458 n-d-851359-3 devstack@n-api.service[115769]: Content-Length: 0 Aug 04 16:46:14.084458 n-d-851359-3 devstack@n-api.service[115769]: Host: 10.222.0.93 Aug 04 16:46:14.084458 n-d-851359-3 devstack@n-api.service[115769]: Openstack-Api-Version: compute 2.90 Aug 04 16:46:14.084458 n-d-851359-3 devstack@n-api.service[115769]: Openstack-System-Scope: None Aug 04 16:46:14.084458 n-d-851359-3 devstack@n-api.service[115769]: User-Agent: python-novaclient Aug 04 16:46:14.084458 n-d-851359-3 devstack@n-api.service[115769]: X-Auth-Token: gAAAAABi6_fVHLqhQdDbCKOj1k2wRgZ6J7T5Vt54DXqhnzVVkxomEP2izyMqCXFhmSPv6F4B2RziH1TrPROZCLpOh-CVUG1cp_cYVcKRzEh96vtwjglnYaTgEdWliNHvWiqk4nuEmF1c_ls8jKYB4Mt_ZN1ggGZ5reTPphPmatovrV3xLHiWHyM Aug 04 16:46:14.084458 n-d-851359-3 devstack@n-api.service[115769]: X-Domain-Id: None Aug 04 16:46:14.084458 n-d-851359-3 devstack@n-api.service[115769]: X-Domain-Name: None Aug 04 16:46:14.084458 n-d-851359-3 devstack@n-api.service[115769]: X-Identity-Status: Confirmed Aug 04 16:46:14.084458 n-d-851359-3 devstack@n-api.service[115769]: X-Is-Admin-Project: True Aug 04 16:46:14.084458 n-d-851359-3 devstack@n-api.service[115769]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 16:46:14.084458 n-d-851359-3 devstack@n-api.service[115769]: X-Project-Domain-Id: default Aug 04 16:46:14.084458 n-d-851359-3 devstack@n-api.service[115769]: X-Project-Domain-Name: Default Aug 04 16:46:14.084458 n-d-851359-3 devstack@n-api.service[115769]: X-Project-Id: 3e2d96c4b1d54d39bd8bfbf7ebe1a2ed Aug 04 16:46:14.084458 n-d-851359-3 devstack@n-api.service[115769]: X-Project-Name: admin Aug 04 16:46:14.084458 n-d-851359-3 devstack@n-api.service[115769]: X-Role: admin,member,reader Aug 04 16:46:14.084458 n-d-851359-3 devstack@n-api.service[115769]: X-Roles: admin,member,reader Aug 04 16:46:14.086025 n-d-851359-3 devstack@n-api.service[115769]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e2d96c4b1d54d39bd8bfbf7ebe1a2ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e2d96c4b1d54d39bd8bfbf7ebe1a2ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3e2d96c4b1d54d39bd8bfbf7ebe1a2ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3e2d96c4b1d54d39bd8bfbf7ebe1a2ed"}]}] Aug 04 16:46:14.086025 n-d-851359-3 devstack@n-api.service[115769]: X-Tenant: admin Aug 04 16:46:14.086025 n-d-851359-3 devstack@n-api.service[115769]: X-Tenant-Id: 3e2d96c4b1d54d39bd8bfbf7ebe1a2ed Aug 04 16:46:14.086025 n-d-851359-3 devstack@n-api.service[115769]: X-Tenant-Name: admin Aug 04 16:46:14.086025 n-d-851359-3 devstack@n-api.service[115769]: X-User: admin Aug 04 16:46:14.086025 n-d-851359-3 devstack@n-api.service[115769]: X-User-Domain-Id: default Aug 04 16:46:14.086025 n-d-851359-3 devstack@n-api.service[115769]: X-User-Domain-Name: Default Aug 04 16:46:14.086025 n-d-851359-3 devstack@n-api.service[115769]: X-User-Id: 265f6ddd718f458cbd6f6ef5e00044c1 Aug 04 16:46:14.086025 n-d-851359-3 devstack@n-api.service[115769]: X-User-Name: admin Aug 04 16:46:14.086025 n-d-851359-3 devstack@n-api.service[115769]: method: > Aug 04 16:46:14.086025 n-d-851359-3 devstack@n-api.service[115769]: exception: Flavor 42 could not be found. Aug 04 16:46:14.086025 n-d-851359-3 devstack@n-api.service[115769]: action_args: {'id': '42'} Aug 04 16:46:14.086025 n-d-851359-3 devstack@n-api.service[115769]: {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:46:14.086025 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:46:14.086957 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 16:46:14.086957 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 16:46:14.086957 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 16:46:14.086957 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 16:46:14.086957 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:46:14.086957 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:46:14.086957 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 16:46:14.086957 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 16:46:14.086957 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 16:46:14.086957 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:46:14.086957 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 16:46:14.086957 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 16:46:14.086957 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 16:46:14.086957 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi Aug 04 16:46:14.086957 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:46:14.086957 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi Aug 04 16:46:14.086957 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:46:14.086957 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:46:14.086957 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:46:14.088434 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:46:14.088434 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:46:14.088434 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:46:14.088434 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:46:14.088434 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 16:46:14.088434 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:46:14.088434 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 16:46:14.088434 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi Aug 04 16:46:14.088434 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:46:14.088434 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi Aug 04 16:46:14.088434 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:46:14.088434 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:46:14.088434 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:46:14.088434 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:46:14.088434 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:46:14.088434 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 16:46:14.088434 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi Aug 04 16:46:14.088434 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-b3d02646-8c77-4a73-a968-02c7a721f40d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:46:14.090897 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-b3d02646-8c77-4a73-a968-02c7a721f40d admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.452675 Aug 04 16:46:14.090897 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 20/39] 10.222.0.93 () {60 vars in 1190 bytes} [Thu Aug 4 16:46:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 455 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 16:46:14.096589 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-0564eb65-448d-4ebd-a738-da7cb768d975 admin admin] Calling method '>' {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:14.100826 n-d-851359-3 devstack@n-api.service[115770]: DEBUG dbcounter [-] [115770] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=115770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:46:14.120348 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-0564eb65-448d-4ebd-a738-da7cb768d975 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027910 Aug 04 16:46:14.120936 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 20/40] 10.222.0.93 () {60 vars in 1210 bytes} [Thu Aug 4 16:46:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:46:14.140906 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-4b8d5e1b-9dbd-4f84-91a2-c0dbb9182e99 admin admin] Calling method '>' {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:14.165131 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-4b8d5e1b-9dbd-4f84-91a2-c0dbb9182e99 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028564 Aug 04 16:46:14.165681 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 21/41] 10.222.0.93 () {60 vars in 1210 bytes} [Thu Aug 4 16:46:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:46:14.176571 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-3d5ebcfb-8053-4fea-96a0-32ef7c75b7cf admin admin] Calling method '>' {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:14.184045 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.wsgi [None req-3d5ebcfb-8053-4fea-96a0-32ef7c75b7cf admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 16:46:14.188244 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-3d5ebcfb-8053-4fea-96a0-32ef7c75b7cf admin admin] Request method failure captured: Aug 04 16:46:14.188244 n-d-851359-3 devstack@n-api.service[115770]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 16:46:14.188244 n-d-851359-3 devstack@n-api.service[115770]: Accept: application/json Aug 04 16:46:14.188244 n-d-851359-3 devstack@n-api.service[115770]: Accept-Encoding: gzip, deflate Aug 04 16:46:14.188244 n-d-851359-3 devstack@n-api.service[115770]: Connection: keep-alive Aug 04 16:46:14.188244 n-d-851359-3 devstack@n-api.service[115770]: Content-Length: 0 Aug 04 16:46:14.188244 n-d-851359-3 devstack@n-api.service[115770]: Host: 10.222.0.93 Aug 04 16:46:14.188244 n-d-851359-3 devstack@n-api.service[115770]: Openstack-Api-Version: compute 2.90 Aug 04 16:46:14.188244 n-d-851359-3 devstack@n-api.service[115770]: Openstack-System-Scope: None Aug 04 16:46:14.188244 n-d-851359-3 devstack@n-api.service[115770]: User-Agent: python-novaclient Aug 04 16:46:14.188244 n-d-851359-3 devstack@n-api.service[115770]: X-Auth-Token: gAAAAABi6_fVHLqhQdDbCKOj1k2wRgZ6J7T5Vt54DXqhnzVVkxomEP2izyMqCXFhmSPv6F4B2RziH1TrPROZCLpOh-CVUG1cp_cYVcKRzEh96vtwjglnYaTgEdWliNHvWiqk4nuEmF1c_ls8jKYB4Mt_ZN1ggGZ5reTPphPmatovrV3xLHiWHyM Aug 04 16:46:14.188244 n-d-851359-3 devstack@n-api.service[115770]: X-Domain-Id: None Aug 04 16:46:14.188244 n-d-851359-3 devstack@n-api.service[115770]: X-Domain-Name: None Aug 04 16:46:14.188244 n-d-851359-3 devstack@n-api.service[115770]: X-Identity-Status: Confirmed Aug 04 16:46:14.188244 n-d-851359-3 devstack@n-api.service[115770]: X-Is-Admin-Project: True Aug 04 16:46:14.188244 n-d-851359-3 devstack@n-api.service[115770]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 16:46:14.188244 n-d-851359-3 devstack@n-api.service[115770]: X-Project-Domain-Id: default Aug 04 16:46:14.188244 n-d-851359-3 devstack@n-api.service[115770]: X-Project-Domain-Name: Default Aug 04 16:46:14.188244 n-d-851359-3 devstack@n-api.service[115770]: X-Project-Id: 3e2d96c4b1d54d39bd8bfbf7ebe1a2ed Aug 04 16:46:14.188244 n-d-851359-3 devstack@n-api.service[115770]: X-Project-Name: admin Aug 04 16:46:14.188244 n-d-851359-3 devstack@n-api.service[115770]: X-Role: admin,member,reader Aug 04 16:46:14.188244 n-d-851359-3 devstack@n-api.service[115770]: X-Roles: admin,member,reader Aug 04 16:46:14.190311 n-d-851359-3 devstack@n-api.service[115770]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e2d96c4b1d54d39bd8bfbf7ebe1a2ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e2d96c4b1d54d39bd8bfbf7ebe1a2ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3e2d96c4b1d54d39bd8bfbf7ebe1a2ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3e2d96c4b1d54d39bd8bfbf7ebe1a2ed"}]}] Aug 04 16:46:14.190311 n-d-851359-3 devstack@n-api.service[115770]: X-Tenant: admin Aug 04 16:46:14.190311 n-d-851359-3 devstack@n-api.service[115770]: X-Tenant-Id: 3e2d96c4b1d54d39bd8bfbf7ebe1a2ed Aug 04 16:46:14.190311 n-d-851359-3 devstack@n-api.service[115770]: X-Tenant-Name: admin Aug 04 16:46:14.190311 n-d-851359-3 devstack@n-api.service[115770]: X-User: admin Aug 04 16:46:14.190311 n-d-851359-3 devstack@n-api.service[115770]: X-User-Domain-Id: default Aug 04 16:46:14.190311 n-d-851359-3 devstack@n-api.service[115770]: X-User-Domain-Name: Default Aug 04 16:46:14.190311 n-d-851359-3 devstack@n-api.service[115770]: X-User-Id: 265f6ddd718f458cbd6f6ef5e00044c1 Aug 04 16:46:14.190311 n-d-851359-3 devstack@n-api.service[115770]: X-User-Name: admin Aug 04 16:46:14.190311 n-d-851359-3 devstack@n-api.service[115770]: method: > Aug 04 16:46:14.190311 n-d-851359-3 devstack@n-api.service[115770]: exception: Flavor 42 could not be found. Aug 04 16:46:14.190311 n-d-851359-3 devstack@n-api.service[115770]: action_args: {'id': '42'} Aug 04 16:46:14.190311 n-d-851359-3 devstack@n-api.service[115770]: {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:46:14.190311 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:46:14.191506 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 16:46:14.191506 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 16:46:14.191506 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 16:46:14.191506 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 16:46:14.191506 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:46:14.191506 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:46:14.191506 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 16:46:14.191506 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 16:46:14.191506 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 16:46:14.191506 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:46:14.191506 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 16:46:14.191506 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 16:46:14.191506 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 16:46:14.191506 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi Aug 04 16:46:14.191506 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:46:14.191506 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi Aug 04 16:46:14.191506 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:46:14.191506 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:46:14.191506 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:46:14.192877 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:46:14.192877 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:46:14.192877 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:46:14.192877 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:46:14.192877 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 16:46:14.192877 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:46:14.192877 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 16:46:14.192877 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi Aug 04 16:46:14.192877 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:46:14.192877 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi Aug 04 16:46:14.192877 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:46:14.192877 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:46:14.192877 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:46:14.192877 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:46:14.192877 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:46:14.192877 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 16:46:14.192877 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi Aug 04 16:46:14.192877 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-3d5ebcfb-8053-4fea-96a0-32ef7c75b7cf admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:46:14.194206 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-3d5ebcfb-8053-4fea-96a0-32ef7c75b7cf admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.018373 Aug 04 16:46:14.194206 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 21/42] 10.222.0.93 () {60 vars in 1190 bytes} [Thu Aug 4 16:46:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 04 16:46:15.242770 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-4b8d5e1b-9dbd-4f84-91a2-c0dbb9182e99 admin admin] Calling method '>' {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:15.243705 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-4b8d5e1b-9dbd-4f84-91a2-c0dbb9182e99 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Aug 04 16:46:15.244113 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 22/43] 10.222.0.93 () {56 vars in 1074 bytes} [Thu Aug 4 16:46:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:46:15.826183 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-e8ac2994-055b-43f4-978b-29457ff4b35e admin admin] Calling method '>' {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:15.832520 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.wsgi [None req-e8ac2994-055b-43f4-978b-29457ff4b35e admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 16:46:15.837234 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-e8ac2994-055b-43f4-978b-29457ff4b35e admin admin] Request method failure captured: Aug 04 16:46:15.837234 n-d-851359-3 devstack@n-api.service[115770]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 16:46:15.837234 n-d-851359-3 devstack@n-api.service[115770]: Accept: application/json Aug 04 16:46:15.837234 n-d-851359-3 devstack@n-api.service[115770]: Accept-Encoding: gzip, deflate Aug 04 16:46:15.837234 n-d-851359-3 devstack@n-api.service[115770]: Connection: keep-alive Aug 04 16:46:15.837234 n-d-851359-3 devstack@n-api.service[115770]: Content-Length: 0 Aug 04 16:46:15.837234 n-d-851359-3 devstack@n-api.service[115770]: Host: 10.222.0.93 Aug 04 16:46:15.837234 n-d-851359-3 devstack@n-api.service[115770]: Openstack-Api-Version: compute 2.90 Aug 04 16:46:15.837234 n-d-851359-3 devstack@n-api.service[115770]: Openstack-System-Scope: None Aug 04 16:46:15.837234 n-d-851359-3 devstack@n-api.service[115770]: User-Agent: python-novaclient Aug 04 16:46:15.837234 n-d-851359-3 devstack@n-api.service[115770]: X-Auth-Token: gAAAAABi6_fXPntCyDK27nnfoYcPRNrIyjrr8DyyEXe4Fg-P9Xg_Wu0NUgCR-LL5et7eTC_hWFe9VkR21aW2ao5fPWKzGR7XHddH4KamDtjbL5J460AfPLBofMi50ucSNlNeSoJou46Xr7vEFKphaCe5DWo09w--SqrlOy69pZEGvfM2NVr2aXw Aug 04 16:46:15.837234 n-d-851359-3 devstack@n-api.service[115770]: X-Domain-Id: None Aug 04 16:46:15.837234 n-d-851359-3 devstack@n-api.service[115770]: X-Domain-Name: None Aug 04 16:46:15.837234 n-d-851359-3 devstack@n-api.service[115770]: X-Identity-Status: Confirmed Aug 04 16:46:15.837234 n-d-851359-3 devstack@n-api.service[115770]: X-Is-Admin-Project: True Aug 04 16:46:15.837234 n-d-851359-3 devstack@n-api.service[115770]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 16:46:15.837234 n-d-851359-3 devstack@n-api.service[115770]: X-Project-Domain-Id: default Aug 04 16:46:15.837234 n-d-851359-3 devstack@n-api.service[115770]: X-Project-Domain-Name: Default Aug 04 16:46:15.837234 n-d-851359-3 devstack@n-api.service[115770]: X-Project-Id: 3e2d96c4b1d54d39bd8bfbf7ebe1a2ed Aug 04 16:46:15.837234 n-d-851359-3 devstack@n-api.service[115770]: X-Project-Name: admin Aug 04 16:46:15.837234 n-d-851359-3 devstack@n-api.service[115770]: X-Role: admin,member,reader Aug 04 16:46:15.837234 n-d-851359-3 devstack@n-api.service[115770]: X-Roles: admin,member,reader Aug 04 16:46:15.844224 n-d-851359-3 devstack@n-api.service[115770]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e2d96c4b1d54d39bd8bfbf7ebe1a2ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e2d96c4b1d54d39bd8bfbf7ebe1a2ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3e2d96c4b1d54d39bd8bfbf7ebe1a2ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3e2d96c4b1d54d39bd8bfbf7ebe1a2ed"}]}] Aug 04 16:46:15.844224 n-d-851359-3 devstack@n-api.service[115770]: X-Tenant: admin Aug 04 16:46:15.844224 n-d-851359-3 devstack@n-api.service[115770]: X-Tenant-Id: 3e2d96c4b1d54d39bd8bfbf7ebe1a2ed Aug 04 16:46:15.844224 n-d-851359-3 devstack@n-api.service[115770]: X-Tenant-Name: admin Aug 04 16:46:15.844224 n-d-851359-3 devstack@n-api.service[115770]: X-User: admin Aug 04 16:46:15.844224 n-d-851359-3 devstack@n-api.service[115770]: X-User-Domain-Id: default Aug 04 16:46:15.844224 n-d-851359-3 devstack@n-api.service[115770]: X-User-Domain-Name: Default Aug 04 16:46:15.844224 n-d-851359-3 devstack@n-api.service[115770]: X-User-Id: 265f6ddd718f458cbd6f6ef5e00044c1 Aug 04 16:46:15.844224 n-d-851359-3 devstack@n-api.service[115770]: X-User-Name: admin Aug 04 16:46:15.844224 n-d-851359-3 devstack@n-api.service[115770]: method: > Aug 04 16:46:15.844224 n-d-851359-3 devstack@n-api.service[115770]: exception: Flavor 84 could not be found. Aug 04 16:46:15.844224 n-d-851359-3 devstack@n-api.service[115770]: action_args: {'id': '84'} Aug 04 16:46:15.844224 n-d-851359-3 devstack@n-api.service[115770]: {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:46:15.844224 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:46:15.845226 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 16:46:15.845226 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 16:46:15.845226 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 16:46:15.845226 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 16:46:15.845226 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:46:15.845226 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:46:15.845226 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 16:46:15.845226 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 16:46:15.845226 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 16:46:15.845226 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:46:15.845226 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 16:46:15.845226 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 16:46:15.845226 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 16:46:15.845226 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi Aug 04 16:46:15.845226 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:46:15.845226 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi Aug 04 16:46:15.845226 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:46:15.845226 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:46:15.845226 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:46:15.846787 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:46:15.846787 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:46:15.846787 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:46:15.846787 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:46:15.846787 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 16:46:15.846787 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:46:15.846787 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 16:46:15.846787 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi Aug 04 16:46:15.846787 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:46:15.846787 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi Aug 04 16:46:15.846787 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:46:15.846787 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:46:15.846787 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:46:15.846787 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:46:15.846787 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:46:15.846787 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 16:46:15.846787 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi Aug 04 16:46:15.846787 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-e8ac2994-055b-43f4-978b-29457ff4b35e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:46:15.848268 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-e8ac2994-055b-43f4-978b-29457ff4b35e admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.444579 Aug 04 16:46:15.848268 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 22/44] 10.222.0.93 () {60 vars in 1190 bytes} [Thu Aug 4 16:46:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 446 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 16:46:15.849064 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-610660bd-872b-47ca-b1e9-2b9da37cd25c admin admin] Calling method '>' {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:15.865028 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-610660bd-872b-47ca-b1e9-2b9da37cd25c admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022522 Aug 04 16:46:15.865586 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 23/45] 10.222.0.93 () {60 vars in 1210 bytes} [Thu Aug 4 16:46:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:46:15.875909 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-ecc9ef77-55da-4b05-b300-b137bc06b97c admin admin] Calling method '>' {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:15.893161 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-ecc9ef77-55da-4b05-b300-b137bc06b97c admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020912 Aug 04 16:46:15.893724 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 23/46] 10.222.0.93 () {60 vars in 1210 bytes} [Thu Aug 4 16:46:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:46:15.903707 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-d27d2f7c-1d64-4a07-94f0-68567c65561e admin admin] Calling method '>' {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:15.909634 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.wsgi [None req-d27d2f7c-1d64-4a07-94f0-68567c65561e admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 16:46:15.911166 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-d27d2f7c-1d64-4a07-94f0-68567c65561e admin admin] Request method failure captured: Aug 04 16:46:15.911166 n-d-851359-3 devstack@n-api.service[115769]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 16:46:15.911166 n-d-851359-3 devstack@n-api.service[115769]: Accept: application/json Aug 04 16:46:15.911166 n-d-851359-3 devstack@n-api.service[115769]: Accept-Encoding: gzip, deflate Aug 04 16:46:15.911166 n-d-851359-3 devstack@n-api.service[115769]: Connection: keep-alive Aug 04 16:46:15.911166 n-d-851359-3 devstack@n-api.service[115769]: Content-Length: 0 Aug 04 16:46:15.911166 n-d-851359-3 devstack@n-api.service[115769]: Host: 10.222.0.93 Aug 04 16:46:15.911166 n-d-851359-3 devstack@n-api.service[115769]: Openstack-Api-Version: compute 2.90 Aug 04 16:46:15.911166 n-d-851359-3 devstack@n-api.service[115769]: Openstack-System-Scope: None Aug 04 16:46:15.911166 n-d-851359-3 devstack@n-api.service[115769]: User-Agent: python-novaclient Aug 04 16:46:15.911166 n-d-851359-3 devstack@n-api.service[115769]: X-Auth-Token: gAAAAABi6_fXPntCyDK27nnfoYcPRNrIyjrr8DyyEXe4Fg-P9Xg_Wu0NUgCR-LL5et7eTC_hWFe9VkR21aW2ao5fPWKzGR7XHddH4KamDtjbL5J460AfPLBofMi50ucSNlNeSoJou46Xr7vEFKphaCe5DWo09w--SqrlOy69pZEGvfM2NVr2aXw Aug 04 16:46:15.911166 n-d-851359-3 devstack@n-api.service[115769]: X-Domain-Id: None Aug 04 16:46:15.911166 n-d-851359-3 devstack@n-api.service[115769]: X-Domain-Name: None Aug 04 16:46:15.911166 n-d-851359-3 devstack@n-api.service[115769]: X-Identity-Status: Confirmed Aug 04 16:46:15.911166 n-d-851359-3 devstack@n-api.service[115769]: X-Is-Admin-Project: True Aug 04 16:46:15.911166 n-d-851359-3 devstack@n-api.service[115769]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 16:46:15.911166 n-d-851359-3 devstack@n-api.service[115769]: X-Project-Domain-Id: default Aug 04 16:46:15.911166 n-d-851359-3 devstack@n-api.service[115769]: X-Project-Domain-Name: Default Aug 04 16:46:15.911166 n-d-851359-3 devstack@n-api.service[115769]: X-Project-Id: 3e2d96c4b1d54d39bd8bfbf7ebe1a2ed Aug 04 16:46:15.911166 n-d-851359-3 devstack@n-api.service[115769]: X-Project-Name: admin Aug 04 16:46:15.911166 n-d-851359-3 devstack@n-api.service[115769]: X-Role: admin,member,reader Aug 04 16:46:15.911166 n-d-851359-3 devstack@n-api.service[115769]: X-Roles: admin,member,reader Aug 04 16:46:15.912705 n-d-851359-3 devstack@n-api.service[115769]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e2d96c4b1d54d39bd8bfbf7ebe1a2ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e2d96c4b1d54d39bd8bfbf7ebe1a2ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3e2d96c4b1d54d39bd8bfbf7ebe1a2ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3e2d96c4b1d54d39bd8bfbf7ebe1a2ed"}]}] Aug 04 16:46:15.912705 n-d-851359-3 devstack@n-api.service[115769]: X-Tenant: admin Aug 04 16:46:15.912705 n-d-851359-3 devstack@n-api.service[115769]: X-Tenant-Id: 3e2d96c4b1d54d39bd8bfbf7ebe1a2ed Aug 04 16:46:15.912705 n-d-851359-3 devstack@n-api.service[115769]: X-Tenant-Name: admin Aug 04 16:46:15.912705 n-d-851359-3 devstack@n-api.service[115769]: X-User: admin Aug 04 16:46:15.912705 n-d-851359-3 devstack@n-api.service[115769]: X-User-Domain-Id: default Aug 04 16:46:15.912705 n-d-851359-3 devstack@n-api.service[115769]: X-User-Domain-Name: Default Aug 04 16:46:15.912705 n-d-851359-3 devstack@n-api.service[115769]: X-User-Id: 265f6ddd718f458cbd6f6ef5e00044c1 Aug 04 16:46:15.912705 n-d-851359-3 devstack@n-api.service[115769]: X-User-Name: admin Aug 04 16:46:15.912705 n-d-851359-3 devstack@n-api.service[115769]: method: > Aug 04 16:46:15.912705 n-d-851359-3 devstack@n-api.service[115769]: exception: Flavor 84 could not be found. Aug 04 16:46:15.912705 n-d-851359-3 devstack@n-api.service[115769]: action_args: {'id': '84'} Aug 04 16:46:15.912705 n-d-851359-3 devstack@n-api.service[115769]: {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:46:15.912705 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:46:15.913763 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 16:46:15.913763 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 16:46:15.913763 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 16:46:15.913763 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 16:46:15.913763 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:46:15.913763 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:46:15.913763 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 16:46:15.913763 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 16:46:15.913763 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 16:46:15.913763 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:46:15.913763 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 16:46:15.913763 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 16:46:15.913763 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 16:46:15.913763 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi Aug 04 16:46:15.913763 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:46:15.913763 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi Aug 04 16:46:15.913763 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:46:15.913763 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:46:15.913763 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:46:15.915176 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:46:15.915176 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:46:15.915176 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:46:15.915176 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:46:15.915176 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 16:46:15.915176 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:46:15.915176 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 16:46:15.915176 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi Aug 04 16:46:15.915176 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:46:15.915176 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi Aug 04 16:46:15.915176 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:46:15.915176 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:46:15.915176 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:46:15.915176 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:46:15.915176 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:46:15.915176 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 16:46:15.915176 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi Aug 04 16:46:15.915176 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-d27d2f7c-1d64-4a07-94f0-68567c65561e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:46:15.916448 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-d27d2f7c-1d64-4a07-94f0-68567c65561e admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012712 Aug 04 16:46:15.918913 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 24/47] 10.222.0.93 () {60 vars in 1190 bytes} [Thu Aug 4 16:46:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 16:46:16.925021 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-ecc9ef77-55da-4b05-b300-b137bc06b97c admin admin] Calling method '>' {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:16.926083 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-ecc9ef77-55da-4b05-b300-b137bc06b97c admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 04 16:46:16.926516 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 24/48] 10.222.0.93 () {56 vars in 1074 bytes} [Thu Aug 4 16:46:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:46:17.488446 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-ed705de6-f09a-4934-a9d4-1a557b08d894 admin admin] Calling method '>' {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:17.494638 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.wsgi [None req-ed705de6-f09a-4934-a9d4-1a557b08d894 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 16:46:17.496342 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-ed705de6-f09a-4934-a9d4-1a557b08d894 admin admin] Request method failure captured: Aug 04 16:46:17.496342 n-d-851359-3 devstack@n-api.service[115769]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 16:46:17.496342 n-d-851359-3 devstack@n-api.service[115769]: Accept: application/json Aug 04 16:46:17.496342 n-d-851359-3 devstack@n-api.service[115769]: Accept-Encoding: gzip, deflate Aug 04 16:46:17.496342 n-d-851359-3 devstack@n-api.service[115769]: Connection: keep-alive Aug 04 16:46:17.496342 n-d-851359-3 devstack@n-api.service[115769]: Content-Length: 0 Aug 04 16:46:17.496342 n-d-851359-3 devstack@n-api.service[115769]: Host: 10.222.0.93 Aug 04 16:46:17.496342 n-d-851359-3 devstack@n-api.service[115769]: Openstack-Api-Version: compute 2.90 Aug 04 16:46:17.496342 n-d-851359-3 devstack@n-api.service[115769]: Openstack-System-Scope: None Aug 04 16:46:17.496342 n-d-851359-3 devstack@n-api.service[115769]: User-Agent: python-novaclient Aug 04 16:46:17.496342 n-d-851359-3 devstack@n-api.service[115769]: X-Auth-Token: gAAAAABi6_fY0rzR0DbEhzKeBJwCjLR_1xuwGvqQHtkP6rDbYONFZnX8PLRhKXMpYRZvyHfgo5qX1oyKJdrMjo1afYvtTNWyypdDP6R2hb-ZXho9nbc00B2Sa1rV6PnVEZ1zBm9difUkpZuf9UNcnA7SFKkgqbMjM6SHGHHZgmUi3S3Un0LBryA Aug 04 16:46:17.496342 n-d-851359-3 devstack@n-api.service[115769]: X-Domain-Id: None Aug 04 16:46:17.496342 n-d-851359-3 devstack@n-api.service[115769]: X-Domain-Name: None Aug 04 16:46:17.496342 n-d-851359-3 devstack@n-api.service[115769]: X-Identity-Status: Confirmed Aug 04 16:46:17.496342 n-d-851359-3 devstack@n-api.service[115769]: X-Is-Admin-Project: True Aug 04 16:46:17.496342 n-d-851359-3 devstack@n-api.service[115769]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 16:46:17.496342 n-d-851359-3 devstack@n-api.service[115769]: X-Project-Domain-Id: default Aug 04 16:46:17.496342 n-d-851359-3 devstack@n-api.service[115769]: X-Project-Domain-Name: Default Aug 04 16:46:17.496342 n-d-851359-3 devstack@n-api.service[115769]: X-Project-Id: 3e2d96c4b1d54d39bd8bfbf7ebe1a2ed Aug 04 16:46:17.496342 n-d-851359-3 devstack@n-api.service[115769]: X-Project-Name: admin Aug 04 16:46:17.496342 n-d-851359-3 devstack@n-api.service[115769]: X-Role: admin,member,reader Aug 04 16:46:17.496342 n-d-851359-3 devstack@n-api.service[115769]: X-Roles: admin,member,reader Aug 04 16:46:17.498888 n-d-851359-3 devstack@n-api.service[115769]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e2d96c4b1d54d39bd8bfbf7ebe1a2ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e2d96c4b1d54d39bd8bfbf7ebe1a2ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3e2d96c4b1d54d39bd8bfbf7ebe1a2ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3e2d96c4b1d54d39bd8bfbf7ebe1a2ed"}]}] Aug 04 16:46:17.498888 n-d-851359-3 devstack@n-api.service[115769]: X-Tenant: admin Aug 04 16:46:17.498888 n-d-851359-3 devstack@n-api.service[115769]: X-Tenant-Id: 3e2d96c4b1d54d39bd8bfbf7ebe1a2ed Aug 04 16:46:17.498888 n-d-851359-3 devstack@n-api.service[115769]: X-Tenant-Name: admin Aug 04 16:46:17.498888 n-d-851359-3 devstack@n-api.service[115769]: X-User: admin Aug 04 16:46:17.498888 n-d-851359-3 devstack@n-api.service[115769]: X-User-Domain-Id: default Aug 04 16:46:17.498888 n-d-851359-3 devstack@n-api.service[115769]: X-User-Domain-Name: Default Aug 04 16:46:17.498888 n-d-851359-3 devstack@n-api.service[115769]: X-User-Id: 265f6ddd718f458cbd6f6ef5e00044c1 Aug 04 16:46:17.498888 n-d-851359-3 devstack@n-api.service[115769]: X-User-Name: admin Aug 04 16:46:17.498888 n-d-851359-3 devstack@n-api.service[115769]: method: > Aug 04 16:46:17.498888 n-d-851359-3 devstack@n-api.service[115769]: exception: Flavor 451 could not be found. Aug 04 16:46:17.498888 n-d-851359-3 devstack@n-api.service[115769]: action_args: {'id': '451'} Aug 04 16:46:17.498888 n-d-851359-3 devstack@n-api.service[115769]: {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:46:17.498888 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:46:17.500152 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 16:46:17.500152 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 16:46:17.500152 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 16:46:17.500152 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 16:46:17.500152 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:46:17.500152 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:46:17.500152 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 16:46:17.500152 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 16:46:17.500152 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 16:46:17.500152 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:46:17.500152 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 16:46:17.500152 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 16:46:17.500152 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 16:46:17.500152 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi Aug 04 16:46:17.500152 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:46:17.500152 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi Aug 04 16:46:17.500152 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:46:17.500152 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:46:17.500152 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:46:17.501541 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:46:17.501541 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:46:17.501541 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:46:17.501541 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:46:17.501541 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 16:46:17.501541 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:46:17.501541 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 16:46:17.501541 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi Aug 04 16:46:17.501541 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:46:17.501541 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi Aug 04 16:46:17.501541 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:46:17.501541 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:46:17.501541 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:46:17.501541 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:46:17.501541 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:46:17.501541 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 16:46:17.501541 n-d-851359-3 devstack@n-api.service[115769]: ERROR nova.api.openstack.wsgi Aug 04 16:46:17.501541 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-ed705de6-f09a-4934-a9d4-1a557b08d894 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:46:17.502850 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-ed705de6-f09a-4934-a9d4-1a557b08d894 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.433232 Aug 04 16:46:17.502850 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 25/49] 10.222.0.93 () {60 vars in 1193 bytes} [Thu Aug 4 16:46:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 434 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 16:46:17.509056 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-28dab63d-4c65-4be1-bb21-4f1e76b69380 admin admin] Calling method '>' {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:17.524635 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-28dab63d-4c65-4be1-bb21-4f1e76b69380 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019991 Aug 04 16:46:17.525196 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 25/50] 10.222.0.93 () {60 vars in 1210 bytes} [Thu Aug 4 16:46:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:46:17.535825 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-1986c78a-6e12-4e5d-b637-3791655b8b39 admin admin] Calling method '>' {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:17.566900 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-1986c78a-6e12-4e5d-b637-3791655b8b39 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.034656 Aug 04 16:46:17.567566 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 26/51] 10.222.0.93 () {60 vars in 1210 bytes} [Thu Aug 4 16:46:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:46:17.578246 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-ea3d5b16-fff7-425b-a625-e6170d737e6c admin admin] Calling method '>' {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:17.584270 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.wsgi [None req-ea3d5b16-fff7-425b-a625-e6170d737e6c admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 16:46:17.585813 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-ea3d5b16-fff7-425b-a625-e6170d737e6c admin admin] Request method failure captured: Aug 04 16:46:17.585813 n-d-851359-3 devstack@n-api.service[115770]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 16:46:17.585813 n-d-851359-3 devstack@n-api.service[115770]: Accept: application/json Aug 04 16:46:17.585813 n-d-851359-3 devstack@n-api.service[115770]: Accept-Encoding: gzip, deflate Aug 04 16:46:17.585813 n-d-851359-3 devstack@n-api.service[115770]: Connection: keep-alive Aug 04 16:46:17.585813 n-d-851359-3 devstack@n-api.service[115770]: Content-Length: 0 Aug 04 16:46:17.585813 n-d-851359-3 devstack@n-api.service[115770]: Host: 10.222.0.93 Aug 04 16:46:17.585813 n-d-851359-3 devstack@n-api.service[115770]: Openstack-Api-Version: compute 2.90 Aug 04 16:46:17.585813 n-d-851359-3 devstack@n-api.service[115770]: Openstack-System-Scope: None Aug 04 16:46:17.585813 n-d-851359-3 devstack@n-api.service[115770]: User-Agent: python-novaclient Aug 04 16:46:17.585813 n-d-851359-3 devstack@n-api.service[115770]: X-Auth-Token: gAAAAABi6_fY0rzR0DbEhzKeBJwCjLR_1xuwGvqQHtkP6rDbYONFZnX8PLRhKXMpYRZvyHfgo5qX1oyKJdrMjo1afYvtTNWyypdDP6R2hb-ZXho9nbc00B2Sa1rV6PnVEZ1zBm9difUkpZuf9UNcnA7SFKkgqbMjM6SHGHHZgmUi3S3Un0LBryA Aug 04 16:46:17.585813 n-d-851359-3 devstack@n-api.service[115770]: X-Domain-Id: None Aug 04 16:46:17.585813 n-d-851359-3 devstack@n-api.service[115770]: X-Domain-Name: None Aug 04 16:46:17.585813 n-d-851359-3 devstack@n-api.service[115770]: X-Identity-Status: Confirmed Aug 04 16:46:17.585813 n-d-851359-3 devstack@n-api.service[115770]: X-Is-Admin-Project: True Aug 04 16:46:17.585813 n-d-851359-3 devstack@n-api.service[115770]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 16:46:17.585813 n-d-851359-3 devstack@n-api.service[115770]: X-Project-Domain-Id: default Aug 04 16:46:17.585813 n-d-851359-3 devstack@n-api.service[115770]: X-Project-Domain-Name: Default Aug 04 16:46:17.585813 n-d-851359-3 devstack@n-api.service[115770]: X-Project-Id: 3e2d96c4b1d54d39bd8bfbf7ebe1a2ed Aug 04 16:46:17.585813 n-d-851359-3 devstack@n-api.service[115770]: X-Project-Name: admin Aug 04 16:46:17.585813 n-d-851359-3 devstack@n-api.service[115770]: X-Role: admin,member,reader Aug 04 16:46:17.585813 n-d-851359-3 devstack@n-api.service[115770]: X-Roles: admin,member,reader Aug 04 16:46:17.588239 n-d-851359-3 devstack@n-api.service[115770]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e2d96c4b1d54d39bd8bfbf7ebe1a2ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e2d96c4b1d54d39bd8bfbf7ebe1a2ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3e2d96c4b1d54d39bd8bfbf7ebe1a2ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3e2d96c4b1d54d39bd8bfbf7ebe1a2ed"}]}] Aug 04 16:46:17.588239 n-d-851359-3 devstack@n-api.service[115770]: X-Tenant: admin Aug 04 16:46:17.588239 n-d-851359-3 devstack@n-api.service[115770]: X-Tenant-Id: 3e2d96c4b1d54d39bd8bfbf7ebe1a2ed Aug 04 16:46:17.588239 n-d-851359-3 devstack@n-api.service[115770]: X-Tenant-Name: admin Aug 04 16:46:17.588239 n-d-851359-3 devstack@n-api.service[115770]: X-User: admin Aug 04 16:46:17.588239 n-d-851359-3 devstack@n-api.service[115770]: X-User-Domain-Id: default Aug 04 16:46:17.588239 n-d-851359-3 devstack@n-api.service[115770]: X-User-Domain-Name: Default Aug 04 16:46:17.588239 n-d-851359-3 devstack@n-api.service[115770]: X-User-Id: 265f6ddd718f458cbd6f6ef5e00044c1 Aug 04 16:46:17.588239 n-d-851359-3 devstack@n-api.service[115770]: X-User-Name: admin Aug 04 16:46:17.588239 n-d-851359-3 devstack@n-api.service[115770]: method: > Aug 04 16:46:17.588239 n-d-851359-3 devstack@n-api.service[115770]: exception: Flavor 451 could not be found. Aug 04 16:46:17.588239 n-d-851359-3 devstack@n-api.service[115770]: action_args: {'id': '451'} Aug 04 16:46:17.588239 n-d-851359-3 devstack@n-api.service[115770]: {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:46:17.588239 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:46:17.589726 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 16:46:17.589726 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 16:46:17.589726 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 16:46:17.589726 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 16:46:17.589726 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:46:17.589726 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:46:17.589726 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 16:46:17.589726 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 16:46:17.589726 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 16:46:17.589726 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:46:17.589726 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 16:46:17.589726 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 16:46:17.589726 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 16:46:17.589726 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi Aug 04 16:46:17.589726 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:46:17.589726 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi Aug 04 16:46:17.589726 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:46:17.589726 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:46:17.589726 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:46:17.591971 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:46:17.591971 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:46:17.591971 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:46:17.591971 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:46:17.591971 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 16:46:17.591971 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:46:17.591971 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 16:46:17.591971 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi Aug 04 16:46:17.591971 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:46:17.591971 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi Aug 04 16:46:17.591971 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:46:17.591971 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:46:17.591971 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:46:17.591971 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:46:17.591971 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:46:17.591971 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 16:46:17.591971 n-d-851359-3 devstack@n-api.service[115770]: ERROR nova.api.openstack.wsgi Aug 04 16:46:17.591971 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-ea3d5b16-fff7-425b-a625-e6170d737e6c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:46:17.594319 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-ea3d5b16-fff7-425b-a625-e6170d737e6c admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013286 Aug 04 16:46:17.594319 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 26/52] 10.222.0.93 () {60 vars in 1193 bytes} [Thu Aug 4 16:46:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 16:46:18.568210 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-1986c78a-6e12-4e5d-b637-3791655b8b39 admin admin] Calling method '>' {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:18.569256 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-1986c78a-6e12-4e5d-b637-3791655b8b39 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 04 16:46:18.569710 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 27/53] 10.222.0.93 () {56 vars in 1074 bytes} [Thu Aug 4 16:46:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:46:19.100509 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-7eec4063-54bb-4e98-8aa1-82846adccc10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:19.119491 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-7eec4063-54bb-4e98-8aa1-82846adccc10 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.412199 Aug 04 16:46:19.120047 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 27/54] 10.222.0.93 () {64 vars in 1235 bytes} [Thu Aug 4 16:46:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:46:20.111193 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-1986c78a-6e12-4e5d-b637-3791655b8b39 admin admin] Calling method '>' {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:20.112263 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-1986c78a-6e12-4e5d-b637-3791655b8b39 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Aug 04 16:46:20.112663 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 28/55] 10.222.0.93 () {56 vars in 1074 bytes} [Thu Aug 4 16:46:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:46:20.633505 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-185ca4b9-e72e-4b66-94cb-0e845747a61e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:20.652248 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-185ca4b9-e72e-4b66-94cb-0e845747a61e admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.403337 Aug 04 16:46:20.652793 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 28/56] 10.222.0.93 () {64 vars in 1235 bytes} [Thu Aug 4 16:46:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:46:21.656074 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-1986c78a-6e12-4e5d-b637-3791655b8b39 admin admin] Calling method '>' {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:21.657087 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-1986c78a-6e12-4e5d-b637-3791655b8b39 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002129 Aug 04 16:46:21.657498 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 29/57] 10.222.0.93 () {56 vars in 1074 bytes} [Thu Aug 4 16:46:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:46:22.196794 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-fe9680a8-a004-4fb5-a57c-e65189492df4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:22.215407 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-fe9680a8-a004-4fb5-a57c-e65189492df4 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.421711 Aug 04 16:46:22.215944 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 29/58] 10.222.0.93 () {64 vars in 1235 bytes} [Thu Aug 4 16:46:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:46:23.323674 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-1986c78a-6e12-4e5d-b637-3791655b8b39 admin admin] Calling method '>' {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:23.324766 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-1986c78a-6e12-4e5d-b637-3791655b8b39 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 Aug 04 16:46:23.325190 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 30/59] 10.222.0.93 () {56 vars in 1074 bytes} [Thu Aug 4 16:46:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:46:23.858989 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-56375ca8-4a0b-4afe-a2b8-b50a286fd4ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:46:23.877145 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-56375ca8-4a0b-4afe-a2b8-b50a286fd4ad admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.411672 Aug 04 16:46:23.877695 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 30/60] 10.222.0.93 () {64 vars in 1235 bytes} [Thu Aug 4 16:46:23 2022] POST /compute/v2.1/flavors => generated 409 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:46:24.970641 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-1986c78a-6e12-4e5d-b637-3791655b8b39 admin admin] Calling method '>' {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:24.971686 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-1986c78a-6e12-4e5d-b637-3791655b8b39 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001619 Aug 04 16:46:24.972098 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 31/61] 10.222.0.93 () {56 vars in 1074 bytes} [Thu Aug 4 16:46:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:46:25.525232 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-0f37e0d0-25ce-49fe-9372-f385b1b73bab admin admin] Calling method '>' {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:46:25.547581 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-0f37e0d0-25ce-49fe-9372-f385b1b73bab admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.433116 Aug 04 16:46:25.548134 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 31/62] 10.222.0.93 () {60 vars in 1202 bytes} [Thu Aug 4 16:46:25 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:47:18.428935 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-1986c78a-6e12-4e5d-b637-3791655b8b39 admin admin] Calling method '>' {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:18.429947 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-1986c78a-6e12-4e5d-b637-3791655b8b39 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 04 16:47:18.430394 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 32/63] 10.222.0.93 () {54 vars in 931 bytes} [Thu Aug 4 16:47:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:47:18.443990 n-d-851359-3 devstack@n-api.service[115770]: DEBUG dbcounter [-] [115770] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=115770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:47:18.877992 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-07034735-e948-4a74-8485-2dbadd3bf91a admin admin] Calling method '>' {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:18.898377 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-07034735-e948-4a74-8485-2dbadd3bf91a admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.459483 Aug 04 16:47:18.898933 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 32/64] 10.222.0.93 () {60 vars in 1292 bytes} [Thu Aug 4 16:47:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:47:18.921435 n-d-851359-3 devstack@n-api.service[115769]: DEBUG dbcounter [-] [115769] Writing DB stats nova_api:SELECT=14 {{(pid=115769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:47:18.925410 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-1b0b1a00-079c-494c-b1d9-1725e73613d5 admin admin] Calling method '>' {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:18.933281 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-1b0b1a00-079c-494c-b1d9-1725e73613d5 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013208 Aug 04 16:47:18.933812 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 33/65] 10.222.0.93 () {60 vars in 1283 bytes} [Thu Aug 4 16:47:18 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:47:18.946120 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-ad88be92-36db-43f3-af38-7f2370125476 admin admin] Calling method '>' {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:18.953910 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-ad88be92-36db-43f3-af38-7f2370125476 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011518 Aug 04 16:47:18.954490 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 33/66] 10.222.0.93 () {60 vars in 1286 bytes} [Thu Aug 4 16:47:18 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:47:18.966963 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-8e507dd3-6e93-4284-9b23-312e20793b5c admin admin] Calling method '>' {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:18.974738 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-8e507dd3-6e93-4284-9b23-312e20793b5c admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012009 Aug 04 16:47:18.975293 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 34/67] 10.222.0.93 () {60 vars in 1286 bytes} [Thu Aug 4 16:47:18 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:47:18.987647 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-88fabcff-6803-4253-a397-5401a5da8ef8 admin admin] Calling method '>' {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:47:18.995394 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-88fabcff-6803-4253-a397-5401a5da8ef8 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011388 Aug 04 16:47:18.995928 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 34/68] 10.222.0.93 () {60 vars in 1283 bytes} [Thu Aug 4 16:47:18 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:52:48.176080 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-8e507dd3-6e93-4284-9b23-312e20793b5c admin admin] Calling method '>' {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:48.177173 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-8e507dd3-6e93-4284-9b23-312e20793b5c admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 Aug 04 16:52:48.177650 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 35/69] 10.222.0.93 () {56 vars in 1074 bytes} [Thu Aug 4 16:52:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:52:48.319382 n-d-851359-3 devstack@n-api.service[115770]: DEBUG dbcounter [-] [115770] Writing DB stats nova_api:SELECT=6 {{(pid=115770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:52:48.466642 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-438fc1d1-dc98-45c2-8d13-5f88b5a15933 admin admin] Calling method '>' {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:48.469114 n-d-851359-3 devstack@n-api.service[115770]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:52:48.469114 n-d-851359-3 devstack@n-api.service[115770]: warnings.warn(msg) Aug 04 16:52:48.470291 n-d-851359-3 devstack@n-api.service[115770]: DEBUG oslo_concurrency.lockutils [None req-438fc1d1-dc98-45c2-8d13-5f88b5a15933 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:52:48.470793 n-d-851359-3 devstack@n-api.service[115770]: DEBUG oslo_concurrency.lockutils [None req-438fc1d1-dc98-45c2-8d13-5f88b5a15933 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:52:48.471219 n-d-851359-3 devstack@n-api.service[115770]: DEBUG oslo_concurrency.lockutils [None req-438fc1d1-dc98-45c2-8d13-5f88b5a15933 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:52:48.472198 n-d-851359-3 devstack@n-api.service[115770]: DEBUG oslo_concurrency.lockutils [None req-438fc1d1-dc98-45c2-8d13-5f88b5a15933 admin admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:52:48.472697 n-d-851359-3 devstack@n-api.service[115770]: DEBUG oslo_concurrency.lockutils [None req-438fc1d1-dc98-45c2-8d13-5f88b5a15933 admin admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:52:48.473158 n-d-851359-3 devstack@n-api.service[115770]: DEBUG oslo_concurrency.lockutils [None req-438fc1d1-dc98-45c2-8d13-5f88b5a15933 admin admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:52:48.513682 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-438fc1d1-dc98-45c2-8d13-5f88b5a15933 admin admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.195644 Aug 04 16:52:48.514281 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 35/70] 10.222.0.93 () {60 vars in 1193 bytes} [Thu Aug 4 16:52:48 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:52:49.350492 n-d-851359-3 devstack@n-api.service[115769]: DEBUG nova.api.openstack.wsgi [None req-8e507dd3-6e93-4284-9b23-312e20793b5c admin admin] Calling method '>' {{(pid=115769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:49.351536 n-d-851359-3 devstack@n-api.service[115769]: INFO nova.api.openstack.requestlog [None req-8e507dd3-6e93-4284-9b23-312e20793b5c admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 04 16:52:49.351960 n-d-851359-3 devstack@n-api.service[115769]: [pid: 115769|app: 0|req: 36/71] 10.222.0.93 () {56 vars in 1074 bytes} [Thu Aug 4 16:52:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:52:49.547749 n-d-851359-3 devstack@n-api.service[115770]: DEBUG nova.api.openstack.wsgi [None req-e84893f8-ddc4-4043-92f7-0be38fd3f422 admin admin] Calling method '>' {{(pid=115770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:52:49.550592 n-d-851359-3 devstack@n-api.service[115770]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:52:49.550592 n-d-851359-3 devstack@n-api.service[115770]: warnings.warn(msg) Aug 04 16:52:49.551745 n-d-851359-3 devstack@n-api.service[115770]: DEBUG oslo_concurrency.lockutils [None req-e84893f8-ddc4-4043-92f7-0be38fd3f422 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:52:49.552221 n-d-851359-3 devstack@n-api.service[115770]: DEBUG oslo_concurrency.lockutils [None req-e84893f8-ddc4-4043-92f7-0be38fd3f422 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:52:49.552661 n-d-851359-3 devstack@n-api.service[115770]: DEBUG oslo_concurrency.lockutils [None req-e84893f8-ddc4-4043-92f7-0be38fd3f422 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:52:49.553372 n-d-851359-3 devstack@n-api.service[115770]: DEBUG oslo_concurrency.lockutils [None req-e84893f8-ddc4-4043-92f7-0be38fd3f422 admin admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:52:49.553819 n-d-851359-3 devstack@n-api.service[115770]: DEBUG oslo_concurrency.lockutils [None req-e84893f8-ddc4-4043-92f7-0be38fd3f422 admin admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:52:49.554342 n-d-851359-3 devstack@n-api.service[115770]: DEBUG oslo_concurrency.lockutils [None req-e84893f8-ddc4-4043-92f7-0be38fd3f422 admin admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:52:49.577810 n-d-851359-3 devstack@n-api.service[115770]: INFO nova.api.openstack.requestlog [None req-e84893f8-ddc4-4043-92f7-0be38fd3f422 admin admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.085051 Aug 04 16:52:49.578428 n-d-851359-3 devstack@n-api.service[115770]: [pid: 115770|app: 0|req: 36/72] 10.222.0.93 () {60 vars in 1193 bytes} [Thu Aug 4 16:52:49 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:53:37.002252 n-d-851359-3 devstack@n-api.service[115768]: Thu Aug 4 16:53:37 2022 - graceful shutdown triggered... Aug 04 16:53:37.002806 n-d-851359-3 devstack@n-api.service[115769]: Gracefully killing worker 1 (pid: 115769)... Aug 04 16:53:37.003171 n-d-851359-3 devstack@n-api.service[115770]: Gracefully killing worker 2 (pid: 115770)... Aug 04 16:53:37.004610 n-d-851359-3 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 04 16:53:38.003477 n-d-851359-3 devstack@n-api.service[115768]: worker 1 buried after 1 seconds Aug 04 16:53:38.003477 n-d-851359-3 devstack@n-api.service[115768]: worker 2 buried after 1 seconds Aug 04 16:53:38.003477 n-d-851359-3 devstack@n-api.service[115768]: goodbye to uWSGI. Aug 04 16:53:38.005051 n-d-851359-3 systemd[1]: devstack@n-api.service: Succeeded. Aug 04 16:53:38.005616 n-d-851359-3 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 04 16:53:38.008579 n-d-851359-3 systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 16:53:38.029968 n-d-851359-3 devstack@n-api.service[131031]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 16:53:38.050458 n-d-851359-3 devstack@n-api.service[131031]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 16:53:38 2022] *** Aug 04 16:53:38.050803 n-d-851359-3 devstack@n-api.service[131031]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 16:53:38.051139 n-d-851359-3 devstack@n-api.service[131031]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 16:53:38.051279 n-d-851359-3 devstack@n-api.service[131031]: nodename: n-d-851359-3 Aug 04 16:53:38.051409 n-d-851359-3 devstack@n-api.service[131031]: machine: x86_64 Aug 04 16:53:38.051513 n-d-851359-3 devstack@n-api.service[131031]: clock source: unix Aug 04 16:53:38.051616 n-d-851359-3 devstack@n-api.service[131031]: pcre jit disabled Aug 04 16:53:38.051710 n-d-851359-3 devstack@n-api.service[131031]: detected number of CPU cores: 4 Aug 04 16:53:38.051834 n-d-851359-3 devstack@n-api.service[131031]: current working directory: / Aug 04 16:53:38.051970 n-d-851359-3 devstack@n-api.service[131031]: detected binary path: /usr/bin/uwsgi-core Aug 04 16:53:38.052109 n-d-851359-3 devstack@n-api.service[131031]: your processes number limit is 47680 Aug 04 16:53:38.052294 n-d-851359-3 devstack@n-api.service[131031]: your memory page size is 4096 bytes Aug 04 16:53:38.052426 n-d-851359-3 devstack@n-api.service[131031]: detected max file descriptor number: 2048 Aug 04 16:53:38.052549 n-d-851359-3 devstack@n-api.service[131031]: lock engine: pthread robust mutexes Aug 04 16:53:38.052844 n-d-851359-3 devstack@n-api.service[131031]: thunder lock: enabled Aug 04 16:53:38.053180 n-d-851359-3 devstack@n-api.service[131031]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 16:53:38.053370 n-d-851359-3 devstack@n-api.service[131031]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 16:53:38.095990 n-d-851359-3 devstack@n-api.service[131031]: Python main interpreter initialized at 0x5556690cf9c0 Aug 04 16:53:38.095990 n-d-851359-3 devstack@n-api.service[131031]: python threads support enabled Aug 04 16:53:38.095990 n-d-851359-3 devstack@n-api.service[131031]: your server socket listen backlog is limited to 100 connections Aug 04 16:53:38.095990 n-d-851359-3 devstack@n-api.service[131031]: your mercy for graceful operations on workers is 90 seconds Aug 04 16:53:38.096491 n-d-851359-3 devstack@n-api.service[131031]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 16:53:38.096491 n-d-851359-3 devstack@n-api.service[131031]: *** Operational MODE: preforking *** Aug 04 16:53:38.096693 n-d-851359-3 devstack@n-api.service[131031]: *** uWSGI is running in multiple interpreter mode *** Aug 04 16:53:38.096693 n-d-851359-3 devstack@n-api.service[131031]: spawned uWSGI master process (pid: 131031) Aug 04 16:53:38.096901 n-d-851359-3 systemd[1]: Started Devstack devstack@n-api.service. Aug 04 16:53:38.098014 n-d-851359-3 devstack@n-api.service[131031]: spawned uWSGI worker 1 (pid: 131043, cores: 1) Aug 04 16:53:38.098014 n-d-851359-3 devstack@n-api.service[131031]: spawned uWSGI worker 2 (pid: 131044, cores: 1) Aug 04 16:53:38.098225 n-d-851359-3 devstack@n-api.service[131031]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 16:53:38.776682 n-d-851359-3 devstack@n-api.service[131043]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 16:53:38.777308 n-d-851359-3 devstack@n-api.service[131044]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 16:53:39.982325 n-d-851359-3 devstack@n-api.service[131043]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 16:53:39.982325 n-d-851359-3 devstack@n-api.service[131043]: from cryptography.utils import int_from_bytes Aug 04 16:53:39.982931 n-d-851359-3 devstack@n-api.service[131043]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 16:53:39.982931 n-d-851359-3 devstack@n-api.service[131043]: from cryptography.utils import int_from_bytes Aug 04 16:53:40.022479 n-d-851359-3 devstack@n-api.service[131044]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 16:53:40.022479 n-d-851359-3 devstack@n-api.service[131044]: from cryptography.utils import int_from_bytes Aug 04 16:53:40.023209 n-d-851359-3 devstack@n-api.service[131044]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 16:53:40.023209 n-d-851359-3 devstack@n-api.service[131044]: from cryptography.utils import int_from_bytes Aug 04 16:53:42.350775 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 16:53:42.351319 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 16:53:42.351475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 16:53:42.351846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 16:53:42.352104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 16:53:42.353040 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.353371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.353696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.354042 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.354383 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.354700 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.355024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.355347 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.355679 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.355945 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.356263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.356593 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-851359-3 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.356921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.357230 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.357543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.357863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.358214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.358541 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.358852 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.359353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.359797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.360106 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.360419 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.360758 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.361077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.361384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.361724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.362039 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.362365 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.362680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.363082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-851359-3 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.363400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.363717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.364035 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.364452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.364767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.365079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.365405 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.365730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.366062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.366406 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.366731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.367053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.367377 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.367682 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.368022 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.368934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.369260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.369570 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.369880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.370163 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.370477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.370802 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.371128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.371453 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.371710 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.371964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.372286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.372610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.372925 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.373234 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.373542 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.373850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.374182 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.374493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.374801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.375111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.375432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.375749 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.376073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.376382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.376707 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.377107 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.93 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.377365 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.93 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.377675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.378034 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.378359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.378670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.378991 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.379313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.379619 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.379925 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.380232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.380552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.380888 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.381194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.381448 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.381753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.382088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.382405 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.382713 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.383023 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.383332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.383662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.383975 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.384284 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.384593 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.384899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.385205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.385512 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.385822 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.386156 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.386465 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.386788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.387111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.387419 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.387727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.388034 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.388342 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.388665 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.388972 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.389279 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.389598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.389906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.390237 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.390559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.390868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.391175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.391495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.391799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.392107 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.392427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.392742 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.393050 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.393355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.393661 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.393965 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.394293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.394598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.394904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.395208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.395527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.395849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.396159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.396466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.396772 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.397093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.397428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.397847 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.398144 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.398540 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.398793 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.399129 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.399985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.400301 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.400620 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.400950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.401265 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.401580 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.401893 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.402237 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.402560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.402897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.403217 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.403537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.403856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.404169 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.404488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.404823 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.405145 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.405460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.405805 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.406176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.406496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.406826 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.407153 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.407467 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.407780 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.408093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.408419 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.408753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.409067 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.409387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.409699 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.410031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.410348 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.410663 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.410975 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.411314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.411631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.411948 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.412262 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.412579 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.412900 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.413211 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.413524 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.413831 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.414166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.414476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.414788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.415677 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.416000 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.416332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.416643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.416979 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.417290 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.417604 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.417915 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.418255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.418566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.418881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.419192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.419501 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.419828 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.420141 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.420451 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.420776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.421084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.421393 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.421710 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.422044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.422359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.422672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.422994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.423318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.423632 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.423944 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.424281 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.424614 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.424923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.425250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.425576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.425895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.426240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.426580 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.426888 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.427196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.427565 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.427812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.428118 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.428425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.428731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.429037 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.429343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.429669 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.430263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.430390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.430796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.431142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.431490 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.431801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.432147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.432486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.432816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.433145 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.433456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.433774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.434113 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.434429 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.435010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.435325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.435649 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.435962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.436309 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.436621 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.436948 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.437261 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.437582 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.437890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.438234 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.438575 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.438909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.439227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.439554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.439867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.440185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.440496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.440810 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.441120 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.441433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.441754 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.442091 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.442413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.442725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.443051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.443363 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.443682 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.443991 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.444307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.444634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.444969 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.445282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.445595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.445918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.446287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.446604 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.446917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.447226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.447535 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.447846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.448162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.448472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.448784 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.449091 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.449405 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.449717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.450049 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.450358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.450674 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.450999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.451343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.451641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.451980 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.452287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.452595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.452929 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.453240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.453547 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.453855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.454185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.454530 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.454844 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.455151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.455471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.455794 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.456105 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.456444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.456756 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.457065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.457390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.457705 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.458039 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.458353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.458665 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.458976 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.459286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.459612 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.459924 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.460236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.460547 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.460854 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.461168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.461484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.462892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.463503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.464101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.464701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.465314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.465886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.466545 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.467167 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.467840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.468193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.468523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.468878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.469205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.469527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.469863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.470287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.470516 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.470837 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.471152 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.471466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.471781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.472095 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.472421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.472738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.473058 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.473387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.473779 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.474131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.474404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.474798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.474959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.475306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.475628 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.475972 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.476307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.476658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.476972 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.477283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.478219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.478541 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.478852 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.479161 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.479477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.479689 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 16:53:42.480383 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.480538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 16:53:42.480778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.480778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.481078 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 16:53:42.481176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.481277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 16:53:42.481361 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.481512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 16:53:42.481620 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.481620 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.481857 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.481959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.482203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.482453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.482563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.482790 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.482883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.483116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.483210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.483428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.483549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.483742 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.483853 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.484051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.484151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.484360 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.484459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.484748 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.484836 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.484971 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.485153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.485268 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.485373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.485581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.485729 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-851359-3 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.485874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.486159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.486264 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.486362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.486507 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.486603 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.486818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.486929 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.487123 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.487226 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.487453 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.487548 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.487765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.487870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.488072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.488297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.488413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.488617 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.488746 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.488932 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.489036 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.489250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.489353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.489560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.489718 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.489890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.490016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.490239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.490349 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.490549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.490674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.490862 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.490982 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.491171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.491306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.491476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.491630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.491768 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.492046 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-851359-3 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.492182 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.492372 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.492471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.492704 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.492802 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.493086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.493201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.493423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.493592 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.493930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.494112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.494209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.494310 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.494464 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.494605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.494728 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.494982 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.495121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.495290 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.495412 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.495654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.495779 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.495963 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.496093 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.496328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.496453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.496638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.496782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.496957 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.497092 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.497281 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.497422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.497595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.497738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.497907 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.498054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.498259 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.498384 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.498545 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.498667 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.498877 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.499011 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.499126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.499239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.499414 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.499551 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.499748 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.499892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.500055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.500192 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.500314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.500734 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.500917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.501066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.501201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.501336 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.501488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.501632 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.501781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.501898 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.502020 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.502142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.502246 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.502424 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.502534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.502737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.502853 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.503079 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.503229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.503416 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.503536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.503722 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.503830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.504019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.504131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.504332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.504444 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.504649 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.504752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.504964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.505068 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.505278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.505379 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.505591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.505740 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.93 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.505900 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.506027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.93 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.506440 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.506604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.506825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.506964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.507093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.507221 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.507484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.507650 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.507774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.507899 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.508042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.508175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.508493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.508832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.508993 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.509145 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.509265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.509731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.509874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.509874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.510166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.510314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.510443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.510711 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.510865 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.511029 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.511181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.511329 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.511470 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.511614 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.511777 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.511909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.512040 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.512170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.512318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.512451 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.512581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.512721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.512860 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.512989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.513159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.513306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.513433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.513569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.513724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.513855 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.514143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.514343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.514606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.514776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.514910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.515054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.515195 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.515338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.515467 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.515604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.515734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.515864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.516001 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.516152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.516293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.516420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.516554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.516658 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.516752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.516836 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.517077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.517171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.517390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.517492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.517701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.517800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.518048 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.518156 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.518364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.518464 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.518700 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.518834 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.519008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.519110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.519321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.519413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.519647 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.519740 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.519960 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.520053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.520272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.520364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.520580 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.520688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.520895 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.521027 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.521208 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.521341 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.521525 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.521666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.521842 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.522017 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.522181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.522327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.522490 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.522637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.522826 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.522959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.523137 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.523266 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.523460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.523606 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.523792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.523921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.524123 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.524941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.525077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.525190 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.525325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.525450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.525611 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.525744 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.525927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.526138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.526275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.526403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.526568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.526707 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.526874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.527012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 16:53:42.527182 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.527325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.527508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.527663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.527897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.528043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.528189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.528301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.528412 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.528520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.528719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.528857 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.529027 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.529183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.529332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.529505 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.529656 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.529827 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.529962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.530186 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.530315 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.530507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.530635 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.530825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.530962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.531143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.531288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.531469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.531597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.531794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.531923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.532133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.532269 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.532460 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.532593 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.532784 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.532975 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.533135 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.533312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.533488 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.533658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.533826 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.534055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.534270 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.534587 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.534793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.535155 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.535330 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.535509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.535509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.535870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.536056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.536231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.536414 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.536599 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.536799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.536978 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.537153 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.537309 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.537480 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.537638 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.537806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.537968 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.538155 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.538333 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.538506 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.538691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.538865 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.539047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.539227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.539394 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.539569 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.539696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.539817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.539964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.540598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.540720 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.540839 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.540960 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.541073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.541182 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.541300 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.541410 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.541526 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.541645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.541756 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.541865 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.542009 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.542151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.542295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.542422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.542542 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.542652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.542762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.542870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.543008 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.543127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.543245 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.543355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.543471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.543598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.543717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.543827 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.543946 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.544075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.544247 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.544416 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.544585 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.544787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.544977 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.545349 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.545525 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.545694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.545894 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.546177 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.546366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.546551 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.546730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.546916 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.547133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.547328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.547506 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.547681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.547854 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.548045 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.548220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.548404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.548404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.548754 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.548943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.549139 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.549325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.549500 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.549677 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.549861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.550070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.550264 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.550456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.550654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.550857 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.551048 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.551255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.551450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.551646 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.551849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.551981 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.552118 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.552263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.552408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.552539 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.552674 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.552805 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.552941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.553085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.553223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.553360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.553491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.553626 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.553857 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.554018 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.554155 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.554277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.554396 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.554522 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.554698 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.554846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.554990 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.555107 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.555591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.555747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.555940 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.556105 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.556297 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.556476 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.556663 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.556853 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.557038 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.557217 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.557403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.557561 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.557721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.557890 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.558072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.558234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.558409 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.558573 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.558741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.558943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.559132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.559300 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.559456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.559866 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.560045 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.560236 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.560421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.560612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.560800 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.560960 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.561139 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.561323 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.561512 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.561688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.561865 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.562120 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.562406 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.562592 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.562592 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.562948 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.563152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.563336 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.563557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.563889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.564092 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.564275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.564454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.564635 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.564819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.564992 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.565171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.565171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.565576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.565720 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.565849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.565961 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.566157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.566271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.566383 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.566509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.566665 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.566783 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.566896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.567007 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.567119 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.567245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.567358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.567469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.567581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.567731 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.567861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.567976 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.568087 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.568208 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.568329 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.568440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.568440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.568667 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.568787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.568898 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.569016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.569016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.569355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.569480 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.569592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.569703 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.569822 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.569933 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.570090 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.570205 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.570316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.570426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.570534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.570653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.570765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.570875 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.570992 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.571134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.571260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.571388 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.571499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.571610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.571727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.571839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.571956 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.572096 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.572330 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.572451 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.572582 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.572727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.572874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.573005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.573142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.573312 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.573486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.573683 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.573845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.574055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.574189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.574318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.574492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.574638 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.574776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.574919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.575046 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.575180 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.575309 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.575452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.575610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.575837 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.575962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.576086 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.576210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.576351 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.576481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.576613 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.576741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.576869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.577005 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.577147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.577285 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.577413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.577542 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.577678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.577822 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.577951 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.578093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.578093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.578337 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.578337 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.578592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.578592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.578838 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.578838 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.579090 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.579223 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.579369 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.579506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.579635 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.579771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.579899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.580028 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.580169 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.580299 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.580433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.580621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.580756 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.580936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.581070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.581248 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.581520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.581654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.581854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.582023 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.582206 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.582306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.582559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.582708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.582869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.582988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.583192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.583318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.583511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.583843 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.584161 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.584377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.584546 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.584707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.584827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.585042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.585437 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.585554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.585722 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.585722 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.586118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.586246 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.586367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.586486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.586605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.587407 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.587540 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.587658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.587831 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.587951 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.588075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.588195 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.588316 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.588427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.588538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.588649 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.588818 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.588953 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.589184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.589319 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.589502 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.589687 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.589828 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.589965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.590325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.590693 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.591086 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.591225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.591538 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.591771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.591906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.594017 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.594166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.594166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.594327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.594420 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.594503 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.594579 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.594660 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.594749 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.594867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.594955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.594955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.595145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.595223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.595313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.595411 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.595509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.595601 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.595687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.595794 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.595891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.595967 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.596047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.596131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.596213 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.596321 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.596865 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.596993 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.597080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.597212 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.597363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.597447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.597528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.597610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.597824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.597903 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.598453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.598615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.598706 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.598790 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.598872 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.598946 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.599063 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.599225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.599386 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.599527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.599693 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.599947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.600158 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.600306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.600438 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.600575 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.600705 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.600889 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.601030 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.601168 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.601304 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.601434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.601575 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.601722 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.601852 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.602054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.602187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.603089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.603236 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.603387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.603519 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.603648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.603779 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.603916 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.604063 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.604194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.604413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.604555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.604731 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.604874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.605045 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.605187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.605354 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.605487 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.605663 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.605797 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.605968 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.606139 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.606305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.606439 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.606608 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.606742 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.606913 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.607055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.607217 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.607358 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.607537 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.607682 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.607853 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.607987 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.608167 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.608301 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.608482 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.608644 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.608862 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.609089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.609089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.609359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.609487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.609608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.609728 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.609865 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.610022 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.610155 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.610364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.610525 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.610657 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.610774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.610974 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.611095 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.611288 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.611417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.611598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.611736 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.611909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.612047 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.612219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.612360 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.612529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.612660 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.612839 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.612974 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.613231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.613374 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.613504 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.613633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.613768 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.613912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.614091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.614232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.614377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.614512 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.614710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.614853 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.615027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.615160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.615337 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.615471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.615648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.615796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.615962 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.616104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.616272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.616406 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.616578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.616719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.616888 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.617027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.617198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.617332 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.617514 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.617649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.617825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.618008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.618183 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.618328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.618492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.618638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.618809 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.618948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.619239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.619360 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.619575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.619741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.619834 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.619920 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.620036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.620166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.622112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.622233 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.622316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.622415 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.622494 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.622583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.622666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.622742 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.622816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.622889 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.622962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.623044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.623126 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.623201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.623293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.623293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=131043) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 16:53:42.623500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.623500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.623500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.623945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.624612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.625013 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.625412 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.625845 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.626284 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.626682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.627072 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.627478 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.627864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.628272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.628659 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.629042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.629455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.629851 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.630283 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.630690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.631147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.631570 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.631950 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.632345 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.632738 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.633147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.633617 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.633996 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.634381 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.634777 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.635249 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.635642 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.636033 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.636423 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.636839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.637264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.637653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.638114 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.638524 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.638912 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.639303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.639689 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.640084 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.640467 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.640999 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.641395 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.641780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.642185 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.642613 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.643009 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.643396 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.643888 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.644352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.644877 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.645303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.645727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.646234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.646619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.647039 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.647438 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.647869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.648277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.648666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.649049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.650013 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.650400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.650849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.651389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.651784 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.652181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.652692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.653084 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.653478 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.653882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.654311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.654757 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.655164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.655564 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.655985 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.656411 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.656820 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.657208 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.657605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.658013 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.658417 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.658823 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.659220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.659623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.660147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.660578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.660969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.661374 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.661781 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.662196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.662583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.662987 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.663361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.663740 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.664151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.664534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.665525 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.665877 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.666354 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.666737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.667125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.667532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.667925 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.668333 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.668709 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.669108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.669509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.669924 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.670352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.670743 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.671127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.671536 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.671920 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.672346 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.672732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.673132 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.673546 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.673954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.674366 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.674779 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.675187 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.675583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.675976 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.676400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.676785 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.677167 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.677556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.677948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.678346 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.678734 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.679118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.679498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.679880 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.680261 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.680706 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.681086 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.705207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.705207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.705207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.705207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.705207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.705207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.705207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.705207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.715390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.715390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.715390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.715390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.715390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.715390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.715390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.715390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.716443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.716443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.716443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.716443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.716443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.716443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.716443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.716443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.717782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.717782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.717782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.717782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.717782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.717782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.717782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.717782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.718810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.718810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.718810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.718810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.718810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.718810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.718810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.718810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.720112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.720112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.720112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.720112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.720112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.720112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.720112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.720921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.720921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.720921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.720921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.720921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.720921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.720921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.720921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.721841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.721841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.721841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.721841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.721841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.721841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.721841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.721841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.723042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.723042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.723042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.723042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.723042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.723042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.723042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.723042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.723959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.723959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.723959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.723959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.723959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.723959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.723959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.723959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.725165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.725165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.725165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.725165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.725165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.725165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.725165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.725165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.726170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.726170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.726170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.726170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.726170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.726170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.726170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.726170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.729450 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.729450 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.729450 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.729450 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.730684 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.730684 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.730684 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.730684 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.731173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.731299 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.731574 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.732117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.732579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.737998 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.737998 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.737998 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.737998 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.737998 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.737998 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.737998 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.737998 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.738456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.738456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.738456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.738456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.738456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.738456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.738456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.738456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.739500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.740001 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.740489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.740853 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.741205 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.741540 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.741866 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.742243 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.742587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.742915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.743271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.743596 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.743919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.744242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.744565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.744891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.745230 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.745532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.745848 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.746194 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.746516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.746835 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.747156 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.747482 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.747837 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.748167 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.748551 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.748956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.749122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.749442 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.749760 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.750114 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.750419 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.750742 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.751084 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.751416 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.751732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.752201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.752523 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.752849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.753241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.753492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.753822 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.754178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.754498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.754826 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.755145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.755486 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.755833 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.756170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.756505 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.756823 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.757138 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.757452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.757768 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.758149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.758494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.759455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.759688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.760008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.760401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.760638 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.760998 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.761317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.761633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.762597 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.762597 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.762869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.763083 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.763480 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.763819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.764139 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.764498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.764812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.765194 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.765549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.765965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.766389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.766787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.767128 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.767588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.767869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.768275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.768595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.768983 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.769319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.769690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.770021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.770558 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.770906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.771277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.771663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.771988 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.772334 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.772868 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.773239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.773580 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.773960 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.774315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.775155 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.775486 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.775816 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.776136 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.776520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.776848 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.777117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.777433 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.777753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.778094 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.778744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.778744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.779113 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.779441 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.779848 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.780154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.780524 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.780836 n-d-851359-3 devstack@n-api.service[131043]: INFO dbcounter [None req-a49e6d59-90ec-46fd-a129-c6b47968ffb0 None None] Registered counter for database nova_api Aug 04 16:53:42.780982 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.781197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.781585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.781969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.782313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.782670 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.783007 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.783331 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.783654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.783967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 16:53:42.784219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 16:53:42.804294 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_db.sqlalchemy.engines [None req-a49e6d59-90ec-46fd-a129-c6b47968ffb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131043) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:53:42.812175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writer thread running {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 16:53:42.881456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.context [None req-a49e6d59-90ec-46fd-a129-c6b47968ffb0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),435e901d-6672-4284-ad57-58e647e6e99d(cell1) {{(pid=131043) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 16:53:42.887463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a49e6d59-90ec-46fd-a129-c6b47968ffb0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:53:42.887981 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a49e6d59-90ec-46fd-a129-c6b47968ffb0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:53:42.889711 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a49e6d59-90ec-46fd-a129-c6b47968ffb0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:53:42.890498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a49e6d59-90ec-46fd-a129-c6b47968ffb0 None None] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:53:42.890953 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a49e6d59-90ec-46fd-a129-c6b47968ffb0 None None] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:53:42.892982 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a49e6d59-90ec-46fd-a129-c6b47968ffb0 None None] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:53:42.895085 n-d-851359-3 devstack@n-api.service[131043]: INFO dbcounter [None req-a49e6d59-90ec-46fd-a129-c6b47968ffb0 None None] Registered counter for database nova_cell0 Aug 04 16:53:42.899996 n-d-851359-3 devstack@n-api.service[131043]: INFO dbcounter [None req-a49e6d59-90ec-46fd-a129-c6b47968ffb0 None None] Registered counter for database nova_cell1 Aug 04 16:53:42.907282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_db.sqlalchemy.engines [None req-a49e6d59-90ec-46fd-a129-c6b47968ffb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131043) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:53:42.911248 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_db.sqlalchemy.engines [None req-a49e6d59-90ec-46fd-a129-c6b47968ffb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131043) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:53:42.919026 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writer thread running {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 16:53:42.921930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writer thread running {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 16:53:42.942320 n-d-851359-3 devstack@n-api.service[131044]: INFO dbcounter [None req-be631ae5-81d3-42f3-94c9-3e98e2eff80a None None] Registered counter for database nova_api Aug 04 16:53:42.963605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_db.sqlalchemy.engines [None req-be631ae5-81d3-42f3-94c9-3e98e2eff80a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131044) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:53:42.971830 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writer thread running {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 16:53:43.030749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.context [None req-be631ae5-81d3-42f3-94c9-3e98e2eff80a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),435e901d-6672-4284-ad57-58e647e6e99d(cell1) {{(pid=131044) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 16:53:43.034874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be631ae5-81d3-42f3-94c9-3e98e2eff80a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:53:43.035366 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be631ae5-81d3-42f3-94c9-3e98e2eff80a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:53:43.036948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be631ae5-81d3-42f3-94c9-3e98e2eff80a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:53:43.037691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be631ae5-81d3-42f3-94c9-3e98e2eff80a None None] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:53:43.038185 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be631ae5-81d3-42f3-94c9-3e98e2eff80a None None] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:53:43.040220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be631ae5-81d3-42f3-94c9-3e98e2eff80a None None] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:53:43.042285 n-d-851359-3 devstack@n-api.service[131044]: INFO dbcounter [None req-be631ae5-81d3-42f3-94c9-3e98e2eff80a None None] Registered counter for database nova_cell0 Aug 04 16:53:43.046370 n-d-851359-3 devstack@n-api.service[131044]: INFO dbcounter [None req-be631ae5-81d3-42f3-94c9-3e98e2eff80a None None] Registered counter for database nova_cell1 Aug 04 16:53:43.053720 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_db.sqlalchemy.engines [None req-be631ae5-81d3-42f3-94c9-3e98e2eff80a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131044) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:53:43.056239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_db.sqlalchemy.engines [None req-be631ae5-81d3-42f3-94c9-3e98e2eff80a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131044) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:53:43.065275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writer thread running {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 16:53:43.065621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writer thread running {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 16:53:43.069957 n-d-851359-3 devstack@n-api.service[131043]: INFO dbcounter [None req-a49e6d59-90ec-46fd-a129-c6b47968ffb0 None None] Registered counter for database nova_cell0 Aug 04 16:53:43.078485 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_db.sqlalchemy.engines [None req-a49e6d59-90ec-46fd-a129-c6b47968ffb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131043) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:53:43.083744 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writer thread running {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 16:53:43.216523 n-d-851359-3 devstack@n-api.service[131044]: INFO dbcounter [None req-be631ae5-81d3-42f3-94c9-3e98e2eff80a None None] Registered counter for database nova_cell0 Aug 04 16:53:43.223727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_db.sqlalchemy.engines [None req-be631ae5-81d3-42f3-94c9-3e98e2eff80a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131044) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 16:53:43.230068 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writer thread running {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 16:53:43.412741 n-d-851359-3 devstack@n-api.service[131043]: WARNING keystonemiddleware.auth_token [None req-a49e6d59-90ec-46fd-a129-c6b47968ffb0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 16:53:43.420076 n-d-851359-3 devstack@n-api.service[131043]: WARNING keystonemiddleware.auth_token [None req-a49e6d59-90ec-46fd-a129-c6b47968ffb0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 16:53:43.561620 n-d-851359-3 devstack@n-api.service[131044]: WARNING keystonemiddleware.auth_token [None req-be631ae5-81d3-42f3-94c9-3e98e2eff80a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 16:53:43.569222 n-d-851359-3 devstack@n-api.service[131044]: WARNING keystonemiddleware.auth_token [None req-be631ae5-81d3-42f3-94c9-3e98e2eff80a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 16:53:43.759714 n-d-851359-3 devstack@n-api.service[131043]: WARNING keystonemiddleware.auth_token [None req-a49e6d59-90ec-46fd-a129-c6b47968ffb0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 16:53:43.766100 n-d-851359-3 devstack@n-api.service[131043]: WARNING keystonemiddleware.auth_token [None req-a49e6d59-90ec-46fd-a129-c6b47968ffb0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 16:53:43.772692 n-d-851359-3 devstack@n-api.service[131043]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5556690cf9c0 pid: 131043 (default app) Aug 04 16:53:43.920266 n-d-851359-3 devstack@n-api.service[131044]: WARNING keystonemiddleware.auth_token [None req-be631ae5-81d3-42f3-94c9-3e98e2eff80a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 16:53:43.928097 n-d-851359-3 devstack@n-api.service[131044]: WARNING keystonemiddleware.auth_token [None req-be631ae5-81d3-42f3-94c9-3e98e2eff80a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 16:53:43.935342 n-d-851359-3 devstack@n-api.service[131044]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5556690cf9c0 pid: 131044 (default app) Aug 04 16:54:21.301946 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:21.302818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:21.303689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:21.304639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:22.583867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-86353465-34cc-424f-a959-bd1b6e769959 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:22.588639 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:22.588639 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:22.589924 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86353465-34cc-424f-a959-bd1b6e769959 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:22.590484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86353465-34cc-424f-a959-bd1b6e769959 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:22.590930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86353465-34cc-424f-a959-bd1b6e769959 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:22.591698 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86353465-34cc-424f-a959-bd1b6e769959 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:22.592159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86353465-34cc-424f-a959-bd1b6e769959 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:22.592658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86353465-34cc-424f-a959-bd1b6e769959 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:22.644071 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-86353465-34cc-424f-a959-bd1b6e769959 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 1.346362 Aug 04 16:54:22.644071 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1/1] 10.222.0.93 () {58 vars in 1176 bytes} [Thu Aug 4 16:54:21 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:22.657299 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:22.658346 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:22.659323 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:22.660200 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:22.878439 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7ba4bcec-dd52-41fc-baf4-fd3e840c6c30 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2068450614"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:22.909083 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:22.909083 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:22.910446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.aggregate [None req-7ba4bcec-dd52-41fc-baf4-fd3e840c6c30 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Generated uuid f7671de6-bdca-4fa4-8763-0cd41f8a7541 for aggregate {{(pid=131044) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:54:22.988650 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7ba4bcec-dd52-41fc-baf4-fd3e840c6c30 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.336757 Aug 04 16:54:22.989763 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1/2] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Aug 4 16:54:22 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:23.008459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-453493e3-6a17-4445-86f2-73a449770776 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-851359-3"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:23.011901 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:23.011901 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:23.048663 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-453493e3-6a17-4445-86f2-73a449770776 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:23.049157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-453493e3-6a17-4445-86f2-73a449770776 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:23.049592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-453493e3-6a17-4445-86f2-73a449770776 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:24.130486 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-453493e3-6a17-4445-86f2-73a449770776 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 242 microversion: 2.1 time: 1.132621 Aug 04 16:54:24.131168 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2/3] 10.222.0.93 () {60 vars in 1191 bytes} [Thu Aug 4 16:54:22 2022] POST /compute/v2.1/os-aggregates/1/action => generated 242 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:24.144190 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6a3a1bdd-fdb3-4ecf-b34f-e30ef1d2d152 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-851359-3"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:24.148519 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:24.148519 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:24.157812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a3a1bdd-fdb3-4ecf-b34f-e30ef1d2d152 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:24.158540 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a3a1bdd-fdb3-4ecf-b34f-e30ef1d2d152 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:24.159157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a3a1bdd-fdb3-4ecf-b34f-e30ef1d2d152 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:24.188311 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-6a3a1bdd-fdb3-4ecf-b34f-e30ef1d2d152 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h1-851359-3. Aug 04 16:54:24.204346 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6a3a1bdd-fdb3-4ecf-b34f-e30ef1d2d152 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Request method failure captured: Aug 04 16:54:24.204346 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Aug 04 16:54:24.204346 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:54:24.204346 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:54:24.204346 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:54:24.204346 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 39 Aug 04 16:54:24.204346 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:54:24.204346 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:54:24.204346 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:54:24.204346 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:54:24.204346 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_m9Tv6QiivKEMChPpOLItHNNFsJXscm9k7GEUP1tWt-LzWbhM_1l9-QMLVNME1zq-Fzx7y8xp3UA45wgOR5vud8QzK6C3YOwuoDZYJfXQVceavqnx2TU2ERCZrq2KXRjmXspKqKxfqBALs4mmoW5_PLA_XHYMRtX5Nd-40A4a-KKFw Aug 04 16:54:24.204346 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:54:24.204346 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:54:24.204346 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:54:24.204346 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:54:24.204346 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:54:24.204346 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:54:24.204346 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: c0ff0891bc7f431dad4e3c76db7dcd0e Aug 04 16:54:24.204346 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1218587882 Aug 04 16:54:24.204346 n-d-851359-3 devstack@n-api.service[131043]: X-Role: admin,member,reader Aug 04 16:54:24.204346 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: admin,member,reader Aug 04 16:54:24.205741 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c0ff0891bc7f431dad4e3c76db7dcd0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c0ff0891bc7f431dad4e3c76db7dcd0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c0ff0891bc7f431dad4e3c76db7dcd0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c0ff0891bc7f431dad4e3c76db7dcd0e"}]}] Aug 04 16:54:24.205741 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1218587882 Aug 04 16:54:24.205741 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: c0ff0891bc7f431dad4e3c76db7dcd0e Aug 04 16:54:24.205741 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1218587882 Aug 04 16:54:24.205741 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin Aug 04 16:54:24.205741 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:54:24.205741 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:54:24.205741 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 7d62c764c03e49499952b26f619ed6ef Aug 04 16:54:24.205741 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin Aug 04 16:54:24.205741 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 16:54:24.205741 n-d-851359-3 devstack@n-api.service[131043]: {"add_host": {"host": "n-h1-851359-3"}} Aug 04 16:54:24.205741 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 16:54:24.205741 n-d-851359-3 devstack@n-api.service[131043]: exception: Aggregate 1 already has host n-h1-851359-3. Aug 04 16:54:24.206654 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h1-851359-3'}}} Aug 04 16:54:24.206654 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:54:24.206654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:24.206654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 16:54:24.206654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 04 16:54:24.206654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 16:54:24.206654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 04 16:54:24.206654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 16:54:24.206654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 04 16:54:24.206654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 16:54:24.206654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 04 16:54:24.206654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 16:54:24.206654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 16:54:24.206654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 16:54:24.206654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result.read() Aug 04 16:54:24.206654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 16:54:24.206654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 04 16:54:24.206654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 16:54:24.206654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 04 16:54:24.207729 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 16:54:24.207729 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 04 16:54:24.207729 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 16:54:24.207729 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 04 16:54:24.207729 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-851359-3-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 04 16:54:24.207729 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:24.207729 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 04 16:54:24.207729 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:24.207729 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:24.207729 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 04 16:54:24.207729 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 04 16:54:24.207729 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 04 16:54:24.207729 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi session.flush() Aug 04 16:54:24.207729 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 16:54:24.207729 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 04 16:54:24.207729 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 16:54:24.207729 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 04 16:54:24.207729 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 16:54:24.207729 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 04 16:54:24.208865 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 16:54:24.208865 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception Aug 04 16:54:24.208865 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 16:54:24.208865 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 04 16:54:24.208865 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 16:54:24.208865 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 04 16:54:24.208865 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 16:54:24.208865 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 04 16:54:24.208865 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 16:54:24.208865 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 04 16:54:24.208865 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 04 16:54:24.208865 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 04 16:54:24.208865 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 16:54:24.208865 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 16:54:24.208865 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 16:54:24.208865 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 04 16:54:24.208865 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 16:54:24.208865 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 04 16:54:24.210471 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 16:54:24.210471 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 04 16:54:24.210471 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 16:54:24.210471 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 16:54:24.210471 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 16:54:24.210471 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception Aug 04 16:54:24.210471 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 16:54:24.210471 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 04 16:54:24.210471 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 16:54:24.210471 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 04 16:54:24.210471 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 16:54:24.210471 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 04 16:54:24.210471 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 16:54:24.210471 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 04 16:54:24.210471 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 16:54:24.210471 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 16:54:24.210471 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 16:54:24.210471 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result.read() Aug 04 16:54:24.211388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 16:54:24.211388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 04 16:54:24.211388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 16:54:24.211388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 04 16:54:24.211388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 16:54:24.211388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 04 16:54:24.211388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 16:54:24.211388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 04 16:54:24.211388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-851359-3-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 04 16:54:24.211388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 04 16:54:24.211388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 4, 16, 54, 24, 174162), 'updated_at': None, 'host': 'n-h1-851359-3', 'aggregate_id': 1}] Aug 04 16:54:24.211388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 16:54:24.211388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:24.211388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:24.211388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:24.211388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:24.211388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 04 16:54:24.212323 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 04 16:54:24.212323 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 16:54:24.212323 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 16:54:24.212323 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:54:24.212323 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:54:24.212323 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:54:24.212323 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:54:24.212323 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 16:54:24.212323 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 16:54:24.212323 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6594, in add_host_to_aggregate Aug 04 16:54:24.212323 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 04 16:54:24.212323 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 04 16:54:24.212323 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 04 16:54:24.212323 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 04 16:54:24.212323 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 04 16:54:24.212323 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 04 16:54:24.212323 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 04 16:54:24.212323 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h1-851359-3. Aug 04 16:54:24.212323 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:24.212323 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:24.213443 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:24.213443 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:24.213443 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:24.213443 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:24.213443 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:54:24.213443 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:54:24.213443 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:54:24.213443 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:54:24.213443 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:54:24.213443 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:54:24.213443 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 04 16:54:24.213443 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 04 16:54:24.213443 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h1-851359-3. Aug 04 16:54:24.213443 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:24.213443 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:24.213443 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:24.213443 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:24.213443 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:24.213443 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:24.213443 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:54:24.213443 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:54:24.217401 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h1-851359-3. Aug 04 16:54:24.217401 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:24.217401 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6a3a1bdd-fdb3-4ecf-b34f-e30ef1d2d152 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Returning 409 to user: Aggregate 1 already has host n-h1-851359-3. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:54:24.217401 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6a3a1bdd-fdb3-4ecf-b34f-e30ef1d2d152 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.076386 Aug 04 16:54:24.217401 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3/4] 10.222.0.93 () {60 vars in 1191 bytes} [Thu Aug 4 16:54:24 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 377 bytes (2 switches on core 0) Aug 04 16:54:24.227294 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cca4ca52-4d9c-4a7d-aa20-a088d33f73ce tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-851359-3"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:24.230118 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:24.230118 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:24.238949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cca4ca52-4d9c-4a7d-aa20-a088d33f73ce tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:24.239439 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cca4ca52-4d9c-4a7d-aa20-a088d33f73ce tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:24.239880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cca4ca52-4d9c-4a7d-aa20-a088d33f73ce tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:24.367327 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cca4ca52-4d9c-4a7d-aa20-a088d33f73ce tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 0.146073 Aug 04 16:54:24.373832 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 4/5] 10.222.0.93 () {60 vars in 1191 bytes} [Thu Aug 4 16:54:24 2022] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:54:24.379093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-eb7589ea-6dde-479f-a75d-a1e8f9c39d56 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:24.379934 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:24.379934 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:24.405876 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-eb7589ea-6dde-479f-a75d-a1e8f9c39d56 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.030347 Aug 04 16:54:24.406743 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 5/6] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Aug 4 16:54:24 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 04 16:54:24.416247 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f168dba7-b2b6-4ad7-817f-fab485df8f18 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-700102316"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:24.436153 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:24.436153 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:24.437193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.aggregate [None req-f168dba7-b2b6-4ad7-817f-fab485df8f18 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Generated uuid 08bafbc9-6eda-4f5d-8b5f-a0b479ef21ec for aggregate {{(pid=131043) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:54:24.467488 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f168dba7-b2b6-4ad7-817f-fab485df8f18 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.054914 Aug 04 16:54:24.468267 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 6/7] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Aug 4 16:54:24 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:24.802546 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3f31c72d-32b0-4db8-9176-c5bf3884be19 tempest-AggregatesAdminTestV241-229300565 tempest-AggregatesAdminTestV241-229300565-project-admin] Calling method '.version_select at 0x7f1e6a159550>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:24.805270 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:24.805270 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:24.812866 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3f31c72d-32b0-4db8-9176-c5bf3884be19 tempest-AggregatesAdminTestV241-229300565 tempest-AggregatesAdminTestV241-229300565-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),435e901d-6672-4284-ad57-58e647e6e99d(cell1) {{(pid=131044) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 04 16:54:24.813607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f31c72d-32b0-4db8-9176-c5bf3884be19 tempest-AggregatesAdminTestV241-229300565 tempest-AggregatesAdminTestV241-229300565-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:24.814125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f31c72d-32b0-4db8-9176-c5bf3884be19 tempest-AggregatesAdminTestV241-229300565 tempest-AggregatesAdminTestV241-229300565-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:24.814565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f31c72d-32b0-4db8-9176-c5bf3884be19 tempest-AggregatesAdminTestV241-229300565 tempest-AggregatesAdminTestV241-229300565-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:24.846294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f31c72d-32b0-4db8-9176-c5bf3884be19 tempest-AggregatesAdminTestV241-229300565 tempest-AggregatesAdminTestV241-229300565-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:24.846800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f31c72d-32b0-4db8-9176-c5bf3884be19 tempest-AggregatesAdminTestV241-229300565 tempest-AggregatesAdminTestV241-229300565-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:24.847328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f31c72d-32b0-4db8-9176-c5bf3884be19 tempest-AggregatesAdminTestV241-229300565 tempest-AggregatesAdminTestV241-229300565-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:24.862308 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f31c72d-32b0-4db8-9176-c5bf3884be19 tempest-AggregatesAdminTestV241-229300565 tempest-AggregatesAdminTestV241-229300565-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:24.862795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f31c72d-32b0-4db8-9176-c5bf3884be19 tempest-AggregatesAdminTestV241-229300565 tempest-AggregatesAdminTestV241-229300565-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:24.863237 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f31c72d-32b0-4db8-9176-c5bf3884be19 tempest-AggregatesAdminTestV241-229300565 tempest-AggregatesAdminTestV241-229300565-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:24.870386 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3f31c72d-32b0-4db8-9176-c5bf3884be19 tempest-AggregatesAdminTestV241-229300565 tempest-AggregatesAdminTestV241-229300565-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.158834 Aug 04 16:54:24.871186 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2/8] 10.222.0.93 () {60 vars in 1208 bytes} [Thu Aug 4 16:54:23 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:54:24.890075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cdb59289-852c-4305-968b-c1db5ca1eb9b tempest-AggregatesAdminTestV241-229300565 tempest-AggregatesAdminTestV241-229300565-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-811321614"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:24.892595 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:24.892595 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:24.893893 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.aggregate [None req-cdb59289-852c-4305-968b-c1db5ca1eb9b tempest-AggregatesAdminTestV241-229300565 tempest-AggregatesAdminTestV241-229300565-project-admin] Generated uuid 8a04f9dd-793f-45c5-aa2c-f52f5bdaaf20 for aggregate {{(pid=131044) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:54:24.915715 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cdb59289-852c-4305-968b-c1db5ca1eb9b tempest-AggregatesAdminTestV241-229300565 tempest-AggregatesAdminTestV241-229300565-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.029690 Aug 04 16:54:24.916959 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3/9] 10.222.0.93 () {62 vars in 1205 bytes} [Thu Aug 4 16:54:24 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 16:54:24.931606 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a0e15fc5-326d-4531-9f01-2ad15421093f tempest-AggregatesAdminTestV241-229300565 tempest-AggregatesAdminTestV241-229300565-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2046505340"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:24.985431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-305bb3f2-0df7-4416-bd5a-1e638d8918b7 tempest-AggregatesAdminNegativeTestJSON-1831622130 tempest-AggregatesAdminNegativeTestJSON-1831622130-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-851359-3"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:24.988377 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:24.988377 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:24.989278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-305bb3f2-0df7-4416-bd5a-1e638d8918b7 tempest-AggregatesAdminNegativeTestJSON-1831622130 tempest-AggregatesAdminNegativeTestJSON-1831622130-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'da896ceda2834cf7ad1a2b8455f23011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ad8607d9644d27a7eddc445e5e9a22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:24.992251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-305bb3f2-0df7-4416-bd5a-1e638d8918b7 tempest-AggregatesAdminNegativeTestJSON-1831622130 tempest-AggregatesAdminNegativeTestJSON-1831622130-project] Request method failure captured: Aug 04 16:54:24.992251 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Aug 04 16:54:24.992251 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:54:24.992251 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:54:24.992251 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:54:24.992251 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 39 Aug 04 16:54:24.992251 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:54:24.992251 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:54:24.992251 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:54:24.992251 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:54:24.992251 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_m7ZgpBume-THBRExitgIUBRWb7q0NC7TDQnv5PunLtwyzUVx4jUKorqLbad6Mer9iaP3b2t9XiPOAiG918F1vOx44KzEVQLr8vhaY1i5KsE780Vdi5j5pTbT9ZaFJiTNUA7IhAec0gy3WNOZmVckC5xDMmGJ9QjO2xzGGX1f91a7g Aug 04 16:54:24.992251 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:54:24.992251 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:54:24.992251 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:54:24.992251 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:54:24.992251 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:54:24.992251 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:54:24.992251 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 38ad8607d9644d27a7eddc445e5e9a22 Aug 04 16:54:24.992251 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1831622130 Aug 04 16:54:24.992251 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 16:54:24.992251 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 16:54:24.993299 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/38ad8607d9644d27a7eddc445e5e9a22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/38ad8607d9644d27a7eddc445e5e9a22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_38ad8607d9644d27a7eddc445e5e9a22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/38ad8607d9644d27a7eddc445e5e9a22"}]}] Aug 04 16:54:24.993299 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1831622130 Aug 04 16:54:24.993299 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 38ad8607d9644d27a7eddc445e5e9a22 Aug 04 16:54:24.993299 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1831622130 Aug 04 16:54:24.993299 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-AggregatesAdminNegativeTestJSON-1831622130-project Aug 04 16:54:24.993299 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:54:24.993299 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:54:24.993299 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: da896ceda2834cf7ad1a2b8455f23011 Aug 04 16:54:24.993299 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1831622130-project Aug 04 16:54:24.993299 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 16:54:24.993299 n-d-851359-3 devstack@n-api.service[131043]: {"add_host": {"host": "n-h1-851359-3"}} Aug 04 16:54:24.993299 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 16:54:24.993299 n-d-851359-3 devstack@n-api.service[131043]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 04 16:54:24.993950 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h1-851359-3'}}} Aug 04 16:54:24.993950 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:54:24.993950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:24.993950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:24.993950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:24.993950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:54:24.993950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:54:24.993950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:54:24.993950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:54:24.993950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:54:24.993950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:54:24.993950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 04 16:54:24.993950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 04 16:54:24.993950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:54:24.993950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:54:24.993950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:54:24.993950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:54:24.993950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:54:24.993950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:54:24.994853 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:54:24.994853 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:54:24.994853 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:54:24.994853 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:54:24.994853 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:54:24.994853 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:54:24.994853 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:54:24.994853 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:54:24.994853 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 04 16:54:24.994853 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:24.994853 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:24.994853 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:24.994853 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:24.994853 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:24.994853 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:24.994853 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:54:24.994853 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:54:24.994853 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 04 16:54:24.994853 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:24.995878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-305bb3f2-0df7-4416-bd5a-1e638d8918b7 tempest-AggregatesAdminNegativeTestJSON-1831622130 tempest-AggregatesAdminNegativeTestJSON-1831622130-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:54:24.995878 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-305bb3f2-0df7-4416-bd5a-1e638d8918b7 tempest-AggregatesAdminNegativeTestJSON-1831622130 tempest-AggregatesAdminNegativeTestJSON-1831622130-project] 10.222.0.93 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.518079 Aug 04 16:54:25.003033 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 7/10] 10.222.0.93 () {60 vars in 1191 bytes} [Thu Aug 4 16:54:24 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 528 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:54:25.013882 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d0da816d-a4e5-4f73-b37a-494a5aa0660c tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:25.014691 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:25.014691 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:25.025748 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:25.025748 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:25.062861 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d0da816d-a4e5-4f73-b37a-494a5aa0660c tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.052514 Aug 04 16:54:25.063473 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 8/11] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Aug 4 16:54:25 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 04 16:54:25.077764 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a0e15fc5-326d-4531-9f01-2ad15421093f tempest-AggregatesAdminTestV241-229300565 tempest-AggregatesAdminTestV241-229300565-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-aggregates/3" status: 200 len: 299 microversion: 2.41 time: 0.151452 Aug 04 16:54:25.078915 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 4/12] 10.222.0.93 () {62 vars in 1210 bytes} [Thu Aug 4 16:54:24 2022] PUT /compute/v2.1/os-aggregates/3 => generated 299 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:54:25.091234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d9262c8e-e964-4c36-8226-c29468c12695 tempest-AggregatesAdminTestV241-229300565 tempest-AggregatesAdminTestV241-229300565-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:25.091568 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:25.091568 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:25.096147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0d2a8123-df09-4888-9936-a7e2ec74c1ec tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-497040346"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:25.102736 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:25.102736 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:25.104873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.aggregate [None req-0d2a8123-df09-4888-9936-a7e2ec74c1ec tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Generated uuid 8552e7ce-b699-44f3-8b6b-38eb31843ee5 for aggregate {{(pid=131043) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:54:25.106248 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d9262c8e-e964-4c36-8226-c29468c12695 tempest-AggregatesAdminTestV241-229300565 tempest-AggregatesAdminTestV241-229300565-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 299 microversion: 2.41 time: 0.018993 Aug 04 16:54:25.106833 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 5/13] 10.222.0.93 () {60 vars in 1190 bytes} [Thu Aug 4 16:54:25 2022] GET /compute/v2.1/os-aggregates/3 => generated 299 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:54:25.120097 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-657a8c2e-5648-4446-b6c3-e0f776844aac tempest-AggregatesAdminTestV241-229300565 tempest-AggregatesAdminTestV241-229300565-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-851359-3"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:25.125678 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:25.125678 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:25.141043 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0d2a8123-df09-4888-9936-a7e2ec74c1ec tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.066827 Aug 04 16:54:25.142787 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 9/14] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Aug 4 16:54:25 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:25.149866 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-657a8c2e-5648-4446-b6c3-e0f776844aac tempest-AggregatesAdminTestV241-229300565 tempest-AggregatesAdminTestV241-229300565-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:25.150405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-657a8c2e-5648-4446-b6c3-e0f776844aac tempest-AggregatesAdminTestV241-229300565 tempest-AggregatesAdminTestV241-229300565-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:25.150840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-657a8c2e-5648-4446-b6c3-e0f776844aac tempest-AggregatesAdminTestV241-229300565 tempest-AggregatesAdminTestV241-229300565-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:25.153077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4d497d70-cb7b-422c-b240-7b3a5f25c325 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-2075093314"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:25.155708 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:25.155708 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:25.181066 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4d497d70-cb7b-422c-b240-7b3a5f25c325 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),435e901d-6672-4284-ad57-58e647e6e99d(cell1) {{(pid=131043) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 04 16:54:25.183637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d497d70-cb7b-422c-b240-7b3a5f25c325 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:25.184639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d497d70-cb7b-422c-b240-7b3a5f25c325 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:25.185250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d497d70-cb7b-422c-b240-7b3a5f25c325 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:25.208943 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d497d70-cb7b-422c-b240-7b3a5f25c325 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:25.210917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d497d70-cb7b-422c-b240-7b3a5f25c325 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:25.212588 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d497d70-cb7b-422c-b240-7b3a5f25c325 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:25.232300 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-4d497d70-cb7b-422c-b240-7b3a5f25c325 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-2075093314 could not be found. Aug 04 16:54:25.237150 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4d497d70-cb7b-422c-b240-7b3a5f25c325 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Request method failure captured: Aug 04 16:54:25.237150 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Aug 04 16:54:25.237150 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:54:25.237150 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:54:25.237150 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:54:25.237150 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 58 Aug 04 16:54:25.237150 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:54:25.237150 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:54:25.237150 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:54:25.237150 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:54:25.237150 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_m9Tv6QiivKEMChPpOLItHNNFsJXscm9k7GEUP1tWt-LzWbhM_1l9-QMLVNME1zq-Fzx7y8xp3UA45wgOR5vud8QzK6C3YOwuoDZYJfXQVceavqnx2TU2ERCZrq2KXRjmXspKqKxfqBALs4mmoW5_PLA_XHYMRtX5Nd-40A4a-KKFw Aug 04 16:54:25.237150 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:54:25.237150 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:54:25.237150 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:54:25.237150 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:54:25.237150 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:54:25.237150 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:54:25.237150 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: c0ff0891bc7f431dad4e3c76db7dcd0e Aug 04 16:54:25.237150 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1218587882 Aug 04 16:54:25.237150 n-d-851359-3 devstack@n-api.service[131043]: X-Role: admin,member,reader Aug 04 16:54:25.237150 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: admin,member,reader Aug 04 16:54:25.238457 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c0ff0891bc7f431dad4e3c76db7dcd0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c0ff0891bc7f431dad4e3c76db7dcd0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c0ff0891bc7f431dad4e3c76db7dcd0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c0ff0891bc7f431dad4e3c76db7dcd0e"}]}] Aug 04 16:54:25.238457 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1218587882 Aug 04 16:54:25.238457 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: c0ff0891bc7f431dad4e3c76db7dcd0e Aug 04 16:54:25.238457 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1218587882 Aug 04 16:54:25.238457 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin Aug 04 16:54:25.238457 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:54:25.238457 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:54:25.238457 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 7d62c764c03e49499952b26f619ed6ef Aug 04 16:54:25.238457 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin Aug 04 16:54:25.238457 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 16:54:25.238457 n-d-851359-3 devstack@n-api.service[131043]: {"add_host": {"host": "tempest-nonexist_host-2075093314"}} Aug 04 16:54:25.238457 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 16:54:25.239012 n-d-851359-3 devstack@n-api.service[131043]: exception: Compute host tempest-nonexist_host-2075093314 could not be found. Aug 04 16:54:25.239012 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-2075093314'}}} Aug 04 16:54:25.239012 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:54:25.239012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:25.239012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5949, in _get_service_in_cell_by_host Aug 04 16:54:25.239012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 04 16:54:25.239012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:54:25.239012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:54:25.239012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 04 16:54:25.239012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 04 16:54:25.239012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:54:25.239012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:54:25.239012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 04 16:54:25.239012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 04 16:54:25.239012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-2075093314' is not mapped to any cell Aug 04 16:54:25.239012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:25.239012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:25.239012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:25.239012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:25.239012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5955, in _get_service_in_cell_by_host Aug 04 16:54:25.239963 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 04 16:54:25.239963 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 04 16:54:25.239963 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 04 16:54:25.239963 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 04 16:54:25.239963 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:25.239963 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:25.239963 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:25.239963 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:25.239963 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 04 16:54:25.239963 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 04 16:54:25.239963 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 16:54:25.239963 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 16:54:25.239963 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:54:25.239963 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:54:25.239963 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:54:25.239963 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:54:25.239963 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 16:54:25.239963 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 16:54:25.239963 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6574, in add_host_to_aggregate Aug 04 16:54:25.239963 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 04 16:54:25.240890 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5957, in _get_service_in_cell_by_host Aug 04 16:54:25.240890 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 04 16:54:25.240890 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-2075093314 could not be found. Aug 04 16:54:25.240890 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:25.240890 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:25.240890 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:25.240890 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:25.240890 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:25.240890 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:25.240890 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:54:25.240890 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:54:25.240890 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:54:25.240890 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:54:25.240890 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:54:25.240890 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:54:25.240890 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 04 16:54:25.240890 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:54:25.240890 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-2075093314 could not be found. Aug 04 16:54:25.240890 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:25.240890 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:25.240890 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:25.242437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:25.242437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:25.242437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:25.242437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:54:25.242437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:54:25.242437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-2075093314 could not be found. Aug 04 16:54:25.242437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:25.245333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4d497d70-cb7b-422c-b240-7b3a5f25c325 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-2075093314 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:54:25.247389 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4d497d70-cb7b-422c-b240-7b3a5f25c325 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.097904 Aug 04 16:54:25.248597 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 10/15] 10.222.0.93 () {60 vars in 1191 bytes} [Thu Aug 4 16:54:25 2022] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:54:25.601954 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8b831b4b-4543-488b-add6-3e5ad19c0ce4 tempest-FlavorsV255TestJSON-1349158994 tempest-FlavorsV255TestJSON-1349158994-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-296540126", "id": 83330690, "os-flavor-access:is_public": "True"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:25.605707 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:25.605707 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:25.638882 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8b831b4b-4543-488b-add6-3e5ad19c0ce4 tempest-FlavorsV255TestJSON-1349158994 tempest-FlavorsV255TestJSON-1349158994-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 442 microversion: 2.55 time: 0.388998 Aug 04 16:54:25.639648 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 11/16] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Aug 4 16:54:25 2022] POST /compute/v2.1/flavors => generated 442 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:54:25.644069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-47366654-3188-472d-97ce-09119d349000 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:25.644837 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:25.644837 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:25.669536 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-47366654-3188-472d-97ce-09119d349000 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.028960 Aug 04 16:54:25.671042 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 12/17] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Aug 4 16:54:25 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 16:54:26.057934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fa91b098-b529-4194-b6c4-3b52f2079601 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Calling method '.version_select at 0x7f1e6858f1f0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:26.058836 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:26.058836 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:26.060538 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fa91b098-b529-4194-b6c4-3b52f2079601 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:26.061151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fa91b098-b529-4194-b6c4-3b52f2079601 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:26.061660 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fa91b098-b529-4194-b6c4-3b52f2079601 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:26.078232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fa91b098-b529-4194-b6c4-3b52f2079601 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:26.078731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fa91b098-b529-4194-b6c4-3b52f2079601 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:26.079276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fa91b098-b529-4194-b6c4-3b52f2079601 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:26.090021 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fa91b098-b529-4194-b6c4-3b52f2079601 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:26.090600 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fa91b098-b529-4194-b6c4-3b52f2079601 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:26.091144 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fa91b098-b529-4194-b6c4-3b52f2079601 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:26.097467 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fa91b098-b529-4194-b6c4-3b52f2079601 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.425376 Aug 04 16:54:26.098150 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 13/18] 10.222.0.93 () {58 vars in 1167 bytes} [Thu Aug 4 16:54:25 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:26.099431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fa91b098-b529-4194-b6c4-3b52f2079601 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:26.100552 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fa91b098-b529-4194-b6c4-3b52f2079601 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001335 Aug 04 16:54:26.101064 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 14/19] 10.222.0.93 () {56 vars in 886 bytes} [Thu Aug 4 16:54:26 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 04 16:54:26.242492 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-657a8c2e-5648-4446-b6c3-e0f776844aac tempest-AggregatesAdminTestV241-229300565 tempest-AggregatesAdminTestV241-229300565-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 314 microversion: 2.41 time: 1.125865 Aug 04 16:54:26.250148 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 6/20] 10.222.0.93 () {62 vars in 1232 bytes} [Thu Aug 4 16:54:25 2022] POST /compute/v2.1/os-aggregates/3/action => generated 314 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:54:26.250148 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-135424e3-450c-4b9a-af27-2244e857c3f4 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:26.254856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-135424e3-450c-4b9a-af27-2244e857c3f4 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Request method failure captured: Aug 04 16:54:26.254856 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 04 16:54:26.254856 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:54:26.254856 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:54:26.254856 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:54:26.254856 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 283 Aug 04 16:54:26.254856 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:54:26.254856 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:54:26.254856 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:54:26.254856 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:54:26.254856 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_m9Tv6QiivKEMChPpOLItHNNFsJXscm9k7GEUP1tWt-LzWbhM_1l9-QMLVNME1zq-Fzx7y8xp3UA45wgOR5vud8QzK6C3YOwuoDZYJfXQVceavqnx2TU2ERCZrq2KXRjmXspKqKxfqBALs4mmoW5_PLA_XHYMRtX5Nd-40A4a-KKFw Aug 04 16:54:26.254856 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:54:26.254856 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:54:26.254856 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:54:26.254856 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:54:26.254856 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:54:26.254856 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:54:26.254856 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: c0ff0891bc7f431dad4e3c76db7dcd0e Aug 04 16:54:26.254856 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1218587882 Aug 04 16:54:26.254856 n-d-851359-3 devstack@n-api.service[131044]: X-Role: admin,member,reader Aug 04 16:54:26.254856 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: admin,member,reader Aug 04 16:54:26.256274 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c0ff0891bc7f431dad4e3c76db7dcd0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c0ff0891bc7f431dad4e3c76db7dcd0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c0ff0891bc7f431dad4e3c76db7dcd0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c0ff0891bc7f431dad4e3c76db7dcd0e"}]}] Aug 04 16:54:26.256274 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1218587882 Aug 04 16:54:26.256274 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: c0ff0891bc7f431dad4e3c76db7dcd0e Aug 04 16:54:26.256274 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1218587882 Aug 04 16:54:26.256274 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin Aug 04 16:54:26.256274 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:54:26.256274 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:54:26.256274 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 7d62c764c03e49499952b26f619ed6ef Aug 04 16:54:26.256274 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin Aug 04 16:54:26.256274 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 16:54:26.257609 n-d-851359-3 devstack@n-api.service[131044]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 04 16:54:26.257609 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:54:26.257609 n-d-851359-3 devstack@n-api.service[131044]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 16:54:26.257609 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 04 16:54:26.257609 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:54:26.257609 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:26.257609 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:54:26.257609 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:54:26.257609 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:54:26.257609 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:54:26.258436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 16:54:26.258436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:26.258436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 04 16:54:26.258436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 16:54:26.258436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:26.258436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 04 16:54:26.258436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 04 16:54:26.258436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:26.258436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:26.258436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:26.258436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:26.258436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:26.258436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:26.258436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:54:26.258436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:54:26.258436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:54:26.258436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:54:26.260292 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:54:26.260292 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:54:26.260292 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 16:54:26.260292 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 16:54:26.260292 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:54:26.260292 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:54:26.260292 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:54:26.260292 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:54:26.260292 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 16:54:26.260292 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:26.260292 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:26.260292 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:26.260292 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:26.260292 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:26.260292 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:26.262214 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:54:26.262214 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:54:26.262214 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 16:54:26.262214 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:26.262214 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-135424e3-450c-4b9a-af27-2244e857c3f4 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:54:26.262776 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-135424e3-450c-4b9a-af27-2244e857c3f4 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.011701 Aug 04 16:54:26.262776 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 7/21] 10.222.0.93 () {60 vars in 1165 bytes} [Thu Aug 4 16:54:26 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:54:26.373592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4ecb7281-8c74-436c-b4ed-1cff50f285ce tempest-FlavorsV255TestJSON-1021162872 tempest-FlavorsV255TestJSON-1021162872-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:26.393153 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4ecb7281-8c74-436c-b4ed-1cff50f285ce tempest-FlavorsV255TestJSON-1021162872 tempest-FlavorsV255TestJSON-1021162872-project] 10.222.0.93 "GET /compute/v2.1/flavors/83330690" status: 200 len: 442 microversion: 2.55 time: 0.290745 Aug 04 16:54:26.393937 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 15/22] 10.222.0.93 () {60 vars in 1193 bytes} [Thu Aug 4 16:54:26 2022] GET /compute/v2.1/flavors/83330690 => generated 442 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:54:26.401517 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4aad6f27-0bae-4180-b297-be7c1dca8564 tempest-AggregatesAdminTestV241-229300565 tempest-AggregatesAdminTestV241-229300565-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-851359-3"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:26.401517 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:26.401517 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:26.409741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4aad6f27-0bae-4180-b297-be7c1dca8564 tempest-AggregatesAdminTestV241-229300565 tempest-AggregatesAdminTestV241-229300565-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:26.410472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4aad6f27-0bae-4180-b297-be7c1dca8564 tempest-AggregatesAdminTestV241-229300565 tempest-AggregatesAdminTestV241-229300565-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:26.411163 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4aad6f27-0bae-4180-b297-be7c1dca8564 tempest-AggregatesAdminTestV241-229300565 tempest-AggregatesAdminTestV241-229300565-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:26.532847 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4aad6f27-0bae-4180-b297-be7c1dca8564 tempest-AggregatesAdminTestV241-229300565 tempest-AggregatesAdminTestV241-229300565-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 299 microversion: 2.41 time: 0.137756 Aug 04 16:54:26.534346 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 16/23] 10.222.0.93 () {62 vars in 1232 bytes} [Thu Aug 4 16:54:26 2022] POST /compute/v2.1/os-aggregates/3/action => generated 299 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:54:26.539838 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d470a992-0050-4474-b609-4d8d93b42a53 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:26.544510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d470a992-0050-4474-b609-4d8d93b42a53 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Request method failure captured: Aug 04 16:54:26.544510 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 04 16:54:26.544510 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:54:26.544510 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:54:26.544510 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:54:26.544510 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 27 Aug 04 16:54:26.544510 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:54:26.544510 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:54:26.544510 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:54:26.544510 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:54:26.544510 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_m9Tv6QiivKEMChPpOLItHNNFsJXscm9k7GEUP1tWt-LzWbhM_1l9-QMLVNME1zq-Fzx7y8xp3UA45wgOR5vud8QzK6C3YOwuoDZYJfXQVceavqnx2TU2ERCZrq2KXRjmXspKqKxfqBALs4mmoW5_PLA_XHYMRtX5Nd-40A4a-KKFw Aug 04 16:54:26.544510 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:54:26.544510 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:54:26.544510 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:54:26.544510 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:54:26.544510 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:54:26.544510 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:54:26.544510 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: c0ff0891bc7f431dad4e3c76db7dcd0e Aug 04 16:54:26.544510 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1218587882 Aug 04 16:54:26.544510 n-d-851359-3 devstack@n-api.service[131043]: X-Role: admin,member,reader Aug 04 16:54:26.544510 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: admin,member,reader Aug 04 16:54:26.545774 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c0ff0891bc7f431dad4e3c76db7dcd0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c0ff0891bc7f431dad4e3c76db7dcd0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c0ff0891bc7f431dad4e3c76db7dcd0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c0ff0891bc7f431dad4e3c76db7dcd0e"}]}] Aug 04 16:54:26.545774 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1218587882 Aug 04 16:54:26.545774 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: c0ff0891bc7f431dad4e3c76db7dcd0e Aug 04 16:54:26.545774 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1218587882 Aug 04 16:54:26.545774 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin Aug 04 16:54:26.545774 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:54:26.545774 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:54:26.545774 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 7d62c764c03e49499952b26f619ed6ef Aug 04 16:54:26.545774 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin Aug 04 16:54:26.545774 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 16:54:26.545774 n-d-851359-3 devstack@n-api.service[131043]: {"aggregate": {"name": ""}} Aug 04 16:54:26.545774 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 16:54:26.545774 n-d-851359-3 devstack@n-api.service[131043]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 04 16:54:26.546586 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 04 16:54:26.546586 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:54:26.546586 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:26.546586 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:54:26.546586 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:54:26.546586 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:54:26.546586 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:54:26.546586 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 04 16:54:26.546586 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:26.546586 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 04 16:54:26.546586 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 16:54:26.546586 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:26.546586 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 04 16:54:26.546586 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi '' Aug 04 16:54:26.546586 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:26.546586 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:26.546586 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:26.546586 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:26.546586 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:26.546586 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:26.546586 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:54:26.546586 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:54:26.546586 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:54:26.547939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:54:26.547939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:54:26.547939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:54:26.547939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 16:54:26.547939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 16:54:26.547939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:54:26.547939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:54:26.547939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:54:26.547939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:54:26.547939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 04 16:54:26.547939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:26.547939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:26.547939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:26.547939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:26.547939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:26.547939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:26.547939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:54:26.547939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:54:26.547939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 04 16:54:26.547939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:26.549898 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d470a992-0050-4474-b609-4d8d93b42a53 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:54:26.550907 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d470a992-0050-4474-b609-4d8d93b42a53 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.015385 Aug 04 16:54:26.551847 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 17/24] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Aug 4 16:54:26 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:54:26.557765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b56f8589-bc40-4ad8-bffe-3745f90575d1 tempest-FlavorsV255TestJSON-1349158994 tempest-FlavorsV255TestJSON-1349158994-project-admin] Action: 'update', calling method: .version_select at 0x7f1e6a65d4c0>, body: {"flavor": {"description": "new"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:26.569304 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:26.569304 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:26.604829 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b56f8589-bc40-4ad8-bffe-3745f90575d1 tempest-FlavorsV255TestJSON-1349158994 tempest-FlavorsV255TestJSON-1349158994-project-admin] 10.222.0.93 "PUT /compute/v2.1/flavors/83330690" status: 200 len: 443 microversion: 2.55 time: 0.051054 Aug 04 16:54:26.605730 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 18/25] 10.222.0.93 () {62 vars in 1213 bytes} [Thu Aug 4 16:54:26 2022] PUT /compute/v2.1/flavors/83330690 => generated 443 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:54:26.610419 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-20688cd9-efcc-4928-b4ac-c3a4d71f53d3 tempest-AggregatesAdminTestV241-229300565 tempest-AggregatesAdminTestV241-229300565-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:26.611164 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:26.611164 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:26.635658 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-20688cd9-efcc-4928-b4ac-c3a4d71f53d3 tempest-AggregatesAdminTestV241-229300565 tempest-AggregatesAdminTestV241-229300565-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.41 time: 0.028308 Aug 04 16:54:26.636239 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 19/26] 10.222.0.93 () {60 vars in 1193 bytes} [Thu Aug 4 16:54:26 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:26.646082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-15f9da76-ab34-4874-a162-026c89ebd9a2 tempest-AggregatesAdminNegativeTestJSON-1831622130 tempest-AggregatesAdminNegativeTestJSON-1831622130-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1309362611"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:26.649265 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:26.649265 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:26.650239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-15f9da76-ab34-4874-a162-026c89ebd9a2 tempest-AggregatesAdminNegativeTestJSON-1831622130 tempest-AggregatesAdminNegativeTestJSON-1831622130-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'da896ceda2834cf7ad1a2b8455f23011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ad8607d9644d27a7eddc445e5e9a22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:26.652488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-15f9da76-ab34-4874-a162-026c89ebd9a2 tempest-AggregatesAdminNegativeTestJSON-1831622130 tempest-AggregatesAdminNegativeTestJSON-1831622130-project] Request method failure captured: Aug 04 16:54:26.652488 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 04 16:54:26.652488 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:54:26.652488 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:54:26.652488 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:54:26.652488 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 60 Aug 04 16:54:26.652488 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:54:26.652488 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:54:26.652488 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:54:26.652488 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:54:26.652488 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_m7ZgpBume-THBRExitgIUBRWb7q0NC7TDQnv5PunLtwyzUVx4jUKorqLbad6Mer9iaP3b2t9XiPOAiG918F1vOx44KzEVQLr8vhaY1i5KsE780Vdi5j5pTbT9ZaFJiTNUA7IhAec0gy3WNOZmVckC5xDMmGJ9QjO2xzGGX1f91a7g Aug 04 16:54:26.652488 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:54:26.652488 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:54:26.652488 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:54:26.652488 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:54:26.652488 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:54:26.652488 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:54:26.652488 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 38ad8607d9644d27a7eddc445e5e9a22 Aug 04 16:54:26.652488 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1831622130 Aug 04 16:54:26.652488 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 16:54:26.652488 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 16:54:26.653837 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/38ad8607d9644d27a7eddc445e5e9a22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/38ad8607d9644d27a7eddc445e5e9a22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_38ad8607d9644d27a7eddc445e5e9a22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/38ad8607d9644d27a7eddc445e5e9a22"}]}] Aug 04 16:54:26.653837 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1831622130 Aug 04 16:54:26.653837 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 38ad8607d9644d27a7eddc445e5e9a22 Aug 04 16:54:26.653837 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1831622130 Aug 04 16:54:26.653837 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-AggregatesAdminNegativeTestJSON-1831622130-project Aug 04 16:54:26.653837 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:54:26.653837 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:54:26.653837 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: da896ceda2834cf7ad1a2b8455f23011 Aug 04 16:54:26.653837 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1831622130-project Aug 04 16:54:26.653837 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 16:54:26.653837 n-d-851359-3 devstack@n-api.service[131043]: {"aggregate": {"name": "tempest-test_aggregate-1309362611"}} Aug 04 16:54:26.653837 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 16:54:26.653837 n-d-851359-3 devstack@n-api.service[131043]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 04 16:54:26.654707 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1309362611'}}} Aug 04 16:54:26.654707 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:54:26.654707 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:26.654707 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:26.654707 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:26.654707 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:54:26.654707 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:54:26.654707 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:54:26.654707 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:54:26.654707 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:54:26.654707 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:54:26.654707 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:54:26.654707 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:54:26.654707 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 04 16:54:26.654707 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 04 16:54:26.654707 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:54:26.654707 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:54:26.654707 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:54:26.654707 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:54:26.655817 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:54:26.655817 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:54:26.655817 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:54:26.655817 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:54:26.655817 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:54:26.655817 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:54:26.655817 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:54:26.655817 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:54:26.655817 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:54:26.655817 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:54:26.655817 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 04 16:54:26.655817 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:26.655817 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:26.655817 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:26.655817 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:26.655817 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:26.655817 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:26.655817 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:54:26.655817 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:54:26.655817 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 04 16:54:26.657038 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:26.657821 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-15f9da76-ab34-4874-a162-026c89ebd9a2 tempest-AggregatesAdminNegativeTestJSON-1831622130 tempest-AggregatesAdminNegativeTestJSON-1831622130-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:54:26.658826 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-15f9da76-ab34-4874-a162-026c89ebd9a2 tempest-AggregatesAdminNegativeTestJSON-1831622130 tempest-AggregatesAdminNegativeTestJSON-1831622130-project] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.021527 Aug 04 16:54:26.659505 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 20/27] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Aug 4 16:54:26 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:54:26.666891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f01e614e-de85-4638-9762-96690c41577d tempest-FlavorsV255TestJSON-1021162872 tempest-FlavorsV255TestJSON-1021162872-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:26.697220 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f01e614e-de85-4638-9762-96690c41577d tempest-FlavorsV255TestJSON-1021162872 tempest-FlavorsV255TestJSON-1021162872-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5718 microversion: 2.55 time: 0.036524 Aug 04 16:54:26.697807 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 21/28] 10.222.0.93 () {60 vars in 1187 bytes} [Thu Aug 4 16:54:26 2022] GET /compute/v2.1/flavors/detail => generated 5718 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:54:26.702223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cb3435f8-89f2-4c2f-b3e5-2103155a53e0 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2049053969"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:26.705614 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.aggregate [None req-cb3435f8-89f2-4c2f-b3e5-2103155a53e0 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Generated uuid 891a1576-579f-45cd-88d3-321620aa0ed4 for aggregate {{(pid=131043) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:54:26.710211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-76a5766b-0789-4c2a-b69e-3cc95d3c9851 tempest-HypervisorAdminV228Test-1382887935 tempest-HypervisorAdminV228Test-1382887935-project-admin] Calling method '.version_select at 0x7f1e6889bca0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:26.711195 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:26.711195 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:26.712508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76a5766b-0789-4c2a-b69e-3cc95d3c9851 tempest-HypervisorAdminV228Test-1382887935 tempest-HypervisorAdminV228Test-1382887935-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:26.713004 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76a5766b-0789-4c2a-b69e-3cc95d3c9851 tempest-HypervisorAdminV228Test-1382887935 tempest-HypervisorAdminV228Test-1382887935-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:26.713496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76a5766b-0789-4c2a-b69e-3cc95d3c9851 tempest-HypervisorAdminV228Test-1382887935 tempest-HypervisorAdminV228Test-1382887935-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:26.730779 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cb3435f8-89f2-4c2f-b3e5-2103155a53e0 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.031817 Aug 04 16:54:26.731662 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 22/29] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Aug 4 16:54:26 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:26.736725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8ab52003-db04-43f2-ad85-3bf52dda1413 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-872963359", "name": "tempest-test_aggregate-160626775"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:26.746277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76a5766b-0789-4c2a-b69e-3cc95d3c9851 tempest-HypervisorAdminV228Test-1382887935 tempest-HypervisorAdminV228Test-1382887935-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:26.746984 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76a5766b-0789-4c2a-b69e-3cc95d3c9851 tempest-HypervisorAdminV228Test-1382887935 tempest-HypervisorAdminV228Test-1382887935-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:26.747633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76a5766b-0789-4c2a-b69e-3cc95d3c9851 tempest-HypervisorAdminV228Test-1382887935 tempest-HypervisorAdminV228Test-1382887935-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:26.757468 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:26.757468 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:26.758814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.aggregate [None req-8ab52003-db04-43f2-ad85-3bf52dda1413 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Generated uuid 50f7726c-ae79-46de-abdd-8c248226e86c for aggregate {{(pid=131043) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:54:26.759307 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76a5766b-0789-4c2a-b69e-3cc95d3c9851 tempest-HypervisorAdminV228Test-1382887935 tempest-HypervisorAdminV228Test-1382887935-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:26.759877 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76a5766b-0789-4c2a-b69e-3cc95d3c9851 tempest-HypervisorAdminV228Test-1382887935 tempest-HypervisorAdminV228Test-1382887935-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:26.760363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76a5766b-0789-4c2a-b69e-3cc95d3c9851 tempest-HypervisorAdminV228Test-1382887935 tempest-HypervisorAdminV228Test-1382887935-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:26.766635 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-76a5766b-0789-4c2a-b69e-3cc95d3c9851 tempest-HypervisorAdminV228Test-1382887935 tempest-HypervisorAdminV228Test-1382887935-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.503491 Aug 04 16:54:26.776080 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 8/30] 10.222.0.93 () {60 vars in 1187 bytes} [Thu Aug 4 16:54:26 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:54:26.781475 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8a43161b-a6a8-4977-a03d-111fb893ed17 tempest-FlavorsV255TestJSON-1021162872 tempest-FlavorsV255TestJSON-1021162872-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:26.794138 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8ab52003-db04-43f2-ad85-3bf52dda1413 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.061138 Aug 04 16:54:26.801137 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 23/31] 10.222.0.93 () {60 vars in 1165 bytes} [Thu Aug 4 16:54:26 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:26.806792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-68e63ce5-5596-4de7-95e4-ce77f7369e0b tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2049053969"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:26.809810 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:26.809810 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:26.810706 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.aggregate [None req-68e63ce5-5596-4de7-95e4-ce77f7369e0b tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Generated uuid 9069890c-09e7-4a9e-ab02-7f3ba151fc9d for aggregate {{(pid=131043) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:54:26.817683 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=8,nova_api:DELETE=10,nova_api:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:26.822011 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-68e63ce5-5596-4de7-95e4-ce77f7369e0b tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-2049053969 already exists. Aug 04 16:54:26.824695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-68e63ce5-5596-4de7-95e4-ce77f7369e0b tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Request method failure captured: Aug 04 16:54:26.824695 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 04 16:54:26.824695 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:54:26.824695 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:54:26.824695 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:54:26.824695 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 60 Aug 04 16:54:26.824695 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:54:26.824695 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:54:26.824695 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:54:26.824695 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:54:26.824695 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_m9Tv6QiivKEMChPpOLItHNNFsJXscm9k7GEUP1tWt-LzWbhM_1l9-QMLVNME1zq-Fzx7y8xp3UA45wgOR5vud8QzK6C3YOwuoDZYJfXQVceavqnx2TU2ERCZrq2KXRjmXspKqKxfqBALs4mmoW5_PLA_XHYMRtX5Nd-40A4a-KKFw Aug 04 16:54:26.824695 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:54:26.824695 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:54:26.824695 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:54:26.824695 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:54:26.824695 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:54:26.824695 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:54:26.824695 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: c0ff0891bc7f431dad4e3c76db7dcd0e Aug 04 16:54:26.824695 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1218587882 Aug 04 16:54:26.824695 n-d-851359-3 devstack@n-api.service[131043]: X-Role: admin,member,reader Aug 04 16:54:26.824695 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: admin,member,reader Aug 04 16:54:26.825756 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c0ff0891bc7f431dad4e3c76db7dcd0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c0ff0891bc7f431dad4e3c76db7dcd0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c0ff0891bc7f431dad4e3c76db7dcd0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c0ff0891bc7f431dad4e3c76db7dcd0e"}]}] Aug 04 16:54:26.825756 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1218587882 Aug 04 16:54:26.825756 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: c0ff0891bc7f431dad4e3c76db7dcd0e Aug 04 16:54:26.825756 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1218587882 Aug 04 16:54:26.825756 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin Aug 04 16:54:26.825756 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:54:26.825756 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:54:26.825756 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 7d62c764c03e49499952b26f619ed6ef Aug 04 16:54:26.825756 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin Aug 04 16:54:26.825756 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 16:54:26.825756 n-d-851359-3 devstack@n-api.service[131043]: {"aggregate": {"name": "tempest-test_aggregate-2049053969"}} Aug 04 16:54:26.825756 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 16:54:26.825756 n-d-851359-3 devstack@n-api.service[131043]: exception: Aggregate tempest-test_aggregate-2049053969 already exists. Aug 04 16:54:26.837765 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-2049053969'}}} Aug 04 16:54:26.837765 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:54:26.837765 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:26.837765 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 04 16:54:26.837765 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 04 16:54:26.837765 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 16:54:26.837765 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 16:54:26.837765 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:54:26.837765 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:54:26.837765 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:54:26.837765 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:54:26.837765 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 16:54:26.837765 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 16:54:26.837765 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6411, in create_aggregate Aug 04 16:54:26.837765 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 04 16:54:26.837765 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 04 16:54:26.837765 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 04 16:54:26.837765 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 04 16:54:26.837765 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 04 16:54:26.838832 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:54:26.838832 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:54:26.838832 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 04 16:54:26.838832 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 04 16:54:26.838832 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-2049053969 already exists. Aug 04 16:54:26.838832 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:26.838832 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:26.838832 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:26.838832 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:26.838832 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:26.838832 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:26.838832 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:54:26.838832 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:54:26.838832 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:54:26.838832 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:54:26.838832 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:54:26.838832 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:54:26.838832 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:54:26.838832 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:54:26.838832 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 04 16:54:26.839798 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 04 16:54:26.839798 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-2049053969 already exists. Aug 04 16:54:26.839798 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:26.839798 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:26.839798 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:26.839798 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:26.839798 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:26.839798 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:26.839798 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:54:26.839798 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:54:26.839798 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-2049053969 already exists. Aug 04 16:54:26.839798 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:26.839798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-68e63ce5-5596-4de7-95e4-ce77f7369e0b tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-2049053969 already exists. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:54:26.840436 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8a43161b-a6a8-4977-a03d-111fb893ed17 tempest-FlavorsV255TestJSON-1021162872 tempest-FlavorsV255TestJSON-1021162872-project] 10.222.0.93 "GET /compute/v2.1/flavors" status: 200 len: 3150 microversion: 2.55 time: 0.048097 Aug 04 16:54:26.840505 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-68e63ce5-5596-4de7-95e4-ce77f7369e0b tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.023937 Aug 04 16:54:26.840578 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 9/32] 10.222.0.93 () {60 vars in 1166 bytes} [Thu Aug 4 16:54:26 2022] GET /compute/v2.1/flavors => generated 3150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:54:26.840648 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 24/33] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Aug 4 16:54:26 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 25 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:54:26.840648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bce91aad-f464-47c6-a634-c0d1aa82b2fd tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:26.840648 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:26.840648 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:26.840878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-96578673-327d-46b0-a6d0-e433eab2d58c tempest-HypervisorAdminV228Test-1382887935 tempest-HypervisorAdminV228Test-1382887935-project-admin] Calling method '.version_select at 0x7f1e687f95e0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:26.840878 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:26.840878 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:26.840878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96578673-327d-46b0-a6d0-e433eab2d58c tempest-HypervisorAdminV228Test-1382887935 tempest-HypervisorAdminV228Test-1382887935-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:26.840878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96578673-327d-46b0-a6d0-e433eab2d58c tempest-HypervisorAdminV228Test-1382887935 tempest-HypervisorAdminV228Test-1382887935-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:26.841167 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96578673-327d-46b0-a6d0-e433eab2d58c tempest-HypervisorAdminV228Test-1382887935 tempest-HypervisorAdminV228Test-1382887935-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:26.845806 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bce91aad-f464-47c6-a634-c0d1aa82b2fd tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates" status: 200 len: 514 microversion: 2.1 time: 0.017001 Aug 04 16:54:26.846422 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 25/34] 10.222.0.93 () {58 vars in 1143 bytes} [Thu Aug 4 16:54:26 2022] GET /compute/v2.1/os-aggregates => generated 514 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:26.854437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96578673-327d-46b0-a6d0-e433eab2d58c tempest-HypervisorAdminV228Test-1382887935 tempest-HypervisorAdminV228Test-1382887935-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:26.855085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96578673-327d-46b0-a6d0-e433eab2d58c tempest-HypervisorAdminV228Test-1382887935 tempest-HypervisorAdminV228Test-1382887935-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:26.855699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96578673-327d-46b0-a6d0-e433eab2d58c tempest-HypervisorAdminV228Test-1382887935 tempest-HypervisorAdminV228Test-1382887935-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:26.858173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0ce2bf92-3901-4513-877e-fc8345c25c51 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:26.859236 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:26.859236 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:26.864856 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-96578673-327d-46b0-a6d0-e433eab2d58c tempest-HypervisorAdminV228Test-1382887935 tempest-HypervisorAdminV228Test-1382887935-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 717 microversion: 2.28 time: 0.037508 Aug 04 16:54:26.866392 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 10/35] 10.222.0.93 () {60 vars in 1193 bytes} [Thu Aug 4 16:54:26 2022] GET /compute/v2.1/os-hypervisors/1 => generated 717 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:54:26.871169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-240b6a1d-a690-4d80-b6ff-20a960d56206 tempest-FlavorsV255TestJSON-1349158994 tempest-FlavorsV255TestJSON-1349158994-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:26.871940 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:26.871940 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:26.904987 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-240b6a1d-a690-4d80-b6ff-20a960d56206 tempest-FlavorsV255TestJSON-1349158994 tempest-FlavorsV255TestJSON-1349158994-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/83330690" status: 202 len: 0 microversion: 2.55 time: 0.037257 Aug 04 16:54:26.905633 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 11/36] 10.222.0.93 () {60 vars in 1196 bytes} [Thu Aug 4 16:54:26 2022] DELETE /compute/v2.1/flavors/83330690 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:54:26.915177 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0ce2bf92-3901-4513-877e-fc8345c25c51 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.064028 Aug 04 16:54:26.915948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-51317834-6927-4459-a718-f6e4a9db1017 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-851359-3"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:26.919971 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:26.919971 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:26.922786 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 26/37] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Aug 4 16:54:26 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 16:54:26.928829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51317834-6927-4459-a718-f6e4a9db1017 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:26.929361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51317834-6927-4459-a718-f6e4a9db1017 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:26.929938 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-66044a8e-d205-45b6-b4bb-ea02a9cc66e8 tempest-FlavorsV255TestJSON-1349158994 tempest-FlavorsV255TestJSON-1349158994-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:26.930309 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51317834-6927-4459-a718-f6e4a9db1017 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:26.969023 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-66044a8e-d205-45b6-b4bb-ea02a9cc66e8 tempest-FlavorsV255TestJSON-1349158994 tempest-FlavorsV255TestJSON-1349158994-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.044535 Aug 04 16:54:26.969880 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 27/38] 10.222.0.93 () {60 vars in 1187 bytes} [Thu Aug 4 16:54:26 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:54:26.976085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c74354d5-8380-4dd1-8138-235ac8b22b6f tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-688649168"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:26.979515 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:26.979515 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:26.980941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.aggregate [None req-c74354d5-8380-4dd1-8138-235ac8b22b6f tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Generated uuid e2d4063b-0ed1-484b-9e1a-5cd50f1d8662 for aggregate {{(pid=131043) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:54:27.008545 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c74354d5-8380-4dd1-8138-235ac8b22b6f tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.037310 Aug 04 16:54:27.009735 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 28/39] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Aug 4 16:54:26 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:27.026638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d1e520df-33b1-4963-9c20-4db2fd8fca51 tempest-AggregatesAdminNegativeTestJSON-1831622130 tempest-AggregatesAdminNegativeTestJSON-1831622130-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:27.027696 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:27.027696 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:27.028903 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d1e520df-33b1-4963-9c20-4db2fd8fca51 tempest-AggregatesAdminNegativeTestJSON-1831622130 tempest-AggregatesAdminNegativeTestJSON-1831622130-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'da896ceda2834cf7ad1a2b8455f23011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ad8607d9644d27a7eddc445e5e9a22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:27.030878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d1e520df-33b1-4963-9c20-4db2fd8fca51 tempest-AggregatesAdminNegativeTestJSON-1831622130 tempest-AggregatesAdminNegativeTestJSON-1831622130-project] Request method failure captured: Aug 04 16:54:27.030878 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 04 16:54:27.030878 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:54:27.030878 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:54:27.030878 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:54:27.030878 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:54:27.030878 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:54:27.030878 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:54:27.030878 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:54:27.030878 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:54:27.030878 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_m7ZgpBume-THBRExitgIUBRWb7q0NC7TDQnv5PunLtwyzUVx4jUKorqLbad6Mer9iaP3b2t9XiPOAiG918F1vOx44KzEVQLr8vhaY1i5KsE780Vdi5j5pTbT9ZaFJiTNUA7IhAec0gy3WNOZmVckC5xDMmGJ9QjO2xzGGX1f91a7g Aug 04 16:54:27.030878 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:54:27.030878 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:54:27.030878 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:54:27.030878 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:54:27.030878 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:54:27.030878 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:54:27.030878 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 38ad8607d9644d27a7eddc445e5e9a22 Aug 04 16:54:27.030878 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1831622130 Aug 04 16:54:27.030878 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 16:54:27.030878 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 16:54:27.032007 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/38ad8607d9644d27a7eddc445e5e9a22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/38ad8607d9644d27a7eddc445e5e9a22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_38ad8607d9644d27a7eddc445e5e9a22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/38ad8607d9644d27a7eddc445e5e9a22"}]}] Aug 04 16:54:27.032007 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1831622130 Aug 04 16:54:27.032007 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 38ad8607d9644d27a7eddc445e5e9a22 Aug 04 16:54:27.032007 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1831622130 Aug 04 16:54:27.032007 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-AggregatesAdminNegativeTestJSON-1831622130-project Aug 04 16:54:27.032007 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:54:27.032007 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:54:27.032007 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: da896ceda2834cf7ad1a2b8455f23011 Aug 04 16:54:27.032007 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1831622130-project Aug 04 16:54:27.032007 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 16:54:27.032007 n-d-851359-3 devstack@n-api.service[131043]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 04 16:54:27.032007 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '7'} Aug 04 16:54:27.032594 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:54:27.032594 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:27.032594 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:27.032594 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:27.032594 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:54:27.032594 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:54:27.032594 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:54:27.032594 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:54:27.032594 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 04 16:54:27.032594 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 04 16:54:27.032594 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:54:27.032594 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:54:27.032594 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:54:27.032594 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:54:27.032594 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:54:27.032594 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:54:27.032594 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:54:27.032594 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:54:27.032594 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:54:27.033482 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:54:27.033482 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:54:27.033482 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:54:27.033482 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:54:27.033482 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:54:27.033482 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 04 16:54:27.033482 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:27.033482 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:27.033482 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:27.033482 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:27.033482 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:27.033482 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:27.033482 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:54:27.033482 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:54:27.033482 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 04 16:54:27.033482 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:27.036007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d1e520df-33b1-4963-9c20-4db2fd8fca51 tempest-AggregatesAdminNegativeTestJSON-1831622130 tempest-AggregatesAdminNegativeTestJSON-1831622130-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:54:27.036876 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d1e520df-33b1-4963-9c20-4db2fd8fca51 tempest-AggregatesAdminNegativeTestJSON-1831622130 tempest-AggregatesAdminNegativeTestJSON-1831622130-project] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.019341 Aug 04 16:54:27.038697 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 29/40] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Aug 4 16:54:27 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:54:27.048096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a8d16260-0b22-45f8-a0aa-73cd5a1ae387 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:27.081887 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a8d16260-0b22-45f8-a0aa-73cd5a1ae387 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.038605 Aug 04 16:54:27.084849 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 30/41] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Aug 4 16:54:27 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 16:54:27.092710 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9f175d89-5b96-489f-af5d-348b31dfd432 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:27.094979 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:27.094979 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:27.111335 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-9f175d89-5b96-489f-af5d-348b31dfd432 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 04 16:54:27.113080 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9f175d89-5b96-489f-af5d-348b31dfd432 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Request method failure captured: Aug 04 16:54:27.113080 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 04 16:54:27.113080 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:54:27.113080 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:54:27.113080 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:54:27.113080 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:54:27.113080 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:54:27.113080 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:54:27.113080 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:54:27.113080 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:54:27.113080 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_m9Tv6QiivKEMChPpOLItHNNFsJXscm9k7GEUP1tWt-LzWbhM_1l9-QMLVNME1zq-Fzx7y8xp3UA45wgOR5vud8QzK6C3YOwuoDZYJfXQVceavqnx2TU2ERCZrq2KXRjmXspKqKxfqBALs4mmoW5_PLA_XHYMRtX5Nd-40A4a-KKFw Aug 04 16:54:27.113080 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:54:27.113080 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:54:27.113080 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:54:27.113080 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:54:27.113080 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:54:27.113080 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:54:27.113080 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: c0ff0891bc7f431dad4e3c76db7dcd0e Aug 04 16:54:27.113080 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1218587882 Aug 04 16:54:27.113080 n-d-851359-3 devstack@n-api.service[131043]: X-Role: admin,member,reader Aug 04 16:54:27.113080 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: admin,member,reader Aug 04 16:54:27.114529 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c0ff0891bc7f431dad4e3c76db7dcd0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c0ff0891bc7f431dad4e3c76db7dcd0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c0ff0891bc7f431dad4e3c76db7dcd0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c0ff0891bc7f431dad4e3c76db7dcd0e"}]}] Aug 04 16:54:27.114529 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1218587882 Aug 04 16:54:27.114529 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: c0ff0891bc7f431dad4e3c76db7dcd0e Aug 04 16:54:27.114529 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1218587882 Aug 04 16:54:27.114529 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin Aug 04 16:54:27.114529 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:54:27.114529 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:54:27.114529 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 7d62c764c03e49499952b26f619ed6ef Aug 04 16:54:27.114529 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin Aug 04 16:54:27.114529 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 16:54:27.114529 n-d-851359-3 devstack@n-api.service[131043]: exception: Aggregate -1 could not be found. Aug 04 16:54:27.114529 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '-1'} Aug 04 16:54:27.115390 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:54:27.115390 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:27.115390 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 04 16:54:27.115390 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 04 16:54:27.115390 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 16:54:27.115390 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 16:54:27.115390 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:54:27.115390 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:54:27.115390 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:54:27.115390 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:54:27.115390 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 16:54:27.115390 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 16:54:27.115390 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Aug 04 16:54:27.115390 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 04 16:54:27.115390 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:54:27.115390 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:54:27.115390 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 04 16:54:27.115390 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 04 16:54:27.115390 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:54:27.116928 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:54:27.116928 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 04 16:54:27.116928 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 04 16:54:27.116928 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 04 16:54:27.116928 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:27.116928 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:27.116928 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:27.116928 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:27.116928 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:27.116928 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:27.116928 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:54:27.116928 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:54:27.116928 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:54:27.116928 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:54:27.116928 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 04 16:54:27.116928 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:54:27.116928 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 04 16:54:27.116928 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:27.116928 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:27.116928 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:27.116928 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:27.118045 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:27.118045 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:27.118045 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:54:27.118045 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:54:27.118045 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 04 16:54:27.118045 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:27.118045 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9f175d89-5b96-489f-af5d-348b31dfd432 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:54:27.118045 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9f175d89-5b96-489f-af5d-348b31dfd432 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.026572 Aug 04 16:54:27.118045 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 31/42] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Aug 4 16:54:27 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 04 16:54:27.138163 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bf20d933-1879-4b59-9e5d-4b0dbba9e4c4 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-818763587"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:27.144193 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:27.144193 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:27.151772 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.aggregate [None req-bf20d933-1879-4b59-9e5d-4b0dbba9e4c4 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Generated uuid decf9941-f309-489c-9690-9d5d58a1fcc3 for aggregate {{(pid=131043) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:54:27.176309 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-51317834-6927-4459-a718-f6e4a9db1017 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 312 microversion: 2.1 time: 0.266438 Aug 04 16:54:27.190908 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 12/43] 10.222.0.93 () {60 vars in 1191 bytes} [Thu Aug 4 16:54:26 2022] POST /compute/v2.1/os-aggregates/6/action => generated 312 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:27.200460 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bf20d933-1879-4b59-9e5d-4b0dbba9e4c4 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.072744 Aug 04 16:54:27.201218 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 32/44] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Aug 4 16:54:27 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:27.217103 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0f80d5da-1299-4cef-ba12-d0b6fdd5bfb3 tempest-AggregatesAdminNegativeTestJSON-1831622130 tempest-AggregatesAdminNegativeTestJSON-1831622130-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:27.217933 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:27.217933 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:27.223317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0f80d5da-1299-4cef-ba12-d0b6fdd5bfb3 tempest-AggregatesAdminNegativeTestJSON-1831622130 tempest-AggregatesAdminNegativeTestJSON-1831622130-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'da896ceda2834cf7ad1a2b8455f23011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ad8607d9644d27a7eddc445e5e9a22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:27.227343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0f80d5da-1299-4cef-ba12-d0b6fdd5bfb3 tempest-AggregatesAdminNegativeTestJSON-1831622130 tempest-AggregatesAdminNegativeTestJSON-1831622130-project] Request method failure captured: Aug 04 16:54:27.227343 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Aug 04 16:54:27.227343 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:54:27.227343 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:54:27.227343 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:54:27.227343 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:54:27.227343 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:54:27.227343 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:54:27.227343 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:54:27.227343 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:54:27.227343 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_m7ZgpBume-THBRExitgIUBRWb7q0NC7TDQnv5PunLtwyzUVx4jUKorqLbad6Mer9iaP3b2t9XiPOAiG918F1vOx44KzEVQLr8vhaY1i5KsE780Vdi5j5pTbT9ZaFJiTNUA7IhAec0gy3WNOZmVckC5xDMmGJ9QjO2xzGGX1f91a7g Aug 04 16:54:27.227343 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:54:27.227343 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:54:27.227343 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:54:27.227343 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:54:27.227343 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:54:27.227343 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:54:27.227343 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 38ad8607d9644d27a7eddc445e5e9a22 Aug 04 16:54:27.227343 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1831622130 Aug 04 16:54:27.227343 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:54:27.227343 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:54:27.228474 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/38ad8607d9644d27a7eddc445e5e9a22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/38ad8607d9644d27a7eddc445e5e9a22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_38ad8607d9644d27a7eddc445e5e9a22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/38ad8607d9644d27a7eddc445e5e9a22"}]}] Aug 04 16:54:27.228474 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1831622130 Aug 04 16:54:27.228474 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 38ad8607d9644d27a7eddc445e5e9a22 Aug 04 16:54:27.228474 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1831622130 Aug 04 16:54:27.228474 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-AggregatesAdminNegativeTestJSON-1831622130-project Aug 04 16:54:27.228474 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:54:27.228474 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:54:27.228474 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: da896ceda2834cf7ad1a2b8455f23011 Aug 04 16:54:27.228474 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1831622130-project Aug 04 16:54:27.228474 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:54:27.228474 n-d-851359-3 devstack@n-api.service[131044]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 04 16:54:27.228474 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '8'} Aug 04 16:54:27.229085 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:54:27.229085 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:27.229085 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:27.229085 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:27.229085 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:54:27.229085 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:54:27.229085 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:54:27.229085 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:54:27.229085 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 04 16:54:27.229085 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 04 16:54:27.229085 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:54:27.229085 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:54:27.229085 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:54:27.229085 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:54:27.229085 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:54:27.229085 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:54:27.229085 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:54:27.229085 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:54:27.229085 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:54:27.233456 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:54:27.233456 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:54:27.233456 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:54:27.233456 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:54:27.233456 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:54:27.233456 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 04 16:54:27.233456 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:27.233456 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:27.233456 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:27.233456 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:27.233456 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:27.233456 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:27.233456 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:54:27.233456 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:54:27.233456 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 04 16:54:27.233456 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:27.233456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0f80d5da-1299-4cef-ba12-d0b6fdd5bfb3 tempest-AggregatesAdminNegativeTestJSON-1831622130 tempest-AggregatesAdminNegativeTestJSON-1831622130-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:54:27.234375 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0f80d5da-1299-4cef-ba12-d0b6fdd5bfb3 tempest-AggregatesAdminNegativeTestJSON-1831622130 tempest-AggregatesAdminNegativeTestJSON-1831622130-project] 10.222.0.93 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.019895 Aug 04 16:54:27.234375 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 13/45] 10.222.0.93 () {58 vars in 1149 bytes} [Thu Aug 4 16:54:27 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:54:27.241940 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fc5902c3-c2c5-4b7a-8444-8b774fcfc355 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:27.242910 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:27.242910 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:27.290715 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fc5902c3-c2c5-4b7a-8444-8b774fcfc355 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.055367 Aug 04 16:54:27.292150 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 33/46] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Aug 4 16:54:27 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 04 16:54:27.308380 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-62d477fa-2605-4a15-8d29-f297954a05c0 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:27.324468 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-62d477fa-2605-4a15-8d29-f297954a05c0 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 04 16:54:27.330523 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-62d477fa-2605-4a15-8d29-f297954a05c0 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Request method failure captured: Aug 04 16:54:27.330523 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 04 16:54:27.330523 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:54:27.330523 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:54:27.330523 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:54:27.330523 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:54:27.330523 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:54:27.330523 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:54:27.330523 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:54:27.330523 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:54:27.330523 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_m9Tv6QiivKEMChPpOLItHNNFsJXscm9k7GEUP1tWt-LzWbhM_1l9-QMLVNME1zq-Fzx7y8xp3UA45wgOR5vud8QzK6C3YOwuoDZYJfXQVceavqnx2TU2ERCZrq2KXRjmXspKqKxfqBALs4mmoW5_PLA_XHYMRtX5Nd-40A4a-KKFw Aug 04 16:54:27.330523 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:54:27.330523 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:54:27.330523 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:54:27.330523 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:54:27.330523 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:54:27.330523 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:54:27.330523 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: c0ff0891bc7f431dad4e3c76db7dcd0e Aug 04 16:54:27.330523 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1218587882 Aug 04 16:54:27.330523 n-d-851359-3 devstack@n-api.service[131044]: X-Role: admin,member,reader Aug 04 16:54:27.330523 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: admin,member,reader Aug 04 16:54:27.331676 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c0ff0891bc7f431dad4e3c76db7dcd0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c0ff0891bc7f431dad4e3c76db7dcd0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c0ff0891bc7f431dad4e3c76db7dcd0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c0ff0891bc7f431dad4e3c76db7dcd0e"}]}] Aug 04 16:54:27.331676 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1218587882 Aug 04 16:54:27.331676 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: c0ff0891bc7f431dad4e3c76db7dcd0e Aug 04 16:54:27.331676 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1218587882 Aug 04 16:54:27.331676 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin Aug 04 16:54:27.331676 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:54:27.331676 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:54:27.331676 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 7d62c764c03e49499952b26f619ed6ef Aug 04 16:54:27.331676 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin Aug 04 16:54:27.331676 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:54:27.331676 n-d-851359-3 devstack@n-api.service[131044]: exception: Aggregate -1 could not be found. Aug 04 16:54:27.331676 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '-1'} Aug 04 16:54:27.332270 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:54:27.332270 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:27.332270 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 04 16:54:27.332270 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 04 16:54:27.332270 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Aug 04 16:54:27.332270 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 04 16:54:27.332270 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:54:27.332270 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:54:27.332270 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 04 16:54:27.332270 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 04 16:54:27.332270 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:54:27.332270 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:54:27.332270 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 04 16:54:27.332270 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 04 16:54:27.332270 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 04 16:54:27.332270 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:27.332270 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:27.332270 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:27.332270 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:27.332270 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:27.333248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:27.333248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:54:27.333248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:54:27.333248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:54:27.333248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:54:27.333248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 04 16:54:27.333248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:54:27.333248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 04 16:54:27.333248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:27.333248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:27.333248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:27.333248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:27.333248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:27.333248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:27.333248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:54:27.333248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:54:27.333248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 04 16:54:27.333248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:27.336775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-62d477fa-2605-4a15-8d29-f297954a05c0 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:54:27.337930 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-62d477fa-2605-4a15-8d29-f297954a05c0 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.038397 Aug 04 16:54:27.338648 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 14/47] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Aug 4 16:54:27 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:54:27.356017 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-55e27b15-135f-4be7-b68f-d1e93f54d6ec tempest-AggregatesAdminNegativeTestJSON-1831622130 tempest-AggregatesAdminNegativeTestJSON-1831622130-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:27.356807 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:27.356807 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:27.357926 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-55e27b15-135f-4be7-b68f-d1e93f54d6ec tempest-AggregatesAdminNegativeTestJSON-1831622130 tempest-AggregatesAdminNegativeTestJSON-1831622130-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'da896ceda2834cf7ad1a2b8455f23011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ad8607d9644d27a7eddc445e5e9a22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:27.360024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-55e27b15-135f-4be7-b68f-d1e93f54d6ec tempest-AggregatesAdminNegativeTestJSON-1831622130 tempest-AggregatesAdminNegativeTestJSON-1831622130-project] Request method failure captured: Aug 04 16:54:27.360024 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 04 16:54:27.360024 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:54:27.360024 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:54:27.360024 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:54:27.360024 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:54:27.360024 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:54:27.360024 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:54:27.360024 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:54:27.360024 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:54:27.360024 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_m7ZgpBume-THBRExitgIUBRWb7q0NC7TDQnv5PunLtwyzUVx4jUKorqLbad6Mer9iaP3b2t9XiPOAiG918F1vOx44KzEVQLr8vhaY1i5KsE780Vdi5j5pTbT9ZaFJiTNUA7IhAec0gy3WNOZmVckC5xDMmGJ9QjO2xzGGX1f91a7g Aug 04 16:54:27.360024 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:54:27.360024 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:54:27.360024 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:54:27.360024 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:54:27.360024 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:54:27.360024 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:54:27.360024 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 38ad8607d9644d27a7eddc445e5e9a22 Aug 04 16:54:27.360024 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1831622130 Aug 04 16:54:27.360024 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 16:54:27.360024 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 16:54:27.361389 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/38ad8607d9644d27a7eddc445e5e9a22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/38ad8607d9644d27a7eddc445e5e9a22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_38ad8607d9644d27a7eddc445e5e9a22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/38ad8607d9644d27a7eddc445e5e9a22"}]}] Aug 04 16:54:27.361389 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1831622130 Aug 04 16:54:27.361389 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 38ad8607d9644d27a7eddc445e5e9a22 Aug 04 16:54:27.361389 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1831622130 Aug 04 16:54:27.361389 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-AggregatesAdminNegativeTestJSON-1831622130-project Aug 04 16:54:27.361389 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:54:27.361389 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:54:27.361389 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: da896ceda2834cf7ad1a2b8455f23011 Aug 04 16:54:27.361389 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1831622130-project Aug 04 16:54:27.361389 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 16:54:27.361389 n-d-851359-3 devstack@n-api.service[131043]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 04 16:54:27.361389 n-d-851359-3 devstack@n-api.service[131043]: action_args: {} Aug 04 16:54:27.362137 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:54:27.362137 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:27.362137 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:27.362137 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:27.362137 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:54:27.362137 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:54:27.362137 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:54:27.362137 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:54:27.362137 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 04 16:54:27.362137 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 04 16:54:27.362137 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:54:27.362137 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:54:27.362137 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:54:27.362137 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:54:27.362137 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:54:27.362137 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:54:27.362137 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:54:27.362137 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:54:27.362137 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:54:27.363241 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:54:27.363241 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:54:27.363241 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:54:27.363241 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:54:27.363241 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:54:27.363241 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 04 16:54:27.363241 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:27.363241 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:27.363241 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:27.363241 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:27.363241 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:27.363241 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:27.363241 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:54:27.363241 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:54:27.363241 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 04 16:54:27.363241 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:27.364947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-55e27b15-135f-4be7-b68f-d1e93f54d6ec tempest-AggregatesAdminNegativeTestJSON-1831622130 tempest-AggregatesAdminNegativeTestJSON-1831622130-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:54:27.367025 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-55e27b15-135f-4be7-b68f-d1e93f54d6ec tempest-AggregatesAdminNegativeTestJSON-1831622130 tempest-AggregatesAdminNegativeTestJSON-1831622130-project] 10.222.0.93 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.022604 Aug 04 16:54:27.367555 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 34/48] 10.222.0.93 () {58 vars in 1143 bytes} [Thu Aug 4 16:54:27 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:54:27.957080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6f6c22a8-5050-4377-9f5d-885c3c41f37f tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1214655532", "id": 592473042, "os-flavor-access:is_public": "False"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:27.961128 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:27.961128 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:27.989030 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6f6c22a8-5050-4377-9f5d-885c3c41f37f tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.633572 Aug 04 16:54:27.989629 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 15/49] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:54:27 2022] POST /compute/v2.1/flavors => generated 436 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:28.004357 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-36abbe17-f5f0-49dc-a5f3-71c5903884ff tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "00cf64ce6b5147b3a5997bc6c2428eb2"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:28.007375 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:28.007375 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:28.066155 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-aa518ca2-3370-4ffe-82a2-b37a6837844c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-644188521", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "availability_zone": "tempest-test_az-872963359"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:28.084095 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa518ca2-3370-4ffe-82a2-b37a6837844c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:28.084872 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa518ca2-3370-4ffe-82a2-b37a6837844c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:28.085531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa518ca2-3370-4ffe-82a2-b37a6837844c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:28.086415 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa518ca2-3370-4ffe-82a2-b37a6837844c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:28.087270 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa518ca2-3370-4ffe-82a2-b37a6837844c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:28.087947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa518ca2-3370-4ffe-82a2-b37a6837844c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:28.668216 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-36abbe17-f5f0-49dc-a5f3-71c5903884ff tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/592473042/action" status: 200 len: 96 microversion: 2.1 time: 0.667342 Aug 04 16:54:28.675030 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 16/50] 10.222.0.93 () {60 vars in 1197 bytes} [Thu Aug 4 16:54:27 2022] POST /compute/v2.1/flavors/592473042/action => generated 96 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 16:54:28.684848 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2217a40f-59d0-416d-8664-eeec8ce1474e tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "00cf64ce6b5147b3a5997bc6c2428eb2"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:29.068219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-aa518ca2-3370-4ffe-82a2-b37a6837844c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] validate_networks() for None {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:54:29.232804 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-2217a40f-59d0-416d-8664-eeec8ce1474e tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] HTTP exception thrown: Flavor access already exists for flavor 16 and project 00cf64ce6b5147b3a5997bc6c2428eb2 combination. Aug 04 16:54:29.257812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2217a40f-59d0-416d-8664-eeec8ce1474e tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] Request method failure captured: Aug 04 16:54:29.257812 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/flavors/592473042/action HTTP/1.1 Aug 04 16:54:29.257812 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:54:29.257812 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:54:29.257812 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:54:29.257812 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 67 Aug 04 16:54:29.257812 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:54:29.257812 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:54:29.257812 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:54:29.257812 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:54:29.257812 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_nB-xQGeyO8NzlyAGfSklZexTzNPCIFamlhfSB5WCKDtRi5TUq2gE6pCKwQJN3NwRTtlw3KAMJUvZOfseDGGyIPXoShUBQYEPJEVSFtsZzWRbVX0nBymkq4udjNP-mTNN5uwPJLGDHfB-5uYjV5E-wI99zw0H0NXqNBHg94VAJ9dx8 Aug 04 16:54:29.257812 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:54:29.257812 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:54:29.257812 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:54:29.257812 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:54:29.257812 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:54:29.257812 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:54:29.257812 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 5a33cd67a21243bfbdeb44fc7aa60369 Aug 04 16:54:29.257812 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-131841580 Aug 04 16:54:29.257812 n-d-851359-3 devstack@n-api.service[131044]: X-Role: admin,member,reader Aug 04 16:54:29.257812 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: admin,member,reader Aug 04 16:54:29.259116 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5a33cd67a21243bfbdeb44fc7aa60369"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5a33cd67a21243bfbdeb44fc7aa60369"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5a33cd67a21243bfbdeb44fc7aa60369"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5a33cd67a21243bfbdeb44fc7aa60369"}]}] Aug 04 16:54:29.259116 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-131841580 Aug 04 16:54:29.259116 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 5a33cd67a21243bfbdeb44fc7aa60369 Aug 04 16:54:29.259116 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-131841580 Aug 04 16:54:29.259116 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin Aug 04 16:54:29.259116 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:54:29.259116 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:54:29.259116 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 7d6617330045402e9c3afc071cd6f559 Aug 04 16:54:29.259116 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin Aug 04 16:54:29.259116 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 16:54:29.259116 n-d-851359-3 devstack@n-api.service[131044]: {"addTenantAccess": {"tenant": "00cf64ce6b5147b3a5997bc6c2428eb2"}} Aug 04 16:54:29.259116 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:54:29.259806 n-d-851359-3 devstack@n-api.service[131044]: exception: Flavor access already exists for flavor 16 and project 00cf64ce6b5147b3a5997bc6c2428eb2 combination. Aug 04 16:54:29.259806 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '592473042', 'body': {'addTenantAccess': {'tenant': '00cf64ce6b5147b3a5997bc6c2428eb2'}}} Aug 04 16:54:29.259806 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:54:29.259806 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:29.259806 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 16:54:29.259806 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 04 16:54:29.259806 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 16:54:29.259806 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 04 16:54:29.259806 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 16:54:29.259806 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 04 16:54:29.259806 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 16:54:29.259806 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 04 16:54:29.259806 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 16:54:29.259806 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 16:54:29.259806 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 16:54:29.259806 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result.read() Aug 04 16:54:29.259806 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 16:54:29.259806 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 04 16:54:29.260731 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 16:54:29.260731 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 04 16:54:29.260731 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 16:54:29.260731 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 04 16:54:29.260731 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 16:54:29.260731 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 04 16:54:29.260731 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '16-00cf64ce6b5147b3a5997bc6c2428eb2' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 04 16:54:29.260731 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:29.260731 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 04 16:54:29.260731 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:29.260731 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:29.260731 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 04 16:54:29.260731 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 04 16:54:29.260731 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 04 16:54:29.260731 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi session.flush() Aug 04 16:54:29.260731 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 16:54:29.260731 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 04 16:54:29.260731 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 16:54:29.260731 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 04 16:54:29.261734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 16:54:29.261734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 04 16:54:29.261734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 16:54:29.261734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception Aug 04 16:54:29.261734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 16:54:29.261734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 04 16:54:29.261734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 16:54:29.261734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 04 16:54:29.261734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 16:54:29.261734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 04 16:54:29.261734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 16:54:29.261734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 04 16:54:29.261734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 04 16:54:29.261734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 04 16:54:29.261734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 16:54:29.261734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 16:54:29.261734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 16:54:29.261734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 04 16:54:29.264725 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 16:54:29.264725 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 04 16:54:29.264725 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 16:54:29.264725 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 04 16:54:29.264725 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 16:54:29.264725 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 16:54:29.264725 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 16:54:29.264725 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception Aug 04 16:54:29.264725 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 16:54:29.264725 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 04 16:54:29.264725 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 16:54:29.264725 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 04 16:54:29.264725 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 16:54:29.264725 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 04 16:54:29.264725 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 16:54:29.264725 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 04 16:54:29.264725 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 16:54:29.264725 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 16:54:29.267398 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 16:54:29.267398 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result.read() Aug 04 16:54:29.267398 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 16:54:29.267398 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 04 16:54:29.267398 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 16:54:29.267398 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 04 16:54:29.267398 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 16:54:29.267398 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 04 16:54:29.267398 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 16:54:29.267398 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 04 16:54:29.267398 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '16-00cf64ce6b5147b3a5997bc6c2428eb2' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 04 16:54:29.267398 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 04 16:54:29.267398 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 4, 16, 54, 29, 224334), 'updated_at': None, 'flavor_id': 16, 'project_id': '00cf64ce6b5147b3a5997bc6c2428eb2'}] Aug 04 16:54:29.267398 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 16:54:29.267398 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:29.267398 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:29.267398 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:29.269459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:29.269459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 04 16:54:29.269459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 04 16:54:29.269459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 04 16:54:29.269459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 04 16:54:29.269459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 04 16:54:29.269459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 04 16:54:29.269459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 04 16:54:29.269459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 04 16:54:29.269459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 04 16:54:29.269459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 04 16:54:29.269459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:54:29.269459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:54:29.269459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 04 16:54:29.269459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 04 16:54:29.269459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 16 and project 00cf64ce6b5147b3a5997bc6c2428eb2 combination. Aug 04 16:54:29.269459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:29.269459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:29.269459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:29.272579 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:29.272579 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:29.272579 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:29.272579 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:54:29.272579 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:54:29.272579 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:54:29.272579 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:54:29.272579 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:54:29.272579 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:54:29.272579 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 04 16:54:29.272579 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 04 16:54:29.272579 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 16 and project 00cf64ce6b5147b3a5997bc6c2428eb2 combination. Aug 04 16:54:29.272579 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:29.272579 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:29.272579 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:29.272579 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:29.272579 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:29.272579 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:29.272579 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:54:29.272579 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:54:29.276668 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 16 and project 00cf64ce6b5147b3a5997bc6c2428eb2 combination. Aug 04 16:54:29.276668 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:29.276668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2217a40f-59d0-416d-8664-eeec8ce1474e tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] Returning 409 to user: Flavor access already exists for flavor 16 and project 00cf64ce6b5147b3a5997bc6c2428eb2 combination. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:54:29.276668 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2217a40f-59d0-416d-8664-eeec8ce1474e tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/592473042/action" status: 409 len: 152 microversion: 2.1 time: 0.582659 Aug 04 16:54:29.276668 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 17/51] 10.222.0.93 () {60 vars in 1197 bytes} [Thu Aug 4 16:54:28 2022] POST /compute/v2.1/flavors/592473042/action => generated 152 bytes in 589 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:54:29.282502 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a6a8d658-e3d0-40cd-ace7-f7d06d8d7709 tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "00cf64ce6b5147b3a5997bc6c2428eb2"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:29.286978 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:29.286978 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:29.678779 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-aa518ca2-3370-4ffe-82a2-b37a6837844c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:54:29.679476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-aa518ca2-3370-4ffe-82a2-b37a6837844c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:54:29.679960 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-aa518ca2-3370-4ffe-82a2-b37a6837844c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:54:29.680374 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-aa518ca2-3370-4ffe-82a2-b37a6837844c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:54:29.680792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-aa518ca2-3370-4ffe-82a2-b37a6837844c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:54:29.720567 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa518ca2-3370-4ffe-82a2-b37a6837844c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:29.722344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa518ca2-3370-4ffe-82a2-b37a6837844c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:29.723024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa518ca2-3370-4ffe-82a2-b37a6837844c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:29.725917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa518ca2-3370-4ffe-82a2-b37a6837844c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:29.730393 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa518ca2-3370-4ffe-82a2-b37a6837844c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:29.731312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa518ca2-3370-4ffe-82a2-b37a6837844c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:29.791192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-aa518ca2-3370-4ffe-82a2-b37a6837844c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Getting quotas for project 8d4104fbd3df4e7aadfaf896bea56a9c. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:54:29.801775 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-aa518ca2-3370-4ffe-82a2-b37a6837844c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Getting quotas for user 808f13b51f6d4e1d9e7c924742544ef6 and project 8d4104fbd3df4e7aadfaf896bea56a9c. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:54:29.818124 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-aa518ca2-3370-4ffe-82a2-b37a6837844c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:54:29.819684 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-aa518ca2-3370-4ffe-82a2-b37a6837844c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] [instance: d0d49f6b-4070-4e08-a35a-5dfd203c773f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:54:29.900082 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-aa518ca2-3370-4ffe-82a2-b37a6837844c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.317126 Aug 04 16:54:29.908680 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 35/52] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:54:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 16:54:29.922155 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ee303e86-57c9-47b3-b0cd-d9c0ccaf68f3 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:29.923034 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ee303e86-57c9-47b3-b0cd-d9c0ccaf68f3 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] [instance: d0d49f6b-4070-4e08-a35a-5dfd203c773f] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:30.090294 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ee303e86-57c9-47b3-b0cd-d9c0ccaf68f3 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808f13b51f6d4e1d9e7c924742544ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4104fbd3df4e7aadfaf896bea56a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:30.128301 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ee303e86-57c9-47b3-b0cd-d9c0ccaf68f3 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] 10.222.0.93 "GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f" status: 200 len: 1241 microversion: 2.1 time: 0.217119 Aug 04 16:54:30.142863 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 36/53] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:29 2022] GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f => generated 1241 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:30.146961 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a6a8d658-e3d0-40cd-ace7-f7d06d8d7709 tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/592473042/action" status: 200 len: 21 microversion: 2.1 time: 0.875108 Aug 04 16:54:30.148598 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 18/54] 10.222.0.93 () {60 vars in 1197 bytes} [Thu Aug 4 16:54:29 2022] POST /compute/v2.1/flavors/592473042/action => generated 21 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:54:30.160164 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f750a5ba-522c-4786-9445-526213842761 tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:30.161115 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:30.161115 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:30.245922 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f750a5ba-522c-4786-9445-526213842761 tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/592473042" status: 202 len: 0 microversion: 2.1 time: 0.090588 Aug 04 16:54:30.246538 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 37/55] 10.222.0.93 () {58 vars in 1158 bytes} [Thu Aug 4 16:54:30 2022] DELETE /compute/v2.1/flavors/592473042 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:54:30.254598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-50f5a428-3c10-4613-8838-5f248a63edfa tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:30.313596 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-50f5a428-3c10-4613-8838-5f248a63edfa tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062530 Aug 04 16:54:30.316316 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 19/56] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:54:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:30.343202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3aa9cc5a-aacf-49f0-a351-bdca344f7e9a tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-118354972", "id": 697563977, "os-flavor-access:is_public": "True"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:30.347636 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:30.347636 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:30.375857 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3aa9cc5a-aacf-49f0-a351-bdca344f7e9a tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.037521 Aug 04 16:54:30.386279 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 38/57] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:54:30 2022] POST /compute/v2.1/flavors => generated 434 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:30.394414 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eb122dd9-0c27-4c03-abd8-8a6161dbd9df tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:30.395354 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:30.395354 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:30.416898 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-eb122dd9-0c27-4c03-abd8-8a6161dbd9df tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 04 16:54:30.418334 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eb122dd9-0c27-4c03-abd8-8a6161dbd9df tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] Request method failure captured: Aug 04 16:54:30.418334 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/flavors/697563977/os-flavor-access HTTP/1.1 Aug 04 16:54:30.418334 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:54:30.418334 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:54:30.418334 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:54:30.418334 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:54:30.418334 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:54:30.418334 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:54:30.418334 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:54:30.418334 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:54:30.418334 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_nB-xQGeyO8NzlyAGfSklZexTzNPCIFamlhfSB5WCKDtRi5TUq2gE6pCKwQJN3NwRTtlw3KAMJUvZOfseDGGyIPXoShUBQYEPJEVSFtsZzWRbVX0nBymkq4udjNP-mTNN5uwPJLGDHfB-5uYjV5E-wI99zw0H0NXqNBHg94VAJ9dx8 Aug 04 16:54:30.418334 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:54:30.418334 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:54:30.418334 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:54:30.418334 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:54:30.418334 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:54:30.418334 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:54:30.418334 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 5a33cd67a21243bfbdeb44fc7aa60369 Aug 04 16:54:30.418334 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-131841580 Aug 04 16:54:30.418334 n-d-851359-3 devstack@n-api.service[131044]: X-Role: admin,member,reader Aug 04 16:54:30.418334 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: admin,member,reader Aug 04 16:54:30.419531 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5a33cd67a21243bfbdeb44fc7aa60369"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5a33cd67a21243bfbdeb44fc7aa60369"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5a33cd67a21243bfbdeb44fc7aa60369"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5a33cd67a21243bfbdeb44fc7aa60369"}]}] Aug 04 16:54:30.419531 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-131841580 Aug 04 16:54:30.419531 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 5a33cd67a21243bfbdeb44fc7aa60369 Aug 04 16:54:30.419531 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-131841580 Aug 04 16:54:30.419531 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin Aug 04 16:54:30.419531 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:54:30.419531 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:54:30.419531 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 7d6617330045402e9c3afc071cd6f559 Aug 04 16:54:30.419531 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin Aug 04 16:54:30.419531 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:54:30.419531 n-d-851359-3 devstack@n-api.service[131044]: exception: Access list not available for public flavors. Aug 04 16:54:30.419531 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'flavor_id': '697563977'} Aug 04 16:54:30.420143 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:54:30.420143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:30.420143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:30.420143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:30.420143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:54:30.420143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:54:30.420143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:54:30.420143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:54:30.420143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 04 16:54:30.420143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 16:54:30.420143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 04 16:54:30.420143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:30.420143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:30.420143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:30.420143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:30.420143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:30.420143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:30.420143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:54:30.420143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:54:30.420143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 04 16:54:30.420143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:30.427512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eb122dd9-0c27-4c03-abd8-8a6161dbd9df tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:54:30.433264 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eb122dd9-0c27-4c03-abd8-8a6161dbd9df tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/697563977/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.046167 Aug 04 16:54:30.439549 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 20/58] 10.222.0.93 () {58 vars in 1206 bytes} [Thu Aug 4 16:54:30 2022] GET /compute/v2.1/flavors/697563977/os-flavor-access => generated 91 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:54:30.449033 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-29fd20ac-8c14-4be7-913f-b533a32c79de tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:30.491977 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-29fd20ac-8c14-4be7-913f-b533a32c79de tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/697563977" status: 202 len: 0 microversion: 2.1 time: 0.048681 Aug 04 16:54:30.492774 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 39/59] 10.222.0.93 () {58 vars in 1158 bytes} [Thu Aug 4 16:54:30 2022] DELETE /compute/v2.1/flavors/697563977 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:54:30.502657 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e7c6df9c-8be8-4575-9ed8-dba45fd26e2f tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:30.543628 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e7c6df9c-8be8-4575-9ed8-dba45fd26e2f tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044140 Aug 04 16:54:30.546563 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 21/60] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:54:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:30.572409 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9dc34e17-0967-409f-a051-eb0e541a3f68 tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-4830461", "id": 1717088462, "os-flavor-access:is_public": "False"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:30.623101 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9dc34e17-0967-409f-a051-eb0e541a3f68 tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.054243 Aug 04 16:54:30.632667 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 40/61] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:54:30 2022] POST /compute/v2.1/flavors => generated 436 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:54:31.161138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6cfab208-af4f-4510-ae60-ff4ba50f46e1 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:31.164709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6cfab208-af4f-4510-ae60-ff4ba50f46e1 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] [instance: d0d49f6b-4070-4e08-a35a-5dfd203c773f] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:31.257513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6cfab208-af4f-4510-ae60-ff4ba50f46e1 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808f13b51f6d4e1d9e7c924742544ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4104fbd3df4e7aadfaf896bea56a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:31.272800 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6cfab208-af4f-4510-ae60-ff4ba50f46e1 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] 10.222.0.93 "GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f" status: 200 len: 1241 microversion: 2.1 time: 0.125134 Aug 04 16:54:31.274841 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 41/62] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:31 2022] GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f => generated 1241 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:31.481536 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-824e27e8-a46b-40d1-8f11-62b2be0fe180 tempest-FlavorsAccessNegativeTestJSON-2074774198 tempest-FlavorsAccessNegativeTestJSON-2074774198-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "00cf64ce6b5147b3a5997bc6c2428eb2"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:31.487981 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-824e27e8-a46b-40d1-8f11-62b2be0fe180 tempest-FlavorsAccessNegativeTestJSON-2074774198 tempest-FlavorsAccessNegativeTestJSON-2074774198-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'aafffcaeb8d243909f25ef946f4ec25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cf64ce6b5147b3a5997bc6c2428eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:31.490491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-824e27e8-a46b-40d1-8f11-62b2be0fe180 tempest-FlavorsAccessNegativeTestJSON-2074774198 tempest-FlavorsAccessNegativeTestJSON-2074774198-project] Request method failure captured: Aug 04 16:54:31.490491 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/flavors/1717088462/action HTTP/1.1 Aug 04 16:54:31.490491 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:54:31.490491 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:54:31.490491 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:54:31.490491 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 67 Aug 04 16:54:31.490491 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:54:31.490491 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:54:31.490491 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:54:31.490491 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:54:31.490491 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_m_q7rMc05FiWAdEvtVsvtIxXsGfZmNpizOxnnPP_Yji40pIRmRfPJg5FlLVuB7mmqcvaSMrpXaWlsU9Ky8U-PkWD-pQwilnQTVzfGdCkaG1AhlxE5jstu3R5Ht3tEQ00e8PGLMIo4A9Crr3UnqUHy3GAA0YHIgGZlIG9l9rsFHbw0 Aug 04 16:54:31.490491 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:54:31.490491 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:54:31.490491 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:54:31.490491 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:54:31.490491 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:54:31.490491 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:54:31.490491 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 00cf64ce6b5147b3a5997bc6c2428eb2 Aug 04 16:54:31.490491 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2074774198 Aug 04 16:54:31.490491 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:54:31.490491 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:54:31.491612 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/00cf64ce6b5147b3a5997bc6c2428eb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/00cf64ce6b5147b3a5997bc6c2428eb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_00cf64ce6b5147b3a5997bc6c2428eb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/00cf64ce6b5147b3a5997bc6c2428eb2"}]}] Aug 04 16:54:31.491612 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2074774198 Aug 04 16:54:31.491612 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 00cf64ce6b5147b3a5997bc6c2428eb2 Aug 04 16:54:31.491612 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2074774198 Aug 04 16:54:31.491612 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-FlavorsAccessNegativeTestJSON-2074774198-project Aug 04 16:54:31.491612 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:54:31.491612 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:54:31.491612 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: aafffcaeb8d243909f25ef946f4ec25e Aug 04 16:54:31.491612 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2074774198-project Aug 04 16:54:31.491612 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 16:54:31.491612 n-d-851359-3 devstack@n-api.service[131044]: {"addTenantAccess": {"tenant": "00cf64ce6b5147b3a5997bc6c2428eb2"}} Aug 04 16:54:31.491612 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:54:31.492238 n-d-851359-3 devstack@n-api.service[131044]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 04 16:54:31.492238 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '1717088462', 'body': {'addTenantAccess': {'tenant': '00cf64ce6b5147b3a5997bc6c2428eb2'}}} Aug 04 16:54:31.492238 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:54:31.492238 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:31.492238 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:31.492238 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:31.492238 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:54:31.492238 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:54:31.492238 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:54:31.492238 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:54:31.492238 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:54:31.492238 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:54:31.492238 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 04 16:54:31.492238 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 04 16:54:31.492238 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:54:31.492238 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:54:31.492238 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:54:31.492238 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:54:31.492238 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:54:31.493224 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:54:31.493224 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:54:31.493224 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:54:31.493224 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:54:31.493224 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:54:31.493224 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:54:31.493224 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:54:31.493224 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:54:31.493224 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:54:31.493224 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 04 16:54:31.493224 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:31.493224 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:31.493224 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:31.493224 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:31.493224 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:31.493224 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:31.493224 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:54:31.493224 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:54:31.493224 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 04 16:54:31.493224 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:31.497921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-824e27e8-a46b-40d1-8f11-62b2be0fe180 tempest-FlavorsAccessNegativeTestJSON-2074774198 tempest-FlavorsAccessNegativeTestJSON-2074774198-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:54:31.499818 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-824e27e8-a46b-40d1-8f11-62b2be0fe180 tempest-FlavorsAccessNegativeTestJSON-2074774198 tempest-FlavorsAccessNegativeTestJSON-2074774198-project] 10.222.0.93 "POST /compute/v2.1/flavors/1717088462/action" status: 403 len: 130 microversion: 2.1 time: 0.867344 Aug 04 16:54:31.504220 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 22/63] 10.222.0.93 () {60 vars in 1200 bytes} [Thu Aug 4 16:54:30 2022] POST /compute/v2.1/flavors/1717088462/action => generated 130 bytes in 872 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:54:31.514093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d1cbaa5b-8e08-4d63-9ffa-988cb4c54031 tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:31.514875 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:31.514875 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:31.565605 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d1cbaa5b-8e08-4d63-9ffa-988cb4c54031 tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1717088462" status: 202 len: 0 microversion: 2.1 time: 0.055996 Aug 04 16:54:31.566655 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 42/64] 10.222.0.93 () {58 vars in 1161 bytes} [Thu Aug 4 16:54:31 2022] DELETE /compute/v2.1/flavors/1717088462 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:54:31.575608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8cdd5009-078b-42e7-9012-098e48887b81 tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:31.603144 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8cdd5009-078b-42e7-9012-098e48887b81 tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031665 Aug 04 16:54:31.604186 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 23/65] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:54:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:31.628613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-33497d98-d40e-4f46-9cbe-1faff5c4706a tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-129352179", "id": 674812032, "os-flavor-access:is_public": "False"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:31.633498 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:31.633498 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:31.665389 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-33497d98-d40e-4f46-9cbe-1faff5c4706a tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.043752 Aug 04 16:54:31.671900 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 43/66] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:54:31 2022] POST /compute/v2.1/flavors => generated 435 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:31.689523 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2a652df8-707f-4c32-8802-455731433ae0 tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "00cf64ce6b5147b3a5997bc6c2428eb2"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:32.296476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-de8dd51f-588d-4109-a48f-88abb28dd9a3 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:32.297872 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-de8dd51f-588d-4109-a48f-88abb28dd9a3 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] [instance: d0d49f6b-4070-4e08-a35a-5dfd203c773f] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:32.310888 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de8dd51f-588d-4109-a48f-88abb28dd9a3 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:32.316199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de8dd51f-588d-4109-a48f-88abb28dd9a3 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:32.316691 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de8dd51f-588d-4109-a48f-88abb28dd9a3 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:32.318557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de8dd51f-588d-4109-a48f-88abb28dd9a3 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:32.320895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de8dd51f-588d-4109-a48f-88abb28dd9a3 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:32.322875 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de8dd51f-588d-4109-a48f-88abb28dd9a3 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:32.351262 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2a652df8-707f-4c32-8802-455731433ae0 tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/674812032/action" status: 200 len: 96 microversion: 2.1 time: 0.677256 Aug 04 16:54:32.352408 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 24/67] 10.222.0.93 () {60 vars in 1197 bytes} [Thu Aug 4 16:54:31 2022] POST /compute/v2.1/flavors/674812032/action => generated 96 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:54:32.377413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7c401612-466f-4c4e-b4b0-454ba47a017d tempest-FlavorsAccessNegativeTestJSON-2074774198 tempest-FlavorsAccessNegativeTestJSON-2074774198-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "00cf64ce6b5147b3a5997bc6c2428eb2"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:32.387428 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7c401612-466f-4c4e-b4b0-454ba47a017d tempest-FlavorsAccessNegativeTestJSON-2074774198 tempest-FlavorsAccessNegativeTestJSON-2074774198-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'aafffcaeb8d243909f25ef946f4ec25e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00cf64ce6b5147b3a5997bc6c2428eb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:32.390313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7c401612-466f-4c4e-b4b0-454ba47a017d tempest-FlavorsAccessNegativeTestJSON-2074774198 tempest-FlavorsAccessNegativeTestJSON-2074774198-project] Request method failure captured: Aug 04 16:54:32.390313 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/flavors/674812032/action HTTP/1.1 Aug 04 16:54:32.390313 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:54:32.390313 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:54:32.390313 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:54:32.390313 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 70 Aug 04 16:54:32.390313 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:54:32.390313 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:54:32.390313 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:54:32.390313 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:54:32.390313 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_m_q7rMc05FiWAdEvtVsvtIxXsGfZmNpizOxnnPP_Yji40pIRmRfPJg5FlLVuB7mmqcvaSMrpXaWlsU9Ky8U-PkWD-pQwilnQTVzfGdCkaG1AhlxE5jstu3R5Ht3tEQ00e8PGLMIo4A9Crr3UnqUHy3GAA0YHIgGZlIG9l9rsFHbw0 Aug 04 16:54:32.390313 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:54:32.390313 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:54:32.390313 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:54:32.390313 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:54:32.390313 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:54:32.390313 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:54:32.390313 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 00cf64ce6b5147b3a5997bc6c2428eb2 Aug 04 16:54:32.390313 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2074774198 Aug 04 16:54:32.390313 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:54:32.390313 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:54:32.391485 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/00cf64ce6b5147b3a5997bc6c2428eb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/00cf64ce6b5147b3a5997bc6c2428eb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_00cf64ce6b5147b3a5997bc6c2428eb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/00cf64ce6b5147b3a5997bc6c2428eb2"}]}] Aug 04 16:54:32.391485 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2074774198 Aug 04 16:54:32.391485 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 00cf64ce6b5147b3a5997bc6c2428eb2 Aug 04 16:54:32.391485 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2074774198 Aug 04 16:54:32.391485 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-FlavorsAccessNegativeTestJSON-2074774198-project Aug 04 16:54:32.391485 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:54:32.391485 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:54:32.391485 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: aafffcaeb8d243909f25ef946f4ec25e Aug 04 16:54:32.391485 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2074774198-project Aug 04 16:54:32.391485 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 16:54:32.391485 n-d-851359-3 devstack@n-api.service[131044]: {"removeTenantAccess": {"tenant": "00cf64ce6b5147b3a5997bc6c2428eb2"}} Aug 04 16:54:32.391485 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:54:32.392082 n-d-851359-3 devstack@n-api.service[131044]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 04 16:54:32.392082 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '674812032', 'body': {'removeTenantAccess': {'tenant': '00cf64ce6b5147b3a5997bc6c2428eb2'}}} Aug 04 16:54:32.392082 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:54:32.392082 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:32.392082 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:32.392082 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:32.392082 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:54:32.392082 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:54:32.392082 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:54:32.392082 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:54:32.392082 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:54:32.392082 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:54:32.392082 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 04 16:54:32.392082 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi context.can( Aug 04 16:54:32.392082 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:54:32.392082 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:54:32.392082 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:54:32.392082 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:54:32.392082 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:54:32.392082 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:54:32.393104 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:54:32.393104 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:54:32.393104 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:54:32.393104 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:54:32.393104 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:54:32.393104 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:54:32.393104 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:54:32.393104 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:54:32.393104 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 04 16:54:32.393104 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:32.393104 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:32.393104 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:32.393104 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:32.393104 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:32.393104 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:32.393104 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:54:32.393104 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:54:32.393104 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 04 16:54:32.393104 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:32.396614 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7c401612-466f-4c4e-b4b0-454ba47a017d tempest-FlavorsAccessNegativeTestJSON-2074774198 tempest-FlavorsAccessNegativeTestJSON-2074774198-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:54:32.398307 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7c401612-466f-4c4e-b4b0-454ba47a017d tempest-FlavorsAccessNegativeTestJSON-2074774198 tempest-FlavorsAccessNegativeTestJSON-2074774198-project] 10.222.0.93 "POST /compute/v2.1/flavors/674812032/action" status: 403 len: 133 microversion: 2.1 time: 0.039463 Aug 04 16:54:32.399539 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 25/68] 10.222.0.93 () {60 vars in 1197 bytes} [Thu Aug 4 16:54:32 2022] POST /compute/v2.1/flavors/674812032/action => generated 133 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:54:32.411596 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-469ccc21-abe4-4a55-8d96-5b2c5cb1445f tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "00cf64ce6b5147b3a5997bc6c2428eb2"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:32.586478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-de8dd51f-588d-4109-a48f-88abb28dd9a3 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808f13b51f6d4e1d9e7c924742544ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4104fbd3df4e7aadfaf896bea56a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:32.607037 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-de8dd51f-588d-4109-a48f-88abb28dd9a3 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] 10.222.0.93 "GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f" status: 200 len: 1233 microversion: 2.1 time: 0.314327 Aug 04 16:54:32.609236 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 44/69] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:32 2022] GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f => generated 1233 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:54:33.249053 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-469ccc21-abe4-4a55-8d96-5b2c5cb1445f tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/674812032/action" status: 200 len: 21 microversion: 2.1 time: 0.839468 Aug 04 16:54:33.254977 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 26/70] 10.222.0.93 () {60 vars in 1197 bytes} [Thu Aug 4 16:54:32 2022] POST /compute/v2.1/flavors/674812032/action => generated 21 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:54:33.261459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-756087b1-a1ba-4541-9005-ad9daf6d51e2 tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:33.262301 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:33.262301 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:33.311869 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=17,nova_api:INSERT=8 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:33.336643 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-756087b1-a1ba-4541-9005-ad9daf6d51e2 tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/674812032" status: 202 len: 0 microversion: 2.1 time: 0.077217 Aug 04 16:54:33.338626 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 45/71] 10.222.0.93 () {58 vars in 1158 bytes} [Thu Aug 4 16:54:33 2022] DELETE /compute/v2.1/flavors/674812032 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:54:33.350515 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ca2ad925-40e4-461a-8a55-c707f7affcd0 tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:33.365236 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=8,nova_api:UPDATE=1,nova_api:DELETE=5 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:33.435893 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ca2ad925-40e4-461a-8a55-c707f7affcd0 tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.092690 Aug 04 16:54:33.440525 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 27/72] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:54:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:33.461245 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e193c91d-5df7-4f01-92b5-83994b815e90 tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1566113810", "id": 1454216905, "os-flavor-access:is_public": "False"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:33.464873 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:33.464873 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:33.516851 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e193c91d-5df7-4f01-92b5-83994b815e90 tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.060486 Aug 04 16:54:33.518403 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 46/73] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:54:33 2022] POST /compute/v2.1/flavors => generated 439 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:33.532040 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c9125a1b-40fe-4e27-ba15-4c87a0bda363 tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2087319143a64b0cb7ce6151ca2121ca"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:33.637478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-49262883-e82b-48a7-8fe7-733d9d632db2 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:33.638996 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-49262883-e82b-48a7-8fe7-733d9d632db2 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] [instance: d0d49f6b-4070-4e08-a35a-5dfd203c773f] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:33.665689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-49262883-e82b-48a7-8fe7-733d9d632db2 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:33.670934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-49262883-e82b-48a7-8fe7-733d9d632db2 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:33.672460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-49262883-e82b-48a7-8fe7-733d9d632db2 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:33.674591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-49262883-e82b-48a7-8fe7-733d9d632db2 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:33.677508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-49262883-e82b-48a7-8fe7-733d9d632db2 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:33.680643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-49262883-e82b-48a7-8fe7-733d9d632db2 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:33.865190 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-49262883-e82b-48a7-8fe7-733d9d632db2 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808f13b51f6d4e1d9e7c924742544ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4104fbd3df4e7aadfaf896bea56a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:33.873348 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-49262883-e82b-48a7-8fe7-733d9d632db2 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] 10.222.0.93 "GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f" status: 200 len: 1295 microversion: 2.1 time: 0.240351 Aug 04 16:54:33.878974 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 47/74] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:33 2022] GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f => generated 1295 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:34.456621 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-c9125a1b-40fe-4e27-ba15-4c87a0bda363 tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] HTTP exception thrown: Flavor access not found for 20 / 2087319143a64b0cb7ce6151ca2121ca combination. Aug 04 16:54:34.461476 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c9125a1b-40fe-4e27-ba15-4c87a0bda363 tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] Request method failure captured: Aug 04 16:54:34.461476 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/flavors/1454216905/action HTTP/1.1 Aug 04 16:54:34.461476 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:54:34.461476 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:54:34.461476 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:54:34.461476 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 70 Aug 04 16:54:34.461476 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:54:34.461476 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:54:34.461476 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:54:34.461476 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:54:34.461476 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_nB-xQGeyO8NzlyAGfSklZexTzNPCIFamlhfSB5WCKDtRi5TUq2gE6pCKwQJN3NwRTtlw3KAMJUvZOfseDGGyIPXoShUBQYEPJEVSFtsZzWRbVX0nBymkq4udjNP-mTNN5uwPJLGDHfB-5uYjV5E-wI99zw0H0NXqNBHg94VAJ9dx8 Aug 04 16:54:34.461476 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:54:34.461476 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:54:34.461476 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:54:34.461476 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:54:34.461476 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:54:34.461476 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:54:34.461476 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 5a33cd67a21243bfbdeb44fc7aa60369 Aug 04 16:54:34.461476 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-131841580 Aug 04 16:54:34.461476 n-d-851359-3 devstack@n-api.service[131044]: X-Role: admin,member,reader Aug 04 16:54:34.461476 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: admin,member,reader Aug 04 16:54:34.462618 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5a33cd67a21243bfbdeb44fc7aa60369"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5a33cd67a21243bfbdeb44fc7aa60369"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5a33cd67a21243bfbdeb44fc7aa60369"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5a33cd67a21243bfbdeb44fc7aa60369"}]}] Aug 04 16:54:34.462618 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-131841580 Aug 04 16:54:34.462618 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 5a33cd67a21243bfbdeb44fc7aa60369 Aug 04 16:54:34.462618 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-131841580 Aug 04 16:54:34.462618 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin Aug 04 16:54:34.462618 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:54:34.462618 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:54:34.462618 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 7d6617330045402e9c3afc071cd6f559 Aug 04 16:54:34.462618 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin Aug 04 16:54:34.462618 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 16:54:34.462618 n-d-851359-3 devstack@n-api.service[131044]: {"removeTenantAccess": {"tenant": "2087319143a64b0cb7ce6151ca2121ca"}} Aug 04 16:54:34.462618 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:54:34.463230 n-d-851359-3 devstack@n-api.service[131044]: exception: Flavor access not found for 20 / 2087319143a64b0cb7ce6151ca2121ca combination. Aug 04 16:54:34.463230 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '1454216905', 'body': {'removeTenantAccess': {'tenant': '2087319143a64b0cb7ce6151ca2121ca'}}} Aug 04 16:54:34.463230 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:54:34.463230 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:34.463230 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 04 16:54:34.463230 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 04 16:54:34.463230 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 04 16:54:34.463230 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 04 16:54:34.463230 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 04 16:54:34.463230 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 04 16:54:34.463230 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 04 16:54:34.463230 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 04 16:54:34.463230 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 04 16:54:34.463230 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 04 16:54:34.463230 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:54:34.463230 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:54:34.463230 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 04 16:54:34.463230 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 04 16:54:34.464187 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 20 / 2087319143a64b0cb7ce6151ca2121ca combination. Aug 04 16:54:34.464187 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:34.464187 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:34.464187 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:34.464187 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:34.464187 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:34.464187 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:34.464187 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:54:34.464187 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:54:34.464187 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:54:34.464187 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:54:34.464187 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:54:34.464187 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:54:34.464187 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 04 16:54:34.464187 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:54:34.464187 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 20 / 2087319143a64b0cb7ce6151ca2121ca combination. Aug 04 16:54:34.464187 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:34.464187 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:34.464187 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:34.464187 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:34.465188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:34.465188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:34.465188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:54:34.465188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:54:34.465188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 20 / 2087319143a64b0cb7ce6151ca2121ca combination. Aug 04 16:54:34.465188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:34.465188 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c9125a1b-40fe-4e27-ba15-4c87a0bda363 tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] Returning 404 to user: Flavor access not found for 20 / 2087319143a64b0cb7ce6151ca2121ca combination. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:54:34.466989 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c9125a1b-40fe-4e27-ba15-4c87a0bda363 tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/1454216905/action" status: 404 len: 124 microversion: 2.1 time: 0.938576 Aug 04 16:54:34.467602 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 28/75] 10.222.0.93 () {60 vars in 1200 bytes} [Thu Aug 4 16:54:33 2022] POST /compute/v2.1/flavors/1454216905/action => generated 124 bytes in 942 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:54:34.478877 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8f8f53fd-4699-4f4a-9333-193c5b80f621 tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:34.479900 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:34.479900 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:34.515927 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8f8f53fd-4699-4f4a-9333-193c5b80f621 tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1454216905" status: 202 len: 0 microversion: 2.1 time: 0.041891 Aug 04 16:54:34.517151 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 48/76] 10.222.0.93 () {58 vars in 1161 bytes} [Thu Aug 4 16:54:34 2022] DELETE /compute/v2.1/flavors/1454216905 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:54:34.526521 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6264ca1d-ce4d-4af6-84c4-a048f07f3c5d tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:34.574053 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6264ca1d-ce4d-4af6-84c4-a048f07f3c5d tempest-FlavorsAccessNegativeTestJSON-131841580 tempest-FlavorsAccessNegativeTestJSON-131841580-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051259 Aug 04 16:54:34.576626 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 29/77] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:54:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:34.898661 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-13f8deee-f085-48b3-9a33-d32a324753b3 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:34.899299 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-13f8deee-f085-48b3-9a33-d32a324753b3 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] [instance: d0d49f6b-4070-4e08-a35a-5dfd203c773f] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:34.906133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13f8deee-f085-48b3-9a33-d32a324753b3 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:34.906725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13f8deee-f085-48b3-9a33-d32a324753b3 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:34.907187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13f8deee-f085-48b3-9a33-d32a324753b3 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:34.907919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13f8deee-f085-48b3-9a33-d32a324753b3 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:34.908380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13f8deee-f085-48b3-9a33-d32a324753b3 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:34.908980 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13f8deee-f085-48b3-9a33-d32a324753b3 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:35.979130 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-13f8deee-f085-48b3-9a33-d32a324753b3 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808f13b51f6d4e1d9e7c924742544ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4104fbd3df4e7aadfaf896bea56a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:35.989300 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-13f8deee-f085-48b3-9a33-d32a324753b3 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] 10.222.0.93 "GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f" status: 200 len: 1337 microversion: 2.1 time: 1.094451 Aug 04 16:54:36.009248 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 49/78] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:34 2022] GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f => generated 1337 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:36.993301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=24 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:37.029631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0ca15a86-53ca-43ae-b49f-57ecfc38dac4 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:37.030287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0ca15a86-53ca-43ae-b49f-57ecfc38dac4 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] [instance: d0d49f6b-4070-4e08-a35a-5dfd203c773f] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:37.039118 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ca15a86-53ca-43ae-b49f-57ecfc38dac4 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:37.043311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ca15a86-53ca-43ae-b49f-57ecfc38dac4 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:37.044464 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ca15a86-53ca-43ae-b49f-57ecfc38dac4 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:37.047049 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ca15a86-53ca-43ae-b49f-57ecfc38dac4 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:37.048123 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ca15a86-53ca-43ae-b49f-57ecfc38dac4 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:37.050293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ca15a86-53ca-43ae-b49f-57ecfc38dac4 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:37.418323 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-548c936e-94f8-4689-ba67-c6f050d2e890 tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Calling method '.version_select at 0x7f1e68497dc0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:37.419330 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:37.419330 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:37.420930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-548c936e-94f8-4689-ba67-c6f050d2e890 tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:37.421682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-548c936e-94f8-4689-ba67-c6f050d2e890 tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:37.422328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-548c936e-94f8-4689-ba67-c6f050d2e890 tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:37.471238 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-548c936e-94f8-4689-ba67-c6f050d2e890 tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:37.475988 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-548c936e-94f8-4689-ba67-c6f050d2e890 tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:37.476694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-548c936e-94f8-4689-ba67-c6f050d2e890 tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:37.511853 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-548c936e-94f8-4689-ba67-c6f050d2e890 tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:37.512624 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-548c936e-94f8-4689-ba67-c6f050d2e890 tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:37.514691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-548c936e-94f8-4689-ba67-c6f050d2e890 tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:37.529657 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-548c936e-94f8-4689-ba67-c6f050d2e890 tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.942270 Aug 04 16:54:37.537907 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 30/79] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:54:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:37.747684 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0ca15a86-53ca-43ae-b49f-57ecfc38dac4 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808f13b51f6d4e1d9e7c924742544ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4104fbd3df4e7aadfaf896bea56a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:37.759189 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0ca15a86-53ca-43ae-b49f-57ecfc38dac4 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] 10.222.0.93 "GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f" status: 200 len: 1337 microversion: 2.1 time: 0.733490 Aug 04 16:54:37.761065 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 50/80] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:37 2022] GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f => generated 1337 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:37.789807 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f2426f21-ec2d-42ee-b81b-9cafd0217708 tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Calling method '.version_select at 0x7f1e6830c820>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:37.803251 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:37.803251 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:37.804490 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2426f21-ec2d-42ee-b81b-9cafd0217708 tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:37.804992 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2426f21-ec2d-42ee-b81b-9cafd0217708 tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:37.805439 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2426f21-ec2d-42ee-b81b-9cafd0217708 tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:37.902938 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2426f21-ec2d-42ee-b81b-9cafd0217708 tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:37.903447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2426f21-ec2d-42ee-b81b-9cafd0217708 tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:37.903896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2426f21-ec2d-42ee-b81b-9cafd0217708 tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:38.039910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2426f21-ec2d-42ee-b81b-9cafd0217708 tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:38.041317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2426f21-ec2d-42ee-b81b-9cafd0217708 tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:38.048085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2426f21-ec2d-42ee-b81b-9cafd0217708 tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:38.056526 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f2426f21-ec2d-42ee-b81b-9cafd0217708 tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/n-h1-851359-3/servers" status: 200 len: 196 microversion: 2.1 time: 0.293492 Aug 04 16:54:38.057436 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 51/81] 10.222.0.93 () {58 vars in 1212 bytes} [Thu Aug 4 16:54:37 2022] GET /compute/v2.1/os-hypervisors/n-h1-851359-3/servers => generated 196 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:38.071628 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e0e9d338-7c97-498e-ac67-26c8e78f2a6c tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Calling method '.version_select at 0x7f1e6830caf0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:38.073707 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:38.073707 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:38.075477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0e9d338-7c97-498e-ac67-26c8e78f2a6c tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:38.076169 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0e9d338-7c97-498e-ac67-26c8e78f2a6c tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:38.076939 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0e9d338-7c97-498e-ac67-26c8e78f2a6c tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:38.180458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0e9d338-7c97-498e-ac67-26c8e78f2a6c tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:38.181022 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0e9d338-7c97-498e-ac67-26c8e78f2a6c tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:38.183708 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0e9d338-7c97-498e-ac67-26c8e78f2a6c tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:38.227428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0e9d338-7c97-498e-ac67-26c8e78f2a6c tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:38.229843 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0e9d338-7c97-498e-ac67-26c8e78f2a6c tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:38.232605 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0e9d338-7c97-498e-ac67-26c8e78f2a6c tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:38.264412 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e0e9d338-7c97-498e-ac67-26c8e78f2a6c tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.197348 Aug 04 16:54:38.265098 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 52/82] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:54:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:54:38.278058 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8c45e289-6b1e-420f-84d5-e0adc221856d tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Calling method '.version_select at 0x7f1e682ae3a0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:38.281020 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:38.281020 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:38.282217 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c45e289-6b1e-420f-84d5-e0adc221856d tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:38.282979 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c45e289-6b1e-420f-84d5-e0adc221856d tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:38.283776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c45e289-6b1e-420f-84d5-e0adc221856d tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:38.298675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c45e289-6b1e-420f-84d5-e0adc221856d tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:38.299691 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c45e289-6b1e-420f-84d5-e0adc221856d tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:38.300410 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c45e289-6b1e-420f-84d5-e0adc221856d tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:38.308511 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8c45e289-6b1e-420f-84d5-e0adc221856d tempest-HypervisorAdminUnderV252Test-1697922473 tempest-HypervisorAdminUnderV252Test-1697922473-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/n-h1-851359-3/search" status: 200 len: 104 microversion: 2.1 time: 0.036135 Aug 04 16:54:38.310010 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 53/83] 10.222.0.93 () {58 vars in 1209 bytes} [Thu Aug 4 16:54:38 2022] GET /compute/v2.1/os-hypervisors/n-h1-851359-3/search => generated 104 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:38.470870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1039225b-f643-4920-afa9-8fb414a80ed1 tempest-FlavorsAccessTestJSON-1410270275 tempest-FlavorsAccessTestJSON-1410270275-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1560524251", "id": 674771023, "os-flavor-access:is_public": "False"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:38.475233 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:38.475233 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:38.509447 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1039225b-f643-4920-afa9-8fb414a80ed1 tempest-FlavorsAccessTestJSON-1410270275 tempest-FlavorsAccessTestJSON-1410270275-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.974787 Aug 04 16:54:38.525305 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 31/84] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:54:37 2022] POST /compute/v2.1/flavors => generated 428 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:38.531631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-527f89b9-1a95-4fef-90fe-92ee35c0f2e9 tempest-FlavorsAccessTestJSON-1410270275 tempest-FlavorsAccessTestJSON-1410270275-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "dbd6be14f0654d6d9d7856f593f067dd"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:38.534256 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:38.534256 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:38.783938 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1a23dcbb-e20b-439b-b144-46d62b0fa13e tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:38.784861 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1a23dcbb-e20b-439b-b144-46d62b0fa13e tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] [instance: d0d49f6b-4070-4e08-a35a-5dfd203c773f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:38.819125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1a23dcbb-e20b-439b-b144-46d62b0fa13e tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:38.819844 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1a23dcbb-e20b-439b-b144-46d62b0fa13e tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:38.822777 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1a23dcbb-e20b-439b-b144-46d62b0fa13e tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:38.823973 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1a23dcbb-e20b-439b-b144-46d62b0fa13e tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:38.826724 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1a23dcbb-e20b-439b-b144-46d62b0fa13e tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:38.827501 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1a23dcbb-e20b-439b-b144-46d62b0fa13e tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:39.771295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=8 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:40.230396 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-527f89b9-1a95-4fef-90fe-92ee35c0f2e9 tempest-FlavorsAccessTestJSON-1410270275 tempest-FlavorsAccessTestJSON-1410270275-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/674771023/action" status: 200 len: 96 microversion: 2.1 time: 1.700859 Aug 04 16:54:40.232934 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 54/85] 10.222.0.93 () {60 vars in 1197 bytes} [Thu Aug 4 16:54:38 2022] POST /compute/v2.1/flavors/674771023/action => generated 96 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:54:41.269456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=10 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:41.328546 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c1991481-d893-4c67-8a82-9054270ab1e7 tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Calling method '.version_select at 0x7f1e6828c790>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:41.332430 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:41.332430 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:41.334653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c1991481-d893-4c67-8a82-9054270ab1e7 tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:41.336846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c1991481-d893-4c67-8a82-9054270ab1e7 tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:41.339894 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c1991481-d893-4c67-8a82-9054270ab1e7 tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:41.406914 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c1991481-d893-4c67-8a82-9054270ab1e7 tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:41.411772 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c1991481-d893-4c67-8a82-9054270ab1e7 tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:41.413849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c1991481-d893-4c67-8a82-9054270ab1e7 tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:41.484612 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c1991481-d893-4c67-8a82-9054270ab1e7 tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:41.485119 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c1991481-d893-4c67-8a82-9054270ab1e7 tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:41.485593 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c1991481-d893-4c67-8a82-9054270ab1e7 tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:41.502310 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c1991481-d893-4c67-8a82-9054270ab1e7 tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:41.503060 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c1991481-d893-4c67-8a82-9054270ab1e7 tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:41.503654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c1991481-d893-4c67-8a82-9054270ab1e7 tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:41.539259 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c1991481-d893-4c67-8a82-9054270ab1e7 tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:41.540119 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c1991481-d893-4c67-8a82-9054270ab1e7 tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:41.540774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c1991481-d893-4c67-8a82-9054270ab1e7 tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:41.549043 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c1991481-d893-4c67-8a82-9054270ab1e7 tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1664 microversion: 2.53 time: 1.314485 Aug 04 16:54:41.550376 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 55/86] 10.222.0.93 () {60 vars in 1243 bytes} [Thu Aug 4 16:54:40 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1664 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:54:41.648725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1a23dcbb-e20b-439b-b144-46d62b0fa13e tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808f13b51f6d4e1d9e7c924742544ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4104fbd3df4e7aadfaf896bea56a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:41.686165 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1a23dcbb-e20b-439b-b144-46d62b0fa13e tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] 10.222.0.93 "GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f" status: 200 len: 1337 microversion: 2.1 time: 2.907711 Aug 04 16:54:41.686780 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 32/87] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:38 2022] GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f => generated 1337 bytes in 2909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:54:42.367350 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bd14160f-4a20-4c67-aa4c-782b5a7206a2 tempest-FlavorsAccessTestJSON-2064347852 tempest-FlavorsAccessTestJSON-2064347852-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:42.441908 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bd14160f-4a20-4c67-aa4c-782b5a7206a2 tempest-FlavorsAccessTestJSON-2064347852 tempest-FlavorsAccessTestJSON-2064347852-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.887020 Aug 04 16:54:42.443876 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 56/88] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:54:41 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:42.455924 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-285b37e8-8657-48ed-b3b9-4dccdc6c1570 req-16c156e5-75f1-4c90-bf46-52ee95358a9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0d49f6b-4070-4e08-a35a-5dfd203c773f", "tag": "1b12464f-face-48ed-ae05-715066fcbad9"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:42.517713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-285b37e8-8657-48ed-b3b9-4dccdc6c1570 req-16c156e5-75f1-4c90-bf46-52ee95358a9b service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:42.518867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-285b37e8-8657-48ed-b3b9-4dccdc6c1570 req-16c156e5-75f1-4c90-bf46-52ee95358a9b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:42.519447 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-285b37e8-8657-48ed-b3b9-4dccdc6c1570 req-16c156e5-75f1-4c90-bf46-52ee95358a9b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:42.554739 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-285b37e8-8657-48ed-b3b9-4dccdc6c1570 req-16c156e5-75f1-4c90-bf46-52ee95358a9b service nova] Creating event network-changed:1b12464f-face-48ed-ae05-715066fcbad9 for instance d0d49f6b-4070-4e08-a35a-5dfd203c773f on n-h1-851359-3 Aug 04 16:54:42.555560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-285b37e8-8657-48ed-b3b9-4dccdc6c1570 req-16c156e5-75f1-4c90-bf46-52ee95358a9b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 04 16:54:42.556394 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-285b37e8-8657-48ed-b3b9-4dccdc6c1570 req-16c156e5-75f1-4c90-bf46-52ee95358a9b service nova] Acquired lock "compute-rpcapi-router" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 04 16:54:42.558068 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a664b7c-2dc5-451e-97bc-1b33dcd0ae0b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:42.558787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a664b7c-2dc5-451e-97bc-1b33dcd0ae0b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:42.559783 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a664b7c-2dc5-451e-97bc-1b33dcd0ae0b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:42.560758 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a664b7c-2dc5-451e-97bc-1b33dcd0ae0b None None] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:42.561434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a664b7c-2dc5-451e-97bc-1b33dcd0ae0b None None] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:42.562109 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a664b7c-2dc5-451e-97bc-1b33dcd0ae0b None None] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:42.575065 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.compute.rpcapi [None req-7a664b7c-2dc5-451e-97bc-1b33dcd0ae0b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 16:54:42.581844 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a664b7c-2dc5-451e-97bc-1b33dcd0ae0b None None] Releasing lock "compute-rpcapi-router" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 04 16:54:42.626619 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7a664b7c-2dc5-451e-97bc-1b33dcd0ae0b None None] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.920741 Aug 04 16:54:42.627629 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 33/89] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:42.637874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-601420bf-c89e-4a21-b8b2-5d2414e69faf tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Calling method '.version_select at 0x7f1e6836db80>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:42.644890 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:42.644890 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:42.646245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-601420bf-c89e-4a21-b8b2-5d2414e69faf tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:42.659211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-601420bf-c89e-4a21-b8b2-5d2414e69faf tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:42.660572 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-601420bf-c89e-4a21-b8b2-5d2414e69faf tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:42.735509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-601420bf-c89e-4a21-b8b2-5d2414e69faf tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:42.736113 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-601420bf-c89e-4a21-b8b2-5d2414e69faf tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:42.736569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-601420bf-c89e-4a21-b8b2-5d2414e69faf tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:42.840912 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-601420bf-c89e-4a21-b8b2-5d2414e69faf tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:42.842554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-601420bf-c89e-4a21-b8b2-5d2414e69faf tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:42.843347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-601420bf-c89e-4a21-b8b2-5d2414e69faf tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:42.863927 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ed1dbe49-b5a5-4c38-8fe1-73a308f68fb3 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Calling method '.version_select at 0x7f1e68365c10>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:42.863927 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:42.863927 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:42.863927 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed1dbe49-b5a5-4c38-8fe1-73a308f68fb3 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:42.863927 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed1dbe49-b5a5-4c38-8fe1-73a308f68fb3 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:42.864497 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed1dbe49-b5a5-4c38-8fe1-73a308f68fb3 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:42.902421 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-601420bf-c89e-4a21-b8b2-5d2414e69faf tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:42.907983 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-601420bf-c89e-4a21-b8b2-5d2414e69faf tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:42.909964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-601420bf-c89e-4a21-b8b2-5d2414e69faf tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:42.926684 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed1dbe49-b5a5-4c38-8fe1-73a308f68fb3 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:42.928862 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed1dbe49-b5a5-4c38-8fe1-73a308f68fb3 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:42.931741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed1dbe49-b5a5-4c38-8fe1-73a308f68fb3 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:42.981803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-601420bf-c89e-4a21-b8b2-5d2414e69faf tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:42.985141 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-601420bf-c89e-4a21-b8b2-5d2414e69faf tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:42.988377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-601420bf-c89e-4a21-b8b2-5d2414e69faf tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:42.997691 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed1dbe49-b5a5-4c38-8fe1-73a308f68fb3 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:42.997691 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed1dbe49-b5a5-4c38-8fe1-73a308f68fb3 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:43.001469 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed1dbe49-b5a5-4c38-8fe1-73a308f68fb3 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:43.023369 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-601420bf-c89e-4a21-b8b2-5d2414e69faf tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 357 microversion: 2.53 time: 0.392113 Aug 04 16:54:43.029108 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 34/90] 10.222.0.93 () {60 vars in 1222 bytes} [Thu Aug 4 16:54:42 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 357 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:54:43.034171 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ed1dbe49-b5a5-4c38-8fe1-73a308f68fb3 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.587761 Aug 04 16:54:43.045680 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 57/91] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:54:42 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:43.053876 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-885cc750-6cba-493f-83bf-6aa0f5b62f4a tempest-FlavorsAccessTestJSON-1410270275 tempest-FlavorsAccessTestJSON-1410270275-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "dbd6be14f0654d6d9d7856f593f067dd"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:43.082742 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3ee32fda-4b3f-45c0-92a2-78f479d4ee0f tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:43.083762 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:43.083762 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:43.087543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3ee32fda-4b3f-45c0-92a2-78f479d4ee0f tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] [instance: d0d49f6b-4070-4e08-a35a-5dfd203c773f] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:43.110196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ee32fda-4b3f-45c0-92a2-78f479d4ee0f tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:43.110704 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ee32fda-4b3f-45c0-92a2-78f479d4ee0f tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:43.111149 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ee32fda-4b3f-45c0-92a2-78f479d4ee0f tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:43.117160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ee32fda-4b3f-45c0-92a2-78f479d4ee0f tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:43.120232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ee32fda-4b3f-45c0-92a2-78f479d4ee0f tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:43.122243 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ee32fda-4b3f-45c0-92a2-78f479d4ee0f tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:43.877746 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-885cc750-6cba-493f-83bf-6aa0f5b62f4a tempest-FlavorsAccessTestJSON-1410270275 tempest-FlavorsAccessTestJSON-1410270275-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/674771023/action" status: 200 len: 21 microversion: 2.1 time: 0.847366 Aug 04 16:54:43.884425 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 35/92] 10.222.0.93 () {60 vars in 1197 bytes} [Thu Aug 4 16:54:43 2022] POST /compute/v2.1/flavors/674771023/action => generated 21 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:54:43.890148 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-79cb7d71-4489-4bdc-9f72-7489b5875862 tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Calling method '.version_select at 0x7f1e683ab790>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:43.899857 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:43.899857 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:43.907904 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-79cb7d71-4489-4bdc-9f72-7489b5875862 tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:43.908887 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-79cb7d71-4489-4bdc-9f72-7489b5875862 tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:43.910463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-79cb7d71-4489-4bdc-9f72-7489b5875862 tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:43.963714 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-79cb7d71-4489-4bdc-9f72-7489b5875862 tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:43.964421 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-79cb7d71-4489-4bdc-9f72-7489b5875862 tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:43.965032 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-79cb7d71-4489-4bdc-9f72-7489b5875862 tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:43.983779 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-79cb7d71-4489-4bdc-9f72-7489b5875862 tempest-HypervisorAdminV253TestBase-1383276004 tempest-HypervisorAdminV253TestBase-1383276004-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/4440ca4f-54a5-4b28-ad9b-a52ad997cbed" status: 200 len: 792 microversion: 2.53 time: 0.095280 Aug 04 16:54:43.998839 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 36/93] 10.222.0.93 () {60 vars in 1298 bytes} [Thu Aug 4 16:54:43 2022] GET /compute/v2.1/os-hypervisors/4440ca4f-54a5-4b28-ad9b-a52ad997cbed => generated 792 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:54:44.004257 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e6422638-465e-4b16-9fbf-049caf051c8e tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Calling method '.version_select at 0x7f1e683604c0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:44.010777 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:44.010777 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:44.012403 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6422638-465e-4b16-9fbf-049caf051c8e tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:44.013142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6422638-465e-4b16-9fbf-049caf051c8e tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:44.017958 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6422638-465e-4b16-9fbf-049caf051c8e tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:44.068416 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6422638-465e-4b16-9fbf-049caf051c8e tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:44.069278 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6422638-465e-4b16-9fbf-049caf051c8e tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:44.070000 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6422638-465e-4b16-9fbf-049caf051c8e tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:44.098721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6422638-465e-4b16-9fbf-049caf051c8e tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:44.107950 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6422638-465e-4b16-9fbf-049caf051c8e tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:44.109134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6422638-465e-4b16-9fbf-049caf051c8e tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:44.124319 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e6422638-465e-4b16-9fbf-049caf051c8e tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.123561 Aug 04 16:54:44.125421 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 37/94] 10.222.0.93 () {58 vars in 1167 bytes} [Thu Aug 4 16:54:43 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:44.144170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0f91365f-c8e5-480f-a163-d5d5bc14d85f tempest-FlavorsAccessTestJSON-2064347852 tempest-FlavorsAccessTestJSON-2064347852-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:44.221736 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0f91365f-c8e5-480f-a163-d5d5bc14d85f tempest-FlavorsAccessTestJSON-2064347852 tempest-FlavorsAccessTestJSON-2064347852-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.088914 Aug 04 16:54:44.235880 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 38/95] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:54:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:44.241659 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6170773f-c8dd-441f-ae1e-5ffb7df56a20 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Calling method '.version_select at 0x7f1e68360430>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:44.242710 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:44.242710 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:44.244438 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6170773f-c8dd-441f-ae1e-5ffb7df56a20 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:44.245294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6170773f-c8dd-441f-ae1e-5ffb7df56a20 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:44.246210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6170773f-c8dd-441f-ae1e-5ffb7df56a20 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:44.262587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6170773f-c8dd-441f-ae1e-5ffb7df56a20 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:44.263326 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6170773f-c8dd-441f-ae1e-5ffb7df56a20 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:44.263937 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6170773f-c8dd-441f-ae1e-5ffb7df56a20 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:44.277245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6170773f-c8dd-441f-ae1e-5ffb7df56a20 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:44.277901 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6170773f-c8dd-441f-ae1e-5ffb7df56a20 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:44.278528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6170773f-c8dd-441f-ae1e-5ffb7df56a20 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:44.285675 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6170773f-c8dd-441f-ae1e-5ffb7df56a20 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.048591 Aug 04 16:54:44.287590 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 39/96] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:54:44 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:44.298875 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2bd231d1-8cc8-4e61-9c89-cd88a971ea58 tempest-FlavorsAccessTestJSON-1410270275 tempest-FlavorsAccessTestJSON-1410270275-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:44.299739 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:44.299739 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:44.331643 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2bd231d1-8cc8-4e61-9c89-cd88a971ea58 tempest-FlavorsAccessTestJSON-1410270275 tempest-FlavorsAccessTestJSON-1410270275-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/674771023" status: 202 len: 0 microversion: 2.1 time: 0.041289 Aug 04 16:54:44.332976 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 40/97] 10.222.0.93 () {58 vars in 1158 bytes} [Thu Aug 4 16:54:44 2022] DELETE /compute/v2.1/flavors/674771023 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:54:44.340235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-98fd45fd-e63c-49bd-833e-781ca277c571 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Calling method '.version_select at 0x7f1e68313ee0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:44.341770 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:44.341770 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:44.343339 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98fd45fd-e63c-49bd-833e-781ca277c571 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:44.344283 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98fd45fd-e63c-49bd-833e-781ca277c571 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:44.345220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98fd45fd-e63c-49bd-833e-781ca277c571 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:44.363181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98fd45fd-e63c-49bd-833e-781ca277c571 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:44.366403 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98fd45fd-e63c-49bd-833e-781ca277c571 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:44.367461 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98fd45fd-e63c-49bd-833e-781ca277c571 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:44.376780 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-98fd45fd-e63c-49bd-833e-781ca277c571 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.042091 Aug 04 16:54:44.389282 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 41/98] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Aug 4 16:54:44 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:44.395633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2b29fa6b-389e-4054-849e-ad77b176897d tempest-FlavorsAccessTestJSON-1410270275 tempest-FlavorsAccessTestJSON-1410270275-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:44.422524 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2b29fa6b-389e-4054-849e-ad77b176897d tempest-FlavorsAccessTestJSON-1410270275 tempest-FlavorsAccessTestJSON-1410270275-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031033 Aug 04 16:54:44.423828 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 42/99] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:54:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:44.458221 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d770e47e-c7e0-48e0-a530-53c9bf331c81 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Calling method '.version_select at 0x7f1e683130d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:44.461290 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:44.461290 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:44.466460 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d770e47e-c7e0-48e0-a530-53c9bf331c81 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:44.468951 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d770e47e-c7e0-48e0-a530-53c9bf331c81 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:44.470604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d770e47e-c7e0-48e0-a530-53c9bf331c81 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:44.520016 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3ee32fda-4b3f-45c0-92a2-78f479d4ee0f tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808f13b51f6d4e1d9e7c924742544ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4104fbd3df4e7aadfaf896bea56a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:44.530483 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3ee32fda-4b3f-45c0-92a2-78f479d4ee0f tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] 10.222.0.93 "GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f" status: 200 len: 1337 microversion: 2.1 time: 1.479606 Aug 04 16:54:44.530827 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d770e47e-c7e0-48e0-a530-53c9bf331c81 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.104730 Aug 04 16:54:44.533063 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 43/100] 10.222.0.93 () {58 vars in 1179 bytes} [Thu Aug 4 16:54:44 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:44.534619 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 58/101] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:43 2022] GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f => generated 1337 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:44.551814 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-91286f17-79a8-4aca-bfcc-064324a980e6 tempest-FlavorsAccessTestJSON-1410270275 tempest-FlavorsAccessTestJSON-1410270275-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1606977969", "id": 764232286, "os-flavor-access:is_public": "False"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:44.560098 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-28765918-855f-4253-9f08-6fb52da34659 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Calling method '.version_select at 0x7f1e68232820>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:44.561159 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:44.561159 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:44.562512 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28765918-855f-4253-9f08-6fb52da34659 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:44.563172 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28765918-855f-4253-9f08-6fb52da34659 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:44.563765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28765918-855f-4253-9f08-6fb52da34659 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:44.564168 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:44.564168 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:44.610251 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-91286f17-79a8-4aca-bfcc-064324a980e6 tempest-FlavorsAccessTestJSON-1410270275 tempest-FlavorsAccessTestJSON-1410270275-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.073738 Aug 04 16:54:44.614120 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 44/102] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:54:44 2022] POST /compute/v2.1/flavors => generated 428 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:44.626364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28765918-855f-4253-9f08-6fb52da34659 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:44.628249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28765918-855f-4253-9f08-6fb52da34659 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:44.629427 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2dd7a65a-6a55-4bf7-bb23-92eddc022152 tempest-FlavorsAccessTestJSON-1410270275 tempest-FlavorsAccessTestJSON-1410270275-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:44.630740 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28765918-855f-4253-9f08-6fb52da34659 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:44.635144 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:44.635144 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:44.668802 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28765918-855f-4253-9f08-6fb52da34659 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:44.671819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28765918-855f-4253-9f08-6fb52da34659 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:44.673969 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2dd7a65a-6a55-4bf7-bb23-92eddc022152 tempest-FlavorsAccessTestJSON-1410270275 tempest-FlavorsAccessTestJSON-1410270275-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/764232286/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.050541 Aug 04 16:54:44.674605 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 45/103] 10.222.0.93 () {58 vars in 1206 bytes} [Thu Aug 4 16:54:44 2022] GET /compute/v2.1/flavors/764232286/os-flavor-access => generated 21 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:54:44.675245 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28765918-855f-4253-9f08-6fb52da34659 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:44.684942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:44.694758 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-731ca319-1570-4f7c-8771-901fda65e75b tempest-FlavorsAccessTestJSON-1410270275 tempest-FlavorsAccessTestJSON-1410270275-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:44.697004 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-28765918-855f-4253-9f08-6fb52da34659 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.141234 Aug 04 16:54:44.698131 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:44.698131 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:44.704053 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 59/104] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:54:44 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:44.715788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-23072178-4686-494b-b602-8463e55da3b2 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Calling method '.version_select at 0x7f1e68232d30>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:44.720835 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:44.720835 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:44.727429 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23072178-4686-494b-b602-8463e55da3b2 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:44.730135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23072178-4686-494b-b602-8463e55da3b2 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:44.730770 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23072178-4686-494b-b602-8463e55da3b2 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:44.748980 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-731ca319-1570-4f7c-8771-901fda65e75b tempest-FlavorsAccessTestJSON-1410270275 tempest-FlavorsAccessTestJSON-1410270275-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/764232286" status: 202 len: 0 microversion: 2.1 time: 0.068088 Aug 04 16:54:44.750136 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 46/105] 10.222.0.93 () {58 vars in 1158 bytes} [Thu Aug 4 16:54:44 2022] DELETE /compute/v2.1/flavors/764232286 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:54:44.768417 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-416d0acb-ce23-421f-b4e4-e58289005de4 tempest-FlavorsAccessTestJSON-1410270275 tempest-FlavorsAccessTestJSON-1410270275-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:44.786224 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23072178-4686-494b-b602-8463e55da3b2 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:44.787037 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23072178-4686-494b-b602-8463e55da3b2 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:44.798703 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23072178-4686-494b-b602-8463e55da3b2 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:44.807682 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-23072178-4686-494b-b602-8463e55da3b2 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.097009 Aug 04 16:54:44.813235 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 60/106] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Aug 4 16:54:44 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:44.826993 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-416d0acb-ce23-421f-b4e4-e58289005de4 tempest-FlavorsAccessTestJSON-1410270275 tempest-FlavorsAccessTestJSON-1410270275-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.072224 Aug 04 16:54:44.833630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4df29265-fae6-4d3b-9829-84f97be4b97a tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Calling method '.version_select at 0x7f1e68232dc0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:44.834380 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 47/107] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:54:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:44.835447 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:44.835447 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:44.839681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4df29265-fae6-4d3b-9829-84f97be4b97a tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:44.840383 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4df29265-fae6-4d3b-9829-84f97be4b97a tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:44.840983 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4df29265-fae6-4d3b-9829-84f97be4b97a tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:44.877628 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4df29265-fae6-4d3b-9829-84f97be4b97a tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:44.878421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4df29265-fae6-4d3b-9829-84f97be4b97a tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:44.879038 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4df29265-fae6-4d3b-9829-84f97be4b97a tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:44.892052 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4df29265-fae6-4d3b-9829-84f97be4b97a tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.072026 Aug 04 16:54:44.895560 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 61/108] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Aug 4 16:54:44 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:44.907166 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-64ece43b-5941-47f8-975a-784835a89f06 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Calling method '.version_select at 0x7f1e682deee0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:44.907932 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:44.907932 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:44.909031 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64ece43b-5941-47f8-975a-784835a89f06 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:44.909618 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64ece43b-5941-47f8-975a-784835a89f06 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:44.909939 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64ece43b-5941-47f8-975a-784835a89f06 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:44.934201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64ece43b-5941-47f8-975a-784835a89f06 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:44.936927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64ece43b-5941-47f8-975a-784835a89f06 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:44.937440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64ece43b-5941-47f8-975a-784835a89f06 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:44.960869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64ece43b-5941-47f8-975a-784835a89f06 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:44.961261 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64ece43b-5941-47f8-975a-784835a89f06 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:44.961706 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64ece43b-5941-47f8-975a-784835a89f06 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:45.011572 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-64ece43b-5941-47f8-975a-784835a89f06 tempest-HypervisorAdminTestJSON-1036619550 tempest-HypervisorAdminTestJSON-1036619550-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.107953 Aug 04 16:54:45.012183 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 48/109] 10.222.0.93 () {58 vars in 1173 bytes} [Thu Aug 4 16:54:44 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:45.584723 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d1501f0e-2f15-4815-9572-ea2134b80530 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:45.586965 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d1501f0e-2f15-4815-9572-ea2134b80530 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] [instance: d0d49f6b-4070-4e08-a35a-5dfd203c773f] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:45.651088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1501f0e-2f15-4815-9572-ea2134b80530 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:45.653328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1501f0e-2f15-4815-9572-ea2134b80530 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:45.655751 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1501f0e-2f15-4815-9572-ea2134b80530 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:45.659616 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1501f0e-2f15-4815-9572-ea2134b80530 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:45.661622 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1501f0e-2f15-4815-9572-ea2134b80530 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:45.662856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1501f0e-2f15-4815-9572-ea2134b80530 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:46.202914 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d1501f0e-2f15-4815-9572-ea2134b80530 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808f13b51f6d4e1d9e7c924742544ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4104fbd3df4e7aadfaf896bea56a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:46.218049 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d1501f0e-2f15-4815-9572-ea2134b80530 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] 10.222.0.93 "GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f" status: 200 len: 1337 microversion: 2.1 time: 0.657545 Aug 04 16:54:46.220727 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 62/110] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:45 2022] GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f => generated 1337 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:47.245173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fa6bc1b4-3b1e-434d-8db0-ac76272cb9b7 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:47.245891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fa6bc1b4-3b1e-434d-8db0-ac76272cb9b7 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] [instance: d0d49f6b-4070-4e08-a35a-5dfd203c773f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:47.264379 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa6bc1b4-3b1e-434d-8db0-ac76272cb9b7 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:47.264937 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa6bc1b4-3b1e-434d-8db0-ac76272cb9b7 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:47.265411 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa6bc1b4-3b1e-434d-8db0-ac76272cb9b7 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:47.266158 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa6bc1b4-3b1e-434d-8db0-ac76272cb9b7 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:47.268354 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa6bc1b4-3b1e-434d-8db0-ac76272cb9b7 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:47.269870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa6bc1b4-3b1e-434d-8db0-ac76272cb9b7 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:47.645603 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fa6bc1b4-3b1e-434d-8db0-ac76272cb9b7 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808f13b51f6d4e1d9e7c924742544ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4104fbd3df4e7aadfaf896bea56a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:47.660976 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fa6bc1b4-3b1e-434d-8db0-ac76272cb9b7 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] 10.222.0.93 "GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f" status: 200 len: 1337 microversion: 2.1 time: 0.418586 Aug 04 16:54:47.662518 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 49/111] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:47 2022] GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f => generated 1337 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:48.684153 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4261f539-db0f-47bc-97be-3902b9a54116 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:48.684753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4261f539-db0f-47bc-97be-3902b9a54116 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] [instance: d0d49f6b-4070-4e08-a35a-5dfd203c773f] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:48.691501 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4261f539-db0f-47bc-97be-3902b9a54116 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:48.699241 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4261f539-db0f-47bc-97be-3902b9a54116 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:48.699857 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4261f539-db0f-47bc-97be-3902b9a54116 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:48.704088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4261f539-db0f-47bc-97be-3902b9a54116 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:48.704650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4261f539-db0f-47bc-97be-3902b9a54116 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:48.706602 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4261f539-db0f-47bc-97be-3902b9a54116 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:49.160499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4261f539-db0f-47bc-97be-3902b9a54116 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808f13b51f6d4e1d9e7c924742544ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4104fbd3df4e7aadfaf896bea56a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:49.182242 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4261f539-db0f-47bc-97be-3902b9a54116 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] 10.222.0.93 "GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f" status: 200 len: 1337 microversion: 2.1 time: 0.502335 Aug 04 16:54:49.215231 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 63/112] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:48 2022] GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f => generated 1337 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:50.017724 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dcb0f0a6-66da-4f2a-9e42-d10a78bbf8c9 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-826007387", "ram": 512, "vcpus": 1, "disk": 10, "id": 1199705057, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:50.026311 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:50.026311 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:50.067691 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dcb0f0a6-66da-4f2a-9e42-d10a78bbf8c9 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.505743 Aug 04 16:54:50.077763 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 50/113] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:54:49 2022] POST /compute/v2.1/flavors => generated 415 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:50.208088 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-07f9312c-38e2-4e19-9aac-a852966cac23 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:50.209246 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-07f9312c-38e2-4e19-9aac-a852966cac23 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] [instance: d0d49f6b-4070-4e08-a35a-5dfd203c773f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:50.230724 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07f9312c-38e2-4e19-9aac-a852966cac23 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:50.231253 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07f9312c-38e2-4e19-9aac-a852966cac23 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:50.232595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07f9312c-38e2-4e19-9aac-a852966cac23 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:50.234768 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07f9312c-38e2-4e19-9aac-a852966cac23 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:50.238541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07f9312c-38e2-4e19-9aac-a852966cac23 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:50.239006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07f9312c-38e2-4e19-9aac-a852966cac23 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:50.545726 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-07f9312c-38e2-4e19-9aac-a852966cac23 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808f13b51f6d4e1d9e7c924742544ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4104fbd3df4e7aadfaf896bea56a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:50.563812 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-07f9312c-38e2-4e19-9aac-a852966cac23 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] 10.222.0.93 "GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f" status: 200 len: 1337 microversion: 2.1 time: 0.360009 Aug 04 16:54:50.564614 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 51/114] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:50 2022] GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f => generated 1337 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:54:50.616493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a9495462-ce88-41f4-ba88-caf82691e39e tempest-FlavorsExtraSpecsNegativeTestJSON-550231404 tempest-FlavorsExtraSpecsNegativeTestJSON-550231404-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:50.629425 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-a9495462-ce88-41f4-ba88-caf82691e39e tempest-FlavorsExtraSpecsNegativeTestJSON-550231404 tempest-FlavorsExtraSpecsNegativeTestJSON-550231404-project] HTTP exception thrown: Flavor 1199705057 has no extra specs with key hw:cpu_thread_policy. Aug 04 16:54:50.645695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a9495462-ce88-41f4-ba88-caf82691e39e tempest-FlavorsExtraSpecsNegativeTestJSON-550231404 tempest-FlavorsExtraSpecsNegativeTestJSON-550231404-project] Request method failure captured: Aug 04 16:54:50.645695 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/flavors/1199705057/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 04 16:54:50.645695 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:54:50.645695 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:54:50.645695 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:54:50.645695 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:54:50.645695 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:54:50.645695 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:54:50.645695 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:54:50.645695 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:54:50.645695 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_nW3XLjQtW2yN-1Sl8nLgNkCEL29Jbrs7HDHO4Qp6w99p7AR5Rt9TTpZc8c-Sf9FZ-nxuKDefNSg2DVytStEWEwv6bFIB2D7EDbotoqg9KcT2Ec-P6h2MxCPnIa0KI5XyI_d-vyu_ZXkaA-2Jr_fK_OjbtUHQ5ewVAd7vwnaCI8Hvs Aug 04 16:54:50.645695 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:54:50.645695 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:54:50.645695 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:54:50.645695 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:54:50.645695 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:54:50.645695 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:54:50.645695 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: f3ad77f5b5d64cb9ad88264795fb9132 Aug 04 16:54:50.645695 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-550231404 Aug 04 16:54:50.645695 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 16:54:50.645695 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 16:54:50.647274 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f3ad77f5b5d64cb9ad88264795fb9132"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f3ad77f5b5d64cb9ad88264795fb9132"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f3ad77f5b5d64cb9ad88264795fb9132"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f3ad77f5b5d64cb9ad88264795fb9132"}]}] Aug 04 16:54:50.647274 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-550231404 Aug 04 16:54:50.647274 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: f3ad77f5b5d64cb9ad88264795fb9132 Aug 04 16:54:50.647274 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-550231404 Aug 04 16:54:50.647274 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-550231404-project Aug 04 16:54:50.647274 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:54:50.647274 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:54:50.647274 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 6e904ff819c4443ca70605088d2b62ec Aug 04 16:54:50.647274 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-550231404-project Aug 04 16:54:50.647274 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 16:54:50.647274 n-d-851359-3 devstack@n-api.service[131043]: exception: Flavor 1199705057 has no extra specs with key hw:cpu_thread_policy. Aug 04 16:54:50.648110 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'flavor_id': '1199705057', 'id': 'hw:cpu_thread_policy'} Aug 04 16:54:50.648110 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:54:50.648110 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:50.648110 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 04 16:54:50.648110 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 04 16:54:50.648110 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 04 16:54:50.648110 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:50.648110 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:50.648110 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:50.648110 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:50.648110 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:50.648110 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:50.648110 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:54:50.648110 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:54:50.648110 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:54:50.648110 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:54:50.648110 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 04 16:54:50.648110 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 16:54:50.648110 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1199705057 has no extra specs with key hw:cpu_thread_policy. Aug 04 16:54:50.648110 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:50.648110 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:50.648110 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:50.649285 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:50.649285 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:50.649285 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:50.649285 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:54:50.649285 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:54:50.649285 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1199705057 has no extra specs with key hw:cpu_thread_policy. Aug 04 16:54:50.649285 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:50.649285 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a9495462-ce88-41f4-ba88-caf82691e39e tempest-FlavorsExtraSpecsNegativeTestJSON-550231404 tempest-FlavorsExtraSpecsNegativeTestJSON-550231404-project] Returning 404 to user: Flavor 1199705057 has no extra specs with key hw:cpu_thread_policy. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:54:50.649285 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a9495462-ce88-41f4-ba88-caf82691e39e tempest-FlavorsExtraSpecsNegativeTestJSON-550231404 tempest-FlavorsExtraSpecsNegativeTestJSON-550231404-project] 10.222.0.93 "GET /compute/v2.1/flavors/1199705057/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.569773 Aug 04 16:54:50.649285 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 64/115] 10.222.0.93 () {58 vars in 1266 bytes} [Thu Aug 4 16:54:50 2022] GET /compute/v2.1/flavors/1199705057/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 571 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:54:50.659389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cd3370bd-590b-4e97-9516-4e690786ba07 tempest-FlavorsExtraSpecsNegativeTestJSON-550231404 tempest-FlavorsExtraSpecsNegativeTestJSON-550231404-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:50.662514 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:50.662514 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:50.665151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cd3370bd-590b-4e97-9516-4e690786ba07 tempest-FlavorsExtraSpecsNegativeTestJSON-550231404 tempest-FlavorsExtraSpecsNegativeTestJSON-550231404-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '6e904ff819c4443ca70605088d2b62ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ad77f5b5d64cb9ad88264795fb9132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:50.670246 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cd3370bd-590b-4e97-9516-4e690786ba07 tempest-FlavorsExtraSpecsNegativeTestJSON-550231404 tempest-FlavorsExtraSpecsNegativeTestJSON-550231404-project] Request method failure captured: Aug 04 16:54:50.670246 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/flavors/1199705057/os-extra_specs HTTP/1.1 Aug 04 16:54:50.670246 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:54:50.670246 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:54:50.670246 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:54:50.670246 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 66 Aug 04 16:54:50.670246 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:54:50.670246 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:54:50.670246 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:54:50.670246 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:54:50.670246 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_nW3XLjQtW2yN-1Sl8nLgNkCEL29Jbrs7HDHO4Qp6w99p7AR5Rt9TTpZc8c-Sf9FZ-nxuKDefNSg2DVytStEWEwv6bFIB2D7EDbotoqg9KcT2Ec-P6h2MxCPnIa0KI5XyI_d-vyu_ZXkaA-2Jr_fK_OjbtUHQ5ewVAd7vwnaCI8Hvs Aug 04 16:54:50.670246 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:54:50.670246 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:54:50.670246 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:54:50.670246 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:54:50.670246 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:54:50.670246 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:54:50.670246 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: f3ad77f5b5d64cb9ad88264795fb9132 Aug 04 16:54:50.670246 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-550231404 Aug 04 16:54:50.670246 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:54:50.670246 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:54:50.671402 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f3ad77f5b5d64cb9ad88264795fb9132"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f3ad77f5b5d64cb9ad88264795fb9132"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f3ad77f5b5d64cb9ad88264795fb9132"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f3ad77f5b5d64cb9ad88264795fb9132"}]}] Aug 04 16:54:50.671402 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-550231404 Aug 04 16:54:50.671402 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: f3ad77f5b5d64cb9ad88264795fb9132 Aug 04 16:54:50.671402 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-550231404 Aug 04 16:54:50.671402 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-550231404-project Aug 04 16:54:50.671402 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:54:50.671402 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:54:50.671402 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 6e904ff819c4443ca70605088d2b62ec Aug 04 16:54:50.671402 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-550231404-project Aug 04 16:54:50.671402 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 16:54:50.671402 n-d-851359-3 devstack@n-api.service[131044]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 04 16:54:50.671402 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:54:50.672028 n-d-851359-3 devstack@n-api.service[131044]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 04 16:54:50.672028 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'flavor_id': '1199705057', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 04 16:54:50.672028 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:54:50.672028 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:50.672028 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:50.672028 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:50.672028 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:54:50.672028 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:54:50.672028 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:54:50.672028 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:54:50.672028 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:54:50.672028 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:54:50.672028 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 04 16:54:50.672028 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 04 16:54:50.672028 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:54:50.672028 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:54:50.672028 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:54:50.672028 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:54:50.672028 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:54:50.673801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:54:50.673801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:54:50.673801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:54:50.673801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:54:50.673801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:54:50.673801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:54:50.673801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:54:50.673801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:54:50.673801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:54:50.673801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 04 16:54:50.673801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:50.673801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:50.673801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:50.673801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:50.673801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:50.673801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:50.673801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:54:50.673801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:54:50.673801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 04 16:54:50.673801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:50.674880 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cd3370bd-590b-4e97-9516-4e690786ba07 tempest-FlavorsExtraSpecsNegativeTestJSON-550231404 tempest-FlavorsExtraSpecsNegativeTestJSON-550231404-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:54:50.674880 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cd3370bd-590b-4e97-9516-4e690786ba07 tempest-FlavorsExtraSpecsNegativeTestJSON-550231404 tempest-FlavorsExtraSpecsNegativeTestJSON-550231404-project] 10.222.0.93 "POST /compute/v2.1/flavors/1199705057/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.016341 Aug 04 16:54:50.674880 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 52/116] 10.222.0.93 () {60 vars in 1224 bytes} [Thu Aug 4 16:54:50 2022] POST /compute/v2.1/flavors/1199705057/os-extra_specs => generated 124 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:54:50.682254 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-214cc30c-51fd-4d67-a9e8-ef861c756882 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:50.685459 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:50.685459 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:50.724035 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-214cc30c-51fd-4d67-a9e8-ef861c756882 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/1199705057/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.045654 Aug 04 16:54:50.725705 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 65/117] 10.222.0.93 () {60 vars in 1224 bytes} [Thu Aug 4 16:54:50 2022] POST /compute/v2.1/flavors/1199705057/os-extra_specs => generated 66 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:54:50.737060 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7ad0cf9e-6f5b-4cdf-b531-f2ff355363b8 tempest-FlavorsExtraSpecsNegativeTestJSON-550231404 tempest-FlavorsExtraSpecsNegativeTestJSON-550231404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:50.737829 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:50.737829 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:50.738793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7ad0cf9e-6f5b-4cdf-b531-f2ff355363b8 tempest-FlavorsExtraSpecsNegativeTestJSON-550231404 tempest-FlavorsExtraSpecsNegativeTestJSON-550231404-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '6e904ff819c4443ca70605088d2b62ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ad77f5b5d64cb9ad88264795fb9132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:50.740356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7ad0cf9e-6f5b-4cdf-b531-f2ff355363b8 tempest-FlavorsExtraSpecsNegativeTestJSON-550231404 tempest-FlavorsExtraSpecsNegativeTestJSON-550231404-project] Request method failure captured: Aug 04 16:54:50.740356 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/flavors/1199705057/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 04 16:54:50.740356 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:54:50.740356 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:54:50.740356 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:54:50.740356 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:54:50.740356 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:54:50.740356 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:54:50.740356 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:54:50.740356 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:54:50.740356 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_nW3XLjQtW2yN-1Sl8nLgNkCEL29Jbrs7HDHO4Qp6w99p7AR5Rt9TTpZc8c-Sf9FZ-nxuKDefNSg2DVytStEWEwv6bFIB2D7EDbotoqg9KcT2Ec-P6h2MxCPnIa0KI5XyI_d-vyu_ZXkaA-2Jr_fK_OjbtUHQ5ewVAd7vwnaCI8Hvs Aug 04 16:54:50.740356 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:54:50.740356 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:54:50.740356 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:54:50.740356 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:54:50.740356 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:54:50.740356 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:54:50.740356 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: f3ad77f5b5d64cb9ad88264795fb9132 Aug 04 16:54:50.740356 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-550231404 Aug 04 16:54:50.740356 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:54:50.740356 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:54:50.741467 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f3ad77f5b5d64cb9ad88264795fb9132"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f3ad77f5b5d64cb9ad88264795fb9132"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f3ad77f5b5d64cb9ad88264795fb9132"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f3ad77f5b5d64cb9ad88264795fb9132"}]}] Aug 04 16:54:50.741467 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-550231404 Aug 04 16:54:50.741467 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: f3ad77f5b5d64cb9ad88264795fb9132 Aug 04 16:54:50.741467 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-550231404 Aug 04 16:54:50.741467 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-550231404-project Aug 04 16:54:50.741467 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:54:50.741467 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:54:50.741467 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 6e904ff819c4443ca70605088d2b62ec Aug 04 16:54:50.741467 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-550231404-project Aug 04 16:54:50.741467 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:54:50.741467 n-d-851359-3 devstack@n-api.service[131044]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 04 16:54:50.742097 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'flavor_id': '1199705057', 'id': 'hw:numa_nodes'} Aug 04 16:54:50.742097 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:54:50.742097 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:50.742097 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:50.742097 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:50.742097 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:54:50.742097 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:54:50.742097 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:54:50.742097 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:54:50.742097 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 04 16:54:50.742097 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 04 16:54:50.742097 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:54:50.742097 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:54:50.742097 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:54:50.742097 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:54:50.742097 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:54:50.742097 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:54:50.742097 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:54:50.742097 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:54:50.742097 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:54:50.743155 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:54:50.743155 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:54:50.743155 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:54:50.743155 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:54:50.743155 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:54:50.743155 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 04 16:54:50.743155 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:50.743155 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:50.743155 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:50.743155 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:50.743155 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:50.743155 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:50.743155 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:54:50.743155 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:54:50.743155 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 04 16:54:50.743155 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:50.743155 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7ad0cf9e-6f5b-4cdf-b531-f2ff355363b8 tempest-FlavorsExtraSpecsNegativeTestJSON-550231404 tempest-FlavorsExtraSpecsNegativeTestJSON-550231404-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:54:50.744223 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7ad0cf9e-6f5b-4cdf-b531-f2ff355363b8 tempest-FlavorsExtraSpecsNegativeTestJSON-550231404 tempest-FlavorsExtraSpecsNegativeTestJSON-550231404-project] 10.222.0.93 "DELETE /compute/v2.1/flavors/1199705057/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.009361 Aug 04 16:54:50.749534 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 53/118] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Aug 4 16:54:50 2022] DELETE /compute/v2.1/flavors/1199705057/os-extra_specs/hw:numa_nodes => generated 124 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:54:50.752481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a21533b7-a3c8-46f1-a59d-c921a159d31d tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:50.785591 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a21533b7-a3c8-46f1-a59d-c921a159d31d tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/1199705057/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.037931 Aug 04 16:54:50.787606 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 66/119] 10.222.0.93 () {60 vars in 1224 bytes} [Thu Aug 4 16:54:50 2022] POST /compute/v2.1/flavors/1199705057/os-extra_specs => generated 66 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 16:54:50.799491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bba91773-ad95-4bdb-b26d-86a94b72b78a tempest-FlavorsExtraSpecsNegativeTestJSON-550231404 tempest-FlavorsExtraSpecsNegativeTestJSON-550231404-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:50.802075 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:50.802075 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:50.803075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bba91773-ad95-4bdb-b26d-86a94b72b78a tempest-FlavorsExtraSpecsNegativeTestJSON-550231404 tempest-FlavorsExtraSpecsNegativeTestJSON-550231404-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '6e904ff819c4443ca70605088d2b62ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3ad77f5b5d64cb9ad88264795fb9132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:50.808201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bba91773-ad95-4bdb-b26d-86a94b72b78a tempest-FlavorsExtraSpecsNegativeTestJSON-550231404 tempest-FlavorsExtraSpecsNegativeTestJSON-550231404-project] Request method failure captured: Aug 04 16:54:50.808201 n-d-851359-3 devstack@n-api.service[131044]: request: PUT /compute/v2.1/flavors/1199705057/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 04 16:54:50.808201 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:54:50.808201 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:54:50.808201 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:54:50.808201 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 22 Aug 04 16:54:50.808201 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:54:50.808201 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:54:50.808201 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:54:50.808201 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:54:50.808201 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_nW3XLjQtW2yN-1Sl8nLgNkCEL29Jbrs7HDHO4Qp6w99p7AR5Rt9TTpZc8c-Sf9FZ-nxuKDefNSg2DVytStEWEwv6bFIB2D7EDbotoqg9KcT2Ec-P6h2MxCPnIa0KI5XyI_d-vyu_ZXkaA-2Jr_fK_OjbtUHQ5ewVAd7vwnaCI8Hvs Aug 04 16:54:50.808201 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:54:50.808201 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:54:50.808201 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:54:50.808201 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:54:50.808201 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:54:50.808201 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:54:50.808201 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: f3ad77f5b5d64cb9ad88264795fb9132 Aug 04 16:54:50.808201 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-550231404 Aug 04 16:54:50.808201 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:54:50.808201 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:54:50.809685 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f3ad77f5b5d64cb9ad88264795fb9132"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f3ad77f5b5d64cb9ad88264795fb9132"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f3ad77f5b5d64cb9ad88264795fb9132"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f3ad77f5b5d64cb9ad88264795fb9132"}]}] Aug 04 16:54:50.809685 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-550231404 Aug 04 16:54:50.809685 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: f3ad77f5b5d64cb9ad88264795fb9132 Aug 04 16:54:50.809685 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-550231404 Aug 04 16:54:50.809685 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-550231404-project Aug 04 16:54:50.809685 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:54:50.809685 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:54:50.809685 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 6e904ff819c4443ca70605088d2b62ec Aug 04 16:54:50.809685 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-550231404-project Aug 04 16:54:50.809685 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 16:54:50.809685 n-d-851359-3 devstack@n-api.service[131044]: {"hw:numa_nodes": "1"} Aug 04 16:54:50.809685 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:54:50.809685 n-d-851359-3 devstack@n-api.service[131044]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 04 16:54:50.810512 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'flavor_id': '1199705057', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 04 16:54:50.810512 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:54:50.810512 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:50.810512 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:50.810512 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:50.810512 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:54:50.810512 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:54:50.810512 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:54:50.810512 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:54:50.810512 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:54:50.810512 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:54:50.810512 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 04 16:54:50.810512 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 04 16:54:50.810512 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:54:50.810512 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:54:50.810512 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:54:50.810512 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:54:50.810512 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:54:50.810512 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:54:50.811494 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:54:50.811494 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:54:50.811494 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:54:50.811494 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:54:50.811494 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:54:50.811494 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:54:50.811494 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:54:50.811494 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:54:50.811494 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 04 16:54:50.811494 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:50.811494 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:50.811494 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:50.811494 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:50.811494 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:50.811494 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:50.811494 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:54:50.811494 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:54:50.811494 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 04 16:54:50.811494 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:50.812495 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bba91773-ad95-4bdb-b26d-86a94b72b78a tempest-FlavorsExtraSpecsNegativeTestJSON-550231404 tempest-FlavorsExtraSpecsNegativeTestJSON-550231404-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:54:50.813315 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bba91773-ad95-4bdb-b26d-86a94b72b78a tempest-FlavorsExtraSpecsNegativeTestJSON-550231404 tempest-FlavorsExtraSpecsNegativeTestJSON-550231404-project] 10.222.0.93 "PUT /compute/v2.1/flavors/1199705057/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.018886 Aug 04 16:54:50.820118 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 54/120] 10.222.0.93 () {60 vars in 1265 bytes} [Thu Aug 4 16:54:50 2022] PUT /compute/v2.1/flavors/1199705057/os-extra_specs/hw:numa_nodes => generated 124 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:54:50.829658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e8700b3e-a10a-417a-a596-40480f88d5c9 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:50.833166 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:50.833166 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:50.850776 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-e8700b3e-a10a-417a-a596-40480f88d5c9 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161-project-admin] HTTP exception thrown: Flavor 1199705057 has no extra specs with key hw:cpu_thread_policy. Aug 04 16:54:50.852214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e8700b3e-a10a-417a-a596-40480f88d5c9 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161-project-admin] Request method failure captured: Aug 04 16:54:50.852214 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/flavors/1199705057/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 04 16:54:50.852214 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:54:50.852214 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:54:50.852214 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:54:50.852214 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:54:50.852214 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:54:50.852214 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:54:50.852214 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:54:50.852214 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:54:50.852214 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_nZmIfo9dSdkQEY40NNzJu-koSp2ekcLJiC48I073bvQ8HV_GimV9T1DD2m2f1AOIY-XiLVB_g-QyFnTnSjZ69G7fGMsM4DwXmGRTIIz-oppHMeoVE0kywiQKcYSef80F5UdqKzwdobPThi9qee8WGm_re05n8NKQTBifGzkJzelH4 Aug 04 16:54:50.852214 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:54:50.852214 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:54:50.852214 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:54:50.852214 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:54:50.852214 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:54:50.852214 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:54:50.852214 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 1ef84df8857840bf903373086597be61 Aug 04 16:54:50.852214 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161 Aug 04 16:54:50.852214 n-d-851359-3 devstack@n-api.service[131043]: X-Role: admin,member,reader Aug 04 16:54:50.852214 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: admin,member,reader Aug 04 16:54:50.853373 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1ef84df8857840bf903373086597be61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1ef84df8857840bf903373086597be61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1ef84df8857840bf903373086597be61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1ef84df8857840bf903373086597be61"}]}] Aug 04 16:54:50.853373 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161 Aug 04 16:54:50.853373 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 1ef84df8857840bf903373086597be61 Aug 04 16:54:50.853373 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161 Aug 04 16:54:50.853373 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161-project-admin Aug 04 16:54:50.853373 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:54:50.853373 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:54:50.853373 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 0a6a4dcb6ec049479e507ef82a4c8ded Aug 04 16:54:50.853373 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161-project-admin Aug 04 16:54:50.853373 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 16:54:50.853373 n-d-851359-3 devstack@n-api.service[131043]: exception: Flavor 1199705057 has no extra specs with key hw:cpu_thread_policy. Aug 04 16:54:50.854031 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'flavor_id': '1199705057', 'id': 'hw:cpu_thread_policy'} Aug 04 16:54:50.854031 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:54:50.854031 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:50.854031 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 04 16:54:50.854031 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 04 16:54:50.854031 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 04 16:54:50.854031 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:50.854031 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:50.854031 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:50.854031 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:50.854031 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:50.854031 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:50.854031 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:54:50.854031 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:54:50.854031 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:54:50.854031 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:54:50.854031 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 04 16:54:50.854031 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 16:54:50.854031 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1199705057 has no extra specs with key hw:cpu_thread_policy. Aug 04 16:54:50.854031 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:50.854031 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:50.854031 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:50.855232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:50.855232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:50.855232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:50.855232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:54:50.855232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:54:50.855232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1199705057 has no extra specs with key hw:cpu_thread_policy. Aug 04 16:54:50.855232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:50.855232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e8700b3e-a10a-417a-a596-40480f88d5c9 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161-project-admin] Returning 404 to user: Flavor 1199705057 has no extra specs with key hw:cpu_thread_policy. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:54:50.855232 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e8700b3e-a10a-417a-a596-40480f88d5c9 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1199705057/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.031556 Aug 04 16:54:50.855232 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 67/121] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Aug 4 16:54:50 2022] DELETE /compute/v2.1/flavors/1199705057/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:54:50.865761 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-74dd7e3b-8675-4aa3-ae42-7bb047c3133f tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:50.873438 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-74dd7e3b-8675-4aa3-ae42-7bb047c3133f tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 04 16:54:50.876215 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-74dd7e3b-8675-4aa3-ae42-7bb047c3133f tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161-project-admin] Request method failure captured: Aug 04 16:54:50.876215 n-d-851359-3 devstack@n-api.service[131044]: request: PUT /compute/v2.1/flavors/1199705057/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 04 16:54:50.876215 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:54:50.876215 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:54:50.876215 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:54:50.876215 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 27 Aug 04 16:54:50.876215 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:54:50.876215 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:54:50.876215 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:54:50.876215 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:54:50.876215 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_nZmIfo9dSdkQEY40NNzJu-koSp2ekcLJiC48I073bvQ8HV_GimV9T1DD2m2f1AOIY-XiLVB_g-QyFnTnSjZ69G7fGMsM4DwXmGRTIIz-oppHMeoVE0kywiQKcYSef80F5UdqKzwdobPThi9qee8WGm_re05n8NKQTBifGzkJzelH4 Aug 04 16:54:50.876215 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:54:50.876215 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:54:50.876215 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:54:50.876215 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:54:50.876215 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:54:50.876215 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:54:50.876215 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 1ef84df8857840bf903373086597be61 Aug 04 16:54:50.876215 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161 Aug 04 16:54:50.876215 n-d-851359-3 devstack@n-api.service[131044]: X-Role: admin,member,reader Aug 04 16:54:50.876215 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: admin,member,reader Aug 04 16:54:50.877425 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1ef84df8857840bf903373086597be61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1ef84df8857840bf903373086597be61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1ef84df8857840bf903373086597be61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1ef84df8857840bf903373086597be61"}]}] Aug 04 16:54:50.877425 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161 Aug 04 16:54:50.877425 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 1ef84df8857840bf903373086597be61 Aug 04 16:54:50.877425 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161 Aug 04 16:54:50.877425 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161-project-admin Aug 04 16:54:50.877425 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:54:50.877425 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:54:50.877425 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 0a6a4dcb6ec049479e507ef82a4c8ded Aug 04 16:54:50.877425 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161-project-admin Aug 04 16:54:50.877425 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 16:54:50.877425 n-d-851359-3 devstack@n-api.service[131044]: {"hw:cpu_policy": "shared"} Aug 04 16:54:50.877425 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:54:50.877425 n-d-851359-3 devstack@n-api.service[131044]: exception: Request body and URI mismatch Aug 04 16:54:50.878150 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'flavor_id': '1199705057', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 04 16:54:50.878150 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:54:50.878150 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:50.878150 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:50.878150 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:50.878150 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:54:50.878150 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:54:50.878150 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:54:50.878150 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:54:50.878150 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:54:50.878150 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:54:50.878150 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 04 16:54:50.878150 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 04 16:54:50.878150 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 04 16:54:50.878150 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:50.878150 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:50.878150 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:50.878150 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:50.878150 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:50.878150 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:50.879190 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:54:50.879190 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:54:50.879190 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 04 16:54:50.879190 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:54:50.879190 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-74dd7e3b-8675-4aa3-ae42-7bb047c3133f tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:54:50.880469 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-74dd7e3b-8675-4aa3-ae42-7bb047c3133f tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161-project-admin] 10.222.0.93 "PUT /compute/v2.1/flavors/1199705057/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.020009 Aug 04 16:54:50.881038 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 55/122] 10.222.0.93 () {60 vars in 1265 bytes} [Thu Aug 4 16:54:50 2022] PUT /compute/v2.1/flavors/1199705057/os-extra_specs/hw:numa_nodes => generated 73 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 16:54:50.893314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1c456d9b-99a1-4c07-9114-233f89cd73d1 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:50.899380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1c456d9b-99a1-4c07-9114-233f89cd73d1 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161-project-admin] Request method failure captured: Aug 04 16:54:50.899380 n-d-851359-3 devstack@n-api.service[131043]: request: PUT /compute/v2.1/flavors/1199705057/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 04 16:54:50.899380 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:54:50.899380 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:54:50.899380 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:54:50.899380 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 49 Aug 04 16:54:50.899380 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:54:50.899380 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:54:50.899380 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:54:50.899380 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:54:50.899380 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_nZmIfo9dSdkQEY40NNzJu-koSp2ekcLJiC48I073bvQ8HV_GimV9T1DD2m2f1AOIY-XiLVB_g-QyFnTnSjZ69G7fGMsM4DwXmGRTIIz-oppHMeoVE0kywiQKcYSef80F5UdqKzwdobPThi9qee8WGm_re05n8NKQTBifGzkJzelH4 Aug 04 16:54:50.899380 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:54:50.899380 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:54:50.899380 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:54:50.899380 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:54:50.899380 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:54:50.899380 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:54:50.899380 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 1ef84df8857840bf903373086597be61 Aug 04 16:54:50.899380 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161 Aug 04 16:54:50.899380 n-d-851359-3 devstack@n-api.service[131043]: X-Role: admin,member,reader Aug 04 16:54:50.899380 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: admin,member,reader Aug 04 16:54:50.900882 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1ef84df8857840bf903373086597be61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1ef84df8857840bf903373086597be61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1ef84df8857840bf903373086597be61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1ef84df8857840bf903373086597be61"}]}] Aug 04 16:54:50.900882 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161 Aug 04 16:54:50.900882 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 1ef84df8857840bf903373086597be61 Aug 04 16:54:50.900882 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161 Aug 04 16:54:50.900882 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161-project-admin Aug 04 16:54:50.900882 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:54:50.900882 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:54:50.900882 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 0a6a4dcb6ec049479e507ef82a4c8ded Aug 04 16:54:50.900882 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161-project-admin Aug 04 16:54:50.900882 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 16:54:50.900882 n-d-851359-3 devstack@n-api.service[131043]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 04 16:54:50.900882 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 16:54:50.901639 n-d-851359-3 devstack@n-api.service[131043]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 04 16:54:50.901639 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'flavor_id': '1199705057', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 04 16:54:50.901639 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:54:50.901639 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:50.901639 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:54:50.901639 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:54:50.901639 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:54:50.901639 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:54:50.901639 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 04 16:54:50.901639 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:50.901639 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 04 16:54:50.901639 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 04 16:54:50.901639 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 04 16:54:50.901639 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 04 16:54:50.901639 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 04 16:54:50.901639 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 04 16:54:50.901639 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 04 16:54:50.901639 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 04 16:54:50.901639 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:50.901639 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi On instance: Aug 04 16:54:50.901639 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 04 16:54:50.901639 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:50.902952 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:50.902952 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:50.902952 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:50.902952 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:50.902952 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:50.902952 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:54:50.902952 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:54:50.902952 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:54:50.902952 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:54:50.902952 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 16:54:50.902952 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 16:54:50.902952 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:54:50.902952 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:54:50.902952 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:54:50.902952 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:54:50.902952 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 04 16:54:50.902952 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:50.902952 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:54:50.902952 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:50.902952 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:54:50.903960 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:54:50.903960 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:54:50.903960 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:54:50.903960 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:54:50.903960 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 04 16:54:50.903960 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:54:50.920597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1c456d9b-99a1-4c07-9114-233f89cd73d1 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:54:50.921800 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1c456d9b-99a1-4c07-9114-233f89cd73d1 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161-project-admin] 10.222.0.93 "PUT /compute/v2.1/flavors/1199705057/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.035422 Aug 04 16:54:50.924525 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 68/123] 10.222.0.93 () {60 vars in 1265 bytes} [Thu Aug 4 16:54:50 2022] PUT /compute/v2.1/flavors/1199705057/os-extra_specs/hw:numa_nodes => generated 117 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:54:50.936122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a5aade62-e46c-475d-9e8e-ce1477c993d5 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:50.937752 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:50.937752 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:50.973418 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a5aade62-e46c-475d-9e8e-ce1477c993d5 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1199705057" status: 202 len: 0 microversion: 2.1 time: 0.042634 Aug 04 16:54:50.974988 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 56/124] 10.222.0.93 () {58 vars in 1161 bytes} [Thu Aug 4 16:54:50 2022] DELETE /compute/v2.1/flavors/1199705057 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:54:50.982855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4e65c605-e3d3-41ff-952b-902747cad4fc tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:51.013920 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4e65c605-e3d3-41ff-952b-902747cad4fc tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161 tempest-FlavorsExtraSpecsNegativeTestJSON-1387299161-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034551 Aug 04 16:54:51.031925 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 69/125] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:54:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:54:51.589950 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a514939b-f6e1-4966-b091-15e45fc82ad8 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:51.590686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a514939b-f6e1-4966-b091-15e45fc82ad8 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] [instance: d0d49f6b-4070-4e08-a35a-5dfd203c773f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:51.602511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a514939b-f6e1-4966-b091-15e45fc82ad8 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:51.612537 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a514939b-f6e1-4966-b091-15e45fc82ad8 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:51.613036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a514939b-f6e1-4966-b091-15e45fc82ad8 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:51.614039 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a514939b-f6e1-4966-b091-15e45fc82ad8 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:51.615238 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a514939b-f6e1-4966-b091-15e45fc82ad8 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:51.620169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a514939b-f6e1-4966-b091-15e45fc82ad8 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:51.823853 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a514939b-f6e1-4966-b091-15e45fc82ad8 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808f13b51f6d4e1d9e7c924742544ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4104fbd3df4e7aadfaf896bea56a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:51.832344 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a514939b-f6e1-4966-b091-15e45fc82ad8 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] 10.222.0.93 "GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f" status: 200 len: 1337 microversion: 2.1 time: 0.247122 Aug 04 16:54:51.832939 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 57/126] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:51 2022] GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f => generated 1337 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:52.471259 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8967add4-e655-44ad-9146-c55e9b8e805b tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:52.483678 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8967add4-e655-44ad-9146-c55e9b8e805b tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.522741 Aug 04 16:54:52.486113 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 70/127] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Aug 4 16:54:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:52.572122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:52.636665 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-19124c6a-8d76-4b57-ba15-a3c2dceab14f tempest-QuotasAdminTestV236-471524776 tempest-QuotasAdminTestV236-471524776-project-admin] Action: 'update', calling method: .version_select at 0x7f1e68266550>, body: {"quota_set": {"ram": "5120"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:52.845548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ee8253f4-e503-42b9-a7c3-7691825e8000 tempest-ServersWithSpecificFlavorTestJSON-656468098 tempest-ServersWithSpecificFlavorTestJSON-656468098-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-753972808", "id": 1225047199, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:52.849485 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:52.849485 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:52.867894 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ee8253f4-e503-42b9-a7c3-7691825e8000 tempest-ServersWithSpecificFlavorTestJSON-656468098 tempest-ServersWithSpecificFlavorTestJSON-656468098-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.373740 Aug 04 16:54:52.868556 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 71/128] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:54:52 2022] POST /compute/v2.1/flavors => generated 424 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:52.873069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-203dc984-1f35-4f01-93e1-d88383285708 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:52.873719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-203dc984-1f35-4f01-93e1-d88383285708 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] [instance: d0d49f6b-4070-4e08-a35a-5dfd203c773f] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:52.881165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-203dc984-1f35-4f01-93e1-d88383285708 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:52.881752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-203dc984-1f35-4f01-93e1-d88383285708 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:52.882223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-203dc984-1f35-4f01-93e1-d88383285708 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:52.883122 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-203dc984-1f35-4f01-93e1-d88383285708 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:52.883625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-203dc984-1f35-4f01-93e1-d88383285708 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:52.884078 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-203dc984-1f35-4f01-93e1-d88383285708 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:53.057888 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-203dc984-1f35-4f01-93e1-d88383285708 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808f13b51f6d4e1d9e7c924742544ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4104fbd3df4e7aadfaf896bea56a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:53.068805 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-203dc984-1f35-4f01-93e1-d88383285708 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] 10.222.0.93 "GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f" status: 200 len: 1337 microversion: 2.1 time: 0.198526 Aug 04 16:54:53.069848 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 72/129] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:52 2022] GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f => generated 1337 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:53.075615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b16bfe3d-17f6-4cc9-bb6d-f898099396c6 tempest-ServersWithSpecificFlavorTestJSON-656468098 tempest-ServersWithSpecificFlavorTestJSON-656468098-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:53.084855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:DELETE=4,nova_api:SELECT=83,nova_api:INSERT=5,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:53.087738 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b16bfe3d-17f6-4cc9-bb6d-f898099396c6 tempest-ServersWithSpecificFlavorTestJSON-656468098 tempest-ServersWithSpecificFlavorTestJSON-656468098-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.016026 Aug 04 16:54:53.088954 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 73/130] 10.222.0.93 () {58 vars in 1182 bytes} [Thu Aug 4 16:54:53 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:54:53.102688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b87ab6ab-bd9f-46d0-90ff-d8a19f01def3 tempest-ServersWithSpecificFlavorTestJSON-656468098 tempest-ServersWithSpecificFlavorTestJSON-656468098-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1236775920", "id": 1139904760, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:53.105912 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:53.105912 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:53.126417 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b87ab6ab-bd9f-46d0-90ff-d8a19f01def3 tempest-ServersWithSpecificFlavorTestJSON-656468098 tempest-ServersWithSpecificFlavorTestJSON-656468098-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.030588 Aug 04 16:54:53.130159 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 74/131] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:54:53 2022] POST /compute/v2.1/flavors => generated 425 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:53.140152 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b1694a93-5baf-43a7-8f11-436166a03584 tempest-ServersWithSpecificFlavorTestJSON-656468098 tempest-ServersWithSpecificFlavorTestJSON-656468098-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:53.151175 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b1694a93-5baf-43a7-8f11-436166a03584 tempest-ServersWithSpecificFlavorTestJSON-656468098 tempest-ServersWithSpecificFlavorTestJSON-656468098-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.014945 Aug 04 16:54:53.152502 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 75/132] 10.222.0.93 () {58 vars in 1182 bytes} [Thu Aug 4 16:54:53 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:54:53.165296 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-085ac2ac-03e5-411e-b375-fcfb4918a75e tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Action: 'create', calling method: .version_select at 0x7f1e68232af0>, body: {"keypair": {"name": "tempest-keypair-1666819661", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0Tu0AjcPTd5yfbZRaLJ6azwR896Us6Y/DQrTD0o8FuzZ1mdjI/ZDG1Z2+Jjbw5YyMbSV8gJGcNTTXQLrriU0/xmwtGvytZuqqanmuE/YX94vLO+NvVjbdJtup6k0OJ2Q=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:53.197650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-085ac2ac-03e5-411e-b375-fcfb4918a75e tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Getting quotas for project 131b528863154fefbc36f11eaf18365e. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:54:53.203772 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-085ac2ac-03e5-411e-b375-fcfb4918a75e tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Getting quotas for user 679ea09388514a19a79f2dcce73b4189 and project 131b528863154fefbc36f11eaf18365e. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:54:53.240120 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-085ac2ac-03e5-411e-b375-fcfb4918a75e tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.076984 Aug 04 16:54:53.259891 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 76/133] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 16:54:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:54:53.525834 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19124c6a-8d76-4b57-ba15-a3c2dceab14f tempest-QuotasAdminTestV236-471524776 tempest-QuotasAdminTestV236-471524776-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:53.526376 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19124c6a-8d76-4b57-ba15-a3c2dceab14f tempest-QuotasAdminTestV236-471524776 tempest-QuotasAdminTestV236-471524776-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:53.526811 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19124c6a-8d76-4b57-ba15-a3c2dceab14f tempest-QuotasAdminTestV236-471524776 tempest-QuotasAdminTestV236-471524776-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:53.529659 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19124c6a-8d76-4b57-ba15-a3c2dceab14f tempest-QuotasAdminTestV236-471524776 tempest-QuotasAdminTestV236-471524776-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:53.530168 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19124c6a-8d76-4b57-ba15-a3c2dceab14f tempest-QuotasAdminTestV236-471524776 tempest-QuotasAdminTestV236-471524776-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:53.530607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19124c6a-8d76-4b57-ba15-a3c2dceab14f tempest-QuotasAdminTestV236-471524776 tempest-QuotasAdminTestV236-471524776-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:53.613776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=11,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:54:53.782588 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-19124c6a-8d76-4b57-ba15-a3c2dceab14f tempest-QuotasAdminTestV236-471524776 tempest-QuotasAdminTestV236-471524776-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/aeae5ec084f24d848dcdef347c5fcd79" status: 200 len: 240 microversion: 2.36 time: 1.609103 Aug 04 16:54:53.791713 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 58/134] 10.222.0.93 () {62 vars in 1303 bytes} [Thu Aug 4 16:54:52 2022] PUT /compute/v2.1/os-quota-sets/aeae5ec084f24d848dcdef347c5fcd79 => generated 240 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 16:54:53.805401 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0c59f255-5592-45e9-b099-ed54dca965d2 tempest-QuotasAdminTestV236-471524776 tempest-QuotasAdminTestV236-471524776-project-admin] Calling method '.version_select at 0x7f1e6828c940>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:54.092209 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5fa6c9f8-2509-4197-82af-30c6a2dba4a5 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:54.093176 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5fa6c9f8-2509-4197-82af-30c6a2dba4a5 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] [instance: d0d49f6b-4070-4e08-a35a-5dfd203c773f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:54.102961 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5fa6c9f8-2509-4197-82af-30c6a2dba4a5 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:54.105880 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5fa6c9f8-2509-4197-82af-30c6a2dba4a5 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:54.106619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5fa6c9f8-2509-4197-82af-30c6a2dba4a5 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:54.109499 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5fa6c9f8-2509-4197-82af-30c6a2dba4a5 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:54.110218 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5fa6c9f8-2509-4197-82af-30c6a2dba4a5 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:54.112699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5fa6c9f8-2509-4197-82af-30c6a2dba4a5 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:54.415013 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c59f255-5592-45e9-b099-ed54dca965d2 tempest-QuotasAdminTestV236-471524776 tempest-QuotasAdminTestV236-471524776-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:54.416050 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c59f255-5592-45e9-b099-ed54dca965d2 tempest-QuotasAdminTestV236-471524776 tempest-QuotasAdminTestV236-471524776-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:54.417806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c59f255-5592-45e9-b099-ed54dca965d2 tempest-QuotasAdminTestV236-471524776 tempest-QuotasAdminTestV236-471524776-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:54.419988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c59f255-5592-45e9-b099-ed54dca965d2 tempest-QuotasAdminTestV236-471524776 tempest-QuotasAdminTestV236-471524776-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:54.432470 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c59f255-5592-45e9-b099-ed54dca965d2 tempest-QuotasAdminTestV236-471524776 tempest-QuotasAdminTestV236-471524776-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:54.433185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c59f255-5592-45e9-b099-ed54dca965d2 tempest-QuotasAdminTestV236-471524776 tempest-QuotasAdminTestV236-471524776-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:54.459723 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0c59f255-5592-45e9-b099-ed54dca965d2 tempest-QuotasAdminTestV236-471524776 tempest-QuotasAdminTestV236-471524776-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/aeae5ec084f24d848dcdef347c5fcd79/detail" status: 200 len: 672 microversion: 2.36 time: 0.661924 Aug 04 16:54:54.461355 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 77/135] 10.222.0.93 () {60 vars in 1304 bytes} [Thu Aug 4 16:54:53 2022] GET /compute/v2.1/os-quota-sets/aeae5ec084f24d848dcdef347c5fcd79/detail => generated 672 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:54:54.533456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5fa6c9f8-2509-4197-82af-30c6a2dba4a5 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808f13b51f6d4e1d9e7c924742544ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4104fbd3df4e7aadfaf896bea56a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:54.543022 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5fa6c9f8-2509-4197-82af-30c6a2dba4a5 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] 10.222.0.93 "GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f" status: 200 len: 1337 microversion: 2.1 time: 0.455336 Aug 04 16:54:54.543618 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 59/136] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:54 2022] GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f => generated 1337 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:54.939858 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a9b500cd-26c8-45a0-9d77-ab005074ae3c tempest-NetworksTest-1707304817 tempest-NetworksTest-1707304817-project-admin] Calling method '.version_select at 0x7f1e68232e50>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:55.297946 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a9b500cd-26c8-45a0-9d77-ab005074ae3c tempest-NetworksTest-1707304817 tempest-NetworksTest-1707304817-project-admin] 10.222.0.93 "GET /compute/v2.1/os-networks" status: 200 len: 3326 microversion: 2.1 time: 0.835254 Aug 04 16:54:55.298562 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 78/137] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Aug 4 16:54:54 2022] GET /compute/v2.1/os-networks => generated 3326 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:55.300459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b792b7e3-3c50-4f97-8bb0-0ca004af02d4 req-1f82f2c3-c3d5-48cf-aaff-ebdfc295828a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0d49f6b-4070-4e08-a35a-5dfd203c773f", "name": "network-vif-plugged", "status": "completed", "tag": "1b12464f-face-48ed-ae05-715066fcbad9"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:55.307255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e0aa0d5b-3f40-4321-9c01-a20cade2fa74 tempest-NetworksTest-1707304817 tempest-NetworksTest-1707304817-project-admin] Calling method '.version_select at 0x7f1e6828cf70>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:55.320817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b792b7e3-3c50-4f97-8bb0-0ca004af02d4 req-1f82f2c3-c3d5-48cf-aaff-ebdfc295828a service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:55.322035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b792b7e3-3c50-4f97-8bb0-0ca004af02d4 req-1f82f2c3-c3d5-48cf-aaff-ebdfc295828a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:55.324651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b792b7e3-3c50-4f97-8bb0-0ca004af02d4 req-1f82f2c3-c3d5-48cf-aaff-ebdfc295828a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:55.354367 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b792b7e3-3c50-4f97-8bb0-0ca004af02d4 req-1f82f2c3-c3d5-48cf-aaff-ebdfc295828a service nova] Creating event network-vif-plugged:1b12464f-face-48ed-ae05-715066fcbad9 for instance d0d49f6b-4070-4e08-a35a-5dfd203c773f on n-h1-851359-3 Aug 04 16:54:55.374304 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b792b7e3-3c50-4f97-8bb0-0ca004af02d4 req-1f82f2c3-c3d5-48cf-aaff-ebdfc295828a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.594172 Aug 04 16:54:55.375674 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 60/138] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:54:55.501473 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e0aa0d5b-3f40-4321-9c01-a20cade2fa74 tempest-NetworksTest-1707304817 tempest-NetworksTest-1707304817-project-admin] 10.222.0.93 "GET /compute/v2.1/os-networks/aa834c21-a026-461a-926c-9c43b1a51a9c" status: 200 len: 652 microversion: 2.1 time: 0.197775 Aug 04 16:54:55.502296 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 79/139] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Aug 4 16:54:55 2022] GET /compute/v2.1/os-networks/aa834c21-a026-461a-926c-9c43b1a51a9c => generated 652 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:54:55.512308 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3f31bf77-f75b-4d09-870a-fff42b2bda24 tempest-NetworksTest-1707304817 tempest-NetworksTest-1707304817-project-admin] Calling method '.version_select at 0x7f1e68237040>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:55.688582 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-47506ecc-b078-45f4-9f24-9078ab3a094c tempest-InstanceUsageAuditLogTestJSON-153049389 tempest-InstanceUsageAuditLogTestJSON-153049389-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:55.689904 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:55.689904 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:55.740124 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-47506ecc-b078-45f4-9f24-9078ab3a094c tempest-InstanceUsageAuditLogTestJSON-153049389 tempest-InstanceUsageAuditLogTestJSON-153049389-project-admin] 10.222.0.93 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-04 16:54:55" status: 200 len: 318 microversion: 2.1 time: 0.205573 Aug 04 16:54:55.750236 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 80/140] 10.222.0.93 () {58 vars in 1251 bytes} [Thu Aug 4 16:54:55 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-04%2016%3A54%3A55 => generated 318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:54:55.757835 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c28e265a-9378-4169-91c1-bd39fcaa10ca tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:55.759259 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c28e265a-9378-4169-91c1-bd39fcaa10ca tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] [instance: d0d49f6b-4070-4e08-a35a-5dfd203c773f] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:55.764738 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3f31bf77-f75b-4d09-870a-fff42b2bda24 tempest-NetworksTest-1707304817 tempest-NetworksTest-1707304817-project-admin] 10.222.0.93 "GET /compute/v2.1/os-networks" status: 200 len: 3326 microversion: 2.1 time: 0.256415 Aug 04 16:54:55.769778 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 61/141] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Aug 4 16:54:55 2022] GET /compute/v2.1/os-networks => generated 3326 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:55.773604 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c28e265a-9378-4169-91c1-bd39fcaa10ca tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:55.774322 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c28e265a-9378-4169-91c1-bd39fcaa10ca tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:55.774909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c28e265a-9378-4169-91c1-bd39fcaa10ca tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:55.775767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c28e265a-9378-4169-91c1-bd39fcaa10ca tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:55.776395 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c28e265a-9378-4169-91c1-bd39fcaa10ca tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:55.777107 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c28e265a-9378-4169-91c1-bd39fcaa10ca tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:56.058535 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c28e265a-9378-4169-91c1-bd39fcaa10ca tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808f13b51f6d4e1d9e7c924742544ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4104fbd3df4e7aadfaf896bea56a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:56.066378 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c28e265a-9378-4169-91c1-bd39fcaa10ca tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] 10.222.0.93 "GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f" status: 200 len: 1337 microversion: 2.1 time: 0.314394 Aug 04 16:54:56.070176 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 81/142] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:55 2022] GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f => generated 1337 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:56.075052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e9a94ba8-8b3e-4da4-a699-abc1bc2d2ba9 tempest-QuotasAdminTestV236-471524776 tempest-QuotasAdminTestV236-471524776-project-admin] Action: 'update', calling method: .version_select at 0x7f1e6828c8b0>, body: {"quota_set": {"ram": "2048"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:56.195014 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4b1e69f6-8ff8-47fd-afd5-074303e5ff10 tempest-FlavorMetadataValidation-500973599 tempest-FlavorMetadataValidation-500973599-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1530126742", "id": 1451501827, "os-flavor-access:is_public": "True"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:56.200701 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:56.200701 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:56.228015 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4b1e69f6-8ff8-47fd-afd5-074303e5ff10 tempest-FlavorMetadataValidation-500973599 tempest-FlavorMetadataValidation-500973599-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.459464 Aug 04 16:54:56.240228 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 62/143] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Aug 4 16:54:55 2022] POST /compute/v2.1/flavors => generated 471 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:54:56.246506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2557ac5f-5f27-45a1-a14c-cac97432cdbd tempest-InstanceUsageAuditLogTestJSON-153049389 tempest-InstanceUsageAuditLogTestJSON-153049389-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:56.248421 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:56.248421 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:56.275805 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2557ac5f-5f27-45a1-a14c-cac97432cdbd tempest-InstanceUsageAuditLogTestJSON-153049389 tempest-InstanceUsageAuditLogTestJSON-153049389-project-admin] 10.222.0.93 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.034061 Aug 04 16:54:56.277436 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 63/144] 10.222.0.93 () {58 vars in 1185 bytes} [Thu Aug 4 16:54:56 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:54:56.284010 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3db4e523-8fa0-47ad-835d-a9135e796995 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1207850091", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "1139904760", "adminPass": "***", "networks": [{"uuid": "3269466f-d3dd-44c7-90ef-d541bfb7f6fb"}], "security_groups": [{"name": "tempest-securitygroup--271549013"}], "key_name": "tempest-keypair-1666819661", "user_data": "}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:56.470195 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-3db4e523-8fa0-47ad-835d-a9135e796995 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] validate_networks() for [('3269466f-d3dd-44c7-90ef-d541bfb7f6fb', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:54:56.662897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9a94ba8-8b3e-4da4-a699-abc1bc2d2ba9 tempest-QuotasAdminTestV236-471524776 tempest-QuotasAdminTestV236-471524776-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:56.663403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9a94ba8-8b3e-4da4-a699-abc1bc2d2ba9 tempest-QuotasAdminTestV236-471524776 tempest-QuotasAdminTestV236-471524776-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:56.663847 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9a94ba8-8b3e-4da4-a699-abc1bc2d2ba9 tempest-QuotasAdminTestV236-471524776 tempest-QuotasAdminTestV236-471524776-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:56.666718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9a94ba8-8b3e-4da4-a699-abc1bc2d2ba9 tempest-QuotasAdminTestV236-471524776 tempest-QuotasAdminTestV236-471524776-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:56.667208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9a94ba8-8b3e-4da4-a699-abc1bc2d2ba9 tempest-QuotasAdminTestV236-471524776 tempest-QuotasAdminTestV236-471524776-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:56.667648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9a94ba8-8b3e-4da4-a699-abc1bc2d2ba9 tempest-QuotasAdminTestV236-471524776 tempest-QuotasAdminTestV236-471524776-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:56.747114 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9a94ba8-8b3e-4da4-a699-abc1bc2d2ba9 tempest-QuotasAdminTestV236-471524776 tempest-QuotasAdminTestV236-471524776-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:56.747610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9a94ba8-8b3e-4da4-a699-abc1bc2d2ba9 tempest-QuotasAdminTestV236-471524776 tempest-QuotasAdminTestV236-471524776-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:56.748052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9a94ba8-8b3e-4da4-a699-abc1bc2d2ba9 tempest-QuotasAdminTestV236-471524776 tempest-QuotasAdminTestV236-471524776-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:56.748792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9a94ba8-8b3e-4da4-a699-abc1bc2d2ba9 tempest-QuotasAdminTestV236-471524776 tempest-QuotasAdminTestV236-471524776-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:56.749252 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9a94ba8-8b3e-4da4-a699-abc1bc2d2ba9 tempest-QuotasAdminTestV236-471524776 tempest-QuotasAdminTestV236-471524776-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:56.755680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9a94ba8-8b3e-4da4-a699-abc1bc2d2ba9 tempest-QuotasAdminTestV236-471524776 tempest-QuotasAdminTestV236-471524776-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:56.877318 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e9a94ba8-8b3e-4da4-a699-abc1bc2d2ba9 tempest-QuotasAdminTestV236-471524776 tempest-QuotasAdminTestV236-471524776-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/aeae5ec084f24d848dcdef347c5fcd79?user_id=725f04b51f83430a97e0ecb6eeed0d7b" status: 200 len: 240 microversion: 2.36 time: 0.805486 Aug 04 16:54:56.878330 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 82/145] 10.222.0.93 () {62 vars in 1384 bytes} [Thu Aug 4 16:54:56 2022] PUT /compute/v2.1/os-quota-sets/aeae5ec084f24d848dcdef347c5fcd79?user_id=725f04b51f83430a97e0ecb6eeed0d7b => generated 240 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:54:56.884947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-55b605b8-01b0-4678-a8aa-fd125353475f tempest-FlavorMetadataValidation-500973599 tempest-FlavorMetadataValidation-500973599-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:54:56.889823 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:56.889823 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:54:57.274372 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-55b605b8-01b0-4678-a8aa-fd125353475f tempest-FlavorMetadataValidation-500973599 tempest-FlavorMetadataValidation-500973599-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/1451501827/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.394700 Aug 04 16:54:57.275312 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 83/146] 10.222.0.93 () {62 vars in 1265 bytes} [Thu Aug 4 16:54:56 2022] POST /compute/v2.1/flavors/1451501827/os-extra_specs => generated 62 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:57.287719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2b5b47a9-8c14-4a28-9267-09040c039de8 tempest-QuotasAdminTestV236-471524776 tempest-QuotasAdminTestV236-471524776-project-admin] Calling method '.version_select at 0x7f1e681e7280>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:57.683143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-3db4e523-8fa0-47ad-835d-a9135e796995 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:54:57.684681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-3db4e523-8fa0-47ad-835d-a9135e796995 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:54:57.685751 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-3db4e523-8fa0-47ad-835d-a9135e796995 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:54:57.686468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-3db4e523-8fa0-47ad-835d-a9135e796995 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:54:57.686922 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-3db4e523-8fa0-47ad-835d-a9135e796995 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:54:57.702220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3db4e523-8fa0-47ad-835d-a9135e796995 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:57.702808 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3db4e523-8fa0-47ad-835d-a9135e796995 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:57.703647 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3db4e523-8fa0-47ad-835d-a9135e796995 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:57.704593 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3db4e523-8fa0-47ad-835d-a9135e796995 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:57.705116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3db4e523-8fa0-47ad-835d-a9135e796995 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:57.705821 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3db4e523-8fa0-47ad-835d-a9135e796995 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:57.725885 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-3db4e523-8fa0-47ad-835d-a9135e796995 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Getting quotas for project 131b528863154fefbc36f11eaf18365e. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:54:57.730854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-3db4e523-8fa0-47ad-835d-a9135e796995 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Getting quotas for user 679ea09388514a19a79f2dcce73b4189 and project 131b528863154fefbc36f11eaf18365e. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:54:57.743075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3db4e523-8fa0-47ad-835d-a9135e796995 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:54:57.746992 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3db4e523-8fa0-47ad-835d-a9135e796995 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:54:57.802106 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2b5b47a9-8c14-4a28-9267-09040c039de8 tempest-QuotasAdminTestV236-471524776 tempest-QuotasAdminTestV236-471524776-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/aeae5ec084f24d848dcdef347c5fcd79?user_id=725f04b51f83430a97e0ecb6eeed0d7b" status: 200 len: 282 microversion: 2.36 time: 0.524740 Aug 04 16:54:57.803881 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 84/147] 10.222.0.93 () {60 vars in 1364 bytes} [Thu Aug 4 16:54:57 2022] GET /compute/v2.1/os-quota-sets/aeae5ec084f24d848dcdef347c5fcd79?user_id=725f04b51f83430a97e0ecb6eeed0d7b => generated 282 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:54:57.815468 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-985dc098-44de-4fac-9012-86a06636fd6e tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:57.816690 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-985dc098-44de-4fac-9012-86a06636fd6e tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] [instance: d0d49f6b-4070-4e08-a35a-5dfd203c773f] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:57.827472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-985dc098-44de-4fac-9012-86a06636fd6e tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:57.828187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-985dc098-44de-4fac-9012-86a06636fd6e tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:57.828857 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-985dc098-44de-4fac-9012-86a06636fd6e tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:57.829902 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-985dc098-44de-4fac-9012-86a06636fd6e tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:57.831140 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-985dc098-44de-4fac-9012-86a06636fd6e tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:57.831870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-985dc098-44de-4fac-9012-86a06636fd6e tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:57.850251 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3db4e523-8fa0-47ad-835d-a9135e796995 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.571429 Aug 04 16:54:57.851417 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 64/148] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:54:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 1573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:54:57.875324 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8dc62781-e8c4-4841-811a-6bced945ca0c tempest-FlavorMetadataValidation-500973599 tempest-FlavorMetadataValidation-500973599-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:57.877245 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:57.877245 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:57.923963 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8dc62781-e8c4-4841-811a-6bced945ca0c tempest-FlavorMetadataValidation-500973599 tempest-FlavorMetadataValidation-500973599-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1451501827" status: 202 len: 0 microversion: 2.86 time: 0.070019 Aug 04 16:54:57.926081 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 65/149] 10.222.0.93 () {60 vars in 1202 bytes} [Thu Aug 4 16:54:57 2022] DELETE /compute/v2.1/flavors/1451501827 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:54:57.937285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ecd5c3a4-a309-4aef-8796-fe7882b20a76 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:57.939003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ecd5c3a4-a309-4aef-8796-fe7882b20a76 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:58.056577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ecd5c3a4-a309-4aef-8796-fe7882b20a76 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:58.080752 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ecd5c3a4-a309-4aef-8796-fe7882b20a76 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13" status: 200 len: 1265 microversion: 2.1 time: 0.152556 Aug 04 16:54:58.084958 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 66/150] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:57 2022] GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:58.093137 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-94645d42-0739-4eac-ae87-1d6f7d2bee7c tempest-FlavorMetadataValidation-500973599 tempest-FlavorMetadataValidation-500973599-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:58.127773 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-985dc098-44de-4fac-9012-86a06636fd6e tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808f13b51f6d4e1d9e7c924742544ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4104fbd3df4e7aadfaf896bea56a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:58.136792 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-94645d42-0739-4eac-ae87-1d6f7d2bee7c tempest-FlavorMetadataValidation-500973599 tempest-FlavorMetadataValidation-500973599-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 6684 microversion: 2.86 time: 0.047626 Aug 04 16:54:58.137425 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 67/151] 10.222.0.93 () {60 vars in 1187 bytes} [Thu Aug 4 16:54:58 2022] GET /compute/v2.1/flavors/detail => generated 6684 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:54:58.140938 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-985dc098-44de-4fac-9012-86a06636fd6e tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] 10.222.0.93 "GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f" status: 200 len: 1487 microversion: 2.1 time: 0.335783 Aug 04 16:54:58.141825 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 85/152] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:57 2022] GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f => generated 1487 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:58.162819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9f18897e-f102-4c6b-9057-2f978c96240f tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:58.163460 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9f18897e-f102-4c6b-9057-2f978c96240f tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] [instance: d0d49f6b-4070-4e08-a35a-5dfd203c773f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:58.171201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f18897e-f102-4c6b-9057-2f978c96240f tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:58.171702 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f18897e-f102-4c6b-9057-2f978c96240f tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:58.172318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f18897e-f102-4c6b-9057-2f978c96240f tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:58.173182 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f18897e-f102-4c6b-9057-2f978c96240f tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:58.173788 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f18897e-f102-4c6b-9057-2f978c96240f tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:58.174388 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f18897e-f102-4c6b-9057-2f978c96240f tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:58.694122 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9f18897e-f102-4c6b-9057-2f978c96240f tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f" status: 200 len: 1638 microversion: 2.1 time: 0.535155 Aug 04 16:54:58.702134 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 68/153] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:58 2022] GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f => generated 1638 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:58.715393 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2656d606-7901-49ec-9aa4-0a2c71fcab3c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:58.717938 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2656d606-7901-49ec-9aa4-0a2c71fcab3c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] [instance: d0d49f6b-4070-4e08-a35a-5dfd203c773f] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:58.745838 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2656d606-7901-49ec-9aa4-0a2c71fcab3c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:58.749856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2656d606-7901-49ec-9aa4-0a2c71fcab3c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:58.751415 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2656d606-7901-49ec-9aa4-0a2c71fcab3c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:58.752567 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2656d606-7901-49ec-9aa4-0a2c71fcab3c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:58.753451 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2656d606-7901-49ec-9aa4-0a2c71fcab3c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:58.754714 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2656d606-7901-49ec-9aa4-0a2c71fcab3c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:58.859085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2656d606-7901-49ec-9aa4-0a2c71fcab3c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] [instance: d0d49f6b-4070-4e08-a35a-5dfd203c773f] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:54:59.109285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-81915696-b51e-4e73-bd59-b78de4527a13 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:59.109919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-81915696-b51e-4e73-bd59-b78de4527a13 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:59.231972 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2656d606-7901-49ec-9aa4-0a2c71fcab3c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "compute-rpcapi-router" {{(pid=131043) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 04 16:54:59.232387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2656d606-7901-49ec-9aa4-0a2c71fcab3c tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquired lock "compute-rpcapi-router" {{(pid=131043) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 04 16:54:59.233603 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8f0bd139-b37d-47e3-9b57-6668a5d162f9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:59.234000 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8f0bd139-b37d-47e3-9b57-6668a5d162f9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:59.234507 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8f0bd139-b37d-47e3-9b57-6668a5d162f9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:59.235134 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8f0bd139-b37d-47e3-9b57-6668a5d162f9 None None] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:59.247711 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8f0bd139-b37d-47e3-9b57-6668a5d162f9 None None] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:59.248591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8f0bd139-b37d-47e3-9b57-6668a5d162f9 None None] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:59.260414 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-81915696-b51e-4e73-bd59-b78de4527a13 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:59.264018 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.compute.rpcapi [None req-8f0bd139-b37d-47e3-9b57-6668a5d162f9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 16:54:59.265207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8f0bd139-b37d-47e3-9b57-6668a5d162f9 None None] Releasing lock "compute-rpcapi-router" {{(pid=131043) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 04 16:54:59.272961 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-81915696-b51e-4e73-bd59-b78de4527a13 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13" status: 200 len: 1265 microversion: 2.1 time: 0.166046 Aug 04 16:54:59.274925 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 69/154] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:59 2022] GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:59.363463 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8f0bd139-b37d-47e3-9b57-6668a5d162f9 None None] 10.222.0.93 "DELETE /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f" status: 204 len: 0 microversion: 2.1 time: 0.652492 Aug 04 16:54:59.367981 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 86/155] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 16:54:58 2022] DELETE /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f => generated 0 bytes in 655 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:54:59.374166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cf298dbf-f66e-43d3-92b2-9760bf1bff0e tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:59.375135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cf298dbf-f66e-43d3-92b2-9760bf1bff0e tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] [instance: d0d49f6b-4070-4e08-a35a-5dfd203c773f] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:54:59.382291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cf298dbf-f66e-43d3-92b2-9760bf1bff0e tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:59.383061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cf298dbf-f66e-43d3-92b2-9760bf1bff0e tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:59.383733 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cf298dbf-f66e-43d3-92b2-9760bf1bff0e tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:59.384657 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cf298dbf-f66e-43d3-92b2-9760bf1bff0e tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:59.385238 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cf298dbf-f66e-43d3-92b2-9760bf1bff0e tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:59.385740 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cf298dbf-f66e-43d3-92b2-9760bf1bff0e tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:54:59.549516 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cf298dbf-f66e-43d3-92b2-9760bf1bff0e tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808f13b51f6d4e1d9e7c924742544ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4104fbd3df4e7aadfaf896bea56a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:54:59.557555 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cf298dbf-f66e-43d3-92b2-9760bf1bff0e tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] 10.222.0.93 "GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f" status: 200 len: 1493 microversion: 2.1 time: 0.187934 Aug 04 16:54:59.559102 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 87/156] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:54:59 2022] GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f => generated 1493 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:54:59.948854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7c2bc2ee-a7d4-47e8-9db9-129c0df82ee7 tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] Calling method '.version_select at 0x7f1e6814e940>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:54:59.950200 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:54:59.950200 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:54:59.952597 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c2bc2ee-a7d4-47e8-9db9-129c0df82ee7 tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:54:59.953726 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c2bc2ee-a7d4-47e8-9db9-129c0df82ee7 tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:54:59.954876 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c2bc2ee-a7d4-47e8-9db9-129c0df82ee7 tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:00.021947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c2bc2ee-a7d4-47e8-9db9-129c0df82ee7 tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:00.027964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c2bc2ee-a7d4-47e8-9db9-129c0df82ee7 tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:00.031452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c2bc2ee-a7d4-47e8-9db9-129c0df82ee7 tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:00.074331 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c2bc2ee-a7d4-47e8-9db9-129c0df82ee7 tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:00.077293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c2bc2ee-a7d4-47e8-9db9-129c0df82ee7 tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:00.078083 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c2bc2ee-a7d4-47e8-9db9-129c0df82ee7 tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:00.108247 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7c2bc2ee-a7d4-47e8-9db9-129c0df82ee7 tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.809479 Aug 04 16:55:00.109604 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 70/157] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:54:59 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:55:00.297719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f22de80c-7f93-47e8-967a-91d040473003 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:00.298598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f22de80c-7f93-47e8-967a-91d040473003 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:00.312134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f22de80c-7f93-47e8-967a-91d040473003 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:00.312663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f22de80c-7f93-47e8-967a-91d040473003 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:00.313095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f22de80c-7f93-47e8-967a-91d040473003 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:00.313831 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f22de80c-7f93-47e8-967a-91d040473003 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:00.314327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f22de80c-7f93-47e8-967a-91d040473003 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:00.315896 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f22de80c-7f93-47e8-967a-91d040473003 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:00.328492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:00.423636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f22de80c-7f93-47e8-967a-91d040473003 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:00.450680 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f22de80c-7f93-47e8-967a-91d040473003 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13" status: 200 len: 1335 microversion: 2.1 time: 0.157993 Aug 04 16:55:00.452153 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 71/158] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:00 2022] GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 => generated 1335 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:00.579683 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-70843aaa-2888-40e3-8d99-2aabc8cd4e77 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:00.580597 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-70843aaa-2888-40e3-8d99-2aabc8cd4e77 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] [instance: d0d49f6b-4070-4e08-a35a-5dfd203c773f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:00.587609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70843aaa-2888-40e3-8d99-2aabc8cd4e77 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:00.588225 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70843aaa-2888-40e3-8d99-2aabc8cd4e77 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:00.589006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70843aaa-2888-40e3-8d99-2aabc8cd4e77 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:00.590207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70843aaa-2888-40e3-8d99-2aabc8cd4e77 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:00.591579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70843aaa-2888-40e3-8d99-2aabc8cd4e77 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:00.592233 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70843aaa-2888-40e3-8d99-2aabc8cd4e77 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:00.634042 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-eb01e28f-4513-4f15-a80a-e5d0fb610e4c tempest-HypervisorAdminNegativeUnderV252Test-1211314720 tempest-HypervisorAdminNegativeUnderV252Test-1211314720-project] Calling method '.version_select at 0x7f1e681e7e50>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:00.635206 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:00.635206 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:55:00.637090 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-eb01e28f-4513-4f15-a80a-e5d0fb610e4c tempest-HypervisorAdminNegativeUnderV252Test-1211314720 tempest-HypervisorAdminNegativeUnderV252Test-1211314720-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'ddf814ab6cc04a59ba6bc5aa1de41621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eaae21f020445dab3cecdafd512c383', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:00.639788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-eb01e28f-4513-4f15-a80a-e5d0fb610e4c tempest-HypervisorAdminNegativeUnderV252Test-1211314720 tempest-HypervisorAdminNegativeUnderV252Test-1211314720-project] Request method failure captured: Aug 04 16:55:00.639788 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/os-hypervisors/n-h1-851359-3/search HTTP/1.1 Aug 04 16:55:00.639788 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:55:00.639788 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:55:00.639788 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:55:00.639788 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:55:00.639788 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:55:00.639788 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:55:00.639788 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:55:00.639788 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:00.639788 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_ngL-n7y41VY5LGodO_DvAfrdxRxGE-aWdr6DCFPT3EU1mDSKZbg_E4rls0Kr56qyGTINrsXlt8oWjbRZQmbbN6BpLlHDyeMIipw29CzI2YH5yRQ_RyribZuMvV5IcRpK4Yjypx5YZc6Vn-cpGDClBJj3o9N2fU73Sv-Wwzz1-W_XY Aug 04 16:55:00.639788 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:55:00.639788 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:55:00.639788 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:55:00.639788 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:55:00.639788 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:55:00.639788 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:55:00.639788 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 1eaae21f020445dab3cecdafd512c383 Aug 04 16:55:00.639788 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1211314720 Aug 04 16:55:00.639788 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 16:55:00.639788 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 16:55:00.641309 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1eaae21f020445dab3cecdafd512c383"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1eaae21f020445dab3cecdafd512c383"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1eaae21f020445dab3cecdafd512c383"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1eaae21f020445dab3cecdafd512c383"}]}] Aug 04 16:55:00.641309 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1211314720 Aug 04 16:55:00.641309 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 1eaae21f020445dab3cecdafd512c383 Aug 04 16:55:00.641309 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1211314720 Aug 04 16:55:00.641309 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1211314720-project Aug 04 16:55:00.641309 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:55:00.641309 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:55:00.641309 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: ddf814ab6cc04a59ba6bc5aa1de41621 Aug 04 16:55:00.641309 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1211314720-project Aug 04 16:55:00.641309 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 16:55:00.641309 n-d-851359-3 devstack@n-api.service[131043]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 04 16:55:00.641309 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'n-h1-851359-3'} Aug 04 16:55:00.642187 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:00.642187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:00.642187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:00.642187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:00.642187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:00.642187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:00.642187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:55:00.642187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:55:00.642187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:00.642187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:00.642187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 04 16:55:00.642187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 04 16:55:00.642187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:55:00.642187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:55:00.642187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:55:00.642187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:55:00.642187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:55:00.642187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:55:00.642187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:55:00.644012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:55:00.644012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:55:00.644012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:55:00.644012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:55:00.644012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:55:00.644012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:55:00.644012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:55:00.644012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 04 16:55:00.644012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:00.644012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:00.644012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:00.644012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:00.644012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:00.644012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:00.644012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:55:00.644012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:55:00.644012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 04 16:55:00.644012 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:00.648164 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-eb01e28f-4513-4f15-a80a-e5d0fb610e4c tempest-HypervisorAdminNegativeUnderV252Test-1211314720 tempest-HypervisorAdminNegativeUnderV252Test-1211314720-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:00.649573 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-eb01e28f-4513-4f15-a80a-e5d0fb610e4c tempest-HypervisorAdminNegativeUnderV252Test-1211314720 tempest-HypervisorAdminNegativeUnderV252Test-1211314720-project] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/n-h1-851359-3/search" status: 403 len: 117 microversion: 2.1 time: 0.532284 Aug 04 16:55:00.652629 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 88/159] 10.222.0.93 () {58 vars in 1209 bytes} [Thu Aug 4 16:55:00 2022] GET /compute/v2.1/os-hypervisors/n-h1-851359-3/search => generated 117 bytes in 537 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:55:00.667825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b96566e3-9b21-48b3-ba19-984221fd912f tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] Calling method '.version_select at 0x7f1e680ce0d0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:00.670359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b96566e3-9b21-48b3-ba19-984221fd912f tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:00.670962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b96566e3-9b21-48b3-ba19-984221fd912f tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:00.671641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b96566e3-9b21-48b3-ba19-984221fd912f tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:00.681748 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-b96566e3-9b21-48b3-ba19-984221fd912f tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 04 16:55:00.683964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b96566e3-9b21-48b3-ba19-984221fd912f tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] Request method failure captured: Aug 04 16:55:00.683964 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 04 16:55:00.683964 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:55:00.683964 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:55:00.683964 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:55:00.683964 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:55:00.683964 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:55:00.683964 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:55:00.683964 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:55:00.683964 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:00.683964 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_njqcukmwgTbbcDm94WiqInZF_gHc1SKAPYLlKIkq7joJiDCYO_iUBbc0jqfQdgAuqCYyJZKirDU6MRAL1f2MoDGQiVPMhvaBL10GwsqBC36d77wWsvDq2Rq04hATIHXL2LcL8cs3rBtmJlc-LMDOyUMALyx6uKEQPsj4KgjXZ75to Aug 04 16:55:00.683964 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:55:00.683964 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:55:00.683964 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:55:00.683964 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:55:00.683964 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:55:00.683964 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:55:00.683964 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 562a9d58f4b140ec9a1310e7f08b6d00 Aug 04 16:55:00.683964 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-58369253 Aug 04 16:55:00.683964 n-d-851359-3 devstack@n-api.service[131043]: X-Role: admin,member,reader Aug 04 16:55:00.683964 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: admin,member,reader Aug 04 16:55:00.686425 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/562a9d58f4b140ec9a1310e7f08b6d00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/562a9d58f4b140ec9a1310e7f08b6d00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_562a9d58f4b140ec9a1310e7f08b6d00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/562a9d58f4b140ec9a1310e7f08b6d00"}]}] Aug 04 16:55:00.686425 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-58369253 Aug 04 16:55:00.686425 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 562a9d58f4b140ec9a1310e7f08b6d00 Aug 04 16:55:00.686425 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-58369253 Aug 04 16:55:00.686425 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin Aug 04 16:55:00.686425 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:55:00.686425 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:55:00.686425 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 9a342e2c4f854cd7a4312e7157a6a7a3 Aug 04 16:55:00.686425 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin Aug 04 16:55:00.686425 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 16:55:00.686425 n-d-851359-3 devstack@n-api.service[131043]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 04 16:55:00.686425 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 04 16:55:00.688011 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:00.688011 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:00.688011 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:00.688011 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:00.688011 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:00.688011 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:00.688011 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:55:00.688011 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:55:00.688011 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:00.688011 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:00.688011 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 04 16:55:00.688011 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 04 16:55:00.688011 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 04 16:55:00.688011 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 16:55:00.688011 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 04 16:55:00.688011 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:00.688011 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:00.688011 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:00.688011 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:00.688011 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:00.690393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:00.690393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:55:00.690393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:55:00.690393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 04 16:55:00.690393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:00.694243 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b96566e3-9b21-48b3-ba19-984221fd912f tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:00.694243 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b96566e3-9b21-48b3-ba19-984221fd912f tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.028534 Aug 04 16:55:00.694243 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 89/160] 10.222.0.93 () {58 vars in 1251 bytes} [Thu Aug 4 16:55:00 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:55:00.705280 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-63a916ed-16f6-437b-bc79-609419c65036 tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] Calling method '.version_select at 0x7f1e681d0f70>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:00.708055 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:00.708055 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:55:00.709253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63a916ed-16f6-437b-bc79-609419c65036 tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:00.710874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63a916ed-16f6-437b-bc79-609419c65036 tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:00.713335 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63a916ed-16f6-437b-bc79-609419c65036 tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:00.745468 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63a916ed-16f6-437b-bc79-609419c65036 tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:00.748516 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63a916ed-16f6-437b-bc79-609419c65036 tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:00.749326 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63a916ed-16f6-437b-bc79-609419c65036 tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:00.776469 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63a916ed-16f6-437b-bc79-609419c65036 tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:00.777995 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63a916ed-16f6-437b-bc79-609419c65036 tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:00.781445 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63a916ed-16f6-437b-bc79-609419c65036 tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:00.795769 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-63a916ed-16f6-437b-bc79-609419c65036 tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.096182 Aug 04 16:55:00.801349 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 90/161] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:55:00 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:00.812561 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3a395134-03d7-43dd-94a1-a11fb6fd031e tempest-HypervisorAdminNegativeUnderV252Test-1211314720 tempest-HypervisorAdminNegativeUnderV252Test-1211314720-project] Calling method '.version_select at 0x7f1e68143ca0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:00.813546 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:00.813546 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:55:00.814565 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3a395134-03d7-43dd-94a1-a11fb6fd031e tempest-HypervisorAdminNegativeUnderV252Test-1211314720 tempest-HypervisorAdminNegativeUnderV252Test-1211314720-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'ddf814ab6cc04a59ba6bc5aa1de41621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eaae21f020445dab3cecdafd512c383', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:00.816136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3a395134-03d7-43dd-94a1-a11fb6fd031e tempest-HypervisorAdminNegativeUnderV252Test-1211314720 tempest-HypervisorAdminNegativeUnderV252Test-1211314720-project] Request method failure captured: Aug 04 16:55:00.816136 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 04 16:55:00.816136 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:55:00.816136 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:55:00.816136 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:55:00.816136 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:55:00.816136 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:55:00.816136 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:55:00.816136 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:55:00.816136 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:00.816136 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_ngL-n7y41VY5LGodO_DvAfrdxRxGE-aWdr6DCFPT3EU1mDSKZbg_E4rls0Kr56qyGTINrsXlt8oWjbRZQmbbN6BpLlHDyeMIipw29CzI2YH5yRQ_RyribZuMvV5IcRpK4Yjypx5YZc6Vn-cpGDClBJj3o9N2fU73Sv-Wwzz1-W_XY Aug 04 16:55:00.816136 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:55:00.816136 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:55:00.816136 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:55:00.816136 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:55:00.816136 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:55:00.816136 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:55:00.816136 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 1eaae21f020445dab3cecdafd512c383 Aug 04 16:55:00.816136 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1211314720 Aug 04 16:55:00.816136 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 16:55:00.816136 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 16:55:00.817618 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1eaae21f020445dab3cecdafd512c383"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1eaae21f020445dab3cecdafd512c383"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1eaae21f020445dab3cecdafd512c383"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1eaae21f020445dab3cecdafd512c383"}]}] Aug 04 16:55:00.817618 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1211314720 Aug 04 16:55:00.817618 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 1eaae21f020445dab3cecdafd512c383 Aug 04 16:55:00.817618 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1211314720 Aug 04 16:55:00.817618 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1211314720-project Aug 04 16:55:00.817618 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:55:00.817618 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:55:00.817618 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: ddf814ab6cc04a59ba6bc5aa1de41621 Aug 04 16:55:00.817618 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1211314720-project Aug 04 16:55:00.817618 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 16:55:00.817618 n-d-851359-3 devstack@n-api.service[131043]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 04 16:55:00.817618 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '1'} Aug 04 16:55:00.818295 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:00.818295 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:00.818295 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:00.818295 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:00.818295 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:00.818295 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:00.818295 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:55:00.818295 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:55:00.818295 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:00.818295 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:00.818295 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 04 16:55:00.818295 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 04 16:55:00.818295 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:55:00.818295 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:55:00.818295 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:55:00.818295 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:55:00.818295 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:55:00.818295 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:55:00.818295 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:55:00.819317 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:55:00.819317 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:55:00.819317 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:55:00.819317 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:55:00.819317 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:55:00.819317 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:55:00.819317 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:55:00.819317 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 04 16:55:00.819317 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:00.819317 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:00.819317 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:00.819317 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:00.819317 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:00.819317 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:00.819317 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:55:00.819317 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:55:00.819317 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 04 16:55:00.819317 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:00.820289 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3a395134-03d7-43dd-94a1-a11fb6fd031e tempest-HypervisorAdminNegativeUnderV252Test-1211314720 tempest-HypervisorAdminNegativeUnderV252Test-1211314720-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:00.832367 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3a395134-03d7-43dd-94a1-a11fb6fd031e tempest-HypervisorAdminNegativeUnderV252Test-1211314720 tempest-HypervisorAdminNegativeUnderV252Test-1211314720-project] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.010778 Aug 04 16:55:00.834441 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 91/162] 10.222.0.93 () {58 vars in 1176 bytes} [Thu Aug 4 16:55:00 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:55:00.849321 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d470717c-9046-4a5c-ab06-603aaa620202 tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] Calling method '.version_select at 0x7f1e68135310>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:00.860581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d470717c-9046-4a5c-ab06-603aaa620202 tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:00.861082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d470717c-9046-4a5c-ab06-603aaa620202 tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:00.864508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d470717c-9046-4a5c-ab06-603aaa620202 tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:00.884529 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-d470717c-9046-4a5c-ab06-603aaa620202 tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] HTTP exception thrown: No hypervisor matching '9a9b4d02-1bd8-4982-9ca5-760006e781e2' could be found. Aug 04 16:55:00.889566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d470717c-9046-4a5c-ab06-603aaa620202 tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] Request method failure captured: Aug 04 16:55:00.889566 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/os-hypervisors/9a9b4d02-1bd8-4982-9ca5-760006e781e2/servers HTTP/1.1 Aug 04 16:55:00.889566 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:55:00.889566 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:55:00.889566 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:55:00.889566 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:55:00.889566 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:55:00.889566 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:55:00.889566 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:55:00.889566 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:00.889566 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_njqcukmwgTbbcDm94WiqInZF_gHc1SKAPYLlKIkq7joJiDCYO_iUBbc0jqfQdgAuqCYyJZKirDU6MRAL1f2MoDGQiVPMhvaBL10GwsqBC36d77wWsvDq2Rq04hATIHXL2LcL8cs3rBtmJlc-LMDOyUMALyx6uKEQPsj4KgjXZ75to Aug 04 16:55:00.889566 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:55:00.889566 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:55:00.889566 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:55:00.889566 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:55:00.889566 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:55:00.889566 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:55:00.889566 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 562a9d58f4b140ec9a1310e7f08b6d00 Aug 04 16:55:00.889566 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-58369253 Aug 04 16:55:00.889566 n-d-851359-3 devstack@n-api.service[131043]: X-Role: admin,member,reader Aug 04 16:55:00.889566 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: admin,member,reader Aug 04 16:55:00.891092 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/562a9d58f4b140ec9a1310e7f08b6d00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/562a9d58f4b140ec9a1310e7f08b6d00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_562a9d58f4b140ec9a1310e7f08b6d00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/562a9d58f4b140ec9a1310e7f08b6d00"}]}] Aug 04 16:55:00.891092 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-58369253 Aug 04 16:55:00.891092 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 562a9d58f4b140ec9a1310e7f08b6d00 Aug 04 16:55:00.891092 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-58369253 Aug 04 16:55:00.891092 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin Aug 04 16:55:00.891092 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:55:00.891092 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:55:00.891092 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 9a342e2c4f854cd7a4312e7157a6a7a3 Aug 04 16:55:00.891092 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin Aug 04 16:55:00.891092 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 16:55:00.891092 n-d-851359-3 devstack@n-api.service[131043]: exception: No hypervisor matching '9a9b4d02-1bd8-4982-9ca5-760006e781e2' could be found. Aug 04 16:55:00.891092 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '9a9b4d02-1bd8-4982-9ca5-760006e781e2'} Aug 04 16:55:00.891863 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:00.891863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:00.891863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:00.891863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:00.891863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:00.891863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:00.891863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:55:00.891863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:55:00.891863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:00.891863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:00.891863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 04 16:55:00.891863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 04 16:55:00.891863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 04 16:55:00.891863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 16:55:00.891863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '9a9b4d02-1bd8-4982-9ca5-760006e781e2' could be found. Aug 04 16:55:00.891863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:00.891863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:00.891863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:00.891863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:00.893010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:00.893010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:00.893010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:55:00.893010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:55:00.893010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '9a9b4d02-1bd8-4982-9ca5-760006e781e2' could be found. Aug 04 16:55:00.893010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:00.899450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d470717c-9046-4a5c-ab06-603aaa620202 tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] Returning 404 to user: No hypervisor matching '9a9b4d02-1bd8-4982-9ca5-760006e781e2' could be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:00.900344 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d470717c-9046-4a5c-ab06-603aaa620202 tempest-HypervisorAdminNegativeUnderV252Test-58369253 tempest-HypervisorAdminNegativeUnderV252Test-58369253-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/9a9b4d02-1bd8-4982-9ca5-760006e781e2/servers" status: 404 len: 123 microversion: 2.1 time: 0.060934 Aug 04 16:55:00.904254 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 92/163] 10.222.0.93 () {58 vars in 1281 bytes} [Thu Aug 4 16:55:00 2022] GET /compute/v2.1/os-hypervisors/9a9b4d02-1bd8-4982-9ca5-760006e781e2/servers => generated 123 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:55:01.110886 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-70843aaa-2888-40e3-8d99-2aabc8cd4e77 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808f13b51f6d4e1d9e7c924742544ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4104fbd3df4e7aadfaf896bea56a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:01.137128 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-70843aaa-2888-40e3-8d99-2aabc8cd4e77 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] 10.222.0.93 "GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f" status: 200 len: 1493 microversion: 2.1 time: 0.554383 Aug 04 16:55:01.138453 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 72/164] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:00 2022] GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f => generated 1493 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:55:01.475527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5ed94ee4-6607-494e-b775-1b902da4fc9c tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:01.476414 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5ed94ee4-6607-494e-b775-1b902da4fc9c tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:01.492895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ed94ee4-6607-494e-b775-1b902da4fc9c tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:01.493535 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ed94ee4-6607-494e-b775-1b902da4fc9c tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:01.493894 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ed94ee4-6607-494e-b775-1b902da4fc9c tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:01.503620 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ed94ee4-6607-494e-b775-1b902da4fc9c tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:01.504133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ed94ee4-6607-494e-b775-1b902da4fc9c tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:01.504581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ed94ee4-6607-494e-b775-1b902da4fc9c tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:01.685550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5ed94ee4-6607-494e-b775-1b902da4fc9c tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:01.704325 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5ed94ee4-6607-494e-b775-1b902da4fc9c tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13" status: 200 len: 1323 microversion: 2.1 time: 0.228508 Aug 04 16:55:01.704325 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 93/165] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:01 2022] GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 => generated 1323 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:02.160639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7d019d87-9c00-4cbc-b5a9-978497325bff tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:02.161543 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7d019d87-9c00-4cbc-b5a9-978497325bff tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] [instance: d0d49f6b-4070-4e08-a35a-5dfd203c773f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:02.187213 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d019d87-9c00-4cbc-b5a9-978497325bff tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:02.188275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d019d87-9c00-4cbc-b5a9-978497325bff tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:02.189092 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d019d87-9c00-4cbc-b5a9-978497325bff tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:02.190178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d019d87-9c00-4cbc-b5a9-978497325bff tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:02.190963 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d019d87-9c00-4cbc-b5a9-978497325bff tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:02.192014 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d019d87-9c00-4cbc-b5a9-978497325bff tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:02.273527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-f3a24446-17c9-4edf-8472-bd6c2c630c8a req-8b8a394e-cf9d-46d1-866e-17606dae2b92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0d49f6b-4070-4e08-a35a-5dfd203c773f", "name": "network-vif-deleted", "tag": "1b12464f-face-48ed-ae05-715066fcbad9"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:02.318865 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f3a24446-17c9-4edf-8472-bd6c2c630c8a req-8b8a394e-cf9d-46d1-866e-17606dae2b92 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:02.320778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f3a24446-17c9-4edf-8472-bd6c2c630c8a req-8b8a394e-cf9d-46d1-866e-17606dae2b92 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:02.323268 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f3a24446-17c9-4edf-8472-bd6c2c630c8a req-8b8a394e-cf9d-46d1-866e-17606dae2b92 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:02.433965 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-f3a24446-17c9-4edf-8472-bd6c2c630c8a req-8b8a394e-cf9d-46d1-866e-17606dae2b92 service nova] Creating event network-vif-deleted:1b12464f-face-48ed-ae05-715066fcbad9 for instance d0d49f6b-4070-4e08-a35a-5dfd203c773f on n-h1-851359-3 Aug 04 16:55:02.470504 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-f3a24446-17c9-4edf-8472-bd6c2c630c8a req-8b8a394e-cf9d-46d1-866e-17606dae2b92 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201999 Aug 04 16:55:02.473036 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 94/166] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:02.729574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b6ec70e9-674a-4857-91e4-5333ec7d24a5 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:02.731904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b6ec70e9-674a-4857-91e4-5333ec7d24a5 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:02.742763 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6ec70e9-674a-4857-91e4-5333ec7d24a5 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:02.743269 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6ec70e9-674a-4857-91e4-5333ec7d24a5 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:02.743830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6ec70e9-674a-4857-91e4-5333ec7d24a5 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:02.753551 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6ec70e9-674a-4857-91e4-5333ec7d24a5 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:02.757677 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6ec70e9-674a-4857-91e4-5333ec7d24a5 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:02.757677 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6ec70e9-674a-4857-91e4-5333ec7d24a5 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:02.853926 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7d019d87-9c00-4cbc-b5a9-978497325bff tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808f13b51f6d4e1d9e7c924742544ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d4104fbd3df4e7aadfaf896bea56a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:02.872385 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7d019d87-9c00-4cbc-b5a9-978497325bff tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] 10.222.0.93 "GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f" status: 200 len: 1451 microversion: 2.1 time: 0.711638 Aug 04 16:55:02.873401 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 73/167] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:02 2022] GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f => generated 1451 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:55:03.285493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b6ec70e9-674a-4857-91e4-5333ec7d24a5 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:03.304990 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b6ec70e9-674a-4857-91e4-5333ec7d24a5 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13" status: 200 len: 1390 microversion: 2.1 time: 0.584903 Aug 04 16:55:03.313564 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 95/168] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:02 2022] GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 => generated 1390 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:55:03.901909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f235b8b7-09b9-4ee9-ad62-91ef7006a1f9 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:03.903812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f235b8b7-09b9-4ee9-ad62-91ef7006a1f9 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] [instance: d0d49f6b-4070-4e08-a35a-5dfd203c773f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:03.915115 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f235b8b7-09b9-4ee9-ad62-91ef7006a1f9 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:03.925340 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f235b8b7-09b9-4ee9-ad62-91ef7006a1f9 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:03.926234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f235b8b7-09b9-4ee9-ad62-91ef7006a1f9 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:03.928509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f235b8b7-09b9-4ee9-ad62-91ef7006a1f9 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:03.931378 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f235b8b7-09b9-4ee9-ad62-91ef7006a1f9 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:03.931944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f235b8b7-09b9-4ee9-ad62-91ef7006a1f9 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:03.978613 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-f235b8b7-09b9-4ee9-ad62-91ef7006a1f9 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] HTTP exception thrown: Instance d0d49f6b-4070-4e08-a35a-5dfd203c773f could not be found. Aug 04 16:55:03.998450 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f235b8b7-09b9-4ee9-ad62-91ef7006a1f9 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Request method failure captured: Aug 04 16:55:03.998450 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f HTTP/1.1 Aug 04 16:55:03.998450 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:55:03.998450 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:55:03.998450 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:55:03.998450 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:55:03.998450 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:55:03.998450 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:55:03.998450 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:55:03.998450 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:03.998450 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_m-OiWjXKAzc1mKiUxi8Z7XP4oyiCmNV_Go3F225JCH_WEWZY3p84DkR2_zse626gZAB9Bh8EAPqCt9Sp_1M89R4-ZHe5y0sTJVCiyPmRi1GMOde2VIYs3Jey8YA6D9juEbt3DWa0aLGTmwhgGA1-QIbgvYxkgK6KYShaoFLB8OvSw Aug 04 16:55:03.998450 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:55:03.998450 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:55:03.998450 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:55:03.998450 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:55:03.998450 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:55:03.998450 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:55:03.998450 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 8d4104fbd3df4e7aadfaf896bea56a9c Aug 04 16:55:03.998450 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-AggregatesAdminTestJSON-66516335 Aug 04 16:55:03.998450 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:55:03.998450 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:55:03.999931 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8d4104fbd3df4e7aadfaf896bea56a9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8d4104fbd3df4e7aadfaf896bea56a9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8d4104fbd3df4e7aadfaf896bea56a9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8d4104fbd3df4e7aadfaf896bea56a9c"}]}] Aug 04 16:55:03.999931 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-AggregatesAdminTestJSON-66516335 Aug 04 16:55:03.999931 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 8d4104fbd3df4e7aadfaf896bea56a9c Aug 04 16:55:03.999931 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-66516335 Aug 04 16:55:03.999931 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-AggregatesAdminTestJSON-66516335-project Aug 04 16:55:03.999931 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:55:03.999931 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:55:03.999931 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 808f13b51f6d4e1d9e7c924742544ef6 Aug 04 16:55:03.999931 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-AggregatesAdminTestJSON-66516335-project Aug 04 16:55:03.999931 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:55:03.999931 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance d0d49f6b-4070-4e08-a35a-5dfd203c773f could not be found. Aug 04 16:55:03.999931 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'd0d49f6b-4070-4e08-a35a-5dfd203c773f'} Aug 04 16:55:04.000888 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:04.000888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:04.000888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:55:04.000888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:55:04.000888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:55:04.000888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:55:04.000888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:55:04.000888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:55:04.000888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:55:04.000888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:55:04.000888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0d49f6b-4070-4e08-a35a-5dfd203c773f could not be found. Aug 04 16:55:04.000888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:04.000888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:04.000888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:04.000888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:04.000888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:04.000888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:04.000888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:04.000888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:04.000888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:04.004328 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:04.004328 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:55:04.004328 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:55:04.004328 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:55:04.004328 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:55:04.004328 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:55:04.004328 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:55:04.004328 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0d49f6b-4070-4e08-a35a-5dfd203c773f could not be found. Aug 04 16:55:04.004328 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:04.004328 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:04.004328 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:04.004328 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:04.004328 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:04.004328 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:04.004328 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:55:04.004328 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:55:04.004328 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0d49f6b-4070-4e08-a35a-5dfd203c773f could not be found. Aug 04 16:55:04.004328 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:04.009359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f235b8b7-09b9-4ee9-ad62-91ef7006a1f9 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Returning 404 to user: Instance d0d49f6b-4070-4e08-a35a-5dfd203c773f could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:04.013652 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f235b8b7-09b9-4ee9-ad62-91ef7006a1f9 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] 10.222.0.93 "GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f" status: 404 len: 111 microversion: 2.1 time: 0.114652 Aug 04 16:55:04.016410 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 74/169] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:03 2022] GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:55:04.026779 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b437c043-3ca0-4521-b76c-cebaf2fbba18 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-851359-3"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:04.033196 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:04.033196 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:55:04.060309 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b437c043-3ca0-4521-b76c-cebaf2fbba18 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:04.062209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b437c043-3ca0-4521-b76c-cebaf2fbba18 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:04.063956 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b437c043-3ca0-4521-b76c-cebaf2fbba18 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:04.343500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-10bb876c-c32f-41cc-971a-b8ec128342f6 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:04.344038 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-10bb876c-c32f-41cc-971a-b8ec128342f6 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:04.369793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10bb876c-c32f-41cc-971a-b8ec128342f6 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:04.371284 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10bb876c-c32f-41cc-971a-b8ec128342f6 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:04.372027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10bb876c-c32f-41cc-971a-b8ec128342f6 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:04.373250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10bb876c-c32f-41cc-971a-b8ec128342f6 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:04.374010 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10bb876c-c32f-41cc-971a-b8ec128342f6 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:04.374592 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10bb876c-c32f-41cc-971a-b8ec128342f6 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:04.392272 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b437c043-3ca0-4521-b76c-cebaf2fbba18 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 297 microversion: 2.1 time: 0.371711 Aug 04 16:55:04.392881 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 96/170] 10.222.0.93 () {60 vars in 1191 bytes} [Thu Aug 4 16:55:04 2022] POST /compute/v2.1/os-aggregates/6/action => generated 297 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:04.407366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8438d35e-1e39-483d-9c7d-0b1ce56b7e14 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:04.408143 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:04.408143 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:55:04.430750 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:04.480042 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8438d35e-1e39-483d-9c7d-0b1ce56b7e14 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.076188 Aug 04 16:55:04.497460 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 97/171] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Aug 4 16:55:04 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 16:55:04.506127 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4f67d984-a9af-4cd3-ab1a-04356ccfc9e5 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1940830004"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:04.556478 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:04.556478 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:55:04.557840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.aggregate [None req-4f67d984-a9af-4cd3-ab1a-04356ccfc9e5 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Generated uuid f4896cad-8f78-42b8-86a2-cea9ac50421b for aggregate {{(pid=131043) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:55:04.605990 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4f67d984-a9af-4cd3-ab1a-04356ccfc9e5 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.107111 Aug 04 16:55:04.606839 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 98/172] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Aug 4 16:55:04 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:04.629380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e87e0128-2cb4-4e6b-b67c-5ff5a8be6ca1 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-851359-3"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:04.632846 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:04.632846 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:55:04.661671 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e87e0128-2cb4-4e6b-b67c-5ff5a8be6ca1 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:04.662545 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e87e0128-2cb4-4e6b-b67c-5ff5a8be6ca1 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:04.663150 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e87e0128-2cb4-4e6b-b67c-5ff5a8be6ca1 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:04.708265 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:04.857416 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e87e0128-2cb4-4e6b-b67c-5ff5a8be6ca1 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.231876 Aug 04 16:55:04.858728 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 99/173] 10.222.0.93 () {60 vars in 1191 bytes} [Thu Aug 4 16:55:04 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:04.870758 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ac975ff9-4f68-445f-8dbb-1c2637104437 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:04.872213 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:04.872213 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:55:04.887717 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ac975ff9-4f68-445f-8dbb-1c2637104437 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 242 microversion: 2.1 time: 0.020317 Aug 04 16:55:04.891115 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 100/174] 10.222.0.93 () {58 vars in 1149 bytes} [Thu Aug 4 16:55:04 2022] GET /compute/v2.1/os-aggregates/9 => generated 242 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:04.903159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9aaf0569-39fc-4df7-b129-0a704159de4e tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-851359-3"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:04.909839 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:04.909839 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:55:04.949439 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-10bb876c-c32f-41cc-971a-b8ec128342f6 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:04.971324 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9aaf0569-39fc-4df7-b129-0a704159de4e tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:04.974316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9aaf0569-39fc-4df7-b129-0a704159de4e tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:04.978281 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9aaf0569-39fc-4df7-b129-0a704159de4e tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:04.980461 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-10bb876c-c32f-41cc-971a-b8ec128342f6 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13" status: 200 len: 1390 microversion: 2.1 time: 0.637056 Aug 04 16:55:04.983849 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 75/175] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:04 2022] GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 => generated 1390 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:05.204856 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9aaf0569-39fc-4df7-b129-0a704159de4e tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.305550 Aug 04 16:55:05.206792 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 101/176] 10.222.0.93 () {60 vars in 1191 bytes} [Thu Aug 4 16:55:04 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:55:05.220808 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cb816807-eb97-471a-82a4-eb8ef407fa51 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:05.221671 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:05.221671 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:05.263655 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cb816807-eb97-471a-82a4-eb8ef407fa51 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.046118 Aug 04 16:55:05.266676 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 76/177] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Aug 4 16:55:05 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 16:55:05.278921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c27ed123-789b-4b84-a3eb-c3a5dba66751 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-186134975"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:05.282862 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:05.282862 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:55:05.284224 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.aggregate [None req-c27ed123-789b-4b84-a3eb-c3a5dba66751 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Generated uuid 0f379079-6cd1-4209-b3fb-69685f868b7b for aggregate {{(pid=131043) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:55:05.340635 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c27ed123-789b-4b84-a3eb-c3a5dba66751 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.065207 Aug 04 16:55:05.341465 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 102/178] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Aug 4 16:55:05 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:05.355302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5991c647-4f5c-4c85-a03f-13281ccfd153 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-851359-3"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:05.358531 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:05.358531 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:05.372315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5991c647-4f5c-4c85-a03f-13281ccfd153 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:05.373173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5991c647-4f5c-4c85-a03f-13281ccfd153 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:05.373830 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5991c647-4f5c-4c85-a03f-13281ccfd153 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:05.641476 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5991c647-4f5c-4c85-a03f-13281ccfd153 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 242 microversion: 2.1 time: 0.291474 Aug 04 16:55:05.642401 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 77/179] 10.222.0.93 () {60 vars in 1194 bytes} [Thu Aug 4 16:55:05 2022] POST /compute/v2.1/os-aggregates/10/action => generated 242 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:55:05.663365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-97513230-bce3-4370-ae64-59dddcb5403d tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:05.665115 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:05.665115 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:05.687874 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-97513230-bce3-4370-ae64-59dddcb5403d tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.037642 Aug 04 16:55:05.690962 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 78/180] 10.222.0.93 () {58 vars in 1143 bytes} [Thu Aug 4 16:55:05 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:55:05.710093 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d2349f77-33b3-4874-ba96-25ad222a5a41 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-851359-3"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:05.724772 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:05.724772 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:05.737492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2349f77-33b3-4874-ba96-25ad222a5a41 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:05.738379 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2349f77-33b3-4874-ba96-25ad222a5a41 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:05.739839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2349f77-33b3-4874-ba96-25ad222a5a41 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:05.928680 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d2349f77-33b3-4874-ba96-25ad222a5a41 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.228529 Aug 04 16:55:05.929403 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 79/181] 10.222.0.93 () {60 vars in 1194 bytes} [Thu Aug 4 16:55:05 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:05.943945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-791f293f-2f96-40e9-a414-4cf4d3118537 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:05.944985 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:05.944985 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:05.980272 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-791f293f-2f96-40e9-a414-4cf4d3118537 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.040653 Aug 04 16:55:05.988843 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 80/182] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Aug 4 16:55:05 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 16:55:05.994881 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f4cc89f3-1741-4f0a-8db2-2c42fbb95692 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1564844718"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:05.998127 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:05.998127 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:05.999987 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.aggregate [None req-f4cc89f3-1741-4f0a-8db2-2c42fbb95692 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Generated uuid 6944894f-bb71-4081-9929-40ff27a7748c for aggregate {{(pid=131044) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:55:06.033575 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f4cc89f3-1741-4f0a-8db2-2c42fbb95692 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.042614 Aug 04 16:55:06.034501 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 81/183] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Aug 4 16:55:05 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:06.048772 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a36235d7-d4ce-46f5-ba91-4a33dc79c36e tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:06.050697 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a36235d7-d4ce-46f5-ba91-4a33dc79c36e tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:06.056770 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7,nova_api:DELETE=8 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:06.063689 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a36235d7-d4ce-46f5-ba91-4a33dc79c36e tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:06.065240 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a36235d7-d4ce-46f5-ba91-4a33dc79c36e tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:06.066114 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a36235d7-d4ce-46f5-ba91-4a33dc79c36e tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:06.067628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a36235d7-d4ce-46f5-ba91-4a33dc79c36e tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:06.068665 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a36235d7-d4ce-46f5-ba91-4a33dc79c36e tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:06.069320 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a36235d7-d4ce-46f5-ba91-4a33dc79c36e tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:06.149630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f2f4cacd-fb61-4592-93d5-9291c3ed6d11 tempest-QuotaClassesAdmin257Test-137344953 tempest-QuotaClassesAdmin257Test-137344953-project-admin] Calling method '.version_select at 0x7f1e680ddc10>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:06.150471 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:06.150471 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:55:06.171156 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f2f4cacd-fb61-4592-93d5-9291c3ed6d11 tempest-QuotaClassesAdmin257Test-137344953 tempest-QuotaClassesAdmin257Test-137344953-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.545657 Aug 04 16:55:06.178456 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 103/184] 10.222.0.93 () {60 vars in 1226 bytes} [Thu Aug 4 16:55:05 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:55:06.185772 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3f69899f-9800-4557-a3a3-08e6fe86f8e6 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-851359-3"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:06.189414 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:06.189414 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:55:06.206550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f69899f-9800-4557-a3a3-08e6fe86f8e6 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:06.208398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f69899f-9800-4557-a3a3-08e6fe86f8e6 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:06.208994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f69899f-9800-4557-a3a3-08e6fe86f8e6 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:06.257774 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a36235d7-d4ce-46f5-ba91-4a33dc79c36e tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:06.269010 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a36235d7-d4ce-46f5-ba91-4a33dc79c36e tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13" status: 200 len: 1390 microversion: 2.1 time: 0.227591 Aug 04 16:55:06.279435 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 82/185] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:06 2022] GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 => generated 1390 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:06.303840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e82bdab4-0585-41fb-8db8-5e5ab837de55 tempest-QuotaClassesAdmin257Test-137344953 tempest-QuotaClassesAdmin257Test-137344953-project-admin] Action: 'update', calling method: .version_select at 0x7f1e683ab790>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:06.312607 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:06.312607 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:06.449878 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3f69899f-9800-4557-a3a3-08e6fe86f8e6 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.269820 Aug 04 16:55:06.451464 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 104/186] 10.222.0.93 () {60 vars in 1194 bytes} [Thu Aug 4 16:55:06 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:06.662217 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e82bdab4-0585-41fb-8db8-5e5ab837de55 tempest-QuotaClassesAdmin257Test-137344953 tempest-QuotaClassesAdmin257Test-137344953-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.380146 Aug 04 16:55:06.665187 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 83/187] 10.222.0.93 () {62 vars in 1247 bytes} [Thu Aug 4 16:55:06 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:55:06.679432 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-008bebe0-342f-4f83-a1cf-9562e17d62c5 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-851359-3"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:06.682524 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:06.682524 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:06.692985 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-008bebe0-342f-4f83-a1cf-9562e17d62c5 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:06.693652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-008bebe0-342f-4f83-a1cf-9562e17d62c5 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:06.694233 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-008bebe0-342f-4f83-a1cf-9562e17d62c5 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:06.881715 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-008bebe0-342f-4f83-a1cf-9562e17d62c5 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.213045 Aug 04 16:55:06.891215 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 84/188] 10.222.0.93 () {60 vars in 1194 bytes} [Thu Aug 4 16:55:06 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:06.907299 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1237ce4c-51ff-4f3f-80b0-41aa1fc6f9a5 tempest-QuotaClassesAdmin257Test-137344953 tempest-QuotaClassesAdmin257Test-137344953-project-admin] Calling method '.version_select at 0x7f1e6810b280>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:06.908642 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:06.908642 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:06.943727 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1237ce4c-51ff-4f3f-80b0-41aa1fc6f9a5 tempest-QuotaClassesAdmin257Test-137344953 tempest-QuotaClassesAdmin257Test-137344953-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.049714 Aug 04 16:55:06.946630 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 85/189] 10.222.0.93 () {60 vars in 1226 bytes} [Thu Aug 4 16:55:06 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:55:06.953857 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-06882a59-e3d3-4716-aa9a-837a06d35231 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:06.955150 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:06.955150 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:06.970300 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a2b3d38c-d368-4592-974c-257d13dc69ed tempest-FlavorsV2NegativeTest-1785985957 tempest-FlavorsV2NegativeTest-1785985957-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:07.010207 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a2b3d38c-d368-4592-974c-257d13dc69ed tempest-FlavorsV2NegativeTest-1785985957 tempest-FlavorsV2NegativeTest-1785985957-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.556690 Aug 04 16:55:07.015483 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-06882a59-e3d3-4716-aa9a-837a06d35231 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.067266 Aug 04 16:55:07.028160 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 86/190] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Aug 4 16:55:06 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 16:55:07.031462 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 105/191] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Aug 4 16:55:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:07.043377 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8d3e658d-c2b0-4b5f-8735-782a0b2bd1ce tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1866995392"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:07.047317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-410a1056-c1d5-4514-8112-ce6e315d0a2f tempest-QuotaClassesAdmin257Test-137344953 tempest-QuotaClassesAdmin257Test-137344953-project-admin] Action: 'update', calling method: .version_select at 0x7f1e6814ee50>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:07.051615 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:07.051615 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:55:07.053775 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:07.053775 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:07.054826 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.aggregate [None req-8d3e658d-c2b0-4b5f-8735-782a0b2bd1ce tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Generated uuid 4c433051-5e3d-4272-9d26-46f01e2e29ca for aggregate {{(pid=131043) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:55:07.105807 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8d3e658d-c2b0-4b5f-8735-782a0b2bd1ce tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.072053 Aug 04 16:55:07.106467 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 106/192] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Aug 4 16:55:07 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:07.119523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-75555215-21a9-49c8-a1e3-b5e3e08030af tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:07.120675 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:07.120675 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:55:07.173536 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-75555215-21a9-49c8-a1e3-b5e3e08030af tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.054585 Aug 04 16:55:07.173536 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 107/193] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Aug 4 16:55:07 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 04 16:55:07.184450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-13afc75f-8a56-400b-ad86-5ce38611e6e4 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1817325357"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:07.190617 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:07.190617 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:55:07.191782 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.aggregate [None req-13afc75f-8a56-400b-ad86-5ce38611e6e4 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Generated uuid 050fb3e0-70b0-4899-a9bd-0c0a6bc050da for aggregate {{(pid=131043) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:55:07.213667 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-410a1056-c1d5-4514-8112-ce6e315d0a2f tempest-QuotaClassesAdmin257Test-137344953 tempest-QuotaClassesAdmin257Test-137344953-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.182798 Aug 04 16:55:07.216597 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 87/194] 10.222.0.93 () {62 vars in 1247 bytes} [Thu Aug 4 16:55:07 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:55:07.227328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-26a5ed33-0825-4744-94dd-7a67932fefcd tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:07.232110 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:07.232110 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:07.242414 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-13afc75f-8a56-400b-ad86-5ce38611e6e4 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.071383 Aug 04 16:55:07.249727 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-26a5ed33-0825-4744-94dd-7a67932fefcd tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Aug 04 16:55:07.252048 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 108/195] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Aug 4 16:55:07 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:07.252441 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-26a5ed33-0825-4744-94dd-7a67932fefcd tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Request method failure captured: Aug 04 16:55:07.252441 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Aug 04 16:55:07.252441 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:55:07.252441 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:55:07.252441 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:55:07.252441 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:55:07.252441 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:55:07.252441 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:55:07.252441 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:55:07.252441 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:07.252441 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_nBGl7OQR5nx2aU8gBHkYL9As24EZ3gMgRG5101rwCKT5iwTGLbPjVEzBxRLpyQA5QoUTIryH_DUY1ZPD4IY4aUoDb9CT2xMVGC0HUrSiDRM1VcxuG7JICwfn_GwCFpRaBeEBx7qMIEMf2WYzNd42CW0g11svy4kVyGxqiJqOnMyXw Aug 04 16:55:07.252441 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:55:07.252441 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:55:07.252441 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:55:07.252441 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:55:07.252441 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:55:07.252441 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:55:07.252441 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 5a656b9ae0354ab38560246937638dd3 Aug 04 16:55:07.252441 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-AggregatesAdminTestJSON-948166685 Aug 04 16:55:07.252441 n-d-851359-3 devstack@n-api.service[131044]: X-Role: admin,member,reader Aug 04 16:55:07.252441 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: admin,member,reader Aug 04 16:55:07.253672 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5a656b9ae0354ab38560246937638dd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5a656b9ae0354ab38560246937638dd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5a656b9ae0354ab38560246937638dd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5a656b9ae0354ab38560246937638dd3"}]}] Aug 04 16:55:07.253672 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-AggregatesAdminTestJSON-948166685 Aug 04 16:55:07.253672 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 5a656b9ae0354ab38560246937638dd3 Aug 04 16:55:07.253672 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-948166685 Aug 04 16:55:07.253672 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-AggregatesAdminTestJSON-948166685-project-admin Aug 04 16:55:07.253672 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:55:07.253672 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:55:07.253672 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: edab05d552c64ed7bdaea84328a68276 Aug 04 16:55:07.253672 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-AggregatesAdminTestJSON-948166685-project-admin Aug 04 16:55:07.253672 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:55:07.253672 n-d-851359-3 devstack@n-api.service[131044]: exception: Aggregate 12 could not be found. Aug 04 16:55:07.253672 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '12'} Aug 04 16:55:07.253672 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:07.254464 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:07.254464 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 04 16:55:07.254464 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 04 16:55:07.254464 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Aug 04 16:55:07.254464 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 04 16:55:07.254464 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:55:07.254464 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:55:07.254464 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 04 16:55:07.254464 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 04 16:55:07.254464 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:55:07.254464 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:55:07.254464 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 04 16:55:07.254464 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 04 16:55:07.254464 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Aug 04 16:55:07.254464 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:07.254464 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:07.254464 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:07.254464 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:07.254464 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:07.256164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:07.256164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:07.256164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:07.256164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:07.256164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:07.256164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 04 16:55:07.256164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:55:07.256164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Aug 04 16:55:07.256164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:07.256164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:07.256164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:07.256164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:07.256164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:07.256164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:07.256164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:55:07.256164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:55:07.256164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Aug 04 16:55:07.256164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:07.258830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e92cb7b7-7096-428c-a7c8-9c861db62ef7 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-851359-3"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:07.260760 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-26a5ed33-0825-4744-94dd-7a67932fefcd tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:07.262211 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-26a5ed33-0825-4744-94dd-7a67932fefcd tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.044286 Aug 04 16:55:07.265166 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:07.265166 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:55:07.267273 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 88/196] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Aug 4 16:55:07 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:55:07.277268 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-59f93d06-12b9-4689-85b2-a37967f951c4 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:07.280212 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:07.280212 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:07.282944 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e92cb7b7-7096-428c-a7c8-9c861db62ef7 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:07.284038 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e92cb7b7-7096-428c-a7c8-9c861db62ef7 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:07.284488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e92cb7b7-7096-428c-a7c8-9c861db62ef7 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:07.311790 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-59f93d06-12b9-4689-85b2-a37967f951c4 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Aug 04 16:55:07.313735 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-59f93d06-12b9-4689-85b2-a37967f951c4 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Request method failure captured: Aug 04 16:55:07.313735 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Aug 04 16:55:07.313735 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:55:07.313735 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:55:07.313735 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:55:07.313735 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:55:07.313735 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:55:07.313735 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:55:07.313735 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:55:07.313735 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:07.313735 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_nBGl7OQR5nx2aU8gBHkYL9As24EZ3gMgRG5101rwCKT5iwTGLbPjVEzBxRLpyQA5QoUTIryH_DUY1ZPD4IY4aUoDb9CT2xMVGC0HUrSiDRM1VcxuG7JICwfn_GwCFpRaBeEBx7qMIEMf2WYzNd42CW0g11svy4kVyGxqiJqOnMyXw Aug 04 16:55:07.313735 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:55:07.313735 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:55:07.313735 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:55:07.313735 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:55:07.313735 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:55:07.313735 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:55:07.313735 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 5a656b9ae0354ab38560246937638dd3 Aug 04 16:55:07.313735 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-AggregatesAdminTestJSON-948166685 Aug 04 16:55:07.313735 n-d-851359-3 devstack@n-api.service[131044]: X-Role: admin,member,reader Aug 04 16:55:07.313735 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: admin,member,reader Aug 04 16:55:07.320693 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5a656b9ae0354ab38560246937638dd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5a656b9ae0354ab38560246937638dd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5a656b9ae0354ab38560246937638dd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5a656b9ae0354ab38560246937638dd3"}]}] Aug 04 16:55:07.320693 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-AggregatesAdminTestJSON-948166685 Aug 04 16:55:07.320693 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 5a656b9ae0354ab38560246937638dd3 Aug 04 16:55:07.320693 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-948166685 Aug 04 16:55:07.320693 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-AggregatesAdminTestJSON-948166685-project-admin Aug 04 16:55:07.320693 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:55:07.320693 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:55:07.320693 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: edab05d552c64ed7bdaea84328a68276 Aug 04 16:55:07.320693 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-AggregatesAdminTestJSON-948166685-project-admin Aug 04 16:55:07.320693 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:55:07.320693 n-d-851359-3 devstack@n-api.service[131044]: exception: Aggregate 12 could not be found. Aug 04 16:55:07.320693 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '12'} Aug 04 16:55:07.320693 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:07.321531 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:07.321531 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 04 16:55:07.321531 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 04 16:55:07.321531 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 16:55:07.321531 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 16:55:07.321531 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:55:07.321531 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:55:07.321531 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:55:07.321531 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:55:07.321531 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 16:55:07.321531 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 16:55:07.321531 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Aug 04 16:55:07.321531 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 04 16:55:07.321531 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:55:07.321531 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:55:07.321531 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 04 16:55:07.321531 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 04 16:55:07.321531 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:55:07.321531 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:55:07.322768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 04 16:55:07.322768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 04 16:55:07.322768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Aug 04 16:55:07.322768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:07.322768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:07.322768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:07.322768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:07.322768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:07.322768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:07.322768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:07.322768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:07.322768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:07.322768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:07.322768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 04 16:55:07.322768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:55:07.322768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Aug 04 16:55:07.322768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:07.322768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:07.322768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:07.322768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:07.322768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:07.324091 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:07.324091 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:55:07.324091 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:55:07.324091 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Aug 04 16:55:07.324091 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:07.324091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-59f93d06-12b9-4689-85b2-a37967f951c4 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:07.324091 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-59f93d06-12b9-4689-85b2-a37967f951c4 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.045867 Aug 04 16:55:07.324091 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 89/197] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Aug 4 16:55:07 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:55:07.345997 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d1649ca9-3a3e-4bf8-8bdd-265f7aee323f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:07.347670 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d1649ca9-3a3e-4bf8-8bdd-265f7aee323f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:07.387301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1649ca9-3a3e-4bf8-8bdd-265f7aee323f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:07.387805 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1649ca9-3a3e-4bf8-8bdd-265f7aee323f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:07.388247 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1649ca9-3a3e-4bf8-8bdd-265f7aee323f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:07.388984 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1649ca9-3a3e-4bf8-8bdd-265f7aee323f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:07.389445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1649ca9-3a3e-4bf8-8bdd-265f7aee323f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:07.389915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1649ca9-3a3e-4bf8-8bdd-265f7aee323f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:07.506196 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e92cb7b7-7096-428c-a7c8-9c861db62ef7 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 243 microversion: 2.1 time: 0.252453 Aug 04 16:55:07.506920 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 109/198] 10.222.0.93 () {60 vars in 1194 bytes} [Thu Aug 4 16:55:07 2022] POST /compute/v2.1/os-aggregates/13/action => generated 243 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:07.513779 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-75dc65ec-9ac4-4f2a-9876-9fd153f1cc0e tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1662795633", "name": "tempest-test_aggregate-96202471"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:07.560933 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:07.560933 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:55:07.565462 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.aggregate [None req-75dc65ec-9ac4-4f2a-9876-9fd153f1cc0e tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Generated uuid bce2cdf1-b1ca-4ae3-9baf-df993cff71b8 for aggregate {{(pid=131043) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:55:07.631352 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-75dc65ec-9ac4-4f2a-9876-9fd153f1cc0e tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.123030 Aug 04 16:55:07.639391 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 110/199] 10.222.0.93 () {60 vars in 1165 bytes} [Thu Aug 4 16:55:07 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:07.716248 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:07.950707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d1649ca9-3a3e-4bf8-8bdd-265f7aee323f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:07.964054 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d1649ca9-3a3e-4bf8-8bdd-265f7aee323f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13" status: 200 len: 1390 microversion: 2.1 time: 0.636986 Aug 04 16:55:07.964673 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 90/200] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:07 2022] GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 => generated 1390 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:07.977311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-648b6231-501e-421f-a38c-4b8a404d86a4 tempest-AggregatesAdminNegativeTestJSON-1831622130 tempest-AggregatesAdminNegativeTestJSON-1831622130-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-851359-3"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:07.982774 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:07.982774 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:07.984012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-648b6231-501e-421f-a38c-4b8a404d86a4 tempest-AggregatesAdminNegativeTestJSON-1831622130 tempest-AggregatesAdminNegativeTestJSON-1831622130-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'da896ceda2834cf7ad1a2b8455f23011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38ad8607d9644d27a7eddc445e5e9a22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:07.986453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-648b6231-501e-421f-a38c-4b8a404d86a4 tempest-AggregatesAdminNegativeTestJSON-1831622130 tempest-AggregatesAdminNegativeTestJSON-1831622130-project] Request method failure captured: Aug 04 16:55:07.986453 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Aug 04 16:55:07.986453 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:55:07.986453 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:55:07.986453 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:55:07.986453 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 42 Aug 04 16:55:07.986453 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:55:07.986453 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:55:07.986453 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:55:07.986453 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:07.986453 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_m7ZgpBume-THBRExitgIUBRWb7q0NC7TDQnv5PunLtwyzUVx4jUKorqLbad6Mer9iaP3b2t9XiPOAiG918F1vOx44KzEVQLr8vhaY1i5KsE780Vdi5j5pTbT9ZaFJiTNUA7IhAec0gy3WNOZmVckC5xDMmGJ9QjO2xzGGX1f91a7g Aug 04 16:55:07.986453 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:55:07.986453 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:55:07.986453 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:55:07.986453 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:55:07.986453 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:55:07.986453 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:55:07.986453 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 38ad8607d9644d27a7eddc445e5e9a22 Aug 04 16:55:07.986453 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1831622130 Aug 04 16:55:07.986453 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:55:07.986453 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:55:07.987780 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/38ad8607d9644d27a7eddc445e5e9a22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/38ad8607d9644d27a7eddc445e5e9a22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_38ad8607d9644d27a7eddc445e5e9a22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/38ad8607d9644d27a7eddc445e5e9a22"}]}] Aug 04 16:55:07.987780 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1831622130 Aug 04 16:55:07.987780 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 38ad8607d9644d27a7eddc445e5e9a22 Aug 04 16:55:07.987780 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1831622130 Aug 04 16:55:07.987780 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-AggregatesAdminNegativeTestJSON-1831622130-project Aug 04 16:55:07.987780 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:55:07.987780 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:55:07.987780 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: da896ceda2834cf7ad1a2b8455f23011 Aug 04 16:55:07.987780 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1831622130-project Aug 04 16:55:07.987780 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 16:55:07.987780 n-d-851359-3 devstack@n-api.service[131044]: {"remove_host": {"host": "n-h1-851359-3"}} Aug 04 16:55:07.987780 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:55:07.987780 n-d-851359-3 devstack@n-api.service[131044]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 04 16:55:07.988634 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h1-851359-3'}}} Aug 04 16:55:07.988634 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:07.988634 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:07.988634 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:07.988634 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:07.988634 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:07.988634 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:07.988634 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:07.988634 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:07.988634 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:55:07.988634 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:55:07.988634 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 04 16:55:07.988634 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 04 16:55:07.988634 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:55:07.988634 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:55:07.988634 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:55:07.988634 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:55:07.988634 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:55:07.988634 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:55:07.990686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:55:07.990686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:55:07.990686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:55:07.990686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:55:07.990686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:55:07.990686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:55:07.990686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:55:07.990686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:55:07.990686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 04 16:55:07.990686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:07.990686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:07.990686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:07.990686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:07.990686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:07.990686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:07.990686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:55:07.990686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:55:07.990686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 04 16:55:07.990686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:07.993039 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-648b6231-501e-421f-a38c-4b8a404d86a4 tempest-AggregatesAdminNegativeTestJSON-1831622130 tempest-AggregatesAdminNegativeTestJSON-1831622130-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:07.994076 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-648b6231-501e-421f-a38c-4b8a404d86a4 tempest-AggregatesAdminNegativeTestJSON-1831622130 tempest-AggregatesAdminNegativeTestJSON-1831622130-project] 10.222.0.93 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.026454 Aug 04 16:55:07.996215 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 91/201] 10.222.0.93 () {60 vars in 1194 bytes} [Thu Aug 4 16:55:07 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:55:08.002165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-593bc9ab-ecd6-4771-ac7d-e17f4d3e74f5 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:08.005368 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:08.005368 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:08.043849 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-593bc9ab-ecd6-4771-ac7d-e17f4d3e74f5 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.044307 Aug 04 16:55:08.047383 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 92/202] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Aug 4 16:55:07 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 16:55:08.061772 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-927279a5-bc7a-4f20-971d-e4979adba924 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-851359-3"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:08.065657 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:08.065657 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:08.077204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-927279a5-bc7a-4f20-971d-e4979adba924 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:08.078158 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-927279a5-bc7a-4f20-971d-e4979adba924 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:08.078775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-927279a5-bc7a-4f20-971d-e4979adba924 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:08.128494 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f023cca7-a628-4310-88bd-6b1b0190b786 tempest-FlavorsV261TestJSON-229979613 tempest-FlavorsV261TestJSON-229979613-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1161163978", "id": 1728440172, "os-flavor-access:is_public": "True"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:08.132201 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:08.132201 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:55:08.172585 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f023cca7-a628-4310-88bd-6b1b0190b786 tempest-FlavorsV261TestJSON-229979613 tempest-FlavorsV261TestJSON-229979613-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.531718 Aug 04 16:55:08.173697 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 111/203] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Aug 4 16:55:07 2022] POST /compute/v2.1/flavors => generated 468 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:55:08.194524 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-292790c0-8799-426c-aae4-7e109617b172 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:08.195497 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:08.195497 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:55:08.208755 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-292790c0-8799-426c-aae4-7e109617b172 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Aug 04 16:55:08.218243 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-292790c0-8799-426c-aae4-7e109617b172 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Request method failure captured: Aug 04 16:55:08.218243 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Aug 04 16:55:08.218243 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:55:08.218243 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:55:08.218243 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:55:08.218243 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:55:08.218243 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:55:08.218243 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:55:08.218243 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:55:08.218243 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:08.218243 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_nBGl7OQR5nx2aU8gBHkYL9As24EZ3gMgRG5101rwCKT5iwTGLbPjVEzBxRLpyQA5QoUTIryH_DUY1ZPD4IY4aUoDb9CT2xMVGC0HUrSiDRM1VcxuG7JICwfn_GwCFpRaBeEBx7qMIEMf2WYzNd42CW0g11svy4kVyGxqiJqOnMyXw Aug 04 16:55:08.218243 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:55:08.218243 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:55:08.218243 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:55:08.218243 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:55:08.218243 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:55:08.218243 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:55:08.218243 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 5a656b9ae0354ab38560246937638dd3 Aug 04 16:55:08.218243 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-AggregatesAdminTestJSON-948166685 Aug 04 16:55:08.218243 n-d-851359-3 devstack@n-api.service[131043]: X-Role: admin,member,reader Aug 04 16:55:08.218243 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: admin,member,reader Aug 04 16:55:08.219573 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5a656b9ae0354ab38560246937638dd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5a656b9ae0354ab38560246937638dd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5a656b9ae0354ab38560246937638dd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5a656b9ae0354ab38560246937638dd3"}]}] Aug 04 16:55:08.219573 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-AggregatesAdminTestJSON-948166685 Aug 04 16:55:08.219573 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 5a656b9ae0354ab38560246937638dd3 Aug 04 16:55:08.219573 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-948166685 Aug 04 16:55:08.219573 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-AggregatesAdminTestJSON-948166685-project-admin Aug 04 16:55:08.219573 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:55:08.219573 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:55:08.219573 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: edab05d552c64ed7bdaea84328a68276 Aug 04 16:55:08.219573 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-AggregatesAdminTestJSON-948166685-project-admin Aug 04 16:55:08.219573 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 16:55:08.219573 n-d-851359-3 devstack@n-api.service[131043]: exception: Aggregate 14 could not be found. Aug 04 16:55:08.219573 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '14'} Aug 04 16:55:08.219573 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:08.220368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:08.220368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 04 16:55:08.220368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 04 16:55:08.220368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Aug 04 16:55:08.220368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 04 16:55:08.220368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:55:08.220368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:55:08.220368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 04 16:55:08.220368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 04 16:55:08.220368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:55:08.220368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:55:08.220368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 04 16:55:08.220368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 04 16:55:08.220368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Aug 04 16:55:08.220368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:08.220368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:08.220368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:08.220368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:08.220368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:08.221571 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:08.221571 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:08.221571 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:08.221571 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:08.221571 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:08.221571 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 04 16:55:08.221571 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:55:08.221571 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Aug 04 16:55:08.221571 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:08.221571 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:08.221571 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:08.221571 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:08.221571 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:08.221571 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:08.221571 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:55:08.221571 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:55:08.221571 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Aug 04 16:55:08.221571 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:08.223000 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-292790c0-8799-426c-aae4-7e109617b172 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:08.223000 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-292790c0-8799-426c-aae4-7e109617b172 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.030555 Aug 04 16:55:08.223000 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 112/204] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Aug 4 16:55:08 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:55:08.253997 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-927279a5-bc7a-4f20-971d-e4979adba924 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 228 microversion: 2.1 time: 0.201992 Aug 04 16:55:08.256791 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 93/205] 10.222.0.93 () {60 vars in 1194 bytes} [Thu Aug 4 16:55:08 2022] POST /compute/v2.1/os-aggregates/13/action => generated 228 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:08.265293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7c5d88d3-9093-4a52-b241-e5294acb9cd6 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:08.268012 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:08.268012 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:08.283384 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-7c5d88d3-9093-4a52-b241-e5294acb9cd6 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Aug 04 16:55:08.286509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7c5d88d3-9093-4a52-b241-e5294acb9cd6 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Request method failure captured: Aug 04 16:55:08.286509 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Aug 04 16:55:08.286509 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:55:08.286509 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:55:08.286509 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:55:08.286509 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:55:08.286509 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:55:08.286509 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:55:08.286509 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:55:08.286509 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:08.286509 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_nBGl7OQR5nx2aU8gBHkYL9As24EZ3gMgRG5101rwCKT5iwTGLbPjVEzBxRLpyQA5QoUTIryH_DUY1ZPD4IY4aUoDb9CT2xMVGC0HUrSiDRM1VcxuG7JICwfn_GwCFpRaBeEBx7qMIEMf2WYzNd42CW0g11svy4kVyGxqiJqOnMyXw Aug 04 16:55:08.286509 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:55:08.286509 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:55:08.286509 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:55:08.286509 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:55:08.286509 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:55:08.286509 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:55:08.286509 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 5a656b9ae0354ab38560246937638dd3 Aug 04 16:55:08.286509 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-AggregatesAdminTestJSON-948166685 Aug 04 16:55:08.286509 n-d-851359-3 devstack@n-api.service[131044]: X-Role: admin,member,reader Aug 04 16:55:08.286509 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: admin,member,reader Aug 04 16:55:08.288055 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5a656b9ae0354ab38560246937638dd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5a656b9ae0354ab38560246937638dd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5a656b9ae0354ab38560246937638dd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5a656b9ae0354ab38560246937638dd3"}]}] Aug 04 16:55:08.288055 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-AggregatesAdminTestJSON-948166685 Aug 04 16:55:08.288055 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 5a656b9ae0354ab38560246937638dd3 Aug 04 16:55:08.288055 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-948166685 Aug 04 16:55:08.288055 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-AggregatesAdminTestJSON-948166685-project-admin Aug 04 16:55:08.288055 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:55:08.288055 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:55:08.288055 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: edab05d552c64ed7bdaea84328a68276 Aug 04 16:55:08.288055 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-AggregatesAdminTestJSON-948166685-project-admin Aug 04 16:55:08.288055 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:55:08.288055 n-d-851359-3 devstack@n-api.service[131044]: exception: Aggregate 14 could not be found. Aug 04 16:55:08.288055 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '14'} Aug 04 16:55:08.288055 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:08.288863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:08.288863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 04 16:55:08.288863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 04 16:55:08.288863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 16:55:08.288863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 16:55:08.288863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:55:08.288863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:55:08.288863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:55:08.288863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:55:08.288863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 16:55:08.288863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 16:55:08.288863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Aug 04 16:55:08.288863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 04 16:55:08.288863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:55:08.288863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:55:08.288863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 04 16:55:08.288863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 04 16:55:08.288863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:55:08.288863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:55:08.290117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 04 16:55:08.290117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 04 16:55:08.290117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Aug 04 16:55:08.290117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:08.290117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:08.290117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:08.290117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:08.290117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:08.290117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:08.290117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:08.290117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:08.290117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:08.290117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:08.290117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 04 16:55:08.290117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:55:08.290117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Aug 04 16:55:08.290117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:08.290117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:08.290117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:08.290117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:08.290117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:08.293155 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:08.293155 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:55:08.293155 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:55:08.293155 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Aug 04 16:55:08.293155 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:08.293155 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7c5d88d3-9093-4a52-b241-e5294acb9cd6 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:08.293155 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7c5d88d3-9093-4a52-b241-e5294acb9cd6 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.030005 Aug 04 16:55:08.293155 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 94/206] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Aug 4 16:55:08 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:55:08.298405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-344f90a5-edcd-4624-b091-fe02d6316e45 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:08.338333 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-344f90a5-edcd-4624-b091-fe02d6316e45 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.044287 Aug 04 16:55:08.339910 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 95/207] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Aug 4 16:55:08 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 16:55:08.349644 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3129fa63-7a73-401b-8574-b9ef3c4f334a tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2003008302"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:08.363586 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:08.363586 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:08.364986 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.aggregate [None req-3129fa63-7a73-401b-8574-b9ef3c4f334a tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Generated uuid 6bca0990-a59f-4e68-a34e-b94943e21df3 for aggregate {{(pid=131044) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:55:08.416348 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3129fa63-7a73-401b-8574-b9ef3c4f334a tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.073650 Aug 04 16:55:08.417375 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 96/208] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Aug 4 16:55:08 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:08.427709 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0dfe7a5e-27aa-4bc2-ba8a-1b9cb7602986 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2089530065"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:08.430432 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:08.430432 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:08.431356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.aggregate [None req-0dfe7a5e-27aa-4bc2-ba8a-1b9cb7602986 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Generated uuid f080d614-1a11-40fc-961f-7c56d61e87d8 for aggregate {{(pid=131044) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:55:08.446638 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=14,nova_api:INSERT=9,nova_api:DELETE=8 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:08.474041 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0dfe7a5e-27aa-4bc2-ba8a-1b9cb7602986 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.054916 Aug 04 16:55:08.474657 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 97/209] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Aug 4 16:55:08 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:08.490067 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e833ffd3-4b06-488f-aa98-fb2d4e557bb0 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:08.491180 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:08.491180 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:08.502947 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e833ffd3-4b06-488f-aa98-fb2d4e557bb0 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 228 microversion: 2.1 time: 0.026174 Aug 04 16:55:08.508002 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 98/210] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Aug 4 16:55:08 2022] GET /compute/v2.1/os-aggregates/15 => generated 228 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:08.513465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0c75d0d0-41a6-43ca-867f-bc3655708d16 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:08.522248 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:08.522248 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:08.538775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c75d0d0-41a6-43ca-867f-bc3655708d16 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:08.539239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c75d0d0-41a6-43ca-867f-bc3655708d16 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:08.539669 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c75d0d0-41a6-43ca-867f-bc3655708d16 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:08.571027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c75d0d0-41a6-43ca-867f-bc3655708d16 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:08.571551 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c75d0d0-41a6-43ca-867f-bc3655708d16 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:08.571969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c75d0d0-41a6-43ca-867f-bc3655708d16 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:08.584964 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.compute.aggregates [None req-0c75d0d0-41a6-43ca-867f-bc3655708d16 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Failed to remove host nonexist_host from aggregate 16. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 04 16:55:08.585499 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-0c75d0d0-41a6-43ca-867f-bc3655708d16 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 16 Aug 04 16:55:08.587587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0c75d0d0-41a6-43ca-867f-bc3655708d16 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Request method failure captured: Aug 04 16:55:08.587587 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/os-aggregates/16/action HTTP/1.1 Aug 04 16:55:08.587587 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:55:08.587587 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:55:08.587587 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:55:08.587587 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 42 Aug 04 16:55:08.587587 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:55:08.587587 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:55:08.587587 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:55:08.587587 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:08.587587 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_m9Tv6QiivKEMChPpOLItHNNFsJXscm9k7GEUP1tWt-LzWbhM_1l9-QMLVNME1zq-Fzx7y8xp3UA45wgOR5vud8QzK6C3YOwuoDZYJfXQVceavqnx2TU2ERCZrq2KXRjmXspKqKxfqBALs4mmoW5_PLA_XHYMRtX5Nd-40A4a-KKFw Aug 04 16:55:08.587587 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:55:08.587587 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:55:08.587587 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:55:08.587587 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:55:08.587587 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:55:08.587587 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:55:08.587587 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: c0ff0891bc7f431dad4e3c76db7dcd0e Aug 04 16:55:08.587587 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1218587882 Aug 04 16:55:08.587587 n-d-851359-3 devstack@n-api.service[131044]: X-Role: admin,member,reader Aug 04 16:55:08.587587 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: admin,member,reader Aug 04 16:55:08.588840 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c0ff0891bc7f431dad4e3c76db7dcd0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c0ff0891bc7f431dad4e3c76db7dcd0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c0ff0891bc7f431dad4e3c76db7dcd0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c0ff0891bc7f431dad4e3c76db7dcd0e"}]}] Aug 04 16:55:08.588840 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1218587882 Aug 04 16:55:08.588840 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: c0ff0891bc7f431dad4e3c76db7dcd0e Aug 04 16:55:08.588840 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1218587882 Aug 04 16:55:08.588840 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin Aug 04 16:55:08.588840 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:55:08.588840 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:55:08.588840 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 7d62c764c03e49499952b26f619ed6ef Aug 04 16:55:08.588840 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin Aug 04 16:55:08.588840 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 16:55:08.588840 n-d-851359-3 devstack@n-api.service[131044]: {"remove_host": {"host": "nonexist_host"}} Aug 04 16:55:08.588840 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:55:08.588840 n-d-851359-3 devstack@n-api.service[131044]: exception: Cannot remove host nonexist_host in aggregate 16 Aug 04 16:55:08.589545 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '16', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 04 16:55:08.589545 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:08.589545 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:08.589545 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5949, in _get_service_in_cell_by_host Aug 04 16:55:08.589545 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 04 16:55:08.589545 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:55:08.589545 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:55:08.589545 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 04 16:55:08.589545 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 04 16:55:08.589545 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:55:08.589545 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:55:08.589545 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 04 16:55:08.589545 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 04 16:55:08.589545 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 04 16:55:08.589545 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:08.589545 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:08.589545 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:08.589545 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:08.589545 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5955, in _get_service_in_cell_by_host Aug 04 16:55:08.589545 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 04 16:55:08.590791 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 04 16:55:08.590791 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 04 16:55:08.590791 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 04 16:55:08.590791 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:08.590791 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:08.590791 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:08.590791 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:08.590791 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 04 16:55:08.590791 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 04 16:55:08.590791 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 16:55:08.590791 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 16:55:08.590791 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:55:08.590791 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:55:08.590791 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:55:08.590791 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:55:08.590791 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 16:55:08.590791 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 16:55:08.590791 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6636, in remove_host_from_aggregate Aug 04 16:55:08.590791 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 04 16:55:08.590791 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5957, in _get_service_in_cell_by_host Aug 04 16:55:08.592079 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 04 16:55:08.592079 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 04 16:55:08.592079 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:08.592079 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:08.592079 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:08.592079 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:08.592079 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:08.592079 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:08.592079 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:08.592079 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:08.592079 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:08.592079 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:08.592079 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:55:08.592079 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:55:08.592079 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 04 16:55:08.592079 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 16:55:08.592079 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 16 Aug 04 16:55:08.592079 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:08.592079 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:08.592079 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:08.592079 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:08.593197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:08.593197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:08.593197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:55:08.593197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:55:08.593197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 16 Aug 04 16:55:08.593197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:08.593197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0c75d0d0-41a6-43ca-867f-bc3655708d16 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 16 {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:08.594792 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0c75d0d0-41a6-43ca-867f-bc3655708d16 tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/16/action" status: 404 len: 94 microversion: 2.1 time: 0.079781 Aug 04 16:55:08.595637 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 99/211] 10.222.0.93 () {60 vars in 1194 bytes} [Thu Aug 4 16:55:08 2022] POST /compute/v2.1/os-aggregates/16/action => generated 94 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:55:08.603746 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-486a667d-f902-40d9-bbcb-c3aebf477e81 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:08.610088 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:08.610088 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:08.656334 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-486a667d-f902-40d9-bbcb-c3aebf477e81 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 266 microversion: 2.1 time: 0.059326 Aug 04 16:55:08.656919 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 100/212] 10.222.0.93 () {60 vars in 1194 bytes} [Thu Aug 4 16:55:08 2022] POST /compute/v2.1/os-aggregates/15/action => generated 266 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:08.661850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-506ce351-3b2a-4131-93db-3e8ffa1fcefd tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:08.666830 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:08.666830 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:08.708098 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-506ce351-3b2a-4131-93db-3e8ffa1fcefd tempest-AggregatesAdminNegativeTestJSON-1218587882 tempest-AggregatesAdminNegativeTestJSON-1218587882-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.049339 Aug 04 16:55:08.714646 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 101/213] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Aug 4 16:55:08 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 16:55:08.720131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dac19048-aae3-4034-bb3e-c145ee369179 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:08.721614 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:08.721614 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:08.735311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ac51d7a3-331e-4ac8-8592-58c8ac4f564d tempest-FlavorsV261TestJSON-1241500571 tempest-FlavorsV261TestJSON-1241500571-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:08.738862 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dac19048-aae3-4034-bb3e-c145ee369179 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 242 microversion: 2.1 time: 0.022504 Aug 04 16:55:08.739788 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 102/214] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Aug 4 16:55:08 2022] GET /compute/v2.1/os-aggregates/15 => generated 242 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:08.757400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b6a80dd5-ecbe-4be6-bd24-22febd20c2df tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:08.757803 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:08.757803 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:08.777613 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ac51d7a3-331e-4ac8-8592-58c8ac4f564d tempest-FlavorsV261TestJSON-1241500571 tempest-FlavorsV261TestJSON-1241500571-project] 10.222.0.93 "GET /compute/v2.1/flavors/1728440172" status: 200 len: 468 microversion: 2.61 time: 0.554594 Aug 04 16:55:08.790414 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 113/215] 10.222.0.93 () {60 vars in 1199 bytes} [Thu Aug 4 16:55:08 2022] GET /compute/v2.1/flavors/1728440172 => generated 468 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:55:08.804743 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ea1df4b9-13cb-4492-a784-870aa9a3e751 tempest-FlavorsV261TestJSON-229979613 tempest-FlavorsV261TestJSON-229979613-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:08.807812 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b6a80dd5-ecbe-4be6-bd24-22febd20c2df tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.060210 Aug 04 16:55:08.815221 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 103/216] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Aug 4 16:55:08 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 16:55:08.825221 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:08.825221 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:55:08.827440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-34c70b74-3060-42ea-be10-d2ffde655495 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-903600120", "availability_zone": "tempest-test_az-55148300"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:08.891838 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ea1df4b9-13cb-4492-a784-870aa9a3e751 tempest-FlavorsV261TestJSON-229979613 tempest-FlavorsV261TestJSON-229979613-project-admin] 10.222.0.93 "PUT /compute/v2.1/flavors/1728440172" status: 200 len: 469 microversion: 2.61 time: 0.092415 Aug 04 16:55:08.892544 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:08.892544 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:08.892905 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 114/217] 10.222.0.93 () {62 vars in 1219 bytes} [Thu Aug 4 16:55:08 2022] PUT /compute/v2.1/flavors/1728440172 => generated 469 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:55:08.893621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.aggregate [None req-34c70b74-3060-42ea-be10-d2ffde655495 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Generated uuid d4a45ed6-4167-49e6-9616-6d77313365f3 for aggregate {{(pid=131044) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:55:08.905591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9c2d3b7b-6716-4d54-96f6-825dbbe6c3d2 tempest-FlavorsV261TestJSON-1241500571 tempest-FlavorsV261TestJSON-1241500571-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:08.961535 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9c2d3b7b-6716-4d54-96f6-825dbbe6c3d2 tempest-FlavorsV261TestJSON-1241500571 tempest-FlavorsV261TestJSON-1241500571-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 7159 microversion: 2.61 time: 0.059728 Aug 04 16:55:08.962381 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 115/218] 10.222.0.93 () {60 vars in 1187 bytes} [Thu Aug 4 16:55:08 2022] GET /compute/v2.1/flavors/detail => generated 7159 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:55:08.985119 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f2db8207-2d5e-44ab-b7fc-21f42d5a1bfa tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:08.986341 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f2db8207-2d5e-44ab-b7fc-21f42d5a1bfa tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:08.999377 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2db8207-2d5e-44ab-b7fc-21f42d5a1bfa tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:09.002990 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2db8207-2d5e-44ab-b7fc-21f42d5a1bfa tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:09.006534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2db8207-2d5e-44ab-b7fc-21f42d5a1bfa tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:09.007421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2db8207-2d5e-44ab-b7fc-21f42d5a1bfa tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:09.008034 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2db8207-2d5e-44ab-b7fc-21f42d5a1bfa tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:09.008562 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2db8207-2d5e-44ab-b7fc-21f42d5a1bfa tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:09.016501 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-34c70b74-3060-42ea-be10-d2ffde655495 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.197354 Aug 04 16:55:09.017165 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 104/219] 10.222.0.93 () {60 vars in 1165 bytes} [Thu Aug 4 16:55:08 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:09.041585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2a5e64bb-e1c7-4b03-841a-34d0dc863cb5 tempest-FlavorsV261TestJSON-1241500571 tempest-FlavorsV261TestJSON-1241500571-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:09.112012 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2a5e64bb-e1c7-4b03-841a-34d0dc863cb5 tempest-FlavorsV261TestJSON-1241500571 tempest-FlavorsV261TestJSON-1241500571-project] 10.222.0.93 "GET /compute/v2.1/flavors" status: 200 len: 3686 microversion: 2.61 time: 0.078247 Aug 04 16:55:09.113112 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 105/220] 10.222.0.93 () {60 vars in 1166 bytes} [Thu Aug 4 16:55:09 2022] GET /compute/v2.1/flavors => generated 3686 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:09.120840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-623cbfa9-102b-4715-b23a-30c1d96a1939 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-903600120_new", "availability_zone": "tempest-test_az-55148300_new"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:09.133483 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:09.133483 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:09.178023 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-623cbfa9-102b-4715-b23a-30c1d96a1939 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:09.178613 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-623cbfa9-102b-4715-b23a-30c1d96a1939 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:09.179158 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-623cbfa9-102b-4715-b23a-30c1d96a1939 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:09.241011 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-623cbfa9-102b-4715-b23a-30c1d96a1939 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 332 microversion: 2.1 time: 0.126560 Aug 04 16:55:09.244192 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 106/221] 10.222.0.93 () {60 vars in 1173 bytes} [Thu Aug 4 16:55:09 2022] PUT /compute/v2.1/os-aggregates/17 => generated 332 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:09.257773 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=9 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:09.258119 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d6c1cc14-5210-4f42-a994-b9585b16bfbd tempest-FlavorsV261TestJSON-229979613 tempest-FlavorsV261TestJSON-229979613-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:09.263013 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:09.263013 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:09.349053 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d6c1cc14-5210-4f42-a994-b9585b16bfbd tempest-FlavorsV261TestJSON-229979613 tempest-FlavorsV261TestJSON-229979613-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1728440172" status: 202 len: 0 microversion: 2.61 time: 0.102552 Aug 04 16:55:09.353298 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 107/222] 10.222.0.93 () {60 vars in 1202 bytes} [Thu Aug 4 16:55:09 2022] DELETE /compute/v2.1/flavors/1728440172 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:55:09.366226 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e98ab573-3e02-43c4-8b58-b36197d78b43 tempest-FlavorsV2NegativeTest-1785985957 tempest-FlavorsV2NegativeTest-1785985957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-415318917", "imageRef": "d8041953-8ef8-4b1b-b028-c35683482da4", "flavorRef": "452"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:09.482054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-e98ab573-3e02-43c4-8b58-b36197d78b43 tempest-FlavorsV2NegativeTest-1785985957 tempest-FlavorsV2NegativeTest-1785985957-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:55:09.666805 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f2db8207-2d5e-44ab-b7fc-21f42d5a1bfa tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:09.683040 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f2db8207-2d5e-44ab-b7fc-21f42d5a1bfa tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13" status: 200 len: 1390 microversion: 2.1 time: 0.702100 Aug 04 16:55:09.684417 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 116/223] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:08 2022] GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 => generated 1390 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:09.689355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-27088bc3-8fe0-4647-b95e-cda7b750fdae tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:09.690136 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:09.690136 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:55:09.705568 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-27088bc3-8fe0-4647-b95e-cda7b750fdae tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates" status: 200 len: 335 microversion: 2.1 time: 0.019909 Aug 04 16:55:09.706212 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 117/224] 10.222.0.93 () {58 vars in 1143 bytes} [Thu Aug 4 16:55:09 2022] GET /compute/v2.1/os-aggregates => generated 335 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:09.720079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1fad482f-1625-49b5-b3a3-e51d2ca15b7c tempest-FlavorsV261TestJSON-229979613 tempest-FlavorsV261TestJSON-229979613-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:09.748894 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1fad482f-1625-49b5-b3a3-e51d2ca15b7c tempest-FlavorsV261TestJSON-229979613 tempest-FlavorsV261TestJSON-229979613-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 6700 microversion: 2.61 time: 0.041279 Aug 04 16:55:09.756180 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 118/225] 10.222.0.93 () {60 vars in 1187 bytes} [Thu Aug 4 16:55:09 2022] GET /compute/v2.1/flavors/detail => generated 6700 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:10.056801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c648b986-aa44-40b7-8902-dd73d062076c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-218825787", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:10.156056 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-e98ab573-3e02-43c4-8b58-b36197d78b43 tempest-FlavorsV2NegativeTest-1785985957 tempest-FlavorsV2NegativeTest-1785985957-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 04 16:55:10.158156 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e98ab573-3e02-43c4-8b58-b36197d78b43 tempest-FlavorsV2NegativeTest-1785985957 tempest-FlavorsV2NegativeTest-1785985957-project] Request method failure captured: Aug 04 16:55:10.158156 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 16:55:10.158156 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:55:10.158156 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:55:10.158156 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:55:10.158156 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 142 Aug 04 16:55:10.158156 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:55:10.158156 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:55:10.158156 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:55:10.158156 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:10.158156 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_nqhw96MTEhL6EuDlTYxX0l65oiUofBoxf-fNLmIOfh8nRHg831gxcc1vZQRuI3veeI6XHhAThxEBoyw-JY5OxrbhEhBe4Q1LRse_ytrXbBnQVLEA5QKr2LBVgrX3hOU2NmUUsCp63GRhbxQ5_kNDqk-W0iL_pF0eyhBr48iOQpzkA Aug 04 16:55:10.158156 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:55:10.158156 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:55:10.158156 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:55:10.158156 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:55:10.158156 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:55:10.158156 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:55:10.158156 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: bd45cfe4b7444ed1a01f8a3d76f4b9f2 Aug 04 16:55:10.158156 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-FlavorsV2NegativeTest-1785985957 Aug 04 16:55:10.158156 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:55:10.158156 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:55:10.159461 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/bd45cfe4b7444ed1a01f8a3d76f4b9f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/bd45cfe4b7444ed1a01f8a3d76f4b9f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_bd45cfe4b7444ed1a01f8a3d76f4b9f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/bd45cfe4b7444ed1a01f8a3d76f4b9f2"}]}] Aug 04 16:55:10.159461 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-FlavorsV2NegativeTest-1785985957 Aug 04 16:55:10.159461 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: bd45cfe4b7444ed1a01f8a3d76f4b9f2 Aug 04 16:55:10.159461 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1785985957 Aug 04 16:55:10.159461 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-FlavorsV2NegativeTest-1785985957-project Aug 04 16:55:10.159461 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:55:10.159461 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:55:10.159461 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: d0a9a802c71a401f92061ce2b8102b6e Aug 04 16:55:10.159461 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-FlavorsV2NegativeTest-1785985957-project Aug 04 16:55:10.159461 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 16:55:10.159461 n-d-851359-3 devstack@n-api.service[131044]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-415318917", "imageRef": "d8041953-8ef8-4b1b-b028-c35683482da4", "flavorRef": "452"}} Aug 04 16:55:10.159461 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:55:10.160176 n-d-851359-3 devstack@n-api.service[131044]: exception: Flavor's memory is too small for requested image. Aug 04 16:55:10.160176 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-415318917', 'imageRef': 'd8041953-8ef8-4b1b-b028-c35683482da4', 'flavorRef': '452'}}} Aug 04 16:55:10.160176 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:10.160176 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:10.160176 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 04 16:55:10.160176 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 04 16:55:10.160176 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 04 16:55:10.160176 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 04 16:55:10.160176 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 04 16:55:10.160176 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 04 16:55:10.160176 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1007, in _checks_for_create_and_rebuild Aug 04 16:55:10.160176 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 04 16:55:10.160176 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 671, in _validate_flavor_image Aug 04 16:55:10.160176 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 04 16:55:10.160176 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 739, in _validate_flavor_image_nostatus Aug 04 16:55:10.160176 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 04 16:55:10.160176 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 04 16:55:10.160176 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:10.160176 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:10.160176 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:10.161612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:10.161612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:10.161612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:10.161612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:10.161612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:10.161612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:10.161612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:10.161612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:55:10.161612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:55:10.161612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:55:10.161612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:55:10.161612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:55:10.161612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:55:10.161612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 16:55:10.161612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 04 16:55:10.161612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 04 16:55:10.161612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 04 16:55:10.161612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:10.161612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:10.161612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:10.161612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:10.164446 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:10.164446 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:10.164446 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:55:10.164446 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:55:10.164446 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 04 16:55:10.164446 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:10.164446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e98ab573-3e02-43c4-8b58-b36197d78b43 tempest-FlavorsV2NegativeTest-1785985957 tempest-FlavorsV2NegativeTest-1785985957-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:10.168943 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e98ab573-3e02-43c4-8b58-b36197d78b43 tempest-FlavorsV2NegativeTest-1785985957 tempest-FlavorsV2NegativeTest-1785985957-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.809447 Aug 04 16:55:10.168943 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 108/226] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:55:09 2022] POST /compute/v2.1/servers => generated 93 bytes in 811 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 16:55:10.172268 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-c648b986-aa44-40b7-8902-dd73d062076c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] validate_networks() for None {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:55:10.176943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c712377b-7b42-460f-a8b7-a28ca7dac56c tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:10.178082 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:10.178082 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:10.244584 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c712377b-7b42-460f-a8b7-a28ca7dac56c tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.078096 Aug 04 16:55:10.251356 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 109/227] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Aug 4 16:55:10 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 16:55:10.258815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-02e176af-4905-4361-8288-085166ac8a30 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1748082823"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:10.267224 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:10.267224 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:10.268243 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.aggregate [None req-02e176af-4905-4361-8288-085166ac8a30 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Generated uuid 2973ac23-9049-426d-b605-6bdc9177d93b for aggregate {{(pid=131044) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 16:55:10.323481 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-02e176af-4905-4361-8288-085166ac8a30 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.064476 Aug 04 16:55:10.334466 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 110/228] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Aug 4 16:55:10 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:10.339232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7d5f778d-40fa-46b7-b649-8e30846205af tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:10.339988 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:10.339988 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:10.379903 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7d5f778d-40fa-46b7-b649-8e30846205af tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.043620 Aug 04 16:55:10.382272 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 111/229] 10.222.0.93 () {58 vars in 1143 bytes} [Thu Aug 4 16:55:10 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:10.410794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-461f549d-16e6-4860-9aae-123d8c14b161 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:10.415477 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:10.415477 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:10.487957 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-461f549d-16e6-4860-9aae-123d8c14b161 tempest-AggregatesAdminTestJSON-948166685 tempest-AggregatesAdminTestJSON-948166685-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.086913 Aug 04 16:55:10.490741 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 112/230] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Aug 4 16:55:10 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 16:55:10.500622 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4ca463af-051f-49e8-803d-346ce1e263d9 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:10.501135 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4ca463af-051f-49e8-803d-346ce1e263d9 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] [instance: d0d49f6b-4070-4e08-a35a-5dfd203c773f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:10.541536 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ca463af-051f-49e8-803d-346ce1e263d9 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:10.541953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ca463af-051f-49e8-803d-346ce1e263d9 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:10.542423 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ca463af-051f-49e8-803d-346ce1e263d9 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:10.543139 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ca463af-051f-49e8-803d-346ce1e263d9 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:10.543602 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ca463af-051f-49e8-803d-346ce1e263d9 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:10.551581 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ca463af-051f-49e8-803d-346ce1e263d9 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:10.589330 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-4ca463af-051f-49e8-803d-346ce1e263d9 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] HTTP exception thrown: Instance d0d49f6b-4070-4e08-a35a-5dfd203c773f could not be found. Aug 04 16:55:10.595862 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4ca463af-051f-49e8-803d-346ce1e263d9 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Request method failure captured: Aug 04 16:55:10.595862 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f HTTP/1.1 Aug 04 16:55:10.595862 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:55:10.595862 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:55:10.595862 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:55:10.595862 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:55:10.595862 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:55:10.595862 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:55:10.595862 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:55:10.595862 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:10.595862 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_m-OiWjXKAzc1mKiUxi8Z7XP4oyiCmNV_Go3F225JCH_WEWZY3p84DkR2_zse626gZAB9Bh8EAPqCt9Sp_1M89R4-ZHe5y0sTJVCiyPmRi1GMOde2VIYs3Jey8YA6D9juEbt3DWa0aLGTmwhgGA1-QIbgvYxkgK6KYShaoFLB8OvSw Aug 04 16:55:10.595862 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:55:10.595862 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:55:10.595862 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:55:10.595862 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:55:10.595862 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:55:10.595862 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:55:10.595862 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 8d4104fbd3df4e7aadfaf896bea56a9c Aug 04 16:55:10.595862 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-AggregatesAdminTestJSON-66516335 Aug 04 16:55:10.595862 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:55:10.595862 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:55:10.597310 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8d4104fbd3df4e7aadfaf896bea56a9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8d4104fbd3df4e7aadfaf896bea56a9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8d4104fbd3df4e7aadfaf896bea56a9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8d4104fbd3df4e7aadfaf896bea56a9c"}]}] Aug 04 16:55:10.597310 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-AggregatesAdminTestJSON-66516335 Aug 04 16:55:10.597310 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 8d4104fbd3df4e7aadfaf896bea56a9c Aug 04 16:55:10.597310 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-66516335 Aug 04 16:55:10.597310 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-AggregatesAdminTestJSON-66516335-project Aug 04 16:55:10.597310 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:55:10.597310 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:55:10.597310 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 808f13b51f6d4e1d9e7c924742544ef6 Aug 04 16:55:10.597310 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-AggregatesAdminTestJSON-66516335-project Aug 04 16:55:10.597310 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:55:10.597310 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance d0d49f6b-4070-4e08-a35a-5dfd203c773f could not be found. Aug 04 16:55:10.597310 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'd0d49f6b-4070-4e08-a35a-5dfd203c773f'} Aug 04 16:55:10.597999 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:10.597999 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:10.597999 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:55:10.597999 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:55:10.597999 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:55:10.597999 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:55:10.597999 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:55:10.597999 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:55:10.597999 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:55:10.597999 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:55:10.597999 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0d49f6b-4070-4e08-a35a-5dfd203c773f could not be found. Aug 04 16:55:10.597999 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:10.597999 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:10.597999 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:10.597999 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:10.597999 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:10.597999 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:10.597999 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:10.597999 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:10.597999 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:10.599897 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:10.599897 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:55:10.599897 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:55:10.599897 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:55:10.599897 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:55:10.599897 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:55:10.599897 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:55:10.599897 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:55:10.599897 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:55:10.599897 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0d49f6b-4070-4e08-a35a-5dfd203c773f could not be found. Aug 04 16:55:10.599897 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:10.599897 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:10.599897 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:10.599897 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:10.599897 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:10.599897 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:10.599897 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:55:10.599897 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:55:10.599897 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0d49f6b-4070-4e08-a35a-5dfd203c773f could not be found. Aug 04 16:55:10.599897 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:10.601340 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4ca463af-051f-49e8-803d-346ce1e263d9 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Returning 404 to user: Instance d0d49f6b-4070-4e08-a35a-5dfd203c773f could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:10.603234 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4ca463af-051f-49e8-803d-346ce1e263d9 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] 10.222.0.93 "DELETE /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f" status: 404 len: 111 microversion: 2.1 time: 0.107290 Aug 04 16:55:10.606424 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 113/231] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 16:55:10 2022] DELETE /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:55:10.621644 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a5be31a1-242f-4a16-b22b-b1021654d575 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:10.622427 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a5be31a1-242f-4a16-b22b-b1021654d575 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] [instance: d0d49f6b-4070-4e08-a35a-5dfd203c773f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:10.635194 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5be31a1-242f-4a16-b22b-b1021654d575 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:10.635690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5be31a1-242f-4a16-b22b-b1021654d575 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:10.636492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5be31a1-242f-4a16-b22b-b1021654d575 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:10.637034 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5be31a1-242f-4a16-b22b-b1021654d575 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:10.637519 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5be31a1-242f-4a16-b22b-b1021654d575 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:10.637953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5be31a1-242f-4a16-b22b-b1021654d575 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:10.655524 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-a5be31a1-242f-4a16-b22b-b1021654d575 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] HTTP exception thrown: Instance d0d49f6b-4070-4e08-a35a-5dfd203c773f could not be found. Aug 04 16:55:10.657020 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a5be31a1-242f-4a16-b22b-b1021654d575 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Request method failure captured: Aug 04 16:55:10.657020 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f HTTP/1.1 Aug 04 16:55:10.657020 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:55:10.657020 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:55:10.657020 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:55:10.657020 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:55:10.657020 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:55:10.657020 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:55:10.657020 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:55:10.657020 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:10.657020 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_m-OiWjXKAzc1mKiUxi8Z7XP4oyiCmNV_Go3F225JCH_WEWZY3p84DkR2_zse626gZAB9Bh8EAPqCt9Sp_1M89R4-ZHe5y0sTJVCiyPmRi1GMOde2VIYs3Jey8YA6D9juEbt3DWa0aLGTmwhgGA1-QIbgvYxkgK6KYShaoFLB8OvSw Aug 04 16:55:10.657020 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:55:10.657020 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:55:10.657020 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:55:10.657020 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:55:10.657020 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:55:10.657020 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:55:10.657020 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 8d4104fbd3df4e7aadfaf896bea56a9c Aug 04 16:55:10.657020 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-AggregatesAdminTestJSON-66516335 Aug 04 16:55:10.657020 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:55:10.657020 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:55:10.658297 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8d4104fbd3df4e7aadfaf896bea56a9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8d4104fbd3df4e7aadfaf896bea56a9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8d4104fbd3df4e7aadfaf896bea56a9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8d4104fbd3df4e7aadfaf896bea56a9c"}]}] Aug 04 16:55:10.658297 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-AggregatesAdminTestJSON-66516335 Aug 04 16:55:10.658297 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 8d4104fbd3df4e7aadfaf896bea56a9c Aug 04 16:55:10.658297 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-66516335 Aug 04 16:55:10.658297 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-AggregatesAdminTestJSON-66516335-project Aug 04 16:55:10.658297 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:55:10.658297 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:55:10.658297 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 808f13b51f6d4e1d9e7c924742544ef6 Aug 04 16:55:10.658297 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-AggregatesAdminTestJSON-66516335-project Aug 04 16:55:10.658297 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:55:10.658297 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance d0d49f6b-4070-4e08-a35a-5dfd203c773f could not be found. Aug 04 16:55:10.658297 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'd0d49f6b-4070-4e08-a35a-5dfd203c773f'} Aug 04 16:55:10.658986 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:10.658986 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:10.658986 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:55:10.658986 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:55:10.658986 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:55:10.658986 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:55:10.658986 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:55:10.658986 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:55:10.658986 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:55:10.658986 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:55:10.658986 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0d49f6b-4070-4e08-a35a-5dfd203c773f could not be found. Aug 04 16:55:10.658986 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:10.658986 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:10.658986 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:10.658986 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:10.658986 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:10.658986 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:10.658986 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:10.658986 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:10.658986 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:10.660117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:10.660117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:55:10.660117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:55:10.660117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:55:10.660117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:55:10.660117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:55:10.660117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:55:10.660117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0d49f6b-4070-4e08-a35a-5dfd203c773f could not be found. Aug 04 16:55:10.660117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:10.660117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:10.660117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:10.660117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:10.660117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:10.660117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:10.660117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:55:10.660117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:55:10.660117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0d49f6b-4070-4e08-a35a-5dfd203c773f could not be found. Aug 04 16:55:10.660117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:10.661747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a5be31a1-242f-4a16-b22b-b1021654d575 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] Returning 404 to user: Instance d0d49f6b-4070-4e08-a35a-5dfd203c773f could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:10.661747 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a5be31a1-242f-4a16-b22b-b1021654d575 tempest-AggregatesAdminTestJSON-66516335 tempest-AggregatesAdminTestJSON-66516335-project] 10.222.0.93 "GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f" status: 404 len: 111 microversion: 2.1 time: 0.046916 Aug 04 16:55:10.663629 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 114/232] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:10 2022] GET /compute/v2.1/servers/d0d49f6b-4070-4e08-a35a-5dfd203c773f => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:55:10.709188 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5138144c-b5ee-4e32-a54a-cf51ca62a92a tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:10.709883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5138144c-b5ee-4e32-a54a-cf51ca62a92a tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:10.719560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5138144c-b5ee-4e32-a54a-cf51ca62a92a tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:10.720063 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5138144c-b5ee-4e32-a54a-cf51ca62a92a tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:10.720500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5138144c-b5ee-4e32-a54a-cf51ca62a92a tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:10.721209 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5138144c-b5ee-4e32-a54a-cf51ca62a92a tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:10.721670 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5138144c-b5ee-4e32-a54a-cf51ca62a92a tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:10.722134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5138144c-b5ee-4e32-a54a-cf51ca62a92a tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:11.129295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-c648b986-aa44-40b7-8902-dd73d062076c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:55:11.130481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-c648b986-aa44-40b7-8902-dd73d062076c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:55:11.130780 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-c648b986-aa44-40b7-8902-dd73d062076c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:55:11.131197 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-c648b986-aa44-40b7-8902-dd73d062076c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:55:11.131611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-c648b986-aa44-40b7-8902-dd73d062076c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:55:11.144364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c648b986-aa44-40b7-8902-dd73d062076c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:11.144866 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c648b986-aa44-40b7-8902-dd73d062076c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:11.145337 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c648b986-aa44-40b7-8902-dd73d062076c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:11.146112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c648b986-aa44-40b7-8902-dd73d062076c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:11.146582 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c648b986-aa44-40b7-8902-dd73d062076c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:11.147011 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c648b986-aa44-40b7-8902-dd73d062076c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:11.197734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-c648b986-aa44-40b7-8902-dd73d062076c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Getting quotas for project 6f64e49086c94f65ba1fc2ef97b6bcde. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:55:11.209380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=5,nova_api:INSERT=10,nova_api:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:11.211880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-c648b986-aa44-40b7-8902-dd73d062076c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Getting quotas for user 655795644d9941c99a82d15d9daa5ab5 and project 6f64e49086c94f65ba1fc2ef97b6bcde. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:55:11.251071 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c648b986-aa44-40b7-8902-dd73d062076c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:55:11.259093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c648b986-aa44-40b7-8902-dd73d062076c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:55:11.388945 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c648b986-aa44-40b7-8902-dd73d062076c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.627375 Aug 04 16:55:11.390331 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 119/233] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:55:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:55:11.405708 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9326ced7-82ec-4df1-98eb-5435f658382c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:11.406368 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9326ced7-82ec-4df1-98eb-5435f658382c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:11.492018 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5138144c-b5ee-4e32-a54a-cf51ca62a92a tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:11.500869 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5138144c-b5ee-4e32-a54a-cf51ca62a92a tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13" status: 200 len: 1390 microversion: 2.1 time: 0.795959 Aug 04 16:55:11.505383 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 115/234] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:10 2022] GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 => generated 1390 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:55:11.630476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9326ced7-82ec-4df1-98eb-5435f658382c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:11.646131 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9326ced7-82ec-4df1-98eb-5435f658382c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1212 microversion: 2.1 time: 0.246108 Aug 04 16:55:11.661883 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 120/235] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:11 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1212 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:55:12.527914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-da77b5c4-8f4a-4a43-9328-0b16c9b81357 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:12.528546 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-da77b5c4-8f4a-4a43-9328-0b16c9b81357 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:12.535335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da77b5c4-8f4a-4a43-9328-0b16c9b81357 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:12.535902 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da77b5c4-8f4a-4a43-9328-0b16c9b81357 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:12.536344 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da77b5c4-8f4a-4a43-9328-0b16c9b81357 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:12.540640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da77b5c4-8f4a-4a43-9328-0b16c9b81357 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:12.541260 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da77b5c4-8f4a-4a43-9328-0b16c9b81357 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:12.541575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da77b5c4-8f4a-4a43-9328-0b16c9b81357 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:12.670560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8fa292cc-5133-49da-9f60-832f45da45c7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:12.671805 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8fa292cc-5133-49da-9f60-832f45da45c7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:12.682620 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fa292cc-5133-49da-9f60-832f45da45c7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:12.683549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fa292cc-5133-49da-9f60-832f45da45c7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:12.687022 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fa292cc-5133-49da-9f60-832f45da45c7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:12.688147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fa292cc-5133-49da-9f60-832f45da45c7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:12.689011 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fa292cc-5133-49da-9f60-832f45da45c7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:12.693382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fa292cc-5133-49da-9f60-832f45da45c7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:12.919744 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8fa292cc-5133-49da-9f60-832f45da45c7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:12.938779 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8fa292cc-5133-49da-9f60-832f45da45c7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1264 microversion: 2.1 time: 0.273687 Aug 04 16:55:12.960767 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 121/236] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:12 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1264 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:55:13.059140 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-da77b5c4-8f4a-4a43-9328-0b16c9b81357 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:13.071947 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-da77b5c4-8f4a-4a43-9328-0b16c9b81357 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13" status: 200 len: 1390 microversion: 2.1 time: 0.548868 Aug 04 16:55:13.083232 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 116/237] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:12 2022] GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 => generated 1390 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:13.388161 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-bc607075-c5b0-40f2-9700-9fc943137c3e req-16b3c862-3d56-41ba-a8c6-205691ddd8c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69d189f5-2ca5-4d3b-9a70-b6e27d6dda13", "tag": "8294cc37-07d5-4724-a0a2-e13fb2658fa6"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:13.409837 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-bc607075-c5b0-40f2-9700-9fc943137c3e req-16b3c862-3d56-41ba-a8c6-205691ddd8c6 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:13.410382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-bc607075-c5b0-40f2-9700-9fc943137c3e req-16b3c862-3d56-41ba-a8c6-205691ddd8c6 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:13.410936 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-bc607075-c5b0-40f2-9700-9fc943137c3e req-16b3c862-3d56-41ba-a8c6-205691ddd8c6 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:13.429016 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-bc607075-c5b0-40f2-9700-9fc943137c3e req-16b3c862-3d56-41ba-a8c6-205691ddd8c6 service nova] Creating event network-changed:8294cc37-07d5-4724-a0a2-e13fb2658fa6 for instance 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 on n-h2-851359-3 Aug 04 16:55:13.443514 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-bc607075-c5b0-40f2-9700-9fc943137c3e req-16b3c862-3d56-41ba-a8c6-205691ddd8c6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.480896 Aug 04 16:55:13.444479 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 122/238] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:13.965397 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7c201fd8-8613-4e04-8d44-af051d2d7b07 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:13.967064 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7c201fd8-8613-4e04-8d44-af051d2d7b07 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:13.981636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c201fd8-8613-4e04-8d44-af051d2d7b07 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:13.982542 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c201fd8-8613-4e04-8d44-af051d2d7b07 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:13.984939 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c201fd8-8613-4e04-8d44-af051d2d7b07 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:13.987170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c201fd8-8613-4e04-8d44-af051d2d7b07 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:13.991346 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c201fd8-8613-4e04-8d44-af051d2d7b07 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:13.992194 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c201fd8-8613-4e04-8d44-af051d2d7b07 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:14.095812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0cc41422-54ab-4fb5-93d7-05a6c2ef52c9 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:14.096646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0cc41422-54ab-4fb5-93d7-05a6c2ef52c9 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:14.112028 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0cc41422-54ab-4fb5-93d7-05a6c2ef52c9 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:14.114569 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0cc41422-54ab-4fb5-93d7-05a6c2ef52c9 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:14.119590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0cc41422-54ab-4fb5-93d7-05a6c2ef52c9 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:14.120887 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0cc41422-54ab-4fb5-93d7-05a6c2ef52c9 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:14.123698 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0cc41422-54ab-4fb5-93d7-05a6c2ef52c9 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:14.123698 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0cc41422-54ab-4fb5-93d7-05a6c2ef52c9 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:14.333569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7c201fd8-8613-4e04-8d44-af051d2d7b07 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:14.347233 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7c201fd8-8613-4e04-8d44-af051d2d7b07 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1270 microversion: 2.1 time: 0.387501 Aug 04 16:55:14.354838 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 117/239] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:13 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1270 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:14.537829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0cc41422-54ab-4fb5-93d7-05a6c2ef52c9 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:14.547861 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0cc41422-54ab-4fb5-93d7-05a6c2ef52c9 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13" status: 200 len: 1390 microversion: 2.1 time: 0.456281 Aug 04 16:55:14.548822 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 123/240] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:14 2022] GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 => generated 1390 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:55:15.376286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a21fbdec-0e8b-4cb4-8f0c-c3a6262c0135 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:15.377883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a21fbdec-0e8b-4cb4-8f0c-c3a6262c0135 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:15.396522 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a21fbdec-0e8b-4cb4-8f0c-c3a6262c0135 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:15.399792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a21fbdec-0e8b-4cb4-8f0c-c3a6262c0135 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:15.400437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a21fbdec-0e8b-4cb4-8f0c-c3a6262c0135 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:15.404084 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a21fbdec-0e8b-4cb4-8f0c-c3a6262c0135 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:15.405583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a21fbdec-0e8b-4cb4-8f0c-c3a6262c0135 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:15.406218 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a21fbdec-0e8b-4cb4-8f0c-c3a6262c0135 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:15.571617 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4a1f23a9-894d-49b6-81f3-f1fbca21e8f4 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:15.572244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4a1f23a9-894d-49b6-81f3-f1fbca21e8f4 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:15.587272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a1f23a9-894d-49b6-81f3-f1fbca21e8f4 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:15.587663 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a1f23a9-894d-49b6-81f3-f1fbca21e8f4 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:15.588201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a1f23a9-894d-49b6-81f3-f1fbca21e8f4 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:15.589019 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a1f23a9-894d-49b6-81f3-f1fbca21e8f4 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:15.592355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a1f23a9-894d-49b6-81f3-f1fbca21e8f4 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:15.592976 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a1f23a9-894d-49b6-81f3-f1fbca21e8f4 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:15.773089 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a21fbdec-0e8b-4cb4-8f0c-c3a6262c0135 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:15.782980 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a21fbdec-0e8b-4cb4-8f0c-c3a6262c0135 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1312 microversion: 2.1 time: 0.411134 Aug 04 16:55:15.798609 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 118/241] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:15 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1312 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:15.817343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4a1f23a9-894d-49b6-81f3-f1fbca21e8f4 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:15.828322 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4a1f23a9-894d-49b6-81f3-f1fbca21e8f4 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13" status: 200 len: 1390 microversion: 2.1 time: 0.260651 Aug 04 16:55:15.830055 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 124/242] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:15 2022] GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 => generated 1390 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:55:15.987788 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-134e9d6c-d18e-4dcc-b4f6-f123fa935d50 req-8613785b-0eea-4b7a-a975-fdbf83fd9b92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0b4f50d-df7a-44ab-87d8-054aa370c979", "tag": "6defc06d-afcb-4aaa-9d45-8000639706e7"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:16.006531 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-134e9d6c-d18e-4dcc-b4f6-f123fa935d50 req-8613785b-0eea-4b7a-a975-fdbf83fd9b92 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:16.007287 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-134e9d6c-d18e-4dcc-b4f6-f123fa935d50 req-8613785b-0eea-4b7a-a975-fdbf83fd9b92 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:16.007880 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-134e9d6c-d18e-4dcc-b4f6-f123fa935d50 req-8613785b-0eea-4b7a-a975-fdbf83fd9b92 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:16.042548 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-134e9d6c-d18e-4dcc-b4f6-f123fa935d50 req-8613785b-0eea-4b7a-a975-fdbf83fd9b92 service nova] Creating event network-changed:6defc06d-afcb-4aaa-9d45-8000639706e7 for instance d0b4f50d-df7a-44ab-87d8-054aa370c979 on n-h1-851359-3 Aug 04 16:55:16.048903 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-134e9d6c-d18e-4dcc-b4f6-f123fa935d50 req-8613785b-0eea-4b7a-a975-fdbf83fd9b92 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068570 Aug 04 16:55:16.049501 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 119/243] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:16.806950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-aac4afdb-32bd-4c2b-afcb-e58df59cc9e3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:16.807578 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-aac4afdb-32bd-4c2b-afcb-e58df59cc9e3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:16.820236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aac4afdb-32bd-4c2b-afcb-e58df59cc9e3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:16.821367 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aac4afdb-32bd-4c2b-afcb-e58df59cc9e3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:16.822814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aac4afdb-32bd-4c2b-afcb-e58df59cc9e3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:16.823792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aac4afdb-32bd-4c2b-afcb-e58df59cc9e3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:16.824647 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aac4afdb-32bd-4c2b-afcb-e58df59cc9e3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:16.827147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aac4afdb-32bd-4c2b-afcb-e58df59cc9e3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:16.858929 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-edb47483-9012-403b-a206-8e9a8340bde0 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:16.862265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-edb47483-9012-403b-a206-8e9a8340bde0 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:16.883417 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-edb47483-9012-403b-a206-8e9a8340bde0 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:16.883918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-edb47483-9012-403b-a206-8e9a8340bde0 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:16.884380 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-edb47483-9012-403b-a206-8e9a8340bde0 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:16.885082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-edb47483-9012-403b-a206-8e9a8340bde0 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:16.891117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-edb47483-9012-403b-a206-8e9a8340bde0 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:16.891964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-edb47483-9012-403b-a206-8e9a8340bde0 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:17.204090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=49,nova_cell0:UPDATE=7 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:17.405383 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-aac4afdb-32bd-4c2b-afcb-e58df59cc9e3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:17.410232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-edb47483-9012-403b-a206-8e9a8340bde0 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:17.421257 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-aac4afdb-32bd-4c2b-afcb-e58df59cc9e3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1312 microversion: 2.1 time: 0.617672 Aug 04 16:55:17.434542 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 125/244] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:16 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1312 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:17.442280 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-edb47483-9012-403b-a206-8e9a8340bde0 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13" status: 200 len: 1390 microversion: 2.1 time: 0.573525 Aug 04 16:55:17.453419 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 120/245] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:16 2022] GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 => generated 1390 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:18.451564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-17f80981-f390-4b86-ad5b-75b4f7903be8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:18.457341 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-17f80981-f390-4b86-ad5b-75b4f7903be8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:18.469308 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-36bf6cc6-32a2-4aec-85e2-89e07818e1d9 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:18.470112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-36bf6cc6-32a2-4aec-85e2-89e07818e1d9 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:18.472528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-17f80981-f390-4b86-ad5b-75b4f7903be8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:18.473070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-17f80981-f390-4b86-ad5b-75b4f7903be8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:18.473512 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-17f80981-f390-4b86-ad5b-75b4f7903be8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:18.474684 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-17f80981-f390-4b86-ad5b-75b4f7903be8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:18.476113 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-17f80981-f390-4b86-ad5b-75b4f7903be8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:18.477509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-17f80981-f390-4b86-ad5b-75b4f7903be8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:18.484133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36bf6cc6-32a2-4aec-85e2-89e07818e1d9 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:18.484753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36bf6cc6-32a2-4aec-85e2-89e07818e1d9 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:18.485401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36bf6cc6-32a2-4aec-85e2-89e07818e1d9 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:18.486090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36bf6cc6-32a2-4aec-85e2-89e07818e1d9 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:18.489091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36bf6cc6-32a2-4aec-85e2-89e07818e1d9 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:18.500966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36bf6cc6-32a2-4aec-85e2-89e07818e1d9 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:18.555156 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:18.732816 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-36bf6cc6-32a2-4aec-85e2-89e07818e1d9 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:18.750720 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-36bf6cc6-32a2-4aec-85e2-89e07818e1d9 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13" status: 200 len: 1390 microversion: 2.1 time: 0.283248 Aug 04 16:55:18.752736 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 121/246] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:18 2022] GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 => generated 1390 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:18.778128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-17f80981-f390-4b86-ad5b-75b4f7903be8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:18.791350 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-17f80981-f390-4b86-ad5b-75b4f7903be8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1312 microversion: 2.1 time: 0.347236 Aug 04 16:55:18.792725 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 126/247] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:18 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1312 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:19.775025 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dfc3421c-47da-4e2b-8227-9dadbd44858f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:19.776547 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dfc3421c-47da-4e2b-8227-9dadbd44858f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:19.793968 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfc3421c-47da-4e2b-8227-9dadbd44858f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:19.798385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfc3421c-47da-4e2b-8227-9dadbd44858f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:19.799295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfc3421c-47da-4e2b-8227-9dadbd44858f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:19.805318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfc3421c-47da-4e2b-8227-9dadbd44858f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:19.806192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfc3421c-47da-4e2b-8227-9dadbd44858f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:19.807963 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfc3421c-47da-4e2b-8227-9dadbd44858f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:20.150515 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dfc3421c-47da-4e2b-8227-9dadbd44858f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:20.166404 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dfc3421c-47da-4e2b-8227-9dadbd44858f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13" status: 200 len: 1390 microversion: 2.1 time: 0.395878 Aug 04 16:55:20.168586 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 127/248] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:19 2022] GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 => generated 1390 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:55:20.186978 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cb1cbeb2-e9e1-4f12-985a-a1fb1cf6b85c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:20.203867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cb1cbeb2-e9e1-4f12-985a-a1fb1cf6b85c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:20.216402 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb1cbeb2-e9e1-4f12-985a-a1fb1cf6b85c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:20.217518 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb1cbeb2-e9e1-4f12-985a-a1fb1cf6b85c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:20.218229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb1cbeb2-e9e1-4f12-985a-a1fb1cf6b85c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:20.220663 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb1cbeb2-e9e1-4f12-985a-a1fb1cf6b85c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:20.222508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb1cbeb2-e9e1-4f12-985a-a1fb1cf6b85c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:20.224110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb1cbeb2-e9e1-4f12-985a-a1fb1cf6b85c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:20.252413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f2bf976a-75e2-4b3d-98ca-e311505d73e9 tempest-AZAdminV2TestJSON-195550046 tempest-AZAdminV2TestJSON-195550046-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:20.254277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2bf976a-75e2-4b3d-98ca-e311505d73e9 tempest-AZAdminV2TestJSON-195550046 tempest-AZAdminV2TestJSON-195550046-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:20.254777 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2bf976a-75e2-4b3d-98ca-e311505d73e9 tempest-AZAdminV2TestJSON-195550046 tempest-AZAdminV2TestJSON-195550046-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:20.255274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2bf976a-75e2-4b3d-98ca-e311505d73e9 tempest-AZAdminV2TestJSON-195550046 tempest-AZAdminV2TestJSON-195550046-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:20.256023 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2bf976a-75e2-4b3d-98ca-e311505d73e9 tempest-AZAdminV2TestJSON-195550046 tempest-AZAdminV2TestJSON-195550046-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:20.257311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2bf976a-75e2-4b3d-98ca-e311505d73e9 tempest-AZAdminV2TestJSON-195550046 tempest-AZAdminV2TestJSON-195550046-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:20.257751 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2bf976a-75e2-4b3d-98ca-e311505d73e9 tempest-AZAdminV2TestJSON-195550046 tempest-AZAdminV2TestJSON-195550046-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:20.301510 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:20.374981 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f2bf976a-75e2-4b3d-98ca-e311505d73e9 tempest-AZAdminV2TestJSON-195550046 tempest-AZAdminV2TestJSON-195550046-project-admin] 10.222.0.93 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.748667 Aug 04 16:55:20.375591 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 122/249] 10.222.0.93 () {58 vars in 1164 bytes} [Thu Aug 4 16:55:19 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:55:20.807760 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cb1cbeb2-e9e1-4f12-985a-a1fb1cf6b85c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:20.819004 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cb1cbeb2-e9e1-4f12-985a-a1fb1cf6b85c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1312 microversion: 2.1 time: 0.648313 Aug 04 16:55:20.824703 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 128/250] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:20 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1312 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:20.838468 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2fb51a9c-25fa-42f1-912d-607277532a6a tempest-AZAdminV2TestJSON-195550046 tempest-AZAdminV2TestJSON-195550046-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:20.839487 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:20.839487 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:55:20.840720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2fb51a9c-25fa-42f1-912d-607277532a6a tempest-AZAdminV2TestJSON-195550046 tempest-AZAdminV2TestJSON-195550046-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:20.841372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2fb51a9c-25fa-42f1-912d-607277532a6a tempest-AZAdminV2TestJSON-195550046 tempest-AZAdminV2TestJSON-195550046-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:20.841919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2fb51a9c-25fa-42f1-912d-607277532a6a tempest-AZAdminV2TestJSON-195550046 tempest-AZAdminV2TestJSON-195550046-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:20.842931 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2fb51a9c-25fa-42f1-912d-607277532a6a tempest-AZAdminV2TestJSON-195550046 tempest-AZAdminV2TestJSON-195550046-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:20.843509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2fb51a9c-25fa-42f1-912d-607277532a6a tempest-AZAdminV2TestJSON-195550046 tempest-AZAdminV2TestJSON-195550046-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:20.844036 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2fb51a9c-25fa-42f1-912d-607277532a6a tempest-AZAdminV2TestJSON-195550046 tempest-AZAdminV2TestJSON-195550046-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:20.906932 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2fb51a9c-25fa-42f1-912d-607277532a6a tempest-AZAdminV2TestJSON-195550046 tempest-AZAdminV2TestJSON-195550046-project-admin] 10.222.0.93 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.080635 Aug 04 16:55:20.908100 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 129/251] 10.222.0.93 () {58 vars in 1185 bytes} [Thu Aug 4 16:55:20 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:21.069319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-93660046-c2ac-4073-8818-a4bd417cb525 tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] Calling method '.version_select at 0x7f1e5bfcf160>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:21.072449 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:21.072449 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:21.075721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93660046-c2ac-4073-8818-a4bd417cb525 tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:21.077390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93660046-c2ac-4073-8818-a4bd417cb525 tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:21.079206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93660046-c2ac-4073-8818-a4bd417cb525 tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:21.087996 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93660046-c2ac-4073-8818-a4bd417cb525 tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:21.092285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93660046-c2ac-4073-8818-a4bd417cb525 tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:21.093107 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93660046-c2ac-4073-8818-a4bd417cb525 tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:21.205180 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-93660046-c2ac-4073-8818-a4bd417cb525 tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.828306 Aug 04 16:55:21.206022 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 123/252] 10.222.0.93 () {58 vars in 1128 bytes} [Thu Aug 4 16:55:20 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:21.360229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b61fcc75-c127-4f6f-9263-b3bbe289f447 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Calling method '.version_select at 0x7f1e682d78b0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:21.495038 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a02d6c11-9be0-4734-8898-7034f1700996 tempest-AZAdminNegativeTestJSON-2105476218 tempest-AZAdminNegativeTestJSON-2105476218-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:21.497538 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:21.497538 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:21.499528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a02d6c11-9be0-4734-8898-7034f1700996 tempest-AZAdminNegativeTestJSON-2105476218 tempest-AZAdminNegativeTestJSON-2105476218-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '862aff389aa040c4b42720ad87fcb206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b46bfe1642b4d7ebe37a416cdcd6b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:21.515113 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a02d6c11-9be0-4734-8898-7034f1700996 tempest-AZAdminNegativeTestJSON-2105476218 tempest-AZAdminNegativeTestJSON-2105476218-project] Request method failure captured: Aug 04 16:55:21.515113 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 04 16:55:21.515113 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:55:21.515113 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:55:21.515113 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:55:21.515113 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:55:21.515113 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:55:21.515113 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:55:21.515113 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:55:21.515113 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:21.515113 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_n2rqQrsanQ7d6iyUQG64kyZscEBMlJT7PF_CAK8GUWSLfoIFN3_2pUiRcOSe59nxE8aypQVqG6cilMLFc6r85oFaZzf07zo204ALUoMOhtjQHQaZEIWcvlDlUYMCASdYAmiZYYZTsc2JoXT4sPfXla59MlZB9nAoTMtefVB0trynA Aug 04 16:55:21.515113 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:55:21.515113 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:55:21.515113 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:55:21.515113 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:55:21.515113 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:55:21.515113 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:55:21.515113 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 0b46bfe1642b4d7ebe37a416cdcd6b1d Aug 04 16:55:21.515113 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-AZAdminNegativeTestJSON-2105476218 Aug 04 16:55:21.515113 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:55:21.515113 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:55:21.516388 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0b46bfe1642b4d7ebe37a416cdcd6b1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0b46bfe1642b4d7ebe37a416cdcd6b1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0b46bfe1642b4d7ebe37a416cdcd6b1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0b46bfe1642b4d7ebe37a416cdcd6b1d"}]}] Aug 04 16:55:21.516388 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-AZAdminNegativeTestJSON-2105476218 Aug 04 16:55:21.516388 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 0b46bfe1642b4d7ebe37a416cdcd6b1d Aug 04 16:55:21.516388 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-2105476218 Aug 04 16:55:21.516388 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-AZAdminNegativeTestJSON-2105476218-project Aug 04 16:55:21.516388 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:55:21.516388 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:55:21.516388 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 862aff389aa040c4b42720ad87fcb206 Aug 04 16:55:21.516388 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-AZAdminNegativeTestJSON-2105476218-project Aug 04 16:55:21.516388 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:55:21.516388 n-d-851359-3 devstack@n-api.service[131044]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 04 16:55:21.516388 n-d-851359-3 devstack@n-api.service[131044]: action_args: {} Aug 04 16:55:21.517106 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:21.517106 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:21.517106 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:21.517106 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:21.517106 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:21.517106 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:21.517106 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:21.517106 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:21.517106 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 04 16:55:21.517106 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 04 16:55:21.517106 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:55:21.517106 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:55:21.517106 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:55:21.517106 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:55:21.517106 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:55:21.517106 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:55:21.517106 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:55:21.517106 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:55:21.517106 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:55:21.518574 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:55:21.518574 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:55:21.518574 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:55:21.518574 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:55:21.518574 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:55:21.518574 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 04 16:55:21.518574 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:21.518574 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:21.518574 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:21.518574 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:21.518574 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:21.518574 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:21.518574 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:55:21.518574 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:55:21.518574 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 04 16:55:21.518574 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:21.518574 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a02d6c11-9be0-4734-8898-7034f1700996 tempest-AZAdminNegativeTestJSON-2105476218 tempest-AZAdminNegativeTestJSON-2105476218-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:21.520191 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a02d6c11-9be0-4734-8898-7034f1700996 tempest-AZAdminNegativeTestJSON-2105476218 tempest-AZAdminNegativeTestJSON-2105476218-project] 10.222.0.93 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.308638 Aug 04 16:55:21.520191 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 124/253] 10.222.0.93 () {58 vars in 1185 bytes} [Thu Aug 4 16:55:21 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 311 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:55:21.526230 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e12334d3-aea6-48ec-a2ed-8551f8c61549 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:21.526860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e12334d3-aea6-48ec-a2ed-8551f8c61549 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:21.542715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e12334d3-aea6-48ec-a2ed-8551f8c61549 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:21.543215 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e12334d3-aea6-48ec-a2ed-8551f8c61549 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:21.543661 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e12334d3-aea6-48ec-a2ed-8551f8c61549 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:21.544378 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e12334d3-aea6-48ec-a2ed-8551f8c61549 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:21.544838 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e12334d3-aea6-48ec-a2ed-8551f8c61549 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:21.545268 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e12334d3-aea6-48ec-a2ed-8551f8c61549 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:21.644097 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=36 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:21.801561 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b61fcc75-c127-4f6f-9263-b3bbe289f447 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/be3adfb9a88f408db259a4ea3ef47c75" status: 200 len: 371 microversion: 2.1 time: 0.891912 Aug 04 16:55:21.808395 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 130/254] 10.222.0.93 () {58 vars in 1242 bytes} [Thu Aug 4 16:55:20 2022] GET /compute/v2.1/os-quota-sets/be3adfb9a88f408db259a4ea3ef47c75 => generated 371 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:22.041909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e12334d3-aea6-48ec-a2ed-8551f8c61549 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:22.052343 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e12334d3-aea6-48ec-a2ed-8551f8c61549 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13" status: 200 len: 1390 microversion: 2.1 time: 0.533500 Aug 04 16:55:22.067037 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 125/255] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:21 2022] GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 => generated 1390 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:22.073204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ed4e745e-f614-40d4-8d1b-5007f4f0c9d2 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Action: 'update', calling method: .version_select at 0x7f1e680871f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:22.388040 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c5638c85-6424-4910-952d-c52266e91d00 tempest-HostsAdminNegativeTestJSON-885164280 tempest-HostsAdminNegativeTestJSON-885164280-project] Calling method '.version_select at 0x7f1e682ae1f0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:22.390674 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:22.390674 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:55:22.391859 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c5638c85-6424-4910-952d-c52266e91d00 tempest-HostsAdminNegativeTestJSON-885164280 tempest-HostsAdminNegativeTestJSON-885164280-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '621db0dc13694b9c80abc6c8104fbd61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4221224e414427c9f72883dd8143172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:22.393944 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c5638c85-6424-4910-952d-c52266e91d00 tempest-HostsAdminNegativeTestJSON-885164280 tempest-HostsAdminNegativeTestJSON-885164280-project] Request method failure captured: Aug 04 16:55:22.393944 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 04 16:55:22.393944 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:55:22.393944 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:55:22.393944 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:55:22.393944 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:55:22.393944 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:55:22.393944 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:55:22.393944 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:55:22.393944 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:22.393944 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_n1d8s5XSsDGLCh6mYukQynU03VKvXq27a1ho7Vc8fKaZK09oopTqMsihLNavo2ldVNSEUXSRlCOIqTn4YB6Q52r0H1zErtwgHKhJgHZXIw8UI6v-nOpYCJWAz4iwYvai4vkrpM8E-K0mBbHn_rbzJnWmHghGIQ6UOEazVwjCXSKpk Aug 04 16:55:22.393944 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:55:22.393944 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:55:22.393944 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:55:22.393944 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:55:22.393944 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:55:22.393944 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:55:22.393944 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: b4221224e414427c9f72883dd8143172 Aug 04 16:55:22.393944 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-885164280 Aug 04 16:55:22.393944 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 16:55:22.393944 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 16:55:22.395846 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b4221224e414427c9f72883dd8143172"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b4221224e414427c9f72883dd8143172"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b4221224e414427c9f72883dd8143172"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b4221224e414427c9f72883dd8143172"}]}] Aug 04 16:55:22.395846 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-HostsAdminNegativeTestJSON-885164280 Aug 04 16:55:22.395846 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: b4221224e414427c9f72883dd8143172 Aug 04 16:55:22.395846 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-885164280 Aug 04 16:55:22.395846 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-HostsAdminNegativeTestJSON-885164280-project Aug 04 16:55:22.395846 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:55:22.395846 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:55:22.395846 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 621db0dc13694b9c80abc6c8104fbd61 Aug 04 16:55:22.395846 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-HostsAdminNegativeTestJSON-885164280-project Aug 04 16:55:22.395846 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 16:55:22.395846 n-d-851359-3 devstack@n-api.service[131043]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 04 16:55:22.395846 n-d-851359-3 devstack@n-api.service[131043]: action_args: {} Aug 04 16:55:22.395846 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:22.396577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:22.396577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:22.396577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:22.396577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:22.396577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:22.396577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:55:22.396577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:55:22.396577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 16:55:22.396577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:55:22.396577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:22.396577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:22.396577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 04 16:55:22.396577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 04 16:55:22.396577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:55:22.396577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:55:22.396577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:55:22.396577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:55:22.396577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:55:22.396577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:55:22.397576 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:55:22.397576 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:55:22.397576 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:55:22.397576 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:55:22.397576 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:55:22.397576 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:55:22.397576 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:55:22.397576 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:55:22.397576 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 04 16:55:22.397576 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:22.397576 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:22.397576 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:22.397576 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:22.397576 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:22.397576 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:22.397576 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:55:22.397576 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:55:22.397576 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 04 16:55:22.397576 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:22.400289 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c5638c85-6424-4910-952d-c52266e91d00 tempest-HostsAdminNegativeTestJSON-885164280 tempest-HostsAdminNegativeTestJSON-885164280-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:22.401357 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c5638c85-6424-4910-952d-c52266e91d00 tempest-HostsAdminNegativeTestJSON-885164280 tempest-HostsAdminNegativeTestJSON-885164280-project] 10.222.0.93 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.596884 Aug 04 16:55:22.411114 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 131/256] 10.222.0.93 () {58 vars in 1128 bytes} [Thu Aug 4 16:55:21 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 604 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:55:22.427488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ebdc6ff8-3ddd-47a8-bb83-b42126354dbc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:22.432717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ebdc6ff8-3ddd-47a8-bb83-b42126354dbc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:22.455467 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ebdc6ff8-3ddd-47a8-bb83-b42126354dbc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:22.456287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ebdc6ff8-3ddd-47a8-bb83-b42126354dbc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:22.457481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ebdc6ff8-3ddd-47a8-bb83-b42126354dbc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:22.461194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ebdc6ff8-3ddd-47a8-bb83-b42126354dbc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:22.461950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ebdc6ff8-3ddd-47a8-bb83-b42126354dbc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:22.462670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ebdc6ff8-3ddd-47a8-bb83-b42126354dbc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:22.465261 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4,nova_api:DELETE=11,nova_api:UPDATE=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:22.487005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed4e745e-f614-40d4-8d1b-5007f4f0c9d2 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:22.487775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed4e745e-f614-40d4-8d1b-5007f4f0c9d2 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:22.488928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed4e745e-f614-40d4-8d1b-5007f4f0c9d2 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:22.490006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed4e745e-f614-40d4-8d1b-5007f4f0c9d2 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:22.490626 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed4e745e-f614-40d4-8d1b-5007f4f0c9d2 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:22.493718 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed4e745e-f614-40d4-8d1b-5007f4f0c9d2 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:22.611876 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ed4e745e-f614-40d4-8d1b-5007f4f0c9d2 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/be3adfb9a88f408db259a4ea3ef47c75" status: 200 len: 328 microversion: 2.1 time: 0.542690 Aug 04 16:55:22.612941 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 126/257] 10.222.0.93 () {60 vars in 1262 bytes} [Thu Aug 4 16:55:22 2022] PUT /compute/v2.1/os-quota-sets/be3adfb9a88f408db259a4ea3ef47c75 => generated 328 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:22.619956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a435302a-e096-456f-8c8e-951b3b37fa52 tempest-HostsAdminNegativeTestJSON-885164280 tempest-HostsAdminNegativeTestJSON-885164280-project] Calling method '.version_select at 0x7f1e5bfeb040>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:22.621353 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:22.621353 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:22.622961 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a435302a-e096-456f-8c8e-951b3b37fa52 tempest-HostsAdminNegativeTestJSON-885164280 tempest-HostsAdminNegativeTestJSON-885164280-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '621db0dc13694b9c80abc6c8104fbd61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4221224e414427c9f72883dd8143172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:22.626127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a435302a-e096-456f-8c8e-951b3b37fa52 tempest-HostsAdminNegativeTestJSON-885164280 tempest-HostsAdminNegativeTestJSON-885164280-project] Request method failure captured: Aug 04 16:55:22.626127 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-hosts/n-d-851359-3/reboot HTTP/1.1 Aug 04 16:55:22.626127 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:55:22.626127 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:55:22.626127 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:55:22.626127 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:55:22.626127 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:55:22.626127 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:55:22.626127 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:55:22.626127 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:22.626127 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_n1d8s5XSsDGLCh6mYukQynU03VKvXq27a1ho7Vc8fKaZK09oopTqMsihLNavo2ldVNSEUXSRlCOIqTn4YB6Q52r0H1zErtwgHKhJgHZXIw8UI6v-nOpYCJWAz4iwYvai4vkrpM8E-K0mBbHn_rbzJnWmHghGIQ6UOEazVwjCXSKpk Aug 04 16:55:22.626127 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:55:22.626127 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:55:22.626127 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:55:22.626127 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:55:22.626127 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:55:22.626127 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:55:22.626127 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: b4221224e414427c9f72883dd8143172 Aug 04 16:55:22.626127 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-885164280 Aug 04 16:55:22.626127 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:55:22.626127 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:55:22.627568 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b4221224e414427c9f72883dd8143172"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b4221224e414427c9f72883dd8143172"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b4221224e414427c9f72883dd8143172"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b4221224e414427c9f72883dd8143172"}]}] Aug 04 16:55:22.627568 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-HostsAdminNegativeTestJSON-885164280 Aug 04 16:55:22.627568 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: b4221224e414427c9f72883dd8143172 Aug 04 16:55:22.627568 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-885164280 Aug 04 16:55:22.627568 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-HostsAdminNegativeTestJSON-885164280-project Aug 04 16:55:22.627568 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:55:22.627568 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:55:22.627568 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 621db0dc13694b9c80abc6c8104fbd61 Aug 04 16:55:22.627568 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-HostsAdminNegativeTestJSON-885164280-project Aug 04 16:55:22.627568 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:55:22.627568 n-d-851359-3 devstack@n-api.service[131044]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 04 16:55:22.627568 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'n-d-851359-3'} Aug 04 16:55:22.627568 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:22.628410 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:22.628410 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:22.628410 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:22.628410 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:22.628410 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:22.628410 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:55:22.628410 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:55:22.628410 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:22.628410 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:22.628410 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 04 16:55:22.628410 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 04 16:55:22.628410 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:55:22.628410 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:55:22.628410 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:55:22.628410 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:55:22.628410 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:55:22.628410 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:55:22.628410 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:55:22.628410 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:55:22.629673 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:55:22.629673 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:55:22.629673 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:55:22.629673 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:55:22.629673 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:55:22.629673 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:55:22.629673 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 04 16:55:22.629673 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:22.629673 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:22.629673 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:22.629673 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:22.629673 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:22.629673 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:22.629673 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:55:22.629673 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:55:22.629673 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 04 16:55:22.629673 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:22.631792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a435302a-e096-456f-8c8e-951b3b37fa52 tempest-HostsAdminNegativeTestJSON-885164280 tempest-HostsAdminNegativeTestJSON-885164280-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:22.632872 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a435302a-e096-456f-8c8e-951b3b37fa52 tempest-HostsAdminNegativeTestJSON-885164280 tempest-HostsAdminNegativeTestJSON-885164280-project] 10.222.0.93 "GET /compute/v2.1/os-hosts/n-d-851359-3/reboot" status: 403 len: 111 microversion: 2.1 time: 0.017998 Aug 04 16:55:22.633641 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 127/258] 10.222.0.93 () {58 vars in 1188 bytes} [Thu Aug 4 16:55:22 2022] GET /compute/v2.1/os-hosts/n-d-851359-3/reboot => generated 111 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:55:22.639203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-762949bf-e861-4e8b-8b06-951d65b8d0ab tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:22.655584 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-762949bf-e861-4e8b-8b06-951d65b8d0ab tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-quota-sets/be3adfb9a88f408db259a4ea3ef47c75" status: 202 len: 0 microversion: 2.1 time: 0.018937 Aug 04 16:55:22.658011 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 128/259] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Aug 4 16:55:22 2022] DELETE /compute/v2.1/os-quota-sets/be3adfb9a88f408db259a4ea3ef47c75 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:55:22.672588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-24d41a95-bed2-4c74-80f8-e16c35ab57f9 tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] Calling method '.version_select at 0x7f1e6814e940>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:22.700157 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-24d41a95-bed2-4c74-80f8-e16c35ab57f9 tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:55:22.708671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-24d41a95-bed2-4c74-80f8-e16c35ab57f9 tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] Request method failure captured: Aug 04 16:55:22.708671 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 04 16:55:22.708671 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:55:22.708671 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:55:22.708671 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:55:22.708671 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:55:22.708671 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:55:22.708671 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:55:22.708671 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:55:22.708671 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:22.708671 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_n3tLlqqE616hO9BvZKKFRXFrki876FQMyDZtzCHfLAkmqq2LmxV0NRTL4in4UvKijG9oXkbxs5mvSRlie_Hvv81EmuDSTaa7Co0M9pD_uht0uZXBsMJ21eiH5DD-kCyru1Q0V3e-GjTXDTJwXTSizRe1DvBg9y1z7fv_AQ7LiQXDM Aug 04 16:55:22.708671 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:55:22.708671 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:55:22.708671 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:55:22.708671 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:55:22.708671 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:55:22.708671 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:55:22.708671 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 4408b96961bb421fb9261176fce8f402 Aug 04 16:55:22.708671 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-485279365 Aug 04 16:55:22.708671 n-d-851359-3 devstack@n-api.service[131044]: X-Role: admin,member,reader Aug 04 16:55:22.708671 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: admin,member,reader Aug 04 16:55:22.710381 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4408b96961bb421fb9261176fce8f402"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4408b96961bb421fb9261176fce8f402"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4408b96961bb421fb9261176fce8f402"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4408b96961bb421fb9261176fce8f402"}]}] Aug 04 16:55:22.710381 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-HostsAdminNegativeTestJSON-485279365 Aug 04 16:55:22.710381 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 4408b96961bb421fb9261176fce8f402 Aug 04 16:55:22.710381 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-485279365 Aug 04 16:55:22.710381 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-HostsAdminNegativeTestJSON-485279365-project-admin Aug 04 16:55:22.710381 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:55:22.710381 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:55:22.710381 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 92ee2e5940ef4f58aa2d0e28466aa9e6 Aug 04 16:55:22.710381 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-HostsAdminNegativeTestJSON-485279365-project-admin Aug 04 16:55:22.710381 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:55:22.710381 n-d-851359-3 devstack@n-api.service[131044]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:55:22.710381 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'nonexistent_hostname'} Aug 04 16:55:22.710381 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:22.711235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:22.711235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 04 16:55:22.711235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 04 16:55:22.711235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 16:55:22.711235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 16:55:22.711235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:55:22.711235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:55:22.711235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:55:22.711235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:55:22.711235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 16:55:22.711235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 16:55:22.711235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 04 16:55:22.711235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 04 16:55:22.711235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:55:22.711235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:55:22.711235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 04 16:55:22.711235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 04 16:55:22.711235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:55:22.711235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:55:22.713107 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 04 16:55:22.713107 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 04 16:55:22.713107 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:55:22.713107 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:22.713107 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:22.713107 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:22.713107 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:22.713107 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:22.713107 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:22.713107 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:22.713107 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:22.713107 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:55:22.713107 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:55:22.713107 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:22.713107 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:22.713107 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 04 16:55:22.713107 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 04 16:55:22.713107 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 04 16:55:22.713107 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:55:22.714467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:55:22.714467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:22.714467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:22.714467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:22.714467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:22.714467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:22.714467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:22.714467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:55:22.714467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:55:22.714467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:55:22.714467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:22.719311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-24d41a95-bed2-4c74-80f8-e16c35ab57f9 tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:22.725341 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-24d41a95-bed2-4c74-80f8-e16c35ab57f9 tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.063182 Aug 04 16:55:22.728038 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 129/260] 10.222.0.93 () {58 vars in 1212 bytes} [Thu Aug 4 16:55:22 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:55:22.743031 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1686e954-357b-4ed6-9ec0-1f1dfbe99c1f tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Calling method '.version_select at 0x7f1e6804b1f0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:22.899247 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1686e954-357b-4ed6-9ec0-1f1dfbe99c1f tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/be3adfb9a88f408db259a4ea3ef47c75" status: 200 len: 371 microversion: 2.1 time: 0.168947 Aug 04 16:55:22.899847 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 130/261] 10.222.0.93 () {58 vars in 1242 bytes} [Thu Aug 4 16:55:22 2022] GET /compute/v2.1/os-quota-sets/be3adfb9a88f408db259a4ea3ef47c75 => generated 371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:22.927809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7b1d6d15-0e18-42f7-9da4-cbbc9a4b9e59 tempest-HostsAdminNegativeTestJSON-885164280 tempest-HostsAdminNegativeTestJSON-885164280-project] Calling method '.version_select at 0x7f1e6804b4c0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:22.928820 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:22.928820 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:22.938334 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7b1d6d15-0e18-42f7-9da4-cbbc9a4b9e59 tempest-HostsAdminNegativeTestJSON-885164280 tempest-HostsAdminNegativeTestJSON-885164280-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '621db0dc13694b9c80abc6c8104fbd61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4221224e414427c9f72883dd8143172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:22.960283 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7b1d6d15-0e18-42f7-9da4-cbbc9a4b9e59 tempest-HostsAdminNegativeTestJSON-885164280 tempest-HostsAdminNegativeTestJSON-885164280-project] Request method failure captured: Aug 04 16:55:22.960283 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-hosts/n-d-851359-3 HTTP/1.1 Aug 04 16:55:22.960283 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:55:22.960283 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:55:22.960283 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:55:22.960283 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:55:22.960283 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:55:22.960283 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:55:22.960283 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:55:22.960283 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:22.960283 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_n1d8s5XSsDGLCh6mYukQynU03VKvXq27a1ho7Vc8fKaZK09oopTqMsihLNavo2ldVNSEUXSRlCOIqTn4YB6Q52r0H1zErtwgHKhJgHZXIw8UI6v-nOpYCJWAz4iwYvai4vkrpM8E-K0mBbHn_rbzJnWmHghGIQ6UOEazVwjCXSKpk Aug 04 16:55:22.960283 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:55:22.960283 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:55:22.960283 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:55:22.960283 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:55:22.960283 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:55:22.960283 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:55:22.960283 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: b4221224e414427c9f72883dd8143172 Aug 04 16:55:22.960283 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-885164280 Aug 04 16:55:22.960283 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:55:22.960283 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:55:22.961735 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b4221224e414427c9f72883dd8143172"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b4221224e414427c9f72883dd8143172"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b4221224e414427c9f72883dd8143172"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b4221224e414427c9f72883dd8143172"}]}] Aug 04 16:55:22.961735 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-HostsAdminNegativeTestJSON-885164280 Aug 04 16:55:22.961735 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: b4221224e414427c9f72883dd8143172 Aug 04 16:55:22.961735 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-885164280 Aug 04 16:55:22.961735 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-HostsAdminNegativeTestJSON-885164280-project Aug 04 16:55:22.961735 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:55:22.961735 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:55:22.961735 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 621db0dc13694b9c80abc6c8104fbd61 Aug 04 16:55:22.961735 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-HostsAdminNegativeTestJSON-885164280-project Aug 04 16:55:22.961735 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:55:22.961735 n-d-851359-3 devstack@n-api.service[131044]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 04 16:55:22.961735 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'n-d-851359-3'} Aug 04 16:55:22.961735 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:22.962585 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:22.962585 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:22.962585 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:22.962585 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:22.962585 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:22.962585 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:55:22.962585 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:55:22.962585 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:22.962585 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:22.962585 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 04 16:55:22.962585 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 04 16:55:22.962585 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:55:22.962585 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:55:22.962585 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:55:22.962585 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:55:22.962585 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:55:22.962585 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:55:22.962585 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:55:22.962585 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:55:22.963818 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:55:22.963818 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:55:22.963818 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:55:22.963818 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:55:22.963818 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:55:22.963818 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:55:22.963818 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 04 16:55:22.963818 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:22.963818 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:22.963818 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:22.963818 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:22.963818 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:22.963818 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:22.963818 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:55:22.963818 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:55:22.963818 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 04 16:55:22.963818 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:22.964908 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7b1d6d15-0e18-42f7-9da4-cbbc9a4b9e59 tempest-HostsAdminNegativeTestJSON-885164280 tempest-HostsAdminNegativeTestJSON-885164280-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:22.972957 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7b1d6d15-0e18-42f7-9da4-cbbc9a4b9e59 tempest-HostsAdminNegativeTestJSON-885164280 tempest-HostsAdminNegativeTestJSON-885164280-project] 10.222.0.93 "GET /compute/v2.1/os-hosts/n-d-851359-3" status: 403 len: 109 microversion: 2.1 time: 0.058780 Aug 04 16:55:22.979794 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 131/262] 10.222.0.93 () {58 vars in 1167 bytes} [Thu Aug 4 16:55:22 2022] GET /compute/v2.1/os-hosts/n-d-851359-3 => generated 109 bytes in 73 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:55:23.017330 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9bc6aa12-0d27-4cdd-a449-e04a30138685 tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] Calling method '.version_select at 0x7f1e68087160>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:23.042112 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-9bc6aa12-0d27-4cdd-a449-e04a30138685 tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:55:23.051520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9bc6aa12-0d27-4cdd-a449-e04a30138685 tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] Request method failure captured: Aug 04 16:55:23.051520 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 04 16:55:23.051520 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:55:23.051520 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:55:23.051520 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:55:23.051520 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:55:23.051520 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:55:23.051520 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:55:23.051520 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:55:23.051520 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:23.051520 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_n3tLlqqE616hO9BvZKKFRXFrki876FQMyDZtzCHfLAkmqq2LmxV0NRTL4in4UvKijG9oXkbxs5mvSRlie_Hvv81EmuDSTaa7Co0M9pD_uht0uZXBsMJ21eiH5DD-kCyru1Q0V3e-GjTXDTJwXTSizRe1DvBg9y1z7fv_AQ7LiQXDM Aug 04 16:55:23.051520 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:55:23.051520 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:55:23.051520 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:55:23.051520 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:55:23.051520 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:55:23.051520 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:55:23.051520 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 4408b96961bb421fb9261176fce8f402 Aug 04 16:55:23.051520 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-485279365 Aug 04 16:55:23.051520 n-d-851359-3 devstack@n-api.service[131044]: X-Role: admin,member,reader Aug 04 16:55:23.051520 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: admin,member,reader Aug 04 16:55:23.052710 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4408b96961bb421fb9261176fce8f402"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4408b96961bb421fb9261176fce8f402"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4408b96961bb421fb9261176fce8f402"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4408b96961bb421fb9261176fce8f402"}]}] Aug 04 16:55:23.052710 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-HostsAdminNegativeTestJSON-485279365 Aug 04 16:55:23.052710 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 4408b96961bb421fb9261176fce8f402 Aug 04 16:55:23.052710 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-485279365 Aug 04 16:55:23.052710 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-HostsAdminNegativeTestJSON-485279365-project-admin Aug 04 16:55:23.052710 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:55:23.052710 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:55:23.052710 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 92ee2e5940ef4f58aa2d0e28466aa9e6 Aug 04 16:55:23.052710 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-HostsAdminNegativeTestJSON-485279365-project-admin Aug 04 16:55:23.052710 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:55:23.052710 n-d-851359-3 devstack@n-api.service[131044]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:55:23.052710 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'nonexistent_hostname'} Aug 04 16:55:23.052710 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:23.053391 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:23.053391 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 04 16:55:23.053391 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 04 16:55:23.053391 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:55:23.053391 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:55:23.053391 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 04 16:55:23.053391 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 04 16:55:23.053391 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:55:23.053391 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:55:23.053391 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 04 16:55:23.053391 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 04 16:55:23.053391 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:55:23.053391 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.053391 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:23.053391 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.053391 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:23.053391 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:23.053391 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:23.053391 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:23.062952 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:23.062952 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:55:23.062952 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:55:23.062952 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:23.062952 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:23.062952 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 04 16:55:23.062952 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:55:23.062952 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:55:23.062952 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.062952 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:23.062952 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.062952 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:23.062952 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:23.062952 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:23.062952 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:55:23.062952 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:55:23.062952 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:55:23.062952 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.063940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9bc6aa12-0d27-4cdd-a449-e04a30138685 tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:23.063940 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9bc6aa12-0d27-4cdd-a449-e04a30138685 tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.070790 Aug 04 16:55:23.063940 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 132/263] 10.222.0.93 () {58 vars in 1191 bytes} [Thu Aug 4 16:55:22 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:55:23.080850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5990d1f1-504e-4831-9215-5a85bf34f7d1 tempest-HostsAdminNegativeTestJSON-885164280 tempest-HostsAdminNegativeTestJSON-885164280-project] Calling method '.version_select at 0x7f1e5bfebd30>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:23.082574 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:23.082574 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:23.092655 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5990d1f1-504e-4831-9215-5a85bf34f7d1 tempest-HostsAdminNegativeTestJSON-885164280 tempest-HostsAdminNegativeTestJSON-885164280-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '621db0dc13694b9c80abc6c8104fbd61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4221224e414427c9f72883dd8143172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:23.094459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5990d1f1-504e-4831-9215-5a85bf34f7d1 tempest-HostsAdminNegativeTestJSON-885164280 tempest-HostsAdminNegativeTestJSON-885164280-project] Request method failure captured: Aug 04 16:55:23.094459 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-hosts/n-d-851359-3/shutdown HTTP/1.1 Aug 04 16:55:23.094459 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:55:23.094459 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:55:23.094459 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:55:23.094459 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:55:23.094459 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:55:23.094459 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:55:23.094459 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:55:23.094459 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:23.094459 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_n1d8s5XSsDGLCh6mYukQynU03VKvXq27a1ho7Vc8fKaZK09oopTqMsihLNavo2ldVNSEUXSRlCOIqTn4YB6Q52r0H1zErtwgHKhJgHZXIw8UI6v-nOpYCJWAz4iwYvai4vkrpM8E-K0mBbHn_rbzJnWmHghGIQ6UOEazVwjCXSKpk Aug 04 16:55:23.094459 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:55:23.094459 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:55:23.094459 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:55:23.094459 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:55:23.094459 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:55:23.094459 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:55:23.094459 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: b4221224e414427c9f72883dd8143172 Aug 04 16:55:23.094459 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-885164280 Aug 04 16:55:23.094459 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:55:23.094459 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:55:23.095669 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b4221224e414427c9f72883dd8143172"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b4221224e414427c9f72883dd8143172"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b4221224e414427c9f72883dd8143172"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b4221224e414427c9f72883dd8143172"}]}] Aug 04 16:55:23.095669 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-HostsAdminNegativeTestJSON-885164280 Aug 04 16:55:23.095669 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: b4221224e414427c9f72883dd8143172 Aug 04 16:55:23.095669 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-885164280 Aug 04 16:55:23.095669 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-HostsAdminNegativeTestJSON-885164280-project Aug 04 16:55:23.095669 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:55:23.095669 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:55:23.095669 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 621db0dc13694b9c80abc6c8104fbd61 Aug 04 16:55:23.095669 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-HostsAdminNegativeTestJSON-885164280-project Aug 04 16:55:23.095669 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:55:23.095669 n-d-851359-3 devstack@n-api.service[131044]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 04 16:55:23.095669 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'n-d-851359-3'} Aug 04 16:55:23.095669 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:23.096533 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:23.096533 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:23.096533 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:23.096533 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:23.096533 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:23.096533 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:55:23.096533 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:55:23.096533 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:23.096533 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:23.096533 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 04 16:55:23.096533 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 04 16:55:23.096533 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:55:23.096533 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:55:23.096533 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:55:23.096533 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:55:23.096533 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:55:23.096533 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:55:23.096533 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:55:23.096533 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:55:23.097802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:55:23.097802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:55:23.097802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:55:23.097802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:55:23.097802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:55:23.097802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:55:23.097802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 04 16:55:23.097802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.097802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:23.097802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.097802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:23.097802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:23.097802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:23.097802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:55:23.097802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:55:23.097802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 04 16:55:23.097802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.102489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5990d1f1-504e-4831-9215-5a85bf34f7d1 tempest-HostsAdminNegativeTestJSON-885164280 tempest-HostsAdminNegativeTestJSON-885164280-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:23.107124 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5990d1f1-504e-4831-9215-5a85bf34f7d1 tempest-HostsAdminNegativeTestJSON-885164280 tempest-HostsAdminNegativeTestJSON-885164280-project] 10.222.0.93 "GET /compute/v2.1/os-hosts/n-d-851359-3/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.045025 Aug 04 16:55:23.118284 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 133/264] 10.222.0.93 () {58 vars in 1194 bytes} [Thu Aug 4 16:55:23 2022] GET /compute/v2.1/os-hosts/n-d-851359-3/shutdown => generated 113 bytes in 57 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:55:23.130379 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-83d5ed90-0bba-423e-8a3e-e3dcad7de1f0 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:23.131156 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-83d5ed90-0bba-423e-8a3e-e3dcad7de1f0 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:23.147223 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83d5ed90-0bba-423e-8a3e-e3dcad7de1f0 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:23.149003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83d5ed90-0bba-423e-8a3e-e3dcad7de1f0 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:23.149764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83d5ed90-0bba-423e-8a3e-e3dcad7de1f0 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:23.151586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83d5ed90-0bba-423e-8a3e-e3dcad7de1f0 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:23.154379 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83d5ed90-0bba-423e-8a3e-e3dcad7de1f0 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:23.155036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83d5ed90-0bba-423e-8a3e-e3dcad7de1f0 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:23.470952 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ebdc6ff8-3ddd-47a8-bb83-b42126354dbc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:23.488127 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ebdc6ff8-3ddd-47a8-bb83-b42126354dbc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1312 microversion: 2.1 time: 1.074429 Aug 04 16:55:23.492516 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 132/265] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:22 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1312 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:23.500932 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0f43191d-c1e9-4f33-866c-388b8ee83e7f tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] Calling method '.version_select at 0x7f1e68143a60>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:23.505719 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:23.505719 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:55:23.538184 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-0f43191d-c1e9-4f33-866c-388b8ee83e7f tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:55:23.546086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0f43191d-c1e9-4f33-866c-388b8ee83e7f tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] Request method failure captured: Aug 04 16:55:23.546086 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 04 16:55:23.546086 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:55:23.546086 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:55:23.546086 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:55:23.546086 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:55:23.546086 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:55:23.546086 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:55:23.546086 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:55:23.546086 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:23.546086 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_n3tLlqqE616hO9BvZKKFRXFrki876FQMyDZtzCHfLAkmqq2LmxV0NRTL4in4UvKijG9oXkbxs5mvSRlie_Hvv81EmuDSTaa7Co0M9pD_uht0uZXBsMJ21eiH5DD-kCyru1Q0V3e-GjTXDTJwXTSizRe1DvBg9y1z7fv_AQ7LiQXDM Aug 04 16:55:23.546086 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:55:23.546086 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:55:23.546086 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:55:23.546086 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:55:23.546086 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:55:23.546086 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:55:23.546086 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 4408b96961bb421fb9261176fce8f402 Aug 04 16:55:23.546086 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-485279365 Aug 04 16:55:23.546086 n-d-851359-3 devstack@n-api.service[131043]: X-Role: admin,member,reader Aug 04 16:55:23.546086 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: admin,member,reader Aug 04 16:55:23.547531 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4408b96961bb421fb9261176fce8f402"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4408b96961bb421fb9261176fce8f402"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4408b96961bb421fb9261176fce8f402"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4408b96961bb421fb9261176fce8f402"}]}] Aug 04 16:55:23.547531 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-HostsAdminNegativeTestJSON-485279365 Aug 04 16:55:23.547531 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 4408b96961bb421fb9261176fce8f402 Aug 04 16:55:23.547531 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-485279365 Aug 04 16:55:23.547531 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-HostsAdminNegativeTestJSON-485279365-project-admin Aug 04 16:55:23.547531 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:55:23.547531 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:55:23.547531 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 92ee2e5940ef4f58aa2d0e28466aa9e6 Aug 04 16:55:23.547531 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-HostsAdminNegativeTestJSON-485279365-project-admin Aug 04 16:55:23.547531 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 16:55:23.547531 n-d-851359-3 devstack@n-api.service[131043]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:55:23.547531 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'nonexistent_hostname'} Aug 04 16:55:23.547531 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:23.548378 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:23.548378 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 04 16:55:23.548378 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 04 16:55:23.548378 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 16:55:23.548378 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 16:55:23.548378 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:55:23.548378 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:55:23.548378 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:55:23.548378 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:55:23.548378 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 16:55:23.548378 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 16:55:23.548378 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 04 16:55:23.548378 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 04 16:55:23.548378 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:55:23.548378 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:55:23.548378 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 04 16:55:23.548378 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 04 16:55:23.548378 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:55:23.548378 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:55:23.549631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 04 16:55:23.549631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 04 16:55:23.549631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:55:23.549631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.549631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:23.549631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.549631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:23.549631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:23.549631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:23.549631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:23.549631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:23.549631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:55:23.549631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:55:23.549631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:23.549631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:23.549631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 04 16:55:23.549631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 04 16:55:23.549631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 04 16:55:23.549631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:55:23.550950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:55:23.550950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.550950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:23.550950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.550950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:23.550950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:23.550950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:23.550950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:55:23.550950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:55:23.550950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:55:23.550950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.550950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0f43191d-c1e9-4f33-866c-388b8ee83e7f tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:23.551716 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0f43191d-c1e9-4f33-866c-388b8ee83e7f tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.057716 Aug 04 16:55:23.552951 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 133/266] 10.222.0.93 () {58 vars in 1218 bytes} [Thu Aug 4 16:55:23 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:55:23.575131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-deff2836-9305-4b45-abb2-d04eb5de2916 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Calling method '.version_select at 0x7f1e68267a60>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:23.738735 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-83d5ed90-0bba-423e-8a3e-e3dcad7de1f0 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:23.748775 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-83d5ed90-0bba-423e-8a3e-e3dcad7de1f0 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13" status: 200 len: 1390 microversion: 2.1 time: 0.628866 Aug 04 16:55:23.750276 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 134/267] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:23 2022] GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 => generated 1390 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:23.762273 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4fc4a504-73ab-4cc9-9a50-ff5f145f0a84 tempest-HostsAdminNegativeTestJSON-885164280 tempest-HostsAdminNegativeTestJSON-885164280-project] Calling method '.version_select at 0x7f1e5bfd8af0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:23.763827 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:23.763827 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:23.767368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4fc4a504-73ab-4cc9-9a50-ff5f145f0a84 tempest-HostsAdminNegativeTestJSON-885164280 tempest-HostsAdminNegativeTestJSON-885164280-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '621db0dc13694b9c80abc6c8104fbd61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4221224e414427c9f72883dd8143172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:23.771814 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4fc4a504-73ab-4cc9-9a50-ff5f145f0a84 tempest-HostsAdminNegativeTestJSON-885164280 tempest-HostsAdminNegativeTestJSON-885164280-project] Request method failure captured: Aug 04 16:55:23.771814 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-hosts/n-d-851359-3/startup HTTP/1.1 Aug 04 16:55:23.771814 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:55:23.771814 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:55:23.771814 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:55:23.771814 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:55:23.771814 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:55:23.771814 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:55:23.771814 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:55:23.771814 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:23.771814 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_n1d8s5XSsDGLCh6mYukQynU03VKvXq27a1ho7Vc8fKaZK09oopTqMsihLNavo2ldVNSEUXSRlCOIqTn4YB6Q52r0H1zErtwgHKhJgHZXIw8UI6v-nOpYCJWAz4iwYvai4vkrpM8E-K0mBbHn_rbzJnWmHghGIQ6UOEazVwjCXSKpk Aug 04 16:55:23.771814 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:55:23.771814 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:55:23.771814 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:55:23.771814 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:55:23.771814 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:55:23.771814 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:55:23.771814 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: b4221224e414427c9f72883dd8143172 Aug 04 16:55:23.771814 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-885164280 Aug 04 16:55:23.771814 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:55:23.771814 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:55:23.773152 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b4221224e414427c9f72883dd8143172"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b4221224e414427c9f72883dd8143172"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b4221224e414427c9f72883dd8143172"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b4221224e414427c9f72883dd8143172"}]}] Aug 04 16:55:23.773152 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-HostsAdminNegativeTestJSON-885164280 Aug 04 16:55:23.773152 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: b4221224e414427c9f72883dd8143172 Aug 04 16:55:23.773152 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-885164280 Aug 04 16:55:23.773152 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-HostsAdminNegativeTestJSON-885164280-project Aug 04 16:55:23.773152 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:55:23.773152 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:55:23.773152 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 621db0dc13694b9c80abc6c8104fbd61 Aug 04 16:55:23.773152 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-HostsAdminNegativeTestJSON-885164280-project Aug 04 16:55:23.773152 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:55:23.773152 n-d-851359-3 devstack@n-api.service[131044]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 04 16:55:23.773152 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'n-d-851359-3'} Aug 04 16:55:23.773152 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:23.773914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:23.773914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:23.773914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:23.773914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:23.773914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:23.773914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:55:23.773914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:55:23.773914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:23.773914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:23.773914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 04 16:55:23.773914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 04 16:55:23.773914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:55:23.773914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:55:23.773914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:55:23.773914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:55:23.773914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:55:23.773914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:55:23.773914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:55:23.773914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:55:23.775257 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:55:23.775257 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:55:23.775257 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:55:23.775257 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:55:23.775257 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:55:23.775257 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:55:23.775257 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 04 16:55:23.775257 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.775257 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:23.775257 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.775257 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:23.775257 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:23.775257 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:23.775257 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:55:23.775257 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:55:23.775257 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 04 16:55:23.775257 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.777909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4fc4a504-73ab-4cc9-9a50-ff5f145f0a84 tempest-HostsAdminNegativeTestJSON-885164280 tempest-HostsAdminNegativeTestJSON-885164280-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:23.782974 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4fc4a504-73ab-4cc9-9a50-ff5f145f0a84 tempest-HostsAdminNegativeTestJSON-885164280 tempest-HostsAdminNegativeTestJSON-885164280-project] 10.222.0.93 "GET /compute/v2.1/os-hosts/n-d-851359-3/startup" status: 403 len: 110 microversion: 2.1 time: 0.031516 Aug 04 16:55:23.783697 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 135/268] 10.222.0.93 () {58 vars in 1191 bytes} [Thu Aug 4 16:55:23 2022] GET /compute/v2.1/os-hosts/n-d-851359-3/startup => generated 110 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:55:23.794476 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-937e488c-b624-4201-8e94-83aba8e5d6f8 tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] Calling method '.version_select at 0x7f1e5bfcf1f0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:23.815489 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-937e488c-b624-4201-8e94-83aba8e5d6f8 tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:55:23.820937 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-937e488c-b624-4201-8e94-83aba8e5d6f8 tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] Request method failure captured: Aug 04 16:55:23.820937 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 04 16:55:23.820937 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:55:23.820937 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:55:23.820937 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:55:23.820937 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:55:23.820937 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:55:23.820937 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:55:23.820937 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:55:23.820937 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:23.820937 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_n3tLlqqE616hO9BvZKKFRXFrki876FQMyDZtzCHfLAkmqq2LmxV0NRTL4in4UvKijG9oXkbxs5mvSRlie_Hvv81EmuDSTaa7Co0M9pD_uht0uZXBsMJ21eiH5DD-kCyru1Q0V3e-GjTXDTJwXTSizRe1DvBg9y1z7fv_AQ7LiQXDM Aug 04 16:55:23.820937 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:55:23.820937 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:55:23.820937 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:55:23.820937 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:55:23.820937 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:55:23.820937 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:55:23.820937 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 4408b96961bb421fb9261176fce8f402 Aug 04 16:55:23.820937 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-485279365 Aug 04 16:55:23.820937 n-d-851359-3 devstack@n-api.service[131044]: X-Role: admin,member,reader Aug 04 16:55:23.820937 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: admin,member,reader Aug 04 16:55:23.822392 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4408b96961bb421fb9261176fce8f402"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4408b96961bb421fb9261176fce8f402"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4408b96961bb421fb9261176fce8f402"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4408b96961bb421fb9261176fce8f402"}]}] Aug 04 16:55:23.822392 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-HostsAdminNegativeTestJSON-485279365 Aug 04 16:55:23.822392 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 4408b96961bb421fb9261176fce8f402 Aug 04 16:55:23.822392 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-485279365 Aug 04 16:55:23.822392 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-HostsAdminNegativeTestJSON-485279365-project-admin Aug 04 16:55:23.822392 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:55:23.822392 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:55:23.822392 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 92ee2e5940ef4f58aa2d0e28466aa9e6 Aug 04 16:55:23.822392 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-HostsAdminNegativeTestJSON-485279365-project-admin Aug 04 16:55:23.822392 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:55:23.822392 n-d-851359-3 devstack@n-api.service[131044]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:55:23.822392 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'nonexistent_hostname'} Aug 04 16:55:23.822392 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:23.823148 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:23.823148 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 04 16:55:23.823148 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 04 16:55:23.823148 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 16:55:23.823148 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 16:55:23.823148 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:55:23.823148 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:55:23.823148 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:55:23.823148 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:55:23.823148 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 16:55:23.823148 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 16:55:23.823148 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 04 16:55:23.823148 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 04 16:55:23.823148 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:55:23.823148 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:55:23.823148 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 04 16:55:23.823148 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 04 16:55:23.823148 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:55:23.823148 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:55:23.824236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 04 16:55:23.824236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 04 16:55:23.824236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:55:23.824236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.824236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:23.824236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.824236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:23.824236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:23.824236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:23.824236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:23.824236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:23.824236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:55:23.824236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:55:23.824236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:23.824236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:23.824236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 04 16:55:23.824236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 04 16:55:23.824236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 04 16:55:23.824236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:55:23.825484 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:55:23.825484 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.825484 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:23.825484 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.825484 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:23.825484 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:23.825484 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:23.825484 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:55:23.825484 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:55:23.825484 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:55:23.825484 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.830754 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-937e488c-b624-4201-8e94-83aba8e5d6f8 tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:23.837741 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-937e488c-b624-4201-8e94-83aba8e5d6f8 tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.048069 Aug 04 16:55:23.838859 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 136/269] 10.222.0.93 () {58 vars in 1215 bytes} [Thu Aug 4 16:55:23 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 04 16:55:23.852356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fb5ab72c-afa3-419c-bb8c-61cda7995f8e tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] Action: 'update', calling method: .version_select at 0x7f1e6816f790>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:23.856854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fb5ab72c-afa3-419c-bb8c-61cda7995f8e tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] Request method failure captured: Aug 04 16:55:23.856854 n-d-851359-3 devstack@n-api.service[131044]: request: PUT /compute/v2.1/os-hosts/n-d-851359-3 HTTP/1.1 Aug 04 16:55:23.856854 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:55:23.856854 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:55:23.856854 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:55:23.856854 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 51 Aug 04 16:55:23.856854 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:55:23.856854 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:55:23.856854 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:55:23.856854 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:23.856854 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_n3tLlqqE616hO9BvZKKFRXFrki876FQMyDZtzCHfLAkmqq2LmxV0NRTL4in4UvKijG9oXkbxs5mvSRlie_Hvv81EmuDSTaa7Co0M9pD_uht0uZXBsMJ21eiH5DD-kCyru1Q0V3e-GjTXDTJwXTSizRe1DvBg9y1z7fv_AQ7LiQXDM Aug 04 16:55:23.856854 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:55:23.856854 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:55:23.856854 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:55:23.856854 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:55:23.856854 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:55:23.856854 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:55:23.856854 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 4408b96961bb421fb9261176fce8f402 Aug 04 16:55:23.856854 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-485279365 Aug 04 16:55:23.856854 n-d-851359-3 devstack@n-api.service[131044]: X-Role: admin,member,reader Aug 04 16:55:23.856854 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: admin,member,reader Aug 04 16:55:23.858202 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4408b96961bb421fb9261176fce8f402"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4408b96961bb421fb9261176fce8f402"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4408b96961bb421fb9261176fce8f402"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4408b96961bb421fb9261176fce8f402"}]}] Aug 04 16:55:23.858202 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-HostsAdminNegativeTestJSON-485279365 Aug 04 16:55:23.858202 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 4408b96961bb421fb9261176fce8f402 Aug 04 16:55:23.858202 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-485279365 Aug 04 16:55:23.858202 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-HostsAdminNegativeTestJSON-485279365-project-admin Aug 04 16:55:23.858202 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:55:23.858202 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:55:23.858202 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 92ee2e5940ef4f58aa2d0e28466aa9e6 Aug 04 16:55:23.858202 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-HostsAdminNegativeTestJSON-485279365-project-admin Aug 04 16:55:23.858202 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 16:55:23.858202 n-d-851359-3 devstack@n-api.service[131044]: {"status": "enable", "maintenance_mode": "invalid"} Aug 04 16:55:23.858202 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:55:23.858202 n-d-851359-3 devstack@n-api.service[131044]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 04 16:55:23.859320 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'n-d-851359-3', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 04 16:55:23.859320 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:23.859320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:23.859320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:55:23.859320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:55:23.859320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:55:23.859320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:55:23.859320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 04 16:55:23.859320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.859320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 04 16:55:23.859320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 04 16:55:23.859320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'disable', Aug 04 16:55:23.859320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'Enable', Aug 04 16:55:23.859320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'Disable', Aug 04 16:55:23.859320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 04 16:55:23.859320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 04 16:55:23.859320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 04 16:55:23.859320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.859320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance: Aug 04 16:55:23.859320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'invalid' Aug 04 16:55:23.859320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.859320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:23.859320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.859320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:23.859320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:23.860990 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:23.860990 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:23.860990 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:23.860990 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:55:23.860990 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:55:23.860990 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:23.860990 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:23.860990 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 16:55:23.860990 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 16:55:23.860990 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:55:23.860990 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:55:23.860990 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:55:23.860990 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:55:23.860990 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 04 16:55:23.860990 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.860990 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:23.860990 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.860990 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:23.860990 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:23.862913 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:23.862913 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:55:23.862913 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:55:23.862913 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 04 16:55:23.862913 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.869188 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fb5ab72c-afa3-419c-bb8c-61cda7995f8e tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:23.870320 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fb5ab72c-afa3-419c-bb8c-61cda7995f8e tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-hosts/n-d-851359-3" status: 400 len: 199 microversion: 2.1 time: 0.026534 Aug 04 16:55:23.871355 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 137/270] 10.222.0.93 () {60 vars in 1187 bytes} [Thu Aug 4 16:55:23 2022] PUT /compute/v2.1/os-hosts/n-d-851359-3 => generated 199 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 16:55:23.903081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2f96e440-01c8-4cbe-9198-53841dfab301 tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] Action: 'update', calling method: .version_select at 0x7f1e5bfd80d0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:23.911470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2f96e440-01c8-4cbe-9198-53841dfab301 tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] Request method failure captured: Aug 04 16:55:23.911470 n-d-851359-3 devstack@n-api.service[131044]: request: PUT /compute/v2.1/os-hosts/n-d-851359-3 HTTP/1.1 Aug 04 16:55:23.911470 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:55:23.911470 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:55:23.911470 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:55:23.911470 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 51 Aug 04 16:55:23.911470 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:55:23.911470 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:55:23.911470 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:55:23.911470 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:23.911470 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_n3tLlqqE616hO9BvZKKFRXFrki876FQMyDZtzCHfLAkmqq2LmxV0NRTL4in4UvKijG9oXkbxs5mvSRlie_Hvv81EmuDSTaa7Co0M9pD_uht0uZXBsMJ21eiH5DD-kCyru1Q0V3e-GjTXDTJwXTSizRe1DvBg9y1z7fv_AQ7LiQXDM Aug 04 16:55:23.911470 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:55:23.911470 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:55:23.911470 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:55:23.911470 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:55:23.911470 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:55:23.911470 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:55:23.911470 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 4408b96961bb421fb9261176fce8f402 Aug 04 16:55:23.911470 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-485279365 Aug 04 16:55:23.911470 n-d-851359-3 devstack@n-api.service[131044]: X-Role: admin,member,reader Aug 04 16:55:23.911470 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: admin,member,reader Aug 04 16:55:23.912962 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4408b96961bb421fb9261176fce8f402"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4408b96961bb421fb9261176fce8f402"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4408b96961bb421fb9261176fce8f402"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4408b96961bb421fb9261176fce8f402"}]}] Aug 04 16:55:23.912962 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-HostsAdminNegativeTestJSON-485279365 Aug 04 16:55:23.912962 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 4408b96961bb421fb9261176fce8f402 Aug 04 16:55:23.912962 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-485279365 Aug 04 16:55:23.912962 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-HostsAdminNegativeTestJSON-485279365-project-admin Aug 04 16:55:23.912962 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:55:23.912962 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:55:23.912962 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 92ee2e5940ef4f58aa2d0e28466aa9e6 Aug 04 16:55:23.912962 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-HostsAdminNegativeTestJSON-485279365-project-admin Aug 04 16:55:23.912962 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 16:55:23.912962 n-d-851359-3 devstack@n-api.service[131044]: {"status": "invalid", "maintenance_mode": "enable"} Aug 04 16:55:23.912962 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:55:23.912962 n-d-851359-3 devstack@n-api.service[131044]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 04 16:55:23.913801 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'n-d-851359-3', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 04 16:55:23.913801 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:23.913801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:23.913801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:55:23.913801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:55:23.913801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:55:23.913801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:55:23.913801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 04 16:55:23.913801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.913801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 04 16:55:23.913801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 04 16:55:23.913801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'disable', Aug 04 16:55:23.913801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'Enable', Aug 04 16:55:23.913801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'Disable', Aug 04 16:55:23.913801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 04 16:55:23.913801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 04 16:55:23.913801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 04 16:55:23.913801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.913801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance: Aug 04 16:55:23.913801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'invalid' Aug 04 16:55:23.913801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.913801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:23.913801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.913801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:23.913801 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:23.915858 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:23.915858 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:23.915858 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:23.915858 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:55:23.915858 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:55:23.915858 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:23.915858 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:23.915858 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 16:55:23.915858 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 16:55:23.915858 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:55:23.915858 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:55:23.915858 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:55:23.915858 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:55:23.915858 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 04 16:55:23.915858 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.915858 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:23.915858 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.915858 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:23.915858 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:23.917714 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:23.917714 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:55:23.917714 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:55:23.917714 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 04 16:55:23.917714 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.923951 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2f96e440-01c8-4cbe-9198-53841dfab301 tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:23.926431 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2f96e440-01c8-4cbe-9198-53841dfab301 tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-hosts/n-d-851359-3" status: 400 len: 189 microversion: 2.1 time: 0.048888 Aug 04 16:55:23.928786 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 138/271] 10.222.0.93 () {60 vars in 1187 bytes} [Thu Aug 4 16:55:23 2022] PUT /compute/v2.1/os-hosts/n-d-851359-3 => generated 189 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:55:23.948015 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7c90c1e9-bc8f-4099-a615-a3dd3ef8c623 tempest-HostsAdminNegativeTestJSON-885164280 tempest-HostsAdminNegativeTestJSON-885164280-project] Action: 'update', calling method: .version_select at 0x7f1e680e70d0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:23.953969 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:23.953969 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:23.955639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7c90c1e9-bc8f-4099-a615-a3dd3ef8c623 tempest-HostsAdminNegativeTestJSON-885164280 tempest-HostsAdminNegativeTestJSON-885164280-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '621db0dc13694b9c80abc6c8104fbd61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4221224e414427c9f72883dd8143172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:23.958745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7c90c1e9-bc8f-4099-a615-a3dd3ef8c623 tempest-HostsAdminNegativeTestJSON-885164280 tempest-HostsAdminNegativeTestJSON-885164280-project] Request method failure captured: Aug 04 16:55:23.958745 n-d-851359-3 devstack@n-api.service[131044]: request: PUT /compute/v2.1/os-hosts/n-d-851359-3 HTTP/1.1 Aug 04 16:55:23.958745 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:55:23.958745 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:55:23.958745 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:55:23.958745 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 50 Aug 04 16:55:23.958745 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:55:23.958745 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:55:23.958745 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:55:23.958745 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:23.958745 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_n1d8s5XSsDGLCh6mYukQynU03VKvXq27a1ho7Vc8fKaZK09oopTqMsihLNavo2ldVNSEUXSRlCOIqTn4YB6Q52r0H1zErtwgHKhJgHZXIw8UI6v-nOpYCJWAz4iwYvai4vkrpM8E-K0mBbHn_rbzJnWmHghGIQ6UOEazVwjCXSKpk Aug 04 16:55:23.958745 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:55:23.958745 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:55:23.958745 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:55:23.958745 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:55:23.958745 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:55:23.958745 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:55:23.958745 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: b4221224e414427c9f72883dd8143172 Aug 04 16:55:23.958745 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-885164280 Aug 04 16:55:23.958745 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:55:23.958745 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:55:23.960406 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b4221224e414427c9f72883dd8143172"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b4221224e414427c9f72883dd8143172"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b4221224e414427c9f72883dd8143172"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b4221224e414427c9f72883dd8143172"}]}] Aug 04 16:55:23.960406 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-HostsAdminNegativeTestJSON-885164280 Aug 04 16:55:23.960406 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: b4221224e414427c9f72883dd8143172 Aug 04 16:55:23.960406 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-885164280 Aug 04 16:55:23.960406 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-HostsAdminNegativeTestJSON-885164280-project Aug 04 16:55:23.960406 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:55:23.960406 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:55:23.960406 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 621db0dc13694b9c80abc6c8104fbd61 Aug 04 16:55:23.960406 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-HostsAdminNegativeTestJSON-885164280-project Aug 04 16:55:23.960406 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 16:55:23.960406 n-d-851359-3 devstack@n-api.service[131044]: {"status": "enable", "maintenance_mode": "enable"} Aug 04 16:55:23.960406 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:55:23.960406 n-d-851359-3 devstack@n-api.service[131044]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 04 16:55:23.960406 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'n-d-851359-3', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 04 16:55:23.961868 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:23.961868 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:23.961868 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:23.961868 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:23.961868 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:23.961868 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:23.961868 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:55:23.961868 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:55:23.961868 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:23.961868 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:23.961868 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:55:23.961868 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:55:23.961868 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 04 16:55:23.961868 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 04 16:55:23.961868 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:55:23.961868 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:55:23.961868 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:55:23.961868 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:55:23.961868 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:55:23.961868 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:55:23.963402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:55:23.963402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:55:23.963402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:55:23.963402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:55:23.963402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:55:23.963402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:55:23.963402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:55:23.963402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:55:23.963402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 04 16:55:23.963402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.963402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:23.963402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:23.963402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:23.963402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:23.963402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:23.963402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:55:23.963402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:55:23.963402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 04 16:55:23.963402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:24.011964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7c90c1e9-bc8f-4099-a615-a3dd3ef8c623 tempest-HostsAdminNegativeTestJSON-885164280 tempest-HostsAdminNegativeTestJSON-885164280-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:24.013059 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7c90c1e9-bc8f-4099-a615-a3dd3ef8c623 tempest-HostsAdminNegativeTestJSON-885164280 tempest-HostsAdminNegativeTestJSON-885164280-project] 10.222.0.93 "PUT /compute/v2.1/os-hosts/n-d-851359-3" status: 403 len: 111 microversion: 2.1 time: 0.074818 Aug 04 16:55:24.016246 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 139/272] 10.222.0.93 () {60 vars in 1187 bytes} [Thu Aug 4 16:55:23 2022] PUT /compute/v2.1/os-hosts/n-d-851359-3 => generated 111 bytes in 80 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:55:24.031044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ae3254e3-1421-4f7d-adca-63624bf8065c tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] Action: 'update', calling method: .version_select at 0x7f1e5bfd81f0>, body: {"status": null, "maintenance_mode": null} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:24.036506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ae3254e3-1421-4f7d-adca-63624bf8065c tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] Request method failure captured: Aug 04 16:55:24.036506 n-d-851359-3 devstack@n-api.service[131044]: request: PUT /compute/v2.1/os-hosts/n-d-851359-3 HTTP/1.1 Aug 04 16:55:24.036506 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:55:24.036506 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:55:24.036506 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:55:24.036506 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 42 Aug 04 16:55:24.036506 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:55:24.036506 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:55:24.036506 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:55:24.036506 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:24.036506 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_n3tLlqqE616hO9BvZKKFRXFrki876FQMyDZtzCHfLAkmqq2LmxV0NRTL4in4UvKijG9oXkbxs5mvSRlie_Hvv81EmuDSTaa7Co0M9pD_uht0uZXBsMJ21eiH5DD-kCyru1Q0V3e-GjTXDTJwXTSizRe1DvBg9y1z7fv_AQ7LiQXDM Aug 04 16:55:24.036506 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:55:24.036506 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:55:24.036506 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:55:24.036506 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:55:24.036506 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:55:24.036506 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:55:24.036506 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 4408b96961bb421fb9261176fce8f402 Aug 04 16:55:24.036506 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-485279365 Aug 04 16:55:24.036506 n-d-851359-3 devstack@n-api.service[131044]: X-Role: admin,member,reader Aug 04 16:55:24.036506 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: admin,member,reader Aug 04 16:55:24.037928 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4408b96961bb421fb9261176fce8f402"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4408b96961bb421fb9261176fce8f402"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4408b96961bb421fb9261176fce8f402"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4408b96961bb421fb9261176fce8f402"}]}] Aug 04 16:55:24.037928 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-HostsAdminNegativeTestJSON-485279365 Aug 04 16:55:24.037928 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 4408b96961bb421fb9261176fce8f402 Aug 04 16:55:24.037928 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-485279365 Aug 04 16:55:24.037928 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-HostsAdminNegativeTestJSON-485279365-project-admin Aug 04 16:55:24.037928 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:55:24.037928 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:55:24.037928 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 92ee2e5940ef4f58aa2d0e28466aa9e6 Aug 04 16:55:24.037928 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-HostsAdminNegativeTestJSON-485279365-project-admin Aug 04 16:55:24.037928 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 16:55:24.037928 n-d-851359-3 devstack@n-api.service[131044]: {"status": null, "maintenance_mode": null} Aug 04 16:55:24.037928 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:55:24.037928 n-d-851359-3 devstack@n-api.service[131044]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 04 16:55:24.037928 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'n-d-851359-3', 'body': {'status': None, 'maintenance_mode': None}} Aug 04 16:55:24.039041 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:24.039041 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:24.039041 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:55:24.039041 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:55:24.039041 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:55:24.039041 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:55:24.039041 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 04 16:55:24.039041 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:24.039041 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 04 16:55:24.039041 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 04 16:55:24.039041 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'disable', Aug 04 16:55:24.039041 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'Enable', Aug 04 16:55:24.039041 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'Disable', Aug 04 16:55:24.039041 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 04 16:55:24.039041 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 04 16:55:24.039041 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 04 16:55:24.039041 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:24.039041 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance: Aug 04 16:55:24.039041 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi None Aug 04 16:55:24.039041 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:24.039041 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:24.039041 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:24.039041 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:24.039041 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:24.039041 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:24.040672 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:24.040672 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:24.040672 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:55:24.040672 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:55:24.040672 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:24.040672 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:24.040672 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 16:55:24.040672 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 16:55:24.040672 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:55:24.040672 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:55:24.040672 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:55:24.040672 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:55:24.040672 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 04 16:55:24.040672 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:24.040672 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:24.040672 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:24.040672 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:24.040672 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:24.040672 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:24.042206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:55:24.042206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:55:24.042206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 04 16:55:24.042206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:24.042206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ae3254e3-1421-4f7d-adca-63624bf8065c tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:24.042206 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ae3254e3-1421-4f7d-adca-63624bf8065c tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-hosts/n-d-851359-3" status: 400 len: 127 microversion: 2.1 time: 0.016623 Aug 04 16:55:24.042206 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 140/273] 10.222.0.93 () {60 vars in 1187 bytes} [Thu Aug 4 16:55:24 2022] PUT /compute/v2.1/os-hosts/n-d-851359-3 => generated 127 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:55:24.049616 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e60ddf9f-52c6-42bc-893f-93f0cff64d48 tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] Action: 'update', calling method: .version_select at 0x7f1e6816f160>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:24.055336 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.hosts [None req-e60ddf9f-52c6-42bc-893f-93f0cff64d48 tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] Enabling host nonexistent_hostname. Aug 04 16:55:24.072063 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-e60ddf9f-52c6-42bc-893f-93f0cff64d48 tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:55:24.079753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e60ddf9f-52c6-42bc-893f-93f0cff64d48 tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] Request method failure captured: Aug 04 16:55:24.079753 n-d-851359-3 devstack@n-api.service[131044]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 04 16:55:24.079753 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:55:24.079753 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:55:24.079753 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:55:24.079753 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 50 Aug 04 16:55:24.079753 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:55:24.079753 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:55:24.079753 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:55:24.079753 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:24.079753 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_n3tLlqqE616hO9BvZKKFRXFrki876FQMyDZtzCHfLAkmqq2LmxV0NRTL4in4UvKijG9oXkbxs5mvSRlie_Hvv81EmuDSTaa7Co0M9pD_uht0uZXBsMJ21eiH5DD-kCyru1Q0V3e-GjTXDTJwXTSizRe1DvBg9y1z7fv_AQ7LiQXDM Aug 04 16:55:24.079753 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:55:24.079753 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:55:24.079753 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:55:24.079753 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:55:24.079753 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:55:24.079753 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:55:24.079753 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 4408b96961bb421fb9261176fce8f402 Aug 04 16:55:24.079753 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-485279365 Aug 04 16:55:24.079753 n-d-851359-3 devstack@n-api.service[131044]: X-Role: admin,member,reader Aug 04 16:55:24.079753 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: admin,member,reader Aug 04 16:55:24.081011 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4408b96961bb421fb9261176fce8f402"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4408b96961bb421fb9261176fce8f402"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4408b96961bb421fb9261176fce8f402"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4408b96961bb421fb9261176fce8f402"}]}] Aug 04 16:55:24.081011 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-HostsAdminNegativeTestJSON-485279365 Aug 04 16:55:24.081011 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 4408b96961bb421fb9261176fce8f402 Aug 04 16:55:24.081011 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-485279365 Aug 04 16:55:24.081011 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-HostsAdminNegativeTestJSON-485279365-project-admin Aug 04 16:55:24.081011 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:55:24.081011 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:55:24.081011 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 92ee2e5940ef4f58aa2d0e28466aa9e6 Aug 04 16:55:24.081011 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-HostsAdminNegativeTestJSON-485279365-project-admin Aug 04 16:55:24.081011 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 16:55:24.081011 n-d-851359-3 devstack@n-api.service[131044]: {"status": "enable", "maintenance_mode": "enable"} Aug 04 16:55:24.081011 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:55:24.081011 n-d-851359-3 devstack@n-api.service[131044]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:55:24.081011 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 04 16:55:24.081757 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:24.081757 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:24.081757 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 04 16:55:24.081757 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 04 16:55:24.081757 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 16:55:24.081757 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 16:55:24.081757 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:55:24.081757 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:55:24.081757 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:55:24.081757 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:55:24.081757 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 16:55:24.081757 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 16:55:24.081757 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 04 16:55:24.081757 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 04 16:55:24.081757 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:55:24.081757 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:55:24.081757 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 04 16:55:24.081757 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 04 16:55:24.082779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:55:24.082779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:55:24.082779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 04 16:55:24.082779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 04 16:55:24.082779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:55:24.082779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:24.082779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:24.082779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:24.082779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:24.082779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:24.082779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:24.082779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:24.082779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:24.082779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:55:24.082779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:55:24.082779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:24.082779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:24.082779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:55:24.082779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:55:24.082779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 04 16:55:24.083809 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 04 16:55:24.083809 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 04 16:55:24.083809 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:55:24.083809 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:55:24.083809 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:24.083809 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:24.083809 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:24.083809 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:24.083809 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:24.083809 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:24.083809 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:55:24.083809 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:55:24.083809 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 04 16:55:24.083809 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:55:24.103119 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e60ddf9f-52c6-42bc-893f-93f0cff64d48 tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:24.104447 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e60ddf9f-52c6-42bc-893f-93f0cff64d48 tempest-HostsAdminNegativeTestJSON-485279365 tempest-HostsAdminNegativeTestJSON-485279365-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.059713 Aug 04 16:55:24.107170 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 141/274] 10.222.0.93 () {60 vars in 1211 bytes} [Thu Aug 4 16:55:24 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 04 16:55:24.120426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-1096fa7f-d987-4125-b50c-20986f633de0 req-46029a04-7247-44cd-bcdf-1af1951803dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69d189f5-2ca5-4d3b-9a70-b6e27d6dda13", "name": "network-vif-plugged", "status": "completed", "tag": "8294cc37-07d5-4724-a0a2-e13fb2658fa6"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:24.154434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1096fa7f-d987-4125-b50c-20986f633de0 req-46029a04-7247-44cd-bcdf-1af1951803dd service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:24.155067 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1096fa7f-d987-4125-b50c-20986f633de0 req-46029a04-7247-44cd-bcdf-1af1951803dd service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:24.155927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1096fa7f-d987-4125-b50c-20986f633de0 req-46029a04-7247-44cd-bcdf-1af1951803dd service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:24.185237 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-1096fa7f-d987-4125-b50c-20986f633de0 req-46029a04-7247-44cd-bcdf-1af1951803dd service nova] Creating event network-vif-plugged:8294cc37-07d5-4724-a0a2-e13fb2658fa6 for instance 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 on n-h2-851359-3 Aug 04 16:55:24.197371 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-1096fa7f-d987-4125-b50c-20986f633de0 req-46029a04-7247-44cd-bcdf-1af1951803dd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086607 Aug 04 16:55:24.205045 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 142/275] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:24.224104 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-deff2836-9305-4b45-abb2-d04eb5de2916 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/453a8f7d3e834893b378f9c963387d26/defaults" status: 200 len: 371 microversion: 2.1 time: 0.667085 Aug 04 16:55:24.225254 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 134/276] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Aug 4 16:55:23 2022] GET /compute/v2.1/os-quota-sets/453a8f7d3e834893b378f9c963387d26/defaults => generated 371 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:24.518367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8da6cbb0-9f27-45d2-bcc3-6167d093423a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:24.519245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8da6cbb0-9f27-45d2-bcc3-6167d093423a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:24.534518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8da6cbb0-9f27-45d2-bcc3-6167d093423a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:24.537212 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8da6cbb0-9f27-45d2-bcc3-6167d093423a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:24.538203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8da6cbb0-9f27-45d2-bcc3-6167d093423a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:24.540665 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8da6cbb0-9f27-45d2-bcc3-6167d093423a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:24.541391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8da6cbb0-9f27-45d2-bcc3-6167d093423a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:24.544604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8da6cbb0-9f27-45d2-bcc3-6167d093423a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:24.777055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-97e9bf2d-ff33-4aa1-8cf2-251e4b9655aa tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:24.779047 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-97e9bf2d-ff33-4aa1-8cf2-251e4b9655aa tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:24.785965 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-97e9bf2d-ff33-4aa1-8cf2-251e4b9655aa tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:24.789463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-97e9bf2d-ff33-4aa1-8cf2-251e4b9655aa tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:24.790877 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-97e9bf2d-ff33-4aa1-8cf2-251e4b9655aa tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:24.792643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-97e9bf2d-ff33-4aa1-8cf2-251e4b9655aa tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:24.793435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-97e9bf2d-ff33-4aa1-8cf2-251e4b9655aa tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:24.795434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-97e9bf2d-ff33-4aa1-8cf2-251e4b9655aa tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:25.100406 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8da6cbb0-9f27-45d2-bcc3-6167d093423a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:25.110033 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8da6cbb0-9f27-45d2-bcc3-6167d093423a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1312 microversion: 2.1 time: 0.596359 Aug 04 16:55:25.124956 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 143/277] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:24 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1312 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:25.487287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-97e9bf2d-ff33-4aa1-8cf2-251e4b9655aa tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:25.510320 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-97e9bf2d-ff33-4aa1-8cf2-251e4b9655aa tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13" status: 200 len: 1390 microversion: 2.1 time: 0.740857 Aug 04 16:55:25.510944 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 135/278] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:24 2022] GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 => generated 1390 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:55:25.879103 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a21694c6-abcd-40e5-8df8-36bd20ce8ff0 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Action: 'update', calling method: .version_select at 0x7f1e5bfeb700>, body: {"quota_set": {"ram": "5120"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:26.142872 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-514dde16-8619-4516-a23e-f85b2d7e5c9d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:26.143504 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-514dde16-8619-4516-a23e-f85b2d7e5c9d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:26.153629 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-514dde16-8619-4516-a23e-f85b2d7e5c9d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:26.154171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-514dde16-8619-4516-a23e-f85b2d7e5c9d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:26.154612 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-514dde16-8619-4516-a23e-f85b2d7e5c9d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:26.155327 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-514dde16-8619-4516-a23e-f85b2d7e5c9d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:26.155778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-514dde16-8619-4516-a23e-f85b2d7e5c9d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:26.160639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-514dde16-8619-4516-a23e-f85b2d7e5c9d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:26.206379 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a21694c6-abcd-40e5-8df8-36bd20ce8ff0 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:26.208070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a21694c6-abcd-40e5-8df8-36bd20ce8ff0 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:26.210073 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a21694c6-abcd-40e5-8df8-36bd20ce8ff0 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:26.213006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a21694c6-abcd-40e5-8df8-36bd20ce8ff0 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:26.214164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a21694c6-abcd-40e5-8df8-36bd20ce8ff0 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:26.215863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a21694c6-abcd-40e5-8df8-36bd20ce8ff0 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:26.371999 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a21694c6-abcd-40e5-8df8-36bd20ce8ff0 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/3fa75d2ea8584db3b5126a478dbbcc88" status: 200 len: 328 microversion: 2.1 time: 0.496946 Aug 04 16:55:26.375497 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 144/279] 10.222.0.93 () {60 vars in 1262 bytes} [Thu Aug 4 16:55:25 2022] PUT /compute/v2.1/os-quota-sets/3fa75d2ea8584db3b5126a478dbbcc88 => generated 328 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:26.384812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-88625de3-f541-456e-ac0c-fbebd5cf3579 req-cbf16880-5bcd-4f7a-8e9c-0364a4c02283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0b4f50d-df7a-44ab-87d8-054aa370c979", "name": "network-vif-plugged", "status": "completed", "tag": "6defc06d-afcb-4aaa-9d45-8000639706e7"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:26.404594 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-88625de3-f541-456e-ac0c-fbebd5cf3579 req-cbf16880-5bcd-4f7a-8e9c-0364a4c02283 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:26.405075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-88625de3-f541-456e-ac0c-fbebd5cf3579 req-cbf16880-5bcd-4f7a-8e9c-0364a4c02283 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:26.405507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-88625de3-f541-456e-ac0c-fbebd5cf3579 req-cbf16880-5bcd-4f7a-8e9c-0364a4c02283 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:26.437673 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-88625de3-f541-456e-ac0c-fbebd5cf3579 req-cbf16880-5bcd-4f7a-8e9c-0364a4c02283 service nova] Creating event network-vif-plugged:6defc06d-afcb-4aaa-9d45-8000639706e7 for instance d0b4f50d-df7a-44ab-87d8-054aa370c979 on n-h1-851359-3 Aug 04 16:55:26.451674 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-88625de3-f541-456e-ac0c-fbebd5cf3579 req-cbf16880-5bcd-4f7a-8e9c-0364a4c02283 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074712 Aug 04 16:55:26.455009 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 145/280] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:26.468978 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5c48cce0-274d-4544-9119-7f7e0cef6e77 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Calling method '.version_select at 0x7f1e5bfd8160>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:26.970611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-514dde16-8619-4516-a23e-f85b2d7e5c9d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:26.996423 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-514dde16-8619-4516-a23e-f85b2d7e5c9d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1312 microversion: 2.1 time: 0.856212 Aug 04 16:55:26.998202 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 136/281] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:26 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1312 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:27.007840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-75ab4419-06fd-4c35-86c2-fc19cebe1721 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:27.008751 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-75ab4419-06fd-4c35-86c2-fc19cebe1721 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:27.040181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75ab4419-06fd-4c35-86c2-fc19cebe1721 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:27.043106 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75ab4419-06fd-4c35-86c2-fc19cebe1721 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:27.043755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75ab4419-06fd-4c35-86c2-fc19cebe1721 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:27.045395 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75ab4419-06fd-4c35-86c2-fc19cebe1721 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:27.048695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75ab4419-06fd-4c35-86c2-fc19cebe1721 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:27.053069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75ab4419-06fd-4c35-86c2-fc19cebe1721 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:27.080443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c48cce0-274d-4544-9119-7f7e0cef6e77 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:27.081116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c48cce0-274d-4544-9119-7f7e0cef6e77 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:27.081769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c48cce0-274d-4544-9119-7f7e0cef6e77 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:27.082696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c48cce0-274d-4544-9119-7f7e0cef6e77 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:27.083369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c48cce0-274d-4544-9119-7f7e0cef6e77 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:27.084196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c48cce0-274d-4544-9119-7f7e0cef6e77 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:27.128045 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5c48cce0-274d-4544-9119-7f7e0cef6e77 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/3fa75d2ea8584db3b5126a478dbbcc88/detail" status: 200 len: 916 microversion: 2.1 time: 0.671557 Aug 04 16:55:27.128990 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 146/282] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Aug 4 16:55:26 2022] GET /compute/v2.1/os-quota-sets/3fa75d2ea8584db3b5126a478dbbcc88/detail => generated 916 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:27.435884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-75ab4419-06fd-4c35-86c2-fc19cebe1721 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:27.454745 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-75ab4419-06fd-4c35-86c2-fc19cebe1721 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13" status: 200 len: 1390 microversion: 2.1 time: 0.454735 Aug 04 16:55:27.455901 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 137/283] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:26 2022] GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 => generated 1390 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:27.509563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7fd36d6d-f5b2-48e9-9002-e6cbd3773f32 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1131005455", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "a29c24ff-4240-47ba-a31d-3bb350182580"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:27.637066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-7fd36d6d-f5b2-48e9-9002-e6cbd3773f32 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] validate_networks() for [('a29c24ff-4240-47ba-a31d-3bb350182580', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:55:28.017486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f2db804c-ebcf-415c-ae2f-7ef557b3e41b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:28.018662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f2db804c-ebcf-415c-ae2f-7ef557b3e41b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:28.029769 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2db804c-ebcf-415c-ae2f-7ef557b3e41b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:28.030661 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2db804c-ebcf-415c-ae2f-7ef557b3e41b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:28.033842 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2db804c-ebcf-415c-ae2f-7ef557b3e41b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:28.036697 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2db804c-ebcf-415c-ae2f-7ef557b3e41b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:28.037406 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2db804c-ebcf-415c-ae2f-7ef557b3e41b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:28.038787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2db804c-ebcf-415c-ae2f-7ef557b3e41b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:28.478446 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f2db804c-ebcf-415c-ae2f-7ef557b3e41b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:28.496288 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f2db804c-ebcf-415c-ae2f-7ef557b3e41b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1462 microversion: 2.1 time: 0.483155 Aug 04 16:55:28.497590 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 138/284] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:28 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1462 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:55:28.520490 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a596477c-d992-4cf5-81b9-1269ad35e189 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Action: 'update', calling method: .version_select at 0x7f1e680ce820>, body: {"quota_set": {"ram": "2048"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:29.225821 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a596477c-d992-4cf5-81b9-1269ad35e189 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:29.228355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a596477c-d992-4cf5-81b9-1269ad35e189 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:29.228860 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a596477c-d992-4cf5-81b9-1269ad35e189 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:29.230924 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a596477c-d992-4cf5-81b9-1269ad35e189 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:29.232920 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a596477c-d992-4cf5-81b9-1269ad35e189 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:29.233669 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a596477c-d992-4cf5-81b9-1269ad35e189 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:29.312803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7fd36d6d-f5b2-48e9-9002-e6cbd3773f32 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:55:29.313313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7fd36d6d-f5b2-48e9-9002-e6cbd3773f32 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:55:29.313603 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7fd36d6d-f5b2-48e9-9002-e6cbd3773f32 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:55:29.314124 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7fd36d6d-f5b2-48e9-9002-e6cbd3773f32 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:55:29.314549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7fd36d6d-f5b2-48e9-9002-e6cbd3773f32 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:55:29.346287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a596477c-d992-4cf5-81b9-1269ad35e189 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:29.346784 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a596477c-d992-4cf5-81b9-1269ad35e189 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:29.350491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7fd36d6d-f5b2-48e9-9002-e6cbd3773f32 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:29.350649 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a596477c-d992-4cf5-81b9-1269ad35e189 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:29.350988 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7fd36d6d-f5b2-48e9-9002-e6cbd3773f32 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:29.351426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7fd36d6d-f5b2-48e9-9002-e6cbd3773f32 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:29.351559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a596477c-d992-4cf5-81b9-1269ad35e189 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:29.351929 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a596477c-d992-4cf5-81b9-1269ad35e189 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:29.352159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7fd36d6d-f5b2-48e9-9002-e6cbd3773f32 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:29.352618 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7fd36d6d-f5b2-48e9-9002-e6cbd3773f32 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:29.353046 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7fd36d6d-f5b2-48e9-9002-e6cbd3773f32 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:29.355696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a596477c-d992-4cf5-81b9-1269ad35e189 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:29.399598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:29.417246 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-7fd36d6d-f5b2-48e9-9002-e6cbd3773f32 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Getting quotas for project 792f078eb62f4820ba4166d421079491. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:55:29.436932 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-7fd36d6d-f5b2-48e9-9002-e6cbd3773f32 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Getting quotas for user 81d93fe83a6542c89cbc86106671b15f and project 792f078eb62f4820ba4166d421079491. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:55:29.490230 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7fd36d6d-f5b2-48e9-9002-e6cbd3773f32 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:55:29.510233 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7fd36d6d-f5b2-48e9-9002-e6cbd3773f32 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 37140c09-31fd-4233-9ab9-6351044c5864] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:55:29.526899 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a596477c-d992-4cf5-81b9-1269ad35e189 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/3fa75d2ea8584db3b5126a478dbbcc88?user_id=4d0cb7f7cae346b5b84a13fe673fcb87" status: 200 len: 328 microversion: 2.1 time: 1.027308 Aug 04 16:55:29.532029 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 139/285] 10.222.0.93 () {60 vars in 1343 bytes} [Thu Aug 4 16:55:28 2022] PUT /compute/v2.1/os-quota-sets/3fa75d2ea8584db3b5126a478dbbcc88?user_id=4d0cb7f7cae346b5b84a13fe673fcb87 => generated 328 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:29.545741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-eaaea1c7-d279-4b56-809a-4f683e29de22 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:29.554309 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-eaaea1c7-d279-4b56-809a-4f683e29de22 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:29.577571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eaaea1c7-d279-4b56-809a-4f683e29de22 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:29.578539 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eaaea1c7-d279-4b56-809a-4f683e29de22 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:29.581940 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eaaea1c7-d279-4b56-809a-4f683e29de22 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:29.582922 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eaaea1c7-d279-4b56-809a-4f683e29de22 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:29.584980 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eaaea1c7-d279-4b56-809a-4f683e29de22 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:29.585652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eaaea1c7-d279-4b56-809a-4f683e29de22 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:29.657577 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7fd36d6d-f5b2-48e9-9002-e6cbd3773f32 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.527231 Aug 04 16:55:29.659256 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 147/286] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:55:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:55:30.070625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-eaaea1c7-d279-4b56-809a-4f683e29de22 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:30.081380 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-eaaea1c7-d279-4b56-809a-4f683e29de22 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13" status: 200 len: 1589 microversion: 2.1 time: 0.548043 Aug 04 16:55:30.089637 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 140/287] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:29 2022] GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 => generated 1589 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:30.112310 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-aa6f6a79-4c48-4631-aea7-e37f2de090a8 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Calling method '.version_select at 0x7f1e681e7c10>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:30.173739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6680685b-363d-4a90-b2bb-f6be8976115b tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:30.174547 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6680685b-363d-4a90-b2bb-f6be8976115b tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:30.184813 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6680685b-363d-4a90-b2bb-f6be8976115b tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:30.185470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6680685b-363d-4a90-b2bb-f6be8976115b tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:30.185917 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6680685b-363d-4a90-b2bb-f6be8976115b tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:30.186800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6680685b-363d-4a90-b2bb-f6be8976115b tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:30.187779 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6680685b-363d-4a90-b2bb-f6be8976115b tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:30.188250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6680685b-363d-4a90-b2bb-f6be8976115b tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:30.997742 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-aa6f6a79-4c48-4631-aea7-e37f2de090a8 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/3fa75d2ea8584db3b5126a478dbbcc88?user_id=4d0cb7f7cae346b5b84a13fe673fcb87" status: 200 len: 370 microversion: 2.1 time: 0.906530 Aug 04 16:55:30.999211 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 141/288] 10.222.0.93 () {58 vars in 1323 bytes} [Thu Aug 4 16:55:30 2022] GET /compute/v2.1/os-quota-sets/3fa75d2ea8584db3b5126a478dbbcc88?user_id=4d0cb7f7cae346b5b84a13fe673fcb87 => generated 370 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:31.029058 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-70912b3d-d83b-44d5-b8bf-f92857f2a697 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:31.030192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-70912b3d-d83b-44d5-b8bf-f92857f2a697 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 37140c09-31fd-4233-9ab9-6351044c5864] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:31.042336 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70912b3d-d83b-44d5-b8bf-f92857f2a697 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:31.043391 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70912b3d-d83b-44d5-b8bf-f92857f2a697 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:31.044166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70912b3d-d83b-44d5-b8bf-f92857f2a697 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:31.045122 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70912b3d-d83b-44d5-b8bf-f92857f2a697 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:31.045802 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70912b3d-d83b-44d5-b8bf-f92857f2a697 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:31.046498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70912b3d-d83b-44d5-b8bf-f92857f2a697 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:31.322252 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-70912b3d-d83b-44d5-b8bf-f92857f2a697 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:31.353045 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-70912b3d-d83b-44d5-b8bf-f92857f2a697 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864" status: 200 len: 1207 microversion: 2.1 time: 0.349253 Aug 04 16:55:31.357292 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 142/289] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:31 2022] GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864 => generated 1207 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:31.367137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cd697d01-5aff-4abc-bcb1-1719ec809797 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:31.371883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cd697d01-5aff-4abc-bcb1-1719ec809797 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:31.392778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd697d01-5aff-4abc-bcb1-1719ec809797 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:31.395424 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd697d01-5aff-4abc-bcb1-1719ec809797 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:31.396870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd697d01-5aff-4abc-bcb1-1719ec809797 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:31.398681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd697d01-5aff-4abc-bcb1-1719ec809797 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:31.400800 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd697d01-5aff-4abc-bcb1-1719ec809797 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:31.407338 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd697d01-5aff-4abc-bcb1-1719ec809797 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:31.802245 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6680685b-363d-4a90-b2bb-f6be8976115b tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1613 microversion: 2.1 time: 2.140730 Aug 04 16:55:31.806676 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 148/290] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:29 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1613 bytes in 2147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:31.821695 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cd697d01-5aff-4abc-bcb1-1719ec809797 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.462316 Aug 04 16:55:31.822556 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 143/291] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Aug 4 16:55:31 2022] GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13/os-interface => generated 284 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:31.835663 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f364c8ab-b41d-4dc7-84bc-dc4426c87f0a tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:31.837112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f364c8ab-b41d-4dc7-84bc-dc4426c87f0a tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:31.851678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f364c8ab-b41d-4dc7-84bc-dc4426c87f0a tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:31.854604 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f364c8ab-b41d-4dc7-84bc-dc4426c87f0a tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:31.855243 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f364c8ab-b41d-4dc7-84bc-dc4426c87f0a tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:31.856126 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f364c8ab-b41d-4dc7-84bc-dc4426c87f0a tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:31.872102 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f364c8ab-b41d-4dc7-84bc-dc4426c87f0a tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:31.872798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f364c8ab-b41d-4dc7-84bc-dc4426c87f0a tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:32.527612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8daf9ddf-eb95-4836-b34a-2482337f8fc1 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1961699604", "id": 2094574600, "os-flavor-access:is_public": "True"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:32.533069 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:32.533069 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:32.556567 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8daf9ddf-eb95-4836-b34a-2482337f8fc1 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.747310 Aug 04 16:55:32.557709 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 149/292] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:55:31 2022] POST /compute/v2.1/flavors => generated 430 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:32.763970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dc1bb2cb-81d0-4cc5-9783-ab5257292b65 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1822470949", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:32.821390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f364c8ab-b41d-4dc7-84bc-dc4426c87f0a tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '88b72b6cf0e14849a4b09a9595b0bef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c5f6b6398d485baaf555deb448172f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:32.825733 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f364c8ab-b41d-4dc7-84bc-dc4426c87f0a tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] flavor_id is None. Assuming migration. {{(pid=131043) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 04 16:55:32.826271 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f364c8ab-b41d-4dc7-84bc-dc4426c87f0a tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=131043) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 16:55:32.909259 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-dc1bb2cb-81d0-4cc5-9783-ab5257292b65 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:55:33.661928 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f364c8ab-b41d-4dc7-84bc-dc4426c87f0a tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979/action" status: 202 len: 0 microversion: 2.1 time: 1.826280 Aug 04 16:55:33.665931 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 144/293] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:55:31 2022] POST /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979/action => generated 0 bytes in 1834 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:55:33.682308 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cb568516-614c-4236-8475-e2bcd7af0865 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Calling method '.version_select at 0x7f1e681e7e50>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:34.053364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-dc1bb2cb-81d0-4cc5-9783-ab5257292b65 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:55:34.055257 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-dc1bb2cb-81d0-4cc5-9783-ab5257292b65 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:55:34.056195 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-dc1bb2cb-81d0-4cc5-9783-ab5257292b65 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:55:34.056884 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-dc1bb2cb-81d0-4cc5-9783-ab5257292b65 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:55:34.057560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-dc1bb2cb-81d0-4cc5-9783-ab5257292b65 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:55:34.084796 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc1bb2cb-81d0-4cc5-9783-ab5257292b65 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:34.089615 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc1bb2cb-81d0-4cc5-9783-ab5257292b65 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:34.090399 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc1bb2cb-81d0-4cc5-9783-ab5257292b65 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:34.093152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc1bb2cb-81d0-4cc5-9783-ab5257292b65 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:34.095589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc1bb2cb-81d0-4cc5-9783-ab5257292b65 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:34.097365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc1bb2cb-81d0-4cc5-9783-ab5257292b65 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:34.166897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-dc1bb2cb-81d0-4cc5-9783-ab5257292b65 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Getting quotas for project 37ed72eca39e4bab83ccbba779ac37c9. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:55:34.174230 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-dc1bb2cb-81d0-4cc5-9783-ab5257292b65 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Getting quotas for user c12efa078aa84861925925314ef00aea and project 37ed72eca39e4bab83ccbba779ac37c9. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:55:34.200767 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dc1bb2cb-81d0-4cc5-9783-ab5257292b65 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:55:34.206976 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dc1bb2cb-81d0-4cc5-9783-ab5257292b65 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: e07a80a8-dec0-4a8b-bd5e-e2a50370d35b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:55:34.207135 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cb568516-614c-4236-8475-e2bcd7af0865 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/453a8f7d3e834893b378f9c963387d26/defaults" status: 200 len: 371 microversion: 2.1 time: 0.512079 Aug 04 16:55:34.221516 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 145/294] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Aug 4 16:55:33 2022] GET /compute/v2.1/os-quota-sets/453a8f7d3e834893b378f9c963387d26/defaults => generated 371 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:34.238687 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3961f79e-b6be-4620-b472-ea71a914960f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:34.239345 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3961f79e-b6be-4620-b472-ea71a914960f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 37140c09-31fd-4233-9ab9-6351044c5864] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:34.261731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3961f79e-b6be-4620-b472-ea71a914960f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:34.263121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3961f79e-b6be-4620-b472-ea71a914960f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:34.263770 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3961f79e-b6be-4620-b472-ea71a914960f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:34.264721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3961f79e-b6be-4620-b472-ea71a914960f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:34.265326 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3961f79e-b6be-4620-b472-ea71a914960f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:34.265898 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3961f79e-b6be-4620-b472-ea71a914960f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:34.326264 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dc1bb2cb-81d0-4cc5-9783-ab5257292b65 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.766036 Aug 04 16:55:34.327627 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 150/295] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:55:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:55:34.339028 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e2b29217-7b0a-41f4-8e22-01362fa612df tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:34.340033 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:34.340033 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:34.370497 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=9,nova_api:DELETE=5 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:34.383621 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e2b29217-7b0a-41f4-8e22-01362fa612df tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/2094574600" status: 202 len: 0 microversion: 2.1 time: 0.054303 Aug 04 16:55:34.384470 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 151/296] 10.222.0.93 () {58 vars in 1161 bytes} [Thu Aug 4 16:55:34 2022] DELETE /compute/v2.1/flavors/2094574600 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:55:34.713146 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3961f79e-b6be-4620-b472-ea71a914960f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:34.731727 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3961f79e-b6be-4620-b472-ea71a914960f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864" status: 200 len: 1311 microversion: 2.1 time: 0.508393 Aug 04 16:55:34.734529 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 146/297] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:34 2022] GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864 => generated 1311 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:34.741768 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e31c9644-ed48-42cb-b30c-5afe5954995c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:34.745070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e31c9644-ed48-42cb-b30c-5afe5954995c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:34.748730 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d3c9fbe6-f2eb-48a5-bb7a-2f0f58316b42 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1345844235", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "4f601fe3-086d-4166-a668-9b13ff766838"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:34.759236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e31c9644-ed48-42cb-b30c-5afe5954995c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:34.764757 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e31c9644-ed48-42cb-b30c-5afe5954995c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:34.765516 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e31c9644-ed48-42cb-b30c-5afe5954995c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:34.766503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e31c9644-ed48-42cb-b30c-5afe5954995c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:34.772939 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e31c9644-ed48-42cb-b30c-5afe5954995c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:34.773695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e31c9644-ed48-42cb-b30c-5afe5954995c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:34.868944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-d3c9fbe6-f2eb-48a5-bb7a-2f0f58316b42 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] validate_networks() for [('4f601fe3-086d-4166-a668-9b13ff766838', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:55:35.584997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e31c9644-ed48-42cb-b30c-5afe5954995c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:35.599729 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e31c9644-ed48-42cb-b30c-5afe5954995c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1471 microversion: 2.1 time: 0.863834 Aug 04 16:55:35.609455 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 147/298] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:34 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1471 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:35.614185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-cf71acd9-cb9d-4df6-ad2d-f2011f213fac req-67ca9592-2618-412e-ae72-f2b947ad6d34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37140c09-31fd-4233-9ab9-6351044c5864", "tag": "e39bb9a8-b8ea-451a-83ab-1b6e8662ede5"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:35.633958 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-cf71acd9-cb9d-4df6-ad2d-f2011f213fac req-67ca9592-2618-412e-ae72-f2b947ad6d34 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:35.634914 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-cf71acd9-cb9d-4df6-ad2d-f2011f213fac req-67ca9592-2618-412e-ae72-f2b947ad6d34 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:35.635506 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-cf71acd9-cb9d-4df6-ad2d-f2011f213fac req-67ca9592-2618-412e-ae72-f2b947ad6d34 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:35.666961 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-cf71acd9-cb9d-4df6-ad2d-f2011f213fac req-67ca9592-2618-412e-ae72-f2b947ad6d34 service nova] Creating event network-changed:e39bb9a8-b8ea-451a-83ab-1b6e8662ede5 for instance 37140c09-31fd-4233-9ab9-6351044c5864 on n-h1-851359-3 Aug 04 16:55:35.681774 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-cf71acd9-cb9d-4df6-ad2d-f2011f213fac req-67ca9592-2618-412e-ae72-f2b947ad6d34 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070540 Aug 04 16:55:35.683740 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 148/299] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:35.689512 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-46ee3558-95c7-4f56-a674-864b3310c1a0 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Action: 'update', calling method: .version_select at 0x7f1e5bffadc0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:35.827665 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:35.840333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-46ee3558-95c7-4f56-a674-864b3310c1a0 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:35.841917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-46ee3558-95c7-4f56-a674-864b3310c1a0 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:35.842579 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-46ee3558-95c7-4f56-a674-864b3310c1a0 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:35.843833 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-46ee3558-95c7-4f56-a674-864b3310c1a0 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:35.844516 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-46ee3558-95c7-4f56-a674-864b3310c1a0 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:35.845123 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-46ee3558-95c7-4f56-a674-864b3310c1a0 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:36.220054 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-46ee3558-95c7-4f56-a674-864b3310c1a0 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/453a8f7d3e834893b378f9c963387d26" status: 200 len: 329 microversion: 2.1 time: 0.534927 Aug 04 16:55:36.221424 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 149/300] 10.222.0.93 () {60 vars in 1263 bytes} [Thu Aug 4 16:55:35 2022] PUT /compute/v2.1/os-quota-sets/453a8f7d3e834893b378f9c963387d26 => generated 329 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:36.230476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5bc5faa9-bbb3-409a-83b8-04f9c306233e tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:36.233074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5bc5faa9-bbb3-409a-83b8-04f9c306233e tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: e07a80a8-dec0-4a8b-bd5e-e2a50370d35b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:36.242435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5bc5faa9-bbb3-409a-83b8-04f9c306233e tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:36.242986 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5bc5faa9-bbb3-409a-83b8-04f9c306233e tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:36.243430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5bc5faa9-bbb3-409a-83b8-04f9c306233e tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:36.246011 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5bc5faa9-bbb3-409a-83b8-04f9c306233e tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:36.246586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5bc5faa9-bbb3-409a-83b8-04f9c306233e tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:36.247291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5bc5faa9-bbb3-409a-83b8-04f9c306233e tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:36.348879 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d3c9fbe6-f2eb-48a5-bb7a-2f0f58316b42 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:55:36.349608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d3c9fbe6-f2eb-48a5-bb7a-2f0f58316b42 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:55:36.350723 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d3c9fbe6-f2eb-48a5-bb7a-2f0f58316b42 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:55:36.351301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d3c9fbe6-f2eb-48a5-bb7a-2f0f58316b42 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:55:36.351783 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d3c9fbe6-f2eb-48a5-bb7a-2f0f58316b42 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:55:36.374727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3c9fbe6-f2eb-48a5-bb7a-2f0f58316b42 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:36.375888 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3c9fbe6-f2eb-48a5-bb7a-2f0f58316b42 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:36.375888 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3c9fbe6-f2eb-48a5-bb7a-2f0f58316b42 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:36.376599 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3c9fbe6-f2eb-48a5-bb7a-2f0f58316b42 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:36.377205 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3c9fbe6-f2eb-48a5-bb7a-2f0f58316b42 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:36.377794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3c9fbe6-f2eb-48a5-bb7a-2f0f58316b42 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:36.412614 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5bc5faa9-bbb3-409a-83b8-04f9c306233e tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12efa078aa84861925925314ef00aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ed72eca39e4bab83ccbba779ac37c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:36.429342 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5bc5faa9-bbb3-409a-83b8-04f9c306233e tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "GET /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b" status: 200 len: 1290 microversion: 2.1 time: 0.198617 Aug 04 16:55:36.430253 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 150/301] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:36 2022] GET /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b => generated 1290 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:36.451218 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3a0819fd-1539-4fc3-8a63-f56989c5a1f1 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:36.453942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-d3c9fbe6-f2eb-48a5-bb7a-2f0f58316b42 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Getting quotas for project 3f3e5530401f4a87a038b3d30679a74e. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:55:36.459751 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-d3c9fbe6-f2eb-48a5-bb7a-2f0f58316b42 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Getting quotas for user 48eddfe7e2c347fcbc122b4f6fb89076 and project 3f3e5530401f4a87a038b3d30679a74e. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:55:36.494015 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d3c9fbe6-f2eb-48a5-bb7a-2f0f58316b42 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:55:36.496554 n-d-851359-3 devstack@n-api.service[131044]: WARNING nova.utils [None req-d3c9fbe6-f2eb-48a5-bb7a-2f0f58316b42 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1345844235 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-134584423 Aug 04 16:55:36.498584 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d3c9fbe6-f2eb-48a5-bb7a-2f0f58316b42 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] [instance: eb10c53c-59c3-4239-97c5-c898c9f9ca89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:55:36.538878 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3a0819fd-1539-4fc3-8a63-f56989c5a1f1 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.106848 Aug 04 16:55:36.554748 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 151/302] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:55:36 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:36.624524 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f74f74da-160b-4843-86bf-27868a20c335 tempest-InstanceUsageAuditLogNegativeTestJSON-1803721824 tempest-InstanceUsageAuditLogNegativeTestJSON-1803721824-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:36.626659 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:36.626659 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:55:36.628267 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-f74f74da-160b-4843-86bf-27868a20c335 tempest-InstanceUsageAuditLogNegativeTestJSON-1803721824 tempest-InstanceUsageAuditLogNegativeTestJSON-1803721824-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 04 16:55:36.635609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f74f74da-160b-4843-86bf-27868a20c335 tempest-InstanceUsageAuditLogNegativeTestJSON-1803721824 tempest-InstanceUsageAuditLogNegativeTestJSON-1803721824-project-admin] Request method failure captured: Aug 04 16:55:36.635609 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 04 16:55:36.635609 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:55:36.635609 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:55:36.635609 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:55:36.635609 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:55:36.635609 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:55:36.635609 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:55:36.635609 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:55:36.635609 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:36.635609 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_oG7YkjEx8bo66tN0PrlfzjJg4bXSg9dtjwc-XQ2C8l-BTOggsQUrWzc1R1clrq5v__K1ZBP1nYv0bpnMYESsxXySUt1XBLFCYer3TdjIoVh_wzZ3-E32yMKrAfSm_suKmyBOftmmhIDy5fQ48dylefWxMCmxgrquFKxFJuWrD_rKA Aug 04 16:55:36.635609 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:55:36.635609 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:55:36.635609 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:55:36.635609 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:55:36.635609 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:55:36.635609 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:55:36.635609 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 76558f15844d44a7a801e2fb97cbcca6 Aug 04 16:55:36.635609 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1803721824 Aug 04 16:55:36.635609 n-d-851359-3 devstack@n-api.service[131043]: X-Role: admin,member,reader Aug 04 16:55:36.635609 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: admin,member,reader Aug 04 16:55:36.637173 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/76558f15844d44a7a801e2fb97cbcca6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/76558f15844d44a7a801e2fb97cbcca6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_76558f15844d44a7a801e2fb97cbcca6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/76558f15844d44a7a801e2fb97cbcca6"}]}] Aug 04 16:55:36.637173 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1803721824 Aug 04 16:55:36.637173 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 76558f15844d44a7a801e2fb97cbcca6 Aug 04 16:55:36.637173 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1803721824 Aug 04 16:55:36.637173 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1803721824-project-admin Aug 04 16:55:36.637173 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:55:36.637173 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:55:36.637173 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 7f00d97fc51a4030a84a4ac5735f4d4d Aug 04 16:55:36.637173 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1803721824-project-admin Aug 04 16:55:36.637173 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 16:55:36.637173 n-d-851359-3 devstack@n-api.service[131043]: exception: Invalid timestamp for date invalid_time Aug 04 16:55:36.637936 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'invalid_time'} Aug 04 16:55:36.637936 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:36.637936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:36.637936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 04 16:55:36.637936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 04 16:55:36.637936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 04 16:55:36.637936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 04 16:55:36.637936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 04 16:55:36.637936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 04 16:55:36.637936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 04 16:55:36.637936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:36.637936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:36.637936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:36.637936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:36.637936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:36.637936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:36.637936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:36.637936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:36.637936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:36.637936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:36.639311 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 04 16:55:36.639311 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 04 16:55:36.639311 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 04 16:55:36.639311 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:36.639311 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:36.639311 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:36.639311 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:36.639311 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:36.639311 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:36.639311 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:55:36.639311 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:55:36.639311 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 04 16:55:36.639311 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:36.641170 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f74f74da-160b-4843-86bf-27868a20c335 tempest-InstanceUsageAuditLogNegativeTestJSON-1803721824 tempest-InstanceUsageAuditLogNegativeTestJSON-1803721824-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:36.642225 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f74f74da-160b-4843-86bf-27868a20c335 tempest-InstanceUsageAuditLogNegativeTestJSON-1803721824 tempest-InstanceUsageAuditLogNegativeTestJSON-1803721824-project-admin] 10.222.0.93 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.086273 Aug 04 16:55:36.642952 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 152/303] 10.222.0.93 () {58 vars in 1224 bytes} [Thu Aug 4 16:55:36 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 88 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 16:55:36.654723 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5db89c2f-c153-4015-a945-dafd5b5f2fa5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:36.656990 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5db89c2f-c153-4015-a945-dafd5b5f2fa5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 37140c09-31fd-4233-9ab9-6351044c5864] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:36.666575 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d3c9fbe6-f2eb-48a5-bb7a-2f0f58316b42 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.280696 Aug 04 16:55:36.667766 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 152/304] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:55:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2282 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:55:36.676818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5db89c2f-c153-4015-a945-dafd5b5f2fa5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:36.677548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5db89c2f-c153-4015-a945-dafd5b5f2fa5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:36.678237 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5db89c2f-c153-4015-a945-dafd5b5f2fa5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:36.679020 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5db89c2f-c153-4015-a945-dafd5b5f2fa5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:36.679484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5db89c2f-c153-4015-a945-dafd5b5f2fa5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:36.679982 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5db89c2f-c153-4015-a945-dafd5b5f2fa5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:36.701154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6e1becc8-c576-4450-bb18-43fe361919ac tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:36.703429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6e1becc8-c576-4450-bb18-43fe361919ac tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:36.726103 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e1becc8-c576-4450-bb18-43fe361919ac tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:36.730692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e1becc8-c576-4450-bb18-43fe361919ac tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:36.731152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e1becc8-c576-4450-bb18-43fe361919ac tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:36.731905 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e1becc8-c576-4450-bb18-43fe361919ac tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:36.732373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e1becc8-c576-4450-bb18-43fe361919ac tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:36.732802 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e1becc8-c576-4450-bb18-43fe361919ac tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:37.208898 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6e1becc8-c576-4450-bb18-43fe361919ac tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:37.221096 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6e1becc8-c576-4450-bb18-43fe361919ac tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13" status: 200 len: 1589 microversion: 2.1 time: 0.551011 Aug 04 16:55:37.222566 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 153/305] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:36 2022] GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 => generated 1589 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:37.237350 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-c9c63cc4-224d-4928-8516-46dedd872fb7 req-aed94775-edef-4fa5-9637-ae14a6647320 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69d189f5-2ca5-4d3b-9a70-b6e27d6dda13", "tag": "8294cc37-07d5-4724-a0a2-e13fb2658fa6"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:37.257154 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5db89c2f-c153-4015-a945-dafd5b5f2fa5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:37.288863 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5db89c2f-c153-4015-a945-dafd5b5f2fa5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864" status: 200 len: 1311 microversion: 2.1 time: 0.641528 Aug 04 16:55:37.289841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c9c63cc4-224d-4928-8516-46dedd872fb7 req-aed94775-edef-4fa5-9637-ae14a6647320 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:37.290534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c9c63cc4-224d-4928-8516-46dedd872fb7 req-aed94775-edef-4fa5-9637-ae14a6647320 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:37.291325 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 153/306] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:36 2022] GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864 => generated 1311 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:37.292203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c9c63cc4-224d-4928-8516-46dedd872fb7 req-aed94775-edef-4fa5-9637-ae14a6647320 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:37.305117 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4cbf7bb7-2ab9-4a58-acac-ca7536723472 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Action: 'update', calling method: .version_select at 0x7f1e68135c10>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:37.322367 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-c9c63cc4-224d-4928-8516-46dedd872fb7 req-aed94775-edef-4fa5-9637-ae14a6647320 service nova] Creating event network-changed:8294cc37-07d5-4724-a0a2-e13fb2658fa6 for instance 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 on n-h2-851359-3 Aug 04 16:55:37.339344 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-c9c63cc4-224d-4928-8516-46dedd872fb7 req-aed94775-edef-4fa5-9637-ae14a6647320 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113282 Aug 04 16:55:37.342669 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 154/307] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:37.364140 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ab5153d3-a600-48ae-9738-9af9c06b1b98 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1002628170", "id": 2113492084, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:37.385711 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:37.385711 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:37.434929 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ab5153d3-a600-48ae-9738-9af9c06b1b98 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.088881 Aug 04 16:55:37.436042 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 155/308] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:55:37 2022] POST /compute/v2.1/flavors => generated 417 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:37.448402 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cb7f9c14-b983-4375-b2ed-2d540c3e04f5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:37.449640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cb7f9c14-b983-4375-b2ed-2d540c3e04f5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:37.469105 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4cbf7bb7-2ab9-4a58-acac-ca7536723472 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:37.469913 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4cbf7bb7-2ab9-4a58-acac-ca7536723472 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:37.470650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4cbf7bb7-2ab9-4a58-acac-ca7536723472 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:37.471679 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4cbf7bb7-2ab9-4a58-acac-ca7536723472 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:37.472827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4cbf7bb7-2ab9-4a58-acac-ca7536723472 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:37.473489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4cbf7bb7-2ab9-4a58-acac-ca7536723472 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:37.474715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb7f9c14-b983-4375-b2ed-2d540c3e04f5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:37.478450 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb7f9c14-b983-4375-b2ed-2d540c3e04f5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:37.480345 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb7f9c14-b983-4375-b2ed-2d540c3e04f5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:37.482618 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb7f9c14-b983-4375-b2ed-2d540c3e04f5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:37.483185 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb7f9c14-b983-4375-b2ed-2d540c3e04f5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:37.483632 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb7f9c14-b983-4375-b2ed-2d540c3e04f5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:37.938303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=26,nova_api:UPDATE=12 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:38.065646 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4cbf7bb7-2ab9-4a58-acac-ca7536723472 tempest-QuotasAdminTestJSON-1627868782 tempest-QuotasAdminTestJSON-1627868782-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/453a8f7d3e834893b378f9c963387d26" status: 200 len: 329 microversion: 2.1 time: 0.771720 Aug 04 16:55:38.066642 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 154/309] 10.222.0.93 () {60 vars in 1263 bytes} [Thu Aug 4 16:55:37 2022] PUT /compute/v2.1/os-quota-sets/453a8f7d3e834893b378f9c963387d26 => generated 329 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:38.109799 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cb7f9c14-b983-4375-b2ed-2d540c3e04f5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:38.122829 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cb7f9c14-b983-4375-b2ed-2d540c3e04f5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1471 microversion: 2.1 time: 0.681481 Aug 04 16:55:38.124336 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 156/310] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:37 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1471 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:38.131358 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b9f0a1ea-95fb-46a1-af8b-423b5857fa91 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:38.132217 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b9f0a1ea-95fb-46a1-af8b-423b5857fa91 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] [instance: eb10c53c-59c3-4239-97c5-c898c9f9ca89] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:38.139125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9f0a1ea-95fb-46a1-af8b-423b5857fa91 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:38.139795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9f0a1ea-95fb-46a1-af8b-423b5857fa91 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:38.140427 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9f0a1ea-95fb-46a1-af8b-423b5857fa91 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:38.141303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9f0a1ea-95fb-46a1-af8b-423b5857fa91 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:38.141925 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9f0a1ea-95fb-46a1-af8b-423b5857fa91 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:38.142532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9f0a1ea-95fb-46a1-af8b-423b5857fa91 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:38.254062 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b9f0a1ea-95fb-46a1-af8b-423b5857fa91 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eddfe7e2c347fcbc122b4f6fb89076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3e5530401f4a87a038b3d30679a74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:38.264018 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b9f0a1ea-95fb-46a1-af8b-423b5857fa91 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] 10.222.0.93 "GET /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89" status: 200 len: 1284 microversion: 2.1 time: 0.137802 Aug 04 16:55:38.266575 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 157/311] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:38 2022] GET /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89 => generated 1284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:38.273942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8a0d6325-df22-4e5a-ba17-169b9197224a tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:38.310840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-31ed6a69-26bf-4d91-8ed7-f2ec81e4dac8 tempest-InstanceUsageAuditLogNegativeTestJSON-468185867 tempest-InstanceUsageAuditLogNegativeTestJSON-468185867-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:38.312072 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:38.312072 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:55:38.314095 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-31ed6a69-26bf-4d91-8ed7-f2ec81e4dac8 tempest-InstanceUsageAuditLogNegativeTestJSON-468185867 tempest-InstanceUsageAuditLogNegativeTestJSON-468185867-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'd351ff7fc1de4486b74ce98c8871eab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf8e19711ef47f9beefce42685a8485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:38.316248 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-31ed6a69-26bf-4d91-8ed7-f2ec81e4dac8 tempest-InstanceUsageAuditLogNegativeTestJSON-468185867 tempest-InstanceUsageAuditLogNegativeTestJSON-468185867-project] Request method failure captured: Aug 04 16:55:38.316248 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 04 16:55:38.316248 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:55:38.316248 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:55:38.316248 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:55:38.316248 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:55:38.316248 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:55:38.316248 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:55:38.316248 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:55:38.316248 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:38.316248 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_oFo0S_RNxlBBjikSG84KsX5H1tw5eYX3R61xpV1_nNJ2vhB0hCNpENubrGFI6BZHsiDlwlc_iEX90g96Jw9Piod6wmOjy5TwFtOwh8_v7BXitX863lgAD2lFY0icLa5rtgpJPADHF7bGt5P0c6jhdGEKZayjAFeo4nwV4w9bY8-4Q Aug 04 16:55:38.316248 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:55:38.316248 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:55:38.316248 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:55:38.316248 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:55:38.316248 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:55:38.316248 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:55:38.316248 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: eaf8e19711ef47f9beefce42685a8485 Aug 04 16:55:38.316248 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-468185867 Aug 04 16:55:38.316248 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 16:55:38.316248 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 16:55:38.317662 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/eaf8e19711ef47f9beefce42685a8485"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/eaf8e19711ef47f9beefce42685a8485"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_eaf8e19711ef47f9beefce42685a8485"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/eaf8e19711ef47f9beefce42685a8485"}]}] Aug 04 16:55:38.317662 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-468185867 Aug 04 16:55:38.317662 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: eaf8e19711ef47f9beefce42685a8485 Aug 04 16:55:38.317662 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-468185867 Aug 04 16:55:38.317662 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-468185867-project Aug 04 16:55:38.317662 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:55:38.317662 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:55:38.317662 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: d351ff7fc1de4486b74ce98c8871eab8 Aug 04 16:55:38.317662 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-468185867-project Aug 04 16:55:38.317662 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 16:55:38.318374 n-d-851359-3 devstack@n-api.service[131043]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 04 16:55:38.318374 n-d-851359-3 devstack@n-api.service[131043]: action_args: {} Aug 04 16:55:38.318374 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:38.318374 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:38.318374 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:38.318374 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:38.318374 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:38.318374 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:38.318374 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:38.318374 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:38.318374 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 04 16:55:38.318374 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 04 16:55:38.318374 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:55:38.318374 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:55:38.318374 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:55:38.318374 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:55:38.318374 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:55:38.318374 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:55:38.318374 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:55:38.318374 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:55:38.319748 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:55:38.319748 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:55:38.319748 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:55:38.319748 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:55:38.319748 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:55:38.319748 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:55:38.319748 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 04 16:55:38.319748 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:38.319748 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:38.319748 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:38.319748 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:38.319748 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:38.319748 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:38.319748 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:55:38.319748 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:55:38.319748 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 04 16:55:38.319748 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:38.324198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-31ed6a69-26bf-4d91-8ed7-f2ec81e4dac8 tempest-InstanceUsageAuditLogNegativeTestJSON-468185867 tempest-InstanceUsageAuditLogNegativeTestJSON-468185867-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:38.327415 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-31ed6a69-26bf-4d91-8ed7-f2ec81e4dac8 tempest-InstanceUsageAuditLogNegativeTestJSON-468185867 tempest-InstanceUsageAuditLogNegativeTestJSON-468185867-project] 10.222.0.93 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.259694 Aug 04 16:55:38.333946 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 155/312] 10.222.0.93 () {58 vars in 1185 bytes} [Thu Aug 4 16:55:38 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 264 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:55:38.342459 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8a0d6325-df22-4e5a-ba17-169b9197224a tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 6227 microversion: 2.1 time: 0.070733 Aug 04 16:55:38.342459 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 158/313] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:55:38 2022] GET /compute/v2.1/flavors/detail => generated 6227 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:38.352152 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-08b3626c-e3b6-40c2-bc09-fe20301dbfc6 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:38.354680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-08b3626c-e3b6-40c2-bc09-fe20301dbfc6 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: e07a80a8-dec0-4a8b-bd5e-e2a50370d35b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:38.371503 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-adeb91c8-695c-4bb7-86c0-39a7273f4280 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:38.373015 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-adeb91c8-695c-4bb7-86c0-39a7273f4280 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 37140c09-31fd-4233-9ab9-6351044c5864] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:38.392192 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adeb91c8-695c-4bb7-86c0-39a7273f4280 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:38.392592 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adeb91c8-695c-4bb7-86c0-39a7273f4280 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:38.392908 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-08b3626c-e3b6-40c2-bc09-fe20301dbfc6 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:38.393043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adeb91c8-695c-4bb7-86c0-39a7273f4280 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:38.395401 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-08b3626c-e3b6-40c2-bc09-fe20301dbfc6 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:38.397542 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adeb91c8-695c-4bb7-86c0-39a7273f4280 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:38.399307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-08b3626c-e3b6-40c2-bc09-fe20301dbfc6 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:38.400444 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adeb91c8-695c-4bb7-86c0-39a7273f4280 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:38.401227 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adeb91c8-695c-4bb7-86c0-39a7273f4280 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:38.402892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-08b3626c-e3b6-40c2-bc09-fe20301dbfc6 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:38.405791 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-08b3626c-e3b6-40c2-bc09-fe20301dbfc6 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:38.407117 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-08b3626c-e3b6-40c2-bc09-fe20301dbfc6 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:38.669540 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-08b3626c-e3b6-40c2-bc09-fe20301dbfc6 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12efa078aa84861925925314ef00aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ed72eca39e4bab83ccbba779ac37c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:38.682196 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-08b3626c-e3b6-40c2-bc09-fe20301dbfc6 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "GET /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b" status: 200 len: 1278 microversion: 2.1 time: 0.342121 Aug 04 16:55:38.684508 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 156/314] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:38 2022] GET /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b => generated 1278 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:38.702213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-da207322-6c06-4466-b497-8ae8ac7b41f7 tempest-InstanceUsageAuditLogNegativeTestJSON-468185867 tempest-InstanceUsageAuditLogNegativeTestJSON-468185867-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:38.703632 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:38.703632 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:55:38.705563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-da207322-6c06-4466-b497-8ae8ac7b41f7 tempest-InstanceUsageAuditLogNegativeTestJSON-468185867 tempest-InstanceUsageAuditLogNegativeTestJSON-468185867-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'd351ff7fc1de4486b74ce98c8871eab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf8e19711ef47f9beefce42685a8485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:38.708722 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-da207322-6c06-4466-b497-8ae8ac7b41f7 tempest-InstanceUsageAuditLogNegativeTestJSON-468185867 tempest-InstanceUsageAuditLogNegativeTestJSON-468185867-project] Request method failure captured: Aug 04 16:55:38.708722 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-04%2016:55:38 HTTP/1.1 Aug 04 16:55:38.708722 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:55:38.708722 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:55:38.708722 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:55:38.708722 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:55:38.708722 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:55:38.708722 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:55:38.708722 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:55:38.708722 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:38.708722 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_oFo0S_RNxlBBjikSG84KsX5H1tw5eYX3R61xpV1_nNJ2vhB0hCNpENubrGFI6BZHsiDlwlc_iEX90g96Jw9Piod6wmOjy5TwFtOwh8_v7BXitX863lgAD2lFY0icLa5rtgpJPADHF7bGt5P0c6jhdGEKZayjAFeo4nwV4w9bY8-4Q Aug 04 16:55:38.708722 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:55:38.708722 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:55:38.708722 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:55:38.708722 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:55:38.708722 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:55:38.708722 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:55:38.708722 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: eaf8e19711ef47f9beefce42685a8485 Aug 04 16:55:38.708722 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-468185867 Aug 04 16:55:38.708722 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 16:55:38.708722 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 16:55:38.709901 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/eaf8e19711ef47f9beefce42685a8485"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/eaf8e19711ef47f9beefce42685a8485"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_eaf8e19711ef47f9beefce42685a8485"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/eaf8e19711ef47f9beefce42685a8485"}]}] Aug 04 16:55:38.709901 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-468185867 Aug 04 16:55:38.709901 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: eaf8e19711ef47f9beefce42685a8485 Aug 04 16:55:38.709901 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-468185867 Aug 04 16:55:38.709901 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-468185867-project Aug 04 16:55:38.709901 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:55:38.709901 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:55:38.709901 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: d351ff7fc1de4486b74ce98c8871eab8 Aug 04 16:55:38.709901 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-468185867-project Aug 04 16:55:38.709901 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 16:55:38.710494 n-d-851359-3 devstack@n-api.service[131043]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 04 16:55:38.710494 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '2022-08-04 16:55:38'} Aug 04 16:55:38.710494 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:38.710494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:38.710494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:38.710494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:38.710494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:38.710494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:38.710494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:38.710494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:38.710494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 04 16:55:38.710494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 04 16:55:38.710494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:55:38.710494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:55:38.710494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:55:38.710494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:55:38.710494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:55:38.710494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:55:38.710494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:55:38.710494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:55:38.711636 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:55:38.711636 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:55:38.711636 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:55:38.711636 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:55:38.711636 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:55:38.711636 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:55:38.711636 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 04 16:55:38.711636 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:38.711636 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:38.711636 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:38.711636 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:38.711636 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:38.711636 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:38.711636 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:55:38.711636 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:55:38.711636 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 04 16:55:38.711636 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:38.714236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-da207322-6c06-4466-b497-8ae8ac7b41f7 tempest-InstanceUsageAuditLogNegativeTestJSON-468185867 tempest-InstanceUsageAuditLogNegativeTestJSON-468185867-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:38.716129 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-da207322-6c06-4466-b497-8ae8ac7b41f7 tempest-InstanceUsageAuditLogNegativeTestJSON-468185867 tempest-InstanceUsageAuditLogNegativeTestJSON-468185867-project] 10.222.0.93 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-04 16:55:38" status: 403 len: 128 microversion: 2.1 time: 0.030448 Aug 04 16:55:38.718587 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 157/315] 10.222.0.93 () {58 vars in 1251 bytes} [Thu Aug 4 16:55:38 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-04%2016%3A55%3A38 => generated 128 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:55:38.734175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-781c2bef-5882-41ea-8a50-39ec2848c468 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:38.735254 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:38.735254 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:55:38.790498 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-781c2bef-5882-41ea-8a50-39ec2848c468 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/2113492084" status: 202 len: 0 microversion: 2.1 time: 0.067037 Aug 04 16:55:38.796618 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 158/316] 10.222.0.93 () {58 vars in 1161 bytes} [Thu Aug 4 16:55:38 2022] DELETE /compute/v2.1/flavors/2113492084 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:55:38.803229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-edb21c94-2049-4853-9361-4469e7c93102 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:38.830782 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-edb21c94-2049-4853-9361-4469e7c93102 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.032382 Aug 04 16:55:38.833861 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 159/317] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:55:38 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:38.873024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2dc4ba66-6ec0-4b65-97f1-1c646cb4e4e9 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1837569503", "id": 1664883519, "os-flavor-access:is_public": "True"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:38.877801 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:38.877801 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:55:38.914405 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2dc4ba66-6ec0-4b65-97f1-1c646cb4e4e9 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.050101 Aug 04 16:55:38.915338 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 160/318] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:55:38 2022] POST /compute/v2.1/flavors => generated 429 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:38.919006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-adeb91c8-695c-4bb7-86c0-39a7273f4280 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:38.927315 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-adeb91c8-695c-4bb7-86c0-39a7273f4280 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864" status: 200 len: 1311 microversion: 2.1 time: 0.567445 Aug 04 16:55:38.931795 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 159/319] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:38 2022] GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864 => generated 1311 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:38.941092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b64444f1-b21e-471c-938d-06553393284c tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:38.983097 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b64444f1-b21e-471c-938d-06553393284c tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1664883519" status: 202 len: 0 microversion: 2.1 time: 0.058441 Aug 04 16:55:38.987078 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 161/320] 10.222.0.93 () {58 vars in 1161 bytes} [Thu Aug 4 16:55:38 2022] DELETE /compute/v2.1/flavors/1664883519 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:55:38.992007 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bf846b6c-dc18-4ee3-9aff-43f96a349392 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:39.044307 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bf846b6c-dc18-4ee3-9aff-43f96a349392 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.055993 Aug 04 16:55:39.061431 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 160/321] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:55:38 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:39.066692 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-17a8ede8-6667-4775-9050-b7cb47b62860 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-377617266", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:39.092874 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-17a8ede8-6667-4775-9050-b7cb47b62860 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.030498 Aug 04 16:55:39.094275 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 162/322] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:55:39 2022] POST /compute/v2.1/flavors => generated 506 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:55:39.109369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-09444edb-477f-4225-b072-da1aeae98577 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:39.111445 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:39.111445 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:39.137326 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-09444edb-477f-4225-b072-da1aeae98577 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/187f3a74-0a5e-441c-90ee-1214c9bea01f" status: 202 len: 0 microversion: 2.1 time: 0.034299 Aug 04 16:55:39.142526 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 161/323] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 16:55:39 2022] DELETE /compute/v2.1/flavors/187f3a74-0a5e-441c-90ee-1214c9bea01f => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:55:39.147028 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2c59f766-32a9-4596-9bad-ff6e40474f89 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:39.153720 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ae871802-94fd-4421-8951-bb3ea6e02344 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:39.155206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ae871802-94fd-4421-8951-bb3ea6e02344 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:39.167511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae871802-94fd-4421-8951-bb3ea6e02344 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:39.168181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae871802-94fd-4421-8951-bb3ea6e02344 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:39.168643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae871802-94fd-4421-8951-bb3ea6e02344 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:39.172810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae871802-94fd-4421-8951-bb3ea6e02344 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:39.172810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae871802-94fd-4421-8951-bb3ea6e02344 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:39.173263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae871802-94fd-4421-8951-bb3ea6e02344 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:39.190408 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2c59f766-32a9-4596-9bad-ff6e40474f89 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.046365 Aug 04 16:55:39.206489 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 163/324] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:55:39 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:39.213041 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-711a2f37-e04f-4d71-a129-b7aaa1d90678 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-237422624", "id": "aaca3b1f-9d13-40d4-9232-c6aa5d7bd7c0", "os-flavor-access:is_public": "True"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:39.268740 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-711a2f37-e04f-4d71-a129-b7aaa1d90678 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.060071 Aug 04 16:55:39.279425 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 164/325] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:55:39 2022] POST /compute/v2.1/flavors => generated 506 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:39.289217 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-48036016-e96e-4610-ab1f-91f2c68f6ef0 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:39.328873 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-48036016-e96e-4610-ab1f-91f2c68f6ef0 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/aaca3b1f-9d13-40d4-9232-c6aa5d7bd7c0" status: 202 len: 0 microversion: 2.1 time: 0.046676 Aug 04 16:55:39.329671 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 165/326] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 16:55:39 2022] DELETE /compute/v2.1/flavors/aaca3b1f-9d13-40d4-9232-c6aa5d7bd7c0 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:55:39.336718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-20ca7428-214d-43a9-9ebf-aceb085ab822 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:39.337347 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-20ca7428-214d-43a9-9ebf-aceb085ab822 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] [instance: eb10c53c-59c3-4239-97c5-c898c9f9ca89] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:39.350956 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20ca7428-214d-43a9-9ebf-aceb085ab822 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:39.351716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20ca7428-214d-43a9-9ebf-aceb085ab822 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:39.352404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20ca7428-214d-43a9-9ebf-aceb085ab822 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:39.353431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20ca7428-214d-43a9-9ebf-aceb085ab822 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:39.354716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20ca7428-214d-43a9-9ebf-aceb085ab822 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:39.355371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20ca7428-214d-43a9-9ebf-aceb085ab822 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:39.462900 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-20ca7428-214d-43a9-9ebf-aceb085ab822 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eddfe7e2c347fcbc122b4f6fb89076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3e5530401f4a87a038b3d30679a74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:39.477342 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-20ca7428-214d-43a9-9ebf-aceb085ab822 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] 10.222.0.93 "GET /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89" status: 200 len: 1290 microversion: 2.1 time: 0.146771 Aug 04 16:55:39.477961 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 166/327] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:39 2022] GET /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89 => generated 1290 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:39.503886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f65453ac-6705-44c6-8ec5-24950dfec384 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:39.551971 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f65453ac-6705-44c6-8ec5-24950dfec384 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.057261 Aug 04 16:55:39.555250 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 167/328] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:55:39 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:39.577189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8f51c8a4-dcfc-4135-8b55-f303f20ac8b1 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1027311195", "id": 331687036, "os-flavor-access:is_public": "True"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:39.580538 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:39.580538 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:55:39.609306 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8f51c8a4-dcfc-4135-8b55-f303f20ac8b1 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.033960 Aug 04 16:55:39.610381 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 168/329] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:55:39 2022] POST /compute/v2.1/flavors => generated 411 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:55:39.623768 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0ec587ee-19b0-402a-8b42-da2cf0798463 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:39.636283 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0ec587ee-19b0-402a-8b42-da2cf0798463 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/331687036" status: 200 len: 411 microversion: 2.1 time: 0.015687 Aug 04 16:55:39.637289 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 169/330] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Aug 4 16:55:39 2022] GET /compute/v2.1/flavors/331687036 => generated 411 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:55:39.711755 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ae871802-94fd-4421-8951-bb3ea6e02344 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:39.724527 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ae871802-94fd-4421-8951-bb3ea6e02344 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1471 microversion: 2.1 time: 0.577340 Aug 04 16:55:39.726970 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 162/331] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:39 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1471 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:39.741997 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1900949d-6437-4060-b3ca-1c0a7166b460 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:39.742909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1900949d-6437-4060-b3ca-1c0a7166b460 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: e07a80a8-dec0-4a8b-bd5e-e2a50370d35b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:39.755669 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1900949d-6437-4060-b3ca-1c0a7166b460 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:39.758674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1900949d-6437-4060-b3ca-1c0a7166b460 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:39.759483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1900949d-6437-4060-b3ca-1c0a7166b460 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:39.761492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1900949d-6437-4060-b3ca-1c0a7166b460 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:39.762289 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1900949d-6437-4060-b3ca-1c0a7166b460 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:39.764664 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1900949d-6437-4060-b3ca-1c0a7166b460 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:40.025208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4c0206fa-69c3-45d2-a53e-a02b5138db26 tempest-FlavorsAdminTestJSON-1100200661 tempest-FlavorsAdminTestJSON-1100200661-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:40.075605 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4c0206fa-69c3-45d2-a53e-a02b5138db26 tempest-FlavorsAdminTestJSON-1100200661 tempest-FlavorsAdminTestJSON-1100200661-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 6221 microversion: 2.1 time: 0.428794 Aug 04 16:55:40.079734 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 170/332] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:55:39 2022] GET /compute/v2.1/flavors/detail => generated 6221 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:40.111881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-439ebe2d-28e6-428b-8cf4-aabe55ea0667 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:40.112563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-439ebe2d-28e6-428b-8cf4-aabe55ea0667 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 37140c09-31fd-4233-9ab9-6351044c5864] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:40.120439 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-439ebe2d-28e6-428b-8cf4-aabe55ea0667 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:40.121329 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-439ebe2d-28e6-428b-8cf4-aabe55ea0667 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:40.121775 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-439ebe2d-28e6-428b-8cf4-aabe55ea0667 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:40.122747 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-439ebe2d-28e6-428b-8cf4-aabe55ea0667 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:40.123769 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-439ebe2d-28e6-428b-8cf4-aabe55ea0667 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:40.124996 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-439ebe2d-28e6-428b-8cf4-aabe55ea0667 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:40.699257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-439ebe2d-28e6-428b-8cf4-aabe55ea0667 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:40.723899 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-439ebe2d-28e6-428b-8cf4-aabe55ea0667 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864" status: 200 len: 1311 microversion: 2.1 time: 0.642503 Aug 04 16:55:40.724808 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 171/333] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:40 2022] GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864 => generated 1311 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:40.748697 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d53d8ec5-5e7d-45c0-b375-835ffb922231 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:40.748697 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:40.748697 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:55:40.772918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1900949d-6437-4060-b3ca-1c0a7166b460 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12efa078aa84861925925314ef00aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ed72eca39e4bab83ccbba779ac37c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:40.788295 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d53d8ec5-5e7d-45c0-b375-835ffb922231 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/331687036" status: 202 len: 0 microversion: 2.1 time: 0.048500 Aug 04 16:55:40.792749 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 172/334] 10.222.0.93 () {58 vars in 1158 bytes} [Thu Aug 4 16:55:40 2022] DELETE /compute/v2.1/flavors/331687036 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:55:40.797804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1ffe1303-a0a5-4c8c-b3cb-193be5e8ed42 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:40.798452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1ffe1303-a0a5-4c8c-b3cb-193be5e8ed42 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] [instance: eb10c53c-59c3-4239-97c5-c898c9f9ca89] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:40.803294 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1900949d-6437-4060-b3ca-1c0a7166b460 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "GET /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b" status: 200 len: 1320 microversion: 2.1 time: 1.075104 Aug 04 16:55:40.804231 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 163/335] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:39 2022] GET /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b => generated 1320 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:40.811602 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-95a12c3c-9d54-4c0d-bf2d-3e0e6ae278bd tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:40.812839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-95a12c3c-9d54-4c0d-bf2d-3e0e6ae278bd tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:40.821165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ffe1303-a0a5-4c8c-b3cb-193be5e8ed42 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:40.821666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ffe1303-a0a5-4c8c-b3cb-193be5e8ed42 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:40.825238 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95a12c3c-9d54-4c0d-bf2d-3e0e6ae278bd tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:40.827001 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95a12c3c-9d54-4c0d-bf2d-3e0e6ae278bd tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:40.827632 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95a12c3c-9d54-4c0d-bf2d-3e0e6ae278bd tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:40.827954 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ffe1303-a0a5-4c8c-b3cb-193be5e8ed42 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:40.828887 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ffe1303-a0a5-4c8c-b3cb-193be5e8ed42 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:40.829815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95a12c3c-9d54-4c0d-bf2d-3e0e6ae278bd tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:40.830624 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95a12c3c-9d54-4c0d-bf2d-3e0e6ae278bd tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:40.833079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ffe1303-a0a5-4c8c-b3cb-193be5e8ed42 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:40.833079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ffe1303-a0a5-4c8c-b3cb-193be5e8ed42 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:40.838601 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95a12c3c-9d54-4c0d-bf2d-3e0e6ae278bd tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:41.234838 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1ffe1303-a0a5-4c8c-b3cb-193be5e8ed42 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eddfe7e2c347fcbc122b4f6fb89076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3e5530401f4a87a038b3d30679a74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:41.250328 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1ffe1303-a0a5-4c8c-b3cb-193be5e8ed42 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] 10.222.0.93 "GET /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89" status: 200 len: 1332 microversion: 2.1 time: 0.459737 Aug 04 16:55:41.251722 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 173/336] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:40 2022] GET /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89 => generated 1332 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:41.262313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-55df18aa-0051-4db5-8e37-9c7e8ce441f3 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:41.275259 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-95a12c3c-9d54-4c0d-bf2d-3e0e6ae278bd tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:41.287174 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-95a12c3c-9d54-4c0d-bf2d-3e0e6ae278bd tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1476 microversion: 2.1 time: 0.480023 Aug 04 16:55:41.288433 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 164/337] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:40 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1476 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:41.316519 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-55df18aa-0051-4db5-8e37-9c7e8ce441f3 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.061867 Aug 04 16:55:41.323024 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 174/338] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:55:41 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:41.346328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-867da4d5-4e6a-4da8-b04f-65a9b0b0156c tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-514551073", "id": 1469392070, "os-flavor-access:is_public": "False"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:41.350268 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:41.350268 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:41.378546 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-867da4d5-4e6a-4da8-b04f-65a9b0b0156c tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.037416 Aug 04 16:55:41.386130 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 165/339] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:55:41 2022] POST /compute/v2.1/flavors => generated 429 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:41.399180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bbda6a4c-fa35-4d5f-9385-33d0cdec5b9b tempest-FlavorsAdminTestJSON-1100200661 tempest-FlavorsAdminTestJSON-1100200661-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "1469392070"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:41.412439 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-bbda6a4c-fa35-4d5f-9385-33d0cdec5b9b tempest-FlavorsAdminTestJSON-1100200661 tempest-FlavorsAdminTestJSON-1100200661-project] HTTP exception thrown: Flavor 1469392070 could not be found. Aug 04 16:55:41.416078 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bbda6a4c-fa35-4d5f-9385-33d0cdec5b9b tempest-FlavorsAdminTestJSON-1100200661 tempest-FlavorsAdminTestJSON-1100200661-project] Request method failure captured: Aug 04 16:55:41.416078 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 16:55:41.416078 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:55:41.416078 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:55:41.416078 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:55:41.416078 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 107 Aug 04 16:55:41.416078 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:55:41.416078 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:55:41.416078 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:55:41.416078 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:55:41.416078 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_oAvnIuN_-zzwBjbLibXw6ukT0PMHo27S6RiRFiqC5ZT9TFckybuMalJokk2YniDWSCmiZ10Hk-tkIVlKZSLcQAj6FPdJ8RnYkqlTEzpN0x01unK2x_xziENNnGepWCqQo1YUFy08awP-mi3QrvKb5yRIj0TVQ413eWzF3Cu5KEwsE Aug 04 16:55:41.416078 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:55:41.416078 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:55:41.416078 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:55:41.416078 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:55:41.416078 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:55:41.416078 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:55:41.416078 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 7b9f31ec28da4737ac9bd0a68bdbcc26 Aug 04 16:55:41.416078 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-FlavorsAdminTestJSON-1100200661 Aug 04 16:55:41.416078 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 16:55:41.416078 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 16:55:41.417652 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7b9f31ec28da4737ac9bd0a68bdbcc26"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7b9f31ec28da4737ac9bd0a68bdbcc26"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_7b9f31ec28da4737ac9bd0a68bdbcc26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/7b9f31ec28da4737ac9bd0a68bdbcc26"}]}] Aug 04 16:55:41.417652 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-FlavorsAdminTestJSON-1100200661 Aug 04 16:55:41.417652 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 7b9f31ec28da4737ac9bd0a68bdbcc26 Aug 04 16:55:41.417652 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1100200661 Aug 04 16:55:41.417652 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-FlavorsAdminTestJSON-1100200661-project Aug 04 16:55:41.417652 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:55:41.417652 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:55:41.417652 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 20c6a686dffb4193bd18433dac86246b Aug 04 16:55:41.417652 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-FlavorsAdminTestJSON-1100200661-project Aug 04 16:55:41.417652 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 16:55:41.417652 n-d-851359-3 devstack@n-api.service[131043]: {"server": {"name": "test", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "1469392070"}} Aug 04 16:55:41.417652 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 16:55:41.417652 n-d-851359-3 devstack@n-api.service[131043]: exception: Flavor 1469392070 could not be found. Aug 04 16:55:41.418795 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '93ebc91d-2d7a-4ab2-b133-dcf9559166d9', 'flavorRef': '1469392070'}}} Aug 04 16:55:41.418795 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:55:41.418795 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:41.418795 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 04 16:55:41.418795 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 04 16:55:41.418795 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 16:55:41.418795 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 16:55:41.418795 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:55:41.418795 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:55:41.418795 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 16:55:41.418795 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 16:55:41.418795 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 16:55:41.418795 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:41.418795 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 16:55:41.418795 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 16:55:41.418795 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1469392070 could not be found. Aug 04 16:55:41.418795 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:41.418795 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:41.418795 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:41.418795 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:41.420218 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:41.420218 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:41.420218 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:55:41.420218 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:55:41.420218 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:55:41.420218 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:55:41.420218 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:55:41.420218 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:55:41.420218 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:55:41.420218 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:55:41.420218 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:55:41.420218 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:55:41.420218 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 16:55:41.420218 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 04 16:55:41.420218 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 04 16:55:41.420218 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1469392070 could not be found. Aug 04 16:55:41.420218 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:41.420218 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:55:41.420218 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:41.420218 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:55:41.420218 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:55:41.421397 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:55:41.421397 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:55:41.421397 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:55:41.421397 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1469392070 could not be found. Aug 04 16:55:41.421397 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:55:41.423431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bbda6a4c-fa35-4d5f-9385-33d0cdec5b9b tempest-FlavorsAdminTestJSON-1100200661 tempest-FlavorsAdminTestJSON-1100200661-project] Returning 400 to user: Flavor 1469392070 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:55:41.426231 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bbda6a4c-fa35-4d5f-9385-33d0cdec5b9b tempest-FlavorsAdminTestJSON-1100200661 tempest-FlavorsAdminTestJSON-1100200661-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.031822 Aug 04 16:55:41.428198 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 175/340] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:55:41 2022] POST /compute/v2.1/servers => generated 81 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 16:55:41.437263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-96407365-14a3-4db4-bc11-3dc5e2f1155e tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:41.438071 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:41.438071 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:41.466806 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-96407365-14a3-4db4-bc11-3dc5e2f1155e tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1469392070" status: 202 len: 0 microversion: 2.1 time: 0.033445 Aug 04 16:55:41.468263 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 166/341] 10.222.0.93 () {58 vars in 1161 bytes} [Thu Aug 4 16:55:41 2022] DELETE /compute/v2.1/flavors/1469392070 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 16:55:41.479458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7d262c1b-90c3-4df6-8c85-78e02adacb0a tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:41.505148 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7d262c1b-90c3-4df6-8c85-78e02adacb0a tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.032106 Aug 04 16:55:41.506525 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 176/342] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:55:41 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:41.529566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-29b27b8b-f398-4565-bc2f-93e8852b8251 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-846127577", "id": 1682247634, "os-flavor-access:is_public": "False"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:41.572852 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-29b27b8b-f398-4565-bc2f-93e8852b8251 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.047789 Aug 04 16:55:41.573701 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 167/343] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:55:41 2022] POST /compute/v2.1/flavors => generated 414 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:41.588020 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-07f31515-7ea0-4ccf-b20a-b5b24faf869c tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-859699709", "id": 1208505247, "os-flavor-access:is_public": "True"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:41.591423 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:41.591423 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:55:41.614326 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-07f31515-7ea0-4ccf-b20a-b5b24faf869c tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.030710 Aug 04 16:55:41.616313 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 177/344] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:55:41 2022] POST /compute/v2.1/flavors => generated 413 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:55:41.630128 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6d06e095-122e-4f2e-ae16-e84b782dba0a tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:41.657376 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6d06e095-122e-4f2e-ae16-e84b782dba0a tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.032364 Aug 04 16:55:41.659234 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 168/345] 10.222.0.93 () {58 vars in 1169 bytes} [Thu Aug 4 16:55:41 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:41.673313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c4e75b75-582b-4364-809c-10bf53a0ebd8 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:41.702241 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c4e75b75-582b-4364-809c-10bf53a0ebd8 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.033031 Aug 04 16:55:41.705761 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 178/346] 10.222.0.93 () {58 vars in 1177 bytes} [Thu Aug 4 16:55:41 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:41.720512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a45d699f-5ef8-4ea3-a04d-48534259f184 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:41.749201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d7df0ba0-feee-4b2c-88c6-d1092ddab9a0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:41.750099 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d7df0ba0-feee-4b2c-88c6-d1092ddab9a0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 37140c09-31fd-4233-9ab9-6351044c5864] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:41.764103 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7df0ba0-feee-4b2c-88c6-d1092ddab9a0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:41.764428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7df0ba0-feee-4b2c-88c6-d1092ddab9a0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:41.764613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7df0ba0-feee-4b2c-88c6-d1092ddab9a0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:41.765463 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a45d699f-5ef8-4ea3-a04d-48534259f184 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.049436 Aug 04 16:55:41.767331 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 169/347] 10.222.0.93 () {58 vars in 1171 bytes} [Thu Aug 4 16:55:41 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:41.767823 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7df0ba0-feee-4b2c-88c6-d1092ddab9a0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:41.768627 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7df0ba0-feee-4b2c-88c6-d1092ddab9a0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:41.769557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7df0ba0-feee-4b2c-88c6-d1092ddab9a0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:41.783623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a5b83a20-ec1c-4b3f-9200-ae25aa37789a tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:41.812224 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a5b83a20-ec1c-4b3f-9200-ae25aa37789a tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.033995 Aug 04 16:55:41.815048 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 170/348] 10.222.0.93 () {58 vars in 1169 bytes} [Thu Aug 4 16:55:41 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:55:41.829199 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e06b3bc2-bdbc-4b3b-87e2-1d2e1ab11c8f tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:41.830254 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e06b3bc2-bdbc-4b3b-87e2-1d2e1ab11c8f tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: e07a80a8-dec0-4a8b-bd5e-e2a50370d35b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:41.852365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e06b3bc2-bdbc-4b3b-87e2-1d2e1ab11c8f tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:41.854941 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e06b3bc2-bdbc-4b3b-87e2-1d2e1ab11c8f tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:41.858686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e06b3bc2-bdbc-4b3b-87e2-1d2e1ab11c8f tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:41.860131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e06b3bc2-bdbc-4b3b-87e2-1d2e1ab11c8f tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:41.861165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e06b3bc2-bdbc-4b3b-87e2-1d2e1ab11c8f tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:41.863572 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e06b3bc2-bdbc-4b3b-87e2-1d2e1ab11c8f tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:42.398304 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e06b3bc2-bdbc-4b3b-87e2-1d2e1ab11c8f tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12efa078aa84861925925314ef00aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ed72eca39e4bab83ccbba779ac37c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:42.410298 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d7df0ba0-feee-4b2c-88c6-d1092ddab9a0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:42.420562 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e06b3bc2-bdbc-4b3b-87e2-1d2e1ab11c8f tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "GET /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b" status: 200 len: 1320 microversion: 2.1 time: 0.599016 Aug 04 16:55:42.421815 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 171/349] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:41 2022] GET /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b => generated 1320 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:42.423008 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d7df0ba0-feee-4b2c-88c6-d1092ddab9a0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864" status: 200 len: 1311 microversion: 2.1 time: 0.680182 Aug 04 16:55:42.437536 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 179/350] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:41 2022] GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864 => generated 1311 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:42.443036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b732aa8f-5461-4808-804c-e3597295dd9c tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:42.465617 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-64dda785-ab36-4b54-844f-11209cec652a req-53595af0-9f01-4581-a1e2-8a040c5cf583 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb10c53c-59c3-4239-97c5-c898c9f9ca89", "tag": "7c10a7ae-46ce-40dd-b73d-1e6d2b434cee"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:42.478471 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b732aa8f-5461-4808-804c-e3597295dd9c tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6223 microversion: 2.1 time: 0.054765 Aug 04 16:55:42.495056 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 172/351] 10.222.0.93 () {58 vars in 1169 bytes} [Thu Aug 4 16:55:42 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6223 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:42.495288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-64dda785-ab36-4b54-844f-11209cec652a req-53595af0-9f01-4581-a1e2-8a040c5cf583 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:42.495288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-64dda785-ab36-4b54-844f-11209cec652a req-53595af0-9f01-4581-a1e2-8a040c5cf583 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:42.495288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-64dda785-ab36-4b54-844f-11209cec652a req-53595af0-9f01-4581-a1e2-8a040c5cf583 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:42.498246 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0b9e877d-7abc-4634-8fb6-d708fb690c2f req-ccfea522-9b0f-46fb-9682-3354e7d4245c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37140c09-31fd-4233-9ab9-6351044c5864", "name": "network-vif-plugged", "status": "completed", "tag": "e39bb9a8-b8ea-451a-83ab-1b6e8662ede5"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:42.517257 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0b9e877d-7abc-4634-8fb6-d708fb690c2f req-ccfea522-9b0f-46fb-9682-3354e7d4245c service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:42.517452 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-64dda785-ab36-4b54-844f-11209cec652a req-53595af0-9f01-4581-a1e2-8a040c5cf583 service nova] Creating event network-changed:7c10a7ae-46ce-40dd-b73d-1e6d2b434cee for instance eb10c53c-59c3-4239-97c5-c898c9f9ca89 on n-h1-851359-3 Aug 04 16:55:42.523588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0b9e877d-7abc-4634-8fb6-d708fb690c2f req-ccfea522-9b0f-46fb-9682-3354e7d4245c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:42.523707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0b9e877d-7abc-4634-8fb6-d708fb690c2f req-ccfea522-9b0f-46fb-9682-3354e7d4245c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:42.528026 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-64dda785-ab36-4b54-844f-11209cec652a req-53595af0-9f01-4581-a1e2-8a040c5cf583 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086247 Aug 04 16:55:42.534418 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 180/352] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:42.539696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8b533b2f-e143-4f75-bbd8-03f6e4efc720 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:42.540395 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8b533b2f-e143-4f75-bbd8-03f6e4efc720 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] [instance: eb10c53c-59c3-4239-97c5-c898c9f9ca89] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:42.551867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8b533b2f-e143-4f75-bbd8-03f6e4efc720 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:42.552194 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0b9e877d-7abc-4634-8fb6-d708fb690c2f req-ccfea522-9b0f-46fb-9682-3354e7d4245c service nova] Creating event network-vif-plugged:e39bb9a8-b8ea-451a-83ab-1b6e8662ede5 for instance 37140c09-31fd-4233-9ab9-6351044c5864 on n-h1-851359-3 Aug 04 16:55:42.553733 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8b533b2f-e143-4f75-bbd8-03f6e4efc720 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:42.554826 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8b533b2f-e143-4f75-bbd8-03f6e4efc720 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:42.556315 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8b533b2f-e143-4f75-bbd8-03f6e4efc720 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:42.557243 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8b533b2f-e143-4f75-bbd8-03f6e4efc720 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:42.558069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8b533b2f-e143-4f75-bbd8-03f6e4efc720 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:42.575292 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0b9e877d-7abc-4634-8fb6-d708fb690c2f req-ccfea522-9b0f-46fb-9682-3354e7d4245c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085359 Aug 04 16:55:42.576554 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 173/353] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:42.585610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b6df17e0-6248-41ac-ace9-371a66d84c77 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:42.586596 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b6df17e0-6248-41ac-ace9-371a66d84c77 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:42.595811 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6df17e0-6248-41ac-ace9-371a66d84c77 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:42.596695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6df17e0-6248-41ac-ace9-371a66d84c77 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:42.597288 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6df17e0-6248-41ac-ace9-371a66d84c77 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:42.600508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6df17e0-6248-41ac-ace9-371a66d84c77 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:42.601150 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6df17e0-6248-41ac-ace9-371a66d84c77 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:42.602090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6df17e0-6248-41ac-ace9-371a66d84c77 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:42.621549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:43.020177 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b6df17e0-6248-41ac-ace9-371a66d84c77 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:43.023824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:43.030330 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b6df17e0-6248-41ac-ace9-371a66d84c77 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1476 microversion: 2.1 time: 0.449878 Aug 04 16:55:43.031344 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 174/354] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:42 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1476 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:43.038698 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-486e7ed0-fd18-4e07-a283-f6bcac1cd18b req-3dab85ce-17e3-4ad7-8b6e-14a299b70757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e07a80a8-dec0-4a8b-bd5e-e2a50370d35b", "tag": "8594332c-5c09-4548-bbe4-843f0ea972a9"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:43.048905 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8b533b2f-e143-4f75-bbd8-03f6e4efc720 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eddfe7e2c347fcbc122b4f6fb89076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3e5530401f4a87a038b3d30679a74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:43.051540 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-486e7ed0-fd18-4e07-a283-f6bcac1cd18b req-3dab85ce-17e3-4ad7-8b6e-14a299b70757 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:43.052211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-486e7ed0-fd18-4e07-a283-f6bcac1cd18b req-3dab85ce-17e3-4ad7-8b6e-14a299b70757 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:43.052899 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-486e7ed0-fd18-4e07-a283-f6bcac1cd18b req-3dab85ce-17e3-4ad7-8b6e-14a299b70757 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:43.063035 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8b533b2f-e143-4f75-bbd8-03f6e4efc720 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] 10.222.0.93 "GET /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89" status: 200 len: 1332 microversion: 2.1 time: 0.527303 Aug 04 16:55:43.063624 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 181/355] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:42 2022] GET /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89 => generated 1332 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:43.069584 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-486e7ed0-fd18-4e07-a283-f6bcac1cd18b req-3dab85ce-17e3-4ad7-8b6e-14a299b70757 service nova] Creating event network-changed:8594332c-5c09-4548-bbe4-843f0ea972a9 for instance e07a80a8-dec0-4a8b-bd5e-e2a50370d35b on n-h2-851359-3 Aug 04 16:55:43.074468 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-486e7ed0-fd18-4e07-a283-f6bcac1cd18b req-3dab85ce-17e3-4ad7-8b6e-14a299b70757 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041691 Aug 04 16:55:43.075720 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 175/356] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:43.077930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f6c753cf-475f-4a14-b94b-5c194a20b42c tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:43.112780 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f6c753cf-475f-4a14-b94b-5c194a20b42c tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6223 microversion: 2.1 time: 0.047704 Aug 04 16:55:43.114210 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 182/357] 10.222.0.93 () {58 vars in 1175 bytes} [Thu Aug 4 16:55:43 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6223 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:43.141174 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-20bff89d-822c-40f3-8484-74f0916524a4 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:43.166942 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-20bff89d-822c-40f3-8484-74f0916524a4 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6223 microversion: 2.1 time: 0.034499 Aug 04 16:55:43.167999 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 176/358] 10.222.0.93 () {58 vars in 1173 bytes} [Thu Aug 4 16:55:43 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6223 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:43.186872 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-567529a7-1a04-432e-8191-9bc46a714f0e tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:43.218924 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-567529a7-1a04-432e-8191-9bc46a714f0e tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6223 microversion: 2.1 time: 0.035475 Aug 04 16:55:43.220621 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 183/359] 10.222.0.93 () {58 vars in 1169 bytes} [Thu Aug 4 16:55:43 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6223 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:43.238944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-118f0e00-7464-4689-b205-f70bf25c9934 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:43.239793 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:43.239793 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:43.257736 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-118f0e00-7464-4689-b205-f70bf25c9934 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1208505247" status: 202 len: 0 microversion: 2.1 time: 0.022839 Aug 04 16:55:43.262257 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 177/360] 10.222.0.93 () {58 vars in 1161 bytes} [Thu Aug 4 16:55:43 2022] DELETE /compute/v2.1/flavors/1208505247 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:55:43.266828 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-25871636-b9f7-4769-97ef-d19ad67c8ae8 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:43.288717 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-25871636-b9f7-4769-97ef-d19ad67c8ae8 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.025340 Aug 04 16:55:43.289945 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 184/361] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:55:43 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:55:43.315165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3308ae7b-f1b5-4e22-9ea3-58b7273cd1b5 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:43.342669 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3308ae7b-f1b5-4e22-9ea3-58b7273cd1b5 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1682247634" status: 202 len: 0 microversion: 2.1 time: 0.035305 Aug 04 16:55:43.343999 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 178/362] 10.222.0.93 () {58 vars in 1161 bytes} [Thu Aug 4 16:55:43 2022] DELETE /compute/v2.1/flavors/1682247634 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:55:43.355487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b624ad3e-3d77-4575-b8c6-3b42da37ffa4 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:43.362432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=7,nova_api:UPDATE=2,nova_api:DELETE=12 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:43.383304 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b624ad3e-3d77-4575-b8c6-3b42da37ffa4 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.032376 Aug 04 16:55:43.383939 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 185/363] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:55:43 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:43.412913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cda64d34-5d4d-48dc-9299-b39fd7c1c33c tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-547770124", "id": 1980759348, "os-flavor-access:is_public": "False"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:43.416042 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:43.416042 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:43.433522 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cda64d34-5d4d-48dc-9299-b39fd7c1c33c tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.024616 Aug 04 16:55:43.441355 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 179/364] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:55:43 2022] POST /compute/v2.1/flavors => generated 414 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:43.449816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-018434de-a425-4444-87bb-dee9e82345d0 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:43.456482 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2fb7f8f8-d11c-41ab-8f57-ff924ab870e7 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:43.457292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2fb7f8f8-d11c-41ab-8f57-ff924ab870e7 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: e07a80a8-dec0-4a8b-bd5e-e2a50370d35b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:43.462175 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7,nova_api:DELETE=12 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:43.467833 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fb7f8f8-d11c-41ab-8f57-ff924ab870e7 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:43.468441 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fb7f8f8-d11c-41ab-8f57-ff924ab870e7 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:43.468877 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fb7f8f8-d11c-41ab-8f57-ff924ab870e7 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:43.469594 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fb7f8f8-d11c-41ab-8f57-ff924ab870e7 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:43.470653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fb7f8f8-d11c-41ab-8f57-ff924ab870e7 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:43.471095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fb7f8f8-d11c-41ab-8f57-ff924ab870e7 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:43.481228 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-018434de-a425-4444-87bb-dee9e82345d0 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.036036 Aug 04 16:55:43.486761 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 186/365] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:55:43 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:43.499608 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9f5e2232-77ea-4f5a-a4f1-96471f9927fe tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:43.501210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9f5e2232-77ea-4f5a-a4f1-96471f9927fe tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 37140c09-31fd-4233-9ab9-6351044c5864] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:43.509441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f5e2232-77ea-4f5a-a4f1-96471f9927fe tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:43.509946 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f5e2232-77ea-4f5a-a4f1-96471f9927fe tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:43.510457 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f5e2232-77ea-4f5a-a4f1-96471f9927fe tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:43.511544 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f5e2232-77ea-4f5a-a4f1-96471f9927fe tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:43.512730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f5e2232-77ea-4f5a-a4f1-96471f9927fe tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:43.513528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f5e2232-77ea-4f5a-a4f1-96471f9927fe tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:43.730954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2fb7f8f8-d11c-41ab-8f57-ff924ab870e7 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12efa078aa84861925925314ef00aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ed72eca39e4bab83ccbba779ac37c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:43.745302 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2fb7f8f8-d11c-41ab-8f57-ff924ab870e7 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "GET /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b" status: 200 len: 1320 microversion: 2.1 time: 0.294317 Aug 04 16:55:43.758463 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 180/366] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:43 2022] GET /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b => generated 1320 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:43.765008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4040b440-3f74-450e-bbb1-ad29ff8ba5ee tempest-FlavorsAdminTestJSON-1100200661 tempest-FlavorsAdminTestJSON-1100200661-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:43.783807 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9f5e2232-77ea-4f5a-a4f1-96471f9927fe tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:43.789148 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4040b440-3f74-450e-bbb1-ad29ff8ba5ee tempest-FlavorsAdminTestJSON-1100200661 tempest-FlavorsAdminTestJSON-1100200661-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.029474 Aug 04 16:55:43.790650 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 181/367] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:55:43 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:43.798568 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9f5e2232-77ea-4f5a-a4f1-96471f9927fe tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864" status: 200 len: 1311 microversion: 2.1 time: 0.309595 Aug 04 16:55:43.799448 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 187/368] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:43 2022] GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864 => generated 1311 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:43.817835 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-48891e5c-ce7f-42cf-82e9-5332924c58ff tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:43.818974 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:43.818974 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:43.837057 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-48891e5c-ce7f-42cf-82e9-5332924c58ff tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1980759348" status: 202 len: 0 microversion: 2.1 time: 0.024827 Aug 04 16:55:43.837738 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 182/369] 10.222.0.93 () {58 vars in 1161 bytes} [Thu Aug 4 16:55:43 2022] DELETE /compute/v2.1/flavors/1980759348 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:55:43.848523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-58cad45c-428a-4455-8a39-bd82180095df tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:43.868050 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-58cad45c-428a-4455-8a39-bd82180095df tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.025380 Aug 04 16:55:43.868848 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 188/370] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:55:43 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:55:43.888906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7ab2f028-200d-471e-bb77-5b2fb533ce8e tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1726404370", "id": 517499004, "os-flavor-access:is_public": "True"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:43.891826 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:43.891826 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:43.911037 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7ab2f028-200d-471e-bb77-5b2fb533ce8e tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.025771 Aug 04 16:55:43.911641 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 183/371] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:55:43 2022] POST /compute/v2.1/flavors => generated 411 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:43.927634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ddace6c6-05d3-465f-97e8-15edfacb8e3f tempest-FlavorsAdminTestJSON-1100200661 tempest-FlavorsAdminTestJSON-1100200661-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:43.955576 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ddace6c6-05d3-465f-97e8-15edfacb8e3f tempest-FlavorsAdminTestJSON-1100200661 tempest-FlavorsAdminTestJSON-1100200661-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 6221 microversion: 2.1 time: 0.034943 Aug 04 16:55:43.956810 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 189/372] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:55:43 2022] GET /compute/v2.1/flavors/detail => generated 6221 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:43.974977 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f2d35bde-90c5-4e49-ae5c-bc535391c747 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:43.999735 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f2d35bde-90c5-4e49-ae5c-bc535391c747 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/517499004" status: 202 len: 0 microversion: 2.1 time: 0.028415 Aug 04 16:55:44.001124 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 184/373] 10.222.0.93 () {58 vars in 1158 bytes} [Thu Aug 4 16:55:43 2022] DELETE /compute/v2.1/flavors/517499004 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:55:44.011946 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f0d40ad7-bccb-402c-b9e2-3321f4b51128 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:44.032855 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f0d40ad7-bccb-402c-b9e2-3321f4b51128 tempest-FlavorsAdminTestJSON-1000936402 tempest-FlavorsAdminTestJSON-1000936402-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.027534 Aug 04 16:55:44.033437 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 190/374] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:55:44 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:44.056605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d5035fba-1114-4b72-a5de-32035bb448df tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:44.057223 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d5035fba-1114-4b72-a5de-32035bb448df tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:44.064552 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5035fba-1114-4b72-a5de-32035bb448df tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:44.065044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5035fba-1114-4b72-a5de-32035bb448df tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:44.065510 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5035fba-1114-4b72-a5de-32035bb448df tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:44.066240 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5035fba-1114-4b72-a5de-32035bb448df tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:44.066709 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5035fba-1114-4b72-a5de-32035bb448df tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:44.067137 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5035fba-1114-4b72-a5de-32035bb448df tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:44.086023 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-34694527-3e60-44e8-bb92-d66530b83604 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:44.086889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-34694527-3e60-44e8-bb92-d66530b83604 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] [instance: eb10c53c-59c3-4239-97c5-c898c9f9ca89] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:44.102027 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-34694527-3e60-44e8-bb92-d66530b83604 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:44.102761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-34694527-3e60-44e8-bb92-d66530b83604 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:44.103204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-34694527-3e60-44e8-bb92-d66530b83604 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:44.103926 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-34694527-3e60-44e8-bb92-d66530b83604 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:44.104462 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-34694527-3e60-44e8-bb92-d66530b83604 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:44.104905 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-34694527-3e60-44e8-bb92-d66530b83604 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:44.411207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-34694527-3e60-44e8-bb92-d66530b83604 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eddfe7e2c347fcbc122b4f6fb89076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3e5530401f4a87a038b3d30679a74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:44.412791 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d5035fba-1114-4b72-a5de-32035bb448df tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:44.431512 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d5035fba-1114-4b72-a5de-32035bb448df tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1476 microversion: 2.1 time: 0.378930 Aug 04 16:55:44.432088 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 185/375] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:44 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1476 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:44.434839 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-34694527-3e60-44e8-bb92-d66530b83604 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] 10.222.0.93 "GET /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89" status: 200 len: 1332 microversion: 2.1 time: 0.353539 Aug 04 16:55:44.436102 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 191/376] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:44 2022] GET /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89 => generated 1332 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:44.773908 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e530c8b7-c135-4e18-93e1-a5f0e1130f0e tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:44.774632 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e530c8b7-c135-4e18-93e1-a5f0e1130f0e tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: e07a80a8-dec0-4a8b-bd5e-e2a50370d35b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:44.788204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e530c8b7-c135-4e18-93e1-a5f0e1130f0e tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:44.788878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e530c8b7-c135-4e18-93e1-a5f0e1130f0e tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:44.790928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e530c8b7-c135-4e18-93e1-a5f0e1130f0e tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:44.791957 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e530c8b7-c135-4e18-93e1-a5f0e1130f0e tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:44.794278 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e530c8b7-c135-4e18-93e1-a5f0e1130f0e tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:44.794798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e530c8b7-c135-4e18-93e1-a5f0e1130f0e tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:44.829403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1e73d6ac-57dc-48fb-bc88-d1ffa83d5bc3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:44.831526 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1e73d6ac-57dc-48fb-bc88-d1ffa83d5bc3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 37140c09-31fd-4233-9ab9-6351044c5864] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:44.850928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e73d6ac-57dc-48fb-bc88-d1ffa83d5bc3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:44.851602 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e73d6ac-57dc-48fb-bc88-d1ffa83d5bc3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:44.852118 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e73d6ac-57dc-48fb-bc88-d1ffa83d5bc3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:44.852904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e73d6ac-57dc-48fb-bc88-d1ffa83d5bc3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:44.853456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e73d6ac-57dc-48fb-bc88-d1ffa83d5bc3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:44.854498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e73d6ac-57dc-48fb-bc88-d1ffa83d5bc3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:45.127619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e530c8b7-c135-4e18-93e1-a5f0e1130f0e tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12efa078aa84861925925314ef00aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ed72eca39e4bab83ccbba779ac37c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:45.137333 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e530c8b7-c135-4e18-93e1-a5f0e1130f0e tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "GET /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b" status: 200 len: 1320 microversion: 2.1 time: 0.369697 Aug 04 16:55:45.138091 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 186/377] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:44 2022] GET /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b => generated 1320 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:45.172888 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1e73d6ac-57dc-48fb-bc88-d1ffa83d5bc3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:45.187250 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1e73d6ac-57dc-48fb-bc88-d1ffa83d5bc3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864" status: 200 len: 1311 microversion: 2.1 time: 0.365530 Aug 04 16:55:45.189669 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 192/378] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:44 2022] GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864 => generated 1311 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:45.484515 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-48e03146-cb37-4cc8-a96b-845e42bd32fb tempest-KeyPairsV210TestJSON-1499132328 tempest-KeyPairsV210TestJSON-1499132328-project-admin] Action: 'create', calling method: .version_select at 0x7f1e5bfa81f0>, body: {"keypair": {"name": "tempest-keypair-58982800", "type": "ssh", "user_id": "1dc1817645944f359735bcecd7f670f8", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9wS/Mv804/aVjkTq4U7pcBBTwpxjkYmLSAtajfAbvOjngTXY8IhjldQn6FisHwtpUjIOAg0ieLix8Oz32httm377mcAioRI8uHN0sf43R/fIM6o8ugGi74UBsWOxpwow=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:45.505507 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d18bf7a5-f09e-4393-bea1-99dca97f17b7 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-2054208087", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": "none"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:45.506478 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-48e03146-cb37-4cc8-a96b-845e42bd32fb tempest-KeyPairsV210TestJSON-1499132328 tempest-KeyPairsV210TestJSON-1499132328-project-admin] Getting quotas for project ef739471e3be42059ebc8a1214643520. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:55:45.511645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-48e03146-cb37-4cc8-a96b-845e42bd32fb tempest-KeyPairsV210TestJSON-1499132328 tempest-KeyPairsV210TestJSON-1499132328-project-admin] Getting quotas for user fdb594730d48433d8b06de0ad020fdeb and project ef739471e3be42059ebc8a1214643520. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:55:45.545009 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-48e03146-cb37-4cc8-a96b-845e42bd32fb tempest-KeyPairsV210TestJSON-1499132328 tempest-KeyPairsV210TestJSON-1499132328-project-admin] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.10 time: 0.405049 Aug 04 16:55:45.545882 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 187/379] 10.222.0.93 () {62 vars in 1200 bytes} [Thu Aug 4 16:55:45 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 407 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 16:55:45.561263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-06df0ddd-a752-418e-826b-2fa13efd3ba4 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:45.562095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-06df0ddd-a752-418e-826b-2fa13efd3ba4 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] [instance: eb10c53c-59c3-4239-97c5-c898c9f9ca89] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:45.570356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06df0ddd-a752-418e-826b-2fa13efd3ba4 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:45.570356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06df0ddd-a752-418e-826b-2fa13efd3ba4 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:45.570649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06df0ddd-a752-418e-826b-2fa13efd3ba4 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:45.572243 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06df0ddd-a752-418e-826b-2fa13efd3ba4 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:45.572944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06df0ddd-a752-418e-826b-2fa13efd3ba4 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:45.574500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06df0ddd-a752-418e-826b-2fa13efd3ba4 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:45.620744 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-d18bf7a5-f09e-4393-bea1-99dca97f17b7 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:55:45.621462 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-d18bf7a5-f09e-4393-bea1-99dca97f17b7 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:55:45.622140 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-d18bf7a5-f09e-4393-bea1-99dca97f17b7 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:55:45.622901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-d18bf7a5-f09e-4393-bea1-99dca97f17b7 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:55:45.623322 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-d18bf7a5-f09e-4393-bea1-99dca97f17b7 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:55:45.632748 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d18bf7a5-f09e-4393-bea1-99dca97f17b7 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:45.633946 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d18bf7a5-f09e-4393-bea1-99dca97f17b7 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:45.633946 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d18bf7a5-f09e-4393-bea1-99dca97f17b7 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:45.634479 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d18bf7a5-f09e-4393-bea1-99dca97f17b7 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:45.635129 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d18bf7a5-f09e-4393-bea1-99dca97f17b7 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:45.635560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d18bf7a5-f09e-4393-bea1-99dca97f17b7 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:45.651664 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=14 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:45.664183 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-d18bf7a5-f09e-4393-bea1-99dca97f17b7 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Getting quotas for project 3fff2f05e8d446a9bbf1a5e0b4fb51af. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:55:45.670772 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-d18bf7a5-f09e-4393-bea1-99dca97f17b7 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Getting quotas for user 24127ef4082b441999fe5b808ccac1a4 and project 3fff2f05e8d446a9bbf1a5e0b4fb51af. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:55:45.687794 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d18bf7a5-f09e-4393-bea1-99dca97f17b7 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:55:45.691009 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d18bf7a5-f09e-4393-bea1-99dca97f17b7 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:55:45.763197 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d18bf7a5-f09e-4393-bea1-99dca97f17b7 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.572179 Aug 04 16:55:45.765535 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 193/380] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Aug 4 16:55:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 16:55:45.775353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-656826ef-1e24-4409-9362-d701c80ff2ee tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:45.779463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-656826ef-1e24-4409-9362-d701c80ff2ee tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:45.787874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-656826ef-1e24-4409-9362-d701c80ff2ee tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:45.788376 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-656826ef-1e24-4409-9362-d701c80ff2ee tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:45.789015 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-656826ef-1e24-4409-9362-d701c80ff2ee tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:45.790115 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-656826ef-1e24-4409-9362-d701c80ff2ee tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:45.791274 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-656826ef-1e24-4409-9362-d701c80ff2ee tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:45.792041 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-656826ef-1e24-4409-9362-d701c80ff2ee tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:46.016893 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-06df0ddd-a752-418e-826b-2fa13efd3ba4 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eddfe7e2c347fcbc122b4f6fb89076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3e5530401f4a87a038b3d30679a74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:46.031102 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-06df0ddd-a752-418e-826b-2fa13efd3ba4 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] 10.222.0.93 "GET /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89" status: 200 len: 1332 microversion: 2.1 time: 0.473851 Aug 04 16:55:46.032499 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 188/381] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:45 2022] GET /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89 => generated 1332 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:46.053766 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2a444855-16f9-4a12-9540-4fda3e9c67d9 tempest-KeyPairsV210TestJSON-1499132328 tempest-KeyPairsV210TestJSON-1499132328-project-admin] Action: 'create', calling method: .version_select at 0x7f1e6804b160>, body: {"keypair": {"name": "tempest-keypair-1450172837", "type": "ssh", "user_id": "1dc1817645944f359735bcecd7f670f8", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOdP4j9Y36+nNkE0W4COVP+SlEaRDLMNDzb4cVvYiYiWIo5tle+GES6WORzAKiwo/G/Pb8H0XgOs+r5bTK/0moow4X/h6oZ71Qls6D3CAxUMuy/Y2c5gXN5Yq5UKxrCuA=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:46.085035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-2a444855-16f9-4a12-9540-4fda3e9c67d9 tempest-KeyPairsV210TestJSON-1499132328 tempest-KeyPairsV210TestJSON-1499132328-project-admin] Getting quotas for project ef739471e3be42059ebc8a1214643520. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:55:46.092540 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-2a444855-16f9-4a12-9540-4fda3e9c67d9 tempest-KeyPairsV210TestJSON-1499132328 tempest-KeyPairsV210TestJSON-1499132328-project-admin] Getting quotas for user fdb594730d48433d8b06de0ad020fdeb and project ef739471e3be42059ebc8a1214643520. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:55:46.136691 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2a444855-16f9-4a12-9540-4fda3e9c67d9 tempest-KeyPairsV210TestJSON-1499132328 tempest-KeyPairsV210TestJSON-1499132328-project-admin] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.099121 Aug 04 16:55:46.138202 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 189/382] 10.222.0.93 () {62 vars in 1200 bytes} [Thu Aug 4 16:55:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 105 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 16:55:46.143418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ee0a8d49-b4be-4c47-a9f6-1fbef42dc16c tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:46.146133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ee0a8d49-b4be-4c47-a9f6-1fbef42dc16c tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:46.337817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ee0a8d49-b4be-4c47-a9f6-1fbef42dc16c tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:46.349039 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ee0a8d49-b4be-4c47-a9f6-1fbef42dc16c tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:46.351586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ee0a8d49-b4be-4c47-a9f6-1fbef42dc16c tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:46.368301 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ee0a8d49-b4be-4c47-a9f6-1fbef42dc16c tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "PUT /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1359 microversion: 2.75 time: 0.227141 Aug 04 16:55:46.375645 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-656826ef-1e24-4409-9362-d701c80ff2ee tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:46.379124 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 190/383] 10.222.0.93 () {62 vars in 1297 bytes} [Thu Aug 4 16:55:46 2022] PUT /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1359 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:46.384839 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-656826ef-1e24-4409-9362-d701c80ff2ee tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1476 microversion: 2.1 time: 0.613412 Aug 04 16:55:46.386596 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c7229f21-b526-41c3-acad-6e0283f7f61a tempest-KeyPairsV210TestJSON-1499132328 tempest-KeyPairsV210TestJSON-1499132328-project-admin] Calling method '.version_select at 0x7f1e5bf4c700>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:46.390713 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 194/384] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:45 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1476 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:46.396780 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d49c5fcf-692b-4c75-9572-ad096d1e9fed tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:46.397416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d49c5fcf-692b-4c75-9572-ad096d1e9fed tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: e07a80a8-dec0-4a8b-bd5e-e2a50370d35b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:46.415171 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c7229f21-b526-41c3-acad-6e0283f7f61a tempest-KeyPairsV210TestJSON-1499132328 tempest-KeyPairsV210TestJSON-1499132328-project-admin] 10.222.0.93 "GET /compute/v2.1/os-keypairs/tempest-keypair-58982800?user_id=1dc1817645944f359735bcecd7f670f8" status: 200 len: 510 microversion: 2.10 time: 0.033761 Aug 04 16:55:46.416547 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d49c5fcf-692b-4c75-9572-ad096d1e9fed tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:46.417226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d49c5fcf-692b-4c75-9572-ad096d1e9fed tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:46.417826 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d49c5fcf-692b-4c75-9572-ad096d1e9fed tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:46.418570 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d49c5fcf-692b-4c75-9572-ad096d1e9fed tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:46.419186 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d49c5fcf-692b-4c75-9572-ad096d1e9fed tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:46.419622 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d49c5fcf-692b-4c75-9572-ad096d1e9fed tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:46.429379 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 191/385] 10.222.0.93 () {60 vars in 1334 bytes} [Thu Aug 4 16:55:46 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-58982800?user_id=1dc1817645944f359735bcecd7f670f8 => generated 510 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:55:46.440193 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c3caf6ff-c313-4265-b03d-bae92cbe0779 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:46.441410 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c3caf6ff-c313-4265-b03d-bae92cbe0779 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 37140c09-31fd-4233-9ab9-6351044c5864] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:46.443391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=16 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:46.458095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3caf6ff-c313-4265-b03d-bae92cbe0779 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:46.458762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3caf6ff-c313-4265-b03d-bae92cbe0779 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:46.459345 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3caf6ff-c313-4265-b03d-bae92cbe0779 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:46.460245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3caf6ff-c313-4265-b03d-bae92cbe0779 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:46.460862 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3caf6ff-c313-4265-b03d-bae92cbe0779 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:46.461440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3caf6ff-c313-4265-b03d-bae92cbe0779 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:46.837751 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c3caf6ff-c313-4265-b03d-bae92cbe0779 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:46.845335 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c3caf6ff-c313-4265-b03d-bae92cbe0779 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864" status: 200 len: 1495 microversion: 2.1 time: 0.414071 Aug 04 16:55:46.846114 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 192/386] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:46 2022] GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864 => generated 1495 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:46.852049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-309d6b77-b824-481e-a236-de91dd8e32f8 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:46.852663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-309d6b77-b824-481e-a236-de91dd8e32f8 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:46.858695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d49c5fcf-692b-4c75-9572-ad096d1e9fed tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12efa078aa84861925925314ef00aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ed72eca39e4bab83ccbba779ac37c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:46.864267 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-309d6b77-b824-481e-a236-de91dd8e32f8 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:46.865791 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-309d6b77-b824-481e-a236-de91dd8e32f8 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:46.866611 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-309d6b77-b824-481e-a236-de91dd8e32f8 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:46.868141 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-309d6b77-b824-481e-a236-de91dd8e32f8 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:46.869278 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-309d6b77-b824-481e-a236-de91dd8e32f8 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:46.870249 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-309d6b77-b824-481e-a236-de91dd8e32f8 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:46.875273 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d49c5fcf-692b-4c75-9572-ad096d1e9fed tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "GET /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b" status: 200 len: 1320 microversion: 2.1 time: 0.481660 Aug 04 16:55:46.878184 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 195/387] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:46 2022] GET /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b => generated 1320 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:46.884537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c3d970da-9831-4eb5-92a6-39143bd46e87 tempest-KeyPairsV210TestJSON-1499132328 tempest-KeyPairsV210TestJSON-1499132328-project-admin] Action: 'create', calling method: .version_select at 0x7f1e5bffaaf0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-781206193", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAMxPMx+vUXRZQgeKbeTD90qqztWff+yWyRTmMumomE+VMir5GfscNdn8iLTG+0Hap45FKI+s3uro7V4tu8Feey4K4BZNM8GK3m7DlV19rl/mwAziOzBOGWEkPk7QwtjA=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:46.918261 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-c3d970da-9831-4eb5-92a6-39143bd46e87 tempest-KeyPairsV210TestJSON-1499132328 tempest-KeyPairsV210TestJSON-1499132328-project-admin] Getting quotas for project ef739471e3be42059ebc8a1214643520. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:55:46.921019 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-c3d970da-9831-4eb5-92a6-39143bd46e87 tempest-KeyPairsV210TestJSON-1499132328 tempest-KeyPairsV210TestJSON-1499132328-project-admin] Getting quotas for user fdb594730d48433d8b06de0ad020fdeb and project ef739471e3be42059ebc8a1214643520. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:55:46.955432 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c3d970da-9831-4eb5-92a6-39143bd46e87 tempest-KeyPairsV210TestJSON-1499132328 tempest-KeyPairsV210TestJSON-1499132328-project-admin] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.075859 Aug 04 16:55:46.956421 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 196/388] 10.222.0.93 () {62 vars in 1200 bytes} [Thu Aug 4 16:55:46 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 78 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 16:55:47.028749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-309d6b77-b824-481e-a236-de91dd8e32f8 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:47.038040 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-309d6b77-b824-481e-a236-de91dd8e32f8 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:47.039649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-309d6b77-b824-481e-a236-de91dd8e32f8 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:47.045221 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-309d6b77-b824-481e-a236-de91dd8e32f8 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1411 microversion: 2.75 time: 0.197371 Aug 04 16:55:47.046510 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 193/389] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:46 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1411 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:47.051199 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f026b638-dc41-4ae6-ae81-7c540fce01c8 tempest-KeyPairsV210TestJSON-1499132328 tempest-KeyPairsV210TestJSON-1499132328-project-admin] Calling method '.version_select at 0x7f1e5bf4c5e0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:47.056044 n-d-851359-3 devstack@n-api.service[131044]: WARNING oslo_db.sqlalchemy.utils [None req-f026b638-dc41-4ae6-ae81-7c540fce01c8 tempest-KeyPairsV210TestJSON-1499132328 tempest-KeyPairsV210TestJSON-1499132328-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 04 16:55:47.063905 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f026b638-dc41-4ae6-ae81-7c540fce01c8 tempest-KeyPairsV210TestJSON-1499132328 tempest-KeyPairsV210TestJSON-1499132328-project-admin] 10.222.0.93 "GET /compute/v2.1/os-keypairs?user_id=1dc1817645944f359735bcecd7f670f8" status: 200 len: 724 microversion: 2.10 time: 0.016148 Aug 04 16:55:47.064816 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 194/390] 10.222.0.93 () {60 vars in 1259 bytes} [Thu Aug 4 16:55:47 2022] GET /compute/v2.1/os-keypairs?user_id=1dc1817645944f359735bcecd7f670f8 => generated 724 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:55:47.077813 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a0666f30-1a33-4974-bdc0-b5b4fd6da957 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:47.079012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a0666f30-1a33-4974-bdc0-b5b4fd6da957 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] [instance: eb10c53c-59c3-4239-97c5-c898c9f9ca89] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:47.088552 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0666f30-1a33-4974-bdc0-b5b4fd6da957 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:47.091462 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0666f30-1a33-4974-bdc0-b5b4fd6da957 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:47.093418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0666f30-1a33-4974-bdc0-b5b4fd6da957 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:47.094447 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0666f30-1a33-4974-bdc0-b5b4fd6da957 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:47.096350 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0666f30-1a33-4974-bdc0-b5b4fd6da957 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:47.097281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0666f30-1a33-4974-bdc0-b5b4fd6da957 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:47.295918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a0666f30-1a33-4974-bdc0-b5b4fd6da957 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eddfe7e2c347fcbc122b4f6fb89076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3e5530401f4a87a038b3d30679a74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:47.310997 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a0666f30-1a33-4974-bdc0-b5b4fd6da957 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] 10.222.0.93 "GET /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89" status: 200 len: 1332 microversion: 2.1 time: 0.244812 Aug 04 16:55:47.314657 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 195/391] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:47 2022] GET /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89 => generated 1332 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:47.323154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-28d43d79-a8b4-437d-9506-8025fd40676f tempest-KeyPairsV210TestJSON-1499132328 tempest-KeyPairsV210TestJSON-1499132328-project-admin] Calling method '.version_select at 0x7f1e5bfeb160>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:47.356161 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-28d43d79-a8b4-437d-9506-8025fd40676f tempest-KeyPairsV210TestJSON-1499132328 tempest-KeyPairsV210TestJSON-1499132328-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-781206193" status: 204 len: 0 microversion: 2.10 time: 0.039126 Aug 04 16:55:47.357461 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 196/392] 10.222.0.93 () {60 vars in 1322 bytes} [Thu Aug 4 16:55:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-781206193 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 16:55:47.372878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2157cd14-c16a-41e8-a479-88f87e9f9715 tempest-KeyPairsV210TestJSON-1499132328 tempest-KeyPairsV210TestJSON-1499132328-project-admin] Calling method '.version_select at 0x7f1e5bfa8c10>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:47.402330 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2157cd14-c16a-41e8-a479-88f87e9f9715 tempest-KeyPairsV210TestJSON-1499132328 tempest-KeyPairsV210TestJSON-1499132328-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1450172837?user_id=1dc1817645944f359735bcecd7f670f8" status: 204 len: 0 microversion: 2.10 time: 0.039619 Aug 04 16:55:47.404501 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 197/393] 10.222.0.93 () {60 vars in 1343 bytes} [Thu Aug 4 16:55:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1450172837?user_id=1dc1817645944f359735bcecd7f670f8 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 04 16:55:47.417666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-77461792-13cc-40cb-ad9f-f4fc969be417 tempest-KeyPairsV210TestJSON-1499132328 tempest-KeyPairsV210TestJSON-1499132328-project-admin] Calling method '.version_select at 0x7f1e5bf1a430>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:47.447497 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-77461792-13cc-40cb-ad9f-f4fc969be417 tempest-KeyPairsV210TestJSON-1499132328 tempest-KeyPairsV210TestJSON-1499132328-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-58982800?user_id=1dc1817645944f359735bcecd7f670f8" status: 204 len: 0 microversion: 2.10 time: 0.038292 Aug 04 16:55:47.449228 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 198/394] 10.222.0.93 () {60 vars in 1337 bytes} [Thu Aug 4 16:55:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-58982800?user_id=1dc1817645944f359735bcecd7f670f8 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 16:55:47.456185 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7b95408e-8112-42e1-8c18-ee02e8d8c287 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:47.457310 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7b95408e-8112-42e1-8c18-ee02e8d8c287 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:47.469157 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b95408e-8112-42e1-8c18-ee02e8d8c287 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:47.470722 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b95408e-8112-42e1-8c18-ee02e8d8c287 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:47.472027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b95408e-8112-42e1-8c18-ee02e8d8c287 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:47.472905 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b95408e-8112-42e1-8c18-ee02e8d8c287 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:47.473568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b95408e-8112-42e1-8c18-ee02e8d8c287 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:47.474092 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b95408e-8112-42e1-8c18-ee02e8d8c287 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:47.494625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9c7ebd51-5827-42af-9a90-3b0897ccaf4d tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:47.495562 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9c7ebd51-5827-42af-9a90-3b0897ccaf4d tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] [instance: 37140c09-31fd-4233-9ab9-6351044c5864] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:47.510072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9c7ebd51-5827-42af-9a90-3b0897ccaf4d tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:47.510749 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9c7ebd51-5827-42af-9a90-3b0897ccaf4d tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:47.512251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9c7ebd51-5827-42af-9a90-3b0897ccaf4d tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:47.513182 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9c7ebd51-5827-42af-9a90-3b0897ccaf4d tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:47.513775 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9c7ebd51-5827-42af-9a90-3b0897ccaf4d tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:47.514484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9c7ebd51-5827-42af-9a90-3b0897ccaf4d tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:47.760088 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7b95408e-8112-42e1-8c18-ee02e8d8c287 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:47.775359 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7b95408e-8112-42e1-8c18-ee02e8d8c287 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1476 microversion: 2.1 time: 0.320818 Aug 04 16:55:47.804524 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9c7ebd51-5827-42af-9a90-3b0897ccaf4d tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864" status: 200 len: 1646 microversion: 2.1 time: 0.846837 Aug 04 16:55:47.805172 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 197/396] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:46 2022] GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864 => generated 1646 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:47.805307 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 199/396] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:47 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1476 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:47.828643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7e9dad80-ce13-49a5-a146-679b73333f19 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:47.829584 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7e9dad80-ce13-49a5-a146-679b73333f19 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] [instance: 37140c09-31fd-4233-9ab9-6351044c5864] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:47.839023 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7e9dad80-ce13-49a5-a146-679b73333f19 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:47.839907 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7e9dad80-ce13-49a5-a146-679b73333f19 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:47.840894 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7e9dad80-ce13-49a5-a146-679b73333f19 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:47.842004 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7e9dad80-ce13-49a5-a146-679b73333f19 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:47.843004 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7e9dad80-ce13-49a5-a146-679b73333f19 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:47.843787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7e9dad80-ce13-49a5-a146-679b73333f19 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:47.909437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b3597a9e-6007-47ca-94fb-6ec877212c5a tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:47.910913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b3597a9e-6007-47ca-94fb-6ec877212c5a tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: e07a80a8-dec0-4a8b-bd5e-e2a50370d35b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:47.919825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3597a9e-6007-47ca-94fb-6ec877212c5a tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:47.920354 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3597a9e-6007-47ca-94fb-6ec877212c5a tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:47.921010 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3597a9e-6007-47ca-94fb-6ec877212c5a tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:47.922429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3597a9e-6007-47ca-94fb-6ec877212c5a tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:47.923090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3597a9e-6007-47ca-94fb-6ec877212c5a tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:47.923963 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3597a9e-6007-47ca-94fb-6ec877212c5a tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:48.106091 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7e9dad80-ce13-49a5-a146-679b73333f19 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864" status: 200 len: 1646 microversion: 2.1 time: 0.281831 Aug 04 16:55:48.106686 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 198/397] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:47 2022] GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864 => generated 1646 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:48.124015 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-1734e0ae-cc09-4cc3-9411-df8390a85915 req-f551251a-40ad-4866-9403-34e21d0b1be7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb10c53c-59c3-4239-97c5-c898c9f9ca89", "name": "network-vif-plugged", "status": "completed", "tag": "7c10a7ae-46ce-40dd-b73d-1e6d2b434cee"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:48.135945 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1734e0ae-cc09-4cc3-9411-df8390a85915 req-f551251a-40ad-4866-9403-34e21d0b1be7 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:48.136478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1734e0ae-cc09-4cc3-9411-df8390a85915 req-f551251a-40ad-4866-9403-34e21d0b1be7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:48.137274 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1734e0ae-cc09-4cc3-9411-df8390a85915 req-f551251a-40ad-4866-9403-34e21d0b1be7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:48.149028 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-1734e0ae-cc09-4cc3-9411-df8390a85915 req-f551251a-40ad-4866-9403-34e21d0b1be7 service nova] Creating event network-vif-plugged:7c10a7ae-46ce-40dd-b73d-1e6d2b434cee for instance eb10c53c-59c3-4239-97c5-c898c9f9ca89 on n-h1-851359-3 Aug 04 16:55:48.154246 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-1734e0ae-cc09-4cc3-9411-df8390a85915 req-f551251a-40ad-4866-9403-34e21d0b1be7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045471 Aug 04 16:55:48.155081 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 199/398] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:48.162011 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a4a86896-b0a6-41d0-8788-e45e36dd884d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:48.162718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a4a86896-b0a6-41d0-8788-e45e36dd884d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:48.169331 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a4a86896-b0a6-41d0-8788-e45e36dd884d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:48.169825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a4a86896-b0a6-41d0-8788-e45e36dd884d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:48.170469 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a4a86896-b0a6-41d0-8788-e45e36dd884d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:48.171202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a4a86896-b0a6-41d0-8788-e45e36dd884d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:48.171662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a4a86896-b0a6-41d0-8788-e45e36dd884d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:48.172094 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a4a86896-b0a6-41d0-8788-e45e36dd884d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:48.218872 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b3597a9e-6007-47ca-94fb-6ec877212c5a tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12efa078aa84861925925314ef00aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ed72eca39e4bab83ccbba779ac37c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:48.239660 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b3597a9e-6007-47ca-94fb-6ec877212c5a tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "GET /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b" status: 200 len: 1320 microversion: 2.1 time: 0.334557 Aug 04 16:55:48.256531 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 200/399] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:47 2022] GET /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b => generated 1320 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:55:48.261615 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0c7f4b01-c01e-437a-ab01-b8e269eea2fc tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:48.264762 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:55:48.264762 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:55:48.266453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c7f4b01-c01e-437a-ab01-b8e269eea2fc tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:48.267125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c7f4b01-c01e-437a-ab01-b8e269eea2fc tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:48.267735 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c7f4b01-c01e-437a-ab01-b8e269eea2fc tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:48.268814 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c7f4b01-c01e-437a-ab01-b8e269eea2fc tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:48.269424 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c7f4b01-c01e-437a-ab01-b8e269eea2fc tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:48.270019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c7f4b01-c01e-437a-ab01-b8e269eea2fc tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:48.297889 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0c7f4b01-c01e-437a-ab01-b8e269eea2fc tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.039929 Aug 04 16:55:48.299206 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 201/400] 10.222.0.93 () {58 vars in 1176 bytes} [Thu Aug 4 16:55:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:48.314291 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5c3d03d7-d575-40a7-9629-543136c5838b tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851359-3", "block_migration": true, "disk_over_commit": false}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:48.317325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5c3d03d7-d575-40a7-9629-543136c5838b tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] [instance: 37140c09-31fd-4233-9ab9-6351044c5864] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:48.325518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c3d03d7-d575-40a7-9629-543136c5838b tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:48.326040 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c3d03d7-d575-40a7-9629-543136c5838b tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:48.326491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c3d03d7-d575-40a7-9629-543136c5838b tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:48.327207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c3d03d7-d575-40a7-9629-543136c5838b tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:48.327671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c3d03d7-d575-40a7-9629-543136c5838b tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:48.328101 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c3d03d7-d575-40a7-9629-543136c5838b tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:48.391584 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a4a86896-b0a6-41d0-8788-e45e36dd884d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:48.414607 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a4a86896-b0a6-41d0-8788-e45e36dd884d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:48.421895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a4a86896-b0a6-41d0-8788-e45e36dd884d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:48.437238 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a4a86896-b0a6-41d0-8788-e45e36dd884d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1417 microversion: 2.75 time: 0.280704 Aug 04 16:55:48.437833 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 200/401] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:48 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1417 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:48.443880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-abe4679e-44b1-4a30-970b-25fcf9e92f79 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:48.444496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-abe4679e-44b1-4a30-970b-25fcf9e92f79 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] [instance: eb10c53c-59c3-4239-97c5-c898c9f9ca89] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:48.446692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-5c3d03d7-d575-40a7-9629-543136c5838b tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lazy-loading 'flavor' on Instance uuid 37140c09-31fd-4233-9ab9-6351044c5864 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:55:48.452655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-abe4679e-44b1-4a30-970b-25fcf9e92f79 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:48.453417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-abe4679e-44b1-4a30-970b-25fcf9e92f79 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:48.454399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-abe4679e-44b1-4a30-970b-25fcf9e92f79 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:48.455749 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-abe4679e-44b1-4a30-970b-25fcf9e92f79 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:48.456839 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-abe4679e-44b1-4a30-970b-25fcf9e92f79 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:48.457668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-abe4679e-44b1-4a30-970b-25fcf9e92f79 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:48.510200 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5c3d03d7-d575-40a7-9629-543136c5838b tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] [instance: 37140c09-31fd-4233-9ab9-6351044c5864] Going to try to live migrate instance to n-h2-851359-3 {{(pid=131044) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 16:55:48.678209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-abe4679e-44b1-4a30-970b-25fcf9e92f79 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eddfe7e2c347fcbc122b4f6fb89076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3e5530401f4a87a038b3d30679a74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:48.694080 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-abe4679e-44b1-4a30-970b-25fcf9e92f79 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] 10.222.0.93 "GET /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89" status: 200 len: 1332 microversion: 2.1 time: 0.253033 Aug 04 16:55:48.695200 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 201/402] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:48 2022] GET /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89 => generated 1332 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:48.808150 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4bebae23-429c-4766-afc8-4d41602f8eab tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:48.810242 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4bebae23-429c-4766-afc8-4d41602f8eab tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:48.822159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4bebae23-429c-4766-afc8-4d41602f8eab tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:48.823154 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4bebae23-429c-4766-afc8-4d41602f8eab tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:48.823912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4bebae23-429c-4766-afc8-4d41602f8eab tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:48.826074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4bebae23-429c-4766-afc8-4d41602f8eab tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:48.827314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4bebae23-429c-4766-afc8-4d41602f8eab tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:48.828359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4bebae23-429c-4766-afc8-4d41602f8eab tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:49.226530 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4bebae23-429c-4766-afc8-4d41602f8eab tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:49.238787 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4bebae23-429c-4766-afc8-4d41602f8eab tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1476 microversion: 2.1 time: 0.440929 Aug 04 16:55:49.253686 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 202/403] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:48 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1476 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:49.265638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1f6b7e44-3a28-4d91-b56a-b9e8bdb775f0 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:49.266861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1f6b7e44-3a28-4d91-b56a-b9e8bdb775f0 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: e07a80a8-dec0-4a8b-bd5e-e2a50370d35b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:49.279192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f6b7e44-3a28-4d91-b56a-b9e8bdb775f0 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:49.283131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f6b7e44-3a28-4d91-b56a-b9e8bdb775f0 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:49.284986 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f6b7e44-3a28-4d91-b56a-b9e8bdb775f0 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:49.285919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f6b7e44-3a28-4d91-b56a-b9e8bdb775f0 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:49.287148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f6b7e44-3a28-4d91-b56a-b9e8bdb775f0 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:49.293820 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f6b7e44-3a28-4d91-b56a-b9e8bdb775f0 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:49.617528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1f6b7e44-3a28-4d91-b56a-b9e8bdb775f0 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12efa078aa84861925925314ef00aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ed72eca39e4bab83ccbba779ac37c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:49.630757 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1f6b7e44-3a28-4d91-b56a-b9e8bdb775f0 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "GET /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b" status: 200 len: 1320 microversion: 2.1 time: 0.371617 Aug 04 16:55:49.631952 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 203/404] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:49 2022] GET /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b => generated 1320 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:55:49.636911 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f11f0e9f-7d46-4414-badc-87cb0d05343d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:49.638227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f11f0e9f-7d46-4414-badc-87cb0d05343d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:49.646431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f11f0e9f-7d46-4414-badc-87cb0d05343d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:49.647224 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f11f0e9f-7d46-4414-badc-87cb0d05343d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:49.647769 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f11f0e9f-7d46-4414-badc-87cb0d05343d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:49.650562 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f11f0e9f-7d46-4414-badc-87cb0d05343d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:49.651671 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f11f0e9f-7d46-4414-badc-87cb0d05343d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:49.651752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f11f0e9f-7d46-4414-badc-87cb0d05343d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:49.811308 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f11f0e9f-7d46-4414-badc-87cb0d05343d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:49.833466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f11f0e9f-7d46-4414-badc-87cb0d05343d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:49.843736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f11f0e9f-7d46-4414-badc-87cb0d05343d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:49.852017 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f11f0e9f-7d46-4414-badc-87cb0d05343d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1417 microversion: 2.75 time: 0.218099 Aug 04 16:55:49.854459 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 204/405] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:49 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1417 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:49.859955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b3d974b4-8a96-4785-bc6b-b16ee95196a1 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:49.860947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b3d974b4-8a96-4785-bc6b-b16ee95196a1 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] [instance: eb10c53c-59c3-4239-97c5-c898c9f9ca89] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:49.875794 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3d974b4-8a96-4785-bc6b-b16ee95196a1 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:49.876727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3d974b4-8a96-4785-bc6b-b16ee95196a1 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:49.877386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3d974b4-8a96-4785-bc6b-b16ee95196a1 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:49.879153 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3d974b4-8a96-4785-bc6b-b16ee95196a1 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:49.879857 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3d974b4-8a96-4785-bc6b-b16ee95196a1 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:49.880711 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3d974b4-8a96-4785-bc6b-b16ee95196a1 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:50.369899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b3d974b4-8a96-4785-bc6b-b16ee95196a1 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eddfe7e2c347fcbc122b4f6fb89076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3e5530401f4a87a038b3d30679a74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:50.380991 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b3d974b4-8a96-4785-bc6b-b16ee95196a1 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] 10.222.0.93 "GET /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89" status: 200 len: 1332 microversion: 2.1 time: 0.524426 Aug 04 16:55:50.396092 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 205/406] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:49 2022] GET /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89 => generated 1332 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:50.404825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-03c4c03b-579c-4e2a-b5be-76e545ae391a req-361f2e34-60a1-485b-a15a-e98d9a0d78d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e07a80a8-dec0-4a8b-bd5e-e2a50370d35b", "name": "network-vif-plugged", "status": "completed", "tag": "8594332c-5c09-4548-bbe4-843f0ea972a9"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:50.418832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-03c4c03b-579c-4e2a-b5be-76e545ae391a req-361f2e34-60a1-485b-a15a-e98d9a0d78d4 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:50.419422 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-03c4c03b-579c-4e2a-b5be-76e545ae391a req-361f2e34-60a1-485b-a15a-e98d9a0d78d4 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:50.419924 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-03c4c03b-579c-4e2a-b5be-76e545ae391a req-361f2e34-60a1-485b-a15a-e98d9a0d78d4 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:50.436198 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-03c4c03b-579c-4e2a-b5be-76e545ae391a req-361f2e34-60a1-485b-a15a-e98d9a0d78d4 service nova] Creating event network-vif-plugged:8594332c-5c09-4548-bbe4-843f0ea972a9 for instance e07a80a8-dec0-4a8b-bd5e-e2a50370d35b on n-h2-851359-3 Aug 04 16:55:50.445328 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-03c4c03b-579c-4e2a-b5be-76e545ae391a req-361f2e34-60a1-485b-a15a-e98d9a0d78d4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047637 Aug 04 16:55:50.451165 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 206/407] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:50.458860 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8a6d1bad-00e2-4202-9ca6-d81264b63767 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:50.459867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8a6d1bad-00e2-4202-9ca6-d81264b63767 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:50.467031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a6d1bad-00e2-4202-9ca6-d81264b63767 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:50.467654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a6d1bad-00e2-4202-9ca6-d81264b63767 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:50.468164 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a6d1bad-00e2-4202-9ca6-d81264b63767 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:50.468964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a6d1bad-00e2-4202-9ca6-d81264b63767 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:50.470039 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a6d1bad-00e2-4202-9ca6-d81264b63767 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:50.470674 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a6d1bad-00e2-4202-9ca6-d81264b63767 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:50.784321 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8a6d1bad-00e2-4202-9ca6-d81264b63767 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:50.803308 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8a6d1bad-00e2-4202-9ca6-d81264b63767 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1476 microversion: 2.1 time: 0.350013 Aug 04 16:55:50.810620 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 207/408] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:50 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1476 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:50.817514 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ac0e38e2-e3a0-4e3c-bb9b-1969bee364fd tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:50.818602 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ac0e38e2-e3a0-4e3c-bb9b-1969bee364fd tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: e07a80a8-dec0-4a8b-bd5e-e2a50370d35b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:50.840446 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac0e38e2-e3a0-4e3c-bb9b-1969bee364fd tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:50.841561 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac0e38e2-e3a0-4e3c-bb9b-1969bee364fd tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:50.842659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac0e38e2-e3a0-4e3c-bb9b-1969bee364fd tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:50.844561 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac0e38e2-e3a0-4e3c-bb9b-1969bee364fd tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:50.846004 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac0e38e2-e3a0-4e3c-bb9b-1969bee364fd tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:50.846891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac0e38e2-e3a0-4e3c-bb9b-1969bee364fd tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:51.091982 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ac0e38e2-e3a0-4e3c-bb9b-1969bee364fd tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12efa078aa84861925925314ef00aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ed72eca39e4bab83ccbba779ac37c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:51.101710 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ac0e38e2-e3a0-4e3c-bb9b-1969bee364fd tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "GET /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b" status: 200 len: 1320 microversion: 2.1 time: 0.289646 Aug 04 16:55:51.102761 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 208/409] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:50 2022] GET /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b => generated 1320 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:51.108130 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d0baf955-9673-4a89-a0ae-929aba664235 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:51.108960 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d0baf955-9673-4a89-a0ae-929aba664235 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:51.121991 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d0baf955-9673-4a89-a0ae-929aba664235 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:51.123830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d0baf955-9673-4a89-a0ae-929aba664235 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:51.124437 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d0baf955-9673-4a89-a0ae-929aba664235 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:51.126437 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d0baf955-9673-4a89-a0ae-929aba664235 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:51.127440 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d0baf955-9673-4a89-a0ae-929aba664235 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:51.128672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d0baf955-9673-4a89-a0ae-929aba664235 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:51.135693 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:51.226999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d0baf955-9673-4a89-a0ae-929aba664235 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:51.235526 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d0baf955-9673-4a89-a0ae-929aba664235 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:51.237229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d0baf955-9673-4a89-a0ae-929aba664235 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:51.244305 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d0baf955-9673-4a89-a0ae-929aba664235 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1417 microversion: 2.75 time: 0.140262 Aug 04 16:55:51.244880 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 209/410] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:51 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1417 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:51.411732 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-854c9e46-a959-4ee6-9175-326327b4b36b tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:51.412801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-854c9e46-a959-4ee6-9175-326327b4b36b tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] [instance: eb10c53c-59c3-4239-97c5-c898c9f9ca89] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:51.421553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-854c9e46-a959-4ee6-9175-326327b4b36b tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:51.429184 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-854c9e46-a959-4ee6-9175-326327b4b36b tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:51.433488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-854c9e46-a959-4ee6-9175-326327b4b36b tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:51.434303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-854c9e46-a959-4ee6-9175-326327b4b36b tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:51.434932 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-854c9e46-a959-4ee6-9175-326327b4b36b tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:51.435909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-854c9e46-a959-4ee6-9175-326327b4b36b tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:51.711533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-854c9e46-a959-4ee6-9175-326327b4b36b tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eddfe7e2c347fcbc122b4f6fb89076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3e5530401f4a87a038b3d30679a74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:51.720792 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-854c9e46-a959-4ee6-9175-326327b4b36b tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] 10.222.0.93 "GET /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89" status: 200 len: 1537 microversion: 2.1 time: 0.316409 Aug 04 16:55:51.721672 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 210/411] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:51 2022] GET /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89 => generated 1537 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:51.749168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b68a5f05-2252-4ec0-b41d-d7c1cb19736e tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Action: 'create', calling method: .version_select at 0x7f1e5be6a9d0>, body: {"pool": "aa834c21-a026-461a-926c-9c43b1a51a9c"} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:52.780875 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5c3d03d7-d575-40a7-9629-543136c5838b tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864/action" status: 202 len: 0 microversion: 2.1 time: 4.470883 Aug 04 16:55:52.781543 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 202/412] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:55:48 2022] POST /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864/action => generated 0 bytes in 4473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 16:55:52.787966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-80533fa2-39d9-4fd1-9333-284aa7ede740 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:52.788837 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-80533fa2-39d9-4fd1-9333-284aa7ede740 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:52.821628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80533fa2-39d9-4fd1-9333-284aa7ede740 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:52.825784 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80533fa2-39d9-4fd1-9333-284aa7ede740 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:52.828896 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80533fa2-39d9-4fd1-9333-284aa7ede740 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:52.829898 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80533fa2-39d9-4fd1-9333-284aa7ede740 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:52.830568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80533fa2-39d9-4fd1-9333-284aa7ede740 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:52.831174 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80533fa2-39d9-4fd1-9333-284aa7ede740 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:53.213342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-80533fa2-39d9-4fd1-9333-284aa7ede740 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:53.232138 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-80533fa2-39d9-4fd1-9333-284aa7ede740 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1476 microversion: 2.1 time: 0.449196 Aug 04 16:55:53.234537 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 203/413] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:52 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1476 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:53.367443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e32454e2-793b-43bd-b191-2181388de0f8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1631358114", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:53.400736 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=9,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:53.486530 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-e32454e2-793b-43bd-b191-2181388de0f8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:55:54.210738 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e32454e2-793b-43bd-b191-2181388de0f8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:55:54.213934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e32454e2-793b-43bd-b191-2181388de0f8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:55:54.214731 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e32454e2-793b-43bd-b191-2181388de0f8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:55:54.217344 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e32454e2-793b-43bd-b191-2181388de0f8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:55:54.218157 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e32454e2-793b-43bd-b191-2181388de0f8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:55:54.239232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=49 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:54.243704 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e32454e2-793b-43bd-b191-2181388de0f8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:54.244351 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e32454e2-793b-43bd-b191-2181388de0f8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:54.245130 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e32454e2-793b-43bd-b191-2181388de0f8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:54.245922 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e32454e2-793b-43bd-b191-2181388de0f8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:54.246451 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e32454e2-793b-43bd-b191-2181388de0f8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:54.247001 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e32454e2-793b-43bd-b191-2181388de0f8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:54.272544 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e32454e2-793b-43bd-b191-2181388de0f8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Getting quotas for project 3f8c7c49e56743dd9f64102e53c2bec7. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:55:54.278313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e32454e2-793b-43bd-b191-2181388de0f8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Getting quotas for user 712723e5418441c096f008d1520f6dce and project 3f8c7c49e56743dd9f64102e53c2bec7. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:55:54.293960 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e32454e2-793b-43bd-b191-2181388de0f8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:55:54.296505 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e32454e2-793b-43bd-b191-2181388de0f8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: 2b1b8878-8ab2-4792-904f-dae80363ee37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:55:54.332423 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b68a5f05-2252-4ec0-b41d-d7c1cb19736e tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] 10.222.0.93 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.592401 Aug 04 16:55:54.340263 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 211/414] 10.222.0.93 () {60 vars in 1170 bytes} [Thu Aug 4 16:55:51 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:54.344210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6a7a2a8f-55b0-483a-a5e2-194b4b4dbb96 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:54.345002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6a7a2a8f-55b0-483a-a5e2-194b4b4dbb96 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: e07a80a8-dec0-4a8b-bd5e-e2a50370d35b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:54.355407 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a7a2a8f-55b0-483a-a5e2-194b4b4dbb96 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:54.357552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a7a2a8f-55b0-483a-a5e2-194b4b4dbb96 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:54.358197 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a7a2a8f-55b0-483a-a5e2-194b4b4dbb96 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:54.358907 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a7a2a8f-55b0-483a-a5e2-194b4b4dbb96 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:54.359441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a7a2a8f-55b0-483a-a5e2-194b4b4dbb96 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:54.359793 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a7a2a8f-55b0-483a-a5e2-194b4b4dbb96 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:54.386960 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e32454e2-793b-43bd-b191-2181388de0f8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.147986 Aug 04 16:55:54.390928 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 204/415] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:55:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1152 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:55:54.403780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-416e0cbf-48d9-425b-8ffe-23120b4a6627 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:54.404992 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-416e0cbf-48d9-425b-8ffe-23120b4a6627 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:54.422196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-416e0cbf-48d9-425b-8ffe-23120b4a6627 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:54.423223 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-416e0cbf-48d9-425b-8ffe-23120b4a6627 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:54.423814 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-416e0cbf-48d9-425b-8ffe-23120b4a6627 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:54.425391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-416e0cbf-48d9-425b-8ffe-23120b4a6627 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:54.426363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-416e0cbf-48d9-425b-8ffe-23120b4a6627 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:54.426961 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-416e0cbf-48d9-425b-8ffe-23120b4a6627 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:54.565161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-416e0cbf-48d9-425b-8ffe-23120b4a6627 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:54.579594 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-416e0cbf-48d9-425b-8ffe-23120b4a6627 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:54.581778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-416e0cbf-48d9-425b-8ffe-23120b4a6627 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:54.590419 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-416e0cbf-48d9-425b-8ffe-23120b4a6627 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1438 microversion: 2.75 time: 0.198030 Aug 04 16:55:54.591526 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 205/416] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:54 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1438 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:54.602244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3a91d6f7-c176-48c5-b984-ef88dbd19233 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:54.604031 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3a91d6f7-c176-48c5-b984-ef88dbd19233 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 37140c09-31fd-4233-9ab9-6351044c5864] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:54.614966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a91d6f7-c176-48c5-b984-ef88dbd19233 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:54.615616 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a91d6f7-c176-48c5-b984-ef88dbd19233 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:54.617183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a91d6f7-c176-48c5-b984-ef88dbd19233 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:54.618343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a91d6f7-c176-48c5-b984-ef88dbd19233 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:54.620512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a91d6f7-c176-48c5-b984-ef88dbd19233 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:54.622675 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a91d6f7-c176-48c5-b984-ef88dbd19233 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:54.648850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6a7a2a8f-55b0-483a-a5e2-194b4b4dbb96 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12efa078aa84861925925314ef00aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ed72eca39e4bab83ccbba779ac37c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:54.658225 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6a7a2a8f-55b0-483a-a5e2-194b4b4dbb96 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "GET /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b" status: 200 len: 1470 microversion: 2.1 time: 0.323435 Aug 04 16:55:54.658864 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 212/417] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:54 2022] GET /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b => generated 1470 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:54.673937 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-858a6a25-bcc3-45b0-8343-a961ce5231da tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:54.684852 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-858a6a25-bcc3-45b0-8343-a961ce5231da tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:54.697713 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-858a6a25-bcc3-45b0-8343-a961ce5231da tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:54.702522 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-858a6a25-bcc3-45b0-8343-a961ce5231da tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:54.703092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-858a6a25-bcc3-45b0-8343-a961ce5231da tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:54.705244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-858a6a25-bcc3-45b0-8343-a961ce5231da tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:54.705782 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-858a6a25-bcc3-45b0-8343-a961ce5231da tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:54.706294 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-858a6a25-bcc3-45b0-8343-a961ce5231da tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:54.949167 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3a91d6f7-c176-48c5-b984-ef88dbd19233 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:54.962528 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3a91d6f7-c176-48c5-b984-ef88dbd19233 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864" status: 200 len: 1505 microversion: 2.1 time: 0.369707 Aug 04 16:55:54.980271 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 206/418] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:54 2022] GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864 => generated 1505 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:54.994146 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f3709873-709f-4476-9616-41cd7c8f6290 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Action: 'action', calling method: .version_select at 0x7f1e6a4d0af0>, body: {"addFloatingIp": {"address": "172.25.9.127"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:54.997119 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f3709873-709f-4476-9616-41cd7c8f6290 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] [instance: eb10c53c-59c3-4239-97c5-c898c9f9ca89] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:55.028502 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3709873-709f-4476-9616-41cd7c8f6290 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:55.028958 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3709873-709f-4476-9616-41cd7c8f6290 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:55.029575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3709873-709f-4476-9616-41cd7c8f6290 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:55.030658 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3709873-709f-4476-9616-41cd7c8f6290 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:55.031383 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3709873-709f-4476-9616-41cd7c8f6290 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:55.032165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3709873-709f-4476-9616-41cd7c8f6290 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:55.094079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-858a6a25-bcc3-45b0-8343-a961ce5231da tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:55.107190 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-858a6a25-bcc3-45b0-8343-a961ce5231da tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1476 microversion: 2.1 time: 0.434634 Aug 04 16:55:55.108237 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 213/419] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:54 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1476 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:55.125461 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:55.128491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5150ff3d-3509-44e3-aa16-7961e6199f87 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:55.129395 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5150ff3d-3509-44e3-aa16-7961e6199f87 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: 2b1b8878-8ab2-4792-904f-dae80363ee37] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:55.134979 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3709873-709f-4476-9616-41cd7c8f6290 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "refresh_cache-eb10c53c-59c3-4239-97c5-c898c9f9ca89" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 04 16:55:55.135646 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3709873-709f-4476-9616-41cd7c8f6290 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquired lock "refresh_cache-eb10c53c-59c3-4239-97c5-c898c9f9ca89" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 04 16:55:55.137923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5150ff3d-3509-44e3-aa16-7961e6199f87 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:55.138761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5150ff3d-3509-44e3-aa16-7961e6199f87 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:55.139200 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5150ff3d-3509-44e3-aa16-7961e6199f87 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:55.139923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5150ff3d-3509-44e3-aa16-7961e6199f87 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:55.140394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5150ff3d-3509-44e3-aa16-7961e6199f87 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:55.140832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5150ff3d-3509-44e3-aa16-7961e6199f87 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:55.283087 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5150ff3d-3509-44e3-aa16-7961e6199f87 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712723e5418441c096f008d1520f6dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8c7c49e56743dd9f64102e53c2bec7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:55.295547 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5150ff3d-3509-44e3-aa16-7961e6199f87 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "GET /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37" status: 200 len: 1223 microversion: 2.1 time: 0.185840 Aug 04 16:55:55.296409 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 214/420] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:55 2022] GET /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37 => generated 1223 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:55.311722 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-83150be0-d9cc-4a5d-a6f6-701cba69c188 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:55.315018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-83150be0-d9cc-4a5d-a6f6-701cba69c188 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:55.322389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83150be0-d9cc-4a5d-a6f6-701cba69c188 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:55.322898 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83150be0-d9cc-4a5d-a6f6-701cba69c188 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:55.323340 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83150be0-d9cc-4a5d-a6f6-701cba69c188 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:55.324060 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83150be0-d9cc-4a5d-a6f6-701cba69c188 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:55.324524 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83150be0-d9cc-4a5d-a6f6-701cba69c188 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:55.324957 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83150be0-d9cc-4a5d-a6f6-701cba69c188 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:55.430865 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-83150be0-d9cc-4a5d-a6f6-701cba69c188 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:55:55.432539 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-83150be0-d9cc-4a5d-a6f6-701cba69c188 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:55:55.433449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-83150be0-d9cc-4a5d-a6f6-701cba69c188 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:55:55.434246 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-83150be0-d9cc-4a5d-a6f6-701cba69c188 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:55:55.435505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-83150be0-d9cc-4a5d-a6f6-701cba69c188 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:55:55.554287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-83150be0-d9cc-4a5d-a6f6-701cba69c188 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:55.573899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83150be0-d9cc-4a5d-a6f6-701cba69c188 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:55.575276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83150be0-d9cc-4a5d-a6f6-701cba69c188 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:55.575276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83150be0-d9cc-4a5d-a6f6-701cba69c188 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:55.575918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83150be0-d9cc-4a5d-a6f6-701cba69c188 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:55.576515 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83150be0-d9cc-4a5d-a6f6-701cba69c188 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:55.576788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83150be0-d9cc-4a5d-a6f6-701cba69c188 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:55.659587 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:55.910634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-83150be0-d9cc-4a5d-a6f6-701cba69c188 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:55.928633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-83150be0-d9cc-4a5d-a6f6-701cba69c188 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:55.937173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-83150be0-d9cc-4a5d-a6f6-701cba69c188 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:55.947754 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-83150be0-d9cc-4a5d-a6f6-701cba69c188 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "POST /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb/action" status: 202 len: 1495 microversion: 2.75 time: 0.649730 Aug 04 16:55:55.948808 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 215/421] 10.222.0.93 () {62 vars in 1319 bytes} [Thu Aug 4 16:55:55 2022] POST /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb/action => generated 1495 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 04 16:55:56.393489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a78fdb6d-88b4-4780-8208-8b48ade6b64a tempest-DeleteServersAdminTestJSON-80250509 tempest-DeleteServersAdminTestJSON-80250509-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:56.394971 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a78fdb6d-88b4-4780-8208-8b48ade6b64a tempest-DeleteServersAdminTestJSON-80250509 tempest-DeleteServersAdminTestJSON-80250509-project-admin] [instance: e07a80a8-dec0-4a8b-bd5e-e2a50370d35b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:56.401504 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a78fdb6d-88b4-4780-8208-8b48ade6b64a tempest-DeleteServersAdminTestJSON-80250509 tempest-DeleteServersAdminTestJSON-80250509-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:56.402356 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a78fdb6d-88b4-4780-8208-8b48ade6b64a tempest-DeleteServersAdminTestJSON-80250509 tempest-DeleteServersAdminTestJSON-80250509-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:56.403480 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a78fdb6d-88b4-4780-8208-8b48ade6b64a tempest-DeleteServersAdminTestJSON-80250509 tempest-DeleteServersAdminTestJSON-80250509-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:56.405125 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a78fdb6d-88b4-4780-8208-8b48ade6b64a tempest-DeleteServersAdminTestJSON-80250509 tempest-DeleteServersAdminTestJSON-80250509-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:56.407394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a78fdb6d-88b4-4780-8208-8b48ade6b64a tempest-DeleteServersAdminTestJSON-80250509 tempest-DeleteServersAdminTestJSON-80250509-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:56.408079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a78fdb6d-88b4-4780-8208-8b48ade6b64a tempest-DeleteServersAdminTestJSON-80250509 tempest-DeleteServersAdminTestJSON-80250509-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:56.444820 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a78fdb6d-88b4-4780-8208-8b48ade6b64a tempest-DeleteServersAdminTestJSON-80250509 tempest-DeleteServersAdminTestJSON-80250509-project-admin] [instance: e07a80a8-dec0-4a8b-bd5e-e2a50370d35b] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:55:56.633084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:56.640731 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a78fdb6d-88b4-4780-8208-8b48ade6b64a tempest-DeleteServersAdminTestJSON-80250509 tempest-DeleteServersAdminTestJSON-80250509-project-admin] 10.222.0.93 "DELETE /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b" status: 204 len: 0 microversion: 2.1 time: 0.679970 Aug 04 16:55:56.641928 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 216/422] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 16:55:55 2022] DELETE /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b => generated 0 bytes in 692 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:55:56.648886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e50a64cf-5438-4c8d-b5c9-111e38e671b4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:56.650779 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e50a64cf-5438-4c8d-b5c9-111e38e671b4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 37140c09-31fd-4233-9ab9-6351044c5864] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:56.659297 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e50a64cf-5438-4c8d-b5c9-111e38e671b4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:56.660203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e50a64cf-5438-4c8d-b5c9-111e38e671b4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:56.660912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e50a64cf-5438-4c8d-b5c9-111e38e671b4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:56.661931 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e50a64cf-5438-4c8d-b5c9-111e38e671b4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:56.662981 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e50a64cf-5438-4c8d-b5c9-111e38e671b4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:56.663838 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e50a64cf-5438-4c8d-b5c9-111e38e671b4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:56.930358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=96 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:55:57.191397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e50a64cf-5438-4c8d-b5c9-111e38e671b4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:57.203722 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e50a64cf-5438-4c8d-b5c9-111e38e671b4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864" status: 200 len: 1505 microversion: 2.1 time: 0.559271 Aug 04 16:55:57.207925 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 217/423] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:56 2022] GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864 => generated 1505 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:57.232965 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4d4040b6-72cb-41e2-aa84-70c4d066b190 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:57.233707 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4d4040b6-72cb-41e2-aa84-70c4d066b190 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:57.244691 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d4040b6-72cb-41e2-aa84-70c4d066b190 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:57.245203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d4040b6-72cb-41e2-aa84-70c4d066b190 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:57.245796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d4040b6-72cb-41e2-aa84-70c4d066b190 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:57.246949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d4040b6-72cb-41e2-aa84-70c4d066b190 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:57.247502 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d4040b6-72cb-41e2-aa84-70c4d066b190 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:57.248003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d4040b6-72cb-41e2-aa84-70c4d066b190 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:57.399611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4d4040b6-72cb-41e2-aa84-70c4d066b190 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:57.415332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4d4040b6-72cb-41e2-aa84-70c4d066b190 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:57.417469 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4d4040b6-72cb-41e2-aa84-70c4d066b190 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:57.425184 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4d4040b6-72cb-41e2-aa84-70c4d066b190 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1447 microversion: 2.75 time: 0.201949 Aug 04 16:55:57.426465 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 218/424] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:55:57 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1447 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:55:57.433853 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-961aee9b-7944-4832-b682-a3ad646817c2 req-b741106a-d8fb-483f-af3c-08a8a3e4ea54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37140c09-31fd-4233-9ab9-6351044c5864", "name": "network-vif-unplugged", "status": "completed", "tag": "e39bb9a8-b8ea-451a-83ab-1b6e8662ede5"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:55:57.451284 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-961aee9b-7944-4832-b682-a3ad646817c2 req-b741106a-d8fb-483f-af3c-08a8a3e4ea54 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:57.452023 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-961aee9b-7944-4832-b682-a3ad646817c2 req-b741106a-d8fb-483f-af3c-08a8a3e4ea54 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:57.452555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-961aee9b-7944-4832-b682-a3ad646817c2 req-b741106a-d8fb-483f-af3c-08a8a3e4ea54 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:57.478621 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-961aee9b-7944-4832-b682-a3ad646817c2 req-b741106a-d8fb-483f-af3c-08a8a3e4ea54 service nova] Creating event network-vif-unplugged:e39bb9a8-b8ea-451a-83ab-1b6e8662ede5 for instance 37140c09-31fd-4233-9ab9-6351044c5864 on n-h1-851359-3 Aug 04 16:55:57.485884 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-961aee9b-7944-4832-b682-a3ad646817c2 req-b741106a-d8fb-483f-af3c-08a8a3e4ea54 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056989 Aug 04 16:55:57.487397 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 219/425] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:55:57.494337 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a8b5660f-014d-42c2-8766-00432ddc50e3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:57.495107 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a8b5660f-014d-42c2-8766-00432ddc50e3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:57.503194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8b5660f-014d-42c2-8766-00432ddc50e3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:57.503827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8b5660f-014d-42c2-8766-00432ddc50e3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:57.504292 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8b5660f-014d-42c2-8766-00432ddc50e3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:57.505079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8b5660f-014d-42c2-8766-00432ddc50e3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:57.505543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8b5660f-014d-42c2-8766-00432ddc50e3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:57.507265 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8b5660f-014d-42c2-8766-00432ddc50e3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:57.867115 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a8b5660f-014d-42c2-8766-00432ddc50e3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:57.878228 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a8b5660f-014d-42c2-8766-00432ddc50e3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1476 microversion: 2.1 time: 0.388818 Aug 04 16:55:57.883062 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 220/426] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:57 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1476 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:57.916362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0818a87f-5ae3-499b-b3af-f29c4b6faa9e tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:57.917071 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0818a87f-5ae3-499b-b3af-f29c4b6faa9e tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: 2b1b8878-8ab2-4792-904f-dae80363ee37] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:57.942170 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0818a87f-5ae3-499b-b3af-f29c4b6faa9e tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:57.942797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0818a87f-5ae3-499b-b3af-f29c4b6faa9e tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:57.943318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0818a87f-5ae3-499b-b3af-f29c4b6faa9e tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:57.944411 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0818a87f-5ae3-499b-b3af-f29c4b6faa9e tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:57.954488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0818a87f-5ae3-499b-b3af-f29c4b6faa9e tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:57.955178 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0818a87f-5ae3-499b-b3af-f29c4b6faa9e tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:58.548828 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0818a87f-5ae3-499b-b3af-f29c4b6faa9e tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712723e5418441c096f008d1520f6dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8c7c49e56743dd9f64102e53c2bec7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:58.584512 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0818a87f-5ae3-499b-b3af-f29c4b6faa9e tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "GET /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37" status: 200 len: 1277 microversion: 2.1 time: 0.696650 Aug 04 16:55:58.590202 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 221/427] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:57 2022] GET /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37 => generated 1277 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:58.613598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3ceb7d8c-6859-41db-b4c3-aff87907109d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:58.614392 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3ceb7d8c-6859-41db-b4c3-aff87907109d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: e07a80a8-dec0-4a8b-bd5e-e2a50370d35b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:58.639401 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ceb7d8c-6859-41db-b4c3-aff87907109d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:58.648878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ceb7d8c-6859-41db-b4c3-aff87907109d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:58.649835 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ceb7d8c-6859-41db-b4c3-aff87907109d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:58.650843 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ceb7d8c-6859-41db-b4c3-aff87907109d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:58.651488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ceb7d8c-6859-41db-b4c3-aff87907109d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:58.652122 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ceb7d8c-6859-41db-b4c3-aff87907109d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:59.011235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-f3709873-709f-4476-9616-41cd7c8f6290 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] [instance: eb10c53c-59c3-4239-97c5-c898c9f9ca89] Building network info cache for instance {{(pid=131044) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 16:55:59.718603 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3ceb7d8c-6859-41db-b4c3-aff87907109d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12efa078aa84861925925314ef00aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ed72eca39e4bab83ccbba779ac37c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:55:59.731069 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3ceb7d8c-6859-41db-b4c3-aff87907109d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "GET /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b" status: 200 len: 1476 microversion: 2.1 time: 1.128266 Aug 04 16:55:59.734378 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 222/428] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:58 2022] GET /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b => generated 1476 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:55:59.747266 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-90a90495-35d4-49d2-bfe8-e737a319c911 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:55:59.749550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-90a90495-35d4-49d2-bfe8-e737a319c911 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 37140c09-31fd-4233-9ab9-6351044c5864] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:55:59.766885 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90a90495-35d4-49d2-bfe8-e737a319c911 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:59.767684 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90a90495-35d4-49d2-bfe8-e737a319c911 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:59.769362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90a90495-35d4-49d2-bfe8-e737a319c911 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:59.772585 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90a90495-35d4-49d2-bfe8-e737a319c911 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:55:59.773608 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90a90495-35d4-49d2-bfe8-e737a319c911 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:55:59.775039 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90a90495-35d4-49d2-bfe8-e737a319c911 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:55:59.819959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:00.550177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-90a90495-35d4-49d2-bfe8-e737a319c911 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:00.565582 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-90a90495-35d4-49d2-bfe8-e737a319c911 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864" status: 200 len: 1505 microversion: 2.1 time: 0.828878 Aug 04 16:56:00.566199 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 223/429] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:55:59 2022] GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864 => generated 1505 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:00.583427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-82d1ed01-a709-48fa-bdb6-9bebfade78df tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:00.584060 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-82d1ed01-a709-48fa-bdb6-9bebfade78df tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:00.591555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82d1ed01-a709-48fa-bdb6-9bebfade78df tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:00.592059 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82d1ed01-a709-48fa-bdb6-9bebfade78df tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:00.598026 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82d1ed01-a709-48fa-bdb6-9bebfade78df tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:00.598908 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82d1ed01-a709-48fa-bdb6-9bebfade78df tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:00.599401 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82d1ed01-a709-48fa-bdb6-9bebfade78df tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:00.599845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82d1ed01-a709-48fa-bdb6-9bebfade78df tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:00.832139 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-82d1ed01-a709-48fa-bdb6-9bebfade78df tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:00.847636 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-82d1ed01-a709-48fa-bdb6-9bebfade78df tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:00.849509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-82d1ed01-a709-48fa-bdb6-9bebfade78df tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:00.864921 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-82d1ed01-a709-48fa-bdb6-9bebfade78df tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1447 microversion: 2.75 time: 0.297570 Aug 04 16:56:00.867240 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 224/430] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:00 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1447 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:00.878105 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5b991fa2-a370-4e95-826f-e16f4e9599b3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:00.881352 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5b991fa2-a370-4e95-826f-e16f4e9599b3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:00.892142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b991fa2-a370-4e95-826f-e16f4e9599b3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:00.892776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b991fa2-a370-4e95-826f-e16f4e9599b3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:00.893212 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b991fa2-a370-4e95-826f-e16f4e9599b3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:00.893950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b991fa2-a370-4e95-826f-e16f4e9599b3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:00.894431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b991fa2-a370-4e95-826f-e16f4e9599b3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:00.899101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b991fa2-a370-4e95-826f-e16f4e9599b3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:01.141569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-f3709873-709f-4476-9616-41cd7c8f6290 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] [instance: eb10c53c-59c3-4239-97c5-c898c9f9ca89] Updating instance_info_cache with network_info: [{"id": "7c10a7ae-46ce-40dd-b73d-1e6d2b434cee", "address": "fa:16:3e:b5:fc:4d", "network": {"id": "4f601fe3-086d-4166-a668-9b13ff766838", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1712798257-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3f3e5530401f4a87a038b3d30679a74e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7c10a7ae-46", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131044) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 16:56:01.189325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3709873-709f-4476-9616-41cd7c8f6290 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Releasing lock "refresh_cache-eb10c53c-59c3-4239-97c5-c898c9f9ca89" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 04 16:56:01.191842 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f3709873-709f-4476-9616-41cd7c8f6290 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] 10.222.0.93 "POST /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89/action" status: 202 len: 0 microversion: 2.1 time: 6.209820 Aug 04 16:56:01.193070 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 207/431] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:55:54 2022] POST /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89/action => generated 0 bytes in 6212 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 04 16:56:01.201278 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0af08f57-5f5e-4596-8880-374986b7369b req-029fbee1-f0a1-432b-8553-aa284c74369d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37140c09-31fd-4233-9ab9-6351044c5864", "tag": "e39bb9a8-b8ea-451a-83ab-1b6e8662ede5"}, {"name": "network-changed", "server_uuid": "eb10c53c-59c3-4239-97c5-c898c9f9ca89", "tag": "7c10a7ae-46ce-40dd-b73d-1e6d2b434cee"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:01.224958 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0af08f57-5f5e-4596-8880-374986b7369b req-029fbee1-f0a1-432b-8553-aa284c74369d service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:01.227314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0af08f57-5f5e-4596-8880-374986b7369b req-029fbee1-f0a1-432b-8553-aa284c74369d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:01.229330 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0af08f57-5f5e-4596-8880-374986b7369b req-029fbee1-f0a1-432b-8553-aa284c74369d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:01.265937 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0af08f57-5f5e-4596-8880-374986b7369b req-029fbee1-f0a1-432b-8553-aa284c74369d service nova] Creating event network-changed:e39bb9a8-b8ea-451a-83ab-1b6e8662ede5 for instance 37140c09-31fd-4233-9ab9-6351044c5864 on n-h1-851359-3 Aug 04 16:56:01.266480 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0af08f57-5f5e-4596-8880-374986b7369b req-029fbee1-f0a1-432b-8553-aa284c74369d service nova] Creating event network-changed:7c10a7ae-46ce-40dd-b73d-1e6d2b434cee for instance eb10c53c-59c3-4239-97c5-c898c9f9ca89 on n-h1-851359-3 Aug 04 16:56:01.275353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5b991fa2-a370-4e95-826f-e16f4e9599b3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:01.285389 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0af08f57-5f5e-4596-8880-374986b7369b req-029fbee1-f0a1-432b-8553-aa284c74369d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.087948 Aug 04 16:56:01.286650 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 208/432] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:01.293362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-62ee1b88-6064-4c65-a1ff-0cf904e3c272 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:01.294089 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-62ee1b88-6064-4c65-a1ff-0cf904e3c272 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: 2b1b8878-8ab2-4792-904f-dae80363ee37] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:01.297745 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5b991fa2-a370-4e95-826f-e16f4e9599b3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1476 microversion: 2.1 time: 0.411771 Aug 04 16:56:01.299522 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 225/433] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:00 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1476 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:01.306882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62ee1b88-6064-4c65-a1ff-0cf904e3c272 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:01.307381 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62ee1b88-6064-4c65-a1ff-0cf904e3c272 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:01.307818 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62ee1b88-6064-4c65-a1ff-0cf904e3c272 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:01.308772 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62ee1b88-6064-4c65-a1ff-0cf904e3c272 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:01.309225 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62ee1b88-6064-4c65-a1ff-0cf904e3c272 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:01.309647 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62ee1b88-6064-4c65-a1ff-0cf904e3c272 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:01.310076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1b8d43e5-021f-462b-baf1-8ad62830b27a tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:01.310701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1b8d43e5-021f-462b-baf1-8ad62830b27a tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: e07a80a8-dec0-4a8b-bd5e-e2a50370d35b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:01.329728 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1b8d43e5-021f-462b-baf1-8ad62830b27a tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:01.330881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1b8d43e5-021f-462b-baf1-8ad62830b27a tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:01.331326 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1b8d43e5-021f-462b-baf1-8ad62830b27a tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:01.332045 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1b8d43e5-021f-462b-baf1-8ad62830b27a tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:01.332560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1b8d43e5-021f-462b-baf1-8ad62830b27a tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:01.332992 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1b8d43e5-021f-462b-baf1-8ad62830b27a tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:01.520290 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1b8d43e5-021f-462b-baf1-8ad62830b27a tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12efa078aa84861925925314ef00aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ed72eca39e4bab83ccbba779ac37c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:01.535520 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1b8d43e5-021f-462b-baf1-8ad62830b27a tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "GET /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b" status: 200 len: 1305 microversion: 2.1 time: 0.234402 Aug 04 16:56:01.536801 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 226/434] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:01 2022] GET /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b => generated 1305 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:01.547827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-588d2fb7-69fe-4272-8a09-945b68fcad0b tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Action: 'create', calling method: .version_select at 0x7f1e5bf20670>, body: {"pool": "aa834c21-a026-461a-926c-9c43b1a51a9c"} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:01.705919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-62ee1b88-6064-4c65-a1ff-0cf904e3c272 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712723e5418441c096f008d1520f6dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8c7c49e56743dd9f64102e53c2bec7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:01.714054 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-62ee1b88-6064-4c65-a1ff-0cf904e3c272 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "GET /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37" status: 200 len: 1319 microversion: 2.1 time: 0.425920 Aug 04 16:56:01.717033 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 209/435] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:01 2022] GET /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37 => generated 1319 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:01.725685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3c2cdc96-49a6-4808-85df-4c117d1fa112 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:01.728054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3c2cdc96-49a6-4808-85df-4c117d1fa112 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 37140c09-31fd-4233-9ab9-6351044c5864] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:01.743915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c2cdc96-49a6-4808-85df-4c117d1fa112 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:01.747736 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c2cdc96-49a6-4808-85df-4c117d1fa112 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:01.748470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c2cdc96-49a6-4808-85df-4c117d1fa112 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:01.752564 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c2cdc96-49a6-4808-85df-4c117d1fa112 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:01.753339 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c2cdc96-49a6-4808-85df-4c117d1fa112 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:01.759872 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c2cdc96-49a6-4808-85df-4c117d1fa112 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:02.286897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3c2cdc96-49a6-4808-85df-4c117d1fa112 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:02.316808 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3c2cdc96-49a6-4808-85df-4c117d1fa112 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864" status: 200 len: 1505 microversion: 2.1 time: 0.596556 Aug 04 16:56:02.319154 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 210/436] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:01 2022] GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864 => generated 1505 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:02.335369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-247db4e0-da5c-4b42-9641-661130b62d09 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:02.338254 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-247db4e0-da5c-4b42-9641-661130b62d09 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:02.349930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-247db4e0-da5c-4b42-9641-661130b62d09 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:02.350851 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-247db4e0-da5c-4b42-9641-661130b62d09 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:02.351450 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-247db4e0-da5c-4b42-9641-661130b62d09 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:02.352333 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-247db4e0-da5c-4b42-9641-661130b62d09 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:02.352990 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-247db4e0-da5c-4b42-9641-661130b62d09 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:02.353380 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-247db4e0-da5c-4b42-9641-661130b62d09 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:02.787639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-247db4e0-da5c-4b42-9641-661130b62d09 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:02.796442 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-247db4e0-da5c-4b42-9641-661130b62d09 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:02.802992 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-247db4e0-da5c-4b42-9641-661130b62d09 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:02.809144 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-247db4e0-da5c-4b42-9641-661130b62d09 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1447 microversion: 2.75 time: 0.487354 Aug 04 16:56:02.827442 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 211/437] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:02 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1447 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:02.847832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1505bcf2-1562-4795-8268-922acbb8be1c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:02.848613 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1505bcf2-1562-4795-8268-922acbb8be1c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:02.861188 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1505bcf2-1562-4795-8268-922acbb8be1c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:02.862536 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1505bcf2-1562-4795-8268-922acbb8be1c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:02.863407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1505bcf2-1562-4795-8268-922acbb8be1c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:02.864370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1505bcf2-1562-4795-8268-922acbb8be1c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:02.865068 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1505bcf2-1562-4795-8268-922acbb8be1c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:02.865713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1505bcf2-1562-4795-8268-922acbb8be1c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:03.276790 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1505bcf2-1562-4795-8268-922acbb8be1c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:03.307545 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1505bcf2-1562-4795-8268-922acbb8be1c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1475 microversion: 2.1 time: 0.478657 Aug 04 16:56:03.310453 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 212/438] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:02 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1475 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:03.316798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3755dd43-a674-4bcd-b8f8-306c6ef5c58e tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:03.318131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3755dd43-a674-4bcd-b8f8-306c6ef5c58e tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: e07a80a8-dec0-4a8b-bd5e-e2a50370d35b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:03.331852 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3755dd43-a674-4bcd-b8f8-306c6ef5c58e tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:03.332715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3755dd43-a674-4bcd-b8f8-306c6ef5c58e tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:03.335532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3755dd43-a674-4bcd-b8f8-306c6ef5c58e tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:03.339613 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3755dd43-a674-4bcd-b8f8-306c6ef5c58e tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:03.341396 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3755dd43-a674-4bcd-b8f8-306c6ef5c58e tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:03.342115 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3755dd43-a674-4bcd-b8f8-306c6ef5c58e tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:03.370514 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-3755dd43-a674-4bcd-b8f8-306c6ef5c58e tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] HTTP exception thrown: Instance e07a80a8-dec0-4a8b-bd5e-e2a50370d35b could not be found. Aug 04 16:56:03.373834 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3755dd43-a674-4bcd-b8f8-306c6ef5c58e tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Request method failure captured: Aug 04 16:56:03.373834 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b HTTP/1.1 Aug 04 16:56:03.373834 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:56:03.373834 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:56:03.373834 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:56:03.373834 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:56:03.373834 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:56:03.373834 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:56:03.373834 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:56:03.373834 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:03.373834 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_oBtkwavIdTC29hFuseZiZRg_Ei4T9WN50LARf4FZkWYS0GRjeVTKoWE9ZUr3zwxdCSci7KRy3WPW0ujpdZo_OxEZObuzoUYigFK2Md8tPPyDMUcgU2BR65DZmOHgnQcHVjBIK2KV5AVyvPuuJn61J3sl6tWrOq6v8_MQtbMgsNTaE Aug 04 16:56:03.373834 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:56:03.373834 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:56:03.373834 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:56:03.373834 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:56:03.373834 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:56:03.373834 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:56:03.373834 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 37ed72eca39e4bab83ccbba779ac37c9 Aug 04 16:56:03.373834 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-DeleteServersAdminTestJSON-113822406 Aug 04 16:56:03.373834 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:56:03.373834 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:56:03.375193 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/37ed72eca39e4bab83ccbba779ac37c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/37ed72eca39e4bab83ccbba779ac37c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_37ed72eca39e4bab83ccbba779ac37c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/37ed72eca39e4bab83ccbba779ac37c9"}]}] Aug 04 16:56:03.375193 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-DeleteServersAdminTestJSON-113822406 Aug 04 16:56:03.375193 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 37ed72eca39e4bab83ccbba779ac37c9 Aug 04 16:56:03.375193 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-113822406 Aug 04 16:56:03.375193 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-DeleteServersAdminTestJSON-113822406-project Aug 04 16:56:03.375193 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:56:03.375193 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:56:03.375193 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: c12efa078aa84861925925314ef00aea Aug 04 16:56:03.375193 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-DeleteServersAdminTestJSON-113822406-project Aug 04 16:56:03.375193 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:56:03.375193 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance e07a80a8-dec0-4a8b-bd5e-e2a50370d35b could not be found. Aug 04 16:56:03.375193 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'e07a80a8-dec0-4a8b-bd5e-e2a50370d35b'} Aug 04 16:56:03.375948 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:03.375948 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:03.375948 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:56:03.375948 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:56:03.375948 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:56:03.375948 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:56:03.375948 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:56:03.375948 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:56:03.375948 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:56:03.375948 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:56:03.375948 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e07a80a8-dec0-4a8b-bd5e-e2a50370d35b could not be found. Aug 04 16:56:03.375948 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:03.375948 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:03.375948 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:03.375948 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:03.375948 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:03.375948 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:03.375948 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:03.375948 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:03.375948 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:03.377686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:03.377686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:56:03.377686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:56:03.377686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:56:03.377686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:56:03.377686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:56:03.377686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:56:03.377686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e07a80a8-dec0-4a8b-bd5e-e2a50370d35b could not be found. Aug 04 16:56:03.377686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:03.377686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:03.377686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:03.377686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:03.377686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:03.377686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:03.377686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:56:03.377686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:56:03.377686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e07a80a8-dec0-4a8b-bd5e-e2a50370d35b could not be found. Aug 04 16:56:03.377686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:03.383434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3755dd43-a674-4bcd-b8f8-306c6ef5c58e tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Returning 404 to user: Instance e07a80a8-dec0-4a8b-bd5e-e2a50370d35b could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:03.384577 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3755dd43-a674-4bcd-b8f8-306c6ef5c58e tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "GET /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b" status: 404 len: 111 microversion: 2.1 time: 0.072890 Aug 04 16:56:03.385957 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 213/439] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:03 2022] GET /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:56:03.402306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3fa515c1-29d5-4ce9-bb8f-e03472c357b4 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:03.404744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3fa515c1-29d5-4ce9-bb8f-e03472c357b4 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: 2b1b8878-8ab2-4792-904f-dae80363ee37] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:03.431587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3fa515c1-29d5-4ce9-bb8f-e03472c357b4 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:03.432531 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3fa515c1-29d5-4ce9-bb8f-e03472c357b4 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:03.433872 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3fa515c1-29d5-4ce9-bb8f-e03472c357b4 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:03.436642 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3fa515c1-29d5-4ce9-bb8f-e03472c357b4 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:03.438983 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3fa515c1-29d5-4ce9-bb8f-e03472c357b4 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:03.440489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3fa515c1-29d5-4ce9-bb8f-e03472c357b4 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:03.948000 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3fa515c1-29d5-4ce9-bb8f-e03472c357b4 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712723e5418441c096f008d1520f6dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8c7c49e56743dd9f64102e53c2bec7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:03.957319 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3fa515c1-29d5-4ce9-bb8f-e03472c357b4 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "GET /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37" status: 200 len: 1319 microversion: 2.1 time: 0.569714 Aug 04 16:56:03.958296 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 214/440] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:03 2022] GET /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37 => generated 1319 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:03.962844 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-dbc8e3d0-d421-4bbb-9062-2cfbedfbdcc8 req-abb03cd5-2229-4fac-9f36-ec7e6ec43379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e07a80a8-dec0-4a8b-bd5e-e2a50370d35b", "name": "network-vif-deleted", "tag": "8594332c-5c09-4548-bbe4-843f0ea972a9"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:03.979794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-dbc8e3d0-d421-4bbb-9062-2cfbedfbdcc8 req-abb03cd5-2229-4fac-9f36-ec7e6ec43379 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:03.980288 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-dbc8e3d0-d421-4bbb-9062-2cfbedfbdcc8 req-abb03cd5-2229-4fac-9f36-ec7e6ec43379 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:03.980735 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-dbc8e3d0-d421-4bbb-9062-2cfbedfbdcc8 req-abb03cd5-2229-4fac-9f36-ec7e6ec43379 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:04.001668 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-dbc8e3d0-d421-4bbb-9062-2cfbedfbdcc8 req-abb03cd5-2229-4fac-9f36-ec7e6ec43379 service nova] Creating event network-vif-deleted:8594332c-5c09-4548-bbe4-843f0ea972a9 for instance e07a80a8-dec0-4a8b-bd5e-e2a50370d35b on n-h2-851359-3 Aug 04 16:56:04.009564 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-dbc8e3d0-d421-4bbb-9062-2cfbedfbdcc8 req-abb03cd5-2229-4fac-9f36-ec7e6ec43379 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050408 Aug 04 16:56:04.010299 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 215/441] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:04.016366 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-039e49ad-18b4-40b3-aaa5-a3fe49f1399e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:04.017679 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-039e49ad-18b4-40b3-aaa5-a3fe49f1399e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 37140c09-31fd-4233-9ab9-6351044c5864] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:04.024107 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-039e49ad-18b4-40b3-aaa5-a3fe49f1399e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:04.024572 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-039e49ad-18b4-40b3-aaa5-a3fe49f1399e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:04.025019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-039e49ad-18b4-40b3-aaa5-a3fe49f1399e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:04.025966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-039e49ad-18b4-40b3-aaa5-a3fe49f1399e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:04.026673 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-039e49ad-18b4-40b3-aaa5-a3fe49f1399e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:04.027489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-039e49ad-18b4-40b3-aaa5-a3fe49f1399e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:04.259387 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:04.288408 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=5 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:04.734690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-039e49ad-18b4-40b3-aaa5-a3fe49f1399e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:04.747984 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-039e49ad-18b4-40b3-aaa5-a3fe49f1399e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864" status: 200 len: 1505 microversion: 2.1 time: 0.736345 Aug 04 16:56:04.749802 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 216/442] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:04 2022] GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864 => generated 1505 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:04.759059 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-72ffb417-b885-432d-8534-f980ae0e7cf6 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-565491911", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:04.834680 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-72ffb417-b885-432d-8534-f980ae0e7cf6 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:56:06.046643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-72ffb417-b885-432d-8534-f980ae0e7cf6 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:56:06.047209 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-72ffb417-b885-432d-8534-f980ae0e7cf6 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:56:06.048455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-72ffb417-b885-432d-8534-f980ae0e7cf6 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:56:06.050159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-72ffb417-b885-432d-8534-f980ae0e7cf6 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:56:06.050821 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-72ffb417-b885-432d-8534-f980ae0e7cf6 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:56:06.061872 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72ffb417-b885-432d-8534-f980ae0e7cf6 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:06.062394 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72ffb417-b885-432d-8534-f980ae0e7cf6 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:06.062916 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72ffb417-b885-432d-8534-f980ae0e7cf6 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:06.063833 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72ffb417-b885-432d-8534-f980ae0e7cf6 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:06.064333 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72ffb417-b885-432d-8534-f980ae0e7cf6 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:06.064819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72ffb417-b885-432d-8534-f980ae0e7cf6 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:06.083108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-72ffb417-b885-432d-8534-f980ae0e7cf6 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Getting quotas for project 37ed72eca39e4bab83ccbba779ac37c9. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:56:06.088058 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-72ffb417-b885-432d-8534-f980ae0e7cf6 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Getting quotas for user c12efa078aa84861925925314ef00aea and project 37ed72eca39e4bab83ccbba779ac37c9. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:56:06.100905 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-72ffb417-b885-432d-8534-f980ae0e7cf6 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:56:06.103144 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-72ffb417-b885-432d-8534-f980ae0e7cf6 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: 9d66fc68-229a-4ec3-8c6a-af43a20d2462] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:56:06.148742 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-72ffb417-b885-432d-8534-f980ae0e7cf6 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.397336 Aug 04 16:56:06.155075 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 217/443] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:56:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:56:06.155075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2cd6f1c4-9810-4eed-84a6-d17116716c87 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:06.155346 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2cd6f1c4-9810-4eed-84a6-d17116716c87 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:06.162826 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-588d2fb7-69fe-4272-8a09-945b68fcad0b tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] 10.222.0.93 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.624634 Aug 04 16:56:06.164021 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 227/444] 10.222.0.93 () {60 vars in 1170 bytes} [Thu Aug 4 16:56:01 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:06.170195 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2cd6f1c4-9810-4eed-84a6-d17116716c87 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:06.170195 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2cd6f1c4-9810-4eed-84a6-d17116716c87 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:06.170195 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2cd6f1c4-9810-4eed-84a6-d17116716c87 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:06.170195 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2cd6f1c4-9810-4eed-84a6-d17116716c87 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:06.170534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2cd6f1c4-9810-4eed-84a6-d17116716c87 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:06.170534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2cd6f1c4-9810-4eed-84a6-d17116716c87 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:06.184919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8c350f43-42de-4bc8-9231-0700bfb01e08 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:06.185559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8c350f43-42de-4bc8-9231-0700bfb01e08 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:06.202168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c350f43-42de-4bc8-9231-0700bfb01e08 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:06.202665 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c350f43-42de-4bc8-9231-0700bfb01e08 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:06.203103 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c350f43-42de-4bc8-9231-0700bfb01e08 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:06.203807 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c350f43-42de-4bc8-9231-0700bfb01e08 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:06.204262 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c350f43-42de-4bc8-9231-0700bfb01e08 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:06.204689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c350f43-42de-4bc8-9231-0700bfb01e08 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:06.329051 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2cd6f1c4-9810-4eed-84a6-d17116716c87 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:06.347951 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2cd6f1c4-9810-4eed-84a6-d17116716c87 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:06.351618 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2cd6f1c4-9810-4eed-84a6-d17116716c87 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:06.371352 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2cd6f1c4-9810-4eed-84a6-d17116716c87 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1447 microversion: 2.75 time: 0.219108 Aug 04 16:56:06.372540 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 218/445] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:06 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1447 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:06.382283 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ffeb7c8e-6964-48d0-9dc1-828ae0529cc9 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:06.385374 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ffeb7c8e-6964-48d0-9dc1-828ae0529cc9 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: 2b1b8878-8ab2-4792-904f-dae80363ee37] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:06.399832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffeb7c8e-6964-48d0-9dc1-828ae0529cc9 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:06.400432 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffeb7c8e-6964-48d0-9dc1-828ae0529cc9 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:06.401094 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffeb7c8e-6964-48d0-9dc1-828ae0529cc9 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:06.401910 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffeb7c8e-6964-48d0-9dc1-828ae0529cc9 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:06.402516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffeb7c8e-6964-48d0-9dc1-828ae0529cc9 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:06.403100 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffeb7c8e-6964-48d0-9dc1-828ae0529cc9 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:06.716700 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8c350f43-42de-4bc8-9231-0700bfb01e08 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:06.727805 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8c350f43-42de-4bc8-9231-0700bfb01e08 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1475 microversion: 2.1 time: 0.547814 Aug 04 16:56:06.728736 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 228/446] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:06 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1475 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:06.733407 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2746579d-9b3b-4c54-83ca-0bb58b890c07 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:06.742129 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2746579d-9b3b-4c54-83ca-0bb58b890c07 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 37140c09-31fd-4233-9ab9-6351044c5864] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:06.749360 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2746579d-9b3b-4c54-83ca-0bb58b890c07 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:06.750185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2746579d-9b3b-4c54-83ca-0bb58b890c07 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:06.750741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2746579d-9b3b-4c54-83ca-0bb58b890c07 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:06.751582 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2746579d-9b3b-4c54-83ca-0bb58b890c07 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:06.752312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2746579d-9b3b-4c54-83ca-0bb58b890c07 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:06.752912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2746579d-9b3b-4c54-83ca-0bb58b890c07 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:07.061369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ffeb7c8e-6964-48d0-9dc1-828ae0529cc9 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712723e5418441c096f008d1520f6dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8c7c49e56743dd9f64102e53c2bec7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:07.074860 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ffeb7c8e-6964-48d0-9dc1-828ae0529cc9 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "GET /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37" status: 200 len: 1319 microversion: 2.1 time: 0.699202 Aug 04 16:56:07.076313 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 219/447] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:06 2022] GET /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37 => generated 1319 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:07.084474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0c46036a-d7d3-4d71-83bc-1bbacff3886b req-61b5deed-719a-4010-a772-9a1374c7501a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0b4f50d-df7a-44ab-87d8-054aa370c979", "name": "network-vif-unplugged", "status": "completed", "tag": "6defc06d-afcb-4aaa-9d45-8000639706e7"}, {"name": "network-changed", "server_uuid": "2b1b8878-8ab2-4792-904f-dae80363ee37", "tag": "f14cc87b-6de7-4609-9c0c-01ed874b29b1"}, {"name": "network-changed", "server_uuid": "d0b4f50d-df7a-44ab-87d8-054aa370c979", "tag": "6defc06d-afcb-4aaa-9d45-8000639706e7"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:07.104026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0c46036a-d7d3-4d71-83bc-1bbacff3886b req-61b5deed-719a-4010-a772-9a1374c7501a service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:07.104776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0c46036a-d7d3-4d71-83bc-1bbacff3886b req-61b5deed-719a-4010-a772-9a1374c7501a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:07.105297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0c46036a-d7d3-4d71-83bc-1bbacff3886b req-61b5deed-719a-4010-a772-9a1374c7501a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:07.123016 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0c46036a-d7d3-4d71-83bc-1bbacff3886b req-61b5deed-719a-4010-a772-9a1374c7501a service nova] Creating event network-vif-unplugged:6defc06d-afcb-4aaa-9d45-8000639706e7 for instance d0b4f50d-df7a-44ab-87d8-054aa370c979 on n-h2-851359-3 Aug 04 16:56:07.123527 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0c46036a-d7d3-4d71-83bc-1bbacff3886b req-61b5deed-719a-4010-a772-9a1374c7501a service nova] Creating event network-changed:f14cc87b-6de7-4609-9c0c-01ed874b29b1 for instance 2b1b8878-8ab2-4792-904f-dae80363ee37 on n-h1-851359-3 Aug 04 16:56:07.124031 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0c46036a-d7d3-4d71-83bc-1bbacff3886b req-61b5deed-719a-4010-a772-9a1374c7501a service nova] Creating event network-changed:6defc06d-afcb-4aaa-9d45-8000639706e7 for instance d0b4f50d-df7a-44ab-87d8-054aa370c979 on n-h2-851359-3 Aug 04 16:56:07.138883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-0c46036a-d7d3-4d71-83bc-1bbacff3886b req-61b5deed-719a-4010-a772-9a1374c7501a service nova] Instance d0b4f50d-df7a-44ab-87d8-054aa370c979 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 16:56:07.152764 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0c46036a-d7d3-4d71-83bc-1bbacff3886b req-61b5deed-719a-4010-a772-9a1374c7501a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.073824 Aug 04 16:56:07.154937 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 220/448] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:07.161729 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4a67f0a2-387e-4d9f-b2ff-1796fbae7603 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:07.162558 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4a67f0a2-387e-4d9f-b2ff-1796fbae7603 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: 9d66fc68-229a-4ec3-8c6a-af43a20d2462] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:07.170864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a67f0a2-387e-4d9f-b2ff-1796fbae7603 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:07.172260 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a67f0a2-387e-4d9f-b2ff-1796fbae7603 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:07.172867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a67f0a2-387e-4d9f-b2ff-1796fbae7603 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:07.174413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a67f0a2-387e-4d9f-b2ff-1796fbae7603 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:07.175049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a67f0a2-387e-4d9f-b2ff-1796fbae7603 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:07.175486 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a67f0a2-387e-4d9f-b2ff-1796fbae7603 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:07.626121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4a67f0a2-387e-4d9f-b2ff-1796fbae7603 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12efa078aa84861925925314ef00aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ed72eca39e4bab83ccbba779ac37c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:07.634219 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4a67f0a2-387e-4d9f-b2ff-1796fbae7603 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462" status: 200 len: 1215 microversion: 2.1 time: 0.477637 Aug 04 16:56:07.634799 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 221/449] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:07 2022] GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462 => generated 1215 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:07.652560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-854466ba-a6d8-43f8-922d-31a212b071c4 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.172"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:07.655157 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-854466ba-a6d8-43f8-922d-31a212b071c4 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] [instance: eb10c53c-59c3-4239-97c5-c898c9f9ca89] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:07.661302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-854466ba-a6d8-43f8-922d-31a212b071c4 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:07.661788 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-854466ba-a6d8-43f8-922d-31a212b071c4 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:07.662254 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-854466ba-a6d8-43f8-922d-31a212b071c4 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:07.662966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-854466ba-a6d8-43f8-922d-31a212b071c4 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:07.663421 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-854466ba-a6d8-43f8-922d-31a212b071c4 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:07.664846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-854466ba-a6d8-43f8-922d-31a212b071c4 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:07.669804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2746579d-9b3b-4c54-83ca-0bb58b890c07 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:07.689741 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2746579d-9b3b-4c54-83ca-0bb58b890c07 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864" status: 200 len: 1505 microversion: 2.1 time: 0.959143 Aug 04 16:56:07.690751 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 229/450] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:06 2022] GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864 => generated 1505 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:07.699340 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3581d0f5-cd22-492d-be9e-b2329af89575 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:07.705888 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3581d0f5-cd22-492d-be9e-b2329af89575 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:07.709224 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-854466ba-a6d8-43f8-922d-31a212b071c4 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "refresh_cache-eb10c53c-59c3-4239-97c5-c898c9f9ca89" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 04 16:56:07.710881 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-854466ba-a6d8-43f8-922d-31a212b071c4 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquired lock "refresh_cache-eb10c53c-59c3-4239-97c5-c898c9f9ca89" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 04 16:56:07.717875 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3581d0f5-cd22-492d-be9e-b2329af89575 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:07.718415 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3581d0f5-cd22-492d-be9e-b2329af89575 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:07.718851 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3581d0f5-cd22-492d-be9e-b2329af89575 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:07.719563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3581d0f5-cd22-492d-be9e-b2329af89575 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:07.720025 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3581d0f5-cd22-492d-be9e-b2329af89575 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:07.720505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3581d0f5-cd22-492d-be9e-b2329af89575 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:07.957552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3581d0f5-cd22-492d-be9e-b2329af89575 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:07.972414 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3581d0f5-cd22-492d-be9e-b2329af89575 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:07.976289 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3581d0f5-cd22-492d-be9e-b2329af89575 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:07.985735 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3581d0f5-cd22-492d-be9e-b2329af89575 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1447 microversion: 2.75 time: 0.293698 Aug 04 16:56:07.988725 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 230/451] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:07 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1447 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:08.009881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-039cb172-6442-4a4a-b289-634e436de899 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:08.010540 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-039cb172-6442-4a4a-b289-634e436de899 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:08.021847 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-039cb172-6442-4a4a-b289-634e436de899 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:08.022383 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-039cb172-6442-4a4a-b289-634e436de899 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:08.022822 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-039cb172-6442-4a4a-b289-634e436de899 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:08.023534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-039cb172-6442-4a4a-b289-634e436de899 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:08.023996 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-039cb172-6442-4a4a-b289-634e436de899 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:08.024424 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-039cb172-6442-4a4a-b289-634e436de899 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:08.543842 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-039cb172-6442-4a4a-b289-634e436de899 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:08.557589 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-039cb172-6442-4a4a-b289-634e436de899 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1473 microversion: 2.1 time: 0.567289 Aug 04 16:56:08.558522 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 231/452] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:07 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1473 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:08.563274 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-94d0f179-821a-47cf-8c9c-0d1f78ea6278 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:08.563882 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-94d0f179-821a-47cf-8c9c-0d1f78ea6278 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: 2b1b8878-8ab2-4792-904f-dae80363ee37] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:08.570012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94d0f179-821a-47cf-8c9c-0d1f78ea6278 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:08.570719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94d0f179-821a-47cf-8c9c-0d1f78ea6278 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:08.571324 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94d0f179-821a-47cf-8c9c-0d1f78ea6278 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:08.572699 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94d0f179-821a-47cf-8c9c-0d1f78ea6278 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:08.573309 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94d0f179-821a-47cf-8c9c-0d1f78ea6278 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:08.573884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94d0f179-821a-47cf-8c9c-0d1f78ea6278 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:08.895982 n-d-851359-3 devstack@n-api.service[131044]: DEBUG neutronclient.v2_0.client [None req-854466ba-a6d8-43f8-922d-31a212b071c4 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.9.172 (4d28f69c-d976-4907-ac3d-66320556c29a) with port 7c10a7ae-46ce-40dd-b73d-1e6d2b434cee using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network aa834c21-a026-461a-926c-9c43b1a51a9c.", "detail": ""}} {{(pid=131044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:56:08.896872 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-854466ba-a6d8-43f8-922d-31a212b071c4 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Releasing lock "refresh_cache-eb10c53c-59c3-4239-97c5-c898c9f9ca89" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 04 16:56:08.897750 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-854466ba-a6d8-43f8-922d-31a212b071c4 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] HTTP exception thrown: Cannot associate floating IP 172.25.9.172 (4d28f69c-d976-4907-ac3d-66320556c29a) with port 7c10a7ae-46ce-40dd-b73d-1e6d2b434cee using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network aa834c21-a026-461a-926c-9c43b1a51a9c. Aug 04 16:56:08.897750 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-2fa2a0a3-5d32-41d0-a045-6494f9a0a9a9'] Aug 04 16:56:08.907502 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-854466ba-a6d8-43f8-922d-31a212b071c4 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Request method failure captured: Aug 04 16:56:08.907502 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89/action HTTP/1.1 Aug 04 16:56:08.907502 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:56:08.907502 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:56:08.907502 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:56:08.907502 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 46 Aug 04 16:56:08.907502 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:56:08.907502 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:56:08.907502 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:56:08.907502 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:08.907502 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_oEMqMT7qr76Z4RtbhpvbPrrjmzm899mOZDakfyONmuOK5oIqtTz-3wClndCr7uGgn8TIDFjY-ogMsCNaEU0di-g6TyEvvUs-lZyqrRWVD0H__km7kGTIjRZPuW0nO46SmbrSlrP6tb8d8RjNTLa4t5HmvZI202M0v06Cs40foeqfE Aug 04 16:56:08.907502 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:56:08.907502 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:56:08.907502 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:56:08.907502 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:56:08.907502 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:56:08.907502 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:56:08.907502 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 3f3e5530401f4a87a038b3d30679a74e Aug 04 16:56:08.907502 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-146158996 Aug 04 16:56:08.907502 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:56:08.907502 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:56:08.909114 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3f3e5530401f4a87a038b3d30679a74e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3f3e5530401f4a87a038b3d30679a74e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3f3e5530401f4a87a038b3d30679a74e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3f3e5530401f4a87a038b3d30679a74e"}]}] Aug 04 16:56:08.909114 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-146158996 Aug 04 16:56:08.909114 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 3f3e5530401f4a87a038b3d30679a74e Aug 04 16:56:08.909114 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-146158996 Aug 04 16:56:08.909114 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project Aug 04 16:56:08.909114 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:56:08.909114 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:56:08.909114 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 48eddfe7e2c347fcbc122b4f6fb89076 Aug 04 16:56:08.909114 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project Aug 04 16:56:08.909114 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 16:56:08.909114 n-d-851359-3 devstack@n-api.service[131044]: {"addFloatingIp": {"address": "172.25.9.172"}} Aug 04 16:56:08.909114 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:56:08.910008 n-d-851359-3 devstack@n-api.service[131044]: exception: Cannot associate floating IP 172.25.9.172 (4d28f69c-d976-4907-ac3d-66320556c29a) with port 7c10a7ae-46ce-40dd-b73d-1e6d2b434cee using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network aa834c21-a026-461a-926c-9c43b1a51a9c. Aug 04 16:56:08.910008 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-2fa2a0a3-5d32-41d0-a045-6494f9a0a9a9'] Aug 04 16:56:08.910008 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'eb10c53c-59c3-4239-97c5-c898c9f9ca89', 'body': {'addFloatingIp': {'address': '172.25.9.172'}}} Aug 04 16:56:08.910008 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:08.910008 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:08.910008 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Aug 04 16:56:08.910008 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 04 16:56:08.910008 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:56:08.910008 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:56:08.910008 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 04 16:56:08.910008 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 04 16:56:08.910008 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:56:08.910008 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:56:08.910008 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 04 16:56:08.910008 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 04 16:56:08.910008 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:56:08.910008 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:56:08.911181 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 04 16:56:08.911181 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 04 16:56:08.911181 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:56:08.911181 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:56:08.911181 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:56:08.911181 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:56:08.911181 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:56:08.911181 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:56:08.911181 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:56:08.911181 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:56:08.911181 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:56:08.911181 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:56:08.911181 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:56:08.911181 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:56:08.911181 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:56:08.911181 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:56:08.912258 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.9.172 (4d28f69c-d976-4907-ac3d-66320556c29a) with port 7c10a7ae-46ce-40dd-b73d-1e6d2b434cee using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network aa834c21-a026-461a-926c-9c43b1a51a9c. Aug 04 16:56:08.912258 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2fa2a0a3-5d32-41d0-a045-6494f9a0a9a9'] Aug 04 16:56:08.912258 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:08.912258 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:08.912258 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:08.912258 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:08.912258 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 04 16:56:08.912258 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 04 16:56:08.912258 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 04 16:56:08.912258 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 04 16:56:08.912258 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Aug 04 16:56:08.912258 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 04 16:56:08.912258 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.9.172 (4d28f69c-d976-4907-ac3d-66320556c29a) with port 7c10a7ae-46ce-40dd-b73d-1e6d2b434cee using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network aa834c21-a026-461a-926c-9c43b1a51a9c. Aug 04 16:56:08.912258 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2fa2a0a3-5d32-41d0-a045-6494f9a0a9a9'] Aug 04 16:56:08.912258 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:08.912258 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:08.913487 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:08.913487 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:08.913487 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:08.913487 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:08.913487 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:08.913487 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:08.913487 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:56:08.913487 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:56:08.913487 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:08.913487 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:08.913487 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:56:08.913487 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:56:08.913487 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 04 16:56:08.913487 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 16:56:08.913487 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.9.172 (4d28f69c-d976-4907-ac3d-66320556c29a) with port 7c10a7ae-46ce-40dd-b73d-1e6d2b434cee using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network aa834c21-a026-461a-926c-9c43b1a51a9c. Aug 04 16:56:08.913487 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2fa2a0a3-5d32-41d0-a045-6494f9a0a9a9'] Aug 04 16:56:08.913487 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:08.913487 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:08.915329 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:08.915329 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:08.915329 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:08.915329 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:08.915329 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:56:08.915329 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:56:08.915329 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.9.172 (4d28f69c-d976-4907-ac3d-66320556c29a) with port 7c10a7ae-46ce-40dd-b73d-1e6d2b434cee using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network aa834c21-a026-461a-926c-9c43b1a51a9c. Aug 04 16:56:08.915329 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2fa2a0a3-5d32-41d0-a045-6494f9a0a9a9'] Aug 04 16:56:08.915329 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:08.916398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-854466ba-a6d8-43f8-922d-31a212b071c4 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Returning 400 to user: Cannot associate floating IP 172.25.9.172 (4d28f69c-d976-4907-ac3d-66320556c29a) with port 7c10a7ae-46ce-40dd-b73d-1e6d2b434cee using fixed IP 172.20.0.10, as that fixed IP already has a floating IP on external network aa834c21-a026-461a-926c-9c43b1a51a9c. Aug 04 16:56:08.916398 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-2fa2a0a3-5d32-41d0-a045-6494f9a0a9a9'] {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:08.917541 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-854466ba-a6d8-43f8-922d-31a212b071c4 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] 10.222.0.93 "POST /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89/action" status: 400 len: 382 microversion: 2.1 time: 1.269032 Aug 04 16:56:08.918522 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 222/453] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:56:07 2022] POST /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89/action => generated 382 bytes in 1283 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:56:08.924047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-17bfbf82-29ee-49d4-a858-d16955500400 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:08.924978 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-17bfbf82-29ee-49d4-a858-d16955500400 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: 9d66fc68-229a-4ec3-8c6a-af43a20d2462] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:08.932507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17bfbf82-29ee-49d4-a858-d16955500400 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:08.933380 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17bfbf82-29ee-49d4-a858-d16955500400 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:08.934014 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17bfbf82-29ee-49d4-a858-d16955500400 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:08.934948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17bfbf82-29ee-49d4-a858-d16955500400 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:08.935476 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17bfbf82-29ee-49d4-a858-d16955500400 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:08.935975 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17bfbf82-29ee-49d4-a858-d16955500400 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:09.020102 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-17bfbf82-29ee-49d4-a858-d16955500400 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12efa078aa84861925925314ef00aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ed72eca39e4bab83ccbba779ac37c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:09.021338 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-94d0f179-821a-47cf-8c9c-0d1f78ea6278 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712723e5418441c096f008d1520f6dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8c7c49e56743dd9f64102e53c2bec7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:09.028814 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-94d0f179-821a-47cf-8c9c-0d1f78ea6278 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "GET /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37" status: 200 len: 1319 microversion: 2.1 time: 0.469063 Aug 04 16:56:09.035563 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 232/454] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:08 2022] GET /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37 => generated 1319 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:09.038923 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-17bfbf82-29ee-49d4-a858-d16955500400 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462" status: 200 len: 1277 microversion: 2.1 time: 0.119407 Aug 04 16:56:09.040976 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7b08bf5a-0310-4c33-bd48-32a955103979 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:09.041773 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7b08bf5a-0310-4c33-bd48-32a955103979 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 37140c09-31fd-4233-9ab9-6351044c5864] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:09.054017 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 223/455] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:08 2022] GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462 => generated 1277 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:09.054017 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dfe84601-3ae6-456f-9c2f-0c961fde82dd tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Calling method '.version_select at 0x7f1e5bc0d940>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:09.061309 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b08bf5a-0310-4c33-bd48-32a955103979 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:09.061813 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b08bf5a-0310-4c33-bd48-32a955103979 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:09.062330 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b08bf5a-0310-4c33-bd48-32a955103979 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:09.063076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b08bf5a-0310-4c33-bd48-32a955103979 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:09.063536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b08bf5a-0310-4c33-bd48-32a955103979 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:09.063966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b08bf5a-0310-4c33-bd48-32a955103979 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:09.372544 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7b08bf5a-0310-4c33-bd48-32a955103979 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:09.380780 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7b08bf5a-0310-4c33-bd48-32a955103979 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864" status: 200 len: 1495 microversion: 2.1 time: 0.346445 Aug 04 16:56:09.381785 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 233/456] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:09 2022] GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864 => generated 1495 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:09.386982 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0d439413-48cd-4574-b849-d97aa5678d83 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:09.394091 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0d439413-48cd-4574-b849-d97aa5678d83 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:09.400996 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d439413-48cd-4574-b849-d97aa5678d83 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:09.401717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d439413-48cd-4574-b849-d97aa5678d83 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:09.402614 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d439413-48cd-4574-b849-d97aa5678d83 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:09.404505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d439413-48cd-4574-b849-d97aa5678d83 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:09.405162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d439413-48cd-4574-b849-d97aa5678d83 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:09.405781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d439413-48cd-4574-b849-d97aa5678d83 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:09.760272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0d439413-48cd-4574-b849-d97aa5678d83 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:09.776164 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0d439413-48cd-4574-b849-d97aa5678d83 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:09.777833 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0d439413-48cd-4574-b849-d97aa5678d83 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:09.787806 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0d439413-48cd-4574-b849-d97aa5678d83 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1447 microversion: 2.75 time: 0.404691 Aug 04 16:56:09.789311 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 234/457] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:09 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1447 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:09.804100 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2bf6e947-a163-45f1-a599-2b98285bde75 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Calling method '.version_select at 0x7f1e5bd6a430>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:09.813839 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2bf6e947-a163-45f1-a599-2b98285bde75 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:09.814484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2bf6e947-a163-45f1-a599-2b98285bde75 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:09.815148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2bf6e947-a163-45f1-a599-2b98285bde75 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:09.836010 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2bf6e947-a163-45f1-a599-2b98285bde75 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] 10.222.0.93 "GET /compute/v2.1/os-migrations" status: 200 len: 796 microversion: 2.1 time: 0.045228 Aug 04 16:56:09.837294 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 235/458] 10.222.0.93 () {58 vars in 1143 bytes} [Thu Aug 4 16:56:09 2022] GET /compute/v2.1/os-migrations => generated 796 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:09.856704 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-25884542-e3e5-49af-8458-176cd5696233 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:09.858127 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-25884542-e3e5-49af-8458-176cd5696233 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:09.868135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25884542-e3e5-49af-8458-176cd5696233 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:09.869642 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25884542-e3e5-49af-8458-176cd5696233 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:09.870377 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25884542-e3e5-49af-8458-176cd5696233 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:09.871328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25884542-e3e5-49af-8458-176cd5696233 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:09.872375 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25884542-e3e5-49af-8458-176cd5696233 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:09.873031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25884542-e3e5-49af-8458-176cd5696233 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:10.273807 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-25884542-e3e5-49af-8458-176cd5696233 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:10.282724 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-25884542-e3e5-49af-8458-176cd5696233 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1473 microversion: 2.1 time: 0.443928 Aug 04 16:56:10.297624 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 236/459] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:09 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1473 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:10.302578 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2cd08a11-ecb9-458e-a9e0-0eefc2fd5d4e tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:10.303191 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2cd08a11-ecb9-458e-a9e0-0eefc2fd5d4e tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] [instance: 37140c09-31fd-4233-9ab9-6351044c5864] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:10.309905 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2cd08a11-ecb9-458e-a9e0-0eefc2fd5d4e tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:10.310411 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2cd08a11-ecb9-458e-a9e0-0eefc2fd5d4e tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:10.310848 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2cd08a11-ecb9-458e-a9e0-0eefc2fd5d4e tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:10.311637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2cd08a11-ecb9-458e-a9e0-0eefc2fd5d4e tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:10.312018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2cd08a11-ecb9-458e-a9e0-0eefc2fd5d4e tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:10.312448 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2cd08a11-ecb9-458e-a9e0-0eefc2fd5d4e tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:10.628953 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2cd08a11-ecb9-458e-a9e0-0eefc2fd5d4e tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864" status: 200 len: 1646 microversion: 2.1 time: 0.330087 Aug 04 16:56:10.629529 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 237/460] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:10 2022] GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864 => generated 1646 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:10.649303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4de7223d-eeff-4915-8660-372bc5f78744 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:10.650583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4de7223d-eeff-4915-8660-372bc5f78744 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: 2b1b8878-8ab2-4792-904f-dae80363ee37] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:10.658926 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4de7223d-eeff-4915-8660-372bc5f78744 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:10.659911 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4de7223d-eeff-4915-8660-372bc5f78744 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:10.660587 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4de7223d-eeff-4915-8660-372bc5f78744 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:10.661876 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4de7223d-eeff-4915-8660-372bc5f78744 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:10.662632 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4de7223d-eeff-4915-8660-372bc5f78744 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:10.663321 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4de7223d-eeff-4915-8660-372bc5f78744 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:10.894363 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dfe84601-3ae6-456f-9c2f-0c961fde82dd tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/4d28f69c-d976-4907-ac3d-66320556c29a" status: 202 len: 0 microversion: 2.1 time: 1.849980 Aug 04 16:56:10.898526 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 224/461] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Aug 4 16:56:09 2022] DELETE /compute/v2.1/os-floating-ips/4d28f69c-d976-4907-ac3d-66320556c29a => generated 0 bytes in 1852 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:56:10.900989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-209189a5-e72c-443b-a78b-fa7b2ba8df76 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:10.908171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-209189a5-e72c-443b-a78b-fa7b2ba8df76 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: 9d66fc68-229a-4ec3-8c6a-af43a20d2462] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:10.916411 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-209189a5-e72c-443b-a78b-fa7b2ba8df76 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:10.916907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-209189a5-e72c-443b-a78b-fa7b2ba8df76 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:10.917352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-209189a5-e72c-443b-a78b-fa7b2ba8df76 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:10.918102 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-209189a5-e72c-443b-a78b-fa7b2ba8df76 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:10.918569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-209189a5-e72c-443b-a78b-fa7b2ba8df76 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:10.919000 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-209189a5-e72c-443b-a78b-fa7b2ba8df76 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:10.940771 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4de7223d-eeff-4915-8660-372bc5f78744 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712723e5418441c096f008d1520f6dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8c7c49e56743dd9f64102e53c2bec7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:10.951213 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4de7223d-eeff-4915-8660-372bc5f78744 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "GET /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37" status: 200 len: 1319 microversion: 2.1 time: 0.320282 Aug 04 16:56:10.952065 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 238/462] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:10 2022] GET /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37 => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:10.957153 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-330e5d11-b590-479f-9824-f760c61a3a7a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1084833805", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "a29c24ff-4240-47ba-a31d-3bb350182580"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:10.992866 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-209189a5-e72c-443b-a78b-fa7b2ba8df76 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12efa078aa84861925925314ef00aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ed72eca39e4bab83ccbba779ac37c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:11.003002 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-209189a5-e72c-443b-a78b-fa7b2ba8df76 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462" status: 200 len: 1277 microversion: 2.1 time: 0.106915 Aug 04 16:56:11.010214 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 225/463] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:10 2022] GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462 => generated 1277 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:11.016808 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3b88bdf4-79bd-42c3-879a-586bbb6da9e4 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:11.017685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3b88bdf4-79bd-42c3-879a-586bbb6da9e4 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:11.025373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b88bdf4-79bd-42c3-879a-586bbb6da9e4 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:11.026109 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b88bdf4-79bd-42c3-879a-586bbb6da9e4 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:11.026723 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b88bdf4-79bd-42c3-879a-586bbb6da9e4 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:11.028184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b88bdf4-79bd-42c3-879a-586bbb6da9e4 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:11.029100 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b88bdf4-79bd-42c3-879a-586bbb6da9e4 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:11.029682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b88bdf4-79bd-42c3-879a-586bbb6da9e4 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:11.039893 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-330e5d11-b590-479f-9824-f760c61a3a7a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] validate_networks() for [('a29c24ff-4240-47ba-a31d-3bb350182580', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:56:11.142270 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3b88bdf4-79bd-42c3-879a-586bbb6da9e4 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:11.151108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3b88bdf4-79bd-42c3-879a-586bbb6da9e4 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:11.152621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3b88bdf4-79bd-42c3-879a-586bbb6da9e4 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:11.158071 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3b88bdf4-79bd-42c3-879a-586bbb6da9e4 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1447 microversion: 2.75 time: 0.145996 Aug 04 16:56:11.158649 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 226/464] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:11 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1447 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:11.163558 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8ae0aa06-0137-40ad-b4c6-b3da8008bedd tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Action: 'action', calling method: .version_select at 0x7f1e6a4d0ca0>, body: {"removeFloatingIp": {"address": "172.25.9.127"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:11.383250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8ae0aa06-0137-40ad-b4c6-b3da8008bedd tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] [instance: eb10c53c-59c3-4239-97c5-c898c9f9ca89] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:11.392459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ae0aa06-0137-40ad-b4c6-b3da8008bedd tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:11.393283 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ae0aa06-0137-40ad-b4c6-b3da8008bedd tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:11.394521 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ae0aa06-0137-40ad-b4c6-b3da8008bedd tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:11.395927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ae0aa06-0137-40ad-b4c6-b3da8008bedd tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:11.396632 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ae0aa06-0137-40ad-b4c6-b3da8008bedd tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:11.397317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ae0aa06-0137-40ad-b4c6-b3da8008bedd tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:11.870677 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-330e5d11-b590-479f-9824-f760c61a3a7a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:56:11.871674 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-330e5d11-b590-479f-9824-f760c61a3a7a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:56:11.872493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-330e5d11-b590-479f-9824-f760c61a3a7a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:56:11.873815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-330e5d11-b590-479f-9824-f760c61a3a7a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:56:11.874487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-330e5d11-b590-479f-9824-f760c61a3a7a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:56:11.885612 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-330e5d11-b590-479f-9824-f760c61a3a7a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:11.886490 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-330e5d11-b590-479f-9824-f760c61a3a7a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:11.887152 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-330e5d11-b590-479f-9824-f760c61a3a7a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:11.888436 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-330e5d11-b590-479f-9824-f760c61a3a7a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:11.889125 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-330e5d11-b590-479f-9824-f760c61a3a7a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:11.889796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-330e5d11-b590-479f-9824-f760c61a3a7a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:11.913025 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-330e5d11-b590-479f-9824-f760c61a3a7a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Getting quotas for project 792f078eb62f4820ba4166d421079491. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:56:11.920080 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-330e5d11-b590-479f-9824-f760c61a3a7a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Getting quotas for user 81d93fe83a6542c89cbc86106671b15f and project 792f078eb62f4820ba4166d421079491. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:56:11.934131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-330e5d11-b590-479f-9824-f760c61a3a7a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:56:11.936976 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-330e5d11-b590-479f-9824-f760c61a3a7a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:56:12.012313 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-330e5d11-b590-479f-9824-f760c61a3a7a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.058802 Aug 04 16:56:12.024834 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 239/465] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:56:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:56:12.048810 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c5e93d17-50e8-4b7b-a17f-9216174379ef tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:12.054726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c5e93d17-50e8-4b7b-a17f-9216174379ef tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:12.081417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c5e93d17-50e8-4b7b-a17f-9216174379ef tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:12.082463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c5e93d17-50e8-4b7b-a17f-9216174379ef tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:12.096976 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c5e93d17-50e8-4b7b-a17f-9216174379ef tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:12.098012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c5e93d17-50e8-4b7b-a17f-9216174379ef tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:12.106801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c5e93d17-50e8-4b7b-a17f-9216174379ef tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:12.108311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c5e93d17-50e8-4b7b-a17f-9216174379ef tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:12.541146 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ae0aa06-0137-40ad-b4c6-b3da8008bedd tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "refresh_cache-eb10c53c-59c3-4239-97c5-c898c9f9ca89" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 04 16:56:12.541649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ae0aa06-0137-40ad-b4c6-b3da8008bedd tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquired lock "refresh_cache-eb10c53c-59c3-4239-97c5-c898c9f9ca89" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 04 16:56:12.646407 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c5e93d17-50e8-4b7b-a17f-9216174379ef tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:12.670437 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c5e93d17-50e8-4b7b-a17f-9216174379ef tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1470 microversion: 2.1 time: 0.634385 Aug 04 16:56:12.675644 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 240/466] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:12 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1470 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:12.686240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-71ff28e4-80ad-47d6-b6df-80fdfd784f06 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:12.687308 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-71ff28e4-80ad-47d6-b6df-80fdfd784f06 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: 2b1b8878-8ab2-4792-904f-dae80363ee37] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:12.695494 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71ff28e4-80ad-47d6-b6df-80fdfd784f06 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:12.695989 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71ff28e4-80ad-47d6-b6df-80fdfd784f06 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:12.696803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71ff28e4-80ad-47d6-b6df-80fdfd784f06 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:12.697910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71ff28e4-80ad-47d6-b6df-80fdfd784f06 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:12.698804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71ff28e4-80ad-47d6-b6df-80fdfd784f06 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:12.699602 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71ff28e4-80ad-47d6-b6df-80fdfd784f06 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:13.023679 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-71ff28e4-80ad-47d6-b6df-80fdfd784f06 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712723e5418441c096f008d1520f6dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8c7c49e56743dd9f64102e53c2bec7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:13.035517 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-71ff28e4-80ad-47d6-b6df-80fdfd784f06 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "GET /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37" status: 200 len: 1319 microversion: 2.1 time: 0.358545 Aug 04 16:56:13.038322 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 241/467] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:12 2022] GET /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37 => generated 1319 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:13.056521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b88e97f9-2b4d-4ea9-a79c-284c1e23a2e4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:13.063234 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b88e97f9-2b4d-4ea9-a79c-284c1e23a2e4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:13.080590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b88e97f9-2b4d-4ea9-a79c-284c1e23a2e4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:13.081275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b88e97f9-2b4d-4ea9-a79c-284c1e23a2e4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:13.084232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b88e97f9-2b4d-4ea9-a79c-284c1e23a2e4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:13.085442 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b88e97f9-2b4d-4ea9-a79c-284c1e23a2e4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:13.086244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b88e97f9-2b4d-4ea9-a79c-284c1e23a2e4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:13.086835 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b88e97f9-2b4d-4ea9-a79c-284c1e23a2e4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:13.120356 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:13.286274 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b88e97f9-2b4d-4ea9-a79c-284c1e23a2e4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:13.295653 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b88e97f9-2b4d-4ea9-a79c-284c1e23a2e4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989" status: 200 len: 1263 microversion: 2.1 time: 0.254710 Aug 04 16:56:13.298040 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 242/468] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:13 2022] GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989 => generated 1263 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:13.313269 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-01df4c9a-cd40-4a42-8954-a5633709d8f7 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:13.317694 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-01df4c9a-cd40-4a42-8954-a5633709d8f7 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: 9d66fc68-229a-4ec3-8c6a-af43a20d2462] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:13.324984 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01df4c9a-cd40-4a42-8954-a5633709d8f7 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:13.325566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01df4c9a-cd40-4a42-8954-a5633709d8f7 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:13.326215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01df4c9a-cd40-4a42-8954-a5633709d8f7 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:13.326985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01df4c9a-cd40-4a42-8954-a5633709d8f7 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:13.327892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01df4c9a-cd40-4a42-8954-a5633709d8f7 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:13.328559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01df4c9a-cd40-4a42-8954-a5633709d8f7 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:13.948200 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-01df4c9a-cd40-4a42-8954-a5633709d8f7 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12efa078aa84861925925314ef00aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ed72eca39e4bab83ccbba779ac37c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:13.958473 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-01df4c9a-cd40-4a42-8954-a5633709d8f7 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462" status: 200 len: 1319 microversion: 2.1 time: 0.656357 Aug 04 16:56:13.971498 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 243/469] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:13 2022] GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462 => generated 1319 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:13.976797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-d09f8c5c-aee8-43a4-bb73-d332085fffb7 req-3cd25e30-4b20-4afb-895b-766e27f2e65c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b1b8878-8ab2-4792-904f-dae80363ee37", "name": "network-vif-plugged", "status": "completed", "tag": "f14cc87b-6de7-4609-9c0c-01ed874b29b1"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:13.987714 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d09f8c5c-aee8-43a4-bb73-d332085fffb7 req-3cd25e30-4b20-4afb-895b-766e27f2e65c service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:13.988445 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d09f8c5c-aee8-43a4-bb73-d332085fffb7 req-3cd25e30-4b20-4afb-895b-766e27f2e65c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:13.989084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d09f8c5c-aee8-43a4-bb73-d332085fffb7 req-3cd25e30-4b20-4afb-895b-766e27f2e65c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:14.011029 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-d09f8c5c-aee8-43a4-bb73-d332085fffb7 req-3cd25e30-4b20-4afb-895b-766e27f2e65c service nova] Creating event network-vif-plugged:f14cc87b-6de7-4609-9c0c-01ed874b29b1 for instance 2b1b8878-8ab2-4792-904f-dae80363ee37 on n-h1-851359-3 Aug 04 16:56:14.017688 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-d09f8c5c-aee8-43a4-bb73-d332085fffb7 req-3cd25e30-4b20-4afb-895b-766e27f2e65c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044573 Aug 04 16:56:14.018993 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 244/470] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:14.024811 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-651338b2-9652-4b78-a8f0-cb68798dcf36 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:14.025644 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-651338b2-9652-4b78-a8f0-cb68798dcf36 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:14.032334 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-651338b2-9652-4b78-a8f0-cb68798dcf36 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:14.032857 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-651338b2-9652-4b78-a8f0-cb68798dcf36 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:14.033492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-651338b2-9652-4b78-a8f0-cb68798dcf36 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:14.034258 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-651338b2-9652-4b78-a8f0-cb68798dcf36 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:14.034717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-651338b2-9652-4b78-a8f0-cb68798dcf36 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:14.035178 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-651338b2-9652-4b78-a8f0-cb68798dcf36 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:14.207206 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-651338b2-9652-4b78-a8f0-cb68798dcf36 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:14.232565 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-651338b2-9652-4b78-a8f0-cb68798dcf36 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:14.234781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-651338b2-9652-4b78-a8f0-cb68798dcf36 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:14.249207 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-651338b2-9652-4b78-a8f0-cb68798dcf36 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1447 microversion: 2.75 time: 0.228802 Aug 04 16:56:14.251001 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 245/471] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:14 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1447 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:14.259098 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6e428256-f609-4a27-8f40-9554e0416058 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:14.259819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6e428256-f609-4a27-8f40-9554e0416058 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:14.267985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6e428256-f609-4a27-8f40-9554e0416058 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:14.269116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6e428256-f609-4a27-8f40-9554e0416058 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:14.269886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6e428256-f609-4a27-8f40-9554e0416058 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:14.271077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6e428256-f609-4a27-8f40-9554e0416058 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:14.271750 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6e428256-f609-4a27-8f40-9554e0416058 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:14.272333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6e428256-f609-4a27-8f40-9554e0416058 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:14.358988 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6e428256-f609-4a27-8f40-9554e0416058 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "POST /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979/action" status: 204 len: 0 microversion: 2.1 time: 0.104912 Aug 04 16:56:14.360483 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 246/472] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:56:14 2022] POST /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979/action => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:56:14.394688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a6632f1f-ff33-4004-85ca-ef7dc95bbf30 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:14.395323 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a6632f1f-ff33-4004-85ca-ef7dc95bbf30 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: 2b1b8878-8ab2-4792-904f-dae80363ee37] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:14.405626 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6632f1f-ff33-4004-85ca-ef7dc95bbf30 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:14.406213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6632f1f-ff33-4004-85ca-ef7dc95bbf30 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:14.406665 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6632f1f-ff33-4004-85ca-ef7dc95bbf30 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:14.408825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6632f1f-ff33-4004-85ca-ef7dc95bbf30 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:14.409800 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6632f1f-ff33-4004-85ca-ef7dc95bbf30 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:14.410491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6632f1f-ff33-4004-85ca-ef7dc95bbf30 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:14.854552 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-8ae0aa06-0137-40ad-b4c6-b3da8008bedd tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] [instance: eb10c53c-59c3-4239-97c5-c898c9f9ca89] Building network info cache for instance {{(pid=131044) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 16:56:14.857301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:14.870609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a6632f1f-ff33-4004-85ca-ef7dc95bbf30 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712723e5418441c096f008d1520f6dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8c7c49e56743dd9f64102e53c2bec7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:14.880742 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a6632f1f-ff33-4004-85ca-ef7dc95bbf30 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "GET /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37" status: 200 len: 1319 microversion: 2.1 time: 0.518271 Aug 04 16:56:14.884145 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 247/473] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:14 2022] GET /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37 => generated 1319 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:14.902589 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-34ccff1f-a7b5-4568-975a-5248ecb6f5df req-9fef622a-4346-443e-a7ae-d612fd477404 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d66fc68-229a-4ec3-8c6a-af43a20d2462", "tag": "8efedb88-926c-4bea-a1ea-6a41752b45e9"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:14.919394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-34ccff1f-a7b5-4568-975a-5248ecb6f5df req-9fef622a-4346-443e-a7ae-d612fd477404 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:14.920046 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-34ccff1f-a7b5-4568-975a-5248ecb6f5df req-9fef622a-4346-443e-a7ae-d612fd477404 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:14.921667 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-34ccff1f-a7b5-4568-975a-5248ecb6f5df req-9fef622a-4346-443e-a7ae-d612fd477404 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:14.952653 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-34ccff1f-a7b5-4568-975a-5248ecb6f5df req-9fef622a-4346-443e-a7ae-d612fd477404 service nova] Creating event network-changed:8efedb88-926c-4bea-a1ea-6a41752b45e9 for instance 9d66fc68-229a-4ec3-8c6a-af43a20d2462 on n-h2-851359-3 Aug 04 16:56:14.965379 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-34ccff1f-a7b5-4568-975a-5248ecb6f5df req-9fef622a-4346-443e-a7ae-d612fd477404 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079190 Aug 04 16:56:14.968896 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 248/474] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:14.978084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1436be1f-0ede-486e-9dda-c829814f20c4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:14.979164 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1436be1f-0ede-486e-9dda-c829814f20c4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:14.987416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1436be1f-0ede-486e-9dda-c829814f20c4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:14.988447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1436be1f-0ede-486e-9dda-c829814f20c4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:14.989215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1436be1f-0ede-486e-9dda-c829814f20c4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:14.990087 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1436be1f-0ede-486e-9dda-c829814f20c4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:14.990671 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1436be1f-0ede-486e-9dda-c829814f20c4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:14.991196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1436be1f-0ede-486e-9dda-c829814f20c4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:15.360817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1436be1f-0ede-486e-9dda-c829814f20c4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:15.368834 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1436be1f-0ede-486e-9dda-c829814f20c4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989" status: 200 len: 1269 microversion: 2.1 time: 0.397761 Aug 04 16:56:15.382522 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 249/475] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:14 2022] GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989 => generated 1269 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:15.388550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4e76669f-b62b-4a0d-a2fc-4c0423797aac tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:15.389180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4e76669f-b62b-4a0d-a2fc-4c0423797aac tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:15.396056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e76669f-b62b-4a0d-a2fc-4c0423797aac tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:15.396419 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e76669f-b62b-4a0d-a2fc-4c0423797aac tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:15.396861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e76669f-b62b-4a0d-a2fc-4c0423797aac tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:15.397565 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e76669f-b62b-4a0d-a2fc-4c0423797aac tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:15.398252 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e76669f-b62b-4a0d-a2fc-4c0423797aac tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:15.398681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e76669f-b62b-4a0d-a2fc-4c0423797aac tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:15.864836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4e76669f-b62b-4a0d-a2fc-4c0423797aac tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:15.883984 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4e76669f-b62b-4a0d-a2fc-4c0423797aac tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1470 microversion: 2.1 time: 0.500192 Aug 04 16:56:15.884580 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 250/476] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:15 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1470 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:15.901593 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-8381a328-132d-4887-8305-665f143a9611 req-70369c5f-26b5-42a2-b20a-d2e2a8c995e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb10c53c-59c3-4239-97c5-c898c9f9ca89", "tag": "7c10a7ae-46ce-40dd-b73d-1e6d2b434cee"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:15.928715 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8381a328-132d-4887-8305-665f143a9611 req-70369c5f-26b5-42a2-b20a-d2e2a8c995e5 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:15.929484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8381a328-132d-4887-8305-665f143a9611 req-70369c5f-26b5-42a2-b20a-d2e2a8c995e5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:15.933411 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8381a328-132d-4887-8305-665f143a9611 req-70369c5f-26b5-42a2-b20a-d2e2a8c995e5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:15.952385 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-8381a328-132d-4887-8305-665f143a9611 req-70369c5f-26b5-42a2-b20a-d2e2a8c995e5 service nova] Creating event network-changed:7c10a7ae-46ce-40dd-b73d-1e6d2b434cee for instance eb10c53c-59c3-4239-97c5-c898c9f9ca89 on n-h1-851359-3 Aug 04 16:56:15.965365 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-8381a328-132d-4887-8305-665f143a9611 req-70369c5f-26b5-42a2-b20a-d2e2a8c995e5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072068 Aug 04 16:56:15.966657 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 251/477] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:15.979101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f5d13162-6bc8-426e-95e4-5f62231fddeb tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:15.980012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f5d13162-6bc8-426e-95e4-5f62231fddeb tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: 9d66fc68-229a-4ec3-8c6a-af43a20d2462] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:15.990110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5d13162-6bc8-426e-95e4-5f62231fddeb tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:15.993390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5d13162-6bc8-426e-95e4-5f62231fddeb tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:15.994125 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5d13162-6bc8-426e-95e4-5f62231fddeb tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:15.994877 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5d13162-6bc8-426e-95e4-5f62231fddeb tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:15.997179 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5d13162-6bc8-426e-95e4-5f62231fddeb tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:16.012343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5d13162-6bc8-426e-95e4-5f62231fddeb tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:16.074414 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:16.095940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:16.652013 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f5d13162-6bc8-426e-95e4-5f62231fddeb tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12efa078aa84861925925314ef00aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ed72eca39e4bab83ccbba779ac37c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:16.663489 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f5d13162-6bc8-426e-95e4-5f62231fddeb tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462" status: 200 len: 1319 microversion: 2.1 time: 0.695434 Aug 04 16:56:16.664072 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 252/478] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:15 2022] GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462 => generated 1319 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:16.669680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-24338150-e613-4218-90a2-88812a27c76d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:16.670924 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-24338150-e613-4218-90a2-88812a27c76d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:16.677275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-24338150-e613-4218-90a2-88812a27c76d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:16.677775 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-24338150-e613-4218-90a2-88812a27c76d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:16.678830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-24338150-e613-4218-90a2-88812a27c76d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:16.679544 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-24338150-e613-4218-90a2-88812a27c76d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:16.680012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-24338150-e613-4218-90a2-88812a27c76d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:16.680441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-24338150-e613-4218-90a2-88812a27c76d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:16.844267 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-24338150-e613-4218-90a2-88812a27c76d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:16.852829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-24338150-e613-4218-90a2-88812a27c76d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:16.855231 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-24338150-e613-4218-90a2-88812a27c76d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:16.859665 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-24338150-e613-4218-90a2-88812a27c76d tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1447 microversion: 2.75 time: 0.193748 Aug 04 16:56:16.860555 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 253/479] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:16 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1447 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:16.865777 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-55a72990-e2bb-4253-bbcc-2cfc70d4c1b9 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:16.866799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-55a72990-e2bb-4253-bbcc-2cfc70d4c1b9 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: 2b1b8878-8ab2-4792-904f-dae80363ee37] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:16.875965 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:16.887070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-55a72990-e2bb-4253-bbcc-2cfc70d4c1b9 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:16.888255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-55a72990-e2bb-4253-bbcc-2cfc70d4c1b9 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:16.890594 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-55a72990-e2bb-4253-bbcc-2cfc70d4c1b9 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:16.892372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-55a72990-e2bb-4253-bbcc-2cfc70d4c1b9 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:16.899104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-55a72990-e2bb-4253-bbcc-2cfc70d4c1b9 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:16.900218 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-55a72990-e2bb-4253-bbcc-2cfc70d4c1b9 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:17.204966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-8ae0aa06-0137-40ad-b4c6-b3da8008bedd tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] [instance: eb10c53c-59c3-4239-97c5-c898c9f9ca89] Updating instance_info_cache with network_info: [{"id": "7c10a7ae-46ce-40dd-b73d-1e6d2b434cee", "address": "fa:16:3e:b5:fc:4d", "network": {"id": "4f601fe3-086d-4166-a668-9b13ff766838", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1712798257-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3f3e5530401f4a87a038b3d30679a74e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7c10a7ae-46", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131044) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 16:56:17.219531 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ae0aa06-0137-40ad-b4c6-b3da8008bedd tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Releasing lock "refresh_cache-eb10c53c-59c3-4239-97c5-c898c9f9ca89" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 04 16:56:17.221146 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8ae0aa06-0137-40ad-b4c6-b3da8008bedd tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] 10.222.0.93 "POST /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89/action" status: 202 len: 0 microversion: 2.1 time: 6.061376 Aug 04 16:56:17.221755 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 227/480] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:56:11 2022] POST /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89/action => generated 0 bytes in 6062 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 04 16:56:17.227009 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-1eaf65b7-f1d5-4178-b6b6-f0f9f437cb8b req-5aa9224b-0e5d-4de8-9d4e-7a9a07a8d441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0b4f50d-df7a-44ab-87d8-054aa370c979", "name": "network-vif-plugged", "status": "completed", "tag": "6defc06d-afcb-4aaa-9d45-8000639706e7"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:17.237346 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1eaf65b7-f1d5-4178-b6b6-f0f9f437cb8b req-5aa9224b-0e5d-4de8-9d4e-7a9a07a8d441 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:17.237818 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1eaf65b7-f1d5-4178-b6b6-f0f9f437cb8b req-5aa9224b-0e5d-4de8-9d4e-7a9a07a8d441 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:17.238432 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1eaf65b7-f1d5-4178-b6b6-f0f9f437cb8b req-5aa9224b-0e5d-4de8-9d4e-7a9a07a8d441 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:17.249872 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-1eaf65b7-f1d5-4178-b6b6-f0f9f437cb8b req-5aa9224b-0e5d-4de8-9d4e-7a9a07a8d441 service nova] Creating event network-vif-plugged:6defc06d-afcb-4aaa-9d45-8000639706e7 for instance d0b4f50d-df7a-44ab-87d8-054aa370c979 on n-h2-851359-3 Aug 04 16:56:17.256270 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-1eaf65b7-f1d5-4178-b6b6-f0f9f437cb8b req-5aa9224b-0e5d-4de8-9d4e-7a9a07a8d441 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033060 Aug 04 16:56:17.256908 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 228/481] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:17.263030 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bc9f9af5-9da2-4ed8-87f0-e9023c21ea8e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:17.263780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bc9f9af5-9da2-4ed8-87f0-e9023c21ea8e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:17.270369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc9f9af5-9da2-4ed8-87f0-e9023c21ea8e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:17.270947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc9f9af5-9da2-4ed8-87f0-e9023c21ea8e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:17.271470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc9f9af5-9da2-4ed8-87f0-e9023c21ea8e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:17.272812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc9f9af5-9da2-4ed8-87f0-e9023c21ea8e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:17.273350 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc9f9af5-9da2-4ed8-87f0-e9023c21ea8e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:17.273889 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc9f9af5-9da2-4ed8-87f0-e9023c21ea8e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:17.339189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-55a72990-e2bb-4253-bbcc-2cfc70d4c1b9 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712723e5418441c096f008d1520f6dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8c7c49e56743dd9f64102e53c2bec7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:17.347247 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-55a72990-e2bb-4253-bbcc-2cfc70d4c1b9 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "GET /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37" status: 200 len: 1468 microversion: 2.1 time: 0.484927 Aug 04 16:56:17.347819 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 254/482] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:16 2022] GET /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37 => generated 1468 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:17.352559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-92df94d8-a179-4504-b598-3df24e1d9e56 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:17.353170 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-92df94d8-a179-4504-b598-3df24e1d9e56 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:17.359019 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92df94d8-a179-4504-b598-3df24e1d9e56 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:17.359506 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92df94d8-a179-4504-b598-3df24e1d9e56 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:17.359941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92df94d8-a179-4504-b598-3df24e1d9e56 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:17.360718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92df94d8-a179-4504-b598-3df24e1d9e56 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:17.361177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92df94d8-a179-4504-b598-3df24e1d9e56 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:17.361714 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92df94d8-a179-4504-b598-3df24e1d9e56 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:17.737485 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bc9f9af5-9da2-4ed8-87f0-e9023c21ea8e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:17.746476 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bc9f9af5-9da2-4ed8-87f0-e9023c21ea8e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989" status: 200 len: 1311 microversion: 2.1 time: 0.488036 Aug 04 16:56:17.759072 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 229/483] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:17 2022] GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989 => generated 1311 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:17.769801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f01ce281-83a1-4a78-9408-6f6afc81be7b tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Calling method '.version_select at 0x7f1e5bcd5550>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:17.802558 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-92df94d8-a179-4504-b598-3df24e1d9e56 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:17.816673 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-92df94d8-a179-4504-b598-3df24e1d9e56 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1462 microversion: 2.1 time: 0.467644 Aug 04 16:56:17.817731 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 255/484] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:17 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1462 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:18.080648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-67d34d3f-94d6-400b-8e59-3a9361468a57 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-367341363", "block_migration": true, "disk_over_commit": false}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:18.083678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-67d34d3f-94d6-400b-8e59-3a9361468a57 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] [instance: 2b1b8878-8ab2-4792-904f-dae80363ee37] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:18.092901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-67d34d3f-94d6-400b-8e59-3a9361468a57 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:18.093408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-67d34d3f-94d6-400b-8e59-3a9361468a57 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:18.094138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-67d34d3f-94d6-400b-8e59-3a9361468a57 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:18.095422 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-67d34d3f-94d6-400b-8e59-3a9361468a57 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:18.095886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-67d34d3f-94d6-400b-8e59-3a9361468a57 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:18.096316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-67d34d3f-94d6-400b-8e59-3a9361468a57 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:18.176390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-67d34d3f-94d6-400b-8e59-3a9361468a57 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Lazy-loading 'flavor' on Instance uuid 2b1b8878-8ab2-4792-904f-dae80363ee37 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:56:18.226945 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-67d34d3f-94d6-400b-8e59-3a9361468a57 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] [instance: 2b1b8878-8ab2-4792-904f-dae80363ee37] Going to try to live migrate instance to tempest-host-367341363 {{(pid=131043) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 16:56:18.234135 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-67d34d3f-94d6-400b-8e59-3a9361468a57 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] HTTP exception thrown: Compute host tempest-host-367341363 could not be found. Aug 04 16:56:18.238859 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-67d34d3f-94d6-400b-8e59-3a9361468a57 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Request method failure captured: Aug 04 16:56:18.238859 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37/action HTTP/1.1 Aug 04 16:56:18.238859 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:56:18.238859 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:56:18.238859 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:56:18.238859 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 106 Aug 04 16:56:18.238859 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:56:18.238859 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:56:18.238859 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:56:18.238859 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:18.238859 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_oXFR_NwOpOOCavnZuPLghySyLoRUJL1zs3DwPeMOtMhgzxZGHc-EC1UmBfYbWB3okXOuugFq1Qor5RlKJjPLU9bX5eOy-f19JnpIHicdvOBWcELy28qHt6P29VkFM35UFIPnYgtmef6QMEVx2ve6Gy-EpGXJhzrkESNHQ_otn97E4 Aug 04 16:56:18.238859 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:56:18.238859 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:56:18.238859 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:56:18.238859 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:56:18.238859 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:56:18.238859 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:56:18.238859 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: de7aed43550a451e93a1ac32adfde6f8 Aug 04 16:56:18.238859 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-LiveMigrationNegativeTest-1474604380 Aug 04 16:56:18.238859 n-d-851359-3 devstack@n-api.service[131043]: X-Role: admin,member,reader Aug 04 16:56:18.238859 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: admin,member,reader Aug 04 16:56:18.240613 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/de7aed43550a451e93a1ac32adfde6f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/de7aed43550a451e93a1ac32adfde6f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_de7aed43550a451e93a1ac32adfde6f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/de7aed43550a451e93a1ac32adfde6f8"}]}] Aug 04 16:56:18.240613 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-LiveMigrationNegativeTest-1474604380 Aug 04 16:56:18.240613 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: de7aed43550a451e93a1ac32adfde6f8 Aug 04 16:56:18.240613 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1474604380 Aug 04 16:56:18.240613 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-LiveMigrationNegativeTest-1474604380-project-admin Aug 04 16:56:18.240613 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:56:18.240613 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:56:18.240613 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: c43a503c5bd6425183ef105bf03d7fc4 Aug 04 16:56:18.240613 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-LiveMigrationNegativeTest-1474604380-project-admin Aug 04 16:56:18.240613 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 16:56:18.240613 n-d-851359-3 devstack@n-api.service[131043]: {"os-migrateLive": {"host": "tempest-host-367341363", "block_migration": true, "disk_over_commit": false}} Aug 04 16:56:18.240613 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 16:56:18.241456 n-d-851359-3 devstack@n-api.service[131043]: exception: Compute host tempest-host-367341363 could not be found. Aug 04 16:56:18.241456 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '2b1b8878-8ab2-4792-904f-dae80363ee37', 'body': {'os-migrateLive': {'host': 'tempest-host-367341363', 'block_migration': True, 'disk_over_commit': False}}} Aug 04 16:56:18.241456 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:18.241456 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:18.241456 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 04 16:56:18.241456 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 04 16:56:18.241456 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 04 16:56:18.241456 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 16:56:18.241456 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 04 16:56:18.241456 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 16:56:18.241456 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 04 16:56:18.241456 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 16:56:18.241456 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 16:56:18.241456 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 16:56:18.241456 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 04 16:56:18.241456 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 16:56:18.241456 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 04 16:56:18.241456 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 16:56:18.241456 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 16:56:18.242790 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 16:56:18.242790 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 16:56:18.242790 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 16:56:18.242790 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5436, in live_migrate Aug 04 16:56:18.242790 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 04 16:56:18.242790 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:56:18.242790 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:56:18.242790 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 04 16:56:18.242790 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 04 16:56:18.242790 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 04 16:56:18.242790 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:18.242790 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 04 16:56:18.242790 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 04 16:56:18.242790 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 04 16:56:18.242790 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 04 16:56:18.242790 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 04 16:56:18.242790 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 04 16:56:18.242790 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-367341363 could not be found. Aug 04 16:56:18.242790 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:18.243949 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:18.243949 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:18.243949 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:18.243949 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:18.243949 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:18.243949 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:18.243949 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:18.243949 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:18.243949 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:18.243949 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:56:18.243949 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:56:18.243949 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:56:18.243949 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:56:18.243949 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:56:18.243949 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:56:18.243949 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 04 16:56:18.243949 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 04 16:56:18.243949 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 16:56:18.243949 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-367341363 could not be found. Aug 04 16:56:18.243949 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:18.245110 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:18.245110 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:18.245110 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:18.245110 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:18.245110 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:18.245110 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:56:18.245110 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:56:18.245110 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-367341363 could not be found. Aug 04 16:56:18.245110 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:18.246478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-67d34d3f-94d6-400b-8e59-3a9361468a57 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Returning 400 to user: Compute host tempest-host-367341363 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:18.247532 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-67d34d3f-94d6-400b-8e59-3a9361468a57 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37/action" status: 400 len: 99 microversion: 2.1 time: 0.407655 Aug 04 16:56:18.248363 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 256/485] 10.222.0.93 () {60 vars in 1279 bytes} [Thu Aug 4 16:56:17 2022] POST /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37/action => generated 99 bytes in 414 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 16:56:18.254210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a2823bb8-f8ad-4fca-a2b5-ffef5c43f552 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:18.254836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a2823bb8-f8ad-4fca-a2b5-ffef5c43f552 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: 9d66fc68-229a-4ec3-8c6a-af43a20d2462] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:18.262473 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a2823bb8-f8ad-4fca-a2b5-ffef5c43f552 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:18.262977 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a2823bb8-f8ad-4fca-a2b5-ffef5c43f552 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:18.263421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a2823bb8-f8ad-4fca-a2b5-ffef5c43f552 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:18.264136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a2823bb8-f8ad-4fca-a2b5-ffef5c43f552 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:18.264599 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a2823bb8-f8ad-4fca-a2b5-ffef5c43f552 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:18.265027 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a2823bb8-f8ad-4fca-a2b5-ffef5c43f552 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:18.684151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a2823bb8-f8ad-4fca-a2b5-ffef5c43f552 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12efa078aa84861925925314ef00aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ed72eca39e4bab83ccbba779ac37c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:18.692936 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a2823bb8-f8ad-4fca-a2b5-ffef5c43f552 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462" status: 200 len: 1319 microversion: 2.1 time: 0.443409 Aug 04 16:56:18.693609 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 257/486] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:18 2022] GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462 => generated 1319 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:18.710878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-50c26ab2-25e3-40e4-a6da-a736134e0e5c tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:18.711619 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-50c26ab2-25e3-40e4-a6da-a736134e0e5c tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:18.718305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50c26ab2-25e3-40e4-a6da-a736134e0e5c tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:18.719305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50c26ab2-25e3-40e4-a6da-a736134e0e5c tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:18.719817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50c26ab2-25e3-40e4-a6da-a736134e0e5c tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:18.720880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50c26ab2-25e3-40e4-a6da-a736134e0e5c tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:18.721417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50c26ab2-25e3-40e4-a6da-a736134e0e5c tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:18.721923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50c26ab2-25e3-40e4-a6da-a736134e0e5c tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:19.033412 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-50c26ab2-25e3-40e4-a6da-a736134e0e5c tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1613 microversion: 2.1 time: 0.338493 Aug 04 16:56:19.034611 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 258/487] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:18 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1613 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:19.039330 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a8417734-21d9-4cd1-89c4-0db7f327117b tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:19.039937 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a8417734-21d9-4cd1-89c4-0db7f327117b tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:19.045801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8417734-21d9-4cd1-89c4-0db7f327117b tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:19.046602 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8417734-21d9-4cd1-89c4-0db7f327117b tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:19.050399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8417734-21d9-4cd1-89c4-0db7f327117b tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:19.050399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8417734-21d9-4cd1-89c4-0db7f327117b tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:19.050399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8417734-21d9-4cd1-89c4-0db7f327117b tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:19.050399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8417734-21d9-4cd1-89c4-0db7f327117b tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:19.175405 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a8417734-21d9-4cd1-89c4-0db7f327117b tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:19.178066 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:19.187886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a8417734-21d9-4cd1-89c4-0db7f327117b tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:19.190240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a8417734-21d9-4cd1-89c4-0db7f327117b tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:19.196318 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a8417734-21d9-4cd1-89c4-0db7f327117b tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1447 microversion: 2.75 time: 0.160538 Aug 04 16:56:19.196896 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 259/488] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:19 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1447 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:19.201558 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-43f4a3b6-5ffc-453c-94a2-2a1a21a0ac33 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:19.202380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-43f4a3b6-5ffc-453c-94a2-2a1a21a0ac33 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: 2b1b8878-8ab2-4792-904f-dae80363ee37] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:19.208468 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-43f4a3b6-5ffc-453c-94a2-2a1a21a0ac33 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:19.209145 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-43f4a3b6-5ffc-453c-94a2-2a1a21a0ac33 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:19.209747 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-43f4a3b6-5ffc-453c-94a2-2a1a21a0ac33 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:19.210670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-43f4a3b6-5ffc-453c-94a2-2a1a21a0ac33 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:19.211350 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-43f4a3b6-5ffc-453c-94a2-2a1a21a0ac33 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:19.211959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-43f4a3b6-5ffc-453c-94a2-2a1a21a0ac33 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:19.413044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-43f4a3b6-5ffc-453c-94a2-2a1a21a0ac33 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712723e5418441c096f008d1520f6dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8c7c49e56743dd9f64102e53c2bec7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:19.420578 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-43f4a3b6-5ffc-453c-94a2-2a1a21a0ac33 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "GET /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37" status: 200 len: 1468 microversion: 2.1 time: 0.222521 Aug 04 16:56:19.421370 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 260/489] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:19 2022] GET /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37 => generated 1468 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:19.426280 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-fb272f9c-cf63-4089-b7a7-e16a8cc5659f req-8e07061d-47c7-4339-a7ca-d1989338bc28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc381c07-ce7e-4a71-bede-f15c69c1d989", "tag": "ab451c60-9699-45ff-809b-94b053bd20d8"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:19.440471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-fb272f9c-cf63-4089-b7a7-e16a8cc5659f req-8e07061d-47c7-4339-a7ca-d1989338bc28 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:19.441244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-fb272f9c-cf63-4089-b7a7-e16a8cc5659f req-8e07061d-47c7-4339-a7ca-d1989338bc28 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:19.441864 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-fb272f9c-cf63-4089-b7a7-e16a8cc5659f req-8e07061d-47c7-4339-a7ca-d1989338bc28 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:19.460165 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-fb272f9c-cf63-4089-b7a7-e16a8cc5659f req-8e07061d-47c7-4339-a7ca-d1989338bc28 service nova] Creating event network-changed:ab451c60-9699-45ff-809b-94b053bd20d8 for instance fc381c07-ce7e-4a71-bede-f15c69c1d989 on n-h1-851359-3 Aug 04 16:56:19.467260 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-fb272f9c-cf63-4089-b7a7-e16a8cc5659f req-8e07061d-47c7-4339-a7ca-d1989338bc28 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043354 Aug 04 16:56:19.468219 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 261/490] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:19.477250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dcae1a3d-8270-4d89-b7db-d4a00d4e98e8 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:19.478138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dcae1a3d-8270-4d89-b7db-d4a00d4e98e8 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:19.491506 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcae1a3d-8270-4d89-b7db-d4a00d4e98e8 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:19.492012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcae1a3d-8270-4d89-b7db-d4a00d4e98e8 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:19.493816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcae1a3d-8270-4d89-b7db-d4a00d4e98e8 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:19.494589 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcae1a3d-8270-4d89-b7db-d4a00d4e98e8 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:19.495066 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcae1a3d-8270-4d89-b7db-d4a00d4e98e8 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:19.495500 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcae1a3d-8270-4d89-b7db-d4a00d4e98e8 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:19.497249 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f01ce281-83a1-4a78-9408-6f6afc81be7b tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/c9e8cf47-4189-4294-b3a8-4a8bbabc2048" status: 202 len: 0 microversion: 2.1 time: 1.736633 Aug 04 16:56:19.498440 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 230/491] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Aug 4 16:56:17 2022] DELETE /compute/v2.1/os-floating-ips/c9e8cf47-4189-4294-b3a8-4a8bbabc2048 => generated 0 bytes in 1739 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:56:19.504126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c5f59b1d-fa03-40ee-b930-87df5f8e38fd tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Calling method '.version_select at 0x7f1e5bcd5040>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:19.509596 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5f59b1d-fa03-40ee-b930-87df5f8e38fd tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:19.510345 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5f59b1d-fa03-40ee-b930-87df5f8e38fd tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:19.511165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5f59b1d-fa03-40ee-b930-87df5f8e38fd tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:19.526699 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c5f59b1d-fa03-40ee-b930-87df5f8e38fd tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] 10.222.0.93 "GET /compute/v2.1/os-migrations" status: 200 len: 793 microversion: 2.1 time: 0.026914 Aug 04 16:56:19.528063 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 231/492] 10.222.0.93 () {58 vars in 1143 bytes} [Thu Aug 4 16:56:19 2022] GET /compute/v2.1/os-migrations => generated 793 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:19.550350 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-af5b443f-33aa-42d5-9b63-0285b102e846 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:19.554820 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-af5b443f-33aa-42d5-9b63-0285b102e846 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Request method failure captured: Aug 04 16:56:19.554820 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89/action HTTP/1.1 Aug 04 16:56:19.554820 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:56:19.554820 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:56:19.554820 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:56:19.554820 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 34 Aug 04 16:56:19.554820 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:56:19.554820 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:56:19.554820 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:56:19.554820 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:19.554820 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_oEMqMT7qr76Z4RtbhpvbPrrjmzm899mOZDakfyONmuOK5oIqtTz-3wClndCr7uGgn8TIDFjY-ogMsCNaEU0di-g6TyEvvUs-lZyqrRWVD0H__km7kGTIjRZPuW0nO46SmbrSlrP6tb8d8RjNTLa4t5HmvZI202M0v06Cs40foeqfE Aug 04 16:56:19.554820 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:56:19.554820 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:56:19.554820 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:56:19.554820 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:56:19.554820 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:56:19.554820 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:56:19.554820 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 3f3e5530401f4a87a038b3d30679a74e Aug 04 16:56:19.554820 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-146158996 Aug 04 16:56:19.554820 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:56:19.554820 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:56:19.556172 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3f3e5530401f4a87a038b3d30679a74e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3f3e5530401f4a87a038b3d30679a74e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3f3e5530401f4a87a038b3d30679a74e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3f3e5530401f4a87a038b3d30679a74e"}]}] Aug 04 16:56:19.556172 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-146158996 Aug 04 16:56:19.556172 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 3f3e5530401f4a87a038b3d30679a74e Aug 04 16:56:19.556172 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-146158996 Aug 04 16:56:19.556172 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project Aug 04 16:56:19.556172 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:56:19.556172 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:56:19.556172 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 48eddfe7e2c347fcbc122b4f6fb89076 Aug 04 16:56:19.556172 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project Aug 04 16:56:19.556172 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 16:56:19.556172 n-d-851359-3 devstack@n-api.service[131044]: {"addFloatingIp": {"address": ""}} Aug 04 16:56:19.556172 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:56:19.556172 n-d-851359-3 devstack@n-api.service[131044]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 04 16:56:19.557409 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'eb10c53c-59c3-4239-97c5-c898c9f9ca89', 'body': {'addFloatingIp': {'address': ''}}} Aug 04 16:56:19.557409 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:19.557409 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:19.557409 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:56:19.557409 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:56:19.557409 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:56:19.557409 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:56:19.557409 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 04 16:56:19.557409 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:19.557409 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 04 16:56:19.557409 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 04 16:56:19.557409 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:19.557409 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 04 16:56:19.557409 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi '' Aug 04 16:56:19.557409 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:19.557409 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:19.557409 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:19.557409 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:19.557409 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:19.557409 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:19.557409 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:19.557409 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:19.559400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:56:19.559400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:56:19.559400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:19.559400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:19.559400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 16:56:19.559400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 16:56:19.559400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:56:19.559400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:56:19.559400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:56:19.559400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:56:19.559400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 04 16:56:19.559400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:19.559400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:19.559400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:19.559400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:19.559400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:19.559400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:19.559400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:56:19.559400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:56:19.560697 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 04 16:56:19.560697 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:19.560697 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-af5b443f-33aa-42d5-9b63-0285b102e846 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:19.560697 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-af5b443f-33aa-42d5-9b63-0285b102e846 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] 10.222.0.93 "POST /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89/action" status: 400 len: 142 microversion: 2.1 time: 0.014486 Aug 04 16:56:19.561596 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 232/493] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:56:19 2022] POST /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89/action => generated 142 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:56:19.568434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dd7f16e1-6084-4157-b046-143c32d7b5b3 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:19.571603 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dd7f16e1-6084-4157-b046-143c32d7b5b3 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] [instance: eb10c53c-59c3-4239-97c5-c898c9f9ca89] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:19.580280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd7f16e1-6084-4157-b046-143c32d7b5b3 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:19.580775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd7f16e1-6084-4157-b046-143c32d7b5b3 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:19.581663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd7f16e1-6084-4157-b046-143c32d7b5b3 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:19.582607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd7f16e1-6084-4157-b046-143c32d7b5b3 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:19.583237 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd7f16e1-6084-4157-b046-143c32d7b5b3 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:19.583832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd7f16e1-6084-4157-b046-143c32d7b5b3 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:19.625054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd7f16e1-6084-4157-b046-143c32d7b5b3 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "refresh_cache-eb10c53c-59c3-4239-97c5-c898c9f9ca89" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 04 16:56:19.625596 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd7f16e1-6084-4157-b046-143c32d7b5b3 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquired lock "refresh_cache-eb10c53c-59c3-4239-97c5-c898c9f9ca89" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 04 16:56:19.781535 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd7f16e1-6084-4157-b046-143c32d7b5b3 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Releasing lock "refresh_cache-eb10c53c-59c3-4239-97c5-c898c9f9ca89" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 04 16:56:19.783931 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-dd7f16e1-6084-4157-b046-143c32d7b5b3 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] HTTP exception thrown: floating IP not found Aug 04 16:56:19.786411 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dcae1a3d-8270-4d89-b7db-d4a00d4e98e8 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:19.790210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dd7f16e1-6084-4157-b046-143c32d7b5b3 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Request method failure captured: Aug 04 16:56:19.790210 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89/action HTTP/1.1 Aug 04 16:56:19.790210 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:56:19.790210 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:56:19.790210 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:56:19.790210 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 41 Aug 04 16:56:19.790210 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:56:19.790210 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:56:19.790210 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:56:19.790210 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:19.790210 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_oEMqMT7qr76Z4RtbhpvbPrrjmzm899mOZDakfyONmuOK5oIqtTz-3wClndCr7uGgn8TIDFjY-ogMsCNaEU0di-g6TyEvvUs-lZyqrRWVD0H__km7kGTIjRZPuW0nO46SmbrSlrP6tb8d8RjNTLa4t5HmvZI202M0v06Cs40foeqfE Aug 04 16:56:19.790210 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:56:19.790210 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:56:19.790210 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:56:19.790210 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:56:19.790210 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:56:19.790210 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:56:19.790210 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 3f3e5530401f4a87a038b3d30679a74e Aug 04 16:56:19.790210 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-146158996 Aug 04 16:56:19.790210 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:56:19.790210 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:56:19.791879 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3f3e5530401f4a87a038b3d30679a74e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3f3e5530401f4a87a038b3d30679a74e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3f3e5530401f4a87a038b3d30679a74e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3f3e5530401f4a87a038b3d30679a74e"}]}] Aug 04 16:56:19.791879 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-146158996 Aug 04 16:56:19.791879 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 3f3e5530401f4a87a038b3d30679a74e Aug 04 16:56:19.791879 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-146158996 Aug 04 16:56:19.791879 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project Aug 04 16:56:19.791879 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:56:19.791879 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:56:19.791879 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 48eddfe7e2c347fcbc122b4f6fb89076 Aug 04 16:56:19.791879 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project Aug 04 16:56:19.791879 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 16:56:19.791879 n-d-851359-3 devstack@n-api.service[131044]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 04 16:56:19.791879 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:56:19.791879 n-d-851359-3 devstack@n-api.service[131044]: exception: floating IP not found Aug 04 16:56:19.792775 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'eb10c53c-59c3-4239-97c5-c898c9f9ca89', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 04 16:56:19.792775 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:19.792775 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:19.792775 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 04 16:56:19.792775 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 04 16:56:19.792775 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 04 16:56:19.792775 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 04 16:56:19.792775 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Aug 04 16:56:19.792775 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 04 16:56:19.792775 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 04 16:56:19.792775 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 04 16:56:19.792775 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 04 16:56:19.792775 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:19.792775 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:19.792775 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:19.792775 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:19.792775 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:19.792775 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:19.792775 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:19.798576 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:19.798576 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:56:19.798576 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:56:19.798576 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:19.798576 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:19.798576 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:56:19.798576 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:56:19.798576 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 04 16:56:19.798576 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 16:56:19.798576 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 04 16:56:19.798576 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:19.798576 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:19.798576 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:19.798576 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:19.798576 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:19.798576 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:19.798576 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:56:19.798576 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:56:19.798576 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 04 16:56:19.798576 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:19.799913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dd7f16e1-6084-4157-b046-143c32d7b5b3 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Returning 404 to user: floating IP not found {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:19.799913 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dd7f16e1-6084-4157-b046-143c32d7b5b3 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] 10.222.0.93 "POST /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89/action" status: 404 len: 67 microversion: 2.1 time: 0.229647 Aug 04 16:56:19.799913 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 233/494] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:56:19 2022] POST /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89/action => generated 67 bytes in 231 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:56:19.804178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f32f33d5-686c-48c9-b492-fe5cd37dc14c tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1653151405", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:19.807229 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dcae1a3d-8270-4d89-b7db-d4a00d4e98e8 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989" status: 200 len: 1311 microversion: 2.1 time: 0.337572 Aug 04 16:56:19.818512 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 262/495] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:19 2022] GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989 => generated 1311 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:19.828108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-54b926de-b67b-4c44-9467-f978663f1985 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1016508425", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:19.880454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-f32f33d5-686c-48c9-b492-fe5cd37dc14c tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:56:19.891396 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-54b926de-b67b-4c44-9467-f978663f1985 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] validate_networks() for None {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:56:20.244823 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f32f33d5-686c-48c9-b492-fe5cd37dc14c tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:56:20.245775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f32f33d5-686c-48c9-b492-fe5cd37dc14c tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:56:20.246305 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f32f33d5-686c-48c9-b492-fe5cd37dc14c tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:56:20.247535 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f32f33d5-686c-48c9-b492-fe5cd37dc14c tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:56:20.248532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f32f33d5-686c-48c9-b492-fe5cd37dc14c tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:56:20.248918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-54b926de-b67b-4c44-9467-f978663f1985 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:56:20.249378 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-54b926de-b67b-4c44-9467-f978663f1985 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:56:20.250150 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-54b926de-b67b-4c44-9467-f978663f1985 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:56:20.252116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-54b926de-b67b-4c44-9467-f978663f1985 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:56:20.252555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-54b926de-b67b-4c44-9467-f978663f1985 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:56:20.267297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f32f33d5-686c-48c9-b492-fe5cd37dc14c tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:20.267784 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f32f33d5-686c-48c9-b492-fe5cd37dc14c tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:20.268703 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f32f33d5-686c-48c9-b492-fe5cd37dc14c tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:20.269695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f32f33d5-686c-48c9-b492-fe5cd37dc14c tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:20.270020 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-54b926de-b67b-4c44-9467-f978663f1985 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:20.270341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f32f33d5-686c-48c9-b492-fe5cd37dc14c tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:20.270518 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-54b926de-b67b-4c44-9467-f978663f1985 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:20.270958 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-54b926de-b67b-4c44-9467-f978663f1985 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:20.271060 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f32f33d5-686c-48c9-b492-fe5cd37dc14c tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:20.271697 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-54b926de-b67b-4c44-9467-f978663f1985 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:20.272156 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-54b926de-b67b-4c44-9467-f978663f1985 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:20.272582 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-54b926de-b67b-4c44-9467-f978663f1985 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:20.291862 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-54b926de-b67b-4c44-9467-f978663f1985 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Getting quotas for project 6f64e49086c94f65ba1fc2ef97b6bcde. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:56:20.297235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-54b926de-b67b-4c44-9467-f978663f1985 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Getting quotas for user 655795644d9941c99a82d15d9daa5ab5 and project 6f64e49086c94f65ba1fc2ef97b6bcde. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:56:20.305867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-f32f33d5-686c-48c9-b492-fe5cd37dc14c tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Getting quotas for project 3f8c7c49e56743dd9f64102e53c2bec7. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:56:20.318761 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-f32f33d5-686c-48c9-b492-fe5cd37dc14c tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Getting quotas for user 712723e5418441c096f008d1520f6dce and project 3f8c7c49e56743dd9f64102e53c2bec7. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:56:20.321633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-54b926de-b67b-4c44-9467-f978663f1985 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:56:20.324065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-54b926de-b67b-4c44-9467-f978663f1985 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:56:20.335134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f32f33d5-686c-48c9-b492-fe5cd37dc14c tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:56:20.337716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f32f33d5-686c-48c9-b492-fe5cd37dc14c tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: c0e9cb60-b590-412f-a6a1-fc8534bd1c97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:56:20.374436 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:20.383847 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-54b926de-b67b-4c44-9467-f978663f1985 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563890 Aug 04 16:56:20.385604 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 263/496] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:56:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:56:20.390852 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b052aae5-2f6d-487b-9ddc-7c5833cec7dd tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:20.392283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b052aae5-2f6d-487b-9ddc-7c5833cec7dd tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: 9d66fc68-229a-4ec3-8c6a-af43a20d2462] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:20.401567 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b052aae5-2f6d-487b-9ddc-7c5833cec7dd tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:20.402781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b052aae5-2f6d-487b-9ddc-7c5833cec7dd tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:20.403436 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b052aae5-2f6d-487b-9ddc-7c5833cec7dd tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:20.405096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b052aae5-2f6d-487b-9ddc-7c5833cec7dd tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:20.406936 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b052aae5-2f6d-487b-9ddc-7c5833cec7dd tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:20.408508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b052aae5-2f6d-487b-9ddc-7c5833cec7dd tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:20.409035 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f32f33d5-686c-48c9-b492-fe5cd37dc14c tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614135 Aug 04 16:56:20.414027 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 234/497] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:56:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:56:20.417222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6d1a9b36-a814-4f51-8fe1-764601d8aa57 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:20.520930 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-6d1a9b36-a814-4f51-8fe1-764601d8aa57 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 04 16:56:20.526008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6d1a9b36-a814-4f51-8fe1-764601d8aa57 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Request method failure captured: Aug 04 16:56:20.526008 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89/action HTTP/1.1 Aug 04 16:56:20.526008 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:56:20.526008 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:56:20.526008 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:56:20.526008 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 44 Aug 04 16:56:20.526008 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:56:20.526008 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:56:20.526008 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:56:20.526008 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:20.526008 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_oEMqMT7qr76Z4RtbhpvbPrrjmzm899mOZDakfyONmuOK5oIqtTz-3wClndCr7uGgn8TIDFjY-ogMsCNaEU0di-g6TyEvvUs-lZyqrRWVD0H__km7kGTIjRZPuW0nO46SmbrSlrP6tb8d8RjNTLa4t5HmvZI202M0v06Cs40foeqfE Aug 04 16:56:20.526008 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:56:20.526008 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:56:20.526008 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:56:20.526008 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:56:20.526008 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:56:20.526008 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:56:20.526008 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 3f3e5530401f4a87a038b3d30679a74e Aug 04 16:56:20.526008 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-146158996 Aug 04 16:56:20.526008 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:56:20.526008 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:56:20.527515 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3f3e5530401f4a87a038b3d30679a74e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3f3e5530401f4a87a038b3d30679a74e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3f3e5530401f4a87a038b3d30679a74e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3f3e5530401f4a87a038b3d30679a74e"}]}] Aug 04 16:56:20.527515 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-146158996 Aug 04 16:56:20.527515 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 3f3e5530401f4a87a038b3d30679a74e Aug 04 16:56:20.527515 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-146158996 Aug 04 16:56:20.527515 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project Aug 04 16:56:20.527515 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:56:20.527515 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:56:20.527515 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 48eddfe7e2c347fcbc122b4f6fb89076 Aug 04 16:56:20.527515 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project Aug 04 16:56:20.527515 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 16:56:20.527515 n-d-851359-3 devstack@n-api.service[131044]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 04 16:56:20.527515 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:56:20.527515 n-d-851359-3 devstack@n-api.service[131044]: exception: Floating IP not found for address 0.0.0.0. Aug 04 16:56:20.528463 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'eb10c53c-59c3-4239-97c5-c898c9f9ca89', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 04 16:56:20.528463 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:20.528463 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:20.528463 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 04 16:56:20.528463 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 04 16:56:20.528463 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Aug 04 16:56:20.528463 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 04 16:56:20.528463 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 04 16:56:20.528463 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 04 16:56:20.528463 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 04 16:56:20.528463 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:20.528463 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:20.528463 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:20.528463 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:20.528463 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:20.528463 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:20.528463 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:20.528463 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:20.528463 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:56:20.529748 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:56:20.529748 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:20.529748 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:20.529748 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:56:20.529748 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:56:20.529748 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 04 16:56:20.529748 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 04 16:56:20.529748 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 04 16:56:20.529748 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 04 16:56:20.529748 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 04 16:56:20.529748 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:20.529748 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:20.529748 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:20.529748 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:20.529748 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:20.529748 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:20.529748 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:56:20.529748 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:56:20.529748 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 04 16:56:20.529748 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:20.533018 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6d1a9b36-a814-4f51-8fe1-764601d8aa57 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:20.533018 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6d1a9b36-a814-4f51-8fe1-764601d8aa57 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] 10.222.0.93 "POST /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89/action" status: 404 len: 88 microversion: 2.1 time: 0.120261 Aug 04 16:56:20.533697 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 235/498] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:56:20 2022] POST /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89/action => generated 88 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:56:20.540111 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5b14fc14-956f-49be-b721-32df8635e5ca tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:20.540976 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5b14fc14-956f-49be-b721-32df8635e5ca tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:20.548449 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b14fc14-956f-49be-b721-32df8635e5ca tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:20.553356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b14fc14-956f-49be-b721-32df8635e5ca tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:20.554767 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b14fc14-956f-49be-b721-32df8635e5ca tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:20.555521 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b14fc14-956f-49be-b721-32df8635e5ca tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:20.555997 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b14fc14-956f-49be-b721-32df8635e5ca tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:20.556426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b14fc14-956f-49be-b721-32df8635e5ca tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:20.638749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5b14fc14-956f-49be-b721-32df8635e5ca tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:20.648641 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5b14fc14-956f-49be-b721-32df8635e5ca tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:20.650408 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5b14fc14-956f-49be-b721-32df8635e5ca tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:20.657313 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5b14fc14-956f-49be-b721-32df8635e5ca tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1447 microversion: 2.75 time: 0.122055 Aug 04 16:56:20.658451 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 236/499] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:20 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1447 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:20.702867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b052aae5-2f6d-487b-9ddc-7c5833cec7dd tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12efa078aa84861925925314ef00aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ed72eca39e4bab83ccbba779ac37c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:20.718344 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b052aae5-2f6d-487b-9ddc-7c5833cec7dd tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462" status: 200 len: 1319 microversion: 2.1 time: 0.331131 Aug 04 16:56:20.724098 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 264/500] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:20 2022] GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462 => generated 1319 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:20.738986 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7c4aad5f-86e0-49b3-9ee4-16caa78f3c1b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:20.739610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7c4aad5f-86e0-49b3-9ee4-16caa78f3c1b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:20.842150 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7c4aad5f-86e0-49b3-9ee4-16caa78f3c1b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:20.871984 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7c4aad5f-86e0-49b3-9ee4-16caa78f3c1b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1213 microversion: 2.1 time: 0.137228 Aug 04 16:56:20.873044 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 265/501] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:20 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1213 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:20.879382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-302f966a-efa7-4e25-983b-bc87ad733ae0 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:20.879979 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-302f966a-efa7-4e25-983b-bc87ad733ae0 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: c0e9cb60-b590-412f-a6a1-fc8534bd1c97] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:20.900166 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-24474662-6a64-4092-9b21-8edef9389215 tempest-QuotasAdminTestV257-1414241980 tempest-QuotasAdminTestV257-1414241980-project-admin] Action: 'update', calling method: .version_select at 0x7f1e5bc0d700>, body: {"quota_set": {"ram": "5120"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:20.979056 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24474662-6a64-4092-9b21-8edef9389215 tempest-QuotasAdminTestV257-1414241980 tempest-QuotasAdminTestV257-1414241980-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:20.979739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24474662-6a64-4092-9b21-8edef9389215 tempest-QuotasAdminTestV257-1414241980 tempest-QuotasAdminTestV257-1414241980-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:20.980336 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24474662-6a64-4092-9b21-8edef9389215 tempest-QuotasAdminTestV257-1414241980 tempest-QuotasAdminTestV257-1414241980-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:20.981232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24474662-6a64-4092-9b21-8edef9389215 tempest-QuotasAdminTestV257-1414241980 tempest-QuotasAdminTestV257-1414241980-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:20.982102 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24474662-6a64-4092-9b21-8edef9389215 tempest-QuotasAdminTestV257-1414241980 tempest-QuotasAdminTestV257-1414241980-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:20.982839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24474662-6a64-4092-9b21-8edef9389215 tempest-QuotasAdminTestV257-1414241980 tempest-QuotasAdminTestV257-1414241980-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:20.986632 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-302f966a-efa7-4e25-983b-bc87ad733ae0 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712723e5418441c096f008d1520f6dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8c7c49e56743dd9f64102e53c2bec7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:20.997733 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-302f966a-efa7-4e25-983b-bc87ad733ae0 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97" status: 200 len: 1219 microversion: 2.1 time: 0.123681 Aug 04 16:56:20.998416 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 266/502] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:20 2022] GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97 => generated 1219 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:21.013821 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5d737c7e-a57c-47e5-8ab0-b94992cbf175 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:21.014756 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5d737c7e-a57c-47e5-8ab0-b94992cbf175 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] [instance: eb10c53c-59c3-4239-97c5-c898c9f9ca89] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:21.025720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d737c7e-a57c-47e5-8ab0-b94992cbf175 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:21.026483 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d737c7e-a57c-47e5-8ab0-b94992cbf175 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:21.027676 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d737c7e-a57c-47e5-8ab0-b94992cbf175 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:21.029674 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d737c7e-a57c-47e5-8ab0-b94992cbf175 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:21.031535 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d737c7e-a57c-47e5-8ab0-b94992cbf175 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:21.031979 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d737c7e-a57c-47e5-8ab0-b94992cbf175 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:21.046806 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-24474662-6a64-4092-9b21-8edef9389215 tempest-QuotasAdminTestV257-1414241980 tempest-QuotasAdminTestV257-1414241980-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/765c8c400844421da675485f4f2d6999" status: 200 len: 148 microversion: 2.57 time: 0.386715 Aug 04 16:56:21.048017 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 237/503] 10.222.0.93 () {62 vars in 1303 bytes} [Thu Aug 4 16:56:20 2022] PUT /compute/v2.1/os-quota-sets/765c8c400844421da675485f4f2d6999 => generated 148 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:56:21.054251 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ec89fe3e-3004-4a4c-90bb-e1dc86d53c8f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:21.055152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ec89fe3e-3004-4a4c-90bb-e1dc86d53c8f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:21.063356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec89fe3e-3004-4a4c-90bb-e1dc86d53c8f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:21.065002 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec89fe3e-3004-4a4c-90bb-e1dc86d53c8f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:21.065646 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec89fe3e-3004-4a4c-90bb-e1dc86d53c8f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:21.066894 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec89fe3e-3004-4a4c-90bb-e1dc86d53c8f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:21.067639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec89fe3e-3004-4a4c-90bb-e1dc86d53c8f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:21.068226 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec89fe3e-3004-4a4c-90bb-e1dc86d53c8f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:21.074375 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5d737c7e-a57c-47e5-8ab0-b94992cbf175 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] [instance: eb10c53c-59c3-4239-97c5-c898c9f9ca89] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:56:21.171486 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5d737c7e-a57c-47e5-8ab0-b94992cbf175 tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] 10.222.0.93 "DELETE /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89" status: 204 len: 0 microversion: 2.1 time: 0.171834 Aug 04 16:56:21.172161 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 267/504] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 16:56:20 2022] DELETE /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:56:21.182062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6251f873-519d-4703-a432-fe55adb6c729 tempest-QuotasAdminTestV257-1414241980 tempest-QuotasAdminTestV257-1414241980-project-admin] Calling method '.version_select at 0x7f1e5bcd2e50>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:21.266157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6251f873-519d-4703-a432-fe55adb6c729 tempest-QuotasAdminTestV257-1414241980 tempest-QuotasAdminTestV257-1414241980-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:21.267434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6251f873-519d-4703-a432-fe55adb6c729 tempest-QuotasAdminTestV257-1414241980 tempest-QuotasAdminTestV257-1414241980-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:21.267634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6251f873-519d-4703-a432-fe55adb6c729 tempest-QuotasAdminTestV257-1414241980 tempest-QuotasAdminTestV257-1414241980-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:21.268530 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6251f873-519d-4703-a432-fe55adb6c729 tempest-QuotasAdminTestV257-1414241980 tempest-QuotasAdminTestV257-1414241980-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:21.269052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6251f873-519d-4703-a432-fe55adb6c729 tempest-QuotasAdminTestV257-1414241980 tempest-QuotasAdminTestV257-1414241980-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:21.269480 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6251f873-519d-4703-a432-fe55adb6c729 tempest-QuotasAdminTestV257-1414241980 tempest-QuotasAdminTestV257-1414241980-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:21.290047 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6251f873-519d-4703-a432-fe55adb6c729 tempest-QuotasAdminTestV257-1414241980 tempest-QuotasAdminTestV257-1414241980-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/765c8c400844421da675485f4f2d6999/detail" status: 200 len: 463 microversion: 2.57 time: 0.113346 Aug 04 16:56:21.290666 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 268/505] 10.222.0.93 () {60 vars in 1304 bytes} [Thu Aug 4 16:56:21 2022] GET /compute/v2.1/os-quota-sets/765c8c400844421da675485f4f2d6999/detail => generated 463 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:56:21.295553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0fe83849-1049-436e-b7da-e5c51f07266d tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:21.296545 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0fe83849-1049-436e-b7da-e5c51f07266d tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] [instance: eb10c53c-59c3-4239-97c5-c898c9f9ca89] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:21.303344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0fe83849-1049-436e-b7da-e5c51f07266d tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:21.303947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0fe83849-1049-436e-b7da-e5c51f07266d tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:21.304492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0fe83849-1049-436e-b7da-e5c51f07266d tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:21.305302 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0fe83849-1049-436e-b7da-e5c51f07266d tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:21.305764 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0fe83849-1049-436e-b7da-e5c51f07266d tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:21.306220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0fe83849-1049-436e-b7da-e5c51f07266d tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:21.537176 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ec89fe3e-3004-4a4c-90bb-e1dc86d53c8f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:21.544812 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ec89fe3e-3004-4a4c-90bb-e1dc86d53c8f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989" status: 200 len: 1311 microversion: 2.1 time: 0.495692 Aug 04 16:56:21.545579 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 238/506] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:21 2022] GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989 => generated 1311 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:21.550313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1f235033-661a-48dc-82a7-11a0cac158ee tempest-QuotasAdminTestV257-1414241980 tempest-QuotasAdminTestV257-1414241980-project-admin] Action: 'update', calling method: .version_select at 0x7f1e5bdd8e50>, body: {"quota_set": {"ram": "2048"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:21.590846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0fe83849-1049-436e-b7da-e5c51f07266d tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eddfe7e2c347fcbc122b4f6fb89076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3e5530401f4a87a038b3d30679a74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:21.599136 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0fe83849-1049-436e-b7da-e5c51f07266d tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] 10.222.0.93 "GET /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89" status: 200 len: 1543 microversion: 2.1 time: 0.307240 Aug 04 16:56:21.600081 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 269/507] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:21 2022] GET /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89 => generated 1543 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:21.627805 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f235033-661a-48dc-82a7-11a0cac158ee tempest-QuotasAdminTestV257-1414241980 tempest-QuotasAdminTestV257-1414241980-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:21.628295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f235033-661a-48dc-82a7-11a0cac158ee tempest-QuotasAdminTestV257-1414241980 tempest-QuotasAdminTestV257-1414241980-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:21.628734 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f235033-661a-48dc-82a7-11a0cac158ee tempest-QuotasAdminTestV257-1414241980 tempest-QuotasAdminTestV257-1414241980-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:21.629648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f235033-661a-48dc-82a7-11a0cac158ee tempest-QuotasAdminTestV257-1414241980 tempest-QuotasAdminTestV257-1414241980-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:21.630151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f235033-661a-48dc-82a7-11a0cac158ee tempest-QuotasAdminTestV257-1414241980 tempest-QuotasAdminTestV257-1414241980-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:21.630586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f235033-661a-48dc-82a7-11a0cac158ee tempest-QuotasAdminTestV257-1414241980 tempest-QuotasAdminTestV257-1414241980-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:21.662923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f235033-661a-48dc-82a7-11a0cac158ee tempest-QuotasAdminTestV257-1414241980 tempest-QuotasAdminTestV257-1414241980-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:21.663669 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f235033-661a-48dc-82a7-11a0cac158ee tempest-QuotasAdminTestV257-1414241980 tempest-QuotasAdminTestV257-1414241980-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:21.664118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f235033-661a-48dc-82a7-11a0cac158ee tempest-QuotasAdminTestV257-1414241980 tempest-QuotasAdminTestV257-1414241980-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:21.664859 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f235033-661a-48dc-82a7-11a0cac158ee tempest-QuotasAdminTestV257-1414241980 tempest-QuotasAdminTestV257-1414241980-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:21.665319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f235033-661a-48dc-82a7-11a0cac158ee tempest-QuotasAdminTestV257-1414241980 tempest-QuotasAdminTestV257-1414241980-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:21.665748 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f235033-661a-48dc-82a7-11a0cac158ee tempest-QuotasAdminTestV257-1414241980 tempest-QuotasAdminTestV257-1414241980-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:21.696340 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2ce46fc4-b7b8-4804-acd2-b4b7e4de21b5 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:21.696957 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2ce46fc4-b7b8-4804-acd2-b4b7e4de21b5 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:21.703775 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ce46fc4-b7b8-4804-acd2-b4b7e4de21b5 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:21.705078 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ce46fc4-b7b8-4804-acd2-b4b7e4de21b5 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:21.705588 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ce46fc4-b7b8-4804-acd2-b4b7e4de21b5 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:21.706421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ce46fc4-b7b8-4804-acd2-b4b7e4de21b5 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:21.706947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ce46fc4-b7b8-4804-acd2-b4b7e4de21b5 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:21.707596 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ce46fc4-b7b8-4804-acd2-b4b7e4de21b5 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:21.735226 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1f235033-661a-48dc-82a7-11a0cac158ee tempest-QuotasAdminTestV257-1414241980 tempest-QuotasAdminTestV257-1414241980-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/765c8c400844421da675485f4f2d6999?user_id=f8537f185f7f4d2d919ba2801441f50d" status: 200 len: 148 microversion: 2.57 time: 0.188735 Aug 04 16:56:21.736231 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 239/508] 10.222.0.93 () {62 vars in 1384 bytes} [Thu Aug 4 16:56:21 2022] PUT /compute/v2.1/os-quota-sets/765c8c400844421da675485f4f2d6999?user_id=f8537f185f7f4d2d919ba2801441f50d => generated 148 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:56:21.745167 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7570f212-4695-44a5-9836-d85fcf331bb8 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:21.745878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7570f212-4695-44a5-9836-d85fcf331bb8 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: 9d66fc68-229a-4ec3-8c6a-af43a20d2462] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:21.752729 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7570f212-4695-44a5-9836-d85fcf331bb8 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:21.753496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7570f212-4695-44a5-9836-d85fcf331bb8 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:21.754151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7570f212-4695-44a5-9836-d85fcf331bb8 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:21.755090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7570f212-4695-44a5-9836-d85fcf331bb8 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:21.755730 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7570f212-4695-44a5-9836-d85fcf331bb8 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:21.756255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7570f212-4695-44a5-9836-d85fcf331bb8 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:21.777064 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2ce46fc4-b7b8-4804-acd2-b4b7e4de21b5 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:21.787610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2ce46fc4-b7b8-4804-acd2-b4b7e4de21b5 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:21.787847 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2ce46fc4-b7b8-4804-acd2-b4b7e4de21b5 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:21.793740 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2ce46fc4-b7b8-4804-acd2-b4b7e4de21b5 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1447 microversion: 2.75 time: 0.103504 Aug 04 16:56:21.805999 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 270/509] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:21 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1447 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:21.805999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c3aa7be4-bc7c-4759-ab3a-bed73e2ac8bd tempest-QuotasAdminTestV257-1414241980 tempest-QuotasAdminTestV257-1414241980-project-admin] Calling method '.version_select at 0x7f1e5bbb4040>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:21.883404 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c3aa7be4-bc7c-4759-ab3a-bed73e2ac8bd tempest-QuotasAdminTestV257-1414241980 tempest-QuotasAdminTestV257-1414241980-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/765c8c400844421da675485f4f2d6999?user_id=f8537f185f7f4d2d919ba2801441f50d" status: 200 len: 190 microversion: 2.57 time: 0.087748 Aug 04 16:56:21.883990 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 271/510] 10.222.0.93 () {60 vars in 1364 bytes} [Thu Aug 4 16:56:21 2022] GET /compute/v2.1/os-quota-sets/765c8c400844421da675485f4f2d6999?user_id=f8537f185f7f4d2d919ba2801441f50d => generated 190 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:56:21.888727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-b9768660-4324-49f5-a844-655affd8e69d req-8ff9fd9a-a8b7-4894-b4d4-2934be02ed37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d66fc68-229a-4ec3-8c6a-af43a20d2462", "name": "network-vif-plugged", "status": "completed", "tag": "8efedb88-926c-4bea-a1ea-6a41752b45e9"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:21.898774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b9768660-4324-49f5-a844-655affd8e69d req-8ff9fd9a-a8b7-4894-b4d4-2934be02ed37 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:21.899266 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b9768660-4324-49f5-a844-655affd8e69d req-8ff9fd9a-a8b7-4894-b4d4-2934be02ed37 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:21.899707 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b9768660-4324-49f5-a844-655affd8e69d req-8ff9fd9a-a8b7-4894-b4d4-2934be02ed37 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:21.912075 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-b9768660-4324-49f5-a844-655affd8e69d req-8ff9fd9a-a8b7-4894-b4d4-2934be02ed37 service nova] Creating event network-vif-plugged:8efedb88-926c-4bea-a1ea-6a41752b45e9 for instance 9d66fc68-229a-4ec3-8c6a-af43a20d2462 on n-h2-851359-3 Aug 04 16:56:21.918891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7570f212-4695-44a5-9836-d85fcf331bb8 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12efa078aa84861925925314ef00aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ed72eca39e4bab83ccbba779ac37c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:21.926587 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7570f212-4695-44a5-9836-d85fcf331bb8 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462" status: 200 len: 1319 microversion: 2.1 time: 0.185861 Aug 04 16:56:21.927427 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 240/511] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:21 2022] GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:21.932101 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5fcbfe8b-bc77-4f7e-a78d-6e7545b657fc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:21.933065 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5fcbfe8b-bc77-4f7e-a78d-6e7545b657fc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:21.936657 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-b9768660-4324-49f5-a844-655affd8e69d req-8ff9fd9a-a8b7-4894-b4d4-2934be02ed37 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051071 Aug 04 16:56:21.937266 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 272/512] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:21.939388 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5fcbfe8b-bc77-4f7e-a78d-6e7545b657fc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:21.940646 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5fcbfe8b-bc77-4f7e-a78d-6e7545b657fc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:21.941340 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5fcbfe8b-bc77-4f7e-a78d-6e7545b657fc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:21.942226 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5fcbfe8b-bc77-4f7e-a78d-6e7545b657fc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:21.942851 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5fcbfe8b-bc77-4f7e-a78d-6e7545b657fc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:21.943590 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5fcbfe8b-bc77-4f7e-a78d-6e7545b657fc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:22.021402 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5fcbfe8b-bc77-4f7e-a78d-6e7545b657fc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:22.022915 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5a4efd31-131b-45ba-b0be-758270e3d369 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:22.025042 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5a4efd31-131b-45ba-b0be-758270e3d369 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: c0e9cb60-b590-412f-a6a1-fc8534bd1c97] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:22.029599 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5fcbfe8b-bc77-4f7e-a78d-6e7545b657fc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1209 microversion: 2.1 time: 0.100927 Aug 04 16:56:22.036641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5a4efd31-131b-45ba-b0be-758270e3d369 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:22.039455 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5a4efd31-131b-45ba-b0be-758270e3d369 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:22.041079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5a4efd31-131b-45ba-b0be-758270e3d369 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:22.042593 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 241/513] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:21 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1209 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:22.043377 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5a4efd31-131b-45ba-b0be-758270e3d369 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:22.043953 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5a4efd31-131b-45ba-b0be-758270e3d369 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:22.045243 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5a4efd31-131b-45ba-b0be-758270e3d369 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:22.132398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5a4efd31-131b-45ba-b0be-758270e3d369 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712723e5418441c096f008d1520f6dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8c7c49e56743dd9f64102e53c2bec7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:22.140883 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5a4efd31-131b-45ba-b0be-758270e3d369 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97" status: 200 len: 1223 microversion: 2.1 time: 0.124854 Aug 04 16:56:22.146519 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 273/514] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:22 2022] GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97 => generated 1223 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:56:22.570109 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eeef87a8-dde1-4393-9f2e-4e60c544a164 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:22.570775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eeef87a8-dde1-4393-9f2e-4e60c544a164 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:22.578931 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eeef87a8-dde1-4393-9f2e-4e60c544a164 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:22.580339 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eeef87a8-dde1-4393-9f2e-4e60c544a164 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:22.580738 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eeef87a8-dde1-4393-9f2e-4e60c544a164 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:22.581513 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eeef87a8-dde1-4393-9f2e-4e60c544a164 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:22.581935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eeef87a8-dde1-4393-9f2e-4e60c544a164 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:22.582402 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eeef87a8-dde1-4393-9f2e-4e60c544a164 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:22.621624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dbeb936a-b722-4fb0-bd70-f594d53ee27d tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:22.622506 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dbeb936a-b722-4fb0-bd70-f594d53ee27d tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] [instance: eb10c53c-59c3-4239-97c5-c898c9f9ca89] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:22.631970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dbeb936a-b722-4fb0-bd70-f594d53ee27d tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:22.634490 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dbeb936a-b722-4fb0-bd70-f594d53ee27d tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:22.635238 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dbeb936a-b722-4fb0-bd70-f594d53ee27d tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:22.636202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dbeb936a-b722-4fb0-bd70-f594d53ee27d tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:22.637066 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dbeb936a-b722-4fb0-bd70-f594d53ee27d tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:22.638141 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dbeb936a-b722-4fb0-bd70-f594d53ee27d tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:22.866005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eeef87a8-dde1-4393-9f2e-4e60c544a164 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:22.874340 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eeef87a8-dde1-4393-9f2e-4e60c544a164 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989" status: 200 len: 1311 microversion: 2.1 time: 0.310964 Aug 04 16:56:22.875524 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 242/515] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:22 2022] GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989 => generated 1311 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:22.881378 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0b2f251b-219c-48c8-9eb3-9a158acd06c7 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:22.882324 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0b2f251b-219c-48c8-9eb3-9a158acd06c7 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:22.890469 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dbeb936a-b722-4fb0-bd70-f594d53ee27d tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eddfe7e2c347fcbc122b4f6fb89076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3e5530401f4a87a038b3d30679a74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:22.896108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b2f251b-219c-48c8-9eb3-9a158acd06c7 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:22.896814 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b2f251b-219c-48c8-9eb3-9a158acd06c7 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:22.897308 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b2f251b-219c-48c8-9eb3-9a158acd06c7 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:22.900507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b2f251b-219c-48c8-9eb3-9a158acd06c7 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:22.900507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b2f251b-219c-48c8-9eb3-9a158acd06c7 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:22.900507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b2f251b-219c-48c8-9eb3-9a158acd06c7 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:22.900938 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dbeb936a-b722-4fb0-bd70-f594d53ee27d tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] 10.222.0.93 "GET /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89" status: 200 len: 1543 microversion: 2.1 time: 0.283276 Aug 04 16:56:22.900938 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 274/516] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:22 2022] GET /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89 => generated 1543 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:22.947129 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0e661af3-ea58-4889-99c3-1b641a6182d7 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:22.947741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0e661af3-ea58-4889-99c3-1b641a6182d7 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: 9d66fc68-229a-4ec3-8c6a-af43a20d2462] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:22.953626 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e661af3-ea58-4889-99c3-1b641a6182d7 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:22.954175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e661af3-ea58-4889-99c3-1b641a6182d7 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:22.954611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e661af3-ea58-4889-99c3-1b641a6182d7 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:22.955312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e661af3-ea58-4889-99c3-1b641a6182d7 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:22.955766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e661af3-ea58-4889-99c3-1b641a6182d7 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:22.956191 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e661af3-ea58-4889-99c3-1b641a6182d7 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:22.970605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0b2f251b-219c-48c8-9eb3-9a158acd06c7 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:22.994401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0b2f251b-219c-48c8-9eb3-9a158acd06c7 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:22.996007 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0b2f251b-219c-48c8-9eb3-9a158acd06c7 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:23.001686 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0b2f251b-219c-48c8-9eb3-9a158acd06c7 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1447 microversion: 2.75 time: 0.123686 Aug 04 16:56:23.002395 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 243/517] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:22 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1447 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:23.052974 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5190703e-af8c-4451-b06d-75af7912bba0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:23.053646 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5190703e-af8c-4451-b06d-75af7912bba0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:23.060784 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5190703e-af8c-4451-b06d-75af7912bba0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:23.062188 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5190703e-af8c-4451-b06d-75af7912bba0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:23.062750 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5190703e-af8c-4451-b06d-75af7912bba0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:23.064527 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5190703e-af8c-4451-b06d-75af7912bba0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:23.065122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5190703e-af8c-4451-b06d-75af7912bba0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:23.065636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5190703e-af8c-4451-b06d-75af7912bba0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:23.183061 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5190703e-af8c-4451-b06d-75af7912bba0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:23.191374 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5190703e-af8c-4451-b06d-75af7912bba0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1265 microversion: 2.1 time: 0.143651 Aug 04 16:56:23.191964 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 244/518] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:23 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:56:23.196756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7d239b8e-66bd-4d88-9bab-c4bab9d2d32b tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:23.197390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7d239b8e-66bd-4d88-9bab-c4bab9d2d32b tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: c0e9cb60-b590-412f-a6a1-fc8534bd1c97] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:23.203908 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d239b8e-66bd-4d88-9bab-c4bab9d2d32b tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:23.204403 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d239b8e-66bd-4d88-9bab-c4bab9d2d32b tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:23.205079 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d239b8e-66bd-4d88-9bab-c4bab9d2d32b tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:23.205556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d239b8e-66bd-4d88-9bab-c4bab9d2d32b tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:23.206037 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d239b8e-66bd-4d88-9bab-c4bab9d2d32b tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:23.206471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d239b8e-66bd-4d88-9bab-c4bab9d2d32b tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:23.228311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0e661af3-ea58-4889-99c3-1b641a6182d7 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12efa078aa84861925925314ef00aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ed72eca39e4bab83ccbba779ac37c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:23.237054 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0e661af3-ea58-4889-99c3-1b641a6182d7 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462" status: 200 len: 1319 microversion: 2.1 time: 0.293572 Aug 04 16:56:23.237845 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 275/519] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:22 2022] GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462 => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:56:23.272178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7d239b8e-66bd-4d88-9bab-c4bab9d2d32b tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712723e5418441c096f008d1520f6dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8c7c49e56743dd9f64102e53c2bec7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:23.280274 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7d239b8e-66bd-4d88-9bab-c4bab9d2d32b tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97" status: 200 len: 1271 microversion: 2.1 time: 0.087299 Aug 04 16:56:23.280912 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 245/520] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:23 2022] GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:23.898382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d21988ad-0401-475c-b4e1-cec5510ec7f1 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:23.899775 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d21988ad-0401-475c-b4e1-cec5510ec7f1 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:23.906048 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d21988ad-0401-475c-b4e1-cec5510ec7f1 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:23.906552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d21988ad-0401-475c-b4e1-cec5510ec7f1 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:23.907303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d21988ad-0401-475c-b4e1-cec5510ec7f1 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:23.914934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d21988ad-0401-475c-b4e1-cec5510ec7f1 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:23.914934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d21988ad-0401-475c-b4e1-cec5510ec7f1 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:23.914934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d21988ad-0401-475c-b4e1-cec5510ec7f1 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:23.921119 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-42fa77e9-2462-49b3-9718-e21a6678626a tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:23.922461 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-42fa77e9-2462-49b3-9718-e21a6678626a tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] [instance: eb10c53c-59c3-4239-97c5-c898c9f9ca89] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:23.936474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-42fa77e9-2462-49b3-9718-e21a6678626a tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:23.937466 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-42fa77e9-2462-49b3-9718-e21a6678626a tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:23.938218 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-42fa77e9-2462-49b3-9718-e21a6678626a tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:23.939883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-42fa77e9-2462-49b3-9718-e21a6678626a tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:23.945574 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-42fa77e9-2462-49b3-9718-e21a6678626a tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:23.946231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-42fa77e9-2462-49b3-9718-e21a6678626a tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:24.465732 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d21988ad-0401-475c-b4e1-cec5510ec7f1 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:24.467578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-42fa77e9-2462-49b3-9718-e21a6678626a tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48eddfe7e2c347fcbc122b4f6fb89076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3e5530401f4a87a038b3d30679a74e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:24.491921 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-42fa77e9-2462-49b3-9718-e21a6678626a tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] 10.222.0.93 "GET /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89" status: 200 len: 1543 microversion: 2.1 time: 0.575232 Aug 04 16:56:24.493084 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 246/521] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:23 2022] GET /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89 => generated 1543 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:24.501192 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d21988ad-0401-475c-b4e1-cec5510ec7f1 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989" status: 200 len: 1311 microversion: 2.1 time: 0.607311 Aug 04 16:56:24.512090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-716510a5-0405-4a16-90f2-dfcee8de5553 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:24.514237 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-716510a5-0405-4a16-90f2-dfcee8de5553 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:24.515456 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 276/522] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:23 2022] GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989 => generated 1311 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:24.526021 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-957a2d68-9561-4006-acb1-6ac13600ad51 req-2b5bee98-0c1d-483b-9bb4-44690825bfe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc381c07-ce7e-4a71-bede-f15c69c1d989", "name": "network-vif-plugged", "status": "completed", "tag": "ab451c60-9699-45ff-809b-94b053bd20d8"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:24.529454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-716510a5-0405-4a16-90f2-dfcee8de5553 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:24.530128 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-716510a5-0405-4a16-90f2-dfcee8de5553 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:24.530671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-716510a5-0405-4a16-90f2-dfcee8de5553 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:24.536548 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-716510a5-0405-4a16-90f2-dfcee8de5553 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:24.537253 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-716510a5-0405-4a16-90f2-dfcee8de5553 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:24.537794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-716510a5-0405-4a16-90f2-dfcee8de5553 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:24.546752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-957a2d68-9561-4006-acb1-6ac13600ad51 req-2b5bee98-0c1d-483b-9bb4-44690825bfe8 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:24.547424 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-957a2d68-9561-4006-acb1-6ac13600ad51 req-2b5bee98-0c1d-483b-9bb4-44690825bfe8 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:24.548501 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-957a2d68-9561-4006-acb1-6ac13600ad51 req-2b5bee98-0c1d-483b-9bb4-44690825bfe8 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:24.560559 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-957a2d68-9561-4006-acb1-6ac13600ad51 req-2b5bee98-0c1d-483b-9bb4-44690825bfe8 service nova] Creating event network-vif-plugged:ab451c60-9699-45ff-809b-94b053bd20d8 for instance fc381c07-ce7e-4a71-bede-f15c69c1d989 on n-h1-851359-3 Aug 04 16:56:24.565687 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-957a2d68-9561-4006-acb1-6ac13600ad51 req-2b5bee98-0c1d-483b-9bb4-44690825bfe8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048966 Aug 04 16:56:24.566942 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 277/523] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:24.575378 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-19b8a968-141a-47f3-8bce-bf0f1c6c4c07 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:24.576303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-19b8a968-141a-47f3-8bce-bf0f1c6c4c07 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:24.593893 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19b8a968-141a-47f3-8bce-bf0f1c6c4c07 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:24.595031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19b8a968-141a-47f3-8bce-bf0f1c6c4c07 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:24.595488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19b8a968-141a-47f3-8bce-bf0f1c6c4c07 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:24.596232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19b8a968-141a-47f3-8bce-bf0f1c6c4c07 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:24.596702 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19b8a968-141a-47f3-8bce-bf0f1c6c4c07 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:24.597146 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19b8a968-141a-47f3-8bce-bf0f1c6c4c07 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:24.682521 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-716510a5-0405-4a16-90f2-dfcee8de5553 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:24.697421 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-716510a5-0405-4a16-90f2-dfcee8de5553 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:24.701748 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-716510a5-0405-4a16-90f2-dfcee8de5553 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:24.716567 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-716510a5-0405-4a16-90f2-dfcee8de5553 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1447 microversion: 2.75 time: 0.222217 Aug 04 16:56:24.718026 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 247/524] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:24 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1447 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:24.730282 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-463b849b-4bd4-4946-801e-3c697d92cb6d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:24.731216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-463b849b-4bd4-4946-801e-3c697d92cb6d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: 9d66fc68-229a-4ec3-8c6a-af43a20d2462] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:24.752670 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-463b849b-4bd4-4946-801e-3c697d92cb6d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:24.753539 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-463b849b-4bd4-4946-801e-3c697d92cb6d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:24.754425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-463b849b-4bd4-4946-801e-3c697d92cb6d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:24.755993 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-463b849b-4bd4-4946-801e-3c697d92cb6d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:24.757377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-463b849b-4bd4-4946-801e-3c697d92cb6d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:24.759239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-463b849b-4bd4-4946-801e-3c697d92cb6d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:24.776119 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-19b8a968-141a-47f3-8bce-bf0f1c6c4c07 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:24.788075 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-19b8a968-141a-47f3-8bce-bf0f1c6c4c07 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1271 microversion: 2.1 time: 0.219809 Aug 04 16:56:24.789536 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 278/525] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:24 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1271 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:24.807209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d737fb9b-d809-4529-8d6a-45e410227d0e tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:24.808428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d737fb9b-d809-4529-8d6a-45e410227d0e tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: c0e9cb60-b590-412f-a6a1-fc8534bd1c97] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:24.825959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d737fb9b-d809-4529-8d6a-45e410227d0e tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:24.826625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d737fb9b-d809-4529-8d6a-45e410227d0e tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:24.827083 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d737fb9b-d809-4529-8d6a-45e410227d0e tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:24.829609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d737fb9b-d809-4529-8d6a-45e410227d0e tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:24.830121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d737fb9b-d809-4529-8d6a-45e410227d0e tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:24.833551 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d737fb9b-d809-4529-8d6a-45e410227d0e tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:25.203437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-463b849b-4bd4-4946-801e-3c697d92cb6d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12efa078aa84861925925314ef00aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ed72eca39e4bab83ccbba779ac37c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:25.220773 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-463b849b-4bd4-4946-801e-3c697d92cb6d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462" status: 200 len: 1319 microversion: 2.1 time: 0.501379 Aug 04 16:56:25.221369 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 248/526] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:24 2022] GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462 => generated 1319 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:25.242523 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-d60f91a0-0e19-4c86-b2b7-5417871b3c83 req-02950a31-f145-4f29-b2e3-7173a3e2d1c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb10c53c-59c3-4239-97c5-c898c9f9ca89", "name": "network-vif-deleted", "tag": "7c10a7ae-46ce-40dd-b73d-1e6d2b434cee"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:25.294235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d60f91a0-0e19-4c86-b2b7-5417871b3c83 req-02950a31-f145-4f29-b2e3-7173a3e2d1c8 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:25.295061 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d60f91a0-0e19-4c86-b2b7-5417871b3c83 req-02950a31-f145-4f29-b2e3-7173a3e2d1c8 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:25.297167 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d60f91a0-0e19-4c86-b2b7-5417871b3c83 req-02950a31-f145-4f29-b2e3-7173a3e2d1c8 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:25.340448 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-d60f91a0-0e19-4c86-b2b7-5417871b3c83 req-02950a31-f145-4f29-b2e3-7173a3e2d1c8 service nova] Creating event network-vif-deleted:7c10a7ae-46ce-40dd-b73d-1e6d2b434cee for instance eb10c53c-59c3-4239-97c5-c898c9f9ca89 on n-h1-851359-3 Aug 04 16:56:25.355329 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-d60f91a0-0e19-4c86-b2b7-5417871b3c83 req-02950a31-f145-4f29-b2e3-7173a3e2d1c8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131799 Aug 04 16:56:25.356681 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 249/527] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:25.464520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d737fb9b-d809-4529-8d6a-45e410227d0e tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712723e5418441c096f008d1520f6dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8c7c49e56743dd9f64102e53c2bec7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:25.473676 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d737fb9b-d809-4529-8d6a-45e410227d0e tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97" status: 200 len: 1319 microversion: 2.1 time: 0.682769 Aug 04 16:56:25.474628 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 279/528] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:24 2022] GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97 => generated 1319 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:25.514449 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f47c9cab-a9b0-44cd-b0fc-7fde8d49066b tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:25.516224 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f47c9cab-a9b0-44cd-b0fc-7fde8d49066b tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] [instance: eb10c53c-59c3-4239-97c5-c898c9f9ca89] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:25.537992 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-32134442-9cb8-4213-901f-d0c942d468b7 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:25.538909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-32134442-9cb8-4213-901f-d0c942d468b7 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:25.542342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f47c9cab-a9b0-44cd-b0fc-7fde8d49066b tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:25.542954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f47c9cab-a9b0-44cd-b0fc-7fde8d49066b tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:25.543408 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f47c9cab-a9b0-44cd-b0fc-7fde8d49066b tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:25.544160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f47c9cab-a9b0-44cd-b0fc-7fde8d49066b tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:25.544621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f47c9cab-a9b0-44cd-b0fc-7fde8d49066b tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:25.545052 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f47c9cab-a9b0-44cd-b0fc-7fde8d49066b tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:25.554508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32134442-9cb8-4213-901f-d0c942d468b7 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:25.554508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32134442-9cb8-4213-901f-d0c942d468b7 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:25.554991 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32134442-9cb8-4213-901f-d0c942d468b7 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:25.555685 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32134442-9cb8-4213-901f-d0c942d468b7 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:25.556300 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32134442-9cb8-4213-901f-d0c942d468b7 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:25.556712 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32134442-9cb8-4213-901f-d0c942d468b7 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:25.599485 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-f47c9cab-a9b0-44cd-b0fc-7fde8d49066b tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] HTTP exception thrown: Instance eb10c53c-59c3-4239-97c5-c898c9f9ca89 could not be found. Aug 04 16:56:25.606307 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f47c9cab-a9b0-44cd-b0fc-7fde8d49066b tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Request method failure captured: Aug 04 16:56:25.606307 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89 HTTP/1.1 Aug 04 16:56:25.606307 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:56:25.606307 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:56:25.606307 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:56:25.606307 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:56:25.606307 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:56:25.606307 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:56:25.606307 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:56:25.606307 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:25.606307 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_oEMqMT7qr76Z4RtbhpvbPrrjmzm899mOZDakfyONmuOK5oIqtTz-3wClndCr7uGgn8TIDFjY-ogMsCNaEU0di-g6TyEvvUs-lZyqrRWVD0H__km7kGTIjRZPuW0nO46SmbrSlrP6tb8d8RjNTLa4t5HmvZI202M0v06Cs40foeqfE Aug 04 16:56:25.606307 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:56:25.606307 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:56:25.606307 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:56:25.606307 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:56:25.606307 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:56:25.606307 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:56:25.606307 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 3f3e5530401f4a87a038b3d30679a74e Aug 04 16:56:25.606307 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-146158996 Aug 04 16:56:25.606307 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:56:25.606307 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:56:25.607743 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3f3e5530401f4a87a038b3d30679a74e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3f3e5530401f4a87a038b3d30679a74e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3f3e5530401f4a87a038b3d30679a74e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3f3e5530401f4a87a038b3d30679a74e"}]}] Aug 04 16:56:25.607743 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-146158996 Aug 04 16:56:25.607743 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 3f3e5530401f4a87a038b3d30679a74e Aug 04 16:56:25.607743 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-146158996 Aug 04 16:56:25.607743 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project Aug 04 16:56:25.607743 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:56:25.607743 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:56:25.607743 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 48eddfe7e2c347fcbc122b4f6fb89076 Aug 04 16:56:25.607743 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project Aug 04 16:56:25.607743 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:56:25.607743 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance eb10c53c-59c3-4239-97c5-c898c9f9ca89 could not be found. Aug 04 16:56:25.608505 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'eb10c53c-59c3-4239-97c5-c898c9f9ca89'} Aug 04 16:56:25.608505 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:25.608505 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:25.608505 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:56:25.608505 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:56:25.608505 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:56:25.608505 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:56:25.608505 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:56:25.608505 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:56:25.608505 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:56:25.608505 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:56:25.608505 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb10c53c-59c3-4239-97c5-c898c9f9ca89 could not be found. Aug 04 16:56:25.608505 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:25.608505 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:25.608505 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:25.608505 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:25.608505 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:25.608505 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:25.608505 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:25.608505 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:25.609732 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:25.609732 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:25.609732 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:56:25.609732 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:56:25.609732 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:56:25.609732 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:56:25.609732 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:56:25.609732 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:56:25.609732 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb10c53c-59c3-4239-97c5-c898c9f9ca89 could not be found. Aug 04 16:56:25.609732 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:25.609732 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:25.609732 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:25.609732 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:25.609732 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:25.609732 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:25.609732 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:56:25.609732 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:56:25.609732 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb10c53c-59c3-4239-97c5-c898c9f9ca89 could not be found. Aug 04 16:56:25.609732 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:25.613293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f47c9cab-a9b0-44cd-b0fc-7fde8d49066b tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] Returning 404 to user: Instance eb10c53c-59c3-4239-97c5-c898c9f9ca89 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:25.613293 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f47c9cab-a9b0-44cd-b0fc-7fde8d49066b tempest-FloatingIPsAssociationNegativeTestJSON-146158996 tempest-FloatingIPsAssociationNegativeTestJSON-146158996-project] 10.222.0.93 "GET /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89" status: 404 len: 111 microversion: 2.1 time: 0.098878 Aug 04 16:56:25.613293 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 250/529] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:25 2022] GET /compute/v2.1/servers/eb10c53c-59c3-4239-97c5-c898c9f9ca89 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:56:25.745290 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-31ad2e35-339c-4ac6-bab0-e48c5fd03710 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:25.745920 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-31ad2e35-339c-4ac6-bab0-e48c5fd03710 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:25.757075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31ad2e35-339c-4ac6-bab0-e48c5fd03710 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:25.757585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31ad2e35-339c-4ac6-bab0-e48c5fd03710 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:25.760745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31ad2e35-339c-4ac6-bab0-e48c5fd03710 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:25.763567 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31ad2e35-339c-4ac6-bab0-e48c5fd03710 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:25.764079 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31ad2e35-339c-4ac6-bab0-e48c5fd03710 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:25.764529 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31ad2e35-339c-4ac6-bab0-e48c5fd03710 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:25.780182 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:25.940907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-31ad2e35-339c-4ac6-bab0-e48c5fd03710 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:25.954463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-31ad2e35-339c-4ac6-bab0-e48c5fd03710 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:25.962076 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-31ad2e35-339c-4ac6-bab0-e48c5fd03710 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:25.983304 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-31ad2e35-339c-4ac6-bab0-e48c5fd03710 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1453 microversion: 2.75 time: 0.243176 Aug 04 16:56:25.985873 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 251/530] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:25 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1453 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:56:25.993756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6ed2c177-bf12-4b7e-82e4-16228d53b956 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:25.994697 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6ed2c177-bf12-4b7e-82e4-16228d53b956 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:26.006967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ed2c177-bf12-4b7e-82e4-16228d53b956 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:26.007930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ed2c177-bf12-4b7e-82e4-16228d53b956 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:26.011403 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ed2c177-bf12-4b7e-82e4-16228d53b956 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:26.015507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ed2c177-bf12-4b7e-82e4-16228d53b956 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:26.015909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ed2c177-bf12-4b7e-82e4-16228d53b956 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:26.017613 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ed2c177-bf12-4b7e-82e4-16228d53b956 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:26.168725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-32134442-9cb8-4213-901f-d0c942d468b7 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:26.191758 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-32134442-9cb8-4213-901f-d0c942d468b7 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989" status: 200 len: 1311 microversion: 2.1 time: 0.655343 Aug 04 16:56:26.204917 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 280/531] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:25 2022] GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989 => generated 1311 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:26.242220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c315b738-c108-4a70-af7d-39171b96241d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:26.244090 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c315b738-c108-4a70-af7d-39171b96241d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: 9d66fc68-229a-4ec3-8c6a-af43a20d2462] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:26.254822 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c315b738-c108-4a70-af7d-39171b96241d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:26.256869 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c315b738-c108-4a70-af7d-39171b96241d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:26.260250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c315b738-c108-4a70-af7d-39171b96241d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:26.261022 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c315b738-c108-4a70-af7d-39171b96241d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:26.261505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c315b738-c108-4a70-af7d-39171b96241d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:26.262143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c315b738-c108-4a70-af7d-39171b96241d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:26.267073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:26.544309 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6ed2c177-bf12-4b7e-82e4-16228d53b956 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:26.571118 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6ed2c177-bf12-4b7e-82e4-16228d53b956 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1313 microversion: 2.1 time: 0.579497 Aug 04 16:56:26.589514 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 252/532] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:25 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1313 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:26.603489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-47e1b019-d127-46cb-bd28-71aec30007ec tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:26.607475 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-47e1b019-d127-46cb-bd28-71aec30007ec tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: c0e9cb60-b590-412f-a6a1-fc8534bd1c97] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:26.625317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47e1b019-d127-46cb-bd28-71aec30007ec tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:26.627032 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47e1b019-d127-46cb-bd28-71aec30007ec tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:26.629374 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47e1b019-d127-46cb-bd28-71aec30007ec tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:26.630346 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47e1b019-d127-46cb-bd28-71aec30007ec tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:26.633341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47e1b019-d127-46cb-bd28-71aec30007ec tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:26.634340 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47e1b019-d127-46cb-bd28-71aec30007ec tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:26.701378 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c315b738-c108-4a70-af7d-39171b96241d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12efa078aa84861925925314ef00aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ed72eca39e4bab83ccbba779ac37c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:26.764196 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c315b738-c108-4a70-af7d-39171b96241d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462" status: 200 len: 1469 microversion: 2.1 time: 0.526515 Aug 04 16:56:26.767383 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 281/533] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:26 2022] GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462 => generated 1469 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:56:26.789191 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3f016eaa-68a0-41a5-8abd-c75bfc780195 tempest-DeleteServersAdminTestJSON-80250509 tempest-DeleteServersAdminTestJSON-80250509-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:26.792137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3f016eaa-68a0-41a5-8abd-c75bfc780195 tempest-DeleteServersAdminTestJSON-80250509 tempest-DeleteServersAdminTestJSON-80250509-project-admin] [instance: 9d66fc68-229a-4ec3-8c6a-af43a20d2462] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:26.800287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f016eaa-68a0-41a5-8abd-c75bfc780195 tempest-DeleteServersAdminTestJSON-80250509 tempest-DeleteServersAdminTestJSON-80250509-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:26.800995 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f016eaa-68a0-41a5-8abd-c75bfc780195 tempest-DeleteServersAdminTestJSON-80250509 tempest-DeleteServersAdminTestJSON-80250509-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:26.801611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f016eaa-68a0-41a5-8abd-c75bfc780195 tempest-DeleteServersAdminTestJSON-80250509 tempest-DeleteServersAdminTestJSON-80250509-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:26.802614 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f016eaa-68a0-41a5-8abd-c75bfc780195 tempest-DeleteServersAdminTestJSON-80250509 tempest-DeleteServersAdminTestJSON-80250509-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:26.803225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f016eaa-68a0-41a5-8abd-c75bfc780195 tempest-DeleteServersAdminTestJSON-80250509 tempest-DeleteServersAdminTestJSON-80250509-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:26.803982 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f016eaa-68a0-41a5-8abd-c75bfc780195 tempest-DeleteServersAdminTestJSON-80250509 tempest-DeleteServersAdminTestJSON-80250509-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:26.926385 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3f016eaa-68a0-41a5-8abd-c75bfc780195 tempest-DeleteServersAdminTestJSON-80250509 tempest-DeleteServersAdminTestJSON-80250509-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462/action" status: 202 len: 0 microversion: 2.1 time: 0.140727 Aug 04 16:56:26.933026 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 282/534] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:56:26 2022] POST /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 16:56:26.939771 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-87e1922a-ad48-487f-9177-1f777cf3e994 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:26.940822 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-87e1922a-ad48-487f-9177-1f777cf3e994 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: 9d66fc68-229a-4ec3-8c6a-af43a20d2462] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:26.947834 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87e1922a-ad48-487f-9177-1f777cf3e994 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:26.948695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87e1922a-ad48-487f-9177-1f777cf3e994 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:26.949406 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87e1922a-ad48-487f-9177-1f777cf3e994 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:26.951023 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87e1922a-ad48-487f-9177-1f777cf3e994 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:26.951689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87e1922a-ad48-487f-9177-1f777cf3e994 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:26.952342 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87e1922a-ad48-487f-9177-1f777cf3e994 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:26.990199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87e1922a-ad48-487f-9177-1f777cf3e994 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:26.991066 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87e1922a-ad48-487f-9177-1f777cf3e994 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:26.991666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87e1922a-ad48-487f-9177-1f777cf3e994 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:26.992411 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-87e1922a-ad48-487f-9177-1f777cf3e994 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lazy-loading 'fault' on Instance uuid 9d66fc68-229a-4ec3-8c6a-af43a20d2462 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:56:27.284759 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-47e1b019-d127-46cb-bd28-71aec30007ec tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712723e5418441c096f008d1520f6dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8c7c49e56743dd9f64102e53c2bec7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:27.293961 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-47e1b019-d127-46cb-bd28-71aec30007ec tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97" status: 200 len: 1319 microversion: 2.1 time: 0.702608 Aug 04 16:56:27.294580 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 253/535] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:26 2022] GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97 => generated 1319 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:27.299829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cfed12ca-3f46-4712-82aa-aa539319e9f2 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:27.300668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cfed12ca-3f46-4712-82aa-aa539319e9f2 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:27.310575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfed12ca-3f46-4712-82aa-aa539319e9f2 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:27.311276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfed12ca-3f46-4712-82aa-aa539319e9f2 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:27.311741 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfed12ca-3f46-4712-82aa-aa539319e9f2 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:27.312688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfed12ca-3f46-4712-82aa-aa539319e9f2 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:27.313707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfed12ca-3f46-4712-82aa-aa539319e9f2 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:27.314489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfed12ca-3f46-4712-82aa-aa539319e9f2 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:27.419913 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-87e1922a-ad48-487f-9177-1f777cf3e994 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12efa078aa84861925925314ef00aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ed72eca39e4bab83ccbba779ac37c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:27.424324 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cfed12ca-3f46-4712-82aa-aa539319e9f2 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:27.429082 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-87e1922a-ad48-487f-9177-1f777cf3e994 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462" status: 200 len: 1452 microversion: 2.1 time: 0.494652 Aug 04 16:56:27.437302 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 283/536] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:26 2022] GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462 => generated 1452 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:27.439515 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cfed12ca-3f46-4712-82aa-aa539319e9f2 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:27.442092 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cfed12ca-3f46-4712-82aa-aa539319e9f2 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:27.446671 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-b6ce4bae-782c-4ec8-bd7f-73374cc47f2e req-34106711-3bc3-4049-aea0-036929296a18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0e9cb60-b590-412f-a6a1-fc8534bd1c97", "tag": "f90a54ce-7427-41d6-bbc9-f7eddedbc6bf"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:27.453768 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cfed12ca-3f46-4712-82aa-aa539319e9f2 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1453 microversion: 2.75 time: 0.158109 Aug 04 16:56:27.455113 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 254/537] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:27 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:27.458541 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b6ce4bae-782c-4ec8-bd7f-73374cc47f2e req-34106711-3bc3-4049-aea0-036929296a18 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:27.459111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b6ce4bae-782c-4ec8-bd7f-73374cc47f2e req-34106711-3bc3-4049-aea0-036929296a18 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:27.459821 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b6ce4bae-782c-4ec8-bd7f-73374cc47f2e req-34106711-3bc3-4049-aea0-036929296a18 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:27.477650 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-b6ce4bae-782c-4ec8-bd7f-73374cc47f2e req-34106711-3bc3-4049-aea0-036929296a18 service nova] Creating event network-changed:f90a54ce-7427-41d6-bbc9-f7eddedbc6bf for instance c0e9cb60-b590-412f-a6a1-fc8534bd1c97 on n-h1-851359-3 Aug 04 16:56:27.483599 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-b6ce4bae-782c-4ec8-bd7f-73374cc47f2e req-34106711-3bc3-4049-aea0-036929296a18 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044761 Aug 04 16:56:27.484849 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 284/538] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:27.491249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6ca6f62f-9ba7-4a03-9433-3c699dc6df86 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:27.492385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6ca6f62f-9ba7-4a03-9433-3c699dc6df86 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:27.495882 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:27.501883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ca6f62f-9ba7-4a03-9433-3c699dc6df86 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:27.503399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ca6f62f-9ba7-4a03-9433-3c699dc6df86 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:27.504043 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ca6f62f-9ba7-4a03-9433-3c699dc6df86 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:27.504970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ca6f62f-9ba7-4a03-9433-3c699dc6df86 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:27.505696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ca6f62f-9ba7-4a03-9433-3c699dc6df86 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:27.506716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ca6f62f-9ba7-4a03-9433-3c699dc6df86 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:27.629163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cf9623fa-8617-4050-8de0-a7357af47da4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1789163996", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:27.699144 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-cf9623fa-8617-4050-8de0-a7357af47da4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:56:27.760990 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6ca6f62f-9ba7-4a03-9433-3c699dc6df86 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:27.770251 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6ca6f62f-9ba7-4a03-9433-3c699dc6df86 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989" status: 200 len: 1494 microversion: 2.1 time: 0.283027 Aug 04 16:56:27.784278 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 285/539] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:27 2022] GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989 => generated 1494 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:27.793557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9a4e87af-1028-4d59-aa56-6e952617cd53 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:27.794924 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9a4e87af-1028-4d59-aa56-6e952617cd53 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: 9d66fc68-229a-4ec3-8c6a-af43a20d2462] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:27.802904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9a4e87af-1028-4d59-aa56-6e952617cd53 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:27.803696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9a4e87af-1028-4d59-aa56-6e952617cd53 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:27.805117 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9a4e87af-1028-4d59-aa56-6e952617cd53 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:27.806734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9a4e87af-1028-4d59-aa56-6e952617cd53 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:27.807208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9a4e87af-1028-4d59-aa56-6e952617cd53 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:27.808061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9a4e87af-1028-4d59-aa56-6e952617cd53 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:27.843876 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9a4e87af-1028-4d59-aa56-6e952617cd53 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: 9d66fc68-229a-4ec3-8c6a-af43a20d2462] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:56:27.947781 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9a4e87af-1028-4d59-aa56-6e952617cd53 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462" status: 204 len: 0 microversion: 2.1 time: 0.158031 Aug 04 16:56:27.950046 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 286/540] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 16:56:27 2022] DELETE /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:56:27.957883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-082af159-30d2-47d9-a3dc-bcf74746c222 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:27.958722 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-082af159-30d2-47d9-a3dc-bcf74746c222 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:27.965406 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-082af159-30d2-47d9-a3dc-bcf74746c222 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:27.966059 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-082af159-30d2-47d9-a3dc-bcf74746c222 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:27.966695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-082af159-30d2-47d9-a3dc-bcf74746c222 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:27.967600 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-082af159-30d2-47d9-a3dc-bcf74746c222 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:27.968128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-082af159-30d2-47d9-a3dc-bcf74746c222 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:27.969111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-082af159-30d2-47d9-a3dc-bcf74746c222 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:28.069727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-cf9623fa-8617-4050-8de0-a7357af47da4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:56:28.070364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-cf9623fa-8617-4050-8de0-a7357af47da4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:56:28.071071 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-cf9623fa-8617-4050-8de0-a7357af47da4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:56:28.071495 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-cf9623fa-8617-4050-8de0-a7357af47da4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:56:28.072085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-cf9623fa-8617-4050-8de0-a7357af47da4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:56:28.085846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf9623fa-8617-4050-8de0-a7357af47da4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:28.087141 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf9623fa-8617-4050-8de0-a7357af47da4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:28.087813 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf9623fa-8617-4050-8de0-a7357af47da4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:28.089000 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf9623fa-8617-4050-8de0-a7357af47da4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:28.089800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf9623fa-8617-4050-8de0-a7357af47da4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:28.090483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf9623fa-8617-4050-8de0-a7357af47da4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:28.112240 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-cf9623fa-8617-4050-8de0-a7357af47da4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Getting quotas for project 3db0dbf55e504a95903556ffd03801fe. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:56:28.118959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-cf9623fa-8617-4050-8de0-a7357af47da4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Getting quotas for user 774f01840dcc4fb9a160f4e3707c20ef and project 3db0dbf55e504a95903556ffd03801fe. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:56:28.133487 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cf9623fa-8617-4050-8de0-a7357af47da4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:56:28.136037 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cf9623fa-8617-4050-8de0-a7357af47da4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: b8efce6c-198e-49a7-8576-32d80cb168df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:56:28.189719 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cf9623fa-8617-4050-8de0-a7357af47da4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.733235 Aug 04 16:56:28.190784 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 255/541] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:56:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:56:28.195619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-66bbfa2f-92cd-4bcc-bd1b-68486772dca5 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:28.196038 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-66bbfa2f-92cd-4bcc-bd1b-68486772dca5 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:28.198411 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=93 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:28.203041 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-082af159-30d2-47d9-a3dc-bcf74746c222 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:28.205745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66bbfa2f-92cd-4bcc-bd1b-68486772dca5 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:28.206271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66bbfa2f-92cd-4bcc-bd1b-68486772dca5 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:28.206714 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66bbfa2f-92cd-4bcc-bd1b-68486772dca5 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:28.208028 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66bbfa2f-92cd-4bcc-bd1b-68486772dca5 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:28.208505 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66bbfa2f-92cd-4bcc-bd1b-68486772dca5 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:28.208941 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66bbfa2f-92cd-4bcc-bd1b-68486772dca5 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:28.211993 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-082af159-30d2-47d9-a3dc-bcf74746c222 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1313 microversion: 2.1 time: 0.260355 Aug 04 16:56:28.225209 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 287/542] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:27 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:28.225209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3f293929-3ac8-4d90-b92c-7472b9c52fc5 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:28.225209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3f293929-3ac8-4d90-b92c-7472b9c52fc5 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: 9d66fc68-229a-4ec3-8c6a-af43a20d2462] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:28.233581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f293929-3ac8-4d90-b92c-7472b9c52fc5 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:28.236534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f293929-3ac8-4d90-b92c-7472b9c52fc5 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:28.238772 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f293929-3ac8-4d90-b92c-7472b9c52fc5 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:28.239755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f293929-3ac8-4d90-b92c-7472b9c52fc5 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:28.240400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f293929-3ac8-4d90-b92c-7472b9c52fc5 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:28.240839 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f293929-3ac8-4d90-b92c-7472b9c52fc5 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:28.279983 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f293929-3ac8-4d90-b92c-7472b9c52fc5 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:28.280467 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f293929-3ac8-4d90-b92c-7472b9c52fc5 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:28.280901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f293929-3ac8-4d90-b92c-7472b9c52fc5 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:28.281348 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-3f293929-3ac8-4d90-b92c-7472b9c52fc5 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lazy-loading 'fault' on Instance uuid 9d66fc68-229a-4ec3-8c6a-af43a20d2462 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:56:28.448241 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-66bbfa2f-92cd-4bcc-bd1b-68486772dca5 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989" status: 200 len: 1645 microversion: 2.1 time: 0.256243 Aug 04 16:56:28.448891 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 256/543] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:28 2022] GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989 => generated 1645 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:28.460396 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-1b28298a-b21c-4809-b13a-63d1ee91a461 req-f05e6184-62da-42e3-af6c-767fa31d6863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cfbd46c-8842-4119-a0d0-7bf5827e45d3", "tag": "6b6134e1-88b8-41c8-9a22-a162b6145647"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:28.484700 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1b28298a-b21c-4809-b13a-63d1ee91a461 req-f05e6184-62da-42e3-af6c-767fa31d6863 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:28.485252 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1b28298a-b21c-4809-b13a-63d1ee91a461 req-f05e6184-62da-42e3-af6c-767fa31d6863 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:28.486584 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1b28298a-b21c-4809-b13a-63d1ee91a461 req-f05e6184-62da-42e3-af6c-767fa31d6863 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:28.502003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3f293929-3ac8-4d90-b92c-7472b9c52fc5 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12efa078aa84861925925314ef00aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ed72eca39e4bab83ccbba779ac37c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:28.504949 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-1b28298a-b21c-4809-b13a-63d1ee91a461 req-f05e6184-62da-42e3-af6c-767fa31d6863 service nova] Creating event network-changed:6b6134e1-88b8-41c8-9a22-a162b6145647 for instance 6cfbd46c-8842-4119-a0d0-7bf5827e45d3 on n-h1-851359-3 Aug 04 16:56:28.510223 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3f293929-3ac8-4d90-b92c-7472b9c52fc5 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462" status: 200 len: 1458 microversion: 2.1 time: 0.295840 Aug 04 16:56:28.510829 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 288/544] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:28 2022] GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462 => generated 1458 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:28.511828 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-1b28298a-b21c-4809-b13a-63d1ee91a461 req-f05e6184-62da-42e3-af6c-767fa31d6863 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054826 Aug 04 16:56:28.513914 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 257/545] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:28.519484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8c187fb8-275d-4548-8e1c-852b5832844c tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:28.520352 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8c187fb8-275d-4548-8e1c-852b5832844c tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: b8efce6c-198e-49a7-8576-32d80cb168df] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:28.527735 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e62f6d15-970a-40d7-b98a-4805007cd500 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:28.529474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e62f6d15-970a-40d7-b98a-4805007cd500 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: c0e9cb60-b590-412f-a6a1-fc8534bd1c97] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:28.540084 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e62f6d15-970a-40d7-b98a-4805007cd500 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:28.540742 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e62f6d15-970a-40d7-b98a-4805007cd500 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:28.541376 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e62f6d15-970a-40d7-b98a-4805007cd500 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:28.542275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e62f6d15-970a-40d7-b98a-4805007cd500 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:28.542836 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e62f6d15-970a-40d7-b98a-4805007cd500 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:28.543553 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e62f6d15-970a-40d7-b98a-4805007cd500 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:28.584110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8c187fb8-275d-4548-8e1c-852b5832844c tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:28.607732 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8c187fb8-275d-4548-8e1c-852b5832844c tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df" status: 200 len: 1222 microversion: 2.1 time: 0.095613 Aug 04 16:56:28.608341 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 289/546] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:28 2022] GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df => generated 1222 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:28.615299 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2465a1d4-9454-4f1e-b174-40c0ea81a416 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:28.625568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2465a1d4-9454-4f1e-b174-40c0ea81a416 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:28.633076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2465a1d4-9454-4f1e-b174-40c0ea81a416 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:28.635194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2465a1d4-9454-4f1e-b174-40c0ea81a416 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:28.637415 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2465a1d4-9454-4f1e-b174-40c0ea81a416 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:28.638488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2465a1d4-9454-4f1e-b174-40c0ea81a416 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:28.640080 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2465a1d4-9454-4f1e-b174-40c0ea81a416 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:28.642069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2465a1d4-9454-4f1e-b174-40c0ea81a416 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:28.756946 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e62f6d15-970a-40d7-b98a-4805007cd500 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712723e5418441c096f008d1520f6dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8c7c49e56743dd9f64102e53c2bec7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:28.767834 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e62f6d15-970a-40d7-b98a-4805007cd500 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97" status: 200 len: 1319 microversion: 2.1 time: 0.252562 Aug 04 16:56:28.769027 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 258/547] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:28 2022] GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:28.776603 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-51bc3d4a-788c-482d-8875-a64cf6d20c61 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:28.777227 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-51bc3d4a-788c-482d-8875-a64cf6d20c61 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:28.795781 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51bc3d4a-788c-482d-8875-a64cf6d20c61 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:28.796466 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51bc3d4a-788c-482d-8875-a64cf6d20c61 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:28.796935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51bc3d4a-788c-482d-8875-a64cf6d20c61 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:28.799843 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51bc3d4a-788c-482d-8875-a64cf6d20c61 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:28.800609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51bc3d4a-788c-482d-8875-a64cf6d20c61 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:28.808683 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51bc3d4a-788c-482d-8875-a64cf6d20c61 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:28.914924 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2465a1d4-9454-4f1e-b174-40c0ea81a416 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989" status: 200 len: 1645 microversion: 2.1 time: 0.305146 Aug 04 16:56:28.930306 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 290/548] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:28 2022] GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989 => generated 1645 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:28.930629 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-51bc3d4a-788c-482d-8875-a64cf6d20c61 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:28.936896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b3ed7f56-ddec-4bc5-bd77-b115e73b7533 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:28.939154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-51bc3d4a-788c-482d-8875-a64cf6d20c61 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:28.940407 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:56:28.940407 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:56:28.941557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3ed7f56-ddec-4bc5-bd77-b115e73b7533 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:28.942031 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-51bc3d4a-788c-482d-8875-a64cf6d20c61 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:28.942208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3ed7f56-ddec-4bc5-bd77-b115e73b7533 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:28.942500 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3ed7f56-ddec-4bc5-bd77-b115e73b7533 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:28.943232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3ed7f56-ddec-4bc5-bd77-b115e73b7533 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:28.943687 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3ed7f56-ddec-4bc5-bd77-b115e73b7533 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:28.944111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3ed7f56-ddec-4bc5-bd77-b115e73b7533 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:28.949893 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-51bc3d4a-788c-482d-8875-a64cf6d20c61 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1453 microversion: 2.75 time: 0.179664 Aug 04 16:56:28.950540 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 259/549] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:28 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1453 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:28.972243 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b3ed7f56-ddec-4bc5-bd77-b115e73b7533 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.039259 Aug 04 16:56:28.972764 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 291/550] 10.222.0.93 () {58 vars in 1176 bytes} [Thu Aug 4 16:56:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:28.984333 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c87af57a-3011-4f51-84a3-6d9163c41257 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:28.985591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c87af57a-3011-4f51-84a3-6d9163c41257 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:28.991990 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c87af57a-3011-4f51-84a3-6d9163c41257 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:28.992692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c87af57a-3011-4f51-84a3-6d9163c41257 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:28.993253 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c87af57a-3011-4f51-84a3-6d9163c41257 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:28.994107 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c87af57a-3011-4f51-84a3-6d9163c41257 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:28.994683 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c87af57a-3011-4f51-84a3-6d9163c41257 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:28.995215 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c87af57a-3011-4f51-84a3-6d9163c41257 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:29.065764 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c87af57a-3011-4f51-84a3-6d9163c41257 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989/action" status: 202 len: 0 microversion: 2.1 time: 0.085122 Aug 04 16:56:29.066491 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 260/551] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:56:28 2022] POST /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:56:29.074381 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f356724f-d876-40e9-a93a-a3c7662e7eb4 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:29.075197 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f356724f-d876-40e9-a93a-a3c7662e7eb4 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:29.083984 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f356724f-d876-40e9-a93a-a3c7662e7eb4 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:29.085043 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f356724f-d876-40e9-a93a-a3c7662e7eb4 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:29.085700 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f356724f-d876-40e9-a93a-a3c7662e7eb4 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:29.087244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f356724f-d876-40e9-a93a-a3c7662e7eb4 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:29.087892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f356724f-d876-40e9-a93a-a3c7662e7eb4 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:29.088546 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f356724f-d876-40e9-a93a-a3c7662e7eb4 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:29.235493 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a53d479d-e860-4a47-9f9c-f7df80c4e049 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:29.236389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a53d479d-e860-4a47-9f9c-f7df80c4e049 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:29.247101 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a53d479d-e860-4a47-9f9c-f7df80c4e049 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:29.247587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a53d479d-e860-4a47-9f9c-f7df80c4e049 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:29.248165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a53d479d-e860-4a47-9f9c-f7df80c4e049 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:29.249028 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a53d479d-e860-4a47-9f9c-f7df80c4e049 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:29.249609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a53d479d-e860-4a47-9f9c-f7df80c4e049 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:29.250195 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a53d479d-e860-4a47-9f9c-f7df80c4e049 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:29.373214 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f356724f-d876-40e9-a93a-a3c7662e7eb4 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989" status: 200 len: 1650 microversion: 2.1 time: 0.302376 Aug 04 16:56:29.388090 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 292/552] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:29 2022] GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989 => generated 1650 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:29.446189 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a53d479d-e860-4a47-9f9c-f7df80c4e049 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:29.458576 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a53d479d-e860-4a47-9f9c-f7df80c4e049 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1313 microversion: 2.1 time: 0.227988 Aug 04 16:56:29.459175 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 261/553] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:29 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:56:29.533664 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-560cd849-df24-47b9-ab9f-e74c27ab07e1 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:29.534503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-560cd849-df24-47b9-ab9f-e74c27ab07e1 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: 9d66fc68-229a-4ec3-8c6a-af43a20d2462] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:29.562334 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-560cd849-df24-47b9-ab9f-e74c27ab07e1 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:29.565564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-560cd849-df24-47b9-ab9f-e74c27ab07e1 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:29.566677 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-560cd849-df24-47b9-ab9f-e74c27ab07e1 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:29.567626 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-560cd849-df24-47b9-ab9f-e74c27ab07e1 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:29.568257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-560cd849-df24-47b9-ab9f-e74c27ab07e1 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:29.569355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-560cd849-df24-47b9-ab9f-e74c27ab07e1 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:29.620943 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-560cd849-df24-47b9-ab9f-e74c27ab07e1 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:29.621482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-560cd849-df24-47b9-ab9f-e74c27ab07e1 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:29.622129 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-560cd849-df24-47b9-ab9f-e74c27ab07e1 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:29.622737 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-560cd849-df24-47b9-ab9f-e74c27ab07e1 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lazy-loading 'fault' on Instance uuid 9d66fc68-229a-4ec3-8c6a-af43a20d2462 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:56:29.634944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fadc8015-7ad9-476c-95f1-89f5e8b2b390 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:29.635978 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fadc8015-7ad9-476c-95f1-89f5e8b2b390 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: b8efce6c-198e-49a7-8576-32d80cb168df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:29.644685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fadc8015-7ad9-476c-95f1-89f5e8b2b390 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:29.646005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fadc8015-7ad9-476c-95f1-89f5e8b2b390 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:29.647460 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fadc8015-7ad9-476c-95f1-89f5e8b2b390 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:29.649414 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fadc8015-7ad9-476c-95f1-89f5e8b2b390 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:29.650172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fadc8015-7ad9-476c-95f1-89f5e8b2b390 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:29.650905 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fadc8015-7ad9-476c-95f1-89f5e8b2b390 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:29.849589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fadc8015-7ad9-476c-95f1-89f5e8b2b390 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:29.858373 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fadc8015-7ad9-476c-95f1-89f5e8b2b390 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df" status: 200 len: 1218 microversion: 2.1 time: 0.233871 Aug 04 16:56:29.866040 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 262/554] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:29 2022] GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df => generated 1218 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:29.867400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-40036fe5-3645-4ecf-853d-19d8a1e136b2 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:29.868230 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-40036fe5-3645-4ecf-853d-19d8a1e136b2 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: c0e9cb60-b590-412f-a6a1-fc8534bd1c97] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:29.875262 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40036fe5-3645-4ecf-853d-19d8a1e136b2 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:29.876104 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40036fe5-3645-4ecf-853d-19d8a1e136b2 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:29.876710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40036fe5-3645-4ecf-853d-19d8a1e136b2 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:29.877589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40036fe5-3645-4ecf-853d-19d8a1e136b2 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:29.878226 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40036fe5-3645-4ecf-853d-19d8a1e136b2 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:29.878800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40036fe5-3645-4ecf-853d-19d8a1e136b2 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:30.076199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-560cd849-df24-47b9-ab9f-e74c27ab07e1 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12efa078aa84861925925314ef00aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ed72eca39e4bab83ccbba779ac37c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:30.092301 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-560cd849-df24-47b9-ab9f-e74c27ab07e1 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462" status: 200 len: 1458 microversion: 2.1 time: 0.563397 Aug 04 16:56:30.093226 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 293/555] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:29 2022] GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462 => generated 1458 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:30.101816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-414c5ae3-74c9-4f8c-abb0-19d35b80b2d9 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:30.103028 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-414c5ae3-74c9-4f8c-abb0-19d35b80b2d9 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:30.111023 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-414c5ae3-74c9-4f8c-abb0-19d35b80b2d9 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:30.111476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-414c5ae3-74c9-4f8c-abb0-19d35b80b2d9 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:30.111921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-414c5ae3-74c9-4f8c-abb0-19d35b80b2d9 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:30.112639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-414c5ae3-74c9-4f8c-abb0-19d35b80b2d9 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:30.113106 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-414c5ae3-74c9-4f8c-abb0-19d35b80b2d9 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:30.113539 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-414c5ae3-74c9-4f8c-abb0-19d35b80b2d9 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:30.178048 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-40036fe5-3645-4ecf-853d-19d8a1e136b2 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712723e5418441c096f008d1520f6dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8c7c49e56743dd9f64102e53c2bec7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:30.187226 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-40036fe5-3645-4ecf-853d-19d8a1e136b2 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97" status: 200 len: 1319 microversion: 2.1 time: 0.324702 Aug 04 16:56:30.187803 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 263/556] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:29 2022] GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97 => generated 1319 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:30.203495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-414c5ae3-74c9-4f8c-abb0-19d35b80b2d9 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:30.212747 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-414c5ae3-74c9-4f8c-abb0-19d35b80b2d9 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:30.216838 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-414c5ae3-74c9-4f8c-abb0-19d35b80b2d9 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:30.223052 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-414c5ae3-74c9-4f8c-abb0-19d35b80b2d9 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1453 microversion: 2.75 time: 0.127220 Aug 04 16:56:30.223637 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 294/557] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:30 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1453 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:30.395344 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-32773fd0-382a-4aaf-9ddd-c42c5fb1e85c tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:30.395965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-32773fd0-382a-4aaf-9ddd-c42c5fb1e85c tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:30.402638 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32773fd0-382a-4aaf-9ddd-c42c5fb1e85c tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:30.403131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32773fd0-382a-4aaf-9ddd-c42c5fb1e85c tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:30.403570 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32773fd0-382a-4aaf-9ddd-c42c5fb1e85c tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:30.404274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32773fd0-382a-4aaf-9ddd-c42c5fb1e85c tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:30.405547 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32773fd0-382a-4aaf-9ddd-c42c5fb1e85c tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:30.406175 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32773fd0-382a-4aaf-9ddd-c42c5fb1e85c tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:30.481415 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e9f2b810-78e3-4275-9afc-b2b72f244714 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:30.482317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e9f2b810-78e3-4275-9afc-b2b72f244714 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:30.489648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9f2b810-78e3-4275-9afc-b2b72f244714 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:30.490171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9f2b810-78e3-4275-9afc-b2b72f244714 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:30.490811 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9f2b810-78e3-4275-9afc-b2b72f244714 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:30.491524 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9f2b810-78e3-4275-9afc-b2b72f244714 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:30.492013 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9f2b810-78e3-4275-9afc-b2b72f244714 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:30.492475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9f2b810-78e3-4275-9afc-b2b72f244714 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:30.734634 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-32773fd0-382a-4aaf-9ddd-c42c5fb1e85c tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989" status: 200 len: 1630 microversion: 2.1 time: 0.343336 Aug 04 16:56:30.735362 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 264/558] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:30 2022] GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989 => generated 1630 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:56:30.756133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c4e26a72-4350-42a5-b09d-5f366674f878 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851359-3", "block_migration": true, "disk_over_commit": false}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:30.758808 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c4e26a72-4350-42a5-b09d-5f366674f878 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:30.782866 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4e26a72-4350-42a5-b09d-5f366674f878 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:30.783730 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4e26a72-4350-42a5-b09d-5f366674f878 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:30.784377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4e26a72-4350-42a5-b09d-5f366674f878 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:30.785372 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4e26a72-4350-42a5-b09d-5f366674f878 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:30.786216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4e26a72-4350-42a5-b09d-5f366674f878 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:30.786818 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4e26a72-4350-42a5-b09d-5f366674f878 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:30.800257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e9f2b810-78e3-4275-9afc-b2b72f244714 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:30.804434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:30.815679 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e9f2b810-78e3-4275-9afc-b2b72f244714 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1313 microversion: 2.1 time: 0.338429 Aug 04 16:56:30.821877 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 295/559] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:30 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1313 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:30.834618 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-c4e26a72-4350-42a5-b09d-5f366674f878 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lazy-loading 'flavor' on Instance uuid fc381c07-ce7e-4a71-bede-f15c69c1d989 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:56:30.847997 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c4e26a72-4350-42a5-b09d-5f366674f878 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Going to try to live migrate instance to n-h2-851359-3 {{(pid=131044) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 16:56:30.887852 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cf02a1ab-d4cc-482a-884c-19df55fb0e46 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:30.888758 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cf02a1ab-d4cc-482a-884c-19df55fb0e46 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: b8efce6c-198e-49a7-8576-32d80cb168df] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:30.897675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cf02a1ab-d4cc-482a-884c-19df55fb0e46 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:30.898502 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cf02a1ab-d4cc-482a-884c-19df55fb0e46 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:30.899185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cf02a1ab-d4cc-482a-884c-19df55fb0e46 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:30.900153 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cf02a1ab-d4cc-482a-884c-19df55fb0e46 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:30.900854 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cf02a1ab-d4cc-482a-884c-19df55fb0e46 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:30.901501 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cf02a1ab-d4cc-482a-884c-19df55fb0e46 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:30.993375 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cf02a1ab-d4cc-482a-884c-19df55fb0e46 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:31.004027 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cf02a1ab-d4cc-482a-884c-19df55fb0e46 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df" status: 200 len: 1274 microversion: 2.1 time: 0.119750 Aug 04 16:56:31.004734 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 296/560] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:30 2022] GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df => generated 1274 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:56:31.115869 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3a85450b-c3cc-4f19-8b07-e9a1bba1e504 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:31.116731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3a85450b-c3cc-4f19-8b07-e9a1bba1e504 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: 9d66fc68-229a-4ec3-8c6a-af43a20d2462] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:31.132204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a85450b-c3cc-4f19-8b07-e9a1bba1e504 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:31.132707 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a85450b-c3cc-4f19-8b07-e9a1bba1e504 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:31.133148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a85450b-c3cc-4f19-8b07-e9a1bba1e504 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:31.133854 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a85450b-c3cc-4f19-8b07-e9a1bba1e504 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:31.134510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a85450b-c3cc-4f19-8b07-e9a1bba1e504 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:31.134949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a85450b-c3cc-4f19-8b07-e9a1bba1e504 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:31.177572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a85450b-c3cc-4f19-8b07-e9a1bba1e504 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:31.178087 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a85450b-c3cc-4f19-8b07-e9a1bba1e504 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:31.178526 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a85450b-c3cc-4f19-8b07-e9a1bba1e504 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:31.179363 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-3a85450b-c3cc-4f19-8b07-e9a1bba1e504 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lazy-loading 'fault' on Instance uuid 9d66fc68-229a-4ec3-8c6a-af43a20d2462 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:56:31.816953 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3a85450b-c3cc-4f19-8b07-e9a1bba1e504 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12efa078aa84861925925314ef00aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ed72eca39e4bab83ccbba779ac37c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:31.828090 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3a85450b-c3cc-4f19-8b07-e9a1bba1e504 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462" status: 200 len: 1458 microversion: 2.1 time: 0.715884 Aug 04 16:56:31.829324 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 297/561] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:31 2022] GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462 => generated 1458 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:56:31.845309 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b70b8bc1-bba7-4feb-9f53-2b0c0a4ce8c8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:31.846232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b70b8bc1-bba7-4feb-9f53-2b0c0a4ce8c8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: c0e9cb60-b590-412f-a6a1-fc8534bd1c97] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:31.856429 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b70b8bc1-bba7-4feb-9f53-2b0c0a4ce8c8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:31.857059 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b70b8bc1-bba7-4feb-9f53-2b0c0a4ce8c8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:31.857524 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b70b8bc1-bba7-4feb-9f53-2b0c0a4ce8c8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:31.858304 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b70b8bc1-bba7-4feb-9f53-2b0c0a4ce8c8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:31.859232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b70b8bc1-bba7-4feb-9f53-2b0c0a4ce8c8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:31.859670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b70b8bc1-bba7-4feb-9f53-2b0c0a4ce8c8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:32.580597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b70b8bc1-bba7-4feb-9f53-2b0c0a4ce8c8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712723e5418441c096f008d1520f6dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8c7c49e56743dd9f64102e53c2bec7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:32.588269 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b70b8bc1-bba7-4feb-9f53-2b0c0a4ce8c8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97" status: 200 len: 1319 microversion: 2.1 time: 0.757527 Aug 04 16:56:32.588849 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 298/562] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:31 2022] GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97 => generated 1319 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:32.593855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6ca3c36f-0cbc-4ad0-bdf1-475b370d8ae3 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:32.595170 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6ca3c36f-0cbc-4ad0-bdf1-475b370d8ae3 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:32.609587 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ca3c36f-0cbc-4ad0-bdf1-475b370d8ae3 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:32.610593 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ca3c36f-0cbc-4ad0-bdf1-475b370d8ae3 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:32.611204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ca3c36f-0cbc-4ad0-bdf1-475b370d8ae3 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:32.612685 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ca3c36f-0cbc-4ad0-bdf1-475b370d8ae3 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:32.613319 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ca3c36f-0cbc-4ad0-bdf1-475b370d8ae3 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:32.613931 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ca3c36f-0cbc-4ad0-bdf1-475b370d8ae3 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:32.696572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6ca3c36f-0cbc-4ad0-bdf1-475b370d8ae3 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:32.707242 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6ca3c36f-0cbc-4ad0-bdf1-475b370d8ae3 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:32.709398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6ca3c36f-0cbc-4ad0-bdf1-475b370d8ae3 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:32.716570 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6ca3c36f-0cbc-4ad0-bdf1-475b370d8ae3 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1438 microversion: 2.75 time: 0.126280 Aug 04 16:56:32.730672 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 299/563] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:32 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1438 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:32.742188 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0c2df0c0-0a82-49e2-b565-35a39a0e0cc9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:32.742909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0c2df0c0-0a82-49e2-b565-35a39a0e0cc9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:32.753177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c2df0c0-0a82-49e2-b565-35a39a0e0cc9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:32.753740 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c2df0c0-0a82-49e2-b565-35a39a0e0cc9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:32.754308 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c2df0c0-0a82-49e2-b565-35a39a0e0cc9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:32.755100 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c2df0c0-0a82-49e2-b565-35a39a0e0cc9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:32.755574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c2df0c0-0a82-49e2-b565-35a39a0e0cc9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:32.756185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c2df0c0-0a82-49e2-b565-35a39a0e0cc9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:33.207520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0c2df0c0-0a82-49e2-b565-35a39a0e0cc9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:33.216613 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0c2df0c0-0a82-49e2-b565-35a39a0e0cc9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1313 microversion: 2.1 time: 0.484766 Aug 04 16:56:33.217510 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 300/564] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:32 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1313 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:33.237165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-38be1243-29c1-4a1f-8b64-2d7f1f13c00c tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:33.237994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-38be1243-29c1-4a1f-8b64-2d7f1f13c00c tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: b8efce6c-198e-49a7-8576-32d80cb168df] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:33.245471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38be1243-29c1-4a1f-8b64-2d7f1f13c00c tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:33.246227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38be1243-29c1-4a1f-8b64-2d7f1f13c00c tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:33.246653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38be1243-29c1-4a1f-8b64-2d7f1f13c00c tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:33.247426 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38be1243-29c1-4a1f-8b64-2d7f1f13c00c tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:33.247898 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38be1243-29c1-4a1f-8b64-2d7f1f13c00c tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:33.248334 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38be1243-29c1-4a1f-8b64-2d7f1f13c00c tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:33.347182 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-38be1243-29c1-4a1f-8b64-2d7f1f13c00c tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:33.355347 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-38be1243-29c1-4a1f-8b64-2d7f1f13c00c tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df" status: 200 len: 1280 microversion: 2.1 time: 0.123626 Aug 04 16:56:33.356440 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 301/565] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:33 2022] GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df => generated 1280 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:33.361617 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-797a4fdd-1bf7-4c42-b10a-d88fae12150e req-0766d31a-3485-4446-b98e-b7edd19c1585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d66fc68-229a-4ec3-8c6a-af43a20d2462", "name": "network-vif-deleted", "tag": "8efedb88-926c-4bea-a1ea-6a41752b45e9"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:33.372781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-797a4fdd-1bf7-4c42-b10a-d88fae12150e req-0766d31a-3485-4446-b98e-b7edd19c1585 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:33.373466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-797a4fdd-1bf7-4c42-b10a-d88fae12150e req-0766d31a-3485-4446-b98e-b7edd19c1585 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:33.374350 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-797a4fdd-1bf7-4c42-b10a-d88fae12150e req-0766d31a-3485-4446-b98e-b7edd19c1585 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:33.387584 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-797a4fdd-1bf7-4c42-b10a-d88fae12150e req-0766d31a-3485-4446-b98e-b7edd19c1585 service nova] Creating event network-vif-deleted:8efedb88-926c-4bea-a1ea-6a41752b45e9 for instance 9d66fc68-229a-4ec3-8c6a-af43a20d2462 on n-h2-851359-3 Aug 04 16:56:33.393828 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-797a4fdd-1bf7-4c42-b10a-d88fae12150e req-0766d31a-3485-4446-b98e-b7edd19c1585 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036019 Aug 04 16:56:33.394472 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 302/566] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:33.624049 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c4e26a72-4350-42a5-b09d-5f366674f878 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989/action" status: 202 len: 0 microversion: 2.1 time: 2.871627 Aug 04 16:56:33.626052 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 265/567] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:56:30 2022] POST /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989/action => generated 0 bytes in 2874 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:56:33.631035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4410c935-7eeb-4a6a-bd4f-f1106661c200 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:33.632132 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4410c935-7eeb-4a6a-bd4f-f1106661c200 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: 9d66fc68-229a-4ec3-8c6a-af43a20d2462] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:33.645291 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4410c935-7eeb-4a6a-bd4f-f1106661c200 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:33.646187 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4410c935-7eeb-4a6a-bd4f-f1106661c200 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:33.646899 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4410c935-7eeb-4a6a-bd4f-f1106661c200 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:33.647851 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4410c935-7eeb-4a6a-bd4f-f1106661c200 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:33.648534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4410c935-7eeb-4a6a-bd4f-f1106661c200 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:33.649187 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4410c935-7eeb-4a6a-bd4f-f1106661c200 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:33.667177 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:33.670860 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-4410c935-7eeb-4a6a-bd4f-f1106661c200 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] HTTP exception thrown: Instance 9d66fc68-229a-4ec3-8c6a-af43a20d2462 could not be found. Aug 04 16:56:33.684444 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4410c935-7eeb-4a6a-bd4f-f1106661c200 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Request method failure captured: Aug 04 16:56:33.684444 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462 HTTP/1.1 Aug 04 16:56:33.684444 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:56:33.684444 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:56:33.684444 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:56:33.684444 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:56:33.684444 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:56:33.684444 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:56:33.684444 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:56:33.684444 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:33.684444 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_oBtkwavIdTC29hFuseZiZRg_Ei4T9WN50LARf4FZkWYS0GRjeVTKoWE9ZUr3zwxdCSci7KRy3WPW0ujpdZo_OxEZObuzoUYigFK2Md8tPPyDMUcgU2BR65DZmOHgnQcHVjBIK2KV5AVyvPuuJn61J3sl6tWrOq6v8_MQtbMgsNTaE Aug 04 16:56:33.684444 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:56:33.684444 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:56:33.684444 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:56:33.684444 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:56:33.684444 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:56:33.684444 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:56:33.684444 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 37ed72eca39e4bab83ccbba779ac37c9 Aug 04 16:56:33.684444 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-DeleteServersAdminTestJSON-113822406 Aug 04 16:56:33.684444 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:56:33.684444 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:56:33.685732 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/37ed72eca39e4bab83ccbba779ac37c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/37ed72eca39e4bab83ccbba779ac37c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_37ed72eca39e4bab83ccbba779ac37c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/37ed72eca39e4bab83ccbba779ac37c9"}]}] Aug 04 16:56:33.685732 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-DeleteServersAdminTestJSON-113822406 Aug 04 16:56:33.685732 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 37ed72eca39e4bab83ccbba779ac37c9 Aug 04 16:56:33.685732 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-113822406 Aug 04 16:56:33.685732 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-DeleteServersAdminTestJSON-113822406-project Aug 04 16:56:33.685732 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:56:33.685732 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:56:33.685732 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: c12efa078aa84861925925314ef00aea Aug 04 16:56:33.685732 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-DeleteServersAdminTestJSON-113822406-project Aug 04 16:56:33.685732 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:56:33.685732 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 9d66fc68-229a-4ec3-8c6a-af43a20d2462 could not be found. Aug 04 16:56:33.685732 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '9d66fc68-229a-4ec3-8c6a-af43a20d2462'} Aug 04 16:56:33.687007 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:33.687007 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:33.687007 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:56:33.687007 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:56:33.687007 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:56:33.687007 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:56:33.687007 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:56:33.687007 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:56:33.687007 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:56:33.687007 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:56:33.687007 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d66fc68-229a-4ec3-8c6a-af43a20d2462 could not be found. Aug 04 16:56:33.687007 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:33.687007 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:33.687007 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:33.687007 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:33.687007 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:33.687007 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:33.687007 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:33.687007 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:33.687007 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:33.688211 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:33.688211 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:56:33.688211 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:56:33.688211 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:56:33.688211 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:56:33.688211 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:56:33.688211 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:56:33.688211 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d66fc68-229a-4ec3-8c6a-af43a20d2462 could not be found. Aug 04 16:56:33.688211 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:33.688211 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:33.688211 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:33.688211 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:33.688211 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:33.688211 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:33.688211 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:56:33.688211 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:56:33.688211 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d66fc68-229a-4ec3-8c6a-af43a20d2462 could not be found. Aug 04 16:56:33.688211 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:33.695014 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4410c935-7eeb-4a6a-bd4f-f1106661c200 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Returning 404 to user: Instance 9d66fc68-229a-4ec3-8c6a-af43a20d2462 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:33.696161 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4410c935-7eeb-4a6a-bd4f-f1106661c200 tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462" status: 404 len: 111 microversion: 2.1 time: 0.068931 Aug 04 16:56:33.702955 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 266/568] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:33 2022] GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:56:33.794957 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ffabeb73-5799-41c6-b8e3-53a4337a568c tempest-ImagesMetadataNegativeTestJSON-637878481 tempest-ImagesMetadataNegativeTestJSON-637878481-project] Calling method '.version_select at 0x7f1e5bc39160>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:33.824836 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-ffabeb73-5799-41c6-b8e3-53a4337a568c tempest-ImagesMetadataNegativeTestJSON-637878481 tempest-ImagesMetadataNegativeTestJSON-637878481-project] HTTP exception thrown: Image not found. Aug 04 16:56:33.836719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5291e979-a924-4b89-84a6-7808ea43952a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:33.837793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ffabeb73-5799-41c6-b8e3-53a4337a568c tempest-ImagesMetadataNegativeTestJSON-637878481 tempest-ImagesMetadataNegativeTestJSON-637878481-project] Request method failure captured: Aug 04 16:56:33.837793 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/images/5e333c47-c999-4c64-a286-346a37023498/metadata/os_distro HTTP/1.1 Aug 04 16:56:33.837793 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:56:33.837793 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:56:33.837793 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:56:33.837793 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:56:33.837793 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:56:33.837793 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:56:33.837793 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:56:33.837793 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:33.837793 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_pBNRgaBmm3wRpRJHCFevzbHJc1JO_4kg5HDa1zovkvSBre6e4autl1VJi_oRo816SNwyHDymyXjZEXtU4k8qU36PR8_B1q2cP9MugF98-jRa_aO3gGY-kpF8d1qyiFwT5sWxI4vMcOfia--aKxbZvwETP4ThvK6T6SJsG_N6UAud8 Aug 04 16:56:33.837793 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:56:33.837793 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:56:33.837793 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:56:33.837793 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:56:33.837793 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:56:33.837793 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:56:33.837793 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 8436d01737024fa59d8f0b81c6552f29 Aug 04 16:56:33.837793 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-637878481 Aug 04 16:56:33.837793 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:56:33.837793 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:56:33.839419 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8436d01737024fa59d8f0b81c6552f29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8436d01737024fa59d8f0b81c6552f29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8436d01737024fa59d8f0b81c6552f29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8436d01737024fa59d8f0b81c6552f29"}]}] Aug 04 16:56:33.839419 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-637878481 Aug 04 16:56:33.839419 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 8436d01737024fa59d8f0b81c6552f29 Aug 04 16:56:33.839419 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-637878481 Aug 04 16:56:33.839419 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ImagesMetadataNegativeTestJSON-637878481-project Aug 04 16:56:33.839419 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:56:33.839419 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:56:33.839419 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 2b5baa36ebc3476c8cc28e1727939dc0 Aug 04 16:56:33.839419 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-637878481-project Aug 04 16:56:33.839419 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:56:33.839419 n-d-851359-3 devstack@n-api.service[131044]: exception: Image not found. Aug 04 16:56:33.839419 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'image_id': '5e333c47-c999-4c64-a286-346a37023498', 'id': 'os_distro'} Aug 04 16:56:33.839419 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:33.840299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:33.840299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 16:56:33.840299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 16:56:33.840299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:56:33.840299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:56:33.840299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 16:56:33.840299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 16:56:33.840299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:56:33.840299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:56:33.840299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 16:56:33.840299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 16:56:33.840299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 16:56:33.840299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 16:56:33.840299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:56:33.840299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:56:33.840299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:56:33.840299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:56:33.840299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5e333c47-c999-4c64-a286-346a37023498 Aug 04 16:56:33.841374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:33.841374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:33.841374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:33.841374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:33.841374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 04 16:56:33.841374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 04 16:56:33.841374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 16:56:33.841374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 16:56:33.841374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 16:56:33.841374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 16:56:33.841374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 16:56:33.841374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 16:56:33.841374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 16:56:33.841374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 16:56:33.841374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:56:33.841374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:56:33.841374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 16:56:33.841374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 16:56:33.841374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:56:33.841374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:56:33.846898 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 16:56:33.846898 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 16:56:33.846898 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 16:56:33.846898 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 16:56:33.846898 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:56:33.846898 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:56:33.846898 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:56:33.846898 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:56:33.846898 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5e333c47-c999-4c64-a286-346a37023498 could not be found. Aug 04 16:56:33.846898 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:33.846898 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:33.846898 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:33.846898 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:33.846898 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:33.846898 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:33.846898 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:33.846898 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:33.846898 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:56:33.846898 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:56:33.848073 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:33.848073 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:33.848073 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 04 16:56:33.848073 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 04 16:56:33.848073 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 04 16:56:33.848073 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 16:56:33.848073 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 16:56:33.848073 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:33.848073 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:33.848073 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:33.848073 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:33.848073 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:33.848073 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:33.848073 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:56:33.848073 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:56:33.848073 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 16:56:33.848073 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:33.848073 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ffabeb73-5799-41c6-b8e3-53a4337a568c tempest-ImagesMetadataNegativeTestJSON-637878481 tempest-ImagesMetadataNegativeTestJSON-637878481-project] Returning 404 to user: Image not found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:33.849115 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ffabeb73-5799-41c6-b8e3-53a4337a568c tempest-ImagesMetadataNegativeTestJSON-637878481 tempest-ImagesMetadataNegativeTestJSON-637878481-project] 10.222.0.93 "DELETE /compute/v2.1/images/5e333c47-c999-4c64-a286-346a37023498/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.136044 Aug 04 16:56:33.849196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5291e979-a924-4b89-84a6-7808ea43952a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:33.849277 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 267/569] 10.222.0.93 () {58 vars in 1293 bytes} [Thu Aug 4 16:56:33 2022] DELETE /compute/v2.1/images/5e333c47-c999-4c64-a286-346a37023498/metadata/os_distro => generated 62 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:56:33.849452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-180a6643-7039-4542-8923-f60badc30438 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:33.850282 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-180a6643-7039-4542-8923-f60badc30438 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: c0e9cb60-b590-412f-a6a1-fc8534bd1c97] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:33.856538 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5291e979-a924-4b89-84a6-7808ea43952a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:33.857096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5291e979-a924-4b89-84a6-7808ea43952a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:33.857572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5291e979-a924-4b89-84a6-7808ea43952a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:33.858268 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-180a6643-7039-4542-8923-f60badc30438 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:33.858409 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5291e979-a924-4b89-84a6-7808ea43952a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:33.858770 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-180a6643-7039-4542-8923-f60badc30438 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:33.858885 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5291e979-a924-4b89-84a6-7808ea43952a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:33.859195 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5291e979-a924-4b89-84a6-7808ea43952a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:33.859305 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-180a6643-7039-4542-8923-f60badc30438 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:33.860187 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-180a6643-7039-4542-8923-f60badc30438 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:33.860680 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-180a6643-7039-4542-8923-f60badc30438 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:33.861116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-180a6643-7039-4542-8923-f60badc30438 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:33.983014 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5291e979-a924-4b89-84a6-7808ea43952a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:56:33.984111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5291e979-a924-4b89-84a6-7808ea43952a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:56:33.984851 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5291e979-a924-4b89-84a6-7808ea43952a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:56:33.985459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5291e979-a924-4b89-84a6-7808ea43952a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:56:33.993957 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5291e979-a924-4b89-84a6-7808ea43952a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:56:34.081073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5291e979-a924-4b89-84a6-7808ea43952a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:34.093071 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5291e979-a924-4b89-84a6-7808ea43952a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:34.093849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5291e979-a924-4b89-84a6-7808ea43952a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:34.095010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5291e979-a924-4b89-84a6-7808ea43952a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:34.095949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5291e979-a924-4b89-84a6-7808ea43952a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:34.096675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5291e979-a924-4b89-84a6-7808ea43952a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:34.097398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5291e979-a924-4b89-84a6-7808ea43952a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:34.119639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-180a6643-7039-4542-8923-f60badc30438 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712723e5418441c096f008d1520f6dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8c7c49e56743dd9f64102e53c2bec7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:34.132010 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-180a6643-7039-4542-8923-f60badc30438 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97" status: 200 len: 1319 microversion: 2.1 time: 0.289262 Aug 04 16:56:34.147838 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 268/570] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:33 2022] GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97 => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:34.155026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-367d546f-7b05-4c74-9709-0b99a7e12032 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:34.155909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-367d546f-7b05-4c74-9709-0b99a7e12032 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:34.165552 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-367d546f-7b05-4c74-9709-0b99a7e12032 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:34.166555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-367d546f-7b05-4c74-9709-0b99a7e12032 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:34.167225 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-367d546f-7b05-4c74-9709-0b99a7e12032 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:34.168622 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-367d546f-7b05-4c74-9709-0b99a7e12032 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:34.169331 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-367d546f-7b05-4c74-9709-0b99a7e12032 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:34.170006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-367d546f-7b05-4c74-9709-0b99a7e12032 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:34.387285 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-5291e979-a924-4b89-84a6-7808ea43952a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lazy-loading 'services' on Instance uuid 96d30c66-24c7-4b25-81cd-fb638035a1cb {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:56:34.499323 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-367d546f-7b05-4c74-9709-0b99a7e12032 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:34.514237 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-367d546f-7b05-4c74-9709-0b99a7e12032 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989" status: 200 len: 1504 microversion: 2.1 time: 0.362287 Aug 04 16:56:34.515155 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 269/571] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:34 2022] GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989 => generated 1504 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:34.524519 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fb2e7dd1-0131-4626-92ce-bbc746350dea tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:34.525400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fb2e7dd1-0131-4626-92ce-bbc746350dea tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: 9d66fc68-229a-4ec3-8c6a-af43a20d2462] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:34.532030 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5291e979-a924-4b89-84a6-7808ea43952a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb/action" status: 202 len: 1942 microversion: 2.75 time: 1.135920 Aug 04 16:56:34.532987 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 303/572] 10.222.0.93 () {62 vars in 1319 bytes} [Thu Aug 4 16:56:33 2022] POST /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb/action => generated 1942 bytes in 1138 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 04 16:56:34.556142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b0c1b20c-934e-4e96-9578-2c8adee95562 tempest-ImagesMetadataNegativeTestJSON-637878481 tempest-ImagesMetadataNegativeTestJSON-637878481-project] Calling method '.version_select at 0x7f1e5bb11790>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:34.576079 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb2e7dd1-0131-4626-92ce-bbc746350dea tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:34.576839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb2e7dd1-0131-4626-92ce-bbc746350dea tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:34.577368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb2e7dd1-0131-4626-92ce-bbc746350dea tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:34.578296 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb2e7dd1-0131-4626-92ce-bbc746350dea tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:34.579363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb2e7dd1-0131-4626-92ce-bbc746350dea tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:34.585768 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb2e7dd1-0131-4626-92ce-bbc746350dea tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:34.586381 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-b0c1b20c-934e-4e96-9578-2c8adee95562 tempest-ImagesMetadataNegativeTestJSON-637878481 tempest-ImagesMetadataNegativeTestJSON-637878481-project] HTTP exception thrown: Image not found. Aug 04 16:56:34.591177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b0c1b20c-934e-4e96-9578-2c8adee95562 tempest-ImagesMetadataNegativeTestJSON-637878481 tempest-ImagesMetadataNegativeTestJSON-637878481-project] Request method failure captured: Aug 04 16:56:34.591177 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/images/7fb0278a-7f34-4cfa-a8f7-e626befb7e79/metadata/os_version HTTP/1.1 Aug 04 16:56:34.591177 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:56:34.591177 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:56:34.591177 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:56:34.591177 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:56:34.591177 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:56:34.591177 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:56:34.591177 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:56:34.591177 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:34.591177 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_pBNRgaBmm3wRpRJHCFevzbHJc1JO_4kg5HDa1zovkvSBre6e4autl1VJi_oRo816SNwyHDymyXjZEXtU4k8qU36PR8_B1q2cP9MugF98-jRa_aO3gGY-kpF8d1qyiFwT5sWxI4vMcOfia--aKxbZvwETP4ThvK6T6SJsG_N6UAud8 Aug 04 16:56:34.591177 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:56:34.591177 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:56:34.591177 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:56:34.591177 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:56:34.591177 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:56:34.591177 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:56:34.591177 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 8436d01737024fa59d8f0b81c6552f29 Aug 04 16:56:34.591177 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-637878481 Aug 04 16:56:34.591177 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 16:56:34.591177 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 16:56:34.592551 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8436d01737024fa59d8f0b81c6552f29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8436d01737024fa59d8f0b81c6552f29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8436d01737024fa59d8f0b81c6552f29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8436d01737024fa59d8f0b81c6552f29"}]}] Aug 04 16:56:34.592551 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-637878481 Aug 04 16:56:34.592551 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 8436d01737024fa59d8f0b81c6552f29 Aug 04 16:56:34.592551 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-637878481 Aug 04 16:56:34.592551 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ImagesMetadataNegativeTestJSON-637878481-project Aug 04 16:56:34.592551 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:56:34.592551 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:56:34.592551 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 2b5baa36ebc3476c8cc28e1727939dc0 Aug 04 16:56:34.592551 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-637878481-project Aug 04 16:56:34.592551 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 16:56:34.592551 n-d-851359-3 devstack@n-api.service[131043]: exception: Image not found. Aug 04 16:56:34.592551 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'image_id': '7fb0278a-7f34-4cfa-a8f7-e626befb7e79', 'id': 'os_version'} Aug 04 16:56:34.592551 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:34.593346 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:34.593346 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 16:56:34.593346 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 16:56:34.593346 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:56:34.593346 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:56:34.593346 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 16:56:34.593346 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 16:56:34.593346 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:56:34.593346 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:56:34.593346 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 16:56:34.593346 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 16:56:34.593346 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 16:56:34.593346 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 16:56:34.593346 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:56:34.593346 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:56:34.593346 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:56:34.593346 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:56:34.593346 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7fb0278a-7f34-4cfa-a8f7-e626befb7e79 Aug 04 16:56:34.594535 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:34.594535 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:34.594535 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:34.594535 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:34.594535 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 04 16:56:34.594535 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 04 16:56:34.594535 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 16:56:34.594535 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 16:56:34.594535 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 16:56:34.594535 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 16:56:34.594535 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 16:56:34.594535 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 16:56:34.594535 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 16:56:34.594535 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 16:56:34.594535 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:56:34.594535 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:56:34.594535 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 16:56:34.594535 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 16:56:34.594535 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:56:34.594535 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:56:34.595656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 16:56:34.595656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 16:56:34.595656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 16:56:34.595656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 16:56:34.595656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:56:34.595656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:56:34.595656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:56:34.595656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:56:34.595656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7fb0278a-7f34-4cfa-a8f7-e626befb7e79 could not be found. Aug 04 16:56:34.595656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:34.595656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:34.595656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:34.595656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:34.595656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:34.595656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:34.595656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:34.595656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:34.595656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:56:34.595656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:56:34.596732 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:34.596732 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:34.596732 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 04 16:56:34.596732 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 04 16:56:34.596732 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 04 16:56:34.596732 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 16:56:34.596732 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 16:56:34.596732 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:34.596732 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:34.596732 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:34.596732 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:34.596732 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:34.596732 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:34.596732 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:56:34.596732 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:56:34.596732 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 16:56:34.596732 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:34.596732 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b0c1b20c-934e-4e96-9578-2c8adee95562 tempest-ImagesMetadataNegativeTestJSON-637878481 tempest-ImagesMetadataNegativeTestJSON-637878481-project] Returning 404 to user: Image not found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:34.600354 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b0c1b20c-934e-4e96-9578-2c8adee95562 tempest-ImagesMetadataNegativeTestJSON-637878481 tempest-ImagesMetadataNegativeTestJSON-637878481-project] 10.222.0.93 "GET /compute/v2.1/images/7fb0278a-7f34-4cfa-a8f7-e626befb7e79/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.049413 Aug 04 16:56:34.602399 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 304/573] 10.222.0.93 () {58 vars in 1293 bytes} [Thu Aug 4 16:56:34 2022] GET /compute/v2.1/images/7fb0278a-7f34-4cfa-a8f7-e626befb7e79/metadata/os_version => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:56:34.607550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-897d4f5b-7acd-4404-8973-a6fd18ac6b70 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:34.608237 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-897d4f5b-7acd-4404-8973-a6fd18ac6b70 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:34.612271 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-fb2e7dd1-0131-4626-92ce-bbc746350dea tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] HTTP exception thrown: Instance 9d66fc68-229a-4ec3-8c6a-af43a20d2462 could not be found. Aug 04 16:56:34.614910 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fb2e7dd1-0131-4626-92ce-bbc746350dea tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Request method failure captured: Aug 04 16:56:34.614910 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462 HTTP/1.1 Aug 04 16:56:34.614910 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:56:34.614910 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:56:34.614910 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:56:34.614910 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:56:34.614910 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:56:34.614910 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:56:34.614910 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:56:34.614910 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:34.614910 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_oBtkwavIdTC29hFuseZiZRg_Ei4T9WN50LARf4FZkWYS0GRjeVTKoWE9ZUr3zwxdCSci7KRy3WPW0ujpdZo_OxEZObuzoUYigFK2Md8tPPyDMUcgU2BR65DZmOHgnQcHVjBIK2KV5AVyvPuuJn61J3sl6tWrOq6v8_MQtbMgsNTaE Aug 04 16:56:34.614910 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:56:34.614910 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:56:34.614910 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:56:34.614910 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:56:34.614910 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:56:34.614910 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:56:34.614910 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 37ed72eca39e4bab83ccbba779ac37c9 Aug 04 16:56:34.614910 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-DeleteServersAdminTestJSON-113822406 Aug 04 16:56:34.614910 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:56:34.614910 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:56:34.616195 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/37ed72eca39e4bab83ccbba779ac37c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/37ed72eca39e4bab83ccbba779ac37c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_37ed72eca39e4bab83ccbba779ac37c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/37ed72eca39e4bab83ccbba779ac37c9"}]}] Aug 04 16:56:34.616195 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-DeleteServersAdminTestJSON-113822406 Aug 04 16:56:34.616195 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 37ed72eca39e4bab83ccbba779ac37c9 Aug 04 16:56:34.616195 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-113822406 Aug 04 16:56:34.616195 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-DeleteServersAdminTestJSON-113822406-project Aug 04 16:56:34.616195 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:56:34.616195 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:56:34.616195 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: c12efa078aa84861925925314ef00aea Aug 04 16:56:34.616195 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-DeleteServersAdminTestJSON-113822406-project Aug 04 16:56:34.616195 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:56:34.616195 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 9d66fc68-229a-4ec3-8c6a-af43a20d2462 could not be found. Aug 04 16:56:34.616195 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '9d66fc68-229a-4ec3-8c6a-af43a20d2462'} Aug 04 16:56:34.616914 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:34.616914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:34.616914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:56:34.616914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:56:34.616914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:56:34.616914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:56:34.616914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:56:34.616914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:56:34.616914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:56:34.616914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:56:34.616914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d66fc68-229a-4ec3-8c6a-af43a20d2462 could not be found. Aug 04 16:56:34.616914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:34.616914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:34.616914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:34.616914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:34.616914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:34.616914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:34.616914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:34.616914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:34.616914 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:34.618149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:34.618149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:56:34.618149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:56:34.618149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:56:34.618149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:56:34.618149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:56:34.618149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:56:34.618149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:56:34.618149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:56:34.618149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d66fc68-229a-4ec3-8c6a-af43a20d2462 could not be found. Aug 04 16:56:34.618149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:34.618149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:34.618149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:34.618149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:34.618149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:34.618149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:34.618149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:56:34.618149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:56:34.618149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d66fc68-229a-4ec3-8c6a-af43a20d2462 could not be found. Aug 04 16:56:34.618149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:34.619371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-897d4f5b-7acd-4404-8973-a6fd18ac6b70 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:34.619371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-897d4f5b-7acd-4404-8973-a6fd18ac6b70 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:34.619371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-897d4f5b-7acd-4404-8973-a6fd18ac6b70 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:34.619371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-897d4f5b-7acd-4404-8973-a6fd18ac6b70 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:34.619643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-897d4f5b-7acd-4404-8973-a6fd18ac6b70 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:34.620569 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-897d4f5b-7acd-4404-8973-a6fd18ac6b70 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:34.621910 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fb2e7dd1-0131-4626-92ce-bbc746350dea tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Returning 404 to user: Instance 9d66fc68-229a-4ec3-8c6a-af43a20d2462 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:34.623846 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fb2e7dd1-0131-4626-92ce-bbc746350dea tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462" status: 404 len: 111 microversion: 2.1 time: 0.105549 Aug 04 16:56:34.630301 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 270/574] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 16:56:34 2022] DELETE /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:56:34.637883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-019904dc-7743-4e40-962c-08863340d42b tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:34.638892 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-019904dc-7743-4e40-962c-08863340d42b tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: b8efce6c-198e-49a7-8576-32d80cb168df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:34.647293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-019904dc-7743-4e40-962c-08863340d42b tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:34.647790 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-019904dc-7743-4e40-962c-08863340d42b tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:34.648231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-019904dc-7743-4e40-962c-08863340d42b tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:34.648940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-019904dc-7743-4e40-962c-08863340d42b tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:34.649594 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-019904dc-7743-4e40-962c-08863340d42b tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:34.650081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-019904dc-7743-4e40-962c-08863340d42b tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:34.966222 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-897d4f5b-7acd-4404-8973-a6fd18ac6b70 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:34.971250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-019904dc-7743-4e40-962c-08863340d42b tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:34.974296 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-897d4f5b-7acd-4404-8973-a6fd18ac6b70 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1313 microversion: 2.1 time: 0.370495 Aug 04 16:56:34.974998 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 305/575] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:34 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1313 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:34.979859 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-a2917832-ff87-46dd-afda-402766b23017 req-b5ce5c08-5d57-4d6a-a0c4-123f95ca7e42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e9cb60-b590-412f-a6a1-fc8534bd1c97", "name": "network-vif-plugged", "status": "completed", "tag": "f90a54ce-7427-41d6-bbc9-f7eddedbc6bf"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:34.990505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a2917832-ff87-46dd-afda-402766b23017 req-b5ce5c08-5d57-4d6a-a0c4-123f95ca7e42 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:34.990993 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a2917832-ff87-46dd-afda-402766b23017 req-b5ce5c08-5d57-4d6a-a0c4-123f95ca7e42 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:34.991435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a2917832-ff87-46dd-afda-402766b23017 req-b5ce5c08-5d57-4d6a-a0c4-123f95ca7e42 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:34.992137 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-019904dc-7743-4e40-962c-08863340d42b tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df" status: 200 len: 1322 microversion: 2.1 time: 0.359870 Aug 04 16:56:34.992893 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 271/576] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:34 2022] GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df => generated 1322 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:35.000147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d964fbdd-a4e9-40b5-9783-15fd30c330b1 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:35.002036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d964fbdd-a4e9-40b5-9783-15fd30c330b1 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:35.004473 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-a2917832-ff87-46dd-afda-402766b23017 req-b5ce5c08-5d57-4d6a-a0c4-123f95ca7e42 service nova] Creating event network-vif-plugged:f90a54ce-7427-41d6-bbc9-f7eddedbc6bf for instance c0e9cb60-b590-412f-a6a1-fc8534bd1c97 on n-h1-851359-3 Aug 04 16:56:35.008826 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d964fbdd-a4e9-40b5-9783-15fd30c330b1 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:35.009590 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d964fbdd-a4e9-40b5-9783-15fd30c330b1 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:35.009869 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-a2917832-ff87-46dd-afda-402766b23017 req-b5ce5c08-5d57-4d6a-a0c4-123f95ca7e42 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033654 Aug 04 16:56:35.010311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d964fbdd-a4e9-40b5-9783-15fd30c330b1 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:35.010913 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 306/577] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:35.011044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d964fbdd-a4e9-40b5-9783-15fd30c330b1 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:35.012443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d964fbdd-a4e9-40b5-9783-15fd30c330b1 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:35.013151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d964fbdd-a4e9-40b5-9783-15fd30c330b1 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:35.016033 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b7fd58e7-3c49-4c4e-b10e-b061a9083d7c tempest-ImagesMetadataNegativeTestJSON-637878481 tempest-ImagesMetadataNegativeTestJSON-637878481-project] Calling method '.version_select at 0x7f1e5bcab820>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:35.039425 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-b7fd58e7-3c49-4c4e-b10e-b061a9083d7c tempest-ImagesMetadataNegativeTestJSON-637878481 tempest-ImagesMetadataNegativeTestJSON-637878481-project] HTTP exception thrown: Image not found. Aug 04 16:56:35.041764 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b7fd58e7-3c49-4c4e-b10e-b061a9083d7c tempest-ImagesMetadataNegativeTestJSON-637878481 tempest-ImagesMetadataNegativeTestJSON-637878481-project] Request method failure captured: Aug 04 16:56:35.041764 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/images/8e13d3fb-6264-4371-9795-54dc00bfc847/metadata HTTP/1.1 Aug 04 16:56:35.041764 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:56:35.041764 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:56:35.041764 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:56:35.041764 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:56:35.041764 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:56:35.041764 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:56:35.041764 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:56:35.041764 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:35.041764 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_pBNRgaBmm3wRpRJHCFevzbHJc1JO_4kg5HDa1zovkvSBre6e4autl1VJi_oRo816SNwyHDymyXjZEXtU4k8qU36PR8_B1q2cP9MugF98-jRa_aO3gGY-kpF8d1qyiFwT5sWxI4vMcOfia--aKxbZvwETP4ThvK6T6SJsG_N6UAud8 Aug 04 16:56:35.041764 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:56:35.041764 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:56:35.041764 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:56:35.041764 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:56:35.041764 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:56:35.041764 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:56:35.041764 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 8436d01737024fa59d8f0b81c6552f29 Aug 04 16:56:35.041764 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-637878481 Aug 04 16:56:35.041764 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 16:56:35.041764 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 16:56:35.043400 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8436d01737024fa59d8f0b81c6552f29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8436d01737024fa59d8f0b81c6552f29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8436d01737024fa59d8f0b81c6552f29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8436d01737024fa59d8f0b81c6552f29"}]}] Aug 04 16:56:35.043400 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-637878481 Aug 04 16:56:35.043400 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 8436d01737024fa59d8f0b81c6552f29 Aug 04 16:56:35.043400 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-637878481 Aug 04 16:56:35.043400 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ImagesMetadataNegativeTestJSON-637878481-project Aug 04 16:56:35.043400 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:56:35.043400 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:56:35.043400 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 2b5baa36ebc3476c8cc28e1727939dc0 Aug 04 16:56:35.043400 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-637878481-project Aug 04 16:56:35.043400 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 16:56:35.043400 n-d-851359-3 devstack@n-api.service[131043]: exception: Image not found. Aug 04 16:56:35.043400 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'image_id': '8e13d3fb-6264-4371-9795-54dc00bfc847'} Aug 04 16:56:35.043400 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:35.044319 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:35.044319 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 16:56:35.044319 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 16:56:35.044319 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:56:35.044319 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:56:35.044319 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 16:56:35.044319 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 16:56:35.044319 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:56:35.044319 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:56:35.044319 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 16:56:35.044319 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 16:56:35.044319 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 16:56:35.044319 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 16:56:35.044319 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:56:35.044319 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:56:35.044319 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:56:35.044319 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:56:35.044319 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8e13d3fb-6264-4371-9795-54dc00bfc847 Aug 04 16:56:35.045339 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.045339 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:35.045339 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.045339 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:35.045339 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 04 16:56:35.045339 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 04 16:56:35.045339 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 16:56:35.045339 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 16:56:35.045339 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 16:56:35.045339 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 16:56:35.045339 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 16:56:35.045339 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 16:56:35.045339 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 16:56:35.045339 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 16:56:35.045339 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:56:35.045339 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:56:35.045339 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 16:56:35.045339 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 16:56:35.045339 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:56:35.045339 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:56:35.049841 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 16:56:35.049841 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 16:56:35.049841 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 16:56:35.049841 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 16:56:35.049841 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:56:35.049841 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:56:35.049841 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:56:35.049841 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:56:35.049841 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8e13d3fb-6264-4371-9795-54dc00bfc847 could not be found. Aug 04 16:56:35.049841 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.049841 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:35.049841 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.049841 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:35.049841 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:35.049841 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:35.049841 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:35.049841 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:35.049841 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:56:35.049841 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:56:35.054515 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:35.054515 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:35.054515 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 04 16:56:35.054515 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 04 16:56:35.054515 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 04 16:56:35.054515 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 16:56:35.054515 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 16:56:35.054515 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.054515 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:35.054515 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.054515 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:35.054515 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:35.054515 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:35.054515 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:56:35.054515 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:56:35.054515 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 16:56:35.054515 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.054515 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b7fd58e7-3c49-4c4e-b10e-b061a9083d7c tempest-ImagesMetadataNegativeTestJSON-637878481 tempest-ImagesMetadataNegativeTestJSON-637878481-project] Returning 404 to user: Image not found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:35.058243 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b7fd58e7-3c49-4c4e-b10e-b061a9083d7c tempest-ImagesMetadataNegativeTestJSON-637878481 tempest-ImagesMetadataNegativeTestJSON-637878481-project] 10.222.0.93 "GET /compute/v2.1/images/8e13d3fb-6264-4371-9795-54dc00bfc847/metadata" status: 404 len: 62 microversion: 2.1 time: 0.031172 Aug 04 16:56:35.058243 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 307/578] 10.222.0.93 () {58 vars in 1260 bytes} [Thu Aug 4 16:56:35 2022] GET /compute/v2.1/images/8e13d3fb-6264-4371-9795-54dc00bfc847/metadata => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:56:35.058243 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-affbbf23-750f-455e-b37a-72135bc6104d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:35.058243 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-affbbf23-750f-455e-b37a-72135bc6104d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: 9d66fc68-229a-4ec3-8c6a-af43a20d2462] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:35.061468 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-affbbf23-750f-455e-b37a-72135bc6104d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:35.061941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-affbbf23-750f-455e-b37a-72135bc6104d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:35.062422 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-affbbf23-750f-455e-b37a-72135bc6104d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:35.063710 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-affbbf23-750f-455e-b37a-72135bc6104d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:35.064175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-affbbf23-750f-455e-b37a-72135bc6104d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:35.064611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-affbbf23-750f-455e-b37a-72135bc6104d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:35.103393 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-affbbf23-750f-455e-b37a-72135bc6104d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] HTTP exception thrown: Instance 9d66fc68-229a-4ec3-8c6a-af43a20d2462 could not be found. Aug 04 16:56:35.106111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-affbbf23-750f-455e-b37a-72135bc6104d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Request method failure captured: Aug 04 16:56:35.106111 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462 HTTP/1.1 Aug 04 16:56:35.106111 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:56:35.106111 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:56:35.106111 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:56:35.106111 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:56:35.106111 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:56:35.106111 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:56:35.106111 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:56:35.106111 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:35.106111 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_oBtkwavIdTC29hFuseZiZRg_Ei4T9WN50LARf4FZkWYS0GRjeVTKoWE9ZUr3zwxdCSci7KRy3WPW0ujpdZo_OxEZObuzoUYigFK2Md8tPPyDMUcgU2BR65DZmOHgnQcHVjBIK2KV5AVyvPuuJn61J3sl6tWrOq6v8_MQtbMgsNTaE Aug 04 16:56:35.106111 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:56:35.106111 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:56:35.106111 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:56:35.106111 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:56:35.106111 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:56:35.106111 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:56:35.106111 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 37ed72eca39e4bab83ccbba779ac37c9 Aug 04 16:56:35.106111 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-DeleteServersAdminTestJSON-113822406 Aug 04 16:56:35.106111 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 16:56:35.106111 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 16:56:35.107370 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/37ed72eca39e4bab83ccbba779ac37c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/37ed72eca39e4bab83ccbba779ac37c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_37ed72eca39e4bab83ccbba779ac37c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/37ed72eca39e4bab83ccbba779ac37c9"}]}] Aug 04 16:56:35.107370 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-DeleteServersAdminTestJSON-113822406 Aug 04 16:56:35.107370 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 37ed72eca39e4bab83ccbba779ac37c9 Aug 04 16:56:35.107370 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-113822406 Aug 04 16:56:35.107370 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-DeleteServersAdminTestJSON-113822406-project Aug 04 16:56:35.107370 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:56:35.107370 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:56:35.107370 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: c12efa078aa84861925925314ef00aea Aug 04 16:56:35.107370 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-DeleteServersAdminTestJSON-113822406-project Aug 04 16:56:35.107370 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 16:56:35.107370 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 9d66fc68-229a-4ec3-8c6a-af43a20d2462 could not be found. Aug 04 16:56:35.107370 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '9d66fc68-229a-4ec3-8c6a-af43a20d2462'} Aug 04 16:56:35.108107 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:35.108107 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:35.108107 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:56:35.108107 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:56:35.108107 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:56:35.108107 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:56:35.108107 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:56:35.108107 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:56:35.108107 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:56:35.108107 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:56:35.108107 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d66fc68-229a-4ec3-8c6a-af43a20d2462 could not be found. Aug 04 16:56:35.108107 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.108107 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:35.108107 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.108107 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:35.108107 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:35.108107 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:35.108107 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:35.108107 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:35.108107 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:35.109350 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:35.109350 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:56:35.109350 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:56:35.109350 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:56:35.109350 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:56:35.109350 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:56:35.109350 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:56:35.109350 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d66fc68-229a-4ec3-8c6a-af43a20d2462 could not be found. Aug 04 16:56:35.109350 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.109350 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:35.109350 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.109350 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:35.109350 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:35.109350 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:35.109350 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:56:35.109350 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:56:35.109350 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d66fc68-229a-4ec3-8c6a-af43a20d2462 could not be found. Aug 04 16:56:35.109350 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.110958 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-affbbf23-750f-455e-b37a-72135bc6104d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Returning 404 to user: Instance 9d66fc68-229a-4ec3-8c6a-af43a20d2462 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:35.110958 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-affbbf23-750f-455e-b37a-72135bc6104d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462" status: 404 len: 111 microversion: 2.1 time: 0.063621 Aug 04 16:56:35.110958 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 308/579] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:35 2022] GET /compute/v2.1/servers/9d66fc68-229a-4ec3-8c6a-af43a20d2462 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:56:35.126802 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6102c16a-4693-49df-993e-90b49289a90e tempest-ImagesMetadataNegativeTestJSON-637878481 tempest-ImagesMetadataNegativeTestJSON-637878481-project] Action: 'update_all', calling method: .version_select at 0x7f1e5bac58b0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:35.154175 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-6102c16a-4693-49df-993e-90b49289a90e tempest-ImagesMetadataNegativeTestJSON-637878481 tempest-ImagesMetadataNegativeTestJSON-637878481-project] HTTP exception thrown: Image not found. Aug 04 16:56:35.157689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6102c16a-4693-49df-993e-90b49289a90e tempest-ImagesMetadataNegativeTestJSON-637878481 tempest-ImagesMetadataNegativeTestJSON-637878481-project] Request method failure captured: Aug 04 16:56:35.157689 n-d-851359-3 devstack@n-api.service[131043]: request: PUT /compute/v2.1/images/61455385-8ac2-4fe2-a518-919c756f5e58/metadata HTTP/1.1 Aug 04 16:56:35.157689 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:56:35.157689 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:56:35.157689 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:56:35.157689 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 57 Aug 04 16:56:35.157689 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:56:35.157689 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:56:35.157689 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:56:35.157689 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:35.157689 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_pBNRgaBmm3wRpRJHCFevzbHJc1JO_4kg5HDa1zovkvSBre6e4autl1VJi_oRo816SNwyHDymyXjZEXtU4k8qU36PR8_B1q2cP9MugF98-jRa_aO3gGY-kpF8d1qyiFwT5sWxI4vMcOfia--aKxbZvwETP4ThvK6T6SJsG_N6UAud8 Aug 04 16:56:35.157689 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:56:35.157689 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:56:35.157689 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:56:35.157689 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:56:35.157689 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:56:35.157689 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:56:35.157689 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 8436d01737024fa59d8f0b81c6552f29 Aug 04 16:56:35.157689 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-637878481 Aug 04 16:56:35.157689 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 16:56:35.157689 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 16:56:35.159202 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8436d01737024fa59d8f0b81c6552f29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8436d01737024fa59d8f0b81c6552f29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8436d01737024fa59d8f0b81c6552f29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8436d01737024fa59d8f0b81c6552f29"}]}] Aug 04 16:56:35.159202 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-637878481 Aug 04 16:56:35.159202 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 8436d01737024fa59d8f0b81c6552f29 Aug 04 16:56:35.159202 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-637878481 Aug 04 16:56:35.159202 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ImagesMetadataNegativeTestJSON-637878481-project Aug 04 16:56:35.159202 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:56:35.159202 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:56:35.159202 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 2b5baa36ebc3476c8cc28e1727939dc0 Aug 04 16:56:35.159202 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-637878481-project Aug 04 16:56:35.159202 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 16:56:35.159202 n-d-851359-3 devstack@n-api.service[131043]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 04 16:56:35.159202 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 16:56:35.159202 n-d-851359-3 devstack@n-api.service[131043]: exception: Image not found. Aug 04 16:56:35.159202 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'image_id': '61455385-8ac2-4fe2-a518-919c756f5e58', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 04 16:56:35.160105 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:35.160105 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:35.160105 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 16:56:35.160105 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 16:56:35.160105 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:56:35.160105 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:56:35.160105 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 16:56:35.160105 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 16:56:35.160105 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:56:35.160105 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:56:35.160105 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 16:56:35.160105 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 16:56:35.160105 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 16:56:35.160105 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 16:56:35.160105 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:56:35.160105 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:56:35.160105 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:56:35.160105 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:56:35.161252 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 61455385-8ac2-4fe2-a518-919c756f5e58 Aug 04 16:56:35.161252 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.161252 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:35.161252 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.161252 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:35.161252 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 04 16:56:35.161252 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 04 16:56:35.161252 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 16:56:35.161252 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 16:56:35.161252 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 16:56:35.161252 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 16:56:35.161252 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 16:56:35.161252 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 16:56:35.161252 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 16:56:35.161252 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 16:56:35.161252 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:56:35.161252 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:56:35.161252 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 16:56:35.161252 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 16:56:35.162559 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:56:35.162559 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:56:35.162559 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 16:56:35.162559 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 16:56:35.162559 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 16:56:35.162559 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 16:56:35.162559 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:56:35.162559 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:56:35.162559 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:56:35.162559 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:56:35.162559 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 61455385-8ac2-4fe2-a518-919c756f5e58 could not be found. Aug 04 16:56:35.162559 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.162559 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:35.162559 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.162559 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:35.162559 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:35.162559 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:35.162559 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:35.162559 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:35.163806 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:56:35.163806 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:56:35.163806 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:35.163806 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:35.163806 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:56:35.163806 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:56:35.163806 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 04 16:56:35.163806 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 04 16:56:35.163806 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 04 16:56:35.163806 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 16:56:35.163806 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 16:56:35.163806 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.163806 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:35.163806 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.163806 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:35.163806 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:35.163806 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:35.163806 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:56:35.163806 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:56:35.163806 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 16:56:35.163806 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.166110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6102c16a-4693-49df-993e-90b49289a90e tempest-ImagesMetadataNegativeTestJSON-637878481 tempest-ImagesMetadataNegativeTestJSON-637878481-project] Returning 404 to user: Image not found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:35.167120 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6102c16a-4693-49df-993e-90b49289a90e tempest-ImagesMetadataNegativeTestJSON-637878481 tempest-ImagesMetadataNegativeTestJSON-637878481-project] 10.222.0.93 "PUT /compute/v2.1/images/61455385-8ac2-4fe2-a518-919c756f5e58/metadata" status: 404 len: 62 microversion: 2.1 time: 0.052763 Aug 04 16:56:35.167857 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 309/580] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Aug 4 16:56:35 2022] PUT /compute/v2.1/images/61455385-8ac2-4fe2-a518-919c756f5e58/metadata => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:56:35.174828 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-97588206-8448-4766-bcda-1b3c9ce7dcc8 req-72385a18-73bc-4231-a0cb-ab58d57dc7d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8efce6c-198e-49a7-8576-32d80cb168df", "tag": "4142971e-ec56-42da-9825-fae6aa5ef34a"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:35.180624 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-d964fbdd-a4e9-40b5-9783-15fd30c330b1 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lazy-loading 'services' on Instance uuid 96d30c66-24c7-4b25-81cd-fb638035a1cb {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:56:35.185632 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-97588206-8448-4766-bcda-1b3c9ce7dcc8 req-72385a18-73bc-4231-a0cb-ab58d57dc7d2 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:35.186361 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-97588206-8448-4766-bcda-1b3c9ce7dcc8 req-72385a18-73bc-4231-a0cb-ab58d57dc7d2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:35.186964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-97588206-8448-4766-bcda-1b3c9ce7dcc8 req-72385a18-73bc-4231-a0cb-ab58d57dc7d2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:35.198346 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-97588206-8448-4766-bcda-1b3c9ce7dcc8 req-72385a18-73bc-4231-a0cb-ab58d57dc7d2 service nova] Creating event network-changed:4142971e-ec56-42da-9825-fae6aa5ef34a for instance b8efce6c-198e-49a7-8576-32d80cb168df on n-h2-851359-3 Aug 04 16:56:35.204271 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-97588206-8448-4766-bcda-1b3c9ce7dcc8 req-72385a18-73bc-4231-a0cb-ab58d57dc7d2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034313 Aug 04 16:56:35.204876 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 310/581] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:35.209996 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4463c032-f2e8-4a13-982f-8c77660ce69d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:35.210546 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4463c032-f2e8-4a13-982f-8c77660ce69d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: e07a80a8-dec0-4a8b-bd5e-e2a50370d35b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:35.216832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4463c032-f2e8-4a13-982f-8c77660ce69d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:35.217241 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4463c032-f2e8-4a13-982f-8c77660ce69d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:35.217680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4463c032-f2e8-4a13-982f-8c77660ce69d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:35.218411 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4463c032-f2e8-4a13-982f-8c77660ce69d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:35.218867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4463c032-f2e8-4a13-982f-8c77660ce69d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:35.219869 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4463c032-f2e8-4a13-982f-8c77660ce69d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:35.233548 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-4463c032-f2e8-4a13-982f-8c77660ce69d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] HTTP exception thrown: Instance e07a80a8-dec0-4a8b-bd5e-e2a50370d35b could not be found. Aug 04 16:56:35.235489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4463c032-f2e8-4a13-982f-8c77660ce69d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Request method failure captured: Aug 04 16:56:35.235489 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b HTTP/1.1 Aug 04 16:56:35.235489 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:56:35.235489 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:56:35.235489 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:56:35.235489 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:56:35.235489 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:56:35.235489 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:56:35.235489 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:56:35.235489 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:35.235489 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_oBtkwavIdTC29hFuseZiZRg_Ei4T9WN50LARf4FZkWYS0GRjeVTKoWE9ZUr3zwxdCSci7KRy3WPW0ujpdZo_OxEZObuzoUYigFK2Md8tPPyDMUcgU2BR65DZmOHgnQcHVjBIK2KV5AVyvPuuJn61J3sl6tWrOq6v8_MQtbMgsNTaE Aug 04 16:56:35.235489 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:56:35.235489 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:56:35.235489 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:56:35.235489 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:56:35.235489 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:56:35.235489 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:56:35.235489 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 37ed72eca39e4bab83ccbba779ac37c9 Aug 04 16:56:35.235489 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-DeleteServersAdminTestJSON-113822406 Aug 04 16:56:35.235489 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 16:56:35.235489 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 16:56:35.237009 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/37ed72eca39e4bab83ccbba779ac37c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/37ed72eca39e4bab83ccbba779ac37c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_37ed72eca39e4bab83ccbba779ac37c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/37ed72eca39e4bab83ccbba779ac37c9"}]}] Aug 04 16:56:35.237009 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-DeleteServersAdminTestJSON-113822406 Aug 04 16:56:35.237009 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 37ed72eca39e4bab83ccbba779ac37c9 Aug 04 16:56:35.237009 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-113822406 Aug 04 16:56:35.237009 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-DeleteServersAdminTestJSON-113822406-project Aug 04 16:56:35.237009 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:56:35.237009 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:56:35.237009 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: c12efa078aa84861925925314ef00aea Aug 04 16:56:35.237009 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-DeleteServersAdminTestJSON-113822406-project Aug 04 16:56:35.237009 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 16:56:35.237009 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance e07a80a8-dec0-4a8b-bd5e-e2a50370d35b could not be found. Aug 04 16:56:35.237009 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'e07a80a8-dec0-4a8b-bd5e-e2a50370d35b'} Aug 04 16:56:35.237863 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:35.237863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:35.237863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:56:35.237863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:56:35.237863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:56:35.237863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:56:35.237863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:56:35.237863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:56:35.237863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:56:35.237863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:56:35.237863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e07a80a8-dec0-4a8b-bd5e-e2a50370d35b could not be found. Aug 04 16:56:35.237863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.237863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:35.237863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.237863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:35.237863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:35.237863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:35.237863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:35.237863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:35.237863 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:35.239158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:35.239158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:56:35.239158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:56:35.239158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:56:35.239158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:56:35.239158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:56:35.239158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:56:35.239158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:56:35.239158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:56:35.239158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e07a80a8-dec0-4a8b-bd5e-e2a50370d35b could not be found. Aug 04 16:56:35.239158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.239158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:35.239158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.239158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:35.239158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:35.239158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:35.239158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:56:35.239158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:56:35.239158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e07a80a8-dec0-4a8b-bd5e-e2a50370d35b could not be found. Aug 04 16:56:35.239158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.241037 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4463c032-f2e8-4a13-982f-8c77660ce69d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Returning 404 to user: Instance e07a80a8-dec0-4a8b-bd5e-e2a50370d35b could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:35.241037 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4463c032-f2e8-4a13-982f-8c77660ce69d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b" status: 404 len: 111 microversion: 2.1 time: 0.032326 Aug 04 16:56:35.241037 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 311/582] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 16:56:35 2022] DELETE /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:56:35.243634 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d964fbdd-a4e9-40b5-9783-15fd30c330b1 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1929 microversion: 2.75 time: 0.249536 Aug 04 16:56:35.244235 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 272/583] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:34 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1929 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:35.246408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ed84e997-b665-45ba-90e0-da854b5af722 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:35.247271 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ed84e997-b665-45ba-90e0-da854b5af722 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: c0e9cb60-b590-412f-a6a1-fc8534bd1c97] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:35.252607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a37ca62c-5fa0-4830-ad51-d8eea6191f6f tempest-ImagesMetadataNegativeTestJSON-637878481 tempest-ImagesMetadataNegativeTestJSON-637878481-project] Action: 'update', calling method: .version_select at 0x7f1e5bb79af0>, body: {"meta": {"os_distro": "alt"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:35.254369 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed84e997-b665-45ba-90e0-da854b5af722 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:35.254968 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed84e997-b665-45ba-90e0-da854b5af722 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:35.255496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed84e997-b665-45ba-90e0-da854b5af722 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:35.256271 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed84e997-b665-45ba-90e0-da854b5af722 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:35.256849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed84e997-b665-45ba-90e0-da854b5af722 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:35.257337 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed84e997-b665-45ba-90e0-da854b5af722 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:35.285932 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-a37ca62c-5fa0-4830-ad51-d8eea6191f6f tempest-ImagesMetadataNegativeTestJSON-637878481 tempest-ImagesMetadataNegativeTestJSON-637878481-project] HTTP exception thrown: Image not found. Aug 04 16:56:35.288246 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a37ca62c-5fa0-4830-ad51-d8eea6191f6f tempest-ImagesMetadataNegativeTestJSON-637878481 tempest-ImagesMetadataNegativeTestJSON-637878481-project] Request method failure captured: Aug 04 16:56:35.288246 n-d-851359-3 devstack@n-api.service[131044]: request: PUT /compute/v2.1/images/ae4064aa-0304-45e4-891f-289de9fcefe4/metadata/os_distro HTTP/1.1 Aug 04 16:56:35.288246 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:56:35.288246 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:56:35.288246 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:56:35.288246 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 30 Aug 04 16:56:35.288246 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:56:35.288246 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:56:35.288246 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:56:35.288246 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:35.288246 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_pBNRgaBmm3wRpRJHCFevzbHJc1JO_4kg5HDa1zovkvSBre6e4autl1VJi_oRo816SNwyHDymyXjZEXtU4k8qU36PR8_B1q2cP9MugF98-jRa_aO3gGY-kpF8d1qyiFwT5sWxI4vMcOfia--aKxbZvwETP4ThvK6T6SJsG_N6UAud8 Aug 04 16:56:35.288246 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:56:35.288246 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:56:35.288246 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:56:35.288246 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:56:35.288246 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:56:35.288246 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:56:35.288246 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 8436d01737024fa59d8f0b81c6552f29 Aug 04 16:56:35.288246 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-637878481 Aug 04 16:56:35.288246 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:56:35.288246 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:56:35.289657 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8436d01737024fa59d8f0b81c6552f29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8436d01737024fa59d8f0b81c6552f29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8436d01737024fa59d8f0b81c6552f29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8436d01737024fa59d8f0b81c6552f29"}]}] Aug 04 16:56:35.289657 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-637878481 Aug 04 16:56:35.289657 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 8436d01737024fa59d8f0b81c6552f29 Aug 04 16:56:35.289657 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-637878481 Aug 04 16:56:35.289657 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ImagesMetadataNegativeTestJSON-637878481-project Aug 04 16:56:35.289657 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:56:35.289657 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:56:35.289657 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 2b5baa36ebc3476c8cc28e1727939dc0 Aug 04 16:56:35.289657 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-637878481-project Aug 04 16:56:35.289657 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 16:56:35.289657 n-d-851359-3 devstack@n-api.service[131044]: {"meta": {"os_distro": "alt"}} Aug 04 16:56:35.289657 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:56:35.289657 n-d-851359-3 devstack@n-api.service[131044]: exception: Image not found. Aug 04 16:56:35.289657 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'image_id': 'ae4064aa-0304-45e4-891f-289de9fcefe4', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 04 16:56:35.290670 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:35.290670 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:35.290670 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 16:56:35.290670 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 16:56:35.290670 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:56:35.290670 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:56:35.290670 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 16:56:35.290670 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 16:56:35.290670 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:56:35.290670 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:56:35.290670 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 16:56:35.290670 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 16:56:35.290670 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 16:56:35.290670 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 16:56:35.290670 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:56:35.290670 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:56:35.290670 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:56:35.290670 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:56:35.291698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ae4064aa-0304-45e4-891f-289de9fcefe4 Aug 04 16:56:35.291698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.291698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:35.291698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.291698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:35.291698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 04 16:56:35.291698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 04 16:56:35.291698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 16:56:35.291698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 16:56:35.291698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 16:56:35.291698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 16:56:35.291698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 16:56:35.291698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 16:56:35.291698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 16:56:35.291698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 16:56:35.291698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:56:35.291698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:56:35.291698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 16:56:35.291698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 16:56:35.292773 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:56:35.292773 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:56:35.292773 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 16:56:35.292773 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 16:56:35.292773 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 16:56:35.292773 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 16:56:35.292773 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:56:35.292773 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:56:35.292773 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:56:35.292773 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:56:35.292773 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ae4064aa-0304-45e4-891f-289de9fcefe4 could not be found. Aug 04 16:56:35.292773 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.292773 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:35.292773 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.292773 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:35.292773 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:35.292773 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:35.292773 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:35.292773 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:35.293919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:56:35.293919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:56:35.293919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:35.293919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:35.293919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:56:35.293919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:56:35.293919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 04 16:56:35.293919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 04 16:56:35.293919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 04 16:56:35.293919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 16:56:35.293919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 16:56:35.293919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.293919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:35.293919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.293919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:35.293919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:35.293919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:35.293919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:56:35.293919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:56:35.293919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 16:56:35.293919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.297315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a37ca62c-5fa0-4830-ad51-d8eea6191f6f tempest-ImagesMetadataNegativeTestJSON-637878481 tempest-ImagesMetadataNegativeTestJSON-637878481-project] Returning 404 to user: Image not found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:35.297315 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a37ca62c-5fa0-4830-ad51-d8eea6191f6f tempest-ImagesMetadataNegativeTestJSON-637878481 tempest-ImagesMetadataNegativeTestJSON-637878481-project] 10.222.0.93 "PUT /compute/v2.1/images/ae4064aa-0304-45e4-891f-289de9fcefe4/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.044591 Aug 04 16:56:35.297315 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 273/584] 10.222.0.93 () {60 vars in 1310 bytes} [Thu Aug 4 16:56:35 2022] PUT /compute/v2.1/images/ae4064aa-0304-45e4-891f-289de9fcefe4/metadata/os_distro => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:56:35.299557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e9ecf18b-cd0b-4169-82c0-defd13ec837d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:35.300175 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e9ecf18b-cd0b-4169-82c0-defd13ec837d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] [instance: e07a80a8-dec0-4a8b-bd5e-e2a50370d35b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:35.308115 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9ecf18b-cd0b-4169-82c0-defd13ec837d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:35.308617 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9ecf18b-cd0b-4169-82c0-defd13ec837d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:35.309058 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9ecf18b-cd0b-4169-82c0-defd13ec837d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:35.309875 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9ecf18b-cd0b-4169-82c0-defd13ec837d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:35.310367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9ecf18b-cd0b-4169-82c0-defd13ec837d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:35.310789 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9ecf18b-cd0b-4169-82c0-defd13ec837d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:35.331285 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-e9ecf18b-cd0b-4169-82c0-defd13ec837d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] HTTP exception thrown: Instance e07a80a8-dec0-4a8b-bd5e-e2a50370d35b could not be found. Aug 04 16:56:35.332987 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e9ecf18b-cd0b-4169-82c0-defd13ec837d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Request method failure captured: Aug 04 16:56:35.332987 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b HTTP/1.1 Aug 04 16:56:35.332987 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:56:35.332987 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:56:35.332987 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:56:35.332987 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:56:35.332987 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:56:35.332987 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:56:35.332987 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:56:35.332987 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:35.332987 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_oBtkwavIdTC29hFuseZiZRg_Ei4T9WN50LARf4FZkWYS0GRjeVTKoWE9ZUr3zwxdCSci7KRy3WPW0ujpdZo_OxEZObuzoUYigFK2Md8tPPyDMUcgU2BR65DZmOHgnQcHVjBIK2KV5AVyvPuuJn61J3sl6tWrOq6v8_MQtbMgsNTaE Aug 04 16:56:35.332987 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:56:35.332987 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:56:35.332987 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:56:35.332987 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:56:35.332987 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:56:35.332987 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:56:35.332987 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 37ed72eca39e4bab83ccbba779ac37c9 Aug 04 16:56:35.332987 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-DeleteServersAdminTestJSON-113822406 Aug 04 16:56:35.332987 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:56:35.332987 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:56:35.334316 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/37ed72eca39e4bab83ccbba779ac37c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/37ed72eca39e4bab83ccbba779ac37c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_37ed72eca39e4bab83ccbba779ac37c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/37ed72eca39e4bab83ccbba779ac37c9"}]}] Aug 04 16:56:35.334316 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-DeleteServersAdminTestJSON-113822406 Aug 04 16:56:35.334316 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 37ed72eca39e4bab83ccbba779ac37c9 Aug 04 16:56:35.334316 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-113822406 Aug 04 16:56:35.334316 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-DeleteServersAdminTestJSON-113822406-project Aug 04 16:56:35.334316 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:56:35.334316 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:56:35.334316 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: c12efa078aa84861925925314ef00aea Aug 04 16:56:35.334316 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-DeleteServersAdminTestJSON-113822406-project Aug 04 16:56:35.334316 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:56:35.334316 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance e07a80a8-dec0-4a8b-bd5e-e2a50370d35b could not be found. Aug 04 16:56:35.334316 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'e07a80a8-dec0-4a8b-bd5e-e2a50370d35b'} Aug 04 16:56:35.335051 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:35.335051 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:35.335051 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:56:35.335051 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:56:35.335051 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:56:35.335051 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:56:35.335051 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:56:35.335051 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:56:35.335051 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:56:35.335051 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:56:35.335051 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e07a80a8-dec0-4a8b-bd5e-e2a50370d35b could not be found. Aug 04 16:56:35.335051 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.335051 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:35.335051 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.335051 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:35.335051 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:35.335051 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:35.335051 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:35.335051 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:35.335051 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:35.336197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:35.336197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:56:35.336197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:56:35.336197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:56:35.336197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:56:35.336197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:56:35.336197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:56:35.336197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e07a80a8-dec0-4a8b-bd5e-e2a50370d35b could not be found. Aug 04 16:56:35.336197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.336197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:35.336197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.336197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:35.336197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:35.336197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:35.336197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:56:35.336197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:56:35.336197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e07a80a8-dec0-4a8b-bd5e-e2a50370d35b could not be found. Aug 04 16:56:35.336197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.337668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e9ecf18b-cd0b-4169-82c0-defd13ec837d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] Returning 404 to user: Instance e07a80a8-dec0-4a8b-bd5e-e2a50370d35b could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:35.337668 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e9ecf18b-cd0b-4169-82c0-defd13ec837d tempest-DeleteServersAdminTestJSON-113822406 tempest-DeleteServersAdminTestJSON-113822406-project] 10.222.0.93 "GET /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b" status: 404 len: 111 microversion: 2.1 time: 0.038849 Aug 04 16:56:35.337668 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 274/585] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:35 2022] GET /compute/v2.1/servers/e07a80a8-dec0-4a8b-bd5e-e2a50370d35b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:56:35.340994 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f5aa8e63-8037-47c4-807a-36ffbfdcef17 tempest-ImagesMetadataNegativeTestJSON-637878481 tempest-ImagesMetadataNegativeTestJSON-637878481-project] Action: 'create', calling method: .version_select at 0x7f1e5bb790d0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:35.369460 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-f5aa8e63-8037-47c4-807a-36ffbfdcef17 tempest-ImagesMetadataNegativeTestJSON-637878481 tempest-ImagesMetadataNegativeTestJSON-637878481-project] HTTP exception thrown: Image not found. Aug 04 16:56:35.371512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f5aa8e63-8037-47c4-807a-36ffbfdcef17 tempest-ImagesMetadataNegativeTestJSON-637878481 tempest-ImagesMetadataNegativeTestJSON-637878481-project] Request method failure captured: Aug 04 16:56:35.371512 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/images/2101f13e-5393-483a-9d47-492328c5478b/metadata HTTP/1.1 Aug 04 16:56:35.371512 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:56:35.371512 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:56:35.371512 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:56:35.371512 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 57 Aug 04 16:56:35.371512 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:56:35.371512 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:56:35.371512 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:56:35.371512 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:35.371512 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_pBNRgaBmm3wRpRJHCFevzbHJc1JO_4kg5HDa1zovkvSBre6e4autl1VJi_oRo816SNwyHDymyXjZEXtU4k8qU36PR8_B1q2cP9MugF98-jRa_aO3gGY-kpF8d1qyiFwT5sWxI4vMcOfia--aKxbZvwETP4ThvK6T6SJsG_N6UAud8 Aug 04 16:56:35.371512 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:56:35.371512 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:56:35.371512 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:56:35.371512 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:56:35.371512 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:56:35.371512 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:56:35.371512 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 8436d01737024fa59d8f0b81c6552f29 Aug 04 16:56:35.371512 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-637878481 Aug 04 16:56:35.371512 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:56:35.371512 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:56:35.372794 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8436d01737024fa59d8f0b81c6552f29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8436d01737024fa59d8f0b81c6552f29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8436d01737024fa59d8f0b81c6552f29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8436d01737024fa59d8f0b81c6552f29"}]}] Aug 04 16:56:35.372794 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-637878481 Aug 04 16:56:35.372794 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 8436d01737024fa59d8f0b81c6552f29 Aug 04 16:56:35.372794 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-637878481 Aug 04 16:56:35.372794 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ImagesMetadataNegativeTestJSON-637878481-project Aug 04 16:56:35.372794 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:56:35.372794 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:56:35.372794 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 2b5baa36ebc3476c8cc28e1727939dc0 Aug 04 16:56:35.372794 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-637878481-project Aug 04 16:56:35.372794 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 16:56:35.372794 n-d-851359-3 devstack@n-api.service[131044]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 04 16:56:35.372794 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:56:35.372794 n-d-851359-3 devstack@n-api.service[131044]: exception: Image not found. Aug 04 16:56:35.372794 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'image_id': '2101f13e-5393-483a-9d47-492328c5478b', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 04 16:56:35.373613 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:35.373613 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:35.373613 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 16:56:35.373613 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 16:56:35.373613 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:56:35.373613 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:56:35.373613 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 16:56:35.373613 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 16:56:35.373613 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:56:35.373613 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:56:35.373613 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 16:56:35.373613 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 16:56:35.373613 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 16:56:35.373613 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 16:56:35.373613 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:56:35.373613 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:56:35.373613 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:56:35.373613 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:56:35.374650 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2101f13e-5393-483a-9d47-492328c5478b Aug 04 16:56:35.374650 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.374650 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:35.374650 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.374650 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:35.374650 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 04 16:56:35.374650 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 04 16:56:35.374650 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 16:56:35.374650 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 16:56:35.374650 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 16:56:35.374650 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 16:56:35.374650 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 16:56:35.374650 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 16:56:35.374650 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 16:56:35.374650 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 16:56:35.374650 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:56:35.374650 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:56:35.374650 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 16:56:35.374650 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 16:56:35.375758 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:56:35.375758 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:56:35.375758 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 16:56:35.375758 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 16:56:35.375758 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 16:56:35.375758 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 16:56:35.375758 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:56:35.375758 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:56:35.375758 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:56:35.375758 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:56:35.375758 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2101f13e-5393-483a-9d47-492328c5478b could not be found. Aug 04 16:56:35.375758 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.375758 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:35.375758 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.375758 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:35.375758 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:35.375758 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:35.375758 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:35.375758 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:35.376802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:56:35.376802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:56:35.376802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:35.376802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:35.376802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:56:35.376802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:56:35.376802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 04 16:56:35.376802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 04 16:56:35.376802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 04 16:56:35.376802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 16:56:35.376802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 16:56:35.376802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.376802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:35.376802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.376802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:35.376802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:35.376802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:35.376802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:56:35.376802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:56:35.376802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 16:56:35.376802 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:35.380225 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f5aa8e63-8037-47c4-807a-36ffbfdcef17 tempest-ImagesMetadataNegativeTestJSON-637878481 tempest-ImagesMetadataNegativeTestJSON-637878481-project] Returning 404 to user: Image not found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:35.380225 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f5aa8e63-8037-47c4-807a-36ffbfdcef17 tempest-ImagesMetadataNegativeTestJSON-637878481 tempest-ImagesMetadataNegativeTestJSON-637878481-project] 10.222.0.93 "POST /compute/v2.1/images/2101f13e-5393-483a-9d47-492328c5478b/metadata" status: 404 len: 62 microversion: 2.1 time: 0.043527 Aug 04 16:56:35.380225 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 275/586] 10.222.0.93 () {60 vars in 1281 bytes} [Thu Aug 4 16:56:35 2022] POST /compute/v2.1/images/2101f13e-5393-483a-9d47-492328c5478b/metadata => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:56:35.507926 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ed84e997-b665-45ba-90e0-da854b5af722 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712723e5418441c096f008d1520f6dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8c7c49e56743dd9f64102e53c2bec7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:35.519100 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ed84e997-b665-45ba-90e0-da854b5af722 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97" status: 200 len: 1319 microversion: 2.1 time: 0.276348 Aug 04 16:56:35.519914 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 312/587] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:35 2022] GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97 => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:35.538598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e1e45275-34d3-4cd9-a4d8-72fbf389cccc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:35.539214 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e1e45275-34d3-4cd9-a4d8-72fbf389cccc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:35.549423 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1e45275-34d3-4cd9-a4d8-72fbf389cccc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:35.549788 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1e45275-34d3-4cd9-a4d8-72fbf389cccc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:35.555304 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1e45275-34d3-4cd9-a4d8-72fbf389cccc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:35.556384 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1e45275-34d3-4cd9-a4d8-72fbf389cccc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:35.556889 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1e45275-34d3-4cd9-a4d8-72fbf389cccc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:35.557328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1e45275-34d3-4cd9-a4d8-72fbf389cccc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:35.812229 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e1e45275-34d3-4cd9-a4d8-72fbf389cccc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:35.823370 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e1e45275-34d3-4cd9-a4d8-72fbf389cccc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989" status: 200 len: 1504 microversion: 2.1 time: 0.292094 Aug 04 16:56:35.838698 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 276/588] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:35 2022] GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989 => generated 1504 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:35.996818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9ef0451e-ef99-4b35-9fae-1f41efbf661f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:35.997440 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9ef0451e-ef99-4b35-9fae-1f41efbf661f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:36.005849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9ef0451e-ef99-4b35-9fae-1f41efbf661f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:36.010539 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9ef0451e-ef99-4b35-9fae-1f41efbf661f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:36.012352 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9ef0451e-ef99-4b35-9fae-1f41efbf661f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:36.012473 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-80973c2b-9d9b-4a8d-aa06-7e89cadc6736 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:36.013037 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-80973c2b-9d9b-4a8d-aa06-7e89cadc6736 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: b8efce6c-198e-49a7-8576-32d80cb168df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:36.013956 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9ef0451e-ef99-4b35-9fae-1f41efbf661f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:36.015086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9ef0451e-ef99-4b35-9fae-1f41efbf661f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:36.017204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9ef0451e-ef99-4b35-9fae-1f41efbf661f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:36.021334 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80973c2b-9d9b-4a8d-aa06-7e89cadc6736 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:36.021828 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80973c2b-9d9b-4a8d-aa06-7e89cadc6736 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:36.022298 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80973c2b-9d9b-4a8d-aa06-7e89cadc6736 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:36.023003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80973c2b-9d9b-4a8d-aa06-7e89cadc6736 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:36.023464 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80973c2b-9d9b-4a8d-aa06-7e89cadc6736 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:36.029827 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80973c2b-9d9b-4a8d-aa06-7e89cadc6736 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:36.276645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-80973c2b-9d9b-4a8d-aa06-7e89cadc6736 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:36.284717 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-80973c2b-9d9b-4a8d-aa06-7e89cadc6736 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df" status: 200 len: 1322 microversion: 2.1 time: 0.275949 Aug 04 16:56:36.285684 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 277/589] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:36 2022] GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df => generated 1322 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:56:36.304014 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7772febe-a800-4618-90d4-9cbfd2fea3e4 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:36.304990 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7772febe-a800-4618-90d4-9cbfd2fea3e4 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:36.313396 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7772febe-a800-4618-90d4-9cbfd2fea3e4 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:36.314912 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7772febe-a800-4618-90d4-9cbfd2fea3e4 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:36.316066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7772febe-a800-4618-90d4-9cbfd2fea3e4 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:36.318203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7772febe-a800-4618-90d4-9cbfd2fea3e4 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:36.319422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7772febe-a800-4618-90d4-9cbfd2fea3e4 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:36.320259 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7772febe-a800-4618-90d4-9cbfd2fea3e4 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:36.338597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9ef0451e-ef99-4b35-9fae-1f41efbf661f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:36.348823 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9ef0451e-ef99-4b35-9fae-1f41efbf661f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1313 microversion: 2.1 time: 0.355801 Aug 04 16:56:36.362284 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 313/590] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:35 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1313 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:36.405791 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-7772febe-a800-4618-90d4-9cbfd2fea3e4 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lazy-loading 'services' on Instance uuid 96d30c66-24c7-4b25-81cd-fb638035a1cb {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:56:36.431193 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7772febe-a800-4618-90d4-9cbfd2fea3e4 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1929 microversion: 2.75 time: 0.131508 Aug 04 16:56:36.431794 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 278/591] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:36 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1929 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:36.542310 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0c79375f-b754-40c6-8661-cabc71b036b7 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:36.543017 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0c79375f-b754-40c6-8661-cabc71b036b7 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: c0e9cb60-b590-412f-a6a1-fc8534bd1c97] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:36.550374 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c79375f-b754-40c6-8661-cabc71b036b7 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:36.550859 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c79375f-b754-40c6-8661-cabc71b036b7 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:36.551303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c79375f-b754-40c6-8661-cabc71b036b7 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:36.552026 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c79375f-b754-40c6-8661-cabc71b036b7 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:36.552492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c79375f-b754-40c6-8661-cabc71b036b7 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:36.552931 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c79375f-b754-40c6-8661-cabc71b036b7 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:36.618028 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-ae7cc7b9-0499-4e3a-9cb0-a99a33b19453 req-3b8baf6a-bb39-4f1a-96dd-f260ec98ed6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc381c07-ce7e-4a71-bede-f15c69c1d989", "name": "network-vif-unplugged", "status": "completed", "tag": "ab451c60-9699-45ff-809b-94b053bd20d8"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:36.629137 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ae7cc7b9-0499-4e3a-9cb0-a99a33b19453 req-3b8baf6a-bb39-4f1a-96dd-f260ec98ed6d service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:36.629621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ae7cc7b9-0499-4e3a-9cb0-a99a33b19453 req-3b8baf6a-bb39-4f1a-96dd-f260ec98ed6d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:36.630260 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ae7cc7b9-0499-4e3a-9cb0-a99a33b19453 req-3b8baf6a-bb39-4f1a-96dd-f260ec98ed6d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:36.643957 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-ae7cc7b9-0499-4e3a-9cb0-a99a33b19453 req-3b8baf6a-bb39-4f1a-96dd-f260ec98ed6d service nova] Creating event network-vif-unplugged:ab451c60-9699-45ff-809b-94b053bd20d8 for instance fc381c07-ce7e-4a71-bede-f15c69c1d989 on n-h1-851359-3 Aug 04 16:56:36.649011 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-ae7cc7b9-0499-4e3a-9cb0-a99a33b19453 req-3b8baf6a-bb39-4f1a-96dd-f260ec98ed6d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036349 Aug 04 16:56:36.649926 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 279/592] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:36.704030 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0c79375f-b754-40c6-8661-cabc71b036b7 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712723e5418441c096f008d1520f6dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8c7c49e56743dd9f64102e53c2bec7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:36.711727 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0c79375f-b754-40c6-8661-cabc71b036b7 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97" status: 200 len: 1469 microversion: 2.1 time: 0.173821 Aug 04 16:56:36.712306 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 314/593] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:36 2022] GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97 => generated 1469 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:36.733631 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-81809a25-04ed-4f60-93f5-e6e607571c6d tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:36.734284 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-81809a25-04ed-4f60-93f5-e6e607571c6d tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] [instance: c0e9cb60-b590-412f-a6a1-fc8534bd1c97] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:36.740749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81809a25-04ed-4f60-93f5-e6e607571c6d tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:36.741236 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81809a25-04ed-4f60-93f5-e6e607571c6d tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:36.741668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81809a25-04ed-4f60-93f5-e6e607571c6d tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:36.742405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81809a25-04ed-4f60-93f5-e6e607571c6d tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:36.742858 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81809a25-04ed-4f60-93f5-e6e607571c6d tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:36.743580 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81809a25-04ed-4f60-93f5-e6e607571c6d tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:36.778882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-81809a25-04ed-4f60-93f5-e6e607571c6d tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Lazy-loading 'flavor' on Instance uuid c0e9cb60-b590-412f-a6a1-fc8534bd1c97 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:56:36.847505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3f1caa4b-4a05-458a-b411-f44b99209eac tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:36.848455 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3f1caa4b-4a05-458a-b411-f44b99209eac tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:36.857344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f1caa4b-4a05-458a-b411-f44b99209eac tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:36.858701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f1caa4b-4a05-458a-b411-f44b99209eac tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:36.859335 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f1caa4b-4a05-458a-b411-f44b99209eac tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:36.860885 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f1caa4b-4a05-458a-b411-f44b99209eac tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:36.861847 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f1caa4b-4a05-458a-b411-f44b99209eac tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:36.862610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f1caa4b-4a05-458a-b411-f44b99209eac tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:36.865950 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-81809a25-04ed-4f60-93f5-e6e607571c6d tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97/action" status: 202 len: 0 microversion: 2.1 time: 0.136517 Aug 04 16:56:36.867087 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 280/594] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:56:36 2022] POST /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 16:56:36.877467 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b9d4640f-1428-4062-86b8-0f7f7708dce3 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:36.878619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b9d4640f-1428-4062-86b8-0f7f7708dce3 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: c0e9cb60-b590-412f-a6a1-fc8534bd1c97] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:36.887737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9d4640f-1428-4062-86b8-0f7f7708dce3 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:36.888939 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9d4640f-1428-4062-86b8-0f7f7708dce3 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:36.889750 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9d4640f-1428-4062-86b8-0f7f7708dce3 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:36.891511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9d4640f-1428-4062-86b8-0f7f7708dce3 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:36.892349 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9d4640f-1428-4062-86b8-0f7f7708dce3 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:36.893184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9d4640f-1428-4062-86b8-0f7f7708dce3 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:37.180662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3f1caa4b-4a05-458a-b411-f44b99209eac tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:37.184816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:37.193229 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3f1caa4b-4a05-458a-b411-f44b99209eac tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989" status: 200 len: 1504 microversion: 2.1 time: 0.349989 Aug 04 16:56:37.193842 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 315/595] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:36 2022] GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989 => generated 1504 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:37.195042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b9d4640f-1428-4062-86b8-0f7f7708dce3 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712723e5418441c096f008d1520f6dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8c7c49e56743dd9f64102e53c2bec7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:37.203226 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b9d4640f-1428-4062-86b8-0f7f7708dce3 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97" status: 200 len: 1477 microversion: 2.1 time: 0.331895 Aug 04 16:56:37.205103 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 281/596] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:36 2022] GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97 => generated 1477 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:56:37.206934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-0771a0de-740f-4d31-b0c0-081a160ef698 req-f7152c03-e66d-4c4a-861e-6e4a203b9058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cfbd46c-8842-4119-a0d0-7bf5827e45d3", "name": "network-vif-plugged", "status": "completed", "tag": "6b6134e1-88b8-41c8-9a22-a162b6145647"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:37.221393 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-0771a0de-740f-4d31-b0c0-081a160ef698 req-f7152c03-e66d-4c4a-861e-6e4a203b9058 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:37.221967 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-0771a0de-740f-4d31-b0c0-081a160ef698 req-f7152c03-e66d-4c4a-861e-6e4a203b9058 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:37.222520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-0771a0de-740f-4d31-b0c0-081a160ef698 req-f7152c03-e66d-4c4a-861e-6e4a203b9058 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:37.235874 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-0771a0de-740f-4d31-b0c0-081a160ef698 req-f7152c03-e66d-4c4a-861e-6e4a203b9058 service nova] Creating event network-vif-plugged:6b6134e1-88b8-41c8-9a22-a162b6145647 for instance 6cfbd46c-8842-4119-a0d0-7bf5827e45d3 on n-h1-851359-3 Aug 04 16:56:37.240865 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-0771a0de-740f-4d31-b0c0-081a160ef698 req-f7152c03-e66d-4c4a-861e-6e4a203b9058 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040784 Aug 04 16:56:37.241747 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 316/597] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:37.309149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ed065e46-a26e-4a14-b82f-dbc3944c43db tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:37.310169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ed065e46-a26e-4a14-b82f-dbc3944c43db tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: b8efce6c-198e-49a7-8576-32d80cb168df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:37.319336 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed065e46-a26e-4a14-b82f-dbc3944c43db tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:37.320241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed065e46-a26e-4a14-b82f-dbc3944c43db tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:37.321630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed065e46-a26e-4a14-b82f-dbc3944c43db tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:37.322705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed065e46-a26e-4a14-b82f-dbc3944c43db tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:37.323253 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed065e46-a26e-4a14-b82f-dbc3944c43db tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:37.323816 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed065e46-a26e-4a14-b82f-dbc3944c43db tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:37.373560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5377debd-5781-4727-b86f-f1ee015136f2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:37.374375 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5377debd-5781-4727-b86f-f1ee015136f2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:37.395804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5377debd-5781-4727-b86f-f1ee015136f2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:37.397197 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5377debd-5781-4727-b86f-f1ee015136f2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:37.398286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5377debd-5781-4727-b86f-f1ee015136f2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:37.400345 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5377debd-5781-4727-b86f-f1ee015136f2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:37.402884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5377debd-5781-4727-b86f-f1ee015136f2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:37.403609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5377debd-5781-4727-b86f-f1ee015136f2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:37.695395 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ed065e46-a26e-4a14-b82f-dbc3944c43db tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:37.708005 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ed065e46-a26e-4a14-b82f-dbc3944c43db tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df" status: 200 len: 1322 microversion: 2.1 time: 0.403382 Aug 04 16:56:37.709012 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 282/598] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:37 2022] GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df => generated 1322 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:37.713573 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5377debd-5781-4727-b86f-f1ee015136f2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:37.721841 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5377debd-5781-4727-b86f-f1ee015136f2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1313 microversion: 2.1 time: 0.353963 Aug 04 16:56:37.722455 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 317/599] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:37 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1313 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:37.734251 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-64ab86fe-59b0-45c6-9dde-64438a94f4a1 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:37.734251 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-64ab86fe-59b0-45c6-9dde-64438a94f4a1 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:37.737417 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64ab86fe-59b0-45c6-9dde-64438a94f4a1 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:37.737939 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64ab86fe-59b0-45c6-9dde-64438a94f4a1 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:37.738772 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64ab86fe-59b0-45c6-9dde-64438a94f4a1 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:37.739538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64ab86fe-59b0-45c6-9dde-64438a94f4a1 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:37.739935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64ab86fe-59b0-45c6-9dde-64438a94f4a1 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:37.740411 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64ab86fe-59b0-45c6-9dde-64438a94f4a1 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:37.833461 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-64ab86fe-59b0-45c6-9dde-64438a94f4a1 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lazy-loading 'services' on Instance uuid 96d30c66-24c7-4b25-81cd-fb638035a1cb {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:56:37.858620 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-64ab86fe-59b0-45c6-9dde-64438a94f4a1 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1929 microversion: 2.75 time: 0.145330 Aug 04 16:56:37.859853 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 283/600] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:37 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1929 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:38.221508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bb382659-9ebf-42da-8efb-6ac36b66729d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:38.222993 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bb382659-9ebf-42da-8efb-6ac36b66729d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:38.226037 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=11 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:38.227292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=32 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:38.232992 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb382659-9ebf-42da-8efb-6ac36b66729d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:38.233698 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb382659-9ebf-42da-8efb-6ac36b66729d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:38.235091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb382659-9ebf-42da-8efb-6ac36b66729d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:38.236204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb382659-9ebf-42da-8efb-6ac36b66729d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:38.236890 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb382659-9ebf-42da-8efb-6ac36b66729d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:38.237670 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb382659-9ebf-42da-8efb-6ac36b66729d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:38.276453 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c660832d-1a97-421d-8ae4-54e4c38aea9c tempest-ImagesDeleteNegativeTestJSON-1106882008 tempest-ImagesDeleteNegativeTestJSON-1106882008-project] 10.222.0.93 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.251126 Aug 04 16:56:38.277440 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 318/601] 10.222.0.93 () {58 vars in 1128 bytes} [Thu Aug 4 16:56:38 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 16:56:38.286314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e2274947-838f-4d27-b71d-7ca538a3cf6c tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:38.287718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e2274947-838f-4d27-b71d-7ca538a3cf6c tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: c0e9cb60-b590-412f-a6a1-fc8534bd1c97] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:38.294706 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2274947-838f-4d27-b71d-7ca538a3cf6c tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:38.295216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2274947-838f-4d27-b71d-7ca538a3cf6c tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:38.295665 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2274947-838f-4d27-b71d-7ca538a3cf6c tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:38.296416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2274947-838f-4d27-b71d-7ca538a3cf6c tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:38.296891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2274947-838f-4d27-b71d-7ca538a3cf6c tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:38.298318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2274947-838f-4d27-b71d-7ca538a3cf6c tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:38.440404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bb382659-9ebf-42da-8efb-6ac36b66729d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:38.449368 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bb382659-9ebf-42da-8efb-6ac36b66729d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989" status: 200 len: 1504 microversion: 2.1 time: 0.236779 Aug 04 16:56:38.450999 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 284/602] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:38 2022] GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989 => generated 1504 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:56:38.456389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7b1bee10-0838-4fc0-a6ae-830086e69c5e tempest-ImagesDeleteNegativeTestJSON-1106882008 tempest-ImagesDeleteNegativeTestJSON-1106882008-project] Calling method '.version_select at 0x7f1e5bb7e790>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:38.468726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e2274947-838f-4d27-b71d-7ca538a3cf6c tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712723e5418441c096f008d1520f6dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8c7c49e56743dd9f64102e53c2bec7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:38.477280 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e2274947-838f-4d27-b71d-7ca538a3cf6c tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97" status: 200 len: 1460 microversion: 2.1 time: 0.198385 Aug 04 16:56:38.477857 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 319/603] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:38 2022] GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97 => generated 1460 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:38.502253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ccae65f7-3f4d-496e-bf4d-6733da3ab5b5 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:38.502875 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ccae65f7-3f4d-496e-bf4d-6733da3ab5b5 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] [instance: c0e9cb60-b590-412f-a6a1-fc8534bd1c97] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:38.509829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ccae65f7-3f4d-496e-bf4d-6733da3ab5b5 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:38.510352 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ccae65f7-3f4d-496e-bf4d-6733da3ab5b5 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:38.510804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ccae65f7-3f4d-496e-bf4d-6733da3ab5b5 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:38.511529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ccae65f7-3f4d-496e-bf4d-6733da3ab5b5 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:38.512189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ccae65f7-3f4d-496e-bf4d-6733da3ab5b5 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:38.512791 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ccae65f7-3f4d-496e-bf4d-6733da3ab5b5 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:38.514742 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-7b1bee10-0838-4fc0-a6ae-830086e69c5e tempest-ImagesDeleteNegativeTestJSON-1106882008 tempest-ImagesDeleteNegativeTestJSON-1106882008-project] HTTP exception thrown: Image not found. Aug 04 16:56:38.517885 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7b1bee10-0838-4fc0-a6ae-830086e69c5e tempest-ImagesDeleteNegativeTestJSON-1106882008 tempest-ImagesDeleteNegativeTestJSON-1106882008-project] Request method failure captured: Aug 04 16:56:38.517885 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 04 16:56:38.517885 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:56:38.517885 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:56:38.517885 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:56:38.517885 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:56:38.517885 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:56:38.517885 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:56:38.517885 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:56:38.517885 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:38.517885 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_pFYGTrZv07TLPcAOco3Gj-3sXmA2UjKTiPhSyaJscbVKlvyUvLjv0KKHvk4UHEKNF6VwhKU-xcQBDFcMAST-yEbyvxWDq4fDG0lt3exqcwhv71z9Sqj8G8Sn9CFLPKNXyWRDbwJVTXPq2TonYzc0t6zDzrNwUHLnmEt3HWDdJicH0 Aug 04 16:56:38.517885 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:56:38.517885 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:56:38.517885 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:56:38.517885 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:56:38.517885 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:56:38.517885 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:56:38.517885 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: c625449bf8a94f068035a64821f90fee Aug 04 16:56:38.517885 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1106882008 Aug 04 16:56:38.517885 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:56:38.517885 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:56:38.519902 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c625449bf8a94f068035a64821f90fee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c625449bf8a94f068035a64821f90fee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c625449bf8a94f068035a64821f90fee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c625449bf8a94f068035a64821f90fee"}]}] Aug 04 16:56:38.519902 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1106882008 Aug 04 16:56:38.519902 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: c625449bf8a94f068035a64821f90fee Aug 04 16:56:38.519902 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1106882008 Aug 04 16:56:38.519902 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ImagesDeleteNegativeTestJSON-1106882008-project Aug 04 16:56:38.519902 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:56:38.519902 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:56:38.519902 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 3068c28408654ea8aa4579cf64b0fb2e Aug 04 16:56:38.519902 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1106882008-project Aug 04 16:56:38.519902 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:56:38.519902 n-d-851359-3 devstack@n-api.service[131044]: exception: Image not found. Aug 04 16:56:38.519902 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '-1'} Aug 04 16:56:38.519902 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:38.519902 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:38.520913 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 16:56:38.520913 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 16:56:38.520913 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:56:38.520913 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:56:38.520913 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:56:38.520913 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:56:38.520913 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 16:56:38.520913 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 16:56:38.520913 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 16:56:38.520913 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 16:56:38.520913 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:56:38.520913 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:56:38.520913 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:56:38.520913 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:56:38.520913 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 04 16:56:38.520913 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.520913 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:38.520913 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.520913 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:38.522435 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 16:56:38.522435 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 16:56:38.522435 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 16:56:38.522435 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 16:56:38.522435 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 16:56:38.522435 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 16:56:38.522435 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 04 16:56:38.522435 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.522435 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:38.522435 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.522435 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:38.522435 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:38.522435 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:38.522435 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:38.522435 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:38.522435 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:56:38.522435 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:56:38.522435 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:38.522435 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:38.522435 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 16:56:38.523682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 16:56:38.523682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 16:56:38.523682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.523682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:38.523682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.523682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:38.523682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:38.523682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:38.523682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:56:38.523682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:56:38.523682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 16:56:38.523682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.523682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7b1bee10-0838-4fc0-a6ae-830086e69c5e tempest-ImagesDeleteNegativeTestJSON-1106882008 tempest-ImagesDeleteNegativeTestJSON-1106882008-project] Returning 404 to user: Image not found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:38.523682 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7b1bee10-0838-4fc0-a6ae-830086e69c5e tempest-ImagesDeleteNegativeTestJSON-1106882008 tempest-ImagesDeleteNegativeTestJSON-1106882008-project] 10.222.0.93 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.067526 Aug 04 16:56:38.523682 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 285/604] 10.222.0.93 () {58 vars in 1134 bytes} [Thu Aug 4 16:56:38 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:56:38.532316 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-902a6725-95fa-4000-b41e-4a8541a26cbb tempest-ImagesDeleteNegativeTestJSON-1106882008 tempest-ImagesDeleteNegativeTestJSON-1106882008-project] Calling method '.version_select at 0x7f1e5bdde9d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:38.564363 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-902a6725-95fa-4000-b41e-4a8541a26cbb tempest-ImagesDeleteNegativeTestJSON-1106882008 tempest-ImagesDeleteNegativeTestJSON-1106882008-project] HTTP exception thrown: Image not found. Aug 04 16:56:38.566157 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-902a6725-95fa-4000-b41e-4a8541a26cbb tempest-ImagesDeleteNegativeTestJSON-1106882008 tempest-ImagesDeleteNegativeTestJSON-1106882008-project] Request method failure captured: Aug 04 16:56:38.566157 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/images/1ef5b643-3820-4f5f-b3e4-52fa0e6414bj HTTP/1.1 Aug 04 16:56:38.566157 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:56:38.566157 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:56:38.566157 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:56:38.566157 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:56:38.566157 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:56:38.566157 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:56:38.566157 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:56:38.566157 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:38.566157 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_pFYGTrZv07TLPcAOco3Gj-3sXmA2UjKTiPhSyaJscbVKlvyUvLjv0KKHvk4UHEKNF6VwhKU-xcQBDFcMAST-yEbyvxWDq4fDG0lt3exqcwhv71z9Sqj8G8Sn9CFLPKNXyWRDbwJVTXPq2TonYzc0t6zDzrNwUHLnmEt3HWDdJicH0 Aug 04 16:56:38.566157 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:56:38.566157 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:56:38.566157 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:56:38.566157 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:56:38.566157 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:56:38.566157 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:56:38.566157 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: c625449bf8a94f068035a64821f90fee Aug 04 16:56:38.566157 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1106882008 Aug 04 16:56:38.566157 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:56:38.566157 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:56:38.567391 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c625449bf8a94f068035a64821f90fee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c625449bf8a94f068035a64821f90fee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c625449bf8a94f068035a64821f90fee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c625449bf8a94f068035a64821f90fee"}]}] Aug 04 16:56:38.567391 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1106882008 Aug 04 16:56:38.567391 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: c625449bf8a94f068035a64821f90fee Aug 04 16:56:38.567391 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1106882008 Aug 04 16:56:38.567391 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ImagesDeleteNegativeTestJSON-1106882008-project Aug 04 16:56:38.567391 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:56:38.567391 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:56:38.567391 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 3068c28408654ea8aa4579cf64b0fb2e Aug 04 16:56:38.567391 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1106882008-project Aug 04 16:56:38.567391 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:56:38.567391 n-d-851359-3 devstack@n-api.service[131044]: exception: Image not found. Aug 04 16:56:38.567391 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '1ef5b643-3820-4f5f-b3e4-52fa0e6414bj'} Aug 04 16:56:38.567391 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:38.568259 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:38.568259 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 16:56:38.568259 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 16:56:38.568259 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:56:38.568259 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:56:38.568259 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:56:38.568259 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:56:38.568259 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 16:56:38.568259 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 16:56:38.568259 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 16:56:38.568259 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 16:56:38.568259 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:56:38.568259 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:56:38.568259 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:56:38.568259 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:56:38.568259 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1ef5b643-3820-4f5f-b3e4-52fa0e6414bj to delete Aug 04 16:56:38.568259 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.568259 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:38.568259 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.573924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:38.573924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 16:56:38.573924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 16:56:38.573924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 16:56:38.573924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 16:56:38.573924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 16:56:38.573924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 16:56:38.573924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1ef5b643-3820-4f5f-b3e4-52fa0e6414bj could not be found. Aug 04 16:56:38.573924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.573924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:38.573924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.573924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:38.573924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:38.573924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:38.573924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:38.573924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:38.573924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:56:38.573924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:56:38.573924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:38.573924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:38.575212 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 16:56:38.575212 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 16:56:38.575212 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 16:56:38.575212 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.575212 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:38.575212 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.575212 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:38.575212 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:38.575212 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:38.575212 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:56:38.575212 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:56:38.575212 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 16:56:38.575212 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.575212 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-902a6725-95fa-4000-b41e-4a8541a26cbb tempest-ImagesDeleteNegativeTestJSON-1106882008 tempest-ImagesDeleteNegativeTestJSON-1106882008-project] Returning 404 to user: Image not found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:38.575212 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-902a6725-95fa-4000-b41e-4a8541a26cbb tempest-ImagesDeleteNegativeTestJSON-1106882008 tempest-ImagesDeleteNegativeTestJSON-1106882008-project] 10.222.0.93 "DELETE /compute/v2.1/images/1ef5b643-3820-4f5f-b3e4-52fa0e6414bj" status: 404 len: 62 microversion: 2.1 time: 0.039997 Aug 04 16:56:38.576068 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 286/605] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:38 2022] DELETE /compute/v2.1/images/1ef5b643-3820-4f5f-b3e4-52fa0e6414bj => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:56:38.580537 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-545656ae-b2e5-4189-95aa-b45476ac7f1c tempest-ImagesDeleteNegativeTestJSON-1106882008 tempest-ImagesDeleteNegativeTestJSON-1106882008-project] Calling method '.version_select at 0x7f1e5bd15af0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:38.589135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=24 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:38.606890 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-545656ae-b2e5-4189-95aa-b45476ac7f1c tempest-ImagesDeleteNegativeTestJSON-1106882008 tempest-ImagesDeleteNegativeTestJSON-1106882008-project] HTTP exception thrown: Image not found. Aug 04 16:56:38.608737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-545656ae-b2e5-4189-95aa-b45476ac7f1c tempest-ImagesDeleteNegativeTestJSON-1106882008 tempest-ImagesDeleteNegativeTestJSON-1106882008-project] Request method failure captured: Aug 04 16:56:38.608737 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/images/44104eeb-f67d-4cb8-8587-e85851a522ad1 HTTP/1.1 Aug 04 16:56:38.608737 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:56:38.608737 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:56:38.608737 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:56:38.608737 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:56:38.608737 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:56:38.608737 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:56:38.608737 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:56:38.608737 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:38.608737 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_pFYGTrZv07TLPcAOco3Gj-3sXmA2UjKTiPhSyaJscbVKlvyUvLjv0KKHvk4UHEKNF6VwhKU-xcQBDFcMAST-yEbyvxWDq4fDG0lt3exqcwhv71z9Sqj8G8Sn9CFLPKNXyWRDbwJVTXPq2TonYzc0t6zDzrNwUHLnmEt3HWDdJicH0 Aug 04 16:56:38.608737 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:56:38.608737 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:56:38.608737 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:56:38.608737 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:56:38.608737 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:56:38.608737 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:56:38.608737 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: c625449bf8a94f068035a64821f90fee Aug 04 16:56:38.608737 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1106882008 Aug 04 16:56:38.608737 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:56:38.608737 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:56:38.610102 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c625449bf8a94f068035a64821f90fee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c625449bf8a94f068035a64821f90fee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c625449bf8a94f068035a64821f90fee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c625449bf8a94f068035a64821f90fee"}]}] Aug 04 16:56:38.610102 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1106882008 Aug 04 16:56:38.610102 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: c625449bf8a94f068035a64821f90fee Aug 04 16:56:38.610102 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1106882008 Aug 04 16:56:38.610102 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ImagesDeleteNegativeTestJSON-1106882008-project Aug 04 16:56:38.610102 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:56:38.610102 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:56:38.610102 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 3068c28408654ea8aa4579cf64b0fb2e Aug 04 16:56:38.610102 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1106882008-project Aug 04 16:56:38.610102 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:56:38.610102 n-d-851359-3 devstack@n-api.service[131044]: exception: Image not found. Aug 04 16:56:38.610102 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '44104eeb-f67d-4cb8-8587-e85851a522ad1'} Aug 04 16:56:38.610102 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:38.610959 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:38.610959 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 16:56:38.610959 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 16:56:38.610959 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:56:38.610959 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:56:38.610959 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:56:38.610959 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:56:38.610959 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 16:56:38.610959 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 16:56:38.610959 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 16:56:38.610959 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 16:56:38.610959 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:56:38.610959 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:56:38.610959 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:56:38.610959 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:56:38.610959 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 44104eeb-f67d-4cb8-8587-e85851a522ad1 to delete Aug 04 16:56:38.610959 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.610959 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:38.610959 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.612015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:38.612015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 16:56:38.612015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 16:56:38.612015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 16:56:38.612015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 16:56:38.612015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 16:56:38.612015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 16:56:38.612015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 44104eeb-f67d-4cb8-8587-e85851a522ad1 could not be found. Aug 04 16:56:38.612015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.612015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:38.612015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.612015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:38.612015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:38.612015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:38.612015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:38.612015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:38.612015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:56:38.612015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:56:38.612015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:38.612015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:38.614378 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 16:56:38.614378 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 16:56:38.614378 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 16:56:38.614378 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.614378 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:38.614378 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.614378 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:38.614378 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:38.614378 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:38.614378 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:56:38.614378 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:56:38.614378 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 16:56:38.614378 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.614378 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-545656ae-b2e5-4189-95aa-b45476ac7f1c tempest-ImagesDeleteNegativeTestJSON-1106882008 tempest-ImagesDeleteNegativeTestJSON-1106882008-project] Returning 404 to user: Image not found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:38.614378 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-545656ae-b2e5-4189-95aa-b45476ac7f1c tempest-ImagesDeleteNegativeTestJSON-1106882008 tempest-ImagesDeleteNegativeTestJSON-1106882008-project] 10.222.0.93 "DELETE /compute/v2.1/images/44104eeb-f67d-4cb8-8587-e85851a522ad1" status: 404 len: 62 microversion: 2.1 time: 0.039436 Aug 04 16:56:38.616069 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 287/606] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 16:56:38 2022] DELETE /compute/v2.1/images/44104eeb-f67d-4cb8-8587-e85851a522ad1 => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 04 16:56:38.623825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3cf1eb9d-91d8-4cc5-b9a0-57ee42ff6ade tempest-ImagesDeleteNegativeTestJSON-1106882008 tempest-ImagesDeleteNegativeTestJSON-1106882008-project] Calling method '.version_select at 0x7f1e5bc39820>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:38.652426 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-3cf1eb9d-91d8-4cc5-b9a0-57ee42ff6ade tempest-ImagesDeleteNegativeTestJSON-1106882008 tempest-ImagesDeleteNegativeTestJSON-1106882008-project] HTTP exception thrown: Image not found. Aug 04 16:56:38.654463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3cf1eb9d-91d8-4cc5-b9a0-57ee42ff6ade tempest-ImagesDeleteNegativeTestJSON-1106882008 tempest-ImagesDeleteNegativeTestJSON-1106882008-project] Request method failure captured: Aug 04 16:56:38.654463 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/images/tempest-invalid-1128800892 HTTP/1.1 Aug 04 16:56:38.654463 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:56:38.654463 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:56:38.654463 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:56:38.654463 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:56:38.654463 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:56:38.654463 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:56:38.654463 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:56:38.654463 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:38.654463 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_pFYGTrZv07TLPcAOco3Gj-3sXmA2UjKTiPhSyaJscbVKlvyUvLjv0KKHvk4UHEKNF6VwhKU-xcQBDFcMAST-yEbyvxWDq4fDG0lt3exqcwhv71z9Sqj8G8Sn9CFLPKNXyWRDbwJVTXPq2TonYzc0t6zDzrNwUHLnmEt3HWDdJicH0 Aug 04 16:56:38.654463 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:56:38.654463 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:56:38.654463 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:56:38.654463 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:56:38.654463 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:56:38.654463 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:56:38.654463 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: c625449bf8a94f068035a64821f90fee Aug 04 16:56:38.654463 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1106882008 Aug 04 16:56:38.654463 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:56:38.654463 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:56:38.655863 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c625449bf8a94f068035a64821f90fee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c625449bf8a94f068035a64821f90fee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c625449bf8a94f068035a64821f90fee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c625449bf8a94f068035a64821f90fee"}]}] Aug 04 16:56:38.655863 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1106882008 Aug 04 16:56:38.655863 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: c625449bf8a94f068035a64821f90fee Aug 04 16:56:38.655863 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1106882008 Aug 04 16:56:38.655863 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ImagesDeleteNegativeTestJSON-1106882008-project Aug 04 16:56:38.655863 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:56:38.655863 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:56:38.655863 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 3068c28408654ea8aa4579cf64b0fb2e Aug 04 16:56:38.655863 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1106882008-project Aug 04 16:56:38.655863 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:56:38.655863 n-d-851359-3 devstack@n-api.service[131044]: exception: Image not found. Aug 04 16:56:38.655863 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'tempest-invalid-1128800892'} Aug 04 16:56:38.655863 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:38.656671 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:38.656671 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 16:56:38.656671 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 16:56:38.656671 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:56:38.656671 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:56:38.656671 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:56:38.656671 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:56:38.656671 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 16:56:38.656671 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 16:56:38.656671 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 16:56:38.656671 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 16:56:38.656671 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:56:38.656671 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:56:38.656671 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:56:38.656671 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:56:38.656671 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1128800892 to delete Aug 04 16:56:38.656671 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.656671 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:38.656671 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.658457 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:38.658457 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 16:56:38.658457 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 16:56:38.658457 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 16:56:38.658457 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 16:56:38.658457 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 16:56:38.658457 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 16:56:38.658457 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1128800892 could not be found. Aug 04 16:56:38.658457 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.658457 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:38.658457 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.658457 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:38.658457 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:38.658457 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:38.658457 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:38.658457 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:38.658457 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:56:38.658457 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:56:38.658457 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:38.658457 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:38.662242 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 16:56:38.662242 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 16:56:38.662242 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 16:56:38.662242 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.662242 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:38.662242 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.662242 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:38.662242 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:38.662242 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:38.662242 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:56:38.662242 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:56:38.662242 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 16:56:38.662242 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.662242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3cf1eb9d-91d8-4cc5-b9a0-57ee42ff6ade tempest-ImagesDeleteNegativeTestJSON-1106882008 tempest-ImagesDeleteNegativeTestJSON-1106882008-project] Returning 404 to user: Image not found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:38.662242 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3cf1eb9d-91d8-4cc5-b9a0-57ee42ff6ade tempest-ImagesDeleteNegativeTestJSON-1106882008 tempest-ImagesDeleteNegativeTestJSON-1106882008-project] 10.222.0.93 "DELETE /compute/v2.1/images/tempest-invalid-1128800892" status: 404 len: 62 microversion: 2.1 time: 0.036183 Aug 04 16:56:38.663419 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 288/607] 10.222.0.93 () {58 vars in 1206 bytes} [Thu Aug 4 16:56:38 2022] DELETE /compute/v2.1/images/tempest-invalid-1128800892 => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 04 16:56:38.674795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0312503c-3327-437f-b9d3-80be23ba11c4 tempest-ImagesDeleteNegativeTestJSON-1106882008 tempest-ImagesDeleteNegativeTestJSON-1106882008-project] Calling method '.version_select at 0x7f1e5bb7e0d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:38.697013 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-0312503c-3327-437f-b9d3-80be23ba11c4 tempest-ImagesDeleteNegativeTestJSON-1106882008 tempest-ImagesDeleteNegativeTestJSON-1106882008-project] HTTP exception thrown: Image not found. Aug 04 16:56:38.698901 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0312503c-3327-437f-b9d3-80be23ba11c4 tempest-ImagesDeleteNegativeTestJSON-1106882008 tempest-ImagesDeleteNegativeTestJSON-1106882008-project] Request method failure captured: Aug 04 16:56:38.698901 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/images/e635c891-822f-47b2-adc7-e827a7a9c848 HTTP/1.1 Aug 04 16:56:38.698901 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:56:38.698901 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:56:38.698901 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:56:38.698901 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:56:38.698901 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:56:38.698901 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:56:38.698901 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:56:38.698901 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:38.698901 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_pFYGTrZv07TLPcAOco3Gj-3sXmA2UjKTiPhSyaJscbVKlvyUvLjv0KKHvk4UHEKNF6VwhKU-xcQBDFcMAST-yEbyvxWDq4fDG0lt3exqcwhv71z9Sqj8G8Sn9CFLPKNXyWRDbwJVTXPq2TonYzc0t6zDzrNwUHLnmEt3HWDdJicH0 Aug 04 16:56:38.698901 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:56:38.698901 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:56:38.698901 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:56:38.698901 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:56:38.698901 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:56:38.698901 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:56:38.698901 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: c625449bf8a94f068035a64821f90fee Aug 04 16:56:38.698901 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1106882008 Aug 04 16:56:38.698901 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:56:38.698901 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:56:38.700258 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c625449bf8a94f068035a64821f90fee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c625449bf8a94f068035a64821f90fee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c625449bf8a94f068035a64821f90fee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c625449bf8a94f068035a64821f90fee"}]}] Aug 04 16:56:38.700258 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1106882008 Aug 04 16:56:38.700258 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: c625449bf8a94f068035a64821f90fee Aug 04 16:56:38.700258 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1106882008 Aug 04 16:56:38.700258 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ImagesDeleteNegativeTestJSON-1106882008-project Aug 04 16:56:38.700258 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:56:38.700258 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:56:38.700258 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 3068c28408654ea8aa4579cf64b0fb2e Aug 04 16:56:38.700258 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1106882008-project Aug 04 16:56:38.700258 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:56:38.700258 n-d-851359-3 devstack@n-api.service[131044]: exception: Image not found. Aug 04 16:56:38.700258 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'e635c891-822f-47b2-adc7-e827a7a9c848'} Aug 04 16:56:38.700258 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:38.701032 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:38.701032 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 16:56:38.701032 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 16:56:38.701032 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 16:56:38.701032 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 16:56:38.701032 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 16:56:38.701032 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 16:56:38.701032 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 16:56:38.701032 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 16:56:38.701032 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 16:56:38.701032 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 16:56:38.701032 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 16:56:38.701032 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 16:56:38.701032 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 16:56:38.701032 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 16:56:38.701032 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e635c891-822f-47b2-adc7-e827a7a9c848 to delete Aug 04 16:56:38.701032 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.701032 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:38.701032 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.705043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:38.705043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 16:56:38.705043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 16:56:38.705043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 16:56:38.705043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 16:56:38.705043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 16:56:38.705043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 16:56:38.705043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e635c891-822f-47b2-adc7-e827a7a9c848 could not be found. Aug 04 16:56:38.705043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.705043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:38.705043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.705043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:38.705043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:38.705043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:38.705043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:38.705043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:38.705043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:56:38.705043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:56:38.705043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:38.705043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:38.706307 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 16:56:38.706307 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 16:56:38.706307 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 16:56:38.706307 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.706307 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:38.706307 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.706307 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:38.706307 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:38.706307 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:38.706307 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:56:38.706307 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:56:38.706307 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 16:56:38.706307 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:38.706307 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0312503c-3327-437f-b9d3-80be23ba11c4 tempest-ImagesDeleteNegativeTestJSON-1106882008 tempest-ImagesDeleteNegativeTestJSON-1106882008-project] Returning 404 to user: Image not found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:38.706307 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0312503c-3327-437f-b9d3-80be23ba11c4 tempest-ImagesDeleteNegativeTestJSON-1106882008 tempest-ImagesDeleteNegativeTestJSON-1106882008-project] 10.222.0.93 "DELETE /compute/v2.1/images/e635c891-822f-47b2-adc7-e827a7a9c848" status: 404 len: 62 microversion: 2.1 time: 0.037536 Aug 04 16:56:38.709005 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 289/608] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:38 2022] DELETE /compute/v2.1/images/e635c891-822f-47b2-adc7-e827a7a9c848 => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:56:38.709005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-086d876e-3abf-4220-bec0-26eef10b1e38 req-bd5cdd62-9095-4f39-8314-b1eed75a4c16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc381c07-ce7e-4a71-bede-f15c69c1d989", "tag": "ab451c60-9699-45ff-809b-94b053bd20d8"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:38.717573 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-086d876e-3abf-4220-bec0-26eef10b1e38 req-bd5cdd62-9095-4f39-8314-b1eed75a4c16 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:38.718105 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-086d876e-3abf-4220-bec0-26eef10b1e38 req-bd5cdd62-9095-4f39-8314-b1eed75a4c16 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:38.718931 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-086d876e-3abf-4220-bec0-26eef10b1e38 req-bd5cdd62-9095-4f39-8314-b1eed75a4c16 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:38.732459 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-086d876e-3abf-4220-bec0-26eef10b1e38 req-bd5cdd62-9095-4f39-8314-b1eed75a4c16 service nova] Creating event network-changed:ab451c60-9699-45ff-809b-94b053bd20d8 for instance fc381c07-ce7e-4a71-bede-f15c69c1d989 on n-h1-851359-3 Aug 04 16:56:38.738599 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-086d876e-3abf-4220-bec0-26eef10b1e38 req-bd5cdd62-9095-4f39-8314-b1eed75a4c16 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036641 Aug 04 16:56:38.742104 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 290/609] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:38.747488 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e85d9152-94f1-4c1d-b857-2815914c027c tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:38.748202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e85d9152-94f1-4c1d-b857-2815914c027c tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: b8efce6c-198e-49a7-8576-32d80cb168df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:38.759182 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e85d9152-94f1-4c1d-b857-2815914c027c tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:38.759701 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e85d9152-94f1-4c1d-b857-2815914c027c tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:38.760417 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e85d9152-94f1-4c1d-b857-2815914c027c tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:38.764933 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e85d9152-94f1-4c1d-b857-2815914c027c tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:38.766355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e85d9152-94f1-4c1d-b857-2815914c027c tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:38.767674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e85d9152-94f1-4c1d-b857-2815914c027c tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:38.785376 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:38.797485 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ccae65f7-3f4d-496e-bf4d-6733da3ab5b5 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97" status: 200 len: 1611 microversion: 2.1 time: 0.299062 Aug 04 16:56:38.815732 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 320/610] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:38 2022] GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97 => generated 1611 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:56:38.822737 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e1ffd1b4-5afe-4df2-a0e8-b928566dc627 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:38.823701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e1ffd1b4-5afe-4df2-a0e8-b928566dc627 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:38.832194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1ffd1b4-5afe-4df2-a0e8-b928566dc627 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:38.832923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1ffd1b4-5afe-4df2-a0e8-b928566dc627 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:38.834294 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1ffd1b4-5afe-4df2-a0e8-b928566dc627 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:38.835240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1ffd1b4-5afe-4df2-a0e8-b928566dc627 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:38.835933 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1ffd1b4-5afe-4df2-a0e8-b928566dc627 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:38.837753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1ffd1b4-5afe-4df2-a0e8-b928566dc627 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:38.954029 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=8 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:39.118449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e1ffd1b4-5afe-4df2-a0e8-b928566dc627 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:39.130622 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e1ffd1b4-5afe-4df2-a0e8-b928566dc627 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1313 microversion: 2.1 time: 0.313245 Aug 04 16:56:39.131751 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 321/611] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:38 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:39.137128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-103663fe-d2be-4008-be87-1c787c3a6d5d tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:39.141651 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:56:39.141651 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:56:39.143607 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-103663fe-d2be-4008-be87-1c787c3a6d5d tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:39.144336 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-103663fe-d2be-4008-be87-1c787c3a6d5d tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:39.145013 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-103663fe-d2be-4008-be87-1c787c3a6d5d tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:39.145822 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-103663fe-d2be-4008-be87-1c787c3a6d5d tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:39.146397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-103663fe-d2be-4008-be87-1c787c3a6d5d tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:39.146964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-103663fe-d2be-4008-be87-1c787c3a6d5d tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:39.153810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e85d9152-94f1-4c1d-b857-2815914c027c tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:39.163590 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e85d9152-94f1-4c1d-b857-2815914c027c tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df" status: 200 len: 1322 microversion: 2.1 time: 0.420277 Aug 04 16:56:39.164170 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 291/612] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:38 2022] GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df => generated 1322 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:39.181331 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-103663fe-d2be-4008-be87-1c787c3a6d5d tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.048249 Aug 04 16:56:39.182419 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 322/613] 10.222.0.93 () {58 vars in 1176 bytes} [Thu Aug 4 16:56:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:39.189395 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c9ab80f5-8658-4765-b152-1100d539c99e tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:39.192532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c9ab80f5-8658-4765-b152-1100d539c99e tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:39.196625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d7324212-f122-49b6-a21d-af71ad98cdf3 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851359-3", "block_migration": true, "disk_over_commit": false}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:39.199874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d7324212-f122-49b6-a21d-af71ad98cdf3 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] [instance: c0e9cb60-b590-412f-a6a1-fc8534bd1c97] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:39.205494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9ab80f5-8658-4765-b152-1100d539c99e tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:39.207567 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9ab80f5-8658-4765-b152-1100d539c99e tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:39.208624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7324212-f122-49b6-a21d-af71ad98cdf3 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:39.208829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9ab80f5-8658-4765-b152-1100d539c99e tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:39.209564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7324212-f122-49b6-a21d-af71ad98cdf3 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:39.210325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7324212-f122-49b6-a21d-af71ad98cdf3 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:39.211825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9ab80f5-8658-4765-b152-1100d539c99e tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:39.212483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9ab80f5-8658-4765-b152-1100d539c99e tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:39.212725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7324212-f122-49b6-a21d-af71ad98cdf3 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:39.213309 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9ab80f5-8658-4765-b152-1100d539c99e tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:39.213635 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7324212-f122-49b6-a21d-af71ad98cdf3 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:39.215235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7324212-f122-49b6-a21d-af71ad98cdf3 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:39.248359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-d7324212-f122-49b6-a21d-af71ad98cdf3 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Lazy-loading 'flavor' on Instance uuid c0e9cb60-b590-412f-a6a1-fc8534bd1c97 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:56:39.268797 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-d7324212-f122-49b6-a21d-af71ad98cdf3 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance c0e9cb60-b590-412f-a6a1-fc8534bd1c97 while it is in vm_state suspended Aug 04 16:56:39.271238 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d7324212-f122-49b6-a21d-af71ad98cdf3 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Request method failure captured: Aug 04 16:56:39.271238 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97/action HTTP/1.1 Aug 04 16:56:39.271238 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:56:39.271238 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:56:39.271238 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:56:39.271238 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 97 Aug 04 16:56:39.271238 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:56:39.271238 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:56:39.271238 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:56:39.271238 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:39.271238 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_oXFR_NwOpOOCavnZuPLghySyLoRUJL1zs3DwPeMOtMhgzxZGHc-EC1UmBfYbWB3okXOuugFq1Qor5RlKJjPLU9bX5eOy-f19JnpIHicdvOBWcELy28qHt6P29VkFM35UFIPnYgtmef6QMEVx2ve6Gy-EpGXJhzrkESNHQ_otn97E4 Aug 04 16:56:39.271238 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:56:39.271238 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:56:39.271238 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:56:39.271238 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:56:39.271238 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:56:39.271238 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:56:39.271238 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: de7aed43550a451e93a1ac32adfde6f8 Aug 04 16:56:39.271238 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-LiveMigrationNegativeTest-1474604380 Aug 04 16:56:39.271238 n-d-851359-3 devstack@n-api.service[131043]: X-Role: admin,member,reader Aug 04 16:56:39.271238 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: admin,member,reader Aug 04 16:56:39.273385 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/de7aed43550a451e93a1ac32adfde6f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/de7aed43550a451e93a1ac32adfde6f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_de7aed43550a451e93a1ac32adfde6f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/de7aed43550a451e93a1ac32adfde6f8"}]}] Aug 04 16:56:39.273385 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-LiveMigrationNegativeTest-1474604380 Aug 04 16:56:39.273385 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: de7aed43550a451e93a1ac32adfde6f8 Aug 04 16:56:39.273385 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1474604380 Aug 04 16:56:39.273385 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-LiveMigrationNegativeTest-1474604380-project-admin Aug 04 16:56:39.273385 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:56:39.273385 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:56:39.273385 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: c43a503c5bd6425183ef105bf03d7fc4 Aug 04 16:56:39.273385 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-LiveMigrationNegativeTest-1474604380-project-admin Aug 04 16:56:39.273385 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 16:56:39.273385 n-d-851359-3 devstack@n-api.service[131043]: {"os-migrateLive": {"host": "n-h2-851359-3", "block_migration": true, "disk_over_commit": false}} Aug 04 16:56:39.273385 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 16:56:39.274747 n-d-851359-3 devstack@n-api.service[131043]: exception: Cannot 'os-migrateLive' instance c0e9cb60-b590-412f-a6a1-fc8534bd1c97 while it is in vm_state suspended Aug 04 16:56:39.274747 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'c0e9cb60-b590-412f-a6a1-fc8534bd1c97', 'body': {'os-migrateLive': {'host': 'n-h2-851359-3', 'block_migration': True, 'disk_over_commit': False}}} Aug 04 16:56:39.274747 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:39.274747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:39.274747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 04 16:56:39.274747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 04 16:56:39.274747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 04 16:56:39.274747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 16:56:39.274747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 04 16:56:39.274747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 16:56:39.274747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 04 16:56:39.274747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 16:56:39.274747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 16:56:39.274747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 16:56:39.274747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 04 16:56:39.274747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 16:56:39.274747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 04 16:56:39.274747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 16:56:39.275788 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 16:56:39.275788 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 16:56:39.275788 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 16:56:39.275788 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 16:56:39.275788 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c0e9cb60-b590-412f-a6a1-fc8534bd1c97 in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 04 16:56:39.275788 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:39.275788 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:39.275788 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:39.275788 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:39.275788 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:39.275788 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:39.275788 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:39.275788 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:39.275788 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:39.275788 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:39.275788 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:56:39.275788 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:56:39.275788 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:56:39.275788 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:56:39.275788 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:56:39.277368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:56:39.277368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 04 16:56:39.277368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 04 16:56:39.277368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 16:56:39.277368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 16:56:39.277368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 16:56:39.277368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance c0e9cb60-b590-412f-a6a1-fc8534bd1c97 while it is in vm_state suspended Aug 04 16:56:39.277368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:39.277368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:39.277368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:39.277368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:39.277368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:39.277368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:39.277368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:56:39.277368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:56:39.277368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance c0e9cb60-b590-412f-a6a1-fc8534bd1c97 while it is in vm_state suspended Aug 04 16:56:39.277368 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:39.279549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d7324212-f122-49b6-a21d-af71ad98cdf3 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance c0e9cb60-b590-412f-a6a1-fc8534bd1c97 while it is in vm_state suspended {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:39.280605 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d7324212-f122-49b6-a21d-af71ad98cdf3 tempest-LiveMigrationNegativeTest-1474604380 tempest-LiveMigrationNegativeTest-1474604380-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97/action" status: 409 len: 155 microversion: 2.1 time: 0.089580 Aug 04 16:56:39.287103 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 323/614] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:56:39 2022] POST /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97/action => generated 155 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:56:39.292629 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fd363e83-7c5a-4c68-9b33-46bf2d45e5d8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:39.293720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fd363e83-7c5a-4c68-9b33-46bf2d45e5d8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: c0e9cb60-b590-412f-a6a1-fc8534bd1c97] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:39.300785 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd363e83-7c5a-4c68-9b33-46bf2d45e5d8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:39.301689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd363e83-7c5a-4c68-9b33-46bf2d45e5d8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:39.302452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd363e83-7c5a-4c68-9b33-46bf2d45e5d8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:39.303389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd363e83-7c5a-4c68-9b33-46bf2d45e5d8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:39.304055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd363e83-7c5a-4c68-9b33-46bf2d45e5d8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:39.304765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd363e83-7c5a-4c68-9b33-46bf2d45e5d8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:39.339901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fd363e83-7c5a-4c68-9b33-46bf2d45e5d8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: c0e9cb60-b590-412f-a6a1-fc8534bd1c97] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:56:39.424195 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:39.450675 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fd363e83-7c5a-4c68-9b33-46bf2d45e5d8 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "DELETE /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97" status: 204 len: 0 microversion: 2.1 time: 0.161070 Aug 04 16:56:39.452825 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 324/615] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 16:56:39 2022] DELETE /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:56:39.465581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-709ed8ba-fedb-4117-814a-044d03de0652 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:39.467387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-709ed8ba-fedb-4117-814a-044d03de0652 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: c0e9cb60-b590-412f-a6a1-fc8534bd1c97] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:39.477391 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-709ed8ba-fedb-4117-814a-044d03de0652 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:39.478193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-709ed8ba-fedb-4117-814a-044d03de0652 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:39.480028 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-709ed8ba-fedb-4117-814a-044d03de0652 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:39.480983 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-709ed8ba-fedb-4117-814a-044d03de0652 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:39.481615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-709ed8ba-fedb-4117-814a-044d03de0652 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:39.482251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-709ed8ba-fedb-4117-814a-044d03de0652 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:39.662175 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-c9ab80f5-8658-4765-b152-1100d539c99e tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lazy-loading 'services' on Instance uuid 96d30c66-24c7-4b25-81cd-fb638035a1cb {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:56:39.680263 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c9ab80f5-8658-4765-b152-1100d539c99e tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1929 microversion: 2.75 time: 0.501599 Aug 04 16:56:39.680817 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 292/616] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:39 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1929 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:39.685686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-07983de5-3983-4a0f-a430-d0e6aebb0ac5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:39.686326 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-07983de5-3983-4a0f-a430-d0e6aebb0ac5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:39.691920 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07983de5-3983-4a0f-a430-d0e6aebb0ac5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:39.692594 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07983de5-3983-4a0f-a430-d0e6aebb0ac5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:39.693034 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07983de5-3983-4a0f-a430-d0e6aebb0ac5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:39.693740 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07983de5-3983-4a0f-a430-d0e6aebb0ac5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:39.694224 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07983de5-3983-4a0f-a430-d0e6aebb0ac5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:39.694681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07983de5-3983-4a0f-a430-d0e6aebb0ac5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:39.894813 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-709ed8ba-fedb-4117-814a-044d03de0652 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712723e5418441c096f008d1520f6dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8c7c49e56743dd9f64102e53c2bec7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:39.902431 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-709ed8ba-fedb-4117-814a-044d03de0652 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97" status: 200 len: 1466 microversion: 2.1 time: 0.444777 Aug 04 16:56:39.903110 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 325/617] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:39 2022] GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97 => generated 1466 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:56:39.923215 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-07983de5-3983-4a0f-a430-d0e6aebb0ac5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:39.931844 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-07983de5-3983-4a0f-a430-d0e6aebb0ac5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989" status: 200 len: 1504 microversion: 2.1 time: 0.249824 Aug 04 16:56:39.932902 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 293/618] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:39 2022] GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989 => generated 1504 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:40.107083 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-44c8dd5c-a093-4876-b80d-38f7d49d4b21 tempest-HypervisorAdminNegativeTestJSON-1211304953 tempest-HypervisorAdminNegativeTestJSON-1211304953-project] Calling method '.version_select at 0x7f1e5bac5e50>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:40.107967 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:56:40.107967 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:56:40.109022 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-44c8dd5c-a093-4876-b80d-38f7d49d4b21 tempest-HypervisorAdminNegativeTestJSON-1211304953 tempest-HypervisorAdminNegativeTestJSON-1211304953-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '5b15ccefc5cf4351a3c0c574f0821910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46fe5c413294401a1fe8cbf5e4164dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:40.119025 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-44c8dd5c-a093-4876-b80d-38f7d49d4b21 tempest-HypervisorAdminNegativeTestJSON-1211304953 tempest-HypervisorAdminNegativeTestJSON-1211304953-project] Request method failure captured: Aug 04 16:56:40.119025 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 04 16:56:40.119025 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:56:40.119025 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:56:40.119025 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:56:40.119025 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:56:40.119025 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:56:40.119025 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:56:40.119025 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:56:40.119025 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:40.119025 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_pGPfxzz4CF0eV7mmXfGE2RG1TyXec6P7-LK4iH6hzynNAaLLUSUaD9o4CrfwLAlvW5YgvFbyfK5RxfOrb2yvUtHanK6AJbcYLDbgtc3ycRaebSgW570MEgYSG-_q9mh6mTSY5nsqHitjPHveB0_zawBTR6ZV_h19qF_HCVtje6TvA Aug 04 16:56:40.119025 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:56:40.119025 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:56:40.119025 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:56:40.119025 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:56:40.119025 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:56:40.119025 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:56:40.119025 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: a46fe5c413294401a1fe8cbf5e4164dd Aug 04 16:56:40.119025 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1211304953 Aug 04 16:56:40.119025 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 16:56:40.119025 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 16:56:40.120544 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a46fe5c413294401a1fe8cbf5e4164dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a46fe5c413294401a1fe8cbf5e4164dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a46fe5c413294401a1fe8cbf5e4164dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a46fe5c413294401a1fe8cbf5e4164dd"}]}] Aug 04 16:56:40.120544 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1211304953 Aug 04 16:56:40.120544 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: a46fe5c413294401a1fe8cbf5e4164dd Aug 04 16:56:40.120544 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1211304953 Aug 04 16:56:40.120544 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-HypervisorAdminNegativeTestJSON-1211304953-project Aug 04 16:56:40.120544 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:56:40.120544 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:56:40.120544 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 5b15ccefc5cf4351a3c0c574f0821910 Aug 04 16:56:40.120544 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1211304953-project Aug 04 16:56:40.120544 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 16:56:40.120544 n-d-851359-3 devstack@n-api.service[131043]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 04 16:56:40.120544 n-d-851359-3 devstack@n-api.service[131043]: action_args: {} Aug 04 16:56:40.120544 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:40.121468 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:40.121468 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:40.121468 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:40.121468 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:40.121468 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:40.121468 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:56:40.121468 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:56:40.121468 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:40.121468 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:40.121468 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 04 16:56:40.121468 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 04 16:56:40.121468 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 04 16:56:40.121468 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 04 16:56:40.121468 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:56:40.121468 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:56:40.121468 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:56:40.121468 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:56:40.121468 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:56:40.121468 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:56:40.122864 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:56:40.122864 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:56:40.122864 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:56:40.122864 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:56:40.122864 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:56:40.122864 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:56:40.122864 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:56:40.122864 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:56:40.122864 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 04 16:56:40.122864 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:40.122864 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:40.122864 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:40.122864 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:40.122864 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:40.122864 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:40.122864 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:56:40.122864 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:56:40.122864 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 04 16:56:40.122864 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:40.124205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-44c8dd5c-a093-4876-b80d-38f7d49d4b21 tempest-HypervisorAdminNegativeTestJSON-1211304953 tempest-HypervisorAdminNegativeTestJSON-1211304953-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:40.124205 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-44c8dd5c-a093-4876-b80d-38f7d49d4b21 tempest-HypervisorAdminNegativeTestJSON-1211304953 tempest-HypervisorAdminNegativeTestJSON-1211304953-project] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.203566 Aug 04 16:56:40.124205 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 326/619] 10.222.0.93 () {58 vars in 1167 bytes} [Thu Aug 4 16:56:39 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 218 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:56:40.132466 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1f0e7134-7e75-4118-8252-8d0dcc386949 tempest-HypervisorAdminNegativeTestJSON-1211304953 tempest-HypervisorAdminNegativeTestJSON-1211304953-project] Calling method '.version_select at 0x7f1e5baa21f0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:40.133363 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:56:40.133363 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:56:40.134482 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1f0e7134-7e75-4118-8252-8d0dcc386949 tempest-HypervisorAdminNegativeTestJSON-1211304953 tempest-HypervisorAdminNegativeTestJSON-1211304953-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '5b15ccefc5cf4351a3c0c574f0821910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46fe5c413294401a1fe8cbf5e4164dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:40.136923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1f0e7134-7e75-4118-8252-8d0dcc386949 tempest-HypervisorAdminNegativeTestJSON-1211304953 tempest-HypervisorAdminNegativeTestJSON-1211304953-project] Request method failure captured: Aug 04 16:56:40.136923 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 04 16:56:40.136923 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:56:40.136923 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:56:40.136923 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:56:40.136923 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:56:40.136923 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:56:40.136923 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:56:40.136923 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:56:40.136923 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:40.136923 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_pGPfxzz4CF0eV7mmXfGE2RG1TyXec6P7-LK4iH6hzynNAaLLUSUaD9o4CrfwLAlvW5YgvFbyfK5RxfOrb2yvUtHanK6AJbcYLDbgtc3ycRaebSgW570MEgYSG-_q9mh6mTSY5nsqHitjPHveB0_zawBTR6ZV_h19qF_HCVtje6TvA Aug 04 16:56:40.136923 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:56:40.136923 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:56:40.136923 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:56:40.136923 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:56:40.136923 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:56:40.136923 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:56:40.136923 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: a46fe5c413294401a1fe8cbf5e4164dd Aug 04 16:56:40.136923 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1211304953 Aug 04 16:56:40.136923 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:56:40.136923 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:56:40.138272 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a46fe5c413294401a1fe8cbf5e4164dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a46fe5c413294401a1fe8cbf5e4164dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a46fe5c413294401a1fe8cbf5e4164dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a46fe5c413294401a1fe8cbf5e4164dd"}]}] Aug 04 16:56:40.138272 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1211304953 Aug 04 16:56:40.138272 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: a46fe5c413294401a1fe8cbf5e4164dd Aug 04 16:56:40.138272 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1211304953 Aug 04 16:56:40.138272 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-HypervisorAdminNegativeTestJSON-1211304953-project Aug 04 16:56:40.138272 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:56:40.138272 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:56:40.138272 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 5b15ccefc5cf4351a3c0c574f0821910 Aug 04 16:56:40.138272 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1211304953-project Aug 04 16:56:40.138272 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:56:40.138272 n-d-851359-3 devstack@n-api.service[131044]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 04 16:56:40.138272 n-d-851359-3 devstack@n-api.service[131044]: action_args: {} Aug 04 16:56:40.138272 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:40.139060 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:40.139060 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:40.139060 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:40.139060 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:40.139060 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:40.139060 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:56:40.139060 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:56:40.139060 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:40.139060 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:40.139060 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 04 16:56:40.139060 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 04 16:56:40.139060 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 04 16:56:40.139060 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 04 16:56:40.139060 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:56:40.139060 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:56:40.139060 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:56:40.139060 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:56:40.139060 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:56:40.139060 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:56:40.140159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:56:40.140159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:56:40.140159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:56:40.140159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:56:40.140159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:56:40.140159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:56:40.140159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:56:40.140159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:56:40.140159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 04 16:56:40.140159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:40.140159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:40.140159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:40.140159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:40.140159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:40.140159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:40.140159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:56:40.140159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:56:40.140159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 04 16:56:40.140159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:40.141856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1f0e7134-7e75-4118-8252-8d0dcc386949 tempest-HypervisorAdminNegativeTestJSON-1211304953 tempest-HypervisorAdminNegativeTestJSON-1211304953-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:40.141856 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1f0e7134-7e75-4118-8252-8d0dcc386949 tempest-HypervisorAdminNegativeTestJSON-1211304953 tempest-HypervisorAdminNegativeTestJSON-1211304953-project] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.010572 Aug 04 16:56:40.141856 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 294/620] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:56:40 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:56:40.150313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b4692d34-c58e-41e0-873d-b6996408d453 tempest-HypervisorAdminNegativeTestJSON-1211304953 tempest-HypervisorAdminNegativeTestJSON-1211304953-project] Calling method '.version_select at 0x7f1e5ba13f70>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:40.151285 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:56:40.151285 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:56:40.152695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b4692d34-c58e-41e0-873d-b6996408d453 tempest-HypervisorAdminNegativeTestJSON-1211304953 tempest-HypervisorAdminNegativeTestJSON-1211304953-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '5b15ccefc5cf4351a3c0c574f0821910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46fe5c413294401a1fe8cbf5e4164dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:40.154273 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b4692d34-c58e-41e0-873d-b6996408d453 tempest-HypervisorAdminNegativeTestJSON-1211304953 tempest-HypervisorAdminNegativeTestJSON-1211304953-project] Request method failure captured: Aug 04 16:56:40.154273 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 04 16:56:40.154273 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:56:40.154273 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:56:40.154273 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:56:40.154273 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:56:40.154273 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:56:40.154273 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:56:40.154273 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:56:40.154273 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:40.154273 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_pGPfxzz4CF0eV7mmXfGE2RG1TyXec6P7-LK4iH6hzynNAaLLUSUaD9o4CrfwLAlvW5YgvFbyfK5RxfOrb2yvUtHanK6AJbcYLDbgtc3ycRaebSgW570MEgYSG-_q9mh6mTSY5nsqHitjPHveB0_zawBTR6ZV_h19qF_HCVtje6TvA Aug 04 16:56:40.154273 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:56:40.154273 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:56:40.154273 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:56:40.154273 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:56:40.154273 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:56:40.154273 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:56:40.154273 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: a46fe5c413294401a1fe8cbf5e4164dd Aug 04 16:56:40.154273 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1211304953 Aug 04 16:56:40.154273 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 16:56:40.154273 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 16:56:40.155771 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a46fe5c413294401a1fe8cbf5e4164dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a46fe5c413294401a1fe8cbf5e4164dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a46fe5c413294401a1fe8cbf5e4164dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a46fe5c413294401a1fe8cbf5e4164dd"}]}] Aug 04 16:56:40.155771 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1211304953 Aug 04 16:56:40.155771 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: a46fe5c413294401a1fe8cbf5e4164dd Aug 04 16:56:40.155771 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1211304953 Aug 04 16:56:40.155771 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-HypervisorAdminNegativeTestJSON-1211304953-project Aug 04 16:56:40.155771 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:56:40.155771 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:56:40.155771 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 5b15ccefc5cf4351a3c0c574f0821910 Aug 04 16:56:40.155771 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1211304953-project Aug 04 16:56:40.155771 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 16:56:40.155771 n-d-851359-3 devstack@n-api.service[131043]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 04 16:56:40.155771 n-d-851359-3 devstack@n-api.service[131043]: action_args: {} Aug 04 16:56:40.155771 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:40.157061 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:40.157061 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:40.157061 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:40.157061 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:40.157061 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:40.157061 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:56:40.157061 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:56:40.157061 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:40.157061 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:40.157061 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 04 16:56:40.157061 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 04 16:56:40.157061 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:56:40.157061 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:56:40.157061 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:56:40.157061 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:56:40.157061 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:56:40.157061 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:56:40.157061 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:56:40.157061 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:56:40.159551 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:56:40.159551 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:56:40.159551 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:56:40.159551 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:56:40.159551 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:56:40.159551 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:56:40.159551 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 04 16:56:40.159551 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:40.159551 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:40.159551 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:40.159551 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:40.159551 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:40.159551 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:40.159551 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:56:40.159551 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:56:40.159551 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 04 16:56:40.159551 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:40.161187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b4692d34-c58e-41e0-873d-b6996408d453 tempest-HypervisorAdminNegativeTestJSON-1211304953 tempest-HypervisorAdminNegativeTestJSON-1211304953-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:40.161187 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b4692d34-c58e-41e0-873d-b6996408d453 tempest-HypervisorAdminNegativeTestJSON-1211304953 tempest-HypervisorAdminNegativeTestJSON-1211304953-project] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.009910 Aug 04 16:56:40.163544 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 327/621] 10.222.0.93 () {58 vars in 1179 bytes} [Thu Aug 4 16:56:40 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:56:40.167951 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-50cae41c-dda1-4ae7-9f43-4a93593c2f7c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:40.168922 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-50cae41c-dda1-4ae7-9f43-4a93593c2f7c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:40.182421 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50cae41c-dda1-4ae7-9f43-4a93593c2f7c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:40.183885 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50cae41c-dda1-4ae7-9f43-4a93593c2f7c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:40.184332 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50cae41c-dda1-4ae7-9f43-4a93593c2f7c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:40.185042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50cae41c-dda1-4ae7-9f43-4a93593c2f7c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:40.185677 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50cae41c-dda1-4ae7-9f43-4a93593c2f7c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:40.186518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50cae41c-dda1-4ae7-9f43-4a93593c2f7c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:40.236820 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9921c299-005d-4d1e-a289-7b5e6e0310b5 tempest-HypervisorAdminNegativeTestJSON-447528778 tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin] Calling method '.version_select at 0x7f1e5bcaba60>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:40.238166 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:56:40.238166 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:56:40.241591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9921c299-005d-4d1e-a289-7b5e6e0310b5 tempest-HypervisorAdminNegativeTestJSON-447528778 tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:40.242082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9921c299-005d-4d1e-a289-7b5e6e0310b5 tempest-HypervisorAdminNegativeTestJSON-447528778 tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:40.242537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9921c299-005d-4d1e-a289-7b5e6e0310b5 tempest-HypervisorAdminNegativeTestJSON-447528778 tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:40.273278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9921c299-005d-4d1e-a289-7b5e6e0310b5 tempest-HypervisorAdminNegativeTestJSON-447528778 tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:40.273845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9921c299-005d-4d1e-a289-7b5e6e0310b5 tempest-HypervisorAdminNegativeTestJSON-447528778 tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:40.274600 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9921c299-005d-4d1e-a289-7b5e6e0310b5 tempest-HypervisorAdminNegativeTestJSON-447528778 tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:40.292653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9921c299-005d-4d1e-a289-7b5e6e0310b5 tempest-HypervisorAdminNegativeTestJSON-447528778 tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:40.293283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9921c299-005d-4d1e-a289-7b5e6e0310b5 tempest-HypervisorAdminNegativeTestJSON-447528778 tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:40.293739 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9921c299-005d-4d1e-a289-7b5e6e0310b5 tempest-HypervisorAdminNegativeTestJSON-447528778 tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:40.300640 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9921c299-005d-4d1e-a289-7b5e6e0310b5 tempest-HypervisorAdminNegativeTestJSON-447528778 tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.136376 Aug 04 16:56:40.301538 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 328/622] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:56:40 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:40.306631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-23bd2fe9-c800-40a1-a89c-7de67d3c33a4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:40.307904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-23bd2fe9-c800-40a1-a89c-7de67d3c33a4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: b8efce6c-198e-49a7-8576-32d80cb168df] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:40.314913 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23bd2fe9-c800-40a1-a89c-7de67d3c33a4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:40.315643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23bd2fe9-c800-40a1-a89c-7de67d3c33a4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:40.316093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23bd2fe9-c800-40a1-a89c-7de67d3c33a4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:40.316809 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23bd2fe9-c800-40a1-a89c-7de67d3c33a4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:40.317470 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23bd2fe9-c800-40a1-a89c-7de67d3c33a4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:40.318311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23bd2fe9-c800-40a1-a89c-7de67d3c33a4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:40.423555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-50cae41c-dda1-4ae7-9f43-4a93593c2f7c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:40.434809 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-50cae41c-dda1-4ae7-9f43-4a93593c2f7c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1462 microversion: 2.1 time: 0.271622 Aug 04 16:56:40.435695 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 295/623] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:40 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1462 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:40.440669 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-13ac3828-6115-4ea7-8f0b-78d28607f265 tempest-HypervisorAdminNegativeTestJSON-1211304953 tempest-HypervisorAdminNegativeTestJSON-1211304953-project] Calling method '.version_select at 0x7f1e5baa2820>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:40.441584 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:56:40.441584 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:56:40.443178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-13ac3828-6115-4ea7-8f0b-78d28607f265 tempest-HypervisorAdminNegativeTestJSON-1211304953 tempest-HypervisorAdminNegativeTestJSON-1211304953-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '5b15ccefc5cf4351a3c0c574f0821910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46fe5c413294401a1fe8cbf5e4164dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:40.446094 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-13ac3828-6115-4ea7-8f0b-78d28607f265 tempest-HypervisorAdminNegativeTestJSON-1211304953 tempest-HypervisorAdminNegativeTestJSON-1211304953-project] Request method failure captured: Aug 04 16:56:40.446094 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 04 16:56:40.446094 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:56:40.446094 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:56:40.446094 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:56:40.446094 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:56:40.446094 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:56:40.446094 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:56:40.446094 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:56:40.446094 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:40.446094 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_pGPfxzz4CF0eV7mmXfGE2RG1TyXec6P7-LK4iH6hzynNAaLLUSUaD9o4CrfwLAlvW5YgvFbyfK5RxfOrb2yvUtHanK6AJbcYLDbgtc3ycRaebSgW570MEgYSG-_q9mh6mTSY5nsqHitjPHveB0_zawBTR6ZV_h19qF_HCVtje6TvA Aug 04 16:56:40.446094 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:56:40.446094 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:56:40.446094 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:56:40.446094 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:56:40.446094 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:56:40.446094 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:56:40.446094 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: a46fe5c413294401a1fe8cbf5e4164dd Aug 04 16:56:40.446094 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1211304953 Aug 04 16:56:40.446094 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:56:40.446094 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:56:40.447362 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a46fe5c413294401a1fe8cbf5e4164dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a46fe5c413294401a1fe8cbf5e4164dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a46fe5c413294401a1fe8cbf5e4164dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a46fe5c413294401a1fe8cbf5e4164dd"}]}] Aug 04 16:56:40.447362 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1211304953 Aug 04 16:56:40.447362 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: a46fe5c413294401a1fe8cbf5e4164dd Aug 04 16:56:40.447362 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1211304953 Aug 04 16:56:40.447362 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-HypervisorAdminNegativeTestJSON-1211304953-project Aug 04 16:56:40.447362 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:56:40.447362 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:56:40.447362 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 5b15ccefc5cf4351a3c0c574f0821910 Aug 04 16:56:40.447362 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1211304953-project Aug 04 16:56:40.447362 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:56:40.447362 n-d-851359-3 devstack@n-api.service[131044]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 04 16:56:40.447362 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '1'} Aug 04 16:56:40.447362 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:40.448198 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:40.448198 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:40.448198 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:40.448198 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:40.448198 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:40.448198 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:56:40.448198 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:56:40.448198 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:40.448198 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:40.448198 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 04 16:56:40.448198 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 04 16:56:40.448198 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:56:40.448198 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:56:40.448198 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:56:40.448198 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:56:40.448198 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:56:40.448198 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:56:40.448198 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:56:40.448198 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:56:40.449438 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:56:40.449438 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:56:40.449438 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:56:40.449438 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:56:40.449438 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:56:40.449438 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:56:40.449438 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 04 16:56:40.449438 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:40.449438 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:40.449438 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:40.449438 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:40.449438 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:40.449438 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:40.449438 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:56:40.449438 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:56:40.449438 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 04 16:56:40.449438 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:40.451970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-13ac3828-6115-4ea7-8f0b-78d28607f265 tempest-HypervisorAdminNegativeTestJSON-1211304953 tempest-HypervisorAdminNegativeTestJSON-1211304953-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:40.451970 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-13ac3828-6115-4ea7-8f0b-78d28607f265 tempest-HypervisorAdminNegativeTestJSON-1211304953 tempest-HypervisorAdminNegativeTestJSON-1211304953-project] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.011082 Aug 04 16:56:40.451970 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 296/624] 10.222.0.93 () {58 vars in 1173 bytes} [Thu Aug 4 16:56:40 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:56:40.455160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0c144263-e061-4c9d-9a6d-e1404c664ab9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:40.457505 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0c144263-e061-4c9d-9a6d-e1404c664ab9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:40.466042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c144263-e061-4c9d-9a6d-e1404c664ab9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:40.466562 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c144263-e061-4c9d-9a6d-e1404c664ab9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:40.466989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c144263-e061-4c9d-9a6d-e1404c664ab9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:40.467689 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c144263-e061-4c9d-9a6d-e1404c664ab9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:40.468146 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c144263-e061-4c9d-9a6d-e1404c664ab9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:40.468572 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c144263-e061-4c9d-9a6d-e1404c664ab9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:40.519383 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-23bd2fe9-c800-40a1-a89c-7de67d3c33a4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:40.539314 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-23bd2fe9-c800-40a1-a89c-7de67d3c33a4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df" status: 200 len: 1322 microversion: 2.1 time: 0.236458 Aug 04 16:56:40.558003 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 329/625] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:40 2022] GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:40.561644 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0c144263-e061-4c9d-9a6d-e1404c664ab9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:40.565869 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b503fa3f-25f1-437e-8b2a-d330c5ddd943 tempest-HypervisorAdminNegativeTestJSON-447528778 tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin] Calling method '.version_select at 0x7f1e5bcab9d0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:40.567626 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:56:40.567626 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:56:40.569148 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-b503fa3f-25f1-437e-8b2a-d330c5ddd943 tempest-HypervisorAdminNegativeTestJSON-447528778 tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin] HTTP exception thrown: Hypervisor with ID '675ab132-0fd5-4986-97e5-f9b65b23620e' could not be found. Aug 04 16:56:40.572341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0c144263-e061-4c9d-9a6d-e1404c664ab9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Old instance type m1.heat2, new instance type m1.heat {{(pid=131044) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 16:56:40.576211 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b503fa3f-25f1-437e-8b2a-d330c5ddd943 tempest-HypervisorAdminNegativeTestJSON-447528778 tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin] Request method failure captured: Aug 04 16:56:40.576211 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/os-hypervisors/675ab132-0fd5-4986-97e5-f9b65b23620e/uptime HTTP/1.1 Aug 04 16:56:40.576211 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:56:40.576211 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:56:40.576211 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:56:40.576211 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:56:40.576211 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:56:40.576211 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:56:40.576211 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:56:40.576211 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:40.576211 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_pH-AIp7cw6lSjR5gDa8dqr92lNVgDxUf2C8KRnQAcC1GRt69sYS7q9ONTCG0eKk3jv6ZlVYbh2uGFKYLgBhDcCcyMMe4-DV1B_ZldTdPnzV1nBytf-0ngo1I46nz6aeo_ZxRCdlKnbMW1LNsQwq-8EHuD9ifmtBVeZW36ITL0B2xg Aug 04 16:56:40.576211 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:56:40.576211 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:56:40.576211 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:56:40.576211 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:56:40.576211 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:56:40.576211 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:56:40.576211 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 7b1f9124fb27431bb4c49a54ba9d3de2 Aug 04 16:56:40.576211 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-447528778 Aug 04 16:56:40.576211 n-d-851359-3 devstack@n-api.service[131043]: X-Role: admin,member,reader Aug 04 16:56:40.576211 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: admin,member,reader Aug 04 16:56:40.577541 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7b1f9124fb27431bb4c49a54ba9d3de2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7b1f9124fb27431bb4c49a54ba9d3de2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_7b1f9124fb27431bb4c49a54ba9d3de2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/7b1f9124fb27431bb4c49a54ba9d3de2"}]}] Aug 04 16:56:40.577541 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-447528778 Aug 04 16:56:40.577541 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 7b1f9124fb27431bb4c49a54ba9d3de2 Aug 04 16:56:40.577541 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-447528778 Aug 04 16:56:40.577541 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin Aug 04 16:56:40.577541 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:56:40.577541 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:56:40.577541 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 777ccb12c56e4d828aa068e87e9b010f Aug 04 16:56:40.577541 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin Aug 04 16:56:40.577541 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 16:56:40.577541 n-d-851359-3 devstack@n-api.service[131043]: exception: Hypervisor with ID '675ab132-0fd5-4986-97e5-f9b65b23620e' could not be found. Aug 04 16:56:40.577541 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '675ab132-0fd5-4986-97e5-f9b65b23620e'} Aug 04 16:56:40.578901 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:40.578901 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:40.578901 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 04 16:56:40.578901 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 04 16:56:40.578901 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '675ab132-0fd5-4986-97e5-f9b65b23620e' Aug 04 16:56:40.578901 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:40.578901 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:40.578901 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:40.578901 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:40.578901 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 04 16:56:40.578901 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 04 16:56:40.578901 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 04 16:56:40.578901 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 04 16:56:40.578901 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 04 16:56:40.578901 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:40.578901 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:40.578901 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:40.578901 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:40.578901 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 04 16:56:40.578901 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 04 16:56:40.578901 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 04 16:56:40.578901 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 04 16:56:40.580187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 04 16:56:40.580187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:40.580187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:40.580187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:40.580187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:40.580187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:40.580187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:40.580187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:40.580187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:40.580187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:56:40.580187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:56:40.580187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:40.580187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:40.580187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 04 16:56:40.580187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 04 16:56:40.580187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 04 16:56:40.580187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 16:56:40.580187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '675ab132-0fd5-4986-97e5-f9b65b23620e' could not be found. Aug 04 16:56:40.580187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:40.580187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:40.580187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:40.581418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:40.581418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:40.581418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:40.581418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:56:40.581418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:56:40.581418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '675ab132-0fd5-4986-97e5-f9b65b23620e' could not be found. Aug 04 16:56:40.581418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:40.584024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b503fa3f-25f1-437e-8b2a-d330c5ddd943 tempest-HypervisorAdminNegativeTestJSON-447528778 tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin] Returning 404 to user: Hypervisor with ID '675ab132-0fd5-4986-97e5-f9b65b23620e' could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:40.585232 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b503fa3f-25f1-437e-8b2a-d330c5ddd943 tempest-HypervisorAdminNegativeTestJSON-447528778 tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/675ab132-0fd5-4986-97e5-f9b65b23620e/uptime" status: 404 len: 123 microversion: 2.1 time: 0.036681 Aug 04 16:56:40.585789 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 330/626] 10.222.0.93 () {58 vars in 1278 bytes} [Thu Aug 4 16:56:40 2022] GET /compute/v2.1/os-hypervisors/675ab132-0fd5-4986-97e5-f9b65b23620e/uptime => generated 123 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:56:40.588030 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0c144263-e061-4c9d-9a6d-e1404c664ab9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:56:40.588463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0c144263-e061-4c9d-9a6d-e1404c664ab9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:56:40.588956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0c144263-e061-4c9d-9a6d-e1404c664ab9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:56:40.589366 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0c144263-e061-4c9d-9a6d-e1404c664ab9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:56:40.590289 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0c144263-e061-4c9d-9a6d-e1404c664ab9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:56:40.596279 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1f5ba3b3-42ff-43db-adf9-8ca7e4d8dfbe tempest-HypervisorAdminNegativeTestJSON-447528778 tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin] Calling method '.version_select at 0x7f1e5bb60550>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:40.600159 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:56:40.600159 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:56:40.601544 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f5ba3b3-42ff-43db-adf9-8ca7e4d8dfbe tempest-HypervisorAdminNegativeTestJSON-447528778 tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:40.604265 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f5ba3b3-42ff-43db-adf9-8ca7e4d8dfbe tempest-HypervisorAdminNegativeTestJSON-447528778 tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:40.604984 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f5ba3b3-42ff-43db-adf9-8ca7e4d8dfbe tempest-HypervisorAdminNegativeTestJSON-447528778 tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:40.643696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f5ba3b3-42ff-43db-adf9-8ca7e4d8dfbe tempest-HypervisorAdminNegativeTestJSON-447528778 tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:40.644197 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f5ba3b3-42ff-43db-adf9-8ca7e4d8dfbe tempest-HypervisorAdminNegativeTestJSON-447528778 tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:40.644822 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f5ba3b3-42ff-43db-adf9-8ca7e4d8dfbe tempest-HypervisorAdminNegativeTestJSON-447528778 tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:40.668972 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f5ba3b3-42ff-43db-adf9-8ca7e4d8dfbe tempest-HypervisorAdminNegativeTestJSON-447528778 tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:40.669696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f5ba3b3-42ff-43db-adf9-8ca7e4d8dfbe tempest-HypervisorAdminNegativeTestJSON-447528778 tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:40.670462 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f5ba3b3-42ff-43db-adf9-8ca7e4d8dfbe tempest-HypervisorAdminNegativeTestJSON-447528778 tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:40.678620 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1f5ba3b3-42ff-43db-adf9-8ca7e4d8dfbe tempest-HypervisorAdminNegativeTestJSON-447528778 tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.086083 Aug 04 16:56:40.679375 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 331/627] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:56:40 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:56:40.694831 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6667c35b-9688-44cc-87e5-81c997c57fd3 tempest-HypervisorAdminNegativeTestJSON-1211304953 tempest-HypervisorAdminNegativeTestJSON-1211304953-project] Calling method '.version_select at 0x7f1e5bac5820>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:40.696026 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:56:40.696026 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:56:40.697290 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6667c35b-9688-44cc-87e5-81c997c57fd3 tempest-HypervisorAdminNegativeTestJSON-1211304953 tempest-HypervisorAdminNegativeTestJSON-1211304953-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '5b15ccefc5cf4351a3c0c574f0821910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46fe5c413294401a1fe8cbf5e4164dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:40.699002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6667c35b-9688-44cc-87e5-81c997c57fd3 tempest-HypervisorAdminNegativeTestJSON-1211304953 tempest-HypervisorAdminNegativeTestJSON-1211304953-project] Request method failure captured: Aug 04 16:56:40.699002 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 04 16:56:40.699002 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:56:40.699002 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:56:40.699002 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:56:40.699002 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:56:40.699002 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:56:40.699002 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:56:40.699002 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:56:40.699002 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:40.699002 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_pGPfxzz4CF0eV7mmXfGE2RG1TyXec6P7-LK4iH6hzynNAaLLUSUaD9o4CrfwLAlvW5YgvFbyfK5RxfOrb2yvUtHanK6AJbcYLDbgtc3ycRaebSgW570MEgYSG-_q9mh6mTSY5nsqHitjPHveB0_zawBTR6ZV_h19qF_HCVtje6TvA Aug 04 16:56:40.699002 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:56:40.699002 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:56:40.699002 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:56:40.699002 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:56:40.699002 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:56:40.699002 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:56:40.699002 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: a46fe5c413294401a1fe8cbf5e4164dd Aug 04 16:56:40.699002 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1211304953 Aug 04 16:56:40.699002 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 16:56:40.699002 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 16:56:40.702459 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a46fe5c413294401a1fe8cbf5e4164dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a46fe5c413294401a1fe8cbf5e4164dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a46fe5c413294401a1fe8cbf5e4164dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a46fe5c413294401a1fe8cbf5e4164dd"}]}] Aug 04 16:56:40.702459 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1211304953 Aug 04 16:56:40.702459 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: a46fe5c413294401a1fe8cbf5e4164dd Aug 04 16:56:40.702459 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1211304953 Aug 04 16:56:40.702459 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-HypervisorAdminNegativeTestJSON-1211304953-project Aug 04 16:56:40.702459 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:56:40.702459 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:56:40.702459 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 5b15ccefc5cf4351a3c0c574f0821910 Aug 04 16:56:40.702459 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1211304953-project Aug 04 16:56:40.702459 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 16:56:40.702459 n-d-851359-3 devstack@n-api.service[131043]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 04 16:56:40.702459 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '1'} Aug 04 16:56:40.702459 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:40.703431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:40.703431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:40.703431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:40.703431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:40.703431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:40.703431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:56:40.703431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:56:40.703431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:40.703431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:40.703431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 04 16:56:40.703431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 04 16:56:40.703431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 04 16:56:40.703431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 04 16:56:40.703431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:56:40.703431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:56:40.703431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:56:40.703431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:56:40.703431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:56:40.703431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:56:40.704542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:56:40.704542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:56:40.704542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:56:40.704542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:56:40.704542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:56:40.704542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:56:40.704542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:56:40.704542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:56:40.704542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 04 16:56:40.704542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:40.704542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:40.704542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:40.704542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:40.704542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:40.704542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:40.704542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:56:40.704542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:56:40.704542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 04 16:56:40.704542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:40.705833 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6667c35b-9688-44cc-87e5-81c997c57fd3 tempest-HypervisorAdminNegativeTestJSON-1211304953 tempest-HypervisorAdminNegativeTestJSON-1211304953-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:40.705833 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6667c35b-9688-44cc-87e5-81c997c57fd3 tempest-HypervisorAdminNegativeTestJSON-1211304953 tempest-HypervisorAdminNegativeTestJSON-1211304953-project] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.013956 Aug 04 16:56:40.706611 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 332/628] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Aug 4 16:56:40 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:56:40.712642 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-84a73933-299e-4f61-bdf2-6712e777920d tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:40.714043 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-84a73933-299e-4f61-bdf2-6712e777920d tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:40.722735 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84a73933-299e-4f61-bdf2-6712e777920d tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:40.723916 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84a73933-299e-4f61-bdf2-6712e777920d tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:40.724931 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84a73933-299e-4f61-bdf2-6712e777920d tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:40.727192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84a73933-299e-4f61-bdf2-6712e777920d tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:40.728075 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84a73933-299e-4f61-bdf2-6712e777920d tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:40.729157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84a73933-299e-4f61-bdf2-6712e777920d tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:40.786392 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0c144263-e061-4c9d-9a6d-e1404c664ab9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "POST /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3/action" status: 202 len: 0 microversion: 2.1 time: 0.335331 Aug 04 16:56:40.788185 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 297/629] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:56:40 2022] POST /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 16:56:40.793795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-246e718b-9342-43f0-9a8a-ba1a5bb59d5d tempest-HypervisorAdminNegativeTestJSON-447528778 tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin] Calling method '.version_select at 0x7f1e5baa29d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:40.795015 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:56:40.795015 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:56:40.796381 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-246e718b-9342-43f0-9a8a-ba1a5bb59d5d tempest-HypervisorAdminNegativeTestJSON-447528778 tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin] HTTP exception thrown: Hypervisor with ID '3aaa8b4c-33a3-439b-a35a-55eeb1e0cfec' could not be found. Aug 04 16:56:40.799832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-246e718b-9342-43f0-9a8a-ba1a5bb59d5d tempest-HypervisorAdminNegativeTestJSON-447528778 tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin] Request method failure captured: Aug 04 16:56:40.799832 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-hypervisors/3aaa8b4c-33a3-439b-a35a-55eeb1e0cfec HTTP/1.1 Aug 04 16:56:40.799832 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:56:40.799832 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:56:40.799832 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:56:40.799832 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:56:40.799832 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:56:40.799832 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:56:40.799832 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:56:40.799832 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:40.799832 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_pH-AIp7cw6lSjR5gDa8dqr92lNVgDxUf2C8KRnQAcC1GRt69sYS7q9ONTCG0eKk3jv6ZlVYbh2uGFKYLgBhDcCcyMMe4-DV1B_ZldTdPnzV1nBytf-0ngo1I46nz6aeo_ZxRCdlKnbMW1LNsQwq-8EHuD9ifmtBVeZW36ITL0B2xg Aug 04 16:56:40.799832 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:56:40.799832 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:56:40.799832 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:56:40.799832 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:56:40.799832 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:56:40.799832 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:56:40.799832 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 7b1f9124fb27431bb4c49a54ba9d3de2 Aug 04 16:56:40.799832 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-447528778 Aug 04 16:56:40.799832 n-d-851359-3 devstack@n-api.service[131044]: X-Role: admin,member,reader Aug 04 16:56:40.799832 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: admin,member,reader Aug 04 16:56:40.801300 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7b1f9124fb27431bb4c49a54ba9d3de2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7b1f9124fb27431bb4c49a54ba9d3de2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_7b1f9124fb27431bb4c49a54ba9d3de2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/7b1f9124fb27431bb4c49a54ba9d3de2"}]}] Aug 04 16:56:40.801300 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-447528778 Aug 04 16:56:40.801300 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 7b1f9124fb27431bb4c49a54ba9d3de2 Aug 04 16:56:40.801300 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-447528778 Aug 04 16:56:40.801300 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin Aug 04 16:56:40.801300 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:56:40.801300 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:56:40.801300 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 777ccb12c56e4d828aa068e87e9b010f Aug 04 16:56:40.801300 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin Aug 04 16:56:40.801300 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:56:40.801300 n-d-851359-3 devstack@n-api.service[131044]: exception: Hypervisor with ID '3aaa8b4c-33a3-439b-a35a-55eeb1e0cfec' could not be found. Aug 04 16:56:40.801300 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '3aaa8b4c-33a3-439b-a35a-55eeb1e0cfec'} Aug 04 16:56:40.802052 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:40.802052 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:40.802052 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 04 16:56:40.802052 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 04 16:56:40.802052 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '3aaa8b4c-33a3-439b-a35a-55eeb1e0cfec' Aug 04 16:56:40.802052 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:40.802052 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:40.802052 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:40.802052 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:40.802052 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 04 16:56:40.802052 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 04 16:56:40.802052 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 04 16:56:40.802052 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 04 16:56:40.802052 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 04 16:56:40.802052 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:40.802052 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:40.802052 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:40.802052 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:40.802052 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 04 16:56:40.802052 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 04 16:56:40.802052 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 04 16:56:40.802052 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 04 16:56:40.803400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 04 16:56:40.803400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:40.803400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:40.803400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:40.803400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:40.803400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:40.803400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:40.803400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:40.803400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:40.803400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:56:40.803400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:56:40.803400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:40.803400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:40.803400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 04 16:56:40.803400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 04 16:56:40.803400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 04 16:56:40.803400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 04 16:56:40.803400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 04 16:56:40.803400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 16:56:40.803400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '3aaa8b4c-33a3-439b-a35a-55eeb1e0cfec' could not be found. Aug 04 16:56:40.806337 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:40.806337 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:40.806337 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:40.806337 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:40.806337 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:40.806337 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:40.806337 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:56:40.806337 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:56:40.806337 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '3aaa8b4c-33a3-439b-a35a-55eeb1e0cfec' could not be found. Aug 04 16:56:40.806337 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:40.810074 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-246e718b-9342-43f0-9a8a-ba1a5bb59d5d tempest-HypervisorAdminNegativeTestJSON-447528778 tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin] Returning 404 to user: Hypervisor with ID '3aaa8b4c-33a3-439b-a35a-55eeb1e0cfec' could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:40.811215 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-246e718b-9342-43f0-9a8a-ba1a5bb59d5d tempest-HypervisorAdminNegativeTestJSON-447528778 tempest-HypervisorAdminNegativeTestJSON-447528778-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors/3aaa8b4c-33a3-439b-a35a-55eeb1e0cfec" status: 404 len: 123 microversion: 2.1 time: 0.021712 Aug 04 16:56:40.816126 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 298/630] 10.222.0.93 () {58 vars in 1257 bytes} [Thu Aug 4 16:56:40 2022] GET /compute/v2.1/os-hypervisors/3aaa8b4c-33a3-439b-a35a-55eeb1e0cfec => generated 123 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:56:40.822360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b25f36e6-faec-4105-a322-f2cf7365962a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:40.823277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b25f36e6-faec-4105-a322-f2cf7365962a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:40.836373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b25f36e6-faec-4105-a322-f2cf7365962a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:40.838256 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b25f36e6-faec-4105-a322-f2cf7365962a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:40.840204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b25f36e6-faec-4105-a322-f2cf7365962a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:40.842232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b25f36e6-faec-4105-a322-f2cf7365962a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:40.844474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b25f36e6-faec-4105-a322-f2cf7365962a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:40.846518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b25f36e6-faec-4105-a322-f2cf7365962a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:40.880058 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-84a73933-299e-4f61-bdf2-6712e777920d tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lazy-loading 'services' on Instance uuid 96d30c66-24c7-4b25-81cd-fb638035a1cb {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:56:40.923740 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-84a73933-299e-4f61-bdf2-6712e777920d tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1929 microversion: 2.75 time: 0.215590 Aug 04 16:56:40.938644 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 333/631] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:40 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1929 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:40.960358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f8c69022-9d98-4f49-a5a6-ca2626be3679 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:40.960986 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f8c69022-9d98-4f49-a5a6-ca2626be3679 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: c0e9cb60-b590-412f-a6a1-fc8534bd1c97] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:40.970432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8c69022-9d98-4f49-a5a6-ca2626be3679 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:40.970934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8c69022-9d98-4f49-a5a6-ca2626be3679 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:40.971448 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8c69022-9d98-4f49-a5a6-ca2626be3679 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:40.972089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8c69022-9d98-4f49-a5a6-ca2626be3679 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:40.972558 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8c69022-9d98-4f49-a5a6-ca2626be3679 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:40.972985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8c69022-9d98-4f49-a5a6-ca2626be3679 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:41.243922 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b25f36e6-faec-4105-a322-f2cf7365962a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:41.251745 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b25f36e6-faec-4105-a322-f2cf7365962a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1471 microversion: 2.1 time: 0.434292 Aug 04 16:56:41.253105 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 299/632] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:40 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1471 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:41.264118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f9a30b31-00c8-4223-a7c7-cc24a357b4bf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:41.264739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f9a30b31-00c8-4223-a7c7-cc24a357b4bf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:41.281997 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9a30b31-00c8-4223-a7c7-cc24a357b4bf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:41.282515 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9a30b31-00c8-4223-a7c7-cc24a357b4bf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:41.282958 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9a30b31-00c8-4223-a7c7-cc24a357b4bf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:41.283687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9a30b31-00c8-4223-a7c7-cc24a357b4bf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:41.286605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9a30b31-00c8-4223-a7c7-cc24a357b4bf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:41.287052 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9a30b31-00c8-4223-a7c7-cc24a357b4bf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:41.319999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f8c69022-9d98-4f49-a5a6-ca2626be3679 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712723e5418441c096f008d1520f6dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8c7c49e56743dd9f64102e53c2bec7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:41.330783 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f8c69022-9d98-4f49-a5a6-ca2626be3679 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97" status: 200 len: 1466 microversion: 2.1 time: 0.390956 Aug 04 16:56:41.331358 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 334/633] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:40 2022] GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97 => generated 1466 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:41.571887 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-846aed7c-a571-44ff-9f74-76d858627372 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:41.573491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-846aed7c-a571-44ff-9f74-76d858627372 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: b8efce6c-198e-49a7-8576-32d80cb168df] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:41.583835 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-846aed7c-a571-44ff-9f74-76d858627372 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:41.585257 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f9a30b31-00c8-4223-a7c7-cc24a357b4bf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:41.586411 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-846aed7c-a571-44ff-9f74-76d858627372 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:41.588430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-846aed7c-a571-44ff-9f74-76d858627372 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:41.589475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-846aed7c-a571-44ff-9f74-76d858627372 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:41.590597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-846aed7c-a571-44ff-9f74-76d858627372 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:41.591032 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-846aed7c-a571-44ff-9f74-76d858627372 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:41.597956 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f9a30b31-00c8-4223-a7c7-cc24a357b4bf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989" status: 200 len: 1504 microversion: 2.1 time: 0.343751 Aug 04 16:56:41.602103 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 300/634] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:41 2022] GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989 => generated 1504 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:42.084034 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-781a2765-2e03-40de-bcfe-8d70aafeedbe tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Action: 'create', calling method: .version_select at 0x7f1e5bb863a0>, body: {"keypair": {"name": "tempest-keypair-396177442", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG149xmPwuhLZ3MZ0sqZY6aFnjPq1pvXQA6HZKPaJPYh9maUz8kIM2cfIjQvhNzA42BMe49Mj2fONhZNF25nVFS59JADY1ziqDNFORXm49i8sFfF+sg94R/PN9FYZkZyA=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:42.132651 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-846aed7c-a571-44ff-9f74-76d858627372 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:42.140234 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-846aed7c-a571-44ff-9f74-76d858627372 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df" status: 200 len: 1322 microversion: 2.1 time: 0.572307 Aug 04 16:56:42.141173 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 335/635] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:41 2022] GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df => generated 1322 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:56:42.143119 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-781a2765-2e03-40de-bcfe-8d70aafeedbe tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Getting quotas for project a879594197614cac92810e4454a5b0e5. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:56:42.152036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-781a2765-2e03-40de-bcfe-8d70aafeedbe tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Getting quotas for user f1e3e20191ce4384b646f9b2f51cabb0 and project a879594197614cac92810e4454a5b0e5. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:56:42.161652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4b057a06-5e62-49c2-8d7d-88f960e9278a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:42.162663 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4b057a06-5e62-49c2-8d7d-88f960e9278a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:42.173401 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b057a06-5e62-49c2-8d7d-88f960e9278a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:42.174427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b057a06-5e62-49c2-8d7d-88f960e9278a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:42.175450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b057a06-5e62-49c2-8d7d-88f960e9278a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:42.176675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b057a06-5e62-49c2-8d7d-88f960e9278a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:42.177390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b057a06-5e62-49c2-8d7d-88f960e9278a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:42.178313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b057a06-5e62-49c2-8d7d-88f960e9278a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:42.213829 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-781a2765-2e03-40de-bcfe-8d70aafeedbe tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.378908 Aug 04 16:56:42.215308 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 301/636] 10.222.0.93 () {62 vars in 1199 bytes} [Thu Aug 4 16:56:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 381 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 04 16:56:42.226529 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d1296213-73b9-4604-8d05-b19f888401b7 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Calling method '.version_select at 0x7f1e5bb95940>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:42.236084 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d1296213-73b9-4604-8d05-b19f888401b7 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] 10.222.0.93 "GET /compute/v2.1/os-keypairs/tempest-keypair-396177442" status: 200 len: 511 microversion: 2.2 time: 0.013938 Aug 04 16:56:42.237002 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 302/637] 10.222.0.93 () {60 vars in 1255 bytes} [Thu Aug 4 16:56:42 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-396177442 => generated 511 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:42.267177 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c700b90a-2b50-41ff-8ffa-597fdfe69931 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Calling method '.version_select at 0x7f1e5b9ad940>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:42.276861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:42.284618 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-4b057a06-5e62-49c2-8d7d-88f960e9278a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lazy-loading 'services' on Instance uuid 96d30c66-24c7-4b25-81cd-fb638035a1cb {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:56:42.300323 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:42.308989 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c700b90a-2b50-41ff-8ffa-597fdfe69931 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-396177442" status: 204 len: 0 microversion: 2.2 time: 0.064724 Aug 04 16:56:42.310684 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 303/638] 10.222.0.93 () {60 vars in 1258 bytes} [Thu Aug 4 16:56:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-396177442 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 16:56:42.316854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1a7bfc31-aa9f-4fc9-ac53-1bdcefddf0d1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:42.318414 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1a7bfc31-aa9f-4fc9-ac53-1bdcefddf0d1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:42.330857 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1a7bfc31-aa9f-4fc9-ac53-1bdcefddf0d1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:42.331606 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1a7bfc31-aa9f-4fc9-ac53-1bdcefddf0d1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:42.332271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1a7bfc31-aa9f-4fc9-ac53-1bdcefddf0d1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:42.333294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1a7bfc31-aa9f-4fc9-ac53-1bdcefddf0d1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:42.333988 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1a7bfc31-aa9f-4fc9-ac53-1bdcefddf0d1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:42.334723 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1a7bfc31-aa9f-4fc9-ac53-1bdcefddf0d1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:42.345536 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4b057a06-5e62-49c2-8d7d-88f960e9278a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1929 microversion: 2.75 time: 0.203135 Aug 04 16:56:42.350394 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 336/639] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:42 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1929 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:42.366299 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b99b7251-267b-430b-9a76-b68ed5600fbf tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Action: 'create', calling method: .version_select at 0x7f1e5b9d8820>, body: {"keypair": {"name": "tempest-keypair-687101200", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1NoLl5ik6lrnO7tgugQKxNERfJ2qeW0CIaTSdJGRku/UzDToSVvooMCzGzVsSTmew5QlRevR2vQT8W4kOuSCAT4No2ouz48Z8uTRy2B9zXkdYqJ8noR90ejj/sGsrIsA=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:42.403587 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-b99b7251-267b-430b-9a76-b68ed5600fbf tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Getting quotas for project a879594197614cac92810e4454a5b0e5. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:56:42.417889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-b99b7251-267b-430b-9a76-b68ed5600fbf tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Getting quotas for user f1e3e20191ce4384b646f9b2f51cabb0 and project a879594197614cac92810e4454a5b0e5. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:56:42.475919 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b99b7251-267b-430b-9a76-b68ed5600fbf tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.123732 Aug 04 16:56:42.479126 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 337/640] 10.222.0.93 () {62 vars in 1199 bytes} [Thu Aug 4 16:56:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 04 16:56:42.496012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cf758dd1-dd63-4f80-af15-6fd9e1f5b7a1 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:42.498496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cf758dd1-dd63-4f80-af15-6fd9e1f5b7a1 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: c0e9cb60-b590-412f-a6a1-fc8534bd1c97] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:42.516778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cf758dd1-dd63-4f80-af15-6fd9e1f5b7a1 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:42.520865 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cf758dd1-dd63-4f80-af15-6fd9e1f5b7a1 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:42.521433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cf758dd1-dd63-4f80-af15-6fd9e1f5b7a1 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:42.522418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cf758dd1-dd63-4f80-af15-6fd9e1f5b7a1 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:42.522975 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cf758dd1-dd63-4f80-af15-6fd9e1f5b7a1 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:42.523625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cf758dd1-dd63-4f80-af15-6fd9e1f5b7a1 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:42.670874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cf758dd1-dd63-4f80-af15-6fd9e1f5b7a1 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712723e5418441c096f008d1520f6dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8c7c49e56743dd9f64102e53c2bec7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:42.705256 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cf758dd1-dd63-4f80-af15-6fd9e1f5b7a1 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97" status: 200 len: 1295 microversion: 2.1 time: 0.214532 Aug 04 16:56:42.711404 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 338/641] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:42 2022] GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97 => generated 1295 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:42.724676 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-37ab38cd-c509-415f-9cb0-c1fac26c42aa req-a4ab39fd-f52c-4355-a218-18f26a97e280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e9cb60-b590-412f-a6a1-fc8534bd1c97", "name": "network-vif-deleted", "tag": "f90a54ce-7427-41d6-bbc9-f7eddedbc6bf"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:42.766850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-37ab38cd-c509-415f-9cb0-c1fac26c42aa req-a4ab39fd-f52c-4355-a218-18f26a97e280 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:42.767703 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-37ab38cd-c509-415f-9cb0-c1fac26c42aa req-a4ab39fd-f52c-4355-a218-18f26a97e280 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:42.768472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-37ab38cd-c509-415f-9cb0-c1fac26c42aa req-a4ab39fd-f52c-4355-a218-18f26a97e280 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:42.791988 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-37ab38cd-c509-415f-9cb0-c1fac26c42aa req-a4ab39fd-f52c-4355-a218-18f26a97e280 service nova] Creating event network-vif-deleted:f90a54ce-7427-41d6-bbc9-f7eddedbc6bf for instance c0e9cb60-b590-412f-a6a1-fc8534bd1c97 on n-h1-851359-3 Aug 04 16:56:42.798231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1a7bfc31-aa9f-4fc9-ac53-1bdcefddf0d1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:42.800785 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-37ab38cd-c509-415f-9cb0-c1fac26c42aa req-a4ab39fd-f52c-4355-a218-18f26a97e280 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086815 Aug 04 16:56:42.802151 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 339/642] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:42.813435 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1a7bfc31-aa9f-4fc9-ac53-1bdcefddf0d1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1471 microversion: 2.1 time: 0.500375 Aug 04 16:56:42.814403 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 304/643] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:42 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1471 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:42.818214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-011d33e5-1d28-4b25-b1a9-159709b04103 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Calling method '.version_select at 0x7f1e5ba13160>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:42.822279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d3447f98-2d83-4452-98a2-6edb274ec5b9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:42.823503 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d3447f98-2d83-4452-98a2-6edb274ec5b9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:42.833544 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3447f98-2d83-4452-98a2-6edb274ec5b9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:42.834764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3447f98-2d83-4452-98a2-6edb274ec5b9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:42.835865 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3447f98-2d83-4452-98a2-6edb274ec5b9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:42.837201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3447f98-2d83-4452-98a2-6edb274ec5b9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:42.837958 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3447f98-2d83-4452-98a2-6edb274ec5b9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:42.838716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3447f98-2d83-4452-98a2-6edb274ec5b9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:42.852000 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-011d33e5-1d28-4b25-b1a9-159709b04103 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-687101200" status: 204 len: 0 microversion: 2.2 time: 0.042063 Aug 04 16:56:42.852590 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 340/644] 10.222.0.93 () {60 vars in 1258 bytes} [Thu Aug 4 16:56:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-687101200 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:56:42.865553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a52ed0de-fa9c-464d-84b8-486ac933fc79 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Action: 'create', calling method: .version_select at 0x7f1e5ba8a700>, body: {"keypair": {"name": "tempest-keypair-1618747728", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:42.886059 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-a52ed0de-fa9c-464d-84b8-486ac933fc79 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Getting quotas for project a879594197614cac92810e4454a5b0e5. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:56:42.891658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-a52ed0de-fa9c-464d-84b8-486ac933fc79 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Getting quotas for user f1e3e20191ce4384b646f9b2f51cabb0 and project a879594197614cac92810e4454a5b0e5. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:56:42.922022 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a52ed0de-fa9c-464d-84b8-486ac933fc79 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.062675 Aug 04 16:56:42.923672 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 341/645] 10.222.0.93 () {62 vars in 1199 bytes} [Thu Aug 4 16:56:42 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 65 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 04 16:56:42.935190 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-61067422-6e37-457d-9d31-918b432f3c3f tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Calling method '.version_select at 0x7f1e5b9f9ca0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:42.958833 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-61067422-6e37-457d-9d31-918b432f3c3f tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1618747728" status: 204 len: 0 microversion: 2.2 time: 0.028692 Aug 04 16:56:42.959436 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 342/646] 10.222.0.93 () {60 vars in 1261 bytes} [Thu Aug 4 16:56:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1618747728 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:56:42.972251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a9fe6a78-a3b9-4791-a580-f370dc4f2c01 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Action: 'create', calling method: .version_select at 0x7f1e5bcab1f0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1166880505", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIWRdkqnRFfYzdtdQhUoZf4UaNDorxV9V5N1ZFIALb1+GGyxj6REAh/WXIs0Tsgho3glT3SnZnFd9TBLDFA78mboXCMmQo9EVqcF8DaPC60EKL2KojffwgA1DzS7TR3EA=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:42.988935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-a9fe6a78-a3b9-4791-a580-f370dc4f2c01 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Getting quotas for project a879594197614cac92810e4454a5b0e5. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:56:42.994553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-a9fe6a78-a3b9-4791-a580-f370dc4f2c01 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Getting quotas for user f1e3e20191ce4384b646f9b2f51cabb0 and project a879594197614cac92810e4454a5b0e5. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:56:43.017735 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d3447f98-2d83-4452-98a2-6edb274ec5b9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:43.021953 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a9fe6a78-a3b9-4791-a580-f370dc4f2c01 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.054074 Aug 04 16:56:43.021953 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 343/647] 10.222.0.93 () {62 vars in 1199 bytes} [Thu Aug 4 16:56:42 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 56 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 04 16:56:43.033515 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d3447f98-2d83-4452-98a2-6edb274ec5b9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989" status: 200 len: 1504 microversion: 2.1 time: 0.217542 Aug 04 16:56:43.034542 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 305/648] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:42 2022] GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989 => generated 1504 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:43.035785 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6b510729-da9f-4a8b-8854-8711b6df8b4b tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Action: 'create', calling method: .version_select at 0x7f1e5b9f61f0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1452898059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5G9UlWyCcczMl0GuDs0fu5rfffUUan7ETyGk8dveJI55VjynG0CrA7Le2bE+WqCPYh5LLF4OX2KTd3PzRlQM63wq5Uz2e4ZY4yfIyiz4MJ3YsTNwmQZKNhDWSVaLb+mA=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:43.051361 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-6b510729-da9f-4a8b-8854-8711b6df8b4b tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Getting quotas for project a879594197614cac92810e4454a5b0e5. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:56:43.056234 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-6b510729-da9f-4a8b-8854-8711b6df8b4b tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Getting quotas for user f1e3e20191ce4384b646f9b2f51cabb0 and project a879594197614cac92810e4454a5b0e5. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:56:43.081804 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6b510729-da9f-4a8b-8854-8711b6df8b4b tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.050733 Aug 04 16:56:43.082434 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 344/649] 10.222.0.93 () {62 vars in 1199 bytes} [Thu Aug 4 16:56:43 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 04 16:56:43.105925 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bbfcb932-4814-4182-9bad-8ba6b1be068b tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Action: 'create', calling method: .version_select at 0x7f1e5b9adca0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1723071109", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKJpb7WboyUiXWjbqYchZmS9cKvm3tsAvQ6nJyT9npbktG/+tG9VVuSCyCgarm6ZMy42JxI3m2Y/wlaGjK7PFyEm9q71wF3BdtYX7Wn28gYfAjpGtzBPk49fYA8oQChcA=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:43.128283 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-bbfcb932-4814-4182-9bad-8ba6b1be068b tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Getting quotas for project a879594197614cac92810e4454a5b0e5. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:56:43.138084 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-bbfcb932-4814-4182-9bad-8ba6b1be068b tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Getting quotas for user f1e3e20191ce4384b646f9b2f51cabb0 and project a879594197614cac92810e4454a5b0e5. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:56:43.167693 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d208c65a-ceed-4cc2-abae-47ba0edcaaef tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:43.171362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d208c65a-ceed-4cc2-abae-47ba0edcaaef tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: b8efce6c-198e-49a7-8576-32d80cb168df] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:43.181181 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bbfcb932-4814-4182-9bad-8ba6b1be068b tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.083654 Aug 04 16:56:43.181870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d208c65a-ceed-4cc2-abae-47ba0edcaaef tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:43.183273 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d208c65a-ceed-4cc2-abae-47ba0edcaaef tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:43.184370 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 306/650] 10.222.0.93 () {62 vars in 1199 bytes} [Thu Aug 4 16:56:43 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 88 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 04 16:56:43.184511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d208c65a-ceed-4cc2-abae-47ba0edcaaef tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:43.185580 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d208c65a-ceed-4cc2-abae-47ba0edcaaef tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:43.186657 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d208c65a-ceed-4cc2-abae-47ba0edcaaef tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:43.187277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d208c65a-ceed-4cc2-abae-47ba0edcaaef tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:43.200321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5ed992f4-b114-4ac0-ac56-b4d814db0251 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Calling method '.version_select at 0x7f1e5bb86e50>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:43.204578 n-d-851359-3 devstack@n-api.service[131044]: WARNING oslo_db.sqlalchemy.utils [None req-5ed992f4-b114-4ac0-ac56-b4d814db0251 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 04 16:56:43.210673 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5ed992f4-b114-4ac0-ac56-b4d814db0251 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] 10.222.0.93 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.014455 Aug 04 16:56:43.211246 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 307/651] 10.222.0.93 () {60 vars in 1177 bytes} [Thu Aug 4 16:56:43 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:56:43.225204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-54c698cc-6c49-47f2-baf4-8e49ba52709d tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Calling method '.version_select at 0x7f1e5b9a6dc0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:43.252815 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-54c698cc-6c49-47f2-baf4-8e49ba52709d tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1723071109" status: 204 len: 0 microversion: 2.2 time: 0.034150 Aug 04 16:56:43.253710 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 308/652] 10.222.0.93 () {60 vars in 1321 bytes} [Thu Aug 4 16:56:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1723071109 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 16:56:43.264343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-10b7620c-bc83-4d2e-89a0-64b7a5fb36f5 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Calling method '.version_select at 0x7f1e5b948a60>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:43.311072 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-10b7620c-bc83-4d2e-89a0-64b7a5fb36f5 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1452898059" status: 204 len: 0 microversion: 2.2 time: 0.048444 Aug 04 16:56:43.314161 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 309/653] 10.222.0.93 () {60 vars in 1321 bytes} [Thu Aug 4 16:56:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1452898059 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:56:43.328786 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1c8f5bcb-4ecb-4310-bf48-a5fb9aa05fbe tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Calling method '.version_select at 0x7f1e5b9a6430>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:43.370242 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1c8f5bcb-4ecb-4310-bf48-a5fb9aa05fbe tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1166880505" status: 204 len: 0 microversion: 2.2 time: 0.051541 Aug 04 16:56:43.371262 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 310/654] 10.222.0.93 () {60 vars in 1321 bytes} [Thu Aug 4 16:56:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1166880505 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 16:56:43.383841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4d1a008d-b86d-403d-84e9-6c3346e718a0 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:43.385332 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4d1a008d-b86d-403d-84e9-6c3346e718a0 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:43.402173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d1a008d-b86d-403d-84e9-6c3346e718a0 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:43.403971 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d1a008d-b86d-403d-84e9-6c3346e718a0 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:43.404559 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d1a008d-b86d-403d-84e9-6c3346e718a0 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:43.405339 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d1a008d-b86d-403d-84e9-6c3346e718a0 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:43.405852 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d1a008d-b86d-403d-84e9-6c3346e718a0 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:43.406792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d1a008d-b86d-403d-84e9-6c3346e718a0 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:43.508503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d208c65a-ceed-4cc2-abae-47ba0edcaaef tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:43.514507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-4d1a008d-b86d-403d-84e9-6c3346e718a0 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lazy-loading 'services' on Instance uuid 96d30c66-24c7-4b25-81cd-fb638035a1cb {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:56:43.524001 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d208c65a-ceed-4cc2-abae-47ba0edcaaef tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df" status: 200 len: 1322 microversion: 2.1 time: 0.363647 Aug 04 16:56:43.524609 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 345/655] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:43 2022] GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df => generated 1322 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:43.534016 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-887bc2e0-6a43-46c8-a403-65685b934cd1 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Action: 'create', calling method: .version_select at 0x7f1e5ba13280>, body: {"keypair": {"name": "tempest-keypair-1486918472", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQ7yVq3jFLWwkOdxa6sN8IphthTzo5RqYJ/mEnh/5P0YRGj1Q+DUKa0qaatlYmYoZqOHpbYlMjcnB+S/FHN+LiljzW+gx1QRKRW33tLO6QnBkH4HKzoXqwLdhRMaAEn2A=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:43.536747 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4d1a008d-b86d-403d-84e9-6c3346e718a0 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1929 microversion: 2.75 time: 0.158139 Aug 04 16:56:43.537413 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 311/656] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:43 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1929 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:56:43.563794 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-887bc2e0-6a43-46c8-a403-65685b934cd1 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Getting quotas for project a879594197614cac92810e4454a5b0e5. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:56:43.569027 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-887bc2e0-6a43-46c8-a403-65685b934cd1 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Getting quotas for user f1e3e20191ce4384b646f9b2f51cabb0 and project a879594197614cac92810e4454a5b0e5. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:56:43.579815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:43.597817 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-887bc2e0-6a43-46c8-a403-65685b934cd1 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.069320 Aug 04 16:56:43.598482 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 346/657] 10.222.0.93 () {62 vars in 1199 bytes} [Thu Aug 4 16:56:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 71 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 04 16:56:43.610043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eec34554-1f91-4b8e-9c0b-0086fc59d886 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Calling method '.version_select at 0x7f1e5b9ad280>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:43.618981 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eec34554-1f91-4b8e-9c0b-0086fc59d886 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] 10.222.0.93 "GET /compute/v2.1/os-keypairs/tempest-keypair-1486918472" status: 200 len: 513 microversion: 2.2 time: 0.013749 Aug 04 16:56:43.619660 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 312/658] 10.222.0.93 () {60 vars in 1258 bytes} [Thu Aug 4 16:56:43 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1486918472 => generated 513 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:43.631601 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9ef447e1-07c0-401a-a19a-dcb85f90a033 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Calling method '.version_select at 0x7f1e5b9f6f70>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:43.635716 n-d-851359-3 devstack@n-api.service[131043]: WARNING oslo_db.sqlalchemy.utils [None req-9ef447e1-07c0-401a-a19a-dcb85f90a033 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 04 16:56:43.644138 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9ef447e1-07c0-401a-a19a-dcb85f90a033 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] 10.222.0.93 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.017193 Aug 04 16:56:43.644798 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 347/659] 10.222.0.93 () {60 vars in 1177 bytes} [Thu Aug 4 16:56:43 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:56:43.655971 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-332811e8-c802-4a21-8159-12749be413c2 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Calling method '.version_select at 0x7f1e5b9a6a60>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:43.675903 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-332811e8-c802-4a21-8159-12749be413c2 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1486918472" status: 204 len: 0 microversion: 2.2 time: 0.024202 Aug 04 16:56:43.676543 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 313/660] 10.222.0.93 () {60 vars in 1261 bytes} [Thu Aug 4 16:56:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1486918472 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 16:56:43.686315 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-846cdfc7-8c4c-4fd5-9630-3e35750d3a32 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Action: 'create', calling method: .version_select at 0x7f1e5ba8aaf0>, body: {"keypair": {"name": "tempest-keypair-113796749", "type": "x509"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:43.709371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-846cdfc7-8c4c-4fd5-9630-3e35750d3a32 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Getting quotas for project a879594197614cac92810e4454a5b0e5. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:56:43.716878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-846cdfc7-8c4c-4fd5-9630-3e35750d3a32 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Getting quotas for user f1e3e20191ce4384b646f9b2f51cabb0 and project a879594197614cac92810e4454a5b0e5. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:56:43.737611 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-75072ff3-a9f2-4e15-8c80-0f421816cae9 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:43.737611 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-75072ff3-a9f2-4e15-8c80-0f421816cae9 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: c0e9cb60-b590-412f-a6a1-fc8534bd1c97] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:43.739770 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.processutils [None req-846cdfc7-8c4c-4fd5-9630-3e35750d3a32 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpt5dtars6/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpt5dtars6/temp.key -subj /CN=f1e3e20191ce4384b646f9b2f51cabb0 -extensions v3_req_client {{(pid=131043) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 04 16:56:43.742890 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75072ff3-a9f2-4e15-8c80-0f421816cae9 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:43.743544 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75072ff3-a9f2-4e15-8c80-0f421816cae9 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:43.744034 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75072ff3-a9f2-4e15-8c80-0f421816cae9 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:43.745171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75072ff3-a9f2-4e15-8c80-0f421816cae9 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:43.746016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75072ff3-a9f2-4e15-8c80-0f421816cae9 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:43.746176 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75072ff3-a9f2-4e15-8c80-0f421816cae9 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:43.761420 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-75072ff3-a9f2-4e15-8c80-0f421816cae9 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] HTTP exception thrown: Instance c0e9cb60-b590-412f-a6a1-fc8534bd1c97 could not be found. Aug 04 16:56:43.763032 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-75072ff3-a9f2-4e15-8c80-0f421816cae9 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Request method failure captured: Aug 04 16:56:43.763032 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97 HTTP/1.1 Aug 04 16:56:43.763032 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:56:43.763032 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:56:43.763032 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:56:43.763032 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:56:43.763032 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:56:43.763032 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:56:43.763032 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:56:43.763032 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:43.763032 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_oWds9owWNPaV7yQcBUrpy3N0lHI9lR33fwXDGyBSq4se_5-Wifk-pRLtX1NlOdhGGj18SkiHTKRhP9YhVUYayk5-_m2YeFfB3Qf94X7CcO1rQsBtmjK-eFn2EzWDa9rR-iX8Z3jAOtIwvc85uLM_MHmgsvyeX3KenO1e9Kn5hus9I Aug 04 16:56:43.763032 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:56:43.763032 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:56:43.763032 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:56:43.763032 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:56:43.763032 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:56:43.763032 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:56:43.763032 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 3f8c7c49e56743dd9f64102e53c2bec7 Aug 04 16:56:43.763032 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-LiveMigrationNegativeTest-934305132 Aug 04 16:56:43.763032 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:56:43.763032 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:56:43.764428 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3f8c7c49e56743dd9f64102e53c2bec7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3f8c7c49e56743dd9f64102e53c2bec7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3f8c7c49e56743dd9f64102e53c2bec7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3f8c7c49e56743dd9f64102e53c2bec7"}]}] Aug 04 16:56:43.764428 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-LiveMigrationNegativeTest-934305132 Aug 04 16:56:43.764428 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 3f8c7c49e56743dd9f64102e53c2bec7 Aug 04 16:56:43.764428 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-934305132 Aug 04 16:56:43.764428 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-LiveMigrationNegativeTest-934305132-project Aug 04 16:56:43.764428 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:56:43.764428 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:56:43.764428 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 712723e5418441c096f008d1520f6dce Aug 04 16:56:43.764428 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-LiveMigrationNegativeTest-934305132-project Aug 04 16:56:43.764428 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:56:43.764428 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance c0e9cb60-b590-412f-a6a1-fc8534bd1c97 could not be found. Aug 04 16:56:43.764428 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'c0e9cb60-b590-412f-a6a1-fc8534bd1c97'} Aug 04 16:56:43.765207 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:43.765207 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:43.765207 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:56:43.765207 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:56:43.765207 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:56:43.765207 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:56:43.765207 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:56:43.765207 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:56:43.765207 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:56:43.765207 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:56:43.765207 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0e9cb60-b590-412f-a6a1-fc8534bd1c97 could not be found. Aug 04 16:56:43.765207 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:43.765207 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:43.765207 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:43.765207 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:43.765207 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:43.765207 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:43.765207 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:43.765207 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:43.765207 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:43.766715 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:43.766715 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:56:43.766715 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:56:43.766715 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:56:43.766715 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:56:43.766715 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:56:43.766715 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:56:43.766715 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0e9cb60-b590-412f-a6a1-fc8534bd1c97 could not be found. Aug 04 16:56:43.766715 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:43.766715 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:43.766715 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:43.766715 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:43.766715 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:43.766715 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:43.766715 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:56:43.766715 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:56:43.766715 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0e9cb60-b590-412f-a6a1-fc8534bd1c97 could not be found. Aug 04 16:56:43.766715 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:43.768133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-75072ff3-a9f2-4e15-8c80-0f421816cae9 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Returning 404 to user: Instance c0e9cb60-b590-412f-a6a1-fc8534bd1c97 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:43.768133 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-75072ff3-a9f2-4e15-8c80-0f421816cae9 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97" status: 404 len: 111 microversion: 2.1 time: 0.035611 Aug 04 16:56:43.768133 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 314/661] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:43 2022] GET /compute/v2.1/servers/c0e9cb60-b590-412f-a6a1-fc8534bd1c97 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:56:43.776872 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-850e376a-88e3-416f-af64-b2fa6b892a38 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:43.777917 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-850e376a-88e3-416f-af64-b2fa6b892a38 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: 2b1b8878-8ab2-4792-904f-dae80363ee37] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:43.786509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-850e376a-88e3-416f-af64-b2fa6b892a38 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:43.787026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-850e376a-88e3-416f-af64-b2fa6b892a38 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:43.787462 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-850e376a-88e3-416f-af64-b2fa6b892a38 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:43.788244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-850e376a-88e3-416f-af64-b2fa6b892a38 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:43.788609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-850e376a-88e3-416f-af64-b2fa6b892a38 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:43.791040 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-850e376a-88e3-416f-af64-b2fa6b892a38 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:43.805303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.processutils [None req-846cdfc7-8c4c-4fd5-9630-3e35750d3a32 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpt5dtars6/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpt5dtars6/temp.key -subj /CN=f1e3e20191ce4384b646f9b2f51cabb0 -extensions v3_req_client" returned: 0 in 0.065s {{(pid=131043) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 04 16:56:43.807119 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.processutils [None req-846cdfc7-8c4c-4fd5-9630-3e35750d3a32 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpt5dtars6/temp.key -password pass: {{(pid=131043) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 04 16:56:43.822936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-850e376a-88e3-416f-af64-b2fa6b892a38 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: 2b1b8878-8ab2-4792-904f-dae80363ee37] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:56:43.837309 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.processutils [None req-846cdfc7-8c4c-4fd5-9630-3e35750d3a32 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpt5dtars6/temp.key -password pass:" returned: 0 in 0.029s {{(pid=131043) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 04 16:56:43.901577 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-846cdfc7-8c4c-4fd5-9630-3e35750d3a32 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Getting quotas for project a879594197614cac92810e4454a5b0e5. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:56:43.908207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-846cdfc7-8c4c-4fd5-9630-3e35750d3a32 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Getting quotas for user f1e3e20191ce4384b646f9b2f51cabb0 and project a879594197614cac92810e4454a5b0e5. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:56:43.928243 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-846cdfc7-8c4c-4fd5-9630-3e35750d3a32 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.246284 Aug 04 16:56:43.929370 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 348/662] 10.222.0.93 () {62 vars in 1198 bytes} [Thu Aug 4 16:56:43 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 248 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:56:43.936177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-71f1636d-20e6-4f38-8ea0-62868b29c93b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:43.937101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-71f1636d-20e6-4f38-8ea0-62868b29c93b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:43.946225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71f1636d-20e6-4f38-8ea0-62868b29c93b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:43.946909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71f1636d-20e6-4f38-8ea0-62868b29c93b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:43.947369 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71f1636d-20e6-4f38-8ea0-62868b29c93b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:43.948161 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71f1636d-20e6-4f38-8ea0-62868b29c93b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:43.948625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71f1636d-20e6-4f38-8ea0-62868b29c93b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:43.949079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71f1636d-20e6-4f38-8ea0-62868b29c93b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:43.958917 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-850e376a-88e3-416f-af64-b2fa6b892a38 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "DELETE /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37" status: 204 len: 0 microversion: 2.1 time: 0.186947 Aug 04 16:56:43.959568 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 315/663] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 16:56:43 2022] DELETE /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:56:43.966326 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6e57bfdc-775b-47fe-9516-134118110f52 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Calling method '.version_select at 0x7f1e5b9b9700>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:43.976474 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6e57bfdc-775b-47fe-9516-134118110f52 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] 10.222.0.93 "GET /compute/v2.1/os-keypairs/tempest-keypair-113796749" status: 200 len: 1533 microversion: 2.2 time: 0.015429 Aug 04 16:56:43.977259 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 316/664] 10.222.0.93 () {60 vars in 1255 bytes} [Thu Aug 4 16:56:43 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-113796749 => generated 1533 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:43.981508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-121b0d10-f30c-4574-95bb-6052e98903dc tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:43.986305 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-121b0d10-f30c-4574-95bb-6052e98903dc tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: 2b1b8878-8ab2-4792-904f-dae80363ee37] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:44.003691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-121b0d10-f30c-4574-95bb-6052e98903dc tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:44.004266 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-121b0d10-f30c-4574-95bb-6052e98903dc tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:44.005465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-121b0d10-f30c-4574-95bb-6052e98903dc tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:44.006287 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-121b0d10-f30c-4574-95bb-6052e98903dc tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:44.007085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-121b0d10-f30c-4574-95bb-6052e98903dc tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:44.007521 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-121b0d10-f30c-4574-95bb-6052e98903dc tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:44.149353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-71f1636d-20e6-4f38-8ea0-62868b29c93b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:44.158821 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-71f1636d-20e6-4f38-8ea0-62868b29c93b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1471 microversion: 2.1 time: 0.228239 Aug 04 16:56:44.159581 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 349/665] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:43 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1471 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:44.165399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f79ebf09-c276-4792-a552-14bf0a3ba375 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Calling method '.version_select at 0x7f1e5ba133a0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:44.169932 n-d-851359-3 devstack@n-api.service[131043]: WARNING oslo_db.sqlalchemy.utils [None req-f79ebf09-c276-4792-a552-14bf0a3ba375 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 04 16:56:44.175889 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f79ebf09-c276-4792-a552-14bf0a3ba375 tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] 10.222.0.93 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.015088 Aug 04 16:56:44.176650 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 350/666] 10.222.0.93 () {60 vars in 1177 bytes} [Thu Aug 4 16:56:44 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:44.185207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f13a6f10-8f93-4aad-810c-f7d074dfcdc6 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:44.185824 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f13a6f10-8f93-4aad-810c-f7d074dfcdc6 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:44.192138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f13a6f10-8f93-4aad-810c-f7d074dfcdc6 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:44.192626 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f13a6f10-8f93-4aad-810c-f7d074dfcdc6 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:44.194048 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f13a6f10-8f93-4aad-810c-f7d074dfcdc6 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:44.195018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f13a6f10-8f93-4aad-810c-f7d074dfcdc6 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:44.195469 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f13a6f10-8f93-4aad-810c-f7d074dfcdc6 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:44.195921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f13a6f10-8f93-4aad-810c-f7d074dfcdc6 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:44.197715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-121b0d10-f30c-4574-95bb-6052e98903dc tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712723e5418441c096f008d1520f6dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8c7c49e56743dd9f64102e53c2bec7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:44.219710 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-121b0d10-f30c-4574-95bb-6052e98903dc tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "GET /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37" status: 200 len: 1474 microversion: 2.1 time: 0.240983 Aug 04 16:56:44.236183 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 317/667] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:43 2022] GET /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37 => generated 1474 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:44.244897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c42559df-883c-4ba5-8af5-5a2e0df9a30b tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] Calling method '.version_select at 0x7f1e5b9a51f0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:44.267675 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c42559df-883c-4ba5-8af5-5a2e0df9a30b tempest-KeyPairsV22TestJSON-825402553 tempest-KeyPairsV22TestJSON-825402553-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-113796749" status: 204 len: 0 microversion: 2.2 time: 0.030303 Aug 04 16:56:44.268357 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 318/668] 10.222.0.93 () {60 vars in 1258 bytes} [Thu Aug 4 16:56:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-113796749 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:56:44.362401 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f13a6f10-8f93-4aad-810c-f7d074dfcdc6 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:44.371724 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f13a6f10-8f93-4aad-810c-f7d074dfcdc6 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989" status: 200 len: 1504 microversion: 2.1 time: 0.190638 Aug 04 16:56:44.372460 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 351/669] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:44 2022] GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989 => generated 1504 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:44.544956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-012e0e71-668f-4cc4-acfc-52acb9cc774e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:44.545948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-012e0e71-668f-4cc4-acfc-52acb9cc774e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: b8efce6c-198e-49a7-8576-32d80cb168df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:44.553364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-012e0e71-668f-4cc4-acfc-52acb9cc774e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:44.554201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-012e0e71-668f-4cc4-acfc-52acb9cc774e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:44.554597 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-012e0e71-668f-4cc4-acfc-52acb9cc774e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:44.555394 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-012e0e71-668f-4cc4-acfc-52acb9cc774e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:44.555903 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-012e0e71-668f-4cc4-acfc-52acb9cc774e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:44.556366 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-012e0e71-668f-4cc4-acfc-52acb9cc774e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:44.568393 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d03fa432-0a04-47c6-814b-5c24adb7d82a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:44.569535 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d03fa432-0a04-47c6-814b-5c24adb7d82a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:44.579211 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d03fa432-0a04-47c6-814b-5c24adb7d82a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:44.580097 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d03fa432-0a04-47c6-814b-5c24adb7d82a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:44.581183 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d03fa432-0a04-47c6-814b-5c24adb7d82a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:44.582220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d03fa432-0a04-47c6-814b-5c24adb7d82a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:44.583351 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d03fa432-0a04-47c6-814b-5c24adb7d82a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:44.584131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d03fa432-0a04-47c6-814b-5c24adb7d82a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:44.683225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-d03fa432-0a04-47c6-814b-5c24adb7d82a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lazy-loading 'services' on Instance uuid 96d30c66-24c7-4b25-81cd-fb638035a1cb {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:56:44.706292 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d03fa432-0a04-47c6-814b-5c24adb7d82a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1929 microversion: 2.75 time: 0.146991 Aug 04 16:56:44.718027 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 352/670] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:44 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1929 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:56:44.732319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-012e0e71-668f-4cc4-acfc-52acb9cc774e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:44.740884 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-012e0e71-668f-4cc4-acfc-52acb9cc774e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df" status: 200 len: 1322 microversion: 2.1 time: 0.200034 Aug 04 16:56:44.741464 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 319/671] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:44 2022] GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:45.180480 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4c6a95e9-1404-427b-a1ff-c4ce6b37bdb9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:45.180925 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4c6a95e9-1404-427b-a1ff-c4ce6b37bdb9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:45.187458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c6a95e9-1404-427b-a1ff-c4ce6b37bdb9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:45.187948 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c6a95e9-1404-427b-a1ff-c4ce6b37bdb9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:45.188574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c6a95e9-1404-427b-a1ff-c4ce6b37bdb9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:45.189441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c6a95e9-1404-427b-a1ff-c4ce6b37bdb9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:45.190082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c6a95e9-1404-427b-a1ff-c4ce6b37bdb9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:45.190663 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c6a95e9-1404-427b-a1ff-c4ce6b37bdb9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:45.236184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-fa254703-3495-4527-8d70-a69a34f3f429 req-8ca3712a-1ed8-449d-aae6-da2121454450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8efce6c-198e-49a7-8576-32d80cb168df", "name": "network-vif-plugged", "status": "completed", "tag": "4142971e-ec56-42da-9825-fae6aa5ef34a"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:45.255576 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fa254703-3495-4527-8d70-a69a34f3f429 req-8ca3712a-1ed8-449d-aae6-da2121454450 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:45.257668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fa254703-3495-4527-8d70-a69a34f3f429 req-8ca3712a-1ed8-449d-aae6-da2121454450 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:45.258241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fa254703-3495-4527-8d70-a69a34f3f429 req-8ca3712a-1ed8-449d-aae6-da2121454450 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:45.262780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:45.281890 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-fa254703-3495-4527-8d70-a69a34f3f429 req-8ca3712a-1ed8-449d-aae6-da2121454450 service nova] Creating event network-vif-plugged:4142971e-ec56-42da-9825-fae6aa5ef34a for instance b8efce6c-198e-49a7-8576-32d80cb168df on n-h2-851359-3 Aug 04 16:56:45.288090 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-fa254703-3495-4527-8d70-a69a34f3f429 req-8ca3712a-1ed8-449d-aae6-da2121454450 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059266 Aug 04 16:56:45.289041 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 320/672] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:56:45.319063 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fb9b4294-95bd-48e9-a6bf-aac3e129b561 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:45.321001 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fb9b4294-95bd-48e9-a6bf-aac3e129b561 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: 2b1b8878-8ab2-4792-904f-dae80363ee37] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:45.338977 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb9b4294-95bd-48e9-a6bf-aac3e129b561 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:45.339516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb9b4294-95bd-48e9-a6bf-aac3e129b561 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:45.339969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb9b4294-95bd-48e9-a6bf-aac3e129b561 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:45.340696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb9b4294-95bd-48e9-a6bf-aac3e129b561 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:45.341161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb9b4294-95bd-48e9-a6bf-aac3e129b561 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:45.341593 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb9b4294-95bd-48e9-a6bf-aac3e129b561 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:45.507013 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4c6a95e9-1404-427b-a1ff-c4ce6b37bdb9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:45.517762 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4c6a95e9-1404-427b-a1ff-c4ce6b37bdb9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1471 microversion: 2.1 time: 0.341029 Aug 04 16:56:45.519133 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 353/673] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:45 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1471 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:45.548783 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6ac20f97-ac81-4f36-9aed-6159f5504ffc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:45.549355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6ac20f97-ac81-4f36-9aed-6159f5504ffc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:45.556821 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ac20f97-ac81-4f36-9aed-6159f5504ffc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:45.557334 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ac20f97-ac81-4f36-9aed-6159f5504ffc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:45.558068 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ac20f97-ac81-4f36-9aed-6159f5504ffc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:45.558853 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ac20f97-ac81-4f36-9aed-6159f5504ffc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:45.559326 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ac20f97-ac81-4f36-9aed-6159f5504ffc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:45.559904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ac20f97-ac81-4f36-9aed-6159f5504ffc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:45.660508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fb9b4294-95bd-48e9-a6bf-aac3e129b561 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712723e5418441c096f008d1520f6dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8c7c49e56743dd9f64102e53c2bec7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:45.673558 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fb9b4294-95bd-48e9-a6bf-aac3e129b561 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "GET /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37" status: 200 len: 1474 microversion: 2.1 time: 0.382886 Aug 04 16:56:45.675455 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 321/674] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:45 2022] GET /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37 => generated 1474 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:45.735155 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b9b97a00-ceed-4848-bc94-0695931cabbf tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:45.736144 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b9b97a00-ceed-4848-bc94-0695931cabbf tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:45.747235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9b97a00-ceed-4848-bc94-0695931cabbf tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:45.751630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9b97a00-ceed-4848-bc94-0695931cabbf tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:45.752309 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9b97a00-ceed-4848-bc94-0695931cabbf tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:45.753217 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9b97a00-ceed-4848-bc94-0695931cabbf tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:45.753872 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9b97a00-ceed-4848-bc94-0695931cabbf tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:45.754671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9b97a00-ceed-4848-bc94-0695931cabbf tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:46.195637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-b9b97a00-ceed-4848-bc94-0695931cabbf tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lazy-loading 'services' on Instance uuid 96d30c66-24c7-4b25-81cd-fb638035a1cb {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:56:46.236390 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b9b97a00-ceed-4848-bc94-0695931cabbf tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1929 microversion: 2.75 time: 0.505914 Aug 04 16:56:46.254143 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 322/675] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:45 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1929 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:56:46.265170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-240ed141-ed27-43eb-a737-b8f089dfa27e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:46.266619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-240ed141-ed27-43eb-a737-b8f089dfa27e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: b8efce6c-198e-49a7-8576-32d80cb168df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:46.274169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-240ed141-ed27-43eb-a737-b8f089dfa27e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:46.274874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-240ed141-ed27-43eb-a737-b8f089dfa27e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:46.275486 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-240ed141-ed27-43eb-a737-b8f089dfa27e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:46.276377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-240ed141-ed27-43eb-a737-b8f089dfa27e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:46.277015 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-240ed141-ed27-43eb-a737-b8f089dfa27e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:46.277992 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-240ed141-ed27-43eb-a737-b8f089dfa27e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:46.299105 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6ac20f97-ac81-4f36-9aed-6159f5504ffc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:46.307034 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6ac20f97-ac81-4f36-9aed-6159f5504ffc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989" status: 200 len: 1504 microversion: 2.1 time: 0.786605 Aug 04 16:56:46.313000 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 354/676] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:45 2022] GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989 => generated 1504 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:46.523466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5313567b-2c9d-4b6d-8410-b2042b5d5961 tempest-AbsoluteLimitsNegativeTestJSON-1478376505 tempest-AbsoluteLimitsNegativeTestJSON-1478376505-project] Calling method '.version_select at 0x7f1e5b9f94c0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:46.545801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5313567b-2c9d-4b6d-8410-b2042b5d5961 tempest-AbsoluteLimitsNegativeTestJSON-1478376505 tempest-AbsoluteLimitsNegativeTestJSON-1478376505-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:46.556788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5313567b-2c9d-4b6d-8410-b2042b5d5961 tempest-AbsoluteLimitsNegativeTestJSON-1478376505 tempest-AbsoluteLimitsNegativeTestJSON-1478376505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:46.557841 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5313567b-2c9d-4b6d-8410-b2042b5d5961 tempest-AbsoluteLimitsNegativeTestJSON-1478376505 tempest-AbsoluteLimitsNegativeTestJSON-1478376505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:46.560376 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5313567b-2c9d-4b6d-8410-b2042b5d5961 tempest-AbsoluteLimitsNegativeTestJSON-1478376505 tempest-AbsoluteLimitsNegativeTestJSON-1478376505-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:46.561501 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5313567b-2c9d-4b6d-8410-b2042b5d5961 tempest-AbsoluteLimitsNegativeTestJSON-1478376505 tempest-AbsoluteLimitsNegativeTestJSON-1478376505-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:46.561773 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5313567b-2c9d-4b6d-8410-b2042b5d5961 tempest-AbsoluteLimitsNegativeTestJSON-1478376505 tempest-AbsoluteLimitsNegativeTestJSON-1478376505-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:46.590713 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5313567b-2c9d-4b6d-8410-b2042b5d5961 tempest-AbsoluteLimitsNegativeTestJSON-1478376505 tempest-AbsoluteLimitsNegativeTestJSON-1478376505-project] 10.222.0.93 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.254667 Aug 04 16:56:46.605881 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 355/677] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 16:56:46 2022] GET /compute/v2.1/limits => generated 511 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:56:46.623618 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-51203014-a8a0-409b-8c4d-0b55edb91d3d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:46.624245 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-51203014-a8a0-409b-8c4d-0b55edb91d3d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:46.636502 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-51203014-a8a0-409b-8c4d-0b55edb91d3d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:46.636897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-51203014-a8a0-409b-8c4d-0b55edb91d3d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:46.637349 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-51203014-a8a0-409b-8c4d-0b55edb91d3d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:46.638097 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-51203014-a8a0-409b-8c4d-0b55edb91d3d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:46.638555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-51203014-a8a0-409b-8c4d-0b55edb91d3d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:46.638988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-51203014-a8a0-409b-8c4d-0b55edb91d3d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:46.895400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-240ed141-ed27-43eb-a737-b8f089dfa27e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:46.919302 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-240ed141-ed27-43eb-a737-b8f089dfa27e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df" status: 200 len: 1322 microversion: 2.1 time: 0.663656 Aug 04 16:56:46.919897 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 323/678] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:46 2022] GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df => generated 1322 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:46.942351 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-86a294d0-8fd3-4108-9359-50dbc1eada5e tempest-AbsoluteLimitsNegativeTestJSON-1478376505 tempest-AbsoluteLimitsNegativeTestJSON-1478376505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-169283043", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:47.042560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-86a294d0-8fd3-4108-9359-50dbc1eada5e tempest-AbsoluteLimitsNegativeTestJSON-1478376505 tempest-AbsoluteLimitsNegativeTestJSON-1478376505-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:56:47.063595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-51203014-a8a0-409b-8c4d-0b55edb91d3d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:47.076101 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-51203014-a8a0-409b-8c4d-0b55edb91d3d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1471 microversion: 2.1 time: 0.468094 Aug 04 16:56:47.079431 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 356/679] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:46 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1471 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:47.087521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f9cccab6-f748-4e8a-98e7-4fd7929c8d28 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:47.091397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f9cccab6-f748-4e8a-98e7-4fd7929c8d28 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: 2b1b8878-8ab2-4792-904f-dae80363ee37] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:47.103368 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9cccab6-f748-4e8a-98e7-4fd7929c8d28 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:47.104266 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9cccab6-f748-4e8a-98e7-4fd7929c8d28 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:47.105453 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9cccab6-f748-4e8a-98e7-4fd7929c8d28 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:47.106459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9cccab6-f748-4e8a-98e7-4fd7929c8d28 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:47.107295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9cccab6-f748-4e8a-98e7-4fd7929c8d28 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:47.108060 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9cccab6-f748-4e8a-98e7-4fd7929c8d28 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:47.599327 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f9cccab6-f748-4e8a-98e7-4fd7929c8d28 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712723e5418441c096f008d1520f6dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8c7c49e56743dd9f64102e53c2bec7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:47.620781 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f9cccab6-f748-4e8a-98e7-4fd7929c8d28 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "GET /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37" status: 200 len: 1432 microversion: 2.1 time: 0.539898 Aug 04 16:56:47.625804 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 357/680] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:47 2022] GET /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37 => generated 1432 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:47.643874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-841d6048-933f-46da-95eb-3f3c56601ffa tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:47.645027 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-841d6048-933f-46da-95eb-3f3c56601ffa tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:47.654730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-841d6048-933f-46da-95eb-3f3c56601ffa tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:47.655666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-841d6048-933f-46da-95eb-3f3c56601ffa tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:47.656482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-841d6048-933f-46da-95eb-3f3c56601ffa tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:47.657533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-841d6048-933f-46da-95eb-3f3c56601ffa tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:47.658332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-841d6048-933f-46da-95eb-3f3c56601ffa tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:47.659059 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-841d6048-933f-46da-95eb-3f3c56601ffa tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:47.839960 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-841d6048-933f-46da-95eb-3f3c56601ffa tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lazy-loading 'services' on Instance uuid 96d30c66-24c7-4b25-81cd-fb638035a1cb {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:56:47.862965 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-841d6048-933f-46da-95eb-3f3c56601ffa tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1929 microversion: 2.75 time: 0.235642 Aug 04 16:56:47.863908 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 358/681] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:47 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1929 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:47.881897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-29d5a83f-16be-4c6c-807e-766dbd0915de tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:47.887194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-29d5a83f-16be-4c6c-807e-766dbd0915de tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:47.895909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29d5a83f-16be-4c6c-807e-766dbd0915de tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:47.896952 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29d5a83f-16be-4c6c-807e-766dbd0915de tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:47.897622 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29d5a83f-16be-4c6c-807e-766dbd0915de tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:47.898868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29d5a83f-16be-4c6c-807e-766dbd0915de tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:47.899571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29d5a83f-16be-4c6c-807e-766dbd0915de tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:47.900227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29d5a83f-16be-4c6c-807e-766dbd0915de tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:48.007834 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-86a294d0-8fd3-4108-9359-50dbc1eada5e tempest-AbsoluteLimitsNegativeTestJSON-1478376505 tempest-AbsoluteLimitsNegativeTestJSON-1478376505-project] Getting quotas for project c015c2b94f8241cfa22bb3fa7ebc40a5. Resources: dict_keys(['metadata_items']) {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:56:48.013948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-86a294d0-8fd3-4108-9359-50dbc1eada5e tempest-AbsoluteLimitsNegativeTestJSON-1478376505 tempest-AbsoluteLimitsNegativeTestJSON-1478376505-project] Getting quotas for user c6b1aadeabcd41cf9ad9523ca9316f56 and project c015c2b94f8241cfa22bb3fa7ebc40a5. Resources: dict_keys(['metadata_items']) {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:56:48.027329 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-86a294d0-8fd3-4108-9359-50dbc1eada5e tempest-AbsoluteLimitsNegativeTestJSON-1478376505 tempest-AbsoluteLimitsNegativeTestJSON-1478376505-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-86a294d0-8fd3-4108-9359-50dbc1eada5e tempest-AbsoluteLimitsNegativeTestJSON-1478376505 tempest-AbsoluteLimitsNegativeTestJSON-1478376505-project] Request method failure captured: Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 1751 Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_pOx9mc5zKKXF6mWMzGIz3cuhduS1VxoOumLfXz1DhEkQ24cYZkVJmK46dt0uMt88ktMYSHI2dOJ_KepcZ86t667N4zBEPznkg7hCSG24CD6qW4PdT_Fn9nTzwjKUYOW1NN1BTmtVs14r0wnQG7SXstf4F4eMg_2w8vghWVyGMcBa0 Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: c015c2b94f8241cfa22bb3fa7ebc40a5 Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1478376505 Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c015c2b94f8241cfa22bb3fa7ebc40a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c015c2b94f8241cfa22bb3fa7ebc40a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c015c2b94f8241cfa22bb3fa7ebc40a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c015c2b94f8241cfa22bb3fa7ebc40a5"}]}] Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1478376505 Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: c015c2b94f8241cfa22bb3fa7ebc40a5 Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1478376505 Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1478376505-project Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: c6b1aadeabcd41cf9ad9523ca9316f56 Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1478376505-project Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-169283043", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:56:48.030711 n-d-851359-3 devstack@n-api.service[131044]: exception: Maximum number of metadata items exceeds 128 Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-169283043', 'imageRef': '93ebc91d-2d7a-4ab2-b133-dcf9559166d9', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 464, in _check_metadata_properties_quota Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1004, in _checks_for_create_and_rebuild Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 471, in _check_metadata_properties_quota Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:56:48.033375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:56:48.036019 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:56:48.036019 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 16:56:48.036019 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 04 16:56:48.036019 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 04 16:56:48.036019 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 04 16:56:48.036019 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:48.036019 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:48.036019 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:48.036019 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:48.036019 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:48.036019 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:48.036019 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:56:48.036019 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:56:48.036019 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 04 16:56:48.036019 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:48.038969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-86a294d0-8fd3-4108-9359-50dbc1eada5e tempest-AbsoluteLimitsNegativeTestJSON-1478376505 tempest-AbsoluteLimitsNegativeTestJSON-1478376505-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:48.040114 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-86a294d0-8fd3-4108-9359-50dbc1eada5e tempest-AbsoluteLimitsNegativeTestJSON-1478376505 tempest-AbsoluteLimitsNegativeTestJSON-1478376505-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.104970 Aug 04 16:56:48.041307 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 324/682] 10.222.0.93 () {60 vars in 1148 bytes} [Thu Aug 4 16:56:46 2022] POST /compute/v2.1/servers => generated 87 bytes in 1107 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:56:48.046827 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-98c97101-d4c8-4f0d-8bd7-d02024ae6d38 req-5c3318bb-7a8c-4e6e-9e26-0780bfab76e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b1b8878-8ab2-4792-904f-dae80363ee37", "name": "network-vif-deleted", "tag": "f14cc87b-6de7-4609-9c0c-01ed874b29b1"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:48.060904 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-98c97101-d4c8-4f0d-8bd7-d02024ae6d38 req-5c3318bb-7a8c-4e6e-9e26-0780bfab76e5 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:48.062083 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-98c97101-d4c8-4f0d-8bd7-d02024ae6d38 req-5c3318bb-7a8c-4e6e-9e26-0780bfab76e5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:48.063285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-98c97101-d4c8-4f0d-8bd7-d02024ae6d38 req-5c3318bb-7a8c-4e6e-9e26-0780bfab76e5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:48.085960 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-98c97101-d4c8-4f0d-8bd7-d02024ae6d38 req-5c3318bb-7a8c-4e6e-9e26-0780bfab76e5 service nova] Creating event network-vif-deleted:f14cc87b-6de7-4609-9c0c-01ed874b29b1 for instance 2b1b8878-8ab2-4792-904f-dae80363ee37 on n-h1-851359-3 Aug 04 16:56:48.092405 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-98c97101-d4c8-4f0d-8bd7-d02024ae6d38 req-5c3318bb-7a8c-4e6e-9e26-0780bfab76e5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049482 Aug 04 16:56:48.093321 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 325/683] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:48.106057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ce8e6dab-ab83-4ecb-8b0f-ed7bc3f5b16e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:48.107000 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ce8e6dab-ab83-4ecb-8b0f-ed7bc3f5b16e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: b8efce6c-198e-49a7-8576-32d80cb168df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:48.125896 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce8e6dab-ab83-4ecb-8b0f-ed7bc3f5b16e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:48.126810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce8e6dab-ab83-4ecb-8b0f-ed7bc3f5b16e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:48.127484 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce8e6dab-ab83-4ecb-8b0f-ed7bc3f5b16e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:48.128430 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce8e6dab-ab83-4ecb-8b0f-ed7bc3f5b16e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:48.129094 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce8e6dab-ab83-4ecb-8b0f-ed7bc3f5b16e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:48.130889 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce8e6dab-ab83-4ecb-8b0f-ed7bc3f5b16e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:48.169725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-29d5a83f-16be-4c6c-807e-766dbd0915de tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:48.183248 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-29d5a83f-16be-4c6c-807e-766dbd0915de tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989" status: 200 len: 1504 microversion: 2.1 time: 0.307654 Aug 04 16:56:48.190122 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 359/684] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:47 2022] GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989 => generated 1504 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:48.201676 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-70d48e96-caaa-475d-ab93-79c481369852 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:48.203914 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-70d48e96-caaa-475d-ab93-79c481369852 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:48.231556 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70d48e96-caaa-475d-ab93-79c481369852 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:48.232320 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70d48e96-caaa-475d-ab93-79c481369852 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:48.235691 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70d48e96-caaa-475d-ab93-79c481369852 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:48.236890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70d48e96-caaa-475d-ab93-79c481369852 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:48.238901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70d48e96-caaa-475d-ab93-79c481369852 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:48.239517 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70d48e96-caaa-475d-ab93-79c481369852 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:48.473751 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-70d48e96-caaa-475d-ab93-79c481369852 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:48.486637 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-70d48e96-caaa-475d-ab93-79c481369852 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1476 microversion: 2.1 time: 0.294353 Aug 04 16:56:48.491828 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ce8e6dab-ab83-4ecb-8b0f-ed7bc3f5b16e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:48.500512 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 360/685] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:48 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1476 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:48.508244 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ce8e6dab-ab83-4ecb-8b0f-ed7bc3f5b16e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df" status: 200 len: 1472 microversion: 2.1 time: 0.412934 Aug 04 16:56:48.509418 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 326/686] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:48 2022] GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df => generated 1472 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:48.644217 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c3bce061-6bce-4675-b85b-d0e1ef1468d5 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:48.644729 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c3bce061-6bce-4675-b85b-d0e1ef1468d5 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] [instance: 2b1b8878-8ab2-4792-904f-dae80363ee37] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:48.655799 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3bce061-6bce-4675-b85b-d0e1ef1468d5 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:48.656680 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3bce061-6bce-4675-b85b-d0e1ef1468d5 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:48.659359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3bce061-6bce-4675-b85b-d0e1ef1468d5 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:48.660344 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3bce061-6bce-4675-b85b-d0e1ef1468d5 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:48.661004 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3bce061-6bce-4675-b85b-d0e1ef1468d5 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:48.662741 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3bce061-6bce-4675-b85b-d0e1ef1468d5 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:48.700982 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-c3bce061-6bce-4675-b85b-d0e1ef1468d5 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] HTTP exception thrown: Instance 2b1b8878-8ab2-4792-904f-dae80363ee37 could not be found. Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c3bce061-6bce-4675-b85b-d0e1ef1468d5 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Request method failure captured: Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37 HTTP/1.1 Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_oWds9owWNPaV7yQcBUrpy3N0lHI9lR33fwXDGyBSq4se_5-Wifk-pRLtX1NlOdhGGj18SkiHTKRhP9YhVUYayk5-_m2YeFfB3Qf94X7CcO1rQsBtmjK-eFn2EzWDa9rR-iX8Z3jAOtIwvc85uLM_MHmgsvyeX3KenO1e9Kn5hus9I Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 3f8c7c49e56743dd9f64102e53c2bec7 Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-LiveMigrationNegativeTest-934305132 Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3f8c7c49e56743dd9f64102e53c2bec7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3f8c7c49e56743dd9f64102e53c2bec7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3f8c7c49e56743dd9f64102e53c2bec7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3f8c7c49e56743dd9f64102e53c2bec7"}]}] Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-LiveMigrationNegativeTest-934305132 Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 3f8c7c49e56743dd9f64102e53c2bec7 Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-934305132 Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-LiveMigrationNegativeTest-934305132-project Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 712723e5418441c096f008d1520f6dce Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-LiveMigrationNegativeTest-934305132-project Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 2b1b8878-8ab2-4792-904f-dae80363ee37 could not be found. Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '2b1b8878-8ab2-4792-904f-dae80363ee37'} Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b1b8878-8ab2-4792-904f-dae80363ee37 could not be found. Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b1b8878-8ab2-4792-904f-dae80363ee37 could not be found. Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:48.702768 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:48.708491 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:48.708491 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:48.708491 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:48.708491 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:56:48.708491 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:56:48.708491 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b1b8878-8ab2-4792-904f-dae80363ee37 could not be found. Aug 04 16:56:48.708491 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:56:48.708491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c3bce061-6bce-4675-b85b-d0e1ef1468d5 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] Returning 404 to user: Instance 2b1b8878-8ab2-4792-904f-dae80363ee37 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:48.708491 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c3bce061-6bce-4675-b85b-d0e1ef1468d5 tempest-LiveMigrationNegativeTest-934305132 tempest-LiveMigrationNegativeTest-934305132-project] 10.222.0.93 "GET /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37" status: 404 len: 111 microversion: 2.1 time: 0.064467 Aug 04 16:56:48.713819 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 327/687] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:48 2022] GET /compute/v2.1/servers/2b1b8878-8ab2-4792-904f-dae80363ee37 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:56:48.862489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dc193ac6-ebd8-4608-b0ca-4963ac4c4d9f tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:48.863725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dc193ac6-ebd8-4608-b0ca-4963ac4c4d9f tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] [instance: 24794fae-0ed5-47f8-b2fc-8eaf21b9bd6d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:48.872881 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-dc193ac6-ebd8-4608-b0ca-4963ac4c4d9f tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] HTTP exception thrown: Instance 24794fae-0ed5-47f8-b2fc-8eaf21b9bd6d could not be found. Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dc193ac6-ebd8-4608-b0ca-4963ac4c4d9f tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Request method failure captured: Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers/24794fae-0ed5-47f8-b2fc-8eaf21b9bd6d/action HTTP/1.1 Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 15 Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_o6nVjFi-3zob8aowZyt1IgcLYu-nQd5vnf64oZUAtZ-_nSAtKC20iT-Dkv8lO94A-WJ_kf7cpRr47GH_SavpCgP8y8PS7wl-yhVk5qcMC7x620QV7QQHa3Co0iEpg2kOXEtwEnEQCLx3qQcQgT6zEgBovXzhiQTLGZztIkcncmlzs Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: b2d92201c7aa48a1a150111dcc2dcdac Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1221082146 Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: X-Role: admin,member,reader Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: admin,member,reader Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b2d92201c7aa48a1a150111dcc2dcdac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b2d92201c7aa48a1a150111dcc2dcdac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b2d92201c7aa48a1a150111dcc2dcdac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b2d92201c7aa48a1a150111dcc2dcdac"}]}] Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1221082146 Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: b2d92201c7aa48a1a150111dcc2dcdac Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1221082146 Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersAdminNegativeTestJSON-1221082146-project-admin Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 3e67b4859e594e0caf5bdc2ab1d6ac72 Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1221082146-project-admin Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: {"migrate": {}} Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 24794fae-0ed5-47f8-b2fc-8eaf21b9bd6d could not be found. Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '24794fae-0ed5-47f8-b2fc-8eaf21b9bd6d', 'body': {'migrate': {}}} Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24794fae-0ed5-47f8-b2fc-8eaf21b9bd6d could not be found. Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24794fae-0ed5-47f8-b2fc-8eaf21b9bd6d could not be found. Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:48.885423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:56:48.889446 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:56:48.889446 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:56:48.889446 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:56:48.889446 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:56:48.889446 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24794fae-0ed5-47f8-b2fc-8eaf21b9bd6d could not be found. Aug 04 16:56:48.889446 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:56:48.889808 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cc476fe3-aaf7-4ced-9330-add248607821 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:48.889808 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cc476fe3-aaf7-4ced-9330-add248607821 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:48.892051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dc193ac6-ebd8-4608-b0ca-4963ac4c4d9f tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Returning 404 to user: Instance 24794fae-0ed5-47f8-b2fc-8eaf21b9bd6d could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:56:48.893015 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dc193ac6-ebd8-4608-b0ca-4963ac4c4d9f tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/24794fae-0ed5-47f8-b2fc-8eaf21b9bd6d/action" status: 404 len: 111 microversion: 2.1 time: 0.366573 Aug 04 16:56:48.903559 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc476fe3-aaf7-4ced-9330-add248607821 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:48.903559 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc476fe3-aaf7-4ced-9330-add248607821 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:48.903559 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc476fe3-aaf7-4ced-9330-add248607821 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:48.904417 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 361/688] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:56:48 2022] POST /compute/v2.1/servers/24794fae-0ed5-47f8-b2fc-8eaf21b9bd6d/action => generated 111 bytes in 378 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:56:48.904868 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc476fe3-aaf7-4ced-9330-add248607821 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:48.906085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc476fe3-aaf7-4ced-9330-add248607821 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:48.906539 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc476fe3-aaf7-4ced-9330-add248607821 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:49.072126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-cc476fe3-aaf7-4ced-9330-add248607821 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lazy-loading 'services' on Instance uuid 96d30c66-24c7-4b25-81cd-fb638035a1cb {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:56:49.082872 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f600946e-1086-46c1-9fff-cc49a9b346c0 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-656762963", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:49.102750 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cc476fe3-aaf7-4ced-9330-add248607821 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1929 microversion: 2.75 time: 0.218256 Aug 04 16:56:49.106081 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 328/689] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:48 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1929 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:49.211187 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6872f970-7486-4823-9898-570e5eda198a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:49.211987 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6872f970-7486-4823-9898-570e5eda198a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:49.222432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-f600946e-1086-46c1-9fff-cc49a9b346c0 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] validate_networks() for None {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:56:49.228715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6872f970-7486-4823-9898-570e5eda198a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:49.230696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6872f970-7486-4823-9898-570e5eda198a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:49.231151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6872f970-7486-4823-9898-570e5eda198a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:49.233538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6872f970-7486-4823-9898-570e5eda198a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:49.234562 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6872f970-7486-4823-9898-570e5eda198a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:49.235321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6872f970-7486-4823-9898-570e5eda198a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:49.607051 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6872f970-7486-4823-9898-570e5eda198a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:49.618599 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6872f970-7486-4823-9898-570e5eda198a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989" status: 200 len: 1504 microversion: 2.1 time: 0.411922 Aug 04 16:56:49.632972 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 329/690] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:49 2022] GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989 => generated 1504 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:49.638784 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-38cd3efd-7d14-453f-bfd7-dbdf4ab8015d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:49.639750 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-38cd3efd-7d14-453f-bfd7-dbdf4ab8015d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:49.646273 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38cd3efd-7d14-453f-bfd7-dbdf4ab8015d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:49.647127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38cd3efd-7d14-453f-bfd7-dbdf4ab8015d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:49.647801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38cd3efd-7d14-453f-bfd7-dbdf4ab8015d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:49.648804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38cd3efd-7d14-453f-bfd7-dbdf4ab8015d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:49.649464 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38cd3efd-7d14-453f-bfd7-dbdf4ab8015d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:49.650142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38cd3efd-7d14-453f-bfd7-dbdf4ab8015d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:49.773713 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-f600946e-1086-46c1-9fff-cc49a9b346c0 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:56:49.774161 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-f600946e-1086-46c1-9fff-cc49a9b346c0 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:56:49.774699 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-f600946e-1086-46c1-9fff-cc49a9b346c0 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:56:49.775085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-f600946e-1086-46c1-9fff-cc49a9b346c0 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:56:49.775543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-f600946e-1086-46c1-9fff-cc49a9b346c0 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:56:49.803728 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f600946e-1086-46c1-9fff-cc49a9b346c0 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:49.804562 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f600946e-1086-46c1-9fff-cc49a9b346c0 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:49.805400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f600946e-1086-46c1-9fff-cc49a9b346c0 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:49.806995 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f600946e-1086-46c1-9fff-cc49a9b346c0 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:49.837002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f600946e-1086-46c1-9fff-cc49a9b346c0 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:49.837473 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f600946e-1086-46c1-9fff-cc49a9b346c0 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:49.885128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-f600946e-1086-46c1-9fff-cc49a9b346c0 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Getting quotas for project 3db0dbf55e504a95903556ffd03801fe. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:56:49.891720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-f600946e-1086-46c1-9fff-cc49a9b346c0 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Getting quotas for user 774f01840dcc4fb9a160f4e3707c20ef and project 3db0dbf55e504a95903556ffd03801fe. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:56:49.904885 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f600946e-1086-46c1-9fff-cc49a9b346c0 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:56:49.908415 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f600946e-1086-46c1-9fff-cc49a9b346c0 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: 687e42c7-8cf6-41a3-b16f-6cc104223f58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:56:49.974860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-38cd3efd-7d14-453f-bfd7-dbdf4ab8015d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:49.996444 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-38cd3efd-7d14-453f-bfd7-dbdf4ab8015d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1476 microversion: 2.1 time: 0.361408 Aug 04 16:56:50.002819 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 330/691] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:49 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1476 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:50.031515 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f600946e-1086-46c1-9fff-cc49a9b346c0 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.955491 Aug 04 16:56:50.038318 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 362/692] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:56:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:56:50.055452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4f33bf1d-3585-4aee-b89a-b84f71256498 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:50.057472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4f33bf1d-3585-4aee-b89a-b84f71256498 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: 687e42c7-8cf6-41a3-b16f-6cc104223f58] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:50.130913 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1bce2aad-595d-432f-882d-d84b44200050 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:50.131538 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1bce2aad-595d-432f-882d-d84b44200050 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:50.140077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1bce2aad-595d-432f-882d-d84b44200050 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:50.148223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1bce2aad-595d-432f-882d-d84b44200050 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:50.149087 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1bce2aad-595d-432f-882d-d84b44200050 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:50.149472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1bce2aad-595d-432f-882d-d84b44200050 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:50.149960 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1bce2aad-595d-432f-882d-d84b44200050 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:50.150423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1bce2aad-595d-432f-882d-d84b44200050 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:50.218982 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4f33bf1d-3585-4aee-b89a-b84f71256498 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:50.227598 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4f33bf1d-3585-4aee-b89a-b84f71256498 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58" status: 200 len: 1221 microversion: 2.1 time: 0.187062 Aug 04 16:56:50.228845 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 331/693] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:50 2022] GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58 => generated 1221 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:50.303483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f36ed877-cd53-4b40-9e60-550df1323c78 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:50.304243 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f36ed877-cd53-4b40-9e60-550df1323c78 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:50.313637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:DELETE=6,nova_api:SELECT=92,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:50.327053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-1bce2aad-595d-432f-882d-d84b44200050 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lazy-loading 'services' on Instance uuid 96d30c66-24c7-4b25-81cd-fb638035a1cb {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:56:50.356873 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f36ed877-cd53-4b40-9e60-550df1323c78 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:50.360990 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f36ed877-cd53-4b40-9e60-550df1323c78 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:50.361501 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f36ed877-cd53-4b40-9e60-550df1323c78 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:50.362593 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f36ed877-cd53-4b40-9e60-550df1323c78 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:50.363075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f36ed877-cd53-4b40-9e60-550df1323c78 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:50.363514 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f36ed877-cd53-4b40-9e60-550df1323c78 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:50.391063 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1bce2aad-595d-432f-882d-d84b44200050 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1929 microversion: 2.75 time: 0.263943 Aug 04 16:56:50.394871 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 363/694] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:50 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1929 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:50.424468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f36ed877-cd53-4b40-9e60-550df1323c78 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:56:50.631487 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f36ed877-cd53-4b40-9e60-550df1323c78 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "DELETE /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13" status: 204 len: 0 microversion: 2.1 time: 0.332571 Aug 04 16:56:50.644214 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 332/695] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 16:56:50 2022] DELETE /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:56:50.644841 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8370ef86-b346-4986-a0bd-f93aae524d45 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:50.645967 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8370ef86-b346-4986-a0bd-f93aae524d45 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:50.655400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8370ef86-b346-4986-a0bd-f93aae524d45 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:50.655945 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8370ef86-b346-4986-a0bd-f93aae524d45 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:50.656404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8370ef86-b346-4986-a0bd-f93aae524d45 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:50.657112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8370ef86-b346-4986-a0bd-f93aae524d45 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:50.657573 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8370ef86-b346-4986-a0bd-f93aae524d45 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:50.658040 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8370ef86-b346-4986-a0bd-f93aae524d45 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:50.918758 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-087928ad-0618-4ac3-a252-8ad7095e317f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-2146407965", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "1225047199", "adminPass": "***", "networks": [{"uuid": "3269466f-d3dd-44c7-90ef-d541bfb7f6fb"}], "security_groups": [{"name": "tempest-securitygroup--271549013"}], "key_name": "tempest-keypair-1666819661", "user_data": "}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:51.114685 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8370ef86-b346-4986-a0bd-f93aae524d45 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:51.127920 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8370ef86-b346-4986-a0bd-f93aae524d45 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989" status: 200 len: 1479 microversion: 2.1 time: 0.490399 Aug 04 16:56:51.150544 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 364/696] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:50 2022] GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989 => generated 1479 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:56:51.156275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3a22f8a7-486a-45b1-afde-3e69276705a0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:51.156905 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3a22f8a7-486a-45b1-afde-3e69276705a0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:51.177334 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a22f8a7-486a-45b1-afde-3e69276705a0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:51.177834 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a22f8a7-486a-45b1-afde-3e69276705a0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:51.178316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a22f8a7-486a-45b1-afde-3e69276705a0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:51.179036 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a22f8a7-486a-45b1-afde-3e69276705a0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:51.179501 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a22f8a7-486a-45b1-afde-3e69276705a0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:51.179930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a22f8a7-486a-45b1-afde-3e69276705a0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:51.229386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:51.297270 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-087928ad-0618-4ac3-a252-8ad7095e317f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] validate_networks() for [('3269466f-d3dd-44c7-90ef-d541bfb7f6fb', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:56:51.628817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3a22f8a7-486a-45b1-afde-3e69276705a0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:51.636628 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3a22f8a7-486a-45b1-afde-3e69276705a0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1476 microversion: 2.1 time: 0.484908 Aug 04 16:56:51.652598 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 365/697] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:51 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1476 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:51.656893 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-227b2a75-8e3d-4236-a5df-6c039ab5d3eb tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Calling method '.version_select at 0x7f1e6aec9040>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:51.660342 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-227b2a75-8e3d-4236-a5df-6c039ab5d3eb tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:51.660840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-227b2a75-8e3d-4236-a5df-6c039ab5d3eb tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:51.661280 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-227b2a75-8e3d-4236-a5df-6c039ab5d3eb tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:51.670958 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-227b2a75-8e3d-4236-a5df-6c039ab5d3eb tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] 10.222.0.93 "GET /compute/v2.1/os-migrations" status: 200 len: 1568 microversion: 2.1 time: 0.020989 Aug 04 16:56:51.680913 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 366/698] 10.222.0.93 () {58 vars in 1143 bytes} [Thu Aug 4 16:56:51 2022] GET /compute/v2.1/os-migrations => generated 1568 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:51.686110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c80e7759-cb78-450e-aaa7-e8aed91f9905 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:51.687904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c80e7759-cb78-450e-aaa7-e8aed91f9905 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: 687e42c7-8cf6-41a3-b16f-6cc104223f58] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:51.694855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c80e7759-cb78-450e-aaa7-e8aed91f9905 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:51.695361 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c80e7759-cb78-450e-aaa7-e8aed91f9905 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:51.695808 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c80e7759-cb78-450e-aaa7-e8aed91f9905 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:51.696554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c80e7759-cb78-450e-aaa7-e8aed91f9905 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:51.696989 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c80e7759-cb78-450e-aaa7-e8aed91f9905 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:51.697422 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c80e7759-cb78-450e-aaa7-e8aed91f9905 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:51.900810 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c80e7759-cb78-450e-aaa7-e8aed91f9905 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:51.926891 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c80e7759-cb78-450e-aaa7-e8aed91f9905 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58" status: 200 len: 1273 microversion: 2.1 time: 0.243695 Aug 04 16:56:51.939330 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 367/699] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:51 2022] GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58 => generated 1273 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:51.953785 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a0e11d1d-0c6d-4f7c-9551-0c01e7a86690 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:51.956013 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a0e11d1d-0c6d-4f7c-9551-0c01e7a86690 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:51.967828 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a0e11d1d-0c6d-4f7c-9551-0c01e7a86690 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:51.969421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a0e11d1d-0c6d-4f7c-9551-0c01e7a86690 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:51.972661 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a0e11d1d-0c6d-4f7c-9551-0c01e7a86690 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:51.975089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a0e11d1d-0c6d-4f7c-9551-0c01e7a86690 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:51.976372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a0e11d1d-0c6d-4f7c-9551-0c01e7a86690 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:51.977111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a0e11d1d-0c6d-4f7c-9551-0c01e7a86690 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:52.447196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-087928ad-0618-4ac3-a252-8ad7095e317f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:56:52.447693 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-087928ad-0618-4ac3-a252-8ad7095e317f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:56:52.448635 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-087928ad-0618-4ac3-a252-8ad7095e317f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:56:52.449086 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-087928ad-0618-4ac3-a252-8ad7095e317f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:56:52.449472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-087928ad-0618-4ac3-a252-8ad7095e317f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:56:52.453724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-a0e11d1d-0c6d-4f7c-9551-0c01e7a86690 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lazy-loading 'services' on Instance uuid 96d30c66-24c7-4b25-81cd-fb638035a1cb {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:56:52.473216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-087928ad-0618-4ac3-a252-8ad7095e317f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:52.473718 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-087928ad-0618-4ac3-a252-8ad7095e317f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:52.477088 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-087928ad-0618-4ac3-a252-8ad7095e317f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:52.478393 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-087928ad-0618-4ac3-a252-8ad7095e317f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:52.479506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-087928ad-0618-4ac3-a252-8ad7095e317f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:52.481135 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-087928ad-0618-4ac3-a252-8ad7095e317f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:52.533787 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a0e11d1d-0c6d-4f7c-9551-0c01e7a86690 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1929 microversion: 2.75 time: 0.593134 Aug 04 16:56:52.537245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-087928ad-0618-4ac3-a252-8ad7095e317f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Getting quotas for project 131b528863154fefbc36f11eaf18365e. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:56:52.538643 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 368/700] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:51 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1929 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:52.544445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-087928ad-0618-4ac3-a252-8ad7095e317f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Getting quotas for user 679ea09388514a19a79f2dcce73b4189 and project 131b528863154fefbc36f11eaf18365e. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:56:52.552630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-751ec6c7-2ebe-40ab-9f1e-848cbcb8d16f tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:52.558382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-751ec6c7-2ebe-40ab-9f1e-848cbcb8d16f tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:52.582343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-087928ad-0618-4ac3-a252-8ad7095e317f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:56:52.588103 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-087928ad-0618-4ac3-a252-8ad7095e317f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: f2d3490d-12a5-453d-b698-80ca6550f0f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:56:52.594477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-751ec6c7-2ebe-40ab-9f1e-848cbcb8d16f tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:52.595235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-751ec6c7-2ebe-40ab-9f1e-848cbcb8d16f tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:52.595820 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-751ec6c7-2ebe-40ab-9f1e-848cbcb8d16f tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:52.596685 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-751ec6c7-2ebe-40ab-9f1e-848cbcb8d16f tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:52.597283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-751ec6c7-2ebe-40ab-9f1e-848cbcb8d16f tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:52.597879 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-751ec6c7-2ebe-40ab-9f1e-848cbcb8d16f tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:52.746919 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-087928ad-0618-4ac3-a252-8ad7095e317f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.824409 Aug 04 16:56:52.754021 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 333/701] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:56:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 1835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:56:52.760626 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dd8937b1-0f3c-4d2e-a2a3-bfaca352992c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:52.761506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dd8937b1-0f3c-4d2e-a2a3-bfaca352992c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:52.774942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd8937b1-0f3c-4d2e-a2a3-bfaca352992c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:52.777240 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd8937b1-0f3c-4d2e-a2a3-bfaca352992c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:52.777802 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd8937b1-0f3c-4d2e-a2a3-bfaca352992c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:52.779677 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd8937b1-0f3c-4d2e-a2a3-bfaca352992c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:52.781832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd8937b1-0f3c-4d2e-a2a3-bfaca352992c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:52.782591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd8937b1-0f3c-4d2e-a2a3-bfaca352992c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:53.477330 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dd8937b1-0f3c-4d2e-a2a3-bfaca352992c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:53.493237 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dd8937b1-0f3c-4d2e-a2a3-bfaca352992c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1476 microversion: 2.1 time: 0.741173 Aug 04 16:56:53.494647 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 334/702] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:52 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1476 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:53.506335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-af9735de-af2f-465b-a520-44c37735b3bb tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:53.508225 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-af9735de-af2f-465b-a520-44c37735b3bb tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: f2d3490d-12a5-453d-b698-80ca6550f0f0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:53.830526 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-af9735de-af2f-465b-a520-44c37735b3bb tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:53.848925 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-af9735de-af2f-465b-a520-44c37735b3bb tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0" status: 200 len: 1265 microversion: 2.1 time: 0.352230 Aug 04 16:56:53.850595 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 335/703] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:53 2022] GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0 => generated 1265 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:53.862402 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-31ab7e9d-647b-41f8-a8bb-92882680e524 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:53.863208 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-31ab7e9d-647b-41f8-a8bb-92882680e524 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: 687e42c7-8cf6-41a3-b16f-6cc104223f58] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:53.877346 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31ab7e9d-647b-41f8-a8bb-92882680e524 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:53.879956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31ab7e9d-647b-41f8-a8bb-92882680e524 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:53.880773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31ab7e9d-647b-41f8-a8bb-92882680e524 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:53.881757 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31ab7e9d-647b-41f8-a8bb-92882680e524 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:53.883719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31ab7e9d-647b-41f8-a8bb-92882680e524 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:53.884480 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31ab7e9d-647b-41f8-a8bb-92882680e524 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:53.896426 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-751ec6c7-2ebe-40ab-9f1e-848cbcb8d16f tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989" status: 200 len: 1630 microversion: 2.1 time: 1.351224 Aug 04 16:56:53.898971 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 369/704] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:52 2022] GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989 => generated 1630 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:53.938820 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-998a1c07-dd52-4ba7-85e3-37b2259f280f tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:53.945702 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-998a1c07-dd52-4ba7-85e3-37b2259f280f tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:53.958739 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-998a1c07-dd52-4ba7-85e3-37b2259f280f tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:53.958958 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-998a1c07-dd52-4ba7-85e3-37b2259f280f tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:53.959328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-998a1c07-dd52-4ba7-85e3-37b2259f280f tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:53.960060 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-998a1c07-dd52-4ba7-85e3-37b2259f280f tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:53.960527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-998a1c07-dd52-4ba7-85e3-37b2259f280f tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:53.960958 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-998a1c07-dd52-4ba7-85e3-37b2259f280f tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:54.210768 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-31ab7e9d-647b-41f8-a8bb-92882680e524 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:54.255570 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-998a1c07-dd52-4ba7-85e3-37b2259f280f tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lazy-loading 'services' on Instance uuid 96d30c66-24c7-4b25-81cd-fb638035a1cb {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:56:54.255759 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-31ab7e9d-647b-41f8-a8bb-92882680e524 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58" status: 200 len: 1279 microversion: 2.1 time: 0.401566 Aug 04 16:56:54.256518 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 336/705] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:53 2022] GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58 => generated 1279 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:54.297384 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-998a1c07-dd52-4ba7-85e3-37b2259f280f tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1929 microversion: 2.75 time: 0.383083 Aug 04 16:56:54.298452 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 370/706] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:53 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1929 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:54.303801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9c87fd55-ee1e-4f78-ab0e-f8d66510e289 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Action: 'create', calling method: .version_select at 0x7f1e5ba13f70>, body: {"keypair": {"name": "tempest-keypair-1843048410", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7YMkWbT34MFQ+RRUETbmvxRBIt3L0xPBDyR6P/ruuKmjqu4Yl2RJJYj6QJFhPbfv/SLwVuqgG19v/uL8NckULRv453yDnezQD45AeV8apcHh0SagFywrWEZziGNVx4bw=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:54.335532 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:54.352031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-9c87fd55-ee1e-4f78-ab0e-f8d66510e289 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Getting quotas for project 792f078eb62f4820ba4166d421079491. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:56:54.365254 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-9c87fd55-ee1e-4f78-ab0e-f8d66510e289 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Getting quotas for user 81d93fe83a6542c89cbc86106671b15f and project 792f078eb62f4820ba4166d421079491. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:56:54.420383 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9c87fd55-ee1e-4f78-ab0e-f8d66510e289 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.120561 Aug 04 16:56:54.422582 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 371/707] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 16:56:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:54.524284 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7e675364-c153-4042-b909-d458d8ebda61 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:54.525371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7e675364-c153-4042-b909-d458d8ebda61 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:54.543881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7e675364-c153-4042-b909-d458d8ebda61 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:54.545749 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7e675364-c153-4042-b909-d458d8ebda61 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:54.546769 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7e675364-c153-4042-b909-d458d8ebda61 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:54.547524 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7e675364-c153-4042-b909-d458d8ebda61 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:54.547990 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7e675364-c153-4042-b909-d458d8ebda61 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:54.548422 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7e675364-c153-4042-b909-d458d8ebda61 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:54.557681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-668d03ce-915a-45ee-8ddd-824ce006a5a5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1493691471", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:54.686849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-668d03ce-915a-45ee-8ddd-824ce006a5a5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:56:55.347659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7e675364-c153-4042-b909-d458d8ebda61 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:55.362367 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7e675364-c153-4042-b909-d458d8ebda61 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1476 microversion: 2.1 time: 0.849606 Aug 04 16:56:55.363001 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 372/708] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:54 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1476 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:55.386186 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-19f31f42-08ea-4812-af20-51647ad744f3 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:55.387370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-19f31f42-08ea-4812-af20-51647ad744f3 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: f2d3490d-12a5-453d-b698-80ca6550f0f0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:55.402273 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19f31f42-08ea-4812-af20-51647ad744f3 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:55.402853 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19f31f42-08ea-4812-af20-51647ad744f3 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:55.403303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19f31f42-08ea-4812-af20-51647ad744f3 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:55.404022 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19f31f42-08ea-4812-af20-51647ad744f3 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:55.410891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19f31f42-08ea-4812-af20-51647ad744f3 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:55.411457 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19f31f42-08ea-4812-af20-51647ad744f3 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:55.531550 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-668d03ce-915a-45ee-8ddd-824ce006a5a5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:56:55.532408 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-668d03ce-915a-45ee-8ddd-824ce006a5a5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:56:55.533536 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-668d03ce-915a-45ee-8ddd-824ce006a5a5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:56:55.534884 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-668d03ce-915a-45ee-8ddd-824ce006a5a5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:56:55.535628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-668d03ce-915a-45ee-8ddd-824ce006a5a5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:56:55.556033 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-668d03ce-915a-45ee-8ddd-824ce006a5a5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:55.558150 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-668d03ce-915a-45ee-8ddd-824ce006a5a5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:55.559451 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-668d03ce-915a-45ee-8ddd-824ce006a5a5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:55.561635 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-668d03ce-915a-45ee-8ddd-824ce006a5a5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:55.563679 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-668d03ce-915a-45ee-8ddd-824ce006a5a5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:55.566530 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-668d03ce-915a-45ee-8ddd-824ce006a5a5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:55.620431 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-668d03ce-915a-45ee-8ddd-824ce006a5a5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Getting quotas for project 42f88328efc24fa4b8e8e5023bd6d5a1. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:56:55.633303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-668d03ce-915a-45ee-8ddd-824ce006a5a5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Getting quotas for user 2965e80f1b6e4cf8b750a28de3129541 and project 42f88328efc24fa4b8e8e5023bd6d5a1. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:56:55.682359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-668d03ce-915a-45ee-8ddd-824ce006a5a5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:56:55.690714 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-668d03ce-915a-45ee-8ddd-824ce006a5a5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:56:55.750938 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-19f31f42-08ea-4812-af20-51647ad744f3 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:55.768410 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-19f31f42-08ea-4812-af20-51647ad744f3 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0" status: 200 len: 1323 microversion: 2.1 time: 0.404369 Aug 04 16:56:55.771306 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 373/709] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:55 2022] GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0 => generated 1323 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:55.804586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-966a6611-2703-4a31-988c-cef1fe55e874 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:55.805242 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-966a6611-2703-4a31-988c-cef1fe55e874 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: 687e42c7-8cf6-41a3-b16f-6cc104223f58] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:55.821353 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-668d03ce-915a-45ee-8ddd-824ce006a5a5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.560704 Aug 04 16:56:55.835224 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 337/710] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:56:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:56:55.840446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c50b4757-636c-42ac-8bc0-0317fd0b0fbd tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:55.841338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c50b4757-636c-42ac-8bc0-0317fd0b0fbd tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:55.849492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-966a6611-2703-4a31-988c-cef1fe55e874 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:55.850061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-966a6611-2703-4a31-988c-cef1fe55e874 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:55.857409 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-966a6611-2703-4a31-988c-cef1fe55e874 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:55.859220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-966a6611-2703-4a31-988c-cef1fe55e874 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:55.861229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-966a6611-2703-4a31-988c-cef1fe55e874 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:55.864493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-966a6611-2703-4a31-988c-cef1fe55e874 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:55.865420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c50b4757-636c-42ac-8bc0-0317fd0b0fbd tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:55.866135 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c50b4757-636c-42ac-8bc0-0317fd0b0fbd tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:55.866586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c50b4757-636c-42ac-8bc0-0317fd0b0fbd tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:55.867511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c50b4757-636c-42ac-8bc0-0317fd0b0fbd tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:55.868412 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c50b4757-636c-42ac-8bc0-0317fd0b0fbd tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:55.868987 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c50b4757-636c-42ac-8bc0-0317fd0b0fbd tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:56.187602 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-c50b4757-636c-42ac-8bc0-0317fd0b0fbd tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lazy-loading 'services' on Instance uuid 96d30c66-24c7-4b25-81cd-fb638035a1cb {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:56:56.203999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-966a6611-2703-4a31-988c-cef1fe55e874 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:56.218962 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-966a6611-2703-4a31-988c-cef1fe55e874 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58" status: 200 len: 1321 microversion: 2.1 time: 0.428725 Aug 04 16:56:56.230159 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 374/711] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:55 2022] GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58 => generated 1321 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:56.248551 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ac6eadc7-d3bd-4c52-9df0-309ba7a7f090 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-756773635", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:56.254525 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c50b4757-636c-42ac-8bc0-0317fd0b0fbd tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1929 microversion: 2.75 time: 0.417727 Aug 04 16:56:56.255141 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 338/712] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:55 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1929 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:56.361327 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-ac6eadc7-d3bd-4c52-9df0-309ba7a7f090 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] validate_networks() for None {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:56:56.383383 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bb414a01-a5cf-4488-88db-703b0054bb39 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:56.384209 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bb414a01-a5cf-4488-88db-703b0054bb39 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:56.391908 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb414a01-a5cf-4488-88db-703b0054bb39 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:56.392595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb414a01-a5cf-4488-88db-703b0054bb39 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:56.393391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb414a01-a5cf-4488-88db-703b0054bb39 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:56.394348 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb414a01-a5cf-4488-88db-703b0054bb39 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:56.394970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb414a01-a5cf-4488-88db-703b0054bb39 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:56.395557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb414a01-a5cf-4488-88db-703b0054bb39 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:57.886785 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bb414a01-a5cf-4488-88db-703b0054bb39 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:57.901403 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bb414a01-a5cf-4488-88db-703b0054bb39 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1476 microversion: 2.1 time: 1.521730 Aug 04 16:56:57.902232 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 339/713] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:56 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1476 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:56:57.937904 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dd6e01a2-d42f-4584-b209-bf9d45a5e075 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:57.942465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dd6e01a2-d42f-4584-b209-bf9d45a5e075 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: f2d3490d-12a5-453d-b698-80ca6550f0f0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:57.971142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd6e01a2-d42f-4584-b209-bf9d45a5e075 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:57.973823 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd6e01a2-d42f-4584-b209-bf9d45a5e075 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:57.974506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd6e01a2-d42f-4584-b209-bf9d45a5e075 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:57.978426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd6e01a2-d42f-4584-b209-bf9d45a5e075 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:57.979105 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd6e01a2-d42f-4584-b209-bf9d45a5e075 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:57.979743 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd6e01a2-d42f-4584-b209-bf9d45a5e075 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:58.043259 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:56:58.165310 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-ac6eadc7-d3bd-4c52-9df0-309ba7a7f090 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:56:58.166368 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-ac6eadc7-d3bd-4c52-9df0-309ba7a7f090 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:56:58.167006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-ac6eadc7-d3bd-4c52-9df0-309ba7a7f090 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:56:58.167579 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-ac6eadc7-d3bd-4c52-9df0-309ba7a7f090 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:56:58.168226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-ac6eadc7-d3bd-4c52-9df0-309ba7a7f090 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:56:58.187543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac6eadc7-d3bd-4c52-9df0-309ba7a7f090 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:58.188430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac6eadc7-d3bd-4c52-9df0-309ba7a7f090 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:58.189003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac6eadc7-d3bd-4c52-9df0-309ba7a7f090 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:58.192736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac6eadc7-d3bd-4c52-9df0-309ba7a7f090 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:58.193466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac6eadc7-d3bd-4c52-9df0-309ba7a7f090 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:58.194107 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac6eadc7-d3bd-4c52-9df0-309ba7a7f090 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:58.247495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-ac6eadc7-d3bd-4c52-9df0-309ba7a7f090 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Getting quotas for project 42f88328efc24fa4b8e8e5023bd6d5a1. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:56:58.274264 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-ac6eadc7-d3bd-4c52-9df0-309ba7a7f090 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Getting quotas for user 2965e80f1b6e4cf8b750a28de3129541 and project 42f88328efc24fa4b8e8e5023bd6d5a1. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:56:58.317852 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dd6e01a2-d42f-4584-b209-bf9d45a5e075 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:58.329608 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dd6e01a2-d42f-4584-b209-bf9d45a5e075 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0" status: 200 len: 1323 microversion: 2.1 time: 0.426113 Aug 04 16:56:58.331044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ac6eadc7-d3bd-4c52-9df0-309ba7a7f090 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:56:58.332840 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 340/714] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:57 2022] GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0 => generated 1323 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:58.336116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ac6eadc7-d3bd-4c52-9df0-309ba7a7f090 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 02856bd5-3936-4593-b70d-ddf3452f440d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:56:58.346575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b84ddbc1-d2cf-447e-a179-cd9d019bb4c4 req-1e5fede7-b631-49bc-ba67-b9cc88adef09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69d189f5-2ca5-4d3b-9a70-b6e27d6dda13", "name": "network-vif-deleted", "tag": "8294cc37-07d5-4724-a0a2-e13fb2658fa6"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:56:58.373070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b84ddbc1-d2cf-447e-a179-cd9d019bb4c4 req-1e5fede7-b631-49bc-ba67-b9cc88adef09 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:58.373944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b84ddbc1-d2cf-447e-a179-cd9d019bb4c4 req-1e5fede7-b631-49bc-ba67-b9cc88adef09 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:58.375037 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b84ddbc1-d2cf-447e-a179-cd9d019bb4c4 req-1e5fede7-b631-49bc-ba67-b9cc88adef09 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:58.397574 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b84ddbc1-d2cf-447e-a179-cd9d019bb4c4 req-1e5fede7-b631-49bc-ba67-b9cc88adef09 service nova] Creating event network-vif-deleted:8294cc37-07d5-4724-a0a2-e13fb2658fa6 for instance 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 on n-h2-851359-3 Aug 04 16:56:58.415752 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b84ddbc1-d2cf-447e-a179-cd9d019bb4c4 req-1e5fede7-b631-49bc-ba67-b9cc88adef09 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081473 Aug 04 16:56:58.419221 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 341/715] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:56:58.451160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cff088bb-7862-4007-a424-af0e85bb1876 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:58.451892 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cff088bb-7862-4007-a424-af0e85bb1876 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: 687e42c7-8cf6-41a3-b16f-6cc104223f58] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:58.472399 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ac6eadc7-d3bd-4c52-9df0-309ba7a7f090 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.239331 Aug 04 16:56:58.474293 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 375/716] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:56:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:56:58.489567 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-de93d22f-dc8e-486c-a5ae-abb925fc858f tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:58.489781 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cff088bb-7862-4007-a424-af0e85bb1876 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:58.490126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cff088bb-7862-4007-a424-af0e85bb1876 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:58.491102 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-de93d22f-dc8e-486c-a5ae-abb925fc858f tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:58.499466 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cff088bb-7862-4007-a424-af0e85bb1876 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:58.506927 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de93d22f-dc8e-486c-a5ae-abb925fc858f tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:58.509725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de93d22f-dc8e-486c-a5ae-abb925fc858f tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:58.509889 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cff088bb-7862-4007-a424-af0e85bb1876 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:58.510518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cff088bb-7862-4007-a424-af0e85bb1876 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:58.513407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cff088bb-7862-4007-a424-af0e85bb1876 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:58.513526 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de93d22f-dc8e-486c-a5ae-abb925fc858f tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:58.515217 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de93d22f-dc8e-486c-a5ae-abb925fc858f tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:58.516866 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de93d22f-dc8e-486c-a5ae-abb925fc858f tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:58.517401 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de93d22f-dc8e-486c-a5ae-abb925fc858f tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:58.963562 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-de93d22f-dc8e-486c-a5ae-abb925fc858f tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lazy-loading 'services' on Instance uuid 96d30c66-24c7-4b25-81cd-fb638035a1cb {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:56:59.013390 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-de93d22f-dc8e-486c-a5ae-abb925fc858f tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1929 microversion: 2.75 time: 0.537578 Aug 04 16:56:59.014009 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 376/717] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:56:58 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1929 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:56:59.052039 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-77e48207-fb52-4397-b6a6-fe6d4cceef6f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:59.052672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-77e48207-fb52-4397-b6a6-fe6d4cceef6f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 02856bd5-3936-4593-b70d-ddf3452f440d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:59.214069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-77e48207-fb52-4397-b6a6-fe6d4cceef6f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:59.236788 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-77e48207-fb52-4397-b6a6-fe6d4cceef6f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d" status: 200 len: 1213 microversion: 2.1 time: 0.203960 Aug 04 16:56:59.240058 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 377/718] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:59 2022] GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d => generated 1213 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:59.256666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b2c529fd-da0b-4dc3-a59f-977fd51711e7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:59.257730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b2c529fd-da0b-4dc3-a59f-977fd51711e7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:59.281067 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2c529fd-da0b-4dc3-a59f-977fd51711e7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:59.281917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2c529fd-da0b-4dc3-a59f-977fd51711e7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:59.282557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2c529fd-da0b-4dc3-a59f-977fd51711e7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:59.284676 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2c529fd-da0b-4dc3-a59f-977fd51711e7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:59.287224 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2c529fd-da0b-4dc3-a59f-977fd51711e7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:59.289783 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2c529fd-da0b-4dc3-a59f-977fd51711e7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:59.835275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cff088bb-7862-4007-a424-af0e85bb1876 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:56:59.870230 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cff088bb-7862-4007-a424-af0e85bb1876 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58" status: 200 len: 1321 microversion: 2.1 time: 1.449248 Aug 04 16:56:59.884684 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 342/719] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:58 2022] GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58 => generated 1321 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:56:59.884684 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ad5a73c5-4cef-4ae4-a57f-13d3bc388864 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:56:59.884684 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ad5a73c5-4cef-4ae4-a57f-13d3bc388864 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: f2d3490d-12a5-453d-b698-80ca6550f0f0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:56:59.892184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad5a73c5-4cef-4ae4-a57f-13d3bc388864 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:59.892936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad5a73c5-4cef-4ae4-a57f-13d3bc388864 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:59.896062 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad5a73c5-4cef-4ae4-a57f-13d3bc388864 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:56:59.898476 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad5a73c5-4cef-4ae4-a57f-13d3bc388864 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:56:59.900021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad5a73c5-4cef-4ae4-a57f-13d3bc388864 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:56:59.900731 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad5a73c5-4cef-4ae4-a57f-13d3bc388864 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:00.055541 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b2c529fd-da0b-4dc3-a59f-977fd51711e7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:00.064870 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b2c529fd-da0b-4dc3-a59f-977fd51711e7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1476 microversion: 2.1 time: 0.823568 Aug 04 16:57:00.065768 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 378/720] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:59 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1476 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:00.070609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6e8fcd53-d628-43eb-922c-4ec244600aab tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:00.072123 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6e8fcd53-d628-43eb-922c-4ec244600aab tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:00.086468 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6e8fcd53-d628-43eb-922c-4ec244600aab tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:00.087459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6e8fcd53-d628-43eb-922c-4ec244600aab tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:00.088237 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6e8fcd53-d628-43eb-922c-4ec244600aab tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:00.089234 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6e8fcd53-d628-43eb-922c-4ec244600aab tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:00.089933 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6e8fcd53-d628-43eb-922c-4ec244600aab tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:00.090635 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6e8fcd53-d628-43eb-922c-4ec244600aab tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:00.300175 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ad5a73c5-4cef-4ae4-a57f-13d3bc388864 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:00.340944 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-6e8fcd53-d628-43eb-922c-4ec244600aab tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lazy-loading 'services' on Instance uuid 96d30c66-24c7-4b25-81cd-fb638035a1cb {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:57:00.343498 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ad5a73c5-4cef-4ae4-a57f-13d3bc388864 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0" status: 200 len: 1390 microversion: 2.1 time: 0.469787 Aug 04 16:57:00.344107 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 343/721] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:56:59 2022] GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0 => generated 1390 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:00.366658 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-56bcd766-199c-4c02-86b1-bf4c3e5ff4a0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:00.370370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-56bcd766-199c-4c02-86b1-bf4c3e5ff4a0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 02856bd5-3936-4593-b70d-ddf3452f440d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:00.381947 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6e8fcd53-d628-43eb-922c-4ec244600aab tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1929 microversion: 2.75 time: 0.314538 Aug 04 16:57:00.392850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56bcd766-199c-4c02-86b1-bf4c3e5ff4a0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:00.397305 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 379/722] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:00 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1929 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:00.399231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56bcd766-199c-4c02-86b1-bf4c3e5ff4a0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:00.404206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56bcd766-199c-4c02-86b1-bf4c3e5ff4a0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:00.406241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56bcd766-199c-4c02-86b1-bf4c3e5ff4a0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:00.410138 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56bcd766-199c-4c02-86b1-bf4c3e5ff4a0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:00.411114 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56bcd766-199c-4c02-86b1-bf4c3e5ff4a0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:00.724857 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-56bcd766-199c-4c02-86b1-bf4c3e5ff4a0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:00.736807 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-56bcd766-199c-4c02-86b1-bf4c3e5ff4a0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d" status: 200 len: 1273 microversion: 2.1 time: 0.391566 Aug 04 16:57:00.737812 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 344/723] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:00 2022] GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d => generated 1273 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:00.894350 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-66e9d558-abcf-4b56-b294-0892ee1edae7 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:00.895079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-66e9d558-abcf-4b56-b294-0892ee1edae7 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: 687e42c7-8cf6-41a3-b16f-6cc104223f58] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:00.915514 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66e9d558-abcf-4b56-b294-0892ee1edae7 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:00.917819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66e9d558-abcf-4b56-b294-0892ee1edae7 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:00.919322 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66e9d558-abcf-4b56-b294-0892ee1edae7 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:00.925262 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66e9d558-abcf-4b56-b294-0892ee1edae7 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:00.927310 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66e9d558-abcf-4b56-b294-0892ee1edae7 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:00.928894 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66e9d558-abcf-4b56-b294-0892ee1edae7 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:01.000389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-9362f461-0373-469d-9650-ed6a3d9f51ed req-46439536-6baf-4d1e-945c-1c601b0b5d8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "687e42c7-8cf6-41a3-b16f-6cc104223f58", "tag": "ba2d2ad8-c9ad-4f5d-99d3-5361b3a0665e"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:01.027981 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9362f461-0373-469d-9650-ed6a3d9f51ed req-46439536-6baf-4d1e-945c-1c601b0b5d8e service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:01.028964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9362f461-0373-469d-9650-ed6a3d9f51ed req-46439536-6baf-4d1e-945c-1c601b0b5d8e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:01.032159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9362f461-0373-469d-9650-ed6a3d9f51ed req-46439536-6baf-4d1e-945c-1c601b0b5d8e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:01.063889 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-9362f461-0373-469d-9650-ed6a3d9f51ed req-46439536-6baf-4d1e-945c-1c601b0b5d8e service nova] Creating event network-changed:ba2d2ad8-c9ad-4f5d-99d3-5361b3a0665e for instance 687e42c7-8cf6-41a3-b16f-6cc104223f58 on n-h1-851359-3 Aug 04 16:57:01.078428 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-9362f461-0373-469d-9650-ed6a3d9f51ed req-46439536-6baf-4d1e-945c-1c601b0b5d8e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081862 Aug 04 16:57:01.079413 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 345/724] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:57:01.097126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-28323fa0-65ed-46fe-acdb-6ec762df5558 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:01.101705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-28323fa0-65ed-46fe-acdb-6ec762df5558 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:01.109719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28323fa0-65ed-46fe-acdb-6ec762df5558 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:01.110178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28323fa0-65ed-46fe-acdb-6ec762df5558 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:01.110633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28323fa0-65ed-46fe-acdb-6ec762df5558 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:01.120159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28323fa0-65ed-46fe-acdb-6ec762df5558 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:01.120931 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28323fa0-65ed-46fe-acdb-6ec762df5558 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:01.121748 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28323fa0-65ed-46fe-acdb-6ec762df5558 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:01.741483 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-66e9d558-abcf-4b56-b294-0892ee1edae7 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:01.796857 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-66e9d558-abcf-4b56-b294-0892ee1edae7 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58" status: 200 len: 1321 microversion: 2.1 time: 0.907780 Aug 04 16:57:01.809426 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 380/725] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:00 2022] GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58 => generated 1321 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:01.809426 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b3b95072-e58b-4520-b013-a7649f7f6d34 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:01.809833 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b3b95072-e58b-4520-b013-a7649f7f6d34 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: f2d3490d-12a5-453d-b698-80ca6550f0f0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:01.819586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3b95072-e58b-4520-b013-a7649f7f6d34 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:01.820097 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3b95072-e58b-4520-b013-a7649f7f6d34 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:01.820538 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3b95072-e58b-4520-b013-a7649f7f6d34 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:01.821249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3b95072-e58b-4520-b013-a7649f7f6d34 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:01.821697 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3b95072-e58b-4520-b013-a7649f7f6d34 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:01.833616 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3b95072-e58b-4520-b013-a7649f7f6d34 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:02.244355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-28323fa0-65ed-46fe-acdb-6ec762df5558 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:02.259068 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-28323fa0-65ed-46fe-acdb-6ec762df5558 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1476 microversion: 2.1 time: 1.176863 Aug 04 16:57:02.259910 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 346/726] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:01 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1476 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:02.264937 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-df47688a-8e3b-44b6-956b-237df06a9ca8 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:02.265490 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-df47688a-8e3b-44b6-956b-237df06a9ca8 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:02.275915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df47688a-8e3b-44b6-956b-237df06a9ca8 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:02.276428 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df47688a-8e3b-44b6-956b-237df06a9ca8 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:02.276879 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df47688a-8e3b-44b6-956b-237df06a9ca8 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:02.277612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df47688a-8e3b-44b6-956b-237df06a9ca8 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:02.278111 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df47688a-8e3b-44b6-956b-237df06a9ca8 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:02.278734 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df47688a-8e3b-44b6-956b-237df06a9ca8 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:02.437180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b3b95072-e58b-4520-b013-a7649f7f6d34 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:02.450823 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b3b95072-e58b-4520-b013-a7649f7f6d34 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0" status: 200 len: 1390 microversion: 2.1 time: 0.651906 Aug 04 16:57:02.451416 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 381/727] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:01 2022] GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0 => generated 1390 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:02.460411 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-df47688a-8e3b-44b6-956b-237df06a9ca8 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lazy-loading 'services' on Instance uuid 96d30c66-24c7-4b25-81cd-fb638035a1cb {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:57:02.461430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cd38eae4-0978-4f9f-884f-c3f90e7f6ff9 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:02.462085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cd38eae4-0978-4f9f-884f-c3f90e7f6ff9 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 02856bd5-3936-4593-b70d-ddf3452f440d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:02.484059 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-df47688a-8e3b-44b6-956b-237df06a9ca8 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1929 microversion: 2.75 time: 0.222918 Aug 04 16:57:02.485402 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 347/728] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:02 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1929 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:02.507127 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd38eae4-0978-4f9f-884f-c3f90e7f6ff9 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:02.508765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd38eae4-0978-4f9f-884f-c3f90e7f6ff9 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:02.509648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd38eae4-0978-4f9f-884f-c3f90e7f6ff9 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:02.510596 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd38eae4-0978-4f9f-884f-c3f90e7f6ff9 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:02.511218 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd38eae4-0978-4f9f-884f-c3f90e7f6ff9 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:02.511844 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd38eae4-0978-4f9f-884f-c3f90e7f6ff9 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:02.652527 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ee557dd1-0cef-41a5-a8c5-42d540dcd3a0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-609730239", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "a29c24ff-4240-47ba-a31d-3bb350182580"}], "security_groups": [{"name": "tempest-securitygroup--138392614"}], "key_name": "tempest-keypair-1843048410", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:02.845214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cd38eae4-0978-4f9f-884f-c3f90e7f6ff9 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:02.857059 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cd38eae4-0978-4f9f-884f-c3f90e7f6ff9 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d" status: 200 len: 1271 microversion: 2.1 time: 0.404481 Aug 04 16:57:02.857939 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 382/729] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:02 2022] GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d => generated 1271 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:02.875192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ea1d096d-0093-4f50-89b6-28498b38b5ec tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:02.876089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ea1d096d-0093-4f50-89b6-28498b38b5ec tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: 687e42c7-8cf6-41a3-b16f-6cc104223f58] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:02.897135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea1d096d-0093-4f50-89b6-28498b38b5ec tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:02.898294 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea1d096d-0093-4f50-89b6-28498b38b5ec tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:02.900229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea1d096d-0093-4f50-89b6-28498b38b5ec tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:02.903548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea1d096d-0093-4f50-89b6-28498b38b5ec tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:02.906679 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea1d096d-0093-4f50-89b6-28498b38b5ec tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:02.907389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea1d096d-0093-4f50-89b6-28498b38b5ec tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:03.095673 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-ee557dd1-0cef-41a5-a8c5-42d540dcd3a0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] validate_networks() for [('a29c24ff-4240-47ba-a31d-3bb350182580', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:57:03.573278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ea1d096d-0093-4f50-89b6-28498b38b5ec tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:03.587465 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:03.607048 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ea1d096d-0093-4f50-89b6-28498b38b5ec tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58" status: 200 len: 1321 microversion: 2.1 time: 0.747132 Aug 04 16:57:03.607646 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 383/730] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:02 2022] GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58 => generated 1321 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:03.612908 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-aedd65df-f028-4f35-acf9-0c7c1c962462 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:03.618043 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-aedd65df-f028-4f35-acf9-0c7c1c962462 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:03.634129 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aedd65df-f028-4f35-acf9-0c7c1c962462 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:03.638652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aedd65df-f028-4f35-acf9-0c7c1c962462 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:03.639459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aedd65df-f028-4f35-acf9-0c7c1c962462 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:03.640981 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aedd65df-f028-4f35-acf9-0c7c1c962462 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:03.641661 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aedd65df-f028-4f35-acf9-0c7c1c962462 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:03.642334 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aedd65df-f028-4f35-acf9-0c7c1c962462 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:04.092596 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-aedd65df-f028-4f35-acf9-0c7c1c962462 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:04.102582 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-aedd65df-f028-4f35-acf9-0c7c1c962462 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1476 microversion: 2.1 time: 0.493051 Aug 04 16:57:04.117773 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 384/731] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:03 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1476 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:04.126946 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c2ac491d-f707-4a7e-b17b-469f57b3ae33 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:04.127583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c2ac491d-f707-4a7e-b17b-469f57b3ae33 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: f2d3490d-12a5-453d-b698-80ca6550f0f0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:04.137450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2ac491d-f707-4a7e-b17b-469f57b3ae33 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:04.138439 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2ac491d-f707-4a7e-b17b-469f57b3ae33 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:04.139090 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2ac491d-f707-4a7e-b17b-469f57b3ae33 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:04.140087 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2ac491d-f707-4a7e-b17b-469f57b3ae33 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:04.140721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2ac491d-f707-4a7e-b17b-469f57b3ae33 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:04.141320 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2ac491d-f707-4a7e-b17b-469f57b3ae33 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:04.149945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-ee557dd1-0cef-41a5-a8c5-42d540dcd3a0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:57:04.150916 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-ee557dd1-0cef-41a5-a8c5-42d540dcd3a0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:57:04.152024 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-ee557dd1-0cef-41a5-a8c5-42d540dcd3a0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:57:04.152589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-ee557dd1-0cef-41a5-a8c5-42d540dcd3a0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:57:04.153218 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-ee557dd1-0cef-41a5-a8c5-42d540dcd3a0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:57:04.165922 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee557dd1-0cef-41a5-a8c5-42d540dcd3a0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:04.166718 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee557dd1-0cef-41a5-a8c5-42d540dcd3a0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:04.167567 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee557dd1-0cef-41a5-a8c5-42d540dcd3a0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:04.168473 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee557dd1-0cef-41a5-a8c5-42d540dcd3a0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:04.169088 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee557dd1-0cef-41a5-a8c5-42d540dcd3a0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:04.169660 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee557dd1-0cef-41a5-a8c5-42d540dcd3a0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:04.195569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-ee557dd1-0cef-41a5-a8c5-42d540dcd3a0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Getting quotas for project 792f078eb62f4820ba4166d421079491. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:57:04.201743 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-ee557dd1-0cef-41a5-a8c5-42d540dcd3a0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Getting quotas for user 81d93fe83a6542c89cbc86106671b15f and project 792f078eb62f4820ba4166d421079491. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:57:04.241926 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ee557dd1-0cef-41a5-a8c5-42d540dcd3a0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:57:04.245144 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ee557dd1-0cef-41a5-a8c5-42d540dcd3a0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:57:04.327833 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ee557dd1-0cef-41a5-a8c5-42d540dcd3a0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.678165 Aug 04 16:57:04.335286 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 348/732] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:57:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 1682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:57:04.339109 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-849fd204-c569-4c9a-a80f-36443e49c093 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:04.339741 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-849fd204-c569-4c9a-a80f-36443e49c093 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:04.344907 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c2ac491d-f707-4a7e-b17b-469f57b3ae33 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:04.352046 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-849fd204-c569-4c9a-a80f-36443e49c093 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:04.353089 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-849fd204-c569-4c9a-a80f-36443e49c093 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:04.353743 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-849fd204-c569-4c9a-a80f-36443e49c093 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:04.354654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-849fd204-c569-4c9a-a80f-36443e49c093 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:04.355435 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-849fd204-c569-4c9a-a80f-36443e49c093 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:04.356030 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c2ac491d-f707-4a7e-b17b-469f57b3ae33 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0" status: 200 len: 1390 microversion: 2.1 time: 0.233410 Aug 04 16:57:04.356192 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-849fd204-c569-4c9a-a80f-36443e49c093 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:04.362587 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 385/733] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:04 2022] GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0 => generated 1390 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:04.370448 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-732e07d6-159a-4f9d-855f-2dd0a819d79c req-62e6e517-a9df-4f8f-91d0-dea7b5b5d4b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2d3490d-12a5-453d-b698-80ca6550f0f0", "tag": "3e3d1de2-eec1-4af1-8d8a-6520bfe5cf96"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:04.386000 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-732e07d6-159a-4f9d-855f-2dd0a819d79c req-62e6e517-a9df-4f8f-91d0-dea7b5b5d4b5 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:04.394313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-732e07d6-159a-4f9d-855f-2dd0a819d79c req-62e6e517-a9df-4f8f-91d0-dea7b5b5d4b5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:04.394834 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-732e07d6-159a-4f9d-855f-2dd0a819d79c req-62e6e517-a9df-4f8f-91d0-dea7b5b5d4b5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:04.410214 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-732e07d6-159a-4f9d-855f-2dd0a819d79c req-62e6e517-a9df-4f8f-91d0-dea7b5b5d4b5 service nova] Creating event network-changed:3e3d1de2-eec1-4af1-8d8a-6520bfe5cf96 for instance f2d3490d-12a5-453d-b698-80ca6550f0f0 on n-h1-851359-3 Aug 04 16:57:04.419899 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-732e07d6-159a-4f9d-855f-2dd0a819d79c req-62e6e517-a9df-4f8f-91d0-dea7b5b5d4b5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052734 Aug 04 16:57:04.420534 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 386/734] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:04.427755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e8b40a1c-f889-4e71-8a8a-d5007758d05c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:04.428554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e8b40a1c-f889-4e71-8a8a-d5007758d05c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 02856bd5-3936-4593-b70d-ddf3452f440d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:04.435711 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8b40a1c-f889-4e71-8a8a-d5007758d05c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:04.436425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8b40a1c-f889-4e71-8a8a-d5007758d05c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:04.437043 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8b40a1c-f889-4e71-8a8a-d5007758d05c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:04.438486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8b40a1c-f889-4e71-8a8a-d5007758d05c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:04.439110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8b40a1c-f889-4e71-8a8a-d5007758d05c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:04.439696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8b40a1c-f889-4e71-8a8a-d5007758d05c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:04.486473 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-849fd204-c569-4c9a-a80f-36443e49c093 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lazy-loading 'services' on Instance uuid 96d30c66-24c7-4b25-81cd-fb638035a1cb {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:57:04.521946 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-849fd204-c569-4c9a-a80f-36443e49c093 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1929 microversion: 2.75 time: 0.183425 Aug 04 16:57:04.524281 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 349/735] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:04 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1929 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:04.530752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9b66e0c9-b747-4e8d-946f-adba48369cd5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:04.531467 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9b66e0c9-b747-4e8d-946f-adba48369cd5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:04.729151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9b66e0c9-b747-4e8d-946f-adba48369cd5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:04.738198 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9b66e0c9-b747-4e8d-946f-adba48369cd5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1234 microversion: 2.1 time: 0.212489 Aug 04 16:57:04.739523 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 350/736] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:04 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1234 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:04.746577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-adf75427-0f74-42d7-a688-071905d326ba tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:04.747512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-adf75427-0f74-42d7-a688-071905d326ba tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: 687e42c7-8cf6-41a3-b16f-6cc104223f58] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:04.754586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:04.756777 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adf75427-0f74-42d7-a688-071905d326ba tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:04.757609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adf75427-0f74-42d7-a688-071905d326ba tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:04.758445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adf75427-0f74-42d7-a688-071905d326ba tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:04.764121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adf75427-0f74-42d7-a688-071905d326ba tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:04.765020 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adf75427-0f74-42d7-a688-071905d326ba tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:04.766272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adf75427-0f74-42d7-a688-071905d326ba tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:05.069568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e8b40a1c-f889-4e71-8a8a-d5007758d05c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:05.080455 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e8b40a1c-f889-4e71-8a8a-d5007758d05c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d" status: 200 len: 1313 microversion: 2.1 time: 0.658122 Aug 04 16:57:05.081070 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 387/737] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:04 2022] GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d => generated 1313 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:05.125097 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2710981d-08d6-45b5-adb0-a1a3a0b40953 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:05.125760 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2710981d-08d6-45b5-adb0-a1a3a0b40953 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:05.137717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2710981d-08d6-45b5-adb0-a1a3a0b40953 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:05.138576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2710981d-08d6-45b5-adb0-a1a3a0b40953 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:05.139046 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2710981d-08d6-45b5-adb0-a1a3a0b40953 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:05.141579 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2710981d-08d6-45b5-adb0-a1a3a0b40953 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:05.148631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2710981d-08d6-45b5-adb0-a1a3a0b40953 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:05.149104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2710981d-08d6-45b5-adb0-a1a3a0b40953 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:05.379545 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-adf75427-0f74-42d7-a688-071905d326ba tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:05.389359 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-adf75427-0f74-42d7-a688-071905d326ba tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58" status: 200 len: 1321 microversion: 2.1 time: 0.647878 Aug 04 16:57:05.405932 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 351/738] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:04 2022] GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58 => generated 1321 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:05.416531 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b3a0b4d3-caf9-438f-8188-3085775695e5 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:05.417525 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b3a0b4d3-caf9-438f-8188-3085775695e5 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: f2d3490d-12a5-453d-b698-80ca6550f0f0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:05.426845 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3a0b4d3-caf9-438f-8188-3085775695e5 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:05.427633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3a0b4d3-caf9-438f-8188-3085775695e5 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:05.428317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3a0b4d3-caf9-438f-8188-3085775695e5 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:05.429207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3a0b4d3-caf9-438f-8188-3085775695e5 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:05.429827 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3a0b4d3-caf9-438f-8188-3085775695e5 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:05.430466 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3a0b4d3-caf9-438f-8188-3085775695e5 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:05.922866 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2710981d-08d6-45b5-adb0-a1a3a0b40953 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:05.931849 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2710981d-08d6-45b5-adb0-a1a3a0b40953 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1476 microversion: 2.1 time: 0.810730 Aug 04 16:57:05.933032 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 388/739] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:05 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1476 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:05.938981 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fd98d7ba-5c81-4841-bc57-4d21f4817efd tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:05.940205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fd98d7ba-5c81-4841-bc57-4d21f4817efd tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:05.948684 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd98d7ba-5c81-4841-bc57-4d21f4817efd tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:05.950136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd98d7ba-5c81-4841-bc57-4d21f4817efd tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:05.950826 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd98d7ba-5c81-4841-bc57-4d21f4817efd tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:05.951753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd98d7ba-5c81-4841-bc57-4d21f4817efd tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:05.952598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd98d7ba-5c81-4841-bc57-4d21f4817efd tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:05.953250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd98d7ba-5c81-4841-bc57-4d21f4817efd tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:06.153100 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b3a0b4d3-caf9-438f-8188-3085775695e5 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:06.171704 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b3a0b4d3-caf9-438f-8188-3085775695e5 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0" status: 200 len: 1390 microversion: 2.1 time: 0.762730 Aug 04 16:57:06.174302 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 352/740] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:05 2022] GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0 => generated 1390 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:06.201034 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f0fd4a64-90fd-4313-9fd2-6f00c247e1ce tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:06.201842 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f0fd4a64-90fd-4313-9fd2-6f00c247e1ce tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:06.221213 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0fd4a64-90fd-4313-9fd2-6f00c247e1ce tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:06.222882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0fd4a64-90fd-4313-9fd2-6f00c247e1ce tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:06.224850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0fd4a64-90fd-4313-9fd2-6f00c247e1ce tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:06.225726 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0fd4a64-90fd-4313-9fd2-6f00c247e1ce tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:06.228253 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0fd4a64-90fd-4313-9fd2-6f00c247e1ce tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:06.231734 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0fd4a64-90fd-4313-9fd2-6f00c247e1ce tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:06.403129 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-fd98d7ba-5c81-4841-bc57-4d21f4817efd tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lazy-loading 'services' on Instance uuid 96d30c66-24c7-4b25-81cd-fb638035a1cb {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:57:06.436556 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fd98d7ba-5c81-4841-bc57-4d21f4817efd tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1929 microversion: 2.75 time: 0.502083 Aug 04 16:57:06.450001 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 389/741] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:05 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1929 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:06.450001 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-a7479145-81ff-43b9-9aac-4c5fb8c8761d req-91d22e32-4a55-4de4-a055-c65fe3185185 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19c5ab52-7c2b-4d63-8628-43c75476e45c", "tag": "134ee327-dd36-4c6e-b53f-b97914e333e8"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:06.458686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f0fd4a64-90fd-4313-9fd2-6f00c247e1ce tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:06.459142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a7479145-81ff-43b9-9aac-4c5fb8c8761d req-91d22e32-4a55-4de4-a055-c65fe3185185 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:06.459142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a7479145-81ff-43b9-9aac-4c5fb8c8761d req-91d22e32-4a55-4de4-a055-c65fe3185185 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:06.459142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a7479145-81ff-43b9-9aac-4c5fb8c8761d req-91d22e32-4a55-4de4-a055-c65fe3185185 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:06.469841 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f0fd4a64-90fd-4313-9fd2-6f00c247e1ce tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1286 microversion: 2.1 time: 0.269049 Aug 04 16:57:06.482052 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 353/742] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:06 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1286 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:06.485649 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-a7479145-81ff-43b9-9aac-4c5fb8c8761d req-91d22e32-4a55-4de4-a055-c65fe3185185 service nova] Creating event network-changed:134ee327-dd36-4c6e-b53f-b97914e333e8 for instance 19c5ab52-7c2b-4d63-8628-43c75476e45c on n-h2-851359-3 Aug 04 16:57:06.486889 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d669d03e-554c-459d-bb86-06f87b7e6d47 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:06.487840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d669d03e-554c-459d-bb86-06f87b7e6d47 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 02856bd5-3936-4593-b70d-ddf3452f440d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:06.491063 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-a7479145-81ff-43b9-9aac-4c5fb8c8761d req-91d22e32-4a55-4de4-a055-c65fe3185185 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052304 Aug 04 16:57:06.491971 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 390/743] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:06.497303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0205307b-3989-4a97-928c-6d9ae2f5d94a tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:06.497883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d669d03e-554c-459d-bb86-06f87b7e6d47 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:06.498133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0205307b-3989-4a97-928c-6d9ae2f5d94a tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: 687e42c7-8cf6-41a3-b16f-6cc104223f58] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:06.500070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d669d03e-554c-459d-bb86-06f87b7e6d47 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:06.500727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d669d03e-554c-459d-bb86-06f87b7e6d47 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:06.501673 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d669d03e-554c-459d-bb86-06f87b7e6d47 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:06.502375 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d669d03e-554c-459d-bb86-06f87b7e6d47 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:06.503058 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d669d03e-554c-459d-bb86-06f87b7e6d47 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:06.505849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0205307b-3989-4a97-928c-6d9ae2f5d94a tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:06.506374 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0205307b-3989-4a97-928c-6d9ae2f5d94a tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:06.506813 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0205307b-3989-4a97-928c-6d9ae2f5d94a tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:06.507521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0205307b-3989-4a97-928c-6d9ae2f5d94a tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:06.507987 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0205307b-3989-4a97-928c-6d9ae2f5d94a tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:06.508403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0205307b-3989-4a97-928c-6d9ae2f5d94a tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:06.921777 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d669d03e-554c-459d-bb86-06f87b7e6d47 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:06.933458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0205307b-3989-4a97-928c-6d9ae2f5d94a tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:06.953603 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0205307b-3989-4a97-928c-6d9ae2f5d94a tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58" status: 200 len: 1321 microversion: 2.1 time: 0.460229 Aug 04 16:57:06.954485 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 391/744] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:06 2022] GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58 => generated 1321 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:06.963894 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3f93ab1c-06da-4697-8cab-f7798fe879b9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:06.964997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3f93ab1c-06da-4697-8cab-f7798fe879b9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:06.974108 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d669d03e-554c-459d-bb86-06f87b7e6d47 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d" status: 200 len: 1313 microversion: 2.1 time: 0.502187 Aug 04 16:57:06.976801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f93ab1c-06da-4697-8cab-f7798fe879b9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:06.977511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f93ab1c-06da-4697-8cab-f7798fe879b9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:06.977754 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 354/745] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:06 2022] GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d => generated 1313 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:06.978305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f93ab1c-06da-4697-8cab-f7798fe879b9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:06.984689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f93ab1c-06da-4697-8cab-f7798fe879b9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:06.985487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f93ab1c-06da-4697-8cab-f7798fe879b9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:06.986230 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f93ab1c-06da-4697-8cab-f7798fe879b9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:07.208277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f36935f5-a8db-4bee-ac4b-e8e469362adf tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:07.216529 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f36935f5-a8db-4bee-ac4b-e8e469362adf tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: f2d3490d-12a5-453d-b698-80ca6550f0f0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:07.232842 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f36935f5-a8db-4bee-ac4b-e8e469362adf tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:07.233642 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f36935f5-a8db-4bee-ac4b-e8e469362adf tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:07.234290 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f36935f5-a8db-4bee-ac4b-e8e469362adf tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:07.235244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f36935f5-a8db-4bee-ac4b-e8e469362adf tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:07.235869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f36935f5-a8db-4bee-ac4b-e8e469362adf tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:07.236458 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f36935f5-a8db-4bee-ac4b-e8e469362adf tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:07.447265 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3f93ab1c-06da-4697-8cab-f7798fe879b9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:07.458591 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3f93ab1c-06da-4697-8cab-f7798fe879b9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1476 microversion: 2.1 time: 0.498608 Aug 04 16:57:07.474069 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 392/746] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:06 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1476 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:07.521204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f36935f5-a8db-4bee-ac4b-e8e469362adf tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:07.532633 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f36935f5-a8db-4bee-ac4b-e8e469362adf tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0" status: 200 len: 1390 microversion: 2.1 time: 0.333149 Aug 04 16:57:07.552070 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 355/747] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:07 2022] GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0 => generated 1390 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:07.564726 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b317b480-b52c-4f12-94d4-7965c357d005 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:07.565585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b317b480-b52c-4f12-94d4-7965c357d005 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:07.587643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b317b480-b52c-4f12-94d4-7965c357d005 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:07.588372 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b317b480-b52c-4f12-94d4-7965c357d005 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:07.588973 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b317b480-b52c-4f12-94d4-7965c357d005 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:07.589965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b317b480-b52c-4f12-94d4-7965c357d005 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:07.590640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b317b480-b52c-4f12-94d4-7965c357d005 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:07.591244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b317b480-b52c-4f12-94d4-7965c357d005 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:07.714494 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-764b878d-b309-4d29-911e-073bf1a2ab6a tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Action: 'create', calling method: .version_select at 0x7f1e5bac5040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1717000695", "description": "tempest-description-454786762"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:07.786417 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-b317b480-b52c-4f12-94d4-7965c357d005 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lazy-loading 'services' on Instance uuid 96d30c66-24c7-4b25-81cd-fb638035a1cb {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:57:07.829512 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b317b480-b52c-4f12-94d4-7965c357d005 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1935 microversion: 2.75 time: 0.269258 Aug 04 16:57:07.830416 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 356/748] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:07 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1935 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:07.835533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-becb5d83-5ac8-4900-bc47-5884d9919459 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:07.837148 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-becb5d83-5ac8-4900-bc47-5884d9919459 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:07.861164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-becb5d83-5ac8-4900-bc47-5884d9919459 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:07.863108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-becb5d83-5ac8-4900-bc47-5884d9919459 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:07.869130 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-becb5d83-5ac8-4900-bc47-5884d9919459 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:07.870204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-becb5d83-5ac8-4900-bc47-5884d9919459 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:07.873257 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-becb5d83-5ac8-4900-bc47-5884d9919459 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:07.874477 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-becb5d83-5ac8-4900-bc47-5884d9919459 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:08.000249 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-becb5d83-5ac8-4900-bc47-5884d9919459 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:08.015183 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-becb5d83-5ac8-4900-bc47-5884d9919459 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1292 microversion: 2.1 time: 0.180003 Aug 04 16:57:08.022025 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 357/749] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:07 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1292 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:08.028420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-57d18f93-7c15-4aaa-8bf2-08753ab2f2bc tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:08.029841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-57d18f93-7c15-4aaa-8bf2-08753ab2f2bc tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: 687e42c7-8cf6-41a3-b16f-6cc104223f58] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:08.046019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57d18f93-7c15-4aaa-8bf2-08753ab2f2bc tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:08.046713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57d18f93-7c15-4aaa-8bf2-08753ab2f2bc tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:08.047354 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57d18f93-7c15-4aaa-8bf2-08753ab2f2bc tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:08.048259 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57d18f93-7c15-4aaa-8bf2-08753ab2f2bc tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:08.048880 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57d18f93-7c15-4aaa-8bf2-08753ab2f2bc tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:08.049482 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57d18f93-7c15-4aaa-8bf2-08753ab2f2bc tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:08.227676 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=8 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:08.331641 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-764b878d-b309-4d29-911e-073bf1a2ab6a tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.869477 Aug 04 16:57:08.333135 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 393/750] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Aug 4 16:57:07 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:08.337911 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b94b1614-ef15-4c68-be82-70408eba1224 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:08.338582 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b94b1614-ef15-4c68-be82-70408eba1224 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 02856bd5-3936-4593-b70d-ddf3452f440d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:08.355491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b94b1614-ef15-4c68-be82-70408eba1224 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:08.356139 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b94b1614-ef15-4c68-be82-70408eba1224 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:08.363300 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b94b1614-ef15-4c68-be82-70408eba1224 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:08.364867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b94b1614-ef15-4c68-be82-70408eba1224 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:08.365373 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b94b1614-ef15-4c68-be82-70408eba1224 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:08.365826 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b94b1614-ef15-4c68-be82-70408eba1224 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:08.442906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-57d18f93-7c15-4aaa-8bf2-08753ab2f2bc tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:08.462780 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-57d18f93-7c15-4aaa-8bf2-08753ab2f2bc tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58" status: 200 len: 1321 microversion: 2.1 time: 0.441964 Aug 04 16:57:08.463525 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 358/751] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:08 2022] GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58 => generated 1321 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:08.471083 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-62a2c031-8737-412c-920b-4ffa17778761 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Action: 'create', calling method: .version_select at 0x7f1e5bc0a8b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-154609973", "description": "tempest-description-1215584941"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:08.929491 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-62a2c031-8737-412c-920b-4ffa17778761 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.462300 Aug 04 16:57:08.930162 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 359/752] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Aug 4 16:57:08 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:08.962051 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a9565c36-74a3-4eaa-93f5-b4dd7aaa9c25 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:08.965397 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a9565c36-74a3-4eaa-93f5-b4dd7aaa9c25 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:08.985428 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9565c36-74a3-4eaa-93f5-b4dd7aaa9c25 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:08.993633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9565c36-74a3-4eaa-93f5-b4dd7aaa9c25 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:08.994165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9565c36-74a3-4eaa-93f5-b4dd7aaa9c25 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:08.996719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9565c36-74a3-4eaa-93f5-b4dd7aaa9c25 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:08.997214 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9565c36-74a3-4eaa-93f5-b4dd7aaa9c25 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:08.997654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9565c36-74a3-4eaa-93f5-b4dd7aaa9c25 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:09.015963 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:09.016508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b94b1614-ef15-4c68-be82-70408eba1224 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:09.026961 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b94b1614-ef15-4c68-be82-70408eba1224 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d" status: 200 len: 1313 microversion: 2.1 time: 0.692596 Aug 04 16:57:09.042846 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 394/753] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:08 2022] GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d => generated 1313 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:09.051052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0ad03970-5b7f-4be7-b03d-d59cac734f48 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:09.052038 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0ad03970-5b7f-4be7-b03d-d59cac734f48 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: f2d3490d-12a5-453d-b698-80ca6550f0f0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:09.067592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ad03970-5b7f-4be7-b03d-d59cac734f48 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:09.068705 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ad03970-5b7f-4be7-b03d-d59cac734f48 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:09.070097 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ad03970-5b7f-4be7-b03d-d59cac734f48 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:09.072281 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ad03970-5b7f-4be7-b03d-d59cac734f48 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:09.073566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ad03970-5b7f-4be7-b03d-d59cac734f48 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:09.074790 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ad03970-5b7f-4be7-b03d-d59cac734f48 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:09.226851 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=48 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:09.418413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a9565c36-74a3-4eaa-93f5-b4dd7aaa9c25 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:09.443943 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a9565c36-74a3-4eaa-93f5-b4dd7aaa9c25 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1476 microversion: 2.1 time: 0.496895 Aug 04 16:57:09.446276 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 360/754] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:08 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1476 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:09.452384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0ad03970-5b7f-4be7-b03d-d59cac734f48 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:09.454103 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b902a496-3fb1-4575-b067-1b50c98fd637 req-2cc8d9f6-38f1-431c-ae8d-b8b3da301a3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02856bd5-3936-4593-b70d-ddf3452f440d", "tag": "2354b854-6575-48f2-a27c-ae89d11c285d"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:09.464063 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0ad03970-5b7f-4be7-b03d-d59cac734f48 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0" status: 200 len: 1390 microversion: 2.1 time: 0.419626 Aug 04 16:57:09.479650 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b902a496-3fb1-4575-b067-1b50c98fd637 req-2cc8d9f6-38f1-431c-ae8d-b8b3da301a3b service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:09.479882 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 395/755] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:09 2022] GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0 => generated 1390 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:09.480646 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b902a496-3fb1-4575-b067-1b50c98fd637 req-2cc8d9f6-38f1-431c-ae8d-b8b3da301a3b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:09.481525 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b902a496-3fb1-4575-b067-1b50c98fd637 req-2cc8d9f6-38f1-431c-ae8d-b8b3da301a3b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:09.486767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-80d2baa5-60ee-412e-8f5c-db2d1c2a291a req-58f42eef-6873-4432-a229-26c1c2eefde6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "687e42c7-8cf6-41a3-b16f-6cc104223f58", "name": "network-vif-plugged", "status": "completed", "tag": "ba2d2ad8-c9ad-4f5d-99d3-5361b3a0665e"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:09.495769 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b902a496-3fb1-4575-b067-1b50c98fd637 req-2cc8d9f6-38f1-431c-ae8d-b8b3da301a3b service nova] Creating event network-changed:2354b854-6575-48f2-a27c-ae89d11c285d for instance 02856bd5-3936-4593-b70d-ddf3452f440d on n-h1-851359-3 Aug 04 16:57:09.501586 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b902a496-3fb1-4575-b067-1b50c98fd637 req-2cc8d9f6-38f1-431c-ae8d-b8b3da301a3b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053829 Aug 04 16:57:09.502902 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 361/756] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:09.508795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-49c2c224-10b7-4eeb-a6c4-5cd7ac398265 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:09.510944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-49c2c224-10b7-4eeb-a6c4-5cd7ac398265 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:09.519317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49c2c224-10b7-4eeb-a6c4-5cd7ac398265 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:09.520751 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49c2c224-10b7-4eeb-a6c4-5cd7ac398265 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:09.521526 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49c2c224-10b7-4eeb-a6c4-5cd7ac398265 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:09.521858 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-80d2baa5-60ee-412e-8f5c-db2d1c2a291a req-58f42eef-6873-4432-a229-26c1c2eefde6 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:09.522795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49c2c224-10b7-4eeb-a6c4-5cd7ac398265 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:09.523463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49c2c224-10b7-4eeb-a6c4-5cd7ac398265 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:09.524087 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49c2c224-10b7-4eeb-a6c4-5cd7ac398265 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:09.529998 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-80d2baa5-60ee-412e-8f5c-db2d1c2a291a req-58f42eef-6873-4432-a229-26c1c2eefde6 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:09.530459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-80d2baa5-60ee-412e-8f5c-db2d1c2a291a req-58f42eef-6873-4432-a229-26c1c2eefde6 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:09.557207 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-80d2baa5-60ee-412e-8f5c-db2d1c2a291a req-58f42eef-6873-4432-a229-26c1c2eefde6 service nova] Creating event network-vif-plugged:ba2d2ad8-c9ad-4f5d-99d3-5361b3a0665e for instance 687e42c7-8cf6-41a3-b16f-6cc104223f58 on n-h1-851359-3 Aug 04 16:57:09.569262 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-80d2baa5-60ee-412e-8f5c-db2d1c2a291a req-58f42eef-6873-4432-a229-26c1c2eefde6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088061 Aug 04 16:57:09.583836 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 396/757] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:09.600074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7c54018b-6ef5-49f3-bb1f-4e5dd7773e51 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1474220807", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "52a50ebb-1421-4698-9ecd-a71892d051d8"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:09.703306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-7c54018b-6ef5-49f3-bb1f-4e5dd7773e51 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] validate_networks() for [('52a50ebb-1421-4698-9ecd-a71892d051d8', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:57:10.023188 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-49c2c224-10b7-4eeb-a6c4-5cd7ac398265 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lazy-loading 'services' on Instance uuid 96d30c66-24c7-4b25-81cd-fb638035a1cb {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:57:10.099466 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-49c2c224-10b7-4eeb-a6c4-5cd7ac398265 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1935 microversion: 2.75 time: 0.594983 Aug 04 16:57:10.100082 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 362/758] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:09 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1935 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:10.127424 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3804bdae-069f-41c1-bdab-94369cb4bbd0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:10.128316 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3804bdae-069f-41c1-bdab-94369cb4bbd0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:10.136072 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3804bdae-069f-41c1-bdab-94369cb4bbd0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:10.136833 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3804bdae-069f-41c1-bdab-94369cb4bbd0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:10.137440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3804bdae-069f-41c1-bdab-94369cb4bbd0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:10.138363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3804bdae-069f-41c1-bdab-94369cb4bbd0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:10.139049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3804bdae-069f-41c1-bdab-94369cb4bbd0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:10.140314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3804bdae-069f-41c1-bdab-94369cb4bbd0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:10.630429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3804bdae-069f-41c1-bdab-94369cb4bbd0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:10.649568 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3804bdae-069f-41c1-bdab-94369cb4bbd0 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1359 microversion: 2.1 time: 0.534147 Aug 04 16:57:10.662598 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 363/759] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:10 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1359 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:10.671333 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a173c4e0-c437-4757-8967-ae68f030481e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:10.673759 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a173c4e0-c437-4757-8967-ae68f030481e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: 687e42c7-8cf6-41a3-b16f-6cc104223f58] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:10.694924 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a173c4e0-c437-4757-8967-ae68f030481e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:10.695464 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a173c4e0-c437-4757-8967-ae68f030481e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:10.696162 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a173c4e0-c437-4757-8967-ae68f030481e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:10.697117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a173c4e0-c437-4757-8967-ae68f030481e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:10.697830 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a173c4e0-c437-4757-8967-ae68f030481e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:10.701148 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a173c4e0-c437-4757-8967-ae68f030481e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:11.399579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a173c4e0-c437-4757-8967-ae68f030481e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:11.410346 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a173c4e0-c437-4757-8967-ae68f030481e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58" status: 200 len: 1321 microversion: 2.1 time: 0.745751 Aug 04 16:57:11.412149 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 364/760] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:10 2022] GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58 => generated 1321 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:11.421564 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8745c256-ed05-486e-9447-15c6783f4246 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:11.422615 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8745c256-ed05-486e-9447-15c6783f4246 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 02856bd5-3936-4593-b70d-ddf3452f440d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:11.436799 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8745c256-ed05-486e-9447-15c6783f4246 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:11.437583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8745c256-ed05-486e-9447-15c6783f4246 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:11.438231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8745c256-ed05-486e-9447-15c6783f4246 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:11.439886 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8745c256-ed05-486e-9447-15c6783f4246 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:11.440523 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8745c256-ed05-486e-9447-15c6783f4246 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:11.441117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8745c256-ed05-486e-9447-15c6783f4246 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:11.707577 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-7c54018b-6ef5-49f3-bb1f-4e5dd7773e51 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:57:11.708746 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-7c54018b-6ef5-49f3-bb1f-4e5dd7773e51 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:57:11.709420 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-7c54018b-6ef5-49f3-bb1f-4e5dd7773e51 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:57:11.712995 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-7c54018b-6ef5-49f3-bb1f-4e5dd7773e51 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:57:11.713732 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-7c54018b-6ef5-49f3-bb1f-4e5dd7773e51 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:57:11.734283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c54018b-6ef5-49f3-bb1f-4e5dd7773e51 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:11.735623 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c54018b-6ef5-49f3-bb1f-4e5dd7773e51 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:11.736082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c54018b-6ef5-49f3-bb1f-4e5dd7773e51 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:11.742841 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c54018b-6ef5-49f3-bb1f-4e5dd7773e51 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:11.743464 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c54018b-6ef5-49f3-bb1f-4e5dd7773e51 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:11.744104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c54018b-6ef5-49f3-bb1f-4e5dd7773e51 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:11.783731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-7c54018b-6ef5-49f3-bb1f-4e5dd7773e51 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Getting quotas for project 985c6a3e9f43418bb14d9d3fbf8df8d4. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:57:11.800373 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-7c54018b-6ef5-49f3-bb1f-4e5dd7773e51 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Getting quotas for user f6232496fbe3458e8a3fde3fdabe9d05 and project 985c6a3e9f43418bb14d9d3fbf8df8d4. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:57:11.819975 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7c54018b-6ef5-49f3-bb1f-4e5dd7773e51 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:57:11.824079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7c54018b-6ef5-49f3-bb1f-4e5dd7773e51 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:57:11.845181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8745c256-ed05-486e-9447-15c6783f4246 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:11.854637 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8745c256-ed05-486e-9447-15c6783f4246 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d" status: 200 len: 1313 microversion: 2.1 time: 0.440386 Aug 04 16:57:11.855955 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 365/761] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:11 2022] GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d => generated 1313 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:11.864741 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b23abbcd-9492-472e-a5ac-fd9fd8025d84 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:11.865833 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b23abbcd-9492-472e-a5ac-fd9fd8025d84 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:11.873038 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b23abbcd-9492-472e-a5ac-fd9fd8025d84 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:11.874565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b23abbcd-9492-472e-a5ac-fd9fd8025d84 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:11.875252 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b23abbcd-9492-472e-a5ac-fd9fd8025d84 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:11.876545 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b23abbcd-9492-472e-a5ac-fd9fd8025d84 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:11.877292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b23abbcd-9492-472e-a5ac-fd9fd8025d84 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:11.878209 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b23abbcd-9492-472e-a5ac-fd9fd8025d84 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:11.932922 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7c54018b-6ef5-49f3-bb1f-4e5dd7773e51 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.347164 Aug 04 16:57:11.933578 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 397/762] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:57:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2349 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:57:11.949016 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e01c9004-ccd2-44c5-91a9-e66fdd4ae863 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:11.950067 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e01c9004-ccd2-44c5-91a9-e66fdd4ae863 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: f2d3490d-12a5-453d-b698-80ca6550f0f0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:11.968650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e01c9004-ccd2-44c5-91a9-e66fdd4ae863 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:11.969237 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e01c9004-ccd2-44c5-91a9-e66fdd4ae863 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:11.969792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e01c9004-ccd2-44c5-91a9-e66fdd4ae863 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:11.970634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e01c9004-ccd2-44c5-91a9-e66fdd4ae863 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:11.971179 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e01c9004-ccd2-44c5-91a9-e66fdd4ae863 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:11.971685 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e01c9004-ccd2-44c5-91a9-e66fdd4ae863 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:12.393175 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b23abbcd-9492-472e-a5ac-fd9fd8025d84 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:12.403875 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b23abbcd-9492-472e-a5ac-fd9fd8025d84 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1476 microversion: 2.1 time: 0.543703 Aug 04 16:57:12.404942 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 366/763] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:11 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1476 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:12.411918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-981ebd5a-3027-4c51-8134-0c871c208461 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:12.412699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-981ebd5a-3027-4c51-8134-0c871c208461 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:12.434826 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-981ebd5a-3027-4c51-8134-0c871c208461 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:12.435267 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-981ebd5a-3027-4c51-8134-0c871c208461 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:12.435714 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-981ebd5a-3027-4c51-8134-0c871c208461 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:12.441087 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-981ebd5a-3027-4c51-8134-0c871c208461 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:12.441595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-981ebd5a-3027-4c51-8134-0c871c208461 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:12.442139 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-981ebd5a-3027-4c51-8134-0c871c208461 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:12.500934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e01c9004-ccd2-44c5-91a9-e66fdd4ae863 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:12.522375 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e01c9004-ccd2-44c5-91a9-e66fdd4ae863 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0" status: 200 len: 1390 microversion: 2.1 time: 0.577034 Aug 04 16:57:12.523853 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 398/764] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:11 2022] GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0 => generated 1390 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:12.538431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f3edd9cc-65e2-4e68-98e2-1052d570c666 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:12.541523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f3edd9cc-65e2-4e68-98e2-1052d570c666 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:12.561474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f3edd9cc-65e2-4e68-98e2-1052d570c666 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:12.563620 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f3edd9cc-65e2-4e68-98e2-1052d570c666 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:12.564571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f3edd9cc-65e2-4e68-98e2-1052d570c666 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:12.565700 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f3edd9cc-65e2-4e68-98e2-1052d570c666 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:12.566651 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f3edd9cc-65e2-4e68-98e2-1052d570c666 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:12.567397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f3edd9cc-65e2-4e68-98e2-1052d570c666 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:12.730904 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-981ebd5a-3027-4c51-8134-0c871c208461 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lazy-loading 'services' on Instance uuid 96d30c66-24c7-4b25-81cd-fb638035a1cb {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:57:12.783923 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-981ebd5a-3027-4c51-8134-0c871c208461 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1935 microversion: 2.75 time: 0.377799 Aug 04 16:57:12.784828 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 367/765] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:12 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1935 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:12.793035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9af40348-c4c6-4472-9e5d-6e0a83543454 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:12.793931 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9af40348-c4c6-4472-9e5d-6e0a83543454 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:12.803308 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9af40348-c4c6-4472-9e5d-6e0a83543454 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:12.804113 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9af40348-c4c6-4472-9e5d-6e0a83543454 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:12.805297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9af40348-c4c6-4472-9e5d-6e0a83543454 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:12.806507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9af40348-c4c6-4472-9e5d-6e0a83543454 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:12.807220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9af40348-c4c6-4472-9e5d-6e0a83543454 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:12.808140 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9af40348-c4c6-4472-9e5d-6e0a83543454 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:12.965610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9af40348-c4c6-4472-9e5d-6e0a83543454 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:12.982643 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9af40348-c4c6-4472-9e5d-6e0a83543454 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83" status: 200 len: 1212 microversion: 2.1 time: 0.196279 Aug 04 16:57:12.998493 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 368/766] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:12 2022] GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 => generated 1212 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:13.054462 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f3edd9cc-65e2-4e68-98e2-1052d570c666 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:13.072698 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f3edd9cc-65e2-4e68-98e2-1052d570c666 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1359 microversion: 2.1 time: 0.547477 Aug 04 16:57:13.075621 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 399/767] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:12 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1359 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:13.091611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2136b556-fe1d-482f-ab23-03768ba73aef tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:13.092765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2136b556-fe1d-482f-ab23-03768ba73aef tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: 687e42c7-8cf6-41a3-b16f-6cc104223f58] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:13.095934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:13.105580 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2136b556-fe1d-482f-ab23-03768ba73aef tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:13.110871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2136b556-fe1d-482f-ab23-03768ba73aef tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:13.111542 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2136b556-fe1d-482f-ab23-03768ba73aef tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:13.112314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2136b556-fe1d-482f-ab23-03768ba73aef tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:13.112802 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2136b556-fe1d-482f-ab23-03768ba73aef tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:13.113244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2136b556-fe1d-482f-ab23-03768ba73aef tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:13.116017 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-50d68c77-0106-4edf-a333-d58ab4f0c1f6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-988632647", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "93c63081-713e-4b1c-8711-321b0490bce1"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:13.188216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-50d68c77-0106-4edf-a333-d58ab4f0c1f6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] validate_networks() for [('93c63081-713e-4b1c-8711-321b0490bce1', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:57:13.397625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2136b556-fe1d-482f-ab23-03768ba73aef tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:13.409078 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2136b556-fe1d-482f-ab23-03768ba73aef tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58" status: 200 len: 1469 microversion: 2.1 time: 0.330805 Aug 04 16:57:13.422247 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 400/768] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:13 2022] GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58 => generated 1469 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:13.426640 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-280faaa2-8b99-4e81-98df-876943b16e71 req-62e08229-ffbc-4f54-b0f2-1d0a8e308c6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e92cd73d-ce71-4f92-9db9-ae02c7febbcb", "tag": "46af0dd3-3cdc-4c63-9694-d9b2f7cf2afa"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:13.443616 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-280faaa2-8b99-4e81-98df-876943b16e71 req-62e08229-ffbc-4f54-b0f2-1d0a8e308c6e service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:13.444474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-280faaa2-8b99-4e81-98df-876943b16e71 req-62e08229-ffbc-4f54-b0f2-1d0a8e308c6e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:13.446345 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-280faaa2-8b99-4e81-98df-876943b16e71 req-62e08229-ffbc-4f54-b0f2-1d0a8e308c6e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:13.461390 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-280faaa2-8b99-4e81-98df-876943b16e71 req-62e08229-ffbc-4f54-b0f2-1d0a8e308c6e service nova] Creating event network-changed:46af0dd3-3cdc-4c63-9694-d9b2f7cf2afa for instance e92cd73d-ce71-4f92-9db9-ae02c7febbcb on n-h2-851359-3 Aug 04 16:57:13.467615 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-280faaa2-8b99-4e81-98df-876943b16e71 req-62e08229-ffbc-4f54-b0f2-1d0a8e308c6e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050680 Aug 04 16:57:13.468881 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 401/769] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:13.477018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d1b372b2-04c1-4860-a38c-80497fc35ab9 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:13.478670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d1b372b2-04c1-4860-a38c-80497fc35ab9 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 02856bd5-3936-4593-b70d-ddf3452f440d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:13.487227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1b372b2-04c1-4860-a38c-80497fc35ab9 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:13.488084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1b372b2-04c1-4860-a38c-80497fc35ab9 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:13.488737 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1b372b2-04c1-4860-a38c-80497fc35ab9 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:13.490366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1b372b2-04c1-4860-a38c-80497fc35ab9 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:13.491058 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1b372b2-04c1-4860-a38c-80497fc35ab9 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:13.491694 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1b372b2-04c1-4860-a38c-80497fc35ab9 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:14.116083 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d1b372b2-04c1-4860-a38c-80497fc35ab9 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:14.132105 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d1b372b2-04c1-4860-a38c-80497fc35ab9 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d" status: 200 len: 1313 microversion: 2.1 time: 0.661681 Aug 04 16:57:14.146270 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 402/770] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:13 2022] GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d => generated 1313 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:14.152033 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-7320e2df-a669-4c31-98bc-c34166ea5fe7 req-3485bff6-813f-44ea-85bd-3891b1d27a1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2d3490d-12a5-453d-b698-80ca6550f0f0", "name": "network-vif-plugged", "status": "completed", "tag": "3e3d1de2-eec1-4af1-8d8a-6520bfe5cf96"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:14.162684 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7320e2df-a669-4c31-98bc-c34166ea5fe7 req-3485bff6-813f-44ea-85bd-3891b1d27a1e service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:14.163391 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7320e2df-a669-4c31-98bc-c34166ea5fe7 req-3485bff6-813f-44ea-85bd-3891b1d27a1e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:14.163991 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7320e2df-a669-4c31-98bc-c34166ea5fe7 req-3485bff6-813f-44ea-85bd-3891b1d27a1e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:14.178504 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-7320e2df-a669-4c31-98bc-c34166ea5fe7 req-3485bff6-813f-44ea-85bd-3891b1d27a1e service nova] Creating event network-vif-plugged:3e3d1de2-eec1-4af1-8d8a-6520bfe5cf96 for instance f2d3490d-12a5-453d-b698-80ca6550f0f0 on n-h1-851359-3 Aug 04 16:57:14.181606 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:14.185133 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-7320e2df-a669-4c31-98bc-c34166ea5fe7 req-3485bff6-813f-44ea-85bd-3891b1d27a1e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037311 Aug 04 16:57:14.185741 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 403/771] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:14.191673 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4a4ab756-290b-4608-8ba1-4ce6c99fa182 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:14.192371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4a4ab756-290b-4608-8ba1-4ce6c99fa182 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:14.198522 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a4ab756-290b-4608-8ba1-4ce6c99fa182 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:14.199212 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a4ab756-290b-4608-8ba1-4ce6c99fa182 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:14.199792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a4ab756-290b-4608-8ba1-4ce6c99fa182 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:14.200654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a4ab756-290b-4608-8ba1-4ce6c99fa182 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:14.201257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a4ab756-290b-4608-8ba1-4ce6c99fa182 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:14.204628 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a4ab756-290b-4608-8ba1-4ce6c99fa182 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:14.366532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-50d68c77-0106-4edf-a333-d58ab4f0c1f6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:57:14.367053 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-50d68c77-0106-4edf-a333-d58ab4f0c1f6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:57:14.367525 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-50d68c77-0106-4edf-a333-d58ab4f0c1f6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:57:14.368426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-50d68c77-0106-4edf-a333-d58ab4f0c1f6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:57:14.368754 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-50d68c77-0106-4edf-a333-d58ab4f0c1f6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:57:14.380869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=37 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:14.383098 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50d68c77-0106-4edf-a333-d58ab4f0c1f6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:14.384441 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50d68c77-0106-4edf-a333-d58ab4f0c1f6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:14.385206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50d68c77-0106-4edf-a333-d58ab4f0c1f6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:14.386339 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50d68c77-0106-4edf-a333-d58ab4f0c1f6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:14.387003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50d68c77-0106-4edf-a333-d58ab4f0c1f6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:14.387609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50d68c77-0106-4edf-a333-d58ab4f0c1f6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:14.433938 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-50d68c77-0106-4edf-a333-d58ab4f0c1f6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Getting quotas for project e457894e070145348859f44a6a3e8ed6. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:57:14.443989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-50d68c77-0106-4edf-a333-d58ab4f0c1f6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Getting quotas for user d0e0f6e799384863af2222416f070c84 and project e457894e070145348859f44a6a3e8ed6. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:57:14.462575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-50d68c77-0106-4edf-a333-d58ab4f0c1f6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:57:14.464984 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-50d68c77-0106-4edf-a333-d58ab4f0c1f6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:57:14.487956 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4a4ab756-290b-4608-8ba1-4ce6c99fa182 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:14.502385 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4a4ab756-290b-4608-8ba1-4ce6c99fa182 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1476 microversion: 2.1 time: 0.314694 Aug 04 16:57:14.517099 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 404/772] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:14 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1476 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:14.527706 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-30cd7598-eecf-40d9-8309-8bce8a56da99 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:14.528143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-30cd7598-eecf-40d9-8309-8bce8a56da99 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] [instance: 687e42c7-8cf6-41a3-b16f-6cc104223f58] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:14.539630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-30cd7598-eecf-40d9-8309-8bce8a56da99 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:14.540171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-30cd7598-eecf-40d9-8309-8bce8a56da99 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:14.540652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-30cd7598-eecf-40d9-8309-8bce8a56da99 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:14.541458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-30cd7598-eecf-40d9-8309-8bce8a56da99 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:14.541898 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-30cd7598-eecf-40d9-8309-8bce8a56da99 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:14.542362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-30cd7598-eecf-40d9-8309-8bce8a56da99 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:14.563293 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-50d68c77-0106-4edf-a333-d58ab4f0c1f6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.563512 Aug 04 16:57:14.563979 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 369/773] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Aug 4 16:57:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1565 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 16:57:14.568607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-112bc3ad-6d96-40d6-86c6-312375ecdb70 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:14.573332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:14.580647 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-30cd7598-eecf-40d9-8309-8bce8a56da99 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Lazy-loading 'flavor' on Instance uuid 687e42c7-8cf6-41a3-b16f-6cc104223f58 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:57:14.584151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-112bc3ad-6d96-40d6-86c6-312375ecdb70 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: f2d3490d-12a5-453d-b698-80ca6550f0f0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:14.612501 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-112bc3ad-6d96-40d6-86c6-312375ecdb70 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:14.621559 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-112bc3ad-6d96-40d6-86c6-312375ecdb70 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:14.632331 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-112bc3ad-6d96-40d6-86c6-312375ecdb70 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:14.634406 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-112bc3ad-6d96-40d6-86c6-312375ecdb70 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:14.635559 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-112bc3ad-6d96-40d6-86c6-312375ecdb70 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:14.636671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-112bc3ad-6d96-40d6-86c6-312375ecdb70 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:14.743442 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-30cd7598-eecf-40d9-8309-8bce8a56da99 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58/action" status: 202 len: 0 microversion: 2.1 time: 0.222745 Aug 04 16:57:14.743442 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 405/774] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:57:14 2022] POST /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:57:14.747716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-57dbecf5-efae-40f6-b58a-53f96c1a0531 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:14.748691 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-57dbecf5-efae-40f6-b58a-53f96c1a0531 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:14.757467 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57dbecf5-efae-40f6-b58a-53f96c1a0531 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:14.758421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57dbecf5-efae-40f6-b58a-53f96c1a0531 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:14.759208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57dbecf5-efae-40f6-b58a-53f96c1a0531 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:14.760441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57dbecf5-efae-40f6-b58a-53f96c1a0531 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:14.761063 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57dbecf5-efae-40f6-b58a-53f96c1a0531 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:14.761699 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57dbecf5-efae-40f6-b58a-53f96c1a0531 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:14.957727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-57dbecf5-efae-40f6-b58a-53f96c1a0531 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lazy-loading 'services' on Instance uuid 96d30c66-24c7-4b25-81cd-fb638035a1cb {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:57:14.987428 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-57dbecf5-efae-40f6-b58a-53f96c1a0531 tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1935 microversion: 2.75 time: 0.244043 Aug 04 16:57:14.988683 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-112bc3ad-6d96-40d6-86c6-312375ecdb70 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:14.990467 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 406/775] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:14 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1935 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:14.996684 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-90afdce3-6836-40a9-9c33-0611ea29d4f0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:14.997470 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-90afdce3-6836-40a9-9c33-0611ea29d4f0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:15.000728 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-112bc3ad-6d96-40d6-86c6-312375ecdb70 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0" status: 200 len: 1390 microversion: 2.1 time: 0.435147 Aug 04 16:57:15.014022 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90afdce3-6836-40a9-9c33-0611ea29d4f0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:15.014022 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90afdce3-6836-40a9-9c33-0611ea29d4f0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:15.014022 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90afdce3-6836-40a9-9c33-0611ea29d4f0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:15.014022 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90afdce3-6836-40a9-9c33-0611ea29d4f0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:15.015027 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 370/776] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:14 2022] GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0 => generated 1390 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:15.016624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90afdce3-6836-40a9-9c33-0611ea29d4f0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:15.017250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90afdce3-6836-40a9-9c33-0611ea29d4f0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:15.032397 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6f1d76d2-0a9d-4f1e-88c3-baa7316d041e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:15.033040 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6f1d76d2-0a9d-4f1e-88c3-baa7316d041e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:15.046173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f1d76d2-0a9d-4f1e-88c3-baa7316d041e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:15.046753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f1d76d2-0a9d-4f1e-88c3-baa7316d041e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:15.047191 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f1d76d2-0a9d-4f1e-88c3-baa7316d041e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:15.049391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f1d76d2-0a9d-4f1e-88c3-baa7316d041e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:15.054095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f1d76d2-0a9d-4f1e-88c3-baa7316d041e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:15.054828 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f1d76d2-0a9d-4f1e-88c3-baa7316d041e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:15.127145 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-90afdce3-6836-40a9-9c33-0611ea29d4f0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:15.140192 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-90afdce3-6836-40a9-9c33-0611ea29d4f0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83" status: 200 len: 1274 microversion: 2.1 time: 0.148487 Aug 04 16:57:15.154434 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 407/777] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:14 2022] GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 => generated 1274 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:15.161444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ffbcc278-3544-41e2-9eab-0ec2556e968d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:15.162266 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ffbcc278-3544-41e2-9eab-0ec2556e968d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:15.304322 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ffbcc278-3544-41e2-9eab-0ec2556e968d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:15.318653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ffbcc278-3544-41e2-9eab-0ec2556e968d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:15.320817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ffbcc278-3544-41e2-9eab-0ec2556e968d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:15.322282 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ffbcc278-3544-41e2-9eab-0ec2556e968d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3" status: 200 len: 1261 microversion: 2.25 time: 0.165947 Aug 04 16:57:15.327352 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 408/778] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:15 2022] GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:15.340381 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e121d2bd-3b78-42ec-a558-39fd39f66ff7 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:15.341501 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e121d2bd-3b78-42ec-a558-39fd39f66ff7 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] [instance: 687e42c7-8cf6-41a3-b16f-6cc104223f58] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:15.355449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e121d2bd-3b78-42ec-a558-39fd39f66ff7 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:15.356089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e121d2bd-3b78-42ec-a558-39fd39f66ff7 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:15.366476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e121d2bd-3b78-42ec-a558-39fd39f66ff7 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:15.367461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e121d2bd-3b78-42ec-a558-39fd39f66ff7 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:15.368033 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e121d2bd-3b78-42ec-a558-39fd39f66ff7 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:15.368550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e121d2bd-3b78-42ec-a558-39fd39f66ff7 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:15.640107 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6f1d76d2-0a9d-4f1e-88c3-baa7316d041e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:15.649024 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6f1d76d2-0a9d-4f1e-88c3-baa7316d041e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1359 microversion: 2.1 time: 0.627989 Aug 04 16:57:15.649728 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 371/779] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:15 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1359 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:15.662159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-103a5f7c-4821-4fd5-91f1-0b2e33f024e3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:15.663239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-103a5f7c-4821-4fd5-91f1-0b2e33f024e3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 02856bd5-3936-4593-b70d-ddf3452f440d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:15.670858 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-103a5f7c-4821-4fd5-91f1-0b2e33f024e3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:15.671706 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-103a5f7c-4821-4fd5-91f1-0b2e33f024e3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:15.672307 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-103a5f7c-4821-4fd5-91f1-0b2e33f024e3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:15.673188 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-103a5f7c-4821-4fd5-91f1-0b2e33f024e3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:15.673808 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-103a5f7c-4821-4fd5-91f1-0b2e33f024e3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:15.674419 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-103a5f7c-4821-4fd5-91f1-0b2e33f024e3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:16.047287 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-103a5f7c-4821-4fd5-91f1-0b2e33f024e3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:16.058362 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-103a5f7c-4821-4fd5-91f1-0b2e33f024e3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d" status: 200 len: 1313 microversion: 2.1 time: 0.407407 Aug 04 16:57:16.059570 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 372/780] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:15 2022] GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d => generated 1313 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:16.067907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dfdd5198-4f25-42b5-8598-2342412a0cd4 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:16.069360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dfdd5198-4f25-42b5-8598-2342412a0cd4 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:16.093179 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfdd5198-4f25-42b5-8598-2342412a0cd4 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:16.093752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfdd5198-4f25-42b5-8598-2342412a0cd4 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:16.094236 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfdd5198-4f25-42b5-8598-2342412a0cd4 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:16.095545 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfdd5198-4f25-42b5-8598-2342412a0cd4 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:16.096070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfdd5198-4f25-42b5-8598-2342412a0cd4 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:16.096790 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfdd5198-4f25-42b5-8598-2342412a0cd4 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:16.118802 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e121d2bd-3b78-42ec-a558-39fd39f66ff7 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58" status: 200 len: 1628 microversion: 2.1 time: 0.789877 Aug 04 16:57:16.133507 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 409/781] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:15 2022] GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58 => generated 1628 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:16.139088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d4ed30b4-1d77-4fc0-8677-e9b907430a7a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:16.139724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d4ed30b4-1d77-4fc0-8677-e9b907430a7a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:16.152146 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d4ed30b4-1d77-4fc0-8677-e9b907430a7a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:16.152568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d4ed30b4-1d77-4fc0-8677-e9b907430a7a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:16.153019 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d4ed30b4-1d77-4fc0-8677-e9b907430a7a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:16.153743 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d4ed30b4-1d77-4fc0-8677-e9b907430a7a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:16.156240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d4ed30b4-1d77-4fc0-8677-e9b907430a7a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:16.156240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d4ed30b4-1d77-4fc0-8677-e9b907430a7a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:16.268865 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-d4ed30b4-1d77-4fc0-8677-e9b907430a7a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] Lazy-loading 'services' on Instance uuid 96d30c66-24c7-4b25-81cd-fb638035a1cb {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:57:16.292718 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d4ed30b4-1d77-4fc0-8677-e9b907430a7a tempest-ServersAdmin275Test-193964712 tempest-ServersAdmin275Test-193964712-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1920 microversion: 2.75 time: 0.157409 Aug 04 16:57:16.293734 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 410/782] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:16 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1920 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:16.299606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3e71b59b-38d0-4342-a058-2de30833410f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:16.300229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3e71b59b-38d0-4342-a058-2de30833410f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: f2d3490d-12a5-453d-b698-80ca6550f0f0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:16.309227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3e71b59b-38d0-4342-a058-2de30833410f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:16.310678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3e71b59b-38d0-4342-a058-2de30833410f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:16.322730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3e71b59b-38d0-4342-a058-2de30833410f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:16.324720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3e71b59b-38d0-4342-a058-2de30833410f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:16.327436 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3e71b59b-38d0-4342-a058-2de30833410f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:16.328980 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3e71b59b-38d0-4342-a058-2de30833410f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:16.594651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dfdd5198-4f25-42b5-8598-2342412a0cd4 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:16.613686 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dfdd5198-4f25-42b5-8598-2342412a0cd4 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1476 microversion: 2.1 time: 0.552335 Aug 04 16:57:16.614670 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 373/783] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:16 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1476 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:16.619547 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c83ece5b-aba1-42a3-b0f6-5724f2feca70 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:16.625043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c83ece5b-aba1-42a3-b0f6-5724f2feca70 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:16.640679 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c83ece5b-aba1-42a3-b0f6-5724f2feca70 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:16.641368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c83ece5b-aba1-42a3-b0f6-5724f2feca70 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:16.641633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c83ece5b-aba1-42a3-b0f6-5724f2feca70 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:16.642394 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c83ece5b-aba1-42a3-b0f6-5724f2feca70 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:16.642864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c83ece5b-aba1-42a3-b0f6-5724f2feca70 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:16.643301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c83ece5b-aba1-42a3-b0f6-5724f2feca70 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:16.829791 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3e71b59b-38d0-4342-a058-2de30833410f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:16.838881 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3e71b59b-38d0-4342-a058-2de30833410f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0" status: 200 len: 1590 microversion: 2.1 time: 0.543055 Aug 04 16:57:16.843192 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 411/784] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:16 2022] GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0 => generated 1590 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:16.845007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-21312b72-f78f-461f-9c8f-24cdfd57cc24 req-d93c55d3-b514-4f43-9664-20d35c30ae54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02856bd5-3936-4593-b70d-ddf3452f440d", "name": "network-vif-plugged", "status": "completed", "tag": "2354b854-6575-48f2-a27c-ae89d11c285d"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:16.856844 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-21312b72-f78f-461f-9c8f-24cdfd57cc24 req-d93c55d3-b514-4f43-9664-20d35c30ae54 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:16.857343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-21312b72-f78f-461f-9c8f-24cdfd57cc24 req-d93c55d3-b514-4f43-9664-20d35c30ae54 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:16.858579 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-21312b72-f78f-461f-9c8f-24cdfd57cc24 req-d93c55d3-b514-4f43-9664-20d35c30ae54 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:16.889255 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-21312b72-f78f-461f-9c8f-24cdfd57cc24 req-d93c55d3-b514-4f43-9664-20d35c30ae54 service nova] Creating event network-vif-plugged:2354b854-6575-48f2-a27c-ae89d11c285d for instance 02856bd5-3936-4593-b70d-ddf3452f440d on n-h1-851359-3 Aug 04 16:57:16.894603 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-21312b72-f78f-461f-9c8f-24cdfd57cc24 req-d93c55d3-b514-4f43-9664-20d35c30ae54 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053598 Aug 04 16:57:16.898664 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 412/785] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:16.905505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4017be82-f4fa-4819-a88f-ead6994f14be tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:16.906198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4017be82-f4fa-4819-a88f-ead6994f14be tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:16.917519 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4017be82-f4fa-4819-a88f-ead6994f14be tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:16.918063 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4017be82-f4fa-4819-a88f-ead6994f14be tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:16.918889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4017be82-f4fa-4819-a88f-ead6994f14be tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:16.919554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4017be82-f4fa-4819-a88f-ead6994f14be tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:16.919670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4017be82-f4fa-4819-a88f-ead6994f14be tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:16.920394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4017be82-f4fa-4819-a88f-ead6994f14be tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:16.958023 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4017be82-f4fa-4819-a88f-ead6994f14be tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:57:16.999798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c83ece5b-aba1-42a3-b0f6-5724f2feca70 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:17.010952 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c83ece5b-aba1-42a3-b0f6-5724f2feca70 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83" status: 200 len: 1316 microversion: 2.1 time: 0.393751 Aug 04 16:57:17.013679 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 374/786] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:16 2022] GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 => generated 1316 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:17.021891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7b1ca581-fea5-4fc6-a787-b8339a2e8a7e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:17.022796 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7b1ca581-fea5-4fc6-a787-b8339a2e8a7e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:17.031779 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b1ca581-fea5-4fc6-a787-b8339a2e8a7e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:17.032281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b1ca581-fea5-4fc6-a787-b8339a2e8a7e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:17.032732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b1ca581-fea5-4fc6-a787-b8339a2e8a7e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:17.036101 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b1ca581-fea5-4fc6-a787-b8339a2e8a7e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:17.036680 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b1ca581-fea5-4fc6-a787-b8339a2e8a7e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:17.037713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b1ca581-fea5-4fc6-a787-b8339a2e8a7e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:17.161697 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4017be82-f4fa-4819-a88f-ead6994f14be tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "DELETE /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 204 len: 0 microversion: 2.75 time: 0.261526 Aug 04 16:57:17.163118 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 413/787] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Aug 4 16:57:16 2022] DELETE /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 16:57:17.182724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a148bf70-c68e-46a3-b765-b0ed8da269ad tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:17.183445 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a148bf70-c68e-46a3-b765-b0ed8da269ad tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:17.202147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a148bf70-c68e-46a3-b765-b0ed8da269ad tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:17.202695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a148bf70-c68e-46a3-b765-b0ed8da269ad tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:17.207508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a148bf70-c68e-46a3-b765-b0ed8da269ad tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:17.208343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a148bf70-c68e-46a3-b765-b0ed8da269ad tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:17.212205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a148bf70-c68e-46a3-b765-b0ed8da269ad tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:17.212759 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a148bf70-c68e-46a3-b765-b0ed8da269ad tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:17.532041 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7b1ca581-fea5-4fc6-a787-b8339a2e8a7e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:17.541094 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7b1ca581-fea5-4fc6-a787-b8339a2e8a7e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:17.542801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7b1ca581-fea5-4fc6-a787-b8339a2e8a7e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:17.544054 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7b1ca581-fea5-4fc6-a787-b8339a2e8a7e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3" status: 200 len: 1361 microversion: 2.25 time: 0.528455 Aug 04 16:57:17.544611 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 375/788] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:17 2022] GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 => generated 1361 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:17.550071 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c926a0f4-552c-45f0-9285-0a17b242bb26 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:17.550846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c926a0f4-552c-45f0-9285-0a17b242bb26 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: f2d3490d-12a5-453d-b698-80ca6550f0f0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:17.588126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c926a0f4-552c-45f0-9285-0a17b242bb26 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:17.588633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c926a0f4-552c-45f0-9285-0a17b242bb26 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:17.589076 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c926a0f4-552c-45f0-9285-0a17b242bb26 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:17.589818 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c926a0f4-552c-45f0-9285-0a17b242bb26 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:17.590307 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c926a0f4-552c-45f0-9285-0a17b242bb26 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:17.590741 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c926a0f4-552c-45f0-9285-0a17b242bb26 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:17.604853 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a148bf70-c68e-46a3-b765-b0ed8da269ad tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:17.615641 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a148bf70-c68e-46a3-b765-b0ed8da269ad tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1359 microversion: 2.1 time: 0.445827 Aug 04 16:57:17.617237 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 414/789] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:17 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1359 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:17.626215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9bc0cef5-91bb-4dde-bfd3-25693bc6a1dc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:17.627888 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9bc0cef5-91bb-4dde-bfd3-25693bc6a1dc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 02856bd5-3936-4593-b70d-ddf3452f440d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:17.634278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9bc0cef5-91bb-4dde-bfd3-25693bc6a1dc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:17.635060 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9bc0cef5-91bb-4dde-bfd3-25693bc6a1dc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:17.635751 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9bc0cef5-91bb-4dde-bfd3-25693bc6a1dc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:17.637001 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9bc0cef5-91bb-4dde-bfd3-25693bc6a1dc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:17.638082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9bc0cef5-91bb-4dde-bfd3-25693bc6a1dc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:17.638703 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9bc0cef5-91bb-4dde-bfd3-25693bc6a1dc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:17.767729 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c926a0f4-552c-45f0-9285-0a17b242bb26 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.221547 Aug 04 16:57:17.768811 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 376/790] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Aug 4 16:57:17 2022] GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0/os-interface => generated 285 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:17.774819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9b008b32-fe46-42e2-b9d9-49fd2b38690c tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:17.775752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9b008b32-fe46-42e2-b9d9-49fd2b38690c tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] [instance: 687e42c7-8cf6-41a3-b16f-6cc104223f58] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:17.783483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b008b32-fe46-42e2-b9d9-49fd2b38690c tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:17.789824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b008b32-fe46-42e2-b9d9-49fd2b38690c tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:17.790430 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b008b32-fe46-42e2-b9d9-49fd2b38690c tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:17.791276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b008b32-fe46-42e2-b9d9-49fd2b38690c tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:17.791762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b008b32-fe46-42e2-b9d9-49fd2b38690c tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:17.792205 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b008b32-fe46-42e2-b9d9-49fd2b38690c tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:18.326672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9bc0cef5-91bb-4dde-bfd3-25693bc6a1dc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:18.334742 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9bc0cef5-91bb-4dde-bfd3-25693bc6a1dc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d" status: 200 len: 1313 microversion: 2.1 time: 0.715689 Aug 04 16:57:18.335324 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 415/791] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:17 2022] GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d => generated 1313 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:18.340285 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3ccca618-6322-4317-aa7b-153e357c05b8 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:18.340921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3ccca618-6322-4317-aa7b-153e357c05b8 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:18.352827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ccca618-6322-4317-aa7b-153e357c05b8 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:18.353328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ccca618-6322-4317-aa7b-153e357c05b8 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:18.353779 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ccca618-6322-4317-aa7b-153e357c05b8 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:18.354536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ccca618-6322-4317-aa7b-153e357c05b8 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:18.355003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ccca618-6322-4317-aa7b-153e357c05b8 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:18.355443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ccca618-6322-4317-aa7b-153e357c05b8 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:18.465065 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:18.467692 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3ccca618-6322-4317-aa7b-153e357c05b8 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:18.473185 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9b008b32-fe46-42e2-b9d9-49fd2b38690c tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58" status: 200 len: 1611 microversion: 2.1 time: 0.703319 Aug 04 16:57:18.481914 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 377/792] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:17 2022] GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58 => generated 1611 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:18.481914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cd101ee0-5b7c-4d57-91c2-0f954a5fc6b3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:18.481914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cd101ee0-5b7c-4d57-91c2-0f954a5fc6b3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:18.488154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd101ee0-5b7c-4d57-91c2-0f954a5fc6b3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:18.488781 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd101ee0-5b7c-4d57-91c2-0f954a5fc6b3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:18.489409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd101ee0-5b7c-4d57-91c2-0f954a5fc6b3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:18.490069 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd101ee0-5b7c-4d57-91c2-0f954a5fc6b3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:18.490530 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd101ee0-5b7c-4d57-91c2-0f954a5fc6b3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:18.490954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd101ee0-5b7c-4d57-91c2-0f954a5fc6b3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:18.492827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3ccca618-6322-4317-aa7b-153e357c05b8 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:18.494139 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3ccca618-6322-4317-aa7b-153e357c05b8 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:18.500393 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3ccca618-6322-4317-aa7b-153e357c05b8 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1444 microversion: 2.75 time: 0.163833 Aug 04 16:57:18.511276 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 416/793] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:18 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1444 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:18.517895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-7ac46b3e-9d24-401f-a137-34ffb8c44d2f req-d9bc4077-41c8-4b61-9d53-4d990f9c70ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98e4458d-d7e4-4663-a974-70ccbe5501f3", "tag": "3feec73d-d957-4633-8d95-d8f2f43a58be"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:18.528469 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7ac46b3e-9d24-401f-a137-34ffb8c44d2f req-d9bc4077-41c8-4b61-9d53-4d990f9c70ab service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:18.528987 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7ac46b3e-9d24-401f-a137-34ffb8c44d2f req-d9bc4077-41c8-4b61-9d53-4d990f9c70ab service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:18.529449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7ac46b3e-9d24-401f-a137-34ffb8c44d2f req-d9bc4077-41c8-4b61-9d53-4d990f9c70ab service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:18.540834 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-7ac46b3e-9d24-401f-a137-34ffb8c44d2f req-d9bc4077-41c8-4b61-9d53-4d990f9c70ab service nova] Creating event network-changed:3feec73d-d957-4633-8d95-d8f2f43a58be for instance 98e4458d-d7e4-4663-a974-70ccbe5501f3 on n-h1-851359-3 Aug 04 16:57:18.546122 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-7ac46b3e-9d24-401f-a137-34ffb8c44d2f req-d9bc4077-41c8-4b61-9d53-4d990f9c70ab service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043426 Aug 04 16:57:18.546727 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 417/794] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:18.551715 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cc256723-e9d4-4280-a213-ec46b8a70536 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:18.552423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cc256723-e9d4-4280-a213-ec46b8a70536 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:18.558979 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc256723-e9d4-4280-a213-ec46b8a70536 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:18.559482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc256723-e9d4-4280-a213-ec46b8a70536 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:18.560006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc256723-e9d4-4280-a213-ec46b8a70536 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:18.560678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc256723-e9d4-4280-a213-ec46b8a70536 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:18.561161 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc256723-e9d4-4280-a213-ec46b8a70536 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:18.561596 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc256723-e9d4-4280-a213-ec46b8a70536 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:18.847657 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cd101ee0-5b7c-4d57-91c2-0f954a5fc6b3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:18.855225 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cd101ee0-5b7c-4d57-91c2-0f954a5fc6b3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1476 microversion: 2.1 time: 0.380156 Aug 04 16:57:18.855790 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 378/795] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:18 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1476 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:18.860227 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-a80d2641-b47b-4790-bf07-8f0d089ded34 req-b7c1f51c-2b35-4afc-a726-a4cadbc005b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c8b06b6-59a1-4595-b2ee-539a4c9dbc83", "tag": "2f81e029-164b-4fbb-9431-2ee5454d602d"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:18.869715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a80d2641-b47b-4790-bf07-8f0d089ded34 req-b7c1f51c-2b35-4afc-a726-a4cadbc005b5 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:18.870229 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a80d2641-b47b-4790-bf07-8f0d089ded34 req-b7c1f51c-2b35-4afc-a726-a4cadbc005b5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:18.870669 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a80d2641-b47b-4790-bf07-8f0d089ded34 req-b7c1f51c-2b35-4afc-a726-a4cadbc005b5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:18.879866 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cc256723-e9d4-4280-a213-ec46b8a70536 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:18.884014 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-a80d2641-b47b-4790-bf07-8f0d089ded34 req-b7c1f51c-2b35-4afc-a726-a4cadbc005b5 service nova] Creating event network-changed:2f81e029-164b-4fbb-9431-2ee5454d602d for instance 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 on n-h1-851359-3 Aug 04 16:57:18.889879 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cc256723-e9d4-4280-a213-ec46b8a70536 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83" status: 200 len: 1316 microversion: 2.1 time: 0.341227 Aug 04 16:57:18.890867 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 418/796] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:18 2022] GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 => generated 1316 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:18.890986 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-a80d2641-b47b-4790-bf07-8f0d089ded34 req-b7c1f51c-2b35-4afc-a726-a4cadbc005b5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033745 Aug 04 16:57:18.891845 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 379/797] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:18.896627 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0786d24a-72ea-4720-954c-7fcff5cd29f7 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:18.897790 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0786d24a-72ea-4720-954c-7fcff5cd29f7 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] [instance: 687e42c7-8cf6-41a3-b16f-6cc104223f58] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:18.898919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-930cce7b-f869-4e73-8d07-bc09b0e82171 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:18.900323 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-930cce7b-f869-4e73-8d07-bc09b0e82171 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:18.905851 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0786d24a-72ea-4720-954c-7fcff5cd29f7 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:18.906478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0786d24a-72ea-4720-954c-7fcff5cd29f7 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:18.907044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0786d24a-72ea-4720-954c-7fcff5cd29f7 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:18.907892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0786d24a-72ea-4720-954c-7fcff5cd29f7 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:18.908063 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-930cce7b-f869-4e73-8d07-bc09b0e82171 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:18.908435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0786d24a-72ea-4720-954c-7fcff5cd29f7 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:18.908966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-930cce7b-f869-4e73-8d07-bc09b0e82171 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:18.909120 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0786d24a-72ea-4720-954c-7fcff5cd29f7 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:18.909421 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-930cce7b-f869-4e73-8d07-bc09b0e82171 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:18.910391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-930cce7b-f869-4e73-8d07-bc09b0e82171 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:18.910862 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-930cce7b-f869-4e73-8d07-bc09b0e82171 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:18.911553 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-930cce7b-f869-4e73-8d07-bc09b0e82171 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:18.943620 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-0786d24a-72ea-4720-954c-7fcff5cd29f7 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] HTTP exception thrown: Cannot 'migrate' instance 687e42c7-8cf6-41a3-b16f-6cc104223f58 while it is in vm_state suspended Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0786d24a-72ea-4720-954c-7fcff5cd29f7 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Request method failure captured: Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58/action HTTP/1.1 Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 15 Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_o6nVjFi-3zob8aowZyt1IgcLYu-nQd5vnf64oZUAtZ-_nSAtKC20iT-Dkv8lO94A-WJ_kf7cpRr47GH_SavpCgP8y8PS7wl-yhVk5qcMC7x620QV7QQHa3Co0iEpg2kOXEtwEnEQCLx3qQcQgT6zEgBovXzhiQTLGZztIkcncmlzs Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: b2d92201c7aa48a1a150111dcc2dcdac Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1221082146 Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: X-Role: admin,member,reader Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: admin,member,reader Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b2d92201c7aa48a1a150111dcc2dcdac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b2d92201c7aa48a1a150111dcc2dcdac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b2d92201c7aa48a1a150111dcc2dcdac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b2d92201c7aa48a1a150111dcc2dcdac"}]}] Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1221082146 Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: b2d92201c7aa48a1a150111dcc2dcdac Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1221082146 Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersAdminNegativeTestJSON-1221082146-project-admin Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 3e67b4859e594e0caf5bdc2ab1d6ac72 Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1221082146-project-admin Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: {"migrate": {}} Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: exception: Cannot 'migrate' instance 687e42c7-8cf6-41a3-b16f-6cc104223f58 while it is in vm_state suspended Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '687e42c7-8cf6-41a3-b16f-6cc104223f58', 'body': {'migrate': {}}} Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 687e42c7-8cf6-41a3-b16f-6cc104223f58 in vm_state suspended. Cannot resize while the instance is in this state. Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:57:18.945382 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:57:18.950201 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:57:18.950201 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 04 16:57:18.950201 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 16:57:18.950201 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 16:57:18.950201 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 16:57:18.950201 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 687e42c7-8cf6-41a3-b16f-6cc104223f58 while it is in vm_state suspended Aug 04 16:57:18.950201 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:57:18.950201 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:18.950201 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:57:18.950201 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:18.950201 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:18.950201 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:18.950201 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:57:18.950201 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:57:18.950201 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 687e42c7-8cf6-41a3-b16f-6cc104223f58 while it is in vm_state suspended Aug 04 16:57:18.950201 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:57:18.950201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0786d24a-72ea-4720-954c-7fcff5cd29f7 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Returning 409 to user: Cannot 'migrate' instance 687e42c7-8cf6-41a3-b16f-6cc104223f58 while it is in vm_state suspended {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:57:18.950201 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0786d24a-72ea-4720-954c-7fcff5cd29f7 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58/action" status: 409 len: 148 microversion: 2.1 time: 0.055271 Aug 04 16:57:18.950201 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 419/798] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:57:18 2022] POST /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58/action => generated 148 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:57:18.952319 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-21ea5f39-7be7-436b-916f-0ce3d00263ef tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:18.952456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-21ea5f39-7be7-436b-916f-0ce3d00263ef tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:18.962426 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-21ea5f39-7be7-436b-916f-0ce3d00263ef tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:18.962928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-21ea5f39-7be7-436b-916f-0ce3d00263ef tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:18.963376 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-21ea5f39-7be7-436b-916f-0ce3d00263ef tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:18.964089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-21ea5f39-7be7-436b-916f-0ce3d00263ef tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:18.964557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-21ea5f39-7be7-436b-916f-0ce3d00263ef tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:18.964990 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-21ea5f39-7be7-436b-916f-0ce3d00263ef tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:18.985804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:19.241117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-930cce7b-f869-4e73-8d07-bc09b0e82171 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:19.249138 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-930cce7b-f869-4e73-8d07-bc09b0e82171 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:19.250748 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-930cce7b-f869-4e73-8d07-bc09b0e82171 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:19.251944 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-930cce7b-f869-4e73-8d07-bc09b0e82171 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3" status: 200 len: 1361 microversion: 2.25 time: 0.358975 Aug 04 16:57:19.252512 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 380/799] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:18 2022] GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 => generated 1361 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:19.267349 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-9a9facbe-8fb7-4a14-935d-b3c5cf4b76d2 req-03266e09-f2cf-4184-b39d-7a3b0df6da70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19c5ab52-7c2b-4d63-8628-43c75476e45c", "name": "network-vif-plugged", "status": "completed", "tag": "134ee327-dd36-4c6e-b53f-b97914e333e8"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:19.267349 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9a9facbe-8fb7-4a14-935d-b3c5cf4b76d2 req-03266e09-f2cf-4184-b39d-7a3b0df6da70 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:19.267349 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9a9facbe-8fb7-4a14-935d-b3c5cf4b76d2 req-03266e09-f2cf-4184-b39d-7a3b0df6da70 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:19.267673 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9a9facbe-8fb7-4a14-935d-b3c5cf4b76d2 req-03266e09-f2cf-4184-b39d-7a3b0df6da70 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:19.279227 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-9a9facbe-8fb7-4a14-935d-b3c5cf4b76d2 req-03266e09-f2cf-4184-b39d-7a3b0df6da70 service nova] Creating event network-vif-plugged:134ee327-dd36-4c6e-b53f-b97914e333e8 for instance 19c5ab52-7c2b-4d63-8628-43c75476e45c on n-h2-851359-3 Aug 04 16:57:19.284819 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-9a9facbe-8fb7-4a14-935d-b3c5cf4b76d2 req-03266e09-f2cf-4184-b39d-7a3b0df6da70 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031194 Aug 04 16:57:19.285432 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 381/800] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:19.290485 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ea612f87-ccce-4212-a13f-8d30bc554095 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ea612f87-ccce-4212-a13f-8d30bc554095 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Request method failure captured: Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df/action HTTP/1.1 Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 39 Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_o6nVjFi-3zob8aowZyt1IgcLYu-nQd5vnf64oZUAtZ-_nSAtKC20iT-Dkv8lO94A-WJ_kf7cpRr47GH_SavpCgP8y8PS7wl-yhVk5qcMC7x620QV7QQHa3Co0iEpg2kOXEtwEnEQCLx3qQcQgT6zEgBovXzhiQTLGZztIkcncmlzs Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: b2d92201c7aa48a1a150111dcc2dcdac Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1221082146 Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: X-Role: admin,member,reader Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: admin,member,reader Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b2d92201c7aa48a1a150111dcc2dcdac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b2d92201c7aa48a1a150111dcc2dcdac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b2d92201c7aa48a1a150111dcc2dcdac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b2d92201c7aa48a1a150111dcc2dcdac"}]}] Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1221082146 Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: b2d92201c7aa48a1a150111dcc2dcdac Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1221082146 Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersAdminNegativeTestJSON-1221082146-project-admin Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 3e67b4859e594e0caf5bdc2ab1d6ac72 Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1221082146-project-admin Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: {"os-resetState": {"state": "invalid"}} Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'b8efce6c-198e-49a7-8576-32d80cb168df', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'invalid' Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:57:19.294235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:57:19.298296 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 04 16:57:19.298296 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:19.298296 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:19.298296 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:19.298296 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:19.298296 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:19.298296 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:19.298296 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:57:19.298296 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:57:19.298296 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 04 16:57:19.298296 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:19.298296 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ea612f87-ccce-4212-a13f-8d30bc554095 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:57:19.298296 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ea612f87-ccce-4212-a13f-8d30bc554095 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df/action" status: 400 len: 144 microversion: 2.1 time: 0.009073 Aug 04 16:57:19.298296 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 382/801] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:57:19 2022] POST /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df/action => generated 144 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:57:19.303691 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-21ea5f39-7be7-436b-916f-0ce3d00263ef tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:19.304986 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0865339a-d4b2-49f6-ad6b-fbade3d48c91 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0865339a-d4b2-49f6-ad6b-fbade3d48c91 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Request method failure captured: Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df/action HTTP/1.1 Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 31 Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_o6nVjFi-3zob8aowZyt1IgcLYu-nQd5vnf64oZUAtZ-_nSAtKC20iT-Dkv8lO94A-WJ_kf7cpRr47GH_SavpCgP8y8PS7wl-yhVk5qcMC7x620QV7QQHa3Co0iEpg2kOXEtwEnEQCLx3qQcQgT6zEgBovXzhiQTLGZztIkcncmlzs Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: b2d92201c7aa48a1a150111dcc2dcdac Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1221082146 Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: X-Role: admin,member,reader Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: admin,member,reader Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b2d92201c7aa48a1a150111dcc2dcdac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b2d92201c7aa48a1a150111dcc2dcdac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b2d92201c7aa48a1a150111dcc2dcdac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b2d92201c7aa48a1a150111dcc2dcdac"}]}] Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1221082146 Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: b2d92201c7aa48a1a150111dcc2dcdac Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1221082146 Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersAdminNegativeTestJSON-1221082146-project-admin Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 3e67b4859e594e0caf5bdc2ab1d6ac72 Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1221082146-project-admin Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: {"os-resetState": {"state": 1}} Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'b8efce6c-198e-49a7-8576-32d80cb168df', 'body': {'os-resetState': {'state': 1}}} Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 1 Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 04 16:57:19.309248 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:19.315662 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:19.315662 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:19.315662 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:19.315662 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:19.315662 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:19.315662 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 16:57:19.315662 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 16:57:19.315662 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 04 16:57:19.315662 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:19.315662 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0865339a-d4b2-49f6-ad6b-fbade3d48c91 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:57:19.315662 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0865339a-d4b2-49f6-ad6b-fbade3d48c91 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df/action" status: 400 len: 120 microversion: 2.1 time: 0.009035 Aug 04 16:57:19.316574 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-21ea5f39-7be7-436b-916f-0ce3d00263ef tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1359 microversion: 2.1 time: 0.364739 Aug 04 16:57:19.316683 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 383/802] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:57:19 2022] POST /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df/action => generated 120 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:57:19.321653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e48f90b7-5d48-4ad2-9f7a-83d728a5f4a7 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:19.324266 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e48f90b7-5d48-4ad2-9f7a-83d728a5f4a7 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Failed to fetch instance by id 999 {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 04 16:57:19.324990 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-e48f90b7-5d48-4ad2-9f7a-83d728a5f4a7 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 04 16:57:19.327006 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 420/803] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:18 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1359 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e48f90b7-5d48-4ad2-9f7a-83d728a5f4a7 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Request method failure captured: Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 37 Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_o6nVjFi-3zob8aowZyt1IgcLYu-nQd5vnf64oZUAtZ-_nSAtKC20iT-Dkv8lO94A-WJ_kf7cpRr47GH_SavpCgP8y8PS7wl-yhVk5qcMC7x620QV7QQHa3Co0iEpg2kOXEtwEnEQCLx3qQcQgT6zEgBovXzhiQTLGZztIkcncmlzs Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: b2d92201c7aa48a1a150111dcc2dcdac Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1221082146 Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: X-Role: admin,member,reader Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: admin,member,reader Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b2d92201c7aa48a1a150111dcc2dcdac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b2d92201c7aa48a1a150111dcc2dcdac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b2d92201c7aa48a1a150111dcc2dcdac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b2d92201c7aa48a1a150111dcc2dcdac"}]}] Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1221082146 Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: b2d92201c7aa48a1a150111dcc2dcdac Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1221082146 Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersAdminNegativeTestJSON-1221082146-project-admin Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 3e67b4859e594e0caf5bdc2ab1d6ac72 Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1221082146-project-admin Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: {"os-resetState": {"state": "error"}} Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 999 could not be found. Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:19.332621 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:57:19.337352 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:57:19.337352 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 04 16:57:19.337352 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:19.337352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e48f90b7-5d48-4ad2-9f7a-83d728a5f4a7 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:57:19.337352 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e48f90b7-5d48-4ad2-9f7a-83d728a5f4a7 tempest-ServersAdminNegativeTestJSON-1221082146 tempest-ServersAdminNegativeTestJSON-1221082146-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.017859 Aug 04 16:57:19.338777 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 384/804] 10.222.0.93 () {60 vars in 1179 bytes} [Thu Aug 4 16:57:19 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 16:57:19.344431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a7ad0287-52c6-42cf-96ac-37219635d8fb tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:19.345028 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a7ad0287-52c6-42cf-96ac-37219635d8fb tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: 687e42c7-8cf6-41a3-b16f-6cc104223f58] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:19.353656 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a7ad0287-52c6-42cf-96ac-37219635d8fb tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:19.354194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a7ad0287-52c6-42cf-96ac-37219635d8fb tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:19.354718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a7ad0287-52c6-42cf-96ac-37219635d8fb tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:19.355517 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a7ad0287-52c6-42cf-96ac-37219635d8fb tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:19.355769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-43035c4f-450e-4c19-bca4-2fd9e2887d72 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:19.356142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a7ad0287-52c6-42cf-96ac-37219635d8fb tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:19.356515 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-43035c4f-450e-4c19-bca4-2fd9e2887d72 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 02856bd5-3936-4593-b70d-ddf3452f440d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:19.356668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a7ad0287-52c6-42cf-96ac-37219635d8fb tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:19.363838 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43035c4f-450e-4c19-bca4-2fd9e2887d72 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:19.364335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43035c4f-450e-4c19-bca4-2fd9e2887d72 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:19.364783 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43035c4f-450e-4c19-bca4-2fd9e2887d72 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:19.365498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43035c4f-450e-4c19-bca4-2fd9e2887d72 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:19.365963 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43035c4f-450e-4c19-bca4-2fd9e2887d72 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:19.366422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43035c4f-450e-4c19-bca4-2fd9e2887d72 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:19.383193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a7ad0287-52c6-42cf-96ac-37219635d8fb tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: 687e42c7-8cf6-41a3-b16f-6cc104223f58] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:57:19.461451 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a7ad0287-52c6-42cf-96ac-37219635d8fb tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "DELETE /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58" status: 204 len: 0 microversion: 2.1 time: 0.121288 Aug 04 16:57:19.462171 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 421/805] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 16:57:19 2022] DELETE /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:57:19.470583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-97927887-6b5f-41f3-9a8a-bd9d72283548 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:19.471572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-97927887-6b5f-41f3-9a8a-bd9d72283548 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: 687e42c7-8cf6-41a3-b16f-6cc104223f58] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:19.477739 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-97927887-6b5f-41f3-9a8a-bd9d72283548 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:19.478270 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-97927887-6b5f-41f3-9a8a-bd9d72283548 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:19.478809 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-97927887-6b5f-41f3-9a8a-bd9d72283548 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:19.479476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-97927887-6b5f-41f3-9a8a-bd9d72283548 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:19.480103 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-97927887-6b5f-41f3-9a8a-bd9d72283548 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:19.480376 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-97927887-6b5f-41f3-9a8a-bd9d72283548 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:19.596062 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-43035c4f-450e-4c19-bca4-2fd9e2887d72 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:19.604461 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-43035c4f-450e-4c19-bca4-2fd9e2887d72 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d" status: 200 len: 1313 microversion: 2.1 time: 0.252508 Aug 04 16:57:19.605121 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 385/806] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:19 2022] GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:19.610652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5325e5f7-7d73-4b10-b78f-fbe83d19e08f tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:19.611263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5325e5f7-7d73-4b10-b78f-fbe83d19e08f tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:19.617001 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5325e5f7-7d73-4b10-b78f-fbe83d19e08f tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:19.617541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5325e5f7-7d73-4b10-b78f-fbe83d19e08f tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:19.618042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5325e5f7-7d73-4b10-b78f-fbe83d19e08f tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:19.618913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5325e5f7-7d73-4b10-b78f-fbe83d19e08f tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:19.619429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5325e5f7-7d73-4b10-b78f-fbe83d19e08f tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:19.619838 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5325e5f7-7d73-4b10-b78f-fbe83d19e08f tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:19.707237 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5325e5f7-7d73-4b10-b78f-fbe83d19e08f tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:19.715599 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5325e5f7-7d73-4b10-b78f-fbe83d19e08f tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:19.718417 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5325e5f7-7d73-4b10-b78f-fbe83d19e08f tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:19.723988 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5325e5f7-7d73-4b10-b78f-fbe83d19e08f tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1444 microversion: 2.75 time: 0.117402 Aug 04 16:57:19.766015 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 386/807] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:19 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1444 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:19.792960 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-97927887-6b5f-41f3-9a8a-bd9d72283548 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:19.808568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9b0bff7c-1717-4bc6-9404-229b56ef39cf tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:19.809191 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9b0bff7c-1717-4bc6-9404-229b56ef39cf tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: f2d3490d-12a5-453d-b698-80ca6550f0f0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:19.817436 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b0bff7c-1717-4bc6-9404-229b56ef39cf tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:19.817927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b0bff7c-1717-4bc6-9404-229b56ef39cf tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:19.818395 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b0bff7c-1717-4bc6-9404-229b56ef39cf tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:19.819245 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-97927887-6b5f-41f3-9a8a-bd9d72283548 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58" status: 200 len: 1466 microversion: 2.1 time: 0.347843 Aug 04 16:57:19.820078 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 422/808] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:19 2022] GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58 => generated 1466 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:19.820314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b0bff7c-1717-4bc6-9404-229b56ef39cf tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:19.820889 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b0bff7c-1717-4bc6-9404-229b56ef39cf tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:19.821335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b0bff7c-1717-4bc6-9404-229b56ef39cf tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:19.876461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e73f2a80-c23d-4d01-9dc8-814735c0d69d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:19.877102 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e73f2a80-c23d-4d01-9dc8-814735c0d69d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:19.884651 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e73f2a80-c23d-4d01-9dc8-814735c0d69d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:19.885172 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e73f2a80-c23d-4d01-9dc8-814735c0d69d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:19.885625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e73f2a80-c23d-4d01-9dc8-814735c0d69d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:19.887734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e73f2a80-c23d-4d01-9dc8-814735c0d69d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:19.887734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e73f2a80-c23d-4d01-9dc8-814735c0d69d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:19.887946 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e73f2a80-c23d-4d01-9dc8-814735c0d69d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:20.033043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9b0bff7c-1717-4bc6-9404-229b56ef39cf tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:20.042538 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9b0bff7c-1717-4bc6-9404-229b56ef39cf tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0" status: 200 len: 1590 microversion: 2.1 time: 0.238271 Aug 04 16:57:20.043801 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 387/809] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:19 2022] GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0 => generated 1590 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:20.048868 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-31ebfcf9-d142-48c2-b8c3-3ff5841c0849 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:20.049902 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-31ebfcf9-d142-48c2-b8c3-3ff5841c0849 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:20.061509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31ebfcf9-d142-48c2-b8c3-3ff5841c0849 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:20.062929 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31ebfcf9-d142-48c2-b8c3-3ff5841c0849 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:20.063475 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31ebfcf9-d142-48c2-b8c3-3ff5841c0849 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:20.064301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31ebfcf9-d142-48c2-b8c3-3ff5841c0849 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:20.065002 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31ebfcf9-d142-48c2-b8c3-3ff5841c0849 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:20.065523 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31ebfcf9-d142-48c2-b8c3-3ff5841c0849 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:20.147092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e73f2a80-c23d-4d01-9dc8-814735c0d69d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:20.156492 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e73f2a80-c23d-4d01-9dc8-814735c0d69d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1476 microversion: 2.1 time: 0.283957 Aug 04 16:57:20.157333 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 423/810] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:19 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1476 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:20.253864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-31ebfcf9-d142-48c2-b8c3-3ff5841c0849 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:20.261819 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-31ebfcf9-d142-48c2-b8c3-3ff5841c0849 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83" status: 200 len: 1316 microversion: 2.1 time: 0.216627 Aug 04 16:57:20.262502 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 388/811] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:20 2022] GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 => generated 1316 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:20.275388 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ef447b30-e9a9-4414-82da-5bd1d969c29d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:20.276553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ef447b30-e9a9-4414-82da-5bd1d969c29d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:20.284110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ef447b30-e9a9-4414-82da-5bd1d969c29d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:20.284685 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ef447b30-e9a9-4414-82da-5bd1d969c29d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:20.285263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ef447b30-e9a9-4414-82da-5bd1d969c29d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:20.286263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ef447b30-e9a9-4414-82da-5bd1d969c29d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:20.287007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ef447b30-e9a9-4414-82da-5bd1d969c29d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:20.287504 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ef447b30-e9a9-4414-82da-5bd1d969c29d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:20.336708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5d3b70db-3a57-4d16-98fe-fc2f210a5aba tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:20.337329 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5d3b70db-3a57-4d16-98fe-fc2f210a5aba tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:20.343895 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d3b70db-3a57-4d16-98fe-fc2f210a5aba tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:20.344385 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d3b70db-3a57-4d16-98fe-fc2f210a5aba tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:20.344819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d3b70db-3a57-4d16-98fe-fc2f210a5aba tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:20.345516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d3b70db-3a57-4d16-98fe-fc2f210a5aba tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:20.345970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d3b70db-3a57-4d16-98fe-fc2f210a5aba tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:20.346436 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d3b70db-3a57-4d16-98fe-fc2f210a5aba tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:20.479583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ef447b30-e9a9-4414-82da-5bd1d969c29d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:20.489264 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ef447b30-e9a9-4414-82da-5bd1d969c29d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:20.491142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ef447b30-e9a9-4414-82da-5bd1d969c29d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:20.492294 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ef447b30-e9a9-4414-82da-5bd1d969c29d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3" status: 200 len: 1361 microversion: 2.25 time: 0.221239 Aug 04 16:57:20.493183 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 424/812] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:20 2022] GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 => generated 1361 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:20.510623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5d3b70db-3a57-4d16-98fe-fc2f210a5aba tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:20.518874 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5d3b70db-3a57-4d16-98fe-fc2f210a5aba tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1359 microversion: 2.1 time: 0.185856 Aug 04 16:57:20.519619 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 389/813] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:20 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:20.625694 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2de724de-d280-495f-ab44-d2461f0e279d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:20.626375 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2de724de-d280-495f-ab44-d2461f0e279d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 02856bd5-3936-4593-b70d-ddf3452f440d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:20.632362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2de724de-d280-495f-ab44-d2461f0e279d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:20.632856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2de724de-d280-495f-ab44-d2461f0e279d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:20.633297 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2de724de-d280-495f-ab44-d2461f0e279d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:20.634035 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2de724de-d280-495f-ab44-d2461f0e279d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:20.634502 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2de724de-d280-495f-ab44-d2461f0e279d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:20.634935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2de724de-d280-495f-ab44-d2461f0e279d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:20.773557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2de724de-d280-495f-ab44-d2461f0e279d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:20.781841 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2de724de-d280-495f-ab44-d2461f0e279d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d" status: 200 len: 1462 microversion: 2.1 time: 0.160583 Aug 04 16:57:20.782438 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 425/814] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:20 2022] GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d => generated 1462 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:20.784139 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1bf54d30-5077-44f3-a7e3-1f3ad2d2e37b tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:20.784389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1bf54d30-5077-44f3-a7e3-1f3ad2d2e37b tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:20.791617 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1bf54d30-5077-44f3-a7e3-1f3ad2d2e37b tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:20.792055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1bf54d30-5077-44f3-a7e3-1f3ad2d2e37b tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:20.792540 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1bf54d30-5077-44f3-a7e3-1f3ad2d2e37b tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:20.793303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1bf54d30-5077-44f3-a7e3-1f3ad2d2e37b tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:20.793762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1bf54d30-5077-44f3-a7e3-1f3ad2d2e37b tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:20.794213 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1bf54d30-5077-44f3-a7e3-1f3ad2d2e37b tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:20.801888 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d6b5ea1b-c6bd-49c5-a180-65c7c16fd207 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:20.802653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d6b5ea1b-c6bd-49c5-a180-65c7c16fd207 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:20.809064 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6b5ea1b-c6bd-49c5-a180-65c7c16fd207 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:20.809650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6b5ea1b-c6bd-49c5-a180-65c7c16fd207 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:20.810190 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6b5ea1b-c6bd-49c5-a180-65c7c16fd207 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:20.810960 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6b5ea1b-c6bd-49c5-a180-65c7c16fd207 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:20.811537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6b5ea1b-c6bd-49c5-a180-65c7c16fd207 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:20.812032 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6b5ea1b-c6bd-49c5-a180-65c7c16fd207 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:20.911268 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1bf54d30-5077-44f3-a7e3-1f3ad2d2e37b tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:20.921259 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1bf54d30-5077-44f3-a7e3-1f3ad2d2e37b tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:20.923327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1bf54d30-5077-44f3-a7e3-1f3ad2d2e37b tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:20.928449 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1bf54d30-5077-44f3-a7e3-1f3ad2d2e37b tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1444 microversion: 2.75 time: 0.149439 Aug 04 16:57:20.929029 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 390/815] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:20 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1444 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:57:20.935407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d93976ee-9bc1-4058-8b9b-de26d3db1cd8 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:20.936027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d93976ee-9bc1-4058-8b9b-de26d3db1cd8 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: 687e42c7-8cf6-41a3-b16f-6cc104223f58] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:20.943401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d93976ee-9bc1-4058-8b9b-de26d3db1cd8 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:20.943903 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d93976ee-9bc1-4058-8b9b-de26d3db1cd8 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:20.944351 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d93976ee-9bc1-4058-8b9b-de26d3db1cd8 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:20.945118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d93976ee-9bc1-4058-8b9b-de26d3db1cd8 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:20.945589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d93976ee-9bc1-4058-8b9b-de26d3db1cd8 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:20.946046 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d93976ee-9bc1-4058-8b9b-de26d3db1cd8 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:21.006367 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d6b5ea1b-c6bd-49c5-a180-65c7c16fd207 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:21.015260 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d6b5ea1b-c6bd-49c5-a180-65c7c16fd207 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1314 microversion: 2.1 time: 0.217334 Aug 04 16:57:21.016326 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 426/816] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:20 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:21.035176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-2ba4aedd-3e82-4f03-8911-2473816ba229 req-68a2b3fb-2859-4885-a220-e6fd2c6c3bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2d3490d-12a5-453d-b698-80ca6550f0f0", "tag": "3e3d1de2-eec1-4af1-8d8a-6520bfe5cf96"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:21.045331 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-2ba4aedd-3e82-4f03-8911-2473816ba229 req-68a2b3fb-2859-4885-a220-e6fd2c6c3bd2 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:21.045876 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-2ba4aedd-3e82-4f03-8911-2473816ba229 req-68a2b3fb-2859-4885-a220-e6fd2c6c3bd2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:21.046451 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-2ba4aedd-3e82-4f03-8911-2473816ba229 req-68a2b3fb-2859-4885-a220-e6fd2c6c3bd2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:21.067566 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-2ba4aedd-3e82-4f03-8911-2473816ba229 req-68a2b3fb-2859-4885-a220-e6fd2c6c3bd2 service nova] Creating event network-changed:3e3d1de2-eec1-4af1-8d8a-6520bfe5cf96 for instance f2d3490d-12a5-453d-b698-80ca6550f0f0 on n-h1-851359-3 Aug 04 16:57:21.073879 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-2ba4aedd-3e82-4f03-8911-2473816ba229 req-68a2b3fb-2859-4885-a220-e6fd2c6c3bd2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042869 Aug 04 16:57:21.074730 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 427/817] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:21.169379 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d93976ee-9bc1-4058-8b9b-de26d3db1cd8 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:21.178631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b2b818db-1d64-42a0-ab2d-45435bcfee29 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:21.179348 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b2b818db-1d64-42a0-ab2d-45435bcfee29 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:21.187454 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d93976ee-9bc1-4058-8b9b-de26d3db1cd8 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58" status: 200 len: 1466 microversion: 2.1 time: 0.257331 Aug 04 16:57:21.188322 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 391/818] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:20 2022] GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58 => generated 1466 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:21.202198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2b818db-1d64-42a0-ab2d-45435bcfee29 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:21.202198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2b818db-1d64-42a0-ab2d-45435bcfee29 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:21.202198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2b818db-1d64-42a0-ab2d-45435bcfee29 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:21.202198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2b818db-1d64-42a0-ab2d-45435bcfee29 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:21.202198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2b818db-1d64-42a0-ab2d-45435bcfee29 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:21.202198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2b818db-1d64-42a0-ab2d-45435bcfee29 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:21.285095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-788f57ea-da75-4afd-a668-bb404839a61b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:21.286046 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-788f57ea-da75-4afd-a668-bb404839a61b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:21.299066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-788f57ea-da75-4afd-a668-bb404839a61b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:21.299688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-788f57ea-da75-4afd-a668-bb404839a61b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:21.300217 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-788f57ea-da75-4afd-a668-bb404839a61b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:21.302551 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-788f57ea-da75-4afd-a668-bb404839a61b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:21.304804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-788f57ea-da75-4afd-a668-bb404839a61b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:21.305359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-788f57ea-da75-4afd-a668-bb404839a61b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:21.646147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b2b818db-1d64-42a0-ab2d-45435bcfee29 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:21.657951 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b2b818db-1d64-42a0-ab2d-45435bcfee29 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1475 microversion: 2.1 time: 0.483533 Aug 04 16:57:21.659188 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 428/819] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:21 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1475 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:21.677664 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-32d10501-8851-4af6-bdfd-5e3cf6a95b36 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:21.678633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-32d10501-8851-4af6-bdfd-5e3cf6a95b36 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:21.685718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32d10501-8851-4af6-bdfd-5e3cf6a95b36 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:21.686758 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32d10501-8851-4af6-bdfd-5e3cf6a95b36 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:21.687442 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32d10501-8851-4af6-bdfd-5e3cf6a95b36 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:21.689058 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32d10501-8851-4af6-bdfd-5e3cf6a95b36 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:21.689710 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32d10501-8851-4af6-bdfd-5e3cf6a95b36 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:21.690413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32d10501-8851-4af6-bdfd-5e3cf6a95b36 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:21.770177 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-788f57ea-da75-4afd-a668-bb404839a61b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:21.772104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:21.778430 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-788f57ea-da75-4afd-a668-bb404839a61b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83" status: 200 len: 1316 microversion: 2.1 time: 0.498360 Aug 04 16:57:21.779156 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 392/820] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:21 2022] GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 => generated 1316 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:21.799673 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a7a06bb3-a286-4a7e-8635-5a48fa6e875f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:21.800695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a7a06bb3-a286-4a7e-8635-5a48fa6e875f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:21.804434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:21.809169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7a06bb3-a286-4a7e-8635-5a48fa6e875f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:21.809938 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7a06bb3-a286-4a7e-8635-5a48fa6e875f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:21.810554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7a06bb3-a286-4a7e-8635-5a48fa6e875f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:21.811376 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7a06bb3-a286-4a7e-8635-5a48fa6e875f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:21.811928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7a06bb3-a286-4a7e-8635-5a48fa6e875f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:21.812454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7a06bb3-a286-4a7e-8635-5a48fa6e875f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:22.395313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-32d10501-8851-4af6-bdfd-5e3cf6a95b36 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:22.404498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-32d10501-8851-4af6-bdfd-5e3cf6a95b36 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:22.406275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-32d10501-8851-4af6-bdfd-5e3cf6a95b36 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:22.407463 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-32d10501-8851-4af6-bdfd-5e3cf6a95b36 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3" status: 200 len: 1361 microversion: 2.25 time: 0.747856 Aug 04 16:57:22.408766 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 429/821] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:21 2022] GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 => generated 1361 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:22.416916 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-91f5b664-fe84-4faa-b11e-42ec43e0e770 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:22.417863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-91f5b664-fe84-4faa-b11e-42ec43e0e770 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:22.426970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91f5b664-fe84-4faa-b11e-42ec43e0e770 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:22.428076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91f5b664-fe84-4faa-b11e-42ec43e0e770 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:22.428205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91f5b664-fe84-4faa-b11e-42ec43e0e770 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:22.429030 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91f5b664-fe84-4faa-b11e-42ec43e0e770 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:22.429641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91f5b664-fe84-4faa-b11e-42ec43e0e770 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:22.430331 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91f5b664-fe84-4faa-b11e-42ec43e0e770 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:22.520617 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a7a06bb3-a286-4a7e-8635-5a48fa6e875f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:22.530329 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a7a06bb3-a286-4a7e-8635-5a48fa6e875f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1359 microversion: 2.1 time: 0.735917 Aug 04 16:57:22.531035 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 393/822] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:21 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1359 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:22.536321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a22981f6-f524-46d6-bfd4-b3119df2a250 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:22.537023 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a22981f6-f524-46d6-bfd4-b3119df2a250 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:22.545075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a22981f6-f524-46d6-bfd4-b3119df2a250 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:22.545914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a22981f6-f524-46d6-bfd4-b3119df2a250 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:22.546621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a22981f6-f524-46d6-bfd4-b3119df2a250 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:22.547586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a22981f6-f524-46d6-bfd4-b3119df2a250 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:22.548276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a22981f6-f524-46d6-bfd4-b3119df2a250 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:22.548910 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a22981f6-f524-46d6-bfd4-b3119df2a250 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:22.567708 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-91f5b664-fe84-4faa-b11e-42ec43e0e770 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:22.582034 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-91f5b664-fe84-4faa-b11e-42ec43e0e770 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:22.584799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-91f5b664-fe84-4faa-b11e-42ec43e0e770 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:22.596474 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-91f5b664-fe84-4faa-b11e-42ec43e0e770 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1444 microversion: 2.75 time: 0.184519 Aug 04 16:57:22.611606 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 430/823] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:22 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1444 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:22.625218 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4e9490dc-0bc4-48c7-ad7b-8c0f2f1d7160 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:22.626165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4e9490dc-0bc4-48c7-ad7b-8c0f2f1d7160 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: 687e42c7-8cf6-41a3-b16f-6cc104223f58] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:22.644881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e9490dc-0bc4-48c7-ad7b-8c0f2f1d7160 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:22.645400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e9490dc-0bc4-48c7-ad7b-8c0f2f1d7160 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:22.645853 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e9490dc-0bc4-48c7-ad7b-8c0f2f1d7160 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:22.646619 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e9490dc-0bc4-48c7-ad7b-8c0f2f1d7160 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:22.647207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e9490dc-0bc4-48c7-ad7b-8c0f2f1d7160 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:22.647524 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e9490dc-0bc4-48c7-ad7b-8c0f2f1d7160 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:22.934791 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a22981f6-f524-46d6-bfd4-b3119df2a250 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:22.948709 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a22981f6-f524-46d6-bfd4-b3119df2a250 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1314 microversion: 2.1 time: 0.416100 Aug 04 16:57:22.950095 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 394/824] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:22 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:22.978806 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-64491aca-fe5a-4fa7-9239-62518e4b731d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:22.981628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-64491aca-fe5a-4fa7-9239-62518e4b731d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:22.997184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64491aca-fe5a-4fa7-9239-62518e4b731d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:22.998066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64491aca-fe5a-4fa7-9239-62518e4b731d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:22.998745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64491aca-fe5a-4fa7-9239-62518e4b731d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:22.998860 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4e9490dc-0bc4-48c7-ad7b-8c0f2f1d7160 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:22.999802 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64491aca-fe5a-4fa7-9239-62518e4b731d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:23.000629 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64491aca-fe5a-4fa7-9239-62518e4b731d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:23.001439 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64491aca-fe5a-4fa7-9239-62518e4b731d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:23.020183 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4e9490dc-0bc4-48c7-ad7b-8c0f2f1d7160 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58" status: 200 len: 1466 microversion: 2.1 time: 0.405832 Aug 04 16:57:23.023853 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 431/825] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:22 2022] GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58 => generated 1466 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:23.059937 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b9c527d8-ac4d-4fce-a7dd-35715d767ca9 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:23.071061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b9c527d8-ac4d-4fce-a7dd-35715d767ca9 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:23.111632 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9c527d8-ac4d-4fce-a7dd-35715d767ca9 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:23.113149 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9c527d8-ac4d-4fce-a7dd-35715d767ca9 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:23.114061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9c527d8-ac4d-4fce-a7dd-35715d767ca9 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:23.115684 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9c527d8-ac4d-4fce-a7dd-35715d767ca9 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:23.116430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9c527d8-ac4d-4fce-a7dd-35715d767ca9 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:23.117186 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9c527d8-ac4d-4fce-a7dd-35715d767ca9 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:23.286292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-64491aca-fe5a-4fa7-9239-62518e4b731d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:23.293822 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-64491aca-fe5a-4fa7-9239-62518e4b731d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1475 microversion: 2.1 time: 0.342075 Aug 04 16:57:23.294446 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 395/826] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:22 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1475 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:23.300078 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-823261d8-5c25-424b-a582-de9870d36ffa req-f5e948eb-4556-46ec-af2b-4f90986e833b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "687e42c7-8cf6-41a3-b16f-6cc104223f58", "name": "network-vif-deleted", "tag": "ba2d2ad8-c9ad-4f5d-99d3-5361b3a0665e"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:23.310204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-823261d8-5c25-424b-a582-de9870d36ffa req-f5e948eb-4556-46ec-af2b-4f90986e833b service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:23.310824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-823261d8-5c25-424b-a582-de9870d36ffa req-f5e948eb-4556-46ec-af2b-4f90986e833b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:23.311064 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b9c527d8-ac4d-4fce-a7dd-35715d767ca9 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:23.311261 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-823261d8-5c25-424b-a582-de9870d36ffa req-f5e948eb-4556-46ec-af2b-4f90986e833b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:23.319031 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b9c527d8-ac4d-4fce-a7dd-35715d767ca9 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83" status: 200 len: 1316 microversion: 2.1 time: 0.286017 Aug 04 16:57:23.319790 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 432/827] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:23 2022] GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 => generated 1316 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:23.323411 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-823261d8-5c25-424b-a582-de9870d36ffa req-f5e948eb-4556-46ec-af2b-4f90986e833b service nova] Creating event network-vif-deleted:ba2d2ad8-c9ad-4f5d-99d3-5361b3a0665e for instance 687e42c7-8cf6-41a3-b16f-6cc104223f58 on n-h1-851359-3 Aug 04 16:57:23.330776 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-823261d8-5c25-424b-a582-de9870d36ffa req-f5e948eb-4556-46ec-af2b-4f90986e833b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034631 Aug 04 16:57:23.331391 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 396/828] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:23.430956 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-12a84106-fc68-41a3-b6b3-8355315fcbea tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:23.431623 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-12a84106-fc68-41a3-b6b3-8355315fcbea tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:23.438133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-12a84106-fc68-41a3-b6b3-8355315fcbea tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:23.439121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-12a84106-fc68-41a3-b6b3-8355315fcbea tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:23.439746 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-12a84106-fc68-41a3-b6b3-8355315fcbea tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:23.440216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-12a84106-fc68-41a3-b6b3-8355315fcbea tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:23.440792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-12a84106-fc68-41a3-b6b3-8355315fcbea tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:23.441230 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-12a84106-fc68-41a3-b6b3-8355315fcbea tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:23.555449 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5ce1d6b2-e28a-439f-95ad-ac3e07e52d0b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:23.556858 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5ce1d6b2-e28a-439f-95ad-ac3e07e52d0b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:23.565632 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ce1d6b2-e28a-439f-95ad-ac3e07e52d0b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:23.568280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ce1d6b2-e28a-439f-95ad-ac3e07e52d0b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:23.569551 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ce1d6b2-e28a-439f-95ad-ac3e07e52d0b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:23.571068 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ce1d6b2-e28a-439f-95ad-ac3e07e52d0b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:23.573213 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ce1d6b2-e28a-439f-95ad-ac3e07e52d0b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:23.575444 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ce1d6b2-e28a-439f-95ad-ac3e07e52d0b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:23.597542 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-12a84106-fc68-41a3-b6b3-8355315fcbea tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:23.609459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-12a84106-fc68-41a3-b6b3-8355315fcbea tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:23.611068 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-12a84106-fc68-41a3-b6b3-8355315fcbea tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:23.612260 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-12a84106-fc68-41a3-b6b3-8355315fcbea tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3" status: 200 len: 1361 microversion: 2.25 time: 0.185314 Aug 04 16:57:23.613073 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 433/829] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:23 2022] GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 => generated 1361 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:23.629678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e8c430c9-cf29-4efa-843b-2555a0acc2ae tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:23.630481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e8c430c9-cf29-4efa-843b-2555a0acc2ae tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:23.641805 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8c430c9-cf29-4efa-843b-2555a0acc2ae tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:23.642451 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8c430c9-cf29-4efa-843b-2555a0acc2ae tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:23.643052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8c430c9-cf29-4efa-843b-2555a0acc2ae tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:23.643778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8c430c9-cf29-4efa-843b-2555a0acc2ae tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:23.644317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8c430c9-cf29-4efa-843b-2555a0acc2ae tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:23.644818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8c430c9-cf29-4efa-843b-2555a0acc2ae tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:23.695383 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8c430c9-cf29-4efa-843b-2555a0acc2ae tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:23.696033 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8c430c9-cf29-4efa-843b-2555a0acc2ae tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:23.696525 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8c430c9-cf29-4efa-843b-2555a0acc2ae tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:23.697061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-e8c430c9-cf29-4efa-843b-2555a0acc2ae tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lazy-loading 'fault' on Instance uuid 96d30c66-24c7-4b25-81cd-fb638035a1cb {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:57:23.760402 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e8c430c9-cf29-4efa-843b-2555a0acc2ae tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:23.768579 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e8c430c9-cf29-4efa-843b-2555a0acc2ae tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:23.770126 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e8c430c9-cf29-4efa-843b-2555a0acc2ae tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24127ef4082b441999fe5b808ccac1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fff2f05e8d446a9bbf1a5e0b4fb51af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:23.775152 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e8c430c9-cf29-4efa-843b-2555a0acc2ae tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 200 len: 1449 microversion: 2.75 time: 0.150963 Aug 04 16:57:23.775726 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 434/830] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:23 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:23.780192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-4e1cf55d-51f6-4042-96bd-b8cbca35f310 req-8f5f35f4-a575-49b6-b70c-c0f7d6fbfb63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e92cd73d-ce71-4f92-9db9-ae02c7febbcb", "name": "network-vif-plugged", "status": "completed", "tag": "46af0dd3-3cdc-4c63-9694-d9b2f7cf2afa"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:23.790690 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-4e1cf55d-51f6-4042-96bd-b8cbca35f310 req-8f5f35f4-a575-49b6-b70c-c0f7d6fbfb63 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:23.791669 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-4e1cf55d-51f6-4042-96bd-b8cbca35f310 req-8f5f35f4-a575-49b6-b70c-c0f7d6fbfb63 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:23.792166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-4e1cf55d-51f6-4042-96bd-b8cbca35f310 req-8f5f35f4-a575-49b6-b70c-c0f7d6fbfb63 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:23.794120 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5ce1d6b2-e28a-439f-95ad-ac3e07e52d0b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:23.802800 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5ce1d6b2-e28a-439f-95ad-ac3e07e52d0b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1359 microversion: 2.1 time: 0.252285 Aug 04 16:57:23.803538 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 397/831] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:23 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1359 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:23.804641 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-4e1cf55d-51f6-4042-96bd-b8cbca35f310 req-8f5f35f4-a575-49b6-b70c-c0f7d6fbfb63 service nova] Creating event network-vif-plugged:46af0dd3-3cdc-4c63-9694-d9b2f7cf2afa for instance e92cd73d-ce71-4f92-9db9-ae02c7febbcb on n-h2-851359-3 Aug 04 16:57:23.809719 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-4e1cf55d-51f6-4042-96bd-b8cbca35f310 req-8f5f35f4-a575-49b6-b70c-c0f7d6fbfb63 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032897 Aug 04 16:57:23.810368 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 435/832] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:23.974818 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1cec1d3e-79fd-48be-b923-6e2615b0a3f0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:23.975470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1cec1d3e-79fd-48be-b923-6e2615b0a3f0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:23.985022 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cec1d3e-79fd-48be-b923-6e2615b0a3f0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:23.985825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cec1d3e-79fd-48be-b923-6e2615b0a3f0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:23.986614 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cec1d3e-79fd-48be-b923-6e2615b0a3f0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:23.987728 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cec1d3e-79fd-48be-b923-6e2615b0a3f0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:23.988511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cec1d3e-79fd-48be-b923-6e2615b0a3f0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:23.989172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cec1d3e-79fd-48be-b923-6e2615b0a3f0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:24.050601 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5944ab5a-c758-4491-bb3a-6c26928efde0 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:24.051766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5944ab5a-c758-4491-bb3a-6c26928efde0 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: 687e42c7-8cf6-41a3-b16f-6cc104223f58] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:24.062857 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5944ab5a-c758-4491-bb3a-6c26928efde0 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:24.063639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5944ab5a-c758-4491-bb3a-6c26928efde0 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:24.064339 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5944ab5a-c758-4491-bb3a-6c26928efde0 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:24.065184 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5944ab5a-c758-4491-bb3a-6c26928efde0 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:24.065664 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5944ab5a-c758-4491-bb3a-6c26928efde0 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:24.066718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5944ab5a-c758-4491-bb3a-6c26928efde0 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:24.090685 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:24.178818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5944ab5a-c758-4491-bb3a-6c26928efde0 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:24.191297 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5944ab5a-c758-4491-bb3a-6c26928efde0 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58" status: 200 len: 1297 microversion: 2.1 time: 0.146916 Aug 04 16:57:24.192891 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 436/833] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:24 2022] GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58 => generated 1297 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:24.211035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1cec1d3e-79fd-48be-b923-6e2615b0a3f0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:24.219290 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1cec1d3e-79fd-48be-b923-6e2615b0a3f0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1464 microversion: 2.1 time: 0.249094 Aug 04 16:57:24.219871 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 398/834] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:23 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1464 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:24.315341 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-39d2179c-1a5b-4fa8-8f2b-e88675fb9ae6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:24.315962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-39d2179c-1a5b-4fa8-8f2b-e88675fb9ae6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:24.318884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:24.322567 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39d2179c-1a5b-4fa8-8f2b-e88675fb9ae6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:24.323056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39d2179c-1a5b-4fa8-8f2b-e88675fb9ae6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:24.323492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39d2179c-1a5b-4fa8-8f2b-e88675fb9ae6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:24.324192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39d2179c-1a5b-4fa8-8f2b-e88675fb9ae6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:24.324664 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39d2179c-1a5b-4fa8-8f2b-e88675fb9ae6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:24.325072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39d2179c-1a5b-4fa8-8f2b-e88675fb9ae6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:24.328347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2d0a048f-52fe-4376-aec8-3050705c8ada tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-929198239", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "19c5ab52-7c2b-4d63-8628-43c75476e45c"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:24.386655 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-2d0a048f-52fe-4376-aec8-3050705c8ada tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:57:24.418964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:24.457816 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=5 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:24.550396 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-39d2179c-1a5b-4fa8-8f2b-e88675fb9ae6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:24.559922 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-39d2179c-1a5b-4fa8-8f2b-e88675fb9ae6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1473 microversion: 2.1 time: 0.248347 Aug 04 16:57:24.570444 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 437/835] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:24 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1473 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:24.570444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-02e8e314-ca2d-4d66-ad98-77152505fc3c tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:24.570444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-02e8e314-ca2d-4d66-ad98-77152505fc3c tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:24.575643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02e8e314-ca2d-4d66-ad98-77152505fc3c tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:24.575643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02e8e314-ca2d-4d66-ad98-77152505fc3c tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:24.575643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02e8e314-ca2d-4d66-ad98-77152505fc3c tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:24.575643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02e8e314-ca2d-4d66-ad98-77152505fc3c tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:24.575643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02e8e314-ca2d-4d66-ad98-77152505fc3c tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:24.575643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02e8e314-ca2d-4d66-ad98-77152505fc3c tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:24.705386 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-2d0a048f-52fe-4376-aec8-3050705c8ada tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:57:24.705953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-2d0a048f-52fe-4376-aec8-3050705c8ada tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:57:24.706298 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-2d0a048f-52fe-4376-aec8-3050705c8ada tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:57:24.706712 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-2d0a048f-52fe-4376-aec8-3050705c8ada tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:57:24.707124 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-2d0a048f-52fe-4376-aec8-3050705c8ada tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:57:24.716598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d0a048f-52fe-4376-aec8-3050705c8ada tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:24.717125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d0a048f-52fe-4376-aec8-3050705c8ada tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:24.717549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d0a048f-52fe-4376-aec8-3050705c8ada tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:24.718755 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d0a048f-52fe-4376-aec8-3050705c8ada tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:24.719215 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d0a048f-52fe-4376-aec8-3050705c8ada tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:24.719648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d0a048f-52fe-4376-aec8-3050705c8ada tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:24.738127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-2d0a048f-52fe-4376-aec8-3050705c8ada tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Getting quotas for project 42f88328efc24fa4b8e8e5023bd6d5a1. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:57:24.742962 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-2d0a048f-52fe-4376-aec8-3050705c8ada tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Getting quotas for user 2965e80f1b6e4cf8b750a28de3129541 and project 42f88328efc24fa4b8e8e5023bd6d5a1. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:57:24.755334 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2d0a048f-52fe-4376-aec8-3050705c8ada tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:57:24.757893 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2d0a048f-52fe-4376-aec8-3050705c8ada tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:57:24.768592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-02e8e314-ca2d-4d66-ad98-77152505fc3c tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:24.777198 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-02e8e314-ca2d-4d66-ad98-77152505fc3c tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83" status: 200 len: 1316 microversion: 2.1 time: 0.215088 Aug 04 16:57:24.777776 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 438/836] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:24 2022] GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 => generated 1316 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:24.782709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8fb08402-7a83-460a-aa63-fa1229b92995 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:24.783319 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8fb08402-7a83-460a-aa63-fa1229b92995 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:24.789966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fb08402-7a83-460a-aa63-fa1229b92995 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:24.790808 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fb08402-7a83-460a-aa63-fa1229b92995 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:24.791247 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fb08402-7a83-460a-aa63-fa1229b92995 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:24.792149 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fb08402-7a83-460a-aa63-fa1229b92995 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:24.792780 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fb08402-7a83-460a-aa63-fa1229b92995 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:24.793212 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fb08402-7a83-460a-aa63-fa1229b92995 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:24.804911 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2d0a048f-52fe-4376-aec8-3050705c8ada tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.482183 Aug 04 16:57:24.805724 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 399/837] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:57:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 16:57:24.810495 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3970dcf9-5a14-49d8-ba1f-6d93e40edbb4 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:24.811134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3970dcf9-5a14-49d8-ba1f-6d93e40edbb4 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] [instance: 96d30c66-24c7-4b25-81cd-fb638035a1cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:24.818490 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3970dcf9-5a14-49d8-ba1f-6d93e40edbb4 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:24.818983 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3970dcf9-5a14-49d8-ba1f-6d93e40edbb4 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:24.819554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3970dcf9-5a14-49d8-ba1f-6d93e40edbb4 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:24.820126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3970dcf9-5a14-49d8-ba1f-6d93e40edbb4 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:24.820636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3970dcf9-5a14-49d8-ba1f-6d93e40edbb4 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:24.820996 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3970dcf9-5a14-49d8-ba1f-6d93e40edbb4 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:24.825423 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:24.836476 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-3970dcf9-5a14-49d8-ba1f-6d93e40edbb4 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] HTTP exception thrown: Instance 96d30c66-24c7-4b25-81cd-fb638035a1cb could not be found. Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3970dcf9-5a14-49d8-ba1f-6d93e40edbb4 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Request method failure captured: Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb HTTP/1.1 Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_oPHJSCQxNYH6khmWlSxTYZdR0t1C9W7yxhKhLFU8P5HTLGhkvT5Uq2ftMoE2Mw93vNH3hQMTkWVJE77XgbqAFQ85oF9FoYUpr06DXKIuIX4IAFZRJ8eCquP_e7Qmf8BT03AO0rORMH5G3XUNmTcWeVOwN3kD6vQzP7y0zm7L-hegE Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.75 Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 3fff2f05e8d446a9bbf1a5e0b4fb51af Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersAdmin275Test-772502355 Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3fff2f05e8d446a9bbf1a5e0b4fb51af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3fff2f05e8d446a9bbf1a5e0b4fb51af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3fff2f05e8d446a9bbf1a5e0b4fb51af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3fff2f05e8d446a9bbf1a5e0b4fb51af"}]}] Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersAdmin275Test-772502355 Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 3fff2f05e8d446a9bbf1a5e0b4fb51af Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersAdmin275Test-772502355 Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersAdmin275Test-772502355-project Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 24127ef4082b441999fe5b808ccac1a4 Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersAdmin275Test-772502355-project Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 96d30c66-24c7-4b25-81cd-fb638035a1cb could not be found. Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '96d30c66-24c7-4b25-81cd-fb638035a1cb'} Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96d30c66-24c7-4b25-81cd-fb638035a1cb could not be found. Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96d30c66-24c7-4b25-81cd-fb638035a1cb could not be found. Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:24.838589 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:24.846313 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:24.846313 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:24.846313 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:24.846313 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:57:24.846313 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:57:24.846313 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96d30c66-24c7-4b25-81cd-fb638035a1cb could not be found. Aug 04 16:57:24.846313 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:24.846313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3970dcf9-5a14-49d8-ba1f-6d93e40edbb4 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] Returning 404 to user: Instance 96d30c66-24c7-4b25-81cd-fb638035a1cb could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:57:24.846313 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3970dcf9-5a14-49d8-ba1f-6d93e40edbb4 tempest-ServersAdmin275Test-772502355 tempest-ServersAdmin275Test-772502355-project] 10.222.0.93 "GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb" status: 404 len: 111 microversion: 2.75 time: 0.033410 Aug 04 16:57:24.846313 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 400/838] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:24 2022] GET /compute/v2.1/servers/96d30c66-24c7-4b25-81cd-fb638035a1cb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:57:24.846313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-139f70ee-569e-437a-8b3f-b09defe41fad tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:24.846313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-139f70ee-569e-437a-8b3f-b09defe41fad tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:24.913250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-139f70ee-569e-437a-8b3f-b09defe41fad tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:24.921449 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-139f70ee-569e-437a-8b3f-b09defe41fad tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9" status: 200 len: 1213 microversion: 2.1 time: 0.079716 Aug 04 16:57:24.934613 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 401/839] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:24 2022] GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9 => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:24.941033 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4f770f6b-65e4-4961-a056-c0c4dadeecbb tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:24.941667 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4f770f6b-65e4-4961-a056-c0c4dadeecbb tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:24.953246 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f770f6b-65e4-4961-a056-c0c4dadeecbb tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:24.953765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f770f6b-65e4-4961-a056-c0c4dadeecbb tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:24.954331 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f770f6b-65e4-4961-a056-c0c4dadeecbb tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:24.954955 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f770f6b-65e4-4961-a056-c0c4dadeecbb tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:24.955421 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f770f6b-65e4-4961-a056-c0c4dadeecbb tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:24.955854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f770f6b-65e4-4961-a056-c0c4dadeecbb tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:24.987726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8fb08402-7a83-460a-aa63-fa1229b92995 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:25.008534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8fb08402-7a83-460a-aa63-fa1229b92995 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:25.010366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8fb08402-7a83-460a-aa63-fa1229b92995 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:25.011801 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8fb08402-7a83-460a-aa63-fa1229b92995 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3" status: 200 len: 1361 microversion: 2.25 time: 0.232638 Aug 04 16:57:25.012092 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 439/840] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:24 2022] GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 => generated 1361 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:25.113703 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4f770f6b-65e4-4961-a056-c0c4dadeecbb tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:25.123770 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4f770f6b-65e4-4961-a056-c0c4dadeecbb tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1359 microversion: 2.1 time: 0.187475 Aug 04 16:57:25.137207 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 402/841] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:24 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1359 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:25.213272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-de9e41dc-b24a-439e-9119-7035ad26f14e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:25.213901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-de9e41dc-b24a-439e-9119-7035ad26f14e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: 687e42c7-8cf6-41a3-b16f-6cc104223f58] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:25.221460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de9e41dc-b24a-439e-9119-7035ad26f14e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:25.222026 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de9e41dc-b24a-439e-9119-7035ad26f14e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:25.222929 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de9e41dc-b24a-439e-9119-7035ad26f14e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:25.223657 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de9e41dc-b24a-439e-9119-7035ad26f14e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:25.224295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de9e41dc-b24a-439e-9119-7035ad26f14e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:25.224738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de9e41dc-b24a-439e-9119-7035ad26f14e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:25.258073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de9e41dc-b24a-439e-9119-7035ad26f14e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:25.258629 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de9e41dc-b24a-439e-9119-7035ad26f14e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:25.259041 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de9e41dc-b24a-439e-9119-7035ad26f14e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:25.259497 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-de9e41dc-b24a-439e-9119-7035ad26f14e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lazy-loading 'fault' on Instance uuid 687e42c7-8cf6-41a3-b16f-6cc104223f58 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:57:25.305101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-de9e41dc-b24a-439e-9119-7035ad26f14e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:25.311028 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=8 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:25.314020 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-de9e41dc-b24a-439e-9119-7035ad26f14e tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58" status: 200 len: 1311 microversion: 2.1 time: 0.104426 Aug 04 16:57:25.314592 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 440/842] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:25 2022] GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58 => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:25.584162 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e5f96c85-d3b8-4ea1-9713-2239e6fbfe1f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:25.584814 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e5f96c85-d3b8-4ea1-9713-2239e6fbfe1f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:25.590850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5f96c85-d3b8-4ea1-9713-2239e6fbfe1f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:25.591381 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5f96c85-d3b8-4ea1-9713-2239e6fbfe1f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:25.592378 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5f96c85-d3b8-4ea1-9713-2239e6fbfe1f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:25.593300 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5f96c85-d3b8-4ea1-9713-2239e6fbfe1f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:25.593779 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5f96c85-d3b8-4ea1-9713-2239e6fbfe1f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:25.594247 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5f96c85-d3b8-4ea1-9713-2239e6fbfe1f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:25.756147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e5f96c85-d3b8-4ea1-9713-2239e6fbfe1f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:25.768960 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e5f96c85-d3b8-4ea1-9713-2239e6fbfe1f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1473 microversion: 2.1 time: 0.188967 Aug 04 16:57:25.770295 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 403/843] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:25 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1473 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:25.802054 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e321e6b0-3a3c-4380-b78a-31d5b2a463dd tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:25.802942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e321e6b0-3a3c-4380-b78a-31d5b2a463dd tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:25.810302 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e321e6b0-3a3c-4380-b78a-31d5b2a463dd tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:25.810847 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e321e6b0-3a3c-4380-b78a-31d5b2a463dd tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:25.811643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e321e6b0-3a3c-4380-b78a-31d5b2a463dd tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:25.812393 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e321e6b0-3a3c-4380-b78a-31d5b2a463dd tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:25.812987 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e321e6b0-3a3c-4380-b78a-31d5b2a463dd tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:25.813436 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e321e6b0-3a3c-4380-b78a-31d5b2a463dd tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:25.835033 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-1b2160ff-68b1-49c9-afc3-6e7a7d70845f req-6826a7d4-38a3-4601-b466-775ccadadf76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cfbd46c-8842-4119-a0d0-7bf5827e45d3", "name": "network-vif-unplugged", "status": "completed", "tag": "6b6134e1-88b8-41c8-9a22-a162b6145647"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:25.846836 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1b2160ff-68b1-49c9-afc3-6e7a7d70845f req-6826a7d4-38a3-4601-b466-775ccadadf76 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:25.847328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1b2160ff-68b1-49c9-afc3-6e7a7d70845f req-6826a7d4-38a3-4601-b466-775ccadadf76 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:25.847769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1b2160ff-68b1-49c9-afc3-6e7a7d70845f req-6826a7d4-38a3-4601-b466-775ccadadf76 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:25.861146 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-1b2160ff-68b1-49c9-afc3-6e7a7d70845f req-6826a7d4-38a3-4601-b466-775ccadadf76 service nova] Creating event network-vif-unplugged:6b6134e1-88b8-41c8-9a22-a162b6145647 for instance 6cfbd46c-8842-4119-a0d0-7bf5827e45d3 on n-h1-851359-3 Aug 04 16:57:25.867202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-1b2160ff-68b1-49c9-afc3-6e7a7d70845f req-6826a7d4-38a3-4601-b466-775ccadadf76 service nova] Instance 6cfbd46c-8842-4119-a0d0-7bf5827e45d3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 16:57:25.874076 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-1b2160ff-68b1-49c9-afc3-6e7a7d70845f req-6826a7d4-38a3-4601-b466-775ccadadf76 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043307 Aug 04 16:57:25.875439 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 404/844] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:57:25.945099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-192d735e-73b9-4c3b-9018-7d26f6c06bcc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:25.945824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-192d735e-73b9-4c3b-9018-7d26f6c06bcc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:25.952385 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-192d735e-73b9-4c3b-9018-7d26f6c06bcc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:25.953292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-192d735e-73b9-4c3b-9018-7d26f6c06bcc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:25.953900 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-192d735e-73b9-4c3b-9018-7d26f6c06bcc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:25.954825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-192d735e-73b9-4c3b-9018-7d26f6c06bcc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:25.955452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-192d735e-73b9-4c3b-9018-7d26f6c06bcc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:25.956045 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-192d735e-73b9-4c3b-9018-7d26f6c06bcc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:25.967470 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e321e6b0-3a3c-4380-b78a-31d5b2a463dd tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:25.977064 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e321e6b0-3a3c-4380-b78a-31d5b2a463dd tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83" status: 200 len: 1316 microversion: 2.1 time: 0.182962 Aug 04 16:57:25.990452 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 441/845] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:25 2022] GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 => generated 1316 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:26.036540 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a1436e36-6b7d-4fe4-8e3d-ef041976d826 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:26.037198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a1436e36-6b7d-4fe4-8e3d-ef041976d826 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:26.043985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a1436e36-6b7d-4fe4-8e3d-ef041976d826 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:26.044496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a1436e36-6b7d-4fe4-8e3d-ef041976d826 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:26.044969 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a1436e36-6b7d-4fe4-8e3d-ef041976d826 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:26.045697 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a1436e36-6b7d-4fe4-8e3d-ef041976d826 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:26.046232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a1436e36-6b7d-4fe4-8e3d-ef041976d826 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:26.046868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a1436e36-6b7d-4fe4-8e3d-ef041976d826 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:26.047823 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-192d735e-73b9-4c3b-9018-7d26f6c06bcc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:26.055737 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-192d735e-73b9-4c3b-9018-7d26f6c06bcc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9" status: 200 len: 1265 microversion: 2.1 time: 0.115682 Aug 04 16:57:26.056321 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 405/846] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:25 2022] GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9 => generated 1265 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:26.150730 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b9e1a0ae-673e-4ea2-88e4-f3a31d56990c tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:26.152343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b9e1a0ae-673e-4ea2-88e4-f3a31d56990c tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:26.162997 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9e1a0ae-673e-4ea2-88e4-f3a31d56990c tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:26.164043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9e1a0ae-673e-4ea2-88e4-f3a31d56990c tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:26.165334 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9e1a0ae-673e-4ea2-88e4-f3a31d56990c tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:26.168033 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9e1a0ae-673e-4ea2-88e4-f3a31d56990c tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:26.169028 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9e1a0ae-673e-4ea2-88e4-f3a31d56990c tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:26.169696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9e1a0ae-673e-4ea2-88e4-f3a31d56990c tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:26.389350 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a1436e36-6b7d-4fe4-8e3d-ef041976d826 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:26.400503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a1436e36-6b7d-4fe4-8e3d-ef041976d826 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:26.402386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a1436e36-6b7d-4fe4-8e3d-ef041976d826 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:26.404765 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a1436e36-6b7d-4fe4-8e3d-ef041976d826 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3" status: 200 len: 1361 microversion: 2.25 time: 0.372321 Aug 04 16:57:26.405691 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 442/847] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:26 2022] GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 => generated 1361 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:26.412242 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6ea857b1-df5a-47f5-9f5b-a0c23daa5d00 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:26.413032 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6ea857b1-df5a-47f5-9f5b-a0c23daa5d00 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: 687e42c7-8cf6-41a3-b16f-6cc104223f58] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:26.451669 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ea857b1-df5a-47f5-9f5b-a0c23daa5d00 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:26.457796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ea857b1-df5a-47f5-9f5b-a0c23daa5d00 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:26.458871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ea857b1-df5a-47f5-9f5b-a0c23daa5d00 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:26.463978 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ea857b1-df5a-47f5-9f5b-a0c23daa5d00 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:26.467646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ea857b1-df5a-47f5-9f5b-a0c23daa5d00 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:26.468737 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ea857b1-df5a-47f5-9f5b-a0c23daa5d00 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:26.505887 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b9e1a0ae-673e-4ea2-88e4-f3a31d56990c tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:26.513741 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b9e1a0ae-673e-4ea2-88e4-f3a31d56990c tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1542 microversion: 2.1 time: 0.370543 Aug 04 16:57:26.515015 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 406/848] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:26 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1542 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:26.538639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bb0ed956-c764-405a-84bd-394d23064c08 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:26.539480 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bb0ed956-c764-405a-84bd-394d23064c08 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:26.543124 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ea857b1-df5a-47f5-9f5b-a0c23daa5d00 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:26.544072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ea857b1-df5a-47f5-9f5b-a0c23daa5d00 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:26.545251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ea857b1-df5a-47f5-9f5b-a0c23daa5d00 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:26.546881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-6ea857b1-df5a-47f5-9f5b-a0c23daa5d00 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lazy-loading 'fault' on Instance uuid 687e42c7-8cf6-41a3-b16f-6cc104223f58 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:57:26.559196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb0ed956-c764-405a-84bd-394d23064c08 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:26.560359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb0ed956-c764-405a-84bd-394d23064c08 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:26.560927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb0ed956-c764-405a-84bd-394d23064c08 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:26.561772 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb0ed956-c764-405a-84bd-394d23064c08 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:26.562408 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb0ed956-c764-405a-84bd-394d23064c08 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:26.571767 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb0ed956-c764-405a-84bd-394d23064c08 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:26.615109 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6ea857b1-df5a-47f5-9f5b-a0c23daa5d00 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:26.624717 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6ea857b1-df5a-47f5-9f5b-a0c23daa5d00 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58" status: 200 len: 1311 microversion: 2.1 time: 0.216821 Aug 04 16:57:26.630026 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 443/849] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:26 2022] GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58 => generated 1311 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:26.690360 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bb0ed956-c764-405a-84bd-394d23064c08 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.156772 Aug 04 16:57:26.693027 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 407/850] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Aug 4 16:57:26 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:26.794554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-92cc07ef-91b3-44d0-bb3a-fb1b842703cb tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:26.795783 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-92cc07ef-91b3-44d0-bb3a-fb1b842703cb tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:26.803147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92cc07ef-91b3-44d0-bb3a-fb1b842703cb tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:26.805222 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92cc07ef-91b3-44d0-bb3a-fb1b842703cb tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:26.805674 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92cc07ef-91b3-44d0-bb3a-fb1b842703cb tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:26.806459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92cc07ef-91b3-44d0-bb3a-fb1b842703cb tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:26.807383 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92cc07ef-91b3-44d0-bb3a-fb1b842703cb tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:26.808007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92cc07ef-91b3-44d0-bb3a-fb1b842703cb tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:27.003831 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7a5a4782-78b6-4371-a3e9-0c6447cb03bd tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:27.004732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7a5a4782-78b6-4371-a3e9-0c6447cb03bd tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:27.011457 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a5a4782-78b6-4371-a3e9-0c6447cb03bd tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:27.013277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a5a4782-78b6-4371-a3e9-0c6447cb03bd tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:27.014589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a5a4782-78b6-4371-a3e9-0c6447cb03bd tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:27.015514 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a5a4782-78b6-4371-a3e9-0c6447cb03bd tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:27.016137 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a5a4782-78b6-4371-a3e9-0c6447cb03bd tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:27.016741 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a5a4782-78b6-4371-a3e9-0c6447cb03bd tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:27.312892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-92cc07ef-91b3-44d0-bb3a-fb1b842703cb tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:27.334142 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-92cc07ef-91b3-44d0-bb3a-fb1b842703cb tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1473 microversion: 2.1 time: 0.542494 Aug 04 16:57:27.349120 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 444/851] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:26 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1473 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:27.362360 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1d41aa85-9eac-4ffc-a204-cf8029ba3401 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:27.363689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1d41aa85-9eac-4ffc-a204-cf8029ba3401 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:27.382038 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d41aa85-9eac-4ffc-a204-cf8029ba3401 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:27.382580 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d41aa85-9eac-4ffc-a204-cf8029ba3401 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:27.383136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d41aa85-9eac-4ffc-a204-cf8029ba3401 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:27.386026 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d41aa85-9eac-4ffc-a204-cf8029ba3401 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:27.388593 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d41aa85-9eac-4ffc-a204-cf8029ba3401 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:27.389767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d41aa85-9eac-4ffc-a204-cf8029ba3401 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:27.495939 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7a5a4782-78b6-4371-a3e9-0c6447cb03bd tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:27.509425 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7a5a4782-78b6-4371-a3e9-0c6447cb03bd tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83" status: 200 len: 1316 microversion: 2.1 time: 0.511769 Aug 04 16:57:27.510040 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 408/852] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:26 2022] GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 => generated 1316 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:27.515508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-43c2e491-cd1b-4069-b058-39b649f98b7d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:27.516336 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-43c2e491-cd1b-4069-b058-39b649f98b7d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:27.536126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43c2e491-cd1b-4069-b058-39b649f98b7d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:27.537170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43c2e491-cd1b-4069-b058-39b649f98b7d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:27.537771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43c2e491-cd1b-4069-b058-39b649f98b7d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:27.538631 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43c2e491-cd1b-4069-b058-39b649f98b7d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:27.539203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43c2e491-cd1b-4069-b058-39b649f98b7d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:27.539709 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43c2e491-cd1b-4069-b058-39b649f98b7d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:27.590596 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1d41aa85-9eac-4ffc-a204-cf8029ba3401 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:27.602737 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1d41aa85-9eac-4ffc-a204-cf8029ba3401 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9" status: 200 len: 1271 microversion: 2.1 time: 0.261574 Aug 04 16:57:27.616876 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 445/853] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:27 2022] GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9 => generated 1271 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:27.646383 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2899efc5-7fdd-4eed-896e-d523f8f931c9 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:27.647665 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2899efc5-7fdd-4eed-896e-d523f8f931c9 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: 687e42c7-8cf6-41a3-b16f-6cc104223f58] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:27.654683 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2899efc5-7fdd-4eed-896e-d523f8f931c9 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:27.655499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2899efc5-7fdd-4eed-896e-d523f8f931c9 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:27.655943 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2899efc5-7fdd-4eed-896e-d523f8f931c9 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:27.656705 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2899efc5-7fdd-4eed-896e-d523f8f931c9 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:27.657177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2899efc5-7fdd-4eed-896e-d523f8f931c9 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:27.657832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2899efc5-7fdd-4eed-896e-d523f8f931c9 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:27.674881 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-2899efc5-7fdd-4eed-896e-d523f8f931c9 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] HTTP exception thrown: Instance 687e42c7-8cf6-41a3-b16f-6cc104223f58 could not be found. Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2899efc5-7fdd-4eed-896e-d523f8f931c9 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Request method failure captured: Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58 HTTP/1.1 Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_o5tvNUrytWwopCcPsX3sVwq0RJSMQ6xReEWCJW3KUfTu5KNPnS-pXcHgq6H7nCp3-3XkCgucUkwvDeVNykNbcjKbtr7PgsjG1PCXpkQFq1V6OvMAuCPCm58Jj0l0HAZtyCupoqvczGgJeKlF-Q1ILa9RWWb947hvBiseFFn7JSHR4 Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 3db0dbf55e504a95903556ffd03801fe Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-594088838 Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3db0dbf55e504a95903556ffd03801fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3db0dbf55e504a95903556ffd03801fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3db0dbf55e504a95903556ffd03801fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3db0dbf55e504a95903556ffd03801fe"}]}] Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersAdminNegativeTestJSON-594088838 Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 3db0dbf55e504a95903556ffd03801fe Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-594088838 Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersAdminNegativeTestJSON-594088838-project Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 774f01840dcc4fb9a160f4e3707c20ef Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersAdminNegativeTestJSON-594088838-project Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 687e42c7-8cf6-41a3-b16f-6cc104223f58 could not be found. Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '687e42c7-8cf6-41a3-b16f-6cc104223f58'} Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 687e42c7-8cf6-41a3-b16f-6cc104223f58 could not be found. Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 687e42c7-8cf6-41a3-b16f-6cc104223f58 could not be found. Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:57:27.676642 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:27.683044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:57:27.683044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:27.683044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:27.683044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:27.683044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:57:27.683044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:57:27.683044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 687e42c7-8cf6-41a3-b16f-6cc104223f58 could not be found. Aug 04 16:57:27.683044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:57:27.683044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2899efc5-7fdd-4eed-896e-d523f8f931c9 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Returning 404 to user: Instance 687e42c7-8cf6-41a3-b16f-6cc104223f58 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:57:27.683044 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2899efc5-7fdd-4eed-896e-d523f8f931c9 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58" status: 404 len: 111 microversion: 2.1 time: 0.037108 Aug 04 16:57:27.683044 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 446/854] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:27 2022] GET /compute/v2.1/servers/687e42c7-8cf6-41a3-b16f-6cc104223f58 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:57:27.687950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7f0d14ee-1dc6-473b-854c-ac7aa6080f81 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:27.688467 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7f0d14ee-1dc6-473b-854c-ac7aa6080f81 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: b8efce6c-198e-49a7-8576-32d80cb168df] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:27.694897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7f0d14ee-1dc6-473b-854c-ac7aa6080f81 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:27.695403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7f0d14ee-1dc6-473b-854c-ac7aa6080f81 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:27.695852 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7f0d14ee-1dc6-473b-854c-ac7aa6080f81 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:27.696581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7f0d14ee-1dc6-473b-854c-ac7aa6080f81 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:27.697049 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7f0d14ee-1dc6-473b-854c-ac7aa6080f81 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:27.697486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7f0d14ee-1dc6-473b-854c-ac7aa6080f81 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:27.726157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7f0d14ee-1dc6-473b-854c-ac7aa6080f81 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: b8efce6c-198e-49a7-8576-32d80cb168df] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:57:27.829578 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7f0d14ee-1dc6-473b-854c-ac7aa6080f81 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df" status: 204 len: 0 microversion: 2.1 time: 0.145670 Aug 04 16:57:27.831303 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 447/855] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 16:57:27 2022] DELETE /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:57:27.841511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f7869d3f-542e-4c09-9b08-ff8c9ced2d25 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:27.845557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f7869d3f-542e-4c09-9b08-ff8c9ced2d25 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: b8efce6c-198e-49a7-8576-32d80cb168df] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:27.853281 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7869d3f-542e-4c09-9b08-ff8c9ced2d25 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:27.853803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7869d3f-542e-4c09-9b08-ff8c9ced2d25 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:27.854539 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7869d3f-542e-4c09-9b08-ff8c9ced2d25 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:27.855559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7869d3f-542e-4c09-9b08-ff8c9ced2d25 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:27.856053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7869d3f-542e-4c09-9b08-ff8c9ced2d25 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:27.856498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7869d3f-542e-4c09-9b08-ff8c9ced2d25 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:28.246690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-43c2e491-cd1b-4069-b058-39b649f98b7d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:28.256631 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-43c2e491-cd1b-4069-b058-39b649f98b7d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:28.258202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-43c2e491-cd1b-4069-b058-39b649f98b7d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:28.260203 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-43c2e491-cd1b-4069-b058-39b649f98b7d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3" status: 200 len: 1361 microversion: 2.25 time: 0.749188 Aug 04 16:57:28.260784 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 409/856] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:27 2022] GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 => generated 1361 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:28.284795 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f7869d3f-542e-4c09-9b08-ff8c9ced2d25 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:28.293134 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f7869d3f-542e-4c09-9b08-ff8c9ced2d25 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df" status: 200 len: 1478 microversion: 2.1 time: 0.456940 Aug 04 16:57:28.294018 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 448/857] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:27 2022] GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df => generated 1478 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:28.361956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6444fe62-fdae-4658-b33c-5fd1ef9aaadf tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:28.362777 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6444fe62-fdae-4658-b33c-5fd1ef9aaadf tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:28.369129 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6444fe62-fdae-4658-b33c-5fd1ef9aaadf tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:28.369783 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6444fe62-fdae-4658-b33c-5fd1ef9aaadf tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:28.370526 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6444fe62-fdae-4658-b33c-5fd1ef9aaadf tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:28.371340 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6444fe62-fdae-4658-b33c-5fd1ef9aaadf tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:28.371908 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6444fe62-fdae-4658-b33c-5fd1ef9aaadf tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:28.374189 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6444fe62-fdae-4658-b33c-5fd1ef9aaadf tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:28.531721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3af2be30-264d-4ce9-96dd-6e11f4f2cee1 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:28.534513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3af2be30-264d-4ce9-96dd-6e11f4f2cee1 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:28.543180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3af2be30-264d-4ce9-96dd-6e11f4f2cee1 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:28.543672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3af2be30-264d-4ce9-96dd-6e11f4f2cee1 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:28.551974 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3af2be30-264d-4ce9-96dd-6e11f4f2cee1 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:28.552778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3af2be30-264d-4ce9-96dd-6e11f4f2cee1 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:28.554776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3af2be30-264d-4ce9-96dd-6e11f4f2cee1 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:28.560433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3af2be30-264d-4ce9-96dd-6e11f4f2cee1 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:28.845863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6444fe62-fdae-4658-b33c-5fd1ef9aaadf tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:28.854224 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6444fe62-fdae-4658-b33c-5fd1ef9aaadf tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1470 microversion: 2.1 time: 0.496896 Aug 04 16:57:28.855147 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 410/858] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:28 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1470 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:28.860113 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-967afee5-b21c-4de7-a9ae-714a7ff313bf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:28.860939 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-967afee5-b21c-4de7-a9ae-714a7ff313bf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:28.867161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-967afee5-b21c-4de7-a9ae-714a7ff313bf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:28.867828 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-967afee5-b21c-4de7-a9ae-714a7ff313bf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:28.868444 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-967afee5-b21c-4de7-a9ae-714a7ff313bf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:28.869300 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-967afee5-b21c-4de7-a9ae-714a7ff313bf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:28.869900 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-967afee5-b21c-4de7-a9ae-714a7ff313bf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:28.870503 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-967afee5-b21c-4de7-a9ae-714a7ff313bf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:28.982174 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3af2be30-264d-4ce9-96dd-6e11f4f2cee1 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:29.002977 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3af2be30-264d-4ce9-96dd-6e11f4f2cee1 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83" status: 200 len: 1316 microversion: 2.1 time: 0.472510 Aug 04 16:57:29.003705 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 449/859] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:28 2022] GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 => generated 1316 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:29.017505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f5ad1623-d0dd-4131-b9e8-1b38e6221add tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:29.018353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f5ad1623-d0dd-4131-b9e8-1b38e6221add tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:29.037334 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5ad1623-d0dd-4131-b9e8-1b38e6221add tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:29.038701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5ad1623-d0dd-4131-b9e8-1b38e6221add tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:29.039177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5ad1623-d0dd-4131-b9e8-1b38e6221add tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:29.041855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5ad1623-d0dd-4131-b9e8-1b38e6221add tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:29.044043 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5ad1623-d0dd-4131-b9e8-1b38e6221add tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:29.044502 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5ad1623-d0dd-4131-b9e8-1b38e6221add tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:29.150187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:29.187686 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f5ad1623-d0dd-4131-b9e8-1b38e6221add tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "POST /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3/action" status: 204 len: 0 microversion: 2.1 time: 0.182700 Aug 04 16:57:29.190936 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 450/860] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:57:29 2022] POST /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3/action => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:57:29.194997 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-967afee5-b21c-4de7-a9ae-714a7ff313bf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:29.206886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4833c2c1-962c-4676-9f2f-30753058a531 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:29.207956 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4833c2c1-962c-4676-9f2f-30753058a531 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:29.221437 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4833c2c1-962c-4676-9f2f-30753058a531 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:29.222238 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4833c2c1-962c-4676-9f2f-30753058a531 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:29.224837 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4833c2c1-962c-4676-9f2f-30753058a531 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:29.225938 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4833c2c1-962c-4676-9f2f-30753058a531 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:29.229158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4833c2c1-962c-4676-9f2f-30753058a531 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:29.230095 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4833c2c1-962c-4676-9f2f-30753058a531 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:29.279843 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-967afee5-b21c-4de7-a9ae-714a7ff313bf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9" status: 200 len: 1313 microversion: 2.1 time: 0.423363 Aug 04 16:57:29.280442 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 411/861] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:28 2022] GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9 => generated 1313 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:29.285371 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-476377fb-2cf9-43ec-9c99-d2fce5ea7bd6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:29.286212 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-476377fb-2cf9-43ec-9c99-d2fce5ea7bd6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:29.301346 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-476377fb-2cf9-43ec-9c99-d2fce5ea7bd6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:29.302135 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-476377fb-2cf9-43ec-9c99-d2fce5ea7bd6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:29.302766 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-476377fb-2cf9-43ec-9c99-d2fce5ea7bd6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:29.303707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-476377fb-2cf9-43ec-9c99-d2fce5ea7bd6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:29.304319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-476377fb-2cf9-43ec-9c99-d2fce5ea7bd6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:29.304890 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-476377fb-2cf9-43ec-9c99-d2fce5ea7bd6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:29.662541 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4833c2c1-962c-4676-9f2f-30753058a531 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:29.676566 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4833c2c1-962c-4676-9f2f-30753058a531 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1470 microversion: 2.1 time: 0.480452 Aug 04 16:57:29.691574 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 451/862] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:29 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1470 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:29.691574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2aa32cb9-7f80-4ac6-b7d8-25abcc85c625 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:29.693249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2aa32cb9-7f80-4ac6-b7d8-25abcc85c625 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: b8efce6c-198e-49a7-8576-32d80cb168df] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:29.705659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2aa32cb9-7f80-4ac6-b7d8-25abcc85c625 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:29.706380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2aa32cb9-7f80-4ac6-b7d8-25abcc85c625 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:29.706835 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2aa32cb9-7f80-4ac6-b7d8-25abcc85c625 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:29.708748 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2aa32cb9-7f80-4ac6-b7d8-25abcc85c625 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:29.710431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2aa32cb9-7f80-4ac6-b7d8-25abcc85c625 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:29.711405 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2aa32cb9-7f80-4ac6-b7d8-25abcc85c625 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:29.779634 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-476377fb-2cf9-43ec-9c99-d2fce5ea7bd6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:29.799497 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-476377fb-2cf9-43ec-9c99-d2fce5ea7bd6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:29.801565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-476377fb-2cf9-43ec-9c99-d2fce5ea7bd6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:29.802866 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-476377fb-2cf9-43ec-9c99-d2fce5ea7bd6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3" status: 200 len: 1361 microversion: 2.25 time: 0.521298 Aug 04 16:57:29.803794 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 412/863] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:29 2022] GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 => generated 1361 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:29.819514 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-7de6dfb2-4489-4250-9ab6-f82c0cd7a36f req-ec21f3cc-f5ec-4321-890d-9ba7fdd36e26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e92cd73d-ce71-4f92-9db9-ae02c7febbcb", "tag": "46af0dd3-3cdc-4c63-9694-d9b2f7cf2afa"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:29.840340 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7de6dfb2-4489-4250-9ab6-f82c0cd7a36f req-ec21f3cc-f5ec-4321-890d-9ba7fdd36e26 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:29.841076 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7de6dfb2-4489-4250-9ab6-f82c0cd7a36f req-ec21f3cc-f5ec-4321-890d-9ba7fdd36e26 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:29.841769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7de6dfb2-4489-4250-9ab6-f82c0cd7a36f req-ec21f3cc-f5ec-4321-890d-9ba7fdd36e26 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:29.872204 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-7de6dfb2-4489-4250-9ab6-f82c0cd7a36f req-ec21f3cc-f5ec-4321-890d-9ba7fdd36e26 service nova] Creating event network-changed:46af0dd3-3cdc-4c63-9694-d9b2f7cf2afa for instance e92cd73d-ce71-4f92-9db9-ae02c7febbcb on n-h2-851359-3 Aug 04 16:57:29.902638 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-7de6dfb2-4489-4250-9ab6-f82c0cd7a36f req-ec21f3cc-f5ec-4321-890d-9ba7fdd36e26 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074194 Aug 04 16:57:29.905446 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 413/864] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:29.924545 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-d17a9b6b-0303-46e5-ba96-8b2b5b114128 req-fc76f040-37f8-433c-9ef6-57e4cca12e18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98e4458d-d7e4-4663-a974-70ccbe5501f3", "name": "network-vif-plugged", "status": "completed", "tag": "3feec73d-d957-4633-8d95-d8f2f43a58be"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:29.964829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d17a9b6b-0303-46e5-ba96-8b2b5b114128 req-fc76f040-37f8-433c-9ef6-57e4cca12e18 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:29.965768 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d17a9b6b-0303-46e5-ba96-8b2b5b114128 req-fc76f040-37f8-433c-9ef6-57e4cca12e18 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:29.966507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d17a9b6b-0303-46e5-ba96-8b2b5b114128 req-fc76f040-37f8-433c-9ef6-57e4cca12e18 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:29.993714 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-d17a9b6b-0303-46e5-ba96-8b2b5b114128 req-fc76f040-37f8-433c-9ef6-57e4cca12e18 service nova] Creating event network-vif-plugged:3feec73d-d957-4633-8d95-d8f2f43a58be for instance 98e4458d-d7e4-4663-a974-70ccbe5501f3 on n-h1-851359-3 Aug 04 16:57:30.002382 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-d17a9b6b-0303-46e5-ba96-8b2b5b114128 req-fc76f040-37f8-433c-9ef6-57e4cca12e18 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092714 Aug 04 16:57:30.004110 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 414/865] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:30.024156 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2aa32cb9-7f80-4ac6-b7d8-25abcc85c625 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:30.040178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5c0eefa6-fe22-48fb-b59e-c1bafe8f72a0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:30.041417 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5c0eefa6-fe22-48fb-b59e-c1bafe8f72a0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:30.046854 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2aa32cb9-7f80-4ac6-b7d8-25abcc85c625 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df" status: 200 len: 1478 microversion: 2.1 time: 0.357023 Aug 04 16:57:30.054802 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c0eefa6-fe22-48fb-b59e-c1bafe8f72a0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:30.055863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c0eefa6-fe22-48fb-b59e-c1bafe8f72a0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:30.056509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c0eefa6-fe22-48fb-b59e-c1bafe8f72a0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:30.057644 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c0eefa6-fe22-48fb-b59e-c1bafe8f72a0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:30.058300 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c0eefa6-fe22-48fb-b59e-c1bafe8f72a0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:30.059293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c0eefa6-fe22-48fb-b59e-c1bafe8f72a0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:30.063455 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 452/866] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:29 2022] GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df => generated 1478 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:30.301940 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-db8a3482-e3dd-4d9f-b87e-9e2ec6a81ba5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:30.302811 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-db8a3482-e3dd-4d9f-b87e-9e2ec6a81ba5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:30.316447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db8a3482-e3dd-4d9f-b87e-9e2ec6a81ba5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:30.316982 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db8a3482-e3dd-4d9f-b87e-9e2ec6a81ba5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:30.318429 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db8a3482-e3dd-4d9f-b87e-9e2ec6a81ba5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:30.319367 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db8a3482-e3dd-4d9f-b87e-9e2ec6a81ba5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:30.324885 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db8a3482-e3dd-4d9f-b87e-9e2ec6a81ba5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:30.325418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db8a3482-e3dd-4d9f-b87e-9e2ec6a81ba5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:30.512585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5c0eefa6-fe22-48fb-b59e-c1bafe8f72a0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:30.520878 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5c0eefa6-fe22-48fb-b59e-c1bafe8f72a0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83" status: 200 len: 1316 microversion: 2.1 time: 0.498515 Aug 04 16:57:30.521468 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 415/867] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:30 2022] GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 => generated 1316 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:30.671404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-db8a3482-e3dd-4d9f-b87e-9e2ec6a81ba5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:30.680334 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-db8a3482-e3dd-4d9f-b87e-9e2ec6a81ba5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9" status: 200 len: 1313 microversion: 2.1 time: 0.382982 Aug 04 16:57:30.681832 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 453/868] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:30 2022] GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9 => generated 1313 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:30.706245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8e4a16ea-9ae9-4e71-a435-46387b569205 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:30.707109 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8e4a16ea-9ae9-4e71-a435-46387b569205 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:30.714824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e4a16ea-9ae9-4e71-a435-46387b569205 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:30.715685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e4a16ea-9ae9-4e71-a435-46387b569205 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:30.716271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e4a16ea-9ae9-4e71-a435-46387b569205 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:30.717221 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e4a16ea-9ae9-4e71-a435-46387b569205 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:30.717842 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e4a16ea-9ae9-4e71-a435-46387b569205 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:30.718468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e4a16ea-9ae9-4e71-a435-46387b569205 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:30.827690 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9a633764-6598-4ae3-bd34-2bcd55994a82 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:30.828685 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9a633764-6598-4ae3-bd34-2bcd55994a82 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:30.837842 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9a633764-6598-4ae3-bd34-2bcd55994a82 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:30.838801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9a633764-6598-4ae3-bd34-2bcd55994a82 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:30.839417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9a633764-6598-4ae3-bd34-2bcd55994a82 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:30.845233 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9a633764-6598-4ae3-bd34-2bcd55994a82 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:30.846001 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9a633764-6598-4ae3-bd34-2bcd55994a82 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:30.846613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9a633764-6598-4ae3-bd34-2bcd55994a82 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:31.137432 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8e4a16ea-9ae9-4e71-a435-46387b569205 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:31.150469 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8e4a16ea-9ae9-4e71-a435-46387b569205 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1470 microversion: 2.1 time: 0.451068 Aug 04 16:57:31.153519 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 416/869] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:30 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1470 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:31.165302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5154a453-c37d-4059-a169-0ae62bbadb51 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:31.166346 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5154a453-c37d-4059-a169-0ae62bbadb51 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: b8efce6c-198e-49a7-8576-32d80cb168df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:31.179939 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5154a453-c37d-4059-a169-0ae62bbadb51 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:31.180835 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5154a453-c37d-4059-a169-0ae62bbadb51 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:31.182705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5154a453-c37d-4059-a169-0ae62bbadb51 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:31.185577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5154a453-c37d-4059-a169-0ae62bbadb51 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:31.199623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5154a453-c37d-4059-a169-0ae62bbadb51 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:31.202012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5154a453-c37d-4059-a169-0ae62bbadb51 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:31.255816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9a633764-6598-4ae3-bd34-2bcd55994a82 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:31.267929 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9a633764-6598-4ae3-bd34-2bcd55994a82 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:31.275801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9a633764-6598-4ae3-bd34-2bcd55994a82 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:31.276910 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9a633764-6598-4ae3-bd34-2bcd55994a82 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3" status: 200 len: 1361 microversion: 2.25 time: 0.456123 Aug 04 16:57:31.287245 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 454/870] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:30 2022] GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 => generated 1361 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:57:31.542423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1ed31493-5bfe-4e6f-998f-875ab609afac tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:31.543314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1ed31493-5bfe-4e6f-998f-875ab609afac tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:31.550787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5154a453-c37d-4059-a169-0ae62bbadb51 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:31.559196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ed31493-5bfe-4e6f-998f-875ab609afac tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:31.566234 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5154a453-c37d-4059-a169-0ae62bbadb51 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df" status: 200 len: 1478 microversion: 2.1 time: 0.410625 Aug 04 16:57:31.567442 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 417/871] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:31 2022] GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df => generated 1478 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:31.568087 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ed31493-5bfe-4e6f-998f-875ab609afac tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:31.568774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ed31493-5bfe-4e6f-998f-875ab609afac tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:31.570212 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ed31493-5bfe-4e6f-998f-875ab609afac tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:31.570864 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ed31493-5bfe-4e6f-998f-875ab609afac tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:31.571609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ed31493-5bfe-4e6f-998f-875ab609afac tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:31.702741 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-607839d9-645f-4ca1-876a-4a6ac7bf7a5d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:31.703730 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-607839d9-645f-4ca1-876a-4a6ac7bf7a5d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:31.712242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-607839d9-645f-4ca1-876a-4a6ac7bf7a5d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:31.717887 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-607839d9-645f-4ca1-876a-4a6ac7bf7a5d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:31.718389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-607839d9-645f-4ca1-876a-4a6ac7bf7a5d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:31.719333 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-607839d9-645f-4ca1-876a-4a6ac7bf7a5d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:31.719980 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-607839d9-645f-4ca1-876a-4a6ac7bf7a5d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:31.720422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-607839d9-645f-4ca1-876a-4a6ac7bf7a5d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:31.895759 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1ed31493-5bfe-4e6f-998f-875ab609afac tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:31.907604 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1ed31493-5bfe-4e6f-998f-875ab609afac tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83" status: 200 len: 1316 microversion: 2.1 time: 0.365714 Aug 04 16:57:31.910222 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 455/872] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:31 2022] GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 => generated 1316 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:31.927973 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-3f6e6f23-28a7-40cf-b315-2313cc233f6b req-948ccdec-46c4-424e-86a1-f1fd10170909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9", "tag": "9d42adf5-9293-46c9-8db6-ea9e4e623164"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:31.946523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-3f6e6f23-28a7-40cf-b315-2313cc233f6b req-948ccdec-46c4-424e-86a1-f1fd10170909 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:31.947301 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-3f6e6f23-28a7-40cf-b315-2313cc233f6b req-948ccdec-46c4-424e-86a1-f1fd10170909 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:31.947969 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-3f6e6f23-28a7-40cf-b315-2313cc233f6b req-948ccdec-46c4-424e-86a1-f1fd10170909 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:31.962496 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-3f6e6f23-28a7-40cf-b315-2313cc233f6b req-948ccdec-46c4-424e-86a1-f1fd10170909 service nova] Creating event network-changed:9d42adf5-9293-46c9-8db6-ea9e4e623164 for instance c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9 on n-h2-851359-3 Aug 04 16:57:31.969620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-607839d9-645f-4ca1-876a-4a6ac7bf7a5d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:31.972503 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-3f6e6f23-28a7-40cf-b315-2313cc233f6b req-948ccdec-46c4-424e-86a1-f1fd10170909 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049475 Aug 04 16:57:31.973671 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 456/873] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:57:31.988744 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-607839d9-645f-4ca1-876a-4a6ac7bf7a5d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9" status: 200 len: 1313 microversion: 2.1 time: 0.287776 Aug 04 16:57:32.002295 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 418/874] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:31 2022] GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9 => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:32.178501 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2458a5e4-d685-41ff-861e-140194786d86 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:32.179235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2458a5e4-d685-41ff-861e-140194786d86 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:32.188298 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2458a5e4-d685-41ff-861e-140194786d86 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:32.188801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2458a5e4-d685-41ff-861e-140194786d86 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:32.189243 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2458a5e4-d685-41ff-861e-140194786d86 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:32.189968 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2458a5e4-d685-41ff-861e-140194786d86 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:32.190486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2458a5e4-d685-41ff-861e-140194786d86 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:32.190883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2458a5e4-d685-41ff-861e-140194786d86 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:32.230569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-382f003a-d016-4f40-86aa-e47806fbd461 req-e85390a5-5bda-4064-b6db-4174ef9bb3ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8efce6c-198e-49a7-8576-32d80cb168df", "name": "network-vif-deleted", "tag": "4142971e-ec56-42da-9825-fae6aa5ef34a"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:32.270692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-382f003a-d016-4f40-86aa-e47806fbd461 req-e85390a5-5bda-4064-b6db-4174ef9bb3ea service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:32.274906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-382f003a-d016-4f40-86aa-e47806fbd461 req-e85390a5-5bda-4064-b6db-4174ef9bb3ea service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:32.277914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-382f003a-d016-4f40-86aa-e47806fbd461 req-e85390a5-5bda-4064-b6db-4174ef9bb3ea service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:32.295854 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-382f003a-d016-4f40-86aa-e47806fbd461 req-e85390a5-5bda-4064-b6db-4174ef9bb3ea service nova] Creating event network-vif-deleted:4142971e-ec56-42da-9825-fae6aa5ef34a for instance b8efce6c-198e-49a7-8576-32d80cb168df on n-h2-851359-3 Aug 04 16:57:32.301137 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-382f003a-d016-4f40-86aa-e47806fbd461 req-e85390a5-5bda-4064-b6db-4174ef9bb3ea service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076476 Aug 04 16:57:32.302283 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 419/875] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:57:32.310452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3113a6bd-6c60-4f91-b710-04797c20850e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:32.311435 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3113a6bd-6c60-4f91-b710-04797c20850e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:32.318763 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3113a6bd-6c60-4f91-b710-04797c20850e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:32.321322 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3113a6bd-6c60-4f91-b710-04797c20850e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:32.322026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3113a6bd-6c60-4f91-b710-04797c20850e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:32.324115 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3113a6bd-6c60-4f91-b710-04797c20850e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:32.326609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3113a6bd-6c60-4f91-b710-04797c20850e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:32.327617 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3113a6bd-6c60-4f91-b710-04797c20850e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:33.068456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3113a6bd-6c60-4f91-b710-04797c20850e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:33.069094 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2458a5e4-d685-41ff-861e-140194786d86 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:33.087125 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2458a5e4-d685-41ff-861e-140194786d86 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1470 microversion: 2.1 time: 0.915865 Aug 04 16:57:33.088912 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3113a6bd-6c60-4f91-b710-04797c20850e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:33.091335 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 457/876] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:32 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1470 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:33.093400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3113a6bd-6c60-4f91-b710-04797c20850e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:33.096125 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3113a6bd-6c60-4f91-b710-04797c20850e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3" status: 200 len: 1361 microversion: 2.25 time: 0.791943 Aug 04 16:57:33.099904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b11c3cd0-e7cc-4293-a940-6bb63433d5f9 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:33.100904 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 420/877] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:32 2022] GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 => generated 1361 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:33.104395 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b11c3cd0-e7cc-4293-a940-6bb63433d5f9 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: b8efce6c-198e-49a7-8576-32d80cb168df] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:33.109956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-86db6def-ebdf-4992-a5bb-17f7f49f7964 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:33.112585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-86db6def-ebdf-4992-a5bb-17f7f49f7964 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:33.121073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b11c3cd0-e7cc-4293-a940-6bb63433d5f9 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:33.121933 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b11c3cd0-e7cc-4293-a940-6bb63433d5f9 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:33.125036 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b11c3cd0-e7cc-4293-a940-6bb63433d5f9 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:33.126126 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b11c3cd0-e7cc-4293-a940-6bb63433d5f9 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:33.127169 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b11c3cd0-e7cc-4293-a940-6bb63433d5f9 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:33.128591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b11c3cd0-e7cc-4293-a940-6bb63433d5f9 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:33.130581 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86db6def-ebdf-4992-a5bb-17f7f49f7964 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:33.131496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86db6def-ebdf-4992-a5bb-17f7f49f7964 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:33.132182 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86db6def-ebdf-4992-a5bb-17f7f49f7964 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:33.133132 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86db6def-ebdf-4992-a5bb-17f7f49f7964 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:33.133809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86db6def-ebdf-4992-a5bb-17f7f49f7964 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:33.134644 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86db6def-ebdf-4992-a5bb-17f7f49f7964 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:33.160360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:33.238147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b11c3cd0-e7cc-4293-a940-6bb63433d5f9 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:33.247325 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b11c3cd0-e7cc-4293-a940-6bb63433d5f9 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df" status: 200 len: 1436 microversion: 2.1 time: 0.152629 Aug 04 16:57:33.248504 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 458/878] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:33 2022] GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df => generated 1436 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:33.254168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fdbdd675-8791-448e-a377-f2ab199701cb tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:33.255061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fdbdd675-8791-448e-a377-f2ab199701cb tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:33.261250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdbdd675-8791-448e-a377-f2ab199701cb tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:33.262014 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdbdd675-8791-448e-a377-f2ab199701cb tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:33.262468 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdbdd675-8791-448e-a377-f2ab199701cb tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:33.263267 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdbdd675-8791-448e-a377-f2ab199701cb tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:33.263849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdbdd675-8791-448e-a377-f2ab199701cb tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:33.264387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdbdd675-8791-448e-a377-f2ab199701cb tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:33.441923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-86db6def-ebdf-4992-a5bb-17f7f49f7964 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:33.453788 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-86db6def-ebdf-4992-a5bb-17f7f49f7964 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83" status: 200 len: 1316 microversion: 2.1 time: 0.351310 Aug 04 16:57:33.454578 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 421/879] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:33 2022] GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 => generated 1316 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:33.530729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fdbdd675-8791-448e-a377-f2ab199701cb tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:33.539694 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fdbdd675-8791-448e-a377-f2ab199701cb tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9" status: 200 len: 1313 microversion: 2.1 time: 0.289680 Aug 04 16:57:33.540709 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 459/880] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:33 2022] GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9 => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:33.891682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-e131c041-0d27-4f96-8740-e01436619e78 req-a83cbd9e-df45-4709-b343-cbf5dc804d4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cfbd46c-8842-4119-a0d0-7bf5827e45d3", "name": "network-vif-plugged", "status": "completed", "tag": "6b6134e1-88b8-41c8-9a22-a162b6145647"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:33.908248 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e131c041-0d27-4f96-8740-e01436619e78 req-a83cbd9e-df45-4709-b343-cbf5dc804d4f service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:33.909398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e131c041-0d27-4f96-8740-e01436619e78 req-a83cbd9e-df45-4709-b343-cbf5dc804d4f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:33.910068 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e131c041-0d27-4f96-8740-e01436619e78 req-a83cbd9e-df45-4709-b343-cbf5dc804d4f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:33.934214 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-e131c041-0d27-4f96-8740-e01436619e78 req-a83cbd9e-df45-4709-b343-cbf5dc804d4f service nova] Creating event network-vif-plugged:6b6134e1-88b8-41c8-9a22-a162b6145647 for instance 6cfbd46c-8842-4119-a0d0-7bf5827e45d3 on n-h1-851359-3 Aug 04 16:57:33.962360 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-e131c041-0d27-4f96-8740-e01436619e78 req-a83cbd9e-df45-4709-b343-cbf5dc804d4f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073169 Aug 04 16:57:33.964922 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 422/881] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:34.113595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2c065a01-ed3a-4b23-a44c-41b7520d48d5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:34.115226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2c065a01-ed3a-4b23-a44c-41b7520d48d5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:34.123811 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c065a01-ed3a-4b23-a44c-41b7520d48d5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:34.132275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ff0e0070-4dcd-46b5-b43e-da3c15881283 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:34.133427 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ff0e0070-4dcd-46b5-b43e-da3c15881283 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:34.137812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c065a01-ed3a-4b23-a44c-41b7520d48d5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:34.138947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c065a01-ed3a-4b23-a44c-41b7520d48d5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:34.147403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c065a01-ed3a-4b23-a44c-41b7520d48d5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:34.147957 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c065a01-ed3a-4b23-a44c-41b7520d48d5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:34.150452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff0e0070-4dcd-46b5-b43e-da3c15881283 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:34.151018 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff0e0070-4dcd-46b5-b43e-da3c15881283 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:34.151456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff0e0070-4dcd-46b5-b43e-da3c15881283 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:34.152171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff0e0070-4dcd-46b5-b43e-da3c15881283 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:34.152659 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff0e0070-4dcd-46b5-b43e-da3c15881283 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:34.153160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c065a01-ed3a-4b23-a44c-41b7520d48d5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:34.158040 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff0e0070-4dcd-46b5-b43e-da3c15881283 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:34.542038 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ff0e0070-4dcd-46b5-b43e-da3c15881283 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:34.556751 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ff0e0070-4dcd-46b5-b43e-da3c15881283 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:34.558988 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ff0e0070-4dcd-46b5-b43e-da3c15881283 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:34.560846 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ff0e0070-4dcd-46b5-b43e-da3c15881283 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3" status: 200 len: 1555 microversion: 2.25 time: 0.433989 Aug 04 16:57:34.562064 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 423/882] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:34 2022] GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 => generated 1555 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:57:34.569227 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ddd15dad-58f1-4ab7-984b-6432ba7071b7 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:34.570409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ddd15dad-58f1-4ab7-984b-6432ba7071b7 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: b8efce6c-198e-49a7-8576-32d80cb168df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:34.581764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ddd15dad-58f1-4ab7-984b-6432ba7071b7 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:34.582919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ddd15dad-58f1-4ab7-984b-6432ba7071b7 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:34.583653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ddd15dad-58f1-4ab7-984b-6432ba7071b7 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:34.584884 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ddd15dad-58f1-4ab7-984b-6432ba7071b7 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:34.585609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ddd15dad-58f1-4ab7-984b-6432ba7071b7 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:34.586321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ddd15dad-58f1-4ab7-984b-6432ba7071b7 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:34.630818 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ddd15dad-58f1-4ab7-984b-6432ba7071b7 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:34.631990 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ddd15dad-58f1-4ab7-984b-6432ba7071b7 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:34.632692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ddd15dad-58f1-4ab7-984b-6432ba7071b7 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:34.633421 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-ddd15dad-58f1-4ab7-984b-6432ba7071b7 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lazy-loading 'fault' on Instance uuid b8efce6c-198e-49a7-8576-32d80cb168df {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:57:34.634702 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2c065a01-ed3a-4b23-a44c-41b7520d48d5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:34.650278 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2c065a01-ed3a-4b23-a44c-41b7520d48d5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1462 microversion: 2.1 time: 0.541721 Aug 04 16:57:34.651442 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 460/883] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:34 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1462 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:34.657705 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b3642a1c-20d4-4ba2-ba0d-6286a574bf63 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:34.658815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b3642a1c-20d4-4ba2-ba0d-6286a574bf63 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:34.672706 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3642a1c-20d4-4ba2-ba0d-6286a574bf63 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:34.673466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3642a1c-20d4-4ba2-ba0d-6286a574bf63 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:34.674287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3642a1c-20d4-4ba2-ba0d-6286a574bf63 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:34.675350 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3642a1c-20d4-4ba2-ba0d-6286a574bf63 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:34.675970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3642a1c-20d4-4ba2-ba0d-6286a574bf63 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:34.676911 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3642a1c-20d4-4ba2-ba0d-6286a574bf63 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:34.692413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ddd15dad-58f1-4ab7-984b-6432ba7071b7 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '774f01840dcc4fb9a160f4e3707c20ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db0dbf55e504a95903556ffd03801fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:34.702635 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ddd15dad-58f1-4ab7-984b-6432ba7071b7 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df" status: 200 len: 1312 microversion: 2.1 time: 0.139309 Aug 04 16:57:34.703990 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 424/884] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:34 2022] GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df => generated 1312 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:34.709788 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6a72b76f-b212-44a4-a938-2e5dc38a961b tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:34.710871 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6a72b76f-b212-44a4-a938-2e5dc38a961b tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:34.718608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a72b76f-b212-44a4-a938-2e5dc38a961b tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:34.719622 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a72b76f-b212-44a4-a938-2e5dc38a961b tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:34.720600 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a72b76f-b212-44a4-a938-2e5dc38a961b tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:34.721609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a72b76f-b212-44a4-a938-2e5dc38a961b tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:34.722315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a72b76f-b212-44a4-a938-2e5dc38a961b tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:34.722978 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a72b76f-b212-44a4-a938-2e5dc38a961b tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:34.730078 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:34.918647 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=8 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:35.237167 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6a72b76f-b212-44a4-a938-2e5dc38a961b tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:35.244488 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6a72b76f-b212-44a4-a938-2e5dc38a961b tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9" status: 200 len: 1313 microversion: 2.1 time: 0.539073 Aug 04 16:57:35.260087 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 425/885] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:34 2022] GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9 => generated 1313 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:35.264637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b3642a1c-20d4-4ba2-ba0d-6286a574bf63 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:35.294086 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b3642a1c-20d4-4ba2-ba0d-6286a574bf63 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83" status: 200 len: 1316 microversion: 2.1 time: 0.641098 Aug 04 16:57:35.294742 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 461/886] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:34 2022] GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 => generated 1316 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:35.314122 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a52c769e-c83d-4b23-91a3-0a2e12d5aca0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:35.315977 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a52c769e-c83d-4b23-91a3-0a2e12d5aca0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:35.330370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a52c769e-c83d-4b23-91a3-0a2e12d5aca0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:35.330808 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a52c769e-c83d-4b23-91a3-0a2e12d5aca0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:35.332011 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a52c769e-c83d-4b23-91a3-0a2e12d5aca0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:35.332952 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a52c769e-c83d-4b23-91a3-0a2e12d5aca0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:35.333512 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a52c769e-c83d-4b23-91a3-0a2e12d5aca0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:35.334775 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a52c769e-c83d-4b23-91a3-0a2e12d5aca0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:35.633970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-abddcba0-5f52-492c-b741-c50f4473910d tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:35.635018 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-abddcba0-5f52-492c-b741-c50f4473910d tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:35.652057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-abddcba0-5f52-492c-b741-c50f4473910d tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:35.652828 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-abddcba0-5f52-492c-b741-c50f4473910d tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:35.654382 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-abddcba0-5f52-492c-b741-c50f4473910d tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:35.655418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-abddcba0-5f52-492c-b741-c50f4473910d tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:35.656055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-abddcba0-5f52-492c-b741-c50f4473910d tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:35.657224 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-abddcba0-5f52-492c-b741-c50f4473910d tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:35.767006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a52c769e-c83d-4b23-91a3-0a2e12d5aca0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:35.779532 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a52c769e-c83d-4b23-91a3-0a2e12d5aca0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1462 microversion: 2.1 time: 0.480921 Aug 04 16:57:35.798854 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 462/887] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:35 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1462 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:35.805583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4a0d4c94-10c3-4a1e-b329-f0160f0306f4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:35.806317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4a0d4c94-10c3-4a1e-b329-f0160f0306f4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] [instance: b8efce6c-198e-49a7-8576-32d80cb168df] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:35.815031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a0d4c94-10c3-4a1e-b329-f0160f0306f4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:35.815539 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a0d4c94-10c3-4a1e-b329-f0160f0306f4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:35.815983 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a0d4c94-10c3-4a1e-b329-f0160f0306f4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:35.816916 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a0d4c94-10c3-4a1e-b329-f0160f0306f4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:35.817675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a0d4c94-10c3-4a1e-b329-f0160f0306f4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:35.818157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a0d4c94-10c3-4a1e-b329-f0160f0306f4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:35.840552 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-4a0d4c94-10c3-4a1e-b329-f0160f0306f4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] HTTP exception thrown: Instance b8efce6c-198e-49a7-8576-32d80cb168df could not be found. Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4a0d4c94-10c3-4a1e-b329-f0160f0306f4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Request method failure captured: Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df HTTP/1.1 Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_o5tvNUrytWwopCcPsX3sVwq0RJSMQ6xReEWCJW3KUfTu5KNPnS-pXcHgq6H7nCp3-3XkCgucUkwvDeVNykNbcjKbtr7PgsjG1PCXpkQFq1V6OvMAuCPCm58Jj0l0HAZtyCupoqvczGgJeKlF-Q1ILa9RWWb947hvBiseFFn7JSHR4 Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 3db0dbf55e504a95903556ffd03801fe Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-594088838 Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3db0dbf55e504a95903556ffd03801fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3db0dbf55e504a95903556ffd03801fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3db0dbf55e504a95903556ffd03801fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3db0dbf55e504a95903556ffd03801fe"}]}] Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersAdminNegativeTestJSON-594088838 Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 3db0dbf55e504a95903556ffd03801fe Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-594088838 Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersAdminNegativeTestJSON-594088838-project Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 774f01840dcc4fb9a160f4e3707c20ef Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersAdminNegativeTestJSON-594088838-project Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance b8efce6c-198e-49a7-8576-32d80cb168df could not be found. Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'b8efce6c-198e-49a7-8576-32d80cb168df'} Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8efce6c-198e-49a7-8576-32d80cb168df could not be found. Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8efce6c-198e-49a7-8576-32d80cb168df could not be found. Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:57:35.843621 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:35.848206 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:57:35.848206 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:35.848206 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:35.848206 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:35.848206 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:57:35.848206 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:57:35.848206 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8efce6c-198e-49a7-8576-32d80cb168df could not be found. Aug 04 16:57:35.848206 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:57:35.850685 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4a0d4c94-10c3-4a1e-b329-f0160f0306f4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] Returning 404 to user: Instance b8efce6c-198e-49a7-8576-32d80cb168df could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:57:35.851729 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4a0d4c94-10c3-4a1e-b329-f0160f0306f4 tempest-ServersAdminNegativeTestJSON-594088838 tempest-ServersAdminNegativeTestJSON-594088838-project] 10.222.0.93 "GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df" status: 404 len: 111 microversion: 2.1 time: 0.051575 Aug 04 16:57:35.852756 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 463/888] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:35 2022] GET /compute/v2.1/servers/b8efce6c-198e-49a7-8576-32d80cb168df => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:57:35.858083 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-76635437-9f18-466a-ba12-4f2b8bfbc1e8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Action: 'create', calling method: .version_select at 0x7f1e5bac5040>, body: {"keypair": {"name": "tempest-keypair-2110583897", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0Pn9VK85+D974ujnLZAzC1KZ//olv+pLhH+1mBS6RZzZxpXEXayDHP05IijO2jOmuKRT5Xl7sy3Er1Wbc5+bsziTot+y14ksxzVfAV5kugLiEBIifYTnbIEckJEGi1Ww=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:35.876540 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-76635437-9f18-466a-ba12-4f2b8bfbc1e8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Getting quotas for project 6f64e49086c94f65ba1fc2ef97b6bcde. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:57:35.881479 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-76635437-9f18-466a-ba12-4f2b8bfbc1e8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Getting quotas for user 655795644d9941c99a82d15d9daa5ab5 and project 6f64e49086c94f65ba1fc2ef97b6bcde. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:57:35.911740 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-76635437-9f18-466a-ba12-4f2b8bfbc1e8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056593 Aug 04 16:57:35.912462 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 464/889] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 16:57:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:35.989750 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-61c718be-1fc3-4c2c-b522-82290c232405 req-98530e03-248b-4c65-8ba7-92214a2120d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c8b06b6-59a1-4595-b2ee-539a4c9dbc83", "name": "network-vif-plugged", "status": "completed", "tag": "2f81e029-164b-4fbb-9431-2ee5454d602d"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:36.013847 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-61c718be-1fc3-4c2c-b522-82290c232405 req-98530e03-248b-4c65-8ba7-92214a2120d6 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:36.014395 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-61c718be-1fc3-4c2c-b522-82290c232405 req-98530e03-248b-4c65-8ba7-92214a2120d6 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:36.016948 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-61c718be-1fc3-4c2c-b522-82290c232405 req-98530e03-248b-4c65-8ba7-92214a2120d6 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:36.032071 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-61c718be-1fc3-4c2c-b522-82290c232405 req-98530e03-248b-4c65-8ba7-92214a2120d6 service nova] Creating event network-vif-plugged:2f81e029-164b-4fbb-9431-2ee5454d602d for instance 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 on n-h1-851359-3 Aug 04 16:57:36.039374 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-61c718be-1fc3-4c2c-b522-82290c232405 req-98530e03-248b-4c65-8ba7-92214a2120d6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053962 Aug 04 16:57:36.040383 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 465/890] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:36.097842 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-abddcba0-5f52-492c-b741-c50f4473910d tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lazy-loading 'services' on Instance uuid 98e4458d-d7e4-4663-a974-70ccbe5501f3 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:57:36.131368 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-abddcba0-5f52-492c-b741-c50f4473910d tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3" status: 200 len: 2047 microversion: 2.25 time: 0.869759 Aug 04 16:57:36.134380 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 426/891] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:35 2022] GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 => generated 2047 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:36.171515 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bbb04415-05f4-4b76-9858-763b634544e5 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:36.172317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bbb04415-05f4-4b76-9858-763b634544e5 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:36.184660 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bbb04415-05f4-4b76-9858-763b634544e5 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:36.185265 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bbb04415-05f4-4b76-9858-763b634544e5 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:36.185712 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bbb04415-05f4-4b76-9858-763b634544e5 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:36.197689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bbb04415-05f4-4b76-9858-763b634544e5 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:36.198142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bbb04415-05f4-4b76-9858-763b634544e5 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:36.198592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bbb04415-05f4-4b76-9858-763b634544e5 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:36.270557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-425a8028-aa26-49b3-acf0-61e6ba642747 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:36.271623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-425a8028-aa26-49b3-acf0-61e6ba642747 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:36.287415 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-425a8028-aa26-49b3-acf0-61e6ba642747 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:36.289030 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-425a8028-aa26-49b3-acf0-61e6ba642747 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:36.293792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-425a8028-aa26-49b3-acf0-61e6ba642747 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:36.294833 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-425a8028-aa26-49b3-acf0-61e6ba642747 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:36.296320 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-425a8028-aa26-49b3-acf0-61e6ba642747 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:36.298353 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-425a8028-aa26-49b3-acf0-61e6ba642747 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:36.953915 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-bbb04415-05f4-4b76-9858-763b634544e5 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lazy-loading 'services' on Instance uuid 98e4458d-d7e4-4663-a974-70ccbe5501f3 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:57:37.001393 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-425a8028-aa26-49b3-acf0-61e6ba642747 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:37.011086 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bbb04415-05f4-4b76-9858-763b634544e5 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3" status: 200 len: 2047 microversion: 2.25 time: 0.839705 Aug 04 16:57:37.014487 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 466/892] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:36 2022] GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 => generated 2047 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:37.019985 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-425a8028-aa26-49b3-acf0-61e6ba642747 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9" status: 200 len: 1313 microversion: 2.1 time: 0.754358 Aug 04 16:57:37.026561 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-182dd963-eeb2-4abe-9967-5960779907ec tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:37.030806 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 427/893] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:36 2022] GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9 => generated 1313 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:37.033689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-182dd963-eeb2-4abe-9967-5960779907ec tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:37.057591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cf0c54e2-884e-4826-9a3c-41cee96d7e13 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:37.060932 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:57:37.060932 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:57:37.063841 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-182dd963-eeb2-4abe-9967-5960779907ec tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:37.064335 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-182dd963-eeb2-4abe-9967-5960779907ec tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:37.064920 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-182dd963-eeb2-4abe-9967-5960779907ec tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:37.065696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-182dd963-eeb2-4abe-9967-5960779907ec tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:37.066203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-182dd963-eeb2-4abe-9967-5960779907ec tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:37.066645 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-182dd963-eeb2-4abe-9967-5960779907ec tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:37.069145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf0c54e2-884e-4826-9a3c-41cee96d7e13 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:37.069709 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf0c54e2-884e-4826-9a3c-41cee96d7e13 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:37.070363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf0c54e2-884e-4826-9a3c-41cee96d7e13 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:37.071509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf0c54e2-884e-4826-9a3c-41cee96d7e13 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:37.072094 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf0c54e2-884e-4826-9a3c-41cee96d7e13 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:37.074344 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf0c54e2-884e-4826-9a3c-41cee96d7e13 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:37.160769 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cf0c54e2-884e-4826-9a3c-41cee96d7e13 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.107945 Aug 04 16:57:37.162390 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 428/894] 10.222.0.93 () {60 vars in 1217 bytes} [Thu Aug 4 16:57:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:57:37.185477 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ab1fee60-638f-4299-abab-112e41dffc8c tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851359-3", "block_migration": "auto"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:37.189259 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ab1fee60-638f-4299-abab-112e41dffc8c tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:37.196499 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab1fee60-638f-4299-abab-112e41dffc8c tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:37.198895 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab1fee60-638f-4299-abab-112e41dffc8c tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:37.200081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab1fee60-638f-4299-abab-112e41dffc8c tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:37.201525 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab1fee60-638f-4299-abab-112e41dffc8c tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:37.202186 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab1fee60-638f-4299-abab-112e41dffc8c tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:37.203802 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab1fee60-638f-4299-abab-112e41dffc8c tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:37.248452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-ab1fee60-638f-4299-abab-112e41dffc8c tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lazy-loading 'flavor' on Instance uuid 98e4458d-d7e4-4663-a974-70ccbe5501f3 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:57:37.266736 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ab1fee60-638f-4299-abab-112e41dffc8c tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Going to try to live migrate instance to n-h2-851359-3 {{(pid=131044) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 16:57:37.518156 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-182dd963-eeb2-4abe-9967-5960779907ec tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:37.539768 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-182dd963-eeb2-4abe-9967-5960779907ec tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83" status: 200 len: 1316 microversion: 2.1 time: 0.524031 Aug 04 16:57:37.543541 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 467/895] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:37 2022] GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 => generated 1316 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:38.067797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-84a203de-a9c7-4e5f-8ad9-97bad3609543 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:38.069294 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-84a203de-a9c7-4e5f-8ad9-97bad3609543 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:38.080709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84a203de-a9c7-4e5f-8ad9-97bad3609543 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:38.081217 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84a203de-a9c7-4e5f-8ad9-97bad3609543 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:38.090230 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84a203de-a9c7-4e5f-8ad9-97bad3609543 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:38.091298 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84a203de-a9c7-4e5f-8ad9-97bad3609543 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:38.094635 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84a203de-a9c7-4e5f-8ad9-97bad3609543 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:38.095388 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84a203de-a9c7-4e5f-8ad9-97bad3609543 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:38.509960 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-84a203de-a9c7-4e5f-8ad9-97bad3609543 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:38.521705 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-84a203de-a9c7-4e5f-8ad9-97bad3609543 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9" status: 200 len: 1313 microversion: 2.1 time: 0.457820 Aug 04 16:57:38.522998 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 468/896] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:38 2022] GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9 => generated 1313 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:38.530658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-33a04304-7af2-42d9-85bf-dbb741681f14 req-a6687b53-5b6e-46be-aaf5-0d9ca96dceac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9", "name": "network-vif-plugged", "status": "completed", "tag": "9d42adf5-9293-46c9-8db6-ea9e4e623164"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:38.549102 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-33a04304-7af2-42d9-85bf-dbb741681f14 req-a6687b53-5b6e-46be-aaf5-0d9ca96dceac service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:38.551147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-33a04304-7af2-42d9-85bf-dbb741681f14 req-a6687b53-5b6e-46be-aaf5-0d9ca96dceac service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:38.552617 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-33a04304-7af2-42d9-85bf-dbb741681f14 req-a6687b53-5b6e-46be-aaf5-0d9ca96dceac service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:38.581591 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-33a04304-7af2-42d9-85bf-dbb741681f14 req-a6687b53-5b6e-46be-aaf5-0d9ca96dceac service nova] Creating event network-vif-plugged:9d42adf5-9293-46c9-8db6-ea9e4e623164 for instance c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9 on n-h2-851359-3 Aug 04 16:57:38.592735 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-33a04304-7af2-42d9-85bf-dbb741681f14 req-a6687b53-5b6e-46be-aaf5-0d9ca96dceac service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067330 Aug 04 16:57:38.593649 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 469/897] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:38.612942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5877109f-f810-4f73-9066-72c270da26cf tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:38.613678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5877109f-f810-4f73-9066-72c270da26cf tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:38.620204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5877109f-f810-4f73-9066-72c270da26cf tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:38.620706 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5877109f-f810-4f73-9066-72c270da26cf tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:38.621155 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5877109f-f810-4f73-9066-72c270da26cf tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:38.622242 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5877109f-f810-4f73-9066-72c270da26cf tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:38.622963 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5877109f-f810-4f73-9066-72c270da26cf tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:38.628436 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5877109f-f810-4f73-9066-72c270da26cf tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:38.695780 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:39.051495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5877109f-f810-4f73-9066-72c270da26cf tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:39.070624 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5877109f-f810-4f73-9066-72c270da26cf tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83" status: 200 len: 1503 microversion: 2.1 time: 0.475098 Aug 04 16:57:39.086621 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 470/898] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:38 2022] GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 => generated 1503 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:39.092720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4be43f62-a6d8-4053-b822-0e011d97f247 tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Calling method '.version_select at 0x7f1e5b9d8160>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:39.097062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4be43f62-a6d8-4053-b822-0e011d97f247 tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:39.097776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4be43f62-a6d8-4053-b822-0e011d97f247 tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:39.098447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4be43f62-a6d8-4053-b822-0e011d97f247 tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:39.109303 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4be43f62-a6d8-4053-b822-0e011d97f247 tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] 10.222.0.93 "GET /compute/v2.1/os-migrations" status: 200 len: 1907 microversion: 2.1 time: 0.021379 Aug 04 16:57:39.110025 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 471/899] 10.222.0.93 () {58 vars in 1143 bytes} [Thu Aug 4 16:57:39 2022] GET /compute/v2.1/os-migrations => generated 1907 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:39.114925 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-77b8cb91-3d32-449b-afad-032f983031c0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1717000695"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:39.115682 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-77b8cb91-3d32-449b-afad-032f983031c0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:39.122137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77b8cb91-3d32-449b-afad-032f983031c0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:39.122671 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77b8cb91-3d32-449b-afad-032f983031c0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:39.123285 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77b8cb91-3d32-449b-afad-032f983031c0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:39.124142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77b8cb91-3d32-449b-afad-032f983031c0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:39.124766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77b8cb91-3d32-449b-afad-032f983031c0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:39.125362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77b8cb91-3d32-449b-afad-032f983031c0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:39.314502 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.network.security_group_api [None req-77b8cb91-3d32-449b-afad-032f983031c0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Adding security group d0b42bf3-4317-4dd0-9c50-b8690f55341b to port 2f81e029-164b-4fbb-9431-2ee5454d602d Aug 04 16:57:39.936170 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-77b8cb91-3d32-449b-afad-032f983031c0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "POST /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83/action" status: 202 len: 0 microversion: 2.1 time: 0.824620 Aug 04 16:57:39.937147 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 472/900] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:57:39 2022] POST /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83/action => generated 0 bytes in 826 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:57:39.944181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-02b5d160-4949-44bb-bf8a-a5734a55cf6e tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:39.965114 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-02b5d160-4949-44bb-bf8a-a5734a55cf6e tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026644 Aug 04 16:57:39.971017 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 473/901] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Aug 4 16:57:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:39.988612 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-eb893950-8dfd-4705-8545-f69f61d11c2d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:39.989719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-eb893950-8dfd-4705-8545-f69f61d11c2d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:40.005019 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eb893950-8dfd-4705-8545-f69f61d11c2d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:40.012427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eb893950-8dfd-4705-8545-f69f61d11c2d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:40.013764 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eb893950-8dfd-4705-8545-f69f61d11c2d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:40.015388 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eb893950-8dfd-4705-8545-f69f61d11c2d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:40.016108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eb893950-8dfd-4705-8545-f69f61d11c2d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:40.018601 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eb893950-8dfd-4705-8545-f69f61d11c2d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:40.301763 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-eb893950-8dfd-4705-8545-f69f61d11c2d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:40.321733 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-eb893950-8dfd-4705-8545-f69f61d11c2d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9" status: 200 len: 1313 microversion: 2.1 time: 0.342025 Aug 04 16:57:40.322679 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 474/902] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:39 2022] GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9 => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:40.341693 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d9dcedec-dc75-4491-9efc-18d75691addf tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-154609973"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:40.343586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d9dcedec-dc75-4491-9efc-18d75691addf tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:40.362750 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9dcedec-dc75-4491-9efc-18d75691addf tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:40.364298 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9dcedec-dc75-4491-9efc-18d75691addf tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:40.364994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9dcedec-dc75-4491-9efc-18d75691addf tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:40.366028 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9dcedec-dc75-4491-9efc-18d75691addf tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:40.371794 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9dcedec-dc75-4491-9efc-18d75691addf tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:40.374534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9dcedec-dc75-4491-9efc-18d75691addf tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:40.723105 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.network.security_group_api [None req-d9dcedec-dc75-4491-9efc-18d75691addf tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Adding security group 35085835-96f1-4cad-a6b5-b8151a18d781 to port 2f81e029-164b-4fbb-9431-2ee5454d602d Aug 04 16:57:41.654342 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ab1fee60-638f-4299-abab-112e41dffc8c tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3/action" status: 202 len: 0 microversion: 2.25 time: 4.481171 Aug 04 16:57:41.655003 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 429/903] 10.222.0.93 () {62 vars in 1319 bytes} [Thu Aug 4 16:57:37 2022] POST /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3/action => generated 0 bytes in 4484 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:57:41.659826 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4cc2a83e-d4ca-4783-bc52-c53965b4f63d tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1881319908", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:41.663704 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:57:41.663704 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:57:41.692516 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4cc2a83e-d4ca-4783-bc52-c53965b4f63d tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.036469 Aug 04 16:57:41.693409 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 430/904] 10.222.0.93 () {60 vars in 1146 bytes} [Thu Aug 4 16:57:41 2022] POST /compute/v2.1/flavors => generated 499 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:41.701701 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-d779b5bd-a012-4bfd-89de-e11bd0ac24d6 req-d28bc1f6-327f-4ef7-b269-1dfaf43335ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c8b06b6-59a1-4595-b2ee-539a4c9dbc83", "tag": "2f81e029-164b-4fbb-9431-2ee5454d602d"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:41.718346 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d9dcedec-dc75-4491-9efc-18d75691addf tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "POST /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83/action" status: 202 len: 0 microversion: 2.1 time: 1.393784 Aug 04 16:57:41.721895 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 475/905] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:57:40 2022] POST /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83/action => generated 0 bytes in 1396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:57:41.750036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:41.764026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d779b5bd-a012-4bfd-89de-e11bd0ac24d6 req-d28bc1f6-327f-4ef7-b269-1dfaf43335ae service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:41.766889 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d779b5bd-a012-4bfd-89de-e11bd0ac24d6 req-d28bc1f6-327f-4ef7-b269-1dfaf43335ae service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:41.769117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d779b5bd-a012-4bfd-89de-e11bd0ac24d6 req-d28bc1f6-327f-4ef7-b269-1dfaf43335ae service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:41.814925 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-d779b5bd-a012-4bfd-89de-e11bd0ac24d6 req-d28bc1f6-327f-4ef7-b269-1dfaf43335ae service nova] Creating event network-changed:2f81e029-164b-4fbb-9431-2ee5454d602d for instance 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 on n-h1-851359-3 Aug 04 16:57:41.832431 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-d779b5bd-a012-4bfd-89de-e11bd0ac24d6 req-d28bc1f6-327f-4ef7-b269-1dfaf43335ae service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136896 Aug 04 16:57:41.834983 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 431/906] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:41.847942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c514abe3-7923-4276-826c-6b248690b00e tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:41.848678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c514abe3-7923-4276-826c-6b248690b00e tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:41.886825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c514abe3-7923-4276-826c-6b248690b00e tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:41.915501 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c514abe3-7923-4276-826c-6b248690b00e tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:41.916383 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c514abe3-7923-4276-826c-6b248690b00e tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:41.919275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c514abe3-7923-4276-826c-6b248690b00e tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:41.923203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c514abe3-7923-4276-826c-6b248690b00e tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:41.924203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c514abe3-7923-4276-826c-6b248690b00e tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:42.091441 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-da8c8e59-1229-49ad-8463-092689108fef tempest-TenantUsagesNegativeTestJSON-999456138 tempest-TenantUsagesNegativeTestJSON-999456138-project-admin] 10.222.0.93 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-03T16%3A57%3A40.702278&end=2022-08-05T16%3A57%3A40.702278" status: 404 len: 112 microversion: - time: 0.370478 Aug 04 16:57:42.091971 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 476/907] 10.222.0.93 () {58 vars in 1316 bytes} [Thu Aug 4 16:57:41 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-03T16%3A57%3A40.702278&end=2022-08-05T16%3A57%3A40.702278 => generated 112 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 16:57:42.105173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2984ad60-27cf-4755-aa75-184d02884ede tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:42.105802 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2984ad60-27cf-4755-aa75-184d02884ede tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:42.129118 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2984ad60-27cf-4755-aa75-184d02884ede tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:42.129643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2984ad60-27cf-4755-aa75-184d02884ede tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:42.130114 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2984ad60-27cf-4755-aa75-184d02884ede tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:42.137870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2984ad60-27cf-4755-aa75-184d02884ede tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:42.142908 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2984ad60-27cf-4755-aa75-184d02884ede tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:42.143609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2984ad60-27cf-4755-aa75-184d02884ede tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:42.418961 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c514abe3-7923-4276-826c-6b248690b00e tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:42.432870 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c514abe3-7923-4276-826c-6b248690b00e tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9" status: 200 len: 1463 microversion: 2.1 time: 0.592605 Aug 04 16:57:42.433519 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 432/908] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:41 2022] GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9 => generated 1463 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:42.451845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2984ad60-27cf-4755-aa75-184d02884ede tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:42.458985 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b1f31fc5-eac8-4764-bd5c-d82a1c78c324 tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:42.471804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2984ad60-27cf-4755-aa75-184d02884ede tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:42.483659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2984ad60-27cf-4755-aa75-184d02884ede tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:42.485224 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2984ad60-27cf-4755-aa75-184d02884ede tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3" status: 200 len: 1565 microversion: 2.25 time: 0.390048 Aug 04 16:57:42.486908 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 477/909] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:42 2022] GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 => generated 1565 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:42.496269 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-afa47fd3-8897-49ee-898f-a9662d8cc32e tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:42.497336 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-afa47fd3-8897-49ee-898f-a9662d8cc32e tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:42.500372 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b1f31fc5-eac8-4764-bd5c-d82a1c78c324 tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.060574 Aug 04 16:57:42.501196 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 433/910] 10.222.0.93 () {58 vars in 1182 bytes} [Thu Aug 4 16:57:42 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:57:42.506454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ad6f09f6-ffb0-4982-9e44-c0410862d886 tempest-TenantUsagesNegativeTestJSON-999456138 tempest-TenantUsagesNegativeTestJSON-999456138-project-admin] Calling method '.version_select at 0x7f1e6816fb80>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:42.521369 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-ad6f09f6-ffb0-4982-9e44-c0410862d886 tempest-TenantUsagesNegativeTestJSON-999456138 tempest-TenantUsagesNegativeTestJSON-999456138-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ad6f09f6-ffb0-4982-9e44-c0410862d886 tempest-TenantUsagesNegativeTestJSON-999456138 tempest-TenantUsagesNegativeTestJSON-999456138-project-admin] Request method failure captured: Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-simple-tenant-usage/ce17eda1a7874ef5baccfa045c9b074a?start=2022-08-05T16%3A57%3A40.702278&end=2022-08-03T16%3A57%3A40.702278 HTTP/1.1 Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_qEIP6PGS1bjC5ZY71ywQly6lbr797FxlcuBaf0bqwrlH5nNEqxaTgFFHA97Kvw6E6SwPPQNQ6BQyeYffm0GBlbPNRKmGPxhaRWxdN3XqIMZdD9uKfy35p9uG0g4zcTLdPCsa39rxCOEVTDBPnJH6sKzSGeZzoog-fYMeUdxWZ-z5g Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 7c2493a94cae410bbcbe9f735c4e2711 Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-999456138 Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: X-Role: admin,member,reader Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: admin,member,reader Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7c2493a94cae410bbcbe9f735c4e2711"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7c2493a94cae410bbcbe9f735c4e2711"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_7c2493a94cae410bbcbe9f735c4e2711"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/7c2493a94cae410bbcbe9f735c4e2711"}]}] Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-999456138 Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 7c2493a94cae410bbcbe9f735c4e2711 Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-999456138 Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TenantUsagesNegativeTestJSON-999456138-project-admin Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: fccf072159ac435087bb6c8d5edc8ba4 Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-999456138-project-admin Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: exception: Invalid start time. The start time cannot occur after the end time. Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'ce17eda1a7874ef5baccfa045c9b074a'} Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 04 16:57:42.523250 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:42.528529 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ad6f09f6-ffb0-4982-9e44-c0410862d886 tempest-TenantUsagesNegativeTestJSON-999456138 tempest-TenantUsagesNegativeTestJSON-999456138-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:57:42.529311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-afa47fd3-8897-49ee-898f-a9662d8cc32e tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:42.529828 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-afa47fd3-8897-49ee-898f-a9662d8cc32e tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:42.530312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-afa47fd3-8897-49ee-898f-a9662d8cc32e tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:42.531050 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-afa47fd3-8897-49ee-898f-a9662d8cc32e tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:42.531519 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-afa47fd3-8897-49ee-898f-a9662d8cc32e tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:42.531959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-afa47fd3-8897-49ee-898f-a9662d8cc32e tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:42.544485 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ad6f09f6-ffb0-4982-9e44-c0410862d886 tempest-TenantUsagesNegativeTestJSON-999456138 tempest-TenantUsagesNegativeTestJSON-999456138-project-admin] 10.222.0.93 "GET /compute/v2.1/os-simple-tenant-usage/ce17eda1a7874ef5baccfa045c9b074a?start=2022-08-05T16%3A57%3A40.702278&end=2022-08-03T16%3A57%3A40.702278" status: 400 len: 111 microversion: 2.1 time: 0.041622 Aug 04 16:57:42.545083 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 434/911] 10.222.0.93 () {58 vars in 1412 bytes} [Thu Aug 4 16:57:42 2022] GET /compute/v2.1/os-simple-tenant-usage/ce17eda1a7874ef5baccfa045c9b074a?start=2022-08-05T16%3A57%3A40.702278&end=2022-08-03T16%3A57%3A40.702278 => generated 111 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:57:42.825350 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d1ca4d9d-b7b4-48b0-8632-b8a97f5681c6 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:42.831562 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d1ca4d9d-b7b4-48b0-8632-b8a97f5681c6 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Searching by: {'deleted': False, 'project_id': 'd506baaf1ae741fbb1e07a2df68a1487'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:57:42.839655 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1ca4d9d-b7b4-48b0-8632-b8a97f5681c6 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:42.840226 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1ca4d9d-b7b4-48b0-8632-b8a97f5681c6 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:42.840935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1ca4d9d-b7b4-48b0-8632-b8a97f5681c6 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:42.841741 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1ca4d9d-b7b4-48b0-8632-b8a97f5681c6 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:42.842450 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1ca4d9d-b7b4-48b0-8632-b8a97f5681c6 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:42.843094 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1ca4d9d-b7b4-48b0-8632-b8a97f5681c6 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:43.064134 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d1ca4d9d-b7b4-48b0-8632-b8a97f5681c6 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.517959 Aug 04 16:57:43.066987 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 435/912] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:57:42 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:57:43.174750 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-afa47fd3-8897-49ee-898f-a9662d8cc32e tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.686540 Aug 04 16:57:43.176206 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 478/913] 10.222.0.93 () {58 vars in 1293 bytes} [Thu Aug 4 16:57:42 2022] GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83/os-security-groups => generated 1157 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:43.190157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0eb60310-d52d-4a29-88e9-314214ee5b4e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-108702099", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "8da34e9d-49be-4084-b683-1772e2f80f21"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:43.204502 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:43.295006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-425abee1-320a-41e7-99ca-45435440b500 tempest-TenantUsagesNegativeTestJSON-625875683 tempest-TenantUsagesNegativeTestJSON-625875683-project] Calling method '.version_select at 0x7f1e5bb86af0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:43.298882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-425abee1-320a-41e7-99ca-45435440b500 tempest-TenantUsagesNegativeTestJSON-625875683 tempest-TenantUsagesNegativeTestJSON-625875683-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '5c54bc9d615d4a8b9caebbc06ccbdde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce17eda1a7874ef5baccfa045c9b074a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-425abee1-320a-41e7-99ca-45435440b500 tempest-TenantUsagesNegativeTestJSON-625875683 tempest-TenantUsagesNegativeTestJSON-625875683-project] Request method failure captured: Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-03T16%3A57%3A40.702278&end=2022-08-05T16%3A57%3A40.702278&detailed=1 HTTP/1.1 Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_qDHrRK9oHNs69x2qdoWUVvkKRCEKe6hbgQj1IwQfCjBYSzW5tn2JiADOamIY3FFvOow5sgBhefAwQ7MS_bptmzKAzGskHkR93diXO9tx-CUvqRZXQoUty_DDlitR3TIHBPgnq4-uokGC2vPM_o1vEMYETqsuUOwXpsfD-qkeCTNV4 Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: ce17eda1a7874ef5baccfa045c9b074a Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-625875683 Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ce17eda1a7874ef5baccfa045c9b074a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ce17eda1a7874ef5baccfa045c9b074a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ce17eda1a7874ef5baccfa045c9b074a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ce17eda1a7874ef5baccfa045c9b074a"}]}] Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-625875683 Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: ce17eda1a7874ef5baccfa045c9b074a Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-625875683 Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TenantUsagesNegativeTestJSON-625875683-project Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 5c54bc9d615d4a8b9caebbc06ccbdde6 Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-625875683-project Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: action_args: {} Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:57:43.300530 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:57:43.304743 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 04 16:57:43.304743 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:43.304743 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:43.304743 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:43.304743 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:43.304743 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:43.304743 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:43.304743 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:57:43.304743 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:57:43.304743 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 04 16:57:43.304743 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:43.304743 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-425abee1-320a-41e7-99ca-45435440b500 tempest-TenantUsagesNegativeTestJSON-625875683 tempest-TenantUsagesNegativeTestJSON-625875683-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:57:43.304743 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-425abee1-320a-41e7-99ca-45435440b500 tempest-TenantUsagesNegativeTestJSON-625875683 tempest-TenantUsagesNegativeTestJSON-625875683-project] 10.222.0.93 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-03T16%3A57%3A40.702278&end=2022-08-05T16%3A57%3A40.702278&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.233771 Aug 04 16:57:43.310172 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 436/914] 10.222.0.93 () {58 vars in 1335 bytes} [Thu Aug 4 16:57:43 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-03T16%3A57%3A40.702278&end=2022-08-05T16%3A57%3A40.702278&detailed=1 => generated 123 bytes in 242 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:57:43.323528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1455d77b-9682-4a69-87f3-4d7e2624dde6 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:43.334017 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1455d77b-9682-4a69-87f3-4d7e2624dde6 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Searching by: {'deleted': False} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:57:43.334932 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-0eb60310-d52d-4a29-88e9-314214ee5b4e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] validate_networks() for None {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:57:43.352056 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1455d77b-9682-4a69-87f3-4d7e2624dde6 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:43.352470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1455d77b-9682-4a69-87f3-4d7e2624dde6 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:43.352915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1455d77b-9682-4a69-87f3-4d7e2624dde6 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:43.353652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1455d77b-9682-4a69-87f3-4d7e2624dde6 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:43.354146 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1455d77b-9682-4a69-87f3-4d7e2624dde6 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:43.354578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1455d77b-9682-4a69-87f3-4d7e2624dde6 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:43.607666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-1455d77b-9682-4a69-87f3-4d7e2624dde6 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Listed batch of 11 results from cell out of 1000 limit. Returned 11 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:57:43.779404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-0eb60310-d52d-4a29-88e9-314214ee5b4e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:57:43.780427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-0eb60310-d52d-4a29-88e9-314214ee5b4e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:57:43.781151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-0eb60310-d52d-4a29-88e9-314214ee5b4e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:57:43.781808 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-0eb60310-d52d-4a29-88e9-314214ee5b4e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:57:43.782545 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-0eb60310-d52d-4a29-88e9-314214ee5b4e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:57:43.820036 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0eb60310-d52d-4a29-88e9-314214ee5b4e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:43.823508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0eb60310-d52d-4a29-88e9-314214ee5b4e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:43.824370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0eb60310-d52d-4a29-88e9-314214ee5b4e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:43.828304 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0eb60310-d52d-4a29-88e9-314214ee5b4e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:43.830431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0eb60310-d52d-4a29-88e9-314214ee5b4e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:43.831168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0eb60310-d52d-4a29-88e9-314214ee5b4e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:43.859840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-0eb60310-d52d-4a29-88e9-314214ee5b4e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Getting quotas for project 6f64e49086c94f65ba1fc2ef97b6bcde. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:57:43.871376 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-0eb60310-d52d-4a29-88e9-314214ee5b4e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Getting quotas for user 655795644d9941c99a82d15d9daa5ab5 and project 6f64e49086c94f65ba1fc2ef97b6bcde. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:57:43.902184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1455d77b-9682-4a69-87f3-4d7e2624dde6 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:43.903329 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1455d77b-9682-4a69-87f3-4d7e2624dde6 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:43.904513 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1455d77b-9682-4a69-87f3-4d7e2624dde6 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:43.909598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0eb60310-d52d-4a29-88e9-314214ee5b4e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:57:43.916452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0eb60310-d52d-4a29-88e9-314214ee5b4e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:57:44.044574 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0eb60310-d52d-4a29-88e9-314214ee5b4e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.866873 Aug 04 16:57:44.045173 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 479/915] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:57:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:57:44.060830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a3f0815f-31ed-4be5-b684-cdeaf757d2b1 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Action: 'create', calling method: .version_select at 0x7f1e5be4e790>, body: {"security_group": {"name": " tempest-securitygroup -324789752 ", "description": "tempest-description-1124811339"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:45.007852 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a3f0815f-31ed-4be5-b684-cdeaf757d2b1 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.961584 Aug 04 16:57:45.009124 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 480/916] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Aug 4 16:57:44 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:45.020521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8613efc2-8b21-4691-b46d-123bdb16e47f tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:45.021427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8613efc2-8b21-4691-b46d-123bdb16e47f tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:45.037667 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8613efc2-8b21-4691-b46d-123bdb16e47f tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:45.038492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8613efc2-8b21-4691-b46d-123bdb16e47f tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:45.039112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8613efc2-8b21-4691-b46d-123bdb16e47f tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:45.040042 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8613efc2-8b21-4691-b46d-123bdb16e47f tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:45.040692 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8613efc2-8b21-4691-b46d-123bdb16e47f tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:45.041382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8613efc2-8b21-4691-b46d-123bdb16e47f tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:45.757110 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1455d77b-9682-4a69-87f3-4d7e2624dde6 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 18386 microversion: 2.1 time: 2.445741 Aug 04 16:57:45.758905 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 437/917] 10.222.0.93 () {58 vars in 1171 bytes} [Thu Aug 4 16:57:43 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 18386 bytes in 2448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:57:45.764457 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-01ae4b52-de21-4fc2-bd9e-1feb71cdf0bf req-5730f97c-b249-4fbd-8b6e-f879c0c4bae7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c8b06b6-59a1-4595-b2ee-539a4c9dbc83", "tag": "2f81e029-164b-4fbb-9431-2ee5454d602d"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:45.813080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-01ae4b52-de21-4fc2-bd9e-1feb71cdf0bf req-5730f97c-b249-4fbd-8b6e-f879c0c4bae7 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:45.813080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-01ae4b52-de21-4fc2-bd9e-1feb71cdf0bf req-5730f97c-b249-4fbd-8b6e-f879c0c4bae7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:45.813270 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-01ae4b52-de21-4fc2-bd9e-1feb71cdf0bf req-5730f97c-b249-4fbd-8b6e-f879c0c4bae7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:45.837147 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-01ae4b52-de21-4fc2-bd9e-1feb71cdf0bf req-5730f97c-b249-4fbd-8b6e-f879c0c4bae7 service nova] Creating event network-changed:2f81e029-164b-4fbb-9431-2ee5454d602d for instance 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 on n-h1-851359-3 Aug 04 16:57:45.858245 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-01ae4b52-de21-4fc2-bd9e-1feb71cdf0bf req-5730f97c-b249-4fbd-8b6e-f879c0c4bae7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097775 Aug 04 16:57:45.866392 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 438/918] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:45.877828 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-59c6550a-b95f-41f7-beb6-ac870216abf9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:45.878581 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-59c6550a-b95f-41f7-beb6-ac870216abf9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:45.900980 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59c6550a-b95f-41f7-beb6-ac870216abf9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:45.902302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59c6550a-b95f-41f7-beb6-ac870216abf9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:45.904475 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59c6550a-b95f-41f7-beb6-ac870216abf9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:45.905501 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59c6550a-b95f-41f7-beb6-ac870216abf9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:45.906215 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59c6550a-b95f-41f7-beb6-ac870216abf9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:45.906670 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59c6550a-b95f-41f7-beb6-ac870216abf9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:45.911582 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8613efc2-8b21-4691-b46d-123bdb16e47f tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:45.923115 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8613efc2-8b21-4691-b46d-123bdb16e47f tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:45.924900 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8613efc2-8b21-4691-b46d-123bdb16e47f tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:45.929156 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8613efc2-8b21-4691-b46d-123bdb16e47f tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3" status: 200 len: 1565 microversion: 2.25 time: 0.918840 Aug 04 16:57:45.950787 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 481/919] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:45 2022] GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 => generated 1565 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:45.967132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f82b24a8-1da8-4711-93bf-e4dd712f96a6 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '.version_select at 0x7f1e68081550>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:46.167565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-59c6550a-b95f-41f7-beb6-ac870216abf9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:46.181024 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-59c6550a-b95f-41f7-beb6-ac870216abf9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1338 microversion: 2.1 time: 0.313238 Aug 04 16:57:46.186460 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 439/920] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:45 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1338 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:46.196653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-00771fa5-2e9b-4a1b-aaad-60aee8866579 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:46.213813 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-00771fa5-2e9b-4a1b-aaad-60aee8866579 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Searching by: {'deleted': False, 'project_id': 'd506baaf1ae741fbb1e07a2df68a1487'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:57:46.226959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00771fa5-2e9b-4a1b-aaad-60aee8866579 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:46.226959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00771fa5-2e9b-4a1b-aaad-60aee8866579 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:46.227372 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00771fa5-2e9b-4a1b-aaad-60aee8866579 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:46.228222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00771fa5-2e9b-4a1b-aaad-60aee8866579 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:46.228729 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00771fa5-2e9b-4a1b-aaad-60aee8866579 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:46.229286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00771fa5-2e9b-4a1b-aaad-60aee8866579 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:46.241856 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f82b24a8-1da8-4711-93bf-e4dd712f96a6 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups/33a0c34a-492a-441d-8e45-8017f34a74a7" status: 200 len: 223 microversion: 2.1 time: 0.280246 Aug 04 16:57:46.243281 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 482/921] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Aug 4 16:57:45 2022] GET /compute/v2.1/os-security-groups/33a0c34a-492a-441d-8e45-8017f34a74a7 => generated 223 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:46.297438 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-00771fa5-2e9b-4a1b-aaad-60aee8866579 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/detail?tenant_id=42f88328efc24fa4b8e8e5023bd6d5a1" status: 200 len: 15 microversion: 2.1 time: 0.109666 Aug 04 16:57:46.301877 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 440/922] 10.222.0.93 () {58 vars in 1231 bytes} [Thu Aug 4 16:57:46 2022] GET /compute/v2.1/servers/detail?tenant_id=42f88328efc24fa4b8e8e5023bd6d5a1 => generated 15 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:57:46.312389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-847db17f-ced1-4244-ad56-2bef4bdfd377 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '.version_select at 0x7f1e5bf235e0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:46.687070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ce9ffabc-6504-4c63-887b-e88c9cc65d4e tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Action: 'create', calling method: .version_select at 0x7f1e5bf37d30>, body: {"keypair": {"name": "tempest-keypair-706721067", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzHll1cK9dwJNlbz28hOfSXVkOTmNzklIoofl6z3MLlQxkgi4j4kq9TmbPA8IqnlnvI7UBZmvCoFXglVBhryrAs/XAbCicjN00VTOeZSt9gFu9FVHB3Uhfvh5dPOpHqlQ=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:46.717444 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-847db17f-ced1-4244-ad56-2bef4bdfd377 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/33a0c34a-492a-441d-8e45-8017f34a74a7" status: 202 len: 0 microversion: 2.1 time: 0.414137 Aug 04 16:57:46.718281 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 441/923] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 16:57:46 2022] DELETE /compute/v2.1/os-security-groups/33a0c34a-492a-441d-8e45-8017f34a74a7 => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:57:46.723296 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0a304c37-e6c2-4402-b615-ec5e2f7873fb tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:46.729760 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0a304c37-e6c2-4402-b615-ec5e2f7873fb tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Searching by: {'tenant_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'deleted': False} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:57:46.748207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a304c37-e6c2-4402-b615-ec5e2f7873fb tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:46.748708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a304c37-e6c2-4402-b615-ec5e2f7873fb tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:46.749165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a304c37-e6c2-4402-b615-ec5e2f7873fb tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:46.749932 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a304c37-e6c2-4402-b615-ec5e2f7873fb tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:46.750966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-ce9ffabc-6504-4c63-887b-e88c9cc65d4e tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Getting quotas for project 50604ce0bb604209a3c18932fdd193e2. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:57:46.764724 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a304c37-e6c2-4402-b615-ec5e2f7873fb tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:46.765241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a304c37-e6c2-4402-b615-ec5e2f7873fb tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:46.769877 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-ce9ffabc-6504-4c63-887b-e88c9cc65d4e tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Getting quotas for user 08ad6ccd2d804e158989a5f94c6f9a2f and project 50604ce0bb604209a3c18932fdd193e2. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:57:46.832108 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ce9ffabc-6504-4c63-887b-e88c9cc65d4e tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.584918 Aug 04 16:57:46.833988 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 483/924] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 16:57:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:46.845089 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-0a304c37-e6c2-4402-b615-ec5e2f7873fb tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:57:46.845302 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ef280478-2320-4f0d-a429-9468698fe318 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '.version_select at 0x7f1e5b9f98b0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:46.960076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG neutronclient.v2_0.client [None req-ef280478-2320-4f0d-a429-9468698fe318 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 33a0c34a-492a-441d-8e45-8017f34a74a7 does not exist", "detail": ""}} {{(pid=131043) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:57:46.968668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.security_group_api [None req-ef280478-2320-4f0d-a429-9468698fe318 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Neutron security group 33a0c34a-492a-441d-8e45-8017f34a74a7 not found {{(pid=131043) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 16:57:46.969382 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-ef280478-2320-4f0d-a429-9468698fe318 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] HTTP exception thrown: Security group 33a0c34a-492a-441d-8e45-8017f34a74a7 does not exist Aug 04 16:57:46.969382 n-d-851359-3 devstack@n-api.service[131043]: Neutron server returns request_ids: ['req-f60f0a18-cef4-4743-a124-e975e1596f9d'] Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ef280478-2320-4f0d-a429-9468698fe318 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Request method failure captured: Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/os-security-groups/33a0c34a-492a-441d-8e45-8017f34a74a7 HTTP/1.1 Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_pjNxGdIj4rXs7GW0_V_LIfBAwJuU8zCy9GzNAxdG5ZTEUBvkg39A9YsV-x75Y0btHlF-rpmXrDhvRCz9GI3Wx5SWU7zVXPxh15depvYj5y_bJWqGesF6D1R4D_MXtZ4ixR6WiUOhX-7Ef4eUOV6pVChDbMDy3f5C8W9ilQQLLYZGk Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 985c6a3e9f43418bb14d9d3fbf8df8d4 Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}] Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 985c6a3e9f43418bb14d9d3fbf8df8d4 Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-SecurityGroupsTestJSON-961611610-project Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: f6232496fbe3458e8a3fde3fdabe9d05 Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-SecurityGroupsTestJSON-961611610-project Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: exception: Security group 33a0c34a-492a-441d-8e45-8017f34a74a7 does not exist Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: Neutron server returns request_ids: ['req-f60f0a18-cef4-4743-a124-e975e1596f9d'] Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '33a0c34a-492a-441d-8e45-8017f34a74a7'} Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:57:46.976307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 33a0c34a-492a-441d-8e45-8017f34a74a7 does not exist Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f60f0a18-cef4-4743-a124-e975e1596f9d'] Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 33a0c34a-492a-441d-8e45-8017f34a74a7 does not exist Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f60f0a18-cef4-4743-a124-e975e1596f9d'] Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 33a0c34a-492a-441d-8e45-8017f34a74a7 does not exist Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f60f0a18-cef4-4743-a124-e975e1596f9d'] Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 33a0c34a-492a-441d-8e45-8017f34a74a7 does not exist Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f60f0a18-cef4-4743-a124-e975e1596f9d'] Aug 04 16:57:46.980226 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:57:46.988787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ef280478-2320-4f0d-a429-9468698fe318 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Returning 404 to user: Security group 33a0c34a-492a-441d-8e45-8017f34a74a7 does not exist Aug 04 16:57:46.988787 n-d-851359-3 devstack@n-api.service[131043]: Neutron server returns request_ids: ['req-f60f0a18-cef4-4743-a124-e975e1596f9d'] {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:57:46.992986 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ef280478-2320-4f0d-a429-9468698fe318 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups/33a0c34a-492a-441d-8e45-8017f34a74a7" status: 404 len: 194 microversion: 2.1 time: 0.156139 Aug 04 16:57:46.994384 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 484/925] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Aug 4 16:57:46 2022] GET /compute/v2.1/os-security-groups/33a0c34a-492a-441d-8e45-8017f34a74a7 => generated 194 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:57:47.006635 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a304c37-e6c2-4402-b615-ec5e2f7873fb tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:47.007230 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a304c37-e6c2-4402-b615-ec5e2f7873fb tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:47.007773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a304c37-e6c2-4402-b615-ec5e2f7873fb tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:47.011164 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-38adcfb5-61f5-4817-8c77-6e44fe3248a1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:47.012194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-38adcfb5-61f5-4817-8c77-6e44fe3248a1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:47.014170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:47.020366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38adcfb5-61f5-4817-8c77-6e44fe3248a1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:47.021163 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38adcfb5-61f5-4817-8c77-6e44fe3248a1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:47.021871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38adcfb5-61f5-4817-8c77-6e44fe3248a1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:47.023610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38adcfb5-61f5-4817-8c77-6e44fe3248a1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:47.024772 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38adcfb5-61f5-4817-8c77-6e44fe3248a1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:47.026131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38adcfb5-61f5-4817-8c77-6e44fe3248a1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:47.440064 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0a304c37-e6c2-4402-b615-ec5e2f7873fb tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=42f88328efc24fa4b8e8e5023bd6d5a1" status: 200 len: 4825 microversion: 2.1 time: 0.720329 Aug 04 16:57:47.441318 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 442/926] 10.222.0.93 () {58 vars in 1257 bytes} [Thu Aug 4 16:57:46 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=42f88328efc24fa4b8e8e5023bd6d5a1 => generated 4825 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:47.446369 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-38adcfb5-61f5-4817-8c77-6e44fe3248a1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:47.448774 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1dc8cf98-d0fc-49d2-9f58-942e5b6e2188 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Action: 'create', calling method: .version_select at 0x7f1e68173d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1441474121", "description": "tempest-description-1697746548"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:47.469368 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-38adcfb5-61f5-4817-8c77-6e44fe3248a1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:47.471682 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-38adcfb5-61f5-4817-8c77-6e44fe3248a1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:47.473377 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-38adcfb5-61f5-4817-8c77-6e44fe3248a1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3" status: 200 len: 1565 microversion: 2.25 time: 0.477649 Aug 04 16:57:47.475636 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 485/927] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:46 2022] GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 => generated 1565 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:47.482195 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-47208250-6241-4eb6-b018-c151acd7064b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:47.483299 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-47208250-6241-4eb6-b018-c151acd7064b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:47.490683 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47208250-6241-4eb6-b018-c151acd7064b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:47.492039 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47208250-6241-4eb6-b018-c151acd7064b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:47.492649 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47208250-6241-4eb6-b018-c151acd7064b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:47.493373 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47208250-6241-4eb6-b018-c151acd7064b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:47.493839 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47208250-6241-4eb6-b018-c151acd7064b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:47.494590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47208250-6241-4eb6-b018-c151acd7064b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:47.626868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-47208250-6241-4eb6-b018-c151acd7064b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:47.638114 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-47208250-6241-4eb6-b018-c151acd7064b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1336 microversion: 2.1 time: 0.160727 Aug 04 16:57:47.662029 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 486/928] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:47 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1336 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:47.672133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fc5311b9-dd90-4e7e-8058-2ef0d649a970 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:47.679292 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fc5311b9-dd90-4e7e-8058-2ef0d649a970 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Searching by: {'tenant_id': 'd506baaf1ae741fbb1e07a2df68a1487', 'deleted': False} {{(pid=131043) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:57:47.687828 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc5311b9-dd90-4e7e-8058-2ef0d649a970 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:47.688989 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc5311b9-dd90-4e7e-8058-2ef0d649a970 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:47.689667 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc5311b9-dd90-4e7e-8058-2ef0d649a970 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:47.690726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc5311b9-dd90-4e7e-8058-2ef0d649a970 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:47.691454 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc5311b9-dd90-4e7e-8058-2ef0d649a970 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:47.692106 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc5311b9-dd90-4e7e-8058-2ef0d649a970 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:47.808131 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1dc8cf98-d0fc-49d2-9f58-942e5b6e2188 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.364883 Aug 04 16:57:47.809118 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 443/929] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Aug 4 16:57:47 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:47.829759 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ef6d00d0-f592-486d-86c5-030e446b1826 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Action: 'create', calling method: .version_select at 0x7f1e5bfd8d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-400340211", "description": "tempest-description-1602207746"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:47.836112 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fc5311b9-dd90-4e7e-8058-2ef0d649a970 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=d506baaf1ae741fbb1e07a2df68a1487" status: 200 len: 15 microversion: 2.1 time: 0.172927 Aug 04 16:57:47.837323 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 487/930] 10.222.0.93 () {58 vars in 1257 bytes} [Thu Aug 4 16:57:47 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=d506baaf1ae741fbb1e07a2df68a1487 => generated 15 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:57:47.875072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-eb25da69-60a9-43d8-830a-e4f740888265 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:47.897958 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-eb25da69-60a9-43d8-830a-e4f740888265 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.037822 Aug 04 16:57:47.898641 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 488/931] 10.222.0.93 () {58 vars in 1189 bytes} [Thu Aug 4 16:57:47 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:57:47.916617 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-f52828a7-e40a-499d-a052-61b762364d34 req-dac53708-013b-4b74-8508-90888116c35e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98e4458d-d7e4-4663-a974-70ccbe5501f3", "name": "network-vif-unplugged", "status": "completed", "tag": "3feec73d-d957-4633-8d95-d8f2f43a58be"}, {"name": "network-changed", "server_uuid": "98e4458d-d7e4-4663-a974-70ccbe5501f3", "tag": "3feec73d-d957-4633-8d95-d8f2f43a58be"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:47.957795 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f52828a7-e40a-499d-a052-61b762364d34 req-dac53708-013b-4b74-8508-90888116c35e service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:47.960978 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f52828a7-e40a-499d-a052-61b762364d34 req-dac53708-013b-4b74-8508-90888116c35e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:47.962779 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f52828a7-e40a-499d-a052-61b762364d34 req-dac53708-013b-4b74-8508-90888116c35e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:47.991009 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-f52828a7-e40a-499d-a052-61b762364d34 req-dac53708-013b-4b74-8508-90888116c35e service nova] Creating event network-vif-unplugged:3feec73d-d957-4633-8d95-d8f2f43a58be for instance 98e4458d-d7e4-4663-a974-70ccbe5501f3 on n-h1-851359-3 Aug 04 16:57:47.995835 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-f52828a7-e40a-499d-a052-61b762364d34 req-dac53708-013b-4b74-8508-90888116c35e service nova] Creating event network-changed:3feec73d-d957-4633-8d95-d8f2f43a58be for instance 98e4458d-d7e4-4663-a974-70ccbe5501f3 on n-h1-851359-3 Aug 04 16:57:48.007659 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-f52828a7-e40a-499d-a052-61b762364d34 req-dac53708-013b-4b74-8508-90888116c35e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.106705 Aug 04 16:57:48.010710 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 489/932] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:48.026847 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1265a297-1822-4687-bd79-005d4220c8b0 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:48.034339 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1265a297-1822-4687-bd79-005d4220c8b0 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:48.053628 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1265a297-1822-4687-bd79-005d4220c8b0 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:48.055562 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1265a297-1822-4687-bd79-005d4220c8b0 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:48.057453 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1265a297-1822-4687-bd79-005d4220c8b0 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:48.060484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1265a297-1822-4687-bd79-005d4220c8b0 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:48.061272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1265a297-1822-4687-bd79-005d4220c8b0 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:48.066909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1265a297-1822-4687-bd79-005d4220c8b0 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:48.257000 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ef6d00d0-f592-486d-86c5-030e446b1826 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.437351 Aug 04 16:57:48.258177 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 444/933] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Aug 4 16:57:47 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:57:48.273727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-65b189d5-b044-41d9-912b-60a6752a7893 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Action: 'create', calling method: .version_select at 0x7f1e5b6c6dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-858261125", "description": "tempest-description-952562532"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:48.301744 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1265a297-1822-4687-bd79-005d4220c8b0 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c/action" status: 202 len: 0 microversion: 2.1 time: 0.287120 Aug 04 16:57:48.303071 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 490/934] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:57:48 2022] POST /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:57:48.315653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f7d9980a-f77a-4045-a468-8e181b4bfbbc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:48.325691 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f7d9980a-f77a-4045-a468-8e181b4bfbbc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:48.326736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f7d9980a-f77a-4045-a468-8e181b4bfbbc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1'} {{(pid=131043) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:57:48.382977 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7d9980a-f77a-4045-a468-8e181b4bfbbc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:48.383626 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7d9980a-f77a-4045-a468-8e181b4bfbbc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:48.385654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7d9980a-f77a-4045-a468-8e181b4bfbbc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:48.387336 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7d9980a-f77a-4045-a468-8e181b4bfbbc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:48.388637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7d9980a-f77a-4045-a468-8e181b4bfbbc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:48.389078 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7d9980a-f77a-4045-a468-8e181b4bfbbc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:48.558801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.multi_cell_list [None req-f7d9980a-f77a-4045-a468-8e181b4bfbbc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:57:48.587559 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-65b189d5-b044-41d9-912b-60a6752a7893 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.319514 Aug 04 16:57:48.588043 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 445/935] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Aug 4 16:57:48 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:48.593500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4abc63e0-de08-4472-9974-d40b59a4a2dd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:48.594350 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4abc63e0-de08-4472-9974-d40b59a4a2dd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:48.611434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4abc63e0-de08-4472-9974-d40b59a4a2dd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:48.615174 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4abc63e0-de08-4472-9974-d40b59a4a2dd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:48.616288 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4abc63e0-de08-4472-9974-d40b59a4a2dd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:48.617450 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4abc63e0-de08-4472-9974-d40b59a4a2dd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:48.620437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4abc63e0-de08-4472-9974-d40b59a4a2dd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:48.621194 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4abc63e0-de08-4472-9974-d40b59a4a2dd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:48.719565 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f7d9980a-f77a-4045-a468-8e181b4bfbbc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.409154 Aug 04 16:57:48.720552 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 491/936] 10.222.0.93 () {58 vars in 1150 bytes} [Thu Aug 4 16:57:48 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:48.725279 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6f7dae50-1d80-4920-ac01-1992e227534e tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '.version_select at 0x7f1e5bac5b80>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:49.047134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4abc63e0-de08-4472-9974-d40b59a4a2dd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:49.062645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4abc63e0-de08-4472-9974-d40b59a4a2dd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:49.064544 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4abc63e0-de08-4472-9974-d40b59a4a2dd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:49.076837 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4abc63e0-de08-4472-9974-d40b59a4a2dd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3" status: 200 len: 1565 microversion: 2.25 time: 0.477318 Aug 04 16:57:49.082317 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 446/937] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:48 2022] GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 => generated 1565 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:49.109847 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-473cf28a-704c-4cda-a5b4-0c766df389e9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:49.110617 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-473cf28a-704c-4cda-a5b4-0c766df389e9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:49.118775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-473cf28a-704c-4cda-a5b4-0c766df389e9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:49.119552 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-473cf28a-704c-4cda-a5b4-0c766df389e9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:49.120248 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-473cf28a-704c-4cda-a5b4-0c766df389e9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:49.121179 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-473cf28a-704c-4cda-a5b4-0c766df389e9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:49.122832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-473cf28a-704c-4cda-a5b4-0c766df389e9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:49.123538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-473cf28a-704c-4cda-a5b4-0c766df389e9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:49.192268 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6f7dae50-1d80-4920-ac01-1992e227534e tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 0.470512 Aug 04 16:57:49.193230 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 492/938] 10.222.0.93 () {58 vars in 1158 bytes} [Thu Aug 4 16:57:48 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:49.199726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ad593aed-89ed-4ac3-8428-4e324598f04a tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:49.203031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ad593aed-89ed-4ac3-8428-4e324598f04a tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:49.213194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad593aed-89ed-4ac3-8428-4e324598f04a tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:49.213785 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad593aed-89ed-4ac3-8428-4e324598f04a tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:49.214495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad593aed-89ed-4ac3-8428-4e324598f04a tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:49.216102 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad593aed-89ed-4ac3-8428-4e324598f04a tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:49.217870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad593aed-89ed-4ac3-8428-4e324598f04a tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:49.218344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad593aed-89ed-4ac3-8428-4e324598f04a tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:49.317566 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ad593aed-89ed-4ac3-8428-4e324598f04a tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c/action" status: 202 len: 0 microversion: 2.1 time: 0.122836 Aug 04 16:57:49.321418 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 493/939] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:57:49 2022] POST /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:57:49.399173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-473cf28a-704c-4cda-a5b4-0c766df389e9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:49.410676 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-473cf28a-704c-4cda-a5b4-0c766df389e9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1378 microversion: 2.1 time: 0.326707 Aug 04 16:57:49.411928 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 447/940] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:49 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1378 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:49.417664 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3da85fe4-5816-4b49-83b4-0092ad684a78 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '.version_select at 0x7f1e5b6eb940>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:49.505088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2a600de4-f70a-49c7-9e0e-1b022ca80047 tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:49.515784 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2a600de4-f70a-49c7-9e0e-1b022ca80047 tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.195466 Aug 04 16:57:49.520053 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 494/941] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Aug 4 16:57:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:49.525138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6115292e-5b28-49e0-9698-f146f25a9285 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:49.526063 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6115292e-5b28-49e0-9698-f146f25a9285 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:49.536428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6115292e-5b28-49e0-9698-f146f25a9285 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:49.537137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6115292e-5b28-49e0-9698-f146f25a9285 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:49.537780 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6115292e-5b28-49e0-9698-f146f25a9285 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:49.539024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6115292e-5b28-49e0-9698-f146f25a9285 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:49.539994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6115292e-5b28-49e0-9698-f146f25a9285 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:49.543208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6115292e-5b28-49e0-9698-f146f25a9285 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:49.833638 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6115292e-5b28-49e0-9698-f146f25a9285 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1615 microversion: 2.1 time: 0.311656 Aug 04 16:57:49.834308 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 495/942] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:49 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1615 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:49.838552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-538c18de-57e9-4629-8e63-666f9d202a3c tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:49.874360 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-538c18de-57e9-4629-8e63-666f9d202a3c tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] 10.222.0.93 "GET /compute/v2.1/flavors" status: 200 len: 3399 microversion: 2.1 time: 0.039408 Aug 04 16:57:49.884729 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 496/943] 10.222.0.93 () {58 vars in 1125 bytes} [Thu Aug 4 16:57:49 2022] GET /compute/v2.1/flavors => generated 3399 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:49.889793 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-b4c88eb2-1beb-466a-87af-88439a828fc6 req-88a61db9-f5c6-412e-a7ad-ea17600919bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1250487f-b35f-4803-b7b3-a9a80850fa12", "tag": "167d17c7-b0d3-40d2-8410-10740bd6347f"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:49.899533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b4c88eb2-1beb-466a-87af-88439a828fc6 req-88a61db9-f5c6-412e-a7ad-ea17600919bb service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:49.900041 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b4c88eb2-1beb-466a-87af-88439a828fc6 req-88a61db9-f5c6-412e-a7ad-ea17600919bb service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:49.900486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b4c88eb2-1beb-466a-87af-88439a828fc6 req-88a61db9-f5c6-412e-a7ad-ea17600919bb service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:49.911805 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-b4c88eb2-1beb-466a-87af-88439a828fc6 req-88a61db9-f5c6-412e-a7ad-ea17600919bb service nova] Creating event network-changed:167d17c7-b0d3-40d2-8410-10740bd6347f for instance 1250487f-b35f-4803-b7b3-a9a80850fa12 on n-h2-851359-3 Aug 04 16:57:49.917858 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-b4c88eb2-1beb-466a-87af-88439a828fc6 req-88a61db9-f5c6-412e-a7ad-ea17600919bb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031692 Aug 04 16:57:49.919714 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 497/944] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:49.925778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-387e8204-b9ed-4671-8585-f01b88766573 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:49.926595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-387e8204-b9ed-4671-8585-f01b88766573 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:49.933530 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-387e8204-b9ed-4671-8585-f01b88766573 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:49.934127 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-387e8204-b9ed-4671-8585-f01b88766573 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:49.935342 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-387e8204-b9ed-4671-8585-f01b88766573 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:49.936290 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-387e8204-b9ed-4671-8585-f01b88766573 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:49.936768 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-387e8204-b9ed-4671-8585-f01b88766573 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:49.937256 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-387e8204-b9ed-4671-8585-f01b88766573 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:49.940160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:50.055281 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3da85fe4-5816-4b49-83b4-0092ad684a78 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/91c75abb-91e3-4f45-9962-77747eb97500" status: 202 len: 0 microversion: 2.1 time: 0.642020 Aug 04 16:57:50.056541 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 448/945] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 16:57:49 2022] DELETE /compute/v2.1/os-security-groups/91c75abb-91e3-4f45-9962-77747eb97500 => generated 0 bytes in 644 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:57:50.063450 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d35750c9-1ed1-41b7-8a1c-00cf06cac803 tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:50.072908 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d35750c9-1ed1-41b7-8a1c-00cf06cac803 tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014893 Aug 04 16:57:50.074709 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 449/946] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Aug 4 16:57:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:50.080179 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-27e054c2-73df-4873-8829-d6aef0da5fff tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '.version_select at 0x7f1e5bf1a700>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:50.129951 n-d-851359-3 devstack@n-api.service[131044]: DEBUG neutronclient.v2_0.client [None req-27e054c2-73df-4873-8829-d6aef0da5fff tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 91c75abb-91e3-4f45-9962-77747eb97500 does not exist", "detail": ""}} {{(pid=131044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:57:50.130857 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.security_group_api [None req-27e054c2-73df-4873-8829-d6aef0da5fff tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Neutron security group 91c75abb-91e3-4f45-9962-77747eb97500 not found {{(pid=131044) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 16:57:50.131581 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-27e054c2-73df-4873-8829-d6aef0da5fff tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] HTTP exception thrown: Security group 91c75abb-91e3-4f45-9962-77747eb97500 does not exist Aug 04 16:57:50.131581 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-9bb273ee-8a8f-4155-8443-0daab528f531'] Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-27e054c2-73df-4873-8829-d6aef0da5fff tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Request method failure captured: Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-security-groups/91c75abb-91e3-4f45-9962-77747eb97500 HTTP/1.1 Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_pjNxGdIj4rXs7GW0_V_LIfBAwJuU8zCy9GzNAxdG5ZTEUBvkg39A9YsV-x75Y0btHlF-rpmXrDhvRCz9GI3Wx5SWU7zVXPxh15depvYj5y_bJWqGesF6D1R4D_MXtZ4ixR6WiUOhX-7Ef4eUOV6pVChDbMDy3f5C8W9ilQQLLYZGk Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 985c6a3e9f43418bb14d9d3fbf8df8d4 Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}] Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 985c6a3e9f43418bb14d9d3fbf8df8d4 Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-SecurityGroupsTestJSON-961611610-project Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: f6232496fbe3458e8a3fde3fdabe9d05 Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-SecurityGroupsTestJSON-961611610-project Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: exception: Security group 91c75abb-91e3-4f45-9962-77747eb97500 does not exist Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-9bb273ee-8a8f-4155-8443-0daab528f531'] Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '91c75abb-91e3-4f45-9962-77747eb97500'} Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:57:50.135317 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 91c75abb-91e3-4f45-9962-77747eb97500 does not exist Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9bb273ee-8a8f-4155-8443-0daab528f531'] Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 91c75abb-91e3-4f45-9962-77747eb97500 does not exist Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9bb273ee-8a8f-4155-8443-0daab528f531'] Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 91c75abb-91e3-4f45-9962-77747eb97500 does not exist Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9bb273ee-8a8f-4155-8443-0daab528f531'] Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 91c75abb-91e3-4f45-9962-77747eb97500 does not exist Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9bb273ee-8a8f-4155-8443-0daab528f531'] Aug 04 16:57:50.139173 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:50.144697 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-27e054c2-73df-4873-8829-d6aef0da5fff tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Returning 404 to user: Security group 91c75abb-91e3-4f45-9962-77747eb97500 does not exist Aug 04 16:57:50.144697 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-9bb273ee-8a8f-4155-8443-0daab528f531'] {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:57:50.145959 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-27e054c2-73df-4873-8829-d6aef0da5fff tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups/91c75abb-91e3-4f45-9962-77747eb97500" status: 404 len: 194 microversion: 2.1 time: 0.070040 Aug 04 16:57:50.147072 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 450/947] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Aug 4 16:57:50 2022] GET /compute/v2.1/os-security-groups/91c75abb-91e3-4f45-9962-77747eb97500 => generated 194 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:57:50.155174 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c55a00c0-7864-4b1d-82ff-a16f579b8f7e tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:50.166787 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c55a00c0-7864-4b1d-82ff-a16f579b8f7e tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017656 Aug 04 16:57:50.168022 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 451/948] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Aug 4 16:57:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:50.175645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-77545a18-d8be-4acd-baab-1fef3e0dc9b5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:50.176553 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-77545a18-d8be-4acd-baab-1fef3e0dc9b5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:50.184844 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77545a18-d8be-4acd-baab-1fef3e0dc9b5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:50.185577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77545a18-d8be-4acd-baab-1fef3e0dc9b5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:50.186292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77545a18-d8be-4acd-baab-1fef3e0dc9b5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:50.187179 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77545a18-d8be-4acd-baab-1fef3e0dc9b5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:50.187916 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77545a18-d8be-4acd-baab-1fef3e0dc9b5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:50.188566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77545a18-d8be-4acd-baab-1fef3e0dc9b5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:50.208906 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-387e8204-b9ed-4671-8585-f01b88766573 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1615 microversion: 2.1 time: 0.287785 Aug 04 16:57:50.222047 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 498/949] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:49 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1615 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:50.222047 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-51fca4a6-3505-4996-857f-cce8ad9dff82 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '.version_select at 0x7f1e5b7cc3a0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:50.517331 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-77545a18-d8be-4acd-baab-1fef3e0dc9b5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:50.531784 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-77545a18-d8be-4acd-baab-1fef3e0dc9b5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:50.533707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-77545a18-d8be-4acd-baab-1fef3e0dc9b5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:50.536887 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-77545a18-d8be-4acd-baab-1fef3e0dc9b5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3" status: 200 len: 1565 microversion: 2.25 time: 0.367111 Aug 04 16:57:50.538189 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 452/950] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:50 2022] GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 => generated 1565 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:50.544470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-05a50019-db5f-4ec8-ad33-75349bdf07ac tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:50.599430 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-05a50019-db5f-4ec8-ad33-75349bdf07ac tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.059843 Aug 04 16:57:50.600974 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 453/951] 10.222.0.93 () {58 vars in 1165 bytes} [Thu Aug 4 16:57:50 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:50.605752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-27a49d06-75da-4541-8f60-d5f58fc02bf4 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:50.613103 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-27a49d06-75da-4541-8f60-d5f58fc02bf4 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Searching by: {'host': 'n-h2-851359-3', 'deleted': False} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:57:50.620529 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27a49d06-75da-4541-8f60-d5f58fc02bf4 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:50.621588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27a49d06-75da-4541-8f60-d5f58fc02bf4 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:50.622111 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27a49d06-75da-4541-8f60-d5f58fc02bf4 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:50.623928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27a49d06-75da-4541-8f60-d5f58fc02bf4 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:50.624589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27a49d06-75da-4541-8f60-d5f58fc02bf4 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:50.625046 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27a49d06-75da-4541-8f60-d5f58fc02bf4 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:50.747144 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-27a49d06-75da-4541-8f60-d5f58fc02bf4 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 16:57:50.754939 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-51fca4a6-3505-4996-857f-cce8ad9dff82 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/366da985-cf59-4390-975c-1756167687a4" status: 202 len: 0 microversion: 2.1 time: 0.543872 Aug 04 16:57:50.756011 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 499/952] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 16:57:50 2022] DELETE /compute/v2.1/os-security-groups/366da985-cf59-4390-975c-1756167687a4 => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:57:50.761075 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-42a32e60-9563-4a16-8498-9446d02df70b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:50.762174 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-42a32e60-9563-4a16-8498-9446d02df70b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:50.777571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42a32e60-9563-4a16-8498-9446d02df70b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:50.778296 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42a32e60-9563-4a16-8498-9446d02df70b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:50.778850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42a32e60-9563-4a16-8498-9446d02df70b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:50.779678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42a32e60-9563-4a16-8498-9446d02df70b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:50.781203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42a32e60-9563-4a16-8498-9446d02df70b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:50.782538 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42a32e60-9563-4a16-8498-9446d02df70b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:50.815492 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-27a49d06-75da-4541-8f60-d5f58fc02bf4 tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] 10.222.0.93 "GET /compute/v2.1/servers?host=n-h2-851359-3&all_tenants=1" status: 200 len: 2280 microversion: 2.1 time: 0.213211 Aug 04 16:57:50.816205 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 454/953] 10.222.0.93 () {58 vars in 1190 bytes} [Thu Aug 4 16:57:50 2022] GET /compute/v2.1/servers?host=n-h2-851359-3&all_tenants=1 => generated 2280 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:50.820803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c469ba37-c787-4ffc-9cee-b6521d8d4091 tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:50.829942 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c469ba37-c787-4ffc-9cee-b6521d8d4091 tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012670 Aug 04 16:57:50.837031 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 455/954] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Aug 4 16:57:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:50.837031 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-54629299-9e3c-471d-8041-3fa937c25c79 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '.version_select at 0x7f1e5b6eba60>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:50.906814 n-d-851359-3 devstack@n-api.service[131044]: DEBUG neutronclient.v2_0.client [None req-54629299-9e3c-471d-8041-3fa937c25c79 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 366da985-cf59-4390-975c-1756167687a4 does not exist", "detail": ""}} {{(pid=131044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:57:50.907099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.security_group_api [None req-54629299-9e3c-471d-8041-3fa937c25c79 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Neutron security group 366da985-cf59-4390-975c-1756167687a4 not found {{(pid=131044) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 16:57:50.907703 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-54629299-9e3c-471d-8041-3fa937c25c79 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] HTTP exception thrown: Security group 366da985-cf59-4390-975c-1756167687a4 does not exist Aug 04 16:57:50.907703 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-c38452c4-b536-4b37-9d03-fb57898a3744'] Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-54629299-9e3c-471d-8041-3fa937c25c79 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Request method failure captured: Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-security-groups/366da985-cf59-4390-975c-1756167687a4 HTTP/1.1 Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_pjNxGdIj4rXs7GW0_V_LIfBAwJuU8zCy9GzNAxdG5ZTEUBvkg39A9YsV-x75Y0btHlF-rpmXrDhvRCz9GI3Wx5SWU7zVXPxh15depvYj5y_bJWqGesF6D1R4D_MXtZ4ixR6WiUOhX-7Ef4eUOV6pVChDbMDy3f5C8W9ilQQLLYZGk Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 985c6a3e9f43418bb14d9d3fbf8df8d4 Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}] Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 985c6a3e9f43418bb14d9d3fbf8df8d4 Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-SecurityGroupsTestJSON-961611610-project Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: f6232496fbe3458e8a3fde3fdabe9d05 Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-SecurityGroupsTestJSON-961611610-project Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: exception: Security group 366da985-cf59-4390-975c-1756167687a4 does not exist Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-c38452c4-b536-4b37-9d03-fb57898a3744'] Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '366da985-cf59-4390-975c-1756167687a4'} Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:57:50.910840 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 366da985-cf59-4390-975c-1756167687a4 does not exist Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c38452c4-b536-4b37-9d03-fb57898a3744'] Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 366da985-cf59-4390-975c-1756167687a4 does not exist Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c38452c4-b536-4b37-9d03-fb57898a3744'] Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 366da985-cf59-4390-975c-1756167687a4 does not exist Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c38452c4-b536-4b37-9d03-fb57898a3744'] Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 366da985-cf59-4390-975c-1756167687a4 does not exist Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c38452c4-b536-4b37-9d03-fb57898a3744'] Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-54629299-9e3c-471d-8041-3fa937c25c79 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Returning 404 to user: Security group 366da985-cf59-4390-975c-1756167687a4 does not exist Aug 04 16:57:50.915251 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-c38452c4-b536-4b37-9d03-fb57898a3744'] {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:57:50.919789 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-54629299-9e3c-471d-8041-3fa937c25c79 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups/366da985-cf59-4390-975c-1756167687a4" status: 404 len: 194 microversion: 2.1 time: 0.085523 Aug 04 16:57:50.921838 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 456/955] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Aug 4 16:57:50 2022] GET /compute/v2.1/os-security-groups/366da985-cf59-4390-975c-1756167687a4 => generated 194 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:57:50.927570 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1332fcce-a956-4d54-bf37-365055c49acc tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:50.936927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1332fcce-a956-4d54-bf37-365055c49acc tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 16:57:50.942233 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1332fcce-a956-4d54-bf37-365055c49acc tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:50.942635 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1332fcce-a956-4d54-bf37-365055c49acc tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:50.951257 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1332fcce-a956-4d54-bf37-365055c49acc tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:50.951257 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1332fcce-a956-4d54-bf37-365055c49acc tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:50.951257 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1332fcce-a956-4d54-bf37-365055c49acc tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:50.951257 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1332fcce-a956-4d54-bf37-365055c49acc tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:50.967091 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1332fcce-a956-4d54-bf37-365055c49acc tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] 10.222.0.93 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.043898 Aug 04 16:57:50.975947 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 457/956] 10.222.0.93 () {58 vars in 1196 bytes} [Thu Aug 4 16:57:50 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:57:50.975947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e50ab96f-51f2-4c7b-be73-d0fd914eb0cd tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:51.005324 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e50ab96f-51f2-4c7b-be73-d0fd914eb0cd tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.036072 Aug 04 16:57:51.006399 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 458/957] 10.222.0.93 () {58 vars in 1169 bytes} [Thu Aug 4 16:57:50 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:51.012070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-412a4ca1-bcc4-4817-98e7-5d33e4c3cc43 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '.version_select at 0x7f1e5b5c5790>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:51.049855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-42a32e60-9563-4a16-8498-9446d02df70b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:51.058963 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-42a32e60-9563-4a16-8498-9446d02df70b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1378 microversion: 2.1 time: 0.301584 Aug 04 16:57:51.065210 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 500/958] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:50 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1378 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:51.066220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-81e20f75-1180-4359-9dfc-8680bbbc745e tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:51.068864 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-81e20f75-1180-4359-9dfc-8680bbbc745e tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:51.078286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81e20f75-1180-4359-9dfc-8680bbbc745e tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:51.079222 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81e20f75-1180-4359-9dfc-8680bbbc745e tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:51.080138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81e20f75-1180-4359-9dfc-8680bbbc745e tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:51.081087 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81e20f75-1180-4359-9dfc-8680bbbc745e tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:51.081956 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81e20f75-1180-4359-9dfc-8680bbbc745e tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:51.082677 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81e20f75-1180-4359-9dfc-8680bbbc745e tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:51.175965 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-81e20f75-1180-4359-9dfc-8680bbbc745e tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c/action" status: 202 len: 0 microversion: 2.1 time: 0.114506 Aug 04 16:57:51.177835 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 501/959] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:57:51 2022] POST /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:57:51.183158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-57e8a5e0-05a6-4377-99e0-e12f8a1ba58d tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:51.196060 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-57e8a5e0-05a6-4377-99e0-e12f8a1ba58d tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.016905 Aug 04 16:57:51.196652 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 502/960] 10.222.0.93 () {58 vars in 1161 bytes} [Thu Aug 4 16:57:51 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:51.202861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c168f346-000f-42ab-90b2-1bb925afe04d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-497105216", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "c657b79b-df4b-4f0a-af8f-bb04840f17b6"}], "security_groups": [{"name": "tempest-securitygroup--1011100752"}], "key_name": "tempest-keypair-706721067", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:51.251514 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-412a4ca1-bcc4-4817-98e7-5d33e4c3cc43 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/4288d613-06a1-4e43-9ecd-9eecec98f958" status: 202 len: 0 microversion: 2.1 time: 0.244086 Aug 04 16:57:51.252877 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 459/961] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 16:57:51 2022] DELETE /compute/v2.1/os-security-groups/4288d613-06a1-4e43-9ecd-9eecec98f958 => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:57:51.259394 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-41b260fd-753c-42ae-bdb9-b8fc6e0a636c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:51.264137 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-41b260fd-753c-42ae-bdb9-b8fc6e0a636c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:51.288607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41b260fd-753c-42ae-bdb9-b8fc6e0a636c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:51.289204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41b260fd-753c-42ae-bdb9-b8fc6e0a636c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:51.290376 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41b260fd-753c-42ae-bdb9-b8fc6e0a636c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:51.291308 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41b260fd-753c-42ae-bdb9-b8fc6e0a636c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:51.291784 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41b260fd-753c-42ae-bdb9-b8fc6e0a636c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:51.292367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41b260fd-753c-42ae-bdb9-b8fc6e0a636c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:51.330013 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-c168f346-000f-42ab-90b2-1bb925afe04d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] validate_networks() for [('c657b79b-df4b-4f0a-af8f-bb04840f17b6', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:57:51.382964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-41b260fd-753c-42ae-bdb9-b8fc6e0a636c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:57:51.383392 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-41b260fd-753c-42ae-bdb9-b8fc6e0a636c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:57:51.383868 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-41b260fd-753c-42ae-bdb9-b8fc6e0a636c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:57:51.384282 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-41b260fd-753c-42ae-bdb9-b8fc6e0a636c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:57:51.384697 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-41b260fd-753c-42ae-bdb9-b8fc6e0a636c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:57:51.453112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-41b260fd-753c-42ae-bdb9-b8fc6e0a636c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:51.459285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41b260fd-753c-42ae-bdb9-b8fc6e0a636c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:51.459886 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41b260fd-753c-42ae-bdb9-b8fc6e0a636c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:51.460225 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41b260fd-753c-42ae-bdb9-b8fc6e0a636c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:51.460955 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41b260fd-753c-42ae-bdb9-b8fc6e0a636c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:51.461418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41b260fd-753c-42ae-bdb9-b8fc6e0a636c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:51.461845 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41b260fd-753c-42ae-bdb9-b8fc6e0a636c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:51.493446 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-41b260fd-753c-42ae-bdb9-b8fc6e0a636c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "POST /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c/action" status: 202 len: 1068 microversion: 2.1 time: 0.239246 Aug 04 16:57:51.506962 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 460/962] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:57:51 2022] POST /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c/action => generated 1068 bytes in 253 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 16:57:51.513010 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7b3212c2-611a-48dd-bd95-ae78c3daa567 tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:51.522008 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7b3212c2-611a-48dd-bd95-ae78c3daa567 tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013781 Aug 04 16:57:51.522700 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 461/963] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Aug 4 16:57:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:51.532811 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e8c6a490-09f9-4769-bb70-2c54032dc2b4 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '.version_select at 0x7f1e5b5c59d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:51.563562 n-d-851359-3 devstack@n-api.service[131044]: DEBUG neutronclient.v2_0.client [None req-e8c6a490-09f9-4769-bb70-2c54032dc2b4 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4288d613-06a1-4e43-9ecd-9eecec98f958 does not exist", "detail": ""}} {{(pid=131044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.security_group_api [None req-e8c6a490-09f9-4769-bb70-2c54032dc2b4 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Neutron security group 4288d613-06a1-4e43-9ecd-9eecec98f958 not found {{(pid=131044) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-e8c6a490-09f9-4769-bb70-2c54032dc2b4 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] HTTP exception thrown: Security group 4288d613-06a1-4e43-9ecd-9eecec98f958 does not exist Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-03ce7ecd-5ac8-4c02-9bd5-776656caee47'] Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e8c6a490-09f9-4769-bb70-2c54032dc2b4 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Request method failure captured: Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-security-groups/4288d613-06a1-4e43-9ecd-9eecec98f958 HTTP/1.1 Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_pjNxGdIj4rXs7GW0_V_LIfBAwJuU8zCy9GzNAxdG5ZTEUBvkg39A9YsV-x75Y0btHlF-rpmXrDhvRCz9GI3Wx5SWU7zVXPxh15depvYj5y_bJWqGesF6D1R4D_MXtZ4ixR6WiUOhX-7Ef4eUOV6pVChDbMDy3f5C8W9ilQQLLYZGk Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 985c6a3e9f43418bb14d9d3fbf8df8d4 Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}] Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 985c6a3e9f43418bb14d9d3fbf8df8d4 Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-SecurityGroupsTestJSON-961611610-project Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: f6232496fbe3458e8a3fde3fdabe9d05 Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-SecurityGroupsTestJSON-961611610-project Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: exception: Security group 4288d613-06a1-4e43-9ecd-9eecec98f958 does not exist Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-03ce7ecd-5ac8-4c02-9bd5-776656caee47'] Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '4288d613-06a1-4e43-9ecd-9eecec98f958'} Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:57:51.568149 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4288d613-06a1-4e43-9ecd-9eecec98f958 does not exist Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-03ce7ecd-5ac8-4c02-9bd5-776656caee47'] Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4288d613-06a1-4e43-9ecd-9eecec98f958 does not exist Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-03ce7ecd-5ac8-4c02-9bd5-776656caee47'] Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4288d613-06a1-4e43-9ecd-9eecec98f958 does not exist Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-03ce7ecd-5ac8-4c02-9bd5-776656caee47'] Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4288d613-06a1-4e43-9ecd-9eecec98f958 does not exist Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-03ce7ecd-5ac8-4c02-9bd5-776656caee47'] Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e8c6a490-09f9-4769-bb70-2c54032dc2b4 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Returning 404 to user: Security group 4288d613-06a1-4e43-9ecd-9eecec98f958 does not exist Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-03ce7ecd-5ac8-4c02-9bd5-776656caee47'] {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e8c6a490-09f9-4769-bb70-2c54032dc2b4 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups/4288d613-06a1-4e43-9ecd-9eecec98f958" status: 404 len: 194 microversion: 2.1 time: 0.040931 Aug 04 16:57:51.571949 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 462/964] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Aug 4 16:57:51 2022] GET /compute/v2.1/os-security-groups/4288d613-06a1-4e43-9ecd-9eecec98f958 => generated 194 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:57:51.580066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e0969fa1-3af9-4b73-a607-87acfc8a74d9 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:51.580945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e0969fa1-3af9-4b73-a607-87acfc8a74d9 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:51.588088 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0969fa1-3af9-4b73-a607-87acfc8a74d9 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:51.588793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0969fa1-3af9-4b73-a607-87acfc8a74d9 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:51.589366 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0969fa1-3af9-4b73-a607-87acfc8a74d9 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:51.590216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0969fa1-3af9-4b73-a607-87acfc8a74d9 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:51.590874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0969fa1-3af9-4b73-a607-87acfc8a74d9 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:51.591422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0969fa1-3af9-4b73-a607-87acfc8a74d9 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:51.818595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e0969fa1-3af9-4b73-a607-87acfc8a74d9 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:51.826776 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e0969fa1-3af9-4b73-a607-87acfc8a74d9 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1472 microversion: 2.1 time: 0.256046 Aug 04 16:57:51.827682 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 463/965] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:51 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1472 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:51.832261 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fda9d248-11a3-4240-8a43-43ee210960d6 tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:51.859282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-c168f346-000f-42ab-90b2-1bb925afe04d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:57:51.859719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-c168f346-000f-42ab-90b2-1bb925afe04d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:57:51.860201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-c168f346-000f-42ab-90b2-1bb925afe04d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:57:51.860617 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-c168f346-000f-42ab-90b2-1bb925afe04d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:57:51.861036 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-c168f346-000f-42ab-90b2-1bb925afe04d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:57:51.869784 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fda9d248-11a3-4240-8a43-43ee210960d6 tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2989 microversion: 2.1 time: 0.041042 Aug 04 16:57:51.870204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c168f346-000f-42ab-90b2-1bb925afe04d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:51.879434 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 464/966] 10.222.0.93 () {58 vars in 1167 bytes} [Thu Aug 4 16:57:51 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2989 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:51.879634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c168f346-000f-42ab-90b2-1bb925afe04d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:51.879634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c168f346-000f-42ab-90b2-1bb925afe04d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:51.879634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c168f346-000f-42ab-90b2-1bb925afe04d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:51.879634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c168f346-000f-42ab-90b2-1bb925afe04d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:51.879634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c168f346-000f-42ab-90b2-1bb925afe04d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:51.879994 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5c234254-1a3d-400d-951c-91493cc33fa1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:51.879994 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5c234254-1a3d-400d-951c-91493cc33fa1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:51.883587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c234254-1a3d-400d-951c-91493cc33fa1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:51.884084 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c234254-1a3d-400d-951c-91493cc33fa1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:51.884530 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c234254-1a3d-400d-951c-91493cc33fa1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:51.885238 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c234254-1a3d-400d-951c-91493cc33fa1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:51.885701 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c234254-1a3d-400d-951c-91493cc33fa1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:51.886164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c234254-1a3d-400d-951c-91493cc33fa1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:51.893249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-c168f346-000f-42ab-90b2-1bb925afe04d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Getting quotas for project 50604ce0bb604209a3c18932fdd193e2. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:57:51.898051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-c168f346-000f-42ab-90b2-1bb925afe04d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Getting quotas for user 08ad6ccd2d804e158989a5f94c6f9a2f and project 50604ce0bb604209a3c18932fdd193e2. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:57:51.909884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c168f346-000f-42ab-90b2-1bb925afe04d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:57:51.912214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c168f346-000f-42ab-90b2-1bb925afe04d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cf061e67-e261-41e2-a505-95e318126844] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:57:51.971883 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c168f346-000f-42ab-90b2-1bb925afe04d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.774146 Aug 04 16:57:51.978967 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 503/967] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:57:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:57:51.978967 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5804ba2f-09d0-4f9c-8481-a0033e940108 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '.version_select at 0x7f1e5b7e9c10>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:52.077673 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5c234254-1a3d-400d-951c-91493cc33fa1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:52.087800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5c234254-1a3d-400d-951c-91493cc33fa1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:52.089773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5c234254-1a3d-400d-951c-91493cc33fa1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:52.091432 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5c234254-1a3d-400d-951c-91493cc33fa1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3" status: 200 len: 1565 microversion: 2.25 time: 0.219835 Aug 04 16:57:52.092065 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 465/968] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:51 2022] GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 => generated 1565 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:52.096880 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fe883785-6642-4b36-b155-87bff1cef240 tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:52.105284 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fe883785-6642-4b36-b155-87bff1cef240 tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011946 Aug 04 16:57:52.106460 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 466/969] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Aug 4 16:57:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:52.117776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4166b28e-b4a4-422f-b7a8-dd4204af0271 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:52.118430 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4166b28e-b4a4-422f-b7a8-dd4204af0271 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cf061e67-e261-41e2-a505-95e318126844] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:52.176928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4166b28e-b4a4-422f-b7a8-dd4204af0271 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ad6ccd2d804e158989a5f94c6f9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50604ce0bb604209a3c18932fdd193e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:52.186723 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4166b28e-b4a4-422f-b7a8-dd4204af0271 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844" status: 200 len: 1240 microversion: 2.1 time: 0.072709 Aug 04 16:57:52.187296 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 467/970] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:52 2022] GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844 => generated 1240 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:52.192582 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-811a6935-95a8-43c0-a06d-e4d01586c423 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:52.193409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-811a6935-95a8-43c0-a06d-e4d01586c423 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:52.203914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-811a6935-95a8-43c0-a06d-e4d01586c423 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:52.204510 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-811a6935-95a8-43c0-a06d-e4d01586c423 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:52.204960 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-811a6935-95a8-43c0-a06d-e4d01586c423 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:52.205677 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-811a6935-95a8-43c0-a06d-e4d01586c423 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:52.206168 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-811a6935-95a8-43c0-a06d-e4d01586c423 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:52.206600 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-811a6935-95a8-43c0-a06d-e4d01586c423 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:52.215145 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5804ba2f-09d0-4f9c-8481-a0033e940108 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.240822 Aug 04 16:57:52.215873 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 504/971] 10.222.0.93 () {58 vars in 1158 bytes} [Thu Aug 4 16:57:51 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:52.220853 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-833b0df2-7ee0-4460-ad2a-3d653cfc0812 tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:52.247622 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-833b0df2-7ee0-4460-ad2a-3d653cfc0812 tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] 10.222.0.93 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.029908 Aug 04 16:57:52.248349 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 505/972] 10.222.0.93 () {58 vars in 1144 bytes} [Thu Aug 4 16:57:52 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:52.248349 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e57052cf-f00e-46b1-8727-98bac9e70f72 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Action: 'create', calling method: .version_select at 0x7f1e5b9d8940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1067649351", "description": "tempest-description-871835724"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:52.416459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-811a6935-95a8-43c0-a06d-e4d01586c423 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:52.425583 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-811a6935-95a8-43c0-a06d-e4d01586c423 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1378 microversion: 2.1 time: 0.236635 Aug 04 16:57:52.426737 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 468/973] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:52 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1378 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:52.445329 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6bd5906b-3b31-424a-aba8-d77ad042639a tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:52.455827 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6bd5906b-3b31-424a-aba8-d77ad042639a tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014583 Aug 04 16:57:52.456924 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 469/974] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Aug 4 16:57:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:52.473566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b371605b-22c4-4710-8fdb-16155dc004fd tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:52.497122 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b371605b-22c4-4710-8fdb-16155dc004fd tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] 10.222.0.93 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.029474 Aug 04 16:57:52.498528 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e57052cf-f00e-46b1-8727-98bac9e70f72 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.249047 Aug 04 16:57:52.507750 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 506/975] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Aug 4 16:57:52 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:52.508293 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 470/976] 10.222.0.93 () {58 vars in 1148 bytes} [Thu Aug 4 16:57:52 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:52.511594 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-99bb4ba5-c9ba-4940-a06a-6ea87f424bc5 tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:52.513807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f2edb54d-5f7a-4bf1-867c-870a6c024a42 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Action: 'create', calling method: .version_select at 0x7f1e5b592940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-692180328", "description": "tempest-description-1032617970"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:52.534282 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-99bb4ba5-c9ba-4940-a06a-6ea87f424bc5 tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] 10.222.0.93 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.026644 Aug 04 16:57:52.535064 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 507/977] 10.222.0.93 () {58 vars in 1140 bytes} [Thu Aug 4 16:57:52 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:52.552901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5cf43d95-6bf5-4976-adb7-8072719684c9 tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:52.563198 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5cf43d95-6bf5-4976-adb7-8072719684c9 tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016290 Aug 04 16:57:52.564111 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 508/978] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Aug 4 16:57:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:57:52.576197 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6ad5fd7d-0fc4-4ff1-80fe-640ec43de336 tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:52.617761 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6ad5fd7d-0fc4-4ff1-80fe-640ec43de336 tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] 10.222.0.93 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1618 microversion: 2.1 time: 0.045373 Aug 04 16:57:52.627685 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 509/979] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:57:52 2022] GET /compute/v2.1/flavors?marker=452 => generated 1618 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:52.634810 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-70b50248-46d2-4a81-82ce-95d7ac96d889 tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:52.662844 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-70b50248-46d2-4a81-82ce-95d7ac96d889 tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 6309 microversion: 2.1 time: 0.032861 Aug 04 16:57:52.663570 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 510/980] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:57:52 2022] GET /compute/v2.1/flavors/detail => generated 6309 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:52.683806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6a07647e-3b12-4c75-ab95-f6c10363a10e tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:52.693909 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6a07647e-3b12-4c75-ab95-f6c10363a10e tempest-FlavorsV2TestJSON-196362551 tempest-FlavorsV2TestJSON-196362551-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014675 Aug 04 16:57:52.702664 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 511/981] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Aug 4 16:57:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:52.716405 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f2edb54d-5f7a-4bf1-867c-870a6c024a42 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.205991 Aug 04 16:57:52.717196 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 471/982] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Aug 4 16:57:52 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:52.852831 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c681a1f6-18ea-474c-9a7d-87a2caae0a66 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:52.853558 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c681a1f6-18ea-474c-9a7d-87a2caae0a66 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:52.862474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c681a1f6-18ea-474c-9a7d-87a2caae0a66 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:52.863511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c681a1f6-18ea-474c-9a7d-87a2caae0a66 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:52.864248 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c681a1f6-18ea-474c-9a7d-87a2caae0a66 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:52.866305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c681a1f6-18ea-474c-9a7d-87a2caae0a66 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:52.867417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c681a1f6-18ea-474c-9a7d-87a2caae0a66 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:52.868168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c681a1f6-18ea-474c-9a7d-87a2caae0a66 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:52.988799 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-98e15f5d-d510-4f46-8aba-b5b4afe4e894 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-204660526", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "52a50ebb-1421-4698-9ecd-a71892d051d8"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:53.051888 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-98e15f5d-d510-4f46-8aba-b5b4afe4e894 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] validate_networks() for [('52a50ebb-1421-4698-9ecd-a71892d051d8', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:57:53.060503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c681a1f6-18ea-474c-9a7d-87a2caae0a66 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:53.073669 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c681a1f6-18ea-474c-9a7d-87a2caae0a66 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1472 microversion: 2.1 time: 0.228235 Aug 04 16:57:53.074677 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 512/983] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:52 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1472 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:53.114841 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a097b29b-0bd6-4666-9b30-91dbf46ff7e5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:53.115712 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a097b29b-0bd6-4666-9b30-91dbf46ff7e5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:53.122483 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a097b29b-0bd6-4666-9b30-91dbf46ff7e5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:53.122976 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a097b29b-0bd6-4666-9b30-91dbf46ff7e5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:53.123621 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a097b29b-0bd6-4666-9b30-91dbf46ff7e5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:53.124333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a097b29b-0bd6-4666-9b30-91dbf46ff7e5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:53.124849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a097b29b-0bd6-4666-9b30-91dbf46ff7e5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:53.125214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a097b29b-0bd6-4666-9b30-91dbf46ff7e5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:53.352052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a097b29b-0bd6-4666-9b30-91dbf46ff7e5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:53.361532 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a097b29b-0bd6-4666-9b30-91dbf46ff7e5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:53.363149 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a097b29b-0bd6-4666-9b30-91dbf46ff7e5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:53.364330 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a097b29b-0bd6-4666-9b30-91dbf46ff7e5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3" status: 200 len: 1565 microversion: 2.25 time: 0.253428 Aug 04 16:57:53.372163 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 513/984] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:53 2022] GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 => generated 1565 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:57:53.372163 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-aa5b588b-1907-4537-b3c3-988cf59beea1 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:53.372163 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-aa5b588b-1907-4537-b3c3-988cf59beea1 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cf061e67-e261-41e2-a505-95e318126844] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:53.377485 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa5b588b-1907-4537-b3c3-988cf59beea1 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:53.378022 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa5b588b-1907-4537-b3c3-988cf59beea1 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:53.378495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa5b588b-1907-4537-b3c3-988cf59beea1 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:53.379214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa5b588b-1907-4537-b3c3-988cf59beea1 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:53.379683 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa5b588b-1907-4537-b3c3-988cf59beea1 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:53.380153 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa5b588b-1907-4537-b3c3-988cf59beea1 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:53.459194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-aa5b588b-1907-4537-b3c3-988cf59beea1 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ad6ccd2d804e158989a5f94c6f9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50604ce0bb604209a3c18932fdd193e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:53.467528 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-aa5b588b-1907-4537-b3c3-988cf59beea1 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844" status: 200 len: 1292 microversion: 2.1 time: 0.100975 Aug 04 16:57:53.468258 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 514/985] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:53 2022] GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844 => generated 1292 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:53.474312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-efcf67e9-8904-4bf8-8dee-78d23b4c8fc7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:53.474312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-efcf67e9-8904-4bf8-8dee-78d23b4c8fc7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:53.479986 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-efcf67e9-8904-4bf8-8dee-78d23b4c8fc7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:53.480537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-efcf67e9-8904-4bf8-8dee-78d23b4c8fc7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:53.481552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-efcf67e9-8904-4bf8-8dee-78d23b4c8fc7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:53.482385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-efcf67e9-8904-4bf8-8dee-78d23b4c8fc7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:53.482909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-efcf67e9-8904-4bf8-8dee-78d23b4c8fc7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:53.483339 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-efcf67e9-8904-4bf8-8dee-78d23b4c8fc7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:53.692605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-98e15f5d-d510-4f46-8aba-b5b4afe4e894 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:57:53.692991 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-98e15f5d-d510-4f46-8aba-b5b4afe4e894 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:57:53.693483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-98e15f5d-d510-4f46-8aba-b5b4afe4e894 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:57:53.693892 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-98e15f5d-d510-4f46-8aba-b5b4afe4e894 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:57:53.694789 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-98e15f5d-d510-4f46-8aba-b5b4afe4e894 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:57:53.714287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-efcf67e9-8904-4bf8-8dee-78d23b4c8fc7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:53.715159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98e15f5d-d510-4f46-8aba-b5b4afe4e894 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:53.717483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98e15f5d-d510-4f46-8aba-b5b4afe4e894 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:53.718266 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98e15f5d-d510-4f46-8aba-b5b4afe4e894 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:53.719690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98e15f5d-d510-4f46-8aba-b5b4afe4e894 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:53.720413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98e15f5d-d510-4f46-8aba-b5b4afe4e894 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:53.721073 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98e15f5d-d510-4f46-8aba-b5b4afe4e894 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:53.747849 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-efcf67e9-8904-4bf8-8dee-78d23b4c8fc7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1378 microversion: 2.1 time: 0.276451 Aug 04 16:57:53.752959 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 515/986] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:53 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1378 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:53.756496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-98e15f5d-d510-4f46-8aba-b5b4afe4e894 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Getting quotas for project 985c6a3e9f43418bb14d9d3fbf8df8d4. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:57:53.770241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-98e15f5d-d510-4f46-8aba-b5b4afe4e894 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Getting quotas for user f6232496fbe3458e8a3fde3fdabe9d05 and project 985c6a3e9f43418bb14d9d3fbf8df8d4. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:57:53.796723 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-98e15f5d-d510-4f46-8aba-b5b4afe4e894 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:57:53.806435 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-98e15f5d-d510-4f46-8aba-b5b4afe4e894 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 981a3990-e2d4-4af5-825f-6c611da343f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:57:53.861054 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-98e15f5d-d510-4f46-8aba-b5b4afe4e894 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.876194 Aug 04 16:57:53.867962 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 472/987] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:57:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:57:53.872890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9a59e140-d624-4f01-ac79-210c6937094a tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:53.873818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9a59e140-d624-4f01-ac79-210c6937094a tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 981a3990-e2d4-4af5-825f-6c611da343f9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:53.878323 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:53.973293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9a59e140-d624-4f01-ac79-210c6937094a tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:53.984352 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9a59e140-d624-4f01-ac79-210c6937094a tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9" status: 200 len: 1215 microversion: 2.1 time: 0.115603 Aug 04 16:57:53.986280 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 516/988] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:53 2022] GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9 => generated 1215 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:54.097220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b3099ab2-2787-42b8-85ee-70d1cee996de tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:54.097970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b3099ab2-2787-42b8-85ee-70d1cee996de tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:54.106541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3099ab2-2787-42b8-85ee-70d1cee996de tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:54.107114 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3099ab2-2787-42b8-85ee-70d1cee996de tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:54.107477 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3099ab2-2787-42b8-85ee-70d1cee996de tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:54.108198 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3099ab2-2787-42b8-85ee-70d1cee996de tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:54.108658 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3099ab2-2787-42b8-85ee-70d1cee996de tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:54.109089 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3099ab2-2787-42b8-85ee-70d1cee996de tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:54.336098 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b3099ab2-2787-42b8-85ee-70d1cee996de tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:54.353965 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b3099ab2-2787-42b8-85ee-70d1cee996de tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1472 microversion: 2.1 time: 0.261522 Aug 04 16:57:54.354653 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 473/989] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:54 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1472 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:54.389786 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a2c2e75b-89a8-4304-b27a-869e31fb0070 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:54.391014 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a2c2e75b-89a8-4304-b27a-869e31fb0070 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:54.398229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a2c2e75b-89a8-4304-b27a-869e31fb0070 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:54.398726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a2c2e75b-89a8-4304-b27a-869e31fb0070 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:54.399238 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a2c2e75b-89a8-4304-b27a-869e31fb0070 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:54.399986 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a2c2e75b-89a8-4304-b27a-869e31fb0070 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:54.400431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a2c2e75b-89a8-4304-b27a-869e31fb0070 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:54.401059 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a2c2e75b-89a8-4304-b27a-869e31fb0070 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:54.488706 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-152e13a7-288d-48a0-b9a6-0753e162a4c2 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:54.489727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-152e13a7-288d-48a0-b9a6-0753e162a4c2 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cf061e67-e261-41e2-a505-95e318126844] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:54.505362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-152e13a7-288d-48a0-b9a6-0753e162a4c2 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:54.506503 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-152e13a7-288d-48a0-b9a6-0753e162a4c2 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:54.507661 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-152e13a7-288d-48a0-b9a6-0753e162a4c2 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:54.508838 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-152e13a7-288d-48a0-b9a6-0753e162a4c2 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:54.509891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-152e13a7-288d-48a0-b9a6-0753e162a4c2 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:54.510556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-152e13a7-288d-48a0-b9a6-0753e162a4c2 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:54.891040 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-152e13a7-288d-48a0-b9a6-0753e162a4c2 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ad6ccd2d804e158989a5f94c6f9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50604ce0bb604209a3c18932fdd193e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:54.901780 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-152e13a7-288d-48a0-b9a6-0753e162a4c2 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844" status: 200 len: 1298 microversion: 2.1 time: 0.416942 Aug 04 16:57:54.903523 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 474/990] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:54 2022] GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844 => generated 1298 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:54.908948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-99ed3240-117e-4138-be7f-f523f78f2f84 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:54.909821 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-99ed3240-117e-4138-be7f-f523f78f2f84 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:54.916432 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99ed3240-117e-4138-be7f-f523f78f2f84 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:54.917160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99ed3240-117e-4138-be7f-f523f78f2f84 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:54.917668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99ed3240-117e-4138-be7f-f523f78f2f84 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:54.918540 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99ed3240-117e-4138-be7f-f523f78f2f84 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:54.919069 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99ed3240-117e-4138-be7f-f523f78f2f84 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:54.919575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99ed3240-117e-4138-be7f-f523f78f2f84 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:55.043661 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a2c2e75b-89a8-4304-b27a-869e31fb0070 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:55.054771 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a2c2e75b-89a8-4304-b27a-869e31fb0070 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:55.057275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a2c2e75b-89a8-4304-b27a-869e31fb0070 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:55.058714 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a2c2e75b-89a8-4304-b27a-869e31fb0070 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3" status: 200 len: 1565 microversion: 2.25 time: 0.675127 Aug 04 16:57:55.068433 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 517/991] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:54 2022] GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 => generated 1565 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:55.082679 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8fc040b1-0764-4ee8-a4cd-8fe289a39cb0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:55.083560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8fc040b1-0764-4ee8-a4cd-8fe289a39cb0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 981a3990-e2d4-4af5-825f-6c611da343f9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:55.090225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fc040b1-0764-4ee8-a4cd-8fe289a39cb0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:55.091684 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fc040b1-0764-4ee8-a4cd-8fe289a39cb0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:55.092143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fc040b1-0764-4ee8-a4cd-8fe289a39cb0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:55.092863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fc040b1-0764-4ee8-a4cd-8fe289a39cb0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:55.093330 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fc040b1-0764-4ee8-a4cd-8fe289a39cb0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:55.093769 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fc040b1-0764-4ee8-a4cd-8fe289a39cb0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:55.187930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-99ed3240-117e-4138-be7f-f523f78f2f84 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:55.190403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8fc040b1-0764-4ee8-a4cd-8fe289a39cb0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:55.200355 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-99ed3240-117e-4138-be7f-f523f78f2f84 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1378 microversion: 2.1 time: 0.294796 Aug 04 16:57:55.202491 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8fc040b1-0764-4ee8-a4cd-8fe289a39cb0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9" status: 200 len: 1267 microversion: 2.1 time: 0.132578 Aug 04 16:57:55.203921 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 475/992] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:54 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1378 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:55.210959 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 518/993] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:55 2022] GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9 => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:55.376751 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6ce4221e-1a54-48a7-a7b1-fc4849618643 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:55.377922 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6ce4221e-1a54-48a7-a7b1-fc4849618643 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:55.388817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ce4221e-1a54-48a7-a7b1-fc4849618643 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:55.389941 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ce4221e-1a54-48a7-a7b1-fc4849618643 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:55.390423 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ce4221e-1a54-48a7-a7b1-fc4849618643 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:55.391954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ce4221e-1a54-48a7-a7b1-fc4849618643 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:55.392632 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ce4221e-1a54-48a7-a7b1-fc4849618643 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:55.393484 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ce4221e-1a54-48a7-a7b1-fc4849618643 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:55.762354 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6ce4221e-1a54-48a7-a7b1-fc4849618643 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:55.777109 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6ce4221e-1a54-48a7-a7b1-fc4849618643 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1472 microversion: 2.1 time: 0.405185 Aug 04 16:57:55.779019 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 476/994] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:55 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1472 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:55.927518 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cd7e285d-9875-4a13-9ebb-f788325b5d75 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:55.929260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cd7e285d-9875-4a13-9ebb-f788325b5d75 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cf061e67-e261-41e2-a505-95e318126844] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:55.939878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd7e285d-9875-4a13-9ebb-f788325b5d75 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:55.942157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd7e285d-9875-4a13-9ebb-f788325b5d75 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:55.943012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd7e285d-9875-4a13-9ebb-f788325b5d75 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:55.943971 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd7e285d-9875-4a13-9ebb-f788325b5d75 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:55.944665 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd7e285d-9875-4a13-9ebb-f788325b5d75 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:55.945277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd7e285d-9875-4a13-9ebb-f788325b5d75 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:56.085548 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2ea435bc-cb8e-4cd2-86b7-4541712d198b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:56.087843 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2ea435bc-cb8e-4cd2-86b7-4541712d198b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:56.101826 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ea435bc-cb8e-4cd2-86b7-4541712d198b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:56.103517 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ea435bc-cb8e-4cd2-86b7-4541712d198b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:56.104237 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ea435bc-cb8e-4cd2-86b7-4541712d198b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:56.106817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ea435bc-cb8e-4cd2-86b7-4541712d198b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:56.107688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ea435bc-cb8e-4cd2-86b7-4541712d198b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:56.109954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ea435bc-cb8e-4cd2-86b7-4541712d198b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:56.138636 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cd7e285d-9875-4a13-9ebb-f788325b5d75 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ad6ccd2d804e158989a5f94c6f9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50604ce0bb604209a3c18932fdd193e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:56.150288 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cd7e285d-9875-4a13-9ebb-f788325b5d75 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844" status: 200 len: 1366 microversion: 2.1 time: 0.229031 Aug 04 16:57:56.150882 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 519/995] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:55 2022] GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:56.226414 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dab1b83b-4374-4bdf-a414-a792eccb4fe4 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:56.227427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dab1b83b-4374-4bdf-a414-a792eccb4fe4 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:56.235241 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dab1b83b-4374-4bdf-a414-a792eccb4fe4 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:56.236301 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dab1b83b-4374-4bdf-a414-a792eccb4fe4 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:56.236968 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dab1b83b-4374-4bdf-a414-a792eccb4fe4 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:56.238755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dab1b83b-4374-4bdf-a414-a792eccb4fe4 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:56.239470 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dab1b83b-4374-4bdf-a414-a792eccb4fe4 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:56.240694 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dab1b83b-4374-4bdf-a414-a792eccb4fe4 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:56.508340 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2ea435bc-cb8e-4cd2-86b7-4541712d198b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:56.523039 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2ea435bc-cb8e-4cd2-86b7-4541712d198b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:56.525414 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2ea435bc-cb8e-4cd2-86b7-4541712d198b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:56.526667 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2ea435bc-cb8e-4cd2-86b7-4541712d198b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3" status: 200 len: 1565 microversion: 2.25 time: 0.448344 Aug 04 16:57:56.535657 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 477/996] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:56 2022] GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 => generated 1565 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:56.539449 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9ab67986-846f-40a7-8ce4-a576b547d964 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:56.540078 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9ab67986-846f-40a7-8ce4-a576b547d964 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 981a3990-e2d4-4af5-825f-6c611da343f9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:56.552067 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:56.561382 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ab67986-846f-40a7-8ce4-a576b547d964 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:56.561878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ab67986-846f-40a7-8ce4-a576b547d964 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:56.562519 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ab67986-846f-40a7-8ce4-a576b547d964 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:56.563250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ab67986-846f-40a7-8ce4-a576b547d964 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:56.563712 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ab67986-846f-40a7-8ce4-a576b547d964 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:56.564143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ab67986-846f-40a7-8ce4-a576b547d964 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:56.618209 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:56.778923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9ab67986-846f-40a7-8ce4-a576b547d964 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:56.796772 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9ab67986-846f-40a7-8ce4-a576b547d964 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9" status: 200 len: 1273 microversion: 2.1 time: 0.266546 Aug 04 16:57:56.804046 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 478/997] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:56 2022] GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9 => generated 1273 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:56.818077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c2820912-6cfa-41a1-9796-d358f17d5b54 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:56.819096 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c2820912-6cfa-41a1-9796-d358f17d5b54 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:56.829480 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2820912-6cfa-41a1-9796-d358f17d5b54 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:56.830273 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2820912-6cfa-41a1-9796-d358f17d5b54 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:56.830898 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2820912-6cfa-41a1-9796-d358f17d5b54 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:56.831037 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dab1b83b-4374-4bdf-a414-a792eccb4fe4 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:56.832091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2820912-6cfa-41a1-9796-d358f17d5b54 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:56.832719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2820912-6cfa-41a1-9796-d358f17d5b54 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:56.833785 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2820912-6cfa-41a1-9796-d358f17d5b54 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:56.838745 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dab1b83b-4374-4bdf-a414-a792eccb4fe4 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1378 microversion: 2.1 time: 0.617948 Aug 04 16:57:56.856863 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 520/998] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:56 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1378 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:57.173708 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2a9f20dc-5b2f-45c2-80b9-2beded161bd3 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:57.174460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2a9f20dc-5b2f-45c2-80b9-2beded161bd3 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cf061e67-e261-41e2-a505-95e318126844] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:57.184650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2a9f20dc-5b2f-45c2-80b9-2beded161bd3 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:57.185161 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2a9f20dc-5b2f-45c2-80b9-2beded161bd3 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:57.185603 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2a9f20dc-5b2f-45c2-80b9-2beded161bd3 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:57.186355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2a9f20dc-5b2f-45c2-80b9-2beded161bd3 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:57.186817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2a9f20dc-5b2f-45c2-80b9-2beded161bd3 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:57.187241 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2a9f20dc-5b2f-45c2-80b9-2beded161bd3 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:57.202009 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c2820912-6cfa-41a1-9796-d358f17d5b54 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:57.215065 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c2820912-6cfa-41a1-9796-d358f17d5b54 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1472 microversion: 2.1 time: 0.408013 Aug 04 16:57:57.216296 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 479/999] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:56 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1472 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:57.303628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-99723e26-2787-4283-9b81-28e438563fa8 req-1633e155-c4be-4b32-a915-9a620a8f7326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf061e67-e261-41e2-a505-95e318126844", "tag": "599dbaa7-2ff0-476e-83c1-e0770a3b8f46"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:57.314759 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-99723e26-2787-4283-9b81-28e438563fa8 req-1633e155-c4be-4b32-a915-9a620a8f7326 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:57.315788 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-99723e26-2787-4283-9b81-28e438563fa8 req-1633e155-c4be-4b32-a915-9a620a8f7326 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:57.316438 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-99723e26-2787-4283-9b81-28e438563fa8 req-1633e155-c4be-4b32-a915-9a620a8f7326 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:57.332469 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-99723e26-2787-4283-9b81-28e438563fa8 req-1633e155-c4be-4b32-a915-9a620a8f7326 service nova] Creating event network-changed:599dbaa7-2ff0-476e-83c1-e0770a3b8f46 for instance cf061e67-e261-41e2-a505-95e318126844 on n-h1-851359-3 Aug 04 16:57:57.339321 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-99723e26-2787-4283-9b81-28e438563fa8 req-1633e155-c4be-4b32-a915-9a620a8f7326 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039233 Aug 04 16:57:57.341266 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 480/1000] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:57:57.553568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d73b3495-c989-40c2-8ede-0d1df2d40ceb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:57.554637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d73b3495-c989-40c2-8ede-0d1df2d40ceb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:57.563686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d73b3495-c989-40c2-8ede-0d1df2d40ceb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:57.575692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d73b3495-c989-40c2-8ede-0d1df2d40ceb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:57.576346 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d73b3495-c989-40c2-8ede-0d1df2d40ceb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:57.577256 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d73b3495-c989-40c2-8ede-0d1df2d40ceb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:57.577892 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d73b3495-c989-40c2-8ede-0d1df2d40ceb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:57.579163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d73b3495-c989-40c2-8ede-0d1df2d40ceb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:57.685133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2a9f20dc-5b2f-45c2-80b9-2beded161bd3 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ad6ccd2d804e158989a5f94c6f9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50604ce0bb604209a3c18932fdd193e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:57.703844 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2a9f20dc-5b2f-45c2-80b9-2beded161bd3 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844" status: 200 len: 1366 microversion: 2.1 time: 0.533820 Aug 04 16:57:57.709086 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 521/1001] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:57 2022] GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844 => generated 1366 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:57:57.825098 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-00cbbf02-e92c-4332-9f0b-97508df28a39 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:57.825774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-00cbbf02-e92c-4332-9f0b-97508df28a39 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 981a3990-e2d4-4af5-825f-6c611da343f9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:57.848491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00cbbf02-e92c-4332-9f0b-97508df28a39 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:57.849306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00cbbf02-e92c-4332-9f0b-97508df28a39 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:57.849913 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00cbbf02-e92c-4332-9f0b-97508df28a39 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:57.850854 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00cbbf02-e92c-4332-9f0b-97508df28a39 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:57.851473 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00cbbf02-e92c-4332-9f0b-97508df28a39 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:57.852067 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00cbbf02-e92c-4332-9f0b-97508df28a39 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:58.181323 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d73b3495-c989-40c2-8ede-0d1df2d40ceb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:58.196536 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d73b3495-c989-40c2-8ede-0d1df2d40ceb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:58.198249 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d73b3495-c989-40c2-8ede-0d1df2d40ceb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:58.202262 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d73b3495-c989-40c2-8ede-0d1df2d40ceb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3" status: 200 len: 1565 microversion: 2.25 time: 0.650469 Aug 04 16:57:58.203245 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 481/1002] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:57 2022] GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 => generated 1565 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:57:58.210314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6a288bef-ffd8-4b65-b57f-2594afbe6048 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:58.211492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6a288bef-ffd8-4b65-b57f-2594afbe6048 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:58.227425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a288bef-ffd8-4b65-b57f-2594afbe6048 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:58.228339 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a288bef-ffd8-4b65-b57f-2594afbe6048 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:58.228995 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a288bef-ffd8-4b65-b57f-2594afbe6048 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:58.232074 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a288bef-ffd8-4b65-b57f-2594afbe6048 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:58.232561 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a288bef-ffd8-4b65-b57f-2594afbe6048 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:58.233006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a288bef-ffd8-4b65-b57f-2594afbe6048 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:58.255000 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-00cbbf02-e92c-4332-9f0b-97508df28a39 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:58.270349 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-00cbbf02-e92c-4332-9f0b-97508df28a39 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9" status: 200 len: 1315 microversion: 2.1 time: 0.455166 Aug 04 16:57:58.271279 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 522/1003] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:57 2022] GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9 => generated 1315 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:58.283574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-89cd551b-e24d-48ad-8bef-c5cbeb794af3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:58.284474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-89cd551b-e24d-48ad-8bef-c5cbeb794af3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:58.300278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89cd551b-e24d-48ad-8bef-c5cbeb794af3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:58.300787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89cd551b-e24d-48ad-8bef-c5cbeb794af3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:58.301230 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89cd551b-e24d-48ad-8bef-c5cbeb794af3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:58.302185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89cd551b-e24d-48ad-8bef-c5cbeb794af3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:58.302809 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89cd551b-e24d-48ad-8bef-c5cbeb794af3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:58.303249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89cd551b-e24d-48ad-8bef-c5cbeb794af3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:58.707381 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6a288bef-ffd8-4b65-b57f-2594afbe6048 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:58.723378 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6a288bef-ffd8-4b65-b57f-2594afbe6048 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1378 microversion: 2.1 time: 0.518768 Aug 04 16:57:58.726362 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 482/1004] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:58 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1378 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:58.733141 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2fdbc37d-ef80-491a-a24d-6ffb7deebfdd tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:58.735967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2fdbc37d-ef80-491a-a24d-6ffb7deebfdd tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cf061e67-e261-41e2-a505-95e318126844] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:58.751022 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fdbc37d-ef80-491a-a24d-6ffb7deebfdd tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:58.757284 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fdbc37d-ef80-491a-a24d-6ffb7deebfdd tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:58.759067 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fdbc37d-ef80-491a-a24d-6ffb7deebfdd tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:58.762811 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fdbc37d-ef80-491a-a24d-6ffb7deebfdd tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:58.763752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fdbc37d-ef80-491a-a24d-6ffb7deebfdd tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:58.769386 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fdbc37d-ef80-491a-a24d-6ffb7deebfdd tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:58.778597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-89cd551b-e24d-48ad-8bef-c5cbeb794af3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:58.786296 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-89cd551b-e24d-48ad-8bef-c5cbeb794af3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1472 microversion: 2.1 time: 0.513625 Aug 04 16:57:58.786881 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 523/1005] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:58 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1472 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:59.147315 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-d6e43f77-122f-4487-91eb-48c90d067b35 req-ef0311f8-2a41-4f81-ab5a-9b7c9dc5ba9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1250487f-b35f-4803-b7b3-a9a80850fa12", "name": "network-vif-plugged", "status": "completed", "tag": "167d17c7-b0d3-40d2-8410-10740bd6347f"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:59.170024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d6e43f77-122f-4487-91eb-48c90d067b35 req-ef0311f8-2a41-4f81-ab5a-9b7c9dc5ba9d service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:59.170911 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d6e43f77-122f-4487-91eb-48c90d067b35 req-ef0311f8-2a41-4f81-ab5a-9b7c9dc5ba9d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:59.171413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d6e43f77-122f-4487-91eb-48c90d067b35 req-ef0311f8-2a41-4f81-ab5a-9b7c9dc5ba9d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:59.187730 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-d6e43f77-122f-4487-91eb-48c90d067b35 req-ef0311f8-2a41-4f81-ab5a-9b7c9dc5ba9d service nova] Creating event network-vif-plugged:167d17c7-b0d3-40d2-8410-10740bd6347f for instance 1250487f-b35f-4803-b7b3-a9a80850fa12 on n-h2-851359-3 Aug 04 16:57:59.198446 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-d6e43f77-122f-4487-91eb-48c90d067b35 req-ef0311f8-2a41-4f81-ab5a-9b7c9dc5ba9d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056073 Aug 04 16:57:59.201108 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 524/1006] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:57:59.237124 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-42db6ee9-2f35-4705-bf91-f39fd95936a4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:59.238455 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-42db6ee9-2f35-4705-bf91-f39fd95936a4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:59.254717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42db6ee9-2f35-4705-bf91-f39fd95936a4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:59.255229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42db6ee9-2f35-4705-bf91-f39fd95936a4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:59.255768 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42db6ee9-2f35-4705-bf91-f39fd95936a4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:59.258780 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42db6ee9-2f35-4705-bf91-f39fd95936a4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:59.259276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42db6ee9-2f35-4705-bf91-f39fd95936a4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:59.259727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42db6ee9-2f35-4705-bf91-f39fd95936a4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:59.305508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:57:59.526907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2fdbc37d-ef80-491a-a24d-6ffb7deebfdd tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ad6ccd2d804e158989a5f94c6f9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50604ce0bb604209a3c18932fdd193e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:59.537704 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2fdbc37d-ef80-491a-a24d-6ffb7deebfdd tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844" status: 200 len: 1366 microversion: 2.1 time: 0.809080 Aug 04 16:57:59.539069 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 483/1007] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:58 2022] GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844 => generated 1366 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:59.544335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d037b482-e22a-4c89-b7f6-e2830948d5a2 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:59.545070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d037b482-e22a-4c89-b7f6-e2830948d5a2 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 981a3990-e2d4-4af5-825f-6c611da343f9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:59.551564 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d037b482-e22a-4c89-b7f6-e2830948d5a2 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:59.552147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d037b482-e22a-4c89-b7f6-e2830948d5a2 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:59.552952 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d037b482-e22a-4c89-b7f6-e2830948d5a2 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:59.554266 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d037b482-e22a-4c89-b7f6-e2830948d5a2 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:59.554977 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d037b482-e22a-4c89-b7f6-e2830948d5a2 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:59.555625 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d037b482-e22a-4c89-b7f6-e2830948d5a2 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:59.803903 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-42db6ee9-2f35-4705-bf91-f39fd95936a4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:59.813532 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-42db6ee9-2f35-4705-bf91-f39fd95936a4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:59.815862 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-42db6ee9-2f35-4705-bf91-f39fd95936a4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:59.817188 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-42db6ee9-2f35-4705-bf91-f39fd95936a4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3" status: 200 len: 1555 microversion: 2.25 time: 0.589220 Aug 04 16:57:59.830001 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 525/1008] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:57:59 2022] GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 => generated 1555 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:57:59.834732 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-3b1cef24-95fa-4c30-b0ea-0af206c0d7e0 req-83c0a888-0b32-46c9-be59-c7e11cbb28df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "981a3990-e2d4-4af5-825f-6c611da343f9", "tag": "4478077f-55a2-4682-b8d6-9d7cfdce84a7"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:57:59.845623 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-3b1cef24-95fa-4c30-b0ea-0af206c0d7e0 req-83c0a888-0b32-46c9-be59-c7e11cbb28df service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:59.846426 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-3b1cef24-95fa-4c30-b0ea-0af206c0d7e0 req-83c0a888-0b32-46c9-be59-c7e11cbb28df service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:59.847059 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-3b1cef24-95fa-4c30-b0ea-0af206c0d7e0 req-83c0a888-0b32-46c9-be59-c7e11cbb28df service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:59.860326 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-3b1cef24-95fa-4c30-b0ea-0af206c0d7e0 req-83c0a888-0b32-46c9-be59-c7e11cbb28df service nova] Creating event network-changed:4478077f-55a2-4682-b8d6-9d7cfdce84a7 for instance 981a3990-e2d4-4af5-825f-6c611da343f9 on n-h2-851359-3 Aug 04 16:57:59.865489 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-3b1cef24-95fa-4c30-b0ea-0af206c0d7e0 req-83c0a888-0b32-46c9-be59-c7e11cbb28df service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046440 Aug 04 16:57:59.866329 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 526/1009] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:57:59.872742 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-118ddf4a-fd4c-4159-851c-433626aafae0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:59.873456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-118ddf4a-fd4c-4159-851c-433626aafae0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:59.880593 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d037b482-e22a-4c89-b7f6-e2830948d5a2 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:57:59.880751 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-118ddf4a-fd4c-4159-851c-433626aafae0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:59.881235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-118ddf4a-fd4c-4159-851c-433626aafae0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:59.881685 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-118ddf4a-fd4c-4159-851c-433626aafae0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:59.882427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-118ddf4a-fd4c-4159-851c-433626aafae0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:59.882893 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-118ddf4a-fd4c-4159-851c-433626aafae0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:59.883325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-118ddf4a-fd4c-4159-851c-433626aafae0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:59.895932 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d037b482-e22a-4c89-b7f6-e2830948d5a2 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9" status: 200 len: 1315 microversion: 2.1 time: 0.355339 Aug 04 16:57:59.897904 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 484/1010] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:59 2022] GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9 => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:57:59.913556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f398b7f2-4a93-4218-9547-58e02c50e50f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:57:59.914407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f398b7f2-4a93-4218-9547-58e02c50e50f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:57:59.920748 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f398b7f2-4a93-4218-9547-58e02c50e50f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:59.921502 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f398b7f2-4a93-4218-9547-58e02c50e50f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:59.922288 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f398b7f2-4a93-4218-9547-58e02c50e50f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:57:59.923509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f398b7f2-4a93-4218-9547-58e02c50e50f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:57:59.924277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f398b7f2-4a93-4218-9547-58e02c50e50f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:57:59.924870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f398b7f2-4a93-4218-9547-58e02c50e50f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:00.220294 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-118ddf4a-fd4c-4159-851c-433626aafae0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:00.227734 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-118ddf4a-fd4c-4159-851c-433626aafae0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1378 microversion: 2.1 time: 0.359910 Aug 04 16:58:00.228310 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 527/1011] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:59 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1378 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:00.232668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-284b079b-c518-4aee-8efa-5b7ea2e7a109 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Calling method '.version_select at 0x7f1e5be6a700>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:00.237326 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-284b079b-c518-4aee-8efa-5b7ea2e7a109 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:00.237820 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-284b079b-c518-4aee-8efa-5b7ea2e7a109 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:00.238380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-284b079b-c518-4aee-8efa-5b7ea2e7a109 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:00.248193 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-284b079b-c518-4aee-8efa-5b7ea2e7a109 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] 10.222.0.93 "GET /compute/v2.1/os-migrations" status: 200 len: 2365 microversion: 2.25 time: 0.018872 Aug 04 16:58:00.248849 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 528/1012] 10.222.0.93 () {60 vars in 1184 bytes} [Thu Aug 4 16:58:00 2022] GET /compute/v2.1/os-migrations => generated 2365 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:00.255710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f398b7f2-4a93-4218-9547-58e02c50e50f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:00.264082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8de7b873-f04d-42d6-a141-bb10d1f55388 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:00.264737 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8de7b873-f04d-42d6-a141-bb10d1f55388 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:00.265231 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f398b7f2-4a93-4218-9547-58e02c50e50f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1472 microversion: 2.1 time: 0.365779 Aug 04 16:58:00.265881 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 485/1013] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:57:59 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1472 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:00.271614 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8de7b873-f04d-42d6-a141-bb10d1f55388 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:00.272112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8de7b873-f04d-42d6-a141-bb10d1f55388 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:00.272550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8de7b873-f04d-42d6-a141-bb10d1f55388 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:00.273270 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8de7b873-f04d-42d6-a141-bb10d1f55388 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:00.273736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8de7b873-f04d-42d6-a141-bb10d1f55388 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:00.274783 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8de7b873-f04d-42d6-a141-bb10d1f55388 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:00.494303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-8de7b873-f04d-42d6-a141-bb10d1f55388 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lazy-loading 'services' on Instance uuid 98e4458d-d7e4-4663-a974-70ccbe5501f3 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:58:00.510904 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8de7b873-f04d-42d6-a141-bb10d1f55388 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3" status: 200 len: 2047 microversion: 2.25 time: 0.251461 Aug 04 16:58:00.512354 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 529/1014] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:00 2022] GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 => generated 2047 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:58:00.562370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e11da267-d063-466f-9d35-f9d6ffb26335 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:00.563088 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e11da267-d063-466f-9d35-f9d6ffb26335 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cf061e67-e261-41e2-a505-95e318126844] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:00.574314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e11da267-d063-466f-9d35-f9d6ffb26335 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:00.576263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e11da267-d063-466f-9d35-f9d6ffb26335 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:00.576805 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e11da267-d063-466f-9d35-f9d6ffb26335 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:00.579211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e11da267-d063-466f-9d35-f9d6ffb26335 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:00.580952 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e11da267-d063-466f-9d35-f9d6ffb26335 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:00.581502 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e11da267-d063-466f-9d35-f9d6ffb26335 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:00.704158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c4d030b5-8735-4243-9271-f9ab48e55f1e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1902396882", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "93c63081-713e-4b1c-8711-321b0490bce1"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:00.769556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e11da267-d063-466f-9d35-f9d6ffb26335 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ad6ccd2d804e158989a5f94c6f9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50604ce0bb604209a3c18932fdd193e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:00.771636 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-c4d030b5-8735-4243-9271-f9ab48e55f1e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] validate_networks() for [('93c63081-713e-4b1c-8711-321b0490bce1', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:58:00.778982 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e11da267-d063-466f-9d35-f9d6ffb26335 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844" status: 200 len: 1366 microversion: 2.1 time: 0.223456 Aug 04 16:58:00.780356 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 486/1015] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:00 2022] GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:00.917325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d0e80ed4-0999-4a49-b678-094c4a716a6a tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:00.918621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d0e80ed4-0999-4a49-b678-094c4a716a6a tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 981a3990-e2d4-4af5-825f-6c611da343f9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:00.925490 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0e80ed4-0999-4a49-b678-094c4a716a6a tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:00.926352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0e80ed4-0999-4a49-b678-094c4a716a6a tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:00.927585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0e80ed4-0999-4a49-b678-094c4a716a6a tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:00.928690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0e80ed4-0999-4a49-b678-094c4a716a6a tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:00.929380 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0e80ed4-0999-4a49-b678-094c4a716a6a tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:00.930551 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0e80ed4-0999-4a49-b678-094c4a716a6a tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:01.185101 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d0e80ed4-0999-4a49-b678-094c4a716a6a tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:01.194467 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d0e80ed4-0999-4a49-b678-094c4a716a6a tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9" status: 200 len: 1315 microversion: 2.1 time: 0.281361 Aug 04 16:58:01.208712 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 487/1016] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:00 2022] GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:58:01.249078 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4b97bbf6-ae29-4d21-a49a-76e5bcb1095c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:01.250048 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4b97bbf6-ae29-4d21-a49a-76e5bcb1095c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:01.256609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b97bbf6-ae29-4d21-a49a-76e5bcb1095c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:01.257336 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b97bbf6-ae29-4d21-a49a-76e5bcb1095c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:01.257959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b97bbf6-ae29-4d21-a49a-76e5bcb1095c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:01.258969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b97bbf6-ae29-4d21-a49a-76e5bcb1095c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:01.259606 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b97bbf6-ae29-4d21-a49a-76e5bcb1095c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:01.260198 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b97bbf6-ae29-4d21-a49a-76e5bcb1095c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:01.360226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-c4d030b5-8735-4243-9271-f9ab48e55f1e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:58:01.362736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-c4d030b5-8735-4243-9271-f9ab48e55f1e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:58:01.363498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-c4d030b5-8735-4243-9271-f9ab48e55f1e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:58:01.364229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-c4d030b5-8735-4243-9271-f9ab48e55f1e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:58:01.364792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-c4d030b5-8735-4243-9271-f9ab48e55f1e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:58:01.383495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4d030b5-8735-4243-9271-f9ab48e55f1e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:01.384019 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4d030b5-8735-4243-9271-f9ab48e55f1e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:01.384568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4d030b5-8735-4243-9271-f9ab48e55f1e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:01.385189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4d030b5-8735-4243-9271-f9ab48e55f1e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:01.386551 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4d030b5-8735-4243-9271-f9ab48e55f1e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:01.387283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4d030b5-8735-4243-9271-f9ab48e55f1e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:01.421543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-c4d030b5-8735-4243-9271-f9ab48e55f1e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Getting quotas for project e457894e070145348859f44a6a3e8ed6. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:58:01.430742 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-c4d030b5-8735-4243-9271-f9ab48e55f1e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Getting quotas for user d0e0f6e799384863af2222416f070c84 and project e457894e070145348859f44a6a3e8ed6. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:58:01.446396 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c4d030b5-8735-4243-9271-f9ab48e55f1e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:58:01.449080 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c4d030b5-8735-4243-9271-f9ab48e55f1e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:58:01.462441 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4b97bbf6-ae29-4d21-a49a-76e5bcb1095c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:01.471843 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4b97bbf6-ae29-4d21-a49a-76e5bcb1095c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1378 microversion: 2.1 time: 0.226876 Aug 04 16:58:01.472436 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 488/1017] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:01 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1378 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:58:01.495934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f67d89c6-f2ef-4b54-8445-ebd87b69100f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:01.496619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f67d89c6-f2ef-4b54-8445-ebd87b69100f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:01.503120 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f67d89c6-f2ef-4b54-8445-ebd87b69100f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:01.503627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f67d89c6-f2ef-4b54-8445-ebd87b69100f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:01.504610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f67d89c6-f2ef-4b54-8445-ebd87b69100f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:01.504781 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f67d89c6-f2ef-4b54-8445-ebd87b69100f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:01.505245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f67d89c6-f2ef-4b54-8445-ebd87b69100f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:01.505679 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f67d89c6-f2ef-4b54-8445-ebd87b69100f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:01.526650 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c4d030b5-8735-4243-9271-f9ab48e55f1e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.825416 Aug 04 16:58:01.527277 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 530/1018] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Aug 4 16:58:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 16:58:01.556364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-968e1dbf-a6df-419d-9c17-c528ff3cc9a8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:01.559829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-968e1dbf-a6df-419d-9c17-c528ff3cc9a8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:01.728407 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-968e1dbf-a6df-419d-9c17-c528ff3cc9a8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:01.735956 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-968e1dbf-a6df-419d-9c17-c528ff3cc9a8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:01.737590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-968e1dbf-a6df-419d-9c17-c528ff3cc9a8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:01.742866 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-968e1dbf-a6df-419d-9c17-c528ff3cc9a8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 200 len: 1262 microversion: 2.25 time: 0.203799 Aug 04 16:58:01.743479 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 531/1019] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:01 2022] GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 1262 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:01.801227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9382f6ae-979d-4bcc-b7f3-387453719b72 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:01.801848 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9382f6ae-979d-4bcc-b7f3-387453719b72 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cf061e67-e261-41e2-a505-95e318126844] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:01.813430 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f67d89c6-f2ef-4b54-8445-ebd87b69100f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:01.815113 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9382f6ae-979d-4bcc-b7f3-387453719b72 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:01.815875 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9382f6ae-979d-4bcc-b7f3-387453719b72 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:01.819806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9382f6ae-979d-4bcc-b7f3-387453719b72 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:01.820640 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9382f6ae-979d-4bcc-b7f3-387453719b72 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:01.821126 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9382f6ae-979d-4bcc-b7f3-387453719b72 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:01.821569 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9382f6ae-979d-4bcc-b7f3-387453719b72 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:01.836279 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f67d89c6-f2ef-4b54-8445-ebd87b69100f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1472 microversion: 2.1 time: 0.344434 Aug 04 16:58:01.837733 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 489/1020] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:01 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1472 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:02.065848 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9382f6ae-979d-4bcc-b7f3-387453719b72 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ad6ccd2d804e158989a5f94c6f9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50604ce0bb604209a3c18932fdd193e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:02.076835 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9382f6ae-979d-4bcc-b7f3-387453719b72 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844" status: 200 len: 1366 microversion: 2.1 time: 0.280691 Aug 04 16:58:02.077538 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 532/1021] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:01 2022] GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844 => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:58:02.216479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d009ff43-dc8a-4f07-85b8-6e93c4a756ff tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:02.217096 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d009ff43-dc8a-4f07-85b8-6e93c4a756ff tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 981a3990-e2d4-4af5-825f-6c611da343f9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:02.228844 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d009ff43-dc8a-4f07-85b8-6e93c4a756ff tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:02.228844 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d009ff43-dc8a-4f07-85b8-6e93c4a756ff tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:02.229177 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d009ff43-dc8a-4f07-85b8-6e93c4a756ff tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:02.230115 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d009ff43-dc8a-4f07-85b8-6e93c4a756ff tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:02.231033 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d009ff43-dc8a-4f07-85b8-6e93c4a756ff tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:02.237459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d009ff43-dc8a-4f07-85b8-6e93c4a756ff tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:02.428868 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d009ff43-dc8a-4f07-85b8-6e93c4a756ff tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:02.438065 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d009ff43-dc8a-4f07-85b8-6e93c4a756ff tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9" status: 200 len: 1315 microversion: 2.1 time: 0.225491 Aug 04 16:58:02.439197 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 490/1022] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:02 2022] GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:58:02.493587 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-70c9956b-35cd-40fd-945b-23c968a0d9c1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:02.494857 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-70c9956b-35cd-40fd-945b-23c968a0d9c1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:02.502255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70c9956b-35cd-40fd-945b-23c968a0d9c1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:02.502997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70c9956b-35cd-40fd-945b-23c968a0d9c1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:02.503505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70c9956b-35cd-40fd-945b-23c968a0d9c1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:02.504312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70c9956b-35cd-40fd-945b-23c968a0d9c1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:02.504846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70c9956b-35cd-40fd-945b-23c968a0d9c1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:02.505729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70c9956b-35cd-40fd-945b-23c968a0d9c1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:02.677942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-70c9956b-35cd-40fd-945b-23c968a0d9c1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:02.687106 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-70c9956b-35cd-40fd-945b-23c968a0d9c1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1378 microversion: 2.1 time: 0.198201 Aug 04 16:58:02.687687 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 533/1023] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:02 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1378 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:02.766158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d66fdea4-c6e5-4593-ac56-d1991cbb8fff tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:02.767036 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d66fdea4-c6e5-4593-ac56-d1991cbb8fff tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:02.780386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d66fdea4-c6e5-4593-ac56-d1991cbb8fff tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:02.780915 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d66fdea4-c6e5-4593-ac56-d1991cbb8fff tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:02.781355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d66fdea4-c6e5-4593-ac56-d1991cbb8fff tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:02.782132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d66fdea4-c6e5-4593-ac56-d1991cbb8fff tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:02.782610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d66fdea4-c6e5-4593-ac56-d1991cbb8fff tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:02.783029 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d66fdea4-c6e5-4593-ac56-d1991cbb8fff tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:02.833104 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3cac6ba2-4bdd-428b-a606-06bae92ae5c1 tempest-FloatingIPDetailsTestJSON-1468729100 tempest-FloatingIPDetailsTestJSON-1468729100-project] Action: 'create', calling method: .version_select at 0x7f1e5b54b820>, body: {"pool": null} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:02.890108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d66fdea4-c6e5-4593-ac56-d1991cbb8fff tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:02.899162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d66fdea4-c6e5-4593-ac56-d1991cbb8fff tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:02.900680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d66fdea4-c6e5-4593-ac56-d1991cbb8fff tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:02.902067 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d66fdea4-c6e5-4593-ac56-d1991cbb8fff tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 200 len: 1314 microversion: 2.25 time: 0.141229 Aug 04 16:58:02.902677 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 534/1024] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:02 2022] GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 1314 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:02.907761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e7e335ec-b26f-4cb1-93cb-69ae7c1e7885 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:02.909052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e7e335ec-b26f-4cb1-93cb-69ae7c1e7885 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:02.917446 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7e335ec-b26f-4cb1-93cb-69ae7c1e7885 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:02.918136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7e335ec-b26f-4cb1-93cb-69ae7c1e7885 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:02.918627 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7e335ec-b26f-4cb1-93cb-69ae7c1e7885 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:02.919556 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7e335ec-b26f-4cb1-93cb-69ae7c1e7885 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:02.920064 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7e335ec-b26f-4cb1-93cb-69ae7c1e7885 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:02.920502 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7e335ec-b26f-4cb1-93cb-69ae7c1e7885 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:03.213479 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e7e335ec-b26f-4cb1-93cb-69ae7c1e7885 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:03.233887 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e7e335ec-b26f-4cb1-93cb-69ae7c1e7885 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1472 microversion: 2.1 time: 0.329935 Aug 04 16:58:03.249321 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 535/1025] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:02 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1472 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:03.249321 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-52dd175c-05f6-4223-97a2-ce9b30c1b74d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:03.249321 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-52dd175c-05f6-4223-97a2-ce9b30c1b74d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cf061e67-e261-41e2-a505-95e318126844] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:03.260988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-52dd175c-05f6-4223-97a2-ce9b30c1b74d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:03.261503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-52dd175c-05f6-4223-97a2-ce9b30c1b74d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:03.262551 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-52dd175c-05f6-4223-97a2-ce9b30c1b74d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:03.263237 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-52dd175c-05f6-4223-97a2-ce9b30c1b74d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:03.263704 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-52dd175c-05f6-4223-97a2-ce9b30c1b74d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:03.264140 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-52dd175c-05f6-4223-97a2-ce9b30c1b74d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:03.547997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-52dd175c-05f6-4223-97a2-ce9b30c1b74d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ad6ccd2d804e158989a5f94c6f9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50604ce0bb604209a3c18932fdd193e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:03.558083 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-52dd175c-05f6-4223-97a2-ce9b30c1b74d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844" status: 200 len: 1366 microversion: 2.1 time: 0.319932 Aug 04 16:58:03.559907 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 536/1026] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:03 2022] GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844 => generated 1366 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:03.565598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dbc4c42a-4dbe-4700-9a08-e8797b9caf0b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:03.575500 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dbc4c42a-4dbe-4700-9a08-e8797b9caf0b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 981a3990-e2d4-4af5-825f-6c611da343f9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:03.582952 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dbc4c42a-4dbe-4700-9a08-e8797b9caf0b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:03.584063 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dbc4c42a-4dbe-4700-9a08-e8797b9caf0b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:03.584841 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dbc4c42a-4dbe-4700-9a08-e8797b9caf0b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:03.585999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dbc4c42a-4dbe-4700-9a08-e8797b9caf0b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:03.586738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dbc4c42a-4dbe-4700-9a08-e8797b9caf0b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:03.587670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dbc4c42a-4dbe-4700-9a08-e8797b9caf0b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:03.739661 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=16 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:03.788779 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=12 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:03.812516 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dbc4c42a-4dbe-4700-9a08-e8797b9caf0b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:03.826842 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dbc4c42a-4dbe-4700-9a08-e8797b9caf0b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9" status: 200 len: 1315 microversion: 2.1 time: 0.265229 Aug 04 16:58:03.837835 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 537/1027] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:03 2022] GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:03.838483 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-13607247-f4c3-4c62-a487-dd9ae518fc4b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:03.839118 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-13607247-f4c3-4c62-a487-dd9ae518fc4b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:03.847496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13607247-f4c3-4c62-a487-dd9ae518fc4b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:03.848003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13607247-f4c3-4c62-a487-dd9ae518fc4b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:03.848443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13607247-f4c3-4c62-a487-dd9ae518fc4b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:03.849176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13607247-f4c3-4c62-a487-dd9ae518fc4b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:03.849641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13607247-f4c3-4c62-a487-dd9ae518fc4b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:03.850100 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13607247-f4c3-4c62-a487-dd9ae518fc4b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:04.096854 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-13607247-f4c3-4c62-a487-dd9ae518fc4b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:04.116737 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-13607247-f4c3-4c62-a487-dd9ae518fc4b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1378 microversion: 2.1 time: 0.281658 Aug 04 16:58:04.130112 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 538/1028] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:03 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1378 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:04.150515 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4e347865-e3c4-46dc-b1b9-e6a7d6f52aff tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:04.155249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4e347865-e3c4-46dc-b1b9-e6a7d6f52aff tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:04.163215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e347865-e3c4-46dc-b1b9-e6a7d6f52aff tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:04.163724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e347865-e3c4-46dc-b1b9-e6a7d6f52aff tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:04.164314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e347865-e3c4-46dc-b1b9-e6a7d6f52aff tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:04.165054 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e347865-e3c4-46dc-b1b9-e6a7d6f52aff tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:04.165526 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e347865-e3c4-46dc-b1b9-e6a7d6f52aff tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:04.165965 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e347865-e3c4-46dc-b1b9-e6a7d6f52aff tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:04.430652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4e347865-e3c4-46dc-b1b9-e6a7d6f52aff tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:04.455247 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4e347865-e3c4-46dc-b1b9-e6a7d6f52aff tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:04.458235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4e347865-e3c4-46dc-b1b9-e6a7d6f52aff tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:04.459626 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4e347865-e3c4-46dc-b1b9-e6a7d6f52aff tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 200 len: 1362 microversion: 2.25 time: 0.322416 Aug 04 16:58:04.460570 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 539/1029] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:04 2022] GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 1362 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:04.468683 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-98258576-5236-4d99-8958-6f3cd48bfb0d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:04.469955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-98258576-5236-4d99-8958-6f3cd48bfb0d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:04.497547 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98258576-5236-4d99-8958-6f3cd48bfb0d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:04.498229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98258576-5236-4d99-8958-6f3cd48bfb0d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:04.498756 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98258576-5236-4d99-8958-6f3cd48bfb0d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:04.499537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98258576-5236-4d99-8958-6f3cd48bfb0d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:04.500200 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98258576-5236-4d99-8958-6f3cd48bfb0d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:04.514306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98258576-5236-4d99-8958-6f3cd48bfb0d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:05.016557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-98258576-5236-4d99-8958-6f3cd48bfb0d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:05.028280 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-98258576-5236-4d99-8958-6f3cd48bfb0d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1490 microversion: 2.1 time: 0.565642 Aug 04 16:58:05.043365 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 540/1030] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:04 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1490 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:05.048281 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-5b4f6f82-8658-4c0f-b890-b8c4ce48f774 req-161f6bd6-db9a-4e44-b0fd-e04644e89c31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf061e67-e261-41e2-a505-95e318126844", "name": "network-vif-plugged", "status": "completed", "tag": "599dbaa7-2ff0-476e-83c1-e0770a3b8f46"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:05.060917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-5b4f6f82-8658-4c0f-b890-b8c4ce48f774 req-161f6bd6-db9a-4e44-b0fd-e04644e89c31 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:05.061411 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-5b4f6f82-8658-4c0f-b890-b8c4ce48f774 req-161f6bd6-db9a-4e44-b0fd-e04644e89c31 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:05.061853 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-5b4f6f82-8658-4c0f-b890-b8c4ce48f774 req-161f6bd6-db9a-4e44-b0fd-e04644e89c31 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:05.095555 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-5b4f6f82-8658-4c0f-b890-b8c4ce48f774 req-161f6bd6-db9a-4e44-b0fd-e04644e89c31 service nova] Creating event network-vif-plugged:599dbaa7-2ff0-476e-83c1-e0770a3b8f46 for instance cf061e67-e261-41e2-a505-95e318126844 on n-h1-851359-3 Aug 04 16:58:05.103881 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-5b4f6f82-8658-4c0f-b890-b8c4ce48f774 req-161f6bd6-db9a-4e44-b0fd-e04644e89c31 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058989 Aug 04 16:58:05.104731 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 541/1031] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:05.110027 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b86a9e02-b962-48d8-b844-fe6b915cf273 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:05.116146 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b86a9e02-b962-48d8-b844-fe6b915cf273 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cf061e67-e261-41e2-a505-95e318126844] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:05.131758 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b86a9e02-b962-48d8-b844-fe6b915cf273 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:05.132632 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b86a9e02-b962-48d8-b844-fe6b915cf273 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:05.133277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b86a9e02-b962-48d8-b844-fe6b915cf273 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:05.137913 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b86a9e02-b962-48d8-b844-fe6b915cf273 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:05.138889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b86a9e02-b962-48d8-b844-fe6b915cf273 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:05.139636 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b86a9e02-b962-48d8-b844-fe6b915cf273 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:05.343230 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3cac6ba2-4bdd-428b-a606-06bae92ae5c1 tempest-FloatingIPDetailsTestJSON-1468729100 tempest-FloatingIPDetailsTestJSON-1468729100-project] 10.222.0.93 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.681130 Aug 04 16:58:05.345595 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 491/1032] 10.222.0.93 () {60 vars in 1170 bytes} [Thu Aug 4 16:58:02 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:05.355649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f2ec5f31-ef08-4913-9c4d-4e09c6280815 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:05.356706 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f2ec5f31-ef08-4913-9c4d-4e09c6280815 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 981a3990-e2d4-4af5-825f-6c611da343f9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:05.367260 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2ec5f31-ef08-4913-9c4d-4e09c6280815 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:05.368140 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2ec5f31-ef08-4913-9c4d-4e09c6280815 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:05.369140 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2ec5f31-ef08-4913-9c4d-4e09c6280815 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:05.370294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2ec5f31-ef08-4913-9c4d-4e09c6280815 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:05.371459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2ec5f31-ef08-4913-9c4d-4e09c6280815 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:05.372063 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2ec5f31-ef08-4913-9c4d-4e09c6280815 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:05.373062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b86a9e02-b962-48d8-b844-fe6b915cf273 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ad6ccd2d804e158989a5f94c6f9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50604ce0bb604209a3c18932fdd193e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:05.386340 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b86a9e02-b962-48d8-b844-fe6b915cf273 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844" status: 200 len: 1366 microversion: 2.1 time: 0.279504 Aug 04 16:58:05.392645 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 542/1033] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:05 2022] GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844 => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:05.399998 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6dd9ca85-3d30-42ee-82ae-80abe4c80e03 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:05.407106 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6dd9ca85-3d30-42ee-82ae-80abe4c80e03 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:05.426277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6dd9ca85-3d30-42ee-82ae-80abe4c80e03 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:05.427391 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6dd9ca85-3d30-42ee-82ae-80abe4c80e03 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:05.428024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6dd9ca85-3d30-42ee-82ae-80abe4c80e03 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:05.429438 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6dd9ca85-3d30-42ee-82ae-80abe4c80e03 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:05.430106 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6dd9ca85-3d30-42ee-82ae-80abe4c80e03 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:05.430726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6dd9ca85-3d30-42ee-82ae-80abe4c80e03 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:05.595589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f2ec5f31-ef08-4913-9c4d-4e09c6280815 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:05.616830 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f2ec5f31-ef08-4913-9c4d-4e09c6280815 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9" status: 200 len: 1315 microversion: 2.1 time: 0.268958 Aug 04 16:58:05.617737 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 492/1034] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:05 2022] GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:05.625406 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6093a229-c358-4eb7-8ec2-49c4a042e39d tempest-FloatingIPDetailsTestJSON-1468729100 tempest-FloatingIPDetailsTestJSON-1468729100-project] Action: 'create', calling method: .version_select at 0x7f1e5b50cc10>, body: {"pool": null} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:05.790943 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6dd9ca85-3d30-42ee-82ae-80abe4c80e03 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:05.809643 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6dd9ca85-3d30-42ee-82ae-80abe4c80e03 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1378 microversion: 2.1 time: 0.415426 Aug 04 16:58:05.826472 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 543/1035] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:05 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1378 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:05.844072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7c83fe86-c09e-4a27-a6ce-a672abcd21e3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:05.844716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7c83fe86-c09e-4a27-a6ce-a672abcd21e3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:05.853065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c83fe86-c09e-4a27-a6ce-a672abcd21e3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:05.853819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c83fe86-c09e-4a27-a6ce-a672abcd21e3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:05.854323 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c83fe86-c09e-4a27-a6ce-a672abcd21e3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:05.856045 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c83fe86-c09e-4a27-a6ce-a672abcd21e3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:05.859816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c83fe86-c09e-4a27-a6ce-a672abcd21e3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:05.860505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c83fe86-c09e-4a27-a6ce-a672abcd21e3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:06.197157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7c83fe86-c09e-4a27-a6ce-a672abcd21e3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:06.208521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7c83fe86-c09e-4a27-a6ce-a672abcd21e3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:06.210180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7c83fe86-c09e-4a27-a6ce-a672abcd21e3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:06.211460 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7c83fe86-c09e-4a27-a6ce-a672abcd21e3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 200 len: 1362 microversion: 2.25 time: 0.381498 Aug 04 16:58:06.212994 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 544/1036] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:05 2022] GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 1362 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:06.218501 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-9d76c941-7100-4c0c-93ab-7ac00b1bef7d req-685069ca-61ad-4e12-8cee-f11860894f3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94", "tag": "39c19a16-6fb8-4d94-b72d-890e7a69bd05"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:06.229724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9d76c941-7100-4c0c-93ab-7ac00b1bef7d req-685069ca-61ad-4e12-8cee-f11860894f3c service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:06.230379 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9d76c941-7100-4c0c-93ab-7ac00b1bef7d req-685069ca-61ad-4e12-8cee-f11860894f3c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:06.230882 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9d76c941-7100-4c0c-93ab-7ac00b1bef7d req-685069ca-61ad-4e12-8cee-f11860894f3c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:06.243108 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-9d76c941-7100-4c0c-93ab-7ac00b1bef7d req-685069ca-61ad-4e12-8cee-f11860894f3c service nova] Creating event network-changed:39c19a16-6fb8-4d94-b72d-890e7a69bd05 for instance cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 on n-h1-851359-3 Aug 04 16:58:06.248776 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-9d76c941-7100-4c0c-93ab-7ac00b1bef7d req-685069ca-61ad-4e12-8cee-f11860894f3c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034246 Aug 04 16:58:06.250173 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 545/1037] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:06.256339 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2ffaa065-dd7c-4467-b427-060104467851 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:06.257293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2ffaa065-dd7c-4467-b427-060104467851 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:06.264209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ffaa065-dd7c-4467-b427-060104467851 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:06.265008 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ffaa065-dd7c-4467-b427-060104467851 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:06.265454 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ffaa065-dd7c-4467-b427-060104467851 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:06.267088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ffaa065-dd7c-4467-b427-060104467851 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:06.267088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ffaa065-dd7c-4467-b427-060104467851 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:06.267088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ffaa065-dd7c-4467-b427-060104467851 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:06.271781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:06.484910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2ffaa065-dd7c-4467-b427-060104467851 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:06.494745 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2ffaa065-dd7c-4467-b427-060104467851 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1478 microversion: 2.1 time: 0.243005 Aug 04 16:58:06.510211 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 546/1038] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:06 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1478 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:06.510211 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-65b1ff51-ba55-46d8-a598-fa0b8e022554 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:06.510211 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-65b1ff51-ba55-46d8-a598-fa0b8e022554 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cf061e67-e261-41e2-a505-95e318126844] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:06.512075 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65b1ff51-ba55-46d8-a598-fa0b8e022554 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:06.512287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65b1ff51-ba55-46d8-a598-fa0b8e022554 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:06.512809 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65b1ff51-ba55-46d8-a598-fa0b8e022554 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:06.513659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65b1ff51-ba55-46d8-a598-fa0b8e022554 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:06.514282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65b1ff51-ba55-46d8-a598-fa0b8e022554 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:06.515194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65b1ff51-ba55-46d8-a598-fa0b8e022554 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:06.795498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-65b1ff51-ba55-46d8-a598-fa0b8e022554 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ad6ccd2d804e158989a5f94c6f9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50604ce0bb604209a3c18932fdd193e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:06.803568 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-65b1ff51-ba55-46d8-a598-fa0b8e022554 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844" status: 200 len: 1366 microversion: 2.1 time: 0.307076 Aug 04 16:58:06.804380 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 547/1039] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:06 2022] GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844 => generated 1366 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:06.811344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5cf9af67-270e-4ebf-acea-b7f40c64f832 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:06.812350 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5cf9af67-270e-4ebf-acea-b7f40c64f832 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: f2d3490d-12a5-453d-b698-80ca6550f0f0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:06.818797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5cf9af67-270e-4ebf-acea-b7f40c64f832 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:06.819575 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5cf9af67-270e-4ebf-acea-b7f40c64f832 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:06.820233 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5cf9af67-270e-4ebf-acea-b7f40c64f832 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:06.821381 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5cf9af67-270e-4ebf-acea-b7f40c64f832 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:06.822084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5cf9af67-270e-4ebf-acea-b7f40c64f832 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:06.822526 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5cf9af67-270e-4ebf-acea-b7f40c64f832 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:06.853594 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5cf9af67-270e-4ebf-acea-b7f40c64f832 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: f2d3490d-12a5-453d-b698-80ca6550f0f0] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:58:06.969382 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5cf9af67-270e-4ebf-acea-b7f40c64f832 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0" status: 204 len: 0 microversion: 2.1 time: 0.163199 Aug 04 16:58:06.975327 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 548/1040] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 16:58:06 2022] DELETE /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:58:06.983650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ed5576cd-ce0d-4999-a73c-082461aa02d6 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:06.984678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ed5576cd-ce0d-4999-a73c-082461aa02d6 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 981a3990-e2d4-4af5-825f-6c611da343f9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:06.995317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed5576cd-ce0d-4999-a73c-082461aa02d6 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:06.997071 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed5576cd-ce0d-4999-a73c-082461aa02d6 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:06.997728 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed5576cd-ce0d-4999-a73c-082461aa02d6 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:06.999859 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed5576cd-ce0d-4999-a73c-082461aa02d6 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:07.000548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed5576cd-ce0d-4999-a73c-082461aa02d6 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:07.002064 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed5576cd-ce0d-4999-a73c-082461aa02d6 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:07.263035 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ed5576cd-ce0d-4999-a73c-082461aa02d6 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:07.271928 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ed5576cd-ce0d-4999-a73c-082461aa02d6 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9" status: 200 len: 1315 microversion: 2.1 time: 0.294334 Aug 04 16:58:07.272520 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 549/1041] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:06 2022] GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:07.279513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d779162d-f66c-4947-ad3b-b06ccce1ac2d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:07.280375 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d779162d-f66c-4947-ad3b-b06ccce1ac2d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:07.288477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d779162d-f66c-4947-ad3b-b06ccce1ac2d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:07.288991 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d779162d-f66c-4947-ad3b-b06ccce1ac2d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:07.289439 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d779162d-f66c-4947-ad3b-b06ccce1ac2d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:07.290220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d779162d-f66c-4947-ad3b-b06ccce1ac2d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:07.290688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d779162d-f66c-4947-ad3b-b06ccce1ac2d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:07.291161 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d779162d-f66c-4947-ad3b-b06ccce1ac2d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:07.524819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d779162d-f66c-4947-ad3b-b06ccce1ac2d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:07.533629 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d779162d-f66c-4947-ad3b-b06ccce1ac2d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1528 microversion: 2.1 time: 0.259876 Aug 04 16:58:07.534890 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 550/1042] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:07 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1528 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:07.536739 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6093a229-c358-4eb7-8ec2-49c4a042e39d tempest-FloatingIPDetailsTestJSON-1468729100 tempest-FloatingIPDetailsTestJSON-1468729100-project] 10.222.0.93 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.916331 Aug 04 16:58:07.537871 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 493/1043] 10.222.0.93 () {60 vars in 1170 bytes} [Thu Aug 4 16:58:05 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:07.540103 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4379f150-2aa5-45dd-a604-50d01b2add1a tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:07.540818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4379f150-2aa5-45dd-a604-50d01b2add1a tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: f2d3490d-12a5-453d-b698-80ca6550f0f0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:07.544530 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-df92a2f6-6e76-4483-bbcb-e1ffe45a1238 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:07.545364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-df92a2f6-6e76-4483-bbcb-e1ffe45a1238 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:07.557143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4379f150-2aa5-45dd-a604-50d01b2add1a tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:07.557143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4379f150-2aa5-45dd-a604-50d01b2add1a tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:07.557143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4379f150-2aa5-45dd-a604-50d01b2add1a tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:07.557143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4379f150-2aa5-45dd-a604-50d01b2add1a tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:07.557143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4379f150-2aa5-45dd-a604-50d01b2add1a tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:07.557143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4379f150-2aa5-45dd-a604-50d01b2add1a tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:07.577555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df92a2f6-6e76-4483-bbcb-e1ffe45a1238 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:07.578080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df92a2f6-6e76-4483-bbcb-e1ffe45a1238 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:07.578543 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df92a2f6-6e76-4483-bbcb-e1ffe45a1238 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:07.579250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df92a2f6-6e76-4483-bbcb-e1ffe45a1238 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:07.579705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df92a2f6-6e76-4483-bbcb-e1ffe45a1238 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:07.580130 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df92a2f6-6e76-4483-bbcb-e1ffe45a1238 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:07.762104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4379f150-2aa5-45dd-a604-50d01b2add1a tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:07.770565 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4379f150-2aa5-45dd-a604-50d01b2add1a tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0" status: 200 len: 1714 microversion: 2.1 time: 0.234488 Aug 04 16:58:07.771312 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 551/1044] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:07 2022] GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0 => generated 1714 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:07.775986 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1bf06f44-70c4-4b27-9b37-6d5459f6f4ae tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:07.777738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1bf06f44-70c4-4b27-9b37-6d5459f6f4ae tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:07.780689 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-df92a2f6-6e76-4483-bbcb-e1ffe45a1238 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:07.783863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1bf06f44-70c4-4b27-9b37-6d5459f6f4ae tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:07.784628 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1bf06f44-70c4-4b27-9b37-6d5459f6f4ae tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:07.785142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1bf06f44-70c4-4b27-9b37-6d5459f6f4ae tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:07.785863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1bf06f44-70c4-4b27-9b37-6d5459f6f4ae tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:07.786418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1bf06f44-70c4-4b27-9b37-6d5459f6f4ae tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:07.786843 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1bf06f44-70c4-4b27-9b37-6d5459f6f4ae tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:07.796336 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-df92a2f6-6e76-4483-bbcb-e1ffe45a1238 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:07.798608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-df92a2f6-6e76-4483-bbcb-e1ffe45a1238 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:07.799922 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-df92a2f6-6e76-4483-bbcb-e1ffe45a1238 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 200 len: 1362 microversion: 2.25 time: 0.260736 Aug 04 16:58:07.815385 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 494/1045] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:07 2022] GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:07.821784 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b5c501b5-0bc8-412c-a709-ca96ee5066fc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:07.822465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b5c501b5-0bc8-412c-a709-ca96ee5066fc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:07.829506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5c501b5-0bc8-412c-a709-ca96ee5066fc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:07.830230 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5c501b5-0bc8-412c-a709-ca96ee5066fc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:07.830673 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5c501b5-0bc8-412c-a709-ca96ee5066fc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:07.831569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5c501b5-0bc8-412c-a709-ca96ee5066fc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:07.832038 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5c501b5-0bc8-412c-a709-ca96ee5066fc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:07.832476 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5c501b5-0bc8-412c-a709-ca96ee5066fc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:07.991802 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1bf06f44-70c4-4b27-9b37-6d5459f6f4ae tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:07.999979 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1bf06f44-70c4-4b27-9b37-6d5459f6f4ae tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1478 microversion: 2.1 time: 0.227400 Aug 04 16:58:08.000890 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 552/1046] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:07 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1478 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:08.017807 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c8749cd8-6538-4f20-9e6e-cd4043a54a04 tempest-FloatingIPDetailsTestJSON-1468729100 tempest-FloatingIPDetailsTestJSON-1468729100-project] Action: 'create', calling method: .version_select at 0x7f1e68081ee0>, body: {"pool": null} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:08.021838 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b5c501b5-0bc8-412c-a709-ca96ee5066fc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:08.031349 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b5c501b5-0bc8-412c-a709-ca96ee5066fc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1528 microversion: 2.1 time: 0.214771 Aug 04 16:58:08.032983 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 495/1047] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:07 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1528 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:08.051517 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-394f4ddd-19cb-44fb-ba2a-22607d2766cf req-d18d6048-e798-43f7-9b21-bea0040d8ffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "981a3990-e2d4-4af5-825f-6c611da343f9", "name": "network-vif-plugged", "status": "completed", "tag": "4478077f-55a2-4682-b8d6-9d7cfdce84a7"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:08.064882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-394f4ddd-19cb-44fb-ba2a-22607d2766cf req-d18d6048-e798-43f7-9b21-bea0040d8ffe service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:08.065372 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-394f4ddd-19cb-44fb-ba2a-22607d2766cf req-d18d6048-e798-43f7-9b21-bea0040d8ffe service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:08.066147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-394f4ddd-19cb-44fb-ba2a-22607d2766cf req-d18d6048-e798-43f7-9b21-bea0040d8ffe service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:08.078470 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-394f4ddd-19cb-44fb-ba2a-22607d2766cf req-d18d6048-e798-43f7-9b21-bea0040d8ffe service nova] Creating event network-vif-plugged:4478077f-55a2-4682-b8d6-9d7cfdce84a7 for instance 981a3990-e2d4-4af5-825f-6c611da343f9 on n-h2-851359-3 Aug 04 16:58:08.084589 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-394f4ddd-19cb-44fb-ba2a-22607d2766cf req-d18d6048-e798-43f7-9b21-bea0040d8ffe service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050299 Aug 04 16:58:08.085186 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 496/1048] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:08.091346 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-68e3f2f9-5a59-4f1e-80f6-0dc1deadad7d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:08.093036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-68e3f2f9-5a59-4f1e-80f6-0dc1deadad7d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cf061e67-e261-41e2-a505-95e318126844] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:08.098437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68e3f2f9-5a59-4f1e-80f6-0dc1deadad7d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:08.098928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68e3f2f9-5a59-4f1e-80f6-0dc1deadad7d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:08.099370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68e3f2f9-5a59-4f1e-80f6-0dc1deadad7d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:08.100087 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68e3f2f9-5a59-4f1e-80f6-0dc1deadad7d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:08.100579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68e3f2f9-5a59-4f1e-80f6-0dc1deadad7d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:08.100968 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68e3f2f9-5a59-4f1e-80f6-0dc1deadad7d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:08.322010 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-68e3f2f9-5a59-4f1e-80f6-0dc1deadad7d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ad6ccd2d804e158989a5f94c6f9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50604ce0bb604209a3c18932fdd193e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:08.329787 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-68e3f2f9-5a59-4f1e-80f6-0dc1deadad7d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844" status: 200 len: 1366 microversion: 2.1 time: 0.242409 Aug 04 16:58:08.330474 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 497/1049] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:08 2022] GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:08.335452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9e7ecd0a-8bee-4507-a4f7-418d635b5ead tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:08.336688 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:58:08.336688 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:58:08.354317 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9e7ecd0a-8bee-4507-a4f7-418d635b5ead tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/8da34e9d-49be-4084-b683-1772e2f80f21" status: 202 len: 0 microversion: 2.1 time: 0.022677 Aug 04 16:58:08.355174 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 498/1050] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 16:58:08 2022] DELETE /compute/v2.1/flavors/8da34e9d-49be-4084-b683-1772e2f80f21 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:58:08.360404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9362c880-e96a-453c-a003-46359f10b6d6 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:08.361025 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9362c880-e96a-453c-a003-46359f10b6d6 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 981a3990-e2d4-4af5-825f-6c611da343f9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:08.366930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9362c880-e96a-453c-a003-46359f10b6d6 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:08.367425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9362c880-e96a-453c-a003-46359f10b6d6 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:08.369813 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9362c880-e96a-453c-a003-46359f10b6d6 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:08.370574 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9362c880-e96a-453c-a003-46359f10b6d6 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:08.371163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9362c880-e96a-453c-a003-46359f10b6d6 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:08.371542 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9362c880-e96a-453c-a003-46359f10b6d6 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:08.387570 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:08.619532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9362c880-e96a-453c-a003-46359f10b6d6 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:08.627506 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9362c880-e96a-453c-a003-46359f10b6d6 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9" status: 200 len: 1315 microversion: 2.1 time: 0.270694 Aug 04 16:58:08.628080 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 499/1051] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:08 2022] GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:08.632781 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7a1120e2-37a9-4833-9b2c-216edfdedf13 tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:08.655523 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7a1120e2-37a9-4833-9b2c-216edfdedf13 tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.026353 Aug 04 16:58:08.656117 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 500/1052] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:58:08 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:08.674508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-13b0bb6b-02ea-43b9-92a6-159ac6f3187d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:08.676745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-13b0bb6b-02ea-43b9-92a6-159ac6f3187d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:08.683144 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13b0bb6b-02ea-43b9-92a6-159ac6f3187d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:08.683914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13b0bb6b-02ea-43b9-92a6-159ac6f3187d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:08.684367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13b0bb6b-02ea-43b9-92a6-159ac6f3187d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:08.685079 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13b0bb6b-02ea-43b9-92a6-159ac6f3187d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:08.685537 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13b0bb6b-02ea-43b9-92a6-159ac6f3187d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:08.686318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13b0bb6b-02ea-43b9-92a6-159ac6f3187d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:08.718264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-13b0bb6b-02ea-43b9-92a6-159ac6f3187d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:08.726457 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-13b0bb6b-02ea-43b9-92a6-159ac6f3187d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Old instance type tempest-test_resize_flavor_-1881319908, new instance type m1.heat {{(pid=131044) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 16:58:08.735663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-13b0bb6b-02ea-43b9-92a6-159ac6f3187d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:58:08.736113 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-13b0bb6b-02ea-43b9-92a6-159ac6f3187d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:58:08.736794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-13b0bb6b-02ea-43b9-92a6-159ac6f3187d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:58:08.737369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-13b0bb6b-02ea-43b9-92a6-159ac6f3187d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:58:08.737944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-13b0bb6b-02ea-43b9-92a6-159ac6f3187d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:58:08.809497 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-13b0bb6b-02ea-43b9-92a6-159ac6f3187d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "POST /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12/action" status: 202 len: 0 microversion: 2.1 time: 0.138847 Aug 04 16:58:08.810579 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 501/1053] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:58:08 2022] POST /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 16:58:08.818610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-29542a0c-3252-4f2b-a6c2-22ad93a1c0ed tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:08.819239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-29542a0c-3252-4f2b-a6c2-22ad93a1c0ed tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: f2d3490d-12a5-453d-b698-80ca6550f0f0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:08.826059 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29542a0c-3252-4f2b-a6c2-22ad93a1c0ed tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:08.826565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29542a0c-3252-4f2b-a6c2-22ad93a1c0ed tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:08.827010 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29542a0c-3252-4f2b-a6c2-22ad93a1c0ed tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:08.827745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29542a0c-3252-4f2b-a6c2-22ad93a1c0ed tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:08.828207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29542a0c-3252-4f2b-a6c2-22ad93a1c0ed tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:08.828833 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29542a0c-3252-4f2b-a6c2-22ad93a1c0ed tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:09.146442 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-29542a0c-3252-4f2b-a6c2-22ad93a1c0ed tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:09.158310 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-29542a0c-3252-4f2b-a6c2-22ad93a1c0ed tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0" status: 200 len: 1714 microversion: 2.1 time: 0.343967 Aug 04 16:58:09.159270 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 502/1054] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:08 2022] GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0 => generated 1714 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:09.165946 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-36e44023-79ca-427b-a893-93ac93f3e6d5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:09.166792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-36e44023-79ca-427b-a893-93ac93f3e6d5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:09.180260 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36e44023-79ca-427b-a893-93ac93f3e6d5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:09.182402 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36e44023-79ca-427b-a893-93ac93f3e6d5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:09.182989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36e44023-79ca-427b-a893-93ac93f3e6d5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:09.184294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36e44023-79ca-427b-a893-93ac93f3e6d5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:09.185067 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36e44023-79ca-427b-a893-93ac93f3e6d5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:09.185956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36e44023-79ca-427b-a893-93ac93f3e6d5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:09.416407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-36e44023-79ca-427b-a893-93ac93f3e6d5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:09.423982 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-36e44023-79ca-427b-a893-93ac93f3e6d5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1537 microversion: 2.1 time: 0.263414 Aug 04 16:58:09.425144 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 503/1055] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:09 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1537 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:09.430333 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fc4a4684-f753-4a7d-8aec-ffcb6075da27 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:09.431141 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fc4a4684-f753-4a7d-8aec-ffcb6075da27 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:09.441242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc4a4684-f753-4a7d-8aec-ffcb6075da27 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:09.442003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc4a4684-f753-4a7d-8aec-ffcb6075da27 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:09.442463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc4a4684-f753-4a7d-8aec-ffcb6075da27 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:09.443238 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc4a4684-f753-4a7d-8aec-ffcb6075da27 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:09.443863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc4a4684-f753-4a7d-8aec-ffcb6075da27 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:09.444458 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc4a4684-f753-4a7d-8aec-ffcb6075da27 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:09.671494 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c8749cd8-6538-4f20-9e6e-cd4043a54a04 tempest-FloatingIPDetailsTestJSON-1468729100 tempest-FloatingIPDetailsTestJSON-1468729100-project] 10.222.0.93 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.669259 Aug 04 16:58:09.672928 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 553/1056] 10.222.0.93 () {60 vars in 1170 bytes} [Thu Aug 4 16:58:08 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:09.680113 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-14c22bff-9b5d-43ad-a2ff-6d301333fadd tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:09.680744 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-14c22bff-9b5d-43ad-a2ff-6d301333fadd tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:09.682311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fc4a4684-f753-4a7d-8aec-ffcb6075da27 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:09.689019 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14c22bff-9b5d-43ad-a2ff-6d301333fadd tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:09.689529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14c22bff-9b5d-43ad-a2ff-6d301333fadd tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:09.689997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14c22bff-9b5d-43ad-a2ff-6d301333fadd tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:09.690716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14c22bff-9b5d-43ad-a2ff-6d301333fadd tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:09.691184 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14c22bff-9b5d-43ad-a2ff-6d301333fadd tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:09.691614 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14c22bff-9b5d-43ad-a2ff-6d301333fadd tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:09.695798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fc4a4684-f753-4a7d-8aec-ffcb6075da27 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:09.698430 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fc4a4684-f753-4a7d-8aec-ffcb6075da27 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:09.700663 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fc4a4684-f753-4a7d-8aec-ffcb6075da27 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 200 len: 1362 microversion: 2.25 time: 0.274086 Aug 04 16:58:09.715754 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 504/1057] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:09 2022] GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 1362 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:09.722176 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-83929206-a7bb-47f5-8e00-aaed0dde088d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:09.722845 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-83929206-a7bb-47f5-8e00-aaed0dde088d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cf061e67-e261-41e2-a505-95e318126844] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:09.731519 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83929206-a7bb-47f5-8e00-aaed0dde088d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:09.732018 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83929206-a7bb-47f5-8e00-aaed0dde088d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:09.732462 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83929206-a7bb-47f5-8e00-aaed0dde088d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:09.733206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83929206-a7bb-47f5-8e00-aaed0dde088d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:09.733739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83929206-a7bb-47f5-8e00-aaed0dde088d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:09.734972 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83929206-a7bb-47f5-8e00-aaed0dde088d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:09.984918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-14c22bff-9b5d-43ad-a2ff-6d301333fadd tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:09.993730 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-14c22bff-9b5d-43ad-a2ff-6d301333fadd tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1478 microversion: 2.1 time: 0.319007 Aug 04 16:58:09.997540 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-83929206-a7bb-47f5-8e00-aaed0dde088d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ad6ccd2d804e158989a5f94c6f9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50604ce0bb604209a3c18932fdd193e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:09.998929 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 554/1058] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:09 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1478 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:10.004093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e9c1d471-c977-4695-8f91-a790bf580ee7 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:10.004925 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e9c1d471-c977-4695-8f91-a790bf580ee7 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 981a3990-e2d4-4af5-825f-6c611da343f9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:10.005304 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-83929206-a7bb-47f5-8e00-aaed0dde088d tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844" status: 200 len: 1555 microversion: 2.1 time: 0.287123 Aug 04 16:58:10.005866 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 505/1059] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:09 2022] GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844 => generated 1555 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:10.011805 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9c1d471-c977-4695-8f91-a790bf580ee7 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:10.012299 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9c1d471-c977-4695-8f91-a790bf580ee7 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:10.012740 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9c1d471-c977-4695-8f91-a790bf580ee7 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:10.013440 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9c1d471-c977-4695-8f91-a790bf580ee7 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:10.014016 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9c1d471-c977-4695-8f91-a790bf580ee7 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:10.014450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9c1d471-c977-4695-8f91-a790bf580ee7 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:10.015441 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2f015260-2f81-46da-8ef5-566c9fc7ee7b tempest-FloatingIPDetailsTestJSON-1468729100 tempest-FloatingIPDetailsTestJSON-1468729100-project] Action: 'create', calling method: .version_select at 0x7f1e5b5afc10>, body: {"pool": null} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:10.223525 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e9c1d471-c977-4695-8f91-a790bf580ee7 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:10.232025 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e9c1d471-c977-4695-8f91-a790bf580ee7 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9" status: 200 len: 1315 microversion: 2.1 time: 0.231829 Aug 04 16:58:10.232819 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 555/1060] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:09 2022] GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:10.238276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c26614ae-c5fb-4df2-be95-e623e1bfc622 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:10.238776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c26614ae-c5fb-4df2-be95-e623e1bfc622 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cf061e67-e261-41e2-a505-95e318126844] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:10.240811 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:10.246874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c26614ae-c5fb-4df2-be95-e623e1bfc622 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:10.247371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c26614ae-c5fb-4df2-be95-e623e1bfc622 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:10.247815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c26614ae-c5fb-4df2-be95-e623e1bfc622 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:10.248529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c26614ae-c5fb-4df2-be95-e623e1bfc622 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:10.248991 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c26614ae-c5fb-4df2-be95-e623e1bfc622 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:10.249453 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c26614ae-c5fb-4df2-be95-e623e1bfc622 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:10.355840 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c26614ae-c5fb-4df2-be95-e623e1bfc622 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.121124 Aug 04 16:58:10.356440 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 556/1061] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Aug 4 16:58:10 2022] GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844/os-interface => generated 284 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:10.362045 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-ffbb423a-4ecb-49b1-af95-dc6917e546ca req-0932db48-63c6-4c22-9769-bbf327b5641f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19c5ab52-7c2b-4d63-8628-43c75476e45c", "name": "network-vif-unplugged", "status": "completed", "tag": "134ee327-dd36-4c6e-b53f-b97914e333e8"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:10.372018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ffbb423a-4ecb-49b1-af95-dc6917e546ca req-0932db48-63c6-4c22-9769-bbf327b5641f service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:10.372505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ffbb423a-4ecb-49b1-af95-dc6917e546ca req-0932db48-63c6-4c22-9769-bbf327b5641f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:10.372989 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ffbb423a-4ecb-49b1-af95-dc6917e546ca req-0932db48-63c6-4c22-9769-bbf327b5641f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:10.384798 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-ffbb423a-4ecb-49b1-af95-dc6917e546ca req-0932db48-63c6-4c22-9769-bbf327b5641f service nova] Creating event network-vif-unplugged:134ee327-dd36-4c6e-b53f-b97914e333e8 for instance 19c5ab52-7c2b-4d63-8628-43c75476e45c on n-h2-851359-3 Aug 04 16:58:10.389649 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-ffbb423a-4ecb-49b1-af95-dc6917e546ca req-0932db48-63c6-4c22-9769-bbf327b5641f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032064 Aug 04 16:58:10.390743 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 557/1062] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:10.395856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2ae0beda-4f55-4bcb-9c47-4f549ec56ec7 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:10.396657 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2ae0beda-4f55-4bcb-9c47-4f549ec56ec7 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: f2d3490d-12a5-453d-b698-80ca6550f0f0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:10.403540 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ae0beda-4f55-4bcb-9c47-4f549ec56ec7 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:10.404034 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ae0beda-4f55-4bcb-9c47-4f549ec56ec7 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:10.404467 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ae0beda-4f55-4bcb-9c47-4f549ec56ec7 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:10.405179 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ae0beda-4f55-4bcb-9c47-4f549ec56ec7 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:10.405630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ae0beda-4f55-4bcb-9c47-4f549ec56ec7 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:10.406147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ae0beda-4f55-4bcb-9c47-4f549ec56ec7 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:10.616604 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2ae0beda-4f55-4bcb-9c47-4f549ec56ec7 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:10.628102 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2ae0beda-4f55-4bcb-9c47-4f549ec56ec7 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0" status: 200 len: 1714 microversion: 2.1 time: 0.236093 Aug 04 16:58:10.629267 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 558/1063] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:10 2022] GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0 => generated 1714 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:10.636205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-678c1eee-29b3-47e1-9c92-78b215b4c97c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:10.638087 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-678c1eee-29b3-47e1-9c92-78b215b4c97c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:10.645352 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-678c1eee-29b3-47e1-9c92-78b215b4c97c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:10.646185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-678c1eee-29b3-47e1-9c92-78b215b4c97c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:10.647305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-678c1eee-29b3-47e1-9c92-78b215b4c97c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:10.648208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-678c1eee-29b3-47e1-9c92-78b215b4c97c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:10.650067 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-678c1eee-29b3-47e1-9c92-78b215b4c97c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:10.650682 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-678c1eee-29b3-47e1-9c92-78b215b4c97c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:10.885137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-678c1eee-29b3-47e1-9c92-78b215b4c97c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:10.893654 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-678c1eee-29b3-47e1-9c92-78b215b4c97c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1537 microversion: 2.1 time: 0.262896 Aug 04 16:58:10.894593 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 559/1064] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:10 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1537 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:10.907786 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-94a1d2d5-7652-49bc-9a1d-9e68f41b2140 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:10.908503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-94a1d2d5-7652-49bc-9a1d-9e68f41b2140 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:10.914722 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94a1d2d5-7652-49bc-9a1d-9e68f41b2140 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:10.915397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94a1d2d5-7652-49bc-9a1d-9e68f41b2140 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:10.916042 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94a1d2d5-7652-49bc-9a1d-9e68f41b2140 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:10.917018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94a1d2d5-7652-49bc-9a1d-9e68f41b2140 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:10.918171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94a1d2d5-7652-49bc-9a1d-9e68f41b2140 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:10.918711 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94a1d2d5-7652-49bc-9a1d-9e68f41b2140 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:11.365861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-94a1d2d5-7652-49bc-9a1d-9e68f41b2140 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:11.375923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-94a1d2d5-7652-49bc-9a1d-9e68f41b2140 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:11.377531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-94a1d2d5-7652-49bc-9a1d-9e68f41b2140 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:11.378831 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-94a1d2d5-7652-49bc-9a1d-9e68f41b2140 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 200 len: 1362 microversion: 2.25 time: 0.477795 Aug 04 16:58:11.379791 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 560/1065] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:10 2022] GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 1362 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:11.384598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-165bb771-5369-476f-ba02-ca964b40d8fc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:11.385284 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-165bb771-5369-476f-ba02-ca964b40d8fc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:11.391964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-165bb771-5369-476f-ba02-ca964b40d8fc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:11.392524 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-165bb771-5369-476f-ba02-ca964b40d8fc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:11.393030 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-165bb771-5369-476f-ba02-ca964b40d8fc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:11.393790 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-165bb771-5369-476f-ba02-ca964b40d8fc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:11.394370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-165bb771-5369-476f-ba02-ca964b40d8fc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:11.394861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-165bb771-5369-476f-ba02-ca964b40d8fc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:11.399549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=10 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:11.591875 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-165bb771-5369-476f-ba02-ca964b40d8fc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:11.601940 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-165bb771-5369-476f-ba02-ca964b40d8fc tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1478 microversion: 2.1 time: 0.220836 Aug 04 16:58:11.602875 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 561/1066] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:11 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1478 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:11.610272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-33162d05-1878-47a2-8d69-6da35e1214d0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:11.611113 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-33162d05-1878-47a2-8d69-6da35e1214d0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 981a3990-e2d4-4af5-825f-6c611da343f9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:11.634125 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33162d05-1878-47a2-8d69-6da35e1214d0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:11.634880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33162d05-1878-47a2-8d69-6da35e1214d0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:11.635527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33162d05-1878-47a2-8d69-6da35e1214d0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:11.637239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33162d05-1878-47a2-8d69-6da35e1214d0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:11.637931 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33162d05-1878-47a2-8d69-6da35e1214d0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:11.638552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33162d05-1878-47a2-8d69-6da35e1214d0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:11.735316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=30 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:11.988657 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-33162d05-1878-47a2-8d69-6da35e1214d0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:11.997437 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-33162d05-1878-47a2-8d69-6da35e1214d0 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9" status: 200 len: 1502 microversion: 2.1 time: 0.393097 Aug 04 16:58:11.998477 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 562/1067] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:11 2022] GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9 => generated 1502 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:12.014961 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-28940cf8-6912-4c07-9249-86371c22b14b tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:12.018000 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-28940cf8-6912-4c07-9249-86371c22b14b tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: f2d3490d-12a5-453d-b698-80ca6550f0f0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:12.033351 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28940cf8-6912-4c07-9249-86371c22b14b tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:12.034880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28940cf8-6912-4c07-9249-86371c22b14b tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:12.035612 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28940cf8-6912-4c07-9249-86371c22b14b tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:12.036977 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28940cf8-6912-4c07-9249-86371c22b14b tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:12.037731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28940cf8-6912-4c07-9249-86371c22b14b tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:12.038583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28940cf8-6912-4c07-9249-86371c22b14b tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:12.045819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:12.121694 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2f015260-2f81-46da-8ef5-566c9fc7ee7b tempest-FloatingIPDetailsTestJSON-1468729100 tempest-FloatingIPDetailsTestJSON-1468729100-project] 10.222.0.93 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.113357 Aug 04 16:58:12.131104 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 506/1068] 10.222.0.93 () {60 vars in 1170 bytes} [Thu Aug 4 16:58:10 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:12.140717 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-c06ff158-fd5e-4620-8734-06034ebf50b9 req-49d91c59-6f49-4949-9d06-50e409f4aa84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf061e67-e261-41e2-a505-95e318126844", "tag": "599dbaa7-2ff0-476e-83c1-e0770a3b8f46"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:12.162676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c06ff158-fd5e-4620-8734-06034ebf50b9 req-49d91c59-6f49-4949-9d06-50e409f4aa84 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:12.163476 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c06ff158-fd5e-4620-8734-06034ebf50b9 req-49d91c59-6f49-4949-9d06-50e409f4aa84 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:12.164149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c06ff158-fd5e-4620-8734-06034ebf50b9 req-49d91c59-6f49-4949-9d06-50e409f4aa84 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:12.177192 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-c06ff158-fd5e-4620-8734-06034ebf50b9 req-49d91c59-6f49-4949-9d06-50e409f4aa84 service nova] Creating event network-changed:599dbaa7-2ff0-476e-83c1-e0770a3b8f46 for instance cf061e67-e261-41e2-a505-95e318126844 on n-h1-851359-3 Aug 04 16:58:12.183370 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-c06ff158-fd5e-4620-8734-06034ebf50b9 req-49d91c59-6f49-4949-9d06-50e409f4aa84 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054318 Aug 04 16:58:12.184528 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 507/1069] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:12.190154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8f75e998-67f2-4b65-b87a-574706115ac6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:12.191131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8f75e998-67f2-4b65-b87a-574706115ac6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:12.197885 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f75e998-67f2-4b65-b87a-574706115ac6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:12.199207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f75e998-67f2-4b65-b87a-574706115ac6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:12.199960 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f75e998-67f2-4b65-b87a-574706115ac6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:12.200844 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f75e998-67f2-4b65-b87a-574706115ac6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:12.201467 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f75e998-67f2-4b65-b87a-574706115ac6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:12.202077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f75e998-67f2-4b65-b87a-574706115ac6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:12.244400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-28940cf8-6912-4c07-9249-86371c22b14b tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:12.253467 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-28940cf8-6912-4c07-9249-86371c22b14b tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0" status: 200 len: 1714 microversion: 2.1 time: 0.250180 Aug 04 16:58:12.254389 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 563/1070] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:12 2022] GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0 => generated 1714 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:12.263658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f17445d1-cfdc-479b-8128-f6ca44f7858e tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1067649351"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:12.267478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f17445d1-cfdc-479b-8128-f6ca44f7858e tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 981a3990-e2d4-4af5-825f-6c611da343f9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:12.274796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f17445d1-cfdc-479b-8128-f6ca44f7858e tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:12.275748 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f17445d1-cfdc-479b-8128-f6ca44f7858e tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:12.276370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f17445d1-cfdc-479b-8128-f6ca44f7858e tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:12.277842 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f17445d1-cfdc-479b-8128-f6ca44f7858e tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:12.278717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f17445d1-cfdc-479b-8128-f6ca44f7858e tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:12.279325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f17445d1-cfdc-479b-8128-f6ca44f7858e tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:12.499064 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.network.security_group_api [None req-f17445d1-cfdc-479b-8128-f6ca44f7858e tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Adding security group c41c1853-39aa-4675-a421-733d2998310b to port 4478077f-55a2-4682-b8d6-9d7cfdce84a7 Aug 04 16:58:12.624424 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8f75e998-67f2-4b65-b87a-574706115ac6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:12.652907 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8f75e998-67f2-4b65-b87a-574706115ac6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1537 microversion: 2.1 time: 0.466971 Aug 04 16:58:12.665452 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 508/1071] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:12 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1537 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:12.676854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fe89efc4-e78a-465e-a5f5-a59a2f051b99 tempest-FloatingIPDetailsTestJSON-1468729100 tempest-FloatingIPDetailsTestJSON-1468729100-project] Calling method '.version_select at 0x7f1e5b523d30>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:13.070192 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fe89efc4-e78a-465e-a5f5-a59a2f051b99 tempest-FloatingIPDetailsTestJSON-1468729100 tempest-FloatingIPDetailsTestJSON-1468729100-project] 10.222.0.93 "GET /compute/v2.1/os-floating-ips/3ffc5541-5da0-4266-8c37-ed6bb3b25521" status: 200 len: 142 microversion: 2.1 time: 0.403008 Aug 04 16:58:13.070479 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 509/1072] 10.222.0.93 () {58 vars in 1260 bytes} [Thu Aug 4 16:58:12 2022] GET /compute/v2.1/os-floating-ips/3ffc5541-5da0-4266-8c37-ed6bb3b25521 => generated 142 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:13.082121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e9643325-6d33-4a60-bfd8-05a4af2755ee tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:13.082914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e9643325-6d33-4a60-bfd8-05a4af2755ee tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:13.091943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9643325-6d33-4a60-bfd8-05a4af2755ee tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:13.092835 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9643325-6d33-4a60-bfd8-05a4af2755ee tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:13.093544 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9643325-6d33-4a60-bfd8-05a4af2755ee tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:13.095394 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9643325-6d33-4a60-bfd8-05a4af2755ee tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:13.096115 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9643325-6d33-4a60-bfd8-05a4af2755ee tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:13.096942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9643325-6d33-4a60-bfd8-05a4af2755ee tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:13.404542 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f17445d1-cfdc-479b-8128-f6ca44f7858e tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "POST /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9/action" status: 202 len: 0 microversion: 2.1 time: 1.145299 Aug 04 16:58:13.405933 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 564/1073] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:58:12 2022] POST /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9/action => generated 0 bytes in 1147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:58:13.424293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-8b4aba6f-7710-4558-a667-71844bd81cc4 req-f31b4ee7-78c1-4959-9081-28a32c884887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19c5ab52-7c2b-4d63-8628-43c75476e45c", "name": "network-vif-plugged", "status": "completed", "tag": "134ee327-dd36-4c6e-b53f-b97914e333e8"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:13.458315 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8b4aba6f-7710-4558-a667-71844bd81cc4 req-f31b4ee7-78c1-4959-9081-28a32c884887 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:13.459064 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8b4aba6f-7710-4558-a667-71844bd81cc4 req-f31b4ee7-78c1-4959-9081-28a32c884887 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:13.459889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8b4aba6f-7710-4558-a667-71844bd81cc4 req-f31b4ee7-78c1-4959-9081-28a32c884887 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:13.476655 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-8b4aba6f-7710-4558-a667-71844bd81cc4 req-f31b4ee7-78c1-4959-9081-28a32c884887 service nova] Creating event network-vif-plugged:134ee327-dd36-4c6e-b53f-b97914e333e8 for instance 19c5ab52-7c2b-4d63-8628-43c75476e45c on n-h2-851359-3 Aug 04 16:58:13.486830 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e9643325-6d33-4a60-bfd8-05a4af2755ee tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:13.507375 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-8b4aba6f-7710-4558-a667-71844bd81cc4 req-f31b4ee7-78c1-4959-9081-28a32c884887 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093872 Aug 04 16:58:13.508406 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e9643325-6d33-4a60-bfd8-05a4af2755ee tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:13.508934 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 565/1074] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:13.513604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e9643325-6d33-4a60-bfd8-05a4af2755ee tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:13.520967 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e9643325-6d33-4a60-bfd8-05a4af2755ee tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 200 len: 1362 microversion: 2.25 time: 0.449197 Aug 04 16:58:13.530246 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 510/1075] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:13 2022] GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 1362 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:13.536189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-47ded5e2-c240-422c-9890-6711fe75221d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:13.559159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-47ded5e2-c240-422c-9890-6711fe75221d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:13.569216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-281cc2cd-0002-4066-bd92-4190e9a511ab tempest-FloatingIPDetailsTestJSON-1468729100 tempest-FloatingIPDetailsTestJSON-1468729100-project] Calling method '.version_select at 0x7f1e5b50c670>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:13.621845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47ded5e2-c240-422c-9890-6711fe75221d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:13.622435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47ded5e2-c240-422c-9890-6711fe75221d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:13.622884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47ded5e2-c240-422c-9890-6711fe75221d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:13.650152 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47ded5e2-c240-422c-9890-6711fe75221d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:13.650967 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47ded5e2-c240-422c-9890-6711fe75221d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:13.655114 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47ded5e2-c240-422c-9890-6711fe75221d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:14.172017 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-47ded5e2-c240-422c-9890-6711fe75221d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:14.182342 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-47ded5e2-c240-422c-9890-6711fe75221d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1478 microversion: 2.1 time: 0.669547 Aug 04 16:58:14.183834 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 566/1076] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:13 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1478 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:14.189531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b208bb50-6e9e-4655-ad4c-0b70de673112 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:14.190521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b208bb50-6e9e-4655-ad4c-0b70de673112 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: f2d3490d-12a5-453d-b698-80ca6550f0f0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:14.198657 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b208bb50-6e9e-4655-ad4c-0b70de673112 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:14.199643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b208bb50-6e9e-4655-ad4c-0b70de673112 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:14.200167 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b208bb50-6e9e-4655-ad4c-0b70de673112 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:14.201140 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b208bb50-6e9e-4655-ad4c-0b70de673112 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:14.202566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b208bb50-6e9e-4655-ad4c-0b70de673112 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:14.203190 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b208bb50-6e9e-4655-ad4c-0b70de673112 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:14.267158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b208bb50-6e9e-4655-ad4c-0b70de673112 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:14.267666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b208bb50-6e9e-4655-ad4c-0b70de673112 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:14.268111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b208bb50-6e9e-4655-ad4c-0b70de673112 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:14.268570 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-b208bb50-6e9e-4655-ad4c-0b70de673112 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lazy-loading 'fault' on Instance uuid f2d3490d-12a5-453d-b698-80ca6550f0f0 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:58:14.350249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b208bb50-6e9e-4655-ad4c-0b70de673112 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679ea09388514a19a79f2dcce73b4189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131b528863154fefbc36f11eaf18365e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:14.359911 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b208bb50-6e9e-4655-ad4c-0b70de673112 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0" status: 200 len: 1355 microversion: 2.1 time: 0.174954 Aug 04 16:58:14.360941 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 567/1077] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:14 2022] GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0 => generated 1355 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:14.369169 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-1c2568f5-c14c-4be0-82cb-33a3e8cee95d req-71469d2b-cb0e-4404-8c86-fc631a28eadf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "981a3990-e2d4-4af5-825f-6c611da343f9", "tag": "4478077f-55a2-4682-b8d6-9d7cfdce84a7"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:14.383342 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1c2568f5-c14c-4be0-82cb-33a3e8cee95d req-71469d2b-cb0e-4404-8c86-fc631a28eadf service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:14.384132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1c2568f5-c14c-4be0-82cb-33a3e8cee95d req-71469d2b-cb0e-4404-8c86-fc631a28eadf service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:14.384833 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1c2568f5-c14c-4be0-82cb-33a3e8cee95d req-71469d2b-cb0e-4404-8c86-fc631a28eadf service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:14.397344 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-1c2568f5-c14c-4be0-82cb-33a3e8cee95d req-71469d2b-cb0e-4404-8c86-fc631a28eadf service nova] Creating event network-changed:4478077f-55a2-4682-b8d6-9d7cfdce84a7 for instance 981a3990-e2d4-4af5-825f-6c611da343f9 on n-h2-851359-3 Aug 04 16:58:14.402970 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-1c2568f5-c14c-4be0-82cb-33a3e8cee95d req-71469d2b-cb0e-4404-8c86-fc631a28eadf service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039948 Aug 04 16:58:14.403692 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 568/1078] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:14.409031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-72b645a7-5513-40be-8bda-773852cf3d9f tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '.version_select at 0x7f1e5b7e9d30>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:14.606546 n-d-851359-3 devstack@n-api.service[131043]: DEBUG neutronclient.v2_0.client [None req-72b645a7-5513-40be-8bda-773852cf3d9f tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group c41c1853-39aa-4675-a421-733d2998310b in use.", "detail": ""}} {{(pid=131043) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:58:14.607488 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-72b645a7-5513-40be-8bda-773852cf3d9f tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] HTTP exception thrown: Security Group c41c1853-39aa-4675-a421-733d2998310b in use. Aug 04 16:58:14.607488 n-d-851359-3 devstack@n-api.service[131043]: Neutron server returns request_ids: ['req-a19ac970-5aba-44c0-a4c7-1ee662f6d48f'] Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-72b645a7-5513-40be-8bda-773852cf3d9f tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Request method failure captured: Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/os-security-groups/c41c1853-39aa-4675-a421-733d2998310b HTTP/1.1 Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_pjNxGdIj4rXs7GW0_V_LIfBAwJuU8zCy9GzNAxdG5ZTEUBvkg39A9YsV-x75Y0btHlF-rpmXrDhvRCz9GI3Wx5SWU7zVXPxh15depvYj5y_bJWqGesF6D1R4D_MXtZ4ixR6WiUOhX-7Ef4eUOV6pVChDbMDy3f5C8W9ilQQLLYZGk Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 985c6a3e9f43418bb14d9d3fbf8df8d4 Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}] Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 985c6a3e9f43418bb14d9d3fbf8df8d4 Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-SecurityGroupsTestJSON-961611610-project Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: f6232496fbe3458e8a3fde3fdabe9d05 Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-SecurityGroupsTestJSON-961611610-project Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: exception: Security Group c41c1853-39aa-4675-a421-733d2998310b in use. Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: Neutron server returns request_ids: ['req-a19ac970-5aba-44c0-a4c7-1ee662f6d48f'] Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'c41c1853-39aa-4675-a421-733d2998310b'} Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:58:14.610221 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group c41c1853-39aa-4675-a421-733d2998310b in use. Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a19ac970-5aba-44c0-a4c7-1ee662f6d48f'] Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group c41c1853-39aa-4675-a421-733d2998310b in use. Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a19ac970-5aba-44c0-a4c7-1ee662f6d48f'] Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group c41c1853-39aa-4675-a421-733d2998310b in use. Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a19ac970-5aba-44c0-a4c7-1ee662f6d48f'] Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group c41c1853-39aa-4675-a421-733d2998310b in use. Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a19ac970-5aba-44c0-a4c7-1ee662f6d48f'] Aug 04 16:58:14.614318 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:14.622141 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-72b645a7-5513-40be-8bda-773852cf3d9f tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Returning 400 to user: Security Group c41c1853-39aa-4675-a421-733d2998310b in use. Aug 04 16:58:14.622141 n-d-851359-3 devstack@n-api.service[131043]: Neutron server returns request_ids: ['req-a19ac970-5aba-44c0-a4c7-1ee662f6d48f'] {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:14.626872 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-72b645a7-5513-40be-8bda-773852cf3d9f tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/c41c1853-39aa-4675-a421-733d2998310b" status: 400 len: 185 microversion: 2.1 time: 0.218255 Aug 04 16:58:14.634064 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 569/1079] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 16:58:14 2022] DELETE /compute/v2.1/os-security-groups/c41c1853-39aa-4675-a421-733d2998310b => generated 185 bytes in 226 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:58:14.640710 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5d3be0e7-fe5d-4078-be15-9f1ac321561d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:14.641686 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5d3be0e7-fe5d-4078-be15-9f1ac321561d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:14.648960 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d3be0e7-fe5d-4078-be15-9f1ac321561d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:14.649464 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d3be0e7-fe5d-4078-be15-9f1ac321561d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:14.650128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d3be0e7-fe5d-4078-be15-9f1ac321561d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:14.651029 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d3be0e7-fe5d-4078-be15-9f1ac321561d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:14.651669 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d3be0e7-fe5d-4078-be15-9f1ac321561d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:14.652332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d3be0e7-fe5d-4078-be15-9f1ac321561d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:14.937855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5d3be0e7-fe5d-4078-be15-9f1ac321561d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:14.944561 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-281cc2cd-0002-4066-bd92-4190e9a511ab tempest-FloatingIPDetailsTestJSON-1468729100 tempest-FloatingIPDetailsTestJSON-1468729100-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/3ffc5541-5da0-4266-8c37-ed6bb3b25521" status: 202 len: 0 microversion: 2.1 time: 1.410046 Aug 04 16:58:14.945516 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 511/1080] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Aug 4 16:58:13 2022] DELETE /compute/v2.1/os-floating-ips/3ffc5541-5da0-4266-8c37-ed6bb3b25521 => generated 0 bytes in 1415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:58:14.946535 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5d3be0e7-fe5d-4078-be15-9f1ac321561d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1542 microversion: 2.1 time: 0.310855 Aug 04 16:58:14.947300 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 570/1081] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:14 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1542 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:14.952467 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4612b744-5690-48c8-9fe4-3ff5dd5a40f1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:14.953386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4612b744-5690-48c8-9fe4-3ff5dd5a40f1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:14.953958 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-33c76861-dbf7-4060-9d1f-ef92d7d36cad req-2669e06d-bdea-4a99-86b9-0b483b10800d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2d3490d-12a5-453d-b698-80ca6550f0f0", "name": "network-vif-deleted", "tag": "3e3d1de2-eec1-4af1-8d8a-6520bfe5cf96"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:14.959862 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4612b744-5690-48c8-9fe4-3ff5dd5a40f1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:14.960814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4612b744-5690-48c8-9fe4-3ff5dd5a40f1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:14.961536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4612b744-5690-48c8-9fe4-3ff5dd5a40f1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:14.962574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4612b744-5690-48c8-9fe4-3ff5dd5a40f1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:14.963117 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4612b744-5690-48c8-9fe4-3ff5dd5a40f1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:14.963628 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4612b744-5690-48c8-9fe4-3ff5dd5a40f1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:14.970522 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-33c76861-dbf7-4060-9d1f-ef92d7d36cad req-2669e06d-bdea-4a99-86b9-0b483b10800d service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:14.971510 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-33c76861-dbf7-4060-9d1f-ef92d7d36cad req-2669e06d-bdea-4a99-86b9-0b483b10800d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:14.972147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-33c76861-dbf7-4060-9d1f-ef92d7d36cad req-2669e06d-bdea-4a99-86b9-0b483b10800d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:14.984023 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-33c76861-dbf7-4060-9d1f-ef92d7d36cad req-2669e06d-bdea-4a99-86b9-0b483b10800d service nova] Creating event network-vif-deleted:3e3d1de2-eec1-4af1-8d8a-6520bfe5cf96 for instance f2d3490d-12a5-453d-b698-80ca6550f0f0 on n-h1-851359-3 Aug 04 16:58:14.989010 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-33c76861-dbf7-4060-9d1f-ef92d7d36cad req-2669e06d-bdea-4a99-86b9-0b483b10800d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042280 Aug 04 16:58:14.989757 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 512/1082] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:14.997132 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a57a0d22-1ae8-4d2e-9d9e-570993a08901 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:14.999554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a57a0d22-1ae8-4d2e-9d9e-570993a08901 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 981a3990-e2d4-4af5-825f-6c611da343f9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:15.006351 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a57a0d22-1ae8-4d2e-9d9e-570993a08901 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:15.007004 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a57a0d22-1ae8-4d2e-9d9e-570993a08901 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:15.007547 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a57a0d22-1ae8-4d2e-9d9e-570993a08901 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:15.008371 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a57a0d22-1ae8-4d2e-9d9e-570993a08901 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:15.008933 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a57a0d22-1ae8-4d2e-9d9e-570993a08901 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:15.009457 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a57a0d22-1ae8-4d2e-9d9e-570993a08901 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:15.101715 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a57a0d22-1ae8-4d2e-9d9e-570993a08901 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "POST /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9/action" status: 202 len: 0 microversion: 2.1 time: 0.109364 Aug 04 16:58:15.102506 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 513/1083] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:58:14 2022] POST /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:58:15.105656 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4612b744-5690-48c8-9fe4-3ff5dd5a40f1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:15.108486 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-51a34b42-26e1-46ec-ba29-647c31cfbe70 tempest-FloatingIPDetailsTestJSON-1468729100 tempest-FloatingIPDetailsTestJSON-1468729100-project] Calling method '.version_select at 0x7f1e5b5c5700>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:15.114242 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4612b744-5690-48c8-9fe4-3ff5dd5a40f1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:15.116851 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4612b744-5690-48c8-9fe4-3ff5dd5a40f1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:15.118979 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4612b744-5690-48c8-9fe4-3ff5dd5a40f1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 200 len: 1362 microversion: 2.25 time: 0.170516 Aug 04 16:58:15.120866 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 571/1084] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:14 2022] GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:15.126406 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4f4d4ede-0116-4bd1-b8ea-6d17920682e1 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:15.127210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4f4d4ede-0116-4bd1-b8ea-6d17920682e1 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 981a3990-e2d4-4af5-825f-6c611da343f9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:15.135608 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f4d4ede-0116-4bd1-b8ea-6d17920682e1 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:15.136974 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f4d4ede-0116-4bd1-b8ea-6d17920682e1 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:15.137742 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f4d4ede-0116-4bd1-b8ea-6d17920682e1 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:15.138656 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f4d4ede-0116-4bd1-b8ea-6d17920682e1 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:15.139502 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f4d4ede-0116-4bd1-b8ea-6d17920682e1 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:15.140089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f4d4ede-0116-4bd1-b8ea-6d17920682e1 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:15.743163 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-51a34b42-26e1-46ec-ba29-647c31cfbe70 tempest-FloatingIPDetailsTestJSON-1468729100 tempest-FloatingIPDetailsTestJSON-1468729100-project] 10.222.0.93 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.639361 Aug 04 16:58:15.743739 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 514/1085] 10.222.0.93 () {58 vars in 1164 bytes} [Thu Aug 4 16:58:15 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:58:15.749860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-45691221-506a-42a2-ac2f-7997f03917b0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:15.750214 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-45691221-506a-42a2-ac2f-7997f03917b0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:15.756426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45691221-506a-42a2-ac2f-7997f03917b0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:15.756908 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45691221-506a-42a2-ac2f-7997f03917b0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:15.757345 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45691221-506a-42a2-ac2f-7997f03917b0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:15.758069 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45691221-506a-42a2-ac2f-7997f03917b0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:15.758523 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45691221-506a-42a2-ac2f-7997f03917b0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:15.758945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45691221-506a-42a2-ac2f-7997f03917b0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:15.770946 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4f4d4ede-0116-4bd1-b8ea-6d17920682e1 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:15.778570 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4f4d4ede-0116-4bd1-b8ea-6d17920682e1 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9" status: 200 len: 1573 microversion: 2.1 time: 0.656480 Aug 04 16:58:15.779449 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 572/1086] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:15 2022] GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9 => generated 1573 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:15.784328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f5613f5c-033b-44bd-8f6a-69f978f4b86f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:15.785160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f5613f5c-033b-44bd-8f6a-69f978f4b86f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: f2d3490d-12a5-453d-b698-80ca6550f0f0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:15.792136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5613f5c-033b-44bd-8f6a-69f978f4b86f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:15.792924 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5613f5c-033b-44bd-8f6a-69f978f4b86f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:15.793362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5613f5c-033b-44bd-8f6a-69f978f4b86f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:15.795228 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5613f5c-033b-44bd-8f6a-69f978f4b86f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:15.795920 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5613f5c-033b-44bd-8f6a-69f978f4b86f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:15.796597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5613f5c-033b-44bd-8f6a-69f978f4b86f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:15.815198 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-f5613f5c-033b-44bd-8f6a-69f978f4b86f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] HTTP exception thrown: Instance f2d3490d-12a5-453d-b698-80ca6550f0f0 could not be found. Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f5613f5c-033b-44bd-8f6a-69f978f4b86f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Request method failure captured: Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0 HTTP/1.1 Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_nP4F-ggtDxZKN6LnNWpkt9NTFtTnFH10lPdxBbDkDokaeqF9R9U8fkArH6jwEHahygr2N76T9kEsP3gZgnaWCn_KJow6hDSPiv0sy4jR8d1i4jNY-DkcqmwTOJwoARc6NwiWTE7HUQOD2qeNuYIw_T7isYgDomfADoi_Zgyk4Dkzc Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 131b528863154fefbc36f11eaf18365e Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1836761848 Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/131b528863154fefbc36f11eaf18365e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/131b528863154fefbc36f11eaf18365e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_131b528863154fefbc36f11eaf18365e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/131b528863154fefbc36f11eaf18365e"}]}] Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1836761848 Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 131b528863154fefbc36f11eaf18365e Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1836761848 Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1836761848-project Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 679ea09388514a19a79f2dcce73b4189 Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1836761848-project Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance f2d3490d-12a5-453d-b698-80ca6550f0f0 could not be found. Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'f2d3490d-12a5-453d-b698-80ca6550f0f0'} Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2d3490d-12a5-453d-b698-80ca6550f0f0 could not be found. Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2d3490d-12a5-453d-b698-80ca6550f0f0 could not be found. Aug 04 16:58:15.817062 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:15.822094 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:15.822094 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:15.822094 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:15.822094 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:15.822094 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:15.822094 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:15.822094 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:15.822094 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2d3490d-12a5-453d-b698-80ca6550f0f0 could not be found. Aug 04 16:58:15.822094 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:15.824455 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f5613f5c-033b-44bd-8f6a-69f978f4b86f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Returning 404 to user: Instance f2d3490d-12a5-453d-b698-80ca6550f0f0 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:15.827294 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f5613f5c-033b-44bd-8f6a-69f978f4b86f tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0" status: 404 len: 111 microversion: 2.1 time: 0.044935 Aug 04 16:58:15.829737 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 573/1087] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:15 2022] GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:15.845581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-f9a7f87c-31bd-47f5-9e0e-d0ebd049d7ea req-23c08e03-1376-499c-a10c-8dcff4181a84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94", "name": "network-vif-plugged", "status": "completed", "tag": "39c19a16-6fb8-4d94-b72d-890e7a69bd05"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:15.858073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f9a7f87c-31bd-47f5-9e0e-d0ebd049d7ea req-23c08e03-1376-499c-a10c-8dcff4181a84 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:15.858860 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f9a7f87c-31bd-47f5-9e0e-d0ebd049d7ea req-23c08e03-1376-499c-a10c-8dcff4181a84 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:15.859320 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f9a7f87c-31bd-47f5-9e0e-d0ebd049d7ea req-23c08e03-1376-499c-a10c-8dcff4181a84 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:15.872203 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-f9a7f87c-31bd-47f5-9e0e-d0ebd049d7ea req-23c08e03-1376-499c-a10c-8dcff4181a84 service nova] Creating event network-vif-plugged:39c19a16-6fb8-4d94-b72d-890e7a69bd05 for instance cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 on n-h1-851359-3 Aug 04 16:58:15.894845 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-f9a7f87c-31bd-47f5-9e0e-d0ebd049d7ea req-23c08e03-1376-499c-a10c-8dcff4181a84 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061652 Aug 04 16:58:15.895710 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 574/1088] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:15.902327 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-887ab49d-4969-4d60-b914-02085ef39d14 tempest-FloatingIPDetailsTestJSON-1468729100 tempest-FloatingIPDetailsTestJSON-1468729100-project] Calling method '.version_select at 0x7f1e5bd87040>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:15.948036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-45691221-506a-42a2-ac2f-7997f03917b0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:15.955811 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-45691221-506a-42a2-ac2f-7997f03917b0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1478 microversion: 2.1 time: 0.210960 Aug 04 16:58:15.956421 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 515/1089] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:15 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1478 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:15.962885 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dac8c32b-04d1-4a7f-a36a-19ae222a3ec6 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:15.963122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dac8c32b-04d1-4a7f-a36a-19ae222a3ec6 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:15.970179 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dac8c32b-04d1-4a7f-a36a-19ae222a3ec6 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:15.974054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dac8c32b-04d1-4a7f-a36a-19ae222a3ec6 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:15.974948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dac8c32b-04d1-4a7f-a36a-19ae222a3ec6 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:15.976327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dac8c32b-04d1-4a7f-a36a-19ae222a3ec6 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:15.977085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dac8c32b-04d1-4a7f-a36a-19ae222a3ec6 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:15.977593 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dac8c32b-04d1-4a7f-a36a-19ae222a3ec6 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:15.994515 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-dac8c32b-04d1-4a7f-a36a-19ae222a3ec6 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] HTTP exception thrown: Instance 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 could not be found. Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dac8c32b-04d1-4a7f-a36a-19ae222a3ec6 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Request method failure captured: Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 HTTP/1.1 Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_nP4F-ggtDxZKN6LnNWpkt9NTFtTnFH10lPdxBbDkDokaeqF9R9U8fkArH6jwEHahygr2N76T9kEsP3gZgnaWCn_KJow6hDSPiv0sy4jR8d1i4jNY-DkcqmwTOJwoARc6NwiWTE7HUQOD2qeNuYIw_T7isYgDomfADoi_Zgyk4Dkzc Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 131b528863154fefbc36f11eaf18365e Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1836761848 Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/131b528863154fefbc36f11eaf18365e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/131b528863154fefbc36f11eaf18365e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_131b528863154fefbc36f11eaf18365e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/131b528863154fefbc36f11eaf18365e"}]}] Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1836761848 Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 131b528863154fefbc36f11eaf18365e Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1836761848 Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1836761848-project Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 679ea09388514a19a79f2dcce73b4189 Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1836761848-project Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 could not be found. Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '69d189f5-2ca5-4d3b-9a70-b6e27d6dda13'} Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 could not be found. Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:15.997151 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:16.001456 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 could not be found. Aug 04 16:58:16.001456 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:16.001456 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:16.001456 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:16.001456 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:16.001456 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:16.001456 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:16.001456 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:16.001456 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:16.001456 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 could not be found. Aug 04 16:58:16.001456 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:16.001456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dac8c32b-04d1-4a7f-a36a-19ae222a3ec6 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Returning 404 to user: Instance 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:16.001456 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dac8c32b-04d1-4a7f-a36a-19ae222a3ec6 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "DELETE /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13" status: 404 len: 111 microversion: 2.1 time: 0.041230 Aug 04 16:58:16.001456 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 516/1090] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 16:58:15 2022] DELETE /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:16.007643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b218cd86-b32e-404c-be93-e05c4a124eb3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:16.008402 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b218cd86-b32e-404c-be93-e05c4a124eb3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:16.015036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b218cd86-b32e-404c-be93-e05c4a124eb3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:16.015782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b218cd86-b32e-404c-be93-e05c4a124eb3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:16.016926 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b218cd86-b32e-404c-be93-e05c4a124eb3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:16.018486 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b218cd86-b32e-404c-be93-e05c4a124eb3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:16.018962 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b218cd86-b32e-404c-be93-e05c4a124eb3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:16.019563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b218cd86-b32e-404c-be93-e05c4a124eb3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:16.287307 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-887ab49d-4969-4d60-b914-02085ef39d14 tempest-FloatingIPDetailsTestJSON-1468729100 tempest-FloatingIPDetailsTestJSON-1468729100-project] 10.222.0.93 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.390182 Aug 04 16:58:16.287890 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 575/1091] 10.222.0.93 () {58 vars in 1149 bytes} [Thu Aug 4 16:58:15 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:16.293156 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4fb65da7-bec4-4428-847e-6797fe91b192 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:16.293896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4fb65da7-bec4-4428-847e-6797fe91b192 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:16.300517 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4fb65da7-bec4-4428-847e-6797fe91b192 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:16.301012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4fb65da7-bec4-4428-847e-6797fe91b192 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:16.301464 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4fb65da7-bec4-4428-847e-6797fe91b192 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:16.302202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4fb65da7-bec4-4428-847e-6797fe91b192 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:16.302681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4fb65da7-bec4-4428-847e-6797fe91b192 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:16.303083 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4fb65da7-bec4-4428-847e-6797fe91b192 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:16.317589 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-4fb65da7-bec4-4428-847e-6797fe91b192 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] HTTP exception thrown: Instance 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 could not be found. Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4fb65da7-bec4-4428-847e-6797fe91b192 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Request method failure captured: Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 HTTP/1.1 Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_nP4F-ggtDxZKN6LnNWpkt9NTFtTnFH10lPdxBbDkDokaeqF9R9U8fkArH6jwEHahygr2N76T9kEsP3gZgnaWCn_KJow6hDSPiv0sy4jR8d1i4jNY-DkcqmwTOJwoARc6NwiWTE7HUQOD2qeNuYIw_T7isYgDomfADoi_Zgyk4Dkzc Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 131b528863154fefbc36f11eaf18365e Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1836761848 Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/131b528863154fefbc36f11eaf18365e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/131b528863154fefbc36f11eaf18365e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_131b528863154fefbc36f11eaf18365e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/131b528863154fefbc36f11eaf18365e"}]}] Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1836761848 Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 131b528863154fefbc36f11eaf18365e Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1836761848 Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1836761848-project Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 679ea09388514a19a79f2dcce73b4189 Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1836761848-project Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 could not be found. Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '69d189f5-2ca5-4d3b-9a70-b6e27d6dda13'} Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 could not be found. Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 could not be found. Aug 04 16:58:16.319288 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:16.323364 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:16.323364 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:16.323364 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:16.323364 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:16.323364 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:16.323364 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:16.323364 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:16.323364 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 could not be found. Aug 04 16:58:16.323364 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:16.323364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4fb65da7-bec4-4428-847e-6797fe91b192 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Returning 404 to user: Instance 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:16.323364 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4fb65da7-bec4-4428-847e-6797fe91b192 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13" status: 404 len: 111 microversion: 2.1 time: 0.031892 Aug 04 16:58:16.323364 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 576/1092] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:16 2022] GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:16.326438 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-acf133dd-336c-413a-a2be-48e26de102bb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:16.327056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-acf133dd-336c-413a-a2be-48e26de102bb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:16.331740 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b218cd86-b32e-404c-be93-e05c4a124eb3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:16.332918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-acf133dd-336c-413a-a2be-48e26de102bb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:16.333415 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-acf133dd-336c-413a-a2be-48e26de102bb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:16.333926 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-acf133dd-336c-413a-a2be-48e26de102bb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:16.335144 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-acf133dd-336c-413a-a2be-48e26de102bb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:16.336646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-acf133dd-336c-413a-a2be-48e26de102bb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:16.337418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-acf133dd-336c-413a-a2be-48e26de102bb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:16.342249 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b218cd86-b32e-404c-be93-e05c4a124eb3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1542 microversion: 2.1 time: 0.341753 Aug 04 16:58:16.344266 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 517/1093] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:15 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1542 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:16.361066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-47114d9c-d664-4964-8382-41d892e922ed tempest-FloatingIPDetailsTestJSON-1468729100 tempest-FloatingIPDetailsTestJSON-1468729100-project] Calling method '.version_select at 0x7f1e5b4ea790>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:16.659988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-acf133dd-336c-413a-a2be-48e26de102bb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:16.669438 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-acf133dd-336c-413a-a2be-48e26de102bb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:16.670976 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-acf133dd-336c-413a-a2be-48e26de102bb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:16.672104 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-acf133dd-336c-413a-a2be-48e26de102bb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 200 len: 1362 microversion: 2.25 time: 0.349461 Aug 04 16:58:16.673165 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 577/1094] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:16 2022] GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 1362 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:16.677830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1d2cb3f1-8854-4a5c-b458-3a16723d2546 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '.version_select at 0x7f1e5b743dc0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:16.698092 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1d2cb3f1-8854-4a5c-b458-3a16723d2546 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1666819661" status: 202 len: 0 microversion: 2.1 time: 0.023695 Aug 04 16:58:16.699170 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 578/1095] 10.222.0.93 () {58 vars in 1221 bytes} [Thu Aug 4 16:58:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1666819661 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:58:16.806114 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-32efad5d-0b21-44cf-91c4-1ac9558b6bde tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:16.807142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-32efad5d-0b21-44cf-91c4-1ac9558b6bde tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 981a3990-e2d4-4af5-825f-6c611da343f9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:16.813758 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32efad5d-0b21-44cf-91c4-1ac9558b6bde tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:16.814277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32efad5d-0b21-44cf-91c4-1ac9558b6bde tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:16.815062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32efad5d-0b21-44cf-91c4-1ac9558b6bde tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:16.815769 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32efad5d-0b21-44cf-91c4-1ac9558b6bde tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:16.816228 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32efad5d-0b21-44cf-91c4-1ac9558b6bde tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:16.816655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32efad5d-0b21-44cf-91c4-1ac9558b6bde tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:17.191653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-32efad5d-0b21-44cf-91c4-1ac9558b6bde tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:17.201390 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-32efad5d-0b21-44cf-91c4-1ac9558b6bde tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9" status: 200 len: 1573 microversion: 2.1 time: 0.402905 Aug 04 16:58:17.214005 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 579/1096] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:16 2022] GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9 => generated 1573 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:17.214005 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f1665bb7-8603-4bff-938c-c4b50c5bb3aa tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:17.214005 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f1665bb7-8603-4bff-938c-c4b50c5bb3aa tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:17.214834 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1665bb7-8603-4bff-938c-c4b50c5bb3aa tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:17.216549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1665bb7-8603-4bff-938c-c4b50c5bb3aa tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:17.217026 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1665bb7-8603-4bff-938c-c4b50c5bb3aa tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:17.217753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1665bb7-8603-4bff-938c-c4b50c5bb3aa tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:17.218250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1665bb7-8603-4bff-938c-c4b50c5bb3aa tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:17.218849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1665bb7-8603-4bff-938c-c4b50c5bb3aa tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:17.546691 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f1665bb7-8603-4bff-938c-c4b50c5bb3aa tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:17.559058 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f1665bb7-8603-4bff-938c-c4b50c5bb3aa tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1464 microversion: 2.1 time: 0.355134 Aug 04 16:58:17.570206 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 580/1097] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:17 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1464 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:17.570206 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0ae627b1-3177-4d2f-9dd9-1a74fd7a5046 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:17.570206 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0ae627b1-3177-4d2f-9dd9-1a74fd7a5046 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:17.570913 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ae627b1-3177-4d2f-9dd9-1a74fd7a5046 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:17.571613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ae627b1-3177-4d2f-9dd9-1a74fd7a5046 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:17.572243 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ae627b1-3177-4d2f-9dd9-1a74fd7a5046 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:17.573125 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ae627b1-3177-4d2f-9dd9-1a74fd7a5046 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:17.573755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ae627b1-3177-4d2f-9dd9-1a74fd7a5046 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:17.574378 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ae627b1-3177-4d2f-9dd9-1a74fd7a5046 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:17.881579 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0ae627b1-3177-4d2f-9dd9-1a74fd7a5046 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:17.889476 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0ae627b1-3177-4d2f-9dd9-1a74fd7a5046 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1542 microversion: 2.1 time: 0.328787 Aug 04 16:58:17.890517 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 581/1098] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:17 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1542 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:17.894678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e540aa38-27ef-4766-82ad-d0ac629bbe30 tempest-ServersWithSpecificFlavorTestJSON-656468098 tempest-ServersWithSpecificFlavorTestJSON-656468098-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:17.895686 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:58:17.895686 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:58:17.912814 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-47114d9c-d664-4964-8382-41d892e922ed tempest-FloatingIPDetailsTestJSON-1468729100 tempest-FloatingIPDetailsTestJSON-1468729100-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/7810a3e9-dea0-4096-adbc-901e1c9c7fc2" status: 202 len: 0 microversion: 2.1 time: 1.555644 Aug 04 16:58:17.913441 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 518/1099] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Aug 4 16:58:16 2022] DELETE /compute/v2.1/os-floating-ips/7810a3e9-dea0-4096-adbc-901e1c9c7fc2 => generated 0 bytes in 1557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:58:17.916727 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e540aa38-27ef-4766-82ad-d0ac629bbe30 tempest-ServersWithSpecificFlavorTestJSON-656468098 tempest-ServersWithSpecificFlavorTestJSON-656468098-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1139904760" status: 202 len: 0 microversion: 2.1 time: 0.024846 Aug 04 16:58:17.920407 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 582/1100] 10.222.0.93 () {58 vars in 1161 bytes} [Thu Aug 4 16:58:17 2022] DELETE /compute/v2.1/flavors/1139904760 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:58:17.920545 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2f48a9de-3aae-4332-b805-6ec3318d7009 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:17.920545 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2f48a9de-3aae-4332-b805-6ec3318d7009 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:17.924477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0f91135d-bda1-4c22-ad14-a8d4355ca55c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:17.926502 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f48a9de-3aae-4332-b805-6ec3318d7009 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:17.927197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f48a9de-3aae-4332-b805-6ec3318d7009 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:17.927807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f48a9de-3aae-4332-b805-6ec3318d7009 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:17.928609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f48a9de-3aae-4332-b805-6ec3318d7009 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:17.929070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f48a9de-3aae-4332-b805-6ec3318d7009 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:17.929497 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f48a9de-3aae-4332-b805-6ec3318d7009 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:17.932671 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0f91135d-bda1-4c22-ad14-a8d4355ca55c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:17.944601 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f91135d-bda1-4c22-ad14-a8d4355ca55c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:17.945121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f91135d-bda1-4c22-ad14-a8d4355ca55c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:17.945564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f91135d-bda1-4c22-ad14-a8d4355ca55c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:17.946303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f91135d-bda1-4c22-ad14-a8d4355ca55c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:17.946762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f91135d-bda1-4c22-ad14-a8d4355ca55c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:17.947187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f91135d-bda1-4c22-ad14-a8d4355ca55c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:18.399429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2f48a9de-3aae-4332-b805-6ec3318d7009 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:18.404151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0f91135d-bda1-4c22-ad14-a8d4355ca55c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:18.407654 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2f48a9de-3aae-4332-b805-6ec3318d7009 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1464 microversion: 2.1 time: 0.492939 Aug 04 16:58:18.408228 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 519/1101] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:17 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1464 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:18.412471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0f91135d-bda1-4c22-ad14-a8d4355ca55c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:18.412633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f59136cc-067e-4d11-adc2-7a01a81b1daf tempest-FloatingIPDetailsTestJSON-1468729100 tempest-FloatingIPDetailsTestJSON-1468729100-project] Calling method '.version_select at 0x7f1e5b4ea1f0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:18.414002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0f91135d-bda1-4c22-ad14-a8d4355ca55c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:18.415207 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0f91135d-bda1-4c22-ad14-a8d4355ca55c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 200 len: 1557 microversion: 2.25 time: 0.496037 Aug 04 16:58:18.415760 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 583/1102] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:17 2022] GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 1557 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:18.420434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d6ba1296-9bb3-43be-9672-53eaa2a7eea8 tempest-ServersWithSpecificFlavorTestJSON-656468098 tempest-ServersWithSpecificFlavorTestJSON-656468098-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:18.444950 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d6ba1296-9bb3-43be-9672-53eaa2a7eea8 tempest-ServersWithSpecificFlavorTestJSON-656468098 tempest-ServersWithSpecificFlavorTestJSON-656468098-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.027908 Aug 04 16:58:18.445709 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 584/1103] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:58:18 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:18.450852 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0661ffb9-cad6-4c72-bf8b-2ef8c510eaa5 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:18.451463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0661ffb9-cad6-4c72-bf8b-2ef8c510eaa5 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 981a3990-e2d4-4af5-825f-6c611da343f9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:18.457452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0661ffb9-cad6-4c72-bf8b-2ef8c510eaa5 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:18.457948 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0661ffb9-cad6-4c72-bf8b-2ef8c510eaa5 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:18.458487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0661ffb9-cad6-4c72-bf8b-2ef8c510eaa5 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:18.459203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0661ffb9-cad6-4c72-bf8b-2ef8c510eaa5 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:18.459972 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0661ffb9-cad6-4c72-bf8b-2ef8c510eaa5 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:18.460413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0661ffb9-cad6-4c72-bf8b-2ef8c510eaa5 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:18.723549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0661ffb9-cad6-4c72-bf8b-2ef8c510eaa5 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:18.732853 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0661ffb9-cad6-4c72-bf8b-2ef8c510eaa5 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9" status: 200 len: 1578 microversion: 2.1 time: 0.286015 Aug 04 16:58:18.733769 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 585/1104] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:18 2022] GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9 => generated 1578 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:18.741375 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6d6fdd3d-8dc0-444f-8c64-d22c82330974 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:18.744445 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6d6fdd3d-8dc0-444f-8c64-d22c82330974 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:18.766824 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d6fdd3d-8dc0-444f-8c64-d22c82330974 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:18.767480 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d6fdd3d-8dc0-444f-8c64-d22c82330974 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:18.768978 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d6fdd3d-8dc0-444f-8c64-d22c82330974 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:18.769926 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d6fdd3d-8dc0-444f-8c64-d22c82330974 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:18.770524 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d6fdd3d-8dc0-444f-8c64-d22c82330974 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:18.771053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d6fdd3d-8dc0-444f-8c64-d22c82330974 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:18.850940 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-6d6fdd3d-8dc0-444f-8c64-d22c82330974 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:58:18.851373 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-6d6fdd3d-8dc0-444f-8c64-d22c82330974 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:58:18.851850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-6d6fdd3d-8dc0-444f-8c64-d22c82330974 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:58:18.852292 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-6d6fdd3d-8dc0-444f-8c64-d22c82330974 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:58:18.852710 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-6d6fdd3d-8dc0-444f-8c64-d22c82330974 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:58:18.899022 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:18.919539 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6d6fdd3d-8dc0-444f-8c64-d22c82330974 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:18.926590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d6fdd3d-8dc0-444f-8c64-d22c82330974 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:18.927187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d6fdd3d-8dc0-444f-8c64-d22c82330974 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:18.927638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d6fdd3d-8dc0-444f-8c64-d22c82330974 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:18.928368 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d6fdd3d-8dc0-444f-8c64-d22c82330974 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:18.928840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d6fdd3d-8dc0-444f-8c64-d22c82330974 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:18.929301 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d6fdd3d-8dc0-444f-8c64-d22c82330974 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:18.963910 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6d6fdd3d-8dc0-444f-8c64-d22c82330974 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "POST /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c/action" status: 202 len: 1068 microversion: 2.1 time: 0.228723 Aug 04 16:58:18.965438 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 586/1105] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:58:18 2022] POST /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c/action => generated 1068 bytes in 231 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 16:58:18.969912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a2d4a833-f3f1-4797-91e5-178cb69b8563 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:18.970734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a2d4a833-f3f1-4797-91e5-178cb69b8563 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:18.976788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a2d4a833-f3f1-4797-91e5-178cb69b8563 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:18.977497 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a2d4a833-f3f1-4797-91e5-178cb69b8563 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:18.978203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a2d4a833-f3f1-4797-91e5-178cb69b8563 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:18.978940 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a2d4a833-f3f1-4797-91e5-178cb69b8563 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:18.979410 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a2d4a833-f3f1-4797-91e5-178cb69b8563 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:18.979948 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a2d4a833-f3f1-4797-91e5-178cb69b8563 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:19.171912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-a2d4a833-f3f1-4797-91e5-178cb69b8563 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lazy-loading 'services' on Instance uuid cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:58:19.185509 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a2d4a833-f3f1-4797-91e5-178cb69b8563 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 200 len: 2050 microversion: 2.25 time: 0.218970 Aug 04 16:58:19.186110 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 587/1106] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:18 2022] GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 2050 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:19.191169 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f0b4e181-a274-4648-b29f-72295a8d0df7 tempest-ServersWithSpecificFlavorTestJSON-656468098 tempest-ServersWithSpecificFlavorTestJSON-656468098-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:19.191938 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:58:19.191938 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:58:19.210814 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f0b4e181-a274-4648-b29f-72295a8d0df7 tempest-ServersWithSpecificFlavorTestJSON-656468098 tempest-ServersWithSpecificFlavorTestJSON-656468098-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1225047199" status: 202 len: 0 microversion: 2.1 time: 0.023624 Aug 04 16:58:19.211402 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 588/1107] 10.222.0.93 () {58 vars in 1161 bytes} [Thu Aug 4 16:58:19 2022] DELETE /compute/v2.1/flavors/1225047199 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:58:19.217608 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0e552dd8-02fa-497e-9551-3a573b1c9aa1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:19.218726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0e552dd8-02fa-497e-9551-3a573b1c9aa1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:19.226067 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e552dd8-02fa-497e-9551-3a573b1c9aa1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:19.226572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e552dd8-02fa-497e-9551-3a573b1c9aa1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:19.227213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e552dd8-02fa-497e-9551-3a573b1c9aa1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:19.227935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e552dd8-02fa-497e-9551-3a573b1c9aa1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:19.228541 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e552dd8-02fa-497e-9551-3a573b1c9aa1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:19.228981 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e552dd8-02fa-497e-9551-3a573b1c9aa1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:19.384924 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f59136cc-067e-4d11-adc2-7a01a81b1daf tempest-FloatingIPDetailsTestJSON-1468729100 tempest-FloatingIPDetailsTestJSON-1468729100-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/594429c0-7eec-4c51-a012-3877f85d570f" status: 202 len: 0 microversion: 2.1 time: 0.975597 Aug 04 16:58:19.385512 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 520/1108] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Aug 4 16:58:18 2022] DELETE /compute/v2.1/os-floating-ips/594429c0-7eec-4c51-a012-3877f85d570f => generated 0 bytes in 977 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:58:19.390881 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-10472cff-d666-4a3c-80cf-a5befa6351e4 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:19.391656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-10472cff-d666-4a3c-80cf-a5befa6351e4 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:19.397700 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10472cff-d666-4a3c-80cf-a5befa6351e4 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:19.398244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10472cff-d666-4a3c-80cf-a5befa6351e4 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:19.398688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10472cff-d666-4a3c-80cf-a5befa6351e4 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:19.399398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10472cff-d666-4a3c-80cf-a5befa6351e4 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:19.399984 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10472cff-d666-4a3c-80cf-a5befa6351e4 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:19.400425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10472cff-d666-4a3c-80cf-a5befa6351e4 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:19.415334 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0e552dd8-02fa-497e-9551-3a573b1c9aa1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:19.422784 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0e552dd8-02fa-497e-9551-3a573b1c9aa1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1542 microversion: 2.1 time: 0.210118 Aug 04 16:58:19.423366 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 589/1109] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:19 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1542 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:19.427750 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0513bdf9-3c53-47dc-b62a-eeefd6f53450 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:19.428352 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0513bdf9-3c53-47dc-b62a-eeefd6f53450 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:19.435184 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0513bdf9-3c53-47dc-b62a-eeefd6f53450 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:19.435674 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0513bdf9-3c53-47dc-b62a-eeefd6f53450 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:19.436107 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0513bdf9-3c53-47dc-b62a-eeefd6f53450 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:19.436803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0513bdf9-3c53-47dc-b62a-eeefd6f53450 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:19.437257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0513bdf9-3c53-47dc-b62a-eeefd6f53450 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:19.437680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0513bdf9-3c53-47dc-b62a-eeefd6f53450 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:19.596979 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-10472cff-d666-4a3c-80cf-a5befa6351e4 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:19.606915 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-10472cff-d666-4a3c-80cf-a5befa6351e4 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1473 microversion: 2.1 time: 0.219700 Aug 04 16:58:19.608361 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-0513bdf9-3c53-47dc-b62a-eeefd6f53450 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lazy-loading 'services' on Instance uuid cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:58:19.610350 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 521/1110] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:19 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1473 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:19.615433 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-119d0946-c0a0-4376-a8d3-162058c9c833 tempest-ServersWithSpecificFlavorTestJSON-656468098 tempest-ServersWithSpecificFlavorTestJSON-656468098-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:19.623436 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0513bdf9-3c53-47dc-b62a-eeefd6f53450 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 200 len: 2050 microversion: 2.25 time: 0.199055 Aug 04 16:58:19.624021 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 590/1111] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:19 2022] GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 2050 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:19.628546 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a1b13a65-2517-4f01-b527-ca40a7abefed tempest-FloatingIPDetailsTestJSON-1468729100 tempest-FloatingIPDetailsTestJSON-1468729100-project] Calling method '.version_select at 0x7f1e5b7e9280>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:19.636740 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-119d0946-c0a0-4376-a8d3-162058c9c833 tempest-ServersWithSpecificFlavorTestJSON-656468098 tempest-ServersWithSpecificFlavorTestJSON-656468098-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024149 Aug 04 16:58:19.637544 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 522/1112] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:58:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:19.645271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-29c56774-9f25-4e9b-99a7-bf9364baf9c9 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:19.647915 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:58:19.647915 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:58:19.659355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29c56774-9f25-4e9b-99a7-bf9364baf9c9 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:19.659355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29c56774-9f25-4e9b-99a7-bf9364baf9c9 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:19.659355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29c56774-9f25-4e9b-99a7-bf9364baf9c9 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:19.659355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29c56774-9f25-4e9b-99a7-bf9364baf9c9 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:19.659355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29c56774-9f25-4e9b-99a7-bf9364baf9c9 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:19.659355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29c56774-9f25-4e9b-99a7-bf9364baf9c9 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:19.676478 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-29c56774-9f25-4e9b-99a7-bf9364baf9c9 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.034678 Aug 04 16:58:19.677259 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 523/1113] 10.222.0.93 () {60 vars in 1217 bytes} [Thu Aug 4 16:58:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 16:58:19.681917 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b8bb5ebe-deac-4bd6-bc5c-e55a18815f63 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:19.682450 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b8bb5ebe-deac-4bd6-bc5c-e55a18815f63 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: f2d3490d-12a5-453d-b698-80ca6550f0f0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:19.689606 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8bb5ebe-deac-4bd6-bc5c-e55a18815f63 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:19.690135 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8bb5ebe-deac-4bd6-bc5c-e55a18815f63 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:19.690582 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8bb5ebe-deac-4bd6-bc5c-e55a18815f63 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:19.691289 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8bb5ebe-deac-4bd6-bc5c-e55a18815f63 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:19.691749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8bb5ebe-deac-4bd6-bc5c-e55a18815f63 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:19.692183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8bb5ebe-deac-4bd6-bc5c-e55a18815f63 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:19.706182 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-b8bb5ebe-deac-4bd6-bc5c-e55a18815f63 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] HTTP exception thrown: Instance f2d3490d-12a5-453d-b698-80ca6550f0f0 could not be found. Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b8bb5ebe-deac-4bd6-bc5c-e55a18815f63 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Request method failure captured: Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0 HTTP/1.1 Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_nP4F-ggtDxZKN6LnNWpkt9NTFtTnFH10lPdxBbDkDokaeqF9R9U8fkArH6jwEHahygr2N76T9kEsP3gZgnaWCn_KJow6hDSPiv0sy4jR8d1i4jNY-DkcqmwTOJwoARc6NwiWTE7HUQOD2qeNuYIw_T7isYgDomfADoi_Zgyk4Dkzc Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 131b528863154fefbc36f11eaf18365e Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1836761848 Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/131b528863154fefbc36f11eaf18365e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/131b528863154fefbc36f11eaf18365e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_131b528863154fefbc36f11eaf18365e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/131b528863154fefbc36f11eaf18365e"}]}] Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1836761848 Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 131b528863154fefbc36f11eaf18365e Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1836761848 Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1836761848-project Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 679ea09388514a19a79f2dcce73b4189 Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1836761848-project Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance f2d3490d-12a5-453d-b698-80ca6550f0f0 could not be found. Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'f2d3490d-12a5-453d-b698-80ca6550f0f0'} Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2d3490d-12a5-453d-b698-80ca6550f0f0 could not be found. Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:19.707749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:19.711957 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2d3490d-12a5-453d-b698-80ca6550f0f0 could not be found. Aug 04 16:58:19.711957 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:19.711957 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:19.711957 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:19.711957 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:19.711957 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:19.711957 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:19.711957 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:19.711957 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:19.711957 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2d3490d-12a5-453d-b698-80ca6550f0f0 could not be found. Aug 04 16:58:19.711957 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:19.711957 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b8bb5ebe-deac-4bd6-bc5c-e55a18815f63 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Returning 404 to user: Instance f2d3490d-12a5-453d-b698-80ca6550f0f0 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:19.711957 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b8bb5ebe-deac-4bd6-bc5c-e55a18815f63 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0" status: 404 len: 111 microversion: 2.1 time: 0.031142 Aug 04 16:58:19.711957 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 524/1114] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 16:58:19 2022] DELETE /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:19.714143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1dd6c9c0-d6de-49f8-ba49-aa03701f89e9 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:19.714679 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1dd6c9c0-d6de-49f8-ba49-aa03701f89e9 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:19.721077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dd6c9c0-d6de-49f8-ba49-aa03701f89e9 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:19.721568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dd6c9c0-d6de-49f8-ba49-aa03701f89e9 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:19.722040 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dd6c9c0-d6de-49f8-ba49-aa03701f89e9 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:19.722745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dd6c9c0-d6de-49f8-ba49-aa03701f89e9 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:19.723209 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dd6c9c0-d6de-49f8-ba49-aa03701f89e9 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:19.723643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dd6c9c0-d6de-49f8-ba49-aa03701f89e9 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:19.727998 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:19.793024 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1dd6c9c0-d6de-49f8-ba49-aa03701f89e9 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94/action" status: 202 len: 0 microversion: 2.25 time: 0.081534 Aug 04 16:58:19.793840 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 525/1115] 10.222.0.93 () {62 vars in 1319 bytes} [Thu Aug 4 16:58:19 2022] POST /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:58:19.802533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bae6dd8c-47e9-4a00-b59c-0e2ac333838c tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:19.803245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bae6dd8c-47e9-4a00-b59c-0e2ac333838c tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: f2d3490d-12a5-453d-b698-80ca6550f0f0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:19.811398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bae6dd8c-47e9-4a00-b59c-0e2ac333838c tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:19.811854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bae6dd8c-47e9-4a00-b59c-0e2ac333838c tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:19.812301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bae6dd8c-47e9-4a00-b59c-0e2ac333838c tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:19.813279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bae6dd8c-47e9-4a00-b59c-0e2ac333838c tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:19.813810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bae6dd8c-47e9-4a00-b59c-0e2ac333838c tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:19.814274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bae6dd8c-47e9-4a00-b59c-0e2ac333838c tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:19.829412 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-bae6dd8c-47e9-4a00-b59c-0e2ac333838c tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] HTTP exception thrown: Instance f2d3490d-12a5-453d-b698-80ca6550f0f0 could not be found. Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bae6dd8c-47e9-4a00-b59c-0e2ac333838c tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Request method failure captured: Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0 HTTP/1.1 Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_nP4F-ggtDxZKN6LnNWpkt9NTFtTnFH10lPdxBbDkDokaeqF9R9U8fkArH6jwEHahygr2N76T9kEsP3gZgnaWCn_KJow6hDSPiv0sy4jR8d1i4jNY-DkcqmwTOJwoARc6NwiWTE7HUQOD2qeNuYIw_T7isYgDomfADoi_Zgyk4Dkzc Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 131b528863154fefbc36f11eaf18365e Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1836761848 Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/131b528863154fefbc36f11eaf18365e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/131b528863154fefbc36f11eaf18365e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_131b528863154fefbc36f11eaf18365e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/131b528863154fefbc36f11eaf18365e"}]}] Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1836761848 Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 131b528863154fefbc36f11eaf18365e Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1836761848 Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1836761848-project Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 679ea09388514a19a79f2dcce73b4189 Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1836761848-project Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance f2d3490d-12a5-453d-b698-80ca6550f0f0 could not be found. Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'f2d3490d-12a5-453d-b698-80ca6550f0f0'} Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2d3490d-12a5-453d-b698-80ca6550f0f0 could not be found. Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2d3490d-12a5-453d-b698-80ca6550f0f0 could not be found. Aug 04 16:58:19.832197 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:19.839460 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:19.839460 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:19.839460 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:19.839460 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:19.839460 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:19.839460 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:19.839460 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:19.839460 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2d3490d-12a5-453d-b698-80ca6550f0f0 could not be found. Aug 04 16:58:19.839460 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:19.839460 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bae6dd8c-47e9-4a00-b59c-0e2ac333838c tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Returning 404 to user: Instance f2d3490d-12a5-453d-b698-80ca6550f0f0 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:19.839460 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bae6dd8c-47e9-4a00-b59c-0e2ac333838c tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0" status: 404 len: 111 microversion: 2.1 time: 0.035571 Aug 04 16:58:19.839460 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 526/1116] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:19 2022] GET /compute/v2.1/servers/f2d3490d-12a5-453d-b698-80ca6550f0f0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:19.839460 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fbe4bfd7-6dbc-472e-9888-e0d8cc3a823c tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:19.840465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fbe4bfd7-6dbc-472e-9888-e0d8cc3a823c tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 981a3990-e2d4-4af5-825f-6c611da343f9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:19.846117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbe4bfd7-6dbc-472e-9888-e0d8cc3a823c tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:19.846616 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbe4bfd7-6dbc-472e-9888-e0d8cc3a823c tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:19.847058 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbe4bfd7-6dbc-472e-9888-e0d8cc3a823c tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:19.847765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbe4bfd7-6dbc-472e-9888-e0d8cc3a823c tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:19.848228 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbe4bfd7-6dbc-472e-9888-e0d8cc3a823c tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:19.848660 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbe4bfd7-6dbc-472e-9888-e0d8cc3a823c tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:20.186583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fbe4bfd7-6dbc-472e-9888-e0d8cc3a823c tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:20.194106 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fbe4bfd7-6dbc-472e-9888-e0d8cc3a823c tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9" status: 200 len: 1571 microversion: 2.1 time: 0.358589 Aug 04 16:58:20.194663 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 527/1117] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:19 2022] GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9 => generated 1571 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:20.199214 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fd265b85-5282-452a-8c90-c347d6027fdf tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:20.199767 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fd265b85-5282-452a-8c90-c347d6027fdf tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:20.205434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd265b85-5282-452a-8c90-c347d6027fdf tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:20.205914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd265b85-5282-452a-8c90-c347d6027fdf tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:20.206374 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd265b85-5282-452a-8c90-c347d6027fdf tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:20.207066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd265b85-5282-452a-8c90-c347d6027fdf tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:20.207547 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd265b85-5282-452a-8c90-c347d6027fdf tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:20.207969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd265b85-5282-452a-8c90-c347d6027fdf tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:20.402343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-fd265b85-5282-452a-8c90-c347d6027fdf tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lazy-loading 'services' on Instance uuid cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:58:20.416139 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fd265b85-5282-452a-8c90-c347d6027fdf tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 200 len: 2035 microversion: 2.25 time: 0.220449 Aug 04 16:58:20.416721 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 528/1118] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:20 2022] GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 2035 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:20.421191 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-327607ef-d75d-4173-97be-767cfb878823 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:20.422344 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-327607ef-d75d-4173-97be-767cfb878823 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:20.428110 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-327607ef-d75d-4173-97be-767cfb878823 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:20.428599 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-327607ef-d75d-4173-97be-767cfb878823 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:20.429043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-327607ef-d75d-4173-97be-767cfb878823 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:20.429956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-327607ef-d75d-4173-97be-767cfb878823 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:20.430455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-327607ef-d75d-4173-97be-767cfb878823 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:20.431063 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-327607ef-d75d-4173-97be-767cfb878823 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:20.445649 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-327607ef-d75d-4173-97be-767cfb878823 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] HTTP exception thrown: Instance 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 could not be found. Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-327607ef-d75d-4173-97be-767cfb878823 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Request method failure captured: Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 HTTP/1.1 Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_nP4F-ggtDxZKN6LnNWpkt9NTFtTnFH10lPdxBbDkDokaeqF9R9U8fkArH6jwEHahygr2N76T9kEsP3gZgnaWCn_KJow6hDSPiv0sy4jR8d1i4jNY-DkcqmwTOJwoARc6NwiWTE7HUQOD2qeNuYIw_T7isYgDomfADoi_Zgyk4Dkzc Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 131b528863154fefbc36f11eaf18365e Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1836761848 Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/131b528863154fefbc36f11eaf18365e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/131b528863154fefbc36f11eaf18365e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_131b528863154fefbc36f11eaf18365e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/131b528863154fefbc36f11eaf18365e"}]}] Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1836761848 Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 131b528863154fefbc36f11eaf18365e Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1836761848 Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1836761848-project Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 679ea09388514a19a79f2dcce73b4189 Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1836761848-project Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 could not be found. Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '69d189f5-2ca5-4d3b-9a70-b6e27d6dda13'} Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 could not be found. Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:20.447261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:20.452026 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 could not be found. Aug 04 16:58:20.452026 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:20.452026 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:20.452026 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:20.452026 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:20.452026 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:20.452026 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:20.452026 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:20.452026 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:20.452026 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 could not be found. Aug 04 16:58:20.452026 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:20.452026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-327607ef-d75d-4173-97be-767cfb878823 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Returning 404 to user: Instance 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:20.452026 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-327607ef-d75d-4173-97be-767cfb878823 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "DELETE /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13" status: 404 len: 111 microversion: 2.1 time: 0.031009 Aug 04 16:58:20.452026 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 529/1119] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 16:58:20 2022] DELETE /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:20.454666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8a4d75c4-5322-4455-8410-d347d295a157 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-692180328"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:20.455202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8a4d75c4-5322-4455-8410-d347d295a157 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 981a3990-e2d4-4af5-825f-6c611da343f9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:20.461180 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a4d75c4-5322-4455-8410-d347d295a157 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:20.461669 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a4d75c4-5322-4455-8410-d347d295a157 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:20.462135 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a4d75c4-5322-4455-8410-d347d295a157 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:20.462836 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a4d75c4-5322-4455-8410-d347d295a157 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:20.463294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a4d75c4-5322-4455-8410-d347d295a157 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:20.463785 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a4d75c4-5322-4455-8410-d347d295a157 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:20.578808 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a1b13a65-2517-4f01-b527-ca40a7abefed tempest-FloatingIPDetailsTestJSON-1468729100 tempest-FloatingIPDetailsTestJSON-1468729100-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/af7e7b35-8804-4db4-88d2-252c2c623390" status: 202 len: 0 microversion: 2.1 time: 0.953716 Aug 04 16:58:20.579560 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 591/1120] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Aug 4 16:58:19 2022] DELETE /compute/v2.1/os-floating-ips/af7e7b35-8804-4db4-88d2-252c2c623390 => generated 0 bytes in 955 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:58:20.584309 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b0e3963a-3a28-47a0-b310-e94c33bb6e68 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851359-3", "block_migration": "auto"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:20.586858 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b0e3963a-3a28-47a0-b310-e94c33bb6e68 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:20.596024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0e3963a-3a28-47a0-b310-e94c33bb6e68 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:20.597003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0e3963a-3a28-47a0-b310-e94c33bb6e68 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:20.597525 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0e3963a-3a28-47a0-b310-e94c33bb6e68 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:20.598372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0e3963a-3a28-47a0-b310-e94c33bb6e68 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:20.598912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0e3963a-3a28-47a0-b310-e94c33bb6e68 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:20.599420 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0e3963a-3a28-47a0-b310-e94c33bb6e68 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:20.624565 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-b0e3963a-3a28-47a0-b310-e94c33bb6e68 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lazy-loading 'flavor' on Instance uuid cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:58:20.638261 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b0e3963a-3a28-47a0-b310-e94c33bb6e68 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Going to try to live migrate instance to n-h2-851359-3 {{(pid=131043) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 16:58:20.685494 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.network.security_group_api [None req-8a4d75c4-5322-4455-8410-d347d295a157 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Adding security group 38128ab0-477e-4de6-90f1-4144215ad86e to port 4478077f-55a2-4682-b8d6-9d7cfdce84a7 Aug 04 16:58:21.460562 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8a4d75c4-5322-4455-8410-d347d295a157 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "POST /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9/action" status: 202 len: 0 microversion: 2.1 time: 1.009681 Aug 04 16:58:21.461153 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 530/1121] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:58:20 2022] POST /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9/action => generated 0 bytes in 1011 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:58:21.469146 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e729899e-b4be-4e13-b9b1-0ad09b0acfe0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:21.469765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e729899e-b4be-4e13-b9b1-0ad09b0acfe0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:21.477231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:21.478967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e729899e-b4be-4e13-b9b1-0ad09b0acfe0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:21.479459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e729899e-b4be-4e13-b9b1-0ad09b0acfe0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:21.480388 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e729899e-b4be-4e13-b9b1-0ad09b0acfe0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:21.481094 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e729899e-b4be-4e13-b9b1-0ad09b0acfe0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:21.481721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e729899e-b4be-4e13-b9b1-0ad09b0acfe0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:21.482185 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e729899e-b4be-4e13-b9b1-0ad09b0acfe0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:22.122831 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e729899e-b4be-4e13-b9b1-0ad09b0acfe0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:22.131130 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e729899e-b4be-4e13-b9b1-0ad09b0acfe0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1542 microversion: 2.1 time: 0.665682 Aug 04 16:58:22.131745 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 531/1122] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:21 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1542 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:22.136973 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-526847eb-51f5-4c30-b374-b2d234a08624 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:22.137590 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-526847eb-51f5-4c30-b374-b2d234a08624 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] [instance: 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:22.143520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-526847eb-51f5-4c30-b374-b2d234a08624 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:22.144002 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-526847eb-51f5-4c30-b374-b2d234a08624 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:22.144633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-526847eb-51f5-4c30-b374-b2d234a08624 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:22.145324 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-526847eb-51f5-4c30-b374-b2d234a08624 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:22.145953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-526847eb-51f5-4c30-b374-b2d234a08624 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:22.146407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-526847eb-51f5-4c30-b374-b2d234a08624 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:22.160209 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-526847eb-51f5-4c30-b374-b2d234a08624 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] HTTP exception thrown: Instance 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 could not be found. Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-526847eb-51f5-4c30-b374-b2d234a08624 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Request method failure captured: Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 HTTP/1.1 Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_nP4F-ggtDxZKN6LnNWpkt9NTFtTnFH10lPdxBbDkDokaeqF9R9U8fkArH6jwEHahygr2N76T9kEsP3gZgnaWCn_KJow6hDSPiv0sy4jR8d1i4jNY-DkcqmwTOJwoARc6NwiWTE7HUQOD2qeNuYIw_T7isYgDomfADoi_Zgyk4Dkzc Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 131b528863154fefbc36f11eaf18365e Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1836761848 Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/131b528863154fefbc36f11eaf18365e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/131b528863154fefbc36f11eaf18365e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_131b528863154fefbc36f11eaf18365e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/131b528863154fefbc36f11eaf18365e"}]}] Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1836761848 Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 131b528863154fefbc36f11eaf18365e Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1836761848 Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1836761848-project Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 679ea09388514a19a79f2dcce73b4189 Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1836761848-project Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 could not be found. Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '69d189f5-2ca5-4d3b-9a70-b6e27d6dda13'} Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 could not be found. Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 could not be found. Aug 04 16:58:22.161765 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:22.166138 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:22.166138 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:22.166138 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:22.166138 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:22.166138 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:22.166138 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:22.166138 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:22.166138 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 could not be found. Aug 04 16:58:22.166138 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:22.166138 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-526847eb-51f5-4c30-b374-b2d234a08624 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] Returning 404 to user: Instance 69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:22.166138 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-526847eb-51f5-4c30-b374-b2d234a08624 tempest-ServersWithSpecificFlavorTestJSON-1836761848 tempest-ServersWithSpecificFlavorTestJSON-1836761848-project] 10.222.0.93 "GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13" status: 404 len: 111 microversion: 2.1 time: 0.031172 Aug 04 16:58:22.166138 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 532/1123] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:22 2022] GET /compute/v2.1/servers/69d189f5-2ca5-4d3b-9a70-b6e27d6dda13 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:22.170305 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cbfffb56-0e5a-4267-81ca-6d387d54127c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:22.170930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cbfffb56-0e5a-4267-81ca-6d387d54127c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:22.178182 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbfffb56-0e5a-4267-81ca-6d387d54127c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:22.178698 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbfffb56-0e5a-4267-81ca-6d387d54127c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:22.179619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbfffb56-0e5a-4267-81ca-6d387d54127c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:22.180352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbfffb56-0e5a-4267-81ca-6d387d54127c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:22.180821 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbfffb56-0e5a-4267-81ca-6d387d54127c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:22.181252 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbfffb56-0e5a-4267-81ca-6d387d54127c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:22.439906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cbfffb56-0e5a-4267-81ca-6d387d54127c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:22.447676 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cbfffb56-0e5a-4267-81ca-6d387d54127c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1473 microversion: 2.1 time: 0.281833 Aug 04 16:58:22.449162 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 533/1124] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:22 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1473 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:22.454652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-402c838a-79f2-433a-a840-e1dbe86ab57c tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '.version_select at 0x7f1e5b50c9d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:22.583480 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b0e3963a-3a28-47a0-b310-e94c33bb6e68 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94/action" status: 202 len: 0 microversion: 2.25 time: 2.002639 Aug 04 16:58:22.590642 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 592/1125] 10.222.0.93 () {62 vars in 1319 bytes} [Thu Aug 4 16:58:20 2022] POST /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94/action => generated 0 bytes in 2010 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:58:22.603336 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-0fe2d755-c743-46d9-988d-d19d2c9a3e09 req-e285c926-3152-4b3e-bb4e-08e39d5d287b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "981a3990-e2d4-4af5-825f-6c611da343f9", "tag": "4478077f-55a2-4682-b8d6-9d7cfdce84a7"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:22.618614 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-0fe2d755-c743-46d9-988d-d19d2c9a3e09 req-e285c926-3152-4b3e-bb4e-08e39d5d287b service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:22.619430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-0fe2d755-c743-46d9-988d-d19d2c9a3e09 req-e285c926-3152-4b3e-bb4e-08e39d5d287b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:22.620083 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-0fe2d755-c743-46d9-988d-d19d2c9a3e09 req-e285c926-3152-4b3e-bb4e-08e39d5d287b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:22.649317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG neutronclient.v2_0.client [None req-402c838a-79f2-433a-a840-e1dbe86ab57c tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 38128ab0-477e-4de6-90f1-4144215ad86e in use.", "detail": ""}} {{(pid=131044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:58:22.650284 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-0fe2d755-c743-46d9-988d-d19d2c9a3e09 req-e285c926-3152-4b3e-bb4e-08e39d5d287b service nova] Creating event network-changed:4478077f-55a2-4682-b8d6-9d7cfdce84a7 for instance 981a3990-e2d4-4af5-825f-6c611da343f9 on n-h2-851359-3 Aug 04 16:58:22.651264 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-402c838a-79f2-433a-a840-e1dbe86ab57c tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] HTTP exception thrown: Security Group 38128ab0-477e-4de6-90f1-4144215ad86e in use. Aug 04 16:58:22.651264 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-b8bc2995-564f-4d24-a9d3-1b5bb6aee651'] Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-402c838a-79f2-433a-a840-e1dbe86ab57c tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Request method failure captured: Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/os-security-groups/38128ab0-477e-4de6-90f1-4144215ad86e HTTP/1.1 Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_pjNxGdIj4rXs7GW0_V_LIfBAwJuU8zCy9GzNAxdG5ZTEUBvkg39A9YsV-x75Y0btHlF-rpmXrDhvRCz9GI3Wx5SWU7zVXPxh15depvYj5y_bJWqGesF6D1R4D_MXtZ4ixR6WiUOhX-7Ef4eUOV6pVChDbMDy3f5C8W9ilQQLLYZGk Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 985c6a3e9f43418bb14d9d3fbf8df8d4 Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}] Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 985c6a3e9f43418bb14d9d3fbf8df8d4 Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-SecurityGroupsTestJSON-961611610-project Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: f6232496fbe3458e8a3fde3fdabe9d05 Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-SecurityGroupsTestJSON-961611610-project Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: exception: Security Group 38128ab0-477e-4de6-90f1-4144215ad86e in use. Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-b8bc2995-564f-4d24-a9d3-1b5bb6aee651'] Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '38128ab0-477e-4de6-90f1-4144215ad86e'} Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:58:22.655122 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 38128ab0-477e-4de6-90f1-4144215ad86e in use. Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b8bc2995-564f-4d24-a9d3-1b5bb6aee651'] Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 38128ab0-477e-4de6-90f1-4144215ad86e in use. Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b8bc2995-564f-4d24-a9d3-1b5bb6aee651'] Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 38128ab0-477e-4de6-90f1-4144215ad86e in use. Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b8bc2995-564f-4d24-a9d3-1b5bb6aee651'] Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 38128ab0-477e-4de6-90f1-4144215ad86e in use. Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b8bc2995-564f-4d24-a9d3-1b5bb6aee651'] Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-402c838a-79f2-433a-a840-e1dbe86ab57c tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Returning 400 to user: Security Group 38128ab0-477e-4de6-90f1-4144215ad86e in use. Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-b8bc2995-564f-4d24-a9d3-1b5bb6aee651'] {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-402c838a-79f2-433a-a840-e1dbe86ab57c tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/38128ab0-477e-4de6-90f1-4144215ad86e" status: 400 len: 185 microversion: 2.1 time: 0.207244 Aug 04 16:58:22.663330 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 534/1126] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 16:58:22 2022] DELETE /compute/v2.1/os-security-groups/38128ab0-477e-4de6-90f1-4144215ad86e => generated 185 bytes in 209 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:58:22.668730 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a73bfa9c-350b-4f84-ab98-a58edb390af9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:22.668730 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a73bfa9c-350b-4f84-ab98-a58edb390af9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:22.670468 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-0fe2d755-c743-46d9-988d-d19d2c9a3e09 req-e285c926-3152-4b3e-bb4e-08e39d5d287b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077593 Aug 04 16:58:22.673849 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 593/1127] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:22.682946 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f8e50a8d-9425-4ca1-b4f8-644dad87980b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:22.683586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f8e50a8d-9425-4ca1-b4f8-644dad87980b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 981a3990-e2d4-4af5-825f-6c611da343f9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:22.686132 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a73bfa9c-350b-4f84-ab98-a58edb390af9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:22.686651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a73bfa9c-350b-4f84-ab98-a58edb390af9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:22.687119 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a73bfa9c-350b-4f84-ab98-a58edb390af9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:22.689029 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a73bfa9c-350b-4f84-ab98-a58edb390af9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:22.689498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a73bfa9c-350b-4f84-ab98-a58edb390af9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:22.690184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a73bfa9c-350b-4f84-ab98-a58edb390af9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:22.693041 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8e50a8d-9425-4ca1-b4f8-644dad87980b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:22.693561 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8e50a8d-9425-4ca1-b4f8-644dad87980b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:22.694032 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8e50a8d-9425-4ca1-b4f8-644dad87980b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:22.694754 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8e50a8d-9425-4ca1-b4f8-644dad87980b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:22.695267 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8e50a8d-9425-4ca1-b4f8-644dad87980b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:22.695706 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8e50a8d-9425-4ca1-b4f8-644dad87980b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:22.754135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f8e50a8d-9425-4ca1-b4f8-644dad87980b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 981a3990-e2d4-4af5-825f-6c611da343f9] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:58:22.892859 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f8e50a8d-9425-4ca1-b4f8-644dad87980b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "DELETE /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9" status: 204 len: 0 microversion: 2.1 time: 0.217158 Aug 04 16:58:22.895451 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 594/1128] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 16:58:22 2022] DELETE /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:58:22.913998 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-877d347f-8ec5-4d17-8ca4-8bea3539e906 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:22.915092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-877d347f-8ec5-4d17-8ca4-8bea3539e906 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 981a3990-e2d4-4af5-825f-6c611da343f9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:22.923824 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-877d347f-8ec5-4d17-8ca4-8bea3539e906 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:22.924742 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-877d347f-8ec5-4d17-8ca4-8bea3539e906 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:22.925461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-877d347f-8ec5-4d17-8ca4-8bea3539e906 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:22.926459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-877d347f-8ec5-4d17-8ca4-8bea3539e906 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:22.927133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-877d347f-8ec5-4d17-8ca4-8bea3539e906 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:22.927800 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-877d347f-8ec5-4d17-8ca4-8bea3539e906 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:23.214622 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a73bfa9c-350b-4f84-ab98-a58edb390af9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:23.223450 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a73bfa9c-350b-4f84-ab98-a58edb390af9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:23.225053 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a73bfa9c-350b-4f84-ab98-a58edb390af9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:23.226250 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a73bfa9c-350b-4f84-ab98-a58edb390af9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 200 len: 1567 microversion: 2.25 time: 0.566605 Aug 04 16:58:23.227058 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 535/1129] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:22 2022] GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 1567 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:23.241214 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-151f9413-9fd4-44b5-9a35-e71fcec6d15f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:23.242471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-151f9413-9fd4-44b5-9a35-e71fcec6d15f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:23.255400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-151f9413-9fd4-44b5-9a35-e71fcec6d15f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:23.256310 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-151f9413-9fd4-44b5-9a35-e71fcec6d15f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:23.257010 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-151f9413-9fd4-44b5-9a35-e71fcec6d15f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:23.257799 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-151f9413-9fd4-44b5-9a35-e71fcec6d15f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:23.258361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-151f9413-9fd4-44b5-9a35-e71fcec6d15f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:23.258861 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-151f9413-9fd4-44b5-9a35-e71fcec6d15f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:23.337489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-877d347f-8ec5-4d17-8ca4-8bea3539e906 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:23.348567 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-877d347f-8ec5-4d17-8ca4-8bea3539e906 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9" status: 200 len: 1645 microversion: 2.1 time: 0.439150 Aug 04 16:58:23.349790 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 595/1130] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:22 2022] GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9 => generated 1645 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:23.471568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-956785e4-c269-4c0c-b0ec-d93e2d11adac tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:23.472528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-956785e4-c269-4c0c-b0ec-d93e2d11adac tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:23.476019 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=7,nova_api:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:23.483302 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-956785e4-c269-4c0c-b0ec-d93e2d11adac tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:23.484169 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-956785e4-c269-4c0c-b0ec-d93e2d11adac tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:23.484850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-956785e4-c269-4c0c-b0ec-d93e2d11adac tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:23.485792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-956785e4-c269-4c0c-b0ec-d93e2d11adac tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:23.486626 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-956785e4-c269-4c0c-b0ec-d93e2d11adac tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:23.487438 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-956785e4-c269-4c0c-b0ec-d93e2d11adac tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:23.516207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-151f9413-9fd4-44b5-9a35-e71fcec6d15f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:23.525585 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-151f9413-9fd4-44b5-9a35-e71fcec6d15f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1542 microversion: 2.1 time: 0.291812 Aug 04 16:58:23.526612 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 536/1131] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:23 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1542 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:23.674071 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-956785e4-c269-4c0c-b0ec-d93e2d11adac tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:23.682290 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-956785e4-c269-4c0c-b0ec-d93e2d11adac tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1473 microversion: 2.1 time: 0.214839 Aug 04 16:58:23.683426 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 596/1132] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:23 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1473 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:24.249640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-47e061af-638f-4a64-9938-1613726741a9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:24.250191 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-47e061af-638f-4a64-9938-1613726741a9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:24.261408 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47e061af-638f-4a64-9938-1613726741a9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:24.261907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47e061af-638f-4a64-9938-1613726741a9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:24.262371 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47e061af-638f-4a64-9938-1613726741a9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:24.263081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47e061af-638f-4a64-9938-1613726741a9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:24.263538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47e061af-638f-4a64-9938-1613726741a9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:24.263963 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47e061af-638f-4a64-9938-1613726741a9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:24.372474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ecddb6d1-3dd1-495b-9461-d096ca161ed9 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:24.373410 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ecddb6d1-3dd1-495b-9461-d096ca161ed9 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 981a3990-e2d4-4af5-825f-6c611da343f9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:24.388754 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecddb6d1-3dd1-495b-9461-d096ca161ed9 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:24.389889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecddb6d1-3dd1-495b-9461-d096ca161ed9 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:24.390353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecddb6d1-3dd1-495b-9461-d096ca161ed9 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:24.391159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecddb6d1-3dd1-495b-9461-d096ca161ed9 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:24.391514 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecddb6d1-3dd1-495b-9461-d096ca161ed9 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:24.392139 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecddb6d1-3dd1-495b-9461-d096ca161ed9 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:24.598060 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-47e061af-638f-4a64-9938-1613726741a9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:24.608544 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-47e061af-638f-4a64-9938-1613726741a9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:24.610609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-47e061af-638f-4a64-9938-1613726741a9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:24.612834 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-47e061af-638f-4a64-9938-1613726741a9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 200 len: 1567 microversion: 2.25 time: 0.367300 Aug 04 16:58:24.614765 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 537/1133] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:24 2022] GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 1567 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:24.621653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fd4ab7c1-2edb-4261-9844-0575980f22f8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:24.624125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fd4ab7c1-2edb-4261-9844-0575980f22f8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:24.637753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd4ab7c1-2edb-4261-9844-0575980f22f8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:24.638809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd4ab7c1-2edb-4261-9844-0575980f22f8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:24.639493 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd4ab7c1-2edb-4261-9844-0575980f22f8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:24.640696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd4ab7c1-2edb-4261-9844-0575980f22f8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:24.643620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd4ab7c1-2edb-4261-9844-0575980f22f8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:24.644656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd4ab7c1-2edb-4261-9844-0575980f22f8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:25.008840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ecddb6d1-3dd1-495b-9461-d096ca161ed9 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:25.018736 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ecddb6d1-3dd1-495b-9461-d096ca161ed9 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9" status: 200 len: 1645 microversion: 2.1 time: 0.651265 Aug 04 16:58:25.019533 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 597/1134] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:24 2022] GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9 => generated 1645 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:25.024804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9b14632c-3a8d-418c-82dd-ab503861da96 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:25.025802 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9b14632c-3a8d-418c-82dd-ab503861da96 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:25.032677 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b14632c-3a8d-418c-82dd-ab503861da96 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:25.033573 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b14632c-3a8d-418c-82dd-ab503861da96 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:25.034622 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b14632c-3a8d-418c-82dd-ab503861da96 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:25.036093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b14632c-3a8d-418c-82dd-ab503861da96 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:25.037198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b14632c-3a8d-418c-82dd-ab503861da96 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:25.037874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b14632c-3a8d-418c-82dd-ab503861da96 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:25.142639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fd4ab7c1-2edb-4261-9844-0575980f22f8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:25.163129 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fd4ab7c1-2edb-4261-9844-0575980f22f8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1542 microversion: 2.1 time: 0.546984 Aug 04 16:58:25.164195 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 538/1135] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:24 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1542 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:25.327441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9b14632c-3a8d-418c-82dd-ab503861da96 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:25.336955 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9b14632c-3a8d-418c-82dd-ab503861da96 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1473 microversion: 2.1 time: 0.315123 Aug 04 16:58:25.338224 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 598/1136] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:25 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1473 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:25.644047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-868230d3-5d63-4a03-844e-5e73a4325b77 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:25.645440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-868230d3-5d63-4a03-844e-5e73a4325b77 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:25.654571 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-868230d3-5d63-4a03-844e-5e73a4325b77 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:25.655041 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-868230d3-5d63-4a03-844e-5e73a4325b77 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:25.655708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-868230d3-5d63-4a03-844e-5e73a4325b77 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:25.656579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-868230d3-5d63-4a03-844e-5e73a4325b77 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:25.657056 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-868230d3-5d63-4a03-844e-5e73a4325b77 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:25.657482 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-868230d3-5d63-4a03-844e-5e73a4325b77 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:25.831477 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-868230d3-5d63-4a03-844e-5e73a4325b77 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:25.844409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-868230d3-5d63-4a03-844e-5e73a4325b77 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:25.847169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-868230d3-5d63-4a03-844e-5e73a4325b77 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:25.848432 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-868230d3-5d63-4a03-844e-5e73a4325b77 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 200 len: 1567 microversion: 2.25 time: 0.210496 Aug 04 16:58:25.849315 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 539/1137] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:25 2022] GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:26.041222 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e8f30186-de7f-4c37-80d1-f2f4e94b5d23 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:26.042378 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e8f30186-de7f-4c37-80d1-f2f4e94b5d23 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 981a3990-e2d4-4af5-825f-6c611da343f9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:26.049623 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8f30186-de7f-4c37-80d1-f2f4e94b5d23 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:26.050083 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8f30186-de7f-4c37-80d1-f2f4e94b5d23 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:26.050937 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8f30186-de7f-4c37-80d1-f2f4e94b5d23 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:26.051710 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8f30186-de7f-4c37-80d1-f2f4e94b5d23 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:26.052216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8f30186-de7f-4c37-80d1-f2f4e94b5d23 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:26.052913 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8f30186-de7f-4c37-80d1-f2f4e94b5d23 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:26.186229 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4903702a-ad49-4a2b-baeb-5295c6b399be tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:26.187112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4903702a-ad49-4a2b-baeb-5295c6b399be tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:26.196432 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4903702a-ad49-4a2b-baeb-5295c6b399be tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:26.199230 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4903702a-ad49-4a2b-baeb-5295c6b399be tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:26.199910 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4903702a-ad49-4a2b-baeb-5295c6b399be tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:26.200805 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4903702a-ad49-4a2b-baeb-5295c6b399be tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:26.201606 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4903702a-ad49-4a2b-baeb-5295c6b399be tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:26.202250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4903702a-ad49-4a2b-baeb-5295c6b399be tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:26.422947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e8f30186-de7f-4c37-80d1-f2f4e94b5d23 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:26.434865 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e8f30186-de7f-4c37-80d1-f2f4e94b5d23 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9" status: 200 len: 1645 microversion: 2.1 time: 0.397589 Aug 04 16:58:26.447610 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 599/1138] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:26 2022] GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9 => generated 1645 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:26.456569 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4880c656-d15c-48f9-8d76-9c7b2ea1b7f8 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:26.457543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4880c656-d15c-48f9-8d76-9c7b2ea1b7f8 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:26.465226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4880c656-d15c-48f9-8d76-9c7b2ea1b7f8 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:26.470289 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4880c656-d15c-48f9-8d76-9c7b2ea1b7f8 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:26.470760 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4880c656-d15c-48f9-8d76-9c7b2ea1b7f8 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:26.471654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4880c656-d15c-48f9-8d76-9c7b2ea1b7f8 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:26.472134 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4880c656-d15c-48f9-8d76-9c7b2ea1b7f8 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:26.472591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4880c656-d15c-48f9-8d76-9c7b2ea1b7f8 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:26.554298 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4903702a-ad49-4a2b-baeb-5295c6b399be tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:26.565943 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4903702a-ad49-4a2b-baeb-5295c6b399be tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1542 microversion: 2.1 time: 0.385245 Aug 04 16:58:26.579484 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 540/1139] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:26 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1542 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:58:26.702298 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-e9e6f82a-33fd-4e4d-bc6e-1c847949e6c1 req-821e24fb-4c90-4d69-8579-9544c99c0461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "981a3990-e2d4-4af5-825f-6c611da343f9", "name": "network-vif-deleted", "tag": "4478077f-55a2-4682-b8d6-9d7cfdce84a7"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:26.724437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e9e6f82a-33fd-4e4d-bc6e-1c847949e6c1 req-821e24fb-4c90-4d69-8579-9544c99c0461 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:26.732471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e9e6f82a-33fd-4e4d-bc6e-1c847949e6c1 req-821e24fb-4c90-4d69-8579-9544c99c0461 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:26.734022 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e9e6f82a-33fd-4e4d-bc6e-1c847949e6c1 req-821e24fb-4c90-4d69-8579-9544c99c0461 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:26.777301 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-e9e6f82a-33fd-4e4d-bc6e-1c847949e6c1 req-821e24fb-4c90-4d69-8579-9544c99c0461 service nova] Creating event network-vif-deleted:4478077f-55a2-4682-b8d6-9d7cfdce84a7 for instance 981a3990-e2d4-4af5-825f-6c611da343f9 on n-h2-851359-3 Aug 04 16:58:26.782182 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-e9e6f82a-33fd-4e4d-bc6e-1c847949e6c1 req-821e24fb-4c90-4d69-8579-9544c99c0461 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086879 Aug 04 16:58:26.783245 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 541/1140] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:58:26.877543 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2c39bc68-e7d5-4634-9c0b-ee4ab2b050b1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:26.880239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2c39bc68-e7d5-4634-9c0b-ee4ab2b050b1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:26.894175 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c39bc68-e7d5-4634-9c0b-ee4ab2b050b1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:26.896027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c39bc68-e7d5-4634-9c0b-ee4ab2b050b1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:26.897498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c39bc68-e7d5-4634-9c0b-ee4ab2b050b1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:26.910044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c39bc68-e7d5-4634-9c0b-ee4ab2b050b1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:26.912811 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c39bc68-e7d5-4634-9c0b-ee4ab2b050b1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:26.919827 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c39bc68-e7d5-4634-9c0b-ee4ab2b050b1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:27.279006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2c39bc68-e7d5-4634-9c0b-ee4ab2b050b1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:27.279815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4880c656-d15c-48f9-8d76-9c7b2ea1b7f8 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:27.291505 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4880c656-d15c-48f9-8d76-9c7b2ea1b7f8 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1473 microversion: 2.1 time: 0.842548 Aug 04 16:58:27.292147 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 600/1141] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:26 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1473 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:27.293572 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2c39bc68-e7d5-4634-9c0b-ee4ab2b050b1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:27.296384 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2c39bc68-e7d5-4634-9c0b-ee4ab2b050b1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:27.298645 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2c39bc68-e7d5-4634-9c0b-ee4ab2b050b1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 200 len: 1567 microversion: 2.25 time: 0.428924 Aug 04 16:58:27.312477 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 542/1142] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:26 2022] GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 1567 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:58:27.470535 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-13da8800-2971-4ab3-bc58-291e396eefec tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:27.471549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-13da8800-2971-4ab3-bc58-291e396eefec tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 981a3990-e2d4-4af5-825f-6c611da343f9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:27.482363 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13da8800-2971-4ab3-bc58-291e396eefec tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:27.483226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13da8800-2971-4ab3-bc58-291e396eefec tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:27.483955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13da8800-2971-4ab3-bc58-291e396eefec tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:27.484905 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13da8800-2971-4ab3-bc58-291e396eefec tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:27.487150 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13da8800-2971-4ab3-bc58-291e396eefec tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:27.487966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13da8800-2971-4ab3-bc58-291e396eefec tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:27.492905 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:27.539205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13da8800-2971-4ab3-bc58-291e396eefec tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:27.540193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13da8800-2971-4ab3-bc58-291e396eefec tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:27.540921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13da8800-2971-4ab3-bc58-291e396eefec tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:27.543228 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-13da8800-2971-4ab3-bc58-291e396eefec tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lazy-loading 'fault' on Instance uuid 981a3990-e2d4-4af5-825f-6c611da343f9 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:58:27.596083 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-186ea414-620b-4158-8f7e-92fd7908dcf2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:27.597218 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-186ea414-620b-4158-8f7e-92fd7908dcf2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:27.617000 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-186ea414-620b-4158-8f7e-92fd7908dcf2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:27.617741 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-186ea414-620b-4158-8f7e-92fd7908dcf2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:27.618685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-186ea414-620b-4158-8f7e-92fd7908dcf2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:27.624928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-186ea414-620b-4158-8f7e-92fd7908dcf2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:27.628589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-186ea414-620b-4158-8f7e-92fd7908dcf2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:27.629282 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-186ea414-620b-4158-8f7e-92fd7908dcf2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:27.693285 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-13da8800-2971-4ab3-bc58-291e396eefec tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:27.705071 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-13da8800-2971-4ab3-bc58-291e396eefec tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9" status: 200 len: 1305 microversion: 2.1 time: 0.248839 Aug 04 16:58:27.715158 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 601/1143] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:27 2022] GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9 => generated 1305 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:27.931921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-186ea414-620b-4158-8f7e-92fd7908dcf2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:27.941393 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-186ea414-620b-4158-8f7e-92fd7908dcf2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1542 microversion: 2.1 time: 0.353778 Aug 04 16:58:27.942612 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 543/1144] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:27 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1542 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:28.312643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-afb960fe-3746-4949-a113-7e2de4488bdb tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:28.313903 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-afb960fe-3746-4949-a113-7e2de4488bdb tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:28.320435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-afb960fe-3746-4949-a113-7e2de4488bdb tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:28.320931 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-afb960fe-3746-4949-a113-7e2de4488bdb tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:28.321371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-afb960fe-3746-4949-a113-7e2de4488bdb tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:28.322108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b1eca9d0-13d6-4acb-970b-61452e085aa0 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:28.322259 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-afb960fe-3746-4949-a113-7e2de4488bdb tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:28.322367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b1eca9d0-13d6-4acb-970b-61452e085aa0 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:28.322548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-afb960fe-3746-4949-a113-7e2de4488bdb tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:28.323196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-afb960fe-3746-4949-a113-7e2de4488bdb tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:28.333187 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1eca9d0-13d6-4acb-970b-61452e085aa0 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:28.333687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1eca9d0-13d6-4acb-970b-61452e085aa0 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:28.334169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1eca9d0-13d6-4acb-970b-61452e085aa0 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:28.335606 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1eca9d0-13d6-4acb-970b-61452e085aa0 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:28.336114 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1eca9d0-13d6-4acb-970b-61452e085aa0 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:28.336594 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1eca9d0-13d6-4acb-970b-61452e085aa0 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:28.364579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:28.699795 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-afb960fe-3746-4949-a113-7e2de4488bdb tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:28.704947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b1eca9d0-13d6-4acb-970b-61452e085aa0 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:28.708336 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-afb960fe-3746-4949-a113-7e2de4488bdb tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1473 microversion: 2.1 time: 0.399472 Aug 04 16:58:28.710001 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 602/1145] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:28 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1473 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:58:28.729598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b1eca9d0-13d6-4acb-970b-61452e085aa0 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:28.730498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7e29d57b-87a9-4f78-86d5-3615ff80c330 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:28.731443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7e29d57b-87a9-4f78-86d5-3615ff80c330 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 981a3990-e2d4-4af5-825f-6c611da343f9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:28.732057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b1eca9d0-13d6-4acb-970b-61452e085aa0 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:28.733748 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b1eca9d0-13d6-4acb-970b-61452e085aa0 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 200 len: 1567 microversion: 2.25 time: 0.415908 Aug 04 16:58:28.739571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7e29d57b-87a9-4f78-86d5-3615ff80c330 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:28.740360 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7e29d57b-87a9-4f78-86d5-3615ff80c330 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:28.741070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7e29d57b-87a9-4f78-86d5-3615ff80c330 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:28.742005 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7e29d57b-87a9-4f78-86d5-3615ff80c330 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:28.742680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7e29d57b-87a9-4f78-86d5-3615ff80c330 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:28.743282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7e29d57b-87a9-4f78-86d5-3615ff80c330 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:28.750811 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 544/1146] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:28 2022] GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 1567 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:58:28.763651 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-7e29d57b-87a9-4f78-86d5-3615ff80c330 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] HTTP exception thrown: Instance 981a3990-e2d4-4af5-825f-6c611da343f9 could not be found. Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7e29d57b-87a9-4f78-86d5-3615ff80c330 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Request method failure captured: Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9 HTTP/1.1 Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_pjNxGdIj4rXs7GW0_V_LIfBAwJuU8zCy9GzNAxdG5ZTEUBvkg39A9YsV-x75Y0btHlF-rpmXrDhvRCz9GI3Wx5SWU7zVXPxh15depvYj5y_bJWqGesF6D1R4D_MXtZ4ixR6WiUOhX-7Ef4eUOV6pVChDbMDy3f5C8W9ilQQLLYZGk Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 985c6a3e9f43418bb14d9d3fbf8df8d4 Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}] Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 985c6a3e9f43418bb14d9d3fbf8df8d4 Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-SecurityGroupsTestJSON-961611610-project Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: f6232496fbe3458e8a3fde3fdabe9d05 Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-SecurityGroupsTestJSON-961611610-project Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 981a3990-e2d4-4af5-825f-6c611da343f9 could not be found. Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '981a3990-e2d4-4af5-825f-6c611da343f9'} Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 981a3990-e2d4-4af5-825f-6c611da343f9 could not be found. Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 981a3990-e2d4-4af5-825f-6c611da343f9 could not be found. Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:28.765423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:28.770415 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:28.770415 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:28.770415 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:28.770415 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:28.770415 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:28.770415 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 981a3990-e2d4-4af5-825f-6c611da343f9 could not be found. Aug 04 16:58:28.770415 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:28.770415 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7e29d57b-87a9-4f78-86d5-3615ff80c330 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Returning 404 to user: Instance 981a3990-e2d4-4af5-825f-6c611da343f9 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:28.770415 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7e29d57b-87a9-4f78-86d5-3615ff80c330 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9" status: 404 len: 111 microversion: 2.1 time: 0.042813 Aug 04 16:58:28.771657 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 603/1147] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:28 2022] GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:28.777319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1a58444f-2ea4-47b4-bd87-bb3fe9614383 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '.version_select at 0x7f1e5b4ea790>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:28.856371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-068d3141-2e4e-4a76-ba12-ea9067655317 req-f536d8a6-aa3e-4768-9407-fd93f22f6377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94", "name": "network-vif-unplugged", "status": "completed", "tag": "39c19a16-6fb8-4d94-b72d-890e7a69bd05"}, {"name": "network-changed", "server_uuid": "cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94", "tag": "39c19a16-6fb8-4d94-b72d-890e7a69bd05"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:28.875472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-068d3141-2e4e-4a76-ba12-ea9067655317 req-f536d8a6-aa3e-4768-9407-fd93f22f6377 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:28.876090 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-068d3141-2e4e-4a76-ba12-ea9067655317 req-f536d8a6-aa3e-4768-9407-fd93f22f6377 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:28.876631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-068d3141-2e4e-4a76-ba12-ea9067655317 req-f536d8a6-aa3e-4768-9407-fd93f22f6377 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:28.889205 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-068d3141-2e4e-4a76-ba12-ea9067655317 req-f536d8a6-aa3e-4768-9407-fd93f22f6377 service nova] Creating event network-vif-unplugged:39c19a16-6fb8-4d94-b72d-890e7a69bd05 for instance cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 on n-h1-851359-3 Aug 04 16:58:28.889870 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-068d3141-2e4e-4a76-ba12-ea9067655317 req-f536d8a6-aa3e-4768-9407-fd93f22f6377 service nova] Creating event network-changed:39c19a16-6fb8-4d94-b72d-890e7a69bd05 for instance cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 on n-h1-851359-3 Aug 04 16:58:28.895468 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-068d3141-2e4e-4a76-ba12-ea9067655317 req-f536d8a6-aa3e-4768-9407-fd93f22f6377 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.043239 Aug 04 16:58:28.896348 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 604/1148] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:58:28.966340 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-87f58f57-cf96-42b2-98d8-84516bda2789 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:28.967055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-87f58f57-cf96-42b2-98d8-84516bda2789 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:28.974606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87f58f57-cf96-42b2-98d8-84516bda2789 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:28.975103 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87f58f57-cf96-42b2-98d8-84516bda2789 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:28.975544 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87f58f57-cf96-42b2-98d8-84516bda2789 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:28.976415 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87f58f57-cf96-42b2-98d8-84516bda2789 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:28.976868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87f58f57-cf96-42b2-98d8-84516bda2789 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:28.977295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87f58f57-cf96-42b2-98d8-84516bda2789 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:29.265527 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1a58444f-2ea4-47b4-bd87-bb3fe9614383 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/c41c1853-39aa-4675-a421-733d2998310b" status: 202 len: 0 microversion: 2.1 time: 0.491602 Aug 04 16:58:29.265527 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 545/1149] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 16:58:28 2022] DELETE /compute/v2.1/os-security-groups/c41c1853-39aa-4675-a421-733d2998310b => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:58:29.274193 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-22aa17d5-5362-4fcf-bb58-f223be4fb09a tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '.version_select at 0x7f1e5b48c040>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:29.281557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-87f58f57-cf96-42b2-98d8-84516bda2789 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:29.305446 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-87f58f57-cf96-42b2-98d8-84516bda2789 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1542 microversion: 2.1 time: 0.340892 Aug 04 16:58:29.306115 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 605/1150] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:28 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1542 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:58:29.657165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:29.703079 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-22aa17d5-5362-4fcf-bb58-f223be4fb09a tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/38128ab0-477e-4de6-90f1-4144215ad86e" status: 202 len: 0 microversion: 2.1 time: 0.433335 Aug 04 16:58:29.703825 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 546/1151] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 16:58:29 2022] DELETE /compute/v2.1/os-security-groups/38128ab0-477e-4de6-90f1-4144215ad86e => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:58:29.715717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4eb95c34-7b0d-4e17-80a1-d2fd8cca45dd tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Action: 'create', calling method: .version_select at 0x7f1e5b6ec790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-857535259", "description": "tempest-description-1354276413"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:29.742479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-21580327-b403-4fb6-9eee-562a0b07766c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:29.744674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-21580327-b403-4fb6-9eee-562a0b07766c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:29.757780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21580327-b403-4fb6-9eee-562a0b07766c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:29.758533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21580327-b403-4fb6-9eee-562a0b07766c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:29.759167 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21580327-b403-4fb6-9eee-562a0b07766c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:29.760073 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21580327-b403-4fb6-9eee-562a0b07766c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:29.760756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21580327-b403-4fb6-9eee-562a0b07766c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:29.761198 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21580327-b403-4fb6-9eee-562a0b07766c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:30.140228 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-21580327-b403-4fb6-9eee-562a0b07766c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:30.148389 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-21580327-b403-4fb6-9eee-562a0b07766c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1473 microversion: 2.1 time: 0.413605 Aug 04 16:58:30.149422 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 547/1152] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:29 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1473 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:30.156233 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-203a2047-f06f-4ad9-9733-a803e241bc59 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:30.157041 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-203a2047-f06f-4ad9-9733-a803e241bc59 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:30.164422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-203a2047-f06f-4ad9-9733-a803e241bc59 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:30.164923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-203a2047-f06f-4ad9-9733-a803e241bc59 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:30.165369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-203a2047-f06f-4ad9-9733-a803e241bc59 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:30.166109 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-203a2047-f06f-4ad9-9733-a803e241bc59 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:30.166601 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-203a2047-f06f-4ad9-9733-a803e241bc59 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:30.167239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-203a2047-f06f-4ad9-9733-a803e241bc59 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:30.357167 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4eb95c34-7b0d-4e17-80a1-d2fd8cca45dd tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.644946 Aug 04 16:58:30.358882 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 606/1153] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Aug 4 16:58:29 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:30.364792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0b3612b2-af82-4889-ac1f-40e53eae98b9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:30.365630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0b3612b2-af82-4889-ac1f-40e53eae98b9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:30.373946 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b3612b2-af82-4889-ac1f-40e53eae98b9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:30.374654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b3612b2-af82-4889-ac1f-40e53eae98b9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:30.375220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b3612b2-af82-4889-ac1f-40e53eae98b9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:30.376060 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b3612b2-af82-4889-ac1f-40e53eae98b9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:30.376602 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b3612b2-af82-4889-ac1f-40e53eae98b9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:30.377109 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b3612b2-af82-4889-ac1f-40e53eae98b9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:30.647442 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-203a2047-f06f-4ad9-9733-a803e241bc59 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:30.657650 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-203a2047-f06f-4ad9-9733-a803e241bc59 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:30.660387 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-203a2047-f06f-4ad9-9733-a803e241bc59 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:30.661845 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-203a2047-f06f-4ad9-9733-a803e241bc59 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 200 len: 1567 microversion: 2.25 time: 0.511170 Aug 04 16:58:30.662827 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 548/1154] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:30 2022] GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 1567 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:30.674929 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-68fb86f1-f376-4c21-800b-0a983e2baebe tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Action: 'update', calling method: .version_select at 0x7f1e5b4ea8b0>, body: {"security_group": {"name": "tempest-sg-hth-722707506", "description": "tempest-description-hth-2027229419"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:30.737104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0b3612b2-af82-4889-ac1f-40e53eae98b9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:30.755753 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0b3612b2-af82-4889-ac1f-40e53eae98b9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1542 microversion: 2.1 time: 0.394894 Aug 04 16:58:30.766008 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 607/1155] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:30 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1542 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:31.174456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-33e4a584-85ec-4721-b7ee-a9cf16c1163a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:31.178094 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-33e4a584-85ec-4721-b7ee-a9cf16c1163a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:31.195947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33e4a584-85ec-4721-b7ee-a9cf16c1163a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:31.198819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33e4a584-85ec-4721-b7ee-a9cf16c1163a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:31.202649 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33e4a584-85ec-4721-b7ee-a9cf16c1163a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:31.203567 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33e4a584-85ec-4721-b7ee-a9cf16c1163a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:31.204157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33e4a584-85ec-4721-b7ee-a9cf16c1163a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:31.205050 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33e4a584-85ec-4721-b7ee-a9cf16c1163a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:31.255835 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-68fb86f1-f376-4c21-800b-0a983e2baebe tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "PUT /compute/v2.1/os-security-groups/aaa7fd5a-8f76-48f6-9709-1d7a88999900" status: 200 len: 217 microversion: 2.1 time: 0.591624 Aug 04 16:58:31.257272 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 549/1156] 10.222.0.93 () {60 vars in 1290 bytes} [Thu Aug 4 16:58:30 2022] PUT /compute/v2.1/os-security-groups/aaa7fd5a-8f76-48f6-9709-1d7a88999900 => generated 217 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:31.270127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-685300c6-5d86-414b-a0e2-214928028066 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '.version_select at 0x7f1e5b5c5430>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:31.406350 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-685300c6-5d86-414b-a0e2-214928028066 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups/aaa7fd5a-8f76-48f6-9709-1d7a88999900" status: 200 len: 217 microversion: 2.1 time: 0.140865 Aug 04 16:58:31.417358 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 550/1157] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Aug 4 16:58:31 2022] GET /compute/v2.1/os-security-groups/aaa7fd5a-8f76-48f6-9709-1d7a88999900 => generated 217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:58:31.422611 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3c5e6d8a-57ce-45fa-922a-77aa4484b8cd tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '.version_select at 0x7f1e5b592040>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:31.506534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-33e4a584-85ec-4721-b7ee-a9cf16c1163a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:31.522811 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-33e4a584-85ec-4721-b7ee-a9cf16c1163a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1473 microversion: 2.1 time: 0.354519 Aug 04 16:58:31.524039 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 608/1158] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:31 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1473 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:58:31.685809 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-db4a6626-da57-478c-9273-331f33239187 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:31.686575 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-db4a6626-da57-478c-9273-331f33239187 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:31.701574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db4a6626-da57-478c-9273-331f33239187 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:31.702207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db4a6626-da57-478c-9273-331f33239187 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:31.702749 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db4a6626-da57-478c-9273-331f33239187 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:31.703528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db4a6626-da57-478c-9273-331f33239187 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:31.704100 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db4a6626-da57-478c-9273-331f33239187 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:31.704712 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db4a6626-da57-478c-9273-331f33239187 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:31.720100 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3c5e6d8a-57ce-45fa-922a-77aa4484b8cd tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/aaa7fd5a-8f76-48f6-9709-1d7a88999900" status: 202 len: 0 microversion: 2.1 time: 0.301259 Aug 04 16:58:31.723624 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 551/1159] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 16:58:31 2022] DELETE /compute/v2.1/os-security-groups/aaa7fd5a-8f76-48f6-9709-1d7a88999900 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:58:31.728669 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b0022d95-f0c1-4042-a2bf-a977da39c4f3 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:31.729949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b0022d95-f0c1-4042-a2bf-a977da39c4f3 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 981a3990-e2d4-4af5-825f-6c611da343f9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:31.746824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0022d95-f0c1-4042-a2bf-a977da39c4f3 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:31.747410 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0022d95-f0c1-4042-a2bf-a977da39c4f3 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:31.747855 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0022d95-f0c1-4042-a2bf-a977da39c4f3 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:31.748568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0022d95-f0c1-4042-a2bf-a977da39c4f3 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:31.749030 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0022d95-f0c1-4042-a2bf-a977da39c4f3 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:31.749461 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0022d95-f0c1-4042-a2bf-a977da39c4f3 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:31.803329 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-b0022d95-f0c1-4042-a2bf-a977da39c4f3 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] HTTP exception thrown: Instance 981a3990-e2d4-4af5-825f-6c611da343f9 could not be found. Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b0022d95-f0c1-4042-a2bf-a977da39c4f3 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Request method failure captured: Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9 HTTP/1.1 Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_pjNxGdIj4rXs7GW0_V_LIfBAwJuU8zCy9GzNAxdG5ZTEUBvkg39A9YsV-x75Y0btHlF-rpmXrDhvRCz9GI3Wx5SWU7zVXPxh15depvYj5y_bJWqGesF6D1R4D_MXtZ4ixR6WiUOhX-7Ef4eUOV6pVChDbMDy3f5C8W9ilQQLLYZGk Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 985c6a3e9f43418bb14d9d3fbf8df8d4 Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}] Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 985c6a3e9f43418bb14d9d3fbf8df8d4 Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-SecurityGroupsTestJSON-961611610-project Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: f6232496fbe3458e8a3fde3fdabe9d05 Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-SecurityGroupsTestJSON-961611610-project Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 981a3990-e2d4-4af5-825f-6c611da343f9 could not be found. Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '981a3990-e2d4-4af5-825f-6c611da343f9'} Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 981a3990-e2d4-4af5-825f-6c611da343f9 could not be found. Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:31.804920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:31.809847 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 981a3990-e2d4-4af5-825f-6c611da343f9 could not be found. Aug 04 16:58:31.809847 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:31.809847 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:31.809847 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:31.809847 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:31.809847 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:31.809847 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:31.809847 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:31.809847 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:31.809847 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 981a3990-e2d4-4af5-825f-6c611da343f9 could not be found. Aug 04 16:58:31.809847 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:31.809847 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b0022d95-f0c1-4042-a2bf-a977da39c4f3 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Returning 404 to user: Instance 981a3990-e2d4-4af5-825f-6c611da343f9 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:31.813956 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b0022d95-f0c1-4042-a2bf-a977da39c4f3 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "DELETE /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9" status: 404 len: 111 microversion: 2.1 time: 0.085091 Aug 04 16:58:31.813956 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 552/1160] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 16:58:31 2022] DELETE /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:31.819395 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-64f4858f-c2a1-4ff4-8a50-ff3220abd5d1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:31.820023 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-64f4858f-c2a1-4ff4-8a50-ff3220abd5d1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:31.826638 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64f4858f-c2a1-4ff4-8a50-ff3220abd5d1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:31.827145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64f4858f-c2a1-4ff4-8a50-ff3220abd5d1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:31.827593 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64f4858f-c2a1-4ff4-8a50-ff3220abd5d1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:31.828321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64f4858f-c2a1-4ff4-8a50-ff3220abd5d1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:31.828784 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64f4858f-c2a1-4ff4-8a50-ff3220abd5d1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:31.829402 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64f4858f-c2a1-4ff4-8a50-ff3220abd5d1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:32.002298 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-db4a6626-da57-478c-9273-331f33239187 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:32.015323 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-db4a6626-da57-478c-9273-331f33239187 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:32.017648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-db4a6626-da57-478c-9273-331f33239187 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:32.019170 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-db4a6626-da57-478c-9273-331f33239187 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 200 len: 1567 microversion: 2.25 time: 0.338275 Aug 04 16:58:32.038149 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 609/1161] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:31 2022] GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 1567 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:32.047315 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3bd13f7a-6c06-4f22-aadf-aaa63a1514d2 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:32.048751 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3bd13f7a-6c06-4f22-aadf-aaa63a1514d2 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 981a3990-e2d4-4af5-825f-6c611da343f9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:32.056316 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-64f4858f-c2a1-4ff4-8a50-ff3220abd5d1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:32.058827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3bd13f7a-6c06-4f22-aadf-aaa63a1514d2 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:32.059892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3bd13f7a-6c06-4f22-aadf-aaa63a1514d2 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:32.061158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3bd13f7a-6c06-4f22-aadf-aaa63a1514d2 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:32.062938 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3bd13f7a-6c06-4f22-aadf-aaa63a1514d2 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:32.066571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3bd13f7a-6c06-4f22-aadf-aaa63a1514d2 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:32.066965 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-64f4858f-c2a1-4ff4-8a50-ff3220abd5d1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1542 microversion: 2.1 time: 0.254247 Aug 04 16:58:32.067923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3bd13f7a-6c06-4f22-aadf-aaa63a1514d2 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:32.069709 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 553/1162] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:31 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1542 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:32.086872 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-3bd13f7a-6c06-4f22-aadf-aaa63a1514d2 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] HTTP exception thrown: Instance 981a3990-e2d4-4af5-825f-6c611da343f9 could not be found. Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3bd13f7a-6c06-4f22-aadf-aaa63a1514d2 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Request method failure captured: Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9 HTTP/1.1 Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_pjNxGdIj4rXs7GW0_V_LIfBAwJuU8zCy9GzNAxdG5ZTEUBvkg39A9YsV-x75Y0btHlF-rpmXrDhvRCz9GI3Wx5SWU7zVXPxh15depvYj5y_bJWqGesF6D1R4D_MXtZ4ixR6WiUOhX-7Ef4eUOV6pVChDbMDy3f5C8W9ilQQLLYZGk Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 985c6a3e9f43418bb14d9d3fbf8df8d4 Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}] Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 985c6a3e9f43418bb14d9d3fbf8df8d4 Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-SecurityGroupsTestJSON-961611610-project Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: f6232496fbe3458e8a3fde3fdabe9d05 Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-SecurityGroupsTestJSON-961611610-project Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 981a3990-e2d4-4af5-825f-6c611da343f9 could not be found. Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '981a3990-e2d4-4af5-825f-6c611da343f9'} Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 981a3990-e2d4-4af5-825f-6c611da343f9 could not be found. Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 981a3990-e2d4-4af5-825f-6c611da343f9 could not be found. Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:32.089428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.096989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:32.096989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:32.096989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:32.096989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:32.096989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:32.096989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 981a3990-e2d4-4af5-825f-6c611da343f9 could not be found. Aug 04 16:58:32.096989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.096989 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3bd13f7a-6c06-4f22-aadf-aaa63a1514d2 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Returning 404 to user: Instance 981a3990-e2d4-4af5-825f-6c611da343f9 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:32.096989 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3bd13f7a-6c06-4f22-aadf-aaa63a1514d2 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9" status: 404 len: 111 microversion: 2.1 time: 0.051020 Aug 04 16:58:32.097727 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 610/1163] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:32 2022] GET /compute/v2.1/servers/981a3990-e2d4-4af5-825f-6c611da343f9 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:32.101310 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ee2a2d33-9c17-468d-bb30-d39126a583d5 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '.version_select at 0x7f1e5b50c0d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:32.124381 n-d-851359-3 devstack@n-api.service[131044]: DEBUG neutronclient.v2_0.client [None req-ee2a2d33-9c17-468d-bb30-d39126a583d5 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 38128ab0-477e-4de6-90f1-4144215ad86e does not exist", "detail": ""}} {{(pid=131044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:58:32.124980 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.security_group_api [None req-ee2a2d33-9c17-468d-bb30-d39126a583d5 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Neutron security group 38128ab0-477e-4de6-90f1-4144215ad86e not found {{(pid=131044) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 16:58:32.125716 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-ee2a2d33-9c17-468d-bb30-d39126a583d5 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] HTTP exception thrown: Security group 38128ab0-477e-4de6-90f1-4144215ad86e does not exist Aug 04 16:58:32.125716 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-59c83896-5bd6-4720-9770-6d9c7ca0658a'] Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ee2a2d33-9c17-468d-bb30-d39126a583d5 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Request method failure captured: Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/os-security-groups/38128ab0-477e-4de6-90f1-4144215ad86e HTTP/1.1 Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_pjNxGdIj4rXs7GW0_V_LIfBAwJuU8zCy9GzNAxdG5ZTEUBvkg39A9YsV-x75Y0btHlF-rpmXrDhvRCz9GI3Wx5SWU7zVXPxh15depvYj5y_bJWqGesF6D1R4D_MXtZ4ixR6WiUOhX-7Ef4eUOV6pVChDbMDy3f5C8W9ilQQLLYZGk Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 985c6a3e9f43418bb14d9d3fbf8df8d4 Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}] Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 985c6a3e9f43418bb14d9d3fbf8df8d4 Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-SecurityGroupsTestJSON-961611610-project Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: f6232496fbe3458e8a3fde3fdabe9d05 Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-SecurityGroupsTestJSON-961611610-project Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: exception: Security group 38128ab0-477e-4de6-90f1-4144215ad86e does not exist Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-59c83896-5bd6-4720-9770-6d9c7ca0658a'] Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '38128ab0-477e-4de6-90f1-4144215ad86e'} Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:58:32.127811 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 38128ab0-477e-4de6-90f1-4144215ad86e does not exist Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59c83896-5bd6-4720-9770-6d9c7ca0658a'] Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 38128ab0-477e-4de6-90f1-4144215ad86e does not exist Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59c83896-5bd6-4720-9770-6d9c7ca0658a'] Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 38128ab0-477e-4de6-90f1-4144215ad86e does not exist Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59c83896-5bd6-4720-9770-6d9c7ca0658a'] Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 38128ab0-477e-4de6-90f1-4144215ad86e does not exist Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59c83896-5bd6-4720-9770-6d9c7ca0658a'] Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ee2a2d33-9c17-468d-bb30-d39126a583d5 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Returning 404 to user: Security group 38128ab0-477e-4de6-90f1-4144215ad86e does not exist Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-59c83896-5bd6-4720-9770-6d9c7ca0658a'] {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ee2a2d33-9c17-468d-bb30-d39126a583d5 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/38128ab0-477e-4de6-90f1-4144215ad86e" status: 404 len: 194 microversion: 2.1 time: 0.032249 Aug 04 16:58:32.131975 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 554/1164] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 16:58:32 2022] DELETE /compute/v2.1/os-security-groups/38128ab0-477e-4de6-90f1-4144215ad86e => generated 194 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:58:32.139206 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-065eaf6e-bf61-4d05-8f37-6fa2bff73e66 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '.version_select at 0x7f1e5b6ecd30>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:32.163912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG neutronclient.v2_0.client [None req-065eaf6e-bf61-4d05-8f37-6fa2bff73e66 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c41c1853-39aa-4675-a421-733d2998310b does not exist", "detail": ""}} {{(pid=131043) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:58:32.164624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.security_group_api [None req-065eaf6e-bf61-4d05-8f37-6fa2bff73e66 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Neutron security group c41c1853-39aa-4675-a421-733d2998310b not found {{(pid=131043) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 16:58:32.165281 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-065eaf6e-bf61-4d05-8f37-6fa2bff73e66 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] HTTP exception thrown: Security group c41c1853-39aa-4675-a421-733d2998310b does not exist Aug 04 16:58:32.165281 n-d-851359-3 devstack@n-api.service[131043]: Neutron server returns request_ids: ['req-7da37628-31e2-41ac-ac8c-143385038843'] Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-065eaf6e-bf61-4d05-8f37-6fa2bff73e66 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Request method failure captured: Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/os-security-groups/c41c1853-39aa-4675-a421-733d2998310b HTTP/1.1 Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_pjNxGdIj4rXs7GW0_V_LIfBAwJuU8zCy9GzNAxdG5ZTEUBvkg39A9YsV-x75Y0btHlF-rpmXrDhvRCz9GI3Wx5SWU7zVXPxh15depvYj5y_bJWqGesF6D1R4D_MXtZ4ixR6WiUOhX-7Ef4eUOV6pVChDbMDy3f5C8W9ilQQLLYZGk Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 985c6a3e9f43418bb14d9d3fbf8df8d4 Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}] Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 985c6a3e9f43418bb14d9d3fbf8df8d4 Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-SecurityGroupsTestJSON-961611610-project Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: f6232496fbe3458e8a3fde3fdabe9d05 Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-SecurityGroupsTestJSON-961611610-project Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: exception: Security group c41c1853-39aa-4675-a421-733d2998310b does not exist Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: Neutron server returns request_ids: ['req-7da37628-31e2-41ac-ac8c-143385038843'] Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'c41c1853-39aa-4675-a421-733d2998310b'} Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:58:32.168269 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c41c1853-39aa-4675-a421-733d2998310b does not exist Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7da37628-31e2-41ac-ac8c-143385038843'] Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c41c1853-39aa-4675-a421-733d2998310b does not exist Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7da37628-31e2-41ac-ac8c-143385038843'] Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c41c1853-39aa-4675-a421-733d2998310b does not exist Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7da37628-31e2-41ac-ac8c-143385038843'] Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c41c1853-39aa-4675-a421-733d2998310b does not exist Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7da37628-31e2-41ac-ac8c-143385038843'] Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-065eaf6e-bf61-4d05-8f37-6fa2bff73e66 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Returning 404 to user: Security group c41c1853-39aa-4675-a421-733d2998310b does not exist Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: Neutron server returns request_ids: ['req-7da37628-31e2-41ac-ac8c-143385038843'] {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:32.172730 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-065eaf6e-bf61-4d05-8f37-6fa2bff73e66 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/c41c1853-39aa-4675-a421-733d2998310b" status: 404 len: 194 microversion: 2.1 time: 0.036425 Aug 04 16:58:32.178028 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 611/1165] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 16:58:32 2022] DELETE /compute/v2.1/os-security-groups/c41c1853-39aa-4675-a421-733d2998310b => generated 194 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:32.183654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5a958d01-8d83-4db7-8338-f1c7dc14e87f tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '.version_select at 0x7f1e5b523ee0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:32.208421 n-d-851359-3 devstack@n-api.service[131044]: DEBUG neutronclient.v2_0.client [None req-5a958d01-8d83-4db7-8338-f1c7dc14e87f tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4288d613-06a1-4e43-9ecd-9eecec98f958 does not exist", "detail": ""}} {{(pid=131044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:58:32.209080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.security_group_api [None req-5a958d01-8d83-4db7-8338-f1c7dc14e87f tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Neutron security group 4288d613-06a1-4e43-9ecd-9eecec98f958 not found {{(pid=131044) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 16:58:32.209630 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-5a958d01-8d83-4db7-8338-f1c7dc14e87f tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] HTTP exception thrown: Security group 4288d613-06a1-4e43-9ecd-9eecec98f958 does not exist Aug 04 16:58:32.209630 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-957631a1-671a-4be1-a6ef-1b92c6301480'] Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5a958d01-8d83-4db7-8338-f1c7dc14e87f tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Request method failure captured: Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/os-security-groups/4288d613-06a1-4e43-9ecd-9eecec98f958 HTTP/1.1 Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_pjNxGdIj4rXs7GW0_V_LIfBAwJuU8zCy9GzNAxdG5ZTEUBvkg39A9YsV-x75Y0btHlF-rpmXrDhvRCz9GI3Wx5SWU7zVXPxh15depvYj5y_bJWqGesF6D1R4D_MXtZ4ixR6WiUOhX-7Ef4eUOV6pVChDbMDy3f5C8W9ilQQLLYZGk Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 985c6a3e9f43418bb14d9d3fbf8df8d4 Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}] Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 985c6a3e9f43418bb14d9d3fbf8df8d4 Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-SecurityGroupsTestJSON-961611610-project Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: f6232496fbe3458e8a3fde3fdabe9d05 Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-SecurityGroupsTestJSON-961611610-project Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: exception: Security group 4288d613-06a1-4e43-9ecd-9eecec98f958 does not exist Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-957631a1-671a-4be1-a6ef-1b92c6301480'] Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '4288d613-06a1-4e43-9ecd-9eecec98f958'} Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:58:32.211664 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4288d613-06a1-4e43-9ecd-9eecec98f958 does not exist Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-957631a1-671a-4be1-a6ef-1b92c6301480'] Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4288d613-06a1-4e43-9ecd-9eecec98f958 does not exist Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-957631a1-671a-4be1-a6ef-1b92c6301480'] Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4288d613-06a1-4e43-9ecd-9eecec98f958 does not exist Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-957631a1-671a-4be1-a6ef-1b92c6301480'] Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4288d613-06a1-4e43-9ecd-9eecec98f958 does not exist Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-957631a1-671a-4be1-a6ef-1b92c6301480'] Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5a958d01-8d83-4db7-8338-f1c7dc14e87f tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Returning 404 to user: Security group 4288d613-06a1-4e43-9ecd-9eecec98f958 does not exist Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-957631a1-671a-4be1-a6ef-1b92c6301480'] {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5a958d01-8d83-4db7-8338-f1c7dc14e87f tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/4288d613-06a1-4e43-9ecd-9eecec98f958" status: 404 len: 194 microversion: 2.1 time: 0.035295 Aug 04 16:58:32.216276 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 555/1166] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 16:58:32 2022] DELETE /compute/v2.1/os-security-groups/4288d613-06a1-4e43-9ecd-9eecec98f958 => generated 194 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:58:32.228368 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8534ae9a-f7d7-45e5-acba-302f73c167dc tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '.version_select at 0x7f1e5b75e9d0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:32.285231 n-d-851359-3 devstack@n-api.service[131043]: DEBUG neutronclient.v2_0.client [None req-8534ae9a-f7d7-45e5-acba-302f73c167dc tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 366da985-cf59-4390-975c-1756167687a4 does not exist", "detail": ""}} {{(pid=131043) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:58:32.286084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.security_group_api [None req-8534ae9a-f7d7-45e5-acba-302f73c167dc tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Neutron security group 366da985-cf59-4390-975c-1756167687a4 not found {{(pid=131043) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 16:58:32.286751 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-8534ae9a-f7d7-45e5-acba-302f73c167dc tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] HTTP exception thrown: Security group 366da985-cf59-4390-975c-1756167687a4 does not exist Aug 04 16:58:32.286751 n-d-851359-3 devstack@n-api.service[131043]: Neutron server returns request_ids: ['req-5c12cc47-903b-4fe6-8b63-2330bf5a6480'] Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8534ae9a-f7d7-45e5-acba-302f73c167dc tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Request method failure captured: Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/os-security-groups/366da985-cf59-4390-975c-1756167687a4 HTTP/1.1 Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_pjNxGdIj4rXs7GW0_V_LIfBAwJuU8zCy9GzNAxdG5ZTEUBvkg39A9YsV-x75Y0btHlF-rpmXrDhvRCz9GI3Wx5SWU7zVXPxh15depvYj5y_bJWqGesF6D1R4D_MXtZ4ixR6WiUOhX-7Ef4eUOV6pVChDbMDy3f5C8W9ilQQLLYZGk Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 985c6a3e9f43418bb14d9d3fbf8df8d4 Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}] Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 985c6a3e9f43418bb14d9d3fbf8df8d4 Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-SecurityGroupsTestJSON-961611610-project Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: f6232496fbe3458e8a3fde3fdabe9d05 Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-SecurityGroupsTestJSON-961611610-project Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: exception: Security group 366da985-cf59-4390-975c-1756167687a4 does not exist Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: Neutron server returns request_ids: ['req-5c12cc47-903b-4fe6-8b63-2330bf5a6480'] Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '366da985-cf59-4390-975c-1756167687a4'} Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:58:32.289833 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 366da985-cf59-4390-975c-1756167687a4 does not exist Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5c12cc47-903b-4fe6-8b63-2330bf5a6480'] Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 366da985-cf59-4390-975c-1756167687a4 does not exist Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5c12cc47-903b-4fe6-8b63-2330bf5a6480'] Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 366da985-cf59-4390-975c-1756167687a4 does not exist Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5c12cc47-903b-4fe6-8b63-2330bf5a6480'] Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 366da985-cf59-4390-975c-1756167687a4 does not exist Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5c12cc47-903b-4fe6-8b63-2330bf5a6480'] Aug 04 16:58:32.294694 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.300992 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8534ae9a-f7d7-45e5-acba-302f73c167dc tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Returning 404 to user: Security group 366da985-cf59-4390-975c-1756167687a4 does not exist Aug 04 16:58:32.300992 n-d-851359-3 devstack@n-api.service[131043]: Neutron server returns request_ids: ['req-5c12cc47-903b-4fe6-8b63-2330bf5a6480'] {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:32.302425 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8534ae9a-f7d7-45e5-acba-302f73c167dc tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/366da985-cf59-4390-975c-1756167687a4" status: 404 len: 194 microversion: 2.1 time: 0.080416 Aug 04 16:58:32.303221 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 612/1167] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 16:58:32 2022] DELETE /compute/v2.1/os-security-groups/366da985-cf59-4390-975c-1756167687a4 => generated 194 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:32.312297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5d5e3923-6467-4a8e-8bb1-301ec4afa155 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '.version_select at 0x7f1e5bf4c8b0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:32.341096 n-d-851359-3 devstack@n-api.service[131044]: DEBUG neutronclient.v2_0.client [None req-5d5e3923-6467-4a8e-8bb1-301ec4afa155 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 91c75abb-91e3-4f45-9962-77747eb97500 does not exist", "detail": ""}} {{(pid=131044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:58:32.343093 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.security_group_api [None req-5d5e3923-6467-4a8e-8bb1-301ec4afa155 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Neutron security group 91c75abb-91e3-4f45-9962-77747eb97500 not found {{(pid=131044) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 16:58:32.343697 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-5d5e3923-6467-4a8e-8bb1-301ec4afa155 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] HTTP exception thrown: Security group 91c75abb-91e3-4f45-9962-77747eb97500 does not exist Aug 04 16:58:32.343697 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-4829fcba-a065-4098-9021-9d62913b512d'] Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5d5e3923-6467-4a8e-8bb1-301ec4afa155 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Request method failure captured: Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/os-security-groups/91c75abb-91e3-4f45-9962-77747eb97500 HTTP/1.1 Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_pjNxGdIj4rXs7GW0_V_LIfBAwJuU8zCy9GzNAxdG5ZTEUBvkg39A9YsV-x75Y0btHlF-rpmXrDhvRCz9GI3Wx5SWU7zVXPxh15depvYj5y_bJWqGesF6D1R4D_MXtZ4ixR6WiUOhX-7Ef4eUOV6pVChDbMDy3f5C8W9ilQQLLYZGk Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 985c6a3e9f43418bb14d9d3fbf8df8d4 Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}] Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 985c6a3e9f43418bb14d9d3fbf8df8d4 Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-SecurityGroupsTestJSON-961611610-project Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: f6232496fbe3458e8a3fde3fdabe9d05 Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-SecurityGroupsTestJSON-961611610-project Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: exception: Security group 91c75abb-91e3-4f45-9962-77747eb97500 does not exist Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-4829fcba-a065-4098-9021-9d62913b512d'] Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '91c75abb-91e3-4f45-9962-77747eb97500'} Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:58:32.348285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 91c75abb-91e3-4f45-9962-77747eb97500 does not exist Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4829fcba-a065-4098-9021-9d62913b512d'] Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 91c75abb-91e3-4f45-9962-77747eb97500 does not exist Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4829fcba-a065-4098-9021-9d62913b512d'] Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 91c75abb-91e3-4f45-9962-77747eb97500 does not exist Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4829fcba-a065-4098-9021-9d62913b512d'] Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 91c75abb-91e3-4f45-9962-77747eb97500 does not exist Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4829fcba-a065-4098-9021-9d62913b512d'] Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5d5e3923-6467-4a8e-8bb1-301ec4afa155 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Returning 404 to user: Security group 91c75abb-91e3-4f45-9962-77747eb97500 does not exist Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-4829fcba-a065-4098-9021-9d62913b512d'] {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5d5e3923-6467-4a8e-8bb1-301ec4afa155 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/91c75abb-91e3-4f45-9962-77747eb97500" status: 404 len: 194 microversion: 2.1 time: 0.039009 Aug 04 16:58:32.352235 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 556/1168] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 16:58:32 2022] DELETE /compute/v2.1/os-security-groups/91c75abb-91e3-4f45-9962-77747eb97500 => generated 194 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:32.367572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a2f8c161-804d-499e-b458-7ef8156fba77 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '.version_select at 0x7f1e5b6ec430>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:32.396521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG neutronclient.v2_0.client [None req-a2f8c161-804d-499e-b458-7ef8156fba77 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 33a0c34a-492a-441d-8e45-8017f34a74a7 does not exist", "detail": ""}} {{(pid=131043) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:58:32.397290 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.security_group_api [None req-a2f8c161-804d-499e-b458-7ef8156fba77 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Neutron security group 33a0c34a-492a-441d-8e45-8017f34a74a7 not found {{(pid=131043) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 16:58:32.397908 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-a2f8c161-804d-499e-b458-7ef8156fba77 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] HTTP exception thrown: Security group 33a0c34a-492a-441d-8e45-8017f34a74a7 does not exist Aug 04 16:58:32.397908 n-d-851359-3 devstack@n-api.service[131043]: Neutron server returns request_ids: ['req-b30ce308-233f-4ccb-adad-148573683490'] Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a2f8c161-804d-499e-b458-7ef8156fba77 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Request method failure captured: Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/os-security-groups/33a0c34a-492a-441d-8e45-8017f34a74a7 HTTP/1.1 Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_pjNxGdIj4rXs7GW0_V_LIfBAwJuU8zCy9GzNAxdG5ZTEUBvkg39A9YsV-x75Y0btHlF-rpmXrDhvRCz9GI3Wx5SWU7zVXPxh15depvYj5y_bJWqGesF6D1R4D_MXtZ4ixR6WiUOhX-7Ef4eUOV6pVChDbMDy3f5C8W9ilQQLLYZGk Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 985c6a3e9f43418bb14d9d3fbf8df8d4 Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}] Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 985c6a3e9f43418bb14d9d3fbf8df8d4 Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-SecurityGroupsTestJSON-961611610-project Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: f6232496fbe3458e8a3fde3fdabe9d05 Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-SecurityGroupsTestJSON-961611610-project Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: exception: Security group 33a0c34a-492a-441d-8e45-8017f34a74a7 does not exist Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: Neutron server returns request_ids: ['req-b30ce308-233f-4ccb-adad-148573683490'] Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '33a0c34a-492a-441d-8e45-8017f34a74a7'} Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:58:32.400315 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 33a0c34a-492a-441d-8e45-8017f34a74a7 does not exist Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b30ce308-233f-4ccb-adad-148573683490'] Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 33a0c34a-492a-441d-8e45-8017f34a74a7 does not exist Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b30ce308-233f-4ccb-adad-148573683490'] Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 33a0c34a-492a-441d-8e45-8017f34a74a7 does not exist Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b30ce308-233f-4ccb-adad-148573683490'] Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 33a0c34a-492a-441d-8e45-8017f34a74a7 does not exist Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b30ce308-233f-4ccb-adad-148573683490'] Aug 04 16:58:32.405293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:58:32.409093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a2f8c161-804d-499e-b458-7ef8156fba77 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Returning 404 to user: Security group 33a0c34a-492a-441d-8e45-8017f34a74a7 does not exist Aug 04 16:58:32.409093 n-d-851359-3 devstack@n-api.service[131043]: Neutron server returns request_ids: ['req-b30ce308-233f-4ccb-adad-148573683490'] {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:32.410020 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a2f8c161-804d-499e-b458-7ef8156fba77 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/33a0c34a-492a-441d-8e45-8017f34a74a7" status: 404 len: 194 microversion: 2.1 time: 0.047726 Aug 04 16:58:32.411622 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 613/1169] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 16:58:32 2022] DELETE /compute/v2.1/os-security-groups/33a0c34a-492a-441d-8e45-8017f34a74a7 => generated 194 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:32.420005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6f9a74db-c576-4fb8-8172-c268c2e29009 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:32.420868 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6f9a74db-c576-4fb8-8172-c268c2e29009 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:32.427975 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f9a74db-c576-4fb8-8172-c268c2e29009 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:32.428662 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f9a74db-c576-4fb8-8172-c268c2e29009 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:32.429315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f9a74db-c576-4fb8-8172-c268c2e29009 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:32.430207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f9a74db-c576-4fb8-8172-c268c2e29009 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:32.431086 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f9a74db-c576-4fb8-8172-c268c2e29009 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:32.431892 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f9a74db-c576-4fb8-8172-c268c2e29009 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:32.470891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6f9a74db-c576-4fb8-8172-c268c2e29009 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:58:32.546216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-82d8aae4-5a15-4993-9463-eaa065e9a9bb tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:32.547160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-82d8aae4-5a15-4993-9463-eaa065e9a9bb tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:32.554119 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82d8aae4-5a15-4993-9463-eaa065e9a9bb tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:32.554617 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82d8aae4-5a15-4993-9463-eaa065e9a9bb tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:32.555127 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82d8aae4-5a15-4993-9463-eaa065e9a9bb tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:32.555836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82d8aae4-5a15-4993-9463-eaa065e9a9bb tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:32.556299 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82d8aae4-5a15-4993-9463-eaa065e9a9bb tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:32.557243 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82d8aae4-5a15-4993-9463-eaa065e9a9bb tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:32.615412 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6f9a74db-c576-4fb8-8172-c268c2e29009 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "DELETE /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83" status: 204 len: 0 microversion: 2.1 time: 0.197914 Aug 04 16:58:32.617863 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 557/1170] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 16:58:32 2022] DELETE /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 16:58:32.630741 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-adb2651a-28e9-4d69-9824-b28706535052 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:32.631521 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-adb2651a-28e9-4d69-9824-b28706535052 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:32.648006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adb2651a-28e9-4d69-9824-b28706535052 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:32.649008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adb2651a-28e9-4d69-9824-b28706535052 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:32.649469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adb2651a-28e9-4d69-9824-b28706535052 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:32.650254 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adb2651a-28e9-4d69-9824-b28706535052 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:32.653332 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adb2651a-28e9-4d69-9824-b28706535052 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:32.654182 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adb2651a-28e9-4d69-9824-b28706535052 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:33.010249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-82d8aae4-5a15-4993-9463-eaa065e9a9bb tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:33.019069 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-82d8aae4-5a15-4993-9463-eaa065e9a9bb tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1473 microversion: 2.1 time: 0.477992 Aug 04 16:58:33.019639 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 614/1171] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:32 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1473 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:33.047025 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fe1be531-95c8-4d92-b020-8ef52c9c8235 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:33.047668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fe1be531-95c8-4d92-b020-8ef52c9c8235 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:33.054263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fe1be531-95c8-4d92-b020-8ef52c9c8235 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:33.055026 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fe1be531-95c8-4d92-b020-8ef52c9c8235 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:33.055480 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fe1be531-95c8-4d92-b020-8ef52c9c8235 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:33.057273 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fe1be531-95c8-4d92-b020-8ef52c9c8235 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:33.057920 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fe1be531-95c8-4d92-b020-8ef52c9c8235 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:33.058404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fe1be531-95c8-4d92-b020-8ef52c9c8235 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:33.074883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-adb2651a-28e9-4d69-9824-b28706535052 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:33.087181 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-adb2651a-28e9-4d69-9824-b28706535052 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83" status: 200 len: 1646 microversion: 2.1 time: 0.463413 Aug 04 16:58:33.089241 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 558/1172] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:32 2022] GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 => generated 1646 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:33.097942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0fd990b8-398b-47be-836a-5a0fd17cac35 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:33.098598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0fd990b8-398b-47be-836a-5a0fd17cac35 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:33.107135 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fd990b8-398b-47be-836a-5a0fd17cac35 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:33.107642 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fd990b8-398b-47be-836a-5a0fd17cac35 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:33.108095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fd990b8-398b-47be-836a-5a0fd17cac35 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:33.108810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fd990b8-398b-47be-836a-5a0fd17cac35 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:33.109330 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fd990b8-398b-47be-836a-5a0fd17cac35 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:33.109736 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fd990b8-398b-47be-836a-5a0fd17cac35 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:33.392832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fe1be531-95c8-4d92-b020-8ef52c9c8235 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:33.397625 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0fd990b8-398b-47be-836a-5a0fd17cac35 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:33.405021 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fe1be531-95c8-4d92-b020-8ef52c9c8235 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:33.406559 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0fd990b8-398b-47be-836a-5a0fd17cac35 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1542 microversion: 2.1 time: 0.315906 Aug 04 16:58:33.412785 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fe1be531-95c8-4d92-b020-8ef52c9c8235 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:33.414671 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fe1be531-95c8-4d92-b020-8ef52c9c8235 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 200 len: 1567 microversion: 2.25 time: 0.373506 Aug 04 16:58:33.418690 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 559/1173] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:33 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1542 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:33.427512 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 615/1174] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:33 2022] GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 1567 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:58:34.042202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-09ff9f5e-d7e4-484e-940d-d28b0c7dc9ce tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:34.043079 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-09ff9f5e-d7e4-484e-940d-d28b0c7dc9ce tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:34.050186 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09ff9f5e-d7e4-484e-940d-d28b0c7dc9ce tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:34.050986 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09ff9f5e-d7e4-484e-940d-d28b0c7dc9ce tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:34.051597 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09ff9f5e-d7e4-484e-940d-d28b0c7dc9ce tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:34.052479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09ff9f5e-d7e4-484e-940d-d28b0c7dc9ce tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:34.052937 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09ff9f5e-d7e4-484e-940d-d28b0c7dc9ce tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:34.053355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09ff9f5e-d7e4-484e-940d-d28b0c7dc9ce tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:34.112991 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3332098f-5b9e-4de1-b702-88fe9cfa5255 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:34.113614 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3332098f-5b9e-4de1-b702-88fe9cfa5255 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:34.125872 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3332098f-5b9e-4de1-b702-88fe9cfa5255 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:34.126421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3332098f-5b9e-4de1-b702-88fe9cfa5255 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:34.126871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3332098f-5b9e-4de1-b702-88fe9cfa5255 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:34.127602 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3332098f-5b9e-4de1-b702-88fe9cfa5255 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:34.128064 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3332098f-5b9e-4de1-b702-88fe9cfa5255 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:34.128496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3332098f-5b9e-4de1-b702-88fe9cfa5255 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:34.531945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-09ff9f5e-d7e4-484e-940d-d28b0c7dc9ce tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:34.551708 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-09ff9f5e-d7e4-484e-940d-d28b0c7dc9ce tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1473 microversion: 2.1 time: 0.512373 Aug 04 16:58:34.562096 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 560/1175] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:34 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1473 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:34.579804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-645e1b53-e3b7-4e10-ae48-c80f055926c7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:34.580458 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-645e1b53-e3b7-4e10-ae48-c80f055926c7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:34.612013 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-645e1b53-e3b7-4e10-ae48-c80f055926c7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:34.612467 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-645e1b53-e3b7-4e10-ae48-c80f055926c7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:34.612918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-645e1b53-e3b7-4e10-ae48-c80f055926c7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:34.613647 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-645e1b53-e3b7-4e10-ae48-c80f055926c7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:34.614277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-645e1b53-e3b7-4e10-ae48-c80f055926c7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:34.614586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-645e1b53-e3b7-4e10-ae48-c80f055926c7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:34.663398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3332098f-5b9e-4de1-b702-88fe9cfa5255 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:34.683731 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3332098f-5b9e-4de1-b702-88fe9cfa5255 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83" status: 200 len: 1646 microversion: 2.1 time: 0.572313 Aug 04 16:58:34.684368 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 616/1176] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:34 2022] GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 => generated 1646 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:58:34.709131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e7931c7f-86bd-45bf-92a5-224dab5a92f8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:34.714681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e7931c7f-86bd-45bf-92a5-224dab5a92f8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:34.747918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7931c7f-86bd-45bf-92a5-224dab5a92f8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:34.748434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7931c7f-86bd-45bf-92a5-224dab5a92f8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:34.757104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7931c7f-86bd-45bf-92a5-224dab5a92f8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:34.761073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7931c7f-86bd-45bf-92a5-224dab5a92f8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:34.761581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7931c7f-86bd-45bf-92a5-224dab5a92f8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:34.769706 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7931c7f-86bd-45bf-92a5-224dab5a92f8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:35.117316 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-645e1b53-e3b7-4e10-ae48-c80f055926c7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:35.131891 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-645e1b53-e3b7-4e10-ae48-c80f055926c7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1542 microversion: 2.1 time: 0.574943 Aug 04 16:58:35.132510 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 561/1177] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:34 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1542 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:35.201516 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e7931c7f-86bd-45bf-92a5-224dab5a92f8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:35.214012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e7931c7f-86bd-45bf-92a5-224dab5a92f8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:35.216525 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e7931c7f-86bd-45bf-92a5-224dab5a92f8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:35.219370 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e7931c7f-86bd-45bf-92a5-224dab5a92f8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 200 len: 1567 microversion: 2.25 time: 0.519887 Aug 04 16:58:35.221770 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 617/1178] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:34 2022] GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 1567 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:35.579105 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cc9e53c7-8ffb-4acf-b1b2-8731d05b71cf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:35.580603 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cc9e53c7-8ffb-4acf-b1b2-8731d05b71cf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:35.588928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc9e53c7-8ffb-4acf-b1b2-8731d05b71cf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:35.591358 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc9e53c7-8ffb-4acf-b1b2-8731d05b71cf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:35.592341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc9e53c7-8ffb-4acf-b1b2-8731d05b71cf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:35.593432 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc9e53c7-8ffb-4acf-b1b2-8731d05b71cf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:35.595030 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc9e53c7-8ffb-4acf-b1b2-8731d05b71cf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:35.596222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc9e53c7-8ffb-4acf-b1b2-8731d05b71cf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:35.707664 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d20294f2-90cc-498d-9cc4-f720882e2b2b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:35.708504 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d20294f2-90cc-498d-9cc4-f720882e2b2b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:35.726554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d20294f2-90cc-498d-9cc4-f720882e2b2b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:35.727835 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d20294f2-90cc-498d-9cc4-f720882e2b2b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:35.728583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d20294f2-90cc-498d-9cc4-f720882e2b2b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:35.730708 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d20294f2-90cc-498d-9cc4-f720882e2b2b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:35.735882 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d20294f2-90cc-498d-9cc4-f720882e2b2b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:35.737806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d20294f2-90cc-498d-9cc4-f720882e2b2b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:35.896442 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cc9e53c7-8ffb-4acf-b1b2-8731d05b71cf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:35.916361 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cc9e53c7-8ffb-4acf-b1b2-8731d05b71cf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1473 microversion: 2.1 time: 0.343936 Aug 04 16:58:35.918148 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 562/1179] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:35 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1473 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:36.060528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d20294f2-90cc-498d-9cc4-f720882e2b2b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:36.069780 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d20294f2-90cc-498d-9cc4-f720882e2b2b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83" status: 200 len: 1646 microversion: 2.1 time: 0.368385 Aug 04 16:58:36.070426 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 618/1180] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:35 2022] GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 => generated 1646 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:36.164051 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-131f6eff-bf58-4312-8d1a-d801ebe32111 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:36.164923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-131f6eff-bf58-4312-8d1a-d801ebe32111 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:36.183120 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-131f6eff-bf58-4312-8d1a-d801ebe32111 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:36.183625 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-131f6eff-bf58-4312-8d1a-d801ebe32111 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:36.184228 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-131f6eff-bf58-4312-8d1a-d801ebe32111 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:36.184951 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-131f6eff-bf58-4312-8d1a-d801ebe32111 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:36.185421 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-131f6eff-bf58-4312-8d1a-d801ebe32111 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:36.185850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-131f6eff-bf58-4312-8d1a-d801ebe32111 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:36.244172 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-88b28c1c-22a1-49c7-b6f0-0802a80ebf7c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:36.244838 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-88b28c1c-22a1-49c7-b6f0-0802a80ebf7c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:36.252307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88b28c1c-22a1-49c7-b6f0-0802a80ebf7c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:36.252814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88b28c1c-22a1-49c7-b6f0-0802a80ebf7c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:36.253368 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88b28c1c-22a1-49c7-b6f0-0802a80ebf7c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:36.254384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88b28c1c-22a1-49c7-b6f0-0802a80ebf7c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:36.254874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88b28c1c-22a1-49c7-b6f0-0802a80ebf7c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:36.255319 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88b28c1c-22a1-49c7-b6f0-0802a80ebf7c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:36.450870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-131f6eff-bf58-4312-8d1a-d801ebe32111 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:36.462687 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-131f6eff-bf58-4312-8d1a-d801ebe32111 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1542 microversion: 2.1 time: 0.307518 Aug 04 16:58:36.477856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-88b28c1c-22a1-49c7-b6f0-0802a80ebf7c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:36.478970 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 563/1181] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:36 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1542 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:36.480316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-88b28c1c-22a1-49c7-b6f0-0802a80ebf7c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:36.481853 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-88b28c1c-22a1-49c7-b6f0-0802a80ebf7c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:36.483162 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-88b28c1c-22a1-49c7-b6f0-0802a80ebf7c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 200 len: 1567 microversion: 2.25 time: 0.243098 Aug 04 16:58:36.483770 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 619/1182] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:36 2022] GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 1567 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:36.893222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-255f93fa-9e55-4292-aab0-8cb08ea2f097 req-1ae657d9-2ba9-4c8e-9dd4-1006c5f7d35a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c8b06b6-59a1-4595-b2ee-539a4c9dbc83", "name": "network-vif-deleted", "tag": "2f81e029-164b-4fbb-9431-2ee5454d602d"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:36.908022 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-255f93fa-9e55-4292-aab0-8cb08ea2f097 req-1ae657d9-2ba9-4c8e-9dd4-1006c5f7d35a service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:36.909697 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-255f93fa-9e55-4292-aab0-8cb08ea2f097 req-1ae657d9-2ba9-4c8e-9dd4-1006c5f7d35a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:36.910479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-255f93fa-9e55-4292-aab0-8cb08ea2f097 req-1ae657d9-2ba9-4c8e-9dd4-1006c5f7d35a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:36.941933 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c5d9343e-2127-4026-8597-eddcf4aa7a36 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:36.943396 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c5d9343e-2127-4026-8597-eddcf4aa7a36 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:36.952405 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-255f93fa-9e55-4292-aab0-8cb08ea2f097 req-1ae657d9-2ba9-4c8e-9dd4-1006c5f7d35a service nova] Creating event network-vif-deleted:2f81e029-164b-4fbb-9431-2ee5454d602d for instance 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 on n-h1-851359-3 Aug 04 16:58:36.957837 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c5d9343e-2127-4026-8597-eddcf4aa7a36 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:36.960762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c5d9343e-2127-4026-8597-eddcf4aa7a36 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:36.961592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c5d9343e-2127-4026-8597-eddcf4aa7a36 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:36.962636 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c5d9343e-2127-4026-8597-eddcf4aa7a36 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:36.965797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c5d9343e-2127-4026-8597-eddcf4aa7a36 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:36.968641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c5d9343e-2127-4026-8597-eddcf4aa7a36 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:36.971574 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-255f93fa-9e55-4292-aab0-8cb08ea2f097 req-1ae657d9-2ba9-4c8e-9dd4-1006c5f7d35a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088369 Aug 04 16:58:36.976749 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 564/1183] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:37.096512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-27eaed66-8c0f-44b0-88e9-2173d2dd1098 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:37.097763 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-27eaed66-8c0f-44b0-88e9-2173d2dd1098 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:37.107079 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27eaed66-8c0f-44b0-88e9-2173d2dd1098 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:37.107764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27eaed66-8c0f-44b0-88e9-2173d2dd1098 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:37.108359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27eaed66-8c0f-44b0-88e9-2173d2dd1098 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:37.109319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27eaed66-8c0f-44b0-88e9-2173d2dd1098 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:37.110044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27eaed66-8c0f-44b0-88e9-2173d2dd1098 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:37.110686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27eaed66-8c0f-44b0-88e9-2173d2dd1098 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:37.171695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27eaed66-8c0f-44b0-88e9-2173d2dd1098 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:37.172243 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27eaed66-8c0f-44b0-88e9-2173d2dd1098 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:37.172959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27eaed66-8c0f-44b0-88e9-2173d2dd1098 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:37.173644 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-27eaed66-8c0f-44b0-88e9-2173d2dd1098 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lazy-loading 'fault' on Instance uuid 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:58:37.190999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c5d9343e-2127-4026-8597-eddcf4aa7a36 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:37.200903 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c5d9343e-2127-4026-8597-eddcf4aa7a36 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1473 microversion: 2.1 time: 0.265115 Aug 04 16:58:37.202354 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 620/1184] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:36 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1473 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:37.236691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-27eaed66-8c0f-44b0-88e9-2173d2dd1098 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6232496fbe3458e8a3fde3fdabe9d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985c6a3e9f43418bb14d9d3fbf8df8d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:37.252072 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-27eaed66-8c0f-44b0-88e9-2173d2dd1098 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83" status: 200 len: 1306 microversion: 2.1 time: 0.162666 Aug 04 16:58:37.256461 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 565/1185] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:37 2022] GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 => generated 1306 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:37.486642 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-800aa3a3-daea-4e61-a8a5-7859f483556a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:37.487324 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-800aa3a3-daea-4e61-a8a5-7859f483556a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:37.495568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-800aa3a3-daea-4e61-a8a5-7859f483556a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:37.496555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-800aa3a3-daea-4e61-a8a5-7859f483556a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:37.497205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-800aa3a3-daea-4e61-a8a5-7859f483556a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:37.498201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-800aa3a3-daea-4e61-a8a5-7859f483556a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:37.498855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-800aa3a3-daea-4e61-a8a5-7859f483556a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:37.499495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-800aa3a3-daea-4e61-a8a5-7859f483556a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:37.506518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ab1e932f-ace8-42dd-9ee9-6c0bc855bae4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:37.507840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ab1e932f-ace8-42dd-9ee9-6c0bc855bae4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:37.520206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab1e932f-ace8-42dd-9ee9-6c0bc855bae4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:37.536362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab1e932f-ace8-42dd-9ee9-6c0bc855bae4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:37.539456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab1e932f-ace8-42dd-9ee9-6c0bc855bae4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:37.540273 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab1e932f-ace8-42dd-9ee9-6c0bc855bae4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:37.540763 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab1e932f-ace8-42dd-9ee9-6c0bc855bae4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:37.541205 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab1e932f-ace8-42dd-9ee9-6c0bc855bae4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:37.959144 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-800aa3a3-daea-4e61-a8a5-7859f483556a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:37.961736 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ab1e932f-ace8-42dd-9ee9-6c0bc855bae4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:37.971712 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ab1e932f-ace8-42dd-9ee9-6c0bc855bae4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:37.972858 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-800aa3a3-daea-4e61-a8a5-7859f483556a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1542 microversion: 2.1 time: 0.490556 Aug 04 16:58:37.974197 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 621/1186] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:37 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1542 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:37.978279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ab1e932f-ace8-42dd-9ee9-6c0bc855bae4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:37.981150 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ab1e932f-ace8-42dd-9ee9-6c0bc855bae4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 200 len: 1567 microversion: 2.25 time: 0.479423 Aug 04 16:58:37.982364 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 566/1187] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:37 2022] GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 1567 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:38.222765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7459a93c-bd4e-4517-9820-1181af5ce6c3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:38.223402 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7459a93c-bd4e-4517-9820-1181af5ce6c3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:38.232967 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7459a93c-bd4e-4517-9820-1181af5ce6c3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:38.233476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7459a93c-bd4e-4517-9820-1181af5ce6c3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:38.234204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7459a93c-bd4e-4517-9820-1181af5ce6c3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:38.235328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7459a93c-bd4e-4517-9820-1181af5ce6c3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:38.235955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7459a93c-bd4e-4517-9820-1181af5ce6c3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:38.236436 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7459a93c-bd4e-4517-9820-1181af5ce6c3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:38.277557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d028d3e6-3559-4d5c-aaf2-8a6c18274a28 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:38.279071 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d028d3e6-3559-4d5c-aaf2-8a6c18274a28 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] [instance: 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:38.293085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d028d3e6-3559-4d5c-aaf2-8a6c18274a28 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:38.293806 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d028d3e6-3559-4d5c-aaf2-8a6c18274a28 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:38.294516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d028d3e6-3559-4d5c-aaf2-8a6c18274a28 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:38.295516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d028d3e6-3559-4d5c-aaf2-8a6c18274a28 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:38.296684 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d028d3e6-3559-4d5c-aaf2-8a6c18274a28 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:38.297295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d028d3e6-3559-4d5c-aaf2-8a6c18274a28 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:38.316007 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-d028d3e6-3559-4d5c-aaf2-8a6c18274a28 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] HTTP exception thrown: Instance 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 could not be found. Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d028d3e6-3559-4d5c-aaf2-8a6c18274a28 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Request method failure captured: Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 HTTP/1.1 Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_pjNxGdIj4rXs7GW0_V_LIfBAwJuU8zCy9GzNAxdG5ZTEUBvkg39A9YsV-x75Y0btHlF-rpmXrDhvRCz9GI3Wx5SWU7zVXPxh15depvYj5y_bJWqGesF6D1R4D_MXtZ4ixR6WiUOhX-7Ef4eUOV6pVChDbMDy3f5C8W9ilQQLLYZGk Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 985c6a3e9f43418bb14d9d3fbf8df8d4 Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_985c6a3e9f43418bb14d9d3fbf8df8d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/985c6a3e9f43418bb14d9d3fbf8df8d4"}]}] Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 985c6a3e9f43418bb14d9d3fbf8df8d4 Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-961611610 Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-SecurityGroupsTestJSON-961611610-project Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: f6232496fbe3458e8a3fde3fdabe9d05 Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-SecurityGroupsTestJSON-961611610-project Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 could not be found. Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '1c8b06b6-59a1-4595-b2ee-539a4c9dbc83'} Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 could not be found. Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 could not be found. Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:58:38.318468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:38.323570 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:58:38.323570 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:58:38.323570 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:58:38.323570 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:58:38.323570 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:58:38.323570 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 could not be found. Aug 04 16:58:38.323570 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:58:38.324845 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d028d3e6-3559-4d5c-aaf2-8a6c18274a28 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Returning 404 to user: Instance 1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:58:38.325867 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d028d3e6-3559-4d5c-aaf2-8a6c18274a28 tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83" status: 404 len: 111 microversion: 2.1 time: 0.053026 Aug 04 16:58:38.327396 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 567/1188] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:38 2022] GET /compute/v2.1/servers/1c8b06b6-59a1-4595-b2ee-539a4c9dbc83 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:58:38.336414 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5b70af8b-2f85-43b6-90f2-038bbb73f51c tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '.version_select at 0x7f1e5b4a3820>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:38.459870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7459a93c-bd4e-4517-9820-1181af5ce6c3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:38.469124 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7459a93c-bd4e-4517-9820-1181af5ce6c3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1473 microversion: 2.1 time: 0.250270 Aug 04 16:58:38.482774 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 622/1189] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:38 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1473 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:38.622244 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5b70af8b-2f85-43b6-90f2-038bbb73f51c tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/35085835-96f1-4cad-a6b5-b8151a18d781" status: 202 len: 0 microversion: 2.1 time: 0.290235 Aug 04 16:58:38.623270 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 568/1190] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 16:58:38 2022] DELETE /compute/v2.1/os-security-groups/35085835-96f1-4cad-a6b5-b8151a18d781 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:58:38.637250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-475e68c2-583b-4e82-b170-4fde3decf96b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] Calling method '.version_select at 0x7f1e5b7ccaf0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:39.001267 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-475e68c2-583b-4e82-b170-4fde3decf96b tempest-SecurityGroupsTestJSON-961611610 tempest-SecurityGroupsTestJSON-961611610-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/d0b42bf3-4317-4dd0-9c50-b8690f55341b" status: 202 len: 0 microversion: 2.1 time: 0.372489 Aug 04 16:58:39.002748 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 623/1191] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 16:58:38 2022] DELETE /compute/v2.1/os-security-groups/d0b42bf3-4317-4dd0-9c50-b8690f55341b => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:58:39.003587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0eeb5d62-cc88-4601-a8a6-e70d844ae8e1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:39.004396 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0eeb5d62-cc88-4601-a8a6-e70d844ae8e1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:39.011606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-68924acc-b4ea-4244-98b9-ed7bbe7a7bf3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:39.013725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-68924acc-b4ea-4244-98b9-ed7bbe7a7bf3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:39.024250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0eeb5d62-cc88-4601-a8a6-e70d844ae8e1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:39.028827 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0eeb5d62-cc88-4601-a8a6-e70d844ae8e1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:39.031007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-68924acc-b4ea-4244-98b9-ed7bbe7a7bf3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:39.031269 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0eeb5d62-cc88-4601-a8a6-e70d844ae8e1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:39.033359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0eeb5d62-cc88-4601-a8a6-e70d844ae8e1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:39.035058 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0eeb5d62-cc88-4601-a8a6-e70d844ae8e1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:39.035427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-68924acc-b4ea-4244-98b9-ed7bbe7a7bf3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:39.036295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0eeb5d62-cc88-4601-a8a6-e70d844ae8e1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:39.037194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-68924acc-b4ea-4244-98b9-ed7bbe7a7bf3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:39.038713 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-68924acc-b4ea-4244-98b9-ed7bbe7a7bf3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:39.040920 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-68924acc-b4ea-4244-98b9-ed7bbe7a7bf3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:39.043391 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-68924acc-b4ea-4244-98b9-ed7bbe7a7bf3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:39.111220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:39.445394 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0eeb5d62-cc88-4601-a8a6-e70d844ae8e1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:39.459310 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0eeb5d62-cc88-4601-a8a6-e70d844ae8e1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1542 microversion: 2.1 time: 0.466486 Aug 04 16:58:39.460455 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 569/1192] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:38 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1542 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:39.481777 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-68924acc-b4ea-4244-98b9-ed7bbe7a7bf3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:39.496108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-68924acc-b4ea-4244-98b9-ed7bbe7a7bf3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:39.501717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-68924acc-b4ea-4244-98b9-ed7bbe7a7bf3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:39.503816 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-68924acc-b4ea-4244-98b9-ed7bbe7a7bf3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 200 len: 1567 microversion: 2.25 time: 0.497115 Aug 04 16:58:39.504395 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 624/1193] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:39 2022] GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 1567 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:58:39.537212 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-42ca5ee8-a3ce-4f74-8acc-c11f6c47bd06 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:39.539024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-42ca5ee8-a3ce-4f74-8acc-c11f6c47bd06 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:39.553739 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42ca5ee8-a3ce-4f74-8acc-c11f6c47bd06 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:39.557401 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42ca5ee8-a3ce-4f74-8acc-c11f6c47bd06 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:39.561178 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42ca5ee8-a3ce-4f74-8acc-c11f6c47bd06 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:39.562658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42ca5ee8-a3ce-4f74-8acc-c11f6c47bd06 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:39.564652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42ca5ee8-a3ce-4f74-8acc-c11f6c47bd06 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:39.565932 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42ca5ee8-a3ce-4f74-8acc-c11f6c47bd06 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:39.829126 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-42ca5ee8-a3ce-4f74-8acc-c11f6c47bd06 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:39.832034 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-913a7a14-6377-4332-9774-97013a0f46d6 tempest-FlavorsExtraSpecsTestJSON-749510533 tempest-FlavorsExtraSpecsTestJSON-749510533-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1365031055", "ram": 512, "vcpus": 1, "disk": 10, "id": 2061181200, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:39.836275 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:58:39.836275 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:58:39.841564 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-42ca5ee8-a3ce-4f74-8acc-c11f6c47bd06 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1473 microversion: 2.1 time: 0.320227 Aug 04 16:58:39.843830 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 625/1194] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:39 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1473 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:39.875155 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-913a7a14-6377-4332-9774-97013a0f46d6 tempest-FlavorsExtraSpecsTestJSON-749510533 tempest-FlavorsExtraSpecsTestJSON-749510533-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.413393 Aug 04 16:58:39.876594 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 570/1195] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:58:39 2022] POST /compute/v2.1/flavors => generated 416 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:39.890187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-987449c8-292b-48af-93d4-1b46a2945edd tempest-FlavorsExtraSpecsTestJSON-749510533 tempest-FlavorsExtraSpecsTestJSON-749510533-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:39.895046 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:58:39.895046 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:58:39.927746 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-987449c8-292b-48af-93d4-1b46a2945edd tempest-FlavorsExtraSpecsTestJSON-749510533 tempest-FlavorsExtraSpecsTestJSON-749510533-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/2061181200/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.041889 Aug 04 16:58:39.929526 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 626/1196] 10.222.0.93 () {60 vars in 1224 bytes} [Thu Aug 4 16:58:39 2022] POST /compute/v2.1/flavors/2061181200/os-extra_specs => generated 66 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:58:40.241719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b570120d-1d37-46b3-a38b-1159fcb6e0ef tempest-FlavorsExtraSpecsTestJSON-755178221 tempest-FlavorsExtraSpecsTestJSON-755178221-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:40.261516 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b570120d-1d37-46b3-a38b-1159fcb6e0ef tempest-FlavorsExtraSpecsTestJSON-755178221 tempest-FlavorsExtraSpecsTestJSON-755178221-project] 10.222.0.93 "GET /compute/v2.1/flavors/2061181200/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.325165 Aug 04 16:58:40.262137 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 571/1197] 10.222.0.93 () {58 vars in 1203 bytes} [Thu Aug 4 16:58:39 2022] GET /compute/v2.1/flavors/2061181200/os-extra_specs => generated 66 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:58:40.272963 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fafdcb94-318a-42c9-9bf4-695e5bc735cf tempest-FlavorsExtraSpecsTestJSON-749510533 tempest-FlavorsExtraSpecsTestJSON-749510533-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:40.323495 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fafdcb94-318a-42c9-9bf4-695e5bc735cf tempest-FlavorsExtraSpecsTestJSON-749510533 tempest-FlavorsExtraSpecsTestJSON-749510533-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/2061181200/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.054278 Aug 04 16:58:40.330615 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 627/1198] 10.222.0.93 () {60 vars in 1224 bytes} [Thu Aug 4 16:58:40 2022] POST /compute/v2.1/flavors/2061181200/os-extra_specs => generated 66 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:58:40.336533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5d353571-48a5-44d1-b62b-c3334e4c67d7 tempest-FlavorsExtraSpecsTestJSON-755178221 tempest-FlavorsExtraSpecsTestJSON-755178221-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:40.350508 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5d353571-48a5-44d1-b62b-c3334e4c67d7 tempest-FlavorsExtraSpecsTestJSON-755178221 tempest-FlavorsExtraSpecsTestJSON-755178221-project] 10.222.0.93 "GET /compute/v2.1/flavors/2061181200/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.017959 Aug 04 16:58:40.359433 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 572/1199] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Aug 4 16:58:40 2022] GET /compute/v2.1/flavors/2061181200/os-extra_specs/hw:numa_nodes => generated 22 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:58:40.366015 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e9bd3072-060a-44dd-82a5-01170acbfd58 tempest-FlavorsExtraSpecsTestJSON-749510533 tempest-FlavorsExtraSpecsTestJSON-749510533-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:40.432848 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e9bd3072-060a-44dd-82a5-01170acbfd58 tempest-FlavorsExtraSpecsTestJSON-749510533 tempest-FlavorsExtraSpecsTestJSON-749510533-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors/2061181200/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.070008 Aug 04 16:58:40.438544 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 628/1200] 10.222.0.93 () {60 vars in 1224 bytes} [Thu Aug 4 16:58:40 2022] POST /compute/v2.1/flavors/2061181200/os-extra_specs => generated 66 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:58:40.448487 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-11b650b3-0032-4a26-b043-4c7ba6f5b132 tempest-FlavorsExtraSpecsTestJSON-749510533 tempest-FlavorsExtraSpecsTestJSON-749510533-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:40.483910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d8734811-6542-4005-9a58-6f4b6ab020f7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:40.485094 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d8734811-6542-4005-9a58-6f4b6ab020f7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:40.491656 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-11b650b3-0032-4a26-b043-4c7ba6f5b132 tempest-FlavorsExtraSpecsTestJSON-749510533 tempest-FlavorsExtraSpecsTestJSON-749510533-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/2061181200/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.050939 Aug 04 16:58:40.496249 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 573/1201] 10.222.0.93 () {58 vars in 1203 bytes} [Thu Aug 4 16:58:40 2022] GET /compute/v2.1/flavors/2061181200/os-extra_specs => generated 66 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:58:40.504161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2bc0c873-f349-460f-bbd4-dadffdc826e7 tempest-FlavorsExtraSpecsTestJSON-749510533 tempest-FlavorsExtraSpecsTestJSON-749510533-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:40.507569 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:58:40.507569 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:58:40.512749 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8734811-6542-4005-9a58-6f4b6ab020f7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:40.518923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8734811-6542-4005-9a58-6f4b6ab020f7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:40.519705 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8734811-6542-4005-9a58-6f4b6ab020f7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:40.525021 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8734811-6542-4005-9a58-6f4b6ab020f7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:40.526404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8734811-6542-4005-9a58-6f4b6ab020f7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:40.527941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8734811-6542-4005-9a58-6f4b6ab020f7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:40.564171 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2bc0c873-f349-460f-bbd4-dadffdc826e7 tempest-FlavorsExtraSpecsTestJSON-749510533 tempest-FlavorsExtraSpecsTestJSON-749510533-project-admin] 10.222.0.93 "PUT /compute/v2.1/flavors/2061181200/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.064377 Aug 04 16:58:40.573283 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 574/1202] 10.222.0.93 () {60 vars in 1265 bytes} [Thu Aug 4 16:58:40 2022] PUT /compute/v2.1/flavors/2061181200/os-extra_specs/hw:numa_nodes => generated 22 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 16:58:40.583658 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d9c28f6a-36fe-4b4e-ab7b-337be1578bb0 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:40.587699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d9c28f6a-36fe-4b4e-ab7b-337be1578bb0 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:40.604576 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9c28f6a-36fe-4b4e-ab7b-337be1578bb0 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:40.605369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9c28f6a-36fe-4b4e-ab7b-337be1578bb0 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:40.606185 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9c28f6a-36fe-4b4e-ab7b-337be1578bb0 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:40.607067 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9c28f6a-36fe-4b4e-ab7b-337be1578bb0 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:40.608377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9c28f6a-36fe-4b4e-ab7b-337be1578bb0 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:40.609787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9c28f6a-36fe-4b4e-ab7b-337be1578bb0 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:40.625441 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:40.972116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d8734811-6542-4005-9a58-6f4b6ab020f7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:40.990698 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d8734811-6542-4005-9a58-6f4b6ab020f7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1542 microversion: 2.1 time: 0.513305 Aug 04 16:58:40.993050 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 629/1203] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:40 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1542 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:41.028854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d9c28f6a-36fe-4b4e-ab7b-337be1578bb0 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:41.043956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d9c28f6a-36fe-4b4e-ab7b-337be1578bb0 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:41.045965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d9c28f6a-36fe-4b4e-ab7b-337be1578bb0 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:41.046442 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9298757d-4d3a-4f78-802c-51c7634ccb09 tempest-FlavorsExtraSpecsTestJSON-749510533 tempest-FlavorsExtraSpecsTestJSON-749510533-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:41.049362 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d9c28f6a-36fe-4b4e-ab7b-337be1578bb0 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 200 len: 1542 microversion: 2.25 time: 0.474705 Aug 04 16:58:41.053003 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 575/1204] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:40 2022] GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 1542 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:41.058729 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-766b6b95-3d07-4d62-b3ee-586fb1fbb29e tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:41.059569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-766b6b95-3d07-4d62-b3ee-586fb1fbb29e tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:41.069368 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9298757d-4d3a-4f78-802c-51c7634ccb09 tempest-FlavorsExtraSpecsTestJSON-749510533 tempest-FlavorsExtraSpecsTestJSON-749510533-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/2061181200/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.074950 Aug 04 16:58:41.075543 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-766b6b95-3d07-4d62-b3ee-586fb1fbb29e tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:41.076049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-766b6b95-3d07-4d62-b3ee-586fb1fbb29e tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:41.078758 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-766b6b95-3d07-4d62-b3ee-586fb1fbb29e tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:41.081267 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-766b6b95-3d07-4d62-b3ee-586fb1fbb29e tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:41.081865 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-766b6b95-3d07-4d62-b3ee-586fb1fbb29e tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:41.082331 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 630/1205] 10.222.0.93 () {58 vars in 1203 bytes} [Thu Aug 4 16:58:40 2022] GET /compute/v2.1/flavors/2061181200/os-extra_specs => generated 66 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:58:41.082468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-766b6b95-3d07-4d62-b3ee-586fb1fbb29e tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:41.100878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ffdcad31-c0cf-496c-a1b3-c4e69646638c tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Calling method '.version_select at 0x7f1e5b7e9790>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:41.106541 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ffdcad31-c0cf-496c-a1b3-c4e69646638c tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:41.107288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ffdcad31-c0cf-496c-a1b3-c4e69646638c tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:41.108025 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ffdcad31-c0cf-496c-a1b3-c4e69646638c tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:41.125340 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ffdcad31-c0cf-496c-a1b3-c4e69646638c tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] 10.222.0.93 "GET /compute/v2.1/os-migrations" status: 200 len: 3206 microversion: 2.25 time: 0.039824 Aug 04 16:58:41.128131 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 631/1206] 10.222.0.93 () {60 vars in 1184 bytes} [Thu Aug 4 16:58:41 2022] GET /compute/v2.1/os-migrations => generated 3206 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:41.143125 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d040b403-6cc9-4647-8580-a700aa57e1ee tempest-FlavorsExtraSpecsTestJSON-749510533 tempest-FlavorsExtraSpecsTestJSON-749510533-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:41.147035 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:58:41.147035 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:58:41.223977 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d040b403-6cc9-4647-8580-a700aa57e1ee tempest-FlavorsExtraSpecsTestJSON-749510533 tempest-FlavorsExtraSpecsTestJSON-749510533-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/2061181200/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.091095 Aug 04 16:58:41.227577 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 632/1207] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Aug 4 16:58:41 2022] DELETE /compute/v2.1/flavors/2061181200/os-extra_specs/hw:numa_nodes => generated 0 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 16:58:41.236820 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f153df5f-2c10-405b-bd6e-d07adde35121 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:41.237442 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f153df5f-2c10-405b-bd6e-d07adde35121 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:41.255369 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f153df5f-2c10-405b-bd6e-d07adde35121 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:41.255867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f153df5f-2c10-405b-bd6e-d07adde35121 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:41.256306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f153df5f-2c10-405b-bd6e-d07adde35121 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:41.257005 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f153df5f-2c10-405b-bd6e-d07adde35121 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:41.264425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f153df5f-2c10-405b-bd6e-d07adde35121 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:41.267646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f153df5f-2c10-405b-bd6e-d07adde35121 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:41.319087 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-766b6b95-3d07-4d62-b3ee-586fb1fbb29e tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:41.330787 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-766b6b95-3d07-4d62-b3ee-586fb1fbb29e tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1473 microversion: 2.1 time: 0.276199 Aug 04 16:58:41.331745 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 576/1208] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:41 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1473 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:41.342604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4b909720-d585-4eca-968b-3dbbce77938f tempest-FlavorsExtraSpecsTestJSON-749510533 tempest-FlavorsExtraSpecsTestJSON-749510533-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:41.345536 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:58:41.345536 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:58:41.399029 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4b909720-d585-4eca-968b-3dbbce77938f tempest-FlavorsExtraSpecsTestJSON-749510533 tempest-FlavorsExtraSpecsTestJSON-749510533-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/2061181200/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.065459 Aug 04 16:58:41.407100 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 577/1209] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Aug 4 16:58:41 2022] DELETE /compute/v2.1/flavors/2061181200/os-extra_specs/hw:cpu_policy => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 16:58:41.436315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-564c2454-0cc5-4061-81f0-d5cea7f488b0 tempest-FlavorsExtraSpecsTestJSON-749510533 tempest-FlavorsExtraSpecsTestJSON-749510533-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:41.475470 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-564c2454-0cc5-4061-81f0-d5cea7f488b0 tempest-FlavorsExtraSpecsTestJSON-749510533 tempest-FlavorsExtraSpecsTestJSON-749510533-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/2061181200/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.064569 Aug 04 16:58:41.477235 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 578/1210] 10.222.0.93 () {58 vars in 1203 bytes} [Thu Aug 4 16:58:41 2022] GET /compute/v2.1/flavors/2061181200/os-extra_specs => generated 19 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:58:41.488548 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f3e963bb-b38b-4988-a7bd-36aa40adb886 tempest-FlavorsExtraSpecsTestJSON-749510533 tempest-FlavorsExtraSpecsTestJSON-749510533-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:41.489637 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:58:41.489637 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:58:41.523489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:41.537668 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f3e963bb-b38b-4988-a7bd-36aa40adb886 tempest-FlavorsExtraSpecsTestJSON-749510533 tempest-FlavorsExtraSpecsTestJSON-749510533-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/2061181200" status: 202 len: 0 microversion: 2.1 time: 0.053328 Aug 04 16:58:41.538277 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 579/1211] 10.222.0.93 () {58 vars in 1161 bytes} [Thu Aug 4 16:58:41 2022] DELETE /compute/v2.1/flavors/2061181200 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:58:41.550570 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7a8791d5-e570-49f0-960a-0e5c827c9647 tempest-FlavorsExtraSpecsTestJSON-749510533 tempest-FlavorsExtraSpecsTestJSON-749510533-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:41.633193 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7a8791d5-e570-49f0-960a-0e5c827c9647 tempest-FlavorsExtraSpecsTestJSON-749510533 tempest-FlavorsExtraSpecsTestJSON-749510533-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.089901 Aug 04 16:58:41.633824 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 580/1212] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 16:58:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:42.000398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-f153df5f-2c10-405b-bd6e-d07adde35121 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lazy-loading 'services' on Instance uuid cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:58:42.019725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-51d279c9-0143-4bc2-b9f7-5dcfcbe82ad1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:42.020659 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-51d279c9-0143-4bc2-b9f7-5dcfcbe82ad1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:42.037761 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51d279c9-0143-4bc2-b9f7-5dcfcbe82ad1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:42.038307 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51d279c9-0143-4bc2-b9f7-5dcfcbe82ad1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:42.043342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51d279c9-0143-4bc2-b9f7-5dcfcbe82ad1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:42.044224 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51d279c9-0143-4bc2-b9f7-5dcfcbe82ad1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:42.044728 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51d279c9-0143-4bc2-b9f7-5dcfcbe82ad1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:42.045178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51d279c9-0143-4bc2-b9f7-5dcfcbe82ad1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:42.101677 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f153df5f-2c10-405b-bd6e-d07adde35121 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 200 len: 2035 microversion: 2.25 time: 0.874867 Aug 04 16:58:42.126482 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 633/1213] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:41 2022] GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 2035 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:42.160037 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8e5d7dc9-aa63-4240-8bc3-94892f7f878e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Action: 'create', calling method: .version_select at 0x7f1e5b75e820>, body: {"keypair": {"name": "tempest-keypair-205989504", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAof1GxwZi20DPYAeWU+9TvJEvqeUis4bZxBQSbvHA1TTHKhfpMNDKJQpL+1MenVa/G4j6CBvnlRzNy6bOHbYl1lWghhr09RfwPKGiwl3hKc/7e2WSPgaNTL2DR+frsXag=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:42.165837 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=83,nova_api:SAVEPOINT=7,nova_api:INSERT=2,nova_api:RELEASE=7,nova_api:DELETE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:42.211155 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-8e5d7dc9-aa63-4240-8bc3-94892f7f878e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Getting quotas for project e457894e070145348859f44a6a3e8ed6. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:58:42.232328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-8e5d7dc9-aa63-4240-8bc3-94892f7f878e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Getting quotas for user d0e0f6e799384863af2222416f070c84 and project e457894e070145348859f44a6a3e8ed6. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:58:42.316975 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8e5d7dc9-aa63-4240-8bc3-94892f7f878e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.161020 Aug 04 16:58:42.324386 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 634/1214] 10.222.0.93 () {62 vars in 1200 bytes} [Thu Aug 4 16:58:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 169 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 04 16:58:42.353083 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-170f93cc-7cb9-4883-b0c7-a0d27cbe88e5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:42.354598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-170f93cc-7cb9-4883-b0c7-a0d27cbe88e5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:42.363755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-170f93cc-7cb9-4883-b0c7-a0d27cbe88e5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:42.369089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-170f93cc-7cb9-4883-b0c7-a0d27cbe88e5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:42.369800 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-170f93cc-7cb9-4883-b0c7-a0d27cbe88e5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:42.370788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-170f93cc-7cb9-4883-b0c7-a0d27cbe88e5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:42.371733 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-170f93cc-7cb9-4883-b0c7-a0d27cbe88e5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:42.372106 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-170f93cc-7cb9-4883-b0c7-a0d27cbe88e5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:42.601627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-51d279c9-0143-4bc2-b9f7-5dcfcbe82ad1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:42.642362 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-51d279c9-0143-4bc2-b9f7-5dcfcbe82ad1 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1542 microversion: 2.1 time: 0.626867 Aug 04 16:58:42.652169 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 581/1215] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:42 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1542 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:43.199165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-170f93cc-7cb9-4883-b0c7-a0d27cbe88e5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:43.212325 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-170f93cc-7cb9-4883-b0c7-a0d27cbe88e5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1473 microversion: 2.1 time: 0.860924 Aug 04 16:58:43.215876 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 635/1216] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:42 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1473 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:58:43.673938 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7ecd6183-dd16-47dd-b40d-2c7eec7fe5e0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:43.678166 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7ecd6183-dd16-47dd-b40d-2c7eec7fe5e0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:43.698292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ecd6183-dd16-47dd-b40d-2c7eec7fe5e0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:43.699098 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ecd6183-dd16-47dd-b40d-2c7eec7fe5e0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:43.700301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ecd6183-dd16-47dd-b40d-2c7eec7fe5e0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:43.702322 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ecd6183-dd16-47dd-b40d-2c7eec7fe5e0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:43.703347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ecd6183-dd16-47dd-b40d-2c7eec7fe5e0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:43.703999 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ecd6183-dd16-47dd-b40d-2c7eec7fe5e0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:44.083327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7ecd6183-dd16-47dd-b40d-2c7eec7fe5e0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:44.098880 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7ecd6183-dd16-47dd-b40d-2c7eec7fe5e0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1542 microversion: 2.1 time: 0.429402 Aug 04 16:58:44.100767 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 582/1217] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:43 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1542 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:44.251862 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8eadc82d-4dce-4af8-8665-70284ae85146 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:44.263726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8eadc82d-4dce-4af8-8665-70284ae85146 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:44.288871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8eadc82d-4dce-4af8-8665-70284ae85146 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:44.290334 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8eadc82d-4dce-4af8-8665-70284ae85146 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:44.292087 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8eadc82d-4dce-4af8-8665-70284ae85146 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:44.294995 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8eadc82d-4dce-4af8-8665-70284ae85146 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:44.295492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8eadc82d-4dce-4af8-8665-70284ae85146 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:44.296062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8eadc82d-4dce-4af8-8665-70284ae85146 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:45.059535 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8eadc82d-4dce-4af8-8665-70284ae85146 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:45.068337 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8eadc82d-4dce-4af8-8665-70284ae85146 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1473 microversion: 2.1 time: 0.834061 Aug 04 16:58:45.075577 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 636/1218] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:44 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1473 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:45.128214 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d07e03df-cd8f-4dc2-9683-2955f19d78c5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:45.128944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d07e03df-cd8f-4dc2-9683-2955f19d78c5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:45.141783 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d07e03df-cd8f-4dc2-9683-2955f19d78c5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:45.142319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d07e03df-cd8f-4dc2-9683-2955f19d78c5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:45.145556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d07e03df-cd8f-4dc2-9683-2955f19d78c5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:45.146427 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d07e03df-cd8f-4dc2-9683-2955f19d78c5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:45.146914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d07e03df-cd8f-4dc2-9683-2955f19d78c5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:45.147355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d07e03df-cd8f-4dc2-9683-2955f19d78c5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:45.509205 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d07e03df-cd8f-4dc2-9683-2955f19d78c5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:45.517894 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d07e03df-cd8f-4dc2-9683-2955f19d78c5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1542 microversion: 2.1 time: 0.394141 Aug 04 16:58:45.519211 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 583/1219] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:45 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1542 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:46.097712 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a558a0d8-b37f-4378-8e17-a159a54595d5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:46.098448 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a558a0d8-b37f-4378-8e17-a159a54595d5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:46.105259 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a558a0d8-b37f-4378-8e17-a159a54595d5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:46.107745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a558a0d8-b37f-4378-8e17-a159a54595d5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:46.108753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a558a0d8-b37f-4378-8e17-a159a54595d5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:46.109840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a558a0d8-b37f-4378-8e17-a159a54595d5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:46.112698 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a558a0d8-b37f-4378-8e17-a159a54595d5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:46.114111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a558a0d8-b37f-4378-8e17-a159a54595d5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:46.143299 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2deb73d5-fe1c-4d33-816d-fa20b063913a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1392138881", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "93c63081-713e-4b1c-8711-321b0490bce1"}], "security_groups": [{"name": "tempest-securitygroup--530946785"}], "key_name": "tempest-keypair-205989504", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:46.702724 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-2deb73d5-fe1c-4d33-816d-fa20b063913a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] validate_networks() for [('93c63081-713e-4b1c-8711-321b0490bce1', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:58:46.907791 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a558a0d8-b37f-4378-8e17-a159a54595d5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:46.920311 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a558a0d8-b37f-4378-8e17-a159a54595d5 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1473 microversion: 2.1 time: 0.826273 Aug 04 16:58:46.923262 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 637/1220] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:46 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1473 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:46.936389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e8f8c44e-ed24-407f-84dc-d1b54536c245 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:46.940769 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e8f8c44e-ed24-407f-84dc-d1b54536c245 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:46.957359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8f8c44e-ed24-407f-84dc-d1b54536c245 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:46.958369 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8f8c44e-ed24-407f-84dc-d1b54536c245 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:46.959396 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8f8c44e-ed24-407f-84dc-d1b54536c245 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:46.961058 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8f8c44e-ed24-407f-84dc-d1b54536c245 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:46.961753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8f8c44e-ed24-407f-84dc-d1b54536c245 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:46.964516 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8f8c44e-ed24-407f-84dc-d1b54536c245 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:47.404462 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e8f8c44e-ed24-407f-84dc-d1b54536c245 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:47.418518 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e8f8c44e-ed24-407f-84dc-d1b54536c245 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1542 microversion: 2.1 time: 0.489173 Aug 04 16:58:47.423931 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 638/1221] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:46 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1542 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:47.853764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-2deb73d5-fe1c-4d33-816d-fa20b063913a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:58:47.854356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-2deb73d5-fe1c-4d33-816d-fa20b063913a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:58:47.854694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-2deb73d5-fe1c-4d33-816d-fa20b063913a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:58:47.855414 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-2deb73d5-fe1c-4d33-816d-fa20b063913a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:58:47.855836 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-2deb73d5-fe1c-4d33-816d-fa20b063913a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:58:47.872305 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2deb73d5-fe1c-4d33-816d-fa20b063913a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:47.872807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2deb73d5-fe1c-4d33-816d-fa20b063913a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:47.873245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2deb73d5-fe1c-4d33-816d-fa20b063913a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:47.874006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2deb73d5-fe1c-4d33-816d-fa20b063913a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:47.877511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2deb73d5-fe1c-4d33-816d-fa20b063913a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:47.878515 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2deb73d5-fe1c-4d33-816d-fa20b063913a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:47.952914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-2deb73d5-fe1c-4d33-816d-fa20b063913a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Getting quotas for project e457894e070145348859f44a6a3e8ed6. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:58:47.973215 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-2deb73d5-fe1c-4d33-816d-fa20b063913a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Getting quotas for user d0e0f6e799384863af2222416f070c84 and project e457894e070145348859f44a6a3e8ed6. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:58:47.979166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-352329d0-49dc-4291-a8d4-46b30b9717a6 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:47.980281 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-352329d0-49dc-4291-a8d4-46b30b9717a6 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:47.990371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-352329d0-49dc-4291-a8d4-46b30b9717a6 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:47.996000 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-352329d0-49dc-4291-a8d4-46b30b9717a6 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:47.996842 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-352329d0-49dc-4291-a8d4-46b30b9717a6 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:47.998644 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-352329d0-49dc-4291-a8d4-46b30b9717a6 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:47.999978 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-352329d0-49dc-4291-a8d4-46b30b9717a6 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:48.000624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-352329d0-49dc-4291-a8d4-46b30b9717a6 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:48.004365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2deb73d5-fe1c-4d33-816d-fa20b063913a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:58:48.006720 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2deb73d5-fe1c-4d33-816d-fa20b063913a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:58:48.106906 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2deb73d5-fe1c-4d33-816d-fa20b063913a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 1.973156 Aug 04 16:58:48.116037 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 584/1222] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Aug 4 16:58:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 1983 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 16:58:48.128320 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-20ed8d05-c842-42bf-b655-176a792eebe1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:48.129275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-20ed8d05-c842-42bf-b655-176a792eebe1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:48.290908 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-20ed8d05-c842-42bf-b655-176a792eebe1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:48.301937 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-20ed8d05-c842-42bf-b655-176a792eebe1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:48.303610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-20ed8d05-c842-42bf-b655-176a792eebe1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:48.304775 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-20ed8d05-c842-42bf-b655-176a792eebe1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 1285 microversion: 2.25 time: 0.181113 Aug 04 16:58:48.318618 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-352329d0-49dc-4291-a8d4-46b30b9717a6 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:48.330970 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-352329d0-49dc-4291-a8d4-46b30b9717a6 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1473 microversion: 2.1 time: 0.371510 Aug 04 16:58:48.333754 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 585/1223] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:48 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 1285 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:48.347493 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 639/1224] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:47 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1473 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:48.441166 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3e709d6c-92ac-48eb-8f1b-0fe253bea775 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:48.442102 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3e709d6c-92ac-48eb-8f1b-0fe253bea775 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:48.454219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e709d6c-92ac-48eb-8f1b-0fe253bea775 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:48.457293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e709d6c-92ac-48eb-8f1b-0fe253bea775 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:48.458578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e709d6c-92ac-48eb-8f1b-0fe253bea775 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:48.462193 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e709d6c-92ac-48eb-8f1b-0fe253bea775 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:48.464313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e709d6c-92ac-48eb-8f1b-0fe253bea775 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:48.466463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e709d6c-92ac-48eb-8f1b-0fe253bea775 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:48.870500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3e709d6c-92ac-48eb-8f1b-0fe253bea775 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:48.888230 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3e709d6c-92ac-48eb-8f1b-0fe253bea775 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1541 microversion: 2.1 time: 0.450933 Aug 04 16:58:48.893193 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 586/1225] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:48 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1541 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:48.956077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f33f5976-7057-46fe-bffa-1616342e8b85 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Calling method '.version_select at 0x7f1e5b743dc0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:48.961138 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:58:48.961138 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:58:48.962832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f33f5976-7057-46fe-bffa-1616342e8b85 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:48.963552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f33f5976-7057-46fe-bffa-1616342e8b85 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:48.964657 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f33f5976-7057-46fe-bffa-1616342e8b85 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:48.966733 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f33f5976-7057-46fe-bffa-1616342e8b85 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:48.967267 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f33f5976-7057-46fe-bffa-1616342e8b85 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:48.967712 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f33f5976-7057-46fe-bffa-1616342e8b85 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:49.013552 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f33f5976-7057-46fe-bffa-1616342e8b85 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.548191 Aug 04 16:58:49.021771 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 640/1226] 10.222.0.93 () {58 vars in 1128 bytes} [Thu Aug 4 16:58:48 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:49.029142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-18f1a8ed-dde6-4c0c-9d23-e1e3e046e251 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Calling method '.version_select at 0x7f1e6804b820>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:49.033694 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:58:49.033694 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:58:49.035637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18f1a8ed-dde6-4c0c-9d23-e1e3e046e251 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:49.036867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18f1a8ed-dde6-4c0c-9d23-e1e3e046e251 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:49.038954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18f1a8ed-dde6-4c0c-9d23-e1e3e046e251 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:49.049640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18f1a8ed-dde6-4c0c-9d23-e1e3e046e251 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:49.050285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18f1a8ed-dde6-4c0c-9d23-e1e3e046e251 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:49.051361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18f1a8ed-dde6-4c0c-9d23-e1e3e046e251 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:49.101617 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-18f1a8ed-dde6-4c0c-9d23-e1e3e046e251 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.077199 Aug 04 16:58:49.103103 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 587/1227] 10.222.0.93 () {58 vars in 1139 bytes} [Thu Aug 4 16:58:49 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:49.116591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-85b36109-2320-467c-808e-4e497ddc4091 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Calling method '.version_select at 0x7f1e5b9d8670>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:49.120541 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:58:49.120541 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:58:49.123462 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85b36109-2320-467c-808e-4e497ddc4091 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:49.127418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85b36109-2320-467c-808e-4e497ddc4091 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:49.128416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85b36109-2320-467c-808e-4e497ddc4091 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:49.129365 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85b36109-2320-467c-808e-4e497ddc4091 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:49.132625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85b36109-2320-467c-808e-4e497ddc4091 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:49.134914 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85b36109-2320-467c-808e-4e497ddc4091 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:49.206087 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-85b36109-2320-467c-808e-4e497ddc4091 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.092598 Aug 04 16:58:49.207072 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 641/1228] 10.222.0.93 () {58 vars in 1145 bytes} [Thu Aug 4 16:58:49 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:58:49.220517 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bd83f7be-b205-4d35-a977-3a15f342625e tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Calling method '.version_select at 0x7f1e5bfdb0d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:49.223492 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:58:49.223492 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:58:49.224895 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd83f7be-b205-4d35-a977-3a15f342625e tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:49.227003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd83f7be-b205-4d35-a977-3a15f342625e tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:49.227654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd83f7be-b205-4d35-a977-3a15f342625e tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:49.230206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd83f7be-b205-4d35-a977-3a15f342625e tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:49.230891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd83f7be-b205-4d35-a977-3a15f342625e tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:49.232019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd83f7be-b205-4d35-a977-3a15f342625e tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:49.266404 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bd83f7be-b205-4d35-a977-3a15f342625e tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.050880 Aug 04 16:58:49.267250 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 588/1229] 10.222.0.93 () {58 vars in 1128 bytes} [Thu Aug 4 16:58:49 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:49.279177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-464a6157-c43e-46d6-b32f-aa4cd808d9cc tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Calling method '.version_select at 0x7f1e5bac5f70>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:49.283489 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:58:49.283489 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:58:49.284562 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-464a6157-c43e-46d6-b32f-aa4cd808d9cc tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:49.285403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-464a6157-c43e-46d6-b32f-aa4cd808d9cc tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:49.286158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-464a6157-c43e-46d6-b32f-aa4cd808d9cc tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:49.286971 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-464a6157-c43e-46d6-b32f-aa4cd808d9cc tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:49.287401 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-464a6157-c43e-46d6-b32f-aa4cd808d9cc tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:49.288048 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-464a6157-c43e-46d6-b32f-aa4cd808d9cc tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:49.318340 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-464a6157-c43e-46d6-b32f-aa4cd808d9cc tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.043808 Aug 04 16:58:49.320608 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 642/1230] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Aug 4 16:58:49 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:49.336906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3dbe1674-e7d8-413d-bca4-a0743f88935f tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Calling method '.version_select at 0x7f1e5b4a2b80>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:49.348602 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:58:49.348602 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:58:49.356742 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3dbe1674-e7d8-413d-bca4-a0743f88935f tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:49.357274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3dbe1674-e7d8-413d-bca4-a0743f88935f tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:49.357689 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3dbe1674-e7d8-413d-bca4-a0743f88935f tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:49.358471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3dbe1674-e7d8-413d-bca4-a0743f88935f tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:49.358933 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3dbe1674-e7d8-413d-bca4-a0743f88935f tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:49.359360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3dbe1674-e7d8-413d-bca4-a0743f88935f tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:49.367924 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-00197b2e-13cd-436f-9541-b025d9665fc2 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:49.374538 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-00197b2e-13cd-436f-9541-b025d9665fc2 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:49.391829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00197b2e-13cd-436f-9541-b025d9665fc2 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:49.398779 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00197b2e-13cd-436f-9541-b025d9665fc2 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:49.399308 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00197b2e-13cd-436f-9541-b025d9665fc2 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:49.400881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00197b2e-13cd-436f-9541-b025d9665fc2 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:49.401405 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00197b2e-13cd-436f-9541-b025d9665fc2 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:49.402220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00197b2e-13cd-436f-9541-b025d9665fc2 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:49.420082 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3dbe1674-e7d8-413d-bca4-a0743f88935f tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.088746 Aug 04 16:58:49.423335 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 589/1231] 10.222.0.93 () {58 vars in 1128 bytes} [Thu Aug 4 16:58:49 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:49.435848 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c39eada8-2c35-43fd-834d-e0429dd2b23a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:49.438043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c39eada8-2c35-43fd-834d-e0429dd2b23a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:49.451356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c39eada8-2c35-43fd-834d-e0429dd2b23a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:49.452517 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c39eada8-2c35-43fd-834d-e0429dd2b23a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:49.453252 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c39eada8-2c35-43fd-834d-e0429dd2b23a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:49.455806 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c39eada8-2c35-43fd-834d-e0429dd2b23a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:49.456762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c39eada8-2c35-43fd-834d-e0429dd2b23a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:49.457539 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c39eada8-2c35-43fd-834d-e0429dd2b23a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:49.604129 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-00197b2e-13cd-436f-9541-b025d9665fc2 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:49.614969 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-00197b2e-13cd-436f-9541-b025d9665fc2 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:49.616528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-00197b2e-13cd-436f-9541-b025d9665fc2 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:49.626856 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-00197b2e-13cd-436f-9541-b025d9665fc2 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 1281 microversion: 2.25 time: 0.273715 Aug 04 16:58:49.627811 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 643/1232] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:49 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 1281 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:49.644484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-458d70e9-4911-43b3-8cc8-9f630c9e05d3 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Calling method '.version_select at 0x7f1e5b7e9c10>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:49.645297 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:58:49.645297 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:58:49.660775 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-458d70e9-4911-43b3-8cc8-9f630c9e05d3 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:49.661297 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-458d70e9-4911-43b3-8cc8-9f630c9e05d3 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:49.661748 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-458d70e9-4911-43b3-8cc8-9f630c9e05d3 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:49.711777 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-458d70e9-4911-43b3-8cc8-9f630c9e05d3 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:49.712559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-458d70e9-4911-43b3-8cc8-9f630c9e05d3 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:49.713676 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-458d70e9-4911-43b3-8cc8-9f630c9e05d3 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:49.771829 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-458d70e9-4911-43b3-8cc8-9f630c9e05d3 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts/n-h1-851359-3" status: 200 len: 860 microversion: 2.1 time: 0.142461 Aug 04 16:58:49.780718 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 644/1233] 10.222.0.93 () {58 vars in 1170 bytes} [Thu Aug 4 16:58:49 2022] GET /compute/v2.1/os-hosts/n-h1-851359-3 => generated 860 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:49.789271 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-01eb3c5e-3f3f-4489-b981-1df7cb4234a2 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Calling method '.version_select at 0x7f1e5b6d4430>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:49.792895 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:58:49.792895 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:58:49.810413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01eb3c5e-3f3f-4489-b981-1df7cb4234a2 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:49.811251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01eb3c5e-3f3f-4489-b981-1df7cb4234a2 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:49.812265 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01eb3c5e-3f3f-4489-b981-1df7cb4234a2 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:49.857298 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01eb3c5e-3f3f-4489-b981-1df7cb4234a2 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:49.859232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01eb3c5e-3f3f-4489-b981-1df7cb4234a2 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:49.864602 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01eb3c5e-3f3f-4489-b981-1df7cb4234a2 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:49.872380 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c39eada8-2c35-43fd-834d-e0429dd2b23a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:49.886407 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c39eada8-2c35-43fd-834d-e0429dd2b23a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1473 microversion: 2.1 time: 0.461161 Aug 04 16:58:49.895994 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 590/1234] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:49 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1473 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:49.913850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e8b8ff12-b905-4c29-9ddd-5f05b3cbe5ab tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:49.914505 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e8b8ff12-b905-4c29-9ddd-5f05b3cbe5ab tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:49.936014 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-01eb3c5e-3f3f-4489-b981-1df7cb4234a2 tempest-HostsAdminTestJSON-1353416151 tempest-HostsAdminTestJSON-1353416151-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hosts/n-h2-851359-3" status: 200 len: 860 microversion: 2.1 time: 0.149922 Aug 04 16:58:49.937196 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 645/1235] 10.222.0.93 () {58 vars in 1170 bytes} [Thu Aug 4 16:58:49 2022] GET /compute/v2.1/os-hosts/n-h2-851359-3 => generated 860 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:49.946708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8b8ff12-b905-4c29-9ddd-5f05b3cbe5ab tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:49.950824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8b8ff12-b905-4c29-9ddd-5f05b3cbe5ab tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:49.952964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8b8ff12-b905-4c29-9ddd-5f05b3cbe5ab tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:49.959491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8b8ff12-b905-4c29-9ddd-5f05b3cbe5ab tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:49.960271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8b8ff12-b905-4c29-9ddd-5f05b3cbe5ab tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:49.962137 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8b8ff12-b905-4c29-9ddd-5f05b3cbe5ab tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:50.269103 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e8b8ff12-b905-4c29-9ddd-5f05b3cbe5ab tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:50.281644 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e8b8ff12-b905-4c29-9ddd-5f05b3cbe5ab tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1541 microversion: 2.1 time: 0.372173 Aug 04 16:58:50.299742 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 591/1236] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:49 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1541 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:50.653493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a6c3026c-27e3-44bc-a0ce-58f08ef9acd1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:50.654165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a6c3026c-27e3-44bc-a0ce-58f08ef9acd1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:50.679572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6c3026c-27e3-44bc-a0ce-58f08ef9acd1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:50.680082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6c3026c-27e3-44bc-a0ce-58f08ef9acd1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:50.680532 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6c3026c-27e3-44bc-a0ce-58f08ef9acd1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:50.681602 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6c3026c-27e3-44bc-a0ce-58f08ef9acd1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:50.682111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6c3026c-27e3-44bc-a0ce-58f08ef9acd1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:50.684643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6c3026c-27e3-44bc-a0ce-58f08ef9acd1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:50.870866 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a6c3026c-27e3-44bc-a0ce-58f08ef9acd1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:50.921796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a6c3026c-27e3-44bc-a0ce-58f08ef9acd1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:50.922701 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-789aff9a-857e-4a29-9e61-795884e79014 req-4ebde06e-1f95-4583-98ca-1bcf7a447f90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1250487f-b35f-4803-b7b3-a9a80850fa12", "name": "network-vif-unplugged", "status": "completed", "tag": "167d17c7-b0d3-40d2-8410-10740bd6347f"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:50.933064 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a6c3026c-27e3-44bc-a0ce-58f08ef9acd1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:50.934988 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a6c3026c-27e3-44bc-a0ce-58f08ef9acd1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 1343 microversion: 2.25 time: 0.285793 Aug 04 16:58:50.939401 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 646/1237] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:50 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 1343 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:50.964865 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d4ee5e08-19dd-4b88-bd78-167a875b41fe tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:50.965842 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-789aff9a-857e-4a29-9e61-795884e79014 req-4ebde06e-1f95-4583-98ca-1bcf7a447f90 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:50.966404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-789aff9a-857e-4a29-9e61-795884e79014 req-4ebde06e-1f95-4583-98ca-1bcf7a447f90 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:50.968585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-789aff9a-857e-4a29-9e61-795884e79014 req-4ebde06e-1f95-4583-98ca-1bcf7a447f90 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:50.972048 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d4ee5e08-19dd-4b88-bd78-167a875b41fe tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:51.007127 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d4ee5e08-19dd-4b88-bd78-167a875b41fe tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:51.008288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d4ee5e08-19dd-4b88-bd78-167a875b41fe tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:51.008771 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d4ee5e08-19dd-4b88-bd78-167a875b41fe tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:51.016585 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d4ee5e08-19dd-4b88-bd78-167a875b41fe tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:51.017150 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d4ee5e08-19dd-4b88-bd78-167a875b41fe tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:51.020985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d4ee5e08-19dd-4b88-bd78-167a875b41fe tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:51.038094 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-789aff9a-857e-4a29-9e61-795884e79014 req-4ebde06e-1f95-4583-98ca-1bcf7a447f90 service nova] Creating event network-vif-unplugged:167d17c7-b0d3-40d2-8410-10740bd6347f for instance 1250487f-b35f-4803-b7b3-a9a80850fa12 on n-h1-851359-3 Aug 04 16:58:51.049091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-789aff9a-857e-4a29-9e61-795884e79014 req-4ebde06e-1f95-4583-98ca-1bcf7a447f90 service nova] Instance 1250487f-b35f-4803-b7b3-a9a80850fa12 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 16:58:51.087046 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-789aff9a-857e-4a29-9e61-795884e79014 req-4ebde06e-1f95-4583-98ca-1bcf7a447f90 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.168486 Aug 04 16:58:51.088271 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 592/1238] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:51.308150 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2101833b-a9ee-4e4b-a65a-436c9fdb1a9c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:51.308893 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2101833b-a9ee-4e4b-a65a-436c9fdb1a9c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:51.336856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2101833b-a9ee-4e4b-a65a-436c9fdb1a9c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:51.337344 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2101833b-a9ee-4e4b-a65a-436c9fdb1a9c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:51.338532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2101833b-a9ee-4e4b-a65a-436c9fdb1a9c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:51.341546 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2101833b-a9ee-4e4b-a65a-436c9fdb1a9c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:51.342139 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2101833b-a9ee-4e4b-a65a-436c9fdb1a9c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:51.342644 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2101833b-a9ee-4e4b-a65a-436c9fdb1a9c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:51.435907 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d4ee5e08-19dd-4b88-bd78-167a875b41fe tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:51.448929 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d4ee5e08-19dd-4b88-bd78-167a875b41fe tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1473 microversion: 2.1 time: 0.506444 Aug 04 16:58:51.449290 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 647/1239] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:50 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1473 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:51.774281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2101833b-a9ee-4e4b-a65a-436c9fdb1a9c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:51.784125 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2101833b-a9ee-4e4b-a65a-436c9fdb1a9c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1541 microversion: 2.1 time: 0.483025 Aug 04 16:58:51.798677 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 593/1240] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:51 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1541 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:58:51.963845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-85d77ec7-6ff8-478f-b394-2da362fbc576 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:51.967038 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-85d77ec7-6ff8-478f-b394-2da362fbc576 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:51.979985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85d77ec7-6ff8-478f-b394-2da362fbc576 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:51.980866 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85d77ec7-6ff8-478f-b394-2da362fbc576 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:51.983815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85d77ec7-6ff8-478f-b394-2da362fbc576 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:51.985212 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85d77ec7-6ff8-478f-b394-2da362fbc576 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:51.989887 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85d77ec7-6ff8-478f-b394-2da362fbc576 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:51.990699 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85d77ec7-6ff8-478f-b394-2da362fbc576 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:52.280038 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=4 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:52.432382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-85d77ec7-6ff8-478f-b394-2da362fbc576 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:52.451815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-85d77ec7-6ff8-478f-b394-2da362fbc576 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:52.455973 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-85d77ec7-6ff8-478f-b394-2da362fbc576 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:52.459506 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-85d77ec7-6ff8-478f-b394-2da362fbc576 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 1343 microversion: 2.25 time: 0.499718 Aug 04 16:58:52.461622 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 648/1241] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:51 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 1343 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:52.484886 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0c69f822-8da8-43a2-a789-1ef1be293e61 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:52.486190 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0c69f822-8da8-43a2-a789-1ef1be293e61 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:52.516613 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c69f822-8da8-43a2-a789-1ef1be293e61 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:52.518563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c69f822-8da8-43a2-a789-1ef1be293e61 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:52.519914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c69f822-8da8-43a2-a789-1ef1be293e61 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:52.521620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c69f822-8da8-43a2-a789-1ef1be293e61 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:52.526972 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c69f822-8da8-43a2-a789-1ef1be293e61 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:52.527701 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c69f822-8da8-43a2-a789-1ef1be293e61 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:52.805694 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e1f227ed-168b-492b-b845-849b1529894d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:52.806672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e1f227ed-168b-492b-b845-849b1529894d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:52.815887 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1f227ed-168b-492b-b845-849b1529894d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:52.816389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1f227ed-168b-492b-b845-849b1529894d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:52.816833 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1f227ed-168b-492b-b845-849b1529894d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:52.817553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1f227ed-168b-492b-b845-849b1529894d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:52.818027 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1f227ed-168b-492b-b845-849b1529894d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:52.818460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1f227ed-168b-492b-b845-849b1529894d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:52.911939 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:53.664984 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0c69f822-8da8-43a2-a789-1ef1be293e61 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:53.686592 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0c69f822-8da8-43a2-a789-1ef1be293e61 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1473 microversion: 2.1 time: 1.218933 Aug 04 16:58:53.692073 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 594/1242] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:52 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1473 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:53.723844 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-6da505b7-e79c-4a69-b7e8-5032e6938abe req-8959d58c-52b8-4a22-9865-9864a7b4e8a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1250487f-b35f-4803-b7b3-a9a80850fa12", "tag": "167d17c7-b0d3-40d2-8410-10740bd6347f"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:53.745434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6da505b7-e79c-4a69-b7e8-5032e6938abe req-8959d58c-52b8-4a22-9865-9864a7b4e8a2 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:53.746568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6da505b7-e79c-4a69-b7e8-5032e6938abe req-8959d58c-52b8-4a22-9865-9864a7b4e8a2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:53.747612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6da505b7-e79c-4a69-b7e8-5032e6938abe req-8959d58c-52b8-4a22-9865-9864a7b4e8a2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:53.762702 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-6da505b7-e79c-4a69-b7e8-5032e6938abe req-8959d58c-52b8-4a22-9865-9864a7b4e8a2 service nova] Creating event network-changed:167d17c7-b0d3-40d2-8410-10740bd6347f for instance 1250487f-b35f-4803-b7b3-a9a80850fa12 on n-h1-851359-3 Aug 04 16:58:53.769516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-6da505b7-e79c-4a69-b7e8-5032e6938abe req-8959d58c-52b8-4a22-9865-9864a7b4e8a2 service nova] Instance 1250487f-b35f-4803-b7b3-a9a80850fa12 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 16:58:53.806858 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-6da505b7-e79c-4a69-b7e8-5032e6938abe req-8959d58c-52b8-4a22-9865-9864a7b4e8a2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100646 Aug 04 16:58:53.807315 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 595/1243] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:53.813785 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fd6e80ac-e821-4270-a5f5-b96308f5c4e1 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f798c87-791f-4a2c-addf-0d3deee1700c"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:53.817699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fd6e80ac-e821-4270-a5f5-b96308f5c4e1 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cf061e67-e261-41e2-a505-95e318126844] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:53.826769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd6e80ac-e821-4270-a5f5-b96308f5c4e1 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:53.829660 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd6e80ac-e821-4270-a5f5-b96308f5c4e1 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:53.833329 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd6e80ac-e821-4270-a5f5-b96308f5c4e1 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:53.838604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd6e80ac-e821-4270-a5f5-b96308f5c4e1 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:53.839331 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd6e80ac-e821-4270-a5f5-b96308f5c4e1 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:53.839978 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd6e80ac-e821-4270-a5f5-b96308f5c4e1 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:53.896510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e1f227ed-168b-492b-b845-849b1529894d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:53.907697 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e1f227ed-168b-492b-b845-849b1529894d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1541 microversion: 2.1 time: 1.105704 Aug 04 16:58:53.910868 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 649/1244] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:52 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1541 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:58:53.924873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fea85f65-104e-46e0-9131-5cebf70ecbbd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:53.925788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fea85f65-104e-46e0-9131-5cebf70ecbbd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:53.942320 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fea85f65-104e-46e0-9131-5cebf70ecbbd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:53.947534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fea85f65-104e-46e0-9131-5cebf70ecbbd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:53.949837 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fea85f65-104e-46e0-9131-5cebf70ecbbd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:53.951075 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fea85f65-104e-46e0-9131-5cebf70ecbbd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:53.955659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fea85f65-104e-46e0-9131-5cebf70ecbbd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:53.956421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fea85f65-104e-46e0-9131-5cebf70ecbbd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:54.572670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fea85f65-104e-46e0-9131-5cebf70ecbbd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:54.584961 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fea85f65-104e-46e0-9131-5cebf70ecbbd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:54.586645 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fea85f65-104e-46e0-9131-5cebf70ecbbd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:54.590170 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fea85f65-104e-46e0-9131-5cebf70ecbbd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 1410 microversion: 2.25 time: 0.674835 Aug 04 16:58:54.601174 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 650/1245] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:53 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 1410 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:54.715645 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cf17763c-b550-4a79-9f80-9626b35fa224 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:54.716280 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cf17763c-b550-4a79-9f80-9626b35fa224 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:54.751234 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cf17763c-b550-4a79-9f80-9626b35fa224 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:54.751730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cf17763c-b550-4a79-9f80-9626b35fa224 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:54.752190 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cf17763c-b550-4a79-9f80-9626b35fa224 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:54.768474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cf17763c-b550-4a79-9f80-9626b35fa224 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:54.769680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cf17763c-b550-4a79-9f80-9626b35fa224 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:54.771804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cf17763c-b550-4a79-9f80-9626b35fa224 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:55.251067 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cf17763c-b550-4a79-9f80-9626b35fa224 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:55.296207 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cf17763c-b550-4a79-9f80-9626b35fa224 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1473 microversion: 2.1 time: 0.585290 Aug 04 16:58:55.305551 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 651/1246] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:54 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1473 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:58:55.318735 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-66e62104-43ab-4878-bfa7-7dadef639c66 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:55.329658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-66e62104-43ab-4878-bfa7-7dadef639c66 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:55.357373 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66e62104-43ab-4878-bfa7-7dadef639c66 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:55.362000 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66e62104-43ab-4878-bfa7-7dadef639c66 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:55.362980 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66e62104-43ab-4878-bfa7-7dadef639c66 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:55.364494 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66e62104-43ab-4878-bfa7-7dadef639c66 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:55.373970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66e62104-43ab-4878-bfa7-7dadef639c66 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:55.374882 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66e62104-43ab-4878-bfa7-7dadef639c66 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:55.483057 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fd6e80ac-e821-4270-a5f5-b96308f5c4e1 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "POST /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.672985 Aug 04 16:58:55.487111 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 596/1247] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Aug 4 16:58:53 2022] POST /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844/os-volume_attachments => generated 194 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:55.626599 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9f931e93-aa34-4b42-84fb-a6bf7e0e66a9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:55.627886 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9f931e93-aa34-4b42-84fb-a6bf7e0e66a9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:55.647830 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f931e93-aa34-4b42-84fb-a6bf7e0e66a9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:55.653602 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f931e93-aa34-4b42-84fb-a6bf7e0e66a9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:55.656988 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f931e93-aa34-4b42-84fb-a6bf7e0e66a9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:55.657785 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f931e93-aa34-4b42-84fb-a6bf7e0e66a9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:55.662069 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f931e93-aa34-4b42-84fb-a6bf7e0e66a9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:55.662577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f931e93-aa34-4b42-84fb-a6bf7e0e66a9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:56.330172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9f931e93-aa34-4b42-84fb-a6bf7e0e66a9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:56.343918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9f931e93-aa34-4b42-84fb-a6bf7e0e66a9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:56.345591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9f931e93-aa34-4b42-84fb-a6bf7e0e66a9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:56.362284 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9f931e93-aa34-4b42-84fb-a6bf7e0e66a9 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 1410 microversion: 2.25 time: 0.737207 Aug 04 16:58:56.367086 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 597/1248] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:55 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 1410 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:56.390457 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-9fea078b-a696-40a5-a7d0-9857e417c0d7 req-2f12afcb-c4cb-4f1e-ac4b-4ec5e3912fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afea0f77-8d91-4170-934f-b6b7ef64d5a6", "tag": "9e2d842c-859e-4f10-8b78-924c2156cf47"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:56.423902 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-66e62104-43ab-4878-bfa7-7dadef639c66 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:56.433453 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-66e62104-43ab-4878-bfa7-7dadef639c66 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1470 microversion: 2.1 time: 1.121818 Aug 04 16:58:56.441604 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 652/1249] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:55 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1470 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:56.447774 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9fea078b-a696-40a5-a7d0-9857e417c0d7 req-2f12afcb-c4cb-4f1e-ac4b-4ec5e3912fb0 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:56.448281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9fea078b-a696-40a5-a7d0-9857e417c0d7 req-2f12afcb-c4cb-4f1e-ac4b-4ec5e3912fb0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:56.448728 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9fea078b-a696-40a5-a7d0-9857e417c0d7 req-2f12afcb-c4cb-4f1e-ac4b-4ec5e3912fb0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:56.453033 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f1bcf23a-2df4-484c-b086-6f0b71b5473d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:56.457800 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f1bcf23a-2df4-484c-b086-6f0b71b5473d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:56.471740 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1bcf23a-2df4-484c-b086-6f0b71b5473d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:56.475064 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1bcf23a-2df4-484c-b086-6f0b71b5473d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:56.477071 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1bcf23a-2df4-484c-b086-6f0b71b5473d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:56.479191 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1bcf23a-2df4-484c-b086-6f0b71b5473d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:56.479853 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1bcf23a-2df4-484c-b086-6f0b71b5473d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:56.481030 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1bcf23a-2df4-484c-b086-6f0b71b5473d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:56.513091 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-9fea078b-a696-40a5-a7d0-9857e417c0d7 req-2f12afcb-c4cb-4f1e-ac4b-4ec5e3912fb0 service nova] Creating event network-changed:9e2d842c-859e-4f10-8b78-924c2156cf47 for instance afea0f77-8d91-4170-934f-b6b7ef64d5a6 on n-h1-851359-3 Aug 04 16:58:56.532083 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-9fea078b-a696-40a5-a7d0-9857e417c0d7 req-2f12afcb-c4cb-4f1e-ac4b-4ec5e3912fb0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163449 Aug 04 16:58:56.533321 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 598/1250] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:56.557768 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c498fc1c-9cde-4c1d-911c-a9905f595ae2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:58:56.558598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c498fc1c-9cde-4c1d-911c-a9905f595ae2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:56.569730 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c498fc1c-9cde-4c1d-911c-a9905f595ae2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:56.570644 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c498fc1c-9cde-4c1d-911c-a9905f595ae2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:56.571240 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c498fc1c-9cde-4c1d-911c-a9905f595ae2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:56.573056 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c498fc1c-9cde-4c1d-911c-a9905f595ae2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:56.573722 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c498fc1c-9cde-4c1d-911c-a9905f595ae2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:56.574383 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c498fc1c-9cde-4c1d-911c-a9905f595ae2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:56.601071 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:56.662082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c498fc1c-9cde-4c1d-911c-a9905f595ae2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:56.667804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c498fc1c-9cde-4c1d-911c-a9905f595ae2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:56.668482 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c498fc1c-9cde-4c1d-911c-a9905f595ae2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:56.672973 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c498fc1c-9cde-4c1d-911c-a9905f595ae2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:56.673485 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c498fc1c-9cde-4c1d-911c-a9905f595ae2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:56.673935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c498fc1c-9cde-4c1d-911c-a9905f595ae2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:56.742369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-c498fc1c-9cde-4c1d-911c-a9905f595ae2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Getting quotas for project 6f64e49086c94f65ba1fc2ef97b6bcde. Resources: {'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:58:56.754503 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-c498fc1c-9cde-4c1d-911c-a9905f595ae2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Getting quotas for user 655795644d9941c99a82d15d9daa5ab5 and project 6f64e49086c94f65ba1fc2ef97b6bcde. Resources: {'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:58:57.172669 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c498fc1c-9cde-4c1d-911c-a9905f595ae2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "POST /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12/action" status: 202 len: 0 microversion: 2.1 time: 0.635342 Aug 04 16:58:57.173629 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 599/1251] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:58:56 2022] POST /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12/action => generated 0 bytes in 640 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:58:57.193495 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-507818ec-76aa-4d81-88f7-6702993cefd6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:57.198333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f1bcf23a-2df4-484c-b086-6f0b71b5473d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:57.199360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-507818ec-76aa-4d81-88f7-6702993cefd6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:57.209903 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f1bcf23a-2df4-484c-b086-6f0b71b5473d tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1473 microversion: 2.1 time: 0.766811 Aug 04 16:58:57.210576 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 653/1252] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:56 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1473 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:57.234649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-507818ec-76aa-4d81-88f7-6702993cefd6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:57.235624 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-507818ec-76aa-4d81-88f7-6702993cefd6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:57.236204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-507818ec-76aa-4d81-88f7-6702993cefd6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:57.237036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-507818ec-76aa-4d81-88f7-6702993cefd6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:57.253708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-507818ec-76aa-4d81-88f7-6702993cefd6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:57.254212 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-507818ec-76aa-4d81-88f7-6702993cefd6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:57.388667 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-890b43c0-5e7e-4647-a5ce-c342183733b3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:57.390210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-890b43c0-5e7e-4647-a5ce-c342183733b3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:57.398660 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-890b43c0-5e7e-4647-a5ce-c342183733b3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:57.399221 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-890b43c0-5e7e-4647-a5ce-c342183733b3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:57.399821 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-890b43c0-5e7e-4647-a5ce-c342183733b3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:57.400581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-890b43c0-5e7e-4647-a5ce-c342183733b3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:57.401236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-890b43c0-5e7e-4647-a5ce-c342183733b3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:57.401963 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-890b43c0-5e7e-4647-a5ce-c342183733b3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:57.679529 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-507818ec-76aa-4d81-88f7-6702993cefd6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:57.692855 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-507818ec-76aa-4d81-88f7-6702993cefd6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1469 microversion: 2.1 time: 0.512665 Aug 04 16:58:57.697731 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 600/1253] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:57 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1469 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:58.147652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-890b43c0-5e7e-4647-a5ce-c342183733b3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:58.167353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-890b43c0-5e7e-4647-a5ce-c342183733b3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:58.173771 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-890b43c0-5e7e-4647-a5ce-c342183733b3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:58.178984 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-890b43c0-5e7e-4647-a5ce-c342183733b3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 1410 microversion: 2.25 time: 0.794083 Aug 04 16:58:58.180386 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 654/1254] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:57 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 1410 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:58:58.236328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8b69f747-609e-4a30-b3e6-023a57bc9907 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:58.237181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8b69f747-609e-4a30-b3e6-023a57bc9907 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:58.257031 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b69f747-609e-4a30-b3e6-023a57bc9907 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:58.259105 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b69f747-609e-4a30-b3e6-023a57bc9907 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:58.259804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b69f747-609e-4a30-b3e6-023a57bc9907 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:58.262634 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b69f747-609e-4a30-b3e6-023a57bc9907 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:58.266737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b69f747-609e-4a30-b3e6-023a57bc9907 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:58.267522 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b69f747-609e-4a30-b3e6-023a57bc9907 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:58.305074 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=8 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:58.709308 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2dc7de81-2721-4e6d-9292-89f4ec108c82 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:58.713752 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:58:58.713752 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:58:58.718416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2dc7de81-2721-4e6d-9292-89f4ec108c82 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:58.719300 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2dc7de81-2721-4e6d-9292-89f4ec108c82 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:58.719902 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2dc7de81-2721-4e6d-9292-89f4ec108c82 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:58.721100 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2dc7de81-2721-4e6d-9292-89f4ec108c82 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:58.721811 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2dc7de81-2721-4e6d-9292-89f4ec108c82 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:58.722486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2dc7de81-2721-4e6d-9292-89f4ec108c82 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:58.831336 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2dc7de81-2721-4e6d-9292-89f4ec108c82 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.450038 Aug 04 16:58:58.839695 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 655/1255] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Aug 4 16:58:58 2022] GET /compute/v2.1/os-services => generated 944 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:58.846642 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-94dc6b0a-e237-4a33-9369-37c89bc4cc0a tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:58.847413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-94dc6b0a-e237-4a33-9369-37c89bc4cc0a tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:58.853604 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94dc6b0a-e237-4a33-9369-37c89bc4cc0a tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:58.854147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94dc6b0a-e237-4a33-9369-37c89bc4cc0a tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:58.854992 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94dc6b0a-e237-4a33-9369-37c89bc4cc0a tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:58.855896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94dc6b0a-e237-4a33-9369-37c89bc4cc0a tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:58.856603 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94dc6b0a-e237-4a33-9369-37c89bc4cc0a tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:58.857631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94dc6b0a-e237-4a33-9369-37c89bc4cc0a tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:58.865764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8b69f747-609e-4a30-b3e6-023a57bc9907 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:58.879202 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8b69f747-609e-4a30-b3e6-023a57bc9907 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1473 microversion: 2.1 time: 0.648110 Aug 04 16:58:58.880478 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 601/1256] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:58 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1473 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:58.885928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d3f1bb22-0b63-4835-b37d-be154bae3cb9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:58.897715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d3f1bb22-0b63-4835-b37d-be154bae3cb9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:58.924256 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3f1bb22-0b63-4835-b37d-be154bae3cb9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:58.924754 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3f1bb22-0b63-4835-b37d-be154bae3cb9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:58.925223 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3f1bb22-0b63-4835-b37d-be154bae3cb9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:58.925918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3f1bb22-0b63-4835-b37d-be154bae3cb9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:58.929840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3f1bb22-0b63-4835-b37d-be154bae3cb9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:58.930325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3f1bb22-0b63-4835-b37d-be154bae3cb9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:59.214102 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d3f1bb22-0b63-4835-b37d-be154bae3cb9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:59.222743 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d3f1bb22-0b63-4835-b37d-be154bae3cb9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1469 microversion: 2.1 time: 0.340870 Aug 04 16:58:59.234400 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 602/1257] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:58 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1469 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:59.239375 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-84f39bd1-bb7d-4dad-aac0-1f8f703d2f93 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:59.242213 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:58:59.242213 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:58:59.244210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84f39bd1-bb7d-4dad-aac0-1f8f703d2f93 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:59.244878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84f39bd1-bb7d-4dad-aac0-1f8f703d2f93 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:59.246588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84f39bd1-bb7d-4dad-aac0-1f8f703d2f93 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:59.247400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84f39bd1-bb7d-4dad-aac0-1f8f703d2f93 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:59.247878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84f39bd1-bb7d-4dad-aac0-1f8f703d2f93 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:59.248314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84f39bd1-bb7d-4dad-aac0-1f8f703d2f93 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:59.330801 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-84f39bd1-bb7d-4dad-aac0-1f8f703d2f93 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.094901 Aug 04 16:58:59.331509 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 603/1258] 10.222.0.93 () {58 vars in 1170 bytes} [Thu Aug 4 16:58:59 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:59.332812 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-94dc6b0a-e237-4a33-9369-37c89bc4cc0a tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1811 microversion: 2.1 time: 0.483758 Aug 04 16:58:59.336085 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 656/1259] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:58 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1811 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:58:59.344127 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ccbf9da3-e4c7-4647-9dcf-e1be8d2e9493 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:59.363528 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:58:59.363528 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:58:59.367031 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0d8871bd-fe59-4389-9764-54be5d61a4a4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:59.367961 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0d8871bd-fe59-4389-9764-54be5d61a4a4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:59.371008 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ccbf9da3-e4c7-4647-9dcf-e1be8d2e9493 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:59.372390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ccbf9da3-e4c7-4647-9dcf-e1be8d2e9493 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:59.377358 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d8871bd-fe59-4389-9764-54be5d61a4a4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:59.378219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d8871bd-fe59-4389-9764-54be5d61a4a4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:59.378838 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ccbf9da3-e4c7-4647-9dcf-e1be8d2e9493 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:59.379165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d8871bd-fe59-4389-9764-54be5d61a4a4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:59.380340 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d8871bd-fe59-4389-9764-54be5d61a4a4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:59.381101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ccbf9da3-e4c7-4647-9dcf-e1be8d2e9493 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:59.381457 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d8871bd-fe59-4389-9764-54be5d61a4a4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:59.381575 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ccbf9da3-e4c7-4647-9dcf-e1be8d2e9493 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:59.382530 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d8871bd-fe59-4389-9764-54be5d61a4a4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:59.386624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ccbf9da3-e4c7-4647-9dcf-e1be8d2e9493 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:59.476433 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ccbf9da3-e4c7-4647-9dcf-e1be8d2e9493 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.135746 Aug 04 16:58:59.476965 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 657/1260] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Aug 4 16:58:59 2022] GET /compute/v2.1/os-services => generated 944 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:59.481928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ed96a73a-5ded-49d7-ad28-c500c7c59e0e tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:59.492116 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:58:59.492116 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:58:59.496430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed96a73a-5ded-49d7-ad28-c500c7c59e0e tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:59.496933 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed96a73a-5ded-49d7-ad28-c500c7c59e0e tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:59.497378 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed96a73a-5ded-49d7-ad28-c500c7c59e0e tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:59.498149 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed96a73a-5ded-49d7-ad28-c500c7c59e0e tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:59.498610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed96a73a-5ded-49d7-ad28-c500c7c59e0e tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:59.499038 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed96a73a-5ded-49d7-ad28-c500c7c59e0e tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:59.564197 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ed96a73a-5ded-49d7-ad28-c500c7c59e0e tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.086155 Aug 04 16:58:59.566690 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 658/1261] 10.222.0.93 () {58 vars in 1176 bytes} [Thu Aug 4 16:58:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:59.572727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9a4a7356-a4cb-4a3e-859f-9ca43f6361dc tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:59.585719 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:58:59.585719 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:58:59.588575 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9a4a7356-a4cb-4a3e-859f-9ca43f6361dc tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:59.590000 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9a4a7356-a4cb-4a3e-859f-9ca43f6361dc tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:59.591094 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9a4a7356-a4cb-4a3e-859f-9ca43f6361dc tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:59.591864 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9a4a7356-a4cb-4a3e-859f-9ca43f6361dc tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:59.592328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9a4a7356-a4cb-4a3e-859f-9ca43f6361dc tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:59.592752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9a4a7356-a4cb-4a3e-859f-9ca43f6361dc tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:59.674772 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9a4a7356-a4cb-4a3e-859f-9ca43f6361dc tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?host=n-d-851359-3&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.106157 Aug 04 16:58:59.684560 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 659/1262] 10.222.0.93 () {58 vars in 1194 bytes} [Thu Aug 4 16:58:59 2022] GET /compute/v2.1/os-services?host=n-d-851359-3&binary=xxx => generated 16 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:58:59.702959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-39762022-19a7-4cfd-897e-ec1b4826bd86 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:59.706847 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:58:59.706847 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:58:59.713337 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39762022-19a7-4cfd-897e-ec1b4826bd86 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:59.714282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39762022-19a7-4cfd-897e-ec1b4826bd86 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:59.717062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39762022-19a7-4cfd-897e-ec1b4826bd86 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:59.720922 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0d8871bd-fe59-4389-9764-54be5d61a4a4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:59.728895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39762022-19a7-4cfd-897e-ec1b4826bd86 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:59.730754 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39762022-19a7-4cfd-897e-ec1b4826bd86 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:59.731404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39762022-19a7-4cfd-897e-ec1b4826bd86 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:59.737210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0d8871bd-fe59-4389-9764-54be5d61a4a4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:59.739234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0d8871bd-fe59-4389-9764-54be5d61a4a4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:58:59.745520 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0d8871bd-fe59-4389-9764-54be5d61a4a4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 1410 microversion: 2.25 time: 0.412743 Aug 04 16:58:59.746471 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 604/1263] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:58:59 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 1410 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:58:59.794308 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-39762022-19a7-4cfd-897e-ec1b4826bd86 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.106771 Aug 04 16:58:59.812283 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 660/1264] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Aug 4 16:58:59 2022] GET /compute/v2.1/os-services => generated 944 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:58:59.818071 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-60184eee-d461-441b-85dc-09b50491a2a7 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:59.822522 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:58:59.822522 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:58:59.827084 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60184eee-d461-441b-85dc-09b50491a2a7 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:59.827611 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60184eee-d461-441b-85dc-09b50491a2a7 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:59.828064 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60184eee-d461-441b-85dc-09b50491a2a7 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:59.832823 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60184eee-d461-441b-85dc-09b50491a2a7 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:59.833326 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60184eee-d461-441b-85dc-09b50491a2a7 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:59.833774 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60184eee-d461-441b-85dc-09b50491a2a7 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:59.903014 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d83a213d-07fa-411a-9e4c-5e01ef297faf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:58:59.903832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d83a213d-07fa-411a-9e4c-5e01ef297faf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:58:59.916637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d83a213d-07fa-411a-9e4c-5e01ef297faf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:59.919963 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:DELETE=3,nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:58:59.922028 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d83a213d-07fa-411a-9e4c-5e01ef297faf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:59.922589 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d83a213d-07fa-411a-9e4c-5e01ef297faf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:59.925491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d83a213d-07fa-411a-9e4c-5e01ef297faf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:58:59.926031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d83a213d-07fa-411a-9e4c-5e01ef297faf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:58:59.928442 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d83a213d-07fa-411a-9e4c-5e01ef297faf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:58:59.955642 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-60184eee-d461-441b-85dc-09b50491a2a7 tempest-ServicesAdminNegativeTestJSON-701695195 tempest-ServicesAdminNegativeTestJSON-701695195-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.139707 Aug 04 16:58:59.957241 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 605/1265] 10.222.0.93 () {58 vars in 1198 bytes} [Thu Aug 4 16:58:59 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:59:00.276938 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0f6f45d5-079f-4450-8bb7-82568d5e32cb tempest-ServicesAdminNegativeTestJSON-430646944 tempest-ServicesAdminNegativeTestJSON-430646944-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:00.282405 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:59:00.282405 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:59:00.284864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0f6f45d5-079f-4450-8bb7-82568d5e32cb tempest-ServicesAdminNegativeTestJSON-430646944 tempest-ServicesAdminNegativeTestJSON-430646944-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'b10d2fff448644c4b4b9aa5b70d8234d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d8ac2a5aae34e8698aa1d5c19af25ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0f6f45d5-079f-4450-8bb7-82568d5e32cb tempest-ServicesAdminNegativeTestJSON-430646944 tempest-ServicesAdminNegativeTestJSON-430646944-project] Request method failure captured: Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_rQb_gkUWygFmk_bp-2sqEkXHlZDAeqLOXdS40tvRyhgnwgk4H99-t2DAHqlfCmdKXKISH9WhpWgqfIZIXmY3vMPL6qYlFeYlMAOAvhpRhPgph-xbv3QRD5AOxdIJwoIrtwi0_GqdVzIREwUQyrTX1OtBoWFXrhYZGQ9qqoh364JGw Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 0d8ac2a5aae34e8698aa1d5c19af25ac Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-430646944 Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0d8ac2a5aae34e8698aa1d5c19af25ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0d8ac2a5aae34e8698aa1d5c19af25ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0d8ac2a5aae34e8698aa1d5c19af25ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0d8ac2a5aae34e8698aa1d5c19af25ac"}]}] Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-430646944 Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 0d8ac2a5aae34e8698aa1d5c19af25ac Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-430646944 Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServicesAdminNegativeTestJSON-430646944-project Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: b10d2fff448644c4b4b9aa5b70d8234d Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-430646944-project Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: action_args: {} Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 04 16:59:00.296071 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:00.301185 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:00.301185 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:00.301185 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:00.301185 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:00.301185 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:00.301185 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 16:59:00.301185 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 16:59:00.301185 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 04 16:59:00.301185 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:00.303932 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0f6f45d5-079f-4450-8bb7-82568d5e32cb tempest-ServicesAdminNegativeTestJSON-430646944 tempest-ServicesAdminNegativeTestJSON-430646944-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:59:00.306973 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0f6f45d5-079f-4450-8bb7-82568d5e32cb tempest-ServicesAdminNegativeTestJSON-430646944 tempest-ServicesAdminNegativeTestJSON-430646944-project] 10.222.0.93 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.340975 Aug 04 16:59:00.310981 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 606/1266] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Aug 4 16:58:59 2022] GET /compute/v2.1/os-services => generated 112 bytes in 346 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:59:00.327275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4e03c954-b88c-4b32-8e13-fe3388aa8be3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:00.338430 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4e03c954-b88c-4b32-8e13-fe3388aa8be3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:00.372184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e03c954-b88c-4b32-8e13-fe3388aa8be3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:00.376236 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e03c954-b88c-4b32-8e13-fe3388aa8be3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:00.377034 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e03c954-b88c-4b32-8e13-fe3388aa8be3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:00.378226 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e03c954-b88c-4b32-8e13-fe3388aa8be3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:00.378889 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e03c954-b88c-4b32-8e13-fe3388aa8be3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:00.379612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e03c954-b88c-4b32-8e13-fe3388aa8be3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:00.968149 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d83a213d-07fa-411a-9e4c-5e01ef297faf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:00.977409 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d83a213d-07fa-411a-9e4c-5e01ef297faf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1473 microversion: 2.1 time: 1.080372 Aug 04 16:59:00.981820 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 661/1267] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:58:59 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1473 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:01.010172 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0c778aa9-eacd-4bcd-9bf0-a525cb906a48 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:01.011733 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0c778aa9-eacd-4bcd-9bf0-a525cb906a48 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:01.045690 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c778aa9-eacd-4bcd-9bf0-a525cb906a48 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:01.047959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c778aa9-eacd-4bcd-9bf0-a525cb906a48 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:01.048620 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c778aa9-eacd-4bcd-9bf0-a525cb906a48 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:01.051919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c778aa9-eacd-4bcd-9bf0-a525cb906a48 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:01.054475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c778aa9-eacd-4bcd-9bf0-a525cb906a48 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:01.055535 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c778aa9-eacd-4bcd-9bf0-a525cb906a48 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:01.123171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4e03c954-b88c-4b32-8e13-fe3388aa8be3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:01.132375 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4e03c954-b88c-4b32-8e13-fe3388aa8be3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1469 microversion: 2.1 time: 0.817563 Aug 04 16:59:01.132946 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 607/1268] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:00 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1469 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:02.012762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9850f5f0-f4db-40c7-a3a9-8a2be3c39fbd tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:02.013561 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9850f5f0-f4db-40c7-a3a9-8a2be3c39fbd tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:02.053492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9850f5f0-f4db-40c7-a3a9-8a2be3c39fbd tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:02.054442 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9850f5f0-f4db-40c7-a3a9-8a2be3c39fbd tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:02.055075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9850f5f0-f4db-40c7-a3a9-8a2be3c39fbd tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:02.056793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9850f5f0-f4db-40c7-a3a9-8a2be3c39fbd tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:02.066823 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9850f5f0-f4db-40c7-a3a9-8a2be3c39fbd tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:02.068472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9850f5f0-f4db-40c7-a3a9-8a2be3c39fbd tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:02.444485 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0c778aa9-eacd-4bcd-9bf0-a525cb906a48 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:02.460649 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0c778aa9-eacd-4bcd-9bf0-a525cb906a48 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:02.483744 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0c778aa9-eacd-4bcd-9bf0-a525cb906a48 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:02.489372 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0c778aa9-eacd-4bcd-9bf0-a525cb906a48 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 1410 microversion: 2.25 time: 1.496874 Aug 04 16:59:02.499003 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 662/1269] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:59:00 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 1410 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:59:02.515433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a6a2549a-a1a4-41f1-88c7-32bd3bfa03a3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:02.516367 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a6a2549a-a1a4-41f1-88c7-32bd3bfa03a3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:02.528491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6a2549a-a1a4-41f1-88c7-32bd3bfa03a3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:02.534846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6a2549a-a1a4-41f1-88c7-32bd3bfa03a3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:02.535646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6a2549a-a1a4-41f1-88c7-32bd3bfa03a3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:02.536921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6a2549a-a1a4-41f1-88c7-32bd3bfa03a3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:02.537760 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6a2549a-a1a4-41f1-88c7-32bd3bfa03a3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:02.538699 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6a2549a-a1a4-41f1-88c7-32bd3bfa03a3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:02.579998 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9850f5f0-f4db-40c7-a3a9-8a2be3c39fbd tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:02.597102 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9850f5f0-f4db-40c7-a3a9-8a2be3c39fbd tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1479 microversion: 2.1 time: 0.599013 Aug 04 16:59:02.598341 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 608/1270] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:01 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1479 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:02.605377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-744a8a15-5ba7-4573-a1a2-d461b737ca8d req-3cfc55bb-e323-4799-8a2b-a3d7839d355a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1250487f-b35f-4803-b7b3-a9a80850fa12", "name": "network-vif-plugged", "status": "completed", "tag": "167d17c7-b0d3-40d2-8410-10740bd6347f"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:02.636125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-744a8a15-5ba7-4573-a1a2-d461b737ca8d req-3cfc55bb-e323-4799-8a2b-a3d7839d355a service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:02.640083 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-744a8a15-5ba7-4573-a1a2-d461b737ca8d req-3cfc55bb-e323-4799-8a2b-a3d7839d355a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:02.640914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-744a8a15-5ba7-4573-a1a2-d461b737ca8d req-3cfc55bb-e323-4799-8a2b-a3d7839d355a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:02.663134 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-744a8a15-5ba7-4573-a1a2-d461b737ca8d req-3cfc55bb-e323-4799-8a2b-a3d7839d355a service nova] Creating event network-vif-plugged:167d17c7-b0d3-40d2-8410-10740bd6347f for instance 1250487f-b35f-4803-b7b3-a9a80850fa12 on n-h1-851359-3 Aug 04 16:59:02.670800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-744a8a15-5ba7-4573-a1a2-d461b737ca8d req-3cfc55bb-e323-4799-8a2b-a3d7839d355a service nova] Instance 1250487f-b35f-4803-b7b3-a9a80850fa12 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 16:59:02.683988 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-744a8a15-5ba7-4573-a1a2-d461b737ca8d req-3cfc55bb-e323-4799-8a2b-a3d7839d355a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084196 Aug 04 16:59:02.685015 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 609/1271] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:02.887716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d0d42150-5abe-40bf-a176-99c5dccf41cf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c36f65b0-3829-4c98-afb3-9eb57f33b092", "device": "/dev/xvdb"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:02.891699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d0d42150-5abe-40bf-a176-99c5dccf41cf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:02.939341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0d42150-5abe-40bf-a176-99c5dccf41cf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:02.940709 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0d42150-5abe-40bf-a176-99c5dccf41cf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:02.941418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0d42150-5abe-40bf-a176-99c5dccf41cf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:02.943656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0d42150-5abe-40bf-a176-99c5dccf41cf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:02.945189 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0d42150-5abe-40bf-a176-99c5dccf41cf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:02.945867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0d42150-5abe-40bf-a176-99c5dccf41cf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:03.097961 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a6a2549a-a1a4-41f1-88c7-32bd3bfa03a3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:03.111273 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a6a2549a-a1a4-41f1-88c7-32bd3bfa03a3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1469 microversion: 2.1 time: 0.609831 Aug 04 16:59:03.121315 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 663/1272] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:02 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1469 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:03.528451 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-32096c6f-7377-4556-8b40-7ea09fdb4a76 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:03.532984 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-32096c6f-7377-4556-8b40-7ea09fdb4a76 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:03.553434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32096c6f-7377-4556-8b40-7ea09fdb4a76 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:03.554122 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32096c6f-7377-4556-8b40-7ea09fdb4a76 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:03.554578 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32096c6f-7377-4556-8b40-7ea09fdb4a76 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:03.555312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32096c6f-7377-4556-8b40-7ea09fdb4a76 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:03.555814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32096c6f-7377-4556-8b40-7ea09fdb4a76 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:03.556506 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32096c6f-7377-4556-8b40-7ea09fdb4a76 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:03.906803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-32096c6f-7377-4556-8b40-7ea09fdb4a76 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:03.926947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-32096c6f-7377-4556-8b40-7ea09fdb4a76 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:03.933607 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-32096c6f-7377-4556-8b40-7ea09fdb4a76 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:03.939702 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-32096c6f-7377-4556-8b40-7ea09fdb4a76 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 1410 microversion: 2.25 time: 0.418190 Aug 04 16:59:03.943415 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 664/1273] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:59:03 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 1410 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:59:03.960971 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2e44936a-4d40-491f-9cee-726ecfb32a91 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:03.969241 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2e44936a-4d40-491f-9cee-726ecfb32a91 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:03.992870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2e44936a-4d40-491f-9cee-726ecfb32a91 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:03.993673 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2e44936a-4d40-491f-9cee-726ecfb32a91 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:03.994403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2e44936a-4d40-491f-9cee-726ecfb32a91 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:03.995528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2e44936a-4d40-491f-9cee-726ecfb32a91 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:03.998395 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2e44936a-4d40-491f-9cee-726ecfb32a91 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:03.999158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2e44936a-4d40-491f-9cee-726ecfb32a91 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:04.395800 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2e44936a-4d40-491f-9cee-726ecfb32a91 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:04.412654 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2e44936a-4d40-491f-9cee-726ecfb32a91 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1479 microversion: 2.1 time: 0.464823 Aug 04 16:59:04.422812 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 665/1274] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:03 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1479 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:04.446874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bef62905-83f9-4a81-b5a0-adfe485b8788 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:04.449126 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bef62905-83f9-4a81-b5a0-adfe485b8788 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:04.476496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bef62905-83f9-4a81-b5a0-adfe485b8788 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:04.477933 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bef62905-83f9-4a81-b5a0-adfe485b8788 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:04.479185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bef62905-83f9-4a81-b5a0-adfe485b8788 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:04.480154 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bef62905-83f9-4a81-b5a0-adfe485b8788 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:04.483424 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bef62905-83f9-4a81-b5a0-adfe485b8788 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:04.483906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bef62905-83f9-4a81-b5a0-adfe485b8788 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:04.879103 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bef62905-83f9-4a81-b5a0-adfe485b8788 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:04.902750 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bef62905-83f9-4a81-b5a0-adfe485b8788 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1469 microversion: 2.1 time: 0.457566 Aug 04 16:59:04.903970 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 666/1275] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:04 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1469 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:04.913200 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-a93b1407-0cb0-4c8a-a365-7faa352ea85a req-982f3ad9-9ba9-4308-94be-ea78081f0f87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afea0f77-8d91-4170-934f-b6b7ef64d5a6", "name": "network-vif-plugged", "status": "completed", "tag": "9e2d842c-859e-4f10-8b78-924c2156cf47"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:04.944873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a93b1407-0cb0-4c8a-a365-7faa352ea85a req-982f3ad9-9ba9-4308-94be-ea78081f0f87 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:04.944873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a93b1407-0cb0-4c8a-a365-7faa352ea85a req-982f3ad9-9ba9-4308-94be-ea78081f0f87 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:04.946922 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a93b1407-0cb0-4c8a-a365-7faa352ea85a req-982f3ad9-9ba9-4308-94be-ea78081f0f87 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:04.991410 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-a93b1407-0cb0-4c8a-a365-7faa352ea85a req-982f3ad9-9ba9-4308-94be-ea78081f0f87 service nova] Creating event network-vif-plugged:9e2d842c-859e-4f10-8b78-924c2156cf47 for instance afea0f77-8d91-4170-934f-b6b7ef64d5a6 on n-h1-851359-3 Aug 04 16:59:05.023090 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-a93b1407-0cb0-4c8a-a365-7faa352ea85a req-982f3ad9-9ba9-4308-94be-ea78081f0f87 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109512 Aug 04 16:59:05.027732 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 667/1276] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:05.043186 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e891579b-764c-469b-9ebc-7d1d1b9bfa1a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:05.043903 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e891579b-764c-469b-9ebc-7d1d1b9bfa1a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:05.066219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e891579b-764c-469b-9ebc-7d1d1b9bfa1a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:05.066719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e891579b-764c-469b-9ebc-7d1d1b9bfa1a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:05.067176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e891579b-764c-469b-9ebc-7d1d1b9bfa1a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:05.067879 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e891579b-764c-469b-9ebc-7d1d1b9bfa1a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:05.068340 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e891579b-764c-469b-9ebc-7d1d1b9bfa1a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:05.068767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e891579b-764c-469b-9ebc-7d1d1b9bfa1a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:05.454623 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e891579b-764c-469b-9ebc-7d1d1b9bfa1a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:05.483273 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e891579b-764c-469b-9ebc-7d1d1b9bfa1a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:05.490347 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e891579b-764c-469b-9ebc-7d1d1b9bfa1a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:05.490347 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e891579b-764c-469b-9ebc-7d1d1b9bfa1a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 1410 microversion: 2.25 time: 0.456325 Aug 04 16:59:05.490347 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 668/1277] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:59:05 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 1410 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:59:05.806557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9efe1d84-f008-41be-abc2-f2bf26a52075 tempest-SecurityGroupsNegativeTestJSON-1192170233 tempest-SecurityGroupsNegativeTestJSON-1192170233-project] Calling method '.version_select at 0x7f1e6cb61040>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:05.878511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG neutronclient.v2_0.client [None req-9efe1d84-f008-41be-abc2-f2bf26a52075 tempest-SecurityGroupsNegativeTestJSON-1192170233 tempest-SecurityGroupsNegativeTestJSON-1192170233-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 07034f3d-2bb4-42aa-98a6-f736ec42df0d does not exist", "detail": ""}} {{(pid=131043) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:59:05.879409 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.security_group_api [None req-9efe1d84-f008-41be-abc2-f2bf26a52075 tempest-SecurityGroupsNegativeTestJSON-1192170233 tempest-SecurityGroupsNegativeTestJSON-1192170233-project] Neutron security group 07034f3d-2bb4-42aa-98a6-f736ec42df0d not found {{(pid=131043) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 16:59:05.880205 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-9efe1d84-f008-41be-abc2-f2bf26a52075 tempest-SecurityGroupsNegativeTestJSON-1192170233 tempest-SecurityGroupsNegativeTestJSON-1192170233-project] HTTP exception thrown: Security group 07034f3d-2bb4-42aa-98a6-f736ec42df0d does not exist Aug 04 16:59:05.880205 n-d-851359-3 devstack@n-api.service[131043]: Neutron server returns request_ids: ['req-368954e6-7a93-4f8c-bb0f-47d5001922c5'] Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9efe1d84-f008-41be-abc2-f2bf26a52075 tempest-SecurityGroupsNegativeTestJSON-1192170233 tempest-SecurityGroupsNegativeTestJSON-1192170233-project] Request method failure captured: Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/os-security-groups/07034f3d-2bb4-42aa-98a6-f736ec42df0d HTTP/1.1 Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_rZGuVrF-C44D4J4ti-FUg3VTkm-czE0A7pfOdtzQyn7DWdsIHVw5_TNLW7yvge4a01c_9txJ_mWAjXH9_toMp3iNo91-4o37ITglqlC2P2DeUlMJnbDRfIZXnCg-iWcUyD4f0z2IT7CNlS3YUipkDm1WXY6Kw4vGBIH61Rx--AcWY Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 59284b34adf64c2aadf970214cf25e98 Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1192170233 Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/59284b34adf64c2aadf970214cf25e98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/59284b34adf64c2aadf970214cf25e98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_59284b34adf64c2aadf970214cf25e98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/59284b34adf64c2aadf970214cf25e98"}]}] Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1192170233 Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 59284b34adf64c2aadf970214cf25e98 Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1192170233 Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-SecurityGroupsNegativeTestJSON-1192170233-project Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: c02215a88ab94bb6a1aa86f84b2da966 Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1192170233-project Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: exception: Security group 07034f3d-2bb4-42aa-98a6-f736ec42df0d does not exist Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: Neutron server returns request_ids: ['req-368954e6-7a93-4f8c-bb0f-47d5001922c5'] Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '07034f3d-2bb4-42aa-98a6-f736ec42df0d'} Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:59:05.882654 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 07034f3d-2bb4-42aa-98a6-f736ec42df0d does not exist Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-368954e6-7a93-4f8c-bb0f-47d5001922c5'] Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 07034f3d-2bb4-42aa-98a6-f736ec42df0d does not exist Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-368954e6-7a93-4f8c-bb0f-47d5001922c5'] Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 07034f3d-2bb4-42aa-98a6-f736ec42df0d does not exist Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-368954e6-7a93-4f8c-bb0f-47d5001922c5'] Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 07034f3d-2bb4-42aa-98a6-f736ec42df0d does not exist Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-368954e6-7a93-4f8c-bb0f-47d5001922c5'] Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9efe1d84-f008-41be-abc2-f2bf26a52075 tempest-SecurityGroupsNegativeTestJSON-1192170233 tempest-SecurityGroupsNegativeTestJSON-1192170233-project] Returning 404 to user: Security group 07034f3d-2bb4-42aa-98a6-f736ec42df0d does not exist Aug 04 16:59:05.888487 n-d-851359-3 devstack@n-api.service[131043]: Neutron server returns request_ids: ['req-368954e6-7a93-4f8c-bb0f-47d5001922c5'] {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:59:05.894105 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9efe1d84-f008-41be-abc2-f2bf26a52075 tempest-SecurityGroupsNegativeTestJSON-1192170233 tempest-SecurityGroupsNegativeTestJSON-1192170233-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/07034f3d-2bb4-42aa-98a6-f736ec42df0d" status: 404 len: 194 microversion: 2.1 time: 0.397750 Aug 04 16:59:05.897664 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 669/1278] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 16:59:05 2022] DELETE /compute/v2.1/os-security-groups/07034f3d-2bb4-42aa-98a6-f736ec42df0d => generated 194 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:59:05.905041 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ea9f50d5-44a0-400e-aaa2-9bd04a80e39c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:05.905813 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ea9f50d5-44a0-400e-aaa2-9bd04a80e39c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:05.917646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:05.920542 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea9f50d5-44a0-400e-aaa2-9bd04a80e39c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:05.921041 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea9f50d5-44a0-400e-aaa2-9bd04a80e39c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:05.922832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea9f50d5-44a0-400e-aaa2-9bd04a80e39c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:05.924097 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea9f50d5-44a0-400e-aaa2-9bd04a80e39c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:05.925301 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea9f50d5-44a0-400e-aaa2-9bd04a80e39c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:05.939429 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea9f50d5-44a0-400e-aaa2-9bd04a80e39c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:06.220230 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ea9f50d5-44a0-400e-aaa2-9bd04a80e39c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:06.229928 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ea9f50d5-44a0-400e-aaa2-9bd04a80e39c tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1479 microversion: 2.1 time: 0.330775 Aug 04 16:59:06.231201 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 670/1279] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:05 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1479 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:06.242642 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5e5a08a9-1928-4fe6-8e15-4ba3091715c2 tempest-SecurityGroupsNegativeTestJSON-1192170233 tempest-SecurityGroupsNegativeTestJSON-1192170233-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.007506 Aug 04 16:59:06.243656 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 671/1280] 10.222.0.93 () {58 vars in 1164 bytes} [Thu Aug 4 16:59:06 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 16:59:06.250092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f0191f86-57ba-4032-a16d-da76f70c47c2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:06.251278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f0191f86-57ba-4032-a16d-da76f70c47c2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:06.259300 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f0191f86-57ba-4032-a16d-da76f70c47c2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:06.260148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f0191f86-57ba-4032-a16d-da76f70c47c2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:06.260822 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f0191f86-57ba-4032-a16d-da76f70c47c2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:06.262165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f0191f86-57ba-4032-a16d-da76f70c47c2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:06.262871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f0191f86-57ba-4032-a16d-da76f70c47c2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:06.263526 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f0191f86-57ba-4032-a16d-da76f70c47c2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:06.278693 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:06.694106 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f0191f86-57ba-4032-a16d-da76f70c47c2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:06.708743 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f0191f86-57ba-4032-a16d-da76f70c47c2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1469 microversion: 2.1 time: 0.461394 Aug 04 16:59:06.710676 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 672/1281] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:06 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1469 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:06.722010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1da79f9b-a068-4cf8-86b6-8c6b8ff5c180 tempest-SecurityGroupsNegativeTestJSON-1192170233 tempest-SecurityGroupsNegativeTestJSON-1192170233-project] Calling method '.version_select at 0x7f1e6cb4b5e0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:07.024149 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1da79f9b-a068-4cf8-86b6-8c6b8ff5c180 tempest-SecurityGroupsNegativeTestJSON-1192170233 tempest-SecurityGroupsNegativeTestJSON-1192170233-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.310656 Aug 04 16:59:07.026228 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 673/1282] 10.222.0.93 () {58 vars in 1158 bytes} [Thu Aug 4 16:59:06 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:07.032924 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f9b31f97-8434-47a7-9c3b-bf9c7f56b2db tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:07.033819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f9b31f97-8434-47a7-9c3b-bf9c7f56b2db tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:07.048340 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9b31f97-8434-47a7-9c3b-bf9c7f56b2db tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:07.049190 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9b31f97-8434-47a7-9c3b-bf9c7f56b2db tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:07.051118 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9b31f97-8434-47a7-9c3b-bf9c7f56b2db tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:07.053269 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9b31f97-8434-47a7-9c3b-bf9c7f56b2db tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:07.055307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9b31f97-8434-47a7-9c3b-bf9c7f56b2db tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:07.056918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9b31f97-8434-47a7-9c3b-bf9c7f56b2db tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:07.269002 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d0d42150-5abe-40bf-a176-99c5dccf41cf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "POST /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.386872 Aug 04 16:59:07.272014 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 610/1283] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Aug 4 16:59:02 2022] POST /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb/os-volume_attachments => generated 194 bytes in 4398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:07.290389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-49d222ac-3a53-4f2b-9aa1-aae220472109 tempest-SecurityGroupsNegativeTestJSON-1192170233 tempest-SecurityGroupsNegativeTestJSON-1192170233-project] Calling method '.version_select at 0x7f1e5b3a8700>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:07.548008 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f9b31f97-8434-47a7-9c3b-bf9c7f56b2db tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:07.561004 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f9b31f97-8434-47a7-9c3b-bf9c7f56b2db tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:07.566704 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f9b31f97-8434-47a7-9c3b-bf9c7f56b2db tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:07.572163 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f9b31f97-8434-47a7-9c3b-bf9c7f56b2db tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 1605 microversion: 2.25 time: 0.541882 Aug 04 16:59:07.574108 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 674/1284] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:59:07 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 1605 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:59:07.588095 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-bed5b3f7-674c-400b-b81c-3dbec7b8159d req-8e3041dc-323b-478f-9da5-96090ab8e5af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19c5ab52-7c2b-4d63-8628-43c75476e45c", "name": "network-vif-unplugged", "status": "completed", "tag": "134ee327-dd36-4c6e-b53f-b97914e333e8"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:07.614783 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-bed5b3f7-674c-400b-b81c-3dbec7b8159d req-8e3041dc-323b-478f-9da5-96090ab8e5af service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:07.617597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-bed5b3f7-674c-400b-b81c-3dbec7b8159d req-8e3041dc-323b-478f-9da5-96090ab8e5af service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:07.621203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-bed5b3f7-674c-400b-b81c-3dbec7b8159d req-8e3041dc-323b-478f-9da5-96090ab8e5af service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:07.652017 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-bed5b3f7-674c-400b-b81c-3dbec7b8159d req-8e3041dc-323b-478f-9da5-96090ab8e5af service nova] Creating event network-vif-unplugged:134ee327-dd36-4c6e-b53f-b97914e333e8 for instance 19c5ab52-7c2b-4d63-8628-43c75476e45c on n-h2-851359-3 Aug 04 16:59:07.662665 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-bed5b3f7-674c-400b-b81c-3dbec7b8159d req-8e3041dc-323b-478f-9da5-96090ab8e5af service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085831 Aug 04 16:59:07.663430 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 675/1285] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:07.671500 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f55bbfa2-ff11-46fe-87f0-acca857ace93 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:07.672260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f55bbfa2-ff11-46fe-87f0-acca857ace93 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:07.679257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f55bbfa2-ff11-46fe-87f0-acca857ace93 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:07.679923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f55bbfa2-ff11-46fe-87f0-acca857ace93 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:07.680624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f55bbfa2-ff11-46fe-87f0-acca857ace93 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:07.681684 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f55bbfa2-ff11-46fe-87f0-acca857ace93 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:07.682187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f55bbfa2-ff11-46fe-87f0-acca857ace93 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:07.682806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f55bbfa2-ff11-46fe-87f0-acca857ace93 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:07.840352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG neutronclient.v2_0.client [None req-49d222ac-3a53-4f2b-9aa1-aae220472109 tempest-SecurityGroupsNegativeTestJSON-1192170233 tempest-SecurityGroupsNegativeTestJSON-1192170233-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=131044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:59:07.841161 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-49d222ac-3a53-4f2b-9aa1-aae220472109 tempest-SecurityGroupsNegativeTestJSON-1192170233 tempest-SecurityGroupsNegativeTestJSON-1192170233-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 04 16:59:07.841161 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-d4d7e279-9e58-479d-b189-0949b7dbecf2'] Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-49d222ac-3a53-4f2b-9aa1-aae220472109 tempest-SecurityGroupsNegativeTestJSON-1192170233 tempest-SecurityGroupsNegativeTestJSON-1192170233-project] Request method failure captured: Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/os-security-groups/b380a30c-87cf-4621-9961-2547140496bf HTTP/1.1 Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_rZGuVrF-C44D4J4ti-FUg3VTkm-czE0A7pfOdtzQyn7DWdsIHVw5_TNLW7yvge4a01c_9txJ_mWAjXH9_toMp3iNo91-4o37ITglqlC2P2DeUlMJnbDRfIZXnCg-iWcUyD4f0z2IT7CNlS3YUipkDm1WXY6Kw4vGBIH61Rx--AcWY Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 59284b34adf64c2aadf970214cf25e98 Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1192170233 Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/59284b34adf64c2aadf970214cf25e98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/59284b34adf64c2aadf970214cf25e98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_59284b34adf64c2aadf970214cf25e98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/59284b34adf64c2aadf970214cf25e98"}]}] Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1192170233 Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 59284b34adf64c2aadf970214cf25e98 Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1192170233 Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-SecurityGroupsNegativeTestJSON-1192170233-project Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: c02215a88ab94bb6a1aa86f84b2da966 Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1192170233-project Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: exception: Insufficient rights for removing default security group. Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-d4d7e279-9e58-479d-b189-0949b7dbecf2'] Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'b380a30c-87cf-4621-9961-2547140496bf'} Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:59:07.843651 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d4d7e279-9e58-479d-b189-0949b7dbecf2'] Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d4d7e279-9e58-479d-b189-0949b7dbecf2'] Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d4d7e279-9e58-479d-b189-0949b7dbecf2'] Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d4d7e279-9e58-479d-b189-0949b7dbecf2'] Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-49d222ac-3a53-4f2b-9aa1-aae220472109 tempest-SecurityGroupsNegativeTestJSON-1192170233 tempest-SecurityGroupsNegativeTestJSON-1192170233-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-d4d7e279-9e58-479d-b189-0949b7dbecf2'] {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-49d222ac-3a53-4f2b-9aa1-aae220472109 tempest-SecurityGroupsNegativeTestJSON-1192170233 tempest-SecurityGroupsNegativeTestJSON-1192170233-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/b380a30c-87cf-4621-9961-2547140496bf" status: 400 len: 182 microversion: 2.1 time: 0.571674 Aug 04 16:59:07.851031 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 611/1286] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 16:59:07 2022] DELETE /compute/v2.1/os-security-groups/b380a30c-87cf-4621-9961-2547140496bf => generated 182 bytes in 573 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:59:07.858691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-211dfbb6-2100-4e59-8654-7c780ecc7ff1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:07.858691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-211dfbb6-2100-4e59-8654-7c780ecc7ff1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:07.876654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-211dfbb6-2100-4e59-8654-7c780ecc7ff1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:07.878053 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-211dfbb6-2100-4e59-8654-7c780ecc7ff1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:07.879234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-211dfbb6-2100-4e59-8654-7c780ecc7ff1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:07.880359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-211dfbb6-2100-4e59-8654-7c780ecc7ff1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:07.881220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-211dfbb6-2100-4e59-8654-7c780ecc7ff1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:07.881853 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-211dfbb6-2100-4e59-8654-7c780ecc7ff1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:08.006489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f55bbfa2-ff11-46fe-87f0-acca857ace93 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:08.017771 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f55bbfa2-ff11-46fe-87f0-acca857ace93 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1479 microversion: 2.1 time: 0.352716 Aug 04 16:59:08.018398 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 676/1287] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:07 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1479 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:08.025528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a9852454-eff1-4001-963d-49c0526fbff5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:08.030874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a9852454-eff1-4001-963d-49c0526fbff5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:08.036848 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-211dfbb6-2100-4e59-8654-7c780ecc7ff1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.189281 Aug 04 16:59:08.039046 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 612/1288] 10.222.0.93 () {60 vars in 1316 bytes} [Thu Aug 4 16:59:07 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6/os-interface => generated 285 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:59:08.051932 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0a1f7103-aec0-4c2f-9971-c132331d794b tempest-SecurityGroupsNegativeTestJSON-1192170233 tempest-SecurityGroupsNegativeTestJSON-1192170233-project] Calling method '.version_select at 0x7f1e5b499a60>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:08.053451 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a9852454-eff1-4001-963d-49c0526fbff5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:08.057600 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a9852454-eff1-4001-963d-49c0526fbff5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:08.059058 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a9852454-eff1-4001-963d-49c0526fbff5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:08.060817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a9852454-eff1-4001-963d-49c0526fbff5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:08.062736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a9852454-eff1-4001-963d-49c0526fbff5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:08.063335 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a9852454-eff1-4001-963d-49c0526fbff5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:08.184696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG neutronclient.v2_0.client [None req-0a1f7103-aec0-4c2f-9971-c132331d794b tempest-SecurityGroupsNegativeTestJSON-1192170233 tempest-SecurityGroupsNegativeTestJSON-1192170233-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f054ed30-a512-4f35-a1d8-04010b19c742 does not exist", "detail": ""}} {{(pid=131044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:59:08.185774 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.security_group_api [None req-0a1f7103-aec0-4c2f-9971-c132331d794b tempest-SecurityGroupsNegativeTestJSON-1192170233 tempest-SecurityGroupsNegativeTestJSON-1192170233-project] Neutron security group f054ed30-a512-4f35-a1d8-04010b19c742 not found {{(pid=131044) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 16:59:08.186515 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-0a1f7103-aec0-4c2f-9971-c132331d794b tempest-SecurityGroupsNegativeTestJSON-1192170233 tempest-SecurityGroupsNegativeTestJSON-1192170233-project] HTTP exception thrown: Security group f054ed30-a512-4f35-a1d8-04010b19c742 does not exist Aug 04 16:59:08.186515 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-22d97b6d-d4c5-481a-b70d-7a0a1ae3b51f'] Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0a1f7103-aec0-4c2f-9971-c132331d794b tempest-SecurityGroupsNegativeTestJSON-1192170233 tempest-SecurityGroupsNegativeTestJSON-1192170233-project] Request method failure captured: Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-security-groups/f054ed30-a512-4f35-a1d8-04010b19c742 HTTP/1.1 Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_rZGuVrF-C44D4J4ti-FUg3VTkm-czE0A7pfOdtzQyn7DWdsIHVw5_TNLW7yvge4a01c_9txJ_mWAjXH9_toMp3iNo91-4o37ITglqlC2P2DeUlMJnbDRfIZXnCg-iWcUyD4f0z2IT7CNlS3YUipkDm1WXY6Kw4vGBIH61Rx--AcWY Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 59284b34adf64c2aadf970214cf25e98 Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1192170233 Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/59284b34adf64c2aadf970214cf25e98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/59284b34adf64c2aadf970214cf25e98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_59284b34adf64c2aadf970214cf25e98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/59284b34adf64c2aadf970214cf25e98"}]}] Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1192170233 Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 59284b34adf64c2aadf970214cf25e98 Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1192170233 Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-SecurityGroupsNegativeTestJSON-1192170233-project Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: c02215a88ab94bb6a1aa86f84b2da966 Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1192170233-project Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: exception: Security group f054ed30-a512-4f35-a1d8-04010b19c742 does not exist Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-22d97b6d-d4c5-481a-b70d-7a0a1ae3b51f'] Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'f054ed30-a512-4f35-a1d8-04010b19c742'} Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:59:08.189686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f054ed30-a512-4f35-a1d8-04010b19c742 does not exist Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22d97b6d-d4c5-481a-b70d-7a0a1ae3b51f'] Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f054ed30-a512-4f35-a1d8-04010b19c742 does not exist Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22d97b6d-d4c5-481a-b70d-7a0a1ae3b51f'] Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f054ed30-a512-4f35-a1d8-04010b19c742 does not exist Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22d97b6d-d4c5-481a-b70d-7a0a1ae3b51f'] Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f054ed30-a512-4f35-a1d8-04010b19c742 does not exist Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22d97b6d-d4c5-481a-b70d-7a0a1ae3b51f'] Aug 04 16:59:08.195015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:08.199583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0a1f7103-aec0-4c2f-9971-c132331d794b tempest-SecurityGroupsNegativeTestJSON-1192170233 tempest-SecurityGroupsNegativeTestJSON-1192170233-project] Returning 404 to user: Security group f054ed30-a512-4f35-a1d8-04010b19c742 does not exist Aug 04 16:59:08.199583 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-22d97b6d-d4c5-481a-b70d-7a0a1ae3b51f'] {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:59:08.200857 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0a1f7103-aec0-4c2f-9971-c132331d794b tempest-SecurityGroupsNegativeTestJSON-1192170233 tempest-SecurityGroupsNegativeTestJSON-1192170233-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups/f054ed30-a512-4f35-a1d8-04010b19c742" status: 404 len: 194 microversion: 2.1 time: 0.160745 Aug 04 16:59:08.203513 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 613/1289] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Aug 4 16:59:08 2022] GET /compute/v2.1/os-security-groups/f054ed30-a512-4f35-a1d8-04010b19c742 => generated 194 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:59:08.212934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0e9295fa-0aad-4da4-a68d-0824831d818a tempest-SecurityGroupsNegativeTestJSON-1192170233 tempest-SecurityGroupsNegativeTestJSON-1192170233-project] Action: 'update', calling method: .version_select at 0x7f1e5b389d30>, body: {"security_group": {"name": "tempest-sg-793325783", "description": "tempest-description-157183857"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:08.301951 n-d-851359-3 devstack@n-api.service[131044]: DEBUG neutronclient.v2_0.client [None req-0e9295fa-0aad-4da4-a68d-0824831d818a tempest-SecurityGroupsNegativeTestJSON-1192170233 tempest-SecurityGroupsNegativeTestJSON-1192170233-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e9c73c4b-0c3d-4b68-aee4-321eaffb0164 does not exist", "detail": ""}} {{(pid=131044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 16:59:08.303092 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.security_group_api [None req-0e9295fa-0aad-4da4-a68d-0824831d818a tempest-SecurityGroupsNegativeTestJSON-1192170233 tempest-SecurityGroupsNegativeTestJSON-1192170233-project] Neutron security group e9c73c4b-0c3d-4b68-aee4-321eaffb0164 not found {{(pid=131044) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 16:59:08.303624 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-0e9295fa-0aad-4da4-a68d-0824831d818a tempest-SecurityGroupsNegativeTestJSON-1192170233 tempest-SecurityGroupsNegativeTestJSON-1192170233-project] HTTP exception thrown: Security group e9c73c4b-0c3d-4b68-aee4-321eaffb0164 does not exist Aug 04 16:59:08.303624 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-2cd0e1ea-b23e-4edf-8a35-c6e7f11f3ef7'] Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0e9295fa-0aad-4da4-a68d-0824831d818a tempest-SecurityGroupsNegativeTestJSON-1192170233 tempest-SecurityGroupsNegativeTestJSON-1192170233-project] Request method failure captured: Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: request: PUT /compute/v2.1/os-security-groups/e9c73c4b-0c3d-4b68-aee4-321eaffb0164 HTTP/1.1 Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 100 Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_rZGuVrF-C44D4J4ti-FUg3VTkm-czE0A7pfOdtzQyn7DWdsIHVw5_TNLW7yvge4a01c_9txJ_mWAjXH9_toMp3iNo91-4o37ITglqlC2P2DeUlMJnbDRfIZXnCg-iWcUyD4f0z2IT7CNlS3YUipkDm1WXY6Kw4vGBIH61Rx--AcWY Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 59284b34adf64c2aadf970214cf25e98 Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1192170233 Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/59284b34adf64c2aadf970214cf25e98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/59284b34adf64c2aadf970214cf25e98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_59284b34adf64c2aadf970214cf25e98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/59284b34adf64c2aadf970214cf25e98"}]}] Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1192170233 Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 59284b34adf64c2aadf970214cf25e98 Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1192170233 Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-SecurityGroupsNegativeTestJSON-1192170233-project Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: c02215a88ab94bb6a1aa86f84b2da966 Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1192170233-project Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: {"security_group": {"name": "tempest-sg-793325783", "description": "tempest-description-157183857"}} Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: exception: Security group e9c73c4b-0c3d-4b68-aee4-321eaffb0164 does not exist Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-2cd0e1ea-b23e-4edf-8a35-c6e7f11f3ef7'] Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'e9c73c4b-0c3d-4b68-aee4-321eaffb0164', 'body': {'security_group': {'name': 'tempest-sg-793325783', 'description': 'tempest-description-157183857'}}} Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 16:59:08.307062 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e9c73c4b-0c3d-4b68-aee4-321eaffb0164 does not exist Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2cd0e1ea-b23e-4edf-8a35-c6e7f11f3ef7'] Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e9c73c4b-0c3d-4b68-aee4-321eaffb0164 does not exist Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2cd0e1ea-b23e-4edf-8a35-c6e7f11f3ef7'] Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e9c73c4b-0c3d-4b68-aee4-321eaffb0164 does not exist Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2cd0e1ea-b23e-4edf-8a35-c6e7f11f3ef7'] Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e9c73c4b-0c3d-4b68-aee4-321eaffb0164 does not exist Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2cd0e1ea-b23e-4edf-8a35-c6e7f11f3ef7'] Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0e9295fa-0aad-4da4-a68d-0824831d818a tempest-SecurityGroupsNegativeTestJSON-1192170233 tempest-SecurityGroupsNegativeTestJSON-1192170233-project] Returning 404 to user: Security group e9c73c4b-0c3d-4b68-aee4-321eaffb0164 does not exist Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-2cd0e1ea-b23e-4edf-8a35-c6e7f11f3ef7'] {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0e9295fa-0aad-4da4-a68d-0824831d818a tempest-SecurityGroupsNegativeTestJSON-1192170233 tempest-SecurityGroupsNegativeTestJSON-1192170233-project] 10.222.0.93 "PUT /compute/v2.1/os-security-groups/e9c73c4b-0c3d-4b68-aee4-321eaffb0164" status: 404 len: 194 microversion: 2.1 time: 0.101184 Aug 04 16:59:08.310963 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 614/1290] 10.222.0.93 () {60 vars in 1290 bytes} [Thu Aug 4 16:59:08 2022] PUT /compute/v2.1/os-security-groups/e9c73c4b-0c3d-4b68-aee4-321eaffb0164 => generated 194 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 16:59:08.500664 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a9852454-eff1-4001-963d-49c0526fbff5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:08.524848 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a9852454-eff1-4001-963d-49c0526fbff5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1535 microversion: 2.1 time: 0.499064 Aug 04 16:59:08.527986 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 677/1291] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:08 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1535 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:09.045620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-993d4a3a-58a8-48dd-b78c-8ebf6e7ab348 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:09.046610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-993d4a3a-58a8-48dd-b78c-8ebf6e7ab348 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:09.062679 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-993d4a3a-58a8-48dd-b78c-8ebf6e7ab348 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:09.067474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-993d4a3a-58a8-48dd-b78c-8ebf6e7ab348 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:09.074212 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-993d4a3a-58a8-48dd-b78c-8ebf6e7ab348 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:09.075301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-993d4a3a-58a8-48dd-b78c-8ebf6e7ab348 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:09.075967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-993d4a3a-58a8-48dd-b78c-8ebf6e7ab348 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:09.080623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-993d4a3a-58a8-48dd-b78c-8ebf6e7ab348 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:09.559799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-706a7da8-5949-47e6-a3a0-1318cfb10aec tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:09.561474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-706a7da8-5949-47e6-a3a0-1318cfb10aec tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:09.574074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-706a7da8-5949-47e6-a3a0-1318cfb10aec tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:09.577006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-706a7da8-5949-47e6-a3a0-1318cfb10aec tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:09.597383 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-706a7da8-5949-47e6-a3a0-1318cfb10aec tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:09.603702 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-706a7da8-5949-47e6-a3a0-1318cfb10aec tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:09.607963 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-706a7da8-5949-47e6-a3a0-1318cfb10aec tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:09.616882 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-706a7da8-5949-47e6-a3a0-1318cfb10aec tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:09.750668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=16 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:09.800657 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-993d4a3a-58a8-48dd-b78c-8ebf6e7ab348 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:09.836031 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-993d4a3a-58a8-48dd-b78c-8ebf6e7ab348 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1479 microversion: 2.1 time: 0.786657 Aug 04 16:59:09.839150 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 615/1292] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:09 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1479 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:09.852113 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-1d40b123-6da7-4b6d-945d-590ac47bcd8b req-eb126949-9b96-43f4-989d-2fe26b947ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1250487f-b35f-4803-b7b3-a9a80850fa12", "name": "network-vif-unplugged", "status": "completed", "tag": "167d17c7-b0d3-40d2-8410-10740bd6347f"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:09.892733 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=15 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:09.910028 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1d40b123-6da7-4b6d-945d-590ac47bcd8b req-eb126949-9b96-43f4-989d-2fe26b947ad9 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:09.910535 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1d40b123-6da7-4b6d-945d-590ac47bcd8b req-eb126949-9b96-43f4-989d-2fe26b947ad9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:09.920953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1d40b123-6da7-4b6d-945d-590ac47bcd8b req-eb126949-9b96-43f4-989d-2fe26b947ad9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:09.956819 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-1d40b123-6da7-4b6d-945d-590ac47bcd8b req-eb126949-9b96-43f4-989d-2fe26b947ad9 service nova] Creating event network-vif-unplugged:167d17c7-b0d3-40d2-8410-10740bd6347f for instance 1250487f-b35f-4803-b7b3-a9a80850fa12 on n-h2-851359-3 Aug 04 16:59:09.980466 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-1d40b123-6da7-4b6d-945d-590ac47bcd8b req-eb126949-9b96-43f4-989d-2fe26b947ad9 service nova] Instance 1250487f-b35f-4803-b7b3-a9a80850fa12 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 16:59:10.010805 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-1d40b123-6da7-4b6d-945d-590ac47bcd8b req-eb126949-9b96-43f4-989d-2fe26b947ad9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.170149 Aug 04 16:59:10.012736 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 616/1293] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:10.484512 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-706a7da8-5949-47e6-a3a0-1318cfb10aec tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:10.511574 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-706a7da8-5949-47e6-a3a0-1318cfb10aec tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1535 microversion: 2.1 time: 0.966731 Aug 04 16:59:10.513837 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 678/1294] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:09 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1535 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:10.864809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1090bbb1-8753-4523-a280-368844abd6cf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:10.866322 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1090bbb1-8753-4523-a280-368844abd6cf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:10.879840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1090bbb1-8753-4523-a280-368844abd6cf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:10.885544 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1090bbb1-8753-4523-a280-368844abd6cf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:10.887308 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1090bbb1-8753-4523-a280-368844abd6cf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:10.888604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1090bbb1-8753-4523-a280-368844abd6cf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:10.895297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1090bbb1-8753-4523-a280-368844abd6cf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:10.896873 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1090bbb1-8753-4523-a280-368844abd6cf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:11.535147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2d4f9969-8666-43f2-9058-5cd41ac6349f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:11.537235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2d4f9969-8666-43f2-9058-5cd41ac6349f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:11.549930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d4f9969-8666-43f2-9058-5cd41ac6349f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:11.551393 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d4f9969-8666-43f2-9058-5cd41ac6349f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:11.552087 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d4f9969-8666-43f2-9058-5cd41ac6349f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:11.559077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d4f9969-8666-43f2-9058-5cd41ac6349f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:11.560004 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d4f9969-8666-43f2-9058-5cd41ac6349f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:11.560720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d4f9969-8666-43f2-9058-5cd41ac6349f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:12.149197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1090bbb1-8753-4523-a280-368844abd6cf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:12.159610 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1090bbb1-8753-4523-a280-368844abd6cf tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1479 microversion: 2.1 time: 1.300235 Aug 04 16:59:12.179106 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 617/1295] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:10 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1479 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:12.191315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-47955c8c-7b9f-4834-a5a6-9ff316509b79 req-3aa38a0e-64ca-4cb4-bf62-3bed55104e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19c5ab52-7c2b-4d63-8628-43c75476e45c", "name": "network-vif-plugged", "status": "completed", "tag": "134ee327-dd36-4c6e-b53f-b97914e333e8"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:12.223354 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-47955c8c-7b9f-4834-a5a6-9ff316509b79 req-3aa38a0e-64ca-4cb4-bf62-3bed55104e27 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:12.223853 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-47955c8c-7b9f-4834-a5a6-9ff316509b79 req-3aa38a0e-64ca-4cb4-bf62-3bed55104e27 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:12.226279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-47955c8c-7b9f-4834-a5a6-9ff316509b79 req-3aa38a0e-64ca-4cb4-bf62-3bed55104e27 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:12.240744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:12.264809 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-47955c8c-7b9f-4834-a5a6-9ff316509b79 req-3aa38a0e-64ca-4cb4-bf62-3bed55104e27 service nova] Creating event network-vif-plugged:134ee327-dd36-4c6e-b53f-b97914e333e8 for instance 19c5ab52-7c2b-4d63-8628-43c75476e45c on n-h2-851359-3 Aug 04 16:59:12.312937 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-47955c8c-7b9f-4834-a5a6-9ff316509b79 req-3aa38a0e-64ca-4cb4-bf62-3bed55104e27 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132240 Aug 04 16:59:12.313540 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 618/1296] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:12.327284 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-02cf9892-0c38-442b-b379-6fb5a699de71 req-96a0bf13-641e-417d-97a6-dc2a6544451d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1250487f-b35f-4803-b7b3-a9a80850fa12", "tag": "167d17c7-b0d3-40d2-8410-10740bd6347f"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:12.330722 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2d4f9969-8666-43f2-9058-5cd41ac6349f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:12.345656 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2d4f9969-8666-43f2-9058-5cd41ac6349f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1535 microversion: 2.1 time: 0.814313 Aug 04 16:59:12.349222 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 679/1297] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:11 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1535 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:12.374262 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-02cf9892-0c38-442b-b379-6fb5a699de71 req-96a0bf13-641e-417d-97a6-dc2a6544451d service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:12.374757 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-02cf9892-0c38-442b-b379-6fb5a699de71 req-96a0bf13-641e-417d-97a6-dc2a6544451d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:12.375199 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-02cf9892-0c38-442b-b379-6fb5a699de71 req-96a0bf13-641e-417d-97a6-dc2a6544451d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:12.421260 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-02cf9892-0c38-442b-b379-6fb5a699de71 req-96a0bf13-641e-417d-97a6-dc2a6544451d service nova] Creating event network-changed:167d17c7-b0d3-40d2-8410-10740bd6347f for instance 1250487f-b35f-4803-b7b3-a9a80850fa12 on n-h2-851359-3 Aug 04 16:59:12.433067 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-02cf9892-0c38-442b-b379-6fb5a699de71 req-96a0bf13-641e-417d-97a6-dc2a6544451d service nova] Instance 1250487f-b35f-4803-b7b3-a9a80850fa12 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 16:59:12.473750 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-02cf9892-0c38-442b-b379-6fb5a699de71 req-96a0bf13-641e-417d-97a6-dc2a6544451d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154749 Aug 04 16:59:12.478078 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 619/1298] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:12.888313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-b6097a53-d77d-44fc-b954-70cae8189fd5 req-bcc5503a-0a58-4299-b319-a8bc9a4247f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afea0f77-8d91-4170-934f-b6b7ef64d5a6", "tag": "9e2d842c-859e-4f10-8b78-924c2156cf47"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:12.915860 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b6097a53-d77d-44fc-b954-70cae8189fd5 req-bcc5503a-0a58-4299-b319-a8bc9a4247f1 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:12.916640 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b6097a53-d77d-44fc-b954-70cae8189fd5 req-bcc5503a-0a58-4299-b319-a8bc9a4247f1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:12.918387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b6097a53-d77d-44fc-b954-70cae8189fd5 req-bcc5503a-0a58-4299-b319-a8bc9a4247f1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:12.956468 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-b6097a53-d77d-44fc-b954-70cae8189fd5 req-bcc5503a-0a58-4299-b319-a8bc9a4247f1 service nova] Creating event network-changed:9e2d842c-859e-4f10-8b78-924c2156cf47 for instance afea0f77-8d91-4170-934f-b6b7ef64d5a6 on n-h1-851359-3 Aug 04 16:59:12.982588 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-b6097a53-d77d-44fc-b954-70cae8189fd5 req-bcc5503a-0a58-4299-b319-a8bc9a4247f1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099159 Aug 04 16:59:12.983397 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 680/1299] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:13.190836 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b8c2a7e3-1ab7-4cfe-a030-26b899422a07 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:13.192406 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b8c2a7e3-1ab7-4cfe-a030-26b899422a07 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:13.206363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8c2a7e3-1ab7-4cfe-a030-26b899422a07 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:13.213076 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8c2a7e3-1ab7-4cfe-a030-26b899422a07 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:13.215001 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8c2a7e3-1ab7-4cfe-a030-26b899422a07 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:13.215865 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8c2a7e3-1ab7-4cfe-a030-26b899422a07 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:13.217315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8c2a7e3-1ab7-4cfe-a030-26b899422a07 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:13.223551 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8c2a7e3-1ab7-4cfe-a030-26b899422a07 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:13.380975 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8e463f67-bdda-4db9-a188-a13ad1a3a5df tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:13.382333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8e463f67-bdda-4db9-a188-a13ad1a3a5df tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:13.406268 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e463f67-bdda-4db9-a188-a13ad1a3a5df tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:13.407582 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e463f67-bdda-4db9-a188-a13ad1a3a5df tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:13.409456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e463f67-bdda-4db9-a188-a13ad1a3a5df tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:13.416798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e463f67-bdda-4db9-a188-a13ad1a3a5df tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:13.418920 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e463f67-bdda-4db9-a188-a13ad1a3a5df tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:13.419682 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e463f67-bdda-4db9-a188-a13ad1a3a5df tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:13.680387 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b8c2a7e3-1ab7-4cfe-a030-26b899422a07 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:13.695692 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b8c2a7e3-1ab7-4cfe-a030-26b899422a07 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1479 microversion: 2.1 time: 0.509909 Aug 04 16:59:13.698027 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 620/1300] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:13 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1479 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:13.918571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8e463f67-bdda-4db9-a188-a13ad1a3a5df tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:13.932358 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8e463f67-bdda-4db9-a188-a13ad1a3a5df tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1535 microversion: 2.1 time: 0.556449 Aug 04 16:59:13.933043 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 681/1301] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:13 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1535 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:59:14.725719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-312f45e6-2037-4b69-8b90-9995e08619b8 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:14.728355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-312f45e6-2037-4b69-8b90-9995e08619b8 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:14.741705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-312f45e6-2037-4b69-8b90-9995e08619b8 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:14.743497 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-312f45e6-2037-4b69-8b90-9995e08619b8 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:14.745717 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-312f45e6-2037-4b69-8b90-9995e08619b8 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:14.747849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-312f45e6-2037-4b69-8b90-9995e08619b8 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:14.750335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-312f45e6-2037-4b69-8b90-9995e08619b8 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:14.751777 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-312f45e6-2037-4b69-8b90-9995e08619b8 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:15.301967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-312f45e6-2037-4b69-8b90-9995e08619b8 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:15.305672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-20d515c2-cafb-4df2-83da-6e15bfb096be tempest-VolumesAdminNegativeTest-1555372171 tempest-VolumesAdminNegativeTest-1555372171-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "5bbe1fde-7f0a-440f-b70a-291a4bc193a6"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:15.308955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-20d515c2-cafb-4df2-83da-6e15bfb096be tempest-VolumesAdminNegativeTest-1555372171 tempest-VolumesAdminNegativeTest-1555372171-project-admin] [instance: cf061e67-e261-41e2-a505-95e318126844] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:15.314748 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-312f45e6-2037-4b69-8b90-9995e08619b8 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1479 microversion: 2.1 time: 0.597794 Aug 04 16:59:15.318737 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 621/1302] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:14 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1479 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:15.324617 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20d515c2-cafb-4df2-83da-6e15bfb096be tempest-VolumesAdminNegativeTest-1555372171 tempest-VolumesAdminNegativeTest-1555372171-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:15.326366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20d515c2-cafb-4df2-83da-6e15bfb096be tempest-VolumesAdminNegativeTest-1555372171 tempest-VolumesAdminNegativeTest-1555372171-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:15.328292 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20d515c2-cafb-4df2-83da-6e15bfb096be tempest-VolumesAdminNegativeTest-1555372171 tempest-VolumesAdminNegativeTest-1555372171-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:15.330165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20d515c2-cafb-4df2-83da-6e15bfb096be tempest-VolumesAdminNegativeTest-1555372171 tempest-VolumesAdminNegativeTest-1555372171-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:15.331008 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20d515c2-cafb-4df2-83da-6e15bfb096be tempest-VolumesAdminNegativeTest-1555372171 tempest-VolumesAdminNegativeTest-1555372171-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:15.338176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20d515c2-cafb-4df2-83da-6e15bfb096be tempest-VolumesAdminNegativeTest-1555372171 tempest-VolumesAdminNegativeTest-1555372171-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:15.338407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-85c8c9e4-259b-49fd-be25-95d95383b090 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:15.338908 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-85c8c9e4-259b-49fd-be25-95d95383b090 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:15.378817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85c8c9e4-259b-49fd-be25-95d95383b090 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:15.379337 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85c8c9e4-259b-49fd-be25-95d95383b090 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:15.379790 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85c8c9e4-259b-49fd-be25-95d95383b090 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:15.380525 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85c8c9e4-259b-49fd-be25-95d95383b090 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:15.380993 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85c8c9e4-259b-49fd-be25-95d95383b090 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:15.381423 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85c8c9e4-259b-49fd-be25-95d95383b090 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:15.747589 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-20d515c2-cafb-4df2-83da-6e15bfb096be tempest-VolumesAdminNegativeTest-1555372171 tempest-VolumesAdminNegativeTest-1555372171-project-admin] HTTP exception thrown: Volume 5bbe1fde-7f0a-440f-b70a-291a4bc193a6 could not be found. Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-20d515c2-cafb-4df2-83da-6e15bfb096be tempest-VolumesAdminNegativeTest-1555372171 tempest-VolumesAdminNegativeTest-1555372171-project-admin] Request method failure captured: Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: request: PUT /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844/os-volume_attachments/9f798c87-791f-4a2c-addf-0d3deee1700c HTTP/1.1 Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 74 Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_qJ87kSkh0QGc0Kixaq90xMCi8n9LIeHP0DqQjz1JqNRuTDCNuY9IwV9TBBmQ1dsb2dXHuKTJZVXo79TwIDcnkOrVAnYxY9mKHJutS0D58DnO0z0QGWsKSd_YfsXp0Mb6MgiY9D8RuxmtiiM2O7syVHpWFxtSNzkeRJUespbOgNEPY Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 6eb904c160c34e129309934e76dce27b Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-VolumesAdminNegativeTest-1555372171 Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: X-Role: admin,member,reader Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: admin,member,reader Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6eb904c160c34e129309934e76dce27b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6eb904c160c34e129309934e76dce27b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6eb904c160c34e129309934e76dce27b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6eb904c160c34e129309934e76dce27b"}]}] Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-VolumesAdminNegativeTest-1555372171 Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 6eb904c160c34e129309934e76dce27b Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1555372171 Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-VolumesAdminNegativeTest-1555372171-project-admin Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 9cfd58f863424a96a62eb1102ce3d31a Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-VolumesAdminNegativeTest-1555372171-project-admin Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: {"volumeAttachment": {"volumeId": "5bbe1fde-7f0a-440f-b70a-291a4bc193a6"}} Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: exception: Volume 5bbe1fde-7f0a-440f-b70a-291a4bc193a6 could not be found. Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'server_id': 'cf061e67-e261-41e2-a505-95e318126844', 'id': '9f798c87-791f-4a2c-addf-0d3deee1700c', 'body': {'volumeAttachment': {'volumeId': '5bbe1fde-7f0a-440f-b70a-291a4bc193a6'}}} Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5bbe1fde-7f0a-440f-b70a-291a4bc193a6 could not be found. (HTTP 404) (Request-ID: req-1438e9e3-3d36-4803-af71-6df1ccc58417) Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 16:59:15.752169 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5bbe1fde-7f0a-440f-b70a-291a4bc193a6 could not be found. Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 5bbe1fde-7f0a-440f-b70a-291a4bc193a6 could not be found. Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5bbe1fde-7f0a-440f-b70a-291a4bc193a6 could not be found. Aug 04 16:59:15.756431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:59:15.761820 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-20d515c2-cafb-4df2-83da-6e15bfb096be tempest-VolumesAdminNegativeTest-1555372171 tempest-VolumesAdminNegativeTest-1555372171-project-admin] Returning 400 to user: Volume 5bbe1fde-7f0a-440f-b70a-291a4bc193a6 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:59:15.763033 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-20d515c2-cafb-4df2-83da-6e15bfb096be tempest-VolumesAdminNegativeTest-1555372171 tempest-VolumesAdminNegativeTest-1555372171-project-admin] 10.222.0.93 "PUT /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844/os-volume_attachments/9f798c87-791f-4a2c-addf-0d3deee1700c" status: 400 len: 107 microversion: 2.1 time: 1.047731 Aug 04 16:59:15.764187 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 682/1303] 10.222.0.93 () {60 vars in 1433 bytes} [Thu Aug 4 16:59:14 2022] PUT /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844/os-volume_attachments/9f798c87-791f-4a2c-addf-0d3deee1700c => generated 107 bytes in 1049 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 16:59:15.886959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d52beeab-c88e-46f8-83ea-22fb93727f05 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:15.887626 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d52beeab-c88e-46f8-83ea-22fb93727f05 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cf061e67-e261-41e2-a505-95e318126844] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:15.901940 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d52beeab-c88e-46f8-83ea-22fb93727f05 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:15.905399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d52beeab-c88e-46f8-83ea-22fb93727f05 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:15.907029 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d52beeab-c88e-46f8-83ea-22fb93727f05 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:15.908222 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d52beeab-c88e-46f8-83ea-22fb93727f05 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:15.913086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d52beeab-c88e-46f8-83ea-22fb93727f05 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:15.913779 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d52beeab-c88e-46f8-83ea-22fb93727f05 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:15.915303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-85c8c9e4-259b-49fd-be25-95d95383b090 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:15.928380 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-85c8c9e4-259b-49fd-be25-95d95383b090 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1535 microversion: 2.1 time: 0.608142 Aug 04 16:59:15.968822 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 622/1304] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:15 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1535 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:16.219061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-d52beeab-c88e-46f8-83ea-22fb93727f05 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lazy-loading 'services' on Instance uuid cf061e67-e261-41e2-a505-95e318126844 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:59:16.337640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-916a8e3d-5a42-4dfc-af93-b99a21c58b13 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:16.338305 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-916a8e3d-5a42-4dfc-af93-b99a21c58b13 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:16.350506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-916a8e3d-5a42-4dfc-af93-b99a21c58b13 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:16.357881 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-916a8e3d-5a42-4dfc-af93-b99a21c58b13 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:16.358444 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-916a8e3d-5a42-4dfc-af93-b99a21c58b13 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:16.360201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-916a8e3d-5a42-4dfc-af93-b99a21c58b13 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:16.361541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-916a8e3d-5a42-4dfc-af93-b99a21c58b13 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:16.363572 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-916a8e3d-5a42-4dfc-af93-b99a21c58b13 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:16.429525 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d52beeab-c88e-46f8-83ea-22fb93727f05 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "DELETE /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844/os-volume_attachments/9f798c87-791f-4a2c-addf-0d3deee1700c" status: 202 len: 0 microversion: 2.1 time: 0.544436 Aug 04 16:59:16.436310 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 683/1305] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Aug 4 16:59:15 2022] DELETE /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844/os-volume_attachments/9f798c87-791f-4a2c-addf-0d3deee1700c => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:59:16.442441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e2238c8a-d730-4692-89b1-5630ee751420 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:16.449236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e2238c8a-d730-4692-89b1-5630ee751420 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cf061e67-e261-41e2-a505-95e318126844] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:16.468786 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2238c8a-d730-4692-89b1-5630ee751420 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:16.469723 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2238c8a-d730-4692-89b1-5630ee751420 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:16.470688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2238c8a-d730-4692-89b1-5630ee751420 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:16.473703 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2238c8a-d730-4692-89b1-5630ee751420 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:16.475871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2238c8a-d730-4692-89b1-5630ee751420 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:16.493635 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2238c8a-d730-4692-89b1-5630ee751420 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:16.606387 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e2238c8a-d730-4692-89b1-5630ee751420 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169913 Aug 04 16:59:16.607901 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 684/1306] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 16:59:16 2022] GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:16.948828 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-916a8e3d-5a42-4dfc-af93-b99a21c58b13 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:16.957887 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-916a8e3d-5a42-4dfc-af93-b99a21c58b13 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1479 microversion: 2.1 time: 0.624999 Aug 04 16:59:16.971903 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 623/1307] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:16 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1479 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:16.995505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8ce211a5-2b51-43cc-a5d8-726eb0119e6e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:16.996135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8ce211a5-2b51-43cc-a5d8-726eb0119e6e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:17.004577 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ce211a5-2b51-43cc-a5d8-726eb0119e6e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:17.005083 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ce211a5-2b51-43cc-a5d8-726eb0119e6e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:17.006296 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ce211a5-2b51-43cc-a5d8-726eb0119e6e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:17.007051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ce211a5-2b51-43cc-a5d8-726eb0119e6e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:17.007523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ce211a5-2b51-43cc-a5d8-726eb0119e6e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:17.007956 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ce211a5-2b51-43cc-a5d8-726eb0119e6e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:17.210744 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8ce211a5-2b51-43cc-a5d8-726eb0119e6e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:17.222154 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8ce211a5-2b51-43cc-a5d8-726eb0119e6e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1535 microversion: 2.1 time: 0.232659 Aug 04 16:59:17.222740 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 685/1308] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:16 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1535 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:17.621393 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d6b3e904-a65a-4da6-b6c3-d2e3faef9034 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:17.624648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d6b3e904-a65a-4da6-b6c3-d2e3faef9034 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cf061e67-e261-41e2-a505-95e318126844] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:17.670316 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6b3e904-a65a-4da6-b6c3-d2e3faef9034 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:17.675916 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6b3e904-a65a-4da6-b6c3-d2e3faef9034 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:17.676589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6b3e904-a65a-4da6-b6c3-d2e3faef9034 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:17.678474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6b3e904-a65a-4da6-b6c3-d2e3faef9034 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:17.679420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6b3e904-a65a-4da6-b6c3-d2e3faef9034 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:17.685127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6b3e904-a65a-4da6-b6c3-d2e3faef9034 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:17.810624 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d6b3e904-a65a-4da6-b6c3-d2e3faef9034 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.189345 Aug 04 16:59:17.811836 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 624/1309] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 16:59:17 2022] GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844/os-volume_attachments => generated 197 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:17.980511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f10eab07-44ba-499d-8d60-be91b0723af0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:17.981857 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f10eab07-44ba-499d-8d60-be91b0723af0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:18.000613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f10eab07-44ba-499d-8d60-be91b0723af0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:18.003853 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f10eab07-44ba-499d-8d60-be91b0723af0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:18.005039 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f10eab07-44ba-499d-8d60-be91b0723af0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:18.010090 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f10eab07-44ba-499d-8d60-be91b0723af0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:18.010918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f10eab07-44ba-499d-8d60-be91b0723af0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:18.013378 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f10eab07-44ba-499d-8d60-be91b0723af0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:18.249244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fa9217cc-7b62-45a0-8eab-482033e4bb3f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:18.250159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fa9217cc-7b62-45a0-8eab-482033e4bb3f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:18.269814 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa9217cc-7b62-45a0-8eab-482033e4bb3f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:18.271299 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa9217cc-7b62-45a0-8eab-482033e4bb3f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:18.274221 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa9217cc-7b62-45a0-8eab-482033e4bb3f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:18.277500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa9217cc-7b62-45a0-8eab-482033e4bb3f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:18.278646 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa9217cc-7b62-45a0-8eab-482033e4bb3f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:18.282520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa9217cc-7b62-45a0-8eab-482033e4bb3f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:19.436860 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f10eab07-44ba-499d-8d60-be91b0723af0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:19.452730 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f10eab07-44ba-499d-8d60-be91b0723af0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1479 microversion: 2.1 time: 1.477036 Aug 04 16:59:19.453318 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 686/1310] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:17 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1479 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:19.464375 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fa9217cc-7b62-45a0-8eab-482033e4bb3f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:19.469680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d9adaf6b-1c05-4c1f-88cc-1aefc3ec57c8 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:19.478001 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d9adaf6b-1c05-4c1f-88cc-1aefc3ec57c8 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cf061e67-e261-41e2-a505-95e318126844] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:19.478186 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fa9217cc-7b62-45a0-8eab-482033e4bb3f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1528 microversion: 2.1 time: 1.232860 Aug 04 16:59:19.478646 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 625/1311] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:18 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1528 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:19.502559 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7e7ec3a1-20dc-4209-9fc2-940a874687e7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:19.503184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7e7ec3a1-20dc-4209-9fc2-940a874687e7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:19.507761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9adaf6b-1c05-4c1f-88cc-1aefc3ec57c8 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:19.509355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9adaf6b-1c05-4c1f-88cc-1aefc3ec57c8 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:19.510002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9adaf6b-1c05-4c1f-88cc-1aefc3ec57c8 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:19.512431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9adaf6b-1c05-4c1f-88cc-1aefc3ec57c8 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:19.515365 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9adaf6b-1c05-4c1f-88cc-1aefc3ec57c8 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:19.515994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9adaf6b-1c05-4c1f-88cc-1aefc3ec57c8 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:19.522909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e7ec3a1-20dc-4209-9fc2-940a874687e7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:19.523606 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e7ec3a1-20dc-4209-9fc2-940a874687e7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:19.524073 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e7ec3a1-20dc-4209-9fc2-940a874687e7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:19.528437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e7ec3a1-20dc-4209-9fc2-940a874687e7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:19.529180 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e7ec3a1-20dc-4209-9fc2-940a874687e7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:19.531449 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e7ec3a1-20dc-4209-9fc2-940a874687e7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:19.586721 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d9adaf6b-1c05-4c1f-88cc-1aefc3ec57c8 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131824 Aug 04 16:59:19.594742 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 687/1312] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 16:59:19 2022] GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:19.943555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7e7ec3a1-20dc-4209-9fc2-940a874687e7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:19.953849 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7e7ec3a1-20dc-4209-9fc2-940a874687e7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1528 microversion: 2.1 time: 0.455800 Aug 04 16:59:19.958463 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 626/1313] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:19 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1528 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:19.978545 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3532d7f0-ddf5-43da-a542-db6c102f4477 tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:19.979654 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:59:19.979654 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:59:19.987362 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-3532d7f0-ddf5-43da-a542-db6c102f4477 tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] HTTP exception thrown: Flavor 8da34e9d-49be-4084-b683-1772e2f80f21 could not be found. Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3532d7f0-ddf5-43da-a542-db6c102f4477 tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Request method failure captured: Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/flavors/8da34e9d-49be-4084-b683-1772e2f80f21 HTTP/1.1 Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_nt-wwos1L4nYvNXvDsqduwGnALVIXdESZmK7abcWIT8o4mSYHhiYAKq8NFnvSmNOUS2uyXlox2aBewz2DnIdlVLJswfq9I1noOJXP_fdQg0IIt8kimKfzV50P8Uoi-VDrXyRG3jvBkZoO42n7BwOCQXtdHMZdO1SLU_ROt11d7b_8 Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 95c5f6b6398d485baaf555deb448172f Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-MigrationsAdminTest-874568950 Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: X-Role: admin,member,reader Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: admin,member,reader Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/95c5f6b6398d485baaf555deb448172f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/95c5f6b6398d485baaf555deb448172f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_95c5f6b6398d485baaf555deb448172f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/95c5f6b6398d485baaf555deb448172f"}]}] Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-MigrationsAdminTest-874568950 Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 95c5f6b6398d485baaf555deb448172f Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-MigrationsAdminTest-874568950 Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-MigrationsAdminTest-874568950-project-admin Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 88b72b6cf0e14849a4b09a9595b0bef1 Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-MigrationsAdminTest-874568950-project-admin Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: exception: Flavor 8da34e9d-49be-4084-b683-1772e2f80f21 could not be found. Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '8da34e9d-49be-4084-b683-1772e2f80f21'} Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 8da34e9d-49be-4084-b683-1772e2f80f21 could not be found. Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 8da34e9d-49be-4084-b683-1772e2f80f21 could not be found. Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:19.997453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:20.001665 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:20.001665 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:20.001665 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:20.001665 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:20.001665 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:59:20.001665 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:59:20.001665 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 8da34e9d-49be-4084-b683-1772e2f80f21 could not be found. Aug 04 16:59:20.001665 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:20.001665 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3532d7f0-ddf5-43da-a542-db6c102f4477 tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Returning 404 to user: Flavor 8da34e9d-49be-4084-b683-1772e2f80f21 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:59:20.001665 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3532d7f0-ddf5-43da-a542-db6c102f4477 tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/8da34e9d-49be-4084-b683-1772e2f80f21" status: 404 len: 109 microversion: 2.1 time: 0.024938 Aug 04 16:59:20.001665 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 627/1314] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 16:59:19 2022] DELETE /compute/v2.1/flavors/8da34e9d-49be-4084-b683-1772e2f80f21 => generated 109 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:59:20.145800 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0ac14782-a1de-421f-9d13-893b64a4730b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1781035865", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "fcf929f8-72e5-4701-9267-5cd4fba70ec8"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:20.239048 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-0ac14782-a1de-421f-9d13-893b64a4730b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] validate_networks() for [('fcf929f8-72e5-4701-9267-5cd4fba70ec8', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:59:20.362210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-deb2bc2d-500c-4118-b312-1cbea3d6cd6c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-939321612", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:20.495962 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-deb2bc2d-500c-4118-b312-1cbea3d6cd6c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:59:21.151070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-deb2bc2d-500c-4118-b312-1cbea3d6cd6c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:59:21.151738 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-deb2bc2d-500c-4118-b312-1cbea3d6cd6c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:59:21.152377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-deb2bc2d-500c-4118-b312-1cbea3d6cd6c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:59:21.153182 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-deb2bc2d-500c-4118-b312-1cbea3d6cd6c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:59:21.154134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-deb2bc2d-500c-4118-b312-1cbea3d6cd6c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:59:21.166242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-deb2bc2d-500c-4118-b312-1cbea3d6cd6c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:21.167093 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-deb2bc2d-500c-4118-b312-1cbea3d6cd6c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:21.167854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-deb2bc2d-500c-4118-b312-1cbea3d6cd6c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:21.168867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-deb2bc2d-500c-4118-b312-1cbea3d6cd6c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:21.169594 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-deb2bc2d-500c-4118-b312-1cbea3d6cd6c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:21.170548 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-deb2bc2d-500c-4118-b312-1cbea3d6cd6c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:21.210458 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-deb2bc2d-500c-4118-b312-1cbea3d6cd6c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Getting quotas for project 6f64e49086c94f65ba1fc2ef97b6bcde. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:59:21.223570 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-deb2bc2d-500c-4118-b312-1cbea3d6cd6c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Getting quotas for user 655795644d9941c99a82d15d9daa5ab5 and project 6f64e49086c94f65ba1fc2ef97b6bcde. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:59:21.258212 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-deb2bc2d-500c-4118-b312-1cbea3d6cd6c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:59:21.262280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-deb2bc2d-500c-4118-b312-1cbea3d6cd6c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:59:21.385438 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-deb2bc2d-500c-4118-b312-1cbea3d6cd6c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.035279 Aug 04 16:59:21.389662 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 628/1315] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:59:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:59:21.397732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1373857f-9f65-4fcd-924c-f2e83ac65e2f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:21.398390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1373857f-9f65-4fcd-924c-f2e83ac65e2f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:21.415820 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1373857f-9f65-4fcd-924c-f2e83ac65e2f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:21.416339 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1373857f-9f65-4fcd-924c-f2e83ac65e2f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:21.417336 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1373857f-9f65-4fcd-924c-f2e83ac65e2f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:21.418150 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1373857f-9f65-4fcd-924c-f2e83ac65e2f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:21.418618 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1373857f-9f65-4fcd-924c-f2e83ac65e2f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:21.419046 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1373857f-9f65-4fcd-924c-f2e83ac65e2f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:21.560363 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-0ac14782-a1de-421f-9d13-893b64a4730b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:59:21.560811 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-0ac14782-a1de-421f-9d13-893b64a4730b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:59:21.561717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-0ac14782-a1de-421f-9d13-893b64a4730b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:59:21.562234 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-0ac14782-a1de-421f-9d13-893b64a4730b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:59:21.562687 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-0ac14782-a1de-421f-9d13-893b64a4730b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:59:21.580194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ac14782-a1de-421f-9d13-893b64a4730b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:21.580705 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ac14782-a1de-421f-9d13-893b64a4730b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:21.581156 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ac14782-a1de-421f-9d13-893b64a4730b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:21.581898 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ac14782-a1de-421f-9d13-893b64a4730b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:21.582393 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ac14782-a1de-421f-9d13-893b64a4730b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:21.582825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ac14782-a1de-421f-9d13-893b64a4730b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:21.637218 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-0ac14782-a1de-421f-9d13-893b64a4730b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Getting quotas for project 65efeb63178649a7bdc50a90cfc112e9. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:59:21.652282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-0ac14782-a1de-421f-9d13-893b64a4730b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Getting quotas for user df06c4b403cc4fe5b76915e685b7cef5 and project 65efeb63178649a7bdc50a90cfc112e9. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:59:21.685207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0ac14782-a1de-421f-9d13-893b64a4730b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:59:21.696768 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0ac14782-a1de-421f-9d13-893b64a4730b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:59:21.730698 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1373857f-9f65-4fcd-924c-f2e83ac65e2f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:21.755194 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1373857f-9f65-4fcd-924c-f2e83ac65e2f tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1464 microversion: 2.1 time: 0.364365 Aug 04 16:59:21.762425 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 629/1316] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:21 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1464 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:21.777205 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7c767db1-3d86-4311-a3c3-f3d9a5531e46 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:21.782820 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7c767db1-3d86-4311-a3c3-f3d9a5531e46 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cf061e67-e261-41e2-a505-95e318126844] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:21.799803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c767db1-3d86-4311-a3c3-f3d9a5531e46 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:21.800590 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c767db1-3d86-4311-a3c3-f3d9a5531e46 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:21.801278 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c767db1-3d86-4311-a3c3-f3d9a5531e46 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:21.802274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c767db1-3d86-4311-a3c3-f3d9a5531e46 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:21.802973 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c767db1-3d86-4311-a3c3-f3d9a5531e46 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:21.803786 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c767db1-3d86-4311-a3c3-f3d9a5531e46 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:21.870448 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0ac14782-a1de-421f-9d13-893b64a4730b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.082852 Aug 04 16:59:21.883826 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 688/1317] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:59:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:59:21.891485 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9513815f-433b-48b5-8c3f-6e5dc0e7cc0c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:21.892120 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9513815f-433b-48b5-8c3f-6e5dc0e7cc0c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:21.952343 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7c767db1-3d86-4311-a3c3-f3d9a5531e46 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.187474 Aug 04 16:59:21.967953 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 630/1318] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 16:59:21 2022] GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844/os-volume_attachments => generated 197 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:21.973066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c3230104-0cf5-451f-9d94-ffb78f7b90dd tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:21.984259 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c3230104-0cf5-451f-9d94-ffb78f7b90dd tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:22.001459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3230104-0cf5-451f-9d94-ffb78f7b90dd tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:22.014128 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3230104-0cf5-451f-9d94-ffb78f7b90dd tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:22.016027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3230104-0cf5-451f-9d94-ffb78f7b90dd tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:22.017062 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3230104-0cf5-451f-9d94-ffb78f7b90dd tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:22.020252 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3230104-0cf5-451f-9d94-ffb78f7b90dd tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:22.021166 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3230104-0cf5-451f-9d94-ffb78f7b90dd tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:22.062681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9513815f-433b-48b5-8c3f-6e5dc0e7cc0c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:22.073727 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9513815f-433b-48b5-8c3f-6e5dc0e7cc0c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1212 microversion: 2.1 time: 0.188664 Aug 04 16:59:22.076511 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 689/1319] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:21 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1212 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:22.085888 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-64831821-f214-4501-a4d7-797e56bd1601 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:22.086811 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-64831821-f214-4501-a4d7-797e56bd1601 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:22.214040 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c3230104-0cf5-451f-9d94-ffb78f7b90dd tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c/action" status: 202 len: 0 microversion: 2.1 time: 0.244528 Aug 04 16:59:22.215186 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 631/1320] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:59:21 2022] POST /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:59:22.222952 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-64831821-f214-4501-a4d7-797e56bd1601 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:22.231964 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-64831821-f214-4501-a4d7-797e56bd1601 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8" status: 200 len: 1224 microversion: 2.1 time: 0.154332 Aug 04 16:59:22.236047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c9ff8cea-2e37-422a-af6d-81665844f71e tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:22.238533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c9ff8cea-2e37-422a-af6d-81665844f71e tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:22.249802 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 690/1321] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:22 2022] GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8 => generated 1224 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:22.264147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9ff8cea-2e37-422a-af6d-81665844f71e tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:22.264930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9ff8cea-2e37-422a-af6d-81665844f71e tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:22.267402 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9ff8cea-2e37-422a-af6d-81665844f71e tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:22.269785 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9ff8cea-2e37-422a-af6d-81665844f71e tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:22.271892 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9ff8cea-2e37-422a-af6d-81665844f71e tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:22.278022 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9ff8cea-2e37-422a-af6d-81665844f71e tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:22.367961 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9ff8cea-2e37-422a-af6d-81665844f71e tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:22.371738 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9ff8cea-2e37-422a-af6d-81665844f71e tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:22.374245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9ff8cea-2e37-422a-af6d-81665844f71e tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:22.379614 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-c9ff8cea-2e37-422a-af6d-81665844f71e tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lazy-loading 'fault' on Instance uuid 19c5ab52-7c2b-4d63-8628-43c75476e45c {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:59:22.468895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-40509274-69e3-4500-afd6-b5318a7fde3b req-cddac3e6-faef-43c4-b88f-996c7934107a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1250487f-b35f-4803-b7b3-a9a80850fa12", "name": "network-vif-plugged", "status": "completed", "tag": "167d17c7-b0d3-40d2-8410-10740bd6347f"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:22.486873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-40509274-69e3-4500-afd6-b5318a7fde3b req-cddac3e6-faef-43c4-b88f-996c7934107a service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:22.487371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-40509274-69e3-4500-afd6-b5318a7fde3b req-cddac3e6-faef-43c4-b88f-996c7934107a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:22.498111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-40509274-69e3-4500-afd6-b5318a7fde3b req-cddac3e6-faef-43c4-b88f-996c7934107a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:22.520974 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-40509274-69e3-4500-afd6-b5318a7fde3b req-cddac3e6-faef-43c4-b88f-996c7934107a service nova] Creating event network-vif-plugged:167d17c7-b0d3-40d2-8410-10740bd6347f for instance 1250487f-b35f-4803-b7b3-a9a80850fa12 on n-h2-851359-3 Aug 04 16:59:22.536189 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-40509274-69e3-4500-afd6-b5318a7fde3b req-cddac3e6-faef-43c4-b88f-996c7934107a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071272 Aug 04 16:59:22.537113 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 691/1322] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:22.772014 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c9ff8cea-2e37-422a-af6d-81665844f71e tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1598 microversion: 2.1 time: 0.552368 Aug 04 16:59:22.779281 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 632/1323] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:22 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1598 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:22.806743 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9c60b619-7189-4a10-88ce-cd0df80c276b tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:22.812079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9c60b619-7189-4a10-88ce-cd0df80c276b tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:22.828615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9c60b619-7189-4a10-88ce-cd0df80c276b tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:22.829416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9c60b619-7189-4a10-88ce-cd0df80c276b tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:22.830746 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9c60b619-7189-4a10-88ce-cd0df80c276b tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:22.834073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9c60b619-7189-4a10-88ce-cd0df80c276b tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:22.834785 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9c60b619-7189-4a10-88ce-cd0df80c276b tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:22.835398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9c60b619-7189-4a10-88ce-cd0df80c276b tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:22.946281 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 16:59:22.946455 n-d-851359-3 devstack@n-api.service[131044]: Thu Aug 4 16:59:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 16:59:22.976422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-71e6c3f6-51a7-46a6-a9d1-8d88d5efab14 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:23.001308 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-71e6c3f6-51a7-46a6-a9d1-8d88d5efab14 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cf061e67-e261-41e2-a505-95e318126844] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:23.036814 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71e6c3f6-51a7-46a6-a9d1-8d88d5efab14 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:23.038191 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71e6c3f6-51a7-46a6-a9d1-8d88d5efab14 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:23.039857 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71e6c3f6-51a7-46a6-a9d1-8d88d5efab14 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:23.040758 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71e6c3f6-51a7-46a6-a9d1-8d88d5efab14 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:23.042365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71e6c3f6-51a7-46a6-a9d1-8d88d5efab14 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:23.043590 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71e6c3f6-51a7-46a6-a9d1-8d88d5efab14 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:23.058241 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:23.075199 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9c60b619-7189-4a10-88ce-cd0df80c276b tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c/action" status: 202 len: 0 microversion: 2.1 time: 0.274577 Aug 04 16:59:23.077565 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 692/1324] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:59:22 2022] POST /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:59:23.093491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-28ca8a03-aeac-4747-baae-ef1ad8e3488a tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:23.094520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-28ca8a03-aeac-4747-baae-ef1ad8e3488a tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:23.119725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28ca8a03-aeac-4747-baae-ef1ad8e3488a tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:23.120580 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28ca8a03-aeac-4747-baae-ef1ad8e3488a tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:23.121591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28ca8a03-aeac-4747-baae-ef1ad8e3488a tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:23.123241 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28ca8a03-aeac-4747-baae-ef1ad8e3488a tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:23.126369 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-71e6c3f6-51a7-46a6-a9d1-8d88d5efab14 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161522 Aug 04 16:59:23.126662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28ca8a03-aeac-4747-baae-ef1ad8e3488a tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:23.127304 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28ca8a03-aeac-4747-baae-ef1ad8e3488a tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:23.135370 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 633/1325] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 16:59:22 2022] GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:23.147538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3d9646dc-f547-4418-9dc1-45653a176583 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:23.148561 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3d9646dc-f547-4418-9dc1-45653a176583 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:23.163520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d9646dc-f547-4418-9dc1-45653a176583 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:23.164901 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d9646dc-f547-4418-9dc1-45653a176583 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:23.165356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d9646dc-f547-4418-9dc1-45653a176583 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:23.166122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d9646dc-f547-4418-9dc1-45653a176583 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:23.166592 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d9646dc-f547-4418-9dc1-45653a176583 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:23.167024 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d9646dc-f547-4418-9dc1-45653a176583 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:23.589607 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-28ca8a03-aeac-4747-baae-ef1ad8e3488a tempest-ServersAdminTestJSON-1965181909 tempest-ServersAdminTestJSON-1965181909-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1615 microversion: 2.1 time: 0.506404 Aug 04 16:59:23.591349 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 693/1326] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:23 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1615 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:23.609653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5708ba4c-685a-48ad-82a6-7b3154299840 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:23.611910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5708ba4c-685a-48ad-82a6-7b3154299840 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:23.629702 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5708ba4c-685a-48ad-82a6-7b3154299840 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:23.631562 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5708ba4c-685a-48ad-82a6-7b3154299840 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:23.634082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5708ba4c-685a-48ad-82a6-7b3154299840 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:23.636589 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5708ba4c-685a-48ad-82a6-7b3154299840 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:23.638055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5708ba4c-685a-48ad-82a6-7b3154299840 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:23.640699 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5708ba4c-685a-48ad-82a6-7b3154299840 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:23.822501 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3d9646dc-f547-4418-9dc1-45653a176583 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:23.839710 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3d9646dc-f547-4418-9dc1-45653a176583 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1264 microversion: 2.1 time: 0.702900 Aug 04 16:59:23.845606 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 634/1327] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:23 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1264 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:23.860653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5708ba4c-685a-48ad-82a6-7b3154299840 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:23.861279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-008d491f-7151-4a19-aa4d-485c06a51144 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:23.864546 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-008d491f-7151-4a19-aa4d-485c06a51144 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:23.874612 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5708ba4c-685a-48ad-82a6-7b3154299840 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8" status: 200 len: 1220 microversion: 2.1 time: 0.273602 Aug 04 16:59:23.877347 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 694/1328] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:23 2022] GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8 => generated 1220 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:23.883581 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-008d491f-7151-4a19-aa4d-485c06a51144 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:23.889250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-008d491f-7151-4a19-aa4d-485c06a51144 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:23.890994 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-008d491f-7151-4a19-aa4d-485c06a51144 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:23.897271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-008d491f-7151-4a19-aa4d-485c06a51144 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:23.898158 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-008d491f-7151-4a19-aa4d-485c06a51144 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:23.899051 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-008d491f-7151-4a19-aa4d-485c06a51144 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:23.927903 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:23.941192 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-008d491f-7151-4a19-aa4d-485c06a51144 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:59:24.123158 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-008d491f-7151-4a19-aa4d-485c06a51144 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "DELETE /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9" status: 204 len: 0 microversion: 2.1 time: 0.276031 Aug 04 16:59:24.124586 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 635/1329] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 16:59:23 2022] DELETE /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:59:24.135935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7499ce0a-9c4b-415d-a04b-2503c224cad0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:24.136638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7499ce0a-9c4b-415d-a04b-2503c224cad0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:24.148997 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-139afced-c234-4270-a8b3-8fa1d85e3475 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:24.149444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7499ce0a-9c4b-415d-a04b-2503c224cad0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:24.149958 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7499ce0a-9c4b-415d-a04b-2503c224cad0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:24.151721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-139afced-c234-4270-a8b3-8fa1d85e3475 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cf061e67-e261-41e2-a505-95e318126844] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:24.152838 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7499ce0a-9c4b-415d-a04b-2503c224cad0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:24.153475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7499ce0a-9c4b-415d-a04b-2503c224cad0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:24.154115 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7499ce0a-9c4b-415d-a04b-2503c224cad0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:24.154430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7499ce0a-9c4b-415d-a04b-2503c224cad0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:24.168725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-139afced-c234-4270-a8b3-8fa1d85e3475 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:24.170479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-139afced-c234-4270-a8b3-8fa1d85e3475 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:24.171051 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-139afced-c234-4270-a8b3-8fa1d85e3475 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:24.175251 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-139afced-c234-4270-a8b3-8fa1d85e3475 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:24.177327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-139afced-c234-4270-a8b3-8fa1d85e3475 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:24.178232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-139afced-c234-4270-a8b3-8fa1d85e3475 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:24.250452 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-139afced-c234-4270-a8b3-8fa1d85e3475 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106375 Aug 04 16:59:24.262362 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 636/1330] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 16:59:24 2022] GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:24.709186 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7499ce0a-9c4b-415d-a04b-2503c224cad0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:24.722151 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7499ce0a-9c4b-415d-a04b-2503c224cad0 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9" status: 200 len: 1469 microversion: 2.1 time: 0.589156 Aug 04 16:59:24.725309 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 695/1331] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:24 2022] GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9 => generated 1469 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:24.897748 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ae26a516-8cab-4e41-88da-f240d8c3b68b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:24.900542 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-76f637e5-ee00-4d74-a10f-089c01b7d3b5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:24.903036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-76f637e5-ee00-4d74-a10f-089c01b7d3b5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:24.904997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ae26a516-8cab-4e41-88da-f240d8c3b68b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:24.911534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76f637e5-ee00-4d74-a10f-089c01b7d3b5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:24.912646 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76f637e5-ee00-4d74-a10f-089c01b7d3b5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:24.913644 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76f637e5-ee00-4d74-a10f-089c01b7d3b5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:24.915271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76f637e5-ee00-4d74-a10f-089c01b7d3b5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:24.915416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae26a516-8cab-4e41-88da-f240d8c3b68b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:24.915936 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae26a516-8cab-4e41-88da-f240d8c3b68b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:24.916387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae26a516-8cab-4e41-88da-f240d8c3b68b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:24.916688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76f637e5-ee00-4d74-a10f-089c01b7d3b5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:24.917110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae26a516-8cab-4e41-88da-f240d8c3b68b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:24.917573 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76f637e5-ee00-4d74-a10f-089c01b7d3b5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:24.917778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae26a516-8cab-4e41-88da-f240d8c3b68b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:24.927449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae26a516-8cab-4e41-88da-f240d8c3b68b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:25.101295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ae26a516-8cab-4e41-88da-f240d8c3b68b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:25.116866 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ae26a516-8cab-4e41-88da-f240d8c3b68b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8" status: 200 len: 1282 microversion: 2.1 time: 0.223068 Aug 04 16:59:25.119625 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 696/1332] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:24 2022] GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8 => generated 1282 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:25.269814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-29ff8a25-0da5-4d9b-8a38-9f7344315207 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:25.277606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-29ff8a25-0da5-4d9b-8a38-9f7344315207 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cf061e67-e261-41e2-a505-95e318126844] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:25.301223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29ff8a25-0da5-4d9b-8a38-9f7344315207 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:25.314790 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29ff8a25-0da5-4d9b-8a38-9f7344315207 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:25.319316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29ff8a25-0da5-4d9b-8a38-9f7344315207 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:25.323591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29ff8a25-0da5-4d9b-8a38-9f7344315207 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:25.324223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29ff8a25-0da5-4d9b-8a38-9f7344315207 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:25.324709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29ff8a25-0da5-4d9b-8a38-9f7344315207 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:25.456682 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-29ff8a25-0da5-4d9b-8a38-9f7344315207 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.193100 Aug 04 16:59:25.466470 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 697/1333] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 16:59:25 2022] GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:25.541481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-76f637e5-ee00-4d74-a10f-089c01b7d3b5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:25.584776 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-76f637e5-ee00-4d74-a10f-089c01b7d3b5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1312 microversion: 2.1 time: 0.720654 Aug 04 16:59:25.587606 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 637/1334] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:24 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1312 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:25.746212 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-95219aad-ba54-4758-a08c-f1e6790648f6 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:25.746212 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-95219aad-ba54-4758-a08c-f1e6790648f6 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:25.765639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95219aad-ba54-4758-a08c-f1e6790648f6 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:25.766482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95219aad-ba54-4758-a08c-f1e6790648f6 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:25.768432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95219aad-ba54-4758-a08c-f1e6790648f6 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:25.772844 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95219aad-ba54-4758-a08c-f1e6790648f6 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:25.777611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95219aad-ba54-4758-a08c-f1e6790648f6 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:25.780743 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95219aad-ba54-4758-a08c-f1e6790648f6 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:26.142990 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-95219aad-ba54-4758-a08c-f1e6790648f6 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:26.150503 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e093f4a4-a18b-4f27-8ebe-f3e18acd5bab tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:26.151285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e093f4a4-a18b-4f27-8ebe-f3e18acd5bab tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:26.155271 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-95219aad-ba54-4758-a08c-f1e6790648f6 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9" status: 200 len: 1469 microversion: 2.1 time: 0.414121 Aug 04 16:59:26.158289 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 698/1335] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:25 2022] GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9 => generated 1469 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:26.171162 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e093f4a4-a18b-4f27-8ebe-f3e18acd5bab tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:26.171837 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e093f4a4-a18b-4f27-8ebe-f3e18acd5bab tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:26.173105 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e093f4a4-a18b-4f27-8ebe-f3e18acd5bab tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:26.176368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e093f4a4-a18b-4f27-8ebe-f3e18acd5bab tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:26.177768 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e093f4a4-a18b-4f27-8ebe-f3e18acd5bab tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:26.182891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e093f4a4-a18b-4f27-8ebe-f3e18acd5bab tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:26.306496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e093f4a4-a18b-4f27-8ebe-f3e18acd5bab tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:26.319403 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e093f4a4-a18b-4f27-8ebe-f3e18acd5bab tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8" status: 200 len: 1282 microversion: 2.1 time: 0.174257 Aug 04 16:59:26.321457 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 638/1336] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:26 2022] GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8 => generated 1282 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:26.472873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1f2e97a6-0570-44f4-b097-d75142bfc999 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:26.478910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1f2e97a6-0570-44f4-b097-d75142bfc999 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cf061e67-e261-41e2-a505-95e318126844] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:26.495111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f2e97a6-0570-44f4-b097-d75142bfc999 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:26.501527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f2e97a6-0570-44f4-b097-d75142bfc999 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:26.503291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f2e97a6-0570-44f4-b097-d75142bfc999 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:26.505188 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f2e97a6-0570-44f4-b097-d75142bfc999 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:26.511619 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f2e97a6-0570-44f4-b097-d75142bfc999 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:26.512250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f2e97a6-0570-44f4-b097-d75142bfc999 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:26.586803 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1f2e97a6-0570-44f4-b097-d75142bfc999 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117325 Aug 04 16:59:26.592924 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 699/1337] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 16:59:26 2022] GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:26.618534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8e962b16-48af-49b1-aed0-43d66d116e8e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:26.619605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8e962b16-48af-49b1-aed0-43d66d116e8e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:26.636477 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e962b16-48af-49b1-aed0-43d66d116e8e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:26.637398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e962b16-48af-49b1-aed0-43d66d116e8e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:26.638120 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e962b16-48af-49b1-aed0-43d66d116e8e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:26.639235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e962b16-48af-49b1-aed0-43d66d116e8e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:26.639938 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e962b16-48af-49b1-aed0-43d66d116e8e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:26.640604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e962b16-48af-49b1-aed0-43d66d116e8e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:26.947637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8e962b16-48af-49b1-aed0-43d66d116e8e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:26.963145 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8e962b16-48af-49b1-aed0-43d66d116e8e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1312 microversion: 2.1 time: 0.348647 Aug 04 16:59:26.970960 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 639/1338] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:26 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1312 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:27.178133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1bf17682-8abe-499b-b7af-9764f69841e8 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:27.180306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1bf17682-8abe-499b-b7af-9764f69841e8 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:27.194089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1bf17682-8abe-499b-b7af-9764f69841e8 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:27.194880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1bf17682-8abe-499b-b7af-9764f69841e8 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:27.196939 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1bf17682-8abe-499b-b7af-9764f69841e8 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:27.199064 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1bf17682-8abe-499b-b7af-9764f69841e8 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:27.199788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1bf17682-8abe-499b-b7af-9764f69841e8 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:27.200456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1bf17682-8abe-499b-b7af-9764f69841e8 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:27.342762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-74257edf-958c-437b-92bd-0a26e469fe07 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:27.343777 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-74257edf-958c-437b-92bd-0a26e469fe07 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:27.368168 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74257edf-958c-437b-92bd-0a26e469fe07 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:27.369124 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74257edf-958c-437b-92bd-0a26e469fe07 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:27.370396 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74257edf-958c-437b-92bd-0a26e469fe07 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:27.376526 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74257edf-958c-437b-92bd-0a26e469fe07 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:27.379059 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74257edf-958c-437b-92bd-0a26e469fe07 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:27.381713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74257edf-958c-437b-92bd-0a26e469fe07 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:28.208460 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-74257edf-958c-437b-92bd-0a26e469fe07 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:28.218585 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-74257edf-958c-437b-92bd-0a26e469fe07 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8" status: 200 len: 1282 microversion: 2.1 time: 0.881407 Aug 04 16:59:28.219957 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 640/1339] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:27 2022] GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8 => generated 1282 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:28.229153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-27a648f6-f8be-4d38-9f8f-18272afbe142 req-f28cea97-dca3-4dc3-8d5c-431aaa54f1c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "332a6825-af0b-4bcd-92df-128b918d1a57", "tag": "0baa25b5-966d-4c17-abaf-1794a2778dc0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:28.246076 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-27a648f6-f8be-4d38-9f8f-18272afbe142 req-f28cea97-dca3-4dc3-8d5c-431aaa54f1c4 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:28.249608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-27a648f6-f8be-4d38-9f8f-18272afbe142 req-f28cea97-dca3-4dc3-8d5c-431aaa54f1c4 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:28.250597 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-27a648f6-f8be-4d38-9f8f-18272afbe142 req-f28cea97-dca3-4dc3-8d5c-431aaa54f1c4 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:28.278533 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-27a648f6-f8be-4d38-9f8f-18272afbe142 req-f28cea97-dca3-4dc3-8d5c-431aaa54f1c4 service nova] Creating event network-changed:0baa25b5-966d-4c17-abaf-1794a2778dc0 for instance 332a6825-af0b-4bcd-92df-128b918d1a57 on n-h1-851359-3 Aug 04 16:59:28.292708 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-27a648f6-f8be-4d38-9f8f-18272afbe142 req-f28cea97-dca3-4dc3-8d5c-431aaa54f1c4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070958 Aug 04 16:59:28.295686 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 641/1340] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:28.301991 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-05b288fd-59e0-4216-a245-349b49622535 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:28.315898 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-05b288fd-59e0-4216-a245-349b49622535 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cf061e67-e261-41e2-a505-95e318126844] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:28.329132 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05b288fd-59e0-4216-a245-349b49622535 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:28.330200 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05b288fd-59e0-4216-a245-349b49622535 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:28.330824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05b288fd-59e0-4216-a245-349b49622535 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:28.331721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05b288fd-59e0-4216-a245-349b49622535 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:28.333545 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05b288fd-59e0-4216-a245-349b49622535 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:28.335051 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05b288fd-59e0-4216-a245-349b49622535 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:28.358900 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1bf17682-8abe-499b-b7af-9764f69841e8 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:28.371807 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1bf17682-8abe-499b-b7af-9764f69841e8 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9" status: 200 len: 1469 microversion: 2.1 time: 1.198855 Aug 04 16:59:28.374077 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 700/1341] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:27 2022] GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9 => generated 1469 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:28.376505 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-05b288fd-59e0-4216-a245-349b49622535 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079119 Aug 04 16:59:28.378240 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 642/1342] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 16:59:28 2022] GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 16:59:28.406197 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f25a4f02-ca1e-4a2c-bdcc-ad26e8de99be tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:28.406832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f25a4f02-ca1e-4a2c-bdcc-ad26e8de99be tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:28.419801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f25a4f02-ca1e-4a2c-bdcc-ad26e8de99be tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:28.420219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f25a4f02-ca1e-4a2c-bdcc-ad26e8de99be tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:28.420668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f25a4f02-ca1e-4a2c-bdcc-ad26e8de99be tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:28.424116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f25a4f02-ca1e-4a2c-bdcc-ad26e8de99be tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:28.424626 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f25a4f02-ca1e-4a2c-bdcc-ad26e8de99be tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:28.425080 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f25a4f02-ca1e-4a2c-bdcc-ad26e8de99be tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:28.890535 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f25a4f02-ca1e-4a2c-bdcc-ad26e8de99be tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:28.902532 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f25a4f02-ca1e-4a2c-bdcc-ad26e8de99be tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1312 microversion: 2.1 time: 0.527220 Aug 04 16:59:28.903130 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 701/1343] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:28 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1312 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:28.966794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-774a5cde-1174-4315-b29d-59632fece028 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-892719804", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "c657b79b-df4b-4f0a-af8f-bb04840f17b6"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:29.089191 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-774a5cde-1174-4315-b29d-59632fece028 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] validate_networks() for [('c657b79b-df4b-4f0a-af8f-bb04840f17b6', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:59:29.242865 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-63812f84-25b8-4499-85b5-bc2bc2e6b24b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:29.243926 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-63812f84-25b8-4499-85b5-bc2bc2e6b24b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:29.258405 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63812f84-25b8-4499-85b5-bc2bc2e6b24b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:29.259897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63812f84-25b8-4499-85b5-bc2bc2e6b24b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:29.260786 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63812f84-25b8-4499-85b5-bc2bc2e6b24b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:29.261764 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63812f84-25b8-4499-85b5-bc2bc2e6b24b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:29.265079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63812f84-25b8-4499-85b5-bc2bc2e6b24b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:29.268937 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63812f84-25b8-4499-85b5-bc2bc2e6b24b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:30.249749 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-63812f84-25b8-4499-85b5-bc2bc2e6b24b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:30.259867 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-63812f84-25b8-4499-85b5-bc2bc2e6b24b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8" status: 200 len: 1324 microversion: 2.1 time: 1.021363 Aug 04 16:59:30.278619 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 702/1344] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:29 2022] GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8 => generated 1324 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:30.301930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ec1b2530-b40c-47bf-baeb-780f5550716a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:30.302633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ec1b2530-b40c-47bf-baeb-780f5550716a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:30.315846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec1b2530-b40c-47bf-baeb-780f5550716a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:30.316365 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec1b2530-b40c-47bf-baeb-780f5550716a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:30.319691 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec1b2530-b40c-47bf-baeb-780f5550716a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:30.321073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec1b2530-b40c-47bf-baeb-780f5550716a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:30.321564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec1b2530-b40c-47bf-baeb-780f5550716a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:30.326778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec1b2530-b40c-47bf-baeb-780f5550716a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:30.474136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ec1b2530-b40c-47bf-baeb-780f5550716a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:30.506626 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ec1b2530-b40c-47bf-baeb-780f5550716a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9" status: 200 len: 1427 microversion: 2.1 time: 0.221066 Aug 04 16:59:30.529649 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 703/1345] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:30 2022] GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9 => generated 1427 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:30.563875 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-505bb77e-558c-4199-9f0e-76144dbb3c50 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:30.566578 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-505bb77e-558c-4199-9f0e-76144dbb3c50 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:30.612501 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-505bb77e-558c-4199-9f0e-76144dbb3c50 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:30.613827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-505bb77e-558c-4199-9f0e-76144dbb3c50 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:30.618074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-505bb77e-558c-4199-9f0e-76144dbb3c50 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:30.620651 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-505bb77e-558c-4199-9f0e-76144dbb3c50 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:30.621430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-505bb77e-558c-4199-9f0e-76144dbb3c50 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:30.623488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-505bb77e-558c-4199-9f0e-76144dbb3c50 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:30.825886 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-774a5cde-1174-4315-b29d-59632fece028 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:59:30.827030 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-774a5cde-1174-4315-b29d-59632fece028 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:59:30.827690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-774a5cde-1174-4315-b29d-59632fece028 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:59:30.828271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-774a5cde-1174-4315-b29d-59632fece028 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:59:30.829360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-774a5cde-1174-4315-b29d-59632fece028 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:59:30.831941 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:30.855534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-774a5cde-1174-4315-b29d-59632fece028 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:30.858730 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-774a5cde-1174-4315-b29d-59632fece028 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:30.860255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-774a5cde-1174-4315-b29d-59632fece028 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:30.862299 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-774a5cde-1174-4315-b29d-59632fece028 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:30.863932 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-774a5cde-1174-4315-b29d-59632fece028 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:30.866059 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-774a5cde-1174-4315-b29d-59632fece028 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:30.950921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-774a5cde-1174-4315-b29d-59632fece028 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Getting quotas for project 50604ce0bb604209a3c18932fdd193e2. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:59:30.968018 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-774a5cde-1174-4315-b29d-59632fece028 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Getting quotas for user 08ad6ccd2d804e158989a5f94c6f9a2f and project 50604ce0bb604209a3c18932fdd193e2. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:59:30.999606 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-774a5cde-1174-4315-b29d-59632fece028 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:59:31.009067 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-774a5cde-1174-4315-b29d-59632fece028 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cafacd63-b815-4219-aa5e-f4aa05048c24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:59:31.119659 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-774a5cde-1174-4315-b29d-59632fece028 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.158368 Aug 04 16:59:31.121063 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 643/1346] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:59:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:59:31.130376 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ab1e0e0f-86d2-4cf5-94b6-ef205c5538c5 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:31.137741 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ab1e0e0f-86d2-4cf5-94b6-ef205c5538c5 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:31.154789 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab1e0e0f-86d2-4cf5-94b6-ef205c5538c5 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:31.156579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab1e0e0f-86d2-4cf5-94b6-ef205c5538c5 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:31.159793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab1e0e0f-86d2-4cf5-94b6-ef205c5538c5 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:31.160904 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab1e0e0f-86d2-4cf5-94b6-ef205c5538c5 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:31.162534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab1e0e0f-86d2-4cf5-94b6-ef205c5538c5 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:31.165528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab1e0e0f-86d2-4cf5-94b6-ef205c5538c5 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:31.260372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-505bb77e-558c-4199-9f0e-76144dbb3c50 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:31.279229 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-505bb77e-558c-4199-9f0e-76144dbb3c50 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1312 microversion: 2.1 time: 0.737061 Aug 04 16:59:31.285944 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 704/1347] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:30 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1312 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:31.307382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-1e0c90ab-38fa-4a0e-842f-16289edb279a req-d7950b88-d591-487f-8eb2-4ac9de9d07c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9", "name": "network-vif-deleted", "tag": "9d42adf5-9293-46c9-8db6-ea9e4e623164"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:31.332912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1e0c90ab-38fa-4a0e-842f-16289edb279a req-d7950b88-d591-487f-8eb2-4ac9de9d07c7 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:31.333522 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1e0c90ab-38fa-4a0e-842f-16289edb279a req-d7950b88-d591-487f-8eb2-4ac9de9d07c7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:31.335903 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1e0c90ab-38fa-4a0e-842f-16289edb279a req-d7950b88-d591-487f-8eb2-4ac9de9d07c7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:31.363638 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-1e0c90ab-38fa-4a0e-842f-16289edb279a req-d7950b88-d591-487f-8eb2-4ac9de9d07c7 service nova] Creating event network-vif-deleted:9d42adf5-9293-46c9-8db6-ea9e4e623164 for instance c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9 on n-h2-851359-3 Aug 04 16:59:31.380036 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-1e0c90ab-38fa-4a0e-842f-16289edb279a req-d7950b88-d591-487f-8eb2-4ac9de9d07c7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079748 Aug 04 16:59:31.381548 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 705/1348] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:31.391057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3e7fd799-bf6f-4de6-adf5-a757101364c7 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:31.391057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3e7fd799-bf6f-4de6-adf5-a757101364c7 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cafacd63-b815-4219-aa5e-f4aa05048c24] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:31.606607 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:31.863151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3e7fd799-bf6f-4de6-adf5-a757101364c7 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ad6ccd2d804e158989a5f94c6f9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50604ce0bb604209a3c18932fdd193e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:31.877709 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3e7fd799-bf6f-4de6-adf5-a757101364c7 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24" status: 200 len: 1217 microversion: 2.1 time: 0.493252 Aug 04 16:59:31.878776 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 706/1349] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:31 2022] GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24 => generated 1217 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:31.891495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-10d0347f-7fc5-46a1-b85a-68c1ce941271 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:31.892339 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-10d0347f-7fc5-46a1-b85a-68c1ce941271 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:31.904233 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-10d0347f-7fc5-46a1-b85a-68c1ce941271 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:31.905440 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-10d0347f-7fc5-46a1-b85a-68c1ce941271 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:31.906171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-10d0347f-7fc5-46a1-b85a-68c1ce941271 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:31.907259 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-10d0347f-7fc5-46a1-b85a-68c1ce941271 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:31.923325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-10d0347f-7fc5-46a1-b85a-68c1ce941271 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:31.925382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-10d0347f-7fc5-46a1-b85a-68c1ce941271 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:32.235193 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ab1e0e0f-86d2-4cf5-94b6-ef205c5538c5 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1857 microversion: 2.1 time: 1.110518 Aug 04 16:59:32.241302 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 644/1350] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:31 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1857 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:32.249353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-10d0347f-7fc5-46a1-b85a-68c1ce941271 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:32.262547 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-10d0347f-7fc5-46a1-b85a-68c1ce941271 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8" status: 200 len: 1324 microversion: 2.1 time: 0.382339 Aug 04 16:59:32.273074 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 707/1351] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:31 2022] GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8 => generated 1324 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:32.274855 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-539e1db7-1301-462b-8fce-643a034c50e7 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:32.275500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-539e1db7-1301-462b-8fce-643a034c50e7 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:32.286396 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-537e6613-bed5-4c28-9804-a3ad36c8d079 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-851359-3", "block_migration": true, "disk_over_commit": false}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:32.295036 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-537e6613-bed5-4c28-9804-a3ad36c8d079 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:32.297766 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-539e1db7-1301-462b-8fce-643a034c50e7 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:32.298319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-539e1db7-1301-462b-8fce-643a034c50e7 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:32.302393 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-539e1db7-1301-462b-8fce-643a034c50e7 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:32.303244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-539e1db7-1301-462b-8fce-643a034c50e7 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:32.304063 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-539e1db7-1301-462b-8fce-643a034c50e7 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:32.305100 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-539e1db7-1301-462b-8fce-643a034c50e7 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:32.318964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-537e6613-bed5-4c28-9804-a3ad36c8d079 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:32.318964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-537e6613-bed5-4c28-9804-a3ad36c8d079 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:32.318964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-537e6613-bed5-4c28-9804-a3ad36c8d079 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:32.319746 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-537e6613-bed5-4c28-9804-a3ad36c8d079 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:32.320446 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-537e6613-bed5-4c28-9804-a3ad36c8d079 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:32.320883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-537e6613-bed5-4c28-9804-a3ad36c8d079 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:32.339880 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-539e1db7-1301-462b-8fce-643a034c50e7 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] HTTP exception thrown: Instance c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9 could not be found. Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-539e1db7-1301-462b-8fce-643a034c50e7 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Request method failure captured: Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9 HTTP/1.1 Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_pUEA76YvJPEQ_-ipgjAub19CmZzGr3pU0Uq4mMZN8j6PWXkNReO93KYPdtJAKGYQ62KftSJBZULu_VL9_GNfN8DtlrOYz9Xnr_0abJAB7ZBAEPzon0_3LXvrmPLnJxobbOH7H8WpBocsQZyGBeL8cvu4yc4OtstS968GbT0QOGLh4 Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 42f88328efc24fa4b8e8e5023bd6d5a1 Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersAdminTestJSON-798012702 Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/42f88328efc24fa4b8e8e5023bd6d5a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/42f88328efc24fa4b8e8e5023bd6d5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_42f88328efc24fa4b8e8e5023bd6d5a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/42f88328efc24fa4b8e8e5023bd6d5a1"}]}] Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersAdminTestJSON-798012702 Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 42f88328efc24fa4b8e8e5023bd6d5a1 Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersAdminTestJSON-798012702 Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersAdminTestJSON-798012702-project Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 2965e80f1b6e4cf8b750a28de3129541 Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersAdminTestJSON-798012702-project Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9 could not be found. Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9'} Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9 could not be found. Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9 could not be found. Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:32.341612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:32.347793 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:32.347793 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:32.347793 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:32.347793 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:59:32.347793 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:59:32.347793 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9 could not be found. Aug 04 16:59:32.347793 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:32.347793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-539e1db7-1301-462b-8fce-643a034c50e7 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Returning 404 to user: Instance c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:59:32.347793 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-539e1db7-1301-462b-8fce-643a034c50e7 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9" status: 404 len: 111 microversion: 2.1 time: 0.099014 Aug 04 16:59:32.347793 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 645/1352] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:32 2022] GET /compute/v2.1/servers/c3cd8951-1281-4ed3-99d1-3f8c7ccc38d9 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:59:32.362334 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-81035425-df8e-4e4c-a8e4-c569a993cb20 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:32.362981 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-81035425-df8e-4e4c-a8e4-c569a993cb20 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:32.380663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81035425-df8e-4e4c-a8e4-c569a993cb20 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:32.382933 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81035425-df8e-4e4c-a8e4-c569a993cb20 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:32.383592 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81035425-df8e-4e4c-a8e4-c569a993cb20 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:32.385873 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81035425-df8e-4e4c-a8e4-c569a993cb20 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:32.386746 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81035425-df8e-4e4c-a8e4-c569a993cb20 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:32.387321 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-537e6613-bed5-4c28-9804-a3ad36c8d079 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lazy-loading 'flavor' on Instance uuid e92cd73d-ce71-4f92-9db9-ae02c7febbcb {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:59:32.389901 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81035425-df8e-4e4c-a8e4-c569a993cb20 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:32.405535 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-537e6613-bed5-4c28-9804-a3ad36c8d079 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Going to try to live migrate instance to n-h1-851359-3 {{(pid=131043) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 16:59:32.810657 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-81035425-df8e-4e4c-a8e4-c569a993cb20 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:32.839402 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-81035425-df8e-4e4c-a8e4-c569a993cb20 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1312 microversion: 2.1 time: 0.493246 Aug 04 16:59:32.840710 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 646/1353] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:32 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1312 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:32.852035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-32f2593a-8d3b-4f0d-9679-7e6fb0463c70 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:32.853765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-32f2593a-8d3b-4f0d-9679-7e6fb0463c70 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 02856bd5-3936-4593-b70d-ddf3452f440d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:32.872271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32f2593a-8d3b-4f0d-9679-7e6fb0463c70 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:32.872992 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32f2593a-8d3b-4f0d-9679-7e6fb0463c70 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:32.874029 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32f2593a-8d3b-4f0d-9679-7e6fb0463c70 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:32.874803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32f2593a-8d3b-4f0d-9679-7e6fb0463c70 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:32.874803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32f2593a-8d3b-4f0d-9679-7e6fb0463c70 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:32.875211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32f2593a-8d3b-4f0d-9679-7e6fb0463c70 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:33.050882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-32f2593a-8d3b-4f0d-9679-7e6fb0463c70 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 02856bd5-3936-4593-b70d-ddf3452f440d] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:59:33.296413 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-32f2593a-8d3b-4f0d-9679-7e6fb0463c70 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "DELETE /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d" status: 204 len: 0 microversion: 2.1 time: 0.452353 Aug 04 16:59:33.303653 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 647/1354] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 16:59:32 2022] DELETE /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:59:33.311162 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b137f1e1-2732-4138-82ce-c3428ade6a29 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:33.312291 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b137f1e1-2732-4138-82ce-c3428ade6a29 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cafacd63-b815-4219-aa5e-f4aa05048c24] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:33.322048 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b137f1e1-2732-4138-82ce-c3428ade6a29 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:33.323031 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b137f1e1-2732-4138-82ce-c3428ade6a29 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:33.324054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b137f1e1-2732-4138-82ce-c3428ade6a29 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:33.325125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b137f1e1-2732-4138-82ce-c3428ade6a29 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:33.325760 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b137f1e1-2732-4138-82ce-c3428ade6a29 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:33.326701 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b137f1e1-2732-4138-82ce-c3428ade6a29 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:33.443103 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b137f1e1-2732-4138-82ce-c3428ade6a29 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ad6ccd2d804e158989a5f94c6f9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50604ce0bb604209a3c18932fdd193e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:33.457464 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b137f1e1-2732-4138-82ce-c3428ade6a29 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24" status: 200 len: 1269 microversion: 2.1 time: 0.149305 Aug 04 16:59:33.459825 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 648/1355] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:33 2022] GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24 => generated 1269 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:33.474640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-13ab1d45-4b26-49de-8958-71b33535a0bc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:33.475637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-13ab1d45-4b26-49de-8958-71b33535a0bc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:33.486830 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13ab1d45-4b26-49de-8958-71b33535a0bc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:33.487753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13ab1d45-4b26-49de-8958-71b33535a0bc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:33.488716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13ab1d45-4b26-49de-8958-71b33535a0bc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:33.490621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13ab1d45-4b26-49de-8958-71b33535a0bc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:33.501321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13ab1d45-4b26-49de-8958-71b33535a0bc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:33.502122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13ab1d45-4b26-49de-8958-71b33535a0bc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:33.760911 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-13ab1d45-4b26-49de-8958-71b33535a0bc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:33.770880 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-13ab1d45-4b26-49de-8958-71b33535a0bc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8" status: 200 len: 1324 microversion: 2.1 time: 0.308996 Aug 04 16:59:33.771573 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 649/1356] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:33 2022] GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8 => generated 1324 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:33.794262 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cc3117b9-b61a-48d7-9392-d68f75e94f86 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:33.794902 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cc3117b9-b61a-48d7-9392-d68f75e94f86 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 02856bd5-3936-4593-b70d-ddf3452f440d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:33.811238 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc3117b9-b61a-48d7-9392-d68f75e94f86 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:33.812098 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc3117b9-b61a-48d7-9392-d68f75e94f86 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:33.812776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc3117b9-b61a-48d7-9392-d68f75e94f86 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:33.814104 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc3117b9-b61a-48d7-9392-d68f75e94f86 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:33.817379 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc3117b9-b61a-48d7-9392-d68f75e94f86 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:33.819323 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc3117b9-b61a-48d7-9392-d68f75e94f86 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:34.015574 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cc3117b9-b61a-48d7-9392-d68f75e94f86 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:34.020980 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:34.028755 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cc3117b9-b61a-48d7-9392-d68f75e94f86 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d" status: 200 len: 1468 microversion: 2.1 time: 0.256088 Aug 04 16:59:34.029413 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 650/1357] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:33 2022] GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d => generated 1468 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:34.034631 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-8e64448c-5041-4797-8b8c-0d799acd6cd6 req-27fdae20-a0fe-4fe0-bf8e-ff2a86faf1b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07628113-e50c-4c63-bff3-0401009c87c8", "tag": "a6e94576-42ff-4f94-90f7-18335cd81c04"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:34.050435 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8e64448c-5041-4797-8b8c-0d799acd6cd6 req-27fdae20-a0fe-4fe0-bf8e-ff2a86faf1b7 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:34.050925 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8e64448c-5041-4797-8b8c-0d799acd6cd6 req-27fdae20-a0fe-4fe0-bf8e-ff2a86faf1b7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:34.051575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8e64448c-5041-4797-8b8c-0d799acd6cd6 req-27fdae20-a0fe-4fe0-bf8e-ff2a86faf1b7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:34.063340 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-8e64448c-5041-4797-8b8c-0d799acd6cd6 req-27fdae20-a0fe-4fe0-bf8e-ff2a86faf1b7 service nova] Creating event network-changed:a6e94576-42ff-4f94-90f7-18335cd81c04 for instance 07628113-e50c-4c63-bff3-0401009c87c8 on n-h1-851359-3 Aug 04 16:59:34.068158 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-8e64448c-5041-4797-8b8c-0d799acd6cd6 req-27fdae20-a0fe-4fe0-bf8e-ff2a86faf1b7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037298 Aug 04 16:59:34.068696 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 651/1358] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:34.074798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3f266ded-0524-4f81-8212-f2c808e859c7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:34.075519 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3f266ded-0524-4f81-8212-f2c808e859c7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:34.081769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f266ded-0524-4f81-8212-f2c808e859c7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:34.082298 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f266ded-0524-4f81-8212-f2c808e859c7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:34.082744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f266ded-0524-4f81-8212-f2c808e859c7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:34.083455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f266ded-0524-4f81-8212-f2c808e859c7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:34.083929 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f266ded-0524-4f81-8212-f2c808e859c7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:34.084361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f266ded-0524-4f81-8212-f2c808e859c7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:34.256313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3f266ded-0524-4f81-8212-f2c808e859c7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:34.267044 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3f266ded-0524-4f81-8212-f2c808e859c7 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1312 microversion: 2.1 time: 0.196269 Aug 04 16:59:34.267636 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 652/1359] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:34 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1312 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:34.344082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2261bbee-dce2-430d-a058-3d916773aa50 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1604278268", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "bed30c3f-0c01-4418-9c95-0bb7a79e1c34"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:34.405779 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-2261bbee-dce2-430d-a058-3d916773aa50 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] validate_networks() for [('bed30c3f-0c01-4418-9c95-0bb7a79e1c34', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:59:34.872728 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-2261bbee-dce2-430d-a058-3d916773aa50 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:59:34.873153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-2261bbee-dce2-430d-a058-3d916773aa50 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:59:34.873658 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-2261bbee-dce2-430d-a058-3d916773aa50 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:59:34.874286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-2261bbee-dce2-430d-a058-3d916773aa50 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:59:34.874735 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-2261bbee-dce2-430d-a058-3d916773aa50 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:59:34.883909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2261bbee-dce2-430d-a058-3d916773aa50 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:34.884512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2261bbee-dce2-430d-a058-3d916773aa50 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:34.885281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2261bbee-dce2-430d-a058-3d916773aa50 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:34.886115 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2261bbee-dce2-430d-a058-3d916773aa50 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:34.886641 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2261bbee-dce2-430d-a058-3d916773aa50 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:34.887577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2261bbee-dce2-430d-a058-3d916773aa50 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:34.910983 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-2261bbee-dce2-430d-a058-3d916773aa50 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Getting quotas for project 92bb708c7ba24e4d828f19ecc60e1f91. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:59:34.917570 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-2261bbee-dce2-430d-a058-3d916773aa50 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Getting quotas for user 6d19d8e7953b4e479b4e2143a3c3546a and project 92bb708c7ba24e4d828f19ecc60e1f91. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:59:34.932776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2261bbee-dce2-430d-a058-3d916773aa50 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:59:34.935145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2261bbee-dce2-430d-a058-3d916773aa50 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b04e7f9-a53f-48ee-9389-366bd96d2bfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:59:34.982150 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2261bbee-dce2-430d-a058-3d916773aa50 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700675 Aug 04 16:59:34.982799 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 653/1360] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:59:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:59:34.987597 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b0a14250-1459-496f-a809-ddbb26215d59 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:34.988292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b0a14250-1459-496f-a809-ddbb26215d59 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cafacd63-b815-4219-aa5e-f4aa05048c24] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:34.995850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0a14250-1459-496f-a809-ddbb26215d59 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:34.996390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0a14250-1459-496f-a809-ddbb26215d59 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:34.997042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0a14250-1459-496f-a809-ddbb26215d59 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:34.997928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0a14250-1459-496f-a809-ddbb26215d59 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:34.998601 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0a14250-1459-496f-a809-ddbb26215d59 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:34.999214 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0a14250-1459-496f-a809-ddbb26215d59 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:35.074856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b0a14250-1459-496f-a809-ddbb26215d59 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ad6ccd2d804e158989a5f94c6f9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50604ce0bb604209a3c18932fdd193e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:35.086816 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b0a14250-1459-496f-a809-ddbb26215d59 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24" status: 200 len: 1269 microversion: 2.1 time: 0.100326 Aug 04 16:59:35.089009 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 654/1361] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:34 2022] GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24 => generated 1269 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:35.098243 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-78049b07-67b2-4950-b83f-434b64e2057d tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:35.099549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-78049b07-67b2-4950-b83f-434b64e2057d tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:35.115324 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78049b07-67b2-4950-b83f-434b64e2057d tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:35.116150 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78049b07-67b2-4950-b83f-434b64e2057d tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:35.120049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78049b07-67b2-4950-b83f-434b64e2057d tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:35.122976 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78049b07-67b2-4950-b83f-434b64e2057d tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:35.123681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78049b07-67b2-4950-b83f-434b64e2057d tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:35.125320 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78049b07-67b2-4950-b83f-434b64e2057d tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:35.371588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-78049b07-67b2-4950-b83f-434b64e2057d tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:35.383784 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-78049b07-67b2-4950-b83f-434b64e2057d tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8" status: 200 len: 1324 microversion: 2.1 time: 0.293035 Aug 04 16:59:35.385808 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 655/1362] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:35 2022] GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8 => generated 1324 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:35.392640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4eabd423-e89f-4dce-9d21-751b15e4845f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:35.393450 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4eabd423-e89f-4dce-9d21-751b15e4845f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b04e7f9-a53f-48ee-9389-366bd96d2bfd] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:35.484467 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4eabd423-e89f-4dce-9d21-751b15e4845f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:35.495935 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4eabd423-e89f-4dce-9d21-751b15e4845f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd" status: 200 len: 1215 microversion: 2.1 time: 0.104758 Aug 04 16:59:35.496821 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 656/1363] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:35 2022] GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd => generated 1215 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:35.503289 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ef93912c-4948-4d6e-8aa9-bebcd03ba829 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:35.504227 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ef93912c-4948-4d6e-8aa9-bebcd03ba829 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 02856bd5-3936-4593-b70d-ddf3452f440d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:35.512807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef93912c-4948-4d6e-8aa9-bebcd03ba829 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:35.513739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef93912c-4948-4d6e-8aa9-bebcd03ba829 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:35.514425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef93912c-4948-4d6e-8aa9-bebcd03ba829 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:35.515556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef93912c-4948-4d6e-8aa9-bebcd03ba829 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:35.516472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef93912c-4948-4d6e-8aa9-bebcd03ba829 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:35.517249 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef93912c-4948-4d6e-8aa9-bebcd03ba829 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:35.783413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ef93912c-4948-4d6e-8aa9-bebcd03ba829 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:35.793923 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ef93912c-4948-4d6e-8aa9-bebcd03ba829 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d" status: 200 len: 1468 microversion: 2.1 time: 0.295076 Aug 04 16:59:35.796762 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 657/1364] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:35 2022] GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d => generated 1468 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:35.818608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-64f1e40e-bcba-421f-afba-828e03cf3417 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:35.824008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-64f1e40e-bcba-421f-afba-828e03cf3417 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:35.837934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64f1e40e-bcba-421f-afba-828e03cf3417 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:35.840006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64f1e40e-bcba-421f-afba-828e03cf3417 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:35.841119 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64f1e40e-bcba-421f-afba-828e03cf3417 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:35.842006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64f1e40e-bcba-421f-afba-828e03cf3417 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:35.843047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64f1e40e-bcba-421f-afba-828e03cf3417 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:35.843595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64f1e40e-bcba-421f-afba-828e03cf3417 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:36.260440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-64f1e40e-bcba-421f-afba-828e03cf3417 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:36.270709 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-64f1e40e-bcba-421f-afba-828e03cf3417 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1312 microversion: 2.1 time: 0.463132 Aug 04 16:59:36.290743 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 658/1365] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:35 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1312 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:36.298431 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2d1fae5e-052e-4205-a75e-6fdbe2b9be93 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:36.300157 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2d1fae5e-052e-4205-a75e-6fdbe2b9be93 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cafacd63-b815-4219-aa5e-f4aa05048c24] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:36.313008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d1fae5e-052e-4205-a75e-6fdbe2b9be93 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:36.314490 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d1fae5e-052e-4205-a75e-6fdbe2b9be93 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:36.316582 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d1fae5e-052e-4205-a75e-6fdbe2b9be93 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:36.317626 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d1fae5e-052e-4205-a75e-6fdbe2b9be93 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:36.318327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d1fae5e-052e-4205-a75e-6fdbe2b9be93 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:36.318965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d1fae5e-052e-4205-a75e-6fdbe2b9be93 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:36.424119 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2d1fae5e-052e-4205-a75e-6fdbe2b9be93 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ad6ccd2d804e158989a5f94c6f9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50604ce0bb604209a3c18932fdd193e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:36.438067 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2d1fae5e-052e-4205-a75e-6fdbe2b9be93 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24" status: 200 len: 1275 microversion: 2.1 time: 0.145856 Aug 04 16:59:36.438665 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 659/1366] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:36 2022] GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24 => generated 1275 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:36.450005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-1b3fbe3c-2225-49f3-9aae-fe7d6f8cea2f req-147ede17-b6af-49ca-bb95-a6c754a35a0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "332a6825-af0b-4bcd-92df-128b918d1a57", "name": "network-vif-plugged", "status": "completed", "tag": "0baa25b5-966d-4c17-abaf-1794a2778dc0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:36.464838 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1b3fbe3c-2225-49f3-9aae-fe7d6f8cea2f req-147ede17-b6af-49ca-bb95-a6c754a35a0b service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:36.465546 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1b3fbe3c-2225-49f3-9aae-fe7d6f8cea2f req-147ede17-b6af-49ca-bb95-a6c754a35a0b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:36.466215 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1b3fbe3c-2225-49f3-9aae-fe7d6f8cea2f req-147ede17-b6af-49ca-bb95-a6c754a35a0b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:36.481061 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-1b3fbe3c-2225-49f3-9aae-fe7d6f8cea2f req-147ede17-b6af-49ca-bb95-a6c754a35a0b service nova] Creating event network-vif-plugged:0baa25b5-966d-4c17-abaf-1794a2778dc0 for instance 332a6825-af0b-4bcd-92df-128b918d1a57 on n-h1-851359-3 Aug 04 16:59:36.498218 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-1b3fbe3c-2225-49f3-9aae-fe7d6f8cea2f req-147ede17-b6af-49ca-bb95-a6c754a35a0b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057672 Aug 04 16:59:36.499221 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 660/1367] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:36.508478 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-74d9e759-e0b6-4d70-820d-a8310ea9988e tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:36.510324 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-74d9e759-e0b6-4d70-820d-a8310ea9988e tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:36.520077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74d9e759-e0b6-4d70-820d-a8310ea9988e tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:36.520818 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74d9e759-e0b6-4d70-820d-a8310ea9988e tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:36.521489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74d9e759-e0b6-4d70-820d-a8310ea9988e tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:36.522691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74d9e759-e0b6-4d70-820d-a8310ea9988e tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:36.523770 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74d9e759-e0b6-4d70-820d-a8310ea9988e tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:36.524510 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74d9e759-e0b6-4d70-820d-a8310ea9988e tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:36.758752 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-537e6613-bed5-4c28-9804-a3ad36c8d079 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb/action" status: 202 len: 0 microversion: 2.1 time: 4.484204 Aug 04 16:59:36.760065 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 708/1368] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:59:32 2022] POST /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb/action => generated 0 bytes in 4486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:59:36.765346 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1db3acf6-9d5c-44e9-bafc-c44c20b35b81 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:36.766064 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1db3acf6-9d5c-44e9-bafc-c44c20b35b81 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b04e7f9-a53f-48ee-9389-366bd96d2bfd] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:36.780609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:36.783639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1db3acf6-9d5c-44e9-bafc-c44c20b35b81 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:36.784530 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1db3acf6-9d5c-44e9-bafc-c44c20b35b81 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:36.784974 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1db3acf6-9d5c-44e9-bafc-c44c20b35b81 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:36.785774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1db3acf6-9d5c-44e9-bafc-c44c20b35b81 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:36.786358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1db3acf6-9d5c-44e9-bafc-c44c20b35b81 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:36.786858 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1db3acf6-9d5c-44e9-bafc-c44c20b35b81 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:36.834080 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:36.912382 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-74d9e759-e0b6-4d70-820d-a8310ea9988e tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:36.938913 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1db3acf6-9d5c-44e9-bafc-c44c20b35b81 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:36.943128 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-74d9e759-e0b6-4d70-820d-a8310ea9988e tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8" status: 200 len: 1324 microversion: 2.1 time: 0.437480 Aug 04 16:59:36.944209 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 661/1369] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:36 2022] GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8 => generated 1324 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:36.957674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5f292619-0191-4957-92ac-6dbd5587943b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:36.957674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5f292619-0191-4957-92ac-6dbd5587943b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:36.957898 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1db3acf6-9d5c-44e9-bafc-c44c20b35b81 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd" status: 200 len: 1211 microversion: 2.1 time: 0.194875 Aug 04 16:59:36.957898 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 709/1370] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:36 2022] GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd => generated 1211 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:36.963361 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a46b9a43-0841-457c-9239-4b855841acd3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:36.963986 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a46b9a43-0841-457c-9239-4b855841acd3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 02856bd5-3936-4593-b70d-ddf3452f440d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:36.970864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f292619-0191-4957-92ac-6dbd5587943b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:36.973715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f292619-0191-4957-92ac-6dbd5587943b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:36.975460 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f292619-0191-4957-92ac-6dbd5587943b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:36.980987 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a46b9a43-0841-457c-9239-4b855841acd3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:36.981712 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f292619-0191-4957-92ac-6dbd5587943b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:36.982381 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f292619-0191-4957-92ac-6dbd5587943b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:36.983551 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a46b9a43-0841-457c-9239-4b855841acd3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:36.983923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f292619-0191-4957-92ac-6dbd5587943b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:36.984456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a46b9a43-0841-457c-9239-4b855841acd3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:36.985827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a46b9a43-0841-457c-9239-4b855841acd3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:36.986332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a46b9a43-0841-457c-9239-4b855841acd3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:36.986769 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a46b9a43-0841-457c-9239-4b855841acd3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:37.270676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5f292619-0191-4957-92ac-6dbd5587943b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:37.277566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a46b9a43-0841-457c-9239-4b855841acd3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:37.279418 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5f292619-0191-4957-92ac-6dbd5587943b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1716 microversion: 2.1 time: 0.333060 Aug 04 16:59:37.280162 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 662/1371] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:36 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1716 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:37.287179 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a46b9a43-0841-457c-9239-4b855841acd3 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d" status: 200 len: 1468 microversion: 2.1 time: 0.329277 Aug 04 16:59:37.287765 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 710/1372] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:36 2022] GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d => generated 1468 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:37.303006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7832b4ac-2a30-4206-9a57-e7f398665a13 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:37.304061 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7832b4ac-2a30-4206-9a57-e7f398665a13 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:37.311591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7832b4ac-2a30-4206-9a57-e7f398665a13 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:37.312354 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7832b4ac-2a30-4206-9a57-e7f398665a13 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:37.313010 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7832b4ac-2a30-4206-9a57-e7f398665a13 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:37.313943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7832b4ac-2a30-4206-9a57-e7f398665a13 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:37.314565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7832b4ac-2a30-4206-9a57-e7f398665a13 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:37.315061 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7832b4ac-2a30-4206-9a57-e7f398665a13 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:37.467003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b0fe5dca-0990-48ce-beca-4ad7a4e9263a tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:37.467944 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b0fe5dca-0990-48ce-beca-4ad7a4e9263a tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cafacd63-b815-4219-aa5e-f4aa05048c24] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:37.477917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0fe5dca-0990-48ce-beca-4ad7a4e9263a tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:37.478443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0fe5dca-0990-48ce-beca-4ad7a4e9263a tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:37.478895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0fe5dca-0990-48ce-beca-4ad7a4e9263a tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:37.479613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0fe5dca-0990-48ce-beca-4ad7a4e9263a tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:37.480075 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0fe5dca-0990-48ce-beca-4ad7a4e9263a tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:37.480529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0fe5dca-0990-48ce-beca-4ad7a4e9263a tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:37.504125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7832b4ac-2a30-4206-9a57-e7f398665a13 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:37.513791 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7832b4ac-2a30-4206-9a57-e7f398665a13 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1312 microversion: 2.1 time: 0.214853 Aug 04 16:59:37.518085 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 663/1373] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:37 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1312 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:37.931358 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-a029ca63-606e-4d3d-b7f1-5ef23bac106e req-3d04ad5d-8f29-464d-b6cb-b243638d3898 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02856bd5-3936-4593-b70d-ddf3452f440d", "name": "network-vif-deleted", "tag": "2354b854-6575-48f2-a27c-ae89d11c285d"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:37.975749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a029ca63-606e-4d3d-b7f1-5ef23bac106e req-3d04ad5d-8f29-464d-b6cb-b243638d3898 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:37.976436 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a029ca63-606e-4d3d-b7f1-5ef23bac106e req-3d04ad5d-8f29-464d-b6cb-b243638d3898 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:37.976894 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a029ca63-606e-4d3d-b7f1-5ef23bac106e req-3d04ad5d-8f29-464d-b6cb-b243638d3898 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:38.006316 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-a029ca63-606e-4d3d-b7f1-5ef23bac106e req-3d04ad5d-8f29-464d-b6cb-b243638d3898 service nova] Creating event network-vif-deleted:2354b854-6575-48f2-a27c-ae89d11c285d for instance 02856bd5-3936-4593-b70d-ddf3452f440d on n-h1-851359-3 Aug 04 16:59:38.026254 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-a029ca63-606e-4d3d-b7f1-5ef23bac106e req-3d04ad5d-8f29-464d-b6cb-b243638d3898 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098352 Aug 04 16:59:38.027584 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 664/1374] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:38.034584 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2500c7b4-0fa2-4418-9c92-4080c8fcaffc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:38.035587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2500c7b4-0fa2-4418-9c92-4080c8fcaffc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:38.044699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2500c7b4-0fa2-4418-9c92-4080c8fcaffc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:38.045543 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2500c7b4-0fa2-4418-9c92-4080c8fcaffc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:38.046411 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2500c7b4-0fa2-4418-9c92-4080c8fcaffc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:38.047300 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2500c7b4-0fa2-4418-9c92-4080c8fcaffc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:38.047927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2500c7b4-0fa2-4418-9c92-4080c8fcaffc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:38.049077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2500c7b4-0fa2-4418-9c92-4080c8fcaffc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:38.094594 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b0fe5dca-0990-48ce-beca-4ad7a4e9263a tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ad6ccd2d804e158989a5f94c6f9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50604ce0bb604209a3c18932fdd193e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:38.108387 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b0fe5dca-0990-48ce-beca-4ad7a4e9263a tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24" status: 200 len: 1275 microversion: 2.1 time: 0.645810 Aug 04 16:59:38.109489 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 711/1375] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:37 2022] GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24 => generated 1275 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:38.129667 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2c03bf46-543e-40a3-b953-f8e88c4c9ce1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:38.138785 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2c03bf46-543e-40a3-b953-f8e88c4c9ce1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b04e7f9-a53f-48ee-9389-366bd96d2bfd] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:38.157673 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c03bf46-543e-40a3-b953-f8e88c4c9ce1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:38.158488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c03bf46-543e-40a3-b953-f8e88c4c9ce1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:38.159403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c03bf46-543e-40a3-b953-f8e88c4c9ce1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:38.160314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c03bf46-543e-40a3-b953-f8e88c4c9ce1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:38.160943 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c03bf46-543e-40a3-b953-f8e88c4c9ce1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:38.161606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c03bf46-543e-40a3-b953-f8e88c4c9ce1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:38.384058 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2c03bf46-543e-40a3-b953-f8e88c4c9ce1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:38.394493 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2c03bf46-543e-40a3-b953-f8e88c4c9ce1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd" status: 200 len: 1273 microversion: 2.1 time: 0.269964 Aug 04 16:59:38.397706 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 712/1376] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:38 2022] GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd => generated 1273 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:38.406272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-94f73af8-9b5d-48de-b5cd-8d38bd7d3fea tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:38.412861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-94f73af8-9b5d-48de-b5cd-8d38bd7d3fea tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:38.437322 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94f73af8-9b5d-48de-b5cd-8d38bd7d3fea tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:38.445824 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94f73af8-9b5d-48de-b5cd-8d38bd7d3fea tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:38.446486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94f73af8-9b5d-48de-b5cd-8d38bd7d3fea tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:38.447267 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94f73af8-9b5d-48de-b5cd-8d38bd7d3fea tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:38.452252 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94f73af8-9b5d-48de-b5cd-8d38bd7d3fea tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:38.453181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94f73af8-9b5d-48de-b5cd-8d38bd7d3fea tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:38.520063 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2500c7b4-0fa2-4418-9c92-4080c8fcaffc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:38.528974 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2500c7b4-0fa2-4418-9c92-4080c8fcaffc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8" status: 200 len: 1324 microversion: 2.1 time: 0.499878 Aug 04 16:59:38.531778 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 665/1377] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:38 2022] GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8 => generated 1324 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:38.543882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d4025cf4-f900-4edb-b2cc-8371e8e66110 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:38.545044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d4025cf4-f900-4edb-b2cc-8371e8e66110 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 02856bd5-3936-4593-b70d-ddf3452f440d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:38.567062 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4025cf4-f900-4edb-b2cc-8371e8e66110 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:38.567897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4025cf4-f900-4edb-b2cc-8371e8e66110 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:38.568581 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4025cf4-f900-4edb-b2cc-8371e8e66110 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:38.569761 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4025cf4-f900-4edb-b2cc-8371e8e66110 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:38.570475 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4025cf4-f900-4edb-b2cc-8371e8e66110 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:38.571122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4025cf4-f900-4edb-b2cc-8371e8e66110 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:38.631150 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4025cf4-f900-4edb-b2cc-8371e8e66110 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:38.631664 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4025cf4-f900-4edb-b2cc-8371e8e66110 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:38.632174 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4025cf4-f900-4edb-b2cc-8371e8e66110 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:38.633610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-d4025cf4-f900-4edb-b2cc-8371e8e66110 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lazy-loading 'fault' on Instance uuid 02856bd5-3936-4593-b70d-ddf3452f440d {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:59:38.713805 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d4025cf4-f900-4edb-b2cc-8371e8e66110 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:38.723700 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d4025cf4-f900-4edb-b2cc-8371e8e66110 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d" status: 200 len: 1303 microversion: 2.1 time: 0.190331 Aug 04 16:59:38.729726 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 666/1378] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:38 2022] GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d => generated 1303 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:38.736587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-28d72bc7-1486-44c4-9328-d9ac1b834d2f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:38.737216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-28d72bc7-1486-44c4-9328-d9ac1b834d2f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:38.748585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28d72bc7-1486-44c4-9328-d9ac1b834d2f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:38.749403 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28d72bc7-1486-44c4-9328-d9ac1b834d2f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:38.750086 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28d72bc7-1486-44c4-9328-d9ac1b834d2f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:38.751222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28d72bc7-1486-44c4-9328-d9ac1b834d2f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:38.752089 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28d72bc7-1486-44c4-9328-d9ac1b834d2f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:38.752613 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28d72bc7-1486-44c4-9328-d9ac1b834d2f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:38.885456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-94f73af8-9b5d-48de-b5cd-8d38bd7d3fea tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:38.895961 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-94f73af8-9b5d-48de-b5cd-8d38bd7d3fea tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1716 microversion: 2.1 time: 0.494750 Aug 04 16:59:38.911079 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 713/1379] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:38 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1716 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:39.101695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-28d72bc7-1486-44c4-9328-d9ac1b834d2f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:39.110553 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-28d72bc7-1486-44c4-9328-d9ac1b834d2f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1461 microversion: 2.1 time: 0.379481 Aug 04 16:59:39.111092 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 667/1380] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:38 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1461 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:39.129829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1384fe70-e4db-445e-98f7-51c30f5e9935 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:39.131235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1384fe70-e4db-445e-98f7-51c30f5e9935 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cafacd63-b815-4219-aa5e-f4aa05048c24] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:39.146695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fc0ac218-573f-42e2-97a2-c142bc2c8203 tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:39.147162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1384fe70-e4db-445e-98f7-51c30f5e9935 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:39.147715 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1384fe70-e4db-445e-98f7-51c30f5e9935 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:39.150365 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1384fe70-e4db-445e-98f7-51c30f5e9935 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:39.151126 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1384fe70-e4db-445e-98f7-51c30f5e9935 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:39.151581 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fc0ac218-573f-42e2-97a2-c142bc2c8203 tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:39.156048 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1384fe70-e4db-445e-98f7-51c30f5e9935 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:39.156531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1384fe70-e4db-445e-98f7-51c30f5e9935 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:39.168361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc0ac218-573f-42e2-97a2-c142bc2c8203 tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:39.168882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc0ac218-573f-42e2-97a2-c142bc2c8203 tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:39.169329 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc0ac218-573f-42e2-97a2-c142bc2c8203 tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:39.170081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc0ac218-573f-42e2-97a2-c142bc2c8203 tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:39.178026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc0ac218-573f-42e2-97a2-c142bc2c8203 tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:39.178717 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc0ac218-573f-42e2-97a2-c142bc2c8203 tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:39.473460 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fc0ac218-573f-42e2-97a2-c142bc2c8203 tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1612 microversion: 2.1 time: 0.335682 Aug 04 16:59:39.474305 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 668/1381] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:39 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1612 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:39.490625 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4110bacb-d930-4d8e-adad-7bc63f1b2fac tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:39.492170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4110bacb-d930-4d8e-adad-7bc63f1b2fac tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b04e7f9-a53f-48ee-9389-366bd96d2bfd] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:39.504663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4110bacb-d930-4d8e-adad-7bc63f1b2fac tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:39.505245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4110bacb-d930-4d8e-adad-7bc63f1b2fac tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:39.505779 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4110bacb-d930-4d8e-adad-7bc63f1b2fac tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:39.506583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4110bacb-d930-4d8e-adad-7bc63f1b2fac tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:39.507310 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4110bacb-d930-4d8e-adad-7bc63f1b2fac tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:39.511682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4110bacb-d930-4d8e-adad-7bc63f1b2fac tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:39.674417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1384fe70-e4db-445e-98f7-51c30f5e9935 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ad6ccd2d804e158989a5f94c6f9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50604ce0bb604209a3c18932fdd193e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:39.689048 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1384fe70-e4db-445e-98f7-51c30f5e9935 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24" status: 200 len: 1317 microversion: 2.1 time: 0.561587 Aug 04 16:59:39.689689 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 714/1382] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:39 2022] GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24 => generated 1317 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:39.711416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-34c6c40a-a8f8-4475-ab38-1abc4a3d7edb tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:39.713374 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-34c6c40a-a8f8-4475-ab38-1abc4a3d7edb tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:39.735462 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-34c6c40a-a8f8-4475-ab38-1abc4a3d7edb tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:39.736145 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-34c6c40a-a8f8-4475-ab38-1abc4a3d7edb tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:39.736601 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-34c6c40a-a8f8-4475-ab38-1abc4a3d7edb tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:39.737346 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-34c6c40a-a8f8-4475-ab38-1abc4a3d7edb tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:39.737813 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-34c6c40a-a8f8-4475-ab38-1abc4a3d7edb tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:39.738307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-34c6c40a-a8f8-4475-ab38-1abc4a3d7edb tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:39.788095 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-34c6c40a-a8f8-4475-ab38-1abc4a3d7edb tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '88b72b6cf0e14849a4b09a9595b0bef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c5f6b6398d485baaf555deb448172f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:39.789616 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-34c6c40a-a8f8-4475-ab38-1abc4a3d7edb tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] flavor_id is None. Assuming migration. {{(pid=131043) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 04 16:59:39.790565 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-34c6c40a-a8f8-4475-ab38-1abc4a3d7edb tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=131043) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 16:59:39.872211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4110bacb-d930-4d8e-adad-7bc63f1b2fac tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:39.888888 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4110bacb-d930-4d8e-adad-7bc63f1b2fac tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd" status: 200 len: 1315 microversion: 2.1 time: 0.413002 Aug 04 16:59:39.893455 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 669/1383] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:39 2022] GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd => generated 1315 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:39.925059 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-88ea1837-10fb-4eba-b710-4bed4e44a920 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:39.927657 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-88ea1837-10fb-4eba-b710-4bed4e44a920 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:39.950293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88ea1837-10fb-4eba-b710-4bed4e44a920 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:39.950970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88ea1837-10fb-4eba-b710-4bed4e44a920 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:39.952706 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88ea1837-10fb-4eba-b710-4bed4e44a920 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:39.953544 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88ea1837-10fb-4eba-b710-4bed4e44a920 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:39.956215 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88ea1837-10fb-4eba-b710-4bed4e44a920 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:39.957422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88ea1837-10fb-4eba-b710-4bed4e44a920 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:39.988490 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-34c6c40a-a8f8-4475-ab38-1abc4a3d7edb tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57/action" status: 202 len: 0 microversion: 2.1 time: 0.297047 Aug 04 16:59:39.992892 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 715/1384] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 16:59:39 2022] POST /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 16:59:40.000071 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d45f4eba-bcaf-4b6a-b154-ff3195080191 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:40.001101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d45f4eba-bcaf-4b6a-b154-ff3195080191 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 02856bd5-3936-4593-b70d-ddf3452f440d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:40.012856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d45f4eba-bcaf-4b6a-b154-ff3195080191 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:40.013438 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d45f4eba-bcaf-4b6a-b154-ff3195080191 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:40.013894 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d45f4eba-bcaf-4b6a-b154-ff3195080191 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:40.017142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d45f4eba-bcaf-4b6a-b154-ff3195080191 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:40.017702 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d45f4eba-bcaf-4b6a-b154-ff3195080191 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:40.018116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d45f4eba-bcaf-4b6a-b154-ff3195080191 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:40.081484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d45f4eba-bcaf-4b6a-b154-ff3195080191 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:40.082060 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d45f4eba-bcaf-4b6a-b154-ff3195080191 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:40.082576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d45f4eba-bcaf-4b6a-b154-ff3195080191 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:40.083143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-d45f4eba-bcaf-4b6a-b154-ff3195080191 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lazy-loading 'fault' on Instance uuid 02856bd5-3936-4593-b70d-ddf3452f440d {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:59:40.217199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d45f4eba-bcaf-4b6a-b154-ff3195080191 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:40.234878 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d45f4eba-bcaf-4b6a-b154-ff3195080191 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d" status: 200 len: 1303 microversion: 2.1 time: 0.240703 Aug 04 16:59:40.235809 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 716/1385] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:39 2022] GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d => generated 1303 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:40.240295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-65c02395-6f6d-4877-9b9b-b5311d436add tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:40.241052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-65c02395-6f6d-4877-9b9b-b5311d436add tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:40.255764 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65c02395-6f6d-4877-9b9b-b5311d436add tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:40.256257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65c02395-6f6d-4877-9b9b-b5311d436add tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:40.256881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65c02395-6f6d-4877-9b9b-b5311d436add tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:40.257852 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65c02395-6f6d-4877-9b9b-b5311d436add tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:40.258512 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65c02395-6f6d-4877-9b9b-b5311d436add tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:40.261610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65c02395-6f6d-4877-9b9b-b5311d436add tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:40.577616 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-88ea1837-10fb-4eba-b710-4bed4e44a920 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:40.584009 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:40.624733 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-88ea1837-10fb-4eba-b710-4bed4e44a920 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8" status: 200 len: 1324 microversion: 2.1 time: 0.729362 Aug 04 16:59:40.627242 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 670/1386] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:39 2022] GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8 => generated 1324 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:40.639583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fdef415a-0510-48d7-9aa7-3f12e8cdcf9e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:40.641219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fdef415a-0510-48d7-9aa7-3f12e8cdcf9e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:40.659585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdef415a-0510-48d7-9aa7-3f12e8cdcf9e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:40.662514 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdef415a-0510-48d7-9aa7-3f12e8cdcf9e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:40.663112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdef415a-0510-48d7-9aa7-3f12e8cdcf9e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:40.666259 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdef415a-0510-48d7-9aa7-3f12e8cdcf9e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:40.669209 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdef415a-0510-48d7-9aa7-3f12e8cdcf9e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:40.669779 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdef415a-0510-48d7-9aa7-3f12e8cdcf9e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:40.930404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-65c02395-6f6d-4877-9b9b-b5311d436add tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:40.945263 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-65c02395-6f6d-4877-9b9b-b5311d436add tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1716 microversion: 2.1 time: 0.708149 Aug 04 16:59:40.949786 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 717/1387] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:40 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1716 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:40.973799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-26187e4e-d2e6-4264-8157-57cbf88fbfc9 req-768703de-d699-4572-9996-f4a0f515d064 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cafacd63-b815-4219-aa5e-f4aa05048c24", "tag": "87913dcc-9df8-49c0-bb57-443716142857"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:40.994042 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-26187e4e-d2e6-4264-8157-57cbf88fbfc9 req-768703de-d699-4572-9996-f4a0f515d064 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:40.994879 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-26187e4e-d2e6-4264-8157-57cbf88fbfc9 req-768703de-d699-4572-9996-f4a0f515d064 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:40.995782 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-26187e4e-d2e6-4264-8157-57cbf88fbfc9 req-768703de-d699-4572-9996-f4a0f515d064 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:41.019562 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-26187e4e-d2e6-4264-8157-57cbf88fbfc9 req-768703de-d699-4572-9996-f4a0f515d064 service nova] Creating event network-changed:87913dcc-9df8-49c0-bb57-443716142857 for instance cafacd63-b815-4219-aa5e-f4aa05048c24 on n-h1-851359-3 Aug 04 16:59:41.032380 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fdef415a-0510-48d7-9aa7-3f12e8cdcf9e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:41.033747 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-26187e4e-d2e6-4264-8157-57cbf88fbfc9 req-768703de-d699-4572-9996-f4a0f515d064 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080175 Aug 04 16:59:41.036215 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 718/1388] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:41.043466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-37dc2a71-4ea4-47a1-b8c2-296caae5c2e4 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:41.044404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-37dc2a71-4ea4-47a1-b8c2-296caae5c2e4 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cafacd63-b815-4219-aa5e-f4aa05048c24] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:41.049800 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fdef415a-0510-48d7-9aa7-3f12e8cdcf9e tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1470 microversion: 2.1 time: 0.419883 Aug 04 16:59:41.050629 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 671/1389] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:40 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1470 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:41.056292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ed65cc9e-99b1-4a3a-8b82-b42daae5228b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:41.068646 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ed65cc9e-99b1-4a3a-8b82-b42daae5228b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b04e7f9-a53f-48ee-9389-366bd96d2bfd] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:41.072432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37dc2a71-4ea4-47a1-b8c2-296caae5c2e4 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:41.073189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37dc2a71-4ea4-47a1-b8c2-296caae5c2e4 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:41.073803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37dc2a71-4ea4-47a1-b8c2-296caae5c2e4 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:41.074745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37dc2a71-4ea4-47a1-b8c2-296caae5c2e4 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:41.075397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37dc2a71-4ea4-47a1-b8c2-296caae5c2e4 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:41.075996 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37dc2a71-4ea4-47a1-b8c2-296caae5c2e4 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:41.078392 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed65cc9e-99b1-4a3a-8b82-b42daae5228b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:41.078931 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed65cc9e-99b1-4a3a-8b82-b42daae5228b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:41.079383 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed65cc9e-99b1-4a3a-8b82-b42daae5228b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:41.080469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed65cc9e-99b1-4a3a-8b82-b42daae5228b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:41.083292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed65cc9e-99b1-4a3a-8b82-b42daae5228b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:41.083746 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed65cc9e-99b1-4a3a-8b82-b42daae5228b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:41.564335 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-37dc2a71-4ea4-47a1-b8c2-296caae5c2e4 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ad6ccd2d804e158989a5f94c6f9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50604ce0bb604209a3c18932fdd193e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:41.577558 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-37dc2a71-4ea4-47a1-b8c2-296caae5c2e4 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24" status: 200 len: 1317 microversion: 2.1 time: 0.539520 Aug 04 16:59:41.578195 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 719/1390] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:41 2022] GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24 => generated 1317 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:41.587815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-582d38df-fa48-45c2-a372-1f951ddce9f2 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:41.588443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-582d38df-fa48-45c2-a372-1f951ddce9f2 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 02856bd5-3936-4593-b70d-ddf3452f440d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:41.623024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-582d38df-fa48-45c2-a372-1f951ddce9f2 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:41.624082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-582d38df-fa48-45c2-a372-1f951ddce9f2 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:41.624847 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-582d38df-fa48-45c2-a372-1f951ddce9f2 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:41.625855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-582d38df-fa48-45c2-a372-1f951ddce9f2 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:41.626585 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-582d38df-fa48-45c2-a372-1f951ddce9f2 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:41.627434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-582d38df-fa48-45c2-a372-1f951ddce9f2 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:41.640851 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ed65cc9e-99b1-4a3a-8b82-b42daae5228b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:41.660005 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ed65cc9e-99b1-4a3a-8b82-b42daae5228b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd" status: 200 len: 1315 microversion: 2.1 time: 0.607581 Aug 04 16:59:41.661079 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 672/1391] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:41 2022] GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd => generated 1315 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:41.668316 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3ee8faec-e4c2-4422-8500-19ed6aa7ab14 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:41.672198 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3ee8faec-e4c2-4422-8500-19ed6aa7ab14 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:41.673957 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-582d38df-fa48-45c2-a372-1f951ddce9f2 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] HTTP exception thrown: Instance 02856bd5-3936-4593-b70d-ddf3452f440d could not be found. Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-582d38df-fa48-45c2-a372-1f951ddce9f2 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Request method failure captured: Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d HTTP/1.1 Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_pUEA76YvJPEQ_-ipgjAub19CmZzGr3pU0Uq4mMZN8j6PWXkNReO93KYPdtJAKGYQ62KftSJBZULu_VL9_GNfN8DtlrOYz9Xnr_0abJAB7ZBAEPzon0_3LXvrmPLnJxobbOH7H8WpBocsQZyGBeL8cvu4yc4OtstS968GbT0QOGLh4 Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 42f88328efc24fa4b8e8e5023bd6d5a1 Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersAdminTestJSON-798012702 Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/42f88328efc24fa4b8e8e5023bd6d5a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/42f88328efc24fa4b8e8e5023bd6d5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_42f88328efc24fa4b8e8e5023bd6d5a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/42f88328efc24fa4b8e8e5023bd6d5a1"}]}] Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersAdminTestJSON-798012702 Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 42f88328efc24fa4b8e8e5023bd6d5a1 Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersAdminTestJSON-798012702 Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersAdminTestJSON-798012702-project Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 2965e80f1b6e4cf8b750a28de3129541 Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersAdminTestJSON-798012702-project Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 02856bd5-3936-4593-b70d-ddf3452f440d could not be found. Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '02856bd5-3936-4593-b70d-ddf3452f440d'} Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02856bd5-3936-4593-b70d-ddf3452f440d could not be found. Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02856bd5-3936-4593-b70d-ddf3452f440d could not be found. Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:41.676476 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:59:41.683657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:41.683657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:41.683657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:41.683657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:59:41.683657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:59:41.683657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02856bd5-3936-4593-b70d-ddf3452f440d could not be found. Aug 04 16:59:41.683657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 16:59:41.687120 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-582d38df-fa48-45c2-a372-1f951ddce9f2 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Returning 404 to user: Instance 02856bd5-3936-4593-b70d-ddf3452f440d could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:59:41.688382 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-582d38df-fa48-45c2-a372-1f951ddce9f2 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d" status: 404 len: 111 microversion: 2.1 time: 0.109206 Aug 04 16:59:41.692533 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 720/1392] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:41 2022] GET /compute/v2.1/servers/02856bd5-3936-4593-b70d-ddf3452f440d => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:59:41.698939 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4ce0612b-1624-4637-b362-ecef820cab40 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:41.700829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4ce0612b-1624-4637-b362-ecef820cab40 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:41.709724 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ee8faec-e4c2-4422-8500-19ed6aa7ab14 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:41.711634 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ee8faec-e4c2-4422-8500-19ed6aa7ab14 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:41.712329 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ee8faec-e4c2-4422-8500-19ed6aa7ab14 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:41.716658 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ee8faec-e4c2-4422-8500-19ed6aa7ab14 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:41.717387 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ee8faec-e4c2-4422-8500-19ed6aa7ab14 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:41.717833 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ee8faec-e4c2-4422-8500-19ed6aa7ab14 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:41.727978 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4ce0612b-1624-4637-b362-ecef820cab40 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:41.729609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4ce0612b-1624-4637-b362-ecef820cab40 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:41.740616 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4ce0612b-1624-4637-b362-ecef820cab40 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:41.742690 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4ce0612b-1624-4637-b362-ecef820cab40 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:41.744239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4ce0612b-1624-4637-b362-ecef820cab40 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:41.747049 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4ce0612b-1624-4637-b362-ecef820cab40 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:41.809528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4ce0612b-1624-4637-b362-ecef820cab40 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:59:41.871520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=12 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:42.012110 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4ce0612b-1624-4637-b362-ecef820cab40 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "DELETE /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 204 len: 0 microversion: 2.1 time: 0.317860 Aug 04 16:59:42.013317 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 721/1393] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 16:59:41 2022] DELETE /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:59:42.019786 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8c53602f-83aa-4f01-9bd8-e245c2501bfa tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:42.021542 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8c53602f-83aa-4f01-9bd8-e245c2501bfa tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:42.040195 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3ee8faec-e4c2-4422-8500-19ed6aa7ab14 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:42.050237 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3ee8faec-e4c2-4422-8500-19ed6aa7ab14 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8" status: 200 len: 1324 microversion: 2.1 time: 0.387306 Aug 04 16:59:42.051466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c53602f-83aa-4f01-9bd8-e245c2501bfa tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:42.052473 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c53602f-83aa-4f01-9bd8-e245c2501bfa tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:42.056728 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c53602f-83aa-4f01-9bd8-e245c2501bfa tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:42.057736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c53602f-83aa-4f01-9bd8-e245c2501bfa tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:42.058186 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 673/1394] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:41 2022] GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8 => generated 1324 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:42.063145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3bdbf04b-8bea-4906-adb0-b431d8725c79 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:42.063923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c53602f-83aa-4f01-9bd8-e245c2501bfa tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:42.064564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c53602f-83aa-4f01-9bd8-e245c2501bfa tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:42.073048 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3bdbf04b-8bea-4906-adb0-b431d8725c79 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:42.087647 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bdbf04b-8bea-4906-adb0-b431d8725c79 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:42.089051 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bdbf04b-8bea-4906-adb0-b431d8725c79 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:42.089704 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bdbf04b-8bea-4906-adb0-b431d8725c79 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:42.095840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bdbf04b-8bea-4906-adb0-b431d8725c79 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:42.096825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bdbf04b-8bea-4906-adb0-b431d8725c79 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:42.097714 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bdbf04b-8bea-4906-adb0-b431d8725c79 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:42.372456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8c53602f-83aa-4f01-9bd8-e245c2501bfa tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:42.408221 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8c53602f-83aa-4f01-9bd8-e245c2501bfa tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1716 microversion: 2.1 time: 0.393084 Aug 04 16:59:42.409417 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 722/1395] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:42 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1716 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:42.414262 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-82e7be2c-749c-4407-bac9-c7b264ac6cba tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:42.423587 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-82e7be2c-749c-4407-bac9-c7b264ac6cba tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:42.432942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82e7be2c-749c-4407-bac9-c7b264ac6cba tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:42.439222 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82e7be2c-749c-4407-bac9-c7b264ac6cba tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:42.439891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82e7be2c-749c-4407-bac9-c7b264ac6cba tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:42.440826 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82e7be2c-749c-4407-bac9-c7b264ac6cba tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:42.441759 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82e7be2c-749c-4407-bac9-c7b264ac6cba tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:42.442002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82e7be2c-749c-4407-bac9-c7b264ac6cba tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:42.462208 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3bdbf04b-8bea-4906-adb0-b431d8725c79 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:42.493288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:42.509759 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3bdbf04b-8bea-4906-adb0-b431d8725c79 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1470 microversion: 2.1 time: 0.450212 Aug 04 16:59:42.510623 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 674/1396] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:42 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1470 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:42.608451 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7ec216f4-5760-4ece-8089-2b31471e7a60 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:42.611780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7ec216f4-5760-4ece-8089-2b31471e7a60 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cafacd63-b815-4219-aa5e-f4aa05048c24] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:42.629583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:42.634628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ec216f4-5760-4ece-8089-2b31471e7a60 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:42.636057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ec216f4-5760-4ece-8089-2b31471e7a60 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:42.636732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ec216f4-5760-4ece-8089-2b31471e7a60 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:42.638199 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ec216f4-5760-4ece-8089-2b31471e7a60 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:42.638916 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ec216f4-5760-4ece-8089-2b31471e7a60 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:42.640395 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ec216f4-5760-4ece-8089-2b31471e7a60 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:42.823608 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-82e7be2c-749c-4407-bac9-c7b264ac6cba tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:42.836808 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-82e7be2c-749c-4407-bac9-c7b264ac6cba tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1470 microversion: 2.1 time: 0.425988 Aug 04 16:59:42.837488 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 723/1397] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:42 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1470 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:42.860762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-28718546-2145-49ca-8add-c157984587f8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:42.867605 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-28718546-2145-49ca-8add-c157984587f8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b04e7f9-a53f-48ee-9389-366bd96d2bfd] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:42.883047 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28718546-2145-49ca-8add-c157984587f8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:42.889204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28718546-2145-49ca-8add-c157984587f8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:42.890042 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28718546-2145-49ca-8add-c157984587f8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:42.891191 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28718546-2145-49ca-8add-c157984587f8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:42.893383 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28718546-2145-49ca-8add-c157984587f8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:42.896181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28718546-2145-49ca-8add-c157984587f8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:42.927640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7ec216f4-5760-4ece-8089-2b31471e7a60 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ad6ccd2d804e158989a5f94c6f9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50604ce0bb604209a3c18932fdd193e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:42.940894 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7ec216f4-5760-4ece-8089-2b31471e7a60 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24" status: 200 len: 1317 microversion: 2.1 time: 0.342460 Aug 04 16:59:42.941909 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 675/1398] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:42 2022] GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24 => generated 1317 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:43.077374 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d501561a-03cc-43b5-986d-f33e5bc10e59 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:43.078047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d501561a-03cc-43b5-986d-f33e5bc10e59 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:43.091066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d501561a-03cc-43b5-986d-f33e5bc10e59 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:43.091583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d501561a-03cc-43b5-986d-f33e5bc10e59 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:43.092033 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d501561a-03cc-43b5-986d-f33e5bc10e59 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:43.098528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d501561a-03cc-43b5-986d-f33e5bc10e59 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:43.099653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d501561a-03cc-43b5-986d-f33e5bc10e59 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:43.100326 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d501561a-03cc-43b5-986d-f33e5bc10e59 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:43.129346 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-28718546-2145-49ca-8add-c157984587f8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:43.139856 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-28718546-2145-49ca-8add-c157984587f8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd" status: 200 len: 1315 microversion: 2.1 time: 0.295482 Aug 04 16:59:43.141076 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 724/1399] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:42 2022] GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:43.326554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d501561a-03cc-43b5-986d-f33e5bc10e59 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:43.338329 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d501561a-03cc-43b5-986d-f33e5bc10e59 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8" status: 200 len: 1324 microversion: 2.1 time: 0.265372 Aug 04 16:59:43.352915 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 676/1400] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:43 2022] GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8 => generated 1324 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:59:43.432250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a4510441-ae48-42ba-8c15-345119ac257a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:43.433407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a4510441-ae48-42ba-8c15-345119ac257a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:43.445018 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4510441-ae48-42ba-8c15-345119ac257a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:43.445700 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4510441-ae48-42ba-8c15-345119ac257a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:43.446328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-539cf554-6b45-469f-be78-18abbe92d733 req-0aa22823-aa74-415f-89de-b3e9dc57960c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b04e7f9-a53f-48ee-9389-366bd96d2bfd", "tag": "67dcca79-0cb3-459e-a946-f0663fd939cb"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:43.446491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4510441-ae48-42ba-8c15-345119ac257a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:43.447452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4510441-ae48-42ba-8c15-345119ac257a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:43.448805 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4510441-ae48-42ba-8c15-345119ac257a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:43.449397 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4510441-ae48-42ba-8c15-345119ac257a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:43.471229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-539cf554-6b45-469f-be78-18abbe92d733 req-0aa22823-aa74-415f-89de-b3e9dc57960c service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:43.471713 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-539cf554-6b45-469f-be78-18abbe92d733 req-0aa22823-aa74-415f-89de-b3e9dc57960c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:43.472149 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-539cf554-6b45-469f-be78-18abbe92d733 req-0aa22823-aa74-415f-89de-b3e9dc57960c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:43.500570 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-539cf554-6b45-469f-be78-18abbe92d733 req-0aa22823-aa74-415f-89de-b3e9dc57960c service nova] Creating event network-changed:67dcca79-0cb3-459e-a946-f0663fd939cb for instance 1b04e7f9-a53f-48ee-9389-366bd96d2bfd on n-h2-851359-3 Aug 04 16:59:43.510403 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-539cf554-6b45-469f-be78-18abbe92d733 req-0aa22823-aa74-415f-89de-b3e9dc57960c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198779 Aug 04 16:59:43.516080 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 725/1401] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:43.534536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-02c867bb-0258-456b-a64e-47b82c29f89a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:43.535514 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-02c867bb-0258-456b-a64e-47b82c29f89a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:43.543295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02c867bb-0258-456b-a64e-47b82c29f89a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:43.544360 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02c867bb-0258-456b-a64e-47b82c29f89a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:43.545806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02c867bb-0258-456b-a64e-47b82c29f89a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:43.547171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02c867bb-0258-456b-a64e-47b82c29f89a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:43.548091 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02c867bb-0258-456b-a64e-47b82c29f89a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:43.549122 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02c867bb-0258-456b-a64e-47b82c29f89a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:43.785518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a4510441-ae48-42ba-8c15-345119ac257a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:43.800579 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a4510441-ae48-42ba-8c15-345119ac257a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1716 microversion: 2.1 time: 0.374498 Aug 04 16:59:43.801774 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 677/1402] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:43 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1716 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:59:43.853175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-02c867bb-0258-456b-a64e-47b82c29f89a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:43.861563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2a79c4a3-4c5a-4ada-8dad-99e77401c3a6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:43.861834 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-02c867bb-0258-456b-a64e-47b82c29f89a tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1470 microversion: 2.1 time: 0.331939 Aug 04 16:59:43.862460 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 726/1403] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:43 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1470 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:59:43.871154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2a79c4a3-4c5a-4ada-8dad-99e77401c3a6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:43.886270 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a79c4a3-4c5a-4ada-8dad-99e77401c3a6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:43.886800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a79c4a3-4c5a-4ada-8dad-99e77401c3a6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:43.887251 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a79c4a3-4c5a-4ada-8dad-99e77401c3a6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:43.887982 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a79c4a3-4c5a-4ada-8dad-99e77401c3a6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:43.895529 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a79c4a3-4c5a-4ada-8dad-99e77401c3a6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:43.895922 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a79c4a3-4c5a-4ada-8dad-99e77401c3a6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:43.968022 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ea4fdada-5c0f-40f4-a14c-aa64c481531c tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:43.968709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ea4fdada-5c0f-40f4-a14c-aa64c481531c tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cafacd63-b815-4219-aa5e-f4aa05048c24] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:43.988281 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea4fdada-5c0f-40f4-a14c-aa64c481531c tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:43.988812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea4fdada-5c0f-40f4-a14c-aa64c481531c tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:43.997058 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea4fdada-5c0f-40f4-a14c-aa64c481531c tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:43.997947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea4fdada-5c0f-40f4-a14c-aa64c481531c tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:43.998490 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea4fdada-5c0f-40f4-a14c-aa64c481531c tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:44.002912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea4fdada-5c0f-40f4-a14c-aa64c481531c tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:44.190953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2a79c4a3-4c5a-4ada-8dad-99e77401c3a6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:44.199419 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2a79c4a3-4c5a-4ada-8dad-99e77401c3a6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1470 microversion: 2.1 time: 0.342129 Aug 04 16:59:44.200014 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 678/1404] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:43 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1470 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:44.217788 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b6a00b58-cd2b-4929-a628-d9cccf7331e9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:44.223325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b6a00b58-cd2b-4929-a628-d9cccf7331e9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b04e7f9-a53f-48ee-9389-366bd96d2bfd] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:44.262699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6a00b58-cd2b-4929-a628-d9cccf7331e9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:44.263452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6a00b58-cd2b-4929-a628-d9cccf7331e9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:44.264087 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6a00b58-cd2b-4929-a628-d9cccf7331e9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:44.265021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6a00b58-cd2b-4929-a628-d9cccf7331e9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:44.265689 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6a00b58-cd2b-4929-a628-d9cccf7331e9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:44.266338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6a00b58-cd2b-4929-a628-d9cccf7331e9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:44.665141 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ea4fdada-5c0f-40f4-a14c-aa64c481531c tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ad6ccd2d804e158989a5f94c6f9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50604ce0bb604209a3c18932fdd193e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:44.686216 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ea4fdada-5c0f-40f4-a14c-aa64c481531c tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24" status: 200 len: 1317 microversion: 2.1 time: 0.723630 Aug 04 16:59:44.693636 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 727/1405] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:43 2022] GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24 => generated 1317 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:59:44.710482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d87ab640-09ed-4874-80b2-d4ae87ca0b8b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:44.711371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d87ab640-09ed-4874-80b2-d4ae87ca0b8b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:44.723169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b6a00b58-cd2b-4929-a628-d9cccf7331e9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:44.723672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d87ab640-09ed-4874-80b2-d4ae87ca0b8b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:44.724366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d87ab640-09ed-4874-80b2-d4ae87ca0b8b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:44.725013 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d87ab640-09ed-4874-80b2-d4ae87ca0b8b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:44.726019 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d87ab640-09ed-4874-80b2-d4ae87ca0b8b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:44.726650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d87ab640-09ed-4874-80b2-d4ae87ca0b8b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:44.727254 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d87ab640-09ed-4874-80b2-d4ae87ca0b8b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:44.735217 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b6a00b58-cd2b-4929-a628-d9cccf7331e9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd" status: 200 len: 1315 microversion: 2.1 time: 0.529348 Aug 04 16:59:44.737027 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 679/1406] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:44 2022] GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd => generated 1315 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:44.833012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-159eecfa-b92d-41cc-9c95-386fad7b4401 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:44.834352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-159eecfa-b92d-41cc-9c95-386fad7b4401 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:44.846917 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-159eecfa-b92d-41cc-9c95-386fad7b4401 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:44.847828 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-159eecfa-b92d-41cc-9c95-386fad7b4401 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:44.848528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-159eecfa-b92d-41cc-9c95-386fad7b4401 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:44.849510 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-159eecfa-b92d-41cc-9c95-386fad7b4401 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:44.850321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-159eecfa-b92d-41cc-9c95-386fad7b4401 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:44.851310 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-159eecfa-b92d-41cc-9c95-386fad7b4401 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:44.900783 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:45.172486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d87ab640-09ed-4874-80b2-d4ae87ca0b8b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:45.182015 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d87ab640-09ed-4874-80b2-d4ae87ca0b8b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8" status: 200 len: 1324 microversion: 2.1 time: 0.486261 Aug 04 16:59:45.207366 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 728/1407] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:44 2022] GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8 => generated 1324 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:45.212732 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-891791d5-24f3-4bbb-8990-e9af54ffa45e tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:45.213615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-891791d5-24f3-4bbb-8990-e9af54ffa45e tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:45.226127 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-891791d5-24f3-4bbb-8990-e9af54ffa45e tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:45.226914 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-891791d5-24f3-4bbb-8990-e9af54ffa45e tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:45.227512 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-891791d5-24f3-4bbb-8990-e9af54ffa45e tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:45.228404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-891791d5-24f3-4bbb-8990-e9af54ffa45e tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:45.229021 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-891791d5-24f3-4bbb-8990-e9af54ffa45e tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:45.229622 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-891791d5-24f3-4bbb-8990-e9af54ffa45e tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:45.451288 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-159eecfa-b92d-41cc-9c95-386fad7b4401 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:45.469228 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-159eecfa-b92d-41cc-9c95-386fad7b4401 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1716 microversion: 2.1 time: 0.645698 Aug 04 16:59:45.470478 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 680/1408] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:44 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1716 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:45.482257 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e69b43e2-1ace-41e6-8052-d72535e35d90 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:45.483208 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e69b43e2-1ace-41e6-8052-d72535e35d90 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:45.492698 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=20 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:45.496190 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e69b43e2-1ace-41e6-8052-d72535e35d90 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:45.496952 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e69b43e2-1ace-41e6-8052-d72535e35d90 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:45.497645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e69b43e2-1ace-41e6-8052-d72535e35d90 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:45.498671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e69b43e2-1ace-41e6-8052-d72535e35d90 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:45.500612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e69b43e2-1ace-41e6-8052-d72535e35d90 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:45.501228 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e69b43e2-1ace-41e6-8052-d72535e35d90 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:46.281495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-891791d5-24f3-4bbb-8990-e9af54ffa45e tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2965e80f1b6e4cf8b750a28de3129541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f88328efc24fa4b8e8e5023bd6d5a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:46.293380 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-891791d5-24f3-4bbb-8990-e9af54ffa45e tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 200 len: 1470 microversion: 2.1 time: 1.083845 Aug 04 16:59:46.307824 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 729/1409] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:45 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 1470 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:46.319630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-70d8dc6c-88f1-4b90-948d-fd050def2fc8 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:46.320260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-70d8dc6c-88f1-4b90-948d-fd050def2fc8 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cafacd63-b815-4219-aa5e-f4aa05048c24] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:46.328328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70d8dc6c-88f1-4b90-948d-fd050def2fc8 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:46.329177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70d8dc6c-88f1-4b90-948d-fd050def2fc8 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:46.329890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70d8dc6c-88f1-4b90-948d-fd050def2fc8 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:46.331860 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70d8dc6c-88f1-4b90-948d-fd050def2fc8 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:46.332509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70d8dc6c-88f1-4b90-948d-fd050def2fc8 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:46.333156 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70d8dc6c-88f1-4b90-948d-fd050def2fc8 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:46.621210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e69b43e2-1ace-41e6-8052-d72535e35d90 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:46.639604 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e69b43e2-1ace-41e6-8052-d72535e35d90 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1470 microversion: 2.1 time: 1.164282 Aug 04 16:59:46.640609 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 681/1410] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:45 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1470 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:46.659795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-c87c2ef1-d0bb-471f-8929-b25865d4e9ce req-daf1783b-cb85-49d9-b84e-9268c3ad0633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19c5ab52-7c2b-4d63-8628-43c75476e45c", "name": "network-vif-deleted", "tag": "134ee327-dd36-4c6e-b53f-b97914e333e8"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:46.684452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c87c2ef1-d0bb-471f-8929-b25865d4e9ce req-daf1783b-cb85-49d9-b84e-9268c3ad0633 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:46.686252 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c87c2ef1-d0bb-471f-8929-b25865d4e9ce req-daf1783b-cb85-49d9-b84e-9268c3ad0633 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:46.688389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c87c2ef1-d0bb-471f-8929-b25865d4e9ce req-daf1783b-cb85-49d9-b84e-9268c3ad0633 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:46.716213 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-c87c2ef1-d0bb-471f-8929-b25865d4e9ce req-daf1783b-cb85-49d9-b84e-9268c3ad0633 service nova] Creating event network-vif-deleted:134ee327-dd36-4c6e-b53f-b97914e333e8 for instance 19c5ab52-7c2b-4d63-8628-43c75476e45c on n-h2-851359-3 Aug 04 16:59:46.733418 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-c87c2ef1-d0bb-471f-8929-b25865d4e9ce req-daf1783b-cb85-49d9-b84e-9268c3ad0633 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087842 Aug 04 16:59:46.734134 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 682/1411] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:46.756275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e2685dff-83ef-4928-b279-aed7dfe803a1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:46.758186 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e2685dff-83ef-4928-b279-aed7dfe803a1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b04e7f9-a53f-48ee-9389-366bd96d2bfd] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:46.766684 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2685dff-83ef-4928-b279-aed7dfe803a1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:46.767245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2685dff-83ef-4928-b279-aed7dfe803a1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:46.767901 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2685dff-83ef-4928-b279-aed7dfe803a1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:46.769575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2685dff-83ef-4928-b279-aed7dfe803a1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:46.771107 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2685dff-83ef-4928-b279-aed7dfe803a1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:46.771616 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2685dff-83ef-4928-b279-aed7dfe803a1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:46.899258 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-70d8dc6c-88f1-4b90-948d-fd050def2fc8 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ad6ccd2d804e158989a5f94c6f9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50604ce0bb604209a3c18932fdd193e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:46.909626 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-70d8dc6c-88f1-4b90-948d-fd050def2fc8 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24" status: 200 len: 1317 microversion: 2.1 time: 0.595703 Aug 04 16:59:46.910243 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 730/1412] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:46 2022] GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24 => generated 1317 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:46.919404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-05a6fa5c-aad1-4094-ae34-a404f4c33596 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:46.924983 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-05a6fa5c-aad1-4094-ae34-a404f4c33596 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:46.941551 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05a6fa5c-aad1-4094-ae34-a404f4c33596 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:46.942324 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05a6fa5c-aad1-4094-ae34-a404f4c33596 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:46.942995 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05a6fa5c-aad1-4094-ae34-a404f4c33596 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:46.943938 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05a6fa5c-aad1-4094-ae34-a404f4c33596 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:46.944654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05a6fa5c-aad1-4094-ae34-a404f4c33596 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:46.948607 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05a6fa5c-aad1-4094-ae34-a404f4c33596 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:47.240458 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e2685dff-83ef-4928-b279-aed7dfe803a1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:47.258372 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e2685dff-83ef-4928-b279-aed7dfe803a1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd" status: 200 len: 1315 microversion: 2.1 time: 0.514434 Aug 04 16:59:47.259035 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 683/1413] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:46 2022] GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd => generated 1315 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:47.277653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a47b0397-1d82-40cf-bc9f-3f0528dedca8 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:47.278520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a47b0397-1d82-40cf-bc9f-3f0528dedca8 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:47.286379 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a47b0397-1d82-40cf-bc9f-3f0528dedca8 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:47.287108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a47b0397-1d82-40cf-bc9f-3f0528dedca8 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:47.287728 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a47b0397-1d82-40cf-bc9f-3f0528dedca8 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:47.288870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a47b0397-1d82-40cf-bc9f-3f0528dedca8 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:47.289497 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a47b0397-1d82-40cf-bc9f-3f0528dedca8 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:47.290697 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a47b0397-1d82-40cf-bc9f-3f0528dedca8 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:47.296113 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-05a6fa5c-aad1-4094-ae34-a404f4c33596 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:47.304757 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-05a6fa5c-aad1-4094-ae34-a404f4c33596 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8" status: 200 len: 1324 microversion: 2.1 time: 0.389704 Aug 04 16:59:47.322864 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 731/1414] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:46 2022] GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8 => generated 1324 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:47.331369 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-d7966cec-b4d0-40df-ab3a-0ddb90eaba71 req-3f9e0e87-7b86-4bd2-bc2e-daedbf8c0df3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07628113-e50c-4c63-bff3-0401009c87c8", "name": "network-vif-plugged", "status": "completed", "tag": "a6e94576-42ff-4f94-90f7-18335cd81c04"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:47.357214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d7966cec-b4d0-40df-ab3a-0ddb90eaba71 req-3f9e0e87-7b86-4bd2-bc2e-daedbf8c0df3 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:47.357955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d7966cec-b4d0-40df-ab3a-0ddb90eaba71 req-3f9e0e87-7b86-4bd2-bc2e-daedbf8c0df3 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:47.358720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d7966cec-b4d0-40df-ab3a-0ddb90eaba71 req-3f9e0e87-7b86-4bd2-bc2e-daedbf8c0df3 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:47.374012 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-d7966cec-b4d0-40df-ab3a-0ddb90eaba71 req-3f9e0e87-7b86-4bd2-bc2e-daedbf8c0df3 service nova] Creating event network-vif-plugged:a6e94576-42ff-4f94-90f7-18335cd81c04 for instance 07628113-e50c-4c63-bff3-0401009c87c8 on n-h1-851359-3 Aug 04 16:59:47.379231 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-d7966cec-b4d0-40df-ab3a-0ddb90eaba71 req-3f9e0e87-7b86-4bd2-bc2e-daedbf8c0df3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054832 Aug 04 16:59:47.380322 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 732/1415] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:47.387394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cbfae9e6-c531-46c6-bb2d-d7bf3113fcac tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:47.388309 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cbfae9e6-c531-46c6-bb2d-d7bf3113fcac tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:47.396594 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cbfae9e6-c531-46c6-bb2d-d7bf3113fcac tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:47.397403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cbfae9e6-c531-46c6-bb2d-d7bf3113fcac tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:47.398755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cbfae9e6-c531-46c6-bb2d-d7bf3113fcac tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:47.400001 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cbfae9e6-c531-46c6-bb2d-d7bf3113fcac tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:47.400687 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cbfae9e6-c531-46c6-bb2d-d7bf3113fcac tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:47.401274 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cbfae9e6-c531-46c6-bb2d-d7bf3113fcac tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:47.716736 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a47b0397-1d82-40cf-bc9f-3f0528dedca8 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:47.726403 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a47b0397-1d82-40cf-bc9f-3f0528dedca8 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1716 microversion: 2.1 time: 0.452676 Aug 04 16:59:47.727836 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 684/1416] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:47 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1716 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:47.733415 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-caf07c70-be7b-4119-a097-a96ff7334814 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:47.734794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-caf07c70-be7b-4119-a097-a96ff7334814 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] [instance: 19c5ab52-7c2b-4d63-8628-43c75476e45c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:47.741946 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-caf07c70-be7b-4119-a097-a96ff7334814 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:47.742623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-caf07c70-be7b-4119-a097-a96ff7334814 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:47.751777 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-caf07c70-be7b-4119-a097-a96ff7334814 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:47.752685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-caf07c70-be7b-4119-a097-a96ff7334814 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:47.753254 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-caf07c70-be7b-4119-a097-a96ff7334814 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:47.754548 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-caf07c70-be7b-4119-a097-a96ff7334814 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:47.754686 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-cbfae9e6-c531-46c6-bb2d-d7bf3113fcac tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lazy-loading 'services' on Instance uuid afea0f77-8d91-4170-934f-b6b7ef64d5a6 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 16:59:47.769748 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cbfae9e6-c531-46c6-bb2d-d7bf3113fcac tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 2341 microversion: 2.25 time: 0.388049 Aug 04 16:59:47.771960 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 733/1417] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:59:47 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 2341 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:59:47.777592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f567f47d-8d8c-4833-813d-b5c8a914a57b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:47.780029 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f567f47d-8d8c-4833-813d-b5c8a914a57b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:47.781089 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-caf07c70-be7b-4119-a097-a96ff7334814 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] HTTP exception thrown: Instance 19c5ab52-7c2b-4d63-8628-43c75476e45c could not be found. Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-caf07c70-be7b-4119-a097-a96ff7334814 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Request method failure captured: Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c HTTP/1.1 Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_pUEA76YvJPEQ_-ipgjAub19CmZzGr3pU0Uq4mMZN8j6PWXkNReO93KYPdtJAKGYQ62KftSJBZULu_VL9_GNfN8DtlrOYz9Xnr_0abJAB7ZBAEPzon0_3LXvrmPLnJxobbOH7H8WpBocsQZyGBeL8cvu4yc4OtstS968GbT0QOGLh4 Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 42f88328efc24fa4b8e8e5023bd6d5a1 Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersAdminTestJSON-798012702 Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/42f88328efc24fa4b8e8e5023bd6d5a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/42f88328efc24fa4b8e8e5023bd6d5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_42f88328efc24fa4b8e8e5023bd6d5a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/42f88328efc24fa4b8e8e5023bd6d5a1"}]}] Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersAdminTestJSON-798012702 Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 42f88328efc24fa4b8e8e5023bd6d5a1 Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersAdminTestJSON-798012702 Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersAdminTestJSON-798012702-project Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 2965e80f1b6e4cf8b750a28de3129541 Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersAdminTestJSON-798012702-project Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 19c5ab52-7c2b-4d63-8628-43c75476e45c could not be found. Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '19c5ab52-7c2b-4d63-8628-43c75476e45c'} Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19c5ab52-7c2b-4d63-8628-43c75476e45c could not be found. Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19c5ab52-7c2b-4d63-8628-43c75476e45c could not be found. Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:47.782909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:47.787609 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:47.787609 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:47.787609 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:47.787609 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:59:47.787609 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:59:47.787609 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19c5ab52-7c2b-4d63-8628-43c75476e45c could not be found. Aug 04 16:59:47.787609 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:47.787609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-caf07c70-be7b-4119-a097-a96ff7334814 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] Returning 404 to user: Instance 19c5ab52-7c2b-4d63-8628-43c75476e45c could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:59:47.787609 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-caf07c70-be7b-4119-a097-a96ff7334814 tempest-ServersAdminTestJSON-798012702 tempest-ServersAdminTestJSON-798012702-project] 10.222.0.93 "GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c" status: 404 len: 111 microversion: 2.1 time: 0.055193 Aug 04 16:59:47.787609 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 685/1418] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:47 2022] GET /compute/v2.1/servers/19c5ab52-7c2b-4d63-8628-43c75476e45c => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:59:47.790137 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-815fbcdf-0ecb-4750-a741-ed5cf0896101 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Action: 'create', calling method: .version_select at 0x7f1e5b50c310>, body: {"keypair": {"name": "tempest-keypair-1512317566", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMHt6IMfsWbDO9UO+JthTnwiMF3c8SRKLF26+fo9u6/re9gMf7j5UditfvfLtTC9kLltS/+BYbOaCbKSnGarTgBHkVEx4cCfGJp4j/9gOvhPFcGEv9hcgIbLioysuGObQ=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:47.808878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-815fbcdf-0ecb-4750-a741-ed5cf0896101 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Getting quotas for project d3928c7e72ed440aafbbfd6c2a269906. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:59:47.810719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f567f47d-8d8c-4833-813d-b5c8a914a57b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:47.814306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f567f47d-8d8c-4833-813d-b5c8a914a57b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:47.815121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f567f47d-8d8c-4833-813d-b5c8a914a57b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:47.816217 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f567f47d-8d8c-4833-813d-b5c8a914a57b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:47.820296 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f567f47d-8d8c-4833-813d-b5c8a914a57b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:47.820714 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f567f47d-8d8c-4833-813d-b5c8a914a57b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:47.821795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-815fbcdf-0ecb-4750-a741-ed5cf0896101 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Getting quotas for user 2dcf3d21bb40468f8f9e087fbd99152e and project d3928c7e72ed440aafbbfd6c2a269906. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:59:47.864752 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-815fbcdf-0ecb-4750-a741-ed5cf0896101 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.078163 Aug 04 16:59:47.866830 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 686/1419] 10.222.0.93 () {62 vars in 1200 bytes} [Thu Aug 4 16:59:47 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 81 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 16:59:47.872135 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7ee5ee9d-353e-413a-bb05-68a22874232d tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:47.876596 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:59:47.876596 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:59:47.878410 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ee5ee9d-353e-413a-bb05-68a22874232d tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:47.879077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ee5ee9d-353e-413a-bb05-68a22874232d tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:47.879680 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ee5ee9d-353e-413a-bb05-68a22874232d tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:47.880602 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ee5ee9d-353e-413a-bb05-68a22874232d tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:47.881213 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ee5ee9d-353e-413a-bb05-68a22874232d tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:47.882589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ee5ee9d-353e-413a-bb05-68a22874232d tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:47.923778 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7ee5ee9d-353e-413a-bb05-68a22874232d tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.054657 Aug 04 16:59:47.929778 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 687/1420] 10.222.0.93 () {60 vars in 1217 bytes} [Thu Aug 4 16:59:47 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:59:47.943899 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7f54ada4-4efa-4f4e-8af0-54bab729ec6a tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:47.944875 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7f54ada4-4efa-4f4e-8af0-54bab729ec6a tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cafacd63-b815-4219-aa5e-f4aa05048c24] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:47.954600 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f54ada4-4efa-4f4e-8af0-54bab729ec6a tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:47.955428 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f54ada4-4efa-4f4e-8af0-54bab729ec6a tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:47.955941 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f54ada4-4efa-4f4e-8af0-54bab729ec6a tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:47.956810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f54ada4-4efa-4f4e-8af0-54bab729ec6a tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:47.957332 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f54ada4-4efa-4f4e-8af0-54bab729ec6a tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:47.957870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f54ada4-4efa-4f4e-8af0-54bab729ec6a tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:48.157052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f567f47d-8d8c-4833-813d-b5c8a914a57b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:48.170795 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f567f47d-8d8c-4833-813d-b5c8a914a57b tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1475 microversion: 2.1 time: 0.397393 Aug 04 16:59:48.171656 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 734/1421] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:47 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1475 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:48.279081 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-af209f25-98ee-4546-8b87-8d1cb2f0ff26 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:48.280097 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-af209f25-98ee-4546-8b87-8d1cb2f0ff26 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b04e7f9-a53f-48ee-9389-366bd96d2bfd] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:48.289366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af209f25-98ee-4546-8b87-8d1cb2f0ff26 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:48.291868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af209f25-98ee-4546-8b87-8d1cb2f0ff26 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:48.292722 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af209f25-98ee-4546-8b87-8d1cb2f0ff26 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:48.294227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af209f25-98ee-4546-8b87-8d1cb2f0ff26 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:48.296484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af209f25-98ee-4546-8b87-8d1cb2f0ff26 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:48.298398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af209f25-98ee-4546-8b87-8d1cb2f0ff26 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:48.487115 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7f54ada4-4efa-4f4e-8af0-54bab729ec6a tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ad6ccd2d804e158989a5f94c6f9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50604ce0bb604209a3c18932fdd193e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:48.495997 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7f54ada4-4efa-4f4e-8af0-54bab729ec6a tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24" status: 200 len: 1317 microversion: 2.1 time: 0.560384 Aug 04 16:59:48.501639 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 688/1422] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:47 2022] GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24 => generated 1317 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:48.525051 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a2acdfa8-ebb2-41e1-af78-88844925233d tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:48.526731 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a2acdfa8-ebb2-41e1-af78-88844925233d tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:48.550770 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2acdfa8-ebb2-41e1-af78-88844925233d tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:48.551294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2acdfa8-ebb2-41e1-af78-88844925233d tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:48.551896 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2acdfa8-ebb2-41e1-af78-88844925233d tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:48.552830 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2acdfa8-ebb2-41e1-af78-88844925233d tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:48.556626 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2acdfa8-ebb2-41e1-af78-88844925233d tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:48.557093 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2acdfa8-ebb2-41e1-af78-88844925233d tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:48.598088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-af209f25-98ee-4546-8b87-8d1cb2f0ff26 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:48.617306 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-af209f25-98ee-4546-8b87-8d1cb2f0ff26 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd" status: 200 len: 1315 microversion: 2.1 time: 0.342171 Aug 04 16:59:48.618288 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 735/1423] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:48 2022] GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:48.758349 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c2fd50de-ae77-4e10-9cb0-95c3dae2ce8b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:48.760920 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c2fd50de-ae77-4e10-9cb0-95c3dae2ce8b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:48.772810 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2fd50de-ae77-4e10-9cb0-95c3dae2ce8b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:48.773413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2fd50de-ae77-4e10-9cb0-95c3dae2ce8b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:48.773866 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2fd50de-ae77-4e10-9cb0-95c3dae2ce8b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:48.774661 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2fd50de-ae77-4e10-9cb0-95c3dae2ce8b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:48.775129 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2fd50de-ae77-4e10-9cb0-95c3dae2ce8b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:48.775619 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2fd50de-ae77-4e10-9cb0-95c3dae2ce8b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:48.864945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a2acdfa8-ebb2-41e1-af78-88844925233d tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:48.873692 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a2acdfa8-ebb2-41e1-af78-88844925233d tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8" status: 200 len: 1324 microversion: 2.1 time: 0.366144 Aug 04 16:59:48.889610 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 689/1424] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:48 2022] GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8 => generated 1324 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:49.031265 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c2fd50de-ae77-4e10-9cb0-95c3dae2ce8b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:49.042759 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c2fd50de-ae77-4e10-9cb0-95c3dae2ce8b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1716 microversion: 2.1 time: 0.295702 Aug 04 16:59:49.043366 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 736/1425] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:48 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1716 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:49.201798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2a4e3161-0c1b-4caf-a2ab-760867da0221 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:49.203243 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2a4e3161-0c1b-4caf-a2ab-760867da0221 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:49.211439 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a4e3161-0c1b-4caf-a2ab-760867da0221 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:49.212437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a4e3161-0c1b-4caf-a2ab-760867da0221 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:49.213338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a4e3161-0c1b-4caf-a2ab-760867da0221 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:49.214857 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a4e3161-0c1b-4caf-a2ab-760867da0221 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:49.215545 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a4e3161-0c1b-4caf-a2ab-760867da0221 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:49.216136 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a4e3161-0c1b-4caf-a2ab-760867da0221 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:49.241863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:49.395255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2a4e3161-0c1b-4caf-a2ab-760867da0221 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:49.409464 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-08191bd5-ef45-4be7-bfeb-20aa6e668dfe req-2aeb16cc-30bf-4fed-84fb-c0d9c3bcb1d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cafacd63-b815-4219-aa5e-f4aa05048c24", "name": "network-vif-plugged", "status": "completed", "tag": "87913dcc-9df8-49c0-bb57-443716142857"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:49.423694 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2a4e3161-0c1b-4caf-a2ab-760867da0221 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1475 microversion: 2.1 time: 0.226088 Aug 04 16:59:49.424375 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 690/1426] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:49 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1475 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:49.436914 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-08191bd5-ef45-4be7-bfeb-20aa6e668dfe req-2aeb16cc-30bf-4fed-84fb-c0d9c3bcb1d9 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:49.439558 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-08191bd5-ef45-4be7-bfeb-20aa6e668dfe req-2aeb16cc-30bf-4fed-84fb-c0d9c3bcb1d9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:49.442235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-08191bd5-ef45-4be7-bfeb-20aa6e668dfe req-2aeb16cc-30bf-4fed-84fb-c0d9c3bcb1d9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:49.456482 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-08191bd5-ef45-4be7-bfeb-20aa6e668dfe req-2aeb16cc-30bf-4fed-84fb-c0d9c3bcb1d9 service nova] Creating event network-vif-plugged:87913dcc-9df8-49c0-bb57-443716142857 for instance cafacd63-b815-4219-aa5e-f4aa05048c24 on n-h1-851359-3 Aug 04 16:59:49.467152 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-08191bd5-ef45-4be7-bfeb-20aa6e668dfe req-2aeb16cc-30bf-4fed-84fb-c0d9c3bcb1d9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061441 Aug 04 16:59:49.469957 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 737/1427] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 16:59:49.523298 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0a41f504-0eff-4932-8ad8-752626d947a8 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:49.524256 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0a41f504-0eff-4932-8ad8-752626d947a8 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cafacd63-b815-4219-aa5e-f4aa05048c24] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:49.532221 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a41f504-0eff-4932-8ad8-752626d947a8 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:49.533038 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a41f504-0eff-4932-8ad8-752626d947a8 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:49.533809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a41f504-0eff-4932-8ad8-752626d947a8 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:49.534555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a41f504-0eff-4932-8ad8-752626d947a8 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:49.535179 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a41f504-0eff-4932-8ad8-752626d947a8 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:49.535759 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a41f504-0eff-4932-8ad8-752626d947a8 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:49.655232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d6c98e05-a61f-47ed-a1fb-178f2ef95af3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:49.656016 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d6c98e05-a61f-47ed-a1fb-178f2ef95af3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b04e7f9-a53f-48ee-9389-366bd96d2bfd] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:49.673481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6c98e05-a61f-47ed-a1fb-178f2ef95af3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:49.674038 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6c98e05-a61f-47ed-a1fb-178f2ef95af3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:49.674499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6c98e05-a61f-47ed-a1fb-178f2ef95af3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:49.675244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6c98e05-a61f-47ed-a1fb-178f2ef95af3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:49.675713 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6c98e05-a61f-47ed-a1fb-178f2ef95af3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:49.676148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6c98e05-a61f-47ed-a1fb-178f2ef95af3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:50.018565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0a41f504-0eff-4932-8ad8-752626d947a8 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ad6ccd2d804e158989a5f94c6f9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50604ce0bb604209a3c18932fdd193e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:50.028689 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0a41f504-0eff-4932-8ad8-752626d947a8 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24" status: 200 len: 1317 microversion: 2.1 time: 0.510474 Aug 04 16:59:50.030012 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 691/1428] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:49 2022] GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24 => generated 1317 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:50.036111 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e158388c-5ad2-4af4-83f9-bda5ac50d628 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:50.037325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e158388c-5ad2-4af4-83f9-bda5ac50d628 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:50.045539 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e158388c-5ad2-4af4-83f9-bda5ac50d628 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:50.046769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e158388c-5ad2-4af4-83f9-bda5ac50d628 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:50.047552 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e158388c-5ad2-4af4-83f9-bda5ac50d628 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:50.049194 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e158388c-5ad2-4af4-83f9-bda5ac50d628 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:50.049870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e158388c-5ad2-4af4-83f9-bda5ac50d628 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:50.050539 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e158388c-5ad2-4af4-83f9-bda5ac50d628 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:50.059895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d6c98e05-a61f-47ed-a1fb-178f2ef95af3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:50.067649 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d6c98e05-a61f-47ed-a1fb-178f2ef95af3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd" status: 200 len: 1315 microversion: 2.1 time: 0.422744 Aug 04 16:59:50.069258 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 738/1429] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:49 2022] GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:50.074359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2acbfe02-2d16-45bb-ac9c-ae0edabed3a9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:50.075072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2acbfe02-2d16-45bb-ac9c-ae0edabed3a9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:50.080983 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2acbfe02-2d16-45bb-ac9c-ae0edabed3a9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:50.081548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2acbfe02-2d16-45bb-ac9c-ae0edabed3a9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:50.082089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2acbfe02-2d16-45bb-ac9c-ae0edabed3a9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:50.082873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2acbfe02-2d16-45bb-ac9c-ae0edabed3a9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:50.083425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2acbfe02-2d16-45bb-ac9c-ae0edabed3a9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:50.083930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2acbfe02-2d16-45bb-ac9c-ae0edabed3a9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:50.308268 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e158388c-5ad2-4af4-83f9-bda5ac50d628 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:50.323404 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e158388c-5ad2-4af4-83f9-bda5ac50d628 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8" status: 200 len: 1520 microversion: 2.1 time: 0.290883 Aug 04 16:59:50.325894 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 692/1430] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:50 2022] GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8 => generated 1520 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:50.334689 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d2d6e802-42a4-4b3e-833e-906a582002f1 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1119053637", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "2670a136-e6c5-4074-a6e0-4da275e63c06"}, {"port": "7101ff22-4276-4569-b4b4-db682cbdbaf2", "tag": "port-1"}, {"port": "bd58d1ec-cf62-4cc6-8629-14df8de01861", "tag": "port-2"}, {"uuid": "172381f6-fbca-4c91-a857-f47764e2f7a7", "tag": "net-1"}, {"uuid": "172381f6-fbca-4c91-a857-f47764e2f7a7"}, {"uuid": "0bdcf9c8-d65d-479d-9744-3849b08ef863", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "0bdcf9c8-d65d-479d-9744-3849b08ef863", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "1d7d3861-acb3-4087-8664-b1e3b1676081", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "6b9a8d69-b818-4cd2-b110-157f9be489b8", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "c063f994-374f-4878-b5bb-5ed1f4448ab0", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--904951542"}], "key_name": "tempest-keypair-1512317566", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:50.360672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2acbfe02-2d16-45bb-ac9c-ae0edabed3a9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:50.375658 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2acbfe02-2d16-45bb-ac9c-ae0edabed3a9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1716 microversion: 2.1 time: 0.305046 Aug 04 16:59:50.376311 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 739/1431] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:50 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1716 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:50.383096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-125da440-bdc1-46c2-b714-83872177b6ef tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Action: 'create', calling method: .version_select at 0x7f1e6ca1d0d0>, body: {"pool": null} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:50.528944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-d2d6e802-42a4-4b3e-833e-906a582002f1 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] validate_networks() for [('2670a136-e6c5-4074-a6e0-4da275e63c06', None, None, None, None, None), (None, None, '7101ff22-4276-4569-b4b4-db682cbdbaf2', None, None, None), (None, None, 'bd58d1ec-cf62-4cc6-8629-14df8de01861', None, None, None), ('172381f6-fbca-4c91-a857-f47764e2f7a7', None, None, None, None, None), ('172381f6-fbca-4c91-a857-f47764e2f7a7', None, None, None, None, None), ('0bdcf9c8-d65d-479d-9744-3849b08ef863', '10.2.2.100', None, None, None, None), ('0bdcf9c8-d65d-479d-9744-3849b08ef863', '10.2.2.200', None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:59:52.650346 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-125da440-bdc1-46c2-b714-83872177b6ef tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.272614 Aug 04 16:59:52.652470 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 740/1432] 10.222.0.93 () {60 vars in 1170 bytes} [Thu Aug 4 16:59:50 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:52.662135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1a86bae6-9859-4c04-9b75-f4ad6f671d8f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:52.663131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1a86bae6-9859-4c04-9b75-f4ad6f671d8f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:52.671979 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a86bae6-9859-4c04-9b75-f4ad6f671d8f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:52.672712 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a86bae6-9859-4c04-9b75-f4ad6f671d8f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:52.673415 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a86bae6-9859-4c04-9b75-f4ad6f671d8f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:52.674471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a86bae6-9859-4c04-9b75-f4ad6f671d8f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:52.675298 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a86bae6-9859-4c04-9b75-f4ad6f671d8f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:52.676017 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a86bae6-9859-4c04-9b75-f4ad6f671d8f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:52.887742 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1a86bae6-9859-4c04-9b75-f4ad6f671d8f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:52.895590 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1a86bae6-9859-4c04-9b75-f4ad6f671d8f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1475 microversion: 2.1 time: 0.243482 Aug 04 16:59:52.896168 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 741/1433] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:52 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1475 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:52.904389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e9846578-ae4a-4aaf-bdbe-656ce8c05a9c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02ea4a2e-c015-444f-b810-16702890c1c3", "device": "/dev/xvdb"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:52.907428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e9846578-ae4a-4aaf-bdbe-656ce8c05a9c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:52.913678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9846578-ae4a-4aaf-bdbe-656ce8c05a9c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:52.914932 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9846578-ae4a-4aaf-bdbe-656ce8c05a9c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:52.915387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9846578-ae4a-4aaf-bdbe-656ce8c05a9c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:52.916433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9846578-ae4a-4aaf-bdbe-656ce8c05a9c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:52.916543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9846578-ae4a-4aaf-bdbe-656ce8c05a9c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:52.916981 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9846578-ae4a-4aaf-bdbe-656ce8c05a9c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:52.990658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:53.235712 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e9846578-ae4a-4aaf-bdbe-656ce8c05a9c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "POST /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.335579 Aug 04 16:59:53.236369 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 742/1434] 10.222.0.93 () {62 vars in 1364 bytes} [Thu Aug 4 16:59:52 2022] POST /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6/os-volume_attachments => generated 194 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 16:59:53.243062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cad339f2-2095-48ca-8ce4-2a23d8146f84 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:53.244002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cad339f2-2095-48ca-8ce4-2a23d8146f84 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cafacd63-b815-4219-aa5e-f4aa05048c24] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:53.251767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cad339f2-2095-48ca-8ce4-2a23d8146f84 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:53.252729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cad339f2-2095-48ca-8ce4-2a23d8146f84 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:53.253179 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cad339f2-2095-48ca-8ce4-2a23d8146f84 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:53.253909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cad339f2-2095-48ca-8ce4-2a23d8146f84 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:53.254406 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cad339f2-2095-48ca-8ce4-2a23d8146f84 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:53.254834 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cad339f2-2095-48ca-8ce4-2a23d8146f84 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:53.472439 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cad339f2-2095-48ca-8ce4-2a23d8146f84 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ad6ccd2d804e158989a5f94c6f9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50604ce0bb604209a3c18932fdd193e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:53.480932 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cad339f2-2095-48ca-8ce4-2a23d8146f84 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24" status: 200 len: 1506 microversion: 2.1 time: 0.243364 Aug 04 16:59:53.482210 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 743/1435] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:53 2022] GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24 => generated 1506 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:53.487253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-eaf330a8-14b8-4aea-8073-1127c68a776d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:53.487892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-eaf330a8-14b8-4aea-8073-1127c68a776d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b04e7f9-a53f-48ee-9389-366bd96d2bfd] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:53.494886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eaf330a8-14b8-4aea-8073-1127c68a776d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:53.495636 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eaf330a8-14b8-4aea-8073-1127c68a776d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:53.496285 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eaf330a8-14b8-4aea-8073-1127c68a776d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:53.497390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eaf330a8-14b8-4aea-8073-1127c68a776d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:53.498097 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eaf330a8-14b8-4aea-8073-1127c68a776d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:53.498734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eaf330a8-14b8-4aea-8073-1127c68a776d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:53.767775 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-eaf330a8-14b8-4aea-8073-1127c68a776d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:53.782311 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-eaf330a8-14b8-4aea-8073-1127c68a776d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd" status: 200 len: 1315 microversion: 2.1 time: 0.297726 Aug 04 16:59:53.784152 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 744/1436] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:53 2022] GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:53.790385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-101f5816-b763-408d-b994-08a5b427c30d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:53.791337 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-101f5816-b763-408d-b994-08a5b427c30d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:53.812187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-101f5816-b763-408d-b994-08a5b427c30d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:53.812925 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-101f5816-b763-408d-b994-08a5b427c30d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:53.813799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-101f5816-b763-408d-b994-08a5b427c30d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:53.816905 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-101f5816-b763-408d-b994-08a5b427c30d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:53.817510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-101f5816-b763-408d-b994-08a5b427c30d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:53.818154 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-101f5816-b763-408d-b994-08a5b427c30d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:53.862746 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d2d6e802-42a4-4b3e-833e-906a582002f1 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:59:53.863742 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d2d6e802-42a4-4b3e-833e-906a582002f1 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:59:53.865053 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d2d6e802-42a4-4b3e-833e-906a582002f1 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:59:53.866693 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d2d6e802-42a4-4b3e-833e-906a582002f1 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:59:53.867055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d2d6e802-42a4-4b3e-833e-906a582002f1 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:59:53.880713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2d6e802-42a4-4b3e-833e-906a582002f1 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:53.881228 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2d6e802-42a4-4b3e-833e-906a582002f1 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:53.882284 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2d6e802-42a4-4b3e-833e-906a582002f1 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:53.883040 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2d6e802-42a4-4b3e-833e-906a582002f1 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:53.883534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2d6e802-42a4-4b3e-833e-906a582002f1 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:53.883967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2d6e802-42a4-4b3e-833e-906a582002f1 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:53.914059 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-d2d6e802-42a4-4b3e-833e-906a582002f1 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Getting quotas for project d3928c7e72ed440aafbbfd6c2a269906. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:59:53.921435 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-d2d6e802-42a4-4b3e-833e-906a582002f1 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Getting quotas for user 2dcf3d21bb40468f8f9e087fbd99152e and project d3928c7e72ed440aafbbfd6c2a269906. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:59:54.004341 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-101f5816-b763-408d-b994-08a5b427c30d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:54.014556 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-101f5816-b763-408d-b994-08a5b427c30d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1716 microversion: 2.1 time: 0.228919 Aug 04 16:59:54.021413 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 745/1437] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:53 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1716 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:54.111769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d2d6e802-42a4-4b3e-833e-906a582002f1 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:59:54.115187 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d2d6e802-42a4-4b3e-833e-906a582002f1 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='1d7d3861-acb3-4087-8664-b1e3b1676081',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='6b9a8d69-b818-4cd2-b110-157f9be489b8',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c063f994-374f-4878-b5bb-5ed1f4448ab0',volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:59:54.225840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0e51d379-9cb6-4440-852a-bffc8706e77e tempest-ServicesAdminTestJSON-896340528 tempest-ServicesAdminTestJSON-896340528-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:54.229089 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:59:54.229089 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:59:54.230530 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e51d379-9cb6-4440-852a-bffc8706e77e tempest-ServicesAdminTestJSON-896340528 tempest-ServicesAdminTestJSON-896340528-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:54.231605 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e51d379-9cb6-4440-852a-bffc8706e77e tempest-ServicesAdminTestJSON-896340528 tempest-ServicesAdminTestJSON-896340528-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:54.232244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e51d379-9cb6-4440-852a-bffc8706e77e tempest-ServicesAdminTestJSON-896340528 tempest-ServicesAdminTestJSON-896340528-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:54.233010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e51d379-9cb6-4440-852a-bffc8706e77e tempest-ServicesAdminTestJSON-896340528 tempest-ServicesAdminTestJSON-896340528-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:54.233459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e51d379-9cb6-4440-852a-bffc8706e77e tempest-ServicesAdminTestJSON-896340528 tempest-ServicesAdminTestJSON-896340528-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:54.233890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e51d379-9cb6-4440-852a-bffc8706e77e tempest-ServicesAdminTestJSON-896340528 tempest-ServicesAdminTestJSON-896340528-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:54.262769 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0e51d379-9cb6-4440-852a-bffc8706e77e tempest-ServicesAdminTestJSON-896340528 tempest-ServicesAdminTestJSON-896340528-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.238796 Aug 04 16:59:54.264179 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 746/1438] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Aug 4 16:59:54 2022] GET /compute/v2.1/os-services => generated 944 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:54.276146 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b6a065ab-f347-416c-b6dd-ebe24d648ce3 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1202651711", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "fcf929f8-72e5-4701-9267-5cd4fba70ec8"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:54.340867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-b6a065ab-f347-416c-b6dd-ebe24d648ce3 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] validate_networks() for [('fcf929f8-72e5-4701-9267-5cd4fba70ec8', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 16:59:54.636167 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d2d6e802-42a4-4b3e-833e-906a582002f1 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 4.308637 Aug 04 16:59:54.637421 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 693/1439] 10.222.0.93 () {62 vars in 1189 bytes} [Thu Aug 4 16:59:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 4311 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 16:59:54.643949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b0955816-69ee-4491-8d3c-0848e63b1df8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:54.645275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b0955816-69ee-4491-8d3c-0848e63b1df8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:54.657903 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0955816-69ee-4491-8d3c-0848e63b1df8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:54.658682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0955816-69ee-4491-8d3c-0848e63b1df8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:54.659308 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0955816-69ee-4491-8d3c-0848e63b1df8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:54.660182 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0955816-69ee-4491-8d3c-0848e63b1df8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:54.660801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0955816-69ee-4491-8d3c-0848e63b1df8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:54.663228 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0955816-69ee-4491-8d3c-0848e63b1df8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:55.099945 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-b6a065ab-f347-416c-b6dd-ebe24d648ce3 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 16:59:55.101065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-b6a065ab-f347-416c-b6dd-ebe24d648ce3 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 16:59:55.101425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-b6a065ab-f347-416c-b6dd-ebe24d648ce3 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 16:59:55.101846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-b6a065ab-f347-416c-b6dd-ebe24d648ce3 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 16:59:55.103923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-b6a065ab-f347-416c-b6dd-ebe24d648ce3 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 16:59:55.113851 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6a065ab-f347-416c-b6dd-ebe24d648ce3 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:55.114394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6a065ab-f347-416c-b6dd-ebe24d648ce3 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:55.114845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6a065ab-f347-416c-b6dd-ebe24d648ce3 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:55.115623 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6a065ab-f347-416c-b6dd-ebe24d648ce3 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:55.116099 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6a065ab-f347-416c-b6dd-ebe24d648ce3 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:55.116534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6a065ab-f347-416c-b6dd-ebe24d648ce3 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:55.158591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b0955816-69ee-4491-8d3c-0848e63b1df8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:55.159085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-b6a065ab-f347-416c-b6dd-ebe24d648ce3 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Getting quotas for project 65efeb63178649a7bdc50a90cfc112e9. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 16:59:55.164809 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-b6a065ab-f347-416c-b6dd-ebe24d648ce3 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Getting quotas for user df06c4b403cc4fe5b76915e685b7cef5 and project 65efeb63178649a7bdc50a90cfc112e9. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 16:59:55.173417 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b0955816-69ee-4491-8d3c-0848e63b1df8 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1475 microversion: 2.1 time: 0.533718 Aug 04 16:59:55.183269 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b6a065ab-f347-416c-b6dd-ebe24d648ce3 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 16:59:55.185899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b6a065ab-f347-416c-b6dd-ebe24d648ce3 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 79650928-e2ee-4928-8421-c0423298fdad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 16:59:55.190636 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 694/1440] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:54 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1475 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:55.196374 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b78032d7-d25e-4871-85b3-f3d524a2358f tempest-ServicesAdminTestJSON-896340528 tempest-ServicesAdminTestJSON-896340528-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:55.200030 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:59:55.200030 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:59:55.201626 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b78032d7-d25e-4871-85b3-f3d524a2358f tempest-ServicesAdminTestJSON-896340528 tempest-ServicesAdminTestJSON-896340528-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:55.202322 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b78032d7-d25e-4871-85b3-f3d524a2358f tempest-ServicesAdminTestJSON-896340528 tempest-ServicesAdminTestJSON-896340528-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:55.202933 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b78032d7-d25e-4871-85b3-f3d524a2358f tempest-ServicesAdminTestJSON-896340528 tempest-ServicesAdminTestJSON-896340528-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:55.203978 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b78032d7-d25e-4871-85b3-f3d524a2358f tempest-ServicesAdminTestJSON-896340528 tempest-ServicesAdminTestJSON-896340528-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:55.204762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b78032d7-d25e-4871-85b3-f3d524a2358f tempest-ServicesAdminTestJSON-896340528 tempest-ServicesAdminTestJSON-896340528-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:55.205506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b78032d7-d25e-4871-85b3-f3d524a2358f tempest-ServicesAdminTestJSON-896340528 tempest-ServicesAdminTestJSON-896340528-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:55.222004 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:55.237200 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b78032d7-d25e-4871-85b3-f3d524a2358f tempest-ServicesAdminTestJSON-896340528 tempest-ServicesAdminTestJSON-896340528-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?host=n-d-851359-3" status: 200 len: 578 microversion: 2.1 time: 0.045196 Aug 04 16:59:55.238505 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 695/1441] 10.222.0.93 () {58 vars in 1172 bytes} [Thu Aug 4 16:59:55 2022] GET /compute/v2.1/os-services?host=n-d-851359-3 => generated 578 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:55.244013 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b6a065ab-f347-416c-b6dd-ebe24d648ce3 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.978273 Aug 04 16:59:55.246295 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 747/1442] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 16:59:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 16:59:55.252110 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-936552f8-dc9f-486d-8db2-cac332300b76 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:55.259178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-936552f8-dc9f-486d-8db2-cac332300b76 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:55.339878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-936552f8-dc9f-486d-8db2-cac332300b76 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:55.351429 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-be0f3df1-3cb7-4663-8d71-fed059d32bf4 req-6431ea11-9ce4-4aad-a4f0-696b911e4d9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b04e7f9-a53f-48ee-9389-366bd96d2bfd", "name": "network-vif-plugged", "status": "completed", "tag": "67dcca79-0cb3-459e-a946-f0663fd939cb"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:55.367383 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-936552f8-dc9f-486d-8db2-cac332300b76 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:55.369789 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-936552f8-dc9f-486d-8db2-cac332300b76 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:55.372578 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-936552f8-dc9f-486d-8db2-cac332300b76 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1286 microversion: 2.32 time: 0.131474 Aug 04 16:59:55.373395 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 696/1443] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:59:55 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1286 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:59:55.380847 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1b458410-1cf2-4e90-a61f-0ada5a705b72 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:55.381723 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1b458410-1cf2-4e90-a61f-0ada5a705b72 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b04e7f9-a53f-48ee-9389-366bd96d2bfd] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:55.391787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b458410-1cf2-4e90-a61f-0ada5a705b72 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:55.392578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b458410-1cf2-4e90-a61f-0ada5a705b72 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:55.393300 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b458410-1cf2-4e90-a61f-0ada5a705b72 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:55.394314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b458410-1cf2-4e90-a61f-0ada5a705b72 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:55.394970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b458410-1cf2-4e90-a61f-0ada5a705b72 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:55.396219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b458410-1cf2-4e90-a61f-0ada5a705b72 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:55.403985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-be0f3df1-3cb7-4663-8d71-fed059d32bf4 req-6431ea11-9ce4-4aad-a4f0-696b911e4d9f service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:55.404402 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-be0f3df1-3cb7-4663-8d71-fed059d32bf4 req-6431ea11-9ce4-4aad-a4f0-696b911e4d9f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:55.404849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-be0f3df1-3cb7-4663-8d71-fed059d32bf4 req-6431ea11-9ce4-4aad-a4f0-696b911e4d9f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:55.418824 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-be0f3df1-3cb7-4663-8d71-fed059d32bf4 req-6431ea11-9ce4-4aad-a4f0-696b911e4d9f service nova] Creating event network-vif-plugged:67dcca79-0cb3-459e-a946-f0663fd939cb for instance 1b04e7f9-a53f-48ee-9389-366bd96d2bfd on n-h2-851359-3 Aug 04 16:59:55.436216 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-be0f3df1-3cb7-4663-8d71-fed059d32bf4 req-6431ea11-9ce4-4aad-a4f0-696b911e4d9f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188142 Aug 04 16:59:55.436764 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 748/1444] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:55.454935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8528e0ee-d01d-4462-8693-5ecb86f137ab tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:55.455620 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8528e0ee-d01d-4462-8693-5ecb86f137ab tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:55.469366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8528e0ee-d01d-4462-8693-5ecb86f137ab tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:55.469880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8528e0ee-d01d-4462-8693-5ecb86f137ab tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:55.470436 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8528e0ee-d01d-4462-8693-5ecb86f137ab tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:55.476794 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8528e0ee-d01d-4462-8693-5ecb86f137ab tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:55.477310 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8528e0ee-d01d-4462-8693-5ecb86f137ab tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:55.503019 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8528e0ee-d01d-4462-8693-5ecb86f137ab tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:55.676578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1b458410-1cf2-4e90-a61f-0ada5a705b72 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:55.687873 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1b458410-1cf2-4e90-a61f-0ada5a705b72 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd" status: 200 len: 1315 microversion: 2.1 time: 0.313327 Aug 04 16:59:55.691328 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 697/1445] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:55 2022] GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:55.700484 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cc3b3411-5492-406e-904d-074c361068d2 tempest-ServicesAdminTestJSON-896340528 tempest-ServicesAdminTestJSON-896340528-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:55.708530 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:59:55.708530 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 16:59:55.709870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc3b3411-5492-406e-904d-074c361068d2 tempest-ServicesAdminTestJSON-896340528 tempest-ServicesAdminTestJSON-896340528-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:55.710363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc3b3411-5492-406e-904d-074c361068d2 tempest-ServicesAdminTestJSON-896340528 tempest-ServicesAdminTestJSON-896340528-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:55.710804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc3b3411-5492-406e-904d-074c361068d2 tempest-ServicesAdminTestJSON-896340528 tempest-ServicesAdminTestJSON-896340528-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:55.715935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc3b3411-5492-406e-904d-074c361068d2 tempest-ServicesAdminTestJSON-896340528 tempest-ServicesAdminTestJSON-896340528-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:55.716613 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc3b3411-5492-406e-904d-074c361068d2 tempest-ServicesAdminTestJSON-896340528 tempest-ServicesAdminTestJSON-896340528-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:55.717237 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc3b3411-5492-406e-904d-074c361068d2 tempest-ServicesAdminTestJSON-896340528 tempest-ServicesAdminTestJSON-896340528-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:55.774966 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cc3b3411-5492-406e-904d-074c361068d2 tempest-ServicesAdminTestJSON-896340528 tempest-ServicesAdminTestJSON-896340528-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.082490 Aug 04 16:59:55.775840 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 698/1446] 10.222.0.93 () {58 vars in 1176 bytes} [Thu Aug 4 16:59:55 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:55.789158 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e5f035d1-34f3-4b93-9eae-4225f142bc74 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:55.790138 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e5f035d1-34f3-4b93-9eae-4225f142bc74 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 79650928-e2ee-4928-8421-c0423298fdad] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:55.798227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8528e0ee-d01d-4462-8693-5ecb86f137ab tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:55.808314 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8528e0ee-d01d-4462-8693-5ecb86f137ab tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1716 microversion: 2.1 time: 0.366259 Aug 04 16:59:55.809369 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 749/1447] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:55 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1716 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:55.814805 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3a367465-c689-45d8-ae96-03bafd2c543c tempest-ServicesAdminTestJSON-896340528 tempest-ServicesAdminTestJSON-896340528-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:55.824088 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 16:59:55.824088 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 16:59:55.826486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a367465-c689-45d8-ae96-03bafd2c543c tempest-ServicesAdminTestJSON-896340528 tempest-ServicesAdminTestJSON-896340528-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:55.827272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a367465-c689-45d8-ae96-03bafd2c543c tempest-ServicesAdminTestJSON-896340528 tempest-ServicesAdminTestJSON-896340528-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:55.827976 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a367465-c689-45d8-ae96-03bafd2c543c tempest-ServicesAdminTestJSON-896340528 tempest-ServicesAdminTestJSON-896340528-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:55.829096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a367465-c689-45d8-ae96-03bafd2c543c tempest-ServicesAdminTestJSON-896340528 tempest-ServicesAdminTestJSON-896340528-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:55.829939 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a367465-c689-45d8-ae96-03bafd2c543c tempest-ServicesAdminTestJSON-896340528 tempest-ServicesAdminTestJSON-896340528-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:55.831029 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a367465-c689-45d8-ae96-03bafd2c543c tempest-ServicesAdminTestJSON-896340528 tempest-ServicesAdminTestJSON-896340528-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:55.850318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e5f035d1-34f3-4b93-9eae-4225f142bc74 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:55.860780 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e5f035d1-34f3-4b93-9eae-4225f142bc74 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad" status: 200 len: 1224 microversion: 2.1 time: 0.075744 Aug 04 16:59:55.861683 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 699/1448] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:55 2022] GET /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad => generated 1224 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:55.871735 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3a367465-c689-45d8-ae96-03bafd2c543c tempest-ServicesAdminTestJSON-896340528 tempest-ServicesAdminTestJSON-896340528-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.060779 Aug 04 16:59:55.873468 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 750/1449] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Aug 4 16:59:55 2022] GET /compute/v2.1/os-services => generated 944 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:56.045747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-758347b9-fe76-4d7b-a811-b7be2fbcb826 tempest-VolumesAdminNegativeTest-1555372171 tempest-VolumesAdminNegativeTest-1555372171-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "e47e9218-c2a9-4a62-a6f3-633c59474ce4"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:56.049191 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-758347b9-fe76-4d7b-a811-b7be2fbcb826 tempest-VolumesAdminNegativeTest-1555372171 tempest-VolumesAdminNegativeTest-1555372171-project-admin] [instance: cafacd63-b815-4219-aa5e-f4aa05048c24] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:56.059332 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-758347b9-fe76-4d7b-a811-b7be2fbcb826 tempest-VolumesAdminNegativeTest-1555372171 tempest-VolumesAdminNegativeTest-1555372171-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:56.060230 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-758347b9-fe76-4d7b-a811-b7be2fbcb826 tempest-VolumesAdminNegativeTest-1555372171 tempest-VolumesAdminNegativeTest-1555372171-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:56.061865 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-758347b9-fe76-4d7b-a811-b7be2fbcb826 tempest-VolumesAdminNegativeTest-1555372171 tempest-VolumesAdminNegativeTest-1555372171-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:56.063065 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-758347b9-fe76-4d7b-a811-b7be2fbcb826 tempest-VolumesAdminNegativeTest-1555372171 tempest-VolumesAdminNegativeTest-1555372171-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:56.063862 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-758347b9-fe76-4d7b-a811-b7be2fbcb826 tempest-VolumesAdminNegativeTest-1555372171 tempest-VolumesAdminNegativeTest-1555372171-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:56.064858 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-758347b9-fe76-4d7b-a811-b7be2fbcb826 tempest-VolumesAdminNegativeTest-1555372171 tempest-VolumesAdminNegativeTest-1555372171-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:56.138770 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-758347b9-fe76-4d7b-a811-b7be2fbcb826 tempest-VolumesAdminNegativeTest-1555372171 tempest-VolumesAdminNegativeTest-1555372171-project-admin] HTTP exception thrown: Volume d2390e79-4b01-4276-976c-2edf81eae066 could not be found. Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-758347b9-fe76-4d7b-a811-b7be2fbcb826 tempest-VolumesAdminNegativeTest-1555372171 tempest-VolumesAdminNegativeTest-1555372171-project-admin] Request method failure captured: Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: request: PUT /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24/os-volume_attachments/d2390e79-4b01-4276-976c-2edf81eae066 HTTP/1.1 Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 74 Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_qJ87kSkh0QGc0Kixaq90xMCi8n9LIeHP0DqQjz1JqNRuTDCNuY9IwV9TBBmQ1dsb2dXHuKTJZVXo79TwIDcnkOrVAnYxY9mKHJutS0D58DnO0z0QGWsKSd_YfsXp0Mb6MgiY9D8RuxmtiiM2O7syVHpWFxtSNzkeRJUespbOgNEPY Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 6eb904c160c34e129309934e76dce27b Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-VolumesAdminNegativeTest-1555372171 Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: X-Role: admin,member,reader Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: admin,member,reader Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6eb904c160c34e129309934e76dce27b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6eb904c160c34e129309934e76dce27b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6eb904c160c34e129309934e76dce27b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6eb904c160c34e129309934e76dce27b"}]}] Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-VolumesAdminNegativeTest-1555372171 Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 6eb904c160c34e129309934e76dce27b Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1555372171 Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-VolumesAdminNegativeTest-1555372171-project-admin Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 9cfd58f863424a96a62eb1102ce3d31a Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-VolumesAdminNegativeTest-1555372171-project-admin Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: {"volumeAttachment": {"volumeId": "e47e9218-c2a9-4a62-a6f3-633c59474ce4"}} Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: exception: Volume d2390e79-4b01-4276-976c-2edf81eae066 could not be found. Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'server_id': 'cafacd63-b815-4219-aa5e-f4aa05048c24', 'id': 'd2390e79-4b01-4276-976c-2edf81eae066', 'body': {'volumeAttachment': {'volumeId': 'e47e9218-c2a9-4a62-a6f3-633c59474ce4'}}} Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d2390e79-4b01-4276-976c-2edf81eae066 could not be found. (HTTP 404) (Request-ID: req-16a8c3a9-2daa-4b99-a7fa-deddfa48d368) Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 16:59:56.154881 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d2390e79-4b01-4276-976c-2edf81eae066 could not be found. Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d2390e79-4b01-4276-976c-2edf81eae066 could not be found. Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d2390e79-4b01-4276-976c-2edf81eae066 could not be found. Aug 04 16:59:56.159992 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 16:59:56.168630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-758347b9-fe76-4d7b-a811-b7be2fbcb826 tempest-VolumesAdminNegativeTest-1555372171 tempest-VolumesAdminNegativeTest-1555372171-project-admin] Returning 404 to user: Volume d2390e79-4b01-4276-976c-2edf81eae066 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 16:59:56.169225 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-758347b9-fe76-4d7b-a811-b7be2fbcb826 tempest-VolumesAdminNegativeTest-1555372171 tempest-VolumesAdminNegativeTest-1555372171-project-admin] 10.222.0.93 "PUT /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24/os-volume_attachments/d2390e79-4b01-4276-976c-2edf81eae066" status: 404 len: 109 microversion: 2.1 time: 0.128127 Aug 04 16:59:56.169819 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 700/1450] 10.222.0.93 () {60 vars in 1433 bytes} [Thu Aug 4 16:59:56 2022] PUT /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24/os-volume_attachments/d2390e79-4b01-4276-976c-2edf81eae066 => generated 109 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 16:59:56.198784 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b68454b9-6448-4d1d-830b-c49662155bf9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:56.199456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b68454b9-6448-4d1d-830b-c49662155bf9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:56.213377 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b68454b9-6448-4d1d-830b-c49662155bf9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:56.214915 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b68454b9-6448-4d1d-830b-c49662155bf9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:56.215584 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b68454b9-6448-4d1d-830b-c49662155bf9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:56.217096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b68454b9-6448-4d1d-830b-c49662155bf9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:56.217931 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b68454b9-6448-4d1d-830b-c49662155bf9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:56.218606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b68454b9-6448-4d1d-830b-c49662155bf9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:56.397302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ab619c8e-7341-4774-8beb-77882ac023c5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:56.397934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ab619c8e-7341-4774-8beb-77882ac023c5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:56.404315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab619c8e-7341-4774-8beb-77882ac023c5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:56.408802 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab619c8e-7341-4774-8beb-77882ac023c5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:56.410588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab619c8e-7341-4774-8beb-77882ac023c5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:56.421348 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab619c8e-7341-4774-8beb-77882ac023c5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:56.422595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab619c8e-7341-4774-8beb-77882ac023c5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:56.424260 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab619c8e-7341-4774-8beb-77882ac023c5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:56.646559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b68454b9-6448-4d1d-830b-c49662155bf9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:56.654322 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b68454b9-6448-4d1d-830b-c49662155bf9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1475 microversion: 2.1 time: 0.461096 Aug 04 16:59:56.658290 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 751/1451] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:56 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1475 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:56.663019 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-92b86954-ca65-4c58-b7a2-adbbc91049f2 req-b41a2866-61a7-487c-adfd-c15e8faaf124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e92cd73d-ce71-4f92-9db9-ae02c7febbcb", "name": "network-vif-unplugged", "status": "completed", "tag": "46af0dd3-3cdc-4c63-9694-d9b2f7cf2afa"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:56.695344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-92b86954-ca65-4c58-b7a2-adbbc91049f2 req-b41a2866-61a7-487c-adfd-c15e8faaf124 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:56.695984 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-92b86954-ca65-4c58-b7a2-adbbc91049f2 req-b41a2866-61a7-487c-adfd-c15e8faaf124 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:56.696274 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-92b86954-ca65-4c58-b7a2-adbbc91049f2 req-b41a2866-61a7-487c-adfd-c15e8faaf124 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:56.708301 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-92b86954-ca65-4c58-b7a2-adbbc91049f2 req-b41a2866-61a7-487c-adfd-c15e8faaf124 service nova] Creating event network-vif-unplugged:46af0dd3-3cdc-4c63-9694-d9b2f7cf2afa for instance e92cd73d-ce71-4f92-9db9-ae02c7febbcb on n-h2-851359-3 Aug 04 16:59:56.713596 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-92b86954-ca65-4c58-b7a2-adbbc91049f2 req-b41a2866-61a7-487c-adfd-c15e8faaf124 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054121 Aug 04 16:59:56.714730 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 752/1452] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:56.719987 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-19f90383-2d4f-4c44-87aa-66127d77b1d8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:56.720903 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-19f90383-2d4f-4c44-87aa-66127d77b1d8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b04e7f9-a53f-48ee-9389-366bd96d2bfd] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:56.727723 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19f90383-2d4f-4c44-87aa-66127d77b1d8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:56.728432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19f90383-2d4f-4c44-87aa-66127d77b1d8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:56.729056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19f90383-2d4f-4c44-87aa-66127d77b1d8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:56.729928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19f90383-2d4f-4c44-87aa-66127d77b1d8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:56.730648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19f90383-2d4f-4c44-87aa-66127d77b1d8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:56.731314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19f90383-2d4f-4c44-87aa-66127d77b1d8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:56.899530 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ab619c8e-7341-4774-8beb-77882ac023c5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:56.914923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ab619c8e-7341-4774-8beb-77882ac023c5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:56.920865 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ab619c8e-7341-4774-8beb-77882ac023c5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:56.923637 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ab619c8e-7341-4774-8beb-77882ac023c5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1528 microversion: 2.32 time: 0.529370 Aug 04 16:59:56.926260 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 701/1453] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:59:56 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1528 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 16:59:56.941598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-59dd77f0-4ef6-45fe-8c56-1f76b00f76f6 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:56.942719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-59dd77f0-4ef6-45fe-8c56-1f76b00f76f6 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:56.956682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59dd77f0-4ef6-45fe-8c56-1f76b00f76f6 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:56.958522 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59dd77f0-4ef6-45fe-8c56-1f76b00f76f6 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:56.958985 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59dd77f0-4ef6-45fe-8c56-1f76b00f76f6 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:56.959753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59dd77f0-4ef6-45fe-8c56-1f76b00f76f6 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:56.960230 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59dd77f0-4ef6-45fe-8c56-1f76b00f76f6 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:56.961237 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59dd77f0-4ef6-45fe-8c56-1f76b00f76f6 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:57.233350 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-19f90383-2d4f-4c44-87aa-66127d77b1d8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:57.246479 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-19f90383-2d4f-4c44-87aa-66127d77b1d8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd" status: 200 len: 1315 microversion: 2.1 time: 0.530214 Aug 04 16:59:57.247074 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 753/1454] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:56 2022] GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd => generated 1315 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:57.266306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6683b932-1add-4fd4-9c6c-4aa7a712c519 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:57.267222 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6683b932-1add-4fd4-9c6c-4aa7a712c519 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 79650928-e2ee-4928-8421-c0423298fdad] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:57.274921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6683b932-1add-4fd4-9c6c-4aa7a712c519 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:57.275783 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6683b932-1add-4fd4-9c6c-4aa7a712c519 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:57.276461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6683b932-1add-4fd4-9c6c-4aa7a712c519 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:57.277460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6683b932-1add-4fd4-9c6c-4aa7a712c519 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:57.278436 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6683b932-1add-4fd4-9c6c-4aa7a712c519 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:57.279116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6683b932-1add-4fd4-9c6c-4aa7a712c519 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:57.483108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6683b932-1add-4fd4-9c6c-4aa7a712c519 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:57.495667 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6683b932-1add-4fd4-9c6c-4aa7a712c519 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad" status: 200 len: 1276 microversion: 2.1 time: 0.233524 Aug 04 16:59:57.497453 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 754/1455] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:57 2022] GET /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad => generated 1276 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:57.551959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-59dd77f0-4ef6-45fe-8c56-1f76b00f76f6 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:57.566470 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-59dd77f0-4ef6-45fe-8c56-1f76b00f76f6 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1716 microversion: 2.1 time: 0.638783 Aug 04 16:59:57.568188 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 702/1456] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:56 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1716 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:57.688143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9e818597-ba0f-4861-aa17-73f65188368a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:57.699730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9e818597-ba0f-4861-aa17-73f65188368a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:57.718378 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e818597-ba0f-4861-aa17-73f65188368a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:57.723235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e818597-ba0f-4861-aa17-73f65188368a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:57.724616 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e818597-ba0f-4861-aa17-73f65188368a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:57.725942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e818597-ba0f-4861-aa17-73f65188368a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:57.726462 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e818597-ba0f-4861-aa17-73f65188368a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:57.726907 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e818597-ba0f-4861-aa17-73f65188368a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:57.954574 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a4851f98-7a62-4027-9b81-960235485486 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:57.955499 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a4851f98-7a62-4027-9b81-960235485486 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:57.962950 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4851f98-7a62-4027-9b81-960235485486 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:57.963760 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4851f98-7a62-4027-9b81-960235485486 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:57.964746 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4851f98-7a62-4027-9b81-960235485486 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:57.965656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4851f98-7a62-4027-9b81-960235485486 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:57.966338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4851f98-7a62-4027-9b81-960235485486 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:57.967025 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4851f98-7a62-4027-9b81-960235485486 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:58.003320 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9e818597-ba0f-4861-aa17-73f65188368a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:58.012943 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9e818597-ba0f-4861-aa17-73f65188368a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1475 microversion: 2.1 time: 0.340227 Aug 04 16:59:58.017459 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 755/1457] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:57 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1475 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:58.108483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a4851f98-7a62-4027-9b81-960235485486 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:58.120239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a4851f98-7a62-4027-9b81-960235485486 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:58.122685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a4851f98-7a62-4027-9b81-960235485486 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:58.124688 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a4851f98-7a62-4027-9b81-960235485486 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1576 microversion: 2.32 time: 0.176152 Aug 04 16:59:58.125933 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 703/1458] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:59:57 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:59:58.268401 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d63473fc-0574-4fee-b77d-4895f15c0696 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:58.269133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d63473fc-0574-4fee-b77d-4895f15c0696 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b04e7f9-a53f-48ee-9389-366bd96d2bfd] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:58.281708 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d63473fc-0574-4fee-b77d-4895f15c0696 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:58.282525 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d63473fc-0574-4fee-b77d-4895f15c0696 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:58.283059 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d63473fc-0574-4fee-b77d-4895f15c0696 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:58.285710 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d63473fc-0574-4fee-b77d-4895f15c0696 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:58.289427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d63473fc-0574-4fee-b77d-4895f15c0696 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:58.291249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d63473fc-0574-4fee-b77d-4895f15c0696 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:58.518658 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d9028694-f0a5-4aae-a642-354de066fd6e tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:58.519443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d9028694-f0a5-4aae-a642-354de066fd6e tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 79650928-e2ee-4928-8421-c0423298fdad] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:58.547827 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9028694-f0a5-4aae-a642-354de066fd6e tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:58.548486 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9028694-f0a5-4aae-a642-354de066fd6e tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:58.549309 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9028694-f0a5-4aae-a642-354de066fd6e tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:58.550188 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9028694-f0a5-4aae-a642-354de066fd6e tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:58.556857 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9028694-f0a5-4aae-a642-354de066fd6e tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:58.557507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9028694-f0a5-4aae-a642-354de066fd6e tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:58.618433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d63473fc-0574-4fee-b77d-4895f15c0696 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:58.630267 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d63473fc-0574-4fee-b77d-4895f15c0696 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd" status: 200 len: 1501 microversion: 2.1 time: 0.366011 Aug 04 16:59:58.631669 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 756/1459] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:58 2022] GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd => generated 1501 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:58.639934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1d4a830e-d45c-435f-a6d9-6661be07a333 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:58.656971 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1d4a830e-d45c-435f-a6d9-6661be07a333 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:58.676973 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d4a830e-d45c-435f-a6d9-6661be07a333 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:58.678806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d4a830e-d45c-435f-a6d9-6661be07a333 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:58.681682 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d4a830e-d45c-435f-a6d9-6661be07a333 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:58.682735 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d4a830e-d45c-435f-a6d9-6661be07a333 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:58.687250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d4a830e-d45c-435f-a6d9-6661be07a333 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:58.688733 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d4a830e-d45c-435f-a6d9-6661be07a333 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:58.744005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d9028694-f0a5-4aae-a642-354de066fd6e tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:58.766625 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d9028694-f0a5-4aae-a642-354de066fd6e tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad" status: 200 len: 1294 microversion: 2.1 time: 0.241874 Aug 04 16:59:58.781169 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 704/1460] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:58 2022] GET /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad => generated 1294 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 16:59:58.792226 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-843f06a6-7a35-4aaa-b533-e14fc9931084 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:58.793356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-843f06a6-7a35-4aaa-b533-e14fc9931084 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b04e7f9-a53f-48ee-9389-366bd96d2bfd] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:58.812688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-843f06a6-7a35-4aaa-b533-e14fc9931084 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:58.814650 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-843f06a6-7a35-4aaa-b533-e14fc9931084 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:58.816375 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-843f06a6-7a35-4aaa-b533-e14fc9931084 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:58.817341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-843f06a6-7a35-4aaa-b533-e14fc9931084 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:58.820943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-843f06a6-7a35-4aaa-b533-e14fc9931084 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:58.822001 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-843f06a6-7a35-4aaa-b533-e14fc9931084 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:58.895249 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-843f06a6-7a35-4aaa-b533-e14fc9931084 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b04e7f9-a53f-48ee-9389-366bd96d2bfd] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:59:58.980611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1d4a830e-d45c-435f-a6d9-6661be07a333 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:58.990172 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1d4a830e-d45c-435f-a6d9-6661be07a333 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1716 microversion: 2.1 time: 0.357020 Aug 04 16:59:59.005934 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 757/1461] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:58 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1716 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:59.014602 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-ced8c159-1a29-4fd6-8e7c-346f5f839aeb req-b4b6eaaa-322a-4003-9deb-7f7cc1c946e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e92cd73d-ce71-4f92-9db9-ae02c7febbcb", "tag": "46af0dd3-3cdc-4c63-9694-d9b2f7cf2afa"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 16:59:59.040632 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:59.046323 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-843f06a6-7a35-4aaa-b533-e14fc9931084 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "DELETE /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd" status: 204 len: 0 microversion: 2.1 time: 0.262899 Aug 04 16:59:59.047109 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ced8c159-1a29-4fd6-8e7c-346f5f839aeb req-b4b6eaaa-322a-4003-9deb-7f7cc1c946e7 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:59.047621 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ced8c159-1a29-4fd6-8e7c-346f5f839aeb req-b4b6eaaa-322a-4003-9deb-7f7cc1c946e7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:59.048072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ced8c159-1a29-4fd6-8e7c-346f5f839aeb req-b4b6eaaa-322a-4003-9deb-7f7cc1c946e7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:59.052148 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 705/1462] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 16:59:58 2022] DELETE /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:59:59.063381 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-971dcacd-dddc-4d5f-8a63-bf63d87d6501 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:59.064450 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-971dcacd-dddc-4d5f-8a63-bf63d87d6501 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:59.074855 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-971dcacd-dddc-4d5f-8a63-bf63d87d6501 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:59.075874 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-ced8c159-1a29-4fd6-8e7c-346f5f839aeb req-b4b6eaaa-322a-4003-9deb-7f7cc1c946e7 service nova] Creating event network-changed:46af0dd3-3cdc-4c63-9694-d9b2f7cf2afa for instance e92cd73d-ce71-4f92-9db9-ae02c7febbcb on n-h2-851359-3 Aug 04 16:59:59.076038 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-971dcacd-dddc-4d5f-8a63-bf63d87d6501 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:59.076631 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-971dcacd-dddc-4d5f-8a63-bf63d87d6501 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:59.077800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-971dcacd-dddc-4d5f-8a63-bf63d87d6501 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:59.078422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-971dcacd-dddc-4d5f-8a63-bf63d87d6501 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:59.079009 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-971dcacd-dddc-4d5f-8a63-bf63d87d6501 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:59.092025 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-ced8c159-1a29-4fd6-8e7c-346f5f839aeb req-b4b6eaaa-322a-4003-9deb-7f7cc1c946e7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083863 Aug 04 16:59:59.094974 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 758/1463] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 16:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 16:59:59.110433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-de6d5a80-cc01-4bdf-93b6-f70d97d72672 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:59.115208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-de6d5a80-cc01-4bdf-93b6-f70d97d72672 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b04e7f9-a53f-48ee-9389-366bd96d2bfd] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:59.133630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de6d5a80-cc01-4bdf-93b6-f70d97d72672 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:59.135052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de6d5a80-cc01-4bdf-93b6-f70d97d72672 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:59.136469 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de6d5a80-cc01-4bdf-93b6-f70d97d72672 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:59.138875 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de6d5a80-cc01-4bdf-93b6-f70d97d72672 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:59.139610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de6d5a80-cc01-4bdf-93b6-f70d97d72672 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:59.142005 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de6d5a80-cc01-4bdf-93b6-f70d97d72672 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:59.310835 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-971dcacd-dddc-4d5f-8a63-bf63d87d6501 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:59.330791 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-971dcacd-dddc-4d5f-8a63-bf63d87d6501 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1475 microversion: 2.1 time: 0.273538 Aug 04 16:59:59.334736 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 706/1464] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:59 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1475 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:59.344530 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d8d44586-106f-4939-9e39-9f8de39a8269 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:59.345510 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d8d44586-106f-4939-9e39-9f8de39a8269 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:59.355283 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8d44586-106f-4939-9e39-9f8de39a8269 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:59.356752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8d44586-106f-4939-9e39-9f8de39a8269 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:59.358025 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8d44586-106f-4939-9e39-9f8de39a8269 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:59.359381 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8d44586-106f-4939-9e39-9f8de39a8269 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:59.360006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8d44586-106f-4939-9e39-9f8de39a8269 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:59.360686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8d44586-106f-4939-9e39-9f8de39a8269 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:59.431411 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-de6d5a80-cc01-4bdf-93b6-f70d97d72672 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:59.449174 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-de6d5a80-cc01-4bdf-93b6-f70d97d72672 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd" status: 200 len: 1507 microversion: 2.1 time: 0.352933 Aug 04 16:59:59.449771 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 759/1465] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:59 2022] GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd => generated 1507 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 16:59:59.476828 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d8d44586-106f-4939-9e39-9f8de39a8269 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:59.489219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d8d44586-106f-4939-9e39-9f8de39a8269 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:59.492555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d8d44586-106f-4939-9e39-9f8de39a8269 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 16:59:59.494152 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d8d44586-106f-4939-9e39-9f8de39a8269 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1584 microversion: 2.32 time: 0.156453 Aug 04 16:59:59.495142 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 707/1466] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 16:59:59 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1584 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 16:59:59.578645 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-78990c53-96d5-45ae-865e-8e6cb8e9cdcc tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:59.579161 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-78990c53-96d5-45ae-865e-8e6cb8e9cdcc tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cafacd63-b815-4219-aa5e-f4aa05048c24] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:59.590482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78990c53-96d5-45ae-865e-8e6cb8e9cdcc tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:59.591354 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78990c53-96d5-45ae-865e-8e6cb8e9cdcc tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:59.593592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78990c53-96d5-45ae-865e-8e6cb8e9cdcc tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:59.594419 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78990c53-96d5-45ae-865e-8e6cb8e9cdcc tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:59.595641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78990c53-96d5-45ae-865e-8e6cb8e9cdcc tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:59.598312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78990c53-96d5-45ae-865e-8e6cb8e9cdcc tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:59.643801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-78990c53-96d5-45ae-865e-8e6cb8e9cdcc tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cafacd63-b815-4219-aa5e-f4aa05048c24] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 16:59:59.759460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 16:59:59.790043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b6e13309-36bf-4279-99ed-924879143cf5 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:59.791804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b6e13309-36bf-4279-99ed-924879143cf5 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 79650928-e2ee-4928-8421-c0423298fdad] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:59.803255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6e13309-36bf-4279-99ed-924879143cf5 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:59.818264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6e13309-36bf-4279-99ed-924879143cf5 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:59.822033 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6e13309-36bf-4279-99ed-924879143cf5 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:59.827156 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6e13309-36bf-4279-99ed-924879143cf5 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:59.829447 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6e13309-36bf-4279-99ed-924879143cf5 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:59.831755 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6e13309-36bf-4279-99ed-924879143cf5 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:59.832333 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-78990c53-96d5-45ae-865e-8e6cb8e9cdcc tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "DELETE /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24" status: 204 len: 0 microversion: 2.1 time: 0.255750 Aug 04 16:59:59.832967 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 760/1467] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 16:59:59 2022] DELETE /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 16:59:59.846603 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-416b65e6-f3a8-45bb-b375-8a8a2bbc0285 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 16:59:59.849516 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-416b65e6-f3a8-45bb-b375-8a8a2bbc0285 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cafacd63-b815-4219-aa5e-f4aa05048c24] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 16:59:59.861567 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-416b65e6-f3a8-45bb-b375-8a8a2bbc0285 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:59.863975 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-416b65e6-f3a8-45bb-b375-8a8a2bbc0285 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:59.864911 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-416b65e6-f3a8-45bb-b375-8a8a2bbc0285 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 16:59:59.880819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-416b65e6-f3a8-45bb-b375-8a8a2bbc0285 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 16:59:59.881418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-416b65e6-f3a8-45bb-b375-8a8a2bbc0285 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 16:59:59.893543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-416b65e6-f3a8-45bb-b375-8a8a2bbc0285 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:00.084238 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b6e13309-36bf-4279-99ed-924879143cf5 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:00.098158 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b6e13309-36bf-4279-99ed-924879143cf5 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad" status: 200 len: 1282 microversion: 2.1 time: 0.313329 Aug 04 17:00:00.098757 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 708/1468] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:59 2022] GET /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad => generated 1282 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:00.133534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7c591a88-2e97-4261-951e-a8553a4ef650 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:00.138627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7c591a88-2e97-4261-951e-a8553a4ef650 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:00.155757 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c591a88-2e97-4261-951e-a8553a4ef650 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:00.158196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c591a88-2e97-4261-951e-a8553a4ef650 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:00.158665 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c591a88-2e97-4261-951e-a8553a4ef650 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:00.159481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c591a88-2e97-4261-951e-a8553a4ef650 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:00.163737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c591a88-2e97-4261-951e-a8553a4ef650 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:00.164293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c591a88-2e97-4261-951e-a8553a4ef650 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:00.411421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-416b65e6-f3a8-45bb-b375-8a8a2bbc0285 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ad6ccd2d804e158989a5f94c6f9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50604ce0bb604209a3c18932fdd193e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:00.430698 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-416b65e6-f3a8-45bb-b375-8a8a2bbc0285 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24" status: 200 len: 1512 microversion: 2.1 time: 0.591733 Aug 04 17:00:00.431290 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 761/1469] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 16:59:59 2022] GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24 => generated 1512 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:00.436477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c996a21c-b51c-457d-9196-86facd6cbec6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:00.437770 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c996a21c-b51c-457d-9196-86facd6cbec6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:00.460933 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c996a21c-b51c-457d-9196-86facd6cbec6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:00.462190 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c996a21c-b51c-457d-9196-86facd6cbec6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:00.462892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c996a21c-b51c-457d-9196-86facd6cbec6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:00.464004 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c996a21c-b51c-457d-9196-86facd6cbec6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:00.465476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c996a21c-b51c-457d-9196-86facd6cbec6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:00.466164 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c996a21c-b51c-457d-9196-86facd6cbec6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:00.615345 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7c591a88-2e97-4261-951e-a8553a4ef650 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:00.619056 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:00.645198 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7c591a88-2e97-4261-951e-a8553a4ef650 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1716 microversion: 2.1 time: 0.545270 Aug 04 17:00:00.659614 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 709/1470] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:00 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1716 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:00.667535 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-276803b3-080c-492e-a95a-b2cd55f8efc3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:00.668685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-276803b3-080c-492e-a95a-b2cd55f8efc3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b04e7f9-a53f-48ee-9389-366bd96d2bfd] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:00.676494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-276803b3-080c-492e-a95a-b2cd55f8efc3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:00.677548 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-276803b3-080c-492e-a95a-b2cd55f8efc3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:00.678353 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-276803b3-080c-492e-a95a-b2cd55f8efc3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:00.679329 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-276803b3-080c-492e-a95a-b2cd55f8efc3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:00.680151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-276803b3-080c-492e-a95a-b2cd55f8efc3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:00.681086 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-276803b3-080c-492e-a95a-b2cd55f8efc3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:00.751930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c996a21c-b51c-457d-9196-86facd6cbec6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:00.782001 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c996a21c-b51c-457d-9196-86facd6cbec6 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1475 microversion: 2.1 time: 0.349398 Aug 04 17:00:00.783305 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 762/1471] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:00 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1475 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:00.793703 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-756085ed-cdef-4f9a-b91e-1c17b0669c6e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:00.794276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-756085ed-cdef-4f9a-b91e-1c17b0669c6e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:00.817535 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-756085ed-cdef-4f9a-b91e-1c17b0669c6e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:00.826383 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-756085ed-cdef-4f9a-b91e-1c17b0669c6e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:00.826936 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-756085ed-cdef-4f9a-b91e-1c17b0669c6e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:00.827704 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-756085ed-cdef-4f9a-b91e-1c17b0669c6e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:00.828188 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-756085ed-cdef-4f9a-b91e-1c17b0669c6e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:00.828634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-756085ed-cdef-4f9a-b91e-1c17b0669c6e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:01.037357 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-756085ed-cdef-4f9a-b91e-1c17b0669c6e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:01.056275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-756085ed-cdef-4f9a-b91e-1c17b0669c6e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:01.062307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-756085ed-cdef-4f9a-b91e-1c17b0669c6e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:01.063879 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-756085ed-cdef-4f9a-b91e-1c17b0669c6e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1594 microversion: 2.32 time: 0.279441 Aug 04 17:00:01.066238 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 763/1472] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:00 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1594 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:01.121905 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-56f454a0-6049-4a92-b887-5388075cbb20 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:01.123099 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-56f454a0-6049-4a92-b887-5388075cbb20 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 79650928-e2ee-4928-8421-c0423298fdad] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:01.132788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56f454a0-6049-4a92-b887-5388075cbb20 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:01.134583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56f454a0-6049-4a92-b887-5388075cbb20 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:01.135481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56f454a0-6049-4a92-b887-5388075cbb20 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:01.136471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56f454a0-6049-4a92-b887-5388075cbb20 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:01.137760 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56f454a0-6049-4a92-b887-5388075cbb20 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:01.138472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56f454a0-6049-4a92-b887-5388075cbb20 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:01.165967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-276803b3-080c-492e-a95a-b2cd55f8efc3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:01.178566 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-276803b3-080c-492e-a95a-b2cd55f8efc3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd" status: 200 len: 1507 microversion: 2.1 time: 0.517598 Aug 04 17:00:01.179434 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 710/1473] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:00 2022] GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd => generated 1507 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:01.302130 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-56f454a0-6049-4a92-b887-5388075cbb20 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:01.311578 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-56f454a0-6049-4a92-b887-5388075cbb20 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad" status: 200 len: 1324 microversion: 2.1 time: 0.195350 Aug 04 17:00:01.325096 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 764/1474] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:01 2022] GET /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad => generated 1324 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:01.456036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-47c443f6-d3c4-4d27-a0aa-5505657df975 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:01.457182 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-47c443f6-d3c4-4d27-a0aa-5505657df975 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cafacd63-b815-4219-aa5e-f4aa05048c24] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:01.465812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47c443f6-d3c4-4d27-a0aa-5505657df975 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:01.467225 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47c443f6-d3c4-4d27-a0aa-5505657df975 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:01.468138 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47c443f6-d3c4-4d27-a0aa-5505657df975 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:01.470783 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47c443f6-d3c4-4d27-a0aa-5505657df975 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:01.472583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47c443f6-d3c4-4d27-a0aa-5505657df975 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:01.473218 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47c443f6-d3c4-4d27-a0aa-5505657df975 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:01.670541 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-593cddf5-5056-4ae8-872b-8bb5a357cb94 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:01.671306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-593cddf5-5056-4ae8-872b-8bb5a357cb94 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:01.678817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-593cddf5-5056-4ae8-872b-8bb5a357cb94 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:01.679694 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-593cddf5-5056-4ae8-872b-8bb5a357cb94 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:01.680621 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-593cddf5-5056-4ae8-872b-8bb5a357cb94 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:01.681596 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-593cddf5-5056-4ae8-872b-8bb5a357cb94 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:01.682311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-593cddf5-5056-4ae8-872b-8bb5a357cb94 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:01.682960 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-593cddf5-5056-4ae8-872b-8bb5a357cb94 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:02.362591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-47c443f6-d3c4-4d27-a0aa-5505657df975 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ad6ccd2d804e158989a5f94c6f9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50604ce0bb604209a3c18932fdd193e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:02.373158 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-47c443f6-d3c4-4d27-a0aa-5505657df975 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24" status: 200 len: 1512 microversion: 2.1 time: 0.921553 Aug 04 17:00:02.375142 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 711/1475] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:01 2022] GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24 => generated 1512 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:02.382959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-99ae76ec-e369-45ee-9ca0-52f58112fc9f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:02.388481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-99ae76ec-e369-45ee-9ca0-52f58112fc9f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:02.402591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99ae76ec-e369-45ee-9ca0-52f58112fc9f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:02.403097 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99ae76ec-e369-45ee-9ca0-52f58112fc9f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:02.403547 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99ae76ec-e369-45ee-9ca0-52f58112fc9f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:02.404259 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99ae76ec-e369-45ee-9ca0-52f58112fc9f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:02.404719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99ae76ec-e369-45ee-9ca0-52f58112fc9f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:02.409787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99ae76ec-e369-45ee-9ca0-52f58112fc9f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:02.627237 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-593cddf5-5056-4ae8-872b-8bb5a357cb94 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:02.644649 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-593cddf5-5056-4ae8-872b-8bb5a357cb94 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1716 microversion: 2.1 time: 0.976873 Aug 04 17:00:02.645520 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 765/1476] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:01 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1716 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:00:02.668348 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-50a34fc0-1acb-46fe-9fce-23bd0ab51f71 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:02.669261 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-50a34fc0-1acb-46fe-9fce-23bd0ab51f71 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:02.689790 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50a34fc0-1acb-46fe-9fce-23bd0ab51f71 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:02.691061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50a34fc0-1acb-46fe-9fce-23bd0ab51f71 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:02.691670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50a34fc0-1acb-46fe-9fce-23bd0ab51f71 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:02.692588 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50a34fc0-1acb-46fe-9fce-23bd0ab51f71 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:02.693294 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50a34fc0-1acb-46fe-9fce-23bd0ab51f71 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:02.694498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50a34fc0-1acb-46fe-9fce-23bd0ab51f71 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:02.915286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-50a34fc0-1acb-46fe-9fce-23bd0ab51f71 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:02.937124 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-50a34fc0-1acb-46fe-9fce-23bd0ab51f71 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:02.939219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-50a34fc0-1acb-46fe-9fce-23bd0ab51f71 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:02.940919 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-50a34fc0-1acb-46fe-9fce-23bd0ab51f71 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1594 microversion: 2.32 time: 0.294135 Aug 04 17:00:02.945389 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 766/1477] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:02 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1594 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:02.953560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-88f3ef7f-9996-4fef-8f64-7d5888ed35f1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:02.954498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-88f3ef7f-9996-4fef-8f64-7d5888ed35f1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b04e7f9-a53f-48ee-9389-366bd96d2bfd] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:02.966885 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88f3ef7f-9996-4fef-8f64-7d5888ed35f1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:02.967740 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88f3ef7f-9996-4fef-8f64-7d5888ed35f1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:02.968450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88f3ef7f-9996-4fef-8f64-7d5888ed35f1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:02.973396 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88f3ef7f-9996-4fef-8f64-7d5888ed35f1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:02.973957 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88f3ef7f-9996-4fef-8f64-7d5888ed35f1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:02.975168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88f3ef7f-9996-4fef-8f64-7d5888ed35f1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:03.314650 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-99ae76ec-e369-45ee-9ca0-52f58112fc9f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:03.328998 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-99ae76ec-e369-45ee-9ca0-52f58112fc9f tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1475 microversion: 2.1 time: 0.951829 Aug 04 17:00:03.346246 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 712/1478] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:02 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1475 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:03.365111 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-201ad645-996f-4ed7-ada1-7393d24978cc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:03.369966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-201ad645-996f-4ed7-ada1-7393d24978cc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 79650928-e2ee-4928-8421-c0423298fdad] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:03.377496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-201ad645-996f-4ed7-ada1-7393d24978cc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:03.378236 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-201ad645-996f-4ed7-ada1-7393d24978cc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:03.378848 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-201ad645-996f-4ed7-ada1-7393d24978cc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:03.379702 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-201ad645-996f-4ed7-ada1-7393d24978cc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:03.380338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-201ad645-996f-4ed7-ada1-7393d24978cc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:03.381320 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-201ad645-996f-4ed7-ada1-7393d24978cc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:03.581866 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-88f3ef7f-9996-4fef-8f64-7d5888ed35f1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:03.600575 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-88f3ef7f-9996-4fef-8f64-7d5888ed35f1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd" status: 200 len: 1507 microversion: 2.1 time: 0.651959 Aug 04 17:00:03.611308 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 767/1479] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:02 2022] GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd => generated 1507 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:03.619735 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-6e741d7f-e545-4279-b000-3f2c1b2549ad req-cc8d60ff-08cc-484f-9dce-fff78f5b63c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79650928-e2ee-4928-8421-c0423298fdad", "tag": "13e6f1d8-988c-49db-899d-d36204677383"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:03.646740 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6e741d7f-e545-4279-b000-3f2c1b2549ad req-cc8d60ff-08cc-484f-9dce-fff78f5b63c0 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:03.648262 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6e741d7f-e545-4279-b000-3f2c1b2549ad req-cc8d60ff-08cc-484f-9dce-fff78f5b63c0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:03.649499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6e741d7f-e545-4279-b000-3f2c1b2549ad req-cc8d60ff-08cc-484f-9dce-fff78f5b63c0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:03.701760 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-201ad645-996f-4ed7-ada1-7393d24978cc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:03.744727 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-201ad645-996f-4ed7-ada1-7393d24978cc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad" status: 200 len: 1324 microversion: 2.1 time: 0.382451 Aug 04 17:00:03.748191 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 713/1480] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:03 2022] GET /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad => generated 1324 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:03.762414 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6aaefbf5-f507-4313-9164-6c28dbb5ed06 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:03.765384 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6aaefbf5-f507-4313-9164-6c28dbb5ed06 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cafacd63-b815-4219-aa5e-f4aa05048c24] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:03.812856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aaefbf5-f507-4313-9164-6c28dbb5ed06 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:03.815637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aaefbf5-f507-4313-9164-6c28dbb5ed06 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:03.821851 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aaefbf5-f507-4313-9164-6c28dbb5ed06 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:03.824861 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aaefbf5-f507-4313-9164-6c28dbb5ed06 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:03.826787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aaefbf5-f507-4313-9164-6c28dbb5ed06 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:03.828949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aaefbf5-f507-4313-9164-6c28dbb5ed06 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:04.143825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6aaefbf5-f507-4313-9164-6c28dbb5ed06 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ad6ccd2d804e158989a5f94c6f9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50604ce0bb604209a3c18932fdd193e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:04.166422 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6aaefbf5-f507-4313-9164-6c28dbb5ed06 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24" status: 200 len: 1470 microversion: 2.1 time: 0.416865 Aug 04 17:00:04.167782 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 714/1481] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:03 2022] GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24 => generated 1470 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:04.175289 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bd3f6baf-814d-4aca-a4fd-c0aab1f718f4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:04.176766 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bd3f6baf-814d-4aca-a4fd-c0aab1f718f4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:04.185727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd3f6baf-814d-4aca-a4fd-c0aab1f718f4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:04.189480 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd3f6baf-814d-4aca-a4fd-c0aab1f718f4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:04.190347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd3f6baf-814d-4aca-a4fd-c0aab1f718f4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:04.191335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd3f6baf-814d-4aca-a4fd-c0aab1f718f4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:04.197260 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd3f6baf-814d-4aca-a4fd-c0aab1f718f4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:04.202086 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd3f6baf-814d-4aca-a4fd-c0aab1f718f4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:04.301575 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-6e741d7f-e545-4279-b000-3f2c1b2549ad req-cc8d60ff-08cc-484f-9dce-fff78f5b63c0 service nova] Creating event network-changed:13e6f1d8-988c-49db-899d-d36204677383 for instance 79650928-e2ee-4928-8421-c0423298fdad on n-h2-851359-3 Aug 04 17:00:04.316929 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-6e741d7f-e545-4279-b000-3f2c1b2549ad req-cc8d60ff-08cc-484f-9dce-fff78f5b63c0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.702510 Aug 04 17:00:04.317767 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 768/1482] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:04.338009 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-a8c0c839-8cd0-4a8a-ada4-4b6644352f71 req-3cdd83a0-1891-4de9-9806-139fbea081fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b04e7f9-a53f-48ee-9389-366bd96d2bfd", "name": "network-vif-deleted", "tag": "67dcca79-0cb3-459e-a946-f0663fd939cb"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:04.402551 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a8c0c839-8cd0-4a8a-ada4-4b6644352f71 req-3cdd83a0-1891-4de9-9806-139fbea081fc service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:04.403055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a8c0c839-8cd0-4a8a-ada4-4b6644352f71 req-3cdd83a0-1891-4de9-9806-139fbea081fc service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:04.403502 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a8c0c839-8cd0-4a8a-ada4-4b6644352f71 req-3cdd83a0-1891-4de9-9806-139fbea081fc service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:04.442332 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-a8c0c839-8cd0-4a8a-ada4-4b6644352f71 req-3cdd83a0-1891-4de9-9806-139fbea081fc service nova] Creating event network-vif-deleted:67dcca79-0cb3-459e-a946-f0663fd939cb for instance 1b04e7f9-a53f-48ee-9389-366bd96d2bfd on n-h2-851359-3 Aug 04 17:00:04.457615 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-a8c0c839-8cd0-4a8a-ada4-4b6644352f71 req-3cdd83a0-1891-4de9-9806-139fbea081fc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138187 Aug 04 17:00:04.463131 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 769/1483] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:04.476504 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-731f191f-476e-4dc9-b0fd-dc8ce43cfff5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:04.477873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-731f191f-476e-4dc9-b0fd-dc8ce43cfff5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:04.499477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-731f191f-476e-4dc9-b0fd-dc8ce43cfff5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:04.502237 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-731f191f-476e-4dc9-b0fd-dc8ce43cfff5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:04.504011 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-731f191f-476e-4dc9-b0fd-dc8ce43cfff5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:04.504943 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-731f191f-476e-4dc9-b0fd-dc8ce43cfff5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:04.505613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-731f191f-476e-4dc9-b0fd-dc8ce43cfff5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:04.506769 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-731f191f-476e-4dc9-b0fd-dc8ce43cfff5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:04.735976 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bd3f6baf-814d-4aca-a4fd-c0aab1f718f4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:04.767783 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bd3f6baf-814d-4aca-a4fd-c0aab1f718f4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1716 microversion: 2.1 time: 0.597919 Aug 04 17:00:04.794481 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 715/1484] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:04 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1716 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:04.805094 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2d6a4293-77bc-4270-b376-3ce26e1fa1ea tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:04.808152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2d6a4293-77bc-4270-b376-3ce26e1fa1ea tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:04.841549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d6a4293-77bc-4270-b376-3ce26e1fa1ea tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:04.843263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d6a4293-77bc-4270-b376-3ce26e1fa1ea tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:04.845871 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d6a4293-77bc-4270-b376-3ce26e1fa1ea tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:04.846780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d6a4293-77bc-4270-b376-3ce26e1fa1ea tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:04.847324 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d6a4293-77bc-4270-b376-3ce26e1fa1ea tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:04.847775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d6a4293-77bc-4270-b376-3ce26e1fa1ea tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:04.863774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-731f191f-476e-4dc9-b0fd-dc8ce43cfff5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:04.874175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-731f191f-476e-4dc9-b0fd-dc8ce43cfff5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:04.875695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-731f191f-476e-4dc9-b0fd-dc8ce43cfff5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:04.876866 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-731f191f-476e-4dc9-b0fd-dc8ce43cfff5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1661 microversion: 2.32 time: 0.412375 Aug 04 17:00:04.886011 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 770/1485] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:04 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1661 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:04.893521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-626e39e7-225e-4617-8a37-ca37832d194a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:04.896396 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-626e39e7-225e-4617-8a37-ca37832d194a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b04e7f9-a53f-48ee-9389-366bd96d2bfd] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:04.906656 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-626e39e7-225e-4617-8a37-ca37832d194a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:04.907161 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-626e39e7-225e-4617-8a37-ca37832d194a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:04.907610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-626e39e7-225e-4617-8a37-ca37832d194a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:04.908394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-626e39e7-225e-4617-8a37-ca37832d194a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:04.909099 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-626e39e7-225e-4617-8a37-ca37832d194a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:04.909697 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-626e39e7-225e-4617-8a37-ca37832d194a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:04.992249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-626e39e7-225e-4617-8a37-ca37832d194a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:04.993957 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-626e39e7-225e-4617-8a37-ca37832d194a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:04.995612 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-626e39e7-225e-4617-8a37-ca37832d194a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:04.997843 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-626e39e7-225e-4617-8a37-ca37832d194a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lazy-loading 'fault' on Instance uuid 1b04e7f9-a53f-48ee-9389-366bd96d2bfd {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:00:05.101286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-626e39e7-225e-4617-8a37-ca37832d194a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:05.113475 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-626e39e7-225e-4617-8a37-ca37832d194a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd" status: 200 len: 1305 microversion: 2.1 time: 0.234622 Aug 04 17:00:05.114079 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 771/1486] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:04 2022] GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd => generated 1305 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:05.125515 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-95d87fca-f764-49f4-b8f1-1e72dff5aeb4 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:05.126877 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-95d87fca-f764-49f4-b8f1-1e72dff5aeb4 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 79650928-e2ee-4928-8421-c0423298fdad] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:05.140434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95d87fca-f764-49f4-b8f1-1e72dff5aeb4 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:05.141324 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95d87fca-f764-49f4-b8f1-1e72dff5aeb4 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:05.142062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95d87fca-f764-49f4-b8f1-1e72dff5aeb4 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:05.143060 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95d87fca-f764-49f4-b8f1-1e72dff5aeb4 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:05.143725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95d87fca-f764-49f4-b8f1-1e72dff5aeb4 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:05.144354 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95d87fca-f764-49f4-b8f1-1e72dff5aeb4 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:05.176259 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:05.206330 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2d6a4293-77bc-4270-b376-3ce26e1fa1ea tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:05.214956 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2d6a4293-77bc-4270-b376-3ce26e1fa1ea tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1475 microversion: 2.1 time: 0.418675 Aug 04 17:00:05.215862 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 716/1487] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:04 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1475 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:05.243551 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-692c4f9b-05ce-4d69-9eda-3c3d5dc96edd tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:05.244396 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-692c4f9b-05ce-4d69-9eda-3c3d5dc96edd tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cafacd63-b815-4219-aa5e-f4aa05048c24] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:05.258182 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-692c4f9b-05ce-4d69-9eda-3c3d5dc96edd tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:05.258692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-692c4f9b-05ce-4d69-9eda-3c3d5dc96edd tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:05.259155 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-692c4f9b-05ce-4d69-9eda-3c3d5dc96edd tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:05.259889 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-692c4f9b-05ce-4d69-9eda-3c3d5dc96edd tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:05.260354 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-692c4f9b-05ce-4d69-9eda-3c3d5dc96edd tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:05.260835 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-692c4f9b-05ce-4d69-9eda-3c3d5dc96edd tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:05.323415 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-692c4f9b-05ce-4d69-9eda-3c3d5dc96edd tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] HTTP exception thrown: Instance cafacd63-b815-4219-aa5e-f4aa05048c24 could not be found. Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-692c4f9b-05ce-4d69-9eda-3c3d5dc96edd tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Request method failure captured: Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24 HTTP/1.1 Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_qA6jHLsAQZpXrPx16iX_euAfp05qQ7EDZPJAziGXUzUCleYq7yNPRd_mMPqowRqSoynlb01Yn0-Z9X-RFHs3AEeO7Ff9FLLu5m8ylg4trhXIXHdsN4IBBsBP9LQONIwPZDPwYu6wpNi4PrPt3AUR94weUA9ob87CWgyJ5aFuaD8ng Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 50604ce0bb604209a3c18932fdd193e2 Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-VolumesAdminNegativeTest-1212329384 Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/50604ce0bb604209a3c18932fdd193e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/50604ce0bb604209a3c18932fdd193e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_50604ce0bb604209a3c18932fdd193e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/50604ce0bb604209a3c18932fdd193e2"}]}] Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-VolumesAdminNegativeTest-1212329384 Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 50604ce0bb604209a3c18932fdd193e2 Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1212329384 Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-VolumesAdminNegativeTest-1212329384-project Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 08ad6ccd2d804e158989a5f94c6f9a2f Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-VolumesAdminNegativeTest-1212329384-project Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance cafacd63-b815-4219-aa5e-f4aa05048c24 could not be found. Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'cafacd63-b815-4219-aa5e-f4aa05048c24'} Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cafacd63-b815-4219-aa5e-f4aa05048c24 could not be found. Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cafacd63-b815-4219-aa5e-f4aa05048c24 could not be found. Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:05.325162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:00:05.333145 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:05.333145 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:05.333145 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:05.333145 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:00:05.333145 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:00:05.333145 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cafacd63-b815-4219-aa5e-f4aa05048c24 could not be found. Aug 04 17:00:05.333145 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:00:05.333145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-692c4f9b-05ce-4d69-9eda-3c3d5dc96edd tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Returning 404 to user: Instance cafacd63-b815-4219-aa5e-f4aa05048c24 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:00:05.333145 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-692c4f9b-05ce-4d69-9eda-3c3d5dc96edd tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24" status: 404 len: 111 microversion: 2.1 time: 0.110906 Aug 04 17:00:05.333145 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 717/1488] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:05 2022] GET /compute/v2.1/servers/cafacd63-b815-4219-aa5e-f4aa05048c24 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:00:05.481271 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-95d87fca-f764-49f4-b8f1-1e72dff5aeb4 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:05.492626 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-95d87fca-f764-49f4-b8f1-1e72dff5aeb4 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad" status: 200 len: 1324 microversion: 2.1 time: 0.377122 Aug 04 17:00:05.494033 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 772/1489] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:05 2022] GET /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad => generated 1324 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:05.795155 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5c82b47b-b935-437f-83e0-73defb276f2e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:05.796871 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5c82b47b-b935-437f-83e0-73defb276f2e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:05.800832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=8 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:05.809423 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c82b47b-b935-437f-83e0-73defb276f2e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:05.810840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c82b47b-b935-437f-83e0-73defb276f2e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:05.811607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c82b47b-b935-437f-83e0-73defb276f2e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:05.813595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c82b47b-b935-437f-83e0-73defb276f2e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:05.814509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c82b47b-b935-437f-83e0-73defb276f2e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:05.815347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c82b47b-b935-437f-83e0-73defb276f2e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:05.871893 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=14 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:05.902308 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-84d85fe7-c6bc-448a-8698-9046f615058f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:05.903527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-84d85fe7-c6bc-448a-8698-9046f615058f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:05.912752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:05.919941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84d85fe7-c6bc-448a-8698-9046f615058f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:05.920460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84d85fe7-c6bc-448a-8698-9046f615058f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:05.920909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84d85fe7-c6bc-448a-8698-9046f615058f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:05.927069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84d85fe7-c6bc-448a-8698-9046f615058f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:05.927882 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84d85fe7-c6bc-448a-8698-9046f615058f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:05.928569 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84d85fe7-c6bc-448a-8698-9046f615058f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:06.293822 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5c82b47b-b935-437f-83e0-73defb276f2e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:06.305053 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5c82b47b-b935-437f-83e0-73defb276f2e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1716 microversion: 2.1 time: 0.515008 Aug 04 17:00:06.306323 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 718/1490] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:05 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1716 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:06.322969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1faa587d-6e7f-4f85-bcb1-41a6c35285f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:06.323978 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1faa587d-6e7f-4f85-bcb1-41a6c35285f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b04e7f9-a53f-48ee-9389-366bd96d2bfd] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:06.332722 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1faa587d-6e7f-4f85-bcb1-41a6c35285f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:06.333573 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1faa587d-6e7f-4f85-bcb1-41a6c35285f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:06.334953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1faa587d-6e7f-4f85-bcb1-41a6c35285f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:06.335948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1faa587d-6e7f-4f85-bcb1-41a6c35285f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:06.337233 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1faa587d-6e7f-4f85-bcb1-41a6c35285f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:06.337951 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1faa587d-6e7f-4f85-bcb1-41a6c35285f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:06.348321 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-84d85fe7-c6bc-448a-8698-9046f615058f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:06.360610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-84d85fe7-c6bc-448a-8698-9046f615058f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:06.367381 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-84d85fe7-c6bc-448a-8698-9046f615058f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:06.368883 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-84d85fe7-c6bc-448a-8698-9046f615058f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1661 microversion: 2.32 time: 0.470603 Aug 04 17:00:06.371565 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 773/1491] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:05 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1661 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:00:06.376459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-884770c0-bffd-40f2-ac4d-4d789de9b921 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:06.379285 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-884770c0-bffd-40f2-ac4d-4d789de9b921 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:06.402416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-884770c0-bffd-40f2-ac4d-4d789de9b921 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:06.403483 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-884770c0-bffd-40f2-ac4d-4d789de9b921 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:06.403940 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-884770c0-bffd-40f2-ac4d-4d789de9b921 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:06.404673 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-884770c0-bffd-40f2-ac4d-4d789de9b921 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:06.405142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-884770c0-bffd-40f2-ac4d-4d789de9b921 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:06.405576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-884770c0-bffd-40f2-ac4d-4d789de9b921 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:06.408357 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1faa587d-6e7f-4f85-bcb1-41a6c35285f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:06.409171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1faa587d-6e7f-4f85-bcb1-41a6c35285f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:06.411527 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1faa587d-6e7f-4f85-bcb1-41a6c35285f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:06.412327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-1faa587d-6e7f-4f85-bcb1-41a6c35285f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lazy-loading 'fault' on Instance uuid 1b04e7f9-a53f-48ee-9389-366bd96d2bfd {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:00:06.534454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1faa587d-6e7f-4f85-bcb1-41a6c35285f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:06.543016 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1faa587d-6e7f-4f85-bcb1-41a6c35285f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd" status: 200 len: 1305 microversion: 2.1 time: 0.235410 Aug 04 17:00:06.544292 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 719/1492] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:06 2022] GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd => generated 1305 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:06.549475 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-9002b4ff-8d57-46a3-9de2-d4b5a2f13a6e req-2aaac826-03c7-4fc9-863a-d9accac3495e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cafacd63-b815-4219-aa5e-f4aa05048c24", "name": "network-vif-deleted", "tag": "87913dcc-9df8-49c0-bb57-443716142857"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:06.560608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9002b4ff-8d57-46a3-9de2-d4b5a2f13a6e req-2aaac826-03c7-4fc9-863a-d9accac3495e service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:06.561368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9002b4ff-8d57-46a3-9de2-d4b5a2f13a6e req-2aaac826-03c7-4fc9-863a-d9accac3495e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:06.561994 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9002b4ff-8d57-46a3-9de2-d4b5a2f13a6e req-2aaac826-03c7-4fc9-863a-d9accac3495e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:06.604607 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-9002b4ff-8d57-46a3-9de2-d4b5a2f13a6e req-2aaac826-03c7-4fc9-863a-d9accac3495e service nova] Creating event network-vif-deleted:87913dcc-9df8-49c0-bb57-443716142857 for instance cafacd63-b815-4219-aa5e-f4aa05048c24 on n-h1-851359-3 Aug 04 17:00:06.617254 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-9002b4ff-8d57-46a3-9de2-d4b5a2f13a6e req-2aaac826-03c7-4fc9-863a-d9accac3495e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071442 Aug 04 17:00:06.618141 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 720/1493] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:06.626481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3b02e68c-e856-465f-a2e9-445f9ce5d604 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:06.633463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3b02e68c-e856-465f-a2e9-445f9ce5d604 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 79650928-e2ee-4928-8421-c0423298fdad] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:06.649700 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b02e68c-e856-465f-a2e9-445f9ce5d604 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:06.652180 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b02e68c-e856-465f-a2e9-445f9ce5d604 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:06.654483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b02e68c-e856-465f-a2e9-445f9ce5d604 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:06.655660 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b02e68c-e856-465f-a2e9-445f9ce5d604 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:06.656151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b02e68c-e856-465f-a2e9-445f9ce5d604 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:06.656599 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b02e68c-e856-465f-a2e9-445f9ce5d604 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:06.729915 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-884770c0-bffd-40f2-ac4d-4d789de9b921 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:06.742955 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-884770c0-bffd-40f2-ac4d-4d789de9b921 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1475 microversion: 2.1 time: 0.370014 Aug 04 17:00:06.743561 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 774/1494] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:06 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1475 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:06.942693 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3b02e68c-e856-465f-a2e9-445f9ce5d604 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:06.956574 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3b02e68c-e856-465f-a2e9-445f9ce5d604 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad" status: 200 len: 1324 microversion: 2.1 time: 0.335321 Aug 04 17:00:06.957597 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 721/1495] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:06 2022] GET /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad => generated 1324 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:07.331089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-20a5874b-0f4c-4277-8bd0-aa7dc159b944 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:07.331636 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-20a5874b-0f4c-4277-8bd0-aa7dc159b944 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:07.349611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20a5874b-0f4c-4277-8bd0-aa7dc159b944 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:07.350141 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20a5874b-0f4c-4277-8bd0-aa7dc159b944 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:07.350596 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20a5874b-0f4c-4277-8bd0-aa7dc159b944 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:07.351322 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20a5874b-0f4c-4277-8bd0-aa7dc159b944 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:07.351789 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20a5874b-0f4c-4277-8bd0-aa7dc159b944 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:07.352219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20a5874b-0f4c-4277-8bd0-aa7dc159b944 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:07.406918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6188a5d4-737b-4a5f-a85c-5116b6889f6c tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:07.407744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6188a5d4-737b-4a5f-a85c-5116b6889f6c tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:07.417110 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6188a5d4-737b-4a5f-a85c-5116b6889f6c tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:07.418195 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6188a5d4-737b-4a5f-a85c-5116b6889f6c tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:07.418941 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6188a5d4-737b-4a5f-a85c-5116b6889f6c tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:07.420074 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6188a5d4-737b-4a5f-a85c-5116b6889f6c tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:07.420775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6188a5d4-737b-4a5f-a85c-5116b6889f6c tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:07.422746 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6188a5d4-737b-4a5f-a85c-5116b6889f6c tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:07.755770 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-20a5874b-0f4c-4277-8bd0-aa7dc159b944 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:07.771470 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-20a5874b-0f4c-4277-8bd0-aa7dc159b944 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1716 microversion: 2.1 time: 0.444164 Aug 04 17:00:07.782857 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 775/1496] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:07 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1716 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:07.808470 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-816bbd98-e262-4a9d-9d3b-d85e22b6efed tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:07.809186 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-816bbd98-e262-4a9d-9d3b-d85e22b6efed tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b04e7f9-a53f-48ee-9389-366bd96d2bfd] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:07.831205 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6188a5d4-737b-4a5f-a85c-5116b6889f6c tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:07.831557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-816bbd98-e262-4a9d-9d3b-d85e22b6efed tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:07.833493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-816bbd98-e262-4a9d-9d3b-d85e22b6efed tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:07.834461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-816bbd98-e262-4a9d-9d3b-d85e22b6efed tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:07.835572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-816bbd98-e262-4a9d-9d3b-d85e22b6efed tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:07.838115 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-816bbd98-e262-4a9d-9d3b-d85e22b6efed tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:07.838783 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-816bbd98-e262-4a9d-9d3b-d85e22b6efed tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:07.917545 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6188a5d4-737b-4a5f-a85c-5116b6889f6c tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:07.926836 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6188a5d4-737b-4a5f-a85c-5116b6889f6c tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:07.943658 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6188a5d4-737b-4a5f-a85c-5116b6889f6c tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1661 microversion: 2.32 time: 0.541069 Aug 04 17:00:07.954576 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 722/1497] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:07 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1661 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:07.968365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b4d8478a-96ca-43d1-bfb9-a12f31a00459 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:07.969271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b4d8478a-96ca-43d1-bfb9-a12f31a00459 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:07.985948 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-816bbd98-e262-4a9d-9d3b-d85e22b6efed tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:07.986567 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-816bbd98-e262-4a9d-9d3b-d85e22b6efed tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:07.986981 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-816bbd98-e262-4a9d-9d3b-d85e22b6efed tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:07.988599 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-816bbd98-e262-4a9d-9d3b-d85e22b6efed tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lazy-loading 'fault' on Instance uuid 1b04e7f9-a53f-48ee-9389-366bd96d2bfd {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:00:08.023703 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4d8478a-96ca-43d1-bfb9-a12f31a00459 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:08.030525 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4d8478a-96ca-43d1-bfb9-a12f31a00459 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:08.033624 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4d8478a-96ca-43d1-bfb9-a12f31a00459 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:08.038677 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4d8478a-96ca-43d1-bfb9-a12f31a00459 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:08.041879 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4d8478a-96ca-43d1-bfb9-a12f31a00459 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:08.042638 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4d8478a-96ca-43d1-bfb9-a12f31a00459 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:08.135402 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-816bbd98-e262-4a9d-9d3b-d85e22b6efed tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:08.144642 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-816bbd98-e262-4a9d-9d3b-d85e22b6efed tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd" status: 200 len: 1305 microversion: 2.1 time: 0.359721 Aug 04 17:00:08.149031 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 776/1498] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:07 2022] GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd => generated 1305 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:08.154705 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e652e187-d17a-475b-9acf-60d4e74e6b70 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:08.159624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e652e187-d17a-475b-9acf-60d4e74e6b70 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 79650928-e2ee-4928-8421-c0423298fdad] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:08.174896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e652e187-d17a-475b-9acf-60d4e74e6b70 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:08.177136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e652e187-d17a-475b-9acf-60d4e74e6b70 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:08.178636 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e652e187-d17a-475b-9acf-60d4e74e6b70 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:08.181221 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e652e187-d17a-475b-9acf-60d4e74e6b70 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:08.191448 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e652e187-d17a-475b-9acf-60d4e74e6b70 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:08.192553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e652e187-d17a-475b-9acf-60d4e74e6b70 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:08.513112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b4d8478a-96ca-43d1-bfb9-a12f31a00459 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:08.545552 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b4d8478a-96ca-43d1-bfb9-a12f31a00459 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1475 microversion: 2.1 time: 0.584887 Aug 04 17:00:08.546266 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 723/1499] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:07 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1475 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:08.803191 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e652e187-d17a-475b-9acf-60d4e74e6b70 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:08.808365 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:08.810163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9bc4a725-6bea-4460-9336-5efbf30e1c66 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:08.811291 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9bc4a725-6bea-4460-9336-5efbf30e1c66 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:08.830132 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9bc4a725-6bea-4460-9336-5efbf30e1c66 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:08.830899 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9bc4a725-6bea-4460-9336-5efbf30e1c66 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:08.832967 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e652e187-d17a-475b-9acf-60d4e74e6b70 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad" status: 200 len: 1324 microversion: 2.1 time: 0.682189 Aug 04 17:00:08.836264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9bc4a725-6bea-4460-9336-5efbf30e1c66 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:08.837282 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9bc4a725-6bea-4460-9336-5efbf30e1c66 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:08.838917 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9bc4a725-6bea-4460-9336-5efbf30e1c66 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:08.838917 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9bc4a725-6bea-4460-9336-5efbf30e1c66 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:08.839811 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 777/1500] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:08 2022] GET /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad => generated 1324 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:08.977667 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-37fa5890-93ac-4b5f-935a-fa7981564e07 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:08.978590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-37fa5890-93ac-4b5f-935a-fa7981564e07 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:08.987911 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37fa5890-93ac-4b5f-935a-fa7981564e07 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:08.989615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37fa5890-93ac-4b5f-935a-fa7981564e07 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:08.991028 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37fa5890-93ac-4b5f-935a-fa7981564e07 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:08.992433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37fa5890-93ac-4b5f-935a-fa7981564e07 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:08.995657 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37fa5890-93ac-4b5f-935a-fa7981564e07 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:08.996296 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37fa5890-93ac-4b5f-935a-fa7981564e07 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:09.136089 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9bc4a725-6bea-4460-9336-5efbf30e1c66 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:09.149625 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9bc4a725-6bea-4460-9336-5efbf30e1c66 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1716 microversion: 2.1 time: 0.352770 Aug 04 17:00:09.168741 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 724/1501] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:08 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1716 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:00:09.176168 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-120f6212-c69d-4a23-a3a1-de1f4a6ab267 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:09.177076 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-120f6212-c69d-4a23-a3a1-de1f4a6ab267 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b04e7f9-a53f-48ee-9389-366bd96d2bfd] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:09.192148 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-120f6212-c69d-4a23-a3a1-de1f4a6ab267 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:09.192941 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-120f6212-c69d-4a23-a3a1-de1f4a6ab267 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:09.194188 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-120f6212-c69d-4a23-a3a1-de1f4a6ab267 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:09.195107 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-120f6212-c69d-4a23-a3a1-de1f4a6ab267 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:09.195756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-120f6212-c69d-4a23-a3a1-de1f4a6ab267 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:09.196415 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-120f6212-c69d-4a23-a3a1-de1f4a6ab267 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:09.231964 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-120f6212-c69d-4a23-a3a1-de1f4a6ab267 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] HTTP exception thrown: Instance 1b04e7f9-a53f-48ee-9389-366bd96d2bfd could not be found. Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-120f6212-c69d-4a23-a3a1-de1f4a6ab267 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Request method failure captured: Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd HTTP/1.1 Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_r18zhXKrUNPkTcrqBpyOxEtqmRnN_52CLFZjb6_V1_cyggOBj-ig1uBg8_Jl5DEv1edGlVMK7wsNG9aSNASIbB3U35pyAy7fX4gAPexD_7GsQqaSV2-qce83lQvxIJx4U5ZPEYYCvd7_VfIsOpvvr8aQqah0W-5V3XON-ztAeWk4Y Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/92bb708c7ba24e4d828f19ecc60e1f91"}]}] Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 6d19d8e7953b4e479b4e2143a3c3546a Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 1b04e7f9-a53f-48ee-9389-366bd96d2bfd could not be found. Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '1b04e7f9-a53f-48ee-9389-366bd96d2bfd'} Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b04e7f9-a53f-48ee-9389-366bd96d2bfd could not be found. Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b04e7f9-a53f-48ee-9389-366bd96d2bfd could not be found. Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:09.234143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:00:09.239605 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:09.239605 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:09.239605 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:09.239605 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:00:09.239605 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:00:09.239605 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b04e7f9-a53f-48ee-9389-366bd96d2bfd could not be found. Aug 04 17:00:09.239605 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:00:09.243456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-120f6212-c69d-4a23-a3a1-de1f4a6ab267 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Returning 404 to user: Instance 1b04e7f9-a53f-48ee-9389-366bd96d2bfd could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:00:09.248640 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-120f6212-c69d-4a23-a3a1-de1f4a6ab267 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd" status: 404 len: 111 microversion: 2.1 time: 0.074213 Aug 04 17:00:09.250157 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 725/1502] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:09 2022] GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:00:09.500848 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-65651fc4-c29c-487a-bd62-d112a09b71f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1070774161", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "bed30c3f-0c01-4418-9c95-0bb7a79e1c34"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:09.682930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-65651fc4-c29c-487a-bd62-d112a09b71f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] validate_networks() for [('bed30c3f-0c01-4418-9c95-0bb7a79e1c34', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:00:10.626381 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-37fa5890-93ac-4b5f-935a-fa7981564e07 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:10.635732 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-37fa5890-93ac-4b5f-935a-fa7981564e07 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:10.637221 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-37fa5890-93ac-4b5f-935a-fa7981564e07 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:10.642856 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-37fa5890-93ac-4b5f-935a-fa7981564e07 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1661 microversion: 2.32 time: 1.669961 Aug 04 17:00:10.643449 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 778/1503] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:08 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1661 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:00:11.162664 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f00f105a-7171-4c63-8a5f-92a31d752f6d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:11.163418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f00f105a-7171-4c63-8a5f-92a31d752f6d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:11.174664 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f00f105a-7171-4c63-8a5f-92a31d752f6d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:11.180873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f00f105a-7171-4c63-8a5f-92a31d752f6d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:11.181340 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f00f105a-7171-4c63-8a5f-92a31d752f6d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:11.182130 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f00f105a-7171-4c63-8a5f-92a31d752f6d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:11.190293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f00f105a-7171-4c63-8a5f-92a31d752f6d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:11.190924 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f00f105a-7171-4c63-8a5f-92a31d752f6d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:11.892911 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f00f105a-7171-4c63-8a5f-92a31d752f6d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:11.905162 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f00f105a-7171-4c63-8a5f-92a31d752f6d tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1474 microversion: 2.1 time: 1.245694 Aug 04 17:00:11.914111 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 779/1504] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:10 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1474 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:11.925435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8b173e59-4850-41c3-a80a-532476dc40a4 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:11.931135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8b173e59-4850-41c3-a80a-532476dc40a4 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 79650928-e2ee-4928-8421-c0423298fdad] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:11.951113 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8b173e59-4850-41c3-a80a-532476dc40a4 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:11.957169 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8b173e59-4850-41c3-a80a-532476dc40a4 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:11.957873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8b173e59-4850-41c3-a80a-532476dc40a4 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:11.964386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8b173e59-4850-41c3-a80a-532476dc40a4 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:11.965159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8b173e59-4850-41c3-a80a-532476dc40a4 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:11.965774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8b173e59-4850-41c3-a80a-532476dc40a4 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:12.437044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-65651fc4-c29c-487a-bd62-d112a09b71f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:00:12.437653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-65651fc4-c29c-487a-bd62-d112a09b71f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:00:12.437947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-65651fc4-c29c-487a-bd62-d112a09b71f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:00:12.438592 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-65651fc4-c29c-487a-bd62-d112a09b71f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:00:12.439218 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-65651fc4-c29c-487a-bd62-d112a09b71f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:00:12.453818 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65651fc4-c29c-487a-bd62-d112a09b71f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:12.466847 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65651fc4-c29c-487a-bd62-d112a09b71f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:12.475396 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65651fc4-c29c-487a-bd62-d112a09b71f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:12.476277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65651fc4-c29c-487a-bd62-d112a09b71f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:12.476824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65651fc4-c29c-487a-bd62-d112a09b71f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:12.477263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65651fc4-c29c-487a-bd62-d112a09b71f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:12.551845 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-65651fc4-c29c-487a-bd62-d112a09b71f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Getting quotas for project 92bb708c7ba24e4d828f19ecc60e1f91. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:00:12.569533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-65651fc4-c29c-487a-bd62-d112a09b71f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Getting quotas for user 6d19d8e7953b4e479b4e2143a3c3546a and project 92bb708c7ba24e4d828f19ecc60e1f91. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:00:12.608321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-65651fc4-c29c-487a-bd62-d112a09b71f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:00:12.610685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-65651fc4-c29c-487a-bd62-d112a09b71f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: b4f45353-5340-4cfe-a8c3-0aeeef958607] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:00:12.750495 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-65651fc4-c29c-487a-bd62-d112a09b71f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.254927 Aug 04 17:00:12.757844 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 726/1505] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:00:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:00:12.773265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-10bde6eb-95a5-47cf-9a40-d4e377cdb2a1 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:12.773676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-10bde6eb-95a5-47cf-9a40-d4e377cdb2a1 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:12.800135 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10bde6eb-95a5-47cf-9a40-d4e377cdb2a1 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:12.800564 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10bde6eb-95a5-47cf-9a40-d4e377cdb2a1 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:12.801019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10bde6eb-95a5-47cf-9a40-d4e377cdb2a1 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:12.801756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10bde6eb-95a5-47cf-9a40-d4e377cdb2a1 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:12.802781 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10bde6eb-95a5-47cf-9a40-d4e377cdb2a1 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:12.803238 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10bde6eb-95a5-47cf-9a40-d4e377cdb2a1 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:12.970463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8b173e59-4850-41c3-a80a-532476dc40a4 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:12.980660 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8b173e59-4850-41c3-a80a-532476dc40a4 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad" status: 200 len: 1324 microversion: 2.1 time: 1.065223 Aug 04 17:00:12.988386 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 780/1506] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:11 2022] GET /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad => generated 1324 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:12.997835 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-62d0cbce-a03f-46bf-a5be-c4a13b475178 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:12.998801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-62d0cbce-a03f-46bf-a5be-c4a13b475178 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:13.013016 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-62d0cbce-a03f-46bf-a5be-c4a13b475178 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:13.017267 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-62d0cbce-a03f-46bf-a5be-c4a13b475178 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:13.018974 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-62d0cbce-a03f-46bf-a5be-c4a13b475178 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:13.020930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-62d0cbce-a03f-46bf-a5be-c4a13b475178 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:13.022600 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-62d0cbce-a03f-46bf-a5be-c4a13b475178 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:13.023307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-62d0cbce-a03f-46bf-a5be-c4a13b475178 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:13.308686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-10bde6eb-95a5-47cf-9a40-d4e377cdb2a1 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:13.334355 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-10bde6eb-95a5-47cf-9a40-d4e377cdb2a1 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1716 microversion: 2.1 time: 0.579411 Aug 04 17:00:13.334871 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 727/1507] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:12 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1716 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:13.339523 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-43bec7b4-eb52-44d8-ae39-048ff2825ff2 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:13.340022 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-43bec7b4-eb52-44d8-ae39-048ff2825ff2 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cf061e67-e261-41e2-a505-95e318126844] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:13.378364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43bec7b4-eb52-44d8-ae39-048ff2825ff2 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:13.378876 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43bec7b4-eb52-44d8-ae39-048ff2825ff2 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:13.379322 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43bec7b4-eb52-44d8-ae39-048ff2825ff2 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:13.385995 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43bec7b4-eb52-44d8-ae39-048ff2825ff2 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:13.386500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43bec7b4-eb52-44d8-ae39-048ff2825ff2 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:13.386947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43bec7b4-eb52-44d8-ae39-048ff2825ff2 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:13.469491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-43bec7b4-eb52-44d8-ae39-048ff2825ff2 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cf061e67-e261-41e2-a505-95e318126844] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:00:13.481445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:13.627186 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-43bec7b4-eb52-44d8-ae39-048ff2825ff2 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "DELETE /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844" status: 204 len: 0 microversion: 2.1 time: 0.289931 Aug 04 17:00:13.627398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-62d0cbce-a03f-46bf-a5be-c4a13b475178 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lazy-loading 'services' on Instance uuid afea0f77-8d91-4170-934f-b6b7ef64d5a6 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:00:13.630344 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 728/1508] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:00:13 2022] DELETE /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:00:13.652408 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-62d0cbce-a03f-46bf-a5be-c4a13b475178 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 2419 microversion: 2.25 time: 0.662685 Aug 04 17:00:13.653512 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 781/1509] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:12 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 2419 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:13.672871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-61c36bb0-66bd-443a-a73b-38663b2384e9 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:13.673509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-61c36bb0-66bd-443a-a73b-38663b2384e9 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:13.693398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61c36bb0-66bd-443a-a73b-38663b2384e9 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:13.693912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61c36bb0-66bd-443a-a73b-38663b2384e9 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:13.694423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61c36bb0-66bd-443a-a73b-38663b2384e9 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:13.695177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61c36bb0-66bd-443a-a73b-38663b2384e9 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:13.695647 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61c36bb0-66bd-443a-a73b-38663b2384e9 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:13.696088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61c36bb0-66bd-443a-a73b-38663b2384e9 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:13.782015 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-55ca398d-dc42-4d0d-b932-b4cd447e8bcc tempest-FloatingIPsTestJSON-688972376 tempest-FloatingIPsTestJSON-688972376-project] Action: 'create', calling method: .version_select at 0x7f1e681e7820>, body: {"pool": null} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:14.245085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-61c36bb0-66bd-443a-a73b-38663b2384e9 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:14.260990 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-61c36bb0-66bd-443a-a73b-38663b2384e9 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:14.262620 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-61c36bb0-66bd-443a-a73b-38663b2384e9 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:14.263835 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-61c36bb0-66bd-443a-a73b-38663b2384e9 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1845 microversion: 2.32 time: 0.609223 Aug 04 17:00:14.264400 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 782/1510] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:13 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1845 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:14.407341 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-37b3ffbe-7eb9-41fd-8ea9-25bcb7afdb0a req-0e142f28-6c59-4720-84b5-d495c163b0c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "332a6825-af0b-4bcd-92df-128b918d1a57", "name": "network-vif-unplugged", "status": "completed", "tag": "0baa25b5-966d-4c17-abaf-1794a2778dc0"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:14.432069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-37b3ffbe-7eb9-41fd-8ea9-25bcb7afdb0a req-0e142f28-6c59-4720-84b5-d495c163b0c3 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:14.432937 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-37b3ffbe-7eb9-41fd-8ea9-25bcb7afdb0a req-0e142f28-6c59-4720-84b5-d495c163b0c3 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:14.433407 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-37b3ffbe-7eb9-41fd-8ea9-25bcb7afdb0a req-0e142f28-6c59-4720-84b5-d495c163b0c3 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:14.463725 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-37b3ffbe-7eb9-41fd-8ea9-25bcb7afdb0a req-0e142f28-6c59-4720-84b5-d495c163b0c3 service nova] Creating event network-vif-unplugged:0baa25b5-966d-4c17-abaf-1794a2778dc0 for instance 332a6825-af0b-4bcd-92df-128b918d1a57 on n-h2-851359-3 Aug 04 17:00:14.476391 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [req-37b3ffbe-7eb9-41fd-8ea9-25bcb7afdb0a req-0e142f28-6c59-4720-84b5-d495c163b0c3 service nova] Instance 332a6825-af0b-4bcd-92df-128b918d1a57 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:00:14.508494 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-37b3ffbe-7eb9-41fd-8ea9-25bcb7afdb0a req-0e142f28-6c59-4720-84b5-d495c163b0c3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.219605 Aug 04 17:00:14.510298 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 783/1511] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:14.524890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1d761f70-b982-4829-8666-dc34c04aec68 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:14.525882 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1d761f70-b982-4829-8666-dc34c04aec68 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: b4f45353-5340-4cfe-a8c3-0aeeef958607] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:14.538121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d761f70-b982-4829-8666-dc34c04aec68 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:14.538746 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d761f70-b982-4829-8666-dc34c04aec68 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:14.539286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d761f70-b982-4829-8666-dc34c04aec68 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:14.540225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d761f70-b982-4829-8666-dc34c04aec68 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:14.541478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d761f70-b982-4829-8666-dc34c04aec68 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:14.542157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d761f70-b982-4829-8666-dc34c04aec68 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:14.663853 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1d761f70-b982-4829-8666-dc34c04aec68 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:14.678703 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1d761f70-b982-4829-8666-dc34c04aec68 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607" status: 200 len: 1219 microversion: 2.1 time: 0.166981 Aug 04 17:00:14.692686 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 784/1512] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:14 2022] GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607 => generated 1219 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:14.704637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6da73e8a-1468-4154-98af-05f920523e64 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:14.705712 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6da73e8a-1468-4154-98af-05f920523e64 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:14.730743 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6da73e8a-1468-4154-98af-05f920523e64 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:14.731261 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6da73e8a-1468-4154-98af-05f920523e64 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:14.731719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6da73e8a-1468-4154-98af-05f920523e64 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:14.732469 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6da73e8a-1468-4154-98af-05f920523e64 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:14.732931 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6da73e8a-1468-4154-98af-05f920523e64 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:14.733360 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6da73e8a-1468-4154-98af-05f920523e64 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:15.061762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6da73e8a-1468-4154-98af-05f920523e64 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:15.072807 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6da73e8a-1468-4154-98af-05f920523e64 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1474 microversion: 2.1 time: 0.378373 Aug 04 17:00:15.073403 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 785/1513] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:14 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1474 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:15.080219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c5b150ec-ad83-470b-8b93-d33d63ea8e5f tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:15.080856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c5b150ec-ad83-470b-8b93-d33d63ea8e5f tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cf061e67-e261-41e2-a505-95e318126844] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:15.092393 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c5b150ec-ad83-470b-8b93-d33d63ea8e5f tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:15.093578 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c5b150ec-ad83-470b-8b93-d33d63ea8e5f tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:15.094355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c5b150ec-ad83-470b-8b93-d33d63ea8e5f tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:15.095468 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c5b150ec-ad83-470b-8b93-d33d63ea8e5f tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:15.096124 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c5b150ec-ad83-470b-8b93-d33d63ea8e5f tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:15.096818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c5b150ec-ad83-470b-8b93-d33d63ea8e5f tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:15.349724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c5b150ec-ad83-470b-8b93-d33d63ea8e5f tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ad6ccd2d804e158989a5f94c6f9a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50604ce0bb604209a3c18932fdd193e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:15.381439 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c5b150ec-ad83-470b-8b93-d33d63ea8e5f tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844" status: 200 len: 1679 microversion: 2.1 time: 0.303748 Aug 04 17:00:15.391231 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 786/1514] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:15 2022] GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844 => generated 1679 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:15.406344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a53b7769-f22c-4772-89cf-2aa1d678401b tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851359-3", "block_migration": "auto"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:15.412496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a53b7769-f22c-4772-89cf-2aa1d678401b tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:15.421795 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a53b7769-f22c-4772-89cf-2aa1d678401b tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:15.422497 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a53b7769-f22c-4772-89cf-2aa1d678401b tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:15.423117 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a53b7769-f22c-4772-89cf-2aa1d678401b tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:15.424026 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a53b7769-f22c-4772-89cf-2aa1d678401b tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:15.424652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a53b7769-f22c-4772-89cf-2aa1d678401b tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:15.425414 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a53b7769-f22c-4772-89cf-2aa1d678401b tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:15.479283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-a53b7769-f22c-4772-89cf-2aa1d678401b tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lazy-loading 'flavor' on Instance uuid afea0f77-8d91-4170-934f-b6b7ef64d5a6 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:00:15.509001 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a53b7769-f22c-4772-89cf-2aa1d678401b tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Going to try to live migrate instance to n-h2-851359-3 {{(pid=131043) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 17:00:17.187782 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-55ca398d-dc42-4d0d-b932-b4cd447e8bcc tempest-FloatingIPsTestJSON-688972376 tempest-FloatingIPsTestJSON-688972376-project] 10.222.0.93 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.553697 Aug 04 17:00:17.189499 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 729/1515] 10.222.0.93 () {60 vars in 1170 bytes} [Thu Aug 4 17:00:13 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:17.199464 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-e4759ba2-fca7-41d9-89ff-206efb6904b5 req-a6961012-4808-4d08-b2a3-0492f21d897e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79650928-e2ee-4928-8421-c0423298fdad", "name": "network-vif-plugged", "status": "completed", "tag": "13e6f1d8-988c-49db-899d-d36204677383"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:17.215540 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e4759ba2-fca7-41d9-89ff-206efb6904b5 req-a6961012-4808-4d08-b2a3-0492f21d897e service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:17.216484 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e4759ba2-fca7-41d9-89ff-206efb6904b5 req-a6961012-4808-4d08-b2a3-0492f21d897e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:17.217456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e4759ba2-fca7-41d9-89ff-206efb6904b5 req-a6961012-4808-4d08-b2a3-0492f21d897e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:17.230608 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-e4759ba2-fca7-41d9-89ff-206efb6904b5 req-a6961012-4808-4d08-b2a3-0492f21d897e service nova] Creating event network-vif-plugged:13e6f1d8-988c-49db-899d-d36204677383 for instance 79650928-e2ee-4928-8421-c0423298fdad on n-h2-851359-3 Aug 04 17:00:17.236530 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-e4759ba2-fca7-41d9-89ff-206efb6904b5 req-a6961012-4808-4d08-b2a3-0492f21d897e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045040 Aug 04 17:00:17.237654 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 730/1516] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:17.247875 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a4ca4827-fa09-485e-abf4-812e7329aa4b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:17.249102 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a4ca4827-fa09-485e-abf4-812e7329aa4b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 79650928-e2ee-4928-8421-c0423298fdad] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:17.260093 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4ca4827-fa09-485e-abf4-812e7329aa4b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:17.260876 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4ca4827-fa09-485e-abf4-812e7329aa4b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:17.262201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4ca4827-fa09-485e-abf4-812e7329aa4b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:17.264973 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4ca4827-fa09-485e-abf4-812e7329aa4b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:17.265658 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4ca4827-fa09-485e-abf4-812e7329aa4b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:17.266328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4ca4827-fa09-485e-abf4-812e7329aa4b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:17.608916 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a4ca4827-fa09-485e-abf4-812e7329aa4b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:17.626090 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a4ca4827-fa09-485e-abf4-812e7329aa4b tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad" status: 200 len: 1324 microversion: 2.1 time: 0.386733 Aug 04 17:00:17.632936 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 731/1517] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:17 2022] GET /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad => generated 1324 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:17.638384 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-beb1c3b2-54de-419d-a56f-26ed55c24ae3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:17.643148 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-beb1c3b2-54de-419d-a56f-26ed55c24ae3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:17.653285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-beb1c3b2-54de-419d-a56f-26ed55c24ae3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:17.654111 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-beb1c3b2-54de-419d-a56f-26ed55c24ae3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:17.654874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-beb1c3b2-54de-419d-a56f-26ed55c24ae3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:17.655933 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-beb1c3b2-54de-419d-a56f-26ed55c24ae3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:17.656666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-beb1c3b2-54de-419d-a56f-26ed55c24ae3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:17.659136 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-beb1c3b2-54de-419d-a56f-26ed55c24ae3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:18.098425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-beb1c3b2-54de-419d-a56f-26ed55c24ae3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:18.124312 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-beb1c3b2-54de-419d-a56f-26ed55c24ae3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1716 microversion: 2.1 time: 0.489347 Aug 04 17:00:18.124926 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 732/1518] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:17 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1716 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:18.138007 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1fa2ba74-590f-41bf-a6c2-02e9774cee93 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:18.138672 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1fa2ba74-590f-41bf-a6c2-02e9774cee93 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:18.155668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1fa2ba74-590f-41bf-a6c2-02e9774cee93 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:18.156940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1fa2ba74-590f-41bf-a6c2-02e9774cee93 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:18.158668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1fa2ba74-590f-41bf-a6c2-02e9774cee93 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:18.159592 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1fa2ba74-590f-41bf-a6c2-02e9774cee93 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:18.162100 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1fa2ba74-590f-41bf-a6c2-02e9774cee93 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:18.164929 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1fa2ba74-590f-41bf-a6c2-02e9774cee93 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:18.443800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1fa2ba74-590f-41bf-a6c2-02e9774cee93 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:18.472315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1fa2ba74-590f-41bf-a6c2-02e9774cee93 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:18.475699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1fa2ba74-590f-41bf-a6c2-02e9774cee93 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:18.478097 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1fa2ba74-590f-41bf-a6c2-02e9774cee93 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1845 microversion: 2.32 time: 0.350749 Aug 04 17:00:18.479479 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 733/1519] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:18 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1845 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:18.487197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-53fea4f9-2341-4872-b0b3-41077109154d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:18.488398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-53fea4f9-2341-4872-b0b3-41077109154d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: b4f45353-5340-4cfe-a8c3-0aeeef958607] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:18.501317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53fea4f9-2341-4872-b0b3-41077109154d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:18.502211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53fea4f9-2341-4872-b0b3-41077109154d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:18.503447 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53fea4f9-2341-4872-b0b3-41077109154d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:18.506797 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53fea4f9-2341-4872-b0b3-41077109154d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:18.507727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53fea4f9-2341-4872-b0b3-41077109154d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:18.508352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53fea4f9-2341-4872-b0b3-41077109154d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:18.811234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-53fea4f9-2341-4872-b0b3-41077109154d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:18.824123 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-53fea4f9-2341-4872-b0b3-41077109154d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607" status: 200 len: 1315 microversion: 2.1 time: 0.341985 Aug 04 17:00:18.841675 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 734/1520] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:18 2022] GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607 => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:18.848038 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-08ae77fe-6b2f-4475-aea3-c7748d4554be tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:18.848038 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-08ae77fe-6b2f-4475-aea3-c7748d4554be tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:18.854393 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08ae77fe-6b2f-4475-aea3-c7748d4554be tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:18.855362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08ae77fe-6b2f-4475-aea3-c7748d4554be tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:18.855816 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08ae77fe-6b2f-4475-aea3-c7748d4554be tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:18.856605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08ae77fe-6b2f-4475-aea3-c7748d4554be tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:18.857079 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08ae77fe-6b2f-4475-aea3-c7748d4554be tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:18.857516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08ae77fe-6b2f-4475-aea3-c7748d4554be tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:19.254509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-08ae77fe-6b2f-4475-aea3-c7748d4554be tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:19.271508 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-08ae77fe-6b2f-4475-aea3-c7748d4554be tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1472 microversion: 2.1 time: 0.427562 Aug 04 17:00:19.271823 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 735/1521] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:18 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1472 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:19.276446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-579aa1d4-702a-46f3-8948-23e926ba0a85 req-d1ab3923-72f1-4aab-a481-620ae8b2e85e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "238cb283-0037-440c-a433-d3f4e3de1274", "tag": "3814bb20-52c5-4223-9bc1-3956f0cc6888"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:19.299023 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-579aa1d4-702a-46f3-8948-23e926ba0a85 req-d1ab3923-72f1-4aab-a481-620ae8b2e85e service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:19.299577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-579aa1d4-702a-46f3-8948-23e926ba0a85 req-d1ab3923-72f1-4aab-a481-620ae8b2e85e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:19.300034 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-579aa1d4-702a-46f3-8948-23e926ba0a85 req-d1ab3923-72f1-4aab-a481-620ae8b2e85e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:19.318228 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-579aa1d4-702a-46f3-8948-23e926ba0a85 req-d1ab3923-72f1-4aab-a481-620ae8b2e85e service nova] Creating event network-changed:3814bb20-52c5-4223-9bc1-3956f0cc6888 for instance 238cb283-0037-440c-a433-d3f4e3de1274 on n-h2-851359-3 Aug 04 17:00:19.334930 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-579aa1d4-702a-46f3-8948-23e926ba0a85 req-d1ab3923-72f1-4aab-a481-620ae8b2e85e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060487 Aug 04 17:00:19.335862 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 736/1522] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:19.357459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3550153b-4d52-443a-b458-efac52b136a5 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:19.359105 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3550153b-4d52-443a-b458-efac52b136a5 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] [instance: cf061e67-e261-41e2-a505-95e318126844] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:19.372925 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3550153b-4d52-443a-b458-efac52b136a5 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:19.373845 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3550153b-4d52-443a-b458-efac52b136a5 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:19.375256 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3550153b-4d52-443a-b458-efac52b136a5 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:19.384631 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3550153b-4d52-443a-b458-efac52b136a5 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:19.386678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3550153b-4d52-443a-b458-efac52b136a5 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:19.387436 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3550153b-4d52-443a-b458-efac52b136a5 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:19.417088 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-3550153b-4d52-443a-b458-efac52b136a5 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] HTTP exception thrown: Instance cf061e67-e261-41e2-a505-95e318126844 could not be found. Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3550153b-4d52-443a-b458-efac52b136a5 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Request method failure captured: Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844 HTTP/1.1 Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_qA6jHLsAQZpXrPx16iX_euAfp05qQ7EDZPJAziGXUzUCleYq7yNPRd_mMPqowRqSoynlb01Yn0-Z9X-RFHs3AEeO7Ff9FLLu5m8ylg4trhXIXHdsN4IBBsBP9LQONIwPZDPwYu6wpNi4PrPt3AUR94weUA9ob87CWgyJ5aFuaD8ng Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 50604ce0bb604209a3c18932fdd193e2 Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-VolumesAdminNegativeTest-1212329384 Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/50604ce0bb604209a3c18932fdd193e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/50604ce0bb604209a3c18932fdd193e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_50604ce0bb604209a3c18932fdd193e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/50604ce0bb604209a3c18932fdd193e2"}]}] Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-VolumesAdminNegativeTest-1212329384 Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 50604ce0bb604209a3c18932fdd193e2 Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1212329384 Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-VolumesAdminNegativeTest-1212329384-project Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 08ad6ccd2d804e158989a5f94c6f9a2f Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-VolumesAdminNegativeTest-1212329384-project Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance cf061e67-e261-41e2-a505-95e318126844 could not be found. Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'cf061e67-e261-41e2-a505-95e318126844'} Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf061e67-e261-41e2-a505-95e318126844 could not be found. Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf061e67-e261-41e2-a505-95e318126844 could not be found. Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:19.419548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:00:19.423879 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:19.423879 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:19.423879 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:19.423879 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:00:19.423879 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:00:19.423879 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf061e67-e261-41e2-a505-95e318126844 could not be found. Aug 04 17:00:19.423879 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:00:19.428780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3550153b-4d52-443a-b458-efac52b136a5 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Returning 404 to user: Instance cf061e67-e261-41e2-a505-95e318126844 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:00:19.430141 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3550153b-4d52-443a-b458-efac52b136a5 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844" status: 404 len: 111 microversion: 2.1 time: 0.091753 Aug 04 17:00:19.434512 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 737/1523] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:19 2022] GET /compute/v2.1/servers/cf061e67-e261-41e2-a505-95e318126844 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:00:19.455686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b6e2040b-bec9-49ae-acfd-de998be4f152 req-430e4909-42c6-40dc-b70b-dc30815edf76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "332a6825-af0b-4bcd-92df-128b918d1a57", "tag": "0baa25b5-966d-4c17-abaf-1794a2778dc0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:19.471535 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b6e2040b-bec9-49ae-acfd-de998be4f152 req-430e4909-42c6-40dc-b70b-dc30815edf76 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:19.473165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b6e2040b-bec9-49ae-acfd-de998be4f152 req-430e4909-42c6-40dc-b70b-dc30815edf76 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:19.474286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b6e2040b-bec9-49ae-acfd-de998be4f152 req-430e4909-42c6-40dc-b70b-dc30815edf76 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:19.491352 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b6e2040b-bec9-49ae-acfd-de998be4f152 req-430e4909-42c6-40dc-b70b-dc30815edf76 service nova] Creating event network-changed:0baa25b5-966d-4c17-abaf-1794a2778dc0 for instance 332a6825-af0b-4bcd-92df-128b918d1a57 on n-h2-851359-3 Aug 04 17:00:19.509280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-b6e2040b-bec9-49ae-acfd-de998be4f152 req-430e4909-42c6-40dc-b70b-dc30815edf76 service nova] Instance 332a6825-af0b-4bcd-92df-128b918d1a57 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:00:19.548216 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b6e2040b-bec9-49ae-acfd-de998be4f152 req-430e4909-42c6-40dc-b70b-dc30815edf76 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107179 Aug 04 17:00:19.549786 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 738/1524] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:19.558717 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9ff067bd-c811-4e20-a84b-384fd21a8651 tempest-FloatingIPsTestJSON-688972376 tempest-FloatingIPsTestJSON-688972376-project] Calling method '.version_select at 0x7f1e5bfcfb80>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:19.945571 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9ff067bd-c811-4e20-a84b-384fd21a8651 tempest-FloatingIPsTestJSON-688972376 tempest-FloatingIPsTestJSON-688972376-project] 10.222.0.93 "GET /compute/v2.1/os-floating-ips/1aa2c2b6-74f3-4a48-beec-75ea93db148c" status: 200 len: 141 microversion: 2.1 time: 0.394272 Aug 04 17:00:19.946197 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 739/1525] 10.222.0.93 () {58 vars in 1260 bytes} [Thu Aug 4 17:00:19 2022] GET /compute/v2.1/os-floating-ips/1aa2c2b6-74f3-4a48-beec-75ea93db148c => generated 141 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:19.952024 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4de82a88-9122-4850-9ce5-71bffb9e4886 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:19.952936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4de82a88-9122-4850-9ce5-71bffb9e4886 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 79650928-e2ee-4928-8421-c0423298fdad] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:19.965863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4de82a88-9122-4850-9ce5-71bffb9e4886 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:19.966684 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4de82a88-9122-4850-9ce5-71bffb9e4886 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:19.967860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4de82a88-9122-4850-9ce5-71bffb9e4886 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:19.968778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4de82a88-9122-4850-9ce5-71bffb9e4886 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:19.969402 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4de82a88-9122-4850-9ce5-71bffb9e4886 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:19.970024 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4de82a88-9122-4850-9ce5-71bffb9e4886 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:20.207308 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a53b7769-f22c-4772-89cf-2aa1d678401b tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6/action" status: 202 len: 0 microversion: 2.25 time: 4.813298 Aug 04 17:00:20.208638 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 787/1526] 10.222.0.93 () {62 vars in 1319 bytes} [Thu Aug 4 17:00:15 2022] POST /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6/action => generated 0 bytes in 4816 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:00:20.224768 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d9162a59-d172-4f8c-bc34-62eae23e374f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:20.225498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d9162a59-d172-4f8c-bc34-62eae23e374f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:20.228604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4de82a88-9122-4850-9ce5-71bffb9e4886 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:20.234522 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9162a59-d172-4f8c-bc34-62eae23e374f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:20.235034 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9162a59-d172-4f8c-bc34-62eae23e374f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:20.235485 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9162a59-d172-4f8c-bc34-62eae23e374f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:20.236215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9162a59-d172-4f8c-bc34-62eae23e374f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:20.236684 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9162a59-d172-4f8c-bc34-62eae23e374f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:20.237056 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4de82a88-9122-4850-9ce5-71bffb9e4886 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad" status: 200 len: 1324 microversion: 2.1 time: 0.289431 Aug 04 17:00:20.237197 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9162a59-d172-4f8c-bc34-62eae23e374f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:20.240566 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 740/1527] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:19 2022] GET /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad => generated 1324 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:20.253514 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9a0b4721-7226-4d61-b221-8af5b4b8b568 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] Calling method '.version_select at 0x7f1e5bfa8430>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:20.289831 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9a0b4721-7226-4d61-b221-8af5b4b8b568 tempest-VolumesAdminNegativeTest-1212329384 tempest-VolumesAdminNegativeTest-1212329384-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-706721067" status: 202 len: 0 microversion: 2.1 time: 0.046843 Aug 04 17:00:20.290439 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 741/1528] 10.222.0.93 () {58 vars in 1218 bytes} [Thu Aug 4 17:00:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-706721067 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:00:20.300389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7c6bafe3-91a3-467d-8292-60385f067b26 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:20.301041 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7c6bafe3-91a3-467d-8292-60385f067b26 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:20.308180 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c6bafe3-91a3-467d-8292-60385f067b26 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:20.309317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c6bafe3-91a3-467d-8292-60385f067b26 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:20.309773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c6bafe3-91a3-467d-8292-60385f067b26 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:20.310536 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c6bafe3-91a3-467d-8292-60385f067b26 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:20.311003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c6bafe3-91a3-467d-8292-60385f067b26 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:20.311437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c6bafe3-91a3-467d-8292-60385f067b26 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:20.612453 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d9162a59-d172-4f8c-bc34-62eae23e374f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:20.627311 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d9162a59-d172-4f8c-bc34-62eae23e374f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1716 microversion: 2.1 time: 0.413086 Aug 04 17:00:20.628420 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 788/1529] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:20 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1716 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:20.636592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6bb16279-1811-4ff7-b1c4-d23068390fc4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:20.637225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6bb16279-1811-4ff7-b1c4-d23068390fc4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: b4f45353-5340-4cfe-a8c3-0aeeef958607] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:20.648370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6bb16279-1811-4ff7-b1c4-d23068390fc4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:20.648887 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6bb16279-1811-4ff7-b1c4-d23068390fc4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:20.649443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6bb16279-1811-4ff7-b1c4-d23068390fc4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:20.650204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6bb16279-1811-4ff7-b1c4-d23068390fc4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:20.651457 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6bb16279-1811-4ff7-b1c4-d23068390fc4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:20.651996 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6bb16279-1811-4ff7-b1c4-d23068390fc4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:20.678653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7c6bafe3-91a3-467d-8292-60385f067b26 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:20.694864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7c6bafe3-91a3-467d-8292-60385f067b26 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:20.697161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7c6bafe3-91a3-467d-8292-60385f067b26 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:20.698780 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7c6bafe3-91a3-467d-8292-60385f067b26 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1866 microversion: 2.32 time: 0.403316 Aug 04 17:00:20.700030 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 742/1530] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:20 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1866 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:20.706152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c37c46fb-5b72-42e5-874d-ddd682bf91f3 tempest-FloatingIPsTestJSON-688972376 tempest-FloatingIPsTestJSON-688972376-project] Calling method '.version_select at 0x7f1e5bfcf0d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:21.615996 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6bb16279-1811-4ff7-b1c4-d23068390fc4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:21.630460 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6bb16279-1811-4ff7-b1c4-d23068390fc4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607" status: 200 len: 1315 microversion: 2.1 time: 0.999853 Aug 04 17:00:21.633035 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 789/1531] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:20 2022] GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607 => generated 1315 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:21.659552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-051d68a5-d811-40e6-9b25-f56c9bfb7c42 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:21.664428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-051d68a5-d811-40e6-9b25-f56c9bfb7c42 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:21.666641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:21.687940 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-051d68a5-d811-40e6-9b25-f56c9bfb7c42 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:21.688686 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-051d68a5-d811-40e6-9b25-f56c9bfb7c42 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:21.689332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-051d68a5-d811-40e6-9b25-f56c9bfb7c42 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:21.690280 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-051d68a5-d811-40e6-9b25-f56c9bfb7c42 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:21.691730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-051d68a5-d811-40e6-9b25-f56c9bfb7c42 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:21.693093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-051d68a5-d811-40e6-9b25-f56c9bfb7c42 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:21.694061 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c37c46fb-5b72-42e5-874d-ddd682bf91f3 tempest-FloatingIPsTestJSON-688972376 tempest-FloatingIPsTestJSON-688972376-project] 10.222.0.93 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.992320 Aug 04 17:00:21.694953 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 743/1532] 10.222.0.93 () {58 vars in 1149 bytes} [Thu Aug 4 17:00:20 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:21.699630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6338f046-cb55-4adb-b236-b24be04c4611 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:21.700329 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6338f046-cb55-4adb-b236-b24be04c4611 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:21.714434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6338f046-cb55-4adb-b236-b24be04c4611 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:21.714934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6338f046-cb55-4adb-b236-b24be04c4611 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:21.718591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6338f046-cb55-4adb-b236-b24be04c4611 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:21.719534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6338f046-cb55-4adb-b236-b24be04c4611 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:21.720182 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6338f046-cb55-4adb-b236-b24be04c4611 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:21.720778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6338f046-cb55-4adb-b236-b24be04c4611 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:22.107176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-051d68a5-d811-40e6-9b25-f56c9bfb7c42 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:22.123011 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-051d68a5-d811-40e6-9b25-f56c9bfb7c42 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:22.126304 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-051d68a5-d811-40e6-9b25-f56c9bfb7c42 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:22.129797 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-051d68a5-d811-40e6-9b25-f56c9bfb7c42 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 1810 microversion: 2.25 time: 0.495375 Aug 04 17:00:22.132143 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 790/1533] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:21 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 1810 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:22.140584 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5da105c9-ee09-4deb-b566-b91b21927bcc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:22.141908 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5da105c9-ee09-4deb-b566-b91b21927bcc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 79650928-e2ee-4928-8421-c0423298fdad] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:22.151905 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5da105c9-ee09-4deb-b566-b91b21927bcc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:22.152965 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5da105c9-ee09-4deb-b566-b91b21927bcc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:22.155033 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5da105c9-ee09-4deb-b566-b91b21927bcc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:22.156062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5da105c9-ee09-4deb-b566-b91b21927bcc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:22.156766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5da105c9-ee09-4deb-b566-b91b21927bcc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:22.157624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5da105c9-ee09-4deb-b566-b91b21927bcc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:22.205969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6338f046-cb55-4adb-b236-b24be04c4611 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:22.217761 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6338f046-cb55-4adb-b236-b24be04c4611 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1469 microversion: 2.1 time: 0.521721 Aug 04 17:00:22.230255 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 744/1534] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:21 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1469 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:22.230255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-d5900f89-c2ac-4f6e-b7fe-1d7f76cb25cf req-b37648a0-5f79-4827-9ac7-7e614a8e5ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4f45353-5340-4cfe-a8c3-0aeeef958607", "tag": "0bdc6e7d-6547-4ccf-8a5e-386eed9b1a27"}, {"name": "network-changed", "server_uuid": "238cb283-0037-440c-a433-d3f4e3de1274", "tag": "7101ff22-4276-4569-b4b4-db682cbdbaf2"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:22.237417 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:22.245199 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d5900f89-c2ac-4f6e-b7fe-1d7f76cb25cf req-b37648a0-5f79-4827-9ac7-7e614a8e5ce5 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:22.246671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d5900f89-c2ac-4f6e-b7fe-1d7f76cb25cf req-b37648a0-5f79-4827-9ac7-7e614a8e5ce5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:22.247345 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d5900f89-c2ac-4f6e-b7fe-1d7f76cb25cf req-b37648a0-5f79-4827-9ac7-7e614a8e5ce5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:22.278404 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-d5900f89-c2ac-4f6e-b7fe-1d7f76cb25cf req-b37648a0-5f79-4827-9ac7-7e614a8e5ce5 service nova] Creating event network-changed:0bdc6e7d-6547-4ccf-8a5e-386eed9b1a27 for instance b4f45353-5340-4cfe-a8c3-0aeeef958607 on n-h1-851359-3 Aug 04 17:00:22.278842 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-d5900f89-c2ac-4f6e-b7fe-1d7f76cb25cf req-b37648a0-5f79-4827-9ac7-7e614a8e5ce5 service nova] Creating event network-changed:7101ff22-4276-4569-b4b4-db682cbdbaf2 for instance 238cb283-0037-440c-a433-d3f4e3de1274 on n-h2-851359-3 Aug 04 17:00:22.290933 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-d5900f89-c2ac-4f6e-b7fe-1d7f76cb25cf req-b37648a0-5f79-4827-9ac7-7e614a8e5ce5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.071158 Aug 04 17:00:22.292119 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 745/1535] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:22.298459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-678ee728-bfa9-4613-9039-6c2de3c9dd5b req-c61c5305-54e6-43a3-aa16-46da5a2e9a0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf061e67-e261-41e2-a505-95e318126844", "name": "network-vif-deleted", "tag": "599dbaa7-2ff0-476e-83c1-e0770a3b8f46"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:22.311241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-678ee728-bfa9-4613-9039-6c2de3c9dd5b req-c61c5305-54e6-43a3-aa16-46da5a2e9a0d service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:22.312043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-678ee728-bfa9-4613-9039-6c2de3c9dd5b req-c61c5305-54e6-43a3-aa16-46da5a2e9a0d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:22.312655 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-678ee728-bfa9-4613-9039-6c2de3c9dd5b req-c61c5305-54e6-43a3-aa16-46da5a2e9a0d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:22.325966 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-678ee728-bfa9-4613-9039-6c2de3c9dd5b req-c61c5305-54e6-43a3-aa16-46da5a2e9a0d service nova] Creating event network-vif-deleted:599dbaa7-2ff0-476e-83c1-e0770a3b8f46 for instance cf061e67-e261-41e2-a505-95e318126844 on n-h1-851359-3 Aug 04 17:00:22.331900 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-678ee728-bfa9-4613-9039-6c2de3c9dd5b req-c61c5305-54e6-43a3-aa16-46da5a2e9a0d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038249 Aug 04 17:00:22.332758 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 746/1536] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:22.338179 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1e2baa6a-191b-4318-9914-08f1923d7053 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:22.339133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1e2baa6a-191b-4318-9914-08f1923d7053 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:22.345801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e2baa6a-191b-4318-9914-08f1923d7053 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:22.346631 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e2baa6a-191b-4318-9914-08f1923d7053 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:22.347243 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e2baa6a-191b-4318-9914-08f1923d7053 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:22.348158 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e2baa6a-191b-4318-9914-08f1923d7053 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:22.349334 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e2baa6a-191b-4318-9914-08f1923d7053 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:22.349936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e2baa6a-191b-4318-9914-08f1923d7053 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:22.510790 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:22.556942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5da105c9-ee09-4deb-b566-b91b21927bcc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:22.581035 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5da105c9-ee09-4deb-b566-b91b21927bcc tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad" status: 200 len: 1520 microversion: 2.1 time: 0.446760 Aug 04 17:00:22.581191 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 791/1537] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:22 2022] GET /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad => generated 1520 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:22.589563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-49515051-951c-4097-8022-c6280293e9b8 tempest-FloatingIPsTestJSON-688972376 tempest-FloatingIPsTestJSON-688972376-project] Calling method '.version_select at 0x7f1e6ca1d4c0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:22.603845 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:22.769887 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1e2baa6a-191b-4318-9914-08f1923d7053 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:22.785286 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1e2baa6a-191b-4318-9914-08f1923d7053 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1706 microversion: 2.1 time: 0.451090 Aug 04 17:00:22.787646 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 747/1538] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:22 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1706 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:22.793084 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cc6d54d2-b84c-4ddf-9052-8e895ed07ba0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:22.794254 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cc6d54d2-b84c-4ddf-9052-8e895ed07ba0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:22.812279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc6d54d2-b84c-4ddf-9052-8e895ed07ba0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:22.812943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc6d54d2-b84c-4ddf-9052-8e895ed07ba0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:22.813498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc6d54d2-b84c-4ddf-9052-8e895ed07ba0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:22.814568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc6d54d2-b84c-4ddf-9052-8e895ed07ba0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:22.815956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc6d54d2-b84c-4ddf-9052-8e895ed07ba0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:22.817343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc6d54d2-b84c-4ddf-9052-8e895ed07ba0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:23.217619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cc6d54d2-b84c-4ddf-9052-8e895ed07ba0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:23.238381 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cc6d54d2-b84c-4ddf-9052-8e895ed07ba0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:23.240468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cc6d54d2-b84c-4ddf-9052-8e895ed07ba0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:23.241634 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cc6d54d2-b84c-4ddf-9052-8e895ed07ba0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1866 microversion: 2.32 time: 0.452726 Aug 04 17:00:23.242241 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 748/1539] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:22 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1866 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:23.257523 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-6bf33613-695a-44af-ba9b-b1af4d813cec req-27723169-5ff1-402f-ad6b-345947186c9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "332a6825-af0b-4bcd-92df-128b918d1a57", "name": "network-vif-plugged", "status": "completed", "tag": "0baa25b5-966d-4c17-abaf-1794a2778dc0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:23.278551 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6bf33613-695a-44af-ba9b-b1af4d813cec req-27723169-5ff1-402f-ad6b-345947186c9b service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:23.279342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6bf33613-695a-44af-ba9b-b1af4d813cec req-27723169-5ff1-402f-ad6b-345947186c9b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:23.279955 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6bf33613-695a-44af-ba9b-b1af4d813cec req-27723169-5ff1-402f-ad6b-345947186c9b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:23.303579 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-6bf33613-695a-44af-ba9b-b1af4d813cec req-27723169-5ff1-402f-ad6b-345947186c9b service nova] Creating event network-vif-plugged:0baa25b5-966d-4c17-abaf-1794a2778dc0 for instance 332a6825-af0b-4bcd-92df-128b918d1a57 on n-h2-851359-3 Aug 04 17:00:23.319699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-6bf33613-695a-44af-ba9b-b1af4d813cec req-27723169-5ff1-402f-ad6b-345947186c9b service nova] Instance 332a6825-af0b-4bcd-92df-128b918d1a57 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:00:23.340609 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-6bf33613-695a-44af-ba9b-b1af4d813cec req-27723169-5ff1-402f-ad6b-345947186c9b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086288 Aug 04 17:00:23.341504 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 749/1540] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:23.349907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5a45e223-7310-4dd4-a038-7fce080f2d84 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:23.350874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5a45e223-7310-4dd4-a038-7fce080f2d84 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:23.361044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a45e223-7310-4dd4-a038-7fce080f2d84 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:23.362535 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a45e223-7310-4dd4-a038-7fce080f2d84 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:23.363313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a45e223-7310-4dd4-a038-7fce080f2d84 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:23.364667 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a45e223-7310-4dd4-a038-7fce080f2d84 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:23.365512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a45e223-7310-4dd4-a038-7fce080f2d84 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:23.366609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a45e223-7310-4dd4-a038-7fce080f2d84 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:23.454676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:23.535686 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5a45e223-7310-4dd4-a038-7fce080f2d84 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "POST /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57/action" status: 202 len: 0 microversion: 2.1 time: 0.191756 Aug 04 17:00:23.538133 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 750/1541] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:00:23 2022] POST /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:00:23.545839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fae9a709-5e77-4a13-baec-9d3190645ddf tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.108"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:23.549373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fae9a709-5e77-4a13-baec-9d3190645ddf tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:23.558172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fae9a709-5e77-4a13-baec-9d3190645ddf tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:23.559163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fae9a709-5e77-4a13-baec-9d3190645ddf tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:23.559835 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fae9a709-5e77-4a13-baec-9d3190645ddf tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:23.561175 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fae9a709-5e77-4a13-baec-9d3190645ddf tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:23.561880 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fae9a709-5e77-4a13-baec-9d3190645ddf tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:23.580971 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fae9a709-5e77-4a13-baec-9d3190645ddf tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:23.617149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fae9a709-5e77-4a13-baec-9d3190645ddf tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "refresh_cache-07628113-e50c-4c63-bff3-0401009c87c8" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 04 17:00:23.617700 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fae9a709-5e77-4a13-baec-9d3190645ddf tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquired lock "refresh_cache-07628113-e50c-4c63-bff3-0401009c87c8" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 04 17:00:24.442187 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-49515051-951c-4097-8022-c6280293e9b8 tempest-FloatingIPsTestJSON-688972376 tempest-FloatingIPsTestJSON-688972376-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/1aa2c2b6-74f3-4a48-beec-75ea93db148c" status: 202 len: 0 microversion: 2.1 time: 1.859746 Aug 04 17:00:24.446006 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 792/1542] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Aug 4 17:00:22 2022] DELETE /compute/v2.1/os-floating-ips/1aa2c2b6-74f3-4a48-beec-75ea93db148c => generated 0 bytes in 1864 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:00:24.454732 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-342c7a6e-0e82-49fb-ae1b-5ea25ce93b96 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:24.455772 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-342c7a6e-0e82-49fb-ae1b-5ea25ce93b96 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: b4f45353-5340-4cfe-a8c3-0aeeef958607] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:24.498762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-342c7a6e-0e82-49fb-ae1b-5ea25ce93b96 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:24.505833 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-342c7a6e-0e82-49fb-ae1b-5ea25ce93b96 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:24.506846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-342c7a6e-0e82-49fb-ae1b-5ea25ce93b96 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:24.518343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-342c7a6e-0e82-49fb-ae1b-5ea25ce93b96 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:24.522125 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-342c7a6e-0e82-49fb-ae1b-5ea25ce93b96 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:24.535569 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-342c7a6e-0e82-49fb-ae1b-5ea25ce93b96 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:24.579401 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:25.085810 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-342c7a6e-0e82-49fb-ae1b-5ea25ce93b96 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:25.107946 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-342c7a6e-0e82-49fb-ae1b-5ea25ce93b96 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607" status: 200 len: 1315 microversion: 2.1 time: 0.660399 Aug 04 17:00:25.108536 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 793/1543] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:24 2022] GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607 => generated 1315 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:25.125892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c4e53065-d398-4d7b-b677-ddd75fd022ad tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Calling method '.version_select at 0x7f1e6c91a700>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:25.131318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4e53065-d398-4d7b-b677-ddd75fd022ad tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:25.131905 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4e53065-d398-4d7b-b677-ddd75fd022ad tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:25.132433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4e53065-d398-4d7b-b677-ddd75fd022ad tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:25.152309 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c4e53065-d398-4d7b-b677-ddd75fd022ad tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] 10.222.0.93 "GET /compute/v2.1/os-migrations" status: 200 len: 3892 microversion: 2.1 time: 0.041165 Aug 04 17:00:25.153562 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 794/1544] 10.222.0.93 () {58 vars in 1143 bytes} [Thu Aug 4 17:00:25 2022] GET /compute/v2.1/os-migrations => generated 3892 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:25.161841 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-25b38455-966b-401d-896d-09387929e299 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:25.162770 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-25b38455-966b-401d-896d-09387929e299 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:25.171284 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25b38455-966b-401d-896d-09387929e299 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:25.172237 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25b38455-966b-401d-896d-09387929e299 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:25.172907 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25b38455-966b-401d-896d-09387929e299 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:25.173828 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25b38455-966b-401d-896d-09387929e299 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:25.174837 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25b38455-966b-401d-896d-09387929e299 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:25.175601 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25b38455-966b-401d-896d-09387929e299 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:26.007016 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-25b38455-966b-401d-896d-09387929e299 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:26.027329 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-25b38455-966b-401d-896d-09387929e299 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:26.035279 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-25b38455-966b-401d-896d-09387929e299 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:26.039873 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-25b38455-966b-401d-896d-09387929e299 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 1810 microversion: 2.25 time: 0.882567 Aug 04 17:00:26.054006 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 795/1545] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:25 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 1810 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:26.054006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-853798ca-8b3c-40af-b2c8-12a3acf75b0c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:26.054006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-853798ca-8b3c-40af-b2c8-12a3acf75b0c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:26.077573 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-853798ca-8b3c-40af-b2c8-12a3acf75b0c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:26.077573 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-853798ca-8b3c-40af-b2c8-12a3acf75b0c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:26.078523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-853798ca-8b3c-40af-b2c8-12a3acf75b0c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:26.079308 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-853798ca-8b3c-40af-b2c8-12a3acf75b0c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:26.079930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-853798ca-8b3c-40af-b2c8-12a3acf75b0c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:26.080136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-853798ca-8b3c-40af-b2c8-12a3acf75b0c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:26.441450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-853798ca-8b3c-40af-b2c8-12a3acf75b0c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:26.465899 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-853798ca-8b3c-40af-b2c8-12a3acf75b0c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1468 microversion: 2.1 time: 0.422616 Aug 04 17:00:26.466761 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 796/1546] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:26 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1468 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:26.476910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c3e14a1c-5794-4de6-828a-330bff30a4d3 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:26.483270 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c3e14a1c-5794-4de6-828a-330bff30a4d3 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:26.497204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c3e14a1c-5794-4de6-828a-330bff30a4d3 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:26.500444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c3e14a1c-5794-4de6-828a-330bff30a4d3 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:26.501154 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c3e14a1c-5794-4de6-828a-330bff30a4d3 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:26.502196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c3e14a1c-5794-4de6-828a-330bff30a4d3 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:26.503414 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c3e14a1c-5794-4de6-828a-330bff30a4d3 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:26.504390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c3e14a1c-5794-4de6-828a-330bff30a4d3 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:26.545223 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-fae9a709-5e77-4a13-baec-9d3190645ddf tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Building network info cache for instance {{(pid=131044) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 17:00:26.871386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c3e14a1c-5794-4de6-828a-330bff30a4d3 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:26.883816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c3e14a1c-5794-4de6-828a-330bff30a4d3 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:26.889694 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c3e14a1c-5794-4de6-828a-330bff30a4d3 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:26.891257 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c3e14a1c-5794-4de6-828a-330bff30a4d3 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1887 microversion: 2.32 time: 0.423084 Aug 04 17:00:26.896407 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 797/1547] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:26 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1887 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:26.912385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ae65f929-d2c5-4647-bb69-13dabd01a888 tempest-FloatingIPsTestJSON-688972376 tempest-FloatingIPsTestJSON-688972376-project] Action: 'create', calling method: .version_select at 0x7f1e6cac0ca0>, body: {"pool": null} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:28.422451 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-fae9a709-5e77-4a13-baec-9d3190645ddf tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Updating instance_info_cache with network_info: [{"id": "a6e94576-42ff-4f94-90f7-18335cd81c04", "address": "fa:16:3e:09:50:f1", "network": {"id": "fcf929f8-72e5-4701-9267-5cd4fba70ec8", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1970989112-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "65efeb63178649a7bdc50a90cfc112e9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa6e94576-42", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131044) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 17:00:28.443092 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fae9a709-5e77-4a13-baec-9d3190645ddf tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Releasing lock "refresh_cache-07628113-e50c-4c63-bff3-0401009c87c8" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 04 17:00:28.445214 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fae9a709-5e77-4a13-baec-9d3190645ddf tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "POST /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8/action" status: 202 len: 0 microversion: 2.1 time: 4.905382 Aug 04 17:00:28.450059 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 751/1548] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:00:23 2022] POST /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8/action => generated 0 bytes in 4911 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 04 17:00:28.462367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-72bcf036-ad60-4891-bbd8-8926cdb4bdc7 req-54f24fe4-4ab4-48d4-91a6-73fefd550a58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "238cb283-0037-440c-a433-d3f4e3de1274", "tag": "bd58d1ec-cf62-4cc6-8629-14df8de01861"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:28.498167 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-72bcf036-ad60-4891-bbd8-8926cdb4bdc7 req-54f24fe4-4ab4-48d4-91a6-73fefd550a58 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:28.500328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-72bcf036-ad60-4891-bbd8-8926cdb4bdc7 req-54f24fe4-4ab4-48d4-91a6-73fefd550a58 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:28.501252 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-72bcf036-ad60-4891-bbd8-8926cdb4bdc7 req-54f24fe4-4ab4-48d4-91a6-73fefd550a58 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:28.539506 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-72bcf036-ad60-4891-bbd8-8926cdb4bdc7 req-54f24fe4-4ab4-48d4-91a6-73fefd550a58 service nova] Creating event network-changed:bd58d1ec-cf62-4cc6-8629-14df8de01861 for instance 238cb283-0037-440c-a433-d3f4e3de1274 on n-h2-851359-3 Aug 04 17:00:28.550668 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-72bcf036-ad60-4891-bbd8-8926cdb4bdc7 req-54f24fe4-4ab4-48d4-91a6-73fefd550a58 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098661 Aug 04 17:00:28.554623 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 752/1549] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:28.566161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ae0867ab-e285-4913-8399-710008a1f9db tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:28.567756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ae0867ab-e285-4913-8399-710008a1f9db tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:28.591943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae0867ab-e285-4913-8399-710008a1f9db tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:28.596382 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae0867ab-e285-4913-8399-710008a1f9db tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:28.597164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae0867ab-e285-4913-8399-710008a1f9db tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:28.600024 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae0867ab-e285-4913-8399-710008a1f9db tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:28.600876 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae0867ab-e285-4913-8399-710008a1f9db tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:28.601561 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae0867ab-e285-4913-8399-710008a1f9db tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:28.971757 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ae0867ab-e285-4913-8399-710008a1f9db tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1857 microversion: 2.1 time: 0.414526 Aug 04 17:00:28.973933 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 753/1550] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:28 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1857 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:28.979582 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-83cbf6e9-594f-4674-9d89-03f216f2ac70 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:28.980427 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-83cbf6e9-594f-4674-9d89-03f216f2ac70 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: b4f45353-5340-4cfe-a8c3-0aeeef958607] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:28.987150 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83cbf6e9-594f-4674-9d89-03f216f2ac70 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:28.987893 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83cbf6e9-594f-4674-9d89-03f216f2ac70 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:28.988483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83cbf6e9-594f-4674-9d89-03f216f2ac70 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:28.989793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83cbf6e9-594f-4674-9d89-03f216f2ac70 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:28.990471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83cbf6e9-594f-4674-9d89-03f216f2ac70 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:28.991110 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83cbf6e9-594f-4674-9d89-03f216f2ac70 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:29.283471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-83cbf6e9-594f-4674-9d89-03f216f2ac70 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:29.300199 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-83cbf6e9-594f-4674-9d89-03f216f2ac70 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607" status: 200 len: 1315 microversion: 2.1 time: 0.324361 Aug 04 17:00:29.301356 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 754/1551] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:28 2022] GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:29.306636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-ac7b513c-ed3b-425b-ae24-76f93b318662 req-e0ea26c9-f181-4ee2-9c09-0449cf8bd305 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "238cb283-0037-440c-a433-d3f4e3de1274", "tag": "f4544258-5b29-4f5e-a138-6233282a67c2"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:29.329685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ac7b513c-ed3b-425b-ae24-76f93b318662 req-e0ea26c9-f181-4ee2-9c09-0449cf8bd305 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:29.330534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ac7b513c-ed3b-425b-ae24-76f93b318662 req-e0ea26c9-f181-4ee2-9c09-0449cf8bd305 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:29.331160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ac7b513c-ed3b-425b-ae24-76f93b318662 req-e0ea26c9-f181-4ee2-9c09-0449cf8bd305 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:29.356038 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-ac7b513c-ed3b-425b-ae24-76f93b318662 req-e0ea26c9-f181-4ee2-9c09-0449cf8bd305 service nova] Creating event network-changed:f4544258-5b29-4f5e-a138-6233282a67c2 for instance 238cb283-0037-440c-a433-d3f4e3de1274 on n-h2-851359-3 Aug 04 17:00:29.369667 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-ac7b513c-ed3b-425b-ae24-76f93b318662 req-e0ea26c9-f181-4ee2-9c09-0449cf8bd305 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066278 Aug 04 17:00:29.370940 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 755/1552] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:29.377789 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-7156b134-4333-412d-b159-e7b623b568c8 req-4a5ae1a6-b3cb-4733-8d7f-e356a518b878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4f45353-5340-4cfe-a8c3-0aeeef958607", "name": "network-vif-plugged", "status": "completed", "tag": "0bdc6e7d-6547-4ccf-8a5e-386eed9b1a27"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:29.406761 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7156b134-4333-412d-b159-e7b623b568c8 req-4a5ae1a6-b3cb-4733-8d7f-e356a518b878 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:29.410102 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7156b134-4333-412d-b159-e7b623b568c8 req-4a5ae1a6-b3cb-4733-8d7f-e356a518b878 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:29.410939 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7156b134-4333-412d-b159-e7b623b568c8 req-4a5ae1a6-b3cb-4733-8d7f-e356a518b878 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:29.436098 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-7156b134-4333-412d-b159-e7b623b568c8 req-4a5ae1a6-b3cb-4733-8d7f-e356a518b878 service nova] Creating event network-vif-plugged:0bdc6e7d-6547-4ccf-8a5e-386eed9b1a27 for instance b4f45353-5340-4cfe-a8c3-0aeeef958607 on n-h1-851359-3 Aug 04 17:00:29.443231 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-7156b134-4333-412d-b159-e7b623b568c8 req-4a5ae1a6-b3cb-4733-8d7f-e356a518b878 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069591 Aug 04 17:00:29.445089 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 756/1553] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:29.530176 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-920ae30f-4968-488e-8439-7be355221b96 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:29.533307 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-920ae30f-4968-488e-8439-7be355221b96 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:29.554630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-920ae30f-4968-488e-8439-7be355221b96 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:29.555392 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-920ae30f-4968-488e-8439-7be355221b96 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:29.555843 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-920ae30f-4968-488e-8439-7be355221b96 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:29.556764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-920ae30f-4968-488e-8439-7be355221b96 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:29.557235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-920ae30f-4968-488e-8439-7be355221b96 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:29.558657 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-920ae30f-4968-488e-8439-7be355221b96 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:30.044415 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-920ae30f-4968-488e-8439-7be355221b96 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:30.058915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-920ae30f-4968-488e-8439-7be355221b96 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:30.060775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-920ae30f-4968-488e-8439-7be355221b96 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:30.062367 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-920ae30f-4968-488e-8439-7be355221b96 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 1810 microversion: 2.25 time: 0.568382 Aug 04 17:00:30.063536 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 757/1554] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:29 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 1810 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:30.068490 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-52ec75df-8c39-4a85-9c19-4e948ea1b616 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:30.069396 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-52ec75df-8c39-4a85-9c19-4e948ea1b616 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:30.075821 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52ec75df-8c39-4a85-9c19-4e948ea1b616 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:30.076701 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52ec75df-8c39-4a85-9c19-4e948ea1b616 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:30.077392 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52ec75df-8c39-4a85-9c19-4e948ea1b616 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:30.078389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52ec75df-8c39-4a85-9c19-4e948ea1b616 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:30.079101 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52ec75df-8c39-4a85-9c19-4e948ea1b616 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:30.079763 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52ec75df-8c39-4a85-9c19-4e948ea1b616 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:30.815828 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-52ec75df-8c39-4a85-9c19-4e948ea1b616 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:30.826951 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-52ec75df-8c39-4a85-9c19-4e948ea1b616 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1468 microversion: 2.1 time: 0.762058 Aug 04 17:00:30.827939 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 758/1555] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:30 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1468 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:30.833889 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c8c88ae6-8c5b-4b9a-b2c6-c1825772e7a3 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:30.834761 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c8c88ae6-8c5b-4b9a-b2c6-c1825772e7a3 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:30.841296 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8c88ae6-8c5b-4b9a-b2c6-c1825772e7a3 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:30.843206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8c88ae6-8c5b-4b9a-b2c6-c1825772e7a3 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:30.843862 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8c88ae6-8c5b-4b9a-b2c6-c1825772e7a3 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:30.844777 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8c88ae6-8c5b-4b9a-b2c6-c1825772e7a3 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:30.845411 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8c88ae6-8c5b-4b9a-b2c6-c1825772e7a3 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:30.858497 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8c88ae6-8c5b-4b9a-b2c6-c1825772e7a3 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:30.894433 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ae65f929-d2c5-4647-bb69-13dabd01a888 tempest-FloatingIPsTestJSON-688972376 tempest-FloatingIPsTestJSON-688972376-project] 10.222.0.93 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.996161 Aug 04 17:00:30.898708 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 798/1556] 10.222.0.93 () {60 vars in 1170 bytes} [Thu Aug 4 17:00:26 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4001 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:30.904044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e76b42f8-c840-4bf0-864d-e67fb6fa8567 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Action: 'action', calling method: .version_select at 0x7f1e6a4d1a60>, body: {"addFloatingIp": {"address": "172.25.9.108"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:30.907731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e76b42f8-c840-4bf0-864d-e67fb6fa8567 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 79650928-e2ee-4928-8421-c0423298fdad] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:30.914910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e76b42f8-c840-4bf0-864d-e67fb6fa8567 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:30.915701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e76b42f8-c840-4bf0-864d-e67fb6fa8567 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:30.916906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e76b42f8-c840-4bf0-864d-e67fb6fa8567 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:30.917840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e76b42f8-c840-4bf0-864d-e67fb6fa8567 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:30.918502 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e76b42f8-c840-4bf0-864d-e67fb6fa8567 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:30.919107 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e76b42f8-c840-4bf0-864d-e67fb6fa8567 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:30.999352 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e76b42f8-c840-4bf0-864d-e67fb6fa8567 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "refresh_cache-79650928-e2ee-4928-8421-c0423298fdad" {{(pid=131043) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 04 17:00:30.999983 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e76b42f8-c840-4bf0-864d-e67fb6fa8567 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquired lock "refresh_cache-79650928-e2ee-4928-8421-c0423298fdad" {{(pid=131043) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 04 17:00:31.310086 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c8c88ae6-8c5b-4b9a-b2c6-c1825772e7a3 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:31.354360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c8c88ae6-8c5b-4b9a-b2c6-c1825772e7a3 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:31.356888 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c8c88ae6-8c5b-4b9a-b2c6-c1825772e7a3 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:31.360348 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c8c88ae6-8c5b-4b9a-b2c6-c1825772e7a3 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1887 microversion: 2.32 time: 0.529130 Aug 04 17:00:31.383702 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 759/1557] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:30 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1887 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:31.401625 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-12a370c8-d7e8-4646-a1af-28d929122a28 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:31.403230 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-12a370c8-d7e8-4646-a1af-28d929122a28 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:31.410547 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12a370c8-d7e8-4646-a1af-28d929122a28 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:31.412373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12a370c8-d7e8-4646-a1af-28d929122a28 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:31.413095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12a370c8-d7e8-4646-a1af-28d929122a28 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:31.414105 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12a370c8-d7e8-4646-a1af-28d929122a28 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:31.417197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12a370c8-d7e8-4646-a1af-28d929122a28 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:31.418447 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12a370c8-d7e8-4646-a1af-28d929122a28 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:31.766506 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-12a370c8-d7e8-4646-a1af-28d929122a28 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1857 microversion: 2.1 time: 0.371285 Aug 04 17:00:31.767095 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 760/1558] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:31 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1857 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:31.781525 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c61f0340-2d82-4fe9-a6f8-816898dad8a2 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:31.781525 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c61f0340-2d82-4fe9-a6f8-816898dad8a2 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: b4f45353-5340-4cfe-a8c3-0aeeef958607] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:31.800948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c61f0340-2d82-4fe9-a6f8-816898dad8a2 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:31.801538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c61f0340-2d82-4fe9-a6f8-816898dad8a2 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:31.822098 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c61f0340-2d82-4fe9-a6f8-816898dad8a2 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:31.822930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c61f0340-2d82-4fe9-a6f8-816898dad8a2 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:31.823440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c61f0340-2d82-4fe9-a6f8-816898dad8a2 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:31.823871 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c61f0340-2d82-4fe9-a6f8-816898dad8a2 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:32.318556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c61f0340-2d82-4fe9-a6f8-816898dad8a2 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:32.337553 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c61f0340-2d82-4fe9-a6f8-816898dad8a2 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607" status: 200 len: 1501 microversion: 2.1 time: 0.568894 Aug 04 17:00:32.338601 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 761/1559] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:31 2022] GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607 => generated 1501 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:32.370134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b5d22c3b-3e8a-4510-a17d-da594ba66e96 req-beb1f560-8ae7-4388-946c-5cd69c3bbf29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "332a6825-af0b-4bcd-92df-128b918d1a57", "name": "network-vif-unplugged", "status": "completed", "tag": "0baa25b5-966d-4c17-abaf-1794a2778dc0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:32.385903 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b5d22c3b-3e8a-4510-a17d-da594ba66e96 req-beb1f560-8ae7-4388-946c-5cd69c3bbf29 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:32.387738 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b5d22c3b-3e8a-4510-a17d-da594ba66e96 req-beb1f560-8ae7-4388-946c-5cd69c3bbf29 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:32.395391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b5d22c3b-3e8a-4510-a17d-da594ba66e96 req-beb1f560-8ae7-4388-946c-5cd69c3bbf29 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:32.418686 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b5d22c3b-3e8a-4510-a17d-da594ba66e96 req-beb1f560-8ae7-4388-946c-5cd69c3bbf29 service nova] Creating event network-vif-unplugged:0baa25b5-966d-4c17-abaf-1794a2778dc0 for instance 332a6825-af0b-4bcd-92df-128b918d1a57 on n-h1-851359-3 Aug 04 17:00:32.431187 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-b5d22c3b-3e8a-4510-a17d-da594ba66e96 req-beb1f560-8ae7-4388-946c-5cd69c3bbf29 service nova] Instance 332a6825-af0b-4bcd-92df-128b918d1a57 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:00:32.450227 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b5d22c3b-3e8a-4510-a17d-da594ba66e96 req-beb1f560-8ae7-4388-946c-5cd69c3bbf29 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095672 Aug 04 17:00:32.451523 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 762/1560] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:32.461762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c28f4dac-d71d-4a1e-ad38-8926dc1036ec tempest-FloatingIPsTestJSON-688972376 tempest-FloatingIPsTestJSON-688972376-project] Calling method '.version_select at 0x7f1e5b480310>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:34.825528 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c28f4dac-d71d-4a1e-ad38-8926dc1036ec tempest-FloatingIPsTestJSON-688972376 tempest-FloatingIPsTestJSON-688972376-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/d32ccafc-70b4-4f2d-a06a-b9509035bb07" status: 202 len: 0 microversion: 2.1 time: 2.370896 Aug 04 17:00:34.827644 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 763/1561] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Aug 4 17:00:32 2022] DELETE /compute/v2.1/os-floating-ips/d32ccafc-70b4-4f2d-a06a-b9509035bb07 => generated 0 bytes in 2375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:00:34.846568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-36a4ca04-a418-4702-ac3d-6ec70d21ae25 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:34.849100 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-36a4ca04-a418-4702-ac3d-6ec70d21ae25 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:34.862919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36a4ca04-a418-4702-ac3d-6ec70d21ae25 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:34.864718 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36a4ca04-a418-4702-ac3d-6ec70d21ae25 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:34.865872 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36a4ca04-a418-4702-ac3d-6ec70d21ae25 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:34.867369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36a4ca04-a418-4702-ac3d-6ec70d21ae25 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:34.868079 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36a4ca04-a418-4702-ac3d-6ec70d21ae25 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:34.869036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36a4ca04-a418-4702-ac3d-6ec70d21ae25 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:35.195426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-36a4ca04-a418-4702-ac3d-6ec70d21ae25 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:35.212956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-36a4ca04-a418-4702-ac3d-6ec70d21ae25 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:35.217473 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-36a4ca04-a418-4702-ac3d-6ec70d21ae25 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:35.219567 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-36a4ca04-a418-4702-ac3d-6ec70d21ae25 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 1810 microversion: 2.25 time: 0.390698 Aug 04 17:00:35.223054 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 764/1562] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:34 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 1810 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:35.237017 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-f9ca4804-cc3d-4054-979a-5dfc43e5907d req-ef98d547-2f29-438e-aa6c-dfd42f4187c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07628113-e50c-4c63-bff3-0401009c87c8", "tag": "a6e94576-42ff-4f94-90f7-18335cd81c04"}, {"name": "network-changed", "server_uuid": "238cb283-0037-440c-a433-d3f4e3de1274", "tag": "4bf2b6ee-be9c-4a4f-8dd2-4adfb41f8692"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:35.278686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f9ca4804-cc3d-4054-979a-5dfc43e5907d req-ef98d547-2f29-438e-aa6c-dfd42f4187c2 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:35.279126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f9ca4804-cc3d-4054-979a-5dfc43e5907d req-ef98d547-2f29-438e-aa6c-dfd42f4187c2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:35.279639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f9ca4804-cc3d-4054-979a-5dfc43e5907d req-ef98d547-2f29-438e-aa6c-dfd42f4187c2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:35.297463 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-f9ca4804-cc3d-4054-979a-5dfc43e5907d req-ef98d547-2f29-438e-aa6c-dfd42f4187c2 service nova] Creating event network-changed:a6e94576-42ff-4f94-90f7-18335cd81c04 for instance 07628113-e50c-4c63-bff3-0401009c87c8 on n-h1-851359-3 Aug 04 17:00:35.298307 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-f9ca4804-cc3d-4054-979a-5dfc43e5907d req-ef98d547-2f29-438e-aa6c-dfd42f4187c2 service nova] Creating event network-changed:4bf2b6ee-be9c-4a4f-8dd2-4adfb41f8692 for instance 238cb283-0037-440c-a433-d3f4e3de1274 on n-h2-851359-3 Aug 04 17:00:35.310283 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-f9ca4804-cc3d-4054-979a-5dfc43e5907d req-ef98d547-2f29-438e-aa6c-dfd42f4187c2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.085694 Aug 04 17:00:35.311654 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 765/1563] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:35.327181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3e292a62-3ab2-43c7-9369-67be4e815e53 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:35.328336 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3e292a62-3ab2-43c7-9369-67be4e815e53 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:35.340641 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e292a62-3ab2-43c7-9369-67be4e815e53 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:35.341420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e292a62-3ab2-43c7-9369-67be4e815e53 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:35.342110 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e292a62-3ab2-43c7-9369-67be4e815e53 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:35.343346 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e292a62-3ab2-43c7-9369-67be4e815e53 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:35.344085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e292a62-3ab2-43c7-9369-67be4e815e53 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:35.344734 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e292a62-3ab2-43c7-9369-67be4e815e53 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:36.027355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3e292a62-3ab2-43c7-9369-67be4e815e53 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:36.044149 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.network.neutron [None req-e76b42f8-c840-4bf0-864d-e67fb6fa8567 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 79650928-e2ee-4928-8421-c0423298fdad] re-assign floating IP 172.25.9.108 from instance 07628113-e50c-4c63-bff3-0401009c87c8 Aug 04 17:00:36.058716 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3e292a62-3ab2-43c7-9369-67be4e815e53 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1468 microversion: 2.1 time: 0.745259 Aug 04 17:00:36.060052 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 766/1564] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:35 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1468 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:36.065468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-73493dda-00d9-4c5e-aa6f-e871f1e41311 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:36.070766 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-73493dda-00d9-4c5e-aa6f-e871f1e41311 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:36.081849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73493dda-00d9-4c5e-aa6f-e871f1e41311 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:36.086849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73493dda-00d9-4c5e-aa6f-e871f1e41311 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:36.087594 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73493dda-00d9-4c5e-aa6f-e871f1e41311 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:36.091949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73493dda-00d9-4c5e-aa6f-e871f1e41311 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:36.092799 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73493dda-00d9-4c5e-aa6f-e871f1e41311 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:36.093450 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73493dda-00d9-4c5e-aa6f-e871f1e41311 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:36.138534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-e76b42f8-c840-4bf0-864d-e67fb6fa8567 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Building network info cache for instance {{(pid=131043) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 17:00:36.337944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-73493dda-00d9-4c5e-aa6f-e871f1e41311 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lazy-loading 'services' on Instance uuid e92cd73d-ce71-4f92-9db9-ae02c7febbcb {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:00:36.630873 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-73493dda-00d9-4c5e-aa6f-e871f1e41311 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb/os-volume_attachments/c36f65b0-3829-4c98-afb3-9eb57f33b092" status: 202 len: 0 microversion: 2.1 time: 0.569384 Aug 04 17:00:36.631878 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 767/1565] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Aug 4 17:00:36 2022] DELETE /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb/os-volume_attachments/c36f65b0-3829-4c98-afb3-9eb57f33b092 => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:00:36.644677 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5234265c-6bcc-4c25-ac4d-5a193339da7f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:36.647129 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5234265c-6bcc-4c25-ac4d-5a193339da7f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:36.657942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5234265c-6bcc-4c25-ac4d-5a193339da7f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:36.658871 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5234265c-6bcc-4c25-ac4d-5a193339da7f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:36.659536 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5234265c-6bcc-4c25-ac4d-5a193339da7f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:36.660503 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5234265c-6bcc-4c25-ac4d-5a193339da7f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:36.661271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5234265c-6bcc-4c25-ac4d-5a193339da7f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:36.662085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5234265c-6bcc-4c25-ac4d-5a193339da7f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:37.196585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5234265c-6bcc-4c25-ac4d-5a193339da7f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:37.220991 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5234265c-6bcc-4c25-ac4d-5a193339da7f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:37.223071 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5234265c-6bcc-4c25-ac4d-5a193339da7f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:37.225191 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5234265c-6bcc-4c25-ac4d-5a193339da7f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1875 microversion: 2.32 time: 0.590898 Aug 04 17:00:37.226287 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 768/1566] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:36 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1875 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:37.231516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-9da7c012-956d-4e6d-8bda-5fbaff1b24b5 req-a58b203c-6b47-466d-979e-e02033857c4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "332a6825-af0b-4bcd-92df-128b918d1a57", "tag": "0baa25b5-966d-4c17-abaf-1794a2778dc0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:37.241925 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9da7c012-956d-4e6d-8bda-5fbaff1b24b5 req-a58b203c-6b47-466d-979e-e02033857c4e service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:37.242660 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9da7c012-956d-4e6d-8bda-5fbaff1b24b5 req-a58b203c-6b47-466d-979e-e02033857c4e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:37.243312 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9da7c012-956d-4e6d-8bda-5fbaff1b24b5 req-a58b203c-6b47-466d-979e-e02033857c4e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:37.248866 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:37.263482 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-9da7c012-956d-4e6d-8bda-5fbaff1b24b5 req-a58b203c-6b47-466d-979e-e02033857c4e service nova] Creating event network-changed:0baa25b5-966d-4c17-abaf-1794a2778dc0 for instance 332a6825-af0b-4bcd-92df-128b918d1a57 on n-h1-851359-3 Aug 04 17:00:37.270882 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-9da7c012-956d-4e6d-8bda-5fbaff1b24b5 req-a58b203c-6b47-466d-979e-e02033857c4e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042584 Aug 04 17:00:37.272178 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 769/1567] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:37.278483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-676fab05-7fbf-49b9-aa4a-cd054ce5ae9a tempest-FloatingIPsTestJSON-688972376 tempest-FloatingIPsTestJSON-688972376-project] Calling method '.version_select at 0x7f1e5b5928b0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:37.369930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG neutronclient.v2_0.client [None req-676fab05-7fbf-49b9-aa4a-cd054ce5ae9a tempest-FloatingIPsTestJSON-688972376 tempest-FloatingIPsTestJSON-688972376-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d32ccafc-70b4-4f2d-a06a-b9509035bb07 could not be found", "detail": ""}} {{(pid=131044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 17:00:37.370719 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-676fab05-7fbf-49b9-aa4a-cd054ce5ae9a tempest-FloatingIPsTestJSON-688972376 tempest-FloatingIPsTestJSON-688972376-project] HTTP exception thrown: Floating IP not found for ID d32ccafc-70b4-4f2d-a06a-b9509035bb07 Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-676fab05-7fbf-49b9-aa4a-cd054ce5ae9a tempest-FloatingIPsTestJSON-688972376 tempest-FloatingIPsTestJSON-688972376-project] Request method failure captured: Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-floating-ips/d32ccafc-70b4-4f2d-a06a-b9509035bb07 HTTP/1.1 Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_sbmWngvtt6MEOa-Ds5z2R4_0F0gfLj_wqTT7g8wRPag6nsbohrExlA_V8Oz6aq8k1YHo5SbzErJuJg4_RxMKX-rVI_g-EDJw-GdyHyqoFjir09zcyBtjoX5d9Jhyu0fqxDokQAmHyQAacg-3AuCum4_-_5Cnl9lFCdr8ZGYRwejJU Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 485b41000f3c4cd1895ada9b2988fafb Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-FloatingIPsTestJSON-688972376 Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/485b41000f3c4cd1895ada9b2988fafb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/485b41000f3c4cd1895ada9b2988fafb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_485b41000f3c4cd1895ada9b2988fafb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/485b41000f3c4cd1895ada9b2988fafb"}]}] Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-FloatingIPsTestJSON-688972376 Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 485b41000f3c4cd1895ada9b2988fafb Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FloatingIPsTestJSON-688972376 Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-FloatingIPsTestJSON-688972376-project Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: a040d7ea5c604684b8c271484f664d3a Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-FloatingIPsTestJSON-688972376-project Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: exception: Floating IP not found for ID d32ccafc-70b4-4f2d-a06a-b9509035bb07 Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'd32ccafc-70b4-4f2d-a06a-b9509035bb07'} Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d32ccafc-70b4-4f2d-a06a-b9509035bb07 could not be found Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e28f6d59-1eed-44ad-982e-b7a3d8d3beb5'] Aug 04 17:00:37.372641 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:00:37.377942 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:37.377942 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:00:37.377942 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:37.377942 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 04 17:00:37.377942 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 04 17:00:37.377942 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 04 17:00:37.377942 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 04 17:00:37.377942 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d32ccafc-70b4-4f2d-a06a-b9509035bb07. Aug 04 17:00:37.377942 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:00:37.377942 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:37.377942 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:00:37.377942 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:37.377942 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:37.377942 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:37.377942 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:00:37.377942 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:00:37.377942 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:00:37.377942 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:00:37.377942 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:00:37.377942 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:00:37.377942 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 04 17:00:37.377942 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 17:00:37.377942 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d32ccafc-70b4-4f2d-a06a-b9509035bb07 Aug 04 17:00:37.377942 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:00:37.377942 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:37.377942 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:00:37.377942 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:37.377942 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:37.377942 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:37.377942 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:00:37.377942 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:00:37.377942 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d32ccafc-70b4-4f2d-a06a-b9509035bb07 Aug 04 17:00:37.377942 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:00:37.384684 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-676fab05-7fbf-49b9-aa4a-cd054ce5ae9a tempest-FloatingIPsTestJSON-688972376 tempest-FloatingIPsTestJSON-688972376-project] Returning 404 to user: Floating IP not found for ID d32ccafc-70b4-4f2d-a06a-b9509035bb07 {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:00:37.384684 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-676fab05-7fbf-49b9-aa4a-cd054ce5ae9a tempest-FloatingIPsTestJSON-688972376 tempest-FloatingIPsTestJSON-688972376-project] 10.222.0.93 "GET /compute/v2.1/os-floating-ips/d32ccafc-70b4-4f2d-a06a-b9509035bb07" status: 404 len: 111 microversion: 2.1 time: 0.109493 Aug 04 17:00:37.384684 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 770/1568] 10.222.0.93 () {58 vars in 1260 bytes} [Thu Aug 4 17:00:37 2022] GET /compute/v2.1/os-floating-ips/d32ccafc-70b4-4f2d-a06a-b9509035bb07 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:00:37.392121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-78571354-095c-470a-8a00-34fd40b80679 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f797a19-c563-46d0-b512-3f4aefc22a6f"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:37.398695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-78571354-095c-470a-8a00-34fd40b80679 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: b4f45353-5340-4cfe-a8c3-0aeeef958607] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:37.415658 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78571354-095c-470a-8a00-34fd40b80679 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:37.416455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78571354-095c-470a-8a00-34fd40b80679 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:37.417067 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78571354-095c-470a-8a00-34fd40b80679 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:37.420147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78571354-095c-470a-8a00-34fd40b80679 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:37.420820 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78571354-095c-470a-8a00-34fd40b80679 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:37.422596 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78571354-095c-470a-8a00-34fd40b80679 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:37.800035 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-e76b42f8-c840-4bf0-864d-e67fb6fa8567 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Updating instance_info_cache with network_info: [{"id": "a6e94576-42ff-4f94-90f7-18335cd81c04", "address": "fa:16:3e:09:50:f1", "network": {"id": "fcf929f8-72e5-4701-9267-5cd4fba70ec8", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1970989112-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "65efeb63178649a7bdc50a90cfc112e9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa6e94576-42", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131043) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 17:00:37.820856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-e76b42f8-c840-4bf0-864d-e67fb6fa8567 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 79650928-e2ee-4928-8421-c0423298fdad] Building network info cache for instance {{(pid=131043) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 17:00:38.282563 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-78571354-095c-470a-8a00-34fd40b80679 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "POST /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.897535 Aug 04 17:00:38.284304 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 771/1569] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Aug 4 17:00:37 2022] POST /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607/os-volume_attachments => generated 194 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:38.343295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-826da0a6-e81c-4c38-9a17-21c6f44f33ba tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:38.350705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-826da0a6-e81c-4c38-9a17-21c6f44f33ba tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:38.365492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-826da0a6-e81c-4c38-9a17-21c6f44f33ba tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:38.366011 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-826da0a6-e81c-4c38-9a17-21c6f44f33ba tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:38.366451 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-826da0a6-e81c-4c38-9a17-21c6f44f33ba tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:38.367167 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-826da0a6-e81c-4c38-9a17-21c6f44f33ba tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:38.367681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-826da0a6-e81c-4c38-9a17-21c6f44f33ba tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:38.368062 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-826da0a6-e81c-4c38-9a17-21c6f44f33ba tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:39.224133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-826da0a6-e81c-4c38-9a17-21c6f44f33ba tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:39.239877 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-826da0a6-e81c-4c38-9a17-21c6f44f33ba tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:39.242609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-826da0a6-e81c-4c38-9a17-21c6f44f33ba tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:39.244272 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-826da0a6-e81c-4c38-9a17-21c6f44f33ba tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 1810 microversion: 2.25 time: 0.958234 Aug 04 17:00:39.264127 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 772/1570] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:38 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 1810 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:39.273160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c6d8d86c-158f-46ef-8e20-aa8151beff9d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:39.276254 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c6d8d86c-158f-46ef-8e20-aa8151beff9d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:39.283708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6d8d86c-158f-46ef-8e20-aa8151beff9d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:39.285156 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6d8d86c-158f-46ef-8e20-aa8151beff9d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:39.285903 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6d8d86c-158f-46ef-8e20-aa8151beff9d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:39.286876 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6d8d86c-158f-46ef-8e20-aa8151beff9d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:39.287710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6d8d86c-158f-46ef-8e20-aa8151beff9d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:39.288763 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6d8d86c-158f-46ef-8e20-aa8151beff9d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:39.380351 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c6d8d86c-158f-46ef-8e20-aa8151beff9d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112460 Aug 04 17:00:39.386529 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 773/1571] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:00:39 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:39.394633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1b2d55fe-47d9-4eb3-892b-f04fbb860c69 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:39.398397 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1b2d55fe-47d9-4eb3-892b-f04fbb860c69 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:39.413549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b2d55fe-47d9-4eb3-892b-f04fbb860c69 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:39.415446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b2d55fe-47d9-4eb3-892b-f04fbb860c69 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:39.416121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b2d55fe-47d9-4eb3-892b-f04fbb860c69 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:39.420752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b2d55fe-47d9-4eb3-892b-f04fbb860c69 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:39.421384 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b2d55fe-47d9-4eb3-892b-f04fbb860c69 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:39.421902 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b2d55fe-47d9-4eb3-892b-f04fbb860c69 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:39.505647 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-e76b42f8-c840-4bf0-864d-e67fb6fa8567 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 79650928-e2ee-4928-8421-c0423298fdad] Updating instance_info_cache with network_info: [{"id": "13e6f1d8-988c-49db-899d-d36204677383", "address": "fa:16:3e:96:76:15", "network": {"id": "fcf929f8-72e5-4701-9267-5cd4fba70ec8", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1970989112-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "65efeb63178649a7bdc50a90cfc112e9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap13e6f1d8-98", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131043) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 17:00:39.521046 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e76b42f8-c840-4bf0-864d-e67fb6fa8567 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Releasing lock "refresh_cache-79650928-e2ee-4928-8421-c0423298fdad" {{(pid=131043) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 04 17:00:39.522178 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e76b42f8-c840-4bf0-864d-e67fb6fa8567 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "POST /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad/action" status: 202 len: 0 microversion: 2.1 time: 8.622096 Aug 04 17:00:39.523191 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 799/1572] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:00:30 2022] POST /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad/action => generated 0 bytes in 8624 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 04 17:00:39.534771 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-b6794b18-e3a0-429c-a188-a575d9232891 req-a5908272-9943-4c47-9677-0b31a9902503 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "238cb283-0037-440c-a433-d3f4e3de1274", "tag": "9c46603b-3e50-4dfd-a7a6-bd1e37bb11c3"}, {"name": "network-changed", "server_uuid": "238cb283-0037-440c-a433-d3f4e3de1274", "tag": "b3ffb765-1857-45ce-9f08-b2a94e4fdef2"}, {"name": "network-changed", "server_uuid": "07628113-e50c-4c63-bff3-0401009c87c8", "tag": "a6e94576-42ff-4f94-90f7-18335cd81c04"}, {"name": "network-changed", "server_uuid": "79650928-e2ee-4928-8421-c0423298fdad", "tag": "13e6f1d8-988c-49db-899d-d36204677383"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:39.562236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b6794b18-e3a0-429c-a188-a575d9232891 req-a5908272-9943-4c47-9677-0b31a9902503 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:39.562766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b6794b18-e3a0-429c-a188-a575d9232891 req-a5908272-9943-4c47-9677-0b31a9902503 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:39.563220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b6794b18-e3a0-429c-a188-a575d9232891 req-a5908272-9943-4c47-9677-0b31a9902503 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:39.591562 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-b6794b18-e3a0-429c-a188-a575d9232891 req-a5908272-9943-4c47-9677-0b31a9902503 service nova] Creating event network-changed:9c46603b-3e50-4dfd-a7a6-bd1e37bb11c3 for instance 238cb283-0037-440c-a433-d3f4e3de1274 on n-h2-851359-3 Aug 04 17:00:39.593409 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-b6794b18-e3a0-429c-a188-a575d9232891 req-a5908272-9943-4c47-9677-0b31a9902503 service nova] Creating event network-changed:b3ffb765-1857-45ce-9f08-b2a94e4fdef2 for instance 238cb283-0037-440c-a433-d3f4e3de1274 on n-h2-851359-3 Aug 04 17:00:39.593947 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-b6794b18-e3a0-429c-a188-a575d9232891 req-a5908272-9943-4c47-9677-0b31a9902503 service nova] Creating event network-changed:a6e94576-42ff-4f94-90f7-18335cd81c04 for instance 07628113-e50c-4c63-bff3-0401009c87c8 on n-h1-851359-3 Aug 04 17:00:39.594698 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-b6794b18-e3a0-429c-a188-a575d9232891 req-a5908272-9943-4c47-9677-0b31a9902503 service nova] Creating event network-changed:13e6f1d8-988c-49db-899d-d36204677383 for instance 79650928-e2ee-4928-8421-c0423298fdad on n-h2-851359-3 Aug 04 17:00:39.606941 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-b6794b18-e3a0-429c-a188-a575d9232891 req-a5908272-9943-4c47-9677-0b31a9902503 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 680 microversion: 2.1 time: 0.082228 Aug 04 17:00:39.607988 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 800/1573] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 680 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:39.613419 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f9ba10ba-c915-49ae-b4c0-91c6dfda672f tempest-FloatingIPsTestJSON-688972376 tempest-FloatingIPsTestJSON-688972376-project] Calling method '.version_select at 0x7f1e5b7cc4c0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:39.727709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG neutronclient.v2_0.client [None req-f9ba10ba-c915-49ae-b4c0-91c6dfda672f tempest-FloatingIPsTestJSON-688972376 tempest-FloatingIPsTestJSON-688972376-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d32ccafc-70b4-4f2d-a06a-b9509035bb07 could not be found", "detail": ""}} {{(pid=131043) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 17:00:39.728719 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-f9ba10ba-c915-49ae-b4c0-91c6dfda672f tempest-FloatingIPsTestJSON-688972376 tempest-FloatingIPsTestJSON-688972376-project] HTTP exception thrown: Floating IP not found for ID d32ccafc-70b4-4f2d-a06a-b9509035bb07 Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f9ba10ba-c915-49ae-b4c0-91c6dfda672f tempest-FloatingIPsTestJSON-688972376 tempest-FloatingIPsTestJSON-688972376-project] Request method failure captured: Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/os-floating-ips/d32ccafc-70b4-4f2d-a06a-b9509035bb07 HTTP/1.1 Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_sbmWngvtt6MEOa-Ds5z2R4_0F0gfLj_wqTT7g8wRPag6nsbohrExlA_V8Oz6aq8k1YHo5SbzErJuJg4_RxMKX-rVI_g-EDJw-GdyHyqoFjir09zcyBtjoX5d9Jhyu0fqxDokQAmHyQAacg-3AuCum4_-_5Cnl9lFCdr8ZGYRwejJU Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 485b41000f3c4cd1895ada9b2988fafb Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-FloatingIPsTestJSON-688972376 Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/485b41000f3c4cd1895ada9b2988fafb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/485b41000f3c4cd1895ada9b2988fafb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_485b41000f3c4cd1895ada9b2988fafb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/485b41000f3c4cd1895ada9b2988fafb"}]}] Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-FloatingIPsTestJSON-688972376 Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 485b41000f3c4cd1895ada9b2988fafb Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-FloatingIPsTestJSON-688972376 Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-FloatingIPsTestJSON-688972376-project Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: a040d7ea5c604684b8c271484f664d3a Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-FloatingIPsTestJSON-688972376-project Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: exception: Floating IP not found for ID d32ccafc-70b4-4f2d-a06a-b9509035bb07 Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'd32ccafc-70b4-4f2d-a06a-b9509035bb07'} Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d32ccafc-70b4-4f2d-a06a-b9509035bb07 could not be found Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb6e9b46-cf7a-428e-91e7-1ab586609132'] Aug 04 17:00:39.731365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:00:39.735789 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:39.735789 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:00:39.735789 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:39.735789 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 04 17:00:39.735789 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 04 17:00:39.735789 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 04 17:00:39.735789 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 04 17:00:39.735789 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d32ccafc-70b4-4f2d-a06a-b9509035bb07. Aug 04 17:00:39.735789 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:00:39.735789 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:39.735789 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:00:39.735789 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:39.735789 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:39.735789 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:39.735789 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:00:39.735789 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:00:39.735789 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:00:39.735789 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:00:39.735789 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:00:39.735789 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:00:39.735789 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 04 17:00:39.735789 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 17:00:39.735789 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d32ccafc-70b4-4f2d-a06a-b9509035bb07 Aug 04 17:00:39.735789 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:00:39.735789 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:39.735789 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:00:39.735789 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:39.735789 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:39.735789 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:39.735789 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:00:39.735789 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:00:39.735789 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d32ccafc-70b4-4f2d-a06a-b9509035bb07 Aug 04 17:00:39.735789 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:00:39.742042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1b2d55fe-47d9-4eb3-892b-f04fbb860c69 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:39.743615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f9ba10ba-c915-49ae-b4c0-91c6dfda672f tempest-FloatingIPsTestJSON-688972376 tempest-FloatingIPsTestJSON-688972376-project] Returning 404 to user: Floating IP not found for ID d32ccafc-70b4-4f2d-a06a-b9509035bb07 {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:00:39.743615 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f9ba10ba-c915-49ae-b4c0-91c6dfda672f tempest-FloatingIPsTestJSON-688972376 tempest-FloatingIPsTestJSON-688972376-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/d32ccafc-70b4-4f2d-a06a-b9509035bb07" status: 404 len: 111 microversion: 2.1 time: 0.132113 Aug 04 17:00:39.743615 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 801/1574] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Aug 4 17:00:39 2022] DELETE /compute/v2.1/os-floating-ips/d32ccafc-70b4-4f2d-a06a-b9509035bb07 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:00:39.749886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-026b5b45-4cae-4d60-8c9b-b7dbab123f1f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:39.751202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-026b5b45-4cae-4d60-8c9b-b7dbab123f1f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:39.752324 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1b2d55fe-47d9-4eb3-892b-f04fbb860c69 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1461 microversion: 2.1 time: 0.364614 Aug 04 17:00:39.753102 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 774/1575] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:39 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1461 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:39.762848 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-026b5b45-4cae-4d60-8c9b-b7dbab123f1f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:39.763241 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-026b5b45-4cae-4d60-8c9b-b7dbab123f1f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:39.763788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-026b5b45-4cae-4d60-8c9b-b7dbab123f1f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:39.764651 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-026b5b45-4cae-4d60-8c9b-b7dbab123f1f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:39.765367 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-026b5b45-4cae-4d60-8c9b-b7dbab123f1f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:39.766237 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-026b5b45-4cae-4d60-8c9b-b7dbab123f1f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:39.770751 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-c1fe86f4-0880-48ce-8982-f82823ec69c7 req-ceb9d4ba-ef87-4be9-8f30-fbd2d20e884a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "332a6825-af0b-4bcd-92df-128b918d1a57", "name": "network-vif-plugged", "status": "completed", "tag": "0baa25b5-966d-4c17-abaf-1794a2778dc0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:39.807795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c1fe86f4-0880-48ce-8982-f82823ec69c7 req-ceb9d4ba-ef87-4be9-8f30-fbd2d20e884a service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:39.808285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c1fe86f4-0880-48ce-8982-f82823ec69c7 req-ceb9d4ba-ef87-4be9-8f30-fbd2d20e884a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:39.808721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c1fe86f4-0880-48ce-8982-f82823ec69c7 req-ceb9d4ba-ef87-4be9-8f30-fbd2d20e884a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:39.831478 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-c1fe86f4-0880-48ce-8982-f82823ec69c7 req-ceb9d4ba-ef87-4be9-8f30-fbd2d20e884a service nova] Creating event network-vif-plugged:0baa25b5-966d-4c17-abaf-1794a2778dc0 for instance 332a6825-af0b-4bcd-92df-128b918d1a57 on n-h1-851359-3 Aug 04 17:00:39.838803 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-c1fe86f4-0880-48ce-8982-f82823ec69c7 req-ceb9d4ba-ef87-4be9-8f30-fbd2d20e884a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084705 Aug 04 17:00:39.844377 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 775/1576] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:39.856650 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1ed62145-5396-45d5-9d67-1032247a3a31 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.108"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:40.209469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1ed62145-5396-45d5-9d67-1032247a3a31 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 79650928-e2ee-4928-8421-c0423298fdad] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:40.219253 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ed62145-5396-45d5-9d67-1032247a3a31 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:40.220594 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ed62145-5396-45d5-9d67-1032247a3a31 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:40.221251 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ed62145-5396-45d5-9d67-1032247a3a31 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:40.222908 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ed62145-5396-45d5-9d67-1032247a3a31 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:40.227468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ed62145-5396-45d5-9d67-1032247a3a31 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:40.228121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ed62145-5396-45d5-9d67-1032247a3a31 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:40.265764 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-026b5b45-4cae-4d60-8c9b-b7dbab123f1f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:40.283842 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-026b5b45-4cae-4d60-8c9b-b7dbab123f1f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:40.293144 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-026b5b45-4cae-4d60-8c9b-b7dbab123f1f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:40.295150 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-026b5b45-4cae-4d60-8c9b-b7dbab123f1f tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1875 microversion: 2.32 time: 0.549644 Aug 04 17:00:40.295886 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 802/1577] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:39 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1875 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:40.686019 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d76eeff3-1110-4139-8049-979e9d123620 tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:40.687077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d76eeff3-1110-4139-8049-979e9d123620 tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:40.697519 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d76eeff3-1110-4139-8049-979e9d123620 tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:40.698105 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d76eeff3-1110-4139-8049-979e9d123620 tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:40.698563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d76eeff3-1110-4139-8049-979e9d123620 tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:40.699292 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d76eeff3-1110-4139-8049-979e9d123620 tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:40.699759 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d76eeff3-1110-4139-8049-979e9d123620 tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:40.700196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d76eeff3-1110-4139-8049-979e9d123620 tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:41.032490 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-1ed62145-5396-45d5-9d67-1032247a3a31 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] HTTP exception thrown: Floating IP 172.25.9.108 is not associated with instance 07628113-e50c-4c63-bff3-0401009c87c8. Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1ed62145-5396-45d5-9d67-1032247a3a31 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Request method failure captured: Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8/action HTTP/1.1 Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 49 Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_rnHES_MWst1WXo_1XUJdaO_nmyJ0CPyBNTl2JIyP0Gg86LjCv6PPQ65sD1HuGK49uxmX7aq0siRxkSlVe0KF0dw7tW2qKp5CVHC3hR1waWCH3FFfNaXDMRUMlp2svVSme9vfcGnHDM3waAkVkQB6pnU45Lv6Z4EqCxzxMP2eOHLI4 Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 65efeb63178649a7bdc50a90cfc112e9 Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-37287949 Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/65efeb63178649a7bdc50a90cfc112e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/65efeb63178649a7bdc50a90cfc112e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_65efeb63178649a7bdc50a90cfc112e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/65efeb63178649a7bdc50a90cfc112e9"}]}] Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-37287949 Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 65efeb63178649a7bdc50a90cfc112e9 Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-37287949 Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-FloatingIPsAssociationTestJSON-37287949-project Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: df06c4b403cc4fe5b76915e685b7cef5 Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-37287949-project Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: {"removeFloatingIp": {"address": "172.25.9.108"}} Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: exception: Floating IP 172.25.9.108 is not associated with instance 07628113-e50c-4c63-bff3-0401009c87c8. Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '07628113-e50c-4c63-bff3-0401009c87c8', 'body': {'removeFloatingIp': {'address': '172.25.9.108'}}} Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.9.108 is not associated with instance 07628113-e50c-4c63-bff3-0401009c87c8. Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.9.108 is not associated with instance 07628113-e50c-4c63-bff3-0401009c87c8. Aug 04 17:00:41.040692 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:00:41.046502 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1ed62145-5396-45d5-9d67-1032247a3a31 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Returning 409 to user: Floating IP 172.25.9.108 is not associated with instance 07628113-e50c-4c63-bff3-0401009c87c8. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:00:41.047572 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1ed62145-5396-45d5-9d67-1032247a3a31 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "POST /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8/action" status: 409 len: 146 microversion: 2.1 time: 1.201599 Aug 04 17:00:41.048321 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 776/1578] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:00:39 2022] POST /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8/action => generated 146 bytes in 1203 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:00:41.059644 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3bd24ec0-fa4e-46c7-9803-f97eef7b451d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:41.064771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3bd24ec0-fa4e-46c7-9803-f97eef7b451d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:41.083835 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bd24ec0-fa4e-46c7-9803-f97eef7b451d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:41.085613 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bd24ec0-fa4e-46c7-9803-f97eef7b451d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:41.087713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bd24ec0-fa4e-46c7-9803-f97eef7b451d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:41.090211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bd24ec0-fa4e-46c7-9803-f97eef7b451d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:41.092027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bd24ec0-fa4e-46c7-9803-f97eef7b451d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:41.095317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bd24ec0-fa4e-46c7-9803-f97eef7b451d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:41.413215 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d76eeff3-1110-4139-8049-979e9d123620 tempest-MigrationsAdminTest-874568950 tempest-MigrationsAdminTest-874568950-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1612 microversion: 2.1 time: 1.116080 Aug 04 17:00:41.421492 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 803/1579] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:40 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1612 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:41.426633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7c489105-5d44-419a-a3de-fa528d4b4844 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:41.436063 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7c489105-5d44-419a-a3de-fa528d4b4844 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:41.438367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3bd24ec0-fa4e-46c7-9803-f97eef7b451d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:41.452573 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c489105-5d44-419a-a3de-fa528d4b4844 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:41.453569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3bd24ec0-fa4e-46c7-9803-f97eef7b451d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:41.456534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c489105-5d44-419a-a3de-fa528d4b4844 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:41.456796 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3bd24ec0-fa4e-46c7-9803-f97eef7b451d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:41.456997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c489105-5d44-419a-a3de-fa528d4b4844 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:41.460198 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3bd24ec0-fa4e-46c7-9803-f97eef7b451d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 1810 microversion: 2.25 time: 0.410042 Aug 04 17:00:41.461351 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c489105-5d44-419a-a3de-fa528d4b4844 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:41.461885 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c489105-5d44-419a-a3de-fa528d4b4844 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:41.462366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c489105-5d44-419a-a3de-fa528d4b4844 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:41.463720 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 777/1580] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:41 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 1810 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:41.469087 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e7343fd1-5978-4952-a93a-50615d156dad tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.108"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:41.536794 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7c489105-5d44-419a-a3de-fa528d4b4844 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111638 Aug 04 17:00:41.539037 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 804/1581] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:00:41 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:41.545256 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dddc4db0-935e-4b28-9ca1-492a904ff3b6 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:41.546158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dddc4db0-935e-4b28-9ca1-492a904ff3b6 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:41.554024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dddc4db0-935e-4b28-9ca1-492a904ff3b6 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:41.554513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dddc4db0-935e-4b28-9ca1-492a904ff3b6 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:41.555153 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dddc4db0-935e-4b28-9ca1-492a904ff3b6 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:41.556316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dddc4db0-935e-4b28-9ca1-492a904ff3b6 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:41.557253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dddc4db0-935e-4b28-9ca1-492a904ff3b6 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:41.557785 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dddc4db0-935e-4b28-9ca1-492a904ff3b6 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:41.942232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e7343fd1-5978-4952-a93a-50615d156dad tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 79650928-e2ee-4928-8421-c0423298fdad] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:41.949948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7343fd1-5978-4952-a93a-50615d156dad tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:41.951506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7343fd1-5978-4952-a93a-50615d156dad tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:41.952155 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7343fd1-5978-4952-a93a-50615d156dad tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:41.956468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7343fd1-5978-4952-a93a-50615d156dad tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:41.957251 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7343fd1-5978-4952-a93a-50615d156dad tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:41.958487 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7343fd1-5978-4952-a93a-50615d156dad tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:42.163376 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dddc4db0-935e-4b28-9ca1-492a904ff3b6 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:42.182348 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dddc4db0-935e-4b28-9ca1-492a904ff3b6 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:42.185003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dddc4db0-935e-4b28-9ca1-492a904ff3b6 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:42.187098 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dddc4db0-935e-4b28-9ca1-492a904ff3b6 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1875 microversion: 2.32 time: 0.646252 Aug 04 17:00:42.187686 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 805/1582] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:41 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1875 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:42.192324 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-032f8a0a-19e5-4e7f-bb8d-3672a33342b4 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:42.192827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-032f8a0a-19e5-4e7f-bb8d-3672a33342b4 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:42.215754 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-032f8a0a-19e5-4e7f-bb8d-3672a33342b4 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:42.217808 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-032f8a0a-19e5-4e7f-bb8d-3672a33342b4 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:42.219018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-032f8a0a-19e5-4e7f-bb8d-3672a33342b4 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:42.222063 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-032f8a0a-19e5-4e7f-bb8d-3672a33342b4 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:42.223891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-032f8a0a-19e5-4e7f-bb8d-3672a33342b4 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:42.224526 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-032f8a0a-19e5-4e7f-bb8d-3672a33342b4 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:42.288068 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-032f8a0a-19e5-4e7f-bb8d-3672a33342b4 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:00:42.391107 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-032f8a0a-19e5-4e7f-bb8d-3672a33342b4 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "DELETE /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 204 len: 0 microversion: 2.1 time: 0.202020 Aug 04 17:00:42.392648 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 806/1583] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:00:42 2022] DELETE /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:00:42.404368 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a021a0af-2ca8-4a40-8b92-54e2a3dd174a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:42.405149 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a021a0af-2ca8-4a40-8b92-54e2a3dd174a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:42.413426 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a021a0af-2ca8-4a40-8b92-54e2a3dd174a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:42.414183 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a021a0af-2ca8-4a40-8b92-54e2a3dd174a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:42.414795 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a021a0af-2ca8-4a40-8b92-54e2a3dd174a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:42.415770 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a021a0af-2ca8-4a40-8b92-54e2a3dd174a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:42.416448 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a021a0af-2ca8-4a40-8b92-54e2a3dd174a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:42.417587 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a021a0af-2ca8-4a40-8b92-54e2a3dd174a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:42.590360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7343fd1-5978-4952-a93a-50615d156dad tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "refresh_cache-79650928-e2ee-4928-8421-c0423298fdad" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 04 17:00:42.591343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7343fd1-5978-4952-a93a-50615d156dad tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquired lock "refresh_cache-79650928-e2ee-4928-8421-c0423298fdad" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 04 17:00:42.812513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a021a0af-2ca8-4a40-8b92-54e2a3dd174a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:42.821301 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a021a0af-2ca8-4a40-8b92-54e2a3dd174a tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1467 microversion: 2.1 time: 0.421635 Aug 04 17:00:42.826752 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 807/1584] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:42 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1467 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:42.844316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-25fe6525-8c6a-4721-9fc3-d047ef68967f req-082d97a1-1d88-4641-aca0-4e150c9f7d7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afea0f77-8d91-4170-934f-b6b7ef64d5a6", "name": "network-vif-unplugged", "status": "completed", "tag": "9e2d842c-859e-4f10-8b78-924c2156cf47"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:42.861210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-25fe6525-8c6a-4721-9fc3-d047ef68967f req-082d97a1-1d88-4641-aca0-4e150c9f7d7e service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:42.865094 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-25fe6525-8c6a-4721-9fc3-d047ef68967f req-082d97a1-1d88-4641-aca0-4e150c9f7d7e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:42.865725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-25fe6525-8c6a-4721-9fc3-d047ef68967f req-082d97a1-1d88-4641-aca0-4e150c9f7d7e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:42.887663 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-25fe6525-8c6a-4721-9fc3-d047ef68967f req-082d97a1-1d88-4641-aca0-4e150c9f7d7e service nova] Creating event network-vif-unplugged:9e2d842c-859e-4f10-8b78-924c2156cf47 for instance afea0f77-8d91-4170-934f-b6b7ef64d5a6 on n-h1-851359-3 Aug 04 17:00:42.906719 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-25fe6525-8c6a-4721-9fc3-d047ef68967f req-082d97a1-1d88-4641-aca0-4e150c9f7d7e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078446 Aug 04 17:00:42.907580 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 808/1585] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:42.913713 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-60e89172-6191-425c-a068-570d15358f4e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:42.919564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-60e89172-6191-425c-a068-570d15358f4e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:42.932063 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60e89172-6191-425c-a068-570d15358f4e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:42.938263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60e89172-6191-425c-a068-570d15358f4e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:42.938969 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60e89172-6191-425c-a068-570d15358f4e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:42.939930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60e89172-6191-425c-a068-570d15358f4e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:42.940573 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60e89172-6191-425c-a068-570d15358f4e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:42.946322 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60e89172-6191-425c-a068-570d15358f4e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:44.056153 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-60e89172-6191-425c-a068-570d15358f4e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:44.070485 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-60e89172-6191-425c-a068-570d15358f4e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:44.074201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-60e89172-6191-425c-a068-570d15358f4e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:44.075726 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-60e89172-6191-425c-a068-570d15358f4e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 1810 microversion: 2.25 time: 1.166864 Aug 04 17:00:44.092011 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 809/1586] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:42 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 1810 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:44.101547 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e789036e-00c8-4beb-9a0c-103ed27274ec tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:44.105336 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e789036e-00c8-4beb-9a0c-103ed27274ec tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:44.131196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e789036e-00c8-4beb-9a0c-103ed27274ec tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:44.132953 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e789036e-00c8-4beb-9a0c-103ed27274ec tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:44.135028 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e789036e-00c8-4beb-9a0c-103ed27274ec tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:44.137787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e789036e-00c8-4beb-9a0c-103ed27274ec tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:44.140545 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e789036e-00c8-4beb-9a0c-103ed27274ec tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:44.142477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e789036e-00c8-4beb-9a0c-103ed27274ec tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:44.181830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:44.206644 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e789036e-00c8-4beb-9a0c-103ed27274ec tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112688 Aug 04 17:00:44.213399 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 810/1587] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:00:44 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:44.220800 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-73fd5e58-00ea-4071-8a72-af2a3b998759 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:44.222231 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-73fd5e58-00ea-4071-8a72-af2a3b998759 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:44.235401 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73fd5e58-00ea-4071-8a72-af2a3b998759 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:44.236279 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73fd5e58-00ea-4071-8a72-af2a3b998759 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:44.236966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73fd5e58-00ea-4071-8a72-af2a3b998759 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:44.237926 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73fd5e58-00ea-4071-8a72-af2a3b998759 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:44.238644 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73fd5e58-00ea-4071-8a72-af2a3b998759 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:44.239973 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73fd5e58-00ea-4071-8a72-af2a3b998759 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:44.844736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-73fd5e58-00ea-4071-8a72-af2a3b998759 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:44.858469 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-73fd5e58-00ea-4071-8a72-af2a3b998759 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:44.860008 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-73fd5e58-00ea-4071-8a72-af2a3b998759 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:44.866319 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-73fd5e58-00ea-4071-8a72-af2a3b998759 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1875 microversion: 2.32 time: 0.651036 Aug 04 17:00:44.871865 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 811/1588] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:44 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1875 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:44.876689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b98ec91a-4d71-4f03-906e-7a2f8ad3f117 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:44.877318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b98ec91a-4d71-4f03-906e-7a2f8ad3f117 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:44.894685 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b98ec91a-4d71-4f03-906e-7a2f8ad3f117 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:44.895367 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b98ec91a-4d71-4f03-906e-7a2f8ad3f117 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:44.895829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b98ec91a-4d71-4f03-906e-7a2f8ad3f117 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:44.896564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b98ec91a-4d71-4f03-906e-7a2f8ad3f117 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:44.901753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b98ec91a-4d71-4f03-906e-7a2f8ad3f117 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:44.902321 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b98ec91a-4d71-4f03-906e-7a2f8ad3f117 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:45.471056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b98ec91a-4d71-4f03-906e-7a2f8ad3f117 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:45.483424 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b98ec91a-4d71-4f03-906e-7a2f8ad3f117 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 200 len: 1467 microversion: 2.1 time: 0.610378 Aug 04 17:00:45.484829 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 812/1589] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:44 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 1467 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:45.500436 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-4cfee384-0343-4ee8-b0ff-c5a3ff81d40f req-30ad0b88-5df8-4286-b56f-4fec3dade944 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afea0f77-8d91-4170-934f-b6b7ef64d5a6", "tag": "9e2d842c-859e-4f10-8b78-924c2156cf47"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:45.529372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-4cfee384-0343-4ee8-b0ff-c5a3ff81d40f req-30ad0b88-5df8-4286-b56f-4fec3dade944 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:45.530366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-4cfee384-0343-4ee8-b0ff-c5a3ff81d40f req-30ad0b88-5df8-4286-b56f-4fec3dade944 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:45.533891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-4cfee384-0343-4ee8-b0ff-c5a3ff81d40f req-30ad0b88-5df8-4286-b56f-4fec3dade944 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:45.564515 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-4cfee384-0343-4ee8-b0ff-c5a3ff81d40f req-30ad0b88-5df8-4286-b56f-4fec3dade944 service nova] Creating event network-changed:9e2d842c-859e-4f10-8b78-924c2156cf47 for instance afea0f77-8d91-4170-934f-b6b7ef64d5a6 on n-h1-851359-3 Aug 04 17:00:45.587881 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-4cfee384-0343-4ee8-b0ff-c5a3ff81d40f req-30ad0b88-5df8-4286-b56f-4fec3dade944 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100484 Aug 04 17:00:45.593294 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 813/1590] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:45.612154 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3be1ce0d-d5a2-4ead-a8e3-b3b35080fea8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:45.612154 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3be1ce0d-d5a2-4ead-a8e3-b3b35080fea8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:45.612154 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3be1ce0d-d5a2-4ead-a8e3-b3b35080fea8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:45.612154 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3be1ce0d-d5a2-4ead-a8e3-b3b35080fea8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:45.612154 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3be1ce0d-d5a2-4ead-a8e3-b3b35080fea8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:45.612154 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3be1ce0d-d5a2-4ead-a8e3-b3b35080fea8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:45.612154 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3be1ce0d-d5a2-4ead-a8e3-b3b35080fea8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:45.613140 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3be1ce0d-d5a2-4ead-a8e3-b3b35080fea8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:46.556509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3be1ce0d-d5a2-4ead-a8e3-b3b35080fea8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:46.577302 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3be1ce0d-d5a2-4ead-a8e3-b3b35080fea8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:46.578979 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3be1ce0d-d5a2-4ead-a8e3-b3b35080fea8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:46.610702 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3be1ce0d-d5a2-4ead-a8e3-b3b35080fea8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 1810 microversion: 2.25 time: 1.016741 Aug 04 17:00:46.624614 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 814/1591] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:45 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 1810 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:46.624891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-e7343fd1-5978-4952-a93a-50615d156dad tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 79650928-e2ee-4928-8421-c0423298fdad] Building network info cache for instance {{(pid=131044) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 17:00:46.626910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2924c64c-d7d8-433c-b8d4-9dc81d6d079d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:46.629260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2924c64c-d7d8-433c-b8d4-9dc81d6d079d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:46.647455 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2924c64c-d7d8-433c-b8d4-9dc81d6d079d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:46.648217 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2924c64c-d7d8-433c-b8d4-9dc81d6d079d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:46.648726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2924c64c-d7d8-433c-b8d4-9dc81d6d079d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:46.649512 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2924c64c-d7d8-433c-b8d4-9dc81d6d079d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:46.650044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2924c64c-d7d8-433c-b8d4-9dc81d6d079d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:46.650478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2924c64c-d7d8-433c-b8d4-9dc81d6d079d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:46.733857 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2924c64c-d7d8-433c-b8d4-9dc81d6d079d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.120979 Aug 04 17:00:46.753214 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 815/1592] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:00:46 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb/os-volume_attachments => generated 25 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:00:46.758729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a197c04b-76df-496c-9557-7683c16c53ee tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:46.759974 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a197c04b-76df-496c-9557-7683c16c53ee tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:46.774459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a197c04b-76df-496c-9557-7683c16c53ee tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:46.775679 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a197c04b-76df-496c-9557-7683c16c53ee tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:46.776163 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a197c04b-76df-496c-9557-7683c16c53ee tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:46.776916 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a197c04b-76df-496c-9557-7683c16c53ee tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:46.777388 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a197c04b-76df-496c-9557-7683c16c53ee tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:46.777824 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a197c04b-76df-496c-9557-7683c16c53ee tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:48.057917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a197c04b-76df-496c-9557-7683c16c53ee tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:48.088619 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a197c04b-76df-496c-9557-7683c16c53ee tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:48.093552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a197c04b-76df-496c-9557-7683c16c53ee tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:48.095428 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a197c04b-76df-496c-9557-7683c16c53ee tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1875 microversion: 2.32 time: 1.340770 Aug 04 17:00:48.096231 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 816/1593] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:46 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1875 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:48.102740 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7b2bd77f-7cd6-4018-898d-219e07ba9e52 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:48.103554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7b2bd77f-7cd6-4018-898d-219e07ba9e52 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 332a6825-af0b-4bcd-92df-128b918d1a57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:48.112378 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b2bd77f-7cd6-4018-898d-219e07ba9e52 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:48.112889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b2bd77f-7cd6-4018-898d-219e07ba9e52 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:48.113337 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b2bd77f-7cd6-4018-898d-219e07ba9e52 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:48.115362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b2bd77f-7cd6-4018-898d-219e07ba9e52 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:48.115843 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b2bd77f-7cd6-4018-898d-219e07ba9e52 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:48.117617 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b2bd77f-7cd6-4018-898d-219e07ba9e52 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:48.152487 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-7b2bd77f-7cd6-4018-898d-219e07ba9e52 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] HTTP exception thrown: Instance 332a6825-af0b-4bcd-92df-128b918d1a57 could not be found. Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7b2bd77f-7cd6-4018-898d-219e07ba9e52 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Request method failure captured: Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 HTTP/1.1 Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_nr6TM3VDFE0-a7GjdiPSkulOf76f1c2TbMoDiupaK9Lm5BhPfOeB57S5f3P9qy6YnDYHcKeg0lfdcHN3-0oPuIBLHcgZhXXL7A_HDfLwIpPHXCuAHrcjdKo53PMyOZ9qRxp28gZSglpaT-ZejdPX9f_LNrtsS6BL7HFdN-3zw1bXU Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 6f64e49086c94f65ba1fc2ef97b6bcde Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-MigrationsAdminTest-207825081 Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6f64e49086c94f65ba1fc2ef97b6bcde"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6f64e49086c94f65ba1fc2ef97b6bcde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6f64e49086c94f65ba1fc2ef97b6bcde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6f64e49086c94f65ba1fc2ef97b6bcde"}]}] Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-MigrationsAdminTest-207825081 Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 6f64e49086c94f65ba1fc2ef97b6bcde Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-MigrationsAdminTest-207825081 Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-MigrationsAdminTest-207825081-project Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 655795644d9941c99a82d15d9daa5ab5 Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-MigrationsAdminTest-207825081-project Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 332a6825-af0b-4bcd-92df-128b918d1a57 could not be found. Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '332a6825-af0b-4bcd-92df-128b918d1a57'} Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 332a6825-af0b-4bcd-92df-128b918d1a57 could not be found. Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 332a6825-af0b-4bcd-92df-128b918d1a57 could not be found. Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:00:48.155057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:00:48.160911 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:00:48.160911 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:00:48.160911 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:00:48.160911 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:00:48.160911 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:00:48.160911 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 332a6825-af0b-4bcd-92df-128b918d1a57 could not be found. Aug 04 17:00:48.160911 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:00:48.160911 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7b2bd77f-7cd6-4018-898d-219e07ba9e52 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Returning 404 to user: Instance 332a6825-af0b-4bcd-92df-128b918d1a57 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:00:48.160911 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7b2bd77f-7cd6-4018-898d-219e07ba9e52 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57" status: 404 len: 111 microversion: 2.1 time: 0.059343 Aug 04 17:00:48.165139 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 817/1594] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:48 2022] GET /compute/v2.1/servers/332a6825-af0b-4bcd-92df-128b918d1a57 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:00:48.173481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-48a100c6-fd56-455d-821d-068afb1a66b7 req-59df2d74-0d1e-4a97-9450-08523f0db22f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79650928-e2ee-4928-8421-c0423298fdad", "tag": "13e6f1d8-988c-49db-899d-d36204677383"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:48.197658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-48a100c6-fd56-455d-821d-068afb1a66b7 req-59df2d74-0d1e-4a97-9450-08523f0db22f service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:48.198836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-48a100c6-fd56-455d-821d-068afb1a66b7 req-59df2d74-0d1e-4a97-9450-08523f0db22f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:48.200228 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-48a100c6-fd56-455d-821d-068afb1a66b7 req-59df2d74-0d1e-4a97-9450-08523f0db22f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:48.227134 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-48a100c6-fd56-455d-821d-068afb1a66b7 req-59df2d74-0d1e-4a97-9450-08523f0db22f service nova] Creating event network-changed:13e6f1d8-988c-49db-899d-d36204677383 for instance 79650928-e2ee-4928-8421-c0423298fdad on n-h2-851359-3 Aug 04 17:00:48.237028 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-48a100c6-fd56-455d-821d-068afb1a66b7 req-59df2d74-0d1e-4a97-9450-08523f0db22f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070879 Aug 04 17:00:48.239606 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 818/1595] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:48.247971 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0b826c95-0686-42c2-9e4c-81e1b433481d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:48.248695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0b826c95-0686-42c2-9e4c-81e1b433481d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:48.268051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b826c95-0686-42c2-9e4c-81e1b433481d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:48.268570 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b826c95-0686-42c2-9e4c-81e1b433481d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:48.269020 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b826c95-0686-42c2-9e4c-81e1b433481d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:48.269751 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b826c95-0686-42c2-9e4c-81e1b433481d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:48.272085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b826c95-0686-42c2-9e4c-81e1b433481d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:48.276148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b826c95-0686-42c2-9e4c-81e1b433481d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:49.676065 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-e7343fd1-5978-4952-a93a-50615d156dad tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 79650928-e2ee-4928-8421-c0423298fdad] Updating instance_info_cache with network_info: [{"id": "13e6f1d8-988c-49db-899d-d36204677383", "address": "fa:16:3e:96:76:15", "network": {"id": "fcf929f8-72e5-4701-9267-5cd4fba70ec8", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1970989112-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "65efeb63178649a7bdc50a90cfc112e9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap13e6f1d8-98", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131044) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 17:00:49.690021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7343fd1-5978-4952-a93a-50615d156dad tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Releasing lock "refresh_cache-79650928-e2ee-4928-8421-c0423298fdad" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 04 17:00:49.701609 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e7343fd1-5978-4952-a93a-50615d156dad tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "POST /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad/action" status: 202 len: 0 microversion: 2.1 time: 8.226124 Aug 04 17:00:49.702484 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 778/1596] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:00:41 2022] POST /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad/action => generated 0 bytes in 8238 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 04 17:00:49.709219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-288d923b-c9e8-4157-a2a3-cbc6c4a228ce req-06894862-31a8-4856-b187-381f489181d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "332a6825-af0b-4bcd-92df-128b918d1a57", "name": "network-vif-deleted", "tag": "0baa25b5-966d-4c17-abaf-1794a2778dc0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:49.724721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-288d923b-c9e8-4157-a2a3-cbc6c4a228ce req-06894862-31a8-4856-b187-381f489181d0 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:49.725226 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-288d923b-c9e8-4157-a2a3-cbc6c4a228ce req-06894862-31a8-4856-b187-381f489181d0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:49.725664 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-288d923b-c9e8-4157-a2a3-cbc6c4a228ce req-06894862-31a8-4856-b187-381f489181d0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:49.743072 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-288d923b-c9e8-4157-a2a3-cbc6c4a228ce req-06894862-31a8-4856-b187-381f489181d0 service nova] Creating event network-vif-deleted:0baa25b5-966d-4c17-abaf-1794a2778dc0 for instance 332a6825-af0b-4bcd-92df-128b918d1a57 on n-h1-851359-3 Aug 04 17:00:49.750451 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-288d923b-c9e8-4157-a2a3-cbc6c4a228ce req-06894862-31a8-4856-b187-381f489181d0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046459 Aug 04 17:00:49.758746 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0b826c95-0686-42c2-9e4c-81e1b433481d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:49.763615 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 779/1597] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:49.778872 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0b826c95-0686-42c2-9e4c-81e1b433481d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:49.783240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0b826c95-0686-42c2-9e4c-81e1b433481d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:49.787108 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0b826c95-0686-42c2-9e4c-81e1b433481d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 1810 microversion: 2.25 time: 1.546000 Aug 04 17:00:49.788038 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 819/1598] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:48 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 1810 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:49.788321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8135696e-bcb7-48fb-97b7-5579cd8615fb tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:49.789122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8135696e-bcb7-48fb-97b7-5579cd8615fb tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:49.799524 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8135696e-bcb7-48fb-97b7-5579cd8615fb tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:49.800531 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8135696e-bcb7-48fb-97b7-5579cd8615fb tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:49.801245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8135696e-bcb7-48fb-97b7-5579cd8615fb tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:49.806154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8135696e-bcb7-48fb-97b7-5579cd8615fb tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:49.809819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8135696e-bcb7-48fb-97b7-5579cd8615fb tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:49.810846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8ee17265-b021-4491-b329-909b81bcfca0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:49.812080 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8ee17265-b021-4491-b329-909b81bcfca0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:49.812741 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8135696e-bcb7-48fb-97b7-5579cd8615fb tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:49.833042 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ee17265-b021-4491-b329-909b81bcfca0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:49.833838 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ee17265-b021-4491-b329-909b81bcfca0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:49.834807 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ee17265-b021-4491-b329-909b81bcfca0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:49.836077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ee17265-b021-4491-b329-909b81bcfca0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:49.836779 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ee17265-b021-4491-b329-909b81bcfca0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:49.837433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ee17265-b021-4491-b329-909b81bcfca0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:49.889878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8135696e-bcb7-48fb-97b7-5579cd8615fb tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:00:50.096812 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8135696e-bcb7-48fb-97b7-5579cd8615fb tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "DELETE /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 204 len: 0 microversion: 2.1 time: 0.322722 Aug 04 17:00:50.101728 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 780/1599] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:00:49 2022] DELETE /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:00:50.113292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0bcf9a04-401a-40d9-8730-db9781d67c00 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:50.115420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0bcf9a04-401a-40d9-8730-db9781d67c00 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 79650928-e2ee-4928-8421-c0423298fdad] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:50.133131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bcf9a04-401a-40d9-8730-db9781d67c00 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:50.135642 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bcf9a04-401a-40d9-8730-db9781d67c00 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:50.136912 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bcf9a04-401a-40d9-8730-db9781d67c00 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:50.138698 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bcf9a04-401a-40d9-8730-db9781d67c00 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:50.140043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bcf9a04-401a-40d9-8730-db9781d67c00 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:50.141307 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bcf9a04-401a-40d9-8730-db9781d67c00 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:50.160227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8ee17265-b021-4491-b329-909b81bcfca0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:50.175001 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8ee17265-b021-4491-b329-909b81bcfca0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:50.177010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8ee17265-b021-4491-b329-909b81bcfca0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:50.179847 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8ee17265-b021-4491-b329-909b81bcfca0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1875 microversion: 2.32 time: 0.375331 Aug 04 17:00:50.200600 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 820/1600] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:49 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1875 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:50.206629 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0bcf9a04-401a-40d9-8730-db9781d67c00 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 79650928-e2ee-4928-8421-c0423298fdad] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:00:50.212224 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-967b3764-5ac7-4a28-bd31-7ff24d080543 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:50.213307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-967b3764-5ac7-4a28-bd31-7ff24d080543 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:50.246286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-967b3764-5ac7-4a28-bd31-7ff24d080543 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:50.246828 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-967b3764-5ac7-4a28-bd31-7ff24d080543 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:50.247284 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-967b3764-5ac7-4a28-bd31-7ff24d080543 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:50.248029 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-967b3764-5ac7-4a28-bd31-7ff24d080543 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:50.256157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-967b3764-5ac7-4a28-bd31-7ff24d080543 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:50.256717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-967b3764-5ac7-4a28-bd31-7ff24d080543 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:50.342547 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0bcf9a04-401a-40d9-8730-db9781d67c00 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "DELETE /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad" status: 204 len: 0 microversion: 2.1 time: 0.229345 Aug 04 17:00:50.342547 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 781/1601] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:00:50 2022] DELETE /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:00:50.366539 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-141772f0-796b-42bd-ba28-8d111b9f91ae tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.108"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:50.369276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-141772f0-796b-42bd-ba28-8d111b9f91ae tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:50.381342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-141772f0-796b-42bd-ba28-8d111b9f91ae tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:50.382129 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-141772f0-796b-42bd-ba28-8d111b9f91ae tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:50.382771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-141772f0-796b-42bd-ba28-8d111b9f91ae tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:50.383685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-141772f0-796b-42bd-ba28-8d111b9f91ae tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:50.384341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-141772f0-796b-42bd-ba28-8d111b9f91ae tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:50.384944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-141772f0-796b-42bd-ba28-8d111b9f91ae tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:50.418318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-141772f0-796b-42bd-ba28-8d111b9f91ae tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "refresh_cache-07628113-e50c-4c63-bff3-0401009c87c8" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 04 17:00:50.418979 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-141772f0-796b-42bd-ba28-8d111b9f91ae tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquired lock "refresh_cache-07628113-e50c-4c63-bff3-0401009c87c8" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 04 17:00:50.679359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-967b3764-5ac7-4a28-bd31-7ff24d080543 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:50.706673 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-967b3764-5ac7-4a28-bd31-7ff24d080543 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1534 microversion: 2.1 time: 0.496449 Aug 04 17:00:50.707573 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 821/1602] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:50 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1534 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:50.814756 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2252ca09-b7d0-49d4-ab03-e70a017f8690 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:50.817641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2252ca09-b7d0-49d4-ab03-e70a017f8690 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:50.827710 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2252ca09-b7d0-49d4-ab03-e70a017f8690 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:50.828508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2252ca09-b7d0-49d4-ab03-e70a017f8690 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:50.829152 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2252ca09-b7d0-49d4-ab03-e70a017f8690 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:50.830438 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2252ca09-b7d0-49d4-ab03-e70a017f8690 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:50.831088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2252ca09-b7d0-49d4-ab03-e70a017f8690 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:50.831742 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2252ca09-b7d0-49d4-ab03-e70a017f8690 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:51.302643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2252ca09-b7d0-49d4-ab03-e70a017f8690 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:51.313020 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2252ca09-b7d0-49d4-ab03-e70a017f8690 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:51.314930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2252ca09-b7d0-49d4-ab03-e70a017f8690 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:51.316663 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2252ca09-b7d0-49d4-ab03-e70a017f8690 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 1810 microversion: 2.25 time: 0.506178 Aug 04 17:00:51.320062 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 822/1603] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:50 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 1810 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:00:51.325003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a6f57d23-d1fe-414e-ae7c-45d020bf921e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:51.325631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a6f57d23-d1fe-414e-ae7c-45d020bf921e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:51.332261 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6f57d23-d1fe-414e-ae7c-45d020bf921e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:51.333060 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6f57d23-d1fe-414e-ae7c-45d020bf921e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:51.333702 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6f57d23-d1fe-414e-ae7c-45d020bf921e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:51.334689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6f57d23-d1fe-414e-ae7c-45d020bf921e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:51.335350 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6f57d23-d1fe-414e-ae7c-45d020bf921e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:51.335958 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6f57d23-d1fe-414e-ae7c-45d020bf921e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:51.885674 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a6f57d23-d1fe-414e-ae7c-45d020bf921e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:51.903242 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a6f57d23-d1fe-414e-ae7c-45d020bf921e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:51.907853 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a6f57d23-d1fe-414e-ae7c-45d020bf921e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:51.912261 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a6f57d23-d1fe-414e-ae7c-45d020bf921e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1875 microversion: 2.32 time: 0.591063 Aug 04 17:00:51.915779 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 823/1604] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:51 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1875 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:51.931121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-189188b6-6c7b-4efb-82cc-376aab82f4aa tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:51.932621 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-189188b6-6c7b-4efb-82cc-376aab82f4aa tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:51.945857 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:51.951181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-189188b6-6c7b-4efb-82cc-376aab82f4aa tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:51.953799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-189188b6-6c7b-4efb-82cc-376aab82f4aa tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:51.954547 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-189188b6-6c7b-4efb-82cc-376aab82f4aa tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:51.958744 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-189188b6-6c7b-4efb-82cc-376aab82f4aa tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:51.960370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-189188b6-6c7b-4efb-82cc-376aab82f4aa tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:51.961044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-189188b6-6c7b-4efb-82cc-376aab82f4aa tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:52.377707 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-189188b6-6c7b-4efb-82cc-376aab82f4aa tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:52.399729 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-189188b6-6c7b-4efb-82cc-376aab82f4aa tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1534 microversion: 2.1 time: 0.479420 Aug 04 17:00:52.404956 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 824/1605] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:51 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1534 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:52.414568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bc520799-db75-4cda-8ee8-fb96132f6f33 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:52.416824 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bc520799-db75-4cda-8ee8-fb96132f6f33 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:52.437845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc520799-db75-4cda-8ee8-fb96132f6f33 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:52.439289 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc520799-db75-4cda-8ee8-fb96132f6f33 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:52.448996 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc520799-db75-4cda-8ee8-fb96132f6f33 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:52.450229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc520799-db75-4cda-8ee8-fb96132f6f33 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:52.450958 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc520799-db75-4cda-8ee8-fb96132f6f33 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:52.451591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc520799-db75-4cda-8ee8-fb96132f6f33 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:52.716814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bc520799-db75-4cda-8ee8-fb96132f6f33 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:52.726501 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bc520799-db75-4cda-8ee8-fb96132f6f33 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:52.733482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bc520799-db75-4cda-8ee8-fb96132f6f33 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:52.734708 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bc520799-db75-4cda-8ee8-fb96132f6f33 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 1810 microversion: 2.25 time: 0.326068 Aug 04 17:00:52.735283 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 825/1606] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:52 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 1810 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:52.871364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-141772f0-796b-42bd-ba28-8d111b9f91ae tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Building network info cache for instance {{(pid=131044) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 17:00:52.898406 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-9d58b261-b3c9-4a66-8e20-2f4b10fc5a20 req-fdccdd3c-77fa-4325-952f-f4ddae6c139d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07628113-e50c-4c63-bff3-0401009c87c8", "tag": "a6e94576-42ff-4f94-90f7-18335cd81c04"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:52.920140 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9d58b261-b3c9-4a66-8e20-2f4b10fc5a20 req-fdccdd3c-77fa-4325-952f-f4ddae6c139d service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:52.920629 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9d58b261-b3c9-4a66-8e20-2f4b10fc5a20 req-fdccdd3c-77fa-4325-952f-f4ddae6c139d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:52.921801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9d58b261-b3c9-4a66-8e20-2f4b10fc5a20 req-fdccdd3c-77fa-4325-952f-f4ddae6c139d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:52.950726 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-9d58b261-b3c9-4a66-8e20-2f4b10fc5a20 req-fdccdd3c-77fa-4325-952f-f4ddae6c139d service nova] Creating event network-changed:a6e94576-42ff-4f94-90f7-18335cd81c04 for instance 07628113-e50c-4c63-bff3-0401009c87c8 on n-h1-851359-3 Aug 04 17:00:52.966041 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-9d58b261-b3c9-4a66-8e20-2f4b10fc5a20 req-fdccdd3c-77fa-4325-952f-f4ddae6c139d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073169 Aug 04 17:00:52.966920 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 826/1607] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:00:52.975591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-87fa68d2-0137-4524-aa57-3f49d00f24f9 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:52.978892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-87fa68d2-0137-4524-aa57-3f49d00f24f9 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:52.992044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87fa68d2-0137-4524-aa57-3f49d00f24f9 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:52.994628 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87fa68d2-0137-4524-aa57-3f49d00f24f9 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:52.995281 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87fa68d2-0137-4524-aa57-3f49d00f24f9 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:52.996883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87fa68d2-0137-4524-aa57-3f49d00f24f9 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:53.001243 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87fa68d2-0137-4524-aa57-3f49d00f24f9 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:53.001880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87fa68d2-0137-4524-aa57-3f49d00f24f9 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:53.846849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-87fa68d2-0137-4524-aa57-3f49d00f24f9 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:53.863316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-87fa68d2-0137-4524-aa57-3f49d00f24f9 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:53.866970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-87fa68d2-0137-4524-aa57-3f49d00f24f9 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:53.881273 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-87fa68d2-0137-4524-aa57-3f49d00f24f9 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1875 microversion: 2.32 time: 0.912545 Aug 04 17:00:53.883309 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 827/1608] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:52 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1875 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:53.888268 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8a846f4c-c1ab-4c3b-b103-52fb67a2c3b9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:53.898231 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8a846f4c-c1ab-4c3b-b103-52fb67a2c3b9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:53.912312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a846f4c-c1ab-4c3b-b103-52fb67a2c3b9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:53.917439 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a846f4c-c1ab-4c3b-b103-52fb67a2c3b9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:53.918159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a846f4c-c1ab-4c3b-b103-52fb67a2c3b9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:53.919119 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a846f4c-c1ab-4c3b-b103-52fb67a2c3b9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:53.919757 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a846f4c-c1ab-4c3b-b103-52fb67a2c3b9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:53.931009 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a846f4c-c1ab-4c3b-b103-52fb67a2c3b9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:54.172464 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-141772f0-796b-42bd-ba28-8d111b9f91ae tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Updating instance_info_cache with network_info: [{"id": "a6e94576-42ff-4f94-90f7-18335cd81c04", "address": "fa:16:3e:09:50:f1", "network": {"id": "fcf929f8-72e5-4701-9267-5cd4fba70ec8", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1970989112-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "65efeb63178649a7bdc50a90cfc112e9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa6e94576-42", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131044) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 17:00:54.198148 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-141772f0-796b-42bd-ba28-8d111b9f91ae tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Releasing lock "refresh_cache-07628113-e50c-4c63-bff3-0401009c87c8" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 04 17:00:54.203710 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-141772f0-796b-42bd-ba28-8d111b9f91ae tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "POST /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8/action" status: 202 len: 0 microversion: 2.1 time: 3.841950 Aug 04 17:00:54.204827 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 782/1609] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:00:50 2022] POST /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8/action => generated 0 bytes in 3846 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Aug 04 17:00:54.223046 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ca3c9367-c5cd-4eec-97f2-70c50a83f03c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:54.226043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ca3c9367-c5cd-4eec-97f2-70c50a83f03c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:54.242190 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:54.264974 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca3c9367-c5cd-4eec-97f2-70c50a83f03c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:54.266157 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca3c9367-c5cd-4eec-97f2-70c50a83f03c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:54.267081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca3c9367-c5cd-4eec-97f2-70c50a83f03c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:54.275169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca3c9367-c5cd-4eec-97f2-70c50a83f03c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:54.278021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca3c9367-c5cd-4eec-97f2-70c50a83f03c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:54.278607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca3c9367-c5cd-4eec-97f2-70c50a83f03c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:54.298859 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=5,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:54.411332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8a846f4c-c1ab-4c3b-b103-52fb67a2c3b9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:54.426681 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8a846f4c-c1ab-4c3b-b103-52fb67a2c3b9 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1534 microversion: 2.1 time: 0.540530 Aug 04 17:00:54.427654 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 828/1610] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:53 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1534 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:54.450701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a673228c-da61-4762-ad52-b0fe67222e90 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '.version_select at 0x7f1e5b6d4040>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:55.107475 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ca3c9367-c5cd-4eec-97f2-70c50a83f03c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:55.121518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ca3c9367-c5cd-4eec-97f2-70c50a83f03c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:55.124940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ca3c9367-c5cd-4eec-97f2-70c50a83f03c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:55.137209 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ca3c9367-c5cd-4eec-97f2-70c50a83f03c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 1810 microversion: 2.25 time: 0.928733 Aug 04 17:00:55.140641 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 783/1611] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:54 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 1810 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:55.159617 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-438e66d8-a76c-4262-ac1f-8db5f686a9b6 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:55.161296 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-438e66d8-a76c-4262-ac1f-8db5f686a9b6 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:55.186490 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-438e66d8-a76c-4262-ac1f-8db5f686a9b6 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:55.187801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-438e66d8-a76c-4262-ac1f-8db5f686a9b6 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:55.189281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-438e66d8-a76c-4262-ac1f-8db5f686a9b6 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:55.190505 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-438e66d8-a76c-4262-ac1f-8db5f686a9b6 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:55.191174 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-438e66d8-a76c-4262-ac1f-8db5f686a9b6 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:55.192775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-438e66d8-a76c-4262-ac1f-8db5f686a9b6 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:55.657429 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a673228c-da61-4762-ad52-b0fe67222e90 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/os-floating-ips/a2ee3c7c-a6bc-49d8-a895-2412f30c24c0" status: 200 len: 184 microversion: 2.1 time: 1.213402 Aug 04 17:00:55.663735 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-438e66d8-a76c-4262-ac1f-8db5f686a9b6 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:55.666190 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 829/1612] 10.222.0.93 () {58 vars in 1260 bytes} [Thu Aug 4 17:00:54 2022] GET /compute/v2.1/os-floating-ips/a2ee3c7c-a6bc-49d8-a895-2412f30c24c0 => generated 184 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:55.671350 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fcdbaef3-0738-451f-8b93-b15198387e04 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:55.671983 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fcdbaef3-0738-451f-8b93-b15198387e04 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:55.682752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fcdbaef3-0738-451f-8b93-b15198387e04 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:55.684098 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fcdbaef3-0738-451f-8b93-b15198387e04 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:55.684927 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fcdbaef3-0738-451f-8b93-b15198387e04 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:55.688346 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fcdbaef3-0738-451f-8b93-b15198387e04 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:55.689200 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fcdbaef3-0738-451f-8b93-b15198387e04 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:55.689845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fcdbaef3-0738-451f-8b93-b15198387e04 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:55.697125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-438e66d8-a76c-4262-ac1f-8db5f686a9b6 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:55.702620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-438e66d8-a76c-4262-ac1f-8db5f686a9b6 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:55.709579 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-438e66d8-a76c-4262-ac1f-8db5f686a9b6 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1875 microversion: 2.32 time: 0.564100 Aug 04 17:00:55.712593 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 784/1613] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:55 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1875 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:55.746026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f41f45a1-3781-45c1-a018-242f3252e3b1 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.108"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:55.755286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:00:56.410019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f41f45a1-3781-45c1-a018-242f3252e3b1 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:56.418615 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f41f45a1-3781-45c1-a018-242f3252e3b1 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:56.419130 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f41f45a1-3781-45c1-a018-242f3252e3b1 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:56.419548 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f41f45a1-3781-45c1-a018-242f3252e3b1 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:56.421795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f41f45a1-3781-45c1-a018-242f3252e3b1 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:56.425948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f41f45a1-3781-45c1-a018-242f3252e3b1 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:56.427485 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f41f45a1-3781-45c1-a018-242f3252e3b1 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:56.623337 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fcdbaef3-0738-451f-8b93-b15198387e04 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:56.641695 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fcdbaef3-0738-451f-8b93-b15198387e04 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1534 microversion: 2.1 time: 0.967246 Aug 04 17:00:56.645515 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 830/1614] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:55 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1534 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:56.667578 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bc35fbe6-0e6c-4ca4-9c02-37875cae5752 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:56.668296 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bc35fbe6-0e6c-4ca4-9c02-37875cae5752 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:56.686946 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc35fbe6-0e6c-4ca4-9c02-37875cae5752 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:56.695103 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc35fbe6-0e6c-4ca4-9c02-37875cae5752 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:56.697097 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc35fbe6-0e6c-4ca4-9c02-37875cae5752 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:56.698017 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc35fbe6-0e6c-4ca4-9c02-37875cae5752 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:56.701097 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc35fbe6-0e6c-4ca4-9c02-37875cae5752 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:56.701694 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc35fbe6-0e6c-4ca4-9c02-37875cae5752 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:57.091180 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f41f45a1-3781-45c1-a018-242f3252e3b1 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "refresh_cache-07628113-e50c-4c63-bff3-0401009c87c8" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 04 17:00:57.091856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f41f45a1-3781-45c1-a018-242f3252e3b1 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquired lock "refresh_cache-07628113-e50c-4c63-bff3-0401009c87c8" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 04 17:00:57.498128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bc35fbe6-0e6c-4ca4-9c02-37875cae5752 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:57.508381 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bc35fbe6-0e6c-4ca4-9c02-37875cae5752 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:57.517566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bc35fbe6-0e6c-4ca4-9c02-37875cae5752 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:57.519180 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bc35fbe6-0e6c-4ca4-9c02-37875cae5752 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 1810 microversion: 2.25 time: 0.869181 Aug 04 17:00:57.520035 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 831/1615] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:56 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 1810 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:57.530515 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-68f49b37-5eb1-4fab-bfd7-6457c07bc5ea tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:57.543090 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-68f49b37-5eb1-4fab-bfd7-6457c07bc5ea tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:57.550425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-68f49b37-5eb1-4fab-bfd7-6457c07bc5ea tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:57.551280 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-68f49b37-5eb1-4fab-bfd7-6457c07bc5ea tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:57.551916 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-68f49b37-5eb1-4fab-bfd7-6457c07bc5ea tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:57.552835 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-68f49b37-5eb1-4fab-bfd7-6457c07bc5ea tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:57.553538 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-68f49b37-5eb1-4fab-bfd7-6457c07bc5ea tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:57.554234 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-68f49b37-5eb1-4fab-bfd7-6457c07bc5ea tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:58.587876 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-68f49b37-5eb1-4fab-bfd7-6457c07bc5ea tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:58.614423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-68f49b37-5eb1-4fab-bfd7-6457c07bc5ea tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:58.615982 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-68f49b37-5eb1-4fab-bfd7-6457c07bc5ea tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:58.617210 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-68f49b37-5eb1-4fab-bfd7-6457c07bc5ea tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1875 microversion: 2.32 time: 1.094883 Aug 04 17:00:58.617776 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 832/1616] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:57 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1875 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:00:58.945888 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a5da892b-20fa-4df1-806f-ef32bcf9f598 tempest-FloatingIPsNegativeTestJSON-90746382 tempest-FloatingIPsNegativeTestJSON-90746382-project] Calling method '.version_select at 0x7f1e6c94b8b0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:59.125271 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a5da892b-20fa-4df1-806f-ef32bcf9f598 tempest-FloatingIPsNegativeTestJSON-90746382 tempest-FloatingIPsNegativeTestJSON-90746382-project] 10.222.0.93 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.496610 Aug 04 17:00:59.125866 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 833/1617] 10.222.0.93 () {58 vars in 1149 bytes} [Thu Aug 4 17:00:58 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:00:59.130737 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-88dd5f21-8b11-4dd9-ad35-d5e835698a9c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:59.131358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-88dd5f21-8b11-4dd9-ad35-d5e835698a9c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:59.152065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88dd5f21-8b11-4dd9-ad35-d5e835698a9c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:59.152698 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88dd5f21-8b11-4dd9-ad35-d5e835698a9c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:59.153313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88dd5f21-8b11-4dd9-ad35-d5e835698a9c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:59.154208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88dd5f21-8b11-4dd9-ad35-d5e835698a9c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:59.154735 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88dd5f21-8b11-4dd9-ad35-d5e835698a9c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:59.174322 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88dd5f21-8b11-4dd9-ad35-d5e835698a9c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:59.258437 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88dd5f21-8b11-4dd9-ad35-d5e835698a9c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:59.260772 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88dd5f21-8b11-4dd9-ad35-d5e835698a9c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:59.261342 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88dd5f21-8b11-4dd9-ad35-d5e835698a9c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:59.264103 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-88dd5f21-8b11-4dd9-ad35-d5e835698a9c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lazy-loading 'fault' on Instance uuid 1250487f-b35f-4803-b7b3-a9a80850fa12 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:00:59.371149 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-88dd5f21-8b11-4dd9-ad35-d5e835698a9c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:00:59.382686 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-88dd5f21-8b11-4dd9-ad35-d5e835698a9c tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 200 len: 1368 microversion: 2.1 time: 0.255697 Aug 04 17:00:59.386462 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 834/1618] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:00:59 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 1368 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:00:59.396408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-7f2b5bd8-4b93-4ee8-99c2-d16b91a86878 req-e800353a-8e77-4f75-a19b-0378f37ced06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79650928-e2ee-4928-8421-c0423298fdad", "name": "network-vif-deleted", "tag": "13e6f1d8-988c-49db-899d-d36204677383"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:00:59.418537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7f2b5bd8-4b93-4ee8-99c2-d16b91a86878 req-e800353a-8e77-4f75-a19b-0378f37ced06 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:59.423537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7f2b5bd8-4b93-4ee8-99c2-d16b91a86878 req-e800353a-8e77-4f75-a19b-0378f37ced06 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:59.424738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7f2b5bd8-4b93-4ee8-99c2-d16b91a86878 req-e800353a-8e77-4f75-a19b-0378f37ced06 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:59.456843 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-7f2b5bd8-4b93-4ee8-99c2-d16b91a86878 req-e800353a-8e77-4f75-a19b-0378f37ced06 service nova] Creating event network-vif-deleted:13e6f1d8-988c-49db-899d-d36204677383 for instance 79650928-e2ee-4928-8421-c0423298fdad on n-h2-851359-3 Aug 04 17:00:59.471177 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-7f2b5bd8-4b93-4ee8-99c2-d16b91a86878 req-e800353a-8e77-4f75-a19b-0378f37ced06 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081546 Aug 04 17:00:59.475610 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 835/1619] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:00:59.492449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9c113d04-b7db-4d0e-b803-235fe9ef0ab3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:59.498023 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9c113d04-b7db-4d0e-b803-235fe9ef0ab3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: b4f45353-5340-4cfe-a8c3-0aeeef958607] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:59.512823 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9c113d04-b7db-4d0e-b803-235fe9ef0ab3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:59.513910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9c113d04-b7db-4d0e-b803-235fe9ef0ab3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:59.515911 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9c113d04-b7db-4d0e-b803-235fe9ef0ab3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:59.517952 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9c113d04-b7db-4d0e-b803-235fe9ef0ab3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:59.519762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9c113d04-b7db-4d0e-b803-235fe9ef0ab3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:59.522950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9c113d04-b7db-4d0e-b803-235fe9ef0ab3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:59.580314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9c113d04-b7db-4d0e-b803-235fe9ef0ab3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: b4f45353-5340-4cfe-a8c3-0aeeef958607] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:00:59.621088 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-f41f45a1-3781-45c1-a018-242f3252e3b1 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Building network info cache for instance {{(pid=131044) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 17:00:59.790574 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9c113d04-b7db-4d0e-b803-235fe9ef0ab3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607" status: 204 len: 0 microversion: 2.1 time: 0.312837 Aug 04 17:00:59.799437 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 836/1620] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:00:59 2022] DELETE /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:00:59.823397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d73b0d30-eb61-4307-809b-cca08ac65bce tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:00:59.827916 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d73b0d30-eb61-4307-809b-cca08ac65bce tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:00:59.844095 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d73b0d30-eb61-4307-809b-cca08ac65bce tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:59.844930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d73b0d30-eb61-4307-809b-cca08ac65bce tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:59.845553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d73b0d30-eb61-4307-809b-cca08ac65bce tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:00:59.849294 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d73b0d30-eb61-4307-809b-cca08ac65bce tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:00:59.851308 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d73b0d30-eb61-4307-809b-cca08ac65bce tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:00:59.851986 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d73b0d30-eb61-4307-809b-cca08ac65bce tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:00.411764 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d73b0d30-eb61-4307-809b-cca08ac65bce tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:00.432121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d73b0d30-eb61-4307-809b-cca08ac65bce tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:00.436396 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d73b0d30-eb61-4307-809b-cca08ac65bce tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:00.437992 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d73b0d30-eb61-4307-809b-cca08ac65bce tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 1810 microversion: 2.25 time: 0.637022 Aug 04 17:01:00.443130 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 837/1621] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:00:59 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 1810 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:00.454799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-dcca6568-80e7-4c1f-8441-c35f7dc06843 req-3c2b7829-8e29-4900-83c3-d960104e2d3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1250487f-b35f-4803-b7b3-a9a80850fa12", "name": "network-vif-deleted", "tag": "167d17c7-b0d3-40d2-8410-10740bd6347f"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:00.485363 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-dcca6568-80e7-4c1f-8441-c35f7dc06843 req-3c2b7829-8e29-4900-83c3-d960104e2d3c service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:00.488271 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-dcca6568-80e7-4c1f-8441-c35f7dc06843 req-3c2b7829-8e29-4900-83c3-d960104e2d3c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:00.488977 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-dcca6568-80e7-4c1f-8441-c35f7dc06843 req-3c2b7829-8e29-4900-83c3-d960104e2d3c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:00.517821 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-dcca6568-80e7-4c1f-8441-c35f7dc06843 req-3c2b7829-8e29-4900-83c3-d960104e2d3c service nova] Creating event network-vif-deleted:167d17c7-b0d3-40d2-8410-10740bd6347f for instance 1250487f-b35f-4803-b7b3-a9a80850fa12 on n-h2-851359-3 Aug 04 17:01:00.538190 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-dcca6568-80e7-4c1f-8441-c35f7dc06843 req-3c2b7829-8e29-4900-83c3-d960104e2d3c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092909 Aug 04 17:01:00.546443 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 838/1622] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:00.557541 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6363a09b-caeb-4450-b3e1-aaa5f4b41731 tempest-FloatingIPsNegativeTestJSON-90746382 tempest-FloatingIPsNegativeTestJSON-90746382-project] Action: 'create', calling method: .version_select at 0x7f1e6c9ad790>, body: {"pool": "non_exist_pool"} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:00.709425 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-6363a09b-caeb-4450-b3e1-aaa5f4b41731 tempest-FloatingIPsNegativeTestJSON-90746382 tempest-FloatingIPsNegativeTestJSON-90746382-project] HTTP exception thrown: Floating IP pool not found. Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6363a09b-caeb-4450-b3e1-aaa5f4b41731 tempest-FloatingIPsNegativeTestJSON-90746382 tempest-FloatingIPsNegativeTestJSON-90746382-project] Request method failure captured: Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 26 Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_tIBZJAKWdd3S4GgOYilXIK2KZExOoJsbRIJLr_lM2_rjj_yUV6adv9LYaetR5w1hZg9vq2kQHrn9iPXiNtwO-MbHJGcR4koaPp1hG9J3uKJvps1ZDDcZfRPNwKmkbAVnNBPK4HjBfz0OY_74dtr1r7TiEB1V1dLu3jt-E2Q19rEbo Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: a1b564cae21b499897d01c038c380051 Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-90746382 Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a1b564cae21b499897d01c038c380051"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a1b564cae21b499897d01c038c380051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a1b564cae21b499897d01c038c380051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a1b564cae21b499897d01c038c380051"}]}] Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-90746382 Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: a1b564cae21b499897d01c038c380051 Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-90746382 Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-FloatingIPsNegativeTestJSON-90746382-project Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: b01f8f4486a14de4a3ea086d31ba648f Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-90746382-project Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: {"pool": "non_exist_pool"} Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: exception: Floating IP pool not found. Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:01:00.711357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:01:00.716452 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 04 17:01:00.716452 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:00.716452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6363a09b-caeb-4450-b3e1-aaa5f4b41731 tempest-FloatingIPsNegativeTestJSON-90746382 tempest-FloatingIPsNegativeTestJSON-90746382-project] Returning 404 to user: Floating IP pool not found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:01:00.716452 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6363a09b-caeb-4450-b3e1-aaa5f4b41731 tempest-FloatingIPsNegativeTestJSON-90746382 tempest-FloatingIPsNegativeTestJSON-90746382-project] 10.222.0.93 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.165082 Aug 04 17:01:00.716452 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 839/1623] 10.222.0.93 () {60 vars in 1170 bytes} [Thu Aug 4 17:01:00 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:01:00.721288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6c9c7276-13f6-4c97-b1c5-5d51a5136e13 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:00.721288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6c9c7276-13f6-4c97-b1c5-5d51a5136e13 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:00.745672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c9c7276-13f6-4c97-b1c5-5d51a5136e13 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:00.746201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c9c7276-13f6-4c97-b1c5-5d51a5136e13 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:00.752320 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c9c7276-13f6-4c97-b1c5-5d51a5136e13 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:00.753301 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c9c7276-13f6-4c97-b1c5-5d51a5136e13 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:00.753806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c9c7276-13f6-4c97-b1c5-5d51a5136e13 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:00.757151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c9c7276-13f6-4c97-b1c5-5d51a5136e13 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:00.821377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-f41f45a1-3781-45c1-a018-242f3252e3b1 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Updating instance_info_cache with network_info: [{"id": "a6e94576-42ff-4f94-90f7-18335cd81c04", "address": "fa:16:3e:09:50:f1", "network": {"id": "fcf929f8-72e5-4701-9267-5cd4fba70ec8", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1970989112-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "65efeb63178649a7bdc50a90cfc112e9", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa6e94576-42", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131044) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 17:01:00.839571 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f41f45a1-3781-45c1-a018-242f3252e3b1 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Releasing lock "refresh_cache-07628113-e50c-4c63-bff3-0401009c87c8" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 04 17:01:00.843178 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f41f45a1-3781-45c1-a018-242f3252e3b1 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "POST /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8/action" status: 202 len: 0 microversion: 2.1 time: 5.127857 Aug 04 17:01:00.848841 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 785/1624] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:00:55 2022] POST /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8/action => generated 0 bytes in 5133 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 04 17:01:00.867623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c2b330a1-3351-488a-92d9-a691266212aa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:00.871733 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c2b330a1-3351-488a-92d9-a691266212aa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: b4f45353-5340-4cfe-a8c3-0aeeef958607] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:00.891421 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2b330a1-3351-488a-92d9-a691266212aa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:00.892018 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2b330a1-3351-488a-92d9-a691266212aa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:00.892482 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2b330a1-3351-488a-92d9-a691266212aa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:00.896217 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2b330a1-3351-488a-92d9-a691266212aa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:00.896714 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2b330a1-3351-488a-92d9-a691266212aa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:00.899006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2b330a1-3351-488a-92d9-a691266212aa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:01.220702 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6c9c7276-13f6-4c97-b1c5-5d51a5136e13 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:01.238927 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6c9c7276-13f6-4c97-b1c5-5d51a5136e13 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:01.242776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6c9c7276-13f6-4c97-b1c5-5d51a5136e13 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:01.246467 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6c9c7276-13f6-4c97-b1c5-5d51a5136e13 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1875 microversion: 2.32 time: 0.530561 Aug 04 17:01:01.247291 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 840/1625] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:00 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1875 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:01.252787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c2b330a1-3351-488a-92d9-a691266212aa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:01.263289 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c2b330a1-3351-488a-92d9-a691266212aa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607" status: 200 len: 1553 microversion: 2.1 time: 0.413157 Aug 04 17:01:01.263890 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 786/1626] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:00 2022] GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607 => generated 1553 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:01.280735 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7e0eaa8b-b84b-4445-97cd-24865d2248f0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:01.281369 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7e0eaa8b-b84b-4445-97cd-24865d2248f0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 1250487f-b35f-4803-b7b3-a9a80850fa12] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:01.287794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8cbb729b-1da1-41fc-a29a-09fa78728e9f tempest-FloatingIPsNegativeTestJSON-90746382 tempest-FloatingIPsNegativeTestJSON-90746382-project] Calling method '.version_select at 0x7f1e5bc0a1f0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:01.295694 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7e0eaa8b-b84b-4445-97cd-24865d2248f0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:01.296239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7e0eaa8b-b84b-4445-97cd-24865d2248f0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:01.296690 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7e0eaa8b-b84b-4445-97cd-24865d2248f0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:01.297412 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7e0eaa8b-b84b-4445-97cd-24865d2248f0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:01.297871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7e0eaa8b-b84b-4445-97cd-24865d2248f0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:01.300692 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7e0eaa8b-b84b-4445-97cd-24865d2248f0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:01.318176 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-7e0eaa8b-b84b-4445-97cd-24865d2248f0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] HTTP exception thrown: Instance 1250487f-b35f-4803-b7b3-a9a80850fa12 could not be found. Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7e0eaa8b-b84b-4445-97cd-24865d2248f0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Request method failure captured: Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 HTTP/1.1 Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_nr6TM3VDFE0-a7GjdiPSkulOf76f1c2TbMoDiupaK9Lm5BhPfOeB57S5f3P9qy6YnDYHcKeg0lfdcHN3-0oPuIBLHcgZhXXL7A_HDfLwIpPHXCuAHrcjdKo53PMyOZ9qRxp28gZSglpaT-ZejdPX9f_LNrtsS6BL7HFdN-3zw1bXU Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 6f64e49086c94f65ba1fc2ef97b6bcde Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-MigrationsAdminTest-207825081 Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6f64e49086c94f65ba1fc2ef97b6bcde"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6f64e49086c94f65ba1fc2ef97b6bcde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6f64e49086c94f65ba1fc2ef97b6bcde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6f64e49086c94f65ba1fc2ef97b6bcde"}]}] Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-MigrationsAdminTest-207825081 Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 6f64e49086c94f65ba1fc2ef97b6bcde Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-MigrationsAdminTest-207825081 Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-MigrationsAdminTest-207825081-project Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 655795644d9941c99a82d15d9daa5ab5 Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-MigrationsAdminTest-207825081-project Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 1250487f-b35f-4803-b7b3-a9a80850fa12 could not be found. Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '1250487f-b35f-4803-b7b3-a9a80850fa12'} Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1250487f-b35f-4803-b7b3-a9a80850fa12 could not be found. Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1250487f-b35f-4803-b7b3-a9a80850fa12 could not be found. Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:01.320219 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:01.325379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:01.325379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:01.325379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:01.325379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:01:01.325379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:01:01.325379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1250487f-b35f-4803-b7b3-a9a80850fa12 could not be found. Aug 04 17:01:01.325379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:01.326786 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7e0eaa8b-b84b-4445-97cd-24865d2248f0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Returning 404 to user: Instance 1250487f-b35f-4803-b7b3-a9a80850fa12 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:01:01.328146 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7e0eaa8b-b84b-4445-97cd-24865d2248f0 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12" status: 404 len: 111 microversion: 2.1 time: 0.079108 Aug 04 17:01:01.329195 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 841/1627] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:01 2022] GET /compute/v2.1/servers/1250487f-b35f-4803-b7b3-a9a80850fa12 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:01:01.334355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e5c3ad0d-9ff2-4484-8fa1-2f23f758cb81 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:01.335069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e5c3ad0d-9ff2-4484-8fa1-2f23f758cb81 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 79650928-e2ee-4928-8421-c0423298fdad] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:01.341651 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e5c3ad0d-9ff2-4484-8fa1-2f23f758cb81 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:01.342517 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e5c3ad0d-9ff2-4484-8fa1-2f23f758cb81 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:01.343416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e5c3ad0d-9ff2-4484-8fa1-2f23f758cb81 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:01.344328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e5c3ad0d-9ff2-4484-8fa1-2f23f758cb81 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:01.344972 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e5c3ad0d-9ff2-4484-8fa1-2f23f758cb81 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:01.345585 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e5c3ad0d-9ff2-4484-8fa1-2f23f758cb81 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:01.380623 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-e5c3ad0d-9ff2-4484-8fa1-2f23f758cb81 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] HTTP exception thrown: Instance 79650928-e2ee-4928-8421-c0423298fdad could not be found. Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e5c3ad0d-9ff2-4484-8fa1-2f23f758cb81 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Request method failure captured: Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad HTTP/1.1 Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_rnHES_MWst1WXo_1XUJdaO_nmyJ0CPyBNTl2JIyP0Gg86LjCv6PPQ65sD1HuGK49uxmX7aq0siRxkSlVe0KF0dw7tW2qKp5CVHC3hR1waWCH3FFfNaXDMRUMlp2svVSme9vfcGnHDM3waAkVkQB6pnU45Lv6Z4EqCxzxMP2eOHLI4 Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 65efeb63178649a7bdc50a90cfc112e9 Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-37287949 Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/65efeb63178649a7bdc50a90cfc112e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/65efeb63178649a7bdc50a90cfc112e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_65efeb63178649a7bdc50a90cfc112e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/65efeb63178649a7bdc50a90cfc112e9"}]}] Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-37287949 Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 65efeb63178649a7bdc50a90cfc112e9 Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-37287949 Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-FloatingIPsAssociationTestJSON-37287949-project Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: df06c4b403cc4fe5b76915e685b7cef5 Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-37287949-project Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 79650928-e2ee-4928-8421-c0423298fdad could not be found. Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '79650928-e2ee-4928-8421-c0423298fdad'} Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79650928-e2ee-4928-8421-c0423298fdad could not be found. Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:01:01.382744 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:01:01.388577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79650928-e2ee-4928-8421-c0423298fdad could not be found. Aug 04 17:01:01.388577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:01.388577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:01.388577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:01.388577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:01.388577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:01.388577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:01.388577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:01:01.388577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:01:01.388577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79650928-e2ee-4928-8421-c0423298fdad could not be found. Aug 04 17:01:01.388577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:01.391991 n-d-851359-3 devstack@n-api.service[131044]: DEBUG neutronclient.v2_0.client [None req-8cbb729b-1da1-41fc-a29a-09fa78728e9f tempest-FloatingIPsNegativeTestJSON-90746382 tempest-FloatingIPsNegativeTestJSON-90746382-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP b9ca7b9a-c427-4580-a5ac-eafa7c88b3fa could not be found", "detail": ""}} {{(pid=131044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 17:01:01.392921 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-8cbb729b-1da1-41fc-a29a-09fa78728e9f tempest-FloatingIPsNegativeTestJSON-90746382 tempest-FloatingIPsNegativeTestJSON-90746382-project] HTTP exception thrown: Floating IP not found for ID b9ca7b9a-c427-4580-a5ac-eafa7c88b3fa Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8cbb729b-1da1-41fc-a29a-09fa78728e9f tempest-FloatingIPsNegativeTestJSON-90746382 tempest-FloatingIPsNegativeTestJSON-90746382-project] Request method failure captured: Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/os-floating-ips/b9ca7b9a-c427-4580-a5ac-eafa7c88b3fa HTTP/1.1 Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_tIBZJAKWdd3S4GgOYilXIK2KZExOoJsbRIJLr_lM2_rjj_yUV6adv9LYaetR5w1hZg9vq2kQHrn9iPXiNtwO-MbHJGcR4koaPp1hG9J3uKJvps1ZDDcZfRPNwKmkbAVnNBPK4HjBfz0OY_74dtr1r7TiEB1V1dLu3jt-E2Q19rEbo Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: a1b564cae21b499897d01c038c380051 Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-90746382 Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a1b564cae21b499897d01c038c380051"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a1b564cae21b499897d01c038c380051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a1b564cae21b499897d01c038c380051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a1b564cae21b499897d01c038c380051"}]}] Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-90746382 Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: a1b564cae21b499897d01c038c380051 Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-90746382 Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-FloatingIPsNegativeTestJSON-90746382-project Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: b01f8f4486a14de4a3ea086d31ba648f Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-90746382-project Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: exception: Floating IP not found for ID b9ca7b9a-c427-4580-a5ac-eafa7c88b3fa Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'b9ca7b9a-c427-4580-a5ac-eafa7c88b3fa'} Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP b9ca7b9a-c427-4580-a5ac-eafa7c88b3fa could not be found Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c1205e57-611b-4314-a2ed-ea7d11b15307'] Aug 04 17:01:01.395288 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:01:01.399722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:01.399722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:01:01.399722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:01.399722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 04 17:01:01.399722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 04 17:01:01.399722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 04 17:01:01.399722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 04 17:01:01.399722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID b9ca7b9a-c427-4580-a5ac-eafa7c88b3fa. Aug 04 17:01:01.399722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:01:01.399722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:01.399722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:01:01.399722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:01.399722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:01.399722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:01.399722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:01:01.399722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:01:01.399722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:01:01.399722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:01:01.399722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:01:01.399722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:01:01.399722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 04 17:01:01.399722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 17:01:01.399722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID b9ca7b9a-c427-4580-a5ac-eafa7c88b3fa Aug 04 17:01:01.399722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:01:01.399722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:01.399722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:01:01.399722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:01.399722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:01.399722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:01.399722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:01:01.399722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:01:01.399722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID b9ca7b9a-c427-4580-a5ac-eafa7c88b3fa Aug 04 17:01:01.399722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:01:01.403312 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8cbb729b-1da1-41fc-a29a-09fa78728e9f tempest-FloatingIPsNegativeTestJSON-90746382 tempest-FloatingIPsNegativeTestJSON-90746382-project] Returning 404 to user: Floating IP not found for ID b9ca7b9a-c427-4580-a5ac-eafa7c88b3fa {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:01:01.404456 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8cbb729b-1da1-41fc-a29a-09fa78728e9f tempest-FloatingIPsNegativeTestJSON-90746382 tempest-FloatingIPsNegativeTestJSON-90746382-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/b9ca7b9a-c427-4580-a5ac-eafa7c88b3fa" status: 404 len: 111 microversion: 2.1 time: 0.139550 Aug 04 17:01:01.405121 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 787/1628] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Aug 4 17:01:01 2022] DELETE /compute/v2.1/os-floating-ips/b9ca7b9a-c427-4580-a5ac-eafa7c88b3fa => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:01:01.408745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e5c3ad0d-9ff2-4484-8fa1-2f23f758cb81 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Returning 404 to user: Instance 79650928-e2ee-4928-8421-c0423298fdad could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:01:01.409085 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e5c3ad0d-9ff2-4484-8fa1-2f23f758cb81 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "DELETE /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad" status: 404 len: 111 microversion: 2.1 time: 0.078789 Aug 04 17:01:01.409788 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 842/1629] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:01:01 2022] DELETE /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:01:01.415686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-73eb66e9-2089-4f1b-b506-8987ede9b8d4 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '.version_select at 0x7f1e5b4fe700>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:01.433699 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c2036002-2e3c-4e27-b370-2dcbfde10bd1 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:01.437270 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c2036002-2e3c-4e27-b370-2dcbfde10bd1 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 79650928-e2ee-4928-8421-c0423298fdad] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:01.472731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2036002-2e3c-4e27-b370-2dcbfde10bd1 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:01.473204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2036002-2e3c-4e27-b370-2dcbfde10bd1 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:01.481159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2036002-2e3c-4e27-b370-2dcbfde10bd1 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:01.483591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2036002-2e3c-4e27-b370-2dcbfde10bd1 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:01.486118 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2036002-2e3c-4e27-b370-2dcbfde10bd1 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:01.487774 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-73eb66e9-2089-4f1b-b506-8987ede9b8d4 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2110583897" status: 202 len: 0 microversion: 2.1 time: 0.081796 Aug 04 17:01:01.488442 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2036002-2e3c-4e27-b370-2dcbfde10bd1 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:01.492300 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 788/1630] 10.222.0.93 () {58 vars in 1221 bytes} [Thu Aug 4 17:01:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2110583897 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:01:01.507524 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-64089817-e552-4148-b6d2-3f76cad53a4b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:01.509698 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-64089817-e552-4148-b6d2-3f76cad53a4b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:01.524669 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64089817-e552-4148-b6d2-3f76cad53a4b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:01.527916 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64089817-e552-4148-b6d2-3f76cad53a4b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:01.530645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64089817-e552-4148-b6d2-3f76cad53a4b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:01.532977 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64089817-e552-4148-b6d2-3f76cad53a4b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:01.533593 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-c2036002-2e3c-4e27-b370-2dcbfde10bd1 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] HTTP exception thrown: Instance 79650928-e2ee-4928-8421-c0423298fdad could not be found. Aug 04 17:01:01.536375 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64089817-e552-4148-b6d2-3f76cad53a4b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:01.537265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64089817-e552-4148-b6d2-3f76cad53a4b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c2036002-2e3c-4e27-b370-2dcbfde10bd1 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Request method failure captured: Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad HTTP/1.1 Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_rnHES_MWst1WXo_1XUJdaO_nmyJ0CPyBNTl2JIyP0Gg86LjCv6PPQ65sD1HuGK49uxmX7aq0siRxkSlVe0KF0dw7tW2qKp5CVHC3hR1waWCH3FFfNaXDMRUMlp2svVSme9vfcGnHDM3waAkVkQB6pnU45Lv6Z4EqCxzxMP2eOHLI4 Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 65efeb63178649a7bdc50a90cfc112e9 Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-37287949 Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/65efeb63178649a7bdc50a90cfc112e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/65efeb63178649a7bdc50a90cfc112e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_65efeb63178649a7bdc50a90cfc112e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/65efeb63178649a7bdc50a90cfc112e9"}]}] Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-37287949 Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 65efeb63178649a7bdc50a90cfc112e9 Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-37287949 Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-FloatingIPsAssociationTestJSON-37287949-project Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: df06c4b403cc4fe5b76915e685b7cef5 Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-37287949-project Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 79650928-e2ee-4928-8421-c0423298fdad could not be found. Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '79650928-e2ee-4928-8421-c0423298fdad'} Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79650928-e2ee-4928-8421-c0423298fdad could not be found. Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79650928-e2ee-4928-8421-c0423298fdad could not be found. Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:01.539710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:01.544443 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:01.544443 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:01.544443 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:01.544443 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:01.544443 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:01:01.544443 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:01:01.544443 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79650928-e2ee-4928-8421-c0423298fdad could not be found. Aug 04 17:01:01.544443 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:01.548475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c2036002-2e3c-4e27-b370-2dcbfde10bd1 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Returning 404 to user: Instance 79650928-e2ee-4928-8421-c0423298fdad could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:01:01.550020 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c2036002-2e3c-4e27-b370-2dcbfde10bd1 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad" status: 404 len: 111 microversion: 2.1 time: 0.131380 Aug 04 17:01:01.553663 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 843/1631] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:01 2022] GET /compute/v2.1/servers/79650928-e2ee-4928-8421-c0423298fdad => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:01:01.562868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a7aa0db6-1cdc-4819-be66-10a885fa8f29 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '.version_select at 0x7f1e5b9d8d30>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:02.018529 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-64089817-e552-4148-b6d2-3f76cad53a4b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:02.036851 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-64089817-e552-4148-b6d2-3f76cad53a4b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:02.042304 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-64089817-e552-4148-b6d2-3f76cad53a4b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:02.046461 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-64089817-e552-4148-b6d2-3f76cad53a4b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 1810 microversion: 2.25 time: 0.552770 Aug 04 17:01:02.061929 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 789/1632] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:01 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 1810 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:02.272229 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9db30b49-569d-460e-bf0c-b048c238f700 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:02.272975 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9db30b49-569d-460e-bf0c-b048c238f700 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:02.287387 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9db30b49-569d-460e-bf0c-b048c238f700 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:02.291377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9db30b49-569d-460e-bf0c-b048c238f700 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:02.291973 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9db30b49-569d-460e-bf0c-b048c238f700 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:02.293014 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9db30b49-569d-460e-bf0c-b048c238f700 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:02.296153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9db30b49-569d-460e-bf0c-b048c238f700 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:02.296861 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9db30b49-569d-460e-bf0c-b048c238f700 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:03.483271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9db30b49-569d-460e-bf0c-b048c238f700 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:03.494696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9db30b49-569d-460e-bf0c-b048c238f700 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:03.502588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9db30b49-569d-460e-bf0c-b048c238f700 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:03.504768 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9db30b49-569d-460e-bf0c-b048c238f700 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1875 microversion: 2.32 time: 1.237629 Aug 04 17:01:03.507818 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 790/1633] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:02 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1875 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:01:03.514566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b83153f5-4d54-4672-8147-1889ffd0fdec tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:03.527318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b83153f5-4d54-4672-8147-1889ffd0fdec tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: b4f45353-5340-4cfe-a8c3-0aeeef958607] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:03.544439 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b83153f5-4d54-4672-8147-1889ffd0fdec tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:03.545275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b83153f5-4d54-4672-8147-1889ffd0fdec tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:03.545913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b83153f5-4d54-4672-8147-1889ffd0fdec tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:03.547336 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b83153f5-4d54-4672-8147-1889ffd0fdec tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:03.550260 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b83153f5-4d54-4672-8147-1889ffd0fdec tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:03.550949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b83153f5-4d54-4672-8147-1889ffd0fdec tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:04.308848 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b83153f5-4d54-4672-8147-1889ffd0fdec tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:04.319755 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b83153f5-4d54-4672-8147-1889ffd0fdec tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607" status: 200 len: 1553 microversion: 2.1 time: 0.809694 Aug 04 17:01:04.323500 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 791/1634] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:03 2022] GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607 => generated 1553 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:04.329349 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-f0f7d32f-4437-42b1-b25e-2ba7344ac58c req-f7f9fd30-008a-4d4c-8f06-728c97bab8ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07628113-e50c-4c63-bff3-0401009c87c8", "tag": "a6e94576-42ff-4f94-90f7-18335cd81c04"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:04.341620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f0f7d32f-4437-42b1-b25e-2ba7344ac58c req-f7f9fd30-008a-4d4c-8f06-728c97bab8ed service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:04.344115 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f0f7d32f-4437-42b1-b25e-2ba7344ac58c req-f7f9fd30-008a-4d4c-8f06-728c97bab8ed service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:04.348966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f0f7d32f-4437-42b1-b25e-2ba7344ac58c req-f7f9fd30-008a-4d4c-8f06-728c97bab8ed service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:04.375672 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-f0f7d32f-4437-42b1-b25e-2ba7344ac58c req-f7f9fd30-008a-4d4c-8f06-728c97bab8ed service nova] Creating event network-changed:a6e94576-42ff-4f94-90f7-18335cd81c04 for instance 07628113-e50c-4c63-bff3-0401009c87c8 on n-h1-851359-3 Aug 04 17:01:04.382501 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-f0f7d32f-4437-42b1-b25e-2ba7344ac58c req-f7f9fd30-008a-4d4c-8f06-728c97bab8ed service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057467 Aug 04 17:01:04.383648 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 792/1635] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:04.389586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6f7d7934-5a5c-42dc-8f2f-e98590ee7e7e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:04.390628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6f7d7934-5a5c-42dc-8f2f-e98590ee7e7e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:04.402560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f7d7934-5a5c-42dc-8f2f-e98590ee7e7e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:04.405524 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f7d7934-5a5c-42dc-8f2f-e98590ee7e7e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:04.406985 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f7d7934-5a5c-42dc-8f2f-e98590ee7e7e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:04.409704 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f7d7934-5a5c-42dc-8f2f-e98590ee7e7e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:04.410233 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f7d7934-5a5c-42dc-8f2f-e98590ee7e7e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:04.412538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f7d7934-5a5c-42dc-8f2f-e98590ee7e7e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:05.190697 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6f7d7934-5a5c-42dc-8f2f-e98590ee7e7e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:05.204928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6f7d7934-5a5c-42dc-8f2f-e98590ee7e7e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:05.211125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6f7d7934-5a5c-42dc-8f2f-e98590ee7e7e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:05.222385 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6f7d7934-5a5c-42dc-8f2f-e98590ee7e7e tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 1810 microversion: 2.25 time: 0.837280 Aug 04 17:01:05.224990 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 793/1636] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:04 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 1810 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:05.240326 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5fc171fc-ff80-48cb-b3f1-33869e9bf227 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:05.241374 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5fc171fc-ff80-48cb-b3f1-33869e9bf227 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:05.256049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5fc171fc-ff80-48cb-b3f1-33869e9bf227 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:05.256974 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5fc171fc-ff80-48cb-b3f1-33869e9bf227 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:05.257604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5fc171fc-ff80-48cb-b3f1-33869e9bf227 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:05.258691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5fc171fc-ff80-48cb-b3f1-33869e9bf227 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:05.259337 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5fc171fc-ff80-48cb-b3f1-33869e9bf227 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:05.259944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5fc171fc-ff80-48cb-b3f1-33869e9bf227 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:06.214258 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a7aa0db6-1cdc-4819-be66-10a885fa8f29 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/a2ee3c7c-a6bc-49d8-a895-2412f30c24c0" status: 202 len: 0 microversion: 2.1 time: 4.655392 Aug 04 17:01:06.216119 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 844/1637] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Aug 4 17:01:01 2022] DELETE /compute/v2.1/os-floating-ips/a2ee3c7c-a6bc-49d8-a895-2412f30c24c0 => generated 0 bytes in 4658 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:01:06.232209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8849f620-033c-4235-8a2d-e23765b3c641 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:06.233045 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8849f620-033c-4235-8a2d-e23765b3c641 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:06.275265 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8849f620-033c-4235-8a2d-e23765b3c641 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:06.278841 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8849f620-033c-4235-8a2d-e23765b3c641 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:06.279344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8849f620-033c-4235-8a2d-e23765b3c641 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:06.285942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8849f620-033c-4235-8a2d-e23765b3c641 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:06.288024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8849f620-033c-4235-8a2d-e23765b3c641 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:06.288493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8849f620-033c-4235-8a2d-e23765b3c641 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:06.316276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5fc171fc-ff80-48cb-b3f1-33869e9bf227 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:06.343135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8849f620-033c-4235-8a2d-e23765b3c641 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:01:06.351600 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5fc171fc-ff80-48cb-b3f1-33869e9bf227 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:06.353243 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5fc171fc-ff80-48cb-b3f1-33869e9bf227 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:06.375793 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5fc171fc-ff80-48cb-b3f1-33869e9bf227 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1875 microversion: 2.32 time: 1.145866 Aug 04 17:01:06.388484 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 794/1638] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:05 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1875 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:06.412341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7f1b551d-f3a1-4c9c-a167-ceac2acc255b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:06.413276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7f1b551d-f3a1-4c9c-a167-ceac2acc255b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: b4f45353-5340-4cfe-a8c3-0aeeef958607] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:06.438502 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f1b551d-f3a1-4c9c-a167-ceac2acc255b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:06.439129 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f1b551d-f3a1-4c9c-a167-ceac2acc255b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:06.439942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f1b551d-f3a1-4c9c-a167-ceac2acc255b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:06.441155 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f1b551d-f3a1-4c9c-a167-ceac2acc255b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:06.442514 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f1b551d-f3a1-4c9c-a167-ceac2acc255b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:06.445379 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f1b551d-f3a1-4c9c-a167-ceac2acc255b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:06.618247 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8849f620-033c-4235-8a2d-e23765b3c641 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 204 len: 0 microversion: 2.1 time: 0.400512 Aug 04 17:01:06.633859 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 845/1639] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:01:06 2022] DELETE /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:01:06.641364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1403fe51-faf6-4452-ad52-40623fe804d2 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:06.641960 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1403fe51-faf6-4452-ad52-40623fe804d2 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:06.653149 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1403fe51-faf6-4452-ad52-40623fe804d2 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:06.656694 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1403fe51-faf6-4452-ad52-40623fe804d2 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:06.657408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1403fe51-faf6-4452-ad52-40623fe804d2 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:06.658421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1403fe51-faf6-4452-ad52-40623fe804d2 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:06.660554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1403fe51-faf6-4452-ad52-40623fe804d2 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:06.661350 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1403fe51-faf6-4452-ad52-40623fe804d2 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:06.702702 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1403fe51-faf6-4452-ad52-40623fe804d2 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:01:06.853006 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1403fe51-faf6-4452-ad52-40623fe804d2 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "DELETE /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8" status: 204 len: 0 microversion: 2.1 time: 0.215643 Aug 04 17:01:06.858473 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 846/1640] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:01:06 2022] DELETE /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:01:06.871826 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-055cf7f3-73f5-4f3c-9100-246d1fa283e4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:06.872494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7f1b551d-f3a1-4c9c-a167-ceac2acc255b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:06.874838 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-055cf7f3-73f5-4f3c-9100-246d1fa283e4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:06.892631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-055cf7f3-73f5-4f3c-9100-246d1fa283e4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:06.892631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-055cf7f3-73f5-4f3c-9100-246d1fa283e4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:06.892631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-055cf7f3-73f5-4f3c-9100-246d1fa283e4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:06.892631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-055cf7f3-73f5-4f3c-9100-246d1fa283e4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:06.892631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-055cf7f3-73f5-4f3c-9100-246d1fa283e4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:06.892631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-055cf7f3-73f5-4f3c-9100-246d1fa283e4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:06.900651 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7f1b551d-f3a1-4c9c-a167-ceac2acc255b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607" status: 200 len: 1346 microversion: 2.1 time: 0.510640 Aug 04 17:01:06.919563 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 795/1641] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:06 2022] GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607 => generated 1346 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:06.948829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-82950fb3-4956-468a-b428-1852abd3a005 req-ddd030ad-3485-4e6b-bed8-7f2ad5e8edb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4f45353-5340-4cfe-a8c3-0aeeef958607", "name": "network-vif-deleted", "tag": "0bdc6e7d-6547-4ccf-8a5e-386eed9b1a27"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:06.987901 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-82950fb3-4956-468a-b428-1852abd3a005 req-ddd030ad-3485-4e6b-bed8-7f2ad5e8edb7 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:06.988440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-82950fb3-4956-468a-b428-1852abd3a005 req-ddd030ad-3485-4e6b-bed8-7f2ad5e8edb7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:06.993891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-82950fb3-4956-468a-b428-1852abd3a005 req-ddd030ad-3485-4e6b-bed8-7f2ad5e8edb7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:07.014959 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-82950fb3-4956-468a-b428-1852abd3a005 req-ddd030ad-3485-4e6b-bed8-7f2ad5e8edb7 service nova] Creating event network-vif-deleted:0bdc6e7d-6547-4ccf-8a5e-386eed9b1a27 for instance b4f45353-5340-4cfe-a8c3-0aeeef958607 on n-h1-851359-3 Aug 04 17:01:07.021950 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-82950fb3-4956-468a-b428-1852abd3a005 req-ddd030ad-3485-4e6b-bed8-7f2ad5e8edb7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097157 Aug 04 17:01:07.023640 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 796/1642] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:07.031864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ce4bc631-529f-4bcc-b075-cd8dc9344bc3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:07.032979 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ce4bc631-529f-4bcc-b075-cd8dc9344bc3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:07.042481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce4bc631-529f-4bcc-b075-cd8dc9344bc3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:07.043866 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce4bc631-529f-4bcc-b075-cd8dc9344bc3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:07.044716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce4bc631-529f-4bcc-b075-cd8dc9344bc3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:07.045915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce4bc631-529f-4bcc-b075-cd8dc9344bc3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:07.046639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce4bc631-529f-4bcc-b075-cd8dc9344bc3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:07.047555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce4bc631-529f-4bcc-b075-cd8dc9344bc3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:07.367163 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-055cf7f3-73f5-4f3c-9100-246d1fa283e4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:07.416262 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-055cf7f3-73f5-4f3c-9100-246d1fa283e4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:07.417903 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-055cf7f3-73f5-4f3c-9100-246d1fa283e4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:07.419263 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-055cf7f3-73f5-4f3c-9100-246d1fa283e4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 1810 microversion: 2.25 time: 0.558195 Aug 04 17:01:07.441745 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 847/1643] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:06 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 1810 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:07.455388 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4cfc8c43-ae62-4b7e-83f5-f5a5c0230dec tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:07.465848 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4cfc8c43-ae62-4b7e-83f5-f5a5c0230dec tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:07.490837 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4cfc8c43-ae62-4b7e-83f5-f5a5c0230dec tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:07.495632 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4cfc8c43-ae62-4b7e-83f5-f5a5c0230dec tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:07.496385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4cfc8c43-ae62-4b7e-83f5-f5a5c0230dec tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:07.497354 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4cfc8c43-ae62-4b7e-83f5-f5a5c0230dec tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:07.498286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4cfc8c43-ae62-4b7e-83f5-f5a5c0230dec tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:07.498918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4cfc8c43-ae62-4b7e-83f5-f5a5c0230dec tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:07.536161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ce4bc631-529f-4bcc-b075-cd8dc9344bc3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:07.550804 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ce4bc631-529f-4bcc-b075-cd8dc9344bc3 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1468 microversion: 2.1 time: 0.524852 Aug 04 17:01:07.552111 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 797/1644] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:07 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1468 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:07.564036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d87c3cac-6f1d-42ee-9b7e-e2a031baa9bf tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:07.565279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d87c3cac-6f1d-42ee-9b7e-e2a031baa9bf tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:07.578249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:07.584554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d87c3cac-6f1d-42ee-9b7e-e2a031baa9bf tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:07.586128 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d87c3cac-6f1d-42ee-9b7e-e2a031baa9bf tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:07.587939 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d87c3cac-6f1d-42ee-9b7e-e2a031baa9bf tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:07.589075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d87c3cac-6f1d-42ee-9b7e-e2a031baa9bf tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:07.593831 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d87c3cac-6f1d-42ee-9b7e-e2a031baa9bf tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:07.595121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d87c3cac-6f1d-42ee-9b7e-e2a031baa9bf tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:08.169707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d87c3cac-6f1d-42ee-9b7e-e2a031baa9bf tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:08.184349 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d87c3cac-6f1d-42ee-9b7e-e2a031baa9bf tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:08.186008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d87c3cac-6f1d-42ee-9b7e-e2a031baa9bf tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:08.191057 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d87c3cac-6f1d-42ee-9b7e-e2a031baa9bf tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1875 microversion: 2.32 time: 0.636593 Aug 04 17:01:08.193523 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 798/1645] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:07 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1875 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:08.204645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d96a71f0-b431-479a-afa2-7c5b226f6742 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:08.227273 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d96a71f0-b431-479a-afa2-7c5b226f6742 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: b4f45353-5340-4cfe-a8c3-0aeeef958607] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:08.245391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d96a71f0-b431-479a-afa2-7c5b226f6742 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:08.246403 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d96a71f0-b431-479a-afa2-7c5b226f6742 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:08.247117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d96a71f0-b431-479a-afa2-7c5b226f6742 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:08.248021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d96a71f0-b431-479a-afa2-7c5b226f6742 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:08.248657 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d96a71f0-b431-479a-afa2-7c5b226f6742 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:08.249282 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d96a71f0-b431-479a-afa2-7c5b226f6742 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:08.282928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4cfc8c43-ae62-4b7e-83f5-f5a5c0230dec tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:08.297601 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4cfc8c43-ae62-4b7e-83f5-f5a5c0230dec tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8" status: 200 len: 1526 microversion: 2.1 time: 0.851112 Aug 04 17:01:08.299042 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 848/1646] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:07 2022] GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8 => generated 1526 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:08.425134 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2e294816-15ee-4fe8-8106-52bbda6187d7 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1203099129", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "c4b7b07c-f108-4c13-9679-84b31b18674e"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:08.471293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d96a71f0-b431-479a-afa2-7c5b226f6742 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:08.485365 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d96a71f0-b431-479a-afa2-7c5b226f6742 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607" status: 200 len: 1346 microversion: 2.1 time: 0.290381 Aug 04 17:01:08.486282 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 799/1647] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:08 2022] GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607 => generated 1346 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:08.496934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0c4bcb79-4ff0-451c-b023-f1caf3a49026 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:08.497555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0c4bcb79-4ff0-451c-b023-f1caf3a49026 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:08.520639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c4bcb79-4ff0-451c-b023-f1caf3a49026 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:08.521144 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c4bcb79-4ff0-451c-b023-f1caf3a49026 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:08.521580 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c4bcb79-4ff0-451c-b023-f1caf3a49026 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:08.522338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c4bcb79-4ff0-451c-b023-f1caf3a49026 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:08.522799 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c4bcb79-4ff0-451c-b023-f1caf3a49026 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:08.523231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c4bcb79-4ff0-451c-b023-f1caf3a49026 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:08.543306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-2e294816-15ee-4fe8-8106-52bbda6187d7 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] validate_networks() for [('c4b7b07c-f108-4c13-9679-84b31b18674e', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:01:09.032473 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0c4bcb79-4ff0-451c-b023-f1caf3a49026 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:09.046923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0c4bcb79-4ff0-451c-b023-f1caf3a49026 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:09.048444 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0c4bcb79-4ff0-451c-b023-f1caf3a49026 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:09.049641 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0c4bcb79-4ff0-451c-b023-f1caf3a49026 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 1800 microversion: 2.25 time: 0.562413 Aug 04 17:01:09.070430 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 800/1648] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:08 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 1800 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:09.077448 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-21dfc400-6ed6-45fb-a1be-682cdf96cf28 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:09.078090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-21dfc400-6ed6-45fb-a1be-682cdf96cf28 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:09.097701 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21dfc400-6ed6-45fb-a1be-682cdf96cf28 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:09.111577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21dfc400-6ed6-45fb-a1be-682cdf96cf28 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:09.112105 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21dfc400-6ed6-45fb-a1be-682cdf96cf28 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:09.112923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21dfc400-6ed6-45fb-a1be-682cdf96cf28 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:09.113406 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21dfc400-6ed6-45fb-a1be-682cdf96cf28 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:09.113875 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21dfc400-6ed6-45fb-a1be-682cdf96cf28 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:09.734160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-21dfc400-6ed6-45fb-a1be-682cdf96cf28 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:09.744024 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-21dfc400-6ed6-45fb-a1be-682cdf96cf28 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1468 microversion: 2.1 time: 0.672432 Aug 04 17:01:09.747495 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 801/1649] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:09 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1468 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:09.755352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-150c1825-7e4d-4d65-803a-c73a377067be tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Calling method '.version_select at 0x7f1e5b9b95e0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:09.769465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-150c1825-7e4d-4d65-803a-c73a377067be tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:09.771228 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-150c1825-7e4d-4d65-803a-c73a377067be tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:09.772332 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-150c1825-7e4d-4d65-803a-c73a377067be tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:09.784472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:09.822484 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-150c1825-7e4d-4d65-803a-c73a377067be tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] 10.222.0.93 "GET /compute/v2.1/os-migrations" status: 200 len: 3628 microversion: 2.25 time: 0.073657 Aug 04 17:01:09.823840 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 802/1650] 10.222.0.93 () {60 vars in 1184 bytes} [Thu Aug 4 17:01:09 2022] GET /compute/v2.1/os-migrations => generated 3628 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:09.838568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-33eaed80-4724-49e0-908a-b133ce1adeb2 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:09.839473 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-33eaed80-4724-49e0-908a-b133ce1adeb2 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:09.852458 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33eaed80-4724-49e0-908a-b133ce1adeb2 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:09.855532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33eaed80-4724-49e0-908a-b133ce1adeb2 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:09.855990 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33eaed80-4724-49e0-908a-b133ce1adeb2 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:09.858250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33eaed80-4724-49e0-908a-b133ce1adeb2 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:09.858717 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33eaed80-4724-49e0-908a-b133ce1adeb2 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:09.859252 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33eaed80-4724-49e0-908a-b133ce1adeb2 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:10.508538 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-2e294816-15ee-4fe8-8106-52bbda6187d7 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:01:10.509653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-2e294816-15ee-4fe8-8106-52bbda6187d7 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:01:10.510317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-2e294816-15ee-4fe8-8106-52bbda6187d7 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:01:10.510909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-2e294816-15ee-4fe8-8106-52bbda6187d7 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:01:10.511525 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-2e294816-15ee-4fe8-8106-52bbda6187d7 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:01:10.529263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2e294816-15ee-4fe8-8106-52bbda6187d7 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:10.531375 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2e294816-15ee-4fe8-8106-52bbda6187d7 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:10.532042 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2e294816-15ee-4fe8-8106-52bbda6187d7 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:10.533016 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2e294816-15ee-4fe8-8106-52bbda6187d7 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:10.534515 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2e294816-15ee-4fe8-8106-52bbda6187d7 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:10.538440 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2e294816-15ee-4fe8-8106-52bbda6187d7 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:10.591711 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-2e294816-15ee-4fe8-8106-52bbda6187d7 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Getting quotas for project 86d8604ab1934bdeacd1bb6073ae153a. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:01:10.601648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-33eaed80-4724-49e0-908a-b133ce1adeb2 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:10.611097 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-2e294816-15ee-4fe8-8106-52bbda6187d7 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Getting quotas for user 157e8ca7c2494f3ea5c468dc37f55858 and project 86d8604ab1934bdeacd1bb6073ae153a. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:01:10.615631 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-33eaed80-4724-49e0-908a-b133ce1adeb2 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:10.619791 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-33eaed80-4724-49e0-908a-b133ce1adeb2 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:10.621007 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-33eaed80-4724-49e0-908a-b133ce1adeb2 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1875 microversion: 2.32 time: 0.795605 Aug 04 17:01:10.621567 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 803/1651] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:09 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1875 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:10.632809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-730bb59c-820d-4e22-923f-976b356c6a7e tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:10.636542 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-730bb59c-820d-4e22-923f-976b356c6a7e tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:10.650981 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-730bb59c-820d-4e22-923f-976b356c6a7e tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:10.652634 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-730bb59c-820d-4e22-923f-976b356c6a7e tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:10.652985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2e294816-15ee-4fe8-8106-52bbda6187d7 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:01:10.656117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-730bb59c-820d-4e22-923f-976b356c6a7e tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:10.657233 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-730bb59c-820d-4e22-923f-976b356c6a7e tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:10.657886 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-730bb59c-820d-4e22-923f-976b356c6a7e tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:10.660914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-730bb59c-820d-4e22-923f-976b356c6a7e tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:10.670319 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2e294816-15ee-4fe8-8106-52bbda6187d7 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0aa159af-25ad-4e88-adfd-88736802c68b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:01:10.784339 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2e294816-15ee-4fe8-8106-52bbda6187d7 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.481122 Aug 04 17:01:10.788667 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 849/1652] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:01:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:01:10.799802 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1583bf10-f925-4032-bb94-7072e52a21b9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:10.805272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1583bf10-f925-4032-bb94-7072e52a21b9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: b4f45353-5340-4cfe-a8c3-0aeeef958607] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:10.820303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1583bf10-f925-4032-bb94-7072e52a21b9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:10.826074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1583bf10-f925-4032-bb94-7072e52a21b9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:10.826804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1583bf10-f925-4032-bb94-7072e52a21b9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:10.827749 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1583bf10-f925-4032-bb94-7072e52a21b9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:10.828489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1583bf10-f925-4032-bb94-7072e52a21b9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:10.829129 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1583bf10-f925-4032-bb94-7072e52a21b9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:11.244332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1583bf10-f925-4032-bb94-7072e52a21b9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:11.259609 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1583bf10-f925-4032-bb94-7072e52a21b9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607" status: 200 len: 1346 microversion: 2.1 time: 0.463573 Aug 04 17:01:11.263388 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 850/1653] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:10 2022] GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607 => generated 1346 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:11.268659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-14fa5c28-7147-431a-823d-042081e27fa0 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:11.274812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-14fa5c28-7147-431a-823d-042081e27fa0 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:11.292199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14fa5c28-7147-431a-823d-042081e27fa0 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:11.296668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14fa5c28-7147-431a-823d-042081e27fa0 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:11.297403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14fa5c28-7147-431a-823d-042081e27fa0 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:11.298491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14fa5c28-7147-431a-823d-042081e27fa0 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:11.302092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14fa5c28-7147-431a-823d-042081e27fa0 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:11.303029 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14fa5c28-7147-431a-823d-042081e27fa0 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:11.448288 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-730bb59c-820d-4e22-923f-976b356c6a7e tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:11.461045 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-730bb59c-820d-4e22-923f-976b356c6a7e tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8" status: 200 len: 1526 microversion: 2.1 time: 0.831912 Aug 04 17:01:11.465294 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 804/1654] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:10 2022] GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8 => generated 1526 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:11.477574 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e4b6e82d-2473-44fa-bfeb-09fbddf29246 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:11.479341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e4b6e82d-2473-44fa-bfeb-09fbddf29246 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:11.500397 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4b6e82d-2473-44fa-bfeb-09fbddf29246 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:11.501424 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4b6e82d-2473-44fa-bfeb-09fbddf29246 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:11.502490 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4b6e82d-2473-44fa-bfeb-09fbddf29246 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:11.503815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4b6e82d-2473-44fa-bfeb-09fbddf29246 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:11.504773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4b6e82d-2473-44fa-bfeb-09fbddf29246 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:11.505617 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4b6e82d-2473-44fa-bfeb-09fbddf29246 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:11.658302 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-14fa5c28-7147-431a-823d-042081e27fa0 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lazy-loading 'services' on Instance uuid afea0f77-8d91-4170-934f-b6b7ef64d5a6 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:01:11.689610 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-14fa5c28-7147-431a-823d-042081e27fa0 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 2419 microversion: 2.25 time: 0.424555 Aug 04 17:01:11.692424 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 851/1655] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:11 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 2419 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:11.700324 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7293c90a-5989-4d3c-8083-e2ff34e22624 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:11.705855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7293c90a-5989-4d3c-8083-e2ff34e22624 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0aa159af-25ad-4e88-adfd-88736802c68b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:11.874912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7293c90a-5989-4d3c-8083-e2ff34e22624 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:11.883319 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7293c90a-5989-4d3c-8083-e2ff34e22624 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b" status: 200 len: 1208 microversion: 2.1 time: 0.189552 Aug 04 17:01:11.889098 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 852/1656] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:11 2022] GET /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b => generated 1208 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:11.903130 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9efe44f4-f84c-45df-b39f-003b00605e55 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:11.903768 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9efe44f4-f84c-45df-b39f-003b00605e55 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:11.927498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9efe44f4-f84c-45df-b39f-003b00605e55 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:11.929463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9efe44f4-f84c-45df-b39f-003b00605e55 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:11.938029 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9efe44f4-f84c-45df-b39f-003b00605e55 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:11.939433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9efe44f4-f84c-45df-b39f-003b00605e55 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:11.942366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9efe44f4-f84c-45df-b39f-003b00605e55 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:11.944408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9efe44f4-f84c-45df-b39f-003b00605e55 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:12.106008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e4b6e82d-2473-44fa-bfeb-09fbddf29246 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:12.120514 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e4b6e82d-2473-44fa-bfeb-09fbddf29246 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 200 len: 1468 microversion: 2.1 time: 0.653590 Aug 04 17:01:12.123260 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 805/1657] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:11 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 1468 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:12.141488 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-13417900-4394-4284-ac74-eaf192af8290 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:12.142304 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-13417900-4394-4284-ac74-eaf192af8290 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:12.178304 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13417900-4394-4284-ac74-eaf192af8290 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:12.179965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13417900-4394-4284-ac74-eaf192af8290 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:12.180419 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13417900-4394-4284-ac74-eaf192af8290 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:12.181402 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13417900-4394-4284-ac74-eaf192af8290 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:12.184168 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13417900-4394-4284-ac74-eaf192af8290 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:12.185391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13417900-4394-4284-ac74-eaf192af8290 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:12.874575 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9efe44f4-f84c-45df-b39f-003b00605e55 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:12.885666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9efe44f4-f84c-45df-b39f-003b00605e55 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:12.887846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9efe44f4-f84c-45df-b39f-003b00605e55 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:12.889704 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9efe44f4-f84c-45df-b39f-003b00605e55 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1875 microversion: 2.32 time: 0.999320 Aug 04 17:01:12.921573 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 853/1658] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:11 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1875 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:12.928189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-16255f0d-75fb-43a7-9c12-f629aa983826 req-8484a823-25c3-464a-9cbe-8749413537a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07628113-e50c-4c63-bff3-0401009c87c8", "name": "network-vif-deleted", "tag": "a6e94576-42ff-4f94-90f7-18335cd81c04"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:12.945816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-16255f0d-75fb-43a7-9c12-f629aa983826 req-8484a823-25c3-464a-9cbe-8749413537a4 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:12.946750 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-16255f0d-75fb-43a7-9c12-f629aa983826 req-8484a823-25c3-464a-9cbe-8749413537a4 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:12.947427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-16255f0d-75fb-43a7-9c12-f629aa983826 req-8484a823-25c3-464a-9cbe-8749413537a4 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:12.965788 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-16255f0d-75fb-43a7-9c12-f629aa983826 req-8484a823-25c3-464a-9cbe-8749413537a4 service nova] Creating event network-vif-deleted:a6e94576-42ff-4f94-90f7-18335cd81c04 for instance 07628113-e50c-4c63-bff3-0401009c87c8 on n-h1-851359-3 Aug 04 17:01:12.974826 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-16255f0d-75fb-43a7-9c12-f629aa983826 req-8484a823-25c3-464a-9cbe-8749413537a4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050579 Aug 04 17:01:12.976041 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 854/1659] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:12.982761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-b2f77c17-c454-4dcd-9300-8514e52a3440 req-6b8b62d2-a9e9-44e4-a97a-b8073a823d58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cfbd46c-8842-4119-a0d0-7bf5827e45d3", "name": "network-vif-deleted", "tag": "6b6134e1-88b8-41c8-9a22-a162b6145647"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:12.997804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b2f77c17-c454-4dcd-9300-8514e52a3440 req-6b8b62d2-a9e9-44e4-a97a-b8073a823d58 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:12.998497 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b2f77c17-c454-4dcd-9300-8514e52a3440 req-6b8b62d2-a9e9-44e4-a97a-b8073a823d58 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:12.999478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b2f77c17-c454-4dcd-9300-8514e52a3440 req-6b8b62d2-a9e9-44e4-a97a-b8073a823d58 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:13.043735 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-b2f77c17-c454-4dcd-9300-8514e52a3440 req-6b8b62d2-a9e9-44e4-a97a-b8073a823d58 service nova] Creating event network-vif-deleted:6b6134e1-88b8-41c8-9a22-a162b6145647 for instance 6cfbd46c-8842-4119-a0d0-7bf5827e45d3 on n-h1-851359-3 Aug 04 17:01:13.044715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-13417900-4394-4284-ac74-eaf192af8290 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lazy-loading 'services' on Instance uuid afea0f77-8d91-4170-934f-b6b7ef64d5a6 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:01:13.058103 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-b2f77c17-c454-4dcd-9300-8514e52a3440 req-6b8b62d2-a9e9-44e4-a97a-b8073a823d58 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080400 Aug 04 17:01:13.059082 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 855/1660] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:13.069066 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-13417900-4394-4284-ac74-eaf192af8290 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 2419 microversion: 2.25 time: 0.939608 Aug 04 17:01:13.070705 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 806/1661] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:12 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 2419 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:13.076086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b0ef9c86-2829-4b84-acae-f45d683df056 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:13.076804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b0ef9c86-2829-4b84-acae-f45d683df056 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: b4f45353-5340-4cfe-a8c3-0aeeef958607] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:13.079311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8362baf3-ac2d-444a-8382-b8e9357aafd9 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:13.080111 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8362baf3-ac2d-444a-8382-b8e9357aafd9 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:13.094005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8362baf3-ac2d-444a-8382-b8e9357aafd9 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:13.094686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8362baf3-ac2d-444a-8382-b8e9357aafd9 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:13.095368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8362baf3-ac2d-444a-8382-b8e9357aafd9 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:13.097288 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8362baf3-ac2d-444a-8382-b8e9357aafd9 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:13.098542 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8362baf3-ac2d-444a-8382-b8e9357aafd9 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:13.099179 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8362baf3-ac2d-444a-8382-b8e9357aafd9 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:13.124634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0ef9c86-2829-4b84-acae-f45d683df056 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:13.134757 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0ef9c86-2829-4b84-acae-f45d683df056 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:13.135350 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0ef9c86-2829-4b84-acae-f45d683df056 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:13.136116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0ef9c86-2829-4b84-acae-f45d683df056 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:13.136585 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0ef9c86-2829-4b84-acae-f45d683df056 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:13.137022 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0ef9c86-2829-4b84-acae-f45d683df056 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:13.154265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8362baf3-ac2d-444a-8382-b8e9357aafd9 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:13.156352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8362baf3-ac2d-444a-8382-b8e9357aafd9 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:13.157039 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8362baf3-ac2d-444a-8382-b8e9357aafd9 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:13.159519 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-8362baf3-ac2d-444a-8382-b8e9357aafd9 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lazy-loading 'fault' on Instance uuid 07628113-e50c-4c63-bff3-0401009c87c8 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:01:13.335202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8362baf3-ac2d-444a-8382-b8e9357aafd9 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df06c4b403cc4fe5b76915e685b7cef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65efeb63178649a7bdc50a90cfc112e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:13.346194 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8362baf3-ac2d-444a-8382-b8e9357aafd9 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8" status: 200 len: 1314 microversion: 2.1 time: 0.272983 Aug 04 17:01:13.350072 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 807/1662] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:13 2022] GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:13.369453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-349ec58d-e897-4cb0-bd03-c69d113fad23 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:13.373667 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-349ec58d-e897-4cb0-bd03-c69d113fad23 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0aa159af-25ad-4e88-adfd-88736802c68b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:13.393674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-349ec58d-e897-4cb0-bd03-c69d113fad23 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:13.394853 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-349ec58d-e897-4cb0-bd03-c69d113fad23 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:13.396315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-349ec58d-e897-4cb0-bd03-c69d113fad23 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:13.397120 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-349ec58d-e897-4cb0-bd03-c69d113fad23 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:13.398010 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-349ec58d-e897-4cb0-bd03-c69d113fad23 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:13.398468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-349ec58d-e897-4cb0-bd03-c69d113fad23 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:13.410680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b0ef9c86-2829-4b84-acae-f45d683df056 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:13.421150 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b0ef9c86-2829-4b84-acae-f45d683df056 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607" status: 200 len: 1346 microversion: 2.1 time: 0.360850 Aug 04 17:01:13.436997 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 856/1663] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:13 2022] GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607 => generated 1346 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:13.465550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f2cfdad9-ce32-4f14-8002-1a9e6061f423 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:13.470112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f2cfdad9-ce32-4f14-8002-1a9e6061f423 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: 6cfbd46c-8842-4119-a0d0-7bf5827e45d3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:13.499549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2cfdad9-ce32-4f14-8002-1a9e6061f423 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:13.502647 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2cfdad9-ce32-4f14-8002-1a9e6061f423 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:13.503361 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2cfdad9-ce32-4f14-8002-1a9e6061f423 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:13.506972 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2cfdad9-ce32-4f14-8002-1a9e6061f423 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:13.513446 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2cfdad9-ce32-4f14-8002-1a9e6061f423 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:13.514235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2cfdad9-ce32-4f14-8002-1a9e6061f423 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:13.558485 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-f2cfdad9-ce32-4f14-8002-1a9e6061f423 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] HTTP exception thrown: Instance 6cfbd46c-8842-4119-a0d0-7bf5827e45d3 could not be found. Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f2cfdad9-ce32-4f14-8002-1a9e6061f423 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Request method failure captured: Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 HTTP/1.1 Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_nr6TM3VDFE0-a7GjdiPSkulOf76f1c2TbMoDiupaK9Lm5BhPfOeB57S5f3P9qy6YnDYHcKeg0lfdcHN3-0oPuIBLHcgZhXXL7A_HDfLwIpPHXCuAHrcjdKo53PMyOZ9qRxp28gZSglpaT-ZejdPX9f_LNrtsS6BL7HFdN-3zw1bXU Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 6f64e49086c94f65ba1fc2ef97b6bcde Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-MigrationsAdminTest-207825081 Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6f64e49086c94f65ba1fc2ef97b6bcde"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6f64e49086c94f65ba1fc2ef97b6bcde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6f64e49086c94f65ba1fc2ef97b6bcde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6f64e49086c94f65ba1fc2ef97b6bcde"}]}] Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-MigrationsAdminTest-207825081 Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 6f64e49086c94f65ba1fc2ef97b6bcde Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-MigrationsAdminTest-207825081 Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-MigrationsAdminTest-207825081-project Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 655795644d9941c99a82d15d9daa5ab5 Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-MigrationsAdminTest-207825081-project Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 6cfbd46c-8842-4119-a0d0-7bf5827e45d3 could not be found. Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '6cfbd46c-8842-4119-a0d0-7bf5827e45d3'} Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cfbd46c-8842-4119-a0d0-7bf5827e45d3 could not be found. Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cfbd46c-8842-4119-a0d0-7bf5827e45d3 could not be found. Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:13.563231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:13.569229 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:13.569229 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:13.569229 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:13.569229 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:01:13.569229 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:01:13.569229 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cfbd46c-8842-4119-a0d0-7bf5827e45d3 could not be found. Aug 04 17:01:13.569229 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:13.571069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f2cfdad9-ce32-4f14-8002-1a9e6061f423 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Returning 404 to user: Instance 6cfbd46c-8842-4119-a0d0-7bf5827e45d3 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:01:13.575681 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f2cfdad9-ce32-4f14-8002-1a9e6061f423 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3" status: 404 len: 111 microversion: 2.1 time: 0.132601 Aug 04 17:01:13.578352 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 857/1664] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:13 2022] GET /compute/v2.1/servers/6cfbd46c-8842-4119-a0d0-7bf5827e45d3 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:01:13.593116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4db1d458-ce13-420e-9d98-295d7f0a0c9f tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:13.597348 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4db1d458-ce13-420e-9d98-295d7f0a0c9f tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:13.616062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4db1d458-ce13-420e-9d98-295d7f0a0c9f tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:13.616925 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4db1d458-ce13-420e-9d98-295d7f0a0c9f tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:13.618850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4db1d458-ce13-420e-9d98-295d7f0a0c9f tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:13.619814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4db1d458-ce13-420e-9d98-295d7f0a0c9f tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:13.621415 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4db1d458-ce13-420e-9d98-295d7f0a0c9f tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:13.626917 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-349ec58d-e897-4cb0-bd03-c69d113fad23 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:13.636130 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4db1d458-ce13-420e-9d98-295d7f0a0c9f tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:13.637750 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-349ec58d-e897-4cb0-bd03-c69d113fad23 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b" status: 200 len: 1268 microversion: 2.1 time: 0.282556 Aug 04 17:01:13.642693 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 808/1665] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:13 2022] GET /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b => generated 1268 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:13.666222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-37e1c96a-15f6-4a04-9883-fe2bd509d9d2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:13.667406 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-37e1c96a-15f6-4a04-9883-fe2bd509d9d2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:13.689442 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37e1c96a-15f6-4a04-9883-fe2bd509d9d2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:13.695573 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37e1c96a-15f6-4a04-9883-fe2bd509d9d2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:13.697107 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37e1c96a-15f6-4a04-9883-fe2bd509d9d2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:13.698685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37e1c96a-15f6-4a04-9883-fe2bd509d9d2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:13.703895 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37e1c96a-15f6-4a04-9883-fe2bd509d9d2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:13.705020 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37e1c96a-15f6-4a04-9883-fe2bd509d9d2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:13.791640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-37e1c96a-15f6-4a04-9883-fe2bd509d9d2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:01:13.863868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-4db1d458-ce13-420e-9d98-295d7f0a0c9f tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lazy-loading 'services' on Instance uuid afea0f77-8d91-4170-934f-b6b7ef64d5a6 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:01:14.017782 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-37e1c96a-15f6-4a04-9883-fe2bd509d9d2 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "DELETE /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 204 len: 0 microversion: 2.1 time: 0.365243 Aug 04 17:01:14.030610 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 809/1666] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:01:13 2022] DELETE /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:01:14.047436 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4db1d458-ce13-420e-9d98-295d7f0a0c9f tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "DELETE /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6/os-volume_attachments/02ea4a2e-c015-444f-b810-16702890c1c3" status: 202 len: 0 microversion: 2.25 time: 0.459647 Aug 04 17:01:14.051905 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 858/1667] 10.222.0.93 () {60 vars in 1457 bytes} [Thu Aug 4 17:01:13 2022] DELETE /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6/os-volume_attachments/02ea4a2e-c015-444f-b810-16702890c1c3 => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:01:14.059356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-56807ce5-2325-4f23-8a6d-6602edff350d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:14.060981 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-56807ce5-2325-4f23-8a6d-6602edff350d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:14.069346 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56807ce5-2325-4f23-8a6d-6602edff350d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:14.070128 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56807ce5-2325-4f23-8a6d-6602edff350d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:14.070744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56807ce5-2325-4f23-8a6d-6602edff350d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:14.071666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56807ce5-2325-4f23-8a6d-6602edff350d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:14.072499 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56807ce5-2325-4f23-8a6d-6602edff350d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:14.073115 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56807ce5-2325-4f23-8a6d-6602edff350d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:14.081815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-56f6bb4b-0449-4d80-a87c-648dbfe9e0bc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:14.100555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-56f6bb4b-0449-4d80-a87c-648dbfe9e0bc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:14.130657 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56f6bb4b-0449-4d80-a87c-648dbfe9e0bc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:14.134082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56f6bb4b-0449-4d80-a87c-648dbfe9e0bc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:14.148047 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56f6bb4b-0449-4d80-a87c-648dbfe9e0bc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:14.149366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56f6bb4b-0449-4d80-a87c-648dbfe9e0bc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:14.155741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56f6bb4b-0449-4d80-a87c-648dbfe9e0bc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:14.157109 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56f6bb4b-0449-4d80-a87c-648dbfe9e0bc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:14.374632 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-56807ce5-2325-4f23-8a6d-6602edff350d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:14.391239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-56807ce5-2325-4f23-8a6d-6602edff350d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:14.392376 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-56807ce5-2325-4f23-8a6d-6602edff350d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:14.395407 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-56807ce5-2325-4f23-8a6d-6602edff350d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1875 microversion: 2.32 time: 0.356096 Aug 04 17:01:14.414487 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 810/1668] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:14 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1875 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:14.429759 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-45507d0f-a847-4e84-a087-96a20f6386f2 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:14.434462 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-45507d0f-a847-4e84-a087-96a20f6386f2 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:14.452445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45507d0f-a847-4e84-a087-96a20f6386f2 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:14.452964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45507d0f-a847-4e84-a087-96a20f6386f2 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:14.453417 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45507d0f-a847-4e84-a087-96a20f6386f2 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:14.455925 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45507d0f-a847-4e84-a087-96a20f6386f2 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:14.457901 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45507d0f-a847-4e84-a087-96a20f6386f2 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:14.459643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45507d0f-a847-4e84-a087-96a20f6386f2 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:14.545009 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-45507d0f-a847-4e84-a087-96a20f6386f2 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.129690 Aug 04 17:01:14.549249 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 811/1669] 10.222.0.93 () {60 vars in 1343 bytes} [Thu Aug 4 17:01:14 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:01:14.560595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f0c6c92e-c014-41d7-bf75-cfe087ce3dc2 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:14.561553 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f0c6c92e-c014-41d7-bf75-cfe087ce3dc2 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] [instance: 07628113-e50c-4c63-bff3-0401009c87c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:14.574605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0c6c92e-c014-41d7-bf75-cfe087ce3dc2 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:14.576558 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0c6c92e-c014-41d7-bf75-cfe087ce3dc2 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:14.577327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0c6c92e-c014-41d7-bf75-cfe087ce3dc2 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:14.578863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0c6c92e-c014-41d7-bf75-cfe087ce3dc2 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:14.580903 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0c6c92e-c014-41d7-bf75-cfe087ce3dc2 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:14.582753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0c6c92e-c014-41d7-bf75-cfe087ce3dc2 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:14.621211 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-56f6bb4b-0449-4d80-a87c-648dbfe9e0bc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:14.629964 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-56f6bb4b-0449-4d80-a87c-648dbfe9e0bc tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1468 microversion: 2.1 time: 0.570287 Aug 04 17:01:14.631527 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-f0c6c92e-c014-41d7-bf75-cfe087ce3dc2 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] HTTP exception thrown: Instance 07628113-e50c-4c63-bff3-0401009c87c8 could not be found. Aug 04 17:01:14.632868 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 859/1670] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:14 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1468 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f0c6c92e-c014-41d7-bf75-cfe087ce3dc2 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Request method failure captured: Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8 HTTP/1.1 Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_rnHES_MWst1WXo_1XUJdaO_nmyJ0CPyBNTl2JIyP0Gg86LjCv6PPQ65sD1HuGK49uxmX7aq0siRxkSlVe0KF0dw7tW2qKp5CVHC3hR1waWCH3FFfNaXDMRUMlp2svVSme9vfcGnHDM3waAkVkQB6pnU45Lv6Z4EqCxzxMP2eOHLI4 Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 65efeb63178649a7bdc50a90cfc112e9 Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-37287949 Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/65efeb63178649a7bdc50a90cfc112e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/65efeb63178649a7bdc50a90cfc112e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_65efeb63178649a7bdc50a90cfc112e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/65efeb63178649a7bdc50a90cfc112e9"}]}] Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-37287949 Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 65efeb63178649a7bdc50a90cfc112e9 Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-37287949 Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-FloatingIPsAssociationTestJSON-37287949-project Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: df06c4b403cc4fe5b76915e685b7cef5 Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-37287949-project Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 07628113-e50c-4c63-bff3-0401009c87c8 could not be found. Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '07628113-e50c-4c63-bff3-0401009c87c8'} Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07628113-e50c-4c63-bff3-0401009c87c8 could not be found. Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07628113-e50c-4c63-bff3-0401009c87c8 could not be found. Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:01:14.636606 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:14.641851 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:01:14.641851 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:14.641851 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:14.641851 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:14.641851 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:01:14.641851 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:01:14.641851 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07628113-e50c-4c63-bff3-0401009c87c8 could not be found. Aug 04 17:01:14.641851 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:01:14.648509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f0c6c92e-c014-41d7-bf75-cfe087ce3dc2 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] Returning 404 to user: Instance 07628113-e50c-4c63-bff3-0401009c87c8 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:01:14.651379 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f0c6c92e-c014-41d7-bf75-cfe087ce3dc2 tempest-FloatingIPsAssociationTestJSON-37287949 tempest-FloatingIPsAssociationTestJSON-37287949-project] 10.222.0.93 "GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8" status: 404 len: 111 microversion: 2.1 time: 0.099349 Aug 04 17:01:14.653017 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 812/1671] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:14 2022] GET /compute/v2.1/servers/07628113-e50c-4c63-bff3-0401009c87c8 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:01:14.661879 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e02cbac5-2380-4b12-9526-f37cb572b0fd tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:14.667385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e02cbac5-2380-4b12-9526-f37cb572b0fd tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: b4f45353-5340-4cfe-a8c3-0aeeef958607] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:14.671548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:14.675013 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7be011e4-fcaf-49c5-ad9f-19896c56fed5 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:14.675678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7be011e4-fcaf-49c5-ad9f-19896c56fed5 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0aa159af-25ad-4e88-adfd-88736802c68b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:14.690160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e02cbac5-2380-4b12-9526-f37cb572b0fd tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:14.690675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e02cbac5-2380-4b12-9526-f37cb572b0fd tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:14.691127 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e02cbac5-2380-4b12-9526-f37cb572b0fd tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:14.692412 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e02cbac5-2380-4b12-9526-f37cb572b0fd tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:14.692885 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e02cbac5-2380-4b12-9526-f37cb572b0fd tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:14.693326 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e02cbac5-2380-4b12-9526-f37cb572b0fd tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:14.703762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7be011e4-fcaf-49c5-ad9f-19896c56fed5 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:14.704261 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7be011e4-fcaf-49c5-ad9f-19896c56fed5 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:14.705554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7be011e4-fcaf-49c5-ad9f-19896c56fed5 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:14.706337 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7be011e4-fcaf-49c5-ad9f-19896c56fed5 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:14.706815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7be011e4-fcaf-49c5-ad9f-19896c56fed5 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:14.707817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7be011e4-fcaf-49c5-ad9f-19896c56fed5 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:15.080545 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e02cbac5-2380-4b12-9526-f37cb572b0fd tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:15.093046 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e02cbac5-2380-4b12-9526-f37cb572b0fd tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607" status: 200 len: 1346 microversion: 2.1 time: 0.457525 Aug 04 17:01:15.097123 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7be011e4-fcaf-49c5-ad9f-19896c56fed5 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:15.108985 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7be011e4-fcaf-49c5-ad9f-19896c56fed5 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b" status: 200 len: 1266 microversion: 2.1 time: 0.445154 Aug 04 17:01:15.112147 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 860/1672] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:14 2022] GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607 => generated 1346 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:15.130136 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 813/1673] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:14 2022] GET /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b => generated 1266 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:01:15.424389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a81b2a61-a67e-4505-806b-f8ffa57d4c7a tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:15.425128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a81b2a61-a67e-4505-806b-f8ffa57d4c7a tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:15.446374 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a81b2a61-a67e-4505-806b-f8ffa57d4c7a tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:15.446888 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a81b2a61-a67e-4505-806b-f8ffa57d4c7a tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:15.449457 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a81b2a61-a67e-4505-806b-f8ffa57d4c7a tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:15.450574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a81b2a61-a67e-4505-806b-f8ffa57d4c7a tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:15.453222 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a81b2a61-a67e-4505-806b-f8ffa57d4c7a tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:15.454458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a81b2a61-a67e-4505-806b-f8ffa57d4c7a tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:15.561713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bba2ce6e-ab0d-4efa-8f92-34598b04a8b6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:15.564128 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bba2ce6e-ab0d-4efa-8f92-34598b04a8b6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:15.579526 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bba2ce6e-ab0d-4efa-8f92-34598b04a8b6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:15.580028 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bba2ce6e-ab0d-4efa-8f92-34598b04a8b6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:15.589591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bba2ce6e-ab0d-4efa-8f92-34598b04a8b6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:15.591855 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bba2ce6e-ab0d-4efa-8f92-34598b04a8b6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:15.592520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bba2ce6e-ab0d-4efa-8f92-34598b04a8b6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:15.594924 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bba2ce6e-ab0d-4efa-8f92-34598b04a8b6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:15.679894 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bba2ce6e-ab0d-4efa-8f92-34598b04a8b6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.123776 Aug 04 17:01:15.686384 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 814/1674] 10.222.0.93 () {60 vars in 1343 bytes} [Thu Aug 4 17:01:15 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 17:01:15.696600 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-40a5c249-8c8e-4764-8d94-dab6e7d9d326 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:15.697453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-40a5c249-8c8e-4764-8d94-dab6e7d9d326 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:15.712642 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40a5c249-8c8e-4764-8d94-dab6e7d9d326 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:15.719124 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40a5c249-8c8e-4764-8d94-dab6e7d9d326 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:15.720700 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40a5c249-8c8e-4764-8d94-dab6e7d9d326 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:15.721965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40a5c249-8c8e-4764-8d94-dab6e7d9d326 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:15.722940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40a5c249-8c8e-4764-8d94-dab6e7d9d326 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:15.723674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40a5c249-8c8e-4764-8d94-dab6e7d9d326 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:16.228797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a81b2a61-a67e-4505-806b-f8ffa57d4c7a tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:16.247193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a81b2a61-a67e-4505-806b-f8ffa57d4c7a tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:16.255254 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a81b2a61-a67e-4505-806b-f8ffa57d4c7a tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:16.258111 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a81b2a61-a67e-4505-806b-f8ffa57d4c7a tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1875 microversion: 2.32 time: 0.838967 Aug 04 17:01:16.261706 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 861/1675] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:15 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1875 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:16.278754 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-40a5c249-8c8e-4764-8d94-dab6e7d9d326 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:16.282999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d9569528-c71a-4c29-a26a-fce1d4d5b1f1 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:16.292288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d9569528-c71a-4c29-a26a-fce1d4d5b1f1 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0aa159af-25ad-4e88-adfd-88736802c68b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:16.299571 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-40a5c249-8c8e-4764-8d94-dab6e7d9d326 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1468 microversion: 2.1 time: 0.611794 Aug 04 17:01:16.310065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9569528-c71a-4c29-a26a-fce1d4d5b1f1 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:16.311415 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9569528-c71a-4c29-a26a-fce1d4d5b1f1 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:16.312102 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9569528-c71a-4c29-a26a-fce1d4d5b1f1 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:16.313353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9569528-c71a-4c29-a26a-fce1d4d5b1f1 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:16.314157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9569528-c71a-4c29-a26a-fce1d4d5b1f1 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:16.318296 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 815/1676] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:15 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1468 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:16.334580 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-74459984-4aaf-4c5c-89e1-ccd4c547c58b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:16.335467 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9569528-c71a-4c29-a26a-fce1d4d5b1f1 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:16.337421 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-74459984-4aaf-4c5c-89e1-ccd4c547c58b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: b4f45353-5340-4cfe-a8c3-0aeeef958607] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:16.354518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74459984-4aaf-4c5c-89e1-ccd4c547c58b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:16.356197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74459984-4aaf-4c5c-89e1-ccd4c547c58b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:16.357900 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74459984-4aaf-4c5c-89e1-ccd4c547c58b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:16.362172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74459984-4aaf-4c5c-89e1-ccd4c547c58b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:16.364855 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74459984-4aaf-4c5c-89e1-ccd4c547c58b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:16.367905 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74459984-4aaf-4c5c-89e1-ccd4c547c58b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:16.459722 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74459984-4aaf-4c5c-89e1-ccd4c547c58b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:16.462340 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74459984-4aaf-4c5c-89e1-ccd4c547c58b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:16.463704 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74459984-4aaf-4c5c-89e1-ccd4c547c58b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:16.465199 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-74459984-4aaf-4c5c-89e1-ccd4c547c58b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lazy-loading 'fault' on Instance uuid b4f45353-5340-4cfe-a8c3-0aeeef958607 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:01:16.668316 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-74459984-4aaf-4c5c-89e1-ccd4c547c58b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:16.677269 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-74459984-4aaf-4c5c-89e1-ccd4c547c58b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607" status: 200 len: 1305 microversion: 2.1 time: 0.357615 Aug 04 17:01:16.698992 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 816/1677] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:16 2022] GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607 => generated 1305 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:16.718659 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2ba4d6e5-5762-44b4-b3a3-2831feb58d3a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:16.726402 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2ba4d6e5-5762-44b4-b3a3-2831feb58d3a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:16.737493 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ba4d6e5-5762-44b4-b3a3-2831feb58d3a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:16.742507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ba4d6e5-5762-44b4-b3a3-2831feb58d3a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:16.743789 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ba4d6e5-5762-44b4-b3a3-2831feb58d3a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:16.745661 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ba4d6e5-5762-44b4-b3a3-2831feb58d3a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:16.747478 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ba4d6e5-5762-44b4-b3a3-2831feb58d3a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:16.748506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ba4d6e5-5762-44b4-b3a3-2831feb58d3a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:16.798108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:16.819151 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2ba4d6e5-5762-44b4-b3a3-2831feb58d3a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.117355 Aug 04 17:01:16.824962 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 817/1678] 10.222.0.93 () {60 vars in 1343 bytes} [Thu Aug 4 17:01:16 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:01:16.937914 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d9569528-c71a-4c29-a26a-fce1d4d5b1f1 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:16.954450 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d9569528-c71a-4c29-a26a-fce1d4d5b1f1 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b" status: 200 len: 1308 microversion: 2.1 time: 0.690353 Aug 04 17:01:16.961116 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 862/1679] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:16 2022] GET /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b => generated 1308 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:17.296407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-34cf7675-9091-48af-8886-0603358fcc54 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:17.299897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-34cf7675-9091-48af-8886-0603358fcc54 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:17.324692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34cf7675-9091-48af-8886-0603358fcc54 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:17.325821 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34cf7675-9091-48af-8886-0603358fcc54 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:17.330691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34cf7675-9091-48af-8886-0603358fcc54 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:17.331263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-07ef6ab5-e89a-4150-859e-c31bfa7ee564 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:17.331869 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-07ef6ab5-e89a-4150-859e-c31bfa7ee564 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:17.335502 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34cf7675-9091-48af-8886-0603358fcc54 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:17.338454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34cf7675-9091-48af-8886-0603358fcc54 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:17.341463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34cf7675-9091-48af-8886-0603358fcc54 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:17.369781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-07ef6ab5-e89a-4150-859e-c31bfa7ee564 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:17.372646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-07ef6ab5-e89a-4150-859e-c31bfa7ee564 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:17.374453 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-07ef6ab5-e89a-4150-859e-c31bfa7ee564 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:17.375919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-07ef6ab5-e89a-4150-859e-c31bfa7ee564 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:17.380136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-07ef6ab5-e89a-4150-859e-c31bfa7ee564 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:17.380849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-07ef6ab5-e89a-4150-859e-c31bfa7ee564 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:17.724692 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-07ef6ab5-e89a-4150-859e-c31bfa7ee564 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '655795644d9941c99a82d15d9daa5ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f64e49086c94f65ba1fc2ef97b6bcde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:17.759454 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-07ef6ab5-e89a-4150-859e-c31bfa7ee564 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 200 len: 1297 microversion: 2.1 time: 0.427305 Aug 04 17:01:17.761390 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 863/1680] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:17 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 1297 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:17.783713 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-330428b1-fb24-4db5-b225-f0001983334a req-54208b52-978d-441b-8d61-3dc0b7325f5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0b4f50d-df7a-44ab-87d8-054aa370c979", "name": "network-vif-deleted", "tag": "6defc06d-afcb-4aaa-9d45-8000639706e7"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:17.823517 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-330428b1-fb24-4db5-b225-f0001983334a req-54208b52-978d-441b-8d61-3dc0b7325f5a service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:17.828743 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-330428b1-fb24-4db5-b225-f0001983334a req-54208b52-978d-441b-8d61-3dc0b7325f5a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:17.833437 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-330428b1-fb24-4db5-b225-f0001983334a req-54208b52-978d-441b-8d61-3dc0b7325f5a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:17.885166 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-330428b1-fb24-4db5-b225-f0001983334a req-54208b52-978d-441b-8d61-3dc0b7325f5a service nova] Creating event network-vif-deleted:6defc06d-afcb-4aaa-9d45-8000639706e7 for instance d0b4f50d-df7a-44ab-87d8-054aa370c979 on n-h2-851359-3 Aug 04 17:01:17.905429 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-330428b1-fb24-4db5-b225-f0001983334a req-54208b52-978d-441b-8d61-3dc0b7325f5a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141782 Aug 04 17:01:17.906180 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 864/1681] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:17.913535 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-95d7bdfb-273e-4d19-b9d5-62dbc02ce0a9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:17.921395 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-95d7bdfb-273e-4d19-b9d5-62dbc02ce0a9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: b4f45353-5340-4cfe-a8c3-0aeeef958607] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:17.940106 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95d7bdfb-273e-4d19-b9d5-62dbc02ce0a9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:17.940929 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95d7bdfb-273e-4d19-b9d5-62dbc02ce0a9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:17.941854 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95d7bdfb-273e-4d19-b9d5-62dbc02ce0a9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:17.943185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95d7bdfb-273e-4d19-b9d5-62dbc02ce0a9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:17.944465 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95d7bdfb-273e-4d19-b9d5-62dbc02ce0a9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:17.945595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95d7bdfb-273e-4d19-b9d5-62dbc02ce0a9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:18.015658 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-95d7bdfb-273e-4d19-b9d5-62dbc02ce0a9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] HTTP exception thrown: Instance b4f45353-5340-4cfe-a8c3-0aeeef958607 could not be found. Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-95d7bdfb-273e-4d19-b9d5-62dbc02ce0a9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Request method failure captured: Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607 HTTP/1.1 Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_r18zhXKrUNPkTcrqBpyOxEtqmRnN_52CLFZjb6_V1_cyggOBj-ig1uBg8_Jl5DEv1edGlVMK7wsNG9aSNASIbB3U35pyAy7fX4gAPexD_7GsQqaSV2-qce83lQvxIJx4U5ZPEYYCvd7_VfIsOpvvr8aQqah0W-5V3XON-ztAeWk4Y Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/92bb708c7ba24e4d828f19ecc60e1f91"}]}] Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 6d19d8e7953b4e479b4e2143a3c3546a Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance b4f45353-5340-4cfe-a8c3-0aeeef958607 could not be found. Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'b4f45353-5340-4cfe-a8c3-0aeeef958607'} Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4f45353-5340-4cfe-a8c3-0aeeef958607 could not be found. Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4f45353-5340-4cfe-a8c3-0aeeef958607 could not be found. Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:18.021205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:18.027448 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:18.027448 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:18.027448 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:18.027448 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:01:18.027448 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:01:18.027448 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4f45353-5340-4cfe-a8c3-0aeeef958607 could not be found. Aug 04 17:01:18.027448 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:18.031871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-95d7bdfb-273e-4d19-b9d5-62dbc02ce0a9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Returning 404 to user: Instance b4f45353-5340-4cfe-a8c3-0aeeef958607 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:01:18.031871 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-95d7bdfb-273e-4d19-b9d5-62dbc02ce0a9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607" status: 404 len: 111 microversion: 2.1 time: 0.122111 Aug 04 17:01:18.038194 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 865/1682] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:17 2022] GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:01:18.070595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d7ace8e4-d777-4fc4-b21a-0a9ed64a13e6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:18.078165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d7ace8e4-d777-4fc4-b21a-0a9ed64a13e6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:18.122720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7ace8e4-d777-4fc4-b21a-0a9ed64a13e6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:18.130800 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7ace8e4-d777-4fc4-b21a-0a9ed64a13e6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:18.132162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7ace8e4-d777-4fc4-b21a-0a9ed64a13e6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:18.133430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7ace8e4-d777-4fc4-b21a-0a9ed64a13e6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:18.134995 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7ace8e4-d777-4fc4-b21a-0a9ed64a13e6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:18.136455 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7ace8e4-d777-4fc4-b21a-0a9ed64a13e6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:18.281392 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d7ace8e4-d777-4fc4-b21a-0a9ed64a13e6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.241661 Aug 04 17:01:18.283993 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 866/1683] 10.222.0.93 () {60 vars in 1343 bytes} [Thu Aug 4 17:01:18 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6/os-volume_attachments => generated 197 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:01:18.304623 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-961320e2-f0dc-4b8c-8f27-c0f2c0cd4ae1 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:18.305355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-961320e2-f0dc-4b8c-8f27-c0f2c0cd4ae1 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0aa159af-25ad-4e88-adfd-88736802c68b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:18.326821 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-961320e2-f0dc-4b8c-8f27-c0f2c0cd4ae1 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:18.329400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-961320e2-f0dc-4b8c-8f27-c0f2c0cd4ae1 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:18.330624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-961320e2-f0dc-4b8c-8f27-c0f2c0cd4ae1 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:18.333783 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-961320e2-f0dc-4b8c-8f27-c0f2c0cd4ae1 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:18.339154 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-961320e2-f0dc-4b8c-8f27-c0f2c0cd4ae1 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:18.340809 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-961320e2-f0dc-4b8c-8f27-c0f2c0cd4ae1 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:18.539939 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-34cf7675-9091-48af-8886-0603358fcc54 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:18.563764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-34cf7675-9091-48af-8886-0603358fcc54 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:18.565691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-34cf7675-9091-48af-8886-0603358fcc54 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:18.568128 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-34cf7675-9091-48af-8886-0603358fcc54 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1875 microversion: 2.32 time: 1.279379 Aug 04 17:01:18.589577 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 818/1684] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:17 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1875 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:18.596276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-463673c1-b6b9-4830-a45e-e78b967eba11 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:18.606433 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-463673c1-b6b9-4830-a45e-e78b967eba11 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: b4f45353-5340-4cfe-a8c3-0aeeef958607] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:18.627194 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-463673c1-b6b9-4830-a45e-e78b967eba11 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:18.628679 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-463673c1-b6b9-4830-a45e-e78b967eba11 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:18.632597 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-463673c1-b6b9-4830-a45e-e78b967eba11 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:18.633576 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-463673c1-b6b9-4830-a45e-e78b967eba11 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:18.634418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-463673c1-b6b9-4830-a45e-e78b967eba11 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:18.635099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-463673c1-b6b9-4830-a45e-e78b967eba11 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:18.665499 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-463673c1-b6b9-4830-a45e-e78b967eba11 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] HTTP exception thrown: Instance b4f45353-5340-4cfe-a8c3-0aeeef958607 could not be found. Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-463673c1-b6b9-4830-a45e-e78b967eba11 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Request method failure captured: Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607/os-volume_attachments HTTP/1.1 Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_r18zhXKrUNPkTcrqBpyOxEtqmRnN_52CLFZjb6_V1_cyggOBj-ig1uBg8_Jl5DEv1edGlVMK7wsNG9aSNASIbB3U35pyAy7fX4gAPexD_7GsQqaSV2-qce83lQvxIJx4U5ZPEYYCvd7_VfIsOpvvr8aQqah0W-5V3XON-ztAeWk4Y Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/92bb708c7ba24e4d828f19ecc60e1f91"}]}] Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 6d19d8e7953b4e479b4e2143a3c3546a Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance b4f45353-5340-4cfe-a8c3-0aeeef958607 could not be found. Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'server_id': 'b4f45353-5340-4cfe-a8c3-0aeeef958607'} Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4f45353-5340-4cfe-a8c3-0aeeef958607 could not be found. Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:01:18.673610 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:01:18.680064 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4f45353-5340-4cfe-a8c3-0aeeef958607 could not be found. Aug 04 17:01:18.680064 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:01:18.680064 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:18.680064 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:01:18.680064 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:18.680064 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:18.680064 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:18.680064 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:01:18.680064 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:01:18.680064 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4f45353-5340-4cfe-a8c3-0aeeef958607 could not be found. Aug 04 17:01:18.680064 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:01:18.682163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-463673c1-b6b9-4830-a45e-e78b967eba11 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Returning 404 to user: Instance b4f45353-5340-4cfe-a8c3-0aeeef958607 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:01:18.683778 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-463673c1-b6b9-4830-a45e-e78b967eba11 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.092858 Aug 04 17:01:18.685888 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 819/1685] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:01:18 2022] GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607/os-volume_attachments => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:01:18.782394 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-979918c3-8b93-4409-b761-58622eef83b5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:18.783030 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-979918c3-8b93-4409-b761-58622eef83b5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] [instance: d0b4f50d-df7a-44ab-87d8-054aa370c979] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:18.811409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-979918c3-8b93-4409-b761-58622eef83b5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:18.811915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-979918c3-8b93-4409-b761-58622eef83b5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:18.812953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-979918c3-8b93-4409-b761-58622eef83b5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:18.813079 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-979918c3-8b93-4409-b761-58622eef83b5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:18.813517 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-979918c3-8b93-4409-b761-58622eef83b5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:18.814106 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-979918c3-8b93-4409-b761-58622eef83b5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:18.830323 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-979918c3-8b93-4409-b761-58622eef83b5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] HTTP exception thrown: Instance d0b4f50d-df7a-44ab-87d8-054aa370c979 could not be found. Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-979918c3-8b93-4409-b761-58622eef83b5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Request method failure captured: Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 HTTP/1.1 Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_nr6TM3VDFE0-a7GjdiPSkulOf76f1c2TbMoDiupaK9Lm5BhPfOeB57S5f3P9qy6YnDYHcKeg0lfdcHN3-0oPuIBLHcgZhXXL7A_HDfLwIpPHXCuAHrcjdKo53PMyOZ9qRxp28gZSglpaT-ZejdPX9f_LNrtsS6BL7HFdN-3zw1bXU Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 6f64e49086c94f65ba1fc2ef97b6bcde Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-MigrationsAdminTest-207825081 Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6f64e49086c94f65ba1fc2ef97b6bcde"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6f64e49086c94f65ba1fc2ef97b6bcde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6f64e49086c94f65ba1fc2ef97b6bcde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6f64e49086c94f65ba1fc2ef97b6bcde"}]}] Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-MigrationsAdminTest-207825081 Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 6f64e49086c94f65ba1fc2ef97b6bcde Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-MigrationsAdminTest-207825081 Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-MigrationsAdminTest-207825081-project Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 655795644d9941c99a82d15d9daa5ab5 Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-MigrationsAdminTest-207825081-project Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance d0b4f50d-df7a-44ab-87d8-054aa370c979 could not be found. Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'd0b4f50d-df7a-44ab-87d8-054aa370c979'} Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0b4f50d-df7a-44ab-87d8-054aa370c979 could not be found. Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0b4f50d-df7a-44ab-87d8-054aa370c979 could not be found. Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:18.831884 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:01:18.838062 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:18.838062 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:18.838062 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:18.838062 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:01:18.838062 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:01:18.838062 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0b4f50d-df7a-44ab-87d8-054aa370c979 could not be found. Aug 04 17:01:18.838062 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:01:18.838062 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-979918c3-8b93-4409-b761-58622eef83b5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] Returning 404 to user: Instance d0b4f50d-df7a-44ab-87d8-054aa370c979 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:01:18.838062 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-979918c3-8b93-4409-b761-58622eef83b5 tempest-MigrationsAdminTest-207825081 tempest-MigrationsAdminTest-207825081-project] 10.222.0.93 "GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979" status: 404 len: 111 microversion: 2.1 time: 0.055012 Aug 04 17:01:18.838062 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 820/1686] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:18 2022] GET /compute/v2.1/servers/d0b4f50d-df7a-44ab-87d8-054aa370c979 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:01:18.889847 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-961320e2-f0dc-4b8c-8f27-c0f2c0cd4ae1 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:18.905954 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-961320e2-f0dc-4b8c-8f27-c0f2c0cd4ae1 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b" status: 200 len: 1308 microversion: 2.1 time: 0.613664 Aug 04 17:01:18.906569 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 867/1687] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:18 2022] GET /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b => generated 1308 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:19.069223 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e538618f-bade-4b61-aa09-76f59095dd3e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1342220229", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "bed30c3f-0c01-4418-9c95-0bb7a79e1c34"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:19.185781 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-e538618f-bade-4b61-aa09-76f59095dd3e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] validate_networks() for [('bed30c3f-0c01-4418-9c95-0bb7a79e1c34', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:01:19.295730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-eee8fb7d-37dc-4a56-b999-85abe4e2eefb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:19.298512 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-eee8fb7d-37dc-4a56-b999-85abe4e2eefb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:19.313827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eee8fb7d-37dc-4a56-b999-85abe4e2eefb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:19.315204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eee8fb7d-37dc-4a56-b999-85abe4e2eefb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:19.318555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eee8fb7d-37dc-4a56-b999-85abe4e2eefb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:19.321016 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eee8fb7d-37dc-4a56-b999-85abe4e2eefb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:19.321548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eee8fb7d-37dc-4a56-b999-85abe4e2eefb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:19.322080 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eee8fb7d-37dc-4a56-b999-85abe4e2eefb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:19.391577 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:19.409070 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-eee8fb7d-37dc-4a56-b999-85abe4e2eefb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.107211 Aug 04 17:01:19.410981 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 868/1688] 10.222.0.93 () {60 vars in 1343 bytes} [Thu Aug 4 17:01:19 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:01:19.597656 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2dc8a529-1976-4088-8165-2b4665415347 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:19.598387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2dc8a529-1976-4088-8165-2b4665415347 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:19.620053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2dc8a529-1976-4088-8165-2b4665415347 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:19.626553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2dc8a529-1976-4088-8165-2b4665415347 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:19.627520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2dc8a529-1976-4088-8165-2b4665415347 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:19.628580 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2dc8a529-1976-4088-8165-2b4665415347 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:19.629580 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2dc8a529-1976-4088-8165-2b4665415347 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:19.629951 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2dc8a529-1976-4088-8165-2b4665415347 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:20.558293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:20.590832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2dc8a529-1976-4088-8165-2b4665415347 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:20.612681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2dc8a529-1976-4088-8165-2b4665415347 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:20.614595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2dc8a529-1976-4088-8165-2b4665415347 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:20.616028 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2dc8a529-1976-4088-8165-2b4665415347 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1875 microversion: 2.32 time: 1.022781 Aug 04 17:01:20.617114 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 869/1689] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:19 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1875 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:20.624451 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-732a7146-c5bf-487b-bbe8-4d9cc4893964 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:20.625329 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-732a7146-c5bf-487b-bbe8-4d9cc4893964 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0aa159af-25ad-4e88-adfd-88736802c68b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:20.632196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-732a7146-c5bf-487b-bbe8-4d9cc4893964 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:20.632921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-732a7146-c5bf-487b-bbe8-4d9cc4893964 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:20.633572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-732a7146-c5bf-487b-bbe8-4d9cc4893964 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:20.635548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-732a7146-c5bf-487b-bbe8-4d9cc4893964 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:20.636192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-732a7146-c5bf-487b-bbe8-4d9cc4893964 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:20.636819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-732a7146-c5bf-487b-bbe8-4d9cc4893964 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:20.710919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e538618f-bade-4b61-aa09-76f59095dd3e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:01:20.716322 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e538618f-bade-4b61-aa09-76f59095dd3e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:01:20.716966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e538618f-bade-4b61-aa09-76f59095dd3e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:01:20.717757 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e538618f-bade-4b61-aa09-76f59095dd3e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:01:20.718430 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e538618f-bade-4b61-aa09-76f59095dd3e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:01:20.736489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e538618f-bade-4b61-aa09-76f59095dd3e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:20.738546 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e538618f-bade-4b61-aa09-76f59095dd3e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:20.739078 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e538618f-bade-4b61-aa09-76f59095dd3e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:20.739948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e538618f-bade-4b61-aa09-76f59095dd3e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:20.740426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e538618f-bade-4b61-aa09-76f59095dd3e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:20.740878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e538618f-bade-4b61-aa09-76f59095dd3e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:20.768331 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e538618f-bade-4b61-aa09-76f59095dd3e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Getting quotas for project 92bb708c7ba24e4d828f19ecc60e1f91. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:01:20.777423 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e538618f-bade-4b61-aa09-76f59095dd3e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Getting quotas for user 6d19d8e7953b4e479b4e2143a3c3546a and project 92bb708c7ba24e4d828f19ecc60e1f91. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:01:20.795078 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e538618f-bade-4b61-aa09-76f59095dd3e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:01:20.797503 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e538618f-bade-4b61-aa09-76f59095dd3e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 7d4a1cf5-d8a5-4638-a353-0878b8c40eab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:01:20.888705 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-732a7146-c5bf-487b-bbe8-4d9cc4893964 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:20.899024 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-732a7146-c5bf-487b-bbe8-4d9cc4893964 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b" status: 200 len: 1308 microversion: 2.1 time: 0.280070 Aug 04 17:01:20.900378 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 870/1690] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:20 2022] GET /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b => generated 1308 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:20.912391 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e538618f-bade-4b61-aa09-76f59095dd3e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.847505 Aug 04 17:01:20.915627 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ef66c40e-767d-4382-af98-a7d9824a3e6b tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Calling method '.version_select at 0x7f1e5b154ee0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:20.917320 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 821/1691] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:01:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:01:20.932715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-13aa629e-51e9-4dc6-bec3-fca62483660d req-842aa024-4c84-4d4f-b030-3aaeaa780625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aa159af-25ad-4e88-adfd-88736802c68b", "tag": "0cadd627-9251-4fb3-895b-7cb5c6b41b23"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:20.955942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:20.964963 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-13aa629e-51e9-4dc6-bec3-fca62483660d req-842aa024-4c84-4d4f-b030-3aaeaa780625 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:20.965504 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-13aa629e-51e9-4dc6-bec3-fca62483660d req-842aa024-4c84-4d4f-b030-3aaeaa780625 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:20.966012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-13aa629e-51e9-4dc6-bec3-fca62483660d req-842aa024-4c84-4d4f-b030-3aaeaa780625 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:20.993184 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-13aa629e-51e9-4dc6-bec3-fca62483660d req-842aa024-4c84-4d4f-b030-3aaeaa780625 service nova] Creating event network-changed:0cadd627-9251-4fb3-895b-7cb5c6b41b23 for instance 0aa159af-25ad-4e88-adfd-88736802c68b on n-h1-851359-3 Aug 04 17:01:21.019885 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ef66c40e-767d-4382-af98-a7d9824a3e6b tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] 10.222.0.93 "GET /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360" status: 200 len: 637 microversion: 2.1 time: 0.117908 Aug 04 17:01:21.021749 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 871/1692] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:01:20 2022] GET /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360 => generated 637 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:21.024698 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-13aa629e-51e9-4dc6-bec3-fca62483660d req-842aa024-4c84-4d4f-b030-3aaeaa780625 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096241 Aug 04 17:01:21.026839 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 822/1693] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:21.040602 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9669b1be-8f31-4dd5-b240-76f421e3523a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:21.044166 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9b72278e-9697-4bba-b0f3-6131780841c9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1253007411", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "a29c24ff-4240-47ba-a31d-3bb350182580"}], "block_device_mapping_v2": [{"uuid": "e465d956-303d-46d7-8ee8-3a22822d0062", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:21.048938 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9669b1be-8f31-4dd5-b240-76f421e3523a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:21.067052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9669b1be-8f31-4dd5-b240-76f421e3523a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:21.068977 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9669b1be-8f31-4dd5-b240-76f421e3523a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:21.069505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9669b1be-8f31-4dd5-b240-76f421e3523a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:21.075109 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9669b1be-8f31-4dd5-b240-76f421e3523a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:21.076682 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9669b1be-8f31-4dd5-b240-76f421e3523a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:21.077191 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9669b1be-8f31-4dd5-b240-76f421e3523a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:21.156782 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9669b1be-8f31-4dd5-b240-76f421e3523a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.133869 Aug 04 17:01:21.162190 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 872/1694] 10.222.0.93 () {60 vars in 1343 bytes} [Thu Aug 4 17:01:21 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:01:21.167269 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1e66f356-92d1-4916-87ea-2241ebde9e06 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:21.168133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1e66f356-92d1-4916-87ea-2241ebde9e06 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 7d4a1cf5-d8a5-4638-a353-0878b8c40eab] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:21.195755 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-9b72278e-9697-4bba-b0f3-6131780841c9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] validate_networks() for [('a29c24ff-4240-47ba-a31d-3bb350182580', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:01:21.356338 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1e66f356-92d1-4916-87ea-2241ebde9e06 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:21.365898 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1e66f356-92d1-4916-87ea-2241ebde9e06 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/7d4a1cf5-d8a5-4638-a353-0878b8c40eab" status: 200 len: 1215 microversion: 2.1 time: 0.202402 Aug 04 17:01:21.380042 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 873/1695] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:21 2022] GET /compute/v2.1/servers/7d4a1cf5-d8a5-4638-a353-0878b8c40eab => generated 1215 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:21.389365 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f62282fc-fcc4-4de9-b5ed-66cdf08f5bf1 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Action: 'update_all', calling method: .version_select at 0x7f1e5bd46430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:21.476100 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-f62282fc-fcc4-4de9-b5ed-66cdf08f5bf1 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Getting quotas for project e35197354071461ea6eb68581701b8d5. Resources: dict_keys(['metadata_items']) {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:01:21.482862 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-f62282fc-fcc4-4de9-b5ed-66cdf08f5bf1 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Getting quotas for user 9a371a60366a4753b4c692be35e98555 and project e35197354071461ea6eb68581701b8d5. Resources: dict_keys(['metadata_items']) {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:01:22.042047 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f62282fc-fcc4-4de9-b5ed-66cdf08f5bf1 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] 10.222.0.93 "PUT /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360/metadata" status: 200 len: 61 microversion: 2.1 time: 0.660430 Aug 04 17:01:22.044876 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 874/1696] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Aug 4 17:01:21 2022] PUT /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360/metadata => generated 61 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:01:22.050544 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-51e591bc-0c55-4a4f-b86b-f9bf2423f1a0 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:22.052311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-51e591bc-0c55-4a4f-b86b-f9bf2423f1a0 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 7d4a1cf5-d8a5-4638-a353-0878b8c40eab] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:22.079088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-51e591bc-0c55-4a4f-b86b-f9bf2423f1a0 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:22.080810 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-51e591bc-0c55-4a4f-b86b-f9bf2423f1a0 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:22.081500 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-51e591bc-0c55-4a4f-b86b-f9bf2423f1a0 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:22.085180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-51e591bc-0c55-4a4f-b86b-f9bf2423f1a0 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:22.087677 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-51e591bc-0c55-4a4f-b86b-f9bf2423f1a0 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:22.089003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-51e591bc-0c55-4a4f-b86b-f9bf2423f1a0 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:22.141362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9b72278e-9697-4bba-b0f3-6131780841c9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:01:22.141836 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9b72278e-9697-4bba-b0f3-6131780841c9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:01:22.142292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9b72278e-9697-4bba-b0f3-6131780841c9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:01:22.142710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9b72278e-9697-4bba-b0f3-6131780841c9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:01:22.143130 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9b72278e-9697-4bba-b0f3-6131780841c9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:01:22.166810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b72278e-9697-4bba-b0f3-6131780841c9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:22.167308 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b72278e-9697-4bba-b0f3-6131780841c9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:22.167751 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b72278e-9697-4bba-b0f3-6131780841c9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:22.168495 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b72278e-9697-4bba-b0f3-6131780841c9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:22.168959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b72278e-9697-4bba-b0f3-6131780841c9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:22.169391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b72278e-9697-4bba-b0f3-6131780841c9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:22.174284 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-51e591bc-0c55-4a4f-b86b-f9bf2423f1a0 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 7d4a1cf5-d8a5-4638-a353-0878b8c40eab] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:01:22.215548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-51e591bc-0c55-4a4f-b86b-f9bf2423f1a0 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:22.216060 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-51e591bc-0c55-4a4f-b86b-f9bf2423f1a0 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:22.218081 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-51e591bc-0c55-4a4f-b86b-f9bf2423f1a0 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:22.244942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-9b72278e-9697-4bba-b0f3-6131780841c9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Getting quotas for project 792f078eb62f4820ba4166d421079491. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:01:22.255008 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-51e591bc-0c55-4a4f-b86b-f9bf2423f1a0 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lazy-loading 'flavor' on Instance uuid 7d4a1cf5-d8a5-4638-a353-0878b8c40eab {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:01:22.265607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-9b72278e-9697-4bba-b0f3-6131780841c9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Getting quotas for user 81d93fe83a6542c89cbc86106671b15f and project 792f078eb62f4820ba4166d421079491. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:01:22.384637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-51e591bc-0c55-4a4f-b86b-f9bf2423f1a0 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lazy-loading 'system_metadata' on Instance uuid 7d4a1cf5-d8a5-4638-a353-0878b8c40eab {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:01:22.413340 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9b72278e-9697-4bba-b0f3-6131780841c9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:01:22.415762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9b72278e-9697-4bba-b0f3-6131780841c9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e465d956-303d-46d7-8ee8-3a22822d0062',volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:01:22.504333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-51e591bc-0c55-4a4f-b86b-f9bf2423f1a0 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lazy-loading 'metadata' on Instance uuid 7d4a1cf5-d8a5-4638-a353-0878b8c40eab {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:01:22.710174 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9b72278e-9697-4bba-b0f3-6131780841c9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.681476 Aug 04 17:01:22.719404 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 823/1697] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:01:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:01:22.728736 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7ae8a924-5199-4480-bb60-53f79c0fffff tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:22.761873 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7ae8a924-5199-4480-bb60-53f79c0fffff tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:22.781643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ae8a924-5199-4480-bb60-53f79c0fffff tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:22.796613 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ae8a924-5199-4480-bb60-53f79c0fffff tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:22.797185 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ae8a924-5199-4480-bb60-53f79c0fffff tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:22.797950 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ae8a924-5199-4480-bb60-53f79c0fffff tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:22.798455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ae8a924-5199-4480-bb60-53f79c0fffff tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:22.802792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ae8a924-5199-4480-bb60-53f79c0fffff tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:23.289091 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.scheduler.client.report [None req-51e591bc-0c55-4a4f-b86b-f9bf2423f1a0 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Deleted allocations for instance 7d4a1cf5-d8a5-4638-a353-0878b8c40eab Aug 04 17:01:23.324768 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-51e591bc-0c55-4a4f-b86b-f9bf2423f1a0 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "DELETE /compute/v2.1/servers/7d4a1cf5-d8a5-4638-a353-0878b8c40eab" status: 204 len: 0 microversion: 2.1 time: 1.278267 Aug 04 17:01:23.325410 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 875/1698] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:01:22 2022] DELETE /compute/v2.1/servers/7d4a1cf5-d8a5-4638-a353-0878b8c40eab => generated 0 bytes in 1280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:01:23.339584 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8523ca52-6416-4f1d-ae46-ca913653452c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:23.340616 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8523ca52-6416-4f1d-ae46-ca913653452c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0aa159af-25ad-4e88-adfd-88736802c68b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:23.361364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8523ca52-6416-4f1d-ae46-ca913653452c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:23.363656 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8523ca52-6416-4f1d-ae46-ca913653452c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:23.366672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8523ca52-6416-4f1d-ae46-ca913653452c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:23.370058 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8523ca52-6416-4f1d-ae46-ca913653452c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:23.370606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8523ca52-6416-4f1d-ae46-ca913653452c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:23.371092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8523ca52-6416-4f1d-ae46-ca913653452c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:23.525738 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7ae8a924-5199-4480-bb60-53f79c0fffff tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:23.552503 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7ae8a924-5199-4480-bb60-53f79c0fffff tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:23.554377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7ae8a924-5199-4480-bb60-53f79c0fffff tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:23.555902 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7ae8a924-5199-4480-bb60-53f79c0fffff tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1875 microversion: 2.32 time: 0.831370 Aug 04 17:01:23.571366 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 824/1699] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:22 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1875 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:23.581183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-14f51ab0-a356-4868-8ae2-bd66b037dc66 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Calling method '.version_select at 0x7f1e5b4a2d30>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:23.927586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8523ca52-6416-4f1d-ae46-ca913653452c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:23.942924 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8523ca52-6416-4f1d-ae46-ca913653452c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b" status: 200 len: 1308 microversion: 2.1 time: 0.616079 Aug 04 17:01:23.979397 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 876/1700] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:23 2022] GET /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b => generated 1308 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:24.006955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bc595c59-2677-4818-a116-96ee5960fabb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:24.009352 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bc595c59-2677-4818-a116-96ee5960fabb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:24.036484 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-14f51ab0-a356-4868-8ae2-bd66b037dc66 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] 10.222.0.93 "DELETE /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.463830 Aug 04 17:01:24.037400 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 825/1701] 10.222.0.93 () {58 vars in 1296 bytes} [Thu Aug 4 17:01:23 2022] DELETE /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360/metadata/os_version => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:01:24.042452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-30c9af93-f7bd-4cac-a878-7a2922d31854 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:24.045604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-30c9af93-f7bd-4cac-a878-7a2922d31854 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:24.047837 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc595c59-2677-4818-a116-96ee5960fabb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:24.051665 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc595c59-2677-4818-a116-96ee5960fabb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:24.052347 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc595c59-2677-4818-a116-96ee5960fabb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:24.055205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc595c59-2677-4818-a116-96ee5960fabb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:24.057074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc595c59-2677-4818-a116-96ee5960fabb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:24.058225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc595c59-2677-4818-a116-96ee5960fabb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:24.061791 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-30c9af93-f7bd-4cac-a878-7a2922d31854 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:24.064171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-30c9af93-f7bd-4cac-a878-7a2922d31854 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:24.067638 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-30c9af93-f7bd-4cac-a878-7a2922d31854 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:24.070552 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-30c9af93-f7bd-4cac-a878-7a2922d31854 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:24.071328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-30c9af93-f7bd-4cac-a878-7a2922d31854 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:24.072066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-30c9af93-f7bd-4cac-a878-7a2922d31854 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:24.177991 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bc595c59-2677-4818-a116-96ee5960fabb tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.197151 Aug 04 17:01:24.184729 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 877/1702] 10.222.0.93 () {60 vars in 1343 bytes} [Thu Aug 4 17:01:23 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:01:24.205795 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-34340aa4-6e80-4cce-aa3a-aa02c0ac08ee tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:24.210456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-34340aa4-6e80-4cce-aa3a-aa02c0ac08ee tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 7d4a1cf5-d8a5-4638-a353-0878b8c40eab] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:24.224993 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-34340aa4-6e80-4cce-aa3a-aa02c0ac08ee tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:24.225512 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-34340aa4-6e80-4cce-aa3a-aa02c0ac08ee tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:24.225966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-34340aa4-6e80-4cce-aa3a-aa02c0ac08ee tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:24.232111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-34340aa4-6e80-4cce-aa3a-aa02c0ac08ee tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:24.232845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-34340aa4-6e80-4cce-aa3a-aa02c0ac08ee tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:24.233472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-34340aa4-6e80-4cce-aa3a-aa02c0ac08ee tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:24.268321 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-34340aa4-6e80-4cce-aa3a-aa02c0ac08ee tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] HTTP exception thrown: Instance 7d4a1cf5-d8a5-4638-a353-0878b8c40eab could not be found. Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-34340aa4-6e80-4cce-aa3a-aa02c0ac08ee tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Request method failure captured: Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/7d4a1cf5-d8a5-4638-a353-0878b8c40eab HTTP/1.1 Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_r18zhXKrUNPkTcrqBpyOxEtqmRnN_52CLFZjb6_V1_cyggOBj-ig1uBg8_Jl5DEv1edGlVMK7wsNG9aSNASIbB3U35pyAy7fX4gAPexD_7GsQqaSV2-qce83lQvxIJx4U5ZPEYYCvd7_VfIsOpvvr8aQqah0W-5V3XON-ztAeWk4Y Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/92bb708c7ba24e4d828f19ecc60e1f91"}]}] Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 6d19d8e7953b4e479b4e2143a3c3546a Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 7d4a1cf5-d8a5-4638-a353-0878b8c40eab could not be found. Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '7d4a1cf5-d8a5-4638-a353-0878b8c40eab'} Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d4a1cf5-d8a5-4638-a353-0878b8c40eab could not be found. Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d4a1cf5-d8a5-4638-a353-0878b8c40eab could not be found. Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:24.270882 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:24.275592 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:24.275592 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:24.275592 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:24.275592 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:01:24.275592 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:01:24.275592 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d4a1cf5-d8a5-4638-a353-0878b8c40eab could not be found. Aug 04 17:01:24.275592 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:24.280696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-30c9af93-f7bd-4cac-a878-7a2922d31854 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:24.285483 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-34340aa4-6e80-4cce-aa3a-aa02c0ac08ee tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Returning 404 to user: Instance 7d4a1cf5-d8a5-4638-a353-0878b8c40eab could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:01:24.289485 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-34340aa4-6e80-4cce-aa3a-aa02c0ac08ee tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/7d4a1cf5-d8a5-4638-a353-0878b8c40eab" status: 404 len: 111 microversion: 2.1 time: 0.103682 Aug 04 17:01:24.290192 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 878/1703] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:24 2022] GET /compute/v2.1/servers/7d4a1cf5-d8a5-4638-a353-0878b8c40eab => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:01:24.297238 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-30c9af93-f7bd-4cac-a878-7a2922d31854 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1151 microversion: 2.1 time: 0.258725 Aug 04 17:01:24.298387 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 826/1704] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:24 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1151 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:24.304895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1c120fcb-47ea-4aa2-b3cc-a447c2a8f0f4 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Calling method '.version_select at 0x7f1e5b05f700>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:24.358596 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1c120fcb-47ea-4aa2-b3cc-a447c2a8f0f4 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] 10.222.0.93 "GET /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360/metadata" status: 200 len: 37 microversion: 2.1 time: 0.065925 Aug 04 17:01:24.359236 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 879/1705] 10.222.0.93 () {58 vars in 1260 bytes} [Thu Aug 4 17:01:24 2022] GET /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360/metadata => generated 37 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:01:24.375968 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2d7489e6-a1e9-4130-8051-0059323464be tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Action: 'update_all', calling method: .version_select at 0x7f1e5bdeddc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:24.480772 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-2d7489e6-a1e9-4130-8051-0059323464be tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Getting quotas for project e35197354071461ea6eb68581701b8d5. Resources: dict_keys(['metadata_items']) {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:01:24.497383 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-2d7489e6-a1e9-4130-8051-0059323464be tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Getting quotas for user 9a371a60366a4753b4c692be35e98555 and project e35197354071461ea6eb68581701b8d5. Resources: dict_keys(['metadata_items']) {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:01:24.586814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d1403aee-0c33-4494-843d-c52ba8b3dbce tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:24.587807 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d1403aee-0c33-4494-843d-c52ba8b3dbce tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:24.610958 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1403aee-0c33-4494-843d-c52ba8b3dbce tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:24.611971 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1403aee-0c33-4494-843d-c52ba8b3dbce tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:24.613196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1403aee-0c33-4494-843d-c52ba8b3dbce tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:24.617019 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1403aee-0c33-4494-843d-c52ba8b3dbce tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:24.617706 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1403aee-0c33-4494-843d-c52ba8b3dbce tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:24.618374 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1403aee-0c33-4494-843d-c52ba8b3dbce tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:24.955836 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2d7489e6-a1e9-4130-8051-0059323464be tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] 10.222.0.93 "PUT /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360/metadata" status: 200 len: 61 microversion: 2.1 time: 0.584152 Aug 04 17:01:24.956451 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 827/1706] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Aug 4 17:01:24 2022] PUT /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360/metadata => generated 61 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:01:24.964121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-63be0c76-116c-4784-9473-edfc8ec52fe6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1259966188", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "bed30c3f-0c01-4418-9c95-0bb7a79e1c34"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:25.102868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d1403aee-0c33-4494-843d-c52ba8b3dbce tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:25.116945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-63be0c76-116c-4784-9473-edfc8ec52fe6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] validate_networks() for [('bed30c3f-0c01-4418-9c95-0bb7a79e1c34', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:01:25.129128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d1403aee-0c33-4494-843d-c52ba8b3dbce tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:25.133566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d1403aee-0c33-4494-843d-c52ba8b3dbce tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:25.136806 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d1403aee-0c33-4494-843d-c52ba8b3dbce tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1875 microversion: 2.32 time: 0.556042 Aug 04 17:01:25.138691 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 880/1707] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:24 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1875 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:01:25.152837 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8346732e-b28b-46d6-8234-7febadcb4e82 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Calling method '.version_select at 0x7f1e5b11cc10>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:25.234506 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8346732e-b28b-46d6-8234-7febadcb4e82 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] 10.222.0.93 "GET /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.094044 Aug 04 17:01:25.235425 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 881/1708] 10.222.0.93 () {58 vars in 1290 bytes} [Thu Aug 4 17:01:25 2022] GET /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360/metadata/os_distro => generated 33 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:01:25.245123 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2f1eff53-a79e-40af-ba6f-bbcb0d1e3211 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:25.246960 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2f1eff53-a79e-40af-ba6f-bbcb0d1e3211 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0aa159af-25ad-4e88-adfd-88736802c68b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:25.269843 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f1eff53-a79e-40af-ba6f-bbcb0d1e3211 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:25.270748 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f1eff53-a79e-40af-ba6f-bbcb0d1e3211 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:25.272258 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f1eff53-a79e-40af-ba6f-bbcb0d1e3211 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:25.274962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f1eff53-a79e-40af-ba6f-bbcb0d1e3211 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:25.278046 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f1eff53-a79e-40af-ba6f-bbcb0d1e3211 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:25.278883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f1eff53-a79e-40af-ba6f-bbcb0d1e3211 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:25.821566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-63be0c76-116c-4784-9473-edfc8ec52fe6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:01:25.822351 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-63be0c76-116c-4784-9473-edfc8ec52fe6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:01:25.823159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-63be0c76-116c-4784-9473-edfc8ec52fe6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:01:25.823805 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-63be0c76-116c-4784-9473-edfc8ec52fe6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:01:25.824511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-63be0c76-116c-4784-9473-edfc8ec52fe6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:01:25.853276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2f1eff53-a79e-40af-ba6f-bbcb0d1e3211 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:25.874822 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2f1eff53-a79e-40af-ba6f-bbcb0d1e3211 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b" status: 200 len: 1308 microversion: 2.1 time: 0.637394 Aug 04 17:01:25.876511 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 882/1709] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:25 2022] GET /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b => generated 1308 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:25.877078 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63be0c76-116c-4784-9473-edfc8ec52fe6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:25.879857 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63be0c76-116c-4784-9473-edfc8ec52fe6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:25.880600 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63be0c76-116c-4784-9473-edfc8ec52fe6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:25.883811 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63be0c76-116c-4784-9473-edfc8ec52fe6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:25.886459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63be0c76-116c-4784-9473-edfc8ec52fe6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:25.890074 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63be0c76-116c-4784-9473-edfc8ec52fe6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:25.904650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-503c4b1c-aa83-43f1-ad1a-720a83a59cd4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:25.909531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-503c4b1c-aa83-43f1-ad1a-720a83a59cd4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:25.928020 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-503c4b1c-aa83-43f1-ad1a-720a83a59cd4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:25.928359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-503c4b1c-aa83-43f1-ad1a-720a83a59cd4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:25.928900 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-503c4b1c-aa83-43f1-ad1a-720a83a59cd4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:25.934456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-503c4b1c-aa83-43f1-ad1a-720a83a59cd4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:25.937274 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-503c4b1c-aa83-43f1-ad1a-720a83a59cd4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:25.938064 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-503c4b1c-aa83-43f1-ad1a-720a83a59cd4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:25.947809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-63be0c76-116c-4784-9473-edfc8ec52fe6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Getting quotas for project 92bb708c7ba24e4d828f19ecc60e1f91. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:01:25.962534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-63be0c76-116c-4784-9473-edfc8ec52fe6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Getting quotas for user 6d19d8e7953b4e479b4e2143a3c3546a and project 92bb708c7ba24e4d828f19ecc60e1f91. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:01:26.026867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-63be0c76-116c-4784-9473-edfc8ec52fe6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:01:26.030853 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-63be0c76-116c-4784-9473-edfc8ec52fe6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 14847930-27f6-4ea1-83f0-48a80608885e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:01:26.037841 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-503c4b1c-aa83-43f1-ad1a-720a83a59cd4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.156119 Aug 04 17:01:26.038495 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 883/1710] 10.222.0.93 () {60 vars in 1343 bytes} [Thu Aug 4 17:01:25 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6/os-volume_attachments => generated 25 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:26.046460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-34f19f92-4814-49be-806c-8ea9a8cc1596 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Action: 'update_all', calling method: .version_select at 0x7f1e5b11c9d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:26.148538 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-34f19f92-4814-49be-806c-8ea9a8cc1596 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Getting quotas for project e35197354071461ea6eb68581701b8d5. Resources: dict_keys(['metadata_items']) {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:01:26.152973 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-63be0c76-116c-4784-9473-edfc8ec52fe6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.180775 Aug 04 17:01:26.159291 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 828/1711] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:01:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:01:26.163222 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-34f19f92-4814-49be-806c-8ea9a8cc1596 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Getting quotas for user 9a371a60366a4753b4c692be35e98555 and project e35197354071461ea6eb68581701b8d5. Resources: dict_keys(['metadata_items']) {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:01:26.181766 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f76afb39-39ee-4c08-8ebc-2c2b9d205a6d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:26.183297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f76afb39-39ee-4c08-8ebc-2c2b9d205a6d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:26.199361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f76afb39-39ee-4c08-8ebc-2c2b9d205a6d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:26.200705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f76afb39-39ee-4c08-8ebc-2c2b9d205a6d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:26.203707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f76afb39-39ee-4c08-8ebc-2c2b9d205a6d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:26.223201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f76afb39-39ee-4c08-8ebc-2c2b9d205a6d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:26.229930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f76afb39-39ee-4c08-8ebc-2c2b9d205a6d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:26.230494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f76afb39-39ee-4c08-8ebc-2c2b9d205a6d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:26.559828 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f76afb39-39ee-4c08-8ebc-2c2b9d205a6d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:26.577699 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f76afb39-39ee-4c08-8ebc-2c2b9d205a6d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1211 microversion: 2.1 time: 0.415987 Aug 04 17:01:26.578208 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 829/1712] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:26 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1211 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:26.657857 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-34f19f92-4814-49be-806c-8ea9a8cc1596 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] 10.222.0.93 "PUT /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360/metadata" status: 200 len: 61 microversion: 2.1 time: 0.617999 Aug 04 17:01:26.658962 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 884/1713] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Aug 4 17:01:26 2022] PUT /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360/metadata => generated 61 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:01:26.664648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-46bcf030-aef1-49cf-abe3-c0ba9e3d1972 req-2fba9128-0b11-4d33-a315-3ff45053624e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "238cb283-0037-440c-a433-d3f4e3de1274", "name": "network-vif-plugged", "status": "completed", "tag": "bd58d1ec-cf62-4cc6-8629-14df8de01861"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:26.689866 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-46bcf030-aef1-49cf-abe3-c0ba9e3d1972 req-2fba9128-0b11-4d33-a315-3ff45053624e service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:26.696793 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-46bcf030-aef1-49cf-abe3-c0ba9e3d1972 req-2fba9128-0b11-4d33-a315-3ff45053624e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:26.697443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-46bcf030-aef1-49cf-abe3-c0ba9e3d1972 req-2fba9128-0b11-4d33-a315-3ff45053624e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:26.724461 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-46bcf030-aef1-49cf-abe3-c0ba9e3d1972 req-2fba9128-0b11-4d33-a315-3ff45053624e service nova] Creating event network-vif-plugged:bd58d1ec-cf62-4cc6-8629-14df8de01861 for instance 238cb283-0037-440c-a433-d3f4e3de1274 on n-h2-851359-3 Aug 04 17:01:26.739398 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-46bcf030-aef1-49cf-abe3-c0ba9e3d1972 req-2fba9128-0b11-4d33-a315-3ff45053624e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078964 Aug 04 17:01:26.743339 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 885/1714] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:26.755906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2ce035ea-e73c-492b-a310-7c0aaa7bc89b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:26.757096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2ce035ea-e73c-492b-a310-7c0aaa7bc89b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 14847930-27f6-4ea1-83f0-48a80608885e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:26.917615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2ce035ea-e73c-492b-a310-7c0aaa7bc89b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:26.926119 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2ce035ea-e73c-492b-a310-7c0aaa7bc89b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e" status: 200 len: 1215 microversion: 2.1 time: 0.181227 Aug 04 17:01:26.929750 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 886/1715] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:26 2022] GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e => generated 1215 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:26.945219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c7a285f9-ec7f-4074-98d1-a3fda0ba4cdc tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:26.955918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c7a285f9-ec7f-4074-98d1-a3fda0ba4cdc tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:26.987381 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c7a285f9-ec7f-4074-98d1-a3fda0ba4cdc tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:26.990320 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c7a285f9-ec7f-4074-98d1-a3fda0ba4cdc tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:26.991118 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c7a285f9-ec7f-4074-98d1-a3fda0ba4cdc tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:26.996257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c7a285f9-ec7f-4074-98d1-a3fda0ba4cdc tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:26.998821 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c7a285f9-ec7f-4074-98d1-a3fda0ba4cdc tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:26.999297 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c7a285f9-ec7f-4074-98d1-a3fda0ba4cdc tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:27.215355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0601a323-9253-4aa3-91d8-a140408184b7 tempest-SecurityGroupsTestAdminJSON-1765133464 tempest-SecurityGroupsTestAdminJSON-1765133464-project] Action: 'create', calling method: .version_select at 0x7f1e5baad8b0>, body: {"security_group": {"name": "tempest-securitygroup-441179000", "description": "tempest-description-354866893"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:27.467089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c7a285f9-ec7f-4074-98d1-a3fda0ba4cdc tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:27.481127 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c7a285f9-ec7f-4074-98d1-a3fda0ba4cdc tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:27.490104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c7a285f9-ec7f-4074-98d1-a3fda0ba4cdc tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:27.495291 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c7a285f9-ec7f-4074-98d1-a3fda0ba4cdc tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1875 microversion: 2.32 time: 0.561301 Aug 04 17:01:27.498333 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 887/1716] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:26 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1875 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:27.513381 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bb3460f2-0265-48ec-aae5-19b1559d06a3 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Calling method '.version_select at 0x7f1e5b02e820>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:27.615048 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bb3460f2-0265-48ec-aae5-19b1559d06a3 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] 10.222.0.93 "GET /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360/metadata" status: 200 len: 61 microversion: 2.1 time: 0.113366 Aug 04 17:01:27.624272 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 888/1717] 10.222.0.93 () {58 vars in 1260 bytes} [Thu Aug 4 17:01:27 2022] GET /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360/metadata => generated 61 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:01:27.642893 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5e064aa9-6f63-43e2-89b4-da7e2f4f0336 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:27.644340 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5e064aa9-6f63-43e2-89b4-da7e2f4f0336 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0aa159af-25ad-4e88-adfd-88736802c68b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:27.677718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5e064aa9-6f63-43e2-89b4-da7e2f4f0336 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:27.678252 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5e064aa9-6f63-43e2-89b4-da7e2f4f0336 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:27.678803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5e064aa9-6f63-43e2-89b4-da7e2f4f0336 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:27.679406 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5e064aa9-6f63-43e2-89b4-da7e2f4f0336 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:27.680006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5e064aa9-6f63-43e2-89b4-da7e2f4f0336 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:27.680647 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5e064aa9-6f63-43e2-89b4-da7e2f4f0336 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:28.013789 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0601a323-9253-4aa3-91d8-a140408184b7 tempest-SecurityGroupsTestAdminJSON-1765133464 tempest-SecurityGroupsTestAdminJSON-1765133464-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.427168 Aug 04 17:01:28.014688 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 830/1718] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Aug 4 17:01:26 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:28.140845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5e064aa9-6f63-43e2-89b4-da7e2f4f0336 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:28.157633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-14947950-5fa6-4d72-a0b1-2a229a6bae60 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-201657188", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:28.175339 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5e064aa9-6f63-43e2-89b4-da7e2f4f0336 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b" status: 200 len: 1308 microversion: 2.1 time: 0.548539 Aug 04 17:01:28.176825 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 889/1719] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:27 2022] GET /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b => generated 1308 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:28.202394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-50b818fc-42a6-45f8-b785-5d6ce0229c01 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:28.205602 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-50b818fc-42a6-45f8-b785-5d6ce0229c01 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:28.226567 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50b818fc-42a6-45f8-b785-5d6ce0229c01 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:28.227104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50b818fc-42a6-45f8-b785-5d6ce0229c01 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:28.227553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50b818fc-42a6-45f8-b785-5d6ce0229c01 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:28.232199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50b818fc-42a6-45f8-b785-5d6ce0229c01 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:28.232749 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50b818fc-42a6-45f8-b785-5d6ce0229c01 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:28.233207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50b818fc-42a6-45f8-b785-5d6ce0229c01 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:28.271348 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=11,nova_cell1:DELETE=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:28.292678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-14947950-5fa6-4d72-a0b1-2a229a6bae60 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:01:28.733765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-14947950-5fa6-4d72-a0b1-2a229a6bae60 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:01:28.735223 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-14947950-5fa6-4d72-a0b1-2a229a6bae60 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:01:28.735763 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-14947950-5fa6-4d72-a0b1-2a229a6bae60 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:01:28.737009 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-14947950-5fa6-4d72-a0b1-2a229a6bae60 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:01:28.737462 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-14947950-5fa6-4d72-a0b1-2a229a6bae60 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:01:28.766845 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14947950-5fa6-4d72-a0b1-2a229a6bae60 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:28.767330 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14947950-5fa6-4d72-a0b1-2a229a6bae60 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:28.767776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14947950-5fa6-4d72-a0b1-2a229a6bae60 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:28.769011 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14947950-5fa6-4d72-a0b1-2a229a6bae60 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:28.770054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14947950-5fa6-4d72-a0b1-2a229a6bae60 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:28.774767 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14947950-5fa6-4d72-a0b1-2a229a6bae60 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:28.822277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-14947950-5fa6-4d72-a0b1-2a229a6bae60 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Getting quotas for project d7ca0be197104eaaa8b190117f1c2b53. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:01:28.835090 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-50b818fc-42a6-45f8-b785-5d6ce0229c01 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:28.836753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-14947950-5fa6-4d72-a0b1-2a229a6bae60 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Getting quotas for user 930211b0112b490bbe9f6a262ccaf819 and project d7ca0be197104eaaa8b190117f1c2b53. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:01:28.846040 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-50b818fc-42a6-45f8-b785-5d6ce0229c01 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1211 microversion: 2.1 time: 0.651978 Aug 04 17:01:28.851123 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 890/1720] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:28 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1211 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:28.864583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-14947950-5fa6-4d72-a0b1-2a229a6bae60 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:01:28.869308 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7a724b7a-1084-4e24-9ab3-caf80abc1c98 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Action: 'update_all', calling method: .version_select at 0x7f1e5b00c310>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:28.875177 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-14947950-5fa6-4d72-a0b1-2a229a6bae60 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] [instance: c2695555-41cc-4eff-ae6c-9b8d443103bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:01:28.947298 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-7a724b7a-1084-4e24-9ab3-caf80abc1c98 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Getting quotas for project e35197354071461ea6eb68581701b8d5. Resources: dict_keys(['metadata_items']) {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:01:28.960932 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-7a724b7a-1084-4e24-9ab3-caf80abc1c98 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Getting quotas for user 9a371a60366a4753b4c692be35e98555 and project e35197354071461ea6eb68581701b8d5. Resources: dict_keys(['metadata_items']) {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:01:28.997559 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-14947950-5fa6-4d72-a0b1-2a229a6bae60 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.981490 Aug 04 17:01:28.998266 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 831/1721] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:01:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:01:29.014574 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b9d09861-c269-4248-a4b9-04d249adc842 req-a074678e-1283-4b79-82f8-1f0ac285f7ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3", "tag": "67e31e5f-833c-4ef7-a84f-df2439c611ff"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:29.046708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b9d09861-c269-4248-a4b9-04d249adc842 req-a074678e-1283-4b79-82f8-1f0ac285f7ee service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:29.048398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b9d09861-c269-4248-a4b9-04d249adc842 req-a074678e-1283-4b79-82f8-1f0ac285f7ee service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:29.050058 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b9d09861-c269-4248-a4b9-04d249adc842 req-a074678e-1283-4b79-82f8-1f0ac285f7ee service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:29.081735 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b9d09861-c269-4248-a4b9-04d249adc842 req-a074678e-1283-4b79-82f8-1f0ac285f7ee service nova] Creating event network-changed:67e31e5f-833c-4ef7-a84f-df2439c611ff for instance 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 on n-h2-851359-3 Aug 04 17:01:29.095359 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b9d09861-c269-4248-a4b9-04d249adc842 req-a074678e-1283-4b79-82f8-1f0ac285f7ee service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089478 Aug 04 17:01:29.099108 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 832/1722] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:29.110652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-390f1876-f2f2-48e2-a3a2-b5a9e7dcf6fb tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:29.116421 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-390f1876-f2f2-48e2-a3a2-b5a9e7dcf6fb tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 14847930-27f6-4ea1-83f0-48a80608885e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:29.130178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-390f1876-f2f2-48e2-a3a2-b5a9e7dcf6fb tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:29.131839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-390f1876-f2f2-48e2-a3a2-b5a9e7dcf6fb tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:29.134812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-390f1876-f2f2-48e2-a3a2-b5a9e7dcf6fb tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:29.138791 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-390f1876-f2f2-48e2-a3a2-b5a9e7dcf6fb tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:29.142425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-390f1876-f2f2-48e2-a3a2-b5a9e7dcf6fb tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:29.143696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-390f1876-f2f2-48e2-a3a2-b5a9e7dcf6fb tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:29.271629 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7a724b7a-1084-4e24-9ab3-caf80abc1c98 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] 10.222.0.93 "PUT /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360/metadata" status: 200 len: 61 microversion: 2.1 time: 0.418078 Aug 04 17:01:29.273258 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 891/1723] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Aug 4 17:01:28 2022] PUT /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360/metadata => generated 61 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:01:29.278271 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b02fb248-7895-478a-b335-3d1059d7f0f7 tempest-SecurityGroupsTestAdminJSON-1765133464 tempest-SecurityGroupsTestAdminJSON-1765133464-project] Action: 'create', calling method: .version_select at 0x7f1e5b018550>, body: {"security_group": {"name": "tempest-securitygroup-617295843", "description": "tempest-description-882061043"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:29.293962 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-390f1876-f2f2-48e2-a3a2-b5a9e7dcf6fb tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:29.305293 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-390f1876-f2f2-48e2-a3a2-b5a9e7dcf6fb tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e" status: 200 len: 1273 microversion: 2.1 time: 0.203809 Aug 04 17:01:29.305878 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 833/1724] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:29 2022] GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e => generated 1273 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:29.314091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-08d69278-6ff7-4341-8b25-1d838b05664e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:29.317801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-08d69278-6ff7-4341-8b25-1d838b05664e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:29.336540 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08d69278-6ff7-4341-8b25-1d838b05664e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:29.337046 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08d69278-6ff7-4341-8b25-1d838b05664e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:29.337498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08d69278-6ff7-4341-8b25-1d838b05664e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:29.338273 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08d69278-6ff7-4341-8b25-1d838b05664e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:29.343656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08d69278-6ff7-4341-8b25-1d838b05664e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:29.344809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08d69278-6ff7-4341-8b25-1d838b05664e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:29.699005 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b02fb248-7895-478a-b335-3d1059d7f0f7 tempest-SecurityGroupsTestAdminJSON-1765133464 tempest-SecurityGroupsTestAdminJSON-1765133464-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.424380 Aug 04 17:01:29.699613 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 892/1725] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Aug 4 17:01:29 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:29.705833 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-68f3b97e-67b0-4dbb-8a73-830bf5827f2c req-2d1c0f84-bad5-450c-8285-d5632e0a7dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aa159af-25ad-4e88-adfd-88736802c68b", "name": "network-vif-plugged", "status": "completed", "tag": "0cadd627-9251-4fb3-895b-7cb5c6b41b23"}, {"server_uuid": "238cb283-0037-440c-a433-d3f4e3de1274", "name": "network-vif-plugged", "status": "completed", "tag": "b3ffb765-1857-45ce-9f08-b2a94e4fdef2"}, {"server_uuid": "238cb283-0037-440c-a433-d3f4e3de1274", "name": "network-vif-plugged", "status": "completed", "tag": "9c46603b-3e50-4dfd-a7a6-bd1e37bb11c3"}, {"server_uuid": "238cb283-0037-440c-a433-d3f4e3de1274", "name": "network-vif-plugged", "status": "completed", "tag": "3814bb20-52c5-4223-9bc1-3956f0cc6888"}, {"server_uuid": "238cb283-0037-440c-a433-d3f4e3de1274", "name": "network-vif-plugged", "status": "completed", "tag": "4bf2b6ee-be9c-4a4f-8dd2-4adfb41f8692"}, {"server_uuid": "238cb283-0037-440c-a433-d3f4e3de1274", "name": "network-vif-plugged", "status": "completed", "tag": "f4544258-5b29-4f5e-a138-6233282a67c2"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:29.731610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-68f3b97e-67b0-4dbb-8a73-830bf5827f2c req-2d1c0f84-bad5-450c-8285-d5632e0a7dd9 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:29.732360 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-68f3b97e-67b0-4dbb-8a73-830bf5827f2c req-2d1c0f84-bad5-450c-8285-d5632e0a7dd9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:29.733017 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-68f3b97e-67b0-4dbb-8a73-830bf5827f2c req-2d1c0f84-bad5-450c-8285-d5632e0a7dd9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:29.746055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-08d69278-6ff7-4341-8b25-1d838b05664e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:29.754305 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-68f3b97e-67b0-4dbb-8a73-830bf5827f2c req-2d1c0f84-bad5-450c-8285-d5632e0a7dd9 service nova] Creating event network-vif-plugged:0cadd627-9251-4fb3-895b-7cb5c6b41b23 for instance 0aa159af-25ad-4e88-adfd-88736802c68b on n-h1-851359-3 Aug 04 17:01:29.755107 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-68f3b97e-67b0-4dbb-8a73-830bf5827f2c req-2d1c0f84-bad5-450c-8285-d5632e0a7dd9 service nova] Creating event network-vif-plugged:b3ffb765-1857-45ce-9f08-b2a94e4fdef2 for instance 238cb283-0037-440c-a433-d3f4e3de1274 on n-h2-851359-3 Aug 04 17:01:29.755785 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-68f3b97e-67b0-4dbb-8a73-830bf5827f2c req-2d1c0f84-bad5-450c-8285-d5632e0a7dd9 service nova] Creating event network-vif-plugged:9c46603b-3e50-4dfd-a7a6-bd1e37bb11c3 for instance 238cb283-0037-440c-a433-d3f4e3de1274 on n-h2-851359-3 Aug 04 17:01:29.756622 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-68f3b97e-67b0-4dbb-8a73-830bf5827f2c req-2d1c0f84-bad5-450c-8285-d5632e0a7dd9 service nova] Creating event network-vif-plugged:3814bb20-52c5-4223-9bc1-3956f0cc6888 for instance 238cb283-0037-440c-a433-d3f4e3de1274 on n-h2-851359-3 Aug 04 17:01:29.757350 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-68f3b97e-67b0-4dbb-8a73-830bf5827f2c req-2d1c0f84-bad5-450c-8285-d5632e0a7dd9 service nova] Creating event network-vif-plugged:4bf2b6ee-be9c-4a4f-8dd2-4adfb41f8692 for instance 238cb283-0037-440c-a433-d3f4e3de1274 on n-h2-851359-3 Aug 04 17:01:29.758078 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-68f3b97e-67b0-4dbb-8a73-830bf5827f2c req-2d1c0f84-bad5-450c-8285-d5632e0a7dd9 service nova] Creating event network-vif-plugged:f4544258-5b29-4f5e-a138-6233282a67c2 for instance 238cb283-0037-440c-a433-d3f4e3de1274 on n-h2-851359-3 Aug 04 17:01:29.760776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-08d69278-6ff7-4341-8b25-1d838b05664e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:29.765026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-08d69278-6ff7-4341-8b25-1d838b05664e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:29.769001 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-08d69278-6ff7-4341-8b25-1d838b05664e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1875 microversion: 2.32 time: 0.458708 Aug 04 17:01:29.771146 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 834/1726] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:29 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1875 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:29.781556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d6d6372a-72d1-4db3-9e85-2fc35445d2ac tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:29.782100 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d6d6372a-72d1-4db3-9e85-2fc35445d2ac tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] [instance: c2695555-41cc-4eff-ae6c-9b8d443103bb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:29.786085 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-68f3b97e-67b0-4dbb-8a73-830bf5827f2c req-2d1c0f84-bad5-450c-8285-d5632e0a7dd9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.082846 Aug 04 17:01:29.789711 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 893/1727] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:29.801691 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-381ce04f-72a6-405d-9146-79fff26229ef tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:29.803322 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-381ce04f-72a6-405d-9146-79fff26229ef tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0aa159af-25ad-4e88-adfd-88736802c68b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:29.824276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-381ce04f-72a6-405d-9146-79fff26229ef tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:29.825630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-381ce04f-72a6-405d-9146-79fff26229ef tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:29.826942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-381ce04f-72a6-405d-9146-79fff26229ef tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:29.829583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-381ce04f-72a6-405d-9146-79fff26229ef tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:29.831532 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-381ce04f-72a6-405d-9146-79fff26229ef tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:29.831532 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-381ce04f-72a6-405d-9146-79fff26229ef tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:29.938258 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d6d6372a-72d1-4db3-9e85-2fc35445d2ac tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930211b0112b490bbe9f6a262ccaf819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ca0be197104eaaa8b190117f1c2b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:29.953422 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d6d6372a-72d1-4db3-9e85-2fc35445d2ac tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb" status: 200 len: 1216 microversion: 2.1 time: 0.181116 Aug 04 17:01:29.954191 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 835/1728] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:29 2022] GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb => generated 1216 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:29.959555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d7a84554-f919-460d-aed1-193a866ae768 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Action: 'update_all', calling method: .version_select at 0x7f1e5bdf5280>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:30.075153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-d7a84554-f919-460d-aed1-193a866ae768 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Getting quotas for project e35197354071461ea6eb68581701b8d5. Resources: dict_keys(['metadata_items']) {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:01:30.091149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-d7a84554-f919-460d-aed1-193a866ae768 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Getting quotas for user 9a371a60366a4753b4c692be35e98555 and project e35197354071461ea6eb68581701b8d5. Resources: dict_keys(['metadata_items']) {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:01:30.303286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-381ce04f-72a6-405d-9146-79fff26229ef tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:30.314034 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-381ce04f-72a6-405d-9146-79fff26229ef tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b" status: 200 len: 1308 microversion: 2.1 time: 0.522447 Aug 04 17:01:30.317207 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 894/1729] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:29 2022] GET /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b => generated 1308 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:30.542986 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4c8084f8-265b-4dd4-aa19-ae5e83fb7f91 tempest-SecurityGroupsTestAdminJSON-892087962 tempest-SecurityGroupsTestAdminJSON-892087962-project-admin] Action: 'create', calling method: .version_select at 0x7f1e5b0189d0>, body: {"security_group": {"name": "tempest-securitygroup-152994561", "description": "tempest-description-1656161976"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:30.618734 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d7a84554-f919-460d-aed1-193a866ae768 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] 10.222.0.93 "PUT /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360/metadata" status: 200 len: 64 microversion: 2.1 time: 0.663194 Aug 04 17:01:30.619352 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 836/1730] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Aug 4 17:01:29 2022] PUT /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360/metadata => generated 64 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:01:30.628659 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-54a2f7f9-b646-4152-85e8-e8428b4aef66 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:30.629842 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-54a2f7f9-b646-4152-85e8-e8428b4aef66 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:30.646338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54a2f7f9-b646-4152-85e8-e8428b4aef66 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:30.646841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54a2f7f9-b646-4152-85e8-e8428b4aef66 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:30.647465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54a2f7f9-b646-4152-85e8-e8428b4aef66 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:30.648477 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54a2f7f9-b646-4152-85e8-e8428b4aef66 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:30.654433 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54a2f7f9-b646-4152-85e8-e8428b4aef66 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:30.655153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54a2f7f9-b646-4152-85e8-e8428b4aef66 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:30.920871 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-54a2f7f9-b646-4152-85e8-e8428b4aef66 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:30.925566 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-54a2f7f9-b646-4152-85e8-e8428b4aef66 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1211 microversion: 2.1 time: 0.300734 Aug 04 17:01:30.926227 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 837/1731] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:30 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1211 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:30.937013 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-87e580bb-afa4-4745-af82-732b75c970c7 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:30.937905 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-87e580bb-afa4-4745-af82-732b75c970c7 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 14847930-27f6-4ea1-83f0-48a80608885e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:30.956173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87e580bb-afa4-4745-af82-732b75c970c7 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:30.958089 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87e580bb-afa4-4745-af82-732b75c970c7 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:30.958565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87e580bb-afa4-4745-af82-732b75c970c7 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:30.960033 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87e580bb-afa4-4745-af82-732b75c970c7 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:30.960521 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87e580bb-afa4-4745-af82-732b75c970c7 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:30.961099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87e580bb-afa4-4745-af82-732b75c970c7 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:31.305923 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4c8084f8-265b-4dd4-aa19-ae5e83fb7f91 tempest-SecurityGroupsTestAdminJSON-892087962 tempest-SecurityGroupsTestAdminJSON-892087962-project-admin] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.987297 Aug 04 17:01:31.306556 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 895/1732] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Aug 4 17:01:30 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:31.312297 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b249a648-c765-4f3f-9950-38fde14d39cc tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Calling method '.version_select at 0x7f1e5b07d4c0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:31.331565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-87e580bb-afa4-4745-af82-732b75c970c7 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:31.357717 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-87e580bb-afa4-4745-af82-732b75c970c7 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e" status: 200 len: 1315 microversion: 2.1 time: 0.424768 Aug 04 17:01:31.358378 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 838/1733] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:30 2022] GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:31.380703 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-25ccb068-1145-4c64-8f30-fcd5d8d3f9a4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:31.381663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-25ccb068-1145-4c64-8f30-fcd5d8d3f9a4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:31.384613 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b249a648-c765-4f3f-9950-38fde14d39cc tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] 10.222.0.93 "GET /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360/metadata" status: 200 len: 64 microversion: 2.1 time: 0.076735 Aug 04 17:01:31.385176 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 896/1734] 10.222.0.93 () {58 vars in 1260 bytes} [Thu Aug 4 17:01:31 2022] GET /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360/metadata => generated 64 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:01:31.388683 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25ccb068-1145-4c64-8f30-fcd5d8d3f9a4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:31.389504 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25ccb068-1145-4c64-8f30-fcd5d8d3f9a4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:31.390262 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25ccb068-1145-4c64-8f30-fcd5d8d3f9a4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:31.391292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25ccb068-1145-4c64-8f30-fcd5d8d3f9a4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:31.391972 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25ccb068-1145-4c64-8f30-fcd5d8d3f9a4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:31.392613 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25ccb068-1145-4c64-8f30-fcd5d8d3f9a4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:31.396552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f9f5b538-9c13-4db9-8d8f-6ee4451d2957 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:31.400050 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f9f5b538-9c13-4db9-8d8f-6ee4451d2957 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] [instance: c2695555-41cc-4eff-ae6c-9b8d443103bb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:31.412825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9f5b538-9c13-4db9-8d8f-6ee4451d2957 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:31.416548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9f5b538-9c13-4db9-8d8f-6ee4451d2957 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:31.417485 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9f5b538-9c13-4db9-8d8f-6ee4451d2957 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:31.418454 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9f5b538-9c13-4db9-8d8f-6ee4451d2957 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:31.421428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9f5b538-9c13-4db9-8d8f-6ee4451d2957 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:31.422522 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9f5b538-9c13-4db9-8d8f-6ee4451d2957 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:31.704206 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f9f5b538-9c13-4db9-8d8f-6ee4451d2957 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930211b0112b490bbe9f6a262ccaf819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ca0be197104eaaa8b190117f1c2b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:31.722102 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f9f5b538-9c13-4db9-8d8f-6ee4451d2957 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb" status: 200 len: 1274 microversion: 2.1 time: 0.333173 Aug 04 17:01:31.724298 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 897/1735] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:31 2022] GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb => generated 1274 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:31.755378 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-63bcae08-deef-44da-bc45-76ead23cd566 tempest-SecurityGroupsTestAdminJSON-892087962 tempest-SecurityGroupsTestAdminJSON-892087962-project-admin] Action: 'create', calling method: .version_select at 0x7f1e5b018280>, body: {"security_group": {"name": "tempest-securitygroup-1841474844", "description": "tempest-description-2079601150"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:31.766421 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-25ccb068-1145-4c64-8f30-fcd5d8d3f9a4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:31.780769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-25ccb068-1145-4c64-8f30-fcd5d8d3f9a4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:31.787021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-25ccb068-1145-4c64-8f30-fcd5d8d3f9a4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:31.791310 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-25ccb068-1145-4c64-8f30-fcd5d8d3f9a4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1875 microversion: 2.32 time: 0.418323 Aug 04 17:01:31.794287 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 839/1736] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:31 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1875 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:31.814216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-29eebdd9-1602-4e2e-840b-aec419497250 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:31.815564 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-29eebdd9-1602-4e2e-840b-aec419497250 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0aa159af-25ad-4e88-adfd-88736802c68b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:31.834967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29eebdd9-1602-4e2e-840b-aec419497250 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:31.838898 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29eebdd9-1602-4e2e-840b-aec419497250 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:31.839795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29eebdd9-1602-4e2e-840b-aec419497250 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:31.842915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29eebdd9-1602-4e2e-840b-aec419497250 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:31.844502 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29eebdd9-1602-4e2e-840b-aec419497250 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:31.845136 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29eebdd9-1602-4e2e-840b-aec419497250 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:32.161200 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-29eebdd9-1602-4e2e-840b-aec419497250 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:32.177571 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-29eebdd9-1602-4e2e-840b-aec419497250 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b" status: 200 len: 1488 microversion: 2.1 time: 0.381932 Aug 04 17:01:32.178705 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 840/1737] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:31 2022] GET /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b => generated 1488 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:32.186281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-23ade579-f744-4a9c-9c44-9d085dae31d2 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Action: 'update_all', calling method: .version_select at 0x7f1e5bde8ee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:32.250972 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-23ade579-f744-4a9c-9c44-9d085dae31d2 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Getting quotas for project e35197354071461ea6eb68581701b8d5. Resources: dict_keys(['metadata_items']) {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:01:32.259367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-23ade579-f744-4a9c-9c44-9d085dae31d2 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Getting quotas for user 9a371a60366a4753b4c692be35e98555 and project e35197354071461ea6eb68581701b8d5. Resources: dict_keys(['metadata_items']) {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:01:32.397752 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-63bcae08-deef-44da-bc45-76ead23cd566 tempest-SecurityGroupsTestAdminJSON-892087962 tempest-SecurityGroupsTestAdminJSON-892087962-project-admin] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.671108 Aug 04 17:01:32.399041 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 898/1738] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Aug 4 17:01:31 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:32.412444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-9632cd48-95ab-4686-9b52-b77520c22197 req-2626ba3c-23f9-4387-a7ad-989ffaabbab5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "238cb283-0037-440c-a433-d3f4e3de1274", "name": "network-vif-plugged", "status": "completed", "tag": "7101ff22-4276-4569-b4b4-db682cbdbaf2"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:32.439650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9632cd48-95ab-4686-9b52-b77520c22197 req-2626ba3c-23f9-4387-a7ad-989ffaabbab5 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:32.440317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9632cd48-95ab-4686-9b52-b77520c22197 req-2626ba3c-23f9-4387-a7ad-989ffaabbab5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:32.442476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9632cd48-95ab-4686-9b52-b77520c22197 req-2626ba3c-23f9-4387-a7ad-989ffaabbab5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:32.468213 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-9632cd48-95ab-4686-9b52-b77520c22197 req-2626ba3c-23f9-4387-a7ad-989ffaabbab5 service nova] Creating event network-vif-plugged:7101ff22-4276-4569-b4b4-db682cbdbaf2 for instance 238cb283-0037-440c-a433-d3f4e3de1274 on n-h2-851359-3 Aug 04 17:01:32.480962 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-9632cd48-95ab-4686-9b52-b77520c22197 req-2626ba3c-23f9-4387-a7ad-989ffaabbab5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070680 Aug 04 17:01:32.484420 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 899/1739] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:32.499333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fdf7a889-51bc-455d-b5db-e4d43082f801 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:32.500236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fdf7a889-51bc-455d-b5db-e4d43082f801 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:32.514422 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdf7a889-51bc-455d-b5db-e4d43082f801 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:32.515101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdf7a889-51bc-455d-b5db-e4d43082f801 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:32.518062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdf7a889-51bc-455d-b5db-e4d43082f801 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:32.518981 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdf7a889-51bc-455d-b5db-e4d43082f801 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:32.519894 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdf7a889-51bc-455d-b5db-e4d43082f801 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:32.523193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdf7a889-51bc-455d-b5db-e4d43082f801 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:32.802531 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-23ade579-f744-4a9c-9c44-9d085dae31d2 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] 10.222.0.93 "PUT /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360/metadata" status: 200 len: 61 microversion: 2.1 time: 0.621597 Aug 04 17:01:32.808849 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 841/1740] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Aug 4 17:01:32 2022] PUT /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360/metadata => generated 61 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:01:32.811372 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b5db1bf6-4f58-4c9d-bd86-f93d1c4924e6 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:32.814572 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b5db1bf6-4f58-4c9d-bd86-f93d1c4924e6 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0aa159af-25ad-4e88-adfd-88736802c68b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:32.823231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5db1bf6-4f58-4c9d-bd86-f93d1c4924e6 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:32.824372 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5db1bf6-4f58-4c9d-bd86-f93d1c4924e6 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:32.824940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5db1bf6-4f58-4c9d-bd86-f93d1c4924e6 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:32.827129 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5db1bf6-4f58-4c9d-bd86-f93d1c4924e6 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:32.827696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5db1bf6-4f58-4c9d-bd86-f93d1c4924e6 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:32.828493 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5db1bf6-4f58-4c9d-bd86-f93d1c4924e6 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:32.897411 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fdf7a889-51bc-455d-b5db-e4d43082f801 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:32.905023 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fdf7a889-51bc-455d-b5db-e4d43082f801 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1211 microversion: 2.1 time: 0.417874 Aug 04 17:01:32.911053 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 900/1741] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:32 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1211 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:32.925753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5195d656-cf40-44fb-8951-9ca440967ea1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:32.938959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5195d656-cf40-44fb-8951-9ca440967ea1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 14847930-27f6-4ea1-83f0-48a80608885e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:32.945895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5195d656-cf40-44fb-8951-9ca440967ea1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:32.946627 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5195d656-cf40-44fb-8951-9ca440967ea1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:32.947236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5195d656-cf40-44fb-8951-9ca440967ea1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:32.948115 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5195d656-cf40-44fb-8951-9ca440967ea1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:32.951371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5195d656-cf40-44fb-8951-9ca440967ea1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:32.952037 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5195d656-cf40-44fb-8951-9ca440967ea1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:32.960154 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b5db1bf6-4f58-4c9d-bd86-f93d1c4924e6 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "POST /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b/action" status: 202 len: 0 microversion: 2.1 time: 0.154056 Aug 04 17:01:32.963577 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 842/1742] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:01:32 2022] POST /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:01:32.965951 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a80c951a-6c93-4a16-b1c2-981eb7971818 tempest-SecurityGroupsTestAdminJSON-892087962 tempest-SecurityGroupsTestAdminJSON-892087962-project-admin] Calling method '.version_select at 0x7f1e5b4a2dc0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:33.422146 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5195d656-cf40-44fb-8951-9ca440967ea1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:33.437420 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5195d656-cf40-44fb-8951-9ca440967ea1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e" status: 200 len: 1315 microversion: 2.1 time: 0.519314 Aug 04 17:01:33.440855 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 901/1743] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:32 2022] GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e => generated 1315 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:33.448384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-717da571-e1e9-484c-9538-f4aa946f506b tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:33.449534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-717da571-e1e9-484c-9538-f4aa946f506b tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] [instance: c2695555-41cc-4eff-ae6c-9b8d443103bb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:33.453456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:33.464088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-717da571-e1e9-484c-9538-f4aa946f506b tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:33.464896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-717da571-e1e9-484c-9538-f4aa946f506b tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:33.465549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-717da571-e1e9-484c-9538-f4aa946f506b tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:33.466885 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-717da571-e1e9-484c-9538-f4aa946f506b tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:33.467767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-717da571-e1e9-484c-9538-f4aa946f506b tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:33.471860 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-717da571-e1e9-484c-9538-f4aa946f506b tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:33.839188 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-717da571-e1e9-484c-9538-f4aa946f506b tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930211b0112b490bbe9f6a262ccaf819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ca0be197104eaaa8b190117f1c2b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:33.848200 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-717da571-e1e9-484c-9538-f4aa946f506b tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb" status: 200 len: 1316 microversion: 2.1 time: 0.404423 Aug 04 17:01:33.852478 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 902/1744] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:33 2022] GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb => generated 1316 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:33.859058 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-0c287f46-e1cb-46d2-9d61-560ba1aada81 req-0ec15c26-6e7f-42a1-9f0c-4d670b393e65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14847930-27f6-4ea1-83f0-48a80608885e", "tag": "0f46cabf-3821-4a07-bdf2-8a93e0b4ea41"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:33.884573 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-0c287f46-e1cb-46d2-9d61-560ba1aada81 req-0ec15c26-6e7f-42a1-9f0c-4d670b393e65 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:33.885347 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-0c287f46-e1cb-46d2-9d61-560ba1aada81 req-0ec15c26-6e7f-42a1-9f0c-4d670b393e65 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:33.886009 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-0c287f46-e1cb-46d2-9d61-560ba1aada81 req-0ec15c26-6e7f-42a1-9f0c-4d670b393e65 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:33.904591 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-0c287f46-e1cb-46d2-9d61-560ba1aada81 req-0ec15c26-6e7f-42a1-9f0c-4d670b393e65 service nova] Creating event network-changed:0f46cabf-3821-4a07-bdf2-8a93e0b4ea41 for instance 14847930-27f6-4ea1-83f0-48a80608885e on n-h1-851359-3 Aug 04 17:01:33.910885 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-0c287f46-e1cb-46d2-9d61-560ba1aada81 req-0ec15c26-6e7f-42a1-9f0c-4d670b393e65 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057040 Aug 04 17:01:33.912060 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 903/1745] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:33.918656 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3ca3378e-0625-46f8-9deb-588e6045c13b tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Action: 'update', calling method: .version_select at 0x7f1e5b05f430>, body: {"meta": {"os_version": "alt"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:33.975154 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-3ca3378e-0625-46f8-9deb-588e6045c13b tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Getting quotas for project e35197354071461ea6eb68581701b8d5. Resources: dict_keys(['metadata_items']) {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:01:33.984900 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-3ca3378e-0625-46f8-9deb-588e6045c13b tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Getting quotas for user 9a371a60366a4753b4c692be35e98555 and project e35197354071461ea6eb68581701b8d5. Resources: dict_keys(['metadata_items']) {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:01:34.280708 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3ca3378e-0625-46f8-9deb-588e6045c13b tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] 10.222.0.93 "PUT /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.367229 Aug 04 17:01:34.281307 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 904/1746] 10.222.0.93 () {60 vars in 1313 bytes} [Thu Aug 4 17:01:33 2022] PUT /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360/metadata/os_version => generated 31 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:01:34.285998 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8c214cfa-01c2-45a2-9918-1f6029ce0ce2 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:34.286741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8c214cfa-01c2-45a2-9918-1f6029ce0ce2 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:34.292957 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c214cfa-01c2-45a2-9918-1f6029ce0ce2 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:34.293445 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c214cfa-01c2-45a2-9918-1f6029ce0ce2 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:34.293883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c214cfa-01c2-45a2-9918-1f6029ce0ce2 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:34.294612 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c214cfa-01c2-45a2-9918-1f6029ce0ce2 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:34.295074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c214cfa-01c2-45a2-9918-1f6029ce0ce2 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:34.295516 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c214cfa-01c2-45a2-9918-1f6029ce0ce2 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:34.575652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8c214cfa-01c2-45a2-9918-1f6029ce0ce2 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:34.600241 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8c214cfa-01c2-45a2-9918-1f6029ce0ce2 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:34.602223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8c214cfa-01c2-45a2-9918-1f6029ce0ce2 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:34.603436 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8c214cfa-01c2-45a2-9918-1f6029ce0ce2 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1875 microversion: 2.32 time: 0.321152 Aug 04 17:01:34.609182 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 905/1747] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:34 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1875 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:34.614846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2753752f-80af-42a1-bbb7-92457ee60d5d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:34.615975 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2753752f-80af-42a1-bbb7-92457ee60d5d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0aa159af-25ad-4e88-adfd-88736802c68b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:34.624527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2753752f-80af-42a1-bbb7-92457ee60d5d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:34.625597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2753752f-80af-42a1-bbb7-92457ee60d5d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:34.626450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2753752f-80af-42a1-bbb7-92457ee60d5d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:34.627346 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2753752f-80af-42a1-bbb7-92457ee60d5d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:34.627979 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2753752f-80af-42a1-bbb7-92457ee60d5d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:34.628578 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2753752f-80af-42a1-bbb7-92457ee60d5d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:34.849835 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2753752f-80af-42a1-bbb7-92457ee60d5d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:34.858331 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2753752f-80af-42a1-bbb7-92457ee60d5d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b" status: 200 len: 1473 microversion: 2.1 time: 0.247664 Aug 04 17:01:34.859334 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 906/1748] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:34 2022] GET /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b => generated 1473 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:34.865929 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0f192875-e538-4f87-91be-48176563fefd tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:34.867832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0f192875-e538-4f87-91be-48176563fefd tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:34.879710 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f192875-e538-4f87-91be-48176563fefd tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:34.880515 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f192875-e538-4f87-91be-48176563fefd tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:34.882225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f192875-e538-4f87-91be-48176563fefd tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:34.883757 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f192875-e538-4f87-91be-48176563fefd tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:34.885483 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f192875-e538-4f87-91be-48176563fefd tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:34.886286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f192875-e538-4f87-91be-48176563fefd tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:35.097019 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0f192875-e538-4f87-91be-48176563fefd tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:35.108714 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0f192875-e538-4f87-91be-48176563fefd tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1199 microversion: 2.1 time: 0.247724 Aug 04 17:01:35.109480 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 907/1749] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:34 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1199 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:35.115681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6c6acfd4-e2c3-4432-942c-284c7df5ac01 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Calling method '.version_select at 0x7f1e5b05fca0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:35.207035 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6c6acfd4-e2c3-4432-942c-284c7df5ac01 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] 10.222.0.93 "GET /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360/metadata" status: 200 len: 58 microversion: 2.1 time: 0.096049 Aug 04 17:01:35.212673 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 908/1750] 10.222.0.93 () {58 vars in 1260 bytes} [Thu Aug 4 17:01:35 2022] GET /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360/metadata => generated 58 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:01:35.224420 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-19dd4286-f53b-4b61-b71c-78393e504d65 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:35.234645 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-19dd4286-f53b-4b61-b71c-78393e504d65 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 14847930-27f6-4ea1-83f0-48a80608885e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:35.255135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19dd4286-f53b-4b61-b71c-78393e504d65 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:35.255664 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19dd4286-f53b-4b61-b71c-78393e504d65 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:35.256124 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19dd4286-f53b-4b61-b71c-78393e504d65 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:35.256869 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19dd4286-f53b-4b61-b71c-78393e504d65 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:35.257341 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19dd4286-f53b-4b61-b71c-78393e504d65 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:35.257933 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19dd4286-f53b-4b61-b71c-78393e504d65 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:35.492751 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-19dd4286-f53b-4b61-b71c-78393e504d65 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:35.503705 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-19dd4286-f53b-4b61-b71c-78393e504d65 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e" status: 200 len: 1315 microversion: 2.1 time: 0.288956 Aug 04 17:01:35.506687 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 909/1751] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:35 2022] GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:35.512333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-885ab2f0-1a1d-45cf-a9ae-77b72de9276c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:35.513377 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-885ab2f0-1a1d-45cf-a9ae-77b72de9276c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] [instance: c2695555-41cc-4eff-ae6c-9b8d443103bb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:35.523347 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-885ab2f0-1a1d-45cf-a9ae-77b72de9276c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:35.526312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-885ab2f0-1a1d-45cf-a9ae-77b72de9276c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:35.526782 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-885ab2f0-1a1d-45cf-a9ae-77b72de9276c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:35.527561 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-885ab2f0-1a1d-45cf-a9ae-77b72de9276c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:35.528015 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-885ab2f0-1a1d-45cf-a9ae-77b72de9276c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:35.528459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-885ab2f0-1a1d-45cf-a9ae-77b72de9276c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:35.746704 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-885ab2f0-1a1d-45cf-a9ae-77b72de9276c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930211b0112b490bbe9f6a262ccaf819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ca0be197104eaaa8b190117f1c2b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:35.755883 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-885ab2f0-1a1d-45cf-a9ae-77b72de9276c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb" status: 200 len: 1316 microversion: 2.1 time: 0.247766 Aug 04 17:01:35.756597 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 910/1752] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:35 2022] GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb => generated 1316 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:35.761787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-78431292-379e-4245-b5bf-5fc0dd989ffb tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2139387997"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:35.764695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-78431292-379e-4245-b5bf-5fc0dd989ffb tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0aa159af-25ad-4e88-adfd-88736802c68b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:35.771331 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78431292-379e-4245-b5bf-5fc0dd989ffb tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:35.772079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78431292-379e-4245-b5bf-5fc0dd989ffb tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:35.772779 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78431292-379e-4245-b5bf-5fc0dd989ffb tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:35.773715 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78431292-379e-4245-b5bf-5fc0dd989ffb tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:35.774208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78431292-379e-4245-b5bf-5fc0dd989ffb tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:35.774646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78431292-379e-4245-b5bf-5fc0dd989ffb tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:35.898279 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a80c951a-6c93-4a16-b1c2-981eb7971818 tempest-SecurityGroupsTestAdminJSON-892087962 tempest-SecurityGroupsTestAdminJSON-892087962-project-admin] 10.222.0.93 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 12294 microversion: 2.1 time: 2.935266 Aug 04 17:01:35.912320 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 843/1753] 10.222.0.93 () {58 vars in 1191 bytes} [Thu Aug 4 17:01:32 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 12294 bytes in 2951 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:01:35.924200 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d61659c0-425c-4635-b482-b79b5103cfb7 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Action: 'update_all', calling method: .version_select at 0x7f1e5b592430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:35.974874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:35.983884 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-d61659c0-425c-4635-b482-b79b5103cfb7 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Getting quotas for project e35197354071461ea6eb68581701b8d5. Resources: dict_keys(['metadata_items']) {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:01:35.989840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-d61659c0-425c-4635-b482-b79b5103cfb7 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Getting quotas for user 9a371a60366a4753b4c692be35e98555 and project e35197354071461ea6eb68581701b8d5. Resources: dict_keys(['metadata_items']) {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:01:36.000224 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-78431292-379e-4245-b5bf-5fc0dd989ffb tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "POST /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b/action" status: 202 len: 0 microversion: 2.1 time: 0.241795 Aug 04 17:01:36.001776 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 911/1754] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:01:35 2022] POST /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 17:01:36.008668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8697bc7a-a6ff-471b-8593-196166aaec1a tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:36.009696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8697bc7a-a6ff-471b-8593-196166aaec1a tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:36.016964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8697bc7a-a6ff-471b-8593-196166aaec1a tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:36.017456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8697bc7a-a6ff-471b-8593-196166aaec1a tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:36.017963 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8697bc7a-a6ff-471b-8593-196166aaec1a tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:36.020801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8697bc7a-a6ff-471b-8593-196166aaec1a tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:36.021286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8697bc7a-a6ff-471b-8593-196166aaec1a tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:36.021728 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8697bc7a-a6ff-471b-8593-196166aaec1a tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:36.249340 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8697bc7a-a6ff-471b-8593-196166aaec1a tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:36.261648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8697bc7a-a6ff-471b-8593-196166aaec1a tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:36.263938 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8697bc7a-a6ff-471b-8593-196166aaec1a tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:36.265625 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8697bc7a-a6ff-471b-8593-196166aaec1a tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1875 microversion: 2.32 time: 0.262309 Aug 04 17:01:36.266211 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 912/1755] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:36 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1875 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:36.271445 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ee00533c-4f9b-4d24-8c5f-243c6ee6d306 tempest-SecurityGroupsTestAdminJSON-1765133464 tempest-SecurityGroupsTestAdminJSON-1765133464-project] Calling method '.version_select at 0x7f1e5b05fb80>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:36.306516 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d61659c0-425c-4635-b482-b79b5103cfb7 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] 10.222.0.93 "PUT /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360/metadata" status: 200 len: 61 microversion: 2.1 time: 0.392494 Aug 04 17:01:36.307585 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 844/1756] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Aug 4 17:01:35 2022] PUT /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360/metadata => generated 61 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:01:36.329050 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-1a551033-2cfa-4699-a2be-84807f28fec9 req-bf8a2387-4d9d-4f84-b9c4-c92bc17894cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2695555-41cc-4eff-ae6c-9b8d443103bb", "tag": "a400318a-3d22-404a-90ec-54d7d582192d"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:36.349901 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1a551033-2cfa-4699-a2be-84807f28fec9 req-bf8a2387-4d9d-4f84-b9c4-c92bc17894cf service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:36.350655 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1a551033-2cfa-4699-a2be-84807f28fec9 req-bf8a2387-4d9d-4f84-b9c4-c92bc17894cf service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:36.351413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1a551033-2cfa-4699-a2be-84807f28fec9 req-bf8a2387-4d9d-4f84-b9c4-c92bc17894cf service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:36.371487 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-1a551033-2cfa-4699-a2be-84807f28fec9 req-bf8a2387-4d9d-4f84-b9c4-c92bc17894cf service nova] Creating event network-changed:a400318a-3d22-404a-90ec-54d7d582192d for instance c2695555-41cc-4eff-ae6c-9b8d443103bb on n-h2-851359-3 Aug 04 17:01:36.377170 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-1a551033-2cfa-4699-a2be-84807f28fec9 req-bf8a2387-4d9d-4f84-b9c4-c92bc17894cf service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063888 Aug 04 17:01:36.378015 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 845/1757] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:36.386514 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eabf810a-8953-4a73-aa43-e39710066282 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5b3a80d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:36.447389 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eabf810a-8953-4a73-aa43-e39710066282 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee" status: 200 len: 1410 microversion: 2.1 time: 0.064774 Aug 04 17:01:36.448559 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 846/1758] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:01:36 2022] GET /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee => generated 1410 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:36.454497 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0987cbf4-32d7-426b-88aa-348c033ba5ac tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:36.455231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0987cbf4-32d7-426b-88aa-348c033ba5ac tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:36.467668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0987cbf4-32d7-426b-88aa-348c033ba5ac tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:36.468154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0987cbf4-32d7-426b-88aa-348c033ba5ac tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:36.468599 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0987cbf4-32d7-426b-88aa-348c033ba5ac tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:36.469319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0987cbf4-32d7-426b-88aa-348c033ba5ac tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:36.470040 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0987cbf4-32d7-426b-88aa-348c033ba5ac tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:36.475172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0987cbf4-32d7-426b-88aa-348c033ba5ac tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:36.500319 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ee00533c-4f9b-4d24-8c5f-243c6ee6d306 tempest-SecurityGroupsTestAdminJSON-1765133464 tempest-SecurityGroupsTestAdminJSON-1765133464-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1109 microversion: 2.1 time: 0.232961 Aug 04 17:01:36.501217 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 913/1759] 10.222.0.93 () {58 vars in 1191 bytes} [Thu Aug 4 17:01:36 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1109 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:36.505807 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e4ef0569-e7eb-425e-853a-03e2e428ed00 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Action: 'create', calling method: .version_select at 0x7f1e5b0304c0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:36.576844 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=29 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:36.580255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-e4ef0569-e7eb-425e-853a-03e2e428ed00 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Getting quotas for project e35197354071461ea6eb68581701b8d5. Resources: dict_keys(['metadata_items']) {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:01:36.587369 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-e4ef0569-e7eb-425e-853a-03e2e428ed00 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Getting quotas for user 9a371a60366a4753b4c692be35e98555 and project e35197354071461ea6eb68581701b8d5. Resources: dict_keys(['metadata_items']) {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:01:36.637769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0987cbf4-32d7-426b-88aa-348c033ba5ac tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:36.646536 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0987cbf4-32d7-426b-88aa-348c033ba5ac tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1199 microversion: 2.1 time: 0.196720 Aug 04 17:01:36.647101 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 847/1760] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:36 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1199 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:36.652397 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-68804144-47af-43a8-ab62-392b5d10ab0c tempest-SecurityGroupsTestAdminJSON-892087962 tempest-SecurityGroupsTestAdminJSON-892087962-project-admin] Calling method '.version_select at 0x7f1e5bb79ca0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:36.855841 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-68804144-47af-43a8-ab62-392b5d10ab0c tempest-SecurityGroupsTestAdminJSON-892087962 tempest-SecurityGroupsTestAdminJSON-892087962-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/827656bd-7a02-42d8-ae53-113d3dcbfd36" status: 202 len: 0 microversion: 2.1 time: 0.206689 Aug 04 17:01:36.859971 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 848/1761] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 17:01:36 2022] DELETE /compute/v2.1/os-security-groups/827656bd-7a02-42d8-ae53-113d3dcbfd36 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:01:36.865255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c4978d24-4700-453c-bae4-b3990d70575d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:36.865891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c4978d24-4700-453c-bae4-b3990d70575d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 14847930-27f6-4ea1-83f0-48a80608885e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:36.876052 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4978d24-4700-453c-bae4-b3990d70575d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:36.876558 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4978d24-4700-453c-bae4-b3990d70575d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:36.877004 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4978d24-4700-453c-bae4-b3990d70575d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:36.877720 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4978d24-4700-453c-bae4-b3990d70575d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:36.878283 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4978d24-4700-453c-bae4-b3990d70575d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:36.878746 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4978d24-4700-453c-bae4-b3990d70575d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:36.883793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:36.921602 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e4ef0569-e7eb-425e-853a-03e2e428ed00 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] 10.222.0.93 "POST /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360/metadata" status: 200 len: 85 microversion: 2.1 time: 0.419045 Aug 04 17:01:36.927959 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 914/1762] 10.222.0.93 () {60 vars in 1281 bytes} [Thu Aug 4 17:01:36 2022] POST /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360/metadata => generated 85 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:01:36.933523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3df043f5-8fa0-4672-92e5-80781e8e178b tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:36.934383 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3df043f5-8fa0-4672-92e5-80781e8e178b tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] [instance: c2695555-41cc-4eff-ae6c-9b8d443103bb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:36.941864 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3df043f5-8fa0-4672-92e5-80781e8e178b tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:36.942654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3df043f5-8fa0-4672-92e5-80781e8e178b tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:36.943270 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3df043f5-8fa0-4672-92e5-80781e8e178b tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:36.944856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3df043f5-8fa0-4672-92e5-80781e8e178b tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:36.945350 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3df043f5-8fa0-4672-92e5-80781e8e178b tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:36.945790 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3df043f5-8fa0-4672-92e5-80781e8e178b tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:37.159269 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c4978d24-4700-453c-bae4-b3990d70575d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:37.173709 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c4978d24-4700-453c-bae4-b3990d70575d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e" status: 200 len: 1315 microversion: 2.1 time: 0.312610 Aug 04 17:01:37.178064 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 849/1763] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:36 2022] GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:37.185967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2d68b3f9-1934-4146-98ba-b0f08b544295 tempest-SecurityGroupsTestAdminJSON-892087962 tempest-SecurityGroupsTestAdminJSON-892087962-project-admin] Calling method '.version_select at 0x7f1e5bdf5ee0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:37.189039 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3df043f5-8fa0-4672-92e5-80781e8e178b tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930211b0112b490bbe9f6a262ccaf819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ca0be197104eaaa8b190117f1c2b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:37.199032 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3df043f5-8fa0-4672-92e5-80781e8e178b tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb" status: 200 len: 1316 microversion: 2.1 time: 0.269098 Aug 04 17:01:37.199943 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 915/1764] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:36 2022] GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb => generated 1316 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:37.208154 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e000b753-68f0-40d2-a200-8bd953e1cba9 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] Calling method '.version_select at 0x7f1e5b030160>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:37.270089 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e000b753-68f0-40d2-a200-8bd953e1cba9 tempest-ImagesMetadataTestJSON-794910170 tempest-ImagesMetadataTestJSON-794910170-project] 10.222.0.93 "GET /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360/metadata" status: 200 len: 85 microversion: 2.1 time: 0.068603 Aug 04 17:01:37.270746 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 916/1765] 10.222.0.93 () {58 vars in 1260 bytes} [Thu Aug 4 17:01:37 2022] GET /compute/v2.1/images/a09266f8-0551-4983-a137-4a4f3675a360/metadata => generated 85 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:01:37.292976 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1430e95a-69af-45b4-9bc1-ee60af2238c4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:37.294327 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1430e95a-69af-45b4-9bc1-ee60af2238c4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:37.314209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1430e95a-69af-45b4-9bc1-ee60af2238c4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:37.314914 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1430e95a-69af-45b4-9bc1-ee60af2238c4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:37.315257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1430e95a-69af-45b4-9bc1-ee60af2238c4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:37.316056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1430e95a-69af-45b4-9bc1-ee60af2238c4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:37.316566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1430e95a-69af-45b4-9bc1-ee60af2238c4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:37.318561 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1430e95a-69af-45b4-9bc1-ee60af2238c4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:37.903103 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2d68b3f9-1934-4146-98ba-b0f08b544295 tempest-SecurityGroupsTestAdminJSON-892087962 tempest-SecurityGroupsTestAdminJSON-892087962-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/279a94d1-81ea-45e7-8cf7-c85781c33e23" status: 202 len: 0 microversion: 2.1 time: 0.722175 Aug 04 17:01:37.904050 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 850/1766] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 17:01:37 2022] DELETE /compute/v2.1/os-security-groups/279a94d1-81ea-45e7-8cf7-c85781c33e23 => generated 0 bytes in 724 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:01:37.909300 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-295e323a-ad53-451c-ba52-7e36dc8441b2 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5bc064c0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:37.967496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1430e95a-69af-45b4-9bc1-ee60af2238c4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:37.971147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:37.978789 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1430e95a-69af-45b4-9bc1-ee60af2238c4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:37.985643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1430e95a-69af-45b4-9bc1-ee60af2238c4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:37.987068 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1430e95a-69af-45b4-9bc1-ee60af2238c4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 2826 microversion: 2.32 time: 0.700408 Aug 04 17:01:37.999414 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 917/1767] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:01:37 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 2826 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:38.008339 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-39760fe4-8830-4ebc-ae8b-1aba241ac2f5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:38.009579 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-39760fe4-8830-4ebc-ae8b-1aba241ac2f5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:38.022022 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-295e323a-ad53-451c-ba52-7e36dc8441b2 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee" status: 200 len: 1410 microversion: 2.1 time: 0.116596 Aug 04 17:01:38.022580 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 851/1768] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:01:37 2022] GET /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee => generated 1410 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:38.023308 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39760fe4-8830-4ebc-ae8b-1aba241ac2f5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:38.023774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39760fe4-8830-4ebc-ae8b-1aba241ac2f5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:38.024278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39760fe4-8830-4ebc-ae8b-1aba241ac2f5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:38.025472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39760fe4-8830-4ebc-ae8b-1aba241ac2f5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:38.025951 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39760fe4-8830-4ebc-ae8b-1aba241ac2f5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:38.026472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39760fe4-8830-4ebc-ae8b-1aba241ac2f5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:38.028617 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-520a35dd-6853-4008-a5f7-46d5f3e362b2 tempest-SecurityGroupsTestAdminJSON-1765133464 tempest-SecurityGroupsTestAdminJSON-1765133464-project] Calling method '.version_select at 0x7f1e5bdf5ee0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:38.260745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-39760fe4-8830-4ebc-ae8b-1aba241ac2f5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:38.270160 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-39760fe4-8830-4ebc-ae8b-1aba241ac2f5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1199 microversion: 2.1 time: 0.268385 Aug 04 17:01:38.270748 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 918/1769] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:37 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1199 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:38.280625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c13fce96-fabe-4753-a4e8-b910267f5ba4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:38.281849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c13fce96-fabe-4753-a4e8-b910267f5ba4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:38.292091 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c13fce96-fabe-4753-a4e8-b910267f5ba4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:38.292817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c13fce96-fabe-4753-a4e8-b910267f5ba4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:38.293358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c13fce96-fabe-4753-a4e8-b910267f5ba4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:38.294305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c13fce96-fabe-4753-a4e8-b910267f5ba4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:38.295192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c13fce96-fabe-4753-a4e8-b910267f5ba4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:38.295320 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c13fce96-fabe-4753-a4e8-b910267f5ba4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:38.438951 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c13fce96-fabe-4753-a4e8-b910267f5ba4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.167065 Aug 04 17:01:38.439746 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 919/1770] 10.222.0.93 () {60 vars in 1316 bytes} [Thu Aug 4 17:01:38 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274/os-interface => generated 1830 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:01:38.444658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-42d2e1d2-0f49-4f34-b22b-514d64012717 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:38.446226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-42d2e1d2-0f49-4f34-b22b-514d64012717 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 14847930-27f6-4ea1-83f0-48a80608885e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:38.451513 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-520a35dd-6853-4008-a5f7-46d5f3e362b2 tempest-SecurityGroupsTestAdminJSON-1765133464 tempest-SecurityGroupsTestAdminJSON-1765133464-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/7b4ba99b-c6aa-4ac2-b1fe-c62fb610668d" status: 202 len: 0 microversion: 2.1 time: 0.425882 Aug 04 17:01:38.452066 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42d2e1d2-0f49-4f34-b22b-514d64012717 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:38.452305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42d2e1d2-0f49-4f34-b22b-514d64012717 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:38.452749 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42d2e1d2-0f49-4f34-b22b-514d64012717 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:38.453436 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 852/1771] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 17:01:38 2022] DELETE /compute/v2.1/os-security-groups/7b4ba99b-c6aa-4ac2-b1fe-c62fb610668d => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:01:38.456578 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42d2e1d2-0f49-4f34-b22b-514d64012717 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:38.457151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42d2e1d2-0f49-4f34-b22b-514d64012717 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:38.457601 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42d2e1d2-0f49-4f34-b22b-514d64012717 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:38.463969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2f57407e-9fb7-4315-b329-dc25913e88df tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:38.464614 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2f57407e-9fb7-4315-b329-dc25913e88df tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] [instance: c2695555-41cc-4eff-ae6c-9b8d443103bb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:38.472112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f57407e-9fb7-4315-b329-dc25913e88df tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:38.473046 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f57407e-9fb7-4315-b329-dc25913e88df tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:38.473758 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f57407e-9fb7-4315-b329-dc25913e88df tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:38.475221 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f57407e-9fb7-4315-b329-dc25913e88df tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:38.476160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f57407e-9fb7-4315-b329-dc25913e88df tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:38.476799 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f57407e-9fb7-4315-b329-dc25913e88df tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:38.795137 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2f57407e-9fb7-4315-b329-dc25913e88df tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930211b0112b490bbe9f6a262ccaf819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ca0be197104eaaa8b190117f1c2b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:38.808856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=8 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:38.816462 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2f57407e-9fb7-4315-b329-dc25913e88df tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb" status: 200 len: 1316 microversion: 2.1 time: 0.361219 Aug 04 17:01:38.818134 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 853/1772] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:38 2022] GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb => generated 1316 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:38.824468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dfbe9cef-7b50-4ede-adae-73f2f95bedc3 tempest-SecurityGroupsTestAdminJSON-1765133464 tempest-SecurityGroupsTestAdminJSON-1765133464-project] Calling method '.version_select at 0x7f1e5b54be50>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:38.851780 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-42d2e1d2-0f49-4f34-b22b-514d64012717 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:38.864947 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-42d2e1d2-0f49-4f34-b22b-514d64012717 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e" status: 200 len: 1315 microversion: 2.1 time: 0.422931 Aug 04 17:01:38.871679 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 920/1773] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:38 2022] GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e => generated 1315 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:39.037550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3959fbdb-1443-43a6-9989-b161769feb00 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5b11c9d0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:39.141913 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3959fbdb-1443-43a6-9989-b161769feb00 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee" status: 200 len: 1410 microversion: 2.1 time: 0.108992 Aug 04 17:01:39.150876 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 921/1774] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:01:39 2022] GET /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee => generated 1410 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:39.169334 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dfbe9cef-7b50-4ede-adae-73f2f95bedc3 tempest-SecurityGroupsTestAdminJSON-1765133464 tempest-SecurityGroupsTestAdminJSON-1765133464-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/f95b92aa-bf36-44c3-bb05-bbe73446ac0b" status: 202 len: 0 microversion: 2.1 time: 0.349432 Aug 04 17:01:39.170075 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 854/1775] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 17:01:38 2022] DELETE /compute/v2.1/os-security-groups/f95b92aa-bf36-44c3-bb05-bbe73446ac0b => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:01:39.294548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1595ba2c-c9c2-4b3f-80d8-e8fee43bfa09 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:39.295240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1595ba2c-c9c2-4b3f-80d8-e8fee43bfa09 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:39.306309 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1595ba2c-c9c2-4b3f-80d8-e8fee43bfa09 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:39.307154 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1595ba2c-c9c2-4b3f-80d8-e8fee43bfa09 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:39.307610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1595ba2c-c9c2-4b3f-80d8-e8fee43bfa09 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:39.308344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1595ba2c-c9c2-4b3f-80d8-e8fee43bfa09 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:39.308816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1595ba2c-c9c2-4b3f-80d8-e8fee43bfa09 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:39.309249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1595ba2c-c9c2-4b3f-80d8-e8fee43bfa09 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:39.602416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1595ba2c-c9c2-4b3f-80d8-e8fee43bfa09 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:39.614308 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1595ba2c-c9c2-4b3f-80d8-e8fee43bfa09 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1199 microversion: 2.1 time: 0.325678 Aug 04 17:01:39.615219 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 922/1776] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:39 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1199 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:39.680681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-3b410fec-46f0-4e6e-b26f-108185f3dc6d req-db66eb8c-c1c1-481a-9765-4df66df0d514 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14847930-27f6-4ea1-83f0-48a80608885e", "name": "network-vif-plugged", "status": "completed", "tag": "0f46cabf-3821-4a07-bdf2-8a93e0b4ea41"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:39.710393 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-3b410fec-46f0-4e6e-b26f-108185f3dc6d req-db66eb8c-c1c1-481a-9765-4df66df0d514 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:39.711401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-3b410fec-46f0-4e6e-b26f-108185f3dc6d req-db66eb8c-c1c1-481a-9765-4df66df0d514 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:39.713963 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-3b410fec-46f0-4e6e-b26f-108185f3dc6d req-db66eb8c-c1c1-481a-9765-4df66df0d514 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:39.766454 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-3b410fec-46f0-4e6e-b26f-108185f3dc6d req-db66eb8c-c1c1-481a-9765-4df66df0d514 service nova] Creating event network-vif-plugged:0f46cabf-3821-4a07-bdf2-8a93e0b4ea41 for instance 14847930-27f6-4ea1-83f0-48a80608885e on n-h1-851359-3 Aug 04 17:01:39.774226 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-3b410fec-46f0-4e6e-b26f-108185f3dc6d req-db66eb8c-c1c1-481a-9765-4df66df0d514 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097859 Aug 04 17:01:39.777133 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 855/1777] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:01:39.804590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-63c77967-6dcf-4782-84f6-b6ec4c86cb27 req-2af0e239-4e3c-444a-93ae-59b5741f2a88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "238cb283-0037-440c-a433-d3f4e3de1274", "tag": "3814bb20-52c5-4223-9bc1-3956f0cc6888"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:39.828974 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-63c77967-6dcf-4782-84f6-b6ec4c86cb27 req-2af0e239-4e3c-444a-93ae-59b5741f2a88 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:39.830538 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-63c77967-6dcf-4782-84f6-b6ec4c86cb27 req-2af0e239-4e3c-444a-93ae-59b5741f2a88 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:39.831293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-63c77967-6dcf-4782-84f6-b6ec4c86cb27 req-2af0e239-4e3c-444a-93ae-59b5741f2a88 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:39.843265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-da372e0e-6b54-4193-bc9f-32a36e125877 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:39.844767 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-da372e0e-6b54-4193-bc9f-32a36e125877 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] [instance: c2695555-41cc-4eff-ae6c-9b8d443103bb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:39.856733 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da372e0e-6b54-4193-bc9f-32a36e125877 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:39.858719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da372e0e-6b54-4193-bc9f-32a36e125877 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:39.861360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da372e0e-6b54-4193-bc9f-32a36e125877 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:39.862780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da372e0e-6b54-4193-bc9f-32a36e125877 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:39.870747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da372e0e-6b54-4193-bc9f-32a36e125877 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:39.873586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da372e0e-6b54-4193-bc9f-32a36e125877 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:39.881778 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-63c77967-6dcf-4782-84f6-b6ec4c86cb27 req-2af0e239-4e3c-444a-93ae-59b5741f2a88 service nova] Creating event network-changed:3814bb20-52c5-4223-9bc1-3956f0cc6888 for instance 238cb283-0037-440c-a433-d3f4e3de1274 on n-h2-851359-3 Aug 04 17:01:39.912678 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-63c77967-6dcf-4782-84f6-b6ec4c86cb27 req-2af0e239-4e3c-444a-93ae-59b5741f2a88 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112317 Aug 04 17:01:39.913888 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 923/1778] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:39.919582 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ce1c0a06-3879-47f3-a922-c68304be9e5e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:39.929599 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ce1c0a06-3879-47f3-a922-c68304be9e5e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 14847930-27f6-4ea1-83f0-48a80608885e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:39.939167 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ce1c0a06-3879-47f3-a922-c68304be9e5e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:39.942783 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ce1c0a06-3879-47f3-a922-c68304be9e5e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:39.953305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ce1c0a06-3879-47f3-a922-c68304be9e5e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:39.954602 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ce1c0a06-3879-47f3-a922-c68304be9e5e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:39.955206 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ce1c0a06-3879-47f3-a922-c68304be9e5e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:39.956004 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ce1c0a06-3879-47f3-a922-c68304be9e5e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:40.406527 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-da372e0e-6b54-4193-bc9f-32a36e125877 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930211b0112b490bbe9f6a262ccaf819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ca0be197104eaaa8b190117f1c2b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:40.415405 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-da372e0e-6b54-4193-bc9f-32a36e125877 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb" status: 200 len: 1316 microversion: 2.1 time: 0.576640 Aug 04 17:01:40.419753 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 856/1779] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:39 2022] GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb => generated 1316 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:40.428429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-038f4315-91f5-49bc-b77a-184aacf6dbfa tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e6a348a60>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:40.435288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ce1c0a06-3879-47f3-a922-c68304be9e5e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:40.445630 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ce1c0a06-3879-47f3-a922-c68304be9e5e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e" status: 200 len: 1315 microversion: 2.1 time: 0.530142 Aug 04 17:01:40.453718 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 924/1780] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:39 2022] GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e => generated 1315 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:40.639985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7d47d2e1-94fc-44bf-abb9-dbedf8903428 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:40.640929 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7d47d2e1-94fc-44bf-abb9-dbedf8903428 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:40.654315 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d47d2e1-94fc-44bf-abb9-dbedf8903428 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:40.654827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d47d2e1-94fc-44bf-abb9-dbedf8903428 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:40.655258 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d47d2e1-94fc-44bf-abb9-dbedf8903428 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:40.655961 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d47d2e1-94fc-44bf-abb9-dbedf8903428 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:40.661209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d47d2e1-94fc-44bf-abb9-dbedf8903428 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:40.663331 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d47d2e1-94fc-44bf-abb9-dbedf8903428 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:41.268746 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7d47d2e1-94fc-44bf-abb9-dbedf8903428 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:41.281479 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7d47d2e1-94fc-44bf-abb9-dbedf8903428 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1199 microversion: 2.1 time: 0.645842 Aug 04 17:01:41.297307 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 925/1781] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:40 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1199 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:41.437890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-04efdec6-353b-432d-9a50-fb632d744d51 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:41.439391 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-04efdec6-353b-432d-9a50-fb632d744d51 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] [instance: c2695555-41cc-4eff-ae6c-9b8d443103bb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:41.456362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-04efdec6-353b-432d-9a50-fb632d744d51 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:41.462151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-04efdec6-353b-432d-9a50-fb632d744d51 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:41.465454 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-04efdec6-353b-432d-9a50-fb632d744d51 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:41.468437 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-04efdec6-353b-432d-9a50-fb632d744d51 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:41.470450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-04efdec6-353b-432d-9a50-fb632d744d51 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:41.475499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-04efdec6-353b-432d-9a50-fb632d744d51 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:42.180389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-04efdec6-353b-432d-9a50-fb632d744d51 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930211b0112b490bbe9f6a262ccaf819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ca0be197104eaaa8b190117f1c2b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:42.202621 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-04efdec6-353b-432d-9a50-fb632d744d51 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb" status: 200 len: 1316 microversion: 2.1 time: 0.764388 Aug 04 17:01:42.204241 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 926/1782] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:41 2022] GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb => generated 1316 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:42.219199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-11b615a2-a123-436d-9e2f-36bdec267869 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:42.220184 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-11b615a2-a123-436d-9e2f-36bdec267869 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 14847930-27f6-4ea1-83f0-48a80608885e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:42.246363 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-11b615a2-a123-436d-9e2f-36bdec267869 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:42.246932 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-11b615a2-a123-436d-9e2f-36bdec267869 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:42.247400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-11b615a2-a123-436d-9e2f-36bdec267869 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:42.248137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-11b615a2-a123-436d-9e2f-36bdec267869 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:42.248609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-11b615a2-a123-436d-9e2f-36bdec267869 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:42.249049 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-11b615a2-a123-436d-9e2f-36bdec267869 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:42.522970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-11b615a2-a123-436d-9e2f-36bdec267869 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:42.532381 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-11b615a2-a123-436d-9e2f-36bdec267869 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e" status: 200 len: 1501 microversion: 2.1 time: 0.326732 Aug 04 17:01:42.536495 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 927/1783] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:42 2022] GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e => generated 1501 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:42.543525 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-c1b578ca-6225-43b1-886a-b04d3dc63e8a req-2d6faa67-422e-4e31-888a-6cc1668add74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aa159af-25ad-4e88-adfd-88736802c68b", "name": "network-vif-plugged", "status": "completed", "tag": "0cadd627-9251-4fb3-895b-7cb5c6b41b23"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:42.570881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c1b578ca-6225-43b1-886a-b04d3dc63e8a req-2d6faa67-422e-4e31-888a-6cc1668add74 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:42.571856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c1b578ca-6225-43b1-886a-b04d3dc63e8a req-2d6faa67-422e-4e31-888a-6cc1668add74 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:42.572621 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c1b578ca-6225-43b1-886a-b04d3dc63e8a req-2d6faa67-422e-4e31-888a-6cc1668add74 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:42.670656 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-c1b578ca-6225-43b1-886a-b04d3dc63e8a req-2d6faa67-422e-4e31-888a-6cc1668add74 service nova] Creating event network-vif-plugged:0cadd627-9251-4fb3-895b-7cb5c6b41b23 for instance 0aa159af-25ad-4e88-adfd-88736802c68b on n-h1-851359-3 Aug 04 17:01:42.698314 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-c1b578ca-6225-43b1-886a-b04d3dc63e8a req-2d6faa67-422e-4e31-888a-6cc1668add74 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160092 Aug 04 17:01:42.698940 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 928/1784] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:42.712105 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7181221d-2722-409d-937a-a92cbca43a43 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:42.720796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7181221d-2722-409d-937a-a92cbca43a43 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:42.735284 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7181221d-2722-409d-937a-a92cbca43a43 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:42.739018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7181221d-2722-409d-937a-a92cbca43a43 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:42.747611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7181221d-2722-409d-937a-a92cbca43a43 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:42.748905 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7181221d-2722-409d-937a-a92cbca43a43 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:42.752557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7181221d-2722-409d-937a-a92cbca43a43 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:42.754184 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7181221d-2722-409d-937a-a92cbca43a43 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:43.063341 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7181221d-2722-409d-937a-a92cbca43a43 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:43.073296 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7181221d-2722-409d-937a-a92cbca43a43 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1199 microversion: 2.1 time: 0.365549 Aug 04 17:01:43.074914 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 929/1785] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:42 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1199 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:43.090062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-03d5e97b-7fb7-4e09-b71d-689cca41faa5 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:43.092299 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-03d5e97b-7fb7-4e09-b71d-689cca41faa5 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 14847930-27f6-4ea1-83f0-48a80608885e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:43.109766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03d5e97b-7fb7-4e09-b71d-689cca41faa5 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:43.112660 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03d5e97b-7fb7-4e09-b71d-689cca41faa5 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:43.113492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03d5e97b-7fb7-4e09-b71d-689cca41faa5 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:43.115027 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03d5e97b-7fb7-4e09-b71d-689cca41faa5 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:43.116101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03d5e97b-7fb7-4e09-b71d-689cca41faa5 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:43.116820 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03d5e97b-7fb7-4e09-b71d-689cca41faa5 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:43.205122 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-03d5e97b-7fb7-4e09-b71d-689cca41faa5 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "POST /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e/action" status: 202 len: 0 microversion: 2.1 time: 0.126024 Aug 04 17:01:43.206552 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 930/1786] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:01:43 2022] POST /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:01:43.216151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b764c749-b42e-444f-92c9-027324cd0575 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:43.219480 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b764c749-b42e-444f-92c9-027324cd0575 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 14847930-27f6-4ea1-83f0-48a80608885e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:43.232576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b764c749-b42e-444f-92c9-027324cd0575 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:43.233503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b764c749-b42e-444f-92c9-027324cd0575 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:43.234362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b764c749-b42e-444f-92c9-027324cd0575 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:43.235475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b764c749-b42e-444f-92c9-027324cd0575 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:43.236324 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b764c749-b42e-444f-92c9-027324cd0575 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:43.237294 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b764c749-b42e-444f-92c9-027324cd0575 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:43.887503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b764c749-b42e-444f-92c9-027324cd0575 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:43.909588 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b764c749-b42e-444f-92c9-027324cd0575 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e" status: 200 len: 1506 microversion: 2.1 time: 0.696321 Aug 04 17:01:43.914102 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 931/1787] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:43 2022] GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e => generated 1506 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:43.940511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cd3dc729-84ec-4fc5-84b3-9d46e6487304 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:43.948253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cd3dc729-84ec-4fc5-84b3-9d46e6487304 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] [instance: c2695555-41cc-4eff-ae6c-9b8d443103bb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:43.966763 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd3dc729-84ec-4fc5-84b3-9d46e6487304 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:43.972892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd3dc729-84ec-4fc5-84b3-9d46e6487304 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:43.973678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd3dc729-84ec-4fc5-84b3-9d46e6487304 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:43.974800 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd3dc729-84ec-4fc5-84b3-9d46e6487304 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:43.977533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd3dc729-84ec-4fc5-84b3-9d46e6487304 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:43.978231 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd3dc729-84ec-4fc5-84b3-9d46e6487304 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:44.622208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cd3dc729-84ec-4fc5-84b3-9d46e6487304 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930211b0112b490bbe9f6a262ccaf819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ca0be197104eaaa8b190117f1c2b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:44.637249 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cd3dc729-84ec-4fc5-84b3-9d46e6487304 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb" status: 200 len: 1316 microversion: 2.1 time: 0.720308 Aug 04 17:01:44.637863 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 932/1788] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:43 2022] GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb => generated 1316 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:44.653898 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-33a1e499-4cbd-4812-91c1-cc2351c50374 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:44.654574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-33a1e499-4cbd-4812-91c1-cc2351c50374 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:44.667657 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33a1e499-4cbd-4812-91c1-cc2351c50374 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:44.668171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33a1e499-4cbd-4812-91c1-cc2351c50374 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:44.668617 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33a1e499-4cbd-4812-91c1-cc2351c50374 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:44.672822 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33a1e499-4cbd-4812-91c1-cc2351c50374 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:44.673390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33a1e499-4cbd-4812-91c1-cc2351c50374 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:44.673778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33a1e499-4cbd-4812-91c1-cc2351c50374 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:44.982302 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-33a1e499-4cbd-4812-91c1-cc2351c50374 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:45.005226 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-33a1e499-4cbd-4812-91c1-cc2351c50374 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1199 microversion: 2.1 time: 0.365062 Aug 04 17:01:45.005825 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 933/1789] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:44 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1199 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:45.013192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-71e39368-acc2-4108-a7a6-91612cf5241f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:45.014128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-71e39368-acc2-4108-a7a6-91612cf5241f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 14847930-27f6-4ea1-83f0-48a80608885e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:45.030757 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71e39368-acc2-4108-a7a6-91612cf5241f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:45.038201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71e39368-acc2-4108-a7a6-91612cf5241f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:45.038727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71e39368-acc2-4108-a7a6-91612cf5241f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:45.039838 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71e39368-acc2-4108-a7a6-91612cf5241f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:45.040419 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71e39368-acc2-4108-a7a6-91612cf5241f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:45.048732 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71e39368-acc2-4108-a7a6-91612cf5241f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:45.241872 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-71e39368-acc2-4108-a7a6-91612cf5241f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:45.251998 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-71e39368-acc2-4108-a7a6-91612cf5241f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e" status: 200 len: 1486 microversion: 2.1 time: 0.242433 Aug 04 17:01:45.262664 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 934/1790] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:45 2022] GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e => generated 1486 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:45.281652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2736a258-8d6f-4994-97db-22d2f3d87911 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:45.282186 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2736a258-8d6f-4994-97db-22d2f3d87911 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 14847930-27f6-4ea1-83f0-48a80608885e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:45.292214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2736a258-8d6f-4994-97db-22d2f3d87911 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:45.292779 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2736a258-8d6f-4994-97db-22d2f3d87911 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:45.293211 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2736a258-8d6f-4994-97db-22d2f3d87911 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:45.295037 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2736a258-8d6f-4994-97db-22d2f3d87911 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:45.295523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2736a258-8d6f-4994-97db-22d2f3d87911 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:45.296182 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2736a258-8d6f-4994-97db-22d2f3d87911 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:45.385433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2736a258-8d6f-4994-97db-22d2f3d87911 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 14847930-27f6-4ea1-83f0-48a80608885e] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:01:45.430985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:45.607790 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2736a258-8d6f-4994-97db-22d2f3d87911 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "DELETE /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e" status: 204 len: 0 microversion: 2.1 time: 0.329675 Aug 04 17:01:45.610711 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 935/1791] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:01:45 2022] DELETE /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:01:45.631462 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5b6e7799-7fd8-4ef9-8edf-fab937ece8da tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:45.634511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5b6e7799-7fd8-4ef9-8edf-fab937ece8da tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 14847930-27f6-4ea1-83f0-48a80608885e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:45.648477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b6e7799-7fd8-4ef9-8edf-fab937ece8da tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:45.653181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b6e7799-7fd8-4ef9-8edf-fab937ece8da tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:45.653181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b6e7799-7fd8-4ef9-8edf-fab937ece8da tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:45.653825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b6e7799-7fd8-4ef9-8edf-fab937ece8da tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:45.655959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b6e7799-7fd8-4ef9-8edf-fab937ece8da tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:45.662974 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b6e7799-7fd8-4ef9-8edf-fab937ece8da tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:45.997391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=42 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:46.169893 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5b6e7799-7fd8-4ef9-8edf-fab937ece8da tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:46.181846 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5b6e7799-7fd8-4ef9-8edf-fab937ece8da tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e" status: 200 len: 1492 microversion: 2.1 time: 0.566435 Aug 04 17:01:46.200075 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 936/1792] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:45 2022] GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e => generated 1492 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:01:46.209530 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f7e657a3-df42-4317-9c73-e687fb9f5873 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:46.211198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f7e657a3-df42-4317-9c73-e687fb9f5873 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] [instance: c2695555-41cc-4eff-ae6c-9b8d443103bb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:46.223509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7e657a3-df42-4317-9c73-e687fb9f5873 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:46.224307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7e657a3-df42-4317-9c73-e687fb9f5873 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:46.226634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7e657a3-df42-4317-9c73-e687fb9f5873 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:46.228731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7e657a3-df42-4317-9c73-e687fb9f5873 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:46.230126 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7e657a3-df42-4317-9c73-e687fb9f5873 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:46.231476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7e657a3-df42-4317-9c73-e687fb9f5873 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:46.408828 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-038f4315-91f5-49bc-b77a-184aacf6dbfa tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee" status: 200 len: 1410 microversion: 2.1 time: 5.987556 Aug 04 17:01:46.411600 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 857/1793] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:01:40 2022] GET /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee => generated 1410 bytes in 5991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:46.422955 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-64f355c0-3f5c-4792-a18a-cddd1ca3d9c9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:46.429188 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-64f355c0-3f5c-4792-a18a-cddd1ca3d9c9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:46.449102 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64f355c0-3f5c-4792-a18a-cddd1ca3d9c9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:46.450195 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64f355c0-3f5c-4792-a18a-cddd1ca3d9c9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:46.451050 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64f355c0-3f5c-4792-a18a-cddd1ca3d9c9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:46.452095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64f355c0-3f5c-4792-a18a-cddd1ca3d9c9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:46.453930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64f355c0-3f5c-4792-a18a-cddd1ca3d9c9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:46.457715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64f355c0-3f5c-4792-a18a-cddd1ca3d9c9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:46.585606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f7e657a3-df42-4317-9c73-e687fb9f5873 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930211b0112b490bbe9f6a262ccaf819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ca0be197104eaaa8b190117f1c2b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:46.599580 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f7e657a3-df42-4317-9c73-e687fb9f5873 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb" status: 200 len: 1316 microversion: 2.1 time: 0.392458 Aug 04 17:01:46.600259 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 937/1794] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:46 2022] GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb => generated 1316 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:46.624242 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-6f098e84-25d5-4af0-86c7-eb9c29184922 req-96551999-a747-4658-95ce-7f5d6408f8f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2695555-41cc-4eff-ae6c-9b8d443103bb", "name": "network-vif-plugged", "status": "completed", "tag": "a400318a-3d22-404a-90ec-54d7d582192d"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:46.659998 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:46.670466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6f098e84-25d5-4af0-86c7-eb9c29184922 req-96551999-a747-4658-95ce-7f5d6408f8f6 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:46.672963 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6f098e84-25d5-4af0-86c7-eb9c29184922 req-96551999-a747-4658-95ce-7f5d6408f8f6 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:46.675035 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6f098e84-25d5-4af0-86c7-eb9c29184922 req-96551999-a747-4658-95ce-7f5d6408f8f6 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:46.717778 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-6f098e84-25d5-4af0-86c7-eb9c29184922 req-96551999-a747-4658-95ce-7f5d6408f8f6 service nova] Creating event network-vif-plugged:a400318a-3d22-404a-90ec-54d7d582192d for instance c2695555-41cc-4eff-ae6c-9b8d443103bb on n-h2-851359-3 Aug 04 17:01:46.730586 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-6f098e84-25d5-4af0-86c7-eb9c29184922 req-96551999-a747-4658-95ce-7f5d6408f8f6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111629 Aug 04 17:01:46.734706 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 938/1795] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:46.833915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-64f355c0-3f5c-4792-a18a-cddd1ca3d9c9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:46.861123 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-64f355c0-3f5c-4792-a18a-cddd1ca3d9c9 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1199 microversion: 2.1 time: 0.444318 Aug 04 17:01:46.863510 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 858/1796] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:46 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1199 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:47.038483 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7040630c-b639-47fb-9831-7721cdf87ac4 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-517914799", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:47.139384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-7040630c-b639-47fb-9831-7721cdf87ac4 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] validate_networks() for None {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:01:47.207300 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fe365c0d-7c9c-42fd-81a5-f166e8236c61 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:47.207752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fe365c0d-7c9c-42fd-81a5-f166e8236c61 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 14847930-27f6-4ea1-83f0-48a80608885e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:47.215760 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe365c0d-7c9c-42fd-81a5-f166e8236c61 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:47.220986 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe365c0d-7c9c-42fd-81a5-f166e8236c61 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:47.221890 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe365c0d-7c9c-42fd-81a5-f166e8236c61 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:47.223271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe365c0d-7c9c-42fd-81a5-f166e8236c61 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:47.223767 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe365c0d-7c9c-42fd-81a5-f166e8236c61 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:47.224220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe365c0d-7c9c-42fd-81a5-f166e8236c61 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:47.762518 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-7040630c-b639-47fb-9831-7721cdf87ac4 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:01:47.763600 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-7040630c-b639-47fb-9831-7721cdf87ac4 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:01:47.764262 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-7040630c-b639-47fb-9831-7721cdf87ac4 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:01:47.764846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-7040630c-b639-47fb-9831-7721cdf87ac4 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:01:47.765461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-7040630c-b639-47fb-9831-7721cdf87ac4 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:01:47.779772 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7040630c-b639-47fb-9831-7721cdf87ac4 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:47.783123 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7040630c-b639-47fb-9831-7721cdf87ac4 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:47.783797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7040630c-b639-47fb-9831-7721cdf87ac4 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:47.784784 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7040630c-b639-47fb-9831-7721cdf87ac4 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:47.786470 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7040630c-b639-47fb-9831-7721cdf87ac4 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:47.787526 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fe365c0d-7c9c-42fd-81a5-f166e8236c61 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:47.788321 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7040630c-b639-47fb-9831-7721cdf87ac4 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:47.807944 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fe365c0d-7c9c-42fd-81a5-f166e8236c61 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e" status: 200 len: 1492 microversion: 2.1 time: 0.601552 Aug 04 17:01:47.809481 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 859/1797] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:47 2022] GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e => generated 1492 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:01:47.830609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-14c885cb-47fc-4d0a-a423-f2730e3f0675 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5bdf54c0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:47.834941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-7040630c-b639-47fb-9831-7721cdf87ac4 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Getting quotas for project 85d40b6141974bbea220bf71f61a3ab2. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:01:47.845079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-7040630c-b639-47fb-9831-7721cdf87ac4 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Getting quotas for user bfdd0a24d62e4db4bec3ab39f7cf28a4 and project 85d40b6141974bbea220bf71f61a3ab2. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:01:47.883542 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7040630c-b639-47fb-9831-7721cdf87ac4 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:01:47.883542 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7040630c-b639-47fb-9831-7721cdf87ac4 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] [instance: 067d9f8b-3067-447e-8017-2e6f5a6c721c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:01:47.977406 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7040630c-b639-47fb-9831-7721cdf87ac4 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.240510 Aug 04 17:01:47.984185 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-14c885cb-47fc-4d0a-a423-f2730e3f0675 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee" status: 200 len: 1410 microversion: 2.1 time: 0.173489 Aug 04 17:01:47.985006 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 939/1798] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:01:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1250 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:01:47.995294 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 860/1799] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:01:47 2022] GET /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee => generated 1410 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:48.016298 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7d3ebc45-6d28-4a23-a503-c3179fd7bd5c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:48.016917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7d3ebc45-6d28-4a23-a503-c3179fd7bd5c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] [instance: c2695555-41cc-4eff-ae6c-9b8d443103bb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:48.023533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b8afe2fd-bd33-4373-934a-6695bde47ec3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:48.030833 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b8afe2fd-bd33-4373-934a-6695bde47ec3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:48.034313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:48.036544 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d3ebc45-6d28-4a23-a503-c3179fd7bd5c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:48.037049 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d3ebc45-6d28-4a23-a503-c3179fd7bd5c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:48.037497 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d3ebc45-6d28-4a23-a503-c3179fd7bd5c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:48.038236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d3ebc45-6d28-4a23-a503-c3179fd7bd5c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:48.044322 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d3ebc45-6d28-4a23-a503-c3179fd7bd5c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:48.045002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d3ebc45-6d28-4a23-a503-c3179fd7bd5c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:48.057621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8afe2fd-bd33-4373-934a-6695bde47ec3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:48.058190 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8afe2fd-bd33-4373-934a-6695bde47ec3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:48.058641 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8afe2fd-bd33-4373-934a-6695bde47ec3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:48.066389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8afe2fd-bd33-4373-934a-6695bde47ec3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:48.067225 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8afe2fd-bd33-4373-934a-6695bde47ec3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:48.072630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8afe2fd-bd33-4373-934a-6695bde47ec3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:48.876701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7d3ebc45-6d28-4a23-a503-c3179fd7bd5c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930211b0112b490bbe9f6a262ccaf819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ca0be197104eaaa8b190117f1c2b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:48.896052 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7d3ebc45-6d28-4a23-a503-c3179fd7bd5c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb" status: 200 len: 1316 microversion: 2.1 time: 0.909657 Aug 04 17:01:48.897488 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 940/1800] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:47 2022] GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb => generated 1316 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:48.906563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e6191a1f-8d6c-442c-af3f-9a84280bfeb8 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:48.907567 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e6191a1f-8d6c-442c-af3f-9a84280bfeb8 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] [instance: 067d9f8b-3067-447e-8017-2e6f5a6c721c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:48.964170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b8afe2fd-bd33-4373-934a-6695bde47ec3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:48.973539 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b8afe2fd-bd33-4373-934a-6695bde47ec3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1199 microversion: 2.1 time: 0.976399 Aug 04 17:01:48.976883 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 861/1801] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:47 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1199 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:48.986612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-51353adb-7115-4019-ac42-5dde93cf3a75 req-11ccefa9-7d12-4507-9b2c-4856d6ceecfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14847930-27f6-4ea1-83f0-48a80608885e", "name": "network-vif-deleted", "tag": "0f46cabf-3821-4a07-bdf2-8a93e0b4ea41"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:49.018125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-51353adb-7115-4019-ac42-5dde93cf3a75 req-11ccefa9-7d12-4507-9b2c-4856d6ceecfa service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:49.021037 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-51353adb-7115-4019-ac42-5dde93cf3a75 req-11ccefa9-7d12-4507-9b2c-4856d6ceecfa service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:49.021722 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-51353adb-7115-4019-ac42-5dde93cf3a75 req-11ccefa9-7d12-4507-9b2c-4856d6ceecfa service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:49.051050 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-51353adb-7115-4019-ac42-5dde93cf3a75 req-11ccefa9-7d12-4507-9b2c-4856d6ceecfa service nova] Creating event network-vif-deleted:0f46cabf-3821-4a07-bdf2-8a93e0b4ea41 for instance 14847930-27f6-4ea1-83f0-48a80608885e on n-h1-851359-3 Aug 04 17:01:49.071785 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-51353adb-7115-4019-ac42-5dde93cf3a75 req-11ccefa9-7d12-4507-9b2c-4856d6ceecfa service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093380 Aug 04 17:01:49.076081 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 862/1802] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:49.084775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d8bf2fbe-9ea9-46cb-9b95-5302db6541c5 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:49.091934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d8bf2fbe-9ea9-46cb-9b95-5302db6541c5 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 14847930-27f6-4ea1-83f0-48a80608885e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:49.109558 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8bf2fbe-9ea9-46cb-9b95-5302db6541c5 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:49.110591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8bf2fbe-9ea9-46cb-9b95-5302db6541c5 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:49.111325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8bf2fbe-9ea9-46cb-9b95-5302db6541c5 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:49.112390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8bf2fbe-9ea9-46cb-9b95-5302db6541c5 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:49.113710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8bf2fbe-9ea9-46cb-9b95-5302db6541c5 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:49.120034 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8bf2fbe-9ea9-46cb-9b95-5302db6541c5 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:49.179092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e6191a1f-8d6c-442c-af3f-9a84280bfeb8 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdd0a24d62e4db4bec3ab39f7cf28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d40b6141974bbea220bf71f61a3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:49.190389 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e6191a1f-8d6c-442c-af3f-9a84280bfeb8 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] 10.222.0.93 "GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c" status: 200 len: 1222 microversion: 2.1 time: 0.290123 Aug 04 17:01:49.190605 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 941/1803] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:48 2022] GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c => generated 1222 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:49.202293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8bf2fbe-9ea9-46cb-9b95-5302db6541c5 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:49.202293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8bf2fbe-9ea9-46cb-9b95-5302db6541c5 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:49.202293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8bf2fbe-9ea9-46cb-9b95-5302db6541c5 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:49.202293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-d8bf2fbe-9ea9-46cb-9b95-5302db6541c5 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lazy-loading 'fault' on Instance uuid 14847930-27f6-4ea1-83f0-48a80608885e {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:01:49.217471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3e99ab36-760f-4d6f-b921-5cc6a50eb7f9 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5b017f70>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:49.304329 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3e99ab36-760f-4d6f-b921-5cc6a50eb7f9 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee" status: 200 len: 1410 microversion: 2.1 time: 0.099633 Aug 04 17:01:49.311394 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 942/1804] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:01:49 2022] GET /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee => generated 1410 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:49.371580 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d8bf2fbe-9ea9-46cb-9b95-5302db6541c5 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:49.389183 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d8bf2fbe-9ea9-46cb-9b95-5302db6541c5 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e" status: 200 len: 1305 microversion: 2.1 time: 0.307146 Aug 04 17:01:49.391929 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 863/1805] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:49 2022] GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e => generated 1305 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:49.918204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3dc4f7ca-8d45-4ecd-9409-31c6d18cd32a tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:49.919691 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3dc4f7ca-8d45-4ecd-9409-31c6d18cd32a tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] [instance: c2695555-41cc-4eff-ae6c-9b8d443103bb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:49.933173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3dc4f7ca-8d45-4ecd-9409-31c6d18cd32a tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:49.936960 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3dc4f7ca-8d45-4ecd-9409-31c6d18cd32a tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:49.938906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3dc4f7ca-8d45-4ecd-9409-31c6d18cd32a tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:49.942344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3dc4f7ca-8d45-4ecd-9409-31c6d18cd32a tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:49.946675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3dc4f7ca-8d45-4ecd-9409-31c6d18cd32a tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:49.948249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3dc4f7ca-8d45-4ecd-9409-31c6d18cd32a tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:49.996605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-30824f45-98ee-478e-a58d-21e14fb1f562 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:49.998031 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-30824f45-98ee-478e-a58d-21e14fb1f562 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:50.010585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-30824f45-98ee-478e-a58d-21e14fb1f562 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:50.018977 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-30824f45-98ee-478e-a58d-21e14fb1f562 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:50.021921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-30824f45-98ee-478e-a58d-21e14fb1f562 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:50.024888 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-30824f45-98ee-478e-a58d-21e14fb1f562 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:50.027190 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-30824f45-98ee-478e-a58d-21e14fb1f562 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:50.028171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-30824f45-98ee-478e-a58d-21e14fb1f562 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:50.601548 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-30824f45-98ee-478e-a58d-21e14fb1f562 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:50.612441 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-30824f45-98ee-478e-a58d-21e14fb1f562 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1199 microversion: 2.1 time: 0.619604 Aug 04 17:01:50.636269 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 864/1806] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:49 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1199 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:01:50.647287 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2cefee24-35f2-4f47-b3c2-0e5e047ad06b tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:50.658312 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2cefee24-35f2-4f47-b3c2-0e5e047ad06b tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] [instance: 067d9f8b-3067-447e-8017-2e6f5a6c721c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:50.663751 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3dc4f7ca-8d45-4ecd-9409-31c6d18cd32a tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930211b0112b490bbe9f6a262ccaf819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ca0be197104eaaa8b190117f1c2b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:50.680674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2cefee24-35f2-4f47-b3c2-0e5e047ad06b tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:50.681173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2cefee24-35f2-4f47-b3c2-0e5e047ad06b tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:50.682654 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3dc4f7ca-8d45-4ecd-9409-31c6d18cd32a tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb" status: 200 len: 1466 microversion: 2.1 time: 0.766052 Aug 04 17:01:50.683915 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 943/1807] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:49 2022] GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb => generated 1466 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:50.686063 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2cefee24-35f2-4f47-b3c2-0e5e047ad06b tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:50.686818 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2cefee24-35f2-4f47-b3c2-0e5e047ad06b tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:50.690283 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2cefee24-35f2-4f47-b3c2-0e5e047ad06b tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:50.691679 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2cefee24-35f2-4f47-b3c2-0e5e047ad06b tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:50.703266 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5182151f-d403-4b41-8d1b-2d1ab381b388 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5b017ee0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:50.836300 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5182151f-d403-4b41-8d1b-2d1ab381b388 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee" status: 200 len: 1410 microversion: 2.1 time: 0.149140 Aug 04 17:01:50.845319 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 944/1808] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:01:50 2022] GET /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee => generated 1410 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:50.855905 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e58e9066-9be8-4c96-abe4-b77de618a772 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:50.856730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e58e9066-9be8-4c96-abe4-b77de618a772 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 14847930-27f6-4ea1-83f0-48a80608885e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:50.870419 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2cefee24-35f2-4f47-b3c2-0e5e047ad06b tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdd0a24d62e4db4bec3ab39f7cf28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d40b6141974bbea220bf71f61a3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:50.873193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e58e9066-9be8-4c96-abe4-b77de618a772 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:50.874229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e58e9066-9be8-4c96-abe4-b77de618a772 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:50.874826 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e58e9066-9be8-4c96-abe4-b77de618a772 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:50.875640 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e58e9066-9be8-4c96-abe4-b77de618a772 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:50.876365 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e58e9066-9be8-4c96-abe4-b77de618a772 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:50.877031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e58e9066-9be8-4c96-abe4-b77de618a772 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:50.881991 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2cefee24-35f2-4f47-b3c2-0e5e047ad06b tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] 10.222.0.93 "GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c" status: 200 len: 1280 microversion: 2.1 time: 0.240925 Aug 04 17:01:50.883282 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 865/1809] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:50 2022] GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c => generated 1280 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:50.888288 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3f9fc6d5-3a0e-4512-a93a-7a7f195341ec tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-690392776", "metadata": {"image_type": "test"}}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:50.890789 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3f9fc6d5-3a0e-4512-a93a-7a7f195341ec tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] [instance: c2695555-41cc-4eff-ae6c-9b8d443103bb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:50.916768 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f9fc6d5-3a0e-4512-a93a-7a7f195341ec tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:50.917544 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f9fc6d5-3a0e-4512-a93a-7a7f195341ec tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:50.918213 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f9fc6d5-3a0e-4512-a93a-7a7f195341ec tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:50.919205 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f9fc6d5-3a0e-4512-a93a-7a7f195341ec tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:50.919913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f9fc6d5-3a0e-4512-a93a-7a7f195341ec tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:50.922604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f9fc6d5-3a0e-4512-a93a-7a7f195341ec tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:50.924699 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-e58e9066-9be8-4c96-abe4-b77de618a772 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] HTTP exception thrown: Instance 14847930-27f6-4ea1-83f0-48a80608885e could not be found. Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e58e9066-9be8-4c96-abe4-b77de618a772 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Request method failure captured: Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e HTTP/1.1 Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_r18zhXKrUNPkTcrqBpyOxEtqmRnN_52CLFZjb6_V1_cyggOBj-ig1uBg8_Jl5DEv1edGlVMK7wsNG9aSNASIbB3U35pyAy7fX4gAPexD_7GsQqaSV2-qce83lQvxIJx4U5ZPEYYCvd7_VfIsOpvvr8aQqah0W-5V3XON-ztAeWk4Y Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/92bb708c7ba24e4d828f19ecc60e1f91"}]}] Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 6d19d8e7953b4e479b4e2143a3c3546a Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 14847930-27f6-4ea1-83f0-48a80608885e could not be found. Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '14847930-27f6-4ea1-83f0-48a80608885e'} Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14847930-27f6-4ea1-83f0-48a80608885e could not be found. Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14847930-27f6-4ea1-83f0-48a80608885e could not be found. Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:01:50.927981 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:50.936184 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:01:50.936184 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:01:50.936184 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:01:50.936184 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:01:50.936184 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:01:50.936184 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14847930-27f6-4ea1-83f0-48a80608885e could not be found. Aug 04 17:01:50.936184 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:01:50.939431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e58e9066-9be8-4c96-abe4-b77de618a772 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Returning 404 to user: Instance 14847930-27f6-4ea1-83f0-48a80608885e could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:01:50.941905 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e58e9066-9be8-4c96-abe4-b77de618a772 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e" status: 404 len: 111 microversion: 2.1 time: 0.101944 Aug 04 17:01:50.946479 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 945/1810] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:50 2022] GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:01:51.004851 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-3f9fc6d5-3a0e-4512-a93a-7a7f195341ec tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Getting quotas for project d7ca0be197104eaaa8b190117f1c2b53. Resources: dict_keys(['metadata_items']) {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:01:51.014411 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-3f9fc6d5-3a0e-4512-a93a-7a7f195341ec tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Getting quotas for user 930211b0112b490bbe9f6a262ccaf819 and project d7ca0be197104eaaa8b190117f1c2b53. Resources: dict_keys(['metadata_items']) {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:01:51.212879 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6d02f4b0-973b-4975-aaa4-083806527a0d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-760237638", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "bed30c3f-0c01-4418-9c95-0bb7a79e1c34"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:51.387239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-6d02f4b0-973b-4975-aaa4-083806527a0d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] validate_networks() for [('bed30c3f-0c01-4418-9c95-0bb7a79e1c34', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:01:51.463805 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3f9fc6d5-3a0e-4512-a93a-7a7f195341ec tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "POST /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb/action" status: 202 len: 0 microversion: 2.1 time: 0.578979 Aug 04 17:01:51.466688 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 866/1811] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:01:50 2022] POST /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb/action => generated 0 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 17:01:51.491926 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c1a8e33a-6a26-4588-a6d0-57c305b633f4 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e6a348940>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:51.584746 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c1a8e33a-6a26-4588-a6d0-57c305b633f4 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c" status: 200 len: 1423 microversion: 2.1 time: 0.110780 Aug 04 17:01:51.592200 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 867/1812] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:01:51 2022] GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c => generated 1423 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:51.646417 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-888c166e-b08d-4a05-9027-92ec4cafef56 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:51.647794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-888c166e-b08d-4a05-9027-92ec4cafef56 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:51.680206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-888c166e-b08d-4a05-9027-92ec4cafef56 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:51.681867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-888c166e-b08d-4a05-9027-92ec4cafef56 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:51.686923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-888c166e-b08d-4a05-9027-92ec4cafef56 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:51.687902 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-888c166e-b08d-4a05-9027-92ec4cafef56 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:51.688642 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-888c166e-b08d-4a05-9027-92ec4cafef56 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:51.692066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-888c166e-b08d-4a05-9027-92ec4cafef56 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:52.957282 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-888c166e-b08d-4a05-9027-92ec4cafef56 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:52.972762 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-888c166e-b08d-4a05-9027-92ec4cafef56 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1199 microversion: 2.1 time: 1.334975 Aug 04 17:01:52.987045 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 868/1813] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:51 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1199 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:52.996418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8f4baca4-3b13-46fa-92fb-5fef937967bc tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5bc395e0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:53.072676 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8f4baca4-3b13-46fa-92fb-5fef937967bc tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee" status: 200 len: 1410 microversion: 2.1 time: 0.083510 Aug 04 17:01:53.073267 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 869/1814] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:01:52 2022] GET /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee => generated 1410 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:53.095401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6c5d69f1-be82-443c-8902-9e9c01dd3080 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:53.096039 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6c5d69f1-be82-443c-8902-9e9c01dd3080 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] [instance: 067d9f8b-3067-447e-8017-2e6f5a6c721c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:53.114360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c5d69f1-be82-443c-8902-9e9c01dd3080 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:53.115114 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c5d69f1-be82-443c-8902-9e9c01dd3080 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:53.115750 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c5d69f1-be82-443c-8902-9e9c01dd3080 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:53.116662 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c5d69f1-be82-443c-8902-9e9c01dd3080 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:53.118180 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c5d69f1-be82-443c-8902-9e9c01dd3080 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:53.118993 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c5d69f1-be82-443c-8902-9e9c01dd3080 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:53.281086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-6d02f4b0-973b-4975-aaa4-083806527a0d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:01:53.281655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-6d02f4b0-973b-4975-aaa4-083806527a0d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:01:53.282241 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-6d02f4b0-973b-4975-aaa4-083806527a0d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:01:53.282729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-6d02f4b0-973b-4975-aaa4-083806527a0d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:01:53.283223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-6d02f4b0-973b-4975-aaa4-083806527a0d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:01:53.299135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d02f4b0-973b-4975-aaa4-083806527a0d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:53.299611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d02f4b0-973b-4975-aaa4-083806527a0d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:53.300482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d02f4b0-973b-4975-aaa4-083806527a0d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:53.302251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d02f4b0-973b-4975-aaa4-083806527a0d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:53.302913 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d02f4b0-973b-4975-aaa4-083806527a0d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:53.303571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d02f4b0-973b-4975-aaa4-083806527a0d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:53.332946 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6c5d69f1-be82-443c-8902-9e9c01dd3080 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdd0a24d62e4db4bec3ab39f7cf28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d40b6141974bbea220bf71f61a3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:53.341952 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-6d02f4b0-973b-4975-aaa4-083806527a0d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Getting quotas for project 92bb708c7ba24e4d828f19ecc60e1f91. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:01:53.348845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-6d02f4b0-973b-4975-aaa4-083806527a0d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Getting quotas for user 6d19d8e7953b4e479b4e2143a3c3546a and project 92bb708c7ba24e4d828f19ecc60e1f91. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:01:53.349631 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6c5d69f1-be82-443c-8902-9e9c01dd3080 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] 10.222.0.93 "GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c" status: 200 len: 1280 microversion: 2.1 time: 0.268431 Aug 04 17:01:53.350249 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 870/1815] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:53 2022] GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c => generated 1280 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:53.356634 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b26469a5-8dc9-4a4a-9431-ac5de506471f req-f43b2823-f3eb-4ade-bfc3-7b90a94fdc77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3", "name": "network-vif-plugged", "status": "completed", "tag": "67e31e5f-833c-4ef7-a84f-df2439c611ff"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:53.373187 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b26469a5-8dc9-4a4a-9431-ac5de506471f req-f43b2823-f3eb-4ade-bfc3-7b90a94fdc77 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:53.373963 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b26469a5-8dc9-4a4a-9431-ac5de506471f req-f43b2823-f3eb-4ade-bfc3-7b90a94fdc77 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:53.374672 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b26469a5-8dc9-4a4a-9431-ac5de506471f req-f43b2823-f3eb-4ade-bfc3-7b90a94fdc77 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:53.381026 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6d02f4b0-973b-4975-aaa4-083806527a0d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:01:53.383666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6d02f4b0-973b-4975-aaa4-083806527a0d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:01:53.389229 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b26469a5-8dc9-4a4a-9431-ac5de506471f req-f43b2823-f3eb-4ade-bfc3-7b90a94fdc77 service nova] Creating event network-vif-plugged:67e31e5f-833c-4ef7-a84f-df2439c611ff for instance 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 on n-h2-851359-3 Aug 04 17:01:53.396130 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b26469a5-8dc9-4a4a-9431-ac5de506471f req-f43b2823-f3eb-4ade-bfc3-7b90a94fdc77 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042978 Aug 04 17:01:53.397009 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 871/1816] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:53.403486 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0cdee7fa-0b37-4853-a9f8-034a7377584e tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5baad550>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:53.459273 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6d02f4b0-973b-4975-aaa4-083806527a0d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.250959 Aug 04 17:01:53.460185 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 946/1817] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:01:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2253 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 17:01:53.479930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fbc1c72b-838b-4f9a-9698-2340a00c18d0 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:53.481886 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0cdee7fa-0b37-4853-a9f8-034a7377584e tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c" status: 200 len: 1423 microversion: 2.1 time: 0.083291 Aug 04 17:01:53.489448 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fbc1c72b-838b-4f9a-9698-2340a00c18d0 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:53.489692 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 872/1818] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:01:53 2022] GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c => generated 1423 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:53.593614 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fbc1c72b-838b-4f9a-9698-2340a00c18d0 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:53.619309 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fbc1c72b-838b-4f9a-9698-2340a00c18d0 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1214 microversion: 2.1 time: 0.148976 Aug 04 17:01:53.620086 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 947/1819] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:53 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1214 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:53.998803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dcb5490e-0eb9-4bd5-a80a-b4c3d9954bf3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:54.005947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dcb5490e-0eb9-4bd5-a80a-b4c3d9954bf3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:54.023462 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcb5490e-0eb9-4bd5-a80a-b4c3d9954bf3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:54.024147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcb5490e-0eb9-4bd5-a80a-b4c3d9954bf3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:54.024924 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcb5490e-0eb9-4bd5-a80a-b4c3d9954bf3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:54.027363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcb5490e-0eb9-4bd5-a80a-b4c3d9954bf3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:54.028400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcb5490e-0eb9-4bd5-a80a-b4c3d9954bf3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:54.029429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcb5490e-0eb9-4bd5-a80a-b4c3d9954bf3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:54.090424 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-283aa005-4a59-4711-8e64-d6509314ac0b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5afc8b80>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:54.188515 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-283aa005-4a59-4711-8e64-d6509314ac0b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee" status: 200 len: 1410 microversion: 2.1 time: 0.104616 Aug 04 17:01:54.189853 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 948/1820] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:01:54 2022] GET /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee => generated 1410 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:54.375018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5de10c52-0756-44d5-9241-2912ea7c559a tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:54.375705 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5de10c52-0756-44d5-9241-2912ea7c559a tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] [instance: 067d9f8b-3067-447e-8017-2e6f5a6c721c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:54.393064 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5de10c52-0756-44d5-9241-2912ea7c559a tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:54.393587 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5de10c52-0756-44d5-9241-2912ea7c559a tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:54.395479 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5de10c52-0756-44d5-9241-2912ea7c559a tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:54.395984 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5de10c52-0756-44d5-9241-2912ea7c559a tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:54.396332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5de10c52-0756-44d5-9241-2912ea7c559a tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:54.396776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5de10c52-0756-44d5-9241-2912ea7c559a tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:54.499924 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dcb5490e-0eb9-4bd5-a80a-b4c3d9954bf3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:54.516382 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dcb5490e-0eb9-4bd5-a80a-b4c3d9954bf3 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1199 microversion: 2.1 time: 0.517156 Aug 04 17:01:54.530789 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 873/1821] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:53 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1199 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:54.559711 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6708e74d-a88f-491b-aecb-59116d8093a8 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5b389e50>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:54.650569 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6708e74d-a88f-491b-aecb-59116d8093a8 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c" status: 200 len: 1423 microversion: 2.1 time: 0.118189 Aug 04 17:01:54.651907 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 874/1822] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:01:54 2022] GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c => generated 1423 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:54.658930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9dc835d9-5ea9-4e5f-8da4-c2a5ba67d519 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:54.659887 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9dc835d9-5ea9-4e5f-8da4-c2a5ba67d519 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:54.669947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dc835d9-5ea9-4e5f-8da4-c2a5ba67d519 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:54.672788 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dc835d9-5ea9-4e5f-8da4-c2a5ba67d519 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:54.676264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dc835d9-5ea9-4e5f-8da4-c2a5ba67d519 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:54.681259 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dc835d9-5ea9-4e5f-8da4-c2a5ba67d519 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:54.683277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dc835d9-5ea9-4e5f-8da4-c2a5ba67d519 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:54.684615 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dc835d9-5ea9-4e5f-8da4-c2a5ba67d519 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:54.756831 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:01:54.766487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5de10c52-0756-44d5-9241-2912ea7c559a tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdd0a24d62e4db4bec3ab39f7cf28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d40b6141974bbea220bf71f61a3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:54.776975 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5de10c52-0756-44d5-9241-2912ea7c559a tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] 10.222.0.93 "GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c" status: 200 len: 1322 microversion: 2.1 time: 0.406518 Aug 04 17:01:54.785818 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 949/1823] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:54 2022] GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c => generated 1322 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:54.874594 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9dc835d9-5ea9-4e5f-8da4-c2a5ba67d519 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:54.884035 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9dc835d9-5ea9-4e5f-8da4-c2a5ba67d519 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1218 microversion: 2.1 time: 0.230800 Aug 04 17:01:54.884649 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 875/1824] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:54 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1218 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:55.204460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e71f2aa1-a4c2-4d6d-bd19-07f5526bb642 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5afc8310>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:55.286059 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e71f2aa1-a4c2-4d6d-bd19-07f5526bb642 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee" status: 200 len: 1410 microversion: 2.1 time: 0.084842 Aug 04 17:01:55.287332 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 950/1825] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:01:55 2022] GET /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee => generated 1410 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:01:55.537435 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6b6c7d86-7a80-4398-af38-e8fbc1c0f170 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:55.538227 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6b6c7d86-7a80-4398-af38-e8fbc1c0f170 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:55.556343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b6c7d86-7a80-4398-af38-e8fbc1c0f170 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:55.557638 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b6c7d86-7a80-4398-af38-e8fbc1c0f170 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:55.561660 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b6c7d86-7a80-4398-af38-e8fbc1c0f170 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:55.562926 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b6c7d86-7a80-4398-af38-e8fbc1c0f170 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:55.563936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b6c7d86-7a80-4398-af38-e8fbc1c0f170 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:55.565566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b6c7d86-7a80-4398-af38-e8fbc1c0f170 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:55.665046 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9d695c12-33c0-4538-a996-a84a7e5276ba tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5b030310>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:55.751388 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9d695c12-33c0-4538-a996-a84a7e5276ba tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c" status: 200 len: 1423 microversion: 2.1 time: 0.090147 Aug 04 17:01:55.751961 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 951/1826] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:01:55 2022] GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c => generated 1423 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:01:55.803115 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7f3c6cf9-5cfe-4477-a11b-027217768808 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:55.803617 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7f3c6cf9-5cfe-4477-a11b-027217768808 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] [instance: 067d9f8b-3067-447e-8017-2e6f5a6c721c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:55.832451 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7f3c6cf9-5cfe-4477-a11b-027217768808 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:55.832968 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7f3c6cf9-5cfe-4477-a11b-027217768808 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:55.833422 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7f3c6cf9-5cfe-4477-a11b-027217768808 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:55.834217 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7f3c6cf9-5cfe-4477-a11b-027217768808 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:55.834677 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7f3c6cf9-5cfe-4477-a11b-027217768808 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:55.835118 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7f3c6cf9-5cfe-4477-a11b-027217768808 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:56.392544 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6b6c7d86-7a80-4398-af38-e8fbc1c0f170 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:56.403811 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6b6c7d86-7a80-4398-af38-e8fbc1c0f170 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1199 microversion: 2.1 time: 0.870727 Aug 04 17:01:56.404564 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 876/1827] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:55 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1199 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:56.416745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-55325570-c9e7-485c-87d8-86c3505511a9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:56.425364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-55325570-c9e7-485c-87d8-86c3505511a9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:56.439035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55325570-c9e7-485c-87d8-86c3505511a9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:56.442757 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55325570-c9e7-485c-87d8-86c3505511a9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:56.444075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55325570-c9e7-485c-87d8-86c3505511a9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:56.444906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55325570-c9e7-485c-87d8-86c3505511a9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:56.446479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55325570-c9e7-485c-87d8-86c3505511a9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:56.447684 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55325570-c9e7-485c-87d8-86c3505511a9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:56.628747 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7f3c6cf9-5cfe-4477-a11b-027217768808 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdd0a24d62e4db4bec3ab39f7cf28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d40b6141974bbea220bf71f61a3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:56.643064 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7f3c6cf9-5cfe-4477-a11b-027217768808 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] 10.222.0.93 "GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c" status: 200 len: 1322 microversion: 2.1 time: 0.844685 Aug 04 17:01:56.657339 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 952/1828] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:55 2022] GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c => generated 1322 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:56.658534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-43426fbb-cdc1-4278-98a0-1ebd5126a097 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5b030280>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:56.692583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-55325570-c9e7-485c-87d8-86c3505511a9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:56.700481 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-55325570-c9e7-485c-87d8-86c3505511a9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1272 microversion: 2.1 time: 0.288161 Aug 04 17:01:56.722005 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 877/1829] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:56 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1272 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:56.722005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-a1cafe52-d7c8-4be6-91a0-b32c15856295 req-e8ba2fd2-a075-40bf-9bdb-a00db5e01176 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "067d9f8b-3067-447e-8017-2e6f5a6c721c", "tag": "2345ad42-81c5-40bf-98c8-b558e6b6ca1a"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:56.764856 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-43426fbb-cdc1-4278-98a0-1ebd5126a097 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee" status: 200 len: 1410 microversion: 2.1 time: 0.117907 Aug 04 17:01:56.765826 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 953/1830] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:01:56 2022] GET /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee => generated 1410 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:56.772637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a1cafe52-d7c8-4be6-91a0-b32c15856295 req-e8ba2fd2-a075-40bf-9bdb-a00db5e01176 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:56.773166 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a1cafe52-d7c8-4be6-91a0-b32c15856295 req-e8ba2fd2-a075-40bf-9bdb-a00db5e01176 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:56.773625 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a1cafe52-d7c8-4be6-91a0-b32c15856295 req-e8ba2fd2-a075-40bf-9bdb-a00db5e01176 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:56.808530 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-a1cafe52-d7c8-4be6-91a0-b32c15856295 req-e8ba2fd2-a075-40bf-9bdb-a00db5e01176 service nova] Creating event network-changed:2345ad42-81c5-40bf-98c8-b558e6b6ca1a for instance 067d9f8b-3067-447e-8017-2e6f5a6c721c on n-h1-851359-3 Aug 04 17:01:56.819012 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-a1cafe52-d7c8-4be6-91a0-b32c15856295 req-e8ba2fd2-a075-40bf-9bdb-a00db5e01176 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107860 Aug 04 17:01:56.819887 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 878/1831] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:01:56.833374 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0f66d1c5-c781-4708-8a1e-32d28a6e3600 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5b389430>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:56.890822 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-22d7f931-8c19-47bb-b84d-8d442a6be1e0 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-688326988", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "48658349-8884-418b-b512-79b5b298e0c3"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:01:56.938608 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0f66d1c5-c781-4708-8a1e-32d28a6e3600 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c" status: 200 len: 1423 microversion: 2.1 time: 0.109502 Aug 04 17:01:56.942451 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 879/1832] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:01:56 2022] GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c => generated 1423 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:57.045371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-22d7f931-8c19-47bb-b84d-8d442a6be1e0 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] validate_networks() for [('48658349-8884-418b-b512-79b5b298e0c3', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:01:57.439850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-33ce2de8-d9e0-4bc8-b0a5-d623b62b1f30 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:57.442387 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-33ce2de8-d9e0-4bc8-b0a5-d623b62b1f30 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:57.521278 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33ce2de8-d9e0-4bc8-b0a5-d623b62b1f30 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:57.530686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33ce2de8-d9e0-4bc8-b0a5-d623b62b1f30 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:57.531489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33ce2de8-d9e0-4bc8-b0a5-d623b62b1f30 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:57.535734 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33ce2de8-d9e0-4bc8-b0a5-d623b62b1f30 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:57.536704 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33ce2de8-d9e0-4bc8-b0a5-d623b62b1f30 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:57.537359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33ce2de8-d9e0-4bc8-b0a5-d623b62b1f30 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:58.045860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-33ce2de8-d9e0-4bc8-b0a5-d623b62b1f30 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:58.064283 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-33ce2de8-d9e0-4bc8-b0a5-d623b62b1f30 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1382 microversion: 2.1 time: 0.641627 Aug 04 17:01:58.070872 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 880/1833] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:57 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1382 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:58.076806 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-43012053-7301-430f-a69c-934b326e4513 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:58.078487 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-43012053-7301-430f-a69c-934b326e4513 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] [instance: 067d9f8b-3067-447e-8017-2e6f5a6c721c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:58.099949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43012053-7301-430f-a69c-934b326e4513 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:58.100894 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43012053-7301-430f-a69c-934b326e4513 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:58.101569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43012053-7301-430f-a69c-934b326e4513 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:58.102605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43012053-7301-430f-a69c-934b326e4513 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:58.103276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43012053-7301-430f-a69c-934b326e4513 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:58.111554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43012053-7301-430f-a69c-934b326e4513 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:58.609805 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-43012053-7301-430f-a69c-934b326e4513 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdd0a24d62e4db4bec3ab39f7cf28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d40b6141974bbea220bf71f61a3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:58.623640 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-43012053-7301-430f-a69c-934b326e4513 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] 10.222.0.93 "GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c" status: 200 len: 1322 microversion: 2.1 time: 0.551253 Aug 04 17:01:58.627829 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 881/1834] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:58 2022] GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c => generated 1322 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:58.637445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9d909354-bc50-4909-9346-98d00e276ef8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:58.640612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9d909354-bc50-4909-9346-98d00e276ef8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:58.657640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d909354-bc50-4909-9346-98d00e276ef8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:58.658186 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d909354-bc50-4909-9346-98d00e276ef8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:58.659194 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d909354-bc50-4909-9346-98d00e276ef8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:58.660509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d909354-bc50-4909-9346-98d00e276ef8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:58.663373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d909354-bc50-4909-9346-98d00e276ef8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:58.663846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d909354-bc50-4909-9346-98d00e276ef8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:58.824665 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-22d7f931-8c19-47bb-b84d-8d442a6be1e0 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:01:58.825377 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-22d7f931-8c19-47bb-b84d-8d442a6be1e0 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:01:58.826638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-22d7f931-8c19-47bb-b84d-8d442a6be1e0 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:01:58.827184 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-22d7f931-8c19-47bb-b84d-8d442a6be1e0 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:01:58.827698 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-22d7f931-8c19-47bb-b84d-8d442a6be1e0 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:01:58.848267 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-22d7f931-8c19-47bb-b84d-8d442a6be1e0 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:58.849594 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-22d7f931-8c19-47bb-b84d-8d442a6be1e0 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:58.850173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-22d7f931-8c19-47bb-b84d-8d442a6be1e0 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:58.851042 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-22d7f931-8c19-47bb-b84d-8d442a6be1e0 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:58.851607 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-22d7f931-8c19-47bb-b84d-8d442a6be1e0 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:58.852133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-22d7f931-8c19-47bb-b84d-8d442a6be1e0 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:58.899775 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-22d7f931-8c19-47bb-b84d-8d442a6be1e0 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Getting quotas for project 88e33cbcf48f488683098ef75bd5b25b. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:01:58.906418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-22d7f931-8c19-47bb-b84d-8d442a6be1e0 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Getting quotas for user 52b03ee3b42b48c5b792ec0325d8a90f and project 88e33cbcf48f488683098ef75bd5b25b. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:01:58.923557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-22d7f931-8c19-47bb-b84d-8d442a6be1e0 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:01:58.926781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-22d7f931-8c19-47bb-b84d-8d442a6be1e0 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] [instance: 089f712b-e824-4446-901d-705650fe676a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:01:59.002674 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-22d7f931-8c19-47bb-b84d-8d442a6be1e0 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.225836 Aug 04 17:01:59.003872 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 954/1835] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:01:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:01:59.009577 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a9926124-b9a0-43c4-8981-5eb239e39d4c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5aff9820>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:59.027131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9d909354-bc50-4909-9346-98d00e276ef8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:59.041397 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9d909354-bc50-4909-9346-98d00e276ef8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1314 microversion: 2.1 time: 0.412111 Aug 04 17:01:59.042521 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 882/1836] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:58 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:59.049884 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7ba0e1c0-cd50-4fd5-b806-8532e7e57997 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5b3a80d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:59.133222 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a9926124-b9a0-43c4-8981-5eb239e39d4c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee" status: 200 len: 1410 microversion: 2.1 time: 0.127204 Aug 04 17:01:59.134669 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 955/1837] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:01:59 2022] GET /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee => generated 1410 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:59.145207 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7ba0e1c0-cd50-4fd5-b806-8532e7e57997 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c" status: 200 len: 1423 microversion: 2.1 time: 0.100820 Aug 04 17:01:59.152945 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 883/1838] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:01:59 2022] GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c => generated 1423 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:59.152945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-de2476f6-f8e8-45de-a76b-9d1f2679085a tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:59.152945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-de2476f6-f8e8-45de-a76b-9d1f2679085a tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] [instance: 089f712b-e824-4446-901d-705650fe676a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:59.286882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-de2476f6-f8e8-45de-a76b-9d1f2679085a tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b03ee3b42b48c5b792ec0325d8a90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e33cbcf48f488683098ef75bd5b25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:01:59.298706 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-de2476f6-f8e8-45de-a76b-9d1f2679085a tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] 10.222.0.93 "GET /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a" status: 200 len: 1215 microversion: 2.1 time: 0.147025 Aug 04 17:01:59.299902 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 884/1839] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:59 2022] GET /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a => generated 1215 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:59.310948 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d3039447-c88d-4f1d-90f2-af62401706c1 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:59.312079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d3039447-c88d-4f1d-90f2-af62401706c1 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:59.324796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3039447-c88d-4f1d-90f2-af62401706c1 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:59.325611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3039447-c88d-4f1d-90f2-af62401706c1 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:59.326283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3039447-c88d-4f1d-90f2-af62401706c1 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:59.327425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3039447-c88d-4f1d-90f2-af62401706c1 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:59.329049 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3039447-c88d-4f1d-90f2-af62401706c1 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:59.330345 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3039447-c88d-4f1d-90f2-af62401706c1 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:59.645878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-744938ed-4e06-4aa4-b7ad-c0cc95f4bf52 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:59.645878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-744938ed-4e06-4aa4-b7ad-c0cc95f4bf52 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] [instance: 067d9f8b-3067-447e-8017-2e6f5a6c721c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:59.666590 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-744938ed-4e06-4aa4-b7ad-c0cc95f4bf52 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:59.667471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-744938ed-4e06-4aa4-b7ad-c0cc95f4bf52 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:59.668191 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-744938ed-4e06-4aa4-b7ad-c0cc95f4bf52 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:59.669320 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-744938ed-4e06-4aa4-b7ad-c0cc95f4bf52 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:59.672253 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-744938ed-4e06-4aa4-b7ad-c0cc95f4bf52 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:59.673257 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-744938ed-4e06-4aa4-b7ad-c0cc95f4bf52 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:59.748911 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d3039447-c88d-4f1d-90f2-af62401706c1 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1533 microversion: 2.1 time: 0.612104 Aug 04 17:01:59.755304 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 956/1840] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:59 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1533 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:01:59.781384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d6737b5f-e8b5-4ad2-825c-133c9d2bf565 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:01:59.782062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d6737b5f-e8b5-4ad2-825c-133c9d2bf565 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:01:59.810673 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6737b5f-e8b5-4ad2-825c-133c9d2bf565 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:59.811201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6737b5f-e8b5-4ad2-825c-133c9d2bf565 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:59.811776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6737b5f-e8b5-4ad2-825c-133c9d2bf565 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:01:59.812384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6737b5f-e8b5-4ad2-825c-133c9d2bf565 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:01:59.812855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6737b5f-e8b5-4ad2-825c-133c9d2bf565 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:01:59.829798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6737b5f-e8b5-4ad2-825c-133c9d2bf565 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:00.301341 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d6737b5f-e8b5-4ad2-825c-133c9d2bf565 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1533 microversion: 2.1 time: 0.534410 Aug 04 17:02:00.323765 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 957/1841] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:59 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1533 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:00.331341 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-489bd5c7-5b3c-4dc7-846c-abe409404ea4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:00.332337 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-489bd5c7-5b3c-4dc7-846c-abe409404ea4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:00.339671 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-489bd5c7-5b3c-4dc7-846c-abe409404ea4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:00.339944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-744938ed-4e06-4aa4-b7ad-c0cc95f4bf52 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdd0a24d62e4db4bec3ab39f7cf28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d40b6141974bbea220bf71f61a3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:00.340836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-489bd5c7-5b3c-4dc7-846c-abe409404ea4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:00.341522 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-489bd5c7-5b3c-4dc7-846c-abe409404ea4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:00.342591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-489bd5c7-5b3c-4dc7-846c-abe409404ea4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:00.343594 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-489bd5c7-5b3c-4dc7-846c-abe409404ea4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:00.344613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-489bd5c7-5b3c-4dc7-846c-abe409404ea4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:00.357528 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-744938ed-4e06-4aa4-b7ad-c0cc95f4bf52 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] 10.222.0.93 "GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c" status: 200 len: 1322 microversion: 2.1 time: 0.716714 Aug 04 17:02:00.372807 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 885/1842] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:01:59 2022] GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c => generated 1322 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:02:00.381241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2f32c154-a4e8-4443-a918-1b546af0cd2e tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5bc39ca0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:00.483952 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2f32c154-a4e8-4443-a918-1b546af0cd2e tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee" status: 200 len: 1410 microversion: 2.1 time: 0.109124 Aug 04 17:02:00.492434 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 886/1843] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:00 2022] GET /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee => generated 1410 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:00.497565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e1b3ff91-c140-4af2-be98-cb60f003df89 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5bde8040>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:00.563468 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e1b3ff91-c140-4af2-be98-cb60f003df89 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c" status: 200 len: 1423 microversion: 2.1 time: 0.069774 Aug 04 17:02:00.582520 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 887/1844] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:00 2022] GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c => generated 1423 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:00.586846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0f267af9-6027-40c2-ace7-75e76e3be796 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:00.587587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0f267af9-6027-40c2-ace7-75e76e3be796 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] [instance: 089f712b-e824-4446-901d-705650fe676a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:00.605749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f267af9-6027-40c2-ace7-75e76e3be796 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:00.606921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f267af9-6027-40c2-ace7-75e76e3be796 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:00.607829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f267af9-6027-40c2-ace7-75e76e3be796 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:00.608945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f267af9-6027-40c2-ace7-75e76e3be796 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:00.609871 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f267af9-6027-40c2-ace7-75e76e3be796 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:00.610655 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f267af9-6027-40c2-ace7-75e76e3be796 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:00.716315 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-489bd5c7-5b3c-4dc7-846c-abe409404ea4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:00.734539 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0f267af9-6027-40c2-ace7-75e76e3be796 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b03ee3b42b48c5b792ec0325d8a90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e33cbcf48f488683098ef75bd5b25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:00.743678 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-489bd5c7-5b3c-4dc7-846c-abe409404ea4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1314 microversion: 2.1 time: 0.418289 Aug 04 17:02:00.743918 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0f267af9-6027-40c2-ace7-75e76e3be796 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] 10.222.0.93 "GET /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a" status: 200 len: 1211 microversion: 2.1 time: 0.167288 Aug 04 17:02:00.744283 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 958/1845] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:00 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:00.748650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8d02bff6-47dd-48ec-8fe5-41f6fc99467f tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:00.751354 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:02:00.751354 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 17:02:00.752486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d02bff6-47dd-48ec-8fe5-41f6fc99467f tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:00.752982 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d02bff6-47dd-48ec-8fe5-41f6fc99467f tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:00.753462 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d02bff6-47dd-48ec-8fe5-41f6fc99467f tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:00.754288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d02bff6-47dd-48ec-8fe5-41f6fc99467f tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:00.754753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d02bff6-47dd-48ec-8fe5-41f6fc99467f tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:00.755193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d02bff6-47dd-48ec-8fe5-41f6fc99467f tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:00.770011 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 888/1846] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:00 2022] GET /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a => generated 1211 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:00.770011 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-7d17bf38-8b63-4cf9-b5c3-d2f6ac740361 req-a3172d02-7e32-4406-883c-78641060bb48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2695555-41cc-4eff-ae6c-9b8d443103bb", "name": "network-vif-plugged", "status": "completed", "tag": "a400318a-3d22-404a-90ec-54d7d582192d"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:00.785801 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8d02bff6-47dd-48ec-8fe5-41f6fc99467f tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.040442 Aug 04 17:02:00.786573 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7d17bf38-8b63-4cf9-b5c3-d2f6ac740361 req-a3172d02-7e32-4406-883c-78641060bb48 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:00.786853 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 959/1847] 10.222.0.93 () {58 vars in 1176 bytes} [Thu Aug 4 17:02:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:00.787607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7d17bf38-8b63-4cf9-b5c3-d2f6ac740361 req-a3172d02-7e32-4406-883c-78641060bb48 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:00.788359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7d17bf38-8b63-4cf9-b5c3-d2f6ac740361 req-a3172d02-7e32-4406-883c-78641060bb48 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:00.798654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-63e1a31a-2ee2-4ddf-8beb-db26f0761365 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-851359-3", "block_migration": false, "disk_over_commit": false}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:00.801679 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-63e1a31a-2ee2-4ddf-8beb-db26f0761365 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:00.816305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63e1a31a-2ee2-4ddf-8beb-db26f0761365 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:00.816814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63e1a31a-2ee2-4ddf-8beb-db26f0761365 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:00.817274 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63e1a31a-2ee2-4ddf-8beb-db26f0761365 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:00.818013 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63e1a31a-2ee2-4ddf-8beb-db26f0761365 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:00.818487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63e1a31a-2ee2-4ddf-8beb-db26f0761365 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:00.819000 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63e1a31a-2ee2-4ddf-8beb-db26f0761365 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:00.823085 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-7d17bf38-8b63-4cf9-b5c3-d2f6ac740361 req-a3172d02-7e32-4406-883c-78641060bb48 service nova] Creating event network-vif-plugged:a400318a-3d22-404a-90ec-54d7d582192d for instance c2695555-41cc-4eff-ae6c-9b8d443103bb on n-h2-851359-3 Aug 04 17:02:00.834539 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-7d17bf38-8b63-4cf9-b5c3-d2f6ac740361 req-a3172d02-7e32-4406-883c-78641060bb48 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075550 Aug 04 17:02:00.840617 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 889/1848] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:00.859128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-63e1a31a-2ee2-4ddf-8beb-db26f0761365 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lazy-loading 'flavor' on Instance uuid 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:02:00.881116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-63e1a31a-2ee2-4ddf-8beb-db26f0761365 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Going to try to live migrate instance to n-h1-851359-3 {{(pid=131043) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 17:02:00.955128 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-99343947-fd92-4d22-8727-8abfccd0a1f5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1634960112", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "93c63081-713e-4b1c-8711-321b0490bce1"}], "block_device_mapping_v2": [{"uuid": "7c96426f-bdf8-4950-9aba-48a550a68af5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:01.090798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-99343947-fd92-4d22-8727-8abfccd0a1f5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] validate_networks() for [('93c63081-713e-4b1c-8711-321b0490bce1', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:02:02.556415 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-99343947-fd92-4d22-8727-8abfccd0a1f5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:02:02.558135 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-99343947-fd92-4d22-8727-8abfccd0a1f5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:02:02.558976 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-99343947-fd92-4d22-8727-8abfccd0a1f5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:02:02.559674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-99343947-fd92-4d22-8727-8abfccd0a1f5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:02:02.560371 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-99343947-fd92-4d22-8727-8abfccd0a1f5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:02:02.584481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99343947-fd92-4d22-8727-8abfccd0a1f5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:02.589189 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99343947-fd92-4d22-8727-8abfccd0a1f5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:02.589878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99343947-fd92-4d22-8727-8abfccd0a1f5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:02.593573 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99343947-fd92-4d22-8727-8abfccd0a1f5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:02.595266 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99343947-fd92-4d22-8727-8abfccd0a1f5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:02.596647 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99343947-fd92-4d22-8727-8abfccd0a1f5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:02.658587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-99343947-fd92-4d22-8727-8abfccd0a1f5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Getting quotas for project e457894e070145348859f44a6a3e8ed6. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:02:02.683986 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-99343947-fd92-4d22-8727-8abfccd0a1f5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Getting quotas for user d0e0f6e799384863af2222416f070c84 and project e457894e070145348859f44a6a3e8ed6. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:02:02.795154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-99343947-fd92-4d22-8727-8abfccd0a1f5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:02:02.799543 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-99343947-fd92-4d22-8727-8abfccd0a1f5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7c96426f-bdf8-4950-9aba-48a550a68af5',volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:02:03.007168 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-99343947-fd92-4d22-8727-8abfccd0a1f5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.057170 Aug 04 17:02:03.008013 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 890/1849] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Aug 4 17:02:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2059 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 04 17:02:03.013578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0a6ec90c-4a41-46b6-9e3c-1816b818f330 req-b69b2140-ccad-4e84-aea4-3e585bce0443 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "826b896f-e0e0-48e1-a520-b5fade2c374b", "tag": "0f610c46-1aef-4767-b0af-3f6a244761f6"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:03.026351 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0a6ec90c-4a41-46b6-9e3c-1816b818f330 req-b69b2140-ccad-4e84-aea4-3e585bce0443 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:03.027144 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0a6ec90c-4a41-46b6-9e3c-1816b818f330 req-b69b2140-ccad-4e84-aea4-3e585bce0443 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:03.027929 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0a6ec90c-4a41-46b6-9e3c-1816b818f330 req-b69b2140-ccad-4e84-aea4-3e585bce0443 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:03.046688 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0a6ec90c-4a41-46b6-9e3c-1816b818f330 req-b69b2140-ccad-4e84-aea4-3e585bce0443 service nova] Creating event network-changed:0f610c46-1aef-4767-b0af-3f6a244761f6 for instance 826b896f-e0e0-48e1-a520-b5fade2c374b on n-h1-851359-3 Aug 04 17:02:03.052634 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0a6ec90c-4a41-46b6-9e3c-1816b818f330 req-b69b2140-ccad-4e84-aea4-3e585bce0443 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042970 Aug 04 17:02:03.053245 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 891/1850] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:03.089540 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-48528ed8-619c-4e97-9da4-a02519834b96 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:03.094603 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-48528ed8-619c-4e97-9da4-a02519834b96 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] [instance: 067d9f8b-3067-447e-8017-2e6f5a6c721c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:03.121907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48528ed8-619c-4e97-9da4-a02519834b96 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:03.122715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48528ed8-619c-4e97-9da4-a02519834b96 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:03.123386 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48528ed8-619c-4e97-9da4-a02519834b96 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:03.124368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48528ed8-619c-4e97-9da4-a02519834b96 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:03.125191 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48528ed8-619c-4e97-9da4-a02519834b96 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:03.125964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48528ed8-619c-4e97-9da4-a02519834b96 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:03.356554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-48528ed8-619c-4e97-9da4-a02519834b96 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdd0a24d62e4db4bec3ab39f7cf28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d40b6141974bbea220bf71f61a3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:03.370609 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-48528ed8-619c-4e97-9da4-a02519834b96 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] 10.222.0.93 "GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c" status: 200 len: 1322 microversion: 2.1 time: 0.304138 Aug 04 17:02:03.371453 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 892/1851] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:03 2022] GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c => generated 1322 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:03.377046 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9162fdee-ca20-4093-98f1-4ce43c0b517e tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5b56dee0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:04.576513 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-63e1a31a-2ee2-4ddf-8beb-db26f0761365 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3/action" status: 202 len: 0 microversion: 2.1 time: 3.781528 Aug 04 17:02:04.578077 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 960/1852] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:02:00 2022] POST /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3/action => generated 0 bytes in 3784 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 17:02:04.583761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-120000d9-8d29-462c-ae11-275dacc2f0bd tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5b0174c0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:06.562581 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9162fdee-ca20-4093-98f1-4ce43c0b517e tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee" status: 200 len: 1419 microversion: 2.1 time: 3.189768 Aug 04 17:02:06.563224 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 893/1853] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:03 2022] GET /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee => generated 1419 bytes in 3191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:06.577294 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-120000d9-8d29-462c-ae11-275dacc2f0bd tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c" status: 200 len: 1423 microversion: 2.1 time: 1.995032 Aug 04 17:02:06.587199 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 961/1854] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:04 2022] GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c => generated 1423 bytes in 2008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:06.592830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7c8a4fc1-aeab-452b-a2cd-517440db0fda tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:06.599294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4b758804-fd3f-4719-9f8b-146b6a529150 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:06.600022 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7c8a4fc1-aeab-452b-a2cd-517440db0fda tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] [instance: 089f712b-e824-4446-901d-705650fe676a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:06.605400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4b758804-fd3f-4719-9f8b-146b6a529150 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:06.608435 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:06.609544 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c8a4fc1-aeab-452b-a2cd-517440db0fda tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:06.610622 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c8a4fc1-aeab-452b-a2cd-517440db0fda tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:06.612191 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c8a4fc1-aeab-452b-a2cd-517440db0fda tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:06.613188 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c8a4fc1-aeab-452b-a2cd-517440db0fda tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:06.614126 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c8a4fc1-aeab-452b-a2cd-517440db0fda tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:06.614743 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c8a4fc1-aeab-452b-a2cd-517440db0fda tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:06.636235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b758804-fd3f-4719-9f8b-146b6a529150 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:06.637793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b758804-fd3f-4719-9f8b-146b6a529150 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:06.638582 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b758804-fd3f-4719-9f8b-146b6a529150 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:06.639464 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b758804-fd3f-4719-9f8b-146b6a529150 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:06.639935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b758804-fd3f-4719-9f8b-146b6a529150 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:06.640365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b758804-fd3f-4719-9f8b-146b6a529150 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:06.895903 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7c8a4fc1-aeab-452b-a2cd-517440db0fda tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b03ee3b42b48c5b792ec0325d8a90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e33cbcf48f488683098ef75bd5b25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:06.922383 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7c8a4fc1-aeab-452b-a2cd-517440db0fda tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] 10.222.0.93 "GET /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a" status: 200 len: 1315 microversion: 2.1 time: 0.333485 Aug 04 17:02:06.944691 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 962/1855] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:06 2022] GET /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:06.963898 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3c4fc9ce-0299-423a-8fae-6b8b62578dad tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:06.964774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3c4fc9ce-0299-423a-8fae-6b8b62578dad tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:06.971648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3c4fc9ce-0299-423a-8fae-6b8b62578dad tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:06.973272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3c4fc9ce-0299-423a-8fae-6b8b62578dad tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:06.973998 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3c4fc9ce-0299-423a-8fae-6b8b62578dad tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:06.975001 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3c4fc9ce-0299-423a-8fae-6b8b62578dad tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:06.975699 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3c4fc9ce-0299-423a-8fae-6b8b62578dad tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:06.976381 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3c4fc9ce-0299-423a-8fae-6b8b62578dad tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:06.996027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4b758804-fd3f-4719-9f8b-146b6a529150 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:07.020478 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4b758804-fd3f-4719-9f8b-146b6a529150 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1314 microversion: 2.1 time: 0.455468 Aug 04 17:02:07.021863 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 894/1856] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:06 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:07.027420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-649c35d7-8506-4fb2-adce-f6d8567eb465 req-bd522cd1-6a65-44bf-b692-d4f674bde3de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "067d9f8b-3067-447e-8017-2e6f5a6c721c", "name": "network-vif-plugged", "status": "completed", "tag": "2345ad42-81c5-40bf-98c8-b558e6b6ca1a"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:07.030702 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:07.042856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-649c35d7-8506-4fb2-adce-f6d8567eb465 req-bd522cd1-6a65-44bf-b692-d4f674bde3de service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:07.044465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-649c35d7-8506-4fb2-adce-f6d8567eb465 req-bd522cd1-6a65-44bf-b692-d4f674bde3de service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:07.045248 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-649c35d7-8506-4fb2-adce-f6d8567eb465 req-bd522cd1-6a65-44bf-b692-d4f674bde3de service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:07.089592 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-649c35d7-8506-4fb2-adce-f6d8567eb465 req-bd522cd1-6a65-44bf-b692-d4f674bde3de service nova] Creating event network-vif-plugged:2345ad42-81c5-40bf-98c8-b558e6b6ca1a for instance 067d9f8b-3067-447e-8017-2e6f5a6c721c on n-h1-851359-3 Aug 04 17:02:07.105382 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-649c35d7-8506-4fb2-adce-f6d8567eb465 req-bd522cd1-6a65-44bf-b692-d4f674bde3de service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080204 Aug 04 17:02:07.106704 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 895/1857] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:07.119940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7366141a-30ea-4021-adf2-cda99ec6e210 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:07.123184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7366141a-30ea-4021-adf2-cda99ec6e210 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] [instance: 067d9f8b-3067-447e-8017-2e6f5a6c721c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:07.141719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7366141a-30ea-4021-adf2-cda99ec6e210 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:07.144820 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7366141a-30ea-4021-adf2-cda99ec6e210 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:07.145508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7366141a-30ea-4021-adf2-cda99ec6e210 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:07.152353 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7366141a-30ea-4021-adf2-cda99ec6e210 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:07.162306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7366141a-30ea-4021-adf2-cda99ec6e210 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:07.163153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7366141a-30ea-4021-adf2-cda99ec6e210 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:07.178820 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3c4fc9ce-0299-423a-8fae-6b8b62578dad tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:07.189764 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3c4fc9ce-0299-423a-8fae-6b8b62578dad tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:07.192469 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3c4fc9ce-0299-423a-8fae-6b8b62578dad tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:07.193923 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3c4fc9ce-0299-423a-8fae-6b8b62578dad tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1293 microversion: 2.25 time: 0.248090 Aug 04 17:02:07.204204 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 963/1858] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:06 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1293 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:07.215820 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5d4f94f3-dfa6-4c7e-82de-a3235ad804cf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:07.216790 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5d4f94f3-dfa6-4c7e-82de-a3235ad804cf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:07.227431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d4f94f3-dfa6-4c7e-82de-a3235ad804cf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:07.228263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d4f94f3-dfa6-4c7e-82de-a3235ad804cf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:07.228912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d4f94f3-dfa6-4c7e-82de-a3235ad804cf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:07.230811 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d4f94f3-dfa6-4c7e-82de-a3235ad804cf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:07.231513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d4f94f3-dfa6-4c7e-82de-a3235ad804cf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:07.232336 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d4f94f3-dfa6-4c7e-82de-a3235ad804cf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:08.143078 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7366141a-30ea-4021-adf2-cda99ec6e210 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdd0a24d62e4db4bec3ab39f7cf28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d40b6141974bbea220bf71f61a3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:08.156183 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7366141a-30ea-4021-adf2-cda99ec6e210 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] 10.222.0.93 "GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c" status: 200 len: 1322 microversion: 2.1 time: 1.046066 Aug 04 17:02:08.159466 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 896/1859] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:07 2022] GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c => generated 1322 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:08.164443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-671a494b-9f55-4717-8d93-ca18c2a11251 req-81c16f05-8cb6-4bc9-b591-47f0328e2940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "089f712b-e824-4446-901d-705650fe676a", "tag": "e53ebc8f-9b52-466c-89ff-5c6effdd0523"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:08.190219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5d4f94f3-dfa6-4c7e-82de-a3235ad804cf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:08.203791 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-671a494b-9f55-4717-8d93-ca18c2a11251 req-81c16f05-8cb6-4bc9-b591-47f0328e2940 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:08.205204 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5d4f94f3-dfa6-4c7e-82de-a3235ad804cf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1392 microversion: 2.1 time: 0.994504 Aug 04 17:02:08.205639 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 964/1860] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:07 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1392 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:08.206692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-671a494b-9f55-4717-8d93-ca18c2a11251 req-81c16f05-8cb6-4bc9-b591-47f0328e2940 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:08.207121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-671a494b-9f55-4717-8d93-ca18c2a11251 req-81c16f05-8cb6-4bc9-b591-47f0328e2940 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:08.215243 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-77168d38-3eff-4cea-a435-146451803dd2 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5af9d790>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:08.244078 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-671a494b-9f55-4717-8d93-ca18c2a11251 req-81c16f05-8cb6-4bc9-b591-47f0328e2940 service nova] Creating event network-changed:e53ebc8f-9b52-466c-89ff-5c6effdd0523 for instance 089f712b-e824-4446-901d-705650fe676a on n-h1-851359-3 Aug 04 17:02:08.249209 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-671a494b-9f55-4717-8d93-ca18c2a11251 req-81c16f05-8cb6-4bc9-b591-47f0328e2940 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088331 Aug 04 17:02:08.250104 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 897/1861] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:08.255599 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-38c9e80d-34d7-4636-a923-27e94f69f8ec tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e6ca18160>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:08.288689 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-77168d38-3eff-4cea-a435-146451803dd2 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee" status: 200 len: 1419 microversion: 2.1 time: 0.077538 Aug 04 17:02:08.289277 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 965/1862] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:08 2022] GET /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee => generated 1419 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:08.309966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-671fcb3e-ca3f-4b27-abf6-05551548b018 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:08.310910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-671fcb3e-ca3f-4b27-abf6-05551548b018 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] [instance: 089f712b-e824-4446-901d-705650fe676a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:08.317400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-671fcb3e-ca3f-4b27-abf6-05551548b018 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:08.317954 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-671fcb3e-ca3f-4b27-abf6-05551548b018 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:08.318438 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-671fcb3e-ca3f-4b27-abf6-05551548b018 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:08.319498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-671fcb3e-ca3f-4b27-abf6-05551548b018 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:08.319964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-671fcb3e-ca3f-4b27-abf6-05551548b018 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:08.320397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-671fcb3e-ca3f-4b27-abf6-05551548b018 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:08.335215 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-38c9e80d-34d7-4636-a923-27e94f69f8ec tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c" status: 200 len: 1423 microversion: 2.1 time: 0.083529 Aug 04 17:02:08.344094 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 898/1863] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:08 2022] GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c => generated 1423 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:08.350240 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ccbb66e0-e736-45d3-869d-0c0c868d9333 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:08.351131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ccbb66e0-e736-45d3-869d-0c0c868d9333 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:08.359826 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ccbb66e0-e736-45d3-869d-0c0c868d9333 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:08.360482 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ccbb66e0-e736-45d3-869d-0c0c868d9333 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:08.361261 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ccbb66e0-e736-45d3-869d-0c0c868d9333 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:08.362301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ccbb66e0-e736-45d3-869d-0c0c868d9333 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:08.362771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ccbb66e0-e736-45d3-869d-0c0c868d9333 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:08.363367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ccbb66e0-e736-45d3-869d-0c0c868d9333 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:08.591195 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-671fcb3e-ca3f-4b27-abf6-05551548b018 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b03ee3b42b48c5b792ec0325d8a90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e33cbcf48f488683098ef75bd5b25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:08.609287 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-671fcb3e-ca3f-4b27-abf6-05551548b018 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] 10.222.0.93 "GET /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a" status: 200 len: 1315 microversion: 2.1 time: 0.310771 Aug 04 17:02:08.610207 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 966/1864] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:08 2022] GET /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:08.619106 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-50b67adf-662d-4bae-8983-e6253d064bd5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:08.619741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-50b67adf-662d-4bae-8983-e6253d064bd5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:08.638346 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50b67adf-662d-4bae-8983-e6253d064bd5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:08.638854 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50b67adf-662d-4bae-8983-e6253d064bd5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:08.639547 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50b67adf-662d-4bae-8983-e6253d064bd5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:08.641913 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50b67adf-662d-4bae-8983-e6253d064bd5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:08.642599 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50b67adf-662d-4bae-8983-e6253d064bd5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:08.645833 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50b67adf-662d-4bae-8983-e6253d064bd5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:08.670471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ccbb66e0-e736-45d3-869d-0c0c868d9333 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:08.681375 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ccbb66e0-e736-45d3-869d-0c0c868d9333 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1314 microversion: 2.1 time: 0.336096 Aug 04 17:02:08.696045 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 899/1865] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:08 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:08.702933 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-71f93a3c-e169-43f3-bb0c-c0cd6d20da31 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e6ca189d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:08.839739 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-50b67adf-662d-4bae-8983-e6253d064bd5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:08.851390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-50b67adf-662d-4bae-8983-e6253d064bd5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:08.853916 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-50b67adf-662d-4bae-8983-e6253d064bd5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:08.855648 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-50b67adf-662d-4bae-8983-e6253d064bd5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1293 microversion: 2.25 time: 0.244364 Aug 04 17:02:08.856844 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 967/1866] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:08 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1293 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:09.182138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0b562755-1b6f-4c9d-af02-8f58f5c8d253 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:09.183231 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0b562755-1b6f-4c9d-af02-8f58f5c8d253 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] [instance: 067d9f8b-3067-447e-8017-2e6f5a6c721c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:09.192116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=22 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:09.203536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b562755-1b6f-4c9d-af02-8f58f5c8d253 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:09.209785 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b562755-1b6f-4c9d-af02-8f58f5c8d253 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:09.210415 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b562755-1b6f-4c9d-af02-8f58f5c8d253 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:09.211270 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b562755-1b6f-4c9d-af02-8f58f5c8d253 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:09.211832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b562755-1b6f-4c9d-af02-8f58f5c8d253 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:09.217947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b562755-1b6f-4c9d-af02-8f58f5c8d253 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:09.531428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0b562755-1b6f-4c9d-af02-8f58f5c8d253 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdd0a24d62e4db4bec3ab39f7cf28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d40b6141974bbea220bf71f61a3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:09.554167 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0b562755-1b6f-4c9d-af02-8f58f5c8d253 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] 10.222.0.93 "GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c" status: 200 len: 1471 microversion: 2.1 time: 0.376949 Aug 04 17:02:09.555678 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 968/1867] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:09 2022] GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c => generated 1471 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:09.613122 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-20c82833-4345-4904-b797-fb58adf268da req-2236ec51-1c6e-4312-a573-0074d85dbf22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "826b896f-e0e0-48e1-a520-b5fade2c374b", "name": "network-vif-plugged", "status": "completed", "tag": "0f610c46-1aef-4767-b0af-3f6a244761f6"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:09.643907 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-20c82833-4345-4904-b797-fb58adf268da req-2236ec51-1c6e-4312-a573-0074d85dbf22 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:09.644486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-20c82833-4345-4904-b797-fb58adf268da req-2236ec51-1c6e-4312-a573-0074d85dbf22 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:09.646096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-20c82833-4345-4904-b797-fb58adf268da req-2236ec51-1c6e-4312-a573-0074d85dbf22 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:09.665285 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-20c82833-4345-4904-b797-fb58adf268da req-2236ec51-1c6e-4312-a573-0074d85dbf22 service nova] Creating event network-vif-plugged:0f610c46-1aef-4767-b0af-3f6a244761f6 for instance 826b896f-e0e0-48e1-a520-b5fade2c374b on n-h1-851359-3 Aug 04 17:02:09.676819 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-20c82833-4345-4904-b797-fb58adf268da req-2236ec51-1c6e-4312-a573-0074d85dbf22 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119127 Aug 04 17:02:09.677744 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 969/1868] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:09.683856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0a0beb50-9bd4-4f33-99fc-a74d5c582b92 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:09.684537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0a0beb50-9bd4-4f33-99fc-a74d5c582b92 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:09.696366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0a0beb50-9bd4-4f33-99fc-a74d5c582b92 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:09.696870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0a0beb50-9bd4-4f33-99fc-a74d5c582b92 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:09.697425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0a0beb50-9bd4-4f33-99fc-a74d5c582b92 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:09.698536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0a0beb50-9bd4-4f33-99fc-a74d5c582b92 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:09.699066 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0a0beb50-9bd4-4f33-99fc-a74d5c582b92 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:09.699876 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0a0beb50-9bd4-4f33-99fc-a74d5c582b92 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:09.900544 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-71f93a3c-e169-43f3-bb0c-c0cd6d20da31 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "DELETE /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee" status: 204 len: 0 microversion: 2.1 time: 1.201270 Aug 04 17:02:09.901375 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 900/1869] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:08 2022] DELETE /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee => generated 0 bytes in 1205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:02:09.906874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a2114e35-13c5-40a2-9dad-69e16e2f536c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5bb95430>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:09.961738 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a2114e35-13c5-40a2-9dad-69e16e2f536c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c" status: 200 len: 1423 microversion: 2.1 time: 0.058780 Aug 04 17:02:09.962940 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 901/1870] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:09 2022] GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c => generated 1423 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:09.968212 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-048e243f-32a7-4d8c-8389-bfa61e7f363b tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:09.968922 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-048e243f-32a7-4d8c-8389-bfa61e7f363b tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] [instance: 067d9f8b-3067-447e-8017-2e6f5a6c721c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:09.973059 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0a0beb50-9bd4-4f33-99fc-a74d5c582b92 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:09.976448 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-048e243f-32a7-4d8c-8389-bfa61e7f363b tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:09.977155 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-048e243f-32a7-4d8c-8389-bfa61e7f363b tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:09.977895 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-048e243f-32a7-4d8c-8389-bfa61e7f363b tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:09.978829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-048e243f-32a7-4d8c-8389-bfa61e7f363b tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:09.979458 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-048e243f-32a7-4d8c-8389-bfa61e7f363b tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:09.980170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-048e243f-32a7-4d8c-8389-bfa61e7f363b tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:09.983572 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0a0beb50-9bd4-4f33-99fc-a74d5c582b92 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1392 microversion: 2.1 time: 0.304580 Aug 04 17:02:09.984475 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 970/1871] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:09 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1392 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:09.990054 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-261a731a-6287-4125-bc9e-cf1054cbab87 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:09.991712 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-261a731a-6287-4125-bc9e-cf1054cbab87 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] [instance: 089f712b-e824-4446-901d-705650fe676a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:09.997862 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-261a731a-6287-4125-bc9e-cf1054cbab87 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:09.999053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-261a731a-6287-4125-bc9e-cf1054cbab87 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:09.999900 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-261a731a-6287-4125-bc9e-cf1054cbab87 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:10.001198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-261a731a-6287-4125-bc9e-cf1054cbab87 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:10.001859 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-261a731a-6287-4125-bc9e-cf1054cbab87 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:10.002487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-261a731a-6287-4125-bc9e-cf1054cbab87 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:10.016847 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-048e243f-32a7-4d8c-8389-bfa61e7f363b tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'bfdd0a24d62e4db4bec3ab39f7cf28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d40b6141974bbea220bf71f61a3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-048e243f-32a7-4d8c-8389-bfa61e7f363b tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Request method failure captured: Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c/diagnostics HTTP/1.1 Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_t4Rn4ovQM_Ecys6rhcUPuYwsIxHfSTo5aJ76W7MsZDmXLnJ3meYzJ0qNfkYmjGt4Fd67GNWZUvxYPivSJtZLLx-apMYwldODW2tziS_C4CVwHk9Gpt8i-buFGT7qSiJcpynWs-oB4KGVUzxqNugFX_bS-H69yGk9z2ZFEwXcHpHVI Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 85d40b6141974bbea220bf71f61a3ab2 Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-2113862701 Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/85d40b6141974bbea220bf71f61a3ab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/85d40b6141974bbea220bf71f61a3ab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_85d40b6141974bbea220bf71f61a3ab2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/85d40b6141974bbea220bf71f61a3ab2"}]}] Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-2113862701 Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 85d40b6141974bbea220bf71f61a3ab2 Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-2113862701 Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServerDiagnosticsNegativeTest-2113862701-project Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: bfdd0a24d62e4db4bec3ab39f7cf28a4 Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-2113862701-project Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'server_id': '067d9f8b-3067-447e-8017-2e6f5a6c721c'} Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:02:10.019762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:10.025140 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:10.025140 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:10.025140 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 17:02:10.025140 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 17:02:10.025140 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 04 17:02:10.025140 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:02:10.026465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-048e243f-32a7-4d8c-8389-bfa61e7f363b tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:02:10.027498 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-048e243f-32a7-4d8c-8389-bfa61e7f363b tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] 10.222.0.93 "GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.063384 Aug 04 17:02:10.028651 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 902/1872] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 17:02:09 2022] GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c/diagnostics => generated 117 bytes in 65 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:02:10.033846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d2dee5d5-96a3-433a-8c42-43da685e7eb6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:10.035734 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d2dee5d5-96a3-433a-8c42-43da685e7eb6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:10.042310 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2dee5d5-96a3-433a-8c42-43da685e7eb6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:10.043111 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2dee5d5-96a3-433a-8c42-43da685e7eb6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:10.043835 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2dee5d5-96a3-433a-8c42-43da685e7eb6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:10.044729 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2dee5d5-96a3-433a-8c42-43da685e7eb6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:10.045359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2dee5d5-96a3-433a-8c42-43da685e7eb6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:10.046358 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2dee5d5-96a3-433a-8c42-43da685e7eb6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:10.255808 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-261a731a-6287-4125-bc9e-cf1054cbab87 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b03ee3b42b48c5b792ec0325d8a90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e33cbcf48f488683098ef75bd5b25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:10.271321 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-261a731a-6287-4125-bc9e-cf1054cbab87 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] 10.222.0.93 "GET /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a" status: 200 len: 1315 microversion: 2.1 time: 0.285739 Aug 04 17:02:10.278214 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 971/1873] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:09 2022] GET /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:10.298516 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-95ca2caf-2f51-4895-b797-00ae87dd32c5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:10.300793 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-95ca2caf-2f51-4895-b797-00ae87dd32c5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:10.326713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d2dee5d5-96a3-433a-8c42-43da685e7eb6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:10.330249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95ca2caf-2f51-4895-b797-00ae87dd32c5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:10.336691 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95ca2caf-2f51-4895-b797-00ae87dd32c5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:10.337568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95ca2caf-2f51-4895-b797-00ae87dd32c5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:10.339204 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d2dee5d5-96a3-433a-8c42-43da685e7eb6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1314 microversion: 2.1 time: 0.308747 Aug 04 17:02:10.339639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95ca2caf-2f51-4895-b797-00ae87dd32c5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:10.340728 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 903/1874] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:10 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:10.351425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95ca2caf-2f51-4895-b797-00ae87dd32c5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:10.357650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95ca2caf-2f51-4895-b797-00ae87dd32c5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:10.376812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6e3f3080-3494-42e1-8248-60a05968c8ca tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:10.379724 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6e3f3080-3494-42e1-8248-60a05968c8ca tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0aa159af-25ad-4e88-adfd-88736802c68b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:10.403784 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e3f3080-3494-42e1-8248-60a05968c8ca tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:10.404597 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e3f3080-3494-42e1-8248-60a05968c8ca tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:10.406486 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e3f3080-3494-42e1-8248-60a05968c8ca tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:10.407645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e3f3080-3494-42e1-8248-60a05968c8ca tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:10.414684 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e3f3080-3494-42e1-8248-60a05968c8ca tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:10.415384 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e3f3080-3494-42e1-8248-60a05968c8ca tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:10.468418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6e3f3080-3494-42e1-8248-60a05968c8ca tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0aa159af-25ad-4e88-adfd-88736802c68b] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:02:10.533197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:10.562594 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-95ca2caf-2f51-4895-b797-00ae87dd32c5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:10.573208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-95ca2caf-2f51-4895-b797-00ae87dd32c5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:10.574920 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-95ca2caf-2f51-4895-b797-00ae87dd32c5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:10.576611 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-95ca2caf-2f51-4895-b797-00ae87dd32c5 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1293 microversion: 2.25 time: 0.296823 Aug 04 17:02:10.591683 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 972/1875] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:10 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1293 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:10.591683 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5d2b6529-df05-434a-aaf0-af10b083fa16 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:10.591683 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5d2b6529-df05-434a-aaf0-af10b083fa16 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] [instance: 067d9f8b-3067-447e-8017-2e6f5a6c721c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:10.591683 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d2b6529-df05-434a-aaf0-af10b083fa16 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:10.592240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d2b6529-df05-434a-aaf0-af10b083fa16 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:10.592240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d2b6529-df05-434a-aaf0-af10b083fa16 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:10.595065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d2b6529-df05-434a-aaf0-af10b083fa16 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:10.595065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d2b6529-df05-434a-aaf0-af10b083fa16 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:10.595065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d2b6529-df05-434a-aaf0-af10b083fa16 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:10.628006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5d2b6529-df05-434a-aaf0-af10b083fa16 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] [instance: 067d9f8b-3067-447e-8017-2e6f5a6c721c] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:02:10.669099 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6e3f3080-3494-42e1-8248-60a05968c8ca tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b" status: 204 len: 0 microversion: 2.1 time: 0.326767 Aug 04 17:02:10.673559 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 904/1876] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:02:10 2022] DELETE /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:02:10.688603 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-5e60538a-3882-4abe-b28d-84b62a26dcd4 req-13722d74-23ab-4797-800c-386803117418 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84f56763-a994-4d26-96d4-a6d1ba68566c", "tag": "10ad4377-3641-452e-aee7-2170593948a9"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:10.711166 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5e60538a-3882-4abe-b28d-84b62a26dcd4 req-13722d74-23ab-4797-800c-386803117418 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:10.712936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5e60538a-3882-4abe-b28d-84b62a26dcd4 req-13722d74-23ab-4797-800c-386803117418 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:10.713648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5e60538a-3882-4abe-b28d-84b62a26dcd4 req-13722d74-23ab-4797-800c-386803117418 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:10.738309 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-5e60538a-3882-4abe-b28d-84b62a26dcd4 req-13722d74-23ab-4797-800c-386803117418 service nova] Creating event network-changed:10ad4377-3641-452e-aee7-2170593948a9 for instance 84f56763-a994-4d26-96d4-a6d1ba68566c on n-h1-851359-3 Aug 04 17:02:10.746017 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-5e60538a-3882-4abe-b28d-84b62a26dcd4 req-13722d74-23ab-4797-800c-386803117418 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070654 Aug 04 17:02:10.750069 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 905/1877] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:10.772487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=8 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:10.777561 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5d2b6529-df05-434a-aaf0-af10b083fa16 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] 10.222.0.93 "DELETE /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c" status: 204 len: 0 microversion: 2.1 time: 0.198426 Aug 04 17:02:10.778723 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 973/1878] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:02:10 2022] DELETE /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:02:10.788121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-947ff0f3-621d-4967-86e6-063f023cba10 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:10.789173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-947ff0f3-621d-4967-86e6-063f023cba10 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] [instance: 067d9f8b-3067-447e-8017-2e6f5a6c721c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:10.795818 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-947ff0f3-621d-4967-86e6-063f023cba10 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:10.796628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-947ff0f3-621d-4967-86e6-063f023cba10 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:10.797295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-947ff0f3-621d-4967-86e6-063f023cba10 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:10.798380 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-947ff0f3-621d-4967-86e6-063f023cba10 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:10.799109 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-947ff0f3-621d-4967-86e6-063f023cba10 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:10.799784 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-947ff0f3-621d-4967-86e6-063f023cba10 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:10.832819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ce1437eb-f3e4-4073-aafd-b3fb2099fdaa tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-191175067", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "c4b7b07c-f108-4c13-9679-84b31b18674e"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:10.972381 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-ce1437eb-f3e4-4073-aafd-b3fb2099fdaa tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] validate_networks() for [('c4b7b07c-f108-4c13-9679-84b31b18674e', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:02:11.083492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-947ff0f3-621d-4967-86e6-063f023cba10 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdd0a24d62e4db4bec3ab39f7cf28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d40b6141974bbea220bf71f61a3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:11.096148 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-947ff0f3-621d-4967-86e6-063f023cba10 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] 10.222.0.93 "GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c" status: 200 len: 1477 microversion: 2.1 time: 0.311954 Aug 04 17:02:11.097386 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 906/1879] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:10 2022] GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c => generated 1477 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:11.110930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d70ad296-15a6-48d2-bdb4-a44f6d27d1a3 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5b3891f0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:11.182846 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d70ad296-15a6-48d2-bdb4-a44f6d27d1a3 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c" status: 200 len: 1423 microversion: 2.1 time: 0.082860 Aug 04 17:02:11.183497 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 907/1880] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:11 2022] GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c => generated 1423 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:11.196463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ac07826e-c55f-47ac-bcf0-4c00cdb227bb tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:11.197091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ac07826e-c55f-47ac-bcf0-4c00cdb227bb tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:11.207495 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac07826e-c55f-47ac-bcf0-4c00cdb227bb tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:11.208060 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac07826e-c55f-47ac-bcf0-4c00cdb227bb tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:11.209111 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac07826e-c55f-47ac-bcf0-4c00cdb227bb tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:11.210375 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac07826e-c55f-47ac-bcf0-4c00cdb227bb tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:11.210914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac07826e-c55f-47ac-bcf0-4c00cdb227bb tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:11.211357 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac07826e-c55f-47ac-bcf0-4c00cdb227bb tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:11.446129 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ac07826e-c55f-47ac-bcf0-4c00cdb227bb tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:11.454061 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ac07826e-c55f-47ac-bcf0-4c00cdb227bb tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1392 microversion: 2.1 time: 0.269236 Aug 04 17:02:11.461163 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 908/1881] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:11 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1392 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:11.478656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-65d802bd-ea03-47f0-8083-ce2a51f1ecf9 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:11.479656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-65d802bd-ea03-47f0-8083-ce2a51f1ecf9 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] [instance: 089f712b-e824-4446-901d-705650fe676a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:11.497788 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65d802bd-ea03-47f0-8083-ce2a51f1ecf9 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:11.498778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65d802bd-ea03-47f0-8083-ce2a51f1ecf9 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:11.499573 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65d802bd-ea03-47f0-8083-ce2a51f1ecf9 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:11.500572 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65d802bd-ea03-47f0-8083-ce2a51f1ecf9 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:11.501343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65d802bd-ea03-47f0-8083-ce2a51f1ecf9 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:11.502081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65d802bd-ea03-47f0-8083-ce2a51f1ecf9 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:11.744056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-ce1437eb-f3e4-4073-aafd-b3fb2099fdaa tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:02:11.746821 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-ce1437eb-f3e4-4073-aafd-b3fb2099fdaa tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:02:11.747895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-ce1437eb-f3e4-4073-aafd-b3fb2099fdaa tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:02:11.748643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-ce1437eb-f3e4-4073-aafd-b3fb2099fdaa tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:02:11.749251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-ce1437eb-f3e4-4073-aafd-b3fb2099fdaa tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:02:11.765721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ce1437eb-f3e4-4073-aafd-b3fb2099fdaa tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:11.767445 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ce1437eb-f3e4-4073-aafd-b3fb2099fdaa tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:11.769407 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ce1437eb-f3e4-4073-aafd-b3fb2099fdaa tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:11.770417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ce1437eb-f3e4-4073-aafd-b3fb2099fdaa tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:11.773431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ce1437eb-f3e4-4073-aafd-b3fb2099fdaa tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:11.774645 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ce1437eb-f3e4-4073-aafd-b3fb2099fdaa tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:11.776469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-65d802bd-ea03-47f0-8083-ce2a51f1ecf9 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b03ee3b42b48c5b792ec0325d8a90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e33cbcf48f488683098ef75bd5b25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:11.785993 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-65d802bd-ea03-47f0-8083-ce2a51f1ecf9 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] 10.222.0.93 "GET /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a" status: 200 len: 1315 microversion: 2.1 time: 0.321723 Aug 04 17:02:11.792817 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 909/1882] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:11 2022] GET /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:11.799805 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f9c4952f-590e-40c4-a3e4-773f6b9fe56e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:11.800497 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f9c4952f-590e-40c4-a3e4-773f6b9fe56e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:11.823982 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-ce1437eb-f3e4-4073-aafd-b3fb2099fdaa tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Getting quotas for project 86d8604ab1934bdeacd1bb6073ae153a. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:02:11.824457 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9c4952f-590e-40c4-a3e4-773f6b9fe56e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:11.825059 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9c4952f-590e-40c4-a3e4-773f6b9fe56e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:11.827884 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9c4952f-590e-40c4-a3e4-773f6b9fe56e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:11.829168 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9c4952f-590e-40c4-a3e4-773f6b9fe56e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:11.829753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9c4952f-590e-40c4-a3e4-773f6b9fe56e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:11.831258 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9c4952f-590e-40c4-a3e4-773f6b9fe56e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:11.836655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-ce1437eb-f3e4-4073-aafd-b3fb2099fdaa tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Getting quotas for user 157e8ca7c2494f3ea5c468dc37f55858 and project 86d8604ab1934bdeacd1bb6073ae153a. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:02:11.846652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:11.886824 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ce1437eb-f3e4-4073-aafd-b3fb2099fdaa tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:02:11.893277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ce1437eb-f3e4-4073-aafd-b3fb2099fdaa tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:02:12.004845 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ce1437eb-f3e4-4073-aafd-b3fb2099fdaa tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.179260 Aug 04 17:02:12.019410 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 974/1883] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:02:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:02:12.019410 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c4a0e938-5850-4726-b743-83adbca06bcf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:12.019410 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c4a0e938-5850-4726-b743-83adbca06bcf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:12.033690 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4a0e938-5850-4726-b743-83adbca06bcf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:12.035500 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4a0e938-5850-4726-b743-83adbca06bcf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:12.036714 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4a0e938-5850-4726-b743-83adbca06bcf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:12.037635 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4a0e938-5850-4726-b743-83adbca06bcf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:12.038369 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4a0e938-5850-4726-b743-83adbca06bcf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:12.038845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4a0e938-5850-4726-b743-83adbca06bcf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:12.107162 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f9c4952f-590e-40c4-a3e4-773f6b9fe56e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:12.120114 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f9c4952f-590e-40c4-a3e4-773f6b9fe56e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1314 microversion: 2.1 time: 0.324041 Aug 04 17:02:12.121539 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 910/1884] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:11 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:12.129842 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-ae533389-6e31-4e69-89d3-ac4d2d9339ea req-8cf0fb2c-f667-4aad-8e66-2fd415c66aaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aa159af-25ad-4e88-adfd-88736802c68b", "name": "network-vif-unplugged", "status": "completed", "tag": "0cadd627-9251-4fb3-895b-7cb5c6b41b23"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:12.166062 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ae533389-6e31-4e69-89d3-ac4d2d9339ea req-8cf0fb2c-f667-4aad-8e66-2fd415c66aaf service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:12.168577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ae533389-6e31-4e69-89d3-ac4d2d9339ea req-8cf0fb2c-f667-4aad-8e66-2fd415c66aaf service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:12.171518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ae533389-6e31-4e69-89d3-ac4d2d9339ea req-8cf0fb2c-f667-4aad-8e66-2fd415c66aaf service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:12.194378 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-ae533389-6e31-4e69-89d3-ac4d2d9339ea req-8cf0fb2c-f667-4aad-8e66-2fd415c66aaf service nova] Creating event network-vif-unplugged:0cadd627-9251-4fb3-895b-7cb5c6b41b23 for instance 0aa159af-25ad-4e88-adfd-88736802c68b on n-h1-851359-3 Aug 04 17:02:12.210457 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-ae533389-6e31-4e69-89d3-ac4d2d9339ea req-8cf0fb2c-f667-4aad-8e66-2fd415c66aaf service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085529 Aug 04 17:02:12.211665 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 911/1885] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:12.219560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0c64eb98-ab61-49ee-a14b-72a2838b1991 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:12.224428 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0c64eb98-ab61-49ee-a14b-72a2838b1991 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:12.406334 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0c64eb98-ab61-49ee-a14b-72a2838b1991 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:12.416432 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0c64eb98-ab61-49ee-a14b-72a2838b1991 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1207 microversion: 2.1 time: 0.203545 Aug 04 17:02:12.421482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c4a0e938-5850-4726-b743-83adbca06bcf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:12.422495 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 912/1886] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:12 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1207 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:12.438932 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f5624013-2aba-468d-86fe-4a35f409bf4e tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:12.441036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f5624013-2aba-468d-86fe-4a35f409bf4e tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] [instance: 067d9f8b-3067-447e-8017-2e6f5a6c721c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:12.452236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c4a0e938-5850-4726-b743-83adbca06bcf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:12.454357 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c4a0e938-5850-4726-b743-83adbca06bcf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:12.456844 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5624013-2aba-468d-86fe-4a35f409bf4e tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:12.456986 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c4a0e938-5850-4726-b743-83adbca06bcf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1293 microversion: 2.25 time: 0.447627 Aug 04 17:02:12.470534 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 975/1887] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:12 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1293 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:12.470769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5624013-2aba-468d-86fe-4a35f409bf4e tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:12.470769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5624013-2aba-468d-86fe-4a35f409bf4e tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:12.470978 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-98a7fb76-e599-437d-a8cf-ff455db95523 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5afe69d0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:12.471087 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5624013-2aba-468d-86fe-4a35f409bf4e tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:12.471087 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5624013-2aba-468d-86fe-4a35f409bf4e tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:12.471087 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5624013-2aba-468d-86fe-4a35f409bf4e tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:12.526041 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-98a7fb76-e599-437d-a8cf-ff455db95523 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c" status: 200 len: 1423 microversion: 2.1 time: 0.066899 Aug 04 17:02:12.530353 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 976/1888] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:12 2022] GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c => generated 1423 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:12.544429 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8ec1ce08-23bf-4e47-9d2d-fdf22cb4762b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:12.545159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8ec1ce08-23bf-4e47-9d2d-fdf22cb4762b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:12.562170 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ec1ce08-23bf-4e47-9d2d-fdf22cb4762b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:12.563090 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ec1ce08-23bf-4e47-9d2d-fdf22cb4762b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:12.563090 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ec1ce08-23bf-4e47-9d2d-fdf22cb4762b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:12.564260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ec1ce08-23bf-4e47-9d2d-fdf22cb4762b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:12.564260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ec1ce08-23bf-4e47-9d2d-fdf22cb4762b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:12.564787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ec1ce08-23bf-4e47-9d2d-fdf22cb4762b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:12.615292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:12.825813 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f5624013-2aba-468d-86fe-4a35f409bf4e tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdd0a24d62e4db4bec3ab39f7cf28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d40b6141974bbea220bf71f61a3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:12.840770 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f5624013-2aba-468d-86fe-4a35f409bf4e tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] 10.222.0.93 "GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c" status: 200 len: 1477 microversion: 2.1 time: 0.416823 Aug 04 17:02:12.841581 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 913/1889] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:12 2022] GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c => generated 1477 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:12.846283 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-384dc9b3-c2f6-4392-9881-1b2af3d874a1 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:12.846916 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-384dc9b3-c2f6-4392-9881-1b2af3d874a1 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] [instance: 089f712b-e824-4446-901d-705650fe676a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:12.861821 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-384dc9b3-c2f6-4392-9881-1b2af3d874a1 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:12.862363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-384dc9b3-c2f6-4392-9881-1b2af3d874a1 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:12.862854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-384dc9b3-c2f6-4392-9881-1b2af3d874a1 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:12.863578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-384dc9b3-c2f6-4392-9881-1b2af3d874a1 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:12.864046 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-384dc9b3-c2f6-4392-9881-1b2af3d874a1 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:12.864532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-384dc9b3-c2f6-4392-9881-1b2af3d874a1 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:12.895076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8ec1ce08-23bf-4e47-9d2d-fdf22cb4762b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:12.904879 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8ec1ce08-23bf-4e47-9d2d-fdf22cb4762b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1392 microversion: 2.1 time: 0.366006 Aug 04 17:02:12.905682 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 977/1890] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:12 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1392 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:13.065418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-384dc9b3-c2f6-4392-9881-1b2af3d874a1 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b03ee3b42b48c5b792ec0325d8a90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e33cbcf48f488683098ef75bd5b25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:13.076353 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-384dc9b3-c2f6-4392-9881-1b2af3d874a1 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] 10.222.0.93 "GET /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a" status: 200 len: 1315 microversion: 2.1 time: 0.233707 Aug 04 17:02:13.079879 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 914/1891] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:12 2022] GET /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:13.142583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a392ac7a-f332-4233-9ead-ac886e88e89a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:13.144649 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a392ac7a-f332-4233-9ead-ac886e88e89a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:13.151594 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a392ac7a-f332-4233-9ead-ac886e88e89a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:13.152493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a392ac7a-f332-4233-9ead-ac886e88e89a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:13.153207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a392ac7a-f332-4233-9ead-ac886e88e89a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:13.154314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a392ac7a-f332-4233-9ead-ac886e88e89a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:13.154870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a392ac7a-f332-4233-9ead-ac886e88e89a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:13.155388 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a392ac7a-f332-4233-9ead-ac886e88e89a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:13.338466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a392ac7a-f332-4233-9ead-ac886e88e89a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:13.352572 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a392ac7a-f332-4233-9ead-ac886e88e89a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1314 microversion: 2.1 time: 0.213260 Aug 04 17:02:13.366089 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 978/1892] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:13 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:13.444976 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b43de601-07d6-4955-aa53-2285910e618b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:13.445613 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b43de601-07d6-4955-aa53-2285910e618b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:13.452604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b43de601-07d6-4955-aa53-2285910e618b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:13.453288 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b43de601-07d6-4955-aa53-2285910e618b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:13.453738 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b43de601-07d6-4955-aa53-2285910e618b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:13.454497 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b43de601-07d6-4955-aa53-2285910e618b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:13.455293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b43de601-07d6-4955-aa53-2285910e618b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:13.455733 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b43de601-07d6-4955-aa53-2285910e618b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:13.615319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b43de601-07d6-4955-aa53-2285910e618b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:13.627729 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b43de601-07d6-4955-aa53-2285910e618b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1259 microversion: 2.1 time: 0.186002 Aug 04 17:02:13.634465 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 915/1893] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:13 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1259 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:13.649533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-82b56933-19f5-4480-9186-c6d0754daa6a tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5bdde700>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:13.764420 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-82b56933-19f5-4480-9186-c6d0754daa6a tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c" status: 200 len: 1423 microversion: 2.1 time: 0.126652 Aug 04 17:02:13.770516 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 916/1894] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:13 2022] GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c => generated 1423 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:13.795680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-528882c0-edc9-42e2-b7fe-d49d42c51613 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:13.796285 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-528882c0-edc9-42e2-b7fe-d49d42c51613 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:13.813320 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-528882c0-edc9-42e2-b7fe-d49d42c51613 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:13.816570 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-528882c0-edc9-42e2-b7fe-d49d42c51613 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:13.817499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-528882c0-edc9-42e2-b7fe-d49d42c51613 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:13.818548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-528882c0-edc9-42e2-b7fe-d49d42c51613 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:13.819028 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-528882c0-edc9-42e2-b7fe-d49d42c51613 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:13.819568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-528882c0-edc9-42e2-b7fe-d49d42c51613 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:13.869242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-761a10d3-9673-49ad-8793-faafa4bb3f0d tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:13.870504 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-761a10d3-9673-49ad-8793-faafa4bb3f0d tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] [instance: 067d9f8b-3067-447e-8017-2e6f5a6c721c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:13.888470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-761a10d3-9673-49ad-8793-faafa4bb3f0d tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:13.889135 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-761a10d3-9673-49ad-8793-faafa4bb3f0d tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:13.889953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-761a10d3-9673-49ad-8793-faafa4bb3f0d tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:13.897169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-761a10d3-9673-49ad-8793-faafa4bb3f0d tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:13.897829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-761a10d3-9673-49ad-8793-faafa4bb3f0d tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:13.899358 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-761a10d3-9673-49ad-8793-faafa4bb3f0d tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:14.152848 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-528882c0-edc9-42e2-b7fe-d49d42c51613 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:14.165358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-528882c0-edc9-42e2-b7fe-d49d42c51613 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:14.169825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-528882c0-edc9-42e2-b7fe-d49d42c51613 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:14.176877 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-528882c0-edc9-42e2-b7fe-d49d42c51613 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1293 microversion: 2.25 time: 0.697968 Aug 04 17:02:14.200939 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 979/1895] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:13 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1293 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:14.208018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ba565260-cc6b-4c27-82f3-ce11b9c6d25c tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:14.212832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ba565260-cc6b-4c27-82f3-ce11b9c6d25c tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:14.228110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba565260-cc6b-4c27-82f3-ce11b9c6d25c tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:14.233004 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba565260-cc6b-4c27-82f3-ce11b9c6d25c tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:14.233743 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba565260-cc6b-4c27-82f3-ce11b9c6d25c tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:14.234811 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba565260-cc6b-4c27-82f3-ce11b9c6d25c tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:14.235484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba565260-cc6b-4c27-82f3-ce11b9c6d25c tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:14.236158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba565260-cc6b-4c27-82f3-ce11b9c6d25c tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:14.241642 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-761a10d3-9673-49ad-8793-faafa4bb3f0d tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdd0a24d62e4db4bec3ab39f7cf28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d40b6141974bbea220bf71f61a3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:14.255910 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-761a10d3-9673-49ad-8793-faafa4bb3f0d tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] 10.222.0.93 "GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c" status: 200 len: 1477 microversion: 2.1 time: 0.393795 Aug 04 17:02:14.257915 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 917/1896] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:13 2022] GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c => generated 1477 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:14.267494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ded4005f-59f2-46e4-8818-7d848d6d0b35 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:14.270293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ded4005f-59f2-46e4-8818-7d848d6d0b35 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] [instance: 089f712b-e824-4446-901d-705650fe676a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:14.283897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ded4005f-59f2-46e4-8818-7d848d6d0b35 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:14.284852 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ded4005f-59f2-46e4-8818-7d848d6d0b35 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:14.285559 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ded4005f-59f2-46e4-8818-7d848d6d0b35 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:14.286590 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ded4005f-59f2-46e4-8818-7d848d6d0b35 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:14.287528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ded4005f-59f2-46e4-8818-7d848d6d0b35 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:14.288630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ded4005f-59f2-46e4-8818-7d848d6d0b35 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:14.544909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ba565260-cc6b-4c27-82f3-ce11b9c6d25c tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:14.560615 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ba565260-cc6b-4c27-82f3-ce11b9c6d25c tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1392 microversion: 2.1 time: 0.357658 Aug 04 17:02:14.567181 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 980/1897] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:14 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1392 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:14.570873 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ded4005f-59f2-46e4-8818-7d848d6d0b35 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b03ee3b42b48c5b792ec0325d8a90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e33cbcf48f488683098ef75bd5b25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:14.581108 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ded4005f-59f2-46e4-8818-7d848d6d0b35 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] 10.222.0.93 "GET /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a" status: 200 len: 1315 microversion: 2.1 time: 0.317421 Aug 04 17:02:14.582203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-e80e2a45-80e4-4d8c-96a3-d11744b35b13 req-a232fd6d-e7f6-481e-b6fb-cd0f56860775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "089f712b-e824-4446-901d-705650fe676a", "name": "network-vif-plugged", "status": "completed", "tag": "e53ebc8f-9b52-466c-89ff-5c6effdd0523"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:14.593009 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 918/1898] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:14 2022] GET /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:14.593009 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-43445fbc-e28c-4092-88e6-0ca83c3b9762 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:14.593009 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-43445fbc-e28c-4092-88e6-0ca83c3b9762 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:14.598440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43445fbc-e28c-4092-88e6-0ca83c3b9762 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:14.598440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43445fbc-e28c-4092-88e6-0ca83c3b9762 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:14.598440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43445fbc-e28c-4092-88e6-0ca83c3b9762 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:14.598440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43445fbc-e28c-4092-88e6-0ca83c3b9762 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:14.599029 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43445fbc-e28c-4092-88e6-0ca83c3b9762 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:14.599522 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43445fbc-e28c-4092-88e6-0ca83c3b9762 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:14.630255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e80e2a45-80e4-4d8c-96a3-d11744b35b13 req-a232fd6d-e7f6-481e-b6fb-cd0f56860775 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:14.631541 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e80e2a45-80e4-4d8c-96a3-d11744b35b13 req-a232fd6d-e7f6-481e-b6fb-cd0f56860775 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:14.632446 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e80e2a45-80e4-4d8c-96a3-d11744b35b13 req-a232fd6d-e7f6-481e-b6fb-cd0f56860775 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:14.656641 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-e80e2a45-80e4-4d8c-96a3-d11744b35b13 req-a232fd6d-e7f6-481e-b6fb-cd0f56860775 service nova] Creating event network-vif-plugged:e53ebc8f-9b52-466c-89ff-5c6effdd0523 for instance 089f712b-e824-4446-901d-705650fe676a on n-h1-851359-3 Aug 04 17:02:14.663870 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-e80e2a45-80e4-4d8c-96a3-d11744b35b13 req-a232fd6d-e7f6-481e-b6fb-cd0f56860775 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094967 Aug 04 17:02:14.664954 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 981/1899] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:14.672376 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-04c520b6-6b7a-47b4-b250-7759fec8d316 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:14.673316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-04c520b6-6b7a-47b4-b250-7759fec8d316 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:14.681586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-04c520b6-6b7a-47b4-b250-7759fec8d316 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:14.682384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-04c520b6-6b7a-47b4-b250-7759fec8d316 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:14.683558 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-04c520b6-6b7a-47b4-b250-7759fec8d316 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:14.684652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-04c520b6-6b7a-47b4-b250-7759fec8d316 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:14.685301 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-04c520b6-6b7a-47b4-b250-7759fec8d316 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:14.686253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-04c520b6-6b7a-47b4-b250-7759fec8d316 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:14.692090 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:14.821662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-04c520b6-6b7a-47b4-b250-7759fec8d316 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:14.840989 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-04c520b6-6b7a-47b4-b250-7759fec8d316 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1265 microversion: 2.1 time: 0.171694 Aug 04 17:02:14.860062 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 982/1900] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:14 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:14.876379 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-932c2f5e-3be3-4499-aa73-fa871bd2d680 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5af98c10>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:14.930035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-43445fbc-e28c-4092-88e6-0ca83c3b9762 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:14.942599 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-43445fbc-e28c-4092-88e6-0ca83c3b9762 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1314 microversion: 2.1 time: 0.358469 Aug 04 17:02:14.958420 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 919/1901] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:14 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:14.974169 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-932c2f5e-3be3-4499-aa73-fa871bd2d680 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c" status: 200 len: 1423 microversion: 2.1 time: 0.111450 Aug 04 17:02:14.976957 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 983/1902] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:14 2022] GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c => generated 1423 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:15.208894 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0949af72-72fe-44e8-9efc-5a68874bcde8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:15.209549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0949af72-72fe-44e8-9efc-5a68874bcde8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:15.227448 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0949af72-72fe-44e8-9efc-5a68874bcde8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:15.227965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0949af72-72fe-44e8-9efc-5a68874bcde8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:15.228416 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0949af72-72fe-44e8-9efc-5a68874bcde8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:15.229571 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0949af72-72fe-44e8-9efc-5a68874bcde8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:15.230260 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0949af72-72fe-44e8-9efc-5a68874bcde8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:15.230699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0949af72-72fe-44e8-9efc-5a68874bcde8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:15.281742 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3fefa368-023f-4703-9b90-1c90a296c224 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:15.283523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3fefa368-023f-4703-9b90-1c90a296c224 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] [instance: 067d9f8b-3067-447e-8017-2e6f5a6c721c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:15.317661 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3fefa368-023f-4703-9b90-1c90a296c224 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:15.318906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3fefa368-023f-4703-9b90-1c90a296c224 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:15.321840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3fefa368-023f-4703-9b90-1c90a296c224 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:15.324968 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3fefa368-023f-4703-9b90-1c90a296c224 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:15.327512 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3fefa368-023f-4703-9b90-1c90a296c224 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:15.328293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3fefa368-023f-4703-9b90-1c90a296c224 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:16.090319 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3fefa368-023f-4703-9b90-1c90a296c224 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdd0a24d62e4db4bec3ab39f7cf28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d40b6141974bbea220bf71f61a3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:16.102449 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3fefa368-023f-4703-9b90-1c90a296c224 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] 10.222.0.93 "GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c" status: 200 len: 1477 microversion: 2.1 time: 0.825186 Aug 04 17:02:16.104382 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 984/1903] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:15 2022] GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c => generated 1477 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:02:16.119643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3d512ba4-f45b-40be-bc94-9a9ffe0a562b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:16.122979 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3d512ba4-f45b-40be-bc94-9a9ffe0a562b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:16.140413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0949af72-72fe-44e8-9efc-5a68874bcde8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:16.153500 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d512ba4-f45b-40be-bc94-9a9ffe0a562b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:16.154397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d512ba4-f45b-40be-bc94-9a9ffe0a562b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:16.157535 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d512ba4-f45b-40be-bc94-9a9ffe0a562b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:16.158553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d512ba4-f45b-40be-bc94-9a9ffe0a562b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:16.159224 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d512ba4-f45b-40be-bc94-9a9ffe0a562b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:16.161381 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d512ba4-f45b-40be-bc94-9a9ffe0a562b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:16.170514 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0949af72-72fe-44e8-9efc-5a68874bcde8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:16.174603 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0949af72-72fe-44e8-9efc-5a68874bcde8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:16.179452 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0949af72-72fe-44e8-9efc-5a68874bcde8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1293 microversion: 2.25 time: 0.973216 Aug 04 17:02:16.202040 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 920/1904] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:15 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1293 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:16.217248 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4cfde9f5-5971-41e4-8602-522975109507 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:16.220223 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4cfde9f5-5971-41e4-8602-522975109507 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] [instance: 089f712b-e824-4446-901d-705650fe676a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:16.235727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4cfde9f5-5971-41e4-8602-522975109507 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:16.236665 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4cfde9f5-5971-41e4-8602-522975109507 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:16.237334 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4cfde9f5-5971-41e4-8602-522975109507 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:16.239263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4cfde9f5-5971-41e4-8602-522975109507 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:16.240106 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4cfde9f5-5971-41e4-8602-522975109507 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:16.240773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4cfde9f5-5971-41e4-8602-522975109507 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:16.919892 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4cfde9f5-5971-41e4-8602-522975109507 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b03ee3b42b48c5b792ec0325d8a90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e33cbcf48f488683098ef75bd5b25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:16.928999 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4cfde9f5-5971-41e4-8602-522975109507 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] 10.222.0.93 "GET /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a" status: 200 len: 1315 microversion: 2.1 time: 0.724009 Aug 04 17:02:16.949175 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 921/1905] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:16 2022] GET /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a => generated 1315 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:16.958785 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3d512ba4-f45b-40be-bc94-9a9ffe0a562b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:16.959352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2384d039-f0c5-4657-9276-1a0d5c986436 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:16.959988 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2384d039-f0c5-4657-9276-1a0d5c986436 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:16.968851 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3d512ba4-f45b-40be-bc94-9a9ffe0a562b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1392 microversion: 2.1 time: 0.861974 Aug 04 17:02:16.974947 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 985/1906] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:16 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1392 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:16.980171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0e22169a-3ea6-4cc5-95ae-42e27bcad552 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:16.981234 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0e22169a-3ea6-4cc5-95ae-42e27bcad552 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:16.988795 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e22169a-3ea6-4cc5-95ae-42e27bcad552 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:16.989319 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e22169a-3ea6-4cc5-95ae-42e27bcad552 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:16.989776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e22169a-3ea6-4cc5-95ae-42e27bcad552 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:16.990975 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e22169a-3ea6-4cc5-95ae-42e27bcad552 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:16.993797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e22169a-3ea6-4cc5-95ae-42e27bcad552 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:16.994793 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e22169a-3ea6-4cc5-95ae-42e27bcad552 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:17.007425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2384d039-f0c5-4657-9276-1a0d5c986436 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:17.016471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2384d039-f0c5-4657-9276-1a0d5c986436 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:17.018303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2384d039-f0c5-4657-9276-1a0d5c986436 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:17.019304 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2384d039-f0c5-4657-9276-1a0d5c986436 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:17.023276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2384d039-f0c5-4657-9276-1a0d5c986436 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:17.023852 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2384d039-f0c5-4657-9276-1a0d5c986436 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:17.387207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0e22169a-3ea6-4cc5-95ae-42e27bcad552 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:17.396727 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0e22169a-3ea6-4cc5-95ae-42e27bcad552 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1500 microversion: 2.1 time: 0.420432 Aug 04 17:02:17.398600 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 986/1907] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:16 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1500 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:17.413919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8b04f0ba-97ec-44d8-90ad-9144cdc9bd4d tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5afd5c10>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:17.483492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2384d039-f0c5-4657-9276-1a0d5c986436 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:17.497118 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8b04f0ba-97ec-44d8-90ad-9144cdc9bd4d tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c" status: 200 len: 1423 microversion: 2.1 time: 0.092048 Aug 04 17:02:17.499998 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 987/1908] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:17 2022] GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c => generated 1423 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:17.509911 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2384d039-f0c5-4657-9276-1a0d5c986436 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1307 microversion: 2.1 time: 0.558326 Aug 04 17:02:17.513229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-e934a7c2-6b77-4ff7-a61a-9bc62388b6eb req-3bf0502d-13f3-413d-8120-e2d874e92e30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "067d9f8b-3067-447e-8017-2e6f5a6c721c", "name": "network-vif-deleted", "tag": "2345ad42-81c5-40bf-98c8-b558e6b6ca1a"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:17.523546 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 922/1909] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:16 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1307 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:17.542171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-733526c3-b748-4efb-ad76-06c123ffcc48 req-2c4e7a19-8cc1-4797-85f4-ef70cafcd96e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aa159af-25ad-4e88-adfd-88736802c68b", "name": "network-vif-deleted", "tag": "0cadd627-9251-4fb3-895b-7cb5c6b41b23"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:17.564311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e934a7c2-6b77-4ff7-a61a-9bc62388b6eb req-3bf0502d-13f3-413d-8120-e2d874e92e30 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:17.565084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e934a7c2-6b77-4ff7-a61a-9bc62388b6eb req-3bf0502d-13f3-413d-8120-e2d874e92e30 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:17.567560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e934a7c2-6b77-4ff7-a61a-9bc62388b6eb req-3bf0502d-13f3-413d-8120-e2d874e92e30 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:17.573434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-733526c3-b748-4efb-ad76-06c123ffcc48 req-2c4e7a19-8cc1-4797-85f4-ef70cafcd96e service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:17.579680 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-733526c3-b748-4efb-ad76-06c123ffcc48 req-2c4e7a19-8cc1-4797-85f4-ef70cafcd96e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:17.580331 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-733526c3-b748-4efb-ad76-06c123ffcc48 req-2c4e7a19-8cc1-4797-85f4-ef70cafcd96e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:17.612240 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-e934a7c2-6b77-4ff7-a61a-9bc62388b6eb req-3bf0502d-13f3-413d-8120-e2d874e92e30 service nova] Creating event network-vif-deleted:2345ad42-81c5-40bf-98c8-b558e6b6ca1a for instance 067d9f8b-3067-447e-8017-2e6f5a6c721c on n-h1-851359-3 Aug 04 17:02:17.620137 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-733526c3-b748-4efb-ad76-06c123ffcc48 req-2c4e7a19-8cc1-4797-85f4-ef70cafcd96e service nova] Creating event network-vif-deleted:0cadd627-9251-4fb3-895b-7cb5c6b41b23 for instance 0aa159af-25ad-4e88-adfd-88736802c68b on n-h1-851359-3 Aug 04 17:02:17.629923 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-e934a7c2-6b77-4ff7-a61a-9bc62388b6eb req-3bf0502d-13f3-413d-8120-e2d874e92e30 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126946 Aug 04 17:02:17.633526 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 988/1910] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:17.641051 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-733526c3-b748-4efb-ad76-06c123ffcc48 req-2c4e7a19-8cc1-4797-85f4-ef70cafcd96e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114099 Aug 04 17:02:17.644472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f7b89a94-c193-42ae-8d2b-cccb88d45068 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:17.645516 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f7b89a94-c193-42ae-8d2b-cccb88d45068 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] [instance: 067d9f8b-3067-447e-8017-2e6f5a6c721c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:17.647404 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 923/1911] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:17.654318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a28c05fa-35f4-4551-90b9-8237ce16c461 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:17.654610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7b89a94-c193-42ae-8d2b-cccb88d45068 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:17.655549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7b89a94-c193-42ae-8d2b-cccb88d45068 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:17.656372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7b89a94-c193-42ae-8d2b-cccb88d45068 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:17.657410 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a28c05fa-35f4-4551-90b9-8237ce16c461 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:17.658083 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7b89a94-c193-42ae-8d2b-cccb88d45068 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:17.658782 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7b89a94-c193-42ae-8d2b-cccb88d45068 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:17.660342 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7b89a94-c193-42ae-8d2b-cccb88d45068 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:17.673862 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a28c05fa-35f4-4551-90b9-8237ce16c461 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:17.675295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a28c05fa-35f4-4551-90b9-8237ce16c461 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:17.675971 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a28c05fa-35f4-4551-90b9-8237ce16c461 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:17.676883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a28c05fa-35f4-4551-90b9-8237ce16c461 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:17.677526 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a28c05fa-35f4-4551-90b9-8237ce16c461 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:17.678487 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a28c05fa-35f4-4551-90b9-8237ce16c461 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:17.707557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7b89a94-c193-42ae-8d2b-cccb88d45068 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:17.708628 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7b89a94-c193-42ae-8d2b-cccb88d45068 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:17.709619 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7b89a94-c193-42ae-8d2b-cccb88d45068 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:17.711092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-f7b89a94-c193-42ae-8d2b-cccb88d45068 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lazy-loading 'fault' on Instance uuid 067d9f8b-3067-447e-8017-2e6f5a6c721c {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:02:17.813598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f7b89a94-c193-42ae-8d2b-cccb88d45068 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfdd0a24d62e4db4bec3ab39f7cf28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d40b6141974bbea220bf71f61a3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:17.837247 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f7b89a94-c193-42ae-8d2b-cccb88d45068 tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] 10.222.0.93 "GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c" status: 200 len: 1312 microversion: 2.1 time: 0.199523 Aug 04 17:02:17.841500 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 989/1912] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:17 2022] GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c => generated 1312 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:17.855396 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8497a602-c023-4f38-af1b-1bd2af9ab1df tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:17.856553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8497a602-c023-4f38-af1b-1bd2af9ab1df tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:17.875554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8497a602-c023-4f38-af1b-1bd2af9ab1df tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:17.877013 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8497a602-c023-4f38-af1b-1bd2af9ab1df tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:17.879759 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8497a602-c023-4f38-af1b-1bd2af9ab1df tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:17.880709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8497a602-c023-4f38-af1b-1bd2af9ab1df tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:17.881896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8497a602-c023-4f38-af1b-1bd2af9ab1df tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:17.883358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8497a602-c023-4f38-af1b-1bd2af9ab1df tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:17.950206 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-8497a602-c023-4f38-af1b-1bd2af9ab1df tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lazy-loading 'flavor' on Instance uuid 826b896f-e0e0-48e1-a520-b5fade2c374b {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:02:18.072664 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a28c05fa-35f4-4551-90b9-8237ce16c461 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:18.103516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a28c05fa-35f4-4551-90b9-8237ce16c461 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:18.121787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a28c05fa-35f4-4551-90b9-8237ce16c461 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:18.128254 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a28c05fa-35f4-4551-90b9-8237ce16c461 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1293 microversion: 2.25 time: 0.475571 Aug 04 17:02:18.134015 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 924/1913] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:17 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1293 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:18.154470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7e4f4660-ec45-4c73-828c-87d436ad4347 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:18.156870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7e4f4660-ec45-4c73-828c-87d436ad4347 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] [instance: 089f712b-e824-4446-901d-705650fe676a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:18.181391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e4f4660-ec45-4c73-828c-87d436ad4347 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:18.189964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e4f4660-ec45-4c73-828c-87d436ad4347 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:18.190674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e4f4660-ec45-4c73-828c-87d436ad4347 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:18.195173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e4f4660-ec45-4c73-828c-87d436ad4347 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:18.195778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e4f4660-ec45-4c73-828c-87d436ad4347 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:18.196241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e4f4660-ec45-4c73-828c-87d436ad4347 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:18.293441 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:18.431170 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8497a602-c023-4f38-af1b-1bd2af9ab1df tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "POST /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b/action" status: 202 len: 0 microversion: 2.1 time: 0.588018 Aug 04 17:02:18.432490 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 990/1914] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:02:17 2022] POST /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b/action => generated 0 bytes in 590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:02:18.458391 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-71504b29-844d-4b30-9754-941197f37856 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:18.459128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-71504b29-844d-4b30-9754-941197f37856 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:18.467377 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71504b29-844d-4b30-9754-941197f37856 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:18.467877 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71504b29-844d-4b30-9754-941197f37856 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:18.468323 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71504b29-844d-4b30-9754-941197f37856 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:18.469042 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71504b29-844d-4b30-9754-941197f37856 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:18.469507 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71504b29-844d-4b30-9754-941197f37856 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:18.470012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71504b29-844d-4b30-9754-941197f37856 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:18.539453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7e4f4660-ec45-4c73-828c-87d436ad4347 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b03ee3b42b48c5b792ec0325d8a90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e33cbcf48f488683098ef75bd5b25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:18.555723 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7e4f4660-ec45-4c73-828c-87d436ad4347 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] 10.222.0.93 "GET /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a" status: 200 len: 1503 microversion: 2.1 time: 0.420577 Aug 04 17:02:18.559878 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 925/1915] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:18 2022] GET /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a => generated 1503 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:18.568943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-14d933a8-f0a5-446e-a006-5a89d44a0a8d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:18.579207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-14d933a8-f0a5-446e-a006-5a89d44a0a8d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:18.604210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14d933a8-f0a5-446e-a006-5a89d44a0a8d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:18.604729 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14d933a8-f0a5-446e-a006-5a89d44a0a8d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:18.605181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14d933a8-f0a5-446e-a006-5a89d44a0a8d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:18.605928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14d933a8-f0a5-446e-a006-5a89d44a0a8d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:18.606428 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14d933a8-f0a5-446e-a006-5a89d44a0a8d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:18.606864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14d933a8-f0a5-446e-a006-5a89d44a0a8d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:18.763392 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-71504b29-844d-4b30-9754-941197f37856 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:18.775325 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-71504b29-844d-4b30-9754-941197f37856 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1392 microversion: 2.1 time: 0.341081 Aug 04 17:02:18.792702 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 991/1916] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:18 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1392 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:18.797863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e3c5e3ca-ebc9-4008-8d9c-f7cfc801c522 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5af4c1f0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:18.833298 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-14d933a8-f0a5-446e-a006-5a89d44a0a8d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:18.842960 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-14d933a8-f0a5-446e-a006-5a89d44a0a8d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1506 microversion: 2.1 time: 0.280265 Aug 04 17:02:18.843834 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 926/1917] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:18 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1506 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:18.850036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-45b87b0f-b726-4a77-bee0-c8b409bfb292 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:18.850895 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-45b87b0f-b726-4a77-bee0-c8b409bfb292 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:18.864196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45b87b0f-b726-4a77-bee0-c8b409bfb292 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:18.865057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45b87b0f-b726-4a77-bee0-c8b409bfb292 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:18.865701 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45b87b0f-b726-4a77-bee0-c8b409bfb292 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:18.866653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45b87b0f-b726-4a77-bee0-c8b409bfb292 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:18.867354 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45b87b0f-b726-4a77-bee0-c8b409bfb292 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:18.868747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45b87b0f-b726-4a77-bee0-c8b409bfb292 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:18.894895 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e3c5e3ca-ebc9-4008-8d9c-f7cfc801c522 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c" status: 200 len: 1423 microversion: 2.1 time: 0.099587 Aug 04 17:02:18.903291 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 992/1918] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:18 2022] GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c => generated 1423 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:18.908454 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-617a5fd8-4b7b-4708-996b-db3c6bd268d1 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:18.908983 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-617a5fd8-4b7b-4708-996b-db3c6bd268d1 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] [instance: 089f712b-e824-4446-901d-705650fe676a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:18.919083 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-617a5fd8-4b7b-4708-996b-db3c6bd268d1 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:18.919731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-617a5fd8-4b7b-4708-996b-db3c6bd268d1 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:18.920188 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-617a5fd8-4b7b-4708-996b-db3c6bd268d1 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:18.920921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-617a5fd8-4b7b-4708-996b-db3c6bd268d1 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:18.921388 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-617a5fd8-4b7b-4708-996b-db3c6bd268d1 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:18.921825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-617a5fd8-4b7b-4708-996b-db3c6bd268d1 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:18.989106 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-617a5fd8-4b7b-4708-996b-db3c6bd268d1 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] [instance: 089f712b-e824-4446-901d-705650fe676a] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:02:19.109842 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-45b87b0f-b726-4a77-bee0-c8b409bfb292 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:19.121206 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-45b87b0f-b726-4a77-bee0-c8b409bfb292 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1307 microversion: 2.1 time: 0.275899 Aug 04 17:02:19.123503 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 927/1919] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:18 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1307 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:19.129890 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8cbfa6ba-a13d-43e8-a82c-b82cfd85114d tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:19.130969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8cbfa6ba-a13d-43e8-a82c-b82cfd85114d tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] [instance: 067d9f8b-3067-447e-8017-2e6f5a6c721c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:19.139559 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8cbfa6ba-a13d-43e8-a82c-b82cfd85114d tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:19.140214 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8cbfa6ba-a13d-43e8-a82c-b82cfd85114d tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:19.140880 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8cbfa6ba-a13d-43e8-a82c-b82cfd85114d tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:19.141698 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8cbfa6ba-a13d-43e8-a82c-b82cfd85114d tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:19.143153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8cbfa6ba-a13d-43e8-a82c-b82cfd85114d tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:19.144081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8cbfa6ba-a13d-43e8-a82c-b82cfd85114d tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:19.176980 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-8cbfa6ba-a13d-43e8-a82c-b82cfd85114d tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] HTTP exception thrown: Instance 067d9f8b-3067-447e-8017-2e6f5a6c721c could not be found. Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8cbfa6ba-a13d-43e8-a82c-b82cfd85114d tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Request method failure captured: Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c HTTP/1.1 Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_t4Rn4ovQM_Ecys6rhcUPuYwsIxHfSTo5aJ76W7MsZDmXLnJ3meYzJ0qNfkYmjGt4Fd67GNWZUvxYPivSJtZLLx-apMYwldODW2tziS_C4CVwHk9Gpt8i-buFGT7qSiJcpynWs-oB4KGVUzxqNugFX_bS-H69yGk9z2ZFEwXcHpHVI Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 85d40b6141974bbea220bf71f61a3ab2 Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-2113862701 Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/85d40b6141974bbea220bf71f61a3ab2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/85d40b6141974bbea220bf71f61a3ab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_85d40b6141974bbea220bf71f61a3ab2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/85d40b6141974bbea220bf71f61a3ab2"}]}] Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-2113862701 Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 85d40b6141974bbea220bf71f61a3ab2 Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-2113862701 Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServerDiagnosticsNegativeTest-2113862701-project Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: bfdd0a24d62e4db4bec3ab39f7cf28a4 Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-2113862701-project Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 067d9f8b-3067-447e-8017-2e6f5a6c721c could not be found. Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '067d9f8b-3067-447e-8017-2e6f5a6c721c'} Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 067d9f8b-3067-447e-8017-2e6f5a6c721c could not be found. Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 067d9f8b-3067-447e-8017-2e6f5a6c721c could not be found. Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:02:19.179779 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:19.186320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:02:19.186320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:19.186320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:19.186320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:19.186320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:02:19.186320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:02:19.186320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 067d9f8b-3067-447e-8017-2e6f5a6c721c could not be found. Aug 04 17:02:19.186320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:02:19.186320 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8cbfa6ba-a13d-43e8-a82c-b82cfd85114d tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] Returning 404 to user: Instance 067d9f8b-3067-447e-8017-2e6f5a6c721c could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:02:19.186320 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8cbfa6ba-a13d-43e8-a82c-b82cfd85114d tempest-ServerDiagnosticsNegativeTest-2113862701 tempest-ServerDiagnosticsNegativeTest-2113862701-project] 10.222.0.93 "GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c" status: 404 len: 111 microversion: 2.1 time: 0.057333 Aug 04 17:02:19.186320 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 928/1920] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:19 2022] GET /compute/v2.1/servers/067d9f8b-3067-447e-8017-2e6f5a6c721c => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:02:19.191674 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-617a5fd8-4b7b-4708-996b-db3c6bd268d1 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] 10.222.0.93 "DELETE /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a" status: 204 len: 0 microversion: 2.1 time: 0.284781 Aug 04 17:02:19.195126 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 993/1921] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:02:18 2022] DELETE /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:02:19.207469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-261c626a-c2c6-4fc0-b8d3-3b0feff5f0ed tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:19.210461 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-261c626a-c2c6-4fc0-b8d3-3b0feff5f0ed tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:19.216763 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-01907f78-701b-432e-965d-cee45c7f6379 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:19.221799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-01907f78-701b-432e-965d-cee45c7f6379 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] [instance: 089f712b-e824-4446-901d-705650fe676a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:19.225702 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-261c626a-c2c6-4fc0-b8d3-3b0feff5f0ed tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:19.228132 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-261c626a-c2c6-4fc0-b8d3-3b0feff5f0ed tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:19.230910 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-261c626a-c2c6-4fc0-b8d3-3b0feff5f0ed tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:19.232011 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-261c626a-c2c6-4fc0-b8d3-3b0feff5f0ed tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:19.233392 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-261c626a-c2c6-4fc0-b8d3-3b0feff5f0ed tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:19.241053 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-261c626a-c2c6-4fc0-b8d3-3b0feff5f0ed tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:19.248987 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01907f78-701b-432e-965d-cee45c7f6379 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:19.249895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01907f78-701b-432e-965d-cee45c7f6379 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:19.252348 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01907f78-701b-432e-965d-cee45c7f6379 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:19.255387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01907f78-701b-432e-965d-cee45c7f6379 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:19.257244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01907f78-701b-432e-965d-cee45c7f6379 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:19.259532 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01907f78-701b-432e-965d-cee45c7f6379 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:19.564947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-261c626a-c2c6-4fc0-b8d3-3b0feff5f0ed tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:19.580015 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-261c626a-c2c6-4fc0-b8d3-3b0feff5f0ed tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:19.585137 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-261c626a-c2c6-4fc0-b8d3-3b0feff5f0ed tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:19.586707 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-261c626a-c2c6-4fc0-b8d3-3b0feff5f0ed tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1293 microversion: 2.25 time: 0.401612 Aug 04 17:02:19.590985 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 929/1922] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:19 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1293 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:19.631073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-01907f78-701b-432e-965d-cee45c7f6379 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b03ee3b42b48c5b792ec0325d8a90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e33cbcf48f488683098ef75bd5b25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:19.642281 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-01907f78-701b-432e-965d-cee45c7f6379 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] 10.222.0.93 "GET /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a" status: 200 len: 1509 microversion: 2.1 time: 0.442749 Aug 04 17:02:19.643412 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 994/1923] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:19 2022] GET /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a => generated 1509 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:19.664580 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-faae5c65-1138-46f5-82c1-e9b12aae7465 req-381d34a1-56da-4408-bc15-e51a2f8d4da9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99", "tag": "fa729c8c-8604-47fb-b48f-bd564994c960"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:19.677496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-faae5c65-1138-46f5-82c1-e9b12aae7465 req-381d34a1-56da-4408-bc15-e51a2f8d4da9 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:19.678389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-faae5c65-1138-46f5-82c1-e9b12aae7465 req-381d34a1-56da-4408-bc15-e51a2f8d4da9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:19.679179 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-faae5c65-1138-46f5-82c1-e9b12aae7465 req-381d34a1-56da-4408-bc15-e51a2f8d4da9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:19.701836 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-faae5c65-1138-46f5-82c1-e9b12aae7465 req-381d34a1-56da-4408-bc15-e51a2f8d4da9 service nova] Creating event network-changed:fa729c8c-8604-47fb-b48f-bd564994c960 for instance 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 on n-h2-851359-3 Aug 04 17:02:19.719764 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-faae5c65-1138-46f5-82c1-e9b12aae7465 req-381d34a1-56da-4408-bc15-e51a2f8d4da9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059509 Aug 04 17:02:19.720769 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 930/1924] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:19.801208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3ad33343-72db-4c6f-a1d6-fda110be126a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:19.802170 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3ad33343-72db-4c6f-a1d6-fda110be126a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:19.826477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ad33343-72db-4c6f-a1d6-fda110be126a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:19.828320 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ad33343-72db-4c6f-a1d6-fda110be126a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:19.828982 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ad33343-72db-4c6f-a1d6-fda110be126a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:19.830509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ad33343-72db-4c6f-a1d6-fda110be126a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:19.832369 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ad33343-72db-4c6f-a1d6-fda110be126a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:19.833022 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ad33343-72db-4c6f-a1d6-fda110be126a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:19.871322 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fed7b26f-0b6e-4643-9b13-c4547bb901a4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:19.872332 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fed7b26f-0b6e-4643-9b13-c4547bb901a4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:19.886991 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fed7b26f-0b6e-4643-9b13-c4547bb901a4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:19.887777 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fed7b26f-0b6e-4643-9b13-c4547bb901a4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:19.888404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fed7b26f-0b6e-4643-9b13-c4547bb901a4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:19.889502 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fed7b26f-0b6e-4643-9b13-c4547bb901a4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:19.890219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fed7b26f-0b6e-4643-9b13-c4547bb901a4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:19.890893 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fed7b26f-0b6e-4643-9b13-c4547bb901a4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:20.177528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3ad33343-72db-4c6f-a1d6-fda110be126a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:20.200963 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3ad33343-72db-4c6f-a1d6-fda110be126a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1392 microversion: 2.1 time: 0.403447 Aug 04 17:02:20.207375 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fed7b26f-0b6e-4643-9b13-c4547bb901a4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:20.218434 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fed7b26f-0b6e-4643-9b13-c4547bb901a4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1506 microversion: 2.1 time: 0.352710 Aug 04 17:02:20.219769 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 931/1925] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:19 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1506 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:20.220550 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 995/1926] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:19 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1392 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:02:20.226481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ea12fac2-1eba-432f-a4fc-01307d470404 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e6ca115e0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:20.244089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2764ea68-ac2d-4fe8-b952-27ec1644c4d5 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:20.246446 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2764ea68-ac2d-4fe8-b952-27ec1644c4d5 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:20.256051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2764ea68-ac2d-4fe8-b952-27ec1644c4d5 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:20.257024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2764ea68-ac2d-4fe8-b952-27ec1644c4d5 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:20.257957 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2764ea68-ac2d-4fe8-b952-27ec1644c4d5 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:20.259113 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2764ea68-ac2d-4fe8-b952-27ec1644c4d5 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:20.259799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2764ea68-ac2d-4fe8-b952-27ec1644c4d5 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:20.260408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2764ea68-ac2d-4fe8-b952-27ec1644c4d5 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:20.322067 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ea12fac2-1eba-432f-a4fc-01307d470404 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c" status: 200 len: 1423 microversion: 2.1 time: 0.100841 Aug 04 17:02:20.322645 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 932/1927] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:20 2022] GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c => generated 1423 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:20.512552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2764ea68-ac2d-4fe8-b952-27ec1644c4d5 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:20.521854 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2764ea68-ac2d-4fe8-b952-27ec1644c4d5 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1307 microversion: 2.1 time: 0.300119 Aug 04 17:02:20.549235 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 996/1928] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:20 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1307 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:20.618265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-90514dd6-d8fe-465b-aca9-d4d9dd65a7d3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:20.619311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-90514dd6-d8fe-465b-aca9-d4d9dd65a7d3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:20.629577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90514dd6-d8fe-465b-aca9-d4d9dd65a7d3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:20.630382 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90514dd6-d8fe-465b-aca9-d4d9dd65a7d3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:20.631786 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90514dd6-d8fe-465b-aca9-d4d9dd65a7d3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:20.633313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90514dd6-d8fe-465b-aca9-d4d9dd65a7d3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:20.634030 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90514dd6-d8fe-465b-aca9-d4d9dd65a7d3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:20.634694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90514dd6-d8fe-465b-aca9-d4d9dd65a7d3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:20.664433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e2f01301-306b-4197-89f5-fad0d9ed4a61 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:20.665060 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e2f01301-306b-4197-89f5-fad0d9ed4a61 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] [instance: 089f712b-e824-4446-901d-705650fe676a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:20.678227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2f01301-306b-4197-89f5-fad0d9ed4a61 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:20.683425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2f01301-306b-4197-89f5-fad0d9ed4a61 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:20.684130 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2f01301-306b-4197-89f5-fad0d9ed4a61 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:20.685066 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2f01301-306b-4197-89f5-fad0d9ed4a61 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:20.686381 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2f01301-306b-4197-89f5-fad0d9ed4a61 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:20.686994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2f01301-306b-4197-89f5-fad0d9ed4a61 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:20.940447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e2f01301-306b-4197-89f5-fad0d9ed4a61 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b03ee3b42b48c5b792ec0325d8a90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e33cbcf48f488683098ef75bd5b25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:20.950804 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e2f01301-306b-4197-89f5-fad0d9ed4a61 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] 10.222.0.93 "GET /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a" status: 200 len: 1509 microversion: 2.1 time: 0.290921 Aug 04 17:02:20.971407 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 997/1929] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:20 2022] GET /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a => generated 1509 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:21.027693 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-90514dd6-d8fe-465b-aca9-d4d9dd65a7d3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:21.040158 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-90514dd6-d8fe-465b-aca9-d4d9dd65a7d3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:21.042314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-90514dd6-d8fe-465b-aca9-d4d9dd65a7d3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:21.043455 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-90514dd6-d8fe-465b-aca9-d4d9dd65a7d3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1281 microversion: 2.25 time: 0.433079 Aug 04 17:02:21.044011 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 933/1930] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:20 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1281 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:21.228447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-20b61cdd-9811-4bbc-918d-d874b7e5f74a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:21.229893 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-20b61cdd-9811-4bbc-918d-d874b7e5f74a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:21.238360 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20b61cdd-9811-4bbc-918d-d874b7e5f74a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:21.239206 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20b61cdd-9811-4bbc-918d-d874b7e5f74a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:21.239949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20b61cdd-9811-4bbc-918d-d874b7e5f74a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:21.246172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-391f8f02-ddf5-4adc-a78a-db9db629ba8e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:21.247154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-391f8f02-ddf5-4adc-a78a-db9db629ba8e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:21.251962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20b61cdd-9811-4bbc-918d-d874b7e5f74a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:21.254544 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20b61cdd-9811-4bbc-918d-d874b7e5f74a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:21.255469 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20b61cdd-9811-4bbc-918d-d874b7e5f74a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:21.259104 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-391f8f02-ddf5-4adc-a78a-db9db629ba8e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:21.260782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-391f8f02-ddf5-4adc-a78a-db9db629ba8e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:21.261998 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-391f8f02-ddf5-4adc-a78a-db9db629ba8e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:21.266492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-391f8f02-ddf5-4adc-a78a-db9db629ba8e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:21.267862 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-391f8f02-ddf5-4adc-a78a-db9db629ba8e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:21.268316 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-391f8f02-ddf5-4adc-a78a-db9db629ba8e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:21.302348 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:21.621215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-20b61cdd-9811-4bbc-918d-d874b7e5f74a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:21.633511 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-20b61cdd-9811-4bbc-918d-d874b7e5f74a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1392 microversion: 2.1 time: 0.407990 Aug 04 17:02:21.639676 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 998/1931] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:21 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1392 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:21.643029 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-391f8f02-ddf5-4adc-a78a-db9db629ba8e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:21.654398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-53e8568f-1cf5-4c7d-8827-fdde26bbc148 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5afd5ca0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:21.656329 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-391f8f02-ddf5-4adc-a78a-db9db629ba8e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1506 microversion: 2.1 time: 0.414595 Aug 04 17:02:21.657491 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 934/1932] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:21 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1506 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:02:21.666020 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3ebc3622-e36d-4b71-b6f9-741919194496 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:21.667797 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3ebc3622-e36d-4b71-b6f9-741919194496 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:21.676907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ebc3622-e36d-4b71-b6f9-741919194496 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:21.677137 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ebc3622-e36d-4b71-b6f9-741919194496 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:21.678070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ebc3622-e36d-4b71-b6f9-741919194496 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:21.701215 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ebc3622-e36d-4b71-b6f9-741919194496 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:21.702559 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ebc3622-e36d-4b71-b6f9-741919194496 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:21.704006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ebc3622-e36d-4b71-b6f9-741919194496 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:21.745340 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-53e8568f-1cf5-4c7d-8827-fdde26bbc148 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c" status: 200 len: 1423 microversion: 2.1 time: 0.104155 Aug 04 17:02:21.749840 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 999/1933] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:21 2022] GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c => generated 1423 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:21.911179 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3ebc3622-e36d-4b71-b6f9-741919194496 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:21.919909 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3ebc3622-e36d-4b71-b6f9-741919194496 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1307 microversion: 2.1 time: 0.261087 Aug 04 17:02:21.935202 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 935/1934] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:21 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1307 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:21.980854 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d829653a-da5a-42f1-8844-30f666943267 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:21.981489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d829653a-da5a-42f1-8844-30f666943267 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] [instance: 089f712b-e824-4446-901d-705650fe676a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:21.983506 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:21.984648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:21.995574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d829653a-da5a-42f1-8844-30f666943267 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:21.996358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d829653a-da5a-42f1-8844-30f666943267 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:21.996990 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d829653a-da5a-42f1-8844-30f666943267 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:21.997883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d829653a-da5a-42f1-8844-30f666943267 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:21.998395 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d829653a-da5a-42f1-8844-30f666943267 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:21.998837 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d829653a-da5a-42f1-8844-30f666943267 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:22.070233 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-13c00e95-5e0e-4e54-b53c-4cc0af33ebaf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:22.071633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-13c00e95-5e0e-4e54-b53c-4cc0af33ebaf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:22.087957 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13c00e95-5e0e-4e54-b53c-4cc0af33ebaf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:22.090084 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13c00e95-5e0e-4e54-b53c-4cc0af33ebaf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:22.092484 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13c00e95-5e0e-4e54-b53c-4cc0af33ebaf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:22.093406 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13c00e95-5e0e-4e54-b53c-4cc0af33ebaf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:22.095196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13c00e95-5e0e-4e54-b53c-4cc0af33ebaf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:22.096443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13c00e95-5e0e-4e54-b53c-4cc0af33ebaf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:22.252944 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d829653a-da5a-42f1-8844-30f666943267 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b03ee3b42b48c5b792ec0325d8a90f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e33cbcf48f488683098ef75bd5b25b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:22.265539 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d829653a-da5a-42f1-8844-30f666943267 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] 10.222.0.93 "GET /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a" status: 200 len: 1509 microversion: 2.1 time: 0.288526 Aug 04 17:02:22.270862 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1000/1935] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:21 2022] GET /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a => generated 1509 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:22.364932 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-13c00e95-5e0e-4e54-b53c-4cc0af33ebaf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:22.379898 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-13c00e95-5e0e-4e54-b53c-4cc0af33ebaf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:22.382895 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-13c00e95-5e0e-4e54-b53c-4cc0af33ebaf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:22.384303 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-13c00e95-5e0e-4e54-b53c-4cc0af33ebaf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1281 microversion: 2.25 time: 0.319096 Aug 04 17:02:22.385755 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 936/1936] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:22 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1281 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:22.419065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-665dec60-40d8-4091-ad95-ba6cac5b3c14 req-432b1f2d-a33a-44eb-a989-1249fdb2d10f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "089f712b-e824-4446-901d-705650fe676a", "name": "network-vif-deleted", "tag": "e53ebc8f-9b52-466c-89ff-5c6effdd0523"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:22.431464 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-665dec60-40d8-4091-ad95-ba6cac5b3c14 req-432b1f2d-a33a-44eb-a989-1249fdb2d10f service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:22.431967 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-665dec60-40d8-4091-ad95-ba6cac5b3c14 req-432b1f2d-a33a-44eb-a989-1249fdb2d10f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:22.432417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-665dec60-40d8-4091-ad95-ba6cac5b3c14 req-432b1f2d-a33a-44eb-a989-1249fdb2d10f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:22.455497 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-665dec60-40d8-4091-ad95-ba6cac5b3c14 req-432b1f2d-a33a-44eb-a989-1249fdb2d10f service nova] Creating event network-vif-deleted:e53ebc8f-9b52-466c-89ff-5c6effdd0523 for instance 089f712b-e824-4446-901d-705650fe676a on n-h1-851359-3 Aug 04 17:02:22.465334 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-665dec60-40d8-4091-ad95-ba6cac5b3c14 req-432b1f2d-a33a-44eb-a989-1249fdb2d10f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049991 Aug 04 17:02:22.466690 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1001/1937] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:22.513794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=10 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:22.658725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-363ace7e-d364-48e3-bb7d-5807a3d874bf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:22.659500 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-363ace7e-d364-48e3-bb7d-5807a3d874bf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:22.673935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-363ace7e-d364-48e3-bb7d-5807a3d874bf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:22.674845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-363ace7e-d364-48e3-bb7d-5807a3d874bf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:22.675655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-363ace7e-d364-48e3-bb7d-5807a3d874bf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:22.677783 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-363ace7e-d364-48e3-bb7d-5807a3d874bf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:22.679456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-363ace7e-d364-48e3-bb7d-5807a3d874bf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:22.680768 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-363ace7e-d364-48e3-bb7d-5807a3d874bf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:22.700488 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cff0c734-1dc8-455c-a9ce-31e1dc466c2a tempest-ListImageFiltersNegativeTestJSON-1552610695 tempest-ListImageFiltersNegativeTestJSON-1552610695-project] Calling method '.version_select at 0x7f1e6ca18700>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:22.742648 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-cff0c734-1dc8-455c-a9ce-31e1dc466c2a tempest-ListImageFiltersNegativeTestJSON-1552610695 tempest-ListImageFiltersNegativeTestJSON-1552610695-project] HTTP exception thrown: Image not found. Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cff0c734-1dc8-455c-a9ce-31e1dc466c2a tempest-ListImageFiltersNegativeTestJSON-1552610695 tempest-ListImageFiltersNegativeTestJSON-1552610695-project] Request method failure captured: Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/images/07cd2ae3-24f9-432e-83cb-4797c4343de1 HTTP/1.1 Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_uejV_bqcIXRqhcUQB21X2w4iMIF3thHdW9ELjRRBJ-RYHOH-DruqClblGeOB3-SbG3CPN38HYFdBa5mtsCOD8mePjaz5GqOTABJIMAMpLxjHm1gU5Xhcods9r_CoYDRD9j1CWsZ302DnehmIj4BM8Ey6AqmlkfQSETkMZk1oi8k-s Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: f45accd69e204fa68cf12a810b300bda Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1552610695 Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f45accd69e204fa68cf12a810b300bda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f45accd69e204fa68cf12a810b300bda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f45accd69e204fa68cf12a810b300bda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f45accd69e204fa68cf12a810b300bda"}]}] Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1552610695 Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: f45accd69e204fa68cf12a810b300bda Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1552610695 Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ListImageFiltersNegativeTestJSON-1552610695-project Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 8f14f3f30ea74d43b84fd235c78a84de Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1552610695-project Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: exception: Image not found. Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '07cd2ae3-24f9-432e-83cb-4797c4343de1'} Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 07cd2ae3-24f9-432e-83cb-4797c4343de1 Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 17:02:22.746418 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 07cd2ae3-24f9-432e-83cb-4797c4343de1 could not be found. Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 17:02:22.753322 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:02:22.758164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cff0c734-1dc8-455c-a9ce-31e1dc466c2a tempest-ListImageFiltersNegativeTestJSON-1552610695 tempest-ListImageFiltersNegativeTestJSON-1552610695-project] Returning 404 to user: Image not found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:02:22.759451 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cff0c734-1dc8-455c-a9ce-31e1dc466c2a tempest-ListImageFiltersNegativeTestJSON-1552610695 tempest-ListImageFiltersNegativeTestJSON-1552610695-project] 10.222.0.93 "GET /compute/v2.1/images/07cd2ae3-24f9-432e-83cb-4797c4343de1" status: 404 len: 62 microversion: 2.1 time: 0.251399 Aug 04 17:02:22.760066 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 937/1938] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:22 2022] GET /compute/v2.1/images/07cd2ae3-24f9-432e-83cb-4797c4343de1 => generated 62 bytes in 253 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:02:22.768312 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-94fa9407-ba50-4f8d-bab7-97b948803168 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:22.769737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-94fa9407-ba50-4f8d-bab7-97b948803168 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:22.777807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94fa9407-ba50-4f8d-bab7-97b948803168 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:22.778703 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94fa9407-ba50-4f8d-bab7-97b948803168 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:22.779371 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94fa9407-ba50-4f8d-bab7-97b948803168 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:22.780333 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94fa9407-ba50-4f8d-bab7-97b948803168 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:22.781332 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94fa9407-ba50-4f8d-bab7-97b948803168 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:22.781876 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94fa9407-ba50-4f8d-bab7-97b948803168 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:22.948651 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-363ace7e-d364-48e3-bb7d-5807a3d874bf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:22.962434 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-363ace7e-d364-48e3-bb7d-5807a3d874bf tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1392 microversion: 2.1 time: 0.309186 Aug 04 17:02:22.964267 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1002/1939] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:22 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1392 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:22.977895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-db7a7d44-2905-4d25-a672-1b659d0a66b2 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5af66820>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:23.047570 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-94fa9407-ba50-4f8d-bab7-97b948803168 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:23.057680 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-94fa9407-ba50-4f8d-bab7-97b948803168 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1506 microversion: 2.1 time: 0.294338 Aug 04 17:02:23.059019 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-db7a7d44-2905-4d25-a672-1b659d0a66b2 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c" status: 200 len: 1423 microversion: 2.1 time: 0.089167 Aug 04 17:02:23.059322 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 938/1940] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:22 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1506 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:23.059618 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1003/1941] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:22 2022] GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c => generated 1423 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:23.070811 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-11ca1e15-d571-4d7e-83f4-2430aac9a719 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:23.071955 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-11ca1e15-d571-4d7e-83f4-2430aac9a719 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:23.078540 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11ca1e15-d571-4d7e-83f4-2430aac9a719 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:23.079235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11ca1e15-d571-4d7e-83f4-2430aac9a719 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:23.079863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11ca1e15-d571-4d7e-83f4-2430aac9a719 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:23.080744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11ca1e15-d571-4d7e-83f4-2430aac9a719 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:23.082332 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11ca1e15-d571-4d7e-83f4-2430aac9a719 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:23.083059 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11ca1e15-d571-4d7e-83f4-2430aac9a719 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:23.237819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-11ca1e15-d571-4d7e-83f4-2430aac9a719 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:23.256215 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-11ca1e15-d571-4d7e-83f4-2430aac9a719 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1307 microversion: 2.1 time: 0.195310 Aug 04 17:02:23.257137 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 939/1942] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:23 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1307 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:23.287589 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-05c02b3f-5d7e-4e80-b255-fe6aad18a317 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:23.288244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-05c02b3f-5d7e-4e80-b255-fe6aad18a317 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] [instance: 089f712b-e824-4446-901d-705650fe676a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:23.294282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05c02b3f-5d7e-4e80-b255-fe6aad18a317 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:23.294781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05c02b3f-5d7e-4e80-b255-fe6aad18a317 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:23.295224 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05c02b3f-5d7e-4e80-b255-fe6aad18a317 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:23.295931 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05c02b3f-5d7e-4e80-b255-fe6aad18a317 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:23.296394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05c02b3f-5d7e-4e80-b255-fe6aad18a317 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:23.296825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05c02b3f-5d7e-4e80-b255-fe6aad18a317 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:23.311015 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-05c02b3f-5d7e-4e80-b255-fe6aad18a317 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] HTTP exception thrown: Instance 089f712b-e824-4446-901d-705650fe676a could not be found. Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-05c02b3f-5d7e-4e80-b255-fe6aad18a317 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Request method failure captured: Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a HTTP/1.1 Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_uEPmrDj5f8tT0veOOOQcnFYH8to1B-Bf40t52dzySoC67acsXN7bLH5gv0u4Lx1o-1bM-uTlk6kSVpkzfwy25Dz1kPMErEWyltIFlaHKAN2r5D2uaSd1CthzO6lFN3vKa8V7fbfJfnXA-_nIirg7n6t_CiT1VuIu5A1KbRdl4HRQU Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 88e33cbcf48f488683098ef75bd5b25b Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ImagesNegativeTestJSON-1698866429 Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/88e33cbcf48f488683098ef75bd5b25b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/88e33cbcf48f488683098ef75bd5b25b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_88e33cbcf48f488683098ef75bd5b25b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/88e33cbcf48f488683098ef75bd5b25b"}]}] Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ImagesNegativeTestJSON-1698866429 Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 88e33cbcf48f488683098ef75bd5b25b Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1698866429 Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ImagesNegativeTestJSON-1698866429-project Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 52b03ee3b42b48c5b792ec0325d8a90f Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ImagesNegativeTestJSON-1698866429-project Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 089f712b-e824-4446-901d-705650fe676a could not be found. Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '089f712b-e824-4446-901d-705650fe676a'} Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 089f712b-e824-4446-901d-705650fe676a could not be found. Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 089f712b-e824-4446-901d-705650fe676a could not be found. Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:23.312587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.317832 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:23.317832 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:23.317832 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:23.317832 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:02:23.317832 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:02:23.317832 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 089f712b-e824-4446-901d-705650fe676a could not be found. Aug 04 17:02:23.317832 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.317832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-05c02b3f-5d7e-4e80-b255-fe6aad18a317 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Returning 404 to user: Instance 089f712b-e824-4446-901d-705650fe676a could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:02:23.317832 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-05c02b3f-5d7e-4e80-b255-fe6aad18a317 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] 10.222.0.93 "GET /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a" status: 404 len: 111 microversion: 2.1 time: 0.030901 Aug 04 17:02:23.317832 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1004/1943] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:23 2022] GET /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:02:23.323530 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-df081be4-59e7-4cc7-af4a-d65296f857ff tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-731782234", "metadata": {"image_type": "test"}}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:23.326229 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-df081be4-59e7-4cc7-af4a-d65296f857ff tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] [instance: 089f712b-e824-4446-901d-705650fe676a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:23.333138 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df081be4-59e7-4cc7-af4a-d65296f857ff tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:23.333626 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df081be4-59e7-4cc7-af4a-d65296f857ff tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:23.334102 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df081be4-59e7-4cc7-af4a-d65296f857ff tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:23.334793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df081be4-59e7-4cc7-af4a-d65296f857ff tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:23.335249 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df081be4-59e7-4cc7-af4a-d65296f857ff tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:23.335669 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df081be4-59e7-4cc7-af4a-d65296f857ff tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:23.350780 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-df081be4-59e7-4cc7-af4a-d65296f857ff tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] HTTP exception thrown: Instance 089f712b-e824-4446-901d-705650fe676a could not be found. Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-df081be4-59e7-4cc7-af4a-d65296f857ff tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Request method failure captured: Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a/action HTTP/1.1 Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 111 Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_uEPmrDj5f8tT0veOOOQcnFYH8to1B-Bf40t52dzySoC67acsXN7bLH5gv0u4Lx1o-1bM-uTlk6kSVpkzfwy25Dz1kPMErEWyltIFlaHKAN2r5D2uaSd1CthzO6lFN3vKa8V7fbfJfnXA-_nIirg7n6t_CiT1VuIu5A1KbRdl4HRQU Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 88e33cbcf48f488683098ef75bd5b25b Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesNegativeTestJSON-1698866429 Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/88e33cbcf48f488683098ef75bd5b25b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/88e33cbcf48f488683098ef75bd5b25b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_88e33cbcf48f488683098ef75bd5b25b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/88e33cbcf48f488683098ef75bd5b25b"}]}] Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesNegativeTestJSON-1698866429 Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 88e33cbcf48f488683098ef75bd5b25b Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1698866429 Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ImagesNegativeTestJSON-1698866429-project Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 52b03ee3b42b48c5b792ec0325d8a90f Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesNegativeTestJSON-1698866429-project Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-731782234", "metadata": {"image_type": "test"}}} Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 089f712b-e824-4446-901d-705650fe676a could not be found. Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '089f712b-e824-4446-901d-705650fe676a', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-731782234', 'metadata': {'image_type': 'test'}}}} Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 089f712b-e824-4446-901d-705650fe676a could not be found. Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 04 17:02:23.352412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 04 17:02:23.357561 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:02:23.357561 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:02:23.357561 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:02:23.357561 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:02:23.357561 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 089f712b-e824-4446-901d-705650fe676a could not be found. Aug 04 17:02:23.357561 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.357561 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:23.357561 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.357561 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:23.357561 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:23.357561 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:23.357561 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:02:23.357561 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:02:23.357561 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 089f712b-e824-4446-901d-705650fe676a could not be found. Aug 04 17:02:23.357561 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.357561 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-df081be4-59e7-4cc7-af4a-d65296f857ff tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Returning 404 to user: Instance 089f712b-e824-4446-901d-705650fe676a could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:02:23.357561 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-df081be4-59e7-4cc7-af4a-d65296f857ff tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] 10.222.0.93 "POST /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a/action" status: 404 len: 111 microversion: 2.1 time: 0.034243 Aug 04 17:02:23.357561 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 940/1944] 10.222.0.93 () {60 vars in 1279 bytes} [Thu Aug 4 17:02:23 2022] POST /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:02:23.365283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b8d6367b-b04a-4d9b-b024-f9644f544018 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-812613706", "metadata": {"image_type": "test"}}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:23.368484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b8d6367b-b04a-4d9b-b024-f9644f544018 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Failed to fetch instance by id tempest-invalid-188111854 {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 04 17:02:23.368484 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-b8d6367b-b04a-4d9b-b024-f9644f544018 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] HTTP exception thrown: Instance tempest-invalid-188111854 could not be found. Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b8d6367b-b04a-4d9b-b024-f9644f544018 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Request method failure captured: Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers/tempest-invalid-188111854/action HTTP/1.1 Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 111 Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_uEPmrDj5f8tT0veOOOQcnFYH8to1B-Bf40t52dzySoC67acsXN7bLH5gv0u4Lx1o-1bM-uTlk6kSVpkzfwy25Dz1kPMErEWyltIFlaHKAN2r5D2uaSd1CthzO6lFN3vKa8V7fbfJfnXA-_nIirg7n6t_CiT1VuIu5A1KbRdl4HRQU Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 88e33cbcf48f488683098ef75bd5b25b Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ImagesNegativeTestJSON-1698866429 Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/88e33cbcf48f488683098ef75bd5b25b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/88e33cbcf48f488683098ef75bd5b25b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_88e33cbcf48f488683098ef75bd5b25b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/88e33cbcf48f488683098ef75bd5b25b"}]}] Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ImagesNegativeTestJSON-1698866429 Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 88e33cbcf48f488683098ef75bd5b25b Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1698866429 Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ImagesNegativeTestJSON-1698866429-project Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 52b03ee3b42b48c5b792ec0325d8a90f Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ImagesNegativeTestJSON-1698866429-project Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-812613706", "metadata": {"image_type": "test"}}} Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance tempest-invalid-188111854 could not be found. Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'tempest-invalid-188111854', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-812613706', 'metadata': {'image_type': 'test'}}}} Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-188111854 could not be found. Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:02:23.369693 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-188111854 could not be found. Aug 04 17:02:23.379138 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.379138 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:23.379138 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.379138 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:23.379138 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:23.379138 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:23.379138 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:02:23.379138 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:02:23.379138 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-188111854 could not be found. Aug 04 17:02:23.379138 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.379138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b8d6367b-b04a-4d9b-b024-f9644f544018 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Returning 404 to user: Instance tempest-invalid-188111854 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:02:23.379138 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b8d6367b-b04a-4d9b-b024-f9644f544018 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] 10.222.0.93 "POST /compute/v2.1/servers/tempest-invalid-188111854/action" status: 404 len: 100 microversion: 2.1 time: 0.010362 Aug 04 17:02:23.379138 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1005/1945] 10.222.0.93 () {60 vars in 1246 bytes} [Thu Aug 4 17:02:23 2022] POST /compute/v2.1/servers/tempest-invalid-188111854/action => generated 100 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:02:23.383346 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-143b8c55-2831-47e4-8253-86988f128a1e tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-489511721"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:23.385672 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-143b8c55-2831-47e4-8253-86988f128a1e tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 04 17:02:23.386214 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-143b8c55-2831-47e4-8253-86988f128a1e tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-143b8c55-2831-47e4-8253-86988f128a1e tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Request method failure captured: Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 56 Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_uEPmrDj5f8tT0veOOOQcnFYH8to1B-Bf40t52dzySoC67acsXN7bLH5gv0u4Lx1o-1bM-uTlk6kSVpkzfwy25Dz1kPMErEWyltIFlaHKAN2r5D2uaSd1CthzO6lFN3vKa8V7fbfJfnXA-_nIirg7n6t_CiT1VuIu5A1KbRdl4HRQU Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 88e33cbcf48f488683098ef75bd5b25b Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesNegativeTestJSON-1698866429 Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/88e33cbcf48f488683098ef75bd5b25b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/88e33cbcf48f488683098ef75bd5b25b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_88e33cbcf48f488683098ef75bd5b25b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/88e33cbcf48f488683098ef75bd5b25b"}]}] Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesNegativeTestJSON-1698866429 Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 88e33cbcf48f488683098ef75bd5b25b Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1698866429 Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ImagesNegativeTestJSON-1698866429-project Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 52b03ee3b42b48c5b792ec0325d8a90f Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesNegativeTestJSON-1698866429-project Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: {"createImage": {"name": "tempest-test-snap-489511721"}} Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-489511721'}}} Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 17:02:23.387734 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.394630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:23.394630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.394630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:23.394630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:23.394630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:23.394630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:02:23.394630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:02:23.394630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 17:02:23.394630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.394630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-143b8c55-2831-47e4-8253-86988f128a1e tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:02:23.394630 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-143b8c55-2831-47e4-8253-86988f128a1e tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] 10.222.0.93 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.011138 Aug 04 17:02:23.394630 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 941/1946] 10.222.0.93 () {60 vars in 1275 bytes} [Thu Aug 4 17:02:23 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:02:23.400763 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-26ed47b3-eded-431a-bf56-dde3f41df008 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2102341077"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:23.404440 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-26ed47b3-eded-431a-bf56-dde3f41df008 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 04 17:02:23.404951 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-26ed47b3-eded-431a-bf56-dde3f41df008 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-26ed47b3-eded-431a-bf56-dde3f41df008 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Request method failure captured: Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 57 Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_uEPmrDj5f8tT0veOOOQcnFYH8to1B-Bf40t52dzySoC67acsXN7bLH5gv0u4Lx1o-1bM-uTlk6kSVpkzfwy25Dz1kPMErEWyltIFlaHKAN2r5D2uaSd1CthzO6lFN3vKa8V7fbfJfnXA-_nIirg7n6t_CiT1VuIu5A1KbRdl4HRQU Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 88e33cbcf48f488683098ef75bd5b25b Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ImagesNegativeTestJSON-1698866429 Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/88e33cbcf48f488683098ef75bd5b25b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/88e33cbcf48f488683098ef75bd5b25b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_88e33cbcf48f488683098ef75bd5b25b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/88e33cbcf48f488683098ef75bd5b25b"}]}] Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ImagesNegativeTestJSON-1698866429 Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 88e33cbcf48f488683098ef75bd5b25b Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1698866429 Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ImagesNegativeTestJSON-1698866429-project Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 52b03ee3b42b48c5b792ec0325d8a90f Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ImagesNegativeTestJSON-1698866429-project Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: {"createImage": {"name": "tempest-test-snap-2102341077"}} Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-2102341077'}}} Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 17:02:23.406602 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.416094 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:23.416094 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.416094 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:23.416094 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:23.416094 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:23.416094 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:02:23.416094 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:02:23.416094 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 04 17:02:23.416094 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.416094 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-26ed47b3-eded-431a-bf56-dde3f41df008 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:02:23.418242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dd02b26e-3ee8-4f4c-9e44-077df3b673df tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:23.418242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dd02b26e-3ee8-4f4c-9e44-077df3b673df tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:23.418564 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-26ed47b3-eded-431a-bf56-dde3f41df008 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] 10.222.0.93 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.011842 Aug 04 17:02:23.418564 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1006/1947] 10.222.0.93 () {60 vars in 1281 bytes} [Thu Aug 4 17:02:23 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:02:23.420816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-983bd478-8c22-4993-9b12-fbc3caf2bf05 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:23.421467 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-983bd478-8c22-4993-9b12-fbc3caf2bf05 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] [instance: 089f712b-e824-4446-901d-705650fe676a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:23.421620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd02b26e-3ee8-4f4c-9e44-077df3b673df tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:23.422146 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd02b26e-3ee8-4f4c-9e44-077df3b673df tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:23.422593 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd02b26e-3ee8-4f4c-9e44-077df3b673df tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:23.423328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd02b26e-3ee8-4f4c-9e44-077df3b673df tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:23.423764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd02b26e-3ee8-4f4c-9e44-077df3b673df tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:23.424213 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd02b26e-3ee8-4f4c-9e44-077df3b673df tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:23.428697 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-983bd478-8c22-4993-9b12-fbc3caf2bf05 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:23.430382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-983bd478-8c22-4993-9b12-fbc3caf2bf05 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:23.430382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-983bd478-8c22-4993-9b12-fbc3caf2bf05 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:23.430752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-983bd478-8c22-4993-9b12-fbc3caf2bf05 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:23.431120 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-983bd478-8c22-4993-9b12-fbc3caf2bf05 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:23.431621 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-983bd478-8c22-4993-9b12-fbc3caf2bf05 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:23.447465 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-983bd478-8c22-4993-9b12-fbc3caf2bf05 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] HTTP exception thrown: Instance 089f712b-e824-4446-901d-705650fe676a could not be found. Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-983bd478-8c22-4993-9b12-fbc3caf2bf05 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Request method failure captured: Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a HTTP/1.1 Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_uEPmrDj5f8tT0veOOOQcnFYH8to1B-Bf40t52dzySoC67acsXN7bLH5gv0u4Lx1o-1bM-uTlk6kSVpkzfwy25Dz1kPMErEWyltIFlaHKAN2r5D2uaSd1CthzO6lFN3vKa8V7fbfJfnXA-_nIirg7n6t_CiT1VuIu5A1KbRdl4HRQU Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 88e33cbcf48f488683098ef75bd5b25b Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ImagesNegativeTestJSON-1698866429 Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/88e33cbcf48f488683098ef75bd5b25b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/88e33cbcf48f488683098ef75bd5b25b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_88e33cbcf48f488683098ef75bd5b25b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/88e33cbcf48f488683098ef75bd5b25b"}]}] Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ImagesNegativeTestJSON-1698866429 Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 88e33cbcf48f488683098ef75bd5b25b Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1698866429 Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ImagesNegativeTestJSON-1698866429-project Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 52b03ee3b42b48c5b792ec0325d8a90f Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ImagesNegativeTestJSON-1698866429-project Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 089f712b-e824-4446-901d-705650fe676a could not be found. Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '089f712b-e824-4446-901d-705650fe676a'} Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 089f712b-e824-4446-901d-705650fe676a could not be found. Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:02:23.448656 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:02:23.458492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 089f712b-e824-4446-901d-705650fe676a could not be found. Aug 04 17:02:23.458492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.458492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:23.458492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.458492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:23.458492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:23.458492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:23.458492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:02:23.458492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:02:23.458492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 089f712b-e824-4446-901d-705650fe676a could not be found. Aug 04 17:02:23.458492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.458492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-983bd478-8c22-4993-9b12-fbc3caf2bf05 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Returning 404 to user: Instance 089f712b-e824-4446-901d-705650fe676a could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:02:23.458492 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-983bd478-8c22-4993-9b12-fbc3caf2bf05 tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] 10.222.0.93 "DELETE /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a" status: 404 len: 111 microversion: 2.1 time: 0.034364 Aug 04 17:02:23.458492 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1007/1948] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:02:23 2022] DELETE /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:02:23.461470 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c904976c-c668-4f0b-8c45-62a2bd4ab38a tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:23.462268 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c904976c-c668-4f0b-8c45-62a2bd4ab38a tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] [instance: 089f712b-e824-4446-901d-705650fe676a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:23.468301 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c904976c-c668-4f0b-8c45-62a2bd4ab38a tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:23.468807 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c904976c-c668-4f0b-8c45-62a2bd4ab38a tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:23.469232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c904976c-c668-4f0b-8c45-62a2bd4ab38a tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:23.469947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c904976c-c668-4f0b-8c45-62a2bd4ab38a tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:23.473226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c904976c-c668-4f0b-8c45-62a2bd4ab38a tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:23.473226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c904976c-c668-4f0b-8c45-62a2bd4ab38a tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:23.485873 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-c904976c-c668-4f0b-8c45-62a2bd4ab38a tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] HTTP exception thrown: Instance 089f712b-e824-4446-901d-705650fe676a could not be found. Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c904976c-c668-4f0b-8c45-62a2bd4ab38a tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Request method failure captured: Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a HTTP/1.1 Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_uEPmrDj5f8tT0veOOOQcnFYH8to1B-Bf40t52dzySoC67acsXN7bLH5gv0u4Lx1o-1bM-uTlk6kSVpkzfwy25Dz1kPMErEWyltIFlaHKAN2r5D2uaSd1CthzO6lFN3vKa8V7fbfJfnXA-_nIirg7n6t_CiT1VuIu5A1KbRdl4HRQU Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 88e33cbcf48f488683098ef75bd5b25b Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ImagesNegativeTestJSON-1698866429 Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/88e33cbcf48f488683098ef75bd5b25b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/88e33cbcf48f488683098ef75bd5b25b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_88e33cbcf48f488683098ef75bd5b25b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/88e33cbcf48f488683098ef75bd5b25b"}]}] Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ImagesNegativeTestJSON-1698866429 Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 88e33cbcf48f488683098ef75bd5b25b Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1698866429 Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ImagesNegativeTestJSON-1698866429-project Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 52b03ee3b42b48c5b792ec0325d8a90f Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ImagesNegativeTestJSON-1698866429-project Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 089f712b-e824-4446-901d-705650fe676a could not be found. Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '089f712b-e824-4446-901d-705650fe676a'} Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 089f712b-e824-4446-901d-705650fe676a could not be found. Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 089f712b-e824-4446-901d-705650fe676a could not be found. Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:23.488119 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.495103 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:23.495103 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:23.495103 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:23.495103 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:02:23.495103 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:02:23.495103 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 089f712b-e824-4446-901d-705650fe676a could not be found. Aug 04 17:02:23.495103 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:02:23.495103 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c904976c-c668-4f0b-8c45-62a2bd4ab38a tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] Returning 404 to user: Instance 089f712b-e824-4446-901d-705650fe676a could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:02:23.495103 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c904976c-c668-4f0b-8c45-62a2bd4ab38a tempest-ImagesNegativeTestJSON-1698866429 tempest-ImagesNegativeTestJSON-1698866429-project] 10.222.0.93 "GET /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a" status: 404 len: 111 microversion: 2.1 time: 0.033795 Aug 04 17:02:23.495103 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1008/1949] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:23 2022] GET /compute/v2.1/servers/089f712b-e824-4446-901d-705650fe676a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:02:23.706049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dd02b26e-3ee8-4f4c-9e44-077df3b673df tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:23.718227 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dd02b26e-3ee8-4f4c-9e44-077df3b673df tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:23.720270 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dd02b26e-3ee8-4f4c-9e44-077df3b673df tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:23.722018 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dd02b26e-3ee8-4f4c-9e44-077df3b673df tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1281 microversion: 2.25 time: 0.317436 Aug 04 17:02:23.722176 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 942/1950] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:23 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1281 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:02:23.994574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6a9b293e-e4e9-49c7-9acf-f1620424dbe5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:23.995213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6a9b293e-e4e9-49c7-9acf-f1620424dbe5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:24.005608 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a9b293e-e4e9-49c7-9acf-f1620424dbe5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:24.007025 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a9b293e-e4e9-49c7-9acf-f1620424dbe5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:24.008221 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a9b293e-e4e9-49c7-9acf-f1620424dbe5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:24.010560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a9b293e-e4e9-49c7-9acf-f1620424dbe5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:24.011395 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a9b293e-e4e9-49c7-9acf-f1620424dbe5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:24.012171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a9b293e-e4e9-49c7-9acf-f1620424dbe5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:24.078842 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0ec66e03-fc4d-4ce2-9a1f-1d1a331b4a23 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e6ca3e820>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:24.168814 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0ec66e03-fc4d-4ce2-9a1f-1d1a331b4a23 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c" status: 200 len: 1432 microversion: 2.1 time: 0.096461 Aug 04 17:02:24.181135 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 943/1951] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:24 2022] GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c => generated 1432 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:24.193866 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6d29320a-784a-419c-aa02-21d3d6c5a4a7 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:24.197472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6d29320a-784a-419c-aa02-21d3d6c5a4a7 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:24.213232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d29320a-784a-419c-aa02-21d3d6c5a4a7 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:24.214182 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d29320a-784a-419c-aa02-21d3d6c5a4a7 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:24.214994 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d29320a-784a-419c-aa02-21d3d6c5a4a7 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:24.216482 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d29320a-784a-419c-aa02-21d3d6c5a4a7 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:24.217488 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d29320a-784a-419c-aa02-21d3d6c5a4a7 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:24.218136 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d29320a-784a-419c-aa02-21d3d6c5a4a7 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:24.454379 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6a9b293e-e4e9-49c7-9acf-f1620424dbe5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:24.479380 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6a9b293e-e4e9-49c7-9acf-f1620424dbe5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1392 microversion: 2.1 time: 0.491379 Aug 04 17:02:24.480116 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1009/1952] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:23 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1392 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:24.497571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7ef8fd0b-fdca-431b-a3e1-bfae6efe0eaa tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5afcd040>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:24.546763 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7ef8fd0b-fdca-431b-a3e1-bfae6efe0eaa tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c" status: 200 len: 1432 microversion: 2.1 time: 0.063861 Aug 04 17:02:24.555928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6d29320a-784a-419c-aa02-21d3d6c5a4a7 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:24.556826 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1010/1953] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:24 2022] GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c => generated 1432 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:24.560423 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6d29320a-784a-419c-aa02-21d3d6c5a4a7 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1506 microversion: 2.1 time: 0.383284 Aug 04 17:02:24.563113 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5d190f9b-a1dd-4935-a3ae-f28b569f85d1 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:24.563927 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5d190f9b-a1dd-4935-a3ae-f28b569f85d1 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:24.570268 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d190f9b-a1dd-4935-a3ae-f28b569f85d1 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:24.570961 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d190f9b-a1dd-4935-a3ae-f28b569f85d1 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:24.571408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d190f9b-a1dd-4935-a3ae-f28b569f85d1 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:24.572145 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d190f9b-a1dd-4935-a3ae-f28b569f85d1 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:24.572573 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d190f9b-a1dd-4935-a3ae-f28b569f85d1 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:24.573006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d190f9b-a1dd-4935-a3ae-f28b569f85d1 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:24.581337 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 944/1954] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:24 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1506 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:24.587525 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ca6f6992-c1c8-4572-973c-c71059b7ab8c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:24.588385 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ca6f6992-c1c8-4572-973c-c71059b7ab8c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] [instance: c2695555-41cc-4eff-ae6c-9b8d443103bb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:24.596620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca6f6992-c1c8-4572-973c-c71059b7ab8c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:24.598229 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca6f6992-c1c8-4572-973c-c71059b7ab8c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:24.598869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca6f6992-c1c8-4572-973c-c71059b7ab8c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:24.600856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca6f6992-c1c8-4572-973c-c71059b7ab8c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:24.601503 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca6f6992-c1c8-4572-973c-c71059b7ab8c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:24.602212 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca6f6992-c1c8-4572-973c-c71059b7ab8c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:24.895719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5d190f9b-a1dd-4935-a3ae-f28b569f85d1 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:24.908196 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5d190f9b-a1dd-4935-a3ae-f28b569f85d1 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1307 microversion: 2.1 time: 0.348779 Aug 04 17:02:24.917497 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1011/1955] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:24 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1307 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:24.923077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4de6a087-77b2-4098-8de1-8ff45c9f1321 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:24.923700 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4de6a087-77b2-4098-8de1-8ff45c9f1321 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:24.928342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ca6f6992-c1c8-4572-973c-c71059b7ab8c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930211b0112b490bbe9f6a262ccaf819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ca0be197104eaaa8b190117f1c2b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:24.930423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4de6a087-77b2-4098-8de1-8ff45c9f1321 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:24.930924 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4de6a087-77b2-4098-8de1-8ff45c9f1321 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:24.931366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4de6a087-77b2-4098-8de1-8ff45c9f1321 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:24.932254 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4de6a087-77b2-4098-8de1-8ff45c9f1321 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:24.932719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4de6a087-77b2-4098-8de1-8ff45c9f1321 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:24.933403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4de6a087-77b2-4098-8de1-8ff45c9f1321 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:24.939780 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ca6f6992-c1c8-4572-973c-c71059b7ab8c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb" status: 200 len: 1466 microversion: 2.1 time: 0.356877 Aug 04 17:02:24.940720 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 945/1956] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:24 2022] GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb => generated 1466 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:24.961670 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-254565a7-5010-40bf-a8a3-2d2b64874eff tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5bdd8700>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:25.014692 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-254565a7-5010-40bf-a8a3-2d2b64874eff tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/93ebc91d-2d7a-4ab2-b133-dcf9559166d9" status: 200 len: 784 microversion: 2.1 time: 0.056733 Aug 04 17:02:25.015326 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 946/1957] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:24 2022] GET /compute/v2.1/images/93ebc91d-2d7a-4ab2-b133-dcf9559166d9 => generated 784 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:25.031069 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c56f34ea-3151-4727-a006-4ffb5bad4f5f tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:25.040538 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c56f34ea-3151-4727-a006-4ffb5bad4f5f tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012944 Aug 04 17:02:25.041268 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 947/1958] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Aug 4 17:02:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:02:25.054130 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f2c31222-56f9-4693-aee4-445b6d6b37ef tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5bded820>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:25.186747 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4de6a087-77b2-4098-8de1-8ff45c9f1321 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:25.198910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4de6a087-77b2-4098-8de1-8ff45c9f1321 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:25.202921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4de6a087-77b2-4098-8de1-8ff45c9f1321 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:25.204877 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4de6a087-77b2-4098-8de1-8ff45c9f1321 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1281 microversion: 2.25 time: 0.286020 Aug 04 17:02:25.205457 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1012/1959] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:24 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1281 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:25.502315 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-27c87f00-0bb5-4c97-bd6f-c96516413be5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:25.503165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-27c87f00-0bb5-4c97-bd6f-c96516413be5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:25.511295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-27c87f00-0bb5-4c97-bd6f-c96516413be5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:25.511867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-27c87f00-0bb5-4c97-bd6f-c96516413be5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:25.512390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-27c87f00-0bb5-4c97-bd6f-c96516413be5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:25.513188 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-27c87f00-0bb5-4c97-bd6f-c96516413be5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:25.514056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-27c87f00-0bb5-4c97-bd6f-c96516413be5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:25.514313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-27c87f00-0bb5-4c97-bd6f-c96516413be5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:25.787978 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f2c31222-56f9-4693-aee4-445b6d6b37ef tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "DELETE /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c" status: 204 len: 0 microversion: 2.1 time: 0.738425 Aug 04 17:02:25.788712 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 948/1960] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:25 2022] DELETE /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c => generated 0 bytes in 740 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 17:02:25.793411 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-00b6e90a-fef8-42cc-a04e-3b221a0364c7 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:25.794760 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-00b6e90a-fef8-42cc-a04e-3b221a0364c7 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:25.803951 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00b6e90a-fef8-42cc-a04e-3b221a0364c7 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:25.804667 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00b6e90a-fef8-42cc-a04e-3b221a0364c7 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:25.805189 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00b6e90a-fef8-42cc-a04e-3b221a0364c7 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:25.806255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00b6e90a-fef8-42cc-a04e-3b221a0364c7 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:25.806843 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00b6e90a-fef8-42cc-a04e-3b221a0364c7 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:25.807433 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00b6e90a-fef8-42cc-a04e-3b221a0364c7 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:25.980585 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-27c87f00-0bb5-4c97-bd6f-c96516413be5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:25.989265 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-27c87f00-0bb5-4c97-bd6f-c96516413be5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1392 microversion: 2.1 time: 0.492466 Aug 04 17:02:25.989943 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1013/1961] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:25 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1392 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:02:26.007749 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-55357415-ce57-41b3-ba60-32213d917b8c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5af4c040>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:26.029029 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-55357415-ce57-41b3-ba60-32213d917b8c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] HTTP exception thrown: Image not found. Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-55357415-ce57-41b3-ba60-32213d917b8c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Request method failure captured: Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c HTTP/1.1 Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_tmhQ7KcQSfhmWfKCr-IMapgh4OjYV6synQUvbV0IPGXvLM3OnLFPBj32Y-dAUsgAHGX6WKpZdJ3jrN6zFOdGdRleTkney0NAVjYAe7AbxyoR2rdueUg1Heay663GmtLIGrBsWt6KxDt989sQgjeEP1Q_jk_fhH1Xvbavp1t8Q413E Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: d7ca0be197104eaaa8b190117f1c2b53 Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ImagesOneServerTestJSON-2010861375 Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d7ca0be197104eaaa8b190117f1c2b53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d7ca0be197104eaaa8b190117f1c2b53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d7ca0be197104eaaa8b190117f1c2b53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d7ca0be197104eaaa8b190117f1c2b53"}]}] Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ImagesOneServerTestJSON-2010861375 Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: d7ca0be197104eaaa8b190117f1c2b53 Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2010861375 Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ImagesOneServerTestJSON-2010861375-project Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 930211b0112b490bbe9f6a262ccaf819 Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ImagesOneServerTestJSON-2010861375-project Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: exception: Image not found. Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '30258874-ff7e-479f-b295-179fe4b83c6c'} Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 30258874-ff7e-479f-b295-179fe4b83c6c Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 17:02:26.031507 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 30258874-ff7e-479f-b295-179fe4b83c6c could not be found. Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-55357415-ce57-41b3-ba60-32213d917b8c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Returning 404 to user: Image not found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-55357415-ce57-41b3-ba60-32213d917b8c tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c" status: 404 len: 62 microversion: 2.1 time: 0.029862 Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1014/1962] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:25 2022] GET /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-24b65f29-23ff-4757-877e-9a38486bec8e tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:26.042939 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-24b65f29-23ff-4757-877e-9a38486bec8e tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:26.051643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-24b65f29-23ff-4757-877e-9a38486bec8e tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:26.052151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-24b65f29-23ff-4757-877e-9a38486bec8e tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:26.052752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-24b65f29-23ff-4757-877e-9a38486bec8e tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:26.053312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-24b65f29-23ff-4757-877e-9a38486bec8e tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:26.053783 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-24b65f29-23ff-4757-877e-9a38486bec8e tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:26.054267 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-24b65f29-23ff-4757-877e-9a38486bec8e tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:26.198954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-00b6e90a-fef8-42cc-a04e-3b221a0364c7 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:26.206487 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-00b6e90a-fef8-42cc-a04e-3b221a0364c7 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1506 microversion: 2.1 time: 0.416828 Aug 04 17:02:26.207055 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 949/1963] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:25 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1506 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:26.211710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3d81ab8e-9e6d-4511-85c6-9fb1daa720d6 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-601753149"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:26.214126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3d81ab8e-9e6d-4511-85c6-9fb1daa720d6 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] [instance: c2695555-41cc-4eff-ae6c-9b8d443103bb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:26.220120 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d81ab8e-9e6d-4511-85c6-9fb1daa720d6 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:26.220612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d81ab8e-9e6d-4511-85c6-9fb1daa720d6 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:26.221052 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d81ab8e-9e6d-4511-85c6-9fb1daa720d6 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:26.222325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d81ab8e-9e6d-4511-85c6-9fb1daa720d6 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:26.222756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d81ab8e-9e6d-4511-85c6-9fb1daa720d6 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:26.223186 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d81ab8e-9e6d-4511-85c6-9fb1daa720d6 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:26.382292 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-24b65f29-23ff-4757-877e-9a38486bec8e tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:26.398013 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-24b65f29-23ff-4757-877e-9a38486bec8e tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1307 microversion: 2.1 time: 0.363113 Aug 04 17:02:26.400373 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1015/1964] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:26 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1307 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:26.415842 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-61ac8070-a32e-4299-ba9a-efd8c801e7ab tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:26.416528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-61ac8070-a32e-4299-ba9a-efd8c801e7ab tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:26.423547 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61ac8070-a32e-4299-ba9a-efd8c801e7ab tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:26.425366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61ac8070-a32e-4299-ba9a-efd8c801e7ab tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:26.425824 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61ac8070-a32e-4299-ba9a-efd8c801e7ab tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:26.426707 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61ac8070-a32e-4299-ba9a-efd8c801e7ab tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:26.427182 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61ac8070-a32e-4299-ba9a-efd8c801e7ab tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:26.427677 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61ac8070-a32e-4299-ba9a-efd8c801e7ab tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:26.435445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:26.483110 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3d81ab8e-9e6d-4511-85c6-9fb1daa720d6 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "POST /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb/action" status: 202 len: 0 microversion: 2.1 time: 0.274390 Aug 04 17:02:26.484245 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 950/1965] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:02:26 2022] POST /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 17:02:26.498232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-051141b4-bcbc-40f5-b5ca-4693774817c5 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5b3ed820>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:26.558648 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-051141b4-bcbc-40f5-b5ca-4693774817c5 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96" status: 200 len: 1428 microversion: 2.1 time: 0.066315 Aug 04 17:02:26.559997 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 951/1966] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:26 2022] GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96 => generated 1428 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:26.791661 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-61ac8070-a32e-4299-ba9a-efd8c801e7ab tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:26.799772 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-61ac8070-a32e-4299-ba9a-efd8c801e7ab tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:26.802154 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-61ac8070-a32e-4299-ba9a-efd8c801e7ab tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:26.803587 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-61ac8070-a32e-4299-ba9a-efd8c801e7ab tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1281 microversion: 2.25 time: 0.401954 Aug 04 17:02:26.804306 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1016/1967] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:26 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1281 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:27.014691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3486c2b7-eed8-4f64-b3d7-c8eb6a6ff92a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:27.015624 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3486c2b7-eed8-4f64-b3d7-c8eb6a6ff92a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:27.024680 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:27.029126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3486c2b7-eed8-4f64-b3d7-c8eb6a6ff92a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:27.029753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3486c2b7-eed8-4f64-b3d7-c8eb6a6ff92a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:27.035064 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3486c2b7-eed8-4f64-b3d7-c8eb6a6ff92a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:27.035965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3486c2b7-eed8-4f64-b3d7-c8eb6a6ff92a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:27.036537 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3486c2b7-eed8-4f64-b3d7-c8eb6a6ff92a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:27.037070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3486c2b7-eed8-4f64-b3d7-c8eb6a6ff92a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:27.230879 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c02ce018-d496-4f6a-8197-bebdb2ec1e99 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:27.231880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c02ce018-d496-4f6a-8197-bebdb2ec1e99 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:27.245992 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c02ce018-d496-4f6a-8197-bebdb2ec1e99 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:27.248410 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c02ce018-d496-4f6a-8197-bebdb2ec1e99 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:27.249304 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c02ce018-d496-4f6a-8197-bebdb2ec1e99 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:27.250162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c02ce018-d496-4f6a-8197-bebdb2ec1e99 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:27.250868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c02ce018-d496-4f6a-8197-bebdb2ec1e99 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:27.251523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c02ce018-d496-4f6a-8197-bebdb2ec1e99 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:27.472954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3486c2b7-eed8-4f64-b3d7-c8eb6a6ff92a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:27.489358 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3486c2b7-eed8-4f64-b3d7-c8eb6a6ff92a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1392 microversion: 2.1 time: 0.478983 Aug 04 17:02:27.491172 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 952/1968] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:27 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1392 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:27.505165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f119e165-be1d-4192-994b-a4c10a6e0bda tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:27.505837 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f119e165-be1d-4192-994b-a4c10a6e0bda tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:27.520333 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f119e165-be1d-4192-994b-a4c10a6e0bda tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:27.520827 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f119e165-be1d-4192-994b-a4c10a6e0bda tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:27.521281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f119e165-be1d-4192-994b-a4c10a6e0bda tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:27.526721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f119e165-be1d-4192-994b-a4c10a6e0bda tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:27.529281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f119e165-be1d-4192-994b-a4c10a6e0bda tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:27.529755 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f119e165-be1d-4192-994b-a4c10a6e0bda tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:27.795544 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c02ce018-d496-4f6a-8197-bebdb2ec1e99 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:27.810773 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c02ce018-d496-4f6a-8197-bebdb2ec1e99 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1506 microversion: 2.1 time: 0.585729 Aug 04 17:02:27.811361 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1017/1969] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:27 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1506 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:27.821250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-091e1e8d-f3d8-4c74-9050-831b37d071dc tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5b017af0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:27.903235 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-091e1e8d-f3d8-4c74-9050-831b37d071dc tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96" status: 200 len: 1428 microversion: 2.1 time: 0.090796 Aug 04 17:02:27.904102 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1018/1970] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:27 2022] GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96 => generated 1428 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:27.910378 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6e6d6ae6-73da-4f76-bd1e-a08a24d82518 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:27.912531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6e6d6ae6-73da-4f76-bd1e-a08a24d82518 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:27.924516 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6e6d6ae6-73da-4f76-bd1e-a08a24d82518 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:27.925454 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6e6d6ae6-73da-4f76-bd1e-a08a24d82518 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:27.929059 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6e6d6ae6-73da-4f76-bd1e-a08a24d82518 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:27.931070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6e6d6ae6-73da-4f76-bd1e-a08a24d82518 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:27.932298 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6e6d6ae6-73da-4f76-bd1e-a08a24d82518 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:27.933584 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6e6d6ae6-73da-4f76-bd1e-a08a24d82518 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:27.950108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f119e165-be1d-4192-994b-a4c10a6e0bda tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:27.959731 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f119e165-be1d-4192-994b-a4c10a6e0bda tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1307 microversion: 2.1 time: 0.467334 Aug 04 17:02:27.966017 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 953/1971] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:27 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1307 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:28.362215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6e6d6ae6-73da-4f76-bd1e-a08a24d82518 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:28.380855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6e6d6ae6-73da-4f76-bd1e-a08a24d82518 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:28.388342 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6e6d6ae6-73da-4f76-bd1e-a08a24d82518 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:28.392038 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6e6d6ae6-73da-4f76-bd1e-a08a24d82518 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1281 microversion: 2.25 time: 0.486477 Aug 04 17:02:28.394936 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1019/1972] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:27 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1281 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:28.515927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4c8d367f-bbad-4642-ba36-5cf03342da33 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:28.517167 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4c8d367f-bbad-4642-ba36-5cf03342da33 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:28.525935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c8d367f-bbad-4642-ba36-5cf03342da33 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:28.526788 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c8d367f-bbad-4642-ba36-5cf03342da33 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:28.527235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c8d367f-bbad-4642-ba36-5cf03342da33 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:28.527967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c8d367f-bbad-4642-ba36-5cf03342da33 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:28.528434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c8d367f-bbad-4642-ba36-5cf03342da33 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:28.530941 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c8d367f-bbad-4642-ba36-5cf03342da33 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:28.553546 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-61cd5356-5237-4b6b-a510-8fd4a0862673 req-dd01c9cd-9e86-4774-9df0-34bbf12cc322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99", "name": "network-vif-plugged", "status": "completed", "tag": "fa729c8c-8604-47fb-b48f-bd564994c960"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:28.576880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-61cd5356-5237-4b6b-a510-8fd4a0862673 req-dd01c9cd-9e86-4774-9df0-34bbf12cc322 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:28.577550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-61cd5356-5237-4b6b-a510-8fd4a0862673 req-dd01c9cd-9e86-4774-9df0-34bbf12cc322 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:28.578176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-61cd5356-5237-4b6b-a510-8fd4a0862673 req-dd01c9cd-9e86-4774-9df0-34bbf12cc322 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:28.606064 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-61cd5356-5237-4b6b-a510-8fd4a0862673 req-dd01c9cd-9e86-4774-9df0-34bbf12cc322 service nova] Creating event network-vif-plugged:fa729c8c-8604-47fb-b48f-bd564994c960 for instance 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 on n-h2-851359-3 Aug 04 17:02:28.618944 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-61cd5356-5237-4b6b-a510-8fd4a0862673 req-dd01c9cd-9e86-4774-9df0-34bbf12cc322 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071444 Aug 04 17:02:28.619972 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1020/1973] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:28.849253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-71aee4bf-a505-4555-ae2d-e464b97f1992 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:28.850761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-71aee4bf-a505-4555-ae2d-e464b97f1992 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:28.862082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71aee4bf-a505-4555-ae2d-e464b97f1992 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:28.877127 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71aee4bf-a505-4555-ae2d-e464b97f1992 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:28.881632 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71aee4bf-a505-4555-ae2d-e464b97f1992 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:28.882796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71aee4bf-a505-4555-ae2d-e464b97f1992 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:28.885353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71aee4bf-a505-4555-ae2d-e464b97f1992 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:28.885915 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71aee4bf-a505-4555-ae2d-e464b97f1992 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:29.311627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4c8d367f-bbad-4642-ba36-5cf03342da33 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:29.326077 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4c8d367f-bbad-4642-ba36-5cf03342da33 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1392 microversion: 2.1 time: 0.816487 Aug 04 17:02:29.334058 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 954/1974] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:28 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1392 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:29.335162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-71aee4bf-a505-4555-ae2d-e464b97f1992 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:29.347521 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-22b30de7-3277-45f8-9b98-40a0b1590314 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e6c9e7dc0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:29.348663 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-71aee4bf-a505-4555-ae2d-e464b97f1992 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1506 microversion: 2.1 time: 0.507422 Aug 04 17:02:29.349846 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1021/1975] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:28 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1506 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:29.375236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b1ab66e6-5649-40b3-892e-9e082cf678cf tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:29.376681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b1ab66e6-5649-40b3-892e-9e082cf678cf tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:29.395547 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1ab66e6-5649-40b3-892e-9e082cf678cf tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:29.402167 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1ab66e6-5649-40b3-892e-9e082cf678cf tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:29.404902 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1ab66e6-5649-40b3-892e-9e082cf678cf tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:29.417843 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1ab66e6-5649-40b3-892e-9e082cf678cf tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:29.419071 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-22b30de7-3277-45f8-9b98-40a0b1590314 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96" status: 200 len: 1428 microversion: 2.1 time: 0.083855 Aug 04 17:02:29.419651 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 955/1976] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:29 2022] GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96 => generated 1428 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:29.420195 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1ab66e6-5649-40b3-892e-9e082cf678cf tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:29.420731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1ab66e6-5649-40b3-892e-9e082cf678cf tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:29.433590 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6d999936-f482-4cea-b9f7-aa7d67d03fcf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:29.434247 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6d999936-f482-4cea-b9f7-aa7d67d03fcf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:29.449551 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d999936-f482-4cea-b9f7-aa7d67d03fcf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:29.450985 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d999936-f482-4cea-b9f7-aa7d67d03fcf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:29.451749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d999936-f482-4cea-b9f7-aa7d67d03fcf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:29.452772 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d999936-f482-4cea-b9f7-aa7d67d03fcf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:29.453590 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d999936-f482-4cea-b9f7-aa7d67d03fcf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:29.454477 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d999936-f482-4cea-b9f7-aa7d67d03fcf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:29.838697 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b1ab66e6-5649-40b3-892e-9e082cf678cf tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:29.856160 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b1ab66e6-5649-40b3-892e-9e082cf678cf tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1307 microversion: 2.1 time: 0.503882 Aug 04 17:02:29.858834 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1022/1977] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:29 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1307 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:29.867455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6d999936-f482-4cea-b9f7-aa7d67d03fcf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:29.878456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6d999936-f482-4cea-b9f7-aa7d67d03fcf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:29.879912 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6d999936-f482-4cea-b9f7-aa7d67d03fcf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:29.881048 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6d999936-f482-4cea-b9f7-aa7d67d03fcf tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1281 microversion: 2.25 time: 0.453052 Aug 04 17:02:29.881604 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 956/1978] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:29 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1281 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:29.959157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-bca00a7c-20b4-428e-8b57-249258960eba req-e8dffef5-e89a-4f5e-b277-099651f29ded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3", "name": "network-vif-unplugged", "status": "completed", "tag": "67e31e5f-833c-4ef7-a84f-df2439c611ff"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:29.977405 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-bca00a7c-20b4-428e-8b57-249258960eba req-e8dffef5-e89a-4f5e-b277-099651f29ded service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:29.978274 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-bca00a7c-20b4-428e-8b57-249258960eba req-e8dffef5-e89a-4f5e-b277-099651f29ded service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:29.979478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-bca00a7c-20b4-428e-8b57-249258960eba req-e8dffef5-e89a-4f5e-b277-099651f29ded service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:30.006544 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-bca00a7c-20b4-428e-8b57-249258960eba req-e8dffef5-e89a-4f5e-b277-099651f29ded service nova] Creating event network-vif-unplugged:67e31e5f-833c-4ef7-a84f-df2439c611ff for instance 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 on n-h2-851359-3 Aug 04 17:02:30.014819 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-bca00a7c-20b4-428e-8b57-249258960eba req-e8dffef5-e89a-4f5e-b277-099651f29ded service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078891 Aug 04 17:02:30.019495 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1023/1979] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:30.349407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2fed10a3-957b-4e1b-8a0f-8598766463db tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:30.350357 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2fed10a3-957b-4e1b-8a0f-8598766463db tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:30.357618 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fed10a3-957b-4e1b-8a0f-8598766463db tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:30.359174 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fed10a3-957b-4e1b-8a0f-8598766463db tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:30.359918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fed10a3-957b-4e1b-8a0f-8598766463db tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:30.362074 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fed10a3-957b-4e1b-8a0f-8598766463db tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:30.363384 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fed10a3-957b-4e1b-8a0f-8598766463db tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:30.364797 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fed10a3-957b-4e1b-8a0f-8598766463db tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:30.385685 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-977004f2-f7e7-4324-8a8c-394a4eb6216a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:30.386765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-977004f2-f7e7-4324-8a8c-394a4eb6216a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:30.410863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-977004f2-f7e7-4324-8a8c-394a4eb6216a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:30.413311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-977004f2-f7e7-4324-8a8c-394a4eb6216a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:30.417667 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-977004f2-f7e7-4324-8a8c-394a4eb6216a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:30.418943 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-977004f2-f7e7-4324-8a8c-394a4eb6216a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:30.419694 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-977004f2-f7e7-4324-8a8c-394a4eb6216a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:30.420404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-977004f2-f7e7-4324-8a8c-394a4eb6216a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:30.819220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-977004f2-f7e7-4324-8a8c-394a4eb6216a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:30.832906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2fed10a3-957b-4e1b-8a0f-8598766463db tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:30.842964 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2fed10a3-957b-4e1b-8a0f-8598766463db tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1392 microversion: 2.1 time: 0.498732 Aug 04 17:02:30.845565 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-977004f2-f7e7-4324-8a8c-394a4eb6216a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1506 microversion: 2.1 time: 0.472494 Aug 04 17:02:30.846859 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 957/1980] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:30 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1392 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:30.865053 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1024/1981] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:30 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1506 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:02:30.874778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-9bc8272e-0cd8-4b5a-b0d6-1d396f1b6d90 req-5c56874c-875e-45f6-89a5-9d73069b5273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2695555-41cc-4eff-ae6c-9b8d443103bb", "name": "network-vif-unplugged", "status": "completed", "tag": "a400318a-3d22-404a-90ec-54d7d582192d"}, {"server_uuid": "84f56763-a994-4d26-96d4-a6d1ba68566c", "name": "network-vif-plugged", "status": "completed", "tag": "10ad4377-3641-452e-aee7-2170593948a9"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:30.876287 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bf3c5223-3c17-46fd-9660-9482940667aa tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5b41ab80>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:30.895414 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9bc8272e-0cd8-4b5a-b0d6-1d396f1b6d90 req-5c56874c-875e-45f6-89a5-9d73069b5273 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:30.896313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9bc8272e-0cd8-4b5a-b0d6-1d396f1b6d90 req-5c56874c-875e-45f6-89a5-9d73069b5273 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:30.897011 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9bc8272e-0cd8-4b5a-b0d6-1d396f1b6d90 req-5c56874c-875e-45f6-89a5-9d73069b5273 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:30.917411 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-9bc8272e-0cd8-4b5a-b0d6-1d396f1b6d90 req-5c56874c-875e-45f6-89a5-9d73069b5273 service nova] Creating event network-vif-unplugged:a400318a-3d22-404a-90ec-54d7d582192d for instance c2695555-41cc-4eff-ae6c-9b8d443103bb on n-h2-851359-3 Aug 04 17:02:30.923148 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-9bc8272e-0cd8-4b5a-b0d6-1d396f1b6d90 req-5c56874c-875e-45f6-89a5-9d73069b5273 service nova] Creating event network-vif-plugged:10ad4377-3641-452e-aee7-2170593948a9 for instance 84f56763-a994-4d26-96d4-a6d1ba68566c on n-h1-851359-3 Aug 04 17:02:30.946401 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bf3c5223-3c17-46fd-9660-9482940667aa tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96" status: 200 len: 1428 microversion: 2.1 time: 0.082734 Aug 04 17:02:30.947406 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 958/1982] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:30 2022] GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96 => generated 1428 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:30.952191 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2ac7730a-8de8-4d4d-8f1a-e977c9091bd2 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:30.952365 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-9bc8272e-0cd8-4b5a-b0d6-1d396f1b6d90 req-5c56874c-875e-45f6-89a5-9d73069b5273 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.085052 Aug 04 17:02:30.953649 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1025/1983] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:30.954239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2ac7730a-8de8-4d4d-8f1a-e977c9091bd2 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:30.960282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-81814996-7bc0-48e4-b242-f989dd1752f1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:30.961077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ac7730a-8de8-4d4d-8f1a-e977c9091bd2 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:30.961687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ac7730a-8de8-4d4d-8f1a-e977c9091bd2 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:30.962375 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ac7730a-8de8-4d4d-8f1a-e977c9091bd2 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:30.963206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ac7730a-8de8-4d4d-8f1a-e977c9091bd2 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:30.963761 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ac7730a-8de8-4d4d-8f1a-e977c9091bd2 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:30.964724 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ac7730a-8de8-4d4d-8f1a-e977c9091bd2 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:30.965548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-81814996-7bc0-48e4-b242-f989dd1752f1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:30.976403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81814996-7bc0-48e4-b242-f989dd1752f1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:30.976968 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81814996-7bc0-48e4-b242-f989dd1752f1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:30.977514 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81814996-7bc0-48e4-b242-f989dd1752f1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:30.978852 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81814996-7bc0-48e4-b242-f989dd1752f1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:30.979819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81814996-7bc0-48e4-b242-f989dd1752f1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:30.980470 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81814996-7bc0-48e4-b242-f989dd1752f1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:31.301377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2ac7730a-8de8-4d4d-8f1a-e977c9091bd2 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:31.316668 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2ac7730a-8de8-4d4d-8f1a-e977c9091bd2 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1307 microversion: 2.1 time: 0.366683 Aug 04 17:02:31.317562 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 959/1984] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:30 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1307 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:31.344798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-81814996-7bc0-48e4-b242-f989dd1752f1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:31.348820 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:31.355595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-81814996-7bc0-48e4-b242-f989dd1752f1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:31.358435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-81814996-7bc0-48e4-b242-f989dd1752f1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:31.359583 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-81814996-7bc0-48e4-b242-f989dd1752f1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1281 microversion: 2.25 time: 0.404794 Aug 04 17:02:31.360153 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1026/1985] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:30 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1281 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:31.868963 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9d505378-95c0-4154-8dcf-2e67c899b607 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:31.873307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1ccbad7c-6579-4660-be26-4253817565a3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:31.873938 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1ccbad7c-6579-4660-be26-4253817565a3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:31.879629 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9d505378-95c0-4154-8dcf-2e67c899b607 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:31.887181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ccbad7c-6579-4660-be26-4253817565a3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:31.887966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ccbad7c-6579-4660-be26-4253817565a3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:31.888598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ccbad7c-6579-4660-be26-4253817565a3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:31.889509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ccbad7c-6579-4660-be26-4253817565a3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:31.890322 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ccbad7c-6579-4660-be26-4253817565a3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:31.890929 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ccbad7c-6579-4660-be26-4253817565a3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:31.891485 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d505378-95c0-4154-8dcf-2e67c899b607 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:31.892253 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d505378-95c0-4154-8dcf-2e67c899b607 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:31.893255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d505378-95c0-4154-8dcf-2e67c899b607 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:31.894833 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d505378-95c0-4154-8dcf-2e67c899b607 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:31.895549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d505378-95c0-4154-8dcf-2e67c899b607 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:31.896442 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d505378-95c0-4154-8dcf-2e67c899b607 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:32.201320 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1ccbad7c-6579-4660-be26-4253817565a3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:32.216835 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1ccbad7c-6579-4660-be26-4253817565a3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1506 microversion: 2.1 time: 0.352366 Aug 04 17:02:32.230007 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1027/1986] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:31 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1506 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:32.230007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8221216e-75cb-4eaf-9c44-2e4165111732 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5af55280>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:32.244624 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9d505378-95c0-4154-8dcf-2e67c899b607 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:32.252287 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9d505378-95c0-4154-8dcf-2e67c899b607 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1392 microversion: 2.1 time: 0.387137 Aug 04 17:02:32.253299 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 960/1987] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:31 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1392 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:32.269019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-ac058562-9053-46a1-98c1-cb2e62dd2c22 req-e9893bca-054b-4176-9f4a-5edfc6632890 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3", "tag": "67e31e5f-833c-4ef7-a84f-df2439c611ff"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:32.283325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ac058562-9053-46a1-98c1-cb2e62dd2c22 req-e9893bca-054b-4176-9f4a-5edfc6632890 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:32.283801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ac058562-9053-46a1-98c1-cb2e62dd2c22 req-e9893bca-054b-4176-9f4a-5edfc6632890 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:32.292325 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8221216e-75cb-4eaf-9c44-2e4165111732 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96" status: 200 len: 1428 microversion: 2.1 time: 0.073410 Aug 04 17:02:32.293121 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1028/1988] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:32 2022] GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96 => generated 1428 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:32.301258 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ac058562-9053-46a1-98c1-cb2e62dd2c22 req-e9893bca-054b-4176-9f4a-5edfc6632890 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:32.318175 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-ac058562-9053-46a1-98c1-cb2e62dd2c22 req-e9893bca-054b-4176-9f4a-5edfc6632890 service nova] Creating event network-changed:67e31e5f-833c-4ef7-a84f-df2439c611ff for instance 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 on n-h2-851359-3 Aug 04 17:02:32.323573 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-ac058562-9053-46a1-98c1-cb2e62dd2c22 req-e9893bca-054b-4176-9f4a-5edfc6632890 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069051 Aug 04 17:02:32.324673 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 961/1989] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:32.337395 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-75b590d9-0166-4ab1-a08b-2e089345306b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:32.338085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-75b590d9-0166-4ab1-a08b-2e089345306b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:32.340016 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:32.345685 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75b590d9-0166-4ab1-a08b-2e089345306b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:32.346459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75b590d9-0166-4ab1-a08b-2e089345306b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:32.347662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75b590d9-0166-4ab1-a08b-2e089345306b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:32.348694 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75b590d9-0166-4ab1-a08b-2e089345306b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:32.349449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75b590d9-0166-4ab1-a08b-2e089345306b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:32.350152 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75b590d9-0166-4ab1-a08b-2e089345306b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:32.383719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eccbe977-b372-4335-a9ec-24c9483bf817 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:32.384437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eccbe977-b372-4335-a9ec-24c9483bf817 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:32.395454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eccbe977-b372-4335-a9ec-24c9483bf817 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:32.395945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eccbe977-b372-4335-a9ec-24c9483bf817 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:32.396382 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eccbe977-b372-4335-a9ec-24c9483bf817 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:32.397089 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eccbe977-b372-4335-a9ec-24c9483bf817 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:32.402095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eccbe977-b372-4335-a9ec-24c9483bf817 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:32.402842 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eccbe977-b372-4335-a9ec-24c9483bf817 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:32.746736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-75b590d9-0166-4ab1-a08b-2e089345306b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:32.754499 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-75b590d9-0166-4ab1-a08b-2e089345306b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1488 microversion: 2.1 time: 0.421029 Aug 04 17:02:32.755090 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1029/1990] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:32 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1488 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:32.774617 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-097c7b26-ed44-486b-9932-ea68b4fb96c9 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:32.781026 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-097c7b26-ed44-486b-9932-ea68b4fb96c9 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:32.781520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-097c7b26-ed44-486b-9932-ea68b4fb96c9 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:32.781954 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-097c7b26-ed44-486b-9932-ea68b4fb96c9 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:32.836904 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eccbe977-b372-4335-a9ec-24c9483bf817 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:32.845501 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eccbe977-b372-4335-a9ec-24c9483bf817 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:32.848506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eccbe977-b372-4335-a9ec-24c9483bf817 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:32.849937 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eccbe977-b372-4335-a9ec-24c9483bf817 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1281 microversion: 2.25 time: 0.471519 Aug 04 17:02:32.851117 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 962/1991] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:32 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1281 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:32.861914 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-097c7b26-ed44-486b-9932-ea68b4fb96c9 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Going to try to stop instance {{(pid=131043) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 17:02:32.936868 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-097c7b26-ed44-486b-9932-ea68b4fb96c9 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "POST /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99/action" status: 202 len: 0 microversion: 2.1 time: 0.165198 Aug 04 17:02:32.942360 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1030/1992] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:02:32 2022] POST /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 17:02:32.954399 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ca0de86c-5b17-4fcc-ac71-1dc0e4a65f5d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:32.955806 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ca0de86c-5b17-4fcc-ac71-1dc0e4a65f5d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:32.972523 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca0de86c-5b17-4fcc-ac71-1dc0e4a65f5d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:32.973038 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca0de86c-5b17-4fcc-ac71-1dc0e4a65f5d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:32.973489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca0de86c-5b17-4fcc-ac71-1dc0e4a65f5d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:32.982727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca0de86c-5b17-4fcc-ac71-1dc0e4a65f5d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:32.983243 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca0de86c-5b17-4fcc-ac71-1dc0e4a65f5d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:32.983700 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca0de86c-5b17-4fcc-ac71-1dc0e4a65f5d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:33.244252 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a9a9a85c-b6b3-4cb4-bad7-2410bb7ce6b3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:33.246317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a9a9a85c-b6b3-4cb4-bad7-2410bb7ce6b3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:33.274586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a9a9a85c-b6b3-4cb4-bad7-2410bb7ce6b3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:33.275158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a9a9a85c-b6b3-4cb4-bad7-2410bb7ce6b3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:33.275505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a9a9a85c-b6b3-4cb4-bad7-2410bb7ce6b3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:33.276240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a9a9a85c-b6b3-4cb4-bad7-2410bb7ce6b3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:33.276710 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a9a9a85c-b6b3-4cb4-bad7-2410bb7ce6b3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:33.277148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a9a9a85c-b6b3-4cb4-bad7-2410bb7ce6b3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:33.545524 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ca0de86c-5b17-4fcc-ac71-1dc0e4a65f5d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:33.563002 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ca0de86c-5b17-4fcc-ac71-1dc0e4a65f5d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1498 microversion: 2.1 time: 0.617666 Aug 04 17:02:33.565319 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 963/1993] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:32 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1498 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:33.583344 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-525b617f-7680-482d-96bd-bd688a79781d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:33.585315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-525b617f-7680-482d-96bd-bd688a79781d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:33.601703 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-525b617f-7680-482d-96bd-bd688a79781d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:33.603046 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-525b617f-7680-482d-96bd-bd688a79781d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:33.604303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-525b617f-7680-482d-96bd-bd688a79781d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:33.605672 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-525b617f-7680-482d-96bd-bd688a79781d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:33.608130 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-525b617f-7680-482d-96bd-bd688a79781d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:33.609736 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-525b617f-7680-482d-96bd-bd688a79781d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:33.694709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a9a9a85c-b6b3-4cb4-bad7-2410bb7ce6b3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:33.725360 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a9a9a85c-b6b3-4cb4-bad7-2410bb7ce6b3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1506 microversion: 2.1 time: 0.486368 Aug 04 17:02:33.727846 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1031/1994] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:33 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1506 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:02:33.748716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-537b7a15-4d4e-4845-9a9f-b9954dbf4e0f tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5af05ee0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:33.840468 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-537b7a15-4d4e-4845-9a9f-b9954dbf4e0f tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96" status: 200 len: 1428 microversion: 2.1 time: 0.111256 Aug 04 17:02:33.851641 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1032/1995] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:33 2022] GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96 => generated 1428 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:34.021482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ef79e91d-26b6-40c3-b1e3-3698cb608375 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Action: 'create', calling method: .version_select at 0x7f1e5af4cc10>, body: {"keypair": {"name": "tempest-keypair-266859357", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiIdSo1TZzpVMsBrXVuITnMoahdW8bKFn4humv5QJJ7zuloPm+jjkQvGGAlqMYdYNjytAwrJo7vQC8J2+hZZ4AGRBglybcdMm8c2N0c2iKxhBiBFP5EXAhayoL+KicsLw=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:34.068456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-ef79e91d-26b6-40c3-b1e3-3698cb608375 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Getting quotas for project de3f2746c4894fdea00a84678e47f990. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:02:34.074523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-ef79e91d-26b6-40c3-b1e3-3698cb608375 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Getting quotas for user 6fef8a6c8c5e4eab9656d3f86511c7de and project de3f2746c4894fdea00a84678e47f990. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:02:34.122887 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ef79e91d-26b6-40c3-b1e3-3698cb608375 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.269795 Aug 04 17:02:34.124005 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1033/1996] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:02:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:34.130519 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6609bdba-8fe1-41cb-b9eb-4b59e0352aee tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:34.131573 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6609bdba-8fe1-41cb-b9eb-4b59e0352aee tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:34.141012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6609bdba-8fe1-41cb-b9eb-4b59e0352aee tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:34.141862 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6609bdba-8fe1-41cb-b9eb-4b59e0352aee tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:34.143114 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6609bdba-8fe1-41cb-b9eb-4b59e0352aee tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:34.145074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6609bdba-8fe1-41cb-b9eb-4b59e0352aee tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:34.146183 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6609bdba-8fe1-41cb-b9eb-4b59e0352aee tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:34.147026 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6609bdba-8fe1-41cb-b9eb-4b59e0352aee tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:34.379858 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-525b617f-7680-482d-96bd-bd688a79781d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:34.396391 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-525b617f-7680-482d-96bd-bd688a79781d tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1392 microversion: 2.1 time: 0.827396 Aug 04 17:02:34.397305 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 964/1997] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:33 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1392 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:34.411333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6609bdba-8fe1-41cb-b9eb-4b59e0352aee tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:34.412492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dd062d69-ad9a-4e58-b1f0-8bd7e4b36d77 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5b3ed8b0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:34.419709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6609bdba-8fe1-41cb-b9eb-4b59e0352aee tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:34.421226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6609bdba-8fe1-41cb-b9eb-4b59e0352aee tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:34.422523 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6609bdba-8fe1-41cb-b9eb-4b59e0352aee tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1476 microversion: 2.25 time: 0.296443 Aug 04 17:02:34.423455 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1034/1998] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:34 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1476 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:34.455482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2fd61b23-f92e-4a39-b6f1-c50859d213fc tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:34.456850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2fd61b23-f92e-4a39-b6f1-c50859d213fc tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:34.469806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2fd61b23-f92e-4a39-b6f1-c50859d213fc tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:34.470681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2fd61b23-f92e-4a39-b6f1-c50859d213fc tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:34.471361 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2fd61b23-f92e-4a39-b6f1-c50859d213fc tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:34.472384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2fd61b23-f92e-4a39-b6f1-c50859d213fc tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:34.473143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2fd61b23-f92e-4a39-b6f1-c50859d213fc tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:34.473319 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dd062d69-ad9a-4e58-b1f0-8bd7e4b36d77 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/d29c35ea-a363-48ad-a6dc-ec58b8346c74" status: 200 len: 662 microversion: 2.1 time: 0.067400 Aug 04 17:02:34.474107 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2fd61b23-f92e-4a39-b6f1-c50859d213fc tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:34.474381 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 965/1999] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:34 2022] GET /compute/v2.1/images/d29c35ea-a363-48ad-a6dc-ec58b8346c74 => generated 662 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:34.501884 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4ea3e94f-871d-4cef-9159-5e4840b870f6 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e6c9cf8b0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:34.562694 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4ea3e94f-871d-4cef-9159-5e4840b870f6 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/d29c35ea-a363-48ad-a6dc-ec58b8346c74" status: 200 len: 662 microversion: 2.1 time: 0.075694 Aug 04 17:02:34.563260 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 966/2000] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:34 2022] GET /compute/v2.1/images/d29c35ea-a363-48ad-a6dc-ec58b8346c74 => generated 662 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:34.589295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1c46bb06-0198-4b51-b961-5a13c3259ab8 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:34.590462 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1c46bb06-0198-4b51-b961-5a13c3259ab8 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:34.608627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c46bb06-0198-4b51-b961-5a13c3259ab8 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:34.609474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c46bb06-0198-4b51-b961-5a13c3259ab8 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:34.610085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c46bb06-0198-4b51-b961-5a13c3259ab8 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:34.611005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c46bb06-0198-4b51-b961-5a13c3259ab8 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:34.611686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c46bb06-0198-4b51-b961-5a13c3259ab8 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:34.612960 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c46bb06-0198-4b51-b961-5a13c3259ab8 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:34.737810 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-2fd61b23-f92e-4a39-b6f1-c50859d213fc tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lazy-loading 'services' on Instance uuid 84f56763-a994-4d26-96d4-a6d1ba68566c {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:02:34.759991 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2fd61b23-f92e-4a39-b6f1-c50859d213fc tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1969 microversion: 2.25 time: 0.308976 Aug 04 17:02:34.761847 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1035/2001] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:34 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1969 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:02:34.767589 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2e74c4ba-010f-44f5-b44b-8d8cf0c4a2d6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:34.777854 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2e74c4ba-010f-44f5-b44b-8d8cf0c4a2d6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:34.786251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2e74c4ba-010f-44f5-b44b-8d8cf0c4a2d6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:34.786928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2e74c4ba-010f-44f5-b44b-8d8cf0c4a2d6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:34.787505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2e74c4ba-010f-44f5-b44b-8d8cf0c4a2d6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:34.789017 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2e74c4ba-010f-44f5-b44b-8d8cf0c4a2d6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:34.789753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2e74c4ba-010f-44f5-b44b-8d8cf0c4a2d6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:34.790408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2e74c4ba-010f-44f5-b44b-8d8cf0c4a2d6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:34.812152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1c46bb06-0198-4b51-b961-5a13c3259ab8 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:34.826402 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1c46bb06-0198-4b51-b961-5a13c3259ab8 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1498 microversion: 2.1 time: 0.245433 Aug 04 17:02:34.828639 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 967/2002] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:34 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1498 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:34.835512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5d49d4c3-07a5-465a-ad8a-6d736e0742ea tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:34.836940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5d49d4c3-07a5-465a-ad8a-6d736e0742ea tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:34.844257 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d49d4c3-07a5-465a-ad8a-6d736e0742ea tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:34.844988 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d49d4c3-07a5-465a-ad8a-6d736e0742ea tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:34.845739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d49d4c3-07a5-465a-ad8a-6d736e0742ea tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:34.847308 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d49d4c3-07a5-465a-ad8a-6d736e0742ea tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:34.847793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d49d4c3-07a5-465a-ad8a-6d736e0742ea tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:34.848222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d49d4c3-07a5-465a-ad8a-6d736e0742ea tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:35.011871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2e74c4ba-010f-44f5-b44b-8d8cf0c4a2d6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:35.022611 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2e74c4ba-010f-44f5-b44b-8d8cf0c4a2d6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1506 microversion: 2.1 time: 0.259387 Aug 04 17:02:35.024665 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1036/2003] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:34 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1506 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:35.030775 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3295ab8c-396f-4006-b79f-1b6507d8cf88 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5af36c10>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:35.054047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-5d49d4c3-07a5-465a-ad8a-6d736e0742ea tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lazy-loading 'services' on Instance uuid 84f56763-a994-4d26-96d4-a6d1ba68566c {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:02:35.075625 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5d49d4c3-07a5-465a-ad8a-6d736e0742ea tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1969 microversion: 2.25 time: 0.245660 Aug 04 17:02:35.076854 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 968/2004] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:34 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1969 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:35.088243 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3295ab8c-396f-4006-b79f-1b6507d8cf88 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96" status: 200 len: 1428 microversion: 2.1 time: 0.061728 Aug 04 17:02:35.089132 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1037/2005] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:35 2022] GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96 => generated 1428 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:35.100546 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3b1bfa9d-45a9-4234-afc5-05c82abed762 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:35.104001 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:02:35.104001 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 17:02:35.105727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b1bfa9d-45a9-4234-afc5-05c82abed762 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:35.106508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b1bfa9d-45a9-4234-afc5-05c82abed762 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:35.107216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b1bfa9d-45a9-4234-afc5-05c82abed762 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:35.108214 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b1bfa9d-45a9-4234-afc5-05c82abed762 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:35.108867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b1bfa9d-45a9-4234-afc5-05c82abed762 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:35.109645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b1bfa9d-45a9-4234-afc5-05c82abed762 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:35.137893 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3b1bfa9d-45a9-4234-afc5-05c82abed762 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.042097 Aug 04 17:02:35.139239 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 969/2006] 10.222.0.93 () {60 vars in 1217 bytes} [Thu Aug 4 17:02:35 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:02:35.151917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7b7c4200-46c1-4c18-83cd-407a5bad4139 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851359-3", "block_migration": "auto"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:35.154442 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7b7c4200-46c1-4c18-83cd-407a5bad4139 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:35.163483 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b7c4200-46c1-4c18-83cd-407a5bad4139 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:35.163987 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b7c4200-46c1-4c18-83cd-407a5bad4139 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:35.164733 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b7c4200-46c1-4c18-83cd-407a5bad4139 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:35.165832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b7c4200-46c1-4c18-83cd-407a5bad4139 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:35.166451 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b7c4200-46c1-4c18-83cd-407a5bad4139 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:35.166884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b7c4200-46c1-4c18-83cd-407a5bad4139 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:35.201059 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-7b7c4200-46c1-4c18-83cd-407a5bad4139 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lazy-loading 'flavor' on Instance uuid 84f56763-a994-4d26-96d4-a6d1ba68566c {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:02:35.217835 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7b7c4200-46c1-4c18-83cd-407a5bad4139 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Going to try to live migrate instance to n-h2-851359-3 {{(pid=131043) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 17:02:35.426206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e020c3e5-52fe-4c75-b8d2-378b83dae458 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:35.426989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e020c3e5-52fe-4c75-b8d2-378b83dae458 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:35.433930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e020c3e5-52fe-4c75-b8d2-378b83dae458 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:35.434900 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e020c3e5-52fe-4c75-b8d2-378b83dae458 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:35.435606 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e020c3e5-52fe-4c75-b8d2-378b83dae458 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:35.436604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e020c3e5-52fe-4c75-b8d2-378b83dae458 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:35.437287 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e020c3e5-52fe-4c75-b8d2-378b83dae458 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:35.438074 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e020c3e5-52fe-4c75-b8d2-378b83dae458 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:35.599193 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e020c3e5-52fe-4c75-b8d2-378b83dae458 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:35.615073 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e020c3e5-52fe-4c75-b8d2-378b83dae458 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1392 microversion: 2.1 time: 0.198384 Aug 04 17:02:35.616450 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 970/2007] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:35 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1392 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:35.822963 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-682ae639-a442-41fa-ab6b-a0d611d18b20 req-5ff922a0-e61c-4af3-aaf3-7dc89e990e72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2695555-41cc-4eff-ae6c-9b8d443103bb", "name": "network-vif-plugged", "status": "completed", "tag": "a400318a-3d22-404a-90ec-54d7d582192d"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:35.846096 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-682ae639-a442-41fa-ab6b-a0d611d18b20 req-5ff922a0-e61c-4af3-aaf3-7dc89e990e72 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:35.849062 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-682ae639-a442-41fa-ab6b-a0d611d18b20 req-5ff922a0-e61c-4af3-aaf3-7dc89e990e72 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:35.850761 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-682ae639-a442-41fa-ab6b-a0d611d18b20 req-5ff922a0-e61c-4af3-aaf3-7dc89e990e72 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:35.871033 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-682ae639-a442-41fa-ab6b-a0d611d18b20 req-5ff922a0-e61c-4af3-aaf3-7dc89e990e72 service nova] Creating event network-vif-plugged:a400318a-3d22-404a-90ec-54d7d582192d for instance c2695555-41cc-4eff-ae6c-9b8d443103bb on n-h2-851359-3 Aug 04 17:02:35.877513 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-682ae639-a442-41fa-ab6b-a0d611d18b20 req-5ff922a0-e61c-4af3-aaf3-7dc89e990e72 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058526 Aug 04 17:02:35.879754 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 971/2008] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:35.885386 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-736167ef-5ae1-42f1-963c-de7707d9371e tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:35.886325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-736167ef-5ae1-42f1-963c-de7707d9371e tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:35.896572 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-736167ef-5ae1-42f1-963c-de7707d9371e tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:35.898298 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-736167ef-5ae1-42f1-963c-de7707d9371e tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:35.898981 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-736167ef-5ae1-42f1-963c-de7707d9371e tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:35.900328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-736167ef-5ae1-42f1-963c-de7707d9371e tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:35.901424 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-736167ef-5ae1-42f1-963c-de7707d9371e tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:35.902078 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-736167ef-5ae1-42f1-963c-de7707d9371e tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:36.200925 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-736167ef-5ae1-42f1-963c-de7707d9371e tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:36.215869 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-736167ef-5ae1-42f1-963c-de7707d9371e tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1498 microversion: 2.1 time: 0.334630 Aug 04 17:02:36.218503 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 972/2009] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:35 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1498 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:36.235522 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e961fa87-1644-4061-b082-e21ece870593 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:36.236143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e961fa87-1644-4061-b082-e21ece870593 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:36.256686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e961fa87-1644-4061-b082-e21ece870593 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:36.257116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e961fa87-1644-4061-b082-e21ece870593 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:36.257564 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e961fa87-1644-4061-b082-e21ece870593 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:36.258315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e961fa87-1644-4061-b082-e21ece870593 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:36.259004 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e961fa87-1644-4061-b082-e21ece870593 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:36.259672 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e961fa87-1644-4061-b082-e21ece870593 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:36.264710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:36.407314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e961fa87-1644-4061-b082-e21ece870593 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:36.416588 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e961fa87-1644-4061-b082-e21ece870593 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1506 microversion: 2.1 time: 0.195117 Aug 04 17:02:36.417502 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 973/2010] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:36 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1506 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:36.422605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b471271d-48c2-4355-87d8-6f17336e70f3 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e6ca154c0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:36.475997 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b471271d-48c2-4355-87d8-6f17336e70f3 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96" status: 200 len: 1428 microversion: 2.1 time: 0.056445 Aug 04 17:02:36.478179 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 974/2011] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:36 2022] GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96 => generated 1428 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:36.482643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7d0564e9-8230-49a0-aff1-f37fe54d7989 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e6c9cf280>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:36.535806 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7d0564e9-8230-49a0-aff1-f37fe54d7989 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/fe940275-840d-44eb-98a1-27bc7460c23c" status: 200 len: 660 microversion: 2.1 time: 0.057490 Aug 04 17:02:36.544271 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 975/2012] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:36 2022] GET /compute/v2.1/images/fe940275-840d-44eb-98a1-27bc7460c23c => generated 660 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:36.549454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-296595b4-4121-42d9-855a-6c04024e2389 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e6c9cf4c0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:36.622398 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-296595b4-4121-42d9-855a-6c04024e2389 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/fe940275-840d-44eb-98a1-27bc7460c23c" status: 200 len: 660 microversion: 2.1 time: 0.075304 Aug 04 17:02:36.623432 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 976/2013] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:36 2022] GET /compute/v2.1/images/fe940275-840d-44eb-98a1-27bc7460c23c => generated 660 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:36.642245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7cdc6d6c-ca57-4f33-86f1-9523f145df0f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:36.643313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7cdc6d6c-ca57-4f33-86f1-9523f145df0f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:36.651146 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cdc6d6c-ca57-4f33-86f1-9523f145df0f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:36.652025 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cdc6d6c-ca57-4f33-86f1-9523f145df0f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:36.652376 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cdc6d6c-ca57-4f33-86f1-9523f145df0f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:36.656687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cdc6d6c-ca57-4f33-86f1-9523f145df0f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:36.657849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cdc6d6c-ca57-4f33-86f1-9523f145df0f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:36.658428 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cdc6d6c-ca57-4f33-86f1-9523f145df0f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:36.904434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7cdc6d6c-ca57-4f33-86f1-9523f145df0f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:36.918063 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7cdc6d6c-ca57-4f33-86f1-9523f145df0f tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1392 microversion: 2.1 time: 0.280811 Aug 04 17:02:36.919042 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 977/2014] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:36 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1392 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:36.924921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c2171a9c-3887-4955-9e45-5c34dd0ab245 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1462533281", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "810f8db3-28ae-45fa-b7f8-05df027b5bea"}], "security_groups": [{"name": "tempest-securitygroup--2026758408"}], "key_name": "tempest-keypair-266859357", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:37.068042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-c2171a9c-3887-4955-9e45-5c34dd0ab245 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] validate_networks() for [('810f8db3-28ae-45fa-b7f8-05df027b5bea', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:02:37.768116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-c2171a9c-3887-4955-9e45-5c34dd0ab245 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Getting quotas for project de3f2746c4894fdea00a84678e47f990. Resources: dict_keys(['metadata_items']) {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:02:37.775823 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-c2171a9c-3887-4955-9e45-5c34dd0ab245 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Getting quotas for user 6fef8a6c8c5e4eab9656d3f86511c7de and project de3f2746c4894fdea00a84678e47f990. Resources: dict_keys(['metadata_items']) {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:02:37.806107 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-c2171a9c-3887-4955-9e45-5c34dd0ab245 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:02:37.808445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-c2171a9c-3887-4955-9e45-5c34dd0ab245 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:02:37.809609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-c2171a9c-3887-4955-9e45-5c34dd0ab245 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:02:37.810967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-c2171a9c-3887-4955-9e45-5c34dd0ab245 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:02:37.813357 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-c2171a9c-3887-4955-9e45-5c34dd0ab245 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:02:37.851438 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2171a9c-3887-4955-9e45-5c34dd0ab245 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:37.854016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2171a9c-3887-4955-9e45-5c34dd0ab245 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:37.855441 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2171a9c-3887-4955-9e45-5c34dd0ab245 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:37.856265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2171a9c-3887-4955-9e45-5c34dd0ab245 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:37.858970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2171a9c-3887-4955-9e45-5c34dd0ab245 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:37.859567 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2171a9c-3887-4955-9e45-5c34dd0ab245 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:37.903776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-c2171a9c-3887-4955-9e45-5c34dd0ab245 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Getting quotas for project de3f2746c4894fdea00a84678e47f990. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:02:37.911171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-c2171a9c-3887-4955-9e45-5c34dd0ab245 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Getting quotas for user 6fef8a6c8c5e4eab9656d3f86511c7de and project de3f2746c4894fdea00a84678e47f990. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:02:37.936990 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c2171a9c-3887-4955-9e45-5c34dd0ab245 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:02:37.940876 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c2171a9c-3887-4955-9e45-5c34dd0ab245 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] [instance: 28e0f947-b275-48aa-90f0-bc74218c9478] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:02:37.956959 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7b7c4200-46c1-4c18-83cd-407a5bad4139 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c/action" status: 202 len: 0 microversion: 2.25 time: 2.809030 Aug 04 17:02:37.958133 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1038/2015] 10.222.0.93 () {62 vars in 1319 bytes} [Thu Aug 4 17:02:35 2022] POST /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c/action => generated 0 bytes in 2811 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:02:37.963269 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-02c5cea6-a731-4c4e-8eec-cc44f5118e6c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:37.965958 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-02c5cea6-a731-4c4e-8eec-cc44f5118e6c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:37.983954 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02c5cea6-a731-4c4e-8eec-cc44f5118e6c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:37.991321 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02c5cea6-a731-4c4e-8eec-cc44f5118e6c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:37.992159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02c5cea6-a731-4c4e-8eec-cc44f5118e6c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:37.993504 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02c5cea6-a731-4c4e-8eec-cc44f5118e6c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:37.995010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02c5cea6-a731-4c4e-8eec-cc44f5118e6c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:38.006449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02c5cea6-a731-4c4e-8eec-cc44f5118e6c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:38.049213 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c2171a9c-3887-4955-9e45-5c34dd0ab245 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.128702 Aug 04 17:02:38.060677 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 978/2016] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:02:36 2022] POST /compute/v2.1/servers => generated 407 bytes in 1141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:02:38.070405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-315e6b66-dae9-499c-b79a-1bba50cf8cbf tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:38.074721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-315e6b66-dae9-499c-b79a-1bba50cf8cbf tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:38.089858 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-315e6b66-dae9-499c-b79a-1bba50cf8cbf tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:38.090491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-315e6b66-dae9-499c-b79a-1bba50cf8cbf tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:38.091038 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-315e6b66-dae9-499c-b79a-1bba50cf8cbf tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:38.091951 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-315e6b66-dae9-499c-b79a-1bba50cf8cbf tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:38.093023 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-315e6b66-dae9-499c-b79a-1bba50cf8cbf tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:38.093826 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-315e6b66-dae9-499c-b79a-1bba50cf8cbf tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:38.421456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-02c5cea6-a731-4c4e-8eec-cc44f5118e6c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:38.437784 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-02c5cea6-a731-4c4e-8eec-cc44f5118e6c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1498 microversion: 2.1 time: 0.478478 Aug 04 17:02:38.438518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-315e6b66-dae9-499c-b79a-1bba50cf8cbf tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:38.447659 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1039/2017] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:37 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1498 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:38.449391 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-315e6b66-dae9-499c-b79a-1bba50cf8cbf tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1506 microversion: 2.1 time: 0.387357 Aug 04 17:02:38.450099 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 979/2018] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:38 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1506 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:38.470991 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-df615cbf-d4e3-4153-a7c1-7ca2276c73e1 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5aedaa60>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:38.480019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e63b4184-12bb-45c6-aa49-6208e3a63258 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:38.483132 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e63b4184-12bb-45c6-aa49-6208e3a63258 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:38.509053 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e63b4184-12bb-45c6-aa49-6208e3a63258 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:38.509619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e63b4184-12bb-45c6-aa49-6208e3a63258 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:38.510097 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e63b4184-12bb-45c6-aa49-6208e3a63258 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:38.510956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e63b4184-12bb-45c6-aa49-6208e3a63258 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:38.511699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e63b4184-12bb-45c6-aa49-6208e3a63258 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:38.512029 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e63b4184-12bb-45c6-aa49-6208e3a63258 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:38.566277 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-df615cbf-d4e3-4153-a7c1-7ca2276c73e1 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96" status: 200 len: 1428 microversion: 2.1 time: 0.116519 Aug 04 17:02:38.567250 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1040/2019] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:38 2022] GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96 => generated 1428 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:38.573514 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a3b83941-7b88-40f7-af79-d10cbb2d3fc6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:38.574456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a3b83941-7b88-40f7-af79-d10cbb2d3fc6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:38.604496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3b83941-7b88-40f7-af79-d10cbb2d3fc6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:38.607017 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3b83941-7b88-40f7-af79-d10cbb2d3fc6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:38.609072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3b83941-7b88-40f7-af79-d10cbb2d3fc6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:38.618444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3b83941-7b88-40f7-af79-d10cbb2d3fc6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:38.619824 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3b83941-7b88-40f7-af79-d10cbb2d3fc6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:38.620895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3b83941-7b88-40f7-af79-d10cbb2d3fc6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:38.823803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a3b83941-7b88-40f7-af79-d10cbb2d3fc6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:38.843809 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a3b83941-7b88-40f7-af79-d10cbb2d3fc6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:38.846676 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a3b83941-7b88-40f7-af79-d10cbb2d3fc6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:38.848927 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a3b83941-7b88-40f7-af79-d10cbb2d3fc6 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1486 microversion: 2.25 time: 0.280083 Aug 04 17:02:38.849615 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e63b4184-12bb-45c6-aa49-6208e3a63258 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:38.862026 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1041/2020] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:38 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1486 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:38.872270 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e63b4184-12bb-45c6-aa49-6208e3a63258 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1392 microversion: 2.1 time: 0.421035 Aug 04 17:02:38.880588 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 980/2021] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:38 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1392 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:38.884185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c34235fb-2fbe-45f9-8274-69d62201106f tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:38.885048 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c34235fb-2fbe-45f9-8274-69d62201106f tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] [instance: 28e0f947-b275-48aa-90f0-bc74218c9478] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:38.892915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f309ea1c-3345-4cda-b46d-7f110dd86d9c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e6c999280>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:38.912179 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c34235fb-2fbe-45f9-8274-69d62201106f tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:38.913814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c34235fb-2fbe-45f9-8274-69d62201106f tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:38.914488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c34235fb-2fbe-45f9-8274-69d62201106f tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:38.915777 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c34235fb-2fbe-45f9-8274-69d62201106f tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:38.916509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c34235fb-2fbe-45f9-8274-69d62201106f tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:38.917428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c34235fb-2fbe-45f9-8274-69d62201106f tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:38.954740 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f309ea1c-3345-4cda-b46d-7f110dd86d9c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/02bc6af0-ae31-4dbe-9498-dfa200074e7b" status: 200 len: 661 microversion: 2.1 time: 0.072783 Aug 04 17:02:38.963215 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 981/2022] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:38 2022] GET /compute/v2.1/images/02bc6af0-ae31-4dbe-9498-dfa200074e7b => generated 661 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:38.972058 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-77ef338c-c289-49c8-8baa-80aa64929ee7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e6c999a60>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:39.029451 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c34235fb-2fbe-45f9-8274-69d62201106f tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fef8a6c8c5e4eab9656d3f86511c7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3f2746c4894fdea00a84678e47f990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:39.038759 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-77ef338c-c289-49c8-8baa-80aa64929ee7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/02bc6af0-ae31-4dbe-9498-dfa200074e7b" status: 200 len: 661 microversion: 2.1 time: 0.070913 Aug 04 17:02:39.040048 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 982/2023] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:38 2022] GET /compute/v2.1/images/02bc6af0-ae31-4dbe-9498-dfa200074e7b => generated 661 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:39.042860 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c34235fb-2fbe-45f9-8274-69d62201106f tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] 10.222.0.93 "GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478" status: 200 len: 1273 microversion: 2.1 time: 0.171977 Aug 04 17:02:39.043443 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1042/2024] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:38 2022] GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478 => generated 1273 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:39.119894 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-55d9e599-ce0b-4389-a293-d988cb87390a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-119106304", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:39.185644 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-55d9e599-ce0b-4389-a293-d988cb87390a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:02:39.442665 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-55d9e599-ce0b-4389-a293-d988cb87390a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:02:39.444178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-55d9e599-ce0b-4389-a293-d988cb87390a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:02:39.445527 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-55d9e599-ce0b-4389-a293-d988cb87390a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:02:39.446843 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-55d9e599-ce0b-4389-a293-d988cb87390a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:02:39.447702 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-55d9e599-ce0b-4389-a293-d988cb87390a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:02:39.460792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55d9e599-ce0b-4389-a293-d988cb87390a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:39.461418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55d9e599-ce0b-4389-a293-d988cb87390a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:39.461865 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55d9e599-ce0b-4389-a293-d988cb87390a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:39.462649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55d9e599-ce0b-4389-a293-d988cb87390a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:39.463108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55d9e599-ce0b-4389-a293-d988cb87390a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:39.463533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55d9e599-ce0b-4389-a293-d988cb87390a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:39.489575 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2e71b4d6-0b31-4766-8db4-d5d1d88afb72 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:39.490810 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2e71b4d6-0b31-4766-8db4-d5d1d88afb72 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:39.507812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-55d9e599-ce0b-4389-a293-d988cb87390a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Getting quotas for project f82de1eabf714c3492860c2a65df5ae1. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:02:39.511620 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2e71b4d6-0b31-4766-8db4-d5d1d88afb72 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:39.513250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2e71b4d6-0b31-4766-8db4-d5d1d88afb72 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:39.514107 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2e71b4d6-0b31-4766-8db4-d5d1d88afb72 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:39.517476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2e71b4d6-0b31-4766-8db4-d5d1d88afb72 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:39.520364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2e71b4d6-0b31-4766-8db4-d5d1d88afb72 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:39.522096 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-55d9e599-ce0b-4389-a293-d988cb87390a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Getting quotas for user 4a373cb0cd004b65a4ea9c804cbea3ab and project f82de1eabf714c3492860c2a65df5ae1. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:02:39.523002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2e71b4d6-0b31-4766-8db4-d5d1d88afb72 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:39.536377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-55d9e599-ce0b-4389-a293-d988cb87390a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:02:39.538627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-55d9e599-ce0b-4389-a293-d988cb87390a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: ba09cec5-a546-4fe5-90df-c90d94591fb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:02:39.602317 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-55d9e599-ce0b-4389-a293-d988cb87390a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.483809 Aug 04 17:02:39.630680 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 983/2025] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:02:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:02:39.646076 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cffd6cda-3da4-4035-ae71-f403526c73ae tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:39.646927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cffd6cda-3da4-4035-ae71-f403526c73ae tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:39.658262 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cffd6cda-3da4-4035-ae71-f403526c73ae tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:39.658765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cffd6cda-3da4-4035-ae71-f403526c73ae tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:39.659753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cffd6cda-3da4-4035-ae71-f403526c73ae tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:39.660471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cffd6cda-3da4-4035-ae71-f403526c73ae tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:39.660939 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cffd6cda-3da4-4035-ae71-f403526c73ae tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:39.668636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cffd6cda-3da4-4035-ae71-f403526c73ae tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:39.971446 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2e71b4d6-0b31-4766-8db4-d5d1d88afb72 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:39.979468 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2e71b4d6-0b31-4766-8db4-d5d1d88afb72 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1498 microversion: 2.1 time: 0.499689 Aug 04 17:02:39.980056 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1043/2026] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:39 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1498 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:02:40.001782 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b20280c8-8f9d-49d0-9cbf-05819e0c4b95 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5afe6430>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:40.044656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cffd6cda-3da4-4035-ae71-f403526c73ae tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:40.056435 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cffd6cda-3da4-4035-ae71-f403526c73ae tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1506 microversion: 2.1 time: 0.424575 Aug 04 17:02:40.075801 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 984/2027] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:39 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1506 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:40.096848 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6889d271-0875-467e-9e26-dcb85f8292b7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-989994757", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:40.110926 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b20280c8-8f9d-49d0-9cbf-05819e0c4b95 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96" status: 200 len: 1428 microversion: 2.1 time: 0.112915 Aug 04 17:02:40.127195 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1044/2028] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:39 2022] GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96 => generated 1428 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:40.132623 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-aafa7c7f-aea6-4710-a9e5-515b478e0195 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:40.133507 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-aafa7c7f-aea6-4710-a9e5-515b478e0195 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:40.150378 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aafa7c7f-aea6-4710-a9e5-515b478e0195 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:40.151000 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aafa7c7f-aea6-4710-a9e5-515b478e0195 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:40.151557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aafa7c7f-aea6-4710-a9e5-515b478e0195 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:40.152827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aafa7c7f-aea6-4710-a9e5-515b478e0195 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:40.153414 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aafa7c7f-aea6-4710-a9e5-515b478e0195 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:40.154090 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aafa7c7f-aea6-4710-a9e5-515b478e0195 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:40.206186 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-6889d271-0875-467e-9e26-dcb85f8292b7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:02:40.601919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-aafa7c7f-aea6-4710-a9e5-515b478e0195 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:40.615341 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-aafa7c7f-aea6-4710-a9e5-515b478e0195 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:40.617157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-aafa7c7f-aea6-4710-a9e5-515b478e0195 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:40.619655 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-aafa7c7f-aea6-4710-a9e5-515b478e0195 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1486 microversion: 2.25 time: 0.491019 Aug 04 17:02:40.650290 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1045/2029] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:40 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1486 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:40.663053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7691c6e4-56f4-4abd-b881-563ffa33abbc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:40.665010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7691c6e4-56f4-4abd-b881-563ffa33abbc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:40.677850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7691c6e4-56f4-4abd-b881-563ffa33abbc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:40.679044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7691c6e4-56f4-4abd-b881-563ffa33abbc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:40.680409 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7691c6e4-56f4-4abd-b881-563ffa33abbc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:40.681869 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7691c6e4-56f4-4abd-b881-563ffa33abbc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:40.683504 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7691c6e4-56f4-4abd-b881-563ffa33abbc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:40.684665 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7691c6e4-56f4-4abd-b881-563ffa33abbc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:40.693291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:40.789791 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6889d271-0875-467e-9e26-dcb85f8292b7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:02:40.790262 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6889d271-0875-467e-9e26-dcb85f8292b7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:02:40.790752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6889d271-0875-467e-9e26-dcb85f8292b7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:02:40.791172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6889d271-0875-467e-9e26-dcb85f8292b7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:02:40.791591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6889d271-0875-467e-9e26-dcb85f8292b7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:02:40.830481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6889d271-0875-467e-9e26-dcb85f8292b7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:40.831556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6889d271-0875-467e-9e26-dcb85f8292b7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:40.831934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6889d271-0875-467e-9e26-dcb85f8292b7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:40.846807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6889d271-0875-467e-9e26-dcb85f8292b7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:40.847605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6889d271-0875-467e-9e26-dcb85f8292b7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:40.848229 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6889d271-0875-467e-9e26-dcb85f8292b7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:40.900442 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-6889d271-0875-467e-9e26-dcb85f8292b7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Getting quotas for project f82de1eabf714c3492860c2a65df5ae1. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:02:40.916342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-6889d271-0875-467e-9e26-dcb85f8292b7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Getting quotas for user 4a373cb0cd004b65a4ea9c804cbea3ab and project f82de1eabf714c3492860c2a65df5ae1. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:02:40.955686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6889d271-0875-467e-9e26-dcb85f8292b7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:02:40.961098 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6889d271-0875-467e-9e26-dcb85f8292b7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: a6fb758e-d1f2-4244-b287-d93d20a53ac5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:02:40.992509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:41.076380 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6889d271-0875-467e-9e26-dcb85f8292b7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.999123 Aug 04 17:02:41.086720 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 985/2030] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:02:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:02:41.100422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a0967c42-5591-464d-9e52-da4c4d93ace5 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:41.102701 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a0967c42-5591-464d-9e52-da4c4d93ace5 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] [instance: 28e0f947-b275-48aa-90f0-bc74218c9478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:41.110918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0967c42-5591-464d-9e52-da4c4d93ace5 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:41.113085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0967c42-5591-464d-9e52-da4c4d93ace5 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:41.113773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0967c42-5591-464d-9e52-da4c4d93ace5 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:41.114722 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0967c42-5591-464d-9e52-da4c4d93ace5 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:41.115285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0967c42-5591-464d-9e52-da4c4d93ace5 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:41.115812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0967c42-5591-464d-9e52-da4c4d93ace5 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:41.115944 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7691c6e4-56f4-4abd-b881-563ffa33abbc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:41.166936 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7691c6e4-56f4-4abd-b881-563ffa33abbc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1392 microversion: 2.1 time: 0.509348 Aug 04 17:02:41.169433 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1046/2031] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:40 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1392 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:41.189404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8853d6be-6d42-4a64-835d-a2b6e3e8da57 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:41.193562 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8853d6be-6d42-4a64-835d-a2b6e3e8da57 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:41.211452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8853d6be-6d42-4a64-835d-a2b6e3e8da57 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:41.212139 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8853d6be-6d42-4a64-835d-a2b6e3e8da57 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:41.212941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8853d6be-6d42-4a64-835d-a2b6e3e8da57 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:41.219307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8853d6be-6d42-4a64-835d-a2b6e3e8da57 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:41.220489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8853d6be-6d42-4a64-835d-a2b6e3e8da57 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:41.225240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8853d6be-6d42-4a64-835d-a2b6e3e8da57 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:41.271088 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a0967c42-5591-464d-9e52-da4c4d93ace5 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fef8a6c8c5e4eab9656d3f86511c7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3f2746c4894fdea00a84678e47f990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:41.292541 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a0967c42-5591-464d-9e52-da4c4d93ace5 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] 10.222.0.93 "GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478" status: 200 len: 1327 microversion: 2.1 time: 0.201841 Aug 04 17:02:41.295327 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 986/2032] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:41 2022] GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478 => generated 1327 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:41.321203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-46eca1bb-7fdf-4edb-b535-fd880a797b7a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:41.323417 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-46eca1bb-7fdf-4edb-b535-fd880a797b7a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:41.339463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46eca1bb-7fdf-4edb-b535-fd880a797b7a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:41.343957 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46eca1bb-7fdf-4edb-b535-fd880a797b7a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:41.345751 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46eca1bb-7fdf-4edb-b535-fd880a797b7a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:41.347007 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46eca1bb-7fdf-4edb-b535-fd880a797b7a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:41.348783 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46eca1bb-7fdf-4edb-b535-fd880a797b7a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:41.354610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46eca1bb-7fdf-4edb-b535-fd880a797b7a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:41.769901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8853d6be-6d42-4a64-835d-a2b6e3e8da57 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:41.779439 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8853d6be-6d42-4a64-835d-a2b6e3e8da57 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1498 microversion: 2.1 time: 0.604876 Aug 04 17:02:41.782617 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1047/2033] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:41 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1498 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:41.793888 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-46eca1bb-7fdf-4edb-b535-fd880a797b7a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:41.805112 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-46eca1bb-7fdf-4edb-b535-fd880a797b7a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1506 microversion: 2.1 time: 0.503839 Aug 04 17:02:41.815908 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 987/2034] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:41 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1506 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:41.818498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-28bc084c-c961-41ad-84c7-7e0ca586241d tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:41.819137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-28bc084c-c961-41ad-84c7-7e0ca586241d tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: a6fb758e-d1f2-4244-b287-d93d20a53ac5] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:41.828057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5434dc22-d391-4bfb-9eee-a878e1850c98 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e6c9cf4c0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:41.891279 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5434dc22-d391-4bfb-9eee-a878e1850c98 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96" status: 200 len: 1428 microversion: 2.1 time: 0.074184 Aug 04 17:02:41.910980 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 988/2035] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:41 2022] GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96 => generated 1428 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:41.930421 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cd310ffb-7234-4207-8a11-2a3b7c7a3c79 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:41.931341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cd310ffb-7234-4207-8a11-2a3b7c7a3c79 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:41.950473 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd310ffb-7234-4207-8a11-2a3b7c7a3c79 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:41.951070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd310ffb-7234-4207-8a11-2a3b7c7a3c79 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:41.951414 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd310ffb-7234-4207-8a11-2a3b7c7a3c79 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:41.952132 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd310ffb-7234-4207-8a11-2a3b7c7a3c79 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:41.952697 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd310ffb-7234-4207-8a11-2a3b7c7a3c79 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:41.953082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd310ffb-7234-4207-8a11-2a3b7c7a3c79 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:41.976309 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-28bc084c-c961-41ad-84c7-7e0ca586241d tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a373cb0cd004b65a4ea9c804cbea3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82de1eabf714c3492860c2a65df5ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:41.985323 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-28bc084c-c961-41ad-84c7-7e0ca586241d tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5" status: 200 len: 1217 microversion: 2.1 time: 0.200226 Aug 04 17:02:41.990463 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1048/2036] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:41 2022] GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5 => generated 1217 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:42.192635 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b4942d64-1c12-4b10-962b-fcd15a836bdd tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:42.193440 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b4942d64-1c12-4b10-962b-fcd15a836bdd tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:42.206709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b4942d64-1c12-4b10-962b-fcd15a836bdd tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:42.218357 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b4942d64-1c12-4b10-962b-fcd15a836bdd tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:42.219201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b4942d64-1c12-4b10-962b-fcd15a836bdd tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:42.220093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b4942d64-1c12-4b10-962b-fcd15a836bdd tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:42.220698 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b4942d64-1c12-4b10-962b-fcd15a836bdd tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:42.223495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b4942d64-1c12-4b10-962b-fcd15a836bdd tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:42.459614 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cd310ffb-7234-4207-8a11-2a3b7c7a3c79 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:42.474106 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cd310ffb-7234-4207-8a11-2a3b7c7a3c79 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:42.479945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cd310ffb-7234-4207-8a11-2a3b7c7a3c79 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:42.493094 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cd310ffb-7234-4207-8a11-2a3b7c7a3c79 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1486 microversion: 2.25 time: 0.580746 Aug 04 17:02:42.508945 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 989/2037] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:41 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1486 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:42.514634 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0fa54b85-3f5f-49c2-95b2-e01543a87f68 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:42.517032 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0fa54b85-3f5f-49c2-95b2-e01543a87f68 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] [instance: 28e0f947-b275-48aa-90f0-bc74218c9478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:42.538152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fa54b85-3f5f-49c2-95b2-e01543a87f68 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:42.539225 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fa54b85-3f5f-49c2-95b2-e01543a87f68 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:42.539683 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fa54b85-3f5f-49c2-95b2-e01543a87f68 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:42.544533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fa54b85-3f5f-49c2-95b2-e01543a87f68 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:42.548132 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fa54b85-3f5f-49c2-95b2-e01543a87f68 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:42.549373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fa54b85-3f5f-49c2-95b2-e01543a87f68 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:42.664870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b4942d64-1c12-4b10-962b-fcd15a836bdd tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:42.675350 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b4942d64-1c12-4b10-962b-fcd15a836bdd tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1392 microversion: 2.1 time: 0.486754 Aug 04 17:02:42.675950 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1049/2038] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:42 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1392 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:42.805816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5c83963f-e4f6-4712-a364-06fb53cc37aa tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:42.806493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5c83963f-e4f6-4712-a364-06fb53cc37aa tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:42.816458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c83963f-e4f6-4712-a364-06fb53cc37aa tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:42.819150 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c83963f-e4f6-4712-a364-06fb53cc37aa tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:42.819797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c83963f-e4f6-4712-a364-06fb53cc37aa tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:42.822874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c83963f-e4f6-4712-a364-06fb53cc37aa tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:42.825278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c83963f-e4f6-4712-a364-06fb53cc37aa tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:42.825922 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c83963f-e4f6-4712-a364-06fb53cc37aa tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:42.836200 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0fa54b85-3f5f-49c2-95b2-e01543a87f68 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fef8a6c8c5e4eab9656d3f86511c7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3f2746c4894fdea00a84678e47f990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:42.844984 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0fa54b85-3f5f-49c2-95b2-e01543a87f68 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] 10.222.0.93 "GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478" status: 200 len: 1395 microversion: 2.1 time: 0.349097 Aug 04 17:02:42.845576 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 990/2039] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:42 2022] GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478 => generated 1395 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:42.859675 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fb01851b-29b6-4dd4-baad-b70bcd1e76fe tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:42.865154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fb01851b-29b6-4dd4-baad-b70bcd1e76fe tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:42.873202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb01851b-29b6-4dd4-baad-b70bcd1e76fe tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:42.877317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb01851b-29b6-4dd4-baad-b70bcd1e76fe tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:42.878623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb01851b-29b6-4dd4-baad-b70bcd1e76fe tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:42.879846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb01851b-29b6-4dd4-baad-b70bcd1e76fe tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:42.882558 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb01851b-29b6-4dd4-baad-b70bcd1e76fe tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:42.883224 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb01851b-29b6-4dd4-baad-b70bcd1e76fe tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:43.124069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5c83963f-e4f6-4712-a364-06fb53cc37aa tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:43.134023 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5c83963f-e4f6-4712-a364-06fb53cc37aa tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1498 microversion: 2.1 time: 0.332333 Aug 04 17:02:43.140026 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1050/2040] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:42 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1498 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:02:43.154326 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c2b18348-0857-438f-8eb1-207327299f02 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5ae83160>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:43.191019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fb01851b-29b6-4dd4-baad-b70bcd1e76fe tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:43.202235 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fb01851b-29b6-4dd4-baad-b70bcd1e76fe tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1506 microversion: 2.1 time: 0.354283 Aug 04 17:02:43.215511 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 991/2041] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:42 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1506 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:43.229619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c66d0d4e-38f4-4a69-a167-70479dec16a7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:43.230428 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c66d0d4e-38f4-4a69-a167-70479dec16a7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: a6fb758e-d1f2-4244-b287-d93d20a53ac5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:43.246306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c66d0d4e-38f4-4a69-a167-70479dec16a7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:43.246802 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c66d0d4e-38f4-4a69-a167-70479dec16a7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:43.248138 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c2b18348-0857-438f-8eb1-207327299f02 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96" status: 200 len: 1428 microversion: 2.1 time: 0.106528 Aug 04 17:02:43.249495 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c66d0d4e-38f4-4a69-a167-70479dec16a7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:43.249957 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1051/2042] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:43 2022] GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96 => generated 1428 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:43.250656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c66d0d4e-38f4-4a69-a167-70479dec16a7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:43.251141 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c66d0d4e-38f4-4a69-a167-70479dec16a7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:43.253427 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c66d0d4e-38f4-4a69-a167-70479dec16a7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:43.354111 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c66d0d4e-38f4-4a69-a167-70479dec16a7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a373cb0cd004b65a4ea9c804cbea3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82de1eabf714c3492860c2a65df5ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:43.366218 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c66d0d4e-38f4-4a69-a167-70479dec16a7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5" status: 200 len: 1269 microversion: 2.1 time: 0.147636 Aug 04 17:02:43.366816 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 992/2043] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:43 2022] GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5 => generated 1269 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:43.516752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7168132d-4d8e-4fe5-86e9-0334b24ba180 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:43.517558 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7168132d-4d8e-4fe5-86e9-0334b24ba180 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:43.532208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7168132d-4d8e-4fe5-86e9-0334b24ba180 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:43.546475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7168132d-4d8e-4fe5-86e9-0334b24ba180 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:43.553928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7168132d-4d8e-4fe5-86e9-0334b24ba180 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:43.562569 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7168132d-4d8e-4fe5-86e9-0334b24ba180 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:43.563814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7168132d-4d8e-4fe5-86e9-0334b24ba180 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:43.564947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7168132d-4d8e-4fe5-86e9-0334b24ba180 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:43.700742 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cbdf1874-1e12-462c-b8f5-79a831361e30 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:43.701528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cbdf1874-1e12-462c-b8f5-79a831361e30 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:43.708129 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbdf1874-1e12-462c-b8f5-79a831361e30 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:43.708628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbdf1874-1e12-462c-b8f5-79a831361e30 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:43.709072 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbdf1874-1e12-462c-b8f5-79a831361e30 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:43.709787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbdf1874-1e12-462c-b8f5-79a831361e30 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:43.710281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbdf1874-1e12-462c-b8f5-79a831361e30 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:43.731163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbdf1874-1e12-462c-b8f5-79a831361e30 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:44.087388 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7168132d-4d8e-4fe5-86e9-0334b24ba180 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:44.097634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7168132d-4d8e-4fe5-86e9-0334b24ba180 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:44.112986 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7168132d-4d8e-4fe5-86e9-0334b24ba180 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:44.122152 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7168132d-4d8e-4fe5-86e9-0334b24ba180 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1486 microversion: 2.25 time: 0.607131 Aug 04 17:02:44.125646 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1052/2044] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:43 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1486 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:44.142792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a01f81ec-0119-4329-96cf-52c88b9a7a54 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:44.146930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a01f81ec-0119-4329-96cf-52c88b9a7a54 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] [instance: 28e0f947-b275-48aa-90f0-bc74218c9478] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:44.166574 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cbdf1874-1e12-462c-b8f5-79a831361e30 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:44.168076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a01f81ec-0119-4329-96cf-52c88b9a7a54 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:44.170519 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a01f81ec-0119-4329-96cf-52c88b9a7a54 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:44.171628 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a01f81ec-0119-4329-96cf-52c88b9a7a54 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:44.173819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a01f81ec-0119-4329-96cf-52c88b9a7a54 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:44.175636 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a01f81ec-0119-4329-96cf-52c88b9a7a54 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:44.178302 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a01f81ec-0119-4329-96cf-52c88b9a7a54 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:44.208860 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cbdf1874-1e12-462c-b8f5-79a831361e30 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1392 microversion: 2.1 time: 0.492213 Aug 04 17:02:44.223852 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 993/2045] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:43 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1392 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:02:44.229181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-601a5ddc-5266-4608-96ed-578033e21893 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:44.255078 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-601a5ddc-5266-4608-96ed-578033e21893 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:44.309452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-601a5ddc-5266-4608-96ed-578033e21893 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:44.310915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-601a5ddc-5266-4608-96ed-578033e21893 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:44.312926 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-601a5ddc-5266-4608-96ed-578033e21893 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:44.316820 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-601a5ddc-5266-4608-96ed-578033e21893 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:44.322925 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-601a5ddc-5266-4608-96ed-578033e21893 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:44.323942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-601a5ddc-5266-4608-96ed-578033e21893 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:44.710413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-601a5ddc-5266-4608-96ed-578033e21893 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:44.719696 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-601a5ddc-5266-4608-96ed-578033e21893 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1498 microversion: 2.1 time: 0.494396 Aug 04 17:02:44.729304 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 994/2046] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:44 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1498 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:44.735134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a4eccc29-4e62-4fb2-9e31-e341054d3fe5 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:44.743141 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a01f81ec-0119-4329-96cf-52c88b9a7a54 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fef8a6c8c5e4eab9656d3f86511c7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3f2746c4894fdea00a84678e47f990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:44.748524 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a4eccc29-4e62-4fb2-9e31-e341054d3fe5 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:44.755792 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a01f81ec-0119-4329-96cf-52c88b9a7a54 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] 10.222.0.93 "GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478" status: 200 len: 1395 microversion: 2.1 time: 0.626706 Aug 04 17:02:44.756572 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1053/2047] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:44 2022] GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478 => generated 1395 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:44.777835 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-98a8c4c9-6090-4222-a65e-7c965ca38a38 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5af71ee0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:44.786737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4eccc29-4e62-4fb2-9e31-e341054d3fe5 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:44.787418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4eccc29-4e62-4fb2-9e31-e341054d3fe5 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:44.788114 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4eccc29-4e62-4fb2-9e31-e341054d3fe5 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:44.791571 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4eccc29-4e62-4fb2-9e31-e341054d3fe5 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:44.792217 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4eccc29-4e62-4fb2-9e31-e341054d3fe5 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:44.792817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4eccc29-4e62-4fb2-9e31-e341054d3fe5 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:44.874276 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-98a8c4c9-6090-4222-a65e-7c965ca38a38 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96" status: 200 len: 1428 microversion: 2.1 time: 0.092728 Aug 04 17:02:44.885240 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1054/2048] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:44 2022] GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96 => generated 1428 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:44.890485 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-182b90e1-71d9-4706-9ecb-6f1812128f6c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:44.891380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-182b90e1-71d9-4706-9ecb-6f1812128f6c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: a6fb758e-d1f2-4244-b287-d93d20a53ac5] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:44.909725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-182b90e1-71d9-4706-9ecb-6f1812128f6c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:44.910416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-182b90e1-71d9-4706-9ecb-6f1812128f6c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:44.910979 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-182b90e1-71d9-4706-9ecb-6f1812128f6c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:44.911821 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-182b90e1-71d9-4706-9ecb-6f1812128f6c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:44.912406 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-182b90e1-71d9-4706-9ecb-6f1812128f6c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:44.912957 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-182b90e1-71d9-4706-9ecb-6f1812128f6c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:45.059999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-182b90e1-71d9-4706-9ecb-6f1812128f6c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a373cb0cd004b65a4ea9c804cbea3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82de1eabf714c3492860c2a65df5ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:45.071687 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-182b90e1-71d9-4706-9ecb-6f1812128f6c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5" status: 200 len: 1275 microversion: 2.1 time: 0.189966 Aug 04 17:02:45.073428 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1055/2049] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:44 2022] GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5 => generated 1275 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:45.100374 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a4eccc29-4e62-4fb2-9e31-e341054d3fe5 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:45.110969 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a4eccc29-4e62-4fb2-9e31-e341054d3fe5 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1506 microversion: 2.1 time: 0.379740 Aug 04 17:02:45.120467 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 995/2050] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:44 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1506 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:45.151557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c4773533-b69f-4f67-8c71-b7051f9d0b47 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:45.152906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c4773533-b69f-4f67-8c71-b7051f9d0b47 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:45.163144 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4773533-b69f-4f67-8c71-b7051f9d0b47 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:45.163977 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4773533-b69f-4f67-8c71-b7051f9d0b47 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:45.165455 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4773533-b69f-4f67-8c71-b7051f9d0b47 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:45.168107 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4773533-b69f-4f67-8c71-b7051f9d0b47 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:45.168783 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4773533-b69f-4f67-8c71-b7051f9d0b47 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:45.170450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4773533-b69f-4f67-8c71-b7051f9d0b47 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:45.233138 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f58a704f-25c1-4caa-bab6-ec94da517434 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:45.237576 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f58a704f-25c1-4caa-bab6-ec94da517434 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:45.249578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f58a704f-25c1-4caa-bab6-ec94da517434 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:45.251896 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f58a704f-25c1-4caa-bab6-ec94da517434 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:45.253034 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f58a704f-25c1-4caa-bab6-ec94da517434 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:45.254227 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f58a704f-25c1-4caa-bab6-ec94da517434 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:45.256374 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f58a704f-25c1-4caa-bab6-ec94da517434 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:45.257385 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f58a704f-25c1-4caa-bab6-ec94da517434 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:45.479717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c4773533-b69f-4f67-8c71-b7051f9d0b47 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:45.500061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c4773533-b69f-4f67-8c71-b7051f9d0b47 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:45.503513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c4773533-b69f-4f67-8c71-b7051f9d0b47 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:45.508646 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c4773533-b69f-4f67-8c71-b7051f9d0b47 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1486 microversion: 2.25 time: 0.362254 Aug 04 17:02:45.510383 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1056/2051] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:45 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1486 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:45.710013 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f58a704f-25c1-4caa-bab6-ec94da517434 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:45.724520 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f58a704f-25c1-4caa-bab6-ec94da517434 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1392 microversion: 2.1 time: 0.496944 Aug 04 17:02:45.726747 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 996/2052] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:45 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1392 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:45.754771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-5ae53d60-dbf4-40d0-9f78-9f93614230f7 req-06caa271-6382-4994-b303-1c1fa3c1e57e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28e0f947-b275-48aa-90f0-bc74218c9478", "tag": "b54af5f4-7d06-458b-b36f-c876adabf6c0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:45.758555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b7f8295c-b97c-4fa5-814d-6902301e4709 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:45.762853 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b7f8295c-b97c-4fa5-814d-6902301e4709 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:45.782062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b7f8295c-b97c-4fa5-814d-6902301e4709 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:45.783187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b7f8295c-b97c-4fa5-814d-6902301e4709 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:45.784539 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b7f8295c-b97c-4fa5-814d-6902301e4709 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:45.784988 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5ae53d60-dbf4-40d0-9f78-9f93614230f7 req-06caa271-6382-4994-b303-1c1fa3c1e57e service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:45.785699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5ae53d60-dbf4-40d0-9f78-9f93614230f7 req-06caa271-6382-4994-b303-1c1fa3c1e57e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:45.787088 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5ae53d60-dbf4-40d0-9f78-9f93614230f7 req-06caa271-6382-4994-b303-1c1fa3c1e57e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:45.787411 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b7f8295c-b97c-4fa5-814d-6902301e4709 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:45.788551 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b7f8295c-b97c-4fa5-814d-6902301e4709 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:45.790489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b7f8295c-b97c-4fa5-814d-6902301e4709 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:45.852160 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-5ae53d60-dbf4-40d0-9f78-9f93614230f7 req-06caa271-6382-4994-b303-1c1fa3c1e57e service nova] Creating event network-changed:b54af5f4-7d06-458b-b36f-c876adabf6c0 for instance 28e0f947-b275-48aa-90f0-bc74218c9478 on n-h1-851359-3 Aug 04 17:02:45.877134 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-5ae53d60-dbf4-40d0-9f78-9f93614230f7 req-06caa271-6382-4994-b303-1c1fa3c1e57e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128818 Aug 04 17:02:45.882595 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 997/2053] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:45.901123 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f7bd3e42-fcfb-4f65-8838-313a9d064e64 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:45.902860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f7bd3e42-fcfb-4f65-8838-313a9d064e64 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] [instance: 28e0f947-b275-48aa-90f0-bc74218c9478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:45.916045 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7bd3e42-fcfb-4f65-8838-313a9d064e64 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:45.916557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7bd3e42-fcfb-4f65-8838-313a9d064e64 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:45.922203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7bd3e42-fcfb-4f65-8838-313a9d064e64 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:45.922994 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7bd3e42-fcfb-4f65-8838-313a9d064e64 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:45.923476 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7bd3e42-fcfb-4f65-8838-313a9d064e64 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:45.924178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7bd3e42-fcfb-4f65-8838-313a9d064e64 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:45.992042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:46.317101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b7f8295c-b97c-4fa5-814d-6902301e4709 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:46.344668 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b7f8295c-b97c-4fa5-814d-6902301e4709 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1498 microversion: 2.1 time: 0.604029 Aug 04 17:02:46.353582 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1057/2054] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:45 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1498 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:46.372050 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7d4ff973-45eb-4162-8325-a0f6e617074a tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5afe4310>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:46.424075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f7bd3e42-fcfb-4f65-8838-313a9d064e64 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fef8a6c8c5e4eab9656d3f86511c7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3f2746c4894fdea00a84678e47f990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:46.440010 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f7bd3e42-fcfb-4f65-8838-313a9d064e64 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] 10.222.0.93 "GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478" status: 200 len: 1395 microversion: 2.1 time: 0.550482 Aug 04 17:02:46.443925 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 998/2055] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:45 2022] GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478 => generated 1395 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:46.462007 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7d4ff973-45eb-4162-8325-a0f6e617074a tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96" status: 200 len: 1428 microversion: 2.1 time: 0.106195 Aug 04 17:02:46.463217 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1058/2056] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:46 2022] GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96 => generated 1428 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:46.468612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-af3ae573-7cc3-4c04-b98b-f3ef0c77069c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:46.470124 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-af3ae573-7cc3-4c04-b98b-f3ef0c77069c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: a6fb758e-d1f2-4244-b287-d93d20a53ac5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:46.473514 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e9fc6c41-89b2-4f25-88b4-064407b3eeca tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:46.482047 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e9fc6c41-89b2-4f25-88b4-064407b3eeca tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:46.493651 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9fc6c41-89b2-4f25-88b4-064407b3eeca tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:46.495361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-af3ae573-7cc3-4c04-b98b-f3ef0c77069c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:46.496232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9fc6c41-89b2-4f25-88b4-064407b3eeca tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:46.496890 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-af3ae573-7cc3-4c04-b98b-f3ef0c77069c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:46.500894 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-af3ae573-7cc3-4c04-b98b-f3ef0c77069c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:46.501646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9fc6c41-89b2-4f25-88b4-064407b3eeca tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:46.502596 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9fc6c41-89b2-4f25-88b4-064407b3eeca tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:46.503756 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9fc6c41-89b2-4f25-88b4-064407b3eeca tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:46.504070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-af3ae573-7cc3-4c04-b98b-f3ef0c77069c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:46.504532 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9fc6c41-89b2-4f25-88b4-064407b3eeca tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:46.507969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-af3ae573-7cc3-4c04-b98b-f3ef0c77069c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:46.508712 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-af3ae573-7cc3-4c04-b98b-f3ef0c77069c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:47.298581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e9fc6c41-89b2-4f25-88b4-064407b3eeca tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:47.316486 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e9fc6c41-89b2-4f25-88b4-064407b3eeca tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1506 microversion: 2.1 time: 0.851996 Aug 04 17:02:47.331441 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1059/2057] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:46 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1506 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:47.352225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dd4f6f25-ab0e-4227-aa6f-f177e9e79c07 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:47.352873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dd4f6f25-ab0e-4227-aa6f-f177e9e79c07 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:47.367474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-af3ae573-7cc3-4c04-b98b-f3ef0c77069c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a373cb0cd004b65a4ea9c804cbea3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82de1eabf714c3492860c2a65df5ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:47.372932 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd4f6f25-ab0e-4227-aa6f-f177e9e79c07 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:47.376843 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd4f6f25-ab0e-4227-aa6f-f177e9e79c07 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:47.386308 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-af3ae573-7cc3-4c04-b98b-f3ef0c77069c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5" status: 200 len: 1317 microversion: 2.1 time: 0.935590 Aug 04 17:02:47.386966 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 999/2058] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:46 2022] GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5 => generated 1317 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:47.395998 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd4f6f25-ab0e-4227-aa6f-f177e9e79c07 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:47.397550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd4f6f25-ab0e-4227-aa6f-f177e9e79c07 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:47.398533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd4f6f25-ab0e-4227-aa6f-f177e9e79c07 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:47.399308 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd4f6f25-ab0e-4227-aa6f-f177e9e79c07 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:47.400878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-48365230-f2b6-4951-82f9-8f3b10633ba5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:47.401648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-48365230-f2b6-4951-82f9-8f3b10633ba5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:47.418900 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48365230-f2b6-4951-82f9-8f3b10633ba5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:47.419387 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48365230-f2b6-4951-82f9-8f3b10633ba5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:47.428827 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48365230-f2b6-4951-82f9-8f3b10633ba5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:47.434696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48365230-f2b6-4951-82f9-8f3b10633ba5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:47.435421 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48365230-f2b6-4951-82f9-8f3b10633ba5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:47.436808 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48365230-f2b6-4951-82f9-8f3b10633ba5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:47.838661 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-48365230-f2b6-4951-82f9-8f3b10633ba5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:47.854722 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-48365230-f2b6-4951-82f9-8f3b10633ba5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1382 microversion: 2.1 time: 0.466667 Aug 04 17:02:47.857037 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1000/2059] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:47 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1382 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:47.869420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8cfb922d-c709-47c9-a4f6-3d6b7e588fd0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:47.872260 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8cfb922d-c709-47c9-a4f6-3d6b7e588fd0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:47.889257 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8cfb922d-c709-47c9-a4f6-3d6b7e588fd0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:47.891854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8cfb922d-c709-47c9-a4f6-3d6b7e588fd0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:47.892803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8cfb922d-c709-47c9-a4f6-3d6b7e588fd0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:47.894669 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8cfb922d-c709-47c9-a4f6-3d6b7e588fd0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:47.897232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8cfb922d-c709-47c9-a4f6-3d6b7e588fd0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:47.897989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8cfb922d-c709-47c9-a4f6-3d6b7e588fd0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:48.947463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8cfb922d-c709-47c9-a4f6-3d6b7e588fd0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:48.959752 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8cfb922d-c709-47c9-a4f6-3d6b7e588fd0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1498 microversion: 2.1 time: 1.100375 Aug 04 17:02:48.964655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dd4f6f25-ab0e-4227-aa6f-f177e9e79c07 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:48.969601 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1001/2060] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:47 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1498 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:49.007893 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dd4f6f25-ab0e-4227-aa6f-f177e9e79c07 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:49.007893 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dd4f6f25-ab0e-4227-aa6f-f177e9e79c07 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:49.008718 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d70cf7cc-32a8-4e15-b3f3-671059f8437d tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:49.008718 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d70cf7cc-32a8-4e15-b3f3-671059f8437d tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] [instance: 28e0f947-b275-48aa-90f0-bc74218c9478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:49.008896 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dd4f6f25-ab0e-4227-aa6f-f177e9e79c07 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1486 microversion: 2.25 time: 1.656138 Aug 04 17:02:49.008896 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1060/2061] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:47 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1486 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:49.008896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-55023d73-004f-401a-80be-fb7c02386de8 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5ae83dc0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:49.011185 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d70cf7cc-32a8-4e15-b3f3-671059f8437d tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:49.019937 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d70cf7cc-32a8-4e15-b3f3-671059f8437d tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:49.022934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d70cf7cc-32a8-4e15-b3f3-671059f8437d tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:49.024252 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d70cf7cc-32a8-4e15-b3f3-671059f8437d tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:49.024739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d70cf7cc-32a8-4e15-b3f3-671059f8437d tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:49.027618 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d70cf7cc-32a8-4e15-b3f3-671059f8437d tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:49.092826 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-55023d73-004f-401a-80be-fb7c02386de8 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96" status: 200 len: 1428 microversion: 2.1 time: 0.098220 Aug 04 17:02:49.093862 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1061/2062] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:48 2022] GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96 => generated 1428 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:49.099542 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-49065274-954b-478f-9f7f-5e59bc8efea6 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Calling method '.version_select at 0x7f1e5ae83d30>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:49.103716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-49065274-954b-478f-9f7f-5e59bc8efea6 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:49.104296 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-49065274-954b-478f-9f7f-5e59bc8efea6 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:49.105031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-49065274-954b-478f-9f7f-5e59bc8efea6 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:49.118231 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-49065274-954b-478f-9f7f-5e59bc8efea6 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] 10.222.0.93 "GET /compute/v2.1/os-migrations" status: 200 len: 3089 microversion: 2.1 time: 0.023123 Aug 04 17:02:49.118838 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1062/2063] 10.222.0.93 () {58 vars in 1143 bytes} [Thu Aug 4 17:02:49 2022] GET /compute/v2.1/os-migrations => generated 3089 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:49.123677 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-102f76f4-5090-4af5-afe3-91d9ead1a1cc req-4885a648-eb2e-4df2-ae5d-53b80503dff9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba09cec5-a546-4fe5-90df-c90d94591fb2", "tag": "14919ddc-0463-47b2-9b85-fd575b876018"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:49.137411 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-102f76f4-5090-4af5-afe3-91d9ead1a1cc req-4885a648-eb2e-4df2-ae5d-53b80503dff9 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:49.138082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-102f76f4-5090-4af5-afe3-91d9ead1a1cc req-4885a648-eb2e-4df2-ae5d-53b80503dff9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:49.138537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-102f76f4-5090-4af5-afe3-91d9ead1a1cc req-4885a648-eb2e-4df2-ae5d-53b80503dff9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:49.151287 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-102f76f4-5090-4af5-afe3-91d9ead1a1cc req-4885a648-eb2e-4df2-ae5d-53b80503dff9 service nova] Creating event network-changed:14919ddc-0463-47b2-9b85-fd575b876018 for instance ba09cec5-a546-4fe5-90df-c90d94591fb2 on n-h1-851359-3 Aug 04 17:02:49.157222 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-102f76f4-5090-4af5-afe3-91d9ead1a1cc req-4885a648-eb2e-4df2-ae5d-53b80503dff9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036849 Aug 04 17:02:49.158393 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1063/2064] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:49.167581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-84545875-06c5-4a05-a24b-efe094d07dbd tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:49.168255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-84545875-06c5-4a05-a24b-efe094d07dbd tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:49.175088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84545875-06c5-4a05-a24b-efe094d07dbd tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:49.175974 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84545875-06c5-4a05-a24b-efe094d07dbd tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:49.176667 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84545875-06c5-4a05-a24b-efe094d07dbd tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:49.177674 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84545875-06c5-4a05-a24b-efe094d07dbd tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:49.178558 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84545875-06c5-4a05-a24b-efe094d07dbd tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:49.179180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84545875-06c5-4a05-a24b-efe094d07dbd tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:49.437037 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d70cf7cc-32a8-4e15-b3f3-671059f8437d tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fef8a6c8c5e4eab9656d3f86511c7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3f2746c4894fdea00a84678e47f990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:49.445040 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-84545875-06c5-4a05-a24b-efe094d07dbd tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:49.454038 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-84545875-06c5-4a05-a24b-efe094d07dbd tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1506 microversion: 2.1 time: 0.294162 Aug 04 17:02:49.458424 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1064/2065] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:49 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1506 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:49.465281 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-690794ce-539b-46be-ab61-c373b58c7c9b tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:49.465909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-690794ce-539b-46be-ab61-c373b58c7c9b tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: a6fb758e-d1f2-4244-b287-d93d20a53ac5] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:49.466689 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d70cf7cc-32a8-4e15-b3f3-671059f8437d tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] 10.222.0.93 "GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478" status: 200 len: 1395 microversion: 2.1 time: 0.484127 Aug 04 17:02:49.477370 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1002/2066] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:48 2022] GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478 => generated 1395 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:49.481100 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-690794ce-539b-46be-ab61-c373b58c7c9b tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:49.481659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-690794ce-539b-46be-ab61-c373b58c7c9b tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:49.485120 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-690794ce-539b-46be-ab61-c373b58c7c9b tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:49.486016 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-690794ce-539b-46be-ab61-c373b58c7c9b tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:49.486512 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-690794ce-539b-46be-ab61-c373b58c7c9b tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:49.486982 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-690794ce-539b-46be-ab61-c373b58c7c9b tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:49.510146 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9f0024ae-62cf-496c-afa3-dc6f3e2f4406 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:49.536401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9f0024ae-62cf-496c-afa3-dc6f3e2f4406 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:49.562732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f0024ae-62cf-496c-afa3-dc6f3e2f4406 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:49.582047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f0024ae-62cf-496c-afa3-dc6f3e2f4406 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:49.587884 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f0024ae-62cf-496c-afa3-dc6f3e2f4406 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:49.588795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f0024ae-62cf-496c-afa3-dc6f3e2f4406 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:49.589332 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f0024ae-62cf-496c-afa3-dc6f3e2f4406 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:49.589795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f0024ae-62cf-496c-afa3-dc6f3e2f4406 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:50.094151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-690794ce-539b-46be-ab61-c373b58c7c9b tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a373cb0cd004b65a4ea9c804cbea3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82de1eabf714c3492860c2a65df5ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:50.107980 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-690794ce-539b-46be-ab61-c373b58c7c9b tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5" status: 200 len: 1317 microversion: 2.1 time: 0.646281 Aug 04 17:02:50.111853 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1065/2067] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:49 2022] GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5 => generated 1317 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:50.117916 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2b3036b2-1b8a-4e23-9598-0da7111f1161 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:50.118576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2b3036b2-1b8a-4e23-9598-0da7111f1161 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:50.143080 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b3036b2-1b8a-4e23-9598-0da7111f1161 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:50.143616 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b3036b2-1b8a-4e23-9598-0da7111f1161 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:50.144070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b3036b2-1b8a-4e23-9598-0da7111f1161 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:50.144794 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b3036b2-1b8a-4e23-9598-0da7111f1161 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:50.145510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b3036b2-1b8a-4e23-9598-0da7111f1161 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:50.146164 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b3036b2-1b8a-4e23-9598-0da7111f1161 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:50.156297 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9f0024ae-62cf-496c-afa3-dc6f3e2f4406 tempest-LiveMigrationTest-1857909785 tempest-LiveMigrationTest-1857909785-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1533 microversion: 2.1 time: 0.665502 Aug 04 17:02:50.182661 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1003/2068] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:49 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1533 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:50.201115 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-772cd5ef-560f-4fb8-b6a2-73add7777c3b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:50.208652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-772cd5ef-560f-4fb8-b6a2-73add7777c3b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:50.229840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-772cd5ef-560f-4fb8-b6a2-73add7777c3b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:50.231145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-772cd5ef-560f-4fb8-b6a2-73add7777c3b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:50.232106 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-772cd5ef-560f-4fb8-b6a2-73add7777c3b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:50.238032 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-772cd5ef-560f-4fb8-b6a2-73add7777c3b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:50.239313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-772cd5ef-560f-4fb8-b6a2-73add7777c3b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:50.241479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-772cd5ef-560f-4fb8-b6a2-73add7777c3b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:50.604012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-772cd5ef-560f-4fb8-b6a2-73add7777c3b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:50.606577 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2b3036b2-1b8a-4e23-9598-0da7111f1161 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:50.614483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-772cd5ef-560f-4fb8-b6a2-73add7777c3b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:50.614942 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2b3036b2-1b8a-4e23-9598-0da7111f1161 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1498 microversion: 2.1 time: 0.501260 Aug 04 17:02:50.615532 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1066/2069] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:50 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1498 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:50.615947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-772cd5ef-560f-4fb8-b6a2-73add7777c3b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:50.621024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2265fe10-6470-430a-8b54-2e6aa9f41aeb tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5af4c9d0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:50.621630 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-772cd5ef-560f-4fb8-b6a2-73add7777c3b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1486 microversion: 2.25 time: 0.432280 Aug 04 17:02:50.636680 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1004/2070] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:50 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1486 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:50.643049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b5687a5d-6ab1-48bc-bafa-fd4a3b4a4bb5 req-639a2365-ab0c-41e4-b49d-7cc671f9ccc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6fb758e-d1f2-4244-b287-d93d20a53ac5", "tag": "e1ab51bf-fb27-46c5-9e82-16eef50f40f8"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:50.660329 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b5687a5d-6ab1-48bc-bafa-fd4a3b4a4bb5 req-639a2365-ab0c-41e4-b49d-7cc671f9ccc7 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:50.661126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b5687a5d-6ab1-48bc-bafa-fd4a3b4a4bb5 req-639a2365-ab0c-41e4-b49d-7cc671f9ccc7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:50.661751 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b5687a5d-6ab1-48bc-bafa-fd4a3b4a4bb5 req-639a2365-ab0c-41e4-b49d-7cc671f9ccc7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:50.675778 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2265fe10-6470-430a-8b54-2e6aa9f41aeb tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96" status: 200 len: 1428 microversion: 2.1 time: 0.058304 Aug 04 17:02:50.676648 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1067/2071] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:50 2022] GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96 => generated 1428 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:50.687089 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b5687a5d-6ab1-48bc-bafa-fd4a3b4a4bb5 req-639a2365-ab0c-41e4-b49d-7cc671f9ccc7 service nova] Creating event network-changed:e1ab51bf-fb27-46c5-9e82-16eef50f40f8 for instance a6fb758e-d1f2-4244-b287-d93d20a53ac5 on n-h1-851359-3 Aug 04 17:02:50.690723 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a67c403d-2248-4bf4-9b56-5871dd58bc2b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:50.691968 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a67c403d-2248-4bf4-9b56-5871dd58bc2b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:50.695915 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b5687a5d-6ab1-48bc-bafa-fd4a3b4a4bb5 req-639a2365-ab0c-41e4-b49d-7cc671f9ccc7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057179 Aug 04 17:02:50.698919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a67c403d-2248-4bf4-9b56-5871dd58bc2b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:50.699609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a67c403d-2248-4bf4-9b56-5871dd58bc2b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:50.699770 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1005/2072] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:50.704376 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a67c403d-2248-4bf4-9b56-5871dd58bc2b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:50.705616 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a67c403d-2248-4bf4-9b56-5871dd58bc2b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:50.706942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a67c403d-2248-4bf4-9b56-5871dd58bc2b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:50.707560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a67c403d-2248-4bf4-9b56-5871dd58bc2b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:50.718035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-35d4fecc-1c14-4e37-9d6c-7289dd77b1dc tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:50.718766 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-35d4fecc-1c14-4e37-9d6c-7289dd77b1dc tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:50.726342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35d4fecc-1c14-4e37-9d6c-7289dd77b1dc tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:50.726851 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35d4fecc-1c14-4e37-9d6c-7289dd77b1dc tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:50.727859 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35d4fecc-1c14-4e37-9d6c-7289dd77b1dc tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:50.728609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35d4fecc-1c14-4e37-9d6c-7289dd77b1dc tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:50.729119 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35d4fecc-1c14-4e37-9d6c-7289dd77b1dc tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:50.729611 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35d4fecc-1c14-4e37-9d6c-7289dd77b1dc tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:50.739565 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a67c403d-2248-4bf4-9b56-5871dd58bc2b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:02:50.807807 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:50.851245 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a67c403d-2248-4bf4-9b56-5871dd58bc2b tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "DELETE /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 204 len: 0 microversion: 2.1 time: 0.172326 Aug 04 17:02:50.852384 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1068/2073] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:02:50 2022] DELETE /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:02:50.857116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=8 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:50.860961 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-020a73ff-7743-483a-be9a-f0c680eda282 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:50.862095 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-020a73ff-7743-483a-be9a-f0c680eda282 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] [instance: 28e0f947-b275-48aa-90f0-bc74218c9478] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:50.872429 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-020a73ff-7743-483a-be9a-f0c680eda282 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:50.873282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-020a73ff-7743-483a-be9a-f0c680eda282 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:50.874274 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-020a73ff-7743-483a-be9a-f0c680eda282 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:50.875219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-020a73ff-7743-483a-be9a-f0c680eda282 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:50.876049 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-020a73ff-7743-483a-be9a-f0c680eda282 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:50.877497 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-020a73ff-7743-483a-be9a-f0c680eda282 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:50.906736 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-35d4fecc-1c14-4e37-9d6c-7289dd77b1dc tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:50.914844 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-35d4fecc-1c14-4e37-9d6c-7289dd77b1dc tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1527 microversion: 2.1 time: 0.211710 Aug 04 17:02:50.915434 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1006/2074] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:50 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1527 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:50.927549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9be638e9-937e-41b1-ba76-cd7391d0a5ba tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:50.928351 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9be638e9-937e-41b1-ba76-cd7391d0a5ba tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:50.934022 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=22 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:50.938077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9be638e9-937e-41b1-ba76-cd7391d0a5ba tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:50.938701 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9be638e9-937e-41b1-ba76-cd7391d0a5ba tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:50.939264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9be638e9-937e-41b1-ba76-cd7391d0a5ba tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:50.941566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9be638e9-937e-41b1-ba76-cd7391d0a5ba tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:50.941566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9be638e9-937e-41b1-ba76-cd7391d0a5ba tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:50.941566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9be638e9-937e-41b1-ba76-cd7391d0a5ba tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:51.128332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-020a73ff-7743-483a-be9a-f0c680eda282 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fef8a6c8c5e4eab9656d3f86511c7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3f2746c4894fdea00a84678e47f990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:51.137382 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-020a73ff-7743-483a-be9a-f0c680eda282 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] 10.222.0.93 "GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478" status: 200 len: 1395 microversion: 2.1 time: 0.283512 Aug 04 17:02:51.138163 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1069/2075] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:50 2022] GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478 => generated 1395 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:51.142803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-82abb009-170b-474a-b547-6148d7892fe1 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:51.143461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-82abb009-170b-474a-b547-6148d7892fe1 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: a6fb758e-d1f2-4244-b287-d93d20a53ac5] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:51.146452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9be638e9-937e-41b1-ba76-cd7391d0a5ba tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:51.154111 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9be638e9-937e-41b1-ba76-cd7391d0a5ba tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1388 microversion: 2.1 time: 0.230527 Aug 04 17:02:51.154678 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1007/2076] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:50 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1388 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:51.176012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82abb009-170b-474a-b547-6148d7892fe1 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:51.176777 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82abb009-170b-474a-b547-6148d7892fe1 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:51.177408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82abb009-170b-474a-b547-6148d7892fe1 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:51.178506 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82abb009-170b-474a-b547-6148d7892fe1 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:51.179152 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82abb009-170b-474a-b547-6148d7892fe1 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:51.182117 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82abb009-170b-474a-b547-6148d7892fe1 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:51.330026 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-82abb009-170b-474a-b547-6148d7892fe1 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a373cb0cd004b65a4ea9c804cbea3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82de1eabf714c3492860c2a65df5ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:51.341796 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-82abb009-170b-474a-b547-6148d7892fe1 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5" status: 200 len: 1317 microversion: 2.1 time: 0.201826 Aug 04 17:02:51.344021 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1070/2077] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:51 2022] GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5 => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:51.644361 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c75b82ea-0964-41f9-b237-c6e5612aa6b1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:51.644979 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c75b82ea-0964-41f9-b237-c6e5612aa6b1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:51.647847 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-57e35222-af39-4c14-ad89-4d82aa39e7e0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:51.648489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-57e35222-af39-4c14-ad89-4d82aa39e7e0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:51.664127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57e35222-af39-4c14-ad89-4d82aa39e7e0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:51.664546 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c75b82ea-0964-41f9-b237-c6e5612aa6b1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:51.665271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57e35222-af39-4c14-ad89-4d82aa39e7e0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:51.666057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c75b82ea-0964-41f9-b237-c6e5612aa6b1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:51.666733 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57e35222-af39-4c14-ad89-4d82aa39e7e0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:51.667394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c75b82ea-0964-41f9-b237-c6e5612aa6b1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:51.668130 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c75b82ea-0964-41f9-b237-c6e5612aa6b1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:51.668592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c75b82ea-0964-41f9-b237-c6e5612aa6b1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:51.669019 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c75b82ea-0964-41f9-b237-c6e5612aa6b1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:51.672341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57e35222-af39-4c14-ad89-4d82aa39e7e0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:51.672813 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57e35222-af39-4c14-ad89-4d82aa39e7e0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:51.673247 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57e35222-af39-4c14-ad89-4d82aa39e7e0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:51.929825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-57e35222-af39-4c14-ad89-4d82aa39e7e0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:51.942407 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-57e35222-af39-4c14-ad89-4d82aa39e7e0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1498 microversion: 2.1 time: 0.306339 Aug 04 17:02:51.943761 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1008/2078] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:51 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1498 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:02:51.950552 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fa5df0b4-d880-47a4-86a6-59229b1a0b58 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e6c9a2dc0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:51.961674 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c75b82ea-0964-41f9-b237-c6e5612aa6b1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:51.975482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c75b82ea-0964-41f9-b237-c6e5612aa6b1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:51.977138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c75b82ea-0964-41f9-b237-c6e5612aa6b1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:51.978336 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c75b82ea-0964-41f9-b237-c6e5612aa6b1 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1486 microversion: 2.25 time: 0.337737 Aug 04 17:02:51.993219 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1071/2079] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:51 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1486 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:02:51.998085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-870facb1-812b-4b42-9381-36c9b28746e8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:51.998702 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-870facb1-812b-4b42-9381-36c9b28746e8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:52.000693 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:52.008116 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fa5df0b4-d880-47a4-86a6-59229b1a0b58 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96" status: 200 len: 1428 microversion: 2.1 time: 0.062468 Aug 04 17:02:52.008660 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1009/2080] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:51 2022] GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96 => generated 1428 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:52.013503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-870facb1-812b-4b42-9381-36c9b28746e8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:52.014029 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-870facb1-812b-4b42-9381-36c9b28746e8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:52.014651 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-870facb1-812b-4b42-9381-36c9b28746e8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:52.015175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-870facb1-812b-4b42-9381-36c9b28746e8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:52.015628 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-870facb1-812b-4b42-9381-36c9b28746e8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:52.016056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-870facb1-812b-4b42-9381-36c9b28746e8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:52.163949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fad42b8a-168d-4d97-837f-884bfd0920b8 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:52.164690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fad42b8a-168d-4d97-837f-884bfd0920b8 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] [instance: 28e0f947-b275-48aa-90f0-bc74218c9478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:52.171937 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fad42b8a-168d-4d97-837f-884bfd0920b8 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:52.172438 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fad42b8a-168d-4d97-837f-884bfd0920b8 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:52.173057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fad42b8a-168d-4d97-837f-884bfd0920b8 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:52.173774 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fad42b8a-168d-4d97-837f-884bfd0920b8 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:52.174257 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fad42b8a-168d-4d97-837f-884bfd0920b8 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:52.174910 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fad42b8a-168d-4d97-837f-884bfd0920b8 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:52.180426 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-870facb1-812b-4b42-9381-36c9b28746e8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:52.189377 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-870facb1-812b-4b42-9381-36c9b28746e8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1527 microversion: 2.1 time: 0.195021 Aug 04 17:02:52.191517 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1072/2081] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:51 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1527 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:52.196344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6ec1cd96-10c3-47d6-bb84-a829f8ff448e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:52.197131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6ec1cd96-10c3-47d6-bb84-a829f8ff448e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:52.204320 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ec1cd96-10c3-47d6-bb84-a829f8ff448e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:52.204956 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ec1cd96-10c3-47d6-bb84-a829f8ff448e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:52.205601 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ec1cd96-10c3-47d6-bb84-a829f8ff448e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:52.206921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ec1cd96-10c3-47d6-bb84-a829f8ff448e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:52.207516 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ec1cd96-10c3-47d6-bb84-a829f8ff448e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:52.208032 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ec1cd96-10c3-47d6-bb84-a829f8ff448e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:52.472467 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fad42b8a-168d-4d97-837f-884bfd0920b8 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fef8a6c8c5e4eab9656d3f86511c7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3f2746c4894fdea00a84678e47f990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:52.480594 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fad42b8a-168d-4d97-837f-884bfd0920b8 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] 10.222.0.93 "GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478" status: 200 len: 1395 microversion: 2.1 time: 0.322267 Aug 04 17:02:52.481820 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1010/2082] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:52 2022] GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478 => generated 1395 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:02:52.486734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6ec1cd96-10c3-47d6-bb84-a829f8ff448e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:52.488269 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0125634e-ccd1-4ffc-840d-89d0a633013c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:52.488893 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0125634e-ccd1-4ffc-840d-89d0a633013c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: a6fb758e-d1f2-4244-b287-d93d20a53ac5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:52.494892 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6ec1cd96-10c3-47d6-bb84-a829f8ff448e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1388 microversion: 2.1 time: 0.302288 Aug 04 17:02:52.495118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0125634e-ccd1-4ffc-840d-89d0a633013c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:52.495669 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1073/2083] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:52 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1388 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:52.495810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0125634e-ccd1-4ffc-840d-89d0a633013c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:52.496038 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0125634e-ccd1-4ffc-840d-89d0a633013c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:52.496794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0125634e-ccd1-4ffc-840d-89d0a633013c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:52.497301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0125634e-ccd1-4ffc-840d-89d0a633013c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:52.497711 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0125634e-ccd1-4ffc-840d-89d0a633013c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:52.680055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0125634e-ccd1-4ffc-840d-89d0a633013c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a373cb0cd004b65a4ea9c804cbea3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82de1eabf714c3492860c2a65df5ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:52.688488 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0125634e-ccd1-4ffc-840d-89d0a633013c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5" status: 200 len: 1317 microversion: 2.1 time: 0.204835 Aug 04 17:02:52.689564 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1011/2084] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:52 2022] GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5 => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:52.848739 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-49489475-80ee-4078-8e91-07c18eacc0c1 req-184f188c-adbd-45e8-bc97-7adbc64d6ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "826b896f-e0e0-48e1-a520-b5fade2c374b", "name": "network-vif-plugged", "status": "completed", "tag": "0f610c46-1aef-4767-b0af-3f6a244761f6"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:52.882415 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-49489475-80ee-4078-8e91-07c18eacc0c1 req-184f188c-adbd-45e8-bc97-7adbc64d6ee0 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:52.882916 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-49489475-80ee-4078-8e91-07c18eacc0c1 req-184f188c-adbd-45e8-bc97-7adbc64d6ee0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:52.883370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-49489475-80ee-4078-8e91-07c18eacc0c1 req-184f188c-adbd-45e8-bc97-7adbc64d6ee0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:52.902616 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-49489475-80ee-4078-8e91-07c18eacc0c1 req-184f188c-adbd-45e8-bc97-7adbc64d6ee0 service nova] Creating event network-vif-plugged:0f610c46-1aef-4767-b0af-3f6a244761f6 for instance 826b896f-e0e0-48e1-a520-b5fade2c374b on n-h1-851359-3 Aug 04 17:02:52.911114 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-49489475-80ee-4078-8e91-07c18eacc0c1 req-184f188c-adbd-45e8-bc97-7adbc64d6ee0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066591 Aug 04 17:02:52.912100 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1074/2085] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:52.964622 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-02030b2a-6740-4e28-9784-d2b3de962298 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:52.965252 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-02030b2a-6740-4e28-9784-d2b3de962298 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:52.975702 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02030b2a-6740-4e28-9784-d2b3de962298 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:52.976209 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02030b2a-6740-4e28-9784-d2b3de962298 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:52.976662 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02030b2a-6740-4e28-9784-d2b3de962298 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:52.977383 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02030b2a-6740-4e28-9784-d2b3de962298 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:52.977851 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02030b2a-6740-4e28-9784-d2b3de962298 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:52.978311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02030b2a-6740-4e28-9784-d2b3de962298 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:53.003190 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-65a2b1d9-a61f-4ae0-b6d6-a02b6ea56a4a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:53.004325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-65a2b1d9-a61f-4ae0-b6d6-a02b6ea56a4a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:53.011613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65a2b1d9-a61f-4ae0-b6d6-a02b6ea56a4a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:53.012390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65a2b1d9-a61f-4ae0-b6d6-a02b6ea56a4a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:53.013009 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65a2b1d9-a61f-4ae0-b6d6-a02b6ea56a4a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:53.013932 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65a2b1d9-a61f-4ae0-b6d6-a02b6ea56a4a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:53.014582 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65a2b1d9-a61f-4ae0-b6d6-a02b6ea56a4a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:53.015176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65a2b1d9-a61f-4ae0-b6d6-a02b6ea56a4a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:53.412169 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-65a2b1d9-a61f-4ae0-b6d6-a02b6ea56a4a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:53.425186 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-65a2b1d9-a61f-4ae0-b6d6-a02b6ea56a4a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:53.426708 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-65a2b1d9-a61f-4ae0-b6d6-a02b6ea56a4a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:53.432456 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-65a2b1d9-a61f-4ae0-b6d6-a02b6ea56a4a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1486 microversion: 2.25 time: 0.430281 Aug 04 17:02:53.433700 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1075/2086] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:52 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1486 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:53.438620 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fc50cc14-fc3c-4a5d-bacd-e7da6b68a534 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5af055e0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:53.479307 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-02030b2a-6740-4e28-9784-d2b3de962298 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:53.539010 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-02030b2a-6740-4e28-9784-d2b3de962298 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1498 microversion: 2.1 time: 0.578117 Aug 04 17:02:53.549621 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1012/2087] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:52 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1498 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:53.563914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e47d1cf8-2f57-4e4a-a58d-62108b63d130 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:53.566493 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e47d1cf8-2f57-4e4a-a58d-62108b63d130 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:53.582860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e47d1cf8-2f57-4e4a-a58d-62108b63d130 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:53.583462 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e47d1cf8-2f57-4e4a-a58d-62108b63d130 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:53.586209 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e47d1cf8-2f57-4e4a-a58d-62108b63d130 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:53.586428 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fc50cc14-fc3c-4a5d-bacd-e7da6b68a534 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96" status: 200 len: 1428 microversion: 2.1 time: 0.150866 Aug 04 17:02:53.587113 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e47d1cf8-2f57-4e4a-a58d-62108b63d130 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:53.587739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e47d1cf8-2f57-4e4a-a58d-62108b63d130 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:53.589137 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1076/2088] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:53 2022] GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96 => generated 1428 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:53.589735 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e47d1cf8-2f57-4e4a-a58d-62108b63d130 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:53.605271 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-429eeb86-acb5-45ae-b83b-40a890fad0cf tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:53.606669 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-429eeb86-acb5-45ae-b83b-40a890fad0cf tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] [instance: 28e0f947-b275-48aa-90f0-bc74218c9478] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:53.621514 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-429eeb86-acb5-45ae-b83b-40a890fad0cf tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:53.622606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-429eeb86-acb5-45ae-b83b-40a890fad0cf tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:53.626044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-429eeb86-acb5-45ae-b83b-40a890fad0cf tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:53.628456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-429eeb86-acb5-45ae-b83b-40a890fad0cf tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:53.630478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-429eeb86-acb5-45ae-b83b-40a890fad0cf tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:53.631087 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-429eeb86-acb5-45ae-b83b-40a890fad0cf tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:53.957291 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e47d1cf8-2f57-4e4a-a58d-62108b63d130 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:53.959147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-429eeb86-acb5-45ae-b83b-40a890fad0cf tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fef8a6c8c5e4eab9656d3f86511c7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3f2746c4894fdea00a84678e47f990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:53.966950 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-429eeb86-acb5-45ae-b83b-40a890fad0cf tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] 10.222.0.93 "GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478" status: 200 len: 1395 microversion: 2.1 time: 0.376209 Aug 04 17:02:53.968817 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1077/2089] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:53 2022] GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478 => generated 1395 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:53.973363 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e47d1cf8-2f57-4e4a-a58d-62108b63d130 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1522 microversion: 2.1 time: 0.420888 Aug 04 17:02:53.974204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-666cbbc5-fbf5-495b-8dc8-f92d3cbb5fec tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:53.975422 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-666cbbc5-fbf5-495b-8dc8-f92d3cbb5fec tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:53.982136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-666cbbc5-fbf5-495b-8dc8-f92d3cbb5fec tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:53.982913 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-666cbbc5-fbf5-495b-8dc8-f92d3cbb5fec tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:53.983555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-666cbbc5-fbf5-495b-8dc8-f92d3cbb5fec tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:53.984434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-666cbbc5-fbf5-495b-8dc8-f92d3cbb5fec tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:53.985072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-666cbbc5-fbf5-495b-8dc8-f92d3cbb5fec tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:53.985678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-666cbbc5-fbf5-495b-8dc8-f92d3cbb5fec tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:53.989816 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1013/2090] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:53 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1522 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:54.011673 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ee740074-582d-4d58-8377-ffff7a0c9995 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:54.012485 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ee740074-582d-4d58-8377-ffff7a0c9995 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: a6fb758e-d1f2-4244-b287-d93d20a53ac5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:54.020547 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee740074-582d-4d58-8377-ffff7a0c9995 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:54.021008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee740074-582d-4d58-8377-ffff7a0c9995 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:54.021472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee740074-582d-4d58-8377-ffff7a0c9995 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:54.022249 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee740074-582d-4d58-8377-ffff7a0c9995 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:54.022819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee740074-582d-4d58-8377-ffff7a0c9995 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:54.023894 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee740074-582d-4d58-8377-ffff7a0c9995 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:54.055316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-666cbbc5-fbf5-495b-8dc8-f92d3cbb5fec tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:54.063599 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-666cbbc5-fbf5-495b-8dc8-f92d3cbb5fec tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1346 microversion: 2.1 time: 0.093410 Aug 04 17:02:54.066753 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1078/2091] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:53 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1346 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:54.166025 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-9720ef99-16be-4f40-a336-bb42375f5133 req-4be685e5-0c7c-4a63-a1fe-5d82b1bd0bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3", "name": "network-vif-deleted", "tag": "67e31e5f-833c-4ef7-a84f-df2439c611ff"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:54.182689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9720ef99-16be-4f40-a336-bb42375f5133 req-4be685e5-0c7c-4a63-a1fe-5d82b1bd0bf2 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:54.184777 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9720ef99-16be-4f40-a336-bb42375f5133 req-4be685e5-0c7c-4a63-a1fe-5d82b1bd0bf2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:54.186713 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9720ef99-16be-4f40-a336-bb42375f5133 req-4be685e5-0c7c-4a63-a1fe-5d82b1bd0bf2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:54.207536 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-9720ef99-16be-4f40-a336-bb42375f5133 req-4be685e5-0c7c-4a63-a1fe-5d82b1bd0bf2 service nova] Creating event network-vif-deleted:67e31e5f-833c-4ef7-a84f-df2439c611ff for instance 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 on n-h1-851359-3 Aug 04 17:02:54.213513 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-9720ef99-16be-4f40-a336-bb42375f5133 req-4be685e5-0c7c-4a63-a1fe-5d82b1bd0bf2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051512 Aug 04 17:02:54.214698 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1079/2092] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:02:54.312501 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ee740074-582d-4d58-8377-ffff7a0c9995 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a373cb0cd004b65a4ea9c804cbea3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82de1eabf714c3492860c2a65df5ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:54.321365 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ee740074-582d-4d58-8377-ffff7a0c9995 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5" status: 200 len: 1317 microversion: 2.1 time: 0.330530 Aug 04 17:02:54.327061 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1014/2093] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:53 2022] GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5 => generated 1317 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:54.458450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0581d1ab-4706-405a-9568-ae5a8dc6f28d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:54.459373 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0581d1ab-4706-405a-9568-ae5a8dc6f28d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:54.475532 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:54.477783 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0581d1ab-4706-405a-9568-ae5a8dc6f28d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:54.478323 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0581d1ab-4706-405a-9568-ae5a8dc6f28d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:54.478778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0581d1ab-4706-405a-9568-ae5a8dc6f28d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:54.479513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0581d1ab-4706-405a-9568-ae5a8dc6f28d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:54.479996 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0581d1ab-4706-405a-9568-ae5a8dc6f28d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:54.480435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0581d1ab-4706-405a-9568-ae5a8dc6f28d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:54.573767 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-802eaca4-17b4-4db7-b356-f5954a0ddba4 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:54.574989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-802eaca4-17b4-4db7-b356-f5954a0ddba4 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:54.583528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-802eaca4-17b4-4db7-b356-f5954a0ddba4 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:54.584317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-802eaca4-17b4-4db7-b356-f5954a0ddba4 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:54.585187 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-802eaca4-17b4-4db7-b356-f5954a0ddba4 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:54.586341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-802eaca4-17b4-4db7-b356-f5954a0ddba4 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:54.587045 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-802eaca4-17b4-4db7-b356-f5954a0ddba4 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:54.587711 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-802eaca4-17b4-4db7-b356-f5954a0ddba4 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:54.855183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-802eaca4-17b4-4db7-b356-f5954a0ddba4 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:54.873873 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-802eaca4-17b4-4db7-b356-f5954a0ddba4 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1498 microversion: 2.1 time: 0.306853 Aug 04 17:02:54.891371 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1015/2094] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:54 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1498 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:54.910939 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cb39d53c-7853-433c-ae1f-b932c3be1ec3 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e6c9a21f0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:55.048601 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0581d1ab-4706-405a-9568-ae5a8dc6f28d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:55.060430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0581d1ab-4706-405a-9568-ae5a8dc6f28d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:55.062276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0581d1ab-4706-405a-9568-ae5a8dc6f28d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:55.063823 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0581d1ab-4706-405a-9568-ae5a8dc6f28d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1486 microversion: 2.25 time: 0.610564 Aug 04 17:02:55.065162 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1080/2095] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:54 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1486 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:55.071798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-471f3943-2f38-4bb3-b9b0-b98551060e52 req-6dc1ce6a-3e6b-480f-8a4f-e7c74f0c18a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28e0f947-b275-48aa-90f0-bc74218c9478", "name": "network-vif-plugged", "status": "completed", "tag": "b54af5f4-7d06-458b-b36f-c876adabf6c0"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:55.097425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-471f3943-2f38-4bb3-b9b0-b98551060e52 req-6dc1ce6a-3e6b-480f-8a4f-e7c74f0c18a0 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:55.098279 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-471f3943-2f38-4bb3-b9b0-b98551060e52 req-6dc1ce6a-3e6b-480f-8a4f-e7c74f0c18a0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:55.098975 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-471f3943-2f38-4bb3-b9b0-b98551060e52 req-6dc1ce6a-3e6b-480f-8a4f-e7c74f0c18a0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:55.142733 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-471f3943-2f38-4bb3-b9b0-b98551060e52 req-6dc1ce6a-3e6b-480f-8a4f-e7c74f0c18a0 service nova] Creating event network-vif-plugged:b54af5f4-7d06-458b-b36f-c876adabf6c0 for instance 28e0f947-b275-48aa-90f0-bc74218c9478 on n-h1-851359-3 Aug 04 17:02:55.155624 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-471f3943-2f38-4bb3-b9b0-b98551060e52 req-6dc1ce6a-3e6b-480f-8a4f-e7c74f0c18a0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088340 Aug 04 17:02:55.157455 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1081/2096] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:55.174321 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a8083cee-afdd-4910-bf6b-d6b6cbd857c6 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:55.175981 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a8083cee-afdd-4910-bf6b-d6b6cbd857c6 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] [instance: 28e0f947-b275-48aa-90f0-bc74218c9478] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:55.194219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8083cee-afdd-4910-bf6b-d6b6cbd857c6 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:55.194931 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8083cee-afdd-4910-bf6b-d6b6cbd857c6 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:55.195378 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8083cee-afdd-4910-bf6b-d6b6cbd857c6 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:55.196099 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8083cee-afdd-4910-bf6b-d6b6cbd857c6 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:55.196561 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8083cee-afdd-4910-bf6b-d6b6cbd857c6 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:55.198194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8083cee-afdd-4910-bf6b-d6b6cbd857c6 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:55.543848 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a8083cee-afdd-4910-bf6b-d6b6cbd857c6 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fef8a6c8c5e4eab9656d3f86511c7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3f2746c4894fdea00a84678e47f990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:55.553115 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a8083cee-afdd-4910-bf6b-d6b6cbd857c6 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] 10.222.0.93 "GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478" status: 200 len: 1395 microversion: 2.1 time: 0.391926 Aug 04 17:02:55.553703 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1082/2097] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:55 2022] GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478 => generated 1395 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:55.594772 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-44ba3894-c2c1-473f-aedb-28fd7fb102aa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:55.595355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-44ba3894-c2c1-473f-aedb-28fd7fb102aa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:55.621161 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-44ba3894-c2c1-473f-aedb-28fd7fb102aa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:55.621665 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-44ba3894-c2c1-473f-aedb-28fd7fb102aa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:55.622148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-44ba3894-c2c1-473f-aedb-28fd7fb102aa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:55.622871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-44ba3894-c2c1-473f-aedb-28fd7fb102aa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:55.623334 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-44ba3894-c2c1-473f-aedb-28fd7fb102aa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:55.624743 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-44ba3894-c2c1-473f-aedb-28fd7fb102aa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:56.036701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-44ba3894-c2c1-473f-aedb-28fd7fb102aa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:56.053121 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-44ba3894-c2c1-473f-aedb-28fd7fb102aa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1522 microversion: 2.1 time: 0.465171 Aug 04 17:02:56.054042 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1083/2098] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:55 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1522 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:56.089755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7059c74b-b825-47c2-baf8-4fc435ac6336 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:56.090916 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7059c74b-b825-47c2-baf8-4fc435ac6336 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:56.099443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7059c74b-b825-47c2-baf8-4fc435ac6336 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:56.100222 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7059c74b-b825-47c2-baf8-4fc435ac6336 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:56.101028 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7059c74b-b825-47c2-baf8-4fc435ac6336 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:56.102115 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7059c74b-b825-47c2-baf8-4fc435ac6336 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:56.102895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7059c74b-b825-47c2-baf8-4fc435ac6336 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:56.103631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7059c74b-b825-47c2-baf8-4fc435ac6336 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:56.239133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7059c74b-b825-47c2-baf8-4fc435ac6336 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:56.251565 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7059c74b-b825-47c2-baf8-4fc435ac6336 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1184 microversion: 2.1 time: 0.176021 Aug 04 17:02:56.255163 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1084/2099] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:56 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1184 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:56.273084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0e65a120-c1f3-4959-9ade-3c2b2bb030af tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:56.274138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0e65a120-c1f3-4959-9ade-3c2b2bb030af tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: a6fb758e-d1f2-4244-b287-d93d20a53ac5] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:56.290497 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e65a120-c1f3-4959-9ade-3c2b2bb030af tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:56.291951 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e65a120-c1f3-4959-9ade-3c2b2bb030af tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:56.293479 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e65a120-c1f3-4959-9ade-3c2b2bb030af tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:56.298897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e65a120-c1f3-4959-9ade-3c2b2bb030af tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:56.301552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e65a120-c1f3-4959-9ade-3c2b2bb030af tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:56.302527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e65a120-c1f3-4959-9ade-3c2b2bb030af tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:56.707938 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0e65a120-c1f3-4959-9ade-3c2b2bb030af tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a373cb0cd004b65a4ea9c804cbea3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82de1eabf714c3492860c2a65df5ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:56.735614 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0e65a120-c1f3-4959-9ade-3c2b2bb030af tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5" status: 200 len: 1317 microversion: 2.1 time: 0.471882 Aug 04 17:02:56.760685 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1085/2100] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:56 2022] GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5 => generated 1317 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:56.786366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-293f883b-1348-4066-920d-16a97b33d138 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:56.787169 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-293f883b-1348-4066-920d-16a97b33d138 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:56.807484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-293f883b-1348-4066-920d-16a97b33d138 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:56.811124 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-293f883b-1348-4066-920d-16a97b33d138 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:56.814944 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-293f883b-1348-4066-920d-16a97b33d138 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:56.823033 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-293f883b-1348-4066-920d-16a97b33d138 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:56.832431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-293f883b-1348-4066-920d-16a97b33d138 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:56.833069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-293f883b-1348-4066-920d-16a97b33d138 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:57.180454 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-293f883b-1348-4066-920d-16a97b33d138 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:57.193247 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-293f883b-1348-4066-920d-16a97b33d138 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1498 microversion: 2.1 time: 0.430322 Aug 04 17:02:57.199789 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1086/2101] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:56 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1498 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:57.215726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3742299a-819a-4f6a-84bf-1a9e6b607ff2 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:57.217683 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3742299a-819a-4f6a-84bf-1a9e6b607ff2 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:57.225272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3742299a-819a-4f6a-84bf-1a9e6b607ff2 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:57.226031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3742299a-819a-4f6a-84bf-1a9e6b607ff2 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:57.226579 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3742299a-819a-4f6a-84bf-1a9e6b607ff2 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:57.227566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3742299a-819a-4f6a-84bf-1a9e6b607ff2 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:57.228745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3742299a-819a-4f6a-84bf-1a9e6b607ff2 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:57.229428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3742299a-819a-4f6a-84bf-1a9e6b607ff2 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:57.604019 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3742299a-819a-4f6a-84bf-1a9e6b607ff2 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:57.613810 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3742299a-819a-4f6a-84bf-1a9e6b607ff2 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:57.620339 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3742299a-819a-4f6a-84bf-1a9e6b607ff2 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:57.624108 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3742299a-819a-4f6a-84bf-1a9e6b607ff2 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1486 microversion: 2.25 time: 0.422070 Aug 04 17:02:57.628220 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1087/2102] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:57 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1486 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:57.644002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8ad6de34-145d-44dc-8f30-5ce93f5070a2 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:57.648161 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8ad6de34-145d-44dc-8f30-5ce93f5070a2 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] [instance: 28e0f947-b275-48aa-90f0-bc74218c9478] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:57.668430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ad6de34-145d-44dc-8f30-5ce93f5070a2 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:57.669301 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ad6de34-145d-44dc-8f30-5ce93f5070a2 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:57.670506 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ad6de34-145d-44dc-8f30-5ce93f5070a2 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:57.673598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ad6de34-145d-44dc-8f30-5ce93f5070a2 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:57.674450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ad6de34-145d-44dc-8f30-5ce93f5070a2 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:57.675156 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ad6de34-145d-44dc-8f30-5ce93f5070a2 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:57.728797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:58.064916 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8ad6de34-145d-44dc-8f30-5ce93f5070a2 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fef8a6c8c5e4eab9656d3f86511c7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3f2746c4894fdea00a84678e47f990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:58.089225 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8ad6de34-145d-44dc-8f30-5ce93f5070a2 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] 10.222.0.93 "GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478" status: 200 len: 1576 microversion: 2.1 time: 0.459523 Aug 04 17:02:58.107259 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1088/2103] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:57 2022] GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478 => generated 1576 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:58.120963 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-42eb3b66-adf4-4bb9-a86f-e0651d6b5f01 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:58.124325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-42eb3b66-adf4-4bb9-a86f-e0651d6b5f01 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:58.132715 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42eb3b66-adf4-4bb9-a86f-e0651d6b5f01 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:58.133217 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42eb3b66-adf4-4bb9-a86f-e0651d6b5f01 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:58.133661 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42eb3b66-adf4-4bb9-a86f-e0651d6b5f01 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:58.134594 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42eb3b66-adf4-4bb9-a86f-e0651d6b5f01 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:58.135092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42eb3b66-adf4-4bb9-a86f-e0651d6b5f01 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:58.135533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42eb3b66-adf4-4bb9-a86f-e0651d6b5f01 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:58.504758 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-42eb3b66-adf4-4bb9-a86f-e0651d6b5f01 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:58.523807 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-42eb3b66-adf4-4bb9-a86f-e0651d6b5f01 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1522 microversion: 2.1 time: 0.415277 Aug 04 17:02:58.529041 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1089/2104] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:58 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1522 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:58.544141 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6bf975cf-1c9a-4080-a1d4-569d858c3d32 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:58.546876 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6bf975cf-1c9a-4080-a1d4-569d858c3d32 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:58.556212 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6bf975cf-1c9a-4080-a1d4-569d858c3d32 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:58.556876 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6bf975cf-1c9a-4080-a1d4-569d858c3d32 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:58.557498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6bf975cf-1c9a-4080-a1d4-569d858c3d32 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:58.558418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6bf975cf-1c9a-4080-a1d4-569d858c3d32 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:58.559247 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6bf975cf-1c9a-4080-a1d4-569d858c3d32 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:58.559896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6bf975cf-1c9a-4080-a1d4-569d858c3d32 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:58.679245 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6bf975cf-1c9a-4080-a1d4-569d858c3d32 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:58.690673 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6bf975cf-1c9a-4080-a1d4-569d858c3d32 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1184 microversion: 2.1 time: 0.159168 Aug 04 17:02:58.707808 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1090/2105] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:58 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1184 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:58.715504 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c0bd8a48-eab3-4195-a3c7-b3891631526e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:58.716485 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c0bd8a48-eab3-4195-a3c7-b3891631526e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:58.726882 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c0bd8a48-eab3-4195-a3c7-b3891631526e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:58.737506 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c0bd8a48-eab3-4195-a3c7-b3891631526e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:58.737506 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c0bd8a48-eab3-4195-a3c7-b3891631526e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:58.738416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c0bd8a48-eab3-4195-a3c7-b3891631526e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:58.739177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c0bd8a48-eab3-4195-a3c7-b3891631526e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:58.741544 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c0bd8a48-eab3-4195-a3c7-b3891631526e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:59.051997 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cb39d53c-7853-433c-ae1f-b932c3be1ec3 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96" status: 200 len: 1437 microversion: 2.1 time: 4.155058 Aug 04 17:02:59.052643 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1016/2106] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:54 2022] GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96 => generated 1437 bytes in 4160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:59.060480 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-64750b94-3567-47c6-b264-a6bf220c6dde tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:59.067508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-64750b94-3567-47c6-b264-a6bf220c6dde tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: a6fb758e-d1f2-4244-b287-d93d20a53ac5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:59.078773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64750b94-3567-47c6-b264-a6bf220c6dde tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:59.079262 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64750b94-3567-47c6-b264-a6bf220c6dde tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:59.081347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64750b94-3567-47c6-b264-a6bf220c6dde tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:59.082376 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64750b94-3567-47c6-b264-a6bf220c6dde tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:59.088507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64750b94-3567-47c6-b264-a6bf220c6dde tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:59.089181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64750b94-3567-47c6-b264-a6bf220c6dde tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:59.137518 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c0bd8a48-eab3-4195-a3c7-b3891631526e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:59.153134 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c0bd8a48-eab3-4195-a3c7-b3891631526e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:59.160589 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c0bd8a48-eab3-4195-a3c7-b3891631526e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:59.162283 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c0bd8a48-eab3-4195-a3c7-b3891631526e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 2944 microversion: 2.32 time: 0.453013 Aug 04 17:02:59.186439 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1091/2107] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:58 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 2944 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:59.201912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-5a76e8fa-6fa2-4e53-b798-2ecb527a87d4 req-9b233077-241b-4a37-b028-bb0f7e46e99f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84f56763-a994-4d26-96d4-a6d1ba68566c", "name": "network-vif-unplugged", "status": "completed", "tag": "10ad4377-3641-452e-aee7-2170593948a9"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:59.223219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-5a76e8fa-6fa2-4e53-b798-2ecb527a87d4 req-9b233077-241b-4a37-b028-bb0f7e46e99f service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:59.224227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-5a76e8fa-6fa2-4e53-b798-2ecb527a87d4 req-9b233077-241b-4a37-b028-bb0f7e46e99f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:59.224747 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-5a76e8fa-6fa2-4e53-b798-2ecb527a87d4 req-9b233077-241b-4a37-b028-bb0f7e46e99f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:59.241800 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-5a76e8fa-6fa2-4e53-b798-2ecb527a87d4 req-9b233077-241b-4a37-b028-bb0f7e46e99f service nova] Creating event network-vif-unplugged:10ad4377-3641-452e-aee7-2170593948a9 for instance 84f56763-a994-4d26-96d4-a6d1ba68566c on n-h1-851359-3 Aug 04 17:02:59.247490 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-5a76e8fa-6fa2-4e53-b798-2ecb527a87d4 req-9b233077-241b-4a37-b028-bb0f7e46e99f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059624 Aug 04 17:02:59.248385 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1092/2108] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:59.255093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-adbb3263-3a90-4504-9fc8-9fa6c569b90e tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:59.255778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-adbb3263-3a90-4504-9fc8-9fa6c569b90e tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] [instance: 28e0f947-b275-48aa-90f0-bc74218c9478] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:59.262374 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-adbb3263-3a90-4504-9fc8-9fa6c569b90e tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:59.263172 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-adbb3263-3a90-4504-9fc8-9fa6c569b90e tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:59.263854 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-adbb3263-3a90-4504-9fc8-9fa6c569b90e tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:59.264790 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-adbb3263-3a90-4504-9fc8-9fa6c569b90e tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:59.265463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-adbb3263-3a90-4504-9fc8-9fa6c569b90e tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:59.266135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-adbb3263-3a90-4504-9fc8-9fa6c569b90e tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:59.336895 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-64750b94-3567-47c6-b264-a6bf220c6dde tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a373cb0cd004b65a4ea9c804cbea3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82de1eabf714c3492860c2a65df5ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:59.343429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:02:59.346322 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-64750b94-3567-47c6-b264-a6bf220c6dde tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5" status: 200 len: 1317 microversion: 2.1 time: 0.292659 Aug 04 17:02:59.363080 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1017/2109] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:59 2022] GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5 => generated 1317 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:59.379449 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8166b864-e07e-47d9-b4de-5222e56e8293 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:59.380338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8166b864-e07e-47d9-b4de-5222e56e8293 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:59.386779 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8166b864-e07e-47d9-b4de-5222e56e8293 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:59.392444 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8166b864-e07e-47d9-b4de-5222e56e8293 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:59.393636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8166b864-e07e-47d9-b4de-5222e56e8293 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:59.394468 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-adbb3263-3a90-4504-9fc8-9fa6c569b90e tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] 10.222.0.93 "GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.144571 Aug 04 17:02:59.394807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8166b864-e07e-47d9-b4de-5222e56e8293 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:59.395068 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1093/2110] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Aug 4 17:02:59 2022] GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478/os-interface => generated 285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:59.395744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8166b864-e07e-47d9-b4de-5222e56e8293 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:59.396386 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8166b864-e07e-47d9-b4de-5222e56e8293 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:59.399709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-af7a8988-8365-4688-9cf8-14acaf5b3854 req-1601f5d2-a4d4-4fdc-8c87-8c2b201cf520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba09cec5-a546-4fe5-90df-c90d94591fb2", "name": "network-vif-plugged", "status": "completed", "tag": "14919ddc-0463-47b2-9b85-fd575b876018"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:02:59.424241 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-af7a8988-8365-4688-9cf8-14acaf5b3854 req-1601f5d2-a4d4-4fdc-8c87-8c2b201cf520 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:59.426025 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-af7a8988-8365-4688-9cf8-14acaf5b3854 req-1601f5d2-a4d4-4fdc-8c87-8c2b201cf520 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:59.426025 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-af7a8988-8365-4688-9cf8-14acaf5b3854 req-1601f5d2-a4d4-4fdc-8c87-8c2b201cf520 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:59.447916 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-af7a8988-8365-4688-9cf8-14acaf5b3854 req-1601f5d2-a4d4-4fdc-8c87-8c2b201cf520 service nova] Creating event network-vif-plugged:14919ddc-0463-47b2-9b85-fd575b876018 for instance ba09cec5-a546-4fe5-90df-c90d94591fb2 on n-h1-851359-3 Aug 04 17:02:59.461770 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-af7a8988-8365-4688-9cf8-14acaf5b3854 req-1601f5d2-a4d4-4fdc-8c87-8c2b201cf520 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065164 Aug 04 17:02:59.462969 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1094/2111] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:02:59.468241 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bb2004a1-4c2e-4460-b168-a91975669fe3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:59.469192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bb2004a1-4c2e-4460-b168-a91975669fe3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:59.478762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bb2004a1-4c2e-4460-b168-a91975669fe3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:59.479919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bb2004a1-4c2e-4460-b168-a91975669fe3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:59.480563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bb2004a1-4c2e-4460-b168-a91975669fe3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:59.481478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bb2004a1-4c2e-4460-b168-a91975669fe3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:59.482179 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bb2004a1-4c2e-4460-b168-a91975669fe3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:59.482789 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bb2004a1-4c2e-4460-b168-a91975669fe3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:59.873497 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8166b864-e07e-47d9-b4de-5222e56e8293 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:59.884795 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8166b864-e07e-47d9-b4de-5222e56e8293 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1498 microversion: 2.1 time: 0.509427 Aug 04 17:02:59.885298 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1018/2112] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:59 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1498 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:59.895875 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bb2004a1-4c2e-4460-b168-a91975669fe3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:59.900324 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7241468d-04f3-4215-928d-38e255735fb4 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e6c9b85e0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:59.908377 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bb2004a1-4c2e-4460-b168-a91975669fe3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:59.911524 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bb2004a1-4c2e-4460-b168-a91975669fe3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:02:59.922615 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bb2004a1-4c2e-4460-b168-a91975669fe3 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1486 microversion: 2.25 time: 0.449901 Aug 04 17:02:59.924652 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1095/2113] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:02:59 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1486 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:02:59.931149 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-db5610de-c6f6-41e4-b6b6-0c697c2590d1 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:02:59.938543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-db5610de-c6f6-41e4-b6b6-0c697c2590d1 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:02:59.946952 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db5610de-c6f6-41e4-b6b6-0c697c2590d1 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:59.950189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db5610de-c6f6-41e4-b6b6-0c697c2590d1 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:59.950791 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db5610de-c6f6-41e4-b6b6-0c697c2590d1 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:59.951658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db5610de-c6f6-41e4-b6b6-0c697c2590d1 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:02:59.961073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db5610de-c6f6-41e4-b6b6-0c697c2590d1 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:02:59.961662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db5610de-c6f6-41e4-b6b6-0c697c2590d1 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:02:59.975787 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7241468d-04f3-4215-928d-38e255735fb4 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96" status: 200 len: 1437 microversion: 2.1 time: 0.080249 Aug 04 17:02:59.976858 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1019/2114] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:02:59 2022] GET /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96 => generated 1437 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:02:59.996338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8f240340-98e5-4704-80cd-039f94d42757 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:00.001437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8f240340-98e5-4704-80cd-039f94d42757 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:00.018677 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f240340-98e5-4704-80cd-039f94d42757 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:00.019581 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f240340-98e5-4704-80cd-039f94d42757 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:00.021114 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f240340-98e5-4704-80cd-039f94d42757 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:00.024598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f240340-98e5-4704-80cd-039f94d42757 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:00.025403 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f240340-98e5-4704-80cd-039f94d42757 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:00.026538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f240340-98e5-4704-80cd-039f94d42757 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:00.264803 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-db5610de-c6f6-41e4-b6b6-0c697c2590d1 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.337943 Aug 04 17:03:00.275217 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1096/2115] 10.222.0.93 () {60 vars in 1316 bytes} [Thu Aug 4 17:02:59 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274/os-interface => generated 1830 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:00.281108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b2e0a707-df84-4284-9e13-f4239d8853d5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:00.282071 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b2e0a707-df84-4284-9e13-f4239d8853d5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:00.293435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2e0a707-df84-4284-9e13-f4239d8853d5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:00.301678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2e0a707-df84-4284-9e13-f4239d8853d5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:00.302478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2e0a707-df84-4284-9e13-f4239d8853d5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:00.303445 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2e0a707-df84-4284-9e13-f4239d8853d5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:00.304116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2e0a707-df84-4284-9e13-f4239d8853d5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:00.304750 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2e0a707-df84-4284-9e13-f4239d8853d5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:00.460617 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b2e0a707-df84-4284-9e13-f4239d8853d5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:00.468966 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b2e0a707-df84-4284-9e13-f4239d8853d5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1184 microversion: 2.1 time: 0.192308 Aug 04 17:03:00.469566 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1097/2116] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:00 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1184 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:00.482869 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-54743b46-ec23-4a02-8446-1ba06f38427f tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:00.483840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-54743b46-ec23-4a02-8446-1ba06f38427f tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] [instance: c2695555-41cc-4eff-ae6c-9b8d443103bb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:00.503388 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-54743b46-ec23-4a02-8446-1ba06f38427f tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:00.504246 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-54743b46-ec23-4a02-8446-1ba06f38427f tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:00.504907 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-54743b46-ec23-4a02-8446-1ba06f38427f tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:00.505859 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-54743b46-ec23-4a02-8446-1ba06f38427f tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:00.514676 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-54743b46-ec23-4a02-8446-1ba06f38427f tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:00.515433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-54743b46-ec23-4a02-8446-1ba06f38427f tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:00.567298 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8f240340-98e5-4704-80cd-039f94d42757 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:00.576721 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8f240340-98e5-4704-80cd-039f94d42757 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1522 microversion: 2.1 time: 0.588513 Aug 04 17:03:00.576842 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1020/2117] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:02:59 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1522 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:00.588227 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0d537812-643f-4be3-823b-a788eb999742 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:00.590599 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0d537812-643f-4be3-823b-a788eb999742 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: a6fb758e-d1f2-4244-b287-d93d20a53ac5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:00.609696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d537812-643f-4be3-823b-a788eb999742 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:00.610335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d537812-643f-4be3-823b-a788eb999742 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:00.610853 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d537812-643f-4be3-823b-a788eb999742 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:00.611645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d537812-643f-4be3-823b-a788eb999742 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:00.612245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d537812-643f-4be3-823b-a788eb999742 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:00.612743 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d537812-643f-4be3-823b-a788eb999742 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:01.295096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-54743b46-ec23-4a02-8446-1ba06f38427f tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930211b0112b490bbe9f6a262ccaf819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ca0be197104eaaa8b190117f1c2b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:01.303662 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-54743b46-ec23-4a02-8446-1ba06f38427f tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb" status: 200 len: 1466 microversion: 2.1 time: 0.824431 Aug 04 17:03:01.315814 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1098/2118] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:00 2022] GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb => generated 1466 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:01.320520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b28359c7-fece-4bd6-a008-e806022c5282 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:01.321157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b28359c7-fece-4bd6-a008-e806022c5282 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:01.332307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b28359c7-fece-4bd6-a008-e806022c5282 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:01.332810 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b28359c7-fece-4bd6-a008-e806022c5282 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:01.333259 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b28359c7-fece-4bd6-a008-e806022c5282 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:01.333995 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b28359c7-fece-4bd6-a008-e806022c5282 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:01.334496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b28359c7-fece-4bd6-a008-e806022c5282 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:01.338543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b28359c7-fece-4bd6-a008-e806022c5282 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:01.399288 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0d537812-643f-4be3-823b-a788eb999742 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a373cb0cd004b65a4ea9c804cbea3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82de1eabf714c3492860c2a65df5ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:01.411294 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0d537812-643f-4be3-823b-a788eb999742 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5" status: 200 len: 1317 microversion: 2.1 time: 0.828099 Aug 04 17:03:01.418480 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1021/2119] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:00 2022] GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5 => generated 1317 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:01.434310 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-53be4915-72c7-4d49-ac05-06ed02bbfbf8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:01.439241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-53be4915-72c7-4d49-ac05-06ed02bbfbf8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:01.463926 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53be4915-72c7-4d49-ac05-06ed02bbfbf8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:01.469758 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53be4915-72c7-4d49-ac05-06ed02bbfbf8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:01.486881 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53be4915-72c7-4d49-ac05-06ed02bbfbf8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:01.487730 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53be4915-72c7-4d49-ac05-06ed02bbfbf8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:01.488229 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53be4915-72c7-4d49-ac05-06ed02bbfbf8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:01.488666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53be4915-72c7-4d49-ac05-06ed02bbfbf8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:01.734631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b28359c7-fece-4bd6-a008-e806022c5282 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:01.751567 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b28359c7-fece-4bd6-a008-e806022c5282 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1498 microversion: 2.1 time: 0.434777 Aug 04 17:03:01.752556 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1099/2120] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:01 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1498 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:01.769856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-c5f4da4f-85e0-4d79-b819-c9392ecfe76b req-6f09e14e-5385-47fb-8588-50679aa4f155 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84f56763-a994-4d26-96d4-a6d1ba68566c", "tag": "10ad4377-3641-452e-aee7-2170593948a9"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:01.785438 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c5f4da4f-85e0-4d79-b819-c9392ecfe76b req-6f09e14e-5385-47fb-8588-50679aa4f155 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:01.786188 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c5f4da4f-85e0-4d79-b819-c9392ecfe76b req-6f09e14e-5385-47fb-8588-50679aa4f155 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:01.786643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c5f4da4f-85e0-4d79-b819-c9392ecfe76b req-6f09e14e-5385-47fb-8588-50679aa4f155 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:01.802575 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-c5f4da4f-85e0-4d79-b819-c9392ecfe76b req-6f09e14e-5385-47fb-8588-50679aa4f155 service nova] Creating event network-changed:10ad4377-3641-452e-aee7-2170593948a9 for instance 84f56763-a994-4d26-96d4-a6d1ba68566c on n-h1-851359-3 Aug 04 17:03:01.810805 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-c5f4da4f-85e0-4d79-b819-c9392ecfe76b req-6f09e14e-5385-47fb-8588-50679aa4f155 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056233 Aug 04 17:03:01.812041 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1100/2121] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:01.818968 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8736db2d-b91b-40d0-a4eb-a9a5ff2906fd tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e5afe6700>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:01.984648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-53be4915-72c7-4d49-ac05-06ed02bbfbf8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:01.997951 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-53be4915-72c7-4d49-ac05-06ed02bbfbf8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:02.001374 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-53be4915-72c7-4d49-ac05-06ed02bbfbf8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:02.003288 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-53be4915-72c7-4d49-ac05-06ed02bbfbf8 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1486 microversion: 2.25 time: 0.578380 Aug 04 17:03:02.006573 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1022/2122] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:01 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1486 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:02.028926 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-94cb7a14-8ace-4677-8b2b-57688ff3caa0 req-ab76eebf-db34-433f-a0ad-36113e0f23d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6fb758e-d1f2-4244-b287-d93d20a53ac5", "name": "network-vif-plugged", "status": "completed", "tag": "e1ab51bf-fb27-46c5-9e82-16eef50f40f8"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:02.080836 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-94cb7a14-8ace-4677-8b2b-57688ff3caa0 req-ab76eebf-db34-433f-a0ad-36113e0f23d2 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:02.081360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-94cb7a14-8ace-4677-8b2b-57688ff3caa0 req-ab76eebf-db34-433f-a0ad-36113e0f23d2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:02.081832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-94cb7a14-8ace-4677-8b2b-57688ff3caa0 req-ab76eebf-db34-433f-a0ad-36113e0f23d2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:02.146830 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-94cb7a14-8ace-4677-8b2b-57688ff3caa0 req-ab76eebf-db34-433f-a0ad-36113e0f23d2 service nova] Creating event network-vif-plugged:e1ab51bf-fb27-46c5-9e82-16eef50f40f8 for instance a6fb758e-d1f2-4244-b287-d93d20a53ac5 on n-h1-851359-3 Aug 04 17:03:02.193625 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-94cb7a14-8ace-4677-8b2b-57688ff3caa0 req-ab76eebf-db34-433f-a0ad-36113e0f23d2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177973 Aug 04 17:03:02.200367 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1023/2123] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:02.233418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7bf78aa4-529f-4bd3-91da-c3f7cc625a38 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:02.238455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7bf78aa4-529f-4bd3-91da-c3f7cc625a38 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:02.262019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7bf78aa4-529f-4bd3-91da-c3f7cc625a38 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:02.271337 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7bf78aa4-529f-4bd3-91da-c3f7cc625a38 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:02.271841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7bf78aa4-529f-4bd3-91da-c3f7cc625a38 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:02.272648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7bf78aa4-529f-4bd3-91da-c3f7cc625a38 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:02.273122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7bf78aa4-529f-4bd3-91da-c3f7cc625a38 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:02.287868 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7bf78aa4-529f-4bd3-91da-c3f7cc625a38 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:02.532972 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7bf78aa4-529f-4bd3-91da-c3f7cc625a38 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:02.548590 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7bf78aa4-529f-4bd3-91da-c3f7cc625a38 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1184 microversion: 2.1 time: 0.346845 Aug 04 17:03:02.549193 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1024/2124] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:02 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1184 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:02.567778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-472ee14c-d91f-4846-8ff8-a19821d1ce9f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:02.568699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-472ee14c-d91f-4846-8ff8-a19821d1ce9f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:02.583873 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-472ee14c-d91f-4846-8ff8-a19821d1ce9f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:02.585965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-472ee14c-d91f-4846-8ff8-a19821d1ce9f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:02.587733 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-472ee14c-d91f-4846-8ff8-a19821d1ce9f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:02.591073 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-472ee14c-d91f-4846-8ff8-a19821d1ce9f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:02.596044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-472ee14c-d91f-4846-8ff8-a19821d1ce9f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:02.596765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-472ee14c-d91f-4846-8ff8-a19821d1ce9f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:02.829781 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-472ee14c-d91f-4846-8ff8-a19821d1ce9f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:02.844039 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-472ee14c-d91f-4846-8ff8-a19821d1ce9f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1522 microversion: 2.1 time: 0.287766 Aug 04 17:03:02.845413 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1025/2125] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:02 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:02.856646 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7542033b-6c93-4247-a4e1-534eb38de522 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:02.857666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7542033b-6c93-4247-a4e1-534eb38de522 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] [instance: 28e0f947-b275-48aa-90f0-bc74218c9478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:02.876887 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7542033b-6c93-4247-a4e1-534eb38de522 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:02.878878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7542033b-6c93-4247-a4e1-534eb38de522 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:02.879395 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7542033b-6c93-4247-a4e1-534eb38de522 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:02.880210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7542033b-6c93-4247-a4e1-534eb38de522 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:02.880729 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7542033b-6c93-4247-a4e1-534eb38de522 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:02.881224 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7542033b-6c93-4247-a4e1-534eb38de522 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:03.063198 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8736db2d-b91b-40d0-a4eb-a9a5ff2906fd tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "DELETE /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96" status: 204 len: 0 microversion: 2.1 time: 1.249528 Aug 04 17:03:03.064699 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1101/2126] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:01 2022] DELETE /compute/v2.1/images/a31eadbd-ce2d-43be-9fbe-444ed48b4b96 => generated 0 bytes in 1252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:03:03.071792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-94ad187f-3526-4708-8aeb-40ceea41f505 req-96fb7727-5bce-4cbd-b9df-77b1f3f09eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28e0f947-b275-48aa-90f0-bc74218c9478", "tag": "b54af5f4-7d06-458b-b36f-c876adabf6c0"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:03.092113 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7542033b-6c93-4247-a4e1-534eb38de522 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fef8a6c8c5e4eab9656d3f86511c7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3f2746c4894fdea00a84678e47f990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:03.100093 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7542033b-6c93-4247-a4e1-534eb38de522 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] 10.222.0.93 "GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478" status: 200 len: 1576 microversion: 2.1 time: 0.252514 Aug 04 17:03:03.100701 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1026/2127] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:02 2022] GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478 => generated 1576 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:03.106112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-94ad187f-3526-4708-8aeb-40ceea41f505 req-96fb7727-5bce-4cbd-b9df-77b1f3f09eb6 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:03.107342 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-94ad187f-3526-4708-8aeb-40ceea41f505 req-96fb7727-5bce-4cbd-b9df-77b1f3f09eb6 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:03.108752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-94ad187f-3526-4708-8aeb-40ceea41f505 req-96fb7727-5bce-4cbd-b9df-77b1f3f09eb6 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:03.130681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6501988d-dd98-4ffa-9a43-cf5ebe64357f tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:03.131611 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6501988d-dd98-4ffa-9a43-cf5ebe64357f tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: a6fb758e-d1f2-4244-b287-d93d20a53ac5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:03.140516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6501988d-dd98-4ffa-9a43-cf5ebe64357f tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:03.144047 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-94ad187f-3526-4708-8aeb-40ceea41f505 req-96fb7727-5bce-4cbd-b9df-77b1f3f09eb6 service nova] Creating event network-changed:b54af5f4-7d06-458b-b36f-c876adabf6c0 for instance 28e0f947-b275-48aa-90f0-bc74218c9478 on n-h1-851359-3 Aug 04 17:03:03.152906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6501988d-dd98-4ffa-9a43-cf5ebe64357f tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:03.154119 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6501988d-dd98-4ffa-9a43-cf5ebe64357f tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:03.156256 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6501988d-dd98-4ffa-9a43-cf5ebe64357f tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:03.156921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6501988d-dd98-4ffa-9a43-cf5ebe64357f tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:03.157526 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6501988d-dd98-4ffa-9a43-cf5ebe64357f tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:03.163901 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-94ad187f-3526-4708-8aeb-40ceea41f505 req-96fb7727-5bce-4cbd-b9df-77b1f3f09eb6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086410 Aug 04 17:03:03.171750 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1102/2128] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:03.181883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-964634c7-1e0f-4e74-9258-663df65c9941 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:03.191734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-964634c7-1e0f-4e74-9258-663df65c9941 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:03.212962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-964634c7-1e0f-4e74-9258-663df65c9941 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:03.213691 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-964634c7-1e0f-4e74-9258-663df65c9941 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:03.214276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-964634c7-1e0f-4e74-9258-663df65c9941 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:03.215432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-964634c7-1e0f-4e74-9258-663df65c9941 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:03.219464 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-964634c7-1e0f-4e74-9258-663df65c9941 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:03.226517 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-964634c7-1e0f-4e74-9258-663df65c9941 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:03.479882 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-964634c7-1e0f-4e74-9258-663df65c9941 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:03.494385 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-964634c7-1e0f-4e74-9258-663df65c9941 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1498 microversion: 2.1 time: 0.318918 Aug 04 17:03:03.497995 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1103/2129] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:03 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1498 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:03.522924 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-38c2dda3-fd0c-48b7-914a-4a96e47573de tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:03.525096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-38c2dda3-fd0c-48b7-914a-4a96e47573de tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:03.529205 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6501988d-dd98-4ffa-9a43-cf5ebe64357f tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a373cb0cd004b65a4ea9c804cbea3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82de1eabf714c3492860c2a65df5ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:03.538238 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6501988d-dd98-4ffa-9a43-cf5ebe64357f tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5" status: 200 len: 1317 microversion: 2.1 time: 0.414780 Aug 04 17:03:03.541484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38c2dda3-fd0c-48b7-914a-4a96e47573de tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:03.543164 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1027/2130] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:03 2022] GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5 => generated 1317 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:03.543599 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38c2dda3-fd0c-48b7-914a-4a96e47573de tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:03.544050 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38c2dda3-fd0c-48b7-914a-4a96e47573de tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:03.547124 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38c2dda3-fd0c-48b7-914a-4a96e47573de tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:03.547698 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38c2dda3-fd0c-48b7-914a-4a96e47573de tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:03.548212 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38c2dda3-fd0c-48b7-914a-4a96e47573de tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:03.551918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-06f8c2ad-6cf4-4a20-b8e9-473162139a65 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '.version_select at 0x7f1e6ca11ee0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:03.604069 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-06f8c2ad-6cf4-4a20-b8e9-473162139a65 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] HTTP exception thrown: Image not found. Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-06f8c2ad-6cf4-4a20-b8e9-473162139a65 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Request method failure captured: Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c HTTP/1.1 Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_tmhQ7KcQSfhmWfKCr-IMapgh4OjYV6synQUvbV0IPGXvLM3OnLFPBj32Y-dAUsgAHGX6WKpZdJ3jrN6zFOdGdRleTkney0NAVjYAe7AbxyoR2rdueUg1Heay663GmtLIGrBsWt6KxDt989sQgjeEP1Q_jk_fhH1Xvbavp1t8Q413E Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: d7ca0be197104eaaa8b190117f1c2b53 Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesOneServerTestJSON-2010861375 Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d7ca0be197104eaaa8b190117f1c2b53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d7ca0be197104eaaa8b190117f1c2b53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d7ca0be197104eaaa8b190117f1c2b53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d7ca0be197104eaaa8b190117f1c2b53"}]}] Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesOneServerTestJSON-2010861375 Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: d7ca0be197104eaaa8b190117f1c2b53 Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2010861375 Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ImagesOneServerTestJSON-2010861375-project Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 930211b0112b490bbe9f6a262ccaf819 Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesOneServerTestJSON-2010861375-project Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: exception: Image not found. Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '30258874-ff7e-479f-b295-179fe4b83c6c'} Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 30258874-ff7e-479f-b295-179fe4b83c6c to delete Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 30258874-ff7e-479f-b295-179fe4b83c6c could not be found. Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:03:03.608465 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:03.614412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:03.614412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:03.614412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:03.614412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:03.614412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:03:03.614412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:03:03.614412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:03.614412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:03.614412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 17:03:03.614412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 17:03:03.614412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 17:03:03.614412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:03:03.614412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:03.614412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:03:03.614412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:03.614412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:03.614412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:03.614412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:03:03.614412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:03:03.614412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 17:03:03.614412 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:03:03.614412 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-06f8c2ad-6cf4-4a20-b8e9-473162139a65 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Returning 404 to user: Image not found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:03.614412 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-06f8c2ad-6cf4-4a20-b8e9-473162139a65 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "DELETE /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c" status: 404 len: 62 microversion: 2.1 time: 0.065633 Aug 04 17:03:03.618940 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1028/2131] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:03 2022] DELETE /compute/v2.1/images/30258874-ff7e-479f-b295-179fe4b83c6c => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:03:03.623616 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-35f07051-cb7b-4155-9da7-0d0c7a678c17 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:03.624392 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-35f07051-cb7b-4155-9da7-0d0c7a678c17 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:03.644955 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35f07051-cb7b-4155-9da7-0d0c7a678c17 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:03.645815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35f07051-cb7b-4155-9da7-0d0c7a678c17 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:03.646367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35f07051-cb7b-4155-9da7-0d0c7a678c17 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:03.647011 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35f07051-cb7b-4155-9da7-0d0c7a678c17 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:03.647629 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35f07051-cb7b-4155-9da7-0d0c7a678c17 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:03.648069 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35f07051-cb7b-4155-9da7-0d0c7a678c17 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:03.868297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-35f07051-cb7b-4155-9da7-0d0c7a678c17 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:03.885199 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-35f07051-cb7b-4155-9da7-0d0c7a678c17 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 200 len: 1184 microversion: 2.1 time: 0.259828 Aug 04 17:03:03.892729 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1029/2132] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:03 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 1184 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:03.925289 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3cbf6dec-893e-4470-910c-32cb570d26df tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:03.926163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3cbf6dec-893e-4470-910c-32cb570d26df tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] [instance: c2695555-41cc-4eff-ae6c-9b8d443103bb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:03.930314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-38c2dda3-fd0c-48b7-914a-4a96e47573de tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:03.942384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-38c2dda3-fd0c-48b7-914a-4a96e47573de tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:03.943904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-38c2dda3-fd0c-48b7-914a-4a96e47573de tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:03.944626 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3cbf6dec-893e-4470-910c-32cb570d26df tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:03.945090 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-38c2dda3-fd0c-48b7-914a-4a96e47573de tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1486 microversion: 2.25 time: 0.432968 Aug 04 17:03:03.952053 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1104/2133] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:03 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1486 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:03.962560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3cbf6dec-893e-4470-910c-32cb570d26df tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:03.963244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3cbf6dec-893e-4470-910c-32cb570d26df tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:03.964228 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3cbf6dec-893e-4470-910c-32cb570d26df tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:03.965372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ccf28615-f3e8-4967-bc15-785d9bce6135 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:03.967156 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ccf28615-f3e8-4967-bc15-785d9bce6135 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:03.967627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3cbf6dec-893e-4470-910c-32cb570d26df tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:03.968263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3cbf6dec-893e-4470-910c-32cb570d26df tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:03.983279 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ccf28615-f3e8-4967-bc15-785d9bce6135 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:03.983794 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ccf28615-f3e8-4967-bc15-785d9bce6135 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:03.984228 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ccf28615-f3e8-4967-bc15-785d9bce6135 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:03.985058 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ccf28615-f3e8-4967-bc15-785d9bce6135 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:03.985522 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ccf28615-f3e8-4967-bc15-785d9bce6135 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:03.992333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ccf28615-f3e8-4967-bc15-785d9bce6135 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:04.031367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3cbf6dec-893e-4470-910c-32cb570d26df tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] [instance: c2695555-41cc-4eff-ae6c-9b8d443103bb] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:03:04.250234 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3cbf6dec-893e-4470-910c-32cb570d26df tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "DELETE /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb" status: 204 len: 0 microversion: 2.1 time: 0.352674 Aug 04 17:03:04.255802 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1030/2134] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:03:03 2022] DELETE /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:03:04.263256 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e62be92f-556b-4cc6-8147-c9223cf84e2f tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:04.264319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e62be92f-556b-4cc6-8147-c9223cf84e2f tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] [instance: c2695555-41cc-4eff-ae6c-9b8d443103bb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:04.272053 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e62be92f-556b-4cc6-8147-c9223cf84e2f tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:04.272899 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e62be92f-556b-4cc6-8147-c9223cf84e2f tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:04.273579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e62be92f-556b-4cc6-8147-c9223cf84e2f tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:04.274546 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e62be92f-556b-4cc6-8147-c9223cf84e2f tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:04.275180 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e62be92f-556b-4cc6-8147-c9223cf84e2f tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:04.275807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e62be92f-556b-4cc6-8147-c9223cf84e2f tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:04.671209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ccf28615-f3e8-4967-bc15-785d9bce6135 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:04.690646 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ccf28615-f3e8-4967-bc15-785d9bce6135 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1522 microversion: 2.1 time: 0.736232 Aug 04 17:03:04.691244 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1105/2135] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:03 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1522 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:04.713274 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0972acdc-4c20-4962-85aa-5b98787d7f4d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:04.716159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0972acdc-4c20-4962-85aa-5b98787d7f4d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:04.729184 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0972acdc-4c20-4962-85aa-5b98787d7f4d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:04.731150 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0972acdc-4c20-4962-85aa-5b98787d7f4d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:04.732076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0972acdc-4c20-4962-85aa-5b98787d7f4d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:04.733836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0972acdc-4c20-4962-85aa-5b98787d7f4d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:04.734912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0972acdc-4c20-4962-85aa-5b98787d7f4d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:04.735600 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0972acdc-4c20-4962-85aa-5b98787d7f4d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:04.772674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e62be92f-556b-4cc6-8147-c9223cf84e2f tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930211b0112b490bbe9f6a262ccaf819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ca0be197104eaaa8b190117f1c2b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:04.784003 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e62be92f-556b-4cc6-8147-c9223cf84e2f tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb" status: 200 len: 1472 microversion: 2.1 time: 0.525892 Aug 04 17:03:04.785396 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1031/2136] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:04 2022] GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb => generated 1472 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:04.799789 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-feb10489-c306-4846-ba74-25f37747af8a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:04.801097 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-feb10489-c306-4846-ba74-25f37747af8a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: a6fb758e-d1f2-4244-b287-d93d20a53ac5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:04.808970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-feb10489-c306-4846-ba74-25f37747af8a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:04.809832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-feb10489-c306-4846-ba74-25f37747af8a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:04.810822 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-feb10489-c306-4846-ba74-25f37747af8a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:04.825716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-feb10489-c306-4846-ba74-25f37747af8a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:04.826618 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-feb10489-c306-4846-ba74-25f37747af8a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:04.827305 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-feb10489-c306-4846-ba74-25f37747af8a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:05.103104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0972acdc-4c20-4962-85aa-5b98787d7f4d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:05.119139 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0972acdc-4c20-4962-85aa-5b98787d7f4d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1498 microversion: 2.1 time: 0.410689 Aug 04 17:03:05.144849 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1106/2137] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:04 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1498 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:05.145545 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-84d2d0c7-35ef-4e21-9f25-63aff06a1f60 req-942a84b8-c7dc-4398-8dbc-7fbb02cb1da9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2695555-41cc-4eff-ae6c-9b8d443103bb", "name": "network-vif-unplugged", "status": "completed", "tag": "a400318a-3d22-404a-90ec-54d7d582192d"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:05.187445 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-84d2d0c7-35ef-4e21-9f25-63aff06a1f60 req-942a84b8-c7dc-4398-8dbc-7fbb02cb1da9 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:05.188666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-84d2d0c7-35ef-4e21-9f25-63aff06a1f60 req-942a84b8-c7dc-4398-8dbc-7fbb02cb1da9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:05.189195 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-84d2d0c7-35ef-4e21-9f25-63aff06a1f60 req-942a84b8-c7dc-4398-8dbc-7fbb02cb1da9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:05.205583 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-84d2d0c7-35ef-4e21-9f25-63aff06a1f60 req-942a84b8-c7dc-4398-8dbc-7fbb02cb1da9 service nova] Creating event network-vif-unplugged:a400318a-3d22-404a-90ec-54d7d582192d for instance c2695555-41cc-4eff-ae6c-9b8d443103bb on n-h2-851359-3 Aug 04 17:03:05.227115 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-84d2d0c7-35ef-4e21-9f25-63aff06a1f60 req-942a84b8-c7dc-4398-8dbc-7fbb02cb1da9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088586 Aug 04 17:03:05.227840 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1107/2138] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:05.237769 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d58dabb6-b217-42fd-8c9e-9b265bf9e2c5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:05.238955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d58dabb6-b217-42fd-8c9e-9b265bf9e2c5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:05.242342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-feb10489-c306-4846-ba74-25f37747af8a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a373cb0cd004b65a4ea9c804cbea3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82de1eabf714c3492860c2a65df5ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:05.252244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d58dabb6-b217-42fd-8c9e-9b265bf9e2c5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:05.253032 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d58dabb6-b217-42fd-8c9e-9b265bf9e2c5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:05.253711 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d58dabb6-b217-42fd-8c9e-9b265bf9e2c5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:05.254682 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d58dabb6-b217-42fd-8c9e-9b265bf9e2c5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:05.255370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d58dabb6-b217-42fd-8c9e-9b265bf9e2c5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:05.255774 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-feb10489-c306-4846-ba74-25f37747af8a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5" status: 200 len: 1467 microversion: 2.1 time: 0.467499 Aug 04 17:03:05.256376 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1032/2139] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:04 2022] GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5 => generated 1467 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:05.272003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d58dabb6-b217-42fd-8c9e-9b265bf9e2c5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:05.272696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-58795a30-3ead-433f-9811-6cab40c1942b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:05.273434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-58795a30-3ead-433f-9811-6cab40c1942b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:05.291069 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58795a30-3ead-433f-9811-6cab40c1942b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:05.292505 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58795a30-3ead-433f-9811-6cab40c1942b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:05.293388 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-d58dabb6-b217-42fd-8c9e-9b265bf9e2c5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] HTTP exception thrown: Instance 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 could not be found. Aug 04 17:03:05.293594 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58795a30-3ead-433f-9811-6cab40c1942b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:05.294770 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58795a30-3ead-433f-9811-6cab40c1942b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:05.295713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58795a30-3ead-433f-9811-6cab40c1942b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:05.296367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58795a30-3ead-433f-9811-6cab40c1942b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d58dabb6-b217-42fd-8c9e-9b265bf9e2c5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Request method failure captured: Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 HTTP/1.1 Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_nx4zpoZyN271LHTSeJxILr3fxWmehAd73Qj4Mr3-kQ0Z96VGd88Njdn98GUYX0n84u9xHwJg1ygSOcJgsbmRZxdOJa7CP_K2Ra1wkoWsIeJsOtucMgDGajwnhOJDwPBrqSjSfszp3sXUCDj_lHYyKsw8X_WMLGlgsCYqeXhflvOHk Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 792f078eb62f4820ba4166d421079491 Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-LiveMigrationTest-1342252687 Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/792f078eb62f4820ba4166d421079491"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/792f078eb62f4820ba4166d421079491"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_792f078eb62f4820ba4166d421079491"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/792f078eb62f4820ba4166d421079491"}]}] Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-LiveMigrationTest-1342252687 Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 792f078eb62f4820ba4166d421079491 Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-LiveMigrationTest-1342252687 Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-LiveMigrationTest-1342252687-project Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 81d93fe83a6542c89cbc86106671b15f Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-LiveMigrationTest-1342252687-project Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 could not be found. Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3'} Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 could not be found. Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 could not be found. Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:05.298247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:05.304233 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:05.304233 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:05.304233 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:05.304233 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:03:05.304233 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:03:05.304233 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 could not be found. Aug 04 17:03:05.304233 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:05.306526 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d58dabb6-b217-42fd-8c9e-9b265bf9e2c5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Returning 404 to user: Instance 3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:05.307622 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d58dabb6-b217-42fd-8c9e-9b265bf9e2c5 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3" status: 404 len: 111 microversion: 2.1 time: 0.076950 Aug 04 17:03:05.314242 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1108/2140] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:05 2022] GET /compute/v2.1/servers/3d3255be-3e39-4bd8-8c1b-0cd443a6ffe3 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:03:05.320183 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b4b7ba98-f066-4b66-ba35-03d57f87d756 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:05.321185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b4b7ba98-f066-4b66-ba35-03d57f87d756 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: ba09cec5-a546-4fe5-90df-c90d94591fb2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:05.328579 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b4b7ba98-f066-4b66-ba35-03d57f87d756 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:05.329295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b4b7ba98-f066-4b66-ba35-03d57f87d756 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:05.329895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b4b7ba98-f066-4b66-ba35-03d57f87d756 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:05.331395 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b4b7ba98-f066-4b66-ba35-03d57f87d756 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:05.332743 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b4b7ba98-f066-4b66-ba35-03d57f87d756 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:05.333328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b4b7ba98-f066-4b66-ba35-03d57f87d756 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:05.718893 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b4b7ba98-f066-4b66-ba35-03d57f87d756 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a373cb0cd004b65a4ea9c804cbea3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82de1eabf714c3492860c2a65df5ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:05.729584 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b4b7ba98-f066-4b66-ba35-03d57f87d756 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/servers/ba09cec5-a546-4fe5-90df-c90d94591fb2" status: 200 len: 1467 microversion: 2.1 time: 0.413740 Aug 04 17:03:05.734367 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1109/2141] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:05 2022] GET /compute/v2.1/servers/ba09cec5-a546-4fe5-90df-c90d94591fb2 => generated 1467 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:05.746237 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-58795a30-3ead-433f-9811-6cab40c1942b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:05.756055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b8518ffe-43c5-4206-bf2e-d8aed8e3e6b8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:05.756314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-58795a30-3ead-433f-9811-6cab40c1942b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:05.757396 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b8518ffe-43c5-4206-bf2e-d8aed8e3e6b8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:05.757684 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-58795a30-3ead-433f-9811-6cab40c1942b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:05.758955 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-58795a30-3ead-433f-9811-6cab40c1942b tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1486 microversion: 2.25 time: 0.501621 Aug 04 17:03:05.763825 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1033/2142] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:05 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1486 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:05.765458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b8518ffe-43c5-4206-bf2e-d8aed8e3e6b8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:05.766379 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b8518ffe-43c5-4206-bf2e-d8aed8e3e6b8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:05.767251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b8518ffe-43c5-4206-bf2e-d8aed8e3e6b8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:05.768729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b8518ffe-43c5-4206-bf2e-d8aed8e3e6b8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:05.769300 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-26f54d44-a1eb-47db-a9b5-eca26f89595b tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-124495790"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:05.770003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b8518ffe-43c5-4206-bf2e-d8aed8e3e6b8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:05.770765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b8518ffe-43c5-4206-bf2e-d8aed8e3e6b8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:05.771876 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-26f54d44-a1eb-47db-a9b5-eca26f89595b tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: ba09cec5-a546-4fe5-90df-c90d94591fb2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:05.779574 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26f54d44-a1eb-47db-a9b5-eca26f89595b tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:05.780077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26f54d44-a1eb-47db-a9b5-eca26f89595b tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:05.780522 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26f54d44-a1eb-47db-a9b5-eca26f89595b tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:05.781280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26f54d44-a1eb-47db-a9b5-eca26f89595b tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:05.781753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26f54d44-a1eb-47db-a9b5-eca26f89595b tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:05.782239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26f54d44-a1eb-47db-a9b5-eca26f89595b tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:05.831250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:06.065867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b8518ffe-43c5-4206-bf2e-d8aed8e3e6b8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:06.068400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:06.084424 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b8518ffe-43c5-4206-bf2e-d8aed8e3e6b8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1522 microversion: 2.1 time: 0.336693 Aug 04 17:03:06.085278 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1110/2143] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:05 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:06.095434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c6d24c8a-623b-48a2-8172-a052011976e4 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:06.096492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c6d24c8a-623b-48a2-8172-a052011976e4 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] [instance: c2695555-41cc-4eff-ae6c-9b8d443103bb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:06.109173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6d24c8a-623b-48a2-8172-a052011976e4 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:06.109675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6d24c8a-623b-48a2-8172-a052011976e4 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:06.110169 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6d24c8a-623b-48a2-8172-a052011976e4 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:06.110877 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6d24c8a-623b-48a2-8172-a052011976e4 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:06.111344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6d24c8a-623b-48a2-8172-a052011976e4 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:06.112486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6d24c8a-623b-48a2-8172-a052011976e4 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:06.148880 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-26f54d44-a1eb-47db-a9b5-eca26f89595b tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "POST /compute/v2.1/servers/ba09cec5-a546-4fe5-90df-c90d94591fb2/action" status: 202 len: 0 microversion: 2.1 time: 0.383514 Aug 04 17:03:06.153333 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1034/2144] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:03:05 2022] POST /compute/v2.1/servers/ba09cec5-a546-4fe5-90df-c90d94591fb2/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 17:03:06.167094 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bc983e54-ad5d-48b4-96b7-0a4f8de0bdef tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:06.168002 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bc983e54-ad5d-48b4-96b7-0a4f8de0bdef tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:06.204117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc983e54-ad5d-48b4-96b7-0a4f8de0bdef tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:06.205127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc983e54-ad5d-48b4-96b7-0a4f8de0bdef tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:06.206717 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc983e54-ad5d-48b4-96b7-0a4f8de0bdef tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:06.208053 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc983e54-ad5d-48b4-96b7-0a4f8de0bdef tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:06.208790 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc983e54-ad5d-48b4-96b7-0a4f8de0bdef tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:06.209512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc983e54-ad5d-48b4-96b7-0a4f8de0bdef tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:06.489737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bc983e54-ad5d-48b4-96b7-0a4f8de0bdef tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:06.494334 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c6d24c8a-623b-48a2-8172-a052011976e4 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930211b0112b490bbe9f6a262ccaf819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ca0be197104eaaa8b190117f1c2b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:06.498910 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bc983e54-ad5d-48b4-96b7-0a4f8de0bdef tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1498 microversion: 2.1 time: 0.344109 Aug 04 17:03:06.503715 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1035/2145] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:06 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1498 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:06.505037 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c6d24c8a-623b-48a2-8172-a052011976e4 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb" status: 200 len: 1472 microversion: 2.1 time: 0.412362 Aug 04 17:03:06.506167 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1111/2146] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:06 2022] GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb => generated 1472 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:06.530798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2f0905f8-01d9-436a-ab95-d49138eefe25 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e6c959e50>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:06.607291 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2f0905f8-01d9-436a-ab95-d49138eefe25 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461" status: 200 len: 1452 microversion: 2.1 time: 0.102230 Aug 04 17:03:06.608634 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1036/2147] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:06 2022] GET /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461 => generated 1452 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:06.854345 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-006f6b31-c22e-4786-9a6c-1d827907f174 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:06.854994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-006f6b31-c22e-4786-9a6c-1d827907f174 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:06.867918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-006f6b31-c22e-4786-9a6c-1d827907f174 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:06.868543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-006f6b31-c22e-4786-9a6c-1d827907f174 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:06.871063 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-006f6b31-c22e-4786-9a6c-1d827907f174 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:06.871906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-006f6b31-c22e-4786-9a6c-1d827907f174 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:06.873704 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-006f6b31-c22e-4786-9a6c-1d827907f174 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:06.876005 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-006f6b31-c22e-4786-9a6c-1d827907f174 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:07.087657 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-006f6b31-c22e-4786-9a6c-1d827907f174 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:07.102617 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-006f6b31-c22e-4786-9a6c-1d827907f174 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:07.104278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-006f6b31-c22e-4786-9a6c-1d827907f174 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:07.105596 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-006f6b31-c22e-4786-9a6c-1d827907f174 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1486 microversion: 2.25 time: 0.255996 Aug 04 17:03:07.106141 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1112/2148] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:06 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1486 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:03:07.106283 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ab3e5903-3a77-48c4-8b12-3062bcbcf1e0 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:07.106818 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ab3e5903-3a77-48c4-8b12-3062bcbcf1e0 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:07.117148 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:07.118950 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab3e5903-3a77-48c4-8b12-3062bcbcf1e0 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:07.119724 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab3e5903-3a77-48c4-8b12-3062bcbcf1e0 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:07.120463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab3e5903-3a77-48c4-8b12-3062bcbcf1e0 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:07.121344 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab3e5903-3a77-48c4-8b12-3062bcbcf1e0 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:07.121964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab3e5903-3a77-48c4-8b12-3062bcbcf1e0 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:07.122581 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab3e5903-3a77-48c4-8b12-3062bcbcf1e0 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:07.313156 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ab3e5903-3a77-48c4-8b12-3062bcbcf1e0 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:07.323845 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ab3e5903-3a77-48c4-8b12-3062bcbcf1e0 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1522 microversion: 2.1 time: 0.221282 Aug 04 17:03:07.329505 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1037/2149] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:07 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:07.523267 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6922f70e-b355-4477-b17e-3ab1cebb001b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:07.523928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6922f70e-b355-4477-b17e-3ab1cebb001b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:07.527312 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-50b3fa20-a55b-48f4-ad3c-8ba2e10cc870 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:07.528499 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-50b3fa20-a55b-48f4-ad3c-8ba2e10cc870 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] [instance: c2695555-41cc-4eff-ae6c-9b8d443103bb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:07.535583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50b3fa20-a55b-48f4-ad3c-8ba2e10cc870 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:07.536565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50b3fa20-a55b-48f4-ad3c-8ba2e10cc870 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:07.537293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50b3fa20-a55b-48f4-ad3c-8ba2e10cc870 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:07.537929 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6922f70e-b355-4477-b17e-3ab1cebb001b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:07.538426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50b3fa20-a55b-48f4-ad3c-8ba2e10cc870 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:07.539056 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50b3fa20-a55b-48f4-ad3c-8ba2e10cc870 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:07.539654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50b3fa20-a55b-48f4-ad3c-8ba2e10cc870 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:07.540239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6922f70e-b355-4477-b17e-3ab1cebb001b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:07.540696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6922f70e-b355-4477-b17e-3ab1cebb001b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:07.541413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6922f70e-b355-4477-b17e-3ab1cebb001b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:07.541885 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6922f70e-b355-4477-b17e-3ab1cebb001b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:07.544934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6922f70e-b355-4477-b17e-3ab1cebb001b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:07.928732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-50b3fa20-a55b-48f4-ad3c-8ba2e10cc870 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930211b0112b490bbe9f6a262ccaf819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ca0be197104eaaa8b190117f1c2b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:07.944312 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-50b3fa20-a55b-48f4-ad3c-8ba2e10cc870 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb" status: 200 len: 1472 microversion: 2.1 time: 0.421906 Aug 04 17:03:07.954691 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1038/2150] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:07 2022] GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb => generated 1472 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:07.954691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-10d3da4a-d58a-4bf2-aa5b-ae5bcc632a07 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e6c944310>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:08.014270 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-10d3da4a-d58a-4bf2-aa5b-ae5bcc632a07 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461" status: 200 len: 1452 microversion: 2.1 time: 0.067810 Aug 04 17:03:08.015035 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1039/2151] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:07 2022] GET /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461 => generated 1452 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:08.041474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6922f70e-b355-4477-b17e-3ab1cebb001b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:08.053158 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6922f70e-b355-4477-b17e-3ab1cebb001b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1498 microversion: 2.1 time: 0.533786 Aug 04 17:03:08.066292 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1113/2152] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:07 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1498 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:08.138051 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-748f70e2-b9d7-4e9f-a9e2-fb28ded2975c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:08.138283 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-748f70e2-b9d7-4e9f-a9e2-fb28ded2975c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:08.155548 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-748f70e2-b9d7-4e9f-a9e2-fb28ded2975c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:08.156100 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-748f70e2-b9d7-4e9f-a9e2-fb28ded2975c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:08.156556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-748f70e2-b9d7-4e9f-a9e2-fb28ded2975c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:08.157303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-748f70e2-b9d7-4e9f-a9e2-fb28ded2975c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:08.157846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-748f70e2-b9d7-4e9f-a9e2-fb28ded2975c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:08.158319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-748f70e2-b9d7-4e9f-a9e2-fb28ded2975c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:08.350570 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-60cf3a9b-04a7-487e-b239-01b20cd1dea3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:08.351237 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-60cf3a9b-04a7-487e-b239-01b20cd1dea3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:08.366195 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60cf3a9b-04a7-487e-b239-01b20cd1dea3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:08.368361 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60cf3a9b-04a7-487e-b239-01b20cd1dea3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:08.369076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60cf3a9b-04a7-487e-b239-01b20cd1dea3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:08.372748 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60cf3a9b-04a7-487e-b239-01b20cd1dea3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:08.373387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60cf3a9b-04a7-487e-b239-01b20cd1dea3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:08.373850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60cf3a9b-04a7-487e-b239-01b20cd1dea3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:08.565466 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-748f70e2-b9d7-4e9f-a9e2-fb28ded2975c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:08.594030 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-748f70e2-b9d7-4e9f-a9e2-fb28ded2975c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:08.600617 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-748f70e2-b9d7-4e9f-a9e2-fb28ded2975c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:08.601961 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-748f70e2-b9d7-4e9f-a9e2-fb28ded2975c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1486 microversion: 2.25 time: 0.474630 Aug 04 17:03:08.613117 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1040/2153] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:08 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1486 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:08.773133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-60cf3a9b-04a7-487e-b239-01b20cd1dea3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:08.817424 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-60cf3a9b-04a7-487e-b239-01b20cd1dea3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1522 microversion: 2.1 time: 0.455071 Aug 04 17:03:08.820328 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1114/2154] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:08 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1522 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:03:08.969105 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-82b23e86-57d3-4c10-b3ea-bc6490c7c574 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:08.969733 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-82b23e86-57d3-4c10-b3ea-bc6490c7c574 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] [instance: c2695555-41cc-4eff-ae6c-9b8d443103bb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:08.990890 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82b23e86-57d3-4c10-b3ea-bc6490c7c574 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:08.993006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82b23e86-57d3-4c10-b3ea-bc6490c7c574 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:08.993796 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82b23e86-57d3-4c10-b3ea-bc6490c7c574 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:08.996680 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82b23e86-57d3-4c10-b3ea-bc6490c7c574 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:08.997180 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82b23e86-57d3-4c10-b3ea-bc6490c7c574 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:08.998688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82b23e86-57d3-4c10-b3ea-bc6490c7c574 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:09.029723 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3314eb3a-b495-4554-9487-742dc9d8abc0 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5af36820>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:09.134083 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3314eb3a-b495-4554-9487-742dc9d8abc0 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461" status: 200 len: 1452 microversion: 2.1 time: 0.108849 Aug 04 17:03:09.136387 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1115/2155] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:09 2022] GET /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461 => generated 1452 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:09.160733 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-39dc8e94-1aec-473a-a867-018a70b1b04b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:09.161290 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-39dc8e94-1aec-473a-a867-018a70b1b04b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:09.189935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39dc8e94-1aec-473a-a867-018a70b1b04b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:09.190457 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39dc8e94-1aec-473a-a867-018a70b1b04b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:09.190899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39dc8e94-1aec-473a-a867-018a70b1b04b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:09.191615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39dc8e94-1aec-473a-a867-018a70b1b04b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:09.192072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39dc8e94-1aec-473a-a867-018a70b1b04b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:09.194039 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39dc8e94-1aec-473a-a867-018a70b1b04b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:09.198923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-82b23e86-57d3-4c10-b3ea-bc6490c7c574 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930211b0112b490bbe9f6a262ccaf819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ca0be197104eaaa8b190117f1c2b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:09.208236 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-82b23e86-57d3-4c10-b3ea-bc6490c7c574 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb" status: 200 len: 1430 microversion: 2.1 time: 0.243990 Aug 04 17:03:09.208810 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1041/2156] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:08 2022] GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb => generated 1430 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:09.459362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-39dc8e94-1aec-473a-a867-018a70b1b04b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:09.469407 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-39dc8e94-1aec-473a-a867-018a70b1b04b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1498 microversion: 2.1 time: 0.314972 Aug 04 17:03:09.496235 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1116/2157] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:09 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1498 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:09.579274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-f2ca486c-1059-49c4-b349-25752943f125 req-13c13d54-2b06-43fe-a609-dd742a5cd146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2695555-41cc-4eff-ae6c-9b8d443103bb", "name": "network-vif-deleted", "tag": "a400318a-3d22-404a-90ec-54d7d582192d"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:09.605512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f2ca486c-1059-49c4-b349-25752943f125 req-13c13d54-2b06-43fe-a609-dd742a5cd146 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:09.606039 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f2ca486c-1059-49c4-b349-25752943f125 req-13c13d54-2b06-43fe-a609-dd742a5cd146 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:09.606490 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f2ca486c-1059-49c4-b349-25752943f125 req-13c13d54-2b06-43fe-a609-dd742a5cd146 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:09.631580 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dfd029e8-f266-4220-958f-7d0fe239e821 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:09.632478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dfd029e8-f266-4220-958f-7d0fe239e821 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:09.651490 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfd029e8-f266-4220-958f-7d0fe239e821 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:09.655700 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfd029e8-f266-4220-958f-7d0fe239e821 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:09.656231 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfd029e8-f266-4220-958f-7d0fe239e821 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:09.657008 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfd029e8-f266-4220-958f-7d0fe239e821 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:09.661376 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfd029e8-f266-4220-958f-7d0fe239e821 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:09.664082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfd029e8-f266-4220-958f-7d0fe239e821 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:09.665262 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-f2ca486c-1059-49c4-b349-25752943f125 req-13c13d54-2b06-43fe-a609-dd742a5cd146 service nova] Creating event network-vif-deleted:a400318a-3d22-404a-90ec-54d7d582192d for instance c2695555-41cc-4eff-ae6c-9b8d443103bb on n-h2-851359-3 Aug 04 17:03:09.676994 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-f2ca486c-1059-49c4-b349-25752943f125 req-13c13d54-2b06-43fe-a609-dd742a5cd146 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102043 Aug 04 17:03:09.677609 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1042/2158] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:09.845491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ab8fee79-db44-4710-8f81-b3f7ac862018 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:09.846557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ab8fee79-db44-4710-8f81-b3f7ac862018 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:09.856290 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab8fee79-db44-4710-8f81-b3f7ac862018 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:09.857099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab8fee79-db44-4710-8f81-b3f7ac862018 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:09.857895 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab8fee79-db44-4710-8f81-b3f7ac862018 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:09.859660 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab8fee79-db44-4710-8f81-b3f7ac862018 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:09.860368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab8fee79-db44-4710-8f81-b3f7ac862018 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:09.860977 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab8fee79-db44-4710-8f81-b3f7ac862018 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:10.085341 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dfd029e8-f266-4220-958f-7d0fe239e821 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:10.103313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dfd029e8-f266-4220-958f-7d0fe239e821 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:10.115072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dfd029e8-f266-4220-958f-7d0fe239e821 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:10.123077 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dfd029e8-f266-4220-958f-7d0fe239e821 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1486 microversion: 2.25 time: 0.489662 Aug 04 17:03:10.128010 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1117/2159] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:09 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1486 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:10.159576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1d896677-1b2f-4d2b-b734-380b168d661c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5ae745e0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:10.277443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ab8fee79-db44-4710-8f81-b3f7ac862018 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:10.293198 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ab8fee79-db44-4710-8f81-b3f7ac862018 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1522 microversion: 2.1 time: 0.454154 Aug 04 17:03:10.293712 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1043/2160] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:09 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1522 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:10.323974 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2e2a18dc-0cbf-41d0-86a8-4dd8288437cb tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:10.336805 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2e2a18dc-0cbf-41d0-86a8-4dd8288437cb tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] [instance: c2695555-41cc-4eff-ae6c-9b8d443103bb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:10.352432 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e2a18dc-0cbf-41d0-86a8-4dd8288437cb tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:10.407849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e2a18dc-0cbf-41d0-86a8-4dd8288437cb tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:10.407849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e2a18dc-0cbf-41d0-86a8-4dd8288437cb tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:10.407849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e2a18dc-0cbf-41d0-86a8-4dd8288437cb tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:10.407849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e2a18dc-0cbf-41d0-86a8-4dd8288437cb tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:10.407849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e2a18dc-0cbf-41d0-86a8-4dd8288437cb tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:10.412643 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1d896677-1b2f-4d2b-b734-380b168d661c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461" status: 200 len: 1452 microversion: 2.1 time: 0.219728 Aug 04 17:03:10.412643 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1118/2161] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:10 2022] GET /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461 => generated 1452 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:10.454560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e2a18dc-0cbf-41d0-86a8-4dd8288437cb tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:10.455103 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e2a18dc-0cbf-41d0-86a8-4dd8288437cb tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:10.456198 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e2a18dc-0cbf-41d0-86a8-4dd8288437cb tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:10.456923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-2e2a18dc-0cbf-41d0-86a8-4dd8288437cb tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lazy-loading 'fault' on Instance uuid c2695555-41cc-4eff-ae6c-9b8d443103bb {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:03:10.495435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d92b4199-ce38-4565-80fe-ddf406bbb6ba tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:10.496066 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d92b4199-ce38-4565-80fe-ddf406bbb6ba tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:10.518067 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d92b4199-ce38-4565-80fe-ddf406bbb6ba tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:10.518586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d92b4199-ce38-4565-80fe-ddf406bbb6ba tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:10.519037 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d92b4199-ce38-4565-80fe-ddf406bbb6ba tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:10.519761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d92b4199-ce38-4565-80fe-ddf406bbb6ba tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:10.520227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d92b4199-ce38-4565-80fe-ddf406bbb6ba tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:10.520662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d92b4199-ce38-4565-80fe-ddf406bbb6ba tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:10.562850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2e2a18dc-0cbf-41d0-86a8-4dd8288437cb tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '930211b0112b490bbe9f6a262ccaf819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ca0be197104eaaa8b190117f1c2b53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:10.571184 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2e2a18dc-0cbf-41d0-86a8-4dd8288437cb tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb" status: 200 len: 1306 microversion: 2.1 time: 0.260028 Aug 04 17:03:10.586132 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1044/2162] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:10 2022] GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb => generated 1306 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:10.600544 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-3cd912f4-3af5-4307-bfd1-6b7268944077 req-68dd5d3b-2acc-4c4f-93db-036e0d1ce54a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba09cec5-a546-4fe5-90df-c90d94591fb2", "name": "network-vif-plugged", "status": "completed", "tag": "14919ddc-0463-47b2-9b85-fd575b876018"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:10.624929 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-3cd912f4-3af5-4307-bfd1-6b7268944077 req-68dd5d3b-2acc-4c4f-93db-036e0d1ce54a service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:10.625665 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-3cd912f4-3af5-4307-bfd1-6b7268944077 req-68dd5d3b-2acc-4c4f-93db-036e0d1ce54a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:10.628099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-3cd912f4-3af5-4307-bfd1-6b7268944077 req-68dd5d3b-2acc-4c4f-93db-036e0d1ce54a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:10.660346 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-3cd912f4-3af5-4307-bfd1-6b7268944077 req-68dd5d3b-2acc-4c4f-93db-036e0d1ce54a service nova] Creating event network-vif-plugged:14919ddc-0463-47b2-9b85-fd575b876018 for instance ba09cec5-a546-4fe5-90df-c90d94591fb2 on n-h1-851359-3 Aug 04 17:03:10.691062 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-3cd912f4-3af5-4307-bfd1-6b7268944077 req-68dd5d3b-2acc-4c4f-93db-036e0d1ce54a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100811 Aug 04 17:03:10.698492 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1045/2163] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:10.879829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d92b4199-ce38-4565-80fe-ddf406bbb6ba tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:10.888054 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d92b4199-ce38-4565-80fe-ddf406bbb6ba tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1498 microversion: 2.1 time: 0.396532 Aug 04 17:03:10.889369 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1119/2164] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:10 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1498 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:03:11.159715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ee758ebe-2e21-4c96-bead-1d528e33d98d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:11.160907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ee758ebe-2e21-4c96-bead-1d528e33d98d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:11.179362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee758ebe-2e21-4c96-bead-1d528e33d98d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:11.182436 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee758ebe-2e21-4c96-bead-1d528e33d98d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:11.183090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee758ebe-2e21-4c96-bead-1d528e33d98d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:11.186681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee758ebe-2e21-4c96-bead-1d528e33d98d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:11.187315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee758ebe-2e21-4c96-bead-1d528e33d98d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:11.189029 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee758ebe-2e21-4c96-bead-1d528e33d98d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:11.316742 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-de6b458e-aa8c-4fe3-9144-1fbdd6b6a957 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:11.318012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-de6b458e-aa8c-4fe3-9144-1fbdd6b6a957 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:11.328080 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de6b458e-aa8c-4fe3-9144-1fbdd6b6a957 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:11.332365 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de6b458e-aa8c-4fe3-9144-1fbdd6b6a957 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:11.333125 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de6b458e-aa8c-4fe3-9144-1fbdd6b6a957 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:11.335109 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de6b458e-aa8c-4fe3-9144-1fbdd6b6a957 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:11.335752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de6b458e-aa8c-4fe3-9144-1fbdd6b6a957 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:11.338226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de6b458e-aa8c-4fe3-9144-1fbdd6b6a957 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:11.648145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ee758ebe-2e21-4c96-bead-1d528e33d98d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:11.755927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ee758ebe-2e21-4c96-bead-1d528e33d98d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:11.757436 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ee758ebe-2e21-4c96-bead-1d528e33d98d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:11.758818 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ee758ebe-2e21-4c96-bead-1d528e33d98d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1486 microversion: 2.25 time: 0.605414 Aug 04 17:03:11.759866 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1046/2165] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:11 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1486 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:11.764446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e84b73ca-cc33-4677-93e5-219017f7f6bb tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e6c981dc0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:12.055453 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-de6b458e-aa8c-4fe3-9144-1fbdd6b6a957 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:12.075474 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-de6b458e-aa8c-4fe3-9144-1fbdd6b6a957 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1522 microversion: 2.1 time: 0.763271 Aug 04 17:03:12.077324 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1120/2166] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:11 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1522 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:12.090860 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ceb04143-b49f-46c3-9ec4-df9b408c5418 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:12.092721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ceb04143-b49f-46c3-9ec4-df9b408c5418 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] [instance: c2695555-41cc-4eff-ae6c-9b8d443103bb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:12.108698 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ceb04143-b49f-46c3-9ec4-df9b408c5418 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:12.111118 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ceb04143-b49f-46c3-9ec4-df9b408c5418 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:12.112279 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ceb04143-b49f-46c3-9ec4-df9b408c5418 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:12.117350 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ceb04143-b49f-46c3-9ec4-df9b408c5418 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:12.118557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ceb04143-b49f-46c3-9ec4-df9b408c5418 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:12.121642 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ceb04143-b49f-46c3-9ec4-df9b408c5418 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:12.155928 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-ceb04143-b49f-46c3-9ec4-df9b408c5418 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] HTTP exception thrown: Instance c2695555-41cc-4eff-ae6c-9b8d443103bb could not be found. Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ceb04143-b49f-46c3-9ec4-df9b408c5418 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Request method failure captured: Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb HTTP/1.1 Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_tmhQ7KcQSfhmWfKCr-IMapgh4OjYV6synQUvbV0IPGXvLM3OnLFPBj32Y-dAUsgAHGX6WKpZdJ3jrN6zFOdGdRleTkney0NAVjYAe7AbxyoR2rdueUg1Heay663GmtLIGrBsWt6KxDt989sQgjeEP1Q_jk_fhH1Xvbavp1t8Q413E Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: d7ca0be197104eaaa8b190117f1c2b53 Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ImagesOneServerTestJSON-2010861375 Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d7ca0be197104eaaa8b190117f1c2b53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d7ca0be197104eaaa8b190117f1c2b53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d7ca0be197104eaaa8b190117f1c2b53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d7ca0be197104eaaa8b190117f1c2b53"}]}] Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ImagesOneServerTestJSON-2010861375 Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: d7ca0be197104eaaa8b190117f1c2b53 Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2010861375 Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ImagesOneServerTestJSON-2010861375-project Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 930211b0112b490bbe9f6a262ccaf819 Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ImagesOneServerTestJSON-2010861375-project Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance c2695555-41cc-4eff-ae6c-9b8d443103bb could not be found. Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'c2695555-41cc-4eff-ae6c-9b8d443103bb'} Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2695555-41cc-4eff-ae6c-9b8d443103bb could not be found. Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2695555-41cc-4eff-ae6c-9b8d443103bb could not be found. Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:12.163710 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:12.167426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:12.167426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:12.167426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:12.167426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:03:12.167426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:03:12.167426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2695555-41cc-4eff-ae6c-9b8d443103bb could not be found. Aug 04 17:03:12.167426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:12.169037 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ceb04143-b49f-46c3-9ec4-df9b408c5418 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] Returning 404 to user: Instance c2695555-41cc-4eff-ae6c-9b8d443103bb could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:12.170152 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ceb04143-b49f-46c3-9ec4-df9b408c5418 tempest-ImagesOneServerTestJSON-2010861375 tempest-ImagesOneServerTestJSON-2010861375-project] 10.222.0.93 "GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb" status: 404 len: 111 microversion: 2.1 time: 0.090217 Aug 04 17:03:12.171229 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1121/2167] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:12 2022] GET /compute/v2.1/servers/c2695555-41cc-4eff-ae6c-9b8d443103bb => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:03:12.191424 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-eecc20aa-d0f5-4957-9a55-c9a7cf393656 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:12.206488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-eecc20aa-d0f5-4957-9a55-c9a7cf393656 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:12.226045 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eecc20aa-d0f5-4957-9a55-c9a7cf393656 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:12.233002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eecc20aa-d0f5-4957-9a55-c9a7cf393656 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:12.233508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eecc20aa-d0f5-4957-9a55-c9a7cf393656 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:12.235554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eecc20aa-d0f5-4957-9a55-c9a7cf393656 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:12.236047 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eecc20aa-d0f5-4957-9a55-c9a7cf393656 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:12.236488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eecc20aa-d0f5-4957-9a55-c9a7cf393656 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:12.518816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-eecc20aa-d0f5-4957-9a55-c9a7cf393656 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:12.532486 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-eecc20aa-d0f5-4957-9a55-c9a7cf393656 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1498 microversion: 2.1 time: 0.358863 Aug 04 17:03:12.534217 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1122/2168] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:12 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1498 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:12.790785 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0922b4ea-0082-4825-a2f0-f7ffac028339 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:12.791681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0922b4ea-0082-4825-a2f0-f7ffac028339 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:12.800827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0922b4ea-0082-4825-a2f0-f7ffac028339 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:12.801478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0922b4ea-0082-4825-a2f0-f7ffac028339 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:12.807101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0922b4ea-0082-4825-a2f0-f7ffac028339 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:12.808197 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0922b4ea-0082-4825-a2f0-f7ffac028339 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:12.809070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0922b4ea-0082-4825-a2f0-f7ffac028339 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:12.814207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0922b4ea-0082-4825-a2f0-f7ffac028339 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:13.093678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0922b4ea-0082-4825-a2f0-f7ffac028339 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:13.107125 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0922b4ea-0082-4825-a2f0-f7ffac028339 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:13.109010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0922b4ea-0082-4825-a2f0-f7ffac028339 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:13.110715 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0922b4ea-0082-4825-a2f0-f7ffac028339 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1486 microversion: 2.25 time: 0.324512 Aug 04 17:03:13.112336 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1123/2169] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:12 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1486 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:03:13.117433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d5763023-c149-416b-b34a-d0fe83166472 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:13.118355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d5763023-c149-416b-b34a-d0fe83166472 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:13.126746 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d5763023-c149-416b-b34a-d0fe83166472 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:13.128053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d5763023-c149-416b-b34a-d0fe83166472 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:13.128838 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d5763023-c149-416b-b34a-d0fe83166472 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:13.130542 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d5763023-c149-416b-b34a-d0fe83166472 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:13.131462 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d5763023-c149-416b-b34a-d0fe83166472 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:13.132174 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d5763023-c149-416b-b34a-d0fe83166472 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:13.197914 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e84b73ca-cc33-4677-93e5-219017f7f6bb tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461" status: 200 len: 1452 microversion: 2.1 time: 1.436597 Aug 04 17:03:13.200778 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1047/2170] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:11 2022] GET /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461 => generated 1452 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:13.378176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d5763023-c149-416b-b34a-d0fe83166472 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:13.386847 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d5763023-c149-416b-b34a-d0fe83166472 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1522 microversion: 2.1 time: 0.273212 Aug 04 17:03:13.401012 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1124/2171] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:13 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:13.563500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e5a683bc-eff6-4321-af08-5c5e8a86584f tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:13.564443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e5a683bc-eff6-4321-af08-5c5e8a86584f tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:13.582253 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5a683bc-eff6-4321-af08-5c5e8a86584f tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:13.585511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5a683bc-eff6-4321-af08-5c5e8a86584f tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:13.589316 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5a683bc-eff6-4321-af08-5c5e8a86584f tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:13.590387 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5a683bc-eff6-4321-af08-5c5e8a86584f tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:13.592405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5a683bc-eff6-4321-af08-5c5e8a86584f tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:13.595714 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5a683bc-eff6-4321-af08-5c5e8a86584f tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:13.938619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e5a683bc-eff6-4321-af08-5c5e8a86584f tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:13.952310 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e5a683bc-eff6-4321-af08-5c5e8a86584f tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1498 microversion: 2.1 time: 0.397825 Aug 04 17:03:13.953620 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1048/2172] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:13 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1498 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:14.145559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e795f3dd-5552-4abe-8bf4-9780ccaf8f80 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:14.146275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e795f3dd-5552-4abe-8bf4-9780ccaf8f80 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:14.169773 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e795f3dd-5552-4abe-8bf4-9780ccaf8f80 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:14.175757 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e795f3dd-5552-4abe-8bf4-9780ccaf8f80 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:14.176480 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e795f3dd-5552-4abe-8bf4-9780ccaf8f80 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:14.177777 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e795f3dd-5552-4abe-8bf4-9780ccaf8f80 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:14.185206 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e795f3dd-5552-4abe-8bf4-9780ccaf8f80 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:14.196812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e795f3dd-5552-4abe-8bf4-9780ccaf8f80 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:14.212383 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a1d138dd-1c2e-4bcd-8565-5d3f3ceaf93e tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e6c9b8d30>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:14.282891 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a1d138dd-1c2e-4bcd-8565-5d3f3ceaf93e tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461" status: 200 len: 1452 microversion: 2.1 time: 0.074195 Aug 04 17:03:14.286305 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1049/2173] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:14 2022] GET /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461 => generated 1452 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:14.355991 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-09eb97a6-49b3-4693-ba5b-c26e0985dc40 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:14.356430 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-09eb97a6-49b3-4693-ba5b-c26e0985dc40 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:14.369841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09eb97a6-49b3-4693-ba5b-c26e0985dc40 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:14.370394 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09eb97a6-49b3-4693-ba5b-c26e0985dc40 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:14.370855 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09eb97a6-49b3-4693-ba5b-c26e0985dc40 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:14.371588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09eb97a6-49b3-4693-ba5b-c26e0985dc40 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:14.372057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09eb97a6-49b3-4693-ba5b-c26e0985dc40 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:14.372490 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09eb97a6-49b3-4693-ba5b-c26e0985dc40 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:14.433142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-09eb97a6-49b3-4693-ba5b-c26e0985dc40 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:03:14.501138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e795f3dd-5552-4abe-8bf4-9780ccaf8f80 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:14.512246 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e795f3dd-5552-4abe-8bf4-9780ccaf8f80 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:14.516502 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e795f3dd-5552-4abe-8bf4-9780ccaf8f80 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:14.525292 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e795f3dd-5552-4abe-8bf4-9780ccaf8f80 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1476 microversion: 2.25 time: 0.383386 Aug 04 17:03:14.527167 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1125/2174] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:14 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1476 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:14.532047 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d945e9da-57fe-42a3-a9ae-517129a639eb tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:14.539004 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d945e9da-57fe-42a3-a9ae-517129a639eb tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:14.546179 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d945e9da-57fe-42a3-a9ae-517129a639eb tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:14.546864 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d945e9da-57fe-42a3-a9ae-517129a639eb tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:14.547550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d945e9da-57fe-42a3-a9ae-517129a639eb tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:14.548400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d945e9da-57fe-42a3-a9ae-517129a639eb tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:14.550036 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d945e9da-57fe-42a3-a9ae-517129a639eb tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:14.550653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d945e9da-57fe-42a3-a9ae-517129a639eb tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:14.621340 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-09eb97a6-49b3-4693-ba5b-c26e0985dc40 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 204 len: 0 microversion: 2.1 time: 0.269424 Aug 04 17:03:14.624601 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1050/2175] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:03:14 2022] DELETE /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 17:03:14.636946 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a48a7d39-7d2a-4747-b791-6caa61d5d96a tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Calling method '.version_select at 0x7f1e6c9cf4c0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:14.643797 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a48a7d39-7d2a-4747-b791-6caa61d5d96a tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:14.645949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a48a7d39-7d2a-4747-b791-6caa61d5d96a tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:14.646587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a48a7d39-7d2a-4747-b791-6caa61d5d96a tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:14.660337 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a48a7d39-7d2a-4747-b791-6caa61d5d96a tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] 10.222.0.93 "GET /compute/v2.1/os-migrations" status: 200 len: 3204 microversion: 2.25 time: 0.034155 Aug 04 17:03:14.661443 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1051/2176] 10.222.0.93 () {60 vars in 1184 bytes} [Thu Aug 4 17:03:14 2022] GET /compute/v2.1/os-migrations => generated 3204 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:14.666238 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f4639a5a-8884-41b8-aa81-cc40fc9556d4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:14.667142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f4639a5a-8884-41b8-aa81-cc40fc9556d4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:14.674666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4639a5a-8884-41b8-aa81-cc40fc9556d4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:14.675356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4639a5a-8884-41b8-aa81-cc40fc9556d4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:14.676424 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4639a5a-8884-41b8-aa81-cc40fc9556d4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:14.677467 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4639a5a-8884-41b8-aa81-cc40fc9556d4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:14.678117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4639a5a-8884-41b8-aa81-cc40fc9556d4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:14.678694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4639a5a-8884-41b8-aa81-cc40fc9556d4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:14.901899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d945e9da-57fe-42a3-a9ae-517129a639eb tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:14.914623 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d945e9da-57fe-42a3-a9ae-517129a639eb tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1504 microversion: 2.1 time: 0.381996 Aug 04 17:03:14.915653 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1126/2177] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:14 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1504 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:14.921392 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f4639a5a-8884-41b8-aa81-cc40fc9556d4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:14.933148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0d0bc425-3b37-48bf-923a-961dbf88c6d9 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:14.933781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0d0bc425-3b37-48bf-923a-961dbf88c6d9 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:14.935126 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f4639a5a-8884-41b8-aa81-cc40fc9556d4 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1666 microversion: 2.1 time: 0.272386 Aug 04 17:03:14.946013 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1052/2178] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:14 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1666 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:14.946204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d0bc425-3b37-48bf-923a-961dbf88c6d9 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:14.946204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d0bc425-3b37-48bf-923a-961dbf88c6d9 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:14.946204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d0bc425-3b37-48bf-923a-961dbf88c6d9 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:14.946204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d0bc425-3b37-48bf-923a-961dbf88c6d9 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:14.946204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d0bc425-3b37-48bf-923a-961dbf88c6d9 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:14.946204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d0bc425-3b37-48bf-923a-961dbf88c6d9 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:14.975732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c277f480-126c-41b0-8eb8-6982a928a1b3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:14.975963 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c277f480-126c-41b0-8eb8-6982a928a1b3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:14.987269 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c277f480-126c-41b0-8eb8-6982a928a1b3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:14.989739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c277f480-126c-41b0-8eb8-6982a928a1b3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:14.990398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c277f480-126c-41b0-8eb8-6982a928a1b3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:14.991135 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c277f480-126c-41b0-8eb8-6982a928a1b3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:14.991611 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c277f480-126c-41b0-8eb8-6982a928a1b3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:14.992043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c277f480-126c-41b0-8eb8-6982a928a1b3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:15.215189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-0d0bc425-3b37-48bf-923a-961dbf88c6d9 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] Lazy-loading 'services' on Instance uuid 84f56763-a994-4d26-96d4-a6d1ba68566c {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:03:15.246280 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0d0bc425-3b37-48bf-923a-961dbf88c6d9 tempest-LiveAutoBlockMigrationV225Test-816472911 tempest-LiveAutoBlockMigrationV225Test-816472911-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1969 microversion: 2.25 time: 0.325258 Aug 04 17:03:15.248166 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1127/2179] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:14 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1969 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:15.288144 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-175269a0-f15c-483f-a4d1-7cc92438853d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:15.289172 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-175269a0-f15c-483f-a4d1-7cc92438853d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:15.307394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-175269a0-f15c-483f-a4d1-7cc92438853d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:15.310630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-175269a0-f15c-483f-a4d1-7cc92438853d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:15.312013 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-175269a0-f15c-483f-a4d1-7cc92438853d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:15.313460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-175269a0-f15c-483f-a4d1-7cc92438853d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:15.316085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-175269a0-f15c-483f-a4d1-7cc92438853d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:15.320513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-175269a0-f15c-483f-a4d1-7cc92438853d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:15.344059 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c277f480-126c-41b0-8eb8-6982a928a1b3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:15.352809 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c277f480-126c-41b0-8eb8-6982a928a1b3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 200 len: 1475 microversion: 2.1 time: 0.382563 Aug 04 17:03:15.355010 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1053/2180] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:14 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 1475 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:03:15.365412 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6961334b-fc84-4bb0-a3d9-76f98ad5de07 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e6c942670>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:15.383325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-175269a0-f15c-483f-a4d1-7cc92438853d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:03:15.445223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:15.464018 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6961334b-fc84-4bb0-a3d9-76f98ad5de07 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461" status: 200 len: 1452 microversion: 2.1 time: 0.107849 Aug 04 17:03:15.471844 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1054/2181] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:15 2022] GET /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461 => generated 1452 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:15.479577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-142c8e27-6417-4673-9f74-822c21dc4a6d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-151583507"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:15.484435 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-142c8e27-6417-4673-9f74-822c21dc4a6d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:15.503984 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-142c8e27-6417-4673-9f74-822c21dc4a6d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:15.507531 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-142c8e27-6417-4673-9f74-822c21dc4a6d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:15.508311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-142c8e27-6417-4673-9f74-822c21dc4a6d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:15.510262 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-142c8e27-6417-4673-9f74-822c21dc4a6d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:15.512991 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-142c8e27-6417-4673-9f74-822c21dc4a6d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:15.514300 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-142c8e27-6417-4673-9f74-822c21dc4a6d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:15.548749 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-175269a0-f15c-483f-a4d1-7cc92438853d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "DELETE /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 204 len: 0 microversion: 2.25 time: 0.264630 Aug 04 17:03:15.551636 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1128/2182] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Aug 4 17:03:15 2022] DELETE /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:03:15.577934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:15.811247 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-84d68cb8-aea0-4192-bcf1-a053d8401ca0 tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] Action: 'create', calling method: .version_select at 0x7f1e5ae46ca0>, body: {"keypair": {"name": "tempest-keypair-1733718112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7uHACjs1LXjs08upwdZGIaZOddCUmdcCx5wxKdmDmBO2ZKdWmm2qs2zdKuPPeU9/MBxSv08m3rlkc1jJcYiPVHSRV5jrMuEJmlwQYmGWe4sMF9MhEkus2C9joG6CgWHQ=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:15.821486 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-142c8e27-6417-4673-9f74-822c21dc4a6d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "POST /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99/action" status: 202 len: 0 microversion: 2.1 time: 0.355212 Aug 04 17:03:15.822576 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1055/2183] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:03:15 2022] POST /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 17:03:15.822975 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:15.828984 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-96426bb5-6d10-48db-a576-53977deaf94d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:15.829712 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-84d68cb8-aea0-4192-bcf1-a053d8401ca0 tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] Getting quotas for project 3ad179c9a7954bfe831ab04c5122f488. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:03:15.830103 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-96426bb5-6d10-48db-a576-53977deaf94d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:15.836953 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-84d68cb8-aea0-4192-bcf1-a053d8401ca0 tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] Getting quotas for user 08cab8af1cf948f197132e275c6b1132 and project 3ad179c9a7954bfe831ab04c5122f488. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:03:15.840975 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96426bb5-6d10-48db-a576-53977deaf94d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:15.841758 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96426bb5-6d10-48db-a576-53977deaf94d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:15.842341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96426bb5-6d10-48db-a576-53977deaf94d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:15.843194 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96426bb5-6d10-48db-a576-53977deaf94d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:15.843777 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96426bb5-6d10-48db-a576-53977deaf94d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:15.844321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96426bb5-6d10-48db-a576-53977deaf94d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:15.927338 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-84d68cb8-aea0-4192-bcf1-a053d8401ca0 tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.373994 Aug 04 17:03:15.929700 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1129/2184] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:03:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:15.943832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2038f7d4-86b3-41b8-9948-71ce9858ccc0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5af553a0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:16.031176 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2038f7d4-86b3-41b8-9948-71ce9858ccc0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e" status: 200 len: 1409 microversion: 2.1 time: 0.095721 Aug 04 17:03:16.032694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-96426bb5-6d10-48db-a576-53977deaf94d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:16.032964 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1130/2185] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:15 2022] GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e => generated 1409 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:16.038632 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-05aa8134-79d0-40ef-9653-ae5228735f6b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:16.039810 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-05aa8134-79d0-40ef-9653-ae5228735f6b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:16.052970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05aa8134-79d0-40ef-9653-ae5228735f6b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:16.053896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05aa8134-79d0-40ef-9653-ae5228735f6b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:16.054675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05aa8134-79d0-40ef-9653-ae5228735f6b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:16.055351 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-96426bb5-6d10-48db-a576-53977deaf94d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:16.055758 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05aa8134-79d0-40ef-9653-ae5228735f6b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:16.056428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05aa8134-79d0-40ef-9653-ae5228735f6b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:16.057044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05aa8134-79d0-40ef-9653-ae5228735f6b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:16.057712 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-96426bb5-6d10-48db-a576-53977deaf94d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:16.059453 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-96426bb5-6d10-48db-a576-53977deaf94d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1482 microversion: 2.25 time: 0.234884 Aug 04 17:03:16.075672 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1056/2186] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:15 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1482 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:16.083457 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2b18e790-2f8d-4ed9-80a8-ea2a8d804373 tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] Calling method '.version_select at 0x7f1e6ca11ee0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:16.093416 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2b18e790-2f8d-4ed9-80a8-ea2a8d804373 tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] 10.222.0.93 "GET /compute/v2.1/os-keypairs/tempest-keypair-1733718112" status: 200 len: 498 microversion: 2.1 time: 0.016409 Aug 04 17:03:16.094529 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1057/2187] 10.222.0.93 () {58 vars in 1218 bytes} [Thu Aug 4 17:03:16 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1733718112 => generated 498 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:16.104921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d79a49d1-526e-4ded-8cc4-8d3ed1069c98 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:16.107021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d79a49d1-526e-4ded-8cc4-8d3ed1069c98 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:16.113714 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d79a49d1-526e-4ded-8cc4-8d3ed1069c98 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:16.114304 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d79a49d1-526e-4ded-8cc4-8d3ed1069c98 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:16.114817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d79a49d1-526e-4ded-8cc4-8d3ed1069c98 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:16.115539 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d79a49d1-526e-4ded-8cc4-8d3ed1069c98 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:16.116584 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d79a49d1-526e-4ded-8cc4-8d3ed1069c98 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:16.117193 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d79a49d1-526e-4ded-8cc4-8d3ed1069c98 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:16.421326 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-05aa8134-79d0-40ef-9653-ae5228735f6b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:16.439487 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-05aa8134-79d0-40ef-9653-ae5228735f6b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1504 microversion: 2.1 time: 0.403100 Aug 04 17:03:16.441396 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1131/2188] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:16 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1504 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:16.458758 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-51b1d1e7-40f7-4233-9f42-c140a37b4b07 tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] Calling method '.version_select at 0x7f1e5af55820>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:16.478589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d79a49d1-526e-4ded-8cc4-8d3ed1069c98 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:16.487775 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d79a49d1-526e-4ded-8cc4-8d3ed1069c98 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1666 microversion: 2.1 time: 0.391075 Aug 04 17:03:16.506801 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1058/2189] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:16 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1666 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:16.515741 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-d0e6968e-2be3-41e0-8c2d-6a67cf19bf18 req-26bf18d9-7923-4982-afc9-ff2cde2568bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "826b896f-e0e0-48e1-a520-b5fade2c374b", "name": "network-vif-unplugged", "status": "completed", "tag": "0f610c46-1aef-4767-b0af-3f6a244761f6"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:16.523399 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-51b1d1e7-40f7-4233-9f42-c140a37b4b07 tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1733718112" status: 202 len: 0 microversion: 2.1 time: 0.080173 Aug 04 17:03:16.525920 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1132/2190] 10.222.0.93 () {58 vars in 1221 bytes} [Thu Aug 4 17:03:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1733718112 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:03:16.536916 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-14a49d9e-5848-4929-a5d6-c2a69ebb0fba tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5ae743a0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:16.547135 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d0e6968e-2be3-41e0-8c2d-6a67cf19bf18 req-26bf18d9-7923-4982-afc9-ff2cde2568bb service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:16.549121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d0e6968e-2be3-41e0-8c2d-6a67cf19bf18 req-26bf18d9-7923-4982-afc9-ff2cde2568bb service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:16.550278 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d0e6968e-2be3-41e0-8c2d-6a67cf19bf18 req-26bf18d9-7923-4982-afc9-ff2cde2568bb service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:16.570573 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-d0e6968e-2be3-41e0-8c2d-6a67cf19bf18 req-26bf18d9-7923-4982-afc9-ff2cde2568bb service nova] Creating event network-vif-unplugged:0f610c46-1aef-4767-b0af-3f6a244761f6 for instance 826b896f-e0e0-48e1-a520-b5fade2c374b on n-h1-851359-3 Aug 04 17:03:16.575852 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-d0e6968e-2be3-41e0-8c2d-6a67cf19bf18 req-26bf18d9-7923-4982-afc9-ff2cde2568bb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067554 Aug 04 17:03:16.576655 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1059/2191] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:16.598765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-015155e2-b014-42bc-bbc8-824cdb964116 tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] Action: 'create', calling method: .version_select at 0x7f1e6c9818b0>, body: {"keypair": {"name": "tempest-keypair-952396351", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzEY7KvuI7KWyaB+dXKdOsTiSisJO50THF0zVbAr80oVTpv1Mm778PX1FT1jG/6nR+XjeIdoAetFkXfROfCTvdGY/FAHiyV2oG/XFv/CSbswL8l8V9T6e4jhAexmghKvA=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:16.633934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-015155e2-b014-42bc-bbc8-824cdb964116 tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] Getting quotas for project 3ad179c9a7954bfe831ab04c5122f488. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:03:16.637941 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-14a49d9e-5848-4929-a5d6-c2a69ebb0fba tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461" status: 200 len: 1452 microversion: 2.1 time: 0.109797 Aug 04 17:03:16.638547 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1133/2192] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:16 2022] GET /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461 => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:16.646612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-015155e2-b014-42bc-bbc8-824cdb964116 tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] Getting quotas for user 08cab8af1cf948f197132e275c6b1132 and project 3ad179c9a7954bfe831ab04c5122f488. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:03:16.676249 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-015155e2-b014-42bc-bbc8-824cdb964116 tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.098549 Aug 04 17:03:16.676912 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1060/2193] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:03:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:16.689056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f210ec80-e9e7-4a3f-a8d2-09224fcdf1b4 tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] Calling method '.version_select at 0x7f1e5ae74f70>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:16.727590 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f210ec80-e9e7-4a3f-a8d2-09224fcdf1b4 tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-952396351" status: 202 len: 0 microversion: 2.1 time: 0.044126 Aug 04 17:03:16.728447 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1134/2194] 10.222.0.93 () {58 vars in 1218 bytes} [Thu Aug 4 17:03:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-952396351 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 17:03:16.739540 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-31b63401-f860-4010-a6a0-6bcf6f948efd tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] Action: 'create', calling method: .version_select at 0x7f1e6c944940>, body: {"keypair": {"name": "tempest-keypair-671489039", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:16.759611 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-31b63401-f860-4010-a6a0-6bcf6f948efd tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] Getting quotas for project 3ad179c9a7954bfe831ab04c5122f488. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:03:16.764806 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-31b63401-f860-4010-a6a0-6bcf6f948efd tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] Getting quotas for user 08cab8af1cf948f197132e275c6b1132 and project 3ad179c9a7954bfe831ab04c5122f488. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:03:16.804671 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-31b63401-f860-4010-a6a0-6bcf6f948efd tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.070647 Aug 04 17:03:16.805956 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1061/2195] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:03:16 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:16.817380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c3ecd8a7-48e3-415c-b845-ece185a6547a tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] Calling method '.version_select at 0x7f1e5ae73040>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:16.840681 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c3ecd8a7-48e3-415c-b845-ece185a6547a tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-671489039" status: 202 len: 0 microversion: 2.1 time: 0.027969 Aug 04 17:03:16.848155 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1135/2196] 10.222.0.93 () {58 vars in 1218 bytes} [Thu Aug 4 17:03:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-671489039 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:03:16.858994 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-80af96a4-85de-4cba-83f6-333341c18a42 tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] Action: 'create', calling method: .version_select at 0x7f1e6c999820>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1853021321", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/mII+YqD89Q2etjB/eID23o1+Xx92QsWv19kzkF164d7ayqUz9xRNxqdkoe2GtW50LY5Au9n1d4mqF6J4WsoUQ/59rKb42MS2PgnsdodqzcNWpSpaBwfX2eSl5qJR65Q=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:16.875436 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-80af96a4-85de-4cba-83f6-333341c18a42 tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] Getting quotas for project 3ad179c9a7954bfe831ab04c5122f488. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:03:16.882798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-80af96a4-85de-4cba-83f6-333341c18a42 tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] Getting quotas for user 08cab8af1cf948f197132e275c6b1132 and project 3ad179c9a7954bfe831ab04c5122f488. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:03:16.916023 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-80af96a4-85de-4cba-83f6-333341c18a42 tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.066286 Aug 04 17:03:16.917123 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1062/2197] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:03:16 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:03:16.934759 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4b6e4bb4-7ac8-420b-82de-7a377be83cac tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] Action: 'create', calling method: .version_select at 0x7f1e5ae13af0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1338694680", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMru2W7OLy8GRHtgtWR0qEkDTUo29+3N1nogJP13mjvF3kiJaHG/elfZbH9LJUDOi8qy+XBOtI3Zmi6onOwPYfxxLKS2edqljD8dU0c+Jfk2rRljWVKkW4FQ/L9Gy3ekQ=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:16.959787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-4b6e4bb4-7ac8-420b-82de-7a377be83cac tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] Getting quotas for project 3ad179c9a7954bfe831ab04c5122f488. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:03:16.973315 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-4b6e4bb4-7ac8-420b-82de-7a377be83cac tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] Getting quotas for user 08cab8af1cf948f197132e275c6b1132 and project 3ad179c9a7954bfe831ab04c5122f488. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:03:17.027355 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4b6e4bb4-7ac8-420b-82de-7a377be83cac tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.100011 Aug 04 17:03:17.030471 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1136/2198] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:03:16 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:17.048217 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0dec5208-b00c-448a-8e5c-6daa3b82687d tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] Action: 'create', calling method: .version_select at 0x7f1e6c981310>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-162681222", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdQOkV2MSxgb8vOT60QWgXs9pjuXTtH7auKWppKB9PXuyc5c0uJiLGmmwEgQ3rBqeapDBpoIGHcgryMZ53PCpJUPknS21HRI7AbtdLgksNyM59vCYuNtCELaQsT7zEDGA=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:17.052519 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9d0a189b-e515-4a37-9034-95348b154269 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5ae144c0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:17.068909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-0dec5208-b00c-448a-8e5c-6daa3b82687d tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] Getting quotas for project 3ad179c9a7954bfe831ab04c5122f488. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:03:17.088473 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-0dec5208-b00c-448a-8e5c-6daa3b82687d tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] Getting quotas for user 08cab8af1cf948f197132e275c6b1132 and project 3ad179c9a7954bfe831ab04c5122f488. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:03:17.126201 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9d0a189b-e515-4a37-9034-95348b154269 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e" status: 200 len: 1409 microversion: 2.1 time: 0.083040 Aug 04 17:03:17.126781 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0dec5208-b00c-448a-8e5c-6daa3b82687d tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.082933 Aug 04 17:03:17.128457 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1137/2199] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:17 2022] GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e => generated 1409 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:17.134068 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1063/2200] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:03:17 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:17.134331 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-29f4ab6f-be20-4a96-8152-a42676d47d99 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:17.135124 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-29f4ab6f-be20-4a96-8152-a42676d47d99 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:17.141068 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5fb1b8d6-1da9-410a-89a9-42866b393dd2 tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] Calling method '.version_select at 0x7f1e6c908ca0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:17.142252 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29f4ab6f-be20-4a96-8152-a42676d47d99 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:17.143081 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29f4ab6f-be20-4a96-8152-a42676d47d99 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:17.143701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29f4ab6f-be20-4a96-8152-a42676d47d99 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:17.144737 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29f4ab6f-be20-4a96-8152-a42676d47d99 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:17.145393 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29f4ab6f-be20-4a96-8152-a42676d47d99 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:17.146010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29f4ab6f-be20-4a96-8152-a42676d47d99 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:17.146659 n-d-851359-3 devstack@n-api.service[131044]: WARNING oslo_db.sqlalchemy.utils [None req-5fb1b8d6-1da9-410a-89a9-42866b393dd2 tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 04 17:03:17.153188 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5fb1b8d6-1da9-410a-89a9-42866b393dd2 tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] 10.222.0.93 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.017040 Aug 04 17:03:17.160883 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1064/2201] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Aug 4 17:03:17 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:03:17.167090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-910eb9f0-b7d5-446c-823e-1b58519aadfe tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] Calling method '.version_select at 0x7f1e6c942670>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:17.196280 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-910eb9f0-b7d5-446c-823e-1b58519aadfe tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-162681222" status: 202 len: 0 microversion: 2.1 time: 0.033202 Aug 04 17:03:17.197131 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1065/2202] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Aug 4 17:03:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-162681222 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:03:17.207792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1fc8a570-1068-415a-ae11-cda9d590b786 tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] Calling method '.version_select at 0x7f1e6c915040>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:17.227629 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:17.235152 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1fc8a570-1068-415a-ae11-cda9d590b786 tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1338694680" status: 202 len: 0 microversion: 2.1 time: 0.033078 Aug 04 17:03:17.235677 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1066/2203] 10.222.0.93 () {58 vars in 1278 bytes} [Thu Aug 4 17:03:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1338694680 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:03:17.247901 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6128112a-ba36-4c20-b5d1-b29fca6724ae tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] Calling method '.version_select at 0x7f1e5b9b9d30>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:17.284595 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6128112a-ba36-4c20-b5d1-b29fca6724ae tempest-KeyPairsV2TestJSON-696929878 tempest-KeyPairsV2TestJSON-696929878-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1853021321" status: 202 len: 0 microversion: 2.1 time: 0.043049 Aug 04 17:03:17.290034 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1067/2204] 10.222.0.93 () {58 vars in 1278 bytes} [Thu Aug 4 17:03:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1853021321 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 17:03:17.386178 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-29f4ab6f-be20-4a96-8152-a42676d47d99 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:17.396566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-29f4ab6f-be20-4a96-8152-a42676d47d99 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:17.398999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-29f4ab6f-be20-4a96-8152-a42676d47d99 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:17.400467 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-29f4ab6f-be20-4a96-8152-a42676d47d99 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1482 microversion: 2.25 time: 0.270952 Aug 04 17:03:17.401761 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1138/2205] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:17 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1482 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:17.464294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1d8db49d-a1a0-44ac-9d9a-101e7b884b05 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:17.465206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1d8db49d-a1a0-44ac-9d9a-101e7b884b05 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:17.473274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d8db49d-a1a0-44ac-9d9a-101e7b884b05 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:17.473957 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d8db49d-a1a0-44ac-9d9a-101e7b884b05 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:17.474513 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d8db49d-a1a0-44ac-9d9a-101e7b884b05 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:17.475314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d8db49d-a1a0-44ac-9d9a-101e7b884b05 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:17.475875 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d8db49d-a1a0-44ac-9d9a-101e7b884b05 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:17.476994 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d8db49d-a1a0-44ac-9d9a-101e7b884b05 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:17.514125 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6944cf8b-56d6-4187-8c7f-7e3986f65339 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:17.514979 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6944cf8b-56d6-4187-8c7f-7e3986f65339 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:17.529222 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6944cf8b-56d6-4187-8c7f-7e3986f65339 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:17.530567 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6944cf8b-56d6-4187-8c7f-7e3986f65339 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:17.531630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6944cf8b-56d6-4187-8c7f-7e3986f65339 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:17.538746 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6944cf8b-56d6-4187-8c7f-7e3986f65339 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:17.539334 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6944cf8b-56d6-4187-8c7f-7e3986f65339 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:17.542532 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6944cf8b-56d6-4187-8c7f-7e3986f65339 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:17.653213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6944cf8b-56d6-4187-8c7f-7e3986f65339 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:17.666393 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6944cf8b-56d6-4187-8c7f-7e3986f65339 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1599 microversion: 2.1 time: 0.157332 Aug 04 17:03:17.667224 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1139/2206] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:17 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:03:17.672196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8c0f1540-da42-48ba-9a7d-844588185e8b tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5ae46940>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:17.754724 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8c0f1540-da42-48ba-9a7d-844588185e8b tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461" status: 200 len: 1452 microversion: 2.1 time: 0.086358 Aug 04 17:03:17.757235 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1140/2207] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:17 2022] GET /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461 => generated 1452 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:17.843047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1d8db49d-a1a0-44ac-9d9a-101e7b884b05 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:17.859163 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1d8db49d-a1a0-44ac-9d9a-101e7b884b05 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1504 microversion: 2.1 time: 0.392154 Aug 04 17:03:17.860934 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1068/2208] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:17 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1504 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:18.055382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-6633da57-5000-4cd5-a8a9-cf17240aa158 req-2e0ee5dd-92d6-4ef1-8278-e3725dc1c48c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e92cd73d-ce71-4f92-9db9-ae02c7febbcb", "name": "network-vif-deleted", "tag": "46af0dd3-3cdc-4c63-9694-d9b2f7cf2afa"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:18.076856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6633da57-5000-4cd5-a8a9-cf17240aa158 req-2e0ee5dd-92d6-4ef1-8278-e3725dc1c48c service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:18.079050 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6633da57-5000-4cd5-a8a9-cf17240aa158 req-2e0ee5dd-92d6-4ef1-8278-e3725dc1c48c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:18.079541 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6633da57-5000-4cd5-a8a9-cf17240aa158 req-2e0ee5dd-92d6-4ef1-8278-e3725dc1c48c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:18.102629 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-6633da57-5000-4cd5-a8a9-cf17240aa158 req-2e0ee5dd-92d6-4ef1-8278-e3725dc1c48c service nova] Creating event network-vif-deleted:46af0dd3-3cdc-4c63-9694-d9b2f7cf2afa for instance e92cd73d-ce71-4f92-9db9-ae02c7febbcb on n-h1-851359-3 Aug 04 17:03:18.121190 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-6633da57-5000-4cd5-a8a9-cf17240aa158 req-2e0ee5dd-92d6-4ef1-8278-e3725dc1c48c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071738 Aug 04 17:03:18.122431 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1141/2209] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:18.143166 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3657ca68-6778-4b8a-9b97-e9b2e5722e48 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e6c981280>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:18.217928 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3657ca68-6778-4b8a-9b97-e9b2e5722e48 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e" status: 200 len: 1409 microversion: 2.1 time: 0.078735 Aug 04 17:03:18.218854 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1069/2210] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:18 2022] GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e => generated 1409 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:18.426166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-094bef10-da4b-47a6-b34a-ed7e883e0c3c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:18.428880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-094bef10-da4b-47a6-b34a-ed7e883e0c3c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:18.441179 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-094bef10-da4b-47a6-b34a-ed7e883e0c3c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:18.447426 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-094bef10-da4b-47a6-b34a-ed7e883e0c3c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:18.448254 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-094bef10-da4b-47a6-b34a-ed7e883e0c3c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:18.449287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-094bef10-da4b-47a6-b34a-ed7e883e0c3c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:18.450077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-094bef10-da4b-47a6-b34a-ed7e883e0c3c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:18.451022 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-094bef10-da4b-47a6-b34a-ed7e883e0c3c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:18.614871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-094bef10-da4b-47a6-b34a-ed7e883e0c3c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:18.628009 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-094bef10-da4b-47a6-b34a-ed7e883e0c3c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:18.632431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-094bef10-da4b-47a6-b34a-ed7e883e0c3c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:18.639364 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-094bef10-da4b-47a6-b34a-ed7e883e0c3c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1266 microversion: 2.25 time: 0.216286 Aug 04 17:03:18.651705 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1142/2211] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:18 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:18.688760 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ec853cf1-866b-4d17-a78e-7d06d14efd3a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:18.689465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ec853cf1-866b-4d17-a78e-7d06d14efd3a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:18.706951 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec853cf1-866b-4d17-a78e-7d06d14efd3a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:18.710164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec853cf1-866b-4d17-a78e-7d06d14efd3a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:18.710715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec853cf1-866b-4d17-a78e-7d06d14efd3a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:18.711490 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec853cf1-866b-4d17-a78e-7d06d14efd3a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:18.712453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec853cf1-866b-4d17-a78e-7d06d14efd3a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:18.712906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec853cf1-866b-4d17-a78e-7d06d14efd3a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:18.771661 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9b0e79e8-8c08-4900-9a38-926cca6645d7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5ae14820>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:18.868298 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9b0e79e8-8c08-4900-9a38-926cca6645d7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461" status: 200 len: 1452 microversion: 2.1 time: 0.100806 Aug 04 17:03:18.878608 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1143/2212] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:18 2022] GET /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461 => generated 1452 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:18.891239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ec853cf1-866b-4d17-a78e-7d06d14efd3a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:18.892114 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5a796a0a-15be-4fb0-ba34-1485df92c218 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:18.892910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5a796a0a-15be-4fb0-ba34-1485df92c218 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:18.903362 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ec853cf1-866b-4d17-a78e-7d06d14efd3a tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1599 microversion: 2.1 time: 0.219852 Aug 04 17:03:18.920746 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5a796a0a-15be-4fb0-ba34-1485df92c218 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:18.924052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5a796a0a-15be-4fb0-ba34-1485df92c218 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:18.924052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5a796a0a-15be-4fb0-ba34-1485df92c218 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:18.924052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5a796a0a-15be-4fb0-ba34-1485df92c218 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:18.924052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5a796a0a-15be-4fb0-ba34-1485df92c218 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:18.924052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5a796a0a-15be-4fb0-ba34-1485df92c218 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:18.924673 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1070/2213] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:18 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1599 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:19.235489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a4bab855-35b2-4582-be76-7df0fe4b8a75 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e6c9448b0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:19.253215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5a796a0a-15be-4fb0-ba34-1485df92c218 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:19.263015 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5a796a0a-15be-4fb0-ba34-1485df92c218 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1504 microversion: 2.1 time: 0.383337 Aug 04 17:03:19.277220 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1144/2214] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:18 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1504 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:19.311646 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a4bab855-35b2-4582-be76-7df0fe4b8a75 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e" status: 200 len: 1409 microversion: 2.1 time: 0.082668 Aug 04 17:03:19.317170 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1071/2215] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:19 2022] GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e => generated 1409 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:03:19.662410 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-be91989e-cb39-42eb-bafc-ab3a503119da tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:19.663045 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-be91989e-cb39-42eb-bafc-ab3a503119da tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:19.678720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be91989e-cb39-42eb-bafc-ab3a503119da tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:19.682281 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be91989e-cb39-42eb-bafc-ab3a503119da tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:19.683081 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be91989e-cb39-42eb-bafc-ab3a503119da tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:19.684194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be91989e-cb39-42eb-bafc-ab3a503119da tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:19.684874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be91989e-cb39-42eb-bafc-ab3a503119da tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:19.687394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be91989e-cb39-42eb-bafc-ab3a503119da tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:19.866191 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-be91989e-cb39-42eb-bafc-ab3a503119da tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:19.875091 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-be91989e-cb39-42eb-bafc-ab3a503119da tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:19.876631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-be91989e-cb39-42eb-bafc-ab3a503119da tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:19.888953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-82fbbe4f-92ef-458e-b963-f84ab345b4ce tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e6c981c10>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:19.900268 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-be91989e-cb39-42eb-bafc-ab3a503119da tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1266 microversion: 2.25 time: 0.220448 Aug 04 17:03:19.901084 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1145/2216] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:19 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:19.949966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ea47e9b2-3370-4f79-8db3-559b573471ec tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:19.950644 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ea47e9b2-3370-4f79-8db3-559b573471ec tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:19.966150 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-82fbbe4f-92ef-458e-b963-f84ab345b4ce tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461" status: 200 len: 1452 microversion: 2.1 time: 0.082058 Aug 04 17:03:19.971798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea47e9b2-3370-4f79-8db3-559b573471ec tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:19.972315 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1072/2217] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:19 2022] GET /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461 => generated 1452 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:19.973123 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea47e9b2-3370-4f79-8db3-559b573471ec tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:19.973768 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea47e9b2-3370-4f79-8db3-559b573471ec tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:19.974711 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea47e9b2-3370-4f79-8db3-559b573471ec tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:19.975358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea47e9b2-3370-4f79-8db3-559b573471ec tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:19.975988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea47e9b2-3370-4f79-8db3-559b573471ec tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:20.036665 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea47e9b2-3370-4f79-8db3-559b573471ec tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:20.037180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea47e9b2-3370-4f79-8db3-559b573471ec tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:20.037635 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea47e9b2-3370-4f79-8db3-559b573471ec tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:20.038135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-ea47e9b2-3370-4f79-8db3-559b573471ec tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lazy-loading 'fault' on Instance uuid e92cd73d-ce71-4f92-9db9-ae02c7febbcb {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:03:20.139580 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-4dfe11bf-e41d-4782-91ea-eeb113cd4f83 req-dca79223-1b1b-47ae-a35e-c91c83e42294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84f56763-a994-4d26-96d4-a6d1ba68566c", "name": "network-vif-deleted", "tag": "10ad4377-3641-452e-aee7-2170593948a9"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:20.157695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4dfe11bf-e41d-4782-91ea-eeb113cd4f83 req-dca79223-1b1b-47ae-a35e-c91c83e42294 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:20.160399 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4dfe11bf-e41d-4782-91ea-eeb113cd4f83 req-dca79223-1b1b-47ae-a35e-c91c83e42294 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:20.165318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4dfe11bf-e41d-4782-91ea-eeb113cd4f83 req-dca79223-1b1b-47ae-a35e-c91c83e42294 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:20.194839 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-4dfe11bf-e41d-4782-91ea-eeb113cd4f83 req-dca79223-1b1b-47ae-a35e-c91c83e42294 service nova] Creating event network-vif-deleted:10ad4377-3641-452e-aee7-2170593948a9 for instance 84f56763-a994-4d26-96d4-a6d1ba68566c on n-h2-851359-3 Aug 04 17:03:20.212340 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-4dfe11bf-e41d-4782-91ea-eeb113cd4f83 req-dca79223-1b1b-47ae-a35e-c91c83e42294 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076343 Aug 04 17:03:20.221298 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1073/2218] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:20.255219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ea47e9b2-3370-4f79-8db3-559b573471ec tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:20.279785 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ea47e9b2-3370-4f79-8db3-559b573471ec tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 200 len: 1324 microversion: 2.1 time: 0.351266 Aug 04 17:03:20.281810 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1146/2219] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:19 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 1324 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:20.291480 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b3043590-8859-4548-b390-7f244a0e184d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:20.301019 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b3043590-8859-4548-b390-7f244a0e184d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:20.310465 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3043590-8859-4548-b390-7f244a0e184d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:20.313104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3043590-8859-4548-b390-7f244a0e184d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:20.313668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3043590-8859-4548-b390-7f244a0e184d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:20.314557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3043590-8859-4548-b390-7f244a0e184d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:20.315760 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3043590-8859-4548-b390-7f244a0e184d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:20.316412 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3043590-8859-4548-b390-7f244a0e184d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:20.484483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b9bfa73b-8a2d-41d4-8fcb-579dd05663a8 tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Action: 'create', calling method: .version_select at 0x7f1e6c9cfc10>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+fFiYkPi+jh25bm/vYiInAF2hFrfzU4oTdPrCFUnj1xPAUNa0UgLaYGB3GDvcXZxuDRK0ZqrLOIVcx2cPEprm2HDgRyEAx0Fg46skTTwQfUrllskgO1GCH9YGYaGl3yg=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b9bfa73b-8a2d-41d4-8fcb-579dd05663a8 tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Request method failure captured: Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 257 Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_vYiitVabgWz_2pIX8ZGDxdeLbMPI8Ccf9xB5Su5QYA0h-_1s9KqhM4sS6m8fdQwX5neikxXMXk-wHWZzXEzuufXWRxW0E3k60YR5I7FLhAUyCgCXd0OHvKgFSR1v0dwhy-eVVGnSoATQSuDrOlwoMCJVXLjz4ZIybtkYTrJ-SKe-I Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 302f1cef15ac4b58ab2a212b5a11783e Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-559076456 Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/302f1cef15ac4b58ab2a212b5a11783e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/302f1cef15ac4b58ab2a212b5a11783e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_302f1cef15ac4b58ab2a212b5a11783e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/302f1cef15ac4b58ab2a212b5a11783e"}]}] Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-KeyPairsNegativeTestJSON-559076456 Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 302f1cef15ac4b58ab2a212b5a11783e Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-559076456 Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-KeyPairsNegativeTestJSON-559076456-project Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: e604c32bc1294a72843ff468257e90de Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-KeyPairsNegativeTestJSON-559076456-project Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+fFiYkPi+jh25bm/vYiInAF2hFrfzU4oTdPrCFUnj1xPAUNa0UgLaYGB3GDvcXZxuDRK0ZqrLOIVcx2cPEprm2HDgRyEAx0Fg46skTTwQfUrllskgO1GCH9YGYaGl3yg=="}} Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+fFiYkPi+jh25bm/vYiInAF2hFrfzU4oTdPrCFUnj1xPAUNa0UgLaYGB3GDvcXZxuDRK0ZqrLOIVcx2cPEprm2HDgRyEAx0Fg46skTTwQfUrllskgO1GCH9YGYaGl3yg=='}}} Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 04 17:03:20.492030 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:03:20.495587 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:20.495587 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:03:20.495587 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:20.495587 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:20.495587 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:20.495587 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:20.495587 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:20.495587 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:03:20.495587 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:03:20.495587 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:20.495587 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:20.495587 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:03:20.495587 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:03:20.495587 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:03:20.495587 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:03:20.495587 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:03:20.495587 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:03:20.495587 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:03:20.495587 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:03:20.495587 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 04 17:03:20.495587 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:03:20.495587 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:20.495587 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:03:20.495587 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:20.495587 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:20.495587 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:20.495587 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:03:20.495587 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:03:20.495587 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 04 17:03:20.495587 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:03:20.495587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b9bfa73b-8a2d-41d4-8fcb-579dd05663a8 tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:20.495587 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b9bfa73b-8a2d-41d4-8fcb-579dd05663a8 tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.238482 Aug 04 17:03:20.501690 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1074/2220] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:03:20 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 243 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:03:20.506472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-21436531-adfe-4286-a110-d636e36bf5be tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e6c999820>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:20.567483 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b3043590-8859-4548-b390-7f244a0e184d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:20.576924 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b3043590-8859-4548-b390-7f244a0e184d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 200 len: 1447 microversion: 2.1 time: 0.293142 Aug 04 17:03:20.578230 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1147/2221] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:20 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 1447 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:20.583509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-796068aa-3197-4159-b2c5-fab7c188492f tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Action: 'create', calling method: .version_select at 0x7f1e5ae731f0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-569896952", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:20.594481 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-21436531-adfe-4286-a110-d636e36bf5be tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e" status: 200 len: 1409 microversion: 2.1 time: 0.092268 Aug 04 17:03:20.604950 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1075/2222] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:20 2022] GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e => generated 1409 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:20.614719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bc205fb4-785c-42de-b653-863bba4fb1e6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:20.617106 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-796068aa-3197-4159-b2c5-fab7c188492f tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Getting quotas for project 302f1cef15ac4b58ab2a212b5a11783e. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:03:20.618744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bc205fb4-785c-42de-b653-863bba4fb1e6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:20.622010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-796068aa-3197-4159-b2c5-fab7c188492f tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Getting quotas for user e604c32bc1294a72843ff468257e90de and project 302f1cef15ac4b58ab2a212b5a11783e. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:03:20.632841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc205fb4-785c-42de-b653-863bba4fb1e6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:20.633430 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc205fb4-785c-42de-b653-863bba4fb1e6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:20.634724 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc205fb4-785c-42de-b653-863bba4fb1e6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:20.636271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc205fb4-785c-42de-b653-863bba4fb1e6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:20.636928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc205fb4-785c-42de-b653-863bba4fb1e6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:20.638377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc205fb4-785c-42de-b653-863bba4fb1e6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:20.639076 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-796068aa-3197-4159-b2c5-fab7c188492f tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-796068aa-3197-4159-b2c5-fab7c188492f tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Request method failure captured: Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 2166 Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_vYiitVabgWz_2pIX8ZGDxdeLbMPI8Ccf9xB5Su5QYA0h-_1s9KqhM4sS6m8fdQwX5neikxXMXk-wHWZzXEzuufXWRxW0E3k60YR5I7FLhAUyCgCXd0OHvKgFSR1v0dwhy-eVVGnSoATQSuDrOlwoMCJVXLjz4ZIybtkYTrJ-SKe-I Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 302f1cef15ac4b58ab2a212b5a11783e Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-559076456 Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/302f1cef15ac4b58ab2a212b5a11783e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/302f1cef15ac4b58ab2a212b5a11783e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_302f1cef15ac4b58ab2a212b5a11783e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/302f1cef15ac4b58ab2a212b5a11783e"}]}] Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-KeyPairsNegativeTestJSON-559076456 Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 302f1cef15ac4b58ab2a212b5a11783e Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-559076456 Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-KeyPairsNegativeTestJSON-559076456-project Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: e604c32bc1294a72843ff468257e90de Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-KeyPairsNegativeTestJSON-559076456-project Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-569896952", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 17:03:20.662535 n-d-851359-3 devstack@n-api.service[131043]: exception: Keypair data is invalid: failed to generate fingerprint Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-569896952', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:20.664716 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:20.667679 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:03:20.667679 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:03:20.667679 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:03:20.667679 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:03:20.667679 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 04 17:03:20.667679 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 04 17:03:20.667679 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 04 17:03:20.667679 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 04 17:03:20.667679 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 04 17:03:20.667679 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:20.667679 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:20.667679 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:20.667679 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:20.667679 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:20.667679 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:20.667679 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:03:20.667679 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:03:20.667679 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 04 17:03:20.667679 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:20.667679 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-796068aa-3197-4159-b2c5-fab7c188492f tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:20.667679 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-796068aa-3197-4159-b2c5-fab7c188492f tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.084757 Aug 04 17:03:20.674245 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1148/2223] 10.222.0.93 () {60 vars in 1160 bytes} [Thu Aug 4 17:03:20 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 17:03:20.684644 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7167a4c8-10d0-49c4-a2c0-17b21722f6f9 tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Action: 'create', calling method: .version_select at 0x7f1e5b177c10>, body: {"keypair": {"name": "tempest-keypair-239386600", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFueisnMaqbFP++hzl6jA5WVb2LlqIRJnSA2ZPQysmOvBrDqJ0CwGi9KHfppFawisBVRVT39jCNiYH1/m6USbr85U6VL413xNqJ0TFnwudWOIF1dVcymw3edUSKgA+LaiA=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:20.687757 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bc205fb4-785c-42de-b653-863bba4fb1e6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:03:20.707268 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-7167a4c8-10d0-49c4-a2c0-17b21722f6f9 tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Getting quotas for project 302f1cef15ac4b58ab2a212b5a11783e. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:03:20.714676 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.compute.api [None req-bc205fb4-785c-42de-b653-863bba4fb1e6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Working on deleting snapshot 646b95d2-6cc8-45c5-804c-ff07c77c9045 from shelved instance... Aug 04 17:03:20.717717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-7167a4c8-10d0-49c4-a2c0-17b21722f6f9 tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Getting quotas for user e604c32bc1294a72843ff468257e90de and project 302f1cef15ac4b58ab2a212b5a11783e. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:03:20.763299 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7167a4c8-10d0-49c4-a2c0-17b21722f6f9 tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.087592 Aug 04 17:03:20.764144 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1149/2224] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:03:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:20.780128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-513ae26a-5d2f-4126-8057-4260b02f850c tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Action: 'create', calling method: .version_select at 0x7f1e5af05ca0>, body: {"keypair": {"name": "tempest-keypair-239386600", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNH9J+JP8IElQ+vUM1XAdLPxLjQlDXEu35o328Tdi1dqgmCuIPTYlbVt3uwH273LsZwBA5qalKhsYJZbY2LHqFLWc/sZbyeSzoTZqQM2RIhYS4gFyporW/d3TnXYYWsUEA=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:20.800639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-513ae26a-5d2f-4126-8057-4260b02f850c tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Getting quotas for project 302f1cef15ac4b58ab2a212b5a11783e. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:03:20.806793 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-513ae26a-5d2f-4126-8057-4260b02f850c tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Getting quotas for user e604c32bc1294a72843ff468257e90de and project 302f1cef15ac4b58ab2a212b5a11783e. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:03:20.845569 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-513ae26a-5d2f-4126-8057-4260b02f850c tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] HTTP exception thrown: Key pair 'tempest-keypair-239386600' already exists. Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-513ae26a-5d2f-4126-8057-4260b02f850c tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Request method failure captured: Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 272 Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_vYiitVabgWz_2pIX8ZGDxdeLbMPI8Ccf9xB5Su5QYA0h-_1s9KqhM4sS6m8fdQwX5neikxXMXk-wHWZzXEzuufXWRxW0E3k60YR5I7FLhAUyCgCXd0OHvKgFSR1v0dwhy-eVVGnSoATQSuDrOlwoMCJVXLjz4ZIybtkYTrJ-SKe-I Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 302f1cef15ac4b58ab2a212b5a11783e Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-559076456 Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/302f1cef15ac4b58ab2a212b5a11783e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/302f1cef15ac4b58ab2a212b5a11783e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_302f1cef15ac4b58ab2a212b5a11783e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/302f1cef15ac4b58ab2a212b5a11783e"}]}] Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-KeyPairsNegativeTestJSON-559076456 Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 302f1cef15ac4b58ab2a212b5a11783e Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-559076456 Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-KeyPairsNegativeTestJSON-559076456-project Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: e604c32bc1294a72843ff468257e90de Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-KeyPairsNegativeTestJSON-559076456-project Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: {"keypair": {"name": "tempest-keypair-239386600", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNH9J+JP8IElQ+vUM1XAdLPxLjQlDXEu35o328Tdi1dqgmCuIPTYlbVt3uwH273LsZwBA5qalKhsYJZbY2LHqFLWc/sZbyeSzoTZqQM2RIhYS4gFyporW/d3TnXYYWsUEA=="}} Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: exception: Key pair 'tempest-keypair-239386600' already exists. Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-239386600', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNH9J+JP8IElQ+vUM1XAdLPxLjQlDXEu35o328Tdi1dqgmCuIPTYlbVt3uwH273LsZwBA5qalKhsYJZbY2LHqFLWc/sZbyeSzoTZqQM2RIhYS4gFyporW/d3TnXYYWsUEA=='}}} Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result.read() Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'e604c32bc1294a72843ff468257e90de-tempest-keypair-239386600' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 04 17:03:20.860293 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi session.flush() Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result.read() Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 04 17:03:20.864575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'e604c32bc1294a72843ff468257e90de-tempest-keypair-239386600' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 4, 17, 3, 20, 829047), 'updated_at': None, 'name': 'tempest-keypair-239386600', 'user_id': 'e604c32bc1294a72843ff468257e90de', 'fingerprint': '8d:ff:09:88:b3:9c:ea:5d:d5:e8:54:26:3b:0c:87:12', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNH9J+JP8IElQ+vUM1XAdLPxLjQlDXEu35o328Tdi1dqgmCuIPTYlbVt3uwH273LsZwBA5qalKhsYJZbY2LHqFLWc/sZbyeSzoTZqQM2RIhYS4gFyporW/d3TnXYYWsUEA==', 'type': 'ssh'}] Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6730, in import_key_pair Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi keypair.create() Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._create() Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-239386600' already exists. Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 04 17:03:20.867877 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-239386600' already exists. Aug 04 17:03:20.873846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:20.873846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:20.873846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:20.873846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:20.873846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:20.873846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:20.873846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:03:20.873846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:03:20.873846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-239386600' already exists. Aug 04 17:03:20.873846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:20.873846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-513ae26a-5d2f-4126-8057-4260b02f850c tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Returning 409 to user: Key pair 'tempest-keypair-239386600' already exists. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:20.873846 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-513ae26a-5d2f-4126-8057-4260b02f850c tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.096700 Aug 04 17:03:20.873846 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1150/2225] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:03:20 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:03:20.896083 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9f2259d7-765d-4dc2-a8a9-578ef82ac60b tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Calling method '.version_select at 0x7f1e5ae46430>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:20.935776 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9f2259d7-765d-4dc2-a8a9-578ef82ac60b tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-239386600" status: 202 len: 0 microversion: 2.1 time: 0.056771 Aug 04 17:03:20.942880 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1151/2226] 10.222.0.93 () {58 vars in 1218 bytes} [Thu Aug 4 17:03:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-239386600 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:03:20.953345 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a23d973a-48bf-4edc-a0b0-ebf2dc1e6ea4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:20.954025 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a23d973a-48bf-4edc-a0b0-ebf2dc1e6ea4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:20.961359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a23d973a-48bf-4edc-a0b0-ebf2dc1e6ea4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:20.962115 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a23d973a-48bf-4edc-a0b0-ebf2dc1e6ea4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:20.962636 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a23d973a-48bf-4edc-a0b0-ebf2dc1e6ea4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:20.963717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a23d973a-48bf-4edc-a0b0-ebf2dc1e6ea4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:20.964689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a23d973a-48bf-4edc-a0b0-ebf2dc1e6ea4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:20.965203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a23d973a-48bf-4edc-a0b0-ebf2dc1e6ea4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:21.044093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a23d973a-48bf-4edc-a0b0-ebf2dc1e6ea4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:21.052918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a23d973a-48bf-4edc-a0b0-ebf2dc1e6ea4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:21.055325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a23d973a-48bf-4edc-a0b0-ebf2dc1e6ea4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:21.056641 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a23d973a-48bf-4edc-a0b0-ebf2dc1e6ea4 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1266 microversion: 2.25 time: 0.112665 Aug 04 17:03:21.057933 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1152/2227] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:20 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1266 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:21.062940 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e12502cd-721d-44d3-a0e9-24f631f18af9 tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Action: 'create', calling method: .version_select at 0x7f1e5aec30d0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIheT7YCG+aGpejsEyDb/OVQkNEfgylR53Hx5mMPqaofZz2/EH7uEvRR8EDj6eYsjGcZeo0biotCjt7KfbMNS5ipeXa7HpF1isso6YpL2pHNdL5Ndq018uFF/sXKtDPIDA=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e12502cd-721d-44d3-a0e9-24f631f18af9 tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Request method failure captured: Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 247 Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_vYiitVabgWz_2pIX8ZGDxdeLbMPI8Ccf9xB5Su5QYA0h-_1s9KqhM4sS6m8fdQwX5neikxXMXk-wHWZzXEzuufXWRxW0E3k60YR5I7FLhAUyCgCXd0OHvKgFSR1v0dwhy-eVVGnSoATQSuDrOlwoMCJVXLjz4ZIybtkYTrJ-SKe-I Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 302f1cef15ac4b58ab2a212b5a11783e Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-559076456 Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/302f1cef15ac4b58ab2a212b5a11783e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/302f1cef15ac4b58ab2a212b5a11783e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_302f1cef15ac4b58ab2a212b5a11783e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/302f1cef15ac4b58ab2a212b5a11783e"}]}] Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-KeyPairsNegativeTestJSON-559076456 Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 302f1cef15ac4b58ab2a212b5a11783e Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-559076456 Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-KeyPairsNegativeTestJSON-559076456-project Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: e604c32bc1294a72843ff468257e90de Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-KeyPairsNegativeTestJSON-559076456-project Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIheT7YCG+aGpejsEyDb/OVQkNEfgylR53Hx5mMPqaofZz2/EH7uEvRR8EDj6eYsjGcZeo0biotCjt7KfbMNS5ipeXa7HpF1isso6YpL2pHNdL5Ndq018uFF/sXKtDPIDA=="}} Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIheT7YCG+aGpejsEyDb/OVQkNEfgylR53Hx5mMPqaofZz2/EH7uEvRR8EDj6eYsjGcZeo0biotCjt7KfbMNS5ipeXa7HpF1isso6YpL2pHNdL5Ndq018uFF/sXKtDPIDA=='}}} Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi '' Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:03:21.068225 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:03:21.071380 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:03:21.071380 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:03:21.071380 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:03:21.071380 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:03:21.071380 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 04 17:03:21.071380 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:21.071380 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:21.071380 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:21.071380 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:21.071380 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:21.071380 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:21.071380 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:03:21.071380 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:03:21.071380 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 04 17:03:21.071380 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:21.073452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e12502cd-721d-44d3-a0e9-24f631f18af9 tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:21.074524 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e12502cd-721d-44d3-a0e9-24f631f18af9 tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.015419 Aug 04 17:03:21.075249 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1153/2228] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:03:21 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:03:21.084824 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-67901e1d-d18c-49ba-92ac-52813940e658 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5ae14ca0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:21.989134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bc205fb4-785c-42de-b653-863bba4fb1e6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Doing local delete in cell 435e901d-6672-4284-ad57-58e647e6e99d(cell1) {{(pid=131044) _delete /opt/stack/nova/nova/compute/api.py:2491}} Aug 04 17:03:21.990559 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc205fb4-785c-42de-b653-863bba4fb1e6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:21.991282 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc205fb4-785c-42de-b653-863bba4fb1e6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:21.991527 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-67901e1d-d18c-49ba-92ac-52813940e658 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461" status: 200 len: 1452 microversion: 2.1 time: 0.914987 Aug 04 17:03:21.992693 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc205fb4-785c-42de-b653-863bba4fb1e6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:21.993012 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1154/2229] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:21 2022] GET /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461 => generated 1452 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:22.001717 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.compute.api [None req-bc205fb4-785c-42de-b653-863bba4fb1e6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 04 17:03:22.003921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-bc205fb4-785c-42de-b653-863bba4fb1e6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] deallocate_for_instance() {{(pid=131044) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 04 17:03:22.009628 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-56b9296b-8203-4fd0-aad7-41613a453a65 tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Action: 'create', calling method: .version_select at 0x7f1e5aedfaf0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1045194219", "public_key": " "}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:22.028713 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-56b9296b-8203-4fd0-aad7-41613a453a65 tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Getting quotas for project 302f1cef15ac4b58ab2a212b5a11783e. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:03:22.037610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-56b9296b-8203-4fd0-aad7-41613a453a65 tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Getting quotas for user e604c32bc1294a72843ff468257e90de and project 302f1cef15ac4b58ab2a212b5a11783e. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:03:22.041279 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=4 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:22.068609 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-56b9296b-8203-4fd0-aad7-41613a453a65 tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-56b9296b-8203-4fd0-aad7-41613a453a65 tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Request method failure captured: Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 95 Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_vYiitVabgWz_2pIX8ZGDxdeLbMPI8Ccf9xB5Su5QYA0h-_1s9KqhM4sS6m8fdQwX5neikxXMXk-wHWZzXEzuufXWRxW0E3k60YR5I7FLhAUyCgCXd0OHvKgFSR1v0dwhy-eVVGnSoATQSuDrOlwoMCJVXLjz4ZIybtkYTrJ-SKe-I Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 302f1cef15ac4b58ab2a212b5a11783e Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-559076456 Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/302f1cef15ac4b58ab2a212b5a11783e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/302f1cef15ac4b58ab2a212b5a11783e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_302f1cef15ac4b58ab2a212b5a11783e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/302f1cef15ac4b58ab2a212b5a11783e"}]}] Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-KeyPairsNegativeTestJSON-559076456 Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 302f1cef15ac4b58ab2a212b5a11783e Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-559076456 Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-KeyPairsNegativeTestJSON-559076456-project Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: e604c32bc1294a72843ff468257e90de Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-KeyPairsNegativeTestJSON-559076456-project Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1045194219", "public_key": " "}} Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: exception: Keypair data is invalid: failed to generate fingerprint Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1045194219', 'public_key': ' '}}} Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:22.071850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.075199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:22.075199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:22.075199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:22.075199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:22.075199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:22.075199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:03:22.075199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:03:22.075199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:22.075199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:22.075199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:03:22.075199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:03:22.075199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:03:22.075199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:03:22.075199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 04 17:03:22.075199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 04 17:03:22.075199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 04 17:03:22.075199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 04 17:03:22.075199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 04 17:03:22.075199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.075199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:22.075199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.075199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:22.075199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:22.075199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:22.075199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:03:22.075199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:03:22.075199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 04 17:03:22.075199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.075199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-56b9296b-8203-4fd0-aad7-41613a453a65 tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:22.077119 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-56b9296b-8203-4fd0-aad7-41613a453a65 tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.069808 Aug 04 17:03:22.077119 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1155/2230] 10.222.0.93 () {60 vars in 1158 bytes} [Thu Aug 4 17:03:22 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 17:03:22.087018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0d37aa22-e08d-4e9f-af6c-4d42ca7cc0ca tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:22.087928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0d37aa22-e08d-4e9f-af6c-4d42ca7cc0ca tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: e92cd73d-ce71-4f92-9db9-ae02c7febbcb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:22.107767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d37aa22-e08d-4e9f-af6c-4d42ca7cc0ca tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:22.108444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d37aa22-e08d-4e9f-af6c-4d42ca7cc0ca tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:22.108992 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d37aa22-e08d-4e9f-af6c-4d42ca7cc0ca tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:22.112920 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d37aa22-e08d-4e9f-af6c-4d42ca7cc0ca tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:22.113519 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d37aa22-e08d-4e9f-af6c-4d42ca7cc0ca tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:22.114058 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d37aa22-e08d-4e9f-af6c-4d42ca7cc0ca tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:22.133828 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-0d37aa22-e08d-4e9f-af6c-4d42ca7cc0ca tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] HTTP exception thrown: Instance e92cd73d-ce71-4f92-9db9-ae02c7febbcb could not be found. Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0d37aa22-e08d-4e9f-af6c-4d42ca7cc0ca tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Request method failure captured: Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb HTTP/1.1 Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_nx4zpoZyN271LHTSeJxILr3fxWmehAd73Qj4Mr3-kQ0Z96VGd88Njdn98GUYX0n84u9xHwJg1ygSOcJgsbmRZxdOJa7CP_K2Ra1wkoWsIeJsOtucMgDGajwnhOJDwPBrqSjSfszp3sXUCDj_lHYyKsw8X_WMLGlgsCYqeXhflvOHk Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 792f078eb62f4820ba4166d421079491 Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-LiveMigrationTest-1342252687 Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/792f078eb62f4820ba4166d421079491"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/792f078eb62f4820ba4166d421079491"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_792f078eb62f4820ba4166d421079491"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/792f078eb62f4820ba4166d421079491"}]}] Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-LiveMigrationTest-1342252687 Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 792f078eb62f4820ba4166d421079491 Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-LiveMigrationTest-1342252687 Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-LiveMigrationTest-1342252687-project Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 81d93fe83a6542c89cbc86106671b15f Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-LiveMigrationTest-1342252687-project Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance e92cd73d-ce71-4f92-9db9-ae02c7febbcb could not be found. Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'e92cd73d-ce71-4f92-9db9-ae02c7febbcb'} Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e92cd73d-ce71-4f92-9db9-ae02c7febbcb could not be found. Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e92cd73d-ce71-4f92-9db9-ae02c7febbcb could not be found. Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:22.139167 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.142540 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:22.142540 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:22.142540 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:22.142540 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:03:22.142540 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:03:22.142540 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e92cd73d-ce71-4f92-9db9-ae02c7febbcb could not be found. Aug 04 17:03:22.142540 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.142540 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0d37aa22-e08d-4e9f-af6c-4d42ca7cc0ca tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Returning 404 to user: Instance e92cd73d-ce71-4f92-9db9-ae02c7febbcb could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:22.142540 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0d37aa22-e08d-4e9f-af6c-4d42ca7cc0ca tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb" status: 404 len: 111 microversion: 2.1 time: 0.063714 Aug 04 17:03:22.142540 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1156/2231] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:22 2022] GET /compute/v2.1/servers/e92cd73d-ce71-4f92-9db9-ae02c7febbcb => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:03:22.169027 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-076b7a24-6e45-4b9d-ad9b-7593d8a431e4 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5ae73940>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:22.229941 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-076b7a24-6e45-4b9d-ad9b-7593d8a431e4 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e" status: 200 len: 1409 microversion: 2.1 time: 0.087547 Aug 04 17:03:22.237772 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1157/2232] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:22 2022] GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e => generated 1409 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:22.237772 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-16b63738-bc86-47e6-a6dd-e3cf63e8696c req-12b1199b-fade-4e7f-a24a-b30ad9dda71f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99", "name": "network-vif-plugged", "status": "completed", "tag": "fa729c8c-8604-47fb-b48f-bd564994c960"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:22.263904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-16b63738-bc86-47e6-a6dd-e3cf63e8696c req-12b1199b-fade-4e7f-a24a-b30ad9dda71f service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:22.263904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-16b63738-bc86-47e6-a6dd-e3cf63e8696c req-12b1199b-fade-4e7f-a24a-b30ad9dda71f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:22.263904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-16b63738-bc86-47e6-a6dd-e3cf63e8696c req-12b1199b-fade-4e7f-a24a-b30ad9dda71f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:22.276910 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-16b63738-bc86-47e6-a6dd-e3cf63e8696c req-12b1199b-fade-4e7f-a24a-b30ad9dda71f service nova] Creating event network-vif-plugged:fa729c8c-8604-47fb-b48f-bd564994c960 for instance 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 on n-h2-851359-3 Aug 04 17:03:22.282340 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-16b63738-bc86-47e6-a6dd-e3cf63e8696c req-12b1199b-fade-4e7f-a24a-b30ad9dda71f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050093 Aug 04 17:03:22.283198 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1158/2233] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:22.288202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bb4ced93-15a4-4b5a-97c9-0a583f43fce7 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:22.288921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bb4ced93-15a4-4b5a-97c9-0a583f43fce7 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:22.295474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bb4ced93-15a4-4b5a-97c9-0a583f43fce7 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:22.295970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bb4ced93-15a4-4b5a-97c9-0a583f43fce7 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:22.296418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bb4ced93-15a4-4b5a-97c9-0a583f43fce7 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:22.297128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bb4ced93-15a4-4b5a-97c9-0a583f43fce7 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:22.297597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bb4ced93-15a4-4b5a-97c9-0a583f43fce7 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:22.298052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bb4ced93-15a4-4b5a-97c9-0a583f43fce7 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:22.406884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bb4ced93-15a4-4b5a-97c9-0a583f43fce7 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:22.420296 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bb4ced93-15a4-4b5a-97c9-0a583f43fce7 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:22.421744 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bb4ced93-15a4-4b5a-97c9-0a583f43fce7 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:22.423137 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bb4ced93-15a4-4b5a-97c9-0a583f43fce7 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1266 microversion: 2.25 time: 0.138958 Aug 04 17:03:22.424538 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1159/2234] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:22 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:22.430373 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e552f8ef-08ad-4bc9-a7c4-f7df69781497 tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Action: 'create', calling method: .version_select at 0x7f1e5ae0aee0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJYN1v3b3iFG1oXtLDa7YRJJjAP4D7B7UWVLvgPsAZfoQ1gTgHb62T9fYE7996raACmt1gz5bfPNVEz5e0NPkB3itT3nsgFVQWx7dqnMrZHIyST+CCyY2O+oAyEkWNehg=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e552f8ef-08ad-4bc9-a7c4-f7df69781497 tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Request method failure captured: Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 507 Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_vYiitVabgWz_2pIX8ZGDxdeLbMPI8Ccf9xB5Su5QYA0h-_1s9KqhM4sS6m8fdQwX5neikxXMXk-wHWZzXEzuufXWRxW0E3k60YR5I7FLhAUyCgCXd0OHvKgFSR1v0dwhy-eVVGnSoATQSuDrOlwoMCJVXLjz4ZIybtkYTrJ-SKe-I Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 302f1cef15ac4b58ab2a212b5a11783e Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-559076456 Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/302f1cef15ac4b58ab2a212b5a11783e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/302f1cef15ac4b58ab2a212b5a11783e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_302f1cef15ac4b58ab2a212b5a11783e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/302f1cef15ac4b58ab2a212b5a11783e"}]}] Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-KeyPairsNegativeTestJSON-559076456 Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 302f1cef15ac4b58ab2a212b5a11783e Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-559076456 Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-KeyPairsNegativeTestJSON-559076456-project Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: e604c32bc1294a72843ff468257e90de Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-KeyPairsNegativeTestJSON-559076456-project Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJYN1v3b3iFG1oXtLDa7YRJJjAP4D7B7UWVLvgPsAZfoQ1gTgHb62T9fYE7996raACmt1gz5bfPNVEz5e0NPkB3itT3nsgFVQWx7dqnMrZHIyST+CCyY2O+oAyEkWNehg=="}} Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJYN1v3b3iFG1oXtLDa7YRJJjAP4D7B7UWVLvgPsAZfoQ1gTgHb62T9fYE7996raACmt1gz5bfPNVEz5e0NPkB3itT3nsgFVQWx7dqnMrZHIyST+CCyY2O+oAyEkWNehg=='}}} Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 04 17:03:22.436133 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e552f8ef-08ad-4bc9-a7c4-f7df69781497 tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e552f8ef-08ad-4bc9-a7c4-f7df69781497 tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.012410 Aug 04 17:03:22.439353 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1160/2235] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:03:22 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:03:22.459767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-afba3aa9-38af-4460-ad55-2c918090373e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '.version_select at 0x7f1e5ae73310>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:22.495805 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-afba3aa9-38af-4460-ad55-2c918090373e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1843048410" status: 202 len: 0 microversion: 2.1 time: 0.055955 Aug 04 17:03:22.497349 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1161/2236] 10.222.0.93 () {58 vars in 1221 bytes} [Thu Aug 4 17:03:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1843048410 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:03:22.506980 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-55631af7-cc95-4408-ad99-90553ff33e0f tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Action: 'create', calling method: .version_select at 0x7f1e5ae46e50>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1938638377", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:22.529461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-55631af7-cc95-4408-ad99-90553ff33e0f tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Getting quotas for project 302f1cef15ac4b58ab2a212b5a11783e. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:03:22.537576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-55631af7-cc95-4408-ad99-90553ff33e0f tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Getting quotas for user e604c32bc1294a72843ff468257e90de and project 302f1cef15ac4b58ab2a212b5a11783e. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:03:22.580201 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-55631af7-cc95-4408-ad99-90553ff33e0f tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-55631af7-cc95-4408-ad99-90553ff33e0f tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Request method failure captured: Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 118 Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_vYiitVabgWz_2pIX8ZGDxdeLbMPI8Ccf9xB5Su5QYA0h-_1s9KqhM4sS6m8fdQwX5neikxXMXk-wHWZzXEzuufXWRxW0E3k60YR5I7FLhAUyCgCXd0OHvKgFSR1v0dwhy-eVVGnSoATQSuDrOlwoMCJVXLjz4ZIybtkYTrJ-SKe-I Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 302f1cef15ac4b58ab2a212b5a11783e Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-559076456 Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/302f1cef15ac4b58ab2a212b5a11783e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/302f1cef15ac4b58ab2a212b5a11783e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_302f1cef15ac4b58ab2a212b5a11783e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/302f1cef15ac4b58ab2a212b5a11783e"}]}] Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-KeyPairsNegativeTestJSON-559076456 Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 302f1cef15ac4b58ab2a212b5a11783e Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-559076456 Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-KeyPairsNegativeTestJSON-559076456-project Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: e604c32bc1294a72843ff468257e90de Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-KeyPairsNegativeTestJSON-559076456-project Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1938638377", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: exception: Keypair data is invalid: failed to generate fingerprint Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1938638377', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Aug 04 17:03:22.582386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.585965 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-55631af7-cc95-4408-ad99-90553ff33e0f tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:22.589806 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-55631af7-cc95-4408-ad99-90553ff33e0f tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.086669 Aug 04 17:03:22.591212 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1162/2237] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:03:22 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 17:03:22.601301 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-151ca71d-5004-4c4c-8633-92b6a86d8e54 tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Calling method '.version_select at 0x7f1e5ae73f70>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:22.631789 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-151ca71d-5004-4c4c-8633-92b6a86d8e54 tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-23886502 not found for user e604c32bc1294a72843ff468257e90de Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-151ca71d-5004-4c4c-8633-92b6a86d8e54 tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Request method failure captured: Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-23886502 HTTP/1.1 Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_vYiitVabgWz_2pIX8ZGDxdeLbMPI8Ccf9xB5Su5QYA0h-_1s9KqhM4sS6m8fdQwX5neikxXMXk-wHWZzXEzuufXWRxW0E3k60YR5I7FLhAUyCgCXd0OHvKgFSR1v0dwhy-eVVGnSoATQSuDrOlwoMCJVXLjz4ZIybtkYTrJ-SKe-I Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 302f1cef15ac4b58ab2a212b5a11783e Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-559076456 Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/302f1cef15ac4b58ab2a212b5a11783e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/302f1cef15ac4b58ab2a212b5a11783e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_302f1cef15ac4b58ab2a212b5a11783e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/302f1cef15ac4b58ab2a212b5a11783e"}]}] Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-KeyPairsNegativeTestJSON-559076456 Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 302f1cef15ac4b58ab2a212b5a11783e Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-559076456 Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-KeyPairsNegativeTestJSON-559076456-project Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: e604c32bc1294a72843ff468257e90de Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-KeyPairsNegativeTestJSON-559076456-project Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: exception: Keypair tempest-keypair-non-existent-23886502 not found for user e604c32bc1294a72843ff468257e90de Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'tempest-keypair-non-existent-23886502'} Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6814, in delete_key_pair Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6835, in get_key_pair Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-23886502 not found for user e604c32bc1294a72843ff468257e90de Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.633913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:22.637057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.637057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:22.637057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:22.637057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:22.637057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:22.637057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:22.637057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:03:22.637057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:03:22.637057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 17:03:22.637057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:03:22.637057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:22.637057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:22.637057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 04 17:03:22.637057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 04 17:03:22.637057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 04 17:03:22.637057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 04 17:03:22.637057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-23886502 not found for user e604c32bc1294a72843ff468257e90de Aug 04 17:03:22.637057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.637057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:22.637057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.637057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:22.637057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:22.637057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:22.637057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:03:22.637057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:03:22.637057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-23886502 not found for user e604c32bc1294a72843ff468257e90de Aug 04 17:03:22.637057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:22.637057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-151ca71d-5004-4c4c-8633-92b6a86d8e54 tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] Returning 404 to user: Keypair tempest-keypair-non-existent-23886502 not found for user e604c32bc1294a72843ff468257e90de {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:22.638483 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-151ca71d-5004-4c4c-8633-92b6a86d8e54 tempest-KeyPairsNegativeTestJSON-559076456 tempest-KeyPairsNegativeTestJSON-559076456-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-23886502" status: 404 len: 143 microversion: 2.1 time: 0.042960 Aug 04 17:03:22.639751 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1163/2238] 10.222.0.93 () {58 vars in 1254 bytes} [Thu Aug 4 17:03:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-23886502 => generated 143 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:03:22.866344 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-bc205fb4-785c-42de-b653-863bba4fb1e6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Updating instance_info_cache with network_info: [] {{(pid=131044) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 17:03:22.901022 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-f54ecb92-b68e-471d-9946-0e4eed5c0f69 req-39a35508-12c1-49f7-854b-5c300bee6e77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "826b896f-e0e0-48e1-a520-b5fade2c374b", "name": "network-vif-deleted", "tag": "0f610c46-1aef-4767-b0af-3f6a244761f6"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:22.924883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f54ecb92-b68e-471d-9946-0e4eed5c0f69 req-39a35508-12c1-49f7-854b-5c300bee6e77 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:22.927461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f54ecb92-b68e-471d-9946-0e4eed5c0f69 req-39a35508-12c1-49f7-854b-5c300bee6e77 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:22.927935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f54ecb92-b68e-471d-9946-0e4eed5c0f69 req-39a35508-12c1-49f7-854b-5c300bee6e77 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:22.963248 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.compute.server_external_events [req-f54ecb92-b68e-471d-9946-0e4eed5c0f69 req-39a35508-12c1-49f7-854b-5c300bee6e77 service nova] Unable to find a host for instance 826b896f-e0e0-48e1-a520-b5fade2c374b. Dropping event network-vif-deleted {{(pid=131043) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 04 17:03:22.964905 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-f54ecb92-b68e-471d-9946-0e4eed5c0f69 req-39a35508-12c1-49f7-854b-5c300bee6e77 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.068911 Aug 04 17:03:22.966509 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1164/2239] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 71 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 04 17:03:23.007985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6bd44ec7-52f1-48ed-b12f-9cc4f359ef6f tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5aedf940>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:23.111486 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6bd44ec7-52f1-48ed-b12f-9cc4f359ef6f tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461" status: 200 len: 1452 microversion: 2.1 time: 0.107736 Aug 04 17:03:23.112446 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1165/2240] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:23 2022] GET /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461 => generated 1452 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:23.245401 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ccccb91a-bc51-4498-9150-ce79a9a42dca tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5ae14d30>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:23.339400 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ccccb91a-bc51-4498-9150-ce79a9a42dca tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e" status: 200 len: 1409 microversion: 2.1 time: 0.098485 Aug 04 17:03:23.347352 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1166/2241] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:23 2022] GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e => generated 1409 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:23.450281 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f638268c-3a53-430d-a1cd-2596981f6ead tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:23.451210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f638268c-3a53-430d-a1cd-2596981f6ead tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:23.463405 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f638268c-3a53-430d-a1cd-2596981f6ead tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:23.465480 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f638268c-3a53-430d-a1cd-2596981f6ead tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:23.466272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f638268c-3a53-430d-a1cd-2596981f6ead tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:23.467274 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f638268c-3a53-430d-a1cd-2596981f6ead tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:23.469608 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f638268c-3a53-430d-a1cd-2596981f6ead tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:23.471860 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f638268c-3a53-430d-a1cd-2596981f6ead tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:23.622717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f638268c-3a53-430d-a1cd-2596981f6ead tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:23.633597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f638268c-3a53-430d-a1cd-2596981f6ead tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:23.635376 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f638268c-3a53-430d-a1cd-2596981f6ead tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:23.636290 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f638268c-3a53-430d-a1cd-2596981f6ead tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1266 microversion: 2.25 time: 0.190346 Aug 04 17:03:23.649883 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1167/2242] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:23 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:23.747660 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bc205fb4-785c-42de-b653-863bba4fb1e6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "DELETE /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 204 len: 0 microversion: 2.1 time: 3.140165 Aug 04 17:03:23.748184 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1076/2243] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:03:20 2022] DELETE /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 0 bytes in 3142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:03:23.756683 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f7f74c6b-e0b6-471a-95fa-f20454b76960 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:23.757373 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f7f74c6b-e0b6-471a-95fa-f20454b76960 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:23.765427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7f74c6b-e0b6-471a-95fa-f20454b76960 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:23.765928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7f74c6b-e0b6-471a-95fa-f20454b76960 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:23.766398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7f74c6b-e0b6-471a-95fa-f20454b76960 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:23.767109 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7f74c6b-e0b6-471a-95fa-f20454b76960 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:23.767570 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7f74c6b-e0b6-471a-95fa-f20454b76960 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:23.768588 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7f74c6b-e0b6-471a-95fa-f20454b76960 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:23.779348 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-51d546c3-32b8-4800-b352-54092cf994cc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:23.780608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-51d546c3-32b8-4800-b352-54092cf994cc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:23.796093 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51d546c3-32b8-4800-b352-54092cf994cc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:23.797389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51d546c3-32b8-4800-b352-54092cf994cc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:23.798162 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51d546c3-32b8-4800-b352-54092cf994cc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:23.799620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51d546c3-32b8-4800-b352-54092cf994cc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:23.800236 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51d546c3-32b8-4800-b352-54092cf994cc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:23.800817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51d546c3-32b8-4800-b352-54092cf994cc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:23.814549 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-f7f74c6b-e0b6-471a-95fa-f20454b76960 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] HTTP exception thrown: Instance 826b896f-e0e0-48e1-a520-b5fade2c374b could not be found. Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f7f74c6b-e0b6-471a-95fa-f20454b76960 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Request method failure captured: Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b HTTP/1.1 Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_r18zhXKrUNPkTcrqBpyOxEtqmRnN_52CLFZjb6_V1_cyggOBj-ig1uBg8_Jl5DEv1edGlVMK7wsNG9aSNASIbB3U35pyAy7fX4gAPexD_7GsQqaSV2-qce83lQvxIJx4U5ZPEYYCvd7_VfIsOpvvr8aQqah0W-5V3XON-ztAeWk4Y Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/92bb708c7ba24e4d828f19ecc60e1f91"}]}] Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 6d19d8e7953b4e479b4e2143a3c3546a Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 826b896f-e0e0-48e1-a520-b5fade2c374b could not be found. Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '826b896f-e0e0-48e1-a520-b5fade2c374b'} Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 826b896f-e0e0-48e1-a520-b5fade2c374b could not be found. Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 826b896f-e0e0-48e1-a520-b5fade2c374b could not be found. Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:23.816187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:23.819516 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:23.819516 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:23.819516 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:23.819516 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:03:23.819516 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:03:23.819516 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 826b896f-e0e0-48e1-a520-b5fade2c374b could not be found. Aug 04 17:03:23.819516 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:23.819516 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f7f74c6b-e0b6-471a-95fa-f20454b76960 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Returning 404 to user: Instance 826b896f-e0e0-48e1-a520-b5fade2c374b could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:23.819516 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f7f74c6b-e0b6-471a-95fa-f20454b76960 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 404 len: 111 microversion: 2.1 time: 0.065512 Aug 04 17:03:23.828990 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1168/2244] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:23 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:03:24.003308 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-78c39b93-34f6-4df7-9bff-221b5f321d0e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-218012598", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "bed30c3f-0c01-4418-9c95-0bb7a79e1c34"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:24.094357 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-51d546c3-32b8-4800-b352-54092cf994cc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:03:24.147610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-78c39b93-34f6-4df7-9bff-221b5f321d0e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] validate_networks() for [('bed30c3f-0c01-4418-9c95-0bb7a79e1c34', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:03:24.239098 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-51d546c3-32b8-4800-b352-54092cf994cc tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "DELETE /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989" status: 204 len: 0 microversion: 2.1 time: 0.465504 Aug 04 17:03:24.248883 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1077/2245] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:03:23 2022] DELETE /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:03:24.256865 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0cc527d0-0eea-49aa-8790-fe6d7d132871 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e6c910940>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:24.369201 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0cc527d0-0eea-49aa-8790-fe6d7d132871 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461" status: 200 len: 1452 microversion: 2.1 time: 0.118956 Aug 04 17:03:24.370423 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1078/2246] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:24 2022] GET /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461 => generated 1452 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:24.375347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e3b08dbd-6324-4636-9cbc-6753b0ee68aa tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:24.376296 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e3b08dbd-6324-4636-9cbc-6753b0ee68aa tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:24.382929 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3b08dbd-6324-4636-9cbc-6753b0ee68aa tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:24.383654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3b08dbd-6324-4636-9cbc-6753b0ee68aa tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:24.384241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3b08dbd-6324-4636-9cbc-6753b0ee68aa tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:24.385102 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3b08dbd-6324-4636-9cbc-6753b0ee68aa tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:24.385709 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3b08dbd-6324-4636-9cbc-6753b0ee68aa tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:24.386338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3b08dbd-6324-4636-9cbc-6753b0ee68aa tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:24.413685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=18,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:24.738407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e3b08dbd-6324-4636-9cbc-6753b0ee68aa tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:24.755943 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e3b08dbd-6324-4636-9cbc-6753b0ee68aa tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989" status: 200 len: 1485 microversion: 2.1 time: 0.384285 Aug 04 17:03:24.771397 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1079/2247] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:24 2022] GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989 => generated 1485 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:24.779711 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4e9a27b8-7645-4e40-bbaa-22030b02293e tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e6c9a2040>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:24.851894 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4e9a27b8-7645-4e40-bbaa-22030b02293e tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e" status: 200 len: 1409 microversion: 2.1 time: 0.079190 Aug 04 17:03:24.866998 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1080/2248] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:24 2022] GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e => generated 1409 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:24.872067 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-61a5900c-0961-4355-a76d-e149879df54c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:24.872780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-61a5900c-0961-4355-a76d-e149879df54c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:24.885519 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-61a5900c-0961-4355-a76d-e149879df54c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:24.886181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-61a5900c-0961-4355-a76d-e149879df54c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:24.886704 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-61a5900c-0961-4355-a76d-e149879df54c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:24.887274 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-78c39b93-34f6-4df7-9bff-221b5f321d0e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:03:24.887710 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-78c39b93-34f6-4df7-9bff-221b5f321d0e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:03:24.887971 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-61a5900c-0961-4355-a76d-e149879df54c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:24.888191 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-78c39b93-34f6-4df7-9bff-221b5f321d0e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:03:24.888607 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-78c39b93-34f6-4df7-9bff-221b5f321d0e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:03:24.889030 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-78c39b93-34f6-4df7-9bff-221b5f321d0e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:03:24.889657 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-61a5900c-0961-4355-a76d-e149879df54c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:24.890208 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-61a5900c-0961-4355-a76d-e149879df54c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:24.902894 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78c39b93-34f6-4df7-9bff-221b5f321d0e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:24.903396 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78c39b93-34f6-4df7-9bff-221b5f321d0e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:24.905553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78c39b93-34f6-4df7-9bff-221b5f321d0e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:24.906380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78c39b93-34f6-4df7-9bff-221b5f321d0e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:24.906860 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78c39b93-34f6-4df7-9bff-221b5f321d0e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:24.907301 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78c39b93-34f6-4df7-9bff-221b5f321d0e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:24.931259 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-78c39b93-34f6-4df7-9bff-221b5f321d0e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Getting quotas for project 92bb708c7ba24e4d828f19ecc60e1f91. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:03:24.940403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-78c39b93-34f6-4df7-9bff-221b5f321d0e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Getting quotas for user 6d19d8e7953b4e479b4e2143a3c3546a and project 92bb708c7ba24e4d828f19ecc60e1f91. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:03:24.958120 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-78c39b93-34f6-4df7-9bff-221b5f321d0e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:03:24.971337 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-78c39b93-34f6-4df7-9bff-221b5f321d0e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:03:25.024583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-61a5900c-0961-4355-a76d-e149879df54c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:25.035612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-61a5900c-0961-4355-a76d-e149879df54c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:25.037274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-61a5900c-0961-4355-a76d-e149879df54c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:25.038990 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-61a5900c-0961-4355-a76d-e149879df54c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 200 len: 1266 microversion: 2.25 time: 0.170577 Aug 04 17:03:25.039914 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1081/2249] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:24 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:25.093707 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-78c39b93-34f6-4df7-9bff-221b5f321d0e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.085376 Aug 04 17:03:25.101206 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1169/2250] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:03:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1102 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:03:25.107522 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ef54f84c-a1a6-456a-a41b-2ad2c9eca781 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:25.108160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ef54f84c-a1a6-456a-a41b-2ad2c9eca781 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:25.229911 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ef54f84c-a1a6-456a-a41b-2ad2c9eca781 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:25.244963 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ef54f84c-a1a6-456a-a41b-2ad2c9eca781 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b" status: 200 len: 1214 microversion: 2.1 time: 0.142351 Aug 04 17:03:25.245593 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1082/2251] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:25 2022] GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b => generated 1214 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:03:25.384962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cf626251-2439-460d-8e42-f53be94ae363 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5ae140d0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:25.789285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1c1f9778-ee23-4ad1-b1d5-543bcf83b4f8 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:25.791925 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1c1f9778-ee23-4ad1-b1d5-543bcf83b4f8 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:25.831275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c1f9778-ee23-4ad1-b1d5-543bcf83b4f8 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:25.834723 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c1f9778-ee23-4ad1-b1d5-543bcf83b4f8 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:25.836377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c1f9778-ee23-4ad1-b1d5-543bcf83b4f8 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:25.838911 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c1f9778-ee23-4ad1-b1d5-543bcf83b4f8 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:25.843269 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c1f9778-ee23-4ad1-b1d5-543bcf83b4f8 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:25.846621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c1f9778-ee23-4ad1-b1d5-543bcf83b4f8 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:26.068553 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1c1f9778-ee23-4ad1-b1d5-543bcf83b4f8 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:26.082248 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1c1f9778-ee23-4ad1-b1d5-543bcf83b4f8 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989" status: 200 len: 1443 microversion: 2.1 time: 0.301996 Aug 04 17:03:26.113083 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1083/2252] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:25 2022] GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989 => generated 1443 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:26.143282 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a2d8da18-083b-494d-bd09-1062c8531852 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e6c942820>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:29.098830 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a2d8da18-083b-494d-bd09-1062c8531852 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e" status: 200 len: 1409 microversion: 2.1 time: 2.984207 Aug 04 17:03:29.099463 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cf626251-2439-460d-8e42-f53be94ae363 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461" status: 200 len: 1461 microversion: 2.1 time: 3.714368 Aug 04 17:03:29.103050 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1170/2253] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:25 2022] GET /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461 => generated 1461 bytes in 3723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:29.109996 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1084/2254] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:26 2022] GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e => generated 1409 bytes in 2996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:29.124989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-7b14a662-055b-48b7-9f0e-93c5247851b1 req-8e7ed287-dd21-40ac-a15c-b07407a207cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc381c07-ce7e-4a71-bede-f15c69c1d989", "name": "network-vif-deleted", "tag": "ab451c60-9699-45ff-809b-94b053bd20d8"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:29.129052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d4154219-d2d7-4dc1-9df3-e396cee953e7 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:29.135290 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d4154219-d2d7-4dc1-9df3-e396cee953e7 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 84f56763-a994-4d26-96d4-a6d1ba68566c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:29.182723 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7b14a662-055b-48b7-9f0e-93c5247851b1 req-8e7ed287-dd21-40ac-a15c-b07407a207cd service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:29.183500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7b14a662-055b-48b7-9f0e-93c5247851b1 req-8e7ed287-dd21-40ac-a15c-b07407a207cd service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:29.184384 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7b14a662-055b-48b7-9f0e-93c5247851b1 req-8e7ed287-dd21-40ac-a15c-b07407a207cd service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:29.188902 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d4154219-d2d7-4dc1-9df3-e396cee953e7 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:29.192201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d4154219-d2d7-4dc1-9df3-e396cee953e7 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:29.194595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d4154219-d2d7-4dc1-9df3-e396cee953e7 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:29.195549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d4154219-d2d7-4dc1-9df3-e396cee953e7 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:29.202536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d4154219-d2d7-4dc1-9df3-e396cee953e7 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:29.203399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d4154219-d2d7-4dc1-9df3-e396cee953e7 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:29.227032 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-7b14a662-055b-48b7-9f0e-93c5247851b1 req-8e7ed287-dd21-40ac-a15c-b07407a207cd service nova] Creating event network-vif-deleted:ab451c60-9699-45ff-809b-94b053bd20d8 for instance fc381c07-ce7e-4a71-bede-f15c69c1d989 on n-h2-851359-3 Aug 04 17:03:29.250484 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-7b14a662-055b-48b7-9f0e-93c5247851b1 req-8e7ed287-dd21-40ac-a15c-b07407a207cd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138935 Aug 04 17:03:29.251300 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1085/2255] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:29.253991 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-d4154219-d2d7-4dc1-9df3-e396cee953e7 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] HTTP exception thrown: Instance 84f56763-a994-4d26-96d4-a6d1ba68566c could not be found. Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d4154219-d2d7-4dc1-9df3-e396cee953e7 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Request method failure captured: Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c HTTP/1.1 Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_pXlwUhhhM_d03666MBri4F66KYuzI-tT_44Q_uVp3yoZZcQlN-j61rkAZzwmwW4tSKuQH258YusxcVfdu_QDCUhoCbzi0tpJLDDBqkC799acQ0ABeNQ8x9blh_NUOKP-2Fn47qeOsKKyHkb_AGeMLzK1T3WAwYCm04XKXRWS0V3w8 Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: X-Openstack-Nova-Api-Version: 2.25 Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: e457894e070145348859f44a6a3e8ed6 Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-653155874 Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e457894e070145348859f44a6a3e8ed6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e457894e070145348859f44a6a3e8ed6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e457894e070145348859f44a6a3e8ed6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e457894e070145348859f44a6a3e8ed6"}]}] Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-653155874 Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: e457894e070145348859f44a6a3e8ed6 Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-653155874 Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-LiveAutoBlockMigrationV225Test-653155874-project Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: d0e0f6e799384863af2222416f070c84 Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-653155874-project Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 84f56763-a994-4d26-96d4-a6d1ba68566c could not be found. Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '84f56763-a994-4d26-96d4-a6d1ba68566c'} Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84f56763-a994-4d26-96d4-a6d1ba68566c could not be found. Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84f56763-a994-4d26-96d4-a6d1ba68566c could not be found. Aug 04 17:03:29.258886 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:29.263083 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:29.263083 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:29.263083 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:29.263083 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:29.263083 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:29.263083 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:03:29.263083 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:03:29.263083 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84f56763-a994-4d26-96d4-a6d1ba68566c could not be found. Aug 04 17:03:29.263083 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:29.264696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d4154219-d2d7-4dc1-9df3-e396cee953e7 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Returning 404 to user: Instance 84f56763-a994-4d26-96d4-a6d1ba68566c could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:29.266633 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d4154219-d2d7-4dc1-9df3-e396cee953e7 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c" status: 404 len: 111 microversion: 2.25 time: 0.161677 Aug 04 17:03:29.268368 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1171/2256] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:29 2022] GET /compute/v2.1/servers/84f56763-a994-4d26-96d4-a6d1ba68566c => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:03:29.277653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-88a8eb2c-d419-46e1-9b76-1dedfe5ec345 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:29.279185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-88a8eb2c-d419-46e1-9b76-1dedfe5ec345 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: fc381c07-ce7e-4a71-bede-f15c69c1d989] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:29.285770 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2f294d00-b953-4364-9f36-a745a5a0e425 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:29.289060 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2f294d00-b953-4364-9f36-a745a5a0e425 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:29.296654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88a8eb2c-d419-46e1-9b76-1dedfe5ec345 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:29.300577 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88a8eb2c-d419-46e1-9b76-1dedfe5ec345 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:29.301074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88a8eb2c-d419-46e1-9b76-1dedfe5ec345 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:29.301871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88a8eb2c-d419-46e1-9b76-1dedfe5ec345 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:29.302386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88a8eb2c-d419-46e1-9b76-1dedfe5ec345 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:29.302828 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88a8eb2c-d419-46e1-9b76-1dedfe5ec345 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:29.318768 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f294d00-b953-4364-9f36-a745a5a0e425 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:29.319368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f294d00-b953-4364-9f36-a745a5a0e425 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:29.319826 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f294d00-b953-4364-9f36-a745a5a0e425 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:29.320573 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f294d00-b953-4364-9f36-a745a5a0e425 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:29.327487 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f294d00-b953-4364-9f36-a745a5a0e425 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:29.330518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f294d00-b953-4364-9f36-a745a5a0e425 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:29.344686 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-88a8eb2c-d419-46e1-9b76-1dedfe5ec345 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] HTTP exception thrown: Instance fc381c07-ce7e-4a71-bede-f15c69c1d989 could not be found. Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-88a8eb2c-d419-46e1-9b76-1dedfe5ec345 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Request method failure captured: Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989 HTTP/1.1 Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_nx4zpoZyN271LHTSeJxILr3fxWmehAd73Qj4Mr3-kQ0Z96VGd88Njdn98GUYX0n84u9xHwJg1ygSOcJgsbmRZxdOJa7CP_K2Ra1wkoWsIeJsOtucMgDGajwnhOJDwPBrqSjSfszp3sXUCDj_lHYyKsw8X_WMLGlgsCYqeXhflvOHk Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 792f078eb62f4820ba4166d421079491 Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-LiveMigrationTest-1342252687 Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/792f078eb62f4820ba4166d421079491"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/792f078eb62f4820ba4166d421079491"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_792f078eb62f4820ba4166d421079491"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/792f078eb62f4820ba4166d421079491"}]}] Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-LiveMigrationTest-1342252687 Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 792f078eb62f4820ba4166d421079491 Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-LiveMigrationTest-1342252687 Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-LiveMigrationTest-1342252687-project Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 81d93fe83a6542c89cbc86106671b15f Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-LiveMigrationTest-1342252687-project Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance fc381c07-ce7e-4a71-bede-f15c69c1d989 could not be found. Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'fc381c07-ce7e-4a71-bede-f15c69c1d989'} Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc381c07-ce7e-4a71-bede-f15c69c1d989 could not be found. Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc381c07-ce7e-4a71-bede-f15c69c1d989 could not be found. Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:29.349600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:29.353557 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:29.353557 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:29.353557 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:29.353557 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:03:29.353557 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:03:29.353557 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc381c07-ce7e-4a71-bede-f15c69c1d989 could not be found. Aug 04 17:03:29.353557 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:29.355446 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-88a8eb2c-d419-46e1-9b76-1dedfe5ec345 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Returning 404 to user: Instance fc381c07-ce7e-4a71-bede-f15c69c1d989 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:29.358442 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-88a8eb2c-d419-46e1-9b76-1dedfe5ec345 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989" status: 404 len: 111 microversion: 2.1 time: 0.088806 Aug 04 17:03:29.360302 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1172/2257] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:29 2022] GET /compute/v2.1/servers/fc381c07-ce7e-4a71-bede-f15c69c1d989 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:03:29.373903 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-525e12d0-0e44-4962-ba7a-c2a84a7c6c70 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5ae13d30>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:29.458549 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-525e12d0-0e44-4962-ba7a-c2a84a7c6c70 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461" status: 200 len: 1461 microversion: 2.1 time: 0.091894 Aug 04 17:03:29.459523 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1173/2258] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:29 2022] GET /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461 => generated 1461 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:29.470056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0ce1c8f7-7f91-4d43-8e25-10679c6e7e84 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:29.471147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0ce1c8f7-7f91-4d43-8e25-10679c6e7e84 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 37140c09-31fd-4233-9ab9-6351044c5864] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:29.485430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ce1c8f7-7f91-4d43-8e25-10679c6e7e84 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:29.489535 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ce1c8f7-7f91-4d43-8e25-10679c6e7e84 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:29.491208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ce1c8f7-7f91-4d43-8e25-10679c6e7e84 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:29.492175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ce1c8f7-7f91-4d43-8e25-10679c6e7e84 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:29.496508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ce1c8f7-7f91-4d43-8e25-10679c6e7e84 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:29.497174 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ce1c8f7-7f91-4d43-8e25-10679c6e7e84 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:29.564766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0ce1c8f7-7f91-4d43-8e25-10679c6e7e84 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 37140c09-31fd-4233-9ab9-6351044c5864] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:03:29.631477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:29.774457 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0ce1c8f7-7f91-4d43-8e25-10679c6e7e84 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "DELETE /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864" status: 204 len: 0 microversion: 2.1 time: 0.313444 Aug 04 17:03:29.775072 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1174/2259] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:03:29 2022] DELETE /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:03:29.789774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-abefa274-5bc4-4944-afcf-e6068f215aa2 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:29.796755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-abefa274-5bc4-4944-afcf-e6068f215aa2 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: ba09cec5-a546-4fe5-90df-c90d94591fb2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:29.809891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-abefa274-5bc4-4944-afcf-e6068f215aa2 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:29.810702 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-abefa274-5bc4-4944-afcf-e6068f215aa2 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:29.813223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-abefa274-5bc4-4944-afcf-e6068f215aa2 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:29.818342 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-abefa274-5bc4-4944-afcf-e6068f215aa2 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:29.819327 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-abefa274-5bc4-4944-afcf-e6068f215aa2 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:29.820851 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-abefa274-5bc4-4944-afcf-e6068f215aa2 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:30.789517 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2f294d00-b953-4364-9f36-a745a5a0e425 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:30.806701 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2f294d00-b953-4364-9f36-a745a5a0e425 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b" status: 200 len: 1314 microversion: 2.1 time: 1.552706 Aug 04 17:03:30.815834 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1086/2260] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:29 2022] GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b => generated 1314 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:30.833461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-abefa274-5bc4-4944-afcf-e6068f215aa2 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a373cb0cd004b65a4ea9c804cbea3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82de1eabf714c3492860c2a65df5ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:30.835287 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dbcf1d4b-be84-4082-9fdf-8bdacaaecc88 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:30.840863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dbcf1d4b-be84-4082-9fdf-8bdacaaecc88 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 37140c09-31fd-4233-9ab9-6351044c5864] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:30.847093 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-abefa274-5bc4-4944-afcf-e6068f215aa2 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/servers/ba09cec5-a546-4fe5-90df-c90d94591fb2" status: 200 len: 1467 microversion: 2.1 time: 1.069484 Aug 04 17:03:30.847721 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1175/2261] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:29 2022] GET /compute/v2.1/servers/ba09cec5-a546-4fe5-90df-c90d94591fb2 => generated 1467 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:30.871320 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8b0877e3-7cb1-4ff4-b3e6-c78552d17c96 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5ae414c0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:30.880054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbcf1d4b-be84-4082-9fdf-8bdacaaecc88 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:30.881095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbcf1d4b-be84-4082-9fdf-8bdacaaecc88 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:30.885188 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbcf1d4b-be84-4082-9fdf-8bdacaaecc88 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:30.888401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbcf1d4b-be84-4082-9fdf-8bdacaaecc88 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:30.891454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbcf1d4b-be84-4082-9fdf-8bdacaaecc88 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:30.894535 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbcf1d4b-be84-4082-9fdf-8bdacaaecc88 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:30.963090 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8b0877e3-7cb1-4ff4-b3e6-c78552d17c96 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e" status: 200 len: 1409 microversion: 2.1 time: 0.100004 Aug 04 17:03:30.964738 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1176/2262] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:30 2022] GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e => generated 1409 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:30.969790 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-adb3d5fa-e1b0-402e-984b-95ce99fc0aaf tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1147075807"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:30.980195 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-adb3d5fa-e1b0-402e-984b-95ce99fc0aaf tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: a6fb758e-d1f2-4244-b287-d93d20a53ac5] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:30.996720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-adb3d5fa-e1b0-402e-984b-95ce99fc0aaf tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:30.997549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-adb3d5fa-e1b0-402e-984b-95ce99fc0aaf tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:30.998229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-adb3d5fa-e1b0-402e-984b-95ce99fc0aaf tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:31.001227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-adb3d5fa-e1b0-402e-984b-95ce99fc0aaf tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:31.002464 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-adb3d5fa-e1b0-402e-984b-95ce99fc0aaf tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:31.004877 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-adb3d5fa-e1b0-402e-984b-95ce99fc0aaf tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:31.451324 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-adb3d5fa-e1b0-402e-984b-95ce99fc0aaf tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "POST /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5/action" status: 202 len: 0 microversion: 2.1 time: 0.484940 Aug 04 17:03:31.460691 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1177/2263] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:03:30 2022] POST /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 17:03:31.476399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bd968b3f-76fe-48fa-aa33-a9db47e3077a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5adc1700>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:31.552652 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bd968b3f-76fe-48fa-aa33-a9db47e3077a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/6b573959-42da-4d15-a449-07ba5a2d7253" status: 200 len: 1453 microversion: 2.1 time: 0.089400 Aug 04 17:03:31.552883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dbcf1d4b-be84-4082-9fdf-8bdacaaecc88 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:31.561633 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1178/2264] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:31 2022] GET /compute/v2.1/images/6b573959-42da-4d15-a449-07ba5a2d7253 => generated 1453 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:31.562310 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dbcf1d4b-be84-4082-9fdf-8bdacaaecc88 tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864" status: 200 len: 1501 microversion: 2.1 time: 0.742778 Aug 04 17:03:31.562885 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1087/2265] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:30 2022] GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864 => generated 1501 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:31.838871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d979cee9-7363-441d-9f81-0f33170d7d30 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:31.839690 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d979cee9-7363-441d-9f81-0f33170d7d30 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:31.851330 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d979cee9-7363-441d-9f81-0f33170d7d30 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:31.851848 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d979cee9-7363-441d-9f81-0f33170d7d30 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:31.852295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d979cee9-7363-441d-9f81-0f33170d7d30 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:31.855295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d979cee9-7363-441d-9f81-0f33170d7d30 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:31.857421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d979cee9-7363-441d-9f81-0f33170d7d30 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:31.858051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d979cee9-7363-441d-9f81-0f33170d7d30 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:31.979104 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e3ccd6bb-f5e0-44a5-be77-edfaf980379a tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e6c908940>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:32.052956 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e3ccd6bb-f5e0-44a5-be77-edfaf980379a tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e" status: 200 len: 1409 microversion: 2.1 time: 0.077623 Aug 04 17:03:32.053801 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1088/2266] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:31 2022] GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e => generated 1409 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:03:32.310317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d979cee9-7363-441d-9f81-0f33170d7d30 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:32.318728 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d979cee9-7363-441d-9f81-0f33170d7d30 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b" status: 200 len: 1314 microversion: 2.1 time: 0.485437 Aug 04 17:03:32.323026 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1179/2267] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:31 2022] GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:32.570664 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cdb3d973-c841-4c4e-b008-abba3dbc6441 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e6c9a28b0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:32.587499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9d619dfe-8634-4d1b-8bd7-7e9d16839c7e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:32.588131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9d619dfe-8634-4d1b-8bd7-7e9d16839c7e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 37140c09-31fd-4233-9ab9-6351044c5864] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:32.600709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d619dfe-8634-4d1b-8bd7-7e9d16839c7e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:32.601453 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d619dfe-8634-4d1b-8bd7-7e9d16839c7e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:32.612362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d619dfe-8634-4d1b-8bd7-7e9d16839c7e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:32.613398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d619dfe-8634-4d1b-8bd7-7e9d16839c7e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:32.614090 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d619dfe-8634-4d1b-8bd7-7e9d16839c7e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:32.614716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d619dfe-8634-4d1b-8bd7-7e9d16839c7e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:32.676471 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cdb3d973-c841-4c4e-b008-abba3dbc6441 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/6b573959-42da-4d15-a449-07ba5a2d7253" status: 200 len: 1453 microversion: 2.1 time: 0.111633 Aug 04 17:03:32.677365 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1089/2268] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:32 2022] GET /compute/v2.1/images/6b573959-42da-4d15-a449-07ba5a2d7253 => generated 1453 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:32.969239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-ca65d946-151f-40e9-93a8-5667701829f3 req-90b393fc-1611-464f-926e-3418f67160c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8622154b-7c51-4c6c-9652-f81e32e35f7b", "tag": "db19c01b-063e-454a-9199-c6e2117589bd"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:32.989962 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ca65d946-151f-40e9-93a8-5667701829f3 req-90b393fc-1611-464f-926e-3418f67160c0 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:32.992198 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ca65d946-151f-40e9-93a8-5667701829f3 req-90b393fc-1611-464f-926e-3418f67160c0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:32.993272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ca65d946-151f-40e9-93a8-5667701829f3 req-90b393fc-1611-464f-926e-3418f67160c0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:33.028881 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-ca65d946-151f-40e9-93a8-5667701829f3 req-90b393fc-1611-464f-926e-3418f67160c0 service nova] Creating event network-changed:db19c01b-063e-454a-9199-c6e2117589bd for instance 8622154b-7c51-4c6c-9652-f81e32e35f7b on n-h1-851359-3 Aug 04 17:03:33.039361 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-ca65d946-151f-40e9-93a8-5667701829f3 req-90b393fc-1611-464f-926e-3418f67160c0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074167 Aug 04 17:03:33.042444 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1090/2269] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:33.074632 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9d619dfe-8634-4d1b-8bd7-7e9d16839c7e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d93fe83a6542c89cbc86106671b15f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '792f078eb62f4820ba4166d421079491', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:33.079619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0eb23ca1-7c0c-46ec-8e79-4d7af332a7ca tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e6c908c10>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:33.084755 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9d619dfe-8634-4d1b-8bd7-7e9d16839c7e tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864" status: 200 len: 1501 microversion: 2.1 time: 0.501010 Aug 04 17:03:33.103693 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1180/2270] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:32 2022] GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864 => generated 1501 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:33.174388 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0eb23ca1-7c0c-46ec-8e79-4d7af332a7ca tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e" status: 200 len: 1409 microversion: 2.1 time: 0.109205 Aug 04 17:03:33.175846 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1091/2271] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:33 2022] GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e => generated 1409 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:33.343281 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d03dfbb1-a5a4-438f-bf89-0f9ddcfda75b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:33.343801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d03dfbb1-a5a4-438f-bf89-0f9ddcfda75b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:33.354266 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d03dfbb1-a5a4-438f-bf89-0f9ddcfda75b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:33.357408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d03dfbb1-a5a4-438f-bf89-0f9ddcfda75b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:33.361413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d03dfbb1-a5a4-438f-bf89-0f9ddcfda75b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:33.362477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d03dfbb1-a5a4-438f-bf89-0f9ddcfda75b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:33.363517 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d03dfbb1-a5a4-438f-bf89-0f9ddcfda75b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:33.364134 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d03dfbb1-a5a4-438f-bf89-0f9ddcfda75b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:33.693685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9053cdda-1fbe-4bd8-98c8-ad7040e21c44 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e6c999550>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:33.790657 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9053cdda-1fbe-4bd8-98c8-ad7040e21c44 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/6b573959-42da-4d15-a449-07ba5a2d7253" status: 200 len: 1453 microversion: 2.1 time: 0.102908 Aug 04 17:03:33.792578 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1092/2272] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:33 2022] GET /compute/v2.1/images/6b573959-42da-4d15-a449-07ba5a2d7253 => generated 1453 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:34.006393 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d03dfbb1-a5a4-438f-bf89-0f9ddcfda75b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:34.023932 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d03dfbb1-a5a4-438f-bf89-0f9ddcfda75b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b" status: 200 len: 1314 microversion: 2.1 time: 0.685157 Aug 04 17:03:34.032607 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1181/2273] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:33 2022] GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b => generated 1314 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:34.121792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-797c20b1-5838-4f06-b52a-94a48e126f4c tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:34.126488 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-797c20b1-5838-4f06-b52a-94a48e126f4c tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] [instance: 37140c09-31fd-4233-9ab9-6351044c5864] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:34.154280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-797c20b1-5838-4f06-b52a-94a48e126f4c tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:34.154758 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-797c20b1-5838-4f06-b52a-94a48e126f4c tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:34.155552 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-797c20b1-5838-4f06-b52a-94a48e126f4c tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:34.156708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-797c20b1-5838-4f06-b52a-94a48e126f4c tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:34.162828 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-797c20b1-5838-4f06-b52a-94a48e126f4c tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:34.163531 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-797c20b1-5838-4f06-b52a-94a48e126f4c tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:34.188894 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-312f2d24-c98c-4339-abec-7f9e5b33a3b2 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5ae48ca0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:34.217685 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-797c20b1-5838-4f06-b52a-94a48e126f4c tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] HTTP exception thrown: Instance 37140c09-31fd-4233-9ab9-6351044c5864 could not be found. Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-797c20b1-5838-4f06-b52a-94a48e126f4c tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Request method failure captured: Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864 HTTP/1.1 Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_nx4zpoZyN271LHTSeJxILr3fxWmehAd73Qj4Mr3-kQ0Z96VGd88Njdn98GUYX0n84u9xHwJg1ygSOcJgsbmRZxdOJa7CP_K2Ra1wkoWsIeJsOtucMgDGajwnhOJDwPBrqSjSfszp3sXUCDj_lHYyKsw8X_WMLGlgsCYqeXhflvOHk Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 792f078eb62f4820ba4166d421079491 Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-LiveMigrationTest-1342252687 Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/792f078eb62f4820ba4166d421079491"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/792f078eb62f4820ba4166d421079491"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_792f078eb62f4820ba4166d421079491"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/792f078eb62f4820ba4166d421079491"}]}] Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-LiveMigrationTest-1342252687 Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 792f078eb62f4820ba4166d421079491 Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-LiveMigrationTest-1342252687 Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-LiveMigrationTest-1342252687-project Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 81d93fe83a6542c89cbc86106671b15f Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-LiveMigrationTest-1342252687-project Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 37140c09-31fd-4233-9ab9-6351044c5864 could not be found. Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '37140c09-31fd-4233-9ab9-6351044c5864'} Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37140c09-31fd-4233-9ab9-6351044c5864 could not be found. Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37140c09-31fd-4233-9ab9-6351044c5864 could not be found. Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:34.219583 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:03:34.223074 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:34.223074 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:34.223074 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:34.223074 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:03:34.223074 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:03:34.223074 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37140c09-31fd-4233-9ab9-6351044c5864 could not be found. Aug 04 17:03:34.223074 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:03:34.223074 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-797c20b1-5838-4f06-b52a-94a48e126f4c tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] Returning 404 to user: Instance 37140c09-31fd-4233-9ab9-6351044c5864 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:34.223074 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-797c20b1-5838-4f06-b52a-94a48e126f4c tempest-LiveMigrationTest-1342252687 tempest-LiveMigrationTest-1342252687-project] 10.222.0.93 "GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864" status: 404 len: 111 microversion: 2.1 time: 0.104201 Aug 04 17:03:34.223074 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1093/2274] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:34 2022] GET /compute/v2.1/servers/37140c09-31fd-4233-9ab9-6351044c5864 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:03:34.291045 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-312f2d24-c98c-4339-abec-7f9e5b33a3b2 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e" status: 200 len: 1409 microversion: 2.1 time: 0.088035 Aug 04 17:03:34.303187 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1182/2275] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:34 2022] GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e => generated 1409 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:03:34.812481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ca3faa19-8610-4de6-8b8a-321a39df451a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5b3898b0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:34.898406 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ca3faa19-8610-4de6-8b8a-321a39df451a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/6b573959-42da-4d15-a449-07ba5a2d7253" status: 200 len: 1453 microversion: 2.1 time: 0.095855 Aug 04 17:03:34.899567 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1094/2276] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:34 2022] GET /compute/v2.1/images/6b573959-42da-4d15-a449-07ba5a2d7253 => generated 1453 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:35.050952 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:35.052336 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=34 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:35.056669 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cd3ad498-157f-4837-8de0-87d83acf76cd tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:35.057431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cd3ad498-157f-4837-8de0-87d83acf76cd tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:35.076303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-5a8ca9c5-ab3d-4fd0-872f-f5dc79573ab1 req-b8a1738d-563f-45f0-8bf1-ad104b7b37ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba09cec5-a546-4fe5-90df-c90d94591fb2", "name": "network-vif-unplugged", "status": "completed", "tag": "14919ddc-0463-47b2-9b85-fd575b876018"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:35.085533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd3ad498-157f-4837-8de0-87d83acf76cd tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:35.094872 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd3ad498-157f-4837-8de0-87d83acf76cd tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:35.102742 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd3ad498-157f-4837-8de0-87d83acf76cd tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:35.105122 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd3ad498-157f-4837-8de0-87d83acf76cd tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:35.105841 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd3ad498-157f-4837-8de0-87d83acf76cd tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:35.110292 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd3ad498-157f-4837-8de0-87d83acf76cd tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:35.114897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5a8ca9c5-ab3d-4fd0-872f-f5dc79573ab1 req-b8a1738d-563f-45f0-8bf1-ad104b7b37ae service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:35.115677 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5a8ca9c5-ab3d-4fd0-872f-f5dc79573ab1 req-b8a1738d-563f-45f0-8bf1-ad104b7b37ae service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:35.122027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5a8ca9c5-ab3d-4fd0-872f-f5dc79573ab1 req-b8a1738d-563f-45f0-8bf1-ad104b7b37ae service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:35.163857 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-5a8ca9c5-ab3d-4fd0-872f-f5dc79573ab1 req-b8a1738d-563f-45f0-8bf1-ad104b7b37ae service nova] Creating event network-vif-unplugged:14919ddc-0463-47b2-9b85-fd575b876018 for instance ba09cec5-a546-4fe5-90df-c90d94591fb2 on n-h1-851359-3 Aug 04 17:03:35.186078 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-5a8ca9c5-ab3d-4fd0-872f-f5dc79573ab1 req-b8a1738d-563f-45f0-8bf1-ad104b7b37ae service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113404 Aug 04 17:03:35.189550 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1095/2277] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:03:35.260358 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-c4924471-21bd-4996-b99b-24734fd3d40a req-b4c55806-3b08-4486-8de3-e65a9184ad0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37140c09-31fd-4233-9ab9-6351044c5864", "name": "network-vif-deleted", "tag": "e39bb9a8-b8ea-451a-83ab-1b6e8662ede5"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:35.283361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=18 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:35.285918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c4924471-21bd-4996-b99b-24734fd3d40a req-b4c55806-3b08-4486-8de3-e65a9184ad0d service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:35.286564 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c4924471-21bd-4996-b99b-24734fd3d40a req-b4c55806-3b08-4486-8de3-e65a9184ad0d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:35.287269 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c4924471-21bd-4996-b99b-24734fd3d40a req-b4c55806-3b08-4486-8de3-e65a9184ad0d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:35.371630 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-c4924471-21bd-4996-b99b-24734fd3d40a req-b4c55806-3b08-4486-8de3-e65a9184ad0d service nova] Creating event network-vif-deleted:e39bb9a8-b8ea-451a-83ab-1b6e8662ede5 for instance 37140c09-31fd-4233-9ab9-6351044c5864 on n-h2-851359-3 Aug 04 17:03:35.382194 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-c4924471-21bd-4996-b99b-24734fd3d40a req-b4c55806-3b08-4486-8de3-e65a9184ad0d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126074 Aug 04 17:03:35.384408 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1096/2278] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:35.396814 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2b8c6db8-d412-4a7a-8a1b-fa33b0d3c432 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e6c908af0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:35.514499 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2b8c6db8-d412-4a7a-8a1b-fa33b0d3c432 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e" status: 200 len: 1409 microversion: 2.1 time: 0.128609 Aug 04 17:03:35.521227 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1097/2279] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:35 2022] GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e => generated 1409 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:35.643196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cd3ad498-157f-4837-8de0-87d83acf76cd tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:35.656510 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cd3ad498-157f-4837-8de0-87d83acf76cd tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b" status: 200 len: 1314 microversion: 2.1 time: 0.605159 Aug 04 17:03:35.658840 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1183/2280] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:35 2022] GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b => generated 1314 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:35.913825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fdd2bcf7-d7c4-443c-bd54-2690e874e929 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5b41a8b0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:35.999248 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fdd2bcf7-d7c4-443c-bd54-2690e874e929 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/6b573959-42da-4d15-a449-07ba5a2d7253" status: 200 len: 1453 microversion: 2.1 time: 0.089857 Aug 04 17:03:36.000178 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1098/2281] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:35 2022] GET /compute/v2.1/images/6b573959-42da-4d15-a449-07ba5a2d7253 => generated 1453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:36.295426 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4f56b277-9842-482c-a284-168699f01801 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:36.296062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4f56b277-9842-482c-a284-168699f01801 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:36.313061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f56b277-9842-482c-a284-168699f01801 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:36.316414 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f56b277-9842-482c-a284-168699f01801 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:36.317786 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f56b277-9842-482c-a284-168699f01801 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:36.320613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f56b277-9842-482c-a284-168699f01801 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:36.327150 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f56b277-9842-482c-a284-168699f01801 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:36.327887 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f56b277-9842-482c-a284-168699f01801 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:36.418645 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4f56b277-9842-482c-a284-168699f01801 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:03:36.529356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-192b4570-6881-470e-a884-bed24ccb068f tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e6c9083a0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:36.695818 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-192b4570-6881-470e-a884-bed24ccb068f tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e" status: 200 len: 1409 microversion: 2.1 time: 0.170493 Aug 04 17:03:36.696867 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1099/2282] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:36 2022] GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e => generated 1409 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:36.719998 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d5907a6c-e042-427a-bbca-85fd194e5ce3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:36.723819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d5907a6c-e042-427a-bbca-85fd194e5ce3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:36.747114 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5907a6c-e042-427a-bbca-85fd194e5ce3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:36.748295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5907a6c-e042-427a-bbca-85fd194e5ce3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:36.751587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5907a6c-e042-427a-bbca-85fd194e5ce3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:36.752763 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5907a6c-e042-427a-bbca-85fd194e5ce3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:36.759683 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5907a6c-e042-427a-bbca-85fd194e5ce3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:36.760181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5907a6c-e042-427a-bbca-85fd194e5ce3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:37.182121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d5907a6c-e042-427a-bbca-85fd194e5ce3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:37.195860 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d5907a6c-e042-427a-bbca-85fd194e5ce3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b" status: 200 len: 1314 microversion: 2.1 time: 0.496835 Aug 04 17:03:37.196678 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1100/2283] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:36 2022] GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b => generated 1314 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:37.437608 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4f56b277-9842-482c-a284-168699f01801 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "DELETE /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 204 len: 0 microversion: 2.25 time: 1.146109 Aug 04 17:03:37.441172 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1184/2284] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Aug 4 17:03:36 2022] DELETE /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 0 bytes in 1151 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:03:37.453966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b6f4cd16-060d-4606-b010-9005afa6e075 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5adf7430>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:37.656180 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7007eee1-1a2d-4910-b77c-63ce7690dfa6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Action: 'create', calling method: .version_select at 0x7f1e5b54b310>, body: {"keypair": {"name": "tempest-keypair-558239303", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgVT6xp9uIalOi2mzr4hg6k1BsZXLPQ6EmKPoZPAUdZ3ca7xG8eOavcOp944EOG5fVPFPSpVak4dUNocl+n/ggLPrAnUWxmthWbBANMLwlwrXS5+azAGm9Bq7Mc1wZ+7g=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:37.677444 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-7007eee1-1a2d-4910-b77c-63ce7690dfa6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Getting quotas for project a29204609fba44a4b69c57e2d0f5e581. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:03:37.700985 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-7007eee1-1a2d-4910-b77c-63ce7690dfa6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Getting quotas for user 9df56ffaf1f14046b8a97d219833caf9 and project a29204609fba44a4b69c57e2d0f5e581. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:03:37.760893 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7007eee1-1a2d-4910-b77c-63ce7690dfa6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.545098 Aug 04 17:03:37.798919 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1101/2285] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:03:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:37.823952 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-71dfcd85-c59d-4624-9e22-2e185857016d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:37.829596 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-71dfcd85-c59d-4624-9e22-2e185857016d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:37.860098 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71dfcd85-c59d-4624-9e22-2e185857016d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:37.864140 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71dfcd85-c59d-4624-9e22-2e185857016d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:37.868174 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71dfcd85-c59d-4624-9e22-2e185857016d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:37.870583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71dfcd85-c59d-4624-9e22-2e185857016d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:37.877504 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71dfcd85-c59d-4624-9e22-2e185857016d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:37.879690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71dfcd85-c59d-4624-9e22-2e185857016d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:38.278775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-71dfcd85-c59d-4624-9e22-2e185857016d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:38.295490 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-71dfcd85-c59d-4624-9e22-2e185857016d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:38.298409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-71dfcd85-c59d-4624-9e22-2e185857016d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:38.306530 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-71dfcd85-c59d-4624-9e22-2e185857016d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 200 len: 1728 microversion: 2.25 time: 0.506080 Aug 04 17:03:38.310220 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1102/2286] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:37 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 1728 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:38.333222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b10fbde9-8158-4141-9a4e-0d03e8ad30b6 req-2e247a2b-d08e-4e94-b323-ed7ebaa9e144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6fb758e-d1f2-4244-b287-d93d20a53ac5", "name": "network-vif-plugged", "status": "completed", "tag": "e1ab51bf-fb27-46c5-9e82-16eef50f40f8"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:38.364889 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b10fbde9-8158-4141-9a4e-0d03e8ad30b6 req-2e247a2b-d08e-4e94-b323-ed7ebaa9e144 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:38.372390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b10fbde9-8158-4141-9a4e-0d03e8ad30b6 req-2e247a2b-d08e-4e94-b323-ed7ebaa9e144 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:38.374855 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b10fbde9-8158-4141-9a4e-0d03e8ad30b6 req-2e247a2b-d08e-4e94-b323-ed7ebaa9e144 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:38.457299 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b10fbde9-8158-4141-9a4e-0d03e8ad30b6 req-2e247a2b-d08e-4e94-b323-ed7ebaa9e144 service nova] Creating event network-vif-plugged:e1ab51bf-fb27-46c5-9e82-16eef50f40f8 for instance a6fb758e-d1f2-4244-b287-d93d20a53ac5 on n-h1-851359-3 Aug 04 17:03:38.497313 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b10fbde9-8158-4141-9a4e-0d03e8ad30b6 req-2e247a2b-d08e-4e94-b323-ed7ebaa9e144 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184463 Aug 04 17:03:38.504846 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1103/2287] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:38.549660 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-279ef390-31c3-4114-90cd-22b9cb3bcfe6 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5b54baf0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:47.382536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=60,nova_cell1:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:47.421740 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:47.730095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:48.363965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=66,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:48.397028 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=50 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:49.759775 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b6f4cd16-060d-4606-b010-9005afa6e075 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/6b573959-42da-4d15-a449-07ba5a2d7253" status: 200 len: 1453 microversion: 2.1 time: 12.317037 Aug 04 17:03:49.760334 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1185/2288] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:37 2022] GET /compute/v2.1/images/6b573959-42da-4d15-a449-07ba5a2d7253 => generated 1453 bytes in 12318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:49.762040 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-279ef390-31c3-4114-90cd-22b9cb3bcfe6 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e" status: 200 len: 1418 microversion: 2.1 time: 11.245351 Aug 04 17:03:49.763561 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1104/2289] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:38 2022] GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e => generated 1418 bytes in 11258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:49.768465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-634ff977-4a86-41d8-af90-7afb31d3e5ce tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:49.776313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-16f807e3-0e9a-4713-bb48-c8a14059b303 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:49.777303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-16f807e3-0e9a-4713-bb48-c8a14059b303 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:49.780562 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-634ff977-4a86-41d8-af90-7afb31d3e5ce tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: afea0f77-8d91-4170-934f-b6b7ef64d5a6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:49.786222 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16f807e3-0e9a-4713-bb48-c8a14059b303 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:49.786899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16f807e3-0e9a-4713-bb48-c8a14059b303 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:49.787645 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16f807e3-0e9a-4713-bb48-c8a14059b303 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:49.788504 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16f807e3-0e9a-4713-bb48-c8a14059b303 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:49.789109 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16f807e3-0e9a-4713-bb48-c8a14059b303 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:49.789687 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16f807e3-0e9a-4713-bb48-c8a14059b303 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:49.827109 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-634ff977-4a86-41d8-af90-7afb31d3e5ce tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:49.827621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-634ff977-4a86-41d8-af90-7afb31d3e5ce tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:49.828069 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-634ff977-4a86-41d8-af90-7afb31d3e5ce tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:49.829324 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-634ff977-4a86-41d8-af90-7afb31d3e5ce tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:49.829324 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-634ff977-4a86-41d8-af90-7afb31d3e5ce tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:49.829742 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-634ff977-4a86-41d8-af90-7afb31d3e5ce tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:49.858941 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-634ff977-4a86-41d8-af90-7afb31d3e5ce tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] HTTP exception thrown: Instance afea0f77-8d91-4170-934f-b6b7ef64d5a6 could not be found. Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-634ff977-4a86-41d8-af90-7afb31d3e5ce tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Request method failure captured: Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 HTTP/1.1 Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_pXlwUhhhM_d03666MBri4F66KYuzI-tT_44Q_uVp3yoZZcQlN-j61rkAZzwmwW4tSKuQH258YusxcVfdu_QDCUhoCbzi0tpJLDDBqkC799acQ0ABeNQ8x9blh_NUOKP-2Fn47qeOsKKyHkb_AGeMLzK1T3WAwYCm04XKXRWS0V3w8 Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.25 Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: e457894e070145348859f44a6a3e8ed6 Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-653155874 Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e457894e070145348859f44a6a3e8ed6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e457894e070145348859f44a6a3e8ed6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e457894e070145348859f44a6a3e8ed6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e457894e070145348859f44a6a3e8ed6"}]}] Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-653155874 Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: e457894e070145348859f44a6a3e8ed6 Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-653155874 Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-LiveAutoBlockMigrationV225Test-653155874-project Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: d0e0f6e799384863af2222416f070c84 Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-653155874-project Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance afea0f77-8d91-4170-934f-b6b7ef64d5a6 could not be found. Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'afea0f77-8d91-4170-934f-b6b7ef64d5a6'} Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afea0f77-8d91-4170-934f-b6b7ef64d5a6 could not be found. Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afea0f77-8d91-4170-934f-b6b7ef64d5a6 could not be found. Aug 04 17:03:49.860578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:03:49.864105 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:49.864105 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:03:49.864105 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:49.864105 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:49.864105 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:49.864105 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:03:49.864105 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:03:49.864105 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afea0f77-8d91-4170-934f-b6b7ef64d5a6 could not be found. Aug 04 17:03:49.864105 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:03:49.865569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-634ff977-4a86-41d8-af90-7afb31d3e5ce tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Returning 404 to user: Instance afea0f77-8d91-4170-934f-b6b7ef64d5a6 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:49.866628 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-634ff977-4a86-41d8-af90-7afb31d3e5ce tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6" status: 404 len: 111 microversion: 2.25 time: 0.101893 Aug 04 17:03:49.868476 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1105/2290] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:49 2022] GET /compute/v2.1/servers/afea0f77-8d91-4170-934f-b6b7ef64d5a6 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:03:49.873598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-64d22bd1-60af-42a6-8807-5212912e7527 req-7a010eff-6437-49ca-8552-358e61f6c2e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8622154b-7c51-4c6c-9652-f81e32e35f7b", "name": "network-vif-plugged", "status": "completed", "tag": "db19c01b-063e-454a-9199-c6e2117589bd"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:49.885469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-64d22bd1-60af-42a6-8807-5212912e7527 req-7a010eff-6437-49ca-8552-358e61f6c2e2 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:49.886290 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-64d22bd1-60af-42a6-8807-5212912e7527 req-7a010eff-6437-49ca-8552-358e61f6c2e2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:49.886872 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-64d22bd1-60af-42a6-8807-5212912e7527 req-7a010eff-6437-49ca-8552-358e61f6c2e2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:49.898739 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-64d22bd1-60af-42a6-8807-5212912e7527 req-7a010eff-6437-49ca-8552-358e61f6c2e2 service nova] Creating event network-vif-plugged:db19c01b-063e-454a-9199-c6e2117589bd for instance 8622154b-7c51-4c6c-9652-f81e32e35f7b on n-h1-851359-3 Aug 04 17:03:49.904262 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-64d22bd1-60af-42a6-8807-5212912e7527 req-7a010eff-6437-49ca-8552-358e61f6c2e2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034230 Aug 04 17:03:49.905322 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1106/2291] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:49.911043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9509878f-27cb-4951-b188-9c065546d479 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "ce4e1e37-0af7-4462-bd47-64fd625a164a"}], "security_groups": [{"name": "tempest-securitygroup--1851260479"}], "key_name": "tempest-keypair-558239303", "user_data": "}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:50.082047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-9509878f-27cb-4951-b188-9c065546d479 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] validate_networks() for [('ce4e1e37-0af7-4462-bd47-64fd625a164a', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:03:50.242076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-16f807e3-0e9a-4713-bb48-c8a14059b303 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:50.251269 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-16f807e3-0e9a-4713-bb48-c8a14059b303 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b" status: 200 len: 1314 microversion: 2.1 time: 0.487764 Aug 04 17:03:50.267697 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1186/2292] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:49 2022] GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b => generated 1314 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:50.272835 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-8afb96b9-b883-4195-8405-acb9011dbc09 req-0fa89cf8-657c-4cde-8ac2-3771a2261ace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afea0f77-8d91-4170-934f-b6b7ef64d5a6", "name": "network-vif-deleted", "tag": "9e2d842c-859e-4f10-8b78-924c2156cf47"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:50.282862 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8afb96b9-b883-4195-8405-acb9011dbc09 req-0fa89cf8-657c-4cde-8ac2-3771a2261ace service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:50.283723 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8afb96b9-b883-4195-8405-acb9011dbc09 req-0fa89cf8-657c-4cde-8ac2-3771a2261ace service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:50.284378 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8afb96b9-b883-4195-8405-acb9011dbc09 req-0fa89cf8-657c-4cde-8ac2-3771a2261ace service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:50.301594 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-8afb96b9-b883-4195-8405-acb9011dbc09 req-0fa89cf8-657c-4cde-8ac2-3771a2261ace service nova] Creating event network-vif-deleted:9e2d842c-859e-4f10-8b78-924c2156cf47 for instance afea0f77-8d91-4170-934f-b6b7ef64d5a6 on n-h2-851359-3 Aug 04 17:03:50.310118 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-8afb96b9-b883-4195-8405-acb9011dbc09 req-0fa89cf8-657c-4cde-8ac2-3771a2261ace service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040522 Aug 04 17:03:50.310978 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1187/2293] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:50.317213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9c451208-477d-4745-86d9-81750f113a89 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:50.322198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9c451208-477d-4745-86d9-81750f113a89 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6fef8a6c8c5e4eab9656d3f86511c7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3f2746c4894fdea00a84678e47f990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:50.323274 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9c451208-477d-4745-86d9-81750f113a89 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Searching by: {'deleted': False, 'project_id': 'de3f2746c4894fdea00a84678e47f990'} {{(pid=131043) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:03:50.328844 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9c451208-477d-4745-86d9-81750f113a89 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:50.329777 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9c451208-477d-4745-86d9-81750f113a89 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:50.330468 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9c451208-477d-4745-86d9-81750f113a89 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:50.331432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9c451208-477d-4745-86d9-81750f113a89 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:50.332098 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9c451208-477d-4745-86d9-81750f113a89 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:50.332757 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9c451208-477d-4745-86d9-81750f113a89 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:50.443240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.multi_cell_list [None req-9c451208-477d-4745-86d9-81750f113a89 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:03:50.529903 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9c451208-477d-4745-86d9-81750f113a89 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.217485 Aug 04 17:03:50.538675 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1188/2294] 10.222.0.93 () {58 vars in 1125 bytes} [Thu Aug 4 17:03:50 2022] GET /compute/v2.1/servers => generated 334 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:50.545385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-50bc9df6-bb02-490b-a7f8-66449bd57e67 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5ae415e0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:50.645696 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-50bc9df6-bb02-490b-a7f8-66449bd57e67 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e" status: 200 len: 1418 microversion: 2.1 time: 0.105817 Aug 04 17:03:50.646516 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1189/2295] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:50 2022] GET /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e => generated 1418 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:50.651097 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c80c8065-dc49-4481-9424-432b795b9377 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '.version_select at 0x7f1e5aedf3a0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:50.676023 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c80c8065-dc49-4481-9424-432b795b9377 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-205989504" status: 204 len: 0 microversion: 2.25 time: 0.028628 Aug 04 17:03:50.680001 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1190/2296] 10.222.0.93 () {60 vars in 1259 bytes} [Thu Aug 4 17:03:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-205989504 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:03:50.693506 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-373f1932-f651-4b67-891a-29642e1e858c tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:50.709348 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-373f1932-f651-4b67-891a-29642e1e858c tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6fef8a6c8c5e4eab9656d3f86511c7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3f2746c4894fdea00a84678e47f990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:50.710734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-373f1932-f651-4b67-891a-29642e1e858c tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Searching by: {'deleted': False, 'project_id': 'de3f2746c4894fdea00a84678e47f990'} {{(pid=131043) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:03:50.722243 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-373f1932-f651-4b67-891a-29642e1e858c tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:50.722742 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-373f1932-f651-4b67-891a-29642e1e858c tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:50.723185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-373f1932-f651-4b67-891a-29642e1e858c tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:50.723934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-373f1932-f651-4b67-891a-29642e1e858c tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:50.724405 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-373f1932-f651-4b67-891a-29642e1e858c tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:50.724843 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-373f1932-f651-4b67-891a-29642e1e858c tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:50.777243 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.multi_cell_list [None req-373f1932-f651-4b67-891a-29642e1e858c tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:03:50.870217 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-373f1932-f651-4b67-891a-29642e1e858c tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fef8a6c8c5e4eab9656d3f86511c7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3f2746c4894fdea00a84678e47f990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:50.875763 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-373f1932-f651-4b67-891a-29642e1e858c tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:50.876274 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-373f1932-f651-4b67-891a-29642e1e858c tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:50.876766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-373f1932-f651-4b67-891a-29642e1e858c tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:51.507059 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-373f1932-f651-4b67-891a-29642e1e858c tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] 10.222.0.93 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.828681 Aug 04 17:03:51.522199 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1191/2297] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 17:03:50 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:51.522199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-abd62cbd-72f5-4c92-a1d0-6b3eadb49c56 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5aedf790>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:51.529483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9509878f-27cb-4951-b188-9c065546d479 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:03:51.536491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9509878f-27cb-4951-b188-9c065546d479 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:03:51.537388 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9509878f-27cb-4951-b188-9c065546d479 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:03:51.540201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9509878f-27cb-4951-b188-9c065546d479 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:03:51.540784 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9509878f-27cb-4951-b188-9c065546d479 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:03:51.580152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9509878f-27cb-4951-b188-9c065546d479 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:51.583980 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9509878f-27cb-4951-b188-9c065546d479 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:51.585536 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9509878f-27cb-4951-b188-9c065546d479 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:51.590055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9509878f-27cb-4951-b188-9c065546d479 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:51.600086 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9509878f-27cb-4951-b188-9c065546d479 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:51.600948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9509878f-27cb-4951-b188-9c065546d479 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:51.671111 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-9509878f-27cb-4951-b188-9c065546d479 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Getting quotas for project a29204609fba44a4b69c57e2d0f5e581. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:03:51.707263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-9509878f-27cb-4951-b188-9c065546d479 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Getting quotas for user 9df56ffaf1f14046b8a97d219833caf9 and project a29204609fba44a4b69c57e2d0f5e581. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:03:51.737676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9509878f-27cb-4951-b188-9c065546d479 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:03:51.742464 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9509878f-27cb-4951-b188-9c065546d479 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] [instance: c91f5223-09be-4180-b1a0-c261e00361fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:03:51.828572 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9509878f-27cb-4951-b188-9c065546d479 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.922482 Aug 04 17:03:51.836382 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1107/2298] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:03:49 2022] POST /compute/v2.1/servers => generated 409 bytes in 1931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:03:51.843555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b2e531bc-0a2e-4f9f-a5f7-613c023ca361 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e6c910550>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:52.425583 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-abd62cbd-72f5-4c92-a1d0-6b3eadb49c56 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "DELETE /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e" status: 204 len: 0 microversion: 2.1 time: 0.915363 Aug 04 17:03:52.426937 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1192/2299] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:51 2022] DELETE /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e => generated 0 bytes in 918 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:03:52.432862 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e995cb35-362c-430e-9403-f5f208d99d1c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:52.433957 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e995cb35-362c-430e-9403-f5f208d99d1c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:52.446558 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e995cb35-362c-430e-9403-f5f208d99d1c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:52.448085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e995cb35-362c-430e-9403-f5f208d99d1c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:52.448764 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e995cb35-362c-430e-9403-f5f208d99d1c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:52.451552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e995cb35-362c-430e-9403-f5f208d99d1c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:52.452310 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e995cb35-362c-430e-9403-f5f208d99d1c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:52.453120 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e995cb35-362c-430e-9403-f5f208d99d1c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:52.478549 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b2e531bc-0a2e-4f9f-a5f7-613c023ca361 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/6b573959-42da-4d15-a449-07ba5a2d7253" status: 200 len: 1453 microversion: 2.1 time: 0.640549 Aug 04 17:03:52.479128 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1108/2300] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:51 2022] GET /compute/v2.1/images/6b573959-42da-4d15-a449-07ba5a2d7253 => generated 1453 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:52.499390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dbe8c792-1013-4cfe-a6b2-7ed992ce4c44 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:52.536754 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dbe8c792-1013-4cfe-a6b2-7ed992ce4c44 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.054895 Aug 04 17:03:52.537407 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1109/2301] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Aug 4 17:03:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:52.552867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dfc6f889-792a-437e-9e26-32fe8650592c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:52.564705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dfc6f889-792a-437e-9e26-32fe8650592c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:52.615830 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfc6f889-792a-437e-9e26-32fe8650592c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:52.618883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfc6f889-792a-437e-9e26-32fe8650592c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:52.619442 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfc6f889-792a-437e-9e26-32fe8650592c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:52.620938 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfc6f889-792a-437e-9e26-32fe8650592c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:52.623719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfc6f889-792a-437e-9e26-32fe8650592c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:52.629556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfc6f889-792a-437e-9e26-32fe8650592c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:52.667211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dfc6f889-792a-437e-9e26-32fe8650592c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:03:52.825592 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dfc6f889-792a-437e-9e26-32fe8650592c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "DELETE /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 204 len: 0 microversion: 2.25 time: 0.276650 Aug 04 17:03:52.826157 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1110/2302] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Aug 4 17:03:52 2022] DELETE /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:03:52.843312 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3b6927dc-8ade-4369-87f7-ba278797aac5 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:52.844039 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3b6927dc-8ade-4369-87f7-ba278797aac5 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] [instance: c91f5223-09be-4180-b1a0-c261e00361fc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:52.872462 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b6927dc-8ade-4369-87f7-ba278797aac5 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:52.877927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b6927dc-8ade-4369-87f7-ba278797aac5 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:52.878608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b6927dc-8ade-4369-87f7-ba278797aac5 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:52.880243 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b6927dc-8ade-4369-87f7-ba278797aac5 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:52.880897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b6927dc-8ade-4369-87f7-ba278797aac5 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:52.881475 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b6927dc-8ade-4369-87f7-ba278797aac5 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:52.896018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e995cb35-362c-430e-9403-f5f208d99d1c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:52.910582 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e995cb35-362c-430e-9403-f5f208d99d1c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b" status: 200 len: 1501 microversion: 2.1 time: 0.481881 Aug 04 17:03:52.913623 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1193/2303] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:52 2022] GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b => generated 1501 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:52.930280 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-17013d28-d4cc-4428-a6f6-b7178e052497 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:52.930803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-17013d28-d4cc-4428-a6f6-b7178e052497 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:52.940769 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-17013d28-d4cc-4428-a6f6-b7178e052497 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:52.941528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-17013d28-d4cc-4428-a6f6-b7178e052497 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:52.942194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-17013d28-d4cc-4428-a6f6-b7178e052497 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:52.943087 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-17013d28-d4cc-4428-a6f6-b7178e052497 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:52.943772 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-17013d28-d4cc-4428-a6f6-b7178e052497 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:52.944369 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-17013d28-d4cc-4428-a6f6-b7178e052497 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:52.977637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-17013d28-d4cc-4428-a6f6-b7178e052497 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:03:53.047478 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3b6927dc-8ade-4369-87f7-ba278797aac5 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df56ffaf1f14046b8a97d219833caf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29204609fba44a4b69c57e2d0f5e581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:53.062950 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3b6927dc-8ade-4369-87f7-ba278797aac5 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] 10.222.0.93 "GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc" status: 200 len: 1221 microversion: 2.1 time: 0.235490 Aug 04 17:03:53.064950 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1111/2304] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:52 2022] GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc => generated 1221 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:53.075579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-571f203c-03fc-486d-89e4-4e4a3afae06c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:53.076526 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-571f203c-03fc-486d-89e4-4e4a3afae06c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:53.089647 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-571f203c-03fc-486d-89e4-4e4a3afae06c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:53.093206 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-17013d28-d4cc-4428-a6f6-b7178e052497 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 204 len: 0 microversion: 2.1 time: 0.178105 Aug 04 17:03:53.094217 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-571f203c-03fc-486d-89e4-4e4a3afae06c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:53.094914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-571f203c-03fc-486d-89e4-4e4a3afae06c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:53.096029 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1194/2305] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:03:52 2022] DELETE /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:03:53.104780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-571f203c-03fc-486d-89e4-4e4a3afae06c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:53.105801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-571f203c-03fc-486d-89e4-4e4a3afae06c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:53.107950 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-571f203c-03fc-486d-89e4-4e4a3afae06c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:53.114863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bc08ee2c-6bd7-444f-951b-8c5513cfb80e tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:53.116005 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bc08ee2c-6bd7-444f-951b-8c5513cfb80e tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] [instance: 28e0f947-b275-48aa-90f0-bc74218c9478] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:53.133666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc08ee2c-6bd7-444f-951b-8c5513cfb80e tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:53.135653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc08ee2c-6bd7-444f-951b-8c5513cfb80e tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:53.136256 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc08ee2c-6bd7-444f-951b-8c5513cfb80e tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:53.138213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc08ee2c-6bd7-444f-951b-8c5513cfb80e tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:53.140519 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc08ee2c-6bd7-444f-951b-8c5513cfb80e tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:53.142642 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc08ee2c-6bd7-444f-951b-8c5513cfb80e tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:53.198818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bc08ee2c-6bd7-444f-951b-8c5513cfb80e tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] [instance: 28e0f947-b275-48aa-90f0-bc74218c9478] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:03:53.373822 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bc08ee2c-6bd7-444f-951b-8c5513cfb80e tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] 10.222.0.93 "DELETE /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478" status: 204 len: 0 microversion: 2.1 time: 0.276050 Aug 04 17:03:53.382506 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1195/2306] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:03:53 2022] DELETE /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:03:53.389840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9bae9113-1507-4de4-94a7-6a8bd7d569f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:53.397924 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9bae9113-1507-4de4-94a7-6a8bd7d569f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:53.398694 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9bae9113-1507-4de4-94a7-6a8bd7d569f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:53.399321 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9bae9113-1507-4de4-94a7-6a8bd7d569f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:53.437010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9bae9113-1507-4de4-94a7-6a8bd7d569f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Going to try to stop instance {{(pid=131043) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 17:03:53.456365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-571f203c-03fc-486d-89e4-4e4a3afae06c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:53.466694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-571f203c-03fc-486d-89e4-4e4a3afae06c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:53.473823 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-571f203c-03fc-486d-89e4-4e4a3afae06c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:53.475338 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-571f203c-03fc-486d-89e4-4e4a3afae06c tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 200 len: 1548 microversion: 2.25 time: 0.409400 Aug 04 17:03:53.476405 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1112/2307] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:53 2022] GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 1548 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:53.498702 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a83c68d9-609f-4c5e-a061-43d732571956 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1666949758", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "c4b7b07c-f108-4c13-9679-84b31b18674e"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:53.526224 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9bae9113-1507-4de4-94a7-6a8bd7d569f4 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "POST /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b/action" status: 202 len: 0 microversion: 2.1 time: 0.138804 Aug 04 17:03:53.526224 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1196/2308] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:03:53 2022] POST /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:03:53.536328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d9219f85-2422-4e9e-80d0-a4eff5c2eb80 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:53.537055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d9219f85-2422-4e9e-80d0-a4eff5c2eb80 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] [instance: 28e0f947-b275-48aa-90f0-bc74218c9478] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:53.543871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9219f85-2422-4e9e-80d0-a4eff5c2eb80 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:53.544325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9219f85-2422-4e9e-80d0-a4eff5c2eb80 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:53.544777 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9219f85-2422-4e9e-80d0-a4eff5c2eb80 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:53.545523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9219f85-2422-4e9e-80d0-a4eff5c2eb80 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:53.546028 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9219f85-2422-4e9e-80d0-a4eff5c2eb80 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:53.546493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9219f85-2422-4e9e-80d0-a4eff5c2eb80 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:53.583436 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-a83c68d9-609f-4c5e-a061-43d732571956 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] validate_networks() for [('c4b7b07c-f108-4c13-9679-84b31b18674e', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:03:53.894515 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d9219f85-2422-4e9e-80d0-a4eff5c2eb80 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fef8a6c8c5e4eab9656d3f86511c7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3f2746c4894fdea00a84678e47f990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:53.917602 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d9219f85-2422-4e9e-80d0-a4eff5c2eb80 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] 10.222.0.93 "GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478" status: 200 len: 1701 microversion: 2.1 time: 0.379546 Aug 04 17:03:53.932485 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1197/2309] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:53 2022] GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478 => generated 1701 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:53.938018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-27ee8076-8dd5-4a08-adcc-605423106c66 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5afe6ee0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:54.027643 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-27ee8076-8dd5-4a08-adcc-605423106c66 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/6b573959-42da-4d15-a449-07ba5a2d7253" status: 200 len: 1453 microversion: 2.1 time: 0.093286 Aug 04 17:03:54.028409 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1198/2310] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:53 2022] GET /compute/v2.1/images/6b573959-42da-4d15-a449-07ba5a2d7253 => generated 1453 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:54.041570 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e7ccf3d3-1add-43dd-aeb7-b7441838dc3b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:54.049897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e7ccf3d3-1add-43dd-aeb7-b7441838dc3b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:54.057613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7ccf3d3-1add-43dd-aeb7-b7441838dc3b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:54.060636 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7ccf3d3-1add-43dd-aeb7-b7441838dc3b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:54.062157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7ccf3d3-1add-43dd-aeb7-b7441838dc3b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:54.066583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7ccf3d3-1add-43dd-aeb7-b7441838dc3b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:54.067953 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7ccf3d3-1add-43dd-aeb7-b7441838dc3b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:54.068652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7ccf3d3-1add-43dd-aeb7-b7441838dc3b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:54.370280 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e7ccf3d3-1add-43dd-aeb7-b7441838dc3b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:54.379118 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e7ccf3d3-1add-43dd-aeb7-b7441838dc3b tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b" status: 200 len: 1511 microversion: 2.1 time: 0.345477 Aug 04 17:03:54.395503 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1199/2311] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:54 2022] GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b => generated 1511 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:54.400973 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e31f4900-c4d2-4261-aff0-55efe5f22ec6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:54.401812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e31f4900-c4d2-4261-aff0-55efe5f22ec6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] [instance: c91f5223-09be-4180-b1a0-c261e00361fc] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:54.409491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e31f4900-c4d2-4261-aff0-55efe5f22ec6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:54.410273 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e31f4900-c4d2-4261-aff0-55efe5f22ec6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:54.410868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e31f4900-c4d2-4261-aff0-55efe5f22ec6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:54.411768 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e31f4900-c4d2-4261-aff0-55efe5f22ec6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:54.412242 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e31f4900-c4d2-4261-aff0-55efe5f22ec6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:54.412679 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e31f4900-c4d2-4261-aff0-55efe5f22ec6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:54.420945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-a83c68d9-609f-4c5e-a061-43d732571956 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:03:54.421651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-a83c68d9-609f-4c5e-a061-43d732571956 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:03:54.422295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-a83c68d9-609f-4c5e-a061-43d732571956 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:03:54.422958 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-a83c68d9-609f-4c5e-a061-43d732571956 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:03:54.423946 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-a83c68d9-609f-4c5e-a061-43d732571956 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:03:54.444007 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a83c68d9-609f-4c5e-a061-43d732571956 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:54.446898 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a83c68d9-609f-4c5e-a061-43d732571956 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:54.448884 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a83c68d9-609f-4c5e-a061-43d732571956 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:54.449786 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a83c68d9-609f-4c5e-a061-43d732571956 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:54.450413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a83c68d9-609f-4c5e-a061-43d732571956 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:54.451298 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a83c68d9-609f-4c5e-a061-43d732571956 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:54.495055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-a83c68d9-609f-4c5e-a061-43d732571956 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Getting quotas for project 86d8604ab1934bdeacd1bb6073ae153a. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:03:54.503103 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-a83c68d9-609f-4c5e-a061-43d732571956 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Getting quotas for user 157e8ca7c2494f3ea5c468dc37f55858 and project 86d8604ab1934bdeacd1bb6073ae153a. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:03:54.503288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e31f4900-c4d2-4261-aff0-55efe5f22ec6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df56ffaf1f14046b8a97d219833caf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29204609fba44a4b69c57e2d0f5e581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:54.514377 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e31f4900-c4d2-4261-aff0-55efe5f22ec6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] 10.222.0.93 "GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc" status: 200 len: 1277 microversion: 2.1 time: 0.115314 Aug 04 17:03:54.514825 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1200/2312] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:54 2022] GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc => generated 1277 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:54.522144 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-709e08f0-a8da-45bb-b346-b93533edb7bd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:54.522714 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-709e08f0-a8da-45bb-b346-b93533edb7bd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:54.529386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-709e08f0-a8da-45bb-b346-b93533edb7bd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:54.529917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-709e08f0-a8da-45bb-b346-b93533edb7bd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:54.530577 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-709e08f0-a8da-45bb-b346-b93533edb7bd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:54.531339 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-709e08f0-a8da-45bb-b346-b93533edb7bd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:54.532031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-709e08f0-a8da-45bb-b346-b93533edb7bd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:54.532437 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-709e08f0-a8da-45bb-b346-b93533edb7bd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:54.542140 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a83c68d9-609f-4c5e-a061-43d732571956 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:03:54.545174 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a83c68d9-609f-4c5e-a061-43d732571956 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 30e66be0-1c2b-401d-8e17-1271b1910f4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:03:54.651163 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a83c68d9-609f-4c5e-a061-43d732571956 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.173351 Aug 04 17:03:54.655379 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1113/2313] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:03:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:03:54.672396 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ccd22cfd-c3b2-46e7-b36c-840bb4c2765e tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:54.673806 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ccd22cfd-c3b2-46e7-b36c-840bb4c2765e tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 30e66be0-1c2b-401d-8e17-1271b1910f4a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:54.772306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-709e08f0-a8da-45bb-b346-b93533edb7bd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:54.776126 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:03:54.793433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-709e08f0-a8da-45bb-b346-b93533edb7bd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:54.795517 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-709e08f0-a8da-45bb-b346-b93533edb7bd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:54.796752 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-709e08f0-a8da-45bb-b346-b93533edb7bd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 200 len: 1548 microversion: 2.25 time: 0.280915 Aug 04 17:03:54.813625 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1201/2314] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:54 2022] GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 1548 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:54.829154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ccd22cfd-c3b2-46e7-b36c-840bb4c2765e tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:54.837530 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ccd22cfd-c3b2-46e7-b36c-840bb4c2765e tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a" status: 200 len: 1208 microversion: 2.1 time: 0.169519 Aug 04 17:03:54.838607 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1114/2315] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:54 2022] GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a => generated 1208 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:03:54.943715 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a654a54f-5855-433a-8368-42690e67e378 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:54.944505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a654a54f-5855-433a-8368-42690e67e378 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] [instance: 28e0f947-b275-48aa-90f0-bc74218c9478] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:54.963537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a654a54f-5855-433a-8368-42690e67e378 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:54.964248 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a654a54f-5855-433a-8368-42690e67e378 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:54.965015 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a654a54f-5855-433a-8368-42690e67e378 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:54.965919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a654a54f-5855-433a-8368-42690e67e378 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:54.966578 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a654a54f-5855-433a-8368-42690e67e378 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:54.968693 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a654a54f-5855-433a-8368-42690e67e378 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:55.047053 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-37eefb45-bfd8-4cd0-a344-8fd108c85b5c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e6c9a20d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:55.101318 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-37eefb45-bfd8-4cd0-a344-8fd108c85b5c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/6b573959-42da-4d15-a449-07ba5a2d7253" status: 200 len: 1453 microversion: 2.1 time: 0.059548 Aug 04 17:03:55.109142 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1115/2316] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:55 2022] GET /compute/v2.1/images/6b573959-42da-4d15-a449-07ba5a2d7253 => generated 1453 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:55.266897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a654a54f-5855-433a-8368-42690e67e378 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fef8a6c8c5e4eab9656d3f86511c7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3f2746c4894fdea00a84678e47f990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:55.278671 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a654a54f-5855-433a-8368-42690e67e378 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] 10.222.0.93 "GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478" status: 200 len: 1701 microversion: 2.1 time: 0.342418 Aug 04 17:03:55.280332 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1202/2317] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:54 2022] GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478 => generated 1701 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:55.405241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-18026646-7ee8-492c-a333-1d7ed44cf700 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:55.406046 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-18026646-7ee8-492c-a333-1d7ed44cf700 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:55.420217 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18026646-7ee8-492c-a333-1d7ed44cf700 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:55.424127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18026646-7ee8-492c-a333-1d7ed44cf700 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:55.424786 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18026646-7ee8-492c-a333-1d7ed44cf700 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:55.427099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18026646-7ee8-492c-a333-1d7ed44cf700 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:55.427809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18026646-7ee8-492c-a333-1d7ed44cf700 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:55.429510 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18026646-7ee8-492c-a333-1d7ed44cf700 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:55.538727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fe99766c-8fb4-4bd3-bfaa-a988f42cfb51 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:55.539710 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fe99766c-8fb4-4bd3-bfaa-a988f42cfb51 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] [instance: c91f5223-09be-4180-b1a0-c261e00361fc] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:55.558333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fe99766c-8fb4-4bd3-bfaa-a988f42cfb51 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:55.558844 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fe99766c-8fb4-4bd3-bfaa-a988f42cfb51 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:55.564247 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fe99766c-8fb4-4bd3-bfaa-a988f42cfb51 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:55.565966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fe99766c-8fb4-4bd3-bfaa-a988f42cfb51 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:55.568074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fe99766c-8fb4-4bd3-bfaa-a988f42cfb51 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:55.568692 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fe99766c-8fb4-4bd3-bfaa-a988f42cfb51 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:55.635240 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-18026646-7ee8-492c-a333-1d7ed44cf700 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:55.645625 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-18026646-7ee8-492c-a333-1d7ed44cf700 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b" status: 200 len: 1511 microversion: 2.1 time: 0.244154 Aug 04 17:03:55.648158 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1116/2318] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:55 2022] GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b => generated 1511 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:55.668631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fe99766c-8fb4-4bd3-bfaa-a988f42cfb51 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df56ffaf1f14046b8a97d219833caf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29204609fba44a4b69c57e2d0f5e581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:55.677061 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fe99766c-8fb4-4bd3-bfaa-a988f42cfb51 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] 10.222.0.93 "GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc" status: 200 len: 1277 microversion: 2.1 time: 0.143528 Aug 04 17:03:55.678334 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1203/2319] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:55 2022] GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc => generated 1277 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:55.821350 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aea792fa-ef1d-4b24-97f2-59ca286daa6a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:55.822722 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aea792fa-ef1d-4b24-97f2-59ca286daa6a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:55.841037 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aea792fa-ef1d-4b24-97f2-59ca286daa6a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:55.842869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aea792fa-ef1d-4b24-97f2-59ca286daa6a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:55.845273 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aea792fa-ef1d-4b24-97f2-59ca286daa6a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:55.846335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aea792fa-ef1d-4b24-97f2-59ca286daa6a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:55.849225 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aea792fa-ef1d-4b24-97f2-59ca286daa6a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:55.852165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aea792fa-ef1d-4b24-97f2-59ca286daa6a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:55.863782 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-39addf1a-9f2f-483e-8ae9-e65c01b6313d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:55.864616 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-39addf1a-9f2f-483e-8ae9-e65c01b6313d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 30e66be0-1c2b-401d-8e17-1271b1910f4a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:55.872736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39addf1a-9f2f-483e-8ae9-e65c01b6313d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:55.873507 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39addf1a-9f2f-483e-8ae9-e65c01b6313d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:55.875193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39addf1a-9f2f-483e-8ae9-e65c01b6313d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:55.877622 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39addf1a-9f2f-483e-8ae9-e65c01b6313d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:55.878563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39addf1a-9f2f-483e-8ae9-e65c01b6313d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:55.879483 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39addf1a-9f2f-483e-8ae9-e65c01b6313d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:56.068346 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-39addf1a-9f2f-483e-8ae9-e65c01b6313d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:56.078620 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-39addf1a-9f2f-483e-8ae9-e65c01b6313d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a" status: 200 len: 1204 microversion: 2.1 time: 0.219718 Aug 04 17:03:56.079215 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1204/2320] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:55 2022] GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a => generated 1204 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:56.092611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-c813534d-40d7-439c-85c0-d124708288d8 req-2f04dfb8-038f-4ab4-9ea3-38bbb072c17e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99", "name": "network-vif-unplugged", "status": "completed", "tag": "fa729c8c-8604-47fb-b48f-bd564994c960"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:56.118160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c813534d-40d7-439c-85c0-d124708288d8 req-2f04dfb8-038f-4ab4-9ea3-38bbb072c17e service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:56.120023 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c813534d-40d7-439c-85c0-d124708288d8 req-2f04dfb8-038f-4ab4-9ea3-38bbb072c17e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:56.122253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c813534d-40d7-439c-85c0-d124708288d8 req-2f04dfb8-038f-4ab4-9ea3-38bbb072c17e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:56.150705 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-c813534d-40d7-439c-85c0-d124708288d8 req-2f04dfb8-038f-4ab4-9ea3-38bbb072c17e service nova] Creating event network-vif-unplugged:fa729c8c-8604-47fb-b48f-bd564994c960 for instance 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 on n-h2-851359-3 Aug 04 17:03:56.162132 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-c813534d-40d7-439c-85c0-d124708288d8 req-2f04dfb8-038f-4ab4-9ea3-38bbb072c17e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081139 Aug 04 17:03:56.165158 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1205/2321] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:56.180142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bfc75caa-6876-45ef-bc1c-1af33453ceca tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5aff9940>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:56.273152 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bfc75caa-6876-45ef-bc1c-1af33453ceca tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/6b573959-42da-4d15-a449-07ba5a2d7253" status: 200 len: 1462 microversion: 2.1 time: 0.106507 Aug 04 17:03:56.273743 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1206/2322] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:56 2022] GET /compute/v2.1/images/6b573959-42da-4d15-a449-07ba5a2d7253 => generated 1462 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:56.287824 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-703044f9-54a8-4f1e-91e7-13b48fe68d45 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5b018af0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:56.349419 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-703044f9-54a8-4f1e-91e7-13b48fe68d45 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/6b573959-42da-4d15-a449-07ba5a2d7253" status: 200 len: 1462 microversion: 2.1 time: 0.065066 Aug 04 17:03:56.351501 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1207/2323] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:56 2022] GET /compute/v2.1/images/6b573959-42da-4d15-a449-07ba5a2d7253 => generated 1462 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:03:56.357074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e3d35641-d827-4f64-a75c-0e106f47147b tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:56.358274 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e3d35641-d827-4f64-a75c-0e106f47147b tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] [instance: 28e0f947-b275-48aa-90f0-bc74218c9478] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:56.366214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e3d35641-d827-4f64-a75c-0e106f47147b tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:56.367177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e3d35641-d827-4f64-a75c-0e106f47147b tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:56.368044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e3d35641-d827-4f64-a75c-0e106f47147b tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:56.369804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e3d35641-d827-4f64-a75c-0e106f47147b tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:56.371031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e3d35641-d827-4f64-a75c-0e106f47147b tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:56.371948 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e3d35641-d827-4f64-a75c-0e106f47147b tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:56.398076 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-aea792fa-ef1d-4b24-97f2-59ca286daa6a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:56.422903 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-aea792fa-ef1d-4b24-97f2-59ca286daa6a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:56.427037 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-aea792fa-ef1d-4b24-97f2-59ca286daa6a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:56.430588 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aea792fa-ef1d-4b24-97f2-59ca286daa6a tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 200 len: 1548 microversion: 2.25 time: 0.612525 Aug 04 17:03:56.431666 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1117/2324] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:55 2022] GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 1548 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:56.438337 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d9831e35-6f4b-4bce-8f4a-e55437e9ab06 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:56.440714 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d9831e35-6f4b-4bce-8f4a-e55437e9ab06 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: a6fb758e-d1f2-4244-b287-d93d20a53ac5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:56.449904 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9831e35-6f4b-4bce-8f4a-e55437e9ab06 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:56.450632 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9831e35-6f4b-4bce-8f4a-e55437e9ab06 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:56.451278 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9831e35-6f4b-4bce-8f4a-e55437e9ab06 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:56.452480 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9831e35-6f4b-4bce-8f4a-e55437e9ab06 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:56.453192 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9831e35-6f4b-4bce-8f4a-e55437e9ab06 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:56.453777 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9831e35-6f4b-4bce-8f4a-e55437e9ab06 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:56.718263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e3d35641-d827-4f64-a75c-0e106f47147b tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fef8a6c8c5e4eab9656d3f86511c7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3f2746c4894fdea00a84678e47f990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:56.734110 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e3d35641-d827-4f64-a75c-0e106f47147b tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] 10.222.0.93 "GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478" status: 200 len: 1701 microversion: 2.1 time: 0.379210 Aug 04 17:03:56.739553 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1208/2325] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:56 2022] GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478 => generated 1701 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:56.759515 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e96ae7bf-e755-487d-a3f6-76a63df7ebfc tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:56.760512 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e96ae7bf-e755-487d-a3f6-76a63df7ebfc tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:56.769258 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e96ae7bf-e755-487d-a3f6-76a63df7ebfc tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:56.770163 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e96ae7bf-e755-487d-a3f6-76a63df7ebfc tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:56.770869 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e96ae7bf-e755-487d-a3f6-76a63df7ebfc tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:56.771779 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e96ae7bf-e755-487d-a3f6-76a63df7ebfc tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:56.772466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e96ae7bf-e755-487d-a3f6-76a63df7ebfc tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:56.773130 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e96ae7bf-e755-487d-a3f6-76a63df7ebfc tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:57.013878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d9831e35-6f4b-4bce-8f4a-e55437e9ab06 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a373cb0cd004b65a4ea9c804cbea3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82de1eabf714c3492860c2a65df5ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:57.036383 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d9831e35-6f4b-4bce-8f4a-e55437e9ab06 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5" status: 200 len: 1467 microversion: 2.1 time: 0.602021 Aug 04 17:03:57.038739 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1118/2326] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:56 2022] GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5 => generated 1467 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:57.046436 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e106bf37-c263-4242-aa68-d306550d31f9 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:57.047336 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e106bf37-c263-4242-aa68-d306550d31f9 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] [instance: c91f5223-09be-4180-b1a0-c261e00361fc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:57.058061 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e106bf37-c263-4242-aa68-d306550d31f9 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:57.058841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e106bf37-c263-4242-aa68-d306550d31f9 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:57.059895 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e106bf37-c263-4242-aa68-d306550d31f9 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:57.060927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e106bf37-c263-4242-aa68-d306550d31f9 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:57.061687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e106bf37-c263-4242-aa68-d306550d31f9 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:57.062322 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e106bf37-c263-4242-aa68-d306550d31f9 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:57.240696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e96ae7bf-e755-487d-a3f6-76a63df7ebfc tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:57.249707 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e96ae7bf-e755-487d-a3f6-76a63df7ebfc tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b" status: 200 len: 1511 microversion: 2.1 time: 0.508783 Aug 04 17:03:57.252903 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1209/2327] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:56 2022] GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b => generated 1511 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:57.266219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-610f1fdc-2387-4adf-975e-502b1c3b8e68 req-389de40c-732e-4bbe-8159-a1efe4d40199 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99", "name": "network-vif-deleted", "tag": "fa729c8c-8604-47fb-b48f-bd564994c960"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:57.287475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-610f1fdc-2387-4adf-975e-502b1c3b8e68 req-389de40c-732e-4bbe-8159-a1efe4d40199 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:57.290311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-610f1fdc-2387-4adf-975e-502b1c3b8e68 req-389de40c-732e-4bbe-8159-a1efe4d40199 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:57.291318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-610f1fdc-2387-4adf-975e-502b1c3b8e68 req-389de40c-732e-4bbe-8159-a1efe4d40199 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:57.330963 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e106bf37-c263-4242-aa68-d306550d31f9 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df56ffaf1f14046b8a97d219833caf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29204609fba44a4b69c57e2d0f5e581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:57.339970 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-610f1fdc-2387-4adf-975e-502b1c3b8e68 req-389de40c-732e-4bbe-8159-a1efe4d40199 service nova] Creating event network-vif-deleted:fa729c8c-8604-47fb-b48f-bd564994c960 for instance 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 on n-h2-851359-3 Aug 04 17:03:57.341128 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e106bf37-c263-4242-aa68-d306550d31f9 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] 10.222.0.93 "GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc" status: 200 len: 1283 microversion: 2.1 time: 0.300259 Aug 04 17:03:57.341713 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1119/2328] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:57 2022] GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc => generated 1283 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:57.364365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ec2a0690-35a8-4373-98eb-f590a345dc84 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-706592354"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:57.366346 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-610f1fdc-2387-4adf-975e-502b1c3b8e68 req-389de40c-732e-4bbe-8159-a1efe4d40199 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112023 Aug 04 17:03:57.368861 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1210/2329] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:57.369680 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ec2a0690-35a8-4373-98eb-f590a345dc84 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: ba09cec5-a546-4fe5-90df-c90d94591fb2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:57.376667 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec2a0690-35a8-4373-98eb-f590a345dc84 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:57.377159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec2a0690-35a8-4373-98eb-f590a345dc84 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:57.377560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5b8599ec-ce87-423c-b467-948347005e83 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:57.377678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec2a0690-35a8-4373-98eb-f590a345dc84 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:57.378320 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec2a0690-35a8-4373-98eb-f590a345dc84 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:57.378701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5b8599ec-ce87-423c-b467-948347005e83 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 30e66be0-1c2b-401d-8e17-1271b1910f4a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:57.378813 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec2a0690-35a8-4373-98eb-f590a345dc84 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:57.379203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec2a0690-35a8-4373-98eb-f590a345dc84 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:57.390221 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b8599ec-ce87-423c-b467-948347005e83 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:57.394175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b8599ec-ce87-423c-b467-948347005e83 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:57.397148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b8599ec-ce87-423c-b467-948347005e83 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:57.401374 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b8599ec-ce87-423c-b467-948347005e83 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:57.402103 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b8599ec-ce87-423c-b467-948347005e83 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:57.402701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b8599ec-ce87-423c-b467-948347005e83 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:57.582403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5b8599ec-ce87-423c-b467-948347005e83 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:57.602877 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5b8599ec-ce87-423c-b467-948347005e83 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a" status: 200 len: 1266 microversion: 2.1 time: 0.231859 Aug 04 17:03:57.605798 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1211/2330] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:57 2022] GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:57.624331 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a541fa62-53e1-4950-a4f7-e031bd7c247d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:57.626106 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a541fa62-53e1-4950-a4f7-e031bd7c247d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:57.637659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a541fa62-53e1-4950-a4f7-e031bd7c247d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:57.638194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a541fa62-53e1-4950-a4f7-e031bd7c247d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:57.638642 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a541fa62-53e1-4950-a4f7-e031bd7c247d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:57.639459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a541fa62-53e1-4950-a4f7-e031bd7c247d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:57.639930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a541fa62-53e1-4950-a4f7-e031bd7c247d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:57.640545 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a541fa62-53e1-4950-a4f7-e031bd7c247d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:57.694017 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a541fa62-53e1-4950-a4f7-e031bd7c247d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:57.694616 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a541fa62-53e1-4950-a4f7-e031bd7c247d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:57.695388 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a541fa62-53e1-4950-a4f7-e031bd7c247d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:57.695966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-a541fa62-53e1-4950-a4f7-e031bd7c247d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lazy-loading 'fault' on Instance uuid cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:03:57.830604 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ec2a0690-35a8-4373-98eb-f590a345dc84 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "POST /compute/v2.1/servers/ba09cec5-a546-4fe5-90df-c90d94591fb2/action" status: 202 len: 0 microversion: 2.1 time: 0.479307 Aug 04 17:03:57.831324 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1120/2331] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:03:57 2022] POST /compute/v2.1/servers/ba09cec5-a546-4fe5-90df-c90d94591fb2/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 17:03:57.844916 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-62d5e4f4-2de6-46d0-9df4-a7fa658ee897 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:57.849348 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-62d5e4f4-2de6-46d0-9df4-a7fa658ee897 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] [instance: 28e0f947-b275-48aa-90f0-bc74218c9478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:57.868947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62d5e4f4-2de6-46d0-9df4-a7fa658ee897 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:57.869463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62d5e4f4-2de6-46d0-9df4-a7fa658ee897 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:57.869910 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62d5e4f4-2de6-46d0-9df4-a7fa658ee897 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:57.870857 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62d5e4f4-2de6-46d0-9df4-a7fa658ee897 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:57.873249 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62d5e4f4-2de6-46d0-9df4-a7fa658ee897 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:57.873703 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62d5e4f4-2de6-46d0-9df4-a7fa658ee897 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:57.883124 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a541fa62-53e1-4950-a4f7-e031bd7c247d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:57.899920 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a541fa62-53e1-4950-a4f7-e031bd7c247d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:57.920941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a541fa62-53e1-4950-a4f7-e031bd7c247d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:57.925469 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a541fa62-53e1-4950-a4f7-e031bd7c247d tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 200 len: 1352 microversion: 2.25 time: 0.318280 Aug 04 17:03:57.946815 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1212/2332] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:57 2022] GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 1352 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:03:57.952837 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-acc22217-ddbd-4d27-9fb4-3896d7b0a05a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5adcc940>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:58.049724 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-acc22217-ddbd-4d27-9fb4-3896d7b0a05a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257" status: 200 len: 1452 microversion: 2.1 time: 0.100066 Aug 04 17:03:58.058083 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1213/2333] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:57 2022] GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257 => generated 1452 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:58.164292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-62d5e4f4-2de6-46d0-9df4-a7fa658ee897 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fef8a6c8c5e4eab9656d3f86511c7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de3f2746c4894fdea00a84678e47f990', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:58.189957 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-62d5e4f4-2de6-46d0-9df4-a7fa658ee897 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] 10.222.0.93 "GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478" status: 200 len: 1633 microversion: 2.1 time: 0.349575 Aug 04 17:03:58.204177 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1121/2334] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:57 2022] GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478 => generated 1633 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:58.284924 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8d2455ba-399c-4e8d-842b-7766eb674d30 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:58.285878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8d2455ba-399c-4e8d-842b-7766eb674d30 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:58.299173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d2455ba-399c-4e8d-842b-7766eb674d30 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:58.299833 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d2455ba-399c-4e8d-842b-7766eb674d30 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:58.300900 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d2455ba-399c-4e8d-842b-7766eb674d30 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:58.302601 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d2455ba-399c-4e8d-842b-7766eb674d30 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:58.303443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d2455ba-399c-4e8d-842b-7766eb674d30 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:58.304252 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d2455ba-399c-4e8d-842b-7766eb674d30 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:58.370900 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-686f81d0-77fa-4260-9c2b-ac0dbb065e28 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:58.372730 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-686f81d0-77fa-4260-9c2b-ac0dbb065e28 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] [instance: c91f5223-09be-4180-b1a0-c261e00361fc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:58.383842 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-686f81d0-77fa-4260-9c2b-ac0dbb065e28 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:58.384579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-686f81d0-77fa-4260-9c2b-ac0dbb065e28 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:58.398922 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-686f81d0-77fa-4260-9c2b-ac0dbb065e28 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:58.401121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-686f81d0-77fa-4260-9c2b-ac0dbb065e28 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:58.403514 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-686f81d0-77fa-4260-9c2b-ac0dbb065e28 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:58.404280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-686f81d0-77fa-4260-9c2b-ac0dbb065e28 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:59.186510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8d2455ba-399c-4e8d-842b-7766eb674d30 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:59.196376 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8d2455ba-399c-4e8d-842b-7766eb674d30 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b" status: 200 len: 1511 microversion: 2.1 time: 0.919389 Aug 04 17:03:59.211184 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1214/2335] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:58 2022] GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b => generated 1511 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:59.221726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3e129d03-26ed-449b-aadf-f06b1ae1b7be tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:59.222480 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3e129d03-26ed-449b-aadf-f06b1ae1b7be tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 30e66be0-1c2b-401d-8e17-1271b1910f4a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:59.229108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3e129d03-26ed-449b-aadf-f06b1ae1b7be tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:59.229918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3e129d03-26ed-449b-aadf-f06b1ae1b7be tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:59.230481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3e129d03-26ed-449b-aadf-f06b1ae1b7be tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:59.232045 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3e129d03-26ed-449b-aadf-f06b1ae1b7be tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:59.232588 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3e129d03-26ed-449b-aadf-f06b1ae1b7be tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:59.233097 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3e129d03-26ed-449b-aadf-f06b1ae1b7be tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:59.322687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-686f81d0-77fa-4260-9c2b-ac0dbb065e28 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df56ffaf1f14046b8a97d219833caf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29204609fba44a4b69c57e2d0f5e581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:59.331833 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-686f81d0-77fa-4260-9c2b-ac0dbb065e28 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] 10.222.0.93 "GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc" status: 200 len: 1351 microversion: 2.1 time: 0.967606 Aug 04 17:03:59.333108 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1122/2336] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:58 2022] GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc => generated 1351 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:03:59.338256 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-692ff509-febe-49cc-9189-c4f61ce98790 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:59.338879 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-692ff509-febe-49cc-9189-c4f61ce98790 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:59.345907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-692ff509-febe-49cc-9189-c4f61ce98790 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:59.346700 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-692ff509-febe-49cc-9189-c4f61ce98790 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:59.347096 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-692ff509-febe-49cc-9189-c4f61ce98790 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:59.347880 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-692ff509-febe-49cc-9189-c4f61ce98790 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:59.348375 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-692ff509-febe-49cc-9189-c4f61ce98790 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:59.349194 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-692ff509-febe-49cc-9189-c4f61ce98790 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:59.354466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3e129d03-26ed-449b-aadf-f06b1ae1b7be tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:03:59.366065 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-692ff509-febe-49cc-9189-c4f61ce98790 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] HTTP exception thrown: Instance cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 could not be found. Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-692ff509-febe-49cc-9189-c4f61ce98790 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Request method failure captured: Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 HTTP/1.1 Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_pXlwUhhhM_d03666MBri4F66KYuzI-tT_44Q_uVp3yoZZcQlN-j61rkAZzwmwW4tSKuQH258YusxcVfdu_QDCUhoCbzi0tpJLDDBqkC799acQ0ABeNQ8x9blh_NUOKP-2Fn47qeOsKKyHkb_AGeMLzK1T3WAwYCm04XKXRWS0V3w8 Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.25 Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: e457894e070145348859f44a6a3e8ed6 Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-653155874 Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e457894e070145348859f44a6a3e8ed6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e457894e070145348859f44a6a3e8ed6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e457894e070145348859f44a6a3e8ed6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e457894e070145348859f44a6a3e8ed6"}]}] Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-653155874 Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: e457894e070145348859f44a6a3e8ed6 Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-653155874 Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-LiveAutoBlockMigrationV225Test-653155874-project Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: d0e0f6e799384863af2222416f070c84 Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-653155874-project Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 could not be found. Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94'} Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 could not be found. Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 could not be found. Aug 04 17:03:59.367910 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:03:59.371617 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:59.371617 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:03:59.371617 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:59.371617 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:59.371617 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:59.371617 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:03:59.371617 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:03:59.371617 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 could not be found. Aug 04 17:03:59.371617 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:03:59.373234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-692ff509-febe-49cc-9189-c4f61ce98790 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Returning 404 to user: Instance cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:59.374904 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-692ff509-febe-49cc-9189-c4f61ce98790 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94" status: 404 len: 111 microversion: 2.25 time: 0.039900 Aug 04 17:03:59.375956 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1123/2337] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:59 2022] GET /compute/v2.1/servers/cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:03:59.381275 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3e129d03-26ed-449b-aadf-f06b1ae1b7be tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a" status: 200 len: 1266 microversion: 2.1 time: 0.166137 Aug 04 17:03:59.382205 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1215/2338] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:59 2022] GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:59.385445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9fe705de-4c74-4d39-8242-016f370d7626 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5b523790>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:59.390136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ac90a04d-9452-46ad-92ca-7f1cb6f94a83 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:59.391918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ac90a04d-9452-46ad-92ca-7f1cb6f94a83 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] [instance: 28e0f947-b275-48aa-90f0-bc74218c9478] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:59.403818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac90a04d-9452-46ad-92ca-7f1cb6f94a83 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:59.405122 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac90a04d-9452-46ad-92ca-7f1cb6f94a83 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:59.406251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac90a04d-9452-46ad-92ca-7f1cb6f94a83 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:59.407195 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac90a04d-9452-46ad-92ca-7f1cb6f94a83 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:59.409199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac90a04d-9452-46ad-92ca-7f1cb6f94a83 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:59.409810 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac90a04d-9452-46ad-92ca-7f1cb6f94a83 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:59.436428 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-ac90a04d-9452-46ad-92ca-7f1cb6f94a83 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] HTTP exception thrown: Instance 28e0f947-b275-48aa-90f0-bc74218c9478 could not be found. Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ac90a04d-9452-46ad-92ca-7f1cb6f94a83 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Request method failure captured: Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478 HTTP/1.1 Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_upsIAHycB-x233221eQLqqRkqZe8JmcyR6KaW9J2pPbeoOQ2NZIgYv6Vz8VrPbR4N1MW3I7yKtMmHPf4HAehx0PsF3dnqvGOR2XsLBqtKM2deJvpxXijcH11pWLultUY2PshalSj-FgqSS1bUm6DmIGuNWFudodxQBtUpbLp8eal4 Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: de3f2746c4894fdea00a84678e47f990 Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersTestJSON-345530427 Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/de3f2746c4894fdea00a84678e47f990"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/de3f2746c4894fdea00a84678e47f990"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_de3f2746c4894fdea00a84678e47f990"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/de3f2746c4894fdea00a84678e47f990"}]}] Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersTestJSON-345530427 Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: de3f2746c4894fdea00a84678e47f990 Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersTestJSON-345530427 Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersTestJSON-345530427-project Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 6fef8a6c8c5e4eab9656d3f86511c7de Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersTestJSON-345530427-project Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 28e0f947-b275-48aa-90f0-bc74218c9478 could not be found. Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '28e0f947-b275-48aa-90f0-bc74218c9478'} Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28e0f947-b275-48aa-90f0-bc74218c9478 could not be found. Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28e0f947-b275-48aa-90f0-bc74218c9478 could not be found. Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:59.438309 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:03:59.443404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:03:59.443404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:03:59.443404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:03:59.443404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:03:59.443404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28e0f947-b275-48aa-90f0-bc74218c9478 could not be found. Aug 04 17:03:59.443404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:03:59.443404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ac90a04d-9452-46ad-92ca-7f1cb6f94a83 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Returning 404 to user: Instance 28e0f947-b275-48aa-90f0-bc74218c9478 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:03:59.443404 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ac90a04d-9452-46ad-92ca-7f1cb6f94a83 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] 10.222.0.93 "GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478" status: 404 len: 111 microversion: 2.1 time: 0.056663 Aug 04 17:03:59.445383 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1216/2339] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:03:59 2022] GET /compute/v2.1/servers/28e0f947-b275-48aa-90f0-bc74218c9478 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:03:59.450995 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0a3f534c-5b77-4c4f-924e-4bf89b842cef tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:59.451578 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0a3f534c-5b77-4c4f-924e-4bf89b842cef tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:59.453603 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9fe705de-4c74-4d39-8242-016f370d7626 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257" status: 200 len: 1452 microversion: 2.1 time: 0.076298 Aug 04 17:03:59.455732 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1124/2340] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:03:59 2022] GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257 => generated 1452 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:03:59.460858 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0a3f534c-5b77-4c4f-924e-4bf89b842cef tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:59.461435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0a3f534c-5b77-4c4f-924e-4bf89b842cef tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:59.462182 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0a3f534c-5b77-4c4f-924e-4bf89b842cef tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:59.463392 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0a3f534c-5b77-4c4f-924e-4bf89b842cef tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:59.463809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-143b8fbe-ba1a-41aa-84e5-053cf84b8acf req-3af9a288-56ff-4ecd-979d-5d67c01a7ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94", "name": "network-vif-deleted", "tag": "39c19a16-6fb8-4d94-b72d-890e7a69bd05"}, {"server_uuid": "28e0f947-b275-48aa-90f0-bc74218c9478", "name": "network-vif-deleted", "tag": "b54af5f4-7d06-458b-b36f-c876adabf6c0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:03:59.464372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0a3f534c-5b77-4c4f-924e-4bf89b842cef tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:59.465103 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0a3f534c-5b77-4c4f-924e-4bf89b842cef tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:59.480107 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-143b8fbe-ba1a-41aa-84e5-053cf84b8acf req-3af9a288-56ff-4ecd-979d-5d67c01a7ff3 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:59.480754 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-143b8fbe-ba1a-41aa-84e5-053cf84b8acf req-3af9a288-56ff-4ecd-979d-5d67c01a7ff3 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:59.481318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-143b8fbe-ba1a-41aa-84e5-053cf84b8acf req-3af9a288-56ff-4ecd-979d-5d67c01a7ff3 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:59.501441 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-143b8fbe-ba1a-41aa-84e5-053cf84b8acf req-3af9a288-56ff-4ecd-979d-5d67c01a7ff3 service nova] Creating event network-vif-deleted:39c19a16-6fb8-4d94-b72d-890e7a69bd05 for instance cf9dc395-9a31-4a7b-9b1b-bacf26ff7d94 on n-h2-851359-3 Aug 04 17:03:59.502318 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-143b8fbe-ba1a-41aa-84e5-053cf84b8acf req-3af9a288-56ff-4ecd-979d-5d67c01a7ff3 service nova] Creating event network-vif-deleted:b54af5f4-7d06-458b-b36f-c876adabf6c0 for instance 28e0f947-b275-48aa-90f0-bc74218c9478 on n-h1-851359-3 Aug 04 17:03:59.503257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0a3f534c-5b77-4c4f-924e-4bf89b842cef tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:03:59.515038 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-143b8fbe-ba1a-41aa-84e5-053cf84b8acf req-3af9a288-56ff-4ecd-979d-5d67c01a7ff3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.056916 Aug 04 17:03:59.516439 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1125/2341] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:03:59.524216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-03acfef1-64c8-44e4-9954-b6de046f3147 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] Calling method '.version_select at 0x7f1e5b523820>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:59.548626 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-03acfef1-64c8-44e4-9954-b6de046f3147 tempest-ServersTestJSON-345530427 tempest-ServersTestJSON-345530427-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-266859357" status: 202 len: 0 microversion: 2.1 time: 0.030160 Aug 04 17:03:59.549392 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1126/2342] 10.222.0.93 () {58 vars in 1218 bytes} [Thu Aug 4 17:03:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-266859357 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:03:59.633629 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0a3f534c-5b77-4c4f-924e-4bf89b842cef tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "DELETE /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3" status: 204 len: 0 microversion: 2.25 time: 0.185364 Aug 04 17:03:59.634695 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1217/2343] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Aug 4 17:03:59 2022] DELETE /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:03:59.644139 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-139b257d-2946-414d-a8a2-540e55733e90 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:03:59.645394 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-139b257d-2946-414d-a8a2-540e55733e90 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:03:59.658953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-139b257d-2946-414d-a8a2-540e55733e90 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:59.660054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-139b257d-2946-414d-a8a2-540e55733e90 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:59.660795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-139b257d-2946-414d-a8a2-540e55733e90 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:03:59.661620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-139b257d-2946-414d-a8a2-540e55733e90 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:03:59.662229 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-139b257d-2946-414d-a8a2-540e55733e90 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:03:59.662944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-139b257d-2946-414d-a8a2-540e55733e90 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:00.119372 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-139b257d-2946-414d-a8a2-540e55733e90 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:00.140523 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-139b257d-2946-414d-a8a2-540e55733e90 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:00.142343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-139b257d-2946-414d-a8a2-540e55733e90 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:00.143736 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-139b257d-2946-414d-a8a2-540e55733e90 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3" status: 200 len: 1561 microversion: 2.25 time: 0.504109 Aug 04 17:04:00.144446 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1127/2344] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:03:59 2022] GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 => generated 1561 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:04:00.219066 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f74bf33f-827a-4275-8851-a1f532e42a7e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:00.219796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f74bf33f-827a-4275-8851-a1f532e42a7e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:00.235406 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f74bf33f-827a-4275-8851-a1f532e42a7e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:00.235916 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f74bf33f-827a-4275-8851-a1f532e42a7e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:00.236365 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f74bf33f-827a-4275-8851-a1f532e42a7e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:00.237379 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f74bf33f-827a-4275-8851-a1f532e42a7e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:00.238549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f74bf33f-827a-4275-8851-a1f532e42a7e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:00.239002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f74bf33f-827a-4275-8851-a1f532e42a7e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:00.361739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7c4701df-1fce-48ed-82b1-dd11ee99c356 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:00.363833 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7c4701df-1fce-48ed-82b1-dd11ee99c356 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] [instance: c91f5223-09be-4180-b1a0-c261e00361fc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:00.371837 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c4701df-1fce-48ed-82b1-dd11ee99c356 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:00.372615 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c4701df-1fce-48ed-82b1-dd11ee99c356 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:00.373237 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c4701df-1fce-48ed-82b1-dd11ee99c356 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:00.374468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c4701df-1fce-48ed-82b1-dd11ee99c356 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:00.375073 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c4701df-1fce-48ed-82b1-dd11ee99c356 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:00.376969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c4701df-1fce-48ed-82b1-dd11ee99c356 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:00.403965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:00.740755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f74bf33f-827a-4275-8851-a1f532e42a7e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:00.750310 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=4 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:00.756622 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f74bf33f-827a-4275-8851-a1f532e42a7e tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b" status: 200 len: 1511 microversion: 2.1 time: 0.541881 Aug 04 17:04:00.785355 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1218/2345] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:00 2022] GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b => generated 1511 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:00.804128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a29a517d-82bf-4e3a-8942-10183aa8e442 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:00.805010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a29a517d-82bf-4e3a-8942-10183aa8e442 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 30e66be0-1c2b-401d-8e17-1271b1910f4a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:00.819407 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a29a517d-82bf-4e3a-8942-10183aa8e442 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:00.820182 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a29a517d-82bf-4e3a-8942-10183aa8e442 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:00.820782 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a29a517d-82bf-4e3a-8942-10183aa8e442 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:00.821647 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a29a517d-82bf-4e3a-8942-10183aa8e442 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:00.822306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a29a517d-82bf-4e3a-8942-10183aa8e442 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:00.823679 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a29a517d-82bf-4e3a-8942-10183aa8e442 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:00.865361 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:00.919993 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7c4701df-1fce-48ed-82b1-dd11ee99c356 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df56ffaf1f14046b8a97d219833caf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29204609fba44a4b69c57e2d0f5e581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:00.928604 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7c4701df-1fce-48ed-82b1-dd11ee99c356 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] 10.222.0.93 "GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc" status: 200 len: 1351 microversion: 2.1 time: 0.572045 Aug 04 17:04:00.941522 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1128/2346] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:00 2022] GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc => generated 1351 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:00.950107 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-1588e58e-9808-4513-81b7-ca08bc009cdc req-b95fc112-1ff9-45cc-b1e2-a510f8bc8c79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c91f5223-09be-4180-b1a0-c261e00361fc", "tag": "01be168a-8839-40cc-bbbf-055fbfa0ec50"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:00.962821 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1588e58e-9808-4513-81b7-ca08bc009cdc req-b95fc112-1ff9-45cc-b1e2-a510f8bc8c79 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:00.963597 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1588e58e-9808-4513-81b7-ca08bc009cdc req-b95fc112-1ff9-45cc-b1e2-a510f8bc8c79 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:00.964226 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1588e58e-9808-4513-81b7-ca08bc009cdc req-b95fc112-1ff9-45cc-b1e2-a510f8bc8c79 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:00.984695 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-1588e58e-9808-4513-81b7-ca08bc009cdc req-b95fc112-1ff9-45cc-b1e2-a510f8bc8c79 service nova] Creating event network-changed:01be168a-8839-40cc-bbbf-055fbfa0ec50 for instance c91f5223-09be-4180-b1a0-c261e00361fc on n-h2-851359-3 Aug 04 17:04:01.004030 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-1588e58e-9808-4513-81b7-ca08bc009cdc req-b95fc112-1ff9-45cc-b1e2-a510f8bc8c79 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055163 Aug 04 17:04:01.005031 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1129/2347] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:01.018602 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6a5430ff-b851-4401-b1e1-3551332126f8 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5b3a8ee0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:01.116839 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6a5430ff-b851-4401-b1e1-3551332126f8 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257" status: 200 len: 1452 microversion: 2.1 time: 0.110384 Aug 04 17:04:01.118711 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1130/2348] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:01 2022] GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257 => generated 1452 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:01.134556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-c981c9e7-7361-48a9-8e97-20213367d2df req-f81f6c89-a7ff-4b2f-8231-501d2e4d75a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6fb758e-d1f2-4244-b287-d93d20a53ac5", "name": "network-vif-unplugged", "status": "completed", "tag": "e1ab51bf-fb27-46c5-9e82-16eef50f40f8"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:01.174549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c981c9e7-7361-48a9-8e97-20213367d2df req-f81f6c89-a7ff-4b2f-8231-501d2e4d75a1 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:01.175710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c981c9e7-7361-48a9-8e97-20213367d2df req-f81f6c89-a7ff-4b2f-8231-501d2e4d75a1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:01.176926 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c981c9e7-7361-48a9-8e97-20213367d2df req-f81f6c89-a7ff-4b2f-8231-501d2e4d75a1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:01.200250 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-c981c9e7-7361-48a9-8e97-20213367d2df req-f81f6c89-a7ff-4b2f-8231-501d2e4d75a1 service nova] Creating event network-vif-unplugged:e1ab51bf-fb27-46c5-9e82-16eef50f40f8 for instance a6fb758e-d1f2-4244-b287-d93d20a53ac5 on n-h1-851359-3 Aug 04 17:04:01.208882 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-c981c9e7-7361-48a9-8e97-20213367d2df req-f81f6c89-a7ff-4b2f-8231-501d2e4d75a1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088547 Aug 04 17:04:01.210159 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1131/2349] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:01.218949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a87bad6f-130c-4191-b315-9be62d3241bd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:01.221079 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a87bad6f-130c-4191-b315-9be62d3241bd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:01.244907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a87bad6f-130c-4191-b315-9be62d3241bd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:01.247885 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a87bad6f-130c-4191-b315-9be62d3241bd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:01.249701 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a87bad6f-130c-4191-b315-9be62d3241bd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:01.250754 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a87bad6f-130c-4191-b315-9be62d3241bd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:01.252910 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a87bad6f-130c-4191-b315-9be62d3241bd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:01.253681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a87bad6f-130c-4191-b315-9be62d3241bd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:01.317571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a29a517d-82bf-4e3a-8942-10183aa8e442 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:01.325838 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a29a517d-82bf-4e3a-8942-10183aa8e442 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a" status: 200 len: 1308 microversion: 2.1 time: 0.538826 Aug 04 17:04:01.327043 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1219/2350] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:00 2022] GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a => generated 1308 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:01.663034 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a87bad6f-130c-4191-b315-9be62d3241bd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:01.691040 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a87bad6f-130c-4191-b315-9be62d3241bd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:01.693149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a87bad6f-130c-4191-b315-9be62d3241bd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:01.695230 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a87bad6f-130c-4191-b315-9be62d3241bd tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3" status: 200 len: 1561 microversion: 2.25 time: 0.482974 Aug 04 17:04:01.705234 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1132/2351] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:04:01 2022] GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 => generated 1561 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:04:01.728802 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-97ec2cc0-2edc-4a52-83ec-f83283abf8b9 req-a3556dab-aa10-458c-b74b-0324906bac01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98e4458d-d7e4-4663-a974-70ccbe5501f3", "name": "network-vif-deleted", "tag": "3feec73d-d957-4633-8d95-d8f2f43a58be"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:01.746228 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-97ec2cc0-2edc-4a52-83ec-f83283abf8b9 req-a3556dab-aa10-458c-b74b-0324906bac01 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:01.746949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-97ec2cc0-2edc-4a52-83ec-f83283abf8b9 req-a3556dab-aa10-458c-b74b-0324906bac01 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:01.747585 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-97ec2cc0-2edc-4a52-83ec-f83283abf8b9 req-a3556dab-aa10-458c-b74b-0324906bac01 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:01.770586 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-97ec2cc0-2edc-4a52-83ec-f83283abf8b9 req-a3556dab-aa10-458c-b74b-0324906bac01 service nova] Creating event network-vif-deleted:3feec73d-d957-4633-8d95-d8f2f43a58be for instance 98e4458d-d7e4-4663-a974-70ccbe5501f3 on n-h2-851359-3 Aug 04 17:04:01.776617 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-97ec2cc0-2edc-4a52-83ec-f83283abf8b9 req-a3556dab-aa10-458c-b74b-0324906bac01 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051615 Aug 04 17:04:01.778487 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1220/2352] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:01.799935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4ca991ef-6128-4927-b09a-6450108ed84c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:01.803857 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4ca991ef-6128-4927-b09a-6450108ed84c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:01.814946 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ca991ef-6128-4927-b09a-6450108ed84c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:01.816503 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ca991ef-6128-4927-b09a-6450108ed84c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:01.818595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ca991ef-6128-4927-b09a-6450108ed84c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:01.820907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ca991ef-6128-4927-b09a-6450108ed84c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:01.821637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ca991ef-6128-4927-b09a-6450108ed84c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:01.824208 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ca991ef-6128-4927-b09a-6450108ed84c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:01.965367 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9329541a-f00b-4c87-aa3f-50b4c4ebe0eb tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:01.966499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9329541a-f00b-4c87-aa3f-50b4c4ebe0eb tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] [instance: c91f5223-09be-4180-b1a0-c261e00361fc] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:01.980964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9329541a-f00b-4c87-aa3f-50b4c4ebe0eb tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:01.981631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9329541a-f00b-4c87-aa3f-50b4c4ebe0eb tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:01.982313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9329541a-f00b-4c87-aa3f-50b4c4ebe0eb tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:01.983199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9329541a-f00b-4c87-aa3f-50b4c4ebe0eb tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:01.992887 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9329541a-f00b-4c87-aa3f-50b4c4ebe0eb tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:01.993595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9329541a-f00b-4c87-aa3f-50b4c4ebe0eb tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:02.091302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4ca991ef-6128-4927-b09a-6450108ed84c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:02.100607 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4ca991ef-6128-4927-b09a-6450108ed84c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b" status: 200 len: 1511 microversion: 2.1 time: 0.307632 Aug 04 17:04:02.104564 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1133/2353] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:01 2022] GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b => generated 1511 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:02.134655 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c557dcbb-1df1-4c25-9df7-f4ba3cd86dcc tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5b54baf0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:02.222364 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c557dcbb-1df1-4c25-9df7-f4ba3cd86dcc tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257" status: 200 len: 1452 microversion: 2.1 time: 0.093945 Aug 04 17:04:02.230262 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1134/2354] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:02 2022] GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257 => generated 1452 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:04:02.275003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9329541a-f00b-4c87-aa3f-50b4c4ebe0eb tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df56ffaf1f14046b8a97d219833caf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29204609fba44a4b69c57e2d0f5e581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:02.315054 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9329541a-f00b-4c87-aa3f-50b4c4ebe0eb tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] 10.222.0.93 "GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc" status: 200 len: 1351 microversion: 2.1 time: 0.350476 Aug 04 17:04:02.316061 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1221/2355] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:01 2022] GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc => generated 1351 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:02.352917 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9572c9c8-eb10-4adc-b71a-22ea4e672a94 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:02.353556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9572c9c8-eb10-4adc-b71a-22ea4e672a94 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 30e66be0-1c2b-401d-8e17-1271b1910f4a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:02.370347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9572c9c8-eb10-4adc-b71a-22ea4e672a94 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:02.370858 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9572c9c8-eb10-4adc-b71a-22ea4e672a94 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:02.371305 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9572c9c8-eb10-4adc-b71a-22ea4e672a94 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:02.372468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9572c9c8-eb10-4adc-b71a-22ea4e672a94 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:02.373203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9572c9c8-eb10-4adc-b71a-22ea4e672a94 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:02.374013 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9572c9c8-eb10-4adc-b71a-22ea4e672a94 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:02.539203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9572c9c8-eb10-4adc-b71a-22ea4e672a94 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:02.563271 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9572c9c8-eb10-4adc-b71a-22ea4e672a94 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a" status: 200 len: 1308 microversion: 2.1 time: 0.218942 Aug 04 17:04:02.588517 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1135/2356] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:02 2022] GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a => generated 1308 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:02.721064 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dcb1e785-e21a-4dc0-9c1a-1b75c26f6a15 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:02.721772 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dcb1e785-e21a-4dc0-9c1a-1b75c26f6a15 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:02.728854 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcb1e785-e21a-4dc0-9c1a-1b75c26f6a15 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:02.729660 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcb1e785-e21a-4dc0-9c1a-1b75c26f6a15 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:02.730237 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcb1e785-e21a-4dc0-9c1a-1b75c26f6a15 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:02.730949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcb1e785-e21a-4dc0-9c1a-1b75c26f6a15 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:02.731576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcb1e785-e21a-4dc0-9c1a-1b75c26f6a15 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:02.732002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcb1e785-e21a-4dc0-9c1a-1b75c26f6a15 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:02.736495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:02.768041 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcb1e785-e21a-4dc0-9c1a-1b75c26f6a15 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:02.768738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcb1e785-e21a-4dc0-9c1a-1b75c26f6a15 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:02.769337 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcb1e785-e21a-4dc0-9c1a-1b75c26f6a15 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:02.769955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-dcb1e785-e21a-4dc0-9c1a-1b75c26f6a15 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lazy-loading 'fault' on Instance uuid 98e4458d-d7e4-4663-a974-70ccbe5501f3 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:04:02.814078 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dcb1e785-e21a-4dc0-9c1a-1b75c26f6a15 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:02.822599 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dcb1e785-e21a-4dc0-9c1a-1b75c26f6a15 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:02.824174 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dcb1e785-e21a-4dc0-9c1a-1b75c26f6a15 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:02.825351 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dcb1e785-e21a-4dc0-9c1a-1b75c26f6a15 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3" status: 200 len: 1351 microversion: 2.25 time: 0.108993 Aug 04 17:04:02.826189 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1222/2357] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:04:02 2022] GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 => generated 1351 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:04:03.055359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-c00a7b64-a0bf-4ac4-a595-a0d42a2635c1 req-fc4331ef-86b4-4832-8491-ba0afb4b68b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30e66be0-1c2b-401d-8e17-1271b1910f4a", "tag": "93b8fa03-1f37-431c-b87c-431cafd2680c"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:03.066992 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c00a7b64-a0bf-4ac4-a595-a0d42a2635c1 req-fc4331ef-86b4-4832-8491-ba0afb4b68b0 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:03.067682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c00a7b64-a0bf-4ac4-a595-a0d42a2635c1 req-fc4331ef-86b4-4832-8491-ba0afb4b68b0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:03.068265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c00a7b64-a0bf-4ac4-a595-a0d42a2635c1 req-fc4331ef-86b4-4832-8491-ba0afb4b68b0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:03.079780 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-c00a7b64-a0bf-4ac4-a595-a0d42a2635c1 req-fc4331ef-86b4-4832-8491-ba0afb4b68b0 service nova] Creating event network-changed:93b8fa03-1f37-431c-b87c-431cafd2680c for instance 30e66be0-1c2b-401d-8e17-1271b1910f4a on n-h2-851359-3 Aug 04 17:04:03.085305 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-c00a7b64-a0bf-4ac4-a595-a0d42a2635c1 req-fc4331ef-86b4-4832-8491-ba0afb4b68b0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033551 Aug 04 17:04:03.086377 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1136/2358] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:03.127730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-710c331b-0cd4-4213-b7ce-c108f1f6368c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:03.128478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-710c331b-0cd4-4213-b7ce-c108f1f6368c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:03.141205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-710c331b-0cd4-4213-b7ce-c108f1f6368c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:03.141712 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-710c331b-0cd4-4213-b7ce-c108f1f6368c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:03.145719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-710c331b-0cd4-4213-b7ce-c108f1f6368c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:03.146518 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-710c331b-0cd4-4213-b7ce-c108f1f6368c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:03.147668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-710c331b-0cd4-4213-b7ce-c108f1f6368c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:03.148670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-710c331b-0cd4-4213-b7ce-c108f1f6368c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:03.226521 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-50bca475-af82-4c11-b1e3-3d43735b6f48 req-13eb6716-34b2-4df6-b91f-fd54ffbea8ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba09cec5-a546-4fe5-90df-c90d94591fb2", "name": "network-vif-plugged", "status": "completed", "tag": "14919ddc-0463-47b2-9b85-fd575b876018"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:03.243838 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-50bca475-af82-4c11-b1e3-3d43735b6f48 req-13eb6716-34b2-4df6-b91f-fd54ffbea8ed service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:03.245220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-50bca475-af82-4c11-b1e3-3d43735b6f48 req-13eb6716-34b2-4df6-b91f-fd54ffbea8ed service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:03.246225 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-50bca475-af82-4c11-b1e3-3d43735b6f48 req-13eb6716-34b2-4df6-b91f-fd54ffbea8ed service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:03.263175 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-50bca475-af82-4c11-b1e3-3d43735b6f48 req-13eb6716-34b2-4df6-b91f-fd54ffbea8ed service nova] Creating event network-vif-plugged:14919ddc-0463-47b2-9b85-fd575b876018 for instance ba09cec5-a546-4fe5-90df-c90d94591fb2 on n-h1-851359-3 Aug 04 17:04:03.269330 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-50bca475-af82-4c11-b1e3-3d43735b6f48 req-13eb6716-34b2-4df6-b91f-fd54ffbea8ed service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046767 Aug 04 17:04:03.270509 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1137/2359] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:04:03.277131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7beeff57-d78e-4a0c-a808-436878a43c4c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e6c9b89d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:03.330357 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7beeff57-d78e-4a0c-a808-436878a43c4c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257" status: 200 len: 1452 microversion: 2.1 time: 0.057938 Aug 04 17:04:03.331457 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1138/2360] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:03 2022] GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257 => generated 1452 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:03.336711 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6f5d44d7-bfe3-4d21-a950-761dcbcdbfa0 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:03.337606 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6f5d44d7-bfe3-4d21-a950-761dcbcdbfa0 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] [instance: c91f5223-09be-4180-b1a0-c261e00361fc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:03.344398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f5d44d7-bfe3-4d21-a950-761dcbcdbfa0 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:03.345818 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f5d44d7-bfe3-4d21-a950-761dcbcdbfa0 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:03.346481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f5d44d7-bfe3-4d21-a950-761dcbcdbfa0 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:03.347350 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f5d44d7-bfe3-4d21-a950-761dcbcdbfa0 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:03.348117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f5d44d7-bfe3-4d21-a950-761dcbcdbfa0 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:03.348928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f5d44d7-bfe3-4d21-a950-761dcbcdbfa0 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:03.551833 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-710c331b-0cd4-4213-b7ce-c108f1f6368c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:03.559531 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-710c331b-0cd4-4213-b7ce-c108f1f6368c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b" status: 200 len: 1511 microversion: 2.1 time: 0.438689 Aug 04 17:04:03.560384 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1223/2361] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:03 2022] GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b => generated 1511 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:03.590118 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-af5fcb4c-d487-4cf2-a024-364b8e83b5f0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:03.590942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-af5fcb4c-d487-4cf2-a024-364b8e83b5f0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 30e66be0-1c2b-401d-8e17-1271b1910f4a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:03.598089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af5fcb4c-d487-4cf2-a024-364b8e83b5f0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:03.598792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af5fcb4c-d487-4cf2-a024-364b8e83b5f0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:03.599232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af5fcb4c-d487-4cf2-a024-364b8e83b5f0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:03.600080 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af5fcb4c-d487-4cf2-a024-364b8e83b5f0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:03.600532 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af5fcb4c-d487-4cf2-a024-364b8e83b5f0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:03.600958 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af5fcb4c-d487-4cf2-a024-364b8e83b5f0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:03.629461 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6f5d44d7-bfe3-4d21-a950-761dcbcdbfa0 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df56ffaf1f14046b8a97d219833caf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29204609fba44a4b69c57e2d0f5e581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:03.637501 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6f5d44d7-bfe3-4d21-a950-761dcbcdbfa0 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] 10.222.0.93 "GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc" status: 200 len: 1351 microversion: 2.1 time: 0.304676 Aug 04 17:04:03.638102 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1139/2362] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:03 2022] GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc => generated 1351 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:03.764261 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-85e73820-95fe-4194-95c9-19ea6f24cfa0 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Action: 'update', calling method: .version_select at 0x7f1e6c9b8af0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:03.767705 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:04:03.767705 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 17:04:03.769420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85e73820-95fe-4194-95c9-19ea6f24cfa0 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:03.769926 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85e73820-95fe-4194-95c9-19ea6f24cfa0 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:03.770399 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85e73820-95fe-4194-95c9-19ea6f24cfa0 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:03.778126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85e73820-95fe-4194-95c9-19ea6f24cfa0 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:03.778604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85e73820-95fe-4194-95c9-19ea6f24cfa0 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:03.779049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85e73820-95fe-4194-95c9-19ea6f24cfa0 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:03.787587 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-85e73820-95fe-4194-95c9-19ea6f24cfa0 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] HTTP exception thrown: Service 437f11cf-2e56-4583-bff2-5c28666da59a could not be found. Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-85e73820-95fe-4194-95c9-19ea6f24cfa0 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Request method failure captured: Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: request: PUT /compute/v2.1/os-services/437f11cf-2e56-4583-bff2-5c28666da59a HTTP/1.1 Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 56 Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_wDpXcscubtt6zKkgVWNOUW-Ae16ceQtmOa8wPb131JF84tYN-IZ7I4Zpddmgp45-3cKQogmPaNDpz7fVwDTeEMm2fvm9i7WVM0qz82pZ573cc-wvXDEwR5Jk8CGI7iy7k8ezpiCrLyXvNzOP0N8dCX2J7vGpqYJjoCO_pdiXvvd_U Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.53 Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: d277c017b2764a67b61778b53a73bd5c Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-299197400 Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: X-Role: admin,member,reader Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: admin,member,reader Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d277c017b2764a67b61778b53a73bd5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d277c017b2764a67b61778b53a73bd5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d277c017b2764a67b61778b53a73bd5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d277c017b2764a67b61778b53a73bd5c"}]}] Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-299197400 Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: d277c017b2764a67b61778b53a73bd5c Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-299197400 Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: abd581308de2481a89212321a66c90d9 Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: exception: Service 437f11cf-2e56-4583-bff2-5c28666da59a could not be found. Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '437f11cf-2e56-4583-bff2-5c28666da59a', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 437f11cf-2e56-4583-bff2-5c28666da59a could not be found. Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:04:03.789394 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:04:03.794043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 04 17:04:03.794043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:04:03.794043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 437f11cf-2e56-4583-bff2-5c28666da59a could not be found. Aug 04 17:04:03.794043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:03.794043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:03.794043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:03.794043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:03.794043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:03.794043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:03.794043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:04:03.794043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:04:03.794043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 437f11cf-2e56-4583-bff2-5c28666da59a could not be found. Aug 04 17:04:03.794043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:03.794043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-85e73820-95fe-4194-95c9-19ea6f24cfa0 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Returning 404 to user: Service 437f11cf-2e56-4583-bff2-5c28666da59a could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:04:03.794043 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-85e73820-95fe-4194-95c9-19ea6f24cfa0 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-services/437f11cf-2e56-4583-bff2-5c28666da59a" status: 404 len: 110 microversion: 2.53 time: 0.147879 Aug 04 17:04:03.794043 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1140/2363] 10.222.0.93 () {62 vars in 1309 bytes} [Thu Aug 4 17:04:03 2022] PUT /compute/v2.1/os-services/437f11cf-2e56-4583-bff2-5c28666da59a => generated 110 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:04:03.800227 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c95d1881-7711-4375-9e20-38ea506647a1 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Action: 'update', calling method: .version_select at 0x7f1e5b54b280>, body: {"status": "disabled"} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:03.803792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c95d1881-7711-4375-9e20-38ea506647a1 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:03.804286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c95d1881-7711-4375-9e20-38ea506647a1 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:03.804730 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c95d1881-7711-4375-9e20-38ea506647a1 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:03.810541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c95d1881-7711-4375-9e20-38ea506647a1 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:03.811016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c95d1881-7711-4375-9e20-38ea506647a1 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:03.811457 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c95d1881-7711-4375-9e20-38ea506647a1 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:03.816749 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-c95d1881-7711-4375-9e20-38ea506647a1 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] HTTP exception thrown: Service 437f11cf-2e56-4583-bff2-5c28666da59a could not be found. Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c95d1881-7711-4375-9e20-38ea506647a1 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Request method failure captured: Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: request: PUT /compute/v2.1/os-services/437f11cf-2e56-4583-bff2-5c28666da59a HTTP/1.1 Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 22 Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_wDpXcscubtt6zKkgVWNOUW-Ae16ceQtmOa8wPb131JF84tYN-IZ7I4Zpddmgp45-3cKQogmPaNDpz7fVwDTeEMm2fvm9i7WVM0qz82pZ573cc-wvXDEwR5Jk8CGI7iy7k8ezpiCrLyXvNzOP0N8dCX2J7vGpqYJjoCO_pdiXvvd_U Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.53 Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: d277c017b2764a67b61778b53a73bd5c Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-299197400 Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: X-Role: admin,member,reader Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: admin,member,reader Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d277c017b2764a67b61778b53a73bd5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d277c017b2764a67b61778b53a73bd5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d277c017b2764a67b61778b53a73bd5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d277c017b2764a67b61778b53a73bd5c"}]}] Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-299197400 Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: d277c017b2764a67b61778b53a73bd5c Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-299197400 Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: abd581308de2481a89212321a66c90d9 Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: {"status": "disabled"} Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: exception: Service 437f11cf-2e56-4583-bff2-5c28666da59a could not be found. Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '437f11cf-2e56-4583-bff2-5c28666da59a', 'body': {'status': 'disabled'}} Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 437f11cf-2e56-4583-bff2-5c28666da59a could not be found. Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:04:03.818423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:04:03.822958 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 04 17:04:03.822958 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:04:03.822958 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 437f11cf-2e56-4583-bff2-5c28666da59a could not be found. Aug 04 17:04:03.822958 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:03.822958 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:03.822958 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:03.822958 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:03.822958 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:03.822958 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:03.822958 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:04:03.822958 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:04:03.822958 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 437f11cf-2e56-4583-bff2-5c28666da59a could not be found. Aug 04 17:04:03.822958 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:03.822958 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c95d1881-7711-4375-9e20-38ea506647a1 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Returning 404 to user: Service 437f11cf-2e56-4583-bff2-5c28666da59a could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:04:03.822958 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c95d1881-7711-4375-9e20-38ea506647a1 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-services/437f11cf-2e56-4583-bff2-5c28666da59a" status: 404 len: 110 microversion: 2.53 time: 0.023251 Aug 04 17:04:03.824585 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1141/2364] 10.222.0.93 () {62 vars in 1309 bytes} [Thu Aug 4 17:04:03 2022] PUT /compute/v2.1/os-services/437f11cf-2e56-4583-bff2-5c28666da59a => generated 110 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 04 17:04:03.829606 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-57a2ce3e-9337-416b-8e4c-d69c1e11d936 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Action: 'update', calling method: .version_select at 0x7f1e6c9a25e0>, body: {"status": "enabled"} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:03.834097 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57a2ce3e-9337-416b-8e4c-d69c1e11d936 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:03.834601 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57a2ce3e-9337-416b-8e4c-d69c1e11d936 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:03.835047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57a2ce3e-9337-416b-8e4c-d69c1e11d936 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:03.835504 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-af5fcb4c-d487-4cf2-a024-364b8e83b5f0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:03.841669 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57a2ce3e-9337-416b-8e4c-d69c1e11d936 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:03.842219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57a2ce3e-9337-416b-8e4c-d69c1e11d936 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:03.843098 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57a2ce3e-9337-416b-8e4c-d69c1e11d936 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:03.848259 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-af5fcb4c-d487-4cf2-a024-364b8e83b5f0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a" status: 200 len: 1308 microversion: 2.1 time: 0.262049 Aug 04 17:04:03.848858 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1224/2365] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:03 2022] GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a => generated 1308 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:04:03.850129 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-57a2ce3e-9337-416b-8e4c-d69c1e11d936 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] HTTP exception thrown: Service 437f11cf-2e56-4583-bff2-5c28666da59a could not be found. Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-57a2ce3e-9337-416b-8e4c-d69c1e11d936 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Request method failure captured: Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: request: PUT /compute/v2.1/os-services/437f11cf-2e56-4583-bff2-5c28666da59a HTTP/1.1 Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 21 Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_wDpXcscubtt6zKkgVWNOUW-Ae16ceQtmOa8wPb131JF84tYN-IZ7I4Zpddmgp45-3cKQogmPaNDpz7fVwDTeEMm2fvm9i7WVM0qz82pZ573cc-wvXDEwR5Jk8CGI7iy7k8ezpiCrLyXvNzOP0N8dCX2J7vGpqYJjoCO_pdiXvvd_U Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.53 Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: d277c017b2764a67b61778b53a73bd5c Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-299197400 Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: X-Role: admin,member,reader Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: admin,member,reader Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d277c017b2764a67b61778b53a73bd5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d277c017b2764a67b61778b53a73bd5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d277c017b2764a67b61778b53a73bd5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d277c017b2764a67b61778b53a73bd5c"}]}] Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-299197400 Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: d277c017b2764a67b61778b53a73bd5c Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-299197400 Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: abd581308de2481a89212321a66c90d9 Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: {"status": "enabled"} Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: exception: Service 437f11cf-2e56-4583-bff2-5c28666da59a could not be found. Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '437f11cf-2e56-4583-bff2-5c28666da59a', 'body': {'status': 'enabled'}} Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 437f11cf-2e56-4583-bff2-5c28666da59a could not be found. Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:04:03.852076 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:04:03.856208 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 04 17:04:03.856208 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:04:03.856208 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 437f11cf-2e56-4583-bff2-5c28666da59a could not be found. Aug 04 17:04:03.856208 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:03.856208 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:03.856208 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:03.856208 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:03.856208 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:03.856208 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:03.856208 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:04:03.856208 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:04:03.856208 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 437f11cf-2e56-4583-bff2-5c28666da59a could not be found. Aug 04 17:04:03.856208 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:03.857675 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-57a2ce3e-9337-416b-8e4c-d69c1e11d936 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Returning 404 to user: Service 437f11cf-2e56-4583-bff2-5c28666da59a could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:04:03.858705 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-57a2ce3e-9337-416b-8e4c-d69c1e11d936 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-services/437f11cf-2e56-4583-bff2-5c28666da59a" status: 404 len: 110 microversion: 2.53 time: 0.033160 Aug 04 17:04:03.863197 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ae55bf16-7b3a-44f5-8d33-adb78e27f3db tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:03.863197 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ae55bf16-7b3a-44f5-8d33-adb78e27f3db tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:03.863615 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1142/2366] 10.222.0.93 () {62 vars in 1309 bytes} [Thu Aug 4 17:04:03 2022] PUT /compute/v2.1/os-services/437f11cf-2e56-4583-bff2-5c28666da59a => generated 110 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:04:03.868399 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b21d0c09-b9cf-4184-9e72-bd9b3ac0a74c tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:03.871134 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:04:03.871134 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 17:04:03.872647 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b21d0c09-b9cf-4184-9e72-bd9b3ac0a74c tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:03.873354 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b21d0c09-b9cf-4184-9e72-bd9b3ac0a74c tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:03.874062 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b21d0c09-b9cf-4184-9e72-bd9b3ac0a74c tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:03.874380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae55bf16-7b3a-44f5-8d33-adb78e27f3db tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:03.874897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae55bf16-7b3a-44f5-8d33-adb78e27f3db tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:03.875347 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae55bf16-7b3a-44f5-8d33-adb78e27f3db tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:03.875747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b21d0c09-b9cf-4184-9e72-bd9b3ac0a74c tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:03.876066 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae55bf16-7b3a-44f5-8d33-adb78e27f3db tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:03.877089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae55bf16-7b3a-44f5-8d33-adb78e27f3db tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:03.877395 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b21d0c09-b9cf-4184-9e72-bd9b3ac0a74c tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:03.877505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae55bf16-7b3a-44f5-8d33-adb78e27f3db tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:03.878161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b21d0c09-b9cf-4184-9e72-bd9b3ac0a74c tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:03.895483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:03.909029 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b21d0c09-b9cf-4184-9e72-bd9b3ac0a74c tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.044282 Aug 04 17:04:03.909650 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1143/2367] 10.222.0.93 () {60 vars in 1178 bytes} [Thu Aug 4 17:04:03 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:04:03.923732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-86a1af70-78b5-4534-a5a8-287acf20687b tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:03.926822 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:04:03.926822 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 17:04:03.927822 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86a1af70-78b5-4534-a5a8-287acf20687b tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:03.928566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86a1af70-78b5-4534-a5a8-287acf20687b tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:03.928761 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86a1af70-78b5-4534-a5a8-287acf20687b tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:03.929686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86a1af70-78b5-4534-a5a8-287acf20687b tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:03.930360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86a1af70-78b5-4534-a5a8-287acf20687b tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:03.930949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86a1af70-78b5-4534-a5a8-287acf20687b tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:03.953174 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae55bf16-7b3a-44f5-8d33-adb78e27f3db tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:03.953921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae55bf16-7b3a-44f5-8d33-adb78e27f3db tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:03.954671 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae55bf16-7b3a-44f5-8d33-adb78e27f3db tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:03.955790 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-ae55bf16-7b3a-44f5-8d33-adb78e27f3db tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lazy-loading 'fault' on Instance uuid 98e4458d-d7e4-4663-a974-70ccbe5501f3 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:04:03.966480 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-86a1af70-78b5-4534-a5a8-287acf20687b tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.047448 Aug 04 17:04:03.976042 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1144/2368] 10.222.0.93 () {60 vars in 1211 bytes} [Thu Aug 4 17:04:03 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:04:03.982151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6e78d4be-0a26-46b3-b9fd-fa742c67a763 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:03.985213 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:04:03.985213 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 17:04:03.987347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e78d4be-0a26-46b3-b9fd-fa742c67a763 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:03.987855 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e78d4be-0a26-46b3-b9fd-fa742c67a763 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:03.988308 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e78d4be-0a26-46b3-b9fd-fa742c67a763 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:03.989073 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e78d4be-0a26-46b3-b9fd-fa742c67a763 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:03.989552 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e78d4be-0a26-46b3-b9fd-fa742c67a763 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:03.990023 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e78d4be-0a26-46b3-b9fd-fa742c67a763 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:04.016464 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6e78d4be-0a26-46b3-b9fd-fa742c67a763 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.037908 Aug 04 17:04:04.023749 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1145/2369] 10.222.0.93 () {60 vars in 1178 bytes} [Thu Aug 4 17:04:03 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:04:04.028608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-566a55af-825a-4fd4-b6cc-e12a0b2302a8 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:04.031225 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:04:04.031225 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 17:04:04.032373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-566a55af-825a-4fd4-b6cc-e12a0b2302a8 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:04.033363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-566a55af-825a-4fd4-b6cc-e12a0b2302a8 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:04.033809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-566a55af-825a-4fd4-b6cc-e12a0b2302a8 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:04.034589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-566a55af-825a-4fd4-b6cc-e12a0b2302a8 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:04.035053 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-566a55af-825a-4fd4-b6cc-e12a0b2302a8 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:04.035484 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-566a55af-825a-4fd4-b6cc-e12a0b2302a8 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:04.052976 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ae55bf16-7b3a-44f5-8d33-adb78e27f3db tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:04.060550 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-566a55af-825a-4fd4-b6cc-e12a0b2302a8 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?host=n-d-851359-3&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.035486 Aug 04 17:04:04.061997 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1146/2370] 10.222.0.93 () {60 vars in 1235 bytes} [Thu Aug 4 17:04:04 2022] GET /compute/v2.1/os-services?host=n-d-851359-3&binary=xxx => generated 16 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:04:04.063405 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ae55bf16-7b3a-44f5-8d33-adb78e27f3db tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:04.065745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ae55bf16-7b3a-44f5-8d33-adb78e27f3db tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0e0f6e799384863af2222416f070c84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e457894e070145348859f44a6a3e8ed6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:04.067853 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ae55bf16-7b3a-44f5-8d33-adb78e27f3db tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3" status: 200 len: 1351 microversion: 2.25 time: 0.218058 Aug 04 17:04:04.068940 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1225/2371] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:04:03 2022] GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 => generated 1351 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:04:04.073264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-030862ac-a6a7-40f6-aa10-d253d29d10df tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:04.075811 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:04:04.075811 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 17:04:04.077077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-030862ac-a6a7-40f6-aa10-d253d29d10df tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:04.077641 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-030862ac-a6a7-40f6-aa10-d253d29d10df tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:04.078201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-030862ac-a6a7-40f6-aa10-d253d29d10df tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:04.079018 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-030862ac-a6a7-40f6-aa10-d253d29d10df tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:04.079712 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-030862ac-a6a7-40f6-aa10-d253d29d10df tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:04.080112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-030862ac-a6a7-40f6-aa10-d253d29d10df tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:04.108794 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-030862ac-a6a7-40f6-aa10-d253d29d10df tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.038468 Aug 04 17:04:04.108794 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1147/2372] 10.222.0.93 () {60 vars in 1178 bytes} [Thu Aug 4 17:04:04 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:04:04.123665 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c74023a0-43e6-472a-b04a-c9226fe59671 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:04.127454 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:04:04.127454 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 17:04:04.129098 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c74023a0-43e6-472a-b04a-c9226fe59671 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:04.129606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c74023a0-43e6-472a-b04a-c9226fe59671 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:04.130079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c74023a0-43e6-472a-b04a-c9226fe59671 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:04.130828 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c74023a0-43e6-472a-b04a-c9226fe59671 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:04.131294 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c74023a0-43e6-472a-b04a-c9226fe59671 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:04.131909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c74023a0-43e6-472a-b04a-c9226fe59671 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:04.150659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:04.159812 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c74023a0-43e6-472a-b04a-c9226fe59671 tempest-ServicesAdminNegativeV253TestJSON-299197400 tempest-ServicesAdminNegativeV253TestJSON-299197400-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.040053 Aug 04 17:04:04.160420 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1226/2373] 10.222.0.93 () {60 vars in 1239 bytes} [Thu Aug 4 17:04:04 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:04.269499 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0b6e0082-04bb-4fd8-b7aa-d4dc35276437 tempest-ServicesAdminNegativeV253TestJSON-2109789589 tempest-ServicesAdminNegativeV253TestJSON-2109789589-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:04.271847 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:04:04.271847 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 17:04:04.272974 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0b6e0082-04bb-4fd8-b7aa-d4dc35276437 tempest-ServicesAdminNegativeV253TestJSON-2109789589 tempest-ServicesAdminNegativeV253TestJSON-2109789589-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '276f79b9dfd742009c6d1adeeecf59ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae0d3f02da04289baf270607847c184', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0b6e0082-04bb-4fd8-b7aa-d4dc35276437 tempest-ServicesAdminNegativeV253TestJSON-2109789589 tempest-ServicesAdminNegativeV253TestJSON-2109789589-project] Request method failure captured: Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_wCaPSiRA1LwmMdqj7v5dESXhG5K0YFHUPgPJ0i0NwTMUL9MjVr_p_kAvhAHbB_adpFjvIfG1GPsufcVhIaAnR5nl9PqsuqxdnygnS1PG4VPnwolqJ8VtJtiLZ7Hq5Bz-I96VfWEo8IZ9a6CUKQ-TnggxiUeufPrvDuytQekF7GUFQ Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.53 Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 7ae0d3f02da04289baf270607847c184 Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2109789589 Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7ae0d3f02da04289baf270607847c184"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7ae0d3f02da04289baf270607847c184"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_7ae0d3f02da04289baf270607847c184"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/7ae0d3f02da04289baf270607847c184"}]}] Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2109789589 Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 7ae0d3f02da04289baf270607847c184 Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2109789589 Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2109789589-project Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 276f79b9dfd742009c6d1adeeecf59ba Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2109789589-project Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: action_args: {} Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 17:04:04.274596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 04 17:04:04.279049 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:04.279049 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:04.279049 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:04.279049 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:04.279049 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:04.279049 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:04.279049 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 17:04:04.279049 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 17:04:04.279049 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 04 17:04:04.279049 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:04.279049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0b6e0082-04bb-4fd8-b7aa-d4dc35276437 tempest-ServicesAdminNegativeV253TestJSON-2109789589 tempest-ServicesAdminNegativeV253TestJSON-2109789589-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:04:04.279049 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0b6e0082-04bb-4fd8-b7aa-d4dc35276437 tempest-ServicesAdminNegativeV253TestJSON-2109789589 tempest-ServicesAdminNegativeV253TestJSON-2109789589-project] 10.222.0.93 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.107603 Aug 04 17:04:04.279049 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1148/2374] 10.222.0.93 () {60 vars in 1178 bytes} [Thu Aug 4 17:04:04 2022] GET /compute/v2.1/os-services => generated 112 bytes in 109 msecs (HTTP/1.1 403) 9 headers in 381 bytes (2 switches on core 0) Aug 04 17:04:04.354955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2962300b-1c52-4c31-8d28-79752e22dbeb tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5af4c940>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:04.423885 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2962300b-1c52-4c31-8d28-79752e22dbeb tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257" status: 200 len: 1452 microversion: 2.1 time: 0.082286 Aug 04 17:04:04.434010 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1227/2375] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:04 2022] GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257 => generated 1452 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:04.583728 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b059f6db-029f-4ed4-b61c-2ae4fee3f3e1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:04.584370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b059f6db-029f-4ed4-b61c-2ae4fee3f3e1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:04.598538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b059f6db-029f-4ed4-b61c-2ae4fee3f3e1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:04.599266 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b059f6db-029f-4ed4-b61c-2ae4fee3f3e1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:04.599863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b059f6db-029f-4ed4-b61c-2ae4fee3f3e1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:04.600741 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b059f6db-029f-4ed4-b61c-2ae4fee3f3e1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:04.604662 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b059f6db-029f-4ed4-b61c-2ae4fee3f3e1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:04.605116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b059f6db-029f-4ed4-b61c-2ae4fee3f3e1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:04.659089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ca78180e-5cb4-49d1-b672-e4c26e98648e tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:04.659924 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ca78180e-5cb4-49d1-b672-e4c26e98648e tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] [instance: c91f5223-09be-4180-b1a0-c261e00361fc] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:04.666755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca78180e-5cb4-49d1-b672-e4c26e98648e tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:04.667526 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca78180e-5cb4-49d1-b672-e4c26e98648e tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:04.668133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca78180e-5cb4-49d1-b672-e4c26e98648e tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:04.669177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca78180e-5cb4-49d1-b672-e4c26e98648e tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:04.669810 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca78180e-5cb4-49d1-b672-e4c26e98648e tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:04.670425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca78180e-5cb4-49d1-b672-e4c26e98648e tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:04.836733 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=14 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:05.181729 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b059f6db-029f-4ed4-b61c-2ae4fee3f3e1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:05.191502 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b059f6db-029f-4ed4-b61c-2ae4fee3f3e1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b" status: 200 len: 1511 microversion: 2.1 time: 0.614436 Aug 04 17:04:05.207056 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1149/2376] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:04 2022] GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b => generated 1511 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:05.212508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-af1c9dbb-75af-45b7-a5fe-79d1e83beeb0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:05.213319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-af1c9dbb-75af-45b7-a5fe-79d1e83beeb0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 30e66be0-1c2b-401d-8e17-1271b1910f4a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:05.220066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-af1c9dbb-75af-45b7-a5fe-79d1e83beeb0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:05.221130 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-af1c9dbb-75af-45b7-a5fe-79d1e83beeb0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:05.221956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-af1c9dbb-75af-45b7-a5fe-79d1e83beeb0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:05.223164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-af1c9dbb-75af-45b7-a5fe-79d1e83beeb0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:05.223946 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-af1c9dbb-75af-45b7-a5fe-79d1e83beeb0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:05.224556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-af1c9dbb-75af-45b7-a5fe-79d1e83beeb0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:05.429566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ca78180e-5cb4-49d1-b672-e4c26e98648e tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df56ffaf1f14046b8a97d219833caf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29204609fba44a4b69c57e2d0f5e581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:05.443949 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ca78180e-5cb4-49d1-b672-e4c26e98648e tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] 10.222.0.93 "GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc" status: 200 len: 1351 microversion: 2.1 time: 0.789599 Aug 04 17:04:05.444687 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1228/2377] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:04 2022] GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc => generated 1351 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:05.472018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4f44d58b-a3f1-41cc-959e-268fbebf9791 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:05.473726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4f44d58b-a3f1-41cc-959e-268fbebf9791 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] [instance: 98e4458d-d7e4-4663-a974-70ccbe5501f3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:05.518657 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f44d58b-a3f1-41cc-959e-268fbebf9791 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:05.521252 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f44d58b-a3f1-41cc-959e-268fbebf9791 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:05.521993 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f44d58b-a3f1-41cc-959e-268fbebf9791 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:05.523150 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f44d58b-a3f1-41cc-959e-268fbebf9791 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:05.524615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f44d58b-a3f1-41cc-959e-268fbebf9791 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:05.525292 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f44d58b-a3f1-41cc-959e-268fbebf9791 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:05.546299 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-4f44d58b-a3f1-41cc-959e-268fbebf9791 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] HTTP exception thrown: Instance 98e4458d-d7e4-4663-a974-70ccbe5501f3 could not be found. Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4f44d58b-a3f1-41cc-959e-268fbebf9791 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Request method failure captured: Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 HTTP/1.1 Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_pXlwUhhhM_d03666MBri4F66KYuzI-tT_44Q_uVp3yoZZcQlN-j61rkAZzwmwW4tSKuQH258YusxcVfdu_QDCUhoCbzi0tpJLDDBqkC799acQ0ABeNQ8x9blh_NUOKP-2Fn47qeOsKKyHkb_AGeMLzK1T3WAwYCm04XKXRWS0V3w8 Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: X-Openstack-Nova-Api-Version: 2.25 Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: e457894e070145348859f44a6a3e8ed6 Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-653155874 Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e457894e070145348859f44a6a3e8ed6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e457894e070145348859f44a6a3e8ed6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e457894e070145348859f44a6a3e8ed6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e457894e070145348859f44a6a3e8ed6"}]}] Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-653155874 Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: e457894e070145348859f44a6a3e8ed6 Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-653155874 Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-LiveAutoBlockMigrationV225Test-653155874-project Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: d0e0f6e799384863af2222416f070c84 Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-653155874-project Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 98e4458d-d7e4-4663-a974-70ccbe5501f3 could not be found. Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '98e4458d-d7e4-4663-a974-70ccbe5501f3'} Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98e4458d-d7e4-4663-a974-70ccbe5501f3 could not be found. Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98e4458d-d7e4-4663-a974-70ccbe5501f3 could not be found. Aug 04 17:04:05.548338 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:05.552351 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:05.552351 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:05.552351 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:05.552351 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:05.552351 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:05.552351 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:04:05.552351 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:04:05.552351 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98e4458d-d7e4-4663-a974-70ccbe5501f3 could not be found. Aug 04 17:04:05.552351 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:05.552914 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4f44d58b-a3f1-41cc-959e-268fbebf9791 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] Returning 404 to user: Instance 98e4458d-d7e4-4663-a974-70ccbe5501f3 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:04:05.554384 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4f44d58b-a3f1-41cc-959e-268fbebf9791 tempest-LiveAutoBlockMigrationV225Test-653155874 tempest-LiveAutoBlockMigrationV225Test-653155874-project] 10.222.0.93 "GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3" status: 404 len: 111 microversion: 2.25 time: 0.107915 Aug 04 17:04:05.555570 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1229/2378] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:04:05 2022] GET /compute/v2.1/servers/98e4458d-d7e4-4663-a974-70ccbe5501f3 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:04:05.562689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ea89683e-dee6-4a32-ab74-d31cb60c4ba4 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5b0183a0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:05.652826 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ea89683e-dee6-4a32-ab74-d31cb60c4ba4 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257" status: 200 len: 1452 microversion: 2.1 time: 0.095878 Aug 04 17:04:05.664034 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1230/2379] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:05 2022] GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257 => generated 1452 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:05.673369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-af1c9dbb-75af-45b7-a5fe-79d1e83beeb0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:05.688142 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-af1c9dbb-75af-45b7-a5fe-79d1e83beeb0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a" status: 200 len: 1308 microversion: 2.1 time: 0.479696 Aug 04 17:04:05.689520 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1150/2380] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:05 2022] GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a => generated 1308 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:06.215946 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e23a368d-cc8c-4ede-b7a6-e3e261e93389 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:06.217032 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e23a368d-cc8c-4ede-b7a6-e3e261e93389 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:06.225021 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e23a368d-cc8c-4ede-b7a6-e3e261e93389 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:06.225970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e23a368d-cc8c-4ede-b7a6-e3e261e93389 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:06.228586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e23a368d-cc8c-4ede-b7a6-e3e261e93389 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:06.229810 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e23a368d-cc8c-4ede-b7a6-e3e261e93389 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:06.230542 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e23a368d-cc8c-4ede-b7a6-e3e261e93389 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:06.231297 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e23a368d-cc8c-4ede-b7a6-e3e261e93389 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:06.466811 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6858032d-362e-4849-82a0-001655b4bb9e tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:06.467721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6858032d-362e-4849-82a0-001655b4bb9e tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] [instance: c91f5223-09be-4180-b1a0-c261e00361fc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:06.474474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6858032d-362e-4849-82a0-001655b4bb9e tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:06.475034 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6858032d-362e-4849-82a0-001655b4bb9e tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:06.475694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6858032d-362e-4849-82a0-001655b4bb9e tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:06.476612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6858032d-362e-4849-82a0-001655b4bb9e tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:06.477141 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6858032d-362e-4849-82a0-001655b4bb9e tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:06.477664 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6858032d-362e-4849-82a0-001655b4bb9e tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:06.566102 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e23a368d-cc8c-4ede-b7a6-e3e261e93389 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:06.576301 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e23a368d-cc8c-4ede-b7a6-e3e261e93389 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b" status: 200 len: 1511 microversion: 2.1 time: 0.366585 Aug 04 17:04:06.595066 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1231/2381] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:06 2022] GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b => generated 1511 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:06.685549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-52e6aaf5-373d-4ccb-a7e9-ae8a3747c446 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5adcc940>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:06.771606 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-52e6aaf5-373d-4ccb-a7e9-ae8a3747c446 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257" status: 200 len: 1452 microversion: 2.1 time: 0.104232 Aug 04 17:04:06.772199 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1232/2382] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:06 2022] GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257 => generated 1452 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:06.786392 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6858032d-362e-4849-82a0-001655b4bb9e tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df56ffaf1f14046b8a97d219833caf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29204609fba44a4b69c57e2d0f5e581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:06.798763 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6858032d-362e-4849-82a0-001655b4bb9e tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] 10.222.0.93 "GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc" status: 200 len: 1351 microversion: 2.1 time: 0.336005 Aug 04 17:04:06.802953 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b6e5483a-08f1-4231-a463-1b6609981f36 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:06.803841 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1151/2383] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:06 2022] GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc => generated 1351 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:06.804842 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b6e5483a-08f1-4231-a463-1b6609981f36 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 30e66be0-1c2b-401d-8e17-1271b1910f4a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:06.813349 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6e5483a-08f1-4231-a463-1b6609981f36 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:06.815274 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6e5483a-08f1-4231-a463-1b6609981f36 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:06.815935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6e5483a-08f1-4231-a463-1b6609981f36 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:06.816897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6e5483a-08f1-4231-a463-1b6609981f36 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:06.817561 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6e5483a-08f1-4231-a463-1b6609981f36 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:06.818900 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6e5483a-08f1-4231-a463-1b6609981f36 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:07.061695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b6e5483a-08f1-4231-a463-1b6609981f36 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:07.076768 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b6e5483a-08f1-4231-a463-1b6609981f36 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a" status: 200 len: 1308 microversion: 2.1 time: 0.294073 Aug 04 17:04:07.090443 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1233/2384] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:06 2022] GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a => generated 1308 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:07.602230 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3baa70e4-2379-4525-b692-c0b64a4dfd0a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:07.603131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3baa70e4-2379-4525-b692-c0b64a4dfd0a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:07.615307 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3baa70e4-2379-4525-b692-c0b64a4dfd0a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:07.615806 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3baa70e4-2379-4525-b692-c0b64a4dfd0a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:07.616437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3baa70e4-2379-4525-b692-c0b64a4dfd0a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:07.617157 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3baa70e4-2379-4525-b692-c0b64a4dfd0a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:07.618526 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3baa70e4-2379-4525-b692-c0b64a4dfd0a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:07.621167 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3baa70e4-2379-4525-b692-c0b64a4dfd0a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:07.788779 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e7263bd2-4758-46ea-bced-25f3da310003 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5b018670>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:07.848195 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3baa70e4-2379-4525-b692-c0b64a4dfd0a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:07.858310 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3baa70e4-2379-4525-b692-c0b64a4dfd0a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b" status: 200 len: 1511 microversion: 2.1 time: 0.259788 Aug 04 17:04:07.872934 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1152/2385] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:07 2022] GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b => generated 1511 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:07.872934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d97884da-bf96-42ba-9737-21c8e6094941 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:07.873847 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d97884da-bf96-42ba-9737-21c8e6094941 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] [instance: c91f5223-09be-4180-b1a0-c261e00361fc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:07.880646 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d97884da-bf96-42ba-9737-21c8e6094941 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:07.881043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d97884da-bf96-42ba-9737-21c8e6094941 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:07.881503 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d97884da-bf96-42ba-9737-21c8e6094941 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:07.882272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d97884da-bf96-42ba-9737-21c8e6094941 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:07.882735 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d97884da-bf96-42ba-9737-21c8e6094941 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:07.883163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d97884da-bf96-42ba-9737-21c8e6094941 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:07.909528 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e7263bd2-4758-46ea-bced-25f3da310003 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257" status: 200 len: 1452 microversion: 2.1 time: 0.125584 Aug 04 17:04:07.910147 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1234/2386] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:07 2022] GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257 => generated 1452 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:04:08.098498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-35f3e8ce-ada3-47eb-8bcb-f8ac4eda25bc tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:08.099608 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-35f3e8ce-ada3-47eb-8bcb-f8ac4eda25bc tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 30e66be0-1c2b-401d-8e17-1271b1910f4a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:08.103709 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d97884da-bf96-42ba-9737-21c8e6094941 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df56ffaf1f14046b8a97d219833caf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29204609fba44a4b69c57e2d0f5e581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:08.112732 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d97884da-bf96-42ba-9737-21c8e6094941 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] 10.222.0.93 "GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc" status: 200 len: 1351 microversion: 2.1 time: 0.249066 Aug 04 17:04:08.113733 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1153/2387] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:07 2022] GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc => generated 1351 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:08.117008 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-35f3e8ce-ada3-47eb-8bcb-f8ac4eda25bc tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:08.119825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-35f3e8ce-ada3-47eb-8bcb-f8ac4eda25bc tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:08.120418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-35f3e8ce-ada3-47eb-8bcb-f8ac4eda25bc tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:08.121258 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-35f3e8ce-ada3-47eb-8bcb-f8ac4eda25bc tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:08.129038 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-35f3e8ce-ada3-47eb-8bcb-f8ac4eda25bc tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:08.129632 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-35f3e8ce-ada3-47eb-8bcb-f8ac4eda25bc tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:08.402829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-35f3e8ce-ada3-47eb-8bcb-f8ac4eda25bc tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:08.413534 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-35f3e8ce-ada3-47eb-8bcb-f8ac4eda25bc tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a" status: 200 len: 1308 microversion: 2.1 time: 0.318977 Aug 04 17:04:08.419095 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1235/2388] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:08 2022] GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a => generated 1308 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:08.516297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-d0e89e1e-3404-45c3-8546-e160938349d8 req-09196a3e-5752-4960-888d-0cc4bbacd180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c91f5223-09be-4180-b1a0-c261e00361fc", "name": "network-vif-plugged", "status": "completed", "tag": "01be168a-8839-40cc-bbbf-055fbfa0ec50"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:08.538500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d0e89e1e-3404-45c3-8546-e160938349d8 req-09196a3e-5752-4960-888d-0cc4bbacd180 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:08.542681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d0e89e1e-3404-45c3-8546-e160938349d8 req-09196a3e-5752-4960-888d-0cc4bbacd180 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:08.546184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d0e89e1e-3404-45c3-8546-e160938349d8 req-09196a3e-5752-4960-888d-0cc4bbacd180 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:08.578618 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-d0e89e1e-3404-45c3-8546-e160938349d8 req-09196a3e-5752-4960-888d-0cc4bbacd180 service nova] Creating event network-vif-plugged:01be168a-8839-40cc-bbbf-055fbfa0ec50 for instance c91f5223-09be-4180-b1a0-c261e00361fc on n-h2-851359-3 Aug 04 17:04:08.596207 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-d0e89e1e-3404-45c3-8546-e160938349d8 req-09196a3e-5752-4960-888d-0cc4bbacd180 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085145 Aug 04 17:04:08.596810 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1154/2389] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:08.883041 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-60c8ac83-70c2-40ef-b57f-496523c5a6fa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:08.883720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-60c8ac83-70c2-40ef-b57f-496523c5a6fa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:08.893449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60c8ac83-70c2-40ef-b57f-496523c5a6fa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:08.893957 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60c8ac83-70c2-40ef-b57f-496523c5a6fa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:08.894433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60c8ac83-70c2-40ef-b57f-496523c5a6fa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:08.895162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60c8ac83-70c2-40ef-b57f-496523c5a6fa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:08.895631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60c8ac83-70c2-40ef-b57f-496523c5a6fa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:08.896070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60c8ac83-70c2-40ef-b57f-496523c5a6fa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:08.926020 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3a01e3b7-9e22-4802-9047-c0bf6b01ad7c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e6a3489d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:09.003306 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3a01e3b7-9e22-4802-9047-c0bf6b01ad7c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257" status: 200 len: 1452 microversion: 2.1 time: 0.082718 Aug 04 17:04:09.005323 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1155/2390] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:08 2022] GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257 => generated 1452 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:04:09.136154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-26185f53-5d73-4a55-be37-2e2390d6d957 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:09.137459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-26185f53-5d73-4a55-be37-2e2390d6d957 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] [instance: c91f5223-09be-4180-b1a0-c261e00361fc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:09.156067 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26185f53-5d73-4a55-be37-2e2390d6d957 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:09.162008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26185f53-5d73-4a55-be37-2e2390d6d957 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:09.162594 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26185f53-5d73-4a55-be37-2e2390d6d957 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:09.163362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26185f53-5d73-4a55-be37-2e2390d6d957 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:09.163999 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26185f53-5d73-4a55-be37-2e2390d6d957 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:09.164443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26185f53-5d73-4a55-be37-2e2390d6d957 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:09.716371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-60c8ac83-70c2-40ef-b57f-496523c5a6fa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:09.727666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-26185f53-5d73-4a55-be37-2e2390d6d957 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df56ffaf1f14046b8a97d219833caf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29204609fba44a4b69c57e2d0f5e581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:09.741054 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-26185f53-5d73-4a55-be37-2e2390d6d957 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] 10.222.0.93 "GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc" status: 200 len: 1351 microversion: 2.1 time: 0.609851 Aug 04 17:04:09.741648 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1156/2391] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:09 2022] GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc => generated 1351 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:04:09.748463 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-60c8ac83-70c2-40ef-b57f-496523c5a6fa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b" status: 200 len: 1511 microversion: 2.1 time: 0.868629 Aug 04 17:04:09.749821 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1236/2392] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:08 2022] GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b => generated 1511 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:09.762532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a1807261-3fdc-4d52-b66c-7a996f4caa8a tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:09.762532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a1807261-3fdc-4d52-b66c-7a996f4caa8a tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 30e66be0-1c2b-401d-8e17-1271b1910f4a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:09.791855 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1807261-3fdc-4d52-b66c-7a996f4caa8a tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:09.794638 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1807261-3fdc-4d52-b66c-7a996f4caa8a tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:09.795096 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1807261-3fdc-4d52-b66c-7a996f4caa8a tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:09.799096 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1807261-3fdc-4d52-b66c-7a996f4caa8a tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:09.799522 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1807261-3fdc-4d52-b66c-7a996f4caa8a tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:09.802279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1807261-3fdc-4d52-b66c-7a996f4caa8a tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:10.014958 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a1807261-3fdc-4d52-b66c-7a996f4caa8a tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:10.021878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5c576a67-38d0-4697-b1ac-00ecc1c6c935 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-848060823", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:10.024904 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a1807261-3fdc-4d52-b66c-7a996f4caa8a tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a" status: 200 len: 1308 microversion: 2.1 time: 0.282183 Aug 04 17:04:10.027484 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1157/2393] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:09 2022] GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a => generated 1308 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:10.033126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d4a7e4d7-da4a-4808-ad45-d39b58e742b8 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e6c908820>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:10.122953 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d4a7e4d7-da4a-4808-ad45-d39b58e742b8 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257" status: 200 len: 1452 microversion: 2.1 time: 0.094052 Aug 04 17:04:10.123973 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1158/2394] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:10 2022] GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257 => generated 1452 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:10.136430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-5c576a67-38d0-4697-b1ac-00ecc1c6c935 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] validate_networks() for None {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:04:10.496871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5c576a67-38d0-4697-b1ac-00ecc1c6c935 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:04:10.498762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5c576a67-38d0-4697-b1ac-00ecc1c6c935 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:04:10.499551 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5c576a67-38d0-4697-b1ac-00ecc1c6c935 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:04:10.500209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5c576a67-38d0-4697-b1ac-00ecc1c6c935 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:04:10.500986 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5c576a67-38d0-4697-b1ac-00ecc1c6c935 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:04:10.519073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c576a67-38d0-4697-b1ac-00ecc1c6c935 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:10.523107 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c576a67-38d0-4697-b1ac-00ecc1c6c935 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:10.523863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c576a67-38d0-4697-b1ac-00ecc1c6c935 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:10.524855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c576a67-38d0-4697-b1ac-00ecc1c6c935 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:10.525673 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c576a67-38d0-4697-b1ac-00ecc1c6c935 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:10.526389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c576a67-38d0-4697-b1ac-00ecc1c6c935 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:10.549941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-5c576a67-38d0-4697-b1ac-00ecc1c6c935 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Getting quotas for project 0fb1953e32b545b1b9c09ba8015038c2. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:04:10.576994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-5c576a67-38d0-4697-b1ac-00ecc1c6c935 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Getting quotas for user 829341e13cf9427b91854d5f285605e0 and project 0fb1953e32b545b1b9c09ba8015038c2. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:04:10.607192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5c576a67-38d0-4697-b1ac-00ecc1c6c935 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:04:10.616818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5c576a67-38d0-4697-b1ac-00ecc1c6c935 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] [instance: 7f02288b-9e88-4277-bc31-ae355dadd181] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:04:10.746165 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5c576a67-38d0-4697-b1ac-00ecc1c6c935 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.991568 Aug 04 17:04:10.747345 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1237/2395] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:04:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:04:10.762358 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-41e7e520-d321-48d4-9ade-d8037a6be999 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:10.762358 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-41e7e520-d321-48d4-9ade-d8037a6be999 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] [instance: 7f02288b-9e88-4277-bc31-ae355dadd181] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:10.768711 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-655f6e38-48dd-4f10-8366-a40b2c6e044d tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:10.780586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-655f6e38-48dd-4f10-8366-a40b2c6e044d tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] [instance: c91f5223-09be-4180-b1a0-c261e00361fc] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:10.807972 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-655f6e38-48dd-4f10-8366-a40b2c6e044d tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:10.819062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-655f6e38-48dd-4f10-8366-a40b2c6e044d tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:10.820090 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-655f6e38-48dd-4f10-8366-a40b2c6e044d tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:10.822434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-655f6e38-48dd-4f10-8366-a40b2c6e044d tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:10.826637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-655f6e38-48dd-4f10-8366-a40b2c6e044d tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:10.827249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-655f6e38-48dd-4f10-8366-a40b2c6e044d tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:10.913556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-41e7e520-d321-48d4-9ade-d8037a6be999 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829341e13cf9427b91854d5f285605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb1953e32b545b1b9c09ba8015038c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:10.920936 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-41e7e520-d321-48d4-9ade-d8037a6be999 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] 10.222.0.93 "GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181" status: 200 len: 1213 microversion: 2.1 time: 0.166237 Aug 04 17:04:10.930728 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1159/2396] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:10 2022] GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181 => generated 1213 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:10.936038 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-77ed98dd-0eb8-46fa-a72e-a3c250952f3c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:10.936658 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-77ed98dd-0eb8-46fa-a72e-a3c250952f3c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:10.971973 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77ed98dd-0eb8-46fa-a72e-a3c250952f3c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:10.972559 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77ed98dd-0eb8-46fa-a72e-a3c250952f3c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:10.972903 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77ed98dd-0eb8-46fa-a72e-a3c250952f3c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:10.973628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77ed98dd-0eb8-46fa-a72e-a3c250952f3c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:10.974124 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77ed98dd-0eb8-46fa-a72e-a3c250952f3c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:10.974562 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77ed98dd-0eb8-46fa-a72e-a3c250952f3c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:11.142390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-655f6e38-48dd-4f10-8366-a40b2c6e044d tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df56ffaf1f14046b8a97d219833caf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29204609fba44a4b69c57e2d0f5e581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:11.166056 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-655f6e38-48dd-4f10-8366-a40b2c6e044d tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] 10.222.0.93 "GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc" status: 200 len: 1351 microversion: 2.1 time: 0.402263 Aug 04 17:04:11.167023 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1238/2397] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:10 2022] GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc => generated 1351 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:11.175836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d8e0336c-7de4-442d-b684-6be993106179 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:11.176625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d8e0336c-7de4-442d-b684-6be993106179 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 30e66be0-1c2b-401d-8e17-1271b1910f4a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:11.191062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8e0336c-7de4-442d-b684-6be993106179 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:11.193337 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8e0336c-7de4-442d-b684-6be993106179 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:11.194288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8e0336c-7de4-442d-b684-6be993106179 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:11.197194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8e0336c-7de4-442d-b684-6be993106179 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:11.197893 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8e0336c-7de4-442d-b684-6be993106179 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:11.199019 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8e0336c-7de4-442d-b684-6be993106179 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:11.537214 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-77ed98dd-0eb8-46fa-a72e-a3c250952f3c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:11.543055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:11.551812 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-77ed98dd-0eb8-46fa-a72e-a3c250952f3c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b" status: 200 len: 1511 microversion: 2.1 time: 0.619781 Aug 04 17:04:11.558676 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1160/2398] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:10 2022] GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b => generated 1511 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:11.578840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eac83326-8514-4166-912c-cd17dcd60584 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5b948700>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:11.599761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d8e0336c-7de4-442d-b684-6be993106179 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:11.613227 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d8e0336c-7de4-442d-b684-6be993106179 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a" status: 200 len: 1308 microversion: 2.1 time: 0.444485 Aug 04 17:04:11.618403 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1239/2399] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:11 2022] GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a => generated 1308 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:11.667175 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eac83326-8514-4166-912c-cd17dcd60584 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257" status: 200 len: 1452 microversion: 2.1 time: 0.107093 Aug 04 17:04:11.668178 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1161/2400] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:11 2022] GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257 => generated 1452 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:11.951307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-54ae97e8-a763-438e-bcfd-62a44151f0ad tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:11.952201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-54ae97e8-a763-438e-bcfd-62a44151f0ad tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] [instance: 7f02288b-9e88-4277-bc31-ae355dadd181] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:11.965530 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-54ae97e8-a763-438e-bcfd-62a44151f0ad tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:11.966290 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-54ae97e8-a763-438e-bcfd-62a44151f0ad tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:11.966968 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-54ae97e8-a763-438e-bcfd-62a44151f0ad tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:11.969139 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-54ae97e8-a763-438e-bcfd-62a44151f0ad tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:11.969848 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-54ae97e8-a763-438e-bcfd-62a44151f0ad tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:11.971194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-54ae97e8-a763-438e-bcfd-62a44151f0ad tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:12.174539 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-54ae97e8-a763-438e-bcfd-62a44151f0ad tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829341e13cf9427b91854d5f285605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb1953e32b545b1b9c09ba8015038c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:12.187166 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-54ae97e8-a763-438e-bcfd-62a44151f0ad tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] 10.222.0.93 "GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181" status: 200 len: 1209 microversion: 2.1 time: 0.239624 Aug 04 17:04:12.190429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c2aeb19f-81b4-4fbe-9a3a-be14cdfe406a tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:12.191297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c2aeb19f-81b4-4fbe-9a3a-be14cdfe406a tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] [instance: c91f5223-09be-4180-b1a0-c261e00361fc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:12.195167 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1240/2401] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:11 2022] GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181 => generated 1209 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:12.199192 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2aeb19f-81b4-4fbe-9a3a-be14cdfe406a tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:12.200155 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2aeb19f-81b4-4fbe-9a3a-be14cdfe406a tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:12.200756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2aeb19f-81b4-4fbe-9a3a-be14cdfe406a tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:12.201606 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2aeb19f-81b4-4fbe-9a3a-be14cdfe406a tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:12.202325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2aeb19f-81b4-4fbe-9a3a-be14cdfe406a tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:12.202893 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2aeb19f-81b4-4fbe-9a3a-be14cdfe406a tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:12.526058 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c2aeb19f-81b4-4fbe-9a3a-be14cdfe406a tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df56ffaf1f14046b8a97d219833caf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29204609fba44a4b69c57e2d0f5e581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:12.551429 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c2aeb19f-81b4-4fbe-9a3a-be14cdfe406a tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] 10.222.0.93 "GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc" status: 200 len: 1541 microversion: 2.1 time: 0.365590 Aug 04 17:04:12.580869 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1162/2402] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:12 2022] GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc => generated 1541 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:04:12.585159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b0de331c-0fa8-42ba-a2a2-3d584804e469 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:12.585828 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b0de331c-0fa8-42ba-a2a2-3d584804e469 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:12.603485 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0de331c-0fa8-42ba-a2a2-3d584804e469 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:12.605044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0de331c-0fa8-42ba-a2a2-3d584804e469 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:12.605519 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0de331c-0fa8-42ba-a2a2-3d584804e469 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:12.605654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3b88d37f-feb1-4578-b261-7c997dc13700 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:12.606151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3b88d37f-feb1-4578-b261-7c997dc13700 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] [instance: c91f5223-09be-4180-b1a0-c261e00361fc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:12.606286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0de331c-0fa8-42ba-a2a2-3d584804e469 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:12.609821 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0de331c-0fa8-42ba-a2a2-3d584804e469 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:12.611522 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0de331c-0fa8-42ba-a2a2-3d584804e469 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:12.614850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b88d37f-feb1-4578-b261-7c997dc13700 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:12.615364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b88d37f-feb1-4578-b261-7c997dc13700 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:12.615819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b88d37f-feb1-4578-b261-7c997dc13700 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:12.616545 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b88d37f-feb1-4578-b261-7c997dc13700 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:12.617013 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b88d37f-feb1-4578-b261-7c997dc13700 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:12.617713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b88d37f-feb1-4578-b261-7c997dc13700 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:13.271498 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3b88d37f-feb1-4578-b261-7c997dc13700 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] 10.222.0.93 "GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.690726 Aug 04 17:04:13.285822 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1163/2403] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Aug 4 17:04:12 2022] GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc/os-interface => generated 284 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:13.294174 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4c1aa68b-5ed2-49bf-8cf9-f93fa673646c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:13.295055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4c1aa68b-5ed2-49bf-8cf9-f93fa673646c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 30e66be0-1c2b-401d-8e17-1271b1910f4a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:13.316191 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c1aa68b-5ed2-49bf-8cf9-f93fa673646c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:13.316959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c1aa68b-5ed2-49bf-8cf9-f93fa673646c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:13.317594 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c1aa68b-5ed2-49bf-8cf9-f93fa673646c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:13.318535 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c1aa68b-5ed2-49bf-8cf9-f93fa673646c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:13.319359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c1aa68b-5ed2-49bf-8cf9-f93fa673646c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:13.320041 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c1aa68b-5ed2-49bf-8cf9-f93fa673646c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:13.558515 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b0de331c-0fa8-42ba-a2a2-3d584804e469 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:13.572805 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b0de331c-0fa8-42ba-a2a2-3d584804e469 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b" status: 200 len: 1511 microversion: 2.1 time: 0.996985 Aug 04 17:04:13.573767 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1241/2404] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:12 2022] GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b => generated 1511 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:13.583478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1fdb12dc-51cc-4c90-a3d2-f42581848fce tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5b018d30>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:13.650247 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1fdb12dc-51cc-4c90-a3d2-f42581848fce tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257" status: 200 len: 1452 microversion: 2.1 time: 0.075195 Aug 04 17:04:13.650949 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1242/2405] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:13 2022] GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257 => generated 1452 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:13.667241 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f2a6bf19-b9d2-4048-a4d4-7b3b0e803947 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:13.668260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f2a6bf19-b9d2-4048-a4d4-7b3b0e803947 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] [instance: 7f02288b-9e88-4277-bc31-ae355dadd181] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:13.683829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2a6bf19-b9d2-4048-a4d4-7b3b0e803947 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:13.684358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2a6bf19-b9d2-4048-a4d4-7b3b0e803947 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:13.685260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2a6bf19-b9d2-4048-a4d4-7b3b0e803947 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:13.686297 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2a6bf19-b9d2-4048-a4d4-7b3b0e803947 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:13.686928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2a6bf19-b9d2-4048-a4d4-7b3b0e803947 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:13.687602 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2a6bf19-b9d2-4048-a4d4-7b3b0e803947 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:13.694339 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4c1aa68b-5ed2-49bf-8cf9-f93fa673646c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:13.709043 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4c1aa68b-5ed2-49bf-8cf9-f93fa673646c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a" status: 200 len: 1308 microversion: 2.1 time: 0.421415 Aug 04 17:04:13.722168 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1164/2406] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:13 2022] GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a => generated 1308 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:13.860035 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f2a6bf19-b9d2-4048-a4d4-7b3b0e803947 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829341e13cf9427b91854d5f285605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb1953e32b545b1b9c09ba8015038c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:13.874352 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f2a6bf19-b9d2-4048-a4d4-7b3b0e803947 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] 10.222.0.93 "GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181" status: 200 len: 1271 microversion: 2.1 time: 0.222075 Aug 04 17:04:13.888046 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1243/2407] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:13 2022] GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181 => generated 1271 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:14.605647 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c6182968-1e29-4051-abeb-8581f50304c8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:14.606309 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c6182968-1e29-4051-abeb-8581f50304c8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:14.608262 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=20 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:14.615562 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6182968-1e29-4051-abeb-8581f50304c8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:14.627267 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6182968-1e29-4051-abeb-8581f50304c8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:14.627739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6182968-1e29-4051-abeb-8581f50304c8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:14.630081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6182968-1e29-4051-abeb-8581f50304c8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:14.632625 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6182968-1e29-4051-abeb-8581f50304c8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:14.634141 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6182968-1e29-4051-abeb-8581f50304c8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:14.665056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-be83fdf5-c83e-4747-99c9-6dfea563d8cf tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5b154310>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:14.732105 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-be83fdf5-c83e-4747-99c9-6dfea563d8cf tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257" status: 200 len: 1452 microversion: 2.1 time: 0.071111 Aug 04 17:04:14.738006 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1244/2408] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:14 2022] GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257 => generated 1452 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:14.743958 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dfb305be-1ce9-42b4-a362-59bee89b88c3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:14.745101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dfb305be-1ce9-42b4-a362-59bee89b88c3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 30e66be0-1c2b-401d-8e17-1271b1910f4a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:14.773179 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfb305be-1ce9-42b4-a362-59bee89b88c3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:14.773947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfb305be-1ce9-42b4-a362-59bee89b88c3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:14.774640 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfb305be-1ce9-42b4-a362-59bee89b88c3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:14.775592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfb305be-1ce9-42b4-a362-59bee89b88c3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:14.776273 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfb305be-1ce9-42b4-a362-59bee89b88c3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:14.776920 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfb305be-1ce9-42b4-a362-59bee89b88c3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:15.244415 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c6182968-1e29-4051-abeb-8581f50304c8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:15.280742 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c6182968-1e29-4051-abeb-8581f50304c8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b" status: 200 len: 1511 microversion: 2.1 time: 0.675340 Aug 04 17:04:15.286113 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1165/2409] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:14 2022] GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b => generated 1511 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:04:15.297939 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-3e98fbc4-3f1b-47e3-90f1-6842c8e99cdc req-3081b4e4-7171-4c3a-a3af-766ebeae5de2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30e66be0-1c2b-401d-8e17-1271b1910f4a", "name": "network-vif-plugged", "status": "completed", "tag": "93b8fa03-1f37-431c-b87c-431cafd2680c"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:15.319131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-3e98fbc4-3f1b-47e3-90f1-6842c8e99cdc req-3081b4e4-7171-4c3a-a3af-766ebeae5de2 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:15.320733 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-3e98fbc4-3f1b-47e3-90f1-6842c8e99cdc req-3081b4e4-7171-4c3a-a3af-766ebeae5de2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:15.321334 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-3e98fbc4-3f1b-47e3-90f1-6842c8e99cdc req-3081b4e4-7171-4c3a-a3af-766ebeae5de2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:15.342877 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-3e98fbc4-3f1b-47e3-90f1-6842c8e99cdc req-3081b4e4-7171-4c3a-a3af-766ebeae5de2 service nova] Creating event network-vif-plugged:93b8fa03-1f37-431c-b87c-431cafd2680c for instance 30e66be0-1c2b-401d-8e17-1271b1910f4a on n-h2-851359-3 Aug 04 17:04:15.354005 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-3e98fbc4-3f1b-47e3-90f1-6842c8e99cdc req-3081b4e4-7171-4c3a-a3af-766ebeae5de2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062710 Aug 04 17:04:15.355120 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1166/2410] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:15.365419 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2eed669e-8c0f-49cd-b313-409a08d89b34 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:15.367097 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2eed669e-8c0f-49cd-b313-409a08d89b34 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] [instance: 7f02288b-9e88-4277-bc31-ae355dadd181] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:15.381905 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2eed669e-8c0f-49cd-b313-409a08d89b34 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:15.383035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2eed669e-8c0f-49cd-b313-409a08d89b34 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:15.384771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2eed669e-8c0f-49cd-b313-409a08d89b34 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:15.386312 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2eed669e-8c0f-49cd-b313-409a08d89b34 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:15.387310 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2eed669e-8c0f-49cd-b313-409a08d89b34 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:15.388285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2eed669e-8c0f-49cd-b313-409a08d89b34 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:15.739289 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dfb305be-1ce9-42b4-a362-59bee89b88c3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:15.749776 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dfb305be-1ce9-42b4-a362-59bee89b88c3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a" status: 200 len: 1308 microversion: 2.1 time: 1.010459 Aug 04 17:04:15.768468 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1245/2411] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:14 2022] GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a => generated 1308 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:15.773541 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-14ca4224-2df1-4a0d-b01a-1084d2733b9f tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5afd53a0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:15.908461 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-14ca4224-2df1-4a0d-b01a-1084d2733b9f tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257" status: 200 len: 1452 microversion: 2.1 time: 0.138619 Aug 04 17:04:15.919744 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1246/2412] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:15 2022] GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:16.106483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2eed669e-8c0f-49cd-b313-409a08d89b34 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829341e13cf9427b91854d5f285605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb1953e32b545b1b9c09ba8015038c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:16.115956 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2eed669e-8c0f-49cd-b313-409a08d89b34 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] 10.222.0.93 "GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181" status: 200 len: 1313 microversion: 2.1 time: 0.759199 Aug 04 17:04:16.122506 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1167/2413] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:15 2022] GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181 => generated 1313 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:16.306565 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fc05dcd5-7b8f-4bb5-bdc0-3f88872b865c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:16.318363 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fc05dcd5-7b8f-4bb5-bdc0-3f88872b865c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:16.334527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc05dcd5-7b8f-4bb5-bdc0-3f88872b865c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:16.347695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc05dcd5-7b8f-4bb5-bdc0-3f88872b865c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:16.349676 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc05dcd5-7b8f-4bb5-bdc0-3f88872b865c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:16.350672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc05dcd5-7b8f-4bb5-bdc0-3f88872b865c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:16.359389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc05dcd5-7b8f-4bb5-bdc0-3f88872b865c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:16.367034 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc05dcd5-7b8f-4bb5-bdc0-3f88872b865c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:16.408824 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:16.795163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-283e6121-46bd-463a-81a7-1575dbd8989f tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:16.795788 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-283e6121-46bd-463a-81a7-1575dbd8989f tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 30e66be0-1c2b-401d-8e17-1271b1910f4a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:16.805862 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-283e6121-46bd-463a-81a7-1575dbd8989f tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:16.806382 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-283e6121-46bd-463a-81a7-1575dbd8989f tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:16.806827 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-283e6121-46bd-463a-81a7-1575dbd8989f tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:16.807542 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-283e6121-46bd-463a-81a7-1575dbd8989f tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:16.807997 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-283e6121-46bd-463a-81a7-1575dbd8989f tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:16.808431 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-283e6121-46bd-463a-81a7-1575dbd8989f tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:16.900513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fc05dcd5-7b8f-4bb5-bdc0-3f88872b865c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:16.915213 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fc05dcd5-7b8f-4bb5-bdc0-3f88872b865c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b" status: 200 len: 1511 microversion: 2.1 time: 0.611071 Aug 04 17:04:16.919688 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1247/2414] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:16 2022] GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b => generated 1511 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:16.938272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d7255981-e6d1-4328-9f77-a9a9f93589e6 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5af4c310>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:17.026099 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d7255981-e6d1-4328-9f77-a9a9f93589e6 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257" status: 200 len: 1452 microversion: 2.1 time: 0.104818 Aug 04 17:04:17.038464 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1248/2415] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:16 2022] GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257 => generated 1452 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:17.149233 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f4488f12-6ec7-4c6d-a9ff-952ead4561a5 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:17.152200 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f4488f12-6ec7-4c6d-a9ff-952ead4561a5 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] [instance: 7f02288b-9e88-4277-bc31-ae355dadd181] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:17.163093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f4488f12-6ec7-4c6d-a9ff-952ead4561a5 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:17.163891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f4488f12-6ec7-4c6d-a9ff-952ead4561a5 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:17.164818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f4488f12-6ec7-4c6d-a9ff-952ead4561a5 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:17.165765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f4488f12-6ec7-4c6d-a9ff-952ead4561a5 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:17.166428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f4488f12-6ec7-4c6d-a9ff-952ead4561a5 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:17.167020 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f4488f12-6ec7-4c6d-a9ff-952ead4561a5 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:17.269255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-283e6121-46bd-463a-81a7-1575dbd8989f tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:17.281386 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-283e6121-46bd-463a-81a7-1575dbd8989f tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a" status: 200 len: 1308 microversion: 2.1 time: 0.489974 Aug 04 17:04:17.300991 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1168/2416] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:16 2022] GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a => generated 1308 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:17.562341 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f4488f12-6ec7-4c6d-a9ff-952ead4561a5 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829341e13cf9427b91854d5f285605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb1953e32b545b1b9c09ba8015038c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:17.572159 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f4488f12-6ec7-4c6d-a9ff-952ead4561a5 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] 10.222.0.93 "GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181" status: 200 len: 1313 microversion: 2.1 time: 0.431240 Aug 04 17:04:17.584558 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1249/2417] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:17 2022] GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181 => generated 1313 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:04:17.941081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3b2ca885-5aa2-4b64-9d38-e83c6f24c233 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:17.941718 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3b2ca885-5aa2-4b64-9d38-e83c6f24c233 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:17.949327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b2ca885-5aa2-4b64-9d38-e83c6f24c233 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:17.949823 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b2ca885-5aa2-4b64-9d38-e83c6f24c233 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:17.950303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b2ca885-5aa2-4b64-9d38-e83c6f24c233 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:17.951019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b2ca885-5aa2-4b64-9d38-e83c6f24c233 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:17.951475 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b2ca885-5aa2-4b64-9d38-e83c6f24c233 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:17.951909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b2ca885-5aa2-4b64-9d38-e83c6f24c233 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:18.044596 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ff0e0660-0f8a-4cf6-a07d-8789376009f9 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5b11ca60>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:18.135974 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ff0e0660-0f8a-4cf6-a07d-8789376009f9 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257" status: 200 len: 1452 microversion: 2.1 time: 0.095697 Aug 04 17:04:18.146140 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1250/2418] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:18 2022] GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257 => generated 1452 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:04:18.309179 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ec1a6880-14c5-47dd-83c5-81dbeb4f7864 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:18.310369 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ec1a6880-14c5-47dd-83c5-81dbeb4f7864 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 30e66be0-1c2b-401d-8e17-1271b1910f4a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:18.320162 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3b2ca885-5aa2-4b64-9d38-e83c6f24c233 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:18.334756 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3b2ca885-5aa2-4b64-9d38-e83c6f24c233 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b" status: 200 len: 1511 microversion: 2.1 time: 0.397495 Aug 04 17:04:18.335376 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1169/2419] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:17 2022] GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b => generated 1511 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:18.344066 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec1a6880-14c5-47dd-83c5-81dbeb4f7864 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:18.346563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec1a6880-14c5-47dd-83c5-81dbeb4f7864 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:18.348921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec1a6880-14c5-47dd-83c5-81dbeb4f7864 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:18.357065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec1a6880-14c5-47dd-83c5-81dbeb4f7864 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:18.357674 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec1a6880-14c5-47dd-83c5-81dbeb4f7864 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:18.364589 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec1a6880-14c5-47dd-83c5-81dbeb4f7864 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:18.510345 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-fc68128e-1f18-405f-9aa3-eac1c99e6658 req-91dafcb2-3027-4f03-9216-6e478039b773 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c91f5223-09be-4180-b1a0-c261e00361fc", "tag": "01be168a-8839-40cc-bbbf-055fbfa0ec50"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:18.575054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fc68128e-1f18-405f-9aa3-eac1c99e6658 req-91dafcb2-3027-4f03-9216-6e478039b773 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:18.576589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fc68128e-1f18-405f-9aa3-eac1c99e6658 req-91dafcb2-3027-4f03-9216-6e478039b773 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:18.577205 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fc68128e-1f18-405f-9aa3-eac1c99e6658 req-91dafcb2-3027-4f03-9216-6e478039b773 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:18.623066 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-fc68128e-1f18-405f-9aa3-eac1c99e6658 req-91dafcb2-3027-4f03-9216-6e478039b773 service nova] Creating event network-changed:01be168a-8839-40cc-bbbf-055fbfa0ec50 for instance c91f5223-09be-4180-b1a0-c261e00361fc on n-h2-851359-3 Aug 04 17:04:18.639034 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-fc68128e-1f18-405f-9aa3-eac1c99e6658 req-91dafcb2-3027-4f03-9216-6e478039b773 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135534 Aug 04 17:04:18.642545 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1170/2420] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:04:18.654304 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-de36376c-57b1-4578-ba96-2641d1b3ff70 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:18.656142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-de36376c-57b1-4578-ba96-2641d1b3ff70 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] [instance: 7f02288b-9e88-4277-bc31-ae355dadd181] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:18.672516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de36376c-57b1-4578-ba96-2641d1b3ff70 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:18.676759 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de36376c-57b1-4578-ba96-2641d1b3ff70 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:18.678775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de36376c-57b1-4578-ba96-2641d1b3ff70 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:18.679964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de36376c-57b1-4578-ba96-2641d1b3ff70 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:18.681935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de36376c-57b1-4578-ba96-2641d1b3ff70 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:18.683685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de36376c-57b1-4578-ba96-2641d1b3ff70 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:20.104412 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ec1a6880-14c5-47dd-83c5-81dbeb4f7864 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:20.118090 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ec1a6880-14c5-47dd-83c5-81dbeb4f7864 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a" status: 200 len: 1488 microversion: 2.1 time: 1.815549 Aug 04 17:04:20.120771 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1251/2421] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:18 2022] GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a => generated 1488 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:20.134394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e0ad4d53-da29-4061-aaa6-33889c09a11c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5afcd160>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:20.136579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-de36376c-57b1-4578-ba96-2641d1b3ff70 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829341e13cf9427b91854d5f285605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb1953e32b545b1b9c09ba8015038c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:20.146272 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-de36376c-57b1-4578-ba96-2641d1b3ff70 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] 10.222.0.93 "GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181" status: 200 len: 1313 microversion: 2.1 time: 1.502190 Aug 04 17:04:20.164794 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1171/2422] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:18 2022] GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181 => generated 1313 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:20.176134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1d370c8e-a3b0-4c20-b5ae-796b133f8415 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:20.179522 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1d370c8e-a3b0-4c20-b5ae-796b133f8415 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:20.200095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d370c8e-a3b0-4c20-b5ae-796b133f8415 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:20.201041 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d370c8e-a3b0-4c20-b5ae-796b133f8415 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:20.201707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d370c8e-a3b0-4c20-b5ae-796b133f8415 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:20.203610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d370c8e-a3b0-4c20-b5ae-796b133f8415 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:20.204843 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d370c8e-a3b0-4c20-b5ae-796b133f8415 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:20.205508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d370c8e-a3b0-4c20-b5ae-796b133f8415 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:20.225745 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e0ad4d53-da29-4061-aaa6-33889c09a11c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257" status: 200 len: 1452 microversion: 2.1 time: 0.103583 Aug 04 17:04:20.238877 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1252/2423] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:20 2022] GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257 => generated 1452 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:20.257642 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-138aec7b-5810-4446-81d7-7616688046b9 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:20.262156 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-138aec7b-5810-4446-81d7-7616688046b9 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 30e66be0-1c2b-401d-8e17-1271b1910f4a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:20.281395 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-138aec7b-5810-4446-81d7-7616688046b9 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:20.284212 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-138aec7b-5810-4446-81d7-7616688046b9 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:20.288462 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-138aec7b-5810-4446-81d7-7616688046b9 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:20.291612 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-138aec7b-5810-4446-81d7-7616688046b9 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:20.292340 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-138aec7b-5810-4446-81d7-7616688046b9 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:20.294070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-138aec7b-5810-4446-81d7-7616688046b9 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:20.360956 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-138aec7b-5810-4446-81d7-7616688046b9 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lazy-loading 'flavor' on Instance uuid 30e66be0-1c2b-401d-8e17-1271b1910f4a {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:04:20.519742 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-138aec7b-5810-4446-81d7-7616688046b9 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "POST /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a/action" status: 202 len: 0 microversion: 2.1 time: 0.273538 Aug 04 17:04:20.523395 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1253/2424] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:04:20 2022] POST /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:04:20.561994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a018caeb-42eb-40ef-8d2d-bd880201a1c7 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:20.562748 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a018caeb-42eb-40ef-8d2d-bd880201a1c7 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 30e66be0-1c2b-401d-8e17-1271b1910f4a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:20.578654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=4 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:20.583080 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a018caeb-42eb-40ef-8d2d-bd880201a1c7 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:20.583723 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a018caeb-42eb-40ef-8d2d-bd880201a1c7 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:20.584457 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a018caeb-42eb-40ef-8d2d-bd880201a1c7 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:20.585481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a018caeb-42eb-40ef-8d2d-bd880201a1c7 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:20.586107 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a018caeb-42eb-40ef-8d2d-bd880201a1c7 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:20.586907 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a018caeb-42eb-40ef-8d2d-bd880201a1c7 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:20.588426 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:20.919984 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:21.020513 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1d370c8e-a3b0-4c20-b5ae-796b133f8415 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:21.037302 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1d370c8e-a3b0-4c20-b5ae-796b133f8415 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b" status: 200 len: 1511 microversion: 2.1 time: 0.868753 Aug 04 17:04:21.039916 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1172/2425] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:20 2022] GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b => generated 1511 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:21.054569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-3d1b2e87-f5db-426a-8ae7-10064a9f030c req-570654e7-0072-41c2-ab6e-3faae8e26963 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f02288b-9e88-4277-bc31-ae355dadd181", "tag": "ebdb02cb-020d-408d-aea7-23152b943370"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:21.073027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-3d1b2e87-f5db-426a-8ae7-10064a9f030c req-570654e7-0072-41c2-ab6e-3faae8e26963 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:21.074467 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-3d1b2e87-f5db-426a-8ae7-10064a9f030c req-570654e7-0072-41c2-ab6e-3faae8e26963 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:21.075477 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-3d1b2e87-f5db-426a-8ae7-10064a9f030c req-570654e7-0072-41c2-ab6e-3faae8e26963 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:21.090782 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-3d1b2e87-f5db-426a-8ae7-10064a9f030c req-570654e7-0072-41c2-ab6e-3faae8e26963 service nova] Creating event network-changed:ebdb02cb-020d-408d-aea7-23152b943370 for instance 7f02288b-9e88-4277-bc31-ae355dadd181 on n-h1-851359-3 Aug 04 17:04:21.100797 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-3d1b2e87-f5db-426a-8ae7-10064a9f030c req-570654e7-0072-41c2-ab6e-3faae8e26963 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059297 Aug 04 17:04:21.102562 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1173/2426] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:21.177805 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2a69fde0-4226-4e53-9587-38403c70d55d tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:21.178720 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2a69fde0-4226-4e53-9587-38403c70d55d tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] [instance: 7f02288b-9e88-4277-bc31-ae355dadd181] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:21.187907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a69fde0-4226-4e53-9587-38403c70d55d tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:21.197040 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a69fde0-4226-4e53-9587-38403c70d55d tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:21.199119 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a69fde0-4226-4e53-9587-38403c70d55d tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:21.206434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a69fde0-4226-4e53-9587-38403c70d55d tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:21.207924 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a69fde0-4226-4e53-9587-38403c70d55d tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:21.208705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a69fde0-4226-4e53-9587-38403c70d55d tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:21.360657 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a018caeb-42eb-40ef-8d2d-bd880201a1c7 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:21.376397 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a018caeb-42eb-40ef-8d2d-bd880201a1c7 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a" status: 200 len: 1496 microversion: 2.1 time: 0.827200 Aug 04 17:04:21.378229 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1254/2427] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:20 2022] GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a => generated 1496 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:21.384527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d8372f56-b67c-47e5-84a8-46f42e94c905 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5afe6160>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:21.448928 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d8372f56-b67c-47e5-84a8-46f42e94c905 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257" status: 200 len: 1452 microversion: 2.1 time: 0.067844 Aug 04 17:04:21.450024 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1255/2428] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:21 2022] GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257 => generated 1452 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:21.811524 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2a69fde0-4226-4e53-9587-38403c70d55d tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829341e13cf9427b91854d5f285605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb1953e32b545b1b9c09ba8015038c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:21.831897 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2a69fde0-4226-4e53-9587-38403c70d55d tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] 10.222.0.93 "GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181" status: 200 len: 1313 microversion: 2.1 time: 0.660209 Aug 04 17:04:21.850824 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1174/2429] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:21 2022] GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181 => generated 1313 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:22.063094 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7566f7d5-01ed-4e4c-a361-6c5ec696a637 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:22.064693 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7566f7d5-01ed-4e4c-a361-6c5ec696a637 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:22.091564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7566f7d5-01ed-4e4c-a361-6c5ec696a637 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:22.097118 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7566f7d5-01ed-4e4c-a361-6c5ec696a637 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:22.099729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7566f7d5-01ed-4e4c-a361-6c5ec696a637 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:22.105610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7566f7d5-01ed-4e4c-a361-6c5ec696a637 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:22.106559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7566f7d5-01ed-4e4c-a361-6c5ec696a637 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:22.108733 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7566f7d5-01ed-4e4c-a361-6c5ec696a637 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:22.386239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7566f7d5-01ed-4e4c-a361-6c5ec696a637 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:22.398675 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1f017d4a-1dfe-4cbb-aac4-df3c727fe0b3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:22.400105 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1f017d4a-1dfe-4cbb-aac4-df3c727fe0b3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 30e66be0-1c2b-401d-8e17-1271b1910f4a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:22.414399 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7566f7d5-01ed-4e4c-a361-6c5ec696a637 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b" status: 200 len: 1488 microversion: 2.1 time: 0.357959 Aug 04 17:04:22.434183 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1256/2430] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:22 2022] GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b => generated 1488 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:22.436361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f017d4a-1dfe-4cbb-aac4-df3c727fe0b3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:22.436888 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f017d4a-1dfe-4cbb-aac4-df3c727fe0b3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:22.437341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f017d4a-1dfe-4cbb-aac4-df3c727fe0b3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:22.438125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f017d4a-1dfe-4cbb-aac4-df3c727fe0b3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:22.438694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f017d4a-1dfe-4cbb-aac4-df3c727fe0b3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:22.439128 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f017d4a-1dfe-4cbb-aac4-df3c727fe0b3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:22.445572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c2ebcd54-c46b-449d-9d58-4eac8820354d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:22.449603 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c2ebcd54-c46b-449d-9d58-4eac8820354d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:22.468897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2ebcd54-c46b-449d-9d58-4eac8820354d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:22.469408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2ebcd54-c46b-449d-9d58-4eac8820354d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:22.470485 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2ebcd54-c46b-449d-9d58-4eac8820354d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:22.471215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2ebcd54-c46b-449d-9d58-4eac8820354d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:22.484985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2ebcd54-c46b-449d-9d58-4eac8820354d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:22.485741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2ebcd54-c46b-449d-9d58-4eac8820354d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:22.525251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c2ebcd54-c46b-449d-9d58-4eac8820354d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:04:22.691398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1f017d4a-1dfe-4cbb-aac4-df3c727fe0b3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:22.702822 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1f017d4a-1dfe-4cbb-aac4-df3c727fe0b3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a" status: 200 len: 1479 microversion: 2.1 time: 0.307892 Aug 04 17:04:22.730593 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1175/2431] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:22 2022] GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a => generated 1479 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:22.731930 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c2ebcd54-c46b-449d-9d58-4eac8820354d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b" status: 204 len: 0 microversion: 2.1 time: 0.295849 Aug 04 17:04:22.734594 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1257/2432] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:04:22 2022] DELETE /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:04:22.745095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a1d5b4df-176d-4f9c-b85a-07ed6d6ebfea tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5b9ad9d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:22.745319 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6d014cbe-519c-4368-b53a-91a8f1b0c09d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1797430052"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:22.754840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6d014cbe-519c-4368-b53a-91a8f1b0c09d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 30e66be0-1c2b-401d-8e17-1271b1910f4a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:22.793247 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d014cbe-519c-4368-b53a-91a8f1b0c09d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:22.800311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d014cbe-519c-4368-b53a-91a8f1b0c09d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:22.801086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d014cbe-519c-4368-b53a-91a8f1b0c09d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:22.802225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d014cbe-519c-4368-b53a-91a8f1b0c09d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:22.802938 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d014cbe-519c-4368-b53a-91a8f1b0c09d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:22.803609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d014cbe-519c-4368-b53a-91a8f1b0c09d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:22.831442 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a1d5b4df-176d-4f9c-b85a-07ed6d6ebfea tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257" status: 200 len: 1452 microversion: 2.1 time: 0.098100 Aug 04 17:04:22.832655 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1176/2433] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:22 2022] GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257 => generated 1452 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:22.854907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-799ed2d8-a57c-41d9-96c4-c85851d1146c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:22.874091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-799ed2d8-a57c-41d9-96c4-c85851d1146c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:22.908930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-799ed2d8-a57c-41d9-96c4-c85851d1146c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:22.910578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-799ed2d8-a57c-41d9-96c4-c85851d1146c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:22.912919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-799ed2d8-a57c-41d9-96c4-c85851d1146c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:22.916502 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-799ed2d8-a57c-41d9-96c4-c85851d1146c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:22.917959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-799ed2d8-a57c-41d9-96c4-c85851d1146c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:22.918191 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-799ed2d8-a57c-41d9-96c4-c85851d1146c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:23.211305 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6d014cbe-519c-4368-b53a-91a8f1b0c09d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "POST /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a/action" status: 202 len: 0 microversion: 2.1 time: 0.473745 Aug 04 17:04:23.212283 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1258/2434] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:04:22 2022] POST /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 17:04:23.219039 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e1b0ec20-401b-425d-a61c-70fc188f6ffd tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:23.220100 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e1b0ec20-401b-425d-a61c-70fc188f6ffd tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] [instance: 7f02288b-9e88-4277-bc31-ae355dadd181] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:23.227475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1b0ec20-401b-425d-a61c-70fc188f6ffd tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:23.228465 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1b0ec20-401b-425d-a61c-70fc188f6ffd tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:23.229283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1b0ec20-401b-425d-a61c-70fc188f6ffd tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:23.231658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1b0ec20-401b-425d-a61c-70fc188f6ffd tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:23.232482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1b0ec20-401b-425d-a61c-70fc188f6ffd tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:23.234148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1b0ec20-401b-425d-a61c-70fc188f6ffd tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:23.450367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-799ed2d8-a57c-41d9-96c4-c85851d1146c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:23.471074 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-799ed2d8-a57c-41d9-96c4-c85851d1146c tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b" status: 200 len: 1494 microversion: 2.1 time: 0.635418 Aug 04 17:04:23.476691 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1177/2435] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:22 2022] GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b => generated 1494 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:23.485560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-15ef547c-ed87-4ee9-8839-9e936bfbbe5e tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5baad1f0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:23.555215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e1b0ec20-401b-425d-a61c-70fc188f6ffd tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829341e13cf9427b91854d5f285605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb1953e32b545b1b9c09ba8015038c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:23.577968 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e1b0ec20-401b-425d-a61c-70fc188f6ffd tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] 10.222.0.93 "GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181" status: 200 len: 1313 microversion: 2.1 time: 0.363613 Aug 04 17:04:23.582678 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-15ef547c-ed87-4ee9-8839-9e936bfbbe5e tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b" status: 200 len: 1436 microversion: 2.1 time: 0.104417 Aug 04 17:04:23.584414 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1259/2436] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:23 2022] GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181 => generated 1313 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:23.605944 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1178/2437] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:23 2022] GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b => generated 1436 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:23.849276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7c7fe4c4-ced4-46d6-a2c4-c33a9db5f84a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5afcde50>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:23.932148 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7c7fe4c4-ced4-46d6-a2c4-c33a9db5f84a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257" status: 200 len: 1452 microversion: 2.1 time: 0.088860 Aug 04 17:04:23.936114 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1260/2438] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:23 2022] GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257 => generated 1452 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:24.498465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3d85e02f-dd55-4fc1-93c7-9667b804f0fa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:24.499083 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3d85e02f-dd55-4fc1-93c7-9667b804f0fa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:24.511858 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d85e02f-dd55-4fc1-93c7-9667b804f0fa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:24.513466 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d85e02f-dd55-4fc1-93c7-9667b804f0fa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:24.515993 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d85e02f-dd55-4fc1-93c7-9667b804f0fa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:24.521699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d85e02f-dd55-4fc1-93c7-9667b804f0fa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:24.522444 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d85e02f-dd55-4fc1-93c7-9667b804f0fa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:24.523349 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d85e02f-dd55-4fc1-93c7-9667b804f0fa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:24.612288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cd31febd-4dd3-4c19-bf17-7177653943c6 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:24.613004 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cd31febd-4dd3-4c19-bf17-7177653943c6 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] [instance: 7f02288b-9e88-4277-bc31-ae355dadd181] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:24.621235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd31febd-4dd3-4c19-bf17-7177653943c6 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:24.622073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd31febd-4dd3-4c19-bf17-7177653943c6 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:24.622699 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd31febd-4dd3-4c19-bf17-7177653943c6 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:24.623595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd31febd-4dd3-4c19-bf17-7177653943c6 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:24.624235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd31febd-4dd3-4c19-bf17-7177653943c6 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:24.624850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd31febd-4dd3-4c19-bf17-7177653943c6 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:24.884115 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3d85e02f-dd55-4fc1-93c7-9667b804f0fa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:24.896504 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3d85e02f-dd55-4fc1-93c7-9667b804f0fa tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b" status: 200 len: 1494 microversion: 2.1 time: 0.403185 Aug 04 17:04:24.899646 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1179/2439] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:24 2022] GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b => generated 1494 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:24.918197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6678825d-93bf-40ef-88e8-b72a70691d46 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5b523dc0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:24.990605 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cd31febd-4dd3-4c19-bf17-7177653943c6 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829341e13cf9427b91854d5f285605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb1953e32b545b1b9c09ba8015038c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:25.002288 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cd31febd-4dd3-4c19-bf17-7177653943c6 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] 10.222.0.93 "GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181" status: 200 len: 1313 microversion: 2.1 time: 0.395414 Aug 04 17:04:25.019160 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1261/2440] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:24 2022] GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181 => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:25.053031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b9e2428a-1db4-43c3-a172-a7b373c80192 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5b05f5e0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:25.060609 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6678825d-93bf-40ef-88e8-b72a70691d46 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b" status: 200 len: 1436 microversion: 2.1 time: 0.142847 Aug 04 17:04:25.068454 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1180/2441] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:24 2022] GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b => generated 1436 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:25.149543 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b9e2428a-1db4-43c3-a172-a7b373c80192 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257" status: 200 len: 1452 microversion: 2.1 time: 0.139448 Aug 04 17:04:25.150189 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1262/2442] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:25 2022] GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257 => generated 1452 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:25.214191 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-20f50ea3-0865-4406-9c1e-70479260fc2b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1378034227", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "0fa2ebc8-4125-4b29-9ccb-429d71faf3e4"}, {"uuid": "017403dc-6ab4-4d72-a6f3-2315f9be9aa8"}, {"uuid": "0fa2ebc8-4125-4b29-9ccb-429d71faf3e4"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:25.304515 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-20f50ea3-0865-4406-9c1e-70479260fc2b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] validate_networks() for [('0fa2ebc8-4125-4b29-9ccb-429d71faf3e4', None, None, None, None, None), ('017403dc-6ab4-4d72-a6f3-2315f9be9aa8', None, None, None, None, None), ('0fa2ebc8-4125-4b29-9ccb-429d71faf3e4', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:04:25.919466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b0be5309-350e-43e5-a12b-5190e456c624 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:25.920720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b0be5309-350e-43e5-a12b-5190e456c624 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:25.936670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0be5309-350e-43e5-a12b-5190e456c624 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:25.937475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0be5309-350e-43e5-a12b-5190e456c624 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:25.948176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0be5309-350e-43e5-a12b-5190e456c624 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:25.950653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0be5309-350e-43e5-a12b-5190e456c624 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:25.952497 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0be5309-350e-43e5-a12b-5190e456c624 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:25.954637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0be5309-350e-43e5-a12b-5190e456c624 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:26.166355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b0be5309-350e-43e5-a12b-5190e456c624 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:26.216480 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b0be5309-350e-43e5-a12b-5190e456c624 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b" status: 200 len: 1452 microversion: 2.1 time: 0.300923 Aug 04 17:04:26.217136 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1263/2443] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:25 2022] GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b => generated 1452 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:26.245847 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-d44b3d35-bf36-45f1-88fe-174950dc02e8 req-c86ac299-6b0d-411c-9b64-ab0052cff287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8622154b-7c51-4c6c-9652-f81e32e35f7b", "name": "network-vif-deleted", "tag": "db19c01b-063e-454a-9199-c6e2117589bd"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:26.287246 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d44b3d35-bf36-45f1-88fe-174950dc02e8 req-c86ac299-6b0d-411c-9b64-ab0052cff287 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:26.288227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d44b3d35-bf36-45f1-88fe-174950dc02e8 req-c86ac299-6b0d-411c-9b64-ab0052cff287 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:26.289172 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d44b3d35-bf36-45f1-88fe-174950dc02e8 req-c86ac299-6b0d-411c-9b64-ab0052cff287 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:26.343772 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-d44b3d35-bf36-45f1-88fe-174950dc02e8 req-c86ac299-6b0d-411c-9b64-ab0052cff287 service nova] Creating event network-vif-deleted:db19c01b-063e-454a-9199-c6e2117589bd for instance 8622154b-7c51-4c6c-9652-f81e32e35f7b on n-h1-851359-3 Aug 04 17:04:26.357121 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-d44b3d35-bf36-45f1-88fe-174950dc02e8 req-c86ac299-6b0d-411c-9b64-ab0052cff287 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125799 Aug 04 17:04:26.359633 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1264/2444] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:26.379915 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-94190f2e-dcd8-4a0b-bf81-4e6ed7da0a47 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:26.381046 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-94190f2e-dcd8-4a0b-bf81-4e6ed7da0a47 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] [instance: 7f02288b-9e88-4277-bc31-ae355dadd181] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:26.398865 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94190f2e-dcd8-4a0b-bf81-4e6ed7da0a47 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:26.400635 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94190f2e-dcd8-4a0b-bf81-4e6ed7da0a47 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:26.401479 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94190f2e-dcd8-4a0b-bf81-4e6ed7da0a47 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:26.403837 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94190f2e-dcd8-4a0b-bf81-4e6ed7da0a47 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:26.405488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94190f2e-dcd8-4a0b-bf81-4e6ed7da0a47 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:26.406352 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94190f2e-dcd8-4a0b-bf81-4e6ed7da0a47 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:27.015773 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-94190f2e-dcd8-4a0b-bf81-4e6ed7da0a47 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829341e13cf9427b91854d5f285605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb1953e32b545b1b9c09ba8015038c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:27.019923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:27.033707 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-94190f2e-dcd8-4a0b-bf81-4e6ed7da0a47 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] 10.222.0.93 "GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181" status: 200 len: 1313 microversion: 2.1 time: 0.668199 Aug 04 17:04:27.050106 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1265/2445] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:26 2022] GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181 => generated 1313 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:27.057718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-39fe43e8-f8a1-4b17-adee-6d8d9ee3e209 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5b030940>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:27.137773 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-39fe43e8-f8a1-4b17-adee-6d8d9ee3e209 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b" status: 200 len: 1436 microversion: 2.1 time: 0.086326 Aug 04 17:04:27.138409 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1266/2446] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:27 2022] GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b => generated 1436 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:27.158002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c6b10252-3fcf-44f4-94c7-e59b6cba1bef tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5b05f430>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:27.246346 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c6b10252-3fcf-44f4-94c7-e59b6cba1bef tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257" status: 200 len: 1452 microversion: 2.1 time: 0.105140 Aug 04 17:04:27.259055 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1267/2447] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:27 2022] GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257 => generated 1452 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:27.266999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-556cfb96-d928-4ab6-ae46-87210965de34 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:27.267929 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-556cfb96-d928-4ab6-ae46-87210965de34 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:27.283765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-556cfb96-d928-4ab6-ae46-87210965de34 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:27.284606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-556cfb96-d928-4ab6-ae46-87210965de34 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:27.286992 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-556cfb96-d928-4ab6-ae46-87210965de34 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:27.288112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-556cfb96-d928-4ab6-ae46-87210965de34 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:27.288806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-556cfb96-d928-4ab6-ae46-87210965de34 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:27.289868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-556cfb96-d928-4ab6-ae46-87210965de34 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:27.331266 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-556cfb96-d928-4ab6-ae46-87210965de34 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] HTTP exception thrown: Instance 8622154b-7c51-4c6c-9652-f81e32e35f7b could not be found. Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-556cfb96-d928-4ab6-ae46-87210965de34 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Request method failure captured: Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b HTTP/1.1 Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_r18zhXKrUNPkTcrqBpyOxEtqmRnN_52CLFZjb6_V1_cyggOBj-ig1uBg8_Jl5DEv1edGlVMK7wsNG9aSNASIbB3U35pyAy7fX4gAPexD_7GsQqaSV2-qce83lQvxIJx4U5ZPEYYCvd7_VfIsOpvvr8aQqah0W-5V3XON-ztAeWk4Y Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/92bb708c7ba24e4d828f19ecc60e1f91"}]}] Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 6d19d8e7953b4e479b4e2143a3c3546a Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 8622154b-7c51-4c6c-9652-f81e32e35f7b could not be found. Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '8622154b-7c51-4c6c-9652-f81e32e35f7b'} Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8622154b-7c51-4c6c-9652-f81e32e35f7b could not be found. Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8622154b-7c51-4c6c-9652-f81e32e35f7b could not be found. Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:27.333846 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:27.337704 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:27.337704 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:27.337704 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:27.337704 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:04:27.337704 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:04:27.337704 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8622154b-7c51-4c6c-9652-f81e32e35f7b could not be found. Aug 04 17:04:27.337704 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:27.340111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-556cfb96-d928-4ab6-ae46-87210965de34 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Returning 404 to user: Instance 8622154b-7c51-4c6c-9652-f81e32e35f7b could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:04:27.341461 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-556cfb96-d928-4ab6-ae46-87210965de34 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b" status: 404 len: 111 microversion: 2.1 time: 0.081185 Aug 04 17:04:27.342227 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1268/2448] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:27 2022] GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:04:27.353224 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-20f50ea3-0865-4406-9c1e-70479260fc2b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:04:27.353724 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-20f50ea3-0865-4406-9c1e-70479260fc2b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:04:27.355540 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-20f50ea3-0865-4406-9c1e-70479260fc2b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:04:27.357024 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-20f50ea3-0865-4406-9c1e-70479260fc2b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:04:27.357560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-20f50ea3-0865-4406-9c1e-70479260fc2b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:04:27.378832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20f50ea3-0865-4406-9c1e-70479260fc2b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:27.379487 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20f50ea3-0865-4406-9c1e-70479260fc2b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:27.383331 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20f50ea3-0865-4406-9c1e-70479260fc2b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:27.384326 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20f50ea3-0865-4406-9c1e-70479260fc2b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:27.384919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20f50ea3-0865-4406-9c1e-70479260fc2b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:27.385459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20f50ea3-0865-4406-9c1e-70479260fc2b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:27.465794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-20f50ea3-0865-4406-9c1e-70479260fc2b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Getting quotas for project 12dc616249934210aab2670a55053ecc. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:04:27.472322 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-20f50ea3-0865-4406-9c1e-70479260fc2b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Getting quotas for user 234245a6fb7c441aa667a4ad619c1986 and project 12dc616249934210aab2670a55053ecc. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:04:27.492212 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-20f50ea3-0865-4406-9c1e-70479260fc2b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:04:27.506732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-20f50ea3-0865-4406-9c1e-70479260fc2b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: baaeefae-c19a-4102-9fc8-245f638aaf45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:04:27.547388 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f1a64f6c-d2b8-4215-ab8b-a2e98a5a8016 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-708394256", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "bed30c3f-0c01-4418-9c95-0bb7a79e1c34"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:27.657566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-f1a64f6c-d2b8-4215-ab8b-a2e98a5a8016 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] validate_networks() for [('bed30c3f-0c01-4418-9c95-0bb7a79e1c34', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:04:27.721323 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-20f50ea3-0865-4406-9c1e-70479260fc2b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.509158 Aug 04 17:04:27.734226 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1181/2449] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:04:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:04:27.762071 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bfea875c-8930-4939-8dc3-2dbb0c07c5c3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:27.764182 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bfea875c-8930-4939-8dc3-2dbb0c07c5c3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: baaeefae-c19a-4102-9fc8-245f638aaf45] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:27.992662 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bfea875c-8930-4939-8dc3-2dbb0c07c5c3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:28.005814 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bfea875c-8930-4939-8dc3-2dbb0c07c5c3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45" status: 200 len: 1213 microversion: 2.1 time: 0.270265 Aug 04 17:04:28.006892 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1182/2450] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:27 2022] GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45 => generated 1213 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:28.072785 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d7225956-2765-4a83-9273-079569ed9d36 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:28.074378 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d7225956-2765-4a83-9273-079569ed9d36 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] [instance: 7f02288b-9e88-4277-bc31-ae355dadd181] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:28.087522 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7225956-2765-4a83-9273-079569ed9d36 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:28.089737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7225956-2765-4a83-9273-079569ed9d36 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:28.092900 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7225956-2765-4a83-9273-079569ed9d36 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:28.093872 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7225956-2765-4a83-9273-079569ed9d36 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:28.095057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7225956-2765-4a83-9273-079569ed9d36 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:28.098916 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7225956-2765-4a83-9273-079569ed9d36 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:28.648657 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d7225956-2765-4a83-9273-079569ed9d36 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829341e13cf9427b91854d5f285605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb1953e32b545b1b9c09ba8015038c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:28.660812 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d7225956-2765-4a83-9273-079569ed9d36 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] 10.222.0.93 "GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181" status: 200 len: 1313 microversion: 2.1 time: 0.605373 Aug 04 17:04:28.679438 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1183/2451] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:28 2022] GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181 => generated 1313 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:04:28.690998 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e810acb0-dc1b-4b6a-acfa-2da965d97944 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e6c942ee0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:28.798600 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e810acb0-dc1b-4b6a-acfa-2da965d97944 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b" status: 200 len: 1436 microversion: 2.1 time: 0.117792 Aug 04 17:04:28.806046 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1184/2452] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:28 2022] GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b => generated 1436 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:28.806046 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fa5e536f-f00e-408b-b49b-5cd16a42ad0d tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5bb95670>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:28.928457 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fa5e536f-f00e-408b-b49b-5cd16a42ad0d tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257" status: 200 len: 1452 microversion: 2.1 time: 0.127714 Aug 04 17:04:28.935594 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1185/2453] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:28 2022] GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257 => generated 1452 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:29.027775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ea824009-2339-44f3-980c-c0fc3ea53c75 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:29.028630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ea824009-2339-44f3-980c-c0fc3ea53c75 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: baaeefae-c19a-4102-9fc8-245f638aaf45] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:29.048212 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea824009-2339-44f3-980c-c0fc3ea53c75 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:29.051059 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea824009-2339-44f3-980c-c0fc3ea53c75 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:29.057408 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea824009-2339-44f3-980c-c0fc3ea53c75 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:29.058406 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea824009-2339-44f3-980c-c0fc3ea53c75 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:29.061440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea824009-2339-44f3-980c-c0fc3ea53c75 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:29.061891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea824009-2339-44f3-980c-c0fc3ea53c75 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:29.261037 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-f1a64f6c-d2b8-4215-ab8b-a2e98a5a8016 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:04:29.261638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-f1a64f6c-d2b8-4215-ab8b-a2e98a5a8016 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:04:29.261943 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-f1a64f6c-d2b8-4215-ab8b-a2e98a5a8016 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:04:29.262390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-f1a64f6c-d2b8-4215-ab8b-a2e98a5a8016 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:04:29.262813 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-f1a64f6c-d2b8-4215-ab8b-a2e98a5a8016 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:04:29.269600 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ea824009-2339-44f3-980c-c0fc3ea53c75 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:29.281028 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ea824009-2339-44f3-980c-c0fc3ea53c75 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45" status: 200 len: 1217 microversion: 2.1 time: 0.257748 Aug 04 17:04:29.302631 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1186/2454] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:29 2022] GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45 => generated 1217 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:29.310894 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1a64f6c-d2b8-4215-ab8b-a2e98a5a8016 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:29.311630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1a64f6c-d2b8-4215-ab8b-a2e98a5a8016 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:29.312235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1a64f6c-d2b8-4215-ab8b-a2e98a5a8016 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:29.313183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b267ee1e-17fc-4a3e-9b6e-75b5780c5727 req-90a76419-6696-4f44-9766-5bc4f36084f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f02288b-9e88-4277-bc31-ae355dadd181", "name": "network-vif-plugged", "status": "completed", "tag": "ebdb02cb-020d-408d-aea7-23152b943370"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:29.314727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1a64f6c-d2b8-4215-ab8b-a2e98a5a8016 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:29.320298 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1a64f6c-d2b8-4215-ab8b-a2e98a5a8016 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:29.321609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1a64f6c-d2b8-4215-ab8b-a2e98a5a8016 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:29.336713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b267ee1e-17fc-4a3e-9b6e-75b5780c5727 req-90a76419-6696-4f44-9766-5bc4f36084f3 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:29.339507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b267ee1e-17fc-4a3e-9b6e-75b5780c5727 req-90a76419-6696-4f44-9766-5bc4f36084f3 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:29.343905 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b267ee1e-17fc-4a3e-9b6e-75b5780c5727 req-90a76419-6696-4f44-9766-5bc4f36084f3 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:29.364283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-f1a64f6c-d2b8-4215-ab8b-a2e98a5a8016 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Getting quotas for project 92bb708c7ba24e4d828f19ecc60e1f91. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:04:29.376504 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b267ee1e-17fc-4a3e-9b6e-75b5780c5727 req-90a76419-6696-4f44-9766-5bc4f36084f3 service nova] Creating event network-vif-plugged:ebdb02cb-020d-408d-aea7-23152b943370 for instance 7f02288b-9e88-4277-bc31-ae355dadd181 on n-h1-851359-3 Aug 04 17:04:29.381726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-f1a64f6c-d2b8-4215-ab8b-a2e98a5a8016 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Getting quotas for user 6d19d8e7953b4e479b4e2143a3c3546a and project 92bb708c7ba24e4d828f19ecc60e1f91. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:04:29.386333 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b267ee1e-17fc-4a3e-9b6e-75b5780c5727 req-90a76419-6696-4f44-9766-5bc4f36084f3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082066 Aug 04 17:04:29.390081 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1187/2455] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:29.399431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f1a64f6c-d2b8-4215-ab8b-a2e98a5a8016 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:04:29.402688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f1a64f6c-d2b8-4215-ab8b-a2e98a5a8016 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b28c38d-e8d7-4a4e-9335-6cd5acd17876] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:04:29.498042 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f1a64f6c-d2b8-4215-ab8b-a2e98a5a8016 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.960163 Aug 04 17:04:29.499743 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1269/2456] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:04:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 17:04:29.511664 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-50476691-ba4e-4a81-b14a-9103a90f1e60 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:29.512380 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-50476691-ba4e-4a81-b14a-9103a90f1e60 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b28c38d-e8d7-4a4e-9335-6cd5acd17876] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:29.515636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:29.704715 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5bfadc42-3ed0-4209-bd2d-c27c7b6a0e7c tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:29.705752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5bfadc42-3ed0-4209-bd2d-c27c7b6a0e7c tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] [instance: 7f02288b-9e88-4277-bc31-ae355dadd181] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:29.713648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5bfadc42-3ed0-4209-bd2d-c27c7b6a0e7c tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:29.714698 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5bfadc42-3ed0-4209-bd2d-c27c7b6a0e7c tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:29.715407 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5bfadc42-3ed0-4209-bd2d-c27c7b6a0e7c tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:29.716829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5bfadc42-3ed0-4209-bd2d-c27c7b6a0e7c tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:29.717724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5bfadc42-3ed0-4209-bd2d-c27c7b6a0e7c tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:29.718522 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5bfadc42-3ed0-4209-bd2d-c27c7b6a0e7c tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:29.760804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-50476691-ba4e-4a81-b14a-9103a90f1e60 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:29.790816 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-50476691-ba4e-4a81-b14a-9103a90f1e60 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876" status: 200 len: 1214 microversion: 2.1 time: 0.283304 Aug 04 17:04:29.809618 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1188/2457] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:29 2022] GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876 => generated 1214 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:04:29.818678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5028bddf-480d-450e-840b-732562643f8d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5bb86a60>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:30.009423 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5028bddf-480d-450e-840b-732562643f8d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b" status: 200 len: 1436 microversion: 2.1 time: 0.163589 Aug 04 17:04:30.009423 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1189/2458] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:29 2022] GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b => generated 1436 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:30.028336 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ba359223-44a8-4ba0-9042-eb1226723c51 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e6c908f70>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:30.187392 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ba359223-44a8-4ba0-9042-eb1226723c51 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257" status: 200 len: 1452 microversion: 2.1 time: 0.188224 Aug 04 17:04:30.190893 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1190/2459] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:29 2022] GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257 => generated 1452 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:30.357359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5bfadc42-3ed0-4209-bd2d-c27c7b6a0e7c tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829341e13cf9427b91854d5f285605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb1953e32b545b1b9c09ba8015038c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:30.381176 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5bfadc42-3ed0-4209-bd2d-c27c7b6a0e7c tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] 10.222.0.93 "GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181" status: 200 len: 1313 microversion: 2.1 time: 0.688186 Aug 04 17:04:30.388563 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1270/2460] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:29 2022] GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181 => generated 1313 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:30.395846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-573a5fd4-4893-4f8b-9f43-dcc1c41efcf3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:30.397396 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-573a5fd4-4893-4f8b-9f43-dcc1c41efcf3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: baaeefae-c19a-4102-9fc8-245f638aaf45] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:30.411253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-573a5fd4-4893-4f8b-9f43-dcc1c41efcf3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:30.426993 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-573a5fd4-4893-4f8b-9f43-dcc1c41efcf3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:30.427813 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-573a5fd4-4893-4f8b-9f43-dcc1c41efcf3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:30.428800 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-573a5fd4-4893-4f8b-9f43-dcc1c41efcf3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:30.432447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-573a5fd4-4893-4f8b-9f43-dcc1c41efcf3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:30.433138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-573a5fd4-4893-4f8b-9f43-dcc1c41efcf3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:30.509757 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ba99c591-8895-4b4d-8032-57bd3105f854 tempest-QuotaClassesAdminTestJSON-2029695984 tempest-QuotaClassesAdminTestJSON-2029695984-project-admin] Calling method '.version_select at 0x7f1e5bb79790>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:30.511235 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:04:30.511235 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 17:04:30.551892 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ba99c591-8895-4b4d-8032-57bd3105f854 tempest-QuotaClassesAdminTestJSON-2029695984 tempest-QuotaClassesAdminTestJSON-2029695984-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.359485 Aug 04 17:04:30.552714 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1191/2461] 10.222.0.93 () {58 vars in 1185 bytes} [Thu Aug 4 17:04:30 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:30.564864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-14f45616-bcff-4dc3-9887-11c05206d01c tempest-QuotaClassesAdminTestJSON-2029695984 tempest-QuotaClassesAdminTestJSON-2029695984-project-admin] Action: 'update', calling method: .version_select at 0x7f1e5bb79ca0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:30.568743 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:04:30.568743 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 17:04:30.622942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-573a5fd4-4893-4f8b-9f43-dcc1c41efcf3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:30.633927 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-573a5fd4-4893-4f8b-9f43-dcc1c41efcf3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45" status: 200 len: 1283 microversion: 2.1 time: 0.243234 Aug 04 17:04:30.635144 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1271/2462] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:30 2022] GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45 => generated 1283 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:30.857353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f08420ea-98ff-461b-ad40-ad66139ea59a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:30.858027 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f08420ea-98ff-461b-ad40-ad66139ea59a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b28c38d-e8d7-4a4e-9335-6cd5acd17876] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:30.988202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f08420ea-98ff-461b-ad40-ad66139ea59a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:31.002768 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f08420ea-98ff-461b-ad40-ad66139ea59a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876" status: 200 len: 1214 microversion: 2.1 time: 0.149617 Aug 04 17:04:31.004267 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1272/2463] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:30 2022] GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876 => generated 1214 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:31.025819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bcca32dc-79b2-4a7e-bcb6-f150584eccd0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5b9d8670>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:31.122572 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-14f45616-bcff-4dc3-9887-11c05206d01c tempest-QuotaClassesAdminTestJSON-2029695984 tempest-QuotaClassesAdminTestJSON-2029695984-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.561891 Aug 04 17:04:31.123471 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1192/2464] 10.222.0.93 () {60 vars in 1206 bytes} [Thu Aug 4 17:04:30 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:04:31.146998 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-40fcc4e9-554b-4629-aebf-0565216c7a3f tempest-QuotaClassesAdminTestJSON-2029695984 tempest-QuotaClassesAdminTestJSON-2029695984-project-admin] Calling method '.version_select at 0x7f1e5bce7700>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:31.178219 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-40fcc4e9-554b-4629-aebf-0565216c7a3f tempest-QuotaClassesAdminTestJSON-2029695984 tempest-QuotaClassesAdminTestJSON-2029695984-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.039123 Aug 04 17:04:31.195288 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bcca32dc-79b2-4a7e-bcb6-f150584eccd0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b" status: 200 len: 1436 microversion: 2.1 time: 0.180536 Aug 04 17:04:31.199619 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1193/2465] 10.222.0.93 () {58 vars in 1185 bytes} [Thu Aug 4 17:04:31 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:31.200324 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1273/2466] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:31 2022] GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b => generated 1436 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:31.216226 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9417018f-ef6a-4166-92d5-f831e162a740 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5bb863a0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:31.229002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e06d7e1d-f98a-45d0-acad-e229e32ddff9 tempest-QuotaClassesAdminTestJSON-2029695984 tempest-QuotaClassesAdminTestJSON-2029695984-project-admin] Action: 'update', calling method: .version_select at 0x7f1e5b19eb80>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:31.233401 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:04:31.233401 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 17:04:31.260441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:31.516483 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e06d7e1d-f98a-45d0-acad-e229e32ddff9 tempest-QuotaClassesAdminTestJSON-2029695984 tempest-QuotaClassesAdminTestJSON-2029695984-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.309135 Aug 04 17:04:31.531204 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1274/2467] 10.222.0.93 () {60 vars in 1206 bytes} [Thu Aug 4 17:04:31 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:31.536502 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8a041373-2f3f-4fd9-9249-b2c295656233 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:31.553403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8a041373-2f3f-4fd9-9249-b2c295656233 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] [instance: 7f02288b-9e88-4277-bc31-ae355dadd181] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:31.601631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a041373-2f3f-4fd9-9249-b2c295656233 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:31.615408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a041373-2f3f-4fd9-9249-b2c295656233 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:31.616096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a041373-2f3f-4fd9-9249-b2c295656233 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:31.617698 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a041373-2f3f-4fd9-9249-b2c295656233 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:31.622231 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a041373-2f3f-4fd9-9249-b2c295656233 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:31.623839 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a041373-2f3f-4fd9-9249-b2c295656233 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:31.944886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8a041373-2f3f-4fd9-9249-b2c295656233 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829341e13cf9427b91854d5f285605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb1953e32b545b1b9c09ba8015038c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:31.981962 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8a041373-2f3f-4fd9-9249-b2c295656233 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] 10.222.0.93 "GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181" status: 200 len: 1313 microversion: 2.1 time: 0.446953 Aug 04 17:04:31.986891 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1275/2468] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:31 2022] GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181 => generated 1313 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:31.996073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-17d69373-6cc1-4e42-ab95-c065df1ade0c tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:31.997303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-17d69373-6cc1-4e42-ab95-c065df1ade0c tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: baaeefae-c19a-4102-9fc8-245f638aaf45] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:32.014313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-17d69373-6cc1-4e42-ab95-c065df1ade0c tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:32.015756 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-17d69373-6cc1-4e42-ab95-c065df1ade0c tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:32.019150 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-17d69373-6cc1-4e42-ab95-c065df1ade0c tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:32.025422 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-17d69373-6cc1-4e42-ab95-c065df1ade0c tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:32.026416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-17d69373-6cc1-4e42-ab95-c065df1ade0c tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:32.028437 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-17d69373-6cc1-4e42-ab95-c065df1ade0c tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:32.247822 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-17d69373-6cc1-4e42-ab95-c065df1ade0c tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:32.263129 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-17d69373-6cc1-4e42-ab95-c065df1ade0c tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45" status: 200 len: 1271 microversion: 2.1 time: 0.272180 Aug 04 17:04:32.263751 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1276/2469] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:31 2022] GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45 => generated 1271 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:32.286831 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-53c0f68a-93f9-40ce-b679-8e95866704f1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:32.288743 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-53c0f68a-93f9-40ce-b679-8e95866704f1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b28c38d-e8d7-4a4e-9335-6cd5acd17876] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:32.330244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53c0f68a-93f9-40ce-b679-8e95866704f1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:32.333053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53c0f68a-93f9-40ce-b679-8e95866704f1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:32.333525 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53c0f68a-93f9-40ce-b679-8e95866704f1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:32.339151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53c0f68a-93f9-40ce-b679-8e95866704f1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:32.339740 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53c0f68a-93f9-40ce-b679-8e95866704f1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:32.340200 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53c0f68a-93f9-40ce-b679-8e95866704f1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:32.558138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-53c0f68a-93f9-40ce-b679-8e95866704f1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:32.580730 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-53c0f68a-93f9-40ce-b679-8e95866704f1 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876" status: 200 len: 1274 microversion: 2.1 time: 0.309985 Aug 04 17:04:32.595219 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1277/2470] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:32 2022] GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876 => generated 1274 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:32.595219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-57dd6158-afba-4238-a5f1-1f5c6f1c964a tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e6c9ad3a0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:32.895815 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9417018f-ef6a-4166-92d5-f831e162a740 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257" status: 200 len: 1461 microversion: 2.1 time: 1.694576 Aug 04 17:04:32.897006 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1194/2471] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:31 2022] GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257 => generated 1461 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:32.910869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5115e913-6b90-4f54-b8e3-c456a5523d1d tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5bb86a60>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:32.932733 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-57dd6158-afba-4238-a5f1-1f5c6f1c964a tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b" status: 200 len: 1436 microversion: 2.1 time: 0.347376 Aug 04 17:04:32.933668 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1278/2472] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:32 2022] GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b => generated 1436 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:33.020047 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1ca57a14-0aea-4e91-abbb-7e4e854287e0 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:33.020759 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1ca57a14-0aea-4e91-abbb-7e4e854287e0 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] [instance: 7f02288b-9e88-4277-bc31-ae355dadd181] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:33.049024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ca57a14-0aea-4e91-abbb-7e4e854287e0 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:33.049517 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ca57a14-0aea-4e91-abbb-7e4e854287e0 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:33.050135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ca57a14-0aea-4e91-abbb-7e4e854287e0 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:33.066926 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5115e913-6b90-4f54-b8e3-c456a5523d1d tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257" status: 200 len: 1461 microversion: 2.1 time: 0.160039 Aug 04 17:04:33.070389 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1195/2473] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:32 2022] GET /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257 => generated 1461 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:33.070964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ca57a14-0aea-4e91-abbb-7e4e854287e0 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:33.071625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ca57a14-0aea-4e91-abbb-7e4e854287e0 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:33.072231 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ca57a14-0aea-4e91-abbb-7e4e854287e0 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:33.088595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-22a23f9b-daa5-4fec-8794-e11975bcb136 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:33.093756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-22a23f9b-daa5-4fec-8794-e11975bcb136 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: ba09cec5-a546-4fe5-90df-c90d94591fb2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:33.120092 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-22a23f9b-daa5-4fec-8794-e11975bcb136 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:33.121846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-22a23f9b-daa5-4fec-8794-e11975bcb136 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:33.124151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-22a23f9b-daa5-4fec-8794-e11975bcb136 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:33.125154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-22a23f9b-daa5-4fec-8794-e11975bcb136 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:33.126690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-22a23f9b-daa5-4fec-8794-e11975bcb136 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:33.128747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-22a23f9b-daa5-4fec-8794-e11975bcb136 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:33.142864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:33.458561 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1ca57a14-0aea-4e91-abbb-7e4e854287e0 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829341e13cf9427b91854d5f285605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb1953e32b545b1b9c09ba8015038c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:33.476799 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1ca57a14-0aea-4e91-abbb-7e4e854287e0 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] 10.222.0.93 "GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181" status: 200 len: 1463 microversion: 2.1 time: 0.469330 Aug 04 17:04:33.490014 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1279/2474] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:33 2022] GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181 => generated 1463 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:33.490014 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7580fd2e-1a35-4aed-b782-6bdd9f0f57c9 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:33.490014 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7580fd2e-1a35-4aed-b782-6bdd9f0f57c9 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: baaeefae-c19a-4102-9fc8-245f638aaf45] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:33.504191 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7580fd2e-1a35-4aed-b782-6bdd9f0f57c9 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:33.506542 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7580fd2e-1a35-4aed-b782-6bdd9f0f57c9 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:33.507245 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7580fd2e-1a35-4aed-b782-6bdd9f0f57c9 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:33.508000 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7580fd2e-1a35-4aed-b782-6bdd9f0f57c9 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:33.508484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7580fd2e-1a35-4aed-b782-6bdd9f0f57c9 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:33.508929 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7580fd2e-1a35-4aed-b782-6bdd9f0f57c9 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:33.829181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-22a23f9b-daa5-4fec-8794-e11975bcb136 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a373cb0cd004b65a4ea9c804cbea3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82de1eabf714c3492860c2a65df5ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:33.838956 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-22a23f9b-daa5-4fec-8794-e11975bcb136 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/servers/ba09cec5-a546-4fe5-90df-c90d94591fb2" status: 200 len: 1480 microversion: 2.1 time: 0.758364 Aug 04 17:04:33.841873 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1196/2475] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:33 2022] GET /compute/v2.1/servers/ba09cec5-a546-4fe5-90df-c90d94591fb2 => generated 1480 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:33.852739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-6ff6757b-6388-4e7c-93ef-56b341c9eec8 req-32ae4ccc-3796-43a9-a161-66a2fdd230b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30e66be0-1c2b-401d-8e17-1271b1910f4a", "name": "network-vif-plugged", "status": "completed", "tag": "93b8fa03-1f37-431c-b87c-431cafd2680c"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:33.872200 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6ff6757b-6388-4e7c-93ef-56b341c9eec8 req-32ae4ccc-3796-43a9-a161-66a2fdd230b2 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:33.875024 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6ff6757b-6388-4e7c-93ef-56b341c9eec8 req-32ae4ccc-3796-43a9-a161-66a2fdd230b2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:33.876503 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6ff6757b-6388-4e7c-93ef-56b341c9eec8 req-32ae4ccc-3796-43a9-a161-66a2fdd230b2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:33.897248 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-6ff6757b-6388-4e7c-93ef-56b341c9eec8 req-32ae4ccc-3796-43a9-a161-66a2fdd230b2 service nova] Creating event network-vif-plugged:93b8fa03-1f37-431c-b87c-431cafd2680c for instance 30e66be0-1c2b-401d-8e17-1271b1910f4a on n-h2-851359-3 Aug 04 17:04:33.904202 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-6ff6757b-6388-4e7c-93ef-56b341c9eec8 req-32ae4ccc-3796-43a9-a161-66a2fdd230b2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060730 Aug 04 17:04:33.904907 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1197/2476] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:34.093267 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7580fd2e-1a35-4aed-b782-6bdd9f0f57c9 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:34.106273 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7580fd2e-1a35-4aed-b782-6bdd9f0f57c9 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45" status: 200 len: 1334 microversion: 2.1 time: 0.623656 Aug 04 17:04:34.107581 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1280/2477] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:33 2022] GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45 => generated 1334 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:34.322861 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a10435aa-eefd-43e2-8057-2ff5cf745c5c tempest-TenantUsagesTestJSON-105963984 tempest-TenantUsagesTestJSON-105963984-project-admin] Calling method '.version_select at 0x7f1e5bc393a0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:34.355160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a10435aa-eefd-43e2-8057-2ff5cf745c5c tempest-TenantUsagesTestJSON-105963984 tempest-TenantUsagesTestJSON-105963984-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:34.355752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a10435aa-eefd-43e2-8057-2ff5cf745c5c tempest-TenantUsagesTestJSON-105963984 tempest-TenantUsagesTestJSON-105963984-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:34.356536 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a10435aa-eefd-43e2-8057-2ff5cf745c5c tempest-TenantUsagesTestJSON-105963984 tempest-TenantUsagesTestJSON-105963984-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:34.381586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a10435aa-eefd-43e2-8057-2ff5cf745c5c tempest-TenantUsagesTestJSON-105963984 tempest-TenantUsagesTestJSON-105963984-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:34.382538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a10435aa-eefd-43e2-8057-2ff5cf745c5c tempest-TenantUsagesTestJSON-105963984 tempest-TenantUsagesTestJSON-105963984-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:34.383179 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a10435aa-eefd-43e2-8057-2ff5cf745c5c tempest-TenantUsagesTestJSON-105963984 tempest-TenantUsagesTestJSON-105963984-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:34.413315 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a10435aa-eefd-43e2-8057-2ff5cf745c5c tempest-TenantUsagesTestJSON-105963984 tempest-TenantUsagesTestJSON-105963984-project-admin] 10.222.0.93 "GET /compute/v2.1/os-simple-tenant-usage/0fb1953e32b545b1b9c09ba8015038c2?start=2022-08-03T17%3A04%3A33.493934&end=2022-08-05T17%3A04%3A33.493934" status: 200 len: 694 microversion: 2.1 time: 0.505053 Aug 04 17:04:34.424415 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1198/2478] 10.222.0.93 () {58 vars in 1412 bytes} [Thu Aug 4 17:04:33 2022] GET /compute/v2.1/os-simple-tenant-usage/0fb1953e32b545b1b9c09ba8015038c2?start=2022-08-03T17%3A04%3A33.493934&end=2022-08-05T17%3A04%3A33.493934 => generated 694 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:34.427536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e8ecd2d1-eb7b-4ac0-ba50-891404068561 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:34.428181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e8ecd2d1-eb7b-4ac0-ba50-891404068561 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b28c38d-e8d7-4a4e-9335-6cd5acd17876] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:34.430308 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-11c26f41-8cd3-445e-8cf0-887ef9efeaea tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5b523940>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:34.434815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8ecd2d1-eb7b-4ac0-ba50-891404068561 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:34.435607 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8ecd2d1-eb7b-4ac0-ba50-891404068561 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:34.436073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8ecd2d1-eb7b-4ac0-ba50-891404068561 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:34.436906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8ecd2d1-eb7b-4ac0-ba50-891404068561 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:34.437442 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8ecd2d1-eb7b-4ac0-ba50-891404068561 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:34.437921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8ecd2d1-eb7b-4ac0-ba50-891404068561 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:34.510706 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-11c26f41-8cd3-445e-8cf0-887ef9efeaea tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b" status: 200 len: 1436 microversion: 2.1 time: 0.083656 Aug 04 17:04:34.520839 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1199/2479] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:34 2022] GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b => generated 1436 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:34.533569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bddaadb1-d930-44e5-965e-162977cf7905 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Calling method '.version_select at 0x7f1e5bb86ca0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:34.588569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bddaadb1-d930-44e5-965e-162977cf7905 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:34.590499 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bddaadb1-d930-44e5-965e-162977cf7905 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:34.591551 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bddaadb1-d930-44e5-965e-162977cf7905 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:34.611413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bddaadb1-d930-44e5-965e-162977cf7905 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:34.612271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bddaadb1-d930-44e5-965e-162977cf7905 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:34.612861 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bddaadb1-d930-44e5-965e-162977cf7905 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:34.631861 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bddaadb1-d930-44e5-965e-162977cf7905 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] 10.222.0.93 "GET /compute/v2.1/os-simple-tenant-usage/0fb1953e32b545b1b9c09ba8015038c2?start=2022-08-03T17%3A04%3A33.493934&end=2022-08-05T17%3A04%3A33.493934" status: 200 len: 693 microversion: 2.1 time: 0.109060 Aug 04 17:04:34.642072 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1200/2480] 10.222.0.93 () {58 vars in 1412 bytes} [Thu Aug 4 17:04:34 2022] GET /compute/v2.1/os-simple-tenant-usage/0fb1953e32b545b1b9c09ba8015038c2?start=2022-08-03T17%3A04%3A33.493934&end=2022-08-05T17%3A04%3A33.493934 => generated 693 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:34.648121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-285e7a9f-5f30-46d6-8ae2-2154fc0a77e8 tempest-TenantUsagesTestJSON-105963984 tempest-TenantUsagesTestJSON-105963984-project-admin] Calling method '.version_select at 0x7f1e5b3899d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:34.674556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-285e7a9f-5f30-46d6-8ae2-2154fc0a77e8 tempest-TenantUsagesTestJSON-105963984 tempest-TenantUsagesTestJSON-105963984-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:34.675061 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-285e7a9f-5f30-46d6-8ae2-2154fc0a77e8 tempest-TenantUsagesTestJSON-105963984 tempest-TenantUsagesTestJSON-105963984-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:34.675529 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-285e7a9f-5f30-46d6-8ae2-2154fc0a77e8 tempest-TenantUsagesTestJSON-105963984 tempest-TenantUsagesTestJSON-105963984-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:34.721436 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-285e7a9f-5f30-46d6-8ae2-2154fc0a77e8 tempest-TenantUsagesTestJSON-105963984 tempest-TenantUsagesTestJSON-105963984-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:34.721941 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-285e7a9f-5f30-46d6-8ae2-2154fc0a77e8 tempest-TenantUsagesTestJSON-105963984 tempest-TenantUsagesTestJSON-105963984-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:34.723809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-285e7a9f-5f30-46d6-8ae2-2154fc0a77e8 tempest-TenantUsagesTestJSON-105963984 tempest-TenantUsagesTestJSON-105963984-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:34.869370 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-285e7a9f-5f30-46d6-8ae2-2154fc0a77e8 tempest-TenantUsagesTestJSON-105963984 tempest-TenantUsagesTestJSON-105963984-project-admin] 10.222.0.93 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-03T17%3A04%3A33.493934&end=2022-08-05T17%3A04%3A33.493934&detailed=1" status: 200 len: 26472 microversion: 2.1 time: 0.224967 Aug 04 17:04:34.870260 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1201/2481] 10.222.0.93 () {58 vars in 1335 bytes} [Thu Aug 4 17:04:34 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-03T17%3A04%3A33.493934&end=2022-08-05T17%3A04%3A33.493934&detailed=1 => generated 26472 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:04:34.875110 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4cd24499-60b7-470f-8f6e-a27d397ec722 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:34.875868 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4cd24499-60b7-470f-8f6e-a27d397ec722 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: ba09cec5-a546-4fe5-90df-c90d94591fb2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:34.883862 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4cd24499-60b7-470f-8f6e-a27d397ec722 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:34.884383 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4cd24499-60b7-470f-8f6e-a27d397ec722 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:34.885073 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4cd24499-60b7-470f-8f6e-a27d397ec722 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:34.886101 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4cd24499-60b7-470f-8f6e-a27d397ec722 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:34.888170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4cd24499-60b7-470f-8f6e-a27d397ec722 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:34.893265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4cd24499-60b7-470f-8f6e-a27d397ec722 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:35.062317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e8ecd2d1-eb7b-4ac0-ba50-891404068561 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:35.085416 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e8ecd2d1-eb7b-4ac0-ba50-891404068561 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876" status: 200 len: 1314 microversion: 2.1 time: 0.975378 Aug 04 17:04:35.087308 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1281/2482] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:34 2022] GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876 => generated 1314 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:35.092323 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9614a814-b5ff-4d41-9d13-554fdad5e89e tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:35.094014 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9614a814-b5ff-4d41-9d13-554fdad5e89e tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] [instance: 7f02288b-9e88-4277-bc31-ae355dadd181] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:35.116681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9614a814-b5ff-4d41-9d13-554fdad5e89e tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:35.117112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9614a814-b5ff-4d41-9d13-554fdad5e89e tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:35.117562 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9614a814-b5ff-4d41-9d13-554fdad5e89e tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:35.118316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9614a814-b5ff-4d41-9d13-554fdad5e89e tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:35.118793 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9614a814-b5ff-4d41-9d13-554fdad5e89e tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:35.126193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9614a814-b5ff-4d41-9d13-554fdad5e89e tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:35.187342 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9614a814-b5ff-4d41-9d13-554fdad5e89e tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] [instance: 7f02288b-9e88-4277-bc31-ae355dadd181] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:04:35.368347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4cd24499-60b7-470f-8f6e-a27d397ec722 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a373cb0cd004b65a4ea9c804cbea3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82de1eabf714c3492860c2a65df5ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:35.378881 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9614a814-b5ff-4d41-9d13-554fdad5e89e tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] 10.222.0.93 "DELETE /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181" status: 204 len: 0 microversion: 2.1 time: 0.268651 Aug 04 17:04:35.383046 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4cd24499-60b7-470f-8f6e-a27d397ec722 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/servers/ba09cec5-a546-4fe5-90df-c90d94591fb2" status: 200 len: 1467 microversion: 2.1 time: 0.511690 Aug 04 17:04:35.383904 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1202/2484] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:34 2022] GET /compute/v2.1/servers/ba09cec5-a546-4fe5-90df-c90d94591fb2 => generated 1467 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:35.384985 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1282/2484] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:04:35 2022] DELETE /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:04:35.397779 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7180878c-7abb-4346-93a2-52ec549ed025 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:35.398864 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7180878c-7abb-4346-93a2-52ec549ed025 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] [instance: 7f02288b-9e88-4277-bc31-ae355dadd181] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:35.402547 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-70576492-930e-4876-ac86-1bd4fe852926 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:35.403498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-70576492-930e-4876-ac86-1bd4fe852926 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: baaeefae-c19a-4102-9fc8-245f638aaf45] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:35.413497 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7180878c-7abb-4346-93a2-52ec549ed025 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:35.414153 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7180878c-7abb-4346-93a2-52ec549ed025 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:35.414599 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7180878c-7abb-4346-93a2-52ec549ed025 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:35.415796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7180878c-7abb-4346-93a2-52ec549ed025 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:35.416588 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7180878c-7abb-4346-93a2-52ec549ed025 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:35.416735 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7180878c-7abb-4346-93a2-52ec549ed025 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:35.418325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70576492-930e-4876-ac86-1bd4fe852926 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:35.418879 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70576492-930e-4876-ac86-1bd4fe852926 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:35.419429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70576492-930e-4876-ac86-1bd4fe852926 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:35.420249 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70576492-930e-4876-ac86-1bd4fe852926 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:35.420965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70576492-930e-4876-ac86-1bd4fe852926 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:35.421613 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70576492-930e-4876-ac86-1bd4fe852926 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:36.215798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-70576492-930e-4876-ac86-1bd4fe852926 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:36.226128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7180878c-7abb-4346-93a2-52ec549ed025 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829341e13cf9427b91854d5f285605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb1953e32b545b1b9c09ba8015038c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:36.234007 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-70576492-930e-4876-ac86-1bd4fe852926 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45" status: 200 len: 1355 microversion: 2.1 time: 0.848799 Aug 04 17:04:36.248967 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1203/2485] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:35 2022] GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45 => generated 1355 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:36.256870 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7180878c-7abb-4346-93a2-52ec549ed025 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] 10.222.0.93 "GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181" status: 200 len: 1469 microversion: 2.1 time: 0.867369 Aug 04 17:04:36.274216 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1283/2486] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:35 2022] GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181 => generated 1469 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:36.285512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5a19c8bd-fbdb-49c9-a6da-2e07ebcf4214 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5bb798b0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:36.304197 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d91f846c-5946-43d9-8b29-fcdc4681ff46 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5b00c1f0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:36.510852 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d91f846c-5946-43d9-8b29-fcdc4681ff46 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b" status: 200 len: 1436 microversion: 2.1 time: 0.235412 Aug 04 17:04:36.511836 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1284/2487] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:36 2022] GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b => generated 1436 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:36.520821 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5a19c8bd-fbdb-49c9-a6da-2e07ebcf4214 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images?changes-since=2022-08-04T17%3A02%3A37Z" status: 200 len: 1901 microversion: 2.1 time: 0.285071 Aug 04 17:04:36.522446 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a5e2e45b-fed8-44fa-83b2-b8911d071896 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:36.535577 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a5e2e45b-fed8-44fa-83b2-b8911d071896 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b28c38d-e8d7-4a4e-9335-6cd5acd17876] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:36.536366 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1204/2488] 10.222.0.93 () {58 vars in 1199 bytes} [Thu Aug 4 17:04:36 2022] GET /compute/v2.1/images?changes-since=2022-08-04T17%3A02%3A37Z => generated 1901 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:36.558575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-25eb189f-4c18-4e83-9c23-b2a5c8792f49 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5bc0a310>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:36.562811 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a5e2e45b-fed8-44fa-83b2-b8911d071896 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:36.566511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a5e2e45b-fed8-44fa-83b2-b8911d071896 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:36.567165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a5e2e45b-fed8-44fa-83b2-b8911d071896 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:36.568787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a5e2e45b-fed8-44fa-83b2-b8911d071896 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:36.573308 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a5e2e45b-fed8-44fa-83b2-b8911d071896 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:36.574714 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a5e2e45b-fed8-44fa-83b2-b8911d071896 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:36.735985 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-25eb189f-4c18-4e83-9c23-b2a5c8792f49 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1351280699" status: 200 len: 485 microversion: 2.1 time: 0.188436 Aug 04 17:04:36.742677 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1205/2489] 10.222.0.93 () {58 vars in 1231 bytes} [Thu Aug 4 17:04:36 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1351280699 => generated 485 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:36.762271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-872fb830-ad7a-45fc-b85f-fee4c3d961d8 req-873c97fb-3188-4fe2-b404-942d719e209a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b28c38d-e8d7-4a4e-9335-6cd5acd17876", "tag": "24a5e1cf-0dc5-4f6f-b106-d7af8675342b"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:36.792172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-872fb830-ad7a-45fc-b85f-fee4c3d961d8 req-873c97fb-3188-4fe2-b404-942d719e209a service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:36.798451 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-872fb830-ad7a-45fc-b85f-fee4c3d961d8 req-873c97fb-3188-4fe2-b404-942d719e209a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:36.799156 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-872fb830-ad7a-45fc-b85f-fee4c3d961d8 req-873c97fb-3188-4fe2-b404-942d719e209a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:36.820204 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-872fb830-ad7a-45fc-b85f-fee4c3d961d8 req-873c97fb-3188-4fe2-b404-942d719e209a service nova] Creating event network-changed:24a5e1cf-0dc5-4f6f-b106-d7af8675342b for instance 1b28c38d-e8d7-4a4e-9335-6cd5acd17876 on n-h2-851359-3 Aug 04 17:04:36.831512 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-872fb830-ad7a-45fc-b85f-fee4c3d961d8 req-873c97fb-3188-4fe2-b404-942d719e209a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087322 Aug 04 17:04:36.834608 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1206/2490] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:36.845862 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-291c5376-96dc-4e82-b150-7f04d7712ff4 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5bb7e310>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:36.923897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a5e2e45b-fed8-44fa-83b2-b8911d071896 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:36.933704 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a5e2e45b-fed8-44fa-83b2-b8911d071896 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876" status: 200 len: 1314 microversion: 2.1 time: 0.420676 Aug 04 17:04:36.954499 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1285/2491] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:36 2022] GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:37.016713 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-291c5376-96dc-4e82-b150-7f04d7712ff4 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images?server=ba09cec5-a546-4fe5-90df-c90d94591fb2" status: 200 len: 956 microversion: 2.1 time: 0.180510 Aug 04 17:04:37.017290 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1207/2492] 10.222.0.93 () {58 vars in 1209 bytes} [Thu Aug 4 17:04:36 2022] GET /compute/v2.1/images?server=ba09cec5-a546-4fe5-90df-c90d94591fb2 => generated 956 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:37.030840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c5599694-ba01-452f-b68d-5193fb3645af tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5bcd2e50>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:37.106781 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c5599694-ba01-452f-b68d-5193fb3645af tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.93%2Fcompute%2Fv2.1%2Fservers%2Fa6fb758e-d1f2-4244-b287-d93d20a53ac5" status: 200 len: 485 microversion: 2.1 time: 0.079942 Aug 04 17:04:37.116003 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1286/2493] 10.222.0.93 () {58 vars in 1317 bytes} [Thu Aug 4 17:04:37 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.93%2Fcompute%2Fv2.1%2Fservers%2Fa6fb758e-d1f2-4244-b287-d93d20a53ac5 => generated 485 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:37.121685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bafbe74f-f2dc-4baa-adb6-cd6d8e0d59f2 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5bc0ab80>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:37.192741 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bafbe74f-f2dc-4baa-adb6-cd6d8e0d59f2 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.93%2Fcompute%2Fservers%2Fa6fb758e-d1f2-4244-b287-d93d20a53ac5" status: 200 len: 485 microversion: 2.1 time: 0.070017 Aug 04 17:04:37.193377 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1208/2494] 10.222.0.93 () {58 vars in 1303 bytes} [Thu Aug 4 17:04:37 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.93%2Fcompute%2Fservers%2Fa6fb758e-d1f2-4244-b287-d93d20a53ac5 => generated 485 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:37.212547 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7a4f6eda-bfc7-4abd-a2a8-71bbcf0ccb3a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5b11c040>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:37.256994 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-022c68ab-fcaf-4073-a306-def7b806fb36 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:37.257653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-022c68ab-fcaf-4073-a306-def7b806fb36 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: baaeefae-c19a-4102-9fc8-245f638aaf45] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:37.264166 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-022c68ab-fcaf-4073-a306-def7b806fb36 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:37.264665 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-022c68ab-fcaf-4073-a306-def7b806fb36 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:37.265107 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-022c68ab-fcaf-4073-a306-def7b806fb36 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:37.273635 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-022c68ab-fcaf-4073-a306-def7b806fb36 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:37.276089 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-022c68ab-fcaf-4073-a306-def7b806fb36 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:37.278631 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-022c68ab-fcaf-4073-a306-def7b806fb36 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:37.563515 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7a4f6eda-bfc7-4abd-a2a8-71bbcf0ccb3a tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3278 microversion: 2.1 time: 0.358961 Aug 04 17:04:37.585622 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1287/2495] 10.222.0.93 () {58 vars in 1149 bytes} [Thu Aug 4 17:04:37 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3278 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:37.617054 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-89e68d5c-d4ba-412b-bf93-0203412e29ed tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:37.617708 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-89e68d5c-d4ba-412b-bf93-0203412e29ed tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] [instance: 7f02288b-9e88-4277-bc31-ae355dadd181] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:37.636058 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89e68d5c-d4ba-412b-bf93-0203412e29ed tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:37.636657 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89e68d5c-d4ba-412b-bf93-0203412e29ed tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:37.637190 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89e68d5c-d4ba-412b-bf93-0203412e29ed tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:37.638373 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89e68d5c-d4ba-412b-bf93-0203412e29ed tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:37.639025 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89e68d5c-d4ba-412b-bf93-0203412e29ed tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:37.639620 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89e68d5c-d4ba-412b-bf93-0203412e29ed tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:37.942321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-022c68ab-fcaf-4073-a306-def7b806fb36 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:37.957697 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-022c68ab-fcaf-4073-a306-def7b806fb36 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45" status: 200 len: 1355 microversion: 2.1 time: 0.704420 Aug 04 17:04:37.958800 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1209/2496] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:37 2022] GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45 => generated 1355 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:37.968587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-22830266-6aca-4b43-9ff5-f01ceec9eb5c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5bc0a040>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:38.040887 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-22830266-6aca-4b43-9ff5-f01ceec9eb5c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b" status: 200 len: 1436 microversion: 2.1 time: 0.080685 Aug 04 17:04:38.041511 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1210/2497] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:37 2022] GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b => generated 1436 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:38.052801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dbb78f49-9a19-455d-b0a3-f9ead954a6e4 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5baad940>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:38.119606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-89e68d5c-d4ba-412b-bf93-0203412e29ed tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829341e13cf9427b91854d5f285605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb1953e32b545b1b9c09ba8015038c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:38.128962 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-89e68d5c-d4ba-412b-bf93-0203412e29ed tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] 10.222.0.93 "GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181" status: 200 len: 1469 microversion: 2.1 time: 0.532078 Aug 04 17:04:38.134239 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1288/2498] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:37 2022] GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181 => generated 1469 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:38.139746 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d50a57ae-decd-438c-9ac8-bb5000b5c2d6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:38.145951 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d50a57ae-decd-438c-9ac8-bb5000b5c2d6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b28c38d-e8d7-4a4e-9335-6cd5acd17876] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:38.155214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d50a57ae-decd-438c-9ac8-bb5000b5c2d6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:38.166999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d50a57ae-decd-438c-9ac8-bb5000b5c2d6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:38.167643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d50a57ae-decd-438c-9ac8-bb5000b5c2d6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:38.168572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d50a57ae-decd-438c-9ac8-bb5000b5c2d6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:38.169193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d50a57ae-decd-438c-9ac8-bb5000b5c2d6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:38.178045 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d50a57ae-decd-438c-9ac8-bb5000b5c2d6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:38.179052 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dbb78f49-9a19-455d-b0a3-f9ead954a6e4 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.136275 Aug 04 17:04:38.179845 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1211/2499] 10.222.0.93 () {58 vars in 1149 bytes} [Thu Aug 4 17:04:38 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:38.200266 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-162b84cd-24af-42ab-b0e0-b5b549ad4023 req-31e4a69d-38a7-4b75-9ff3-8e6b8c5fca0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baaeefae-c19a-4102-9fc8-245f638aaf45", "tag": "49f5666d-c14e-48ba-a220-99abd6a77877"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:38.239205 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-162b84cd-24af-42ab-b0e0-b5b549ad4023 req-31e4a69d-38a7-4b75-9ff3-8e6b8c5fca0b service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:38.239705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-162b84cd-24af-42ab-b0e0-b5b549ad4023 req-31e4a69d-38a7-4b75-9ff3-8e6b8c5fca0b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:38.240156 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-162b84cd-24af-42ab-b0e0-b5b549ad4023 req-31e4a69d-38a7-4b75-9ff3-8e6b8c5fca0b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:38.259941 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-162b84cd-24af-42ab-b0e0-b5b549ad4023 req-31e4a69d-38a7-4b75-9ff3-8e6b8c5fca0b service nova] Creating event network-changed:49f5666d-c14e-48ba-a220-99abd6a77877 for instance baaeefae-c19a-4102-9fc8-245f638aaf45 on n-h1-851359-3 Aug 04 17:04:38.267788 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-162b84cd-24af-42ab-b0e0-b5b549ad4023 req-31e4a69d-38a7-4b75-9ff3-8e6b8c5fca0b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078925 Aug 04 17:04:38.268977 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1212/2500] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:38.278529 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-58aa47e7-4a41-4254-ae79-d962608b015b tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5b5231f0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:38.382183 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-58aa47e7-4a41-4254-ae79-d962608b015b tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.111428 Aug 04 17:04:38.383772 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1213/2501] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Aug 4 17:04:38 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:38.401966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9a8d4400-9b64-4318-b0aa-eade15b84267 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5baadc10>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:38.602341 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9a8d4400-9b64-4318-b0aa-eade15b84267 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/detail?changes-since=2022-08-04T17%3A02%3A32Z" status: 200 len: 6325 microversion: 2.1 time: 0.189674 Aug 04 17:04:38.603307 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1214/2502] 10.222.0.93 () {58 vars in 1220 bytes} [Thu Aug 4 17:04:38 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-04T17%3A02%3A32Z => generated 6325 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:38.627571 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bc2ce131-6d13-4dec-aa31-956af33fc0a8 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5b4a23a0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:38.725606 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bc2ce131-6d13-4dec-aa31-956af33fc0a8 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1351280699" status: 200 len: 665 microversion: 2.1 time: 0.104095 Aug 04 17:04:38.726612 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1215/2503] 10.222.0.93 () {58 vars in 1252 bytes} [Thu Aug 4 17:04:38 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1351280699 => generated 665 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:38.749960 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d50a57ae-decd-438c-9ac8-bb5000b5c2d6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:38.751773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-754c6fb3-e8d1-4e77-9f79-44fe6a089e71 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5bcd5550>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:38.763868 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d50a57ae-decd-438c-9ac8-bb5000b5c2d6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876" status: 200 len: 1314 microversion: 2.1 time: 0.628134 Aug 04 17:04:38.765341 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1289/2504] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:38 2022] GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876 => generated 1314 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:38.859242 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-754c6fb3-e8d1-4e77-9f79-44fe6a089e71 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.93%2Fcompute%2Fv2.1%2Fservers%2Fa6fb758e-d1f2-4244-b287-d93d20a53ac5" status: 200 len: 1465 microversion: 2.1 time: 0.116589 Aug 04 17:04:38.860469 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1216/2505] 10.222.0.93 () {58 vars in 1338 bytes} [Thu Aug 4 17:04:38 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.93%2Fcompute%2Fv2.1%2Fservers%2Fa6fb758e-d1f2-4244-b287-d93d20a53ac5 => generated 1465 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:04:38.878625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7a871482-59e0-40ab-a0c2-9416235470ec tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e6c94b040>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:38.937334 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-945d91e7-252f-438b-aa95-db0e9692eaa7 req-5228f496-8ec6-44ff-88fa-235c119f1c36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba09cec5-a546-4fe5-90df-c90d94591fb2", "name": "network-vif-unplugged", "status": "completed", "tag": "14919ddc-0463-47b2-9b85-fd575b876018"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:38.968210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-945d91e7-252f-438b-aa95-db0e9692eaa7 req-5228f496-8ec6-44ff-88fa-235c119f1c36 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:38.968999 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-945d91e7-252f-438b-aa95-db0e9692eaa7 req-5228f496-8ec6-44ff-88fa-235c119f1c36 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:38.969132 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-945d91e7-252f-438b-aa95-db0e9692eaa7 req-5228f496-8ec6-44ff-88fa-235c119f1c36 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:38.981117 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7a871482-59e0-40ab-a0c2-9416235470ec tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.93%2Fcompute%2Fservers%2Fa6fb758e-d1f2-4244-b287-d93d20a53ac5" status: 200 len: 1465 microversion: 2.1 time: 0.106905 Aug 04 17:04:38.981712 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1290/2506] 10.222.0.93 () {58 vars in 1324 bytes} [Thu Aug 4 17:04:38 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.93%2Fcompute%2Fservers%2Fa6fb758e-d1f2-4244-b287-d93d20a53ac5 => generated 1465 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:38.998489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f00c27ae-3fed-4eec-b3d9-4ca4d3f06740 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:38.999127 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f00c27ae-3fed-4eec-b3d9-4ca4d3f06740 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: baaeefae-c19a-4102-9fc8-245f638aaf45] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:39.019669 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-945d91e7-252f-438b-aa95-db0e9692eaa7 req-5228f496-8ec6-44ff-88fa-235c119f1c36 service nova] Creating event network-vif-unplugged:14919ddc-0463-47b2-9b85-fd575b876018 for instance ba09cec5-a546-4fe5-90df-c90d94591fb2 on n-h1-851359-3 Aug 04 17:04:39.025556 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f00c27ae-3fed-4eec-b3d9-4ca4d3f06740 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:39.034683 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f00c27ae-3fed-4eec-b3d9-4ca4d3f06740 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:39.035967 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f00c27ae-3fed-4eec-b3d9-4ca4d3f06740 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:39.036734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f00c27ae-3fed-4eec-b3d9-4ca4d3f06740 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:39.037236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f00c27ae-3fed-4eec-b3d9-4ca4d3f06740 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:39.037678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f00c27ae-3fed-4eec-b3d9-4ca4d3f06740 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:39.059520 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-945d91e7-252f-438b-aa95-db0e9692eaa7 req-5228f496-8ec6-44ff-88fa-235c119f1c36 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120398 Aug 04 17:04:39.063881 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1217/2507] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:04:39.068929 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6aeca62c-bc36-4541-aec2-7a7d5af1b838 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e6c9309d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:39.283794 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6aeca62c-bc36-4541-aec2-7a7d5af1b838 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7100 microversion: 2.1 time: 0.218836 Aug 04 17:04:39.301656 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1218/2508] 10.222.0.93 () {58 vars in 1170 bytes} [Thu Aug 4 17:04:39 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7100 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:39.307236 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-a5cc0312-6ec8-4b55-9e78-be79d1a44c2c req-74ffe5ee-0000-4319-8a69-91c1a4e6abe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f02288b-9e88-4277-bc31-ae355dadd181", "name": "network-vif-deleted", "tag": "ebdb02cb-020d-408d-aea7-23152b943370"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:39.335668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a5cc0312-6ec8-4b55-9e78-be79d1a44c2c req-74ffe5ee-0000-4319-8a69-91c1a4e6abe1 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:39.340074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:39.353306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a5cc0312-6ec8-4b55-9e78-be79d1a44c2c req-74ffe5ee-0000-4319-8a69-91c1a4e6abe1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:39.354033 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a5cc0312-6ec8-4b55-9e78-be79d1a44c2c req-74ffe5ee-0000-4319-8a69-91c1a4e6abe1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:39.380572 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-a5cc0312-6ec8-4b55-9e78-be79d1a44c2c req-74ffe5ee-0000-4319-8a69-91c1a4e6abe1 service nova] Creating event network-vif-deleted:ebdb02cb-020d-408d-aea7-23152b943370 for instance 7f02288b-9e88-4277-bc31-ae355dadd181 on n-h1-851359-3 Aug 04 17:04:39.394311 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-a5cc0312-6ec8-4b55-9e78-be79d1a44c2c req-74ffe5ee-0000-4319-8a69-91c1a4e6abe1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090592 Aug 04 17:04:39.395730 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1219/2509] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:39.398426 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f00c27ae-3fed-4eec-b3d9-4ca4d3f06740 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:39.402875 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-da692d46-909c-46a3-a17c-071389d7ccab tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5bce79d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:39.410374 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f00c27ae-3fed-4eec-b3d9-4ca4d3f06740 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45" status: 200 len: 1355 microversion: 2.1 time: 0.427527 Aug 04 17:04:39.411992 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1291/2510] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:38 2022] GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45 => generated 1355 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:39.420409 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e68a5c69-a0f3-4f6b-9a89-25fd96670adb tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:39.421240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e68a5c69-a0f3-4f6b-9a89-25fd96670adb tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] [instance: 7f02288b-9e88-4277-bc31-ae355dadd181] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:39.437412 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e68a5c69-a0f3-4f6b-9a89-25fd96670adb tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:39.438905 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e68a5c69-a0f3-4f6b-9a89-25fd96670adb tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:39.439562 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e68a5c69-a0f3-4f6b-9a89-25fd96670adb tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:39.441174 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e68a5c69-a0f3-4f6b-9a89-25fd96670adb tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:39.442927 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e68a5c69-a0f3-4f6b-9a89-25fd96670adb tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:39.443722 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e68a5c69-a0f3-4f6b-9a89-25fd96670adb tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:39.449948 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:39.472791 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-da692d46-909c-46a3-a17c-071389d7ccab tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b" status: 200 len: 1436 microversion: 2.1 time: 0.075661 Aug 04 17:04:39.492478 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1220/2511] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:39 2022] GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b => generated 1436 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:39.494527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e68a5c69-a0f3-4f6b-9a89-25fd96670adb tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:39.495241 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e68a5c69-a0f3-4f6b-9a89-25fd96670adb tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:39.496285 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e68a5c69-a0f3-4f6b-9a89-25fd96670adb tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:39.496944 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-e68a5c69-a0f3-4f6b-9a89-25fd96670adb tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lazy-loading 'fault' on Instance uuid 7f02288b-9e88-4277-bc31-ae355dadd181 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:04:39.502957 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-47f437b4-7fea-481c-9dda-a6716a1e24db tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5bcd5790>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:39.558862 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e68a5c69-a0f3-4f6b-9a89-25fd96670adb tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '829341e13cf9427b91854d5f285605e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb1953e32b545b1b9c09ba8015038c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:39.583257 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e68a5c69-a0f3-4f6b-9a89-25fd96670adb tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] 10.222.0.93 "GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181" status: 200 len: 1303 microversion: 2.1 time: 0.169152 Aug 04 17:04:39.586226 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1292/2512] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:39 2022] GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181 => generated 1303 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:39.624932 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-47f437b4-7fea-481c-9dda-a6716a1e24db tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4369 microversion: 2.1 time: 0.129698 Aug 04 17:04:39.625872 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1221/2513] 10.222.0.93 () {58 vars in 1170 bytes} [Thu Aug 4 17:04:39 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4369 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:39.647556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-231c7424-bbbc-49af-815b-bd097128ac1c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5b523310>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:39.715048 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-231c7424-bbbc-49af-815b-bd097128ac1c tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/93ebc91d-2d7a-4ab2-b133-dcf9559166d9" status: 200 len: 784 microversion: 2.1 time: 0.076647 Aug 04 17:04:39.716268 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1222/2514] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:39 2022] GET /compute/v2.1/images/93ebc91d-2d7a-4ab2-b133-dcf9559166d9 => generated 784 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:39.733264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-df794e07-1f30-4880-9913-a2386bcb8480 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5bcd5820>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:39.797170 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-df794e07-1f30-4880-9913-a2386bcb8480 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.070632 Aug 04 17:04:39.799178 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1223/2515] 10.222.0.93 () {58 vars in 1158 bytes} [Thu Aug 4 17:04:39 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:39.805536 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7a554921-c42d-4692-a542-885457340617 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:39.806639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7a554921-c42d-4692-a542-885457340617 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b28c38d-e8d7-4a4e-9335-6cd5acd17876] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:39.815440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a554921-c42d-4692-a542-885457340617 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:39.816486 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a554921-c42d-4692-a542-885457340617 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:39.817317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a554921-c42d-4692-a542-885457340617 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:39.818365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a554921-c42d-4692-a542-885457340617 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:39.818969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a554921-c42d-4692-a542-885457340617 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:39.819620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a554921-c42d-4692-a542-885457340617 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:39.846724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c73ee191-6e6b-473c-a844-8f2e47e97582 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Calling method '.version_select at 0x7f1e6cb4f9d0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:39.942869 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c73ee191-6e6b-473c-a844-8f2e47e97582 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/047b4a287026476e81fb71c85ae3f471" status: 200 len: 371 microversion: 2.1 time: 0.353587 Aug 04 17:04:39.943929 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1293/2516] 10.222.0.93 () {58 vars in 1242 bytes} [Thu Aug 4 17:04:39 2022] GET /compute/v2.1/os-quota-sets/047b4a287026476e81fb71c85ae3f471 => generated 371 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:39.955726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cd79f13c-79cb-40ef-a901-f8e5d3259fee tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5bb608b0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:40.018721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7a554921-c42d-4692-a542-885457340617 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:40.029802 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7a554921-c42d-4692-a542-885457340617 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876" status: 200 len: 1314 microversion: 2.1 time: 0.229088 Aug 04 17:04:40.031278 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1224/2517] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:39 2022] GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:40.049218 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-af51b1b4-4a04-4e33-a1ee-91e1533185c8 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Action: 'update', calling method: .version_select at 0x7f1e5b3a8d30>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:40.193409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-af51b1b4-4a04-4e33-a1ee-91e1533185c8 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:40.194498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-af51b1b4-4a04-4e33-a1ee-91e1533185c8 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:40.195131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-af51b1b4-4a04-4e33-a1ee-91e1533185c8 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:40.196074 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-af51b1b4-4a04-4e33-a1ee-91e1533185c8 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:40.197124 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-af51b1b4-4a04-4e33-a1ee-91e1533185c8 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:40.197716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-af51b1b4-4a04-4e33-a1ee-91e1533185c8 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:40.333427 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-af51b1b4-4a04-4e33-a1ee-91e1533185c8 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/047b4a287026476e81fb71c85ae3f471" status: 200 len: 328 microversion: 2.1 time: 0.297435 Aug 04 17:04:40.353724 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1225/2518] 10.222.0.93 () {60 vars in 1262 bytes} [Thu Aug 4 17:04:40 2022] PUT /compute/v2.1/os-quota-sets/047b4a287026476e81fb71c85ae3f471 => generated 328 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:40.358930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-090015c7-c15e-46cb-9766-b9988158b55a req-39d50e59-0136-41dd-9c58-b1693d8f1033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baaeefae-c19a-4102-9fc8-245f638aaf45", "tag": "90723e13-4b1c-4323-bcb2-c76a4cc125e8"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:40.383768 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-090015c7-c15e-46cb-9766-b9988158b55a req-39d50e59-0136-41dd-9c58-b1693d8f1033 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:40.384251 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-090015c7-c15e-46cb-9766-b9988158b55a req-39d50e59-0136-41dd-9c58-b1693d8f1033 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:40.384683 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-090015c7-c15e-46cb-9766-b9988158b55a req-39d50e59-0136-41dd-9c58-b1693d8f1033 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:40.436031 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-090015c7-c15e-46cb-9766-b9988158b55a req-39d50e59-0136-41dd-9c58-b1693d8f1033 service nova] Creating event network-changed:90723e13-4b1c-4323-bcb2-c76a4cc125e8 for instance baaeefae-c19a-4102-9fc8-245f638aaf45 on n-h1-851359-3 Aug 04 17:04:40.449823 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-090015c7-c15e-46cb-9766-b9988158b55a req-39d50e59-0136-41dd-9c58-b1693d8f1033 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094643 Aug 04 17:04:40.450526 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1226/2519] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:40.464367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a23e5bb6-a4ed-4a88-ad61-d2e029b06201 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:40.465021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a23e5bb6-a4ed-4a88-ad61-d2e029b06201 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: baaeefae-c19a-4102-9fc8-245f638aaf45] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:40.496614 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a23e5bb6-a4ed-4a88-ad61-d2e029b06201 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:40.497398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a23e5bb6-a4ed-4a88-ad61-d2e029b06201 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:40.497939 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a23e5bb6-a4ed-4a88-ad61-d2e029b06201 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:40.498940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a23e5bb6-a4ed-4a88-ad61-d2e029b06201 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:40.499405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a23e5bb6-a4ed-4a88-ad61-d2e029b06201 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:40.499832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a23e5bb6-a4ed-4a88-ad61-d2e029b06201 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:41.329440 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cd79f13c-79cb-40ef-a901-f8e5d3259fee tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "DELETE /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257" status: 204 len: 0 microversion: 2.1 time: 1.384175 Aug 04 17:04:41.330770 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1294/2520] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:39 2022] DELETE /compute/v2.1/images/168fec44-9a5a-425c-92cd-5de3c1541257 => generated 0 bytes in 1386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:04:41.336087 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ca304e8d-1304-4343-971c-5d0d34413e96 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5bac58b0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:41.380949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a23e5bb6-a4ed-4a88-ad61-d2e029b06201 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:41.393319 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a23e5bb6-a4ed-4a88-ad61-d2e029b06201 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45" status: 200 len: 1355 microversion: 2.1 time: 0.937297 Aug 04 17:04:41.393960 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1227/2521] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:40 2022] GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45 => generated 1355 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:41.422324 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ca304e8d-1304-4343-971c-5d0d34413e96 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b" status: 200 len: 1436 microversion: 2.1 time: 0.090081 Aug 04 17:04:41.422916 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1295/2522] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:41 2022] GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b => generated 1436 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:41.433568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4d4c104e-2f5c-49dd-8790-d83ecf2e71f4 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:41.434478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4d4c104e-2f5c-49dd-8790-d83ecf2e71f4 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] [instance: 7f02288b-9e88-4277-bc31-ae355dadd181] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:41.453599 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d4c104e-2f5c-49dd-8790-d83ecf2e71f4 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:41.454499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d4c104e-2f5c-49dd-8790-d83ecf2e71f4 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:41.455753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d4c104e-2f5c-49dd-8790-d83ecf2e71f4 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:41.456657 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d4c104e-2f5c-49dd-8790-d83ecf2e71f4 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:41.457274 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d4c104e-2f5c-49dd-8790-d83ecf2e71f4 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:41.457861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d4c104e-2f5c-49dd-8790-d83ecf2e71f4 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:41.485688 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-4d4c104e-2f5c-49dd-8790-d83ecf2e71f4 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] HTTP exception thrown: Instance 7f02288b-9e88-4277-bc31-ae355dadd181 could not be found. Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4d4c104e-2f5c-49dd-8790-d83ecf2e71f4 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Request method failure captured: Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181 HTTP/1.1 Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_wIoyaTF1Fgoa6X028AsHag8_iSaMTEKQ37JF8xWRok8uKD189M4Sw7-Vzk008trJGFuh59cfWaJu8Qh57vx0vIrpUwMMEt6DTvrr_egLrjc4505EdnF8Rr_zkc3RlAPQtXSslv_QMzfLlZpMJQP8lgbhTqOyaxrtBK9DgZPcWEu1w Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 0fb1953e32b545b1b9c09ba8015038c2 Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-TenantUsagesTestJSON-857401108 Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0fb1953e32b545b1b9c09ba8015038c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0fb1953e32b545b1b9c09ba8015038c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0fb1953e32b545b1b9c09ba8015038c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0fb1953e32b545b1b9c09ba8015038c2"}]}] Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-TenantUsagesTestJSON-857401108 Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 0fb1953e32b545b1b9c09ba8015038c2 Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-TenantUsagesTestJSON-857401108 Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-TenantUsagesTestJSON-857401108-project Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 829341e13cf9427b91854d5f285605e0 Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-TenantUsagesTestJSON-857401108-project Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 7f02288b-9e88-4277-bc31-ae355dadd181 could not be found. Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '7f02288b-9e88-4277-bc31-ae355dadd181'} Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f02288b-9e88-4277-bc31-ae355dadd181 could not be found. Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f02288b-9e88-4277-bc31-ae355dadd181 could not be found. Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:41.489880 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:41.493906 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:41.493906 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:41.493906 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:41.493906 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:04:41.493906 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:04:41.493906 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f02288b-9e88-4277-bc31-ae355dadd181 could not be found. Aug 04 17:04:41.493906 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:41.504088 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fa0716b2-c560-481a-8b82-fb2aa757bb99 tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1908600499", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:41.504759 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4d4c104e-2f5c-49dd-8790-d83ecf2e71f4 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] Returning 404 to user: Instance 7f02288b-9e88-4277-bc31-ae355dadd181 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:04:41.506002 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4d4c104e-2f5c-49dd-8790-d83ecf2e71f4 tempest-TenantUsagesTestJSON-857401108 tempest-TenantUsagesTestJSON-857401108-project] 10.222.0.93 "GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181" status: 404 len: 111 microversion: 2.1 time: 0.081918 Aug 04 17:04:41.506771 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1296/2523] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:41 2022] GET /compute/v2.1/servers/7f02288b-9e88-4277-bc31-ae355dadd181 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:04:41.514330 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6ad16484-d202-433c-83cb-bb1103c14570 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:41.519688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6ad16484-d202-433c-83cb-bb1103c14570 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b28c38d-e8d7-4a4e-9335-6cd5acd17876] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:41.532247 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ad16484-d202-433c-83cb-bb1103c14570 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:41.533051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ad16484-d202-433c-83cb-bb1103c14570 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:41.533727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ad16484-d202-433c-83cb-bb1103c14570 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:41.534834 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ad16484-d202-433c-83cb-bb1103c14570 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:41.535491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ad16484-d202-433c-83cb-bb1103c14570 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:41.540768 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ad16484-d202-433c-83cb-bb1103c14570 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:41.596822 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-fa0716b2-c560-481a-8b82-fb2aa757bb99 tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:04:42.041114 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6ad16484-d202-433c-83cb-bb1103c14570 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:42.055271 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6ad16484-d202-433c-83cb-bb1103c14570 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876" status: 200 len: 1314 microversion: 2.1 time: 0.545123 Aug 04 17:04:42.059451 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1297/2524] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:41 2022] GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876 => generated 1314 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:42.068830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-62edec6d-01b5-438a-bb70-663df6cf8985 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5adcc3a0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:42.239282 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-fa0716b2-c560-481a-8b82-fb2aa757bb99 tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:04:42.240070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-fa0716b2-c560-481a-8b82-fb2aa757bb99 tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:04:42.240768 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-fa0716b2-c560-481a-8b82-fb2aa757bb99 tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:04:42.241786 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-fa0716b2-c560-481a-8b82-fb2aa757bb99 tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:04:42.242451 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-fa0716b2-c560-481a-8b82-fb2aa757bb99 tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:04:42.245513 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=12,nova_api:INSERT=8 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:42.273942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa0716b2-c560-481a-8b82-fb2aa757bb99 tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:42.275857 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa0716b2-c560-481a-8b82-fb2aa757bb99 tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:42.276308 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa0716b2-c560-481a-8b82-fb2aa757bb99 tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:42.277504 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa0716b2-c560-481a-8b82-fb2aa757bb99 tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:42.278292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa0716b2-c560-481a-8b82-fb2aa757bb99 tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:42.279142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa0716b2-c560-481a-8b82-fb2aa757bb99 tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:42.320844 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-fa0716b2-c560-481a-8b82-fb2aa757bb99 tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Getting quotas for project 047b4a287026476e81fb71c85ae3f471. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:04:42.337893 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-fa0716b2-c560-481a-8b82-fb2aa757bb99 tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Getting quotas for user e87982a8d1164b7e943841a1b791fd9e and project 047b4a287026476e81fb71c85ae3f471. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:04:42.353967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.utils [None req-fa0716b2-c560-481a-8b82-fb2aa757bb99 tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] cores quota exceeded for 047b4a287026476e81fb71c85ae3f471, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=131044) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 04 17:04:42.354787 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-fa0716b2-c560-481a-8b82-fb2aa757bb99 tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fa0716b2-c560-481a-8b82-fb2aa757bb99 tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Request method failure captured: Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 145 Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_wl8Pgx6PaTch0Rs_vtgqXBjOKcjWV-cAbtCw6IhVwU71C4cfuNQPHHcC4pqkXZ5kzZajzvfi6zffWaEY2GyVFovbVHLNAibMFwXHpeEGAkyTo2wHh1R4B2nxjPRDIhtfrg-Cj8FXGcFcFaV1xaA8J2tT7DuHNQ9jhMK3MbA6aMoKw Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 047b4a287026476e81fb71c85ae3f471 Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-QuotasAdminNegativeTest-2115295378 Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/047b4a287026476e81fb71c85ae3f471"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/047b4a287026476e81fb71c85ae3f471"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_047b4a287026476e81fb71c85ae3f471"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/047b4a287026476e81fb71c85ae3f471"}]}] Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-QuotasAdminNegativeTest-2115295378 Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 047b4a287026476e81fb71c85ae3f471 Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2115295378 Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-QuotasAdminNegativeTest-2115295378-project Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: e87982a8d1164b7e943841a1b791fd9e Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-QuotasAdminNegativeTest-2115295378-project Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1908600499", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452"}} Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1908600499', 'imageRef': '93ebc91d-2d7a-4ab2-b133-dcf9559166d9', 'flavorRef': '452'}}} Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 04 17:04:42.365575 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 04 17:04:42.369427 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:42.373790 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fa0716b2-c560-481a-8b82-fb2aa757bb99 tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:04:42.374896 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fa0716b2-c560-481a-8b82-fb2aa757bb99 tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.979796 Aug 04 17:04:42.376213 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1228/2525] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:04:41 2022] POST /compute/v2.1/servers => generated 111 bytes in 982 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:04:42.384940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a7fffbd5-9e9a-4069-bbc0-8ec87c9d9cf1 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Action: 'update', calling method: .version_select at 0x7f1e5baa25e0>, body: {"quota_set": {"cores": 20}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:42.950072 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7fffbd5-9e9a-4069-bbc0-8ec87c9d9cf1 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:42.953632 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7fffbd5-9e9a-4069-bbc0-8ec87c9d9cf1 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:42.956445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7fffbd5-9e9a-4069-bbc0-8ec87c9d9cf1 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:42.968637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7fffbd5-9e9a-4069-bbc0-8ec87c9d9cf1 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:42.969707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7fffbd5-9e9a-4069-bbc0-8ec87c9d9cf1 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:42.970287 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7fffbd5-9e9a-4069-bbc0-8ec87c9d9cf1 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:43.098382 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a7fffbd5-9e9a-4069-bbc0-8ec87c9d9cf1 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/047b4a287026476e81fb71c85ae3f471" status: 200 len: 329 microversion: 2.1 time: 0.717430 Aug 04 17:04:43.099625 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1229/2526] 10.222.0.93 () {60 vars in 1262 bytes} [Thu Aug 4 17:04:42 2022] PUT /compute/v2.1/os-quota-sets/047b4a287026476e81fb71c85ae3f471 => generated 329 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:43.109940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e435bab1-340a-4e22-8375-77f8a795d7f4 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:43.110828 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e435bab1-340a-4e22-8375-77f8a795d7f4 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: baaeefae-c19a-4102-9fc8-245f638aaf45] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:43.123474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e435bab1-340a-4e22-8375-77f8a795d7f4 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:43.124588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e435bab1-340a-4e22-8375-77f8a795d7f4 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:43.125047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e435bab1-340a-4e22-8375-77f8a795d7f4 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:43.126339 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e435bab1-340a-4e22-8375-77f8a795d7f4 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:43.126809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e435bab1-340a-4e22-8375-77f8a795d7f4 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:43.127245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e435bab1-340a-4e22-8375-77f8a795d7f4 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:43.464645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e435bab1-340a-4e22-8375-77f8a795d7f4 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:43.475527 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e435bab1-340a-4e22-8375-77f8a795d7f4 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45" status: 200 len: 1355 microversion: 2.1 time: 0.374611 Aug 04 17:04:43.480040 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1230/2527] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:43 2022] GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45 => generated 1355 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:43.487238 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d1c8924f-cfd9-45d2-b063-3a324d0a6b95 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5bd150d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:43.628226 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-62edec6d-01b5-438a-bb70-663df6cf8985 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "DELETE /compute/v2.1/images/6b573959-42da-4d15-a449-07ba5a2d7253" status: 204 len: 0 microversion: 2.1 time: 1.566872 Aug 04 17:04:43.628802 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1298/2528] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:42 2022] DELETE /compute/v2.1/images/6b573959-42da-4d15-a449-07ba5a2d7253 => generated 0 bytes in 1569 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:04:43.698037 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d1c8924f-cfd9-45d2-b063-3a324d0a6b95 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b" status: 200 len: 1436 microversion: 2.1 time: 0.216611 Aug 04 17:04:43.698647 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1231/2529] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:43 2022] GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b => generated 1436 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:43.731056 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-16c4f38c-b50a-4ae9-bc90-fb8e506c54e3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:43.731741 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-16c4f38c-b50a-4ae9-bc90-fb8e506c54e3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b28c38d-e8d7-4a4e-9335-6cd5acd17876] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:43.760235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16c4f38c-b50a-4ae9-bc90-fb8e506c54e3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:43.761456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16c4f38c-b50a-4ae9-bc90-fb8e506c54e3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:43.763779 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16c4f38c-b50a-4ae9-bc90-fb8e506c54e3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:43.765803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16c4f38c-b50a-4ae9-bc90-fb8e506c54e3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:43.769164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16c4f38c-b50a-4ae9-bc90-fb8e506c54e3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:43.780683 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16c4f38c-b50a-4ae9-bc90-fb8e506c54e3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:44.017235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-16c4f38c-b50a-4ae9-bc90-fb8e506c54e3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:44.027791 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-16c4f38c-b50a-4ae9-bc90-fb8e506c54e3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876" status: 200 len: 1314 microversion: 2.1 time: 0.324191 Aug 04 17:04:44.028551 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1232/2530] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:43 2022] GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:44.034007 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-322fd168-db06-41c3-b007-ebfdf9f4209a tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Calling method '.version_select at 0x7f1e5bd15040>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:44.051300 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-070aa867-027b-416b-8f53-3ced9b55b59a req-10501b02-5922-45da-b169-f771824f7b95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baaeefae-c19a-4102-9fc8-245f638aaf45", "tag": "72399a46-54e5-495a-ae71-1fa3ca0abe4a"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:44.068812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-070aa867-027b-416b-8f53-3ced9b55b59a req-10501b02-5922-45da-b169-f771824f7b95 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:44.069311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-070aa867-027b-416b-8f53-3ced9b55b59a req-10501b02-5922-45da-b169-f771824f7b95 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:44.069755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-070aa867-027b-416b-8f53-3ced9b55b59a req-10501b02-5922-45da-b169-f771824f7b95 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:44.117525 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-070aa867-027b-416b-8f53-3ced9b55b59a req-10501b02-5922-45da-b169-f771824f7b95 service nova] Creating event network-changed:72399a46-54e5-495a-ae71-1fa3ca0abe4a for instance baaeefae-c19a-4102-9fc8-245f638aaf45 on n-h1-851359-3 Aug 04 17:04:44.124556 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-070aa867-027b-416b-8f53-3ced9b55b59a req-10501b02-5922-45da-b169-f771824f7b95 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.489984 Aug 04 17:04:44.141555 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1299/2531] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:44.157346 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-15ef7e72-1435-4e51-a8e6-1d2faf46646b tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e6c94b790>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:44.371459 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-322fd168-db06-41c3-b007-ebfdf9f4209a tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/047b4a287026476e81fb71c85ae3f471" status: 200 len: 371 microversion: 2.1 time: 0.341357 Aug 04 17:04:44.372463 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1233/2532] 10.222.0.93 () {58 vars in 1242 bytes} [Thu Aug 4 17:04:44 2022] GET /compute/v2.1/os-quota-sets/047b4a287026476e81fb71c85ae3f471 => generated 371 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:44.432868 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-272283fa-6366-4b0f-81d8-4b73ad7a0009 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Action: 'update', calling method: .version_select at 0x7f1e5bdde3a0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:44.683649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-272283fa-6366-4b0f-81d8-4b73ad7a0009 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:44.684181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-272283fa-6366-4b0f-81d8-4b73ad7a0009 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:44.687582 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-272283fa-6366-4b0f-81d8-4b73ad7a0009 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:44.692100 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-272283fa-6366-4b0f-81d8-4b73ad7a0009 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:44.692577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-272283fa-6366-4b0f-81d8-4b73ad7a0009 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:44.693017 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-272283fa-6366-4b0f-81d8-4b73ad7a0009 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:44.778365 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-272283fa-6366-4b0f-81d8-4b73ad7a0009 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/047b4a287026476e81fb71c85ae3f471" status: 200 len: 328 microversion: 2.1 time: 0.348955 Aug 04 17:04:44.779817 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1234/2533] 10.222.0.93 () {60 vars in 1262 bytes} [Thu Aug 4 17:04:44 2022] PUT /compute/v2.1/os-quota-sets/047b4a287026476e81fb71c85ae3f471 => generated 328 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:04:44.800322 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-69e00d34-4f37-4234-b8c2-6271cbb2d35c tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:44.802303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-69e00d34-4f37-4234-b8c2-6271cbb2d35c tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: baaeefae-c19a-4102-9fc8-245f638aaf45] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:44.816630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69e00d34-4f37-4234-b8c2-6271cbb2d35c tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:44.817321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69e00d34-4f37-4234-b8c2-6271cbb2d35c tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:44.818018 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69e00d34-4f37-4234-b8c2-6271cbb2d35c tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:44.819278 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69e00d34-4f37-4234-b8c2-6271cbb2d35c tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:44.819978 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69e00d34-4f37-4234-b8c2-6271cbb2d35c tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:44.820673 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69e00d34-4f37-4234-b8c2-6271cbb2d35c tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:45.046374 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-69e00d34-4f37-4234-b8c2-6271cbb2d35c tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:45.055389 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-69e00d34-4f37-4234-b8c2-6271cbb2d35c tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45" status: 200 len: 1355 microversion: 2.1 time: 0.274086 Aug 04 17:04:45.057915 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1235/2534] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:44 2022] GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45 => generated 1355 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:45.076720 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3abd5cec-7187-47db-939b-0cd437f87f99 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5bc0d670>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:45.214611 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-15ef7e72-1435-4e51-a8e6-1d2faf46646b tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "DELETE /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461" status: 204 len: 0 microversion: 2.1 time: 1.071244 Aug 04 17:04:45.215194 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1300/2535] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:44 2022] DELETE /compute/v2.1/images/8ee92864-77d6-4942-b4d7-b3213fa16461 => generated 0 bytes in 1073 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:04:45.221028 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e2d04b90-e2d0-4709-a78a-af32afbb6d1a tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1692680330", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:45.386805 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3abd5cec-7187-47db-939b-0cd437f87f99 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b" status: 200 len: 1436 microversion: 2.1 time: 0.327590 Aug 04 17:04:45.395726 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1236/2536] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:45 2022] GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b => generated 1436 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:45.409101 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fef5e8cc-6ef9-4921-b12c-3b537f5b83e3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:45.421295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-e2d04b90-e2d0-4709-a78a-af32afbb6d1a tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] validate_networks() for None {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:04:45.444511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fef5e8cc-6ef9-4921-b12c-3b537f5b83e3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b28c38d-e8d7-4a4e-9335-6cd5acd17876] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:45.469317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fef5e8cc-6ef9-4921-b12c-3b537f5b83e3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:45.471752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fef5e8cc-6ef9-4921-b12c-3b537f5b83e3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:45.473533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fef5e8cc-6ef9-4921-b12c-3b537f5b83e3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:45.476923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fef5e8cc-6ef9-4921-b12c-3b537f5b83e3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:45.480971 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fef5e8cc-6ef9-4921-b12c-3b537f5b83e3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:45.481966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fef5e8cc-6ef9-4921-b12c-3b537f5b83e3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:45.839994 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fef5e8cc-6ef9-4921-b12c-3b537f5b83e3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:45.852139 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fef5e8cc-6ef9-4921-b12c-3b537f5b83e3 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876" status: 200 len: 1314 microversion: 2.1 time: 0.455019 Aug 04 17:04:45.867529 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1237/2537] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:45 2022] GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876 => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:45.873798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ebac7dcd-439b-4f86-b54c-3c57d1ce31b7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:45.875187 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ebac7dcd-439b-4f86-b54c-3c57d1ce31b7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: a6fb758e-d1f2-4244-b287-d93d20a53ac5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:45.883483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ebac7dcd-439b-4f86-b54c-3c57d1ce31b7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:45.884191 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ebac7dcd-439b-4f86-b54c-3c57d1ce31b7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:45.884631 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ebac7dcd-439b-4f86-b54c-3c57d1ce31b7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:45.885349 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ebac7dcd-439b-4f86-b54c-3c57d1ce31b7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:45.885809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ebac7dcd-439b-4f86-b54c-3c57d1ce31b7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:45.886263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ebac7dcd-439b-4f86-b54c-3c57d1ce31b7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:45.923652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ebac7dcd-439b-4f86-b54c-3c57d1ce31b7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: a6fb758e-d1f2-4244-b287-d93d20a53ac5] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:04:45.932998 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-e2d04b90-e2d0-4709-a78a-af32afbb6d1a tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:04:45.933702 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-e2d04b90-e2d0-4709-a78a-af32afbb6d1a tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:04:45.934477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-e2d04b90-e2d0-4709-a78a-af32afbb6d1a tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:04:45.935152 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-e2d04b90-e2d0-4709-a78a-af32afbb6d1a tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:04:45.936036 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-e2d04b90-e2d0-4709-a78a-af32afbb6d1a tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:04:45.948305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2d04b90-e2d0-4709-a78a-af32afbb6d1a tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:45.949494 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2d04b90-e2d0-4709-a78a-af32afbb6d1a tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:45.950206 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2d04b90-e2d0-4709-a78a-af32afbb6d1a tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:45.951213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2d04b90-e2d0-4709-a78a-af32afbb6d1a tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:45.951917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2d04b90-e2d0-4709-a78a-af32afbb6d1a tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:45.952587 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2d04b90-e2d0-4709-a78a-af32afbb6d1a tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:45.976313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-e2d04b90-e2d0-4709-a78a-af32afbb6d1a tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Getting quotas for project 047b4a287026476e81fb71c85ae3f471. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:04:45.984595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-e2d04b90-e2d0-4709-a78a-af32afbb6d1a tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Getting quotas for user e87982a8d1164b7e943841a1b791fd9e and project 047b4a287026476e81fb71c85ae3f471. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:04:46.001191 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.utils [None req-e2d04b90-e2d0-4709-a78a-af32afbb6d1a tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] instances quota exceeded for 047b4a287026476e81fb71c85ae3f471, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=131043) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 04 17:04:46.002520 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-e2d04b90-e2d0-4709-a78a-af32afbb6d1a tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e2d04b90-e2d0-4709-a78a-af32afbb6d1a tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Request method failure captured: Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 145 Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_wl8Pgx6PaTch0Rs_vtgqXBjOKcjWV-cAbtCw6IhVwU71C4cfuNQPHHcC4pqkXZ5kzZajzvfi6zffWaEY2GyVFovbVHLNAibMFwXHpeEGAkyTo2wHh1R4B2nxjPRDIhtfrg-Cj8FXGcFcFaV1xaA8J2tT7DuHNQ9jhMK3MbA6aMoKw Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 047b4a287026476e81fb71c85ae3f471 Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-QuotasAdminNegativeTest-2115295378 Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/047b4a287026476e81fb71c85ae3f471"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/047b4a287026476e81fb71c85ae3f471"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_047b4a287026476e81fb71c85ae3f471"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/047b4a287026476e81fb71c85ae3f471"}]}] Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-QuotasAdminNegativeTest-2115295378 Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 047b4a287026476e81fb71c85ae3f471 Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2115295378 Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-QuotasAdminNegativeTest-2115295378-project Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: e87982a8d1164b7e943841a1b791fd9e Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-QuotasAdminNegativeTest-2115295378-project Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1692680330", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452"}} Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1692680330', 'imageRef': '93ebc91d-2d7a-4ab2-b133-dcf9559166d9', 'flavorRef': '452'}}} Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 04 17:04:46.006494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 04 17:04:46.010416 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:46.012364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e2d04b90-e2d0-4709-a78a-af32afbb6d1a tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:04:46.012364 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e2d04b90-e2d0-4709-a78a-af32afbb6d1a tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.795574 Aug 04 17:04:46.012364 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1301/2538] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:04:45 2022] POST /compute/v2.1/servers => generated 119 bytes in 797 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:04:46.018256 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:46.025670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-1c9bfcbd-189b-4f2e-b822-854575a63060 req-a65c29d8-dec2-40f7-8a8b-2429bfbdd4d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b28c38d-e8d7-4a4e-9335-6cd5acd17876", "name": "network-vif-plugged", "status": "completed", "tag": "24a5e1cf-0dc5-4f6f-b106-d7af8675342b"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:46.039037 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1c9bfcbd-189b-4f2e-b822-854575a63060 req-a65c29d8-dec2-40f7-8a8b-2429bfbdd4d1 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:46.039873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1c9bfcbd-189b-4f2e-b822-854575a63060 req-a65c29d8-dec2-40f7-8a8b-2429bfbdd4d1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:46.040699 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1c9bfcbd-189b-4f2e-b822-854575a63060 req-a65c29d8-dec2-40f7-8a8b-2429bfbdd4d1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:46.054637 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-1c9bfcbd-189b-4f2e-b822-854575a63060 req-a65c29d8-dec2-40f7-8a8b-2429bfbdd4d1 service nova] Creating event network-vif-plugged:24a5e1cf-0dc5-4f6f-b106-d7af8675342b for instance 1b28c38d-e8d7-4a4e-9335-6cd5acd17876 on n-h2-851359-3 Aug 04 17:04:46.061316 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-1c9bfcbd-189b-4f2e-b822-854575a63060 req-a65c29d8-dec2-40f7-8a8b-2429bfbdd4d1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047385 Aug 04 17:04:46.069966 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1302/2539] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:46.077474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b9ae2e55-059c-4bbe-ac84-b802900b59bd tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Action: 'update', calling method: .version_select at 0x7f1e5b154b80>, body: {"quota_set": {"instances": 10}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:46.078842 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ebac7dcd-439b-4f86-b54c-3c57d1ce31b7 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "DELETE /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5" status: 204 len: 0 microversion: 2.1 time: 0.209327 Aug 04 17:04:46.079643 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1238/2540] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:04:45 2022] DELETE /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:04:46.090390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b429d685-6bb4-44a0-8639-2ca515a17d75 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:46.091173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b429d685-6bb4-44a0-8639-2ca515a17d75 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: baaeefae-c19a-4102-9fc8-245f638aaf45] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:46.098628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b429d685-6bb4-44a0-8639-2ca515a17d75 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:46.099239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b429d685-6bb4-44a0-8639-2ca515a17d75 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:46.099779 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b429d685-6bb4-44a0-8639-2ca515a17d75 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:46.100793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b429d685-6bb4-44a0-8639-2ca515a17d75 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:46.101379 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b429d685-6bb4-44a0-8639-2ca515a17d75 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:46.101902 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b429d685-6bb4-44a0-8639-2ca515a17d75 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:46.419845 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b429d685-6bb4-44a0-8639-2ca515a17d75 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:46.454047 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9ae2e55-059c-4bbe-ac84-b802900b59bd tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:46.454626 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9ae2e55-059c-4bbe-ac84-b802900b59bd tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:46.454970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9ae2e55-059c-4bbe-ac84-b802900b59bd tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:46.456101 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b429d685-6bb4-44a0-8639-2ca515a17d75 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45" status: 200 len: 1355 microversion: 2.1 time: 0.370011 Aug 04 17:04:46.477306 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1239/2541] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:46 2022] GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45 => generated 1355 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:46.484271 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9ae2e55-059c-4bbe-ac84-b802900b59bd tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:46.485829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9ae2e55-059c-4bbe-ac84-b802900b59bd tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:46.488663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5beaa302-8f91-4e35-9afa-f76ce4f64a66 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:46.489293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9ae2e55-059c-4bbe-ac84-b802900b59bd tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:46.497410 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5beaa302-8f91-4e35-9afa-f76ce4f64a66 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: a6fb758e-d1f2-4244-b287-d93d20a53ac5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:46.511067 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5beaa302-8f91-4e35-9afa-f76ce4f64a66 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:46.512812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5beaa302-8f91-4e35-9afa-f76ce4f64a66 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:46.514443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5beaa302-8f91-4e35-9afa-f76ce4f64a66 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:46.515441 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5beaa302-8f91-4e35-9afa-f76ce4f64a66 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:46.516663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5beaa302-8f91-4e35-9afa-f76ce4f64a66 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:46.517336 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5beaa302-8f91-4e35-9afa-f76ce4f64a66 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:46.585280 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b9ae2e55-059c-4bbe-ac84-b802900b59bd tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/047b4a287026476e81fb71c85ae3f471" status: 200 len: 329 microversion: 2.1 time: 0.512732 Aug 04 17:04:46.586549 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1303/2542] 10.222.0.93 () {60 vars in 1262 bytes} [Thu Aug 4 17:04:46 2022] PUT /compute/v2.1/os-quota-sets/047b4a287026476e81fb71c85ae3f471 => generated 329 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:46.591352 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-89332976-42a7-41eb-b656-6641fbb84670 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5b00c1f0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:46.655488 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-89332976-42a7-41eb-b656-6641fbb84670 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b" status: 200 len: 1436 microversion: 2.1 time: 0.067596 Aug 04 17:04:46.656726 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1304/2543] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:46 2022] GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b => generated 1436 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:46.661407 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3cbb1fba-b44a-4afc-a165-9dde79e88607 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Calling method '.version_select at 0x7f1e5afcd790>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:46.742197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5beaa302-8f91-4e35-9afa-f76ce4f64a66 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a373cb0cd004b65a4ea9c804cbea3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82de1eabf714c3492860c2a65df5ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:46.748267 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=13,nova_api:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:46.753349 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5beaa302-8f91-4e35-9afa-f76ce4f64a66 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5" status: 200 len: 1473 microversion: 2.1 time: 0.274317 Aug 04 17:04:46.766250 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3cbb1fba-b44a-4afc-a165-9dde79e88607 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/047b4a287026476e81fb71c85ae3f471" status: 200 len: 371 microversion: 2.1 time: 0.103661 Aug 04 17:04:46.767327 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1240/2544] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:46 2022] GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5 => generated 1473 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:46.769900 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1305/2545] 10.222.0.93 () {58 vars in 1242 bytes} [Thu Aug 4 17:04:46 2022] GET /compute/v2.1/os-quota-sets/047b4a287026476e81fb71c85ae3f471 => generated 371 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:46.775281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d1278bdf-076b-42de-b4eb-24fe5310ebc1 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Action: 'update', calling method: .version_select at 0x7f1e5ba6b550>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:46.855645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1278bdf-076b-42de-b4eb-24fe5310ebc1 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:46.856956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1278bdf-076b-42de-b4eb-24fe5310ebc1 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:46.857618 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1278bdf-076b-42de-b4eb-24fe5310ebc1 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:46.858503 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1278bdf-076b-42de-b4eb-24fe5310ebc1 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:46.859287 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1278bdf-076b-42de-b4eb-24fe5310ebc1 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:46.860765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1278bdf-076b-42de-b4eb-24fe5310ebc1 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:46.878210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d9996ba0-eaff-432d-820a-08fcafb0fb6d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:46.879168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d9996ba0-eaff-432d-820a-08fcafb0fb6d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b28c38d-e8d7-4a4e-9335-6cd5acd17876] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:46.896830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9996ba0-eaff-432d-820a-08fcafb0fb6d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:46.897855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9996ba0-eaff-432d-820a-08fcafb0fb6d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:46.898481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9996ba0-eaff-432d-820a-08fcafb0fb6d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:46.899399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9996ba0-eaff-432d-820a-08fcafb0fb6d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:46.900013 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9996ba0-eaff-432d-820a-08fcafb0fb6d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:46.900601 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9996ba0-eaff-432d-820a-08fcafb0fb6d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:47.005969 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d1278bdf-076b-42de-b4eb-24fe5310ebc1 tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/047b4a287026476e81fb71c85ae3f471" status: 200 len: 325 microversion: 2.1 time: 0.234890 Aug 04 17:04:47.018465 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1241/2546] 10.222.0.93 () {60 vars in 1262 bytes} [Thu Aug 4 17:04:46 2022] PUT /compute/v2.1/os-quota-sets/047b4a287026476e81fb71c85ae3f471 => generated 325 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:47.143651 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d9996ba0-eaff-432d-820a-08fcafb0fb6d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:47.157297 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d9996ba0-eaff-432d-820a-08fcafb0fb6d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876" status: 200 len: 1314 microversion: 2.1 time: 0.282531 Aug 04 17:04:47.164337 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a956c16b-13bf-4b39-a4b5-d06a004c3fba tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-552093402", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:47.169308 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1306/2547] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:46 2022] GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:47.271116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-a956c16b-13bf-4b39-a4b5-d06a004c3fba tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:04:47.487167 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-edb53cb5-7938-4421-b0e7-e1bda2a38162 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:47.495608 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-edb53cb5-7938-4421-b0e7-e1bda2a38162 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: baaeefae-c19a-4102-9fc8-245f638aaf45] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:47.535992 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-edb53cb5-7938-4421-b0e7-e1bda2a38162 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:47.536530 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-edb53cb5-7938-4421-b0e7-e1bda2a38162 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:47.536994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-edb53cb5-7938-4421-b0e7-e1bda2a38162 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:47.537752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-edb53cb5-7938-4421-b0e7-e1bda2a38162 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:47.547264 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-edb53cb5-7938-4421-b0e7-e1bda2a38162 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:47.547840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-edb53cb5-7938-4421-b0e7-e1bda2a38162 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:48.005149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-a956c16b-13bf-4b39-a4b5-d06a004c3fba tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:04:48.006205 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-a956c16b-13bf-4b39-a4b5-d06a004c3fba tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:04:48.006851 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-a956c16b-13bf-4b39-a4b5-d06a004c3fba tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:04:48.007425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-a956c16b-13bf-4b39-a4b5-d06a004c3fba tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:04:48.008000 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-a956c16b-13bf-4b39-a4b5-d06a004c3fba tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:04:48.023055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a956c16b-13bf-4b39-a4b5-d06a004c3fba tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:48.025062 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a956c16b-13bf-4b39-a4b5-d06a004c3fba tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:48.025668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a956c16b-13bf-4b39-a4b5-d06a004c3fba tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:48.029064 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a956c16b-13bf-4b39-a4b5-d06a004c3fba tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:48.029560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a956c16b-13bf-4b39-a4b5-d06a004c3fba tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:48.030030 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a956c16b-13bf-4b39-a4b5-d06a004c3fba tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:48.078959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-edb53cb5-7938-4421-b0e7-e1bda2a38162 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:48.084349 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-a956c16b-13bf-4b39-a4b5-d06a004c3fba tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Getting quotas for project 047b4a287026476e81fb71c85ae3f471. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:04:48.090358 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-edb53cb5-7938-4421-b0e7-e1bda2a38162 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45" status: 200 len: 1355 microversion: 2.1 time: 0.611365 Aug 04 17:04:48.098153 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1307/2548] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:47 2022] GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45 => generated 1355 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:48.106927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-a956c16b-13bf-4b39-a4b5-d06a004c3fba tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Getting quotas for user e87982a8d1164b7e943841a1b791fd9e and project 047b4a287026476e81fb71c85ae3f471. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:04:48.113935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-45248b11-b634-4722-898f-22778c584919 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5b6ec940>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:48.167525 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.utils [None req-a956c16b-13bf-4b39-a4b5-d06a004c3fba tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] ram quota exceeded for 047b4a287026476e81fb71c85ae3f471, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=131044) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 04 17:04:48.168107 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-a956c16b-13bf-4b39-a4b5-d06a004c3fba tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a956c16b-13bf-4b39-a4b5-d06a004c3fba tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Request method failure captured: Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 144 Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_wl8Pgx6PaTch0Rs_vtgqXBjOKcjWV-cAbtCw6IhVwU71C4cfuNQPHHcC4pqkXZ5kzZajzvfi6zffWaEY2GyVFovbVHLNAibMFwXHpeEGAkyTo2wHh1R4B2nxjPRDIhtfrg-Cj8FXGcFcFaV1xaA8J2tT7DuHNQ9jhMK3MbA6aMoKw Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 047b4a287026476e81fb71c85ae3f471 Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-QuotasAdminNegativeTest-2115295378 Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/047b4a287026476e81fb71c85ae3f471"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/047b4a287026476e81fb71c85ae3f471"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_047b4a287026476e81fb71c85ae3f471"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/047b4a287026476e81fb71c85ae3f471"}]}] Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-QuotasAdminNegativeTest-2115295378 Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 047b4a287026476e81fb71c85ae3f471 Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2115295378 Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-QuotasAdminNegativeTest-2115295378-project Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: e87982a8d1164b7e943841a1b791fd9e Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-QuotasAdminNegativeTest-2115295378-project Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-552093402", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452"}} Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-552093402', 'imageRef': '93ebc91d-2d7a-4ab2-b133-dcf9559166d9', 'flavorRef': '452'}}} Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 04 17:04:48.170381 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a956c16b-13bf-4b39-a4b5-d06a004c3fba tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:04:48.178878 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a956c16b-13bf-4b39-a4b5-d06a004c3fba tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.012625 Aug 04 17:04:48.193298 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1242/2549] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:04:47 2022] POST /compute/v2.1/servers => generated 110 bytes in 1035 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:04:48.202819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f0fba13d-d925-4b70-b8e0-64822406a305 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:48.203648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f0fba13d-d925-4b70-b8e0-64822406a305 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: a6fb758e-d1f2-4244-b287-d93d20a53ac5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:48.204819 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-45248b11-b634-4722-898f-22778c584919 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b" status: 200 len: 1436 microversion: 2.1 time: 0.103762 Aug 04 17:04:48.205430 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1308/2550] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:48 2022] GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b => generated 1436 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:48.217546 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-113cdb13-c4ae-4448-ba7a-fb9c476b35a2 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:48.230395 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-113cdb13-c4ae-4448-ba7a-fb9c476b35a2 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b28c38d-e8d7-4a4e-9335-6cd5acd17876] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:48.238849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0fba13d-d925-4b70-b8e0-64822406a305 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:48.239674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0fba13d-d925-4b70-b8e0-64822406a305 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:48.240177 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0fba13d-d925-4b70-b8e0-64822406a305 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:48.243534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0fba13d-d925-4b70-b8e0-64822406a305 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:48.244068 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0fba13d-d925-4b70-b8e0-64822406a305 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:48.245772 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0fba13d-d925-4b70-b8e0-64822406a305 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:48.300571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-113cdb13-c4ae-4448-ba7a-fb9c476b35a2 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:48.301382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-113cdb13-c4ae-4448-ba7a-fb9c476b35a2 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:48.302018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-113cdb13-c4ae-4448-ba7a-fb9c476b35a2 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:48.302928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-113cdb13-c4ae-4448-ba7a-fb9c476b35a2 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:48.306125 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-113cdb13-c4ae-4448-ba7a-fb9c476b35a2 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:48.306767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-113cdb13-c4ae-4448-ba7a-fb9c476b35a2 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:48.758438 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f0fba13d-d925-4b70-b8e0-64822406a305 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a373cb0cd004b65a4ea9c804cbea3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82de1eabf714c3492860c2a65df5ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:48.788821 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f0fba13d-d925-4b70-b8e0-64822406a305 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5" status: 200 len: 1431 microversion: 2.1 time: 0.594281 Aug 04 17:04:48.810661 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1243/2551] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:48 2022] GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5 => generated 1431 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:48.830376 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-821ee80b-674c-4c1e-be68-18650efeadcc tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Action: 'update', calling method: .version_select at 0x7f1e6827f700>, body: {"quota_set": {"ram": 51200}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:49.082839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-821ee80b-674c-4c1e-be68-18650efeadcc tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:49.084817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-821ee80b-674c-4c1e-be68-18650efeadcc tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:49.085533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-821ee80b-674c-4c1e-be68-18650efeadcc tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:49.088026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-821ee80b-674c-4c1e-be68-18650efeadcc tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:49.090230 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-821ee80b-674c-4c1e-be68-18650efeadcc tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:49.090939 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-821ee80b-674c-4c1e-be68-18650efeadcc tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:49.205586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:49.267303 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-821ee80b-674c-4c1e-be68-18650efeadcc tempest-QuotasAdminNegativeTest-964411688 tempest-QuotasAdminNegativeTest-964411688-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/047b4a287026476e81fb71c85ae3f471" status: 200 len: 329 microversion: 2.1 time: 0.454432 Aug 04 17:04:49.276014 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1244/2552] 10.222.0.93 () {60 vars in 1262 bytes} [Thu Aug 4 17:04:48 2022] PUT /compute/v2.1/os-quota-sets/047b4a287026476e81fb71c85ae3f471 => generated 329 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:49.281185 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-68997c48-3467-4621-b232-42730083ec05 req-a9cf58e1-e90f-4cd2-84ea-eae2e99ffb35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6fb758e-d1f2-4244-b287-d93d20a53ac5", "name": "network-vif-deleted", "tag": "e1ab51bf-fb27-46c5-9e82-16eef50f40f8"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:49.303022 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-68997c48-3467-4621-b232-42730083ec05 req-a9cf58e1-e90f-4cd2-84ea-eae2e99ffb35 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:49.303516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-68997c48-3467-4621-b232-42730083ec05 req-a9cf58e1-e90f-4cd2-84ea-eae2e99ffb35 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:49.303967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-68997c48-3467-4621-b232-42730083ec05 req-a9cf58e1-e90f-4cd2-84ea-eae2e99ffb35 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:49.336088 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-68997c48-3467-4621-b232-42730083ec05 req-a9cf58e1-e90f-4cd2-84ea-eae2e99ffb35 service nova] Creating event network-vif-deleted:e1ab51bf-fb27-46c5-9e82-16eef50f40f8 for instance a6fb758e-d1f2-4244-b287-d93d20a53ac5 on n-h1-851359-3 Aug 04 17:04:49.368646 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-68997c48-3467-4621-b232-42730083ec05 req-a9cf58e1-e90f-4cd2-84ea-eae2e99ffb35 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091184 Aug 04 17:04:49.369872 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1245/2553] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:49.376549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7d0bc6d7-9a0d-4f40-b3e4-4b485f057628 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:49.377446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7d0bc6d7-9a0d-4f40-b3e4-4b485f057628 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: baaeefae-c19a-4102-9fc8-245f638aaf45] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:49.392116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d0bc6d7-9a0d-4f40-b3e4-4b485f057628 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:49.397553 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d0bc6d7-9a0d-4f40-b3e4-4b485f057628 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:49.398368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d0bc6d7-9a0d-4f40-b3e4-4b485f057628 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:49.399289 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d0bc6d7-9a0d-4f40-b3e4-4b485f057628 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:49.406516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d0bc6d7-9a0d-4f40-b3e4-4b485f057628 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:49.407693 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d0bc6d7-9a0d-4f40-b3e4-4b485f057628 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:49.483409 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-113cdb13-c4ae-4448-ba7a-fb9c476b35a2 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:49.493454 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-113cdb13-c4ae-4448-ba7a-fb9c476b35a2 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876" status: 200 len: 1501 microversion: 2.1 time: 1.279750 Aug 04 17:04:49.494516 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1309/2554] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:48 2022] GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876 => generated 1501 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:49.518889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a78e8d7a-df08-44a2-a890-51171db9b925 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5b7ccf70>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:49.632052 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a78e8d7a-df08-44a2-a890-51171db9b925 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b" status: 200 len: 1436 microversion: 2.1 time: 0.132899 Aug 04 17:04:49.648615 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1310/2555] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:49 2022] GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b => generated 1436 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:49.668600 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fe290fac-51c7-4723-aaa2-9547e36b315d tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Action: 'update', calling method: .version_select at 0x7f1e6c9ad4c0>, body: {"quota_set": {"ram": 0}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:49.686380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fe290fac-51c7-4723-aaa2-9547e36b315d tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'e87982a8d1164b7e943841a1b791fd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047b4a287026476e81fb71c85ae3f471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fe290fac-51c7-4723-aaa2-9547e36b315d tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Request method failure captured: Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: request: PUT /compute/v2.1/os-quota-sets/047b4a287026476e81fb71c85ae3f471 HTTP/1.1 Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 25 Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_wl8Pgx6PaTch0Rs_vtgqXBjOKcjWV-cAbtCw6IhVwU71C4cfuNQPHHcC4pqkXZ5kzZajzvfi6zffWaEY2GyVFovbVHLNAibMFwXHpeEGAkyTo2wHh1R4B2nxjPRDIhtfrg-Cj8FXGcFcFaV1xaA8J2tT7DuHNQ9jhMK3MbA6aMoKw Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 047b4a287026476e81fb71c85ae3f471 Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-QuotasAdminNegativeTest-2115295378 Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/047b4a287026476e81fb71c85ae3f471"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/047b4a287026476e81fb71c85ae3f471"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_047b4a287026476e81fb71c85ae3f471"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/047b4a287026476e81fb71c85ae3f471"}]}] Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-QuotasAdminNegativeTest-2115295378 Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 047b4a287026476e81fb71c85ae3f471 Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2115295378 Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-QuotasAdminNegativeTest-2115295378-project Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: e87982a8d1164b7e943841a1b791fd9e Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-QuotasAdminNegativeTest-2115295378-project Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: {"quota_set": {"ram": 0}} Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '047b4a287026476e81fb71c85ae3f471', 'body': {'quota_set': {'ram': 0}}} Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise self.value Aug 04 17:04:49.696847 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 04 17:04:49.701719 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 04 17:04:49.701719 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 04 17:04:49.701719 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 04 17:04:49.701719 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 04 17:04:49.701719 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 04 17:04:49.701719 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 04 17:04:49.701719 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:49.701719 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:49.701719 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:49.701719 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:49.701719 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:49.701719 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:49.701719 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 04 17:04:49.701719 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 04 17:04:49.701719 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 04 17:04:49.701719 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:49.703023 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fe290fac-51c7-4723-aaa2-9547e36b315d tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:04:49.704043 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fe290fac-51c7-4723-aaa2-9547e36b315d tempest-QuotasAdminNegativeTest-2115295378 tempest-QuotasAdminNegativeTest-2115295378-project] 10.222.0.93 "PUT /compute/v2.1/os-quota-sets/047b4a287026476e81fb71c85ae3f471" status: 403 len: 116 microversion: 2.1 time: 0.054165 Aug 04 17:04:49.705193 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1311/2556] 10.222.0.93 () {60 vars in 1262 bytes} [Thu Aug 4 17:04:49 2022] PUT /compute/v2.1/os-quota-sets/047b4a287026476e81fb71c85ae3f471 => generated 116 bytes in 56 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:04:49.715040 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-268a5ed5-503b-4527-ad0c-1fcb5363f58d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:49.727288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-268a5ed5-503b-4527-ad0c-1fcb5363f58d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b28c38d-e8d7-4a4e-9335-6cd5acd17876] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:49.733443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7d0bc6d7-9a0d-4f40-b3e4-4b485f057628 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:49.741018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-268a5ed5-503b-4527-ad0c-1fcb5363f58d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:49.744192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-268a5ed5-503b-4527-ad0c-1fcb5363f58d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:49.747914 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-268a5ed5-503b-4527-ad0c-1fcb5363f58d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:49.748959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-268a5ed5-503b-4527-ad0c-1fcb5363f58d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:49.750867 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7d0bc6d7-9a0d-4f40-b3e4-4b485f057628 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45" status: 200 len: 1355 microversion: 2.1 time: 0.378771 Aug 04 17:04:49.751801 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1246/2557] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:49 2022] GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45 => generated 1355 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:49.756737 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-268a5ed5-503b-4527-ad0c-1fcb5363f58d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:49.758668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-268a5ed5-503b-4527-ad0c-1fcb5363f58d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:49.819463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7e93ba9a-45ce-48c2-87b6-39fcf8440465 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:49.820100 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7e93ba9a-45ce-48c2-87b6-39fcf8440465 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: a6fb758e-d1f2-4244-b287-d93d20a53ac5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:49.838389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e93ba9a-45ce-48c2-87b6-39fcf8440465 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:49.838909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e93ba9a-45ce-48c2-87b6-39fcf8440465 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:49.839363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e93ba9a-45ce-48c2-87b6-39fcf8440465 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:49.840125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e93ba9a-45ce-48c2-87b6-39fcf8440465 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:49.852756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e93ba9a-45ce-48c2-87b6-39fcf8440465 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:49.853854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e93ba9a-45ce-48c2-87b6-39fcf8440465 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:49.861013 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-268a5ed5-503b-4527-ad0c-1fcb5363f58d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lazy-loading 'flavor' on Instance uuid 1b28c38d-e8d7-4a4e-9335-6cd5acd17876 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:04:49.894679 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-7e93ba9a-45ce-48c2-87b6-39fcf8440465 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] HTTP exception thrown: Instance a6fb758e-d1f2-4244-b287-d93d20a53ac5 could not be found. Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7e93ba9a-45ce-48c2-87b6-39fcf8440465 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Request method failure captured: Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5 HTTP/1.1 Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_unTPx79lGbTjT_akub73C1089YVQT2JT9CeRrV3deAxok7Sl4oV5-lmYOA1TiG3GYGKeOQAfaixNWI_eeEY9he-34Nm8xlhsTlJSLjipJflYvfN3PxVBZUvzf17rBE6_Z42TT_XaV0DbN-vy0UfWtzuGa3Qjtu_bnFgkZ5gao7ObY Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: f82de1eabf714c3492860c2a65df5ae1 Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ListImageFiltersTestJSON-163868261 Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f82de1eabf714c3492860c2a65df5ae1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f82de1eabf714c3492860c2a65df5ae1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f82de1eabf714c3492860c2a65df5ae1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f82de1eabf714c3492860c2a65df5ae1"}]}] Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ListImageFiltersTestJSON-163868261 Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: f82de1eabf714c3492860c2a65df5ae1 Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-163868261 Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ListImageFiltersTestJSON-163868261-project Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 4a373cb0cd004b65a4ea9c804cbea3ab Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ListImageFiltersTestJSON-163868261-project Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance a6fb758e-d1f2-4244-b287-d93d20a53ac5 could not be found. Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'a6fb758e-d1f2-4244-b287-d93d20a53ac5'} Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6fb758e-d1f2-4244-b287-d93d20a53ac5 could not be found. Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6fb758e-d1f2-4244-b287-d93d20a53ac5 could not be found. Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:49.896971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:49.901603 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:49.901603 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:49.901603 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:49.901603 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:04:49.901603 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:04:49.901603 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6fb758e-d1f2-4244-b287-d93d20a53ac5 could not be found. Aug 04 17:04:49.901603 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:49.901603 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7e93ba9a-45ce-48c2-87b6-39fcf8440465 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Returning 404 to user: Instance a6fb758e-d1f2-4244-b287-d93d20a53ac5 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:04:49.904426 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7e93ba9a-45ce-48c2-87b6-39fcf8440465 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5" status: 404 len: 111 microversion: 2.1 time: 0.089661 Aug 04 17:04:49.907619 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1247/2558] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:49 2022] GET /compute/v2.1/servers/a6fb758e-d1f2-4244-b287-d93d20a53ac5 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:04:49.917924 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7d4cbe0a-39a5-45ff-8459-5b57d0eadd4d tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:49.919089 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7d4cbe0a-39a5-45ff-8459-5b57d0eadd4d tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: ba09cec5-a546-4fe5-90df-c90d94591fb2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:49.938883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d4cbe0a-39a5-45ff-8459-5b57d0eadd4d tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:49.942083 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d4cbe0a-39a5-45ff-8459-5b57d0eadd4d tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:49.942933 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d4cbe0a-39a5-45ff-8459-5b57d0eadd4d tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:49.943930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d4cbe0a-39a5-45ff-8459-5b57d0eadd4d tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:49.945505 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d4cbe0a-39a5-45ff-8459-5b57d0eadd4d tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:49.947166 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d4cbe0a-39a5-45ff-8459-5b57d0eadd4d tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:50.032215 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-268a5ed5-503b-4527-ad0c-1fcb5363f58d tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "POST /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876/action" status: 202 len: 0 microversion: 2.1 time: 0.325428 Aug 04 17:04:50.036671 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1312/2559] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:04:49 2022] POST /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:04:50.037305 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7d4cbe0a-39a5-45ff-8459-5b57d0eadd4d tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: ba09cec5-a546-4fe5-90df-c90d94591fb2] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:04:50.050421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-edb7064e-fb89-44a8-bd03-9625cc8ca5be tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:50.056586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-edb7064e-fb89-44a8-bd03-9625cc8ca5be tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b28c38d-e8d7-4a4e-9335-6cd5acd17876] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:50.074983 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-edb7064e-fb89-44a8-bd03-9625cc8ca5be tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:50.082325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-edb7064e-fb89-44a8-bd03-9625cc8ca5be tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:50.086891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-edb7064e-fb89-44a8-bd03-9625cc8ca5be tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:50.089183 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-edb7064e-fb89-44a8-bd03-9625cc8ca5be tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:50.091523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-edb7064e-fb89-44a8-bd03-9625cc8ca5be tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:50.094249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-edb7064e-fb89-44a8-bd03-9625cc8ca5be tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:50.240472 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7d4cbe0a-39a5-45ff-8459-5b57d0eadd4d tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "DELETE /compute/v2.1/servers/ba09cec5-a546-4fe5-90df-c90d94591fb2" status: 204 len: 0 microversion: 2.1 time: 0.329016 Aug 04 17:04:50.242337 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1248/2560] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:04:49 2022] DELETE /compute/v2.1/servers/ba09cec5-a546-4fe5-90df-c90d94591fb2 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 17:04:50.295528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-29c5148c-fd41-49b0-b03a-daa1a6d5cc87 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:50.299417 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-29c5148c-fd41-49b0-b03a-daa1a6d5cc87 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: ba09cec5-a546-4fe5-90df-c90d94591fb2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:50.318484 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29c5148c-fd41-49b0-b03a-daa1a6d5cc87 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:50.319437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29c5148c-fd41-49b0-b03a-daa1a6d5cc87 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:50.320050 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29c5148c-fd41-49b0-b03a-daa1a6d5cc87 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:50.320965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29c5148c-fd41-49b0-b03a-daa1a6d5cc87 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:50.322591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29c5148c-fd41-49b0-b03a-daa1a6d5cc87 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:50.324308 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29c5148c-fd41-49b0-b03a-daa1a6d5cc87 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:50.607277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-edb7064e-fb89-44a8-bd03-9625cc8ca5be tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:50.619182 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-edb7064e-fb89-44a8-bd03-9625cc8ca5be tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876" status: 200 len: 1509 microversion: 2.1 time: 0.577090 Aug 04 17:04:50.629382 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1313/2561] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:50 2022] GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876 => generated 1509 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:50.655105 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f20f48ec-8872-411d-9958-cb2f93358dff tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e6c9add30>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:50.767706 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f20f48ec-8872-411d-9958-cb2f93358dff tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b" status: 200 len: 1436 microversion: 2.1 time: 0.118021 Aug 04 17:04:50.770448 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1314/2562] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:50 2022] GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b => generated 1436 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:50.782721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c9bbacb0-b002-403d-8900-dfe1935dd81f tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:50.785365 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c9bbacb0-b002-403d-8900-dfe1935dd81f tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: baaeefae-c19a-4102-9fc8-245f638aaf45] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:50.803521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9bbacb0-b002-403d-8900-dfe1935dd81f tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:50.808177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9bbacb0-b002-403d-8900-dfe1935dd81f tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:50.808831 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9bbacb0-b002-403d-8900-dfe1935dd81f tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:50.813463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9bbacb0-b002-403d-8900-dfe1935dd81f tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:50.819537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9bbacb0-b002-403d-8900-dfe1935dd81f tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:50.820142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9bbacb0-b002-403d-8900-dfe1935dd81f tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:51.024234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-29c5148c-fd41-49b0-b03a-daa1a6d5cc87 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a373cb0cd004b65a4ea9c804cbea3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82de1eabf714c3492860c2a65df5ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:51.035147 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-29c5148c-fd41-49b0-b03a-daa1a6d5cc87 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/servers/ba09cec5-a546-4fe5-90df-c90d94591fb2" status: 200 len: 1473 microversion: 2.1 time: 0.759380 Aug 04 17:04:51.053669 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1249/2563] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:50 2022] GET /compute/v2.1/servers/ba09cec5-a546-4fe5-90df-c90d94591fb2 => generated 1473 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:51.160069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c9bbacb0-b002-403d-8900-dfe1935dd81f tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:51.170326 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c9bbacb0-b002-403d-8900-dfe1935dd81f tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45" status: 200 len: 1355 microversion: 2.1 time: 0.398131 Aug 04 17:04:51.171634 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1315/2564] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:50 2022] GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45 => generated 1355 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:51.650876 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b9cdfa9a-61eb-479d-a1c3-7580caab0c7a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:51.653053 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b9cdfa9a-61eb-479d-a1c3-7580caab0c7a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b28c38d-e8d7-4a4e-9335-6cd5acd17876] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:51.663264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9cdfa9a-61eb-479d-a1c3-7580caab0c7a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:51.664496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9cdfa9a-61eb-479d-a1c3-7580caab0c7a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:51.665269 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9cdfa9a-61eb-479d-a1c3-7580caab0c7a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:51.666258 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9cdfa9a-61eb-479d-a1c3-7580caab0c7a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:51.667496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9cdfa9a-61eb-479d-a1c3-7580caab0c7a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:51.668095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9cdfa9a-61eb-479d-a1c3-7580caab0c7a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:51.784892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5e81e7c8-3654-4ddd-a6bf-7f7dfa074020 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5b170ca0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:51.863687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b9cdfa9a-61eb-479d-a1c3-7580caab0c7a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:51.882313 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b9cdfa9a-61eb-479d-a1c3-7580caab0c7a tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876" status: 200 len: 1492 microversion: 2.1 time: 0.228186 Aug 04 17:04:51.883189 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1250/2565] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:51 2022] GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876 => generated 1492 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:51.913419 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aff1dacb-3078-44c1-ae04-0cd517ef26f8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:51.915199 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5e81e7c8-3654-4ddd-a6bf-7f7dfa074020 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b" status: 200 len: 1445 microversion: 2.1 time: 0.134861 Aug 04 17:04:51.915659 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aff1dacb-3078-44c1-ae04-0cd517ef26f8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b28c38d-e8d7-4a4e-9335-6cd5acd17876] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:51.918275 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1316/2566] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:51 2022] GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b => generated 1445 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:04:51.932994 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aff1dacb-3078-44c1-ae04-0cd517ef26f8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:51.933507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aff1dacb-3078-44c1-ae04-0cd517ef26f8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:51.934007 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aff1dacb-3078-44c1-ae04-0cd517ef26f8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:51.934498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f8ae824e-901b-4b5d-b8d6-ee30d666dce1 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5b6ec940>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:51.936384 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aff1dacb-3078-44c1-ae04-0cd517ef26f8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:51.941648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aff1dacb-3078-44c1-ae04-0cd517ef26f8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:51.942295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aff1dacb-3078-44c1-ae04-0cd517ef26f8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:51.994521 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f8ae824e-901b-4b5d-b8d6-ee30d666dce1 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b" status: 200 len: 1445 microversion: 2.1 time: 0.065135 Aug 04 17:04:52.004488 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1317/2567] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:04:51 2022] GET /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b => generated 1445 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:52.010756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aff1dacb-3078-44c1-ae04-0cd517ef26f8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b28c38d-e8d7-4a4e-9335-6cd5acd17876] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:04:52.010956 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-86d46810-1c7d-449d-b01d-dd85d6f64e70 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5b170e50>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:52.206395 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aff1dacb-3078-44c1-ae04-0cd517ef26f8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "DELETE /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876" status: 204 len: 0 microversion: 2.1 time: 0.301671 Aug 04 17:04:52.208373 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1251/2568] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:04:51 2022] DELETE /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:04:52.216367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6d77ae8b-ecdc-4ece-91cc-69b56ec4e705 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:52.217392 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6d77ae8b-ecdc-4ece-91cc-69b56ec4e705 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: ba09cec5-a546-4fe5-90df-c90d94591fb2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:52.231905 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d77ae8b-ecdc-4ece-91cc-69b56ec4e705 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:52.232636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d77ae8b-ecdc-4ece-91cc-69b56ec4e705 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:52.233301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d77ae8b-ecdc-4ece-91cc-69b56ec4e705 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:52.235473 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d77ae8b-ecdc-4ece-91cc-69b56ec4e705 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:52.236157 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d77ae8b-ecdc-4ece-91cc-69b56ec4e705 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:52.236809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d77ae8b-ecdc-4ece-91cc-69b56ec4e705 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:52.503206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6d77ae8b-ecdc-4ece-91cc-69b56ec4e705 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a373cb0cd004b65a4ea9c804cbea3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82de1eabf714c3492860c2a65df5ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:52.515084 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6d77ae8b-ecdc-4ece-91cc-69b56ec4e705 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/servers/ba09cec5-a546-4fe5-90df-c90d94591fb2" status: 200 len: 1473 microversion: 2.1 time: 0.301254 Aug 04 17:04:52.516223 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1252/2569] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:52 2022] GET /compute/v2.1/servers/ba09cec5-a546-4fe5-90df-c90d94591fb2 => generated 1473 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:52.521438 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-84ebc324-445f-44e8-aa1b-3d96738add09 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:52.522093 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-84ebc324-445f-44e8-aa1b-3d96738add09 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: baaeefae-c19a-4102-9fc8-245f638aaf45] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:52.537409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84ebc324-445f-44e8-aa1b-3d96738add09 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:52.537921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84ebc324-445f-44e8-aa1b-3d96738add09 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:52.538393 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84ebc324-445f-44e8-aa1b-3d96738add09 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:52.551006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84ebc324-445f-44e8-aa1b-3d96738add09 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:52.551649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84ebc324-445f-44e8-aa1b-3d96738add09 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:52.552140 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84ebc324-445f-44e8-aa1b-3d96738add09 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:52.835154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-84ebc324-445f-44e8-aa1b-3d96738add09 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:52.848364 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-84ebc324-445f-44e8-aa1b-3d96738add09 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45" status: 200 len: 1355 microversion: 2.1 time: 0.330211 Aug 04 17:04:52.854404 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1253/2570] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:52 2022] GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45 => generated 1355 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:52.879616 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-20c52f04-81ae-4b16-98f3-98687109e5e8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:52.881501 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-20c52f04-81ae-4b16-98f3-98687109e5e8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b28c38d-e8d7-4a4e-9335-6cd5acd17876] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:52.890887 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20c52f04-81ae-4b16-98f3-98687109e5e8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:52.891647 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20c52f04-81ae-4b16-98f3-98687109e5e8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:52.892281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20c52f04-81ae-4b16-98f3-98687109e5e8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:52.893218 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20c52f04-81ae-4b16-98f3-98687109e5e8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:52.893868 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20c52f04-81ae-4b16-98f3-98687109e5e8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:52.894648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20c52f04-81ae-4b16-98f3-98687109e5e8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:53.196509 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-86d46810-1c7d-449d-b01d-dd85d6f64e70 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "DELETE /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b" status: 204 len: 0 microversion: 2.1 time: 1.189550 Aug 04 17:04:53.200211 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1318/2571] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:52 2022] DELETE /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b => generated 0 bytes in 1195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:04:53.209152 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f93cfdd4-14e5-4584-8ac5-d1fa1a3a06b2 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:53.209666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f93cfdd4-14e5-4584-8ac5-d1fa1a3a06b2 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 30e66be0-1c2b-401d-8e17-1271b1910f4a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:53.213081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-20c52f04-81ae-4b16-98f3-98687109e5e8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:53.222916 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-20c52f04-81ae-4b16-98f3-98687109e5e8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876" status: 200 len: 1498 microversion: 2.1 time: 0.367004 Aug 04 17:04:53.225023 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f93cfdd4-14e5-4584-8ac5-d1fa1a3a06b2 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:53.225314 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1254/2572] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:52 2022] GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876 => generated 1498 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:53.226171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f93cfdd4-14e5-4584-8ac5-d1fa1a3a06b2 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:53.226823 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f93cfdd4-14e5-4584-8ac5-d1fa1a3a06b2 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:53.227554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f93cfdd4-14e5-4584-8ac5-d1fa1a3a06b2 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:53.238722 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f93cfdd4-14e5-4584-8ac5-d1fa1a3a06b2 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:53.239444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f93cfdd4-14e5-4584-8ac5-d1fa1a3a06b2 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:53.295290 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f93cfdd4-14e5-4584-8ac5-d1fa1a3a06b2 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 30e66be0-1c2b-401d-8e17-1271b1910f4a] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:04:53.328931 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-31f10c9f-017a-4d98-9bab-c8cc8ea876fd req-9095e6a6-754f-419c-ba2a-9919733acd84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baaeefae-c19a-4102-9fc8-245f638aaf45", "name": "network-vif-plugged", "status": "completed", "tag": "90723e13-4b1c-4323-bcb2-c76a4cc125e8"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:53.352289 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-31f10c9f-017a-4d98-9bab-c8cc8ea876fd req-9095e6a6-754f-419c-ba2a-9919733acd84 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:53.354095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-31f10c9f-017a-4d98-9bab-c8cc8ea876fd req-9095e6a6-754f-419c-ba2a-9919733acd84 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:53.355825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-31f10c9f-017a-4d98-9bab-c8cc8ea876fd req-9095e6a6-754f-419c-ba2a-9919733acd84 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:53.392690 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-31f10c9f-017a-4d98-9bab-c8cc8ea876fd req-9095e6a6-754f-419c-ba2a-9919733acd84 service nova] Creating event network-vif-plugged:90723e13-4b1c-4323-bcb2-c76a4cc125e8 for instance baaeefae-c19a-4102-9fc8-245f638aaf45 on n-h1-851359-3 Aug 04 17:04:53.414286 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-31f10c9f-017a-4d98-9bab-c8cc8ea876fd req-9095e6a6-754f-419c-ba2a-9919733acd84 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090274 Aug 04 17:04:53.415606 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1255/2573] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:04:53.466991 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f93cfdd4-14e5-4584-8ac5-d1fa1a3a06b2 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "DELETE /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a" status: 204 len: 0 microversion: 2.1 time: 0.261767 Aug 04 17:04:53.467858 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1319/2574] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:04:53 2022] DELETE /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:04:53.539151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1400176a-d9d2-458d-8b0c-379922630132 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:53.540156 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1400176a-d9d2-458d-8b0c-379922630132 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: ba09cec5-a546-4fe5-90df-c90d94591fb2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:53.548273 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1400176a-d9d2-458d-8b0c-379922630132 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:53.549601 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1400176a-d9d2-458d-8b0c-379922630132 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:53.550435 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1400176a-d9d2-458d-8b0c-379922630132 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:53.551563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1400176a-d9d2-458d-8b0c-379922630132 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:53.552246 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1400176a-d9d2-458d-8b0c-379922630132 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:53.553520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1400176a-d9d2-458d-8b0c-379922630132 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:53.562370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:53.723910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-06e43b33-c7c1-4215-ba85-3a36bece8be6 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1390013308", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "c4b7b07c-f108-4c13-9679-84b31b18674e"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:53.802302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1400176a-d9d2-458d-8b0c-379922630132 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a373cb0cd004b65a4ea9c804cbea3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f82de1eabf714c3492860c2a65df5ae1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:53.810347 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1400176a-d9d2-458d-8b0c-379922630132 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/servers/ba09cec5-a546-4fe5-90df-c90d94591fb2" status: 200 len: 1473 microversion: 2.1 time: 0.276126 Aug 04 17:04:53.827000 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1256/2575] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:53 2022] GET /compute/v2.1/servers/ba09cec5-a546-4fe5-90df-c90d94591fb2 => generated 1473 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:53.855779 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-06e43b33-c7c1-4215-ba85-3a36bece8be6 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] validate_networks() for [('c4b7b07c-f108-4c13-9679-84b31b18674e', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:04:53.872117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-16f0d0fe-7333-4c4e-a9de-e73e83916b2d tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:53.873465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-16f0d0fe-7333-4c4e-a9de-e73e83916b2d tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: baaeefae-c19a-4102-9fc8-245f638aaf45] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:53.888727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16f0d0fe-7333-4c4e-a9de-e73e83916b2d tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:53.889540 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16f0d0fe-7333-4c4e-a9de-e73e83916b2d tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:53.890001 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16f0d0fe-7333-4c4e-a9de-e73e83916b2d tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:53.896238 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16f0d0fe-7333-4c4e-a9de-e73e83916b2d tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:53.896762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16f0d0fe-7333-4c4e-a9de-e73e83916b2d tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:53.899591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16f0d0fe-7333-4c4e-a9de-e73e83916b2d tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:54.303795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-16f0d0fe-7333-4c4e-a9de-e73e83916b2d tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:54.332550 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-16f0d0fe-7333-4c4e-a9de-e73e83916b2d tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45" status: 200 len: 1355 microversion: 2.1 time: 0.464172 Aug 04 17:04:54.333919 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1257/2576] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:53 2022] GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45 => generated 1355 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:04:54.339163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-49b91a24-79d1-4d40-922d-a16e4b82d2db req-b07c1e10-4e49-4b58-92a0-4dff3653e40c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba09cec5-a546-4fe5-90df-c90d94591fb2", "name": "network-vif-deleted", "tag": "14919ddc-0463-47b2-9b85-fd575b876018"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:54.372499 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-49b91a24-79d1-4d40-922d-a16e4b82d2db req-b07c1e10-4e49-4b58-92a0-4dff3653e40c service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:54.376769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-49b91a24-79d1-4d40-922d-a16e4b82d2db req-b07c1e10-4e49-4b58-92a0-4dff3653e40c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:54.377460 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-49b91a24-79d1-4d40-922d-a16e4b82d2db req-b07c1e10-4e49-4b58-92a0-4dff3653e40c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:54.425076 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-49b91a24-79d1-4d40-922d-a16e4b82d2db req-b07c1e10-4e49-4b58-92a0-4dff3653e40c service nova] Creating event network-vif-deleted:14919ddc-0463-47b2-9b85-fd575b876018 for instance ba09cec5-a546-4fe5-90df-c90d94591fb2 on n-h1-851359-3 Aug 04 17:04:54.438976 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-49b91a24-79d1-4d40-922d-a16e4b82d2db req-b07c1e10-4e49-4b58-92a0-4dff3653e40c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103447 Aug 04 17:04:54.445745 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1258/2577] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:54.453533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-70b4f3ee-e228-4014-b2fc-4a1ab1ae42a6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:54.454378 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-70b4f3ee-e228-4014-b2fc-4a1ab1ae42a6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b28c38d-e8d7-4a4e-9335-6cd5acd17876] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:54.493249 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70b4f3ee-e228-4014-b2fc-4a1ab1ae42a6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:54.493793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70b4f3ee-e228-4014-b2fc-4a1ab1ae42a6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:54.500992 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70b4f3ee-e228-4014-b2fc-4a1ab1ae42a6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:54.501908 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70b4f3ee-e228-4014-b2fc-4a1ab1ae42a6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:54.506868 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70b4f3ee-e228-4014-b2fc-4a1ab1ae42a6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:54.507627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70b4f3ee-e228-4014-b2fc-4a1ab1ae42a6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:54.924893 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-70b4f3ee-e228-4014-b2fc-4a1ab1ae42a6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:54.952968 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-70b4f3ee-e228-4014-b2fc-4a1ab1ae42a6 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876" status: 200 len: 1498 microversion: 2.1 time: 0.500972 Aug 04 17:04:54.957085 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1259/2578] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:54 2022] GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876 => generated 1498 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:54.987233 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-06e43b33-c7c1-4215-ba85-3a36bece8be6 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:04:54.987701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-06e43b33-c7c1-4215-ba85-3a36bece8be6 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:04:54.988460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-06e43b33-c7c1-4215-ba85-3a36bece8be6 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:04:54.988939 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-06e43b33-c7c1-4215-ba85-3a36bece8be6 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:04:54.989612 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-06e43b33-c7c1-4215-ba85-3a36bece8be6 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:04:54.998699 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=29 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:55.001858 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-06e43b33-c7c1-4215-ba85-3a36bece8be6 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:55.002451 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-06e43b33-c7c1-4215-ba85-3a36bece8be6 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:55.002977 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-06e43b33-c7c1-4215-ba85-3a36bece8be6 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:55.003773 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-06e43b33-c7c1-4215-ba85-3a36bece8be6 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:55.004488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-06e43b33-c7c1-4215-ba85-3a36bece8be6 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:55.005114 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-06e43b33-c7c1-4215-ba85-3a36bece8be6 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:55.023553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-06e43b33-c7c1-4215-ba85-3a36bece8be6 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Getting quotas for project 86d8604ab1934bdeacd1bb6073ae153a. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:04:55.028868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-06e43b33-c7c1-4215-ba85-3a36bece8be6 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Getting quotas for user 157e8ca7c2494f3ea5c468dc37f55858 and project 86d8604ab1934bdeacd1bb6073ae153a. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:04:55.042358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-06e43b33-c7c1-4215-ba85-3a36bece8be6 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:04:55.044755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-06e43b33-c7c1-4215-ba85-3a36bece8be6 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: b2078942-c5e1-4e12-ac29-43ac324a16cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:04:55.108169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4f2c635b-ba88-4729-9986-9dd54e4385e9 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-603609715", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:55.108819 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-06e43b33-c7c1-4215-ba85-3a36bece8be6 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.389607 Aug 04 17:04:55.109572 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1320/2579] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:04:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:04:55.118620 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f6e3c024-228c-4999-922b-ee1bb2681e12 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:55.119249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f6e3c024-228c-4999-922b-ee1bb2681e12 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] [instance: ba09cec5-a546-4fe5-90df-c90d94591fb2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:55.126870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f6e3c024-228c-4999-922b-ee1bb2681e12 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:55.138388 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f6e3c024-228c-4999-922b-ee1bb2681e12 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:55.139528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f6e3c024-228c-4999-922b-ee1bb2681e12 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:55.140456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f6e3c024-228c-4999-922b-ee1bb2681e12 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:55.141473 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f6e3c024-228c-4999-922b-ee1bb2681e12 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:55.142310 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f6e3c024-228c-4999-922b-ee1bb2681e12 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:55.165391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-4f2c635b-ba88-4729-9986-9dd54e4385e9 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:04:55.168012 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-f6e3c024-228c-4999-922b-ee1bb2681e12 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] HTTP exception thrown: Instance ba09cec5-a546-4fe5-90df-c90d94591fb2 could not be found. Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f6e3c024-228c-4999-922b-ee1bb2681e12 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Request method failure captured: Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/ba09cec5-a546-4fe5-90df-c90d94591fb2 HTTP/1.1 Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_unTPx79lGbTjT_akub73C1089YVQT2JT9CeRrV3deAxok7Sl4oV5-lmYOA1TiG3GYGKeOQAfaixNWI_eeEY9he-34Nm8xlhsTlJSLjipJflYvfN3PxVBZUvzf17rBE6_Z42TT_XaV0DbN-vy0UfWtzuGa3Qjtu_bnFgkZ5gao7ObY Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: f82de1eabf714c3492860c2a65df5ae1 Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ListImageFiltersTestJSON-163868261 Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f82de1eabf714c3492860c2a65df5ae1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f82de1eabf714c3492860c2a65df5ae1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f82de1eabf714c3492860c2a65df5ae1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f82de1eabf714c3492860c2a65df5ae1"}]}] Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ListImageFiltersTestJSON-163868261 Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: f82de1eabf714c3492860c2a65df5ae1 Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-163868261 Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ListImageFiltersTestJSON-163868261-project Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 4a373cb0cd004b65a4ea9c804cbea3ab Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ListImageFiltersTestJSON-163868261-project Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance ba09cec5-a546-4fe5-90df-c90d94591fb2 could not be found. Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'ba09cec5-a546-4fe5-90df-c90d94591fb2'} Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba09cec5-a546-4fe5-90df-c90d94591fb2 could not be found. Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba09cec5-a546-4fe5-90df-c90d94591fb2 could not be found. Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:55.170112 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:55.173749 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:55.173749 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:55.173749 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:55.173749 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:04:55.173749 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:04:55.173749 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba09cec5-a546-4fe5-90df-c90d94591fb2 could not be found. Aug 04 17:04:55.173749 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:55.175804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f6e3c024-228c-4999-922b-ee1bb2681e12 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Returning 404 to user: Instance ba09cec5-a546-4fe5-90df-c90d94591fb2 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:04:55.177564 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f6e3c024-228c-4999-922b-ee1bb2681e12 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "GET /compute/v2.1/servers/ba09cec5-a546-4fe5-90df-c90d94591fb2" status: 404 len: 111 microversion: 2.1 time: 0.066949 Aug 04 17:04:55.178509 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1321/2580] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:55 2022] GET /compute/v2.1/servers/ba09cec5-a546-4fe5-90df-c90d94591fb2 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:04:55.265529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-83d59bc4-87e9-4002-b029-2db19c365d6e tempest-FloatingIPDetailsNegativeTestJSON-749380254 tempest-FloatingIPDetailsNegativeTestJSON-749380254-project] Calling method '.version_select at 0x7f1e6cb4f0d0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:55.325578 n-d-851359-3 devstack@n-api.service[131043]: DEBUG neutronclient.v2_0.client [None req-83d59bc4-87e9-4002-b029-2db19c365d6e tempest-FloatingIPDetailsNegativeTestJSON-749380254 tempest-FloatingIPDetailsNegativeTestJSON-749380254-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP c82baba1-55d7-40cb-b72c-b2200da61aa1 could not be found", "detail": ""}} {{(pid=131043) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 17:04:55.326361 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-83d59bc4-87e9-4002-b029-2db19c365d6e tempest-FloatingIPDetailsNegativeTestJSON-749380254 tempest-FloatingIPDetailsNegativeTestJSON-749380254-project] HTTP exception thrown: Floating IP not found for ID c82baba1-55d7-40cb-b72c-b2200da61aa1 Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-83d59bc4-87e9-4002-b029-2db19c365d6e tempest-FloatingIPDetailsNegativeTestJSON-749380254 tempest-FloatingIPDetailsNegativeTestJSON-749380254-project] Request method failure captured: Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/os-floating-ips/c82baba1-55d7-40cb-b72c-b2200da61aa1 HTTP/1.1 Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_w2SFT6y3ZhVlXumD2Whgg931L8qizse4pRVyyZ1-BqlrGTQ5ZBJTsEItYqzRbsOskXPtv2G_FmWOclwyNIgrTTHL1xFyxlyBwam0bLOrZBSZGjLyqZfkSOdw1kT9XZnQGN938T7TABNWLlnWnwHwAAPTW8HDca8ZwvdJxXSd5HRQI Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 65c59c8e81b540ad95ad2535485940ac Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-749380254 Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/65c59c8e81b540ad95ad2535485940ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/65c59c8e81b540ad95ad2535485940ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_65c59c8e81b540ad95ad2535485940ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/65c59c8e81b540ad95ad2535485940ac"}]}] Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-749380254 Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 65c59c8e81b540ad95ad2535485940ac Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-749380254 Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-749380254-project Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: a0493d7125cd4ea9923c36ce9ed6d970 Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-749380254-project Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: exception: Floating IP not found for ID c82baba1-55d7-40cb-b72c-b2200da61aa1 Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'c82baba1-55d7-40cb-b72c-b2200da61aa1'} Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP c82baba1-55d7-40cb-b72c-b2200da61aa1 could not be found Aug 04 17:04:55.330165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f66bc8a-622d-4560-9ef8-184909389f08'] Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID c82baba1-55d7-40cb-b72c-b2200da61aa1. Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID c82baba1-55d7-40cb-b72c-b2200da61aa1 Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID c82baba1-55d7-40cb-b72c-b2200da61aa1 Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-83d59bc4-87e9-4002-b029-2db19c365d6e tempest-FloatingIPDetailsNegativeTestJSON-749380254 tempest-FloatingIPDetailsNegativeTestJSON-749380254-project] Returning 404 to user: Floating IP not found for ID c82baba1-55d7-40cb-b72c-b2200da61aa1 {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-83d59bc4-87e9-4002-b029-2db19c365d6e tempest-FloatingIPDetailsNegativeTestJSON-749380254 tempest-FloatingIPDetailsNegativeTestJSON-749380254-project] 10.222.0.93 "GET /compute/v2.1/os-floating-ips/c82baba1-55d7-40cb-b72c-b2200da61aa1" status: 404 len: 111 microversion: 2.1 time: 0.152172 Aug 04 17:04:55.333564 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1322/2581] 10.222.0.93 () {58 vars in 1260 bytes} [Thu Aug 4 17:04:55 2022] GET /compute/v2.1/os-floating-ips/c82baba1-55d7-40cb-b72c-b2200da61aa1 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:04:55.338207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-14220973-ab40-4c4d-b06c-165c81a2004b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:55.338547 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-14220973-ab40-4c4d-b06c-165c81a2004b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: b2078942-c5e1-4e12-ac29-43ac324a16cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:55.419198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-14220973-ab40-4c4d-b06c-165c81a2004b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:55.428762 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-14220973-ab40-4c4d-b06c-165c81a2004b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb" status: 200 len: 1208 microversion: 2.1 time: 0.094566 Aug 04 17:04:55.430092 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1323/2582] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:55 2022] GET /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb => generated 1208 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:55.436125 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bec9931f-0dfd-43f2-95f4-504d0dc64005 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5ae41940>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:55.562850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-4f2c635b-ba88-4729-9986-9dd54e4385e9 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:04:55.563856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-4f2c635b-ba88-4729-9986-9dd54e4385e9 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:04:55.564560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-4f2c635b-ba88-4729-9986-9dd54e4385e9 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:04:55.565184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-4f2c635b-ba88-4729-9986-9dd54e4385e9 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:04:55.565685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-4f2c635b-ba88-4729-9986-9dd54e4385e9 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:04:55.579979 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=92,nova_cell0:UPDATE=7 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:55.591480 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f2c635b-ba88-4729-9986-9dd54e4385e9 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:55.593530 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f2c635b-ba88-4729-9986-9dd54e4385e9 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:55.594676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f2c635b-ba88-4729-9986-9dd54e4385e9 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:55.595533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f2c635b-ba88-4729-9986-9dd54e4385e9 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:55.596211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f2c635b-ba88-4729-9986-9dd54e4385e9 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:55.596839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f2c635b-ba88-4729-9986-9dd54e4385e9 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:55.611925 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=23 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:55.658074 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-4f2c635b-ba88-4729-9986-9dd54e4385e9 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for project de328615cef94528b55b8309dd9b82b0. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:04:55.672253 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-4f2c635b-ba88-4729-9986-9dd54e4385e9 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for user abad886e45bd4c4b8f5f0f86c45eb068 and project de328615cef94528b55b8309dd9b82b0. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:04:55.703561 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4f2c635b-ba88-4729-9986-9dd54e4385e9 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:04:55.706452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4f2c635b-ba88-4729-9986-9dd54e4385e9 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 42dff36d-2301-4c8c-b3a5-1dd535cf9664] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:04:55.771916 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4f2c635b-ba88-4729-9986-9dd54e4385e9 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.813501 Aug 04 17:04:55.791166 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1260/2583] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:04:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:04:55.804280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5b8d8ee5-37c1-448d-9732-6c077b36bf15 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:55.807455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5b8d8ee5-37c1-448d-9732-6c077b36bf15 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: baaeefae-c19a-4102-9fc8-245f638aaf45] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:55.829384 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b8d8ee5-37c1-448d-9732-6c077b36bf15 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:55.834522 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b8d8ee5-37c1-448d-9732-6c077b36bf15 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:55.835106 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b8d8ee5-37c1-448d-9732-6c077b36bf15 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:55.838688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b8d8ee5-37c1-448d-9732-6c077b36bf15 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:55.839272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b8d8ee5-37c1-448d-9732-6c077b36bf15 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:55.842482 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b8d8ee5-37c1-448d-9732-6c077b36bf15 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:56.174213 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bec9931f-0dfd-43f2-95f4-504d0dc64005 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "DELETE /compute/v2.1/images/02bc6af0-ae31-4dbe-9498-dfa200074e7b" status: 204 len: 0 microversion: 2.1 time: 0.742304 Aug 04 17:04:56.175084 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1324/2584] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:55 2022] DELETE /compute/v2.1/images/02bc6af0-ae31-4dbe-9498-dfa200074e7b => generated 0 bytes in 744 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:04:56.256148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-ce43e13e-b4d8-4973-b2d4-cdb544d2c4b4 req-cb81b767-f2e0-4a4d-852e-a96ee0d64437 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baaeefae-c19a-4102-9fc8-245f638aaf45", "name": "network-vif-plugged", "status": "completed", "tag": "72399a46-54e5-495a-ae71-1fa3ca0abe4a"}, {"server_uuid": "baaeefae-c19a-4102-9fc8-245f638aaf45", "name": "network-vif-plugged", "status": "completed", "tag": "49f5666d-c14e-48ba-a220-99abd6a77877"}, {"server_uuid": "30e66be0-1c2b-401d-8e17-1271b1910f4a", "name": "network-vif-unplugged", "status": "completed", "tag": "93b8fa03-1f37-431c-b87c-431cafd2680c"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:56.277112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ce43e13e-b4d8-4973-b2d4-cdb544d2c4b4 req-cb81b767-f2e0-4a4d-852e-a96ee0d64437 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:56.278902 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ce43e13e-b4d8-4973-b2d4-cdb544d2c4b4 req-cb81b767-f2e0-4a4d-852e-a96ee0d64437 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:56.290174 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ce43e13e-b4d8-4973-b2d4-cdb544d2c4b4 req-cb81b767-f2e0-4a4d-852e-a96ee0d64437 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:56.311351 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-ce43e13e-b4d8-4973-b2d4-cdb544d2c4b4 req-cb81b767-f2e0-4a4d-852e-a96ee0d64437 service nova] Creating event network-vif-plugged:72399a46-54e5-495a-ae71-1fa3ca0abe4a for instance baaeefae-c19a-4102-9fc8-245f638aaf45 on n-h1-851359-3 Aug 04 17:04:56.314508 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-ce43e13e-b4d8-4973-b2d4-cdb544d2c4b4 req-cb81b767-f2e0-4a4d-852e-a96ee0d64437 service nova] Creating event network-vif-plugged:49f5666d-c14e-48ba-a220-99abd6a77877 for instance baaeefae-c19a-4102-9fc8-245f638aaf45 on n-h1-851359-3 Aug 04 17:04:56.316099 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-ce43e13e-b4d8-4973-b2d4-cdb544d2c4b4 req-cb81b767-f2e0-4a4d-852e-a96ee0d64437 service nova] Creating event network-vif-unplugged:93b8fa03-1f37-431c-b87c-431cafd2680c for instance 30e66be0-1c2b-401d-8e17-1271b1910f4a on n-h2-851359-3 Aug 04 17:04:56.328822 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-ce43e13e-b4d8-4973-b2d4-cdb544d2c4b4 req-cb81b767-f2e0-4a4d-852e-a96ee0d64437 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.152211 Aug 04 17:04:56.330641 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1325/2585] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:56.338695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dea66d89-3644-48d6-8ee5-34d0668e90a0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:56.339988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dea66d89-3644-48d6-8ee5-34d0668e90a0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 42dff36d-2301-4c8c-b3a5-1dd535cf9664] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:56.444259 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dea66d89-3644-48d6-8ee5-34d0668e90a0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:56.454462 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dea66d89-3644-48d6-8ee5-34d0668e90a0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664" status: 200 len: 1216 microversion: 2.1 time: 0.121708 Aug 04 17:04:56.471907 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1326/2586] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:56 2022] GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664 => generated 1216 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:56.479881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-66224bdf-cef6-49e6-9447-576e07d9c5e2 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:56.498783 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-66224bdf-cef6-49e6-9447-576e07d9c5e2 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b28c38d-e8d7-4a4e-9335-6cd5acd17876] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:56.514110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66224bdf-cef6-49e6-9447-576e07d9c5e2 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:56.515761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66224bdf-cef6-49e6-9447-576e07d9c5e2 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:56.518896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66224bdf-cef6-49e6-9447-576e07d9c5e2 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:56.522527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66224bdf-cef6-49e6-9447-576e07d9c5e2 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:56.524774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66224bdf-cef6-49e6-9447-576e07d9c5e2 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:56.527433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66224bdf-cef6-49e6-9447-576e07d9c5e2 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:56.991384 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5b8d8ee5-37c1-448d-9732-6c077b36bf15 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:57.012231 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5b8d8ee5-37c1-448d-9732-6c077b36bf15 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45" status: 200 len: 1355 microversion: 2.1 time: 1.220272 Aug 04 17:04:57.017554 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1261/2587] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:55 2022] GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45 => generated 1355 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:57.027544 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4b7747b9-ab9a-4a90-8b4c-75f76cca9504 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5b5c5820>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:57.133250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-66224bdf-cef6-49e6-9447-576e07d9c5e2 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d19d8e7953b4e479b4e2143a3c3546a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bb708c7ba24e4d828f19ecc60e1f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:57.166086 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-66224bdf-cef6-49e6-9447-576e07d9c5e2 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876" status: 200 len: 1456 microversion: 2.1 time: 0.689210 Aug 04 17:04:57.178010 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1327/2588] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:56 2022] GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876 => generated 1456 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:57.202334 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f8d49da9-0888-4822-8d10-a4a945b288e3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:57.203082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f8d49da9-0888-4822-8d10-a4a945b288e3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: b2078942-c5e1-4e12-ac29-43ac324a16cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:57.219379 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8d49da9-0888-4822-8d10-a4a945b288e3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:57.220066 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8d49da9-0888-4822-8d10-a4a945b288e3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:57.220527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8d49da9-0888-4822-8d10-a4a945b288e3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:57.221259 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8d49da9-0888-4822-8d10-a4a945b288e3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:57.223645 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8d49da9-0888-4822-8d10-a4a945b288e3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:57.223645 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8d49da9-0888-4822-8d10-a4a945b288e3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:57.248157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:04:57.324404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f8d49da9-0888-4822-8d10-a4a945b288e3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:57.339816 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f8d49da9-0888-4822-8d10-a4a945b288e3 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb" status: 200 len: 1266 microversion: 2.1 time: 0.163917 Aug 04 17:04:57.340453 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1328/2589] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:57 2022] GET /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:57.345499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-f0012382-d724-4013-9f57-4d463ab63df5 req-a415d285-fb37-4c8f-b3b0-466da39f8aef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b28c38d-e8d7-4a4e-9335-6cd5acd17876", "name": "network-vif-deleted", "tag": "24a5e1cf-0dc5-4f6f-b106-d7af8675342b"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:57.369214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f0012382-d724-4013-9f57-4d463ab63df5 req-a415d285-fb37-4c8f-b3b0-466da39f8aef service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:57.369214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f0012382-d724-4013-9f57-4d463ab63df5 req-a415d285-fb37-4c8f-b3b0-466da39f8aef service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:57.369586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f0012382-d724-4013-9f57-4d463ab63df5 req-a415d285-fb37-4c8f-b3b0-466da39f8aef service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:57.403460 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-f0012382-d724-4013-9f57-4d463ab63df5 req-a415d285-fb37-4c8f-b3b0-466da39f8aef service nova] Creating event network-vif-deleted:24a5e1cf-0dc5-4f6f-b106-d7af8675342b for instance 1b28c38d-e8d7-4a4e-9335-6cd5acd17876 on n-h2-851359-3 Aug 04 17:04:57.415322 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-f0012382-d724-4013-9f57-4d463ab63df5 req-a415d285-fb37-4c8f-b3b0-466da39f8aef service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073393 Aug 04 17:04:57.415939 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1329/2590] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:57.432039 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4b7747b9-ab9a-4a90-8b4c-75f76cca9504 tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "DELETE /compute/v2.1/images/fe940275-840d-44eb-98a1-27bc7460c23c" status: 204 len: 0 microversion: 2.1 time: 0.412242 Aug 04 17:04:57.433521 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1262/2591] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:57 2022] DELETE /compute/v2.1/images/fe940275-840d-44eb-98a1-27bc7460c23c => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:04:57.442953 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7c275499-c45a-4ee2-a73a-99182ed6d44d tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] Calling method '.version_select at 0x7f1e5b11caf0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:57.477711 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dc564f44-b2c1-4e65-838d-22f075bc22ed tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:57.478663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dc564f44-b2c1-4e65-838d-22f075bc22ed tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 42dff36d-2301-4c8c-b3a5-1dd535cf9664] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:57.487752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc564f44-b2c1-4e65-838d-22f075bc22ed tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:57.488659 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc564f44-b2c1-4e65-838d-22f075bc22ed tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:57.491082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc564f44-b2c1-4e65-838d-22f075bc22ed tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:57.492328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc564f44-b2c1-4e65-838d-22f075bc22ed tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:57.493304 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc564f44-b2c1-4e65-838d-22f075bc22ed tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:57.494543 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc564f44-b2c1-4e65-838d-22f075bc22ed tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:57.590208 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dc564f44-b2c1-4e65-838d-22f075bc22ed tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:57.612002 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dc564f44-b2c1-4e65-838d-22f075bc22ed tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664" status: 200 len: 1268 microversion: 2.1 time: 0.137988 Aug 04 17:04:57.622309 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1263/2592] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:57 2022] GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664 => generated 1268 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:57.816725 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7c275499-c45a-4ee2-a73a-99182ed6d44d tempest-ListImageFiltersTestJSON-163868261 tempest-ListImageFiltersTestJSON-163868261-project] 10.222.0.93 "DELETE /compute/v2.1/images/d29c35ea-a363-48ad-a6dc-ec58b8346c74" status: 204 len: 0 microversion: 2.1 time: 0.377560 Aug 04 17:04:57.817377 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1330/2593] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:57 2022] DELETE /compute/v2.1/images/d29c35ea-a363-48ad-a6dc-ec58b8346c74 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:04:58.044999 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2c237db7-64af-469f-a67b-8135e2b456e7 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:58.045676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2c237db7-64af-469f-a67b-8135e2b456e7 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: baaeefae-c19a-4102-9fc8-245f638aaf45] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:58.054498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c237db7-64af-469f-a67b-8135e2b456e7 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:58.055381 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c237db7-64af-469f-a67b-8135e2b456e7 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:58.056066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c237db7-64af-469f-a67b-8135e2b456e7 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:58.057035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c237db7-64af-469f-a67b-8135e2b456e7 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:58.057720 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c237db7-64af-469f-a67b-8135e2b456e7 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:58.058425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c237db7-64af-469f-a67b-8135e2b456e7 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:58.191642 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6f400ba2-e61f-4837-a5f4-1e42f9e8f182 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:58.192398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6f400ba2-e61f-4837-a5f4-1e42f9e8f182 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b28c38d-e8d7-4a4e-9335-6cd5acd17876] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:58.204453 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f400ba2-e61f-4837-a5f4-1e42f9e8f182 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:58.208733 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f400ba2-e61f-4837-a5f4-1e42f9e8f182 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:58.209209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f400ba2-e61f-4837-a5f4-1e42f9e8f182 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:58.209956 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f400ba2-e61f-4837-a5f4-1e42f9e8f182 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:58.210455 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f400ba2-e61f-4837-a5f4-1e42f9e8f182 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:58.212367 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f400ba2-e61f-4837-a5f4-1e42f9e8f182 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:58.250148 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-6f400ba2-e61f-4837-a5f4-1e42f9e8f182 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] HTTP exception thrown: Instance 1b28c38d-e8d7-4a4e-9335-6cd5acd17876 could not be found. Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6f400ba2-e61f-4837-a5f4-1e42f9e8f182 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Request method failure captured: Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876 HTTP/1.1 Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_r18zhXKrUNPkTcrqBpyOxEtqmRnN_52CLFZjb6_V1_cyggOBj-ig1uBg8_Jl5DEv1edGlVMK7wsNG9aSNASIbB3U35pyAy7fX4gAPexD_7GsQqaSV2-qce83lQvxIJx4U5ZPEYYCvd7_VfIsOpvvr8aQqah0W-5V3XON-ztAeWk4Y Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/92bb708c7ba24e4d828f19ecc60e1f91"}]}] Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 6d19d8e7953b4e479b4e2143a3c3546a Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 1b28c38d-e8d7-4a4e-9335-6cd5acd17876 could not be found. Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '1b28c38d-e8d7-4a4e-9335-6cd5acd17876'} Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b28c38d-e8d7-4a4e-9335-6cd5acd17876 could not be found. Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b28c38d-e8d7-4a4e-9335-6cd5acd17876 could not be found. Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:58.253048 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.257952 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.257952 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:58.257952 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:58.257952 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:04:58.257952 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:04:58.257952 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b28c38d-e8d7-4a4e-9335-6cd5acd17876 could not be found. Aug 04 17:04:58.257952 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.260604 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6f400ba2-e61f-4837-a5f4-1e42f9e8f182 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Returning 404 to user: Instance 1b28c38d-e8d7-4a4e-9335-6cd5acd17876 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:04:58.261698 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6f400ba2-e61f-4837-a5f4-1e42f9e8f182 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876" status: 404 len: 111 microversion: 2.1 time: 0.076296 Aug 04 17:04:58.263429 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1331/2594] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:58 2022] GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:04:58.280392 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d03f697f-eab7-4db7-acf7-450e2a2cbd74 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:58.281352 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d03f697f-eab7-4db7-acf7-450e2a2cbd74 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b28c38d-e8d7-4a4e-9335-6cd5acd17876] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:58.289917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d03f697f-eab7-4db7-acf7-450e2a2cbd74 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:58.291025 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d03f697f-eab7-4db7-acf7-450e2a2cbd74 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:58.291803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d03f697f-eab7-4db7-acf7-450e2a2cbd74 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:58.292785 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d03f697f-eab7-4db7-acf7-450e2a2cbd74 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:58.293442 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d03f697f-eab7-4db7-acf7-450e2a2cbd74 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:58.295122 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d03f697f-eab7-4db7-acf7-450e2a2cbd74 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:58.315956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2c237db7-64af-469f-a67b-8135e2b456e7 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:58.325741 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2c237db7-64af-469f-a67b-8135e2b456e7 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45" status: 200 len: 1355 microversion: 2.1 time: 0.286731 Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-d03f697f-eab7-4db7-acf7-450e2a2cbd74 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] HTTP exception thrown: Instance 1b28c38d-e8d7-4a4e-9335-6cd5acd17876 could not be found. Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d03f697f-eab7-4db7-acf7-450e2a2cbd74 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Request method failure captured: Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876 HTTP/1.1 Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_r18zhXKrUNPkTcrqBpyOxEtqmRnN_52CLFZjb6_V1_cyggOBj-ig1uBg8_Jl5DEv1edGlVMK7wsNG9aSNASIbB3U35pyAy7fX4gAPexD_7GsQqaSV2-qce83lQvxIJx4U5ZPEYYCvd7_VfIsOpvvr8aQqah0W-5V3XON-ztAeWk4Y Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/92bb708c7ba24e4d828f19ecc60e1f91"}]}] Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 6d19d8e7953b4e479b4e2143a3c3546a Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 1b28c38d-e8d7-4a4e-9335-6cd5acd17876 could not be found. Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '1b28c38d-e8d7-4a4e-9335-6cd5acd17876'} Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b28c38d-e8d7-4a4e-9335-6cd5acd17876 could not be found. Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:04:58.342607 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:04:58.352194 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:04:58.352194 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:04:58.352194 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b28c38d-e8d7-4a4e-9335-6cd5acd17876 could not be found. Aug 04 17:04:58.352194 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.352194 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:58.352194 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.352194 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.352194 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:58.352194 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:58.352194 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:04:58.352194 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:04:58.352194 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b28c38d-e8d7-4a4e-9335-6cd5acd17876 could not be found. Aug 04 17:04:58.352194 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.352194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d03f697f-eab7-4db7-acf7-450e2a2cbd74 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Returning 404 to user: Instance 1b28c38d-e8d7-4a4e-9335-6cd5acd17876 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:04:58.352194 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d03f697f-eab7-4db7-acf7-450e2a2cbd74 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "DELETE /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876" status: 404 len: 111 microversion: 2.1 time: 0.069179 Aug 04 17:04:58.352194 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1332/2595] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:04:58 2022] DELETE /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:04:58.354313 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1264/2596] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:58 2022] GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45 => generated 1355 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:58.362776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c05dbb1b-3da1-4caf-a0e6-1f6b5ec2707a tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:58.363919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c05dbb1b-3da1-4caf-a0e6-1f6b5ec2707a tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: b2078942-c5e1-4e12-ac29-43ac324a16cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:58.371802 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c05dbb1b-3da1-4caf-a0e6-1f6b5ec2707a tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:58.372732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c05dbb1b-3da1-4caf-a0e6-1f6b5ec2707a tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:58.373411 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c05dbb1b-3da1-4caf-a0e6-1f6b5ec2707a tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:58.374810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c05dbb1b-3da1-4caf-a0e6-1f6b5ec2707a tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:58.377264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c05dbb1b-3da1-4caf-a0e6-1f6b5ec2707a tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:58.377968 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c05dbb1b-3da1-4caf-a0e6-1f6b5ec2707a tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:58.378394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-796b7d78-4e63-483e-9d96-7dab52820dbe tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:58.379723 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-796b7d78-4e63-483e-9d96-7dab52820dbe tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b28c38d-e8d7-4a4e-9335-6cd5acd17876] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:58.387159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-796b7d78-4e63-483e-9d96-7dab52820dbe tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:58.387677 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-796b7d78-4e63-483e-9d96-7dab52820dbe tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:58.388131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-796b7d78-4e63-483e-9d96-7dab52820dbe tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:58.388858 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-796b7d78-4e63-483e-9d96-7dab52820dbe tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:58.389325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-796b7d78-4e63-483e-9d96-7dab52820dbe tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:58.389816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-796b7d78-4e63-483e-9d96-7dab52820dbe tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:58.408051 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-796b7d78-4e63-483e-9d96-7dab52820dbe tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] HTTP exception thrown: Instance 1b28c38d-e8d7-4a4e-9335-6cd5acd17876 could not be found. Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-796b7d78-4e63-483e-9d96-7dab52820dbe tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Request method failure captured: Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876 HTTP/1.1 Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_r18zhXKrUNPkTcrqBpyOxEtqmRnN_52CLFZjb6_V1_cyggOBj-ig1uBg8_Jl5DEv1edGlVMK7wsNG9aSNASIbB3U35pyAy7fX4gAPexD_7GsQqaSV2-qce83lQvxIJx4U5ZPEYYCvd7_VfIsOpvvr8aQqah0W-5V3XON-ztAeWk4Y Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/92bb708c7ba24e4d828f19ecc60e1f91"}]}] Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 6d19d8e7953b4e479b4e2143a3c3546a Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 1b28c38d-e8d7-4a4e-9335-6cd5acd17876 could not be found. Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '1b28c38d-e8d7-4a4e-9335-6cd5acd17876'} Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b28c38d-e8d7-4a4e-9335-6cd5acd17876 could not be found. Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b28c38d-e8d7-4a4e-9335-6cd5acd17876 could not be found. Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:58.409768 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.413317 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.413317 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:58.413317 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:58.413317 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:04:58.413317 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:04:58.413317 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b28c38d-e8d7-4a4e-9335-6cd5acd17876 could not be found. Aug 04 17:04:58.413317 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.413317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-796b7d78-4e63-483e-9d96-7dab52820dbe tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Returning 404 to user: Instance 1b28c38d-e8d7-4a4e-9335-6cd5acd17876 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:04:58.413317 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-796b7d78-4e63-483e-9d96-7dab52820dbe tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876" status: 404 len: 111 microversion: 2.1 time: 0.064299 Aug 04 17:04:58.413317 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1333/2597] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:58 2022] GET /compute/v2.1/servers/1b28c38d-e8d7-4a4e-9335-6cd5acd17876 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:04:58.423819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-afa1d257-f253-445e-b8a6-bc6155059339 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:58.425226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-afa1d257-f253-445e-b8a6-bc6155059339 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:58.433744 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-afa1d257-f253-445e-b8a6-bc6155059339 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:58.434858 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-afa1d257-f253-445e-b8a6-bc6155059339 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:58.435810 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-afa1d257-f253-445e-b8a6-bc6155059339 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:58.436680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-afa1d257-f253-445e-b8a6-bc6155059339 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:58.437174 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-afa1d257-f253-445e-b8a6-bc6155059339 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:58.437670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-afa1d257-f253-445e-b8a6-bc6155059339 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:58.458318 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-afa1d257-f253-445e-b8a6-bc6155059339 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] HTTP exception thrown: Instance 8622154b-7c51-4c6c-9652-f81e32e35f7b could not be found. Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-afa1d257-f253-445e-b8a6-bc6155059339 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Request method failure captured: Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b HTTP/1.1 Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_r18zhXKrUNPkTcrqBpyOxEtqmRnN_52CLFZjb6_V1_cyggOBj-ig1uBg8_Jl5DEv1edGlVMK7wsNG9aSNASIbB3U35pyAy7fX4gAPexD_7GsQqaSV2-qce83lQvxIJx4U5ZPEYYCvd7_VfIsOpvvr8aQqah0W-5V3XON-ztAeWk4Y Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/92bb708c7ba24e4d828f19ecc60e1f91"}]}] Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 6d19d8e7953b4e479b4e2143a3c3546a Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 8622154b-7c51-4c6c-9652-f81e32e35f7b could not be found. Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '8622154b-7c51-4c6c-9652-f81e32e35f7b'} Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8622154b-7c51-4c6c-9652-f81e32e35f7b could not be found. Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:04:58.460423 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:04:58.465802 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8622154b-7c51-4c6c-9652-f81e32e35f7b could not be found. Aug 04 17:04:58.465802 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.465802 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:58.465802 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.465802 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.465802 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:58.465802 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:58.465802 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:04:58.465802 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:04:58.465802 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8622154b-7c51-4c6c-9652-f81e32e35f7b could not be found. Aug 04 17:04:58.465802 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.470598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c05dbb1b-3da1-4caf-a0e6-1f6b5ec2707a tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:58.470932 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-afa1d257-f253-445e-b8a6-bc6155059339 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Returning 404 to user: Instance 8622154b-7c51-4c6c-9652-f81e32e35f7b could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:04:58.471679 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-afa1d257-f253-445e-b8a6-bc6155059339 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b" status: 404 len: 111 microversion: 2.1 time: 0.054384 Aug 04 17:04:58.472249 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1334/2598] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:04:58 2022] DELETE /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:04:58.480518 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c05dbb1b-3da1-4caf-a0e6-1f6b5ec2707a tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb" status: 200 len: 1266 microversion: 2.1 time: 0.122924 Aug 04 17:04:58.480849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6c0b4847-797d-4cc3-b722-9497281923ee tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:58.481691 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1265/2599] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:58 2022] GET /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb => generated 1266 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:04:58.481878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6c0b4847-797d-4cc3-b722-9497281923ee tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 8622154b-7c51-4c6c-9652-f81e32e35f7b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:58.493616 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c0b4847-797d-4cc3-b722-9497281923ee tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:58.494624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c0b4847-797d-4cc3-b722-9497281923ee tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:58.495329 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c0b4847-797d-4cc3-b722-9497281923ee tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:58.496308 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c0b4847-797d-4cc3-b722-9497281923ee tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:58.498179 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c0b4847-797d-4cc3-b722-9497281923ee tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:58.498860 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c0b4847-797d-4cc3-b722-9497281923ee tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:58.518462 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-6c0b4847-797d-4cc3-b722-9497281923ee tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] HTTP exception thrown: Instance 8622154b-7c51-4c6c-9652-f81e32e35f7b could not be found. Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6c0b4847-797d-4cc3-b722-9497281923ee tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Request method failure captured: Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b HTTP/1.1 Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_r18zhXKrUNPkTcrqBpyOxEtqmRnN_52CLFZjb6_V1_cyggOBj-ig1uBg8_Jl5DEv1edGlVMK7wsNG9aSNASIbB3U35pyAy7fX4gAPexD_7GsQqaSV2-qce83lQvxIJx4U5ZPEYYCvd7_VfIsOpvvr8aQqah0W-5V3XON-ztAeWk4Y Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/92bb708c7ba24e4d828f19ecc60e1f91"}]}] Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 6d19d8e7953b4e479b4e2143a3c3546a Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 8622154b-7c51-4c6c-9652-f81e32e35f7b could not be found. Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '8622154b-7c51-4c6c-9652-f81e32e35f7b'} Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8622154b-7c51-4c6c-9652-f81e32e35f7b could not be found. Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8622154b-7c51-4c6c-9652-f81e32e35f7b could not be found. Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:58.521075 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.525148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.525148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:58.525148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:58.525148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:04:58.525148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:04:58.525148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8622154b-7c51-4c6c-9652-f81e32e35f7b could not be found. Aug 04 17:04:58.525148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.525148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6c0b4847-797d-4cc3-b722-9497281923ee tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Returning 404 to user: Instance 8622154b-7c51-4c6c-9652-f81e32e35f7b could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:04:58.525148 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6c0b4847-797d-4cc3-b722-9497281923ee tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b" status: 404 len: 111 microversion: 2.1 time: 0.046304 Aug 04 17:04:58.525148 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1335/2600] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:58 2022] GET /compute/v2.1/servers/8622154b-7c51-4c6c-9652-f81e32e35f7b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:04:58.532458 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-21fe012d-8ef2-41d8-b9dc-496c90706b57 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:58.533196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-21fe012d-8ef2-41d8-b9dc-496c90706b57 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:58.541606 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21fe012d-8ef2-41d8-b9dc-496c90706b57 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:58.542245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21fe012d-8ef2-41d8-b9dc-496c90706b57 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:58.542865 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21fe012d-8ef2-41d8-b9dc-496c90706b57 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:58.543588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21fe012d-8ef2-41d8-b9dc-496c90706b57 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:58.544056 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21fe012d-8ef2-41d8-b9dc-496c90706b57 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:58.544488 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21fe012d-8ef2-41d8-b9dc-496c90706b57 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:58.563830 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-21fe012d-8ef2-41d8-b9dc-496c90706b57 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] HTTP exception thrown: Instance 826b896f-e0e0-48e1-a520-b5fade2c374b could not be found. Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-21fe012d-8ef2-41d8-b9dc-496c90706b57 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Request method failure captured: Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b HTTP/1.1 Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_r18zhXKrUNPkTcrqBpyOxEtqmRnN_52CLFZjb6_V1_cyggOBj-ig1uBg8_Jl5DEv1edGlVMK7wsNG9aSNASIbB3U35pyAy7fX4gAPexD_7GsQqaSV2-qce83lQvxIJx4U5ZPEYYCvd7_VfIsOpvvr8aQqah0W-5V3XON-ztAeWk4Y Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/92bb708c7ba24e4d828f19ecc60e1f91"}]}] Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 6d19d8e7953b4e479b4e2143a3c3546a Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 826b896f-e0e0-48e1-a520-b5fade2c374b could not be found. Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '826b896f-e0e0-48e1-a520-b5fade2c374b'} Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 826b896f-e0e0-48e1-a520-b5fade2c374b could not be found. Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:04:58.577269 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:04:58.581480 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 826b896f-e0e0-48e1-a520-b5fade2c374b could not be found. Aug 04 17:04:58.581480 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.581480 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:58.581480 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.581480 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.581480 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:58.581480 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:58.581480 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:04:58.581480 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:04:58.581480 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 826b896f-e0e0-48e1-a520-b5fade2c374b could not be found. Aug 04 17:04:58.581480 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.581480 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-21fe012d-8ef2-41d8-b9dc-496c90706b57 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Returning 404 to user: Instance 826b896f-e0e0-48e1-a520-b5fade2c374b could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:04:58.581480 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-21fe012d-8ef2-41d8-b9dc-496c90706b57 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "DELETE /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 404 len: 111 microversion: 2.1 time: 0.051778 Aug 04 17:04:58.581480 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1266/2601] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:04:58 2022] DELETE /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:04:58.589675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5f6f17d1-4c82-427c-a87c-f29e6a6625e8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:58.590354 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5f6f17d1-4c82-427c-a87c-f29e6a6625e8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 826b896f-e0e0-48e1-a520-b5fade2c374b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:58.606853 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5f6f17d1-4c82-427c-a87c-f29e6a6625e8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:58.615651 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5f6f17d1-4c82-427c-a87c-f29e6a6625e8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:58.616266 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5f6f17d1-4c82-427c-a87c-f29e6a6625e8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:58.617132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5f6f17d1-4c82-427c-a87c-f29e6a6625e8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:58.617713 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5f6f17d1-4c82-427c-a87c-f29e6a6625e8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:58.618390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5f6f17d1-4c82-427c-a87c-f29e6a6625e8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:58.639739 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-5f6f17d1-4c82-427c-a87c-f29e6a6625e8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] HTTP exception thrown: Instance 826b896f-e0e0-48e1-a520-b5fade2c374b could not be found. Aug 04 17:04:58.640650 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e46fb1de-61f5-41a5-83d3-f46ee60df78d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:58.642435 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e46fb1de-61f5-41a5-83d3-f46ee60df78d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 42dff36d-2301-4c8c-b3a5-1dd535cf9664] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5f6f17d1-4c82-427c-a87c-f29e6a6625e8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Request method failure captured: Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b HTTP/1.1 Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_r18zhXKrUNPkTcrqBpyOxEtqmRnN_52CLFZjb6_V1_cyggOBj-ig1uBg8_Jl5DEv1edGlVMK7wsNG9aSNASIbB3U35pyAy7fX4gAPexD_7GsQqaSV2-qce83lQvxIJx4U5ZPEYYCvd7_VfIsOpvvr8aQqah0W-5V3XON-ztAeWk4Y Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/92bb708c7ba24e4d828f19ecc60e1f91"}]}] Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 6d19d8e7953b4e479b4e2143a3c3546a Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 826b896f-e0e0-48e1-a520-b5fade2c374b could not be found. Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '826b896f-e0e0-48e1-a520-b5fade2c374b'} Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 826b896f-e0e0-48e1-a520-b5fade2c374b could not be found. Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 826b896f-e0e0-48e1-a520-b5fade2c374b could not be found. Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:58.650325 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.654563 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.654563 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:58.654563 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:58.654563 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:04:58.654563 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:04:58.654563 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 826b896f-e0e0-48e1-a520-b5fade2c374b could not be found. Aug 04 17:04:58.654563 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.654944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e46fb1de-61f5-41a5-83d3-f46ee60df78d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:58.654944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e46fb1de-61f5-41a5-83d3-f46ee60df78d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:58.654944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e46fb1de-61f5-41a5-83d3-f46ee60df78d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:58.654944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e46fb1de-61f5-41a5-83d3-f46ee60df78d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:58.654944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e46fb1de-61f5-41a5-83d3-f46ee60df78d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:58.654944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e46fb1de-61f5-41a5-83d3-f46ee60df78d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:58.658572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5f6f17d1-4c82-427c-a87c-f29e6a6625e8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Returning 404 to user: Instance 826b896f-e0e0-48e1-a520-b5fade2c374b could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:04:58.660470 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5f6f17d1-4c82-427c-a87c-f29e6a6625e8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b" status: 404 len: 111 microversion: 2.1 time: 0.076670 Aug 04 17:04:58.664380 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1336/2602] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:58 2022] GET /compute/v2.1/servers/826b896f-e0e0-48e1-a520-b5fade2c374b => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:04:58.676204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4e6dd051-0c25-461e-bf56-bf8d675492d8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:58.679093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4e6dd051-0c25-461e-bf56-bf8d675492d8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 14847930-27f6-4ea1-83f0-48a80608885e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:58.696761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e6dd051-0c25-461e-bf56-bf8d675492d8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:58.699029 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e6dd051-0c25-461e-bf56-bf8d675492d8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:58.700880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e6dd051-0c25-461e-bf56-bf8d675492d8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:58.703258 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e6dd051-0c25-461e-bf56-bf8d675492d8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:58.705184 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e6dd051-0c25-461e-bf56-bf8d675492d8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:58.705691 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e6dd051-0c25-461e-bf56-bf8d675492d8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:58.748706 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-4e6dd051-0c25-461e-bf56-bf8d675492d8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] HTTP exception thrown: Instance 14847930-27f6-4ea1-83f0-48a80608885e could not be found. Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4e6dd051-0c25-461e-bf56-bf8d675492d8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Request method failure captured: Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e HTTP/1.1 Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_r18zhXKrUNPkTcrqBpyOxEtqmRnN_52CLFZjb6_V1_cyggOBj-ig1uBg8_Jl5DEv1edGlVMK7wsNG9aSNASIbB3U35pyAy7fX4gAPexD_7GsQqaSV2-qce83lQvxIJx4U5ZPEYYCvd7_VfIsOpvvr8aQqah0W-5V3XON-ztAeWk4Y Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/92bb708c7ba24e4d828f19ecc60e1f91"}]}] Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 6d19d8e7953b4e479b4e2143a3c3546a Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 14847930-27f6-4ea1-83f0-48a80608885e could not be found. Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '14847930-27f6-4ea1-83f0-48a80608885e'} Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14847930-27f6-4ea1-83f0-48a80608885e could not be found. Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:04:58.752199 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:04:58.756439 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14847930-27f6-4ea1-83f0-48a80608885e could not be found. Aug 04 17:04:58.756439 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.756439 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:58.756439 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.756439 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.756439 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:58.756439 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:58.756439 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:04:58.756439 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:04:58.756439 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14847930-27f6-4ea1-83f0-48a80608885e could not be found. Aug 04 17:04:58.756439 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.756439 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4e6dd051-0c25-461e-bf56-bf8d675492d8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Returning 404 to user: Instance 14847930-27f6-4ea1-83f0-48a80608885e could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:04:58.756439 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4e6dd051-0c25-461e-bf56-bf8d675492d8 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "DELETE /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e" status: 404 len: 111 microversion: 2.1 time: 0.086229 Aug 04 17:04:58.756439 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1337/2603] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:04:58 2022] DELETE /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:04:58.765487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1aee9953-2f36-42ee-90a3-cf9860e62794 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:58.766584 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1aee9953-2f36-42ee-90a3-cf9860e62794 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 14847930-27f6-4ea1-83f0-48a80608885e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:58.774693 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1aee9953-2f36-42ee-90a3-cf9860e62794 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:58.775191 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1aee9953-2f36-42ee-90a3-cf9860e62794 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:58.775832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1aee9953-2f36-42ee-90a3-cf9860e62794 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:58.783659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1aee9953-2f36-42ee-90a3-cf9860e62794 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:58.784486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1aee9953-2f36-42ee-90a3-cf9860e62794 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:58.785260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1aee9953-2f36-42ee-90a3-cf9860e62794 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:58.814778 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-1aee9953-2f36-42ee-90a3-cf9860e62794 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] HTTP exception thrown: Instance 14847930-27f6-4ea1-83f0-48a80608885e could not be found. Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1aee9953-2f36-42ee-90a3-cf9860e62794 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Request method failure captured: Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e HTTP/1.1 Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_r18zhXKrUNPkTcrqBpyOxEtqmRnN_52CLFZjb6_V1_cyggOBj-ig1uBg8_Jl5DEv1edGlVMK7wsNG9aSNASIbB3U35pyAy7fX4gAPexD_7GsQqaSV2-qce83lQvxIJx4U5ZPEYYCvd7_VfIsOpvvr8aQqah0W-5V3XON-ztAeWk4Y Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/92bb708c7ba24e4d828f19ecc60e1f91"}]}] Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 6d19d8e7953b4e479b4e2143a3c3546a Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 14847930-27f6-4ea1-83f0-48a80608885e could not be found. Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '14847930-27f6-4ea1-83f0-48a80608885e'} Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14847930-27f6-4ea1-83f0-48a80608885e could not be found. Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14847930-27f6-4ea1-83f0-48a80608885e could not be found. Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:58.816577 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.820142 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.820142 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:58.820142 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:58.820142 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:04:58.820142 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:04:58.820142 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14847930-27f6-4ea1-83f0-48a80608885e could not be found. Aug 04 17:04:58.820142 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.820142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1aee9953-2f36-42ee-90a3-cf9860e62794 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Returning 404 to user: Instance 14847930-27f6-4ea1-83f0-48a80608885e could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:04:58.820142 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1aee9953-2f36-42ee-90a3-cf9860e62794 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e" status: 404 len: 111 microversion: 2.1 time: 0.058545 Aug 04 17:04:58.820142 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1338/2604] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:58 2022] GET /compute/v2.1/servers/14847930-27f6-4ea1-83f0-48a80608885e => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:04:58.829129 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2c991c6b-0b15-4d6e-ab35-c2f74243ff57 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:58.829672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2c991c6b-0b15-4d6e-ab35-c2f74243ff57 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 7d4a1cf5-d8a5-4638-a353-0878b8c40eab] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:58.846482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c991c6b-0b15-4d6e-ab35-c2f74243ff57 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:58.847138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c991c6b-0b15-4d6e-ab35-c2f74243ff57 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:58.847579 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c991c6b-0b15-4d6e-ab35-c2f74243ff57 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:58.848722 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c991c6b-0b15-4d6e-ab35-c2f74243ff57 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:58.849347 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c991c6b-0b15-4d6e-ab35-c2f74243ff57 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:58.849935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c991c6b-0b15-4d6e-ab35-c2f74243ff57 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:58.851085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e46fb1de-61f5-41a5-83d3-f46ee60df78d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:58.863882 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e46fb1de-61f5-41a5-83d3-f46ee60df78d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664" status: 200 len: 1286 microversion: 2.1 time: 0.227075 Aug 04 17:04:58.867473 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1267/2605] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:58 2022] GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664 => generated 1286 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:04:58.872376 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-2c991c6b-0b15-4d6e-ab35-c2f74243ff57 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] HTTP exception thrown: Instance 7d4a1cf5-d8a5-4638-a353-0878b8c40eab could not be found. Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2c991c6b-0b15-4d6e-ab35-c2f74243ff57 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Request method failure captured: Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/7d4a1cf5-d8a5-4638-a353-0878b8c40eab HTTP/1.1 Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_r18zhXKrUNPkTcrqBpyOxEtqmRnN_52CLFZjb6_V1_cyggOBj-ig1uBg8_Jl5DEv1edGlVMK7wsNG9aSNASIbB3U35pyAy7fX4gAPexD_7GsQqaSV2-qce83lQvxIJx4U5ZPEYYCvd7_VfIsOpvvr8aQqah0W-5V3XON-ztAeWk4Y Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/92bb708c7ba24e4d828f19ecc60e1f91"}]}] Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 6d19d8e7953b4e479b4e2143a3c3546a Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 7d4a1cf5-d8a5-4638-a353-0878b8c40eab could not be found. Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '7d4a1cf5-d8a5-4638-a353-0878b8c40eab'} Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d4a1cf5-d8a5-4638-a353-0878b8c40eab could not be found. Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:04:58.879058 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:04:58.882484 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d4a1cf5-d8a5-4638-a353-0878b8c40eab could not be found. Aug 04 17:04:58.882484 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.882484 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:58.882484 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.882484 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.882484 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:58.882484 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:58.882484 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:04:58.882484 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:04:58.882484 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d4a1cf5-d8a5-4638-a353-0878b8c40eab could not be found. Aug 04 17:04:58.882484 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.883984 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2c991c6b-0b15-4d6e-ab35-c2f74243ff57 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Returning 404 to user: Instance 7d4a1cf5-d8a5-4638-a353-0878b8c40eab could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:04:58.885026 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2c991c6b-0b15-4d6e-ab35-c2f74243ff57 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "DELETE /compute/v2.1/servers/7d4a1cf5-d8a5-4638-a353-0878b8c40eab" status: 404 len: 111 microversion: 2.1 time: 0.061954 Aug 04 17:04:58.894527 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-20c50568-a726-479b-96ad-964fbbfbe79f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:58.895275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-20c50568-a726-479b-96ad-964fbbfbe79f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 7d4a1cf5-d8a5-4638-a353-0878b8c40eab] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:58.895971 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1339/2606] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:04:58 2022] DELETE /compute/v2.1/servers/7d4a1cf5-d8a5-4638-a353-0878b8c40eab => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:04:58.904333 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20c50568-a726-479b-96ad-964fbbfbe79f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:58.904840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20c50568-a726-479b-96ad-964fbbfbe79f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:58.905341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20c50568-a726-479b-96ad-964fbbfbe79f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:58.906794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20c50568-a726-479b-96ad-964fbbfbe79f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:58.907270 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20c50568-a726-479b-96ad-964fbbfbe79f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:58.907708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20c50568-a726-479b-96ad-964fbbfbe79f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:58.925062 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-20c50568-a726-479b-96ad-964fbbfbe79f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] HTTP exception thrown: Instance 7d4a1cf5-d8a5-4638-a353-0878b8c40eab could not be found. Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-20c50568-a726-479b-96ad-964fbbfbe79f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Request method failure captured: Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/7d4a1cf5-d8a5-4638-a353-0878b8c40eab HTTP/1.1 Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_r18zhXKrUNPkTcrqBpyOxEtqmRnN_52CLFZjb6_V1_cyggOBj-ig1uBg8_Jl5DEv1edGlVMK7wsNG9aSNASIbB3U35pyAy7fX4gAPexD_7GsQqaSV2-qce83lQvxIJx4U5ZPEYYCvd7_VfIsOpvvr8aQqah0W-5V3XON-ztAeWk4Y Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/92bb708c7ba24e4d828f19ecc60e1f91"}]}] Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 6d19d8e7953b4e479b4e2143a3c3546a Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 7d4a1cf5-d8a5-4638-a353-0878b8c40eab could not be found. Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '7d4a1cf5-d8a5-4638-a353-0878b8c40eab'} Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d4a1cf5-d8a5-4638-a353-0878b8c40eab could not be found. Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d4a1cf5-d8a5-4638-a353-0878b8c40eab could not be found. Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:04:58.926686 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.931236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:04:58.931236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:04:58.931236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:04:58.931236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:04:58.931236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:04:58.931236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d4a1cf5-d8a5-4638-a353-0878b8c40eab could not be found. Aug 04 17:04:58.931236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:04:58.931236 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-20c50568-a726-479b-96ad-964fbbfbe79f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Returning 404 to user: Instance 7d4a1cf5-d8a5-4638-a353-0878b8c40eab could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:04:58.931236 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-20c50568-a726-479b-96ad-964fbbfbe79f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/7d4a1cf5-d8a5-4638-a353-0878b8c40eab" status: 404 len: 111 microversion: 2.1 time: 0.037899 Aug 04 17:04:58.932097 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1268/2607] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:58 2022] GET /compute/v2.1/servers/7d4a1cf5-d8a5-4638-a353-0878b8c40eab => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:04:59.354688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b70696b5-d27a-4429-891e-6e162a2d4c64 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:59.357554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b70696b5-d27a-4429-891e-6e162a2d4c64 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: baaeefae-c19a-4102-9fc8-245f638aaf45] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:59.372994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b70696b5-d27a-4429-891e-6e162a2d4c64 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:59.373507 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b70696b5-d27a-4429-891e-6e162a2d4c64 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:59.373957 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b70696b5-d27a-4429-891e-6e162a2d4c64 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:59.374718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b70696b5-d27a-4429-891e-6e162a2d4c64 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:59.375717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b70696b5-d27a-4429-891e-6e162a2d4c64 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:59.376157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b70696b5-d27a-4429-891e-6e162a2d4c64 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:59.495585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-ca58315c-f905-4ec1-9f29-fca2cc4ffe9e req-b3870dbc-dc1f-4ca7-8e0f-9cf636430f23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30e66be0-1c2b-401d-8e17-1271b1910f4a", "name": "network-vif-deleted", "tag": "93b8fa03-1f37-431c-b87c-431cafd2680c"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:04:59.526282 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ca58315c-f905-4ec1-9f29-fca2cc4ffe9e req-b3870dbc-dc1f-4ca7-8e0f-9cf636430f23 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:59.527800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ca58315c-f905-4ec1-9f29-fca2cc4ffe9e req-b3870dbc-dc1f-4ca7-8e0f-9cf636430f23 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:59.530439 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ca58315c-f905-4ec1-9f29-fca2cc4ffe9e req-b3870dbc-dc1f-4ca7-8e0f-9cf636430f23 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:59.583732 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-ca58315c-f905-4ec1-9f29-fca2cc4ffe9e req-b3870dbc-dc1f-4ca7-8e0f-9cf636430f23 service nova] Creating event network-vif-deleted:93b8fa03-1f37-431c-b87c-431cafd2680c for instance 30e66be0-1c2b-401d-8e17-1271b1910f4a on n-h2-851359-3 Aug 04 17:04:59.598874 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-ca58315c-f905-4ec1-9f29-fca2cc4ffe9e req-b3870dbc-dc1f-4ca7-8e0f-9cf636430f23 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109140 Aug 04 17:04:59.602222 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1269/2608] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:04:59.611121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ba8303cd-1e10-4283-ad51-ebff62f935b5 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:59.613818 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ba8303cd-1e10-4283-ad51-ebff62f935b5 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: b2078942-c5e1-4e12-ac29-43ac324a16cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:59.626048 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba8303cd-1e10-4283-ad51-ebff62f935b5 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:59.626646 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba8303cd-1e10-4283-ad51-ebff62f935b5 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:59.626974 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba8303cd-1e10-4283-ad51-ebff62f935b5 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:59.627678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba8303cd-1e10-4283-ad51-ebff62f935b5 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:59.628136 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba8303cd-1e10-4283-ad51-ebff62f935b5 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:59.628565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba8303cd-1e10-4283-ad51-ebff62f935b5 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:59.637108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b70696b5-d27a-4429-891e-6e162a2d4c64 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:59.649071 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b70696b5-d27a-4429-891e-6e162a2d4c64 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45" status: 200 len: 1806 microversion: 2.1 time: 0.294265 Aug 04 17:04:59.649726 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1340/2609] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:59 2022] GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45 => generated 1806 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:59.672871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a9466f60-e3dd-4f44-95fd-6ca2c3c38074 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:59.673594 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a9466f60-e3dd-4f44-95fd-6ca2c3c38074 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: baaeefae-c19a-4102-9fc8-245f638aaf45] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:59.689633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a9466f60-e3dd-4f44-95fd-6ca2c3c38074 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:59.698981 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a9466f60-e3dd-4f44-95fd-6ca2c3c38074 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:59.699759 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a9466f60-e3dd-4f44-95fd-6ca2c3c38074 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:59.700687 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a9466f60-e3dd-4f44-95fd-6ca2c3c38074 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:59.701325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a9466f60-e3dd-4f44-95fd-6ca2c3c38074 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:59.701923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a9466f60-e3dd-4f44-95fd-6ca2c3c38074 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:59.756524 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a9466f60-e3dd-4f44-95fd-6ca2c3c38074 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45/ips" status: 200 len: 219 microversion: 2.1 time: 0.087468 Aug 04 17:04:59.757118 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1341/2610] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Aug 4 17:04:59 2022] GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45/ips => generated 219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:04:59.769094 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-daeac8ca-99b2-434c-b74b-2c8108b31704 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:59.769597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-daeac8ca-99b2-434c-b74b-2c8108b31704 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: baaeefae-c19a-4102-9fc8-245f638aaf45] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:59.783508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-daeac8ca-99b2-434c-b74b-2c8108b31704 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:59.784267 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-daeac8ca-99b2-434c-b74b-2c8108b31704 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:59.785180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-daeac8ca-99b2-434c-b74b-2c8108b31704 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:59.786085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-daeac8ca-99b2-434c-b74b-2c8108b31704 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:59.788301 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-daeac8ca-99b2-434c-b74b-2c8108b31704 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:59.788946 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-daeac8ca-99b2-434c-b74b-2c8108b31704 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:04:59.840846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-daeac8ca-99b2-434c-b74b-2c8108b31704 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: baaeefae-c19a-4102-9fc8-245f638aaf45] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:04:59.908949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ba8303cd-1e10-4283-ad51-ebff62f935b5 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:04:59.922801 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ba8303cd-1e10-4283-ad51-ebff62f935b5 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb" status: 200 len: 1308 microversion: 2.1 time: 0.318250 Aug 04 17:04:59.926583 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1270/2611] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:59 2022] GET /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb => generated 1308 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:04:59.941620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-572ac02f-92fd-44c1-8bee-195d00a048f0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:59.950414 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-572ac02f-92fd-44c1-8bee-195d00a048f0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 42dff36d-2301-4c8c-b3a5-1dd535cf9664] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:59.976869 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-daeac8ca-99b2-434c-b74b-2c8108b31704 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "DELETE /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45" status: 204 len: 0 microversion: 2.1 time: 0.209622 Aug 04 17:04:59.978204 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1342/2612] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:04:59 2022] DELETE /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 17:04:59.991771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-572ac02f-92fd-44c1-8bee-195d00a048f0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:04:59.995712 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-572ac02f-92fd-44c1-8bee-195d00a048f0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:04:59.995931 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b9d03a78-625c-47b4-8416-81b8afecf39b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:04:59.997294 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b9d03a78-625c-47b4-8416-81b8afecf39b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: baaeefae-c19a-4102-9fc8-245f638aaf45] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:04:59.998600 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-572ac02f-92fd-44c1-8bee-195d00a048f0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:00.000931 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-572ac02f-92fd-44c1-8bee-195d00a048f0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:00.002157 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-572ac02f-92fd-44c1-8bee-195d00a048f0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:00.004255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-572ac02f-92fd-44c1-8bee-195d00a048f0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:00.012782 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9d03a78-625c-47b4-8416-81b8afecf39b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:00.014443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9d03a78-625c-47b4-8416-81b8afecf39b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:00.015193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9d03a78-625c-47b4-8416-81b8afecf39b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:00.016961 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9d03a78-625c-47b4-8416-81b8afecf39b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:00.017641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9d03a78-625c-47b4-8416-81b8afecf39b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:00.018335 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9d03a78-625c-47b4-8416-81b8afecf39b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:00.181911 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-572ac02f-92fd-44c1-8bee-195d00a048f0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:00.194710 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-572ac02f-92fd-44c1-8bee-195d00a048f0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664" status: 200 len: 1274 microversion: 2.1 time: 0.266791 Aug 04 17:05:00.195306 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1271/2613] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:59 2022] GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664 => generated 1274 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:00.306933 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b9d03a78-625c-47b4-8416-81b8afecf39b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:00.317434 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b9d03a78-625c-47b4-8416-81b8afecf39b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45" status: 200 len: 1812 microversion: 2.1 time: 0.334961 Aug 04 17:05:00.318645 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1343/2614] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:04:59 2022] GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45 => generated 1812 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:00.947750 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f2a05301-9afd-4b25-abcc-9d8370fed88d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:00.948903 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f2a05301-9afd-4b25-abcc-9d8370fed88d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: b2078942-c5e1-4e12-ac29-43ac324a16cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:00.957258 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2a05301-9afd-4b25-abcc-9d8370fed88d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:00.958057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2a05301-9afd-4b25-abcc-9d8370fed88d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:00.958698 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2a05301-9afd-4b25-abcc-9d8370fed88d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:00.959722 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2a05301-9afd-4b25-abcc-9d8370fed88d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:00.960334 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2a05301-9afd-4b25-abcc-9d8370fed88d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:00.961089 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2a05301-9afd-4b25-abcc-9d8370fed88d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:01.218374 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-410f6cd6-926c-450c-bd11-09773e5a42e8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:01.219845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-410f6cd6-926c-450c-bd11-09773e5a42e8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 42dff36d-2301-4c8c-b3a5-1dd535cf9664] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:01.233213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-410f6cd6-926c-450c-bd11-09773e5a42e8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:01.235497 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-410f6cd6-926c-450c-bd11-09773e5a42e8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:01.237163 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-410f6cd6-926c-450c-bd11-09773e5a42e8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:01.242124 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f2a05301-9afd-4b25-abcc-9d8370fed88d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:01.250831 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-410f6cd6-926c-450c-bd11-09773e5a42e8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:01.252215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-410f6cd6-926c-450c-bd11-09773e5a42e8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:01.253341 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f2a05301-9afd-4b25-abcc-9d8370fed88d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb" status: 200 len: 1308 microversion: 2.1 time: 0.310205 Aug 04 17:05:01.255884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-410f6cd6-926c-450c-bd11-09773e5a42e8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:01.257034 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1272/2615] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:00 2022] GET /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb => generated 1308 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:05:01.342279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f79ac386-139a-4c63-961d-5bb5e9f081f3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:01.343145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f79ac386-139a-4c63-961d-5bb5e9f081f3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: baaeefae-c19a-4102-9fc8-245f638aaf45] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:01.362328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f79ac386-139a-4c63-961d-5bb5e9f081f3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:01.362328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f79ac386-139a-4c63-961d-5bb5e9f081f3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:01.362328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f79ac386-139a-4c63-961d-5bb5e9f081f3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:01.362328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f79ac386-139a-4c63-961d-5bb5e9f081f3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:01.362328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f79ac386-139a-4c63-961d-5bb5e9f081f3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:01.362328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f79ac386-139a-4c63-961d-5bb5e9f081f3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:01.462975 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-410f6cd6-926c-450c-bd11-09773e5a42e8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:01.488933 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-410f6cd6-926c-450c-bd11-09773e5a42e8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664" status: 200 len: 1274 microversion: 2.1 time: 0.275015 Aug 04 17:05:01.489840 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1344/2616] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:01 2022] GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664 => generated 1274 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:05:01.741291 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f79ac386-139a-4c63-961d-5bb5e9f081f3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:01.756580 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f79ac386-139a-4c63-961d-5bb5e9f081f3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45" status: 200 len: 1812 microversion: 2.1 time: 0.418353 Aug 04 17:05:01.759283 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1273/2617] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:01 2022] GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45 => generated 1812 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:02.179099 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-a112b6e3-0843-4f71-8917-c45450055cac req-ee36dbef-720c-4bc9-b76d-6e6fb71c3666 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2078942-c5e1-4e12-ac29-43ac324a16cb", "tag": "7facb23f-c28c-4ba5-9f3c-7cd9052ba92a"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:02.199883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a112b6e3-0843-4f71-8917-c45450055cac req-ee36dbef-720c-4bc9-b76d-6e6fb71c3666 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:02.202239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a112b6e3-0843-4f71-8917-c45450055cac req-ee36dbef-720c-4bc9-b76d-6e6fb71c3666 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:02.204368 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a112b6e3-0843-4f71-8917-c45450055cac req-ee36dbef-720c-4bc9-b76d-6e6fb71c3666 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:02.236916 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-a112b6e3-0843-4f71-8917-c45450055cac req-ee36dbef-720c-4bc9-b76d-6e6fb71c3666 service nova] Creating event network-changed:7facb23f-c28c-4ba5-9f3c-7cd9052ba92a for instance b2078942-c5e1-4e12-ac29-43ac324a16cb on n-h1-851359-3 Aug 04 17:05:02.249109 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-a112b6e3-0843-4f71-8917-c45450055cac req-ee36dbef-720c-4bc9-b76d-6e6fb71c3666 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074432 Aug 04 17:05:02.251491 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1345/2618] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:02.279639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9b610d72-ca53-4b96-9107-466cefac2175 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:02.280386 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9b610d72-ca53-4b96-9107-466cefac2175 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: b2078942-c5e1-4e12-ac29-43ac324a16cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:02.302291 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b610d72-ca53-4b96-9107-466cefac2175 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:02.303705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b610d72-ca53-4b96-9107-466cefac2175 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:02.304190 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b610d72-ca53-4b96-9107-466cefac2175 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:02.307452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b610d72-ca53-4b96-9107-466cefac2175 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:02.309096 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b610d72-ca53-4b96-9107-466cefac2175 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:02.309588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b610d72-ca53-4b96-9107-466cefac2175 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:02.516793 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-956e0d8c-cb71-44d9-845e-816f172b3744 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:02.517618 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-956e0d8c-cb71-44d9-845e-816f172b3744 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 42dff36d-2301-4c8c-b3a5-1dd535cf9664] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:02.528588 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-956e0d8c-cb71-44d9-845e-816f172b3744 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:02.530738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-956e0d8c-cb71-44d9-845e-816f172b3744 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:02.532897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-956e0d8c-cb71-44d9-845e-816f172b3744 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:02.537741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-956e0d8c-cb71-44d9-845e-816f172b3744 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:02.538363 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-956e0d8c-cb71-44d9-845e-816f172b3744 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:02.538840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-956e0d8c-cb71-44d9-845e-816f172b3744 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:03.495854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9b610d72-ca53-4b96-9107-466cefac2175 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:03.523695 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9b610d72-ca53-4b96-9107-466cefac2175 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb" status: 200 len: 1308 microversion: 2.1 time: 1.249997 Aug 04 17:05:03.526854 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1274/2619] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:02 2022] GET /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb => generated 1308 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:03.527638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-956e0d8c-cb71-44d9-845e-816f172b3744 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:03.536704 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2520a3a4-e363-40af-a104-ed4acbc5ec8d tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:03.540027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2520a3a4-e363-40af-a104-ed4acbc5ec8d tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: baaeefae-c19a-4102-9fc8-245f638aaf45] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:03.551417 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-956e0d8c-cb71-44d9-845e-816f172b3744 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664" status: 200 len: 1316 microversion: 2.1 time: 1.039532 Aug 04 17:05:03.576388 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1346/2620] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:02 2022] GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664 => generated 1316 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:05:03.576545 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2520a3a4-e363-40af-a104-ed4acbc5ec8d tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:03.576647 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2520a3a4-e363-40af-a104-ed4acbc5ec8d tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:03.577152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2520a3a4-e363-40af-a104-ed4acbc5ec8d tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:03.577850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2520a3a4-e363-40af-a104-ed4acbc5ec8d tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:03.578386 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2520a3a4-e363-40af-a104-ed4acbc5ec8d tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:03.578829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2520a3a4-e363-40af-a104-ed4acbc5ec8d tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:03.653203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fc3028e0-3637-445b-b8e4-fb8197eec1d9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:03.667997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fc3028e0-3637-445b-b8e4-fb8197eec1d9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: b4f45353-5340-4cfe-a8c3-0aeeef958607] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:03.680242 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc3028e0-3637-445b-b8e4-fb8197eec1d9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:03.681963 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc3028e0-3637-445b-b8e4-fb8197eec1d9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:03.684049 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc3028e0-3637-445b-b8e4-fb8197eec1d9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:03.686390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc3028e0-3637-445b-b8e4-fb8197eec1d9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:03.688583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc3028e0-3637-445b-b8e4-fb8197eec1d9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:03.689272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc3028e0-3637-445b-b8e4-fb8197eec1d9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:03.743696 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-fc3028e0-3637-445b-b8e4-fb8197eec1d9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] HTTP exception thrown: Instance b4f45353-5340-4cfe-a8c3-0aeeef958607 could not be found. Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fc3028e0-3637-445b-b8e4-fb8197eec1d9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Request method failure captured: Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607 HTTP/1.1 Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_r18zhXKrUNPkTcrqBpyOxEtqmRnN_52CLFZjb6_V1_cyggOBj-ig1uBg8_Jl5DEv1edGlVMK7wsNG9aSNASIbB3U35pyAy7fX4gAPexD_7GsQqaSV2-qce83lQvxIJx4U5ZPEYYCvd7_VfIsOpvvr8aQqah0W-5V3XON-ztAeWk4Y Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/92bb708c7ba24e4d828f19ecc60e1f91"}]}] Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 6d19d8e7953b4e479b4e2143a3c3546a Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance b4f45353-5340-4cfe-a8c3-0aeeef958607 could not be found. Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'b4f45353-5340-4cfe-a8c3-0aeeef958607'} Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4f45353-5340-4cfe-a8c3-0aeeef958607 could not be found. Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:05:03.745425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:05:03.749021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4f45353-5340-4cfe-a8c3-0aeeef958607 could not be found. Aug 04 17:05:03.749021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:03.749021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:03.749021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:03.749021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:03.749021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:03.749021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:03.749021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:05:03.749021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:05:03.749021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4f45353-5340-4cfe-a8c3-0aeeef958607 could not be found. Aug 04 17:05:03.749021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:03.767567 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fc3028e0-3637-445b-b8e4-fb8197eec1d9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Returning 404 to user: Instance b4f45353-5340-4cfe-a8c3-0aeeef958607 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:05:03.771867 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fc3028e0-3637-445b-b8e4-fb8197eec1d9 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607" status: 404 len: 111 microversion: 2.1 time: 0.151816 Aug 04 17:05:03.782426 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1347/2621] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:05:03 2022] DELETE /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:05:03.790751 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-b5a6590e-4a6c-4e8b-8b4b-e17189b4e8ec req-d9e29d85-2895-4991-8f39-26bfb41a0315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baaeefae-c19a-4102-9fc8-245f638aaf45", "name": "network-vif-deleted", "tag": "72399a46-54e5-495a-ae71-1fa3ca0abe4a"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:03.811189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b5a6590e-4a6c-4e8b-8b4b-e17189b4e8ec req-d9e29d85-2895-4991-8f39-26bfb41a0315 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:03.811893 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b5a6590e-4a6c-4e8b-8b4b-e17189b4e8ec req-d9e29d85-2895-4991-8f39-26bfb41a0315 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:03.812745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b5a6590e-4a6c-4e8b-8b4b-e17189b4e8ec req-d9e29d85-2895-4991-8f39-26bfb41a0315 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:03.847437 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-b5a6590e-4a6c-4e8b-8b4b-e17189b4e8ec req-d9e29d85-2895-4991-8f39-26bfb41a0315 service nova] Creating event network-vif-deleted:72399a46-54e5-495a-ae71-1fa3ca0abe4a for instance baaeefae-c19a-4102-9fc8-245f638aaf45 on n-h1-851359-3 Aug 04 17:05:03.862173 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-b5a6590e-4a6c-4e8b-8b4b-e17189b4e8ec req-d9e29d85-2895-4991-8f39-26bfb41a0315 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076616 Aug 04 17:05:03.865251 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1348/2622] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:03.879605 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3281f8ba-0d20-4644-9980-210e2ffdff1f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:03.885729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3281f8ba-0d20-4644-9980-210e2ffdff1f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: b4f45353-5340-4cfe-a8c3-0aeeef958607] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:03.891816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:03.905817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3281f8ba-0d20-4644-9980-210e2ffdff1f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:03.910190 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3281f8ba-0d20-4644-9980-210e2ffdff1f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:03.910937 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3281f8ba-0d20-4644-9980-210e2ffdff1f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:03.911936 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3281f8ba-0d20-4644-9980-210e2ffdff1f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:03.915411 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3281f8ba-0d20-4644-9980-210e2ffdff1f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:03.916180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3281f8ba-0d20-4644-9980-210e2ffdff1f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:03.953462 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-3281f8ba-0d20-4644-9980-210e2ffdff1f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] HTTP exception thrown: Instance b4f45353-5340-4cfe-a8c3-0aeeef958607 could not be found. Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3281f8ba-0d20-4644-9980-210e2ffdff1f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Request method failure captured: Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607 HTTP/1.1 Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_r18zhXKrUNPkTcrqBpyOxEtqmRnN_52CLFZjb6_V1_cyggOBj-ig1uBg8_Jl5DEv1edGlVMK7wsNG9aSNASIbB3U35pyAy7fX4gAPexD_7GsQqaSV2-qce83lQvxIJx4U5ZPEYYCvd7_VfIsOpvvr8aQqah0W-5V3XON-ztAeWk4Y Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/92bb708c7ba24e4d828f19ecc60e1f91"}]}] Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 6d19d8e7953b4e479b4e2143a3c3546a Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance b4f45353-5340-4cfe-a8c3-0aeeef958607 could not be found. Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'b4f45353-5340-4cfe-a8c3-0aeeef958607'} Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4f45353-5340-4cfe-a8c3-0aeeef958607 could not be found. Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4f45353-5340-4cfe-a8c3-0aeeef958607 could not be found. Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:03.960458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:03.963963 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:03.963963 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:03.963963 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:03.963963 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:05:03.963963 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:05:03.963963 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4f45353-5340-4cfe-a8c3-0aeeef958607 could not be found. Aug 04 17:05:03.963963 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:03.967257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3281f8ba-0d20-4644-9980-210e2ffdff1f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Returning 404 to user: Instance b4f45353-5340-4cfe-a8c3-0aeeef958607 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:05:03.968397 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3281f8ba-0d20-4644-9980-210e2ffdff1f tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607" status: 404 len: 111 microversion: 2.1 time: 0.101548 Aug 04 17:05:03.974055 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1349/2623] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:03 2022] GET /compute/v2.1/servers/b4f45353-5340-4cfe-a8c3-0aeeef958607 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:05:03.980690 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-384e688f-e9c9-4f88-8e18-1d67028911ba tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:03.989111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-384e688f-e9c9-4f88-8e18-1d67028911ba tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b04e7f9-a53f-48ee-9389-366bd96d2bfd] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:04.008621 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-384e688f-e9c9-4f88-8e18-1d67028911ba tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:04.011318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-384e688f-e9c9-4f88-8e18-1d67028911ba tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:04.015618 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-384e688f-e9c9-4f88-8e18-1d67028911ba tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:04.016380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-384e688f-e9c9-4f88-8e18-1d67028911ba tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:04.019357 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-384e688f-e9c9-4f88-8e18-1d67028911ba tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:04.019846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-384e688f-e9c9-4f88-8e18-1d67028911ba tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:04.068604 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-384e688f-e9c9-4f88-8e18-1d67028911ba tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] HTTP exception thrown: Instance 1b04e7f9-a53f-48ee-9389-366bd96d2bfd could not be found. Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-384e688f-e9c9-4f88-8e18-1d67028911ba tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Request method failure captured: Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd HTTP/1.1 Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_r18zhXKrUNPkTcrqBpyOxEtqmRnN_52CLFZjb6_V1_cyggOBj-ig1uBg8_Jl5DEv1edGlVMK7wsNG9aSNASIbB3U35pyAy7fX4gAPexD_7GsQqaSV2-qce83lQvxIJx4U5ZPEYYCvd7_VfIsOpvvr8aQqah0W-5V3XON-ztAeWk4Y Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/92bb708c7ba24e4d828f19ecc60e1f91"}]}] Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 6d19d8e7953b4e479b4e2143a3c3546a Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 1b04e7f9-a53f-48ee-9389-366bd96d2bfd could not be found. Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '1b04e7f9-a53f-48ee-9389-366bd96d2bfd'} Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b04e7f9-a53f-48ee-9389-366bd96d2bfd could not be found. Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:05:04.070352 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:05:04.074398 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b04e7f9-a53f-48ee-9389-366bd96d2bfd could not be found. Aug 04 17:05:04.074398 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:04.074398 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:04.074398 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:04.074398 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:04.074398 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:04.074398 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:04.074398 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:05:04.074398 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:05:04.074398 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b04e7f9-a53f-48ee-9389-366bd96d2bfd could not be found. Aug 04 17:05:04.074398 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:04.074398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-384e688f-e9c9-4f88-8e18-1d67028911ba tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Returning 404 to user: Instance 1b04e7f9-a53f-48ee-9389-366bd96d2bfd could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:05:04.074398 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-384e688f-e9c9-4f88-8e18-1d67028911ba tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "DELETE /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd" status: 404 len: 111 microversion: 2.1 time: 0.096189 Aug 04 17:05:04.074398 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1350/2624] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:05:03 2022] DELETE /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:05:04.098454 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c4f2c54d-be6e-468e-9228-686e5c63b099 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:04.099855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c4f2c54d-be6e-468e-9228-686e5c63b099 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] [instance: 1b04e7f9-a53f-48ee-9389-366bd96d2bfd] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:04.120562 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4f2c54d-be6e-468e-9228-686e5c63b099 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:04.123228 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4f2c54d-be6e-468e-9228-686e5c63b099 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:04.134434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4f2c54d-be6e-468e-9228-686e5c63b099 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:04.135621 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4f2c54d-be6e-468e-9228-686e5c63b099 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:04.136245 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4f2c54d-be6e-468e-9228-686e5c63b099 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:04.137655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4f2c54d-be6e-468e-9228-686e5c63b099 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:04.209378 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-c4f2c54d-be6e-468e-9228-686e5c63b099 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] HTTP exception thrown: Instance 1b04e7f9-a53f-48ee-9389-366bd96d2bfd could not be found. Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c4f2c54d-be6e-468e-9228-686e5c63b099 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Request method failure captured: Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd HTTP/1.1 Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_r18zhXKrUNPkTcrqBpyOxEtqmRnN_52CLFZjb6_V1_cyggOBj-ig1uBg8_Jl5DEv1edGlVMK7wsNG9aSNASIbB3U35pyAy7fX4gAPexD_7GsQqaSV2-qce83lQvxIJx4U5ZPEYYCvd7_VfIsOpvvr8aQqah0W-5V3XON-ztAeWk4Y Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_92bb708c7ba24e4d828f19ecc60e1f91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/92bb708c7ba24e4d828f19ecc60e1f91"}]}] Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 92bb708c7ba24e4d828f19ecc60e1f91 Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-DeleteServersTestJSON-1932288585 Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 6d19d8e7953b4e479b4e2143a3c3546a Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-DeleteServersTestJSON-1932288585-project Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 1b04e7f9-a53f-48ee-9389-366bd96d2bfd could not be found. Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '1b04e7f9-a53f-48ee-9389-366bd96d2bfd'} Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b04e7f9-a53f-48ee-9389-366bd96d2bfd could not be found. Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b04e7f9-a53f-48ee-9389-366bd96d2bfd could not be found. Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:04.212583 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:04.216148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:04.216148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:04.216148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:04.216148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:05:04.216148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:05:04.216148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b04e7f9-a53f-48ee-9389-366bd96d2bfd could not be found. Aug 04 17:05:04.216148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:04.222693 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c4f2c54d-be6e-468e-9228-686e5c63b099 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] Returning 404 to user: Instance 1b04e7f9-a53f-48ee-9389-366bd96d2bfd could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:05:04.224328 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c4f2c54d-be6e-468e-9228-686e5c63b099 tempest-DeleteServersTestJSON-1932288585 tempest-DeleteServersTestJSON-1932288585-project] 10.222.0.93 "GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd" status: 404 len: 111 microversion: 2.1 time: 0.142538 Aug 04 17:05:04.228588 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1351/2625] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:04 2022] GET /compute/v2.1/servers/1b04e7f9-a53f-48ee-9389-366bd96d2bfd => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:05:04.549892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3ec50acd-b337-48ab-b628-62a2be225159 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:04.553151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3ec50acd-b337-48ab-b628-62a2be225159 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: b2078942-c5e1-4e12-ac29-43ac324a16cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:04.579374 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ec50acd-b337-48ab-b628-62a2be225159 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:04.581601 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ec50acd-b337-48ab-b628-62a2be225159 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:04.582379 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ec50acd-b337-48ab-b628-62a2be225159 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:04.585669 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ec50acd-b337-48ab-b628-62a2be225159 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:04.586782 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ec50acd-b337-48ab-b628-62a2be225159 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:04.601854 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ec50acd-b337-48ab-b628-62a2be225159 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:04.655909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2520a3a4-e363-40af-a104-ed4acbc5ec8d tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:04.665458 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2520a3a4-e363-40af-a104-ed4acbc5ec8d tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45" status: 200 len: 1791 microversion: 2.1 time: 1.137331 Aug 04 17:05:04.670302 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1275/2626] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:03 2022] GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45 => generated 1791 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:04.676215 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6b4f703b-7925-411b-a9ae-733128fa413a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:04.681479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6b4f703b-7925-411b-a9ae-733128fa413a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 42dff36d-2301-4c8c-b3a5-1dd535cf9664] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:04.696506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b4f703b-7925-411b-a9ae-733128fa413a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:04.699747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b4f703b-7925-411b-a9ae-733128fa413a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:04.700375 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b4f703b-7925-411b-a9ae-733128fa413a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:04.701558 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b4f703b-7925-411b-a9ae-733128fa413a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:04.702233 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b4f703b-7925-411b-a9ae-733128fa413a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:04.703669 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b4f703b-7925-411b-a9ae-733128fa413a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:05.015165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:05.351709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3ec50acd-b337-48ab-b628-62a2be225159 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:05.359517 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3ec50acd-b337-48ab-b628-62a2be225159 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb" status: 200 len: 1308 microversion: 2.1 time: 0.818979 Aug 04 17:05:05.364922 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1352/2627] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:04 2022] GET /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb => generated 1308 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:05:05.373183 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-1f977439-4e9d-44a9-9b6d-40c2a2d3ccbe req-708b4ceb-e837-4f11-a7fe-d97a6128670b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42dff36d-2301-4c8c-b3a5-1dd535cf9664", "tag": "9285b000-3237-417d-acef-9b19e86db779"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:05.396340 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6b4f703b-7925-411b-a9ae-733128fa413a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:05.396507 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1f977439-4e9d-44a9-9b6d-40c2a2d3ccbe req-708b4ceb-e837-4f11-a7fe-d97a6128670b service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:05.397369 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1f977439-4e9d-44a9-9b6d-40c2a2d3ccbe req-708b4ceb-e837-4f11-a7fe-d97a6128670b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:05.397822 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1f977439-4e9d-44a9-9b6d-40c2a2d3ccbe req-708b4ceb-e837-4f11-a7fe-d97a6128670b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:05.415145 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6b4f703b-7925-411b-a9ae-733128fa413a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664" status: 200 len: 1316 microversion: 2.1 time: 0.743282 Aug 04 17:05:05.421561 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1276/2628] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:04 2022] GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664 => generated 1316 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:05.436003 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-1f977439-4e9d-44a9-9b6d-40c2a2d3ccbe req-708b4ceb-e837-4f11-a7fe-d97a6128670b service nova] Creating event network-changed:9285b000-3237-417d-acef-9b19e86db779 for instance 42dff36d-2301-4c8c-b3a5-1dd535cf9664 on n-h1-851359-3 Aug 04 17:05:05.441616 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-1f977439-4e9d-44a9-9b6d-40c2a2d3ccbe req-708b4ceb-e837-4f11-a7fe-d97a6128670b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075132 Aug 04 17:05:05.442510 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1353/2629] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:05.696953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-01277126-4970-4663-8183-f840ced2a05b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:05.698163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-01277126-4970-4663-8183-f840ced2a05b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: baaeefae-c19a-4102-9fc8-245f638aaf45] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:05.702371 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:05.703138 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=5 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:05.715268 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01277126-4970-4663-8183-f840ced2a05b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:05.715704 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01277126-4970-4663-8183-f840ced2a05b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:05.716149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01277126-4970-4663-8183-f840ced2a05b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:05.717059 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01277126-4970-4663-8183-f840ced2a05b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:05.719081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01277126-4970-4663-8183-f840ced2a05b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:05.719796 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01277126-4970-4663-8183-f840ced2a05b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:05.742881 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:06.112143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-05d9f959-8c81-40fa-9e5c-4296ff99a74d req-7f238d07-cbfa-4d4e-a0db-63f08b063230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baaeefae-c19a-4102-9fc8-245f638aaf45", "name": "network-vif-deleted", "tag": "49f5666d-c14e-48ba-a220-99abd6a77877"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:06.136559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-05d9f959-8c81-40fa-9e5c-4296ff99a74d req-7f238d07-cbfa-4d4e-a0db-63f08b063230 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:06.137355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-05d9f959-8c81-40fa-9e5c-4296ff99a74d req-7f238d07-cbfa-4d4e-a0db-63f08b063230 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:06.138044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-05d9f959-8c81-40fa-9e5c-4296ff99a74d req-7f238d07-cbfa-4d4e-a0db-63f08b063230 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:06.165468 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-05d9f959-8c81-40fa-9e5c-4296ff99a74d req-7f238d07-cbfa-4d4e-a0db-63f08b063230 service nova] Creating event network-vif-deleted:49f5666d-c14e-48ba-a220-99abd6a77877 for instance baaeefae-c19a-4102-9fc8-245f638aaf45 on n-h1-851359-3 Aug 04 17:05:06.171082 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-05d9f959-8c81-40fa-9e5c-4296ff99a74d req-7f238d07-cbfa-4d4e-a0db-63f08b063230 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067909 Aug 04 17:05:06.173089 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1354/2630] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:05:06.451196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=9 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:06.550783 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dc216fa9-9eb7-45a0-bbbc-28e03c6fac87 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:06.554656 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dc216fa9-9eb7-45a0-bbbc-28e03c6fac87 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:06.580994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc216fa9-9eb7-45a0-bbbc-28e03c6fac87 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:06.582229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc216fa9-9eb7-45a0-bbbc-28e03c6fac87 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:06.582898 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc216fa9-9eb7-45a0-bbbc-28e03c6fac87 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:06.584213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc216fa9-9eb7-45a0-bbbc-28e03c6fac87 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:06.587057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc216fa9-9eb7-45a0-bbbc-28e03c6fac87 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:06.587781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc216fa9-9eb7-45a0-bbbc-28e03c6fac87 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:06.624788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dc216fa9-9eb7-45a0-bbbc-28e03c6fac87 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:05:06.671335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-01277126-4970-4663-8183-f840ced2a05b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:06.675595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:06.686631 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-01277126-4970-4663-8183-f840ced2a05b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45" status: 200 len: 1655 microversion: 2.1 time: 0.992843 Aug 04 17:05:06.701578 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1277/2631] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:05 2022] GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45 => generated 1655 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:06.709917 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f0502d55-b777-4072-8e01-901e88a20d36 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:06.711069 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f0502d55-b777-4072-8e01-901e88a20d36 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: b2078942-c5e1-4e12-ac29-43ac324a16cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:06.719202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0502d55-b777-4072-8e01-901e88a20d36 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:06.720972 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0502d55-b777-4072-8e01-901e88a20d36 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:06.721652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0502d55-b777-4072-8e01-901e88a20d36 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:06.722666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0502d55-b777-4072-8e01-901e88a20d36 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:06.723348 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0502d55-b777-4072-8e01-901e88a20d36 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:06.724344 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0502d55-b777-4072-8e01-901e88a20d36 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:06.750132 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dc216fa9-9eb7-45a0-bbbc-28e03c6fac87 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "DELETE /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 204 len: 0 microversion: 2.32 time: 0.454551 Aug 04 17:05:06.752723 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1355/2632] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Aug 4 17:05:06 2022] DELETE /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:05:06.759761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e6be6a62-6ae0-4097-88fb-479b0ff8ec90 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:06.760798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e6be6a62-6ae0-4097-88fb-479b0ff8ec90 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 42dff36d-2301-4c8c-b3a5-1dd535cf9664] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:06.771945 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e6be6a62-6ae0-4097-88fb-479b0ff8ec90 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:06.772699 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e6be6a62-6ae0-4097-88fb-479b0ff8ec90 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:06.773226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e6be6a62-6ae0-4097-88fb-479b0ff8ec90 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:06.774157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e6be6a62-6ae0-4097-88fb-479b0ff8ec90 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:06.774487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e6be6a62-6ae0-4097-88fb-479b0ff8ec90 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:06.774922 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e6be6a62-6ae0-4097-88fb-479b0ff8ec90 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:07.212604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f0502d55-b777-4072-8e01-901e88a20d36 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:07.221085 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f0502d55-b777-4072-8e01-901e88a20d36 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb" status: 200 len: 1308 microversion: 2.1 time: 0.516851 Aug 04 17:05:07.222040 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1278/2633] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:06 2022] GET /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb => generated 1308 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:07.238943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-431d0dd7-57a8-46e9-baa8-e019463feacf tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:07.240165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-431d0dd7-57a8-46e9-baa8-e019463feacf tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:07.241824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=93,nova_api:UPDATE=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:07.250363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-431d0dd7-57a8-46e9-baa8-e019463feacf tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:07.251503 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-431d0dd7-57a8-46e9-baa8-e019463feacf tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:07.253747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-431d0dd7-57a8-46e9-baa8-e019463feacf tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:07.255200 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-431d0dd7-57a8-46e9-baa8-e019463feacf tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:07.261157 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-431d0dd7-57a8-46e9-baa8-e019463feacf tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:07.262488 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-431d0dd7-57a8-46e9-baa8-e019463feacf tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:07.321306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e6be6a62-6ae0-4097-88fb-479b0ff8ec90 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:07.333752 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e6be6a62-6ae0-4097-88fb-479b0ff8ec90 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664" status: 200 len: 1316 microversion: 2.1 time: 0.579411 Aug 04 17:05:07.348286 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1356/2634] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:06 2022] GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664 => generated 1316 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:07.354895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-0534f509-ff41-4e2d-9c6d-dbe3e61812f3 req-6fa7187a-3569-44a9-b0b8-852880cf2f25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2078942-c5e1-4e12-ac29-43ac324a16cb", "name": "network-vif-plugged", "status": "completed", "tag": "7facb23f-c28c-4ba5-9f3c-7cd9052ba92a"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:07.371366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-0534f509-ff41-4e2d-9c6d-dbe3e61812f3 req-6fa7187a-3569-44a9-b0b8-852880cf2f25 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:07.372289 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-0534f509-ff41-4e2d-9c6d-dbe3e61812f3 req-6fa7187a-3569-44a9-b0b8-852880cf2f25 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:07.372951 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-0534f509-ff41-4e2d-9c6d-dbe3e61812f3 req-6fa7187a-3569-44a9-b0b8-852880cf2f25 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:07.400212 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-0534f509-ff41-4e2d-9c6d-dbe3e61812f3 req-6fa7187a-3569-44a9-b0b8-852880cf2f25 service nova] Creating event network-vif-plugged:7facb23f-c28c-4ba5-9f3c-7cd9052ba92a for instance b2078942-c5e1-4e12-ac29-43ac324a16cb on n-h1-851359-3 Aug 04 17:05:07.409388 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-0534f509-ff41-4e2d-9c6d-dbe3e61812f3 req-6fa7187a-3569-44a9-b0b8-852880cf2f25 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058473 Aug 04 17:05:07.411303 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1357/2635] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:07.679795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-431d0dd7-57a8-46e9-baa8-e019463feacf tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:07.692716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-431d0dd7-57a8-46e9-baa8-e019463feacf tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:07.698838 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-431d0dd7-57a8-46e9-baa8-e019463feacf tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:07.703434 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-431d0dd7-57a8-46e9-baa8-e019463feacf tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 2950 microversion: 2.32 time: 0.478879 Aug 04 17:05:07.703434 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1279/2636] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:05:07 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 2950 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:05:07.710422 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4f788241-1b09-4874-9ac8-15684d2708c8 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:07.711395 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4f788241-1b09-4874-9ac8-15684d2708c8 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: baaeefae-c19a-4102-9fc8-245f638aaf45] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:07.726317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f788241-1b09-4874-9ac8-15684d2708c8 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:07.727053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f788241-1b09-4874-9ac8-15684d2708c8 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:07.727668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f788241-1b09-4874-9ac8-15684d2708c8 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:07.728389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f788241-1b09-4874-9ac8-15684d2708c8 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:07.728861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f788241-1b09-4874-9ac8-15684d2708c8 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:07.729300 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f788241-1b09-4874-9ac8-15684d2708c8 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:07.884941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4f788241-1b09-4874-9ac8-15684d2708c8 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:07.895041 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4f788241-1b09-4874-9ac8-15684d2708c8 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45" status: 200 len: 1455 microversion: 2.1 time: 0.189660 Aug 04 17:05:07.895970 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1358/2637] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:07 2022] GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45 => generated 1455 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:05:07.953141 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-28cddea6-c639-4046-83c5-bb5738467f66 tempest-AbsoluteLimitsTestJSON-973061398 tempest-AbsoluteLimitsTestJSON-973061398-project] Calling method '.version_select at 0x7f1e5b6dd160>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:07.965627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28cddea6-c639-4046-83c5-bb5738467f66 tempest-AbsoluteLimitsTestJSON-973061398 tempest-AbsoluteLimitsTestJSON-973061398-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:07.966166 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28cddea6-c639-4046-83c5-bb5738467f66 tempest-AbsoluteLimitsTestJSON-973061398 tempest-AbsoluteLimitsTestJSON-973061398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:07.966642 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28cddea6-c639-4046-83c5-bb5738467f66 tempest-AbsoluteLimitsTestJSON-973061398 tempest-AbsoluteLimitsTestJSON-973061398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:07.967497 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28cddea6-c639-4046-83c5-bb5738467f66 tempest-AbsoluteLimitsTestJSON-973061398 tempest-AbsoluteLimitsTestJSON-973061398-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:07.970159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28cddea6-c639-4046-83c5-bb5738467f66 tempest-AbsoluteLimitsTestJSON-973061398 tempest-AbsoluteLimitsTestJSON-973061398-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:07.970714 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28cddea6-c639-4046-83c5-bb5738467f66 tempest-AbsoluteLimitsTestJSON-973061398 tempest-AbsoluteLimitsTestJSON-973061398-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:08.047649 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-28cddea6-c639-4046-83c5-bb5738467f66 tempest-AbsoluteLimitsTestJSON-973061398 tempest-AbsoluteLimitsTestJSON-973061398-project] 10.222.0.93 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.233080 Aug 04 17:05:08.049406 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1280/2638] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 17:05:07 2022] GET /compute/v2.1/limits => generated 511 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:05:08.220638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-41733b40-e01e-430d-8afe-140960fa8dd0 req-cf5fa0e5-72dd-45fb-a131-9f979f04bf6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baaeefae-c19a-4102-9fc8-245f638aaf45", "name": "network-vif-deleted", "tag": "90723e13-4b1c-4323-bcb2-c76a4cc125e8"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:08.242709 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ebf52c11-71d3-49e6-8bfb-bcee0bdcde64 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:08.243447 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ebf52c11-71d3-49e6-8bfb-bcee0bdcde64 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: b2078942-c5e1-4e12-ac29-43ac324a16cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:08.248635 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-41733b40-e01e-430d-8afe-140960fa8dd0 req-cf5fa0e5-72dd-45fb-a131-9f979f04bf6d service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:08.250681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-41733b40-e01e-430d-8afe-140960fa8dd0 req-cf5fa0e5-72dd-45fb-a131-9f979f04bf6d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:08.253186 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ebf52c11-71d3-49e6-8bfb-bcee0bdcde64 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:08.254193 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ebf52c11-71d3-49e6-8bfb-bcee0bdcde64 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:08.254652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-41733b40-e01e-430d-8afe-140960fa8dd0 req-cf5fa0e5-72dd-45fb-a131-9f979f04bf6d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:08.257483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ebf52c11-71d3-49e6-8bfb-bcee0bdcde64 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:08.258409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ebf52c11-71d3-49e6-8bfb-bcee0bdcde64 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:08.259002 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ebf52c11-71d3-49e6-8bfb-bcee0bdcde64 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:08.261342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ebf52c11-71d3-49e6-8bfb-bcee0bdcde64 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:08.283455 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-41733b40-e01e-430d-8afe-140960fa8dd0 req-cf5fa0e5-72dd-45fb-a131-9f979f04bf6d service nova] Creating event network-vif-deleted:90723e13-4b1c-4323-bcb2-c76a4cc125e8 for instance baaeefae-c19a-4102-9fc8-245f638aaf45 on n-h1-851359-3 Aug 04 17:05:08.296115 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-41733b40-e01e-430d-8afe-140960fa8dd0 req-cf5fa0e5-72dd-45fb-a131-9f979f04bf6d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079062 Aug 04 17:05:08.298663 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1359/2639] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:08.356871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1c2e57f2-6b5a-4a33-8b2b-630e58055e59 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:08.357574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1c2e57f2-6b5a-4a33-8b2b-630e58055e59 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 42dff36d-2301-4c8c-b3a5-1dd535cf9664] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:08.367566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1c2e57f2-6b5a-4a33-8b2b-630e58055e59 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:08.369043 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1c2e57f2-6b5a-4a33-8b2b-630e58055e59 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:08.369792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1c2e57f2-6b5a-4a33-8b2b-630e58055e59 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:08.371688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1c2e57f2-6b5a-4a33-8b2b-630e58055e59 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:08.372566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1c2e57f2-6b5a-4a33-8b2b-630e58055e59 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:08.373444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1c2e57f2-6b5a-4a33-8b2b-630e58055e59 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:08.665689 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ebf52c11-71d3-49e6-8bfb-bcee0bdcde64 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:08.678917 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ebf52c11-71d3-49e6-8bfb-bcee0bdcde64 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb" status: 200 len: 1308 microversion: 2.1 time: 0.440289 Aug 04 17:05:08.681881 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1281/2640] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:08 2022] GET /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb => generated 1308 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:05:08.731449 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a2002acd-fada-4c90-a7b6-4912637045d8 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:08.732088 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a2002acd-fada-4c90-a7b6-4912637045d8 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:08.740906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1c2e57f2-6b5a-4a33-8b2b-630e58055e59 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:08.744058 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2002acd-fada-4c90-a7b6-4912637045d8 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:08.747323 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2002acd-fada-4c90-a7b6-4912637045d8 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:08.747829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2002acd-fada-4c90-a7b6-4912637045d8 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:08.749568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2002acd-fada-4c90-a7b6-4912637045d8 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:08.750324 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2002acd-fada-4c90-a7b6-4912637045d8 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:08.750746 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1c2e57f2-6b5a-4a33-8b2b-630e58055e59 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664" status: 200 len: 1316 microversion: 2.1 time: 0.398345 Aug 04 17:05:08.753214 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2002acd-fada-4c90-a7b6-4912637045d8 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:08.768830 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1360/2641] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:08 2022] GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664 => generated 1316 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:08.927847 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e2b23685-b403-41a0-87be-ba48690b389e tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:08.929423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e2b23685-b403-41a0-87be-ba48690b389e tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: baaeefae-c19a-4102-9fc8-245f638aaf45] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:08.938633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2b23685-b403-41a0-87be-ba48690b389e tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:08.940105 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2b23685-b403-41a0-87be-ba48690b389e tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:08.941073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2b23685-b403-41a0-87be-ba48690b389e tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:08.942854 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2b23685-b403-41a0-87be-ba48690b389e tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:08.943613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2b23685-b403-41a0-87be-ba48690b389e tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:08.944200 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2b23685-b403-41a0-87be-ba48690b389e tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:09.003926 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2b23685-b403-41a0-87be-ba48690b389e tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:09.004680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2b23685-b403-41a0-87be-ba48690b389e tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:09.005727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2b23685-b403-41a0-87be-ba48690b389e tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:09.006535 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-e2b23685-b403-41a0-87be-ba48690b389e tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lazy-loading 'fault' on Instance uuid baaeefae-c19a-4102-9fc8-245f638aaf45 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:05:09.078456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e2b23685-b403-41a0-87be-ba48690b389e tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:09.115371 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e2b23685-b403-41a0-87be-ba48690b389e tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45" status: 200 len: 1303 microversion: 2.1 time: 0.198796 Aug 04 17:05:09.125788 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1361/2642] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:08 2022] GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45 => generated 1303 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:05:09.200097 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a2002acd-fada-4c90-a7b6-4912637045d8 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:09.233436 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a2002acd-fada-4c90-a7b6-4912637045d8 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:09.237757 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a2002acd-fada-4c90-a7b6-4912637045d8 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:09.240673 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a2002acd-fada-4c90-a7b6-4912637045d8 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 2950 microversion: 2.32 time: 0.514154 Aug 04 17:05:09.259894 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1282/2643] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:05:08 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 2950 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:05:09.456648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-890ff911-c880-4d6a-b9ea-43338353ed6f req-37af4f7b-9dd5-4a0d-9977-3b5b06a6f241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baaeefae-c19a-4102-9fc8-245f638aaf45", "name": "network-vif-unplugged", "status": "completed", "tag": "90723e13-4b1c-4323-bcb2-c76a4cc125e8"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:09.481512 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-890ff911-c880-4d6a-b9ea-43338353ed6f req-37af4f7b-9dd5-4a0d-9977-3b5b06a6f241 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:09.483184 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-890ff911-c880-4d6a-b9ea-43338353ed6f req-37af4f7b-9dd5-4a0d-9977-3b5b06a6f241 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:09.485699 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-890ff911-c880-4d6a-b9ea-43338353ed6f req-37af4f7b-9dd5-4a0d-9977-3b5b06a6f241 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:09.511555 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-890ff911-c880-4d6a-b9ea-43338353ed6f req-37af4f7b-9dd5-4a0d-9977-3b5b06a6f241 service nova] Creating event network-vif-unplugged:90723e13-4b1c-4323-bcb2-c76a4cc125e8 for instance baaeefae-c19a-4102-9fc8-245f638aaf45 on n-h1-851359-3 Aug 04 17:05:09.520013 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-890ff911-c880-4d6a-b9ea-43338353ed6f req-37af4f7b-9dd5-4a0d-9977-3b5b06a6f241 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073547 Aug 04 17:05:09.521998 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1362/2644] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:05:09.709095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a7d74c68-e492-4b7a-8e1d-ee882b83f624 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:09.710066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a7d74c68-e492-4b7a-8e1d-ee882b83f624 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: b2078942-c5e1-4e12-ac29-43ac324a16cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:09.725580 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7d74c68-e492-4b7a-8e1d-ee882b83f624 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:09.730214 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7d74c68-e492-4b7a-8e1d-ee882b83f624 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:09.731107 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7d74c68-e492-4b7a-8e1d-ee882b83f624 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:09.732453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7d74c68-e492-4b7a-8e1d-ee882b83f624 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:09.735883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7d74c68-e492-4b7a-8e1d-ee882b83f624 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:09.737286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7d74c68-e492-4b7a-8e1d-ee882b83f624 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:09.778850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6efced3c-6a08-4ce1-a747-44df56a8e507 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:09.779813 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6efced3c-6a08-4ce1-a747-44df56a8e507 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 42dff36d-2301-4c8c-b3a5-1dd535cf9664] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:09.806139 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6efced3c-6a08-4ce1-a747-44df56a8e507 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:09.806914 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6efced3c-6a08-4ce1-a747-44df56a8e507 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:09.813524 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6efced3c-6a08-4ce1-a747-44df56a8e507 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:09.814823 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6efced3c-6a08-4ce1-a747-44df56a8e507 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:09.816595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6efced3c-6a08-4ce1-a747-44df56a8e507 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:09.818510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6efced3c-6a08-4ce1-a747-44df56a8e507 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:10.319990 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a7d74c68-e492-4b7a-8e1d-ee882b83f624 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:10.335070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6efced3c-6a08-4ce1-a747-44df56a8e507 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:10.337379 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a7d74c68-e492-4b7a-8e1d-ee882b83f624 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb" status: 200 len: 1488 microversion: 2.1 time: 0.634359 Aug 04 17:05:10.340300 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1283/2645] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:09 2022] GET /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb => generated 1488 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:10.346545 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-06e82fd0-ed0e-4fc3-b3bf-b9e052a0b8af tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:10.347162 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-06e82fd0-ed0e-4fc3-b3bf-b9e052a0b8af tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: baaeefae-c19a-4102-9fc8-245f638aaf45] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:10.361870 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6efced3c-6a08-4ce1-a747-44df56a8e507 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664" status: 200 len: 1316 microversion: 2.1 time: 0.588402 Aug 04 17:05:10.374007 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1363/2646] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:09 2022] GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664 => generated 1316 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:05:10.374007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3bc52187-7011-4fef-9800-87010490ac3d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:10.374007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3bc52187-7011-4fef-9800-87010490ac3d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:10.379594 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06e82fd0-ed0e-4fc3-b3bf-b9e052a0b8af tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:10.380998 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3bc52187-7011-4fef-9800-87010490ac3d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:10.381511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3bc52187-7011-4fef-9800-87010490ac3d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:10.385077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3bc52187-7011-4fef-9800-87010490ac3d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:10.385233 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06e82fd0-ed0e-4fc3-b3bf-b9e052a0b8af tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:10.385317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3bc52187-7011-4fef-9800-87010490ac3d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:10.385317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3bc52187-7011-4fef-9800-87010490ac3d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:10.385317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3bc52187-7011-4fef-9800-87010490ac3d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:10.385523 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06e82fd0-ed0e-4fc3-b3bf-b9e052a0b8af tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:10.388028 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06e82fd0-ed0e-4fc3-b3bf-b9e052a0b8af tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:10.388554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06e82fd0-ed0e-4fc3-b3bf-b9e052a0b8af tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:10.389008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06e82fd0-ed0e-4fc3-b3bf-b9e052a0b8af tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:10.427318 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-06e82fd0-ed0e-4fc3-b3bf-b9e052a0b8af tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] HTTP exception thrown: Instance baaeefae-c19a-4102-9fc8-245f638aaf45 could not be found. Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-06e82fd0-ed0e-4fc3-b3bf-b9e052a0b8af tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Request method failure captured: Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45 HTTP/1.1 Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_wVVZ576bEuleBDdDhY4I0SQ0zK3Ghzp1cBRfY4ga-r487I6rdcJL24mx3zcbzv-eCIwK8F09BnRcC2jNkBlj8M7SUhFxVchCfQtxfke5cInlh_p2edIMVe-YibO79gM4UqJdNGNVAIUbvxuAch_j1xV7m-350QVlKDFEpK_YXnMFk Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 12dc616249934210aab2670a55053ecc Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersTestMultiNic-1689890194 Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/12dc616249934210aab2670a55053ecc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/12dc616249934210aab2670a55053ecc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_12dc616249934210aab2670a55053ecc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/12dc616249934210aab2670a55053ecc"}]}] Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersTestMultiNic-1689890194 Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 12dc616249934210aab2670a55053ecc Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersTestMultiNic-1689890194 Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersTestMultiNic-1689890194-project Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 234245a6fb7c441aa667a4ad619c1986 Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersTestMultiNic-1689890194-project Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance baaeefae-c19a-4102-9fc8-245f638aaf45 could not be found. Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'baaeefae-c19a-4102-9fc8-245f638aaf45'} Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baaeefae-c19a-4102-9fc8-245f638aaf45 could not be found. Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baaeefae-c19a-4102-9fc8-245f638aaf45 could not be found. Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:10.429909 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:10.434298 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:10.434298 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:10.434298 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:10.434298 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:05:10.434298 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:05:10.434298 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baaeefae-c19a-4102-9fc8-245f638aaf45 could not be found. Aug 04 17:05:10.434298 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:10.436282 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-06e82fd0-ed0e-4fc3-b3bf-b9e052a0b8af tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Returning 404 to user: Instance baaeefae-c19a-4102-9fc8-245f638aaf45 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:05:10.437400 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-06e82fd0-ed0e-4fc3-b3bf-b9e052a0b8af tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45" status: 404 len: 111 microversion: 2.1 time: 0.095642 Aug 04 17:05:10.442444 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1284/2647] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:10 2022] GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:05:10.449726 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-59263937-90a2-4625-829b-9a0099c3b9c0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1564315569"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:10.453676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-59263937-90a2-4625-829b-9a0099c3b9c0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: b2078942-c5e1-4e12-ac29-43ac324a16cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:10.463063 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59263937-90a2-4625-829b-9a0099c3b9c0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:10.466800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59263937-90a2-4625-829b-9a0099c3b9c0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:10.467611 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59263937-90a2-4625-829b-9a0099c3b9c0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:10.468605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59263937-90a2-4625-829b-9a0099c3b9c0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:10.469236 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59263937-90a2-4625-829b-9a0099c3b9c0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:10.469824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59263937-90a2-4625-829b-9a0099c3b9c0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:10.820603 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-59263937-90a2-4625-829b-9a0099c3b9c0 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "POST /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb/action" status: 202 len: 0 microversion: 2.1 time: 0.376383 Aug 04 17:05:10.822432 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1285/2648] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:05:10 2022] POST /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 17:05:10.840544 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3456fb08-04b6-42aa-af85-f4d1aedf5726 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e68242040>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:10.913139 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3456fb08-04b6-42aa-af85-f4d1aedf5726 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/6ce9595f-b94a-4e9c-b5bd-a3f7b520ee6d" status: 200 len: 1410 microversion: 2.1 time: 0.083452 Aug 04 17:05:10.913736 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1286/2649] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:05:10 2022] GET /compute/v2.1/images/6ce9595f-b94a-4e9c-b5bd-a3f7b520ee6d => generated 1410 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:10.955924 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fd268f16-d0ec-4ff7-814a-bcb5f6e7266f tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e68087b80>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:11.021026 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fd268f16-d0ec-4ff7-814a-bcb5f6e7266f tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/6ce9595f-b94a-4e9c-b5bd-a3f7b520ee6d" status: 200 len: 1410 microversion: 2.1 time: 0.091014 Aug 04 17:05:11.022170 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1287/2650] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:05:10 2022] GET /compute/v2.1/images/6ce9595f-b94a-4e9c-b5bd-a3f7b520ee6d => generated 1410 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:11.037627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c40f7d3b-ae0c-4f9e-a41b-6775e77ed317 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5b9a6ca0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:11.332069 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c40f7d3b-ae0c-4f9e-a41b-6775e77ed317 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "DELETE /compute/v2.1/images/6ce9595f-b94a-4e9c-b5bd-a3f7b520ee6d" status: 204 len: 0 microversion: 2.1 time: 0.299350 Aug 04 17:05:11.332706 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1288/2651] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:11 2022] DELETE /compute/v2.1/images/6ce9595f-b94a-4e9c-b5bd-a3f7b520ee6d => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:05:11.348688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-db7f9c7d-4283-4d38-8a35-a4a16e668f5a tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5bfa8e50>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:11.381063 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3bc52187-7011-4fef-9800-87010490ac3d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:11.397327 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3bc52187-7011-4fef-9800-87010490ac3d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:11.401545 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-db7f9c7d-4283-4d38-8a35-a4a16e668f5a tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] HTTP exception thrown: Image not found. Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-db7f9c7d-4283-4d38-8a35-a4a16e668f5a tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Request method failure captured: Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/images/6ce9595f-b94a-4e9c-b5bd-a3f7b520ee6d HTTP/1.1 Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_tUfF40yWb3YWSPuST_k75056eDJQSzLbaFJTlk0YU0jUj8ZFyyQdage4s2y--jxmqVBcnPhvgAKjc7jg9b2VNWICPCBCsPlvzmDPQYcaezG6cAVc6eitq6FjvvKsix5Opi_UtjCNda4BZmNIXaNDsAx3Rzl27pqJ6UlvsPp1f3y1I Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 86d8604ab1934bdeacd1bb6073ae153a Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesTestJSON-66576260 Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/86d8604ab1934bdeacd1bb6073ae153a"}]}] Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesTestJSON-66576260 Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 86d8604ab1934bdeacd1bb6073ae153a Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesTestJSON-66576260 Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ImagesTestJSON-66576260-project Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 157e8ca7c2494f3ea5c468dc37f55858 Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesTestJSON-66576260-project Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: exception: Image not found. Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '6ce9595f-b94a-4e9c-b5bd-a3f7b520ee6d'} Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6ce9595f-b94a-4e9c-b5bd-a3f7b520ee6d Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 17:05:11.404622 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6ce9595f-b94a-4e9c-b5bd-a3f7b520ee6d could not be found. Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 17:05:11.409653 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:11.413241 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3bc52187-7011-4fef-9800-87010490ac3d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:11.413241 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3bc52187-7011-4fef-9800-87010490ac3d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 2950 microversion: 2.32 time: 1.044166 Aug 04 17:05:11.415682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-db7f9c7d-4283-4d38-8a35-a4a16e668f5a tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Returning 404 to user: Image not found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:05:11.416751 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-db7f9c7d-4283-4d38-8a35-a4a16e668f5a tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/images/6ce9595f-b94a-4e9c-b5bd-a3f7b520ee6d" status: 404 len: 62 microversion: 2.1 time: 0.074597 Aug 04 17:05:11.417765 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1289/2652] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:05:11 2022] GET /compute/v2.1/images/6ce9595f-b94a-4e9c-b5bd-a3f7b520ee6d => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:05:11.425628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c20518be-1250-47c9-93a9-5f076e7b2847 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:11.426390 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1364/2653] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:05:10 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 2950 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:05:11.426924 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c20518be-1250-47c9-93a9-5f076e7b2847 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 42dff36d-2301-4c8c-b3a5-1dd535cf9664] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:11.439557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-392dd5df-a6aa-4ba6-8c75-bd345853c754 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:11.440195 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-392dd5df-a6aa-4ba6-8c75-bd345853c754 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: b2078942-c5e1-4e12-ac29-43ac324a16cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:11.444355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c20518be-1250-47c9-93a9-5f076e7b2847 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:11.444876 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c20518be-1250-47c9-93a9-5f076e7b2847 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:11.445306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c20518be-1250-47c9-93a9-5f076e7b2847 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:11.446285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c20518be-1250-47c9-93a9-5f076e7b2847 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:11.446918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c20518be-1250-47c9-93a9-5f076e7b2847 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:11.447498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c20518be-1250-47c9-93a9-5f076e7b2847 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:11.463110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-392dd5df-a6aa-4ba6-8c75-bd345853c754 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:11.466200 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-392dd5df-a6aa-4ba6-8c75-bd345853c754 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:11.466659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-392dd5df-a6aa-4ba6-8c75-bd345853c754 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:11.467413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-392dd5df-a6aa-4ba6-8c75-bd345853c754 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:11.467890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-392dd5df-a6aa-4ba6-8c75-bd345853c754 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:11.468329 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-392dd5df-a6aa-4ba6-8c75-bd345853c754 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:12.477938 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c20518be-1250-47c9-93a9-5f076e7b2847 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:12.499750 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c20518be-1250-47c9-93a9-5f076e7b2847 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664" status: 200 len: 1316 microversion: 2.1 time: 1.080469 Aug 04 17:05:12.504077 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1290/2654] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:11 2022] GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664 => generated 1316 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:12.522081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-2aba5572-e222-4cde-997a-3ebf17efbb70 req-2665bb5c-a83e-46c2-9ea8-00c609c6dff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42dff36d-2301-4c8c-b3a5-1dd535cf9664", "name": "network-vif-plugged", "status": "completed", "tag": "9285b000-3237-417d-acef-9b19e86db779"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:12.551697 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2aba5572-e222-4cde-997a-3ebf17efbb70 req-2665bb5c-a83e-46c2-9ea8-00c609c6dff9 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:12.552491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2aba5572-e222-4cde-997a-3ebf17efbb70 req-2665bb5c-a83e-46c2-9ea8-00c609c6dff9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:12.556034 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2aba5572-e222-4cde-997a-3ebf17efbb70 req-2665bb5c-a83e-46c2-9ea8-00c609c6dff9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:12.577200 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-2aba5572-e222-4cde-997a-3ebf17efbb70 req-2665bb5c-a83e-46c2-9ea8-00c609c6dff9 service nova] Creating event network-vif-plugged:9285b000-3237-417d-acef-9b19e86db779 for instance 42dff36d-2301-4c8c-b3a5-1dd535cf9664 on n-h1-851359-3 Aug 04 17:05:12.582675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-392dd5df-a6aa-4ba6-8c75-bd345853c754 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:12.585073 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-2aba5572-e222-4cde-997a-3ebf17efbb70 req-2665bb5c-a83e-46c2-9ea8-00c609c6dff9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077919 Aug 04 17:05:12.587582 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1291/2655] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:12.594315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f967cbb4-f1d6-4127-8436-2edd9d04c18e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:12.595803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f967cbb4-f1d6-4127-8436-2edd9d04c18e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:12.600472 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-392dd5df-a6aa-4ba6-8c75-bd345853c754 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb" status: 200 len: 1500 microversion: 2.1 time: 1.165614 Aug 04 17:05:12.602260 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1365/2656] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:11 2022] GET /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb => generated 1500 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:12.618752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f967cbb4-f1d6-4127-8436-2edd9d04c18e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:12.620514 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f967cbb4-f1d6-4127-8436-2edd9d04c18e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:12.621082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f967cbb4-f1d6-4127-8436-2edd9d04c18e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:12.624587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f967cbb4-f1d6-4127-8436-2edd9d04c18e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:12.625598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f967cbb4-f1d6-4127-8436-2edd9d04c18e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:12.626513 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f967cbb4-f1d6-4127-8436-2edd9d04c18e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:12.907504 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c8c384dc-eb4b-4b34-840c-85e0fc2e66a7 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] Action: 'create', calling method: .version_select at 0x7f1e5b1703a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-198736045", "description": "tempest-description-1531118471"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:13.260265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f967cbb4-f1d6-4127-8436-2edd9d04c18e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:13.281378 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f967cbb4-f1d6-4127-8436-2edd9d04c18e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:13.284896 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f967cbb4-f1d6-4127-8436-2edd9d04c18e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:13.286449 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f967cbb4-f1d6-4127-8436-2edd9d04c18e tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 2950 microversion: 2.32 time: 0.697248 Aug 04 17:05:13.314400 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1292/2657] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:05:12 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 2950 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:05:13.524302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9a3d4088-2376-41c1-b0cb-5c13d3863d9c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:13.525632 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9a3d4088-2376-41c1-b0cb-5c13d3863d9c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 42dff36d-2301-4c8c-b3a5-1dd535cf9664] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:13.569121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a3d4088-2376-41c1-b0cb-5c13d3863d9c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:13.573012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a3d4088-2376-41c1-b0cb-5c13d3863d9c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:13.574296 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a3d4088-2376-41c1-b0cb-5c13d3863d9c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:13.577646 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a3d4088-2376-41c1-b0cb-5c13d3863d9c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:13.600989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a3d4088-2376-41c1-b0cb-5c13d3863d9c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:13.602667 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a3d4088-2376-41c1-b0cb-5c13d3863d9c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:13.639883 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c8c384dc-eb4b-4b34-840c-85e0fc2e66a7 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.013410 Aug 04 17:05:13.660001 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1366/2658] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Aug 4 17:05:12 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:13.679709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4dca40c8-36f9-44a1-8f02-005f8bc17cfc tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:13.687531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4dca40c8-36f9-44a1-8f02-005f8bc17cfc tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: b2078942-c5e1-4e12-ac29-43ac324a16cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:13.721585 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4dca40c8-36f9-44a1-8f02-005f8bc17cfc tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:13.728039 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4dca40c8-36f9-44a1-8f02-005f8bc17cfc tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:13.729268 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4dca40c8-36f9-44a1-8f02-005f8bc17cfc tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:13.730746 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4dca40c8-36f9-44a1-8f02-005f8bc17cfc tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:13.731710 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4dca40c8-36f9-44a1-8f02-005f8bc17cfc tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:13.732171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4dca40c8-36f9-44a1-8f02-005f8bc17cfc tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:14.366806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4dca40c8-36f9-44a1-8f02-005f8bc17cfc tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:14.384852 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4dca40c8-36f9-44a1-8f02-005f8bc17cfc tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb" status: 200 len: 1506 microversion: 2.1 time: 0.712888 Aug 04 17:05:14.388233 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1367/2659] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:13 2022] GET /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb => generated 1506 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:14.394556 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a6455d7b-6955-465c-ac72-3e5a604b930d tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] Action: 'create', calling method: .version_select at 0x7f1e6caac160>, body: {"security_group_rule": {"parent_group_id": "01a93c42-ce8a-41f2-9186-3a75a1de203d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:14.472464 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9a3d4088-2376-41c1-b0cb-5c13d3863d9c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:14.484816 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9a3d4088-2376-41c1-b0cb-5c13d3863d9c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664" status: 200 len: 1316 microversion: 2.1 time: 0.964644 Aug 04 17:05:14.485747 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1293/2660] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:13 2022] GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664 => generated 1316 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:14.498264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7b1dece8-09ba-43bc-8696-1ff766777012 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:14.498901 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7b1dece8-09ba-43bc-8696-1ff766777012 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:14.516852 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b1dece8-09ba-43bc-8696-1ff766777012 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:14.518341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b1dece8-09ba-43bc-8696-1ff766777012 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:14.519278 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b1dece8-09ba-43bc-8696-1ff766777012 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:14.520917 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b1dece8-09ba-43bc-8696-1ff766777012 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:14.523611 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b1dece8-09ba-43bc-8696-1ff766777012 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:14.524378 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b1dece8-09ba-43bc-8696-1ff766777012 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:15.073720 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7b1dece8-09ba-43bc-8696-1ff766777012 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:15.084122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7b1dece8-09ba-43bc-8696-1ff766777012 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:15.085636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7b1dece8-09ba-43bc-8696-1ff766777012 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:15.091516 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7b1dece8-09ba-43bc-8696-1ff766777012 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 2929 microversion: 2.32 time: 0.604437 Aug 04 17:05:15.094789 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1294/2661] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:05:14 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 2929 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:05:15.101687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-437d6e42-ff14-4b21-a4c7-da55446212d0 req-34dd3745-3fb7-4294-83c3-97f28789f93b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "238cb283-0037-440c-a433-d3f4e3de1274", "name": "network-vif-unplugged", "status": "completed", "tag": "bd58d1ec-cf62-4cc6-8629-14df8de01861"}, {"server_uuid": "238cb283-0037-440c-a433-d3f4e3de1274", "name": "network-vif-unplugged", "status": "completed", "tag": "b3ffb765-1857-45ce-9f08-b2a94e4fdef2"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:15.128455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-437d6e42-ff14-4b21-a4c7-da55446212d0 req-34dd3745-3fb7-4294-83c3-97f28789f93b service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:15.129332 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-437d6e42-ff14-4b21-a4c7-da55446212d0 req-34dd3745-3fb7-4294-83c3-97f28789f93b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:15.130763 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-437d6e42-ff14-4b21-a4c7-da55446212d0 req-34dd3745-3fb7-4294-83c3-97f28789f93b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:15.150094 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-437d6e42-ff14-4b21-a4c7-da55446212d0 req-34dd3745-3fb7-4294-83c3-97f28789f93b service nova] Creating event network-vif-unplugged:bd58d1ec-cf62-4cc6-8629-14df8de01861 for instance 238cb283-0037-440c-a433-d3f4e3de1274 on n-h2-851359-3 Aug 04 17:05:15.151474 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-437d6e42-ff14-4b21-a4c7-da55446212d0 req-34dd3745-3fb7-4294-83c3-97f28789f93b service nova] Creating event network-vif-unplugged:b3ffb765-1857-45ce-9f08-b2a94e4fdef2 for instance 238cb283-0037-440c-a433-d3f4e3de1274 on n-h2-851359-3 Aug 04 17:05:15.160461 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-437d6e42-ff14-4b21-a4c7-da55446212d0 req-34dd3745-3fb7-4294-83c3-97f28789f93b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.064288 Aug 04 17:05:15.162253 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1295/2662] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:15.244936 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a6455d7b-6955-465c-ac72-3e5a604b930d tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.854904 Aug 04 17:05:15.253347 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1368/2663] 10.222.0.93 () {60 vars in 1195 bytes} [Thu Aug 4 17:05:14 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:15.259642 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6e513a76-7e57-4bcf-878e-e2dde7be630a tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] Action: 'create', calling method: .version_select at 0x7f1e5bfdb790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1126416015", "description": "tempest-description-821432736"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:15.411901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8e0c1837-f701-4374-b770-24af8fc49e7b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:15.412536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8e0c1837-f701-4374-b770-24af8fc49e7b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: b2078942-c5e1-4e12-ac29-43ac324a16cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:15.428571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e0c1837-f701-4374-b770-24af8fc49e7b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:15.430838 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e0c1837-f701-4374-b770-24af8fc49e7b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:15.436580 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e0c1837-f701-4374-b770-24af8fc49e7b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:15.438016 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e0c1837-f701-4374-b770-24af8fc49e7b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:15.438559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e0c1837-f701-4374-b770-24af8fc49e7b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:15.439071 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e0c1837-f701-4374-b770-24af8fc49e7b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:15.960387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8e0c1837-f701-4374-b770-24af8fc49e7b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:15.981634 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8e0c1837-f701-4374-b770-24af8fc49e7b tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb" status: 200 len: 1488 microversion: 2.1 time: 0.575604 Aug 04 17:05:15.988580 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6e513a76-7e57-4bcf-878e-e2dde7be630a tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.731377 Aug 04 17:05:15.997139 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1296/2664] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Aug 4 17:05:15 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:15.997862 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1369/2665] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:15 2022] GET /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb => generated 1488 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:16.015951 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-379c6c56-a478-462e-9762-d3334b7beef6 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:16.016831 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-379c6c56-a478-462e-9762-d3334b7beef6 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 42dff36d-2301-4c8c-b3a5-1dd535cf9664] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:16.025372 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-379c6c56-a478-462e-9762-d3334b7beef6 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:16.025870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-379c6c56-a478-462e-9762-d3334b7beef6 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:16.026406 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-379c6c56-a478-462e-9762-d3334b7beef6 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:16.027115 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-379c6c56-a478-462e-9762-d3334b7beef6 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:16.027635 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-379c6c56-a478-462e-9762-d3334b7beef6 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:16.028067 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-379c6c56-a478-462e-9762-d3334b7beef6 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:16.035202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5bb1798e-9dac-426a-ac22-9026e23df273 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] Action: 'create', calling method: .version_select at 0x7f1e6c91a1f0>, body: {"security_group_rule": {"parent_group_id": "9f9d991a-8ae2-4641-bc89-f3e9f9ff6400", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:16.406906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-379c6c56-a478-462e-9762-d3334b7beef6 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:16.422164 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-379c6c56-a478-462e-9762-d3334b7beef6 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664" status: 200 len: 1466 microversion: 2.1 time: 0.430545 Aug 04 17:05:16.424595 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1297/2666] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:15 2022] GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664 => generated 1466 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:16.432154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d960e3e3-3676-4104-ab08-797afe1a1934 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:16.434589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d960e3e3-3676-4104-ab08-797afe1a1934 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: b2078942-c5e1-4e12-ac29-43ac324a16cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:16.442266 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d960e3e3-3676-4104-ab08-797afe1a1934 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:16.445294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d960e3e3-3676-4104-ab08-797afe1a1934 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:16.446099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d960e3e3-3676-4104-ab08-797afe1a1934 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:16.447003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d960e3e3-3676-4104-ab08-797afe1a1934 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:16.447638 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d960e3e3-3676-4104-ab08-797afe1a1934 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:16.448232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d960e3e3-3676-4104-ab08-797afe1a1934 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:16.493835 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d960e3e3-3676-4104-ab08-797afe1a1934 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: b2078942-c5e1-4e12-ac29-43ac324a16cb] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:05:16.620389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:16.632335 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5bb1798e-9dac-426a-ac22-9026e23df273 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.615441 Aug 04 17:05:16.633423 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1370/2667] 10.222.0.93 () {60 vars in 1195 bytes} [Thu Aug 4 17:05:16 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:16.649174 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bf439e66-2601-4b86-b8df-23a9ba76abb5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:16.649347 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bf439e66-2601-4b86-b8df-23a9ba76abb5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:16.675533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf439e66-2601-4b86-b8df-23a9ba76abb5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:16.678626 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf439e66-2601-4b86-b8df-23a9ba76abb5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:16.679706 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf439e66-2601-4b86-b8df-23a9ba76abb5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:16.683121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf439e66-2601-4b86-b8df-23a9ba76abb5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:16.684790 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf439e66-2601-4b86-b8df-23a9ba76abb5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:16.685387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf439e66-2601-4b86-b8df-23a9ba76abb5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:16.772864 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d960e3e3-3676-4104-ab08-797afe1a1934 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb" status: 204 len: 0 microversion: 2.1 time: 0.345895 Aug 04 17:05:16.773916 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1298/2668] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:05:16 2022] DELETE /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:05:17.116112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a933072e-07ea-4b34-a660-4289d69f5e29 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:17.117461 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a933072e-07ea-4b34-a660-4289d69f5e29 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] [instance: 42dff36d-2301-4c8c-b3a5-1dd535cf9664] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:17.127665 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bf439e66-2601-4b86-b8df-23a9ba76abb5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:17.138266 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a933072e-07ea-4b34-a660-4289d69f5e29 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:17.139136 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a933072e-07ea-4b34-a660-4289d69f5e29 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:17.139738 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a933072e-07ea-4b34-a660-4289d69f5e29 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:17.141868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bf439e66-2601-4b86-b8df-23a9ba76abb5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:17.143778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bf439e66-2601-4b86-b8df-23a9ba76abb5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:17.144094 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a933072e-07ea-4b34-a660-4289d69f5e29 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:17.144783 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a933072e-07ea-4b34-a660-4289d69f5e29 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:17.145505 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a933072e-07ea-4b34-a660-4289d69f5e29 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:17.151543 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bf439e66-2601-4b86-b8df-23a9ba76abb5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 2862 microversion: 2.32 time: 0.510561 Aug 04 17:05:17.153660 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1371/2669] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:05:16 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 2862 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:05:17.169873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2d5f3bdd-ec18-48b9-bbbf-e09791cbb107 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] Action: 'create', calling method: .version_select at 0x7f1e6c9769d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-584263805", "description": "tempest-description-1765127416"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:17.950510 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2d5f3bdd-ec18-48b9-bbbf-e09791cbb107 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.795225 Aug 04 17:05:17.951262 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1372/2670] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Aug 4 17:05:17 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:17.963177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-38d678de-2256-4916-b6e0-ecf77a56e8ab tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5b07ddc0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:17.965471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:17.988811 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:17.992821 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-38d678de-2256-4916-b6e0-ecf77a56e8ab tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] HTTP exception thrown: Image not found. Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-38d678de-2256-4916-b6e0-ecf77a56e8ab tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Request method failure captured: Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/images/6ce9595f-b94a-4e9c-b5bd-a3f7b520ee6d HTTP/1.1 Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_tUfF40yWb3YWSPuST_k75056eDJQSzLbaFJTlk0YU0jUj8ZFyyQdage4s2y--jxmqVBcnPhvgAKjc7jg9b2VNWICPCBCsPlvzmDPQYcaezG6cAVc6eitq6FjvvKsix5Opi_UtjCNda4BZmNIXaNDsAx3Rzl27pqJ6UlvsPp1f3y1I Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 86d8604ab1934bdeacd1bb6073ae153a Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ImagesTestJSON-66576260 Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/86d8604ab1934bdeacd1bb6073ae153a"}]}] Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ImagesTestJSON-66576260 Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 86d8604ab1934bdeacd1bb6073ae153a Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ImagesTestJSON-66576260 Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ImagesTestJSON-66576260-project Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 157e8ca7c2494f3ea5c468dc37f55858 Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ImagesTestJSON-66576260-project Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: exception: Image not found. Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '6ce9595f-b94a-4e9c-b5bd-a3f7b520ee6d'} Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6ce9595f-b94a-4e9c-b5bd-a3f7b520ee6d to delete Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6ce9595f-b94a-4e9c-b5bd-a3f7b520ee6d could not be found. Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:17.994951 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:17.999418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:17.999418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:17.999418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:05:17.999418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:05:17.999418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:05:17.999418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:05:17.999418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:05:17.999418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:05:17.999418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 17:05:17.999418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 17:05:17.999418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 17:05:17.999418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:17.999418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:17.999418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:17.999418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:17.999418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:17.999418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:17.999418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:05:17.999418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:05:17.999418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 17:05:17.999418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:18.001598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-38d678de-2256-4916-b6e0-ecf77a56e8ab tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Returning 404 to user: Image not found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:05:18.004424 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-38d678de-2256-4916-b6e0-ecf77a56e8ab tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "DELETE /compute/v2.1/images/6ce9595f-b94a-4e9c-b5bd-a3f7b520ee6d" status: 404 len: 62 microversion: 2.1 time: 0.052215 Aug 04 17:05:18.008823 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1373/2671] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:17 2022] DELETE /compute/v2.1/images/6ce9595f-b94a-4e9c-b5bd-a3f7b520ee6d => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:05:18.132206 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a933072e-07ea-4b34-a660-4289d69f5e29 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664" status: 200 len: 1617 microversion: 2.1 time: 1.346321 Aug 04 17:05:18.137916 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1299/2672] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:16 2022] GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664 => generated 1617 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:18.160227 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-92c0692f-b9b1-4416-b148-4e249ca33dba req-47ff49fc-309a-4e2b-8df9-8c6ba9bb30b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "238cb283-0037-440c-a433-d3f4e3de1274", "name": "network-vif-unplugged", "status": "completed", "tag": "9c46603b-3e50-4dfd-a7a6-bd1e37bb11c3"}, {"server_uuid": "238cb283-0037-440c-a433-d3f4e3de1274", "name": "network-vif-unplugged", "status": "completed", "tag": "3814bb20-52c5-4223-9bc1-3956f0cc6888"}, {"server_uuid": "b2078942-c5e1-4e12-ac29-43ac324a16cb", "name": "network-vif-plugged", "status": "completed", "tag": "7facb23f-c28c-4ba5-9f3c-7cd9052ba92a"}, {"server_uuid": "238cb283-0037-440c-a433-d3f4e3de1274", "name": "network-vif-unplugged", "status": "completed", "tag": "4bf2b6ee-be9c-4a4f-8dd2-4adfb41f8692"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:18.199330 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-92c0692f-b9b1-4416-b148-4e249ca33dba req-47ff49fc-309a-4e2b-8df9-8c6ba9bb30b4 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:18.200904 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-92c0692f-b9b1-4416-b148-4e249ca33dba req-47ff49fc-309a-4e2b-8df9-8c6ba9bb30b4 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:18.202824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-92c0692f-b9b1-4416-b148-4e249ca33dba req-47ff49fc-309a-4e2b-8df9-8c6ba9bb30b4 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:18.235271 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-92c0692f-b9b1-4416-b148-4e249ca33dba req-47ff49fc-309a-4e2b-8df9-8c6ba9bb30b4 service nova] Creating event network-vif-unplugged:9c46603b-3e50-4dfd-a7a6-bd1e37bb11c3 for instance 238cb283-0037-440c-a433-d3f4e3de1274 on n-h2-851359-3 Aug 04 17:05:18.238349 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-92c0692f-b9b1-4416-b148-4e249ca33dba req-47ff49fc-309a-4e2b-8df9-8c6ba9bb30b4 service nova] Creating event network-vif-unplugged:3814bb20-52c5-4223-9bc1-3956f0cc6888 for instance 238cb283-0037-440c-a433-d3f4e3de1274 on n-h2-851359-3 Aug 04 17:05:18.239801 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-92c0692f-b9b1-4416-b148-4e249ca33dba req-47ff49fc-309a-4e2b-8df9-8c6ba9bb30b4 service nova] Creating event network-vif-plugged:7facb23f-c28c-4ba5-9f3c-7cd9052ba92a for instance b2078942-c5e1-4e12-ac29-43ac324a16cb on n-h1-851359-3 Aug 04 17:05:18.240783 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-92c0692f-b9b1-4416-b148-4e249ca33dba req-47ff49fc-309a-4e2b-8df9-8c6ba9bb30b4 service nova] Creating event network-vif-unplugged:4bf2b6ee-be9c-4a4f-8dd2-4adfb41f8692 for instance 238cb283-0037-440c-a433-d3f4e3de1274 on n-h2-851359-3 Aug 04 17:05:18.265368 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-92c0692f-b9b1-4416-b148-4e249ca33dba req-47ff49fc-309a-4e2b-8df9-8c6ba9bb30b4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 702 microversion: 2.1 time: 0.125992 Aug 04 17:05:18.269107 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1300/2673] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 702 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:18.283959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d641f77d-0407-4cc5-9d3e-5a107775b93d tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] Action: 'create', calling method: .version_select at 0x7f1e5bfa84c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1205304519", "description": "tempest-description-1880392394"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:18.325275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-5ce56bb9-7429-4e7b-bef8-a75b12f071d1 req-7cd0ed63-58e6-4689-950e-96ddd2361d56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "238cb283-0037-440c-a433-d3f4e3de1274", "name": "network-vif-deleted", "tag": "9c46603b-3e50-4dfd-a7a6-bd1e37bb11c3"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:18.346162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-5ce56bb9-7429-4e7b-bef8-a75b12f071d1 req-7cd0ed63-58e6-4689-950e-96ddd2361d56 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:18.347679 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-5ce56bb9-7429-4e7b-bef8-a75b12f071d1 req-7cd0ed63-58e6-4689-950e-96ddd2361d56 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:18.350547 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-5ce56bb9-7429-4e7b-bef8-a75b12f071d1 req-7cd0ed63-58e6-4689-950e-96ddd2361d56 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:18.378475 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-5ce56bb9-7429-4e7b-bef8-a75b12f071d1 req-7cd0ed63-58e6-4689-950e-96ddd2361d56 service nova] Creating event network-vif-deleted:9c46603b-3e50-4dfd-a7a6-bd1e37bb11c3 for instance 238cb283-0037-440c-a433-d3f4e3de1274 on n-h2-851359-3 Aug 04 17:05:18.391488 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-5ce56bb9-7429-4e7b-bef8-a75b12f071d1 req-7cd0ed63-58e6-4689-950e-96ddd2361d56 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.376286 Aug 04 17:05:18.394202 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1374/2674] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:18.409477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e22d2794-c09d-4b32-952c-917034c9cd3d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:18.412865 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e22d2794-c09d-4b32-952c-917034c9cd3d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: b2078942-c5e1-4e12-ac29-43ac324a16cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:18.428648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e22d2794-c09d-4b32-952c-917034c9cd3d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:18.429538 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e22d2794-c09d-4b32-952c-917034c9cd3d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:18.430222 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e22d2794-c09d-4b32-952c-917034c9cd3d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:18.431291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e22d2794-c09d-4b32-952c-917034c9cd3d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:18.432691 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e22d2794-c09d-4b32-952c-917034c9cd3d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:18.448512 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e22d2794-c09d-4b32-952c-917034c9cd3d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:18.529964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e22d2794-c09d-4b32-952c-917034c9cd3d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: b2078942-c5e1-4e12-ac29-43ac324a16cb] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:05:18.621483 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d641f77d-0407-4cc5-9d3e-5a107775b93d tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.349801 Aug 04 17:05:18.622303 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1301/2675] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Aug 4 17:05:18 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:18.627815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c39e04c3-48f4-4e10-9da2-97681e28f5f8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Action: 'create', calling method: .version_select at 0x7f1e5b6dd280>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-769900565", "policies": ["affinity"]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:18.685331 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.compute.api [None req-e22d2794-c09d-4b32-952c-917034c9cd3d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: b2078942-c5e1-4e12-ac29-43ac324a16cb] Instance is already in deleting state, ignoring this request Aug 04 17:05:18.690895 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e22d2794-c09d-4b32-952c-917034c9cd3d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb" status: 204 len: 0 microversion: 2.1 time: 0.293082 Aug 04 17:05:18.691731 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1375/2676] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:05:18 2022] DELETE /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:05:18.693253 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-c39e04c3-48f4-4e10-9da2-97681e28f5f8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for project de328615cef94528b55b8309dd9b82b0. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:05:18.704831 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7192ef69-305b-4d2d-b867-b7f6a15473c5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:18.706990 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7192ef69-305b-4d2d-b867-b7f6a15473c5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:18.722003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-c39e04c3-48f4-4e10-9da2-97681e28f5f8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for user abad886e45bd4c4b8f5f0f86c45eb068 and project de328615cef94528b55b8309dd9b82b0. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:05:18.722650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7192ef69-305b-4d2d-b867-b7f6a15473c5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:18.723485 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7192ef69-305b-4d2d-b867-b7f6a15473c5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:18.727407 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7192ef69-305b-4d2d-b867-b7f6a15473c5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:18.728378 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7192ef69-305b-4d2d-b867-b7f6a15473c5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:18.729014 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7192ef69-305b-4d2d-b867-b7f6a15473c5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:18.729595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7192ef69-305b-4d2d-b867-b7f6a15473c5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:18.870182 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-c39e04c3-48f4-4e10-9da2-97681e28f5f8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for project de328615cef94528b55b8309dd9b82b0. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:05:18.878408 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-c39e04c3-48f4-4e10-9da2-97681e28f5f8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for user abad886e45bd4c4b8f5f0f86c45eb068 and project de328615cef94528b55b8309dd9b82b0. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:05:18.898941 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c39e04c3-48f4-4e10-9da2-97681e28f5f8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.273892 Aug 04 17:05:18.912292 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1302/2677] 10.222.0.93 () {60 vars in 1174 bytes} [Thu Aug 4 17:05:18 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:18.928955 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-92125ff8-e897-406c-8e82-63bf8cc41e63 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] Action: 'create', calling method: .version_select at 0x7f1e5b6dd9d0>, body: {"security_group_rule": {"parent_group_id": "ff02712a-9bdf-477c-b745-40f4f07f53ee", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "d7ff6779-9d34-43d5-8934-e8bf01cf6475"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:19.269812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7192ef69-305b-4d2d-b867-b7f6a15473c5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:19.286854 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7192ef69-305b-4d2d-b867-b7f6a15473c5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:19.288907 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7192ef69-305b-4d2d-b867-b7f6a15473c5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:19.290732 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7192ef69-305b-4d2d-b867-b7f6a15473c5 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 2748 microversion: 2.32 time: 0.595073 Aug 04 17:05:19.291477 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1376/2678] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:05:18 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 2748 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:05:19.296257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8504d9f0-f0b4-404b-8798-2735f141cc39 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:19.300998 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8504d9f0-f0b4-404b-8798-2735f141cc39 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: b2078942-c5e1-4e12-ac29-43ac324a16cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:19.323029 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8504d9f0-f0b4-404b-8798-2735f141cc39 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:19.324309 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8504d9f0-f0b4-404b-8798-2735f141cc39 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:19.325201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8504d9f0-f0b4-404b-8798-2735f141cc39 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:19.326951 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8504d9f0-f0b4-404b-8798-2735f141cc39 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:19.328585 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8504d9f0-f0b4-404b-8798-2735f141cc39 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:19.329651 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8504d9f0-f0b4-404b-8798-2735f141cc39 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:19.871914 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8504d9f0-f0b4-404b-8798-2735f141cc39 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:19.884417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:19.895161 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8504d9f0-f0b4-404b-8798-2735f141cc39 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb" status: 200 len: 1494 microversion: 2.1 time: 0.602188 Aug 04 17:05:19.895753 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1377/2679] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:19 2022] GET /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb => generated 1494 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:19.904713 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6d9521f9-e9f0-4e48-baa7-5de4d5b2ba31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2045941238", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "2e210599-cdc6-4676-8885-f80832369267"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:20.012371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-6d9521f9-e9f0-4e48-baa7-5de4d5b2ba31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] validate_networks() for None {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:05:20.108379 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-92125ff8-e897-406c-8e82-63bf8cc41e63 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.194636 Aug 04 17:05:20.109845 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1303/2680] 10.222.0.93 () {60 vars in 1195 bytes} [Thu Aug 4 17:05:18 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:20.123048 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-60cef359-a01a-477c-b7b3-96df20f68337 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] Action: 'create', calling method: .version_select at 0x7f1e5b9a6e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1241814755", "description": "tempest-description-698646838"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:20.749939 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-6d9521f9-e9f0-4e48-baa7-5de4d5b2ba31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:05:20.752146 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-6d9521f9-e9f0-4e48-baa7-5de4d5b2ba31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:05:20.753180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-6d9521f9-e9f0-4e48-baa7-5de4d5b2ba31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:05:20.754675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-6d9521f9-e9f0-4e48-baa7-5de4d5b2ba31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:05:20.755271 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-6d9521f9-e9f0-4e48-baa7-5de4d5b2ba31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:05:20.782339 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-60cef359-a01a-477c-b7b3-96df20f68337 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.663082 Aug 04 17:05:20.784556 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1304/2681] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Aug 4 17:05:20 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:20.789728 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-11d23c68-6e9b-42d8-8472-9f5085ccc0ce tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:20.791563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-11d23c68-6e9b-42d8-8472-9f5085ccc0ce tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:20.832790 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11d23c68-6e9b-42d8-8472-9f5085ccc0ce tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:20.834045 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11d23c68-6e9b-42d8-8472-9f5085ccc0ce tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:20.834978 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11d23c68-6e9b-42d8-8472-9f5085ccc0ce tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:20.836393 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11d23c68-6e9b-42d8-8472-9f5085ccc0ce tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:20.837423 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11d23c68-6e9b-42d8-8472-9f5085ccc0ce tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:20.840248 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11d23c68-6e9b-42d8-8472-9f5085ccc0ce tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:20.841665 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d9521f9-e9f0-4e48-baa7-5de4d5b2ba31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:20.843228 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d9521f9-e9f0-4e48-baa7-5de4d5b2ba31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:20.844669 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d9521f9-e9f0-4e48-baa7-5de4d5b2ba31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:20.848345 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d9521f9-e9f0-4e48-baa7-5de4d5b2ba31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:20.849132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d9521f9-e9f0-4e48-baa7-5de4d5b2ba31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:20.850560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d9521f9-e9f0-4e48-baa7-5de4d5b2ba31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:20.891405 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-6d9521f9-e9f0-4e48-baa7-5de4d5b2ba31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for project de328615cef94528b55b8309dd9b82b0. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:05:20.898943 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-6d9521f9-e9f0-4e48-baa7-5de4d5b2ba31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for user abad886e45bd4c4b8f5f0f86c45eb068 and project de328615cef94528b55b8309dd9b82b0. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:05:20.922657 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6d9521f9-e9f0-4e48-baa7-5de4d5b2ba31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Going to run 2 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:05:20.925105 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6d9521f9-e9f0-4e48-baa7-5de4d5b2ba31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 2898397c-98e0-416d-b35d-18984c4730e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:05:21.009040 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-6d9521f9-e9f0-4e48-baa7-5de4d5b2ba31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=131043) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 04 17:05:21.068953 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-6d9521f9-e9f0-4e48-baa7-5de4d5b2ba31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for project de328615cef94528b55b8309dd9b82b0. Resources: {'server_group_members'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:05:21.079694 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-6d9521f9-e9f0-4e48-baa7-5de4d5b2ba31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for user abad886e45bd4c4b8f5f0f86c45eb068 and project de328615cef94528b55b8309dd9b82b0. Resources: {'server_group_members'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:05:21.205761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-6d9521f9-e9f0-4e48-baa7-5de4d5b2ba31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for project de328615cef94528b55b8309dd9b82b0. Resources: {'server_group_members'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:05:21.215928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-6d9521f9-e9f0-4e48-baa7-5de4d5b2ba31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for user abad886e45bd4c4b8f5f0f86c45eb068 and project de328615cef94528b55b8309dd9b82b0. Resources: {'server_group_members'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:05:21.264827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6d9521f9-e9f0-4e48-baa7-5de4d5b2ba31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 893dbe88-23f3-472b-a24f-67b4e8c18007] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=2898397c-98e0-416d-b35d-18984c4730e2,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:05:21.293965 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:21.391556 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-6d9521f9-e9f0-4e48-baa7-5de4d5b2ba31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for project de328615cef94528b55b8309dd9b82b0. Resources: {'server_group_members'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:05:21.406924 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-6d9521f9-e9f0-4e48-baa7-5de4d5b2ba31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for user abad886e45bd4c4b8f5f0f86c45eb068 and project de328615cef94528b55b8309dd9b82b0. Resources: {'server_group_members'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:05:21.519236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-6d9521f9-e9f0-4e48-baa7-5de4d5b2ba31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for project de328615cef94528b55b8309dd9b82b0. Resources: {'server_group_members'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:05:21.529130 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-6d9521f9-e9f0-4e48-baa7-5de4d5b2ba31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for user abad886e45bd4c4b8f5f0f86c45eb068 and project de328615cef94528b55b8309dd9b82b0. Resources: {'server_group_members'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:05:21.627728 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6d9521f9-e9f0-4e48-baa7-5de4d5b2ba31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.730354 Aug 04 17:05:21.628923 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1378/2682] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:05:19 2022] POST /compute/v2.1/servers => generated 32 bytes in 1732 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 04 17:05:21.644819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-17417c07-9391-4c65-a6a1-e7265f90c200 req-581f0b04-e16f-4571-8fc5-b9c7b7e7872d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "238cb283-0037-440c-a433-d3f4e3de1274", "name": "network-vif-deleted", "tag": "f4544258-5b29-4f5e-a138-6233282a67c2"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:21.692731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-17417c07-9391-4c65-a6a1-e7265f90c200 req-581f0b04-e16f-4571-8fc5-b9c7b7e7872d service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:21.699863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-17417c07-9391-4c65-a6a1-e7265f90c200 req-581f0b04-e16f-4571-8fc5-b9c7b7e7872d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:21.703504 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-17417c07-9391-4c65-a6a1-e7265f90c200 req-581f0b04-e16f-4571-8fc5-b9c7b7e7872d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:21.738740 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-17417c07-9391-4c65-a6a1-e7265f90c200 req-581f0b04-e16f-4571-8fc5-b9c7b7e7872d service nova] Creating event network-vif-deleted:f4544258-5b29-4f5e-a138-6233282a67c2 for instance 238cb283-0037-440c-a433-d3f4e3de1274 on n-h2-851359-3 Aug 04 17:05:21.754587 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-17417c07-9391-4c65-a6a1-e7265f90c200 req-581f0b04-e16f-4571-8fc5-b9c7b7e7872d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124188 Aug 04 17:05:21.755358 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1379/2683] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:21.774493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0e1a0258-9be6-4369-be41-67cdc12f88b4 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] Action: 'create', calling method: .version_select at 0x7f1e5b7ccd30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-753433281", "description": "tempest-description-262106861"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:22.508887 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-11d23c68-6e9b-42d8-8472-9f5085ccc0ce tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:22.523202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-11d23c68-6e9b-42d8-8472-9f5085ccc0ce tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:22.537853 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-11d23c68-6e9b-42d8-8472-9f5085ccc0ce tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:22.552249 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-11d23c68-6e9b-42d8-8472-9f5085ccc0ce tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 2656 microversion: 2.32 time: 1.766526 Aug 04 17:05:22.562948 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1305/2684] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:05:20 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 2656 bytes in 1777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:05:22.583927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e0ad2f3b-217b-428e-afb0-308a77ca7e14 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-878715441", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "d65b592e-31d6-4f49-a3cc-553890bcc681"}, {"uuid": "59d6860f-d6d6-4a36-a39b-ffc45f681173"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:22.726560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-e0ad2f3b-217b-428e-afb0-308a77ca7e14 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] validate_networks() for [('d65b592e-31d6-4f49-a3cc-553890bcc681', None, None, None, None, None), ('59d6860f-d6d6-4a36-a39b-ffc45f681173', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:05:22.780528 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0e1a0258-9be6-4369-be41-67cdc12f88b4 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.023790 Aug 04 17:05:22.781686 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1380/2685] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Aug 4 17:05:21 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:22.799051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dc09d755-ce29-429c-8374-8e3e3908915d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:22.800050 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dc09d755-ce29-429c-8374-8e3e3908915d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: b2078942-c5e1-4e12-ac29-43ac324a16cb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:22.819616 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc09d755-ce29-429c-8374-8e3e3908915d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:22.820893 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc09d755-ce29-429c-8374-8e3e3908915d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:22.823091 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc09d755-ce29-429c-8374-8e3e3908915d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:22.825622 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc09d755-ce29-429c-8374-8e3e3908915d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:22.827625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc09d755-ce29-429c-8374-8e3e3908915d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:22.838021 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc09d755-ce29-429c-8374-8e3e3908915d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:22.954506 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc09d755-ce29-429c-8374-8e3e3908915d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:22.956695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc09d755-ce29-429c-8374-8e3e3908915d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:22.958223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc09d755-ce29-429c-8374-8e3e3908915d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:22.962729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-dc09d755-ce29-429c-8374-8e3e3908915d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lazy-loading 'fault' on Instance uuid b2078942-c5e1-4e12-ac29-43ac324a16cb {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:05:23.343729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dc09d755-ce29-429c-8374-8e3e3908915d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157e8ca7c2494f3ea5c468dc37f55858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86d8604ab1934bdeacd1bb6073ae153a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:23.355323 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dc09d755-ce29-429c-8374-8e3e3908915d tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb" status: 200 len: 1298 microversion: 2.1 time: 0.562904 Aug 04 17:05:23.358934 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1381/2686] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:22 2022] GET /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb => generated 1298 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:23.372475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-840c2993-f7c9-4c29-9da3-7b1245e6c19c req-b8632b63-bc46-474a-ab8e-dd7be8e683f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "238cb283-0037-440c-a433-d3f4e3de1274", "name": "network-vif-unplugged", "status": "completed", "tag": "f4544258-5b29-4f5e-a138-6233282a67c2"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:23.391908 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-840c2993-f7c9-4c29-9da3-7b1245e6c19c req-b8632b63-bc46-474a-ab8e-dd7be8e683f1 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:23.392754 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-840c2993-f7c9-4c29-9da3-7b1245e6c19c req-b8632b63-bc46-474a-ab8e-dd7be8e683f1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:23.399960 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-840c2993-f7c9-4c29-9da3-7b1245e6c19c req-b8632b63-bc46-474a-ab8e-dd7be8e683f1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:23.418953 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-840c2993-f7c9-4c29-9da3-7b1245e6c19c req-b8632b63-bc46-474a-ab8e-dd7be8e683f1 service nova] Creating event network-vif-unplugged:f4544258-5b29-4f5e-a138-6233282a67c2 for instance 238cb283-0037-440c-a433-d3f4e3de1274 on n-h2-851359-3 Aug 04 17:05:23.439081 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-840c2993-f7c9-4c29-9da3-7b1245e6c19c req-b8632b63-bc46-474a-ab8e-dd7be8e683f1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078579 Aug 04 17:05:23.440063 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1382/2687] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:23.445873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-53d46256-5863-4b86-978e-549ec7ec58a2 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:23.450723 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-53d46256-5863-4b86-978e-549ec7ec58a2 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:23.458388 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-53d46256-5863-4b86-978e-549ec7ec58a2 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Searching by: {'deleted': False, 'project_id': 'de328615cef94528b55b8309dd9b82b0'} {{(pid=131043) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:05:23.474569 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53d46256-5863-4b86-978e-549ec7ec58a2 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:23.475150 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53d46256-5863-4b86-978e-549ec7ec58a2 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:23.475701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53d46256-5863-4b86-978e-549ec7ec58a2 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:23.476586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53d46256-5863-4b86-978e-549ec7ec58a2 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:23.477157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53d46256-5863-4b86-978e-549ec7ec58a2 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:23.477692 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53d46256-5863-4b86-978e-549ec7ec58a2 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:23.561485 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.multi_cell_list [None req-53d46256-5863-4b86-978e-549ec7ec58a2 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:05:23.622865 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-53d46256-5863-4b86-978e-549ec7ec58a2 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.181225 Aug 04 17:05:23.625536 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1383/2688] 10.222.0.93 () {58 vars in 1125 bytes} [Thu Aug 4 17:05:23 2022] GET /compute/v2.1/servers => generated 1003 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:23.640128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-7fb2f1fd-2366-4c64-a53a-6131b6c5c714 req-a69b1b63-5fb4-4186-80ee-4c8a027812aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2078942-c5e1-4e12-ac29-43ac324a16cb", "name": "network-vif-deleted", "tag": "7facb23f-c28c-4ba5-9f3c-7cd9052ba92a"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:23.673474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7fb2f1fd-2366-4c64-a53a-6131b6c5c714 req-a69b1b63-5fb4-4186-80ee-4c8a027812aa service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:23.673997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7fb2f1fd-2366-4c64-a53a-6131b6c5c714 req-a69b1b63-5fb4-4186-80ee-4c8a027812aa service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:23.674447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7fb2f1fd-2366-4c64-a53a-6131b6c5c714 req-a69b1b63-5fb4-4186-80ee-4c8a027812aa service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:23.713117 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-7fb2f1fd-2366-4c64-a53a-6131b6c5c714 req-a69b1b63-5fb4-4186-80ee-4c8a027812aa service nova] Creating event network-vif-deleted:7facb23f-c28c-4ba5-9f3c-7cd9052ba92a for instance b2078942-c5e1-4e12-ac29-43ac324a16cb on n-h1-851359-3 Aug 04 17:05:23.735993 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-7fb2f1fd-2366-4c64-a53a-6131b6c5c714 req-a69b1b63-5fb4-4186-80ee-4c8a027812aa service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109110 Aug 04 17:05:23.743040 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1384/2689] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:23.755006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-16d856c7-ef06-4a7c-aabe-83e244ac629d tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] Action: 'create', calling method: .version_select at 0x7f1e5b00c820>, body: {"security_group_rule": {"parent_group_id": "3e066c3b-fa0d-44c0-a85c-4169b2e8bff2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "139399a4-d0fe-459c-aa1b-46c68012855e"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:25.354749 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-16d856c7-ef06-4a7c-aabe-83e244ac629d tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.609940 Aug 04 17:05:25.355426 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1385/2690] 10.222.0.93 () {60 vars in 1195 bytes} [Thu Aug 4 17:05:23 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:25.370057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b11b22b1-0249-4490-a277-ad00ee9809f8 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:25.371332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b11b22b1-0249-4490-a277-ad00ee9809f8 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:25.383308 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b11b22b1-0249-4490-a277-ad00ee9809f8 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:25.385961 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b11b22b1-0249-4490-a277-ad00ee9809f8 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:25.388085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b11b22b1-0249-4490-a277-ad00ee9809f8 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:25.389163 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b11b22b1-0249-4490-a277-ad00ee9809f8 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:25.392193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b11b22b1-0249-4490-a277-ad00ee9809f8 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:25.392835 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b11b22b1-0249-4490-a277-ad00ee9809f8 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:25.744965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e0ad2f3b-217b-428e-afb0-308a77ca7e14 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:05:25.746810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e0ad2f3b-217b-428e-afb0-308a77ca7e14 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:05:25.747516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e0ad2f3b-217b-428e-afb0-308a77ca7e14 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:05:25.748282 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e0ad2f3b-217b-428e-afb0-308a77ca7e14 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:05:25.748866 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e0ad2f3b-217b-428e-afb0-308a77ca7e14 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:05:25.771337 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0ad2f3b-217b-428e-afb0-308a77ca7e14 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:25.772157 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0ad2f3b-217b-428e-afb0-308a77ca7e14 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:25.772839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0ad2f3b-217b-428e-afb0-308a77ca7e14 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:25.773856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0ad2f3b-217b-428e-afb0-308a77ca7e14 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:25.775341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0ad2f3b-217b-428e-afb0-308a77ca7e14 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:25.776090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0ad2f3b-217b-428e-afb0-308a77ca7e14 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:25.824098 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b11b22b1-0249-4490-a277-ad00ee9809f8 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:25.840638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b11b22b1-0249-4490-a277-ad00ee9809f8 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:25.842196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b11b22b1-0249-4490-a277-ad00ee9809f8 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:25.844336 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e0ad2f3b-217b-428e-afb0-308a77ca7e14 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Getting quotas for project 12dc616249934210aab2670a55053ecc. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:05:25.851796 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b11b22b1-0249-4490-a277-ad00ee9809f8 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 2497 microversion: 2.32 time: 0.494956 Aug 04 17:05:25.852620 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1386/2691] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:05:25 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 2497 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:05:25.870203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4203ef5c-88d1-4cb6-b247-673481696262 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:25.871227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4203ef5c-88d1-4cb6-b247-673481696262 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 893dbe88-23f3-472b-a24f-67b4e8c18007] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:25.875099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e0ad2f3b-217b-428e-afb0-308a77ca7e14 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Getting quotas for user 234245a6fb7c441aa667a4ad619c1986 and project 12dc616249934210aab2670a55053ecc. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:05:25.882124 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4203ef5c-88d1-4cb6-b247-673481696262 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:25.888744 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4203ef5c-88d1-4cb6-b247-673481696262 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:25.889340 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4203ef5c-88d1-4cb6-b247-673481696262 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:25.890400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4203ef5c-88d1-4cb6-b247-673481696262 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:25.891216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4203ef5c-88d1-4cb6-b247-673481696262 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:25.891811 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4203ef5c-88d1-4cb6-b247-673481696262 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:25.902731 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e0ad2f3b-217b-428e-afb0-308a77ca7e14 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:05:25.964521 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e0ad2f3b-217b-428e-afb0-308a77ca7e14 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: 90fd978f-f119-4293-b43e-2b0cf3aff18c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:05:26.070121 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e0ad2f3b-217b-428e-afb0-308a77ca7e14 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.498955 Aug 04 17:05:26.072394 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1306/2692] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:05:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 3506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:05:26.087999 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-00cf5bd2-cdc2-47c4-82c5-8e262d13bf4a req-21d19f77-c044-4e15-b20b-bdbfc038ce6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "238cb283-0037-440c-a433-d3f4e3de1274", "name": "network-vif-deleted", "tag": "4bf2b6ee-be9c-4a4f-8dd2-4adfb41f8692"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:26.116437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-00cf5bd2-cdc2-47c4-82c5-8e262d13bf4a req-21d19f77-c044-4e15-b20b-bdbfc038ce6c service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:26.119885 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-00cf5bd2-cdc2-47c4-82c5-8e262d13bf4a req-21d19f77-c044-4e15-b20b-bdbfc038ce6c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:26.122178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-00cf5bd2-cdc2-47c4-82c5-8e262d13bf4a req-21d19f77-c044-4e15-b20b-bdbfc038ce6c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:26.169546 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-00cf5bd2-cdc2-47c4-82c5-8e262d13bf4a req-21d19f77-c044-4e15-b20b-bdbfc038ce6c service nova] Creating event network-vif-deleted:4bf2b6ee-be9c-4a4f-8dd2-4adfb41f8692 for instance 238cb283-0037-440c-a433-d3f4e3de1274 on n-h2-851359-3 Aug 04 17:05:26.201035 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-00cf5bd2-cdc2-47c4-82c5-8e262d13bf4a req-21d19f77-c044-4e15-b20b-bdbfc038ce6c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125213 Aug 04 17:05:26.203219 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1307/2693] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:26.221094 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-49b75dff-698e-441f-bc86-f3b6e805141c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:26.224846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-49b75dff-698e-441f-bc86-f3b6e805141c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: b2078942-c5e1-4e12-ac29-43ac324a16cb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:26.252578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49b75dff-698e-441f-bc86-f3b6e805141c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:26.255851 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49b75dff-698e-441f-bc86-f3b6e805141c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:26.259161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49b75dff-698e-441f-bc86-f3b6e805141c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:26.260076 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49b75dff-698e-441f-bc86-f3b6e805141c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:26.260710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49b75dff-698e-441f-bc86-f3b6e805141c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:26.264840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49b75dff-698e-441f-bc86-f3b6e805141c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:26.288149 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4203ef5c-88d1-4cb6-b247-673481696262 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:26.289085 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-49b75dff-698e-441f-bc86-f3b6e805141c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] HTTP exception thrown: Instance b2078942-c5e1-4e12-ac29-43ac324a16cb could not be found. Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-49b75dff-698e-441f-bc86-f3b6e805141c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Request method failure captured: Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb HTTP/1.1 Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_tUfF40yWb3YWSPuST_k75056eDJQSzLbaFJTlk0YU0jUj8ZFyyQdage4s2y--jxmqVBcnPhvgAKjc7jg9b2VNWICPCBCsPlvzmDPQYcaezG6cAVc6eitq6FjvvKsix5Opi_UtjCNda4BZmNIXaNDsAx3Rzl27pqJ6UlvsPp1f3y1I Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 86d8604ab1934bdeacd1bb6073ae153a Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesTestJSON-66576260 Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/86d8604ab1934bdeacd1bb6073ae153a"}]}] Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesTestJSON-66576260 Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 86d8604ab1934bdeacd1bb6073ae153a Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesTestJSON-66576260 Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ImagesTestJSON-66576260-project Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 157e8ca7c2494f3ea5c468dc37f55858 Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesTestJSON-66576260-project Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance b2078942-c5e1-4e12-ac29-43ac324a16cb could not be found. Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'b2078942-c5e1-4e12-ac29-43ac324a16cb'} Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2078942-c5e1-4e12-ac29-43ac324a16cb could not be found. Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2078942-c5e1-4e12-ac29-43ac324a16cb could not be found. Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:26.292778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:26.298092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:26.298092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:26.298092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:05:26.298092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:05:26.298092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2078942-c5e1-4e12-ac29-43ac324a16cb could not be found. Aug 04 17:05:26.298092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:26.301397 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-49b75dff-698e-441f-bc86-f3b6e805141c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Returning 404 to user: Instance b2078942-c5e1-4e12-ac29-43ac324a16cb could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:05:26.302841 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4203ef5c-88d1-4cb6-b247-673481696262 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/893dbe88-23f3-472b-a24f-67b4e8c18007" status: 200 len: 1277 microversion: 2.1 time: 0.448832 Aug 04 17:05:26.319838 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1387/2694] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:25 2022] GET /compute/v2.1/servers/893dbe88-23f3-472b-a24f-67b4e8c18007 => generated 1277 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:26.329319 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-49b75dff-698e-441f-bc86-f3b6e805141c tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb" status: 404 len: 111 microversion: 2.1 time: 0.094790 Aug 04 17:05:26.342075 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1308/2695] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:26 2022] GET /compute/v2.1/servers/b2078942-c5e1-4e12-ac29-43ac324a16cb => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:05:26.360916 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-415e78ba-75b4-4583-93e2-4e061fb39af5 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] Calling method '.version_select at 0x7f1e5b577670>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:26.652488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d1e58125-2f95-4123-97b8-4480ca25ec51 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-559258422", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "ad0d847a-dcbc-4a66-b070-8e9e3359e37a"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:26.754716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-d1e58125-2f95-4123-97b8-4480ca25ec51 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] validate_networks() for [('ad0d847a-dcbc-4a66-b070-8e9e3359e37a', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:05:28.110051 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-415e78ba-75b4-4583-93e2-4e061fb39af5 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/139399a4-d0fe-459c-aa1b-46c68012855e" status: 202 len: 0 microversion: 2.1 time: 1.764955 Aug 04 17:05:28.112223 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1309/2696] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 17:05:26 2022] DELETE /compute/v2.1/os-security-groups/139399a4-d0fe-459c-aa1b-46c68012855e => generated 0 bytes in 1767 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:05:28.123932 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a5e9b6a6-b83c-4c46-8dce-ef0ef915e6a4 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:28.127280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a5e9b6a6-b83c-4c46-8dce-ef0ef915e6a4 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: 90fd978f-f119-4293-b43e-2b0cf3aff18c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:28.165611 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5e9b6a6-b83c-4c46-8dce-ef0ef915e6a4 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:28.166904 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5e9b6a6-b83c-4c46-8dce-ef0ef915e6a4 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:28.169612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5e9b6a6-b83c-4c46-8dce-ef0ef915e6a4 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:28.170955 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5e9b6a6-b83c-4c46-8dce-ef0ef915e6a4 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:28.174011 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5e9b6a6-b83c-4c46-8dce-ef0ef915e6a4 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:28.174646 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5e9b6a6-b83c-4c46-8dce-ef0ef915e6a4 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:28.262625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-d1e58125-2f95-4123-97b8-4480ca25ec51 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:05:28.263897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-d1e58125-2f95-4123-97b8-4480ca25ec51 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:05:28.264649 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-d1e58125-2f95-4123-97b8-4480ca25ec51 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:05:28.267142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-d1e58125-2f95-4123-97b8-4480ca25ec51 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:05:28.267850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-d1e58125-2f95-4123-97b8-4480ca25ec51 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:05:28.281732 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1e58125-2f95-4123-97b8-4480ca25ec51 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:28.283970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1e58125-2f95-4123-97b8-4480ca25ec51 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:28.290999 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a5e9b6a6-b83c-4c46-8dce-ef0ef915e6a4 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:28.294966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1e58125-2f95-4123-97b8-4480ca25ec51 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:28.300122 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1e58125-2f95-4123-97b8-4480ca25ec51 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:28.303864 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1e58125-2f95-4123-97b8-4480ca25ec51 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:28.304877 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1e58125-2f95-4123-97b8-4480ca25ec51 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:28.309591 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a5e9b6a6-b83c-4c46-8dce-ef0ef915e6a4 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c" status: 200 len: 1270 microversion: 2.1 time: 0.195216 Aug 04 17:05:28.311184 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1310/2697] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:28 2022] GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c => generated 1270 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:28.321011 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1aad5b04-d0e3-41fa-a273-3848ae7ce5c4 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5b389d30>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:28.356662 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-1aad5b04-d0e3-41fa-a273-3848ae7ce5c4 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] HTTP exception thrown: Image not found. Aug 04 17:05:28.356857 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-d1e58125-2f95-4123-97b8-4480ca25ec51 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Getting quotas for project 10c6052c3eaf4a11a415839aff00e71f. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1aad5b04-d0e3-41fa-a273-3848ae7ce5c4 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Request method failure captured: Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b HTTP/1.1 Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_tUfF40yWb3YWSPuST_k75056eDJQSzLbaFJTlk0YU0jUj8ZFyyQdage4s2y--jxmqVBcnPhvgAKjc7jg9b2VNWICPCBCsPlvzmDPQYcaezG6cAVc6eitq6FjvvKsix5Opi_UtjCNda4BZmNIXaNDsAx3Rzl27pqJ6UlvsPp1f3y1I Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 86d8604ab1934bdeacd1bb6073ae153a Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesTestJSON-66576260 Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/86d8604ab1934bdeacd1bb6073ae153a"}]}] Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesTestJSON-66576260 Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 86d8604ab1934bdeacd1bb6073ae153a Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesTestJSON-66576260 Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ImagesTestJSON-66576260-project Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 157e8ca7c2494f3ea5c468dc37f55858 Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesTestJSON-66576260-project Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: exception: Image not found. Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '291b9087-1372-4cf5-9e50-5a867aeed46b'} Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 291b9087-1372-4cf5-9e50-5a867aeed46b to delete Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 291b9087-1372-4cf5-9e50-5a867aeed46b could not be found. Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:28.360875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:28.364870 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:28.364870 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:28.364870 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:05:28.364870 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:05:28.364870 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:05:28.364870 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:05:28.364870 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:05:28.364870 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:05:28.364870 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 17:05:28.364870 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 17:05:28.364870 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 17:05:28.364870 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:28.364870 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:28.364870 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:28.364870 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:28.364870 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:28.364870 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:28.364870 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:05:28.364870 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:05:28.364870 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 17:05:28.364870 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:28.366789 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-d1e58125-2f95-4123-97b8-4480ca25ec51 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Getting quotas for user 285bbd96190545c98a5cbaa2a01e3610 and project 10c6052c3eaf4a11a415839aff00e71f. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:05:28.372924 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1aad5b04-d0e3-41fa-a273-3848ae7ce5c4 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Returning 404 to user: Image not found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:05:28.375159 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1aad5b04-d0e3-41fa-a273-3848ae7ce5c4 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "DELETE /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b" status: 404 len: 62 microversion: 2.1 time: 0.062488 Aug 04 17:05:28.387691 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1311/2698] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:28 2022] DELETE /compute/v2.1/images/291b9087-1372-4cf5-9e50-5a867aeed46b => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:05:28.397845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d1e58125-2f95-4123-97b8-4480ca25ec51 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:05:28.400224 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d1e58125-2f95-4123-97b8-4480ca25ec51 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] [instance: 91cdc465-4194-4de5-b82e-2d5382b4e779] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:05:28.400739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f01ab2f4-c1ff-4963-a976-2750937b0a75 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:28.401773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f01ab2f4-c1ff-4963-a976-2750937b0a75 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:28.423797 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f01ab2f4-c1ff-4963-a976-2750937b0a75 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:28.424439 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f01ab2f4-c1ff-4963-a976-2750937b0a75 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:28.425847 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f01ab2f4-c1ff-4963-a976-2750937b0a75 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:28.426836 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f01ab2f4-c1ff-4963-a976-2750937b0a75 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:28.427545 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f01ab2f4-c1ff-4963-a976-2750937b0a75 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:28.428198 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f01ab2f4-c1ff-4963-a976-2750937b0a75 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:28.540417 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d1e58125-2f95-4123-97b8-4480ca25ec51 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.218045 Aug 04 17:05:28.541248 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1388/2699] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:05:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:05:28.555029 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bac591fb-97c7-48b1-8321-2843504e7098 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:28.564688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bac591fb-97c7-48b1-8321-2843504e7098 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 893dbe88-23f3-472b-a24f-67b4e8c18007] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:28.586142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bac591fb-97c7-48b1-8321-2843504e7098 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:28.586703 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bac591fb-97c7-48b1-8321-2843504e7098 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:28.587166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bac591fb-97c7-48b1-8321-2843504e7098 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:28.587906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bac591fb-97c7-48b1-8321-2843504e7098 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:28.588381 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bac591fb-97c7-48b1-8321-2843504e7098 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:28.588818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bac591fb-97c7-48b1-8321-2843504e7098 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:28.895356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f01ab2f4-c1ff-4963-a976-2750937b0a75 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:28.913545 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f01ab2f4-c1ff-4963-a976-2750937b0a75 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:28.942257 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f01ab2f4-c1ff-4963-a976-2750937b0a75 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:28.951725 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f01ab2f4-c1ff-4963-a976-2750937b0a75 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 2317 microversion: 2.32 time: 0.561035 Aug 04 17:05:28.958101 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1312/2700] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:05:28 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 2317 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:05:28.971969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b6c6ff8f-d58b-4c99-84ed-2e1ac276b492 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] Calling method '.version_select at 0x7f1e5bfa88b0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:29.782447 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b6c6ff8f-d58b-4c99-84ed-2e1ac276b492 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups/3e066c3b-fa0d-44c0-a85c-4169b2e8bff2" status: 200 len: 247 microversion: 2.1 time: 0.822067 Aug 04 17:05:29.784181 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1313/2701] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Aug 4 17:05:28 2022] GET /compute/v2.1/os-security-groups/3e066c3b-fa0d-44c0-a85c-4169b2e8bff2 => generated 247 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:29.789008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b4437c29-8f43-4cdf-b992-688ceb9913f3 req-8e9e0f1b-3102-4d58-8002-4e0aa59675a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "238cb283-0037-440c-a433-d3f4e3de1274", "name": "network-vif-deleted", "tag": "b3ffb765-1857-45ce-9f08-b2a94e4fdef2"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:29.814129 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b4437c29-8f43-4cdf-b992-688ceb9913f3 req-8e9e0f1b-3102-4d58-8002-4e0aa59675a8 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:29.815113 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b4437c29-8f43-4cdf-b992-688ceb9913f3 req-8e9e0f1b-3102-4d58-8002-4e0aa59675a8 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:29.815714 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b4437c29-8f43-4cdf-b992-688ceb9913f3 req-8e9e0f1b-3102-4d58-8002-4e0aa59675a8 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:29.841189 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b4437c29-8f43-4cdf-b992-688ceb9913f3 req-8e9e0f1b-3102-4d58-8002-4e0aa59675a8 service nova] Creating event network-vif-deleted:b3ffb765-1857-45ce-9f08-b2a94e4fdef2 for instance 238cb283-0037-440c-a433-d3f4e3de1274 on n-h2-851359-3 Aug 04 17:05:29.858131 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b4437c29-8f43-4cdf-b992-688ceb9913f3 req-8e9e0f1b-3102-4d58-8002-4e0aa59675a8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070348 Aug 04 17:05:29.859102 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1314/2702] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:29.871184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-829dcc32-a066-42d9-81a7-4624cfc77997 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:29.872030 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-829dcc32-a066-42d9-81a7-4624cfc77997 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 30e66be0-1c2b-401d-8e17-1271b1910f4a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:29.884045 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:29.889204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-829dcc32-a066-42d9-81a7-4624cfc77997 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:29.890559 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-829dcc32-a066-42d9-81a7-4624cfc77997 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:29.894674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-829dcc32-a066-42d9-81a7-4624cfc77997 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:29.895617 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-829dcc32-a066-42d9-81a7-4624cfc77997 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:29.896256 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-829dcc32-a066-42d9-81a7-4624cfc77997 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:29.896919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-829dcc32-a066-42d9-81a7-4624cfc77997 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:29.945857 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-829dcc32-a066-42d9-81a7-4624cfc77997 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] HTTP exception thrown: Instance 30e66be0-1c2b-401d-8e17-1271b1910f4a could not be found. Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-829dcc32-a066-42d9-81a7-4624cfc77997 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Request method failure captured: Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a HTTP/1.1 Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_tUfF40yWb3YWSPuST_k75056eDJQSzLbaFJTlk0YU0jUj8ZFyyQdage4s2y--jxmqVBcnPhvgAKjc7jg9b2VNWICPCBCsPlvzmDPQYcaezG6cAVc6eitq6FjvvKsix5Opi_UtjCNda4BZmNIXaNDsAx3Rzl27pqJ6UlvsPp1f3y1I Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 86d8604ab1934bdeacd1bb6073ae153a Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesTestJSON-66576260 Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/86d8604ab1934bdeacd1bb6073ae153a"}]}] Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesTestJSON-66576260 Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 86d8604ab1934bdeacd1bb6073ae153a Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesTestJSON-66576260 Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ImagesTestJSON-66576260-project Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 157e8ca7c2494f3ea5c468dc37f55858 Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesTestJSON-66576260-project Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 30e66be0-1c2b-401d-8e17-1271b1910f4a could not be found. Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '30e66be0-1c2b-401d-8e17-1271b1910f4a'} Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30e66be0-1c2b-401d-8e17-1271b1910f4a could not be found. Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:05:29.947888 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30e66be0-1c2b-401d-8e17-1271b1910f4a could not be found. Aug 04 17:05:29.952891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:29.952891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:29.952891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:29.952891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:29.952891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:29.952891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:29.952891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:05:29.952891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:05:29.952891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30e66be0-1c2b-401d-8e17-1271b1910f4a could not be found. Aug 04 17:05:29.952891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:29.956149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-829dcc32-a066-42d9-81a7-4624cfc77997 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Returning 404 to user: Instance 30e66be0-1c2b-401d-8e17-1271b1910f4a could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:05:29.957771 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bac591fb-97c7-48b1-8321-2843504e7098 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:29.959220 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-829dcc32-a066-42d9-81a7-4624cfc77997 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "DELETE /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a" status: 404 len: 111 microversion: 2.1 time: 0.098831 Aug 04 17:05:29.961631 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1315/2703] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:05:29 2022] DELETE /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:05:29.966378 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bac591fb-97c7-48b1-8321-2843504e7098 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/893dbe88-23f3-472b-a24f-67b4e8c18007" status: 200 len: 1319 microversion: 2.1 time: 1.424026 Aug 04 17:05:29.977186 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9639f934-2f9b-4cfb-9ec5-3efe2b5f1c49 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:29.977405 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1389/2704] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:28 2022] GET /compute/v2.1/servers/893dbe88-23f3-472b-a24f-67b4e8c18007 => generated 1319 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:29.978824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9639f934-2f9b-4cfb-9ec5-3efe2b5f1c49 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] [instance: 91cdc465-4194-4de5-b82e-2d5382b4e779] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:29.995962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-19aff9a6-ca04-40d7-8ed8-ee66862748f0 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:30.003000 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-19aff9a6-ca04-40d7-8ed8-ee66862748f0 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: 90fd978f-f119-4293-b43e-2b0cf3aff18c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:30.003970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9639f934-2f9b-4cfb-9ec5-3efe2b5f1c49 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:30.006477 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9639f934-2f9b-4cfb-9ec5-3efe2b5f1c49 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:30.007204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9639f934-2f9b-4cfb-9ec5-3efe2b5f1c49 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:30.011473 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9639f934-2f9b-4cfb-9ec5-3efe2b5f1c49 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:30.012574 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9639f934-2f9b-4cfb-9ec5-3efe2b5f1c49 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:30.013438 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9639f934-2f9b-4cfb-9ec5-3efe2b5f1c49 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:30.021423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19aff9a6-ca04-40d7-8ed8-ee66862748f0 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:30.021930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19aff9a6-ca04-40d7-8ed8-ee66862748f0 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:30.023372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19aff9a6-ca04-40d7-8ed8-ee66862748f0 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:30.026868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19aff9a6-ca04-40d7-8ed8-ee66862748f0 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:30.035597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19aff9a6-ca04-40d7-8ed8-ee66862748f0 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:30.042670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19aff9a6-ca04-40d7-8ed8-ee66862748f0 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:30.276132 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9639f934-2f9b-4cfb-9ec5-3efe2b5f1c49 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285bbd96190545c98a5cbaa2a01e3610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6052c3eaf4a11a415839aff00e71f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:30.285811 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9639f934-2f9b-4cfb-9ec5-3efe2b5f1c49 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] 10.222.0.93 "GET /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779" status: 200 len: 1275 microversion: 2.1 time: 0.321116 Aug 04 17:05:30.294321 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1316/2705] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:29 2022] GET /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779 => generated 1275 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:30.300009 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9a0107a8-a05c-4e54-8980-69e49076d9a1 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] Action: 'create', calling method: .version_select at 0x7f1e5b50ca60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-115416944", "description": "tempest-description-1276200610"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:30.318955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-19aff9a6-ca04-40d7-8ed8-ee66862748f0 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:30.335636 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-19aff9a6-ca04-40d7-8ed8-ee66862748f0 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c" status: 200 len: 1270 microversion: 2.1 time: 0.357205 Aug 04 17:05:30.344495 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1390/2706] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:29 2022] GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c => generated 1270 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:30.366676 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dbe5ae75-6772-4eab-9e30-1a393d72e9ce tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:30.370336 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dbe5ae75-6772-4eab-9e30-1a393d72e9ce tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 30e66be0-1c2b-401d-8e17-1271b1910f4a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:30.384914 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dbe5ae75-6772-4eab-9e30-1a393d72e9ce tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:30.386581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dbe5ae75-6772-4eab-9e30-1a393d72e9ce tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:30.388615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dbe5ae75-6772-4eab-9e30-1a393d72e9ce tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:30.392822 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dbe5ae75-6772-4eab-9e30-1a393d72e9ce tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:30.394304 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dbe5ae75-6772-4eab-9e30-1a393d72e9ce tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:30.397005 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dbe5ae75-6772-4eab-9e30-1a393d72e9ce tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:30.451562 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-dbe5ae75-6772-4eab-9e30-1a393d72e9ce tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] HTTP exception thrown: Instance 30e66be0-1c2b-401d-8e17-1271b1910f4a could not be found. Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dbe5ae75-6772-4eab-9e30-1a393d72e9ce tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Request method failure captured: Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a HTTP/1.1 Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_tUfF40yWb3YWSPuST_k75056eDJQSzLbaFJTlk0YU0jUj8ZFyyQdage4s2y--jxmqVBcnPhvgAKjc7jg9b2VNWICPCBCsPlvzmDPQYcaezG6cAVc6eitq6FjvvKsix5Opi_UtjCNda4BZmNIXaNDsAx3Rzl27pqJ6UlvsPp1f3y1I Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 86d8604ab1934bdeacd1bb6073ae153a Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ImagesTestJSON-66576260 Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/86d8604ab1934bdeacd1bb6073ae153a"}]}] Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ImagesTestJSON-66576260 Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 86d8604ab1934bdeacd1bb6073ae153a Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ImagesTestJSON-66576260 Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ImagesTestJSON-66576260-project Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 157e8ca7c2494f3ea5c468dc37f55858 Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ImagesTestJSON-66576260-project Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 30e66be0-1c2b-401d-8e17-1271b1910f4a could not be found. Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '30e66be0-1c2b-401d-8e17-1271b1910f4a'} Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30e66be0-1c2b-401d-8e17-1271b1910f4a could not be found. Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30e66be0-1c2b-401d-8e17-1271b1910f4a could not be found. Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:30.458057 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:30.462697 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:30.462697 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:30.462697 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:05:30.462697 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:05:30.462697 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30e66be0-1c2b-401d-8e17-1271b1910f4a could not be found. Aug 04 17:05:30.462697 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:30.462697 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dbe5ae75-6772-4eab-9e30-1a393d72e9ce tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Returning 404 to user: Instance 30e66be0-1c2b-401d-8e17-1271b1910f4a could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:05:30.463798 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dbe5ae75-6772-4eab-9e30-1a393d72e9ce tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a" status: 404 len: 111 microversion: 2.1 time: 0.113793 Aug 04 17:05:30.465934 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1391/2707] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:30 2022] GET /compute/v2.1/servers/30e66be0-1c2b-401d-8e17-1271b1910f4a => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:05:30.488930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f11fd513-0e4f-4fff-9352-8bcbd23a29b4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:30.491032 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f11fd513-0e4f-4fff-9352-8bcbd23a29b4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:30.509765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f11fd513-0e4f-4fff-9352-8bcbd23a29b4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:30.512136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f11fd513-0e4f-4fff-9352-8bcbd23a29b4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:30.515701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f11fd513-0e4f-4fff-9352-8bcbd23a29b4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:30.521219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f11fd513-0e4f-4fff-9352-8bcbd23a29b4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:30.523089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f11fd513-0e4f-4fff-9352-8bcbd23a29b4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:30.527099 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f11fd513-0e4f-4fff-9352-8bcbd23a29b4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:30.787597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f11fd513-0e4f-4fff-9352-8bcbd23a29b4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:30.807079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f11fd513-0e4f-4fff-9352-8bcbd23a29b4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:30.808774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f11fd513-0e4f-4fff-9352-8bcbd23a29b4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:30.815306 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f11fd513-0e4f-4fff-9352-8bcbd23a29b4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1605 microversion: 2.32 time: 0.347802 Aug 04 17:05:30.826167 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1392/2708] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:05:30 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1605 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:05:30.834506 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0d000c4f-5483-44c1-a633-6a7e5c98ce63 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5af55820>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:30.870612 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-0d000c4f-5483-44c1-a633-6a7e5c98ce63 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] HTTP exception thrown: Image not found. Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0d000c4f-5483-44c1-a633-6a7e5c98ce63 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Request method failure captured: Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e HTTP/1.1 Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_tUfF40yWb3YWSPuST_k75056eDJQSzLbaFJTlk0YU0jUj8ZFyyQdage4s2y--jxmqVBcnPhvgAKjc7jg9b2VNWICPCBCsPlvzmDPQYcaezG6cAVc6eitq6FjvvKsix5Opi_UtjCNda4BZmNIXaNDsAx3Rzl27pqJ6UlvsPp1f3y1I Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 86d8604ab1934bdeacd1bb6073ae153a Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ImagesTestJSON-66576260 Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/86d8604ab1934bdeacd1bb6073ae153a"}]}] Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ImagesTestJSON-66576260 Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 86d8604ab1934bdeacd1bb6073ae153a Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ImagesTestJSON-66576260 Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ImagesTestJSON-66576260-project Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 157e8ca7c2494f3ea5c468dc37f55858 Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ImagesTestJSON-66576260-project Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: exception: Image not found. Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e'} Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e to delete Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e could not be found. Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:30.879086 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:30.882906 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:30.882906 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:30.882906 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:05:30.882906 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:05:30.882906 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:05:30.882906 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:05:30.882906 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:05:30.882906 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:05:30.882906 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 17:05:30.882906 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 17:05:30.882906 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 17:05:30.882906 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:30.882906 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:30.882906 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:30.882906 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:30.882906 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:30.882906 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:30.882906 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:05:30.882906 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:05:30.882906 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 17:05:30.882906 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:30.884148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0d000c4f-5483-44c1-a633-6a7e5c98ce63 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Returning 404 to user: Image not found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:05:30.897662 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0d000c4f-5483-44c1-a633-6a7e5c98ce63 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "DELETE /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e" status: 404 len: 62 microversion: 2.1 time: 0.058703 Aug 04 17:05:30.904647 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1393/2709] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:30 2022] DELETE /compute/v2.1/images/7eb5a06f-da6f-46a2-b1d2-82eb1187cc2e => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:05:30.917526 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-28b44ef8-1052-47e9-9945-1207bbaf9253 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:30.918137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-28b44ef8-1052-47e9-9945-1207bbaf9253 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:30.937340 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28b44ef8-1052-47e9-9945-1207bbaf9253 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:30.939643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28b44ef8-1052-47e9-9945-1207bbaf9253 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:30.940225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28b44ef8-1052-47e9-9945-1207bbaf9253 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:30.946246 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28b44ef8-1052-47e9-9945-1207bbaf9253 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:30.947020 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28b44ef8-1052-47e9-9945-1207bbaf9253 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:30.947486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28b44ef8-1052-47e9-9945-1207bbaf9253 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:30.990002 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-28b44ef8-1052-47e9-9945-1207bbaf9253 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] HTTP exception thrown: Instance 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 could not be found. Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-28b44ef8-1052-47e9-9945-1207bbaf9253 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Request method failure captured: Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 HTTP/1.1 Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_tUfF40yWb3YWSPuST_k75056eDJQSzLbaFJTlk0YU0jUj8ZFyyQdage4s2y--jxmqVBcnPhvgAKjc7jg9b2VNWICPCBCsPlvzmDPQYcaezG6cAVc6eitq6FjvvKsix5Opi_UtjCNda4BZmNIXaNDsAx3Rzl27pqJ6UlvsPp1f3y1I Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 86d8604ab1934bdeacd1bb6073ae153a Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ImagesTestJSON-66576260 Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/86d8604ab1934bdeacd1bb6073ae153a"}]}] Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ImagesTestJSON-66576260 Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 86d8604ab1934bdeacd1bb6073ae153a Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ImagesTestJSON-66576260 Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ImagesTestJSON-66576260-project Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 157e8ca7c2494f3ea5c468dc37f55858 Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ImagesTestJSON-66576260-project Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 could not be found. Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99'} Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 could not be found. Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:05:30.992840 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 could not be found. Aug 04 17:05:30.996528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:30.996528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:30.996528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:30.996528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:30.996528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:30.996528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:30.996528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:05:30.996528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:05:30.996528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 could not be found. Aug 04 17:05:30.996528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:30.996528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-28b44ef8-1052-47e9-9945-1207bbaf9253 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Returning 404 to user: Instance 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:05:30.998997 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-28b44ef8-1052-47e9-9945-1207bbaf9253 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 404 len: 111 microversion: 2.1 time: 0.087878 Aug 04 17:05:31.000062 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1394/2710] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:05:30 2022] DELETE /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:05:31.025126 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a854ba50-6c58-450b-a5f8-7fe850c3a27d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:31.027360 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a854ba50-6c58-450b-a5f8-7fe850c3a27d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 893dbe88-23f3-472b-a24f-67b4e8c18007] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:31.045642 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a854ba50-6c58-450b-a5f8-7fe850c3a27d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:31.046725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a854ba50-6c58-450b-a5f8-7fe850c3a27d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:31.050043 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a854ba50-6c58-450b-a5f8-7fe850c3a27d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:31.050797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a854ba50-6c58-450b-a5f8-7fe850c3a27d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:31.051277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a854ba50-6c58-450b-a5f8-7fe850c3a27d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:31.051721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a854ba50-6c58-450b-a5f8-7fe850c3a27d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:31.121726 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9a0107a8-a05c-4e54-8980-69e49076d9a1 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.826012 Aug 04 17:05:31.122909 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1317/2711] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Aug 4 17:05:30 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:31.127902 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-beecf882-25a5-4870-b2ba-2c40c471c4c4 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:31.128807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-beecf882-25a5-4870-b2ba-2c40c471c4c4 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:31.151187 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-beecf882-25a5-4870-b2ba-2c40c471c4c4 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:31.151788 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-beecf882-25a5-4870-b2ba-2c40c471c4c4 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:31.152452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-beecf882-25a5-4870-b2ba-2c40c471c4c4 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:31.153176 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-beecf882-25a5-4870-b2ba-2c40c471c4c4 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:31.153641 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-beecf882-25a5-4870-b2ba-2c40c471c4c4 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:31.160106 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-beecf882-25a5-4870-b2ba-2c40c471c4c4 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:31.186197 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-beecf882-25a5-4870-b2ba-2c40c471c4c4 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] HTTP exception thrown: Instance 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 could not be found. Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-beecf882-25a5-4870-b2ba-2c40c471c4c4 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Request method failure captured: Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 HTTP/1.1 Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_tUfF40yWb3YWSPuST_k75056eDJQSzLbaFJTlk0YU0jUj8ZFyyQdage4s2y--jxmqVBcnPhvgAKjc7jg9b2VNWICPCBCsPlvzmDPQYcaezG6cAVc6eitq6FjvvKsix5Opi_UtjCNda4BZmNIXaNDsAx3Rzl27pqJ6UlvsPp1f3y1I Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 86d8604ab1934bdeacd1bb6073ae153a Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesTestJSON-66576260 Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/86d8604ab1934bdeacd1bb6073ae153a"}]}] Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesTestJSON-66576260 Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 86d8604ab1934bdeacd1bb6073ae153a Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesTestJSON-66576260 Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ImagesTestJSON-66576260-project Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 157e8ca7c2494f3ea5c468dc37f55858 Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesTestJSON-66576260-project Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 could not be found. Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99'} Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 could not be found. Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 could not be found. Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:31.192454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:31.196232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:31.196232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:31.196232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:05:31.196232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:05:31.196232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 could not be found. Aug 04 17:05:31.196232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:31.201345 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-beecf882-25a5-4870-b2ba-2c40c471c4c4 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Returning 404 to user: Instance 0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:05:31.203115 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-beecf882-25a5-4870-b2ba-2c40c471c4c4 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99" status: 404 len: 111 microversion: 2.1 time: 0.078374 Aug 04 17:05:31.204032 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1318/2712] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:31 2022] GET /compute/v2.1/servers/0ab86281-f3ce-4f2a-a4c0-36c2ae3d0b99 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:05:31.225272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-5f323902-b1ee-4a56-ad48-ba7d9b1f9bae req-cfed082e-a28f-4047-97db-2d872ddfeb15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2898397c-98e0-416d-b35d-18984c4730e2", "tag": "6402536c-3b47-40d1-9c06-8f761b813b94"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:31.256803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5f323902-b1ee-4a56-ad48-ba7d9b1f9bae req-cfed082e-a28f-4047-97db-2d872ddfeb15 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:31.262196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5f323902-b1ee-4a56-ad48-ba7d9b1f9bae req-cfed082e-a28f-4047-97db-2d872ddfeb15 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:31.263143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5f323902-b1ee-4a56-ad48-ba7d9b1f9bae req-cfed082e-a28f-4047-97db-2d872ddfeb15 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:31.297473 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-5f323902-b1ee-4a56-ad48-ba7d9b1f9bae req-cfed082e-a28f-4047-97db-2d872ddfeb15 service nova] Creating event network-changed:6402536c-3b47-40d1-9c06-8f761b813b94 for instance 2898397c-98e0-416d-b35d-18984c4730e2 on n-h2-851359-3 Aug 04 17:05:31.307296 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-5f323902-b1ee-4a56-ad48-ba7d9b1f9bae req-cfed082e-a28f-4047-97db-2d872ddfeb15 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101275 Aug 04 17:05:31.310472 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1319/2713] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:31.347583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-169effa6-eba1-4f39-92f5-6d08bcce718f tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] Action: 'create', calling method: .version_select at 0x7f1e5bfeb9d0>, body: {"security_group_rule": {"parent_group_id": "6438c1c5-6e6f-471d-85ec-74f68d3594a7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:32.108225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a854ba50-6c58-450b-a5f8-7fe850c3a27d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:32.118150 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a854ba50-6c58-450b-a5f8-7fe850c3a27d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/893dbe88-23f3-472b-a24f-67b4e8c18007" status: 200 len: 1319 microversion: 2.1 time: 1.111803 Aug 04 17:05:32.118743 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1395/2714] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:31 2022] GET /compute/v2.1/servers/893dbe88-23f3-472b-a24f-67b4e8c18007 => generated 1319 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:32.128705 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-016e60dd-3839-4241-9135-42ab2c9a0089 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '.version_select at 0x7f1e5b7cc430>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:32.172685 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-016e60dd-3839-4241-9135-42ab2c9a0089 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] HTTP exception thrown: Image not found. Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-016e60dd-3839-4241-9135-42ab2c9a0089 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Request method failure captured: Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee HTTP/1.1 Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_tUfF40yWb3YWSPuST_k75056eDJQSzLbaFJTlk0YU0jUj8ZFyyQdage4s2y--jxmqVBcnPhvgAKjc7jg9b2VNWICPCBCsPlvzmDPQYcaezG6cAVc6eitq6FjvvKsix5Opi_UtjCNda4BZmNIXaNDsAx3Rzl27pqJ6UlvsPp1f3y1I Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 86d8604ab1934bdeacd1bb6073ae153a Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ImagesTestJSON-66576260 Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/86d8604ab1934bdeacd1bb6073ae153a"}]}] Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ImagesTestJSON-66576260 Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 86d8604ab1934bdeacd1bb6073ae153a Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ImagesTestJSON-66576260 Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ImagesTestJSON-66576260-project Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 157e8ca7c2494f3ea5c468dc37f55858 Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ImagesTestJSON-66576260-project Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: exception: Image not found. Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '2e83f22c-59ec-4571-aecb-a692821ddcee'} Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2e83f22c-59ec-4571-aecb-a692821ddcee to delete Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2e83f22c-59ec-4571-aecb-a692821ddcee could not be found. Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:32.174492 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:32.178733 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:32.178733 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:32.178733 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:05:32.178733 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:05:32.178733 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:05:32.178733 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:05:32.178733 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:05:32.178733 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:05:32.178733 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 17:05:32.178733 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 17:05:32.178733 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 17:05:32.178733 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:32.178733 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:32.178733 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:32.178733 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:32.178733 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:32.178733 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:32.178733 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:05:32.178733 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:05:32.178733 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 17:05:32.178733 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:32.178733 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-016e60dd-3839-4241-9135-42ab2c9a0089 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Returning 404 to user: Image not found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:05:32.178733 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-016e60dd-3839-4241-9135-42ab2c9a0089 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "DELETE /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee" status: 404 len: 62 microversion: 2.1 time: 0.053653 Aug 04 17:05:32.178733 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1396/2715] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:32 2022] DELETE /compute/v2.1/images/2e83f22c-59ec-4571-aecb-a692821ddcee => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:05:32.181798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6d63c1fb-811e-4d49-8664-6c08de2e08a5 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:32.182449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6d63c1fb-811e-4d49-8664-6c08de2e08a5 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] [instance: 91cdc465-4194-4de5-b82e-2d5382b4e779] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:32.199551 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d63c1fb-811e-4d49-8664-6c08de2e08a5 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:32.202960 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d63c1fb-811e-4d49-8664-6c08de2e08a5 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:32.203637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d63c1fb-811e-4d49-8664-6c08de2e08a5 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:32.204548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d63c1fb-811e-4d49-8664-6c08de2e08a5 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:32.205178 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d63c1fb-811e-4d49-8664-6c08de2e08a5 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:32.206576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d63c1fb-811e-4d49-8664-6c08de2e08a5 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:32.513123 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6d63c1fb-811e-4d49-8664-6c08de2e08a5 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285bbd96190545c98a5cbaa2a01e3610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6052c3eaf4a11a415839aff00e71f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:32.529546 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6d63c1fb-811e-4d49-8664-6c08de2e08a5 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] 10.222.0.93 "GET /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779" status: 200 len: 1281 microversion: 2.1 time: 0.351012 Aug 04 17:05:32.530288 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1397/2716] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:32 2022] GET /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779 => generated 1281 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:32.537879 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b3b3ce7b-ddf9-49e5-8ffa-034df9a23bc1 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:32.543053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b3b3ce7b-ddf9-49e5-8ffa-034df9a23bc1 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: 90fd978f-f119-4293-b43e-2b0cf3aff18c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:32.562086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3b3ce7b-ddf9-49e5-8ffa-034df9a23bc1 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:32.571872 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3b3ce7b-ddf9-49e5-8ffa-034df9a23bc1 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:32.572601 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3b3ce7b-ddf9-49e5-8ffa-034df9a23bc1 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:32.573647 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3b3ce7b-ddf9-49e5-8ffa-034df9a23bc1 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:32.574294 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3b3ce7b-ddf9-49e5-8ffa-034df9a23bc1 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:32.579738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3b3ce7b-ddf9-49e5-8ffa-034df9a23bc1 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:33.004912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b3b3ce7b-ddf9-49e5-8ffa-034df9a23bc1 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:33.015007 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b3b3ce7b-ddf9-49e5-8ffa-034df9a23bc1 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c" status: 200 len: 1312 microversion: 2.1 time: 0.483354 Aug 04 17:05:33.030309 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1398/2717] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:32 2022] GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c => generated 1312 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:33.038062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-16e90a54-5773-4b21-8b76-018f2b1cfe89 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:33.038964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-16e90a54-5773-4b21-8b76-018f2b1cfe89 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:33.039149 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-169effa6-eba1-4f39-92f5-6d08bcce718f tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.696421 Aug 04 17:05:33.041801 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1320/2718] 10.222.0.93 () {60 vars in 1195 bytes} [Thu Aug 4 17:05:31 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:33.048255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0e097dae-e613-48fb-929e-6226f52a4215 req-86e839fd-4478-4127-a3ab-0dc0c101244d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "238cb283-0037-440c-a433-d3f4e3de1274", "name": "network-vif-deleted", "tag": "3814bb20-52c5-4223-9bc1-3956f0cc6888"}, {"name": "network-changed", "server_uuid": "893dbe88-23f3-472b-a24f-67b4e8c18007", "tag": "51b67061-276e-4d87-9e5b-0716997fda47"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:33.052370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16e90a54-5773-4b21-8b76-018f2b1cfe89 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:33.052370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16e90a54-5773-4b21-8b76-018f2b1cfe89 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:33.053663 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16e90a54-5773-4b21-8b76-018f2b1cfe89 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:33.055817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16e90a54-5773-4b21-8b76-018f2b1cfe89 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:33.056985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16e90a54-5773-4b21-8b76-018f2b1cfe89 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:33.058766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16e90a54-5773-4b21-8b76-018f2b1cfe89 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:33.067011 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0e097dae-e613-48fb-929e-6226f52a4215 req-86e839fd-4478-4127-a3ab-0dc0c101244d service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:33.067731 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0e097dae-e613-48fb-929e-6226f52a4215 req-86e839fd-4478-4127-a3ab-0dc0c101244d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:33.068353 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0e097dae-e613-48fb-929e-6226f52a4215 req-86e839fd-4478-4127-a3ab-0dc0c101244d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:33.081572 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0e097dae-e613-48fb-929e-6226f52a4215 req-86e839fd-4478-4127-a3ab-0dc0c101244d service nova] Creating event network-vif-deleted:3814bb20-52c5-4223-9bc1-3956f0cc6888 for instance 238cb283-0037-440c-a433-d3f4e3de1274 on n-h2-851359-3 Aug 04 17:05:33.082367 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0e097dae-e613-48fb-929e-6226f52a4215 req-86e839fd-4478-4127-a3ab-0dc0c101244d service nova] Creating event network-changed:51b67061-276e-4d87-9e5b-0716997fda47 for instance 893dbe88-23f3-472b-a24f-67b4e8c18007 on n-h2-851359-3 Aug 04 17:05:33.089053 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0e097dae-e613-48fb-929e-6226f52a4215 req-86e839fd-4478-4127-a3ab-0dc0c101244d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.045969 Aug 04 17:05:33.092164 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1321/2719] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:33.100617 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7c21a9db-5b5f-4e27-8709-4ab91f1f02e9 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:33.101560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7c21a9db-5b5f-4e27-8709-4ab91f1f02e9 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0aa159af-25ad-4e88-adfd-88736802c68b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:33.114474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c21a9db-5b5f-4e27-8709-4ab91f1f02e9 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:33.125432 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c21a9db-5b5f-4e27-8709-4ab91f1f02e9 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:33.126177 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c21a9db-5b5f-4e27-8709-4ab91f1f02e9 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:33.127089 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c21a9db-5b5f-4e27-8709-4ab91f1f02e9 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:33.127766 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c21a9db-5b5f-4e27-8709-4ab91f1f02e9 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:33.128356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c21a9db-5b5f-4e27-8709-4ab91f1f02e9 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:33.158411 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-7c21a9db-5b5f-4e27-8709-4ab91f1f02e9 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] HTTP exception thrown: Instance 0aa159af-25ad-4e88-adfd-88736802c68b could not be found. Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7c21a9db-5b5f-4e27-8709-4ab91f1f02e9 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Request method failure captured: Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b HTTP/1.1 Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_tUfF40yWb3YWSPuST_k75056eDJQSzLbaFJTlk0YU0jUj8ZFyyQdage4s2y--jxmqVBcnPhvgAKjc7jg9b2VNWICPCBCsPlvzmDPQYcaezG6cAVc6eitq6FjvvKsix5Opi_UtjCNda4BZmNIXaNDsAx3Rzl27pqJ6UlvsPp1f3y1I Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 86d8604ab1934bdeacd1bb6073ae153a Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesTestJSON-66576260 Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/86d8604ab1934bdeacd1bb6073ae153a"}]}] Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesTestJSON-66576260 Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 86d8604ab1934bdeacd1bb6073ae153a Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesTestJSON-66576260 Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ImagesTestJSON-66576260-project Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 157e8ca7c2494f3ea5c468dc37f55858 Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesTestJSON-66576260-project Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 0aa159af-25ad-4e88-adfd-88736802c68b could not be found. Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '0aa159af-25ad-4e88-adfd-88736802c68b'} Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0aa159af-25ad-4e88-adfd-88736802c68b could not be found. Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:05:33.160331 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aa159af-25ad-4e88-adfd-88736802c68b could not be found. Aug 04 17:05:33.164093 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:33.164093 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:33.164093 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:33.164093 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:33.164093 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:33.164093 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:33.164093 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:05:33.164093 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:05:33.164093 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aa159af-25ad-4e88-adfd-88736802c68b could not be found. Aug 04 17:05:33.164093 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:33.166121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7c21a9db-5b5f-4e27-8709-4ab91f1f02e9 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Returning 404 to user: Instance 0aa159af-25ad-4e88-adfd-88736802c68b could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:05:33.169963 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7c21a9db-5b5f-4e27-8709-4ab91f1f02e9 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b" status: 404 len: 111 microversion: 2.1 time: 0.076392 Aug 04 17:05:33.170871 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1322/2720] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:05:33 2022] DELETE /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:05:33.187588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c91aa1c7-b050-4dac-afd4-1268e539c9a3 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] Action: 'create', calling method: .version_select at 0x7f1e5bd15700>, body: {"security_group_rule": {"parent_group_id": "6438c1c5-6e6f-471d-85ec-74f68d3594a7", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:33.446979 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-16e90a54-5773-4b21-8b76-018f2b1cfe89 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:33.462928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-16e90a54-5773-4b21-8b76-018f2b1cfe89 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:33.465286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-16e90a54-5773-4b21-8b76-018f2b1cfe89 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:33.468879 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-16e90a54-5773-4b21-8b76-018f2b1cfe89 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1605 microversion: 2.32 time: 0.436027 Aug 04 17:05:33.486805 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1399/2721] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:05:33 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1605 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:05:33.492173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c2331939-8b73-412e-9666-3bbf6183289f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:33.493117 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c2331939-8b73-412e-9666-3bbf6183289f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 893dbe88-23f3-472b-a24f-67b4e8c18007] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:33.521941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2331939-8b73-412e-9666-3bbf6183289f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:33.526221 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2331939-8b73-412e-9666-3bbf6183289f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:33.528925 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2331939-8b73-412e-9666-3bbf6183289f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:33.532171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2331939-8b73-412e-9666-3bbf6183289f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:33.532796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2331939-8b73-412e-9666-3bbf6183289f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:33.533359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2331939-8b73-412e-9666-3bbf6183289f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:33.910498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c2331939-8b73-412e-9666-3bbf6183289f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:33.925671 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c91aa1c7-b050-4dac-afd4-1268e539c9a3 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.742363 Aug 04 17:05:33.927532 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c2331939-8b73-412e-9666-3bbf6183289f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/893dbe88-23f3-472b-a24f-67b4e8c18007" status: 200 len: 1319 microversion: 2.1 time: 0.436789 Aug 04 17:05:33.933008 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1323/2722] 10.222.0.93 () {60 vars in 1195 bytes} [Thu Aug 4 17:05:33 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:33.938130 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9d01293c-5198-4d93-8368-a3a6ba19ab13 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:33.938763 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9d01293c-5198-4d93-8368-a3a6ba19ab13 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] [instance: 0aa159af-25ad-4e88-adfd-88736802c68b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:33.945906 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1400/2723] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:33 2022] GET /compute/v2.1/servers/893dbe88-23f3-472b-a24f-67b4e8c18007 => generated 1319 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:33.962455 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cc2a4078-257f-486b-9f89-a568ca6ffad3 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:33.965151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cc2a4078-257f-486b-9f89-a568ca6ffad3 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] [instance: 91cdc465-4194-4de5-b82e-2d5382b4e779] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:33.979360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d01293c-5198-4d93-8368-a3a6ba19ab13 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:33.980004 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d01293c-5198-4d93-8368-a3a6ba19ab13 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:33.980449 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d01293c-5198-4d93-8368-a3a6ba19ab13 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:33.981210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d01293c-5198-4d93-8368-a3a6ba19ab13 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:33.981681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d01293c-5198-4d93-8368-a3a6ba19ab13 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:33.984504 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d01293c-5198-4d93-8368-a3a6ba19ab13 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:33.985761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc2a4078-257f-486b-9f89-a568ca6ffad3 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:33.986472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc2a4078-257f-486b-9f89-a568ca6ffad3 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:33.987116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc2a4078-257f-486b-9f89-a568ca6ffad3 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:33.990834 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc2a4078-257f-486b-9f89-a568ca6ffad3 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:33.991812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc2a4078-257f-486b-9f89-a568ca6ffad3 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:33.994829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc2a4078-257f-486b-9f89-a568ca6ffad3 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:34.043269 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-9d01293c-5198-4d93-8368-a3a6ba19ab13 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] HTTP exception thrown: Instance 0aa159af-25ad-4e88-adfd-88736802c68b could not be found. Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9d01293c-5198-4d93-8368-a3a6ba19ab13 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Request method failure captured: Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b HTTP/1.1 Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_tUfF40yWb3YWSPuST_k75056eDJQSzLbaFJTlk0YU0jUj8ZFyyQdage4s2y--jxmqVBcnPhvgAKjc7jg9b2VNWICPCBCsPlvzmDPQYcaezG6cAVc6eitq6FjvvKsix5Opi_UtjCNda4BZmNIXaNDsAx3Rzl27pqJ6UlvsPp1f3y1I Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 86d8604ab1934bdeacd1bb6073ae153a Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesTestJSON-66576260 Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_86d8604ab1934bdeacd1bb6073ae153a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/86d8604ab1934bdeacd1bb6073ae153a"}]}] Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesTestJSON-66576260 Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 86d8604ab1934bdeacd1bb6073ae153a Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesTestJSON-66576260 Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ImagesTestJSON-66576260-project Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 157e8ca7c2494f3ea5c468dc37f55858 Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesTestJSON-66576260-project Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 0aa159af-25ad-4e88-adfd-88736802c68b could not be found. Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '0aa159af-25ad-4e88-adfd-88736802c68b'} Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0aa159af-25ad-4e88-adfd-88736802c68b could not be found. Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aa159af-25ad-4e88-adfd-88736802c68b could not be found. Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:34.044919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:34.049321 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:34.049321 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:34.049321 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:05:34.049321 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:05:34.049321 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aa159af-25ad-4e88-adfd-88736802c68b could not be found. Aug 04 17:05:34.049321 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:34.049321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9d01293c-5198-4d93-8368-a3a6ba19ab13 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] Returning 404 to user: Instance 0aa159af-25ad-4e88-adfd-88736802c68b could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:05:34.049321 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9d01293c-5198-4d93-8368-a3a6ba19ab13 tempest-ImagesTestJSON-66576260 tempest-ImagesTestJSON-66576260-project] 10.222.0.93 "GET /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b" status: 404 len: 111 microversion: 2.1 time: 0.112339 Aug 04 17:05:34.049321 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1324/2724] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:33 2022] GET /compute/v2.1/servers/0aa159af-25ad-4e88-adfd-88736802c68b => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:05:34.065785 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-299d0dc1-a810-4cbb-94b3-7a807ff4fb5b tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] Calling method '.version_select at 0x7f1e68242b80>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:34.421659 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-299d0dc1-a810-4cbb-94b3-7a807ff4fb5b tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] 10.222.0.93 "GET /compute/v2.1/os-security-groups/6438c1c5-6e6f-471d-85ec-74f68d3594a7" status: 200 len: 664 microversion: 2.1 time: 0.372519 Aug 04 17:05:34.422366 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1325/2725] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Aug 4 17:05:34 2022] GET /compute/v2.1/os-security-groups/6438c1c5-6e6f-471d-85ec-74f68d3594a7 => generated 664 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:34.435869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5e9f6e73-a6db-40a4-bf8e-53c016dd278a tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:34.437121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5e9f6e73-a6db-40a4-bf8e-53c016dd278a tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: 90fd978f-f119-4293-b43e-2b0cf3aff18c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:34.453434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e9f6e73-a6db-40a4-bf8e-53c016dd278a tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:34.459064 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e9f6e73-a6db-40a4-bf8e-53c016dd278a tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:34.459812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e9f6e73-a6db-40a4-bf8e-53c016dd278a tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:34.460871 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e9f6e73-a6db-40a4-bf8e-53c016dd278a tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:34.461737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e9f6e73-a6db-40a4-bf8e-53c016dd278a tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:34.462412 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e9f6e73-a6db-40a4-bf8e-53c016dd278a tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:34.506436 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cc2a4078-257f-486b-9f89-a568ca6ffad3 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285bbd96190545c98a5cbaa2a01e3610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6052c3eaf4a11a415839aff00e71f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:34.516752 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cc2a4078-257f-486b-9f89-a568ca6ffad3 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] 10.222.0.93 "GET /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779" status: 200 len: 1323 microversion: 2.1 time: 0.569630 Aug 04 17:05:34.518913 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1401/2726] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:33 2022] GET /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779 => generated 1323 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:34.533260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-db804f6e-7c22-4bee-b59d-cf42396fa391 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] Calling method '.version_select at 0x7f1e5ae0ad30>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:35.160281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5e9f6e73-a6db-40a4-bf8e-53c016dd278a tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:35.171459 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5e9f6e73-a6db-40a4-bf8e-53c016dd278a tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c" status: 200 len: 1333 microversion: 2.1 time: 0.744212 Aug 04 17:05:35.177240 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1326/2727] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:34 2022] GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c => generated 1333 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:35.195576 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8d684cb3-4ea1-4757-ba10-afcbb9296272 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:35.196456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8d684cb3-4ea1-4757-ba10-afcbb9296272 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:35.203471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d684cb3-4ea1-4757-ba10-afcbb9296272 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:35.204222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d684cb3-4ea1-4757-ba10-afcbb9296272 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:35.204836 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d684cb3-4ea1-4757-ba10-afcbb9296272 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:35.205706 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d684cb3-4ea1-4757-ba10-afcbb9296272 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:35.206379 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d684cb3-4ea1-4757-ba10-afcbb9296272 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:35.206967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d684cb3-4ea1-4757-ba10-afcbb9296272 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:35.263809 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-db804f6e-7c22-4bee-b59d-cf42396fa391 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-group-rules/05f4cd4b-2d2f-461c-988e-76e74da98bc5" status: 202 len: 0 microversion: 2.1 time: 0.740953 Aug 04 17:05:35.265634 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1402/2728] 10.222.0.93 () {58 vars in 1287 bytes} [Thu Aug 4 17:05:34 2022] DELETE /compute/v2.1/os-security-group-rules/05f4cd4b-2d2f-461c-988e-76e74da98bc5 => generated 0 bytes in 746 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:05:35.273433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b4f31d14-08e3-495b-9ea1-52c203a11ea2 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:35.275488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b4f31d14-08e3-495b-9ea1-52c203a11ea2 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] [instance: c91f5223-09be-4180-b1a0-c261e00361fc] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:35.294686 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b4f31d14-08e3-495b-9ea1-52c203a11ea2 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:35.297579 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b4f31d14-08e3-495b-9ea1-52c203a11ea2 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:35.299323 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b4f31d14-08e3-495b-9ea1-52c203a11ea2 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:35.315157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b4f31d14-08e3-495b-9ea1-52c203a11ea2 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:35.317361 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b4f31d14-08e3-495b-9ea1-52c203a11ea2 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:35.318365 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b4f31d14-08e3-495b-9ea1-52c203a11ea2 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:35.358204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:35.369524 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b4f31d14-08e3-495b-9ea1-52c203a11ea2 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] [instance: c91f5223-09be-4180-b1a0-c261e00361fc] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:05:35.563014 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b4f31d14-08e3-495b-9ea1-52c203a11ea2 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] 10.222.0.93 "DELETE /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc" status: 204 len: 0 microversion: 2.1 time: 0.293607 Aug 04 17:05:35.566299 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1403/2729] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:05:35 2022] DELETE /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:05:35.585933 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a0dc444b-7862-4ab6-8d2d-c65bb4d09148 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:35.587251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a0dc444b-7862-4ab6-8d2d-c65bb4d09148 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 893dbe88-23f3-472b-a24f-67b4e8c18007] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:35.611104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a0dc444b-7862-4ab6-8d2d-c65bb4d09148 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:35.611951 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a0dc444b-7862-4ab6-8d2d-c65bb4d09148 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:35.612590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a0dc444b-7862-4ab6-8d2d-c65bb4d09148 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:35.614373 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a0dc444b-7862-4ab6-8d2d-c65bb4d09148 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:35.620091 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a0dc444b-7862-4ab6-8d2d-c65bb4d09148 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:35.621287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a0dc444b-7862-4ab6-8d2d-c65bb4d09148 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:35.788732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8d684cb3-4ea1-4757-ba10-afcbb9296272 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:35.798815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:35.806321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8d684cb3-4ea1-4757-ba10-afcbb9296272 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:35.807877 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8d684cb3-4ea1-4757-ba10-afcbb9296272 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:35.813092 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8d684cb3-4ea1-4757-ba10-afcbb9296272 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1605 microversion: 2.32 time: 0.621893 Aug 04 17:05:35.816139 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1327/2730] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:05:35 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1605 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:05:35.829947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-50038ce1-599e-40f5-b918-c66d0cf99305 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] Calling method '.version_select at 0x7f1e5bdf5e50>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:35.894401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=14 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:36.257377 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a0dc444b-7862-4ab6-8d2d-c65bb4d09148 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:36.270342 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a0dc444b-7862-4ab6-8d2d-c65bb4d09148 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/893dbe88-23f3-472b-a24f-67b4e8c18007" status: 200 len: 1319 microversion: 2.1 time: 0.698917 Aug 04 17:05:36.284337 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1404/2731] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:35 2022] GET /compute/v2.1/servers/893dbe88-23f3-472b-a24f-67b4e8c18007 => generated 1319 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:36.294934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3f56958f-070c-4a8c-82aa-3f5d4321d6bf tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:36.294934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3f56958f-070c-4a8c-82aa-3f5d4321d6bf tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] [instance: 91cdc465-4194-4de5-b82e-2d5382b4e779] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:36.309029 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f56958f-070c-4a8c-82aa-3f5d4321d6bf tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:36.309646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f56958f-070c-4a8c-82aa-3f5d4321d6bf tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:36.310293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f56958f-070c-4a8c-82aa-3f5d4321d6bf tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:36.311561 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f56958f-070c-4a8c-82aa-3f5d4321d6bf tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:36.313314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f56958f-070c-4a8c-82aa-3f5d4321d6bf tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:36.313829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f56958f-070c-4a8c-82aa-3f5d4321d6bf tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:36.990196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3f56958f-070c-4a8c-82aa-3f5d4321d6bf tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285bbd96190545c98a5cbaa2a01e3610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6052c3eaf4a11a415839aff00e71f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:37.018800 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3f56958f-070c-4a8c-82aa-3f5d4321d6bf tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] 10.222.0.93 "GET /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779" status: 200 len: 1323 microversion: 2.1 time: 0.728317 Aug 04 17:05:37.019712 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1405/2732] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:36 2022] GET /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779 => generated 1323 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:37.029323 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-334dd98c-8c35-429b-979c-0dfe0b889da6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:37.032042 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-334dd98c-8c35-429b-979c-0dfe0b889da6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] [instance: c91f5223-09be-4180-b1a0-c261e00361fc] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:37.039224 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-334dd98c-8c35-429b-979c-0dfe0b889da6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:37.041048 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-334dd98c-8c35-429b-979c-0dfe0b889da6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:37.042901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-334dd98c-8c35-429b-979c-0dfe0b889da6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:37.044046 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-334dd98c-8c35-429b-979c-0dfe0b889da6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:37.046776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-334dd98c-8c35-429b-979c-0dfe0b889da6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:37.047401 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-334dd98c-8c35-429b-979c-0dfe0b889da6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:37.339734 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-50038ce1-599e-40f5-b918-c66d0cf99305 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/6438c1c5-6e6f-471d-85ec-74f68d3594a7" status: 202 len: 0 microversion: 2.1 time: 1.522290 Aug 04 17:05:37.344280 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1328/2733] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 17:05:35 2022] DELETE /compute/v2.1/os-security-groups/6438c1c5-6e6f-471d-85ec-74f68d3594a7 => generated 0 bytes in 1527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:05:37.349426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-808518a8-adec-4cb6-b957-706dcf45e4bc tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:37.350152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-808518a8-adec-4cb6-b957-706dcf45e4bc tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: 90fd978f-f119-4293-b43e-2b0cf3aff18c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:37.366274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-808518a8-adec-4cb6-b957-706dcf45e4bc tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:37.366782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-808518a8-adec-4cb6-b957-706dcf45e4bc tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:37.367135 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-808518a8-adec-4cb6-b957-706dcf45e4bc tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:37.367889 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-808518a8-adec-4cb6-b957-706dcf45e4bc tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:37.368368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-808518a8-adec-4cb6-b957-706dcf45e4bc tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:37.368882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-808518a8-adec-4cb6-b957-706dcf45e4bc tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:37.432058 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-334dd98c-8c35-429b-979c-0dfe0b889da6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df56ffaf1f14046b8a97d219833caf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29204609fba44a4b69c57e2d0f5e581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:37.441323 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-334dd98c-8c35-429b-979c-0dfe0b889da6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] 10.222.0.93 "GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc" status: 200 len: 1665 microversion: 2.1 time: 0.418830 Aug 04 17:05:37.464055 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1406/2734] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:37 2022] GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc => generated 1665 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:37.469951 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-de46d0f1-d94c-4b37-a1ea-e2df845d43e6 req-6a28ef79-bd72-4c89-b5f4-c5d7e3851e89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90fd978f-f119-4293-b43e-2b0cf3aff18c", "tag": "88598e0e-8988-41cd-afdf-18e2cadc4c97"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:37.500218 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-de46d0f1-d94c-4b37-a1ea-e2df845d43e6 req-6a28ef79-bd72-4c89-b5f4-c5d7e3851e89 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:37.500721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-de46d0f1-d94c-4b37-a1ea-e2df845d43e6 req-6a28ef79-bd72-4c89-b5f4-c5d7e3851e89 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:37.501170 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-de46d0f1-d94c-4b37-a1ea-e2df845d43e6 req-6a28ef79-bd72-4c89-b5f4-c5d7e3851e89 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:37.520453 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-de46d0f1-d94c-4b37-a1ea-e2df845d43e6 req-6a28ef79-bd72-4c89-b5f4-c5d7e3851e89 service nova] Creating event network-changed:88598e0e-8988-41cd-afdf-18e2cadc4c97 for instance 90fd978f-f119-4293-b43e-2b0cf3aff18c on n-h1-851359-3 Aug 04 17:05:37.535194 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-de46d0f1-d94c-4b37-a1ea-e2df845d43e6 req-6a28ef79-bd72-4c89-b5f4-c5d7e3851e89 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069681 Aug 04 17:05:37.536139 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1407/2735] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:37.543204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6bf43a28-f947-4eab-b78b-7719a1347abb tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:37.543937 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6bf43a28-f947-4eab-b78b-7719a1347abb tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:37.575510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6bf43a28-f947-4eab-b78b-7719a1347abb tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:37.576062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6bf43a28-f947-4eab-b78b-7719a1347abb tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:37.576495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6bf43a28-f947-4eab-b78b-7719a1347abb tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:37.577294 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6bf43a28-f947-4eab-b78b-7719a1347abb tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:37.577737 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6bf43a28-f947-4eab-b78b-7719a1347abb tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:37.580665 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6bf43a28-f947-4eab-b78b-7719a1347abb tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:37.791963 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6bf43a28-f947-4eab-b78b-7719a1347abb tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:37.804263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6bf43a28-f947-4eab-b78b-7719a1347abb tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:37.806092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6bf43a28-f947-4eab-b78b-7719a1347abb tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:37.807438 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6bf43a28-f947-4eab-b78b-7719a1347abb tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1605 microversion: 2.32 time: 0.270174 Aug 04 17:05:37.808015 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1408/2736] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:05:37 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1605 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:05:37.885136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f8f27bc5-5c30-4e33-a850-e6d6a8447198 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1347108163", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "e904bd66-a6e8-4396-b479-05a4e6758d3f"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:37.895773 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:37.946799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-f8f27bc5-5c30-4e33-a850-e6d6a8447198 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] validate_networks() for [('e904bd66-a6e8-4396-b479-05a4e6758d3f', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:05:38.079749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-808518a8-adec-4cb6-b957-706dcf45e4bc tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:38.091562 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-808518a8-adec-4cb6-b957-706dcf45e4bc tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c" status: 200 len: 1333 microversion: 2.1 time: 0.746034 Aug 04 17:05:38.092698 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1329/2737] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:37 2022] GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c => generated 1333 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:38.101413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0eaff3f9-3a6e-467d-b8a5-dbd7178d4eb6 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:38.103003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0eaff3f9-3a6e-467d-b8a5-dbd7178d4eb6 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 893dbe88-23f3-472b-a24f-67b4e8c18007] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:38.111260 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0eaff3f9-3a6e-467d-b8a5-dbd7178d4eb6 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:38.111940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0eaff3f9-3a6e-467d-b8a5-dbd7178d4eb6 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:38.112554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0eaff3f9-3a6e-467d-b8a5-dbd7178d4eb6 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:38.113277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0eaff3f9-3a6e-467d-b8a5-dbd7178d4eb6 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:38.113746 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0eaff3f9-3a6e-467d-b8a5-dbd7178d4eb6 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:38.114390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0eaff3f9-3a6e-467d-b8a5-dbd7178d4eb6 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:38.328112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:38.383608 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=28 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:38.642502 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0eaff3f9-3a6e-467d-b8a5-dbd7178d4eb6 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:38.660114 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0eaff3f9-3a6e-467d-b8a5-dbd7178d4eb6 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/893dbe88-23f3-472b-a24f-67b4e8c18007" status: 200 len: 1319 microversion: 2.1 time: 0.565032 Aug 04 17:05:38.661778 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1330/2738] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:38 2022] GET /compute/v2.1/servers/893dbe88-23f3-472b-a24f-67b4e8c18007 => generated 1319 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:38.667504 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1a142e10-f96b-45b0-9c02-de98773a1de6 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] Calling method '.version_select at 0x7f1e680e73a0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:38.827703 n-d-851359-3 devstack@n-api.service[131044]: DEBUG neutronclient.v2_0.client [None req-1a142e10-f96b-45b0-9c02-de98773a1de6 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 139399a4-d0fe-459c-aa1b-46c68012855e does not exist", "detail": ""}} {{(pid=131044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 17:05:38.828758 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.security_group_api [None req-1a142e10-f96b-45b0-9c02-de98773a1de6 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] Neutron security group 139399a4-d0fe-459c-aa1b-46c68012855e not found {{(pid=131044) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 17:05:38.829629 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-1a142e10-f96b-45b0-9c02-de98773a1de6 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] HTTP exception thrown: Security group 139399a4-d0fe-459c-aa1b-46c68012855e does not exist Aug 04 17:05:38.829629 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-240dc37e-4966-4bee-b555-9d35f9733f29'] Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1a142e10-f96b-45b0-9c02-de98773a1de6 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] Request method failure captured: Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/os-security-groups/139399a4-d0fe-459c-aa1b-46c68012855e HTTP/1.1 Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_xIBqPUmi9J9TAd2zKtYTCNQlpgd_u5a63VLU8hchFCkZqxpQ3BD8RPhK_n1V2okXjwpcrg5rPKNbx95sRd23Jy3G0F-1atZ5cfIT0J_uLo6DAilV8uu-gvKEsCzOZD8GgHKIpdPZcYk73Zn6WGKzPwMamBtVySaOtlKc2GF7REA7Y Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 31238a9966d24bd6a43e41626a33633f Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-657604499 Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/31238a9966d24bd6a43e41626a33633f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/31238a9966d24bd6a43e41626a33633f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_31238a9966d24bd6a43e41626a33633f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/31238a9966d24bd6a43e41626a33633f"}]}] Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-SecurityGroupRulesTestJSON-657604499 Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 31238a9966d24bd6a43e41626a33633f Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-657604499 Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-SecurityGroupRulesTestJSON-657604499-project Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: c2028a8172834531a696860323a9cb55 Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-SecurityGroupRulesTestJSON-657604499-project Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: exception: Security group 139399a4-d0fe-459c-aa1b-46c68012855e does not exist Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-240dc37e-4966-4bee-b555-9d35f9733f29'] Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '139399a4-d0fe-459c-aa1b-46c68012855e'} Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 17:05:38.831566 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 139399a4-d0fe-459c-aa1b-46c68012855e does not exist Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-240dc37e-4966-4bee-b555-9d35f9733f29'] Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 139399a4-d0fe-459c-aa1b-46c68012855e does not exist Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-240dc37e-4966-4bee-b555-9d35f9733f29'] Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 139399a4-d0fe-459c-aa1b-46c68012855e does not exist Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-240dc37e-4966-4bee-b555-9d35f9733f29'] Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 139399a4-d0fe-459c-aa1b-46c68012855e does not exist Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-240dc37e-4966-4bee-b555-9d35f9733f29'] Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1a142e10-f96b-45b0-9c02-de98773a1de6 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] Returning 404 to user: Security group 139399a4-d0fe-459c-aa1b-46c68012855e does not exist Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-240dc37e-4966-4bee-b555-9d35f9733f29'] {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:05:38.835900 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1a142e10-f96b-45b0-9c02-de98773a1de6 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/139399a4-d0fe-459c-aa1b-46c68012855e" status: 404 len: 194 microversion: 2.1 time: 0.169980 Aug 04 17:05:38.839076 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1331/2739] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 17:05:38 2022] DELETE /compute/v2.1/os-security-groups/139399a4-d0fe-459c-aa1b-46c68012855e => generated 194 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:05:38.842092 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-378c760c-119d-4b1a-be7d-31976b82e353 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:38.843234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-378c760c-119d-4b1a-be7d-31976b82e353 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] [instance: 91cdc465-4194-4de5-b82e-2d5382b4e779] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:38.851514 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-378c760c-119d-4b1a-be7d-31976b82e353 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:38.852259 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-378c760c-119d-4b1a-be7d-31976b82e353 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:38.852896 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-378c760c-119d-4b1a-be7d-31976b82e353 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:38.853615 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-378c760c-119d-4b1a-be7d-31976b82e353 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:38.854252 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-378c760c-119d-4b1a-be7d-31976b82e353 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:38.854830 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-378c760c-119d-4b1a-be7d-31976b82e353 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:39.751280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-378c760c-119d-4b1a-be7d-31976b82e353 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285bbd96190545c98a5cbaa2a01e3610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6052c3eaf4a11a415839aff00e71f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:39.763798 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-378c760c-119d-4b1a-be7d-31976b82e353 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] 10.222.0.93 "GET /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779" status: 200 len: 1323 microversion: 2.1 time: 0.925466 Aug 04 17:05:39.764492 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1332/2740] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:38 2022] GET /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779 => generated 1323 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:39.783407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6a084ae9-5fdc-4b65-9d10-1e938ac1af08 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:39.784387 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6a084ae9-5fdc-4b65-9d10-1e938ac1af08 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] [instance: c91f5223-09be-4180-b1a0-c261e00361fc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:39.792201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a084ae9-5fdc-4b65-9d10-1e938ac1af08 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:39.793026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a084ae9-5fdc-4b65-9d10-1e938ac1af08 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:39.793495 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a084ae9-5fdc-4b65-9d10-1e938ac1af08 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:39.794352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a084ae9-5fdc-4b65-9d10-1e938ac1af08 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:39.795085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a084ae9-5fdc-4b65-9d10-1e938ac1af08 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:39.795729 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a084ae9-5fdc-4b65-9d10-1e938ac1af08 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:39.813406 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-f8f27bc5-5c30-4e33-a850-e6d6a8447198 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:05:39.814783 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-f8f27bc5-5c30-4e33-a850-e6d6a8447198 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:05:39.815590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-f8f27bc5-5c30-4e33-a850-e6d6a8447198 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:05:39.816252 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-f8f27bc5-5c30-4e33-a850-e6d6a8447198 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:05:39.816950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-f8f27bc5-5c30-4e33-a850-e6d6a8447198 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:05:39.826919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8f27bc5-5c30-4e33-a850-e6d6a8447198 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:39.827774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8f27bc5-5c30-4e33-a850-e6d6a8447198 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:39.828428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8f27bc5-5c30-4e33-a850-e6d6a8447198 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:39.830132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8f27bc5-5c30-4e33-a850-e6d6a8447198 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:39.830839 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8f27bc5-5c30-4e33-a850-e6d6a8447198 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:39.831496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8f27bc5-5c30-4e33-a850-e6d6a8447198 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:39.854549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-f8f27bc5-5c30-4e33-a850-e6d6a8447198 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Getting quotas for project 02352ec274b443429fa5abe400cbcfd0. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:05:39.861110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-f8f27bc5-5c30-4e33-a850-e6d6a8447198 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Getting quotas for user c98638b115404c7d85de7541d9c4182b and project 02352ec274b443429fa5abe400cbcfd0. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:05:39.878526 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f8f27bc5-5c30-4e33-a850-e6d6a8447198 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Going to run 2 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:05:39.881253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f8f27bc5-5c30-4e33-a850-e6d6a8447198 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: d282ccab-7827-4b5e-8ba7-b1600d5140bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:05:39.921392 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f8f27bc5-5c30-4e33-a850-e6d6a8447198 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: 3c07f7b5-53ae-43c8-a0b6-3c5502e02c42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=d282ccab-7827-4b5e-8ba7-b1600d5140bf,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:05:40.004283 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f8f27bc5-5c30-4e33-a850-e6d6a8447198 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.194520 Aug 04 17:05:40.007302 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1409/2741] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:05:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:05:40.028226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dffa1af4-7527-4503-a7d8-f52dc0aab296 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:40.035103 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dffa1af4-7527-4503-a7d8-f52dc0aab296 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:40.042856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dffa1af4-7527-4503-a7d8-f52dc0aab296 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:40.043687 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dffa1af4-7527-4503-a7d8-f52dc0aab296 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:40.044322 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dffa1af4-7527-4503-a7d8-f52dc0aab296 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:40.045227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dffa1af4-7527-4503-a7d8-f52dc0aab296 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:40.046087 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dffa1af4-7527-4503-a7d8-f52dc0aab296 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:40.046707 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dffa1af4-7527-4503-a7d8-f52dc0aab296 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:40.360637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dffa1af4-7527-4503-a7d8-f52dc0aab296 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:40.377792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dffa1af4-7527-4503-a7d8-f52dc0aab296 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:40.379808 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dffa1af4-7527-4503-a7d8-f52dc0aab296 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:40.381875 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dffa1af4-7527-4503-a7d8-f52dc0aab296 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1605 microversion: 2.32 time: 0.372689 Aug 04 17:05:40.383815 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1410/2742] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:05:40 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1605 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:05:40.403263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e3e703e3-cae8-4a7f-9c74-3534a9226a3e tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] Calling method '.version_select at 0x7f1e5ae0a790>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:40.933303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6a084ae9-5fdc-4b65-9d10-1e938ac1af08 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df56ffaf1f14046b8a97d219833caf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29204609fba44a4b69c57e2d0f5e581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:40.951632 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6a084ae9-5fdc-4b65-9d10-1e938ac1af08 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] 10.222.0.93 "GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc" status: 200 len: 1665 microversion: 2.1 time: 1.172763 Aug 04 17:05:40.953651 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1333/2743] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:39 2022] GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc => generated 1665 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:40.960007 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-eae98d5c-74a8-4238-aef7-f0aec884d3aa req-2b313773-b4f7-48e9-a69b-2cadbfad53e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91cdc465-4194-4de5-b82e-2d5382b4e779", "tag": "241e9c15-423e-4c5c-8c22-a0d8f621d376"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:40.992152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-eae98d5c-74a8-4238-aef7-f0aec884d3aa req-2b313773-b4f7-48e9-a69b-2cadbfad53e2 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:40.992749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-eae98d5c-74a8-4238-aef7-f0aec884d3aa req-2b313773-b4f7-48e9-a69b-2cadbfad53e2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:40.995404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-eae98d5c-74a8-4238-aef7-f0aec884d3aa req-2b313773-b4f7-48e9-a69b-2cadbfad53e2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:41.023450 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-eae98d5c-74a8-4238-aef7-f0aec884d3aa req-2b313773-b4f7-48e9-a69b-2cadbfad53e2 service nova] Creating event network-changed:241e9c15-423e-4c5c-8c22-a0d8f621d376 for instance 91cdc465-4194-4de5-b82e-2d5382b4e779 on n-h2-851359-3 Aug 04 17:05:41.028966 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-eae98d5c-74a8-4238-aef7-f0aec884d3aa req-2b313773-b4f7-48e9-a69b-2cadbfad53e2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072538 Aug 04 17:05:41.029923 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1334/2744] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:41.046724 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-46e63a95-b9a7-4f88-a431-db2cbf311ae3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:41.050339 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-46e63a95-b9a7-4f88-a431-db2cbf311ae3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: 90fd978f-f119-4293-b43e-2b0cf3aff18c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:41.062404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46e63a95-b9a7-4f88-a431-db2cbf311ae3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:41.063441 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46e63a95-b9a7-4f88-a431-db2cbf311ae3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:41.064141 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46e63a95-b9a7-4f88-a431-db2cbf311ae3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:41.065153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46e63a95-b9a7-4f88-a431-db2cbf311ae3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:41.065839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46e63a95-b9a7-4f88-a431-db2cbf311ae3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:41.066524 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46e63a95-b9a7-4f88-a431-db2cbf311ae3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:42.892856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-46e63a95-b9a7-4f88-a431-db2cbf311ae3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:42.909209 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-46e63a95-b9a7-4f88-a431-db2cbf311ae3 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c" status: 200 len: 1333 microversion: 2.1 time: 1.875227 Aug 04 17:05:42.911129 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1335/2745] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:41 2022] GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c => generated 1333 bytes in 1880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:42.921769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-9adf520e-3a7b-47c2-b122-f3b2be6f3384 req-e086e723-665d-4780-8f8a-a4ccd70216d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90fd978f-f119-4293-b43e-2b0cf3aff18c", "tag": "cbb9d642-fe31-4c61-b558-e471183d26a4"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:42.944019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9adf520e-3a7b-47c2-b122-f3b2be6f3384 req-e086e723-665d-4780-8f8a-a4ccd70216d8 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:42.949206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9adf520e-3a7b-47c2-b122-f3b2be6f3384 req-e086e723-665d-4780-8f8a-a4ccd70216d8 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:42.949863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9adf520e-3a7b-47c2-b122-f3b2be6f3384 req-e086e723-665d-4780-8f8a-a4ccd70216d8 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:42.962481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:42.984152 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-9adf520e-3a7b-47c2-b122-f3b2be6f3384 req-e086e723-665d-4780-8f8a-a4ccd70216d8 service nova] Creating event network-changed:cbb9d642-fe31-4c61-b558-e471183d26a4 for instance 90fd978f-f119-4293-b43e-2b0cf3aff18c on n-h1-851359-3 Aug 04 17:05:43.000019 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-9adf520e-3a7b-47c2-b122-f3b2be6f3384 req-e086e723-665d-4780-8f8a-a4ccd70216d8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083230 Aug 04 17:05:43.001248 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1336/2746] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:43.013252 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-768d5cbf-1f18-44c4-be04-6c24d777c7f7 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:43.014271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-768d5cbf-1f18-44c4-be04-6c24d777c7f7 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 893dbe88-23f3-472b-a24f-67b4e8c18007] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:43.028728 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-768d5cbf-1f18-44c4-be04-6c24d777c7f7 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:43.030806 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-768d5cbf-1f18-44c4-be04-6c24d777c7f7 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:43.033164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-768d5cbf-1f18-44c4-be04-6c24d777c7f7 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:43.036542 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-768d5cbf-1f18-44c4-be04-6c24d777c7f7 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:43.037063 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-768d5cbf-1f18-44c4-be04-6c24d777c7f7 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:43.039278 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-768d5cbf-1f18-44c4-be04-6c24d777c7f7 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:43.297597 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e3e703e3-cae8-4a7f-9c74-3534a9226a3e tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/3e066c3b-fa0d-44c0-a85c-4169b2e8bff2" status: 202 len: 0 microversion: 2.1 time: 2.910672 Aug 04 17:05:43.298949 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1411/2747] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 17:05:40 2022] DELETE /compute/v2.1/os-security-groups/3e066c3b-fa0d-44c0-a85c-4169b2e8bff2 => generated 0 bytes in 2913 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:05:43.305660 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6687b079-00e8-4f45-89b5-f22ccdcaa3a0 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:43.316115 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6687b079-00e8-4f45-89b5-f22ccdcaa3a0 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:43.316383 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6687b079-00e8-4f45-89b5-f22ccdcaa3a0 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Searching by: {'deleted': False, 'project_id': '02352ec274b443429fa5abe400cbcfd0'} {{(pid=131043) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:05:43.332264 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6687b079-00e8-4f45-89b5-f22ccdcaa3a0 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:43.333048 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6687b079-00e8-4f45-89b5-f22ccdcaa3a0 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:43.334843 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6687b079-00e8-4f45-89b5-f22ccdcaa3a0 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:43.338051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6687b079-00e8-4f45-89b5-f22ccdcaa3a0 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:43.338718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6687b079-00e8-4f45-89b5-f22ccdcaa3a0 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:43.339358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6687b079-00e8-4f45-89b5-f22ccdcaa3a0 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:43.389066 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.multi_cell_list [None req-6687b079-00e8-4f45-89b5-f22ccdcaa3a0 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:05:43.429718 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6687b079-00e8-4f45-89b5-f22ccdcaa3a0 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.127242 Aug 04 17:05:43.430605 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1412/2748] 10.222.0.93 () {58 vars in 1125 bytes} [Thu Aug 4 17:05:43 2022] GET /compute/v2.1/servers => generated 677 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:43.441631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8fab5b74-f5f7-439d-a84f-38859d838afc tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:43.442310 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8fab5b74-f5f7-439d-a84f-38859d838afc tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] [instance: 91cdc465-4194-4de5-b82e-2d5382b4e779] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:43.450205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fab5b74-f5f7-439d-a84f-38859d838afc tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:43.450761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fab5b74-f5f7-439d-a84f-38859d838afc tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:43.451278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fab5b74-f5f7-439d-a84f-38859d838afc tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:43.452039 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fab5b74-f5f7-439d-a84f-38859d838afc tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:43.452662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fab5b74-f5f7-439d-a84f-38859d838afc tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:43.453722 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fab5b74-f5f7-439d-a84f-38859d838afc tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:43.680104 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-768d5cbf-1f18-44c4-be04-6c24d777c7f7 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:43.690187 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-768d5cbf-1f18-44c4-be04-6c24d777c7f7 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/893dbe88-23f3-472b-a24f-67b4e8c18007" status: 200 len: 1319 microversion: 2.1 time: 0.686002 Aug 04 17:05:43.692504 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1337/2749] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:43 2022] GET /compute/v2.1/servers/893dbe88-23f3-472b-a24f-67b4e8c18007 => generated 1319 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:43.700913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a15b5da9-70f7-4d84-ab2d-dddec9bd4895 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:43.701532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a15b5da9-70f7-4d84-ab2d-dddec9bd4895 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:43.724987 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a15b5da9-70f7-4d84-ab2d-dddec9bd4895 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:43.725650 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a15b5da9-70f7-4d84-ab2d-dddec9bd4895 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:43.726250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a15b5da9-70f7-4d84-ab2d-dddec9bd4895 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:43.727841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a15b5da9-70f7-4d84-ab2d-dddec9bd4895 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:43.729615 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a15b5da9-70f7-4d84-ab2d-dddec9bd4895 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:43.731651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a15b5da9-70f7-4d84-ab2d-dddec9bd4895 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:43.774485 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8fab5b74-f5f7-439d-a84f-38859d838afc tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285bbd96190545c98a5cbaa2a01e3610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6052c3eaf4a11a415839aff00e71f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:43.796737 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8fab5b74-f5f7-439d-a84f-38859d838afc tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] 10.222.0.93 "GET /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779" status: 200 len: 1323 microversion: 2.1 time: 0.357523 Aug 04 17:05:43.801835 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1413/2750] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:43 2022] GET /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779 => generated 1323 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:43.817781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cefd1da2-6bcb-41cd-8deb-7c082853baf6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:43.819137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cefd1da2-6bcb-41cd-8deb-7c082853baf6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] [instance: c91f5223-09be-4180-b1a0-c261e00361fc] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:43.846558 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cefd1da2-6bcb-41cd-8deb-7c082853baf6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:43.847123 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cefd1da2-6bcb-41cd-8deb-7c082853baf6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:43.847633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cefd1da2-6bcb-41cd-8deb-7c082853baf6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:43.850448 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cefd1da2-6bcb-41cd-8deb-7c082853baf6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:43.850994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cefd1da2-6bcb-41cd-8deb-7c082853baf6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:43.851446 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cefd1da2-6bcb-41cd-8deb-7c082853baf6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:43.909582 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a15b5da9-70f7-4d84-ab2d-dddec9bd4895 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:43.919311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a15b5da9-70f7-4d84-ab2d-dddec9bd4895 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:43.920934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a15b5da9-70f7-4d84-ab2d-dddec9bd4895 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:43.922162 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a15b5da9-70f7-4d84-ab2d-dddec9bd4895 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1605 microversion: 2.32 time: 0.228649 Aug 04 17:05:43.936316 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1338/2751] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:05:43 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1605 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:05:43.941487 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-40514dcb-0469-4f91-9a96-1d89fc3ab87e req-12ca3a18-ce61-4d0e-8039-4ac21762fd77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2898397c-98e0-416d-b35d-18984c4730e2", "name": "network-vif-plugged", "status": "completed", "tag": "6402536c-3b47-40d1-9c06-8f761b813b94"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:43.960555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-40514dcb-0469-4f91-9a96-1d89fc3ab87e req-12ca3a18-ce61-4d0e-8039-4ac21762fd77 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:43.961213 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-40514dcb-0469-4f91-9a96-1d89fc3ab87e req-12ca3a18-ce61-4d0e-8039-4ac21762fd77 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:43.961803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-40514dcb-0469-4f91-9a96-1d89fc3ab87e req-12ca3a18-ce61-4d0e-8039-4ac21762fd77 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:43.973123 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cefd1da2-6bcb-41cd-8deb-7c082853baf6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df56ffaf1f14046b8a97d219833caf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29204609fba44a4b69c57e2d0f5e581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:43.975531 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-40514dcb-0469-4f91-9a96-1d89fc3ab87e req-12ca3a18-ce61-4d0e-8039-4ac21762fd77 service nova] Creating event network-vif-plugged:6402536c-3b47-40d1-9c06-8f761b813b94 for instance 2898397c-98e0-416d-b35d-18984c4730e2 on n-h2-851359-3 Aug 04 17:05:43.982477 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-40514dcb-0469-4f91-9a96-1d89fc3ab87e req-12ca3a18-ce61-4d0e-8039-4ac21762fd77 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044534 Aug 04 17:05:43.983781 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1339/2752] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:43.986483 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cefd1da2-6bcb-41cd-8deb-7c082853baf6 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] 10.222.0.93 "GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc" status: 200 len: 1597 microversion: 2.1 time: 0.184751 Aug 04 17:05:43.987545 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1414/2753] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:43 2022] GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc => generated 1597 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:43.990629 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a6ef37de-2236-4e85-b344-89bea66e5e82 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] Calling method '.version_select at 0x7f1e5b4ea550>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:43.992228 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-698f109f-0828-44ad-abaf-46ab292e6e1a tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:43.993029 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-698f109f-0828-44ad-abaf-46ab292e6e1a tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: 3c07f7b5-53ae-43c8-a0b6-3c5502e02c42] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:44.015635 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-698f109f-0828-44ad-abaf-46ab292e6e1a tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:44.015635 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-698f109f-0828-44ad-abaf-46ab292e6e1a tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:44.016118 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-698f109f-0828-44ad-abaf-46ab292e6e1a tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:44.016842 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-698f109f-0828-44ad-abaf-46ab292e6e1a tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:44.017550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-698f109f-0828-44ad-abaf-46ab292e6e1a tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:44.018049 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-698f109f-0828-44ad-abaf-46ab292e6e1a tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:44.113105 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-698f109f-0828-44ad-abaf-46ab292e6e1a tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:44.132737 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-698f109f-0828-44ad-abaf-46ab292e6e1a tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/3c07f7b5-53ae-43c8-a0b6-3c5502e02c42" status: 200 len: 1278 microversion: 2.1 time: 0.140222 Aug 04 17:05:44.150138 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1415/2754] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:43 2022] GET /compute/v2.1/servers/3c07f7b5-53ae-43c8-a0b6-3c5502e02c42 => generated 1278 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:44.150138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c3003269-75eb-425a-847f-1e61b6b174e5 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:44.150138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c3003269-75eb-425a-847f-1e61b6b174e5 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: 90fd978f-f119-4293-b43e-2b0cf3aff18c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:44.156752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c3003269-75eb-425a-847f-1e61b6b174e5 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:44.156752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c3003269-75eb-425a-847f-1e61b6b174e5 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:44.157133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c3003269-75eb-425a-847f-1e61b6b174e5 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:44.157860 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c3003269-75eb-425a-847f-1e61b6b174e5 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:44.168766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c3003269-75eb-425a-847f-1e61b6b174e5 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:44.169353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c3003269-75eb-425a-847f-1e61b6b174e5 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:44.404512 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c3003269-75eb-425a-847f-1e61b6b174e5 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:44.408611 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a6ef37de-2236-4e85-b344-89bea66e5e82 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/d7ff6779-9d34-43d5-8934-e8bf01cf6475" status: 202 len: 0 microversion: 2.1 time: 0.423367 Aug 04 17:05:44.409270 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1340/2755] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 17:05:43 2022] DELETE /compute/v2.1/os-security-groups/d7ff6779-9d34-43d5-8934-e8bf01cf6475 => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:05:44.417698 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5d3024a9-6b42-46b8-a264-9ef214eb8196 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] Calling method '.version_select at 0x7f1e5b4ea820>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:44.419786 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c3003269-75eb-425a-847f-1e61b6b174e5 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c" status: 200 len: 1333 microversion: 2.1 time: 0.284725 Aug 04 17:05:44.420377 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1416/2756] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:44 2022] GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c => generated 1333 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:44.710767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-57a76a2b-26e2-41ac-ba46-8f2dba4023ef tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:44.711400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-57a76a2b-26e2-41ac-ba46-8f2dba4023ef tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 893dbe88-23f3-472b-a24f-67b4e8c18007] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:44.722638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57a76a2b-26e2-41ac-ba46-8f2dba4023ef tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:44.723437 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57a76a2b-26e2-41ac-ba46-8f2dba4023ef tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:44.724055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57a76a2b-26e2-41ac-ba46-8f2dba4023ef tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:44.725544 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57a76a2b-26e2-41ac-ba46-8f2dba4023ef tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:44.726213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57a76a2b-26e2-41ac-ba46-8f2dba4023ef tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:44.731441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57a76a2b-26e2-41ac-ba46-8f2dba4023ef tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:44.772478 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5d3024a9-6b42-46b8-a264-9ef214eb8196 tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/ff02712a-9bdf-477c-b745-40f4f07f53ee" status: 202 len: 0 microversion: 2.1 time: 0.359052 Aug 04 17:05:44.773248 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1341/2757] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 17:05:44 2022] DELETE /compute/v2.1/os-security-groups/ff02712a-9bdf-477c-b745-40f4f07f53ee => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 17:05:44.781202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-490d2e7d-27e7-4e30-8ff0-776e486587cb tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] Calling method '.version_select at 0x7f1e5bc0a8b0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:45.573749 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-57a76a2b-26e2-41ac-ba46-8f2dba4023ef tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:45.585162 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-57a76a2b-26e2-41ac-ba46-8f2dba4023ef tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/893dbe88-23f3-472b-a24f-67b4e8c18007" status: 200 len: 1319 microversion: 2.1 time: 0.878696 Aug 04 17:05:45.589331 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1417/2758] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:44 2022] GET /compute/v2.1/servers/893dbe88-23f3-472b-a24f-67b4e8c18007 => generated 1319 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:45.610552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5c157cf6-bcbe-4de6-b1e3-76938788c2a7 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:45.611438 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5c157cf6-bcbe-4de6-b1e3-76938788c2a7 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] [instance: 91cdc465-4194-4de5-b82e-2d5382b4e779] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:45.622169 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c157cf6-bcbe-4de6-b1e3-76938788c2a7 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:45.629312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c157cf6-bcbe-4de6-b1e3-76938788c2a7 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:45.630012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c157cf6-bcbe-4de6-b1e3-76938788c2a7 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:45.630933 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c157cf6-bcbe-4de6-b1e3-76938788c2a7 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:45.631566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c157cf6-bcbe-4de6-b1e3-76938788c2a7 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:45.633622 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c157cf6-bcbe-4de6-b1e3-76938788c2a7 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:46.415119 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5c157cf6-bcbe-4de6-b1e3-76938788c2a7 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285bbd96190545c98a5cbaa2a01e3610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6052c3eaf4a11a415839aff00e71f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:46.433929 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5c157cf6-bcbe-4de6-b1e3-76938788c2a7 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] 10.222.0.93 "GET /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779" status: 200 len: 1323 microversion: 2.1 time: 0.840334 Aug 04 17:05:46.436966 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1418/2759] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:45 2022] GET /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779 => generated 1323 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:46.457961 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-21f0fa9c-e80b-4eb4-9fb7-991d9797c492 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:46.458826 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-21f0fa9c-e80b-4eb4-9fb7-991d9797c492 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:46.474515 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-21f0fa9c-e80b-4eb4-9fb7-991d9797c492 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:46.476281 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-21f0fa9c-e80b-4eb4-9fb7-991d9797c492 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:46.477533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-21f0fa9c-e80b-4eb4-9fb7-991d9797c492 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:46.480164 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-21f0fa9c-e80b-4eb4-9fb7-991d9797c492 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:46.480966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-21f0fa9c-e80b-4eb4-9fb7-991d9797c492 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:46.483196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-21f0fa9c-e80b-4eb4-9fb7-991d9797c492 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:46.699024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-21f0fa9c-e80b-4eb4-9fb7-991d9797c492 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:46.729940 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-21f0fa9c-e80b-4eb4-9fb7-991d9797c492 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:46.734136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-21f0fa9c-e80b-4eb4-9fb7-991d9797c492 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:46.735507 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-21f0fa9c-e80b-4eb4-9fb7-991d9797c492 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1605 microversion: 2.32 time: 0.294284 Aug 04 17:05:46.753862 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1419/2760] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:05:46 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1605 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:05:46.759067 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5a043324-ac3a-451c-b00b-72f6894b84de tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:46.759697 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5a043324-ac3a-451c-b00b-72f6894b84de tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] [instance: c91f5223-09be-4180-b1a0-c261e00361fc] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:46.767422 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5a043324-ac3a-451c-b00b-72f6894b84de tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:46.768244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5a043324-ac3a-451c-b00b-72f6894b84de tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:46.768841 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5a043324-ac3a-451c-b00b-72f6894b84de tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:46.769615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5a043324-ac3a-451c-b00b-72f6894b84de tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:46.770110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5a043324-ac3a-451c-b00b-72f6894b84de tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:46.770611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5a043324-ac3a-451c-b00b-72f6894b84de tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:46.779275 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-490d2e7d-27e7-4e30-8ff0-776e486587cb tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/9f9d991a-8ae2-4641-bc89-f3e9f9ff6400" status: 202 len: 0 microversion: 2.1 time: 2.001577 Aug 04 17:05:46.784119 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1342/2761] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 17:05:44 2022] DELETE /compute/v2.1/os-security-groups/9f9d991a-8ae2-4641-bc89-f3e9f9ff6400 => generated 0 bytes in 2007 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:05:46.790163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b3e62220-143b-41e8-ad89-efa8ee978945 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:46.792894 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b3e62220-143b-41e8-ad89-efa8ee978945 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: 3c07f7b5-53ae-43c8-a0b6-3c5502e02c42] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:46.806070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:46.808986 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3e62220-143b-41e8-ad89-efa8ee978945 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:46.809491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3e62220-143b-41e8-ad89-efa8ee978945 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:46.809933 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3e62220-143b-41e8-ad89-efa8ee978945 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:46.810665 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3e62220-143b-41e8-ad89-efa8ee978945 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:46.811390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3e62220-143b-41e8-ad89-efa8ee978945 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:46.811810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3e62220-143b-41e8-ad89-efa8ee978945 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:46.830024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5a043324-ac3a-451c-b00b-72f6894b84de tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:46.830725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5a043324-ac3a-451c-b00b-72f6894b84de tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:46.831312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5a043324-ac3a-451c-b00b-72f6894b84de tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:46.832011 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-5a043324-ac3a-451c-b00b-72f6894b84de tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lazy-loading 'fault' on Instance uuid c91f5223-09be-4180-b1a0-c261e00361fc {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:05:46.920543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5a043324-ac3a-451c-b00b-72f6894b84de tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9df56ffaf1f14046b8a97d219833caf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29204609fba44a4b69c57e2d0f5e581', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:46.942568 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5a043324-ac3a-451c-b00b-72f6894b84de tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] 10.222.0.93 "GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc" status: 200 len: 1315 microversion: 2.1 time: 0.185387 Aug 04 17:05:46.944683 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1420/2762] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:46 2022] GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:46.967018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1a0c3e64-9d5a-4382-9221-5cf824443d4c tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:46.968438 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1a0c3e64-9d5a-4382-9221-5cf824443d4c tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: 90fd978f-f119-4293-b43e-2b0cf3aff18c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:46.982456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a0c3e64-9d5a-4382-9221-5cf824443d4c tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:46.987026 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a0c3e64-9d5a-4382-9221-5cf824443d4c tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:46.989638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a0c3e64-9d5a-4382-9221-5cf824443d4c tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:46.991845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a0c3e64-9d5a-4382-9221-5cf824443d4c tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:46.992562 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a0c3e64-9d5a-4382-9221-5cf824443d4c tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:46.993131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a0c3e64-9d5a-4382-9221-5cf824443d4c tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:47.445688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b3e62220-143b-41e8-ad89-efa8ee978945 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:47.479962 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b3e62220-143b-41e8-ad89-efa8ee978945 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/3c07f7b5-53ae-43c8-a0b6-3c5502e02c42" status: 200 len: 1320 microversion: 2.1 time: 0.694113 Aug 04 17:05:47.485125 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1343/2763] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:46 2022] GET /compute/v2.1/servers/3c07f7b5-53ae-43c8-a0b6-3c5502e02c42 => generated 1320 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:47.499646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1a0c3e64-9d5a-4382-9221-5cf824443d4c tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:47.499838 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-2253ae87-a51f-410b-bdb7-4ff1c24c9af1 req-68d4f815-da97-40f0-a913-a6803af8616b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c91f5223-09be-4180-b1a0-c261e00361fc", "name": "network-vif-deleted", "tag": "01be168a-8839-40cc-bbbf-055fbfa0ec50"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:47.516170 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1a0c3e64-9d5a-4382-9221-5cf824443d4c tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c" status: 200 len: 1333 microversion: 2.1 time: 0.551198 Aug 04 17:05:47.517472 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1421/2764] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:46 2022] GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c => generated 1333 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:47.524943 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-8933e0be-eef5-436f-82b1-3a19d3840339 req-55c54afd-23a0-4010-9119-1a62664ac010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893dbe88-23f3-472b-a24f-67b4e8c18007", "name": "network-vif-plugged", "status": "completed", "tag": "51b67061-276e-4d87-9e5b-0716997fda47"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:47.548507 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8933e0be-eef5-436f-82b1-3a19d3840339 req-55c54afd-23a0-4010-9119-1a62664ac010 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:47.549413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8933e0be-eef5-436f-82b1-3a19d3840339 req-55c54afd-23a0-4010-9119-1a62664ac010 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:47.550070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8933e0be-eef5-436f-82b1-3a19d3840339 req-55c54afd-23a0-4010-9119-1a62664ac010 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:47.550495 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2253ae87-a51f-410b-bdb7-4ff1c24c9af1 req-68d4f815-da97-40f0-a913-a6803af8616b service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:47.552318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2253ae87-a51f-410b-bdb7-4ff1c24c9af1 req-68d4f815-da97-40f0-a913-a6803af8616b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:47.554400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2253ae87-a51f-410b-bdb7-4ff1c24c9af1 req-68d4f815-da97-40f0-a913-a6803af8616b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:47.576607 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-8933e0be-eef5-436f-82b1-3a19d3840339 req-55c54afd-23a0-4010-9119-1a62664ac010 service nova] Creating event network-vif-plugged:51b67061-276e-4d87-9e5b-0716997fda47 for instance 893dbe88-23f3-472b-a24f-67b4e8c18007 on n-h2-851359-3 Aug 04 17:05:47.592132 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-2253ae87-a51f-410b-bdb7-4ff1c24c9af1 req-68d4f815-da97-40f0-a913-a6803af8616b service nova] Creating event network-vif-deleted:01be168a-8839-40cc-bbbf-055fbfa0ec50 for instance c91f5223-09be-4180-b1a0-c261e00361fc on n-h2-851359-3 Aug 04 17:05:47.593672 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-8933e0be-eef5-436f-82b1-3a19d3840339 req-55c54afd-23a0-4010-9119-1a62664ac010 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074603 Aug 04 17:05:47.594618 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1422/2765] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:47.602368 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-2253ae87-a51f-410b-bdb7-4ff1c24c9af1 req-68d4f815-da97-40f0-a913-a6803af8616b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115682 Aug 04 17:05:47.603685 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1344/2766] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:47.611285 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e47e972f-23ca-4caa-981b-69c29f1b7b90 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:47.612344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e47e972f-23ca-4caa-981b-69c29f1b7b90 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 893dbe88-23f3-472b-a24f-67b4e8c18007] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:47.625309 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3675af67-34af-4d87-a5ac-7e7459d1d10b tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] Calling method '.version_select at 0x7f1e5b4eadc0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:47.625803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e47e972f-23ca-4caa-981b-69c29f1b7b90 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:47.626385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e47e972f-23ca-4caa-981b-69c29f1b7b90 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:47.626841 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e47e972f-23ca-4caa-981b-69c29f1b7b90 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:47.627584 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e47e972f-23ca-4caa-981b-69c29f1b7b90 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:47.628075 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e47e972f-23ca-4caa-981b-69c29f1b7b90 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:47.628550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e47e972f-23ca-4caa-981b-69c29f1b7b90 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:47.928444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e47e972f-23ca-4caa-981b-69c29f1b7b90 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:47.961436 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e47e972f-23ca-4caa-981b-69c29f1b7b90 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/893dbe88-23f3-472b-a24f-67b4e8c18007" status: 200 len: 1319 microversion: 2.1 time: 0.365525 Aug 04 17:05:47.965397 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1423/2767] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:47 2022] GET /compute/v2.1/servers/893dbe88-23f3-472b-a24f-67b4e8c18007 => generated 1319 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:47.974827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fdb77ca9-522c-4f59-876d-a63ea76bf5ce tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:47.975840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fdb77ca9-522c-4f59-876d-a63ea76bf5ce tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] [instance: 91cdc465-4194-4de5-b82e-2d5382b4e779] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:47.984288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdb77ca9-522c-4f59-876d-a63ea76bf5ce tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:47.985003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdb77ca9-522c-4f59-876d-a63ea76bf5ce tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:47.985638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdb77ca9-522c-4f59-876d-a63ea76bf5ce tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:47.987904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdb77ca9-522c-4f59-876d-a63ea76bf5ce tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:47.990726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdb77ca9-522c-4f59-876d-a63ea76bf5ce tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:47.991498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdb77ca9-522c-4f59-876d-a63ea76bf5ce tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:48.078713 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3675af67-34af-4d87-a5ac-7e7459d1d10b tempest-SecurityGroupRulesTestJSON-657604499 tempest-SecurityGroupRulesTestJSON-657604499-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/01a93c42-ce8a-41f2-9186-3a75a1de203d" status: 202 len: 0 microversion: 2.1 time: 0.473530 Aug 04 17:05:48.086002 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1345/2768] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 17:05:47 2022] DELETE /compute/v2.1/os-security-groups/01a93c42-ce8a-41f2-9186-3a75a1de203d => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:05:48.107455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-07cd2185-ad41-44a4-981b-6e9645889c8b tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:48.110572 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-07cd2185-ad41-44a4-981b-6e9645889c8b tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:48.144651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07cd2185-ad41-44a4-981b-6e9645889c8b tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:48.147144 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07cd2185-ad41-44a4-981b-6e9645889c8b tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:48.148972 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07cd2185-ad41-44a4-981b-6e9645889c8b tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:48.152122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07cd2185-ad41-44a4-981b-6e9645889c8b tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:48.153762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07cd2185-ad41-44a4-981b-6e9645889c8b tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:48.154414 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07cd2185-ad41-44a4-981b-6e9645889c8b tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:48.306227 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-07cd2185-ad41-44a4-981b-6e9645889c8b tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:48.325794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-07cd2185-ad41-44a4-981b-6e9645889c8b tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:48.330209 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-07cd2185-ad41-44a4-981b-6e9645889c8b tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:48.335700 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-07cd2185-ad41-44a4-981b-6e9645889c8b tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1605 microversion: 2.32 time: 0.246478 Aug 04 17:05:48.336723 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1346/2769] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:05:48 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1605 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:05:48.352407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-059bbb27-aaaf-4628-adf7-39e45935bfea tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:48.352966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-059bbb27-aaaf-4628-adf7-39e45935bfea tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] [instance: c91f5223-09be-4180-b1a0-c261e00361fc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:48.369935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-059bbb27-aaaf-4628-adf7-39e45935bfea tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:48.370540 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-059bbb27-aaaf-4628-adf7-39e45935bfea tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:48.370986 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-059bbb27-aaaf-4628-adf7-39e45935bfea tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:48.376163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-059bbb27-aaaf-4628-adf7-39e45935bfea tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:48.377627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-059bbb27-aaaf-4628-adf7-39e45935bfea tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:48.378112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-059bbb27-aaaf-4628-adf7-39e45935bfea tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:48.428944 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-059bbb27-aaaf-4628-adf7-39e45935bfea tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] HTTP exception thrown: Instance c91f5223-09be-4180-b1a0-c261e00361fc could not be found. Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-059bbb27-aaaf-4628-adf7-39e45935bfea tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Request method failure captured: Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc HTTP/1.1 Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_voF5TVCN3phnO4KWNXaqtHbOardalHGNJQJJasckyAguy_l5D4JUEmHl74Zykun3CK6Tk4cwmtBM6LR8Zo8ReewXW4Ojy5fGRwnec5qv01At9iW_vg1-YbhdNk10oX3GnZ5FrtnPu4ltjJiqgxMNZofDEb2eKuVcv7SyxnhYsaBR4 Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: a29204609fba44a4b69c57e2d0f5e581 Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersTestFqdnHostnames-659185176 Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a29204609fba44a4b69c57e2d0f5e581"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a29204609fba44a4b69c57e2d0f5e581"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a29204609fba44a4b69c57e2d0f5e581"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a29204609fba44a4b69c57e2d0f5e581"}]}] Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersTestFqdnHostnames-659185176 Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: a29204609fba44a4b69c57e2d0f5e581 Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-659185176 Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersTestFqdnHostnames-659185176-project Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 9df56ffaf1f14046b8a97d219833caf9 Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersTestFqdnHostnames-659185176-project Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance c91f5223-09be-4180-b1a0-c261e00361fc could not be found. Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'c91f5223-09be-4180-b1a0-c261e00361fc'} Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c91f5223-09be-4180-b1a0-c261e00361fc could not be found. Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c91f5223-09be-4180-b1a0-c261e00361fc could not be found. Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:48.438578 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:48.443509 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:48.443509 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:48.443509 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:48.443509 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:05:48.443509 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:05:48.443509 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c91f5223-09be-4180-b1a0-c261e00361fc could not be found. Aug 04 17:05:48.443509 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:48.445366 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-059bbb27-aaaf-4628-adf7-39e45935bfea tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Returning 404 to user: Instance c91f5223-09be-4180-b1a0-c261e00361fc could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:05:48.446411 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-059bbb27-aaaf-4628-adf7-39e45935bfea tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] 10.222.0.93 "GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc" status: 404 len: 111 microversion: 2.1 time: 0.108684 Aug 04 17:05:48.447108 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1347/2770] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:48 2022] GET /compute/v2.1/servers/c91f5223-09be-4180-b1a0-c261e00361fc => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:05:48.454155 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fdb77ca9-522c-4f59-876d-a63ea76bf5ce tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285bbd96190545c98a5cbaa2a01e3610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6052c3eaf4a11a415839aff00e71f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:48.463327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-10004c62-14ba-46bc-940c-03524a70cf81 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] Calling method '.version_select at 0x7f1e5b425040>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:48.468971 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fdb77ca9-522c-4f59-876d-a63ea76bf5ce tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] 10.222.0.93 "GET /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779" status: 200 len: 1323 microversion: 2.1 time: 0.501941 Aug 04 17:05:48.478139 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1424/2771] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:47 2022] GET /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779 => generated 1323 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:48.508092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1a9d04fc-59bc-4c96-879a-cf756b0a5861 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:48.509064 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1a9d04fc-59bc-4c96-879a-cf756b0a5861 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: 3c07f7b5-53ae-43c8-a0b6-3c5502e02c42] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:48.521589 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a9d04fc-59bc-4c96-879a-cf756b0a5861 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:48.523146 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-10004c62-14ba-46bc-940c-03524a70cf81 tempest-ServersTestFqdnHostnames-659185176 tempest-ServersTestFqdnHostnames-659185176-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-558239303" status: 202 len: 0 microversion: 2.1 time: 0.067340 Aug 04 17:05:48.527482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a9d04fc-59bc-4c96-879a-cf756b0a5861 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:48.527974 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1348/2772] 10.222.0.93 () {58 vars in 1218 bytes} [Thu Aug 4 17:05:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-558239303 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:05:48.528745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a9d04fc-59bc-4c96-879a-cf756b0a5861 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:48.529892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a9d04fc-59bc-4c96-879a-cf756b0a5861 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:48.533706 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a9d04fc-59bc-4c96-879a-cf756b0a5861 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:48.537346 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a9d04fc-59bc-4c96-879a-cf756b0a5861 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:48.540323 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d8628c1d-1c18-4a75-b706-2781f5584cde tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:48.540965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d8628c1d-1c18-4a75-b706-2781f5584cde tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: 90fd978f-f119-4293-b43e-2b0cf3aff18c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:48.558541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8628c1d-1c18-4a75-b706-2781f5584cde tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:48.559045 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8628c1d-1c18-4a75-b706-2781f5584cde tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:48.559492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8628c1d-1c18-4a75-b706-2781f5584cde tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:48.560210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8628c1d-1c18-4a75-b706-2781f5584cde tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:48.560679 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8628c1d-1c18-4a75-b706-2781f5584cde tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:48.562673 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8628c1d-1c18-4a75-b706-2781f5584cde tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:49.194132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1a9d04fc-59bc-4c96-879a-cf756b0a5861 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:49.196842 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d8628c1d-1c18-4a75-b706-2781f5584cde tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:49.205927 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1a9d04fc-59bc-4c96-879a-cf756b0a5861 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/3c07f7b5-53ae-43c8-a0b6-3c5502e02c42" status: 200 len: 1320 microversion: 2.1 time: 0.702965 Aug 04 17:05:49.206128 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d8628c1d-1c18-4a75-b706-2781f5584cde tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c" status: 200 len: 1333 microversion: 2.1 time: 0.672469 Aug 04 17:05:49.208031 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1425/2773] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:48 2022] GET /compute/v2.1/servers/3c07f7b5-53ae-43c8-a0b6-3c5502e02c42 => generated 1320 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:05:49.208601 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1349/2774] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:48 2022] GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c => generated 1333 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:49.220580 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2cb9a7b9-3610-40ca-b72f-187277851b0d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:49.223056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2cb9a7b9-3610-40ca-b72f-187277851b0d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 893dbe88-23f3-472b-a24f-67b4e8c18007] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:49.232657 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2cb9a7b9-3610-40ca-b72f-187277851b0d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:49.233931 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2cb9a7b9-3610-40ca-b72f-187277851b0d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:49.234699 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2cb9a7b9-3610-40ca-b72f-187277851b0d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:49.235595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2cb9a7b9-3610-40ca-b72f-187277851b0d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:49.236059 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2cb9a7b9-3610-40ca-b72f-187277851b0d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:49.236947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2cb9a7b9-3610-40ca-b72f-187277851b0d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:49.470826 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b271c296-dfb7-45e3-93df-bc13862ced24 tempest-ListImagesTestJSON-1831102553 tempest-ListImagesTestJSON-1831102553-project] Calling method '.version_select at 0x7f1e5b523a60>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:49.551922 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b271c296-dfb7-45e3-93df-bc13862ced24 tempest-ListImagesTestJSON-1831102553 tempest-ListImagesTestJSON-1831102553-project] 10.222.0.93 "GET /compute/v2.1/images/93ebc91d-2d7a-4ab2-b133-dcf9559166d9" status: 200 len: 784 microversion: 2.1 time: 0.283075 Aug 04 17:05:49.562316 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1350/2775] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:05:49 2022] GET /compute/v2.1/images/93ebc91d-2d7a-4ab2-b133-dcf9559166d9 => generated 784 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:49.567549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9f5f49ac-c2bf-4fe4-a115-4f6b818b228b tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:49.568175 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9f5f49ac-c2bf-4fe4-a115-4f6b818b228b tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:49.583504 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f5f49ac-c2bf-4fe4-a115-4f6b818b228b tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:49.584002 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f5f49ac-c2bf-4fe4-a115-4f6b818b228b tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:49.587978 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f5f49ac-c2bf-4fe4-a115-4f6b818b228b tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:49.588923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f5f49ac-c2bf-4fe4-a115-4f6b818b228b tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:49.589560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f5f49ac-c2bf-4fe4-a115-4f6b818b228b tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:49.590181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f5f49ac-c2bf-4fe4-a115-4f6b818b228b tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:49.667046 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2cb9a7b9-3610-40ca-b72f-187277851b0d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:49.680098 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2cb9a7b9-3610-40ca-b72f-187277851b0d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/893dbe88-23f3-472b-a24f-67b4e8c18007" status: 200 len: 1319 microversion: 2.1 time: 0.470009 Aug 04 17:05:49.681319 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1426/2776] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:49 2022] GET /compute/v2.1/servers/893dbe88-23f3-472b-a24f-67b4e8c18007 => generated 1319 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:49.688832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-03bdc641-7519-4f16-ab82-03b183a5bdb9 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:49.689716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-03bdc641-7519-4f16-ab82-03b183a5bdb9 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] [instance: 91cdc465-4194-4de5-b82e-2d5382b4e779] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:49.699701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03bdc641-7519-4f16-ab82-03b183a5bdb9 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:49.706312 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9f5f49ac-c2bf-4fe4-a115-4f6b818b228b tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:49.712803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03bdc641-7519-4f16-ab82-03b183a5bdb9 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:49.713267 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03bdc641-7519-4f16-ab82-03b183a5bdb9 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:49.714057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03bdc641-7519-4f16-ab82-03b183a5bdb9 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:49.717073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03bdc641-7519-4f16-ab82-03b183a5bdb9 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:49.718203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03bdc641-7519-4f16-ab82-03b183a5bdb9 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:49.721455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9f5f49ac-c2bf-4fe4-a115-4f6b818b228b tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:49.723727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9f5f49ac-c2bf-4fe4-a115-4f6b818b228b tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:49.726134 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9f5f49ac-c2bf-4fe4-a115-4f6b818b228b tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1605 microversion: 2.32 time: 0.161766 Aug 04 17:05:49.727378 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1351/2777] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:05:49 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1605 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:05:49.738903 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a0842e76-e137-41ac-9a3b-97ca362613f3 tempest-ListImagesTestJSON-1831102553 tempest-ListImagesTestJSON-1831102553-project] Calling method '.version_select at 0x7f1e5bfdb790>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:49.855332 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a0842e76-e137-41ac-9a3b-97ca362613f3 tempest-ListImagesTestJSON-1831102553 tempest-ListImagesTestJSON-1831102553-project] 10.222.0.93 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.126227 Aug 04 17:05:49.856650 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1352/2778] 10.222.0.93 () {58 vars in 1122 bytes} [Thu Aug 4 17:05:49 2022] GET /compute/v2.1/images => generated 445 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:49.869886 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-589e1b1b-ab8d-4318-bdf0-ad0af74c118f tempest-ListImagesTestJSON-1831102553 tempest-ListImagesTestJSON-1831102553-project] Calling method '.version_select at 0x7f1e5b6dd280>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:49.870819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:49.956001 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-589e1b1b-ab8d-4318-bdf0-ad0af74c118f tempest-ListImagesTestJSON-1831102553 tempest-ListImagesTestJSON-1831102553-project] 10.222.0.93 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.090773 Aug 04 17:05:49.957265 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1353/2779] 10.222.0.93 () {58 vars in 1143 bytes} [Thu Aug 4 17:05:49 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:50.145084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-03bdc641-7519-4f16-ab82-03b183a5bdb9 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285bbd96190545c98a5cbaa2a01e3610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6052c3eaf4a11a415839aff00e71f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:50.160902 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-03bdc641-7519-4f16-ab82-03b183a5bdb9 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] 10.222.0.93 "GET /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779" status: 200 len: 1323 microversion: 2.1 time: 0.477571 Aug 04 17:05:50.162040 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1427/2780] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:49 2022] GET /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779 => generated 1323 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:50.229082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8aca0eb8-bf8a-4519-afd0-4e766b6eb905 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:50.229722 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8aca0eb8-bf8a-4519-afd0-4e766b6eb905 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: 3c07f7b5-53ae-43c8-a0b6-3c5502e02c42] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:50.241013 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8aca0eb8-bf8a-4519-afd0-4e766b6eb905 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:50.241529 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8aca0eb8-bf8a-4519-afd0-4e766b6eb905 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:50.241992 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8aca0eb8-bf8a-4519-afd0-4e766b6eb905 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:50.242719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8aca0eb8-bf8a-4519-afd0-4e766b6eb905 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:50.243184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8aca0eb8-bf8a-4519-afd0-4e766b6eb905 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:50.243621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8aca0eb8-bf8a-4519-afd0-4e766b6eb905 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:50.251829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ba0df898-2938-4232-836c-9914e3045ada tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:50.252474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ba0df898-2938-4232-836c-9914e3045ada tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: 90fd978f-f119-4293-b43e-2b0cf3aff18c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:50.261634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba0df898-2938-4232-836c-9914e3045ada tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:50.267899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba0df898-2938-4232-836c-9914e3045ada tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:50.268365 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba0df898-2938-4232-836c-9914e3045ada tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:50.272129 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba0df898-2938-4232-836c-9914e3045ada tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:50.272632 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba0df898-2938-4232-836c-9914e3045ada tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:50.273077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba0df898-2938-4232-836c-9914e3045ada tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:50.765663 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ba0df898-2938-4232-836c-9914e3045ada tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:50.782273 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ba0df898-2938-4232-836c-9914e3045ada tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c" status: 200 len: 1333 microversion: 2.1 time: 0.534071 Aug 04 17:05:50.782919 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1428/2781] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:50 2022] GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c => generated 1333 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:05:50.791922 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8aca0eb8-bf8a-4519-afd0-4e766b6eb905 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:50.800844 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8aca0eb8-bf8a-4519-afd0-4e766b6eb905 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/3c07f7b5-53ae-43c8-a0b6-3c5502e02c42" status: 200 len: 1320 microversion: 2.1 time: 0.576663 Aug 04 17:05:50.806820 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-36d5ca33-d254-412e-8f82-2ed61e696da5 req-64753508-1776-4808-bd4c-4753c271e126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91cdc465-4194-4de5-b82e-2d5382b4e779", "name": "network-vif-plugged", "status": "completed", "tag": "241e9c15-423e-4c5c-8c22-a0d8f621d376"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:50.810781 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1354/2782] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:50 2022] GET /compute/v2.1/servers/3c07f7b5-53ae-43c8-a0b6-3c5502e02c42 => generated 1320 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:50.816231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b88de629-6599-4268-8240-9557d84ebdc4 req-1ebdf2f7-bbb1-49ef-bc69-5930e177b420 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c07f7b5-53ae-43c8-a0b6-3c5502e02c42", "tag": "9d5167e5-e571-43e2-9d9e-67c4cc47d93c"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:50.828519 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-36d5ca33-d254-412e-8f82-2ed61e696da5 req-64753508-1776-4808-bd4c-4753c271e126 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:50.829161 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-36d5ca33-d254-412e-8f82-2ed61e696da5 req-64753508-1776-4808-bd4c-4753c271e126 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:50.829451 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-36d5ca33-d254-412e-8f82-2ed61e696da5 req-64753508-1776-4808-bd4c-4753c271e126 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:50.840056 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b88de629-6599-4268-8240-9557d84ebdc4 req-1ebdf2f7-bbb1-49ef-bc69-5930e177b420 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:50.840900 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b88de629-6599-4268-8240-9557d84ebdc4 req-1ebdf2f7-bbb1-49ef-bc69-5930e177b420 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:50.841397 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b88de629-6599-4268-8240-9557d84ebdc4 req-1ebdf2f7-bbb1-49ef-bc69-5930e177b420 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:50.860869 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-36d5ca33-d254-412e-8f82-2ed61e696da5 req-64753508-1776-4808-bd4c-4753c271e126 service nova] Creating event network-vif-plugged:241e9c15-423e-4c5c-8c22-a0d8f621d376 for instance 91cdc465-4194-4de5-b82e-2d5382b4e779 on n-h2-851359-3 Aug 04 17:05:50.867715 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b88de629-6599-4268-8240-9557d84ebdc4 req-1ebdf2f7-bbb1-49ef-bc69-5930e177b420 service nova] Creating event network-changed:9d5167e5-e571-43e2-9d9e-67c4cc47d93c for instance 3c07f7b5-53ae-43c8-a0b6-3c5502e02c42 on n-h1-851359-3 Aug 04 17:05:50.873098 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-36d5ca33-d254-412e-8f82-2ed61e696da5 req-64753508-1776-4808-bd4c-4753c271e126 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072573 Aug 04 17:05:50.874524 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1429/2783] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:50.884377 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b88de629-6599-4268-8240-9557d84ebdc4 req-1ebdf2f7-bbb1-49ef-bc69-5930e177b420 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069376 Aug 04 17:05:50.885381 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1355/2784] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:50.889208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5045cef2-441e-43c6-aded-72e24a33bcae tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:50.892863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5045cef2-441e-43c6-aded-72e24a33bcae tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 893dbe88-23f3-472b-a24f-67b4e8c18007] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:50.902909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-689b6a57-d6dd-49e6-b0f7-9b6addb04953 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:50.905833 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-689b6a57-d6dd-49e6-b0f7-9b6addb04953 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:50.913794 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5045cef2-441e-43c6-aded-72e24a33bcae tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:50.914349 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5045cef2-441e-43c6-aded-72e24a33bcae tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:50.914793 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5045cef2-441e-43c6-aded-72e24a33bcae tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:50.915692 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5045cef2-441e-43c6-aded-72e24a33bcae tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:50.916385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5045cef2-441e-43c6-aded-72e24a33bcae tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:50.917288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5045cef2-441e-43c6-aded-72e24a33bcae tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:50.924376 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-689b6a57-d6dd-49e6-b0f7-9b6addb04953 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:50.924882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-689b6a57-d6dd-49e6-b0f7-9b6addb04953 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:50.925362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-689b6a57-d6dd-49e6-b0f7-9b6addb04953 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:50.929194 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-689b6a57-d6dd-49e6-b0f7-9b6addb04953 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:50.929686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-689b6a57-d6dd-49e6-b0f7-9b6addb04953 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:50.934347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-689b6a57-d6dd-49e6-b0f7-9b6addb04953 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:51.097097 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-689b6a57-d6dd-49e6-b0f7-9b6addb04953 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:51.111741 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-689b6a57-d6dd-49e6-b0f7-9b6addb04953 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:51.121894 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-689b6a57-d6dd-49e6-b0f7-9b6addb04953 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:51.127273 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-689b6a57-d6dd-49e6-b0f7-9b6addb04953 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1605 microversion: 2.32 time: 0.237406 Aug 04 17:05:51.136285 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1356/2785] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:05:50 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1605 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:05:51.185306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-81f35681-90a3-4772-8ae4-6ee21e7b8c72 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:51.187127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-81f35681-90a3-4772-8ae4-6ee21e7b8c72 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] [instance: 91cdc465-4194-4de5-b82e-2d5382b4e779] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:51.203633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81f35681-90a3-4772-8ae4-6ee21e7b8c72 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:51.204058 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81f35681-90a3-4772-8ae4-6ee21e7b8c72 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:51.204509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81f35681-90a3-4772-8ae4-6ee21e7b8c72 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:51.205424 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81f35681-90a3-4772-8ae4-6ee21e7b8c72 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:51.210858 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81f35681-90a3-4772-8ae4-6ee21e7b8c72 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:51.211882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81f35681-90a3-4772-8ae4-6ee21e7b8c72 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:51.443655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5045cef2-441e-43c6-aded-72e24a33bcae tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:51.458212 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5045cef2-441e-43c6-aded-72e24a33bcae tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/893dbe88-23f3-472b-a24f-67b4e8c18007" status: 200 len: 1319 microversion: 2.1 time: 0.579368 Aug 04 17:05:51.471001 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1430/2786] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:50 2022] GET /compute/v2.1/servers/893dbe88-23f3-472b-a24f-67b4e8c18007 => generated 1319 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:51.589478 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-81f35681-90a3-4772-8ae4-6ee21e7b8c72 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285bbd96190545c98a5cbaa2a01e3610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6052c3eaf4a11a415839aff00e71f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:51.607075 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-81f35681-90a3-4772-8ae4-6ee21e7b8c72 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] 10.222.0.93 "GET /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779" status: 200 len: 1323 microversion: 2.1 time: 0.421445 Aug 04 17:05:51.607730 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1357/2787] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:51 2022] GET /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779 => generated 1323 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:51.803901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-74085c66-1e9f-4249-b1a2-2b22296ca432 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:51.804137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-74085c66-1e9f-4249-b1a2-2b22296ca432 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: 90fd978f-f119-4293-b43e-2b0cf3aff18c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:51.814581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-74085c66-1e9f-4249-b1a2-2b22296ca432 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:51.815715 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-74085c66-1e9f-4249-b1a2-2b22296ca432 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:51.816316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-74085c66-1e9f-4249-b1a2-2b22296ca432 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:51.817197 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-74085c66-1e9f-4249-b1a2-2b22296ca432 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:51.818622 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-74085c66-1e9f-4249-b1a2-2b22296ca432 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:51.819004 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-74085c66-1e9f-4249-b1a2-2b22296ca432 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:51.835891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1b5d171f-0d5a-4eca-95c7-e537a4354567 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:51.836516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1b5d171f-0d5a-4eca-95c7-e537a4354567 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: 3c07f7b5-53ae-43c8-a0b6-3c5502e02c42] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:51.847543 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b5d171f-0d5a-4eca-95c7-e537a4354567 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:51.849030 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b5d171f-0d5a-4eca-95c7-e537a4354567 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:51.849507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b5d171f-0d5a-4eca-95c7-e537a4354567 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:51.852554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b5d171f-0d5a-4eca-95c7-e537a4354567 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:51.853059 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b5d171f-0d5a-4eca-95c7-e537a4354567 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:51.853589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b5d171f-0d5a-4eca-95c7-e537a4354567 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:52.463147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-74085c66-1e9f-4249-b1a2-2b22296ca432 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:52.474180 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-74085c66-1e9f-4249-b1a2-2b22296ca432 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c" status: 200 len: 1333 microversion: 2.1 time: 0.673384 Aug 04 17:05:52.474799 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1431/2788] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:51 2022] GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c => generated 1333 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:52.484456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-43b755d1-3bea-4222-9448-32c3427da8e4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:52.489906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-43b755d1-3bea-4222-9448-32c3427da8e4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:52.507278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-43b755d1-3bea-4222-9448-32c3427da8e4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:52.507834 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-43b755d1-3bea-4222-9448-32c3427da8e4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:52.508279 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-43b755d1-3bea-4222-9448-32c3427da8e4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:52.509032 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-43b755d1-3bea-4222-9448-32c3427da8e4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:52.509490 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-43b755d1-3bea-4222-9448-32c3427da8e4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:52.515959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-43b755d1-3bea-4222-9448-32c3427da8e4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:52.523682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1b5d171f-0d5a-4eca-95c7-e537a4354567 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:52.531262 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1b5d171f-0d5a-4eca-95c7-e537a4354567 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/3c07f7b5-53ae-43c8-a0b6-3c5502e02c42" status: 200 len: 1320 microversion: 2.1 time: 0.699450 Aug 04 17:05:52.548019 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1358/2789] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:51 2022] GET /compute/v2.1/servers/3c07f7b5-53ae-43c8-a0b6-3c5502e02c42 => generated 1320 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:05:52.553286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6feb9417-b5fe-46bf-be61-c41afffc7abc tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:52.556852 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6feb9417-b5fe-46bf-be61-c41afffc7abc tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 893dbe88-23f3-472b-a24f-67b4e8c18007] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:52.569205 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6feb9417-b5fe-46bf-be61-c41afffc7abc tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:52.570114 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6feb9417-b5fe-46bf-be61-c41afffc7abc tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:52.572032 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6feb9417-b5fe-46bf-be61-c41afffc7abc tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:52.573358 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6feb9417-b5fe-46bf-be61-c41afffc7abc tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:52.577281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6feb9417-b5fe-46bf-be61-c41afffc7abc tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:52.580495 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6feb9417-b5fe-46bf-be61-c41afffc7abc tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:52.697372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-43b755d1-3bea-4222-9448-32c3427da8e4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:52.711552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-43b755d1-3bea-4222-9448-32c3427da8e4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:52.716371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-43b755d1-3bea-4222-9448-32c3427da8e4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:52.719927 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-43b755d1-3bea-4222-9448-32c3427da8e4 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1605 microversion: 2.32 time: 0.244158 Aug 04 17:05:52.741363 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1432/2790] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:05:52 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1605 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:05:52.751492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6c2cdbd8-edba-421e-94fb-d7ca2c3ae6ed tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:52.753796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6c2cdbd8-edba-421e-94fb-d7ca2c3ae6ed tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] [instance: 91cdc465-4194-4de5-b82e-2d5382b4e779] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:52.768318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c2cdbd8-edba-421e-94fb-d7ca2c3ae6ed tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:52.771805 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c2cdbd8-edba-421e-94fb-d7ca2c3ae6ed tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:52.772528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c2cdbd8-edba-421e-94fb-d7ca2c3ae6ed tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:52.774335 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c2cdbd8-edba-421e-94fb-d7ca2c3ae6ed tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:52.776552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c2cdbd8-edba-421e-94fb-d7ca2c3ae6ed tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:52.777901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c2cdbd8-edba-421e-94fb-d7ca2c3ae6ed tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:52.945077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6feb9417-b5fe-46bf-be61-c41afffc7abc tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:52.958809 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6feb9417-b5fe-46bf-be61-c41afffc7abc tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/893dbe88-23f3-472b-a24f-67b4e8c18007" status: 200 len: 1468 microversion: 2.1 time: 0.409127 Aug 04 17:05:52.959522 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1359/2791] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:52 2022] GET /compute/v2.1/servers/893dbe88-23f3-472b-a24f-67b4e8c18007 => generated 1468 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:52.983098 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d52e407f-a1fa-47b1-a015-e20953af4db3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:52.983727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d52e407f-a1fa-47b1-a015-e20953af4db3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 2898397c-98e0-416d-b35d-18984c4730e2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:52.995141 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d52e407f-a1fa-47b1-a015-e20953af4db3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:52.995710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d52e407f-a1fa-47b1-a015-e20953af4db3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:52.996163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d52e407f-a1fa-47b1-a015-e20953af4db3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:52.996903 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d52e407f-a1fa-47b1-a015-e20953af4db3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:52.997362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d52e407f-a1fa-47b1-a015-e20953af4db3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:52.997787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d52e407f-a1fa-47b1-a015-e20953af4db3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:53.320848 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6c2cdbd8-edba-421e-94fb-d7ca2c3ae6ed tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285bbd96190545c98a5cbaa2a01e3610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6052c3eaf4a11a415839aff00e71f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:53.329673 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6c2cdbd8-edba-421e-94fb-d7ca2c3ae6ed tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] 10.222.0.93 "GET /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779" status: 200 len: 1323 microversion: 2.1 time: 0.586946 Aug 04 17:05:53.332731 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1433/2792] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:52 2022] GET /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779 => generated 1323 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:53.344522 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-62a4f5c0-0dea-4ff5-ba9a-f5a463f410c0 req-02b8f0d9-91b5-4b4e-9368-e7d5df2fb1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90fd978f-f119-4293-b43e-2b0cf3aff18c", "name": "network-vif-plugged", "status": "completed", "tag": "cbb9d642-fe31-4c61-b558-e471183d26a4"}, {"server_uuid": "90fd978f-f119-4293-b43e-2b0cf3aff18c", "name": "network-vif-plugged", "status": "completed", "tag": "88598e0e-8988-41cd-afdf-18e2cadc4c97"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:53.367202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=4 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:53.376463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-62a4f5c0-0dea-4ff5-ba9a-f5a463f410c0 req-02b8f0d9-91b5-4b4e-9368-e7d5df2fb1f5 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:53.377466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-62a4f5c0-0dea-4ff5-ba9a-f5a463f410c0 req-02b8f0d9-91b5-4b4e-9368-e7d5df2fb1f5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:53.377934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-62a4f5c0-0dea-4ff5-ba9a-f5a463f410c0 req-02b8f0d9-91b5-4b4e-9368-e7d5df2fb1f5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:53.410953 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-62a4f5c0-0dea-4ff5-ba9a-f5a463f410c0 req-02b8f0d9-91b5-4b4e-9368-e7d5df2fb1f5 service nova] Creating event network-vif-plugged:cbb9d642-fe31-4c61-b558-e471183d26a4 for instance 90fd978f-f119-4293-b43e-2b0cf3aff18c on n-h1-851359-3 Aug 04 17:05:53.413764 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-62a4f5c0-0dea-4ff5-ba9a-f5a463f410c0 req-02b8f0d9-91b5-4b4e-9368-e7d5df2fb1f5 service nova] Creating event network-vif-plugged:88598e0e-8988-41cd-afdf-18e2cadc4c97 for instance 90fd978f-f119-4293-b43e-2b0cf3aff18c on n-h1-851359-3 Aug 04 17:05:53.428763 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-62a4f5c0-0dea-4ff5-ba9a-f5a463f410c0 req-02b8f0d9-91b5-4b4e-9368-e7d5df2fb1f5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.092855 Aug 04 17:05:53.432245 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1434/2793] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:53.452322 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-a2a411d5-7ef1-4e20-82df-5828b733be15 req-925821e3-e5ba-4803-9330-30b3630c5577 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d282ccab-7827-4b5e-8ba7-b1600d5140bf", "tag": "4e302672-974c-496d-bdd8-b15b1245f517"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:53.480438 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a2a411d5-7ef1-4e20-82df-5828b733be15 req-925821e3-e5ba-4803-9330-30b3630c5577 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:53.484821 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a2a411d5-7ef1-4e20-82df-5828b733be15 req-925821e3-e5ba-4803-9330-30b3630c5577 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:53.485486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a2a411d5-7ef1-4e20-82df-5828b733be15 req-925821e3-e5ba-4803-9330-30b3630c5577 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:53.512708 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-a2a411d5-7ef1-4e20-82df-5828b733be15 req-925821e3-e5ba-4803-9330-30b3630c5577 service nova] Creating event network-changed:4e302672-974c-496d-bdd8-b15b1245f517 for instance d282ccab-7827-4b5e-8ba7-b1600d5140bf on n-h1-851359-3 Aug 04 17:05:53.525853 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-a2a411d5-7ef1-4e20-82df-5828b733be15 req-925821e3-e5ba-4803-9330-30b3630c5577 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089950 Aug 04 17:05:53.543171 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1435/2794] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:53.563753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2e9e79b5-1687-4940-843c-6b37e6c3f95b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:53.564716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2e9e79b5-1687-4940-843c-6b37e6c3f95b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: 90fd978f-f119-4293-b43e-2b0cf3aff18c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:53.582202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2e9e79b5-1687-4940-843c-6b37e6c3f95b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:53.583981 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2e9e79b5-1687-4940-843c-6b37e6c3f95b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:53.584454 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2e9e79b5-1687-4940-843c-6b37e6c3f95b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:53.585193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2e9e79b5-1687-4940-843c-6b37e6c3f95b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:53.585494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d52e407f-a1fa-47b1-a015-e20953af4db3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:53.585667 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2e9e79b5-1687-4940-843c-6b37e6c3f95b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:53.589614 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2e9e79b5-1687-4940-843c-6b37e6c3f95b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:53.596712 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d52e407f-a1fa-47b1-a015-e20953af4db3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/2898397c-98e0-416d-b35d-18984c4730e2" status: 200 len: 1469 microversion: 2.1 time: 0.617939 Aug 04 17:05:53.602017 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1360/2795] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:52 2022] GET /compute/v2.1/servers/2898397c-98e0-416d-b35d-18984c4730e2 => generated 1469 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:05:53.611361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-01849445-c579-4a84-9d71-69ecd83663e3 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:53.612093 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-01849445-c579-4a84-9d71-69ecd83663e3 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: 3c07f7b5-53ae-43c8-a0b6-3c5502e02c42] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:53.629004 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01849445-c579-4a84-9d71-69ecd83663e3 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:53.631480 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01849445-c579-4a84-9d71-69ecd83663e3 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:53.632940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01849445-c579-4a84-9d71-69ecd83663e3 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:53.636227 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01849445-c579-4a84-9d71-69ecd83663e3 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:53.636923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01849445-c579-4a84-9d71-69ecd83663e3 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:53.637578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01849445-c579-4a84-9d71-69ecd83663e3 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:53.942976 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2e9e79b5-1687-4940-843c-6b37e6c3f95b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:53.952925 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2e9e79b5-1687-4940-843c-6b37e6c3f95b tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c" status: 200 len: 1333 microversion: 2.1 time: 0.401593 Aug 04 17:05:53.953748 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1436/2796] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:53 2022] GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c => generated 1333 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:53.985964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9e23c0a4-7e84-48f7-a1e9-9953c3646224 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:54.019198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9e23c0a4-7e84-48f7-a1e9-9953c3646224 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:54.020393 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9e23c0a4-7e84-48f7-a1e9-9953c3646224 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Searching by: {'reservation_id': 'r-q3lojpwh', 'deleted': False, 'project_id': 'de328615cef94528b55b8309dd9b82b0'} {{(pid=131043) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:05:54.029672 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-01849445-c579-4a84-9d71-69ecd83663e3 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:54.038528 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-01849445-c579-4a84-9d71-69ecd83663e3 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/3c07f7b5-53ae-43c8-a0b6-3c5502e02c42" status: 200 len: 1320 microversion: 2.1 time: 0.435347 Aug 04 17:05:54.054013 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1361/2797] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:53 2022] GET /compute/v2.1/servers/3c07f7b5-53ae-43c8-a0b6-3c5502e02c42 => generated 1320 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:54.054013 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6ede2a5d-6c71-47da-af29-7c8a29dffb02 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:54.054013 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6ede2a5d-6c71-47da-af29-7c8a29dffb02 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:54.054790 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e23c0a4-7e84-48f7-a1e9-9953c3646224 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:54.054790 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e23c0a4-7e84-48f7-a1e9-9953c3646224 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:54.054790 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e23c0a4-7e84-48f7-a1e9-9953c3646224 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:54.063818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e23c0a4-7e84-48f7-a1e9-9953c3646224 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:54.064342 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e23c0a4-7e84-48f7-a1e9-9953c3646224 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:54.064791 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e23c0a4-7e84-48f7-a1e9-9953c3646224 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:54.068165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ede2a5d-6c71-47da-af29-7c8a29dffb02 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:54.080735 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ede2a5d-6c71-47da-af29-7c8a29dffb02 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:54.081642 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ede2a5d-6c71-47da-af29-7c8a29dffb02 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:54.082671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ede2a5d-6c71-47da-af29-7c8a29dffb02 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:54.083618 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ede2a5d-6c71-47da-af29-7c8a29dffb02 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:54.084147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ede2a5d-6c71-47da-af29-7c8a29dffb02 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:54.251863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6ede2a5d-6c71-47da-af29-7c8a29dffb02 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:54.268141 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6ede2a5d-6c71-47da-af29-7c8a29dffb02 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:54.270169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6ede2a5d-6c71-47da-af29-7c8a29dffb02 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dcf3d21bb40468f8f9e087fbd99152e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3928c7e72ed440aafbbfd6c2a269906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:54.271444 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6ede2a5d-6c71-47da-af29-7c8a29dffb02 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 200 len: 1605 microversion: 2.32 time: 0.228208 Aug 04 17:05:54.273486 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1362/2798] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:05:54 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 1605 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:05:54.344614 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.multi_cell_list [None req-9e23c0a4-7e84-48f7-a1e9-9953c3646224 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:05:54.353588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ece3e3ea-7ce8-4351-be00-437983ae01e7 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:54.361259 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ece3e3ea-7ce8-4351-be00-437983ae01e7 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] [instance: 91cdc465-4194-4de5-b82e-2d5382b4e779] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:54.373801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ece3e3ea-7ce8-4351-be00-437983ae01e7 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:54.377161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ece3e3ea-7ce8-4351-be00-437983ae01e7 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:54.377866 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ece3e3ea-7ce8-4351-be00-437983ae01e7 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:54.392208 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ece3e3ea-7ce8-4351-be00-437983ae01e7 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:54.392913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ece3e3ea-7ce8-4351-be00-437983ae01e7 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:54.394489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ece3e3ea-7ce8-4351-be00-437983ae01e7 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:54.469518 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9e23c0a4-7e84-48f7-a1e9-9953c3646224 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:54.478374 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e23c0a4-7e84-48f7-a1e9-9953c3646224 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:54.478875 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e23c0a4-7e84-48f7-a1e9-9953c3646224 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:54.481070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e23c0a4-7e84-48f7-a1e9-9953c3646224 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:55.011442 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9e23c0a4-7e84-48f7-a1e9-9953c3646224 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/detail?reservation_id=r-q3lojpwh" status: 200 len: 2930 microversion: 2.1 time: 1.055551 Aug 04 17:05:55.013346 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1437/2799] 10.222.0.93 () {58 vars in 1197 bytes} [Thu Aug 4 17:05:53 2022] GET /compute/v2.1/servers/detail?reservation_id=r-q3lojpwh => generated 2930 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:55.020764 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-31e37163-c99c-4322-9109-7ac3a9496f17 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:55.021813 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-31e37163-c99c-4322-9109-7ac3a9496f17 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: 90fd978f-f119-4293-b43e-2b0cf3aff18c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:55.030225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31e37163-c99c-4322-9109-7ac3a9496f17 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:55.031119 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31e37163-c99c-4322-9109-7ac3a9496f17 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:55.031652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31e37163-c99c-4322-9109-7ac3a9496f17 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:55.033173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31e37163-c99c-4322-9109-7ac3a9496f17 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:55.033173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31e37163-c99c-4322-9109-7ac3a9496f17 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:55.034002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31e37163-c99c-4322-9109-7ac3a9496f17 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:55.095477 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ece3e3ea-7ce8-4351-be00-437983ae01e7 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285bbd96190545c98a5cbaa2a01e3610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6052c3eaf4a11a415839aff00e71f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:55.118475 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ece3e3ea-7ce8-4351-be00-437983ae01e7 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] 10.222.0.93 "GET /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779" status: 200 len: 1520 microversion: 2.1 time: 0.768908 Aug 04 17:05:55.119670 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1363/2800] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:54 2022] GET /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779 => generated 1520 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:55.125434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-28f90ad5-4465-4642-9320-ef98cbd0d124 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:55.167139 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.compute.server_groups [None req-28f90ad5-4465-4642-9320-ef98cbd0d124 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Querying cell 435e901d-6672-4284-ad57-58e647e6e99d(cell1) for 2 instances {{(pid=131044) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 04 17:05:55.168075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28f90ad5-4465-4642-9320-ef98cbd0d124 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:55.168727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28f90ad5-4465-4642-9320-ef98cbd0d124 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:55.169363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28f90ad5-4465-4642-9320-ef98cbd0d124 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:55.187117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:55.208035 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-28f90ad5-4465-4642-9320-ef98cbd0d124 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/os-server-groups/2e210599-cdc6-4676-8885-f80832369267" status: 200 len: 265 microversion: 2.1 time: 0.087255 Aug 04 17:05:55.209340 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1364/2801] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Aug 4 17:05:55 2022] GET /compute/v2.1/os-server-groups/2e210599-cdc6-4676-8885-f80832369267 => generated 265 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:55.223356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-527894cc-5fef-44ec-8bc4-a45b1fa6d7b7 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:55.225057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-527894cc-5fef-44ec-8bc4-a45b1fa6d7b7 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: 3c07f7b5-53ae-43c8-a0b6-3c5502e02c42] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:55.234422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-527894cc-5fef-44ec-8bc4-a45b1fa6d7b7 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:55.235160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-527894cc-5fef-44ec-8bc4-a45b1fa6d7b7 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:55.236181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-527894cc-5fef-44ec-8bc4-a45b1fa6d7b7 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:55.237260 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-527894cc-5fef-44ec-8bc4-a45b1fa6d7b7 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:55.237915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-527894cc-5fef-44ec-8bc4-a45b1fa6d7b7 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:55.238551 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-527894cc-5fef-44ec-8bc4-a45b1fa6d7b7 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:55.350102 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-31e37163-c99c-4322-9109-7ac3a9496f17 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:55.354381 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:55.362759 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-31e37163-c99c-4322-9109-7ac3a9496f17 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c" status: 200 len: 1333 microversion: 2.1 time: 0.347367 Aug 04 17:05:55.365024 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1438/2802] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:55 2022] GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c => generated 1333 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:55.369823 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-404916e8-684c-4a97-8508-0df948702265 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:55.370777 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-404916e8-684c-4a97-8508-0df948702265 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] [instance: 893dbe88-23f3-472b-a24f-67b4e8c18007] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:55.377625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-404916e8-684c-4a97-8508-0df948702265 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:55.378423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-404916e8-684c-4a97-8508-0df948702265 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:55.379098 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-404916e8-684c-4a97-8508-0df948702265 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:55.380082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-404916e8-684c-4a97-8508-0df948702265 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:55.380770 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-404916e8-684c-4a97-8508-0df948702265 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:55.381529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-404916e8-684c-4a97-8508-0df948702265 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:55.691448 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-527894cc-5fef-44ec-8bc4-a45b1fa6d7b7 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:55.699405 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-527894cc-5fef-44ec-8bc4-a45b1fa6d7b7 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/3c07f7b5-53ae-43c8-a0b6-3c5502e02c42" status: 200 len: 1320 microversion: 2.1 time: 0.488720 Aug 04 17:05:55.707961 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1365/2803] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:55 2022] GET /compute/v2.1/servers/3c07f7b5-53ae-43c8-a0b6-3c5502e02c42 => generated 1320 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:55.712854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cbc82399-5c14-4911-b1f1-3d2be87928d0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:55.713663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cbc82399-5c14-4911-b1f1-3d2be87928d0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:55.725659 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbc82399-5c14-4911-b1f1-3d2be87928d0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:55.738810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbc82399-5c14-4911-b1f1-3d2be87928d0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:55.739522 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbc82399-5c14-4911-b1f1-3d2be87928d0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:55.740474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbc82399-5c14-4911-b1f1-3d2be87928d0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:55.741103 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbc82399-5c14-4911-b1f1-3d2be87928d0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:55.741707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbc82399-5c14-4911-b1f1-3d2be87928d0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:55.757956 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-cbc82399-5c14-4911-b1f1-3d2be87928d0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] HTTP exception thrown: Instance 238cb283-0037-440c-a433-d3f4e3de1274 could not be found. Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cbc82399-5c14-4911-b1f1-3d2be87928d0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Request method failure captured: Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 HTTP/1.1 Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_q-Ue6VMDa_iMNINJR4zf0i_CKtIwGuQvgOgsq8hwYYxmEM4QNYnzVbdzIdGnhCeGRVDv_B0NSNojPa3PpHI00NRYaaP348KeE80sy3s9E2gDLXW3xGQa9ki0Q_RJ2otPyPOdobZN03Z7KOumKku5Pmr9v0PMyOnl2u8HtvwQKNxwE Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.32 Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: d3928c7e72ed440aafbbfd6c2a269906 Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TaggedBootDevicesTest-31982629 Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d3928c7e72ed440aafbbfd6c2a269906"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d3928c7e72ed440aafbbfd6c2a269906"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d3928c7e72ed440aafbbfd6c2a269906"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d3928c7e72ed440aafbbfd6c2a269906"}]}] Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TaggedBootDevicesTest-31982629 Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: d3928c7e72ed440aafbbfd6c2a269906 Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TaggedBootDevicesTest-31982629 Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TaggedBootDevicesTest-31982629-project Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 2dcf3d21bb40468f8f9e087fbd99152e Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TaggedBootDevicesTest-31982629-project Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 238cb283-0037-440c-a433-d3f4e3de1274 could not be found. Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '238cb283-0037-440c-a433-d3f4e3de1274'} Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 238cb283-0037-440c-a433-d3f4e3de1274 could not be found. Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 238cb283-0037-440c-a433-d3f4e3de1274 could not be found. Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:55.759899 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:55.763804 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:55.763804 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:55.763804 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:55.763804 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:05:55.763804 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:05:55.763804 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 238cb283-0037-440c-a433-d3f4e3de1274 could not be found. Aug 04 17:05:55.763804 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:55.766492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cbc82399-5c14-4911-b1f1-3d2be87928d0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Returning 404 to user: Instance 238cb283-0037-440c-a433-d3f4e3de1274 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:05:55.767605 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cbc82399-5c14-4911-b1f1-3d2be87928d0 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 404 len: 111 microversion: 2.32 time: 0.058500 Aug 04 17:05:55.768814 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1366/2804] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:05:55 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:05:55.773558 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-efb7d1e5-40f1-42f1-ab09-d9e238d542d3 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2109114741", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "ad0d847a-dcbc-4a66-b070-8e9e3359e37a"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-efb7d1e5-40f1-42f1-ab09-d9e238d542d3 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Request method failure captured: Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 243 Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_xUwumIVWtimvZYWFrX4r61mtlOKWlgaZMkq0RqJ3Y0Iw1toH2NyPPhGPhgvQp4qsO69gOnD9qoaI_HyGV2vrUSaCB38GNX6oHiuPTepYxK1cFsDLaLcGtYdDvulsJ99F5qddCfBCkDZaji30DPqMEjgoNHQM9741nN0l1-pRYtLZ8 Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 10c6052c3eaf4a11a415839aff00e71f Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1570836876 Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/10c6052c3eaf4a11a415839aff00e71f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/10c6052c3eaf4a11a415839aff00e71f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_10c6052c3eaf4a11a415839aff00e71f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/10c6052c3eaf4a11a415839aff00e71f"}]}] Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1570836876 Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 10c6052c3eaf4a11a415839aff00e71f Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1570836876 Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServerMetadataNegativeTestJSON-1570836876-project Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 285bbd96190545c98a5cbaa2a01e3610 Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1570836876-project Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2109114741", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "ad0d847a-dcbc-4a66-b070-8e9e3359e37a"}]}} Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2109114741', 'imageRef': '93ebc91d-2d7a-4ab2-b133-dcf9559166d9', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'ad0d847a-dcbc-4a66-b070-8e9e3359e37a'}]}}} Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:05:55.778009 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:05:55.783681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:05:55.783681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:05:55.783681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:05:55.783681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:05:55.783681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:05:55.783681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:05:55.783681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:05:55.783681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 17:05:55.783681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:55.783681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:55.783681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:55.783681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:55.783681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:55.783681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:55.783681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:05:55.783681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:05:55.783681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 17:05:55.783681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:55.783681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-efb7d1e5-40f1-42f1-ab09-d9e238d542d3 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:05:55.783681 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-efb7d1e5-40f1-42f1-ab09-d9e238d542d3 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.013620 Aug 04 17:05:55.796518 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1367/2805] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:05:55 2022] POST /compute/v2.1/servers => generated 175 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:05:55.796518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f2496aa3-f475-4bcb-8a9a-de346ee4f652 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '.version_select at 0x7f1e5b4eaf70>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:55.819511 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f2496aa3-f475-4bcb-8a9a-de346ee4f652 tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1512317566" status: 204 len: 0 microversion: 2.32 time: 0.032617 Aug 04 17:05:55.820775 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1368/2806] 10.222.0.93 () {60 vars in 1262 bytes} [Thu Aug 4 17:05:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1512317566 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:05:55.827914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0e1fd258-000a-43ab-b952-ad250b16f1b4 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:55.828650 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0e1fd258-000a-43ab-b952-ad250b16f1b4 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] [instance: 52cfa6dd-1379-4d0a-8bcd-adb6f45805bb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:55.837015 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-0e1fd258-000a-43ab-b952-ad250b16f1b4 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] HTTP exception thrown: Instance 52cfa6dd-1379-4d0a-8bcd-adb6f45805bb could not be found. Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0e1fd258-000a-43ab-b952-ad250b16f1b4 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Request method failure captured: Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/52cfa6dd-1379-4d0a-8bcd-adb6f45805bb/metadata HTTP/1.1 Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_xUwumIVWtimvZYWFrX4r61mtlOKWlgaZMkq0RqJ3Y0Iw1toH2NyPPhGPhgvQp4qsO69gOnD9qoaI_HyGV2vrUSaCB38GNX6oHiuPTepYxK1cFsDLaLcGtYdDvulsJ99F5qddCfBCkDZaji30DPqMEjgoNHQM9741nN0l1-pRYtLZ8 Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 10c6052c3eaf4a11a415839aff00e71f Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1570836876 Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/10c6052c3eaf4a11a415839aff00e71f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/10c6052c3eaf4a11a415839aff00e71f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_10c6052c3eaf4a11a415839aff00e71f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/10c6052c3eaf4a11a415839aff00e71f"}]}] Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1570836876 Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 10c6052c3eaf4a11a415839aff00e71f Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1570836876 Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServerMetadataNegativeTestJSON-1570836876-project Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 285bbd96190545c98a5cbaa2a01e3610 Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1570836876-project Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 52cfa6dd-1379-4d0a-8bcd-adb6f45805bb could not be found. Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'server_id': '52cfa6dd-1379-4d0a-8bcd-adb6f45805bb'} Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52cfa6dd-1379-4d0a-8bcd-adb6f45805bb could not be found. Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52cfa6dd-1379-4d0a-8bcd-adb6f45805bb could not be found. Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:55.843369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:55.848223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:05:55.848223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:05:55.848223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52cfa6dd-1379-4d0a-8bcd-adb6f45805bb could not be found. Aug 04 17:05:55.848223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:55.849617 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0e1fd258-000a-43ab-b952-ad250b16f1b4 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Returning 404 to user: Instance 52cfa6dd-1379-4d0a-8bcd-adb6f45805bb could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:05:55.850750 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0e1fd258-000a-43ab-b952-ad250b16f1b4 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] 10.222.0.93 "GET /compute/v2.1/servers/52cfa6dd-1379-4d0a-8bcd-adb6f45805bb/metadata" status: 404 len: 111 microversion: 2.1 time: 0.028693 Aug 04 17:05:55.862113 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1369/2807] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Aug 4 17:05:55 2022] GET /compute/v2.1/servers/52cfa6dd-1379-4d0a-8bcd-adb6f45805bb/metadata => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:05:55.872904 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-82095a5c-d124-44fe-8963-a5697075fd78 req-83b5a65f-04fd-4b33-8771-e2053a0c84b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c07f7b5-53ae-43c8-a0b6-3c5502e02c42", "name": "network-vif-plugged", "status": "completed", "tag": "9d5167e5-e571-43e2-9d9e-67c4cc47d93c"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:55.935053 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-82095a5c-d124-44fe-8963-a5697075fd78 req-83b5a65f-04fd-4b33-8771-e2053a0c84b7 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:55.937335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-82095a5c-d124-44fe-8963-a5697075fd78 req-83b5a65f-04fd-4b33-8771-e2053a0c84b7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:55.937790 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-82095a5c-d124-44fe-8963-a5697075fd78 req-83b5a65f-04fd-4b33-8771-e2053a0c84b7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:55.965008 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-82095a5c-d124-44fe-8963-a5697075fd78 req-83b5a65f-04fd-4b33-8771-e2053a0c84b7 service nova] Creating event network-vif-plugged:9d5167e5-e571-43e2-9d9e-67c4cc47d93c for instance 3c07f7b5-53ae-43c8-a0b6-3c5502e02c42 on n-h1-851359-3 Aug 04 17:05:55.973813 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-82095a5c-d124-44fe-8963-a5697075fd78 req-83b5a65f-04fd-4b33-8771-e2053a0c84b7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107895 Aug 04 17:05:55.978324 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1370/2808] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:55.987396 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0ae8fd94-01a3-4de4-b182-7fd53b95102c tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1174581553", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ad0d847a-dcbc-4a66-b070-8e9e3359e37a"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0ae8fd94-01a3-4de4-b182-7fd53b95102c tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Request method failure captured: Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 499 Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_xUwumIVWtimvZYWFrX4r61mtlOKWlgaZMkq0RqJ3Y0Iw1toH2NyPPhGPhgvQp4qsO69gOnD9qoaI_HyGV2vrUSaCB38GNX6oHiuPTepYxK1cFsDLaLcGtYdDvulsJ99F5qddCfBCkDZaji30DPqMEjgoNHQM9741nN0l1-pRYtLZ8 Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 10c6052c3eaf4a11a415839aff00e71f Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1570836876 Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/10c6052c3eaf4a11a415839aff00e71f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/10c6052c3eaf4a11a415839aff00e71f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_10c6052c3eaf4a11a415839aff00e71f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/10c6052c3eaf4a11a415839aff00e71f"}]}] Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1570836876 Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 10c6052c3eaf4a11a415839aff00e71f Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1570836876 Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServerMetadataNegativeTestJSON-1570836876-project Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 285bbd96190545c98a5cbaa2a01e3610 Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1570836876-project Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1174581553", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ad0d847a-dcbc-4a66-b070-8e9e3359e37a"}]}} Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1174581553', 'imageRef': '93ebc91d-2d7a-4ab2-b133-dcf9559166d9', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'ad0d847a-dcbc-4a66-b070-8e9e3359e37a'}]}}} Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 04 17:05:56.002265 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0ae8fd94-01a3-4de4-b182-7fd53b95102c tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:05:56.014363 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0ae8fd94-01a3-4de4-b182-7fd53b95102c tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.024775 Aug 04 17:05:56.016604 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-404916e8-684c-4a97-8508-0df948702265 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/893dbe88-23f3-472b-a24f-67b4e8c18007" status: 200 len: 1619 microversion: 2.1 time: 0.635840 Aug 04 17:05:56.017189 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1371/2809] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:05:55 2022] POST /compute/v2.1/servers => generated 687 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:05:56.017550 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1439/2810] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:55 2022] GET /compute/v2.1/servers/893dbe88-23f3-472b-a24f-67b4e8c18007 => generated 1619 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:56.028833 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4094c88c-84d7-4f3f-a1e1-b60b28338cfd tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:56.029571 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4094c88c-84d7-4f3f-a1e1-b60b28338cfd tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] [instance: 2898397c-98e0-416d-b35d-18984c4730e2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:56.041256 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4094c88c-84d7-4f3f-a1e1-b60b28338cfd tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:56.041756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4094c88c-84d7-4f3f-a1e1-b60b28338cfd tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:56.045128 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4094c88c-84d7-4f3f-a1e1-b60b28338cfd tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:56.048422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4094c88c-84d7-4f3f-a1e1-b60b28338cfd tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:56.050833 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4094c88c-84d7-4f3f-a1e1-b60b28338cfd tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:56.053273 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4094c88c-84d7-4f3f-a1e1-b60b28338cfd tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:56.122856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4c5c8b84-b216-4fe1-9389-3e93a7375ae9 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-754210407", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ad0d847a-dcbc-4a66-b070-8e9e3359e37a"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4c5c8b84-b216-4fe1-9389-3e93a7375ae9 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Request method failure captured: Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 499 Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_xUwumIVWtimvZYWFrX4r61mtlOKWlgaZMkq0RqJ3Y0Iw1toH2NyPPhGPhgvQp4qsO69gOnD9qoaI_HyGV2vrUSaCB38GNX6oHiuPTepYxK1cFsDLaLcGtYdDvulsJ99F5qddCfBCkDZaji30DPqMEjgoNHQM9741nN0l1-pRYtLZ8 Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 10c6052c3eaf4a11a415839aff00e71f Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1570836876 Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/10c6052c3eaf4a11a415839aff00e71f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/10c6052c3eaf4a11a415839aff00e71f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_10c6052c3eaf4a11a415839aff00e71f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/10c6052c3eaf4a11a415839aff00e71f"}]}] Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1570836876 Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 10c6052c3eaf4a11a415839aff00e71f Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1570836876 Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerMetadataNegativeTestJSON-1570836876-project Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 285bbd96190545c98a5cbaa2a01e3610 Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1570836876-project Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-754210407", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ad0d847a-dcbc-4a66-b070-8e9e3359e37a"}]}} Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-754210407', 'imageRef': '93ebc91d-2d7a-4ab2-b133-dcf9559166d9', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'ad0d847a-dcbc-4a66-b070-8e9e3359e37a'}]}}} Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 04 17:05:56.129178 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 04 17:05:56.132728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 04 17:05:56.132728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:56.132728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 17:05:56.132728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 04 17:05:56.132728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:56.132728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:56.132728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:56.132728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:56.132728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:56.132728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:56.132728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:05:56.132728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:05:56.132728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:05:56.132728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:05:56.132728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:05:56.132728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:05:56.132728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:05:56.132728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:05:56.132728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:05:56.132728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:05:56.132728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:05:56.132728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:05:56.132728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 17:05:56.132728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:56.132728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:56.132728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:56.132728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:56.132728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:56.132728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:56.132728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:05:56.132728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:05:56.132728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 17:05:56.132728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:56.137808 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4c5c8b84-b216-4fe1-9389-3e93a7375ae9 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:05:56.138754 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4c5c8b84-b216-4fe1-9389-3e93a7375ae9 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.025050 Aug 04 17:05:56.139890 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1440/2811] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:05:56 2022] POST /compute/v2.1/servers => generated 689 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:05:56.227619 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e8152850-9a2d-45c5-9e42-113103b30563 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1915109063", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ad0d847a-dcbc-4a66-b070-8e9e3359e37a"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e8152850-9a2d-45c5-9e42-113103b30563 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Request method failure captured: Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 754 Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_xUwumIVWtimvZYWFrX4r61mtlOKWlgaZMkq0RqJ3Y0Iw1toH2NyPPhGPhgvQp4qsO69gOnD9qoaI_HyGV2vrUSaCB38GNX6oHiuPTepYxK1cFsDLaLcGtYdDvulsJ99F5qddCfBCkDZaji30DPqMEjgoNHQM9741nN0l1-pRYtLZ8 Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 10c6052c3eaf4a11a415839aff00e71f Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1570836876 Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/10c6052c3eaf4a11a415839aff00e71f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/10c6052c3eaf4a11a415839aff00e71f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_10c6052c3eaf4a11a415839aff00e71f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/10c6052c3eaf4a11a415839aff00e71f"}]}] Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1570836876 Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 10c6052c3eaf4a11a415839aff00e71f Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1570836876 Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerMetadataNegativeTestJSON-1570836876-project Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 285bbd96190545c98a5cbaa2a01e3610 Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1570836876-project Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1915109063", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ad0d847a-dcbc-4a66-b070-8e9e3359e37a"}]}} Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1915109063', 'imageRef': '93ebc91d-2d7a-4ab2-b133-dcf9559166d9', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'ad0d847a-dcbc-4a66-b070-8e9e3359e37a'}]}}} Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:05:56.235867 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:05:56.238554 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:05:56.240932 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 17:05:56.240932 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:56.243770 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e8152850-9a2d-45c5-9e42-113103b30563 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:05:56.247803 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e8152850-9a2d-45c5-9e42-113103b30563 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.024802 Aug 04 17:05:56.248660 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1441/2812] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:05:56 2022] POST /compute/v2.1/servers => generated 1197 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Aug 04 17:05:56.335566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-41d87d5f-62f0-454d-9c3c-ccdaaab15d24 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-157061530", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ad0d847a-dcbc-4a66-b070-8e9e3359e37a"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:56.340382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-41d87d5f-62f0-454d-9c3c-ccdaaab15d24 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Request method failure captured: Aug 04 17:05:56.340382 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:05:56.340382 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:05:56.340382 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:05:56.340382 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:05:56.340382 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 1265 Aug 04 17:05:56.340382 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:05:56.340382 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:05:56.340382 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:05:56.340382 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:05:56.340382 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_xUwumIVWtimvZYWFrX4r61mtlOKWlgaZMkq0RqJ3Y0Iw1toH2NyPPhGPhgvQp4qsO69gOnD9qoaI_HyGV2vrUSaCB38GNX6oHiuPTepYxK1cFsDLaLcGtYdDvulsJ99F5qddCfBCkDZaji30DPqMEjgoNHQM9741nN0l1-pRYtLZ8 Aug 04 17:05:56.340382 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:05:56.340382 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:05:56.340382 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:05:56.340382 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:05:56.340382 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:05:56.340382 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:05:56.340382 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 10c6052c3eaf4a11a415839aff00e71f Aug 04 17:05:56.340382 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1570836876 Aug 04 17:05:56.340382 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:05:56.340382 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:05:56.340382 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/10c6052c3eaf4a11a415839aff00e71f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/10c6052c3eaf4a11a415839aff00e71f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_10c6052c3eaf4a11a415839aff00e71f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/10c6052c3eaf4a11a415839aff00e71f"}]}] Aug 04 17:05:56.340382 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1570836876 Aug 04 17:05:56.340382 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 10c6052c3eaf4a11a415839aff00e71f Aug 04 17:05:56.340382 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1570836876 Aug 04 17:05:56.340382 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerMetadataNegativeTestJSON-1570836876-project Aug 04 17:05:56.340382 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:05:56.340382 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:05:56.340382 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 285bbd96190545c98a5cbaa2a01e3610 Aug 04 17:05:56.340382 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1570836876-project Aug 04 17:05:56.340382 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:05:56.340382 n-d-851359-3 devstack@n-api.service[131043]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-157061530", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "ad0d847a-dcbc-4a66-b070-8e9e3359e37a"}]}} Aug 04 17:05:56.340382 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:05:56.342978 n-d-851359-3 devstack@n-api.service[131043]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 17:05:56.342978 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-157061530', 'imageRef': '93ebc91d-2d7a-4ab2-b133-dcf9559166d9', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'ad0d847a-dcbc-4a66-b070-8e9e3359e37a'}]}}} Aug 04 17:05:56.342978 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:05:56.342978 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:56.342978 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:05:56.342978 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:05:56.342978 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:05:56.342978 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:05:56.342978 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 17:05:56.342978 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:56.342978 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 04 17:05:56.342978 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 04 17:05:56.342978 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 04 17:05:56.342978 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 04 17:05:56.342978 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 04 17:05:56.342978 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:56.342978 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 17:05:56.344161 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 04 17:05:56.344161 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:56.344161 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:56.344161 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:56.344161 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:56.344161 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:56.344161 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:56.344161 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:05:56.344161 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:05:56.344161 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:05:56.344161 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:05:56.344161 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:05:56.344161 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:05:56.344161 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:05:56.344161 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:05:56.344161 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:05:56.344161 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:05:56.344161 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:05:56.344161 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:05:56.344161 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 17:05:56.344161 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:56.344161 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:56.344161 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:56.344161 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:56.344161 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:56.344161 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:56.344161 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:05:56.344161 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:05:56.345802 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 17:05:56.345802 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:56.350787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-41d87d5f-62f0-454d-9c3c-ccdaaab15d24 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:05:56.351950 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-41d87d5f-62f0-454d-9c3c-ccdaaab15d24 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.020676 Aug 04 17:05:56.353067 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1442/2813] 10.222.0.93 () {60 vars in 1148 bytes} [Thu Aug 4 17:05:56 2022] POST /compute/v2.1/servers => generated 2221 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 04 17:05:56.369279 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e80e6825-755a-479e-b7a2-428287f1f5e4 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:56.370329 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e80e6825-755a-479e-b7a2-428287f1f5e4 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] [instance: 5f2b3feb-2e3d-4fec-a2a4-1318783de7b6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:56.378374 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-e80e6825-755a-479e-b7a2-428287f1f5e4 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] HTTP exception thrown: Instance 5f2b3feb-2e3d-4fec-a2a4-1318783de7b6 could not be found. Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e80e6825-755a-479e-b7a2-428287f1f5e4 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Request method failure captured: Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/5f2b3feb-2e3d-4fec-a2a4-1318783de7b6/metadata/test2 HTTP/1.1 Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_xUwumIVWtimvZYWFrX4r61mtlOKWlgaZMkq0RqJ3Y0Iw1toH2NyPPhGPhgvQp4qsO69gOnD9qoaI_HyGV2vrUSaCB38GNX6oHiuPTepYxK1cFsDLaLcGtYdDvulsJ99F5qddCfBCkDZaji30DPqMEjgoNHQM9741nN0l1-pRYtLZ8 Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 10c6052c3eaf4a11a415839aff00e71f Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1570836876 Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/10c6052c3eaf4a11a415839aff00e71f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/10c6052c3eaf4a11a415839aff00e71f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_10c6052c3eaf4a11a415839aff00e71f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/10c6052c3eaf4a11a415839aff00e71f"}]}] Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1570836876 Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 10c6052c3eaf4a11a415839aff00e71f Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1570836876 Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerMetadataNegativeTestJSON-1570836876-project Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 285bbd96190545c98a5cbaa2a01e3610 Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1570836876-project Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 5f2b3feb-2e3d-4fec-a2a4-1318783de7b6 could not be found. Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'server_id': '5f2b3feb-2e3d-4fec-a2a4-1318783de7b6', 'id': 'test2'} Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f2b3feb-2e3d-4fec-a2a4-1318783de7b6 could not be found. Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f2b3feb-2e3d-4fec-a2a4-1318783de7b6 could not be found. Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:05:56.386359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:05:56.390568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:05:56.390568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:05:56.390568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f2b3feb-2e3d-4fec-a2a4-1318783de7b6 could not be found. Aug 04 17:05:56.390568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:05:56.391977 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e80e6825-755a-479e-b7a2-428287f1f5e4 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Returning 404 to user: Instance 5f2b3feb-2e3d-4fec-a2a4-1318783de7b6 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:05:56.393079 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e80e6825-755a-479e-b7a2-428287f1f5e4 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] 10.222.0.93 "GET /compute/v2.1/servers/5f2b3feb-2e3d-4fec-a2a4-1318783de7b6/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.028154 Aug 04 17:05:56.394197 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1443/2814] 10.222.0.93 () {58 vars in 1281 bytes} [Thu Aug 4 17:05:56 2022] GET /compute/v2.1/servers/5f2b3feb-2e3d-4fec-a2a4-1318783de7b6/metadata/test2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:05:56.399181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1677e7fd-4753-4d76-afbe-3b346b5c24ae tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:56.400086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1677e7fd-4753-4d76-afbe-3b346b5c24ae tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: 90fd978f-f119-4293-b43e-2b0cf3aff18c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:56.407183 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1677e7fd-4753-4d76-afbe-3b346b5c24ae tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:56.407963 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1677e7fd-4753-4d76-afbe-3b346b5c24ae tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:56.408630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1677e7fd-4753-4d76-afbe-3b346b5c24ae tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:56.409566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1677e7fd-4753-4d76-afbe-3b346b5c24ae tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:56.410336 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1677e7fd-4753-4d76-afbe-3b346b5c24ae tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:56.410996 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1677e7fd-4753-4d76-afbe-3b346b5c24ae tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:56.615906 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4094c88c-84d7-4f3f-a1e1-b60b28338cfd tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/2898397c-98e0-416d-b35d-18984c4730e2" status: 200 len: 1620 microversion: 2.1 time: 0.590574 Aug 04 17:05:56.616441 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1372/2815] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:56 2022] GET /compute/v2.1/servers/2898397c-98e0-416d-b35d-18984c4730e2 => generated 1620 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:56.633914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d37b1bdf-d5e9-4606-9088-f9ed6e3e43a0 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:56.634555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d37b1bdf-d5e9-4606-9088-f9ed6e3e43a0 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] [instance: 91cdc465-4194-4de5-b82e-2d5382b4e779] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:56.649615 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d37b1bdf-d5e9-4606-9088-f9ed6e3e43a0 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:56.650244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d37b1bdf-d5e9-4606-9088-f9ed6e3e43a0 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:56.650762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d37b1bdf-d5e9-4606-9088-f9ed6e3e43a0 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:56.651550 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d37b1bdf-d5e9-4606-9088-f9ed6e3e43a0 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:56.652083 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d37b1bdf-d5e9-4606-9088-f9ed6e3e43a0 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:56.652580 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d37b1bdf-d5e9-4606-9088-f9ed6e3e43a0 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:56.702624 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d37b1bdf-d5e9-4606-9088-f9ed6e3e43a0 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] [instance: 91cdc465-4194-4de5-b82e-2d5382b4e779] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:05:56.866791 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d37b1bdf-d5e9-4606-9088-f9ed6e3e43a0 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] 10.222.0.93 "DELETE /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779" status: 204 len: 0 microversion: 2.1 time: 0.247087 Aug 04 17:05:56.871614 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1373/2816] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:05:56 2022] DELETE /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:05:56.881671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-67fad452-1f04-446e-8697-38e50c1c098c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Action: 'create', calling method: .version_select at 0x7f1e5bf1a4c0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1146312319", "policies": ["anti-affinity"]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:56.909432 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:56.933547 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-67fad452-1f04-446e-8697-38e50c1c098c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for project de328615cef94528b55b8309dd9b82b0. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:05:56.951113 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-67fad452-1f04-446e-8697-38e50c1c098c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for user abad886e45bd4c4b8f5f0f86c45eb068 and project de328615cef94528b55b8309dd9b82b0. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:05:57.040422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-67fad452-1f04-446e-8697-38e50c1c098c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for project de328615cef94528b55b8309dd9b82b0. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:05:57.053081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-67fad452-1f04-446e-8697-38e50c1c098c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for user abad886e45bd4c4b8f5f0f86c45eb068 and project de328615cef94528b55b8309dd9b82b0. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:05:57.080912 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-67fad452-1f04-446e-8697-38e50c1c098c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.207564 Aug 04 17:05:57.086223 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1374/2817] 10.222.0.93 () {60 vars in 1174 bytes} [Thu Aug 4 17:05:56 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:57.100467 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ac7a31ea-b83f-4d41-9b99-b0cc300cc2ac tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:57.101218 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ac7a31ea-b83f-4d41-9b99-b0cc300cc2ac tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: 3c07f7b5-53ae-43c8-a0b6-3c5502e02c42] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:57.114925 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac7a31ea-b83f-4d41-9b99-b0cc300cc2ac tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:57.115689 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac7a31ea-b83f-4d41-9b99-b0cc300cc2ac tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:57.116287 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac7a31ea-b83f-4d41-9b99-b0cc300cc2ac tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:57.117163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac7a31ea-b83f-4d41-9b99-b0cc300cc2ac tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:57.117784 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac7a31ea-b83f-4d41-9b99-b0cc300cc2ac tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:57.118429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac7a31ea-b83f-4d41-9b99-b0cc300cc2ac tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:57.133624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1677e7fd-4753-4d76-afbe-3b346b5c24ae tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:57.149034 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1677e7fd-4753-4d76-afbe-3b346b5c24ae tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c" status: 200 len: 1666 microversion: 2.1 time: 0.753480 Aug 04 17:05:57.149634 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1444/2818] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:56 2022] GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c => generated 1666 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:57.165906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-205f6fdd-ae13-4a08-8f56-5948297fba5a tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:57.169465 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-205f6fdd-ae13-4a08-8f56-5948297fba5a tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] [instance: 91cdc465-4194-4de5-b82e-2d5382b4e779] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:57.190337 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-205f6fdd-ae13-4a08-8f56-5948297fba5a tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:57.193550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-205f6fdd-ae13-4a08-8f56-5948297fba5a tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:57.198631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-205f6fdd-ae13-4a08-8f56-5948297fba5a tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:57.200005 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-205f6fdd-ae13-4a08-8f56-5948297fba5a tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:57.203092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-205f6fdd-ae13-4a08-8f56-5948297fba5a tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:57.203775 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-205f6fdd-ae13-4a08-8f56-5948297fba5a tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:57.568328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-205f6fdd-ae13-4a08-8f56-5948297fba5a tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285bbd96190545c98a5cbaa2a01e3610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6052c3eaf4a11a415839aff00e71f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:57.575745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ac7a31ea-b83f-4d41-9b99-b0cc300cc2ac tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:57.597508 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-205f6fdd-ae13-4a08-8f56-5948297fba5a tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] 10.222.0.93 "GET /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779" status: 200 len: 1526 microversion: 2.1 time: 0.436561 Aug 04 17:05:57.597508 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1445/2819] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:57 2022] GET /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779 => generated 1526 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:57.607947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5adbcedd-78c4-4f6c-bf02-8cbde0ceec30 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:57.610558 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5adbcedd-78c4-4f6c-bf02-8cbde0ceec30 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: 90fd978f-f119-4293-b43e-2b0cf3aff18c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:57.624597 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ac7a31ea-b83f-4d41-9b99-b0cc300cc2ac tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/3c07f7b5-53ae-43c8-a0b6-3c5502e02c42" status: 200 len: 1320 microversion: 2.1 time: 0.536818 Aug 04 17:05:57.626069 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1375/2820] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:57 2022] GET /compute/v2.1/servers/3c07f7b5-53ae-43c8-a0b6-3c5502e02c42 => generated 1320 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:57.632753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e65b2a93-ef40-4aa8-ae4f-aba0702efe7a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-579813786", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "c76122ce-aec5-4040-a435-ce738fc598fc"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:05:57.636755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5adbcedd-78c4-4f6c-bf02-8cbde0ceec30 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:57.646563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5adbcedd-78c4-4f6c-bf02-8cbde0ceec30 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:57.647315 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5adbcedd-78c4-4f6c-bf02-8cbde0ceec30 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:57.649531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5adbcedd-78c4-4f6c-bf02-8cbde0ceec30 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:57.654230 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5adbcedd-78c4-4f6c-bf02-8cbde0ceec30 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:57.658213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5adbcedd-78c4-4f6c-bf02-8cbde0ceec30 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:57.721562 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-e65b2a93-ef40-4aa8-ae4f-aba0702efe7a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:05:57.731096 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5adbcedd-78c4-4f6c-bf02-8cbde0ceec30 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c/ips" status: 200 len: 177 microversion: 2.1 time: 0.134130 Aug 04 17:05:57.741604 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1446/2821] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Aug 4 17:05:57 2022] GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c/ips => generated 177 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:05:57.750538 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6752c68f-e3e3-4959-afbe-9e48da7b1df8 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:57.751298 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6752c68f-e3e3-4959-afbe-9e48da7b1df8 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: 90fd978f-f119-4293-b43e-2b0cf3aff18c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:57.757521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6752c68f-e3e3-4959-afbe-9e48da7b1df8 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:57.758343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6752c68f-e3e3-4959-afbe-9e48da7b1df8 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:57.759015 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6752c68f-e3e3-4959-afbe-9e48da7b1df8 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:57.759953 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6752c68f-e3e3-4959-afbe-9e48da7b1df8 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:57.760633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6752c68f-e3e3-4959-afbe-9e48da7b1df8 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:57.761419 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6752c68f-e3e3-4959-afbe-9e48da7b1df8 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:57.816402 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6752c68f-e3e3-4959-afbe-9e48da7b1df8 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: 90fd978f-f119-4293-b43e-2b0cf3aff18c] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:05:57.977920 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6752c68f-e3e3-4959-afbe-9e48da7b1df8 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "DELETE /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c" status: 204 len: 0 microversion: 2.1 time: 0.231509 Aug 04 17:05:57.989669 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1447/2822] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:05:57 2022] DELETE /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:05:57.995661 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f7e44747-1e33-427a-bde3-4c7d7836dcef tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:57.996703 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f7e44747-1e33-427a-bde3-4c7d7836dcef tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: 90fd978f-f119-4293-b43e-2b0cf3aff18c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:58.009022 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7e44747-1e33-427a-bde3-4c7d7836dcef tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:58.009813 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7e44747-1e33-427a-bde3-4c7d7836dcef tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:58.017504 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7e44747-1e33-427a-bde3-4c7d7836dcef tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:58.018554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7e44747-1e33-427a-bde3-4c7d7836dcef tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:58.019257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7e44747-1e33-427a-bde3-4c7d7836dcef tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:58.019907 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7e44747-1e33-427a-bde3-4c7d7836dcef tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:58.754774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f7e44747-1e33-427a-bde3-4c7d7836dcef tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:58.763009 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e65b2a93-ef40-4aa8-ae4f-aba0702efe7a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:05:58.763554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e65b2a93-ef40-4aa8-ae4f-aba0702efe7a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:05:58.763767 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f7e44747-1e33-427a-bde3-4c7d7836dcef tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c" status: 200 len: 1672 microversion: 2.1 time: 0.772033 Aug 04 17:05:58.765160 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1448/2823] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:57 2022] GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c => generated 1672 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:58.765278 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e65b2a93-ef40-4aa8-ae4f-aba0702efe7a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:05:58.766452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e65b2a93-ef40-4aa8-ae4f-aba0702efe7a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:05:58.767005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e65b2a93-ef40-4aa8-ae4f-aba0702efe7a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:05:58.771209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c9ef7de9-607d-46ea-98dc-f2df26ff031c tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:58.772430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c9ef7de9-607d-46ea-98dc-f2df26ff031c tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] [instance: 91cdc465-4194-4de5-b82e-2d5382b4e779] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:58.779003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:58.783332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9ef7de9-607d-46ea-98dc-f2df26ff031c tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:58.784146 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9ef7de9-607d-46ea-98dc-f2df26ff031c tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:58.784812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9ef7de9-607d-46ea-98dc-f2df26ff031c tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:58.786168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9ef7de9-607d-46ea-98dc-f2df26ff031c tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:58.786551 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e65b2a93-ef40-4aa8-ae4f-aba0702efe7a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:58.787054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e65b2a93-ef40-4aa8-ae4f-aba0702efe7a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:58.787368 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9ef7de9-607d-46ea-98dc-f2df26ff031c tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:58.787983 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e65b2a93-ef40-4aa8-ae4f-aba0702efe7a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:58.788344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9ef7de9-607d-46ea-98dc-f2df26ff031c tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:58.788752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e65b2a93-ef40-4aa8-ae4f-aba0702efe7a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:58.789222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e65b2a93-ef40-4aa8-ae4f-aba0702efe7a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:58.789663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e65b2a93-ef40-4aa8-ae4f-aba0702efe7a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:58.816019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e65b2a93-ef40-4aa8-ae4f-aba0702efe7a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for project de328615cef94528b55b8309dd9b82b0. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:05:58.823529 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e65b2a93-ef40-4aa8-ae4f-aba0702efe7a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for user abad886e45bd4c4b8f5f0f86c45eb068 and project de328615cef94528b55b8309dd9b82b0. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:05:58.840474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e65b2a93-ef40-4aa8-ae4f-aba0702efe7a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Going to run 2 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:05:58.843335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e65b2a93-ef40-4aa8-ae4f-aba0702efe7a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: fbee7e39-ec6b-4a04-92e3-56c14721eb85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:05:58.885361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e65b2a93-ef40-4aa8-ae4f-aba0702efe7a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=131044) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 04 17:05:58.908509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e65b2a93-ef40-4aa8-ae4f-aba0702efe7a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for project de328615cef94528b55b8309dd9b82b0. Resources: {'server_group_members'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:05:58.914723 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e65b2a93-ef40-4aa8-ae4f-aba0702efe7a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for user abad886e45bd4c4b8f5f0f86c45eb068 and project de328615cef94528b55b8309dd9b82b0. Resources: {'server_group_members'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:05:58.987195 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e65b2a93-ef40-4aa8-ae4f-aba0702efe7a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for project de328615cef94528b55b8309dd9b82b0. Resources: {'server_group_members'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:05:58.993873 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e65b2a93-ef40-4aa8-ae4f-aba0702efe7a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for user abad886e45bd4c4b8f5f0f86c45eb068 and project de328615cef94528b55b8309dd9b82b0. Resources: {'server_group_members'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:05:59.009745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e65b2a93-ef40-4aa8-ae4f-aba0702efe7a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ca421464-9d69-4127-a819-37fc1936680e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=fbee7e39-ec6b-4a04-92e3-56c14721eb85,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:05:59.056856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c9ef7de9-607d-46ea-98dc-f2df26ff031c tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285bbd96190545c98a5cbaa2a01e3610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6052c3eaf4a11a415839aff00e71f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:59.071172 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c9ef7de9-607d-46ea-98dc-f2df26ff031c tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] 10.222.0.93 "GET /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779" status: 200 len: 1526 microversion: 2.1 time: 0.304420 Aug 04 17:05:59.074094 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1449/2824] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:58 2022] GET /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779 => generated 1526 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:59.083185 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e65b2a93-ef40-4aa8-ae4f-aba0702efe7a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for project de328615cef94528b55b8309dd9b82b0. Resources: {'server_group_members'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:05:59.086975 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f041496d-6eb6-4fba-ad27-b0b7e832e9f3 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:59.087762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f041496d-6eb6-4fba-ad27-b0b7e832e9f3 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: 3c07f7b5-53ae-43c8-a0b6-3c5502e02c42] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:59.088905 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e65b2a93-ef40-4aa8-ae4f-aba0702efe7a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for user abad886e45bd4c4b8f5f0f86c45eb068 and project de328615cef94528b55b8309dd9b82b0. Resources: {'server_group_members'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:05:59.103326 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f041496d-6eb6-4fba-ad27-b0b7e832e9f3 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:59.104814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f041496d-6eb6-4fba-ad27-b0b7e832e9f3 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:59.106415 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f041496d-6eb6-4fba-ad27-b0b7e832e9f3 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:59.107235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f041496d-6eb6-4fba-ad27-b0b7e832e9f3 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:59.108933 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f041496d-6eb6-4fba-ad27-b0b7e832e9f3 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:59.111331 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f041496d-6eb6-4fba-ad27-b0b7e832e9f3 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:59.143536 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e65b2a93-ef40-4aa8-ae4f-aba0702efe7a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for project de328615cef94528b55b8309dd9b82b0. Resources: {'server_group_members'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:05:59.149623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e65b2a93-ef40-4aa8-ae4f-aba0702efe7a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for user abad886e45bd4c4b8f5f0f86c45eb068 and project de328615cef94528b55b8309dd9b82b0. Resources: {'server_group_members'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:05:59.197261 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e65b2a93-ef40-4aa8-ae4f-aba0702efe7a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.569839 Aug 04 17:05:59.201486 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1376/2825] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:05:57 2022] POST /compute/v2.1/servers => generated 32 bytes in 1574 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 04 17:05:59.207324 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-867842c2-8e92-4f06-93c8-a9328ce46ffe tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:59.213142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-867842c2-8e92-4f06-93c8-a9328ce46ffe tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:59.214633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-867842c2-8e92-4f06-93c8-a9328ce46ffe tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Searching by: {'deleted': False, 'project_id': 'de328615cef94528b55b8309dd9b82b0'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:05:59.223251 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:05:59.238084 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-867842c2-8e92-4f06-93c8-a9328ce46ffe tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:59.238877 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-867842c2-8e92-4f06-93c8-a9328ce46ffe tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:59.239488 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-867842c2-8e92-4f06-93c8-a9328ce46ffe tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:59.244690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-867842c2-8e92-4f06-93c8-a9328ce46ffe tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:59.246298 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-867842c2-8e92-4f06-93c8-a9328ce46ffe tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:59.251473 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-867842c2-8e92-4f06-93c8-a9328ce46ffe tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:59.403683 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-867842c2-8e92-4f06-93c8-a9328ce46ffe tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:05:59.528825 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-867842c2-8e92-4f06-93c8-a9328ce46ffe tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.325546 Aug 04 17:05:59.532947 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1377/2826] 10.222.0.93 () {58 vars in 1125 bytes} [Thu Aug 4 17:05:59 2022] GET /compute/v2.1/servers => generated 1663 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:59.546911 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-32f30b50-7712-4e9c-ae92-d4e352e898a4 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:59.547545 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-32f30b50-7712-4e9c-ae92-d4e352e898a4 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ca421464-9d69-4127-a819-37fc1936680e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:59.556550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f041496d-6eb6-4fba-ad27-b0b7e832e9f3 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:59.566298 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f041496d-6eb6-4fba-ad27-b0b7e832e9f3 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/3c07f7b5-53ae-43c8-a0b6-3c5502e02c42" status: 200 len: 1508 microversion: 2.1 time: 0.490966 Aug 04 17:05:59.592247 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1450/2827] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:59 2022] GET /compute/v2.1/servers/3c07f7b5-53ae-43c8-a0b6-3c5502e02c42 => generated 1508 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:05:59.610152 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a911e5ca-35f3-4e72-960e-d2cdb7e68207 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:59.610999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a911e5ca-35f3-4e72-960e-d2cdb7e68207 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: d282ccab-7827-4b5e-8ba7-b1600d5140bf] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:59.631056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a911e5ca-35f3-4e72-960e-d2cdb7e68207 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:59.634672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a911e5ca-35f3-4e72-960e-d2cdb7e68207 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:59.635514 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a911e5ca-35f3-4e72-960e-d2cdb7e68207 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:59.636727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a911e5ca-35f3-4e72-960e-d2cdb7e68207 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:59.637528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a911e5ca-35f3-4e72-960e-d2cdb7e68207 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:59.638358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a911e5ca-35f3-4e72-960e-d2cdb7e68207 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:59.783653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-32f30b50-7712-4e9c-ae92-d4e352e898a4 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:05:59.799506 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-32f30b50-7712-4e9c-ae92-d4e352e898a4 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e" status: 200 len: 1218 microversion: 2.1 time: 0.257424 Aug 04 17:05:59.800932 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1378/2828] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:59 2022] GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e => generated 1218 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:05:59.815816 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-90697fcb-a8da-43e1-a764-d3906f53aaa0 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:05:59.816724 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-90697fcb-a8da-43e1-a764-d3906f53aaa0 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: 90fd978f-f119-4293-b43e-2b0cf3aff18c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:05:59.836283 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90697fcb-a8da-43e1-a764-d3906f53aaa0 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:59.837095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90697fcb-a8da-43e1-a764-d3906f53aaa0 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:59.837705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90697fcb-a8da-43e1-a764-d3906f53aaa0 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:05:59.838628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90697fcb-a8da-43e1-a764-d3906f53aaa0 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:05:59.839259 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90697fcb-a8da-43e1-a764-d3906f53aaa0 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:05:59.839703 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90697fcb-a8da-43e1-a764-d3906f53aaa0 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:00.744268 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a911e5ca-35f3-4e72-960e-d2cdb7e68207 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:00.753361 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a911e5ca-35f3-4e72-960e-d2cdb7e68207 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/d282ccab-7827-4b5e-8ba7-b1600d5140bf" status: 200 len: 1320 microversion: 2.1 time: 1.159760 Aug 04 17:06:00.758703 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1451/2829] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:59 2022] GET /compute/v2.1/servers/d282ccab-7827-4b5e-8ba7-b1600d5140bf => generated 1320 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:00.781828 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-64189808-d348-4344-baaf-82e2849b11c4 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:00.787554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-64189808-d348-4344-baaf-82e2849b11c4 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] [instance: 91cdc465-4194-4de5-b82e-2d5382b4e779] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:00.809118 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64189808-d348-4344-baaf-82e2849b11c4 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:00.816221 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64189808-d348-4344-baaf-82e2849b11c4 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:00.816685 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64189808-d348-4344-baaf-82e2849b11c4 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:00.826184 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64189808-d348-4344-baaf-82e2849b11c4 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:00.827804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64189808-d348-4344-baaf-82e2849b11c4 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:00.828458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64189808-d348-4344-baaf-82e2849b11c4 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:00.986484 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-90697fcb-a8da-43e1-a764-d3906f53aaa0 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:00.995764 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-90697fcb-a8da-43e1-a764-d3906f53aaa0 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c" status: 200 len: 1672 microversion: 2.1 time: 1.193512 Aug 04 17:06:01.002192 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1379/2830] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:05:59 2022] GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c => generated 1672 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:01.019376 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-fcc1013d-e8e7-4a31-8d5a-24beca5e4d5c req-397d0d11-6ab7-403f-8630-f8227fac3d4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d282ccab-7827-4b5e-8ba7-b1600d5140bf", "name": "network-vif-plugged", "status": "completed", "tag": "4e302672-974c-496d-bdd8-b15b1245f517"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:01.029619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fcc1013d-e8e7-4a31-8d5a-24beca5e4d5c req-397d0d11-6ab7-403f-8630-f8227fac3d4f service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:01.030449 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fcc1013d-e8e7-4a31-8d5a-24beca5e4d5c req-397d0d11-6ab7-403f-8630-f8227fac3d4f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:01.031033 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fcc1013d-e8e7-4a31-8d5a-24beca5e4d5c req-397d0d11-6ab7-403f-8630-f8227fac3d4f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:01.043824 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-fcc1013d-e8e7-4a31-8d5a-24beca5e4d5c req-397d0d11-6ab7-403f-8630-f8227fac3d4f service nova] Creating event network-vif-plugged:4e302672-974c-496d-bdd8-b15b1245f517 for instance d282ccab-7827-4b5e-8ba7-b1600d5140bf on n-h1-851359-3 Aug 04 17:06:01.049868 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-fcc1013d-e8e7-4a31-8d5a-24beca5e4d5c req-397d0d11-6ab7-403f-8630-f8227fac3d4f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034181 Aug 04 17:06:01.051452 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1380/2831] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:06:01.057260 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-07917812-c62e-49c1-b833-fe89dd7841fd tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:01.058375 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-07917812-c62e-49c1-b833-fe89dd7841fd tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ca421464-9d69-4127-a819-37fc1936680e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:01.065943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07917812-c62e-49c1-b833-fe89dd7841fd tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:01.066749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07917812-c62e-49c1-b833-fe89dd7841fd tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:01.067338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07917812-c62e-49c1-b833-fe89dd7841fd tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:01.068199 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07917812-c62e-49c1-b833-fe89dd7841fd tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:01.069555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07917812-c62e-49c1-b833-fe89dd7841fd tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:01.070165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07917812-c62e-49c1-b833-fe89dd7841fd tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:01.261123 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-64189808-d348-4344-baaf-82e2849b11c4 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285bbd96190545c98a5cbaa2a01e3610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c6052c3eaf4a11a415839aff00e71f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:01.289465 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-64189808-d348-4344-baaf-82e2849b11c4 tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] 10.222.0.93 "GET /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779" status: 200 len: 1484 microversion: 2.1 time: 0.521481 Aug 04 17:06:01.290617 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1452/2832] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:00 2022] GET /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779 => generated 1484 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:01.318960 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-d6c1746c-36e4-45a6-aa0d-112b6cabd610 req-e5ae1395-607a-407d-a65e-daf6f0e31e8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91cdc465-4194-4de5-b82e-2d5382b4e779", "name": "network-vif-deleted", "tag": "241e9c15-423e-4c5c-8c22-a0d8f621d376"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:01.370366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d6c1746c-36e4-45a6-aa0d-112b6cabd610 req-e5ae1395-607a-407d-a65e-daf6f0e31e8b service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:01.371138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d6c1746c-36e4-45a6-aa0d-112b6cabd610 req-e5ae1395-607a-407d-a65e-daf6f0e31e8b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:01.372712 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d6c1746c-36e4-45a6-aa0d-112b6cabd610 req-e5ae1395-607a-407d-a65e-daf6f0e31e8b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:01.415576 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-d6c1746c-36e4-45a6-aa0d-112b6cabd610 req-e5ae1395-607a-407d-a65e-daf6f0e31e8b service nova] Creating event network-vif-deleted:241e9c15-423e-4c5c-8c22-a0d8f621d376 for instance 91cdc465-4194-4de5-b82e-2d5382b4e779 on n-h2-851359-3 Aug 04 17:06:01.426360 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-d6c1746c-36e4-45a6-aa0d-112b6cabd610 req-e5ae1395-607a-407d-a65e-daf6f0e31e8b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115751 Aug 04 17:06:01.430055 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1453/2833] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:06:01.495721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-07917812-c62e-49c1-b833-fe89dd7841fd tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:01.524032 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-07917812-c62e-49c1-b833-fe89dd7841fd tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e" status: 200 len: 1270 microversion: 2.1 time: 0.471007 Aug 04 17:06:01.538391 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1381/2834] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:01 2022] GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e => generated 1270 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:01.782568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-625d0bff-ad8c-4bec-8346-6e0fbe52297e tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:01.783305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-625d0bff-ad8c-4bec-8346-6e0fbe52297e tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: d282ccab-7827-4b5e-8ba7-b1600d5140bf] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:01.793422 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-625d0bff-ad8c-4bec-8346-6e0fbe52297e tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:01.793932 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-625d0bff-ad8c-4bec-8346-6e0fbe52297e tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:01.794401 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-625d0bff-ad8c-4bec-8346-6e0fbe52297e tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:01.800307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-625d0bff-ad8c-4bec-8346-6e0fbe52297e tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:01.800898 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-625d0bff-ad8c-4bec-8346-6e0fbe52297e tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:01.801362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-625d0bff-ad8c-4bec-8346-6e0fbe52297e tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:02.027660 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-29dc97da-bdb8-498b-86fe-f1ba09eb757d tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:02.028348 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-29dc97da-bdb8-498b-86fe-f1ba09eb757d tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: 90fd978f-f119-4293-b43e-2b0cf3aff18c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:02.042994 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29dc97da-bdb8-498b-86fe-f1ba09eb757d tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:02.043967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29dc97da-bdb8-498b-86fe-f1ba09eb757d tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:02.044094 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29dc97da-bdb8-498b-86fe-f1ba09eb757d tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:02.044830 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29dc97da-bdb8-498b-86fe-f1ba09eb757d tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:02.046064 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29dc97da-bdb8-498b-86fe-f1ba09eb757d tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:02.046462 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29dc97da-bdb8-498b-86fe-f1ba09eb757d tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:02.407000 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-625d0bff-ad8c-4bec-8346-6e0fbe52297e tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:02.415883 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-625d0bff-ad8c-4bec-8346-6e0fbe52297e tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/d282ccab-7827-4b5e-8ba7-b1600d5140bf" status: 200 len: 1320 microversion: 2.1 time: 0.638539 Aug 04 17:06:02.429288 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1454/2835] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:01 2022] GET /compute/v2.1/servers/d282ccab-7827-4b5e-8ba7-b1600d5140bf => generated 1320 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:02.429288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-999a4ea4-9e00-4faa-965d-226962f7f4bf tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:02.429288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-999a4ea4-9e00-4faa-965d-226962f7f4bf tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] [instance: 91cdc465-4194-4de5-b82e-2d5382b4e779] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:02.430380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-999a4ea4-9e00-4faa-965d-226962f7f4bf tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:02.431278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-999a4ea4-9e00-4faa-965d-226962f7f4bf tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:02.432565 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-999a4ea4-9e00-4faa-965d-226962f7f4bf tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:02.433388 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-999a4ea4-9e00-4faa-965d-226962f7f4bf tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:02.434033 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-999a4ea4-9e00-4faa-965d-226962f7f4bf tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:02.434584 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-999a4ea4-9e00-4faa-965d-226962f7f4bf tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:02.455812 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-999a4ea4-9e00-4faa-965d-226962f7f4bf tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] HTTP exception thrown: Instance 91cdc465-4194-4de5-b82e-2d5382b4e779 could not be found. Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-999a4ea4-9e00-4faa-965d-226962f7f4bf tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Request method failure captured: Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779 HTTP/1.1 Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_xUwumIVWtimvZYWFrX4r61mtlOKWlgaZMkq0RqJ3Y0Iw1toH2NyPPhGPhgvQp4qsO69gOnD9qoaI_HyGV2vrUSaCB38GNX6oHiuPTepYxK1cFsDLaLcGtYdDvulsJ99F5qddCfBCkDZaji30DPqMEjgoNHQM9741nN0l1-pRYtLZ8 Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 10c6052c3eaf4a11a415839aff00e71f Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1570836876 Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/10c6052c3eaf4a11a415839aff00e71f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/10c6052c3eaf4a11a415839aff00e71f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_10c6052c3eaf4a11a415839aff00e71f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/10c6052c3eaf4a11a415839aff00e71f"}]}] Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1570836876 Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 10c6052c3eaf4a11a415839aff00e71f Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1570836876 Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerMetadataNegativeTestJSON-1570836876-project Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 285bbd96190545c98a5cbaa2a01e3610 Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1570836876-project Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 91cdc465-4194-4de5-b82e-2d5382b4e779 could not be found. Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '91cdc465-4194-4de5-b82e-2d5382b4e779'} Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91cdc465-4194-4de5-b82e-2d5382b4e779 could not be found. Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91cdc465-4194-4de5-b82e-2d5382b4e779 could not be found. Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:02.457644 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:02.462357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:02.462357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:02.462357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:02.462357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:02.462357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:06:02.462357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:06:02.462357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91cdc465-4194-4de5-b82e-2d5382b4e779 could not be found. Aug 04 17:06:02.462357 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:02.463131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-999a4ea4-9e00-4faa-965d-226962f7f4bf tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] Returning 404 to user: Instance 91cdc465-4194-4de5-b82e-2d5382b4e779 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:06:02.464259 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-999a4ea4-9e00-4faa-965d-226962f7f4bf tempest-ServerMetadataNegativeTestJSON-1570836876 tempest-ServerMetadataNegativeTestJSON-1570836876-project] 10.222.0.93 "GET /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779" status: 404 len: 111 microversion: 2.1 time: 0.046461 Aug 04 17:06:02.465713 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1455/2836] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:02 2022] GET /compute/v2.1/servers/91cdc465-4194-4de5-b82e-2d5382b4e779 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:06:02.548842 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6c4419b5-6e42-4558-9e34-d74ba0e8e9dd tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:02.549476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6c4419b5-6e42-4558-9e34-d74ba0e8e9dd tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ca421464-9d69-4127-a819-37fc1936680e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:02.558947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c4419b5-6e42-4558-9e34-d74ba0e8e9dd tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:02.559588 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c4419b5-6e42-4558-9e34-d74ba0e8e9dd tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:02.560338 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c4419b5-6e42-4558-9e34-d74ba0e8e9dd tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:02.561757 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c4419b5-6e42-4558-9e34-d74ba0e8e9dd tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:02.562651 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c4419b5-6e42-4558-9e34-d74ba0e8e9dd tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:02.564442 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c4419b5-6e42-4558-9e34-d74ba0e8e9dd tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:02.681452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-29dc97da-bdb8-498b-86fe-f1ba09eb757d tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:02.692260 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-29dc97da-bdb8-498b-86fe-f1ba09eb757d tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c" status: 200 len: 1672 microversion: 2.1 time: 0.668594 Aug 04 17:06:02.708344 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1382/2837] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:02 2022] GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c => generated 1672 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:02.715310 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6c4419b5-6e42-4558-9e34-d74ba0e8e9dd tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:02.723289 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-34fa6c8e-91ad-4168-9be8-cc88560f9ce0 req-12f5940a-0e17-4582-8d13-a3fd6fc43c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90fd978f-f119-4293-b43e-2b0cf3aff18c", "name": "network-vif-deleted", "tag": "cbb9d642-fe31-4c61-b558-e471183d26a4"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:02.732293 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6c4419b5-6e42-4558-9e34-d74ba0e8e9dd tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e" status: 200 len: 1276 microversion: 2.1 time: 0.189357 Aug 04 17:06:02.733421 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1456/2838] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:02 2022] GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e => generated 1276 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:02.743060 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-34fa6c8e-91ad-4168-9be8-cc88560f9ce0 req-12f5940a-0e17-4582-8d13-a3fd6fc43c51 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:02.743762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-34fa6c8e-91ad-4168-9be8-cc88560f9ce0 req-12f5940a-0e17-4582-8d13-a3fd6fc43c51 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:02.744289 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-34fa6c8e-91ad-4168-9be8-cc88560f9ce0 req-12f5940a-0e17-4582-8d13-a3fd6fc43c51 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:02.757014 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-34fa6c8e-91ad-4168-9be8-cc88560f9ce0 req-12f5940a-0e17-4582-8d13-a3fd6fc43c51 service nova] Creating event network-vif-deleted:cbb9d642-fe31-4c61-b558-e471183d26a4 for instance 90fd978f-f119-4293-b43e-2b0cf3aff18c on n-h1-851359-3 Aug 04 17:06:02.763161 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-34fa6c8e-91ad-4168-9be8-cc88560f9ce0 req-12f5940a-0e17-4582-8d13-a3fd6fc43c51 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052801 Aug 04 17:06:02.763940 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1383/2839] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:06:03.440340 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0267b01e-df3e-4a28-b5b6-a656fa137a9f tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:03.442226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0267b01e-df3e-4a28-b5b6-a656fa137a9f tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: d282ccab-7827-4b5e-8ba7-b1600d5140bf] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:03.456603 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0267b01e-df3e-4a28-b5b6-a656fa137a9f tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:03.458148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0267b01e-df3e-4a28-b5b6-a656fa137a9f tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:03.460146 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0267b01e-df3e-4a28-b5b6-a656fa137a9f tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:03.461301 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0267b01e-df3e-4a28-b5b6-a656fa137a9f tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:03.462304 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0267b01e-df3e-4a28-b5b6-a656fa137a9f tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:03.463193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0267b01e-df3e-4a28-b5b6-a656fa137a9f tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:03.721960 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d82da623-5469-44b3-8fce-e4c12ff55a67 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:03.723615 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d82da623-5469-44b3-8fce-e4c12ff55a67 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: 90fd978f-f119-4293-b43e-2b0cf3aff18c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:03.735886 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d82da623-5469-44b3-8fce-e4c12ff55a67 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:03.736999 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d82da623-5469-44b3-8fce-e4c12ff55a67 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:03.738540 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d82da623-5469-44b3-8fce-e4c12ff55a67 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:03.741654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d82da623-5469-44b3-8fce-e4c12ff55a67 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:03.742709 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d82da623-5469-44b3-8fce-e4c12ff55a67 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:03.744151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d82da623-5469-44b3-8fce-e4c12ff55a67 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:04.143252 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:06:04.451524 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0267b01e-df3e-4a28-b5b6-a656fa137a9f tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:04.460793 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:06:04.463309 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0267b01e-df3e-4a28-b5b6-a656fa137a9f tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/d282ccab-7827-4b5e-8ba7-b1600d5140bf" status: 200 len: 1509 microversion: 2.1 time: 1.030364 Aug 04 17:06:04.478526 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1457/2840] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:03 2022] GET /compute/v2.1/servers/d282ccab-7827-4b5e-8ba7-b1600d5140bf => generated 1509 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:06:04.484929 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-42a24e81-6698-4d56-b772-11ec30904613 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:04.491738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-42a24e81-6698-4d56-b772-11ec30904613 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ca421464-9d69-4127-a819-37fc1936680e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:04.502055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42a24e81-6698-4d56-b772-11ec30904613 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:04.502899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42a24e81-6698-4d56-b772-11ec30904613 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:04.504141 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42a24e81-6698-4d56-b772-11ec30904613 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:04.505084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42a24e81-6698-4d56-b772-11ec30904613 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:04.505759 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42a24e81-6698-4d56-b772-11ec30904613 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:04.506438 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42a24e81-6698-4d56-b772-11ec30904613 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:04.515639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d82da623-5469-44b3-8fce-e4c12ff55a67 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:04.523955 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d82da623-5469-44b3-8fce-e4c12ff55a67 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c" status: 200 len: 1494 microversion: 2.1 time: 0.811465 Aug 04 17:06:04.528217 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1384/2841] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:03 2022] GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c => generated 1494 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:04.546973 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ba97412c-e2c8-4e0c-8101-5856cbca6744 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:04.547890 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ba97412c-e2c8-4e0c-8101-5856cbca6744 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: d282ccab-7827-4b5e-8ba7-b1600d5140bf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:04.560658 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba97412c-e2c8-4e0c-8101-5856cbca6744 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:04.562633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba97412c-e2c8-4e0c-8101-5856cbca6744 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:04.566101 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba97412c-e2c8-4e0c-8101-5856cbca6744 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:04.573360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba97412c-e2c8-4e0c-8101-5856cbca6744 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:04.574202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba97412c-e2c8-4e0c-8101-5856cbca6744 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:04.575538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba97412c-e2c8-4e0c-8101-5856cbca6744 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:04.632329 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ba97412c-e2c8-4e0c-8101-5856cbca6744 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: d282ccab-7827-4b5e-8ba7-b1600d5140bf] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:06:04.797726 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ba97412c-e2c8-4e0c-8101-5856cbca6744 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "DELETE /compute/v2.1/servers/d282ccab-7827-4b5e-8ba7-b1600d5140bf" status: 204 len: 0 microversion: 2.1 time: 0.267738 Aug 04 17:06:04.810148 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1385/2842] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:06:04 2022] DELETE /compute/v2.1/servers/d282ccab-7827-4b5e-8ba7-b1600d5140bf => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:06:04.817963 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6631e04c-7a85-43c7-a074-14ab5ef48552 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:04.819306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6631e04c-7a85-43c7-a074-14ab5ef48552 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: 3c07f7b5-53ae-43c8-a0b6-3c5502e02c42] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:04.835405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6631e04c-7a85-43c7-a074-14ab5ef48552 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:04.836417 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6631e04c-7a85-43c7-a074-14ab5ef48552 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:04.837144 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6631e04c-7a85-43c7-a074-14ab5ef48552 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:04.838315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6631e04c-7a85-43c7-a074-14ab5ef48552 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:04.839012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6631e04c-7a85-43c7-a074-14ab5ef48552 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:04.839666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6631e04c-7a85-43c7-a074-14ab5ef48552 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:04.885335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6631e04c-7a85-43c7-a074-14ab5ef48552 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: 3c07f7b5-53ae-43c8-a0b6-3c5502e02c42] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:06:04.890005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:06:05.018458 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6631e04c-7a85-43c7-a074-14ab5ef48552 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "DELETE /compute/v2.1/servers/3c07f7b5-53ae-43c8-a0b6-3c5502e02c42" status: 204 len: 0 microversion: 2.1 time: 0.205011 Aug 04 17:06:05.019484 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1386/2843] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:06:04 2022] DELETE /compute/v2.1/servers/3c07f7b5-53ae-43c8-a0b6-3c5502e02c42 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:06:05.173046 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-78e27b86-6eea-4184-9073-c1ebfd82b28b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-519931266", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "e904bd66-a6e8-4396-b479-05a4e6758d3f"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:05.260050 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-78e27b86-6eea-4184-9073-c1ebfd82b28b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] validate_networks() for [('e904bd66-a6e8-4396-b479-05a4e6758d3f', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:06:05.801531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-42a24e81-6698-4d56-b772-11ec30904613 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:05.819142 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-42a24e81-6698-4d56-b772-11ec30904613 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e" status: 200 len: 1318 microversion: 2.1 time: 1.339279 Aug 04 17:06:05.839080 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1458/2844] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:04 2022] GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e => generated 1318 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:05.858537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-60e3d1e7-e485-42f6-8463-d922e7796184 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:05.859564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-60e3d1e7-e485-42f6-8463-d922e7796184 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: 90fd978f-f119-4293-b43e-2b0cf3aff18c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:05.883784 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60e3d1e7-e485-42f6-8463-d922e7796184 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:05.884471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60e3d1e7-e485-42f6-8463-d922e7796184 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:05.885080 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60e3d1e7-e485-42f6-8463-d922e7796184 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:05.886052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60e3d1e7-e485-42f6-8463-d922e7796184 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:05.886679 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60e3d1e7-e485-42f6-8463-d922e7796184 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:05.887445 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60e3d1e7-e485-42f6-8463-d922e7796184 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:05.928003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:06:06.120057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-60e3d1e7-e485-42f6-8463-d922e7796184 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:06.129385 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-60e3d1e7-e485-42f6-8463-d922e7796184 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c" status: 200 len: 1452 microversion: 2.1 time: 0.288091 Aug 04 17:06:06.129989 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1459/2845] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:05 2022] GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c => generated 1452 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:06.166518 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-91a18bc6-7607-4bc1-a18e-c4ab3277651d req-23be3507-fbe1-407b-9621-df33e2630965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90fd978f-f119-4293-b43e-2b0cf3aff18c", "name": "network-vif-deleted", "tag": "88598e0e-8988-41cd-afdf-18e2cadc4c97"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:06.184097 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-91a18bc6-7607-4bc1-a18e-c4ab3277651d req-23be3507-fbe1-407b-9621-df33e2630965 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:06.184939 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-91a18bc6-7607-4bc1-a18e-c4ab3277651d req-23be3507-fbe1-407b-9621-df33e2630965 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:06.187289 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-91a18bc6-7607-4bc1-a18e-c4ab3277651d req-23be3507-fbe1-407b-9621-df33e2630965 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:06.212577 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-91a18bc6-7607-4bc1-a18e-c4ab3277651d req-23be3507-fbe1-407b-9621-df33e2630965 service nova] Creating event network-vif-deleted:88598e0e-8988-41cd-afdf-18e2cadc4c97 for instance 90fd978f-f119-4293-b43e-2b0cf3aff18c on n-h1-851359-3 Aug 04 17:06:06.220696 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-91a18bc6-7607-4bc1-a18e-c4ab3277651d req-23be3507-fbe1-407b-9621-df33e2630965 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083813 Aug 04 17:06:06.221525 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1460/2846] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:06:06.416399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-3777d49b-af06-4efd-97b0-895f28a827d9 req-36ba3117-624d-43f7-8464-ef177ca36656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbee7e39-ec6b-4a04-92e3-56c14721eb85", "tag": "f33593f9-9a52-4a4a-ab95-39d9214c39fc"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:06.514702 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-3777d49b-af06-4efd-97b0-895f28a827d9 req-36ba3117-624d-43f7-8464-ef177ca36656 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:06.515597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-3777d49b-af06-4efd-97b0-895f28a827d9 req-36ba3117-624d-43f7-8464-ef177ca36656 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:06.516726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-3777d49b-af06-4efd-97b0-895f28a827d9 req-36ba3117-624d-43f7-8464-ef177ca36656 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:06.547099 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-3777d49b-af06-4efd-97b0-895f28a827d9 req-36ba3117-624d-43f7-8464-ef177ca36656 service nova] Creating event network-changed:f33593f9-9a52-4a4a-ab95-39d9214c39fc for instance fbee7e39-ec6b-4a04-92e3-56c14721eb85 on n-h2-851359-3 Aug 04 17:06:06.559837 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-3777d49b-af06-4efd-97b0-895f28a827d9 req-36ba3117-624d-43f7-8464-ef177ca36656 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146183 Aug 04 17:06:06.575695 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1461/2847] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:06:06.850600 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-00c32520-9353-489b-9596-f8e586dd3437 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:06.852130 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-00c32520-9353-489b-9596-f8e586dd3437 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ca421464-9d69-4127-a819-37fc1936680e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:06.882415 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00c32520-9353-489b-9596-f8e586dd3437 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:06.883075 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00c32520-9353-489b-9596-f8e586dd3437 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:06.889754 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00c32520-9353-489b-9596-f8e586dd3437 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:06.892636 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00c32520-9353-489b-9596-f8e586dd3437 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:06.898363 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00c32520-9353-489b-9596-f8e586dd3437 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:06.899168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00c32520-9353-489b-9596-f8e586dd3437 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:07.405712 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-78e27b86-6eea-4184-9073-c1ebfd82b28b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:06:07.407049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-78e27b86-6eea-4184-9073-c1ebfd82b28b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:06:07.407866 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-78e27b86-6eea-4184-9073-c1ebfd82b28b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:06:07.409327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-78e27b86-6eea-4184-9073-c1ebfd82b28b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:06:07.410066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-78e27b86-6eea-4184-9073-c1ebfd82b28b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:06:07.437828 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78e27b86-6eea-4184-9073-c1ebfd82b28b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:07.438548 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78e27b86-6eea-4184-9073-c1ebfd82b28b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:07.439465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78e27b86-6eea-4184-9073-c1ebfd82b28b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:07.440766 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78e27b86-6eea-4184-9073-c1ebfd82b28b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:07.441633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78e27b86-6eea-4184-9073-c1ebfd82b28b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:07.442287 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78e27b86-6eea-4184-9073-c1ebfd82b28b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:07.485874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-78e27b86-6eea-4184-9073-c1ebfd82b28b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Getting quotas for project 02352ec274b443429fa5abe400cbcfd0. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:06:07.499600 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-78e27b86-6eea-4184-9073-c1ebfd82b28b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Getting quotas for user c98638b115404c7d85de7541d9c4182b and project 02352ec274b443429fa5abe400cbcfd0. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:06:07.517945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-78e27b86-6eea-4184-9073-c1ebfd82b28b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Going to run 2 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:06:07.551031 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-78e27b86-6eea-4184-9073-c1ebfd82b28b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: bedaa2fb-63ea-4088-9f32-9a0f0bb34c11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:06:07.674354 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-78e27b86-6eea-4184-9073-c1ebfd82b28b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: fb91686e-c56f-43c3-a4b6-24cacc14acc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=bedaa2fb-63ea-4088-9f32-9a0f0bb34c11,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:06:07.752505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-00c32520-9353-489b-9596-f8e586dd3437 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:07.761508 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-00c32520-9353-489b-9596-f8e586dd3437 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e" status: 200 len: 1318 microversion: 2.1 time: 0.918031 Aug 04 17:06:07.764478 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1462/2848] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:06 2022] GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e => generated 1318 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:07.781230 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bd03b8a1-a187-454d-9a09-1add1c3fc50a tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:07.782247 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bd03b8a1-a187-454d-9a09-1add1c3fc50a tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: 90fd978f-f119-4293-b43e-2b0cf3aff18c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:07.793523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bd03b8a1-a187-454d-9a09-1add1c3fc50a tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:07.794470 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bd03b8a1-a187-454d-9a09-1add1c3fc50a tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:07.795688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bd03b8a1-a187-454d-9a09-1add1c3fc50a tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:07.799220 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-78e27b86-6eea-4184-9073-c1ebfd82b28b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.631345 Aug 04 17:06:07.800468 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1387/2849] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:06:05 2022] POST /compute/v2.1/servers => generated 32 bytes in 2633 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Aug 04 17:06:07.808439 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6454decd-7f0e-493e-b784-765d3a2bfe4b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:07.809318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bd03b8a1-a187-454d-9a09-1add1c3fc50a tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:07.816985 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6454decd-7f0e-493e-b784-765d3a2bfe4b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:07.817470 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bd03b8a1-a187-454d-9a09-1add1c3fc50a tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:07.818088 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6454decd-7f0e-493e-b784-765d3a2bfe4b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Searching by: {'deleted': False, 'project_id': '02352ec274b443429fa5abe400cbcfd0'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:06:07.818338 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bd03b8a1-a187-454d-9a09-1add1c3fc50a tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:07.848795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6454decd-7f0e-493e-b784-765d3a2bfe4b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:07.851356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6454decd-7f0e-493e-b784-765d3a2bfe4b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:07.852702 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6454decd-7f0e-493e-b784-765d3a2bfe4b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:07.854212 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6454decd-7f0e-493e-b784-765d3a2bfe4b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:07.854912 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6454decd-7f0e-493e-b784-765d3a2bfe4b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:07.855736 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6454decd-7f0e-493e-b784-765d3a2bfe4b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:07.901691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-6454decd-7f0e-493e-b784-765d3a2bfe4b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:06:07.947917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bd03b8a1-a187-454d-9a09-1add1c3fc50a tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:07.948468 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bd03b8a1-a187-454d-9a09-1add1c3fc50a tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:07.948995 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bd03b8a1-a187-454d-9a09-1add1c3fc50a tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:07.949474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-bd03b8a1-a187-454d-9a09-1add1c3fc50a tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lazy-loading 'fault' on Instance uuid 90fd978f-f119-4293-b43e-2b0cf3aff18c {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:06:07.957459 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6454decd-7f0e-493e-b784-765d3a2bfe4b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.152378 Aug 04 17:06:07.959290 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1388/2850] 10.222.0.93 () {58 vars in 1125 bytes} [Thu Aug 4 17:06:07 2022] GET /compute/v2.1/servers => generated 1335 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:06:07.981768 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d4f4ff60-a443-4e00-857e-84a5e229f556 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:07.986823 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d4f4ff60-a443-4e00-857e-84a5e229f556 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: fb91686e-c56f-43c3-a4b6-24cacc14acc7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:08.080808 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bd03b8a1-a187-454d-9a09-1add1c3fc50a tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '234245a6fb7c441aa667a4ad619c1986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12dc616249934210aab2670a55053ecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:08.110646 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bd03b8a1-a187-454d-9a09-1add1c3fc50a tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c" status: 200 len: 1302 microversion: 2.1 time: 0.341065 Aug 04 17:06:08.112065 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1463/2851] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:07 2022] GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c => generated 1302 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:08.803160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e7354c55-e0fa-47f8-b8c6-5bd8ec673018 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:08.804258 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e7354c55-e0fa-47f8-b8c6-5bd8ec673018 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ca421464-9d69-4127-a819-37fc1936680e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:08.827144 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7354c55-e0fa-47f8-b8c6-5bd8ec673018 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:08.829404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7354c55-e0fa-47f8-b8c6-5bd8ec673018 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:08.830006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7354c55-e0fa-47f8-b8c6-5bd8ec673018 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:08.832064 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7354c55-e0fa-47f8-b8c6-5bd8ec673018 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:08.832557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7354c55-e0fa-47f8-b8c6-5bd8ec673018 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:08.834649 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7354c55-e0fa-47f8-b8c6-5bd8ec673018 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:09.149203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d4f4ff60-a443-4e00-857e-84a5e229f556 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:09.157579 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d4f4ff60-a443-4e00-857e-84a5e229f556 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/fb91686e-c56f-43c3-a4b6-24cacc14acc7" status: 200 len: 1217 microversion: 2.1 time: 1.183234 Aug 04 17:06:09.160299 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1389/2852] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:07 2022] GET /compute/v2.1/servers/fb91686e-c56f-43c3-a4b6-24cacc14acc7 => generated 1217 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:09.174685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-812daed1-ba7a-4b56-9eff-7541f4b88a46 req-cd24b33c-ec88-42d4-a89d-62193ae0f4c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca421464-9d69-4127-a819-37fc1936680e", "tag": "4aae10f2-78c6-4a89-949e-8258cf606147"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:09.189862 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-812daed1-ba7a-4b56-9eff-7541f4b88a46 req-cd24b33c-ec88-42d4-a89d-62193ae0f4c9 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:09.192003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-812daed1-ba7a-4b56-9eff-7541f4b88a46 req-cd24b33c-ec88-42d4-a89d-62193ae0f4c9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:09.193748 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-812daed1-ba7a-4b56-9eff-7541f4b88a46 req-cd24b33c-ec88-42d4-a89d-62193ae0f4c9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:09.211502 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-812daed1-ba7a-4b56-9eff-7541f4b88a46 req-cd24b33c-ec88-42d4-a89d-62193ae0f4c9 service nova] Creating event network-changed:4aae10f2-78c6-4a89-949e-8258cf606147 for instance ca421464-9d69-4127-a819-37fc1936680e on n-h1-851359-3 Aug 04 17:06:09.218627 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-812daed1-ba7a-4b56-9eff-7541f4b88a46 req-cd24b33c-ec88-42d4-a89d-62193ae0f4c9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056799 Aug 04 17:06:09.219477 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1390/2853] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:06:09.227169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5bd67196-9190-427d-9dfd-92beb27d5efe tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:09.229999 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5bd67196-9190-427d-9dfd-92beb27d5efe tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: 90fd978f-f119-4293-b43e-2b0cf3aff18c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:09.237075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5bd67196-9190-427d-9dfd-92beb27d5efe tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:09.237948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5bd67196-9190-427d-9dfd-92beb27d5efe tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:09.238753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5bd67196-9190-427d-9dfd-92beb27d5efe tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:09.241369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5bd67196-9190-427d-9dfd-92beb27d5efe tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:09.241859 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5bd67196-9190-427d-9dfd-92beb27d5efe tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:09.242367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5bd67196-9190-427d-9dfd-92beb27d5efe tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:09.260664 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-5bd67196-9190-427d-9dfd-92beb27d5efe tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] HTTP exception thrown: Instance 90fd978f-f119-4293-b43e-2b0cf3aff18c could not be found. Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5bd67196-9190-427d-9dfd-92beb27d5efe tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Request method failure captured: Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c HTTP/1.1 Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_wVVZ576bEuleBDdDhY4I0SQ0zK3Ghzp1cBRfY4ga-r487I6rdcJL24mx3zcbzv-eCIwK8F09BnRcC2jNkBlj8M7SUhFxVchCfQtxfke5cInlh_p2edIMVe-YibO79gM4UqJdNGNVAIUbvxuAch_j1xV7m-350QVlKDFEpK_YXnMFk Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 12dc616249934210aab2670a55053ecc Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersTestMultiNic-1689890194 Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/12dc616249934210aab2670a55053ecc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/12dc616249934210aab2670a55053ecc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_12dc616249934210aab2670a55053ecc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/12dc616249934210aab2670a55053ecc"}]}] Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersTestMultiNic-1689890194 Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 12dc616249934210aab2670a55053ecc Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersTestMultiNic-1689890194 Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersTestMultiNic-1689890194-project Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 234245a6fb7c441aa667a4ad619c1986 Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersTestMultiNic-1689890194-project Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 90fd978f-f119-4293-b43e-2b0cf3aff18c could not be found. Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '90fd978f-f119-4293-b43e-2b0cf3aff18c'} Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90fd978f-f119-4293-b43e-2b0cf3aff18c could not be found. Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90fd978f-f119-4293-b43e-2b0cf3aff18c could not be found. Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:09.264708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:09.269853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:09.269853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:09.269853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:09.269853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:06:09.269853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:06:09.269853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90fd978f-f119-4293-b43e-2b0cf3aff18c could not be found. Aug 04 17:06:09.269853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:09.269853 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5bd67196-9190-427d-9dfd-92beb27d5efe tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Returning 404 to user: Instance 90fd978f-f119-4293-b43e-2b0cf3aff18c could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:06:09.269853 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5bd67196-9190-427d-9dfd-92beb27d5efe tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c" status: 404 len: 111 microversion: 2.1 time: 0.046077 Aug 04 17:06:09.269853 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1391/2854] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:09 2022] GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:06:09.754764 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e7354c55-e0fa-47f8-b8c6-5bd8ec673018 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:09.781770 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e7354c55-e0fa-47f8-b8c6-5bd8ec673018 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e" status: 200 len: 1318 microversion: 2.1 time: 0.999948 Aug 04 17:06:09.783346 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1464/2855] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:08 2022] GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e => generated 1318 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:10.179258 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-33acac1a-a04c-44d2-84b3-6998301eebcc tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:10.179890 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-33acac1a-a04c-44d2-84b3-6998301eebcc tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: fb91686e-c56f-43c3-a4b6-24cacc14acc7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:10.188275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33acac1a-a04c-44d2-84b3-6998301eebcc tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:10.206658 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33acac1a-a04c-44d2-84b3-6998301eebcc tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:10.209705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33acac1a-a04c-44d2-84b3-6998301eebcc tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:10.210512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33acac1a-a04c-44d2-84b3-6998301eebcc tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:10.210986 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33acac1a-a04c-44d2-84b3-6998301eebcc tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:10.214599 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33acac1a-a04c-44d2-84b3-6998301eebcc tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:10.674964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-33acac1a-a04c-44d2-84b3-6998301eebcc tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:10.686890 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-33acac1a-a04c-44d2-84b3-6998301eebcc tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/fb91686e-c56f-43c3-a4b6-24cacc14acc7" status: 200 len: 1277 microversion: 2.1 time: 0.510457 Aug 04 17:06:10.704726 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1392/2856] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:10 2022] GET /compute/v2.1/servers/fb91686e-c56f-43c3-a4b6-24cacc14acc7 => generated 1277 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:10.807880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-afb75770-5944-479e-8474-69cc4f006069 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:10.808525 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-afb75770-5944-479e-8474-69cc4f006069 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ca421464-9d69-4127-a819-37fc1936680e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:10.839205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-afb75770-5944-479e-8474-69cc4f006069 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:10.839709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-afb75770-5944-479e-8474-69cc4f006069 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:10.847162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-afb75770-5944-479e-8474-69cc4f006069 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:10.850545 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-afb75770-5944-479e-8474-69cc4f006069 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:10.853725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-afb75770-5944-479e-8474-69cc4f006069 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:10.854220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-afb75770-5944-479e-8474-69cc4f006069 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:11.695591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-afb75770-5944-479e-8474-69cc4f006069 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:11.710311 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-afb75770-5944-479e-8474-69cc4f006069 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e" status: 200 len: 1318 microversion: 2.1 time: 0.907670 Aug 04 17:06:11.723767 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-da227fcc-f03b-42b4-a05a-69bedbfeec17 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:11.724469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-da227fcc-f03b-42b4-a05a-69bedbfeec17 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: fb91686e-c56f-43c3-a4b6-24cacc14acc7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:11.724969 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1465/2857] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:10 2022] GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e => generated 1318 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:11.749250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da227fcc-f03b-42b4-a05a-69bedbfeec17 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:11.749757 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da227fcc-f03b-42b4-a05a-69bedbfeec17 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:11.752275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da227fcc-f03b-42b4-a05a-69bedbfeec17 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:11.755001 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da227fcc-f03b-42b4-a05a-69bedbfeec17 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:11.755640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da227fcc-f03b-42b4-a05a-69bedbfeec17 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:11.756240 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da227fcc-f03b-42b4-a05a-69bedbfeec17 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:11.788670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-465135e0-1e8c-4386-b0f8-005d9bfab6e5 req-848e2072-162d-4905-9786-3f5a3409a678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d282ccab-7827-4b5e-8ba7-b1600d5140bf", "name": "network-vif-deleted", "tag": "4e302672-974c-496d-bdd8-b15b1245f517"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:11.806748 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-465135e0-1e8c-4386-b0f8-005d9bfab6e5 req-848e2072-162d-4905-9786-3f5a3409a678 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:11.807503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-465135e0-1e8c-4386-b0f8-005d9bfab6e5 req-848e2072-162d-4905-9786-3f5a3409a678 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:11.809303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-465135e0-1e8c-4386-b0f8-005d9bfab6e5 req-848e2072-162d-4905-9786-3f5a3409a678 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:11.843653 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-465135e0-1e8c-4386-b0f8-005d9bfab6e5 req-848e2072-162d-4905-9786-3f5a3409a678 service nova] Creating event network-vif-deleted:4e302672-974c-496d-bdd8-b15b1245f517 for instance d282ccab-7827-4b5e-8ba7-b1600d5140bf on n-h1-851359-3 Aug 04 17:06:11.855824 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-465135e0-1e8c-4386-b0f8-005d9bfab6e5 req-848e2072-162d-4905-9786-3f5a3409a678 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072193 Aug 04 17:06:11.856854 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1466/2858] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:06:12.023609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-da227fcc-f03b-42b4-a05a-69bedbfeec17 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:12.034770 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-da227fcc-f03b-42b4-a05a-69bedbfeec17 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/fb91686e-c56f-43c3-a4b6-24cacc14acc7" status: 200 len: 1275 microversion: 2.1 time: 0.323128 Aug 04 17:06:12.050915 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1393/2859] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:11 2022] GET /compute/v2.1/servers/fb91686e-c56f-43c3-a4b6-24cacc14acc7 => generated 1275 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:12.732371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ab26eab4-cc3e-42e0-b23f-5d4d88a8014c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:12.734016 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ab26eab4-cc3e-42e0-b23f-5d4d88a8014c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ca421464-9d69-4127-a819-37fc1936680e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:12.741152 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ab26eab4-cc3e-42e0-b23f-5d4d88a8014c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:12.741831 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ab26eab4-cc3e-42e0-b23f-5d4d88a8014c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:12.742466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ab26eab4-cc3e-42e0-b23f-5d4d88a8014c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:12.743336 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ab26eab4-cc3e-42e0-b23f-5d4d88a8014c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:12.743950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ab26eab4-cc3e-42e0-b23f-5d4d88a8014c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:12.744533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ab26eab4-cc3e-42e0-b23f-5d4d88a8014c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:12.920717 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-26b8c438-e694-4ea7-8744-086d1846f587 req-05a53f51-e769-4e82-9784-257066e6d7d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c07f7b5-53ae-43c8-a0b6-3c5502e02c42", "name": "network-vif-deleted", "tag": "9d5167e5-e571-43e2-9d9e-67c4cc47d93c"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:12.941890 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-26b8c438-e694-4ea7-8744-086d1846f587 req-05a53f51-e769-4e82-9784-257066e6d7d4 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:12.942404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-26b8c438-e694-4ea7-8744-086d1846f587 req-05a53f51-e769-4e82-9784-257066e6d7d4 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:12.942832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-26b8c438-e694-4ea7-8744-086d1846f587 req-05a53f51-e769-4e82-9784-257066e6d7d4 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:12.961732 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-26b8c438-e694-4ea7-8744-086d1846f587 req-05a53f51-e769-4e82-9784-257066e6d7d4 service nova] Creating event network-vif-deleted:9d5167e5-e571-43e2-9d9e-67c4cc47d93c for instance 3c07f7b5-53ae-43c8-a0b6-3c5502e02c42 on n-h1-851359-3 Aug 04 17:06:12.969397 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-26b8c438-e694-4ea7-8744-086d1846f587 req-05a53f51-e769-4e82-9784-257066e6d7d4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051516 Aug 04 17:06:12.970938 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1394/2860] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:06:13.075222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-175c9dc7-6b52-448b-9584-2c834984fd44 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:13.076644 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-175c9dc7-6b52-448b-9584-2c834984fd44 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: fb91686e-c56f-43c3-a4b6-24cacc14acc7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:13.101750 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-175c9dc7-6b52-448b-9584-2c834984fd44 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:13.102287 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-175c9dc7-6b52-448b-9584-2c834984fd44 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:13.102734 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-175c9dc7-6b52-448b-9584-2c834984fd44 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:13.103466 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-175c9dc7-6b52-448b-9584-2c834984fd44 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:13.103928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-175c9dc7-6b52-448b-9584-2c834984fd44 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:13.104362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-175c9dc7-6b52-448b-9584-2c834984fd44 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:13.372023 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-175c9dc7-6b52-448b-9584-2c834984fd44 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:13.389155 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-175c9dc7-6b52-448b-9584-2c834984fd44 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/fb91686e-c56f-43c3-a4b6-24cacc14acc7" status: 200 len: 1275 microversion: 2.1 time: 0.331052 Aug 04 17:06:13.390492 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1395/2861] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:13 2022] GET /compute/v2.1/servers/fb91686e-c56f-43c3-a4b6-24cacc14acc7 => generated 1275 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:13.571429 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ab26eab4-cc3e-42e0-b23f-5d4d88a8014c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:13.575900 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fcfa830d-ce49-434e-8e29-0567a8d6061d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:13.576630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fcfa830d-ce49-434e-8e29-0567a8d6061d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:13.582531 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ab26eab4-cc3e-42e0-b23f-5d4d88a8014c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e" status: 200 len: 1318 microversion: 2.1 time: 0.854113 Aug 04 17:06:13.594839 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1467/2862] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:12 2022] GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e => generated 1318 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:13.595320 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fcfa830d-ce49-434e-8e29-0567a8d6061d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:13.595320 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fcfa830d-ce49-434e-8e29-0567a8d6061d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:13.595320 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fcfa830d-ce49-434e-8e29-0567a8d6061d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:13.595320 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fcfa830d-ce49-434e-8e29-0567a8d6061d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:13.595320 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fcfa830d-ce49-434e-8e29-0567a8d6061d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:13.595320 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fcfa830d-ce49-434e-8e29-0567a8d6061d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:13.638240 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-fcfa830d-ce49-434e-8e29-0567a8d6061d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] HTTP exception thrown: Instance 238cb283-0037-440c-a433-d3f4e3de1274 could not be found. Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fcfa830d-ce49-434e-8e29-0567a8d6061d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Request method failure captured: Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 HTTP/1.1 Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_q-Ue6VMDa_iMNINJR4zf0i_CKtIwGuQvgOgsq8hwYYxmEM4QNYnzVbdzIdGnhCeGRVDv_B0NSNojPa3PpHI00NRYaaP348KeE80sy3s9E2gDLXW3xGQa9ki0Q_RJ2otPyPOdobZN03Z7KOumKku5Pmr9v0PMyOnl2u8HtvwQKNxwE Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.32 Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: d3928c7e72ed440aafbbfd6c2a269906 Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TaggedBootDevicesTest-31982629 Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d3928c7e72ed440aafbbfd6c2a269906"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d3928c7e72ed440aafbbfd6c2a269906"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d3928c7e72ed440aafbbfd6c2a269906"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d3928c7e72ed440aafbbfd6c2a269906"}]}] Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TaggedBootDevicesTest-31982629 Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: d3928c7e72ed440aafbbfd6c2a269906 Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TaggedBootDevicesTest-31982629 Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TaggedBootDevicesTest-31982629-project Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 2dcf3d21bb40468f8f9e087fbd99152e Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TaggedBootDevicesTest-31982629-project Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 238cb283-0037-440c-a433-d3f4e3de1274 could not be found. Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '238cb283-0037-440c-a433-d3f4e3de1274'} Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 238cb283-0037-440c-a433-d3f4e3de1274 could not be found. Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:06:13.640472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:06:13.645325 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 238cb283-0037-440c-a433-d3f4e3de1274 could not be found. Aug 04 17:06:13.645325 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:13.645325 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:13.645325 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:13.645325 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:13.645325 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:13.645325 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:13.645325 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:06:13.645325 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:06:13.645325 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 238cb283-0037-440c-a433-d3f4e3de1274 could not be found. Aug 04 17:06:13.645325 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:13.647310 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fcfa830d-ce49-434e-8e29-0567a8d6061d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Returning 404 to user: Instance 238cb283-0037-440c-a433-d3f4e3de1274 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:06:13.649819 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fcfa830d-ce49-434e-8e29-0567a8d6061d tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "DELETE /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 404 len: 111 microversion: 2.32 time: 0.078278 Aug 04 17:06:13.651584 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1396/2863] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Aug 4 17:06:13 2022] DELETE /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 04 17:06:13.660147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6833cf12-7709-4ec6-819d-0660b97d63ac tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:13.662029 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6833cf12-7709-4ec6-819d-0660b97d63ac tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] [instance: 238cb283-0037-440c-a433-d3f4e3de1274] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:13.679257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6833cf12-7709-4ec6-819d-0660b97d63ac tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:13.683158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6833cf12-7709-4ec6-819d-0660b97d63ac tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:13.683622 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6833cf12-7709-4ec6-819d-0660b97d63ac tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:13.684392 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6833cf12-7709-4ec6-819d-0660b97d63ac tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:13.684874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6833cf12-7709-4ec6-819d-0660b97d63ac tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:13.686030 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6833cf12-7709-4ec6-819d-0660b97d63ac tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:13.773656 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-6833cf12-7709-4ec6-819d-0660b97d63ac tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] HTTP exception thrown: Instance 238cb283-0037-440c-a433-d3f4e3de1274 could not be found. Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6833cf12-7709-4ec6-819d-0660b97d63ac tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Request method failure captured: Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 HTTP/1.1 Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_q-Ue6VMDa_iMNINJR4zf0i_CKtIwGuQvgOgsq8hwYYxmEM4QNYnzVbdzIdGnhCeGRVDv_B0NSNojPa3PpHI00NRYaaP348KeE80sy3s9E2gDLXW3xGQa9ki0Q_RJ2otPyPOdobZN03Z7KOumKku5Pmr9v0PMyOnl2u8HtvwQKNxwE Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: X-Openstack-Nova-Api-Version: 2.32 Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: d3928c7e72ed440aafbbfd6c2a269906 Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-TaggedBootDevicesTest-31982629 Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d3928c7e72ed440aafbbfd6c2a269906"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d3928c7e72ed440aafbbfd6c2a269906"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d3928c7e72ed440aafbbfd6c2a269906"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d3928c7e72ed440aafbbfd6c2a269906"}]}] Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-TaggedBootDevicesTest-31982629 Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: d3928c7e72ed440aafbbfd6c2a269906 Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-TaggedBootDevicesTest-31982629 Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-TaggedBootDevicesTest-31982629-project Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 2dcf3d21bb40468f8f9e087fbd99152e Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-TaggedBootDevicesTest-31982629-project Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 238cb283-0037-440c-a433-d3f4e3de1274 could not be found. Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '238cb283-0037-440c-a433-d3f4e3de1274'} Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 238cb283-0037-440c-a433-d3f4e3de1274 could not be found. Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 238cb283-0037-440c-a433-d3f4e3de1274 could not be found. Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:13.777619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:13.783388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:13.783388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:13.783388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:13.783388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:06:13.783388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:06:13.783388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 238cb283-0037-440c-a433-d3f4e3de1274 could not be found. Aug 04 17:06:13.783388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:13.791202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6833cf12-7709-4ec6-819d-0660b97d63ac tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] Returning 404 to user: Instance 238cb283-0037-440c-a433-d3f4e3de1274 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:06:13.793087 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6833cf12-7709-4ec6-819d-0660b97d63ac tempest-TaggedBootDevicesTest-31982629 tempest-TaggedBootDevicesTest-31982629-project] 10.222.0.93 "GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274" status: 404 len: 111 microversion: 2.32 time: 0.136942 Aug 04 17:06:13.798880 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1468/2864] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:06:13 2022] GET /compute/v2.1/servers/238cb283-0037-440c-a433-d3f4e3de1274 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:06:14.411127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-68b7ea4b-1f74-4a27-b57d-feddcf75483c tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:14.412551 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-68b7ea4b-1f74-4a27-b57d-feddcf75483c tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: fb91686e-c56f-43c3-a4b6-24cacc14acc7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:14.427538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68b7ea4b-1f74-4a27-b57d-feddcf75483c tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:14.428274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68b7ea4b-1f74-4a27-b57d-feddcf75483c tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:14.430930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68b7ea4b-1f74-4a27-b57d-feddcf75483c tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:14.431861 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68b7ea4b-1f74-4a27-b57d-feddcf75483c tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:14.432479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68b7ea4b-1f74-4a27-b57d-feddcf75483c tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:14.433060 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68b7ea4b-1f74-4a27-b57d-feddcf75483c tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:14.554113 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-68b7ea4b-1f74-4a27-b57d-feddcf75483c tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:14.593204 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-68b7ea4b-1f74-4a27-b57d-feddcf75483c tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/fb91686e-c56f-43c3-a4b6-24cacc14acc7" status: 200 len: 1275 microversion: 2.1 time: 0.185552 Aug 04 17:06:14.594494 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1397/2865] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:14 2022] GET /compute/v2.1/servers/fb91686e-c56f-43c3-a4b6-24cacc14acc7 => generated 1275 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:14.612958 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-aaeda105-a221-4f08-8fb8-a635c9b694ac tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:14.614415 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-aaeda105-a221-4f08-8fb8-a635c9b694ac tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ca421464-9d69-4127-a819-37fc1936680e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:14.628436 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aaeda105-a221-4f08-8fb8-a635c9b694ac tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:14.629185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aaeda105-a221-4f08-8fb8-a635c9b694ac tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:14.629809 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aaeda105-a221-4f08-8fb8-a635c9b694ac tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:14.630734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aaeda105-a221-4f08-8fb8-a635c9b694ac tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:14.631351 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aaeda105-a221-4f08-8fb8-a635c9b694ac tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:14.631944 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aaeda105-a221-4f08-8fb8-a635c9b694ac tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:15.039366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-aaeda105-a221-4f08-8fb8-a635c9b694ac tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:15.049272 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-aaeda105-a221-4f08-8fb8-a635c9b694ac tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e" status: 200 len: 1318 microversion: 2.1 time: 0.442331 Aug 04 17:06:15.049870 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1469/2866] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:14 2022] GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e => generated 1318 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:15.619625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bf8d41ff-b6fe-4600-aef2-4a8180d55f0f tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:15.620280 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bf8d41ff-b6fe-4600-aef2-4a8180d55f0f tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: fb91686e-c56f-43c3-a4b6-24cacc14acc7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:15.640651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a2f0db12-43a3-40f3-b7a7-a6828382e33d tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Action: 'create', calling method: .version_select at 0x7f1e5b3b25e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1489813425", "description": "tempest-description-901425517"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:15.655783 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf8d41ff-b6fe-4600-aef2-4a8180d55f0f tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:15.659249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf8d41ff-b6fe-4600-aef2-4a8180d55f0f tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:15.659873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf8d41ff-b6fe-4600-aef2-4a8180d55f0f tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:15.663967 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf8d41ff-b6fe-4600-aef2-4a8180d55f0f tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:15.665449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf8d41ff-b6fe-4600-aef2-4a8180d55f0f tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:15.666101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf8d41ff-b6fe-4600-aef2-4a8180d55f0f tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:16.027748 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bf8d41ff-b6fe-4600-aef2-4a8180d55f0f tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:16.050763 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bf8d41ff-b6fe-4600-aef2-4a8180d55f0f tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/fb91686e-c56f-43c3-a4b6-24cacc14acc7" status: 200 len: 1275 microversion: 2.1 time: 0.435851 Aug 04 17:06:16.052520 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1470/2867] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:15 2022] GET /compute/v2.1/servers/fb91686e-c56f-43c3-a4b6-24cacc14acc7 => generated 1275 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:06:16.073114 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-18803aac-fec1-4d46-acc7-30b5b7a9b19f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:16.073940 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-18803aac-fec1-4d46-acc7-30b5b7a9b19f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ca421464-9d69-4127-a819-37fc1936680e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:16.085255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-18803aac-fec1-4d46-acc7-30b5b7a9b19f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:16.086322 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-18803aac-fec1-4d46-acc7-30b5b7a9b19f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:16.086891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-18803aac-fec1-4d46-acc7-30b5b7a9b19f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:16.087892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-18803aac-fec1-4d46-acc7-30b5b7a9b19f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:16.088464 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-18803aac-fec1-4d46-acc7-30b5b7a9b19f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:16.089000 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-18803aac-fec1-4d46-acc7-30b5b7a9b19f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:17.768603 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-18803aac-fec1-4d46-acc7-30b5b7a9b19f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:17.777494 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-18803aac-fec1-4d46-acc7-30b5b7a9b19f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e" status: 200 len: 1318 microversion: 2.1 time: 1.709028 Aug 04 17:06:17.787191 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1471/2868] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:16 2022] GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e => generated 1318 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:17.792377 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-28848a72-6f43-43d5-988f-b9861f7897ac tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:17.793508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-28848a72-6f43-43d5-988f-b9861f7897ac tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: fb91686e-c56f-43c3-a4b6-24cacc14acc7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:17.812135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28848a72-6f43-43d5-988f-b9861f7897ac tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:17.813086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28848a72-6f43-43d5-988f-b9861f7897ac tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:17.813770 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28848a72-6f43-43d5-988f-b9861f7897ac tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:17.815104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28848a72-6f43-43d5-988f-b9861f7897ac tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:17.815843 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28848a72-6f43-43d5-988f-b9861f7897ac tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:17.816516 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28848a72-6f43-43d5-988f-b9861f7897ac tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:17.862697 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=8 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:06:18.361339 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a2f0db12-43a3-40f3-b7a7-a6828382e33d tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 3.056459 Aug 04 17:06:18.362286 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1398/2869] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Aug 4 17:06:15 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 3061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:06:18.381840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-30584d93-35ee-4b25-8d15-7200eb19acb6 req-eab5c412-e05c-4777-9666-f05ec5dd1290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbee7e39-ec6b-4a04-92e3-56c14721eb85", "name": "network-vif-plugged", "status": "completed", "tag": "f33593f9-9a52-4a4a-ab95-39d9214c39fc"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:18.412343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-30584d93-35ee-4b25-8d15-7200eb19acb6 req-eab5c412-e05c-4777-9666-f05ec5dd1290 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:18.414958 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-30584d93-35ee-4b25-8d15-7200eb19acb6 req-eab5c412-e05c-4777-9666-f05ec5dd1290 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:18.419189 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-30584d93-35ee-4b25-8d15-7200eb19acb6 req-eab5c412-e05c-4777-9666-f05ec5dd1290 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:18.452907 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-30584d93-35ee-4b25-8d15-7200eb19acb6 req-eab5c412-e05c-4777-9666-f05ec5dd1290 service nova] Creating event network-vif-plugged:f33593f9-9a52-4a4a-ab95-39d9214c39fc for instance fbee7e39-ec6b-4a04-92e3-56c14721eb85 on n-h2-851359-3 Aug 04 17:06:18.469620 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-30584d93-35ee-4b25-8d15-7200eb19acb6 req-eab5c412-e05c-4777-9666-f05ec5dd1290 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105692 Aug 04 17:06:18.470525 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1399/2870] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:06:18.482724 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-83051f1f-7532-4326-8c49-4632b9e6292a tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Action: 'create', calling method: .version_select at 0x7f1e5b366040>, body: {"security_group_rule": {"parent_group_id": "9780d5f9-f112-4f3d-9898-f82c62d85107", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:18.736436 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-28848a72-6f43-43d5-988f-b9861f7897ac tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:18.747098 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-28848a72-6f43-43d5-988f-b9861f7897ac tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/fb91686e-c56f-43c3-a4b6-24cacc14acc7" status: 200 len: 1317 microversion: 2.1 time: 0.958426 Aug 04 17:06:18.747815 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1472/2871] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:17 2022] GET /compute/v2.1/servers/fb91686e-c56f-43c3-a4b6-24cacc14acc7 => generated 1317 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:18.774286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-abb2850a-4a06-45e0-866e-4856dd4c6e31 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:18.775477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-abb2850a-4a06-45e0-866e-4856dd4c6e31 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: 90fd978f-f119-4293-b43e-2b0cf3aff18c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:18.792244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-abb2850a-4a06-45e0-866e-4856dd4c6e31 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:18.797825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-abb2850a-4a06-45e0-866e-4856dd4c6e31 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:18.798574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-abb2850a-4a06-45e0-866e-4856dd4c6e31 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:18.799587 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-abb2850a-4a06-45e0-866e-4856dd4c6e31 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:18.800366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-abb2850a-4a06-45e0-866e-4856dd4c6e31 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:18.802042 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-abb2850a-4a06-45e0-866e-4856dd4c6e31 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:18.837425 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-abb2850a-4a06-45e0-866e-4856dd4c6e31 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] HTTP exception thrown: Instance 90fd978f-f119-4293-b43e-2b0cf3aff18c could not be found. Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-abb2850a-4a06-45e0-866e-4856dd4c6e31 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Request method failure captured: Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c HTTP/1.1 Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_wVVZ576bEuleBDdDhY4I0SQ0zK3Ghzp1cBRfY4ga-r487I6rdcJL24mx3zcbzv-eCIwK8F09BnRcC2jNkBlj8M7SUhFxVchCfQtxfke5cInlh_p2edIMVe-YibO79gM4UqJdNGNVAIUbvxuAch_j1xV7m-350QVlKDFEpK_YXnMFk Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 12dc616249934210aab2670a55053ecc Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersTestMultiNic-1689890194 Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/12dc616249934210aab2670a55053ecc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/12dc616249934210aab2670a55053ecc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_12dc616249934210aab2670a55053ecc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/12dc616249934210aab2670a55053ecc"}]}] Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersTestMultiNic-1689890194 Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 12dc616249934210aab2670a55053ecc Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersTestMultiNic-1689890194 Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersTestMultiNic-1689890194-project Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 234245a6fb7c441aa667a4ad619c1986 Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersTestMultiNic-1689890194-project Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 90fd978f-f119-4293-b43e-2b0cf3aff18c could not be found. Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '90fd978f-f119-4293-b43e-2b0cf3aff18c'} Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90fd978f-f119-4293-b43e-2b0cf3aff18c could not be found. Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:06:18.839158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:06:18.844304 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90fd978f-f119-4293-b43e-2b0cf3aff18c could not be found. Aug 04 17:06:18.844304 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:18.844304 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:18.844304 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:18.844304 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:18.844304 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:18.844304 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:18.844304 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:06:18.844304 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:06:18.844304 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90fd978f-f119-4293-b43e-2b0cf3aff18c could not be found. Aug 04 17:06:18.844304 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:18.851197 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-abb2850a-4a06-45e0-866e-4856dd4c6e31 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Returning 404 to user: Instance 90fd978f-f119-4293-b43e-2b0cf3aff18c could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:06:18.859125 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-abb2850a-4a06-45e0-866e-4856dd4c6e31 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "DELETE /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c" status: 404 len: 111 microversion: 2.1 time: 0.083943 Aug 04 17:06:18.860208 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1473/2872] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:06:18 2022] DELETE /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:06:18.865373 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b73a5cf0-46d0-4460-a356-75e1763f72f7 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:18.866615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b73a5cf0-46d0-4460-a356-75e1763f72f7 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ca421464-9d69-4127-a819-37fc1936680e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:18.873727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b73a5cf0-46d0-4460-a356-75e1763f72f7 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:18.875080 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b73a5cf0-46d0-4460-a356-75e1763f72f7 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:18.875750 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b73a5cf0-46d0-4460-a356-75e1763f72f7 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:18.876933 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b73a5cf0-46d0-4460-a356-75e1763f72f7 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:18.877603 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b73a5cf0-46d0-4460-a356-75e1763f72f7 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:18.878357 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b73a5cf0-46d0-4460-a356-75e1763f72f7 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:19.158279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=40 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:06:19.742391 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b73a5cf0-46d0-4460-a356-75e1763f72f7 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:19.757439 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b73a5cf0-46d0-4460-a356-75e1763f72f7 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e" status: 200 len: 1318 microversion: 2.1 time: 0.894621 Aug 04 17:06:19.761277 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1474/2873] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:18 2022] GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e => generated 1318 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:19.772720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e8cc4c75-3d8b-4ef1-aac7-2501c900c2da tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:19.777323 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e8cc4c75-3d8b-4ef1-aac7-2501c900c2da tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: 90fd978f-f119-4293-b43e-2b0cf3aff18c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:19.796395 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8cc4c75-3d8b-4ef1-aac7-2501c900c2da tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:19.796915 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8cc4c75-3d8b-4ef1-aac7-2501c900c2da tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:19.797367 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8cc4c75-3d8b-4ef1-aac7-2501c900c2da tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:19.800578 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8cc4c75-3d8b-4ef1-aac7-2501c900c2da tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:19.801083 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8cc4c75-3d8b-4ef1-aac7-2501c900c2da tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:19.810828 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8cc4c75-3d8b-4ef1-aac7-2501c900c2da tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:19.834366 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-e8cc4c75-3d8b-4ef1-aac7-2501c900c2da tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] HTTP exception thrown: Instance 90fd978f-f119-4293-b43e-2b0cf3aff18c could not be found. Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e8cc4c75-3d8b-4ef1-aac7-2501c900c2da tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Request method failure captured: Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c HTTP/1.1 Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_wVVZ576bEuleBDdDhY4I0SQ0zK3Ghzp1cBRfY4ga-r487I6rdcJL24mx3zcbzv-eCIwK8F09BnRcC2jNkBlj8M7SUhFxVchCfQtxfke5cInlh_p2edIMVe-YibO79gM4UqJdNGNVAIUbvxuAch_j1xV7m-350QVlKDFEpK_YXnMFk Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 12dc616249934210aab2670a55053ecc Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersTestMultiNic-1689890194 Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/12dc616249934210aab2670a55053ecc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/12dc616249934210aab2670a55053ecc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_12dc616249934210aab2670a55053ecc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/12dc616249934210aab2670a55053ecc"}]}] Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersTestMultiNic-1689890194 Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 12dc616249934210aab2670a55053ecc Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersTestMultiNic-1689890194 Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersTestMultiNic-1689890194-project Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 234245a6fb7c441aa667a4ad619c1986 Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersTestMultiNic-1689890194-project Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 90fd978f-f119-4293-b43e-2b0cf3aff18c could not be found. Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '90fd978f-f119-4293-b43e-2b0cf3aff18c'} Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90fd978f-f119-4293-b43e-2b0cf3aff18c could not be found. Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90fd978f-f119-4293-b43e-2b0cf3aff18c could not be found. Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:19.836187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:19.840838 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:19.840838 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:19.840838 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:19.840838 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:06:19.840838 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:06:19.840838 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90fd978f-f119-4293-b43e-2b0cf3aff18c could not be found. Aug 04 17:06:19.840838 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:19.847364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e8cc4c75-3d8b-4ef1-aac7-2501c900c2da tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Returning 404 to user: Instance 90fd978f-f119-4293-b43e-2b0cf3aff18c could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:06:19.848486 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e8cc4c75-3d8b-4ef1-aac7-2501c900c2da tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c" status: 404 len: 111 microversion: 2.1 time: 0.086227 Aug 04 17:06:19.849545 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1475/2874] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:19 2022] GET /compute/v2.1/servers/90fd978f-f119-4293-b43e-2b0cf3aff18c => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:06:19.860894 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-0f3b2435-a9b1-41f0-bc9f-b5ecef59b844 req-44ad4e83-ea90-44d6-8cd0-f3e0d790eb37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb91686e-c56f-43c3-a4b6-24cacc14acc7", "tag": "6fc77172-31dd-4362-b557-25bef73747f1"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:19.884513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-0f3b2435-a9b1-41f0-bc9f-b5ecef59b844 req-44ad4e83-ea90-44d6-8cd0-f3e0d790eb37 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:19.885247 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-0f3b2435-a9b1-41f0-bc9f-b5ecef59b844 req-44ad4e83-ea90-44d6-8cd0-f3e0d790eb37 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:19.885860 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-0f3b2435-a9b1-41f0-bc9f-b5ecef59b844 req-44ad4e83-ea90-44d6-8cd0-f3e0d790eb37 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:19.912842 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-0f3b2435-a9b1-41f0-bc9f-b5ecef59b844 req-44ad4e83-ea90-44d6-8cd0-f3e0d790eb37 service nova] Creating event network-changed:6fc77172-31dd-4362-b557-25bef73747f1 for instance fb91686e-c56f-43c3-a4b6-24cacc14acc7 on n-h1-851359-3 Aug 04 17:06:19.924502 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-0f3b2435-a9b1-41f0-bc9f-b5ecef59b844 req-44ad4e83-ea90-44d6-8cd0-f3e0d790eb37 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073531 Aug 04 17:06:19.925370 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1476/2875] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:06:19.942802 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-94be771e-b95d-4c44-bcb6-4b7baac63bc3 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:19.944076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-94be771e-b95d-4c44-bcb6-4b7baac63bc3 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: fb91686e-c56f-43c3-a4b6-24cacc14acc7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:19.950927 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94be771e-b95d-4c44-bcb6-4b7baac63bc3 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:19.952224 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94be771e-b95d-4c44-bcb6-4b7baac63bc3 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:19.953901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94be771e-b95d-4c44-bcb6-4b7baac63bc3 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:19.954893 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94be771e-b95d-4c44-bcb6-4b7baac63bc3 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:19.958630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94be771e-b95d-4c44-bcb6-4b7baac63bc3 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:19.959307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94be771e-b95d-4c44-bcb6-4b7baac63bc3 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:20.007770 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-83051f1f-7532-4326-8c49-4632b9e6292a tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.535339 Aug 04 17:06:20.008887 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1400/2876] 10.222.0.93 () {60 vars in 1195 bytes} [Thu Aug 4 17:06:18 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:06:20.014426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fe63f607-8650-498d-b941-61f5d23202d7 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:20.015753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fe63f607-8650-498d-b941-61f5d23202d7 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: baaeefae-c19a-4102-9fc8-245f638aaf45] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:20.043625 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe63f607-8650-498d-b941-61f5d23202d7 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:20.045828 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe63f607-8650-498d-b941-61f5d23202d7 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:20.047608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe63f607-8650-498d-b941-61f5d23202d7 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:20.048675 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe63f607-8650-498d-b941-61f5d23202d7 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:20.050924 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe63f607-8650-498d-b941-61f5d23202d7 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:20.051505 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe63f607-8650-498d-b941-61f5d23202d7 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:20.096375 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-fe63f607-8650-498d-b941-61f5d23202d7 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] HTTP exception thrown: Instance baaeefae-c19a-4102-9fc8-245f638aaf45 could not be found. Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fe63f607-8650-498d-b941-61f5d23202d7 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Request method failure captured: Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45 HTTP/1.1 Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_wVVZ576bEuleBDdDhY4I0SQ0zK3Ghzp1cBRfY4ga-r487I6rdcJL24mx3zcbzv-eCIwK8F09BnRcC2jNkBlj8M7SUhFxVchCfQtxfke5cInlh_p2edIMVe-YibO79gM4UqJdNGNVAIUbvxuAch_j1xV7m-350QVlKDFEpK_YXnMFk Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 12dc616249934210aab2670a55053ecc Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersTestMultiNic-1689890194 Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/12dc616249934210aab2670a55053ecc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/12dc616249934210aab2670a55053ecc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_12dc616249934210aab2670a55053ecc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/12dc616249934210aab2670a55053ecc"}]}] Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersTestMultiNic-1689890194 Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 12dc616249934210aab2670a55053ecc Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersTestMultiNic-1689890194 Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersTestMultiNic-1689890194-project Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 234245a6fb7c441aa667a4ad619c1986 Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersTestMultiNic-1689890194-project Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance baaeefae-c19a-4102-9fc8-245f638aaf45 could not be found. Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'baaeefae-c19a-4102-9fc8-245f638aaf45'} Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baaeefae-c19a-4102-9fc8-245f638aaf45 could not be found. Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:06:20.098863 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:06:20.104513 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baaeefae-c19a-4102-9fc8-245f638aaf45 could not be found. Aug 04 17:06:20.104513 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:20.104513 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:20.104513 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:20.104513 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:20.104513 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:20.104513 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:20.104513 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:06:20.104513 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:06:20.104513 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baaeefae-c19a-4102-9fc8-245f638aaf45 could not be found. Aug 04 17:06:20.104513 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:20.104513 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fe63f607-8650-498d-b941-61f5d23202d7 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Returning 404 to user: Instance baaeefae-c19a-4102-9fc8-245f638aaf45 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:06:20.106581 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fe63f607-8650-498d-b941-61f5d23202d7 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "DELETE /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45" status: 404 len: 111 microversion: 2.1 time: 0.096545 Aug 04 17:06:20.109531 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1401/2877] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:06:20 2022] DELETE /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:06:20.123927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-66ede105-4a28-4d2a-8ecb-d1140a50ee8d tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Action: 'create', calling method: .version_select at 0x7f1e5bf1a4c0>, body: {"security_group_rule": {"parent_group_id": "9780d5f9-f112-4f3d-9898-f82c62d85107", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:20.899871 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-66ede105-4a28-4d2a-8ecb-d1140a50ee8d tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] HTTP exception thrown: This rule already exists in group 9780d5f9-f112-4f3d-9898-f82c62d85107 Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-66ede105-4a28-4d2a-8ecb-d1140a50ee8d tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Request method failure captured: Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 138 Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_yHFKTwrHRMg6bdIcKzvGUsbKSwPB2VI4fUQTgkHFOc8YTsP6wL5QBWLAl4yzbSQWhcT-xR0LmsgrICHlhLx3vsJjQC72IZ6eDN_LI2tEKpvI7FsoEouoNkn-eP5J9KHfslLne__nODyZsuyUoneHG11NK23HlSOYLujf5_1C6UUWA Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: a41a63c6fc1e4e5db973f7e7d65f6bd8 Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-611023329 Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a41a63c6fc1e4e5db973f7e7d65f6bd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a41a63c6fc1e4e5db973f7e7d65f6bd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a41a63c6fc1e4e5db973f7e7d65f6bd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a41a63c6fc1e4e5db973f7e7d65f6bd8"}]}] Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-611023329 Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: a41a63c6fc1e4e5db973f7e7d65f6bd8 Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-611023329 Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-611023329-project Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: eab9f917485b461e9aad1ed67974aba1 Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-611023329-project Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: {"security_group_rule": {"parent_group_id": "9780d5f9-f112-4f3d-9898-f82c62d85107", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: exception: This rule already exists in group 9780d5f9-f112-4f3d-9898-f82c62d85107 Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'body': {'security_group_rule': {'parent_group_id': '9780d5f9-f112-4f3d-9898-f82c62d85107', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 9780d5f9-f112-4f3d-9898-f82c62d85107 Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 9780d5f9-f112-4f3d-9898-f82c62d85107 Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:20.901474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:20.907773 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:06:20.907773 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:06:20.907773 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 9780d5f9-f112-4f3d-9898-f82c62d85107 Aug 04 17:06:20.907773 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:20.907773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-66ede105-4a28-4d2a-8ecb-d1140a50ee8d tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Returning 400 to user: This rule already exists in group 9780d5f9-f112-4f3d-9898-f82c62d85107 {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:06:20.907773 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-66ede105-4a28-4d2a-8ecb-d1140a50ee8d tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.793771 Aug 04 17:06:20.907773 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1402/2878] 10.222.0.93 () {60 vars in 1195 bytes} [Thu Aug 4 17:06:20 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 796 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:06:20.912991 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b452a358-e2a0-4834-8264-c77087f37d66 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:20.920613 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b452a358-e2a0-4834-8264-c77087f37d66 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] [instance: baaeefae-c19a-4102-9fc8-245f638aaf45] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:20.932872 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b452a358-e2a0-4834-8264-c77087f37d66 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:20.938388 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b452a358-e2a0-4834-8264-c77087f37d66 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:20.939005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b452a358-e2a0-4834-8264-c77087f37d66 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:20.939870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b452a358-e2a0-4834-8264-c77087f37d66 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:20.940432 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b452a358-e2a0-4834-8264-c77087f37d66 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:20.940950 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b452a358-e2a0-4834-8264-c77087f37d66 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:21.000723 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-b452a358-e2a0-4834-8264-c77087f37d66 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] HTTP exception thrown: Instance baaeefae-c19a-4102-9fc8-245f638aaf45 could not be found. Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b452a358-e2a0-4834-8264-c77087f37d66 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Request method failure captured: Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45 HTTP/1.1 Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_wVVZ576bEuleBDdDhY4I0SQ0zK3Ghzp1cBRfY4ga-r487I6rdcJL24mx3zcbzv-eCIwK8F09BnRcC2jNkBlj8M7SUhFxVchCfQtxfke5cInlh_p2edIMVe-YibO79gM4UqJdNGNVAIUbvxuAch_j1xV7m-350QVlKDFEpK_YXnMFk Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 12dc616249934210aab2670a55053ecc Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersTestMultiNic-1689890194 Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/12dc616249934210aab2670a55053ecc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/12dc616249934210aab2670a55053ecc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_12dc616249934210aab2670a55053ecc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/12dc616249934210aab2670a55053ecc"}]}] Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersTestMultiNic-1689890194 Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 12dc616249934210aab2670a55053ecc Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersTestMultiNic-1689890194 Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersTestMultiNic-1689890194-project Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 234245a6fb7c441aa667a4ad619c1986 Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersTestMultiNic-1689890194-project Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance baaeefae-c19a-4102-9fc8-245f638aaf45 could not be found. Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'baaeefae-c19a-4102-9fc8-245f638aaf45'} Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baaeefae-c19a-4102-9fc8-245f638aaf45 could not be found. Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baaeefae-c19a-4102-9fc8-245f638aaf45 could not be found. Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:21.006375 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:21.010838 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:21.010838 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:21.010838 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:21.010838 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:06:21.010838 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:06:21.010838 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baaeefae-c19a-4102-9fc8-245f638aaf45 could not be found. Aug 04 17:06:21.010838 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:21.010838 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b452a358-e2a0-4834-8264-c77087f37d66 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] Returning 404 to user: Instance baaeefae-c19a-4102-9fc8-245f638aaf45 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:06:21.010838 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b452a358-e2a0-4834-8264-c77087f37d66 tempest-ServersTestMultiNic-1689890194 tempest-ServersTestMultiNic-1689890194-project] 10.222.0.93 "GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45" status: 404 len: 111 microversion: 2.1 time: 0.099885 Aug 04 17:06:21.018084 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1403/2879] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:20 2022] GET /compute/v2.1/servers/baaeefae-c19a-4102-9fc8-245f638aaf45 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:06:21.042948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e3bcbcbd-2098-4700-b655-5dae34fed6a8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:21.047155 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e3bcbcbd-2098-4700-b655-5dae34fed6a8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ca421464-9d69-4127-a819-37fc1936680e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:21.060051 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3bcbcbd-2098-4700-b655-5dae34fed6a8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:21.060600 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3bcbcbd-2098-4700-b655-5dae34fed6a8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:21.061047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3bcbcbd-2098-4700-b655-5dae34fed6a8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:21.062235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3bcbcbd-2098-4700-b655-5dae34fed6a8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:21.062860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3bcbcbd-2098-4700-b655-5dae34fed6a8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:21.063461 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3bcbcbd-2098-4700-b655-5dae34fed6a8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:21.083423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-94be771e-b95d-4c44-bcb6-4b7baac63bc3 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:21.091528 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-94be771e-b95d-4c44-bcb6-4b7baac63bc3 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/fb91686e-c56f-43c3-a4b6-24cacc14acc7" status: 200 len: 1317 microversion: 2.1 time: 1.162827 Aug 04 17:06:21.117843 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1477/2880] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:19 2022] GET /compute/v2.1/servers/fb91686e-c56f-43c3-a4b6-24cacc14acc7 => generated 1317 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:21.122881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fea72613-94f5-42d4-b49c-57cc20289649 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Calling method '.version_select at 0x7f1e5ac23820>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:22.363653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e3bcbcbd-2098-4700-b655-5dae34fed6a8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:22.374142 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e3bcbcbd-2098-4700-b655-5dae34fed6a8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e" status: 200 len: 1318 microversion: 2.1 time: 1.353020 Aug 04 17:06:22.377891 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1404/2881] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:21 2022] GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e => generated 1318 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:22.391853 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eb5be16e-543c-4b1f-8dea-fc14343aa1bb tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:22.392690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eb5be16e-543c-4b1f-8dea-fc14343aa1bb tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: fb91686e-c56f-43c3-a4b6-24cacc14acc7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:22.401542 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb5be16e-543c-4b1f-8dea-fc14343aa1bb tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:22.409929 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb5be16e-543c-4b1f-8dea-fc14343aa1bb tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:22.410740 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb5be16e-543c-4b1f-8dea-fc14343aa1bb tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:22.411748 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb5be16e-543c-4b1f-8dea-fc14343aa1bb tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:22.412436 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb5be16e-543c-4b1f-8dea-fc14343aa1bb tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:22.413104 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb5be16e-543c-4b1f-8dea-fc14343aa1bb tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:22.938045 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fea72613-94f5-42d4-b49c-57cc20289649 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-group-rules/e566f45b-bc48-4c35-afc6-0d1a65201d67" status: 202 len: 0 microversion: 2.1 time: 1.818693 Aug 04 17:06:22.938767 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1478/2882] 10.222.0.93 () {58 vars in 1287 bytes} [Thu Aug 4 17:06:21 2022] DELETE /compute/v2.1/os-security-group-rules/e566f45b-bc48-4c35-afc6-0d1a65201d67 => generated 0 bytes in 1820 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:06:22.949224 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-311548c0-d908-4e42-87ce-f0b7413fb6b9 req-878a8425-a2f6-43b5-904c-82d1147fd580 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bedaa2fb-63ea-4088-9f32-9a0f0bb34c11", "tag": "f14ddafe-43d5-4d1a-949c-7b86c6eefa9e"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:22.971530 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-311548c0-d908-4e42-87ce-f0b7413fb6b9 req-878a8425-a2f6-43b5-904c-82d1147fd580 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:22.984646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-311548c0-d908-4e42-87ce-f0b7413fb6b9 req-878a8425-a2f6-43b5-904c-82d1147fd580 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:22.988097 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-311548c0-d908-4e42-87ce-f0b7413fb6b9 req-878a8425-a2f6-43b5-904c-82d1147fd580 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:23.027529 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-311548c0-d908-4e42-87ce-f0b7413fb6b9 req-878a8425-a2f6-43b5-904c-82d1147fd580 service nova] Creating event network-changed:f14ddafe-43d5-4d1a-949c-7b86c6eefa9e for instance bedaa2fb-63ea-4088-9f32-9a0f0bb34c11 on n-h2-851359-3 Aug 04 17:06:23.054982 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-311548c0-d908-4e42-87ce-f0b7413fb6b9 req-878a8425-a2f6-43b5-904c-82d1147fd580 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110018 Aug 04 17:06:23.056962 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1479/2883] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:06:23.071724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0faf7a6c-6958-4a40-8e97-0e79e2672cd1 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Action: 'create', calling method: .version_select at 0x7f1e5ac5c1f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-146328953", "description": "tempest-description-1531708048"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:23.362942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eb5be16e-543c-4b1f-8dea-fc14343aa1bb tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:23.375577 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eb5be16e-543c-4b1f-8dea-fc14343aa1bb tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/fb91686e-c56f-43c3-a4b6-24cacc14acc7" status: 200 len: 1317 microversion: 2.1 time: 0.996294 Aug 04 17:06:23.389596 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1405/2884] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:22 2022] GET /compute/v2.1/servers/fb91686e-c56f-43c3-a4b6-24cacc14acc7 => generated 1317 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:23.400610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-86ee0b89-cfa5-4826-a594-ae9c67feda12 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:23.401247 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-86ee0b89-cfa5-4826-a594-ae9c67feda12 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ca421464-9d69-4127-a819-37fc1936680e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:23.412734 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86ee0b89-cfa5-4826-a594-ae9c67feda12 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:23.413249 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86ee0b89-cfa5-4826-a594-ae9c67feda12 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:23.413696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86ee0b89-cfa5-4826-a594-ae9c67feda12 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:23.414465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86ee0b89-cfa5-4826-a594-ae9c67feda12 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:23.417590 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86ee0b89-cfa5-4826-a594-ae9c67feda12 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:23.418226 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86ee0b89-cfa5-4826-a594-ae9c67feda12 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:24.232935 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0faf7a6c-6958-4a40-8e97-0e79e2672cd1 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.174057 Aug 04 17:06:24.233957 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1480/2885] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Aug 4 17:06:23 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:06:24.249600 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-acea73b7-95d7-449a-a070-16a63ee03e33 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Action: 'create', calling method: .version_select at 0x7f1e5b75e9d0>, body: {"security_group_rule": {"parent_group_id": "787bd618-532d-472e-85d8-93b77951e901", "ip_protocol": "tcp", "from_port": 1244151493, "to_port": 22}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:24.601875 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-acea73b7-95d7-449a-a070-16a63ee03e33 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] HTTP exception thrown: Invalid port range 1244151493:22. Former value cannot be greater than the later Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-acea73b7-95d7-449a-a070-16a63ee03e33 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Request method failure captured: Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 146 Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_yHFKTwrHRMg6bdIcKzvGUsbKSwPB2VI4fUQTgkHFOc8YTsP6wL5QBWLAl4yzbSQWhcT-xR0LmsgrICHlhLx3vsJjQC72IZ6eDN_LI2tEKpvI7FsoEouoNkn-eP5J9KHfslLne__nODyZsuyUoneHG11NK23HlSOYLujf5_1C6UUWA Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: a41a63c6fc1e4e5db973f7e7d65f6bd8 Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-611023329 Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a41a63c6fc1e4e5db973f7e7d65f6bd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a41a63c6fc1e4e5db973f7e7d65f6bd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a41a63c6fc1e4e5db973f7e7d65f6bd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a41a63c6fc1e4e5db973f7e7d65f6bd8"}]}] Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-611023329 Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: a41a63c6fc1e4e5db973f7e7d65f6bd8 Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-611023329 Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-611023329-project Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: eab9f917485b461e9aad1ed67974aba1 Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-611023329-project Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: {"security_group_rule": {"parent_group_id": "787bd618-532d-472e-85d8-93b77951e901", "ip_protocol": "tcp", "from_port": 1244151493, "to_port": 22}} Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: exception: Invalid port range 1244151493:22. Former value cannot be greater than the later Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'body': {'security_group_rule': {'parent_group_id': '787bd618-532d-472e-85d8-93b77951e901', 'ip_protocol': 'tcp', 'from_port': 1244151493, 'to_port': 22}}} Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1244151493:22. Former value cannot be greater than the later Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1244151493:22. Former value cannot be greater than the later Aug 04 17:06:24.604442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:24.613207 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:24.613207 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:24.613207 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:24.613207 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:24.613207 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:24.613207 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:06:24.613207 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:06:24.613207 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1244151493:22. Former value cannot be greater than the later Aug 04 17:06:24.613207 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:24.613207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-acea73b7-95d7-449a-a070-16a63ee03e33 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Returning 400 to user: Invalid port range 1244151493:22. Former value cannot be greater than the later {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:06:24.613207 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-acea73b7-95d7-449a-a070-16a63ee03e33 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.361098 Aug 04 17:06:24.613207 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1481/2886] 10.222.0.93 () {60 vars in 1195 bytes} [Thu Aug 4 17:06:24 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 363 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 17:06:24.625681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-319652c8-9fe4-4fbf-b05c-900667af7911 req-3f0081c2-749d-4baf-90af-e1c56f33f195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca421464-9d69-4127-a819-37fc1936680e", "name": "network-vif-plugged", "status": "completed", "tag": "4aae10f2-78c6-4a89-949e-8258cf606147"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:24.643402 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-319652c8-9fe4-4fbf-b05c-900667af7911 req-3f0081c2-749d-4baf-90af-e1c56f33f195 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:24.643994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-319652c8-9fe4-4fbf-b05c-900667af7911 req-3f0081c2-749d-4baf-90af-e1c56f33f195 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:24.644578 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-319652c8-9fe4-4fbf-b05c-900667af7911 req-3f0081c2-749d-4baf-90af-e1c56f33f195 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:24.669914 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-319652c8-9fe4-4fbf-b05c-900667af7911 req-3f0081c2-749d-4baf-90af-e1c56f33f195 service nova] Creating event network-vif-plugged:4aae10f2-78c6-4a89-949e-8258cf606147 for instance ca421464-9d69-4127-a819-37fc1936680e on n-h1-851359-3 Aug 04 17:06:24.683965 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-319652c8-9fe4-4fbf-b05c-900667af7911 req-3f0081c2-749d-4baf-90af-e1c56f33f195 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063383 Aug 04 17:06:24.689233 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1482/2887] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:06:24.696864 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-80d580ed-d9bb-4952-91b1-3176797724c6 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:24.700653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-80d580ed-d9bb-4952-91b1-3176797724c6 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: fb91686e-c56f-43c3-a4b6-24cacc14acc7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:24.722654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-86ee0b89-cfa5-4826-a594-ae9c67feda12 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:24.730511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80d580ed-d9bb-4952-91b1-3176797724c6 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:24.734806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80d580ed-d9bb-4952-91b1-3176797724c6 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:24.735538 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-86ee0b89-cfa5-4826-a594-ae9c67feda12 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e" status: 200 len: 1318 microversion: 2.1 time: 1.338582 Aug 04 17:06:24.736654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80d580ed-d9bb-4952-91b1-3176797724c6 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:24.739484 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1406/2888] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:23 2022] GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e => generated 1318 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:24.753107 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80d580ed-d9bb-4952-91b1-3176797724c6 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:24.753672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80d580ed-d9bb-4952-91b1-3176797724c6 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:24.755784 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5f845758-08a8-43f6-9b8b-67d154e0bb64 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Action: 'create', calling method: .version_select at 0x7f1e5b3b8ee0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-897981939", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:24.758220 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-5f845758-08a8-43f6-9b8b-67d154e0bb64 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] HTTP exception thrown: Security group id should be uuid Aug 04 17:06:24.760287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80d580ed-d9bb-4952-91b1-3176797724c6 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5f845758-08a8-43f6-9b8b-67d154e0bb64 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Request method failure captured: Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 130 Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_yHFKTwrHRMg6bdIcKzvGUsbKSwPB2VI4fUQTgkHFOc8YTsP6wL5QBWLAl4yzbSQWhcT-xR0LmsgrICHlhLx3vsJjQC72IZ6eDN_LI2tEKpvI7FsoEouoNkn-eP5J9KHfslLne__nODyZsuyUoneHG11NK23HlSOYLujf5_1C6UUWA Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: a41a63c6fc1e4e5db973f7e7d65f6bd8 Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-611023329 Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a41a63c6fc1e4e5db973f7e7d65f6bd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a41a63c6fc1e4e5db973f7e7d65f6bd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a41a63c6fc1e4e5db973f7e7d65f6bd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a41a63c6fc1e4e5db973f7e7d65f6bd8"}]}] Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-611023329 Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: a41a63c6fc1e4e5db973f7e7d65f6bd8 Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-611023329 Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-611023329-project Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: eab9f917485b461e9aad1ed67974aba1 Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-611023329-project Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-897981939", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: exception: Security group id should be uuid Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-897981939', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:06:24.766359 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:06:24.771703 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 04 17:06:24.771703 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:24.775256 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5f845758-08a8-43f6-9b8b-67d154e0bb64 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Returning 400 to user: Security group id should be uuid {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:06:24.789110 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5f845758-08a8-43f6-9b8b-67d154e0bb64 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.037874 Aug 04 17:06:24.790163 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1407/2889] 10.222.0.93 () {60 vars in 1195 bytes} [Thu Aug 4 17:06:24 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 17:06:24.804834 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b238cdbb-ba82-4c2f-91de-baf63e415804 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Action: 'create', calling method: .version_select at 0x7f1e6c944790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1375877923", "description": "tempest-description-466968837"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:25.480989 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-80d580ed-d9bb-4952-91b1-3176797724c6 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:25.491458 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-80d580ed-d9bb-4952-91b1-3176797724c6 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/fb91686e-c56f-43c3-a4b6-24cacc14acc7" status: 200 len: 1317 microversion: 2.1 time: 0.800416 Aug 04 17:06:25.494353 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1483/2890] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:24 2022] GET /compute/v2.1/servers/fb91686e-c56f-43c3-a4b6-24cacc14acc7 => generated 1317 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:25.571320 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b238cdbb-ba82-4c2f-91de-baf63e415804 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.771004 Aug 04 17:06:25.572258 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1408/2891] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Aug 4 17:06:24 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:06:25.585701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b53c880d-b475-469e-9c20-5346eb782ba2 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Action: 'create', calling method: .version_select at 0x7f1e6c976af0>, body: {"security_group_rule": {"parent_group_id": "ee4cc1b5-95e5-4681-b25d-15bf57cf3463", "ip_protocol": "tempest-999-1970171020", "from_port": 22, "to_port": 22}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:25.706968 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-b53c880d-b475-469e-9c20-5346eb782ba2 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] HTTP exception thrown: Invalid IP protocol tempest-999-1970171020. Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b53c880d-b475-469e-9c20-5346eb782ba2 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Request method failure captured: Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 157 Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_yHFKTwrHRMg6bdIcKzvGUsbKSwPB2VI4fUQTgkHFOc8YTsP6wL5QBWLAl4yzbSQWhcT-xR0LmsgrICHlhLx3vsJjQC72IZ6eDN_LI2tEKpvI7FsoEouoNkn-eP5J9KHfslLne__nODyZsuyUoneHG11NK23HlSOYLujf5_1C6UUWA Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: a41a63c6fc1e4e5db973f7e7d65f6bd8 Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-611023329 Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a41a63c6fc1e4e5db973f7e7d65f6bd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a41a63c6fc1e4e5db973f7e7d65f6bd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a41a63c6fc1e4e5db973f7e7d65f6bd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a41a63c6fc1e4e5db973f7e7d65f6bd8"}]}] Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-611023329 Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: a41a63c6fc1e4e5db973f7e7d65f6bd8 Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-611023329 Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-611023329-project Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: eab9f917485b461e9aad1ed67974aba1 Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-611023329-project Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: {"security_group_rule": {"parent_group_id": "ee4cc1b5-95e5-4681-b25d-15bf57cf3463", "ip_protocol": "tempest-999-1970171020", "from_port": 22, "to_port": 22}} Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: exception: Invalid IP protocol tempest-999-1970171020. Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ee4cc1b5-95e5-4681-b25d-15bf57cf3463', 'ip_protocol': 'tempest-999-1970171020', 'from_port': 22, 'to_port': 22}}} Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1970171020. Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1970171020. Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:25.709854 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:25.713579 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:25.713579 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:25.713579 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:25.713579 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:25.713579 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:06:25.713579 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:06:25.713579 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1970171020. Aug 04 17:06:25.713579 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:25.717473 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b53c880d-b475-469e-9c20-5346eb782ba2 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Returning 400 to user: Invalid IP protocol tempest-999-1970171020. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:06:25.719233 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b53c880d-b475-469e-9c20-5346eb782ba2 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.137493 Aug 04 17:06:25.720381 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1484/2892] 10.222.0.93 () {60 vars in 1195 bytes} [Thu Aug 4 17:06:25 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 140 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 17:06:25.731149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a87a2cea-b97f-4f95-93ad-f4cb713fe272 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Action: 'create', calling method: .version_select at 0x7f1e6ca11ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-651376781", "description": "tempest-description-827060552"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:25.762731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-41342813-cee6-4e0c-a4e3-b03ac829237d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:25.764316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-41342813-cee6-4e0c-a4e3-b03ac829237d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ca421464-9d69-4127-a819-37fc1936680e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:25.788457 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-41342813-cee6-4e0c-a4e3-b03ac829237d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:25.789453 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-41342813-cee6-4e0c-a4e3-b03ac829237d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:25.790265 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-41342813-cee6-4e0c-a4e3-b03ac829237d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:25.791545 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-41342813-cee6-4e0c-a4e3-b03ac829237d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:25.792132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-41342813-cee6-4e0c-a4e3-b03ac829237d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:25.792985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-41342813-cee6-4e0c-a4e3-b03ac829237d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:26.188977 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-41342813-cee6-4e0c-a4e3-b03ac829237d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:26.193788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:06:26.206574 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-41342813-cee6-4e0c-a4e3-b03ac829237d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e" status: 200 len: 1318 microversion: 2.1 time: 0.448555 Aug 04 17:06:26.219898 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1485/2893] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:25 2022] GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e => generated 1318 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:06:26.362562 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a87a2cea-b97f-4f95-93ad-f4cb713fe272 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.636589 Aug 04 17:06:26.363646 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1409/2894] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Aug 4 17:06:25 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:06:26.378244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-177fcfe6-579c-4e86-a080-730ad90769bb tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Action: 'create', calling method: .version_select at 0x7f1e5b48c700>, body: {"security_group_rule": {"parent_group_id": "312ffb1b-3509-400c-b6c6-5d0a60953c53", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:26.473585 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-177fcfe6-579c-4e86-a080-730ad90769bb tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-177fcfe6-579c-4e86-a080-730ad90769bb tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Request method failure captured: Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 138 Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_yHFKTwrHRMg6bdIcKzvGUsbKSwPB2VI4fUQTgkHFOc8YTsP6wL5QBWLAl4yzbSQWhcT-xR0LmsgrICHlhLx3vsJjQC72IZ6eDN_LI2tEKpvI7FsoEouoNkn-eP5J9KHfslLne__nODyZsuyUoneHG11NK23HlSOYLujf5_1C6UUWA Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: a41a63c6fc1e4e5db973f7e7d65f6bd8 Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-611023329 Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a41a63c6fc1e4e5db973f7e7d65f6bd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a41a63c6fc1e4e5db973f7e7d65f6bd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a41a63c6fc1e4e5db973f7e7d65f6bd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a41a63c6fc1e4e5db973f7e7d65f6bd8"}]}] Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-611023329 Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: a41a63c6fc1e4e5db973f7e7d65f6bd8 Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-611023329 Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-611023329-project Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: eab9f917485b461e9aad1ed67974aba1 Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-611023329-project Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: {"security_group_rule": {"parent_group_id": "312ffb1b-3509-400c-b6c6-5d0a60953c53", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'body': {'security_group_rule': {'parent_group_id': '312ffb1b-3509-400c-b6c6-5d0a60953c53', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 04 17:06:26.475681 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:26.479430 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:26.479430 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:26.479430 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:26.479430 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:26.479430 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:26.479430 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:06:26.479430 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:06:26.479430 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 04 17:06:26.479430 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:26.484539 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-177fcfe6-579c-4e86-a080-730ad90769bb tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:06:26.485684 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-177fcfe6-579c-4e86-a080-730ad90769bb tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.113379 Aug 04 17:06:26.487318 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1410/2895] 10.222.0.93 () {60 vars in 1195 bytes} [Thu Aug 4 17:06:26 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 17:06:26.497192 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4ab0b895-c1c9-49f3-8263-e7750af9f856 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Action: 'create', calling method: .version_select at 0x7f1e5bded160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-979019459", "description": "tempest-description-160224337"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:26.592905 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2db75bac-def7-46b3-95c3-9f5c585d8c06 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'create', calling method: .version_select at 0x7f1e5ad38820>, body: {"keypair": {"name": "tempest-keypair-2051236122", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNM0oTFlcCIT5otHW1lXLyg+dYDLhOYRkb+ywkwXhYSbQHf8sPx7G6NdYqOiSItnHCDgXoGNWMHFXT7UYv5waioQL2BkWc1oWsGnLUrmYTgFJomfG2KdfdYjD8l7t4pk8w=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:26.630766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-2db75bac-def7-46b3-95c3-9f5c585d8c06 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Getting quotas for project 683ce999e25e42a4a57b3c24a1fd24ef. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:06:26.668148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-2db75bac-def7-46b3-95c3-9f5c585d8c06 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Getting quotas for user 01e6f70936a14e67aecaf71fb615fffa and project 683ce999e25e42a4a57b3c24a1fd24ef. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:06:26.733754 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2db75bac-def7-46b3-95c3-9f5c585d8c06 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.512306 Aug 04 17:06:26.734535 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1486/2896] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:06:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:06:26.750767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4b2d2080-75c4-43be-bc4c-24780c873ac8 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:26.751813 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4b2d2080-75c4-43be-bc4c-24780c873ac8 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: fb91686e-c56f-43c3-a4b6-24cacc14acc7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:26.778678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b2d2080-75c4-43be-bc4c-24780c873ac8 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:26.779644 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b2d2080-75c4-43be-bc4c-24780c873ac8 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:26.780285 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b2d2080-75c4-43be-bc4c-24780c873ac8 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:26.782746 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b2d2080-75c4-43be-bc4c-24780c873ac8 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:26.784654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b2d2080-75c4-43be-bc4c-24780c873ac8 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:26.788680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b2d2080-75c4-43be-bc4c-24780c873ac8 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:26.941427 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4ab0b895-c1c9-49f3-8263-e7750af9f856 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.449284 Aug 04 17:06:26.942527 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1411/2897] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Aug 4 17:06:26 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:06:26.955492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8516f8c5-8116-4a0e-bcf3-bdfa8c2da814 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Action: 'create', calling method: .version_select at 0x7f1e5b48cb80>, body: {"security_group_rule": {"parent_group_id": "5e090b45-dd58-46ce-948c-5d539620c10e", "ip_protocol": "tcp", "from_port": 22, "to_port": 970672388}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:27.299436 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-8516f8c5-8116-4a0e-bcf3-bdfa8c2da814 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] HTTP exception thrown: Invalid port range 22:970672388. Valid TCP ports should be between 1-65535 Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8516f8c5-8116-4a0e-bcf3-bdfa8c2da814 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Request method failure captured: Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 145 Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_yHFKTwrHRMg6bdIcKzvGUsbKSwPB2VI4fUQTgkHFOc8YTsP6wL5QBWLAl4yzbSQWhcT-xR0LmsgrICHlhLx3vsJjQC72IZ6eDN_LI2tEKpvI7FsoEouoNkn-eP5J9KHfslLne__nODyZsuyUoneHG11NK23HlSOYLujf5_1C6UUWA Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: a41a63c6fc1e4e5db973f7e7d65f6bd8 Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-611023329 Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a41a63c6fc1e4e5db973f7e7d65f6bd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a41a63c6fc1e4e5db973f7e7d65f6bd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a41a63c6fc1e4e5db973f7e7d65f6bd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a41a63c6fc1e4e5db973f7e7d65f6bd8"}]}] Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-611023329 Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: a41a63c6fc1e4e5db973f7e7d65f6bd8 Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-611023329 Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-611023329-project Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: eab9f917485b461e9aad1ed67974aba1 Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-611023329-project Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: {"security_group_rule": {"parent_group_id": "5e090b45-dd58-46ce-948c-5d539620c10e", "ip_protocol": "tcp", "from_port": 22, "to_port": 970672388}} Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: exception: Invalid port range 22:970672388. Valid TCP ports should be between 1-65535 Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'body': {'security_group_rule': {'parent_group_id': '5e090b45-dd58-46ce-948c-5d539620c10e', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 970672388}}} Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:970672388. Valid TCP ports should be between 1-65535 Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:970672388. Valid TCP ports should be between 1-65535 Aug 04 17:06:27.301169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:27.306099 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:27.306099 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:27.306099 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:27.306099 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:27.306099 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:27.306099 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:06:27.306099 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:06:27.306099 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:970672388. Valid TCP ports should be between 1-65535 Aug 04 17:06:27.306099 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:27.307703 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8516f8c5-8116-4a0e-bcf3-bdfa8c2da814 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Returning 400 to user: Invalid port range 22:970672388. Valid TCP ports should be between 1-65535 {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:06:27.308740 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8516f8c5-8116-4a0e-bcf3-bdfa8c2da814 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.357925 Aug 04 17:06:27.310260 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1412/2898] 10.222.0.93 () {60 vars in 1195 bytes} [Thu Aug 4 17:06:26 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 360 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 17:06:27.316078 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-66595336-ed99-45ee-bc39-0f7e1682be31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:27.316893 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-66595336-ed99-45ee-bc39-0f7e1682be31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ca421464-9d69-4127-a819-37fc1936680e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:27.331383 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66595336-ed99-45ee-bc39-0f7e1682be31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:27.333423 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66595336-ed99-45ee-bc39-0f7e1682be31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:27.334079 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66595336-ed99-45ee-bc39-0f7e1682be31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:27.336251 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66595336-ed99-45ee-bc39-0f7e1682be31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:27.337003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66595336-ed99-45ee-bc39-0f7e1682be31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:27.340689 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66595336-ed99-45ee-bc39-0f7e1682be31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:27.566147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4b2d2080-75c4-43be-bc4c-24780c873ac8 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:27.578263 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4b2d2080-75c4-43be-bc4c-24780c873ac8 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/fb91686e-c56f-43c3-a4b6-24cacc14acc7" status: 200 len: 1317 microversion: 2.1 time: 0.840574 Aug 04 17:06:27.579216 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1487/2899] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:26 2022] GET /compute/v2.1/servers/fb91686e-c56f-43c3-a4b6-24cacc14acc7 => generated 1317 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:27.594985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-20715966-4eef-4ca0-8083-aa74fa30ab1a tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Action: 'create', calling method: .version_select at 0x7f1e6c976af0>, body: {"security_group_rule": {"parent_group_id": "035428c7-d870-49e7-ace9-817b8748c1dd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:27.803079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG neutronclient.v2_0.client [None req-20715966-4eef-4ca0-8083-aa74fa30ab1a tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 035428c7-d870-49e7-ace9-817b8748c1dd does not exist", "detail": ""}} {{(pid=131043) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 17:06:27.803703 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.security_group_api [None req-20715966-4eef-4ca0-8083-aa74fa30ab1a tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Neutron security group 035428c7-d870-49e7-ace9-817b8748c1dd not found {{(pid=131043) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 04 17:06:27.804774 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-20715966-4eef-4ca0-8083-aa74fa30ab1a tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] HTTP exception thrown: Security group 035428c7-d870-49e7-ace9-817b8748c1dd does not exist Aug 04 17:06:27.804774 n-d-851359-3 devstack@n-api.service[131043]: Neutron server returns request_ids: ['req-9e2a6324-23c2-4e6f-8796-6b08ae6d9f07'] Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-20715966-4eef-4ca0-8083-aa74fa30ab1a tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Request method failure captured: Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 138 Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_yHFKTwrHRMg6bdIcKzvGUsbKSwPB2VI4fUQTgkHFOc8YTsP6wL5QBWLAl4yzbSQWhcT-xR0LmsgrICHlhLx3vsJjQC72IZ6eDN_LI2tEKpvI7FsoEouoNkn-eP5J9KHfslLne__nODyZsuyUoneHG11NK23HlSOYLujf5_1C6UUWA Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: a41a63c6fc1e4e5db973f7e7d65f6bd8 Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-611023329 Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a41a63c6fc1e4e5db973f7e7d65f6bd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a41a63c6fc1e4e5db973f7e7d65f6bd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a41a63c6fc1e4e5db973f7e7d65f6bd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a41a63c6fc1e4e5db973f7e7d65f6bd8"}]}] Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-611023329 Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: a41a63c6fc1e4e5db973f7e7d65f6bd8 Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-611023329 Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-611023329-project Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: eab9f917485b461e9aad1ed67974aba1 Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-611023329-project Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: {"security_group_rule": {"parent_group_id": "035428c7-d870-49e7-ace9-817b8748c1dd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: exception: Security group 035428c7-d870-49e7-ace9-817b8748c1dd does not exist Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: Neutron server returns request_ids: ['req-9e2a6324-23c2-4e6f-8796-6b08ae6d9f07'] Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'body': {'security_group_rule': {'parent_group_id': '035428c7-d870-49e7-ace9-817b8748c1dd', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 17:06:27.806697 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 035428c7-d870-49e7-ace9-817b8748c1dd does not exist Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e2a6324-23c2-4e6f-8796-6b08ae6d9f07'] Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 035428c7-d870-49e7-ace9-817b8748c1dd does not exist Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e2a6324-23c2-4e6f-8796-6b08ae6d9f07'] Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 035428c7-d870-49e7-ace9-817b8748c1dd does not exist Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e2a6324-23c2-4e6f-8796-6b08ae6d9f07'] Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 035428c7-d870-49e7-ace9-817b8748c1dd does not exist Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e2a6324-23c2-4e6f-8796-6b08ae6d9f07'] Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-20715966-4eef-4ca0-8083-aa74fa30ab1a tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Returning 404 to user: Security group 035428c7-d870-49e7-ace9-817b8748c1dd does not exist Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: Neutron server returns request_ids: ['req-9e2a6324-23c2-4e6f-8796-6b08ae6d9f07'] {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:06:27.811185 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-20715966-4eef-4ca0-8083-aa74fa30ab1a tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] 10.222.0.93 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.227960 Aug 04 17:06:27.815074 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1488/2900] 10.222.0.93 () {60 vars in 1195 bytes} [Thu Aug 4 17:06:27 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 234 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:06:27.819032 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-da71647d-66b0-4ff7-9cf5-7e9876703fb6 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Calling method '.version_select at 0x7f1e5ac49b80>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:27.985247 n-d-851359-3 devstack@n-api.service[131043]: DEBUG neutronclient.v2_0.client [None req-da71647d-66b0-4ff7-9cf5-7e9876703fb6 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 72ad6213-9c47-4b66-82b3-35c880ce4634 does not exist", "detail": ""}} {{(pid=131043) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 04 17:06:27.985917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.security_group_api [None req-da71647d-66b0-4ff7-9cf5-7e9876703fb6 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Neutron security group rule 72ad6213-9c47-4b66-82b3-35c880ce4634 not found {{(pid=131043) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 04 17:06:27.986558 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-da71647d-66b0-4ff7-9cf5-7e9876703fb6 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] HTTP exception thrown: Security group rule 72ad6213-9c47-4b66-82b3-35c880ce4634 does not exist Aug 04 17:06:27.986558 n-d-851359-3 devstack@n-api.service[131043]: Neutron server returns request_ids: ['req-839ea4d4-9ff9-4d22-b940-4ebd3f0e6f3a'] Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-da71647d-66b0-4ff7-9cf5-7e9876703fb6 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Request method failure captured: Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/os-security-group-rules/72ad6213-9c47-4b66-82b3-35c880ce4634 HTTP/1.1 Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_yHFKTwrHRMg6bdIcKzvGUsbKSwPB2VI4fUQTgkHFOc8YTsP6wL5QBWLAl4yzbSQWhcT-xR0LmsgrICHlhLx3vsJjQC72IZ6eDN_LI2tEKpvI7FsoEouoNkn-eP5J9KHfslLne__nODyZsuyUoneHG11NK23HlSOYLujf5_1C6UUWA Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: a41a63c6fc1e4e5db973f7e7d65f6bd8 Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-611023329 Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a41a63c6fc1e4e5db973f7e7d65f6bd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a41a63c6fc1e4e5db973f7e7d65f6bd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a41a63c6fc1e4e5db973f7e7d65f6bd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a41a63c6fc1e4e5db973f7e7d65f6bd8"}]}] Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-611023329 Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: a41a63c6fc1e4e5db973f7e7d65f6bd8 Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-611023329 Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-611023329-project Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: eab9f917485b461e9aad1ed67974aba1 Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-611023329-project Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: exception: Security group rule 72ad6213-9c47-4b66-82b3-35c880ce4634 does not exist Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: Neutron server returns request_ids: ['req-839ea4d4-9ff9-4d22-b940-4ebd3f0e6f3a'] Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '72ad6213-9c47-4b66-82b3-35c880ce4634'} Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 04 17:06:27.988414 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 72ad6213-9c47-4b66-82b3-35c880ce4634 does not exist Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-839ea4d4-9ff9-4d22-b940-4ebd3f0e6f3a'] Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 72ad6213-9c47-4b66-82b3-35c880ce4634 does not exist Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-839ea4d4-9ff9-4d22-b940-4ebd3f0e6f3a'] Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 72ad6213-9c47-4b66-82b3-35c880ce4634 does not exist Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-839ea4d4-9ff9-4d22-b940-4ebd3f0e6f3a'] Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 72ad6213-9c47-4b66-82b3-35c880ce4634 does not exist Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-839ea4d4-9ff9-4d22-b940-4ebd3f0e6f3a'] Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-da71647d-66b0-4ff7-9cf5-7e9876703fb6 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Returning 404 to user: Security group rule 72ad6213-9c47-4b66-82b3-35c880ce4634 does not exist Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: Neutron server returns request_ids: ['req-839ea4d4-9ff9-4d22-b940-4ebd3f0e6f3a'] {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-da71647d-66b0-4ff7-9cf5-7e9876703fb6 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-group-rules/72ad6213-9c47-4b66-82b3-35c880ce4634" status: 404 len: 199 microversion: 2.1 time: 0.174590 Aug 04 17:06:27.992472 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1489/2901] 10.222.0.93 () {58 vars in 1287 bytes} [Thu Aug 4 17:06:27 2022] DELETE /compute/v2.1/os-security-group-rules/72ad6213-9c47-4b66-82b3-35c880ce4634 => generated 199 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:06:28.005446 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4f188652-fd7d-4312-a382-716984a85415 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Calling method '.version_select at 0x7f1e5ac54550>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:28.176134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-66595336-ed99-45ee-bc39-0f7e1682be31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:28.184579 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-66595336-ed99-45ee-bc39-0f7e1682be31 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e" status: 200 len: 1467 microversion: 2.1 time: 0.873089 Aug 04 17:06:28.200206 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1413/2902] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:27 2022] GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e => generated 1467 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:28.205454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c2a220fb-44c9-4aeb-8767-0635cf0a74e0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:28.206274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c2a220fb-44c9-4aeb-8767-0635cf0a74e0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: fbee7e39-ec6b-4a04-92e3-56c14721eb85] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:28.219965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2a220fb-44c9-4aeb-8767-0635cf0a74e0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:28.224266 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2a220fb-44c9-4aeb-8767-0635cf0a74e0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:28.224805 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2a220fb-44c9-4aeb-8767-0635cf0a74e0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:28.226321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2a220fb-44c9-4aeb-8767-0635cf0a74e0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:28.226821 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2a220fb-44c9-4aeb-8767-0635cf0a74e0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:28.227266 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2a220fb-44c9-4aeb-8767-0635cf0a74e0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:28.681642 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c2a220fb-44c9-4aeb-8767-0635cf0a74e0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:28.697399 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c2a220fb-44c9-4aeb-8767-0635cf0a74e0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/fbee7e39-ec6b-4a04-92e3-56c14721eb85" status: 200 len: 1468 microversion: 2.1 time: 0.495857 Aug 04 17:06:28.701096 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1414/2903] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:28 2022] GET /compute/v2.1/servers/fbee7e39-ec6b-4a04-92e3-56c14721eb85 => generated 1468 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:28.715764 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4f188652-fd7d-4312-a382-716984a85415 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/5e090b45-dd58-46ce-948c-5d539620c10e" status: 202 len: 0 microversion: 2.1 time: 0.718277 Aug 04 17:06:28.716249 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8eef954c-8d86-461d-ab8f-6e6a691cce45 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:28.716714 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8eef954c-8d86-461d-ab8f-6e6a691cce45 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: fb91686e-c56f-43c3-a4b6-24cacc14acc7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:28.720422 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1490/2904] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 17:06:27 2022] DELETE /compute/v2.1/os-security-groups/5e090b45-dd58-46ce-948c-5d539620c10e => generated 0 bytes in 723 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:06:28.725396 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ae8c8116-dff1-4235-a401-cfdbd33a50c5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:28.726971 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8eef954c-8d86-461d-ab8f-6e6a691cce45 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:28.731722 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8eef954c-8d86-461d-ab8f-6e6a691cce45 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:28.733465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8eef954c-8d86-461d-ab8f-6e6a691cce45 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:28.734524 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8eef954c-8d86-461d-ab8f-6e6a691cce45 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:28.735151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8eef954c-8d86-461d-ab8f-6e6a691cce45 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:28.736262 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8eef954c-8d86-461d-ab8f-6e6a691cce45 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:28.745475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ae8c8116-dff1-4235-a401-cfdbd33a50c5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:28.746413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ae8c8116-dff1-4235-a401-cfdbd33a50c5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Searching by: {'reservation_id': 'r-jxakapj9', 'deleted': False, 'project_id': 'de328615cef94528b55b8309dd9b82b0'} {{(pid=131043) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:06:28.770229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae8c8116-dff1-4235-a401-cfdbd33a50c5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:28.772997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae8c8116-dff1-4235-a401-cfdbd33a50c5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:28.773645 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae8c8116-dff1-4235-a401-cfdbd33a50c5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:28.774766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae8c8116-dff1-4235-a401-cfdbd33a50c5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:28.775649 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae8c8116-dff1-4235-a401-cfdbd33a50c5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:28.776586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae8c8116-dff1-4235-a401-cfdbd33a50c5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:28.996972 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.multi_cell_list [None req-ae8c8116-dff1-4235-a401-cfdbd33a50c5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:06:29.094791 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ae8c8116-dff1-4235-a401-cfdbd33a50c5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:29.101577 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:06:29.104328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae8c8116-dff1-4235-a401-cfdbd33a50c5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:29.105142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae8c8116-dff1-4235-a401-cfdbd33a50c5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:29.106404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae8c8116-dff1-4235-a401-cfdbd33a50c5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:29.400402 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8eef954c-8d86-461d-ab8f-6e6a691cce45 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:29.416846 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8eef954c-8d86-461d-ab8f-6e6a691cce45 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/fb91686e-c56f-43c3-a4b6-24cacc14acc7" status: 200 len: 1317 microversion: 2.1 time: 0.714210 Aug 04 17:06:29.431664 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1415/2905] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:28 2022] GET /compute/v2.1/servers/fb91686e-c56f-43c3-a4b6-24cacc14acc7 => generated 1317 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:29.441597 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d9709f64-1172-4537-99d6-8132b47ca409 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Calling method '.version_select at 0x7f1e6c9815e0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:29.610398 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ae8c8116-dff1-4235-a401-cfdbd33a50c5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/detail?reservation_id=r-jxakapj9" status: 200 len: 2928 microversion: 2.1 time: 0.888605 Aug 04 17:06:29.610997 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1491/2906] 10.222.0.93 () {58 vars in 1197 bytes} [Thu Aug 4 17:06:28 2022] GET /compute/v2.1/servers/detail?reservation_id=r-jxakapj9 => generated 2928 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:29.622471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-8c8c66fa-04db-4621-ad47-936646cae337 req-9290bcaf-ccdc-436f-ad94-11ea36f56780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb91686e-c56f-43c3-a4b6-24cacc14acc7", "name": "network-vif-plugged", "status": "completed", "tag": "6fc77172-31dd-4362-b557-25bef73747f1"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:29.649621 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8c8c66fa-04db-4621-ad47-936646cae337 req-9290bcaf-ccdc-436f-ad94-11ea36f56780 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:29.650409 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8c8c66fa-04db-4621-ad47-936646cae337 req-9290bcaf-ccdc-436f-ad94-11ea36f56780 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:29.651035 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8c8c66fa-04db-4621-ad47-936646cae337 req-9290bcaf-ccdc-436f-ad94-11ea36f56780 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:29.674343 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-8c8c66fa-04db-4621-ad47-936646cae337 req-9290bcaf-ccdc-436f-ad94-11ea36f56780 service nova] Creating event network-vif-plugged:6fc77172-31dd-4362-b557-25bef73747f1 for instance fb91686e-c56f-43c3-a4b6-24cacc14acc7 on n-h1-851359-3 Aug 04 17:06:29.686498 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-8c8c66fa-04db-4621-ad47-936646cae337 req-9290bcaf-ccdc-436f-ad94-11ea36f56780 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069509 Aug 04 17:06:29.691286 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1492/2907] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:06:29.702448 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b6f8dfd6-52c3-42ab-a2b9-e88ca500fa61 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:29.734836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.compute.server_groups [None req-b6f8dfd6-52c3-42ab-a2b9-e88ca500fa61 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Querying cell 435e901d-6672-4284-ad57-58e647e6e99d(cell1) for 2 instances {{(pid=131043) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 04 17:06:29.744040 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6f8dfd6-52c3-42ab-a2b9-e88ca500fa61 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:29.746853 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6f8dfd6-52c3-42ab-a2b9-e88ca500fa61 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:29.749390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6f8dfd6-52c3-42ab-a2b9-e88ca500fa61 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:29.820308 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b6f8dfd6-52c3-42ab-a2b9-e88ca500fa61 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/os-server-groups/c76122ce-aec5-4040-a435-ce738fc598fc" status: 200 len: 271 microversion: 2.1 time: 0.127117 Aug 04 17:06:29.820901 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1493/2908] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Aug 4 17:06:29 2022] GET /compute/v2.1/os-server-groups/c76122ce-aec5-4040-a435-ce738fc598fc => generated 271 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:06:29.831985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c1782e88-bfd2-428e-82ed-41069e8ed08e tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:29.836428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c1782e88-bfd2-428e-82ed-41069e8ed08e tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] [instance: ca421464-9d69-4127-a819-37fc1936680e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:29.852247 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c1782e88-bfd2-428e-82ed-41069e8ed08e tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:29.852964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c1782e88-bfd2-428e-82ed-41069e8ed08e tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:29.853580 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c1782e88-bfd2-428e-82ed-41069e8ed08e tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:29.854514 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c1782e88-bfd2-428e-82ed-41069e8ed08e tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:29.858736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c1782e88-bfd2-428e-82ed-41069e8ed08e tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:29.859461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c1782e88-bfd2-428e-82ed-41069e8ed08e tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:31.839168 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d9709f64-1172-4537-99d6-8132b47ca409 tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/312ffb1b-3509-400c-b6c6-5d0a60953c53" status: 202 len: 0 microversion: 2.1 time: 2.405909 Aug 04 17:06:31.840096 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1416/2909] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 17:06:29 2022] DELETE /compute/v2.1/os-security-groups/312ffb1b-3509-400c-b6c6-5d0a60953c53 => generated 0 bytes in 2408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:06:31.848001 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3da052d5-c4c2-45b6-98a2-555b3fecf98e tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:31.848946 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3da052d5-c4c2-45b6-98a2-555b3fecf98e tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: fb91686e-c56f-43c3-a4b6-24cacc14acc7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:31.858579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:06:31.885834 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3da052d5-c4c2-45b6-98a2-555b3fecf98e tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:31.886555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3da052d5-c4c2-45b6-98a2-555b3fecf98e tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:31.891264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3da052d5-c4c2-45b6-98a2-555b3fecf98e tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:31.892661 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3da052d5-c4c2-45b6-98a2-555b3fecf98e tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:31.893761 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3da052d5-c4c2-45b6-98a2-555b3fecf98e tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:31.894584 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3da052d5-c4c2-45b6-98a2-555b3fecf98e tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:32.014228 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c1782e88-bfd2-428e-82ed-41069e8ed08e tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e" status: 200 len: 1618 microversion: 2.1 time: 2.185190 Aug 04 17:06:32.014831 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1494/2910] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:29 2022] GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e => generated 1618 bytes in 2187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:32.170368 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-911de217-d8e5-41b9-8535-b62a0100b0a8 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Action: 'create', calling method: .version_select at 0x7f1e5ac2be50>, body: {"keypair": {"name": "tempest-keypair-1152410503", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwBaZYsb9ZTQEiEJb/lG23sjV5BGNBdYXqTFFEdyV62YliY3RshHW2s8SHX1qgVm2JQCAuCNRgBWrah4NsHLMrilHQ3WoR9a4lifErrEVApr/yhtNu7/mbviF1lbVSUAw=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:32.221517 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-911de217-d8e5-41b9-8535-b62a0100b0a8 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Getting quotas for project 46ffd2d70271450bae6b634c8cbee620. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:06:32.244586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-911de217-d8e5-41b9-8535-b62a0100b0a8 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Getting quotas for user 95fc1171b95c4605b104d0d44793837c and project 46ffd2d70271450bae6b634c8cbee620. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:06:32.320993 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-911de217-d8e5-41b9-8535-b62a0100b0a8 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.300982 Aug 04 17:06:32.322814 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1495/2911] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:06:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:06:32.333552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3a0bffee-0862-498f-a054-c5125b2ab4bc tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Calling method '.version_select at 0x7f1e5ac2bd30>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:33.076295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3da052d5-c4c2-45b6-98a2-555b3fecf98e tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:33.079950 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:06:33.092226 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3da052d5-c4c2-45b6-98a2-555b3fecf98e tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/fb91686e-c56f-43c3-a4b6-24cacc14acc7" status: 200 len: 1505 microversion: 2.1 time: 1.250304 Aug 04 17:06:33.111408 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1417/2912] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:31 2022] GET /compute/v2.1/servers/fb91686e-c56f-43c3-a4b6-24cacc14acc7 => generated 1505 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:33.125870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-be4aa011-7bb6-4c02-9aaa-d3cb677e7a18 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:33.127694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-be4aa011-7bb6-4c02-9aaa-d3cb677e7a18 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] [instance: fbee7e39-ec6b-4a04-92e3-56c14721eb85] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:33.142343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be4aa011-7bb6-4c02-9aaa-d3cb677e7a18 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:33.142858 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be4aa011-7bb6-4c02-9aaa-d3cb677e7a18 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:33.143304 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be4aa011-7bb6-4c02-9aaa-d3cb677e7a18 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:33.144026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be4aa011-7bb6-4c02-9aaa-d3cb677e7a18 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:33.144489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be4aa011-7bb6-4c02-9aaa-d3cb677e7a18 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:33.150784 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be4aa011-7bb6-4c02-9aaa-d3cb677e7a18 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:33.679376 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-be4aa011-7bb6-4c02-9aaa-d3cb677e7a18 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/fbee7e39-ec6b-4a04-92e3-56c14721eb85" status: 200 len: 1619 microversion: 2.1 time: 0.566497 Aug 04 17:06:33.680987 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1418/2913] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:33 2022] GET /compute/v2.1/servers/fbee7e39-ec6b-4a04-92e3-56c14721eb85 => generated 1619 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:33.692248 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0bbc955f-f42c-4a4e-9c27-60c79060502b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:33.698399 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0bbc955f-f42c-4a4e-9c27-60c79060502b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: bedaa2fb-63ea-4088-9f32-9a0f0bb34c11] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:33.726804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bbc955f-f42c-4a4e-9c27-60c79060502b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:33.727938 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bbc955f-f42c-4a4e-9c27-60c79060502b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:33.728462 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bbc955f-f42c-4a4e-9c27-60c79060502b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:33.729854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bbc955f-f42c-4a4e-9c27-60c79060502b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:33.730489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bbc955f-f42c-4a4e-9c27-60c79060502b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:33.730973 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bbc955f-f42c-4a4e-9c27-60c79060502b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:34.141206 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3a0bffee-0862-498f-a054-c5125b2ab4bc tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/ee4cc1b5-95e5-4681-b25d-15bf57cf3463" status: 202 len: 0 microversion: 2.1 time: 1.816780 Aug 04 17:06:34.142534 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1496/2914] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 17:06:32 2022] DELETE /compute/v2.1/os-security-groups/ee4cc1b5-95e5-4681-b25d-15bf57cf3463 => generated 0 bytes in 1819 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:06:34.154361 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-de8644d4-3eb6-48f9-8863-b7c1ed97da20 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1268425891", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b3c59640-cdc1-4b7c-beb0-ca591646427e"}], "security_groups": [{"name": "tempest-securitygroup--1438629537"}], "key_name": "tempest-keypair-2051236122", "user_data": "}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:34.569968 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-de8644d4-3eb6-48f9-8863-b7c1ed97da20 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] validate_networks() for [('b3c59640-cdc1-4b7c-beb0-ca591646427e', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:06:34.678782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0bbc955f-f42c-4a4e-9c27-60c79060502b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:34.690266 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0bbc955f-f42c-4a4e-9c27-60c79060502b tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/bedaa2fb-63ea-4088-9f32-9a0f0bb34c11" status: 200 len: 1317 microversion: 2.1 time: 1.003879 Aug 04 17:06:34.694862 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1419/2915] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:33 2022] GET /compute/v2.1/servers/bedaa2fb-63ea-4088-9f32-9a0f0bb34c11 => generated 1317 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:34.706748 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-97924e38-3e80-4718-9949-b391edf05645 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2032635216", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "42dff36d-2301-4c8c-b3a5-1dd535cf9664"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:34.796286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-97924e38-3e80-4718-9949-b391edf05645 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:06:35.923745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-97924e38-3e80-4718-9949-b391edf05645 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:06:35.924356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-97924e38-3e80-4718-9949-b391edf05645 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:06:35.924707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-97924e38-3e80-4718-9949-b391edf05645 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:06:35.925120 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-97924e38-3e80-4718-9949-b391edf05645 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:06:35.925690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-97924e38-3e80-4718-9949-b391edf05645 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:06:35.949532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97924e38-3e80-4718-9949-b391edf05645 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:35.951531 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97924e38-3e80-4718-9949-b391edf05645 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:35.956061 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97924e38-3e80-4718-9949-b391edf05645 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:35.957208 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97924e38-3e80-4718-9949-b391edf05645 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:35.959949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97924e38-3e80-4718-9949-b391edf05645 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:35.962213 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97924e38-3e80-4718-9949-b391edf05645 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:36.024579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-97924e38-3e80-4718-9949-b391edf05645 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for project de328615cef94528b55b8309dd9b82b0. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:06:36.031315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-97924e38-3e80-4718-9949-b391edf05645 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for user abad886e45bd4c4b8f5f0f86c45eb068 and project de328615cef94528b55b8309dd9b82b0. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:06:36.045914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-97924e38-3e80-4718-9949-b391edf05645 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:06:36.049589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-97924e38-3e80-4718-9949-b391edf05645 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:06:36.120687 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-97924e38-3e80-4718-9949-b391edf05645 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.418191 Aug 04 17:06:36.130646 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1420/2916] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:06:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1435 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:06:36.153600 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-e2969cd9-41dc-481d-bcbf-c713f1e4bc73 req-314d2f9b-83c3-41d8-a855-70d7c8061077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bedaa2fb-63ea-4088-9f32-9a0f0bb34c11", "name": "network-vif-plugged", "status": "completed", "tag": "f14ddafe-43d5-4d1a-949c-7b86c6eefa9e"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:36.176671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e2969cd9-41dc-481d-bcbf-c713f1e4bc73 req-314d2f9b-83c3-41d8-a855-70d7c8061077 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:36.181164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e2969cd9-41dc-481d-bcbf-c713f1e4bc73 req-314d2f9b-83c3-41d8-a855-70d7c8061077 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:36.182013 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e2969cd9-41dc-481d-bcbf-c713f1e4bc73 req-314d2f9b-83c3-41d8-a855-70d7c8061077 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:36.195338 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-e2969cd9-41dc-481d-bcbf-c713f1e4bc73 req-314d2f9b-83c3-41d8-a855-70d7c8061077 service nova] Creating event network-vif-plugged:f14ddafe-43d5-4d1a-949c-7b86c6eefa9e for instance bedaa2fb-63ea-4088-9f32-9a0f0bb34c11 on n-h2-851359-3 Aug 04 17:06:36.202705 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-e2969cd9-41dc-481d-bcbf-c713f1e4bc73 req-314d2f9b-83c3-41d8-a855-70d7c8061077 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069758 Aug 04 17:06:36.204038 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1421/2917] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:06:36.210119 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2ce9948c-0552-40d7-aa28-dbbc600f665f tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Calling method '.version_select at 0x7f1e6c959790>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:36.799664 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-de8644d4-3eb6-48f9-8863-b7c1ed97da20 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:06:36.800162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-de8644d4-3eb6-48f9-8863-b7c1ed97da20 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:06:36.800570 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-de8644d4-3eb6-48f9-8863-b7c1ed97da20 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:06:36.800983 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-de8644d4-3eb6-48f9-8863-b7c1ed97da20 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:06:36.801601 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-de8644d4-3eb6-48f9-8863-b7c1ed97da20 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:06:36.851125 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de8644d4-3eb6-48f9-8863-b7c1ed97da20 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:36.852762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de8644d4-3eb6-48f9-8863-b7c1ed97da20 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:36.853327 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de8644d4-3eb6-48f9-8863-b7c1ed97da20 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:36.854477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de8644d4-3eb6-48f9-8863-b7c1ed97da20 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:36.854973 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de8644d4-3eb6-48f9-8863-b7c1ed97da20 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:36.855440 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de8644d4-3eb6-48f9-8863-b7c1ed97da20 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:36.889279 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-de8644d4-3eb6-48f9-8863-b7c1ed97da20 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Getting quotas for project 683ce999e25e42a4a57b3c24a1fd24ef. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:06:36.898792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-de8644d4-3eb6-48f9-8863-b7c1ed97da20 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Getting quotas for user 01e6f70936a14e67aecaf71fb615fffa and project 683ce999e25e42a4a57b3c24a1fd24ef. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:06:36.913926 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-de8644d4-3eb6-48f9-8863-b7c1ed97da20 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:06:36.916528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-de8644d4-3eb6-48f9-8863-b7c1ed97da20 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:06:36.994890 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-de8644d4-3eb6-48f9-8863-b7c1ed97da20 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.850846 Aug 04 17:06:37.001444 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1497/2918] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:06:34 2022] POST /compute/v2.1/servers => generated 409 bytes in 2852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:06:37.018316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e78a232a-c23b-4606-b749-4b2ce4533882 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:37.019544 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e78a232a-c23b-4606-b749-4b2ce4533882 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: bedaa2fb-63ea-4088-9f32-9a0f0bb34c11] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:37.029254 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e78a232a-c23b-4606-b749-4b2ce4533882 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:37.030078 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e78a232a-c23b-4606-b749-4b2ce4533882 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:37.032001 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e78a232a-c23b-4606-b749-4b2ce4533882 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:37.033015 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e78a232a-c23b-4606-b749-4b2ce4533882 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:37.033900 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e78a232a-c23b-4606-b749-4b2ce4533882 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:37.034890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e78a232a-c23b-4606-b749-4b2ce4533882 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:37.047336 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2ce9948c-0552-40d7-aa28-dbbc600f665f tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/787bd618-532d-472e-85d8-93b77951e901" status: 202 len: 0 microversion: 2.1 time: 0.840801 Aug 04 17:06:37.049052 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1422/2919] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 17:06:36 2022] DELETE /compute/v2.1/os-security-groups/787bd618-532d-472e-85d8-93b77951e901 => generated 0 bytes in 844 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:06:37.056459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e6e97a52-86f2-4b1c-a9e1-d33c27e9484d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:37.058536 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e6e97a52-86f2-4b1c-a9e1-d33c27e9484d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:37.068753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6e97a52-86f2-4b1c-a9e1-d33c27e9484d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:37.069564 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6e97a52-86f2-4b1c-a9e1-d33c27e9484d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:37.070350 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6e97a52-86f2-4b1c-a9e1-d33c27e9484d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:37.071327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6e97a52-86f2-4b1c-a9e1-d33c27e9484d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:37.072270 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6e97a52-86f2-4b1c-a9e1-d33c27e9484d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:37.072986 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6e97a52-86f2-4b1c-a9e1-d33c27e9484d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:37.426975 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e6e97a52-86f2-4b1c-a9e1-d33c27e9484d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:37.438273 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e6e97a52-86f2-4b1c-a9e1-d33c27e9484d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714" status: 200 len: 1221 microversion: 2.1 time: 0.386790 Aug 04 17:06:37.444736 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1423/2920] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:37 2022] GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 => generated 1221 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:37.459309 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ec3e0c17-8106-4885-83dd-ee7d61e1b8e4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:37.467277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ec3e0c17-8106-4885-83dd-ee7d61e1b8e4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:37.599229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e78a232a-c23b-4606-b749-4b2ce4533882 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:37.624669 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e78a232a-c23b-4606-b749-4b2ce4533882 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/bedaa2fb-63ea-4088-9f32-9a0f0bb34c11" status: 200 len: 1317 microversion: 2.1 time: 0.624169 Aug 04 17:06:37.643135 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1498/2921] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:36 2022] GET /compute/v2.1/servers/bedaa2fb-63ea-4088-9f32-9a0f0bb34c11 => generated 1317 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:37.654087 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-29ce9bfc-7a42-41eb-988d-424f7d1b4c3f tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] Calling method '.version_select at 0x7f1e5ac540d0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:37.788325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ec3e0c17-8106-4885-83dd-ee7d61e1b8e4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:37.800574 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ec3e0c17-8106-4885-83dd-ee7d61e1b8e4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1239 microversion: 2.1 time: 0.354281 Aug 04 17:06:37.806010 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1424/2922] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:37 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1239 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:38.459483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9b35f344-5fb2-4fac-bbf9-0fe1038386e4 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:38.460125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9b35f344-5fb2-4fac-bbf9-0fe1038386e4 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:38.473117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b35f344-5fb2-4fac-bbf9-0fe1038386e4 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:38.473117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b35f344-5fb2-4fac-bbf9-0fe1038386e4 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:38.473336 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b35f344-5fb2-4fac-bbf9-0fe1038386e4 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:38.484015 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b35f344-5fb2-4fac-bbf9-0fe1038386e4 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:38.485095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b35f344-5fb2-4fac-bbf9-0fe1038386e4 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:38.485803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b35f344-5fb2-4fac-bbf9-0fe1038386e4 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:38.620748 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9b35f344-5fb2-4fac-bbf9-0fe1038386e4 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:38.656253 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9b35f344-5fb2-4fac-bbf9-0fe1038386e4 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714" status: 200 len: 1269 microversion: 2.1 time: 0.193284 Aug 04 17:06:38.657795 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1425/2923] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:38 2022] GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 => generated 1269 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:38.681415 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a90273e0-a011-40f3-8780-4a9b5a56edbe tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:38.682423 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a90273e0-a011-40f3-8780-4a9b5a56edbe tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: bedaa2fb-63ea-4088-9f32-9a0f0bb34c11] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:38.690742 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-29ce9bfc-7a42-41eb-988d-424f7d1b4c3f tempest-SecurityGroupRulesNegativeTestJSON-611023329 tempest-SecurityGroupRulesNegativeTestJSON-611023329-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/9780d5f9-f112-4f3d-9898-f82c62d85107" status: 202 len: 0 microversion: 2.1 time: 1.043511 Aug 04 17:06:38.692249 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1499/2924] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 17:06:37 2022] DELETE /compute/v2.1/os-security-groups/9780d5f9-f112-4f3d-9898-f82c62d85107 => generated 0 bytes in 1048 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:06:38.708459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a90273e0-a011-40f3-8780-4a9b5a56edbe tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:38.712228 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a90273e0-a011-40f3-8780-4a9b5a56edbe tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:38.713042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a90273e0-a011-40f3-8780-4a9b5a56edbe tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:38.715319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a90273e0-a011-40f3-8780-4a9b5a56edbe tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:38.716882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a90273e0-a011-40f3-8780-4a9b5a56edbe tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:38.718144 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a90273e0-a011-40f3-8780-4a9b5a56edbe tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:38.835570 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2ebcedc0-a78b-4e10-aa7a-3c026ddf8eb7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:38.837491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2ebcedc0-a78b-4e10-aa7a-3c026ddf8eb7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:38.862102 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ebcedc0-a78b-4e10-aa7a-3c026ddf8eb7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:38.864584 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ebcedc0-a78b-4e10-aa7a-3c026ddf8eb7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:38.866462 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ebcedc0-a78b-4e10-aa7a-3c026ddf8eb7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:38.869568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ebcedc0-a78b-4e10-aa7a-3c026ddf8eb7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:38.870644 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ebcedc0-a78b-4e10-aa7a-3c026ddf8eb7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:38.872981 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ebcedc0-a78b-4e10-aa7a-3c026ddf8eb7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:39.054658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2ebcedc0-a78b-4e10-aa7a-3c026ddf8eb7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:39.067990 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2ebcedc0-a78b-4e10-aa7a-3c026ddf8eb7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1291 microversion: 2.1 time: 0.244777 Aug 04 17:06:39.069239 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1500/2925] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:38 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1291 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:06:39.350647 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c398e6f3-5c2d-434e-b51f-71a1a6fcb4f9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-64662690", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:39.433054 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-c398e6f3-5c2d-434e-b51f-71a1a6fcb4f9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] validate_networks() for [('b4b149c9-2029-4f42-81f7-ee2fe42fc51a', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:06:39.456715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a90273e0-a011-40f3-8780-4a9b5a56edbe tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:39.471121 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a90273e0-a011-40f3-8780-4a9b5a56edbe tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/bedaa2fb-63ea-4088-9f32-9a0f0bb34c11" status: 200 len: 1317 microversion: 2.1 time: 0.806027 Aug 04 17:06:39.474978 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1426/2926] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:38 2022] GET /compute/v2.1/servers/bedaa2fb-63ea-4088-9f32-9a0f0bb34c11 => generated 1317 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:39.680035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-be896d2b-897a-4008-a16d-529e3a1f2efb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:39.681045 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-be896d2b-897a-4008-a16d-529e3a1f2efb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:39.697897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be896d2b-897a-4008-a16d-529e3a1f2efb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:39.698428 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be896d2b-897a-4008-a16d-529e3a1f2efb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:39.699051 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be896d2b-897a-4008-a16d-529e3a1f2efb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:39.699931 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be896d2b-897a-4008-a16d-529e3a1f2efb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:39.700587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be896d2b-897a-4008-a16d-529e3a1f2efb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:39.701235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be896d2b-897a-4008-a16d-529e3a1f2efb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:39.949273 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-be896d2b-897a-4008-a16d-529e3a1f2efb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:39.961835 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-be896d2b-897a-4008-a16d-529e3a1f2efb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714" status: 200 len: 1275 microversion: 2.1 time: 0.285500 Aug 04 17:06:39.964558 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1427/2927] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:39 2022] GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 => generated 1275 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:39.980179 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a1b0a95b-87f1-4282-adda-271b199e8eed tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1061952328", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "ef4141b0-06b8-48b3-aa0e-f4df3808f8e1"}], "security_groups": [{"name": "tempest-securitygroup--2031211199"}], "key_name": "tempest-keypair-1152410503", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:40.384695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-a1b0a95b-87f1-4282-adda-271b199e8eed tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] validate_networks() for [('ef4141b0-06b8-48b3-aa0e-f4df3808f8e1', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:06:41.293072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-c398e6f3-5c2d-434e-b51f-71a1a6fcb4f9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:06:41.295765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-c398e6f3-5c2d-434e-b51f-71a1a6fcb4f9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:06:41.296557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-c398e6f3-5c2d-434e-b51f-71a1a6fcb4f9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:06:41.297202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-c398e6f3-5c2d-434e-b51f-71a1a6fcb4f9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:06:41.298714 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-c398e6f3-5c2d-434e-b51f-71a1a6fcb4f9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:06:41.344788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c398e6f3-5c2d-434e-b51f-71a1a6fcb4f9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:41.345504 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c398e6f3-5c2d-434e-b51f-71a1a6fcb4f9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:41.346237 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c398e6f3-5c2d-434e-b51f-71a1a6fcb4f9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:41.347220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c398e6f3-5c2d-434e-b51f-71a1a6fcb4f9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:41.348155 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c398e6f3-5c2d-434e-b51f-71a1a6fcb4f9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:41.348889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c398e6f3-5c2d-434e-b51f-71a1a6fcb4f9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:41.380607 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-c398e6f3-5c2d-434e-b51f-71a1a6fcb4f9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Getting quotas for project 383c0418c5f849128e0a384ccdc434b4. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:06:41.391110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-c398e6f3-5c2d-434e-b51f-71a1a6fcb4f9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Getting quotas for user aae152a1d00c40409aa78f8a5cff5895 and project 383c0418c5f849128e0a384ccdc434b4. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:06:41.439818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c398e6f3-5c2d-434e-b51f-71a1a6fcb4f9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:06:41.441874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c398e6f3-5c2d-434e-b51f-71a1a6fcb4f9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:06:41.526739 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c398e6f3-5c2d-434e-b51f-71a1a6fcb4f9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.455315 Aug 04 17:06:41.527694 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1501/2928] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:06:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 2458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:06:41.547758 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b0a5940f-8032-4a08-9a2a-a42c9176b876 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:41.551385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b0a5940f-8032-4a08-9a2a-a42c9176b876 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:41.583387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0a5940f-8032-4a08-9a2a-a42c9176b876 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:41.584357 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0a5940f-8032-4a08-9a2a-a42c9176b876 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:41.585250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0a5940f-8032-4a08-9a2a-a42c9176b876 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:41.586247 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0a5940f-8032-4a08-9a2a-a42c9176b876 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:41.586942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0a5940f-8032-4a08-9a2a-a42c9176b876 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:41.587664 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0a5940f-8032-4a08-9a2a-a42c9176b876 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:42.780480 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b0a5940f-8032-4a08-9a2a-a42c9176b876 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:42.790111 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-a1b0a95b-87f1-4282-adda-271b199e8eed tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Getting quotas for project 46ffd2d70271450bae6b634c8cbee620. Resources: dict_keys(['metadata_items']) {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:06:42.815082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-a1b0a95b-87f1-4282-adda-271b199e8eed tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Getting quotas for user 95fc1171b95c4605b104d0d44793837c and project 46ffd2d70271450bae6b634c8cbee620. Resources: dict_keys(['metadata_items']) {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:06:42.819609 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b0a5940f-8032-4a08-9a2a-a42c9176b876 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1365 microversion: 2.1 time: 1.278138 Aug 04 17:06:42.820214 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1502/2929] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:41 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1365 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:42.852024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a728f49d-26bf-4559-af60-938048b06f2e tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:42.854278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a728f49d-26bf-4559-af60-938048b06f2e tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: bedaa2fb-63ea-4088-9f32-9a0f0bb34c11] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:42.856353 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-a1b0a95b-87f1-4282-adda-271b199e8eed tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:06:42.859742 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-a1b0a95b-87f1-4282-adda-271b199e8eed tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:06:42.860565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-a1b0a95b-87f1-4282-adda-271b199e8eed tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:06:42.861557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-a1b0a95b-87f1-4282-adda-271b199e8eed tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:06:42.863247 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-a1b0a95b-87f1-4282-adda-271b199e8eed tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:06:42.884637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a728f49d-26bf-4559-af60-938048b06f2e tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:42.885764 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a728f49d-26bf-4559-af60-938048b06f2e tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:42.887150 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a728f49d-26bf-4559-af60-938048b06f2e tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:42.890240 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1b0a95b-87f1-4282-adda-271b199e8eed tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:42.890746 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1b0a95b-87f1-4282-adda-271b199e8eed tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:42.891432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a728f49d-26bf-4559-af60-938048b06f2e tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:42.892090 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a728f49d-26bf-4559-af60-938048b06f2e tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:42.894744 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a728f49d-26bf-4559-af60-938048b06f2e tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:42.895413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1b0a95b-87f1-4282-adda-271b199e8eed tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:42.896844 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1b0a95b-87f1-4282-adda-271b199e8eed tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:42.897817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1b0a95b-87f1-4282-adda-271b199e8eed tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:42.898869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1b0a95b-87f1-4282-adda-271b199e8eed tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:42.945821 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-a1b0a95b-87f1-4282-adda-271b199e8eed tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Getting quotas for project 46ffd2d70271450bae6b634c8cbee620. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:06:42.954563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-a1b0a95b-87f1-4282-adda-271b199e8eed tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Getting quotas for user 95fc1171b95c4605b104d0d44793837c and project 46ffd2d70271450bae6b634c8cbee620. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:06:42.971049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a1b0a95b-87f1-4282-adda-271b199e8eed tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:06:42.974443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a1b0a95b-87f1-4282-adda-271b199e8eed tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] [instance: 398976e0-4012-4a63-8cb6-fbfd9325ff32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:06:43.053937 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a1b0a95b-87f1-4282-adda-271b199e8eed tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.086721 Aug 04 17:06:43.055979 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1428/2930] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:06:39 2022] POST /compute/v2.1/servers => generated 409 bytes in 3091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:06:43.069666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e1bb955f-96de-42d5-b3e0-51dc9a59751e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:43.070694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e1bb955f-96de-42d5-b3e0-51dc9a59751e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:43.080334 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1bb955f-96de-42d5-b3e0-51dc9a59751e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:43.081228 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1bb955f-96de-42d5-b3e0-51dc9a59751e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:43.081898 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1bb955f-96de-42d5-b3e0-51dc9a59751e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:43.082902 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1bb955f-96de-42d5-b3e0-51dc9a59751e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:43.083872 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1bb955f-96de-42d5-b3e0-51dc9a59751e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:43.084519 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1bb955f-96de-42d5-b3e0-51dc9a59751e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:43.652733 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a728f49d-26bf-4559-af60-938048b06f2e tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:43.674483 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a728f49d-26bf-4559-af60-938048b06f2e tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/bedaa2fb-63ea-4088-9f32-9a0f0bb34c11" status: 200 len: 1506 microversion: 2.1 time: 0.848986 Aug 04 17:06:43.677571 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1503/2931] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:42 2022] GET /compute/v2.1/servers/bedaa2fb-63ea-4088-9f32-9a0f0bb34c11 => generated 1506 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:43.690761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-33e51cba-9703-44a3-89bc-a106b878fc03 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:43.691510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-33e51cba-9703-44a3-89bc-a106b878fc03 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:43.708054 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33e51cba-9703-44a3-89bc-a106b878fc03 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:43.708811 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33e51cba-9703-44a3-89bc-a106b878fc03 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:43.709474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33e51cba-9703-44a3-89bc-a106b878fc03 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:43.710461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33e51cba-9703-44a3-89bc-a106b878fc03 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:43.711142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33e51cba-9703-44a3-89bc-a106b878fc03 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:43.711957 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33e51cba-9703-44a3-89bc-a106b878fc03 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:43.781305 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e1bb955f-96de-42d5-b3e0-51dc9a59751e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:43.813612 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e1bb955f-96de-42d5-b3e0-51dc9a59751e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714" status: 200 len: 1317 microversion: 2.1 time: 0.748778 Aug 04 17:06:43.815581 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1429/2932] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:43 2022] GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 => generated 1317 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:43.834029 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9f684943-6303-4857-b2b7-b9739e3a061a tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:43.836720 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9f684943-6303-4857-b2b7-b9739e3a061a tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] [instance: 398976e0-4012-4a63-8cb6-fbfd9325ff32] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:43.856253 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f684943-6303-4857-b2b7-b9739e3a061a tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:43.869745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f684943-6303-4857-b2b7-b9739e3a061a tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:43.875552 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f684943-6303-4857-b2b7-b9739e3a061a tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:43.880022 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f684943-6303-4857-b2b7-b9739e3a061a tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:43.881940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f684943-6303-4857-b2b7-b9739e3a061a tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:43.882589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f684943-6303-4857-b2b7-b9739e3a061a tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:44.138585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9f684943-6303-4857-b2b7-b9739e3a061a tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fc1171b95c4605b104d0d44793837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ffd2d70271450bae6b634c8cbee620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:44.144045 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-33e51cba-9703-44a3-89bc-a106b878fc03 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:44.147220 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9f684943-6303-4857-b2b7-b9739e3a061a tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] 10.222.0.93 "GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32" status: 200 len: 1282 microversion: 2.1 time: 0.330300 Aug 04 17:06:44.147978 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1430/2933] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:43 2022] GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32 => generated 1282 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:44.154513 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-33e51cba-9703-44a3-89bc-a106b878fc03 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1264 microversion: 2.1 time: 0.474950 Aug 04 17:06:44.169810 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1504/2934] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:43 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1264 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:44.175926 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5bf8e60d-d961-44e4-ae84-9395b4b5efa8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:44.176929 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5bf8e60d-d961-44e4-ae84-9395b4b5efa8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:44.184499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5bf8e60d-d961-44e4-ae84-9395b4b5efa8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:44.185889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5bf8e60d-d961-44e4-ae84-9395b4b5efa8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:44.186477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5bf8e60d-d961-44e4-ae84-9395b4b5efa8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:44.187561 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5bf8e60d-d961-44e4-ae84-9395b4b5efa8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:44.188180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5bf8e60d-d961-44e4-ae84-9395b4b5efa8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:44.188728 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5bf8e60d-d961-44e4-ae84-9395b4b5efa8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:44.190427 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-15928004-23b1-4de3-a339-b8961810b0d6 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:44.190956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-15928004-23b1-4de3-a339-b8961810b0d6 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: bedaa2fb-63ea-4088-9f32-9a0f0bb34c11] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:44.203003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15928004-23b1-4de3-a339-b8961810b0d6 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:44.203511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15928004-23b1-4de3-a339-b8961810b0d6 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:44.203959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15928004-23b1-4de3-a339-b8961810b0d6 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:44.204676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15928004-23b1-4de3-a339-b8961810b0d6 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:44.205142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15928004-23b1-4de3-a339-b8961810b0d6 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:44.205640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15928004-23b1-4de3-a339-b8961810b0d6 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:44.261583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-15928004-23b1-4de3-a339-b8961810b0d6 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: bedaa2fb-63ea-4088-9f32-9a0f0bb34c11] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:06:44.376005 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-15928004-23b1-4de3-a339-b8961810b0d6 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "DELETE /compute/v2.1/servers/bedaa2fb-63ea-4088-9f32-9a0f0bb34c11" status: 204 len: 0 microversion: 2.1 time: 0.208171 Aug 04 17:06:44.381044 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1431/2935] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:06:44 2022] DELETE /compute/v2.1/servers/bedaa2fb-63ea-4088-9f32-9a0f0bb34c11 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:06:44.389874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f94ee077-5740-40e6-8202-ce4d9c15f1c7 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:44.392459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f94ee077-5740-40e6-8202-ce4d9c15f1c7 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: fb91686e-c56f-43c3-a4b6-24cacc14acc7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:44.409498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f94ee077-5740-40e6-8202-ce4d9c15f1c7 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:44.410204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f94ee077-5740-40e6-8202-ce4d9c15f1c7 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:44.410663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f94ee077-5740-40e6-8202-ce4d9c15f1c7 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:44.411468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f94ee077-5740-40e6-8202-ce4d9c15f1c7 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:44.411931 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f94ee077-5740-40e6-8202-ce4d9c15f1c7 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:44.413907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f94ee077-5740-40e6-8202-ce4d9c15f1c7 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:44.457507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f94ee077-5740-40e6-8202-ce4d9c15f1c7 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: fb91686e-c56f-43c3-a4b6-24cacc14acc7] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:06:44.569589 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f94ee077-5740-40e6-8202-ce4d9c15f1c7 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "DELETE /compute/v2.1/servers/fb91686e-c56f-43c3-a4b6-24cacc14acc7" status: 204 len: 0 microversion: 2.1 time: 0.186308 Aug 04 17:06:44.571088 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1432/2936] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:06:44 2022] DELETE /compute/v2.1/servers/fb91686e-c56f-43c3-a4b6-24cacc14acc7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 17:06:44.582497 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-26846fc8-ce32-4ae9-85ae-c5795a99579f tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:44.583576 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-26846fc8-ce32-4ae9-85ae-c5795a99579f tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: bedaa2fb-63ea-4088-9f32-9a0f0bb34c11] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:44.590451 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26846fc8-ce32-4ae9-85ae-c5795a99579f tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:44.591970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26846fc8-ce32-4ae9-85ae-c5795a99579f tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:44.592673 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26846fc8-ce32-4ae9-85ae-c5795a99579f tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:44.593789 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26846fc8-ce32-4ae9-85ae-c5795a99579f tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:44.594555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26846fc8-ce32-4ae9-85ae-c5795a99579f tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:44.595255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26846fc8-ce32-4ae9-85ae-c5795a99579f tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:44.653311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5bf8e60d-d961-44e4-ae84-9395b4b5efa8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:44.667611 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5bf8e60d-d961-44e4-ae84-9395b4b5efa8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1365 microversion: 2.1 time: 0.494568 Aug 04 17:06:44.689676 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1505/2937] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:44 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1365 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:44.843257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ed73ad49-2391-4e82-a065-a2114a151e58 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:44.844719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ed73ad49-2391-4e82-a065-a2114a151e58 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:44.865231 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed73ad49-2391-4e82-a065-a2114a151e58 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:44.866270 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed73ad49-2391-4e82-a065-a2114a151e58 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:44.868868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed73ad49-2391-4e82-a065-a2114a151e58 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:44.870244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed73ad49-2391-4e82-a065-a2114a151e58 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:44.874041 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed73ad49-2391-4e82-a065-a2114a151e58 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:44.874803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed73ad49-2391-4e82-a065-a2114a151e58 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:45.095778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-26846fc8-ce32-4ae9-85ae-c5795a99579f tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:45.113233 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-26846fc8-ce32-4ae9-85ae-c5795a99579f tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/bedaa2fb-63ea-4088-9f32-9a0f0bb34c11" status: 200 len: 1512 microversion: 2.1 time: 0.535058 Aug 04 17:06:45.114219 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1433/2938] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:44 2022] GET /compute/v2.1/servers/bedaa2fb-63ea-4088-9f32-9a0f0bb34c11 => generated 1512 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:45.169836 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f88316d2-32a8-4f3f-ab77-6f78724b48c3 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:45.170779 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f88316d2-32a8-4f3f-ab77-6f78724b48c3 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] [instance: 398976e0-4012-4a63-8cb6-fbfd9325ff32] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:45.192064 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f88316d2-32a8-4f3f-ab77-6f78724b48c3 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:45.192569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f88316d2-32a8-4f3f-ab77-6f78724b48c3 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:45.193011 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f88316d2-32a8-4f3f-ab77-6f78724b48c3 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:45.193737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f88316d2-32a8-4f3f-ab77-6f78724b48c3 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:45.194232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f88316d2-32a8-4f3f-ab77-6f78724b48c3 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:45.194660 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f88316d2-32a8-4f3f-ab77-6f78724b48c3 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:45.356540 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f88316d2-32a8-4f3f-ab77-6f78724b48c3 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fc1171b95c4605b104d0d44793837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ffd2d70271450bae6b634c8cbee620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:45.368220 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f88316d2-32a8-4f3f-ab77-6f78724b48c3 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] 10.222.0.93 "GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32" status: 200 len: 1338 microversion: 2.1 time: 0.202167 Aug 04 17:06:45.370353 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1434/2939] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:45 2022] GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32 => generated 1338 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:06:45.377946 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3379e86b-af59-41fe-8b6b-12068e707819 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:45.384700 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3379e86b-af59-41fe-8b6b-12068e707819 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:45.399661 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3379e86b-af59-41fe-8b6b-12068e707819 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:45.400401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3379e86b-af59-41fe-8b6b-12068e707819 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:45.401050 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3379e86b-af59-41fe-8b6b-12068e707819 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:45.405225 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3379e86b-af59-41fe-8b6b-12068e707819 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:45.408460 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3379e86b-af59-41fe-8b6b-12068e707819 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:45.410133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3379e86b-af59-41fe-8b6b-12068e707819 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:45.424843 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:06:45.632221 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ed73ad49-2391-4e82-a065-a2114a151e58 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:45.644826 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ed73ad49-2391-4e82-a065-a2114a151e58 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714" status: 200 len: 1317 microversion: 2.1 time: 0.807246 Aug 04 17:06:45.648786 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3379e86b-af59-41fe-8b6b-12068e707819 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:45.663933 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1506/2940] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:44 2022] GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 => generated 1317 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:45.666285 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3379e86b-af59-41fe-8b6b-12068e707819 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1270 microversion: 2.1 time: 0.292315 Aug 04 17:06:45.678112 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1435/2941] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:45 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1270 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:45.699247 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b106094f-eeec-414b-9caa-85851104e7cc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:45.700444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b106094f-eeec-414b-9caa-85851104e7cc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:45.726897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b106094f-eeec-414b-9caa-85851104e7cc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:45.727833 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b106094f-eeec-414b-9caa-85851104e7cc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:45.728765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b106094f-eeec-414b-9caa-85851104e7cc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:45.729951 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b106094f-eeec-414b-9caa-85851104e7cc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:45.737174 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b106094f-eeec-414b-9caa-85851104e7cc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:45.738028 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b106094f-eeec-414b-9caa-85851104e7cc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:46.078013 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-7dc22ba9-ed71-4e80-a0aa-aa8c90ad3a69 req-40810810-51b6-4773-b201-4007c81b0dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714", "tag": "6ab7361c-b1ad-445b-b3e5-54cdfd45b93b"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:46.094719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7dc22ba9-ed71-4e80-a0aa-aa8c90ad3a69 req-40810810-51b6-4773-b201-4007c81b0dc9 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:46.100607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7dc22ba9-ed71-4e80-a0aa-aa8c90ad3a69 req-40810810-51b6-4773-b201-4007c81b0dc9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:46.102064 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7dc22ba9-ed71-4e80-a0aa-aa8c90ad3a69 req-40810810-51b6-4773-b201-4007c81b0dc9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:46.120315 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-7dc22ba9-ed71-4e80-a0aa-aa8c90ad3a69 req-40810810-51b6-4773-b201-4007c81b0dc9 service nova] Creating event network-changed:6ab7361c-b1ad-445b-b3e5-54cdfd45b93b for instance ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 on n-h2-851359-3 Aug 04 17:06:46.135668 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-7dc22ba9-ed71-4e80-a0aa-aa8c90ad3a69 req-40810810-51b6-4773-b201-4007c81b0dc9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062594 Aug 04 17:06:46.142092 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1436/2942] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:06:46.147728 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cc934eaa-3a04-4ad6-9086-afc128a86e7c tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:46.153232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cc934eaa-3a04-4ad6-9086-afc128a86e7c tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: bedaa2fb-63ea-4088-9f32-9a0f0bb34c11] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:46.166433 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc934eaa-3a04-4ad6-9086-afc128a86e7c tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:46.167351 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc934eaa-3a04-4ad6-9086-afc128a86e7c tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:46.167991 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc934eaa-3a04-4ad6-9086-afc128a86e7c tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:46.168915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc934eaa-3a04-4ad6-9086-afc128a86e7c tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:46.170125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc934eaa-3a04-4ad6-9086-afc128a86e7c tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:46.173078 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc934eaa-3a04-4ad6-9086-afc128a86e7c tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:46.449439 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b106094f-eeec-414b-9caa-85851104e7cc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:46.472688 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b106094f-eeec-414b-9caa-85851104e7cc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1365 microversion: 2.1 time: 0.779207 Aug 04 17:06:46.490988 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1507/2943] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:45 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1365 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:46.537062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-35043867-d635-4ec0-8b45-c48d4b59dd88 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:46.538155 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-35043867-d635-4ec0-8b45-c48d4b59dd88 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] [instance: 398976e0-4012-4a63-8cb6-fbfd9325ff32] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:46.578096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-35043867-d635-4ec0-8b45-c48d4b59dd88 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:46.579292 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-35043867-d635-4ec0-8b45-c48d4b59dd88 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:46.580607 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-35043867-d635-4ec0-8b45-c48d4b59dd88 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:46.585794 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-35043867-d635-4ec0-8b45-c48d4b59dd88 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:46.587336 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-35043867-d635-4ec0-8b45-c48d4b59dd88 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:46.590855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-35043867-d635-4ec0-8b45-c48d4b59dd88 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:46.768812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-35043867-d635-4ec0-8b45-c48d4b59dd88 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fc1171b95c4605b104d0d44793837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ffd2d70271450bae6b634c8cbee620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:46.784059 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-35043867-d635-4ec0-8b45-c48d4b59dd88 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] 10.222.0.93 "GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32" status: 200 len: 1336 microversion: 2.1 time: 0.286724 Aug 04 17:06:46.786021 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1508/2944] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:46 2022] GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32 => generated 1336 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:46.797708 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e161ff81-1355-4dbe-aa90-0d7e1c901b38 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:46.810762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e161ff81-1355-4dbe-aa90-0d7e1c901b38 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:46.827166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e161ff81-1355-4dbe-aa90-0d7e1c901b38 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:46.827675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e161ff81-1355-4dbe-aa90-0d7e1c901b38 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:46.828136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e161ff81-1355-4dbe-aa90-0d7e1c901b38 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:46.828842 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e161ff81-1355-4dbe-aa90-0d7e1c901b38 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:46.834745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e161ff81-1355-4dbe-aa90-0d7e1c901b38 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:46.839511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e161ff81-1355-4dbe-aa90-0d7e1c901b38 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:46.873400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cc934eaa-3a04-4ad6-9086-afc128a86e7c tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:46.886336 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cc934eaa-3a04-4ad6-9086-afc128a86e7c tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/bedaa2fb-63ea-4088-9f32-9a0f0bb34c11" status: 200 len: 1512 microversion: 2.1 time: 0.742766 Aug 04 17:06:46.893060 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1437/2945] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:46 2022] GET /compute/v2.1/servers/bedaa2fb-63ea-4088-9f32-9a0f0bb34c11 => generated 1512 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:46.898087 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-95f8caa9-c2da-46f3-bc77-1603bc53069d tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:46.902985 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-95f8caa9-c2da-46f3-bc77-1603bc53069d tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:46.920255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95f8caa9-c2da-46f3-bc77-1603bc53069d tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:46.921022 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95f8caa9-c2da-46f3-bc77-1603bc53069d tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:46.923462 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95f8caa9-c2da-46f3-bc77-1603bc53069d tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:46.926587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95f8caa9-c2da-46f3-bc77-1603bc53069d tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:46.929192 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95f8caa9-c2da-46f3-bc77-1603bc53069d tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:46.929853 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95f8caa9-c2da-46f3-bc77-1603bc53069d tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:47.606480 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-95f8caa9-c2da-46f3-bc77-1603bc53069d tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:47.634100 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-95f8caa9-c2da-46f3-bc77-1603bc53069d tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1270 microversion: 2.1 time: 0.734310 Aug 04 17:06:47.637621 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1438/2946] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:46 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1270 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:47.648487 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-8def5a7b-e6bc-4fcc-af4c-a2ce64b9194c req-e1d2b73e-e6f7-44ee-92ee-5748b7c73e5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10991c59-c7d8-447e-8f2b-3f5ea5d8d62a", "tag": "d34d92ed-1a8a-4623-be8e-630b78a99ac4"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:47.687292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8def5a7b-e6bc-4fcc-af4c-a2ce64b9194c req-e1d2b73e-e6f7-44ee-92ee-5748b7c73e5a service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:47.687980 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8def5a7b-e6bc-4fcc-af4c-a2ce64b9194c req-e1d2b73e-e6f7-44ee-92ee-5748b7c73e5a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:47.692255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8def5a7b-e6bc-4fcc-af4c-a2ce64b9194c req-e1d2b73e-e6f7-44ee-92ee-5748b7c73e5a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:47.708566 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-8def5a7b-e6bc-4fcc-af4c-a2ce64b9194c req-e1d2b73e-e6f7-44ee-92ee-5748b7c73e5a service nova] Creating event network-changed:d34d92ed-1a8a-4623-be8e-630b78a99ac4 for instance 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a on n-h1-851359-3 Aug 04 17:06:47.722905 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-8def5a7b-e6bc-4fcc-af4c-a2ce64b9194c req-e1d2b73e-e6f7-44ee-92ee-5748b7c73e5a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083102 Aug 04 17:06:47.723536 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1439/2947] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:06:47.737240 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-74b991c5-6df3-4be7-b209-c69caa371e55 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:47.738708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-74b991c5-6df3-4be7-b209-c69caa371e55 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:47.753557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74b991c5-6df3-4be7-b209-c69caa371e55 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:47.760438 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74b991c5-6df3-4be7-b209-c69caa371e55 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:47.762632 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74b991c5-6df3-4be7-b209-c69caa371e55 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:47.763844 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74b991c5-6df3-4be7-b209-c69caa371e55 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:47.767092 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74b991c5-6df3-4be7-b209-c69caa371e55 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:47.768155 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74b991c5-6df3-4be7-b209-c69caa371e55 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:48.186472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e161ff81-1355-4dbe-aa90-0d7e1c901b38 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:48.197803 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e161ff81-1355-4dbe-aa90-0d7e1c901b38 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714" status: 200 len: 1317 microversion: 2.1 time: 1.410014 Aug 04 17:06:48.218076 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1509/2948] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:46 2022] GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 => generated 1317 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:48.223343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d7b97f5b-637e-40dd-a77b-6f6879881a65 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:48.224212 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d7b97f5b-637e-40dd-a77b-6f6879881a65 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] [instance: 398976e0-4012-4a63-8cb6-fbfd9325ff32] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:48.230448 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7b97f5b-637e-40dd-a77b-6f6879881a65 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:48.231298 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7b97f5b-637e-40dd-a77b-6f6879881a65 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:48.232540 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7b97f5b-637e-40dd-a77b-6f6879881a65 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:48.238012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7b97f5b-637e-40dd-a77b-6f6879881a65 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:48.239233 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7b97f5b-637e-40dd-a77b-6f6879881a65 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:48.240307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7b97f5b-637e-40dd-a77b-6f6879881a65 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:48.593359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d7b97f5b-637e-40dd-a77b-6f6879881a65 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fc1171b95c4605b104d0d44793837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ffd2d70271450bae6b634c8cbee620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:48.610644 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d7b97f5b-637e-40dd-a77b-6f6879881a65 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] 10.222.0.93 "GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32" status: 200 len: 1336 microversion: 2.1 time: 0.389820 Aug 04 17:06:48.612296 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1510/2949] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:48 2022] GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32 => generated 1336 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:48.624212 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e05ce9ac-c4e3-44f5-9f3b-27cc1428d877 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:48.627116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e05ce9ac-c4e3-44f5-9f3b-27cc1428d877 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: bedaa2fb-63ea-4088-9f32-9a0f0bb34c11] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:48.644664 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e05ce9ac-c4e3-44f5-9f3b-27cc1428d877 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:48.645248 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e05ce9ac-c4e3-44f5-9f3b-27cc1428d877 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:48.645765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e05ce9ac-c4e3-44f5-9f3b-27cc1428d877 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:48.646633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e05ce9ac-c4e3-44f5-9f3b-27cc1428d877 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:48.647192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e05ce9ac-c4e3-44f5-9f3b-27cc1428d877 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:48.647696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e05ce9ac-c4e3-44f5-9f3b-27cc1428d877 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:48.652266 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:06:48.736242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-74b991c5-6df3-4be7-b209-c69caa371e55 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:48.745426 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-74b991c5-6df3-4be7-b209-c69caa371e55 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1365 microversion: 2.1 time: 1.020682 Aug 04 17:06:48.755807 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1440/2950] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:47 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1365 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:48.766058 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-497354f2-4751-4909-993c-336a8c53f253 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:48.766989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-497354f2-4751-4909-993c-336a8c53f253 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:48.775866 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-497354f2-4751-4909-993c-336a8c53f253 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:48.776657 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-497354f2-4751-4909-993c-336a8c53f253 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:48.777263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-497354f2-4751-4909-993c-336a8c53f253 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:48.778198 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-497354f2-4751-4909-993c-336a8c53f253 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:48.779962 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-497354f2-4751-4909-993c-336a8c53f253 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:48.780625 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-497354f2-4751-4909-993c-336a8c53f253 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:49.281612 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e05ce9ac-c4e3-44f5-9f3b-27cc1428d877 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:49.301598 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e05ce9ac-c4e3-44f5-9f3b-27cc1428d877 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/bedaa2fb-63ea-4088-9f32-9a0f0bb34c11" status: 200 len: 1512 microversion: 2.1 time: 0.687810 Aug 04 17:06:49.308882 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1511/2951] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:48 2022] GET /compute/v2.1/servers/bedaa2fb-63ea-4088-9f32-9a0f0bb34c11 => generated 1512 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:49.321031 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-497354f2-4751-4909-993c-336a8c53f253 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:49.331512 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-497354f2-4751-4909-993c-336a8c53f253 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1312 microversion: 2.1 time: 0.571066 Aug 04 17:06:49.333733 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-09871757-42bc-42db-b0f7-38a527916daf tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:49.335254 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-09871757-42bc-42db-b0f7-38a527916daf tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:49.335831 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1441/2952] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:48 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1312 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:49.345886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-09871757-42bc-42db-b0f7-38a527916daf tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:49.346797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-09871757-42bc-42db-b0f7-38a527916daf tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:49.347627 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-09871757-42bc-42db-b0f7-38a527916daf tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:49.348622 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-09871757-42bc-42db-b0f7-38a527916daf tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:49.349313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-09871757-42bc-42db-b0f7-38a527916daf tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:49.349960 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-09871757-42bc-42db-b0f7-38a527916daf tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:49.476551 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b82243b8-1e0b-4a30-aa20-f3ea4ba56856 req-3fcc96bf-2d41-4ccd-8de7-7b2b089d09e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb91686e-c56f-43c3-a4b6-24cacc14acc7", "name": "network-vif-deleted", "tag": "6fc77172-31dd-4362-b557-25bef73747f1"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:49.485532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:06:49.508060 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b82243b8-1e0b-4a30-aa20-f3ea4ba56856 req-3fcc96bf-2d41-4ccd-8de7-7b2b089d09e2 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:49.508924 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b82243b8-1e0b-4a30-aa20-f3ea4ba56856 req-3fcc96bf-2d41-4ccd-8de7-7b2b089d09e2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:49.509654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b82243b8-1e0b-4a30-aa20-f3ea4ba56856 req-3fcc96bf-2d41-4ccd-8de7-7b2b089d09e2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:49.525870 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b82243b8-1e0b-4a30-aa20-f3ea4ba56856 req-3fcc96bf-2d41-4ccd-8de7-7b2b089d09e2 service nova] Creating event network-vif-deleted:6fc77172-31dd-4362-b557-25bef73747f1 for instance fb91686e-c56f-43c3-a4b6-24cacc14acc7 on n-h1-851359-3 Aug 04 17:06:49.533059 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b82243b8-1e0b-4a30-aa20-f3ea4ba56856 req-3fcc96bf-2d41-4ccd-8de7-7b2b089d09e2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064735 Aug 04 17:06:49.536817 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1442/2953] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:06:49.632237 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b58dd772-2052-4da7-8564-682783fdfa4a tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:49.633379 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b58dd772-2052-4da7-8564-682783fdfa4a tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] [instance: 398976e0-4012-4a63-8cb6-fbfd9325ff32] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:49.640478 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b58dd772-2052-4da7-8564-682783fdfa4a tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:49.641346 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b58dd772-2052-4da7-8564-682783fdfa4a tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:49.642067 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b58dd772-2052-4da7-8564-682783fdfa4a tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:49.643003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b58dd772-2052-4da7-8564-682783fdfa4a tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:49.643685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b58dd772-2052-4da7-8564-682783fdfa4a tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:49.644330 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b58dd772-2052-4da7-8564-682783fdfa4a tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:49.702273 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-09871757-42bc-42db-b0f7-38a527916daf tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:49.710826 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-09871757-42bc-42db-b0f7-38a527916daf tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714" status: 200 len: 1317 microversion: 2.1 time: 0.399642 Aug 04 17:06:49.726435 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1512/2954] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:49 2022] GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 => generated 1317 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:49.777249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f8fe7716-6ff2-4cfb-976b-5544bdc5f5eb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:49.778236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f8fe7716-6ff2-4cfb-976b-5544bdc5f5eb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:49.787384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8fe7716-6ff2-4cfb-976b-5544bdc5f5eb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:49.788160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8fe7716-6ff2-4cfb-976b-5544bdc5f5eb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:49.788995 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8fe7716-6ff2-4cfb-976b-5544bdc5f5eb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:49.789947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8fe7716-6ff2-4cfb-976b-5544bdc5f5eb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:49.790719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8fe7716-6ff2-4cfb-976b-5544bdc5f5eb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:49.791372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8fe7716-6ff2-4cfb-976b-5544bdc5f5eb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:49.791512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b58dd772-2052-4da7-8564-682783fdfa4a tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fc1171b95c4605b104d0d44793837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ffd2d70271450bae6b634c8cbee620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:49.800008 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b58dd772-2052-4da7-8564-682783fdfa4a tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] 10.222.0.93 "GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32" status: 200 len: 1336 microversion: 2.1 time: 0.171940 Aug 04 17:06:49.810518 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1443/2955] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:49 2022] GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32 => generated 1336 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:06:50.108643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f8fe7716-6ff2-4cfb-976b-5544bdc5f5eb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:50.130754 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f8fe7716-6ff2-4cfb-976b-5544bdc5f5eb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1365 microversion: 2.1 time: 0.355306 Aug 04 17:06:50.142320 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1513/2956] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:49 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1365 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:50.328211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dabf43e9-10d7-4119-b007-88107e7c24a1 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:50.329077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dabf43e9-10d7-4119-b007-88107e7c24a1 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: bedaa2fb-63ea-4088-9f32-9a0f0bb34c11] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:50.337055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dabf43e9-10d7-4119-b007-88107e7c24a1 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:50.337786 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dabf43e9-10d7-4119-b007-88107e7c24a1 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:50.338430 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dabf43e9-10d7-4119-b007-88107e7c24a1 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:50.339591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dabf43e9-10d7-4119-b007-88107e7c24a1 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:50.340780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dabf43e9-10d7-4119-b007-88107e7c24a1 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:50.341899 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dabf43e9-10d7-4119-b007-88107e7c24a1 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:50.363238 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f249bdb7-f051-4351-92a4-a7b1097f3f9b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:50.366067 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f249bdb7-f051-4351-92a4-a7b1097f3f9b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:50.374191 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f249bdb7-f051-4351-92a4-a7b1097f3f9b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:50.383473 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f249bdb7-f051-4351-92a4-a7b1097f3f9b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:50.384009 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f249bdb7-f051-4351-92a4-a7b1097f3f9b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:50.385372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f249bdb7-f051-4351-92a4-a7b1097f3f9b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:50.385964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f249bdb7-f051-4351-92a4-a7b1097f3f9b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:50.387180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f249bdb7-f051-4351-92a4-a7b1097f3f9b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:50.834438 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dabf43e9-10d7-4119-b007-88107e7c24a1 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:50.850471 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dabf43e9-10d7-4119-b007-88107e7c24a1 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/bedaa2fb-63ea-4088-9f32-9a0f0bb34c11" status: 200 len: 1470 microversion: 2.1 time: 0.526451 Aug 04 17:06:50.851730 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1444/2957] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:50 2022] GET /compute/v2.1/servers/bedaa2fb-63ea-4088-9f32-9a0f0bb34c11 => generated 1470 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:50.856874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6f9200b1-5c38-453b-9098-544661ccc321 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:50.857500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6f9200b1-5c38-453b-9098-544661ccc321 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:50.865275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f9200b1-5c38-453b-9098-544661ccc321 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:50.866705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f9200b1-5c38-453b-9098-544661ccc321 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:50.867318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f9200b1-5c38-453b-9098-544661ccc321 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:50.868208 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f9200b1-5c38-453b-9098-544661ccc321 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:50.869004 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f9200b1-5c38-453b-9098-544661ccc321 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:50.869626 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f9200b1-5c38-453b-9098-544661ccc321 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:51.195511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f249bdb7-f051-4351-92a4-a7b1097f3f9b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:51.210213 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f249bdb7-f051-4351-92a4-a7b1097f3f9b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1312 microversion: 2.1 time: 0.852994 Aug 04 17:06:51.211053 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1514/2958] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:50 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1312 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:51.217366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1816ed76-f63b-4ebd-8946-698d019089be tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:51.222251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1816ed76-f63b-4ebd-8946-698d019089be tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] [instance: 398976e0-4012-4a63-8cb6-fbfd9325ff32] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:51.253844 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1816ed76-f63b-4ebd-8946-698d019089be tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:51.253844 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1816ed76-f63b-4ebd-8946-698d019089be tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:51.253844 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1816ed76-f63b-4ebd-8946-698d019089be tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:51.253844 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1816ed76-f63b-4ebd-8946-698d019089be tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:51.253844 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1816ed76-f63b-4ebd-8946-698d019089be tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:51.254324 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1816ed76-f63b-4ebd-8946-698d019089be tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:51.367041 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:06:51.416951 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=22 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:06:51.442775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6f9200b1-5c38-453b-9098-544661ccc321 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:51.452497 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6f9200b1-5c38-453b-9098-544661ccc321 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714" status: 200 len: 1317 microversion: 2.1 time: 0.599520 Aug 04 17:06:51.466511 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1445/2959] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:50 2022] GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 => generated 1317 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:51.471941 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c7d539a3-a944-411f-9db0-5abed592e8b2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:51.472837 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c7d539a3-a944-411f-9db0-5abed592e8b2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:51.480409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7d539a3-a944-411f-9db0-5abed592e8b2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:51.481959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7d539a3-a944-411f-9db0-5abed592e8b2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:51.482809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7d539a3-a944-411f-9db0-5abed592e8b2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:51.483739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7d539a3-a944-411f-9db0-5abed592e8b2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:51.484409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7d539a3-a944-411f-9db0-5abed592e8b2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:51.485041 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7d539a3-a944-411f-9db0-5abed592e8b2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:51.906291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1816ed76-f63b-4ebd-8946-698d019089be tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fc1171b95c4605b104d0d44793837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ffd2d70271450bae6b634c8cbee620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:51.927881 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1816ed76-f63b-4ebd-8946-698d019089be tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] 10.222.0.93 "GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32" status: 200 len: 1404 microversion: 2.1 time: 0.714888 Aug 04 17:06:51.929312 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1515/2960] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:51 2022] GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32 => generated 1404 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:51.935372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-d4422912-c49c-40ec-b34a-6b2c71c38651 req-124a533f-9f59-433b-915e-382dc1904622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bedaa2fb-63ea-4088-9f32-9a0f0bb34c11", "name": "network-vif-deleted", "tag": "f14ddafe-43d5-4d1a-949c-7b86c6eefa9e"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:51.947313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d4422912-c49c-40ec-b34a-6b2c71c38651 req-124a533f-9f59-433b-915e-382dc1904622 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:51.948013 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d4422912-c49c-40ec-b34a-6b2c71c38651 req-124a533f-9f59-433b-915e-382dc1904622 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:51.948839 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d4422912-c49c-40ec-b34a-6b2c71c38651 req-124a533f-9f59-433b-915e-382dc1904622 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:51.968285 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-d4422912-c49c-40ec-b34a-6b2c71c38651 req-124a533f-9f59-433b-915e-382dc1904622 service nova] Creating event network-vif-deleted:f14ddafe-43d5-4d1a-949c-7b86c6eefa9e for instance bedaa2fb-63ea-4088-9f32-9a0f0bb34c11 on n-h2-851359-3 Aug 04 17:06:51.978377 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-d4422912-c49c-40ec-b34a-6b2c71c38651 req-124a533f-9f59-433b-915e-382dc1904622 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047057 Aug 04 17:06:51.979495 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1516/2961] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:06:51.983072 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c7d539a3-a944-411f-9db0-5abed592e8b2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:51.988232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6b665b7a-9b4b-46e0-94be-d03ae3784461 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:51.989180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6b665b7a-9b4b-46e0-94be-d03ae3784461 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: bedaa2fb-63ea-4088-9f32-9a0f0bb34c11] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:51.995284 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c7d539a3-a944-411f-9db0-5abed592e8b2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1365 microversion: 2.1 time: 0.527310 Aug 04 17:06:52.006505 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1446/2962] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:51 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1365 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:52.012476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6b665b7a-9b4b-46e0-94be-d03ae3784461 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:52.013747 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6b665b7a-9b4b-46e0-94be-d03ae3784461 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:52.014503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6b665b7a-9b4b-46e0-94be-d03ae3784461 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:52.015470 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6b665b7a-9b4b-46e0-94be-d03ae3784461 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:52.016101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6b665b7a-9b4b-46e0-94be-d03ae3784461 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:52.016708 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6b665b7a-9b4b-46e0-94be-d03ae3784461 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:52.213145 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6b665b7a-9b4b-46e0-94be-d03ae3784461 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98638b115404c7d85de7541d9c4182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02352ec274b443429fa5abe400cbcfd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:52.231352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-28ed20d3-6097-49c2-93c0-9a9f0511e909 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:52.232867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-28ed20d3-6097-49c2-93c0-9a9f0511e909 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:52.236519 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6b665b7a-9b4b-46e0-94be-d03ae3784461 tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/bedaa2fb-63ea-4088-9f32-9a0f0bb34c11" status: 200 len: 1470 microversion: 2.1 time: 0.253314 Aug 04 17:06:52.237747 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1517/2963] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:51 2022] GET /compute/v2.1/servers/bedaa2fb-63ea-4088-9f32-9a0f0bb34c11 => generated 1470 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:52.243285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28ed20d3-6097-49c2-93c0-9a9f0511e909 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:52.243790 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28ed20d3-6097-49c2-93c0-9a9f0511e909 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:52.244235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28ed20d3-6097-49c2-93c0-9a9f0511e909 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:52.244950 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28ed20d3-6097-49c2-93c0-9a9f0511e909 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:52.245422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28ed20d3-6097-49c2-93c0-9a9f0511e909 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:52.245856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28ed20d3-6097-49c2-93c0-9a9f0511e909 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:52.387519 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-0612389c-aff8-49b6-8e66-63156ae0cf47 req-e31843bd-7f9a-4b75-b19e-cfafc2deaf4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "080c5631-1dd7-457e-958f-67acaed8f46a", "tag": "870ab345-d84e-4fe2-a244-c6a7e5745c86"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:52.479112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-0612389c-aff8-49b6-8e66-63156ae0cf47 req-e31843bd-7f9a-4b75-b19e-cfafc2deaf4b service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:52.480568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-0612389c-aff8-49b6-8e66-63156ae0cf47 req-e31843bd-7f9a-4b75-b19e-cfafc2deaf4b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:52.481044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-0612389c-aff8-49b6-8e66-63156ae0cf47 req-e31843bd-7f9a-4b75-b19e-cfafc2deaf4b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:52.524566 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-0612389c-aff8-49b6-8e66-63156ae0cf47 req-e31843bd-7f9a-4b75-b19e-cfafc2deaf4b service nova] Creating event network-changed:870ab345-d84e-4fe2-a244-c6a7e5745c86 for instance 080c5631-1dd7-457e-958f-67acaed8f46a on n-h1-851359-3 Aug 04 17:06:52.534319 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-0612389c-aff8-49b6-8e66-63156ae0cf47 req-e31843bd-7f9a-4b75-b19e-cfafc2deaf4b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162822 Aug 04 17:06:52.540358 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1518/2964] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:06:52.546638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c3469c0c-d10e-4ffd-9f11-9979b8e3833b tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:52.547653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c3469c0c-d10e-4ffd-9f11-9979b8e3833b tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:52.557506 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c3469c0c-d10e-4ffd-9f11-9979b8e3833b tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:52.558588 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c3469c0c-d10e-4ffd-9f11-9979b8e3833b tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:52.559348 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c3469c0c-d10e-4ffd-9f11-9979b8e3833b tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:52.560272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c3469c0c-d10e-4ffd-9f11-9979b8e3833b tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:52.560911 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c3469c0c-d10e-4ffd-9f11-9979b8e3833b tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:52.562213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c3469c0c-d10e-4ffd-9f11-9979b8e3833b tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:52.775690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-28ed20d3-6097-49c2-93c0-9a9f0511e909 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:52.823544 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-28ed20d3-6097-49c2-93c0-9a9f0511e909 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1312 microversion: 2.1 time: 0.595974 Aug 04 17:06:52.826684 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1447/2965] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:52 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1312 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:06:52.956848 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-99b270db-58e1-4fee-93fd-ff865fe0eb30 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:52.957500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-99b270db-58e1-4fee-93fd-ff865fe0eb30 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] [instance: 398976e0-4012-4a63-8cb6-fbfd9325ff32] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:52.964225 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:06:52.977939 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=18 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:06:52.993846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99b270db-58e1-4fee-93fd-ff865fe0eb30 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:52.994517 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99b270db-58e1-4fee-93fd-ff865fe0eb30 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:52.994820 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99b270db-58e1-4fee-93fd-ff865fe0eb30 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:52.995556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99b270db-58e1-4fee-93fd-ff865fe0eb30 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:52.996020 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99b270db-58e1-4fee-93fd-ff865fe0eb30 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:52.996462 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99b270db-58e1-4fee-93fd-ff865fe0eb30 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:53.550669 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c3469c0c-d10e-4ffd-9f11-9979b8e3833b tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:53.569448 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c3469c0c-d10e-4ffd-9f11-9979b8e3833b tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714" status: 200 len: 1317 microversion: 2.1 time: 1.024372 Aug 04 17:06:53.570423 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1519/2966] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:52 2022] GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 => generated 1317 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:53.585788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6611f3ec-613e-41ae-9557-a1d6765a450b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:53.587861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6611f3ec-613e-41ae-9557-a1d6765a450b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:53.604428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6611f3ec-613e-41ae-9557-a1d6765a450b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:53.608064 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6611f3ec-613e-41ae-9557-a1d6765a450b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:53.609825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6611f3ec-613e-41ae-9557-a1d6765a450b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:53.612019 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6611f3ec-613e-41ae-9557-a1d6765a450b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:53.612531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6611f3ec-613e-41ae-9557-a1d6765a450b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:53.615912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6611f3ec-613e-41ae-9557-a1d6765a450b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:53.936079 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-99b270db-58e1-4fee-93fd-ff865fe0eb30 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fc1171b95c4605b104d0d44793837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ffd2d70271450bae6b634c8cbee620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:53.959929 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-99b270db-58e1-4fee-93fd-ff865fe0eb30 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] 10.222.0.93 "GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32" status: 200 len: 1404 microversion: 2.1 time: 1.010613 Aug 04 17:06:53.961189 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1448/2967] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:52 2022] GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32 => generated 1404 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:06:53.980236 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f1e52a84-8c3c-4991-9b61-f8fa4b68494d tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:53.981291 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f1e52a84-8c3c-4991-9b61-f8fa4b68494d tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: bedaa2fb-63ea-4088-9f32-9a0f0bb34c11] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:54.000202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f1e52a84-8c3c-4991-9b61-f8fa4b68494d tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:54.010843 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f1e52a84-8c3c-4991-9b61-f8fa4b68494d tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:54.011403 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f1e52a84-8c3c-4991-9b61-f8fa4b68494d tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:54.012084 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f1e52a84-8c3c-4991-9b61-f8fa4b68494d tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:54.012558 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f1e52a84-8c3c-4991-9b61-f8fa4b68494d tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:54.013556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f1e52a84-8c3c-4991-9b61-f8fa4b68494d tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:54.039335 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-f1e52a84-8c3c-4991-9b61-f8fa4b68494d tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] HTTP exception thrown: Instance bedaa2fb-63ea-4088-9f32-9a0f0bb34c11 could not be found. Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f1e52a84-8c3c-4991-9b61-f8fa4b68494d tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Request method failure captured: Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/bedaa2fb-63ea-4088-9f32-9a0f0bb34c11 HTTP/1.1 Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_xg_Cdz_9oO_f1YcJdcSGWICoG6WBvAjW6AQlNkKFpAOCC21ZkyOGWLmnmRgUFM-G6asR1O9DRGHPvlnSl9qzrYuOyV7_uMYx0Oj4NMhVmT5izD6NrPCQDqaC18C8ExHsLdCn6_SGnTkZmcCtY1mN8G4ZHss1fLU46Rh910JP1rSmA Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 02352ec274b443429fa5abe400cbcfd0 Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-MultipleCreateTestJSON-269661108 Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/02352ec274b443429fa5abe400cbcfd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/02352ec274b443429fa5abe400cbcfd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_02352ec274b443429fa5abe400cbcfd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/02352ec274b443429fa5abe400cbcfd0"}]}] Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-MultipleCreateTestJSON-269661108 Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 02352ec274b443429fa5abe400cbcfd0 Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-MultipleCreateTestJSON-269661108 Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-MultipleCreateTestJSON-269661108-project Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: c98638b115404c7d85de7541d9c4182b Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-MultipleCreateTestJSON-269661108-project Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance bedaa2fb-63ea-4088-9f32-9a0f0bb34c11 could not be found. Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'bedaa2fb-63ea-4088-9f32-9a0f0bb34c11'} Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bedaa2fb-63ea-4088-9f32-9a0f0bb34c11 could not be found. Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bedaa2fb-63ea-4088-9f32-9a0f0bb34c11 could not be found. Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:54.041021 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:54.045133 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:54.045133 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:54.045133 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:54.045133 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:06:54.045133 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:06:54.045133 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bedaa2fb-63ea-4088-9f32-9a0f0bb34c11 could not be found. Aug 04 17:06:54.045133 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:06:54.045133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f1e52a84-8c3c-4991-9b61-f8fa4b68494d tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Returning 404 to user: Instance bedaa2fb-63ea-4088-9f32-9a0f0bb34c11 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:06:54.045133 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f1e52a84-8c3c-4991-9b61-f8fa4b68494d tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/bedaa2fb-63ea-4088-9f32-9a0f0bb34c11" status: 404 len: 111 microversion: 2.1 time: 0.079148 Aug 04 17:06:54.045133 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1449/2968] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:53 2022] GET /compute/v2.1/servers/bedaa2fb-63ea-4088-9f32-9a0f0bb34c11 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:06:54.050656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-521071fd-88b8-4444-82e9-e8ed2b3e4619 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:54.051223 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-521071fd-88b8-4444-82e9-e8ed2b3e4619 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:54.057566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-521071fd-88b8-4444-82e9-e8ed2b3e4619 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:54.058126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-521071fd-88b8-4444-82e9-e8ed2b3e4619 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:54.058579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-521071fd-88b8-4444-82e9-e8ed2b3e4619 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:54.059301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-521071fd-88b8-4444-82e9-e8ed2b3e4619 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:54.060307 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-521071fd-88b8-4444-82e9-e8ed2b3e4619 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:54.060744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-521071fd-88b8-4444-82e9-e8ed2b3e4619 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:54.402413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6611f3ec-613e-41ae-9557-a1d6765a450b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:54.412757 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6611f3ec-613e-41ae-9557-a1d6765a450b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1365 microversion: 2.1 time: 0.840584 Aug 04 17:06:54.421220 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1520/2969] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:53 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1365 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:54.426239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cdfe6a88-de71-4d67-957a-94a0203d38bf tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:54.426890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cdfe6a88-de71-4d67-957a-94a0203d38bf tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] [instance: fb91686e-c56f-43c3-a4b6-24cacc14acc7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:54.461606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cdfe6a88-de71-4d67-957a-94a0203d38bf tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:54.462311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cdfe6a88-de71-4d67-957a-94a0203d38bf tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:54.462792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cdfe6a88-de71-4d67-957a-94a0203d38bf tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:54.463520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cdfe6a88-de71-4d67-957a-94a0203d38bf tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:54.463982 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cdfe6a88-de71-4d67-957a-94a0203d38bf tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:54.464422 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cdfe6a88-de71-4d67-957a-94a0203d38bf tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:54.489067 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-cdfe6a88-de71-4d67-957a-94a0203d38bf tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] HTTP exception thrown: Instance fb91686e-c56f-43c3-a4b6-24cacc14acc7 could not be found. Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cdfe6a88-de71-4d67-957a-94a0203d38bf tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Request method failure captured: Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/fb91686e-c56f-43c3-a4b6-24cacc14acc7 HTTP/1.1 Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_xg_Cdz_9oO_f1YcJdcSGWICoG6WBvAjW6AQlNkKFpAOCC21ZkyOGWLmnmRgUFM-G6asR1O9DRGHPvlnSl9qzrYuOyV7_uMYx0Oj4NMhVmT5izD6NrPCQDqaC18C8ExHsLdCn6_SGnTkZmcCtY1mN8G4ZHss1fLU46Rh910JP1rSmA Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 02352ec274b443429fa5abe400cbcfd0 Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-MultipleCreateTestJSON-269661108 Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/02352ec274b443429fa5abe400cbcfd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/02352ec274b443429fa5abe400cbcfd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_02352ec274b443429fa5abe400cbcfd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/02352ec274b443429fa5abe400cbcfd0"}]}] Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-MultipleCreateTestJSON-269661108 Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 02352ec274b443429fa5abe400cbcfd0 Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-MultipleCreateTestJSON-269661108 Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-MultipleCreateTestJSON-269661108-project Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: c98638b115404c7d85de7541d9c4182b Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-MultipleCreateTestJSON-269661108-project Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance fb91686e-c56f-43c3-a4b6-24cacc14acc7 could not be found. Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'fb91686e-c56f-43c3-a4b6-24cacc14acc7'} Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb91686e-c56f-43c3-a4b6-24cacc14acc7 could not be found. Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb91686e-c56f-43c3-a4b6-24cacc14acc7 could not be found. Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:06:54.492303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:54.496930 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:06:54.496930 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:06:54.496930 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:06:54.496930 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:06:54.496930 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:06:54.496930 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb91686e-c56f-43c3-a4b6-24cacc14acc7 could not be found. Aug 04 17:06:54.496930 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:06:54.498245 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cdfe6a88-de71-4d67-957a-94a0203d38bf tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] Returning 404 to user: Instance fb91686e-c56f-43c3-a4b6-24cacc14acc7 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:06:54.500067 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cdfe6a88-de71-4d67-957a-94a0203d38bf tempest-MultipleCreateTestJSON-269661108 tempest-MultipleCreateTestJSON-269661108-project] 10.222.0.93 "GET /compute/v2.1/servers/fb91686e-c56f-43c3-a4b6-24cacc14acc7" status: 404 len: 111 microversion: 2.1 time: 0.077710 Aug 04 17:06:54.501205 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1521/2970] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:54 2022] GET /compute/v2.1/servers/fb91686e-c56f-43c3-a4b6-24cacc14acc7 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:06:54.532392 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-86e52a5d-2a8a-4c31-9303-d42c1175471e req-0cd7aca4-7589-4ec2-b61c-29c73ad32cfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10991c59-c7d8-447e-8f2b-3f5ea5d8d62a", "name": "network-vif-plugged", "status": "completed", "tag": "d34d92ed-1a8a-4623-be8e-630b78a99ac4"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:54.540552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:06:54.553254 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-86e52a5d-2a8a-4c31-9303-d42c1175471e req-0cd7aca4-7589-4ec2-b61c-29c73ad32cfe service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:54.553885 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-86e52a5d-2a8a-4c31-9303-d42c1175471e req-0cd7aca4-7589-4ec2-b61c-29c73ad32cfe service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:54.554220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-86e52a5d-2a8a-4c31-9303-d42c1175471e req-0cd7aca4-7589-4ec2-b61c-29c73ad32cfe service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:54.609939 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-86e52a5d-2a8a-4c31-9303-d42c1175471e req-0cd7aca4-7589-4ec2-b61c-29c73ad32cfe service nova] Creating event network-vif-plugged:d34d92ed-1a8a-4623-be8e-630b78a99ac4 for instance 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a on n-h1-851359-3 Aug 04 17:06:54.629787 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-86e52a5d-2a8a-4c31-9303-d42c1175471e req-0cd7aca4-7589-4ec2-b61c-29c73ad32cfe service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102129 Aug 04 17:06:54.631257 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1522/2971] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:06:54.637743 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1f7499e7-5bcf-4792-a5b1-12b380f35684 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:54.639263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1f7499e7-5bcf-4792-a5b1-12b380f35684 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:54.647661 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f7499e7-5bcf-4792-a5b1-12b380f35684 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:54.648243 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f7499e7-5bcf-4792-a5b1-12b380f35684 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:54.648766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f7499e7-5bcf-4792-a5b1-12b380f35684 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:54.650075 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f7499e7-5bcf-4792-a5b1-12b380f35684 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:54.650582 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f7499e7-5bcf-4792-a5b1-12b380f35684 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:54.651100 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f7499e7-5bcf-4792-a5b1-12b380f35684 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:55.028367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-521071fd-88b8-4444-82e9-e8ed2b3e4619 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:55.038400 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-521071fd-88b8-4444-82e9-e8ed2b3e4619 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1312 microversion: 2.1 time: 0.994327 Aug 04 17:06:55.050461 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1450/2972] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:54 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1312 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:55.057898 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-334596de-d943-4369-bc5f-3a67d7e58039 req-edbb4fc5-3dd7-4e79-a8ad-675c32b71b70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "398976e0-4012-4a63-8cb6-fbfd9325ff32", "tag": "96c6f334-144e-4c68-bc69-2ade83fc3418"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:55.079873 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-334596de-d943-4369-bc5f-3a67d7e58039 req-edbb4fc5-3dd7-4e79-a8ad-675c32b71b70 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:55.080278 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-334596de-d943-4369-bc5f-3a67d7e58039 req-edbb4fc5-3dd7-4e79-a8ad-675c32b71b70 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:55.081052 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-334596de-d943-4369-bc5f-3a67d7e58039 req-edbb4fc5-3dd7-4e79-a8ad-675c32b71b70 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:55.094745 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-334596de-d943-4369-bc5f-3a67d7e58039 req-edbb4fc5-3dd7-4e79-a8ad-675c32b71b70 service nova] Creating event network-changed:96c6f334-144e-4c68-bc69-2ade83fc3418 for instance 398976e0-4012-4a63-8cb6-fbfd9325ff32 on n-h1-851359-3 Aug 04 17:06:55.099847 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-334596de-d943-4369-bc5f-3a67d7e58039 req-edbb4fc5-3dd7-4e79-a8ad-675c32b71b70 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047867 Aug 04 17:06:55.100732 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1451/2973] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:06:55.107337 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6f9fb025-caae-4897-bb6f-807e3c6bb2c5 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:55.108275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6f9fb025-caae-4897-bb6f-807e3c6bb2c5 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] [instance: 398976e0-4012-4a63-8cb6-fbfd9325ff32] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:55.115167 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f9fb025-caae-4897-bb6f-807e3c6bb2c5 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:55.115824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f9fb025-caae-4897-bb6f-807e3c6bb2c5 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:55.116450 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f9fb025-caae-4897-bb6f-807e3c6bb2c5 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:55.117186 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f9fb025-caae-4897-bb6f-807e3c6bb2c5 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:55.117786 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f9fb025-caae-4897-bb6f-807e3c6bb2c5 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:55.118247 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f9fb025-caae-4897-bb6f-807e3c6bb2c5 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:55.440079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1f7499e7-5bcf-4792-a5b1-12b380f35684 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:55.448375 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1f7499e7-5bcf-4792-a5b1-12b380f35684 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714" status: 200 len: 1317 microversion: 2.1 time: 0.815545 Aug 04 17:06:55.449043 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1523/2974] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:54 2022] GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 => generated 1317 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:55.453725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-850d1a96-c270-41fe-99cf-00e0f5e964b0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:55.454401 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-850d1a96-c270-41fe-99cf-00e0f5e964b0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:55.467683 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-850d1a96-c270-41fe-99cf-00e0f5e964b0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:55.468182 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-850d1a96-c270-41fe-99cf-00e0f5e964b0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:55.468629 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-850d1a96-c270-41fe-99cf-00e0f5e964b0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:55.469610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-850d1a96-c270-41fe-99cf-00e0f5e964b0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:55.470416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-850d1a96-c270-41fe-99cf-00e0f5e964b0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:55.470864 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-850d1a96-c270-41fe-99cf-00e0f5e964b0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:55.802186 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6f9fb025-caae-4897-bb6f-807e3c6bb2c5 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fc1171b95c4605b104d0d44793837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ffd2d70271450bae6b634c8cbee620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:55.818758 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6f9fb025-caae-4897-bb6f-807e3c6bb2c5 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] 10.222.0.93 "GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32" status: 200 len: 1404 microversion: 2.1 time: 0.716785 Aug 04 17:06:55.819360 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1452/2975] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:55 2022] GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32 => generated 1404 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:56.066051 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f9f41cd4-5799-4b3e-8274-9a822df2b2da tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:56.067801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f9f41cd4-5799-4b3e-8274-9a822df2b2da tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:56.080885 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9f41cd4-5799-4b3e-8274-9a822df2b2da tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:56.081940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9f41cd4-5799-4b3e-8274-9a822df2b2da tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:56.085139 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9f41cd4-5799-4b3e-8274-9a822df2b2da tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:56.085955 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9f41cd4-5799-4b3e-8274-9a822df2b2da tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:56.088497 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9f41cd4-5799-4b3e-8274-9a822df2b2da tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:56.089559 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9f41cd4-5799-4b3e-8274-9a822df2b2da tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:56.279856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-850d1a96-c270-41fe-99cf-00e0f5e964b0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:56.306327 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-850d1a96-c270-41fe-99cf-00e0f5e964b0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1365 microversion: 2.1 time: 0.854002 Aug 04 17:06:56.308742 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1524/2976] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:55 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1365 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:56.473169 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c88fdc6b-2442-4a65-be1d-11abc821bafb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:56.474159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c88fdc6b-2442-4a65-be1d-11abc821bafb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:56.482762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c88fdc6b-2442-4a65-be1d-11abc821bafb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:56.484051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c88fdc6b-2442-4a65-be1d-11abc821bafb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:56.484675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c88fdc6b-2442-4a65-be1d-11abc821bafb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:56.485518 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c88fdc6b-2442-4a65-be1d-11abc821bafb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:56.486066 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c88fdc6b-2442-4a65-be1d-11abc821bafb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:56.486633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c88fdc6b-2442-4a65-be1d-11abc821bafb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:57.292452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f9f41cd4-5799-4b3e-8274-9a822df2b2da tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:57.300409 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f9f41cd4-5799-4b3e-8274-9a822df2b2da tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1312 microversion: 2.1 time: 1.239585 Aug 04 17:06:57.300993 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1453/2977] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:56 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1312 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:06:57.305764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-c0aabf63-60e9-425f-b33d-5aad0ddc8a87 req-7fa594a9-3920-4deb-8cd4-3d5032f7cfab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714", "name": "network-vif-plugged", "status": "completed", "tag": "6ab7361c-b1ad-445b-b3e5-54cdfd45b93b"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:57.315059 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c0aabf63-60e9-425f-b33d-5aad0ddc8a87 req-7fa594a9-3920-4deb-8cd4-3d5032f7cfab service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:57.315538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c0aabf63-60e9-425f-b33d-5aad0ddc8a87 req-7fa594a9-3920-4deb-8cd4-3d5032f7cfab service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:57.315973 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c0aabf63-60e9-425f-b33d-5aad0ddc8a87 req-7fa594a9-3920-4deb-8cd4-3d5032f7cfab service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:57.327927 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-c0aabf63-60e9-425f-b33d-5aad0ddc8a87 req-7fa594a9-3920-4deb-8cd4-3d5032f7cfab service nova] Creating event network-vif-plugged:6ab7361c-b1ad-445b-b3e5-54cdfd45b93b for instance ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 on n-h2-851359-3 Aug 04 17:06:57.332677 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-c0aabf63-60e9-425f-b33d-5aad0ddc8a87 req-7fa594a9-3920-4deb-8cd4-3d5032f7cfab service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030428 Aug 04 17:06:57.333271 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1454/2978] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:06:57.338290 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4c04459b-1c8c-41d2-9e0f-a3440108820c tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:57.338987 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4c04459b-1c8c-41d2-9e0f-a3440108820c tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] [instance: 398976e0-4012-4a63-8cb6-fbfd9325ff32] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:57.346134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c04459b-1c8c-41d2-9e0f-a3440108820c tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:57.346563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c04459b-1c8c-41d2-9e0f-a3440108820c tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:57.347038 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c04459b-1c8c-41d2-9e0f-a3440108820c tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:57.347733 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c04459b-1c8c-41d2-9e0f-a3440108820c tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:57.348191 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c04459b-1c8c-41d2-9e0f-a3440108820c tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:57.348620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c04459b-1c8c-41d2-9e0f-a3440108820c tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:57.384759 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c88fdc6b-2442-4a65-be1d-11abc821bafb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:57.397015 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c88fdc6b-2442-4a65-be1d-11abc821bafb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714" status: 200 len: 1317 microversion: 2.1 time: 0.931803 Aug 04 17:06:57.404739 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1525/2979] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:56 2022] GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 => generated 1317 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:57.554415 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c951f415-4a9c-42ab-9377-61325e3bf4d6 tempest-AZV2TestJSON-1970971475 tempest-AZV2TestJSON-1970971475-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:57.556159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c951f415-4a9c-42ab-9377-61325e3bf4d6 tempest-AZV2TestJSON-1970971475 tempest-AZV2TestJSON-1970971475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:57.556717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c951f415-4a9c-42ab-9377-61325e3bf4d6 tempest-AZV2TestJSON-1970971475 tempest-AZV2TestJSON-1970971475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:57.557255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c951f415-4a9c-42ab-9377-61325e3bf4d6 tempest-AZV2TestJSON-1970971475 tempest-AZV2TestJSON-1970971475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:57.558193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c951f415-4a9c-42ab-9377-61325e3bf4d6 tempest-AZV2TestJSON-1970971475 tempest-AZV2TestJSON-1970971475-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:57.558731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c951f415-4a9c-42ab-9377-61325e3bf4d6 tempest-AZV2TestJSON-1970971475 tempest-AZV2TestJSON-1970971475-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:57.559249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c951f415-4a9c-42ab-9377-61325e3bf4d6 tempest-AZV2TestJSON-1970971475 tempest-AZV2TestJSON-1970971475-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:57.583743 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c951f415-4a9c-42ab-9377-61325e3bf4d6 tempest-AZV2TestJSON-1970971475 tempest-AZV2TestJSON-1970971475-project] 10.222.0.93 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.177641 Aug 04 17:06:57.584410 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1526/2980] 10.222.0.93 () {58 vars in 1164 bytes} [Thu Aug 4 17:06:57 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:06:57.592534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9dcde602-734a-462c-94f6-182afe0ee020 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:57.593925 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9dcde602-734a-462c-94f6-182afe0ee020 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:57.602276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9dcde602-734a-462c-94f6-182afe0ee020 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:57.602825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9dcde602-734a-462c-94f6-182afe0ee020 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:57.603287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9dcde602-734a-462c-94f6-182afe0ee020 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:57.604202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9dcde602-734a-462c-94f6-182afe0ee020 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:57.604679 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9dcde602-734a-462c-94f6-182afe0ee020 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:57.605606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9dcde602-734a-462c-94f6-182afe0ee020 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:57.982374 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4c04459b-1c8c-41d2-9e0f-a3440108820c tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fc1171b95c4605b104d0d44793837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ffd2d70271450bae6b634c8cbee620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:57.985875 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:06:57.991087 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4c04459b-1c8c-41d2-9e0f-a3440108820c tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] 10.222.0.93 "GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32" status: 200 len: 1404 microversion: 2.1 time: 0.656665 Aug 04 17:06:58.003146 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1455/2981] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:57 2022] GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32 => generated 1404 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:58.121565 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9dcde602-734a-462c-94f6-182afe0ee020 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:58.133856 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9dcde602-734a-462c-94f6-182afe0ee020 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1365 microversion: 2.1 time: 0.546895 Aug 04 17:06:58.135460 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1527/2982] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:57 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1365 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:58.320938 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a176ea7b-e79d-4ec9-922c-584e1c31c76d tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:58.321558 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a176ea7b-e79d-4ec9-922c-584e1c31c76d tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:58.350070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a176ea7b-e79d-4ec9-922c-584e1c31c76d tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:58.353358 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a176ea7b-e79d-4ec9-922c-584e1c31c76d tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:58.353951 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a176ea7b-e79d-4ec9-922c-584e1c31c76d tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:58.354837 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a176ea7b-e79d-4ec9-922c-584e1c31c76d tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:58.358627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a176ea7b-e79d-4ec9-922c-584e1c31c76d tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:58.360345 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a176ea7b-e79d-4ec9-922c-584e1c31c76d tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:58.423455 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-eaaf368f-78a6-4271-b38f-57e881c981b4 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:58.424250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-eaaf368f-78a6-4271-b38f-57e881c981b4 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:58.445532 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eaaf368f-78a6-4271-b38f-57e881c981b4 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:58.449414 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eaaf368f-78a6-4271-b38f-57e881c981b4 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:58.452753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eaaf368f-78a6-4271-b38f-57e881c981b4 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:58.454476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eaaf368f-78a6-4271-b38f-57e881c981b4 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:58.459218 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eaaf368f-78a6-4271-b38f-57e881c981b4 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:58.461206 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eaaf368f-78a6-4271-b38f-57e881c981b4 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:59.002700 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a176ea7b-e79d-4ec9-922c-584e1c31c76d tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:59.013240 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a176ea7b-e79d-4ec9-922c-584e1c31c76d tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1312 microversion: 2.1 time: 0.695790 Aug 04 17:06:59.020543 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1456/2983] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:58 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1312 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:06:59.038026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fb43609a-1b3f-41ac-a544-7553c3e9f8b2 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:59.038658 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fb43609a-1b3f-41ac-a544-7553c3e9f8b2 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] [instance: 398976e0-4012-4a63-8cb6-fbfd9325ff32] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:59.045457 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb43609a-1b3f-41ac-a544-7553c3e9f8b2 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:59.053776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb43609a-1b3f-41ac-a544-7553c3e9f8b2 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:59.054473 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb43609a-1b3f-41ac-a544-7553c3e9f8b2 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:59.055423 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb43609a-1b3f-41ac-a544-7553c3e9f8b2 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:59.056073 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb43609a-1b3f-41ac-a544-7553c3e9f8b2 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:59.056679 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb43609a-1b3f-41ac-a544-7553c3e9f8b2 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:59.181945 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-eaaf368f-78a6-4271-b38f-57e881c981b4 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:59.193919 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-eaaf368f-78a6-4271-b38f-57e881c981b4 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714" status: 200 len: 1317 microversion: 2.1 time: 0.778817 Aug 04 17:06:59.206957 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1528/2984] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:58 2022] GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 => generated 1317 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:06:59.212390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-97010096-0925-43c0-a44d-38f9176168f6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:06:59.213237 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-97010096-0925-43c0-a44d-38f9176168f6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:06:59.220068 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-97010096-0925-43c0-a44d-38f9176168f6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:59.220813 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-97010096-0925-43c0-a44d-38f9176168f6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:59.221633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-97010096-0925-43c0-a44d-38f9176168f6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:59.222803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-97010096-0925-43c0-a44d-38f9176168f6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:59.224091 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-97010096-0925-43c0-a44d-38f9176168f6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:59.224733 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-97010096-0925-43c0-a44d-38f9176168f6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:59.638645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fb43609a-1b3f-41ac-a544-7553c3e9f8b2 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fc1171b95c4605b104d0d44793837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ffd2d70271450bae6b634c8cbee620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:06:59.647381 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fb43609a-1b3f-41ac-a544-7553c3e9f8b2 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] 10.222.0.93 "GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32" status: 200 len: 1404 microversion: 2.1 time: 0.622326 Aug 04 17:06:59.648013 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1457/2985] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:59 2022] GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32 => generated 1404 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:06:59.673095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-d7e3ee1d-1a2a-4e5e-b9c3-c61282355918 req-a77ac8a2-8e8b-4dc5-b4dc-454fb83290d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "080c5631-1dd7-457e-958f-67acaed8f46a", "name": "network-vif-plugged", "status": "completed", "tag": "870ab345-d84e-4fe2-a244-c6a7e5745c86"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:06:59.695369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d7e3ee1d-1a2a-4e5e-b9c3-c61282355918 req-a77ac8a2-8e8b-4dc5-b4dc-454fb83290d4 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:06:59.695918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d7e3ee1d-1a2a-4e5e-b9c3-c61282355918 req-a77ac8a2-8e8b-4dc5-b4dc-454fb83290d4 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:06:59.696385 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d7e3ee1d-1a2a-4e5e-b9c3-c61282355918 req-a77ac8a2-8e8b-4dc5-b4dc-454fb83290d4 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:06:59.717941 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-d7e3ee1d-1a2a-4e5e-b9c3-c61282355918 req-a77ac8a2-8e8b-4dc5-b4dc-454fb83290d4 service nova] Creating event network-vif-plugged:870ab345-d84e-4fe2-a244-c6a7e5745c86 for instance 080c5631-1dd7-457e-958f-67acaed8f46a on n-h1-851359-3 Aug 04 17:06:59.728655 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-d7e3ee1d-1a2a-4e5e-b9c3-c61282355918 req-a77ac8a2-8e8b-4dc5-b4dc-454fb83290d4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062794 Aug 04 17:06:59.731181 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1458/2986] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:00.021952 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-97010096-0925-43c0-a44d-38f9176168f6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:00.040897 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-97010096-0925-43c0-a44d-38f9176168f6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1551 microversion: 2.1 time: 0.829990 Aug 04 17:07:00.044265 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1529/2987] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:06:59 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1551 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:00.058785 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4abaf545-db93-4722-bdce-239d6a8c2a63 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:00.060843 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4abaf545-db93-4722-bdce-239d6a8c2a63 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:00.079409 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4abaf545-db93-4722-bdce-239d6a8c2a63 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:00.080804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4abaf545-db93-4722-bdce-239d6a8c2a63 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:00.083521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4abaf545-db93-4722-bdce-239d6a8c2a63 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:00.089305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4abaf545-db93-4722-bdce-239d6a8c2a63 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:00.090076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4abaf545-db93-4722-bdce-239d6a8c2a63 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:00.091780 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4abaf545-db93-4722-bdce-239d6a8c2a63 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:00.162824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5aa101c3-f95a-4e77-970e-64b7bf42536d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-835942858", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "d812de2d-9097-4365-8b54-a9037cf92e5e"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:00.275142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-5aa101c3-f95a-4e77-970e-64b7bf42536d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] validate_networks() for [('d812de2d-9097-4365-8b54-a9037cf92e5e', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:07:00.675551 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4abaf545-db93-4722-bdce-239d6a8c2a63 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:00.686158 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4abaf545-db93-4722-bdce-239d6a8c2a63 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1312 microversion: 2.1 time: 0.639301 Aug 04 17:07:00.699912 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1530/2988] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:00 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1312 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:00.707249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1cf5445d-243c-41bb-8dfa-a779659cc83f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:00.707931 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1cf5445d-243c-41bb-8dfa-a779659cc83f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:00.743872 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1cf5445d-243c-41bb-8dfa-a779659cc83f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:00.744866 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1cf5445d-243c-41bb-8dfa-a779659cc83f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:00.747450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1cf5445d-243c-41bb-8dfa-a779659cc83f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:00.750310 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1cf5445d-243c-41bb-8dfa-a779659cc83f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:00.751990 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1cf5445d-243c-41bb-8dfa-a779659cc83f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:00.753284 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1cf5445d-243c-41bb-8dfa-a779659cc83f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:00.768997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:01.467947 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1cf5445d-243c-41bb-8dfa-a779659cc83f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.755896 Aug 04 17:07:01.468666 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1531/2989] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Aug 4 17:07:00 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/os-interface => generated 284 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:01.480393 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b82a75e2-f0c2-4953-9b83-b477d9c6838c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:01.481377 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b82a75e2-f0c2-4953-9b83-b477d9c6838c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:01.493807 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b82a75e2-f0c2-4953-9b83-b477d9c6838c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:01.494649 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b82a75e2-f0c2-4953-9b83-b477d9c6838c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:01.495249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b82a75e2-f0c2-4953-9b83-b477d9c6838c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:01.496172 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b82a75e2-f0c2-4953-9b83-b477d9c6838c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:01.497305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b82a75e2-f0c2-4953-9b83-b477d9c6838c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:01.499746 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b82a75e2-f0c2-4953-9b83-b477d9c6838c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:02.119767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b82a75e2-f0c2-4953-9b83-b477d9c6838c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:02.139484 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b82a75e2-f0c2-4953-9b83-b477d9c6838c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714" status: 200 len: 1467 microversion: 2.1 time: 0.669312 Aug 04 17:07:02.150477 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1532/2990] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:01 2022] GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 => generated 1467 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:02.167895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bd3a0826-85b1-4dce-a549-eedec6cd4e55 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:02.169171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bd3a0826-85b1-4dce-a549-eedec6cd4e55 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] [instance: 398976e0-4012-4a63-8cb6-fbfd9325ff32] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:02.193562 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bd3a0826-85b1-4dce-a549-eedec6cd4e55 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:02.194578 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bd3a0826-85b1-4dce-a549-eedec6cd4e55 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:02.198126 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bd3a0826-85b1-4dce-a549-eedec6cd4e55 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:02.199590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bd3a0826-85b1-4dce-a549-eedec6cd4e55 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:02.202012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bd3a0826-85b1-4dce-a549-eedec6cd4e55 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:02.204208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bd3a0826-85b1-4dce-a549-eedec6cd4e55 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:02.226402 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-5aa101c3-f95a-4e77-970e-64b7bf42536d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:07:02.226981 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-5aa101c3-f95a-4e77-970e-64b7bf42536d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:07:02.227303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-5aa101c3-f95a-4e77-970e-64b7bf42536d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:07:02.227720 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-5aa101c3-f95a-4e77-970e-64b7bf42536d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:07:02.228142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-5aa101c3-f95a-4e77-970e-64b7bf42536d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:07:02.244904 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5aa101c3-f95a-4e77-970e-64b7bf42536d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:02.245409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5aa101c3-f95a-4e77-970e-64b7bf42536d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:02.245856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5aa101c3-f95a-4e77-970e-64b7bf42536d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:02.252826 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5aa101c3-f95a-4e77-970e-64b7bf42536d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:02.266418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5aa101c3-f95a-4e77-970e-64b7bf42536d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:02.267286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5aa101c3-f95a-4e77-970e-64b7bf42536d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:02.292086 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-5aa101c3-f95a-4e77-970e-64b7bf42536d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Getting quotas for project 0e503687666f4ca59d4ea4d9f9771917. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:07:02.299075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-5aa101c3-f95a-4e77-970e-64b7bf42536d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Getting quotas for user 4b17ad6c3c53441dbd0c648db7b649b5 and project 0e503687666f4ca59d4ea4d9f9771917. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:07:02.314019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5aa101c3-f95a-4e77-970e-64b7bf42536d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:07:02.316677 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5aa101c3-f95a-4e77-970e-64b7bf42536d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:07:02.378759 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5aa101c3-f95a-4e77-970e-64b7bf42536d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.645271 Aug 04 17:07:02.386219 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1459/2991] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:06:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:07:02.398701 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5f945aad-63c6-4403-aa78-798d92e702ec tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:02.399773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5f945aad-63c6-4403-aa78-798d92e702ec tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:02.407309 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f945aad-63c6-4403-aa78-798d92e702ec tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:02.408088 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f945aad-63c6-4403-aa78-798d92e702ec tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:02.408694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f945aad-63c6-4403-aa78-798d92e702ec tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:02.409822 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f945aad-63c6-4403-aa78-798d92e702ec tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:02.410550 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f945aad-63c6-4403-aa78-798d92e702ec tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:02.411947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f945aad-63c6-4403-aa78-798d92e702ec tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:02.590548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bd3a0826-85b1-4dce-a549-eedec6cd4e55 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fc1171b95c4605b104d0d44793837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ffd2d70271450bae6b634c8cbee620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:02.600957 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bd3a0826-85b1-4dce-a549-eedec6cd4e55 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] 10.222.0.93 "GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32" status: 200 len: 1404 microversion: 2.1 time: 0.446131 Aug 04 17:07:02.612655 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1533/2992] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:02 2022] GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32 => generated 1404 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:02.617034 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-faf46312-247c-4d7c-a774-fddf0aa884a6 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:02.617662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-faf46312-247c-4d7c-a774-fddf0aa884a6 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] [instance: ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:02.633764 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-faf46312-247c-4d7c-a774-fddf0aa884a6 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:02.636491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-faf46312-247c-4d7c-a774-fddf0aa884a6 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:02.636973 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-faf46312-247c-4d7c-a774-fddf0aa884a6 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:02.638286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-faf46312-247c-4d7c-a774-fddf0aa884a6 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:02.638765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-faf46312-247c-4d7c-a774-fddf0aa884a6 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:02.639205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-faf46312-247c-4d7c-a774-fddf0aa884a6 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:02.745065 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5f945aad-63c6-4403-aa78-798d92e702ec tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:02.766808 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5f945aad-63c6-4403-aa78-798d92e702ec tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1498 microversion: 2.1 time: 0.379158 Aug 04 17:07:02.768188 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1460/2993] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:02 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1498 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:02.784132 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c703990a-8073-4c87-9e26-3c912e3adf9d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:02.785225 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c703990a-8073-4c87-9e26-3c912e3adf9d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:02.916026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c703990a-8073-4c87-9e26-3c912e3adf9d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:02.924193 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c703990a-8073-4c87-9e26-3c912e3adf9d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1217 microversion: 2.1 time: 0.153844 Aug 04 17:07:02.951990 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1461/2994] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:02 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1217 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:02.960341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c125fbb2-93ea-4760-b75c-17a282cfbf43 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:02.964116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c125fbb2-93ea-4760-b75c-17a282cfbf43 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:02.972088 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c125fbb2-93ea-4760-b75c-17a282cfbf43 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:02.973027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c125fbb2-93ea-4760-b75c-17a282cfbf43 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:02.973851 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c125fbb2-93ea-4760-b75c-17a282cfbf43 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:02.974816 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c125fbb2-93ea-4760-b75c-17a282cfbf43 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:02.975485 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c125fbb2-93ea-4760-b75c-17a282cfbf43 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:02.976124 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c125fbb2-93ea-4760-b75c-17a282cfbf43 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:03.010321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-c125fbb2-93ea-4760-b75c-17a282cfbf43 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lazy-loading 'flavor' on Instance uuid 080c5631-1dd7-457e-958f-67acaed8f46a {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:07:03.204583 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-faf46312-247c-4d7c-a774-fddf0aa884a6 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714" status: 200 len: 1618 microversion: 2.1 time: 0.590705 Aug 04 17:07:03.224557 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1534/2995] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:02 2022] GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 => generated 1618 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:03.235440 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c125fbb2-93ea-4760-b75c-17a282cfbf43 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "POST /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a/action" status: 200 len: 32 microversion: 2.1 time: 0.280762 Aug 04 17:07:03.240272 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1462/2996] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:07:02 2022] POST /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a/action => generated 32 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:07:03.260370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3f09c6f9-24e7-479a-b4e2-ebbdbecae533 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:03.261406 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3f09c6f9-24e7-479a-b4e2-ebbdbecae533 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:03.285839 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f09c6f9-24e7-479a-b4e2-ebbdbecae533 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:03.287988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f09c6f9-24e7-479a-b4e2-ebbdbecae533 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:03.289958 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f09c6f9-24e7-479a-b4e2-ebbdbecae533 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:03.291364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f09c6f9-24e7-479a-b4e2-ebbdbecae533 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:03.298375 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f09c6f9-24e7-479a-b4e2-ebbdbecae533 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:03.300468 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f09c6f9-24e7-479a-b4e2-ebbdbecae533 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:03.489250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7a6a5f59-4f89-456a-b663-5785587e0b05 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-391988393", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["42dff36d-2301-4c8c-b3a5-1dd535cf9664"]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:03.636533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-7a6a5f59-4f89-456a-b663-5785587e0b05 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:07:03.996281 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3f09c6f9-24e7-479a-b4e2-ebbdbecae533 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:04.010782 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3f09c6f9-24e7-479a-b4e2-ebbdbecae533 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1504 microversion: 2.1 time: 0.765297 Aug 04 17:07:04.013640 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1535/2997] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:03 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1504 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:04.032678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1332e8eb-c7ef-40f5-bd46-2cccad4a8e71 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:04.036065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1332e8eb-c7ef-40f5-bd46-2cccad4a8e71 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] [instance: 398976e0-4012-4a63-8cb6-fbfd9325ff32] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:04.073098 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1332e8eb-c7ef-40f5-bd46-2cccad4a8e71 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:04.073618 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1332e8eb-c7ef-40f5-bd46-2cccad4a8e71 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:04.076678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1332e8eb-c7ef-40f5-bd46-2cccad4a8e71 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:04.077031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1332e8eb-c7ef-40f5-bd46-2cccad4a8e71 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:04.077523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1332e8eb-c7ef-40f5-bd46-2cccad4a8e71 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:04.077951 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1332e8eb-c7ef-40f5-bd46-2cccad4a8e71 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:04.525956 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1332e8eb-c7ef-40f5-bd46-2cccad4a8e71 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fc1171b95c4605b104d0d44793837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ffd2d70271450bae6b634c8cbee620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:04.537864 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1332e8eb-c7ef-40f5-bd46-2cccad4a8e71 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] 10.222.0.93 "GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32" status: 200 len: 1404 microversion: 2.1 time: 0.522738 Aug 04 17:07:04.538635 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1536/2998] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:04 2022] GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32 => generated 1404 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:04.547323 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9b90a54f-88a2-46de-9dcf-5335f07ef882 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:04.558124 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9b90a54f-88a2-46de-9dcf-5335f07ef882 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:04.569688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b90a54f-88a2-46de-9dcf-5335f07ef882 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:04.570229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b90a54f-88a2-46de-9dcf-5335f07ef882 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:04.570664 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b90a54f-88a2-46de-9dcf-5335f07ef882 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:04.571383 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b90a54f-88a2-46de-9dcf-5335f07ef882 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:04.573647 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b90a54f-88a2-46de-9dcf-5335f07ef882 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:04.574218 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b90a54f-88a2-46de-9dcf-5335f07ef882 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:04.703122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7a6a5f59-4f89-456a-b663-5785587e0b05 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:07:04.709695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7a6a5f59-4f89-456a-b663-5785587e0b05 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:07:04.714590 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7a6a5f59-4f89-456a-b663-5785587e0b05 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:07:04.715703 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7a6a5f59-4f89-456a-b663-5785587e0b05 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:07:04.717013 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7a6a5f59-4f89-456a-b663-5785587e0b05 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:07:04.741639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a6a5f59-4f89-456a-b663-5785587e0b05 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:04.742655 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a6a5f59-4f89-456a-b663-5785587e0b05 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:04.744500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a6a5f59-4f89-456a-b663-5785587e0b05 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:04.745746 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a6a5f59-4f89-456a-b663-5785587e0b05 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:04.747402 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a6a5f59-4f89-456a-b663-5785587e0b05 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:04.748086 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a6a5f59-4f89-456a-b663-5785587e0b05 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:04.790403 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-7a6a5f59-4f89-456a-b663-5785587e0b05 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for project de328615cef94528b55b8309dd9b82b0. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:07:04.798934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-7a6a5f59-4f89-456a-b663-5785587e0b05 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for user abad886e45bd4c4b8f5f0f86c45eb068 and project de328615cef94528b55b8309dd9b82b0. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:07:04.819091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7a6a5f59-4f89-456a-b663-5785587e0b05 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:07:04.824445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7a6a5f59-4f89-456a-b663-5785587e0b05 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 373884d2-2103-48cb-aac8-e46d2671a6df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:07:04.887443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9b90a54f-88a2-46de-9dcf-5335f07ef882 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:04.912458 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9b90a54f-88a2-46de-9dcf-5335f07ef882 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1275 microversion: 2.1 time: 0.372547 Aug 04 17:07:04.913254 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1537/2999] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:04 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1275 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:04.928742 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7a6a5f59-4f89-456a-b663-5785587e0b05 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.445012 Aug 04 17:07:04.931699 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1463/3000] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:07:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:07:04.950203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4e91f6ed-9b14-4f37-97a5-16f94664ee88 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:04.951030 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4e91f6ed-9b14-4f37-97a5-16f94664ee88 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 373884d2-2103-48cb-aac8-e46d2671a6df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:04.964099 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-aab8068e-574e-4aaf-b59d-f367576db65e req-3465d46c-a3e7-40e2-bc28-8f2b9aa52513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "398976e0-4012-4a63-8cb6-fbfd9325ff32", "name": "network-vif-plugged", "status": "completed", "tag": "96c6f334-144e-4c68-bc69-2ade83fc3418"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:04.987778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-aab8068e-574e-4aaf-b59d-f367576db65e req-3465d46c-a3e7-40e2-bc28-8f2b9aa52513 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:04.988365 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-aab8068e-574e-4aaf-b59d-f367576db65e req-3465d46c-a3e7-40e2-bc28-8f2b9aa52513 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:04.988885 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-aab8068e-574e-4aaf-b59d-f367576db65e req-3465d46c-a3e7-40e2-bc28-8f2b9aa52513 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:05.003196 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-aab8068e-574e-4aaf-b59d-f367576db65e req-3465d46c-a3e7-40e2-bc28-8f2b9aa52513 service nova] Creating event network-vif-plugged:96c6f334-144e-4c68-bc69-2ade83fc3418 for instance 398976e0-4012-4a63-8cb6-fbfd9325ff32 on n-h1-851359-3 Aug 04 17:07:05.009120 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-aab8068e-574e-4aaf-b59d-f367576db65e req-3465d46c-a3e7-40e2-bc28-8f2b9aa52513 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094641 Aug 04 17:07:05.010309 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1538/3001] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:05.036568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ad312cbe-f2fd-4089-b0f1-89b56c3e6522 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:05.038379 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ad312cbe-f2fd-4089-b0f1-89b56c3e6522 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:05.056412 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad312cbe-f2fd-4089-b0f1-89b56c3e6522 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:05.057888 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad312cbe-f2fd-4089-b0f1-89b56c3e6522 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:05.061467 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad312cbe-f2fd-4089-b0f1-89b56c3e6522 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:05.065046 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad312cbe-f2fd-4089-b0f1-89b56c3e6522 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:05.066960 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad312cbe-f2fd-4089-b0f1-89b56c3e6522 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:05.067684 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad312cbe-f2fd-4089-b0f1-89b56c3e6522 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:05.182238 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4e91f6ed-9b14-4f37-97a5-16f94664ee88 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:05.192511 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4e91f6ed-9b14-4f37-97a5-16f94664ee88 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df" status: 200 len: 1216 microversion: 2.1 time: 0.244881 Aug 04 17:07:05.193219 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1464/3002] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:04 2022] GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df => generated 1216 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:05.562320 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fb169ba0-a690-4123-ab1c-edac76b7c380 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:05.563041 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fb169ba0-a690-4123-ab1c-edac76b7c380 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] [instance: 398976e0-4012-4a63-8cb6-fbfd9325ff32] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:05.580591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb169ba0-a690-4123-ab1c-edac76b7c380 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:05.580591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb169ba0-a690-4123-ab1c-edac76b7c380 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:05.581031 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb169ba0-a690-4123-ab1c-edac76b7c380 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:05.590241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb169ba0-a690-4123-ab1c-edac76b7c380 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:05.592843 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb169ba0-a690-4123-ab1c-edac76b7c380 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:05.593566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb169ba0-a690-4123-ab1c-edac76b7c380 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:05.597105 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ad312cbe-f2fd-4089-b0f1-89b56c3e6522 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:05.611623 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ad312cbe-f2fd-4089-b0f1-89b56c3e6522 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1504 microversion: 2.1 time: 0.580508 Aug 04 17:07:05.612769 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1539/3003] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:05 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1504 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:05.940088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b1fa666d-e3a7-4a7f-9ddd-b57c05f94aee tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:05.942743 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b1fa666d-e3a7-4a7f-9ddd-b57c05f94aee tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:05.974463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1fa666d-e3a7-4a7f-9ddd-b57c05f94aee tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:05.977993 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1fa666d-e3a7-4a7f-9ddd-b57c05f94aee tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:05.979706 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1fa666d-e3a7-4a7f-9ddd-b57c05f94aee tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:05.983246 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1fa666d-e3a7-4a7f-9ddd-b57c05f94aee tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:05.984160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1fa666d-e3a7-4a7f-9ddd-b57c05f94aee tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:06.018447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1fa666d-e3a7-4a7f-9ddd-b57c05f94aee tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:06.237573 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b1fa666d-e3a7-4a7f-9ddd-b57c05f94aee tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:06.248127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fb169ba0-a690-4123-ab1c-edac76b7c380 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fc1171b95c4605b104d0d44793837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ffd2d70271450bae6b634c8cbee620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:06.262724 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fb169ba0-a690-4123-ab1c-edac76b7c380 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] 10.222.0.93 "GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32" status: 200 len: 1404 microversion: 2.1 time: 0.705473 Aug 04 17:07:06.263325 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1465/3004] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:05 2022] GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32 => generated 1404 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:06.272921 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b1fa666d-e3a7-4a7f-9ddd-b57c05f94aee tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1275 microversion: 2.1 time: 0.332009 Aug 04 17:07:06.274661 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1540/3005] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:05 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1275 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:06.274805 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-028b0bd5-6342-4011-83f7-a22a4561f2df tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:06.275414 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-028b0bd5-6342-4011-83f7-a22a4561f2df tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 373884d2-2103-48cb-aac8-e46d2671a6df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:06.285881 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-028b0bd5-6342-4011-83f7-a22a4561f2df tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:06.286678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-028b0bd5-6342-4011-83f7-a22a4561f2df tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:06.287269 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-028b0bd5-6342-4011-83f7-a22a4561f2df tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:06.291171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-028b0bd5-6342-4011-83f7-a22a4561f2df tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:06.291824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-028b0bd5-6342-4011-83f7-a22a4561f2df tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:06.292258 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-f87be0ee-2f22-4fb7-9611-80c86bafc9ca req-9d853e37-eb9b-4823-b3ee-d5cfe6f17577 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10991c59-c7d8-447e-8f2b-3f5ea5d8d62a", "tag": "d34d92ed-1a8a-4623-be8e-630b78a99ac4"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:06.292412 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-028b0bd5-6342-4011-83f7-a22a4561f2df tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:06.305039 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f87be0ee-2f22-4fb7-9611-80c86bafc9ca req-9d853e37-eb9b-4823-b3ee-d5cfe6f17577 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:06.305949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f87be0ee-2f22-4fb7-9611-80c86bafc9ca req-9d853e37-eb9b-4823-b3ee-d5cfe6f17577 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:06.306681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f87be0ee-2f22-4fb7-9611-80c86bafc9ca req-9d853e37-eb9b-4823-b3ee-d5cfe6f17577 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:06.321801 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-f87be0ee-2f22-4fb7-9611-80c86bafc9ca req-9d853e37-eb9b-4823-b3ee-d5cfe6f17577 service nova] Creating event network-changed:d34d92ed-1a8a-4623-be8e-630b78a99ac4 for instance 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a on n-h1-851359-3 Aug 04 17:07:06.328816 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-f87be0ee-2f22-4fb7-9611-80c86bafc9ca req-9d853e37-eb9b-4823-b3ee-d5cfe6f17577 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046122 Aug 04 17:07:06.330116 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1541/3006] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:06.489902 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-028b0bd5-6342-4011-83f7-a22a4561f2df tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:06.510731 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-028b0bd5-6342-4011-83f7-a22a4561f2df tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df" status: 200 len: 1268 microversion: 2.1 time: 0.246315 Aug 04 17:07:06.511708 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1466/3007] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:06 2022] GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df => generated 1268 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:06.636780 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-91558447-0e29-4a6b-8a40-21387a117e48 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:06.637786 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-91558447-0e29-4a6b-8a40-21387a117e48 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:06.649380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91558447-0e29-4a6b-8a40-21387a117e48 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:06.649945 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91558447-0e29-4a6b-8a40-21387a117e48 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:06.651217 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91558447-0e29-4a6b-8a40-21387a117e48 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:06.652054 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91558447-0e29-4a6b-8a40-21387a117e48 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:06.652539 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91558447-0e29-4a6b-8a40-21387a117e48 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:06.654861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91558447-0e29-4a6b-8a40-21387a117e48 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:07.220655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-91558447-0e29-4a6b-8a40-21387a117e48 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:07.236560 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-91558447-0e29-4a6b-8a40-21387a117e48 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1504 microversion: 2.1 time: 0.605588 Aug 04 17:07:07.237270 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1542/3008] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:06 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1504 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:07.284554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b2057c7e-4a8c-4a36-95d2-f113d2f4573f tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:07.285766 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b2057c7e-4a8c-4a36-95d2-f113d2f4573f tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] [instance: 398976e0-4012-4a63-8cb6-fbfd9325ff32] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:07.296147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-62890cb3-0641-40c7-be5e-ef04cdadb1d4 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:07.297100 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-62890cb3-0641-40c7-be5e-ef04cdadb1d4 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:07.305174 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-62890cb3-0641-40c7-be5e-ef04cdadb1d4 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:07.308899 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2057c7e-4a8c-4a36-95d2-f113d2f4573f tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:07.309993 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2057c7e-4a8c-4a36-95d2-f113d2f4573f tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:07.310575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2057c7e-4a8c-4a36-95d2-f113d2f4573f tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:07.311133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2057c7e-4a8c-4a36-95d2-f113d2f4573f tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:07.316382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-62890cb3-0641-40c7-be5e-ef04cdadb1d4 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:07.317014 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-62890cb3-0641-40c7-be5e-ef04cdadb1d4 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:07.317951 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-62890cb3-0641-40c7-be5e-ef04cdadb1d4 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:07.318591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-62890cb3-0641-40c7-be5e-ef04cdadb1d4 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:07.320481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-62890cb3-0641-40c7-be5e-ef04cdadb1d4 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:07.326215 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2057c7e-4a8c-4a36-95d2-f113d2f4573f tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:07.338733 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2057c7e-4a8c-4a36-95d2-f113d2f4573f tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:07.566736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:08.108838 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-62890cb3-0641-40c7-be5e-ef04cdadb1d4 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:08.115984 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b2057c7e-4a8c-4a36-95d2-f113d2f4573f tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fc1171b95c4605b104d0d44793837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ffd2d70271450bae6b634c8cbee620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:08.122280 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-62890cb3-0641-40c7-be5e-ef04cdadb1d4 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1317 microversion: 2.1 time: 0.830433 Aug 04 17:07:08.124032 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b2057c7e-4a8c-4a36-95d2-f113d2f4573f tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] 10.222.0.93 "GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32" status: 200 len: 1404 microversion: 2.1 time: 0.843233 Aug 04 17:07:08.136228 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1467/3009] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:07 2022] GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32 => generated 1404 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:08.139793 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1543/3010] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:07 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1317 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:08.141956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-596b9959-2a26-400a-b9a2-12ccf811a2f8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:08.142608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-596b9959-2a26-400a-b9a2-12ccf811a2f8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 373884d2-2103-48cb-aac8-e46d2671a6df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:08.158991 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-596b9959-2a26-400a-b9a2-12ccf811a2f8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:08.170827 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-596b9959-2a26-400a-b9a2-12ccf811a2f8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:08.171293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-596b9959-2a26-400a-b9a2-12ccf811a2f8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:08.172061 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-596b9959-2a26-400a-b9a2-12ccf811a2f8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:08.172529 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-596b9959-2a26-400a-b9a2-12ccf811a2f8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:08.172970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-596b9959-2a26-400a-b9a2-12ccf811a2f8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:08.266082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0ec99dff-0258-480d-9ea6-d1479436a4a4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:08.267371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0ec99dff-0258-480d-9ea6-d1479436a4a4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:08.273917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ec99dff-0258-480d-9ea6-d1479436a4a4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:08.274585 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ec99dff-0258-480d-9ea6-d1479436a4a4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:08.275126 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ec99dff-0258-480d-9ea6-d1479436a4a4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:08.275916 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ec99dff-0258-480d-9ea6-d1479436a4a4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:08.276452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ec99dff-0258-480d-9ea6-d1479436a4a4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:08.276957 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ec99dff-0258-480d-9ea6-d1479436a4a4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:08.336221 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-596b9959-2a26-400a-b9a2-12ccf811a2f8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:08.344833 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-596b9959-2a26-400a-b9a2-12ccf811a2f8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df" status: 200 len: 1274 microversion: 2.1 time: 0.207163 Aug 04 17:07:08.346128 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1468/3011] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:08 2022] GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df => generated 1274 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:08.586036 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0ec99dff-0258-480d-9ea6-d1479436a4a4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:08.594082 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0ec99dff-0258-480d-9ea6-d1479436a4a4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1504 microversion: 2.1 time: 0.335328 Aug 04 17:07:08.600762 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1544/3012] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:08 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1504 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:08.932815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-a334cb8b-3803-438d-9f8b-42cd8118b10f req-b323e76f-8f20-43b3-9560-59f37351db5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec6241cf-bde4-47ad-9e71-7a95f04844b2", "tag": "aa1e462a-c9ad-4a1c-a2c6-89bf4964520f"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:08.950526 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a334cb8b-3803-438d-9f8b-42cd8118b10f req-b323e76f-8f20-43b3-9560-59f37351db5d service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:08.951014 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a334cb8b-3803-438d-9f8b-42cd8118b10f req-b323e76f-8f20-43b3-9560-59f37351db5d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:08.951663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a334cb8b-3803-438d-9f8b-42cd8118b10f req-b323e76f-8f20-43b3-9560-59f37351db5d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:08.979590 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-a334cb8b-3803-438d-9f8b-42cd8118b10f req-b323e76f-8f20-43b3-9560-59f37351db5d service nova] Creating event network-changed:aa1e462a-c9ad-4a1c-a2c6-89bf4964520f for instance ec6241cf-bde4-47ad-9e71-7a95f04844b2 on n-h2-851359-3 Aug 04 17:07:08.986891 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-a334cb8b-3803-438d-9f8b-42cd8118b10f req-b323e76f-8f20-43b3-9560-59f37351db5d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062824 Aug 04 17:07:08.987952 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1469/3013] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:09.145167 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-59bef9fe-32ab-4dad-976f-5858cd97aca7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:09.153418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b881ff66-1edc-46be-b1e0-c96dd1b538bb tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:09.154659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-59bef9fe-32ab-4dad-976f-5858cd97aca7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:09.156279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b881ff66-1edc-46be-b1e0-c96dd1b538bb tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] [instance: 398976e0-4012-4a63-8cb6-fbfd9325ff32] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:09.182716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b881ff66-1edc-46be-b1e0-c96dd1b538bb tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:09.183645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b881ff66-1edc-46be-b1e0-c96dd1b538bb tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:09.184993 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b881ff66-1edc-46be-b1e0-c96dd1b538bb tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:09.185866 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b881ff66-1edc-46be-b1e0-c96dd1b538bb tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:09.186496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b881ff66-1edc-46be-b1e0-c96dd1b538bb tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:09.187922 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b881ff66-1edc-46be-b1e0-c96dd1b538bb tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:09.189070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59bef9fe-32ab-4dad-976f-5858cd97aca7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:09.189860 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59bef9fe-32ab-4dad-976f-5858cd97aca7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:09.190900 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59bef9fe-32ab-4dad-976f-5858cd97aca7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:09.211658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59bef9fe-32ab-4dad-976f-5858cd97aca7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:09.216692 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59bef9fe-32ab-4dad-976f-5858cd97aca7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:09.217023 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59bef9fe-32ab-4dad-976f-5858cd97aca7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:09.630346 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b881ff66-1edc-46be-b1e0-c96dd1b538bb tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fc1171b95c4605b104d0d44793837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ffd2d70271450bae6b634c8cbee620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:09.639736 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b881ff66-1edc-46be-b1e0-c96dd1b538bb tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] 10.222.0.93 "GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32" status: 200 len: 1591 microversion: 2.1 time: 0.492750 Aug 04 17:07:09.641078 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1470/3014] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:09 2022] GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32 => generated 1591 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:09.646123 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-de4bb0a2-561f-4aa3-b75a-8af4f19ae1c8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:09.647123 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-de4bb0a2-561f-4aa3-b75a-8af4f19ae1c8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 373884d2-2103-48cb-aac8-e46d2671a6df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:09.656680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-59bef9fe-32ab-4dad-976f-5858cd97aca7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:09.663890 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de4bb0a2-561f-4aa3-b75a-8af4f19ae1c8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:09.665915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de4bb0a2-561f-4aa3-b75a-8af4f19ae1c8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:09.666671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de4bb0a2-561f-4aa3-b75a-8af4f19ae1c8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:09.666995 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-59bef9fe-32ab-4dad-976f-5858cd97aca7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1317 microversion: 2.1 time: 0.526416 Aug 04 17:07:09.668852 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1545/3015] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:09 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1317 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:09.676640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de4bb0a2-561f-4aa3-b75a-8af4f19ae1c8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:09.677126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de4bb0a2-561f-4aa3-b75a-8af4f19ae1c8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:09.677840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de4bb0a2-561f-4aa3-b75a-8af4f19ae1c8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:09.682573 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cb776c72-4a00-466e-ac1d-6699c867189b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:09.683475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cb776c72-4a00-466e-ac1d-6699c867189b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:09.693759 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb776c72-4a00-466e-ac1d-6699c867189b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:09.694798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb776c72-4a00-466e-ac1d-6699c867189b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:09.695702 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb776c72-4a00-466e-ac1d-6699c867189b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:09.696847 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb776c72-4a00-466e-ac1d-6699c867189b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:09.698076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb776c72-4a00-466e-ac1d-6699c867189b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:09.698796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb776c72-4a00-466e-ac1d-6699c867189b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:10.144336 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-de4bb0a2-561f-4aa3-b75a-8af4f19ae1c8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:10.154014 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cb776c72-4a00-466e-ac1d-6699c867189b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:10.192521 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-de4bb0a2-561f-4aa3-b75a-8af4f19ae1c8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df" status: 200 len: 1316 microversion: 2.1 time: 0.549272 Aug 04 17:07:10.195603 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1471/3016] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:09 2022] GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df => generated 1316 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:10.198861 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cb776c72-4a00-466e-ac1d-6699c867189b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1504 microversion: 2.1 time: 0.526834 Aug 04 17:07:10.201197 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1546/3017] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:09 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1504 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:10.214212 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f38705d9-1a37-4ad3-b0d7-81943238cd77 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:10.216769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f38705d9-1a37-4ad3-b0d7-81943238cd77 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] [instance: 398976e0-4012-4a63-8cb6-fbfd9325ff32] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:10.229239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f38705d9-1a37-4ad3-b0d7-81943238cd77 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:10.230525 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f38705d9-1a37-4ad3-b0d7-81943238cd77 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:10.232845 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f38705d9-1a37-4ad3-b0d7-81943238cd77 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:10.234619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f38705d9-1a37-4ad3-b0d7-81943238cd77 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:10.236216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f38705d9-1a37-4ad3-b0d7-81943238cd77 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:10.237143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f38705d9-1a37-4ad3-b0d7-81943238cd77 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:10.399944 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f38705d9-1a37-4ad3-b0d7-81943238cd77 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] 10.222.0.93 "GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.201705 Aug 04 17:07:10.400873 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1472/3018] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Aug 4 17:07:10 2022] GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32/os-interface => generated 285 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:10.691658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-530c6153-affe-4dd9-a6fd-2cc6243f92f7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:10.692980 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-530c6153-affe-4dd9-a6fd-2cc6243f92f7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:10.699550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-530c6153-affe-4dd9-a6fd-2cc6243f92f7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:10.701094 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-530c6153-affe-4dd9-a6fd-2cc6243f92f7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:10.701771 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-530c6153-affe-4dd9-a6fd-2cc6243f92f7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:10.702767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-530c6153-affe-4dd9-a6fd-2cc6243f92f7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:10.703476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-530c6153-affe-4dd9-a6fd-2cc6243f92f7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:10.704156 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-530c6153-affe-4dd9-a6fd-2cc6243f92f7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:11.072593 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-530c6153-affe-4dd9-a6fd-2cc6243f92f7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:11.088562 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-530c6153-affe-4dd9-a6fd-2cc6243f92f7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1317 microversion: 2.1 time: 0.400908 Aug 04 17:07:11.104497 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1547/3019] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:10 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1317 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:11.221139 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2b65fff8-a20a-4d45-b512-5ed3ec31ac6a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:11.222838 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ff8272f2-8c4f-417e-a454-449a81729cab tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:11.223647 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2b65fff8-a20a-4d45-b512-5ed3ec31ac6a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:11.226334 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ff8272f2-8c4f-417e-a454-449a81729cab tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 373884d2-2103-48cb-aac8-e46d2671a6df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:11.236307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b65fff8-a20a-4d45-b512-5ed3ec31ac6a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:11.239101 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff8272f2-8c4f-417e-a454-449a81729cab tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:11.239988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b65fff8-a20a-4d45-b512-5ed3ec31ac6a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:11.240669 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b65fff8-a20a-4d45-b512-5ed3ec31ac6a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:11.241416 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff8272f2-8c4f-417e-a454-449a81729cab tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:11.242450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b65fff8-a20a-4d45-b512-5ed3ec31ac6a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:11.243144 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff8272f2-8c4f-417e-a454-449a81729cab tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:11.244097 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff8272f2-8c4f-417e-a454-449a81729cab tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:11.244820 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b65fff8-a20a-4d45-b512-5ed3ec31ac6a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:11.245486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b65fff8-a20a-4d45-b512-5ed3ec31ac6a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:11.251253 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff8272f2-8c4f-417e-a454-449a81729cab tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:11.252155 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff8272f2-8c4f-417e-a454-449a81729cab tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:11.616801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2b65fff8-a20a-4d45-b512-5ed3ec31ac6a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:11.627710 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2b65fff8-a20a-4d45-b512-5ed3ec31ac6a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1504 microversion: 2.1 time: 0.409898 Aug 04 17:07:11.630907 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1548/3020] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:11 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1504 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:11.688129 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ff8272f2-8c4f-417e-a454-449a81729cab tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:11.695703 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ff8272f2-8c4f-417e-a454-449a81729cab tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df" status: 200 len: 1316 microversion: 2.1 time: 0.483523 Aug 04 17:07:11.696299 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1473/3021] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:11 2022] GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df => generated 1316 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:12.050837 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-0fd0ddaa-53a1-4efd-bd10-36ced3c258ec req-7354a556-d851-47aa-907c-ca24f04be4e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "373884d2-2103-48cb-aac8-e46d2671a6df", "tag": "909f4468-9b6b-4585-9aaf-9b43a020a453"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:12.072959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-0fd0ddaa-53a1-4efd-bd10-36ced3c258ec req-7354a556-d851-47aa-907c-ca24f04be4e9 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:12.073717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-0fd0ddaa-53a1-4efd-bd10-36ced3c258ec req-7354a556-d851-47aa-907c-ca24f04be4e9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:12.074351 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-0fd0ddaa-53a1-4efd-bd10-36ced3c258ec req-7354a556-d851-47aa-907c-ca24f04be4e9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:12.108453 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-0fd0ddaa-53a1-4efd-bd10-36ced3c258ec req-7354a556-d851-47aa-907c-ca24f04be4e9 service nova] Creating event network-changed:909f4468-9b6b-4585-9aaf-9b43a020a453 for instance 373884d2-2103-48cb-aac8-e46d2671a6df on n-h2-851359-3 Aug 04 17:07:12.110401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bbdf1222-ea5a-4efb-9ca5-1657b626ee45 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:12.111038 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bbdf1222-ea5a-4efb-9ca5-1657b626ee45 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:12.114952 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-0fd0ddaa-53a1-4efd-bd10-36ced3c258ec req-7354a556-d851-47aa-907c-ca24f04be4e9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069991 Aug 04 17:07:12.116074 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1549/3022] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:12.124440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bbdf1222-ea5a-4efb-9ca5-1657b626ee45 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:12.125194 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bbdf1222-ea5a-4efb-9ca5-1657b626ee45 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:12.125641 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bbdf1222-ea5a-4efb-9ca5-1657b626ee45 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:12.126392 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bbdf1222-ea5a-4efb-9ca5-1657b626ee45 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:12.127020 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bbdf1222-ea5a-4efb-9ca5-1657b626ee45 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:12.127959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bbdf1222-ea5a-4efb-9ca5-1657b626ee45 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:12.654972 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0769614a-4a12-46bf-85e9-5c3e02db0f1e tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:12.656142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0769614a-4a12-46bf-85e9-5c3e02db0f1e tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:12.663084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0769614a-4a12-46bf-85e9-5c3e02db0f1e tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:12.664395 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0769614a-4a12-46bf-85e9-5c3e02db0f1e tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:12.665144 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0769614a-4a12-46bf-85e9-5c3e02db0f1e tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:12.666123 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0769614a-4a12-46bf-85e9-5c3e02db0f1e tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:12.666823 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0769614a-4a12-46bf-85e9-5c3e02db0f1e tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:12.670214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0769614a-4a12-46bf-85e9-5c3e02db0f1e tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:12.712719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:13.211159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bbdf1222-ea5a-4efb-9ca5-1657b626ee45 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:13.230287 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bbdf1222-ea5a-4efb-9ca5-1657b626ee45 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1317 microversion: 2.1 time: 1.121909 Aug 04 17:07:13.232985 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1474/3023] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:12 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1317 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:13.236798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0769614a-4a12-46bf-85e9-5c3e02db0f1e tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:13.248181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-69520403-fa29-4ffa-b2d1-5308c2de8bb1 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:13.248933 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-69520403-fa29-4ffa-b2d1-5308c2de8bb1 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 373884d2-2103-48cb-aac8-e46d2671a6df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:13.252696 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0769614a-4a12-46bf-85e9-5c3e02db0f1e tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1504 microversion: 2.1 time: 0.603467 Aug 04 17:07:13.253931 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1550/3024] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:12 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1504 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:13.265951 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69520403-fa29-4ffa-b2d1-5308c2de8bb1 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:13.266471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69520403-fa29-4ffa-b2d1-5308c2de8bb1 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:13.267968 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69520403-fa29-4ffa-b2d1-5308c2de8bb1 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:13.269579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69520403-fa29-4ffa-b2d1-5308c2de8bb1 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:13.270604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69520403-fa29-4ffa-b2d1-5308c2de8bb1 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:13.272907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69520403-fa29-4ffa-b2d1-5308c2de8bb1 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:13.311707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:13.439510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a243d477-b283-4c3f-931e-beac5086d170 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:13.440262 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a243d477-b283-4c3f-931e-beac5086d170 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] [instance: 398976e0-4012-4a63-8cb6-fbfd9325ff32] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:13.453693 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a243d477-b283-4c3f-931e-beac5086d170 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:13.454423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a243d477-b283-4c3f-931e-beac5086d170 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:13.454988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a243d477-b283-4c3f-931e-beac5086d170 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:13.455844 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a243d477-b283-4c3f-931e-beac5086d170 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:13.457925 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a243d477-b283-4c3f-931e-beac5086d170 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:13.458522 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a243d477-b283-4c3f-931e-beac5086d170 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:13.778845 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-69520403-fa29-4ffa-b2d1-5308c2de8bb1 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:13.816973 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-69520403-fa29-4ffa-b2d1-5308c2de8bb1 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df" status: 200 len: 1316 microversion: 2.1 time: 0.576200 Aug 04 17:07:13.820074 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1475/3025] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:13 2022] GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df => generated 1316 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:13.831080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-25aa0b3e-4689-4d24-9d97-044a5e326cce req-484dc83e-5d81-4ccf-8dcd-30c66d8d0fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "398976e0-4012-4a63-8cb6-fbfd9325ff32", "tag": "96c6f334-144e-4c68-bc69-2ade83fc3418"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:13.863256 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:13.866407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-25aa0b3e-4689-4d24-9d97-044a5e326cce req-484dc83e-5d81-4ccf-8dcd-30c66d8d0fe5 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:13.867355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-25aa0b3e-4689-4d24-9d97-044a5e326cce req-484dc83e-5d81-4ccf-8dcd-30c66d8d0fe5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:13.870632 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-25aa0b3e-4689-4d24-9d97-044a5e326cce req-484dc83e-5d81-4ccf-8dcd-30c66d8d0fe5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:13.933601 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-25aa0b3e-4689-4d24-9d97-044a5e326cce req-484dc83e-5d81-4ccf-8dcd-30c66d8d0fe5 service nova] Creating event network-changed:96c6f334-144e-4c68-bc69-2ade83fc3418 for instance 398976e0-4012-4a63-8cb6-fbfd9325ff32 on n-h1-851359-3 Aug 04 17:07:13.964528 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-25aa0b3e-4689-4d24-9d97-044a5e326cce req-484dc83e-5d81-4ccf-8dcd-30c66d8d0fe5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142499 Aug 04 17:07:13.965145 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1476/3026] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:13.994240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a243d477-b283-4c3f-931e-beac5086d170 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fc1171b95c4605b104d0d44793837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ffd2d70271450bae6b634c8cbee620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:14.009458 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a243d477-b283-4c3f-931e-beac5086d170 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] 10.222.0.93 "GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32" status: 200 len: 1591 microversion: 2.1 time: 0.574195 Aug 04 17:07:14.012994 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1551/3027] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:13 2022] GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32 => generated 1591 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:14.256643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cc27c7fa-2447-4341-b68d-3f4574332394 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:14.263291 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cc27c7fa-2447-4341-b68d-3f4574332394 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:14.280419 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e0ea32c0-27fe-4da8-b71c-74ada3b45d53 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:14.281003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc27c7fa-2447-4341-b68d-3f4574332394 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:14.281003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc27c7fa-2447-4341-b68d-3f4574332394 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:14.281375 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc27c7fa-2447-4341-b68d-3f4574332394 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:14.282142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc27c7fa-2447-4341-b68d-3f4574332394 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:14.282525 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e0ea32c0-27fe-4da8-b71c-74ada3b45d53 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:14.282659 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc27c7fa-2447-4341-b68d-3f4574332394 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:14.283032 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc27c7fa-2447-4341-b68d-3f4574332394 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:14.294939 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0ea32c0-27fe-4da8-b71c-74ada3b45d53 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:14.299441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0ea32c0-27fe-4da8-b71c-74ada3b45d53 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:14.300159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0ea32c0-27fe-4da8-b71c-74ada3b45d53 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:14.302394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0ea32c0-27fe-4da8-b71c-74ada3b45d53 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:14.325066 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0ea32c0-27fe-4da8-b71c-74ada3b45d53 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:14.329386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0ea32c0-27fe-4da8-b71c-74ada3b45d53 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:14.780294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:15.187849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=16 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:15.213997 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cc27c7fa-2447-4341-b68d-3f4574332394 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:15.229785 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cc27c7fa-2447-4341-b68d-3f4574332394 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1317 microversion: 2.1 time: 0.975095 Aug 04 17:07:15.231344 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1477/3028] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:14 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1317 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:15.238883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a0565c66-e2bd-4a46-a080-fbff8744bdfa tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:15.243306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a0565c66-e2bd-4a46-a080-fbff8744bdfa tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 373884d2-2103-48cb-aac8-e46d2671a6df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:15.269463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0565c66-e2bd-4a46-a080-fbff8744bdfa tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:15.271910 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0565c66-e2bd-4a46-a080-fbff8744bdfa tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:15.273376 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0565c66-e2bd-4a46-a080-fbff8744bdfa tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:15.282347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0565c66-e2bd-4a46-a080-fbff8744bdfa tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:15.283152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0565c66-e2bd-4a46-a080-fbff8744bdfa tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:15.283792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0565c66-e2bd-4a46-a080-fbff8744bdfa tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:15.791476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e0ea32c0-27fe-4da8-b71c-74ada3b45d53 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:15.801041 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e0ea32c0-27fe-4da8-b71c-74ada3b45d53 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1504 microversion: 2.1 time: 1.525645 Aug 04 17:07:15.807478 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1552/3029] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:14 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1504 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:16.083059 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a0565c66-e2bd-4a46-a080-fbff8744bdfa tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:16.091931 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a0565c66-e2bd-4a46-a080-fbff8744bdfa tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df" status: 200 len: 1316 microversion: 2.1 time: 0.859151 Aug 04 17:07:16.100924 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1478/3030] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:15 2022] GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df => generated 1316 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:16.252123 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-480fad8f-d91f-4d32-9804-9f80ecf71c7b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:16.252767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-480fad8f-d91f-4d32-9804-9f80ecf71c7b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:16.266530 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-480fad8f-d91f-4d32-9804-9f80ecf71c7b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:16.267226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-480fad8f-d91f-4d32-9804-9f80ecf71c7b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:16.268403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-480fad8f-d91f-4d32-9804-9f80ecf71c7b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:16.271689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-480fad8f-d91f-4d32-9804-9f80ecf71c7b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:16.272466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-480fad8f-d91f-4d32-9804-9f80ecf71c7b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:16.273072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-480fad8f-d91f-4d32-9804-9f80ecf71c7b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:16.574672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-480fad8f-d91f-4d32-9804-9f80ecf71c7b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:16.584670 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-480fad8f-d91f-4d32-9804-9f80ecf71c7b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1317 microversion: 2.1 time: 0.333603 Aug 04 17:07:16.585642 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1553/3031] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:16 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1317 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:16.834146 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a5c45884-c8d7-4c44-9c95-c837ea09753b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:16.834763 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a5c45884-c8d7-4c44-9c95-c837ea09753b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:16.842097 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5c45884-c8d7-4c44-9c95-c837ea09753b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:16.843133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5c45884-c8d7-4c44-9c95-c837ea09753b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:16.843727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5c45884-c8d7-4c44-9c95-c837ea09753b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:16.844595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5c45884-c8d7-4c44-9c95-c837ea09753b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:16.845604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5c45884-c8d7-4c44-9c95-c837ea09753b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:16.846593 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5c45884-c8d7-4c44-9c95-c837ea09753b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:17.121065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-61e2eb3d-d3bb-4d19-8621-4d2efa8447f8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:17.122916 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-61e2eb3d-d3bb-4d19-8621-4d2efa8447f8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 373884d2-2103-48cb-aac8-e46d2671a6df] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:17.133528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61e2eb3d-d3bb-4d19-8621-4d2efa8447f8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:17.136512 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61e2eb3d-d3bb-4d19-8621-4d2efa8447f8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:17.137349 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61e2eb3d-d3bb-4d19-8621-4d2efa8447f8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:17.139346 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61e2eb3d-d3bb-4d19-8621-4d2efa8447f8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:17.141488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61e2eb3d-d3bb-4d19-8621-4d2efa8447f8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:17.142056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61e2eb3d-d3bb-4d19-8621-4d2efa8447f8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:17.283459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a5c45884-c8d7-4c44-9c95-c837ea09753b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:17.291365 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a5c45884-c8d7-4c44-9c95-c837ea09753b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1504 microversion: 2.1 time: 0.461236 Aug 04 17:07:17.297867 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1479/3032] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:16 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1504 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:17.494023 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8186f6a4-cdad-4388-a972-7b95a2cc9ad8 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-296144992", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "35f451cf-a1f1-477c-bffa-15168bac5288"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:17.565900 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-8186f6a4-cdad-4388-a972-7b95a2cc9ad8 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] validate_networks() for [('35f451cf-a1f1-477c-bffa-15168bac5288', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:07:17.700548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-61e2eb3d-d3bb-4d19-8621-4d2efa8447f8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:17.712360 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-61e2eb3d-d3bb-4d19-8621-4d2efa8447f8 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df" status: 200 len: 1316 microversion: 2.1 time: 0.595419 Aug 04 17:07:17.735493 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1554/3033] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:17 2022] GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df => generated 1316 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:17.750355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2fae8932-cd32-45a8-b1cc-8b35cca62a91 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:17.753823 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2fae8932-cd32-45a8-b1cc-8b35cca62a91 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:17.771856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2fae8932-cd32-45a8-b1cc-8b35cca62a91 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:17.774796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2fae8932-cd32-45a8-b1cc-8b35cca62a91 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:17.776776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2fae8932-cd32-45a8-b1cc-8b35cca62a91 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:17.779882 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2fae8932-cd32-45a8-b1cc-8b35cca62a91 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:17.780656 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2fae8932-cd32-45a8-b1cc-8b35cca62a91 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:17.781396 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2fae8932-cd32-45a8-b1cc-8b35cca62a91 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:18.213805 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2fae8932-cd32-45a8-b1cc-8b35cca62a91 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:18.222157 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2fae8932-cd32-45a8-b1cc-8b35cca62a91 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1317 microversion: 2.1 time: 0.494796 Aug 04 17:07:18.222750 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1555/3034] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:17 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1317 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:18.322922 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-21ba3ba4-54ce-45a5-a9d6-51556737d652 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:18.323546 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-21ba3ba4-54ce-45a5-a9d6-51556737d652 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:18.338013 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-21ba3ba4-54ce-45a5-a9d6-51556737d652 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:18.338506 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-21ba3ba4-54ce-45a5-a9d6-51556737d652 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:18.338956 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-21ba3ba4-54ce-45a5-a9d6-51556737d652 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:18.339681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-21ba3ba4-54ce-45a5-a9d6-51556737d652 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:18.340210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-21ba3ba4-54ce-45a5-a9d6-51556737d652 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:18.340652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-21ba3ba4-54ce-45a5-a9d6-51556737d652 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:18.836016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8186f6a4-cdad-4388-a972-7b95a2cc9ad8 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:07:18.836425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8186f6a4-cdad-4388-a972-7b95a2cc9ad8 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:07:18.836908 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8186f6a4-cdad-4388-a972-7b95a2cc9ad8 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:07:18.837322 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8186f6a4-cdad-4388-a972-7b95a2cc9ad8 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:07:18.837737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8186f6a4-cdad-4388-a972-7b95a2cc9ad8 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:07:18.852772 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8186f6a4-cdad-4388-a972-7b95a2cc9ad8 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:18.853267 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8186f6a4-cdad-4388-a972-7b95a2cc9ad8 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:18.853713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8186f6a4-cdad-4388-a972-7b95a2cc9ad8 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:18.854491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8186f6a4-cdad-4388-a972-7b95a2cc9ad8 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:18.854949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8186f6a4-cdad-4388-a972-7b95a2cc9ad8 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:18.855379 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8186f6a4-cdad-4388-a972-7b95a2cc9ad8 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:18.898260 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8186f6a4-cdad-4388-a972-7b95a2cc9ad8 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Getting quotas for project 0057b5901fc44b1eae04780a4813c6e0. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:07:18.914316 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8186f6a4-cdad-4388-a972-7b95a2cc9ad8 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Getting quotas for user d27a023a55a348a8bfc02c2818cd0901 and project 0057b5901fc44b1eae04780a4813c6e0. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:07:18.949849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8186f6a4-cdad-4388-a972-7b95a2cc9ad8 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:07:18.949849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8186f6a4-cdad-4388-a972-7b95a2cc9ad8 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] [instance: 67c9cf90-8220-45c0-a580-d027e81e558b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:07:19.042661 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8186f6a4-cdad-4388-a972-7b95a2cc9ad8 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.721916 Aug 04 17:07:19.049434 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1480/3035] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:07:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:07:19.049434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-68b0b168-861a-4f4d-b99b-525be5a1630a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:19.049434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-68b0b168-861a-4f4d-b99b-525be5a1630a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 373884d2-2103-48cb-aac8-e46d2671a6df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:19.056271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68b0b168-861a-4f4d-b99b-525be5a1630a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:19.057081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68b0b168-861a-4f4d-b99b-525be5a1630a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:19.057755 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68b0b168-861a-4f4d-b99b-525be5a1630a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:19.059862 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68b0b168-861a-4f4d-b99b-525be5a1630a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:19.060793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68b0b168-861a-4f4d-b99b-525be5a1630a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:19.061591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68b0b168-861a-4f4d-b99b-525be5a1630a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:19.116018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-21ba3ba4-54ce-45a5-a9d6-51556737d652 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:19.128410 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-21ba3ba4-54ce-45a5-a9d6-51556737d652 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1504 microversion: 2.1 time: 0.809312 Aug 04 17:07:19.129331 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1556/3036] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:18 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1504 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:19.134621 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cc303d55-f175-4963-827f-1235be5f70e6 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:19.135382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cc303d55-f175-4963-827f-1235be5f70e6 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] [instance: 67c9cf90-8220-45c0-a580-d027e81e558b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:19.314215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cc303d55-f175-4963-827f-1235be5f70e6 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a023a55a348a8bfc02c2818cd0901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0057b5901fc44b1eae04780a4813c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:19.328647 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cc303d55-f175-4963-827f-1235be5f70e6 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] 10.222.0.93 "GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b" status: 200 len: 1216 microversion: 2.1 time: 0.195876 Aug 04 17:07:19.342004 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1557/3037] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:19 2022] GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b => generated 1216 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:19.500435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1ee20106-c196-4171-be6c-30cfa09656d8 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Action: 'create', calling method: .version_select at 0x7f1e5aaee160>, body: {"keypair": {"name": "tempest-keypair-1853399408", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaO0iDhxB9AUZbIz1kptOrI5GSTPwomJibzGtcgeCtJS8OSOGDZRZ91uhtlbYLKRaAAD68fMA3uawaTwWZluxUJn8K2IgG7ISSV+i8Eg2CPafCV777SpbQMnR34H14Zcg=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:19.552194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-1ee20106-c196-4171-be6c-30cfa09656d8 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Getting quotas for project 1765b9e2226349c5a88f4bc75f8d1029. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:07:19.569080 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-1ee20106-c196-4171-be6c-30cfa09656d8 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Getting quotas for user 810ad146d8cc4192a3ae68c58ed84d2b and project 1765b9e2226349c5a88f4bc75f8d1029. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:07:19.578307 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-68b0b168-861a-4f4d-b99b-525be5a1630a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:19.586709 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-68b0b168-861a-4f4d-b99b-525be5a1630a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df" status: 200 len: 1316 microversion: 2.1 time: 0.541365 Aug 04 17:07:19.587317 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1481/3038] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:19 2022] GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df => generated 1316 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:19.613524 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-796d0666-cbab-4ef1-98da-4b8d806ab73f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:19.616610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-796d0666-cbab-4ef1-98da-4b8d806ab73f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:19.629375 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1ee20106-c196-4171-be6c-30cfa09656d8 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.294075 Aug 04 17:07:19.632843 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1558/3039] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:07:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:19.635119 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-796d0666-cbab-4ef1-98da-4b8d806ab73f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:19.635993 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-796d0666-cbab-4ef1-98da-4b8d806ab73f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:19.637556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-796d0666-cbab-4ef1-98da-4b8d806ab73f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:19.638773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-796d0666-cbab-4ef1-98da-4b8d806ab73f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:19.639270 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-796d0666-cbab-4ef1-98da-4b8d806ab73f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:19.639854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-796d0666-cbab-4ef1-98da-4b8d806ab73f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:20.157806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7b50c908-05f8-43c7-bbf2-a501363b8540 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:20.158832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7b50c908-05f8-43c7-bbf2-a501363b8540 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:20.205840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b50c908-05f8-43c7-bbf2-a501363b8540 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:20.208863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b50c908-05f8-43c7-bbf2-a501363b8540 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:20.216803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b50c908-05f8-43c7-bbf2-a501363b8540 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:20.221187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b50c908-05f8-43c7-bbf2-a501363b8540 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:20.224916 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b50c908-05f8-43c7-bbf2-a501363b8540 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:20.229615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b50c908-05f8-43c7-bbf2-a501363b8540 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:20.553824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-796d0666-cbab-4ef1-98da-4b8d806ab73f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:20.585960 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-796d0666-cbab-4ef1-98da-4b8d806ab73f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1317 microversion: 2.1 time: 0.982684 Aug 04 17:07:20.588294 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1482/3040] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:19 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1317 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:20.606579 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7b50c908-05f8-43c7-bbf2-a501363b8540 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:20.620961 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7b50c908-05f8-43c7-bbf2-a501363b8540 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1504 microversion: 2.1 time: 0.472324 Aug 04 17:07:20.622661 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1559/3041] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:20 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1504 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:20.629514 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f0aded9d-9164-42e4-b1b3-d7f5cdfe0e3a tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:20.637112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f0aded9d-9164-42e4-b1b3-d7f5cdfe0e3a tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] [instance: 67c9cf90-8220-45c0-a580-d027e81e558b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:20.649044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-ef8f44f5-74f2-4da2-bcf8-104d0d840f88 req-9505eac7-6e8b-4698-8773-8500fb1b706c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec6241cf-bde4-47ad-9e71-7a95f04844b2", "name": "network-vif-plugged", "status": "completed", "tag": "aa1e462a-c9ad-4a1c-a2c6-89bf4964520f"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:20.650871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f0aded9d-9164-42e4-b1b3-d7f5cdfe0e3a tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:20.651634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f0aded9d-9164-42e4-b1b3-d7f5cdfe0e3a tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:20.653204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f0aded9d-9164-42e4-b1b3-d7f5cdfe0e3a tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:20.654215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f0aded9d-9164-42e4-b1b3-d7f5cdfe0e3a tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:20.657125 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f0aded9d-9164-42e4-b1b3-d7f5cdfe0e3a tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:20.658084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f0aded9d-9164-42e4-b1b3-d7f5cdfe0e3a tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:20.674857 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ef8f44f5-74f2-4da2-bcf8-104d0d840f88 req-9505eac7-6e8b-4698-8773-8500fb1b706c service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:20.675854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ef8f44f5-74f2-4da2-bcf8-104d0d840f88 req-9505eac7-6e8b-4698-8773-8500fb1b706c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:20.676614 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ef8f44f5-74f2-4da2-bcf8-104d0d840f88 req-9505eac7-6e8b-4698-8773-8500fb1b706c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:20.696011 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-ef8f44f5-74f2-4da2-bcf8-104d0d840f88 req-9505eac7-6e8b-4698-8773-8500fb1b706c service nova] Creating event network-vif-plugged:aa1e462a-c9ad-4a1c-a2c6-89bf4964520f for instance ec6241cf-bde4-47ad-9e71-7a95f04844b2 on n-h2-851359-3 Aug 04 17:07:20.708421 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-ef8f44f5-74f2-4da2-bcf8-104d0d840f88 req-9505eac7-6e8b-4698-8773-8500fb1b706c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091234 Aug 04 17:07:20.709325 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1483/3042] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:20.719876 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3379fdfd-270a-4a1d-9610-848ab10cf70d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:20.721355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3379fdfd-270a-4a1d-9610-848ab10cf70d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 373884d2-2103-48cb-aac8-e46d2671a6df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:20.729797 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3379fdfd-270a-4a1d-9610-848ab10cf70d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:20.730547 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3379fdfd-270a-4a1d-9610-848ab10cf70d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:20.732294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3379fdfd-270a-4a1d-9610-848ab10cf70d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:20.733188 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3379fdfd-270a-4a1d-9610-848ab10cf70d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:20.733814 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3379fdfd-270a-4a1d-9610-848ab10cf70d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:20.738218 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3379fdfd-270a-4a1d-9610-848ab10cf70d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:20.916827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f0aded9d-9164-42e4-b1b3-d7f5cdfe0e3a tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a023a55a348a8bfc02c2818cd0901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0057b5901fc44b1eae04780a4813c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:20.928355 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f0aded9d-9164-42e4-b1b3-d7f5cdfe0e3a tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] 10.222.0.93 "GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b" status: 200 len: 1268 microversion: 2.1 time: 0.302536 Aug 04 17:07:20.934831 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1560/3043] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:20 2022] GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b => generated 1268 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:21.274003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3379fdfd-270a-4a1d-9610-848ab10cf70d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:21.286116 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3379fdfd-270a-4a1d-9610-848ab10cf70d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df" status: 200 len: 1316 microversion: 2.1 time: 0.571815 Aug 04 17:07:21.298478 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1484/3044] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:20 2022] GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df => generated 1316 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:21.608813 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7966b5ef-b839-4ca9-b1f9-4bf4a96ac28a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:21.609454 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7966b5ef-b839-4ca9-b1f9-4bf4a96ac28a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:21.619895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7966b5ef-b839-4ca9-b1f9-4bf4a96ac28a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:21.620510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7966b5ef-b839-4ca9-b1f9-4bf4a96ac28a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:21.621020 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7966b5ef-b839-4ca9-b1f9-4bf4a96ac28a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:21.622389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7966b5ef-b839-4ca9-b1f9-4bf4a96ac28a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:21.628800 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7966b5ef-b839-4ca9-b1f9-4bf4a96ac28a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:21.629361 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7966b5ef-b839-4ca9-b1f9-4bf4a96ac28a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:21.644627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-351bbcd0-b5e9-46f0-8c5c-a92de58f7b10 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:21.645880 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-351bbcd0-b5e9-46f0-8c5c-a92de58f7b10 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:21.659757 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-351bbcd0-b5e9-46f0-8c5c-a92de58f7b10 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:21.668966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-351bbcd0-b5e9-46f0-8c5c-a92de58f7b10 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:21.669719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-351bbcd0-b5e9-46f0-8c5c-a92de58f7b10 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:21.670675 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-351bbcd0-b5e9-46f0-8c5c-a92de58f7b10 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:21.671377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-351bbcd0-b5e9-46f0-8c5c-a92de58f7b10 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:21.672033 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-351bbcd0-b5e9-46f0-8c5c-a92de58f7b10 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:22.059996 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7966b5ef-b839-4ca9-b1f9-4bf4a96ac28a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:22.069362 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7966b5ef-b839-4ca9-b1f9-4bf4a96ac28a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1317 microversion: 2.1 time: 0.464368 Aug 04 17:07:22.070059 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1561/3045] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:21 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1317 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:22.090140 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-351bbcd0-b5e9-46f0-8c5c-a92de58f7b10 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:22.093696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-58388c12-b826-4daa-9833-8db3777807f3 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:22.094709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-58388c12-b826-4daa-9833-8db3777807f3 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] [instance: 67c9cf90-8220-45c0-a580-d027e81e558b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:22.099078 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-351bbcd0-b5e9-46f0-8c5c-a92de58f7b10 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1504 microversion: 2.1 time: 0.458268 Aug 04 17:07:22.103036 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1485/3046] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:21 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1504 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:22.112176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-58388c12-b826-4daa-9833-8db3777807f3 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:22.113766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-58388c12-b826-4daa-9833-8db3777807f3 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:22.116497 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-58388c12-b826-4daa-9833-8db3777807f3 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:22.117441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-58388c12-b826-4daa-9833-8db3777807f3 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:22.117917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-58388c12-b826-4daa-9833-8db3777807f3 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:22.118417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-58388c12-b826-4daa-9833-8db3777807f3 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:22.244720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-58388c12-b826-4daa-9833-8db3777807f3 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a023a55a348a8bfc02c2818cd0901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0057b5901fc44b1eae04780a4813c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:22.276000 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-58388c12-b826-4daa-9833-8db3777807f3 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] 10.222.0.93 "GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b" status: 200 len: 1274 microversion: 2.1 time: 0.190641 Aug 04 17:07:22.277212 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1562/3047] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:22 2022] GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b => generated 1274 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:22.315304 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0798964a-9104-4aea-83cd-96f98befb541 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:22.317284 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0798964a-9104-4aea-83cd-96f98befb541 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 373884d2-2103-48cb-aac8-e46d2671a6df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:22.343056 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0798964a-9104-4aea-83cd-96f98befb541 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:22.346379 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0798964a-9104-4aea-83cd-96f98befb541 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:22.347054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0798964a-9104-4aea-83cd-96f98befb541 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:22.349664 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0798964a-9104-4aea-83cd-96f98befb541 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:22.351680 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0798964a-9104-4aea-83cd-96f98befb541 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:22.353488 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0798964a-9104-4aea-83cd-96f98befb541 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:22.479744 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6a325d90-0668-45a3-be89-0457b5054541 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Action: 'create', calling method: .version_select at 0x7f1e5aac9280>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1192123186", "policies": ["affinity"]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:22.502964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:22.519450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-6a325d90-0668-45a3-be89-0457b5054541 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Getting quotas for project 3fe912cae63448eea70d0acb20320a05. Resources: {'server_groups'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:07:22.528880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-6a325d90-0668-45a3-be89-0457b5054541 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Getting quotas for user 42bb93640f644e73a4fce9b0682ce858 and project 3fe912cae63448eea70d0acb20320a05. Resources: {'server_groups'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:07:22.614746 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-6a325d90-0668-45a3-be89-0457b5054541 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Getting quotas for project 3fe912cae63448eea70d0acb20320a05. Resources: {'server_groups'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:07:22.620597 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0798964a-9104-4aea-83cd-96f98befb541 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:22.626987 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-6a325d90-0668-45a3-be89-0457b5054541 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Getting quotas for user 42bb93640f644e73a4fce9b0682ce858 and project 3fe912cae63448eea70d0acb20320a05. Resources: {'server_groups'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:07:22.630562 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0798964a-9104-4aea-83cd-96f98befb541 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df" status: 200 len: 1316 microversion: 2.1 time: 0.322126 Aug 04 17:07:22.631715 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1486/3048] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:22 2022] GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df => generated 1316 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:22.650518 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6a325d90-0668-45a3-be89-0457b5054541 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.272523 Aug 04 17:07:22.657811 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1563/3049] 10.222.0.93 () {60 vars in 1174 bytes} [Thu Aug 4 17:07:22 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:22.666644 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-766b58e5-bb98-4658-b695-0fa131f39cfa tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Action: 'create', calling method: .version_select at 0x7f1e5ac61040>, body: {"server_group": {"name": "tempest-server-group-1936633847", "policies": ["affinity"]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:22.691912 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-766b58e5-bb98-4658-b695-0fa131f39cfa tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Getting quotas for project 3fe912cae63448eea70d0acb20320a05. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:07:22.712549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-766b58e5-bb98-4658-b695-0fa131f39cfa tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Getting quotas for user 42bb93640f644e73a4fce9b0682ce858 and project 3fe912cae63448eea70d0acb20320a05. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:07:22.758806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f5d1fc86-7145-49fb-9d24-b85fe74445b6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-248508875", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8402fb52-79f8-43d0-ac17-929a052b62e0"}], "security_groups": [{"name": "tempest-securitygroup--1972862383"}], "key_name": "tempest-keypair-1853399408", "user_data": "}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:22.807204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-766b58e5-bb98-4658-b695-0fa131f39cfa tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Getting quotas for project 3fe912cae63448eea70d0acb20320a05. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:07:22.814636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-766b58e5-bb98-4658-b695-0fa131f39cfa tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Getting quotas for user 42bb93640f644e73a4fce9b0682ce858 and project 3fe912cae63448eea70d0acb20320a05. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:07:22.837953 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-766b58e5-bb98-4658-b695-0fa131f39cfa tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.170145 Aug 04 17:07:22.838977 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1487/3050] 10.222.0.93 () {60 vars in 1173 bytes} [Thu Aug 4 17:07:22 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:22.853113 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-422ebb4b-d79a-4b6a-99a3-78d08d5235d2 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Action: 'create', calling method: .version_select at 0x7f1e5ac76310>, body: {"server_group": {"name": "tempest-server-group-1936633847", "policies": ["affinity"]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:22.888087 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-422ebb4b-d79a-4b6a-99a3-78d08d5235d2 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Getting quotas for project 3fe912cae63448eea70d0acb20320a05. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:07:22.899984 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-422ebb4b-d79a-4b6a-99a3-78d08d5235d2 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Getting quotas for user 42bb93640f644e73a4fce9b0682ce858 and project 3fe912cae63448eea70d0acb20320a05. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:07:22.947510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-f5d1fc86-7145-49fb-9d24-b85fe74445b6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] validate_networks() for [('8402fb52-79f8-43d0-ac17-929a052b62e0', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:07:23.001212 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-422ebb4b-d79a-4b6a-99a3-78d08d5235d2 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Getting quotas for project 3fe912cae63448eea70d0acb20320a05. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:07:23.006699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-422ebb4b-d79a-4b6a-99a3-78d08d5235d2 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Getting quotas for user 42bb93640f644e73a4fce9b0682ce858 and project 3fe912cae63448eea70d0acb20320a05. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:07:23.021838 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-422ebb4b-d79a-4b6a-99a3-78d08d5235d2 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.173032 Aug 04 17:07:23.028964 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1488/3051] 10.222.0.93 () {60 vars in 1173 bytes} [Thu Aug 4 17:07:22 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:23.034942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c5be235d-c816-4937-b0f6-a8758d724573 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:23.076922 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c5be235d-c816-4937-b0f6-a8758d724573 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/af1e0972-ad40-4eff-a7d5-91d4f211d043" status: 204 len: 0 microversion: 2.1 time: 0.046413 Aug 04 17:07:23.078132 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1489/3052] 10.222.0.93 () {58 vars in 1266 bytes} [Thu Aug 4 17:07:23 2022] DELETE /compute/v2.1/os-server-groups/af1e0972-ad40-4eff-a7d5-91d4f211d043 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:07:23.090675 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cdfe6c63-a874-454c-9170-0b63187f0e40 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:23.127920 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cdfe6c63-a874-454c-9170-0b63187f0e40 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.046272 Aug 04 17:07:23.128970 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1490/3053] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Aug 4 17:07:23 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:23.133910 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-910c54a0-ee14-4e0f-853a-b22375c995ba tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:23.135035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-910c54a0-ee14-4e0f-853a-b22375c995ba tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:23.138587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:23.148637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-910c54a0-ee14-4e0f-853a-b22375c995ba tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:23.149561 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-910c54a0-ee14-4e0f-853a-b22375c995ba tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:23.150477 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-910c54a0-ee14-4e0f-853a-b22375c995ba tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:23.151440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-910c54a0-ee14-4e0f-853a-b22375c995ba tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:23.152133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-910c54a0-ee14-4e0f-853a-b22375c995ba tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:23.153363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-910c54a0-ee14-4e0f-853a-b22375c995ba tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:23.518677 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-910c54a0-ee14-4e0f-853a-b22375c995ba tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:23.532264 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-910c54a0-ee14-4e0f-853a-b22375c995ba tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1317 microversion: 2.1 time: 0.402043 Aug 04 17:07:23.549850 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1491/3054] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:23 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:23.559178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ec411fa7-173d-44b2-82fc-7b4bab80ad3e tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:23.564875 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ec411fa7-173d-44b2-82fc-7b4bab80ad3e tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:23.581027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec411fa7-173d-44b2-82fc-7b4bab80ad3e tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:23.581666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec411fa7-173d-44b2-82fc-7b4bab80ad3e tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:23.582194 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec411fa7-173d-44b2-82fc-7b4bab80ad3e tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:23.583167 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec411fa7-173d-44b2-82fc-7b4bab80ad3e tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:23.585123 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec411fa7-173d-44b2-82fc-7b4bab80ad3e tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:23.585784 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec411fa7-173d-44b2-82fc-7b4bab80ad3e tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:23.644820 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-f5d1fc86-7145-49fb-9d24-b85fe74445b6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:07:23.645360 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-f5d1fc86-7145-49fb-9d24-b85fe74445b6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:07:23.647865 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-f5d1fc86-7145-49fb-9d24-b85fe74445b6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:07:23.647865 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-f5d1fc86-7145-49fb-9d24-b85fe74445b6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:07:23.648483 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-f5d1fc86-7145-49fb-9d24-b85fe74445b6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:07:23.667400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5d1fc86-7145-49fb-9d24-b85fe74445b6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:23.670653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5d1fc86-7145-49fb-9d24-b85fe74445b6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:23.671283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5d1fc86-7145-49fb-9d24-b85fe74445b6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:23.672116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5d1fc86-7145-49fb-9d24-b85fe74445b6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:23.672601 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5d1fc86-7145-49fb-9d24-b85fe74445b6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:23.673044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5d1fc86-7145-49fb-9d24-b85fe74445b6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:23.706087 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-f5d1fc86-7145-49fb-9d24-b85fe74445b6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Getting quotas for project 1765b9e2226349c5a88f4bc75f8d1029. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:07:23.713187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-f5d1fc86-7145-49fb-9d24-b85fe74445b6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Getting quotas for user 810ad146d8cc4192a3ae68c58ed84d2b and project 1765b9e2226349c5a88f4bc75f8d1029. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:07:23.732055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f5d1fc86-7145-49fb-9d24-b85fe74445b6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:07:23.734530 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f5d1fc86-7145-49fb-9d24-b85fe74445b6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:07:23.790137 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ec411fa7-173d-44b2-82fc-7b4bab80ad3e tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:23.795772 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f5d1fc86-7145-49fb-9d24-b85fe74445b6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.041810 Aug 04 17:07:23.796970 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1564/3055] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:07:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:07:23.816369 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ec411fa7-173d-44b2-82fc-7b4bab80ad3e tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1504 microversion: 2.1 time: 0.255822 Aug 04 17:07:23.817747 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1492/3056] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:23 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1504 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:23.830427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-76c5e33b-7823-4b15-9101-83c370b4dbaa tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:23.833133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3b199fa1-d09d-407f-87fb-0dde26e95cf3 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:23.833278 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3b199fa1-d09d-407f-87fb-0dde26e95cf3 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] [instance: 67c9cf90-8220-45c0-a580-d027e81e558b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:23.848031 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b199fa1-d09d-407f-87fb-0dde26e95cf3 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:23.848420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b199fa1-d09d-407f-87fb-0dde26e95cf3 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:23.848797 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b199fa1-d09d-407f-87fb-0dde26e95cf3 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:23.850521 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b199fa1-d09d-407f-87fb-0dde26e95cf3 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:23.850996 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b199fa1-d09d-407f-87fb-0dde26e95cf3 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:23.851440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b199fa1-d09d-407f-87fb-0dde26e95cf3 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:23.876406 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-76c5e33b-7823-4b15-9101-83c370b4dbaa tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/840518dd-3352-48a7-9737-944ba5dc3e98" status: 204 len: 0 microversion: 2.1 time: 0.077225 Aug 04 17:07:23.877733 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1565/3057] 10.222.0.93 () {58 vars in 1266 bytes} [Thu Aug 4 17:07:23 2022] DELETE /compute/v2.1/os-server-groups/840518dd-3352-48a7-9737-944ba5dc3e98 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:07:23.884080 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2849adaf-bcf4-4542-adc4-7f2adc98acc1 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:23.885060 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2849adaf-bcf4-4542-adc4-7f2adc98acc1 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 373884d2-2103-48cb-aac8-e46d2671a6df] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:23.894831 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2849adaf-bcf4-4542-adc4-7f2adc98acc1 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:23.895709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2849adaf-bcf4-4542-adc4-7f2adc98acc1 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:23.896417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2849adaf-bcf4-4542-adc4-7f2adc98acc1 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:23.897493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2849adaf-bcf4-4542-adc4-7f2adc98acc1 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:23.898269 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2849adaf-bcf4-4542-adc4-7f2adc98acc1 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:23.899034 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2849adaf-bcf4-4542-adc4-7f2adc98acc1 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:24.135749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3b199fa1-d09d-407f-87fb-0dde26e95cf3 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a023a55a348a8bfc02c2818cd0901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0057b5901fc44b1eae04780a4813c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:24.149680 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3b199fa1-d09d-407f-87fb-0dde26e95cf3 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] 10.222.0.93 "GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b" status: 200 len: 1316 microversion: 2.1 time: 0.329341 Aug 04 17:07:24.151157 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1493/3058] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:23 2022] GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b => generated 1316 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:24.157498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-021f7e75-17fb-41ba-9f84-9b12b0b82577 req-2f4170a4-e2f7-4047-a65f-0be0deb74c07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67c9cf90-8220-45c0-a580-d027e81e558b", "tag": "305f293e-0747-4a76-9e1d-574caaefe1a2"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:24.169551 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-021f7e75-17fb-41ba-9f84-9b12b0b82577 req-2f4170a4-e2f7-4047-a65f-0be0deb74c07 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:24.170726 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-021f7e75-17fb-41ba-9f84-9b12b0b82577 req-2f4170a4-e2f7-4047-a65f-0be0deb74c07 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:24.171982 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-021f7e75-17fb-41ba-9f84-9b12b0b82577 req-2f4170a4-e2f7-4047-a65f-0be0deb74c07 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:24.173101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2849adaf-bcf4-4542-adc4-7f2adc98acc1 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:24.185009 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2849adaf-bcf4-4542-adc4-7f2adc98acc1 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df" status: 200 len: 1316 microversion: 2.1 time: 0.304260 Aug 04 17:07:24.187664 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1566/3059] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:23 2022] GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df => generated 1316 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:24.203622 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-edc22de2-9768-472b-878f-7d84e8cec0ac tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:24.204662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-edc22de2-9768-472b-878f-7d84e8cec0ac tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:24.223044 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-021f7e75-17fb-41ba-9f84-9b12b0b82577 req-2f4170a4-e2f7-4047-a65f-0be0deb74c07 service nova] Creating event network-changed:305f293e-0747-4a76-9e1d-574caaefe1a2 for instance 67c9cf90-8220-45c0-a580-d027e81e558b on n-h1-851359-3 Aug 04 17:07:24.235985 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-021f7e75-17fb-41ba-9f84-9b12b0b82577 req-2f4170a4-e2f7-4047-a65f-0be0deb74c07 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081075 Aug 04 17:07:24.236692 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1494/3060] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:24.249815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-422fc2c5-c958-45ca-913b-71e2b6f40806 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:24.271005 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-edc22de2-9768-472b-878f-7d84e8cec0ac tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:24.273006 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-422fc2c5-c958-45ca-913b-71e2b6f40806 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.032513 Aug 04 17:07:24.277010 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1495/3061] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Aug 4 17:07:24 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:24.285656 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-edc22de2-9768-472b-878f-7d84e8cec0ac tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1237 microversion: 2.1 time: 0.095005 Aug 04 17:07:24.286677 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1567/3062] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:24 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1237 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:24.292362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4e4ec4fe-0661-49f9-80b0-681284a101fc tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Action: 'create', calling method: .version_select at 0x7f1e5ac00af0>, body: {"server_group": {"name": "tempest-server-group-666986095", "policies": ["affinity"]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:24.343400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-4e4ec4fe-0661-49f9-80b0-681284a101fc tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Getting quotas for project 3fe912cae63448eea70d0acb20320a05. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:07:24.352030 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-4e4ec4fe-0661-49f9-80b0-681284a101fc tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Getting quotas for user 42bb93640f644e73a4fce9b0682ce858 and project 3fe912cae63448eea70d0acb20320a05. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:07:24.401402 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-4e4ec4fe-0661-49f9-80b0-681284a101fc tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Getting quotas for project 3fe912cae63448eea70d0acb20320a05. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:07:24.408093 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-4e4ec4fe-0661-49f9-80b0-681284a101fc tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Getting quotas for user 42bb93640f644e73a4fce9b0682ce858 and project 3fe912cae63448eea70d0acb20320a05. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:07:24.433068 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4e4ec4fe-0661-49f9-80b0-681284a101fc tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.148154 Aug 04 17:07:24.441226 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1496/3063] 10.222.0.93 () {60 vars in 1173 bytes} [Thu Aug 4 17:07:24 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:24.445747 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-166782b2-4ece-4ba3-842b-a605b08df4df tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:24.485457 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-166782b2-4ece-4ba3-842b-a605b08df4df tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/41bea93f-ec5a-4929-bcef-6cf8ac56964f" status: 204 len: 0 microversion: 2.1 time: 0.042364 Aug 04 17:07:24.489118 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1568/3064] 10.222.0.93 () {58 vars in 1266 bytes} [Thu Aug 4 17:07:24 2022] DELETE /compute/v2.1/os-server-groups/41bea93f-ec5a-4929-bcef-6cf8ac56964f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:07:24.494660 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0c23bb9e-272b-43dc-a3f8-22c2559f97b9 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:24.510047 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0c23bb9e-272b-43dc-a3f8-22c2559f97b9 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.019328 Aug 04 17:07:24.511221 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1497/3065] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Aug 4 17:07:24 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:24.526504 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ea815b51-2893-4872-a2fd-62275b05a308 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Action: 'create', calling method: .version_select at 0x7f1e5aae5670>, body: {"server_group": {"name": "tempest-server-group-1423718843", "policies": ["anti-affinity"]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:24.548718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-ea815b51-2893-4872-a2fd-62275b05a308 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Getting quotas for project 3fe912cae63448eea70d0acb20320a05. Resources: {'server_groups'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:07:24.560372 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-238a2d26-4166-410b-87fc-54f54a7d3682 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:24.561967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-238a2d26-4166-410b-87fc-54f54a7d3682 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:24.569885 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-238a2d26-4166-410b-87fc-54f54a7d3682 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:24.570776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-238a2d26-4166-410b-87fc-54f54a7d3682 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:24.571550 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-238a2d26-4166-410b-87fc-54f54a7d3682 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:24.572747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-238a2d26-4166-410b-87fc-54f54a7d3682 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:24.574050 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-238a2d26-4166-410b-87fc-54f54a7d3682 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:24.575780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-238a2d26-4166-410b-87fc-54f54a7d3682 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:24.580200 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-ea815b51-2893-4872-a2fd-62275b05a308 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Getting quotas for user 42bb93640f644e73a4fce9b0682ce858 and project 3fe912cae63448eea70d0acb20320a05. Resources: {'server_groups'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:07:24.678135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-ea815b51-2893-4872-a2fd-62275b05a308 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Getting quotas for project 3fe912cae63448eea70d0acb20320a05. Resources: {'server_groups'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:07:24.685230 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-ea815b51-2893-4872-a2fd-62275b05a308 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Getting quotas for user 42bb93640f644e73a4fce9b0682ce858 and project 3fe912cae63448eea70d0acb20320a05. Resources: {'server_groups'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:07:24.702617 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ea815b51-2893-4872-a2fd-62275b05a308 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.181439 Aug 04 17:07:24.704230 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1569/3066] 10.222.0.93 () {60 vars in 1173 bytes} [Thu Aug 4 17:07:24 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:24.710782 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-8166b25a-1f6b-40e5-983e-d0cd5667e54a req-33c1fe51-0d1b-44aa-ba1a-b0c7c2fceab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "373884d2-2103-48cb-aac8-e46d2671a6df", "name": "network-vif-plugged", "status": "completed", "tag": "909f4468-9b6b-4585-9aaf-9b43a020a453"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:24.726460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8166b25a-1f6b-40e5-983e-d0cd5667e54a req-33c1fe51-0d1b-44aa-ba1a-b0c7c2fceab4 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:24.728103 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8166b25a-1f6b-40e5-983e-d0cd5667e54a req-33c1fe51-0d1b-44aa-ba1a-b0c7c2fceab4 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:24.728777 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8166b25a-1f6b-40e5-983e-d0cd5667e54a req-33c1fe51-0d1b-44aa-ba1a-b0c7c2fceab4 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:24.743467 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-8166b25a-1f6b-40e5-983e-d0cd5667e54a req-33c1fe51-0d1b-44aa-ba1a-b0c7c2fceab4 service nova] Creating event network-vif-plugged:909f4468-9b6b-4585-9aaf-9b43a020a453 for instance 373884d2-2103-48cb-aac8-e46d2671a6df on n-h2-851359-3 Aug 04 17:07:24.750272 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-8166b25a-1f6b-40e5-983e-d0cd5667e54a req-33c1fe51-0d1b-44aa-ba1a-b0c7c2fceab4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044377 Aug 04 17:07:24.751325 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1570/3067] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:24.758521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a229b760-1ceb-41fe-889c-3c577fc71cd4 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:24.783348 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-238a2d26-4166-410b-87fc-54f54a7d3682 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:24.792087 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-238a2d26-4166-410b-87fc-54f54a7d3682 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1506 microversion: 2.1 time: 0.239364 Aug 04 17:07:24.793167 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1498/3068] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:24 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1506 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:24.796946 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a229b760-1ceb-41fe-889c-3c577fc71cd4 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/70cd7cd2-32f2-4c99-8148-bd26925978da" status: 204 len: 0 microversion: 2.1 time: 0.043980 Aug 04 17:07:24.797830 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1571/3069] 10.222.0.93 () {58 vars in 1266 bytes} [Thu Aug 4 17:07:24 2022] DELETE /compute/v2.1/os-server-groups/70cd7cd2-32f2-4c99-8148-bd26925978da => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:07:24.810827 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a9874343-37fe-44ca-9e7a-418c833c9d52 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:24.822917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9565e540-26d4-4ff2-8a04-856e21c3849a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:24.825608 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9565e540-26d4-4ff2-8a04-856e21c3849a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:24.837193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7,nova_api:DELETE=9 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:24.850370 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a9874343-37fe-44ca-9e7a-418c833c9d52 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.043138 Aug 04 17:07:24.855100 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1499/3070] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Aug 4 17:07:24 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:07:24.863201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5c0a3c14-9de5-4ed5-8b75-ada18882d26f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:24.863837 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5c0a3c14-9de5-4ed5-8b75-ada18882d26f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:24.866832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9565e540-26d4-4ff2-8a04-856e21c3849a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:24.867706 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9565e540-26d4-4ff2-8a04-856e21c3849a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:24.868204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9565e540-26d4-4ff2-8a04-856e21c3849a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:24.868889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9565e540-26d4-4ff2-8a04-856e21c3849a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:24.869362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9565e540-26d4-4ff2-8a04-856e21c3849a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:24.869802 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9565e540-26d4-4ff2-8a04-856e21c3849a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:24.889731 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c0a3c14-9de5-4ed5-8b75-ada18882d26f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:24.896079 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c0a3c14-9de5-4ed5-8b75-ada18882d26f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:24.896612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c0a3c14-9de5-4ed5-8b75-ada18882d26f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:24.897366 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c0a3c14-9de5-4ed5-8b75-ada18882d26f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:24.898521 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c0a3c14-9de5-4ed5-8b75-ada18882d26f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:24.899028 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c0a3c14-9de5-4ed5-8b75-ada18882d26f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:25.207200 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9565e540-26d4-4ff2-8a04-856e21c3849a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:25.223039 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9565e540-26d4-4ff2-8a04-856e21c3849a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1506 microversion: 2.1 time: 0.408530 Aug 04 17:07:25.235530 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1572/3071] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:24 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1506 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:25.246748 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3bf47480-d8d6-4d90-81a7-ce3b994982a9 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-378145595", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "e89fa35b-1b62-4677-86ab-bfa55fda01d9"}]}, "os:scheduler_hints": {"group": "925e83cd-9458-4892-994c-134d009d5324"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:25.255302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5c0a3c14-9de5-4ed5-8b75-ada18882d26f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:25.270189 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5c0a3c14-9de5-4ed5-8b75-ada18882d26f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1504 microversion: 2.1 time: 0.413081 Aug 04 17:07:25.272246 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1500/3072] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:24 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1504 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:25.292654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8f91ef1a-5cc7-43fd-9ae5-eeb2c6c5b79c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:25.293838 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8f91ef1a-5cc7-43fd-9ae5-eeb2c6c5b79c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] [instance: 67c9cf90-8220-45c0-a580-d027e81e558b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:25.302111 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f91ef1a-5cc7-43fd-9ae5-eeb2c6c5b79c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:25.303702 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f91ef1a-5cc7-43fd-9ae5-eeb2c6c5b79c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:25.303702 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f91ef1a-5cc7-43fd-9ae5-eeb2c6c5b79c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:25.304610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f91ef1a-5cc7-43fd-9ae5-eeb2c6c5b79c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:25.305143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f91ef1a-5cc7-43fd-9ae5-eeb2c6c5b79c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:25.305640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f91ef1a-5cc7-43fd-9ae5-eeb2c6c5b79c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:25.354849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-3bf47480-d8d6-4d90-81a7-ce3b994982a9 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] validate_networks() for [('e89fa35b-1b62-4677-86ab-bfa55fda01d9', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:07:25.570630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8f91ef1a-5cc7-43fd-9ae5-eeb2c6c5b79c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a023a55a348a8bfc02c2818cd0901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0057b5901fc44b1eae04780a4813c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:25.580589 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8f91ef1a-5cc7-43fd-9ae5-eeb2c6c5b79c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] 10.222.0.93 "GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b" status: 200 len: 1316 microversion: 2.1 time: 0.306723 Aug 04 17:07:25.583425 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1501/3073] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:25 2022] GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b => generated 1316 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:25.606528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1eeaccef-2870-4498-85f7-7e3ff93c9a53 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:25.607306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1eeaccef-2870-4498-85f7-7e3ff93c9a53 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 373884d2-2103-48cb-aac8-e46d2671a6df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:25.614102 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1eeaccef-2870-4498-85f7-7e3ff93c9a53 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:25.615036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1eeaccef-2870-4498-85f7-7e3ff93c9a53 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:25.615673 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1eeaccef-2870-4498-85f7-7e3ff93c9a53 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:25.616614 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1eeaccef-2870-4498-85f7-7e3ff93c9a53 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:25.617181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1eeaccef-2870-4498-85f7-7e3ff93c9a53 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:25.617839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1eeaccef-2870-4498-85f7-7e3ff93c9a53 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:25.857410 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1eeaccef-2870-4498-85f7-7e3ff93c9a53 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:25.867713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:25.873716 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1eeaccef-2870-4498-85f7-7e3ff93c9a53 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df" status: 200 len: 1316 microversion: 2.1 time: 0.287516 Aug 04 17:07:25.874164 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1502/3074] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:25 2022] GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df => generated 1316 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:25.881939 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7839e811-d05d-42bf-9108-5f8a20ae441d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "OS-DCF:diskConfig": "AUTO"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:25.884748 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7839e811-d05d-42bf-9108-5f8a20ae441d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:25.895598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7839e811-d05d-42bf-9108-5f8a20ae441d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:25.896196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7839e811-d05d-42bf-9108-5f8a20ae441d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:25.896741 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7839e811-d05d-42bf-9108-5f8a20ae441d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:25.897504 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7839e811-d05d-42bf-9108-5f8a20ae441d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:25.898051 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7839e811-d05d-42bf-9108-5f8a20ae441d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:25.898559 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7839e811-d05d-42bf-9108-5f8a20ae441d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:26.003496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-3bf47480-d8d6-4d90-81a7-ce3b994982a9 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:07:26.004628 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-3bf47480-d8d6-4d90-81a7-ce3b994982a9 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:07:26.005637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-3bf47480-d8d6-4d90-81a7-ce3b994982a9 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:07:26.006301 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-3bf47480-d8d6-4d90-81a7-ce3b994982a9 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:07:26.006915 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-3bf47480-d8d6-4d90-81a7-ce3b994982a9 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:07:26.022991 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7839e811-d05d-42bf-9108-5f8a20ae441d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:07:26.023561 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7839e811-d05d-42bf-9108-5f8a20ae441d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:07:26.024138 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7839e811-d05d-42bf-9108-5f8a20ae441d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:07:26.024619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7839e811-d05d-42bf-9108-5f8a20ae441d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:07:26.025116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7839e811-d05d-42bf-9108-5f8a20ae441d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:07:26.045381 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3bf47480-d8d6-4d90-81a7-ce3b994982a9 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:26.046268 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3bf47480-d8d6-4d90-81a7-ce3b994982a9 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:26.046932 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3bf47480-d8d6-4d90-81a7-ce3b994982a9 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:26.047920 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3bf47480-d8d6-4d90-81a7-ce3b994982a9 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:26.048623 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3bf47480-d8d6-4d90-81a7-ce3b994982a9 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:26.049827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3bf47480-d8d6-4d90-81a7-ce3b994982a9 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:26.081400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-3bf47480-d8d6-4d90-81a7-ce3b994982a9 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Getting quotas for project 3fe912cae63448eea70d0acb20320a05. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:07:26.088469 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-3bf47480-d8d6-4d90-81a7-ce3b994982a9 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Getting quotas for user 42bb93640f644e73a4fce9b0682ce858 and project 3fe912cae63448eea70d0acb20320a05. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:07:26.105337 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3bf47480-d8d6-4d90-81a7-ce3b994982a9 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:07:26.108531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3bf47480-d8d6-4d90-81a7-ce3b994982a9 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] [instance: a6f1bd19-8eaf-4799-b581-dd8b047e31b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:07:26.131778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7839e811-d05d-42bf-9108-5f8a20ae441d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:26.139246 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7839e811-d05d-42bf-9108-5f8a20ae441d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:26.139768 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7839e811-d05d-42bf-9108-5f8a20ae441d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:26.140212 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7839e811-d05d-42bf-9108-5f8a20ae441d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:26.141076 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7839e811-d05d-42bf-9108-5f8a20ae441d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:26.141618 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7839e811-d05d-42bf-9108-5f8a20ae441d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:26.142151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7839e811-d05d-42bf-9108-5f8a20ae441d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:26.168722 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-3bf47480-d8d6-4d90-81a7-ce3b994982a9 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Getting quotas for project 3fe912cae63448eea70d0acb20320a05. Resources: {'server_group_members'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:07:26.177885 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-3bf47480-d8d6-4d90-81a7-ce3b994982a9 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Getting quotas for user 42bb93640f644e73a4fce9b0682ce858 and project 3fe912cae63448eea70d0acb20320a05. Resources: {'server_group_members'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:07:26.191044 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7839e811-d05d-42bf-9108-5f8a20ae441d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "POST /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2/action" status: 202 len: 1108 microversion: 2.1 time: 0.313777 Aug 04 17:07:26.192113 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1503/3075] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:07:25 2022] POST /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2/action => generated 1108 bytes in 317 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 17:07:26.197898 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f8c2103b-5ba1-4946-b10d-bd11e7383e49 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:26.198723 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f8c2103b-5ba1-4946-b10d-bd11e7383e49 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:26.204998 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8c2103b-5ba1-4946-b10d-bd11e7383e49 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:26.205502 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8c2103b-5ba1-4946-b10d-bd11e7383e49 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:26.205945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8c2103b-5ba1-4946-b10d-bd11e7383e49 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:26.206980 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8c2103b-5ba1-4946-b10d-bd11e7383e49 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:26.207217 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8c2103b-5ba1-4946-b10d-bd11e7383e49 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:26.207650 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8c2103b-5ba1-4946-b10d-bd11e7383e49 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:26.241618 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-3bf47480-d8d6-4d90-81a7-ce3b994982a9 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Getting quotas for project 3fe912cae63448eea70d0acb20320a05. Resources: {'server_group_members'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:07:26.247844 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-3bf47480-d8d6-4d90-81a7-ce3b994982a9 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Getting quotas for user 42bb93640f644e73a4fce9b0682ce858 and project 3fe912cae63448eea70d0acb20320a05. Resources: {'server_group_members'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:07:26.279648 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3bf47480-d8d6-4d90-81a7-ce3b994982a9 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.043229 Aug 04 17:07:26.284444 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1573/3076] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:07:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:07:26.292083 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-583bcb27-46a1-4c1d-a4b7-cca5fc0beb6a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:26.292730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-583bcb27-46a1-4c1d-a4b7-cca5fc0beb6a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:26.293786 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f8c2103b-5ba1-4946-b10d-bd11e7383e49 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:26.303881 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f8c2103b-5ba1-4946-b10d-bd11e7383e49 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1297 microversion: 2.1 time: 0.110586 Aug 04 17:07:26.304744 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1504/3077] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:26 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1297 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:26.309732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-76783c9f-8c85-460c-a0a7-fbe3b786475c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:26.310494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-76783c9f-8c85-460c-a0a7-fbe3b786475c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:26.317028 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76783c9f-8c85-460c-a0a7-fbe3b786475c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:26.317843 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76783c9f-8c85-460c-a0a7-fbe3b786475c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:26.318525 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76783c9f-8c85-460c-a0a7-fbe3b786475c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:26.319503 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76783c9f-8c85-460c-a0a7-fbe3b786475c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:26.319888 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-583bcb27-46a1-4c1d-a4b7-cca5fc0beb6a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:26.320407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76783c9f-8c85-460c-a0a7-fbe3b786475c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:26.320550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-583bcb27-46a1-4c1d-a4b7-cca5fc0beb6a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:26.320852 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-583bcb27-46a1-4c1d-a4b7-cca5fc0beb6a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:26.321090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76783c9f-8c85-460c-a0a7-fbe3b786475c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:26.326076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-583bcb27-46a1-4c1d-a4b7-cca5fc0beb6a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:26.326803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-583bcb27-46a1-4c1d-a4b7-cca5fc0beb6a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:26.337176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-583bcb27-46a1-4c1d-a4b7-cca5fc0beb6a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:26.864872 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-583bcb27-46a1-4c1d-a4b7-cca5fc0beb6a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:26.873964 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-583bcb27-46a1-4c1d-a4b7-cca5fc0beb6a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1513 microversion: 2.1 time: 0.588143 Aug 04 17:07:26.882329 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-76783c9f-8c85-460c-a0a7-fbe3b786475c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:26.902844 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1574/3078] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:26 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1513 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:26.904311 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-76783c9f-8c85-460c-a0a7-fbe3b786475c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1504 microversion: 2.1 time: 0.598259 Aug 04 17:07:26.924197 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1505/3079] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:26 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1504 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:26.926883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5d8930b2-c622-432d-a490-a14323167ee9 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:26.929842 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5d8930b2-c622-432d-a490-a14323167ee9 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] [instance: a6f1bd19-8eaf-4799-b581-dd8b047e31b7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:26.932276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c2733e2f-9c6e-47be-84bc-e2a3a04d3ef8 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:26.932902 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c2733e2f-9c6e-47be-84bc-e2a3a04d3ef8 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] [instance: 67c9cf90-8220-45c0-a580-d027e81e558b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:26.949917 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2733e2f-9c6e-47be-84bc-e2a3a04d3ef8 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:26.950457 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2733e2f-9c6e-47be-84bc-e2a3a04d3ef8 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:26.950904 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2733e2f-9c6e-47be-84bc-e2a3a04d3ef8 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:26.951625 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2733e2f-9c6e-47be-84bc-e2a3a04d3ef8 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:26.952084 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2733e2f-9c6e-47be-84bc-e2a3a04d3ef8 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:26.952515 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2733e2f-9c6e-47be-84bc-e2a3a04d3ef8 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:27.034729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5d8930b2-c622-432d-a490-a14323167ee9 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bb93640f644e73a4fce9b0682ce858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe912cae63448eea70d0acb20320a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:27.048071 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5d8930b2-c622-432d-a490-a14323167ee9 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7" status: 200 len: 1212 microversion: 2.1 time: 0.132650 Aug 04 17:07:27.049197 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1575/3080] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:26 2022] GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7 => generated 1212 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:27.066921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-146859b5-8259-4442-b839-bd75ef1d47cb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:27.067885 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-146859b5-8259-4442-b839-bd75ef1d47cb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 373884d2-2103-48cb-aac8-e46d2671a6df] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:27.080674 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-146859b5-8259-4442-b839-bd75ef1d47cb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:27.081262 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-146859b5-8259-4442-b839-bd75ef1d47cb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:27.081777 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-146859b5-8259-4442-b839-bd75ef1d47cb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:27.083059 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-146859b5-8259-4442-b839-bd75ef1d47cb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:27.085076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-146859b5-8259-4442-b839-bd75ef1d47cb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:27.085858 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-146859b5-8259-4442-b839-bd75ef1d47cb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:27.205370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c2733e2f-9c6e-47be-84bc-e2a3a04d3ef8 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a023a55a348a8bfc02c2818cd0901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0057b5901fc44b1eae04780a4813c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:27.218569 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c2733e2f-9c6e-47be-84bc-e2a3a04d3ef8 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] 10.222.0.93 "GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b" status: 200 len: 1316 microversion: 2.1 time: 0.291089 Aug 04 17:07:27.220787 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1506/3081] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:26 2022] GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b => generated 1316 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:27.327961 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1364f5cc-9de9-4d29-877f-40c226cef393 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:27.328594 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1364f5cc-9de9-4d29-877f-40c226cef393 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:27.339545 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1364f5cc-9de9-4d29-877f-40c226cef393 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:27.340364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1364f5cc-9de9-4d29-877f-40c226cef393 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:27.341032 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1364f5cc-9de9-4d29-877f-40c226cef393 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:27.342295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1364f5cc-9de9-4d29-877f-40c226cef393 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:27.343941 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1364f5cc-9de9-4d29-877f-40c226cef393 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:27.344860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1364f5cc-9de9-4d29-877f-40c226cef393 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:27.452718 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1364f5cc-9de9-4d29-877f-40c226cef393 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:27.470324 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1364f5cc-9de9-4d29-877f-40c226cef393 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1295 microversion: 2.1 time: 0.147208 Aug 04 17:07:27.471479 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1507/3082] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:27 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1295 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:27.485064 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-146859b5-8259-4442-b839-bd75ef1d47cb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:27.501557 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-146859b5-8259-4442-b839-bd75ef1d47cb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df" status: 200 len: 1316 microversion: 2.1 time: 0.450863 Aug 04 17:07:27.515094 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1576/3083] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:27 2022] GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df => generated 1316 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:27.930184 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2db9e48d-2ca8-47b7-9064-e06e4d157d4a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:27.930721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2db9e48d-2ca8-47b7-9064-e06e4d157d4a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:27.936904 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1958d977-a0da-4ace-8a93-1dd2e650c666 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:27.938890 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1958d977-a0da-4ace-8a93-1dd2e650c666 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:27.949392 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2db9e48d-2ca8-47b7-9064-e06e4d157d4a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:27.953191 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1958d977-a0da-4ace-8a93-1dd2e650c666 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:27.954017 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2db9e48d-2ca8-47b7-9064-e06e4d157d4a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:27.954948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1958d977-a0da-4ace-8a93-1dd2e650c666 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:27.955421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2db9e48d-2ca8-47b7-9064-e06e4d157d4a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:27.955942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1958d977-a0da-4ace-8a93-1dd2e650c666 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:27.956863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2db9e48d-2ca8-47b7-9064-e06e4d157d4a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:27.957652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1958d977-a0da-4ace-8a93-1dd2e650c666 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:27.958227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2db9e48d-2ca8-47b7-9064-e06e4d157d4a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:27.958762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1958d977-a0da-4ace-8a93-1dd2e650c666 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:27.959247 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1958d977-a0da-4ace-8a93-1dd2e650c666 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:27.959697 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2db9e48d-2ca8-47b7-9064-e06e4d157d4a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:28.329169 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2db9e48d-2ca8-47b7-9064-e06e4d157d4a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:28.332073 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1958d977-a0da-4ace-8a93-1dd2e650c666 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:28.341320 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:28.343030 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1958d977-a0da-4ace-8a93-1dd2e650c666 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1513 microversion: 2.1 time: 0.420693 Aug 04 17:07:28.343999 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1508/3084] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:27 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1513 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:28.346452 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2db9e48d-2ca8-47b7-9064-e06e4d157d4a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1504 microversion: 2.1 time: 0.420281 Aug 04 17:07:28.348801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-46266064-387b-4430-ba55-3724a406771b tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:28.350731 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-46266064-387b-4430-ba55-3724a406771b tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] [instance: a6f1bd19-8eaf-4799-b581-dd8b047e31b7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:28.357841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46266064-387b-4430-ba55-3724a406771b tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:28.358588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46266064-387b-4430-ba55-3724a406771b tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:28.362120 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46266064-387b-4430-ba55-3724a406771b tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:28.363051 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46266064-387b-4430-ba55-3724a406771b tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:28.363671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46266064-387b-4430-ba55-3724a406771b tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:28.364116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46266064-387b-4430-ba55-3724a406771b tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:28.367274 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1577/3085] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:27 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1504 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:28.374469 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a50c084f-e78b-40bb-8bbf-cf013b6ecc3b tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:28.375655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a50c084f-e78b-40bb-8bbf-cf013b6ecc3b tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] [instance: 67c9cf90-8220-45c0-a580-d027e81e558b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:28.384904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a50c084f-e78b-40bb-8bbf-cf013b6ecc3b tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:28.385817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a50c084f-e78b-40bb-8bbf-cf013b6ecc3b tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:28.386867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a50c084f-e78b-40bb-8bbf-cf013b6ecc3b tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:28.388551 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a50c084f-e78b-40bb-8bbf-cf013b6ecc3b tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:28.389240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a50c084f-e78b-40bb-8bbf-cf013b6ecc3b tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:28.389823 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a50c084f-e78b-40bb-8bbf-cf013b6ecc3b tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:28.540069 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-46266064-387b-4430-ba55-3724a406771b tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bb93640f644e73a4fce9b0682ce858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe912cae63448eea70d0acb20320a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:28.554641 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-46266064-387b-4430-ba55-3724a406771b tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7" status: 200 len: 1264 microversion: 2.1 time: 0.209412 Aug 04 17:07:28.565999 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1509/3086] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:28 2022] GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7 => generated 1264 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:28.565999 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d1f5dbb8-7563-44db-ab83-265ae52ca510 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:28.571027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d1f5dbb8-7563-44db-ab83-265ae52ca510 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:28.578651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1f5dbb8-7563-44db-ab83-265ae52ca510 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:28.579869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1f5dbb8-7563-44db-ab83-265ae52ca510 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:28.580506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1f5dbb8-7563-44db-ab83-265ae52ca510 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:28.581603 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1f5dbb8-7563-44db-ab83-265ae52ca510 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:28.582262 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1f5dbb8-7563-44db-ab83-265ae52ca510 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:28.582881 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1f5dbb8-7563-44db-ab83-265ae52ca510 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:28.795787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a50c084f-e78b-40bb-8bbf-cf013b6ecc3b tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a023a55a348a8bfc02c2818cd0901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0057b5901fc44b1eae04780a4813c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:28.803991 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a50c084f-e78b-40bb-8bbf-cf013b6ecc3b tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] 10.222.0.93 "GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b" status: 200 len: 1316 microversion: 2.1 time: 0.435373 Aug 04 17:07:28.804936 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1578/3087] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:28 2022] GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b => generated 1316 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:28.810683 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9004ddf0-ee23-44da-9452-725e766bb167 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:28.811306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9004ddf0-ee23-44da-9452-725e766bb167 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 373884d2-2103-48cb-aac8-e46d2671a6df] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:28.817948 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9004ddf0-ee23-44da-9452-725e766bb167 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:28.818660 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9004ddf0-ee23-44da-9452-725e766bb167 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:28.819279 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9004ddf0-ee23-44da-9452-725e766bb167 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:28.820149 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9004ddf0-ee23-44da-9452-725e766bb167 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:28.820764 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9004ddf0-ee23-44da-9452-725e766bb167 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:28.821362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9004ddf0-ee23-44da-9452-725e766bb167 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:28.875771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:29.014193 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d1f5dbb8-7563-44db-ab83-265ae52ca510 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:29.033904 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d1f5dbb8-7563-44db-ab83-265ae52ca510 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1363 microversion: 2.1 time: 0.476881 Aug 04 17:07:29.048599 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1510/3088] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:28 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1363 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:29.086676 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9004ddf0-ee23-44da-9452-725e766bb167 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:29.096139 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9004ddf0-ee23-44da-9452-725e766bb167 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df" status: 200 len: 1464 microversion: 2.1 time: 0.290019 Aug 04 17:07:29.097075 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1579/3089] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:28 2022] GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df => generated 1464 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:29.115842 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6316a61f-1afc-4a42-aadf-9efb1b25b510 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:29.116649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6316a61f-1afc-4a42-aadf-9efb1b25b510 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] [instance: 373884d2-2103-48cb-aac8-e46d2671a6df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:29.124561 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6316a61f-1afc-4a42-aadf-9efb1b25b510 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:29.125663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6316a61f-1afc-4a42-aadf-9efb1b25b510 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:29.126143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6316a61f-1afc-4a42-aadf-9efb1b25b510 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:29.126869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6316a61f-1afc-4a42-aadf-9efb1b25b510 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:29.127338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6316a61f-1afc-4a42-aadf-9efb1b25b510 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:29.127774 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6316a61f-1afc-4a42-aadf-9efb1b25b510 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:29.364735 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1f3fa2d9-3a82-45bd-a916-14a94685493b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:29.365369 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1f3fa2d9-3a82-45bd-a916-14a94685493b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:29.377076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f3fa2d9-3a82-45bd-a916-14a94685493b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:29.379636 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f3fa2d9-3a82-45bd-a916-14a94685493b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:29.380383 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f3fa2d9-3a82-45bd-a916-14a94685493b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:29.381416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f3fa2d9-3a82-45bd-a916-14a94685493b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:29.382282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f3fa2d9-3a82-45bd-a916-14a94685493b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:29.383742 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f3fa2d9-3a82-45bd-a916-14a94685493b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:29.396003 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6316a61f-1afc-4a42-aadf-9efb1b25b510 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df" status: 200 len: 1615 microversion: 2.1 time: 0.283099 Aug 04 17:07:29.411204 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1511/3090] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:29 2022] GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df => generated 1615 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:29.440605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9b923287-e623-4291-b4ff-1ce9316bfcb2 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:29.444005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9b923287-e623-4291-b4ff-1ce9316bfcb2 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:29.452524 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b923287-e623-4291-b4ff-1ce9316bfcb2 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:29.453328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b923287-e623-4291-b4ff-1ce9316bfcb2 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:29.454008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b923287-e623-4291-b4ff-1ce9316bfcb2 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:29.454893 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b923287-e623-4291-b4ff-1ce9316bfcb2 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:29.455516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b923287-e623-4291-b4ff-1ce9316bfcb2 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:29.458185 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b923287-e623-4291-b4ff-1ce9316bfcb2 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:29.857474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1f3fa2d9-3a82-45bd-a916-14a94685493b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:29.867348 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1f3fa2d9-3a82-45bd-a916-14a94685493b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1513 microversion: 2.1 time: 0.506373 Aug 04 17:07:29.868865 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1580/3091] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:29 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1513 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:29.869349 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9b923287-e623-4291-b4ff-1ce9316bfcb2 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:29.880194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4e631ef8-cf53-449b-ae9a-295516f0d40a tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:29.881869 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4e631ef8-cf53-449b-ae9a-295516f0d40a tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] [instance: a6f1bd19-8eaf-4799-b581-dd8b047e31b7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:29.884409 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9b923287-e623-4291-b4ff-1ce9316bfcb2 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1504 microversion: 2.1 time: 0.470924 Aug 04 17:07:29.885050 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1512/3092] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:29 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1504 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:29.893725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e631ef8-cf53-449b-ae9a-295516f0d40a tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:29.894311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e631ef8-cf53-449b-ae9a-295516f0d40a tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:29.895478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e631ef8-cf53-449b-ae9a-295516f0d40a tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:29.902829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e631ef8-cf53-449b-ae9a-295516f0d40a tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:29.903447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e631ef8-cf53-449b-ae9a-295516f0d40a tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:29.903805 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e631ef8-cf53-449b-ae9a-295516f0d40a tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:29.912879 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8becf3c0-1c38-4da1-946a-556911ad26e3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-595244292", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "42dff36d-2301-4c8c-b3a5-1dd535cf9664"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:29.984854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-8becf3c0-1c38-4da1-946a-556911ad26e3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:07:30.615275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4e631ef8-cf53-449b-ae9a-295516f0d40a tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bb93640f644e73a4fce9b0682ce858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe912cae63448eea70d0acb20320a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:30.624986 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4e631ef8-cf53-449b-ae9a-295516f0d40a tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7" status: 200 len: 1312 microversion: 2.1 time: 0.754081 Aug 04 17:07:30.625831 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1581/3093] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:29 2022] GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7 => generated 1312 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:30.630598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1cc1fe14-4d59-463c-8970-259c3b8fe63e tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:30.631494 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1cc1fe14-4d59-463c-8970-259c3b8fe63e tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] [instance: 67c9cf90-8220-45c0-a580-d027e81e558b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:30.639055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1cc1fe14-4d59-463c-8970-259c3b8fe63e tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:30.639661 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1cc1fe14-4d59-463c-8970-259c3b8fe63e tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:30.640218 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1cc1fe14-4d59-463c-8970-259c3b8fe63e tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:30.641035 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1cc1fe14-4d59-463c-8970-259c3b8fe63e tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:30.641605 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1cc1fe14-4d59-463c-8970-259c3b8fe63e tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:30.642309 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1cc1fe14-4d59-463c-8970-259c3b8fe63e tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:30.866404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8becf3c0-1c38-4da1-946a-556911ad26e3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:07:30.867415 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8becf3c0-1c38-4da1-946a-556911ad26e3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:07:30.868124 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8becf3c0-1c38-4da1-946a-556911ad26e3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:07:30.868756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8becf3c0-1c38-4da1-946a-556911ad26e3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:07:30.869281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8becf3c0-1c38-4da1-946a-556911ad26e3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:07:30.888736 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8becf3c0-1c38-4da1-946a-556911ad26e3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:30.889705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8becf3c0-1c38-4da1-946a-556911ad26e3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:30.890820 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8becf3c0-1c38-4da1-946a-556911ad26e3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:30.892058 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8becf3c0-1c38-4da1-946a-556911ad26e3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:30.892904 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8becf3c0-1c38-4da1-946a-556911ad26e3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:30.894354 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8becf3c0-1c38-4da1-946a-556911ad26e3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:30.917785 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8becf3c0-1c38-4da1-946a-556911ad26e3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for project de328615cef94528b55b8309dd9b82b0. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:07:30.921759 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1cc1fe14-4d59-463c-8970-259c3b8fe63e tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a023a55a348a8bfc02c2818cd0901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0057b5901fc44b1eae04780a4813c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:30.923666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8becf3c0-1c38-4da1-946a-556911ad26e3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Getting quotas for user abad886e45bd4c4b8f5f0f86c45eb068 and project de328615cef94528b55b8309dd9b82b0. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:07:30.930031 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1cc1fe14-4d59-463c-8970-259c3b8fe63e tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] 10.222.0.93 "GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b" status: 200 len: 1316 microversion: 2.1 time: 0.303010 Aug 04 17:07:30.930890 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1582/3094] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:30 2022] GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b => generated 1316 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:30.941780 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-ce8f0342-bff2-4309-972b-0b45c21b9b89 req-aba3d66b-1589-4c41-8000-418c4f29db58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8865e4da-4c6b-4f67-bfdc-547839d7dab3", "tag": "e75f336b-22b2-4da1-8e13-8616b6b93832"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:30.946682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8becf3c0-1c38-4da1-946a-556911ad26e3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:07:30.949054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8becf3c0-1c38-4da1-946a-556911ad26e3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 092fa726-8d2e-4c49-a240-267ceea7404e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:07:30.952491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ce8f0342-bff2-4309-972b-0b45c21b9b89 req-aba3d66b-1589-4c41-8000-418c4f29db58 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:30.953065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ce8f0342-bff2-4309-972b-0b45c21b9b89 req-aba3d66b-1589-4c41-8000-418c4f29db58 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:30.953569 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ce8f0342-bff2-4309-972b-0b45c21b9b89 req-aba3d66b-1589-4c41-8000-418c4f29db58 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:30.965149 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-ce8f0342-bff2-4309-972b-0b45c21b9b89 req-aba3d66b-1589-4c41-8000-418c4f29db58 service nova] Creating event network-changed:e75f336b-22b2-4da1-8e13-8616b6b93832 for instance 8865e4da-4c6b-4f67-bfdc-547839d7dab3 on n-h2-851359-3 Aug 04 17:07:30.970565 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-ce8f0342-bff2-4309-972b-0b45c21b9b89 req-aba3d66b-1589-4c41-8000-418c4f29db58 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038393 Aug 04 17:07:30.971541 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1583/3095] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:30.976421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-30fb5bee-b6ff-489d-94a5-0a0902fb4b46 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:30.977191 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-30fb5bee-b6ff-489d-94a5-0a0902fb4b46 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:30.984019 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-30fb5bee-b6ff-489d-94a5-0a0902fb4b46 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:30.984594 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-30fb5bee-b6ff-489d-94a5-0a0902fb4b46 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:30.985111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-30fb5bee-b6ff-489d-94a5-0a0902fb4b46 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:30.985881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-30fb5bee-b6ff-489d-94a5-0a0902fb4b46 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:30.986548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-30fb5bee-b6ff-489d-94a5-0a0902fb4b46 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:30.986981 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-30fb5bee-b6ff-489d-94a5-0a0902fb4b46 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:30.994779 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8becf3c0-1c38-4da1-946a-556911ad26e3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.104531 Aug 04 17:07:30.995703 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1513/3096] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:07:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:07:31.000709 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b092e96f-0f10-488f-8cd0-3bcde27f2419 req-6d33907b-f4f1-431b-9127-e37077156146 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6f1bd19-8eaf-4799-b581-dd8b047e31b7", "tag": "8a29e23a-f4a0-4be2-b443-a053f40cbe13"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:31.012211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b092e96f-0f10-488f-8cd0-3bcde27f2419 req-6d33907b-f4f1-431b-9127-e37077156146 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:31.013027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b092e96f-0f10-488f-8cd0-3bcde27f2419 req-6d33907b-f4f1-431b-9127-e37077156146 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:31.013701 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b092e96f-0f10-488f-8cd0-3bcde27f2419 req-6d33907b-f4f1-431b-9127-e37077156146 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:31.032670 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b092e96f-0f10-488f-8cd0-3bcde27f2419 req-6d33907b-f4f1-431b-9127-e37077156146 service nova] Creating event network-changed:8a29e23a-f4a0-4be2-b443-a053f40cbe13 for instance a6f1bd19-8eaf-4799-b581-dd8b047e31b7 on n-h1-851359-3 Aug 04 17:07:31.037587 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b092e96f-0f10-488f-8cd0-3bcde27f2419 req-6d33907b-f4f1-431b-9127-e37077156146 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040356 Aug 04 17:07:31.038542 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1514/3097] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:31.044775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-6b5b70e3-74e5-41a7-8569-364cea6ce486 req-aa8752cc-58c5-45f8-9e9b-23b3c89812bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67c9cf90-8220-45c0-a580-d027e81e558b", "name": "network-vif-plugged", "status": "completed", "tag": "305f293e-0747-4a76-9e1d-574caaefe1a2"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:31.054904 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6b5b70e3-74e5-41a7-8569-364cea6ce486 req-aa8752cc-58c5-45f8-9e9b-23b3c89812bf service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:31.055383 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6b5b70e3-74e5-41a7-8569-364cea6ce486 req-aa8752cc-58c5-45f8-9e9b-23b3c89812bf service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:31.055822 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6b5b70e3-74e5-41a7-8569-364cea6ce486 req-aa8752cc-58c5-45f8-9e9b-23b3c89812bf service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:31.067378 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-6b5b70e3-74e5-41a7-8569-364cea6ce486 req-aa8752cc-58c5-45f8-9e9b-23b3c89812bf service nova] Creating event network-vif-plugged:305f293e-0747-4a76-9e1d-574caaefe1a2 for instance 67c9cf90-8220-45c0-a580-d027e81e558b on n-h1-851359-3 Aug 04 17:07:31.072309 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-6b5b70e3-74e5-41a7-8569-364cea6ce486 req-aa8752cc-58c5-45f8-9e9b-23b3c89812bf service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032391 Aug 04 17:07:31.072906 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1515/3098] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:31.079463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b839c4f4-859c-4774-82a7-8ca3edb3d76e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:31.081038 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b839c4f4-859c-4774-82a7-8ca3edb3d76e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:31.088865 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b839c4f4-859c-4774-82a7-8ca3edb3d76e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:31.089348 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b839c4f4-859c-4774-82a7-8ca3edb3d76e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:31.089765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b839c4f4-859c-4774-82a7-8ca3edb3d76e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:31.090655 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b839c4f4-859c-4774-82a7-8ca3edb3d76e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:31.091246 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b839c4f4-859c-4774-82a7-8ca3edb3d76e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:31.091676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b839c4f4-859c-4774-82a7-8ca3edb3d76e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:31.196477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-30fb5bee-b6ff-489d-94a5-0a0902fb4b46 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:31.204206 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-30fb5bee-b6ff-489d-94a5-0a0902fb4b46 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1363 microversion: 2.1 time: 0.231673 Aug 04 17:07:31.204783 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1584/3099] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:30 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:31.209493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-00e3a636-d069-404b-bd3e-5de41fea083b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:31.210466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-00e3a636-d069-404b-bd3e-5de41fea083b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:31.216912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00e3a636-d069-404b-bd3e-5de41fea083b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:31.217416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00e3a636-d069-404b-bd3e-5de41fea083b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:31.217862 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00e3a636-d069-404b-bd3e-5de41fea083b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:31.218602 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00e3a636-d069-404b-bd3e-5de41fea083b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:31.219068 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00e3a636-d069-404b-bd3e-5de41fea083b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:31.219505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00e3a636-d069-404b-bd3e-5de41fea083b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:31.307041 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b839c4f4-859c-4774-82a7-8ca3edb3d76e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:31.319650 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b839c4f4-859c-4774-82a7-8ca3edb3d76e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1513 microversion: 2.1 time: 0.245354 Aug 04 17:07:31.321408 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1516/3100] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:31 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1513 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:31.327506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e9624425-0c35-4e0e-95fc-9c082b80ae46 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:31.328494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e9624425-0c35-4e0e-95fc-9c082b80ae46 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 092fa726-8d2e-4c49-a240-267ceea7404e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:31.401108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e9624425-0c35-4e0e-95fc-9c082b80ae46 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:31.409212 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e9624425-0c35-4e0e-95fc-9c082b80ae46 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e" status: 200 len: 1216 microversion: 2.1 time: 0.086596 Aug 04 17:07:31.409811 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1517/3101] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:31 2022] GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e => generated 1216 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:31.419286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-00e3a636-d069-404b-bd3e-5de41fea083b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:31.429251 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-00e3a636-d069-404b-bd3e-5de41fea083b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1504 microversion: 2.1 time: 0.223040 Aug 04 17:07:31.430020 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1585/3102] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:31 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1504 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:31.645691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6165218a-4327-42c9-a9fc-2a93bcccd11d tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:31.646262 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6165218a-4327-42c9-a9fc-2a93bcccd11d tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] [instance: a6f1bd19-8eaf-4799-b581-dd8b047e31b7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:31.649338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:31.653640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6165218a-4327-42c9-a9fc-2a93bcccd11d tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:31.654161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6165218a-4327-42c9-a9fc-2a93bcccd11d tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:31.654619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6165218a-4327-42c9-a9fc-2a93bcccd11d tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:31.655324 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6165218a-4327-42c9-a9fc-2a93bcccd11d tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:31.655781 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6165218a-4327-42c9-a9fc-2a93bcccd11d tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:31.656204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6165218a-4327-42c9-a9fc-2a93bcccd11d tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:31.786643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6165218a-4327-42c9-a9fc-2a93bcccd11d tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bb93640f644e73a4fce9b0682ce858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe912cae63448eea70d0acb20320a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:31.794216 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6165218a-4327-42c9-a9fc-2a93bcccd11d tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7" status: 200 len: 1312 microversion: 2.1 time: 0.152390 Aug 04 17:07:31.794815 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1518/3103] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:31 2022] GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7 => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:31.952590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5675d86a-080f-43be-b307-fd96b9c120cc tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:31.953203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5675d86a-080f-43be-b307-fd96b9c120cc tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] [instance: 67c9cf90-8220-45c0-a580-d027e81e558b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:31.959553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5675d86a-080f-43be-b307-fd96b9c120cc tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:31.960034 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5675d86a-080f-43be-b307-fd96b9c120cc tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:31.960476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5675d86a-080f-43be-b307-fd96b9c120cc tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:31.961171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5675d86a-080f-43be-b307-fd96b9c120cc tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:31.961629 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5675d86a-080f-43be-b307-fd96b9c120cc tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:31.962079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5675d86a-080f-43be-b307-fd96b9c120cc tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:32.090986 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5675d86a-080f-43be-b307-fd96b9c120cc tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a023a55a348a8bfc02c2818cd0901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0057b5901fc44b1eae04780a4813c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:32.098687 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5675d86a-080f-43be-b307-fd96b9c120cc tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] 10.222.0.93 "GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b" status: 200 len: 1316 microversion: 2.1 time: 0.150503 Aug 04 17:07:32.099247 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1586/3104] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:31 2022] GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:32.227591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9b29900e-a4a9-4807-8d28-5fbbcd5a1405 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:32.228165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9b29900e-a4a9-4807-8d28-5fbbcd5a1405 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:32.235778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b29900e-a4a9-4807-8d28-5fbbcd5a1405 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:32.236275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b29900e-a4a9-4807-8d28-5fbbcd5a1405 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:32.236721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b29900e-a4a9-4807-8d28-5fbbcd5a1405 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:32.237433 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b29900e-a4a9-4807-8d28-5fbbcd5a1405 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:32.237896 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b29900e-a4a9-4807-8d28-5fbbcd5a1405 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:32.238356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b29900e-a4a9-4807-8d28-5fbbcd5a1405 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:32.341707 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bf50cd36-fef6-406f-9811-12972c2dee03 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:32.342460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bf50cd36-fef6-406f-9811-12972c2dee03 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:32.349185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf50cd36-fef6-406f-9811-12972c2dee03 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:32.349683 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf50cd36-fef6-406f-9811-12972c2dee03 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:32.350156 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf50cd36-fef6-406f-9811-12972c2dee03 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:32.350870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf50cd36-fef6-406f-9811-12972c2dee03 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:32.351367 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf50cd36-fef6-406f-9811-12972c2dee03 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:32.351799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf50cd36-fef6-406f-9811-12972c2dee03 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:32.397985 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9b29900e-a4a9-4807-8d28-5fbbcd5a1405 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:32.407293 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9b29900e-a4a9-4807-8d28-5fbbcd5a1405 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1363 microversion: 2.1 time: 0.183594 Aug 04 17:07:32.408215 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1519/3105] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:32 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:32.430435 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-593b9cf1-3153-4621-95a4-4b6cf26393b0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:32.431068 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-593b9cf1-3153-4621-95a4-4b6cf26393b0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 092fa726-8d2e-4c49-a240-267ceea7404e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:32.438646 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-593b9cf1-3153-4621-95a4-4b6cf26393b0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:32.439142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-593b9cf1-3153-4621-95a4-4b6cf26393b0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:32.439586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-593b9cf1-3153-4621-95a4-4b6cf26393b0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:32.440296 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-593b9cf1-3153-4621-95a4-4b6cf26393b0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:32.440771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-593b9cf1-3153-4621-95a4-4b6cf26393b0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:32.441177 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-593b9cf1-3153-4621-95a4-4b6cf26393b0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:32.470144 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:32.531192 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-593b9cf1-3153-4621-95a4-4b6cf26393b0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:32.544136 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-593b9cf1-3153-4621-95a4-4b6cf26393b0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e" status: 200 len: 1212 microversion: 2.1 time: 0.117954 Aug 04 17:07:32.544734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bf50cd36-fef6-406f-9811-12972c2dee03 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:32.545190 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1520/3106] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:32 2022] GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e => generated 1212 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:32.551107 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e7e9acd7-9eef-474d-aa84-54d2d94eccc1 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:32.552528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e7e9acd7-9eef-474d-aa84-54d2d94eccc1 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:32.555989 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bf50cd36-fef6-406f-9811-12972c2dee03 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1513 microversion: 2.1 time: 0.218153 Aug 04 17:07:32.556932 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1587/3107] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:32 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1513 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:32.568553 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7e9acd7-9eef-474d-aa84-54d2d94eccc1 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:32.569662 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7e9acd7-9eef-474d-aa84-54d2d94eccc1 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:32.570375 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7e9acd7-9eef-474d-aa84-54d2d94eccc1 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:32.571114 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7e9acd7-9eef-474d-aa84-54d2d94eccc1 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:32.571999 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7e9acd7-9eef-474d-aa84-54d2d94eccc1 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:32.572445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7e9acd7-9eef-474d-aa84-54d2d94eccc1 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:32.707901 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e7e9acd7-9eef-474d-aa84-54d2d94eccc1 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:32.715297 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e7e9acd7-9eef-474d-aa84-54d2d94eccc1 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1504 microversion: 2.1 time: 0.169046 Aug 04 17:07:32.715893 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1521/3108] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:32 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:32.815776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-485d26d4-b4f4-41b2-abc7-51a1701bbd37 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:32.816731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-485d26d4-b4f4-41b2-abc7-51a1701bbd37 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] [instance: a6f1bd19-8eaf-4799-b581-dd8b047e31b7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:32.822800 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-485d26d4-b4f4-41b2-abc7-51a1701bbd37 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:32.823285 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-485d26d4-b4f4-41b2-abc7-51a1701bbd37 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:32.823721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-485d26d4-b4f4-41b2-abc7-51a1701bbd37 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:32.824418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-485d26d4-b4f4-41b2-abc7-51a1701bbd37 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:32.824871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-485d26d4-b4f4-41b2-abc7-51a1701bbd37 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:32.825297 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-485d26d4-b4f4-41b2-abc7-51a1701bbd37 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:32.958251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-485d26d4-b4f4-41b2-abc7-51a1701bbd37 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bb93640f644e73a4fce9b0682ce858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe912cae63448eea70d0acb20320a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:32.966144 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-485d26d4-b4f4-41b2-abc7-51a1701bbd37 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7" status: 200 len: 1312 microversion: 2.1 time: 0.154776 Aug 04 17:07:32.966714 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1588/3109] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:32 2022] GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7 => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:33.119118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-de40e075-cee7-43b2-9de9-e03ff53e328c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:33.119663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-de40e075-cee7-43b2-9de9-e03ff53e328c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] [instance: 67c9cf90-8220-45c0-a580-d027e81e558b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:33.125800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de40e075-cee7-43b2-9de9-e03ff53e328c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:33.126315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de40e075-cee7-43b2-9de9-e03ff53e328c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:33.126755 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de40e075-cee7-43b2-9de9-e03ff53e328c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:33.127443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de40e075-cee7-43b2-9de9-e03ff53e328c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:33.127903 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de40e075-cee7-43b2-9de9-e03ff53e328c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:33.128329 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de40e075-cee7-43b2-9de9-e03ff53e328c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:33.261914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-de40e075-cee7-43b2-9de9-e03ff53e328c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a023a55a348a8bfc02c2818cd0901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0057b5901fc44b1eae04780a4813c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:33.269278 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-de40e075-cee7-43b2-9de9-e03ff53e328c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] 10.222.0.93 "GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b" status: 200 len: 1316 microversion: 2.1 time: 0.154171 Aug 04 17:07:33.269840 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1522/3110] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:33 2022] GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:33.427864 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fab9e0c7-2c0e-4645-8ab3-c774a7300f56 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:33.428586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fab9e0c7-2c0e-4645-8ab3-c774a7300f56 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:33.435087 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fab9e0c7-2c0e-4645-8ab3-c774a7300f56 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:33.435570 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fab9e0c7-2c0e-4645-8ab3-c774a7300f56 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:33.436007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fab9e0c7-2c0e-4645-8ab3-c774a7300f56 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:33.436689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fab9e0c7-2c0e-4645-8ab3-c774a7300f56 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:33.437144 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fab9e0c7-2c0e-4645-8ab3-c774a7300f56 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:33.437833 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fab9e0c7-2c0e-4645-8ab3-c774a7300f56 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:33.567258 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fab9e0c7-2c0e-4645-8ab3-c774a7300f56 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:33.574947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1b48b0e4-e7bb-4979-afb1-586c9c646f01 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:33.575584 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1b48b0e4-e7bb-4979-afb1-586c9c646f01 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 092fa726-8d2e-4c49-a240-267ceea7404e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:33.577049 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fab9e0c7-2c0e-4645-8ab3-c774a7300f56 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1363 microversion: 2.1 time: 0.152916 Aug 04 17:07:33.577632 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1589/3111] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:33 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:33.582215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e1f370a8-9042-4af1-9206-2b40ec0b6cbf tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:33.582823 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e1f370a8-9042-4af1-9206-2b40ec0b6cbf tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:33.583128 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b48b0e4-e7bb-4979-afb1-586c9c646f01 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:33.583621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b48b0e4-e7bb-4979-afb1-586c9c646f01 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:33.584059 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b48b0e4-e7bb-4979-afb1-586c9c646f01 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:33.584989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b48b0e4-e7bb-4979-afb1-586c9c646f01 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:33.585667 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b48b0e4-e7bb-4979-afb1-586c9c646f01 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:33.586163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b48b0e4-e7bb-4979-afb1-586c9c646f01 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:33.589155 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1f370a8-9042-4af1-9206-2b40ec0b6cbf tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:33.590216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1f370a8-9042-4af1-9206-2b40ec0b6cbf tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:33.590595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1f370a8-9042-4af1-9206-2b40ec0b6cbf tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:33.591294 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1f370a8-9042-4af1-9206-2b40ec0b6cbf tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:33.591751 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1f370a8-9042-4af1-9206-2b40ec0b6cbf tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:33.592179 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1f370a8-9042-4af1-9206-2b40ec0b6cbf tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:33.674649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1b48b0e4-e7bb-4979-afb1-586c9c646f01 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:33.682310 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1b48b0e4-e7bb-4979-afb1-586c9c646f01 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e" status: 200 len: 1276 microversion: 2.1 time: 0.114071 Aug 04 17:07:33.683157 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1523/3112] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:33 2022] GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e => generated 1276 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:33.736034 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-910ee11a-1e67-4c7a-a244-ea04f5d8f35b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:33.736658 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-910ee11a-1e67-4c7a-a244-ea04f5d8f35b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:33.742706 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-910ee11a-1e67-4c7a-a244-ea04f5d8f35b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:33.743195 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-910ee11a-1e67-4c7a-a244-ea04f5d8f35b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:33.743631 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-910ee11a-1e67-4c7a-a244-ea04f5d8f35b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:33.743767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e1f370a8-9042-4af1-9206-2b40ec0b6cbf tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:33.744327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-910ee11a-1e67-4c7a-a244-ea04f5d8f35b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:33.744785 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-910ee11a-1e67-4c7a-a244-ea04f5d8f35b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:33.745207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-910ee11a-1e67-4c7a-a244-ea04f5d8f35b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:33.753697 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e1f370a8-9042-4af1-9206-2b40ec0b6cbf tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1513 microversion: 2.1 time: 0.175047 Aug 04 17:07:33.754310 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1590/3113] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:33 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1513 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:33.882196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-910ee11a-1e67-4c7a-a244-ea04f5d8f35b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:33.890042 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-910ee11a-1e67-4c7a-a244-ea04f5d8f35b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1504 microversion: 2.1 time: 0.157881 Aug 04 17:07:33.890608 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1524/3114] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:33 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:33.987869 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9963e1c2-48d2-4ada-b332-77cbe8a84f23 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:33.988570 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9963e1c2-48d2-4ada-b332-77cbe8a84f23 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] [instance: a6f1bd19-8eaf-4799-b581-dd8b047e31b7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:33.995503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9963e1c2-48d2-4ada-b332-77cbe8a84f23 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:33.996037 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9963e1c2-48d2-4ada-b332-77cbe8a84f23 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:33.996489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9963e1c2-48d2-4ada-b332-77cbe8a84f23 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:33.997202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9963e1c2-48d2-4ada-b332-77cbe8a84f23 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:33.997673 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9963e1c2-48d2-4ada-b332-77cbe8a84f23 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:33.998139 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9963e1c2-48d2-4ada-b332-77cbe8a84f23 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:34.162673 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9963e1c2-48d2-4ada-b332-77cbe8a84f23 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bb93640f644e73a4fce9b0682ce858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe912cae63448eea70d0acb20320a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:34.172072 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9963e1c2-48d2-4ada-b332-77cbe8a84f23 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7" status: 200 len: 1312 microversion: 2.1 time: 0.188565 Aug 04 17:07:34.172796 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1591/3115] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:33 2022] GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7 => generated 1312 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:34.289948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2ccd2ba4-dca9-4bab-b73d-034760271141 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:34.290609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2ccd2ba4-dca9-4bab-b73d-034760271141 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] [instance: 67c9cf90-8220-45c0-a580-d027e81e558b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:34.297588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ccd2ba4-dca9-4bab-b73d-034760271141 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:34.298183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ccd2ba4-dca9-4bab-b73d-034760271141 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:34.298693 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ccd2ba4-dca9-4bab-b73d-034760271141 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:34.299684 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ccd2ba4-dca9-4bab-b73d-034760271141 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:34.300153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ccd2ba4-dca9-4bab-b73d-034760271141 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:34.300653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ccd2ba4-dca9-4bab-b73d-034760271141 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:34.517533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2ccd2ba4-dca9-4bab-b73d-034760271141 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a023a55a348a8bfc02c2818cd0901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0057b5901fc44b1eae04780a4813c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:34.539651 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2ccd2ba4-dca9-4bab-b73d-034760271141 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] 10.222.0.93 "GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b" status: 200 len: 1316 microversion: 2.1 time: 0.253824 Aug 04 17:07:34.540666 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1525/3116] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:34 2022] GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b => generated 1316 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:34.604569 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5c04d4d9-bb32-4dab-b87b-6bb2ca2d9bd2 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:34.605199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5c04d4d9-bb32-4dab-b87b-6bb2ca2d9bd2 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:34.615879 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c04d4d9-bb32-4dab-b87b-6bb2ca2d9bd2 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:34.616564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c04d4d9-bb32-4dab-b87b-6bb2ca2d9bd2 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:34.617156 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c04d4d9-bb32-4dab-b87b-6bb2ca2d9bd2 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:34.618064 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c04d4d9-bb32-4dab-b87b-6bb2ca2d9bd2 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:34.618828 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c04d4d9-bb32-4dab-b87b-6bb2ca2d9bd2 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:34.619502 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c04d4d9-bb32-4dab-b87b-6bb2ca2d9bd2 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:34.705065 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-09c1d7cb-8aa9-4bbb-a385-d822bd71b68f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:34.706517 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-09c1d7cb-8aa9-4bbb-a385-d822bd71b68f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 092fa726-8d2e-4c49-a240-267ceea7404e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:34.715093 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09c1d7cb-8aa9-4bbb-a385-d822bd71b68f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:34.715587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09c1d7cb-8aa9-4bbb-a385-d822bd71b68f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:34.716018 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09c1d7cb-8aa9-4bbb-a385-d822bd71b68f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:34.719510 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09c1d7cb-8aa9-4bbb-a385-d822bd71b68f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:34.722984 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09c1d7cb-8aa9-4bbb-a385-d822bd71b68f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:34.723624 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09c1d7cb-8aa9-4bbb-a385-d822bd71b68f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:34.841049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-09c1d7cb-8aa9-4bbb-a385-d822bd71b68f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:34.850115 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-09c1d7cb-8aa9-4bbb-a385-d822bd71b68f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e" status: 200 len: 1274 microversion: 2.1 time: 0.148844 Aug 04 17:07:34.851987 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1526/3117] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:34 2022] GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e => generated 1274 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:34.857709 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c73f5927-b140-4134-a830-f17ce2c117c6 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:34.858361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c73f5927-b140-4134-a830-f17ce2c117c6 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:34.865656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c73f5927-b140-4134-a830-f17ce2c117c6 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:34.867096 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c73f5927-b140-4134-a830-f17ce2c117c6 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:34.867721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c73f5927-b140-4134-a830-f17ce2c117c6 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:34.868683 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c73f5927-b140-4134-a830-f17ce2c117c6 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:34.869301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c73f5927-b140-4134-a830-f17ce2c117c6 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:34.869891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c73f5927-b140-4134-a830-f17ce2c117c6 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:34.887176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5c04d4d9-bb32-4dab-b87b-6bb2ca2d9bd2 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:34.901067 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5c04d4d9-bb32-4dab-b87b-6bb2ca2d9bd2 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1363 microversion: 2.1 time: 0.306601 Aug 04 17:07:34.910082 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1592/3118] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:34 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1363 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:34.911512 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2966acef-ef2a-4486-8edc-a1fbe945adad tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:34.912138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2966acef-ef2a-4486-8edc-a1fbe945adad tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:34.922606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2966acef-ef2a-4486-8edc-a1fbe945adad tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:34.923412 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2966acef-ef2a-4486-8edc-a1fbe945adad tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:34.924031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2966acef-ef2a-4486-8edc-a1fbe945adad tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:34.924953 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2966acef-ef2a-4486-8edc-a1fbe945adad tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:34.925580 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2966acef-ef2a-4486-8edc-a1fbe945adad tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:34.926205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2966acef-ef2a-4486-8edc-a1fbe945adad tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:35.144135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2966acef-ef2a-4486-8edc-a1fbe945adad tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:35.155239 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2966acef-ef2a-4486-8edc-a1fbe945adad tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1504 microversion: 2.1 time: 0.247694 Aug 04 17:07:35.155841 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1593/3119] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:34 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1504 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:35.192997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-466c14f9-702e-4c87-ab5d-03afb37520d5 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:35.193622 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-466c14f9-702e-4c87-ab5d-03afb37520d5 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] [instance: a6f1bd19-8eaf-4799-b581-dd8b047e31b7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:35.202458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-466c14f9-702e-4c87-ab5d-03afb37520d5 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:35.203001 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-466c14f9-702e-4c87-ab5d-03afb37520d5 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:35.203453 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-466c14f9-702e-4c87-ab5d-03afb37520d5 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:35.204189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-466c14f9-702e-4c87-ab5d-03afb37520d5 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:35.204654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-466c14f9-702e-4c87-ab5d-03afb37520d5 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:35.205084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-466c14f9-702e-4c87-ab5d-03afb37520d5 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:35.385048 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c73f5927-b140-4134-a830-f17ce2c117c6 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:35.396216 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c73f5927-b140-4134-a830-f17ce2c117c6 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1513 microversion: 2.1 time: 0.542879 Aug 04 17:07:35.397645 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1527/3120] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:34 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1513 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:35.442036 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-466c14f9-702e-4c87-ab5d-03afb37520d5 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bb93640f644e73a4fce9b0682ce858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe912cae63448eea70d0acb20320a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:35.449940 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-466c14f9-702e-4c87-ab5d-03afb37520d5 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7" status: 200 len: 1312 microversion: 2.1 time: 0.260735 Aug 04 17:07:35.451588 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1594/3121] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:35 2022] GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7 => generated 1312 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:35.564127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e42a257b-f680-43bd-9b01-c6ca2f169472 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:35.564127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e42a257b-f680-43bd-9b01-c6ca2f169472 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] [instance: 67c9cf90-8220-45c0-a580-d027e81e558b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:35.572189 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e42a257b-f680-43bd-9b01-c6ca2f169472 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:35.572690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e42a257b-f680-43bd-9b01-c6ca2f169472 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:35.573426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e42a257b-f680-43bd-9b01-c6ca2f169472 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:35.575370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e42a257b-f680-43bd-9b01-c6ca2f169472 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:35.576154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e42a257b-f680-43bd-9b01-c6ca2f169472 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:35.576647 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e42a257b-f680-43bd-9b01-c6ca2f169472 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:35.740232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e42a257b-f680-43bd-9b01-c6ca2f169472 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a023a55a348a8bfc02c2818cd0901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0057b5901fc44b1eae04780a4813c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:35.747944 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e42a257b-f680-43bd-9b01-c6ca2f169472 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] 10.222.0.93 "GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b" status: 200 len: 1504 microversion: 2.1 time: 0.190306 Aug 04 17:07:35.748732 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1528/3122] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:35 2022] GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b => generated 1504 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:35.769730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4d474fda-45ec-4504-812e-761daf40ae06 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:35.770360 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4d474fda-45ec-4504-812e-761daf40ae06 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] [instance: 67c9cf90-8220-45c0-a580-d027e81e558b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:35.777239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d474fda-45ec-4504-812e-761daf40ae06 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:35.777956 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d474fda-45ec-4504-812e-761daf40ae06 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:35.778418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d474fda-45ec-4504-812e-761daf40ae06 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:35.779192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d474fda-45ec-4504-812e-761daf40ae06 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:35.779821 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d474fda-45ec-4504-812e-761daf40ae06 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:35.780253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d474fda-45ec-4504-812e-761daf40ae06 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:35.798864 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:35.814939 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4d474fda-45ec-4504-812e-761daf40ae06 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'd27a023a55a348a8bfc02c2818cd0901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0057b5901fc44b1eae04780a4813c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:35.815933 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4d474fda-45ec-4504-812e-761daf40ae06 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] 10.222.0.93 "GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b/os-instance-actions/req-8186f6a4-cdad-4388-a972-7b95a2cc9ad8" status: 200 len: 313 microversion: 2.1 time: 0.050315 Aug 04 17:07:35.816834 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1595/3123] 10.222.0.93 () {58 vars in 1419 bytes} [Thu Aug 4 17:07:35 2022] GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b/os-instance-actions/req-8186f6a4-cdad-4388-a972-7b95a2cc9ad8 => generated 313 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:35.830830 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e0dc507f-7f0a-464a-9954-e2b3c1379bad tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:35.833771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e0dc507f-7f0a-464a-9954-e2b3c1379bad tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] [instance: 67c9cf90-8220-45c0-a580-d027e81e558b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:35.840935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0dc507f-7f0a-464a-9954-e2b3c1379bad tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:35.841654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0dc507f-7f0a-464a-9954-e2b3c1379bad tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:35.842135 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0dc507f-7f0a-464a-9954-e2b3c1379bad tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:35.842850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0dc507f-7f0a-464a-9954-e2b3c1379bad tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:35.843317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0dc507f-7f0a-464a-9954-e2b3c1379bad tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:35.843813 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0dc507f-7f0a-464a-9954-e2b3c1379bad tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:35.876616 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4f611cf7-179e-4f5d-b543-e57059e213ea tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:35.877823 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4f611cf7-179e-4f5d-b543-e57059e213ea tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 092fa726-8d2e-4c49-a240-267ceea7404e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:35.884558 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f611cf7-179e-4f5d-b543-e57059e213ea tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:35.885267 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f611cf7-179e-4f5d-b543-e57059e213ea tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:35.885956 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f611cf7-179e-4f5d-b543-e57059e213ea tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:35.887733 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f611cf7-179e-4f5d-b543-e57059e213ea tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:35.888356 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f611cf7-179e-4f5d-b543-e57059e213ea tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:35.888975 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f611cf7-179e-4f5d-b543-e57059e213ea tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:35.956037 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e0dc507f-7f0a-464a-9954-e2b3c1379bad tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] 10.222.0.93 "POST /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b/action" status: 202 len: 0 microversion: 2.1 time: 0.128894 Aug 04 17:07:35.959463 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1529/3124] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:07:35 2022] POST /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:07:35.977721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2430c38c-d0df-46fd-a95d-586e81f23664 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:35.978563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2430c38c-d0df-46fd-a95d-586e81f23664 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:35.995739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2430c38c-d0df-46fd-a95d-586e81f23664 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:35.997076 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2430c38c-d0df-46fd-a95d-586e81f23664 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:35.997699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2430c38c-d0df-46fd-a95d-586e81f23664 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:35.998648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2430c38c-d0df-46fd-a95d-586e81f23664 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:35.999302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2430c38c-d0df-46fd-a95d-586e81f23664 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:36.000025 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2430c38c-d0df-46fd-a95d-586e81f23664 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:36.066627 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=4 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:36.113108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4f611cf7-179e-4f5d-b543-e57059e213ea tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:36.135188 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4f611cf7-179e-4f5d-b543-e57059e213ea tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e" status: 200 len: 1316 microversion: 2.1 time: 0.264898 Aug 04 17:07:36.136112 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1596/3125] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:35 2022] GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e => generated 1316 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:36.140932 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2d3c9f30-621a-4ac4-8416-9545485b0d43 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:36.141555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2d3c9f30-621a-4ac4-8416-9545485b0d43 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] [instance: 67c9cf90-8220-45c0-a580-d027e81e558b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:36.148986 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d3c9f30-621a-4ac4-8416-9545485b0d43 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:36.149586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d3c9f30-621a-4ac4-8416-9545485b0d43 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:36.149926 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d3c9f30-621a-4ac4-8416-9545485b0d43 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:36.150668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d3c9f30-621a-4ac4-8416-9545485b0d43 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:36.151403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d3c9f30-621a-4ac4-8416-9545485b0d43 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:36.152585 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d3c9f30-621a-4ac4-8416-9545485b0d43 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:36.200445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2430c38c-d0df-46fd-a95d-586e81f23664 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:36.208120 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2430c38c-d0df-46fd-a95d-586e81f23664 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1363 microversion: 2.1 time: 0.249622 Aug 04 17:07:36.222689 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1530/3126] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:35 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:36.222689 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a10ee79f-0a16-4093-9810-424679290411 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:36.222689 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a10ee79f-0a16-4093-9810-424679290411 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:36.222689 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a10ee79f-0a16-4093-9810-424679290411 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:36.224200 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a10ee79f-0a16-4093-9810-424679290411 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:36.224343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a10ee79f-0a16-4093-9810-424679290411 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:36.225350 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a10ee79f-0a16-4093-9810-424679290411 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:36.226098 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a10ee79f-0a16-4093-9810-424679290411 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:36.226765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a10ee79f-0a16-4093-9810-424679290411 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:36.393120 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2d3c9f30-621a-4ac4-8416-9545485b0d43 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a023a55a348a8bfc02c2818cd0901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0057b5901fc44b1eae04780a4813c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:36.410227 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2d3c9f30-621a-4ac4-8416-9545485b0d43 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] 10.222.0.93 "GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b" status: 200 len: 1506 microversion: 2.1 time: 0.272027 Aug 04 17:07:36.416198 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1597/3127] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:36 2022] GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b => generated 1506 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:36.423487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0f94eee9-c5fb-44b1-a130-fdb56106719f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:36.424506 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0f94eee9-c5fb-44b1-a130-fdb56106719f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:36.435928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f94eee9-c5fb-44b1-a130-fdb56106719f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:36.436702 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a10ee79f-0a16-4093-9810-424679290411 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:36.442093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f94eee9-c5fb-44b1-a130-fdb56106719f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:36.446496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f94eee9-c5fb-44b1-a130-fdb56106719f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:36.446644 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a10ee79f-0a16-4093-9810-424679290411 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1504 microversion: 2.1 time: 0.236281 Aug 04 17:07:36.447604 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1531/3128] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:36 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1504 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:36.450339 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f94eee9-c5fb-44b1-a130-fdb56106719f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:36.450910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f94eee9-c5fb-44b1-a130-fdb56106719f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:36.451367 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f94eee9-c5fb-44b1-a130-fdb56106719f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:36.470726 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9f27e278-7f85-4c24-924b-c15538193132 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:36.471296 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9f27e278-7f85-4c24-924b-c15538193132 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] [instance: a6f1bd19-8eaf-4799-b581-dd8b047e31b7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:36.478796 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f27e278-7f85-4c24-924b-c15538193132 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:36.479800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f27e278-7f85-4c24-924b-c15538193132 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:36.480777 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f27e278-7f85-4c24-924b-c15538193132 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:36.481593 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f27e278-7f85-4c24-924b-c15538193132 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:36.482108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f27e278-7f85-4c24-924b-c15538193132 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:36.482556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f27e278-7f85-4c24-924b-c15538193132 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:36.683902 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0f94eee9-c5fb-44b1-a130-fdb56106719f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:36.704122 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0f94eee9-c5fb-44b1-a130-fdb56106719f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1513 microversion: 2.1 time: 0.286370 Aug 04 17:07:36.720169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9f27e278-7f85-4c24-924b-c15538193132 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bb93640f644e73a4fce9b0682ce858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe912cae63448eea70d0acb20320a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:36.725019 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1598/3129] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:36 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1513 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:36.731678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-cd4c04e1-11c1-4d38-98e2-7d4feefcda13 req-63dbc2ba-67ca-473d-aff2-c754a19a1f2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "092fa726-8d2e-4c49-a240-267ceea7404e", "tag": "3e45099b-72eb-4bc4-83cd-3e008ee8a85d"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:36.741533 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9f27e278-7f85-4c24-924b-c15538193132 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7" status: 200 len: 1312 microversion: 2.1 time: 0.273972 Aug 04 17:07:36.747929 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-cd4c04e1-11c1-4d38-98e2-7d4feefcda13 req-63dbc2ba-67ca-473d-aff2-c754a19a1f2d service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:36.748641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-cd4c04e1-11c1-4d38-98e2-7d4feefcda13 req-63dbc2ba-67ca-473d-aff2-c754a19a1f2d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:36.749239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-cd4c04e1-11c1-4d38-98e2-7d4feefcda13 req-63dbc2ba-67ca-473d-aff2-c754a19a1f2d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:36.757054 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1532/3130] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:36 2022] GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7 => generated 1312 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:36.987547 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-cd4c04e1-11c1-4d38-98e2-7d4feefcda13 req-63dbc2ba-67ca-473d-aff2-c754a19a1f2d service nova] Creating event network-changed:3e45099b-72eb-4bc4-83cd-3e008ee8a85d for instance 092fa726-8d2e-4c49-a240-267ceea7404e on n-h1-851359-3 Aug 04 17:07:36.992341 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-cd4c04e1-11c1-4d38-98e2-7d4feefcda13 req-63dbc2ba-67ca-473d-aff2-c754a19a1f2d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.265835 Aug 04 17:07:36.992950 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1599/3131] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:37.155918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cbc3851a-81fb-4454-b8be-e66a259beb42 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:37.156575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cbc3851a-81fb-4454-b8be-e66a259beb42 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 092fa726-8d2e-4c49-a240-267ceea7404e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:37.162572 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbc3851a-81fb-4454-b8be-e66a259beb42 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:37.163056 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbc3851a-81fb-4454-b8be-e66a259beb42 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:37.163493 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbc3851a-81fb-4454-b8be-e66a259beb42 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:37.164193 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbc3851a-81fb-4454-b8be-e66a259beb42 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:37.164654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbc3851a-81fb-4454-b8be-e66a259beb42 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:37.165081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbc3851a-81fb-4454-b8be-e66a259beb42 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:37.228667 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=46 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:37.235793 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-269fcc94-1024-4421-87eb-3f1c5792ffb6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:37.236624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-269fcc94-1024-4421-87eb-3f1c5792ffb6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:37.245905 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-269fcc94-1024-4421-87eb-3f1c5792ffb6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:37.247329 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-269fcc94-1024-4421-87eb-3f1c5792ffb6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:37.248447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-269fcc94-1024-4421-87eb-3f1c5792ffb6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:37.249134 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-269fcc94-1024-4421-87eb-3f1c5792ffb6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:37.249603 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-269fcc94-1024-4421-87eb-3f1c5792ffb6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:37.250067 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-269fcc94-1024-4421-87eb-3f1c5792ffb6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:37.336183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cbc3851a-81fb-4454-b8be-e66a259beb42 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:37.344649 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cbc3851a-81fb-4454-b8be-e66a259beb42 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e" status: 200 len: 1316 microversion: 2.1 time: 0.192585 Aug 04 17:07:37.345424 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1533/3132] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:37 2022] GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e => generated 1316 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:37.401937 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-269fcc94-1024-4421-87eb-3f1c5792ffb6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:37.410184 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-269fcc94-1024-4421-87eb-3f1c5792ffb6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1363 microversion: 2.1 time: 0.183800 Aug 04 17:07:37.410948 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1600/3133] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:37 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:37.435979 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-88472c54-b91e-4750-85aa-8839fb3d6a4c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:37.436636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-88472c54-b91e-4750-85aa-8839fb3d6a4c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] [instance: 67c9cf90-8220-45c0-a580-d027e81e558b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:37.442906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88472c54-b91e-4750-85aa-8839fb3d6a4c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:37.443508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88472c54-b91e-4750-85aa-8839fb3d6a4c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:37.443824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88472c54-b91e-4750-85aa-8839fb3d6a4c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:37.444523 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88472c54-b91e-4750-85aa-8839fb3d6a4c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:37.444988 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88472c54-b91e-4750-85aa-8839fb3d6a4c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:37.445420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88472c54-b91e-4750-85aa-8839fb3d6a4c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:37.468045 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-670dd41a-ea06-4bb9-9712-011be5ec20fb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:37.468776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-670dd41a-ea06-4bb9-9712-011be5ec20fb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:37.471197 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:37.476923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-670dd41a-ea06-4bb9-9712-011be5ec20fb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:37.477493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-670dd41a-ea06-4bb9-9712-011be5ec20fb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:37.477949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-670dd41a-ea06-4bb9-9712-011be5ec20fb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:37.478688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-670dd41a-ea06-4bb9-9712-011be5ec20fb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:37.479239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-670dd41a-ea06-4bb9-9712-011be5ec20fb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:37.479686 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-670dd41a-ea06-4bb9-9712-011be5ec20fb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:37.654234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-88472c54-b91e-4750-85aa-8839fb3d6a4c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a023a55a348a8bfc02c2818cd0901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0057b5901fc44b1eae04780a4813c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:37.662251 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-88472c54-b91e-4750-85aa-8839fb3d6a4c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] 10.222.0.93 "GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b" status: 200 len: 1506 microversion: 2.1 time: 0.230140 Aug 04 17:07:37.663223 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1534/3134] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:37 2022] GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b => generated 1506 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:37.676595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-670dd41a-ea06-4bb9-9712-011be5ec20fb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:37.685838 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-670dd41a-ea06-4bb9-9712-011be5ec20fb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1504 microversion: 2.1 time: 0.222469 Aug 04 17:07:37.686471 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1601/3135] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:37 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1504 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:37.732037 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a751fc3c-f2e2-4185-8948-66dbbf2c2e17 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:37.732661 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a751fc3c-f2e2-4185-8948-66dbbf2c2e17 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:37.739314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a751fc3c-f2e2-4185-8948-66dbbf2c2e17 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:37.739885 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a751fc3c-f2e2-4185-8948-66dbbf2c2e17 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:37.740327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a751fc3c-f2e2-4185-8948-66dbbf2c2e17 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:37.741226 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a751fc3c-f2e2-4185-8948-66dbbf2c2e17 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:37.741769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a751fc3c-f2e2-4185-8948-66dbbf2c2e17 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:37.742229 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a751fc3c-f2e2-4185-8948-66dbbf2c2e17 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:37.764494 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1c512113-2756-406f-a2f9-4b3575685441 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:37.765043 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1c512113-2756-406f-a2f9-4b3575685441 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] [instance: a6f1bd19-8eaf-4799-b581-dd8b047e31b7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:37.771132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1c512113-2756-406f-a2f9-4b3575685441 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:37.771636 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1c512113-2756-406f-a2f9-4b3575685441 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:37.772086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1c512113-2756-406f-a2f9-4b3575685441 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:37.772795 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1c512113-2756-406f-a2f9-4b3575685441 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:37.773265 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1c512113-2756-406f-a2f9-4b3575685441 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:37.773708 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1c512113-2756-406f-a2f9-4b3575685441 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:37.943860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a751fc3c-f2e2-4185-8948-66dbbf2c2e17 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:37.947950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1c512113-2756-406f-a2f9-4b3575685441 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bb93640f644e73a4fce9b0682ce858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe912cae63448eea70d0acb20320a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:37.952301 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a751fc3c-f2e2-4185-8948-66dbbf2c2e17 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1513 microversion: 2.1 time: 0.224704 Aug 04 17:07:37.953087 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1535/3136] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:37 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1513 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:37.956681 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1c512113-2756-406f-a2f9-4b3575685441 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7" status: 200 len: 1312 microversion: 2.1 time: 0.196855 Aug 04 17:07:37.957397 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1602/3137] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:37 2022] GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7 => generated 1312 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:38.365075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cb3bdb8e-b6a4-4191-af36-1ed5d89b6cfb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:38.365696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cb3bdb8e-b6a4-4191-af36-1ed5d89b6cfb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 092fa726-8d2e-4c49-a240-267ceea7404e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:38.372781 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb3bdb8e-b6a4-4191-af36-1ed5d89b6cfb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:38.373272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb3bdb8e-b6a4-4191-af36-1ed5d89b6cfb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:38.373715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb3bdb8e-b6a4-4191-af36-1ed5d89b6cfb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:38.374443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb3bdb8e-b6a4-4191-af36-1ed5d89b6cfb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:38.374907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb3bdb8e-b6a4-4191-af36-1ed5d89b6cfb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:38.375340 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb3bdb8e-b6a4-4191-af36-1ed5d89b6cfb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:38.379534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:38.431394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3515cac8-4a2e-438c-9cd5-1e42e2ba2d6f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:38.432025 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3515cac8-4a2e-438c-9cd5-1e42e2ba2d6f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:38.439174 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3515cac8-4a2e-438c-9cd5-1e42e2ba2d6f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:38.439695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3515cac8-4a2e-438c-9cd5-1e42e2ba2d6f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:38.440158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3515cac8-4a2e-438c-9cd5-1e42e2ba2d6f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:38.440857 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3515cac8-4a2e-438c-9cd5-1e42e2ba2d6f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:38.441326 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3515cac8-4a2e-438c-9cd5-1e42e2ba2d6f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:38.441764 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3515cac8-4a2e-438c-9cd5-1e42e2ba2d6f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:38.543132 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cb3bdb8e-b6a4-4191-af36-1ed5d89b6cfb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:38.550610 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cb3bdb8e-b6a4-4191-af36-1ed5d89b6cfb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e" status: 200 len: 1316 microversion: 2.1 time: 0.189471 Aug 04 17:07:38.551167 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1536/3138] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:38 2022] GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e => generated 1316 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:38.598493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3515cac8-4a2e-438c-9cd5-1e42e2ba2d6f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:38.606579 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3515cac8-4a2e-438c-9cd5-1e42e2ba2d6f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1363 microversion: 2.1 time: 0.179106 Aug 04 17:07:38.607139 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1603/3139] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:38 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:38.683326 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3910d623-5fff-40ff-9e00-0177005b871b tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:38.684541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3910d623-5fff-40ff-9e00-0177005b871b tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] [instance: 67c9cf90-8220-45c0-a580-d027e81e558b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:38.690772 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3910d623-5fff-40ff-9e00-0177005b871b tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:38.691261 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3910d623-5fff-40ff-9e00-0177005b871b tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:38.691700 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3910d623-5fff-40ff-9e00-0177005b871b tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:38.692392 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3910d623-5fff-40ff-9e00-0177005b871b tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:38.692861 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3910d623-5fff-40ff-9e00-0177005b871b tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:38.693291 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3910d623-5fff-40ff-9e00-0177005b871b tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:38.708272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-66ae83b3-8a57-47a8-a4cd-5f64b4564a14 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:38.709686 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-66ae83b3-8a57-47a8-a4cd-5f64b4564a14 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:38.717728 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66ae83b3-8a57-47a8-a4cd-5f64b4564a14 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:38.718367 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66ae83b3-8a57-47a8-a4cd-5f64b4564a14 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:38.718829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66ae83b3-8a57-47a8-a4cd-5f64b4564a14 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:38.719547 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66ae83b3-8a57-47a8-a4cd-5f64b4564a14 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:38.720017 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66ae83b3-8a57-47a8-a4cd-5f64b4564a14 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:38.720454 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66ae83b3-8a57-47a8-a4cd-5f64b4564a14 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:38.904343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-66ae83b3-8a57-47a8-a4cd-5f64b4564a14 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:38.908105 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3910d623-5fff-40ff-9e00-0177005b871b tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a023a55a348a8bfc02c2818cd0901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0057b5901fc44b1eae04780a4813c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:38.914065 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-66ae83b3-8a57-47a8-a4cd-5f64b4564a14 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1504 microversion: 2.1 time: 0.210980 Aug 04 17:07:38.914994 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1604/3140] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:38 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1504 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:38.916691 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3910d623-5fff-40ff-9e00-0177005b871b tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] 10.222.0.93 "GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b" status: 200 len: 1511 microversion: 2.1 time: 0.237175 Aug 04 17:07:38.917349 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1537/3141] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:38 2022] GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b => generated 1511 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:38.935841 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-a564e318-281c-4584-88cd-e2487e99230e req-48f1bbc5-bfc4-42ca-afd4-7e4eb19cb736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f1bd19-8eaf-4799-b581-dd8b047e31b7", "name": "network-vif-plugged", "status": "completed", "tag": "8a29e23a-f4a0-4be2-b443-a053f40cbe13"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:38.946403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a564e318-281c-4584-88cd-e2487e99230e req-48f1bbc5-bfc4-42ca-afd4-7e4eb19cb736 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:38.946903 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a564e318-281c-4584-88cd-e2487e99230e req-48f1bbc5-bfc4-42ca-afd4-7e4eb19cb736 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:38.947381 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a564e318-281c-4584-88cd-e2487e99230e req-48f1bbc5-bfc4-42ca-afd4-7e4eb19cb736 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:38.958724 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-a564e318-281c-4584-88cd-e2487e99230e req-48f1bbc5-bfc4-42ca-afd4-7e4eb19cb736 service nova] Creating event network-vif-plugged:8a29e23a-f4a0-4be2-b443-a053f40cbe13 for instance a6f1bd19-8eaf-4799-b581-dd8b047e31b7 on n-h1-851359-3 Aug 04 17:07:38.963537 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-a564e318-281c-4584-88cd-e2487e99230e req-48f1bbc5-bfc4-42ca-afd4-7e4eb19cb736 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032051 Aug 04 17:07:38.964130 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1605/3142] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:38.972740 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e4428232-b2f3-44a8-8cc1-a6b7a63c620b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:38.973555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e4428232-b2f3-44a8-8cc1-a6b7a63c620b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:38.976746 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b39bdd36-013e-4dc5-842f-bd7bc0a510a0 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:38.977502 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b39bdd36-013e-4dc5-842f-bd7bc0a510a0 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] [instance: a6f1bd19-8eaf-4799-b581-dd8b047e31b7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:38.981522 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4428232-b2f3-44a8-8cc1-a6b7a63c620b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:38.982328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4428232-b2f3-44a8-8cc1-a6b7a63c620b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:38.983091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4428232-b2f3-44a8-8cc1-a6b7a63c620b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:38.983975 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4428232-b2f3-44a8-8cc1-a6b7a63c620b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:38.984103 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b39bdd36-013e-4dc5-842f-bd7bc0a510a0 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:38.984591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b39bdd36-013e-4dc5-842f-bd7bc0a510a0 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:38.984918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4428232-b2f3-44a8-8cc1-a6b7a63c620b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:38.985043 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b39bdd36-013e-4dc5-842f-bd7bc0a510a0 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:38.985719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b39bdd36-013e-4dc5-842f-bd7bc0a510a0 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:38.986215 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4428232-b2f3-44a8-8cc1-a6b7a63c620b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:38.986339 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b39bdd36-013e-4dc5-842f-bd7bc0a510a0 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:38.986659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b39bdd36-013e-4dc5-842f-bd7bc0a510a0 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:39.196679 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e4428232-b2f3-44a8-8cc1-a6b7a63c620b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:39.198714 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b39bdd36-013e-4dc5-842f-bd7bc0a510a0 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bb93640f644e73a4fce9b0682ce858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe912cae63448eea70d0acb20320a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:39.205960 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e4428232-b2f3-44a8-8cc1-a6b7a63c620b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1513 microversion: 2.1 time: 0.237190 Aug 04 17:07:39.206612 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1538/3143] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:38 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1513 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:39.208074 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b39bdd36-013e-4dc5-842f-bd7bc0a510a0 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7" status: 200 len: 1312 microversion: 2.1 time: 0.235266 Aug 04 17:07:39.209034 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1606/3144] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:38 2022] GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7 => generated 1312 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:39.571651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7121cfed-da59-4ae4-9f4d-104408e39218 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:39.572370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7121cfed-da59-4ae4-9f4d-104408e39218 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 092fa726-8d2e-4c49-a240-267ceea7404e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:39.579658 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7121cfed-da59-4ae4-9f4d-104408e39218 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:39.580140 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7121cfed-da59-4ae4-9f4d-104408e39218 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:39.580575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7121cfed-da59-4ae4-9f4d-104408e39218 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:39.581269 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7121cfed-da59-4ae4-9f4d-104408e39218 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:39.581742 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7121cfed-da59-4ae4-9f4d-104408e39218 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:39.582198 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7121cfed-da59-4ae4-9f4d-104408e39218 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:39.627194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d243b882-d968-470d-b326-f05c0adbfec6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:39.627930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d243b882-d968-470d-b326-f05c0adbfec6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:39.634969 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d243b882-d968-470d-b326-f05c0adbfec6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:39.635536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d243b882-d968-470d-b326-f05c0adbfec6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:39.636069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d243b882-d968-470d-b326-f05c0adbfec6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:39.636881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d243b882-d968-470d-b326-f05c0adbfec6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:39.637414 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d243b882-d968-470d-b326-f05c0adbfec6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:39.637916 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d243b882-d968-470d-b326-f05c0adbfec6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:39.776174 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7121cfed-da59-4ae4-9f4d-104408e39218 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:39.786732 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7121cfed-da59-4ae4-9f4d-104408e39218 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e" status: 200 len: 1316 microversion: 2.1 time: 0.218881 Aug 04 17:07:39.787974 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1539/3145] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:39 2022] GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e => generated 1316 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:39.807778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d243b882-d968-470d-b326-f05c0adbfec6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:39.816582 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d243b882-d968-470d-b326-f05c0adbfec6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1363 microversion: 2.1 time: 0.193335 Aug 04 17:07:39.826101 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1607/3146] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:39 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:39.935898 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1c322829-12df-46cc-a824-9971d26b2d20 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:39.936538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1c322829-12df-46cc-a824-9971d26b2d20 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:39.946882 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-03b9136b-40fc-4aba-95ba-2282f390f189 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:39.947504 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-03b9136b-40fc-4aba-95ba-2282f390f189 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] [instance: 67c9cf90-8220-45c0-a580-d027e81e558b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:39.950181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c322829-12df-46cc-a824-9971d26b2d20 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:39.950678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c322829-12df-46cc-a824-9971d26b2d20 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:39.951119 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c322829-12df-46cc-a824-9971d26b2d20 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:39.951868 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c322829-12df-46cc-a824-9971d26b2d20 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:39.952311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c322829-12df-46cc-a824-9971d26b2d20 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:39.952739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c322829-12df-46cc-a824-9971d26b2d20 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:39.963469 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03b9136b-40fc-4aba-95ba-2282f390f189 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:39.963980 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03b9136b-40fc-4aba-95ba-2282f390f189 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:39.964428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03b9136b-40fc-4aba-95ba-2282f390f189 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:39.965846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03b9136b-40fc-4aba-95ba-2282f390f189 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:39.966346 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03b9136b-40fc-4aba-95ba-2282f390f189 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:39.966775 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03b9136b-40fc-4aba-95ba-2282f390f189 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:40.159142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1c322829-12df-46cc-a824-9971d26b2d20 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:40.166954 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1c322829-12df-46cc-a824-9971d26b2d20 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1504 microversion: 2.1 time: 0.235319 Aug 04 17:07:40.167614 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1540/3147] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:39 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1504 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:40.173314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-03b9136b-40fc-4aba-95ba-2282f390f189 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a023a55a348a8bfc02c2818cd0901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0057b5901fc44b1eae04780a4813c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:40.181104 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-03b9136b-40fc-4aba-95ba-2282f390f189 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] 10.222.0.93 "GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b" status: 200 len: 1504 microversion: 2.1 time: 0.240172 Aug 04 17:07:40.181690 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1608/3148] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:39 2022] GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b => generated 1504 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:40.201676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-35b38b93-7e46-4422-b35b-b1f7f4134a46 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Calling method '.version_select at 0x7f1e5b3b29d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:40.202284 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-35b38b93-7e46-4422-b35b-b1f7f4134a46 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] [instance: 67c9cf90-8220-45c0-a580-d027e81e558b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:40.208309 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35b38b93-7e46-4422-b35b-b1f7f4134a46 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:40.208799 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35b38b93-7e46-4422-b35b-b1f7f4134a46 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:40.209242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35b38b93-7e46-4422-b35b-b1f7f4134a46 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:40.209939 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35b38b93-7e46-4422-b35b-b1f7f4134a46 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:40.210452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35b38b93-7e46-4422-b35b-b1f7f4134a46 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:40.210884 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35b38b93-7e46-4422-b35b-b1f7f4134a46 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:40.227374 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-10441e63-5ad2-4f7b-ace0-deeb3a87ee43 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:40.228158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-10441e63-5ad2-4f7b-ace0-deeb3a87ee43 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:40.234381 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-10441e63-5ad2-4f7b-ace0-deeb3a87ee43 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:40.234951 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-10441e63-5ad2-4f7b-ace0-deeb3a87ee43 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:40.235496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-10441e63-5ad2-4f7b-ace0-deeb3a87ee43 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:40.236263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-10441e63-5ad2-4f7b-ace0-deeb3a87ee43 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:40.236790 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-10441e63-5ad2-4f7b-ace0-deeb3a87ee43 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:40.237295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-10441e63-5ad2-4f7b-ace0-deeb3a87ee43 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:40.243974 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-35b38b93-7e46-4422-b35b-b1f7f4134a46 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] 10.222.0.93 "GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.046681 Aug 04 17:07:40.244690 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1541/3149] 10.222.0.93 () {58 vars in 1296 bytes} [Thu Aug 4 17:07:40 2022] GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b/os-instance-actions => generated 611 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:40.249591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aa723419-0e83-4f3e-ad03-a20de3aaa69a tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:40.250428 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aa723419-0e83-4f3e-ad03-a20de3aaa69a tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] [instance: a6f1bd19-8eaf-4799-b581-dd8b047e31b7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:40.256526 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa723419-0e83-4f3e-ad03-a20de3aaa69a tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:40.257018 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa723419-0e83-4f3e-ad03-a20de3aaa69a tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:40.257463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa723419-0e83-4f3e-ad03-a20de3aaa69a tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:40.258220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa723419-0e83-4f3e-ad03-a20de3aaa69a tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:40.258686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa723419-0e83-4f3e-ad03-a20de3aaa69a tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:40.259115 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa723419-0e83-4f3e-ad03-a20de3aaa69a tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:40.439191 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-10441e63-5ad2-4f7b-ace0-deeb3a87ee43 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:40.448016 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-10441e63-5ad2-4f7b-ace0-deeb3a87ee43 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1513 microversion: 2.1 time: 0.224414 Aug 04 17:07:40.451198 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-aa723419-0e83-4f3e-ad03-a20de3aaa69a tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bb93640f644e73a4fce9b0682ce858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe912cae63448eea70d0acb20320a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:40.457744 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1609/3150] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:40 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1513 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:40.459422 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aa723419-0e83-4f3e-ad03-a20de3aaa69a tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7" status: 200 len: 1312 microversion: 2.1 time: 0.213989 Aug 04 17:07:40.463247 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7594f849-b814-4531-8fa1-8d65ced03d43 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:40.463750 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7594f849-b814-4531-8fa1-8d65ced03d43 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] [instance: 67c9cf90-8220-45c0-a580-d027e81e558b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:40.463937 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1542/3151] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:40 2022] GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7 => generated 1312 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:40.469830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7594f849-b814-4531-8fa1-8d65ced03d43 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:40.470355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7594f849-b814-4531-8fa1-8d65ced03d43 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:40.470795 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7594f849-b814-4531-8fa1-8d65ced03d43 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:40.471519 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7594f849-b814-4531-8fa1-8d65ced03d43 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:40.472002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7594f849-b814-4531-8fa1-8d65ced03d43 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:40.472427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7594f849-b814-4531-8fa1-8d65ced03d43 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:40.497317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7594f849-b814-4531-8fa1-8d65ced03d43 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] [instance: 67c9cf90-8220-45c0-a580-d027e81e558b] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:07:40.578782 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7594f849-b814-4531-8fa1-8d65ced03d43 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] 10.222.0.93 "DELETE /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b" status: 204 len: 0 microversion: 2.1 time: 0.119438 Aug 04 17:07:40.579531 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1610/3152] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:07:40 2022] DELETE /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:07:40.588738 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8a1c4156-199c-4744-b013-19bb484d1dd6 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:40.589578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8a1c4156-199c-4744-b013-19bb484d1dd6 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] [instance: 67c9cf90-8220-45c0-a580-d027e81e558b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:40.596992 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a1c4156-199c-4744-b013-19bb484d1dd6 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:40.597151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a1c4156-199c-4744-b013-19bb484d1dd6 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:40.597631 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a1c4156-199c-4744-b013-19bb484d1dd6 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:40.598446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a1c4156-199c-4744-b013-19bb484d1dd6 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:40.598984 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a1c4156-199c-4744-b013-19bb484d1dd6 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:40.599624 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a1c4156-199c-4744-b013-19bb484d1dd6 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:40.739821 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8a1c4156-199c-4744-b013-19bb484d1dd6 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a023a55a348a8bfc02c2818cd0901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0057b5901fc44b1eae04780a4813c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:40.749196 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8a1c4156-199c-4744-b013-19bb484d1dd6 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] 10.222.0.93 "GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b" status: 200 len: 1510 microversion: 2.1 time: 0.164772 Aug 04 17:07:40.750016 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1543/3153] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:40 2022] GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:40.809552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6d3cfb8f-9d19-44df-a23b-f20c6756b316 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:40.810329 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6d3cfb8f-9d19-44df-a23b-f20c6756b316 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 092fa726-8d2e-4c49-a240-267ceea7404e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:40.817531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d3cfb8f-9d19-44df-a23b-f20c6756b316 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:40.818131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d3cfb8f-9d19-44df-a23b-f20c6756b316 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:40.818484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d3cfb8f-9d19-44df-a23b-f20c6756b316 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:40.819188 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d3cfb8f-9d19-44df-a23b-f20c6756b316 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:40.819723 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d3cfb8f-9d19-44df-a23b-f20c6756b316 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:40.820153 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d3cfb8f-9d19-44df-a23b-f20c6756b316 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:40.841359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-767d8b7d-c479-4aa3-a170-3a6ca5734b33 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:40.841688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:40.841795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-767d8b7d-c479-4aa3-a170-3a6ca5734b33 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:40.863412 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-767d8b7d-c479-4aa3-a170-3a6ca5734b33 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:40.863989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-767d8b7d-c479-4aa3-a170-3a6ca5734b33 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:40.864445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-767d8b7d-c479-4aa3-a170-3a6ca5734b33 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:40.865207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-767d8b7d-c479-4aa3-a170-3a6ca5734b33 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:40.865755 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-767d8b7d-c479-4aa3-a170-3a6ca5734b33 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:40.866198 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-767d8b7d-c479-4aa3-a170-3a6ca5734b33 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:40.910082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:41.053695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6d3cfb8f-9d19-44df-a23b-f20c6756b316 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:41.067981 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6d3cfb8f-9d19-44df-a23b-f20c6756b316 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e" status: 200 len: 1316 microversion: 2.1 time: 0.262909 Aug 04 17:07:41.069637 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1611/3154] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:40 2022] GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e => generated 1316 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:41.087074 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-767d8b7d-c479-4aa3-a170-3a6ca5734b33 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:41.098356 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-767d8b7d-c479-4aa3-a170-3a6ca5734b33 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1363 microversion: 2.1 time: 0.261739 Aug 04 17:07:41.107318 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1544/3155] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:40 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:41.118563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-99dcd508-adbc-4046-a700-2ff2f15f427c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:41.119152 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-99dcd508-adbc-4046-a700-2ff2f15f427c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:41.125743 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99dcd508-adbc-4046-a700-2ff2f15f427c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:41.126271 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99dcd508-adbc-4046-a700-2ff2f15f427c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:41.126720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99dcd508-adbc-4046-a700-2ff2f15f427c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:41.127461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99dcd508-adbc-4046-a700-2ff2f15f427c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:41.128006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99dcd508-adbc-4046-a700-2ff2f15f427c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:41.128443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99dcd508-adbc-4046-a700-2ff2f15f427c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:41.189289 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d3a8f57d-8771-4a3f-a199-0f8816380f37 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:41.190247 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d3a8f57d-8771-4a3f-a199-0f8816380f37 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:41.196669 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3a8f57d-8771-4a3f-a199-0f8816380f37 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:41.197370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3a8f57d-8771-4a3f-a199-0f8816380f37 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:41.197997 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3a8f57d-8771-4a3f-a199-0f8816380f37 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:41.198991 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3a8f57d-8771-4a3f-a199-0f8816380f37 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:41.199614 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3a8f57d-8771-4a3f-a199-0f8816380f37 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:41.200202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3a8f57d-8771-4a3f-a199-0f8816380f37 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:41.318653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-99dcd508-adbc-4046-a700-2ff2f15f427c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:41.329288 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-99dcd508-adbc-4046-a700-2ff2f15f427c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.214074 Aug 04 17:07:41.330175 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1612/3156] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:41 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:41.351262 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-85bbc5ca-4a0f-4f0a-bf08-7b845ed3b90c req-06ed2cfe-67ab-4818-aa0c-53f2767ed442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8865e4da-4c6b-4f67-bfdc-547839d7dab3", "name": "network-vif-plugged", "status": "completed", "tag": "e75f336b-22b2-4da1-8e13-8616b6b93832"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:41.361846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-85bbc5ca-4a0f-4f0a-bf08-7b845ed3b90c req-06ed2cfe-67ab-4818-aa0c-53f2767ed442 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:41.362431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-85bbc5ca-4a0f-4f0a-bf08-7b845ed3b90c req-06ed2cfe-67ab-4818-aa0c-53f2767ed442 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:41.363099 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-85bbc5ca-4a0f-4f0a-bf08-7b845ed3b90c req-06ed2cfe-67ab-4818-aa0c-53f2767ed442 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:41.368915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d3a8f57d-8771-4a3f-a199-0f8816380f37 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:41.375887 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-85bbc5ca-4a0f-4f0a-bf08-7b845ed3b90c req-06ed2cfe-67ab-4818-aa0c-53f2767ed442 service nova] Creating event network-vif-plugged:e75f336b-22b2-4da1-8e13-8616b6b93832 for instance 8865e4da-4c6b-4f67-bfdc-547839d7dab3 on n-h2-851359-3 Aug 04 17:07:41.381461 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d3a8f57d-8771-4a3f-a199-0f8816380f37 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1504 microversion: 2.1 time: 0.196614 Aug 04 17:07:41.381997 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-85bbc5ca-4a0f-4f0a-bf08-7b845ed3b90c req-06ed2cfe-67ab-4818-aa0c-53f2767ed442 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034328 Aug 04 17:07:41.382694 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1545/3157] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:41 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1504 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:41.383080 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1613/3158] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:41.388965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-21852f1d-6917-4aef-aa7a-de826135e60d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:41.389637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-21852f1d-6917-4aef-aa7a-de826135e60d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:41.395834 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21852f1d-6917-4aef-aa7a-de826135e60d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:41.396352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21852f1d-6917-4aef-aa7a-de826135e60d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:41.396777 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21852f1d-6917-4aef-aa7a-de826135e60d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:41.398295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21852f1d-6917-4aef-aa7a-de826135e60d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:41.399127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21852f1d-6917-4aef-aa7a-de826135e60d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:41.399575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21852f1d-6917-4aef-aa7a-de826135e60d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:41.416263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=38 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:41.470629 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3d63f4ba-c7d4-43be-b3b2-ac396cc07139 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:41.478994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3d63f4ba-c7d4-43be-b3b2-ac396cc07139 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:41.497145 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d63f4ba-c7d4-43be-b3b2-ac396cc07139 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:41.497770 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d63f4ba-c7d4-43be-b3b2-ac396cc07139 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:41.498369 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d63f4ba-c7d4-43be-b3b2-ac396cc07139 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:41.499165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d63f4ba-c7d4-43be-b3b2-ac396cc07139 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:41.499695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d63f4ba-c7d4-43be-b3b2-ac396cc07139 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:41.500195 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d63f4ba-c7d4-43be-b3b2-ac396cc07139 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:41.639004 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-21852f1d-6917-4aef-aa7a-de826135e60d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:41.646538 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-21852f1d-6917-4aef-aa7a-de826135e60d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.262844 Aug 04 17:07:41.647097 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1546/3159] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:41 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:41.651496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-742740f4-3d60-4bb6-b921-ee3b4ee4092f tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:41.652762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-742740f4-3d60-4bb6-b921-ee3b4ee4092f tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] [instance: a6f1bd19-8eaf-4799-b581-dd8b047e31b7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:41.658486 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-742740f4-3d60-4bb6-b921-ee3b4ee4092f tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:41.658980 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-742740f4-3d60-4bb6-b921-ee3b4ee4092f tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:41.659417 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-742740f4-3d60-4bb6-b921-ee3b4ee4092f tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:41.660113 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-742740f4-3d60-4bb6-b921-ee3b4ee4092f tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:41.660565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-742740f4-3d60-4bb6-b921-ee3b4ee4092f tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:41.660986 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-742740f4-3d60-4bb6-b921-ee3b4ee4092f tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:41.763857 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3d63f4ba-c7d4-43be-b3b2-ac396cc07139 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:41.774014 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3d63f4ba-c7d4-43be-b3b2-ac396cc07139 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1513 microversion: 2.1 time: 0.307940 Aug 04 17:07:41.785466 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1614/3160] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:41 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1513 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:41.785466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ec19609d-587a-49a3-981b-a83367428791 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:41.785466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ec19609d-587a-49a3-981b-a83367428791 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:41.788563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec19609d-587a-49a3-981b-a83367428791 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:41.789063 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec19609d-587a-49a3-981b-a83367428791 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:41.789512 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec19609d-587a-49a3-981b-a83367428791 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:41.790257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec19609d-587a-49a3-981b-a83367428791 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:41.790788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec19609d-587a-49a3-981b-a83367428791 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:41.791228 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec19609d-587a-49a3-981b-a83367428791 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:41.890031 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-742740f4-3d60-4bb6-b921-ee3b4ee4092f tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bb93640f644e73a4fce9b0682ce858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe912cae63448eea70d0acb20320a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:41.899972 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-742740f4-3d60-4bb6-b921-ee3b4ee4092f tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7" status: 200 len: 1312 microversion: 2.1 time: 0.251864 Aug 04 17:07:41.900559 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1547/3161] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:41 2022] GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7 => generated 1312 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:41.921755 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c8903af9-9f49-4b01-a9a9-fa43aba9cb96 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:41.925425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c8903af9-9f49-4b01-a9a9-fa43aba9cb96 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] [instance: 67c9cf90-8220-45c0-a580-d027e81e558b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:41.929532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8903af9-9f49-4b01-a9a9-fa43aba9cb96 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:41.930105 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8903af9-9f49-4b01-a9a9-fa43aba9cb96 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:41.930528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8903af9-9f49-4b01-a9a9-fa43aba9cb96 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:41.931232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8903af9-9f49-4b01-a9a9-fa43aba9cb96 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:41.931684 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8903af9-9f49-4b01-a9a9-fa43aba9cb96 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:41.932106 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8903af9-9f49-4b01-a9a9-fa43aba9cb96 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:41.981720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ec19609d-587a-49a3-981b-a83367428791 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:41.989302 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ec19609d-587a-49a3-981b-a83367428791 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.213362 Aug 04 17:07:41.989873 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1615/3162] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:41 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:42.010276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0aab6d0c-c888-4165-b504-213c466bdc45 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-17157955"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:42.013354 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0aab6d0c-c888-4165-b504-213c466bdc45 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:42.019557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0aab6d0c-c888-4165-b504-213c466bdc45 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:42.020129 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0aab6d0c-c888-4165-b504-213c466bdc45 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:42.020645 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0aab6d0c-c888-4165-b504-213c466bdc45 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:42.021427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0aab6d0c-c888-4165-b504-213c466bdc45 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:42.022006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0aab6d0c-c888-4165-b504-213c466bdc45 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:42.022610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0aab6d0c-c888-4165-b504-213c466bdc45 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:42.070505 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c8903af9-9f49-4b01-a9a9-fa43aba9cb96 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a023a55a348a8bfc02c2818cd0901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0057b5901fc44b1eae04780a4813c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:42.079364 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c8903af9-9f49-4b01-a9a9-fa43aba9cb96 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] 10.222.0.93 "GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b" status: 200 len: 1510 microversion: 2.1 time: 0.177249 Aug 04 17:07:42.079581 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1548/3163] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:41 2022] GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b => generated 1510 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:42.089098 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9408a03a-882a-4478-97fb-8a9b1cf71a60 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:42.089746 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9408a03a-882a-4478-97fb-8a9b1cf71a60 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 092fa726-8d2e-4c49-a240-267ceea7404e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:42.095909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9408a03a-882a-4478-97fb-8a9b1cf71a60 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:42.096392 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9408a03a-882a-4478-97fb-8a9b1cf71a60 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:42.096825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9408a03a-882a-4478-97fb-8a9b1cf71a60 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:42.097511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9408a03a-882a-4478-97fb-8a9b1cf71a60 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:42.097966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9408a03a-882a-4478-97fb-8a9b1cf71a60 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:42.098411 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9408a03a-882a-4478-97fb-8a9b1cf71a60 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:42.214943 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0aab6d0c-c888-4165-b504-213c466bdc45 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action" status: 202 len: 0 microversion: 2.1 time: 0.208481 Aug 04 17:07:42.215620 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1616/3164] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:07:42 2022] POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 04 17:07:42.225187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4fe2df66-0449-4051-892d-1d17517fd4fe tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:42.225906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4fe2df66-0449-4051-892d-1d17517fd4fe tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:42.232576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4fe2df66-0449-4051-892d-1d17517fd4fe tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:42.233073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4fe2df66-0449-4051-892d-1d17517fd4fe tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:42.233524 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4fe2df66-0449-4051-892d-1d17517fd4fe tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:42.234263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4fe2df66-0449-4051-892d-1d17517fd4fe tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:42.234732 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4fe2df66-0449-4051-892d-1d17517fd4fe tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:42.235168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4fe2df66-0449-4051-892d-1d17517fd4fe tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:42.255394 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9408a03a-882a-4478-97fb-8a9b1cf71a60 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:42.262927 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9408a03a-882a-4478-97fb-8a9b1cf71a60 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e" status: 200 len: 1316 microversion: 2.1 time: 0.177455 Aug 04 17:07:42.263581 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1549/3165] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:42 2022] GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e => generated 1316 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:42.364398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4fe2df66-0449-4051-892d-1d17517fd4fe tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:42.372462 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4fe2df66-0449-4051-892d-1d17517fd4fe tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1363 microversion: 2.1 time: 0.152400 Aug 04 17:07:42.373024 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1617/3166] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:42 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:42.402044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5166734f-0eaa-49d7-bbae-9d9d8b63d448 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:42.402684 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5166734f-0eaa-49d7-bbae-9d9d8b63d448 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:42.408684 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5166734f-0eaa-49d7-bbae-9d9d8b63d448 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:42.409177 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5166734f-0eaa-49d7-bbae-9d9d8b63d448 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:42.409640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5166734f-0eaa-49d7-bbae-9d9d8b63d448 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:42.410356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5166734f-0eaa-49d7-bbae-9d9d8b63d448 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:42.410825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5166734f-0eaa-49d7-bbae-9d9d8b63d448 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:42.411287 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5166734f-0eaa-49d7-bbae-9d9d8b63d448 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:42.542304 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5166734f-0eaa-49d7-bbae-9d9d8b63d448 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:42.550413 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5166734f-0eaa-49d7-bbae-9d9d8b63d448 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1504 microversion: 2.1 time: 0.152269 Aug 04 17:07:42.550991 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1550/3167] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:42 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:42.797565 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4e4f75ac-3027-4b8e-b60f-532e4cc310f1 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:42.798144 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4e4f75ac-3027-4b8e-b60f-532e4cc310f1 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:42.804175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e4f75ac-3027-4b8e-b60f-532e4cc310f1 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:42.804695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e4f75ac-3027-4b8e-b60f-532e4cc310f1 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:42.805138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e4f75ac-3027-4b8e-b60f-532e4cc310f1 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:42.805838 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e4f75ac-3027-4b8e-b60f-532e4cc310f1 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:42.806328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e4f75ac-3027-4b8e-b60f-532e4cc310f1 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:42.806761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e4f75ac-3027-4b8e-b60f-532e4cc310f1 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:42.932934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-caa9309f-0065-4330-bf01-a98bac29469d tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:42.933550 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-caa9309f-0065-4330-bf01-a98bac29469d tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] [instance: a6f1bd19-8eaf-4799-b581-dd8b047e31b7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:42.934177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4e4f75ac-3027-4b8e-b60f-532e4cc310f1 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:42.940828 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-caa9309f-0065-4330-bf01-a98bac29469d tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:42.941310 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-caa9309f-0065-4330-bf01-a98bac29469d tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:42.941745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-caa9309f-0065-4330-bf01-a98bac29469d tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:42.942148 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4e4f75ac-3027-4b8e-b60f-532e4cc310f1 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1513 microversion: 2.1 time: 0.149183 Aug 04 17:07:42.942466 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-caa9309f-0065-4330-bf01-a98bac29469d tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:42.942727 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1618/3168] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:42 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:42.942928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-caa9309f-0065-4330-bf01-a98bac29469d tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:42.943348 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-caa9309f-0065-4330-bf01-a98bac29469d tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:43.078360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-caa9309f-0065-4330-bf01-a98bac29469d tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bb93640f644e73a4fce9b0682ce858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe912cae63448eea70d0acb20320a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:43.085859 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-caa9309f-0065-4330-bf01-a98bac29469d tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7" status: 200 len: 1312 microversion: 2.1 time: 0.156898 Aug 04 17:07:43.086725 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1551/3169] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:42 2022] GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7 => generated 1312 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:43.100166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1579bbfe-7f47-4399-8a05-efbff13870c5 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:43.100827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1579bbfe-7f47-4399-8a05-efbff13870c5 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] [instance: 67c9cf90-8220-45c0-a580-d027e81e558b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:43.106751 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1579bbfe-7f47-4399-8a05-efbff13870c5 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:43.107257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1579bbfe-7f47-4399-8a05-efbff13870c5 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:43.107707 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1579bbfe-7f47-4399-8a05-efbff13870c5 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:43.108446 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1579bbfe-7f47-4399-8a05-efbff13870c5 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:43.108915 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1579bbfe-7f47-4399-8a05-efbff13870c5 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:43.109358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1579bbfe-7f47-4399-8a05-efbff13870c5 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:43.246837 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1579bbfe-7f47-4399-8a05-efbff13870c5 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a023a55a348a8bfc02c2818cd0901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0057b5901fc44b1eae04780a4813c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:43.257178 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1579bbfe-7f47-4399-8a05-efbff13870c5 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] 10.222.0.93 "GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b" status: 200 len: 1510 microversion: 2.1 time: 0.161870 Aug 04 17:07:43.257915 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1619/3170] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:43 2022] GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:43.284015 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-25026b03-3d4a-44f3-8b18-5570533e62fe tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:43.284631 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-25026b03-3d4a-44f3-8b18-5570533e62fe tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 092fa726-8d2e-4c49-a240-267ceea7404e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:43.290586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25026b03-3d4a-44f3-8b18-5570533e62fe tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:43.291074 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25026b03-3d4a-44f3-8b18-5570533e62fe tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:43.291513 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25026b03-3d4a-44f3-8b18-5570533e62fe tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:43.292216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25026b03-3d4a-44f3-8b18-5570533e62fe tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:43.292771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25026b03-3d4a-44f3-8b18-5570533e62fe tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:43.293195 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25026b03-3d4a-44f3-8b18-5570533e62fe tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:43.393338 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c34e079f-ca24-45d7-83ca-1f7915f8712e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:43.394270 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c34e079f-ca24-45d7-83ca-1f7915f8712e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:43.400456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c34e079f-ca24-45d7-83ca-1f7915f8712e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:43.400963 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c34e079f-ca24-45d7-83ca-1f7915f8712e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:43.401411 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c34e079f-ca24-45d7-83ca-1f7915f8712e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:43.402166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c34e079f-ca24-45d7-83ca-1f7915f8712e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:43.402629 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c34e079f-ca24-45d7-83ca-1f7915f8712e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:43.403055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c34e079f-ca24-45d7-83ca-1f7915f8712e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:43.430459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-25026b03-3d4a-44f3-8b18-5570533e62fe tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:43.434678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:43.440493 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-25026b03-3d4a-44f3-8b18-5570533e62fe tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e" status: 200 len: 1316 microversion: 2.1 time: 0.160289 Aug 04 17:07:43.441074 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1552/3171] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:43 2022] GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:43.445600 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-7b8bb564-5b78-44b1-bd8f-12ac8af760a3 req-5b9a40cc-edc0-4565-9e6a-348dbfd15795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "092fa726-8d2e-4c49-a240-267ceea7404e", "name": "network-vif-plugged", "status": "completed", "tag": "3e45099b-72eb-4bc4-83cd-3e008ee8a85d"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:43.456046 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7b8bb564-5b78-44b1-bd8f-12ac8af760a3 req-5b9a40cc-edc0-4565-9e6a-348dbfd15795 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:43.456529 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7b8bb564-5b78-44b1-bd8f-12ac8af760a3 req-5b9a40cc-edc0-4565-9e6a-348dbfd15795 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:43.456964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7b8bb564-5b78-44b1-bd8f-12ac8af760a3 req-5b9a40cc-edc0-4565-9e6a-348dbfd15795 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:43.468194 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-7b8bb564-5b78-44b1-bd8f-12ac8af760a3 req-5b9a40cc-edc0-4565-9e6a-348dbfd15795 service nova] Creating event network-vif-plugged:3e45099b-72eb-4bc4-83cd-3e008ee8a85d for instance 092fa726-8d2e-4c49-a240-267ceea7404e on n-h1-851359-3 Aug 04 17:07:43.473049 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-7b8bb564-5b78-44b1-bd8f-12ac8af760a3 req-5b9a40cc-edc0-4565-9e6a-348dbfd15795 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030871 Aug 04 17:07:43.473743 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1553/3172] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:43.536309 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c34e079f-ca24-45d7-83ca-1f7915f8712e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:43.543804 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c34e079f-ca24-45d7-83ca-1f7915f8712e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1363 microversion: 2.1 time: 0.154426 Aug 04 17:07:43.544369 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1620/3173] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:43 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:43.573199 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bedda158-b2f0-4097-a83c-aac75b07faec tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:43.573386 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bedda158-b2f0-4097-a83c-aac75b07faec tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:43.580938 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bedda158-b2f0-4097-a83c-aac75b07faec tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:43.581583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bedda158-b2f0-4097-a83c-aac75b07faec tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:43.582184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bedda158-b2f0-4097-a83c-aac75b07faec tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:43.582981 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bedda158-b2f0-4097-a83c-aac75b07faec tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:43.583497 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bedda158-b2f0-4097-a83c-aac75b07faec tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:43.583975 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bedda158-b2f0-4097-a83c-aac75b07faec tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:43.715058 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bedda158-b2f0-4097-a83c-aac75b07faec tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:43.722637 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bedda158-b2f0-4097-a83c-aac75b07faec tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1504 microversion: 2.1 time: 0.154233 Aug 04 17:07:43.723207 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1554/3174] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:43 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:43.963839 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4b67940f-e4f9-49fb-822d-5be3ad1d2598 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:43.965523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4b67940f-e4f9-49fb-822d-5be3ad1d2598 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:43.972521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b67940f-e4f9-49fb-822d-5be3ad1d2598 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:43.973046 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b67940f-e4f9-49fb-822d-5be3ad1d2598 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:43.973524 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b67940f-e4f9-49fb-822d-5be3ad1d2598 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:43.974259 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b67940f-e4f9-49fb-822d-5be3ad1d2598 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:43.974726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b67940f-e4f9-49fb-822d-5be3ad1d2598 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:43.975181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b67940f-e4f9-49fb-822d-5be3ad1d2598 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:44.107212 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c8d9fdeb-809d-4e63-89e2-8620ceee8213 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:44.107845 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c8d9fdeb-809d-4e63-89e2-8620ceee8213 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] [instance: a6f1bd19-8eaf-4799-b581-dd8b047e31b7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:44.119059 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8d9fdeb-809d-4e63-89e2-8620ceee8213 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:44.119931 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8d9fdeb-809d-4e63-89e2-8620ceee8213 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:44.121149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8d9fdeb-809d-4e63-89e2-8620ceee8213 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:44.122184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8d9fdeb-809d-4e63-89e2-8620ceee8213 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:44.122895 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8d9fdeb-809d-4e63-89e2-8620ceee8213 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:44.123542 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8d9fdeb-809d-4e63-89e2-8620ceee8213 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:44.134416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4b67940f-e4f9-49fb-822d-5be3ad1d2598 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:44.142974 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4b67940f-e4f9-49fb-822d-5be3ad1d2598 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1513 microversion: 2.1 time: 0.183170 Aug 04 17:07:44.143883 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1621/3175] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:43 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1513 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:44.261104 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c8d9fdeb-809d-4e63-89e2-8620ceee8213 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bb93640f644e73a4fce9b0682ce858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe912cae63448eea70d0acb20320a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:44.268791 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c8d9fdeb-809d-4e63-89e2-8620ceee8213 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7" status: 200 len: 1498 microversion: 2.1 time: 0.165649 Aug 04 17:07:44.269358 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1555/3176] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:44 2022] GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7 => generated 1498 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:44.280618 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b81c9455-0377-4a0d-a28e-d2d86d57cdd0 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:44.281249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b81c9455-0377-4a0d-a28e-d2d86d57cdd0 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] [instance: 67c9cf90-8220-45c0-a580-d027e81e558b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:44.289282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b81c9455-0377-4a0d-a28e-d2d86d57cdd0 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:44.290105 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b81c9455-0377-4a0d-a28e-d2d86d57cdd0 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:44.290885 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8a267e49-0a7f-44ea-94a1-54434840b284 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:44.291604 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b81c9455-0377-4a0d-a28e-d2d86d57cdd0 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:44.292444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b81c9455-0377-4a0d-a28e-d2d86d57cdd0 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:44.294161 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b81c9455-0377-4a0d-a28e-d2d86d57cdd0 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:44.294610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b81c9455-0377-4a0d-a28e-d2d86d57cdd0 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:44.305324 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.compute.server_groups [None req-8a267e49-0a7f-44ea-94a1-54434840b284 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Querying cell 435e901d-6672-4284-ad57-58e647e6e99d(cell1) for 1 instances {{(pid=131044) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 04 17:07:44.306091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a267e49-0a7f-44ea-94a1-54434840b284 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:44.307170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a267e49-0a7f-44ea-94a1-54434840b284 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:44.307170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a267e49-0a7f-44ea-94a1-54434840b284 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:44.324932 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8a267e49-0a7f-44ea-94a1-54434840b284 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "GET /compute/v2.1/os-server-groups/925e83cd-9458-4892-994c-134d009d5324" status: 200 len: 222 microversion: 2.1 time: 0.039423 Aug 04 17:07:44.325780 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1556/3177] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Aug 4 17:07:44 2022] GET /compute/v2.1/os-server-groups/925e83cd-9458-4892-994c-134d009d5324 => generated 222 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:44.336076 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0fb4ef68-422c-4dd0-a16e-7f1288fb49ea tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:44.336581 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0fb4ef68-422c-4dd0-a16e-7f1288fb49ea tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] [instance: a6f1bd19-8eaf-4799-b581-dd8b047e31b7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:44.345160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fb4ef68-422c-4dd0-a16e-7f1288fb49ea tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:44.345659 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fb4ef68-422c-4dd0-a16e-7f1288fb49ea tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:44.346133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fb4ef68-422c-4dd0-a16e-7f1288fb49ea tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:44.346844 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fb4ef68-422c-4dd0-a16e-7f1288fb49ea tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:44.347309 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fb4ef68-422c-4dd0-a16e-7f1288fb49ea tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:44.347765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fb4ef68-422c-4dd0-a16e-7f1288fb49ea tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:44.375979 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0fb4ef68-422c-4dd0-a16e-7f1288fb49ea tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] [instance: a6f1bd19-8eaf-4799-b581-dd8b047e31b7] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:07:44.456110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b81c9455-0377-4a0d-a28e-d2d86d57cdd0 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a023a55a348a8bfc02c2818cd0901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0057b5901fc44b1eae04780a4813c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:44.463131 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0fb4ef68-422c-4dd0-a16e-7f1288fb49ea tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "DELETE /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7" status: 204 len: 0 microversion: 2.1 time: 0.130493 Aug 04 17:07:44.463719 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1557/3178] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:07:44 2022] DELETE /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:07:44.465141 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b81c9455-0377-4a0d-a28e-d2d86d57cdd0 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] 10.222.0.93 "GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b" status: 200 len: 1510 microversion: 2.1 time: 0.190145 Aug 04 17:07:44.465890 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1622/3179] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:44 2022] GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b => generated 1510 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:44.469289 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dd79955e-3470-43bf-b4ee-4f770012d459 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:44.470039 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dd79955e-3470-43bf-b4ee-4f770012d459 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 092fa726-8d2e-4c49-a240-267ceea7404e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:44.474971 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a0f2022c-4a48-4f23-8d0a-3fb395d2ff2f tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:44.475717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a0f2022c-4a48-4f23-8d0a-3fb395d2ff2f tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] [instance: a6f1bd19-8eaf-4799-b581-dd8b047e31b7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:44.476427 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd79955e-3470-43bf-b4ee-4f770012d459 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:44.476918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd79955e-3470-43bf-b4ee-4f770012d459 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:44.477370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd79955e-3470-43bf-b4ee-4f770012d459 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:44.478098 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd79955e-3470-43bf-b4ee-4f770012d459 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:44.478559 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd79955e-3470-43bf-b4ee-4f770012d459 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:44.478992 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd79955e-3470-43bf-b4ee-4f770012d459 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:44.482374 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a0f2022c-4a48-4f23-8d0a-3fb395d2ff2f tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:44.482937 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a0f2022c-4a48-4f23-8d0a-3fb395d2ff2f tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:44.483384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a0f2022c-4a48-4f23-8d0a-3fb395d2ff2f tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:44.484084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a0f2022c-4a48-4f23-8d0a-3fb395d2ff2f tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:44.484549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a0f2022c-4a48-4f23-8d0a-3fb395d2ff2f tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:44.484981 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a0f2022c-4a48-4f23-8d0a-3fb395d2ff2f tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:44.675445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dd79955e-3470-43bf-b4ee-4f770012d459 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:44.679437 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a0f2022c-4a48-4f23-8d0a-3fb395d2ff2f tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bb93640f644e73a4fce9b0682ce858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe912cae63448eea70d0acb20320a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:44.683285 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dd79955e-3470-43bf-b4ee-4f770012d459 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e" status: 200 len: 1316 microversion: 2.1 time: 0.218325 Aug 04 17:07:44.683912 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1558/3180] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:44 2022] GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e => generated 1316 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:44.687957 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a0f2022c-4a48-4f23-8d0a-3fb395d2ff2f tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7" status: 200 len: 1504 microversion: 2.1 time: 0.216557 Aug 04 17:07:44.688616 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1623/3181] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:44 2022] GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7 => generated 1504 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:44.688826 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7dba0c7e-e448-4906-839c-3533fa8595f9 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:44.689425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7dba0c7e-e448-4906-839c-3533fa8595f9 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:44.695601 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7dba0c7e-e448-4906-839c-3533fa8595f9 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:44.696093 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7dba0c7e-e448-4906-839c-3533fa8595f9 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:44.696572 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7dba0c7e-e448-4906-839c-3533fa8595f9 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:44.697271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7dba0c7e-e448-4906-839c-3533fa8595f9 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:44.697733 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7dba0c7e-e448-4906-839c-3533fa8595f9 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:44.698197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7dba0c7e-e448-4906-839c-3533fa8595f9 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:44.743579 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cfad5f5d-e3cf-4bca-8800-3e92a34d7467 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:44.744213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cfad5f5d-e3cf-4bca-8800-3e92a34d7467 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:44.750523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cfad5f5d-e3cf-4bca-8800-3e92a34d7467 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:44.751042 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cfad5f5d-e3cf-4bca-8800-3e92a34d7467 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:44.751494 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cfad5f5d-e3cf-4bca-8800-3e92a34d7467 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:44.752268 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cfad5f5d-e3cf-4bca-8800-3e92a34d7467 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:44.752713 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cfad5f5d-e3cf-4bca-8800-3e92a34d7467 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:44.753150 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cfad5f5d-e3cf-4bca-8800-3e92a34d7467 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:45.199803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7dba0c7e-e448-4906-839c-3533fa8595f9 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:45.206302 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cfad5f5d-e3cf-4bca-8800-3e92a34d7467 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:45.208061 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7dba0c7e-e448-4906-839c-3533fa8595f9 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1550 microversion: 2.1 time: 0.523103 Aug 04 17:07:45.208644 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1559/3182] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:44 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1550 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:45.213522 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-44f12eb8-f9aa-4916-aa10-edc3648a3081 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:45.213915 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cfad5f5d-e3cf-4bca-8800-3e92a34d7467 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1504 microversion: 2.1 time: 0.474451 Aug 04 17:07:45.214160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-44f12eb8-f9aa-4916-aa10-edc3648a3081 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:45.218082 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1624/3183] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:44 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1504 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:45.220003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44f12eb8-f9aa-4916-aa10-edc3648a3081 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:45.220488 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44f12eb8-f9aa-4916-aa10-edc3648a3081 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:45.220924 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44f12eb8-f9aa-4916-aa10-edc3648a3081 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:45.221617 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44f12eb8-f9aa-4916-aa10-edc3648a3081 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:45.222092 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44f12eb8-f9aa-4916-aa10-edc3648a3081 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:45.222520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44f12eb8-f9aa-4916-aa10-edc3648a3081 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:45.231498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7d8057fb-97d6-4a1d-8df7-cce5e68e5129 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:45.231998 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7d8057fb-97d6-4a1d-8df7-cce5e68e5129 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:45.237853 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d8057fb-97d6-4a1d-8df7-cce5e68e5129 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:45.238386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d8057fb-97d6-4a1d-8df7-cce5e68e5129 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:45.238825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d8057fb-97d6-4a1d-8df7-cce5e68e5129 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:45.239519 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d8057fb-97d6-4a1d-8df7-cce5e68e5129 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:45.239977 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d8057fb-97d6-4a1d-8df7-cce5e68e5129 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:45.240406 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d8057fb-97d6-4a1d-8df7-cce5e68e5129 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:45.360556 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7d8057fb-97d6-4a1d-8df7-cce5e68e5129 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.134303 Aug 04 17:07:45.361237 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1625/3184] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Aug 4 17:07:45 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3/os-interface => generated 285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:45.392393 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-44f12eb8-f9aa-4916-aa10-edc3648a3081 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:45.400495 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-44f12eb8-f9aa-4916-aa10-edc3648a3081 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1513 microversion: 2.1 time: 0.190769 Aug 04 17:07:45.401271 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1560/3185] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:45 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1513 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:45.486774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6931308b-e4cf-4b2a-8639-ff1d535d6ce7 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:45.487409 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6931308b-e4cf-4b2a-8639-ff1d535d6ce7 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] [instance: 67c9cf90-8220-45c0-a580-d027e81e558b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:45.493617 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6931308b-e4cf-4b2a-8639-ff1d535d6ce7 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:45.494165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6931308b-e4cf-4b2a-8639-ff1d535d6ce7 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:45.494619 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6931308b-e4cf-4b2a-8639-ff1d535d6ce7 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:45.495335 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6931308b-e4cf-4b2a-8639-ff1d535d6ce7 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:45.495855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6931308b-e4cf-4b2a-8639-ff1d535d6ce7 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:45.496900 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6931308b-e4cf-4b2a-8639-ff1d535d6ce7 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:45.705955 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2a187d37-9a1a-4e9d-bc13-9b079902be26 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:45.706493 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2a187d37-9a1a-4e9d-bc13-9b079902be26 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 092fa726-8d2e-4c49-a240-267ceea7404e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:45.712841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a187d37-9a1a-4e9d-bc13-9b079902be26 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:45.713441 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a187d37-9a1a-4e9d-bc13-9b079902be26 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:45.714140 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a187d37-9a1a-4e9d-bc13-9b079902be26 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:45.715448 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a187d37-9a1a-4e9d-bc13-9b079902be26 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:45.716012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a187d37-9a1a-4e9d-bc13-9b079902be26 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:45.716567 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a187d37-9a1a-4e9d-bc13-9b079902be26 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:45.716837 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6931308b-e4cf-4b2a-8639-ff1d535d6ce7 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a023a55a348a8bfc02c2818cd0901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0057b5901fc44b1eae04780a4813c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:45.727156 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6931308b-e4cf-4b2a-8639-ff1d535d6ce7 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] 10.222.0.93 "GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b" status: 200 len: 1510 microversion: 2.1 time: 0.244454 Aug 04 17:07:45.741906 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1626/3186] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:45 2022] GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b => generated 1510 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:45.749167 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-791625d1-1d95-42ff-ba2d-1374f082c180 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:45.750086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-791625d1-1d95-42ff-ba2d-1374f082c180 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] [instance: a6f1bd19-8eaf-4799-b581-dd8b047e31b7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:45.757899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-791625d1-1d95-42ff-ba2d-1374f082c180 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:45.758503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-791625d1-1d95-42ff-ba2d-1374f082c180 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:45.759159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-791625d1-1d95-42ff-ba2d-1374f082c180 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:45.759938 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-791625d1-1d95-42ff-ba2d-1374f082c180 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:45.760476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-791625d1-1d95-42ff-ba2d-1374f082c180 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:45.761039 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-791625d1-1d95-42ff-ba2d-1374f082c180 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:46.032993 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2a187d37-9a1a-4e9d-bc13-9b079902be26 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:46.040036 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-791625d1-1d95-42ff-ba2d-1374f082c180 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bb93640f644e73a4fce9b0682ce858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe912cae63448eea70d0acb20320a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:46.040774 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2a187d37-9a1a-4e9d-bc13-9b079902be26 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e" status: 200 len: 1316 microversion: 2.1 time: 0.340221 Aug 04 17:07:46.041353 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1561/3187] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:45 2022] GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e => generated 1316 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:46.055503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:46.062586 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-791625d1-1d95-42ff-ba2d-1374f082c180 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7" status: 200 len: 1504 microversion: 2.1 time: 0.318976 Aug 04 17:07:46.063363 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1627/3188] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:45 2022] GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7 => generated 1504 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:46.235428 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2800b569-c9b8-40ef-88ba-c8440b0b8be2 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:46.236065 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2800b569-c9b8-40ef-88ba-c8440b0b8be2 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:46.243111 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2800b569-c9b8-40ef-88ba-c8440b0b8be2 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:46.243869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2800b569-c9b8-40ef-88ba-c8440b0b8be2 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:46.244744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2800b569-c9b8-40ef-88ba-c8440b0b8be2 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:46.245479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2800b569-c9b8-40ef-88ba-c8440b0b8be2 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:46.245941 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2800b569-c9b8-40ef-88ba-c8440b0b8be2 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:46.246591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2800b569-c9b8-40ef-88ba-c8440b0b8be2 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:46.414772 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2800b569-c9b8-40ef-88ba-c8440b0b8be2 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:46.422700 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2800b569-c9b8-40ef-88ba-c8440b0b8be2 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1504 microversion: 2.1 time: 0.191591 Aug 04 17:07:46.423361 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1562/3189] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:46 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1504 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:46.424057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-40be52e0-6699-4f0e-93ba-0f6bf335251d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:46.424707 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-40be52e0-6699-4f0e-93ba-0f6bf335251d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:46.431078 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-40be52e0-6699-4f0e-93ba-0f6bf335251d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:46.431583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-40be52e0-6699-4f0e-93ba-0f6bf335251d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:46.432035 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-40be52e0-6699-4f0e-93ba-0f6bf335251d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:46.432753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-40be52e0-6699-4f0e-93ba-0f6bf335251d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:46.438058 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-40be52e0-6699-4f0e-93ba-0f6bf335251d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:46.438534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-40be52e0-6699-4f0e-93ba-0f6bf335251d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:46.482497 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-e81867d7-b4c8-49de-9637-7364ab8fe1b7 req-bac47865-4d06-4e44-a46b-62eeda8e8efc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8865e4da-4c6b-4f67-bfdc-547839d7dab3", "tag": "e75f336b-22b2-4da1-8e13-8616b6b93832"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:46.496740 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e81867d7-b4c8-49de-9637-7364ab8fe1b7 req-bac47865-4d06-4e44-a46b-62eeda8e8efc service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:46.497521 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e81867d7-b4c8-49de-9637-7364ab8fe1b7 req-bac47865-4d06-4e44-a46b-62eeda8e8efc service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:46.498193 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e81867d7-b4c8-49de-9637-7364ab8fe1b7 req-bac47865-4d06-4e44-a46b-62eeda8e8efc service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:46.517221 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-e81867d7-b4c8-49de-9637-7364ab8fe1b7 req-bac47865-4d06-4e44-a46b-62eeda8e8efc service nova] Creating event network-changed:e75f336b-22b2-4da1-8e13-8616b6b93832 for instance 8865e4da-4c6b-4f67-bfdc-547839d7dab3 on n-h2-851359-3 Aug 04 17:07:46.525482 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-e81867d7-b4c8-49de-9637-7364ab8fe1b7 req-bac47865-4d06-4e44-a46b-62eeda8e8efc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046663 Aug 04 17:07:46.526426 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1563/3190] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:07:46.704106 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-40be52e0-6699-4f0e-93ba-0f6bf335251d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:46.715180 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-40be52e0-6699-4f0e-93ba-0f6bf335251d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1513 microversion: 2.1 time: 0.296374 Aug 04 17:07:46.732663 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1628/3191] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:46 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1513 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:46.749896 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-26025b57-6048-404c-b081-eb52b654995c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:46.751251 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-26025b57-6048-404c-b081-eb52b654995c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] [instance: 67c9cf90-8220-45c0-a580-d027e81e558b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:46.757012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:46.759122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26025b57-6048-404c-b081-eb52b654995c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:46.759865 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26025b57-6048-404c-b081-eb52b654995c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:46.760861 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26025b57-6048-404c-b081-eb52b654995c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:46.761951 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26025b57-6048-404c-b081-eb52b654995c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:46.762683 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26025b57-6048-404c-b081-eb52b654995c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:46.763317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26025b57-6048-404c-b081-eb52b654995c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:47.015699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-26025b57-6048-404c-b081-eb52b654995c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a023a55a348a8bfc02c2818cd0901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0057b5901fc44b1eae04780a4813c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:47.030176 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-26025b57-6048-404c-b081-eb52b654995c tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] 10.222.0.93 "GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b" status: 200 len: 1510 microversion: 2.1 time: 0.285112 Aug 04 17:07:47.033636 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1564/3192] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:46 2022] GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b => generated 1510 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:47.061690 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9295da52-ad3d-42ed-9872-ba4b59393ff3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:47.062934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9295da52-ad3d-42ed-9872-ba4b59393ff3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 092fa726-8d2e-4c49-a240-267ceea7404e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:47.086788 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cd692a9c-cd8c-4998-a79a-2760bd1e5bf3 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:47.088619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cd692a9c-cd8c-4998-a79a-2760bd1e5bf3 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] [instance: a6f1bd19-8eaf-4799-b581-dd8b047e31b7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:47.100127 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9295da52-ad3d-42ed-9872-ba4b59393ff3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:47.102504 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9295da52-ad3d-42ed-9872-ba4b59393ff3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:47.105317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd692a9c-cd8c-4998-a79a-2760bd1e5bf3 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:47.105716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9295da52-ad3d-42ed-9872-ba4b59393ff3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:47.107082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9295da52-ad3d-42ed-9872-ba4b59393ff3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:47.108345 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd692a9c-cd8c-4998-a79a-2760bd1e5bf3 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:47.108876 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9295da52-ad3d-42ed-9872-ba4b59393ff3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:47.110460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9295da52-ad3d-42ed-9872-ba4b59393ff3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:47.110715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd692a9c-cd8c-4998-a79a-2760bd1e5bf3 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:47.113460 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd692a9c-cd8c-4998-a79a-2760bd1e5bf3 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:47.114793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd692a9c-cd8c-4998-a79a-2760bd1e5bf3 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:47.116073 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd692a9c-cd8c-4998-a79a-2760bd1e5bf3 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:47.534664 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9295da52-ad3d-42ed-9872-ba4b59393ff3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:47.548078 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9295da52-ad3d-42ed-9872-ba4b59393ff3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e" status: 200 len: 1316 microversion: 2.1 time: 0.491071 Aug 04 17:07:47.548726 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1629/3193] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:47 2022] GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e => generated 1316 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:47.554349 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1d1f95c5-a567-41d4-976f-1c5fdec08167 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:47.554985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1d1f95c5-a567-41d4-976f-1c5fdec08167 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:47.581304 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d1f95c5-a567-41d4-976f-1c5fdec08167 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:47.582256 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d1f95c5-a567-41d4-976f-1c5fdec08167 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:47.582921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d1f95c5-a567-41d4-976f-1c5fdec08167 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:47.583655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d1f95c5-a567-41d4-976f-1c5fdec08167 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:47.584133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d1f95c5-a567-41d4-976f-1c5fdec08167 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:47.584576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d1f95c5-a567-41d4-976f-1c5fdec08167 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:47.585119 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cd692a9c-cd8c-4998-a79a-2760bd1e5bf3 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bb93640f644e73a4fce9b0682ce858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe912cae63448eea70d0acb20320a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:47.593687 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cd692a9c-cd8c-4998-a79a-2760bd1e5bf3 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7" status: 200 len: 1504 microversion: 2.1 time: 0.513429 Aug 04 17:07:47.596967 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1565/3194] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:47 2022] GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7 => generated 1504 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:47.739784 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-56674e50-7080-4b26-80c7-45855c58089c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:47.740319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-56674e50-7080-4b26-80c7-45855c58089c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:47.747232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56674e50-7080-4b26-80c7-45855c58089c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:47.747726 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56674e50-7080-4b26-80c7-45855c58089c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:47.748730 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56674e50-7080-4b26-80c7-45855c58089c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:47.748851 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1d1f95c5-a567-41d4-976f-1c5fdec08167 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:47.748964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56674e50-7080-4b26-80c7-45855c58089c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:47.749308 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56674e50-7080-4b26-80c7-45855c58089c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:47.749738 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56674e50-7080-4b26-80c7-45855c58089c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:47.756440 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1d1f95c5-a567-41d4-976f-1c5fdec08167 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1504 microversion: 2.1 time: 0.206143 Aug 04 17:07:47.757283 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1630/3195] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:47 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1504 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:47.931089 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-56674e50-7080-4b26-80c7-45855c58089c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:47.939127 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-56674e50-7080-4b26-80c7-45855c58089c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1513 microversion: 2.1 time: 0.203379 Aug 04 17:07:47.939714 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1566/3196] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:47 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1513 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:48.053201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-07c2b4fe-7c57-4a81-a318-3bda5bd47ccf tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:48.053833 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-07c2b4fe-7c57-4a81-a318-3bda5bd47ccf tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] [instance: 67c9cf90-8220-45c0-a580-d027e81e558b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:48.060314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-07c2b4fe-7c57-4a81-a318-3bda5bd47ccf tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:48.060823 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-07c2b4fe-7c57-4a81-a318-3bda5bd47ccf tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:48.062012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-07c2b4fe-7c57-4a81-a318-3bda5bd47ccf tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:48.063003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-07c2b4fe-7c57-4a81-a318-3bda5bd47ccf tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:48.063484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-07c2b4fe-7c57-4a81-a318-3bda5bd47ccf tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:48.063919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-07c2b4fe-7c57-4a81-a318-3bda5bd47ccf tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:48.136832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-07c2b4fe-7c57-4a81-a318-3bda5bd47ccf tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a023a55a348a8bfc02c2818cd0901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0057b5901fc44b1eae04780a4813c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:48.146003 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-07c2b4fe-7c57-4a81-a318-3bda5bd47ccf tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] 10.222.0.93 "GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b" status: 200 len: 1468 microversion: 2.1 time: 0.096766 Aug 04 17:07:48.146520 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1631/3197] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:48 2022] GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b => generated 1468 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:48.542427 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-2deb2118-1b36-4d5b-a1d2-d1adcfb76926 req-8d0cc446-3e4d-4c2e-8b17-732788f399af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67c9cf90-8220-45c0-a580-d027e81e558b", "name": "network-vif-deleted", "tag": "305f293e-0747-4a76-9e1d-574caaefe1a2"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:48.552667 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2deb2118-1b36-4d5b-a1d2-d1adcfb76926 req-8d0cc446-3e4d-4c2e-8b17-732788f399af service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:48.553148 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2deb2118-1b36-4d5b-a1d2-d1adcfb76926 req-8d0cc446-3e4d-4c2e-8b17-732788f399af service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:48.553579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2deb2118-1b36-4d5b-a1d2-d1adcfb76926 req-8d0cc446-3e4d-4c2e-8b17-732788f399af service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:48.565543 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-2deb2118-1b36-4d5b-a1d2-d1adcfb76926 req-8d0cc446-3e4d-4c2e-8b17-732788f399af service nova] Creating event network-vif-deleted:305f293e-0747-4a76-9e1d-574caaefe1a2 for instance 67c9cf90-8220-45c0-a580-d027e81e558b on n-h1-851359-3 Aug 04 17:07:48.568901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e8d1208e-2dcc-46a7-b384-1752e61c2e2f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:48.569787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e8d1208e-2dcc-46a7-b384-1752e61c2e2f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 092fa726-8d2e-4c49-a240-267ceea7404e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:48.570748 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-2deb2118-1b36-4d5b-a1d2-d1adcfb76926 req-8d0cc446-3e4d-4c2e-8b17-732788f399af service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031997 Aug 04 17:07:48.571511 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1567/3198] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:48.577173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8d1208e-2dcc-46a7-b384-1752e61c2e2f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:48.577713 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8d1208e-2dcc-46a7-b384-1752e61c2e2f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:48.578224 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8d1208e-2dcc-46a7-b384-1752e61c2e2f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:48.578991 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8d1208e-2dcc-46a7-b384-1752e61c2e2f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:48.579557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8d1208e-2dcc-46a7-b384-1752e61c2e2f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:48.580021 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8d1208e-2dcc-46a7-b384-1752e61c2e2f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:48.617625 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3486c4c4-9974-40e1-81e7-2372bd4d1cdf tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:48.618358 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3486c4c4-9974-40e1-81e7-2372bd4d1cdf tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] [instance: a6f1bd19-8eaf-4799-b581-dd8b047e31b7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:48.625113 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3486c4c4-9974-40e1-81e7-2372bd4d1cdf tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:48.625610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3486c4c4-9974-40e1-81e7-2372bd4d1cdf tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:48.626082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3486c4c4-9974-40e1-81e7-2372bd4d1cdf tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:48.626792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3486c4c4-9974-40e1-81e7-2372bd4d1cdf tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:48.627258 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3486c4c4-9974-40e1-81e7-2372bd4d1cdf tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:48.627692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3486c4c4-9974-40e1-81e7-2372bd4d1cdf tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:48.796704 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e8d1208e-2dcc-46a7-b384-1752e61c2e2f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:48.816327 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e8d1208e-2dcc-46a7-b384-1752e61c2e2f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e" status: 200 len: 1316 microversion: 2.1 time: 0.246134 Aug 04 17:07:48.817382 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1632/3199] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:48 2022] GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e => generated 1316 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:48.826615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cc0569d3-0980-4990-ac08-d096f3ec0d37 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:48.827917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cc0569d3-0980-4990-ac08-d096f3ec0d37 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:48.833913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3486c4c4-9974-40e1-81e7-2372bd4d1cdf tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bb93640f644e73a4fce9b0682ce858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe912cae63448eea70d0acb20320a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:48.835391 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc0569d3-0980-4990-ac08-d096f3ec0d37 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:48.836830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc0569d3-0980-4990-ac08-d096f3ec0d37 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:48.837460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc0569d3-0980-4990-ac08-d096f3ec0d37 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:48.838985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc0569d3-0980-4990-ac08-d096f3ec0d37 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:48.838985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc0569d3-0980-4990-ac08-d096f3ec0d37 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:48.839872 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc0569d3-0980-4990-ac08-d096f3ec0d37 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:48.842670 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3486c4c4-9974-40e1-81e7-2372bd4d1cdf tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7" status: 200 len: 1504 microversion: 2.1 time: 0.229339 Aug 04 17:07:48.843570 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1568/3200] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:48 2022] GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7 => generated 1504 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:48.961663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d3e1bd0b-11b7-40bd-b509-4e00b6fbf7be tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:48.962952 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d3e1bd0b-11b7-40bd-b509-4e00b6fbf7be tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:48.971319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3e1bd0b-11b7-40bd-b509-4e00b6fbf7be tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:48.972137 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3e1bd0b-11b7-40bd-b509-4e00b6fbf7be tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:48.972745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3e1bd0b-11b7-40bd-b509-4e00b6fbf7be tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:48.973671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3e1bd0b-11b7-40bd-b509-4e00b6fbf7be tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:48.974172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3e1bd0b-11b7-40bd-b509-4e00b6fbf7be tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:48.974753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3e1bd0b-11b7-40bd-b509-4e00b6fbf7be tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:49.018219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cc0569d3-0980-4990-ac08-d096f3ec0d37 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:49.028558 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cc0569d3-0980-4990-ac08-d096f3ec0d37 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1484 microversion: 2.1 time: 0.209038 Aug 04 17:07:49.029258 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1633/3201] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:48 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1484 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:49.168100 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2aea7e85-b6ca-4012-92cb-0cc1aede1250 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:49.171184 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2aea7e85-b6ca-4012-92cb-0cc1aede1250 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] [instance: 67c9cf90-8220-45c0-a580-d027e81e558b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:49.188067 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2aea7e85-b6ca-4012-92cb-0cc1aede1250 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:49.188575 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2aea7e85-b6ca-4012-92cb-0cc1aede1250 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:49.189030 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2aea7e85-b6ca-4012-92cb-0cc1aede1250 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:49.189886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2aea7e85-b6ca-4012-92cb-0cc1aede1250 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:49.192062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2aea7e85-b6ca-4012-92cb-0cc1aede1250 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:49.193817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2aea7e85-b6ca-4012-92cb-0cc1aede1250 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:49.280484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2aea7e85-b6ca-4012-92cb-0cc1aede1250 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:49.282424 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2aea7e85-b6ca-4012-92cb-0cc1aede1250 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:49.284231 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2aea7e85-b6ca-4012-92cb-0cc1aede1250 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:49.284738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-2aea7e85-b6ca-4012-92cb-0cc1aede1250 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lazy-loading 'fault' on Instance uuid 67c9cf90-8220-45c0-a580-d027e81e558b {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:07:49.295463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d3e1bd0b-11b7-40bd-b509-4e00b6fbf7be tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:49.313270 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d3e1bd0b-11b7-40bd-b509-4e00b6fbf7be tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1513 microversion: 2.1 time: 0.356934 Aug 04 17:07:49.314518 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1569/3202] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:48 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1513 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:49.319943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e8492c1f-8928-44d8-ae56-a4c9040dab3a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1804189215", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:49.375721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2aea7e85-b6ca-4012-92cb-0cc1aede1250 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27a023a55a348a8bfc02c2818cd0901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0057b5901fc44b1eae04780a4813c6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:49.391916 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2aea7e85-b6ca-4012-92cb-0cc1aede1250 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] 10.222.0.93 "GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b" status: 200 len: 1306 microversion: 2.1 time: 0.228464 Aug 04 17:07:49.406000 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1634/3203] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:49 2022] GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b => generated 1306 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:49.418773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-e8492c1f-8928-44d8-ae56-a4c9040dab3a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] validate_networks() for [('b4b149c9-2029-4f42-81f7-ee2fe42fc51a', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:07:49.836887 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-38380cf5-b3c1-41f0-962f-7f5efe99243a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:49.837637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-38380cf5-b3c1-41f0-962f-7f5efe99243a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 092fa726-8d2e-4c49-a240-267ceea7404e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:49.855968 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38380cf5-b3c1-41f0-962f-7f5efe99243a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:49.857229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38380cf5-b3c1-41f0-962f-7f5efe99243a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:49.859650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38380cf5-b3c1-41f0-962f-7f5efe99243a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:49.860736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38380cf5-b3c1-41f0-962f-7f5efe99243a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:49.861422 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38380cf5-b3c1-41f0-962f-7f5efe99243a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:49.862053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38380cf5-b3c1-41f0-962f-7f5efe99243a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:49.879172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e8492c1f-8928-44d8-ae56-a4c9040dab3a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:07:49.880907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e8492c1f-8928-44d8-ae56-a4c9040dab3a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:07:49.881837 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e8492c1f-8928-44d8-ae56-a4c9040dab3a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:07:49.882815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e8492c1f-8928-44d8-ae56-a4c9040dab3a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:07:49.883766 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e8492c1f-8928-44d8-ae56-a4c9040dab3a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:07:49.906910 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8492c1f-8928-44d8-ae56-a4c9040dab3a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:49.907421 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8492c1f-8928-44d8-ae56-a4c9040dab3a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:49.907913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8492c1f-8928-44d8-ae56-a4c9040dab3a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:49.909338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8492c1f-8928-44d8-ae56-a4c9040dab3a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:49.911204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8492c1f-8928-44d8-ae56-a4c9040dab3a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:49.911747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8492c1f-8928-44d8-ae56-a4c9040dab3a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:49.940256 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:49.955142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e8492c1f-8928-44d8-ae56-a4c9040dab3a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Getting quotas for project 383c0418c5f849128e0a384ccdc434b4. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:07:49.963366 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e8492c1f-8928-44d8-ae56-a4c9040dab3a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Getting quotas for user aae152a1d00c40409aa78f8a5cff5895 and project 383c0418c5f849128e0a384ccdc434b4. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:07:49.980467 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e8492c1f-8928-44d8-ae56-a4c9040dab3a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:07:49.983231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e8492c1f-8928-44d8-ae56-a4c9040dab3a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:07:50.033172 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-38380cf5-b3c1-41f0-962f-7f5efe99243a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:50.035103 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e8492c1f-8928-44d8-ae56-a4c9040dab3a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.718815 Aug 04 17:07:50.038670 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1570/3204] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:07:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:07:50.042070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fa2ff527-c30f-49bc-91cc-ac64bf8df9c0 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:50.043426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fa2ff527-c30f-49bc-91cc-ac64bf8df9c0 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] [instance: a6f1bd19-8eaf-4799-b581-dd8b047e31b7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:50.043912 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-38380cf5-b3c1-41f0-962f-7f5efe99243a tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e" status: 200 len: 1466 microversion: 2.1 time: 0.210889 Aug 04 17:07:50.044649 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1635/3205] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:49 2022] GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e => generated 1466 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:50.049763 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e66f5c52-6c5c-4d42-a0ed-5cf8e08eaba5 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:50.050466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e66f5c52-6c5c-4d42-a0ed-5cf8e08eaba5 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:50.063708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa2ff527-c30f-49bc-91cc-ac64bf8df9c0 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:50.064244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa2ff527-c30f-49bc-91cc-ac64bf8df9c0 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:50.065026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa2ff527-c30f-49bc-91cc-ac64bf8df9c0 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:50.065747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa2ff527-c30f-49bc-91cc-ac64bf8df9c0 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:50.066294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa2ff527-c30f-49bc-91cc-ac64bf8df9c0 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:50.066796 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa2ff527-c30f-49bc-91cc-ac64bf8df9c0 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:50.100598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa2ff527-c30f-49bc-91cc-ac64bf8df9c0 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:50.101095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa2ff527-c30f-49bc-91cc-ac64bf8df9c0 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:50.101541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa2ff527-c30f-49bc-91cc-ac64bf8df9c0 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:50.102016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-fa2ff527-c30f-49bc-91cc-ac64bf8df9c0 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lazy-loading 'fault' on Instance uuid a6f1bd19-8eaf-4799-b581-dd8b047e31b7 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:07:50.113911 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e66f5c52-6c5c-4d42-a0ed-5cf8e08eaba5 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:50.121658 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e66f5c52-6c5c-4d42-a0ed-5cf8e08eaba5 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1214 microversion: 2.1 time: 0.075729 Aug 04 17:07:50.122367 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1636/3206] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:50 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:50.135008 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b77f8ca8-2e97-42bf-a0a2-280067e20733 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:50.135008 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b77f8ca8-2e97-42bf-a0a2-280067e20733 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] [instance: 092fa726-8d2e-4c49-a240-267ceea7404e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:50.136892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b77f8ca8-2e97-42bf-a0a2-280067e20733 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:50.137428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b77f8ca8-2e97-42bf-a0a2-280067e20733 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:50.137817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b77f8ca8-2e97-42bf-a0a2-280067e20733 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:50.138618 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b77f8ca8-2e97-42bf-a0a2-280067e20733 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:50.139091 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b77f8ca8-2e97-42bf-a0a2-280067e20733 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:50.139531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b77f8ca8-2e97-42bf-a0a2-280067e20733 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:50.146549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fa2ff527-c30f-49bc-91cc-ac64bf8df9c0 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bb93640f644e73a4fce9b0682ce858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe912cae63448eea70d0acb20320a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:50.156597 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fa2ff527-c30f-49bc-91cc-ac64bf8df9c0 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7" status: 200 len: 1302 microversion: 2.1 time: 0.119480 Aug 04 17:07:50.157166 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1571/3207] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:50 2022] GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7 => generated 1302 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:50.271063 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b77f8ca8-2e97-42bf-a0a2-280067e20733 tempest-ServersOnMultiNodesTest-925967895 tempest-ServersOnMultiNodesTest-925967895-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e" status: 200 len: 1617 microversion: 2.1 time: 0.147415 Aug 04 17:07:50.271643 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1637/3208] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:50 2022] GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e => generated 1617 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:50.293952 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bc99c223-0653-4daa-aa57-6d7efd1eece2 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:50.294650 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bc99c223-0653-4daa-aa57-6d7efd1eece2 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 092fa726-8d2e-4c49-a240-267ceea7404e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:50.301759 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc99c223-0653-4daa-aa57-6d7efd1eece2 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:50.302363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc99c223-0653-4daa-aa57-6d7efd1eece2 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:50.302929 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc99c223-0653-4daa-aa57-6d7efd1eece2 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:50.303856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc99c223-0653-4daa-aa57-6d7efd1eece2 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:50.304375 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc99c223-0653-4daa-aa57-6d7efd1eece2 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:50.304807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc99c223-0653-4daa-aa57-6d7efd1eece2 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:50.335027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bc99c223-0653-4daa-aa57-6d7efd1eece2 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 092fa726-8d2e-4c49-a240-267ceea7404e] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:07:50.340457 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4141562c-2ccc-4b65-bcf4-f58b58973a66 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:50.341220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4141562c-2ccc-4b65-bcf4-f58b58973a66 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:50.348678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4141562c-2ccc-4b65-bcf4-f58b58973a66 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:50.349187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4141562c-2ccc-4b65-bcf4-f58b58973a66 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:50.349636 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4141562c-2ccc-4b65-bcf4-f58b58973a66 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:50.350382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4141562c-2ccc-4b65-bcf4-f58b58973a66 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:50.350851 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4141562c-2ccc-4b65-bcf4-f58b58973a66 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:50.351318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4141562c-2ccc-4b65-bcf4-f58b58973a66 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:50.446808 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bc99c223-0653-4daa-aa57-6d7efd1eece2 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "DELETE /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e" status: 204 len: 0 microversion: 2.1 time: 0.156700 Aug 04 17:07:50.450061 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1572/3209] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:07:50 2022] DELETE /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 17:07:50.469204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-de474a1c-4561-4ae6-8167-855bf3effd73 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:50.470082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-de474a1c-4561-4ae6-8167-855bf3effd73 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] [instance: 67c9cf90-8220-45c0-a580-d027e81e558b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:50.482705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de474a1c-4561-4ae6-8167-855bf3effd73 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:50.483218 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de474a1c-4561-4ae6-8167-855bf3effd73 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:50.483667 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de474a1c-4561-4ae6-8167-855bf3effd73 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:50.484413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de474a1c-4561-4ae6-8167-855bf3effd73 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:50.484864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de474a1c-4561-4ae6-8167-855bf3effd73 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:50.485292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de474a1c-4561-4ae6-8167-855bf3effd73 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:50.519690 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-de474a1c-4561-4ae6-8167-855bf3effd73 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] HTTP exception thrown: Instance 67c9cf90-8220-45c0-a580-d027e81e558b could not be found. Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-de474a1c-4561-4ae6-8167-855bf3effd73 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Request method failure captured: Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b HTTP/1.1 Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_zFr7eIecG86WKkN9Hh8XQETCOUVzER3M7D6rTaX5s85PomA5bzmhEAmezs4Q910fxcSmVLMBz_tSzUIvx4S0r9uXOTFmNr63nrhwAKBuMWreFyGuoTVyTJxYMA1FqVLLKFRV2UkZjPZ1spMs5c8Q8RUS92qQHNb3oUZcPi4P26tKA Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 0057b5901fc44b1eae04780a4813c6e0 Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-InstanceActionsTestJSON-495440750 Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0057b5901fc44b1eae04780a4813c6e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0057b5901fc44b1eae04780a4813c6e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0057b5901fc44b1eae04780a4813c6e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0057b5901fc44b1eae04780a4813c6e0"}]}] Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-InstanceActionsTestJSON-495440750 Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 0057b5901fc44b1eae04780a4813c6e0 Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-InstanceActionsTestJSON-495440750 Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-InstanceActionsTestJSON-495440750-project Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: d27a023a55a348a8bfc02c2818cd0901 Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-InstanceActionsTestJSON-495440750-project Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 67c9cf90-8220-45c0-a580-d027e81e558b could not be found. Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '67c9cf90-8220-45c0-a580-d027e81e558b'} Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67c9cf90-8220-45c0-a580-d027e81e558b could not be found. Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67c9cf90-8220-45c0-a580-d027e81e558b could not be found. Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:07:50.521552 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:07:50.529879 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:50.529879 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:07:50.529879 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:07:50.529879 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:07:50.529879 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:07:50.529879 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67c9cf90-8220-45c0-a580-d027e81e558b could not be found. Aug 04 17:07:50.529879 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:07:50.529879 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-de474a1c-4561-4ae6-8167-855bf3effd73 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] Returning 404 to user: Instance 67c9cf90-8220-45c0-a580-d027e81e558b could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:07:50.529879 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-de474a1c-4561-4ae6-8167-855bf3effd73 tempest-InstanceActionsTestJSON-495440750 tempest-InstanceActionsTestJSON-495440750-project] 10.222.0.93 "GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b" status: 404 len: 111 microversion: 2.1 time: 0.071755 Aug 04 17:07:50.529879 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1573/3210] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:50 2022] GET /compute/v2.1/servers/67c9cf90-8220-45c0-a580-d027e81e558b => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:07:50.532104 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-640674b6-e58c-42ae-80d1-9519b663caec tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:50.532532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-640674b6-e58c-42ae-80d1-9519b663caec tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 092fa726-8d2e-4c49-a240-267ceea7404e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:50.539692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-640674b6-e58c-42ae-80d1-9519b663caec tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:50.540306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-640674b6-e58c-42ae-80d1-9519b663caec tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:50.540824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-640674b6-e58c-42ae-80d1-9519b663caec tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:50.541612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-640674b6-e58c-42ae-80d1-9519b663caec tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:50.542226 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-640674b6-e58c-42ae-80d1-9519b663caec tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:50.542777 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-640674b6-e58c-42ae-80d1-9519b663caec tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:50.543862 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4141562c-2ccc-4b65-bcf4-f58b58973a66 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:50.551742 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4141562c-2ccc-4b65-bcf4-f58b58973a66 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1513 microversion: 2.1 time: 0.215644 Aug 04 17:07:50.554221 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1638/3211] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:50 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1513 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:50.612176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-2c2ff9ea-bf7f-4d45-bfc4-d27304dee1eb req-7c8263f5-82b0-4e9e-97ef-879608749329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f1bd19-8eaf-4799-b581-dd8b047e31b7", "name": "network-vif-deleted", "tag": "8a29e23a-f4a0-4be2-b443-a053f40cbe13"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:50.625726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-2c2ff9ea-bf7f-4d45-bfc4-d27304dee1eb req-7c8263f5-82b0-4e9e-97ef-879608749329 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:50.627447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-2c2ff9ea-bf7f-4d45-bfc4-d27304dee1eb req-7c8263f5-82b0-4e9e-97ef-879608749329 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:50.628332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-2c2ff9ea-bf7f-4d45-bfc4-d27304dee1eb req-7c8263f5-82b0-4e9e-97ef-879608749329 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:50.645589 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-2c2ff9ea-bf7f-4d45-bfc4-d27304dee1eb req-7c8263f5-82b0-4e9e-97ef-879608749329 service nova] Creating event network-vif-deleted:8a29e23a-f4a0-4be2-b443-a053f40cbe13 for instance a6f1bd19-8eaf-4799-b581-dd8b047e31b7 on n-h1-851359-3 Aug 04 17:07:50.654629 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-2c2ff9ea-bf7f-4d45-bfc4-d27304dee1eb req-7c8263f5-82b0-4e9e-97ef-879608749329 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057962 Aug 04 17:07:50.655799 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1639/3212] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:50.707375 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-640674b6-e58c-42ae-80d1-9519b663caec tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:50.715548 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-640674b6-e58c-42ae-80d1-9519b663caec tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e" status: 200 len: 1472 microversion: 2.1 time: 0.190478 Aug 04 17:07:50.716197 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1574/3213] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:50 2022] GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e => generated 1472 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:51.145074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a6b99718-a8de-4bfe-ae2e-53d44197f3e6 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:51.146426 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a6b99718-a8de-4bfe-ae2e-53d44197f3e6 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:51.153425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6b99718-a8de-4bfe-ae2e-53d44197f3e6 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:51.154085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6b99718-a8de-4bfe-ae2e-53d44197f3e6 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:51.155144 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6b99718-a8de-4bfe-ae2e-53d44197f3e6 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:51.156227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6b99718-a8de-4bfe-ae2e-53d44197f3e6 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:51.157017 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6b99718-a8de-4bfe-ae2e-53d44197f3e6 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:51.157814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6b99718-a8de-4bfe-ae2e-53d44197f3e6 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:51.178852 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5d525448-d11a-4ed6-82ea-296b554f3b02 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:51.180228 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5d525448-d11a-4ed6-82ea-296b554f3b02 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] [instance: a6f1bd19-8eaf-4799-b581-dd8b047e31b7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:51.191465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d525448-d11a-4ed6-82ea-296b554f3b02 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:51.192285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d525448-d11a-4ed6-82ea-296b554f3b02 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:51.193551 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d525448-d11a-4ed6-82ea-296b554f3b02 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:51.205875 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d525448-d11a-4ed6-82ea-296b554f3b02 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:51.207133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d525448-d11a-4ed6-82ea-296b554f3b02 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:51.207842 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d525448-d11a-4ed6-82ea-296b554f3b02 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:51.227826 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-5d525448-d11a-4ed6-82ea-296b554f3b02 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] HTTP exception thrown: Instance a6f1bd19-8eaf-4799-b581-dd8b047e31b7 could not be found. Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5d525448-d11a-4ed6-82ea-296b554f3b02 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Request method failure captured: Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7 HTTP/1.1 Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_zK4M7frlar4Ewvcv1G9XAiRCPgENoqpkWlqpnAHwVTAOwW3YNaXE2rSXesUzbu0KTLSyY5XjB50VyyeuwJtdT19fJFA2SR8Z7lQH_A2w2Yj1DuXAHaWvtFbzPX1i1ey-Fw_q407Vz_1KQyfw3aDoLrXe48fEq371QMWGS9kF4wlVA Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 3fe912cae63448eea70d0acb20320a05 Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerGroupTestJSON-521053522 Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3fe912cae63448eea70d0acb20320a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3fe912cae63448eea70d0acb20320a05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3fe912cae63448eea70d0acb20320a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3fe912cae63448eea70d0acb20320a05"}]}] Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServerGroupTestJSON-521053522 Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 3fe912cae63448eea70d0acb20320a05 Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerGroupTestJSON-521053522 Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServerGroupTestJSON-521053522-project Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 42bb93640f644e73a4fce9b0682ce858 Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServerGroupTestJSON-521053522-project Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance a6f1bd19-8eaf-4799-b581-dd8b047e31b7 could not be found. Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'a6f1bd19-8eaf-4799-b581-dd8b047e31b7'} Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6f1bd19-8eaf-4799-b581-dd8b047e31b7 could not be found. Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6f1bd19-8eaf-4799-b581-dd8b047e31b7 could not be found. Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:07:51.229556 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.237206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:51.237206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:07:51.237206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:07:51.237206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:07:51.237206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:07:51.237206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6f1bd19-8eaf-4799-b581-dd8b047e31b7 could not be found. Aug 04 17:07:51.237206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.237206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5d525448-d11a-4ed6-82ea-296b554f3b02 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Returning 404 to user: Instance a6f1bd19-8eaf-4799-b581-dd8b047e31b7 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:07:51.237206 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5d525448-d11a-4ed6-82ea-296b554f3b02 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7" status: 404 len: 111 microversion: 2.1 time: 0.057352 Aug 04 17:07:51.237206 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1575/3214] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:51 2022] GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:07:51.242984 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a6b99718-a8de-4bfe-ae2e-53d44197f3e6 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:51.247489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fdc57c01-a56a-4a50-bb01-3f718ca1b8a2 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:51.251264 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a6b99718-a8de-4bfe-ae2e-53d44197f3e6 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1266 microversion: 2.1 time: 0.111134 Aug 04 17:07:51.264365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.compute.server_groups [None req-fdc57c01-a56a-4a50-bb01-3f718ca1b8a2 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Querying cell 435e901d-6672-4284-ad57-58e647e6e99d(cell1) for 1 instances {{(pid=131044) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 04 17:07:51.265091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdc57c01-a56a-4a50-bb01-3f718ca1b8a2 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:51.265556 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1640/3215] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:51 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1266 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:51.265701 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdc57c01-a56a-4a50-bb01-3f718ca1b8a2 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:51.266016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdc57c01-a56a-4a50-bb01-3f718ca1b8a2 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:51.277484 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fdc57c01-a56a-4a50-bb01-3f718ca1b8a2 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.033572 Aug 04 17:07:51.278348 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1576/3216] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Aug 4 17:07:51 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:07:51.292833 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2e6c1795-98c4-4df1-b478-cb2e72db3661 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:51.294803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-acfd794e-42e5-4aff-a91b-cead24da4894 req-232c3773-03f7-4bdb-992b-790811fd77d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10991c59-c7d8-447e-8f2b-3f5ea5d8d62a", "name": "network-vif-plugged", "status": "completed", "tag": "d34d92ed-1a8a-4623-be8e-630b78a99ac4"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:51.301006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-acfd794e-42e5-4aff-a91b-cead24da4894 req-232c3773-03f7-4bdb-992b-790811fd77d6 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:51.301781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-acfd794e-42e5-4aff-a91b-cead24da4894 req-232c3773-03f7-4bdb-992b-790811fd77d6 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:51.302610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-acfd794e-42e5-4aff-a91b-cead24da4894 req-232c3773-03f7-4bdb-992b-790811fd77d6 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:51.307588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.compute.server_groups [None req-2e6c1795-98c4-4df1-b478-cb2e72db3661 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Querying cell 435e901d-6672-4284-ad57-58e647e6e99d(cell1) for 1 instances {{(pid=131044) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 04 17:07:51.309273 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e6c1795-98c4-4df1-b478-cb2e72db3661 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:51.309887 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e6c1795-98c4-4df1-b478-cb2e72db3661 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:51.310668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e6c1795-98c4-4df1-b478-cb2e72db3661 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:51.319301 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-acfd794e-42e5-4aff-a91b-cead24da4894 req-232c3773-03f7-4bdb-992b-790811fd77d6 service nova] Creating event network-vif-plugged:d34d92ed-1a8a-4623-be8e-630b78a99ac4 for instance 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a on n-h1-851359-3 Aug 04 17:07:51.322486 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2e6c1795-98c4-4df1-b478-cb2e72db3661 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "GET /compute/v2.1/os-server-groups/925e83cd-9458-4892-994c-134d009d5324" status: 200 len: 184 microversion: 2.1 time: 0.036684 Aug 04 17:07:51.323128 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1577/3217] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Aug 4 17:07:51 2022] GET /compute/v2.1/os-server-groups/925e83cd-9458-4892-994c-134d009d5324 => generated 184 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:51.327788 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-acfd794e-42e5-4aff-a91b-cead24da4894 req-232c3773-03f7-4bdb-992b-790811fd77d6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041937 Aug 04 17:07:51.328933 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1641/3218] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:51.333833 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ef97626b-6ebd-4256-86dd-67fada679ef5 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:51.334702 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ef97626b-6ebd-4256-86dd-67fada679ef5 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] [instance: a6f1bd19-8eaf-4799-b581-dd8b047e31b7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:51.341121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef97626b-6ebd-4256-86dd-67fada679ef5 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:51.341729 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef97626b-6ebd-4256-86dd-67fada679ef5 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:51.342299 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef97626b-6ebd-4256-86dd-67fada679ef5 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:51.343680 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef97626b-6ebd-4256-86dd-67fada679ef5 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:51.344241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef97626b-6ebd-4256-86dd-67fada679ef5 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:51.344771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef97626b-6ebd-4256-86dd-67fada679ef5 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:51.360427 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-ef97626b-6ebd-4256-86dd-67fada679ef5 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] HTTP exception thrown: Instance a6f1bd19-8eaf-4799-b581-dd8b047e31b7 could not be found. Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ef97626b-6ebd-4256-86dd-67fada679ef5 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Request method failure captured: Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7 HTTP/1.1 Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_zK4M7frlar4Ewvcv1G9XAiRCPgENoqpkWlqpnAHwVTAOwW3YNaXE2rSXesUzbu0KTLSyY5XjB50VyyeuwJtdT19fJFA2SR8Z7lQH_A2w2Yj1DuXAHaWvtFbzPX1i1ey-Fw_q407Vz_1KQyfw3aDoLrXe48fEq371QMWGS9kF4wlVA Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 3fe912cae63448eea70d0acb20320a05 Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerGroupTestJSON-521053522 Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3fe912cae63448eea70d0acb20320a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3fe912cae63448eea70d0acb20320a05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3fe912cae63448eea70d0acb20320a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3fe912cae63448eea70d0acb20320a05"}]}] Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServerGroupTestJSON-521053522 Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 3fe912cae63448eea70d0acb20320a05 Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerGroupTestJSON-521053522 Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServerGroupTestJSON-521053522-project Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 42bb93640f644e73a4fce9b0682ce858 Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServerGroupTestJSON-521053522-project Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance a6f1bd19-8eaf-4799-b581-dd8b047e31b7 could not be found. Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'a6f1bd19-8eaf-4799-b581-dd8b047e31b7'} Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6f1bd19-8eaf-4799-b581-dd8b047e31b7 could not be found. Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:07:51.362241 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:07:51.365952 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6f1bd19-8eaf-4799-b581-dd8b047e31b7 could not be found. Aug 04 17:07:51.365952 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.365952 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:07:51.365952 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.365952 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:51.365952 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:07:51.365952 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:07:51.365952 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:07:51.365952 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:07:51.365952 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6f1bd19-8eaf-4799-b581-dd8b047e31b7 could not be found. Aug 04 17:07:51.365952 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.367349 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ef97626b-6ebd-4256-86dd-67fada679ef5 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Returning 404 to user: Instance a6f1bd19-8eaf-4799-b581-dd8b047e31b7 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:07:51.368685 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ef97626b-6ebd-4256-86dd-67fada679ef5 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "DELETE /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7" status: 404 len: 111 microversion: 2.1 time: 0.038523 Aug 04 17:07:51.369470 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1578/3219] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:07:51 2022] DELETE /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:07:51.378897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a6b025ce-6d7e-46b9-bf8a-be4a65057b68 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:51.379772 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a6b025ce-6d7e-46b9-bf8a-be4a65057b68 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] [instance: a6f1bd19-8eaf-4799-b581-dd8b047e31b7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:51.386688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6b025ce-6d7e-46b9-bf8a-be4a65057b68 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:51.387528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6b025ce-6d7e-46b9-bf8a-be4a65057b68 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:51.388397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6b025ce-6d7e-46b9-bf8a-be4a65057b68 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:51.389359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6b025ce-6d7e-46b9-bf8a-be4a65057b68 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:51.390109 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6b025ce-6d7e-46b9-bf8a-be4a65057b68 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:51.390908 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6b025ce-6d7e-46b9-bf8a-be4a65057b68 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:51.407264 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-a6b025ce-6d7e-46b9-bf8a-be4a65057b68 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] HTTP exception thrown: Instance a6f1bd19-8eaf-4799-b581-dd8b047e31b7 could not be found. Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a6b025ce-6d7e-46b9-bf8a-be4a65057b68 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Request method failure captured: Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7 HTTP/1.1 Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_zK4M7frlar4Ewvcv1G9XAiRCPgENoqpkWlqpnAHwVTAOwW3YNaXE2rSXesUzbu0KTLSyY5XjB50VyyeuwJtdT19fJFA2SR8Z7lQH_A2w2Yj1DuXAHaWvtFbzPX1i1ey-Fw_q407Vz_1KQyfw3aDoLrXe48fEq371QMWGS9kF4wlVA Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 3fe912cae63448eea70d0acb20320a05 Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerGroupTestJSON-521053522 Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3fe912cae63448eea70d0acb20320a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3fe912cae63448eea70d0acb20320a05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3fe912cae63448eea70d0acb20320a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3fe912cae63448eea70d0acb20320a05"}]}] Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerGroupTestJSON-521053522 Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 3fe912cae63448eea70d0acb20320a05 Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerGroupTestJSON-521053522 Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerGroupTestJSON-521053522-project Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 42bb93640f644e73a4fce9b0682ce858 Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerGroupTestJSON-521053522-project Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance a6f1bd19-8eaf-4799-b581-dd8b047e31b7 could not be found. Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'a6f1bd19-8eaf-4799-b581-dd8b047e31b7'} Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6f1bd19-8eaf-4799-b581-dd8b047e31b7 could not be found. Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6f1bd19-8eaf-4799-b581-dd8b047e31b7 could not be found. Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:07:51.408965 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.415452 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:51.415452 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:07:51.415452 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:07:51.415452 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:07:51.415452 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:07:51.415452 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6f1bd19-8eaf-4799-b581-dd8b047e31b7 could not be found. Aug 04 17:07:51.415452 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.415452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a6b025ce-6d7e-46b9-bf8a-be4a65057b68 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Returning 404 to user: Instance a6f1bd19-8eaf-4799-b581-dd8b047e31b7 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:07:51.415452 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a6b025ce-6d7e-46b9-bf8a-be4a65057b68 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7" status: 404 len: 111 microversion: 2.1 time: 0.036090 Aug 04 17:07:51.415452 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1642/3220] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:51 2022] GET /compute/v2.1/servers/a6f1bd19-8eaf-4799-b581-dd8b047e31b7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:07:51.420168 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c828f166-3c2b-46d7-9856-b593abc5209c tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:51.426551 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-c828f166-3c2b-46d7-9856-b593abc5209c tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] HTTP exception thrown: Instance group 70cd7cd2-32f2-4c99-8148-bd26925978da could not be found. Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c828f166-3c2b-46d7-9856-b593abc5209c tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Request method failure captured: Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/os-server-groups/70cd7cd2-32f2-4c99-8148-bd26925978da HTTP/1.1 Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_zK4M7frlar4Ewvcv1G9XAiRCPgENoqpkWlqpnAHwVTAOwW3YNaXE2rSXesUzbu0KTLSyY5XjB50VyyeuwJtdT19fJFA2SR8Z7lQH_A2w2Yj1DuXAHaWvtFbzPX1i1ey-Fw_q407Vz_1KQyfw3aDoLrXe48fEq371QMWGS9kF4wlVA Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 3fe912cae63448eea70d0acb20320a05 Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerGroupTestJSON-521053522 Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3fe912cae63448eea70d0acb20320a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3fe912cae63448eea70d0acb20320a05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3fe912cae63448eea70d0acb20320a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3fe912cae63448eea70d0acb20320a05"}]}] Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServerGroupTestJSON-521053522 Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 3fe912cae63448eea70d0acb20320a05 Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerGroupTestJSON-521053522 Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServerGroupTestJSON-521053522-project Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 42bb93640f644e73a4fce9b0682ce858 Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServerGroupTestJSON-521053522-project Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance group 70cd7cd2-32f2-4c99-8148-bd26925978da could not be found. Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '70cd7cd2-32f2-4c99-8148-bd26925978da'} Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 70cd7cd2-32f2-4c99-8148-bd26925978da could not be found. Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 70cd7cd2-32f2-4c99-8148-bd26925978da could not be found. Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.435798 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:51.440667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:07:51.440667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:07:51.440667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:07:51.440667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:07:51.440667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 70cd7cd2-32f2-4c99-8148-bd26925978da could not be found. Aug 04 17:07:51.440667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.440667 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c828f166-3c2b-46d7-9856-b593abc5209c tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Returning 404 to user: Instance group 70cd7cd2-32f2-4c99-8148-bd26925978da could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:07:51.440667 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c828f166-3c2b-46d7-9856-b593abc5209c tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/70cd7cd2-32f2-4c99-8148-bd26925978da" status: 404 len: 117 microversion: 2.1 time: 0.021744 Aug 04 17:07:51.440667 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1579/3221] 10.222.0.93 () {58 vars in 1266 bytes} [Thu Aug 4 17:07:51 2022] DELETE /compute/v2.1/os-server-groups/70cd7cd2-32f2-4c99-8148-bd26925978da => generated 117 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:07:51.447120 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ddceb9a4-ddec-4b54-b111-bd3bfb29a798 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:51.453691 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-ddceb9a4-ddec-4b54-b111-bd3bfb29a798 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] HTTP exception thrown: Instance group 41bea93f-ec5a-4929-bcef-6cf8ac56964f could not be found. Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ddceb9a4-ddec-4b54-b111-bd3bfb29a798 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Request method failure captured: Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/os-server-groups/41bea93f-ec5a-4929-bcef-6cf8ac56964f HTTP/1.1 Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_zK4M7frlar4Ewvcv1G9XAiRCPgENoqpkWlqpnAHwVTAOwW3YNaXE2rSXesUzbu0KTLSyY5XjB50VyyeuwJtdT19fJFA2SR8Z7lQH_A2w2Yj1DuXAHaWvtFbzPX1i1ey-Fw_q407Vz_1KQyfw3aDoLrXe48fEq371QMWGS9kF4wlVA Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 3fe912cae63448eea70d0acb20320a05 Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerGroupTestJSON-521053522 Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3fe912cae63448eea70d0acb20320a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3fe912cae63448eea70d0acb20320a05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3fe912cae63448eea70d0acb20320a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3fe912cae63448eea70d0acb20320a05"}]}] Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerGroupTestJSON-521053522 Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 3fe912cae63448eea70d0acb20320a05 Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerGroupTestJSON-521053522 Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerGroupTestJSON-521053522-project Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 42bb93640f644e73a4fce9b0682ce858 Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerGroupTestJSON-521053522-project Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance group 41bea93f-ec5a-4929-bcef-6cf8ac56964f could not be found. Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '41bea93f-ec5a-4929-bcef-6cf8ac56964f'} Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 41bea93f-ec5a-4929-bcef-6cf8ac56964f could not be found. Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 41bea93f-ec5a-4929-bcef-6cf8ac56964f could not be found. Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.455866 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:51.460829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:07:51.460829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:07:51.460829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:07:51.460829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:07:51.460829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 41bea93f-ec5a-4929-bcef-6cf8ac56964f could not be found. Aug 04 17:07:51.460829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.460829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ddceb9a4-ddec-4b54-b111-bd3bfb29a798 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Returning 404 to user: Instance group 41bea93f-ec5a-4929-bcef-6cf8ac56964f could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:07:51.460829 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ddceb9a4-ddec-4b54-b111-bd3bfb29a798 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/41bea93f-ec5a-4929-bcef-6cf8ac56964f" status: 404 len: 117 microversion: 2.1 time: 0.014387 Aug 04 17:07:51.461489 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1643/3222] 10.222.0.93 () {58 vars in 1266 bytes} [Thu Aug 4 17:07:51 2022] DELETE /compute/v2.1/os-server-groups/41bea93f-ec5a-4929-bcef-6cf8ac56964f => generated 117 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:07:51.467352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e3c08e94-ebdb-4500-8f50-482fc2105f9b tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:51.475125 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-e3c08e94-ebdb-4500-8f50-482fc2105f9b tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] HTTP exception thrown: Instance group 840518dd-3352-48a7-9737-944ba5dc3e98 could not be found. Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e3c08e94-ebdb-4500-8f50-482fc2105f9b tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Request method failure captured: Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/os-server-groups/840518dd-3352-48a7-9737-944ba5dc3e98 HTTP/1.1 Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_zK4M7frlar4Ewvcv1G9XAiRCPgENoqpkWlqpnAHwVTAOwW3YNaXE2rSXesUzbu0KTLSyY5XjB50VyyeuwJtdT19fJFA2SR8Z7lQH_A2w2Yj1DuXAHaWvtFbzPX1i1ey-Fw_q407Vz_1KQyfw3aDoLrXe48fEq371QMWGS9kF4wlVA Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 3fe912cae63448eea70d0acb20320a05 Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerGroupTestJSON-521053522 Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3fe912cae63448eea70d0acb20320a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3fe912cae63448eea70d0acb20320a05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3fe912cae63448eea70d0acb20320a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3fe912cae63448eea70d0acb20320a05"}]}] Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServerGroupTestJSON-521053522 Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 3fe912cae63448eea70d0acb20320a05 Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerGroupTestJSON-521053522 Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServerGroupTestJSON-521053522-project Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 42bb93640f644e73a4fce9b0682ce858 Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServerGroupTestJSON-521053522-project Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance group 840518dd-3352-48a7-9737-944ba5dc3e98 could not be found. Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '840518dd-3352-48a7-9737-944ba5dc3e98'} Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 840518dd-3352-48a7-9737-944ba5dc3e98 could not be found. Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 840518dd-3352-48a7-9737-944ba5dc3e98 could not be found. Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.476706 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:51.484569 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:07:51.484569 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:07:51.484569 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:07:51.484569 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:07:51.484569 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 840518dd-3352-48a7-9737-944ba5dc3e98 could not be found. Aug 04 17:07:51.484569 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.484569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e3c08e94-ebdb-4500-8f50-482fc2105f9b tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Returning 404 to user: Instance group 840518dd-3352-48a7-9737-944ba5dc3e98 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:07:51.484569 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e3c08e94-ebdb-4500-8f50-482fc2105f9b tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/840518dd-3352-48a7-9737-944ba5dc3e98" status: 404 len: 117 microversion: 2.1 time: 0.014993 Aug 04 17:07:51.484569 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1580/3223] 10.222.0.93 () {58 vars in 1266 bytes} [Thu Aug 4 17:07:51 2022] DELETE /compute/v2.1/os-server-groups/840518dd-3352-48a7-9737-944ba5dc3e98 => generated 117 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:07:51.489467 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e34ba91c-469c-4be8-a555-f8d3fe422a2c tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:51.497810 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-e34ba91c-469c-4be8-a555-f8d3fe422a2c tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] HTTP exception thrown: Instance group af1e0972-ad40-4eff-a7d5-91d4f211d043 could not be found. Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e34ba91c-469c-4be8-a555-f8d3fe422a2c tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Request method failure captured: Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/os-server-groups/af1e0972-ad40-4eff-a7d5-91d4f211d043 HTTP/1.1 Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_zK4M7frlar4Ewvcv1G9XAiRCPgENoqpkWlqpnAHwVTAOwW3YNaXE2rSXesUzbu0KTLSyY5XjB50VyyeuwJtdT19fJFA2SR8Z7lQH_A2w2Yj1DuXAHaWvtFbzPX1i1ey-Fw_q407Vz_1KQyfw3aDoLrXe48fEq371QMWGS9kF4wlVA Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 3fe912cae63448eea70d0acb20320a05 Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerGroupTestJSON-521053522 Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3fe912cae63448eea70d0acb20320a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3fe912cae63448eea70d0acb20320a05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3fe912cae63448eea70d0acb20320a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3fe912cae63448eea70d0acb20320a05"}]}] Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerGroupTestJSON-521053522 Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 3fe912cae63448eea70d0acb20320a05 Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerGroupTestJSON-521053522 Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerGroupTestJSON-521053522-project Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 42bb93640f644e73a4fce9b0682ce858 Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerGroupTestJSON-521053522-project Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance group af1e0972-ad40-4eff-a7d5-91d4f211d043 could not be found. Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'af1e0972-ad40-4eff-a7d5-91d4f211d043'} Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group af1e0972-ad40-4eff-a7d5-91d4f211d043 could not be found. Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group af1e0972-ad40-4eff-a7d5-91d4f211d043 could not be found. Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.499450 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:51.507129 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:07:51.507129 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:07:51.507129 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:07:51.507129 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:07:51.507129 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group af1e0972-ad40-4eff-a7d5-91d4f211d043 could not be found. Aug 04 17:07:51.507129 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:07:51.507129 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e34ba91c-469c-4be8-a555-f8d3fe422a2c tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Returning 404 to user: Instance group af1e0972-ad40-4eff-a7d5-91d4f211d043 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:07:51.507129 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e34ba91c-469c-4be8-a555-f8d3fe422a2c tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/af1e0972-ad40-4eff-a7d5-91d4f211d043" status: 404 len: 117 microversion: 2.1 time: 0.015402 Aug 04 17:07:51.507129 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1644/3224] 10.222.0.93 () {58 vars in 1266 bytes} [Thu Aug 4 17:07:51 2022] DELETE /compute/v2.1/os-server-groups/af1e0972-ad40-4eff-a7d5-91d4f211d043 => generated 117 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:07:51.516605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1551de4e-012c-4fa1-9d62-6856a9e7f486 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:51.545627 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1551de4e-012c-4fa1-9d62-6856a9e7f486 tempest-ServerGroupTestJSON-521053522 tempest-ServerGroupTestJSON-521053522-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/925e83cd-9458-4892-994c-134d009d5324" status: 204 len: 0 microversion: 2.1 time: 0.036512 Aug 04 17:07:51.546547 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1581/3225] 10.222.0.93 () {58 vars in 1266 bytes} [Thu Aug 4 17:07:51 2022] DELETE /compute/v2.1/os-server-groups/925e83cd-9458-4892-994c-134d009d5324 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:07:51.580287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b24edff1-be01-4346-ae53-14306f426eb5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:51.580983 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b24edff1-be01-4346-ae53-14306f426eb5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:51.589954 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b24edff1-be01-4346-ae53-14306f426eb5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:51.590831 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b24edff1-be01-4346-ae53-14306f426eb5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:51.591484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b24edff1-be01-4346-ae53-14306f426eb5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:51.592684 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b24edff1-be01-4346-ae53-14306f426eb5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:51.593351 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b24edff1-be01-4346-ae53-14306f426eb5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:51.594007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b24edff1-be01-4346-ae53-14306f426eb5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:51.736520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-042b35a5-dcc9-4457-ba74-97fc2620b861 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:51.737318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-042b35a5-dcc9-4457-ba74-97fc2620b861 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 092fa726-8d2e-4c49-a240-267ceea7404e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:51.746470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-042b35a5-dcc9-4457-ba74-97fc2620b861 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:51.754501 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-042b35a5-dcc9-4457-ba74-97fc2620b861 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:51.755368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-042b35a5-dcc9-4457-ba74-97fc2620b861 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:51.756512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-042b35a5-dcc9-4457-ba74-97fc2620b861 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:51.757276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-042b35a5-dcc9-4457-ba74-97fc2620b861 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:51.758468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-042b35a5-dcc9-4457-ba74-97fc2620b861 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:52.027972 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b24edff1-be01-4346-ae53-14306f426eb5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:52.036600 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b24edff1-be01-4346-ae53-14306f426eb5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1513 microversion: 2.1 time: 0.460274 Aug 04 17:07:52.050015 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1645/3226] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:51 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1513 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:52.169929 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-042b35a5-dcc9-4457-ba74-97fc2620b861 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:52.180137 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-042b35a5-dcc9-4457-ba74-97fc2620b861 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e" status: 200 len: 1472 microversion: 2.1 time: 0.447516 Aug 04 17:07:52.181051 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1582/3227] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:51 2022] GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e => generated 1472 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:52.273970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cb3ebfe1-3ccf-4546-af33-680e3f390947 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:52.275167 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cb3ebfe1-3ccf-4546-af33-680e3f390947 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:52.280977 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:52.288210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb3ebfe1-3ccf-4546-af33-680e3f390947 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:52.288917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb3ebfe1-3ccf-4546-af33-680e3f390947 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:52.289525 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb3ebfe1-3ccf-4546-af33-680e3f390947 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:52.290597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb3ebfe1-3ccf-4546-af33-680e3f390947 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:52.291328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb3ebfe1-3ccf-4546-af33-680e3f390947 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:52.292754 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb3ebfe1-3ccf-4546-af33-680e3f390947 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:52.713249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cb3ebfe1-3ccf-4546-af33-680e3f390947 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:52.739052 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cb3ebfe1-3ccf-4546-af33-680e3f390947 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1272 microversion: 2.1 time: 0.467410 Aug 04 17:07:52.742267 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1646/3228] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:52 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1272 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:53.060529 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2c470e35-176d-4130-bb07-83ba1ae3c2e7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:53.060746 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2c470e35-176d-4130-bb07-83ba1ae3c2e7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:53.077523 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c470e35-176d-4130-bb07-83ba1ae3c2e7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:53.078151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c470e35-176d-4130-bb07-83ba1ae3c2e7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:53.078595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c470e35-176d-4130-bb07-83ba1ae3c2e7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:53.079307 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c470e35-176d-4130-bb07-83ba1ae3c2e7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:53.079767 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c470e35-176d-4130-bb07-83ba1ae3c2e7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:53.080219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c470e35-176d-4130-bb07-83ba1ae3c2e7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:53.201177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dea9088e-04df-4dfe-a263-4590ddd79fcf tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:53.201966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dea9088e-04df-4dfe-a263-4590ddd79fcf tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 092fa726-8d2e-4c49-a240-267ceea7404e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:53.208469 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dea9088e-04df-4dfe-a263-4590ddd79fcf tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:53.208967 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dea9088e-04df-4dfe-a263-4590ddd79fcf tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:53.209443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dea9088e-04df-4dfe-a263-4590ddd79fcf tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:53.210313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dea9088e-04df-4dfe-a263-4590ddd79fcf tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:53.210777 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dea9088e-04df-4dfe-a263-4590ddd79fcf tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:53.211408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dea9088e-04df-4dfe-a263-4590ddd79fcf tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:53.497683 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2c470e35-176d-4130-bb07-83ba1ae3c2e7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:53.511871 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2c470e35-176d-4130-bb07-83ba1ae3c2e7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1513 microversion: 2.1 time: 0.455939 Aug 04 17:07:53.513136 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1583/3229] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:53 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1513 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:53.597832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-277514f3-86ca-4706-a55a-1acd038bc396 req-0a5054ce-b3a6-495a-af58-44e9eae9845e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "092fa726-8d2e-4c49-a240-267ceea7404e", "name": "network-vif-deleted", "tag": "3e45099b-72eb-4bc4-83cd-3e008ee8a85d"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:53.617666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-277514f3-86ca-4706-a55a-1acd038bc396 req-0a5054ce-b3a6-495a-af58-44e9eae9845e service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:53.638883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-277514f3-86ca-4706-a55a-1acd038bc396 req-0a5054ce-b3a6-495a-af58-44e9eae9845e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:53.640049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-277514f3-86ca-4706-a55a-1acd038bc396 req-0a5054ce-b3a6-495a-af58-44e9eae9845e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:53.673998 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-277514f3-86ca-4706-a55a-1acd038bc396 req-0a5054ce-b3a6-495a-af58-44e9eae9845e service nova] Creating event network-vif-deleted:3e45099b-72eb-4bc4-83cd-3e008ee8a85d for instance 092fa726-8d2e-4c49-a240-267ceea7404e on n-h1-851359-3 Aug 04 17:07:53.692628 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-277514f3-86ca-4706-a55a-1acd038bc396 req-0a5054ce-b3a6-495a-af58-44e9eae9845e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098363 Aug 04 17:07:53.712784 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1584/3230] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:53.763675 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fd49fedd-53e8-41da-8fcb-47554fb4e677 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:53.764681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fd49fedd-53e8-41da-8fcb-47554fb4e677 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:53.775373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd49fedd-53e8-41da-8fcb-47554fb4e677 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:53.795896 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd49fedd-53e8-41da-8fcb-47554fb4e677 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:53.796272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd49fedd-53e8-41da-8fcb-47554fb4e677 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:53.797225 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd49fedd-53e8-41da-8fcb-47554fb4e677 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:53.797848 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd49fedd-53e8-41da-8fcb-47554fb4e677 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:53.798485 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd49fedd-53e8-41da-8fcb-47554fb4e677 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:53.879209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dea9088e-04df-4dfe-a263-4590ddd79fcf tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:53.891917 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dea9088e-04df-4dfe-a263-4590ddd79fcf tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e" status: 200 len: 1472 microversion: 2.1 time: 0.694688 Aug 04 17:07:53.893103 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1647/3231] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:53 2022] GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e => generated 1472 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:54.238687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fd49fedd-53e8-41da-8fcb-47554fb4e677 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:54.247492 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fd49fedd-53e8-41da-8fcb-47554fb4e677 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1314 microversion: 2.1 time: 0.488829 Aug 04 17:07:54.251507 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1585/3232] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:53 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:54.533213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4c30e68a-8b59-4ca3-b6e4-0cb6742627e0 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:54.534065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4c30e68a-8b59-4ca3-b6e4-0cb6742627e0 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:54.543722 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c30e68a-8b59-4ca3-b6e4-0cb6742627e0 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:54.544225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c30e68a-8b59-4ca3-b6e4-0cb6742627e0 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:54.544671 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c30e68a-8b59-4ca3-b6e4-0cb6742627e0 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:54.554906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c30e68a-8b59-4ca3-b6e4-0cb6742627e0 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:54.555897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c30e68a-8b59-4ca3-b6e4-0cb6742627e0 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:54.558820 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c30e68a-8b59-4ca3-b6e4-0cb6742627e0 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:54.917591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a72f8f53-5c5c-4c9e-81d6-e40251a0ab0c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:54.919742 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a72f8f53-5c5c-4c9e-81d6-e40251a0ab0c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 092fa726-8d2e-4c49-a240-267ceea7404e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:54.933854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a72f8f53-5c5c-4c9e-81d6-e40251a0ab0c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:54.939807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a72f8f53-5c5c-4c9e-81d6-e40251a0ab0c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:54.941285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a72f8f53-5c5c-4c9e-81d6-e40251a0ab0c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:54.942282 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a72f8f53-5c5c-4c9e-81d6-e40251a0ab0c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:54.942955 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a72f8f53-5c5c-4c9e-81d6-e40251a0ab0c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:54.947834 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a72f8f53-5c5c-4c9e-81d6-e40251a0ab0c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:54.982607 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-a72f8f53-5c5c-4c9e-81d6-e40251a0ab0c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] HTTP exception thrown: Instance 092fa726-8d2e-4c49-a240-267ceea7404e could not be found. Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a72f8f53-5c5c-4c9e-81d6-e40251a0ab0c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Request method failure captured: Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e HTTP/1.1 Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_w0jZeUsbjEc5kYg27hf-dMmPEmOS8mz9zj3LiyLgIwLfZP9355AOtAolQUi0IfSyHmBTm0ZLYpzXBPR2sg5A16dXtRgSW2ZOMGwE8_C42ShFtz9WjdriiJ5vR6sp-55xsNqL34nsOcOKnlgDPAz7cPTUNxqkeWCJfWyd01S-wbqeI Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: de328615cef94528b55b8309dd9b82b0 Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersOnMultiNodesTest-1487912368 Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/de328615cef94528b55b8309dd9b82b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/de328615cef94528b55b8309dd9b82b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_de328615cef94528b55b8309dd9b82b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/de328615cef94528b55b8309dd9b82b0"}]}] Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersOnMultiNodesTest-1487912368 Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: de328615cef94528b55b8309dd9b82b0 Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1487912368 Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersOnMultiNodesTest-1487912368-project Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: abad886e45bd4c4b8f5f0f86c45eb068 Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersOnMultiNodesTest-1487912368-project Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 092fa726-8d2e-4c49-a240-267ceea7404e could not be found. Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '092fa726-8d2e-4c49-a240-267ceea7404e'} Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 092fa726-8d2e-4c49-a240-267ceea7404e could not be found. Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 092fa726-8d2e-4c49-a240-267ceea7404e could not be found. Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:07:54.986223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:07:54.991139 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:07:54.991139 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:07:54.991139 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:07:54.991139 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:07:54.991139 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:07:54.991139 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 092fa726-8d2e-4c49-a240-267ceea7404e could not be found. Aug 04 17:07:54.991139 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:07:55.003934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a72f8f53-5c5c-4c9e-81d6-e40251a0ab0c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Returning 404 to user: Instance 092fa726-8d2e-4c49-a240-267ceea7404e could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:07:55.004894 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a72f8f53-5c5c-4c9e-81d6-e40251a0ab0c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e" status: 404 len: 111 microversion: 2.1 time: 0.095396 Aug 04 17:07:55.016066 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1586/3233] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:54 2022] GET /compute/v2.1/servers/092fa726-8d2e-4c49-a240-267ceea7404e => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:07:55.021136 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2ba12ef6-6e8b-4851-9599-0d95cc5b72e2 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:55.021656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2ba12ef6-6e8b-4851-9599-0d95cc5b72e2 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 373884d2-2103-48cb-aac8-e46d2671a6df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:55.041674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ba12ef6-6e8b-4851-9599-0d95cc5b72e2 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:55.046404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ba12ef6-6e8b-4851-9599-0d95cc5b72e2 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:55.046621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ba12ef6-6e8b-4851-9599-0d95cc5b72e2 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:55.049143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ba12ef6-6e8b-4851-9599-0d95cc5b72e2 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:55.049634 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ba12ef6-6e8b-4851-9599-0d95cc5b72e2 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:55.050099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ba12ef6-6e8b-4851-9599-0d95cc5b72e2 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:55.126279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2ba12ef6-6e8b-4851-9599-0d95cc5b72e2 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 373884d2-2103-48cb-aac8-e46d2671a6df] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:07:55.201234 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4c30e68a-8b59-4ca3-b6e4-0cb6742627e0 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:55.223827 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4c30e68a-8b59-4ca3-b6e4-0cb6742627e0 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1513 microversion: 2.1 time: 0.694405 Aug 04 17:07:55.224639 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1648/3234] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:54 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1513 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:55.279331 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-80ad3b2c-340a-4490-b454-7bdca35513fb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:55.281014 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-80ad3b2c-340a-4490-b454-7bdca35513fb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:55.299130 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2ba12ef6-6e8b-4851-9599-0d95cc5b72e2 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "DELETE /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df" status: 204 len: 0 microversion: 2.1 time: 0.280859 Aug 04 17:07:55.301274 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1587/3235] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:07:55 2022] DELETE /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:07:55.307651 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80ad3b2c-340a-4490-b454-7bdca35513fb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:55.309068 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80ad3b2c-340a-4490-b454-7bdca35513fb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:55.309681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80ad3b2c-340a-4490-b454-7bdca35513fb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:55.316352 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80ad3b2c-340a-4490-b454-7bdca35513fb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:55.317076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80ad3b2c-340a-4490-b454-7bdca35513fb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:55.317833 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80ad3b2c-340a-4490-b454-7bdca35513fb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:55.323809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eb05d0a4-c55a-459e-a9fd-f9f3ea824585 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:55.325611 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eb05d0a4-c55a-459e-a9fd-f9f3ea824585 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 373884d2-2103-48cb-aac8-e46d2671a6df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:55.328683 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:55.348470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb05d0a4-c55a-459e-a9fd-f9f3ea824585 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:55.348988 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb05d0a4-c55a-459e-a9fd-f9f3ea824585 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:55.349439 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb05d0a4-c55a-459e-a9fd-f9f3ea824585 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:55.354348 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb05d0a4-c55a-459e-a9fd-f9f3ea824585 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:55.356433 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb05d0a4-c55a-459e-a9fd-f9f3ea824585 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:55.356897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb05d0a4-c55a-459e-a9fd-f9f3ea824585 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:55.740911 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-80ad3b2c-340a-4490-b454-7bdca35513fb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:55.752404 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-80ad3b2c-340a-4490-b454-7bdca35513fb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1314 microversion: 2.1 time: 0.480851 Aug 04 17:07:55.769246 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1649/3236] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:55 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1314 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:56.016624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-9657e7ba-f230-4873-855e-325cb23247dc req-ba940225-6249-4450-a6c3-14cb63b7cf1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b", "tag": "cd8f865e-af70-411c-8116-3a026f017637"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:56.026982 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9657e7ba-f230-4873-855e-325cb23247dc req-ba940225-6249-4450-a6c3-14cb63b7cf1c service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:56.028073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9657e7ba-f230-4873-855e-325cb23247dc req-ba940225-6249-4450-a6c3-14cb63b7cf1c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:56.028749 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9657e7ba-f230-4873-855e-325cb23247dc req-ba940225-6249-4450-a6c3-14cb63b7cf1c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:56.035188 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eb05d0a4-c55a-459e-a9fd-f9f3ea824585 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:56.049208 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eb05d0a4-c55a-459e-a9fd-f9f3ea824585 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df" status: 200 len: 1470 microversion: 2.1 time: 0.743150 Aug 04 17:07:56.054536 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1588/3237] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:55 2022] GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df => generated 1470 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:56.057069 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-9657e7ba-f230-4873-855e-325cb23247dc req-ba940225-6249-4450-a6c3-14cb63b7cf1c service nova] Creating event network-changed:cd8f865e-af70-411c-8116-3a026f017637 for instance 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b on n-h2-851359-3 Aug 04 17:07:56.062974 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-9657e7ba-f230-4873-855e-325cb23247dc req-ba940225-6249-4450-a6c3-14cb63b7cf1c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050006 Aug 04 17:07:56.063873 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1650/3238] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:07:56.251452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-06027167-ef68-411f-8c43-adaba6e90320 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:56.252525 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-06027167-ef68-411f-8c43-adaba6e90320 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:56.273124 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06027167-ef68-411f-8c43-adaba6e90320 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:56.274462 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06027167-ef68-411f-8c43-adaba6e90320 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:56.275089 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06027167-ef68-411f-8c43-adaba6e90320 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:56.276019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06027167-ef68-411f-8c43-adaba6e90320 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:56.277787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06027167-ef68-411f-8c43-adaba6e90320 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:56.280978 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06027167-ef68-411f-8c43-adaba6e90320 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:56.565570 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-06027167-ef68-411f-8c43-adaba6e90320 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:56.581167 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-06027167-ef68-411f-8c43-adaba6e90320 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1513 microversion: 2.1 time: 0.339948 Aug 04 17:07:56.586036 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1589/3239] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:56 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1513 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:56.777530 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ee772ada-7693-4135-a546-12b24a5f6802 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:56.779078 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ee772ada-7693-4135-a546-12b24a5f6802 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:56.796721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee772ada-7693-4135-a546-12b24a5f6802 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:56.803985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee772ada-7693-4135-a546-12b24a5f6802 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:56.804991 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee772ada-7693-4135-a546-12b24a5f6802 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:56.806217 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee772ada-7693-4135-a546-12b24a5f6802 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:56.806929 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee772ada-7693-4135-a546-12b24a5f6802 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:56.807672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee772ada-7693-4135-a546-12b24a5f6802 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:57.073187 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-29ae347c-4f74-4226-8a48-5a48cfef1cd5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:57.075956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-29ae347c-4f74-4226-8a48-5a48cfef1cd5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 373884d2-2103-48cb-aac8-e46d2671a6df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:57.084035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29ae347c-4f74-4226-8a48-5a48cfef1cd5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:57.085070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29ae347c-4f74-4226-8a48-5a48cfef1cd5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:57.086455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29ae347c-4f74-4226-8a48-5a48cfef1cd5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:57.087475 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29ae347c-4f74-4226-8a48-5a48cfef1cd5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:57.088199 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29ae347c-4f74-4226-8a48-5a48cfef1cd5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:57.088924 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29ae347c-4f74-4226-8a48-5a48cfef1cd5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:57.486520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-29ae347c-4f74-4226-8a48-5a48cfef1cd5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:57.498550 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-29ae347c-4f74-4226-8a48-5a48cfef1cd5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df" status: 200 len: 1470 microversion: 2.1 time: 0.429859 Aug 04 17:07:57.500282 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1590/3240] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:57 2022] GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df => generated 1470 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:57.611035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dee6af66-14f6-41d0-a086-fd252c6445d6 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:57.611035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dee6af66-14f6-41d0-a086-fd252c6445d6 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:57.619183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dee6af66-14f6-41d0-a086-fd252c6445d6 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:57.620305 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dee6af66-14f6-41d0-a086-fd252c6445d6 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:57.620927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dee6af66-14f6-41d0-a086-fd252c6445d6 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:57.621824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dee6af66-14f6-41d0-a086-fd252c6445d6 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:57.628901 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dee6af66-14f6-41d0-a086-fd252c6445d6 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:57.630273 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dee6af66-14f6-41d0-a086-fd252c6445d6 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:57.675559 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:57.734488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ee772ada-7693-4135-a546-12b24a5f6802 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:57.743625 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ee772ada-7693-4135-a546-12b24a5f6802 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1314 microversion: 2.1 time: 0.970331 Aug 04 17:07:57.762045 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1651/3241] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:56 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1314 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:58.078567 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dee6af66-14f6-41d0-a086-fd252c6445d6 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:58.093225 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dee6af66-14f6-41d0-a086-fd252c6445d6 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1513 microversion: 2.1 time: 0.487054 Aug 04 17:07:58.093833 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1591/3242] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:57 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1513 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:58.525847 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-28220004-f8fe-416b-a82a-501594bd4ba7 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:58.527373 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-28220004-f8fe-416b-a82a-501594bd4ba7 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 373884d2-2103-48cb-aac8-e46d2671a6df] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:58.540529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28220004-f8fe-416b-a82a-501594bd4ba7 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:58.548164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b77e29cf-3f9d-461e-83e1-86c3a689769c req-1787e33a-08ab-4a49-afd3-033d338190af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "373884d2-2103-48cb-aac8-e46d2671a6df", "name": "network-vif-deleted", "tag": "909f4468-9b6b-4585-9aaf-9b43a020a453"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:07:58.558253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28220004-f8fe-416b-a82a-501594bd4ba7 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:58.558719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28220004-f8fe-416b-a82a-501594bd4ba7 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:58.559482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28220004-f8fe-416b-a82a-501594bd4ba7 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:58.559950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28220004-f8fe-416b-a82a-501594bd4ba7 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:58.560380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28220004-f8fe-416b-a82a-501594bd4ba7 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:58.601635 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b77e29cf-3f9d-461e-83e1-86c3a689769c req-1787e33a-08ab-4a49-afd3-033d338190af service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:58.610474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b77e29cf-3f9d-461e-83e1-86c3a689769c req-1787e33a-08ab-4a49-afd3-033d338190af service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:58.612512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b77e29cf-3f9d-461e-83e1-86c3a689769c req-1787e33a-08ab-4a49-afd3-033d338190af service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:58.668383 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b77e29cf-3f9d-461e-83e1-86c3a689769c req-1787e33a-08ab-4a49-afd3-033d338190af service nova] Creating event network-vif-deleted:909f4468-9b6b-4585-9aaf-9b43a020a453 for instance 373884d2-2103-48cb-aac8-e46d2671a6df on n-h2-851359-3 Aug 04 17:07:58.681406 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b77e29cf-3f9d-461e-83e1-86c3a689769c req-1787e33a-08ab-4a49-afd3-033d338190af service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137286 Aug 04 17:07:58.682042 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1592/3243] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:58.700753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-844cbe4d-5baf-45f9-8363-e694c884628e tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:58.706470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-844cbe4d-5baf-45f9-8363-e694c884628e tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '95fc1171b95c4605b104d0d44793837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ffd2d70271450bae6b634c8cbee620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:58.707460 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-844cbe4d-5baf-45f9-8363-e694c884628e tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Searching by: {'deleted': False, 'project_id': '46ffd2d70271450bae6b634c8cbee620'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:07:58.714972 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-844cbe4d-5baf-45f9-8363-e694c884628e tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:58.715716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-844cbe4d-5baf-45f9-8363-e694c884628e tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:58.716906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-844cbe4d-5baf-45f9-8363-e694c884628e tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:58.717831 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-844cbe4d-5baf-45f9-8363-e694c884628e tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:58.718490 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-844cbe4d-5baf-45f9-8363-e694c884628e tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:58.719105 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-844cbe4d-5baf-45f9-8363-e694c884628e tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:58.761558 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-844cbe4d-5baf-45f9-8363-e694c884628e tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:07:58.773742 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-28220004-f8fe-416b-a82a-501594bd4ba7 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:58.794471 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-28220004-f8fe-416b-a82a-501594bd4ba7 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df" status: 200 len: 1428 microversion: 2.1 time: 0.272891 Aug 04 17:07:58.795709 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1652/3244] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:58 2022] GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df => generated 1428 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:58.807256 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-33ddd0a4-8487-447b-9713-93b96d660e9c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:58.807802 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-33ddd0a4-8487-447b-9713-93b96d660e9c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:58.826286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33ddd0a4-8487-447b-9713-93b96d660e9c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:58.827082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33ddd0a4-8487-447b-9713-93b96d660e9c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:58.830355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33ddd0a4-8487-447b-9713-93b96d660e9c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:58.831326 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33ddd0a4-8487-447b-9713-93b96d660e9c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:58.836618 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33ddd0a4-8487-447b-9713-93b96d660e9c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:58.837308 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33ddd0a4-8487-447b-9713-93b96d660e9c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:58.840561 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-844cbe4d-5baf-45f9-8363-e694c884628e tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.151597 Aug 04 17:07:58.842367 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1593/3245] 10.222.0.93 () {58 vars in 1125 bytes} [Thu Aug 4 17:07:58 2022] GET /compute/v2.1/servers => generated 340 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:07:58.859098 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fe3bc450-7182-4d10-90ef-9314e776cd41 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:58.882736 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fe3bc450-7182-4d10-90ef-9314e776cd41 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '95fc1171b95c4605b104d0d44793837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ffd2d70271450bae6b634c8cbee620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:58.883513 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fe3bc450-7182-4d10-90ef-9314e776cd41 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Searching by: {'deleted': False, 'project_id': '46ffd2d70271450bae6b634c8cbee620'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:07:58.902387 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe3bc450-7182-4d10-90ef-9314e776cd41 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:58.903174 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe3bc450-7182-4d10-90ef-9314e776cd41 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:58.904389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe3bc450-7182-4d10-90ef-9314e776cd41 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:58.905317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe3bc450-7182-4d10-90ef-9314e776cd41 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:58.905962 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe3bc450-7182-4d10-90ef-9314e776cd41 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:58.910688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe3bc450-7182-4d10-90ef-9314e776cd41 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:58.964239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-fe3bc450-7182-4d10-90ef-9314e776cd41 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:07:59.029465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fe3bc450-7182-4d10-90ef-9314e776cd41 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fc1171b95c4605b104d0d44793837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ffd2d70271450bae6b634c8cbee620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:59.032780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:07:59.044637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe3bc450-7182-4d10-90ef-9314e776cd41 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:59.044637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe3bc450-7182-4d10-90ef-9314e776cd41 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:59.044637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe3bc450-7182-4d10-90ef-9314e776cd41 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:59.358138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-33ddd0a4-8487-447b-9713-93b96d660e9c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:59.368314 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-33ddd0a4-8487-447b-9713-93b96d660e9c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1314 microversion: 2.1 time: 0.571307 Aug 04 17:07:59.380924 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1653/3246] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:58 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1314 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:59.408900 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-972ff938-bb4d-4dd3-b988-64b094d766e3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:59.409937 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-972ff938-bb4d-4dd3-b988-64b094d766e3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:59.430075 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-972ff938-bb4d-4dd3-b988-64b094d766e3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:59.433906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-972ff938-bb4d-4dd3-b988-64b094d766e3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:59.434610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-972ff938-bb4d-4dd3-b988-64b094d766e3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:59.435526 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-972ff938-bb4d-4dd3-b988-64b094d766e3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:59.436354 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-972ff938-bb4d-4dd3-b988-64b094d766e3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:59.436993 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-972ff938-bb4d-4dd3-b988-64b094d766e3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:59.621402 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fe3bc450-7182-4d10-90ef-9314e776cd41 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] 10.222.0.93 "GET /compute/v2.1/servers/detail" status: 200 len: 1713 microversion: 2.1 time: 0.766246 Aug 04 17:07:59.622769 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1594/3247] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 17:07:58 2022] GET /compute/v2.1/servers/detail => generated 1713 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:07:59.655729 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c6b2815e-ceec-4d3d-90ef-e4565f476d0c tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:59.668843 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c6b2815e-ceec-4d3d-90ef-e4565f476d0c tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015891 Aug 04 17:07:59.675315 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1595/3248] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Aug 4 17:07:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:07:59.768230 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-972ff938-bb4d-4dd3-b988-64b094d766e3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:07:59.782807 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-972ff938-bb4d-4dd3-b988-64b094d766e3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1513 microversion: 2.1 time: 0.412815 Aug 04 17:07:59.783404 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1654/3249] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:59 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1513 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:07:59.816067 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3999b22b-07d3-4de4-aed6-363a5bfdab0d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:07:59.817578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3999b22b-07d3-4de4-aed6-363a5bfdab0d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 373884d2-2103-48cb-aac8-e46d2671a6df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:07:59.828929 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3999b22b-07d3-4de4-aed6-363a5bfdab0d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:59.836463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3999b22b-07d3-4de4-aed6-363a5bfdab0d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:59.837917 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3999b22b-07d3-4de4-aed6-363a5bfdab0d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:59.841144 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3999b22b-07d3-4de4-aed6-363a5bfdab0d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:59.843612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3999b22b-07d3-4de4-aed6-363a5bfdab0d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:59.851138 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3999b22b-07d3-4de4-aed6-363a5bfdab0d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:59.960270 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3999b22b-07d3-4de4-aed6-363a5bfdab0d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:07:59.960909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3999b22b-07d3-4de4-aed6-363a5bfdab0d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:07:59.961353 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3999b22b-07d3-4de4-aed6-363a5bfdab0d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:07:59.984615 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-3999b22b-07d3-4de4-aed6-363a5bfdab0d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lazy-loading 'fault' on Instance uuid 373884d2-2103-48cb-aac8-e46d2671a6df {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:08:00.026268 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b74597f7-9b79-446b-b2c7-26af83f862de tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:00.026843 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b74597f7-9b79-446b-b2c7-26af83f862de tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] [instance: 398976e0-4012-4a63-8cb6-fbfd9325ff32] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:00.035944 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b74597f7-9b79-446b-b2c7-26af83f862de tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:00.036504 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b74597f7-9b79-446b-b2c7-26af83f862de tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:00.036961 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b74597f7-9b79-446b-b2c7-26af83f862de tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:00.037689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b74597f7-9b79-446b-b2c7-26af83f862de tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:00.042724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b74597f7-9b79-446b-b2c7-26af83f862de tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:00.043211 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b74597f7-9b79-446b-b2c7-26af83f862de tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:00.083574 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3999b22b-07d3-4de4-aed6-363a5bfdab0d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:00.097255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b74597f7-9b79-446b-b2c7-26af83f862de tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] [instance: 398976e0-4012-4a63-8cb6-fbfd9325ff32] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:08:00.112610 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3999b22b-07d3-4de4-aed6-363a5bfdab0d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df" status: 200 len: 1306 microversion: 2.1 time: 0.300613 Aug 04 17:08:00.117718 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1596/3250] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:07:59 2022] GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df => generated 1306 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:00.124590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:00.270420 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b74597f7-9b79-446b-b2c7-26af83f862de tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] 10.222.0.93 "DELETE /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32" status: 204 len: 0 microversion: 2.1 time: 0.250687 Aug 04 17:08:00.271439 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1655/3251] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:08:00 2022] DELETE /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:08:00.288339 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e7d2bd77-9ee8-4d1e-b8df-50f2d55d4d4c tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:00.291685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e7d2bd77-9ee8-4d1e-b8df-50f2d55d4d4c tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] [instance: 398976e0-4012-4a63-8cb6-fbfd9325ff32] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:00.306458 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7d2bd77-9ee8-4d1e-b8df-50f2d55d4d4c tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:00.307322 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7d2bd77-9ee8-4d1e-b8df-50f2d55d4d4c tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:00.308300 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7d2bd77-9ee8-4d1e-b8df-50f2d55d4d4c tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:00.309281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7d2bd77-9ee8-4d1e-b8df-50f2d55d4d4c tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:00.310389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7d2bd77-9ee8-4d1e-b8df-50f2d55d4d4c tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:00.311412 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7d2bd77-9ee8-4d1e-b8df-50f2d55d4d4c tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:00.393762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-32dad3cd-528c-4808-a416-d1ad83f8f8ee tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:00.394659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-32dad3cd-528c-4808-a416-d1ad83f8f8ee tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:00.408355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32dad3cd-528c-4808-a416-d1ad83f8f8ee tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:00.414126 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32dad3cd-528c-4808-a416-d1ad83f8f8ee tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:00.424404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32dad3cd-528c-4808-a416-d1ad83f8f8ee tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:00.425521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32dad3cd-528c-4808-a416-d1ad83f8f8ee tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:00.426428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32dad3cd-528c-4808-a416-d1ad83f8f8ee tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:00.429075 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32dad3cd-528c-4808-a416-d1ad83f8f8ee tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:01.194935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e7d2bd77-9ee8-4d1e-b8df-50f2d55d4d4c tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fc1171b95c4605b104d0d44793837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ffd2d70271450bae6b634c8cbee620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:01.211942 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e7d2bd77-9ee8-4d1e-b8df-50f2d55d4d4c tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] 10.222.0.93 "GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32" status: 200 len: 1716 microversion: 2.1 time: 0.934202 Aug 04 17:08:01.214635 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1597/3252] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:00 2022] GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32 => generated 1716 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:01.237542 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-32dad3cd-528c-4808-a416-d1ad83f8f8ee tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:01.238177 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f3ab71e2-e12e-4b3b-b3e7-50fd4bd3fa33 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:01.239872 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f3ab71e2-e12e-4b3b-b3e7-50fd4bd3fa33 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:01.250279 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-32dad3cd-528c-4808-a416-d1ad83f8f8ee tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1314 microversion: 2.1 time: 0.861483 Aug 04 17:08:01.251328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3ab71e2-e12e-4b3b-b3e7-50fd4bd3fa33 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:01.252057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3ab71e2-e12e-4b3b-b3e7-50fd4bd3fa33 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:01.252742 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3ab71e2-e12e-4b3b-b3e7-50fd4bd3fa33 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:01.253688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3ab71e2-e12e-4b3b-b3e7-50fd4bd3fa33 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:01.254388 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3ab71e2-e12e-4b3b-b3e7-50fd4bd3fa33 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:01.255055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3ab71e2-e12e-4b3b-b3e7-50fd4bd3fa33 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:01.266143 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1656/3253] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:00 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1314 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:08:01.275739 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bf3f8739-8510-4b1b-9840-e942099e5887 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:01.276804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bf3f8739-8510-4b1b-9840-e942099e5887 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 373884d2-2103-48cb-aac8-e46d2671a6df] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:01.284867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf3f8739-8510-4b1b-9840-e942099e5887 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:01.285615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf3f8739-8510-4b1b-9840-e942099e5887 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:01.286460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf3f8739-8510-4b1b-9840-e942099e5887 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:01.287392 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf3f8739-8510-4b1b-9840-e942099e5887 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:01.288095 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf3f8739-8510-4b1b-9840-e942099e5887 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:01.288732 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf3f8739-8510-4b1b-9840-e942099e5887 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:01.305893 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-bf3f8739-8510-4b1b-9840-e942099e5887 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] HTTP exception thrown: Instance 373884d2-2103-48cb-aac8-e46d2671a6df could not be found. Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bf3f8739-8510-4b1b-9840-e942099e5887 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Request method failure captured: Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df HTTP/1.1 Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_w0jZeUsbjEc5kYg27hf-dMmPEmOS8mz9zj3LiyLgIwLfZP9355AOtAolQUi0IfSyHmBTm0ZLYpzXBPR2sg5A16dXtRgSW2ZOMGwE8_C42ShFtz9WjdriiJ5vR6sp-55xsNqL34nsOcOKnlgDPAz7cPTUNxqkeWCJfWyd01S-wbqeI Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: de328615cef94528b55b8309dd9b82b0 Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersOnMultiNodesTest-1487912368 Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/de328615cef94528b55b8309dd9b82b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/de328615cef94528b55b8309dd9b82b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_de328615cef94528b55b8309dd9b82b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/de328615cef94528b55b8309dd9b82b0"}]}] Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersOnMultiNodesTest-1487912368 Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: de328615cef94528b55b8309dd9b82b0 Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1487912368 Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersOnMultiNodesTest-1487912368-project Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: abad886e45bd4c4b8f5f0f86c45eb068 Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersOnMultiNodesTest-1487912368-project Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 373884d2-2103-48cb-aac8-e46d2671a6df could not be found. Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '373884d2-2103-48cb-aac8-e46d2671a6df'} Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 373884d2-2103-48cb-aac8-e46d2671a6df could not be found. Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 373884d2-2103-48cb-aac8-e46d2671a6df could not be found. Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:08:01.308682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:01.314993 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:01.314993 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:08:01.314993 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:08:01.314993 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:08:01.314993 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:08:01.314993 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 373884d2-2103-48cb-aac8-e46d2671a6df could not be found. Aug 04 17:08:01.314993 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:01.316876 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bf3f8739-8510-4b1b-9840-e942099e5887 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Returning 404 to user: Instance 373884d2-2103-48cb-aac8-e46d2671a6df could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:08:01.318081 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bf3f8739-8510-4b1b-9840-e942099e5887 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df" status: 404 len: 111 microversion: 2.1 time: 0.047299 Aug 04 17:08:01.321557 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1657/3254] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:01 2022] GET /compute/v2.1/servers/373884d2-2103-48cb-aac8-e46d2671a6df => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:08:01.333187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-842b8a6a-b707-4cb6-8652-b791b834bcd0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:01.333763 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-842b8a6a-b707-4cb6-8652-b791b834bcd0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:01.341282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-842b8a6a-b707-4cb6-8652-b791b834bcd0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:01.341780 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-842b8a6a-b707-4cb6-8652-b791b834bcd0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:01.342251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-842b8a6a-b707-4cb6-8652-b791b834bcd0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:01.343008 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-842b8a6a-b707-4cb6-8652-b791b834bcd0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:01.343487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-842b8a6a-b707-4cb6-8652-b791b834bcd0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:01.343886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-842b8a6a-b707-4cb6-8652-b791b834bcd0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:01.387061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-842b8a6a-b707-4cb6-8652-b791b834bcd0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:08:01.515889 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-842b8a6a-b707-4cb6-8652-b791b834bcd0 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "DELETE /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714" status: 204 len: 0 microversion: 2.1 time: 0.192218 Aug 04 17:08:01.519467 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1658/3255] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:08:01 2022] DELETE /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:08:01.532188 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-94a1d9d7-19c2-4c63-81af-2bc370963e15 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:01.533250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-94a1d9d7-19c2-4c63-81af-2bc370963e15 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:01.554752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94a1d9d7-19c2-4c63-81af-2bc370963e15 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:01.555270 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94a1d9d7-19c2-4c63-81af-2bc370963e15 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:01.557242 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94a1d9d7-19c2-4c63-81af-2bc370963e15 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:01.558143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94a1d9d7-19c2-4c63-81af-2bc370963e15 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:01.558619 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94a1d9d7-19c2-4c63-81af-2bc370963e15 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:01.559112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94a1d9d7-19c2-4c63-81af-2bc370963e15 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:01.575796 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f3ab71e2-e12e-4b3b-b3e7-50fd4bd3fa33 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:01.600984 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f3ab71e2-e12e-4b3b-b3e7-50fd4bd3fa33 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1519 microversion: 2.1 time: 0.384893 Aug 04 17:08:01.614495 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1598/3256] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:01 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1519 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:01.934129 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-94a1d9d7-19c2-4c63-81af-2bc370963e15 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:01.958128 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-94a1d9d7-19c2-4c63-81af-2bc370963e15 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714" status: 200 len: 1473 microversion: 2.1 time: 0.435364 Aug 04 17:08:01.960578 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1659/3257] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:01 2022] GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 => generated 1473 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:02.235071 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-93ae3da7-60c6-4159-b320-5ef933db71ae tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:02.236295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-93ae3da7-60c6-4159-b320-5ef933db71ae tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] [instance: 398976e0-4012-4a63-8cb6-fbfd9325ff32] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:02.244515 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93ae3da7-60c6-4159-b320-5ef933db71ae tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:02.248806 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93ae3da7-60c6-4159-b320-5ef933db71ae tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:02.251594 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93ae3da7-60c6-4159-b320-5ef933db71ae tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:02.253433 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93ae3da7-60c6-4159-b320-5ef933db71ae tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:02.256612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93ae3da7-60c6-4159-b320-5ef933db71ae tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:02.257256 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93ae3da7-60c6-4159-b320-5ef933db71ae tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:02.272070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0a190695-0318-4741-af77-1ac80f7ee48a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:02.272713 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0a190695-0318-4741-af77-1ac80f7ee48a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:02.283049 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0a190695-0318-4741-af77-1ac80f7ee48a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:02.284769 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0a190695-0318-4741-af77-1ac80f7ee48a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:02.287521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0a190695-0318-4741-af77-1ac80f7ee48a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:02.289035 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0a190695-0318-4741-af77-1ac80f7ee48a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:02.289930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0a190695-0318-4741-af77-1ac80f7ee48a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:02.290935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0a190695-0318-4741-af77-1ac80f7ee48a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:02.758098 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0a190695-0318-4741-af77-1ac80f7ee48a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:02.776054 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0a190695-0318-4741-af77-1ac80f7ee48a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1314 microversion: 2.1 time: 0.507200 Aug 04 17:08:02.778030 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1660/3258] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:02 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1314 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:02.783432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fca8e029-a959-4ab2-8b21-c8f5979871b2 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:02.784362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fca8e029-a959-4ab2-8b21-c8f5979871b2 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:02.790098 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-93ae3da7-60c6-4159-b320-5ef933db71ae tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fc1171b95c4605b104d0d44793837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ffd2d70271450bae6b634c8cbee620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:02.792192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fca8e029-a959-4ab2-8b21-c8f5979871b2 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:02.792934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fca8e029-a959-4ab2-8b21-c8f5979871b2 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:02.793650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fca8e029-a959-4ab2-8b21-c8f5979871b2 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:02.794605 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fca8e029-a959-4ab2-8b21-c8f5979871b2 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:02.797116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fca8e029-a959-4ab2-8b21-c8f5979871b2 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:02.799099 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fca8e029-a959-4ab2-8b21-c8f5979871b2 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:02.801847 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-93ae3da7-60c6-4159-b320-5ef933db71ae tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] 10.222.0.93 "GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32" status: 200 len: 1716 microversion: 2.1 time: 0.570184 Aug 04 17:08:02.809852 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1599/3259] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:02 2022] GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32 => generated 1716 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:02.982920 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6df352f7-2b59-486a-8bbc-35ff045ced49 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:02.983889 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6df352f7-2b59-486a-8bbc-35ff045ced49 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:02.993694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6df352f7-2b59-486a-8bbc-35ff045ced49 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:02.995524 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6df352f7-2b59-486a-8bbc-35ff045ced49 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:02.996195 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6df352f7-2b59-486a-8bbc-35ff045ced49 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:02.997081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6df352f7-2b59-486a-8bbc-35ff045ced49 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:02.997695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6df352f7-2b59-486a-8bbc-35ff045ced49 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:02.998437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6df352f7-2b59-486a-8bbc-35ff045ced49 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:03.039438 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fca8e029-a959-4ab2-8b21-c8f5979871b2 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:03.052587 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fca8e029-a959-4ab2-8b21-c8f5979871b2 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1519 microversion: 2.1 time: 0.270757 Aug 04 17:08:03.066522 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1661/3260] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:02 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1519 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:03.802408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-23cb8b14-d1c2-480c-b686-50a70b857bd1 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:03.803849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-23cb8b14-d1c2-480c-b686-50a70b857bd1 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:03.814060 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23cb8b14-d1c2-480c-b686-50a70b857bd1 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:03.814280 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23cb8b14-d1c2-480c-b686-50a70b857bd1 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:03.821093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23cb8b14-d1c2-480c-b686-50a70b857bd1 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:03.822280 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23cb8b14-d1c2-480c-b686-50a70b857bd1 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:03.825288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23cb8b14-d1c2-480c-b686-50a70b857bd1 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:03.825935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23cb8b14-d1c2-480c-b686-50a70b857bd1 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:04.413498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6df352f7-2b59-486a-8bbc-35ff045ced49 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:04.424351 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6df352f7-2b59-486a-8bbc-35ff045ced49 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714" status: 200 len: 1473 microversion: 2.1 time: 1.447441 Aug 04 17:08:04.437166 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1600/3261] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:02 2022] GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 => generated 1473 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:04.443344 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-212c2794-d690-4a56-8879-8dc95edc6277 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:04.447898 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-212c2794-d690-4a56-8879-8dc95edc6277 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] [instance: 398976e0-4012-4a63-8cb6-fbfd9325ff32] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:04.460406 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-212c2794-d690-4a56-8879-8dc95edc6277 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:04.463601 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-212c2794-d690-4a56-8879-8dc95edc6277 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:04.467925 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-212c2794-d690-4a56-8879-8dc95edc6277 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:04.470143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-212c2794-d690-4a56-8879-8dc95edc6277 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:04.471032 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-212c2794-d690-4a56-8879-8dc95edc6277 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:04.471736 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-212c2794-d690-4a56-8879-8dc95edc6277 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:04.475564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-23cb8b14-d1c2-480c-b686-50a70b857bd1 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:04.487816 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-23cb8b14-d1c2-480c-b686-50a70b857bd1 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1314 microversion: 2.1 time: 0.689329 Aug 04 17:08:04.504663 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1662/3262] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:03 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1314 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:08:04.509548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-c378840e-1bf2-4047-9e90-71131a30b64b req-58f626a8-51e0-4f1d-b49b-8635eb55991d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "398976e0-4012-4a63-8cb6-fbfd9325ff32", "name": "network-vif-deleted", "tag": "96c6f334-144e-4c68-bc69-2ade83fc3418"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:04.536115 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c378840e-1bf2-4047-9e90-71131a30b64b req-58f626a8-51e0-4f1d-b49b-8635eb55991d service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:04.537016 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c378840e-1bf2-4047-9e90-71131a30b64b req-58f626a8-51e0-4f1d-b49b-8635eb55991d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:04.537712 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c378840e-1bf2-4047-9e90-71131a30b64b req-58f626a8-51e0-4f1d-b49b-8635eb55991d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:04.586260 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-c378840e-1bf2-4047-9e90-71131a30b64b req-58f626a8-51e0-4f1d-b49b-8635eb55991d service nova] Creating event network-vif-deleted:96c6f334-144e-4c68-bc69-2ade83fc3418 for instance 398976e0-4012-4a63-8cb6-fbfd9325ff32 on n-h1-851359-3 Aug 04 17:08:04.607260 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-c378840e-1bf2-4047-9e90-71131a30b64b req-58f626a8-51e0-4f1d-b49b-8635eb55991d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101145 Aug 04 17:08:04.608696 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1663/3263] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:04.615170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-212c2794-d690-4a56-8879-8dc95edc6277 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:04.616946 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-212c2794-d690-4a56-8879-8dc95edc6277 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:04.617429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-212c2794-d690-4a56-8879-8dc95edc6277 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:04.618436 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-329fde29-7a9b-46dd-91ce-5cebfb27274f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:04.620564 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-212c2794-d690-4a56-8879-8dc95edc6277 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lazy-loading 'fault' on Instance uuid 398976e0-4012-4a63-8cb6-fbfd9325ff32 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:08:04.621716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-329fde29-7a9b-46dd-91ce-5cebfb27274f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:04.639217 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-329fde29-7a9b-46dd-91ce-5cebfb27274f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:04.639898 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-329fde29-7a9b-46dd-91ce-5cebfb27274f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:04.640610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-329fde29-7a9b-46dd-91ce-5cebfb27274f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:04.641577 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-329fde29-7a9b-46dd-91ce-5cebfb27274f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:04.642296 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-329fde29-7a9b-46dd-91ce-5cebfb27274f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:04.642955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-329fde29-7a9b-46dd-91ce-5cebfb27274f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:04.682541 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:04.865616 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-212c2794-d690-4a56-8879-8dc95edc6277 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95fc1171b95c4605b104d0d44793837c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ffd2d70271450bae6b634c8cbee620', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:04.883741 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-212c2794-d690-4a56-8879-8dc95edc6277 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] 10.222.0.93 "GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32" status: 200 len: 1368 microversion: 2.1 time: 0.444879 Aug 04 17:08:04.886800 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1601/3264] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:04 2022] GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32 => generated 1368 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:05.008721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-329fde29-7a9b-46dd-91ce-5cebfb27274f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:05.017510 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-329fde29-7a9b-46dd-91ce-5cebfb27274f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1519 microversion: 2.1 time: 0.407377 Aug 04 17:08:05.037264 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1664/3265] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:04 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1519 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:05.321510 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-39496871-31d4-456e-a5ab-71c86fa14b3d req-500df97c-d0be-4647-8ae5-6860bb282cdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec6241cf-bde4-47ad-9e71-7a95f04844b2", "name": "network-vif-unplugged", "status": "completed", "tag": "aa1e462a-c9ad-4a1c-a2c6-89bf4964520f"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:05.341469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-39496871-31d4-456e-a5ab-71c86fa14b3d req-500df97c-d0be-4647-8ae5-6860bb282cdd service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:05.342118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-39496871-31d4-456e-a5ab-71c86fa14b3d req-500df97c-d0be-4647-8ae5-6860bb282cdd service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:05.347627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-39496871-31d4-456e-a5ab-71c86fa14b3d req-500df97c-d0be-4647-8ae5-6860bb282cdd service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:05.375161 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-39496871-31d4-456e-a5ab-71c86fa14b3d req-500df97c-d0be-4647-8ae5-6860bb282cdd service nova] Creating event network-vif-unplugged:aa1e462a-c9ad-4a1c-a2c6-89bf4964520f for instance ec6241cf-bde4-47ad-9e71-7a95f04844b2 on n-h2-851359-3 Aug 04 17:08:05.391352 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-39496871-31d4-456e-a5ab-71c86fa14b3d req-500df97c-d0be-4647-8ae5-6860bb282cdd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071667 Aug 04 17:08:05.393803 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1602/3266] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:05.452803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4ca7a189-cd8f-4501-9855-39eec2c87e5f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:05.453727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4ca7a189-cd8f-4501-9855-39eec2c87e5f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:05.467496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4ca7a189-cd8f-4501-9855-39eec2c87e5f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:05.468225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4ca7a189-cd8f-4501-9855-39eec2c87e5f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:05.468861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4ca7a189-cd8f-4501-9855-39eec2c87e5f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:05.469845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4ca7a189-cd8f-4501-9855-39eec2c87e5f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:05.470505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4ca7a189-cd8f-4501-9855-39eec2c87e5f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:05.471170 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4ca7a189-cd8f-4501-9855-39eec2c87e5f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:05.515982 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-db5814e0-a595-4917-9b78-db913a0cae36 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:05.518082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-db5814e0-a595-4917-9b78-db913a0cae36 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:05.536969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db5814e0-a595-4917-9b78-db913a0cae36 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:05.537877 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db5814e0-a595-4917-9b78-db913a0cae36 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:05.541449 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db5814e0-a595-4917-9b78-db913a0cae36 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:05.545843 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db5814e0-a595-4917-9b78-db913a0cae36 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:05.548763 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db5814e0-a595-4917-9b78-db913a0cae36 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:05.550597 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db5814e0-a595-4917-9b78-db913a0cae36 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:06.133635 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4ca7a189-cd8f-4501-9855-39eec2c87e5f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:06.143542 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4ca7a189-cd8f-4501-9855-39eec2c87e5f tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714" status: 200 len: 1473 microversion: 2.1 time: 0.694598 Aug 04 17:08:06.148516 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1665/3267] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:05 2022] GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 => generated 1473 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:06.157847 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dcc090e3-a2dd-4e0e-9f64-431cdf1a2ad8 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:06.158825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dcc090e3-a2dd-4e0e-9f64-431cdf1a2ad8 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] [instance: 398976e0-4012-4a63-8cb6-fbfd9325ff32] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:06.183807 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcc090e3-a2dd-4e0e-9f64-431cdf1a2ad8 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:06.185288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcc090e3-a2dd-4e0e-9f64-431cdf1a2ad8 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:06.185996 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcc090e3-a2dd-4e0e-9f64-431cdf1a2ad8 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:06.187832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcc090e3-a2dd-4e0e-9f64-431cdf1a2ad8 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:06.188556 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcc090e3-a2dd-4e0e-9f64-431cdf1a2ad8 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:06.190514 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcc090e3-a2dd-4e0e-9f64-431cdf1a2ad8 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:06.228040 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-dcc090e3-a2dd-4e0e-9f64-431cdf1a2ad8 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] HTTP exception thrown: Instance 398976e0-4012-4a63-8cb6-fbfd9325ff32 could not be found. Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dcc090e3-a2dd-4e0e-9f64-431cdf1a2ad8 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Request method failure captured: Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32 HTTP/1.1 Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_yXGZZTC9TxQradYtG0av8cACuzziJtxbw9QM9vkwQMejEAKSme09I2ZT1I1hZRfjSXK73HVfncEfO9bc5w4o92m65NWui2i49V1T9s-XOtt1ybgldHWGr-YpIZ4KwChU4ClcPwPWC36N--jjWwXLysDNk-oDYU_m8HjY7hxfwSt8k Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 46ffd2d70271450bae6b634c8cbee620 Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersTestManualDisk-1339689464 Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46ffd2d70271450bae6b634c8cbee620"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46ffd2d70271450bae6b634c8cbee620"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_46ffd2d70271450bae6b634c8cbee620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/46ffd2d70271450bae6b634c8cbee620"}]}] Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersTestManualDisk-1339689464 Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 46ffd2d70271450bae6b634c8cbee620 Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersTestManualDisk-1339689464 Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersTestManualDisk-1339689464-project Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 95fc1171b95c4605b104d0d44793837c Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersTestManualDisk-1339689464-project Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 398976e0-4012-4a63-8cb6-fbfd9325ff32 could not be found. Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '398976e0-4012-4a63-8cb6-fbfd9325ff32'} Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 398976e0-4012-4a63-8cb6-fbfd9325ff32 could not be found. Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 398976e0-4012-4a63-8cb6-fbfd9325ff32 could not be found. Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:08:06.231366 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:06.236475 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:06.236475 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:08:06.236475 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:08:06.236475 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:08:06.236475 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:08:06.236475 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 398976e0-4012-4a63-8cb6-fbfd9325ff32 could not be found. Aug 04 17:08:06.236475 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:06.236475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dcc090e3-a2dd-4e0e-9f64-431cdf1a2ad8 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Returning 404 to user: Instance 398976e0-4012-4a63-8cb6-fbfd9325ff32 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:08:06.236475 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dcc090e3-a2dd-4e0e-9f64-431cdf1a2ad8 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] 10.222.0.93 "GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32" status: 404 len: 111 microversion: 2.1 time: 0.084890 Aug 04 17:08:06.238680 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1666/3268] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:06 2022] GET /compute/v2.1/servers/398976e0-4012-4a63-8cb6-fbfd9325ff32 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:08:06.245465 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1aeca83a-c022-433e-89fa-87c63a5c2e27 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:06.256931 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1aeca83a-c022-433e-89fa-87c63a5c2e27 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:06.266583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1aeca83a-c022-433e-89fa-87c63a5c2e27 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:06.267096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1aeca83a-c022-433e-89fa-87c63a5c2e27 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:06.267549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1aeca83a-c022-433e-89fa-87c63a5c2e27 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:06.268283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1aeca83a-c022-433e-89fa-87c63a5c2e27 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:06.268756 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1aeca83a-c022-433e-89fa-87c63a5c2e27 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:06.269198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1aeca83a-c022-433e-89fa-87c63a5c2e27 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:06.305377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-db5814e0-a595-4917-9b78-db913a0cae36 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:06.317717 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-db5814e0-a595-4917-9b78-db913a0cae36 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1314 microversion: 2.1 time: 0.809033 Aug 04 17:08:06.322010 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1603/3269] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:05 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1314 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:06.336989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e58142c7-d19f-48a5-bb69-fda7653ebb53 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] Calling method '.version_select at 0x7f1e5ac1a3a0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:06.390710 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e58142c7-d19f-48a5-bb69-fda7653ebb53 tempest-ServersTestManualDisk-1339689464 tempest-ServersTestManualDisk-1339689464-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1152410503" status: 202 len: 0 microversion: 2.1 time: 0.067288 Aug 04 17:08:06.391347 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1604/3270] 10.222.0.93 () {58 vars in 1221 bytes} [Thu Aug 4 17:08:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1152410503 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:08:07.007940 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1aeca83a-c022-433e-89fa-87c63a5c2e27 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:07.021303 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1aeca83a-c022-433e-89fa-87c63a5c2e27 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1519 microversion: 2.1 time: 0.781014 Aug 04 17:08:07.034003 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1667/3271] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:06 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1519 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:07.172651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-44b1a702-e649-4f75-bc8c-62138dfa3741 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:07.174079 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-44b1a702-e649-4f75-bc8c-62138dfa3741 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:07.196276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44b1a702-e649-4f75-bc8c-62138dfa3741 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:07.198139 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44b1a702-e649-4f75-bc8c-62138dfa3741 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:07.208875 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44b1a702-e649-4f75-bc8c-62138dfa3741 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:07.209995 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44b1a702-e649-4f75-bc8c-62138dfa3741 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:07.210726 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44b1a702-e649-4f75-bc8c-62138dfa3741 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:07.211382 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44b1a702-e649-4f75-bc8c-62138dfa3741 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:07.341694 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2b4f8222-0eb1-456d-a6e3-9a344812df6a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:07.342369 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2b4f8222-0eb1-456d-a6e3-9a344812df6a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:07.354149 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b4f8222-0eb1-456d-a6e3-9a344812df6a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:07.355342 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b4f8222-0eb1-456d-a6e3-9a344812df6a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:07.356115 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b4f8222-0eb1-456d-a6e3-9a344812df6a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:07.359688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b4f8222-0eb1-456d-a6e3-9a344812df6a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:07.360446 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b4f8222-0eb1-456d-a6e3-9a344812df6a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:07.361092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b4f8222-0eb1-456d-a6e3-9a344812df6a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:07.953443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2b4f8222-0eb1-456d-a6e3-9a344812df6a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:07.962016 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2b4f8222-0eb1-456d-a6e3-9a344812df6a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1314 microversion: 2.1 time: 0.625120 Aug 04 17:08:07.968221 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1668/3272] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:07 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1314 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:08:08.022857 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-44b1a702-e649-4f75-bc8c-62138dfa3741 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:08.035137 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-44b1a702-e649-4f75-bc8c-62138dfa3741 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714" status: 200 len: 1473 microversion: 2.1 time: 0.866364 Aug 04 17:08:08.040539 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1605/3273] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:07 2022] GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 => generated 1473 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:08.048273 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fb3a9053-617a-4e28-ae01-294b3fdac116 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:08.049284 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fb3a9053-617a-4e28-ae01-294b3fdac116 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:08.058959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fb3a9053-617a-4e28-ae01-294b3fdac116 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:08.062241 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fb3a9053-617a-4e28-ae01-294b3fdac116 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:08.065199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fb3a9053-617a-4e28-ae01-294b3fdac116 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:08.069220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fb3a9053-617a-4e28-ae01-294b3fdac116 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:08.070519 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fb3a9053-617a-4e28-ae01-294b3fdac116 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:08.071687 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fb3a9053-617a-4e28-ae01-294b3fdac116 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:08.363257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fb3a9053-617a-4e28-ae01-294b3fdac116 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:08.372804 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fb3a9053-617a-4e28-ae01-294b3fdac116 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1519 microversion: 2.1 time: 0.328569 Aug 04 17:08:08.378830 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1669/3274] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:08 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1519 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:08.992012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f6ae5009-a03b-4de0-b229-19fd3d1fb1d7 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:08.992820 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f6ae5009-a03b-4de0-b229-19fd3d1fb1d7 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:09.020867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:09.034587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6ae5009-a03b-4de0-b229-19fd3d1fb1d7 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:09.037157 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6ae5009-a03b-4de0-b229-19fd3d1fb1d7 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:09.037917 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6ae5009-a03b-4de0-b229-19fd3d1fb1d7 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:09.039608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6ae5009-a03b-4de0-b229-19fd3d1fb1d7 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:09.040465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6ae5009-a03b-4de0-b229-19fd3d1fb1d7 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:09.041290 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6ae5009-a03b-4de0-b229-19fd3d1fb1d7 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:09.044247 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=8 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:09.061338 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4a8262cb-7dc2-43e1-8ce1-7d720eedae23 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:09.062057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4a8262cb-7dc2-43e1-8ce1-7d720eedae23 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:09.077193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a8262cb-7dc2-43e1-8ce1-7d720eedae23 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:09.087639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a8262cb-7dc2-43e1-8ce1-7d720eedae23 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:09.091632 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a8262cb-7dc2-43e1-8ce1-7d720eedae23 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:09.093271 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a8262cb-7dc2-43e1-8ce1-7d720eedae23 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:09.093794 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a8262cb-7dc2-43e1-8ce1-7d720eedae23 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:09.094268 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a8262cb-7dc2-43e1-8ce1-7d720eedae23 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:09.676575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f6ae5009-a03b-4de0-b229-19fd3d1fb1d7 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:09.693077 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f6ae5009-a03b-4de0-b229-19fd3d1fb1d7 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1314 microversion: 2.1 time: 0.699856 Aug 04 17:08:09.702785 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1606/3275] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:08 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1314 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:09.718101 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f777bb88-e803-4662-b4fa-344d2fbfa459 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:09.719102 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f777bb88-e803-4662-b4fa-344d2fbfa459 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:09.723953 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4a8262cb-7dc2-43e1-8ce1-7d720eedae23 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:09.740857 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4a8262cb-7dc2-43e1-8ce1-7d720eedae23 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714" status: 200 len: 1473 microversion: 2.1 time: 0.681218 Aug 04 17:08:09.746749 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1670/3276] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:09 2022] GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 => generated 1473 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:08:09.755306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f777bb88-e803-4662-b4fa-344d2fbfa459 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:09.758786 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f777bb88-e803-4662-b4fa-344d2fbfa459 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:09.759426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f777bb88-e803-4662-b4fa-344d2fbfa459 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:09.762459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f777bb88-e803-4662-b4fa-344d2fbfa459 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:09.763168 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f777bb88-e803-4662-b4fa-344d2fbfa459 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:09.763769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f777bb88-e803-4662-b4fa-344d2fbfa459 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:09.928881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-ca19e199-6d48-40e8-a74d-9af8bd68f3f8 req-dfa4b590-f5ca-497d-86df-0bcff5902d73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec6241cf-bde4-47ad-9e71-7a95f04844b2", "name": "network-vif-plugged", "status": "completed", "tag": "aa1e462a-c9ad-4a1c-a2c6-89bf4964520f"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:09.943471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ca19e199-6d48-40e8-a74d-9af8bd68f3f8 req-dfa4b590-f5ca-497d-86df-0bcff5902d73 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:09.946977 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ca19e199-6d48-40e8-a74d-9af8bd68f3f8 req-dfa4b590-f5ca-497d-86df-0bcff5902d73 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:09.947882 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ca19e199-6d48-40e8-a74d-9af8bd68f3f8 req-dfa4b590-f5ca-497d-86df-0bcff5902d73 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:09.975865 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-ca19e199-6d48-40e8-a74d-9af8bd68f3f8 req-dfa4b590-f5ca-497d-86df-0bcff5902d73 service nova] Creating event network-vif-plugged:aa1e462a-c9ad-4a1c-a2c6-89bf4964520f for instance ec6241cf-bde4-47ad-9e71-7a95f04844b2 on n-h2-851359-3 Aug 04 17:08:09.981100 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-ca19e199-6d48-40e8-a74d-9af8bd68f3f8 req-dfa4b590-f5ca-497d-86df-0bcff5902d73 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059616 Aug 04 17:08:09.982284 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1671/3277] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:08:10.327036 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-df626973-ab56-49c9-919f-274be8627594 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1661913701", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "252f793e-585e-4d91-9cb2-00d75ea59386"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:10.338758 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f777bb88-e803-4662-b4fa-344d2fbfa459 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:10.348386 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f777bb88-e803-4662-b4fa-344d2fbfa459 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1519 microversion: 2.1 time: 0.644342 Aug 04 17:08:10.358059 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1607/3278] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:09 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1519 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:10.456433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-df626973-ab56-49c9-919f-274be8627594 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] validate_networks() for [('252f793e-585e-4d91-9cb2-00d75ea59386', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:08:10.715447 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b554e12c-4f60-47e4-b3eb-bf1bc6f52068 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:10.716245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b554e12c-4f60-47e4-b3eb-bf1bc6f52068 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:10.746805 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b554e12c-4f60-47e4-b3eb-bf1bc6f52068 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:10.747236 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b554e12c-4f60-47e4-b3eb-bf1bc6f52068 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:10.747694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b554e12c-4f60-47e4-b3eb-bf1bc6f52068 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:10.748415 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b554e12c-4f60-47e4-b3eb-bf1bc6f52068 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:10.748882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b554e12c-4f60-47e4-b3eb-bf1bc6f52068 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:10.749317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b554e12c-4f60-47e4-b3eb-bf1bc6f52068 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:11.331704 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b554e12c-4f60-47e4-b3eb-bf1bc6f52068 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:11.344821 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b554e12c-4f60-47e4-b3eb-bf1bc6f52068 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1314 microversion: 2.1 time: 0.633635 Aug 04 17:08:11.356163 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1608/3279] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:10 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1314 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:11.383203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b981b321-b7de-4116-9118-5c392022f582 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:11.383985 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b981b321-b7de-4116-9118-5c392022f582 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:11.410149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b981b321-b7de-4116-9118-5c392022f582 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:11.410784 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b981b321-b7de-4116-9118-5c392022f582 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:11.411242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b981b321-b7de-4116-9118-5c392022f582 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:11.412469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b981b321-b7de-4116-9118-5c392022f582 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:11.413324 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b981b321-b7de-4116-9118-5c392022f582 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:11.413786 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b981b321-b7de-4116-9118-5c392022f582 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:11.954471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b981b321-b7de-4116-9118-5c392022f582 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:11.958365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:11.989648 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b981b321-b7de-4116-9118-5c392022f582 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714" status: 200 len: 1431 microversion: 2.1 time: 0.632180 Aug 04 17:08:11.990524 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1609/3280] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:11 2022] GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 => generated 1431 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:12.002717 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f4b893c0-79a4-4ef7-bd58-b82f1355364f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:12.011278 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f4b893c0-79a4-4ef7-bd58-b82f1355364f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:12.043862 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4b893c0-79a4-4ef7-bd58-b82f1355364f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:12.054891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4b893c0-79a4-4ef7-bd58-b82f1355364f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:12.055633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4b893c0-79a4-4ef7-bd58-b82f1355364f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:12.056572 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4b893c0-79a4-4ef7-bd58-b82f1355364f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:12.057214 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4b893c0-79a4-4ef7-bd58-b82f1355364f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:12.057870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4b893c0-79a4-4ef7-bd58-b82f1355364f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:12.345725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-df626973-ab56-49c9-919f-274be8627594 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:08:12.346748 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-df626973-ab56-49c9-919f-274be8627594 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:08:12.347573 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-df626973-ab56-49c9-919f-274be8627594 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:08:12.348629 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-df626973-ab56-49c9-919f-274be8627594 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:08:12.349604 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-df626973-ab56-49c9-919f-274be8627594 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:08:12.390898 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df626973-ab56-49c9-919f-274be8627594 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:12.392102 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df626973-ab56-49c9-919f-274be8627594 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:12.393054 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df626973-ab56-49c9-919f-274be8627594 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:12.397039 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df626973-ab56-49c9-919f-274be8627594 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:12.399380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df626973-ab56-49c9-919f-274be8627594 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:12.400051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df626973-ab56-49c9-919f-274be8627594 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:12.431105 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-df626973-ab56-49c9-919f-274be8627594 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Getting quotas for project ab1f5e7e1fda4b55a700c49041331f0b. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:08:12.467282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-df626973-ab56-49c9-919f-274be8627594 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Getting quotas for user ac5ee766cef74c928c68d72419b64e3e and project ab1f5e7e1fda4b55a700c49041331f0b. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:08:12.493932 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-df626973-ab56-49c9-919f-274be8627594 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Going to run 3 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:08:12.501566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-df626973-ab56-49c9-919f-274be8627594 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 33022d3d-bb86-401e-98c8-c6f04f3d8959] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:08:12.602606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-df626973-ab56-49c9-919f-274be8627594 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 5ad185e4-a5ae-4222-b0d7-9c29ee8a9061] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=33022d3d-bb86-401e-98c8-c6f04f3d8959,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:08:12.675379 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f4b893c0-79a4-4ef7-bd58-b82f1355364f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:12.690334 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f4b893c0-79a4-4ef7-bd58-b82f1355364f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1519 microversion: 2.1 time: 0.698249 Aug 04 17:08:12.691326 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1610/3281] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:11 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1519 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:12.698356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-932d9ad7-7084-45b7-93f0-44de35f1bbe3 req-9122fdb3-bed1-410e-9989-1f419240d477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714", "name": "network-vif-deleted", "tag": "6ab7361c-b1ad-445b-b3e5-54cdfd45b93b"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:12.733772 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-932d9ad7-7084-45b7-93f0-44de35f1bbe3 req-9122fdb3-bed1-410e-9989-1f419240d477 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:12.737625 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-932d9ad7-7084-45b7-93f0-44de35f1bbe3 req-9122fdb3-bed1-410e-9989-1f419240d477 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:12.738359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-932d9ad7-7084-45b7-93f0-44de35f1bbe3 req-9122fdb3-bed1-410e-9989-1f419240d477 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:12.761939 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-932d9ad7-7084-45b7-93f0-44de35f1bbe3 req-9122fdb3-bed1-410e-9989-1f419240d477 service nova] Creating event network-vif-deleted:6ab7361c-b1ad-445b-b3e5-54cdfd45b93b for instance ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 on n-h2-851359-3 Aug 04 17:08:12.778372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-df626973-ab56-49c9-919f-274be8627594 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 70c75b7c-2890-48a2-a7b2-7caf3125a492] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=5ad185e4-a5ae-4222-b0d7-9c29ee8a9061,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:08:12.778619 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-932d9ad7-7084-45b7-93f0-44de35f1bbe3 req-9122fdb3-bed1-410e-9989-1f419240d477 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083555 Aug 04 17:08:12.780788 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1611/3282] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:12.788923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f0a441c3-4ed8-44d1-a7a2-0425a4ce56ee tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:12.797200 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f0a441c3-4ed8-44d1-a7a2-0425a4ce56ee tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:12.817567 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0a441c3-4ed8-44d1-a7a2-0425a4ce56ee tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:12.818393 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0a441c3-4ed8-44d1-a7a2-0425a4ce56ee tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:12.819032 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0a441c3-4ed8-44d1-a7a2-0425a4ce56ee tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:12.820023 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0a441c3-4ed8-44d1-a7a2-0425a4ce56ee tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:12.820681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0a441c3-4ed8-44d1-a7a2-0425a4ce56ee tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:12.821316 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0a441c3-4ed8-44d1-a7a2-0425a4ce56ee tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:12.936297 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-df626973-ab56-49c9-919f-274be8627594 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.868611 Aug 04 17:08:12.945888 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1672/3283] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:08:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:08:12.951812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-83d6e62d-8424-4085-b984-2eafb8eecd23 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:12.980848 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-83d6e62d-8424-4085-b984-2eafb8eecd23 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:12.985385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-83d6e62d-8424-4085-b984-2eafb8eecd23 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Searching by: {'deleted': False, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b'} {{(pid=131043) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:08:13.031273 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83d6e62d-8424-4085-b984-2eafb8eecd23 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:13.035189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83d6e62d-8424-4085-b984-2eafb8eecd23 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:13.035897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83d6e62d-8424-4085-b984-2eafb8eecd23 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:13.036873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83d6e62d-8424-4085-b984-2eafb8eecd23 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:13.054029 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83d6e62d-8424-4085-b984-2eafb8eecd23 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:13.055028 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83d6e62d-8424-4085-b984-2eafb8eecd23 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:13.136961 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-83d6e62d-8424-4085-b984-2eafb8eecd23 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.189472 Aug 04 17:08:13.145180 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1673/3284] 10.222.0.93 () {58 vars in 1125 bytes} [Thu Aug 4 17:08:12 2022] GET /compute/v2.1/servers => generated 1018 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:13.154302 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1aa04ecf-511b-4b6f-a8f9-6d684b4ee279 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:13.155218 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1aa04ecf-511b-4b6f-a8f9-6d684b4ee279 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:13.170315 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1aa04ecf-511b-4b6f-a8f9-6d684b4ee279 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:13.172603 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1aa04ecf-511b-4b6f-a8f9-6d684b4ee279 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:13.173263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1aa04ecf-511b-4b6f-a8f9-6d684b4ee279 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:13.174226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1aa04ecf-511b-4b6f-a8f9-6d684b4ee279 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:13.175800 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1aa04ecf-511b-4b6f-a8f9-6d684b4ee279 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:13.176637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1aa04ecf-511b-4b6f-a8f9-6d684b4ee279 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:13.240675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1aa04ecf-511b-4b6f-a8f9-6d684b4ee279 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:13.241325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1aa04ecf-511b-4b6f-a8f9-6d684b4ee279 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:13.245433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1aa04ecf-511b-4b6f-a8f9-6d684b4ee279 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:13.246356 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-1aa04ecf-511b-4b6f-a8f9-6d684b4ee279 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lazy-loading 'fault' on Instance uuid ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:08:14.365387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1aa04ecf-511b-4b6f-a8f9-6d684b4ee279 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:14.395067 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1aa04ecf-511b-4b6f-a8f9-6d684b4ee279 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714" status: 200 len: 1307 microversion: 2.1 time: 1.247253 Aug 04 17:08:14.401737 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1674/3285] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:13 2022] GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 => generated 1307 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:14.409721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-da7af01b-06ce-4413-bce6-3886b963f697 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:14.410380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-da7af01b-06ce-4413-bce6-3886b963f697 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 70c75b7c-2890-48a2-a7b2-7caf3125a492] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:14.920115 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-da7af01b-06ce-4413-bce6-3886b963f697 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:14.955426 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-da7af01b-06ce-4413-bce6-3886b963f697 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492" status: 200 len: 1223 microversion: 2.1 time: 0.552290 Aug 04 17:08:14.964299 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1675/3286] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:14 2022] GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492 => generated 1223 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:14.976839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f0a441c3-4ed8-44d1-a7a2-0425a4ce56ee tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:15.030969 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-502e525f-29ed-4615-8c2d-ca87c83cca48 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:15.032028 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-502e525f-29ed-4615-8c2d-ca87c83cca48 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:15.059640 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f0a441c3-4ed8-44d1-a7a2-0425a4ce56ee tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1314 microversion: 2.1 time: 2.271947 Aug 04 17:08:15.060634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-502e525f-29ed-4615-8c2d-ca87c83cca48 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:15.062112 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1612/3287] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:12 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1314 bytes in 2279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:15.062385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-502e525f-29ed-4615-8c2d-ca87c83cca48 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:15.063261 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-502e525f-29ed-4615-8c2d-ca87c83cca48 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:15.070012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-502e525f-29ed-4615-8c2d-ca87c83cca48 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:15.071283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-502e525f-29ed-4615-8c2d-ca87c83cca48 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:15.071899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-502e525f-29ed-4615-8c2d-ca87c83cca48 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:15.428219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-41cbf5db-9f27-437a-9dee-75e7f0763b2c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:15.433041 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-41cbf5db-9f27-437a-9dee-75e7f0763b2c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:15.469791 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41cbf5db-9f27-437a-9dee-75e7f0763b2c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:15.492362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41cbf5db-9f27-437a-9dee-75e7f0763b2c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:15.495006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41cbf5db-9f27-437a-9dee-75e7f0763b2c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:15.507417 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41cbf5db-9f27-437a-9dee-75e7f0763b2c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:15.511241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41cbf5db-9f27-437a-9dee-75e7f0763b2c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:15.519839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41cbf5db-9f27-437a-9dee-75e7f0763b2c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:15.587890 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-41cbf5db-9f27-437a-9dee-75e7f0763b2c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] HTTP exception thrown: Instance ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 could not be found. Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-41cbf5db-9f27-437a-9dee-75e7f0763b2c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Request method failure captured: Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 HTTP/1.1 Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_w0jZeUsbjEc5kYg27hf-dMmPEmOS8mz9zj3LiyLgIwLfZP9355AOtAolQUi0IfSyHmBTm0ZLYpzXBPR2sg5A16dXtRgSW2ZOMGwE8_C42ShFtz9WjdriiJ5vR6sp-55xsNqL34nsOcOKnlgDPAz7cPTUNxqkeWCJfWyd01S-wbqeI Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: de328615cef94528b55b8309dd9b82b0 Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersOnMultiNodesTest-1487912368 Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/de328615cef94528b55b8309dd9b82b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/de328615cef94528b55b8309dd9b82b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_de328615cef94528b55b8309dd9b82b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/de328615cef94528b55b8309dd9b82b0"}]}] Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersOnMultiNodesTest-1487912368 Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: de328615cef94528b55b8309dd9b82b0 Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1487912368 Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersOnMultiNodesTest-1487912368-project Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: abad886e45bd4c4b8f5f0f86c45eb068 Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersOnMultiNodesTest-1487912368-project Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 could not be found. Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714'} Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 could not be found. Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 could not be found. Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:08:15.594326 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:08:15.599612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:15.599612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:08:15.599612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:08:15.599612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:08:15.599612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:08:15.599612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 could not be found. Aug 04 17:08:15.599612 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:08:15.602621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-41cbf5db-9f27-437a-9dee-75e7f0763b2c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Returning 404 to user: Instance ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:08:15.603695 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-41cbf5db-9f27-437a-9dee-75e7f0763b2c tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714" status: 404 len: 111 microversion: 2.1 time: 0.180391 Aug 04 17:08:15.608000 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1613/3288] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:15 2022] GET /compute/v2.1/servers/ea4c9cb2-c5d3-42fe-8e58-d8ce3f582714 => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:08:15.623041 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0dfa1ba0-9526-4d36-b262-36530e4e7cef tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:15.623843 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0dfa1ba0-9526-4d36-b262-36530e4e7cef tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: fbee7e39-ec6b-4a04-92e3-56c14721eb85] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:15.633698 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0dfa1ba0-9526-4d36-b262-36530e4e7cef tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:15.634484 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0dfa1ba0-9526-4d36-b262-36530e4e7cef tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:15.636233 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0dfa1ba0-9526-4d36-b262-36530e4e7cef tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:15.638736 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0dfa1ba0-9526-4d36-b262-36530e4e7cef tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:15.640796 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0dfa1ba0-9526-4d36-b262-36530e4e7cef tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:15.643403 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0dfa1ba0-9526-4d36-b262-36530e4e7cef tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:15.719909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0dfa1ba0-9526-4d36-b262-36530e4e7cef tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: fbee7e39-ec6b-4a04-92e3-56c14721eb85] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:08:15.918569 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-502e525f-29ed-4615-8c2d-ca87c83cca48 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:15.931539 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-502e525f-29ed-4615-8c2d-ca87c83cca48 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1504 microversion: 2.1 time: 0.963861 Aug 04 17:08:15.942026 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0dfa1ba0-9526-4d36-b262-36530e4e7cef tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "DELETE /compute/v2.1/servers/fbee7e39-ec6b-4a04-92e3-56c14721eb85" status: 204 len: 0 microversion: 2.1 time: 0.326984 Aug 04 17:08:15.945597 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1614/3289] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:08:15 2022] DELETE /compute/v2.1/servers/fbee7e39-ec6b-4a04-92e3-56c14721eb85 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:08:15.951157 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1676/3290] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:14 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1504 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:15.967331 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a6dfe588-6c0a-4466-b3d4-317cc5070a06 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:15.967942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a6dfe588-6c0a-4466-b3d4-317cc5070a06 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ca421464-9d69-4127-a819-37fc1936680e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:15.969750 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-89efe370-81aa-4584-8207-80b202ce9adf tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:15.970420 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-89efe370-81aa-4584-8207-80b202ce9adf tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:15.972493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=9 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:16.003644 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6dfe588-6c0a-4466-b3d4-317cc5070a06 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:16.004197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6dfe588-6c0a-4466-b3d4-317cc5070a06 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:16.004599 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6dfe588-6c0a-4466-b3d4-317cc5070a06 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:16.005336 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6dfe588-6c0a-4466-b3d4-317cc5070a06 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:16.005801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6dfe588-6c0a-4466-b3d4-317cc5070a06 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:16.019139 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89efe370-81aa-4584-8207-80b202ce9adf tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:16.024175 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6dfe588-6c0a-4466-b3d4-317cc5070a06 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:16.030761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89efe370-81aa-4584-8207-80b202ce9adf tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:16.031224 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89efe370-81aa-4584-8207-80b202ce9adf tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:16.031992 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89efe370-81aa-4584-8207-80b202ce9adf tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:16.032466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89efe370-81aa-4584-8207-80b202ce9adf tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:16.032965 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89efe370-81aa-4584-8207-80b202ce9adf tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:16.141358 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a6dfe588-6c0a-4466-b3d4-317cc5070a06 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ca421464-9d69-4127-a819-37fc1936680e] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:08:16.343355 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a6dfe588-6c0a-4466-b3d4-317cc5070a06 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "DELETE /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e" status: 204 len: 0 microversion: 2.1 time: 0.395406 Aug 04 17:08:16.346542 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1615/3291] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:08:15 2022] DELETE /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:08:16.358248 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cc0eb883-76c5-4acb-80c4-842b77d8ad52 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:16.360097 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cc0eb883-76c5-4acb-80c4-842b77d8ad52 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 70c75b7c-2890-48a2-a7b2-7caf3125a492] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:16.383781 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc0eb883-76c5-4acb-80c4-842b77d8ad52 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:16.397411 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc0eb883-76c5-4acb-80c4-842b77d8ad52 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:16.399562 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc0eb883-76c5-4acb-80c4-842b77d8ad52 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:16.402564 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc0eb883-76c5-4acb-80c4-842b77d8ad52 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:16.404232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc0eb883-76c5-4acb-80c4-842b77d8ad52 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:16.406530 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc0eb883-76c5-4acb-80c4-842b77d8ad52 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:16.435111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-89efe370-81aa-4584-8207-80b202ce9adf tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:16.448782 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-89efe370-81aa-4584-8207-80b202ce9adf tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 200 len: 1504 microversion: 2.1 time: 0.485442 Aug 04 17:08:16.486799 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1677/3292] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:15 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 1504 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:16.515523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a73a0662-1400-47ba-b077-f54c922e90aa tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:16.519972 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a73a0662-1400-47ba-b077-f54c922e90aa tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:16.539569 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a73a0662-1400-47ba-b077-f54c922e90aa tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:16.540279 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a73a0662-1400-47ba-b077-f54c922e90aa tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:16.540918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a73a0662-1400-47ba-b077-f54c922e90aa tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:16.543434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a73a0662-1400-47ba-b077-f54c922e90aa tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:16.544119 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a73a0662-1400-47ba-b077-f54c922e90aa tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:16.545648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a73a0662-1400-47ba-b077-f54c922e90aa tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:16.662211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cc0eb883-76c5-4acb-80c4-842b77d8ad52 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:16.701461 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cc0eb883-76c5-4acb-80c4-842b77d8ad52 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492" status: 200 len: 1275 microversion: 2.1 time: 0.352756 Aug 04 17:08:16.715656 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1616/3293] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:16 2022] GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492 => generated 1275 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:16.724305 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-87c0c8b0-3db5-413b-b0ac-2d0580ee9c3d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:16.735236 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-87c0c8b0-3db5-413b-b0ac-2d0580ee9c3d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: fbee7e39-ec6b-4a04-92e3-56c14721eb85] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:16.759990 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87c0c8b0-3db5-413b-b0ac-2d0580ee9c3d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:16.762725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87c0c8b0-3db5-413b-b0ac-2d0580ee9c3d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:16.764900 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87c0c8b0-3db5-413b-b0ac-2d0580ee9c3d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:16.765852 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87c0c8b0-3db5-413b-b0ac-2d0580ee9c3d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:16.768095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87c0c8b0-3db5-413b-b0ac-2d0580ee9c3d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:16.768869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87c0c8b0-3db5-413b-b0ac-2d0580ee9c3d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:17.143452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-87c0c8b0-3db5-413b-b0ac-2d0580ee9c3d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:17.152637 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-87c0c8b0-3db5-413b-b0ac-2d0580ee9c3d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/fbee7e39-ec6b-4a04-92e3-56c14721eb85" status: 200 len: 1474 microversion: 2.1 time: 0.432228 Aug 04 17:08:17.186480 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1617/3294] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:16 2022] GET /compute/v2.1/servers/fbee7e39-ec6b-4a04-92e3-56c14721eb85 => generated 1474 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:17.197095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ed54c438-8b86-449b-bba2-5c6151d24553 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:17.197619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ed54c438-8b86-449b-bba2-5c6151d24553 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:17.218608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed54c438-8b86-449b-bba2-5c6151d24553 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:17.219118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed54c438-8b86-449b-bba2-5c6151d24553 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:17.219565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed54c438-8b86-449b-bba2-5c6151d24553 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:17.230736 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed54c438-8b86-449b-bba2-5c6151d24553 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:17.231196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed54c438-8b86-449b-bba2-5c6151d24553 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:17.231648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed54c438-8b86-449b-bba2-5c6151d24553 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:17.300711 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a73a0662-1400-47ba-b077-f54c922e90aa tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:17.302730 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ed54c438-8b86-449b-bba2-5c6151d24553 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:08:17.309366 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a73a0662-1400-47ba-b077-f54c922e90aa tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1314 microversion: 2.1 time: 0.821336 Aug 04 17:08:17.312959 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1678/3295] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:16 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1314 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:17.550224 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ed54c438-8b86-449b-bba2-5c6151d24553 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "DELETE /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 204 len: 0 microversion: 2.1 time: 0.362331 Aug 04 17:08:17.550835 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1618/3296] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:08:17 2022] DELETE /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:08:17.724876 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1e65d9c2-ba13-4c03-9324-573e6c9bc518 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:17.725512 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1e65d9c2-ba13-4c03-9324-573e6c9bc518 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 70c75b7c-2890-48a2-a7b2-7caf3125a492] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:17.733273 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e65d9c2-ba13-4c03-9324-573e6c9bc518 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:17.733786 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e65d9c2-ba13-4c03-9324-573e6c9bc518 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:17.734267 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e65d9c2-ba13-4c03-9324-573e6c9bc518 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:17.767084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e65d9c2-ba13-4c03-9324-573e6c9bc518 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:17.767857 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e65d9c2-ba13-4c03-9324-573e6c9bc518 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:17.768510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e65d9c2-ba13-4c03-9324-573e6c9bc518 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:17.911554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-50278d58-561d-434a-94dc-065fafe46827 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1612086466", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "d812de2d-9097-4365-8b54-a9037cf92e5e"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:18.106205 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-50278d58-561d-434a-94dc-065fafe46827 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] validate_networks() for [('d812de2d-9097-4365-8b54-a9037cf92e5e', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:08:18.179144 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1e65d9c2-ba13-4c03-9324-573e6c9bc518 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:18.189247 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1e65d9c2-ba13-4c03-9324-573e6c9bc518 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492" status: 200 len: 1275 microversion: 2.1 time: 0.468181 Aug 04 17:08:18.226817 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1679/3297] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:17 2022] GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492 => generated 1275 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:18.240067 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ca2311e1-1c01-4081-bf6b-8b9f42f7ae33 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:18.245721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ca2311e1-1c01-4081-bf6b-8b9f42f7ae33 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: fbee7e39-ec6b-4a04-92e3-56c14721eb85] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:18.267629 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca2311e1-1c01-4081-bf6b-8b9f42f7ae33 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:18.268426 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca2311e1-1c01-4081-bf6b-8b9f42f7ae33 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:18.269065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca2311e1-1c01-4081-bf6b-8b9f42f7ae33 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:18.270078 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca2311e1-1c01-4081-bf6b-8b9f42f7ae33 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:18.270722 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca2311e1-1c01-4081-bf6b-8b9f42f7ae33 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:18.272788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca2311e1-1c01-4081-bf6b-8b9f42f7ae33 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:18.943015 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ca2311e1-1c01-4081-bf6b-8b9f42f7ae33 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:18.960186 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ca2311e1-1c01-4081-bf6b-8b9f42f7ae33 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/fbee7e39-ec6b-4a04-92e3-56c14721eb85" status: 200 len: 1474 microversion: 2.1 time: 0.730564 Aug 04 17:08:18.960734 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1680/3298] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:18 2022] GET /compute/v2.1/servers/fbee7e39-ec6b-4a04-92e3-56c14721eb85 => generated 1474 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:19.018603 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2401dfc2-6568-4e79-a85e-c3f172ab3a8f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:19.022577 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2401dfc2-6568-4e79-a85e-c3f172ab3a8f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:19.049474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2401dfc2-6568-4e79-a85e-c3f172ab3a8f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:19.050095 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2401dfc2-6568-4e79-a85e-c3f172ab3a8f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:19.055076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2401dfc2-6568-4e79-a85e-c3f172ab3a8f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:19.058383 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2401dfc2-6568-4e79-a85e-c3f172ab3a8f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:19.058901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2401dfc2-6568-4e79-a85e-c3f172ab3a8f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:19.059358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2401dfc2-6568-4e79-a85e-c3f172ab3a8f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:19.669288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2401dfc2-6568-4e79-a85e-c3f172ab3a8f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:19.679024 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2401dfc2-6568-4e79-a85e-c3f172ab3a8f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1314 microversion: 2.1 time: 0.716098 Aug 04 17:08:19.683729 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1681/3299] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:18 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1314 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:20.019470 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-260d2b2b-2768-4638-bfa6-fe222a6acc86 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-336011407", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "fb6af935-e335-4559-909d-2fdbf0287ed9"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:20.115434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-260d2b2b-2768-4638-bfa6-fe222a6acc86 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] validate_networks() for [('fb6af935-e335-4559-909d-2fdbf0287ed9', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:08:20.373039 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-50278d58-561d-434a-94dc-065fafe46827 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:08:20.373634 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-50278d58-561d-434a-94dc-065fafe46827 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:08:20.374236 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-50278d58-561d-434a-94dc-065fafe46827 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:08:20.374751 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-50278d58-561d-434a-94dc-065fafe46827 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:08:20.375400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-50278d58-561d-434a-94dc-065fafe46827 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:08:20.396452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50278d58-561d-434a-94dc-065fafe46827 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:20.397288 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50278d58-561d-434a-94dc-065fafe46827 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:20.397902 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50278d58-561d-434a-94dc-065fafe46827 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:20.398912 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50278d58-561d-434a-94dc-065fafe46827 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:20.401224 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50278d58-561d-434a-94dc-065fafe46827 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:20.401848 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50278d58-561d-434a-94dc-065fafe46827 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:20.440377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-50278d58-561d-434a-94dc-065fafe46827 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Getting quotas for project 0e503687666f4ca59d4ea4d9f9771917. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:08:20.450652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-50278d58-561d-434a-94dc-065fafe46827 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Getting quotas for user 4b17ad6c3c53441dbd0c648db7b649b5 and project 0e503687666f4ca59d4ea4d9f9771917. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:08:20.480678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-50278d58-561d-434a-94dc-065fafe46827 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:08:20.488197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-50278d58-561d-434a-94dc-065fafe46827 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:08:20.606027 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-50278d58-561d-434a-94dc-065fafe46827 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.699032 Aug 04 17:08:20.608834 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1619/3300] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:08:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:08:20.616234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f4f07b05-debf-4427-b74d-dceb431436e9 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:20.622424 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f4f07b05-debf-4427-b74d-dceb431436e9 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:20.662352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4f07b05-debf-4427-b74d-dceb431436e9 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:20.664510 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4f07b05-debf-4427-b74d-dceb431436e9 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:20.666270 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4f07b05-debf-4427-b74d-dceb431436e9 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:20.669694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4f07b05-debf-4427-b74d-dceb431436e9 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:20.672184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4f07b05-debf-4427-b74d-dceb431436e9 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:20.674632 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4f07b05-debf-4427-b74d-dceb431436e9 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:21.737935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f4f07b05-debf-4427-b74d-dceb431436e9 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:21.754837 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f4f07b05-debf-4427-b74d-dceb431436e9 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 1.144599 Aug 04 17:08:21.758685 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1620/3301] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:20 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:21.776145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e73041f1-69af-4915-a75b-a4569a26a9c1 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:21.776864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e73041f1-69af-4915-a75b-a4569a26a9c1 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 70c75b7c-2890-48a2-a7b2-7caf3125a492] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:21.796903 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e73041f1-69af-4915-a75b-a4569a26a9c1 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:21.798559 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e73041f1-69af-4915-a75b-a4569a26a9c1 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:21.799178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e73041f1-69af-4915-a75b-a4569a26a9c1 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:21.801297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e73041f1-69af-4915-a75b-a4569a26a9c1 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:21.802645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e73041f1-69af-4915-a75b-a4569a26a9c1 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:21.805438 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e73041f1-69af-4915-a75b-a4569a26a9c1 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:22.045499 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e73041f1-69af-4915-a75b-a4569a26a9c1 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:22.060834 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e73041f1-69af-4915-a75b-a4569a26a9c1 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492" status: 200 len: 1281 microversion: 2.1 time: 0.296840 Aug 04 17:08:22.061876 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1621/3302] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:21 2022] GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492 => generated 1281 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:22.071907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-15dfae2d-0d0f-428e-96d8-b668394cfef5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:22.073550 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-15dfae2d-0d0f-428e-96d8-b668394cfef5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: fbee7e39-ec6b-4a04-92e3-56c14721eb85] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:22.083434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15dfae2d-0d0f-428e-96d8-b668394cfef5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:22.084430 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15dfae2d-0d0f-428e-96d8-b668394cfef5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:22.085145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15dfae2d-0d0f-428e-96d8-b668394cfef5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:22.087063 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15dfae2d-0d0f-428e-96d8-b668394cfef5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:22.088012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15dfae2d-0d0f-428e-96d8-b668394cfef5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:22.088939 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15dfae2d-0d0f-428e-96d8-b668394cfef5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:22.140551 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15dfae2d-0d0f-428e-96d8-b668394cfef5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:22.142720 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15dfae2d-0d0f-428e-96d8-b668394cfef5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:22.143403 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15dfae2d-0d0f-428e-96d8-b668394cfef5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:22.146634 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-15dfae2d-0d0f-428e-96d8-b668394cfef5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lazy-loading 'fault' on Instance uuid fbee7e39-ec6b-4a04-92e3-56c14721eb85 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:08:22.244243 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-260d2b2b-2768-4638-bfa6-fe222a6acc86 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:08:22.245500 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-260d2b2b-2768-4638-bfa6-fe222a6acc86 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:08:22.246344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-260d2b2b-2768-4638-bfa6-fe222a6acc86 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:08:22.247378 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-260d2b2b-2768-4638-bfa6-fe222a6acc86 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:08:22.248120 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-260d2b2b-2768-4638-bfa6-fe222a6acc86 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:08:22.261619 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-260d2b2b-2768-4638-bfa6-fe222a6acc86 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:22.262351 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-260d2b2b-2768-4638-bfa6-fe222a6acc86 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:22.263640 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-260d2b2b-2768-4638-bfa6-fe222a6acc86 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:22.265056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-260d2b2b-2768-4638-bfa6-fe222a6acc86 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:22.265758 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-260d2b2b-2768-4638-bfa6-fe222a6acc86 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:22.266473 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-260d2b2b-2768-4638-bfa6-fe222a6acc86 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:22.309824 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-260d2b2b-2768-4638-bfa6-fe222a6acc86 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Getting quotas for project ea46c96425f849fe87806cbbea8f070f. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:08:22.320667 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-260d2b2b-2768-4638-bfa6-fe222a6acc86 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Getting quotas for user 737beb9600d343b6a63ce3bff3089def and project ea46c96425f849fe87806cbbea8f070f. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:08:22.345357 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-15dfae2d-0d0f-428e-96d8-b668394cfef5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:22.363227 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-15dfae2d-0d0f-428e-96d8-b668394cfef5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/fbee7e39-ec6b-4a04-92e3-56c14721eb85" status: 200 len: 1308 microversion: 2.1 time: 0.295792 Aug 04 17:08:22.369520 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1622/3303] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:22 2022] GET /compute/v2.1/servers/fbee7e39-ec6b-4a04-92e3-56c14721eb85 => generated 1308 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:22.384752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-260d2b2b-2768-4638-bfa6-fe222a6acc86 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:08:22.394972 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-260d2b2b-2768-4638-bfa6-fe222a6acc86 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:08:22.396983 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-fc8f0b92-5aa4-4de0-a588-6ad8b23442c1 req-c31def9a-12cb-4d43-8c07-0bb6c5bf2acf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca421464-9d69-4127-a819-37fc1936680e", "name": "network-vif-deleted", "tag": "4aae10f2-78c6-4a89-949e-8258cf606147"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:22.431218 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fc8f0b92-5aa4-4de0-a588-6ad8b23442c1 req-c31def9a-12cb-4d43-8c07-0bb6c5bf2acf service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:22.433404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fc8f0b92-5aa4-4de0-a588-6ad8b23442c1 req-c31def9a-12cb-4d43-8c07-0bb6c5bf2acf service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:22.434793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fc8f0b92-5aa4-4de0-a588-6ad8b23442c1 req-c31def9a-12cb-4d43-8c07-0bb6c5bf2acf service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:22.441705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:22.471810 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-fc8f0b92-5aa4-4de0-a588-6ad8b23442c1 req-c31def9a-12cb-4d43-8c07-0bb6c5bf2acf service nova] Creating event network-vif-deleted:4aae10f2-78c6-4a89-949e-8258cf606147 for instance ca421464-9d69-4127-a819-37fc1936680e on n-h1-851359-3 Aug 04 17:08:22.484646 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-fc8f0b92-5aa4-4de0-a588-6ad8b23442c1 req-c31def9a-12cb-4d43-8c07-0bb6c5bf2acf service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108020 Aug 04 17:08:22.489130 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1623/3304] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:22.501736 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a50bdbf1-eb61-4bc3-af75-feeba137c161 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:22.504250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a50bdbf1-eb61-4bc3-af75-feeba137c161 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:22.509662 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:22.511374 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-260d2b2b-2768-4638-bfa6-fe222a6acc86 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.826301 Aug 04 17:08:22.518465 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1682/3305] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Aug 4 17:08:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2834 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 17:08:22.523692 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4f653435-c0e3-4b6c-968b-08f198a7b109 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:22.524325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4f653435-c0e3-4b6c-968b-08f198a7b109 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:22.531178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a50bdbf1-eb61-4bc3-af75-feeba137c161 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:22.532052 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a50bdbf1-eb61-4bc3-af75-feeba137c161 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:22.532780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a50bdbf1-eb61-4bc3-af75-feeba137c161 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:22.534120 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a50bdbf1-eb61-4bc3-af75-feeba137c161 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:22.541478 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a50bdbf1-eb61-4bc3-af75-feeba137c161 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:22.542834 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a50bdbf1-eb61-4bc3-af75-feeba137c161 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:22.545543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f653435-c0e3-4b6c-968b-08f198a7b109 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:22.546077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f653435-c0e3-4b6c-968b-08f198a7b109 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:22.546529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f653435-c0e3-4b6c-968b-08f198a7b109 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:22.547250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f653435-c0e3-4b6c-968b-08f198a7b109 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:22.547724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f653435-c0e3-4b6c-968b-08f198a7b109 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:22.548160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f653435-c0e3-4b6c-968b-08f198a7b109 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:22.977658 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a50bdbf1-eb61-4bc3-af75-feeba137c161 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:22.993171 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a50bdbf1-eb61-4bc3-af75-feeba137c161 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1270 microversion: 2.1 time: 0.498453 Aug 04 17:08:22.994219 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1624/3306] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:22 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1270 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:23.011138 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-991772b0-1c71-4c94-9202-8ecfdfb9cb0f req-0cdfaede-91a1-474c-9914-33883e101698 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b", "name": "network-vif-plugged", "status": "completed", "tag": "cd8f865e-af70-411c-8116-3a026f017637"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:23.032123 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-991772b0-1c71-4c94-9202-8ecfdfb9cb0f req-0cdfaede-91a1-474c-9914-33883e101698 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:23.032638 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-991772b0-1c71-4c94-9202-8ecfdfb9cb0f req-0cdfaede-91a1-474c-9914-33883e101698 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:23.033074 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-991772b0-1c71-4c94-9202-8ecfdfb9cb0f req-0cdfaede-91a1-474c-9914-33883e101698 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:23.060712 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-991772b0-1c71-4c94-9202-8ecfdfb9cb0f req-0cdfaede-91a1-474c-9914-33883e101698 service nova] Creating event network-vif-plugged:cd8f865e-af70-411c-8116-3a026f017637 for instance 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b on n-h2-851359-3 Aug 04 17:08:23.083848 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-991772b0-1c71-4c94-9202-8ecfdfb9cb0f req-0cdfaede-91a1-474c-9914-33883e101698 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088166 Aug 04 17:08:23.084804 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1625/3307] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:23.093062 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3e05be78-e7db-483f-bb85-ffb60fa0e5cc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-992091397"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:23.095774 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3e05be78-e7db-483f-bb85-ffb60fa0e5cc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:23.103300 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e05be78-e7db-483f-bb85-ffb60fa0e5cc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:23.104556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e05be78-e7db-483f-bb85-ffb60fa0e5cc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:23.105163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e05be78-e7db-483f-bb85-ffb60fa0e5cc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:23.106652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e05be78-e7db-483f-bb85-ffb60fa0e5cc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:23.107286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e05be78-e7db-483f-bb85-ffb60fa0e5cc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:23.107880 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e05be78-e7db-483f-bb85-ffb60fa0e5cc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:23.509280 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3e05be78-e7db-483f-bb85-ffb60fa0e5cc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action" status: 202 len: 0 microversion: 2.1 time: 0.422871 Aug 04 17:08:23.511665 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1626/3308] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:08:23 2022] POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action => generated 0 bytes in 426 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 04 17:08:23.547325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a955a1bb-ab9f-4244-a4c6-e196fb27cbe9 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:23.548149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a955a1bb-ab9f-4244-a4c6-e196fb27cbe9 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:23.577414 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4f653435-c0e3-4b6c-968b-08f198a7b109 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:23.586917 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4f653435-c0e3-4b6c-968b-08f198a7b109 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1314 microversion: 2.1 time: 1.067247 Aug 04 17:08:23.592416 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a955a1bb-ab9f-4244-a4c6-e196fb27cbe9 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:23.592923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a955a1bb-ab9f-4244-a4c6-e196fb27cbe9 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:23.600331 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1683/3309] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:22 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1314 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:23.602952 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a955a1bb-ab9f-4244-a4c6-e196fb27cbe9 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:23.603961 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a955a1bb-ab9f-4244-a4c6-e196fb27cbe9 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:23.607747 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f01d41c0-cfd0-4958-b5db-98686b13eac4 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:23.611990 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a955a1bb-ab9f-4244-a4c6-e196fb27cbe9 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:23.612827 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a955a1bb-ab9f-4244-a4c6-e196fb27cbe9 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:23.618261 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f01d41c0-cfd0-4958-b5db-98686b13eac4 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 70c75b7c-2890-48a2-a7b2-7caf3125a492] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:23.638620 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f01d41c0-cfd0-4958-b5db-98686b13eac4 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:23.645571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f01d41c0-cfd0-4958-b5db-98686b13eac4 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:23.646406 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f01d41c0-cfd0-4958-b5db-98686b13eac4 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:23.647382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f01d41c0-cfd0-4958-b5db-98686b13eac4 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:23.648062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f01d41c0-cfd0-4958-b5db-98686b13eac4 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:23.648728 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f01d41c0-cfd0-4958-b5db-98686b13eac4 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:23.899141 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a955a1bb-ab9f-4244-a4c6-e196fb27cbe9 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:23.915212 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a955a1bb-ab9f-4244-a4c6-e196fb27cbe9 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:23.917130 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a955a1bb-ab9f-4244-a4c6-e196fb27cbe9 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:23.918584 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a955a1bb-ab9f-4244-a4c6-e196fb27cbe9 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36" status: 200 len: 1265 microversion: 2.26 time: 0.405911 Aug 04 17:08:23.919638 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1627/3310] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:08:23 2022] GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36 => generated 1265 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:08:23.939830 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2bf21248-35e0-4156-9672-967f0915699e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:23.940851 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2bf21248-35e0-4156-9672-967f0915699e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: fbee7e39-ec6b-4a04-92e3-56c14721eb85] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:23.953499 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2bf21248-35e0-4156-9672-967f0915699e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:23.955557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2bf21248-35e0-4156-9672-967f0915699e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:23.956686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2bf21248-35e0-4156-9672-967f0915699e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:23.958644 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2bf21248-35e0-4156-9672-967f0915699e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:23.961292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2bf21248-35e0-4156-9672-967f0915699e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:23.961771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2bf21248-35e0-4156-9672-967f0915699e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:23.977158 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-2bf21248-35e0-4156-9672-967f0915699e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] HTTP exception thrown: Instance fbee7e39-ec6b-4a04-92e3-56c14721eb85 could not be found. Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2bf21248-35e0-4156-9672-967f0915699e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Request method failure captured: Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/fbee7e39-ec6b-4a04-92e3-56c14721eb85 HTTP/1.1 Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_w0jZeUsbjEc5kYg27hf-dMmPEmOS8mz9zj3LiyLgIwLfZP9355AOtAolQUi0IfSyHmBTm0ZLYpzXBPR2sg5A16dXtRgSW2ZOMGwE8_C42ShFtz9WjdriiJ5vR6sp-55xsNqL34nsOcOKnlgDPAz7cPTUNxqkeWCJfWyd01S-wbqeI Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: de328615cef94528b55b8309dd9b82b0 Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersOnMultiNodesTest-1487912368 Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/de328615cef94528b55b8309dd9b82b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/de328615cef94528b55b8309dd9b82b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_de328615cef94528b55b8309dd9b82b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/de328615cef94528b55b8309dd9b82b0"}]}] Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersOnMultiNodesTest-1487912368 Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: de328615cef94528b55b8309dd9b82b0 Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1487912368 Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersOnMultiNodesTest-1487912368-project Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: abad886e45bd4c4b8f5f0f86c45eb068 Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersOnMultiNodesTest-1487912368-project Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance fbee7e39-ec6b-4a04-92e3-56c14721eb85 could not be found. Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'fbee7e39-ec6b-4a04-92e3-56c14721eb85'} Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbee7e39-ec6b-4a04-92e3-56c14721eb85 could not be found. Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbee7e39-ec6b-4a04-92e3-56c14721eb85 could not be found. Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:08:23.979436 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:08:23.984049 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:23.984049 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:08:23.984049 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:08:23.984049 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:08:23.984049 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:08:23.984049 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbee7e39-ec6b-4a04-92e3-56c14721eb85 could not be found. Aug 04 17:08:23.984049 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:08:23.985176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f01d41c0-cfd0-4958-b5db-98686b13eac4 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:23.986195 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2bf21248-35e0-4156-9672-967f0915699e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Returning 404 to user: Instance fbee7e39-ec6b-4a04-92e3-56c14721eb85 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:08:23.987316 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2bf21248-35e0-4156-9672-967f0915699e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/fbee7e39-ec6b-4a04-92e3-56c14721eb85" status: 404 len: 111 microversion: 2.1 time: 0.066242 Aug 04 17:08:23.991924 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1628/3311] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:23 2022] GET /compute/v2.1/servers/fbee7e39-ec6b-4a04-92e3-56c14721eb85 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:08:23.998609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-258f1620-eb0c-4d1a-bc90-05db199441c6 req-78843567-aaff-448a-9fcd-4c32366ff6df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec6241cf-bde4-47ad-9e71-7a95f04844b2", "name": "network-vif-deleted", "tag": "aa1e462a-c9ad-4a1c-a2c6-89bf4964520f"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:23.999994 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f01d41c0-cfd0-4958-b5db-98686b13eac4 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492" status: 200 len: 1281 microversion: 2.1 time: 0.398211 Aug 04 17:08:24.000678 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1684/3312] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:23 2022] GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492 => generated 1281 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:24.018806 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-258f1620-eb0c-4d1a-bc90-05db199441c6 req-78843567-aaff-448a-9fcd-4c32366ff6df service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:24.019741 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-258f1620-eb0c-4d1a-bc90-05db199441c6 req-78843567-aaff-448a-9fcd-4c32366ff6df service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:24.021404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-258f1620-eb0c-4d1a-bc90-05db199441c6 req-78843567-aaff-448a-9fcd-4c32366ff6df service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:24.026635 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ca41b446-1cd5-4f6b-a60e-46fafcc99533 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:24.027647 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ca41b446-1cd5-4f6b-a60e-46fafcc99533 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: ca421464-9d69-4127-a819-37fc1936680e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:24.046565 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca41b446-1cd5-4f6b-a60e-46fafcc99533 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:24.047413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca41b446-1cd5-4f6b-a60e-46fafcc99533 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:24.048604 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca41b446-1cd5-4f6b-a60e-46fafcc99533 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:24.049730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca41b446-1cd5-4f6b-a60e-46fafcc99533 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:24.050787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca41b446-1cd5-4f6b-a60e-46fafcc99533 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:24.051706 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca41b446-1cd5-4f6b-a60e-46fafcc99533 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:24.055316 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-258f1620-eb0c-4d1a-bc90-05db199441c6 req-78843567-aaff-448a-9fcd-4c32366ff6df service nova] Creating event network-vif-deleted:aa1e462a-c9ad-4a1c-a2c6-89bf4964520f for instance ec6241cf-bde4-47ad-9e71-7a95f04844b2 on n-h2-851359-3 Aug 04 17:08:24.059500 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:24.066884 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-258f1620-eb0c-4d1a-bc90-05db199441c6 req-78843567-aaff-448a-9fcd-4c32366ff6df service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073352 Aug 04 17:08:24.070941 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1629/3313] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:24.076870 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-ca41b446-1cd5-4f6b-a60e-46fafcc99533 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] HTTP exception thrown: Instance ca421464-9d69-4127-a819-37fc1936680e could not be found. Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ca41b446-1cd5-4f6b-a60e-46fafcc99533 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Request method failure captured: Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e HTTP/1.1 Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_w0jZeUsbjEc5kYg27hf-dMmPEmOS8mz9zj3LiyLgIwLfZP9355AOtAolQUi0IfSyHmBTm0ZLYpzXBPR2sg5A16dXtRgSW2ZOMGwE8_C42ShFtz9WjdriiJ5vR6sp-55xsNqL34nsOcOKnlgDPAz7cPTUNxqkeWCJfWyd01S-wbqeI Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: de328615cef94528b55b8309dd9b82b0 Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersOnMultiNodesTest-1487912368 Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/de328615cef94528b55b8309dd9b82b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/de328615cef94528b55b8309dd9b82b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_de328615cef94528b55b8309dd9b82b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/de328615cef94528b55b8309dd9b82b0"}]}] Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersOnMultiNodesTest-1487912368 Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: de328615cef94528b55b8309dd9b82b0 Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1487912368 Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersOnMultiNodesTest-1487912368-project Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: abad886e45bd4c4b8f5f0f86c45eb068 Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersOnMultiNodesTest-1487912368-project Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance ca421464-9d69-4127-a819-37fc1936680e could not be found. Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'ca421464-9d69-4127-a819-37fc1936680e'} Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca421464-9d69-4127-a819-37fc1936680e could not be found. Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca421464-9d69-4127-a819-37fc1936680e could not be found. Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:08:24.079232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:24.083411 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:24.083411 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:08:24.083411 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:08:24.083411 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:08:24.083411 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:08:24.083411 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca421464-9d69-4127-a819-37fc1936680e could not be found. Aug 04 17:08:24.083411 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:24.083848 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e2d4aa05-be58-4fa1-9749-2285f37a5d4b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:24.084475 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e2d4aa05-be58-4fa1-9749-2285f37a5d4b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:24.086161 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ca41b446-1cd5-4f6b-a60e-46fafcc99533 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Returning 404 to user: Instance ca421464-9d69-4127-a819-37fc1936680e could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:08:24.087986 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ca41b446-1cd5-4f6b-a60e-46fafcc99533 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e" status: 404 len: 111 microversion: 2.1 time: 0.085330 Aug 04 17:08:24.089176 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1685/3314] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:24 2022] GET /compute/v2.1/servers/ca421464-9d69-4127-a819-37fc1936680e => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:08:24.101044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-428436ef-b46f-4084-831c-20448b923aa6 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:24.112550 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2d4aa05-be58-4fa1-9749-2285f37a5d4b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:24.113342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2d4aa05-be58-4fa1-9749-2285f37a5d4b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:24.113936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2d4aa05-be58-4fa1-9749-2285f37a5d4b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:24.114871 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2d4aa05-be58-4fa1-9749-2285f37a5d4b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:24.115442 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2d4aa05-be58-4fa1-9749-2285f37a5d4b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:24.115995 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2d4aa05-be58-4fa1-9749-2285f37a5d4b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:24.139215 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-428436ef-b46f-4084-831c-20448b923aa6 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/c76122ce-aec5-4040-a435-ce738fc598fc" status: 204 len: 0 microversion: 2.1 time: 0.045672 Aug 04 17:08:24.140874 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1686/3315] 10.222.0.93 () {58 vars in 1266 bytes} [Thu Aug 4 17:08:24 2022] DELETE /compute/v2.1/os-server-groups/c76122ce-aec5-4040-a435-ce738fc598fc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:08:24.155952 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1cb6f0b0-1972-43b4-9be4-fcc50bfafd60 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:24.157280 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1cb6f0b0-1972-43b4-9be4-fcc50bfafd60 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 2898397c-98e0-416d-b35d-18984c4730e2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:24.183897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1cb6f0b0-1972-43b4-9be4-fcc50bfafd60 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:24.184420 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1cb6f0b0-1972-43b4-9be4-fcc50bfafd60 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:24.195975 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1cb6f0b0-1972-43b4-9be4-fcc50bfafd60 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:24.199186 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1cb6f0b0-1972-43b4-9be4-fcc50bfafd60 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:24.203712 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1cb6f0b0-1972-43b4-9be4-fcc50bfafd60 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:24.205705 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1cb6f0b0-1972-43b4-9be4-fcc50bfafd60 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:24.261084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1cb6f0b0-1972-43b4-9be4-fcc50bfafd60 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 2898397c-98e0-416d-b35d-18984c4730e2] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:08:24.284050 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e2d4aa05-be58-4fa1-9749-2285f37a5d4b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:24.303146 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e2d4aa05-be58-4fa1-9749-2285f37a5d4b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1276 microversion: 2.1 time: 0.230775 Aug 04 17:08:24.323315 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1630/3316] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:24 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1276 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:24.504524 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1cb6f0b0-1972-43b4-9be4-fcc50bfafd60 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "DELETE /compute/v2.1/servers/2898397c-98e0-416d-b35d-18984c4730e2" status: 204 len: 0 microversion: 2.1 time: 0.355022 Aug 04 17:08:24.511030 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1687/3317] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:08:24 2022] DELETE /compute/v2.1/servers/2898397c-98e0-416d-b35d-18984c4730e2 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:08:24.521027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3fd12c14-18a2-4fe1-a54b-ad93fd73879e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:24.521541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3fd12c14-18a2-4fe1-a54b-ad93fd73879e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 893dbe88-23f3-472b-a24f-67b4e8c18007] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:24.539414 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3fd12c14-18a2-4fe1-a54b-ad93fd73879e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:24.539929 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3fd12c14-18a2-4fe1-a54b-ad93fd73879e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:24.542437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3fd12c14-18a2-4fe1-a54b-ad93fd73879e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:24.552557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3fd12c14-18a2-4fe1-a54b-ad93fd73879e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:24.558829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3fd12c14-18a2-4fe1-a54b-ad93fd73879e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:24.559528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3fd12c14-18a2-4fe1-a54b-ad93fd73879e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:24.610052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-73b36a92-2e79-48bb-9983-4d1847d729eb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:24.610853 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-73b36a92-2e79-48bb-9983-4d1847d729eb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:24.633777 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73b36a92-2e79-48bb-9983-4d1847d729eb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:24.637474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73b36a92-2e79-48bb-9983-4d1847d729eb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:24.637721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73b36a92-2e79-48bb-9983-4d1847d729eb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:24.639670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73b36a92-2e79-48bb-9983-4d1847d729eb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:24.640202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73b36a92-2e79-48bb-9983-4d1847d729eb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:24.640620 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73b36a92-2e79-48bb-9983-4d1847d729eb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:24.685355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3fd12c14-18a2-4fe1-a54b-ad93fd73879e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 893dbe88-23f3-472b-a24f-67b4e8c18007] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:08:24.933769 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3fd12c14-18a2-4fe1-a54b-ad93fd73879e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "DELETE /compute/v2.1/servers/893dbe88-23f3-472b-a24f-67b4e8c18007" status: 204 len: 0 microversion: 2.1 time: 0.419553 Aug 04 17:08:24.935451 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1631/3318] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:08:24 2022] DELETE /compute/v2.1/servers/893dbe88-23f3-472b-a24f-67b4e8c18007 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:08:24.943791 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-f42443d5-848a-4c06-aaa5-0baa86eeef64 req-eee85917-0b04-40c7-9d84-032f9ac135cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbee7e39-ec6b-4a04-92e3-56c14721eb85", "name": "network-vif-deleted", "tag": "f33593f9-9a52-4a4a-ab95-39d9214c39fc"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:24.957166 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f42443d5-848a-4c06-aaa5-0baa86eeef64 req-eee85917-0b04-40c7-9d84-032f9ac135cd service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:24.957784 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f42443d5-848a-4c06-aaa5-0baa86eeef64 req-eee85917-0b04-40c7-9d84-032f9ac135cd service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:24.958341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f42443d5-848a-4c06-aaa5-0baa86eeef64 req-eee85917-0b04-40c7-9d84-032f9ac135cd service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:24.987839 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-f42443d5-848a-4c06-aaa5-0baa86eeef64 req-eee85917-0b04-40c7-9d84-032f9ac135cd service nova] Creating event network-vif-deleted:f33593f9-9a52-4a4a-ab95-39d9214c39fc for instance fbee7e39-ec6b-4a04-92e3-56c14721eb85 on n-h2-851359-3 Aug 04 17:08:24.998430 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-f42443d5-848a-4c06-aaa5-0baa86eeef64 req-eee85917-0b04-40c7-9d84-032f9ac135cd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061272 Aug 04 17:08:25.003393 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1632/3319] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:25.009927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ee06ebe0-a7c3-4683-885b-e5cb3ece3ddc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:25.022535 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ee06ebe0-a7c3-4683-885b-e5cb3ece3ddc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:25.035854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee06ebe0-a7c3-4683-885b-e5cb3ece3ddc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:25.038235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee06ebe0-a7c3-4683-885b-e5cb3ece3ddc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:25.041494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee06ebe0-a7c3-4683-885b-e5cb3ece3ddc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:25.042538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee06ebe0-a7c3-4683-885b-e5cb3ece3ddc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:25.046486 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee06ebe0-a7c3-4683-885b-e5cb3ece3ddc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:25.047301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee06ebe0-a7c3-4683-885b-e5cb3ece3ddc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:25.259280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ee06ebe0-a7c3-4683-885b-e5cb3ece3ddc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:25.272226 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ee06ebe0-a7c3-4683-885b-e5cb3ece3ddc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:25.276364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ee06ebe0-a7c3-4683-885b-e5cb3ece3ddc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:25.282391 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ee06ebe0-a7c3-4683-885b-e5cb3ece3ddc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36" status: 200 len: 1321 microversion: 2.26 time: 0.277205 Aug 04 17:08:25.285621 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1633/3320] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:08:25 2022] GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36 => generated 1321 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:08:25.306536 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-32af273f-543d-4577-abec-624822d2fb21 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:25.306751 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-32af273f-543d-4577-abec-624822d2fb21 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 2898397c-98e0-416d-b35d-18984c4730e2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:25.325264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32af273f-543d-4577-abec-624822d2fb21 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:25.326115 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32af273f-543d-4577-abec-624822d2fb21 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:25.326660 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32af273f-543d-4577-abec-624822d2fb21 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:25.327675 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32af273f-543d-4577-abec-624822d2fb21 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:25.328781 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32af273f-543d-4577-abec-624822d2fb21 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:25.330348 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32af273f-543d-4577-abec-624822d2fb21 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:25.350552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-73b36a92-2e79-48bb-9983-4d1847d729eb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:25.367929 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-73b36a92-2e79-48bb-9983-4d1847d729eb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1314 microversion: 2.1 time: 0.758281 Aug 04 17:08:25.371782 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1688/3321] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:24 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1314 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:25.389022 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-31e4bdd1-0e37-4629-b459-703c8f21235b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:25.390111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-31e4bdd1-0e37-4629-b459-703c8f21235b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 70c75b7c-2890-48a2-a7b2-7caf3125a492] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:25.422430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31e4bdd1-0e37-4629-b459-703c8f21235b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:25.423125 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31e4bdd1-0e37-4629-b459-703c8f21235b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:25.424481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31e4bdd1-0e37-4629-b459-703c8f21235b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:25.430271 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31e4bdd1-0e37-4629-b459-703c8f21235b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:25.430885 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31e4bdd1-0e37-4629-b459-703c8f21235b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:25.431461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31e4bdd1-0e37-4629-b459-703c8f21235b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:25.940621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-32af273f-543d-4577-abec-624822d2fb21 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:25.952701 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-32af273f-543d-4577-abec-624822d2fb21 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/2898397c-98e0-416d-b35d-18984c4730e2" status: 200 len: 1475 microversion: 2.1 time: 0.650633 Aug 04 17:08:25.953310 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1634/3322] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:25 2022] GET /compute/v2.1/servers/2898397c-98e0-416d-b35d-18984c4730e2 => generated 1475 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:25.965536 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-229fd7db-3960-4ddc-8e73-d3dc0a20a61f req-5385ac7c-e415-466a-9c30-e7180e1b4777 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10991c59-c7d8-447e-8f2b-3f5ea5d8d62a", "name": "network-vif-unplugged", "status": "completed", "tag": "d34d92ed-1a8a-4623-be8e-630b78a99ac4"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:25.983956 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-31e4bdd1-0e37-4629-b459-703c8f21235b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:25.995596 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-31e4bdd1-0e37-4629-b459-703c8f21235b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492" status: 200 len: 1323 microversion: 2.1 time: 0.618590 Aug 04 17:08:26.001682 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1689/3323] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:25 2022] GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492 => generated 1323 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:26.011304 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ed80cf81-ab98-4835-93aa-e916a4ca20c5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:26.012420 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ed80cf81-ab98-4835-93aa-e916a4ca20c5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:26.019039 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-229fd7db-3960-4ddc-8e73-d3dc0a20a61f req-5385ac7c-e415-466a-9c30-e7180e1b4777 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:26.020071 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-229fd7db-3960-4ddc-8e73-d3dc0a20a61f req-5385ac7c-e415-466a-9c30-e7180e1b4777 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:26.020603 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-229fd7db-3960-4ddc-8e73-d3dc0a20a61f req-5385ac7c-e415-466a-9c30-e7180e1b4777 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:26.031975 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed80cf81-ab98-4835-93aa-e916a4ca20c5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:26.032879 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed80cf81-ab98-4835-93aa-e916a4ca20c5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:26.033570 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed80cf81-ab98-4835-93aa-e916a4ca20c5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:26.034565 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed80cf81-ab98-4835-93aa-e916a4ca20c5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:26.035422 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed80cf81-ab98-4835-93aa-e916a4ca20c5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:26.037322 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed80cf81-ab98-4835-93aa-e916a4ca20c5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:26.051467 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-229fd7db-3960-4ddc-8e73-d3dc0a20a61f req-5385ac7c-e415-466a-9c30-e7180e1b4777 service nova] Creating event network-vif-unplugged:d34d92ed-1a8a-4623-be8e-630b78a99ac4 for instance 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a on n-h1-851359-3 Aug 04 17:08:26.068115 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-229fd7db-3960-4ddc-8e73-d3dc0a20a61f req-5385ac7c-e415-466a-9c30-e7180e1b4777 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110255 Aug 04 17:08:26.068737 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1635/3324] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:26.168489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ed80cf81-ab98-4835-93aa-e916a4ca20c5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:26.177436 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ed80cf81-ab98-4835-93aa-e916a4ca20c5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1276 microversion: 2.1 time: 0.173899 Aug 04 17:08:26.182160 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1690/3325] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:26 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1276 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:26.256083 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-c8f4416a-65f4-4cfa-9e39-6f2f3fa636ea req-a5ff2312-356d-4c73-8f08-ae951bc0fb94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ad185e4-a5ae-4222-b0d7-9c29ee8a9061", "tag": "f7b26e84-5e02-418a-9944-239997927fe9"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:26.277841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c8f4416a-65f4-4cfa-9e39-6f2f3fa636ea req-a5ff2312-356d-4c73-8f08-ae951bc0fb94 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:26.286336 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c8f4416a-65f4-4cfa-9e39-6f2f3fa636ea req-a5ff2312-356d-4c73-8f08-ae951bc0fb94 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:26.287216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c8f4416a-65f4-4cfa-9e39-6f2f3fa636ea req-a5ff2312-356d-4c73-8f08-ae951bc0fb94 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:26.310950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1d9ac5bf-6e50-491f-9f91-a2da75482119 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:26.313584 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1d9ac5bf-6e50-491f-9f91-a2da75482119 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:26.319021 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-c8f4416a-65f4-4cfa-9e39-6f2f3fa636ea req-a5ff2312-356d-4c73-8f08-ae951bc0fb94 service nova] Creating event network-changed:f7b26e84-5e02-418a-9944-239997927fe9 for instance 5ad185e4-a5ae-4222-b0d7-9c29ee8a9061 on n-h1-851359-3 Aug 04 17:08:26.322248 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d9ac5bf-6e50-491f-9f91-a2da75482119 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:26.325189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d9ac5bf-6e50-491f-9f91-a2da75482119 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:26.325795 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d9ac5bf-6e50-491f-9f91-a2da75482119 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:26.326571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d9ac5bf-6e50-491f-9f91-a2da75482119 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:26.327183 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d9ac5bf-6e50-491f-9f91-a2da75482119 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:26.327606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d9ac5bf-6e50-491f-9f91-a2da75482119 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:26.335544 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-c8f4416a-65f4-4cfa-9e39-6f2f3fa636ea req-a5ff2312-356d-4c73-8f08-ae951bc0fb94 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083301 Aug 04 17:08:26.336645 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1636/3326] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:26.397707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-48e20363-d6e0-423e-9783-808f6d3cb203 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:26.406363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-48e20363-d6e0-423e-9783-808f6d3cb203 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:26.415674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48e20363-d6e0-423e-9783-808f6d3cb203 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:26.416179 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48e20363-d6e0-423e-9783-808f6d3cb203 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:26.416678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48e20363-d6e0-423e-9783-808f6d3cb203 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:26.417381 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48e20363-d6e0-423e-9783-808f6d3cb203 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:26.417845 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48e20363-d6e0-423e-9783-808f6d3cb203 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:26.425739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48e20363-d6e0-423e-9783-808f6d3cb203 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:26.428295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1d9ac5bf-6e50-491f-9f91-a2da75482119 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:26.442701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1d9ac5bf-6e50-491f-9f91-a2da75482119 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:26.449030 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1d9ac5bf-6e50-491f-9f91-a2da75482119 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:26.451664 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1d9ac5bf-6e50-491f-9f91-a2da75482119 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36" status: 200 len: 1319 microversion: 2.26 time: 0.147335 Aug 04 17:08:26.452911 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1691/3327] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:08:26 2022] GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:08:26.732860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-48e20363-d6e0-423e-9783-808f6d3cb203 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:26.741487 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-48e20363-d6e0-423e-9783-808f6d3cb203 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1314 microversion: 2.1 time: 0.348247 Aug 04 17:08:26.742696 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1637/3328] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:26 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:26.972778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-880db6df-567c-4c35-a357-8e1f94d12b7e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:26.973870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-880db6df-567c-4c35-a357-8e1f94d12b7e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 2898397c-98e0-416d-b35d-18984c4730e2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:26.982013 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-880db6df-567c-4c35-a357-8e1f94d12b7e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:26.982781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-880db6df-567c-4c35-a357-8e1f94d12b7e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:26.983435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-880db6df-567c-4c35-a357-8e1f94d12b7e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:26.984168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-880db6df-567c-4c35-a357-8e1f94d12b7e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:26.985519 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-880db6df-567c-4c35-a357-8e1f94d12b7e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:26.986343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-880db6df-567c-4c35-a357-8e1f94d12b7e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:27.023977 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7c09dd11-67f4-4a89-b3b4-1eda95a9c52f tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:27.025371 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7c09dd11-67f4-4a89-b3b4-1eda95a9c52f tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 70c75b7c-2890-48a2-a7b2-7caf3125a492] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:27.059370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c09dd11-67f4-4a89-b3b4-1eda95a9c52f tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:27.059658 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c09dd11-67f4-4a89-b3b4-1eda95a9c52f tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:27.060481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c09dd11-67f4-4a89-b3b4-1eda95a9c52f tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:27.061377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c09dd11-67f4-4a89-b3b4-1eda95a9c52f tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:27.062116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c09dd11-67f4-4a89-b3b4-1eda95a9c52f tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:27.063294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c09dd11-67f4-4a89-b3b4-1eda95a9c52f tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:27.226043 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-880db6df-567c-4c35-a357-8e1f94d12b7e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:27.235027 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-880db6df-567c-4c35-a357-8e1f94d12b7e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/2898397c-98e0-416d-b35d-18984c4730e2" status: 200 len: 1475 microversion: 2.1 time: 0.266101 Aug 04 17:08:27.235625 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1692/3329] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:26 2022] GET /compute/v2.1/servers/2898397c-98e0-416d-b35d-18984c4730e2 => generated 1475 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:27.246638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-60d28c84-f510-4739-94a0-c5a8dcce94ec req-f13e5f7b-56d5-49de-952d-242a0f76b906 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33022d3d-bb86-401e-98c8-c6f04f3d8959", "tag": "e187bd1f-d4ce-4fa5-ba9e-cfd65b40a2c5"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:27.257651 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-60d28c84-f510-4739-94a0-c5a8dcce94ec req-f13e5f7b-56d5-49de-952d-242a0f76b906 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:27.258489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-60d28c84-f510-4739-94a0-c5a8dcce94ec req-f13e5f7b-56d5-49de-952d-242a0f76b906 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:27.259124 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-60d28c84-f510-4739-94a0-c5a8dcce94ec req-f13e5f7b-56d5-49de-952d-242a0f76b906 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:27.274621 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-60d28c84-f510-4739-94a0-c5a8dcce94ec req-f13e5f7b-56d5-49de-952d-242a0f76b906 service nova] Creating event network-changed:e187bd1f-d4ce-4fa5-ba9e-cfd65b40a2c5 for instance 33022d3d-bb86-401e-98c8-c6f04f3d8959 on n-h1-851359-3 Aug 04 17:08:27.282205 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-60d28c84-f510-4739-94a0-c5a8dcce94ec req-f13e5f7b-56d5-49de-952d-242a0f76b906 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044368 Aug 04 17:08:27.283476 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1693/3330] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:27.289948 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-44a0b75c-0af3-4a2e-a4dc-04a6cae05f5b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:27.291031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-44a0b75c-0af3-4a2e-a4dc-04a6cae05f5b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:27.300043 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-44a0b75c-0af3-4a2e-a4dc-04a6cae05f5b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:27.300803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-44a0b75c-0af3-4a2e-a4dc-04a6cae05f5b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:27.301421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-44a0b75c-0af3-4a2e-a4dc-04a6cae05f5b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:27.304917 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7c09dd11-67f4-4a89-b3b4-1eda95a9c52f tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:27.309258 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-44a0b75c-0af3-4a2e-a4dc-04a6cae05f5b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:27.309757 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-44a0b75c-0af3-4a2e-a4dc-04a6cae05f5b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:27.310238 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-44a0b75c-0af3-4a2e-a4dc-04a6cae05f5b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:27.319236 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7c09dd11-67f4-4a89-b3b4-1eda95a9c52f tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492" status: 200 len: 1323 microversion: 2.1 time: 0.302579 Aug 04 17:08:27.320068 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1638/3331] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:27 2022] GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492 => generated 1323 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:08:27.479931 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a72fd103-8fe5-4db5-8366-77363a3ff1bc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:27.480598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a72fd103-8fe5-4db5-8366-77363a3ff1bc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:27.500302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a72fd103-8fe5-4db5-8366-77363a3ff1bc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:27.502312 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a72fd103-8fe5-4db5-8366-77363a3ff1bc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:27.502994 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a72fd103-8fe5-4db5-8366-77363a3ff1bc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:27.503910 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a72fd103-8fe5-4db5-8366-77363a3ff1bc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:27.504607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a72fd103-8fe5-4db5-8366-77363a3ff1bc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:27.505197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a72fd103-8fe5-4db5-8366-77363a3ff1bc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:27.552897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-44a0b75c-0af3-4a2e-a4dc-04a6cae05f5b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:27.563496 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-44a0b75c-0af3-4a2e-a4dc-04a6cae05f5b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1318 microversion: 2.1 time: 0.278183 Aug 04 17:08:27.565248 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1694/3332] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:27 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:27.607500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a72fd103-8fe5-4db5-8366-77363a3ff1bc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:27.620263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a72fd103-8fe5-4db5-8366-77363a3ff1bc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:27.622237 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a72fd103-8fe5-4db5-8366-77363a3ff1bc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:27.625673 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a72fd103-8fe5-4db5-8366-77363a3ff1bc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36" status: 200 len: 1319 microversion: 2.26 time: 0.148786 Aug 04 17:08:27.626906 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1639/3333] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:08:27 2022] GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:08:27.770639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-41af6bcf-b610-43be-8416-c75230c25e9a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:27.771458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-41af6bcf-b610-43be-8416-c75230c25e9a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:27.781510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-41af6bcf-b610-43be-8416-c75230c25e9a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:27.782418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-41af6bcf-b610-43be-8416-c75230c25e9a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:27.782986 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-41af6bcf-b610-43be-8416-c75230c25e9a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:27.783905 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-41af6bcf-b610-43be-8416-c75230c25e9a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:27.784753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-41af6bcf-b610-43be-8416-c75230c25e9a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:27.785289 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-41af6bcf-b610-43be-8416-c75230c25e9a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:27.983609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-41af6bcf-b610-43be-8416-c75230c25e9a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:27.995936 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-41af6bcf-b610-43be-8416-c75230c25e9a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1314 microversion: 2.1 time: 0.231148 Aug 04 17:08:27.997139 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1695/3334] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:27 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:28.258586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5ee23154-8334-44b3-ab24-4b43701764cb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:28.259929 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5ee23154-8334-44b3-ab24-4b43701764cb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 2898397c-98e0-416d-b35d-18984c4730e2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:28.277826 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ee23154-8334-44b3-ab24-4b43701764cb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:28.278355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ee23154-8334-44b3-ab24-4b43701764cb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:28.278798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ee23154-8334-44b3-ab24-4b43701764cb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:28.279514 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ee23154-8334-44b3-ab24-4b43701764cb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:28.280147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ee23154-8334-44b3-ab24-4b43701764cb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:28.280779 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ee23154-8334-44b3-ab24-4b43701764cb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:28.341685 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f059a7fb-b626-45de-8029-edd56ca2f63d tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:28.342623 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f059a7fb-b626-45de-8029-edd56ca2f63d tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 70c75b7c-2890-48a2-a7b2-7caf3125a492] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:28.353302 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f059a7fb-b626-45de-8029-edd56ca2f63d tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:28.354608 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f059a7fb-b626-45de-8029-edd56ca2f63d tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:28.355260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f059a7fb-b626-45de-8029-edd56ca2f63d tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:28.356259 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f059a7fb-b626-45de-8029-edd56ca2f63d tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:28.356904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f059a7fb-b626-45de-8029-edd56ca2f63d tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:28.357590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f059a7fb-b626-45de-8029-edd56ca2f63d tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:28.765337 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5ee23154-8334-44b3-ab24-4b43701764cb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:28.782594 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5ee23154-8334-44b3-ab24-4b43701764cb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/2898397c-98e0-416d-b35d-18984c4730e2" status: 200 len: 1475 microversion: 2.1 time: 0.529662 Aug 04 17:08:28.796368 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1640/3335] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:28 2022] GET /compute/v2.1/servers/2898397c-98e0-416d-b35d-18984c4730e2 => generated 1475 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:28.796980 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4f0c95b4-fdc5-41a8-9ff6-a15d1e26ae01 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:28.803724 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4f0c95b4-fdc5-41a8-9ff6-a15d1e26ae01 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:28.815754 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f0c95b4-fdc5-41a8-9ff6-a15d1e26ae01 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:28.816560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f0c95b4-fdc5-41a8-9ff6-a15d1e26ae01 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:28.817454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f0c95b4-fdc5-41a8-9ff6-a15d1e26ae01 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:28.818591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f0c95b4-fdc5-41a8-9ff6-a15d1e26ae01 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:28.819262 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f0c95b4-fdc5-41a8-9ff6-a15d1e26ae01 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:28.819900 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f0c95b4-fdc5-41a8-9ff6-a15d1e26ae01 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:28.843711 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:29.042155 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f059a7fb-b626-45de-8029-edd56ca2f63d tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:29.052956 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f059a7fb-b626-45de-8029-edd56ca2f63d tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492" status: 200 len: 1323 microversion: 2.1 time: 0.715909 Aug 04 17:08:29.071369 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1696/3336] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:28 2022] GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492 => generated 1323 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:08:29.084239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-908f7b27-a957-4d0d-a506-0cdb08ca9144 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:29.085239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-908f7b27-a957-4d0d-a506-0cdb08ca9144 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:29.102466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-908f7b27-a957-4d0d-a506-0cdb08ca9144 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:29.103277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-908f7b27-a957-4d0d-a506-0cdb08ca9144 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:29.106160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-908f7b27-a957-4d0d-a506-0cdb08ca9144 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:29.107223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-908f7b27-a957-4d0d-a506-0cdb08ca9144 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:29.110140 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-908f7b27-a957-4d0d-a506-0cdb08ca9144 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:29.115298 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-908f7b27-a957-4d0d-a506-0cdb08ca9144 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:29.325573 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4f0c95b4-fdc5-41a8-9ff6-a15d1e26ae01 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:29.341671 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4f0c95b4-fdc5-41a8-9ff6-a15d1e26ae01 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1318 microversion: 2.1 time: 0.556925 Aug 04 17:08:29.342661 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1641/3337] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:28 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1318 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:29.348093 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a5bdf9a5-3a81-409d-ac72-23772f59e5a4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:29.348711 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a5bdf9a5-3a81-409d-ac72-23772f59e5a4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:29.359981 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5bdf9a5-3a81-409d-ac72-23772f59e5a4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:29.360728 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5bdf9a5-3a81-409d-ac72-23772f59e5a4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:29.361449 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5bdf9a5-3a81-409d-ac72-23772f59e5a4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:29.362619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5bdf9a5-3a81-409d-ac72-23772f59e5a4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:29.363371 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5bdf9a5-3a81-409d-ac72-23772f59e5a4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:29.364017 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5bdf9a5-3a81-409d-ac72-23772f59e5a4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:29.612611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-908f7b27-a957-4d0d-a506-0cdb08ca9144 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:29.621812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-908f7b27-a957-4d0d-a506-0cdb08ca9144 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:29.623884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-908f7b27-a957-4d0d-a506-0cdb08ca9144 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:29.625134 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-908f7b27-a957-4d0d-a506-0cdb08ca9144 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36" status: 200 len: 1361 microversion: 2.26 time: 0.551790 Aug 04 17:08:29.626237 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1697/3338] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:08:29 2022] GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36 => generated 1361 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:08:29.731303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a5bdf9a5-3a81-409d-ac72-23772f59e5a4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:29.742033 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a5bdf9a5-3a81-409d-ac72-23772f59e5a4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1499 microversion: 2.1 time: 0.397829 Aug 04 17:08:29.750490 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1642/3339] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:29 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1499 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:29.764894 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b2e19b2a-0cd6-4ac1-95d9-d5553ace04d4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:29.769058 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b2e19b2a-0cd6-4ac1-95d9-d5553ace04d4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:29.780324 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2e19b2a-0cd6-4ac1-95d9-d5553ace04d4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:29.781626 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2e19b2a-0cd6-4ac1-95d9-d5553ace04d4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:29.782743 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2e19b2a-0cd6-4ac1-95d9-d5553ace04d4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:29.784101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2e19b2a-0cd6-4ac1-95d9-d5553ace04d4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:29.784584 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2e19b2a-0cd6-4ac1-95d9-d5553ace04d4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:29.785034 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2e19b2a-0cd6-4ac1-95d9-d5553ace04d4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:29.805945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e374bcbd-b952-4d00-ad49-57b76819c02d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:29.811223 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e374bcbd-b952-4d00-ad49-57b76819c02d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 2898397c-98e0-416d-b35d-18984c4730e2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:29.812339 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-b2e19b2a-0cd6-4ac1-95d9-d5553ace04d4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lazy-loading 'flavor' on Instance uuid 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:08:29.825044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e374bcbd-b952-4d00-ad49-57b76819c02d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:29.825713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e374bcbd-b952-4d00-ad49-57b76819c02d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:29.826747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e374bcbd-b952-4d00-ad49-57b76819c02d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:29.828049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e374bcbd-b952-4d00-ad49-57b76819c02d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:29.828941 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e374bcbd-b952-4d00-ad49-57b76819c02d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:29.832000 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e374bcbd-b952-4d00-ad49-57b76819c02d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:29.936707 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b2e19b2a-0cd6-4ac1-95d9-d5553ace04d4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "POST /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b/action" status: 200 len: 32 microversion: 2.1 time: 0.177424 Aug 04 17:08:29.937482 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1698/3340] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:08:29 2022] POST /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b/action => generated 32 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:08:29.964144 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-debee962-ceec-41f7-ad68-a766a3b60e8b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:29.964884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-debee962-ceec-41f7-ad68-a766a3b60e8b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:29.975632 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-debee962-ceec-41f7-ad68-a766a3b60e8b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:29.976180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-debee962-ceec-41f7-ad68-a766a3b60e8b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:29.977500 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-debee962-ceec-41f7-ad68-a766a3b60e8b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:29.978449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-debee962-ceec-41f7-ad68-a766a3b60e8b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:29.978958 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-debee962-ceec-41f7-ad68-a766a3b60e8b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:29.981681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-debee962-ceec-41f7-ad68-a766a3b60e8b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:30.417916 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:30.471420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:30.762881 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e374bcbd-b952-4d00-ad49-57b76819c02d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:30.772654 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e374bcbd-b952-4d00-ad49-57b76819c02d tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/2898397c-98e0-416d-b35d-18984c4730e2" status: 200 len: 1475 microversion: 2.1 time: 0.972386 Aug 04 17:08:30.788858 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1643/3341] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:29 2022] GET /compute/v2.1/servers/2898397c-98e0-416d-b35d-18984c4730e2 => generated 1475 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:08:30.795132 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f93f6131-ead1-4cc2-9dc6-196a4432f296 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:30.795969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f93f6131-ead1-4cc2-9dc6-196a4432f296 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 70c75b7c-2890-48a2-a7b2-7caf3125a492] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:30.806626 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f93f6131-ead1-4cc2-9dc6-196a4432f296 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:30.807201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f93f6131-ead1-4cc2-9dc6-196a4432f296 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:30.807667 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f93f6131-ead1-4cc2-9dc6-196a4432f296 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:30.808420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f93f6131-ead1-4cc2-9dc6-196a4432f296 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:30.810335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f93f6131-ead1-4cc2-9dc6-196a4432f296 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:30.810804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f93f6131-ead1-4cc2-9dc6-196a4432f296 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:31.215660 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-debee962-ceec-41f7-ad68-a766a3b60e8b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:31.225993 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-debee962-ceec-41f7-ad68-a766a3b60e8b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1505 microversion: 2.1 time: 1.269598 Aug 04 17:08:31.232491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f93f6131-ead1-4cc2-9dc6-196a4432f296 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:31.255286 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f93f6131-ead1-4cc2-9dc6-196a4432f296 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492" status: 200 len: 1323 microversion: 2.1 time: 0.465066 Aug 04 17:08:31.255809 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1699/3342] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:29 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1505 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:31.262274 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-8663464c-324e-4878-bc08-aa4b6d22c360 req-319728a4-a057-4ad5-8650-37c1470e9b01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a592dcbd-6b85-4d18-acdb-82f579be9067", "tag": "50ccfc29-071f-4ee9-b4b3-d1abf0c5facb"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:31.283030 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1644/3343] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:30 2022] GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492 => generated 1323 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:31.299733 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aafccac6-ea7f-4099-9034-6d024a105d68 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:31.300720 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aafccac6-ea7f-4099-9034-6d024a105d68 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:31.318710 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8663464c-324e-4878-bc08-aa4b6d22c360 req-319728a4-a057-4ad5-8650-37c1470e9b01 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:31.327597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8663464c-324e-4878-bc08-aa4b6d22c360 req-319728a4-a057-4ad5-8650-37c1470e9b01 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:31.328083 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aafccac6-ea7f-4099-9034-6d024a105d68 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:31.328236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8663464c-324e-4878-bc08-aa4b6d22c360 req-319728a4-a057-4ad5-8650-37c1470e9b01 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:31.331548 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aafccac6-ea7f-4099-9034-6d024a105d68 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:31.334954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aafccac6-ea7f-4099-9034-6d024a105d68 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:31.338969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aafccac6-ea7f-4099-9034-6d024a105d68 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:31.342220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aafccac6-ea7f-4099-9034-6d024a105d68 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:31.342869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aafccac6-ea7f-4099-9034-6d024a105d68 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:31.349841 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-8663464c-324e-4878-bc08-aa4b6d22c360 req-319728a4-a057-4ad5-8650-37c1470e9b01 service nova] Creating event network-changed:50ccfc29-071f-4ee9-b4b3-d1abf0c5facb for instance a592dcbd-6b85-4d18-acdb-82f579be9067 on n-h1-851359-3 Aug 04 17:08:31.367267 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-8663464c-324e-4878-bc08-aa4b6d22c360 req-319728a4-a057-4ad5-8650-37c1470e9b01 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109859 Aug 04 17:08:31.372122 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1700/3344] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:31.378233 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9247373c-d07e-4a60-9616-44670d52f94d tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:31.379327 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9247373c-d07e-4a60-9616-44670d52f94d tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:31.410509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9247373c-d07e-4a60-9616-44670d52f94d tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:31.411385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9247373c-d07e-4a60-9616-44670d52f94d tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:31.413399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9247373c-d07e-4a60-9616-44670d52f94d tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:31.414457 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9247373c-d07e-4a60-9616-44670d52f94d tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:31.415114 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9247373c-d07e-4a60-9616-44670d52f94d tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:31.415755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9247373c-d07e-4a60-9616-44670d52f94d tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:31.523787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:31.945561 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9247373c-d07e-4a60-9616-44670d52f94d tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:31.976889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9247373c-d07e-4a60-9616-44670d52f94d tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:31.980220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9247373c-d07e-4a60-9616-44670d52f94d tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:31.987747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-aafccac6-ea7f-4099-9034-6d024a105d68 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:31.999744 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9247373c-d07e-4a60-9616-44670d52f94d tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36" status: 200 len: 1361 microversion: 2.26 time: 0.617740 Aug 04 17:08:32.000901 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1701/3345] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:08:31 2022] GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36 => generated 1361 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:08:32.017812 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aafccac6-ea7f-4099-9034-6d024a105d68 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1318 microversion: 2.1 time: 0.728405 Aug 04 17:08:32.026582 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1645/3346] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:31 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1318 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:32.032878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-767b3e2b-b822-4009-baa2-0ac2af841e42 req-d0facf5b-081c-4daf-b9d5-6ec014eb7113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10991c59-c7d8-447e-8f2b-3f5ea5d8d62a", "name": "network-vif-plugged", "status": "completed", "tag": "d34d92ed-1a8a-4623-be8e-630b78a99ac4"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:32.038909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-44bf05fc-3b2d-406e-9903-c4d051a27c47 req-20fcd838-c0ae-4462-8182-65eb7bf6ddaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70c75b7c-2890-48a2-a7b2-7caf3125a492", "tag": "b59491de-0168-4cb2-aee2-eef9338c21f0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:32.060091 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-767b3e2b-b822-4009-baa2-0ac2af841e42 req-d0facf5b-081c-4daf-b9d5-6ec014eb7113 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:32.061949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-767b3e2b-b822-4009-baa2-0ac2af841e42 req-d0facf5b-081c-4daf-b9d5-6ec014eb7113 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:32.066110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-767b3e2b-b822-4009-baa2-0ac2af841e42 req-d0facf5b-081c-4daf-b9d5-6ec014eb7113 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:32.077286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-44bf05fc-3b2d-406e-9903-c4d051a27c47 req-20fcd838-c0ae-4462-8182-65eb7bf6ddaf service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:32.077790 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-44bf05fc-3b2d-406e-9903-c4d051a27c47 req-20fcd838-c0ae-4462-8182-65eb7bf6ddaf service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:32.078449 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-44bf05fc-3b2d-406e-9903-c4d051a27c47 req-20fcd838-c0ae-4462-8182-65eb7bf6ddaf service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:32.088693 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-767b3e2b-b822-4009-baa2-0ac2af841e42 req-d0facf5b-081c-4daf-b9d5-6ec014eb7113 service nova] Creating event network-vif-plugged:d34d92ed-1a8a-4623-be8e-630b78a99ac4 for instance 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a on n-h1-851359-3 Aug 04 17:08:32.096743 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-767b3e2b-b822-4009-baa2-0ac2af841e42 req-d0facf5b-081c-4daf-b9d5-6ec014eb7113 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075112 Aug 04 17:08:32.098176 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1702/3347] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:32.108024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f02d2932-f346-4f2f-86c2-8e1cc5f98fca tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:32.109644 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f02d2932-f346-4f2f-86c2-8e1cc5f98fca tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 2898397c-98e0-416d-b35d-18984c4730e2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:32.118873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f02d2932-f346-4f2f-86c2-8e1cc5f98fca tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:32.119756 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f02d2932-f346-4f2f-86c2-8e1cc5f98fca tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:32.119876 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-44bf05fc-3b2d-406e-9903-c4d051a27c47 req-20fcd838-c0ae-4462-8182-65eb7bf6ddaf service nova] Creating event network-changed:b59491de-0168-4cb2-aee2-eef9338c21f0 for instance 70c75b7c-2890-48a2-a7b2-7caf3125a492 on n-h2-851359-3 Aug 04 17:08:32.120586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f02d2932-f346-4f2f-86c2-8e1cc5f98fca tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:32.121522 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f02d2932-f346-4f2f-86c2-8e1cc5f98fca tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:32.122256 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f02d2932-f346-4f2f-86c2-8e1cc5f98fca tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:32.122907 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f02d2932-f346-4f2f-86c2-8e1cc5f98fca tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:32.140105 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-44bf05fc-3b2d-406e-9903-c4d051a27c47 req-20fcd838-c0ae-4462-8182-65eb7bf6ddaf service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112050 Aug 04 17:08:32.140744 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1646/3348] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:32.238666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f02d2932-f346-4f2f-86c2-8e1cc5f98fca tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:32.260314 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f02d2932-f346-4f2f-86c2-8e1cc5f98fca tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/2898397c-98e0-416d-b35d-18984c4730e2" status: 200 len: 1433 microversion: 2.1 time: 0.149486 Aug 04 17:08:32.262151 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1703/3349] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:32 2022] GET /compute/v2.1/servers/2898397c-98e0-416d-b35d-18984c4730e2 => generated 1433 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:32.278674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f3bc70be-01f4-4d10-8b3d-54e39519f99f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:32.279810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f3bc70be-01f4-4d10-8b3d-54e39519f99f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:32.292750 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3bc70be-01f4-4d10-8b3d-54e39519f99f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:32.293533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3bc70be-01f4-4d10-8b3d-54e39519f99f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:32.294245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3bc70be-01f4-4d10-8b3d-54e39519f99f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:32.295365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3bc70be-01f4-4d10-8b3d-54e39519f99f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:32.296067 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3bc70be-01f4-4d10-8b3d-54e39519f99f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:32.296728 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3bc70be-01f4-4d10-8b3d-54e39519f99f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:32.310185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-52099406-2084-47f1-b6e8-c15ec0bab4a3 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:32.310963 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-52099406-2084-47f1-b6e8-c15ec0bab4a3 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 70c75b7c-2890-48a2-a7b2-7caf3125a492] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:32.335291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:32.337043 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-52099406-2084-47f1-b6e8-c15ec0bab4a3 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:32.346530 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-52099406-2084-47f1-b6e8-c15ec0bab4a3 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:32.347521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-52099406-2084-47f1-b6e8-c15ec0bab4a3 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:32.349764 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-52099406-2084-47f1-b6e8-c15ec0bab4a3 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:32.350713 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-52099406-2084-47f1-b6e8-c15ec0bab4a3 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:32.351665 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-52099406-2084-47f1-b6e8-c15ec0bab4a3 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:32.353011 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=14 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:32.772976 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-52099406-2084-47f1-b6e8-c15ec0bab4a3 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:32.787699 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-52099406-2084-47f1-b6e8-c15ec0bab4a3 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492" status: 200 len: 1323 microversion: 2.1 time: 0.499743 Aug 04 17:08:32.791382 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1704/3350] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:32 2022] GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492 => generated 1323 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:32.838229 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f3bc70be-01f4-4d10-8b3d-54e39519f99f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:32.863060 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f3bc70be-01f4-4d10-8b3d-54e39519f99f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1505 microversion: 2.1 time: 0.607893 Aug 04 17:08:32.864773 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1647/3351] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:32 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1505 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:08:33.044704 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4cfd059b-d854-417a-bd7c-f68ab8d10807 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:33.045468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3d7ca988-8e2b-4472-a641-46eb9fc3dea2 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:33.046196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3d7ca988-8e2b-4472-a641-46eb9fc3dea2 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:33.047811 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4cfd059b-d854-417a-bd7c-f68ab8d10807 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:33.059577 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4cfd059b-d854-417a-bd7c-f68ab8d10807 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:33.060377 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4cfd059b-d854-417a-bd7c-f68ab8d10807 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:33.060846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d7ca988-8e2b-4472-a641-46eb9fc3dea2 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:33.061199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4cfd059b-d854-417a-bd7c-f68ab8d10807 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:33.062144 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4cfd059b-d854-417a-bd7c-f68ab8d10807 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:33.063032 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4cfd059b-d854-417a-bd7c-f68ab8d10807 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:33.063159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d7ca988-8e2b-4472-a641-46eb9fc3dea2 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:33.063539 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d7ca988-8e2b-4472-a641-46eb9fc3dea2 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:33.063926 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4cfd059b-d854-417a-bd7c-f68ab8d10807 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:33.064569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d7ca988-8e2b-4472-a641-46eb9fc3dea2 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:33.065087 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d7ca988-8e2b-4472-a641-46eb9fc3dea2 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:33.065551 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d7ca988-8e2b-4472-a641-46eb9fc3dea2 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:33.402779 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4cfd059b-d854-417a-bd7c-f68ab8d10807 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:33.413751 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4cfd059b-d854-417a-bd7c-f68ab8d10807 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:33.415334 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4cfd059b-d854-417a-bd7c-f68ab8d10807 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:33.427824 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4cfd059b-d854-417a-bd7c-f68ab8d10807 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36" status: 200 len: 1361 microversion: 2.26 time: 0.405906 Aug 04 17:08:33.428706 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1705/3352] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:08:33 2022] GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36 => generated 1361 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:08:33.444239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0f477ecf-dc11-4dac-b0b2-6a7700b43851 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:33.444875 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0f477ecf-dc11-4dac-b0b2-6a7700b43851 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 2898397c-98e0-416d-b35d-18984c4730e2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:33.464501 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3d7ca988-8e2b-4472-a641-46eb9fc3dea2 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:33.465330 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f477ecf-dc11-4dac-b0b2-6a7700b43851 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:33.465849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f477ecf-dc11-4dac-b0b2-6a7700b43851 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:33.466332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f477ecf-dc11-4dac-b0b2-6a7700b43851 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:33.467068 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f477ecf-dc11-4dac-b0b2-6a7700b43851 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:33.467686 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f477ecf-dc11-4dac-b0b2-6a7700b43851 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:33.468133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f477ecf-dc11-4dac-b0b2-6a7700b43851 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:33.477071 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3d7ca988-8e2b-4472-a641-46eb9fc3dea2 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1318 microversion: 2.1 time: 0.438776 Aug 04 17:08:33.478256 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1648/3353] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:33 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1318 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:33.499771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-f911704e-54eb-4dad-8114-ce2282e477e6 req-a94e28fc-8c94-485c-b0ef-ad273ce21b14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2898397c-98e0-416d-b35d-18984c4730e2", "name": "network-vif-deleted", "tag": "6402536c-3b47-40d1-9c06-8f761b813b94"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:33.525898 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f911704e-54eb-4dad-8114-ce2282e477e6 req-a94e28fc-8c94-485c-b0ef-ad273ce21b14 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:33.538092 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f911704e-54eb-4dad-8114-ce2282e477e6 req-a94e28fc-8c94-485c-b0ef-ad273ce21b14 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:33.538677 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f911704e-54eb-4dad-8114-ce2282e477e6 req-a94e28fc-8c94-485c-b0ef-ad273ce21b14 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:33.585097 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-f911704e-54eb-4dad-8114-ce2282e477e6 req-a94e28fc-8c94-485c-b0ef-ad273ce21b14 service nova] Creating event network-vif-deleted:6402536c-3b47-40d1-9c06-8f761b813b94 for instance 2898397c-98e0-416d-b35d-18984c4730e2 on n-h2-851359-3 Aug 04 17:08:33.605209 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-f911704e-54eb-4dad-8114-ce2282e477e6 req-a94e28fc-8c94-485c-b0ef-ad273ce21b14 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110193 Aug 04 17:08:33.620278 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1649/3354] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:08:33.633076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f477ecf-dc11-4dac-b0b2-6a7700b43851 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:33.633305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f477ecf-dc11-4dac-b0b2-6a7700b43851 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:33.633890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f477ecf-dc11-4dac-b0b2-6a7700b43851 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:33.634523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-0f477ecf-dc11-4dac-b0b2-6a7700b43851 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lazy-loading 'fault' on Instance uuid 2898397c-98e0-416d-b35d-18984c4730e2 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:08:33.694816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0f477ecf-dc11-4dac-b0b2-6a7700b43851 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:33.703440 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0f477ecf-dc11-4dac-b0b2-6a7700b43851 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/2898397c-98e0-416d-b35d-18984c4730e2" status: 200 len: 1309 microversion: 2.1 time: 0.273861 Aug 04 17:08:33.704415 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1706/3355] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:33 2022] GET /compute/v2.1/servers/2898397c-98e0-416d-b35d-18984c4730e2 => generated 1309 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:33.816152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1fe82261-3046-4fec-b69e-ef657e6a586b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:33.817453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1fe82261-3046-4fec-b69e-ef657e6a586b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 70c75b7c-2890-48a2-a7b2-7caf3125a492] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:33.832689 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1fe82261-3046-4fec-b69e-ef657e6a586b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:33.837165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1fe82261-3046-4fec-b69e-ef657e6a586b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:33.838394 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1fe82261-3046-4fec-b69e-ef657e6a586b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:33.840597 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1fe82261-3046-4fec-b69e-ef657e6a586b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:33.842544 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1fe82261-3046-4fec-b69e-ef657e6a586b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:33.843223 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1fe82261-3046-4fec-b69e-ef657e6a586b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:33.888796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-611b9dbb-478f-4327-a993-8e2c600baa07 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:33.889903 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-611b9dbb-478f-4327-a993-8e2c600baa07 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:33.900291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-611b9dbb-478f-4327-a993-8e2c600baa07 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:33.903349 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-611b9dbb-478f-4327-a993-8e2c600baa07 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:33.903945 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-611b9dbb-478f-4327-a993-8e2c600baa07 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:33.906237 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-611b9dbb-478f-4327-a993-8e2c600baa07 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:33.908731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-611b9dbb-478f-4327-a993-8e2c600baa07 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:33.910435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-611b9dbb-478f-4327-a993-8e2c600baa07 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:34.340471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1fe82261-3046-4fec-b69e-ef657e6a586b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:34.350305 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1fe82261-3046-4fec-b69e-ef657e6a586b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492" status: 200 len: 1323 microversion: 2.1 time: 0.541560 Aug 04 17:08:34.354378 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1650/3356] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:33 2022] GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492 => generated 1323 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:34.359100 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-611b9dbb-478f-4327-a993-8e2c600baa07 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:34.365099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-712f532f-1fef-480c-a1d3-96f7e8265a3e req-b503f0ac-2686-4d58-ab0a-89ba1645118a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33022d3d-bb86-401e-98c8-c6f04f3d8959", "name": "network-vif-plugged", "status": "completed", "tag": "e187bd1f-d4ce-4fa5-ba9e-cfd65b40a2c5"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:34.373389 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-611b9dbb-478f-4327-a993-8e2c600baa07 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1505 microversion: 2.1 time: 0.490042 Aug 04 17:08:34.374739 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1707/3357] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:33 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1505 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:34.379892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-970d560e-bd0f-4be3-bc17-7af6c7ac0113 req-1a877094-b74d-41c4-9fee-93b78a73b401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893dbe88-23f3-472b-a24f-67b4e8c18007", "name": "network-vif-deleted", "tag": "51b67061-276e-4d87-9e5b-0716997fda47"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:34.389902 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-712f532f-1fef-480c-a1d3-96f7e8265a3e req-b503f0ac-2686-4d58-ab0a-89ba1645118a service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:34.391922 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-970d560e-bd0f-4be3-bc17-7af6c7ac0113 req-1a877094-b74d-41c4-9fee-93b78a73b401 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:34.392619 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-970d560e-bd0f-4be3-bc17-7af6c7ac0113 req-1a877094-b74d-41c4-9fee-93b78a73b401 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:34.393235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-970d560e-bd0f-4be3-bc17-7af6c7ac0113 req-1a877094-b74d-41c4-9fee-93b78a73b401 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:34.394522 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-712f532f-1fef-480c-a1d3-96f7e8265a3e req-b503f0ac-2686-4d58-ab0a-89ba1645118a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:34.395243 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-712f532f-1fef-480c-a1d3-96f7e8265a3e req-b503f0ac-2686-4d58-ab0a-89ba1645118a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:34.408098 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-970d560e-bd0f-4be3-bc17-7af6c7ac0113 req-1a877094-b74d-41c4-9fee-93b78a73b401 service nova] Creating event network-vif-deleted:51b67061-276e-4d87-9e5b-0716997fda47 for instance 893dbe88-23f3-472b-a24f-67b4e8c18007 on n-h2-851359-3 Aug 04 17:08:34.412993 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-712f532f-1fef-480c-a1d3-96f7e8265a3e req-b503f0ac-2686-4d58-ab0a-89ba1645118a service nova] Creating event network-vif-plugged:e187bd1f-d4ce-4fa5-ba9e-cfd65b40a2c5 for instance 33022d3d-bb86-401e-98c8-c6f04f3d8959 on n-h1-851359-3 Aug 04 17:08:34.413796 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-970d560e-bd0f-4be3-bc17-7af6c7ac0113 req-1a877094-b74d-41c4-9fee-93b78a73b401 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037313 Aug 04 17:08:34.418339 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1708/3358] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:34.420073 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-712f532f-1fef-480c-a1d3-96f7e8265a3e req-b503f0ac-2686-4d58-ab0a-89ba1645118a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063841 Aug 04 17:08:34.420896 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1651/3359] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:34.457181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bca199e1-735c-4f03-9aa9-968f90a88652 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:34.458300 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bca199e1-735c-4f03-9aa9-968f90a88652 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:34.466238 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bca199e1-735c-4f03-9aa9-968f90a88652 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:34.467250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bca199e1-735c-4f03-9aa9-968f90a88652 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:34.468379 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bca199e1-735c-4f03-9aa9-968f90a88652 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:34.470143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bca199e1-735c-4f03-9aa9-968f90a88652 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:34.470910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bca199e1-735c-4f03-9aa9-968f90a88652 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:34.472630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bca199e1-735c-4f03-9aa9-968f90a88652 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:34.505875 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fd01fb03-4bbb-491e-812d-811778015963 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:34.520212 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fd01fb03-4bbb-491e-812d-811778015963 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:34.546299 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd01fb03-4bbb-491e-812d-811778015963 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:34.561778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd01fb03-4bbb-491e-812d-811778015963 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:34.563607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd01fb03-4bbb-491e-812d-811778015963 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:34.580021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd01fb03-4bbb-491e-812d-811778015963 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:34.582327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd01fb03-4bbb-491e-812d-811778015963 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:34.584864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd01fb03-4bbb-491e-812d-811778015963 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:34.793630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bca199e1-735c-4f03-9aa9-968f90a88652 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:34.803004 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bca199e1-735c-4f03-9aa9-968f90a88652 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:34.805654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bca199e1-735c-4f03-9aa9-968f90a88652 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:34.805792 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bca199e1-735c-4f03-9aa9-968f90a88652 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36" status: 200 len: 1361 microversion: 2.26 time: 0.353351 Aug 04 17:08:34.825422 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1709/3360] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:08:34 2022] GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36 => generated 1361 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:08:34.831715 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f6fa6c08-16ef-4d8a-aca5-df622ebec370 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:34.832180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f6fa6c08-16ef-4d8a-aca5-df622ebec370 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 2898397c-98e0-416d-b35d-18984c4730e2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:34.851400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f6fa6c08-16ef-4d8a-aca5-df622ebec370 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:34.852017 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f6fa6c08-16ef-4d8a-aca5-df622ebec370 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:34.852475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f6fa6c08-16ef-4d8a-aca5-df622ebec370 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:34.853225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f6fa6c08-16ef-4d8a-aca5-df622ebec370 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:34.854351 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f6fa6c08-16ef-4d8a-aca5-df622ebec370 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:34.854796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f6fa6c08-16ef-4d8a-aca5-df622ebec370 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:34.872450 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fd01fb03-4bbb-491e-812d-811778015963 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:34.882470 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fd01fb03-4bbb-491e-812d-811778015963 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1318 microversion: 2.1 time: 0.381495 Aug 04 17:08:34.906030 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1652/3361] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:34 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:08:34.926636 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f6fa6c08-16ef-4d8a-aca5-df622ebec370 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:34.927267 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f6fa6c08-16ef-4d8a-aca5-df622ebec370 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:34.927716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f6fa6c08-16ef-4d8a-aca5-df622ebec370 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:34.928512 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-f6fa6c08-16ef-4d8a-aca5-df622ebec370 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lazy-loading 'fault' on Instance uuid 2898397c-98e0-416d-b35d-18984c4730e2 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:08:34.979150 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f6fa6c08-16ef-4d8a-aca5-df622ebec370 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:34.993415 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f6fa6c08-16ef-4d8a-aca5-df622ebec370 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/2898397c-98e0-416d-b35d-18984c4730e2" status: 200 len: 1309 microversion: 2.1 time: 0.165194 Aug 04 17:08:34.996318 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1710/3362] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:34 2022] GET /compute/v2.1/servers/2898397c-98e0-416d-b35d-18984c4730e2 => generated 1309 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:35.376174 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a212ae6f-8b81-4e68-8442-87a5f977837d tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:35.385052 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a212ae6f-8b81-4e68-8442-87a5f977837d tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 70c75b7c-2890-48a2-a7b2-7caf3125a492] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:35.402973 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e8dc623d-eda4-49db-9b90-8bc319ac62d9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:35.403621 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e8dc623d-eda4-49db-9b90-8bc319ac62d9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:35.420508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a212ae6f-8b81-4e68-8442-87a5f977837d tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:35.420689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8dc623d-eda4-49db-9b90-8bc319ac62d9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:35.421204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8dc623d-eda4-49db-9b90-8bc319ac62d9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:35.422072 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a212ae6f-8b81-4e68-8442-87a5f977837d tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:35.425546 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8dc623d-eda4-49db-9b90-8bc319ac62d9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:35.426704 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8dc623d-eda4-49db-9b90-8bc319ac62d9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:35.427208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8dc623d-eda4-49db-9b90-8bc319ac62d9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:35.429929 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8dc623d-eda4-49db-9b90-8bc319ac62d9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:35.452614 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a212ae6f-8b81-4e68-8442-87a5f977837d tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:35.456379 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a212ae6f-8b81-4e68-8442-87a5f977837d tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:35.459051 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a212ae6f-8b81-4e68-8442-87a5f977837d tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:35.462512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a212ae6f-8b81-4e68-8442-87a5f977837d tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:36.018874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e8dc623d-eda4-49db-9b90-8bc319ac62d9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:36.030561 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e8dc623d-eda4-49db-9b90-8bc319ac62d9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1505 microversion: 2.1 time: 0.636260 Aug 04 17:08:36.031880 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1711/3363] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:35 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1505 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:36.037624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-cec822fc-020d-40df-a40f-cd30b6f23be1 req-c06b5a03-27cd-4ad8-acc0-eecac7fb3aba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "876d789c-ca99-4545-aab6-371278764e36", "tag": "60029b7a-10b9-4bcf-9309-fc524eb04b5e"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:36.050794 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:36.053548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-cec822fc-020d-40df-a40f-cd30b6f23be1 req-c06b5a03-27cd-4ad8-acc0-eecac7fb3aba service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:36.054301 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-cec822fc-020d-40df-a40f-cd30b6f23be1 req-c06b5a03-27cd-4ad8-acc0-eecac7fb3aba service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:36.055042 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-cec822fc-020d-40df-a40f-cd30b6f23be1 req-c06b5a03-27cd-4ad8-acc0-eecac7fb3aba service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:36.079906 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-cec822fc-020d-40df-a40f-cd30b6f23be1 req-c06b5a03-27cd-4ad8-acc0-eecac7fb3aba service nova] Creating event network-changed:60029b7a-10b9-4bcf-9309-fc524eb04b5e for instance 876d789c-ca99-4545-aab6-371278764e36 on n-h1-851359-3 Aug 04 17:08:36.086966 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-cec822fc-020d-40df-a40f-cd30b6f23be1 req-c06b5a03-27cd-4ad8-acc0-eecac7fb3aba service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053553 Aug 04 17:08:36.087981 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1712/3364] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:36.098340 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a212ae6f-8b81-4e68-8442-87a5f977837d tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:36.111809 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9994a0a3-4192-4f6f-a3bc-a563d93814af tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:36.114265 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a212ae6f-8b81-4e68-8442-87a5f977837d tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492" status: 200 len: 1323 microversion: 2.1 time: 0.741552 Aug 04 17:08:36.115417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9994a0a3-4192-4f6f-a3bc-a563d93814af tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:36.117127 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1653/3365] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:35 2022] GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492 => generated 1323 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:36.129772 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9994a0a3-4192-4f6f-a3bc-a563d93814af tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:36.130306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5f429c5a-4ff1-41aa-9473-fe69cd1da16c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:36.131473 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5f429c5a-4ff1-41aa-9473-fe69cd1da16c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:36.132185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9994a0a3-4192-4f6f-a3bc-a563d93814af tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:36.134266 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9994a0a3-4192-4f6f-a3bc-a563d93814af tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:36.136655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9994a0a3-4192-4f6f-a3bc-a563d93814af tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:36.138583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9994a0a3-4192-4f6f-a3bc-a563d93814af tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:36.139104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9994a0a3-4192-4f6f-a3bc-a563d93814af tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:36.147323 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f429c5a-4ff1-41aa-9473-fe69cd1da16c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:36.150746 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f429c5a-4ff1-41aa-9473-fe69cd1da16c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:36.151430 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f429c5a-4ff1-41aa-9473-fe69cd1da16c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:36.156923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f429c5a-4ff1-41aa-9473-fe69cd1da16c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:36.157681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f429c5a-4ff1-41aa-9473-fe69cd1da16c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:36.158392 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f429c5a-4ff1-41aa-9473-fe69cd1da16c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:36.631802 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5f429c5a-4ff1-41aa-9473-fe69cd1da16c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:36.640880 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5f429c5a-4ff1-41aa-9473-fe69cd1da16c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1318 microversion: 2.1 time: 0.522427 Aug 04 17:08:36.642121 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1654/3366] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:36 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1318 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:36.657018 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ba734324-1051-495c-9fe0-835572b23935 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:36.657946 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ba734324-1051-495c-9fe0-835572b23935 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 2898397c-98e0-416d-b35d-18984c4730e2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:36.668966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9994a0a3-4192-4f6f-a3bc-a563d93814af tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:36.671161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba734324-1051-495c-9fe0-835572b23935 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:36.672002 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba734324-1051-495c-9fe0-835572b23935 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:36.672609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba734324-1051-495c-9fe0-835572b23935 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:36.674894 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba734324-1051-495c-9fe0-835572b23935 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:36.675607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba734324-1051-495c-9fe0-835572b23935 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:36.676218 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba734324-1051-495c-9fe0-835572b23935 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:36.680400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9994a0a3-4192-4f6f-a3bc-a563d93814af tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:36.682001 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9994a0a3-4192-4f6f-a3bc-a563d93814af tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:36.685575 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9994a0a3-4192-4f6f-a3bc-a563d93814af tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36" status: 200 len: 1361 microversion: 2.26 time: 0.595918 Aug 04 17:08:36.689048 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1713/3367] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:08:36 2022] GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36 => generated 1361 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:08:36.701856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-048e6543-c59c-42b6-89c7-becf673f0af6 req-dd353597-ec45-4543-805d-9f47946adfc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ad185e4-a5ae-4222-b0d7-9c29ee8a9061", "name": "network-vif-plugged", "status": "completed", "tag": "f7b26e84-5e02-418a-9944-239997927fe9"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:36.703490 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-ba734324-1051-495c-9fe0-835572b23935 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] HTTP exception thrown: Instance 2898397c-98e0-416d-b35d-18984c4730e2 could not be found. Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ba734324-1051-495c-9fe0-835572b23935 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Request method failure captured: Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/2898397c-98e0-416d-b35d-18984c4730e2 HTTP/1.1 Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_w0jZeUsbjEc5kYg27hf-dMmPEmOS8mz9zj3LiyLgIwLfZP9355AOtAolQUi0IfSyHmBTm0ZLYpzXBPR2sg5A16dXtRgSW2ZOMGwE8_C42ShFtz9WjdriiJ5vR6sp-55xsNqL34nsOcOKnlgDPAz7cPTUNxqkeWCJfWyd01S-wbqeI Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: de328615cef94528b55b8309dd9b82b0 Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersOnMultiNodesTest-1487912368 Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/de328615cef94528b55b8309dd9b82b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/de328615cef94528b55b8309dd9b82b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_de328615cef94528b55b8309dd9b82b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/de328615cef94528b55b8309dd9b82b0"}]}] Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersOnMultiNodesTest-1487912368 Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: de328615cef94528b55b8309dd9b82b0 Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1487912368 Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersOnMultiNodesTest-1487912368-project Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: abad886e45bd4c4b8f5f0f86c45eb068 Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersOnMultiNodesTest-1487912368-project Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 2898397c-98e0-416d-b35d-18984c4730e2 could not be found. Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '2898397c-98e0-416d-b35d-18984c4730e2'} Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2898397c-98e0-416d-b35d-18984c4730e2 could not be found. Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2898397c-98e0-416d-b35d-18984c4730e2 could not be found. Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:08:36.706903 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:08:36.711505 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:36.711505 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:08:36.711505 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:08:36.711505 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:08:36.711505 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:08:36.711505 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2898397c-98e0-416d-b35d-18984c4730e2 could not be found. Aug 04 17:08:36.711505 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:08:36.721742 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ba734324-1051-495c-9fe0-835572b23935 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Returning 404 to user: Instance 2898397c-98e0-416d-b35d-18984c4730e2 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:08:36.723040 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ba734324-1051-495c-9fe0-835572b23935 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/2898397c-98e0-416d-b35d-18984c4730e2" status: 404 len: 111 microversion: 2.1 time: 0.079793 Aug 04 17:08:36.724386 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1655/3368] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:36 2022] GET /compute/v2.1/servers/2898397c-98e0-416d-b35d-18984c4730e2 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:08:36.735591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-048e6543-c59c-42b6-89c7-becf673f0af6 req-dd353597-ec45-4543-805d-9f47946adfc3 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:36.736330 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-048e6543-c59c-42b6-89c7-becf673f0af6 req-dd353597-ec45-4543-805d-9f47946adfc3 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:36.737018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-048e6543-c59c-42b6-89c7-becf673f0af6 req-dd353597-ec45-4543-805d-9f47946adfc3 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:36.742899 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e73b7a9e-8f14-40b9-b66b-c56bbff9fb88 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:36.745138 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e73b7a9e-8f14-40b9-b66b-c56bbff9fb88 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 893dbe88-23f3-472b-a24f-67b4e8c18007] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:36.749333 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-048e6543-c59c-42b6-89c7-becf673f0af6 req-dd353597-ec45-4543-805d-9f47946adfc3 service nova] Creating event network-vif-plugged:f7b26e84-5e02-418a-9944-239997927fe9 for instance 5ad185e4-a5ae-4222-b0d7-9c29ee8a9061 on n-h1-851359-3 Aug 04 17:08:36.757814 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-048e6543-c59c-42b6-89c7-becf673f0af6 req-dd353597-ec45-4543-805d-9f47946adfc3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064839 Aug 04 17:08:36.772565 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1714/3369] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:36.786453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e73b7a9e-8f14-40b9-b66b-c56bbff9fb88 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:36.786953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e73b7a9e-8f14-40b9-b66b-c56bbff9fb88 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:36.787393 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e73b7a9e-8f14-40b9-b66b-c56bbff9fb88 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:36.788099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e73b7a9e-8f14-40b9-b66b-c56bbff9fb88 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:36.788555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e73b7a9e-8f14-40b9-b66b-c56bbff9fb88 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:36.788985 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e73b7a9e-8f14-40b9-b66b-c56bbff9fb88 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:36.880360 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-e73b7a9e-8f14-40b9-b66b-c56bbff9fb88 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] HTTP exception thrown: Instance 893dbe88-23f3-472b-a24f-67b4e8c18007 could not be found. Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e73b7a9e-8f14-40b9-b66b-c56bbff9fb88 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Request method failure captured: Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/893dbe88-23f3-472b-a24f-67b4e8c18007 HTTP/1.1 Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_w0jZeUsbjEc5kYg27hf-dMmPEmOS8mz9zj3LiyLgIwLfZP9355AOtAolQUi0IfSyHmBTm0ZLYpzXBPR2sg5A16dXtRgSW2ZOMGwE8_C42ShFtz9WjdriiJ5vR6sp-55xsNqL34nsOcOKnlgDPAz7cPTUNxqkeWCJfWyd01S-wbqeI Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: de328615cef94528b55b8309dd9b82b0 Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersOnMultiNodesTest-1487912368 Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/de328615cef94528b55b8309dd9b82b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/de328615cef94528b55b8309dd9b82b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_de328615cef94528b55b8309dd9b82b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/de328615cef94528b55b8309dd9b82b0"}]}] Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersOnMultiNodesTest-1487912368 Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: de328615cef94528b55b8309dd9b82b0 Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1487912368 Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersOnMultiNodesTest-1487912368-project Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: abad886e45bd4c4b8f5f0f86c45eb068 Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersOnMultiNodesTest-1487912368-project Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 893dbe88-23f3-472b-a24f-67b4e8c18007 could not be found. Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '893dbe88-23f3-472b-a24f-67b4e8c18007'} Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 893dbe88-23f3-472b-a24f-67b4e8c18007 could not be found. Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 893dbe88-23f3-472b-a24f-67b4e8c18007 could not be found. Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:08:36.883437 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:08:36.888166 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:36.888166 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:08:36.888166 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:08:36.888166 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:08:36.888166 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:08:36.888166 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 893dbe88-23f3-472b-a24f-67b4e8c18007 could not be found. Aug 04 17:08:36.888166 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:08:36.891348 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e73b7a9e-8f14-40b9-b66b-c56bbff9fb88 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Returning 404 to user: Instance 893dbe88-23f3-472b-a24f-67b4e8c18007 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:08:36.893465 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e73b7a9e-8f14-40b9-b66b-c56bbff9fb88 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/893dbe88-23f3-472b-a24f-67b4e8c18007" status: 404 len: 111 microversion: 2.1 time: 0.161697 Aug 04 17:08:36.894105 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1656/3370] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:36 2022] GET /compute/v2.1/servers/893dbe88-23f3-472b-a24f-67b4e8c18007 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:08:36.903833 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a24fe9e8-9f3c-45b4-9f5d-98cda4221dbb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:37.021538 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a24fe9e8-9f3c-45b4-9f5d-98cda4221dbb tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/2e210599-cdc6-4676-8885-f80832369267" status: 204 len: 0 microversion: 2.1 time: 0.121549 Aug 04 17:08:37.042639 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1715/3371] 10.222.0.93 () {58 vars in 1266 bytes} [Thu Aug 4 17:08:36 2022] DELETE /compute/v2.1/os-server-groups/2e210599-cdc6-4676-8885-f80832369267 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:08:37.049915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-74e51543-9878-47af-a45b-33da2e8bd1e1 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:37.049915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-74e51543-9878-47af-a45b-33da2e8bd1e1 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 42dff36d-2301-4c8c-b3a5-1dd535cf9664] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:37.057440 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2b0e6121-5014-45c8-8d85-a1015b9d4d51 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:37.058228 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2b0e6121-5014-45c8-8d85-a1015b9d4d51 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:37.069509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b0e6121-5014-45c8-8d85-a1015b9d4d51 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:37.070034 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b0e6121-5014-45c8-8d85-a1015b9d4d51 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:37.070347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74e51543-9878-47af-a45b-33da2e8bd1e1 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:37.070478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b0e6121-5014-45c8-8d85-a1015b9d4d51 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:37.070853 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74e51543-9878-47af-a45b-33da2e8bd1e1 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:37.071185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b0e6121-5014-45c8-8d85-a1015b9d4d51 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:37.071838 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74e51543-9878-47af-a45b-33da2e8bd1e1 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:37.073129 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74e51543-9878-47af-a45b-33da2e8bd1e1 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:37.073800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74e51543-9878-47af-a45b-33da2e8bd1e1 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:37.074449 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74e51543-9878-47af-a45b-33da2e8bd1e1 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:37.078201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b0e6121-5014-45c8-8d85-a1015b9d4d51 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:37.078747 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b0e6121-5014-45c8-8d85-a1015b9d4d51 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:37.114607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-74e51543-9878-47af-a45b-33da2e8bd1e1 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 42dff36d-2301-4c8c-b3a5-1dd535cf9664] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:08:37.296358 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-74e51543-9878-47af-a45b-33da2e8bd1e1 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "DELETE /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664" status: 204 len: 0 microversion: 2.1 time: 0.259306 Aug 04 17:08:37.302602 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1657/3372] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:08:37 2022] DELETE /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 17:08:37.309878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-64e4ac60-ca70-4045-9527-13a65761df8b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:37.311102 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-64e4ac60-ca70-4045-9527-13a65761df8b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 70c75b7c-2890-48a2-a7b2-7caf3125a492] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:37.319373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64e4ac60-ca70-4045-9527-13a65761df8b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:37.320238 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64e4ac60-ca70-4045-9527-13a65761df8b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:37.321084 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64e4ac60-ca70-4045-9527-13a65761df8b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:37.322090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64e4ac60-ca70-4045-9527-13a65761df8b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:37.324487 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64e4ac60-ca70-4045-9527-13a65761df8b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:37.325194 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64e4ac60-ca70-4045-9527-13a65761df8b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:37.432620 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2b0e6121-5014-45c8-8d85-a1015b9d4d51 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:37.441732 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2b0e6121-5014-45c8-8d85-a1015b9d4d51 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1505 microversion: 2.1 time: 0.388727 Aug 04 17:08:37.458010 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1716/3373] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:37 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1505 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:37.463270 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-90fcfea7-004f-484c-a1ab-8e07df2acf69 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:37.463270 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-90fcfea7-004f-484c-a1ab-8e07df2acf69 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 42dff36d-2301-4c8c-b3a5-1dd535cf9664] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:37.480453 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90fcfea7-004f-484c-a1ab-8e07df2acf69 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:37.480906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90fcfea7-004f-484c-a1ab-8e07df2acf69 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:37.481365 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90fcfea7-004f-484c-a1ab-8e07df2acf69 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:37.482133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90fcfea7-004f-484c-a1ab-8e07df2acf69 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:37.482694 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90fcfea7-004f-484c-a1ab-8e07df2acf69 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:37.488008 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90fcfea7-004f-484c-a1ab-8e07df2acf69 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:37.751656 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-90fcfea7-004f-484c-a1ab-8e07df2acf69 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:37.763338 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-90fcfea7-004f-484c-a1ab-8e07df2acf69 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664" status: 200 len: 1472 microversion: 2.1 time: 0.310763 Aug 04 17:08:37.763962 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1717/3374] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:37 2022] GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664 => generated 1472 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:37.780143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9a283390-0b84-4fae-b9f3-81ba28a037db tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:37.783180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9a283390-0b84-4fae-b9f3-81ba28a037db tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:37.788729 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-64e4ac60-ca70-4045-9527-13a65761df8b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:37.794925 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9a283390-0b84-4fae-b9f3-81ba28a037db tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:37.795438 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9a283390-0b84-4fae-b9f3-81ba28a037db tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:37.795891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9a283390-0b84-4fae-b9f3-81ba28a037db tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:37.796617 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9a283390-0b84-4fae-b9f3-81ba28a037db tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:37.797084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9a283390-0b84-4fae-b9f3-81ba28a037db tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:37.797521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9a283390-0b84-4fae-b9f3-81ba28a037db tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:37.799907 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-64e4ac60-ca70-4045-9527-13a65761df8b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492" status: 200 len: 1323 microversion: 2.1 time: 0.494877 Aug 04 17:08:37.801250 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1658/3375] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:37 2022] GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492 => generated 1323 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:37.806259 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ffcfa91c-391e-4620-9d04-50566ca77664 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:37.807140 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ffcfa91c-391e-4620-9d04-50566ca77664 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:37.814241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffcfa91c-391e-4620-9d04-50566ca77664 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:37.814944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffcfa91c-391e-4620-9d04-50566ca77664 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:37.815575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffcfa91c-391e-4620-9d04-50566ca77664 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:37.816480 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffcfa91c-391e-4620-9d04-50566ca77664 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:37.817095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffcfa91c-391e-4620-9d04-50566ca77664 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:37.817675 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffcfa91c-391e-4620-9d04-50566ca77664 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:38.102797 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ffcfa91c-391e-4620-9d04-50566ca77664 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:38.110541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:38.121437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ffcfa91c-391e-4620-9d04-50566ca77664 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:38.123955 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ffcfa91c-391e-4620-9d04-50566ca77664 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:38.129073 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ffcfa91c-391e-4620-9d04-50566ca77664 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36" status: 200 len: 1361 microversion: 2.26 time: 0.326512 Aug 04 17:08:38.152445 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1659/3376] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:08:37 2022] GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36 => generated 1361 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:08:38.185856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9a283390-0b84-4fae-b9f3-81ba28a037db tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:38.198828 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9a283390-0b84-4fae-b9f3-81ba28a037db tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1318 microversion: 2.1 time: 0.431667 Aug 04 17:08:38.199949 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1718/3377] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:37 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1318 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:38.472200 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b9477d08-446c-4983-8fe8-973675a4ef1f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:38.473522 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b9477d08-446c-4983-8fe8-973675a4ef1f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:38.482493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9477d08-446c-4983-8fe8-973675a4ef1f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:38.483343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9477d08-446c-4983-8fe8-973675a4ef1f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:38.483960 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9477d08-446c-4983-8fe8-973675a4ef1f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:38.485626 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9477d08-446c-4983-8fe8-973675a4ef1f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:38.486273 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9477d08-446c-4983-8fe8-973675a4ef1f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:38.486867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9477d08-446c-4983-8fe8-973675a4ef1f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:38.565951 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4e30751a-c6be-4da5-905c-431368efebb8 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1536319440", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "d03948e3-4d26-4c41-a7bf-91ef982e4d85"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:38.662214 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-4e30751a-c6be-4da5-905c-431368efebb8 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] validate_networks() for [('d03948e3-4d26-4c41-a7bf-91ef982e4d85', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:08:38.714148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b9477d08-446c-4983-8fe8-973675a4ef1f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:38.724620 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b9477d08-446c-4983-8fe8-973675a4ef1f tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1505 microversion: 2.1 time: 0.257331 Aug 04 17:08:38.725220 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1719/3378] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:38 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1505 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:08:38.788804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-79021320-7128-47b2-88c3-f4f9cdf21f7e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:38.789589 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-79021320-7128-47b2-88c3-f4f9cdf21f7e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 42dff36d-2301-4c8c-b3a5-1dd535cf9664] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:38.798263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79021320-7128-47b2-88c3-f4f9cdf21f7e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:38.799496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79021320-7128-47b2-88c3-f4f9cdf21f7e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:38.802251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79021320-7128-47b2-88c3-f4f9cdf21f7e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:38.803083 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79021320-7128-47b2-88c3-f4f9cdf21f7e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:38.803641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79021320-7128-47b2-88c3-f4f9cdf21f7e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:38.804175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79021320-7128-47b2-88c3-f4f9cdf21f7e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:39.090903 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-79021320-7128-47b2-88c3-f4f9cdf21f7e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:39.097495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:39.103448 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-79021320-7128-47b2-88c3-f4f9cdf21f7e tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664" status: 200 len: 1472 microversion: 2.1 time: 0.315648 Aug 04 17:08:39.104705 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1720/3379] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:38 2022] GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664 => generated 1472 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:08:39.129652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-02bc99be-5e7f-4f7f-a887-843da2a02831 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:39.135394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-02bc99be-5e7f-4f7f-a887-843da2a02831 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 70c75b7c-2890-48a2-a7b2-7caf3125a492] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:39.151061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02bc99be-5e7f-4f7f-a887-843da2a02831 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:39.154551 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02bc99be-5e7f-4f7f-a887-843da2a02831 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:39.155146 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02bc99be-5e7f-4f7f-a887-843da2a02831 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:39.156007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02bc99be-5e7f-4f7f-a887-843da2a02831 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:39.157248 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02bc99be-5e7f-4f7f-a887-843da2a02831 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:39.158625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02bc99be-5e7f-4f7f-a887-843da2a02831 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:39.413304 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-02bc99be-5e7f-4f7f-a887-843da2a02831 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:39.414430 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-4e30751a-c6be-4da5-905c-431368efebb8 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:08:39.414937 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-4e30751a-c6be-4da5-905c-431368efebb8 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:08:39.415512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-4e30751a-c6be-4da5-905c-431368efebb8 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:08:39.416614 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-4e30751a-c6be-4da5-905c-431368efebb8 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:08:39.417032 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-4e30751a-c6be-4da5-905c-431368efebb8 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:08:39.435116 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-02bc99be-5e7f-4f7f-a887-843da2a02831 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492" status: 200 len: 1323 microversion: 2.1 time: 0.327990 Aug 04 17:08:39.435744 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1721/3380] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:39 2022] GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492 => generated 1323 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:39.441117 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-df749930-4f8b-4447-b49b-dea90be6d73b tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:39.443050 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e30751a-c6be-4da5-905c-431368efebb8 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:39.443703 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e30751a-c6be-4da5-905c-431368efebb8 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:39.443816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-df749930-4f8b-4447-b49b-dea90be6d73b tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:39.444377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e30751a-c6be-4da5-905c-431368efebb8 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:39.445122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e30751a-c6be-4da5-905c-431368efebb8 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:39.445645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e30751a-c6be-4da5-905c-431368efebb8 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:39.446100 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e30751a-c6be-4da5-905c-431368efebb8 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:39.457852 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df749930-4f8b-4447-b49b-dea90be6d73b tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:39.458743 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df749930-4f8b-4447-b49b-dea90be6d73b tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:39.459372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df749930-4f8b-4447-b49b-dea90be6d73b tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:39.460263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df749930-4f8b-4447-b49b-dea90be6d73b tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:39.468139 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-4e30751a-c6be-4da5-905c-431368efebb8 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Getting quotas for project 2b3847ca33d14d96b7df887796cf7f7a. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:08:39.471133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df749930-4f8b-4447-b49b-dea90be6d73b tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:39.471600 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df749930-4f8b-4447-b49b-dea90be6d73b tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:39.477741 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-4e30751a-c6be-4da5-905c-431368efebb8 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Getting quotas for user 4ae7d4debce6463999584b08b482d05e and project 2b3847ca33d14d96b7df887796cf7f7a. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:08:39.495356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4e30751a-c6be-4da5-905c-431368efebb8 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:08:39.497985 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4e30751a-c6be-4da5-905c-431368efebb8 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] [instance: 92a10759-f1cf-452a-9e3e-b2d99944dee4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:08:39.555863 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4e30751a-c6be-4da5-905c-431368efebb8 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.175571 Aug 04 17:08:39.557767 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1660/3381] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:08:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 17:08:39.562491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-03cd2a25-7f82-4e1d-b0d8-6cbdfe62ee82 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:39.563690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-03cd2a25-7f82-4e1d-b0d8-6cbdfe62ee82 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:39.571094 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:39.571341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03cd2a25-7f82-4e1d-b0d8-6cbdfe62ee82 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:39.571904 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03cd2a25-7f82-4e1d-b0d8-6cbdfe62ee82 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:39.572800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03cd2a25-7f82-4e1d-b0d8-6cbdfe62ee82 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:39.573341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03cd2a25-7f82-4e1d-b0d8-6cbdfe62ee82 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:39.573949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03cd2a25-7f82-4e1d-b0d8-6cbdfe62ee82 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:39.574465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03cd2a25-7f82-4e1d-b0d8-6cbdfe62ee82 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:39.741196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-df749930-4f8b-4447-b49b-dea90be6d73b tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:39.750384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-df749930-4f8b-4447-b49b-dea90be6d73b tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:39.768577 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-df749930-4f8b-4447-b49b-dea90be6d73b tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:39.769782 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-df749930-4f8b-4447-b49b-dea90be6d73b tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36" status: 200 len: 1361 microversion: 2.26 time: 0.332683 Aug 04 17:08:39.770698 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1722/3382] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:08:39 2022] GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36 => generated 1361 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:08:39.777550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d69ba0be-ddc6-44e1-b1ff-763f1721ffe1 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:39.780438 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d69ba0be-ddc6-44e1-b1ff-763f1721ffe1 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] [instance: 92a10759-f1cf-452a-9e3e-b2d99944dee4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:39.897698 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d69ba0be-ddc6-44e1-b1ff-763f1721ffe1 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae7d4debce6463999584b08b482d05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3847ca33d14d96b7df887796cf7f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:39.909904 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d69ba0be-ddc6-44e1-b1ff-763f1721ffe1 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] 10.222.0.93 "GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4" status: 200 len: 1216 microversion: 2.1 time: 0.137339 Aug 04 17:08:39.911305 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1723/3383] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:39 2022] GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4 => generated 1216 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:39.924812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-03cd2a25-7f82-4e1d-b0d8-6cbdfe62ee82 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:39.929056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-37d7a009-fddd-479a-8259-a87eeb88d743 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:39.933781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-37d7a009-fddd-479a-8259-a87eeb88d743 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:39.934683 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-03cd2a25-7f82-4e1d-b0d8-6cbdfe62ee82 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1318 microversion: 2.1 time: 0.375825 Aug 04 17:08:39.938688 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1661/3384] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:39 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:39.949244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-e131e147-a564-416d-84fb-931daba2e4ab req-48b4f8db-9910-4583-a222-5d4f7cf6a3fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c75b7c-2890-48a2-a7b2-7caf3125a492", "name": "network-vif-plugged", "status": "completed", "tag": "b59491de-0168-4cb2-aee2-eef9338c21f0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:39.964224 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37d7a009-fddd-479a-8259-a87eeb88d743 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:39.964472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e131e147-a564-416d-84fb-931daba2e4ab req-48b4f8db-9910-4583-a222-5d4f7cf6a3fb service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:39.964970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e131e147-a564-416d-84fb-931daba2e4ab req-48b4f8db-9910-4583-a222-5d4f7cf6a3fb service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:39.965407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e131e147-a564-416d-84fb-931daba2e4ab req-48b4f8db-9910-4583-a222-5d4f7cf6a3fb service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:39.965612 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37d7a009-fddd-479a-8259-a87eeb88d743 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:39.970557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37d7a009-fddd-479a-8259-a87eeb88d743 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:39.971434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37d7a009-fddd-479a-8259-a87eeb88d743 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:39.971988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37d7a009-fddd-479a-8259-a87eeb88d743 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:39.972500 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37d7a009-fddd-479a-8259-a87eeb88d743 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:39.983838 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-e131e147-a564-416d-84fb-931daba2e4ab req-48b4f8db-9910-4583-a222-5d4f7cf6a3fb service nova] Creating event network-vif-plugged:b59491de-0168-4cb2-aee2-eef9338c21f0 for instance 70c75b7c-2890-48a2-a7b2-7caf3125a492 on n-h2-851359-3 Aug 04 17:08:40.001743 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-e131e147-a564-416d-84fb-931daba2e4ab req-48b4f8db-9910-4583-a222-5d4f7cf6a3fb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061123 Aug 04 17:08:40.003280 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1662/3385] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:40.126362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6bcb9e54-3066-455a-b4de-1241d81c22a5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:40.127400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6bcb9e54-3066-455a-b4de-1241d81c22a5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 42dff36d-2301-4c8c-b3a5-1dd535cf9664] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:40.175755 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6bcb9e54-3066-455a-b4de-1241d81c22a5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:40.178398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6bcb9e54-3066-455a-b4de-1241d81c22a5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:40.179175 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6bcb9e54-3066-455a-b4de-1241d81c22a5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:40.207187 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6bcb9e54-3066-455a-b4de-1241d81c22a5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:40.211839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6bcb9e54-3066-455a-b4de-1241d81c22a5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:40.216992 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6bcb9e54-3066-455a-b4de-1241d81c22a5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:40.269635 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-37d7a009-fddd-479a-8259-a87eeb88d743 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:40.284130 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-37d7a009-fddd-479a-8259-a87eeb88d743 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1505 microversion: 2.1 time: 0.370092 Aug 04 17:08:40.287387 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1724/3386] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:39 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1505 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:40.456923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4848f7e3-5869-4c31-bce4-3dd68e1dc24b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:40.458287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4848f7e3-5869-4c31-bce4-3dd68e1dc24b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 70c75b7c-2890-48a2-a7b2-7caf3125a492] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:40.469147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4848f7e3-5869-4c31-bce4-3dd68e1dc24b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:40.469941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4848f7e3-5869-4c31-bce4-3dd68e1dc24b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:40.482758 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4848f7e3-5869-4c31-bce4-3dd68e1dc24b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:40.483918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4848f7e3-5869-4c31-bce4-3dd68e1dc24b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:40.484563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4848f7e3-5869-4c31-bce4-3dd68e1dc24b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:40.485186 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4848f7e3-5869-4c31-bce4-3dd68e1dc24b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:40.602375 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6bcb9e54-3066-455a-b4de-1241d81c22a5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:40.610403 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6bcb9e54-3066-455a-b4de-1241d81c22a5 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664" status: 200 len: 1472 microversion: 2.1 time: 0.489152 Aug 04 17:08:40.614358 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1663/3387] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:40 2022] GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664 => generated 1472 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:08:40.693288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4848f7e3-5869-4c31-bce4-3dd68e1dc24b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:40.708198 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4848f7e3-5869-4c31-bce4-3dd68e1dc24b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492" status: 200 len: 1323 microversion: 2.1 time: 0.255771 Aug 04 17:08:40.712403 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1725/3388] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:40 2022] GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492 => generated 1323 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:08:40.801446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4f7cc11d-0547-409e-86ac-909afcfc9052 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:40.802297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4f7cc11d-0547-409e-86ac-909afcfc9052 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:40.814047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f7cc11d-0547-409e-86ac-909afcfc9052 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:40.814511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f7cc11d-0547-409e-86ac-909afcfc9052 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:40.819127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f7cc11d-0547-409e-86ac-909afcfc9052 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:40.820101 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f7cc11d-0547-409e-86ac-909afcfc9052 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:40.820588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f7cc11d-0547-409e-86ac-909afcfc9052 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:40.821030 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f7cc11d-0547-409e-86ac-909afcfc9052 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:40.933278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2da16ee7-a19d-4c10-a57c-340c568fd69c tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:40.933990 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2da16ee7-a19d-4c10-a57c-340c568fd69c tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] [instance: 92a10759-f1cf-452a-9e3e-b2d99944dee4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:40.951629 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2da16ee7-a19d-4c10-a57c-340c568fd69c tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:40.952330 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2da16ee7-a19d-4c10-a57c-340c568fd69c tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:40.952949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2da16ee7-a19d-4c10-a57c-340c568fd69c tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:40.954058 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2da16ee7-a19d-4c10-a57c-340c568fd69c tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:40.954691 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2da16ee7-a19d-4c10-a57c-340c568fd69c tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:40.956516 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2da16ee7-a19d-4c10-a57c-340c568fd69c tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:41.098821 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2da16ee7-a19d-4c10-a57c-340c568fd69c tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae7d4debce6463999584b08b482d05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3847ca33d14d96b7df887796cf7f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:41.102235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4f7cc11d-0547-409e-86ac-909afcfc9052 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:41.109451 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2da16ee7-a19d-4c10-a57c-340c568fd69c tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] 10.222.0.93 "GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4" status: 200 len: 1212 microversion: 2.1 time: 0.180488 Aug 04 17:08:41.111403 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4f7cc11d-0547-409e-86ac-909afcfc9052 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:41.113691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4f7cc11d-0547-409e-86ac-909afcfc9052 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:41.115217 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4f7cc11d-0547-409e-86ac-909afcfc9052 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36" status: 200 len: 1361 microversion: 2.26 time: 0.322939 Aug 04 17:08:41.116344 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1664/3390] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:08:40 2022] GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36 => generated 1361 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:08:41.116465 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1726/3390] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:40 2022] GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4 => generated 1212 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:41.124382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3d43292f-dcda-449e-bc24-42978db4a148 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:41.125355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3d43292f-dcda-449e-bc24-42978db4a148 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:41.134770 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d43292f-dcda-449e-bc24-42978db4a148 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:41.135650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d43292f-dcda-449e-bc24-42978db4a148 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:41.136855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d43292f-dcda-449e-bc24-42978db4a148 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:41.143970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d43292f-dcda-449e-bc24-42978db4a148 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:41.145490 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d43292f-dcda-449e-bc24-42978db4a148 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:41.146317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d43292f-dcda-449e-bc24-42978db4a148 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:41.311008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bb507cd6-0fc1-4108-9852-8eb2046dbab5 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:41.311706 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bb507cd6-0fc1-4108-9852-8eb2046dbab5 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:41.327352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb507cd6-0fc1-4108-9852-8eb2046dbab5 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:41.327947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb507cd6-0fc1-4108-9852-8eb2046dbab5 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:41.328525 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb507cd6-0fc1-4108-9852-8eb2046dbab5 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:41.332002 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb507cd6-0fc1-4108-9852-8eb2046dbab5 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:41.332491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb507cd6-0fc1-4108-9852-8eb2046dbab5 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:41.338701 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb507cd6-0fc1-4108-9852-8eb2046dbab5 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:41.628755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3d43292f-dcda-449e-bc24-42978db4a148 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:41.639321 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3d43292f-dcda-449e-bc24-42978db4a148 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1318 microversion: 2.1 time: 0.519901 Aug 04 17:08:41.650490 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1727/3391] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:41 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1318 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:41.669778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a41ed587-0bac-4bf0-94d0-7fbd3012abd3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:41.673592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a41ed587-0bac-4bf0-94d0-7fbd3012abd3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 42dff36d-2301-4c8c-b3a5-1dd535cf9664] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:41.704652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a41ed587-0bac-4bf0-94d0-7fbd3012abd3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:41.706591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a41ed587-0bac-4bf0-94d0-7fbd3012abd3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:41.707265 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a41ed587-0bac-4bf0-94d0-7fbd3012abd3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:41.710922 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a41ed587-0bac-4bf0-94d0-7fbd3012abd3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:41.711822 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a41ed587-0bac-4bf0-94d0-7fbd3012abd3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:41.712636 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a41ed587-0bac-4bf0-94d0-7fbd3012abd3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:41.835502 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bb507cd6-0fc1-4108-9852-8eb2046dbab5 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:41.845862 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bb507cd6-0fc1-4108-9852-8eb2046dbab5 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1505 microversion: 2.1 time: 0.539553 Aug 04 17:08:41.851416 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1665/3392] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:41 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1505 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:41.866011 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dec4d042-9652-4c04-895a-9d73535e7e79 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:41.878197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dec4d042-9652-4c04-895a-9d73535e7e79 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 70c75b7c-2890-48a2-a7b2-7caf3125a492] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:41.910993 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dec4d042-9652-4c04-895a-9d73535e7e79 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:41.911790 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dec4d042-9652-4c04-895a-9d73535e7e79 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:41.913538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dec4d042-9652-4c04-895a-9d73535e7e79 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:41.919341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dec4d042-9652-4c04-895a-9d73535e7e79 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:41.924187 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dec4d042-9652-4c04-895a-9d73535e7e79 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:41.925033 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dec4d042-9652-4c04-895a-9d73535e7e79 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:42.440930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a41ed587-0bac-4bf0-94d0-7fbd3012abd3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:42.464062 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a41ed587-0bac-4bf0-94d0-7fbd3012abd3 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664" status: 200 len: 1472 microversion: 2.1 time: 0.806196 Aug 04 17:08:42.466190 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1728/3393] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:41 2022] GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664 => generated 1472 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:42.504120 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fddf4f3e-8992-445c-8478-a1c6fecaa82e tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:42.504468 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fddf4f3e-8992-445c-8478-a1c6fecaa82e tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:42.526556 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fddf4f3e-8992-445c-8478-a1c6fecaa82e tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:42.527901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fddf4f3e-8992-445c-8478-a1c6fecaa82e tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:42.533813 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fddf4f3e-8992-445c-8478-a1c6fecaa82e tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:42.535076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fddf4f3e-8992-445c-8478-a1c6fecaa82e tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:42.535805 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fddf4f3e-8992-445c-8478-a1c6fecaa82e tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:42.537958 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fddf4f3e-8992-445c-8478-a1c6fecaa82e tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:42.731362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dec4d042-9652-4c04-895a-9d73535e7e79 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:42.749263 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dec4d042-9652-4c04-895a-9d73535e7e79 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492" status: 200 len: 1323 microversion: 2.1 time: 0.890128 Aug 04 17:08:42.755455 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1666/3394] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:41 2022] GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492 => generated 1323 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:42.783999 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6c623c18-3d52-4643-9299-d38e6ca0bcf9 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:42.787883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6c623c18-3d52-4643-9299-d38e6ca0bcf9 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] [instance: 92a10759-f1cf-452a-9e3e-b2d99944dee4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:42.812197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c623c18-3d52-4643-9299-d38e6ca0bcf9 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:42.812609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c623c18-3d52-4643-9299-d38e6ca0bcf9 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:42.813313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c623c18-3d52-4643-9299-d38e6ca0bcf9 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:42.826172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c623c18-3d52-4643-9299-d38e6ca0bcf9 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:42.826989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c623c18-3d52-4643-9299-d38e6ca0bcf9 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:42.827452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c623c18-3d52-4643-9299-d38e6ca0bcf9 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:43.016081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6c623c18-3d52-4643-9299-d38e6ca0bcf9 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae7d4debce6463999584b08b482d05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3847ca33d14d96b7df887796cf7f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:43.030090 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6c623c18-3d52-4643-9299-d38e6ca0bcf9 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] 10.222.0.93 "GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4" status: 200 len: 1276 microversion: 2.1 time: 0.272996 Aug 04 17:08:43.045869 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1667/3395] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:42 2022] GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4 => generated 1276 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:43.051390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0f88c69e-81be-4ce2-abd4-a7268816563e req-5c019aa1-6a63-436f-8774-607d66c65f09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a592dcbd-6b85-4d18-acdb-82f579be9067", "name": "network-vif-plugged", "status": "completed", "tag": "50ccfc29-071f-4ee9-b4b3-d1abf0c5facb"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:43.092637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0f88c69e-81be-4ce2-abd4-a7268816563e req-5c019aa1-6a63-436f-8774-607d66c65f09 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:43.093445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0f88c69e-81be-4ce2-abd4-a7268816563e req-5c019aa1-6a63-436f-8774-607d66c65f09 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:43.094072 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0f88c69e-81be-4ce2-abd4-a7268816563e req-5c019aa1-6a63-436f-8774-607d66c65f09 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:43.116955 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0f88c69e-81be-4ce2-abd4-a7268816563e req-5c019aa1-6a63-436f-8774-607d66c65f09 service nova] Creating event network-vif-plugged:50ccfc29-071f-4ee9-b4b3-d1abf0c5facb for instance a592dcbd-6b85-4d18-acdb-82f579be9067 on n-h1-851359-3 Aug 04 17:08:43.141359 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0f88c69e-81be-4ce2-abd4-a7268816563e req-5c019aa1-6a63-436f-8774-607d66c65f09 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093480 Aug 04 17:08:43.142014 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1668/3396] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:43.163048 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b09ffcba-3889-4d37-b66d-c0523617d8b2 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:43.163895 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b09ffcba-3889-4d37-b66d-c0523617d8b2 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:43.175995 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b09ffcba-3889-4d37-b66d-c0523617d8b2 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:43.176518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b09ffcba-3889-4d37-b66d-c0523617d8b2 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:43.182986 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b09ffcba-3889-4d37-b66d-c0523617d8b2 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:43.183773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b09ffcba-3889-4d37-b66d-c0523617d8b2 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:43.184261 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b09ffcba-3889-4d37-b66d-c0523617d8b2 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:43.184707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b09ffcba-3889-4d37-b66d-c0523617d8b2 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:43.249238 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fddf4f3e-8992-445c-8478-a1c6fecaa82e tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:43.260944 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fddf4f3e-8992-445c-8478-a1c6fecaa82e tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:43.262560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fddf4f3e-8992-445c-8478-a1c6fecaa82e tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:43.263890 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fddf4f3e-8992-445c-8478-a1c6fecaa82e tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36" status: 200 len: 1361 microversion: 2.26 time: 0.795386 Aug 04 17:08:43.264701 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1729/3397] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:08:42 2022] GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36 => generated 1361 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:08:43.269720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-19ac0fe8-7731-4241-87a5-012383a69193 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:43.270335 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-19ac0fe8-7731-4241-87a5-012383a69193 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:43.277471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19ac0fe8-7731-4241-87a5-012383a69193 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:43.278247 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19ac0fe8-7731-4241-87a5-012383a69193 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:43.278921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19ac0fe8-7731-4241-87a5-012383a69193 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:43.279933 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19ac0fe8-7731-4241-87a5-012383a69193 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:43.281348 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19ac0fe8-7731-4241-87a5-012383a69193 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:43.282789 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19ac0fe8-7731-4241-87a5-012383a69193 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:44.045863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b09ffcba-3889-4d37-b66d-c0523617d8b2 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:44.049131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-19ac0fe8-7731-4241-87a5-012383a69193 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:44.058956 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-19ac0fe8-7731-4241-87a5-012383a69193 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1505 microversion: 2.1 time: 0.792896 Aug 04 17:08:44.078551 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1730/3398] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:43 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1505 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:44.087508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f228f0ad-0f85-418a-b26b-6fa2c4965452 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:44.089071 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b09ffcba-3889-4d37-b66d-c0523617d8b2 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1318 microversion: 2.1 time: 0.919579 Aug 04 17:08:44.090305 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1669/3399] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:43 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1318 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:44.091637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f228f0ad-0f85-418a-b26b-6fa2c4965452 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 42dff36d-2301-4c8c-b3a5-1dd535cf9664] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:44.102099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bd77bbc6-9fbe-41c8-ba10-9eab2d034fcb tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:44.104147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bd77bbc6-9fbe-41c8-ba10-9eab2d034fcb tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 70c75b7c-2890-48a2-a7b2-7caf3125a492] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:44.111266 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f228f0ad-0f85-418a-b26b-6fa2c4965452 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:44.111803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f228f0ad-0f85-418a-b26b-6fa2c4965452 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:44.112275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f228f0ad-0f85-418a-b26b-6fa2c4965452 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:44.113216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f228f0ad-0f85-418a-b26b-6fa2c4965452 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:44.113871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f228f0ad-0f85-418a-b26b-6fa2c4965452 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:44.114520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f228f0ad-0f85-418a-b26b-6fa2c4965452 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:44.117502 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd77bbc6-9fbe-41c8-ba10-9eab2d034fcb tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:44.118913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd77bbc6-9fbe-41c8-ba10-9eab2d034fcb tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:44.119625 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd77bbc6-9fbe-41c8-ba10-9eab2d034fcb tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:44.122070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd77bbc6-9fbe-41c8-ba10-9eab2d034fcb tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:44.125246 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd77bbc6-9fbe-41c8-ba10-9eab2d034fcb tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:44.126017 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd77bbc6-9fbe-41c8-ba10-9eab2d034fcb tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:44.280910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f228f0ad-0f85-418a-b26b-6fa2c4965452 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:44.296191 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f228f0ad-0f85-418a-b26b-6fa2c4965452 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664" status: 200 len: 1430 microversion: 2.1 time: 0.216138 Aug 04 17:08:44.296796 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1731/3400] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:44 2022] GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664 => generated 1430 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:44.317499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8d3483bb-ba92-4c09-9684-52139f45a440 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:44.321655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8d3483bb-ba92-4c09-9684-52139f45a440 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] [instance: 92a10759-f1cf-452a-9e3e-b2d99944dee4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:44.330332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d3483bb-ba92-4c09-9684-52139f45a440 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:44.331312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d3483bb-ba92-4c09-9684-52139f45a440 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:44.331755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d3483bb-ba92-4c09-9684-52139f45a440 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:44.332489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d3483bb-ba92-4c09-9684-52139f45a440 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:44.332960 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d3483bb-ba92-4c09-9684-52139f45a440 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:44.333401 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d3483bb-ba92-4c09-9684-52139f45a440 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:44.425391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bd77bbc6-9fbe-41c8-ba10-9eab2d034fcb tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:44.459324 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bd77bbc6-9fbe-41c8-ba10-9eab2d034fcb tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492" status: 200 len: 1517 microversion: 2.1 time: 0.367064 Aug 04 17:08:44.463378 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1670/3401] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:44 2022] GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492 => generated 1517 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:44.476794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-e8c3331d-98eb-4354-a125-5df8962f1b0d req-acae21a2-2562-4381-98d2-7d387113ef5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42dff36d-2301-4c8c-b3a5-1dd535cf9664", "name": "network-vif-deleted", "tag": "9285b000-3237-417d-acef-9b19e86db779"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:44.537115 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e8c3331d-98eb-4354-a125-5df8962f1b0d req-acae21a2-2562-4381-98d2-7d387113ef5a service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:44.537936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e8c3331d-98eb-4354-a125-5df8962f1b0d req-acae21a2-2562-4381-98d2-7d387113ef5a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:44.547535 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e8c3331d-98eb-4354-a125-5df8962f1b0d req-acae21a2-2562-4381-98d2-7d387113ef5a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:44.604804 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-e8c3331d-98eb-4354-a125-5df8962f1b0d req-acae21a2-2562-4381-98d2-7d387113ef5a service nova] Creating event network-vif-deleted:9285b000-3237-417d-acef-9b19e86db779 for instance 42dff36d-2301-4c8c-b3a5-1dd535cf9664 on n-h1-851359-3 Aug 04 17:08:44.613436 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-e8c3331d-98eb-4354-a125-5df8962f1b0d req-acae21a2-2562-4381-98d2-7d387113ef5a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146500 Aug 04 17:08:44.614468 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1671/3402] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:44.625252 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ffa1a95b-927a-41bc-ad39-487585413a34 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:44.625903 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ffa1a95b-927a-41bc-ad39-487585413a34 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:44.644946 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffa1a95b-927a-41bc-ad39-487585413a34 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:44.645537 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffa1a95b-927a-41bc-ad39-487585413a34 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:44.645899 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffa1a95b-927a-41bc-ad39-487585413a34 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:44.664744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffa1a95b-927a-41bc-ad39-487585413a34 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:44.665286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffa1a95b-927a-41bc-ad39-487585413a34 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:44.665792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffa1a95b-927a-41bc-ad39-487585413a34 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:44.725663 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8d3483bb-ba92-4c09-9684-52139f45a440 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae7d4debce6463999584b08b482d05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3847ca33d14d96b7df887796cf7f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:44.738989 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8d3483bb-ba92-4c09-9684-52139f45a440 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] 10.222.0.93 "GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4" status: 200 len: 1316 microversion: 2.1 time: 0.427673 Aug 04 17:08:44.743409 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1732/3403] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:44 2022] GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4 => generated 1316 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:44.750573 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fea5d894-1c47-4a13-b171-1cb1eeaf6203 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:44.756521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fea5d894-1c47-4a13-b171-1cb1eeaf6203 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 5ad185e4-a5ae-4222-b0d7-9c29ee8a9061] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:44.795593 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fea5d894-1c47-4a13-b171-1cb1eeaf6203 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:44.799873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fea5d894-1c47-4a13-b171-1cb1eeaf6203 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:44.800580 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fea5d894-1c47-4a13-b171-1cb1eeaf6203 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:44.802680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fea5d894-1c47-4a13-b171-1cb1eeaf6203 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:44.803735 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fea5d894-1c47-4a13-b171-1cb1eeaf6203 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:44.807666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fea5d894-1c47-4a13-b171-1cb1eeaf6203 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:45.007481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ffa1a95b-927a-41bc-ad39-487585413a34 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:45.021585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ffa1a95b-927a-41bc-ad39-487585413a34 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:45.022831 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ffa1a95b-927a-41bc-ad39-487585413a34 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:45.024003 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ffa1a95b-927a-41bc-ad39-487585413a34 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36" status: 200 len: 1361 microversion: 2.26 time: 0.408424 Aug 04 17:08:45.029067 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1672/3404] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:08:44 2022] GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36 => generated 1361 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:08:45.056374 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fea5d894-1c47-4a13-b171-1cb1eeaf6203 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:45.064947 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fea5d894-1c47-4a13-b171-1cb1eeaf6203 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers/5ad185e4-a5ae-4222-b0d7-9c29ee8a9061" status: 200 len: 1516 microversion: 2.1 time: 0.318768 Aug 04 17:08:45.065758 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1733/3405] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:44 2022] GET /compute/v2.1/servers/5ad185e4-a5ae-4222-b0d7-9c29ee8a9061 => generated 1516 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:45.085538 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-be302f29-7efe-4549-b087-eeb8a9dcf0db tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:45.086488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-be302f29-7efe-4549-b087-eeb8a9dcf0db tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 33022d3d-bb86-401e-98c8-c6f04f3d8959] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:45.093917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be302f29-7efe-4549-b087-eeb8a9dcf0db tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:45.094648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be302f29-7efe-4549-b087-eeb8a9dcf0db tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:45.095283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be302f29-7efe-4549-b087-eeb8a9dcf0db tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:45.096183 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be302f29-7efe-4549-b087-eeb8a9dcf0db tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:45.096831 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be302f29-7efe-4549-b087-eeb8a9dcf0db tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:45.097440 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be302f29-7efe-4549-b087-eeb8a9dcf0db tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:45.098861 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-32a9a1f0-6b25-426f-8989-00fe7de2f0c6 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:45.099629 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-32a9a1f0-6b25-426f-8989-00fe7de2f0c6 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:45.106636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32a9a1f0-6b25-426f-8989-00fe7de2f0c6 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:45.107140 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32a9a1f0-6b25-426f-8989-00fe7de2f0c6 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:45.110119 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32a9a1f0-6b25-426f-8989-00fe7de2f0c6 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:45.110863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32a9a1f0-6b25-426f-8989-00fe7de2f0c6 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:45.111343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32a9a1f0-6b25-426f-8989-00fe7de2f0c6 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:45.111887 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32a9a1f0-6b25-426f-8989-00fe7de2f0c6 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:45.344783 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-32a9a1f0-6b25-426f-8989-00fe7de2f0c6 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:45.357841 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-32a9a1f0-6b25-426f-8989-00fe7de2f0c6 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1505 microversion: 2.1 time: 0.276994 Aug 04 17:08:45.358716 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1673/3406] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:45 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1505 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:45.368136 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c5f92729-5989-4f50-a405-9b7ff2151dfd tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:45.369772 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c5f92729-5989-4f50-a405-9b7ff2151dfd tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:45.379114 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-be302f29-7efe-4549-b087-eeb8a9dcf0db tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:45.391701 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-be302f29-7efe-4549-b087-eeb8a9dcf0db tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers/33022d3d-bb86-401e-98c8-c6f04f3d8959" status: 200 len: 1516 microversion: 2.1 time: 0.307686 Aug 04 17:08:45.392848 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1734/3407] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:45 2022] GET /compute/v2.1/servers/33022d3d-bb86-401e-98c8-c6f04f3d8959 => generated 1516 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:08:45.396595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5f92729-5989-4f50-a405-9b7ff2151dfd tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:45.397104 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5f92729-5989-4f50-a405-9b7ff2151dfd tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:45.397550 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5f92729-5989-4f50-a405-9b7ff2151dfd tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:45.416692 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-be31f58d-c0e5-4a18-9282-ea177c279337 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:45.417297 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-be31f58d-c0e5-4a18-9282-ea177c279337 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 42dff36d-2301-4c8c-b3a5-1dd535cf9664] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:45.419923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5f92729-5989-4f50-a405-9b7ff2151dfd tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:45.420608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5f92729-5989-4f50-a405-9b7ff2151dfd tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:45.421070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5f92729-5989-4f50-a405-9b7ff2151dfd tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:45.436921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be31f58d-c0e5-4a18-9282-ea177c279337 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:45.437656 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be31f58d-c0e5-4a18-9282-ea177c279337 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:45.438565 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be31f58d-c0e5-4a18-9282-ea177c279337 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:45.439499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be31f58d-c0e5-4a18-9282-ea177c279337 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:45.440284 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be31f58d-c0e5-4a18-9282-ea177c279337 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:45.440873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be31f58d-c0e5-4a18-9282-ea177c279337 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:45.484223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be31f58d-c0e5-4a18-9282-ea177c279337 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:45.484928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be31f58d-c0e5-4a18-9282-ea177c279337 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:45.485719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be31f58d-c0e5-4a18-9282-ea177c279337 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:45.486555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-be31f58d-c0e5-4a18-9282-ea177c279337 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lazy-loading 'fault' on Instance uuid 42dff36d-2301-4c8c-b3a5-1dd535cf9664 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:08:45.577257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-be31f58d-c0e5-4a18-9282-ea177c279337 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abad886e45bd4c4b8f5f0f86c45eb068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de328615cef94528b55b8309dd9b82b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:45.584788 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-be31f58d-c0e5-4a18-9282-ea177c279337 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664" status: 200 len: 1306 microversion: 2.1 time: 0.190809 Aug 04 17:08:45.609031 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1735/3408] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:45 2022] GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664 => generated 1306 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:45.616241 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5c4d635a-38f5-460a-837a-bdd5392f3baf tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:45.617162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5c4d635a-38f5-460a-837a-bdd5392f3baf tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 33022d3d-bb86-401e-98c8-c6f04f3d8959] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:45.625107 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c4d635a-38f5-460a-837a-bdd5392f3baf tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:45.625865 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c4d635a-38f5-460a-837a-bdd5392f3baf tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:45.626529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c4d635a-38f5-460a-837a-bdd5392f3baf tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:45.627414 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c4d635a-38f5-460a-837a-bdd5392f3baf tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:45.628031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c4d635a-38f5-460a-837a-bdd5392f3baf tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:45.629332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c4d635a-38f5-460a-837a-bdd5392f3baf tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:45.655932 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c5f92729-5989-4f50-a405-9b7ff2151dfd tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:45.664680 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c5f92729-5989-4f50-a405-9b7ff2151dfd tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1508 microversion: 2.1 time: 0.304682 Aug 04 17:08:45.666445 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5c4d635a-38f5-460a-837a-bdd5392f3baf tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 33022d3d-bb86-401e-98c8-c6f04f3d8959] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:08:45.678868 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1674/3409] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:45 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1508 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:45.687195 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-ff2f301e-b13f-4b43-9b46-cd85fe41fec6 req-ac63e9de-dcfe-405a-b025-97412ff61322 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92a10759-f1cf-452a-9e3e-b2d99944dee4", "tag": "b62dd3cf-90a4-4252-a6a4-953c8a20aa43"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:45.697709 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ff2f301e-b13f-4b43-9b46-cd85fe41fec6 req-ac63e9de-dcfe-405a-b025-97412ff61322 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:45.698285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ff2f301e-b13f-4b43-9b46-cd85fe41fec6 req-ac63e9de-dcfe-405a-b025-97412ff61322 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:45.698735 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ff2f301e-b13f-4b43-9b46-cd85fe41fec6 req-ac63e9de-dcfe-405a-b025-97412ff61322 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:45.716757 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-ff2f301e-b13f-4b43-9b46-cd85fe41fec6 req-ac63e9de-dcfe-405a-b025-97412ff61322 service nova] Creating event network-changed:b62dd3cf-90a4-4252-a6a4-953c8a20aa43 for instance 92a10759-f1cf-452a-9e3e-b2d99944dee4 on n-h2-851359-3 Aug 04 17:08:45.725309 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-ff2f301e-b13f-4b43-9b46-cd85fe41fec6 req-ac63e9de-dcfe-405a-b025-97412ff61322 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042360 Aug 04 17:08:45.729015 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1675/3410] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:45.740203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a80ba0af-af56-408a-a9d1-203f97bc6017 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:45.741172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a80ba0af-af56-408a-a9d1-203f97bc6017 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:45.751093 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a80ba0af-af56-408a-a9d1-203f97bc6017 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:45.751592 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a80ba0af-af56-408a-a9d1-203f97bc6017 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:45.752037 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a80ba0af-af56-408a-a9d1-203f97bc6017 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:45.752759 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a80ba0af-af56-408a-a9d1-203f97bc6017 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:45.753242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a80ba0af-af56-408a-a9d1-203f97bc6017 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:45.753657 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a80ba0af-af56-408a-a9d1-203f97bc6017 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:45.764867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:45.810493 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5c4d635a-38f5-460a-837a-bdd5392f3baf tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "DELETE /compute/v2.1/servers/33022d3d-bb86-401e-98c8-c6f04f3d8959" status: 204 len: 0 microversion: 2.1 time: 0.198765 Aug 04 17:08:45.811958 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1736/3411] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:08:45 2022] DELETE /compute/v2.1/servers/33022d3d-bb86-401e-98c8-c6f04f3d8959 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:08:45.819592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-02614813-5b5e-46db-b2b6-1a660b560de0 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:45.821676 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-02614813-5b5e-46db-b2b6-1a660b560de0 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] [instance: 92a10759-f1cf-452a-9e3e-b2d99944dee4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:45.828852 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02614813-5b5e-46db-b2b6-1a660b560de0 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:45.831580 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02614813-5b5e-46db-b2b6-1a660b560de0 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:45.832307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02614813-5b5e-46db-b2b6-1a660b560de0 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:45.833334 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02614813-5b5e-46db-b2b6-1a660b560de0 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:45.834006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02614813-5b5e-46db-b2b6-1a660b560de0 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:45.834867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02614813-5b5e-46db-b2b6-1a660b560de0 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:46.103793 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-02614813-5b5e-46db-b2b6-1a660b560de0 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae7d4debce6463999584b08b482d05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3847ca33d14d96b7df887796cf7f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:46.121108 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-02614813-5b5e-46db-b2b6-1a660b560de0 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] 10.222.0.93 "GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4" status: 200 len: 1316 microversion: 2.1 time: 0.307112 Aug 04 17:08:46.135802 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1737/3412] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:45 2022] GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4 => generated 1316 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:46.140761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5fbd57d4-fea5-4042-8b82-847e59cbd7dc tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:46.141403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5fbd57d4-fea5-4042-8b82-847e59cbd7dc tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 33022d3d-bb86-401e-98c8-c6f04f3d8959] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:46.148493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5fbd57d4-fea5-4042-8b82-847e59cbd7dc tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:46.149161 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5fbd57d4-fea5-4042-8b82-847e59cbd7dc tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:46.149622 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5fbd57d4-fea5-4042-8b82-847e59cbd7dc tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:46.150963 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5fbd57d4-fea5-4042-8b82-847e59cbd7dc tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:46.151438 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5fbd57d4-fea5-4042-8b82-847e59cbd7dc tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:46.151878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5fbd57d4-fea5-4042-8b82-847e59cbd7dc tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:46.158746 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a80ba0af-af56-408a-a9d1-203f97bc6017 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:46.171265 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a80ba0af-af56-408a-a9d1-203f97bc6017 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1508 microversion: 2.1 time: 0.441035 Aug 04 17:08:46.174065 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1676/3413] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:45 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1508 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:46.180952 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ae12607b-92e5-485b-a6c7-e47e3fce5ec3 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:46.185055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ae12607b-92e5-485b-a6c7-e47e3fce5ec3 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:46.222560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae12607b-92e5-485b-a6c7-e47e3fce5ec3 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:46.223289 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae12607b-92e5-485b-a6c7-e47e3fce5ec3 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:46.225566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae12607b-92e5-485b-a6c7-e47e3fce5ec3 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:46.226637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae12607b-92e5-485b-a6c7-e47e3fce5ec3 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:46.227292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae12607b-92e5-485b-a6c7-e47e3fce5ec3 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:46.228377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae12607b-92e5-485b-a6c7-e47e3fce5ec3 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:46.376035 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5fbd57d4-fea5-4042-8b82-847e59cbd7dc tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:46.383872 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5fbd57d4-fea5-4042-8b82-847e59cbd7dc tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers/33022d3d-bb86-401e-98c8-c6f04f3d8959" status: 200 len: 1522 microversion: 2.1 time: 0.246935 Aug 04 17:08:46.385097 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1738/3414] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:46 2022] GET /compute/v2.1/servers/33022d3d-bb86-401e-98c8-c6f04f3d8959 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:46.389760 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-c154c160-43af-409a-be9b-37efbd4cccc6 req-19462a38-d5f4-444f-af7f-8635d69ca05a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "876d789c-ca99-4545-aab6-371278764e36", "name": "network-vif-plugged", "status": "completed", "tag": "60029b7a-10b9-4bcf-9309-fc524eb04b5e"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:46.399860 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c154c160-43af-409a-be9b-37efbd4cccc6 req-19462a38-d5f4-444f-af7f-8635d69ca05a service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:46.400707 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c154c160-43af-409a-be9b-37efbd4cccc6 req-19462a38-d5f4-444f-af7f-8635d69ca05a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:46.401371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c154c160-43af-409a-be9b-37efbd4cccc6 req-19462a38-d5f4-444f-af7f-8635d69ca05a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:46.414448 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-c154c160-43af-409a-be9b-37efbd4cccc6 req-19462a38-d5f4-444f-af7f-8635d69ca05a service nova] Creating event network-vif-plugged:60029b7a-10b9-4bcf-9309-fc524eb04b5e for instance 876d789c-ca99-4545-aab6-371278764e36 on n-h1-851359-3 Aug 04 17:08:46.421640 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-c154c160-43af-409a-be9b-37efbd4cccc6 req-19462a38-d5f4-444f-af7f-8635d69ca05a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035106 Aug 04 17:08:46.422604 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1739/3415] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:46.432022 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-71dabd8a-8875-4de1-bf39-1c79707748d7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:46.434813 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-71dabd8a-8875-4de1-bf39-1c79707748d7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:46.441557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71dabd8a-8875-4de1-bf39-1c79707748d7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:46.442093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71dabd8a-8875-4de1-bf39-1c79707748d7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:46.442643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71dabd8a-8875-4de1-bf39-1c79707748d7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:46.443371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71dabd8a-8875-4de1-bf39-1c79707748d7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:46.443730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71dabd8a-8875-4de1-bf39-1c79707748d7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:46.444165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71dabd8a-8875-4de1-bf39-1c79707748d7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:46.452457 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ae12607b-92e5-485b-a6c7-e47e3fce5ec3 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:46.461120 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ae12607b-92e5-485b-a6c7-e47e3fce5ec3 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:46.463047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ae12607b-92e5-485b-a6c7-e47e3fce5ec3 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:46.464464 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ae12607b-92e5-485b-a6c7-e47e3fce5ec3 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36" status: 200 len: 1361 microversion: 2.26 time: 0.289221 Aug 04 17:08:46.465107 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1677/3416] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:08:46 2022] GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36 => generated 1361 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:08:46.469943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ad797a03-df0b-4cbb-accd-799e4c8aaa88 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:46.470880 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ad797a03-df0b-4cbb-accd-799e4c8aaa88 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:46.477152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad797a03-df0b-4cbb-accd-799e4c8aaa88 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:46.477890 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad797a03-df0b-4cbb-accd-799e4c8aaa88 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:46.478681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad797a03-df0b-4cbb-accd-799e4c8aaa88 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:46.479599 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad797a03-df0b-4cbb-accd-799e4c8aaa88 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:46.480262 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad797a03-df0b-4cbb-accd-799e4c8aaa88 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:46.480893 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad797a03-df0b-4cbb-accd-799e4c8aaa88 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:46.538360 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-71dabd8a-8875-4de1-bf39-1c79707748d7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "PUT /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1080 microversion: 2.1 time: 0.113492 Aug 04 17:08:46.539439 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1740/3417] 10.222.0.93 () {60 vars in 1256 bytes} [Thu Aug 4 17:08:46 2022] PUT /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1080 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:46.564562 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f62282e7-6cea-48ce-8572-4ffa6e92138b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:46.565266 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f62282e7-6cea-48ce-8572-4ffa6e92138b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:46.575207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f62282e7-6cea-48ce-8572-4ffa6e92138b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:46.575733 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f62282e7-6cea-48ce-8572-4ffa6e92138b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:46.576186 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f62282e7-6cea-48ce-8572-4ffa6e92138b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:46.577194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f62282e7-6cea-48ce-8572-4ffa6e92138b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:46.577671 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f62282e7-6cea-48ce-8572-4ffa6e92138b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:46.578141 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f62282e7-6cea-48ce-8572-4ffa6e92138b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:46.689376 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ad797a03-df0b-4cbb-accd-799e4c8aaa88 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:46.698210 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ad797a03-df0b-4cbb-accd-799e4c8aaa88 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1505 microversion: 2.1 time: 0.231605 Aug 04 17:08:46.707360 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1678/3418] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:46 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1505 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:46.729096 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cba78a08-f0b1-4aca-9f71-e3a1d6edcaa9 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:46.729877 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cba78a08-f0b1-4aca-9f71-e3a1d6edcaa9 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] [instance: 42dff36d-2301-4c8c-b3a5-1dd535cf9664] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:46.736333 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cba78a08-f0b1-4aca-9f71-e3a1d6edcaa9 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:46.736950 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cba78a08-f0b1-4aca-9f71-e3a1d6edcaa9 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:46.737492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cba78a08-f0b1-4aca-9f71-e3a1d6edcaa9 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:46.738538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cba78a08-f0b1-4aca-9f71-e3a1d6edcaa9 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:46.739232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cba78a08-f0b1-4aca-9f71-e3a1d6edcaa9 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:46.739759 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cba78a08-f0b1-4aca-9f71-e3a1d6edcaa9 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:46.757135 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-cba78a08-f0b1-4aca-9f71-e3a1d6edcaa9 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] HTTP exception thrown: Instance 42dff36d-2301-4c8c-b3a5-1dd535cf9664 could not be found. Aug 04 17:08:46.761186 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f62282e7-6cea-48ce-8572-4ffa6e92138b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cba78a08-f0b1-4aca-9f71-e3a1d6edcaa9 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Request method failure captured: Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664 HTTP/1.1 Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_w0jZeUsbjEc5kYg27hf-dMmPEmOS8mz9zj3LiyLgIwLfZP9355AOtAolQUi0IfSyHmBTm0ZLYpzXBPR2sg5A16dXtRgSW2ZOMGwE8_C42ShFtz9WjdriiJ5vR6sp-55xsNqL34nsOcOKnlgDPAz7cPTUNxqkeWCJfWyd01S-wbqeI Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: de328615cef94528b55b8309dd9b82b0 Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersOnMultiNodesTest-1487912368 Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/de328615cef94528b55b8309dd9b82b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/de328615cef94528b55b8309dd9b82b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_de328615cef94528b55b8309dd9b82b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/de328615cef94528b55b8309dd9b82b0"}]}] Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersOnMultiNodesTest-1487912368 Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: de328615cef94528b55b8309dd9b82b0 Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1487912368 Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersOnMultiNodesTest-1487912368-project Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: abad886e45bd4c4b8f5f0f86c45eb068 Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersOnMultiNodesTest-1487912368-project Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 42dff36d-2301-4c8c-b3a5-1dd535cf9664 could not be found. Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '42dff36d-2301-4c8c-b3a5-1dd535cf9664'} Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42dff36d-2301-4c8c-b3a5-1dd535cf9664 could not be found. Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42dff36d-2301-4c8c-b3a5-1dd535cf9664 could not be found. Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:08:46.767126 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:08:46.772405 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:46.772405 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:08:46.772405 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:08:46.772405 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:08:46.772405 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:08:46.772405 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42dff36d-2301-4c8c-b3a5-1dd535cf9664 could not be found. Aug 04 17:08:46.772405 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:08:46.772961 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f62282e7-6cea-48ce-8572-4ffa6e92138b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1506 microversion: 2.1 time: 0.214972 Aug 04 17:08:46.773607 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1741/3419] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:46 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1506 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:08:46.781027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cba78a08-f0b1-4aca-9f71-e3a1d6edcaa9 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] Returning 404 to user: Instance 42dff36d-2301-4c8c-b3a5-1dd535cf9664 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:08:46.781932 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cba78a08-f0b1-4aca-9f71-e3a1d6edcaa9 tempest-ServersOnMultiNodesTest-1487912368 tempest-ServersOnMultiNodesTest-1487912368-project] 10.222.0.93 "GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664" status: 404 len: 111 microversion: 2.1 time: 0.062464 Aug 04 17:08:46.787481 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1679/3420] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:46 2022] GET /compute/v2.1/servers/42dff36d-2301-4c8c-b3a5-1dd535cf9664 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:08:46.793143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b1467041-0ae6-4b27-88ef-7bbd186b5027 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:46.794005 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b1467041-0ae6-4b27-88ef-7bbd186b5027 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:46.803959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1467041-0ae6-4b27-88ef-7bbd186b5027 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:46.804601 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1467041-0ae6-4b27-88ef-7bbd186b5027 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:46.805139 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1467041-0ae6-4b27-88ef-7bbd186b5027 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:46.805947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1467041-0ae6-4b27-88ef-7bbd186b5027 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:46.806586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1467041-0ae6-4b27-88ef-7bbd186b5027 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:46.807205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1467041-0ae6-4b27-88ef-7bbd186b5027 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:46.976489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b1467041-0ae6-4b27-88ef-7bbd186b5027 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:46.990256 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b1467041-0ae6-4b27-88ef-7bbd186b5027 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1506 microversion: 2.1 time: 0.200314 Aug 04 17:08:46.994321 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1742/3421] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:46 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1506 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:47.019027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-adf6ba08-1fd2-4f06-94e5-fe21331f6f0c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:47.022819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-adf6ba08-1fd2-4f06-94e5-fe21331f6f0c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:47.030435 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adf6ba08-1fd2-4f06-94e5-fe21331f6f0c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:47.031069 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adf6ba08-1fd2-4f06-94e5-fe21331f6f0c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:47.031607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adf6ba08-1fd2-4f06-94e5-fe21331f6f0c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:47.032675 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adf6ba08-1fd2-4f06-94e5-fe21331f6f0c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:47.033249 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adf6ba08-1fd2-4f06-94e5-fe21331f6f0c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:47.033786 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adf6ba08-1fd2-4f06-94e5-fe21331f6f0c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:47.055711 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:47.132188 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-adf6ba08-1fd2-4f06-94e5-fe21331f6f0c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:08:47.132663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-adf6ba08-1fd2-4f06-94e5-fe21331f6f0c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:08:47.133152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-adf6ba08-1fd2-4f06-94e5-fe21331f6f0c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:08:47.133571 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-adf6ba08-1fd2-4f06-94e5-fe21331f6f0c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:08:47.134236 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-adf6ba08-1fd2-4f06-94e5-fe21331f6f0c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:08:47.149363 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7b2de0b4-1f65-4bd4-9459-61bc39872e28 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:47.149363 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7b2de0b4-1f65-4bd4-9459-61bc39872e28 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] [instance: 92a10759-f1cf-452a-9e3e-b2d99944dee4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:47.156314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b2de0b4-1f65-4bd4-9459-61bc39872e28 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:47.156826 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b2de0b4-1f65-4bd4-9459-61bc39872e28 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:47.157273 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b2de0b4-1f65-4bd4-9459-61bc39872e28 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:47.158038 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b2de0b4-1f65-4bd4-9459-61bc39872e28 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:47.160892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b2de0b4-1f65-4bd4-9459-61bc39872e28 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:47.162221 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b2de0b4-1f65-4bd4-9459-61bc39872e28 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:47.261495 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-adf6ba08-1fd2-4f06-94e5-fe21331f6f0c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:47.269162 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adf6ba08-1fd2-4f06-94e5-fe21331f6f0c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:47.271176 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adf6ba08-1fd2-4f06-94e5-fe21331f6f0c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:47.271893 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adf6ba08-1fd2-4f06-94e5-fe21331f6f0c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:47.272840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adf6ba08-1fd2-4f06-94e5-fe21331f6f0c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:47.273516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adf6ba08-1fd2-4f06-94e5-fe21331f6f0c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:47.274199 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adf6ba08-1fd2-4f06-94e5-fe21331f6f0c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:47.310955 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-adf6ba08-1fd2-4f06-94e5-fe21331f6f0c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "POST /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067/action" status: 202 len: 1112 microversion: 2.1 time: 0.296476 Aug 04 17:08:47.335220 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1680/3422] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:08:47 2022] POST /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067/action => generated 1112 bytes in 322 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 17:08:47.379006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-15aa86c5-df68-4083-8f4a-597522f795dd tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:47.381806 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-15aa86c5-df68-4083-8f4a-597522f795dd tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:47.393445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15aa86c5-df68-4083-8f4a-597522f795dd tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:47.394358 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15aa86c5-df68-4083-8f4a-597522f795dd tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:47.395038 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15aa86c5-df68-4083-8f4a-597522f795dd tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:47.396913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15aa86c5-df68-4083-8f4a-597522f795dd tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:47.400711 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15aa86c5-df68-4083-8f4a-597522f795dd tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:47.401403 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15aa86c5-df68-4083-8f4a-597522f795dd tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:47.443682 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7b2de0b4-1f65-4bd4-9459-61bc39872e28 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae7d4debce6463999584b08b482d05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3847ca33d14d96b7df887796cf7f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:47.457459 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7b2de0b4-1f65-4bd4-9459-61bc39872e28 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] 10.222.0.93 "GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4" status: 200 len: 1316 microversion: 2.1 time: 0.317217 Aug 04 17:08:47.472208 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1743/3423] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:47 2022] GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4 => generated 1316 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:47.484901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6608cedf-506b-4f5b-9f10-331af6e4e36f tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:47.485750 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6608cedf-506b-4f5b-9f10-331af6e4e36f tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 33022d3d-bb86-401e-98c8-c6f04f3d8959] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:47.498334 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6608cedf-506b-4f5b-9f10-331af6e4e36f tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:47.499212 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6608cedf-506b-4f5b-9f10-331af6e4e36f tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:47.500055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6608cedf-506b-4f5b-9f10-331af6e4e36f tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:47.500987 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6608cedf-506b-4f5b-9f10-331af6e4e36f tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:47.507098 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6608cedf-506b-4f5b-9f10-331af6e4e36f tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:47.507840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6608cedf-506b-4f5b-9f10-331af6e4e36f tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:47.880454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-15aa86c5-df68-4083-8f4a-597522f795dd tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:47.893409 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-15aa86c5-df68-4083-8f4a-597522f795dd tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1517 microversion: 2.1 time: 0.537189 Aug 04 17:08:47.912444 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1681/3424] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:47 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1517 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:47.927981 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-acccc837-c46b-4c0f-8bee-279fc268f651 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:47.928849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-acccc837-c46b-4c0f-8bee-279fc268f651 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:47.955623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acccc837-c46b-4c0f-8bee-279fc268f651 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:47.957634 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acccc837-c46b-4c0f-8bee-279fc268f651 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:47.959476 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acccc837-c46b-4c0f-8bee-279fc268f651 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:47.960694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acccc837-c46b-4c0f-8bee-279fc268f651 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:47.963698 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acccc837-c46b-4c0f-8bee-279fc268f651 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:47.964847 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acccc837-c46b-4c0f-8bee-279fc268f651 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:47.969787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6608cedf-506b-4f5b-9f10-331af6e4e36f tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:47.980354 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6608cedf-506b-4f5b-9f10-331af6e4e36f tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers/33022d3d-bb86-401e-98c8-c6f04f3d8959" status: 200 len: 1522 microversion: 2.1 time: 0.506897 Aug 04 17:08:47.981588 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1744/3425] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:47 2022] GET /compute/v2.1/servers/33022d3d-bb86-401e-98c8-c6f04f3d8959 => generated 1522 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:48.001899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0fb3ce8b-9b6c-4faf-885f-91d18ffe17ba tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:48.002558 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0fb3ce8b-9b6c-4faf-885f-91d18ffe17ba tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:48.027942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0fb3ce8b-9b6c-4faf-885f-91d18ffe17ba tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:48.031343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0fb3ce8b-9b6c-4faf-885f-91d18ffe17ba tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:48.032489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0fb3ce8b-9b6c-4faf-885f-91d18ffe17ba tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:48.033459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0fb3ce8b-9b6c-4faf-885f-91d18ffe17ba tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:48.035846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0fb3ce8b-9b6c-4faf-885f-91d18ffe17ba tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:48.039802 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0fb3ce8b-9b6c-4faf-885f-91d18ffe17ba tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:48.355550 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-acccc837-c46b-4c0f-8bee-279fc268f651 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:48.370617 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0fb3ce8b-9b6c-4faf-885f-91d18ffe17ba tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:48.373476 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-acccc837-c46b-4c0f-8bee-279fc268f651 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:48.381106 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0fb3ce8b-9b6c-4faf-885f-91d18ffe17ba tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1505 microversion: 2.1 time: 0.398090 Aug 04 17:08:48.382504 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-acccc837-c46b-4c0f-8bee-279fc268f651 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:48.384255 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-acccc837-c46b-4c0f-8bee-279fc268f651 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36" status: 200 len: 1361 microversion: 2.26 time: 0.470462 Aug 04 17:08:48.385216 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1682/3426] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:08:47 2022] GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36 => generated 1361 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:08:48.399830 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1745/3427] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:47 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1505 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:48.484792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-95229139-c16c-4c3d-867b-ec9d54409973 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:48.485431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-95229139-c16c-4c3d-867b-ec9d54409973 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] [instance: 92a10759-f1cf-452a-9e3e-b2d99944dee4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:48.501669 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95229139-c16c-4c3d-867b-ec9d54409973 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:48.502500 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95229139-c16c-4c3d-867b-ec9d54409973 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:48.503117 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95229139-c16c-4c3d-867b-ec9d54409973 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:48.504046 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95229139-c16c-4c3d-867b-ec9d54409973 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:48.504750 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95229139-c16c-4c3d-867b-ec9d54409973 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:48.505195 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95229139-c16c-4c3d-867b-ec9d54409973 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:48.566010 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0c94a895-e155-474e-9c29-1f89ba8b9770 req-aa9955bd-2caa-4a06-95df-3bb5f9d98b3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33022d3d-bb86-401e-98c8-c6f04f3d8959", "name": "network-vif-deleted", "tag": "e187bd1f-d4ce-4fa5-ba9e-cfd65b40a2c5"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:48.594525 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0c94a895-e155-474e-9c29-1f89ba8b9770 req-aa9955bd-2caa-4a06-95df-3bb5f9d98b3b service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:48.597535 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0c94a895-e155-474e-9c29-1f89ba8b9770 req-aa9955bd-2caa-4a06-95df-3bb5f9d98b3b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:48.598055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0c94a895-e155-474e-9c29-1f89ba8b9770 req-aa9955bd-2caa-4a06-95df-3bb5f9d98b3b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:48.647292 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0c94a895-e155-474e-9c29-1f89ba8b9770 req-aa9955bd-2caa-4a06-95df-3bb5f9d98b3b service nova] Creating event network-vif-deleted:e187bd1f-d4ce-4fa5-ba9e-cfd65b40a2c5 for instance 33022d3d-bb86-401e-98c8-c6f04f3d8959 on n-h1-851359-3 Aug 04 17:08:48.673781 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0c94a895-e155-474e-9c29-1f89ba8b9770 req-aa9955bd-2caa-4a06-95df-3bb5f9d98b3b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108356 Aug 04 17:08:48.674778 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1683/3428] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:08:48.799312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-95229139-c16c-4c3d-867b-ec9d54409973 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae7d4debce6463999584b08b482d05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3847ca33d14d96b7df887796cf7f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:48.815537 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-95229139-c16c-4c3d-867b-ec9d54409973 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] 10.222.0.93 "GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4" status: 200 len: 1316 microversion: 2.1 time: 0.341292 Aug 04 17:08:48.830192 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1746/3429] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:48 2022] GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4 => generated 1316 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:48.917607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-438aa4c1-4e4a-4bd4-a3d3-442826929d9f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:48.924258 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-438aa4c1-4e4a-4bd4-a3d3-442826929d9f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:48.932558 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-438aa4c1-4e4a-4bd4-a3d3-442826929d9f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:48.934949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-438aa4c1-4e4a-4bd4-a3d3-442826929d9f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:48.935709 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-438aa4c1-4e4a-4bd4-a3d3-442826929d9f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:48.936611 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-438aa4c1-4e4a-4bd4-a3d3-442826929d9f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:48.937232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-438aa4c1-4e4a-4bd4-a3d3-442826929d9f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:48.938887 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-438aa4c1-4e4a-4bd4-a3d3-442826929d9f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:49.003467 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-25e71c0c-3614-4473-9631-ab4f8678dca7 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:49.004177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-25e71c0c-3614-4473-9631-ab4f8678dca7 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 33022d3d-bb86-401e-98c8-c6f04f3d8959] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:49.031046 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25e71c0c-3614-4473-9631-ab4f8678dca7 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:49.031802 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25e71c0c-3614-4473-9631-ab4f8678dca7 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:49.033518 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25e71c0c-3614-4473-9631-ab4f8678dca7 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:49.035893 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25e71c0c-3614-4473-9631-ab4f8678dca7 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:49.036564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25e71c0c-3614-4473-9631-ab4f8678dca7 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:49.037183 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25e71c0c-3614-4473-9631-ab4f8678dca7 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:49.201818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-25e71c0c-3614-4473-9631-ab4f8678dca7 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:49.223622 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-25e71c0c-3614-4473-9631-ab4f8678dca7 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers/33022d3d-bb86-401e-98c8-c6f04f3d8959" status: 200 len: 1308 microversion: 2.1 time: 0.223956 Aug 04 17:08:49.227904 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1747/3430] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:48 2022] GET /compute/v2.1/servers/33022d3d-bb86-401e-98c8-c6f04f3d8959 => generated 1308 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:49.371621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-438aa4c1-4e4a-4bd4-a3d3-442826929d9f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:49.389130 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-438aa4c1-4e4a-4bd4-a3d3-442826929d9f tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1517 microversion: 2.1 time: 0.470907 Aug 04 17:08:49.389767 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1684/3431] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:48 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1517 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:49.410599 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-df8a9b08-f96e-4a3b-8575-6bf412438119 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:49.411637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-df8a9b08-f96e-4a3b-8575-6bf412438119 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:49.415618 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-10e3fa42-29a8-4e52-8105-f51fdbb11737 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:49.416915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-10e3fa42-29a8-4e52-8105-f51fdbb11737 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:49.422404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df8a9b08-f96e-4a3b-8575-6bf412438119 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:49.423491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df8a9b08-f96e-4a3b-8575-6bf412438119 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:49.424423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df8a9b08-f96e-4a3b-8575-6bf412438119 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:49.425916 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df8a9b08-f96e-4a3b-8575-6bf412438119 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:49.426656 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df8a9b08-f96e-4a3b-8575-6bf412438119 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:49.427472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df8a9b08-f96e-4a3b-8575-6bf412438119 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:49.456718 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10e3fa42-29a8-4e52-8105-f51fdbb11737 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:49.456973 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10e3fa42-29a8-4e52-8105-f51fdbb11737 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:49.457556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10e3fa42-29a8-4e52-8105-f51fdbb11737 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:49.458398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10e3fa42-29a8-4e52-8105-f51fdbb11737 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:49.458864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10e3fa42-29a8-4e52-8105-f51fdbb11737 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:49.459301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10e3fa42-29a8-4e52-8105-f51fdbb11737 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:49.459910 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:49.493239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:49.861039 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-df8a9b08-f96e-4a3b-8575-6bf412438119 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:49.882693 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-df8a9b08-f96e-4a3b-8575-6bf412438119 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1505 microversion: 2.1 time: 0.477270 Aug 04 17:08:49.885389 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1748/3432] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:49 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1505 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:08:49.901181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6c90ac98-24d3-48ce-b225-42f1fd902fd2 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:49.903431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6c90ac98-24d3-48ce-b225-42f1fd902fd2 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] [instance: 92a10759-f1cf-452a-9e3e-b2d99944dee4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:49.919229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:49.926235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c90ac98-24d3-48ce-b225-42f1fd902fd2 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:49.927683 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c90ac98-24d3-48ce-b225-42f1fd902fd2 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:49.928723 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c90ac98-24d3-48ce-b225-42f1fd902fd2 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:49.930166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c90ac98-24d3-48ce-b225-42f1fd902fd2 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:49.932481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c90ac98-24d3-48ce-b225-42f1fd902fd2 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:49.934395 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c90ac98-24d3-48ce-b225-42f1fd902fd2 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:49.995922 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-10e3fa42-29a8-4e52-8105-f51fdbb11737 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:50.007189 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-10e3fa42-29a8-4e52-8105-f51fdbb11737 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:50.017152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-10e3fa42-29a8-4e52-8105-f51fdbb11737 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:50.018524 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-10e3fa42-29a8-4e52-8105-f51fdbb11737 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36" status: 200 len: 1545 microversion: 2.26 time: 0.607240 Aug 04 17:08:50.019399 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1685/3433] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:08:49 2022] GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36 => generated 1545 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:08:50.052427 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-947eb0c2-6554-4104-8378-b3844493ee76 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '.version_select at 0x7f1e5b577280>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:50.082740 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-947eb0c2-6554-4104-8378-b3844493ee76 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.083632 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-947eb0c2-6554-4104-8378-b3844493ee76 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.084307 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-947eb0c2-6554-4104-8378-b3844493ee76 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.085137 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-947eb0c2-6554-4104-8378-b3844493ee76 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:50.093431 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-947eb0c2-6554-4104-8378-b3844493ee76 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.095033 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-947eb0c2-6554-4104-8378-b3844493ee76 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.095684 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-947eb0c2-6554-4104-8378-b3844493ee76 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.098426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-947eb0c2-6554-4104-8378-b3844493ee76 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.099656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-947eb0c2-6554-4104-8378-b3844493ee76 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.100326 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-947eb0c2-6554-4104-8378-b3844493ee76 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.158299 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-947eb0c2-6554-4104-8378-b3844493ee76 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.159104 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-947eb0c2-6554-4104-8378-b3844493ee76 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.159743 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-947eb0c2-6554-4104-8378-b3844493ee76 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.186075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-947eb0c2-6554-4104-8378-b3844493ee76 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.186871 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-947eb0c2-6554-4104-8378-b3844493ee76 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.187504 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-947eb0c2-6554-4104-8378-b3844493ee76 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.233091 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6c90ac98-24d3-48ce-b225-42f1fd902fd2 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae7d4debce6463999584b08b482d05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3847ca33d14d96b7df887796cf7f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:50.240510 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-947eb0c2-6554-4104-8378-b3844493ee76 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lazy-loading 'flavor' on Instance uuid 876d789c-ca99-4545-aab6-371278764e36 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:08:50.261105 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6c90ac98-24d3-48ce-b225-42f1fd902fd2 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] 10.222.0.93 "GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4" status: 200 len: 1316 microversion: 2.1 time: 0.370934 Aug 04 17:08:50.262840 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1749/3434] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:49 2022] GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4 => generated 1316 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:50.274421 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-947eb0c2-6554-4104-8378-b3844493ee76 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "PUT /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags/tempest-tag-903406421" status: 201 len: 0 microversion: 2.26 time: 0.227903 Aug 04 17:08:50.275369 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-56c46598-3cab-4642-95ea-0bef0f1094e2 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:50.276219 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1686/3435] 10.222.0.93 () {62 vars in 1377 bytes} [Thu Aug 4 17:08:50 2022] PUT /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags/tempest-tag-903406421 => generated 0 bytes in 231 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 04 17:08:50.281949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-56c46598-3cab-4642-95ea-0bef0f1094e2 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 33022d3d-bb86-401e-98c8-c6f04f3d8959] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:50.292919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c185667d-d64e-4eb2-9dfc-46ba3b8b5c23 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '.version_select at 0x7f1e5b592550>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:50.296461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56c46598-3cab-4642-95ea-0bef0f1094e2 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.298175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56c46598-3cab-4642-95ea-0bef0f1094e2 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.298903 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56c46598-3cab-4642-95ea-0bef0f1094e2 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.300081 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56c46598-3cab-4642-95ea-0bef0f1094e2 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.301223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56c46598-3cab-4642-95ea-0bef0f1094e2 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.301919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56c46598-3cab-4642-95ea-0bef0f1094e2 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.303991 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c185667d-d64e-4eb2-9dfc-46ba3b8b5c23 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.304722 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c185667d-d64e-4eb2-9dfc-46ba3b8b5c23 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.305820 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c185667d-d64e-4eb2-9dfc-46ba3b8b5c23 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.321325 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c185667d-d64e-4eb2-9dfc-46ba3b8b5c23 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags/tempest-tag-903406421" status: 204 len: 0 microversion: 2.26 time: 0.033127 Aug 04 17:08:50.323324 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1687/3436] 10.222.0.93 () {60 vars in 1358 bytes} [Thu Aug 4 17:08:50 2022] GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags/tempest-tag-903406421 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:08:50.334467 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0691a319-418f-4b46-b5ab-761581ddce1f tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '.version_select at 0x7f1e5b592040>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:50.344645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0691a319-418f-4b46-b5ab-761581ddce1f tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.344879 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-56c46598-3cab-4642-95ea-0bef0f1094e2 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] HTTP exception thrown: Instance 33022d3d-bb86-401e-98c8-c6f04f3d8959 could not be found. Aug 04 17:08:50.345636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0691a319-418f-4b46-b5ab-761581ddce1f tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.346418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0691a319-418f-4b46-b5ab-761581ddce1f tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.347224 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0691a319-418f-4b46-b5ab-761581ddce1f tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-56c46598-3cab-4642-95ea-0bef0f1094e2 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Request method failure captured: Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/33022d3d-bb86-401e-98c8-c6f04f3d8959 HTTP/1.1 Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_z5mp_Zwqz7Jw4QDMJgpPtcvEspl6J9YjhKIIcbfijhzb7nFmee5qEsZQ-Bejp2XGsqjBw78yv5OUKTkPZV_XKUCyhX1xqcyxx0PuLeLtaxvL_OjxzA5V98q8HCYFA8I7IaOJ-l8WzB4LdZ7fTmxoUYN_Ib_KcU_vTiECUCWq0N1Tw Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: ab1f5e7e1fda4b55a700c49041331f0b Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ListServersNegativeTestJSON-1546379396 Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ab1f5e7e1fda4b55a700c49041331f0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ab1f5e7e1fda4b55a700c49041331f0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ab1f5e7e1fda4b55a700c49041331f0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ab1f5e7e1fda4b55a700c49041331f0b"}]}] Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ListServersNegativeTestJSON-1546379396 Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: ab1f5e7e1fda4b55a700c49041331f0b Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1546379396 Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ListServersNegativeTestJSON-1546379396-project Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: ac5ee766cef74c928c68d72419b64e3e Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ListServersNegativeTestJSON-1546379396-project Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 33022d3d-bb86-401e-98c8-c6f04f3d8959 could not be found. Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '33022d3d-bb86-401e-98c8-c6f04f3d8959'} Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33022d3d-bb86-401e-98c8-c6f04f3d8959 could not be found. Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33022d3d-bb86-401e-98c8-c6f04f3d8959 could not be found. Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:50.347531 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:08:50.351698 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:50.351698 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:50.351698 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:08:50.351698 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:08:50.351698 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:08:50.351698 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:08:50.351698 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33022d3d-bb86-401e-98c8-c6f04f3d8959 could not be found. Aug 04 17:08:50.351698 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:50.351698 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-56c46598-3cab-4642-95ea-0bef0f1094e2 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Returning 404 to user: Instance 33022d3d-bb86-401e-98c8-c6f04f3d8959 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:08:50.351698 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-56c46598-3cab-4642-95ea-0bef0f1094e2 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers/33022d3d-bb86-401e-98c8-c6f04f3d8959" status: 404 len: 111 microversion: 2.1 time: 0.084049 Aug 04 17:08:50.351698 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1750/3437] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:50 2022] GET /compute/v2.1/servers/33022d3d-bb86-401e-98c8-c6f04f3d8959 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:08:50.358448 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8c86e681-5fdb-4651-95f5-655986a83116 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:50.360591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0691a319-418f-4b46-b5ab-761581ddce1f tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.361347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0691a319-418f-4b46-b5ab-761581ddce1f tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.361947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0691a319-418f-4b46-b5ab-761581ddce1f tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.363169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0691a319-418f-4b46-b5ab-761581ddce1f tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.363795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0691a319-418f-4b46-b5ab-761581ddce1f tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.364479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0691a319-418f-4b46-b5ab-761581ddce1f tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.368532 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8c86e681-5fdb-4651-95f5-655986a83116 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:50.371038 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8c86e681-5fdb-4651-95f5-655986a83116 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b'} {{(pid=131043) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:08:50.378943 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c86e681-5fdb-4651-95f5-655986a83116 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.379776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c86e681-5fdb-4651-95f5-655986a83116 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.381181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c86e681-5fdb-4651-95f5-655986a83116 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.382392 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c86e681-5fdb-4651-95f5-655986a83116 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.383229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c86e681-5fdb-4651-95f5-655986a83116 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.383906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c86e681-5fdb-4651-95f5-655986a83116 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.393275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0691a319-418f-4b46-b5ab-761581ddce1f tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.394062 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0691a319-418f-4b46-b5ab-761581ddce1f tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.394512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0691a319-418f-4b46-b5ab-761581ddce1f tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.414049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-0691a319-418f-4b46-b5ab-761581ddce1f tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lazy-loading 'flavor' on Instance uuid 876d789c-ca99-4545-aab6-371278764e36 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:08:50.433109 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0691a319-418f-4b46-b5ab-761581ddce1f tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "DELETE /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags" status: 204 len: 0 microversion: 2.26 time: 0.104109 Aug 04 17:08:50.438991 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1688/3438] 10.222.0.93 () {60 vars in 1295 bytes} [Thu Aug 4 17:08:50 2022] DELETE /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 04 17:08:50.447782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9947c8b8-86e5-4542-b58f-e57126f0bb73 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:50.449658 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9947c8b8-86e5-4542-b58f-e57126f0bb73 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:50.458206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9947c8b8-86e5-4542-b58f-e57126f0bb73 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.459177 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9947c8b8-86e5-4542-b58f-e57126f0bb73 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.459915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9947c8b8-86e5-4542-b58f-e57126f0bb73 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.461557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9947c8b8-86e5-4542-b58f-e57126f0bb73 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.463331 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9947c8b8-86e5-4542-b58f-e57126f0bb73 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.464078 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9947c8b8-86e5-4542-b58f-e57126f0bb73 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.498537 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8c86e681-5fdb-4651-95f5-655986a83116 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.143819 Aug 04 17:08:50.499606 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1751/3439] 10.222.0.93 () {58 vars in 1230 bytes} [Thu Aug 4 17:08:50 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:08:50.512915 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b37bb182-80e8-4732-9748-ec30eac284cc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '.version_select at 0x7f1e5ac05ca0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:50.521909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b37bb182-80e8-4732-9748-ec30eac284cc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.522785 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b37bb182-80e8-4732-9748-ec30eac284cc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.523440 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b37bb182-80e8-4732-9748-ec30eac284cc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.541295 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b37bb182-80e8-4732-9748-ec30eac284cc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags" status: 200 len: 12 microversion: 2.26 time: 0.039710 Aug 04 17:08:50.542043 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1752/3440] 10.222.0.93 () {60 vars in 1292 bytes} [Thu Aug 4 17:08:50 2022] GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags => generated 12 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:50.550417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-acfdc7c1-dd8f-433e-b0c5-dd364d28e91b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-acfdc7c1-dd8f-433e-b0c5-dd364d28e91b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Request method failure captured: Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_z5mp_Zwqz7Jw4QDMJgpPtcvEspl6J9YjhKIIcbfijhzb7nFmee5qEsZQ-Bejp2XGsqjBw78yv5OUKTkPZV_XKUCyhX1xqcyxx0PuLeLtaxvL_OjxzA5V98q8HCYFA8I7IaOJ-l8WzB4LdZ7fTmxoUYN_Ib_KcU_vTiECUCWq0N1Tw Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: ab1f5e7e1fda4b55a700c49041331f0b Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ListServersNegativeTestJSON-1546379396 Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ab1f5e7e1fda4b55a700c49041331f0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ab1f5e7e1fda4b55a700c49041331f0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ab1f5e7e1fda4b55a700c49041331f0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ab1f5e7e1fda4b55a700c49041331f0b"}]}] Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ListServersNegativeTestJSON-1546379396 Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: ab1f5e7e1fda4b55a700c49041331f0b Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1546379396 Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ListServersNegativeTestJSON-1546379396-project Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: ac5ee766cef74c928c68d72419b64e3e Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ListServersNegativeTestJSON-1546379396-project Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: action_args: {} Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 04 17:08:50.554823 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:08:50.566711 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:08:50.566711 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:08:50.566711 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:08:50.566711 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 04 17:08:50.566711 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:50.566711 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:08:50.566711 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:50.566711 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:50.566711 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:08:50.566711 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:08:50.566711 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:08:50.566711 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:08:50.566711 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 04 17:08:50.566711 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:50.566711 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-acfdc7c1-dd8f-433e-b0c5-dd364d28e91b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:08:50.566711 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-acfdc7c1-dd8f-433e-b0c5-dd364d28e91b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.013318 Aug 04 17:08:50.566711 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1753/3441] 10.222.0.93 () {58 vars in 1182 bytes} [Thu Aug 4 17:08:50 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:08:50.566711 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-18ff2969-3066-484d-ba66-2171ffdad9ac tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '.version_select at 0x7f1e5acbf310>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:50.573868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-18ff2969-3066-484d-ba66-2171ffdad9ac tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.574272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-18ff2969-3066-484d-ba66-2171ffdad9ac tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.574782 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-18ff2969-3066-484d-ba66-2171ffdad9ac tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.575284 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-18ff2969-3066-484d-ba66-2171ffdad9ac tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:50.578384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:50.582344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-18ff2969-3066-484d-ba66-2171ffdad9ac tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.582903 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-18ff2969-3066-484d-ba66-2171ffdad9ac tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.583360 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-18ff2969-3066-484d-ba66-2171ffdad9ac tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.584072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-18ff2969-3066-484d-ba66-2171ffdad9ac tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.584539 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-18ff2969-3066-484d-ba66-2171ffdad9ac tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.584973 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-18ff2969-3066-484d-ba66-2171ffdad9ac tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.622680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-18ff2969-3066-484d-ba66-2171ffdad9ac tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.623185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-18ff2969-3066-484d-ba66-2171ffdad9ac tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.623638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-18ff2969-3066-484d-ba66-2171ffdad9ac tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.633844 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-18ff2969-3066-484d-ba66-2171ffdad9ac tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.634622 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-18ff2969-3066-484d-ba66-2171ffdad9ac tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.635082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-18ff2969-3066-484d-ba66-2171ffdad9ac tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.652872 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:50.666538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9947c8b8-86e5-4542-b58f-e57126f0bb73 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:50.668202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-18ff2969-3066-484d-ba66-2171ffdad9ac tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lazy-loading 'flavor' on Instance uuid 876d789c-ca99-4545-aab6-371278764e36 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:08:50.687153 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9947c8b8-86e5-4542-b58f-e57126f0bb73 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1517 microversion: 2.1 time: 0.251639 Aug 04 17:08:50.690619 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1689/3442] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:50 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1517 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:50.697311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8048e24f-ced6-49b7-9422-6c72e401ab99 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:50.703142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8048e24f-ced6-49b7-9422-6c72e401ab99 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:50.704001 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8048e24f-ced6-49b7-9422-6c72e401ab99 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Searching by: {'deleted': False, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:08:50.704680 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-18ff2969-3066-484d-ba66-2171ffdad9ac tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "PUT /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags/tempest-tag-1871354080" status: 201 len: 0 microversion: 2.26 time: 0.143798 Aug 04 17:08:50.705585 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1754/3443] 10.222.0.93 () {62 vars in 1380 bytes} [Thu Aug 4 17:08:50 2022] PUT /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags/tempest-tag-1871354080 => generated 0 bytes in 147 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 04 17:08:50.709920 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8048e24f-ced6-49b7-9422-6c72e401ab99 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.710568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8048e24f-ced6-49b7-9422-6c72e401ab99 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.711331 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8048e24f-ced6-49b7-9422-6c72e401ab99 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.712254 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8048e24f-ced6-49b7-9422-6c72e401ab99 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.712764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8048e24f-ced6-49b7-9422-6c72e401ab99 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.713259 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8048e24f-ced6-49b7-9422-6c72e401ab99 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.715762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-64d2f76b-4526-4ade-b415-e59dabebc7c9 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '.version_select at 0x7f1e5af96550>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:50.725664 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64d2f76b-4526-4ade-b415-e59dabebc7c9 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.726453 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64d2f76b-4526-4ade-b415-e59dabebc7c9 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.728923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64d2f76b-4526-4ade-b415-e59dabebc7c9 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.741568 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-64d2f76b-4526-4ade-b415-e59dabebc7c9 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags" status: 200 len: 36 microversion: 2.26 time: 0.029949 Aug 04 17:08:50.748859 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-8048e24f-ced6-49b7-9422-6c72e401ab99 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:08:50.749186 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1755/3444] 10.222.0.93 () {60 vars in 1292 bytes} [Thu Aug 4 17:08:50 2022] GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags => generated 36 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:50.754492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a3fe4fee-db58-4745-9c26-57bfe4d650cc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '.version_select at 0x7f1e6c91ac10>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:50.763405 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3fe4fee-db58-4745-9c26-57bfe4d650cc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.763405 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3fe4fee-db58-4745-9c26-57bfe4d650cc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.763895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3fe4fee-db58-4745-9c26-57bfe4d650cc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.765013 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a3fe4fee-db58-4745-9c26-57bfe4d650cc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:50.771287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3fe4fee-db58-4745-9c26-57bfe4d650cc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.771867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3fe4fee-db58-4745-9c26-57bfe4d650cc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.772507 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3fe4fee-db58-4745-9c26-57bfe4d650cc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.773260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3fe4fee-db58-4745-9c26-57bfe4d650cc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.773734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3fe4fee-db58-4745-9c26-57bfe4d650cc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.774214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3fe4fee-db58-4745-9c26-57bfe4d650cc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.796684 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8048e24f-ced6-49b7-9422-6c72e401ab99 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.104738 Aug 04 17:08:50.797556 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1690/3445] 10.222.0.93 () {58 vars in 1125 bytes} [Thu Aug 4 17:08:50 2022] GET /compute/v2.1/servers => generated 683 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:50.807389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3fe4fee-db58-4745-9c26-57bfe4d650cc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.807896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3fe4fee-db58-4745-9c26-57bfe4d650cc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.808883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3fe4fee-db58-4745-9c26-57bfe4d650cc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.812701 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d766a812-6a93-4c82-bb78-79fee5b502ef tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:50.820218 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d766a812-6a93-4c82-bb78-79fee5b502ef tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:50.821338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.compute.servers [None req-d766a812-6a93-4c82-bb78-79fee5b502ef tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Removing options 'limit' from query {{(pid=131044) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 04 17:08:50.822124 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d766a812-6a93-4c82-bb78-79fee5b502ef tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Searching by: {'deleted': False, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:08:50.828748 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d766a812-6a93-4c82-bb78-79fee5b502ef tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.829243 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d766a812-6a93-4c82-bb78-79fee5b502ef tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.829691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d766a812-6a93-4c82-bb78-79fee5b502ef tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.832702 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d766a812-6a93-4c82-bb78-79fee5b502ef tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.833201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d766a812-6a93-4c82-bb78-79fee5b502ef tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.833851 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d766a812-6a93-4c82-bb78-79fee5b502ef tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.850374 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-a3fe4fee-db58-4745-9c26-57bfe4d650cc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lazy-loading 'flavor' on Instance uuid 876d789c-ca99-4545-aab6-371278764e36 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:08:50.885076 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-d766a812-6a93-4c82-bb78-79fee5b502ef tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:08:50.885989 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a3fe4fee-db58-4745-9c26-57bfe4d650cc tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "DELETE /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags/tempest-tag-1871354080" status: 204 len: 0 microversion: 2.26 time: 0.136052 Aug 04 17:08:50.887073 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1756/3446] 10.222.0.93 () {60 vars in 1364 bytes} [Thu Aug 4 17:08:50 2022] DELETE /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags/tempest-tag-1871354080 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 04 17:08:50.893021 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ed071c09-fbfe-4de9-95cf-ecfcbea960ba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:50.893636 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ed071c09-fbfe-4de9-95cf-ecfcbea960ba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:50.904099 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed071c09-fbfe-4de9-95cf-ecfcbea960ba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.904099 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed071c09-fbfe-4de9-95cf-ecfcbea960ba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.904870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed071c09-fbfe-4de9-95cf-ecfcbea960ba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.906143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed071c09-fbfe-4de9-95cf-ecfcbea960ba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.909033 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed071c09-fbfe-4de9-95cf-ecfcbea960ba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.909605 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed071c09-fbfe-4de9-95cf-ecfcbea960ba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.944831 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d766a812-6a93-4c82-bb78-79fee5b502ef tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.139428 Aug 04 17:08:50.952811 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1691/3447] 10.222.0.93 () {58 vars in 1144 bytes} [Thu Aug 4 17:08:50 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:50.957117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-016f9470-a4db-4e47-9222-a36b1d712789 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '.version_select at 0x7f1e5ba6b430>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:50.977952 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-016f9470-a4db-4e47-9222-a36b1d712789 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:50.979090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-016f9470-a4db-4e47-9222-a36b1d712789 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:50.979536 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-016f9470-a4db-4e47-9222-a36b1d712789 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:50.997149 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-016f9470-a4db-4e47-9222-a36b1d712789 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags" status: 200 len: 12 microversion: 2.26 time: 0.044219 Aug 04 17:08:50.997792 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1692/3448] 10.222.0.93 () {60 vars in 1292 bytes} [Thu Aug 4 17:08:50 2022] GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags => generated 12 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:51.002484 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8b41c581-aeda-4f85-a610-14b83a2c4c3a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:51.015525 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8b41c581-aeda-4f85-a610-14b83a2c4c3a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:51.024541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b41c581-aeda-4f85-a610-14b83a2c4c3a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:51.025721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b41c581-aeda-4f85-a610-14b83a2c4c3a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:51.026200 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b41c581-aeda-4f85-a610-14b83a2c4c3a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:51.026926 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b41c581-aeda-4f85-a610-14b83a2c4c3a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:51.027391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b41c581-aeda-4f85-a610-14b83a2c4c3a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:51.027821 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b41c581-aeda-4f85-a610-14b83a2c4c3a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:51.128575 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ed071c09-fbfe-4de9-95cf-ecfcbea960ba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:51.137463 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ed071c09-fbfe-4de9-95cf-ecfcbea960ba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.248583 Aug 04 17:08:51.138280 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1757/3449] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:50 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:51.142942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-084aef5e-f252-4237-8a12-3d05aa977389 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-084aef5e-f252-4237-8a12-3d05aa977389 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Request method failure captured: Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_z5mp_Zwqz7Jw4QDMJgpPtcvEspl6J9YjhKIIcbfijhzb7nFmee5qEsZQ-Bejp2XGsqjBw78yv5OUKTkPZV_XKUCyhX1xqcyxx0PuLeLtaxvL_OjxzA5V98q8HCYFA8I7IaOJ-l8WzB4LdZ7fTmxoUYN_Ib_KcU_vTiECUCWq0N1Tw Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: ab1f5e7e1fda4b55a700c49041331f0b Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ListServersNegativeTestJSON-1546379396 Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ab1f5e7e1fda4b55a700c49041331f0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ab1f5e7e1fda4b55a700c49041331f0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ab1f5e7e1fda4b55a700c49041331f0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ab1f5e7e1fda4b55a700c49041331f0b"}]}] Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ListServersNegativeTestJSON-1546379396 Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: ab1f5e7e1fda4b55a700c49041331f0b Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1546379396 Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ListServersNegativeTestJSON-1546379396-project Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: ac5ee766cef74c928c68d72419b64e3e Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ListServersNegativeTestJSON-1546379396-project Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: action_args: {} Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi '-1' Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 04 17:08:51.153246 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 04 17:08:51.159311 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:08:51.159311 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:08:51.159311 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:08:51.159311 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:08:51.159311 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 04 17:08:51.159311 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:51.159311 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:08:51.159311 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:51.159311 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:51.159311 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:08:51.159311 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:08:51.159311 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:08:51.159311 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:08:51.159311 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 04 17:08:51.159311 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:51.159311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-084aef5e-f252-4237-8a12-3d05aa977389 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:08:51.159311 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-084aef5e-f252-4237-8a12-3d05aa977389 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.015863 Aug 04 17:08:51.159311 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1758/3450] 10.222.0.93 () {58 vars in 1142 bytes} [Thu Aug 4 17:08:51 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:08:51.160622 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-83e2df02-29f3-4579-9089-60120f930df7 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '.version_select at 0x7f1e5bcd2670>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:51.169804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83e2df02-29f3-4579-9089-60120f930df7 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:51.170349 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83e2df02-29f3-4579-9089-60120f930df7 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:51.170798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83e2df02-29f3-4579-9089-60120f930df7 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:51.171291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-83e2df02-29f3-4579-9089-60120f930df7 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:51.177130 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83e2df02-29f3-4579-9089-60120f930df7 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:51.177641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83e2df02-29f3-4579-9089-60120f930df7 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:51.178231 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83e2df02-29f3-4579-9089-60120f930df7 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:51.178832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83e2df02-29f3-4579-9089-60120f930df7 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:51.179962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83e2df02-29f3-4579-9089-60120f930df7 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:51.179962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83e2df02-29f3-4579-9089-60120f930df7 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:51.203801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83e2df02-29f3-4579-9089-60120f930df7 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:51.204306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83e2df02-29f3-4579-9089-60120f930df7 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:51.204753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83e2df02-29f3-4579-9089-60120f930df7 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:51.212101 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8b41c581-aeda-4f85-a610-14b83a2c4c3a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:51.217261 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:51.217444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-83e2df02-29f3-4579-9089-60120f930df7 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lazy-loading 'flavor' on Instance uuid 876d789c-ca99-4545-aab6-371278764e36 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:08:51.222636 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8b41c581-aeda-4f85-a610-14b83a2c4c3a tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1505 microversion: 2.1 time: 0.223729 Aug 04 17:08:51.223517 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1693/3451] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:50 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1505 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:51.228409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cfd916c4-d9c9-4b0f-81b4-91177c6ec194 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-232540367"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:51.231449 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cfd916c4-d9c9-4b0f-81b4-91177c6ec194 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:51.232826 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-83e2df02-29f3-4579-9089-60120f930df7 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "DELETE /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags" status: 204 len: 0 microversion: 2.26 time: 0.076051 Aug 04 17:08:51.233710 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1759/3452] 10.222.0.93 () {60 vars in 1295 bytes} [Thu Aug 4 17:08:51 2022] DELETE /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:08:51.238847 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d916829b-ae00-4d64-8e0e-03b694073813 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d916829b-ae00-4d64-8e0e-03b694073813 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Request method failure captured: Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_z5mp_Zwqz7Jw4QDMJgpPtcvEspl6J9YjhKIIcbfijhzb7nFmee5qEsZQ-Bejp2XGsqjBw78yv5OUKTkPZV_XKUCyhX1xqcyxx0PuLeLtaxvL_OjxzA5V98q8HCYFA8I7IaOJ-l8WzB4LdZ7fTmxoUYN_Ib_KcU_vTiECUCWq0N1Tw Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: ab1f5e7e1fda4b55a700c49041331f0b Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ListServersNegativeTestJSON-1546379396 Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ab1f5e7e1fda4b55a700c49041331f0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ab1f5e7e1fda4b55a700c49041331f0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ab1f5e7e1fda4b55a700c49041331f0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ab1f5e7e1fda4b55a700c49041331f0b"}]}] Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ListServersNegativeTestJSON-1546379396 Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: ab1f5e7e1fda4b55a700c49041331f0b Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1546379396 Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ListServersNegativeTestJSON-1546379396-project Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: ac5ee766cef74c928c68d72419b64e3e Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ListServersNegativeTestJSON-1546379396-project Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: action_args: {} Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi 'testing' Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 04 17:08:51.242894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 04 17:08:51.247975 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:08:51.247975 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:08:51.247975 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:08:51.247975 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:08:51.247975 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 04 17:08:51.247975 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:51.247975 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:08:51.247975 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:51.247975 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:51.247975 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:08:51.247975 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:08:51.247975 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:08:51.247975 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:08:51.247975 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 04 17:08:51.247975 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:51.247975 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d916829b-ae00-4d64-8e0e-03b694073813 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:08:51.247975 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d916829b-ae00-4d64-8e0e-03b694073813 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.009660 Aug 04 17:08:51.249152 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1760/3453] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Aug 4 17:08:51 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:08:51.254250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-46a3778b-864b-42bc-9de2-149c005befed tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '.version_select at 0x7f1e5ad38670>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:51.258158 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfd916c4-d9c9-4b0f-81b4-91177c6ec194 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:51.258946 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfd916c4-d9c9-4b0f-81b4-91177c6ec194 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:51.261297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfd916c4-d9c9-4b0f-81b4-91177c6ec194 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:51.262987 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfd916c4-d9c9-4b0f-81b4-91177c6ec194 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:51.263949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfd916c4-d9c9-4b0f-81b4-91177c6ec194 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:51.264920 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfd916c4-d9c9-4b0f-81b4-91177c6ec194 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:51.265382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-46a3778b-864b-42bc-9de2-149c005befed tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:51.265906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-46a3778b-864b-42bc-9de2-149c005befed tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:51.266357 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-46a3778b-864b-42bc-9de2-149c005befed tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:51.266854 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-46a3778b-864b-42bc-9de2-149c005befed tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:51.273055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-46a3778b-864b-42bc-9de2-149c005befed tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:51.273814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-46a3778b-864b-42bc-9de2-149c005befed tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:51.274289 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-46a3778b-864b-42bc-9de2-149c005befed tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:51.275582 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-46a3778b-864b-42bc-9de2-149c005befed tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:51.276055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-46a3778b-864b-42bc-9de2-149c005befed tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:51.276490 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-46a3778b-864b-42bc-9de2-149c005befed tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:51.303824 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-46a3778b-864b-42bc-9de2-149c005befed tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:51.304325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-46a3778b-864b-42bc-9de2-149c005befed tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:51.304959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-46a3778b-864b-42bc-9de2-149c005befed tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:51.315475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-46a3778b-864b-42bc-9de2-149c005befed tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:51.316095 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-46a3778b-864b-42bc-9de2-149c005befed tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:51.316397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-46a3778b-864b-42bc-9de2-149c005befed tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:51.351125 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-46a3778b-864b-42bc-9de2-149c005befed tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lazy-loading 'flavor' on Instance uuid 876d789c-ca99-4545-aab6-371278764e36 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:08:51.367702 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-46a3778b-864b-42bc-9de2-149c005befed tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "PUT /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags/tempest-tag-961138381" status: 201 len: 0 microversion: 2.26 time: 0.117455 Aug 04 17:08:51.368351 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1761/3454] 10.222.0.93 () {62 vars in 1377 bytes} [Thu Aug 4 17:08:51 2022] PUT /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags/tempest-tag-961138381 => generated 0 bytes in 119 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 04 17:08:51.373123 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fcd7ecbb-0c22-465e-ae66-ba3983890003 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:51.378397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fcd7ecbb-0c22-465e-ae66-ba3983890003 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:51.379252 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fcd7ecbb-0c22-465e-ae66-ba3983890003 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b'} {{(pid=131043) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:08:51.387014 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.compute.servers [None req-fcd7ecbb-0c22-465e-ae66-ba3983890003 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Flavor 'non_existing_flavor' could not be found {{(pid=131043) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 04 17:08:51.388182 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fcd7ecbb-0c22-465e-ae66-ba3983890003 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.018690 Aug 04 17:08:51.389293 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1762/3455] 10.222.0.93 () {58 vars in 1178 bytes} [Thu Aug 4 17:08:51 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:08:51.394503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6fbf2782-de62-4f22-a075-beee63d2cec3 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:51.395275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6fbf2782-de62-4f22-a075-beee63d2cec3 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] [instance: 92a10759-f1cf-452a-9e3e-b2d99944dee4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:51.403825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6fbf2782-de62-4f22-a075-beee63d2cec3 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:51.404642 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6fbf2782-de62-4f22-a075-beee63d2cec3 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:51.405216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6fbf2782-de62-4f22-a075-beee63d2cec3 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:51.406415 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6fbf2782-de62-4f22-a075-beee63d2cec3 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:51.406977 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6fbf2782-de62-4f22-a075-beee63d2cec3 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:51.408444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6fbf2782-de62-4f22-a075-beee63d2cec3 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:51.516165 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cfd916c4-d9c9-4b0f-81b4-91177c6ec194 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action" status: 202 len: 0 microversion: 2.1 time: 0.291120 Aug 04 17:08:51.518066 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1694/3456] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:08:51 2022] POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 04 17:08:51.532529 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-46281636-fd47-4b34-ab5a-b5fdb85da431 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '.version_select at 0x7f1e5ac76790>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:51.544911 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46281636-fd47-4b34-ab5a-b5fdb85da431 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:51.545691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46281636-fd47-4b34-ab5a-b5fdb85da431 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:51.546518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46281636-fd47-4b34-ab5a-b5fdb85da431 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:51.547268 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-46281636-fd47-4b34-ab5a-b5fdb85da431 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:51.553649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46281636-fd47-4b34-ab5a-b5fdb85da431 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:51.554445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46281636-fd47-4b34-ab5a-b5fdb85da431 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:51.555297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46281636-fd47-4b34-ab5a-b5fdb85da431 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:51.556823 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46281636-fd47-4b34-ab5a-b5fdb85da431 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:51.557445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46281636-fd47-4b34-ab5a-b5fdb85da431 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:51.558059 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46281636-fd47-4b34-ab5a-b5fdb85da431 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:51.595014 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46281636-fd47-4b34-ab5a-b5fdb85da431 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:51.595908 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46281636-fd47-4b34-ab5a-b5fdb85da431 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:51.596523 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46281636-fd47-4b34-ab5a-b5fdb85da431 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:51.604922 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6fbf2782-de62-4f22-a075-beee63d2cec3 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae7d4debce6463999584b08b482d05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3847ca33d14d96b7df887796cf7f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:51.608345 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46281636-fd47-4b34-ab5a-b5fdb85da431 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:51.608918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46281636-fd47-4b34-ab5a-b5fdb85da431 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:51.609905 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46281636-fd47-4b34-ab5a-b5fdb85da431 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:51.614429 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6fbf2782-de62-4f22-a075-beee63d2cec3 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] 10.222.0.93 "GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4" status: 200 len: 1316 microversion: 2.1 time: 0.223790 Aug 04 17:08:51.615731 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1763/3457] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:51 2022] GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4 => generated 1316 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:51.622074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-eee5e7eb-cd9c-4048-a69e-b7d8157eb46d tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:51.628473 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-eee5e7eb-cd9c-4048-a69e-b7d8157eb46d tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:51.630560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-eee5e7eb-cd9c-4048-a69e-b7d8157eb46d tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b'} {{(pid=131043) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:08:51.641408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eee5e7eb-cd9c-4048-a69e-b7d8157eb46d tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:51.642366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eee5e7eb-cd9c-4048-a69e-b7d8157eb46d tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:51.643011 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eee5e7eb-cd9c-4048-a69e-b7d8157eb46d tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:51.646227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eee5e7eb-cd9c-4048-a69e-b7d8157eb46d tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:51.647008 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eee5e7eb-cd9c-4048-a69e-b7d8157eb46d tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:51.647727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eee5e7eb-cd9c-4048-a69e-b7d8157eb46d tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:51.666687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-46281636-fd47-4b34-ab5a-b5fdb85da431 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lazy-loading 'flavor' on Instance uuid 876d789c-ca99-4545-aab6-371278764e36 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:08:51.709284 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-46281636-fd47-4b34-ab5a-b5fdb85da431 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "PUT /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags/tempest-tag-1973780439" status: 201 len: 0 microversion: 2.26 time: 0.189326 Aug 04 17:08:51.709964 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1695/3458] 10.222.0.93 () {62 vars in 1380 bytes} [Thu Aug 4 17:08:51 2022] PUT /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags/tempest-tag-1973780439 => generated 0 bytes in 191 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 04 17:08:51.728798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-df754ab8-e87a-4d30-ac5e-9676202fb6ed tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:51.728798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-df754ab8-e87a-4d30-ac5e-9676202fb6ed tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:51.736864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df754ab8-e87a-4d30-ac5e-9676202fb6ed tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:51.737448 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df754ab8-e87a-4d30-ac5e-9676202fb6ed tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:51.738014 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df754ab8-e87a-4d30-ac5e-9676202fb6ed tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:51.739512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df754ab8-e87a-4d30-ac5e-9676202fb6ed tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:51.740048 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df754ab8-e87a-4d30-ac5e-9676202fb6ed tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:51.740996 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df754ab8-e87a-4d30-ac5e-9676202fb6ed tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:51.784823 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-eee5e7eb-cd9c-4048-a69e-b7d8157eb46d tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.167621 Aug 04 17:08:51.785589 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1764/3459] 10.222.0.93 () {58 vars in 1174 bytes} [Thu Aug 4 17:08:51 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:08:51.790372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-7d8d7d0e-8ed0-4ea7-a783-eac759b816a0 req-d7162db9-e279-4a63-ac80-ad2d245e13fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92a10759-f1cf-452a-9e3e-b2d99944dee4", "name": "network-vif-plugged", "status": "completed", "tag": "b62dd3cf-90a4-4252-a6a4-953c8a20aa43"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:51.801280 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7d8d7d0e-8ed0-4ea7-a783-eac759b816a0 req-d7162db9-e279-4a63-ac80-ad2d245e13fb service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:51.801869 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7d8d7d0e-8ed0-4ea7-a783-eac759b816a0 req-d7162db9-e279-4a63-ac80-ad2d245e13fb service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:51.802569 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7d8d7d0e-8ed0-4ea7-a783-eac759b816a0 req-d7162db9-e279-4a63-ac80-ad2d245e13fb service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:51.816372 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-7d8d7d0e-8ed0-4ea7-a783-eac759b816a0 req-d7162db9-e279-4a63-ac80-ad2d245e13fb service nova] Creating event network-vif-plugged:b62dd3cf-90a4-4252-a6a4-953c8a20aa43 for instance 92a10759-f1cf-452a-9e3e-b2d99944dee4 on n-h2-851359-3 Aug 04 17:08:51.823014 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-7d8d7d0e-8ed0-4ea7-a783-eac759b816a0 req-d7162db9-e279-4a63-ac80-ad2d245e13fb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035267 Aug 04 17:08:51.824613 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1765/3460] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:51.830074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-94f36083-bb8a-4aaa-8924-a744b263d9ee tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:51.831076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-94f36083-bb8a-4aaa-8924-a744b263d9ee tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:51.839151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94f36083-bb8a-4aaa-8924-a744b263d9ee tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:51.839665 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94f36083-bb8a-4aaa-8924-a744b263d9ee tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:51.840185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94f36083-bb8a-4aaa-8924-a744b263d9ee tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:51.840956 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94f36083-bb8a-4aaa-8924-a744b263d9ee tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:51.841417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94f36083-bb8a-4aaa-8924-a744b263d9ee tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:51.841849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94f36083-bb8a-4aaa-8924-a744b263d9ee tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:52.142998 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-df754ab8-e87a-4d30-ac5e-9676202fb6ed tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:52.152068 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-df754ab8-e87a-4d30-ac5e-9676202fb6ed tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1680 microversion: 2.1 time: 0.436260 Aug 04 17:08:52.152743 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1696/3461] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:51 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1680 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:52.166206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c51eade8-034a-4c26-9fc4-364a92687249 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '.version_select at 0x7f1e5b4b4dc0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:52.166342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c51eade8-034a-4c26-9fc4-364a92687249 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:52.166791 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c51eade8-034a-4c26-9fc4-364a92687249 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:52.167230 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c51eade8-034a-4c26-9fc4-364a92687249 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:52.167702 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c51eade8-034a-4c26-9fc4-364a92687249 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:52.172960 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c51eade8-034a-4c26-9fc4-364a92687249 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:52.173444 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c51eade8-034a-4c26-9fc4-364a92687249 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:52.173882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c51eade8-034a-4c26-9fc4-364a92687249 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:52.174612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c51eade8-034a-4c26-9fc4-364a92687249 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:52.175179 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c51eade8-034a-4c26-9fc4-364a92687249 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:52.175644 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c51eade8-034a-4c26-9fc4-364a92687249 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:52.200301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c51eade8-034a-4c26-9fc4-364a92687249 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:52.200790 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c51eade8-034a-4c26-9fc4-364a92687249 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:52.201228 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c51eade8-034a-4c26-9fc4-364a92687249 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:52.214762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-94f36083-bb8a-4aaa-8924-a744b263d9ee tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:52.218344 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-c51eade8-034a-4c26-9fc4-364a92687249 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lazy-loading 'flavor' on Instance uuid 876d789c-ca99-4545-aab6-371278764e36 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:08:52.226605 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-94f36083-bb8a-4aaa-8924-a744b263d9ee tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1517 microversion: 2.1 time: 0.400862 Aug 04 17:08:52.227602 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1766/3462] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:51 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1517 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:52.244774 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c51eade8-034a-4c26-9fc4-364a92687249 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "DELETE /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags" status: 204 len: 0 microversion: 2.26 time: 0.085943 Aug 04 17:08:52.245476 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1697/3463] 10.222.0.93 () {60 vars in 1295 bytes} [Thu Aug 4 17:08:52 2022] DELETE /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:08:52.252272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-66d4d505-619f-494c-a532-f4223274f0f0 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '.version_select at 0x7f1e5b577d30>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:52.253435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-00bbfadb-3e0d-458b-9ab4-69f969f44217 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:52.260410 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-00bbfadb-3e0d-458b-9ab4-69f969f44217 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:52.261403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-00bbfadb-3e0d-458b-9ab4-69f969f44217 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b'} {{(pid=131043) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:08:52.261928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66d4d505-619f-494c-a532-f4223274f0f0 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:52.263656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66d4d505-619f-494c-a532-f4223274f0f0 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:52.264236 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66d4d505-619f-494c-a532-f4223274f0f0 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:52.272644 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00bbfadb-3e0d-458b-9ab4-69f969f44217 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:52.273372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00bbfadb-3e0d-458b-9ab4-69f969f44217 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:52.274005 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00bbfadb-3e0d-458b-9ab4-69f969f44217 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:52.274987 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00bbfadb-3e0d-458b-9ab4-69f969f44217 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:52.275216 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-66d4d505-619f-494c-a532-f4223274f0f0 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags" status: 200 len: 12 microversion: 2.26 time: 0.028308 Aug 04 17:08:52.275843 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00bbfadb-3e0d-458b-9ab4-69f969f44217 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:52.276497 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00bbfadb-3e0d-458b-9ab4-69f969f44217 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:52.281700 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1698/3464] 10.222.0.93 () {60 vars in 1292 bytes} [Thu Aug 4 17:08:52 2022] GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags => generated 12 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:52.287023 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fc433ded-87f6-417a-a129-b4438056bfb5 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:52.287777 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fc433ded-87f6-417a-a129-b4438056bfb5 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:52.294799 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc433ded-87f6-417a-a129-b4438056bfb5 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:52.295420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc433ded-87f6-417a-a129-b4438056bfb5 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:52.295972 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc433ded-87f6-417a-a129-b4438056bfb5 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:52.296905 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc433ded-87f6-417a-a129-b4438056bfb5 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:52.297549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc433ded-87f6-417a-a129-b4438056bfb5 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:52.298157 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc433ded-87f6-417a-a129-b4438056bfb5 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:52.375510 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-00bbfadb-3e0d-458b-9ab4-69f969f44217 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.134980 Aug 04 17:08:52.376153 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1767/3465] 10.222.0.93 () {58 vars in 1184 bytes} [Thu Aug 4 17:08:52 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:08:52.388478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-15331f8e-5eb0-4d28-9f50-01ab01111fb3 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '.version_select at 0x7f1e5ad38c10>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:52.396453 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-15331f8e-5eb0-4d28-9f50-01ab01111fb3 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:52.397220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-15331f8e-5eb0-4d28-9f50-01ab01111fb3 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:52.397677 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-15331f8e-5eb0-4d28-9f50-01ab01111fb3 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:52.398196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-15331f8e-5eb0-4d28-9f50-01ab01111fb3 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:52.405652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-15331f8e-5eb0-4d28-9f50-01ab01111fb3 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:52.405652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-15331f8e-5eb0-4d28-9f50-01ab01111fb3 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:52.406246 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-15331f8e-5eb0-4d28-9f50-01ab01111fb3 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:52.407126 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-15331f8e-5eb0-4d28-9f50-01ab01111fb3 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:52.407452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-15331f8e-5eb0-4d28-9f50-01ab01111fb3 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:52.408267 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-15331f8e-5eb0-4d28-9f50-01ab01111fb3 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:52.437338 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-15331f8e-5eb0-4d28-9f50-01ab01111fb3 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:52.438343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-15331f8e-5eb0-4d28-9f50-01ab01111fb3 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:52.438974 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-15331f8e-5eb0-4d28-9f50-01ab01111fb3 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:52.453965 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-15331f8e-5eb0-4d28-9f50-01ab01111fb3 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lazy-loading 'flavor' on Instance uuid 876d789c-ca99-4545-aab6-371278764e36 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:08:52.472605 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-15331f8e-5eb0-4d28-9f50-01ab01111fb3 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "DELETE /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags" status: 204 len: 0 microversion: 2.26 time: 0.088083 Aug 04 17:08:52.473226 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1768/3466] 10.222.0.93 () {60 vars in 1295 bytes} [Thu Aug 4 17:08:52 2022] DELETE /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:08:52.478636 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f97d6f75-c9a8-413f-9c68-6b2cf9c503df tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:52.484123 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f97d6f75-c9a8-413f-9c68-6b2cf9c503df tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:52.484891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f97d6f75-c9a8-413f-9c68-6b2cf9c503df tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Searching by: {'deleted': False, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b'} {{(pid=131043) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:08:52.490610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f97d6f75-c9a8-413f-9c68-6b2cf9c503df tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:52.491106 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f97d6f75-c9a8-413f-9c68-6b2cf9c503df tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:52.491556 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f97d6f75-c9a8-413f-9c68-6b2cf9c503df tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:52.492295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f97d6f75-c9a8-413f-9c68-6b2cf9c503df tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:52.492763 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f97d6f75-c9a8-413f-9c68-6b2cf9c503df tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:52.493197 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f97d6f75-c9a8-413f-9c68-6b2cf9c503df tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:52.527139 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.multi_cell_list [None req-f97d6f75-c9a8-413f-9c68-6b2cf9c503df tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:08:52.557703 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fc433ded-87f6-417a-a129-b4438056bfb5 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:52.574226 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fc433ded-87f6-417a-a129-b4438056bfb5 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1505 microversion: 2.1 time: 0.291139 Aug 04 17:08:52.591469 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1699/3467] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:52 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1505 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:52.600675 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f5a44e1d-427f-4b73-a573-98f8f5cd33ef tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '.version_select at 0x7f1e5b4b49d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:52.606714 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f97d6f75-c9a8-413f-9c68-6b2cf9c503df tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:52.614243 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f97d6f75-c9a8-413f-9c68-6b2cf9c503df tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:52.614886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f97d6f75-c9a8-413f-9c68-6b2cf9c503df tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:52.615913 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f97d6f75-c9a8-413f-9c68-6b2cf9c503df tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:52.617259 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5a44e1d-427f-4b73-a573-98f8f5cd33ef tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:52.617763 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5a44e1d-427f-4b73-a573-98f8f5cd33ef tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:52.618815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5a44e1d-427f-4b73-a573-98f8f5cd33ef tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:52.618815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f5a44e1d-427f-4b73-a573-98f8f5cd33ef tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:52.625555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5a44e1d-427f-4b73-a573-98f8f5cd33ef tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:52.626072 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5a44e1d-427f-4b73-a573-98f8f5cd33ef tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:52.626525 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5a44e1d-427f-4b73-a573-98f8f5cd33ef tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:52.627444 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5a44e1d-427f-4b73-a573-98f8f5cd33ef tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:52.627927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5a44e1d-427f-4b73-a573-98f8f5cd33ef tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:52.628963 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5a44e1d-427f-4b73-a573-98f8f5cd33ef tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:52.663030 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5a44e1d-427f-4b73-a573-98f8f5cd33ef tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:52.664251 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5a44e1d-427f-4b73-a573-98f8f5cd33ef tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:52.664251 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5a44e1d-427f-4b73-a573-98f8f5cd33ef tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:52.673915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5a44e1d-427f-4b73-a573-98f8f5cd33ef tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:52.674612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5a44e1d-427f-4b73-a573-98f8f5cd33ef tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:52.675354 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5a44e1d-427f-4b73-a573-98f8f5cd33ef tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:52.702153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-f5a44e1d-427f-4b73-a573-98f8f5cd33ef tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lazy-loading 'flavor' on Instance uuid 876d789c-ca99-4545-aab6-371278764e36 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:08:52.718283 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f5a44e1d-427f-4b73-a573-98f8f5cd33ef tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "PUT /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags/tempest-tag-870944237" status: 201 len: 0 microversion: 2.26 time: 0.123260 Aug 04 17:08:52.719379 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1700/3468] 10.222.0.93 () {62 vars in 1377 bytes} [Thu Aug 4 17:08:52 2022] PUT /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags/tempest-tag-870944237 => generated 0 bytes in 127 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 04 17:08:52.724112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c8d9c356-469e-48cf-b510-9290b1f139de tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:52.725012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c8d9c356-469e-48cf-b510-9290b1f139de tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] [instance: 92a10759-f1cf-452a-9e3e-b2d99944dee4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:52.730805 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8d9c356-469e-48cf-b510-9290b1f139de tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:52.731319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8d9c356-469e-48cf-b510-9290b1f139de tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:52.731992 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8d9c356-469e-48cf-b510-9290b1f139de tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:52.732454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8d9c356-469e-48cf-b510-9290b1f139de tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:52.732912 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8d9c356-469e-48cf-b510-9290b1f139de tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:52.733402 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8d9c356-469e-48cf-b510-9290b1f139de tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:52.896165 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f97d6f75-c9a8-413f-9c68-6b2cf9c503df tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 0.421865 Aug 04 17:08:52.910002 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1769/3469] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 17:08:52 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:52.910002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ff30b5b2-fd21-425c-810a-e1c2b6613c59 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '.version_select at 0x7f1e5ad38c10>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:52.913016 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ff30b5b2-fd21-425c-810a-e1c2b6613c59 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:52.914064 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ff30b5b2-fd21-425c-810a-e1c2b6613c59 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:52.916438 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ff30b5b2-fd21-425c-810a-e1c2b6613c59 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:52.917011 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ff30b5b2-fd21-425c-810a-e1c2b6613c59 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:52.925920 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ff30b5b2-fd21-425c-810a-e1c2b6613c59 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:52.925920 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ff30b5b2-fd21-425c-810a-e1c2b6613c59 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:52.926401 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ff30b5b2-fd21-425c-810a-e1c2b6613c59 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:52.927231 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ff30b5b2-fd21-425c-810a-e1c2b6613c59 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:52.927796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ff30b5b2-fd21-425c-810a-e1c2b6613c59 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:52.928559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ff30b5b2-fd21-425c-810a-e1c2b6613c59 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:52.985222 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ff30b5b2-fd21-425c-810a-e1c2b6613c59 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:52.985222 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ff30b5b2-fd21-425c-810a-e1c2b6613c59 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:52.986580 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ff30b5b2-fd21-425c-810a-e1c2b6613c59 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:52.989513 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c8d9c356-469e-48cf-b510-9290b1f139de tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae7d4debce6463999584b08b482d05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3847ca33d14d96b7df887796cf7f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:52.998194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ff30b5b2-fd21-425c-810a-e1c2b6613c59 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:52.998861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ff30b5b2-fd21-425c-810a-e1c2b6613c59 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:52.999400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ff30b5b2-fd21-425c-810a-e1c2b6613c59 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:53.010861 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c8d9c356-469e-48cf-b510-9290b1f139de tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] 10.222.0.93 "GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4" status: 200 len: 1316 microversion: 2.1 time: 0.290514 Aug 04 17:08:53.024038 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1701/3470] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:52 2022] GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4 => generated 1316 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:53.024395 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=91,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:53.028876 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f58315c4-d8c0-41fd-9cc8-995a19fec424 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:53.034483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f58315c4-d8c0-41fd-9cc8-995a19fec424 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:53.035713 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f58315c4-d8c0-41fd-9cc8-995a19fec424 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.020561 Aug 04 17:08:53.036779 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1702/3471] 10.222.0.93 () {58 vars in 1178 bytes} [Thu Aug 4 17:08:53 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:08:53.048465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0403e770-fa69-4583-bf7e-7906edd2f4cb tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:53.064370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-ff30b5b2-fd21-425c-810a-e1c2b6613c59 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lazy-loading 'flavor' on Instance uuid 876d789c-ca99-4545-aab6-371278764e36 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:08:53.067963 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0403e770-fa69-4583-bf7e-7906edd2f4cb tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:53.068840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0403e770-fa69-4583-bf7e-7906edd2f4cb tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Searching by: {'deleted': False, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:08:53.075209 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0403e770-fa69-4583-bf7e-7906edd2f4cb tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:53.075775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0403e770-fa69-4583-bf7e-7906edd2f4cb tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:53.076502 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0403e770-fa69-4583-bf7e-7906edd2f4cb tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:53.077675 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0403e770-fa69-4583-bf7e-7906edd2f4cb tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:53.078364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0403e770-fa69-4583-bf7e-7906edd2f4cb tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:53.079025 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0403e770-fa69-4583-bf7e-7906edd2f4cb tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:53.093633 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ff30b5b2-fd21-425c-810a-e1c2b6613c59 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "PUT /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags/tempest-tag-1692604489" status: 201 len: 0 microversion: 2.26 time: 0.195669 Aug 04 17:08:53.094745 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1770/3472] 10.222.0.93 () {62 vars in 1380 bytes} [Thu Aug 4 17:08:52 2022] PUT /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags/tempest-tag-1692604489 => generated 0 bytes in 197 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 04 17:08:53.108169 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-838c1006-2868-4500-9c5d-495fb2cac2fd tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Action: 'update_all', calling method: .version_select at 0x7f1e5b75e790>, body: {"tags": ["tempest-tag-1490196976", "tempest-tag-1124157598"]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:53.124303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-0403e770-fa69-4583-bf7e-7906edd2f4cb tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:08:53.129789 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-838c1006-2868-4500-9c5d-495fb2cac2fd tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:53.130328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-838c1006-2868-4500-9c5d-495fb2cac2fd tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:53.130836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-838c1006-2868-4500-9c5d-495fb2cac2fd tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:53.131329 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-838c1006-2868-4500-9c5d-495fb2cac2fd tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:53.137380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-838c1006-2868-4500-9c5d-495fb2cac2fd tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:53.138083 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-838c1006-2868-4500-9c5d-495fb2cac2fd tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:53.138472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-838c1006-2868-4500-9c5d-495fb2cac2fd tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:53.140573 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-838c1006-2868-4500-9c5d-495fb2cac2fd tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:53.140573 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-838c1006-2868-4500-9c5d-495fb2cac2fd tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:53.140573 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-838c1006-2868-4500-9c5d-495fb2cac2fd tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:53.173091 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-838c1006-2868-4500-9c5d-495fb2cac2fd tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:53.173593 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-838c1006-2868-4500-9c5d-495fb2cac2fd tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:53.174160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-838c1006-2868-4500-9c5d-495fb2cac2fd tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:53.178226 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0403e770-fa69-4583-bf7e-7906edd2f4cb tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.133519 Aug 04 17:08:53.178902 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1703/3473] 10.222.0.93 () {58 vars in 1125 bytes} [Thu Aug 4 17:08:53 2022] GET /compute/v2.1/servers => generated 683 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:08:53.186816 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1e167a35-90e4-472c-9b68-983c55233c26 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:53.188590 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1e167a35-90e4-472c-9b68-983c55233c26 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:53.195919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e167a35-90e4-472c-9b68-983c55233c26 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:53.196494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e167a35-90e4-472c-9b68-983c55233c26 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:53.197565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e167a35-90e4-472c-9b68-983c55233c26 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:53.198337 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e167a35-90e4-472c-9b68-983c55233c26 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:53.199681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e167a35-90e4-472c-9b68-983c55233c26 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:53.199832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-838c1006-2868-4500-9c5d-495fb2cac2fd tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lazy-loading 'flavor' on Instance uuid 876d789c-ca99-4545-aab6-371278764e36 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:08:53.199941 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e167a35-90e4-472c-9b68-983c55233c26 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:53.215205 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-838c1006-2868-4500-9c5d-495fb2cac2fd tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "PUT /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags" status: 200 len: 62 microversion: 2.26 time: 0.113439 Aug 04 17:08:53.215848 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1771/3474] 10.222.0.93 () {62 vars in 1312 bytes} [Thu Aug 4 17:08:53 2022] PUT /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags => generated 62 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:53.220313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e1ce5dad-d36b-4f2a-b3ec-273152f6ceaa tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:53.220852 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e1ce5dad-d36b-4f2a-b3ec-273152f6ceaa tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 33022d3d-bb86-401e-98c8-c6f04f3d8959] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:53.226846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1ce5dad-d36b-4f2a-b3ec-273152f6ceaa tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:53.227339 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1ce5dad-d36b-4f2a-b3ec-273152f6ceaa tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:53.227778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1ce5dad-d36b-4f2a-b3ec-273152f6ceaa tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:53.228516 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1ce5dad-d36b-4f2a-b3ec-273152f6ceaa tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:53.228986 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1ce5dad-d36b-4f2a-b3ec-273152f6ceaa tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:53.229395 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1ce5dad-d36b-4f2a-b3ec-273152f6ceaa tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:53.243278 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-e1ce5dad-d36b-4f2a-b3ec-273152f6ceaa tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] HTTP exception thrown: Instance 33022d3d-bb86-401e-98c8-c6f04f3d8959 could not be found. Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e1ce5dad-d36b-4f2a-b3ec-273152f6ceaa tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Request method failure captured: Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/33022d3d-bb86-401e-98c8-c6f04f3d8959 HTTP/1.1 Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_z5mp_Zwqz7Jw4QDMJgpPtcvEspl6J9YjhKIIcbfijhzb7nFmee5qEsZQ-Bejp2XGsqjBw78yv5OUKTkPZV_XKUCyhX1xqcyxx0PuLeLtaxvL_OjxzA5V98q8HCYFA8I7IaOJ-l8WzB4LdZ7fTmxoUYN_Ib_KcU_vTiECUCWq0N1Tw Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: ab1f5e7e1fda4b55a700c49041331f0b Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ListServersNegativeTestJSON-1546379396 Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ab1f5e7e1fda4b55a700c49041331f0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ab1f5e7e1fda4b55a700c49041331f0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ab1f5e7e1fda4b55a700c49041331f0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ab1f5e7e1fda4b55a700c49041331f0b"}]}] Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ListServersNegativeTestJSON-1546379396 Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: ab1f5e7e1fda4b55a700c49041331f0b Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1546379396 Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ListServersNegativeTestJSON-1546379396-project Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: ac5ee766cef74c928c68d72419b64e3e Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ListServersNegativeTestJSON-1546379396-project Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 33022d3d-bb86-401e-98c8-c6f04f3d8959 could not be found. Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '33022d3d-bb86-401e-98c8-c6f04f3d8959'} Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33022d3d-bb86-401e-98c8-c6f04f3d8959 could not be found. Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:08:53.245521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:08:53.249826 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33022d3d-bb86-401e-98c8-c6f04f3d8959 could not be found. Aug 04 17:08:53.249826 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:53.249826 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:08:53.249826 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:53.249826 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:53.249826 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:08:53.249826 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:08:53.249826 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:08:53.249826 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:08:53.249826 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33022d3d-bb86-401e-98c8-c6f04f3d8959 could not be found. Aug 04 17:08:53.249826 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:08:53.249826 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e1ce5dad-d36b-4f2a-b3ec-273152f6ceaa tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Returning 404 to user: Instance 33022d3d-bb86-401e-98c8-c6f04f3d8959 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:08:53.249826 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e1ce5dad-d36b-4f2a-b3ec-273152f6ceaa tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "DELETE /compute/v2.1/servers/33022d3d-bb86-401e-98c8-c6f04f3d8959" status: 404 len: 111 microversion: 2.1 time: 0.030149 Aug 04 17:08:53.249826 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1772/3475] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:08:53 2022] DELETE /compute/v2.1/servers/33022d3d-bb86-401e-98c8-c6f04f3d8959 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:08:53.255347 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b3324afb-e4de-4bbd-a0a6-75e7e34a4711 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '.version_select at 0x7f1e6c9adaf0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:53.263425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3324afb-e4de-4bbd-a0a6-75e7e34a4711 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:53.263958 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3324afb-e4de-4bbd-a0a6-75e7e34a4711 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:53.264399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3324afb-e4de-4bbd-a0a6-75e7e34a4711 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:53.273166 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b3324afb-e4de-4bbd-a0a6-75e7e34a4711 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags" status: 200 len: 62 microversion: 2.26 time: 0.024199 Aug 04 17:08:53.273738 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1773/3476] 10.222.0.93 () {60 vars in 1292 bytes} [Thu Aug 4 17:08:53 2022] GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags => generated 62 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:53.278216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fa5b45bd-92e4-4690-9a7d-2ed5f5eea24e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:53.278953 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fa5b45bd-92e4-4690-9a7d-2ed5f5eea24e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:53.284404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fa5b45bd-92e4-4690-9a7d-2ed5f5eea24e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:53.284889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fa5b45bd-92e4-4690-9a7d-2ed5f5eea24e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:53.285328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fa5b45bd-92e4-4690-9a7d-2ed5f5eea24e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:53.286048 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fa5b45bd-92e4-4690-9a7d-2ed5f5eea24e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:53.286506 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fa5b45bd-92e4-4690-9a7d-2ed5f5eea24e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:53.286930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fa5b45bd-92e4-4690-9a7d-2ed5f5eea24e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:53.522394 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1e167a35-90e4-472c-9b68-983c55233c26 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:53.533997 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1e167a35-90e4-472c-9b68-983c55233c26 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1688 microversion: 2.1 time: 0.353724 Aug 04 17:08:53.549101 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1704/3477] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:53 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1688 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:53.554655 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8ea1726e-81bb-48d3-a8a2-174be32cdc6c tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:53.555167 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8ea1726e-81bb-48d3-a8a2-174be32cdc6c tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 5ad185e4-a5ae-4222-b0d7-9c29ee8a9061] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:53.558231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:53.567667 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ea1726e-81bb-48d3-a8a2-174be32cdc6c tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:53.568433 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ea1726e-81bb-48d3-a8a2-174be32cdc6c tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:53.569185 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ea1726e-81bb-48d3-a8a2-174be32cdc6c tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:53.570190 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ea1726e-81bb-48d3-a8a2-174be32cdc6c tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:53.570827 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ea1726e-81bb-48d3-a8a2-174be32cdc6c tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:53.572226 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ea1726e-81bb-48d3-a8a2-174be32cdc6c tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:53.617826 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8ea1726e-81bb-48d3-a8a2-174be32cdc6c tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 5ad185e4-a5ae-4222-b0d7-9c29ee8a9061] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:08:53.623534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fa5b45bd-92e4-4690-9a7d-2ed5f5eea24e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:53.640206 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fa5b45bd-92e4-4690-9a7d-2ed5f5eea24e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1517 microversion: 2.1 time: 0.365373 Aug 04 17:08:53.641604 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1774/3478] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:53 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1517 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:53.656071 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7855211b-d515-417b-a36d-365cd50ac05a tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '.version_select at 0x7f1e6c9addc0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:53.664265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:53.671695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7855211b-d515-417b-a36d-365cd50ac05a tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:53.672456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7855211b-d515-417b-a36d-365cd50ac05a tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:53.672946 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7855211b-d515-417b-a36d-365cd50ac05a tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:53.673545 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7855211b-d515-417b-a36d-365cd50ac05a tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:53.682087 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7855211b-d515-417b-a36d-365cd50ac05a tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:53.682955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7855211b-d515-417b-a36d-365cd50ac05a tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:53.683645 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7855211b-d515-417b-a36d-365cd50ac05a tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:53.684811 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7855211b-d515-417b-a36d-365cd50ac05a tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:53.685959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7855211b-d515-417b-a36d-365cd50ac05a tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:53.686648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7855211b-d515-417b-a36d-365cd50ac05a tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:53.721831 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7855211b-d515-417b-a36d-365cd50ac05a tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:53.722713 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7855211b-d515-417b-a36d-365cd50ac05a tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:53.723484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7855211b-d515-417b-a36d-365cd50ac05a tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:53.726459 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8ea1726e-81bb-48d3-a8a2-174be32cdc6c tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "DELETE /compute/v2.1/servers/5ad185e4-a5ae-4222-b0d7-9c29ee8a9061" status: 204 len: 0 microversion: 2.1 time: 0.175833 Aug 04 17:08:53.727507 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1705/3479] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:08:53 2022] DELETE /compute/v2.1/servers/5ad185e4-a5ae-4222-b0d7-9c29ee8a9061 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:08:53.749674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a50b8d64-1e87-470d-af4a-e06a015d1de6 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:53.753642 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a50b8d64-1e87-470d-af4a-e06a015d1de6 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:53.769874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-7855211b-d515-417b-a36d-365cd50ac05a tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lazy-loading 'flavor' on Instance uuid 876d789c-ca99-4545-aab6-371278764e36 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:08:53.770373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a50b8d64-1e87-470d-af4a-e06a015d1de6 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:53.771643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a50b8d64-1e87-470d-af4a-e06a015d1de6 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:53.775489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a50b8d64-1e87-470d-af4a-e06a015d1de6 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:53.775489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a50b8d64-1e87-470d-af4a-e06a015d1de6 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:53.776131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a50b8d64-1e87-470d-af4a-e06a015d1de6 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:53.776837 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a50b8d64-1e87-470d-af4a-e06a015d1de6 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:53.789505 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7855211b-d515-417b-a36d-365cd50ac05a tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "DELETE /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags" status: 204 len: 0 microversion: 2.26 time: 0.146460 Aug 04 17:08:53.796242 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1775/3480] 10.222.0.93 () {60 vars in 1295 bytes} [Thu Aug 4 17:08:53 2022] DELETE /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36/tags => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:08:53.804310 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c8664539-23e5-470e-b1df-d906027ce6ba tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:53.804832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c8664539-23e5-470e-b1df-d906027ce6ba tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 70c75b7c-2890-48a2-a7b2-7caf3125a492] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:53.811839 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8664539-23e5-470e-b1df-d906027ce6ba tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:53.812380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8664539-23e5-470e-b1df-d906027ce6ba tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:53.813055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8664539-23e5-470e-b1df-d906027ce6ba tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:53.813782 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8664539-23e5-470e-b1df-d906027ce6ba tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:53.814280 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8664539-23e5-470e-b1df-d906027ce6ba tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:53.814721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8664539-23e5-470e-b1df-d906027ce6ba tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:53.849923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c8664539-23e5-470e-b1df-d906027ce6ba tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 70c75b7c-2890-48a2-a7b2-7caf3125a492] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:08:53.954500 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c8664539-23e5-470e-b1df-d906027ce6ba tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "DELETE /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492" status: 204 len: 0 microversion: 2.1 time: 0.155245 Aug 04 17:08:53.955881 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1776/3481] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:08:53 2022] DELETE /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:08:53.962012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b9144d83-6eac-45be-855c-3cba7d512729 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:53.963611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b9144d83-6eac-45be-855c-3cba7d512729 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:53.970667 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9144d83-6eac-45be-855c-3cba7d512729 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:53.971294 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9144d83-6eac-45be-855c-3cba7d512729 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:53.971852 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9144d83-6eac-45be-855c-3cba7d512729 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:53.972662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9144d83-6eac-45be-855c-3cba7d512729 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:53.973186 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9144d83-6eac-45be-855c-3cba7d512729 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:53.973680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9144d83-6eac-45be-855c-3cba7d512729 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:54.000202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b9144d83-6eac-45be-855c-3cba7d512729 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:08:54.085629 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a50b8d64-1e87-470d-af4a-e06a015d1de6 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:54.089344 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b9144d83-6eac-45be-855c-3cba7d512729 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "DELETE /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36" status: 204 len: 0 microversion: 2.26 time: 0.131921 Aug 04 17:08:54.090952 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1777/3482] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Aug 4 17:08:53 2022] DELETE /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:08:54.095328 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a50b8d64-1e87-470d-af4a-e06a015d1de6 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1505 microversion: 2.1 time: 0.365723 Aug 04 17:08:54.096408 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1706/3483] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:53 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1505 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:54.096997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-f31da83e-2079-490b-a7b3-425ca1226c56 req-19990247-cd56-420e-a57e-6a00ca4c4c91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10991c59-c7d8-447e-8f2b-3f5ea5d8d62a", "name": "network-vif-unplugged", "status": "completed", "tag": "d34d92ed-1a8a-4623-be8e-630b78a99ac4"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:54.103134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b17c5b74-44c2-471f-b461-3d704f595807 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:54.103956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b17c5b74-44c2-471f-b461-3d704f595807 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 33022d3d-bb86-401e-98c8-c6f04f3d8959] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:54.108345 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f31da83e-2079-490b-a7b3-425ca1226c56 req-19990247-cd56-420e-a57e-6a00ca4c4c91 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:54.108868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f31da83e-2079-490b-a7b3-425ca1226c56 req-19990247-cd56-420e-a57e-6a00ca4c4c91 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:54.109307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f31da83e-2079-490b-a7b3-425ca1226c56 req-19990247-cd56-420e-a57e-6a00ca4c4c91 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:54.111817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b17c5b74-44c2-471f-b461-3d704f595807 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:54.112303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b17c5b74-44c2-471f-b461-3d704f595807 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:54.112811 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b17c5b74-44c2-471f-b461-3d704f595807 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:54.113754 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b17c5b74-44c2-471f-b461-3d704f595807 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:54.114109 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b17c5b74-44c2-471f-b461-3d704f595807 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:54.114540 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b17c5b74-44c2-471f-b461-3d704f595807 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:54.121692 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-f31da83e-2079-490b-a7b3-425ca1226c56 req-19990247-cd56-420e-a57e-6a00ca4c4c91 service nova] Creating event network-vif-unplugged:d34d92ed-1a8a-4623-be8e-630b78a99ac4 for instance 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a on n-h1-851359-3 Aug 04 17:08:54.127485 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-f31da83e-2079-490b-a7b3-425ca1226c56 req-19990247-cd56-420e-a57e-6a00ca4c4c91 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035064 Aug 04 17:08:54.128069 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1778/3484] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:54.132960 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-b17c5b74-44c2-471f-b461-3d704f595807 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] HTTP exception thrown: Instance 33022d3d-bb86-401e-98c8-c6f04f3d8959 could not be found. Aug 04 17:08:54.133208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-aa3945bd-4e5d-4919-a298-f3c8b1b1e4ad tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:54.133837 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-aa3945bd-4e5d-4919-a298-f3c8b1b1e4ad tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] [instance: 92a10759-f1cf-452a-9e3e-b2d99944dee4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b17c5b74-44c2-471f-b461-3d704f595807 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Request method failure captured: Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/33022d3d-bb86-401e-98c8-c6f04f3d8959 HTTP/1.1 Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_z5mp_Zwqz7Jw4QDMJgpPtcvEspl6J9YjhKIIcbfijhzb7nFmee5qEsZQ-Bejp2XGsqjBw78yv5OUKTkPZV_XKUCyhX1xqcyxx0PuLeLtaxvL_OjxzA5V98q8HCYFA8I7IaOJ-l8WzB4LdZ7fTmxoUYN_Ib_KcU_vTiECUCWq0N1Tw Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: ab1f5e7e1fda4b55a700c49041331f0b Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ListServersNegativeTestJSON-1546379396 Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ab1f5e7e1fda4b55a700c49041331f0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ab1f5e7e1fda4b55a700c49041331f0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ab1f5e7e1fda4b55a700c49041331f0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ab1f5e7e1fda4b55a700c49041331f0b"}]}] Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ListServersNegativeTestJSON-1546379396 Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: ab1f5e7e1fda4b55a700c49041331f0b Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1546379396 Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ListServersNegativeTestJSON-1546379396-project Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: ac5ee766cef74c928c68d72419b64e3e Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ListServersNegativeTestJSON-1546379396-project Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 33022d3d-bb86-401e-98c8-c6f04f3d8959 could not be found. Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '33022d3d-bb86-401e-98c8-c6f04f3d8959'} Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33022d3d-bb86-401e-98c8-c6f04f3d8959 could not be found. Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33022d3d-bb86-401e-98c8-c6f04f3d8959 could not be found. Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:08:54.135468 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:08:54.139534 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:08:54.139534 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:08:54.139534 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:08:54.139534 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:08:54.139534 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:08:54.139534 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:08:54.139534 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33022d3d-bb86-401e-98c8-c6f04f3d8959 could not be found. Aug 04 17:08:54.139534 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:08:54.139534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b17c5b74-44c2-471f-b461-3d704f595807 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Returning 404 to user: Instance 33022d3d-bb86-401e-98c8-c6f04f3d8959 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:08:54.139534 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b17c5b74-44c2-471f-b461-3d704f595807 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers/33022d3d-bb86-401e-98c8-c6f04f3d8959" status: 404 len: 111 microversion: 2.1 time: 0.039160 Aug 04 17:08:54.139534 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1707/3485] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:54 2022] GET /compute/v2.1/servers/33022d3d-bb86-401e-98c8-c6f04f3d8959 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:08:54.141205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa3945bd-4e5d-4919-a298-f3c8b1b1e4ad tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:54.141837 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa3945bd-4e5d-4919-a298-f3c8b1b1e4ad tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:54.142362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa3945bd-4e5d-4919-a298-f3c8b1b1e4ad tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:54.143116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d2a471c9-e03a-4624-abb6-ecf9909f89d0 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:54.143253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa3945bd-4e5d-4919-a298-f3c8b1b1e4ad tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:54.143587 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa3945bd-4e5d-4919-a298-f3c8b1b1e4ad tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:54.143803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d2a471c9-e03a-4624-abb6-ecf9909f89d0 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:54.144067 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa3945bd-4e5d-4919-a298-f3c8b1b1e4ad tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:54.152189 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2a471c9-e03a-4624-abb6-ecf9909f89d0 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:54.152694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2a471c9-e03a-4624-abb6-ecf9909f89d0 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:54.153146 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2a471c9-e03a-4624-abb6-ecf9909f89d0 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:54.153876 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2a471c9-e03a-4624-abb6-ecf9909f89d0 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:54.154458 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2a471c9-e03a-4624-abb6-ecf9909f89d0 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:54.154892 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2a471c9-e03a-4624-abb6-ecf9909f89d0 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:54.754586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d2a471c9-e03a-4624-abb6-ecf9909f89d0 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:54.763661 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d2a471c9-e03a-4624-abb6-ecf9909f89d0 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:54.765164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d2a471c9-e03a-4624-abb6-ecf9909f89d0 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:54.767188 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d2a471c9-e03a-4624-abb6-ecf9909f89d0 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36" status: 200 len: 1551 microversion: 2.26 time: 0.627542 Aug 04 17:08:54.769968 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1708/3486] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:08:54 2022] GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36 => generated 1551 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:08:54.771168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-aa3945bd-4e5d-4919-a298-f3c8b1b1e4ad tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae7d4debce6463999584b08b482d05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3847ca33d14d96b7df887796cf7f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:54.779378 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-aa3945bd-4e5d-4919-a298-f3c8b1b1e4ad tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] 10.222.0.93 "GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4" status: 200 len: 1503 microversion: 2.1 time: 0.650183 Aug 04 17:08:54.783124 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1779/3487] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:54 2022] GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4 => generated 1503 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:54.801230 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-80b46236-c98a-40aa-9ec5-d4398788584e tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:54.801968 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-80b46236-c98a-40aa-9ec5-d4398788584e tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 5ad185e4-a5ae-4222-b0d7-9c29ee8a9061] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:54.803696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fc3b79c0-20dd-41ad-b649-22e26dfd9e66 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:54.807257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fc3b79c0-20dd-41ad-b649-22e26dfd9e66 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:54.812459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80b46236-c98a-40aa-9ec5-d4398788584e tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:54.814976 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80b46236-c98a-40aa-9ec5-d4398788584e tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:54.816153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80b46236-c98a-40aa-9ec5-d4398788584e tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:54.818538 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc3b79c0-20dd-41ad-b649-22e26dfd9e66 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:54.818688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80b46236-c98a-40aa-9ec5-d4398788584e tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:54.819508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc3b79c0-20dd-41ad-b649-22e26dfd9e66 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:54.820063 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc3b79c0-20dd-41ad-b649-22e26dfd9e66 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:54.820186 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80b46236-c98a-40aa-9ec5-d4398788584e tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:54.820689 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80b46236-c98a-40aa-9ec5-d4398788584e tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:54.821022 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc3b79c0-20dd-41ad-b649-22e26dfd9e66 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:54.821832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc3b79c0-20dd-41ad-b649-22e26dfd9e66 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:54.822207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc3b79c0-20dd-41ad-b649-22e26dfd9e66 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:55.141282 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-80b46236-c98a-40aa-9ec5-d4398788584e tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:55.148041 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fc3b79c0-20dd-41ad-b649-22e26dfd9e66 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:55.149237 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-80b46236-c98a-40aa-9ec5-d4398788584e tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers/5ad185e4-a5ae-4222-b0d7-9c29ee8a9061" status: 200 len: 1522 microversion: 2.1 time: 0.368165 Aug 04 17:08:55.149825 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1709/3488] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:54 2022] GET /compute/v2.1/servers/5ad185e4-a5ae-4222-b0d7-9c29ee8a9061 => generated 1522 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:55.155333 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-654b6f5a-71e5-4035-8ba0-d49cb83f6278 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:55.155945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-654b6f5a-71e5-4035-8ba0-d49cb83f6278 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:55.158285 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fc3b79c0-20dd-41ad-b649-22e26dfd9e66 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1688 microversion: 2.1 time: 0.362226 Aug 04 17:08:55.159458 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1780/3489] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:54 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1688 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:55.171314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-654b6f5a-71e5-4035-8ba0-d49cb83f6278 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:55.171854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-654b6f5a-71e5-4035-8ba0-d49cb83f6278 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:55.172331 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-654b6f5a-71e5-4035-8ba0-d49cb83f6278 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:55.176070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-654b6f5a-71e5-4035-8ba0-d49cb83f6278 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:55.176070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-654b6f5a-71e5-4035-8ba0-d49cb83f6278 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:55.176070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-654b6f5a-71e5-4035-8ba0-d49cb83f6278 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:55.179841 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e13abd8a-b6a3-456e-9241-2fa611c6d16a tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:55.182901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e13abd8a-b6a3-456e-9241-2fa611c6d16a tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] [instance: 92a10759-f1cf-452a-9e3e-b2d99944dee4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:55.189251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e13abd8a-b6a3-456e-9241-2fa611c6d16a tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:55.189888 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e13abd8a-b6a3-456e-9241-2fa611c6d16a tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:55.190486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e13abd8a-b6a3-456e-9241-2fa611c6d16a tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:55.191337 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e13abd8a-b6a3-456e-9241-2fa611c6d16a tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:55.191914 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e13abd8a-b6a3-456e-9241-2fa611c6d16a tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:55.192730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e13abd8a-b6a3-456e-9241-2fa611c6d16a tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:55.273465 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e13abd8a-b6a3-456e-9241-2fa611c6d16a tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] 10.222.0.93 "DELETE /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.101597 Aug 04 17:08:55.274098 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1781/3490] 10.222.0.93 () {58 vars in 1296 bytes} [Thu Aug 4 17:08:55 2022] DELETE /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4/os-server-password => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:08:55.279227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-76053560-8e25-4e8e-b86d-4cc164957e1e tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:55.279838 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-76053560-8e25-4e8e-b86d-4cc164957e1e tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:55.286543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76053560-8e25-4e8e-b86d-4cc164957e1e tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:55.286686 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76053560-8e25-4e8e-b86d-4cc164957e1e tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:55.287752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76053560-8e25-4e8e-b86d-4cc164957e1e tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:55.288456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76053560-8e25-4e8e-b86d-4cc164957e1e tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:55.288923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76053560-8e25-4e8e-b86d-4cc164957e1e tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:55.289352 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76053560-8e25-4e8e-b86d-4cc164957e1e tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:55.304868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=88,nova_cell1:DELETE=2,nova_cell1:INSERT=7,nova_cell1:UPDATE=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:55.519040 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-654b6f5a-71e5-4035-8ba0-d49cb83f6278 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:55.540004 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-654b6f5a-71e5-4035-8ba0-d49cb83f6278 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1517 microversion: 2.1 time: 0.388376 Aug 04 17:08:55.541686 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1710/3491] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:55 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1517 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:55.550381 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8660b94a-4286-4388-bcbb-8766e870ce56 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:55.551119 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8660b94a-4286-4388-bcbb-8766e870ce56 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] [instance: 92a10759-f1cf-452a-9e3e-b2d99944dee4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:55.558971 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8660b94a-4286-4388-bcbb-8766e870ce56 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:55.559756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8660b94a-4286-4388-bcbb-8766e870ce56 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:55.560467 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8660b94a-4286-4388-bcbb-8766e870ce56 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:55.561296 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8660b94a-4286-4388-bcbb-8766e870ce56 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:55.578233 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-76053560-8e25-4e8e-b86d-4cc164957e1e tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:55.582391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8660b94a-4286-4388-bcbb-8766e870ce56 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:55.586203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8660b94a-4286-4388-bcbb-8766e870ce56 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:55.589087 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-76053560-8e25-4e8e-b86d-4cc164957e1e tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1505 microversion: 2.1 time: 0.313921 Aug 04 17:08:55.589958 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1782/3492] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:55 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1505 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:55.626508 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8660b94a-4286-4388-bcbb-8766e870ce56 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] 10.222.0.93 "GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.083176 Aug 04 17:08:55.627131 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1711/3493] 10.222.0.93 () {58 vars in 1293 bytes} [Thu Aug 4 17:08:55 2022] GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4/os-server-password => generated 16 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:08:55.648078 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c94c7fdc-2969-4dde-86cd-7b0c6e8b6132 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:55.649471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c94c7fdc-2969-4dde-86cd-7b0c6e8b6132 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] [instance: 92a10759-f1cf-452a-9e3e-b2d99944dee4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:55.659555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c94c7fdc-2969-4dde-86cd-7b0c6e8b6132 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:55.661045 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c94c7fdc-2969-4dde-86cd-7b0c6e8b6132 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:55.661588 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c94c7fdc-2969-4dde-86cd-7b0c6e8b6132 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:55.662529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c94c7fdc-2969-4dde-86cd-7b0c6e8b6132 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:55.663008 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c94c7fdc-2969-4dde-86cd-7b0c6e8b6132 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:55.663592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c94c7fdc-2969-4dde-86cd-7b0c6e8b6132 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:55.694181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c94c7fdc-2969-4dde-86cd-7b0c6e8b6132 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] [instance: 92a10759-f1cf-452a-9e3e-b2d99944dee4] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:08:55.783843 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c94c7fdc-2969-4dde-86cd-7b0c6e8b6132 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] 10.222.0.93 "DELETE /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4" status: 204 len: 0 microversion: 2.1 time: 0.148564 Aug 04 17:08:55.788927 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1783/3494] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:08:55 2022] DELETE /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:08:55.794173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a2c027e1-8030-4b03-989e-3eb9c6b78276 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:55.794841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a2c027e1-8030-4b03-989e-3eb9c6b78276 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:55.798398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-43e2a9f6-e025-4e6c-a32b-0ae292736ab8 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:55.799613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-43e2a9f6-e025-4e6c-a32b-0ae292736ab8 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] [instance: 92a10759-f1cf-452a-9e3e-b2d99944dee4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:55.805795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2c027e1-8030-4b03-989e-3eb9c6b78276 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:55.806909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2c027e1-8030-4b03-989e-3eb9c6b78276 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:55.807273 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-43e2a9f6-e025-4e6c-a32b-0ae292736ab8 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:55.807408 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2c027e1-8030-4b03-989e-3eb9c6b78276 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:55.807975 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-43e2a9f6-e025-4e6c-a32b-0ae292736ab8 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:55.808097 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2c027e1-8030-4b03-989e-3eb9c6b78276 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:55.808586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2c027e1-8030-4b03-989e-3eb9c6b78276 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:55.808722 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-43e2a9f6-e025-4e6c-a32b-0ae292736ab8 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:55.809027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2c027e1-8030-4b03-989e-3eb9c6b78276 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:55.811017 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-43e2a9f6-e025-4e6c-a32b-0ae292736ab8 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:55.811600 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-43e2a9f6-e025-4e6c-a32b-0ae292736ab8 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:55.812170 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-43e2a9f6-e025-4e6c-a32b-0ae292736ab8 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:56.104241 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-43e2a9f6-e025-4e6c-a32b-0ae292736ab8 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae7d4debce6463999584b08b482d05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3847ca33d14d96b7df887796cf7f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:56.110393 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a2c027e1-8030-4b03-989e-3eb9c6b78276 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:56.117475 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-43e2a9f6-e025-4e6c-a32b-0ae292736ab8 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] 10.222.0.93 "GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4" status: 200 len: 1509 microversion: 2.1 time: 0.326026 Aug 04 17:08:56.126451 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1784/3495] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:55 2022] GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4 => generated 1509 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:56.131520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a2c027e1-8030-4b03-989e-3eb9c6b78276 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:56.133517 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a2c027e1-8030-4b03-989e-3eb9c6b78276 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:56.135133 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a2c027e1-8030-4b03-989e-3eb9c6b78276 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36" status: 200 len: 1551 microversion: 2.26 time: 0.345946 Aug 04 17:08:56.135784 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1712/3496] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:08:55 2022] GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36 => generated 1551 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:08:56.171742 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e2fad18e-ae97-40e7-9acc-7f5ee2fd3e1b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:56.172377 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e2fad18e-ae97-40e7-9acc-7f5ee2fd3e1b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 5ad185e4-a5ae-4222-b0d7-9c29ee8a9061] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:56.187645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-16812d0b-03a6-451b-948c-730d1fbd2491 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:56.194886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2fad18e-ae97-40e7-9acc-7f5ee2fd3e1b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:56.195604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-16812d0b-03a6-451b-948c-730d1fbd2491 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:56.200055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2fad18e-ae97-40e7-9acc-7f5ee2fd3e1b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:56.200546 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2fad18e-ae97-40e7-9acc-7f5ee2fd3e1b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:56.201302 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2fad18e-ae97-40e7-9acc-7f5ee2fd3e1b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:56.201780 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2fad18e-ae97-40e7-9acc-7f5ee2fd3e1b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:56.202248 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2fad18e-ae97-40e7-9acc-7f5ee2fd3e1b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:56.208971 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16812d0b-03a6-451b-948c-730d1fbd2491 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:56.209281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16812d0b-03a6-451b-948c-730d1fbd2491 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:56.213033 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16812d0b-03a6-451b-948c-730d1fbd2491 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:56.213778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16812d0b-03a6-451b-948c-730d1fbd2491 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:56.219575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16812d0b-03a6-451b-948c-730d1fbd2491 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:56.220345 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16812d0b-03a6-451b-948c-730d1fbd2491 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:56.526184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-16812d0b-03a6-451b-948c-730d1fbd2491 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:56.535528 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-16812d0b-03a6-451b-948c-730d1fbd2491 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1688 microversion: 2.1 time: 0.355510 Aug 04 17:08:56.549647 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1713/3497] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:56 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1688 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:08:56.561723 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bfefc074-da79-4a5b-acab-8a26b5ee2cf5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:56.562656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bfefc074-da79-4a5b-acab-8a26b5ee2cf5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:56.570654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bfefc074-da79-4a5b-acab-8a26b5ee2cf5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:56.571449 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bfefc074-da79-4a5b-acab-8a26b5ee2cf5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:56.572777 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bfefc074-da79-4a5b-acab-8a26b5ee2cf5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:56.573705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bfefc074-da79-4a5b-acab-8a26b5ee2cf5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:56.576422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bfefc074-da79-4a5b-acab-8a26b5ee2cf5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:56.577052 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bfefc074-da79-4a5b-acab-8a26b5ee2cf5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:56.577502 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e2fad18e-ae97-40e7-9acc-7f5ee2fd3e1b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:56.586462 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e2fad18e-ae97-40e7-9acc-7f5ee2fd3e1b tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers/5ad185e4-a5ae-4222-b0d7-9c29ee8a9061" status: 200 len: 1522 microversion: 2.1 time: 0.418586 Aug 04 17:08:56.598802 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1785/3498] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:56 2022] GET /compute/v2.1/servers/5ad185e4-a5ae-4222-b0d7-9c29ee8a9061 => generated 1522 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:56.611817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-55004813-90e6-462c-80e7-6dbf7144ab4b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:56.612461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-55004813-90e6-462c-80e7-6dbf7144ab4b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:56.620260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-55004813-90e6-462c-80e7-6dbf7144ab4b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:56.621174 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-55004813-90e6-462c-80e7-6dbf7144ab4b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:56.621632 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-55004813-90e6-462c-80e7-6dbf7144ab4b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:56.622505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-55004813-90e6-462c-80e7-6dbf7144ab4b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:56.622979 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-55004813-90e6-462c-80e7-6dbf7144ab4b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:56.623421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-55004813-90e6-462c-80e7-6dbf7144ab4b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:56.907924 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bfefc074-da79-4a5b-acab-8a26b5ee2cf5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:56.915723 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bfefc074-da79-4a5b-acab-8a26b5ee2cf5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1517 microversion: 2.1 time: 0.358610 Aug 04 17:08:56.916316 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1714/3499] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:56 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1517 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:56.941250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-55004813-90e6-462c-80e7-6dbf7144ab4b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:56.949850 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-55004813-90e6-462c-80e7-6dbf7144ab4b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1505 microversion: 2.1 time: 0.343395 Aug 04 17:08:56.950474 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1786/3500] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:56 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1505 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:08:57.143172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-25987661-327b-4def-a33c-51d3cf026a79 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:57.144702 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-25987661-327b-4def-a33c-51d3cf026a79 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] [instance: 92a10759-f1cf-452a-9e3e-b2d99944dee4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:57.152298 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25987661-327b-4def-a33c-51d3cf026a79 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:57.152948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25987661-327b-4def-a33c-51d3cf026a79 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:57.159442 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c4233e81-7459-49b1-842f-fa7069614c15 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:57.160502 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c4233e81-7459-49b1-842f-fa7069614c15 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:57.167076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4233e81-7459-49b1-842f-fa7069614c15 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:57.167882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25987661-327b-4def-a33c-51d3cf026a79 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:57.169699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25987661-327b-4def-a33c-51d3cf026a79 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:57.169928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25987661-327b-4def-a33c-51d3cf026a79 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:57.170630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25987661-327b-4def-a33c-51d3cf026a79 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:57.172385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4233e81-7459-49b1-842f-fa7069614c15 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:57.176939 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4233e81-7459-49b1-842f-fa7069614c15 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:57.181613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4233e81-7459-49b1-842f-fa7069614c15 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:57.182371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4233e81-7459-49b1-842f-fa7069614c15 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:57.183042 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4233e81-7459-49b1-842f-fa7069614c15 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:57.728733 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-25987661-327b-4def-a33c-51d3cf026a79 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae7d4debce6463999584b08b482d05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3847ca33d14d96b7df887796cf7f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:57.740126 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-25987661-327b-4def-a33c-51d3cf026a79 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] 10.222.0.93 "GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4" status: 200 len: 1509 microversion: 2.1 time: 0.603525 Aug 04 17:08:57.742354 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1715/3501] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:57 2022] GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4 => generated 1509 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:57.759314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9344daaf-14e6-4d47-93d5-46aa2c618c17 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:57.760221 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9344daaf-14e6-4d47-93d5-46aa2c618c17 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:57.780222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9344daaf-14e6-4d47-93d5-46aa2c618c17 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:57.783046 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9344daaf-14e6-4d47-93d5-46aa2c618c17 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:57.784478 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9344daaf-14e6-4d47-93d5-46aa2c618c17 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:57.785844 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9344daaf-14e6-4d47-93d5-46aa2c618c17 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:57.787406 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9344daaf-14e6-4d47-93d5-46aa2c618c17 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:57.788028 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9344daaf-14e6-4d47-93d5-46aa2c618c17 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:57.801064 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c4233e81-7459-49b1-842f-fa7069614c15 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:57.832178 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c4233e81-7459-49b1-842f-fa7069614c15 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:57.839688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c4233e81-7459-49b1-842f-fa7069614c15 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '737beb9600d343b6a63ce3bff3089def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea46c96425f849fe87806cbbea8f070f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:57.843405 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c4233e81-7459-49b1-842f-fa7069614c15 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36" status: 200 len: 1551 microversion: 2.26 time: 0.687603 Aug 04 17:08:57.848093 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1787/3502] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:08:57 2022] GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36 => generated 1551 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:08:57.870850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-53f3087c-12fe-4f87-9fbb-77e73f0af507 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:57.873382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-53f3087c-12fe-4f87-9fbb-77e73f0af507 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 5ad185e4-a5ae-4222-b0d7-9c29ee8a9061] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:57.904567 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53f3087c-12fe-4f87-9fbb-77e73f0af507 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:57.905096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53f3087c-12fe-4f87-9fbb-77e73f0af507 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:57.905554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53f3087c-12fe-4f87-9fbb-77e73f0af507 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:57.908986 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53f3087c-12fe-4f87-9fbb-77e73f0af507 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:57.910047 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53f3087c-12fe-4f87-9fbb-77e73f0af507 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:57.912046 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53f3087c-12fe-4f87-9fbb-77e73f0af507 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:58.446296 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-53f3087c-12fe-4f87-9fbb-77e73f0af507 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5ee766cef74c928c68d72419b64e3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab1f5e7e1fda4b55a700c49041331f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:58.470987 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-53f3087c-12fe-4f87-9fbb-77e73f0af507 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers/5ad185e4-a5ae-4222-b0d7-9c29ee8a9061" status: 200 len: 1480 microversion: 2.1 time: 0.618562 Aug 04 17:08:58.472419 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1788/3503] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:57 2022] GET /compute/v2.1/servers/5ad185e4-a5ae-4222-b0d7-9c29ee8a9061 => generated 1480 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:58.483987 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-aa96f82d-461b-4cea-9006-8442a7a40621 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:58.484903 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-aa96f82d-461b-4cea-9006-8442a7a40621 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:58.492492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:08:58.497287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa96f82d-461b-4cea-9006-8442a7a40621 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:58.498185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa96f82d-461b-4cea-9006-8442a7a40621 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:58.498850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa96f82d-461b-4cea-9006-8442a7a40621 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:58.499766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa96f82d-461b-4cea-9006-8442a7a40621 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:58.500402 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa96f82d-461b-4cea-9006-8442a7a40621 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:58.500997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa96f82d-461b-4cea-9006-8442a7a40621 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:59.137401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9344daaf-14e6-4d47-93d5-46aa2c618c17 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:59.155072 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9344daaf-14e6-4d47-93d5-46aa2c618c17 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1683 microversion: 2.1 time: 1.408925 Aug 04 17:08:59.157424 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1716/3504] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:57 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1683 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:59.162887 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dee34b60-f18f-4027-91ea-049ade972340 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:59.163783 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dee34b60-f18f-4027-91ea-049ade972340 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:59.180159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dee34b60-f18f-4027-91ea-049ade972340 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:59.180725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dee34b60-f18f-4027-91ea-049ade972340 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:59.181942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dee34b60-f18f-4027-91ea-049ade972340 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:59.182909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dee34b60-f18f-4027-91ea-049ade972340 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:59.183713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dee34b60-f18f-4027-91ea-049ade972340 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:59.184409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dee34b60-f18f-4027-91ea-049ade972340 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:59.653520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-aa96f82d-461b-4cea-9006-8442a7a40621 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:08:59.699941 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-aa96f82d-461b-4cea-9006-8442a7a40621 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1517 microversion: 2.1 time: 1.223586 Aug 04 17:08:59.701469 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1789/3505] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:58 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1517 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:08:59.714328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-db6496a9-c211-4a8b-b8f0-ce65b85ed017 req-daa4183a-5a7e-4da0-8ca9-b86234d2f0a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ad185e4-a5ae-4222-b0d7-9c29ee8a9061", "name": "network-vif-deleted", "tag": "f7b26e84-5e02-418a-9944-239997927fe9"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:59.741038 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-db6496a9-c211-4a8b-b8f0-ce65b85ed017 req-daa4183a-5a7e-4da0-8ca9-b86234d2f0a9 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:59.742260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-db6496a9-c211-4a8b-b8f0-ce65b85ed017 req-daa4183a-5a7e-4da0-8ca9-b86234d2f0a9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:59.742923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-db6496a9-c211-4a8b-b8f0-ce65b85ed017 req-daa4183a-5a7e-4da0-8ca9-b86234d2f0a9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:59.768030 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-db6496a9-c211-4a8b-b8f0-ce65b85ed017 req-daa4183a-5a7e-4da0-8ca9-b86234d2f0a9 service nova] Creating event network-vif-deleted:f7b26e84-5e02-418a-9944-239997927fe9 for instance 5ad185e4-a5ae-4222-b0d7-9c29ee8a9061 on n-h1-851359-3 Aug 04 17:08:59.774937 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-db6496a9-c211-4a8b-b8f0-ce65b85ed017 req-daa4183a-5a7e-4da0-8ca9-b86234d2f0a9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071664 Aug 04 17:08:59.776318 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1790/3506] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:59.786361 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-8f05573a-12cc-4e1d-8cc2-a08c63443f06 req-c898c48f-d50c-44f9-b608-a83566f5446f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10991c59-c7d8-447e-8f2b-3f5ea5d8d62a", "name": "network-vif-plugged", "status": "completed", "tag": "d34d92ed-1a8a-4623-be8e-630b78a99ac4"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:08:59.804988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8f05573a-12cc-4e1d-8cc2-a08c63443f06 req-c898c48f-d50c-44f9-b608-a83566f5446f service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:59.805837 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8f05573a-12cc-4e1d-8cc2-a08c63443f06 req-c898c48f-d50c-44f9-b608-a83566f5446f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:59.806586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8f05573a-12cc-4e1d-8cc2-a08c63443f06 req-c898c48f-d50c-44f9-b608-a83566f5446f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:59.825457 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-8f05573a-12cc-4e1d-8cc2-a08c63443f06 req-c898c48f-d50c-44f9-b608-a83566f5446f service nova] Creating event network-vif-plugged:d34d92ed-1a8a-4623-be8e-630b78a99ac4 for instance 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a on n-h1-851359-3 Aug 04 17:08:59.831662 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-8f05573a-12cc-4e1d-8cc2-a08c63443f06 req-c898c48f-d50c-44f9-b608-a83566f5446f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051555 Aug 04 17:08:59.832884 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1791/3507] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:08:59.842858 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-57645de7-1ee3-46be-b01e-653051e701a7 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:08:59.843938 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-57645de7-1ee3-46be-b01e-653051e701a7 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] [instance: 92a10759-f1cf-452a-9e3e-b2d99944dee4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:08:59.852103 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57645de7-1ee3-46be-b01e-653051e701a7 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:59.853407 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57645de7-1ee3-46be-b01e-653051e701a7 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:59.854213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57645de7-1ee3-46be-b01e-653051e701a7 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:08:59.855954 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57645de7-1ee3-46be-b01e-653051e701a7 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:08:59.857877 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57645de7-1ee3-46be-b01e-653051e701a7 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:08:59.858612 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57645de7-1ee3-46be-b01e-653051e701a7 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:00.008853 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dee34b60-f18f-4027-91ea-049ade972340 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:00.027037 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dee34b60-f18f-4027-91ea-049ade972340 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1505 microversion: 2.1 time: 0.868190 Aug 04 17:09:00.027943 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1717/3508] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:59 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1505 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:00.032517 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-54139634-b3d7-4898-9167-12461106a919 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:00.033138 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-54139634-b3d7-4898-9167-12461106a919 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] [instance: 876d789c-ca99-4545-aab6-371278764e36] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:00.049154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54139634-b3d7-4898-9167-12461106a919 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:00.049667 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54139634-b3d7-4898-9167-12461106a919 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:00.052110 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54139634-b3d7-4898-9167-12461106a919 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:00.052867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54139634-b3d7-4898-9167-12461106a919 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:00.053375 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54139634-b3d7-4898-9167-12461106a919 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:00.053791 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54139634-b3d7-4898-9167-12461106a919 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:00.080496 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-54139634-b3d7-4898-9167-12461106a919 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] HTTP exception thrown: Instance 876d789c-ca99-4545-aab6-371278764e36 could not be found. Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-54139634-b3d7-4898-9167-12461106a919 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Request method failure captured: Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36 HTTP/1.1 Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_0C3SJZA4A-W4YcGT2XUve8JS1QSYO6AYLMxNla3nV1_wxsNvYfQyMWQxiOtdJD8BMIuafET93cKo9ilp5sAIpMTUKwj5o3B95EBDVXYY1WIWeJgQw6IWGCDLzxNl3MhQ9ow8Xt6FMjLBzNN5yw2vxmuB-M8Zn7oKLkaSw7c_rAOSI Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.26 Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: ea46c96425f849fe87806cbbea8f070f Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerTagsTestJSON-990894476 Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ea46c96425f849fe87806cbbea8f070f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ea46c96425f849fe87806cbbea8f070f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ea46c96425f849fe87806cbbea8f070f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ea46c96425f849fe87806cbbea8f070f"}]}] Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServerTagsTestJSON-990894476 Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: ea46c96425f849fe87806cbbea8f070f Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerTagsTestJSON-990894476 Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServerTagsTestJSON-990894476-project Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 737beb9600d343b6a63ce3bff3089def Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServerTagsTestJSON-990894476-project Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 876d789c-ca99-4545-aab6-371278764e36 could not be found. Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '876d789c-ca99-4545-aab6-371278764e36'} Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 876d789c-ca99-4545-aab6-371278764e36 could not be found. Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 876d789c-ca99-4545-aab6-371278764e36 could not be found. Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:09:00.096807 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:09:00.101658 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:09:00.101658 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:09:00.101658 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:09:00.101658 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:09:00.101658 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:09:00.101658 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 876d789c-ca99-4545-aab6-371278764e36 could not be found. Aug 04 17:09:00.101658 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:09:00.103202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-54139634-b3d7-4898-9167-12461106a919 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] Returning 404 to user: Instance 876d789c-ca99-4545-aab6-371278764e36 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:09:00.114376 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-54139634-b3d7-4898-9167-12461106a919 tempest-ServerTagsTestJSON-990894476 tempest-ServerTagsTestJSON-990894476-project] 10.222.0.93 "GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36" status: 404 len: 111 microversion: 2.26 time: 0.085261 Aug 04 17:09:00.115504 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1718/3509] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:09:00 2022] GET /compute/v2.1/servers/876d789c-ca99-4545-aab6-371278764e36 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:09:00.134791 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b6921660-42ee-4bfb-990b-cded9f357449 req-694bf088-3831-4cfc-b77f-c89e64cecc3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "876d789c-ca99-4545-aab6-371278764e36", "name": "network-vif-deleted", "tag": "60029b7a-10b9-4bcf-9309-fc524eb04b5e"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:00.162616 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b6921660-42ee-4bfb-990b-cded9f357449 req-694bf088-3831-4cfc-b77f-c89e64cecc3b service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:00.170707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b6921660-42ee-4bfb-990b-cded9f357449 req-694bf088-3831-4cfc-b77f-c89e64cecc3b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:00.171163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b6921660-42ee-4bfb-990b-cded9f357449 req-694bf088-3831-4cfc-b77f-c89e64cecc3b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:00.196372 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b6921660-42ee-4bfb-990b-cded9f357449 req-694bf088-3831-4cfc-b77f-c89e64cecc3b service nova] Creating event network-vif-deleted:60029b7a-10b9-4bcf-9309-fc524eb04b5e for instance 876d789c-ca99-4545-aab6-371278764e36 on n-h1-851359-3 Aug 04 17:09:00.210314 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b6921660-42ee-4bfb-990b-cded9f357449 req-694bf088-3831-4cfc-b77f-c89e64cecc3b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093059 Aug 04 17:09:00.213560 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1719/3510] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:09:00.220527 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-741807e9-6b53-44f3-9d0e-20fdc4608314 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:00.221242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-741807e9-6b53-44f3-9d0e-20fdc4608314 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 5ad185e4-a5ae-4222-b0d7-9c29ee8a9061] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:00.237146 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-741807e9-6b53-44f3-9d0e-20fdc4608314 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:00.237654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-741807e9-6b53-44f3-9d0e-20fdc4608314 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:00.239858 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-741807e9-6b53-44f3-9d0e-20fdc4608314 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:00.240627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-741807e9-6b53-44f3-9d0e-20fdc4608314 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:00.241286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-741807e9-6b53-44f3-9d0e-20fdc4608314 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:00.241893 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-741807e9-6b53-44f3-9d0e-20fdc4608314 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:00.275886 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-741807e9-6b53-44f3-9d0e-20fdc4608314 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] HTTP exception thrown: Instance 5ad185e4-a5ae-4222-b0d7-9c29ee8a9061 could not be found. Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-741807e9-6b53-44f3-9d0e-20fdc4608314 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Request method failure captured: Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/5ad185e4-a5ae-4222-b0d7-9c29ee8a9061 HTTP/1.1 Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_z5mp_Zwqz7Jw4QDMJgpPtcvEspl6J9YjhKIIcbfijhzb7nFmee5qEsZQ-Bejp2XGsqjBw78yv5OUKTkPZV_XKUCyhX1xqcyxx0PuLeLtaxvL_OjxzA5V98q8HCYFA8I7IaOJ-l8WzB4LdZ7fTmxoUYN_Ib_KcU_vTiECUCWq0N1Tw Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: ab1f5e7e1fda4b55a700c49041331f0b Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ListServersNegativeTestJSON-1546379396 Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ab1f5e7e1fda4b55a700c49041331f0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ab1f5e7e1fda4b55a700c49041331f0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ab1f5e7e1fda4b55a700c49041331f0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ab1f5e7e1fda4b55a700c49041331f0b"}]}] Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ListServersNegativeTestJSON-1546379396 Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: ab1f5e7e1fda4b55a700c49041331f0b Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1546379396 Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ListServersNegativeTestJSON-1546379396-project Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: ac5ee766cef74c928c68d72419b64e3e Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ListServersNegativeTestJSON-1546379396-project Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 5ad185e4-a5ae-4222-b0d7-9c29ee8a9061 could not be found. Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '5ad185e4-a5ae-4222-b0d7-9c29ee8a9061'} Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ad185e4-a5ae-4222-b0d7-9c29ee8a9061 could not be found. Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ad185e4-a5ae-4222-b0d7-9c29ee8a9061 could not be found. Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:09:00.277947 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:09:00.282726 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:09:00.282726 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:09:00.282726 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:09:00.282726 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:09:00.282726 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:09:00.282726 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:09:00.282726 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ad185e4-a5ae-4222-b0d7-9c29ee8a9061 could not be found. Aug 04 17:09:00.282726 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:09:00.284025 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-741807e9-6b53-44f3-9d0e-20fdc4608314 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Returning 404 to user: Instance 5ad185e4-a5ae-4222-b0d7-9c29ee8a9061 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:09:00.285052 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-741807e9-6b53-44f3-9d0e-20fdc4608314 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers/5ad185e4-a5ae-4222-b0d7-9c29ee8a9061" status: 404 len: 111 microversion: 2.1 time: 0.070331 Aug 04 17:09:00.286133 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1720/3511] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:00 2022] GET /compute/v2.1/servers/5ad185e4-a5ae-4222-b0d7-9c29ee8a9061 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:09:00.291617 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1f3ce942-eb57-4921-a47b-b3994d5acafd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:00.292462 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1f3ce942-eb57-4921-a47b-b3994d5acafd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:00.299743 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f3ce942-eb57-4921-a47b-b3994d5acafd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:00.300442 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f3ce942-eb57-4921-a47b-b3994d5acafd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:00.301126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f3ce942-eb57-4921-a47b-b3994d5acafd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:00.302035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f3ce942-eb57-4921-a47b-b3994d5acafd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:00.302656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f3ce942-eb57-4921-a47b-b3994d5acafd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:00.303245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f3ce942-eb57-4921-a47b-b3994d5acafd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:00.445192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-57645de7-1ee3-46be-b01e-653051e701a7 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae7d4debce6463999584b08b482d05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3847ca33d14d96b7df887796cf7f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:00.460545 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-57645de7-1ee3-46be-b01e-653051e701a7 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] 10.222.0.93 "GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4" status: 200 len: 1509 microversion: 2.1 time: 0.625773 Aug 04 17:09:00.461540 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1792/3512] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:08:59 2022] GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4 => generated 1509 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:00.478683 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-76b506da-c923-498b-bf92-431fbefa41d3 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:00.479193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-76b506da-c923-498b-bf92-431fbefa41d3 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] [instance: 70c75b7c-2890-48a2-a7b2-7caf3125a492] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:00.490333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76b506da-c923-498b-bf92-431fbefa41d3 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:00.490838 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76b506da-c923-498b-bf92-431fbefa41d3 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:00.491287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76b506da-c923-498b-bf92-431fbefa41d3 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:00.492008 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76b506da-c923-498b-bf92-431fbefa41d3 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:00.492474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76b506da-c923-498b-bf92-431fbefa41d3 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:00.492908 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76b506da-c923-498b-bf92-431fbefa41d3 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:00.560034 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-76b506da-c923-498b-bf92-431fbefa41d3 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] HTTP exception thrown: Instance 70c75b7c-2890-48a2-a7b2-7caf3125a492 could not be found. Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-76b506da-c923-498b-bf92-431fbefa41d3 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Request method failure captured: Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492 HTTP/1.1 Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_z5mp_Zwqz7Jw4QDMJgpPtcvEspl6J9YjhKIIcbfijhzb7nFmee5qEsZQ-Bejp2XGsqjBw78yv5OUKTkPZV_XKUCyhX1xqcyxx0PuLeLtaxvL_OjxzA5V98q8HCYFA8I7IaOJ-l8WzB4LdZ7fTmxoUYN_Ib_KcU_vTiECUCWq0N1Tw Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: ab1f5e7e1fda4b55a700c49041331f0b Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ListServersNegativeTestJSON-1546379396 Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ab1f5e7e1fda4b55a700c49041331f0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ab1f5e7e1fda4b55a700c49041331f0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ab1f5e7e1fda4b55a700c49041331f0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ab1f5e7e1fda4b55a700c49041331f0b"}]}] Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ListServersNegativeTestJSON-1546379396 Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: ab1f5e7e1fda4b55a700c49041331f0b Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1546379396 Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ListServersNegativeTestJSON-1546379396-project Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: ac5ee766cef74c928c68d72419b64e3e Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ListServersNegativeTestJSON-1546379396-project Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 70c75b7c-2890-48a2-a7b2-7caf3125a492 could not be found. Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '70c75b7c-2890-48a2-a7b2-7caf3125a492'} Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70c75b7c-2890-48a2-a7b2-7caf3125a492 could not be found. Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70c75b7c-2890-48a2-a7b2-7caf3125a492 could not be found. Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:09:00.599379 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:09:00.603698 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:09:00.603698 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:09:00.603698 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:09:00.603698 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:09:00.603698 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:09:00.603698 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:09:00.603698 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70c75b7c-2890-48a2-a7b2-7caf3125a492 could not be found. Aug 04 17:09:00.603698 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:09:00.603698 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-76b506da-c923-498b-bf92-431fbefa41d3 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] Returning 404 to user: Instance 70c75b7c-2890-48a2-a7b2-7caf3125a492 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:09:00.603698 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-76b506da-c923-498b-bf92-431fbefa41d3 tempest-ListServersNegativeTestJSON-1546379396 tempest-ListServersNegativeTestJSON-1546379396-project] 10.222.0.93 "GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492" status: 404 len: 111 microversion: 2.1 time: 0.140007 Aug 04 17:09:00.607686 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1793/3513] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:00 2022] GET /compute/v2.1/servers/70c75b7c-2890-48a2-a7b2-7caf3125a492 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:09:00.730438 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bb6c7fcf-8147-417a-9b36-30e4851f762c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:00.731076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bb6c7fcf-8147-417a-9b36-30e4851f762c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:00.739532 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bb6c7fcf-8147-417a-9b36-30e4851f762c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:00.751605 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bb6c7fcf-8147-417a-9b36-30e4851f762c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:00.752168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bb6c7fcf-8147-417a-9b36-30e4851f762c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:00.753932 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bb6c7fcf-8147-417a-9b36-30e4851f762c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:00.756811 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bb6c7fcf-8147-417a-9b36-30e4851f762c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:00.757292 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bb6c7fcf-8147-417a-9b36-30e4851f762c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:01.212753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1f3ce942-eb57-4921-a47b-b3994d5acafd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:01.224372 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1f3ce942-eb57-4921-a47b-b3994d5acafd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1683 microversion: 2.1 time: 0.933284 Aug 04 17:09:01.225022 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1721/3514] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:00 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1683 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:01.233643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8c20f106-ec04-4827-b1c5-2b108bbbda25 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:01.238746 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8c20f106-ec04-4827-b1c5-2b108bbbda25 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:01.257832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c20f106-ec04-4827-b1c5-2b108bbbda25 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:01.258722 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c20f106-ec04-4827-b1c5-2b108bbbda25 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:01.259866 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c20f106-ec04-4827-b1c5-2b108bbbda25 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:01.263541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c20f106-ec04-4827-b1c5-2b108bbbda25 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:01.264310 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c20f106-ec04-4827-b1c5-2b108bbbda25 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:01.266959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c20f106-ec04-4827-b1c5-2b108bbbda25 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:01.327536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bb6c7fcf-8147-417a-9b36-30e4851f762c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:01.337840 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bb6c7fcf-8147-417a-9b36-30e4851f762c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1517 microversion: 2.1 time: 0.616143 Aug 04 17:09:01.354658 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1794/3515] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:00 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1517 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:01.482064 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d3ea8372-8c86-4563-a9ad-710a7a340a69 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:01.483007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d3ea8372-8c86-4563-a9ad-710a7a340a69 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] [instance: 92a10759-f1cf-452a-9e3e-b2d99944dee4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:01.496217 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3ea8372-8c86-4563-a9ad-710a7a340a69 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:01.496761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3ea8372-8c86-4563-a9ad-710a7a340a69 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:01.497226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3ea8372-8c86-4563-a9ad-710a7a340a69 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:01.500313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3ea8372-8c86-4563-a9ad-710a7a340a69 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:01.500820 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3ea8372-8c86-4563-a9ad-710a7a340a69 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:01.501273 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3ea8372-8c86-4563-a9ad-710a7a340a69 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:01.589107 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3ea8372-8c86-4563-a9ad-710a7a340a69 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:01.589610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3ea8372-8c86-4563-a9ad-710a7a340a69 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:01.590302 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3ea8372-8c86-4563-a9ad-710a7a340a69 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:01.590950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-d3ea8372-8c86-4563-a9ad-710a7a340a69 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lazy-loading 'fault' on Instance uuid 92a10759-f1cf-452a-9e3e-b2d99944dee4 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:09:01.782548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d3ea8372-8c86-4563-a9ad-710a7a340a69 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae7d4debce6463999584b08b482d05e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3847ca33d14d96b7df887796cf7f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:01.788349 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8c20f106-ec04-4827-b1c5-2b108bbbda25 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:01.794504 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d3ea8372-8c86-4563-a9ad-710a7a340a69 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] 10.222.0.93 "GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4" status: 200 len: 1306 microversion: 2.1 time: 0.317525 Aug 04 17:09:01.795082 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1795/3516] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:01 2022] GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4 => generated 1306 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:09:01.822198 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8c20f106-ec04-4827-b1c5-2b108bbbda25 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1505 microversion: 2.1 time: 0.591570 Aug 04 17:09:01.823369 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1722/3517] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:01 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1505 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:01.833930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-86694824-4811-4ddc-a633-c7202ac02d7f req-0e95ec9c-a000-4038-b4fd-eb482323b871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c75b7c-2890-48a2-a7b2-7caf3125a492", "name": "network-vif-deleted", "tag": "b59491de-0168-4cb2-aee2-eef9338c21f0"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:01.855921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-86694824-4811-4ddc-a633-c7202ac02d7f req-0e95ec9c-a000-4038-b4fd-eb482323b871 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:01.856395 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-86694824-4811-4ddc-a633-c7202ac02d7f req-0e95ec9c-a000-4038-b4fd-eb482323b871 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:01.856857 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-86694824-4811-4ddc-a633-c7202ac02d7f req-0e95ec9c-a000-4038-b4fd-eb482323b871 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:01.882483 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-86694824-4811-4ddc-a633-c7202ac02d7f req-0e95ec9c-a000-4038-b4fd-eb482323b871 service nova] Creating event network-vif-deleted:b59491de-0168-4cb2-aee2-eef9338c21f0 for instance 70c75b7c-2890-48a2-a7b2-7caf3125a492 on n-h2-851359-3 Aug 04 17:09:01.891748 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-86694824-4811-4ddc-a633-c7202ac02d7f req-0e95ec9c-a000-4038-b4fd-eb482323b871 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062843 Aug 04 17:09:01.892707 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1796/3518] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:09:02.252507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-afe60ea5-493a-4bcf-9d71-174489bd828d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:02.254866 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-afe60ea5-493a-4bcf-9d71-174489bd828d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:02.280533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-afe60ea5-493a-4bcf-9d71-174489bd828d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:02.284066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-afe60ea5-493a-4bcf-9d71-174489bd828d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:02.284744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-afe60ea5-493a-4bcf-9d71-174489bd828d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:02.287176 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-afe60ea5-493a-4bcf-9d71-174489bd828d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:02.287834 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-afe60ea5-493a-4bcf-9d71-174489bd828d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:02.289774 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-afe60ea5-493a-4bcf-9d71-174489bd828d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:02.376265 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6ce416d0-6bd0-4e9b-8381-36ab81786455 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:02.376899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6ce416d0-6bd0-4e9b-8381-36ab81786455 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:02.387894 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ce416d0-6bd0-4e9b-8381-36ab81786455 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:02.390332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ce416d0-6bd0-4e9b-8381-36ab81786455 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:02.390835 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ce416d0-6bd0-4e9b-8381-36ab81786455 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:02.391477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ce416d0-6bd0-4e9b-8381-36ab81786455 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:02.391958 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ce416d0-6bd0-4e9b-8381-36ab81786455 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:02.392408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6ce416d0-6bd0-4e9b-8381-36ab81786455 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:02.498545 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=8 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:02.605937 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:02.690838 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-afe60ea5-493a-4bcf-9d71-174489bd828d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:02.698876 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-afe60ea5-493a-4bcf-9d71-174489bd828d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1683 microversion: 2.1 time: 0.452532 Aug 04 17:09:02.699805 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1723/3519] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:02 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1683 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:02.722053 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-22e75686-0fb6-46d8-b0e5-23dad805fd9e req-e8a67495-eb9f-4c40-8d0f-280d685a811c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92a10759-f1cf-452a-9e3e-b2d99944dee4", "name": "network-vif-deleted", "tag": "b62dd3cf-90a4-4252-a6a4-953c8a20aa43"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:02.751791 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-22e75686-0fb6-46d8-b0e5-23dad805fd9e req-e8a67495-eb9f-4c40-8d0f-280d685a811c service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:02.752291 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-22e75686-0fb6-46d8-b0e5-23dad805fd9e req-e8a67495-eb9f-4c40-8d0f-280d685a811c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:02.752737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-22e75686-0fb6-46d8-b0e5-23dad805fd9e req-e8a67495-eb9f-4c40-8d0f-280d685a811c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:02.761240 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:02.773245 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-22e75686-0fb6-46d8-b0e5-23dad805fd9e req-e8a67495-eb9f-4c40-8d0f-280d685a811c service nova] Creating event network-vif-deleted:b62dd3cf-90a4-4252-a6a4-953c8a20aa43 for instance 92a10759-f1cf-452a-9e3e-b2d99944dee4 on n-h2-851359-3 Aug 04 17:09:02.782234 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-22e75686-0fb6-46d8-b0e5-23dad805fd9e req-e8a67495-eb9f-4c40-8d0f-280d685a811c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077331 Aug 04 17:09:02.783519 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1724/3520] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:09:02.823215 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4891a672-4d5b-4be4-b3bf-3b01e2a271e7 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:02.824979 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4891a672-4d5b-4be4-b3bf-3b01e2a271e7 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] [instance: 92a10759-f1cf-452a-9e3e-b2d99944dee4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:02.842312 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4891a672-4d5b-4be4-b3bf-3b01e2a271e7 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:02.843601 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4891a672-4d5b-4be4-b3bf-3b01e2a271e7 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:02.844222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4891a672-4d5b-4be4-b3bf-3b01e2a271e7 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:02.846453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4891a672-4d5b-4be4-b3bf-3b01e2a271e7 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:02.847395 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4891a672-4d5b-4be4-b3bf-3b01e2a271e7 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:02.847849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4891a672-4d5b-4be4-b3bf-3b01e2a271e7 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:02.890415 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-4891a672-4d5b-4be4-b3bf-3b01e2a271e7 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] HTTP exception thrown: Instance 92a10759-f1cf-452a-9e3e-b2d99944dee4 could not be found. Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4891a672-4d5b-4be4-b3bf-3b01e2a271e7 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Request method failure captured: Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4 HTTP/1.1 Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_0WVUw4KJQhXk43WIDPNgzS5gvxsZjQzahz514C8Egf62qq9o58zV9ea8J4l7p2esVY9PIvWtfU_X6YMGgxqDWj5hU5b6XS2P51SF-iUn-ij-xfwvbxxPee-qUologAFsvY5YHr6V7fcrqY4TnPa2-jpk8oMIBt8AO-Q2kDpp8LG2g Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 2b3847ca33d14d96b7df887796cf7f7a Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerPasswordTestJSON-1171556237 Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2b3847ca33d14d96b7df887796cf7f7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2b3847ca33d14d96b7df887796cf7f7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2b3847ca33d14d96b7df887796cf7f7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2b3847ca33d14d96b7df887796cf7f7a"}]}] Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServerPasswordTestJSON-1171556237 Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 2b3847ca33d14d96b7df887796cf7f7a Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1171556237 Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServerPasswordTestJSON-1171556237-project Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 4ae7d4debce6463999584b08b482d05e Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServerPasswordTestJSON-1171556237-project Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 92a10759-f1cf-452a-9e3e-b2d99944dee4 could not be found. Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '92a10759-f1cf-452a-9e3e-b2d99944dee4'} Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92a10759-f1cf-452a-9e3e-b2d99944dee4 could not be found. Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92a10759-f1cf-452a-9e3e-b2d99944dee4 could not be found. Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:09:02.896417 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:09:02.903783 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:09:02.903783 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:09:02.903783 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:09:02.903783 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:09:02.903783 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:09:02.903783 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92a10759-f1cf-452a-9e3e-b2d99944dee4 could not be found. Aug 04 17:09:02.903783 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:09:02.906235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4891a672-4d5b-4be4-b3bf-3b01e2a271e7 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] Returning 404 to user: Instance 92a10759-f1cf-452a-9e3e-b2d99944dee4 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:09:02.907975 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4891a672-4d5b-4be4-b3bf-3b01e2a271e7 tempest-ServerPasswordTestJSON-1171556237 tempest-ServerPasswordTestJSON-1171556237-project] 10.222.0.93 "GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4" status: 404 len: 111 microversion: 2.1 time: 0.095187 Aug 04 17:09:02.909332 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1725/3521] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:02 2022] GET /compute/v2.1/servers/92a10759-f1cf-452a-9e3e-b2d99944dee4 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:09:02.917266 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-40193e73-af23-4587-9191-8ba8fd9adce8 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:02.918291 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-40193e73-af23-4587-9191-8ba8fd9adce8 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:02.930389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40193e73-af23-4587-9191-8ba8fd9adce8 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:02.931694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40193e73-af23-4587-9191-8ba8fd9adce8 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:02.932990 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40193e73-af23-4587-9191-8ba8fd9adce8 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:02.933932 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40193e73-af23-4587-9191-8ba8fd9adce8 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:02.934793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40193e73-af23-4587-9191-8ba8fd9adce8 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:02.935443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40193e73-af23-4587-9191-8ba8fd9adce8 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:03.095279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:03.280705 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6ce416d0-6bd0-4e9b-8381-36ab81786455 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:03.292282 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6ce416d0-6bd0-4e9b-8381-36ab81786455 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1517 microversion: 2.1 time: 0.920849 Aug 04 17:09:03.293744 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1797/3522] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:02 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1517 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:03.597689 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-40193e73-af23-4587-9191-8ba8fd9adce8 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:03.635212 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-40193e73-af23-4587-9191-8ba8fd9adce8 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1505 microversion: 2.1 time: 0.723195 Aug 04 17:09:03.636389 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1726/3523] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:02 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1505 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:03.721889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-38751011-a932-4eba-ad21-7e96915df6a6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:03.722560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-38751011-a932-4eba-ad21-7e96915df6a6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:03.737534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38751011-a932-4eba-ad21-7e96915df6a6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:03.738047 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38751011-a932-4eba-ad21-7e96915df6a6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:03.738512 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38751011-a932-4eba-ad21-7e96915df6a6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:03.739236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38751011-a932-4eba-ad21-7e96915df6a6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:03.739707 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38751011-a932-4eba-ad21-7e96915df6a6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:03.740148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38751011-a932-4eba-ad21-7e96915df6a6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:04.320081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-18c20dc1-0952-4441-a061-7718000350f4 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:04.320866 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-18c20dc1-0952-4441-a061-7718000350f4 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:04.344871 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18c20dc1-0952-4441-a061-7718000350f4 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:04.345394 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18c20dc1-0952-4441-a061-7718000350f4 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:04.348972 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18c20dc1-0952-4441-a061-7718000350f4 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:04.349765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18c20dc1-0952-4441-a061-7718000350f4 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:04.350289 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18c20dc1-0952-4441-a061-7718000350f4 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:04.350737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18c20dc1-0952-4441-a061-7718000350f4 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:04.641655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-38751011-a932-4eba-ad21-7e96915df6a6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:04.649489 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-38751011-a932-4eba-ad21-7e96915df6a6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1683 microversion: 2.1 time: 0.931528 Aug 04 17:09:04.662955 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1798/3524] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:03 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1683 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:04.664345 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1c75b3be-89dc-4ea0-83fc-28e3e46b4594 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:04.665260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1c75b3be-89dc-4ea0-83fc-28e3e46b4594 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:04.678187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1c75b3be-89dc-4ea0-83fc-28e3e46b4594 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:04.679231 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1c75b3be-89dc-4ea0-83fc-28e3e46b4594 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:04.683478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1c75b3be-89dc-4ea0-83fc-28e3e46b4594 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:04.684430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1c75b3be-89dc-4ea0-83fc-28e3e46b4594 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:04.685068 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1c75b3be-89dc-4ea0-83fc-28e3e46b4594 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:04.685698 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1c75b3be-89dc-4ea0-83fc-28e3e46b4594 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:05.184148 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-18c20dc1-0952-4441-a061-7718000350f4 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:05.200566 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-18c20dc1-0952-4441-a061-7718000350f4 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1517 microversion: 2.1 time: 0.885922 Aug 04 17:09:05.203440 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1727/3525] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:04 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1517 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:05.221257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1c75b3be-89dc-4ea0-83fc-28e3e46b4594 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:05.223582 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:05.241113 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1c75b3be-89dc-4ea0-83fc-28e3e46b4594 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1485 microversion: 2.1 time: 0.581881 Aug 04 17:09:05.242079 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1799/3526] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:04 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1485 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:05.262322 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b3eee093-23c1-41d4-a702-38d62e83a0d5 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:05.263091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b3eee093-23c1-41d4-a702-38d62e83a0d5 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:05.275434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3eee093-23c1-41d4-a702-38d62e83a0d5 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:05.276342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3eee093-23c1-41d4-a702-38d62e83a0d5 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:05.277030 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3eee093-23c1-41d4-a702-38d62e83a0d5 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:05.278666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3eee093-23c1-41d4-a702-38d62e83a0d5 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:05.279443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3eee093-23c1-41d4-a702-38d62e83a0d5 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:05.280133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3eee093-23c1-41d4-a702-38d62e83a0d5 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:05.551696 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b3eee093-23c1-41d4-a702-38d62e83a0d5 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "POST /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b/action" status: 202 len: 0 microversion: 2.1 time: 0.293599 Aug 04 17:09:05.557533 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1728/3527] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:09:05 2022] POST /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:09:05.571820 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c4dedb80-85cb-46b1-a0bc-e59f33098136 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:05.574624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c4dedb80-85cb-46b1-a0bc-e59f33098136 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:05.593450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4dedb80-85cb-46b1-a0bc-e59f33098136 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:05.603105 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4dedb80-85cb-46b1-a0bc-e59f33098136 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:05.605006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4dedb80-85cb-46b1-a0bc-e59f33098136 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:05.607371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4dedb80-85cb-46b1-a0bc-e59f33098136 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:05.610585 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4dedb80-85cb-46b1-a0bc-e59f33098136 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:05.615365 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4dedb80-85cb-46b1-a0bc-e59f33098136 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:05.681211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c7809ff2-6871-497d-a692-57d6ecf39179 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:05.683052 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c7809ff2-6871-497d-a692-57d6ecf39179 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:05.691294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7809ff2-6871-497d-a692-57d6ecf39179 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:05.704179 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7809ff2-6871-497d-a692-57d6ecf39179 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:05.708871 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7809ff2-6871-497d-a692-57d6ecf39179 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:05.714322 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7809ff2-6871-497d-a692-57d6ecf39179 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:05.719417 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7809ff2-6871-497d-a692-57d6ecf39179 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:05.733820 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7809ff2-6871-497d-a692-57d6ecf39179 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:06.881761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c4dedb80-85cb-46b1-a0bc-e59f33098136 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:06.898875 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c4dedb80-85cb-46b1-a0bc-e59f33098136 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1493 microversion: 2.1 time: 1.337716 Aug 04 17:09:06.902223 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1800/3528] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:05 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1493 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:09:06.928005 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c3432579-ccd9-41b3-b14a-4672d4e64d54 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:06.928922 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c3432579-ccd9-41b3-b14a-4672d4e64d54 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:06.942223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c3432579-ccd9-41b3-b14a-4672d4e64d54 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:06.944877 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c3432579-ccd9-41b3-b14a-4672d4e64d54 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:06.947747 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c3432579-ccd9-41b3-b14a-4672d4e64d54 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:06.949578 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c3432579-ccd9-41b3-b14a-4672d4e64d54 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:06.951730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c3432579-ccd9-41b3-b14a-4672d4e64d54 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:06.952683 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c3432579-ccd9-41b3-b14a-4672d4e64d54 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:07.300199 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c7809ff2-6871-497d-a692-57d6ecf39179 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:07.311858 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c7809ff2-6871-497d-a692-57d6ecf39179 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1683 microversion: 2.1 time: 1.634930 Aug 04 17:09:07.315541 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1729/3529] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:05 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1683 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:07.927159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b3993455-ea81-4e85-9479-049ce63204eb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:07.927796 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b3993455-ea81-4e85-9479-049ce63204eb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:07.942446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3993455-ea81-4e85-9479-049ce63204eb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:07.942953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3993455-ea81-4e85-9479-049ce63204eb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:07.943400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3993455-ea81-4e85-9479-049ce63204eb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:07.944220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3993455-ea81-4e85-9479-049ce63204eb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:07.954291 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3993455-ea81-4e85-9479-049ce63204eb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:07.961757 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3993455-ea81-4e85-9479-049ce63204eb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:08.038624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c3432579-ccd9-41b3-b14a-4672d4e64d54 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:08.053300 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c3432579-ccd9-41b3-b14a-4672d4e64d54 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1517 microversion: 2.1 time: 1.144309 Aug 04 17:09:08.060313 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1801/3530] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:06 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1517 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:08.511044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-29fb9de6-316e-49ff-a3a8-ed1d7fa41fc1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-988750397", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": "none"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:08.587446 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-29fb9de6-316e-49ff-a3a8-ed1d7fa41fc1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:09:08.588109 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-29fb9de6-316e-49ff-a3a8-ed1d7fa41fc1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:09:08.588831 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-29fb9de6-316e-49ff-a3a8-ed1d7fa41fc1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:09:08.589468 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-29fb9de6-316e-49ff-a3a8-ed1d7fa41fc1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:09:08.590169 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-29fb9de6-316e-49ff-a3a8-ed1d7fa41fc1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:09:08.609247 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29fb9de6-316e-49ff-a3a8-ed1d7fa41fc1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:08.610586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29fb9de6-316e-49ff-a3a8-ed1d7fa41fc1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:08.612060 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29fb9de6-316e-49ff-a3a8-ed1d7fa41fc1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:08.614023 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29fb9de6-316e-49ff-a3a8-ed1d7fa41fc1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:08.614651 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29fb9de6-316e-49ff-a3a8-ed1d7fa41fc1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:08.615435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29fb9de6-316e-49ff-a3a8-ed1d7fa41fc1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:08.637314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-29fb9de6-316e-49ff-a3a8-ed1d7fa41fc1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Getting quotas for project 538e626497154361a47f81781bce54a0. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:09:08.643457 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-29fb9de6-316e-49ff-a3a8-ed1d7fa41fc1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Getting quotas for user b819c1114b2941688b7edb7180df8592 and project 538e626497154361a47f81781bce54a0. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:09:08.661304 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-29fb9de6-316e-49ff-a3a8-ed1d7fa41fc1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:09:08.663907 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-29fb9de6-316e-49ff-a3a8-ed1d7fa41fc1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: 3e9ff0d0-6db8-4db9-a5a9-94f0aeab93c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:09:08.738036 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-29fb9de6-316e-49ff-a3a8-ed1d7fa41fc1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.436312 Aug 04 17:09:08.745213 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1802/3531] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Aug 4 17:09:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 444 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 17:09:08.750376 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7a7f585a-85e5-4f7f-8409-edb9c9181c90 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:08.751608 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7a7f585a-85e5-4f7f-8409-edb9c9181c90 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:08.763928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7a7f585a-85e5-4f7f-8409-edb9c9181c90 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:08.764774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7a7f585a-85e5-4f7f-8409-edb9c9181c90 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:08.765599 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7a7f585a-85e5-4f7f-8409-edb9c9181c90 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:08.766973 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7a7f585a-85e5-4f7f-8409-edb9c9181c90 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:08.768199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7a7f585a-85e5-4f7f-8409-edb9c9181c90 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:08.768862 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7a7f585a-85e5-4f7f-8409-edb9c9181c90 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:08.853845 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b3993455-ea81-4e85-9479-049ce63204eb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:08.872660 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b3993455-ea81-4e85-9479-049ce63204eb tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1493 microversion: 2.1 time: 0.949496 Aug 04 17:09:08.874057 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1730/3532] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:07 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1493 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:09:08.887535 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1d875ac7-e4b4-4ba6-8c16-a38ced38f7c5 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:08.888430 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1d875ac7-e4b4-4ba6-8c16-a38ced38f7c5 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: 3e9ff0d0-6db8-4db9-a5a9-94f0aeab93c5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:09.155047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1d875ac7-e4b4-4ba6-8c16-a38ced38f7c5 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:09.168361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1d875ac7-e4b4-4ba6-8c16-a38ced38f7c5 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:09.175890 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1d875ac7-e4b4-4ba6-8c16-a38ced38f7c5 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:09.177688 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1d875ac7-e4b4-4ba6-8c16-a38ced38f7c5 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/3e9ff0d0-6db8-4db9-a5a9-94f0aeab93c5" status: 200 len: 1277 microversion: 2.47 time: 0.302408 Aug 04 17:09:09.178581 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1731/3533] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:09:08 2022] GET /compute/v2.1/servers/3e9ff0d0-6db8-4db9-a5a9-94f0aeab93c5 => generated 1277 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:09:09.187848 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3e9e54cc-de54-4ce8-8b93-6d85ae4143bc tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:09.190692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3e9e54cc-de54-4ce8-8b93-6d85ae4143bc tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:09.205069 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e9e54cc-de54-4ce8-8b93-6d85ae4143bc tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:09.206326 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e9e54cc-de54-4ce8-8b93-6d85ae4143bc tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:09.208861 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e9e54cc-de54-4ce8-8b93-6d85ae4143bc tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:09.209879 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e9e54cc-de54-4ce8-8b93-6d85ae4143bc tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:09.210377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e9e54cc-de54-4ce8-8b93-6d85ae4143bc tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:09.212906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e9e54cc-de54-4ce8-8b93-6d85ae4143bc tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:09.730612 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7a7f585a-85e5-4f7f-8409-edb9c9181c90 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:09.739935 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7a7f585a-85e5-4f7f-8409-edb9c9181c90 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1683 microversion: 2.1 time: 0.993215 Aug 04 17:09:09.760020 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1803/3534] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:08 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1683 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:09.770738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5022ef1b-a113-4600-bae0-67f1376d90e9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-364963246", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": "none"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:09.877763 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5022ef1b-a113-4600-bae0-67f1376d90e9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:09:09.878218 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5022ef1b-a113-4600-bae0-67f1376d90e9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:09:09.878702 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5022ef1b-a113-4600-bae0-67f1376d90e9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:09:09.879113 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5022ef1b-a113-4600-bae0-67f1376d90e9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:09:09.879528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5022ef1b-a113-4600-bae0-67f1376d90e9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:09:09.905379 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5022ef1b-a113-4600-bae0-67f1376d90e9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:09.911880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5022ef1b-a113-4600-bae0-67f1376d90e9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:09.912367 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5022ef1b-a113-4600-bae0-67f1376d90e9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:09.913215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5022ef1b-a113-4600-bae0-67f1376d90e9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:09.913699 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5022ef1b-a113-4600-bae0-67f1376d90e9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:09.914161 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5022ef1b-a113-4600-bae0-67f1376d90e9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:09.968900 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-5022ef1b-a113-4600-bae0-67f1376d90e9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Getting quotas for project 538e626497154361a47f81781bce54a0. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:09:09.978042 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-5022ef1b-a113-4600-bae0-67f1376d90e9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Getting quotas for user b819c1114b2941688b7edb7180df8592 and project 538e626497154361a47f81781bce54a0. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:09:09.999189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5022ef1b-a113-4600-bae0-67f1376d90e9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:09:10.002457 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5022ef1b-a113-4600-bae0-67f1376d90e9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:09:10.069384 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5022ef1b-a113-4600-bae0-67f1376d90e9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.308138 Aug 04 17:09:10.078528 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1804/3535] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Aug 4 17:09:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 317 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 17:09:10.088267 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-649b7989-7750-4c46-875b-2803430d96f4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:10.088881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-649b7989-7750-4c46-875b-2803430d96f4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:10.121173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-649b7989-7750-4c46-875b-2803430d96f4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:10.121720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-649b7989-7750-4c46-875b-2803430d96f4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:10.122210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-649b7989-7750-4c46-875b-2803430d96f4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:10.122971 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-649b7989-7750-4c46-875b-2803430d96f4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:10.123441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-649b7989-7750-4c46-875b-2803430d96f4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:10.123856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-649b7989-7750-4c46-875b-2803430d96f4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:10.461637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3e9e54cc-de54-4ce8-8b93-6d85ae4143bc tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:10.488527 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3e9e54cc-de54-4ce8-8b93-6d85ae4143bc tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1517 microversion: 2.1 time: 1.293223 Aug 04 17:09:10.511587 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1732/3536] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:09 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1517 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:10.549395 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cd99a285-7e1c-4425-b95d-662fe8b2befb tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:10.559085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cd99a285-7e1c-4425-b95d-662fe8b2befb tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:10.656904 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cd99a285-7e1c-4425-b95d-662fe8b2befb tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "PUT /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e" status: 200 len: 991 microversion: 2.47 time: 0.141766 Aug 04 17:09:10.660102 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1733/3537] 10.222.0.93 () {62 vars in 1297 bytes} [Thu Aug 4 17:09:10 2022] PUT /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e => generated 991 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:09:10.679834 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-93cd124d-de42-4378-984e-ff075d7dadad tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:10.681231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-93cd124d-de42-4378-984e-ff075d7dadad tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:10.695964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-649b7989-7750-4c46-875b-2803430d96f4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:10.710784 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-649b7989-7750-4c46-875b-2803430d96f4 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1493 microversion: 2.1 time: 0.630573 Aug 04 17:09:10.717275 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1805/3538] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:10 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1493 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:10.765320 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f1ba2a80-4878-4547-beb8-b6e37423a09c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:10.766124 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f1ba2a80-4878-4547-beb8-b6e37423a09c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:10.778094 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1ba2a80-4878-4547-beb8-b6e37423a09c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:10.779202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1ba2a80-4878-4547-beb8-b6e37423a09c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:10.779862 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1ba2a80-4878-4547-beb8-b6e37423a09c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:10.781643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1ba2a80-4878-4547-beb8-b6e37423a09c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:10.784085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1ba2a80-4878-4547-beb8-b6e37423a09c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:10.784717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1ba2a80-4878-4547-beb8-b6e37423a09c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:10.862306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-93cd124d-de42-4378-984e-ff075d7dadad tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:10.873359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-93cd124d-de42-4378-984e-ff075d7dadad tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:10.875390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-93cd124d-de42-4378-984e-ff075d7dadad tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:10.879406 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-93cd124d-de42-4378-984e-ff075d7dadad tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e" status: 200 len: 1277 microversion: 2.47 time: 0.203601 Aug 04 17:09:10.884100 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1734/3539] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:09:10 2022] GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e => generated 1277 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:09:11.353137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f1ba2a80-4878-4547-beb8-b6e37423a09c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:11.364529 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f1ba2a80-4878-4547-beb8-b6e37423a09c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1683 microversion: 2.1 time: 0.603065 Aug 04 17:09:11.365720 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1806/3540] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:10 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1683 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:11.515650 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4aba56e0-b800-40f5-9727-5f62bac36001 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:11.516288 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4aba56e0-b800-40f5-9727-5f62bac36001 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:11.525224 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4aba56e0-b800-40f5-9727-5f62bac36001 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:11.525724 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4aba56e0-b800-40f5-9727-5f62bac36001 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:11.529014 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4aba56e0-b800-40f5-9727-5f62bac36001 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:11.529874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4aba56e0-b800-40f5-9727-5f62bac36001 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:11.530462 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4aba56e0-b800-40f5-9727-5f62bac36001 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:11.530950 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4aba56e0-b800-40f5-9727-5f62bac36001 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:11.736467 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d5b48e43-3f15-41f3-9f72-7a139e928dc0 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:11.737103 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d5b48e43-3f15-41f3-9f72-7a139e928dc0 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:11.747975 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d5b48e43-3f15-41f3-9f72-7a139e928dc0 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:11.753833 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d5b48e43-3f15-41f3-9f72-7a139e928dc0 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:11.754997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d5b48e43-3f15-41f3-9f72-7a139e928dc0 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:11.755799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d5b48e43-3f15-41f3-9f72-7a139e928dc0 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:11.756284 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d5b48e43-3f15-41f3-9f72-7a139e928dc0 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:11.756741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d5b48e43-3f15-41f3-9f72-7a139e928dc0 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:12.331622 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4aba56e0-b800-40f5-9727-5f62bac36001 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:12.357065 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4aba56e0-b800-40f5-9727-5f62bac36001 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1517 microversion: 2.1 time: 0.838551 Aug 04 17:09:12.370488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d5b48e43-3f15-41f3-9f72-7a139e928dc0 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:12.376507 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1735/3541] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:11 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1517 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:12.393322 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d5b48e43-3f15-41f3-9f72-7a139e928dc0 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1499 microversion: 2.1 time: 0.663616 Aug 04 17:09:12.394226 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1807/3542] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:11 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1499 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:12.399892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a5e8ce06-ad1c-4a7a-ae65-c47c4bad2e2a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:12.401343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a5e8ce06-ad1c-4a7a-ae65-c47c4bad2e2a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:12.406819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9dc477d5-1e35-489b-bf0c-fa66feaaa22d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:12.407397 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9dc477d5-1e35-489b-bf0c-fa66feaaa22d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:12.410468 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a5e8ce06-ad1c-4a7a-ae65-c47c4bad2e2a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:12.411633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a5e8ce06-ad1c-4a7a-ae65-c47c4bad2e2a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:12.412314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a5e8ce06-ad1c-4a7a-ae65-c47c4bad2e2a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:12.413284 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a5e8ce06-ad1c-4a7a-ae65-c47c4bad2e2a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:12.413968 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a5e8ce06-ad1c-4a7a-ae65-c47c4bad2e2a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:12.414657 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a5e8ce06-ad1c-4a7a-ae65-c47c4bad2e2a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:12.427868 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dc477d5-1e35-489b-bf0c-fa66feaaa22d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:12.428383 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dc477d5-1e35-489b-bf0c-fa66feaaa22d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:12.428831 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dc477d5-1e35-489b-bf0c-fa66feaaa22d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:12.451011 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dc477d5-1e35-489b-bf0c-fa66feaaa22d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:12.452203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dc477d5-1e35-489b-bf0c-fa66feaaa22d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:12.456477 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dc477d5-1e35-489b-bf0c-fa66feaaa22d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:12.700890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a5e8ce06-ad1c-4a7a-ae65-c47c4bad2e2a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:12.709111 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a5e8ce06-ad1c-4a7a-ae65-c47c4bad2e2a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1683 microversion: 2.1 time: 0.313443 Aug 04 17:09:12.713585 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1808/3543] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:12 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1683 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:12.721130 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9e14577d-a99a-4b2a-aa93-c9419f5f614b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:12.723631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9e14577d-a99a-4b2a-aa93-c9419f5f614b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:12.729246 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9dc477d5-1e35-489b-bf0c-fa66feaaa22d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:12.735698 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e14577d-a99a-4b2a-aa93-c9419f5f614b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:12.738554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e14577d-a99a-4b2a-aa93-c9419f5f614b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:12.739136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e14577d-a99a-4b2a-aa93-c9419f5f614b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:12.739988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e14577d-a99a-4b2a-aa93-c9419f5f614b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:12.741620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9dc477d5-1e35-489b-bf0c-fa66feaaa22d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:12.742313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e14577d-a99a-4b2a-aa93-c9419f5f614b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:12.742914 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e14577d-a99a-4b2a-aa93-c9419f5f614b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:12.747118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9dc477d5-1e35-489b-bf0c-fa66feaaa22d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:12.748714 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9dc477d5-1e35-489b-bf0c-fa66feaaa22d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e" status: 200 len: 1337 microversion: 2.47 time: 0.374516 Aug 04 17:09:12.753360 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1736/3544] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:09:12 2022] GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e => generated 1337 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:09:12.792377 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9e14577d-a99a-4b2a-aa93-c9419f5f614b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:09:12.902870 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9e14577d-a99a-4b2a-aa93-c9419f5f614b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 204 len: 0 microversion: 2.1 time: 0.187329 Aug 04 17:09:12.905320 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1809/3545] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:09:12 2022] DELETE /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:09:12.912929 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-560b74dc-3945-40e9-a0d5-31c2d02af4b0 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:12.913552 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-560b74dc-3945-40e9-a0d5-31c2d02af4b0 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:12.932640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-560b74dc-3945-40e9-a0d5-31c2d02af4b0 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:12.933493 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-560b74dc-3945-40e9-a0d5-31c2d02af4b0 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:12.933956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-560b74dc-3945-40e9-a0d5-31c2d02af4b0 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:12.947041 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-560b74dc-3945-40e9-a0d5-31c2d02af4b0 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:12.947665 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-560b74dc-3945-40e9-a0d5-31c2d02af4b0 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:12.948361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-560b74dc-3945-40e9-a0d5-31c2d02af4b0 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:13.381355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d7f3fe40-f1d6-494b-b849-675df5ee6399 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:13.382111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d7f3fe40-f1d6-494b-b849-675df5ee6399 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:13.397145 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7f3fe40-f1d6-494b-b849-675df5ee6399 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:13.397658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7f3fe40-f1d6-494b-b849-675df5ee6399 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:13.398137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7f3fe40-f1d6-494b-b849-675df5ee6399 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:13.401049 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7f3fe40-f1d6-494b-b849-675df5ee6399 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:13.401535 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7f3fe40-f1d6-494b-b849-675df5ee6399 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:13.401997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7f3fe40-f1d6-494b-b849-675df5ee6399 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:13.864671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-560b74dc-3945-40e9-a0d5-31c2d02af4b0 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:13.884961 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-560b74dc-3945-40e9-a0d5-31c2d02af4b0 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1505 microversion: 2.1 time: 0.975796 Aug 04 17:09:13.899710 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1737/3546] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:12 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1505 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:13.914371 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-05b6cbd7-6af6-4f57-aef7-1d80e069bed0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:13.918794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-05b6cbd7-6af6-4f57-aef7-1d80e069bed0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:13.943110 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05b6cbd7-6af6-4f57-aef7-1d80e069bed0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:13.943588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05b6cbd7-6af6-4f57-aef7-1d80e069bed0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:13.945308 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05b6cbd7-6af6-4f57-aef7-1d80e069bed0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:13.947399 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05b6cbd7-6af6-4f57-aef7-1d80e069bed0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:13.948075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05b6cbd7-6af6-4f57-aef7-1d80e069bed0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:13.950990 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05b6cbd7-6af6-4f57-aef7-1d80e069bed0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:14.330695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d7f3fe40-f1d6-494b-b849-675df5ee6399 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:14.342664 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d7f3fe40-f1d6-494b-b849-675df5ee6399 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1517 microversion: 2.1 time: 0.968781 Aug 04 17:09:14.357421 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1810/3547] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:13 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1517 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:14.376124 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-02b16fb4-975a-444c-b299-d5f5f5d86f11 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:14.379366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-02b16fb4-975a-444c-b299-d5f5f5d86f11 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:14.396541 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02b16fb4-975a-444c-b299-d5f5f5d86f11 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:14.399777 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02b16fb4-975a-444c-b299-d5f5f5d86f11 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:14.400653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02b16fb4-975a-444c-b299-d5f5f5d86f11 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:14.401532 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02b16fb4-975a-444c-b299-d5f5f5d86f11 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:14.403727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02b16fb4-975a-444c-b299-d5f5f5d86f11 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:14.404481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02b16fb4-975a-444c-b299-d5f5f5d86f11 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:14.625324 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-02b16fb4-975a-444c-b299-d5f5f5d86f11 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:14.638914 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-02b16fb4-975a-444c-b299-d5f5f5d86f11 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:14.643848 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-02b16fb4-975a-444c-b299-d5f5f5d86f11 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:14.651382 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-02b16fb4-975a-444c-b299-d5f5f5d86f11 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e" status: 200 len: 1335 microversion: 2.47 time: 0.289994 Aug 04 17:09:14.652089 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1811/3548] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:09:14 2022] GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e => generated 1335 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:09:14.724049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-05b6cbd7-6af6-4f57-aef7-1d80e069bed0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:14.758406 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-05b6cbd7-6af6-4f57-aef7-1d80e069bed0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1683 microversion: 2.1 time: 0.854045 Aug 04 17:09:14.766793 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1738/3549] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:13 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1683 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:14.919325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-83ccda87-d216-4494-aa96-407a4c7aab8d tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:14.920387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-83ccda87-d216-4494-aa96-407a4c7aab8d tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:14.934549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83ccda87-d216-4494-aa96-407a4c7aab8d tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:14.939406 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83ccda87-d216-4494-aa96-407a4c7aab8d tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:14.940210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83ccda87-d216-4494-aa96-407a4c7aab8d tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:14.941192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83ccda87-d216-4494-aa96-407a4c7aab8d tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:14.943831 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83ccda87-d216-4494-aa96-407a4c7aab8d tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:14.944514 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83ccda87-d216-4494-aa96-407a4c7aab8d tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:15.364700 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7c19a163-93ed-4447-805b-df9c0004f88a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:15.365426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7c19a163-93ed-4447-805b-df9c0004f88a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:15.373336 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c19a163-93ed-4447-805b-df9c0004f88a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:15.376692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c19a163-93ed-4447-805b-df9c0004f88a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:15.377586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c19a163-93ed-4447-805b-df9c0004f88a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:15.379958 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c19a163-93ed-4447-805b-df9c0004f88a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:15.380919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c19a163-93ed-4447-805b-df9c0004f88a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:15.381582 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c19a163-93ed-4447-805b-df9c0004f88a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:15.717284 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-83ccda87-d216-4494-aa96-407a4c7aab8d tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:15.730840 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-83ccda87-d216-4494-aa96-407a4c7aab8d tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1505 microversion: 2.1 time: 0.815392 Aug 04 17:09:15.735289 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1812/3550] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:14 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1505 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:15.765853 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-641a3e41-a67d-4424-b811-78ee0ddc93f1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:15.775235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-641a3e41-a67d-4424-b811-78ee0ddc93f1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:15.809773 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-641a3e41-a67d-4424-b811-78ee0ddc93f1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:15.813307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-641a3e41-a67d-4424-b811-78ee0ddc93f1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:15.814099 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-641a3e41-a67d-4424-b811-78ee0ddc93f1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:15.818121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-641a3e41-a67d-4424-b811-78ee0ddc93f1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:15.820255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-641a3e41-a67d-4424-b811-78ee0ddc93f1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:15.820710 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-641a3e41-a67d-4424-b811-78ee0ddc93f1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:15.882807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7c19a163-93ed-4447-805b-df9c0004f88a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:15.891905 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7c19a163-93ed-4447-805b-df9c0004f88a tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1517 microversion: 2.1 time: 0.531696 Aug 04 17:09:15.899863 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1739/3551] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:15 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1517 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:09:15.922499 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cfa3a792-1c52-4394-a655-bd5e7082af43 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:15.927231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cfa3a792-1c52-4394-a655-bd5e7082af43 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:15.946475 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfa3a792-1c52-4394-a655-bd5e7082af43 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:15.947019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfa3a792-1c52-4394-a655-bd5e7082af43 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:15.947669 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfa3a792-1c52-4394-a655-bd5e7082af43 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:15.948596 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfa3a792-1c52-4394-a655-bd5e7082af43 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:15.949580 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfa3a792-1c52-4394-a655-bd5e7082af43 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:15.950330 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfa3a792-1c52-4394-a655-bd5e7082af43 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:16.263042 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-641a3e41-a67d-4424-b811-78ee0ddc93f1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:16.279081 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-641a3e41-a67d-4424-b811-78ee0ddc93f1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:16.281457 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-641a3e41-a67d-4424-b811-78ee0ddc93f1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:16.286753 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-641a3e41-a67d-4424-b811-78ee0ddc93f1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e" status: 200 len: 1335 microversion: 2.47 time: 0.548957 Aug 04 17:09:16.302795 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1813/3552] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:09:15 2022] GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e => generated 1335 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:09:16.485095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cfa3a792-1c52-4394-a655-bd5e7082af43 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:16.501644 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cfa3a792-1c52-4394-a655-bd5e7082af43 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1683 microversion: 2.1 time: 0.600631 Aug 04 17:09:16.502278 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1740/3553] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:15 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1683 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:16.531548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-505a815d-f99e-4780-ac98-72efca92c426 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:16.533610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-505a815d-f99e-4780-ac98-72efca92c426 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:16.546260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-505a815d-f99e-4780-ac98-72efca92c426 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:16.547123 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-505a815d-f99e-4780-ac98-72efca92c426 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:16.547819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-505a815d-f99e-4780-ac98-72efca92c426 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:16.548987 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-505a815d-f99e-4780-ac98-72efca92c426 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:16.549961 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-505a815d-f99e-4780-ac98-72efca92c426 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:16.551068 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-505a815d-f99e-4780-ac98-72efca92c426 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:16.629080 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-505a815d-f99e-4780-ac98-72efca92c426 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3/ips" status: 200 len: 145 microversion: 2.1 time: 0.103621 Aug 04 17:09:16.640607 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1814/3554] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Aug 4 17:09:16 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3/ips => generated 145 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:09:16.759162 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-edadcd81-ef20-4f1b-9ce6-831f3f877d12 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:16.759787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-edadcd81-ef20-4f1b-9ce6-831f3f877d12 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:16.777897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-edadcd81-ef20-4f1b-9ce6-831f3f877d12 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:16.778697 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-edadcd81-ef20-4f1b-9ce6-831f3f877d12 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:16.779339 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-edadcd81-ef20-4f1b-9ce6-831f3f877d12 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:16.780229 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-edadcd81-ef20-4f1b-9ce6-831f3f877d12 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:16.780856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-edadcd81-ef20-4f1b-9ce6-831f3f877d12 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:16.781447 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-edadcd81-ef20-4f1b-9ce6-831f3f877d12 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:16.922568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bdca2cb4-b7a6-40bd-bfd6-bccf6ba53d24 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:16.923195 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bdca2cb4-b7a6-40bd-bfd6-bccf6ba53d24 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:16.942891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bdca2cb4-b7a6-40bd-bfd6-bccf6ba53d24 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:16.943403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bdca2cb4-b7a6-40bd-bfd6-bccf6ba53d24 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:16.943856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bdca2cb4-b7a6-40bd-bfd6-bccf6ba53d24 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:16.944590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bdca2cb4-b7a6-40bd-bfd6-bccf6ba53d24 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:16.945057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bdca2cb4-b7a6-40bd-bfd6-bccf6ba53d24 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:16.949751 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bdca2cb4-b7a6-40bd-bfd6-bccf6ba53d24 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:17.408276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-edadcd81-ef20-4f1b-9ce6-831f3f877d12 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:17.424802 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-edadcd81-ef20-4f1b-9ce6-831f3f877d12 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1505 microversion: 2.1 time: 0.669782 Aug 04 17:09:17.442874 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1741/3555] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:16 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1505 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:17.461834 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8f354d1d-76b2-445b-9525-433ac8df0079 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:17.463530 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8f354d1d-76b2-445b-9525-433ac8df0079 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:17.475887 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f354d1d-76b2-445b-9525-433ac8df0079 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:17.476396 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f354d1d-76b2-445b-9525-433ac8df0079 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:17.476842 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f354d1d-76b2-445b-9525-433ac8df0079 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:17.478130 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f354d1d-76b2-445b-9525-433ac8df0079 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:17.483139 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f354d1d-76b2-445b-9525-433ac8df0079 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:17.521699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f354d1d-76b2-445b-9525-433ac8df0079 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:17.531700 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bdca2cb4-b7a6-40bd-bfd6-bccf6ba53d24 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:17.546623 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bdca2cb4-b7a6-40bd-bfd6-bccf6ba53d24 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1517 microversion: 2.1 time: 0.627831 Aug 04 17:09:17.552191 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1815/3556] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:16 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1517 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:09:17.568886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c2dedf97-9553-4303-adcc-c7e0586d2f0f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:17.575164 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c2dedf97-9553-4303-adcc-c7e0586d2f0f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:17.583544 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2dedf97-9553-4303-adcc-c7e0586d2f0f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:17.586677 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2dedf97-9553-4303-adcc-c7e0586d2f0f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:17.587215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2dedf97-9553-4303-adcc-c7e0586d2f0f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:17.589940 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2dedf97-9553-4303-adcc-c7e0586d2f0f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:17.590652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2dedf97-9553-4303-adcc-c7e0586d2f0f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:17.591313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2dedf97-9553-4303-adcc-c7e0586d2f0f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:17.636016 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:17.730441 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8f354d1d-76b2-445b-9525-433ac8df0079 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:17.740532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8f354d1d-76b2-445b-9525-433ac8df0079 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:17.758220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8f354d1d-76b2-445b-9525-433ac8df0079 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:17.763518 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8f354d1d-76b2-445b-9525-433ac8df0079 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e" status: 200 len: 1335 microversion: 2.47 time: 0.317221 Aug 04 17:09:17.771270 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1742/3557] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:09:17 2022] GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e => generated 1335 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:09:18.313907 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c2dedf97-9553-4303-adcc-c7e0586d2f0f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:18.326510 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c2dedf97-9553-4303-adcc-c7e0586d2f0f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1683 microversion: 2.1 time: 0.773095 Aug 04 17:09:18.329502 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1816/3558] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:17 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1683 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:18.453003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-37159814-6c47-46f2-bf03-f693a1edd3b0 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:18.455018 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-37159814-6c47-46f2-bf03-f693a1edd3b0 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:18.482378 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37159814-6c47-46f2-bf03-f693a1edd3b0 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:18.482917 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37159814-6c47-46f2-bf03-f693a1edd3b0 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:18.485788 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37159814-6c47-46f2-bf03-f693a1edd3b0 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:18.489876 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37159814-6c47-46f2-bf03-f693a1edd3b0 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:18.490416 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37159814-6c47-46f2-bf03-f693a1edd3b0 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:18.494940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37159814-6c47-46f2-bf03-f693a1edd3b0 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:18.579630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6d9ca03f-35a2-4ce5-9261-dd6a3bdafa29 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:18.580422 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6d9ca03f-35a2-4ce5-9261-dd6a3bdafa29 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:18.609963 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d9ca03f-35a2-4ce5-9261-dd6a3bdafa29 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:18.610509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d9ca03f-35a2-4ce5-9261-dd6a3bdafa29 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:18.617323 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d9ca03f-35a2-4ce5-9261-dd6a3bdafa29 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:18.620115 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d9ca03f-35a2-4ce5-9261-dd6a3bdafa29 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:18.623117 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d9ca03f-35a2-4ce5-9261-dd6a3bdafa29 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:18.625225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d9ca03f-35a2-4ce5-9261-dd6a3bdafa29 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:19.223626 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6d9ca03f-35a2-4ce5-9261-dd6a3bdafa29 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:19.246820 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6d9ca03f-35a2-4ce5-9261-dd6a3bdafa29 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1517 microversion: 2.1 time: 0.666414 Aug 04 17:09:19.248288 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1817/3559] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:18 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1517 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:19.276605 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f2d0f3e8-b491-4161-a7de-ed6e1e876167 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:19.283169 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f2d0f3e8-b491-4161-a7de-ed6e1e876167 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:19.284316 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-37159814-6c47-46f2-bf03-f693a1edd3b0 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:19.297598 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-37159814-6c47-46f2-bf03-f693a1edd3b0 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1505 microversion: 2.1 time: 0.852496 Aug 04 17:09:19.298753 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1743/3560] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:18 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1505 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:09:19.308381 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2d0f3e8-b491-4161-a7de-ed6e1e876167 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:19.308909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2d0f3e8-b491-4161-a7de-ed6e1e876167 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:19.309682 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2d0f3e8-b491-4161-a7de-ed6e1e876167 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:19.334741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2d0f3e8-b491-4161-a7de-ed6e1e876167 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:19.335401 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2d0f3e8-b491-4161-a7de-ed6e1e876167 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:19.335826 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2d0f3e8-b491-4161-a7de-ed6e1e876167 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:19.351210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-68f6d223-dca0-42cf-aa50-2ba67f42e594 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:19.352007 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-68f6d223-dca0-42cf-aa50-2ba67f42e594 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:19.363530 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68f6d223-dca0-42cf-aa50-2ba67f42e594 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:19.368802 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68f6d223-dca0-42cf-aa50-2ba67f42e594 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:19.369159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68f6d223-dca0-42cf-aa50-2ba67f42e594 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:19.371329 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68f6d223-dca0-42cf-aa50-2ba67f42e594 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:19.371813 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68f6d223-dca0-42cf-aa50-2ba67f42e594 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:19.378418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68f6d223-dca0-42cf-aa50-2ba67f42e594 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:19.480530 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:19.700997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f2d0f3e8-b491-4161-a7de-ed6e1e876167 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:19.721081 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f2d0f3e8-b491-4161-a7de-ed6e1e876167 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:19.734535 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f2d0f3e8-b491-4161-a7de-ed6e1e876167 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:19.737463 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f2d0f3e8-b491-4161-a7de-ed6e1e876167 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e" status: 200 len: 1335 microversion: 2.47 time: 0.488042 Aug 04 17:09:19.740733 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1818/3561] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:09:19 2022] GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e => generated 1335 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:09:20.006993 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=4 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:20.010716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=12 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:20.019210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-358fad31-ab02-4f25-8b27-bc36d117b820 req-53120314-e24a-43b6-8087-1d06a5b0fb45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b", "name": "network-vif-unplugged", "status": "completed", "tag": "cd8f865e-af70-411c-8116-3a026f017637"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:20.047103 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-358fad31-ab02-4f25-8b27-bc36d117b820 req-53120314-e24a-43b6-8087-1d06a5b0fb45 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:20.048559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-358fad31-ab02-4f25-8b27-bc36d117b820 req-53120314-e24a-43b6-8087-1d06a5b0fb45 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:20.050885 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-358fad31-ab02-4f25-8b27-bc36d117b820 req-53120314-e24a-43b6-8087-1d06a5b0fb45 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:20.093592 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-358fad31-ab02-4f25-8b27-bc36d117b820 req-53120314-e24a-43b6-8087-1d06a5b0fb45 service nova] Creating event network-vif-unplugged:cd8f865e-af70-411c-8116-3a026f017637 for instance 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b on n-h2-851359-3 Aug 04 17:09:20.102855 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-68f6d223-dca0-42cf-aa50-2ba67f42e594 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:20.117218 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-68f6d223-dca0-42cf-aa50-2ba67f42e594 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1683 microversion: 2.1 time: 0.770378 Aug 04 17:09:20.120532 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-358fad31-ab02-4f25-8b27-bc36d117b820 req-53120314-e24a-43b6-8087-1d06a5b0fb45 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114578 Aug 04 17:09:20.122542 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1819/3562] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:09:20.126149 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1744/3563] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:19 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1683 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:09:20.269348 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-aef75a2d-aeaf-45bf-8259-e515d6b39089 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:20.270203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-aef75a2d-aeaf-45bf-8259-e515d6b39089 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:20.282239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aef75a2d-aeaf-45bf-8259-e515d6b39089 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:20.283472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aef75a2d-aeaf-45bf-8259-e515d6b39089 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:20.284556 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aef75a2d-aeaf-45bf-8259-e515d6b39089 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:20.285791 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aef75a2d-aeaf-45bf-8259-e515d6b39089 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:20.290360 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aef75a2d-aeaf-45bf-8259-e515d6b39089 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:20.292592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aef75a2d-aeaf-45bf-8259-e515d6b39089 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:20.321510 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e04dbf8c-6754-406f-825c-bb0c9ae1d0f9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:20.322109 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e04dbf8c-6754-406f-825c-bb0c9ae1d0f9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:20.353573 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e04dbf8c-6754-406f-825c-bb0c9ae1d0f9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:20.354161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e04dbf8c-6754-406f-825c-bb0c9ae1d0f9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:20.355174 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e04dbf8c-6754-406f-825c-bb0c9ae1d0f9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:20.356523 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e04dbf8c-6754-406f-825c-bb0c9ae1d0f9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:20.356997 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e04dbf8c-6754-406f-825c-bb0c9ae1d0f9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:20.360257 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e04dbf8c-6754-406f-825c-bb0c9ae1d0f9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:20.867008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:21.030456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-aef75a2d-aeaf-45bf-8259-e515d6b39089 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:21.040651 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-aef75a2d-aeaf-45bf-8259-e515d6b39089 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1535 microversion: 2.1 time: 0.775615 Aug 04 17:09:21.059357 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1820/3564] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:20 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1535 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:21.060000 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e04dbf8c-6754-406f-825c-bb0c9ae1d0f9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:21.073482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-53d95b37-ed06-4dab-b402-2a8218b30dad tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ac06449-f32f-4900-b6e1-3d091ce3fd88"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:21.077358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-53d95b37-ed06-4dab-b402-2a8218b30dad tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:21.085421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:21.088804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53d95b37-ed06-4dab-b402-2a8218b30dad tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:21.090670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53d95b37-ed06-4dab-b402-2a8218b30dad tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:21.091694 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e04dbf8c-6754-406f-825c-bb0c9ae1d0f9 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1505 microversion: 2.1 time: 0.774216 Aug 04 17:09:21.091985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53d95b37-ed06-4dab-b402-2a8218b30dad tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:21.093587 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53d95b37-ed06-4dab-b402-2a8218b30dad tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:21.094532 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53d95b37-ed06-4dab-b402-2a8218b30dad tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:21.095466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53d95b37-ed06-4dab-b402-2a8218b30dad tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:21.097308 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1745/3565] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:20 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1505 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:21.119662 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-28cdc7cf-002d-4199-bf50-c6a97e3ab4a9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:21.120360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-28cdc7cf-002d-4199-bf50-c6a97e3ab4a9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:21.146790 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28cdc7cf-002d-4199-bf50-c6a97e3ab4a9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:21.147295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28cdc7cf-002d-4199-bf50-c6a97e3ab4a9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:21.155446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28cdc7cf-002d-4199-bf50-c6a97e3ab4a9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:21.156298 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28cdc7cf-002d-4199-bf50-c6a97e3ab4a9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:21.156810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28cdc7cf-002d-4199-bf50-c6a97e3ab4a9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:21.157258 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28cdc7cf-002d-4199-bf50-c6a97e3ab4a9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:21.509757 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-28cdc7cf-002d-4199-bf50-c6a97e3ab4a9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:21.600775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-28cdc7cf-002d-4199-bf50-c6a97e3ab4a9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:21.609421 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-28cdc7cf-002d-4199-bf50-c6a97e3ab4a9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:21.614993 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-28cdc7cf-002d-4199-bf50-c6a97e3ab4a9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e" status: 200 len: 1335 microversion: 2.47 time: 0.513252 Aug 04 17:09:21.617321 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1746/3566] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:09:21 2022] GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e => generated 1335 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:09:21.632152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7d3f582d-5723-43cd-9c21-6a837c030a0a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:21.640165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7d3f582d-5723-43cd-9c21-6a837c030a0a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:21.643533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:21.661783 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d3f582d-5723-43cd-9c21-6a837c030a0a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:21.667519 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d3f582d-5723-43cd-9c21-6a837c030a0a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:21.670465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d3f582d-5723-43cd-9c21-6a837c030a0a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:21.673161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d3f582d-5723-43cd-9c21-6a837c030a0a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:21.674028 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d3f582d-5723-43cd-9c21-6a837c030a0a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:21.674472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d3f582d-5723-43cd-9c21-6a837c030a0a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:22.315912 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-53d95b37-ed06-4dab-b402-2a8218b30dad tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "POST /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.254345 Aug 04 17:09:22.318691 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1821/3567] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Aug 4 17:09:21 2022] POST /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3/os-volume_attachments => generated 194 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:09:22.345865 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8253d7fd-3fae-4392-87f7-7ba36dfb288d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:22.347017 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8253d7fd-3fae-4392-87f7-7ba36dfb288d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:22.374372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8253d7fd-3fae-4392-87f7-7ba36dfb288d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:22.376392 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8253d7fd-3fae-4392-87f7-7ba36dfb288d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:22.377410 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8253d7fd-3fae-4392-87f7-7ba36dfb288d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:22.378603 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8253d7fd-3fae-4392-87f7-7ba36dfb288d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:22.381165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8253d7fd-3fae-4392-87f7-7ba36dfb288d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:22.382426 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8253d7fd-3fae-4392-87f7-7ba36dfb288d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:23.631811 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8253d7fd-3fae-4392-87f7-7ba36dfb288d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:23.643240 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8253d7fd-3fae-4392-87f7-7ba36dfb288d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1523 microversion: 2.1 time: 1.323083 Aug 04 17:09:23.655657 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1822/3568] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:22 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1523 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:23.662803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7c7d4e1d-cbca-45aa-86bb-87189a61bb4c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:23.663720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7c7d4e1d-cbca-45aa-86bb-87189a61bb4c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:23.695207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c7d4e1d-cbca-45aa-86bb-87189a61bb4c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:23.701653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c7d4e1d-cbca-45aa-86bb-87189a61bb4c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:23.705547 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c7d4e1d-cbca-45aa-86bb-87189a61bb4c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:23.706645 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c7d4e1d-cbca-45aa-86bb-87189a61bb4c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:23.708260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c7d4e1d-cbca-45aa-86bb-87189a61bb4c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:23.714538 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c7d4e1d-cbca-45aa-86bb-87189a61bb4c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:23.879608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7d3f582d-5723-43cd-9c21-6a837c030a0a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:23.906777 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7d3f582d-5723-43cd-9c21-6a837c030a0a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 2.274527 Aug 04 17:09:23.927670 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1747/3569] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:21 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 2301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:23.951916 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9859396a-490c-479b-a6a1-b227b045b96d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:23.952624 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9859396a-490c-479b-a6a1-b227b045b96d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:23.987085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9859396a-490c-479b-a6a1-b227b045b96d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:23.988968 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9859396a-490c-479b-a6a1-b227b045b96d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:23.989683 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9859396a-490c-479b-a6a1-b227b045b96d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:24.011387 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9859396a-490c-479b-a6a1-b227b045b96d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:24.018940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9859396a-490c-479b-a6a1-b227b045b96d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:24.019616 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9859396a-490c-479b-a6a1-b227b045b96d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:24.325957 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9859396a-490c-479b-a6a1-b227b045b96d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:24.351402 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9859396a-490c-479b-a6a1-b227b045b96d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:24.360209 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9859396a-490c-479b-a6a1-b227b045b96d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:24.366351 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9859396a-490c-479b-a6a1-b227b045b96d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e" status: 200 len: 1356 microversion: 2.47 time: 0.436459 Aug 04 17:09:24.368576 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1748/3570] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:09:23 2022] GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e => generated 1356 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:09:24.376666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1f500b88-8aed-4f19-83e8-6e37f1dff3ac tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:24.379022 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1f500b88-8aed-4f19-83e8-6e37f1dff3ac tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:24.432342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f500b88-8aed-4f19-83e8-6e37f1dff3ac tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:24.433220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f500b88-8aed-4f19-83e8-6e37f1dff3ac tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:24.433901 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f500b88-8aed-4f19-83e8-6e37f1dff3ac tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:24.437250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f500b88-8aed-4f19-83e8-6e37f1dff3ac tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:24.441349 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f500b88-8aed-4f19-83e8-6e37f1dff3ac tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:24.441818 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f500b88-8aed-4f19-83e8-6e37f1dff3ac tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:25.832181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7c7d4e1d-cbca-45aa-86bb-87189a61bb4c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:25.850400 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7c7d4e1d-cbca-45aa-86bb-87189a61bb4c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 200 len: 1505 microversion: 2.1 time: 2.193228 Aug 04 17:09:25.855116 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1823/3571] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:23 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 1505 bytes in 2199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:25.878994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9483de99-969c-400e-b11b-eee27eb0c0ea tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:25.895782 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9483de99-969c-400e-b11b-eee27eb0c0ea tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:25.925578 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9483de99-969c-400e-b11b-eee27eb0c0ea tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:25.926173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9483de99-969c-400e-b11b-eee27eb0c0ea tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:25.926634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9483de99-969c-400e-b11b-eee27eb0c0ea tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:25.927374 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9483de99-969c-400e-b11b-eee27eb0c0ea tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:25.927845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9483de99-969c-400e-b11b-eee27eb0c0ea tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:25.928283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9483de99-969c-400e-b11b-eee27eb0c0ea tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:26.027045 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1f500b88-8aed-4f19-83e8-6e37f1dff3ac tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:26.047605 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1f500b88-8aed-4f19-83e8-6e37f1dff3ac tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 1.677677 Aug 04 17:09:26.051922 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1749/3572] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:24 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 1682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:26.069787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-99df6aae-7768-4790-a126-71184fc82b68 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:26.070991 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-99df6aae-7768-4790-a126-71184fc82b68 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:26.104973 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99df6aae-7768-4790-a126-71184fc82b68 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:26.107583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99df6aae-7768-4790-a126-71184fc82b68 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:26.108395 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99df6aae-7768-4790-a126-71184fc82b68 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:26.109794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99df6aae-7768-4790-a126-71184fc82b68 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:26.113818 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99df6aae-7768-4790-a126-71184fc82b68 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:26.114590 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99df6aae-7768-4790-a126-71184fc82b68 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:26.303629 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-9483de99-969c-400e-b11b-eee27eb0c0ea tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:09:26.309142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-9483de99-969c-400e-b11b-eee27eb0c0ea tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:09:26.309814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-9483de99-969c-400e-b11b-eee27eb0c0ea tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:09:26.311077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-9483de99-969c-400e-b11b-eee27eb0c0ea tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:09:26.312847 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-9483de99-969c-400e-b11b-eee27eb0c0ea tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:09:26.519171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9483de99-969c-400e-b11b-eee27eb0c0ea tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:26.552321 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9483de99-969c-400e-b11b-eee27eb0c0ea tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:26.552939 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9483de99-969c-400e-b11b-eee27eb0c0ea tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:26.553409 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9483de99-969c-400e-b11b-eee27eb0c0ea tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:26.557273 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9483de99-969c-400e-b11b-eee27eb0c0ea tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:26.557796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9483de99-969c-400e-b11b-eee27eb0c0ea tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:26.558280 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9483de99-969c-400e-b11b-eee27eb0c0ea tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:26.689645 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9483de99-969c-400e-b11b-eee27eb0c0ea tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "POST /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e/action" status: 202 len: 1078 microversion: 2.47 time: 0.832890 Aug 04 17:09:26.695529 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1824/3573] 10.222.0.93 () {62 vars in 1319 bytes} [Thu Aug 4 17:09:25 2022] POST /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e/action => generated 1078 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 04 17:09:26.717474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-eabb0840-8e6f-426d-af09-72786a0432f7 req-0ecf9d56-b1f3-4d13-8fd7-6f5280fa55e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b", "name": "network-vif-deleted", "tag": "cd8f865e-af70-411c-8116-3a026f017637"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:26.754462 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-eabb0840-8e6f-426d-af09-72786a0432f7 req-0ecf9d56-b1f3-4d13-8fd7-6f5280fa55e0 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:26.758784 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-eabb0840-8e6f-426d-af09-72786a0432f7 req-0ecf9d56-b1f3-4d13-8fd7-6f5280fa55e0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:26.761801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-eabb0840-8e6f-426d-af09-72786a0432f7 req-0ecf9d56-b1f3-4d13-8fd7-6f5280fa55e0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:26.832412 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-eabb0840-8e6f-426d-af09-72786a0432f7 req-0ecf9d56-b1f3-4d13-8fd7-6f5280fa55e0 service nova] Creating event network-vif-deleted:cd8f865e-af70-411c-8116-3a026f017637 for instance 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b on n-h2-851359-3 Aug 04 17:09:26.847429 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-eabb0840-8e6f-426d-af09-72786a0432f7 req-0ecf9d56-b1f3-4d13-8fd7-6f5280fa55e0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146036 Aug 04 17:09:26.849309 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1825/3574] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:09:26.872954 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-39550a8e-039a-48ff-a4d1-1d9abf749d79 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:26.874372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-39550a8e-039a-48ff-a4d1-1d9abf749d79 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:26.917968 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39550a8e-039a-48ff-a4d1-1d9abf749d79 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:26.925825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39550a8e-039a-48ff-a4d1-1d9abf749d79 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:26.926455 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39550a8e-039a-48ff-a4d1-1d9abf749d79 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:26.928662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39550a8e-039a-48ff-a4d1-1d9abf749d79 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:26.931030 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39550a8e-039a-48ff-a4d1-1d9abf749d79 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:26.935815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39550a8e-039a-48ff-a4d1-1d9abf749d79 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:28.214798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-39550a8e-039a-48ff-a4d1-1d9abf749d79 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:28.239395 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-39550a8e-039a-48ff-a4d1-1d9abf749d79 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:28.248346 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-39550a8e-039a-48ff-a4d1-1d9abf749d79 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:28.249938 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-39550a8e-039a-48ff-a4d1-1d9abf749d79 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e" status: 200 len: 1365 microversion: 2.47 time: 1.399226 Aug 04 17:09:28.256361 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1826/3575] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:09:26 2022] GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e => generated 1365 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:09:28.287312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c8465e3c-4671-477b-a9f2-5fb7f7d51b2b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:28.293701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c8465e3c-4671-477b-a9f2-5fb7f7d51b2b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:28.335466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8465e3c-4671-477b-a9f2-5fb7f7d51b2b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:28.337920 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8465e3c-4671-477b-a9f2-5fb7f7d51b2b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:28.339753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8465e3c-4671-477b-a9f2-5fb7f7d51b2b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:28.346536 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-99df6aae-7768-4790-a126-71184fc82b68 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:28.353618 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8465e3c-4671-477b-a9f2-5fb7f7d51b2b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:28.361319 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8465e3c-4671-477b-a9f2-5fb7f7d51b2b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:28.363923 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-99df6aae-7768-4790-a126-71184fc82b68 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1523 microversion: 2.1 time: 2.310817 Aug 04 17:09:28.368605 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8465e3c-4671-477b-a9f2-5fb7f7d51b2b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:28.370421 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1750/3576] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:26 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1523 bytes in 2318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:28.394604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-e63a2ed2-b985-4844-80c3-11ba1f4aff4e req-c1483c25-52c7-49b3-bf2e-7cfbf9dc7b02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10991c59-c7d8-447e-8f2b-3f5ea5d8d62a", "name": "network-vif-unplugged", "status": "completed", "tag": "d34d92ed-1a8a-4623-be8e-630b78a99ac4"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:28.418651 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-c8465e3c-4671-477b-a9f2-5fb7f7d51b2b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] HTTP exception thrown: Instance 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b could not be found. Aug 04 17:09:28.432196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e63a2ed2-b985-4844-80c3-11ba1f4aff4e req-c1483c25-52c7-49b3-bf2e-7cfbf9dc7b02 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c8465e3c-4671-477b-a9f2-5fb7f7d51b2b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Request method failure captured: Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b HTTP/1.1 Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_yeABS_GyFFTH1o7T1ZhmNeUFjBREIEcha6wxMSD_Cy4Rj8_oCTyfiRrlXMOdnUf3l-6oPqyGMa3FitRhOV33tPoUX4lDTo_p7OUp70vvWwUGZiUNF_opchNFr4cZ6RSGVd6prZFbohhBh36SvPeZyDSUydDWLo-MawC_eBFNCwyQQ Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 383c0418c5f849128e0a384ccdc434b4 Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerRescueTestJSON-1578373332 Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/383c0418c5f849128e0a384ccdc434b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/383c0418c5f849128e0a384ccdc434b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_383c0418c5f849128e0a384ccdc434b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/383c0418c5f849128e0a384ccdc434b4"}]}] Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerRescueTestJSON-1578373332 Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 383c0418c5f849128e0a384ccdc434b4 Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerRescueTestJSON-1578373332 Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerRescueTestJSON-1578373332-project Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: aae152a1d00c40409aa78f8a5cff5895 Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerRescueTestJSON-1578373332-project Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b could not be found. Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b'} Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b could not be found. Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b could not be found. Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:09:28.433503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:09:28.439023 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:09:28.439023 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:09:28.439023 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:09:28.439023 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:09:28.439023 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:09:28.439023 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b could not be found. Aug 04 17:09:28.439023 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:09:28.439961 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c8465e3c-4671-477b-a9f2-5fb7f7d51b2b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Returning 404 to user: Instance 8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:09:28.441768 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e63a2ed2-b985-4844-80c3-11ba1f4aff4e req-c1483c25-52c7-49b3-bf2e-7cfbf9dc7b02 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:28.443011 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c8465e3c-4671-477b-a9f2-5fb7f7d51b2b tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b" status: 404 len: 111 microversion: 2.1 time: 0.181293 Aug 04 17:09:28.443713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e63a2ed2-b985-4844-80c3-11ba1f4aff4e req-c1483c25-52c7-49b3-bf2e-7cfbf9dc7b02 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:28.456610 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1827/3577] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:28 2022] GET /compute/v2.1/servers/8a7b53cf-6d35-4056-b7f3-8ce4c364ad2b => generated 111 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:09:28.462759 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-76977ace-cb3f-4aa8-ac90-5cb9ad250833 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:28.477540 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-76977ace-cb3f-4aa8-ac90-5cb9ad250833 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:28.497847 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76977ace-cb3f-4aa8-ac90-5cb9ad250833 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:28.500848 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-e63a2ed2-b985-4844-80c3-11ba1f4aff4e req-c1483c25-52c7-49b3-bf2e-7cfbf9dc7b02 service nova] Creating event network-vif-unplugged:d34d92ed-1a8a-4623-be8e-630b78a99ac4 for instance 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a on n-h1-851359-3 Aug 04 17:09:28.501711 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76977ace-cb3f-4aa8-ac90-5cb9ad250833 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:28.502478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76977ace-cb3f-4aa8-ac90-5cb9ad250833 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:28.503638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76977ace-cb3f-4aa8-ac90-5cb9ad250833 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:28.504371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76977ace-cb3f-4aa8-ac90-5cb9ad250833 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:28.505580 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76977ace-cb3f-4aa8-ac90-5cb9ad250833 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:28.519012 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-e63a2ed2-b985-4844-80c3-11ba1f4aff4e req-c1483c25-52c7-49b3-bf2e-7cfbf9dc7b02 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.143886 Aug 04 17:09:28.526593 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1751/3578] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:09:28.550168 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ccd36574-e10d-4e8b-a6f0-f71f4f7758b3 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:28.556653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ccd36574-e10d-4e8b-a6f0-f71f4f7758b3 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:28.587747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ccd36574-e10d-4e8b-a6f0-f71f4f7758b3 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:28.589748 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ccd36574-e10d-4e8b-a6f0-f71f4f7758b3 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:28.590423 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ccd36574-e10d-4e8b-a6f0-f71f4f7758b3 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:28.601229 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ccd36574-e10d-4e8b-a6f0-f71f4f7758b3 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:28.603898 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ccd36574-e10d-4e8b-a6f0-f71f4f7758b3 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:28.604781 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ccd36574-e10d-4e8b-a6f0-f71f4f7758b3 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:28.673961 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ccd36574-e10d-4e8b-a6f0-f71f4f7758b3 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:09:28.826902 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ccd36574-e10d-4e8b-a6f0-f71f4f7758b3 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "DELETE /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 204 len: 0 microversion: 2.1 time: 0.298054 Aug 04 17:09:28.834526 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1752/3579] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:09:28 2022] DELETE /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:09:28.851623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eef46885-d8c3-479f-ba57-1b9ffd547c2c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:28.856577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eef46885-d8c3-479f-ba57-1b9ffd547c2c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:28.875933 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eef46885-d8c3-479f-ba57-1b9ffd547c2c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:28.878466 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eef46885-d8c3-479f-ba57-1b9ffd547c2c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:28.883492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eef46885-d8c3-479f-ba57-1b9ffd547c2c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:28.884866 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eef46885-d8c3-479f-ba57-1b9ffd547c2c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:28.886551 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eef46885-d8c3-479f-ba57-1b9ffd547c2c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:28.887264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eef46885-d8c3-479f-ba57-1b9ffd547c2c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:29.467434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eef46885-d8c3-479f-ba57-1b9ffd547c2c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:29.478907 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eef46885-d8c3-479f-ba57-1b9ffd547c2c tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1490 microversion: 2.1 time: 0.639416 Aug 04 17:09:29.481803 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1753/3580] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:28 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1490 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:29.493602 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-98ab70e4-7159-48da-9f8b-c2b4d9ed83e7 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:29.494860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-98ab70e4-7159-48da-9f8b-c2b4d9ed83e7 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:29.529314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98ab70e4-7159-48da-9f8b-c2b4d9ed83e7 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:29.535465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98ab70e4-7159-48da-9f8b-c2b4d9ed83e7 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:29.536629 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98ab70e4-7159-48da-9f8b-c2b4d9ed83e7 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:29.542375 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98ab70e4-7159-48da-9f8b-c2b4d9ed83e7 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:29.544515 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98ab70e4-7159-48da-9f8b-c2b4d9ed83e7 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:29.548429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98ab70e4-7159-48da-9f8b-c2b4d9ed83e7 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:29.656118 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-76977ace-cb3f-4aa8-ac90-5cb9ad250833 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:29.671132 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-76977ace-cb3f-4aa8-ac90-5cb9ad250833 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 1.212602 Aug 04 17:09:29.684356 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1828/3581] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:28 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:29.703651 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e3297a87-b033-4b0e-aa9a-0c481419cafb tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:29.704291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e3297a87-b033-4b0e-aa9a-0c481419cafb tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:29.719189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e3297a87-b033-4b0e-aa9a-0c481419cafb tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:29.722632 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e3297a87-b033-4b0e-aa9a-0c481419cafb tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:29.723314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e3297a87-b033-4b0e-aa9a-0c481419cafb tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:29.724247 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e3297a87-b033-4b0e-aa9a-0c481419cafb tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:29.727834 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e3297a87-b033-4b0e-aa9a-0c481419cafb tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:29.737457 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e3297a87-b033-4b0e-aa9a-0c481419cafb tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:29.810342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-98ab70e4-7159-48da-9f8b-c2b4d9ed83e7 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:29.824403 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-98ab70e4-7159-48da-9f8b-c2b4d9ed83e7 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:29.829239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-98ab70e4-7159-48da-9f8b-c2b4d9ed83e7 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:29.838498 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-98ab70e4-7159-48da-9f8b-c2b4d9ed83e7 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e" status: 200 len: 1365 microversion: 2.47 time: 0.354597 Aug 04 17:09:29.855289 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1754/3582] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:09:29 2022] GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e => generated 1365 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:09:29.894682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-44220761-b23d-4766-b231-0b34d31a0ac6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:29.898079 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-44220761-b23d-4766-b231-0b34d31a0ac6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:29.909458 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44220761-b23d-4766-b231-0b34d31a0ac6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:29.925053 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44220761-b23d-4766-b231-0b34d31a0ac6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:29.925713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44220761-b23d-4766-b231-0b34d31a0ac6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:29.926649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44220761-b23d-4766-b231-0b34d31a0ac6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:29.927388 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44220761-b23d-4766-b231-0b34d31a0ac6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:29.928089 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44220761-b23d-4766-b231-0b34d31a0ac6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:30.190949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e3297a87-b033-4b0e-aa9a-0c481419cafb tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:30.205449 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e3297a87-b033-4b0e-aa9a-0c481419cafb tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1523 microversion: 2.1 time: 0.519843 Aug 04 17:09:30.207834 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1829/3583] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:29 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1523 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:30.349357 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-44220761-b23d-4766-b231-0b34d31a0ac6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:30.361493 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-44220761-b23d-4766-b231-0b34d31a0ac6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.503751 Aug 04 17:09:30.371376 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1755/3584] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:29 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:30.391194 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b352cbbb-cf7a-4b57-81ff-f1fe806165da tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:30.392161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b352cbbb-cf7a-4b57-81ff-f1fe806165da tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:30.405887 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b352cbbb-cf7a-4b57-81ff-f1fe806165da tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:30.408005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b352cbbb-cf7a-4b57-81ff-f1fe806165da tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:30.408700 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b352cbbb-cf7a-4b57-81ff-f1fe806165da tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:30.409955 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b352cbbb-cf7a-4b57-81ff-f1fe806165da tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:30.412586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b352cbbb-cf7a-4b57-81ff-f1fe806165da tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:30.413289 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b352cbbb-cf7a-4b57-81ff-f1fe806165da tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:30.472573 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ae2239ca-9659-49a6-8f89-cf4eae4fe11a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1216698525", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:30.619092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-ae2239ca-9659-49a6-8f89-cf4eae4fe11a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] validate_networks() for [('0112e6ac-257e-4b1b-a397-d0c577c627fb', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:09:30.851037 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b352cbbb-cf7a-4b57-81ff-f1fe806165da tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:30.877532 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b352cbbb-cf7a-4b57-81ff-f1fe806165da tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.490592 Aug 04 17:09:30.890638 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1756/3585] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:30 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:09:30.919156 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b17407d2-c724-4d90-bbde-08dfc34535d1 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:30.920895 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b17407d2-c724-4d90-bbde-08dfc34535d1 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:30.940483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b17407d2-c724-4d90-bbde-08dfc34535d1 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:30.942935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b17407d2-c724-4d90-bbde-08dfc34535d1 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:30.943581 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b17407d2-c724-4d90-bbde-08dfc34535d1 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:30.944639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b17407d2-c724-4d90-bbde-08dfc34535d1 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:30.946362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b17407d2-c724-4d90-bbde-08dfc34535d1 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:30.948926 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b17407d2-c724-4d90-bbde-08dfc34535d1 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:31.842215 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b17407d2-c724-4d90-bbde-08dfc34535d1 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:31.850290 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b17407d2-c724-4d90-bbde-08dfc34535d1 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1490 microversion: 2.1 time: 0.958103 Aug 04 17:09:31.850881 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1757/3586] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:30 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1490 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:31.878050 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-481b05e6-d106-4507-a708-8444b979dcb7 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:31.879906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-481b05e6-d106-4507-a708-8444b979dcb7 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:31.892702 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-481b05e6-d106-4507-a708-8444b979dcb7 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:31.899666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-481b05e6-d106-4507-a708-8444b979dcb7 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:31.900440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-481b05e6-d106-4507-a708-8444b979dcb7 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:31.901889 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-481b05e6-d106-4507-a708-8444b979dcb7 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:31.903478 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-481b05e6-d106-4507-a708-8444b979dcb7 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:31.904389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-481b05e6-d106-4507-a708-8444b979dcb7 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:32.459876 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-ae2239ca-9659-49a6-8f89-cf4eae4fe11a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:09:32.460467 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-ae2239ca-9659-49a6-8f89-cf4eae4fe11a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:09:32.461036 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-ae2239ca-9659-49a6-8f89-cf4eae4fe11a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:09:32.461456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-ae2239ca-9659-49a6-8f89-cf4eae4fe11a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:09:32.461892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-ae2239ca-9659-49a6-8f89-cf4eae4fe11a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:09:32.477189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae2239ca-9659-49a6-8f89-cf4eae4fe11a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:32.481893 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae2239ca-9659-49a6-8f89-cf4eae4fe11a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:32.482626 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae2239ca-9659-49a6-8f89-cf4eae4fe11a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:32.483619 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae2239ca-9659-49a6-8f89-cf4eae4fe11a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:32.484373 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae2239ca-9659-49a6-8f89-cf4eae4fe11a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:32.484982 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae2239ca-9659-49a6-8f89-cf4eae4fe11a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:32.531407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-481b05e6-d106-4507-a708-8444b979dcb7 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:32.547820 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-481b05e6-d106-4507-a708-8444b979dcb7 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:32.555645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-481b05e6-d106-4507-a708-8444b979dcb7 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:32.568921 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-481b05e6-d106-4507-a708-8444b979dcb7 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e" status: 200 len: 1365 microversion: 2.47 time: 0.704793 Aug 04 17:09:32.573812 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1758/3587] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:09:31 2022] GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e => generated 1365 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:09:32.577648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-ae2239ca-9659-49a6-8f89-cf4eae4fe11a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Getting quotas for project 50d2f7cd670340adb1b4187754e302c5. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:09:32.591608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a3583ba9-aac8-4723-acc5-3e54197d8d32 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:32.601399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-ae2239ca-9659-49a6-8f89-cf4eae4fe11a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Getting quotas for user 067e98d624234a48bb0ea3bde77c049c and project 50d2f7cd670340adb1b4187754e302c5. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:09:32.606731 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a3583ba9-aac8-4723-acc5-3e54197d8d32 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:32.638973 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3583ba9-aac8-4723-acc5-3e54197d8d32 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:32.639407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3583ba9-aac8-4723-acc5-3e54197d8d32 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:32.650398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3583ba9-aac8-4723-acc5-3e54197d8d32 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:32.651353 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3583ba9-aac8-4723-acc5-3e54197d8d32 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:32.651772 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3583ba9-aac8-4723-acc5-3e54197d8d32 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:32.652226 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3583ba9-aac8-4723-acc5-3e54197d8d32 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:32.668395 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ae2239ca-9659-49a6-8f89-cf4eae4fe11a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:09:32.686557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ae2239ca-9659-49a6-8f89-cf4eae4fe11a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:09:32.841527 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ae2239ca-9659-49a6-8f89-cf4eae4fe11a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.468121 Aug 04 17:09:32.848829 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1830/3588] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:09:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 2476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:09:32.867542 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6a680b96-cf4f-4f53-8cc2-5afd69c7877b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:32.892840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6a680b96-cf4f-4f53-8cc2-5afd69c7877b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:32.902381 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:32.986404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a680b96-cf4f-4f53-8cc2-5afd69c7877b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:32.992366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a680b96-cf4f-4f53-8cc2-5afd69c7877b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:32.995679 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a680b96-cf4f-4f53-8cc2-5afd69c7877b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:32.998439 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a680b96-cf4f-4f53-8cc2-5afd69c7877b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:32.999834 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a680b96-cf4f-4f53-8cc2-5afd69c7877b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:33.001619 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a680b96-cf4f-4f53-8cc2-5afd69c7877b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:33.035393 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a3583ba9-aac8-4723-acc5-3e54197d8d32 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action" status: 202 len: 0 microversion: 2.1 time: 0.450801 Aug 04 17:09:33.041735 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1759/3589] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:09:32 2022] POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:09:33.077738 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dbd3c43d-9907-4fed-9297-a7454a97dd0b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:33.080469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dbd3c43d-9907-4fed-9297-a7454a97dd0b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:33.510043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dbd3c43d-9907-4fed-9297-a7454a97dd0b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:33.521476 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dbd3c43d-9907-4fed-9297-a7454a97dd0b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 200 len: 1222 microversion: 2.1 time: 0.477895 Aug 04 17:09:33.527330 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1760/3590] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:33 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 1222 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:33.579281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-48e6f538-252c-48c3-8ccf-a8d5b1ef9a73 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:33.580933 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-48e6f538-252c-48c3-8ccf-a8d5b1ef9a73 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:33.589488 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48e6f538-252c-48c3-8ccf-a8d5b1ef9a73 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:33.595477 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48e6f538-252c-48c3-8ccf-a8d5b1ef9a73 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:33.596773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48e6f538-252c-48c3-8ccf-a8d5b1ef9a73 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:33.598129 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48e6f538-252c-48c3-8ccf-a8d5b1ef9a73 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:33.612682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48e6f538-252c-48c3-8ccf-a8d5b1ef9a73 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:33.613377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48e6f538-252c-48c3-8ccf-a8d5b1ef9a73 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:33.791089 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48e6f538-252c-48c3-8ccf-a8d5b1ef9a73 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:33.793340 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48e6f538-252c-48c3-8ccf-a8d5b1ef9a73 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:33.797009 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48e6f538-252c-48c3-8ccf-a8d5b1ef9a73 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:33.803775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-48e6f538-252c-48c3-8ccf-a8d5b1ef9a73 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lazy-loading 'fault' on Instance uuid 080c5631-1dd7-457e-958f-67acaed8f46a {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:09:34.172670 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-48e6f538-252c-48c3-8ccf-a8d5b1ef9a73 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae152a1d00c40409aa78f8a5cff5895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '383c0418c5f849128e0a384ccdc434b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:34.186836 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-48e6f538-252c-48c3-8ccf-a8d5b1ef9a73 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 200 len: 1302 microversion: 2.1 time: 0.656495 Aug 04 17:09:34.202488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6a680b96-cf4f-4f53-8cc2-5afd69c7877b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:34.215561 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1761/3591] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:33 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 1302 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:34.217373 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6a680b96-cf4f-4f53-8cc2-5afd69c7877b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1523 microversion: 2.1 time: 1.365947 Aug 04 17:09:34.218611 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1831/3592] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:32 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1523 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:34.228865 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3c95ffc8-0403-44e3-9452-2e37224f5eb4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:34.229921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3c95ffc8-0403-44e3-9452-2e37224f5eb4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:34.248012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-213f1131-d736-42a3-8980-0111bfef9268 req-385a6665-15df-4495-8c3b-49cf0d1b03ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "080c5631-1dd7-457e-958f-67acaed8f46a", "name": "network-vif-deleted", "tag": "870ab345-d84e-4fe2-a244-c6a7e5745c86"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:34.250867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3c95ffc8-0403-44e3-9452-2e37224f5eb4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:34.254096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3c95ffc8-0403-44e3-9452-2e37224f5eb4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:34.258807 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3c95ffc8-0403-44e3-9452-2e37224f5eb4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:34.259953 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3c95ffc8-0403-44e3-9452-2e37224f5eb4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:34.260671 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3c95ffc8-0403-44e3-9452-2e37224f5eb4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:34.261457 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3c95ffc8-0403-44e3-9452-2e37224f5eb4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:34.293572 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-213f1131-d736-42a3-8980-0111bfef9268 req-385a6665-15df-4495-8c3b-49cf0d1b03ab service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:34.297833 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-213f1131-d736-42a3-8980-0111bfef9268 req-385a6665-15df-4495-8c3b-49cf0d1b03ab service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:34.302686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-213f1131-d736-42a3-8980-0111bfef9268 req-385a6665-15df-4495-8c3b-49cf0d1b03ab service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:34.351769 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:34.370297 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-213f1131-d736-42a3-8980-0111bfef9268 req-385a6665-15df-4495-8c3b-49cf0d1b03ab service nova] Creating event network-vif-deleted:870ab345-d84e-4fe2-a244-c6a7e5745c86 for instance 080c5631-1dd7-457e-958f-67acaed8f46a on n-h1-851359-3 Aug 04 17:09:34.388635 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-213f1131-d736-42a3-8980-0111bfef9268 req-385a6665-15df-4495-8c3b-49cf0d1b03ab service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168059 Aug 04 17:09:34.394625 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1762/3593] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:09:34.410303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-34f22dfc-ce26-40ff-9e0c-600b3e42405f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:34.419814 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-34f22dfc-ce26-40ff-9e0c-600b3e42405f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:34.436124 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34f22dfc-ce26-40ff-9e0c-600b3e42405f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:34.443880 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34f22dfc-ce26-40ff-9e0c-600b3e42405f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:34.448873 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34f22dfc-ce26-40ff-9e0c-600b3e42405f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:34.451629 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34f22dfc-ce26-40ff-9e0c-600b3e42405f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:34.454144 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34f22dfc-ce26-40ff-9e0c-600b3e42405f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:34.466851 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34f22dfc-ce26-40ff-9e0c-600b3e42405f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:34.904181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-34f22dfc-ce26-40ff-9e0c-600b3e42405f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:34.915150 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-34f22dfc-ce26-40ff-9e0c-600b3e42405f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:34.916557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-34f22dfc-ce26-40ff-9e0c-600b3e42405f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:34.917741 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-34f22dfc-ce26-40ff-9e0c-600b3e42405f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e" status: 200 len: 1365 microversion: 2.47 time: 0.521631 Aug 04 17:09:34.918334 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1763/3594] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:09:34 2022] GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e => generated 1365 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:09:34.939789 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e7d29ad2-d3d6-4012-a6ef-c0d60ab8cabd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-398698711", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:35.065631 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-e7d29ad2-d3d6-4012-a6ef-c0d60ab8cabd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] validate_networks() for [('0112e6ac-257e-4b1b-a397-d0c577c627fb', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:09:35.268686 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3c95ffc8-0403-44e3-9452-2e37224f5eb4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:35.276484 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3c95ffc8-0403-44e3-9452-2e37224f5eb4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1672 microversion: 2.1 time: 1.056496 Aug 04 17:09:35.296443 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1832/3595] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:34 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1672 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:35.302005 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-dc4568b1-0b6d-49c8-9f48-5a97b7f0ca8b req-ee5c3d29-44cb-4e98-8914-e0e5a585d1c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a592dcbd-6b85-4d18-acdb-82f579be9067", "name": "network-vif-plugged", "status": "completed", "tag": "50ccfc29-071f-4ee9-b4b3-d1abf0c5facb"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:35.328748 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-dc4568b1-0b6d-49c8-9f48-5a97b7f0ca8b req-ee5c3d29-44cb-4e98-8914-e0e5a585d1c9 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:35.329238 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-dc4568b1-0b6d-49c8-9f48-5a97b7f0ca8b req-ee5c3d29-44cb-4e98-8914-e0e5a585d1c9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:35.329678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-dc4568b1-0b6d-49c8-9f48-5a97b7f0ca8b req-ee5c3d29-44cb-4e98-8914-e0e5a585d1c9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:35.404011 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-dc4568b1-0b6d-49c8-9f48-5a97b7f0ca8b req-ee5c3d29-44cb-4e98-8914-e0e5a585d1c9 service nova] Creating event network-vif-plugged:50ccfc29-071f-4ee9-b4b3-d1abf0c5facb for instance a592dcbd-6b85-4d18-acdb-82f579be9067 on n-h1-851359-3 Aug 04 17:09:35.418112 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-dc4568b1-0b6d-49c8-9f48-5a97b7f0ca8b req-ee5c3d29-44cb-4e98-8914-e0e5a585d1c9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113757 Aug 04 17:09:35.419061 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1833/3596] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:09:35.439804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e30605ec-f801-46ec-9b5c-6d7ff7a14703 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:35.440521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e30605ec-f801-46ec-9b5c-6d7ff7a14703 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] [instance: 080c5631-1dd7-457e-958f-67acaed8f46a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:35.461836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e30605ec-f801-46ec-9b5c-6d7ff7a14703 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:35.462481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e30605ec-f801-46ec-9b5c-6d7ff7a14703 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:35.462938 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e30605ec-f801-46ec-9b5c-6d7ff7a14703 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:35.479524 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e30605ec-f801-46ec-9b5c-6d7ff7a14703 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:35.480084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e30605ec-f801-46ec-9b5c-6d7ff7a14703 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:35.480533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e30605ec-f801-46ec-9b5c-6d7ff7a14703 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:35.539983 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-e30605ec-f801-46ec-9b5c-6d7ff7a14703 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] HTTP exception thrown: Instance 080c5631-1dd7-457e-958f-67acaed8f46a could not be found. Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e30605ec-f801-46ec-9b5c-6d7ff7a14703 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Request method failure captured: Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a HTTP/1.1 Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_yeABS_GyFFTH1o7T1ZhmNeUFjBREIEcha6wxMSD_Cy4Rj8_oCTyfiRrlXMOdnUf3l-6oPqyGMa3FitRhOV33tPoUX4lDTo_p7OUp70vvWwUGZiUNF_opchNFr4cZ6RSGVd6prZFbohhBh36SvPeZyDSUydDWLo-MawC_eBFNCwyQQ Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 383c0418c5f849128e0a384ccdc434b4 Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerRescueTestJSON-1578373332 Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/383c0418c5f849128e0a384ccdc434b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/383c0418c5f849128e0a384ccdc434b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_383c0418c5f849128e0a384ccdc434b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/383c0418c5f849128e0a384ccdc434b4"}]}] Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerRescueTestJSON-1578373332 Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 383c0418c5f849128e0a384ccdc434b4 Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerRescueTestJSON-1578373332 Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerRescueTestJSON-1578373332-project Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: aae152a1d00c40409aa78f8a5cff5895 Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerRescueTestJSON-1578373332-project Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 080c5631-1dd7-457e-958f-67acaed8f46a could not be found. Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '080c5631-1dd7-457e-958f-67acaed8f46a'} Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 080c5631-1dd7-457e-958f-67acaed8f46a could not be found. Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 080c5631-1dd7-457e-958f-67acaed8f46a could not be found. Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:09:35.542307 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:09:35.547936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:09:35.547936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:09:35.547936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:09:35.547936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:09:35.547936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:09:35.547936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 080c5631-1dd7-457e-958f-67acaed8f46a could not be found. Aug 04 17:09:35.547936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:09:35.550475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e30605ec-f801-46ec-9b5c-6d7ff7a14703 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] Returning 404 to user: Instance 080c5631-1dd7-457e-958f-67acaed8f46a could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:09:35.555031 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e30605ec-f801-46ec-9b5c-6d7ff7a14703 tempest-ServerRescueTestJSON-1578373332 tempest-ServerRescueTestJSON-1578373332-project] 10.222.0.93 "GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a" status: 404 len: 111 microversion: 2.1 time: 0.134182 Aug 04 17:09:35.555614 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1834/3597] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:35 2022] GET /compute/v2.1/servers/080c5631-1dd7-457e-958f-67acaed8f46a => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:09:35.582884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-744c2698-80f6-4c8e-8237-7a3d5bdf441e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:35.583689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-744c2698-80f6-4c8e-8237-7a3d5bdf441e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:35.604372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-744c2698-80f6-4c8e-8237-7a3d5bdf441e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:35.606827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-744c2698-80f6-4c8e-8237-7a3d5bdf441e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:35.609966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-744c2698-80f6-4c8e-8237-7a3d5bdf441e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:35.613120 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-744c2698-80f6-4c8e-8237-7a3d5bdf441e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:35.616402 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-744c2698-80f6-4c8e-8237-7a3d5bdf441e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:35.620240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-744c2698-80f6-4c8e-8237-7a3d5bdf441e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:36.497184 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-744c2698-80f6-4c8e-8237-7a3d5bdf441e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:36.507065 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-744c2698-80f6-4c8e-8237-7a3d5bdf441e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1523 microversion: 2.1 time: 0.950022 Aug 04 17:09:36.510257 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1835/3598] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:35 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1523 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:36.637075 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e9a0bf84-5e9f-439f-8818-cd0e62f7cc20 tempest-ServerGroup264TestJSON-1864295631 tempest-ServerGroup264TestJSON-1864295631-project] Action: 'create', calling method: .version_select at 0x7f1e5b0300d0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:36.686052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-e9a0bf84-5e9f-439f-8818-cd0e62f7cc20 tempest-ServerGroup264TestJSON-1864295631 tempest-ServerGroup264TestJSON-1864295631-project] Getting quotas for project ba58915314344de091aab160e878111a. Resources: {'server_groups'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:09:36.692652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-e9a0bf84-5e9f-439f-8818-cd0e62f7cc20 tempest-ServerGroup264TestJSON-1864295631 tempest-ServerGroup264TestJSON-1864295631-project] Getting quotas for user 0801409e2ce94b22a9adfd4909f6d468 and project ba58915314344de091aab160e878111a. Resources: {'server_groups'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:09:36.855619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e7d29ad2-d3d6-4012-a6ef-c0d60ab8cabd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:09:36.856150 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e7d29ad2-d3d6-4012-a6ef-c0d60ab8cabd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:09:36.856719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e7d29ad2-d3d6-4012-a6ef-c0d60ab8cabd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:09:36.857250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e7d29ad2-d3d6-4012-a6ef-c0d60ab8cabd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:09:36.857772 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e7d29ad2-d3d6-4012-a6ef-c0d60ab8cabd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:09:36.871328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-e9a0bf84-5e9f-439f-8818-cd0e62f7cc20 tempest-ServerGroup264TestJSON-1864295631 tempest-ServerGroup264TestJSON-1864295631-project] Getting quotas for project ba58915314344de091aab160e878111a. Resources: {'server_groups'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:09:36.881435 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7d29ad2-d3d6-4012-a6ef-c0d60ab8cabd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:36.883625 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7d29ad2-d3d6-4012-a6ef-c0d60ab8cabd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:36.885049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7d29ad2-d3d6-4012-a6ef-c0d60ab8cabd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:36.887341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7d29ad2-d3d6-4012-a6ef-c0d60ab8cabd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:36.887984 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-e9a0bf84-5e9f-439f-8818-cd0e62f7cc20 tempest-ServerGroup264TestJSON-1864295631 tempest-ServerGroup264TestJSON-1864295631-project] Getting quotas for user 0801409e2ce94b22a9adfd4909f6d468 and project ba58915314344de091aab160e878111a. Resources: {'server_groups'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:09:36.890725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7d29ad2-d3d6-4012-a6ef-c0d60ab8cabd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:36.891364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7d29ad2-d3d6-4012-a6ef-c0d60ab8cabd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:36.921715 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e9a0bf84-5e9f-439f-8818-cd0e62f7cc20 tempest-ServerGroup264TestJSON-1864295631 tempest-ServerGroup264TestJSON-1864295631-project] 10.222.0.93 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.402160 Aug 04 17:09:36.925741 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1836/3599] 10.222.0.93 () {62 vars in 1214 bytes} [Thu Aug 4 17:09:36 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:09:36.938028 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e7d29ad2-d3d6-4012-a6ef-c0d60ab8cabd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Getting quotas for project 50d2f7cd670340adb1b4187754e302c5. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:09:36.940781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-818b5278-6633-4ada-962a-76a7989444c8 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:36.942421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-818b5278-6633-4ada-962a-76a7989444c8 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:36.965272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e7d29ad2-d3d6-4012-a6ef-c0d60ab8cabd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Getting quotas for user 067e98d624234a48bb0ea3bde77c049c and project 50d2f7cd670340adb1b4187754e302c5. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:09:36.968463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-818b5278-6633-4ada-962a-76a7989444c8 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:36.968978 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-818b5278-6633-4ada-962a-76a7989444c8 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:36.969416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-818b5278-6633-4ada-962a-76a7989444c8 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:36.973110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-818b5278-6633-4ada-962a-76a7989444c8 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:36.973629 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-818b5278-6633-4ada-962a-76a7989444c8 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:36.974128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-818b5278-6633-4ada-962a-76a7989444c8 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:37.021993 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e7d29ad2-d3d6-4012-a6ef-c0d60ab8cabd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:09:37.025167 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e7d29ad2-d3d6-4012-a6ef-c0d60ab8cabd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:09:37.150728 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e7d29ad2-d3d6-4012-a6ef-c0d60ab8cabd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.231203 Aug 04 17:09:37.157772 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1764/3600] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:09:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 2238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:09:37.179654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9fd8134c-a935-4ac2-a100-3c1785b532fc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:37.183315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9fd8134c-a935-4ac2-a100-3c1785b532fc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:37.196863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fd8134c-a935-4ac2-a100-3c1785b532fc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:37.197376 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fd8134c-a935-4ac2-a100-3c1785b532fc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:37.201831 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fd8134c-a935-4ac2-a100-3c1785b532fc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:37.203051 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fd8134c-a935-4ac2-a100-3c1785b532fc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:37.203494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fd8134c-a935-4ac2-a100-3c1785b532fc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:37.203940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fd8134c-a935-4ac2-a100-3c1785b532fc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:37.245124 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-818b5278-6633-4ada-962a-76a7989444c8 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:37.268192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-818b5278-6633-4ada-962a-76a7989444c8 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:37.274561 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-818b5278-6633-4ada-962a-76a7989444c8 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:37.289840 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-818b5278-6633-4ada-962a-76a7989444c8 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e" status: 200 len: 1365 microversion: 2.47 time: 0.355647 Aug 04 17:09:37.298782 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1837/3601] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:09:36 2022] GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e => generated 1365 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:09:37.303764 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6ddef465-fd25-4378-acb9-97532113fa89 tempest-ServerGroup264TestJSON-1864295631 tempest-ServerGroup264TestJSON-1864295631-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:37.353445 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6ddef465-fd25-4378-acb9-97532113fa89 tempest-ServerGroup264TestJSON-1864295631 tempest-ServerGroup264TestJSON-1864295631-project] 10.222.0.93 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.053377 Aug 04 17:09:37.362370 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1838/3602] 10.222.0.93 () {60 vars in 1193 bytes} [Thu Aug 4 17:09:37 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:09:37.375008 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-aee33f58-3c57-4ab8-b6bc-e897f99d5c31 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:37.375658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-aee33f58-3c57-4ab8-b6bc-e897f99d5c31 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:37.561671 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-aee33f58-3c57-4ab8-b6bc-e897f99d5c31 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:37.578478 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-aee33f58-3c57-4ab8-b6bc-e897f99d5c31 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1221 microversion: 2.1 time: 0.214723 Aug 04 17:09:37.587415 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1839/3603] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:37 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1221 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:37.602391 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d7e2ba22-433e-4672-b8cc-e16944150a79 tempest-ServerGroup264TestJSON-1864295631 tempest-ServerGroup264TestJSON-1864295631-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:37.637287 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d7e2ba22-433e-4672-b8cc-e16944150a79 tempest-ServerGroup264TestJSON-1864295631 tempest-ServerGroup264TestJSON-1864295631-project] 10.222.0.93 "GET /compute/v2.1/os-server-groups/3c15751a-d1ab-407a-9876-234459c4cb92" status: 200 len: 235 microversion: 2.64 time: 0.045541 Aug 04 17:09:37.647694 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1840/3604] 10.222.0.93 () {60 vars in 1304 bytes} [Thu Aug 4 17:09:37 2022] GET /compute/v2.1/os-server-groups/3c15751a-d1ab-407a-9876-234459c4cb92 => generated 235 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:09:37.669947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0c881324-6323-410d-9969-4c8e301235ae tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:37.670648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0c881324-6323-410d-9969-4c8e301235ae tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:37.699851 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c881324-6323-410d-9969-4c8e301235ae tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:37.702097 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c881324-6323-410d-9969-4c8e301235ae tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:37.702560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c881324-6323-410d-9969-4c8e301235ae tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:37.708603 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c881324-6323-410d-9969-4c8e301235ae tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:37.712477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c881324-6323-410d-9969-4c8e301235ae tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:37.714793 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c881324-6323-410d-9969-4c8e301235ae tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:37.760491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9fd8134c-a935-4ac2-a100-3c1785b532fc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:37.770456 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9fd8134c-a935-4ac2-a100-3c1785b532fc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1672 microversion: 2.1 time: 0.608508 Aug 04 17:09:37.773965 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1765/3605] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:37 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1672 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:37.803591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dc706579-ebb9-4e0f-9a89-7d300ee41d33 tempest-ServerGroup264TestJSON-1864295631 tempest-ServerGroup264TestJSON-1864295631-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:37.893804 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dc706579-ebb9-4e0f-9a89-7d300ee41d33 tempest-ServerGroup264TestJSON-1864295631 tempest-ServerGroup264TestJSON-1864295631-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/3c15751a-d1ab-407a-9876-234459c4cb92" status: 204 len: 0 microversion: 2.64 time: 0.114767 Aug 04 17:09:37.898265 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1766/3606] 10.222.0.93 () {60 vars in 1307 bytes} [Thu Aug 4 17:09:37 2022] DELETE /compute/v2.1/os-server-groups/3c15751a-d1ab-407a-9876-234459c4cb92 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:09:37.915936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bdf3f370-4f60-48f8-bf92-e804a9a371ff tempest-ServerGroup264TestJSON-1864295631 tempest-ServerGroup264TestJSON-1864295631-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:37.944203 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-bdf3f370-4f60-48f8-bf92-e804a9a371ff tempest-ServerGroup264TestJSON-1864295631 tempest-ServerGroup264TestJSON-1864295631-project] HTTP exception thrown: Instance group 3c15751a-d1ab-407a-9876-234459c4cb92 could not be found. Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bdf3f370-4f60-48f8-bf92-e804a9a371ff tempest-ServerGroup264TestJSON-1864295631 tempest-ServerGroup264TestJSON-1864295631-project] Request method failure captured: Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/os-server-groups/3c15751a-d1ab-407a-9876-234459c4cb92 HTTP/1.1 Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_1P43qm1sPALXtdU87N2vb-ImxPJ7X37AUCD1hevrBh_JllYWGLIpy4faexPLNXG8HQnNcOGkT-68Norynln3MTI5seCxnXzdPIWuClWB8f8yQH8OybD0xky6w6-LSlOL7cC1Z8mts0DH9ddlNY1X24pjol9-AfvXKAu5r3Q4ImaIY Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.64 Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: ba58915314344de091aab160e878111a Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerGroup264TestJSON-1864295631 Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ba58915314344de091aab160e878111a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ba58915314344de091aab160e878111a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ba58915314344de091aab160e878111a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ba58915314344de091aab160e878111a"}]}] Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServerGroup264TestJSON-1864295631 Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: ba58915314344de091aab160e878111a Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1864295631 Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServerGroup264TestJSON-1864295631-project Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 0801409e2ce94b22a9adfd4909f6d468 Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServerGroup264TestJSON-1864295631-project Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance group 3c15751a-d1ab-407a-9876-234459c4cb92 could not be found. Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '3c15751a-d1ab-407a-9876-234459c4cb92'} Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 3c15751a-d1ab-407a-9876-234459c4cb92 could not be found. Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 3c15751a-d1ab-407a-9876-234459c4cb92 could not be found. Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:09:37.953090 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:09:37.959296 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:09:37.959296 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:09:37.959296 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:09:37.959296 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:09:37.959296 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 3c15751a-d1ab-407a-9876-234459c4cb92 could not be found. Aug 04 17:09:37.959296 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:09:37.959296 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bdf3f370-4f60-48f8-bf92-e804a9a371ff tempest-ServerGroup264TestJSON-1864295631 tempest-ServerGroup264TestJSON-1864295631-project] Returning 404 to user: Instance group 3c15751a-d1ab-407a-9876-234459c4cb92 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:09:37.961388 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bdf3f370-4f60-48f8-bf92-e804a9a371ff tempest-ServerGroup264TestJSON-1864295631 tempest-ServerGroup264TestJSON-1864295631-project] 10.222.0.93 "DELETE /compute/v2.1/os-server-groups/3c15751a-d1ab-407a-9876-234459c4cb92" status: 404 len: 117 microversion: 2.64 time: 0.053531 Aug 04 17:09:37.964163 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1767/3607] 10.222.0.93 () {60 vars in 1307 bytes} [Thu Aug 4 17:09:37 2022] DELETE /compute/v2.1/os-server-groups/3c15751a-d1ab-407a-9876-234459c4cb92 => generated 117 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:09:38.326373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6aae389f-6a72-44e7-a2e9-92b95a8c5c32 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:38.327732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6aae389f-6a72-44e7-a2e9-92b95a8c5c32 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:38.342295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aae389f-6a72-44e7-a2e9-92b95a8c5c32 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:38.351978 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aae389f-6a72-44e7-a2e9-92b95a8c5c32 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:38.352881 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aae389f-6a72-44e7-a2e9-92b95a8c5c32 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:38.355205 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aae389f-6a72-44e7-a2e9-92b95a8c5c32 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:38.355970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aae389f-6a72-44e7-a2e9-92b95a8c5c32 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:38.357122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aae389f-6a72-44e7-a2e9-92b95a8c5c32 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:39.225145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6aae389f-6a72-44e7-a2e9-92b95a8c5c32 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:39.253162 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6aae389f-6a72-44e7-a2e9-92b95a8c5c32 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:39.255145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6aae389f-6a72-44e7-a2e9-92b95a8c5c32 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:39.256400 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6aae389f-6a72-44e7-a2e9-92b95a8c5c32 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e" status: 200 len: 1365 microversion: 2.47 time: 0.935462 Aug 04 17:09:39.263014 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1768/3608] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:09:38 2022] GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e => generated 1365 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:09:39.279281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-16b22090-0663-40ed-bfe7-beb9a5d35960 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:39.280126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-16b22090-0663-40ed-bfe7-beb9a5d35960 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:39.289703 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16b22090-0663-40ed-bfe7-beb9a5d35960 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:39.295771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16b22090-0663-40ed-bfe7-beb9a5d35960 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:39.296627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16b22090-0663-40ed-bfe7-beb9a5d35960 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:39.297579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16b22090-0663-40ed-bfe7-beb9a5d35960 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:39.298297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16b22090-0663-40ed-bfe7-beb9a5d35960 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:39.306919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16b22090-0663-40ed-bfe7-beb9a5d35960 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:39.583659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0c881324-6323-410d-9969-4c8e301235ae tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:39.593697 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-16b22090-0663-40ed-bfe7-beb9a5d35960 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:39.605933 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-16b22090-0663-40ed-bfe7-beb9a5d35960 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1273 microversion: 2.1 time: 0.335524 Aug 04 17:09:39.610746 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1769/3609] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:39 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1273 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:39.617938 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0c881324-6323-410d-9969-4c8e301235ae tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1508 microversion: 2.1 time: 1.967399 Aug 04 17:09:39.618745 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1841/3610] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:37 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1508 bytes in 1971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:39.622381 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a70efdeb-b2f0-49b1-8353-d63944d219fb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:39.623317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a70efdeb-b2f0-49b1-8353-d63944d219fb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:39.644029 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a70efdeb-b2f0-49b1-8353-d63944d219fb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:39.644968 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a70efdeb-b2f0-49b1-8353-d63944d219fb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:39.645653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a70efdeb-b2f0-49b1-8353-d63944d219fb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:39.646688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a70efdeb-b2f0-49b1-8353-d63944d219fb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:39.647373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a70efdeb-b2f0-49b1-8353-d63944d219fb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:39.648027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a70efdeb-b2f0-49b1-8353-d63944d219fb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:39.649684 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ee33edc1-1bde-4e17-bec5-603f473b4c85 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:39.653679 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ee33edc1-1bde-4e17-bec5-603f473b4c85 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:39.674020 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee33edc1-1bde-4e17-bec5-603f473b4c85 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:39.681370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee33edc1-1bde-4e17-bec5-603f473b4c85 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:39.682083 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee33edc1-1bde-4e17-bec5-603f473b4c85 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:39.684997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee33edc1-1bde-4e17-bec5-603f473b4c85 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:39.685649 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee33edc1-1bde-4e17-bec5-603f473b4c85 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:39.687952 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee33edc1-1bde-4e17-bec5-603f473b4c85 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:40.756751 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ee33edc1-1bde-4e17-bec5-603f473b4c85 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:40.770454 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ee33edc1-1bde-4e17-bec5-603f473b4c85 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 200 len: 1508 microversion: 2.1 time: 1.125062 Aug 04 17:09:40.785633 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1842/3611] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:39 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 1508 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:40.785633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-12f2479e-a10c-4a79-8cac-266302e2ab4b tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:40.790388 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-12f2479e-a10c-4a79-8cac-266302e2ab4b tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:40.819876 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-12f2479e-a10c-4a79-8cac-266302e2ab4b tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:40.820492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-12f2479e-a10c-4a79-8cac-266302e2ab4b tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:40.820943 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-12f2479e-a10c-4a79-8cac-266302e2ab4b tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:40.821685 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-12f2479e-a10c-4a79-8cac-266302e2ab4b tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:40.822315 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-12f2479e-a10c-4a79-8cac-266302e2ab4b tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:40.822751 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-12f2479e-a10c-4a79-8cac-266302e2ab4b tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:40.842566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a70efdeb-b2f0-49b1-8353-d63944d219fb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:40.873045 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a70efdeb-b2f0-49b1-8353-d63944d219fb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 1.260798 Aug 04 17:09:40.890383 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1770/3612] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:39 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:40.908087 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-098d3654-21a0-4056-a685-7c28ff510ea1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:40.908727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-098d3654-21a0-4056-a685-7c28ff510ea1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:40.934888 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-098d3654-21a0-4056-a685-7c28ff510ea1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:40.935672 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-098d3654-21a0-4056-a685-7c28ff510ea1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:40.936293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-098d3654-21a0-4056-a685-7c28ff510ea1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:40.937236 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-098d3654-21a0-4056-a685-7c28ff510ea1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:40.939292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-098d3654-21a0-4056-a685-7c28ff510ea1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:40.939914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-098d3654-21a0-4056-a685-7c28ff510ea1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:41.788309 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-12f2479e-a10c-4a79-8cac-266302e2ab4b tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:41.800058 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-098d3654-21a0-4056-a685-7c28ff510ea1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:41.810688 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-098d3654-21a0-4056-a685-7c28ff510ea1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1279 microversion: 2.1 time: 0.919012 Aug 04 17:09:41.811663 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-12f2479e-a10c-4a79-8cac-266302e2ab4b tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:41.814157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-12f2479e-a10c-4a79-8cac-266302e2ab4b tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:41.830416 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1771/3613] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:40 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1279 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:41.837828 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-12f2479e-a10c-4a79-8cac-266302e2ab4b tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e" status: 200 len: 1365 microversion: 2.47 time: 1.056281 Aug 04 17:09:41.847129 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1843/3614] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:09:40 2022] GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e => generated 1365 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:09:41.853036 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5542b30c-cb2b-4e0b-b6cd-e297bf02d666 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:41.855138 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d12490be-4d19-4540-9b56-715d9ca463f1 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:41.856176 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d12490be-4d19-4540-9b56-715d9ca463f1 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:41.861745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5542b30c-cb2b-4e0b-b6cd-e297bf02d666 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:41.875064 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d12490be-4d19-4540-9b56-715d9ca463f1 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:41.875842 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d12490be-4d19-4540-9b56-715d9ca463f1 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:41.878010 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d12490be-4d19-4540-9b56-715d9ca463f1 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:41.878921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d12490be-4d19-4540-9b56-715d9ca463f1 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:41.881317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d12490be-4d19-4540-9b56-715d9ca463f1 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:41.882185 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d12490be-4d19-4540-9b56-715d9ca463f1 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:41.894464 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5542b30c-cb2b-4e0b-b6cd-e297bf02d666 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:41.895154 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5542b30c-cb2b-4e0b-b6cd-e297bf02d666 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:41.895813 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5542b30c-cb2b-4e0b-b6cd-e297bf02d666 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:41.896706 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5542b30c-cb2b-4e0b-b6cd-e297bf02d666 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:41.899892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5542b30c-cb2b-4e0b-b6cd-e297bf02d666 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:41.902850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5542b30c-cb2b-4e0b-b6cd-e297bf02d666 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:41.972863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d12490be-4d19-4540-9b56-715d9ca463f1 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:09:42.025784 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5542b30c-cb2b-4e0b-b6cd-e297bf02d666 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action" status: 200 len: 319 microversion: 2.1 time: 0.176977 Aug 04 17:09:42.026487 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1844/3615] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:09:41 2022] POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action => generated 319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:09:42.036332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1203ecb0-a997-478e-a534-d2ba5a85941c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:42.037056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1203ecb0-a997-478e-a534-d2ba5a85941c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:42.075840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1203ecb0-a997-478e-a534-d2ba5a85941c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:42.076364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1203ecb0-a997-478e-a534-d2ba5a85941c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:42.076824 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1203ecb0-a997-478e-a534-d2ba5a85941c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:42.091143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1203ecb0-a997-478e-a534-d2ba5a85941c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:42.091901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1203ecb0-a997-478e-a534-d2ba5a85941c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:42.092525 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1203ecb0-a997-478e-a534-d2ba5a85941c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:42.220096 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d12490be-4d19-4540-9b56-715d9ca463f1 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "DELETE /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 204 len: 0 microversion: 2.1 time: 0.388018 Aug 04 17:09:42.221370 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1772/3616] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:09:41 2022] DELETE /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:09:42.485847 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1b7e53d8-b060-4b77-a610-4ea907f26ae3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1364346278", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "d812de2d-9097-4365-8b54-a9037cf92e5e"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:42.514389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:42.588639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-1b7e53d8-b060-4b77-a610-4ea907f26ae3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] validate_networks() for [('d812de2d-9097-4365-8b54-a9037cf92e5e', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:09:44.231018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1203ecb0-a997-478e-a534-d2ba5a85941c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:44.274288 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1203ecb0-a997-478e-a534-d2ba5a85941c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 2.241322 Aug 04 17:09:44.278349 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1845/3617] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:42 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 2247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:09:44.452558 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-857116ee-8bae-476e-85a9-d9e122bb5db2 req-7fa20a65-dd04-4fc5-a796-4d6d397aec82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "930cda99-f658-44c9-bb85-da349e9e5aeb", "tag": "fc731c29-573c-4fea-bc67-f7db2218ed58"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:44.478021 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-857116ee-8bae-476e-85a9-d9e122bb5db2 req-7fa20a65-dd04-4fc5-a796-4d6d397aec82 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:44.478510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-857116ee-8bae-476e-85a9-d9e122bb5db2 req-7fa20a65-dd04-4fc5-a796-4d6d397aec82 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:44.478949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-857116ee-8bae-476e-85a9-d9e122bb5db2 req-7fa20a65-dd04-4fc5-a796-4d6d397aec82 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:44.521406 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-857116ee-8bae-476e-85a9-d9e122bb5db2 req-7fa20a65-dd04-4fc5-a796-4d6d397aec82 service nova] Creating event network-changed:fc731c29-573c-4fea-bc67-f7db2218ed58 for instance 930cda99-f658-44c9-bb85-da349e9e5aeb on n-h1-851359-3 Aug 04 17:09:44.546414 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-857116ee-8bae-476e-85a9-d9e122bb5db2 req-7fa20a65-dd04-4fc5-a796-4d6d397aec82 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.265373 Aug 04 17:09:44.547665 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1846/3618] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:09:44.553131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5f08b781-f81e-44ae-bbc6-eb9ed2bc5c6e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:44.562541 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5f08b781-f81e-44ae-bbc6-eb9ed2bc5c6e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:44.588883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5f08b781-f81e-44ae-bbc6-eb9ed2bc5c6e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:44.589646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5f08b781-f81e-44ae-bbc6-eb9ed2bc5c6e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:44.590416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5f08b781-f81e-44ae-bbc6-eb9ed2bc5c6e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:44.591473 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5f08b781-f81e-44ae-bbc6-eb9ed2bc5c6e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:44.593878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5f08b781-f81e-44ae-bbc6-eb9ed2bc5c6e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:44.594929 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5f08b781-f81e-44ae-bbc6-eb9ed2bc5c6e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:45.672916 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5f08b781-f81e-44ae-bbc6-eb9ed2bc5c6e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:45.693866 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5f08b781-f81e-44ae-bbc6-eb9ed2bc5c6e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1321 microversion: 2.1 time: 1.139540 Aug 04 17:09:45.694602 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1847/3619] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:44 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1321 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:45.730481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2917e707-54c1-4d61-ad19-a32b18b3b684 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:45.731320 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2917e707-54c1-4d61-ad19-a32b18b3b684 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:45.736964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:45.740383 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2917e707-54c1-4d61-ad19-a32b18b3b684 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:45.741111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2917e707-54c1-4d61-ad19-a32b18b3b684 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:45.746287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2917e707-54c1-4d61-ad19-a32b18b3b684 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:45.747372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2917e707-54c1-4d61-ad19-a32b18b3b684 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:45.748061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2917e707-54c1-4d61-ad19-a32b18b3b684 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:45.748686 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2917e707-54c1-4d61-ad19-a32b18b3b684 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:46.225232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2917e707-54c1-4d61-ad19-a32b18b3b684 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:46.241096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2917e707-54c1-4d61-ad19-a32b18b3b684 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:46.244837 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2917e707-54c1-4d61-ad19-a32b18b3b684 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:46.247809 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2917e707-54c1-4d61-ad19-a32b18b3b684 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e" status: 200 len: 1365 microversion: 2.47 time: 0.533942 Aug 04 17:09:46.254023 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1848/3620] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:09:45 2022] GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e => generated 1365 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:09:46.267221 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d0049c3c-b5b4-4087-8286-99f184a07ec2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:46.268338 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d0049c3c-b5b4-4087-8286-99f184a07ec2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:46.280659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d0049c3c-b5b4-4087-8286-99f184a07ec2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:46.282763 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d0049c3c-b5b4-4087-8286-99f184a07ec2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:46.283842 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d0049c3c-b5b4-4087-8286-99f184a07ec2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:46.285114 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d0049c3c-b5b4-4087-8286-99f184a07ec2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:46.287515 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d0049c3c-b5b4-4087-8286-99f184a07ec2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:46.288134 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d0049c3c-b5b4-4087-8286-99f184a07ec2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:46.907787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:46.937616 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-1b7e53d8-b060-4b77-a610-4ea907f26ae3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:09:46.940054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-1b7e53d8-b060-4b77-a610-4ea907f26ae3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:09:46.940691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-1b7e53d8-b060-4b77-a610-4ea907f26ae3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:09:46.941222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-1b7e53d8-b060-4b77-a610-4ea907f26ae3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:09:46.941782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-1b7e53d8-b060-4b77-a610-4ea907f26ae3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:09:46.957089 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b7e53d8-b060-4b77-a610-4ea907f26ae3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:46.958552 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b7e53d8-b060-4b77-a610-4ea907f26ae3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:46.963245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b7e53d8-b060-4b77-a610-4ea907f26ae3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:46.964237 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b7e53d8-b060-4b77-a610-4ea907f26ae3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:46.964954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b7e53d8-b060-4b77-a610-4ea907f26ae3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:46.965500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b7e53d8-b060-4b77-a610-4ea907f26ae3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:46.985702 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d0049c3c-b5b4-4087-8286-99f184a07ec2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:46.992967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-1b7e53d8-b060-4b77-a610-4ea907f26ae3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Getting quotas for project 0e503687666f4ca59d4ea4d9f9771917. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:09:46.999433 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-1b7e53d8-b060-4b77-a610-4ea907f26ae3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Getting quotas for user 4b17ad6c3c53441dbd0c648db7b649b5 and project 0e503687666f4ca59d4ea4d9f9771917. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:09:47.006362 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d0049c3c-b5b4-4087-8286-99f184a07ec2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.747646 Aug 04 17:09:47.007142 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1849/3621] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:46 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:47.016987 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d2c65b84-2f85-4c6a-879f-93030bbe5d86 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:47.032594 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d2c65b84-2f85-4c6a-879f-93030bbe5d86 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:47.033123 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1b7e53d8-b060-4b77-a610-4ea907f26ae3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:09:47.033513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d2c65b84-2f85-4c6a-879f-93030bbe5d86 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:47.034152 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d2c65b84-2f85-4c6a-879f-93030bbe5d86 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:47.035574 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1b7e53d8-b060-4b77-a610-4ea907f26ae3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: 6728b692-24d5-4a20-ab3a-fc1630a75d64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:09:47.065666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:47.095863 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1b7e53d8-b060-4b77-a610-4ea907f26ae3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.613718 Aug 04 17:09:47.097166 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1773/3622] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:09:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 4616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:09:47.102394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d2c65b84-2f85-4c6a-879f-93030bbe5d86 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Going to try to stop instance {{(pid=131043) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 17:09:47.103147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-941ac4a3-3881-4d52-99df-8b35ea43e0a5 req-f70ce7a1-2835-4999-94be-3825000fac68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a592dcbd-6b85-4d18-acdb-82f579be9067", "name": "network-vif-deleted", "tag": "50ccfc29-071f-4ee9-b4b3-d1abf0c5facb"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:47.120913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-941ac4a3-3881-4d52-99df-8b35ea43e0a5 req-f70ce7a1-2835-4999-94be-3825000fac68 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:47.121701 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-941ac4a3-3881-4d52-99df-8b35ea43e0a5 req-f70ce7a1-2835-4999-94be-3825000fac68 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:47.122993 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-941ac4a3-3881-4d52-99df-8b35ea43e0a5 req-f70ce7a1-2835-4999-94be-3825000fac68 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:47.140046 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-941ac4a3-3881-4d52-99df-8b35ea43e0a5 req-f70ce7a1-2835-4999-94be-3825000fac68 service nova] Creating event network-vif-deleted:50ccfc29-071f-4ee9-b4b3-d1abf0c5facb for instance a592dcbd-6b85-4d18-acdb-82f579be9067 on n-h1-851359-3 Aug 04 17:09:47.162929 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-941ac4a3-3881-4d52-99df-8b35ea43e0a5 req-f70ce7a1-2835-4999-94be-3825000fac68 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062429 Aug 04 17:09:47.165425 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1774/3623] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:09:47.192345 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-06eec04d-9673-403f-a836-d100f32a10d8 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:47.200452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-06eec04d-9673-403f-a836-d100f32a10d8 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:47.222677 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06eec04d-9673-403f-a836-d100f32a10d8 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:47.223557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06eec04d-9673-403f-a836-d100f32a10d8 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:47.224254 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06eec04d-9673-403f-a836-d100f32a10d8 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:47.225294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06eec04d-9673-403f-a836-d100f32a10d8 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:47.234436 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06eec04d-9673-403f-a836-d100f32a10d8 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:47.235248 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06eec04d-9673-403f-a836-d100f32a10d8 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:47.255130 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d2c65b84-2f85-4c6a-879f-93030bbe5d86 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "POST /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3/action" status: 202 len: 0 microversion: 2.1 time: 0.244214 Aug 04 17:09:47.257077 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1850/3624] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:09:47 2022] POST /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:09:47.271926 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f435bbc9-86b4-42dc-8913-bac590593f3f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:47.272664 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f435bbc9-86b4-42dc-8913-bac590593f3f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:47.294508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f435bbc9-86b4-42dc-8913-bac590593f3f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:47.295029 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f435bbc9-86b4-42dc-8913-bac590593f3f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:47.298400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f435bbc9-86b4-42dc-8913-bac590593f3f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:47.301379 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f435bbc9-86b4-42dc-8913-bac590593f3f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:47.302099 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f435bbc9-86b4-42dc-8913-bac590593f3f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:47.303648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f435bbc9-86b4-42dc-8913-bac590593f3f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:47.567096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=16 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:47.928345 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-06eec04d-9673-403f-a836-d100f32a10d8 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:47.945731 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-06eec04d-9673-403f-a836-d100f32a10d8 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1321 microversion: 2.1 time: 0.764650 Aug 04 17:09:47.951793 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1775/3625] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:47 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1321 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:47.967356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cf8d4e7d-eed1-480e-b0c8-12e6d61fd8a3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:47.971517 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cf8d4e7d-eed1-480e-b0c8-12e6d61fd8a3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: 6728b692-24d5-4a20-ab3a-fc1630a75d64] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:47.976669 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f435bbc9-86b4-42dc-8913-bac590593f3f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:47.999130 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f435bbc9-86b4-42dc-8913-bac590593f3f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.740402 Aug 04 17:09:48.005056 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf8d4e7d-eed1-480e-b0c8-12e6d61fd8a3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:48.005484 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1851/3626] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:47 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:48.008767 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf8d4e7d-eed1-480e-b0c8-12e6d61fd8a3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:48.009502 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf8d4e7d-eed1-480e-b0c8-12e6d61fd8a3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:48.010825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf8d4e7d-eed1-480e-b0c8-12e6d61fd8a3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:48.013584 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf8d4e7d-eed1-480e-b0c8-12e6d61fd8a3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:48.016977 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf8d4e7d-eed1-480e-b0c8-12e6d61fd8a3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:48.017364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-127a3606-ddeb-4f80-9475-aef679ce0f9a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:48.018013 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-127a3606-ddeb-4f80-9475-aef679ce0f9a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:48.048934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-127a3606-ddeb-4f80-9475-aef679ce0f9a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:48.050557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-127a3606-ddeb-4f80-9475-aef679ce0f9a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:48.051178 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-127a3606-ddeb-4f80-9475-aef679ce0f9a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:48.057874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-127a3606-ddeb-4f80-9475-aef679ce0f9a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:48.058661 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-127a3606-ddeb-4f80-9475-aef679ce0f9a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:48.063675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-127a3606-ddeb-4f80-9475-aef679ce0f9a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:48.353278 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cf8d4e7d-eed1-480e-b0c8-12e6d61fd8a3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:48.365273 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cf8d4e7d-eed1-480e-b0c8-12e6d61fd8a3 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64" status: 200 len: 1214 microversion: 2.1 time: 0.411536 Aug 04 17:09:48.371089 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1776/3627] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:47 2022] GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64 => generated 1214 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:48.376362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aab103a1-c5d5-44a4-a19e-170e8d21a0f6 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:48.379572 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aab103a1-c5d5-44a4-a19e-170e8d21a0f6 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:48.394891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aab103a1-c5d5-44a4-a19e-170e8d21a0f6 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:48.395657 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aab103a1-c5d5-44a4-a19e-170e8d21a0f6 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:48.396287 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aab103a1-c5d5-44a4-a19e-170e8d21a0f6 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:48.405066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aab103a1-c5d5-44a4-a19e-170e8d21a0f6 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:48.405811 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aab103a1-c5d5-44a4-a19e-170e8d21a0f6 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:48.406477 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aab103a1-c5d5-44a4-a19e-170e8d21a0f6 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:48.593240 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-aab103a1-c5d5-44a4-a19e-170e8d21a0f6 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:48.616196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-aab103a1-c5d5-44a4-a19e-170e8d21a0f6 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:48.618666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-aab103a1-c5d5-44a4-a19e-170e8d21a0f6 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:48.620261 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aab103a1-c5d5-44a4-a19e-170e8d21a0f6 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e" status: 200 len: 1365 microversion: 2.47 time: 0.247895 Aug 04 17:09:48.634498 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1777/3628] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:09:48 2022] GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e => generated 1365 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:09:48.641638 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ced80e51-97f5-47e4-93c7-f179bf1cf47f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:48.654934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ced80e51-97f5-47e4-93c7-f179bf1cf47f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:48.663228 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ced80e51-97f5-47e4-93c7-f179bf1cf47f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:48.664574 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ced80e51-97f5-47e4-93c7-f179bf1cf47f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:48.665188 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ced80e51-97f5-47e4-93c7-f179bf1cf47f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:48.666100 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ced80e51-97f5-47e4-93c7-f179bf1cf47f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:48.666727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ced80e51-97f5-47e4-93c7-f179bf1cf47f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:48.668249 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ced80e51-97f5-47e4-93c7-f179bf1cf47f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:48.915099 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-127a3606-ddeb-4f80-9475-aef679ce0f9a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:48.930900 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-127a3606-ddeb-4f80-9475-aef679ce0f9a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1723 microversion: 2.1 time: 0.917647 Aug 04 17:09:48.931871 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1852/3629] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:48 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1723 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:48.971966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7129e27c-75d3-48a9-b076-f2814e249aa9 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:48.972858 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7129e27c-75d3-48a9-b076-f2814e249aa9 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:48.983485 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7129e27c-75d3-48a9-b076-f2814e249aa9 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:48.983994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7129e27c-75d3-48a9-b076-f2814e249aa9 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:48.984446 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7129e27c-75d3-48a9-b076-f2814e249aa9 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:48.985169 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7129e27c-75d3-48a9-b076-f2814e249aa9 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:48.990980 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7129e27c-75d3-48a9-b076-f2814e249aa9 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:48.992579 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7129e27c-75d3-48a9-b076-f2814e249aa9 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:49.054581 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ced80e51-97f5-47e4-93c7-f179bf1cf47f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:49.064068 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ced80e51-97f5-47e4-93c7-f179bf1cf47f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.428166 Aug 04 17:09:49.091841 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1778/3630] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:48 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:49.297529 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b006b077-d45e-4742-9565-d7cd5444bcba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-867062899", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "b3c59640-cdc1-4b7c-beb0-ca591646427e"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:49.379180 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-b006b077-d45e-4742-9565-d7cd5444bcba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] validate_networks() for [('b3c59640-cdc1-4b7c-beb0-ca591646427e', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:09:49.905820 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7129e27c-75d3-48a9-b076-f2814e249aa9 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:49.914765 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7129e27c-75d3-48a9-b076-f2814e249aa9 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1321 microversion: 2.1 time: 0.946275 Aug 04 17:09:49.927030 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1853/3631] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:48 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1321 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:49.932411 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e8411030-9c9d-443f-aa78-95b14135e633 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:49.933243 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e8411030-9c9d-443f-aa78-95b14135e633 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: 6728b692-24d5-4a20-ab3a-fc1630a75d64] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:49.943519 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8411030-9c9d-443f-aa78-95b14135e633 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:49.947975 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8411030-9c9d-443f-aa78-95b14135e633 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:49.948643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8411030-9c9d-443f-aa78-95b14135e633 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:49.949565 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8411030-9c9d-443f-aa78-95b14135e633 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:49.950231 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8411030-9c9d-443f-aa78-95b14135e633 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:49.958684 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8411030-9c9d-443f-aa78-95b14135e633 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:49.984493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:50.079602 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e8411030-9c9d-443f-aa78-95b14135e633 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:50.090793 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e8411030-9c9d-443f-aa78-95b14135e633 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64" status: 200 len: 1276 microversion: 2.1 time: 0.162327 Aug 04 17:09:50.094138 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1854/3632] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:49 2022] GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64 => generated 1276 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:50.127396 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b30572ff-7576-41cf-a823-299d11f36fe9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:50.131580 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b30572ff-7576-41cf-a823-299d11f36fe9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:50.149835 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b30572ff-7576-41cf-a823-299d11f36fe9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:50.150602 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b30572ff-7576-41cf-a823-299d11f36fe9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:50.151228 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b30572ff-7576-41cf-a823-299d11f36fe9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:50.155334 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b30572ff-7576-41cf-a823-299d11f36fe9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:50.156025 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b30572ff-7576-41cf-a823-299d11f36fe9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:50.157447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b30572ff-7576-41cf-a823-299d11f36fe9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:50.449296 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b30572ff-7576-41cf-a823-299d11f36fe9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:50.467179 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b30572ff-7576-41cf-a823-299d11f36fe9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:50.468838 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b30572ff-7576-41cf-a823-299d11f36fe9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:50.470941 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b30572ff-7576-41cf-a823-299d11f36fe9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e" status: 200 len: 1365 microversion: 2.47 time: 0.358780 Aug 04 17:09:50.471217 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1855/3633] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:09:50 2022] GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e => generated 1365 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:09:50.475856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a7363122-f82f-409a-94ab-2fd5fd0f4571 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:50.477023 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a7363122-f82f-409a-94ab-2fd5fd0f4571 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:50.503679 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a7363122-f82f-409a-94ab-2fd5fd0f4571 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:50.504197 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a7363122-f82f-409a-94ab-2fd5fd0f4571 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:50.504655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a7363122-f82f-409a-94ab-2fd5fd0f4571 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:50.506010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a7363122-f82f-409a-94ab-2fd5fd0f4571 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:50.506010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a7363122-f82f-409a-94ab-2fd5fd0f4571 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:50.506623 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a7363122-f82f-409a-94ab-2fd5fd0f4571 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:51.091670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a7363122-f82f-409a-94ab-2fd5fd0f4571 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:51.102074 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a7363122-f82f-409a-94ab-2fd5fd0f4571 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1723 microversion: 2.1 time: 0.629030 Aug 04 17:09:51.106411 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1856/3634] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:50 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1723 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:51.117597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-355dbb35-ab70-4d56-b9d8-527ff22a31d2 req-22109010-47ca-4c54-9513-33c69b451638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "930cda99-f658-44c9-bb85-da349e9e5aeb", "name": "network-vif-plugged", "status": "completed", "tag": "fc731c29-573c-4fea-bc67-f7db2218ed58"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:51.130915 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-355dbb35-ab70-4d56-b9d8-527ff22a31d2 req-22109010-47ca-4c54-9513-33c69b451638 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:51.133901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-355dbb35-ab70-4d56-b9d8-527ff22a31d2 req-22109010-47ca-4c54-9513-33c69b451638 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:51.135224 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-355dbb35-ab70-4d56-b9d8-527ff22a31d2 req-22109010-47ca-4c54-9513-33c69b451638 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:51.223404 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-355dbb35-ab70-4d56-b9d8-527ff22a31d2 req-22109010-47ca-4c54-9513-33c69b451638 service nova] Creating event network-vif-plugged:fc731c29-573c-4fea-bc67-f7db2218ed58 for instance 930cda99-f658-44c9-bb85-da349e9e5aeb on n-h1-851359-3 Aug 04 17:09:51.223404 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-355dbb35-ab70-4d56-b9d8-527ff22a31d2 req-22109010-47ca-4c54-9513-33c69b451638 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055165 Aug 04 17:09:51.223404 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1857/3635] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:09:51.223404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-6246d504-7294-48d7-8703-24419bb36703 req-a8517802-53a3-46b3-bc10-56c6621136f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b958ca6-2ca6-41ac-b4f2-f28d2b031de7", "tag": "fc77b974-f9c9-468a-8a2a-e5a28d0c750d"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:51.223404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6246d504-7294-48d7-8703-24419bb36703 req-a8517802-53a3-46b3-bc10-56c6621136f6 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:51.223404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6246d504-7294-48d7-8703-24419bb36703 req-a8517802-53a3-46b3-bc10-56c6621136f6 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:51.223404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6246d504-7294-48d7-8703-24419bb36703 req-a8517802-53a3-46b3-bc10-56c6621136f6 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:51.223404 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-6246d504-7294-48d7-8703-24419bb36703 req-a8517802-53a3-46b3-bc10-56c6621136f6 service nova] Creating event network-changed:fc77b974-f9c9-468a-8a2a-e5a28d0c750d for instance 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 on n-h2-851359-3 Aug 04 17:09:51.223404 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-6246d504-7294-48d7-8703-24419bb36703 req-a8517802-53a3-46b3-bc10-56c6621136f6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041306 Aug 04 17:09:51.223404 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1858/3636] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:09:51.224313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-b006b077-d45e-4742-9565-d7cd5444bcba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:09:51.224313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-b006b077-d45e-4742-9565-d7cd5444bcba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:09:51.224313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-b006b077-d45e-4742-9565-d7cd5444bcba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:09:51.224861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-34d18f5d-ab6d-4e57-b6d0-91a0da9b048e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:51.224861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-34d18f5d-ab6d-4e57-b6d0-91a0da9b048e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:51.225026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-b006b077-d45e-4742-9565-d7cd5444bcba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:09:51.225026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-b006b077-d45e-4742-9565-d7cd5444bcba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:09:51.225171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-34d18f5d-ab6d-4e57-b6d0-91a0da9b048e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:51.225171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-34d18f5d-ab6d-4e57-b6d0-91a0da9b048e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:51.225171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-34d18f5d-ab6d-4e57-b6d0-91a0da9b048e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:51.225398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-34d18f5d-ab6d-4e57-b6d0-91a0da9b048e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:51.226576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-34d18f5d-ab6d-4e57-b6d0-91a0da9b048e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:51.227032 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-34d18f5d-ab6d-4e57-b6d0-91a0da9b048e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:51.293472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b006b077-d45e-4742-9565-d7cd5444bcba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:51.311852 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b006b077-d45e-4742-9565-d7cd5444bcba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:51.312848 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b006b077-d45e-4742-9565-d7cd5444bcba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:51.323391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b006b077-d45e-4742-9565-d7cd5444bcba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:51.326607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b006b077-d45e-4742-9565-d7cd5444bcba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:51.327359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b006b077-d45e-4742-9565-d7cd5444bcba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:51.371448 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:51.397729 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-b006b077-d45e-4742-9565-d7cd5444bcba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Getting quotas for project 683ce999e25e42a4a57b3c24a1fd24ef. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:09:51.447503 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-b006b077-d45e-4742-9565-d7cd5444bcba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Getting quotas for user 01e6f70936a14e67aecaf71fb615fffa and project 683ce999e25e42a4a57b3c24a1fd24ef. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:09:51.475761 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b006b077-d45e-4742-9565-d7cd5444bcba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:09:51.479303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b006b077-d45e-4742-9565-d7cd5444bcba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:09:51.584392 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b006b077-d45e-4742-9565-d7cd5444bcba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.290673 Aug 04 17:09:51.585602 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1779/3637] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:09:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 17:09:51.590341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-18a42d3d-b3cc-42dc-abf0-1968c92c8d28 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:51.591347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-18a42d3d-b3cc-42dc-abf0-1968c92c8d28 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: 6728b692-24d5-4a20-ab3a-fc1630a75d64] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:51.611265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18a42d3d-b3cc-42dc-abf0-1968c92c8d28 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:51.613292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18a42d3d-b3cc-42dc-abf0-1968c92c8d28 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:51.613917 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18a42d3d-b3cc-42dc-abf0-1968c92c8d28 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:51.631586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18a42d3d-b3cc-42dc-abf0-1968c92c8d28 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:51.633213 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18a42d3d-b3cc-42dc-abf0-1968c92c8d28 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:51.633850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18a42d3d-b3cc-42dc-abf0-1968c92c8d28 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:51.740316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-34d18f5d-ab6d-4e57-b6d0-91a0da9b048e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:51.751236 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-34d18f5d-ab6d-4e57-b6d0-91a0da9b048e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1321 microversion: 2.1 time: 0.542289 Aug 04 17:09:51.756521 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1859/3638] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:51 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1321 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:51.772875 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-db48baf9-1d4f-4fe9-952e-71c764bf53d1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:51.774356 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-db48baf9-1d4f-4fe9-952e-71c764bf53d1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:51.795178 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db48baf9-1d4f-4fe9-952e-71c764bf53d1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:51.807353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db48baf9-1d4f-4fe9-952e-71c764bf53d1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:51.808201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db48baf9-1d4f-4fe9-952e-71c764bf53d1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:51.809181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db48baf9-1d4f-4fe9-952e-71c764bf53d1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:51.813621 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db48baf9-1d4f-4fe9-952e-71c764bf53d1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:51.814248 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db48baf9-1d4f-4fe9-952e-71c764bf53d1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:52.095593 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-db48baf9-1d4f-4fe9-952e-71c764bf53d1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:52.113711 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-db48baf9-1d4f-4fe9-952e-71c764bf53d1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:52.116002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-db48baf9-1d4f-4fe9-952e-71c764bf53d1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:52.118533 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-db48baf9-1d4f-4fe9-952e-71c764bf53d1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e" status: 200 len: 1365 microversion: 2.47 time: 0.360007 Aug 04 17:09:52.120838 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1860/3639] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:09:51 2022] GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e => generated 1365 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:09:52.131899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7edc7bd7-38a8-4c8a-9a8d-95e0cb95527a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:52.134096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7edc7bd7-38a8-4c8a-9a8d-95e0cb95527a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:52.289597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7edc7bd7-38a8-4c8a-9a8d-95e0cb95527a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:52.301162 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7edc7bd7-38a8-4c8a-9a8d-95e0cb95527a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1214 microversion: 2.1 time: 0.178296 Aug 04 17:09:52.301760 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1861/3640] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:52 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1214 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:52.326400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-402145ea-e235-4f0f-b31a-2ee91626ccfb tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:52.333116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-402145ea-e235-4f0f-b31a-2ee91626ccfb tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:52.345178 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-402145ea-e235-4f0f-b31a-2ee91626ccfb tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:52.348446 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-402145ea-e235-4f0f-b31a-2ee91626ccfb tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:52.349117 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-402145ea-e235-4f0f-b31a-2ee91626ccfb tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:52.350139 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-402145ea-e235-4f0f-b31a-2ee91626ccfb tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:52.350797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-402145ea-e235-4f0f-b31a-2ee91626ccfb tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:52.354997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-402145ea-e235-4f0f-b31a-2ee91626ccfb tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:52.399273 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-18a42d3d-b3cc-42dc-abf0-1968c92c8d28 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:52.407269 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-18a42d3d-b3cc-42dc-abf0-1968c92c8d28 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64" status: 200 len: 1318 microversion: 2.1 time: 0.820472 Aug 04 17:09:52.408185 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1780/3641] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:51 2022] GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64 => generated 1318 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:52.660289 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-402145ea-e235-4f0f-b31a-2ee91626ccfb tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:52.672897 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-402145ea-e235-4f0f-b31a-2ee91626ccfb tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1723 microversion: 2.1 time: 0.357291 Aug 04 17:09:52.686388 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1862/3642] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:52 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1723 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:52.777116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fb6bd9b9-1145-4a38-993a-32810bc12134 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:52.777675 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fb6bd9b9-1145-4a38-993a-32810bc12134 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:52.787624 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb6bd9b9-1145-4a38-993a-32810bc12134 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:52.788129 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb6bd9b9-1145-4a38-993a-32810bc12134 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:52.788718 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb6bd9b9-1145-4a38-993a-32810bc12134 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:52.801496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb6bd9b9-1145-4a38-993a-32810bc12134 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:52.801923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb6bd9b9-1145-4a38-993a-32810bc12134 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:52.802500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb6bd9b9-1145-4a38-993a-32810bc12134 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:53.108811 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fb6bd9b9-1145-4a38-993a-32810bc12134 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:53.119765 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fb6bd9b9-1145-4a38-993a-32810bc12134 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1321 microversion: 2.1 time: 0.347108 Aug 04 17:09:53.120654 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1781/3643] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:52 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1321 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:09:53.141461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3b368a24-4349-4c14-abf1-b35284b1466a tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:53.142779 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3b368a24-4349-4c14-abf1-b35284b1466a tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:53.152918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b368a24-4349-4c14-abf1-b35284b1466a tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:53.154566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b368a24-4349-4c14-abf1-b35284b1466a tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:53.156224 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b368a24-4349-4c14-abf1-b35284b1466a tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:53.158894 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b368a24-4349-4c14-abf1-b35284b1466a tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:53.159589 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b368a24-4349-4c14-abf1-b35284b1466a tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:53.160227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b368a24-4349-4c14-abf1-b35284b1466a tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:53.294430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3b368a24-4349-4c14-abf1-b35284b1466a tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:53.303010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3b368a24-4349-4c14-abf1-b35284b1466a tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:53.311786 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3b368a24-4349-4c14-abf1-b35284b1466a tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:53.313925 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3b368a24-4349-4c14-abf1-b35284b1466a tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e" status: 200 len: 1365 microversion: 2.47 time: 0.175781 Aug 04 17:09:53.329335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-12493fa7-9ed1-4221-bc33-c9dbaeee3c9b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:53.330050 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-12493fa7-9ed1-4221-bc33-c9dbaeee3c9b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:53.335285 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1863/3644] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:09:53 2022] GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:09:53.344282 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12493fa7-9ed1-4221-bc33-c9dbaeee3c9b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:53.344795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12493fa7-9ed1-4221-bc33-c9dbaeee3c9b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:53.345247 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12493fa7-9ed1-4221-bc33-c9dbaeee3c9b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:53.346005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12493fa7-9ed1-4221-bc33-c9dbaeee3c9b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:53.352142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12493fa7-9ed1-4221-bc33-c9dbaeee3c9b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:53.352608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12493fa7-9ed1-4221-bc33-c9dbaeee3c9b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:53.428890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-85814124-012d-4c43-8e7e-35cec7ab89a6 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:53.429754 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-85814124-012d-4c43-8e7e-35cec7ab89a6 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: 6728b692-24d5-4a20-ab3a-fc1630a75d64] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:53.440513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85814124-012d-4c43-8e7e-35cec7ab89a6 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:53.441166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85814124-012d-4c43-8e7e-35cec7ab89a6 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:53.442453 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85814124-012d-4c43-8e7e-35cec7ab89a6 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:53.445620 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85814124-012d-4c43-8e7e-35cec7ab89a6 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:53.446275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85814124-012d-4c43-8e7e-35cec7ab89a6 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:53.447677 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85814124-012d-4c43-8e7e-35cec7ab89a6 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:53.572135 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-12493fa7-9ed1-4221-bc33-c9dbaeee3c9b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:53.588097 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-12493fa7-9ed1-4221-bc33-c9dbaeee3c9b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1210 microversion: 2.1 time: 0.262080 Aug 04 17:09:53.593525 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1782/3645] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:53 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1210 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:53.652373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0ed92d37-ada9-499b-a714-111d1905e4c0 req-5a1a2a44-282b-495b-9fa0-aebfc039c67d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6728b692-24d5-4a20-ab3a-fc1630a75d64", "tag": "1b5fbe39-cbd2-4db1-92b2-fae6005216b5"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:53.671420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0ed92d37-ada9-499b-a714-111d1905e4c0 req-5a1a2a44-282b-495b-9fa0-aebfc039c67d service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:53.672131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0ed92d37-ada9-499b-a714-111d1905e4c0 req-5a1a2a44-282b-495b-9fa0-aebfc039c67d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:53.672772 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0ed92d37-ada9-499b-a714-111d1905e4c0 req-5a1a2a44-282b-495b-9fa0-aebfc039c67d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:53.713003 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0ed92d37-ada9-499b-a714-111d1905e4c0 req-5a1a2a44-282b-495b-9fa0-aebfc039c67d service nova] Creating event network-changed:1b5fbe39-cbd2-4db1-92b2-fae6005216b5 for instance 6728b692-24d5-4a20-ab3a-fc1630a75d64 on n-h1-851359-3 Aug 04 17:09:53.718464 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0ed92d37-ada9-499b-a714-111d1905e4c0 req-5a1a2a44-282b-495b-9fa0-aebfc039c67d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072544 Aug 04 17:09:53.719653 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1783/3646] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:09:53.729369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c21d9575-dae3-4726-9135-ba431acff09c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:53.735432 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c21d9575-dae3-4726-9135-ba431acff09c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:53.751029 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c21d9575-dae3-4726-9135-ba431acff09c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:53.751756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c21d9575-dae3-4726-9135-ba431acff09c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:53.752399 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c21d9575-dae3-4726-9135-ba431acff09c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:53.753738 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c21d9575-dae3-4726-9135-ba431acff09c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:53.754404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c21d9575-dae3-4726-9135-ba431acff09c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:53.755002 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c21d9575-dae3-4726-9135-ba431acff09c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:53.757144 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-85814124-012d-4c43-8e7e-35cec7ab89a6 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:53.767820 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-85814124-012d-4c43-8e7e-35cec7ab89a6 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64" status: 200 len: 1318 microversion: 2.1 time: 0.342612 Aug 04 17:09:53.784026 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1864/3647] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:53 2022] GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64 => generated 1318 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:54.039954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c21d9575-dae3-4726-9135-ba431acff09c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:54.053205 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c21d9575-dae3-4726-9135-ba431acff09c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1723 microversion: 2.1 time: 0.331192 Aug 04 17:09:54.068698 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1784/3648] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:53 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1723 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:54.146417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b79e7830-d8a5-4616-84ac-adba9fee40c7 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:54.149017 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b79e7830-d8a5-4616-84ac-adba9fee40c7 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:54.159184 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b79e7830-d8a5-4616-84ac-adba9fee40c7 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:54.160177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b79e7830-d8a5-4616-84ac-adba9fee40c7 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:54.161716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b79e7830-d8a5-4616-84ac-adba9fee40c7 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:54.163203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b79e7830-d8a5-4616-84ac-adba9fee40c7 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:54.164756 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b79e7830-d8a5-4616-84ac-adba9fee40c7 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:54.165437 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b79e7830-d8a5-4616-84ac-adba9fee40c7 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:54.342564 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c318620f-315e-44a0-926e-cfc6894b218f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:54.343697 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c318620f-315e-44a0-926e-cfc6894b218f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:54.352840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c318620f-315e-44a0-926e-cfc6894b218f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:54.354798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c318620f-315e-44a0-926e-cfc6894b218f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:54.357693 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c318620f-315e-44a0-926e-cfc6894b218f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:54.359540 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c318620f-315e-44a0-926e-cfc6894b218f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:54.361365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c318620f-315e-44a0-926e-cfc6894b218f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:54.363517 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c318620f-315e-44a0-926e-cfc6894b218f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:54.440364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b79e7830-d8a5-4616-84ac-adba9fee40c7 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:54.452669 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b79e7830-d8a5-4616-84ac-adba9fee40c7 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1321 microversion: 2.1 time: 0.313962 Aug 04 17:09:54.454120 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1865/3649] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:54 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1321 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:54.513365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c318620f-315e-44a0-926e-cfc6894b218f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:54.530008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c318620f-315e-44a0-926e-cfc6894b218f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:54.534138 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c318620f-315e-44a0-926e-cfc6894b218f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:54.541503 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c318620f-315e-44a0-926e-cfc6894b218f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e" status: 200 len: 1365 microversion: 2.47 time: 0.201641 Aug 04 17:09:54.557190 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1785/3650] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:09:54 2022] GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:09:54.618159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-36d66ebd-6ee9-4086-ba3d-fe3764da42a3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:54.618382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-36d66ebd-6ee9-4086-ba3d-fe3764da42a3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:54.630115 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-36d66ebd-6ee9-4086-ba3d-fe3764da42a3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:54.632794 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-36d66ebd-6ee9-4086-ba3d-fe3764da42a3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:54.637055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-36d66ebd-6ee9-4086-ba3d-fe3764da42a3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:54.639473 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-36d66ebd-6ee9-4086-ba3d-fe3764da42a3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:54.640447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-36d66ebd-6ee9-4086-ba3d-fe3764da42a3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:54.641142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-36d66ebd-6ee9-4086-ba3d-fe3764da42a3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:54.798143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d13a0cae-b860-4a65-b55e-0bd39b6da0f9 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:54.798774 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d13a0cae-b860-4a65-b55e-0bd39b6da0f9 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: 6728b692-24d5-4a20-ab3a-fc1630a75d64] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:54.806836 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d13a0cae-b860-4a65-b55e-0bd39b6da0f9 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:54.807573 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d13a0cae-b860-4a65-b55e-0bd39b6da0f9 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:54.808181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d13a0cae-b860-4a65-b55e-0bd39b6da0f9 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:54.810540 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d13a0cae-b860-4a65-b55e-0bd39b6da0f9 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:54.818662 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d13a0cae-b860-4a65-b55e-0bd39b6da0f9 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:54.818858 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-36d66ebd-6ee9-4086-ba3d-fe3764da42a3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:54.819646 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d13a0cae-b860-4a65-b55e-0bd39b6da0f9 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:54.832327 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-36d66ebd-6ee9-4086-ba3d-fe3764da42a3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1272 microversion: 2.1 time: 0.218743 Aug 04 17:09:54.842071 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1866/3651] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:54 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1272 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:55.020422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d13a0cae-b860-4a65-b55e-0bd39b6da0f9 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:55.028747 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d13a0cae-b860-4a65-b55e-0bd39b6da0f9 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64" status: 200 len: 1318 microversion: 2.1 time: 0.234762 Aug 04 17:09:55.035936 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1786/3652] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:54 2022] GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:09:55.079179 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3ad7ad7e-669e-4dc7-a802-1e41490586d9 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:55.080401 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3ad7ad7e-669e-4dc7-a802-1e41490586d9 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:55.089874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ad7ad7e-669e-4dc7-a802-1e41490586d9 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:55.090394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ad7ad7e-669e-4dc7-a802-1e41490586d9 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:55.090854 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ad7ad7e-669e-4dc7-a802-1e41490586d9 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:55.091721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ad7ad7e-669e-4dc7-a802-1e41490586d9 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:55.092305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ad7ad7e-669e-4dc7-a802-1e41490586d9 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:55.093851 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ad7ad7e-669e-4dc7-a802-1e41490586d9 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:55.289654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3ad7ad7e-669e-4dc7-a802-1e41490586d9 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:55.303955 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3ad7ad7e-669e-4dc7-a802-1e41490586d9 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1723 microversion: 2.1 time: 0.230837 Aug 04 17:09:55.305773 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1867/3653] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:55 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:55.478357 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a14cb19c-ad42-4f38-aa4d-632b3ce7ee6a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:55.478987 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a14cb19c-ad42-4f38-aa4d-632b3ce7ee6a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:55.486530 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a14cb19c-ad42-4f38-aa4d-632b3ce7ee6a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:55.486989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a14cb19c-ad42-4f38-aa4d-632b3ce7ee6a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:55.488000 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a14cb19c-ad42-4f38-aa4d-632b3ce7ee6a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:55.488912 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a14cb19c-ad42-4f38-aa4d-632b3ce7ee6a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:55.489568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a14cb19c-ad42-4f38-aa4d-632b3ce7ee6a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:55.490220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a14cb19c-ad42-4f38-aa4d-632b3ce7ee6a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:55.572966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7dbb5d8c-abd9-4ca8-b733-8658b5a994c4 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:55.575205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7dbb5d8c-abd9-4ca8-b733-8658b5a994c4 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:55.592597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7dbb5d8c-abd9-4ca8-b733-8658b5a994c4 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:55.593110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7dbb5d8c-abd9-4ca8-b733-8658b5a994c4 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:55.595672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7dbb5d8c-abd9-4ca8-b733-8658b5a994c4 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:55.599086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7dbb5d8c-abd9-4ca8-b733-8658b5a994c4 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:55.599600 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7dbb5d8c-abd9-4ca8-b733-8658b5a994c4 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:55.600051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7dbb5d8c-abd9-4ca8-b733-8658b5a994c4 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:55.697576 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a14cb19c-ad42-4f38-aa4d-632b3ce7ee6a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:55.709516 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a14cb19c-ad42-4f38-aa4d-632b3ce7ee6a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1321 microversion: 2.1 time: 0.231786 Aug 04 17:09:55.711389 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1787/3654] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:55 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:55.753796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7dbb5d8c-abd9-4ca8-b733-8658b5a994c4 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:55.764315 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7dbb5d8c-abd9-4ca8-b733-8658b5a994c4 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:55.766526 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7dbb5d8c-abd9-4ca8-b733-8658b5a994c4 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:55.768161 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7dbb5d8c-abd9-4ca8-b733-8658b5a994c4 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e" status: 200 len: 1365 microversion: 2.47 time: 0.201666 Aug 04 17:09:55.782139 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1868/3655] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:09:55 2022] GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:09:55.857765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f80192fa-0b2e-4cd3-a1f6-dee91e626949 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:55.859085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f80192fa-0b2e-4cd3-a1f6-dee91e626949 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:55.869670 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f80192fa-0b2e-4cd3-a1f6-dee91e626949 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:55.872589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f80192fa-0b2e-4cd3-a1f6-dee91e626949 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:55.874656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f80192fa-0b2e-4cd3-a1f6-dee91e626949 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:55.875753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f80192fa-0b2e-4cd3-a1f6-dee91e626949 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:55.878581 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f80192fa-0b2e-4cd3-a1f6-dee91e626949 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:55.879374 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f80192fa-0b2e-4cd3-a1f6-dee91e626949 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:56.051418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-814e54fc-39e6-4562-adbd-f0178e240ac4 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:56.052412 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-814e54fc-39e6-4562-adbd-f0178e240ac4 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: 6728b692-24d5-4a20-ab3a-fc1630a75d64] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:56.066431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-814e54fc-39e6-4562-adbd-f0178e240ac4 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:56.068199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-814e54fc-39e6-4562-adbd-f0178e240ac4 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:56.069752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-814e54fc-39e6-4562-adbd-f0178e240ac4 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:56.071884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-814e54fc-39e6-4562-adbd-f0178e240ac4 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:56.075715 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-814e54fc-39e6-4562-adbd-f0178e240ac4 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:56.078759 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-814e54fc-39e6-4562-adbd-f0178e240ac4 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:56.364037 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f80192fa-0b2e-4cd3-a1f6-dee91e626949 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:56.376898 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f80192fa-0b2e-4cd3-a1f6-dee91e626949 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1314 microversion: 2.1 time: 0.521782 Aug 04 17:09:56.392053 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1788/3656] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:55 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1314 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:56.399058 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f66aedb0-0327-46ee-8217-023cf877f98d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:56.400389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f66aedb0-0327-46ee-8217-023cf877f98d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:56.406910 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f66aedb0-0327-46ee-8217-023cf877f98d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:56.407628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f66aedb0-0327-46ee-8217-023cf877f98d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:56.414335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f66aedb0-0327-46ee-8217-023cf877f98d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:56.417411 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f66aedb0-0327-46ee-8217-023cf877f98d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:56.426511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f66aedb0-0327-46ee-8217-023cf877f98d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:56.428131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f66aedb0-0327-46ee-8217-023cf877f98d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:56.495233 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-814e54fc-39e6-4562-adbd-f0178e240ac4 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:56.510391 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-814e54fc-39e6-4562-adbd-f0178e240ac4 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64" status: 200 len: 1318 microversion: 2.1 time: 0.464408 Aug 04 17:09:56.518643 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1869/3657] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:56 2022] GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64 => generated 1318 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:09:56.732560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fd8928fd-a6ab-4b86-89b2-f7766fccb2ba tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:56.733389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fd8928fd-a6ab-4b86-89b2-f7766fccb2ba tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:56.745137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd8928fd-a6ab-4b86-89b2-f7766fccb2ba tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:56.747893 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd8928fd-a6ab-4b86-89b2-f7766fccb2ba tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:56.752714 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd8928fd-a6ab-4b86-89b2-f7766fccb2ba tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:56.753767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd8928fd-a6ab-4b86-89b2-f7766fccb2ba tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:56.754541 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd8928fd-a6ab-4b86-89b2-f7766fccb2ba tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:56.755163 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd8928fd-a6ab-4b86-89b2-f7766fccb2ba tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:56.846066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f66aedb0-0327-46ee-8217-023cf877f98d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:56.865364 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f66aedb0-0327-46ee-8217-023cf877f98d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1723 microversion: 2.1 time: 0.462069 Aug 04 17:09:56.870695 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1789/3658] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:56 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1723 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:56.875687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ef1d1a17-b9fb-475f-ae91-b45b2606711f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:56.876306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ef1d1a17-b9fb-475f-ae91-b45b2606711f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:56.892135 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef1d1a17-b9fb-475f-ae91-b45b2606711f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:56.892639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef1d1a17-b9fb-475f-ae91-b45b2606711f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:56.894200 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef1d1a17-b9fb-475f-ae91-b45b2606711f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:56.895104 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef1d1a17-b9fb-475f-ae91-b45b2606711f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:56.895734 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef1d1a17-b9fb-475f-ae91-b45b2606711f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:56.896335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef1d1a17-b9fb-475f-ae91-b45b2606711f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:57.095711 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ef1d1a17-b9fb-475f-ae91-b45b2606711f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:57.110943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ef1d1a17-b9fb-475f-ae91-b45b2606711f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:57.114747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ef1d1a17-b9fb-475f-ae91-b45b2606711f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:57.118092 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ef1d1a17-b9fb-475f-ae91-b45b2606711f tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e" status: 200 len: 1371 microversion: 2.47 time: 0.244279 Aug 04 17:09:57.118694 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1790/3659] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:09:56 2022] GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e => generated 1371 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:09:57.148983 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fd8928fd-a6ab-4b86-89b2-f7766fccb2ba tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:57.160571 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fd8928fd-a6ab-4b86-89b2-f7766fccb2ba tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1321 microversion: 2.1 time: 0.431638 Aug 04 17:09:57.181255 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1870/3660] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:56 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1321 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:09:57.403451 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-51af4288-fa63-46cd-ba9d-f38d5875b5c5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:57.404295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-51af4288-fa63-46cd-ba9d-f38d5875b5c5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:57.410515 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51af4288-fa63-46cd-ba9d-f38d5875b5c5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:57.417069 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51af4288-fa63-46cd-ba9d-f38d5875b5c5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:57.417683 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51af4288-fa63-46cd-ba9d-f38d5875b5c5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:57.419115 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51af4288-fa63-46cd-ba9d-f38d5875b5c5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:57.419639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51af4288-fa63-46cd-ba9d-f38d5875b5c5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:57.420029 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51af4288-fa63-46cd-ba9d-f38d5875b5c5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:57.539914 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d8884b01-9c67-4287-8b9d-2e5d58c4affc tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:57.540540 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d8884b01-9c67-4287-8b9d-2e5d58c4affc tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: 6728b692-24d5-4a20-ab3a-fc1630a75d64] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:57.554772 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8884b01-9c67-4287-8b9d-2e5d58c4affc tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:57.555278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8884b01-9c67-4287-8b9d-2e5d58c4affc tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:57.555729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8884b01-9c67-4287-8b9d-2e5d58c4affc tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:57.556448 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8884b01-9c67-4287-8b9d-2e5d58c4affc tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:57.556916 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8884b01-9c67-4287-8b9d-2e5d58c4affc tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:57.557557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8884b01-9c67-4287-8b9d-2e5d58c4affc tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:58.283029 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d8884b01-9c67-4287-8b9d-2e5d58c4affc tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:58.301017 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d8884b01-9c67-4287-8b9d-2e5d58c4affc tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64" status: 200 len: 1318 microversion: 2.1 time: 0.764680 Aug 04 17:09:58.302669 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1871/3661] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:57 2022] GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64 => generated 1318 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:58.312646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a3f2f4c4-2013-4a21-9e38-7fec710f19a6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:58.315555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a3f2f4c4-2013-4a21-9e38-7fec710f19a6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:58.319116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-51af4288-fa63-46cd-ba9d-f38d5875b5c5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:58.324435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3f2f4c4-2013-4a21-9e38-7fec710f19a6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:58.325425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3f2f4c4-2013-4a21-9e38-7fec710f19a6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:58.326454 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3f2f4c4-2013-4a21-9e38-7fec710f19a6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:58.328831 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3f2f4c4-2013-4a21-9e38-7fec710f19a6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:58.329721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3f2f4c4-2013-4a21-9e38-7fec710f19a6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:58.330830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3f2f4c4-2013-4a21-9e38-7fec710f19a6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:58.334345 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-51af4288-fa63-46cd-ba9d-f38d5875b5c5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1314 microversion: 2.1 time: 0.934685 Aug 04 17:09:58.352502 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1791/3662] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:57 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1314 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:58.361709 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5bcee478-af10-4617-bc70-950c1ba32cad tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:58.363994 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5bcee478-af10-4617-bc70-950c1ba32cad tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:58.378811 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5bcee478-af10-4617-bc70-950c1ba32cad tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:58.383353 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5bcee478-af10-4617-bc70-950c1ba32cad tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:58.385173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5bcee478-af10-4617-bc70-950c1ba32cad tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:58.386156 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5bcee478-af10-4617-bc70-950c1ba32cad tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:58.387690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5bcee478-af10-4617-bc70-950c1ba32cad tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:58.389198 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5bcee478-af10-4617-bc70-950c1ba32cad tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:58.552831 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5bcee478-af10-4617-bc70-950c1ba32cad tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:58.571400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5bcee478-af10-4617-bc70-950c1ba32cad tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:58.579230 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5bcee478-af10-4617-bc70-950c1ba32cad tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:58.582775 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5bcee478-af10-4617-bc70-950c1ba32cad tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e" status: 200 len: 1371 microversion: 2.47 time: 0.228949 Aug 04 17:09:58.592589 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1792/3663] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:09:58 2022] GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e => generated 1371 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:09:58.606805 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a3f2f4c4-2013-4a21-9e38-7fec710f19a6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:58.619138 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a3f2f4c4-2013-4a21-9e38-7fec710f19a6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1723 microversion: 2.1 time: 0.314869 Aug 04 17:09:58.622441 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3b18112b-be10-4b67-ab9b-dedce5bff24d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:58.628747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3b18112b-be10-4b67-ab9b-dedce5bff24d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:58.633765 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1872/3664] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:58 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1723 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:58.658258 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b18112b-be10-4b67-ab9b-dedce5bff24d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:58.659008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b18112b-be10-4b67-ab9b-dedce5bff24d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:58.659654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b18112b-be10-4b67-ab9b-dedce5bff24d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:58.660554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b18112b-be10-4b67-ab9b-dedce5bff24d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:58.661185 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b18112b-be10-4b67-ab9b-dedce5bff24d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:58.661802 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b18112b-be10-4b67-ab9b-dedce5bff24d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:58.949891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3b18112b-be10-4b67-ab9b-dedce5bff24d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:58.961910 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3b18112b-be10-4b67-ab9b-dedce5bff24d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1321 microversion: 2.1 time: 0.357175 Aug 04 17:09:58.963833 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1793/3665] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:58 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1321 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:59.123164 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-90b56ac8-8b1b-4e6c-8183-3950eefadf46 req-d527a21a-01c7-4a01-8694-0f29e93cea55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b958ca6-2ca6-41ac-b4f2-f28d2b031de7", "name": "network-vif-plugged", "status": "completed", "tag": "fc77b974-f9c9-468a-8a2a-e5a28d0c750d"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:09:59.162602 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-90b56ac8-8b1b-4e6c-8183-3950eefadf46 req-d527a21a-01c7-4a01-8694-0f29e93cea55 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:59.163602 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-90b56ac8-8b1b-4e6c-8183-3950eefadf46 req-d527a21a-01c7-4a01-8694-0f29e93cea55 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:59.164724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-90b56ac8-8b1b-4e6c-8183-3950eefadf46 req-d527a21a-01c7-4a01-8694-0f29e93cea55 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:59.205446 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-90b56ac8-8b1b-4e6c-8183-3950eefadf46 req-d527a21a-01c7-4a01-8694-0f29e93cea55 service nova] Creating event network-vif-plugged:fc77b974-f9c9-468a-8a2a-e5a28d0c750d for instance 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 on n-h2-851359-3 Aug 04 17:09:59.220712 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-90b56ac8-8b1b-4e6c-8183-3950eefadf46 req-d527a21a-01c7-4a01-8694-0f29e93cea55 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.382243 Aug 04 17:09:59.223532 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1873/3666] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:09:59.327164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4d620156-7371-4295-883a-647b657f7386 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:59.327792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4d620156-7371-4295-883a-647b657f7386 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: 6728b692-24d5-4a20-ab3a-fc1630a75d64] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:59.337931 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d620156-7371-4295-883a-647b657f7386 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:59.338460 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d620156-7371-4295-883a-647b657f7386 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:59.338905 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d620156-7371-4295-883a-647b657f7386 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:59.339632 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d620156-7371-4295-883a-647b657f7386 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:59.340094 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d620156-7371-4295-883a-647b657f7386 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:59.340527 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d620156-7371-4295-883a-647b657f7386 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:59.358626 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3dc57b67-3cda-4399-9226-1d87dc2da9b5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:59.359352 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3dc57b67-3cda-4399-9226-1d87dc2da9b5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:59.375140 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3dc57b67-3cda-4399-9226-1d87dc2da9b5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:59.376320 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3dc57b67-3cda-4399-9226-1d87dc2da9b5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:59.376793 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3dc57b67-3cda-4399-9226-1d87dc2da9b5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:59.380510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3dc57b67-3cda-4399-9226-1d87dc2da9b5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:59.381051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3dc57b67-3cda-4399-9226-1d87dc2da9b5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:59.381661 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3dc57b67-3cda-4399-9226-1d87dc2da9b5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:59.394782 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:09:59.693938 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3dc57b67-3cda-4399-9226-1d87dc2da9b5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:59.706048 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3dc57b67-3cda-4399-9226-1d87dc2da9b5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1314 microversion: 2.1 time: 0.353974 Aug 04 17:09:59.713700 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1874/3667] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:59 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:09:59.722996 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dccf31ec-e71f-4662-b784-e4c885ef13eb tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:59.723712 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dccf31ec-e71f-4662-b784-e4c885ef13eb tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:59.740655 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4d620156-7371-4295-883a-647b657f7386 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:59.743989 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dccf31ec-e71f-4662-b784-e4c885ef13eb tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:59.746625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dccf31ec-e71f-4662-b784-e4c885ef13eb tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:59.747136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dccf31ec-e71f-4662-b784-e4c885ef13eb tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:59.750417 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4d620156-7371-4295-883a-647b657f7386 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64" status: 200 len: 1318 microversion: 2.1 time: 0.428460 Aug 04 17:09:59.751588 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1794/3668] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:59 2022] GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64 => generated 1318 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:09:59.752853 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dccf31ec-e71f-4662-b784-e4c885ef13eb tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:59.753428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dccf31ec-e71f-4662-b784-e4c885ef13eb tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:59.753938 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dccf31ec-e71f-4662-b784-e4c885ef13eb tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:59.757933 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2e194c42-1a7c-4a55-b928-5788d609de6a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:09:59.758782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2e194c42-1a7c-4a55-b928-5788d609de6a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:09:59.765248 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e194c42-1a7c-4a55-b928-5788d609de6a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:59.766265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e194c42-1a7c-4a55-b928-5788d609de6a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:59.766901 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e194c42-1a7c-4a55-b928-5788d609de6a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:59.767840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e194c42-1a7c-4a55-b928-5788d609de6a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:09:59.768692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e194c42-1a7c-4a55-b928-5788d609de6a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:09:59.769386 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e194c42-1a7c-4a55-b928-5788d609de6a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:09:59.931902 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dccf31ec-e71f-4662-b784-e4c885ef13eb tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:59.947780 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dccf31ec-e71f-4662-b784-e4c885ef13eb tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:59.952781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dccf31ec-e71f-4662-b784-e4c885ef13eb tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:09:59.955087 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dccf31ec-e71f-4662-b784-e4c885ef13eb tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e" status: 200 len: 1371 microversion: 2.47 time: 0.240239 Aug 04 17:09:59.970016 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1875/3669] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:09:59 2022] GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e => generated 1371 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:00.090306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2e194c42-1a7c-4a55-b928-5788d609de6a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:00.106721 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2e194c42-1a7c-4a55-b928-5788d609de6a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1723 microversion: 2.1 time: 0.353731 Aug 04 17:10:00.107374 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1795/3670] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:09:59 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1723 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:00.137804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-f0aea86c-e3cd-404c-8169-d288d3795916 req-716a9b95-feb0-4615-bae3-c0811358c569 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2f9bc6d-2c94-4ca6-ab81-62a991e04693", "tag": "195b4d22-104f-4024-9610-835ea111782f"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:00.154841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f0aea86c-e3cd-404c-8169-d288d3795916 req-716a9b95-feb0-4615-bae3-c0811358c569 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:00.155622 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f0aea86c-e3cd-404c-8169-d288d3795916 req-716a9b95-feb0-4615-bae3-c0811358c569 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:00.156257 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f0aea86c-e3cd-404c-8169-d288d3795916 req-716a9b95-feb0-4615-bae3-c0811358c569 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:00.183717 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-f0aea86c-e3cd-404c-8169-d288d3795916 req-716a9b95-feb0-4615-bae3-c0811358c569 service nova] Creating event network-changed:195b4d22-104f-4024-9610-835ea111782f for instance c2f9bc6d-2c94-4ca6-ab81-62a991e04693 on n-h1-851359-3 Aug 04 17:10:00.199799 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-f0aea86c-e3cd-404c-8169-d288d3795916 req-716a9b95-feb0-4615-bae3-c0811358c569 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076440 Aug 04 17:10:00.200416 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1796/3671] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:10:00.205829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0a877806-9386-4ca6-8214-7d5c8447da0a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:00.213154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0a877806-9386-4ca6-8214-7d5c8447da0a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:00.223824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a877806-9386-4ca6-8214-7d5c8447da0a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:00.226582 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a877806-9386-4ca6-8214-7d5c8447da0a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:00.227218 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a877806-9386-4ca6-8214-7d5c8447da0a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:00.231894 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a877806-9386-4ca6-8214-7d5c8447da0a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:00.232621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a877806-9386-4ca6-8214-7d5c8447da0a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:00.233062 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a877806-9386-4ca6-8214-7d5c8447da0a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:00.284321 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ca614317-794e-4b91-a2b6-07acd23dcde6 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Action: 'create', calling method: .version_select at 0x7f1e5aa7f700>, body: {"keypair": {"name": "tempest-keypair-200109654", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTfgtKufdroCn3+Uoxn0NkJC9Y+CSw6xcBvrENkU/fdm/M3I5ocTGcQdYcM3sxAOevrTBgvhgPWK4ToO3lJt9Sq5bH7Eb6Yo26dwwQCGUJstAQCAZawyyNGk46ZFOZGVQ=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:00.307393 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-ca614317-794e-4b91-a2b6-07acd23dcde6 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Getting quotas for project 6bd0b59b952a4a1d8cbc68b4448dfc0a. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:10:00.314296 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-ca614317-794e-4b91-a2b6-07acd23dcde6 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Getting quotas for user c3243fe2bab64fbf8ea77b4f969b16db and project 6bd0b59b952a4a1d8cbc68b4448dfc0a. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:10:00.341354 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ca614317-794e-4b91-a2b6-07acd23dcde6 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.383838 Aug 04 17:10:00.342980 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1876/3672] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:09:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:10:00.687468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0a877806-9386-4ca6-8214-7d5c8447da0a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:00.696271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:00.702205 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0a877806-9386-4ca6-8214-7d5c8447da0a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1321 microversion: 2.1 time: 0.499890 Aug 04 17:10:00.703200 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1797/3673] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:00 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1321 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:00.728276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-eda2afea-a00d-4a0a-acf3-314522cf57b1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:00.728895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-eda2afea-a00d-4a0a-acf3-314522cf57b1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:00.734898 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eda2afea-a00d-4a0a-acf3-314522cf57b1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:00.735395 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eda2afea-a00d-4a0a-acf3-314522cf57b1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:00.735835 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eda2afea-a00d-4a0a-acf3-314522cf57b1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:00.736533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eda2afea-a00d-4a0a-acf3-314522cf57b1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:00.737151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eda2afea-a00d-4a0a-acf3-314522cf57b1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:00.737723 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eda2afea-a00d-4a0a-acf3-314522cf57b1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:00.777787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fb1c4c5a-f4a7-473d-9f94-36ce14e83ca7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:00.778718 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fb1c4c5a-f4a7-473d-9f94-36ce14e83ca7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: 6728b692-24d5-4a20-ab3a-fc1630a75d64] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:00.785173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb1c4c5a-f4a7-473d-9f94-36ce14e83ca7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:00.785969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb1c4c5a-f4a7-473d-9f94-36ce14e83ca7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:00.786607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb1c4c5a-f4a7-473d-9f94-36ce14e83ca7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:00.787478 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb1c4c5a-f4a7-473d-9f94-36ce14e83ca7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:00.788091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb1c4c5a-f4a7-473d-9f94-36ce14e83ca7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:00.788698 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb1c4c5a-f4a7-473d-9f94-36ce14e83ca7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:01.267624 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fb1c4c5a-f4a7-473d-9f94-36ce14e83ca7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:01.285511 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fb1c4c5a-f4a7-473d-9f94-36ce14e83ca7 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64" status: 200 len: 1318 microversion: 2.1 time: 0.511060 Aug 04 17:10:01.290965 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1798/3674] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:00 2022] GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64 => generated 1318 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:01.298378 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e0b1b4a5-d7b5-46db-964d-39dd44e1912d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:01.305261 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e0b1b4a5-d7b5-46db-964d-39dd44e1912d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:01.318939 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0b1b4a5-d7b5-46db-964d-39dd44e1912d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:01.320651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0b1b4a5-d7b5-46db-964d-39dd44e1912d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:01.324242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0b1b4a5-d7b5-46db-964d-39dd44e1912d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:01.324848 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-eda2afea-a00d-4a0a-acf3-314522cf57b1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:01.326067 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0b1b4a5-d7b5-46db-964d-39dd44e1912d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:01.326745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0b1b4a5-d7b5-46db-964d-39dd44e1912d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:01.327377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0b1b4a5-d7b5-46db-964d-39dd44e1912d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:01.344091 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-eda2afea-a00d-4a0a-acf3-314522cf57b1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1314 microversion: 2.1 time: 0.620806 Aug 04 17:10:01.345225 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1877/3675] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:00 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1314 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:01.350822 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8b9f6a17-96b0-4da3-86c5-f51dd122df94 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:01.352232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8b9f6a17-96b0-4da3-86c5-f51dd122df94 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:01.369073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8b9f6a17-96b0-4da3-86c5-f51dd122df94 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:01.370006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8b9f6a17-96b0-4da3-86c5-f51dd122df94 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:01.371625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8b9f6a17-96b0-4da3-86c5-f51dd122df94 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:01.377723 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8b9f6a17-96b0-4da3-86c5-f51dd122df94 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:01.378832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8b9f6a17-96b0-4da3-86c5-f51dd122df94 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:01.379611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8b9f6a17-96b0-4da3-86c5-f51dd122df94 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:01.391216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:01.464434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=20 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:01.560371 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e0b1b4a5-d7b5-46db-964d-39dd44e1912d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:01.580081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e0b1b4a5-d7b5-46db-964d-39dd44e1912d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:01.582286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e0b1b4a5-d7b5-46db-964d-39dd44e1912d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:01.583701 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e0b1b4a5-d7b5-46db-964d-39dd44e1912d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e" status: 200 len: 1356 microversion: 2.47 time: 0.289329 Aug 04 17:10:01.584502 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1799/3676] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:01 2022] GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e => generated 1356 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:01.597512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-e9bf22bc-14ee-420b-a7b0-8993d94bcbd8 req-8090a2d7-831a-4afb-bcc4-2668a75fb1d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6728b692-24d5-4a20-ab3a-fc1630a75d64", "name": "network-vif-plugged", "status": "completed", "tag": "1b5fbe39-cbd2-4db1-92b2-fae6005216b5"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:01.614962 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e9bf22bc-14ee-420b-a7b0-8993d94bcbd8 req-8090a2d7-831a-4afb-bcc4-2668a75fb1d1 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:01.621954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e9bf22bc-14ee-420b-a7b0-8993d94bcbd8 req-8090a2d7-831a-4afb-bcc4-2668a75fb1d1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:01.622809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e9bf22bc-14ee-420b-a7b0-8993d94bcbd8 req-8090a2d7-831a-4afb-bcc4-2668a75fb1d1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:01.641055 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-e9bf22bc-14ee-420b-a7b0-8993d94bcbd8 req-8090a2d7-831a-4afb-bcc4-2668a75fb1d1 service nova] Creating event network-vif-plugged:1b5fbe39-cbd2-4db1-92b2-fae6005216b5 for instance 6728b692-24d5-4a20-ab3a-fc1630a75d64 on n-h1-851359-3 Aug 04 17:10:01.646470 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-e9bf22bc-14ee-420b-a7b0-8993d94bcbd8 req-8090a2d7-831a-4afb-bcc4-2668a75fb1d1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058882 Aug 04 17:10:01.650127 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1800/3677] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:10:01.655713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9fd9bc3d-f3b5-4fa5-84b8-22d16f8f4063 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:01.660287 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9fd9bc3d-f3b5-4fa5-84b8-22d16f8f4063 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:01.661131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9fd9bc3d-f3b5-4fa5-84b8-22d16f8f4063 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Searching by: {'deleted': False, 'project_id': '538e626497154361a47f81781bce54a0'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:10:01.667083 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fd9bc3d-f3b5-4fa5-84b8-22d16f8f4063 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:01.667558 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fd9bc3d-f3b5-4fa5-84b8-22d16f8f4063 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:01.668057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fd9bc3d-f3b5-4fa5-84b8-22d16f8f4063 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:01.668811 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fd9bc3d-f3b5-4fa5-84b8-22d16f8f4063 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:01.669280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fd9bc3d-f3b5-4fa5-84b8-22d16f8f4063 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:01.669959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fd9bc3d-f3b5-4fa5-84b8-22d16f8f4063 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:01.732461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8b9f6a17-96b0-4da3-86c5-f51dd122df94 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:01.755746 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8b9f6a17-96b0-4da3-86c5-f51dd122df94 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1723 microversion: 2.1 time: 0.406450 Aug 04 17:10:01.757247 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1878/3678] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:01 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1723 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:01.772540 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5710694e-7551-405b-8eb3-a20114a59eb4 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:01.773695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5710694e-7551-405b-8eb3-a20114a59eb4 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:01.794515 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5710694e-7551-405b-8eb3-a20114a59eb4 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:01.797034 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5710694e-7551-405b-8eb3-a20114a59eb4 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:01.799212 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5710694e-7551-405b-8eb3-a20114a59eb4 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:01.801114 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5710694e-7551-405b-8eb3-a20114a59eb4 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:01.803175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5710694e-7551-405b-8eb3-a20114a59eb4 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:01.806214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5710694e-7551-405b-8eb3-a20114a59eb4 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:01.861482 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-9fd9bc3d-f3b5-4fa5-84b8-22d16f8f4063 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:10:01.974421 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9fd9bc3d-f3b5-4fa5-84b8-22d16f8f4063 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:01.985078 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fd9bc3d-f3b5-4fa5-84b8-22d16f8f4063 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:01.985836 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fd9bc3d-f3b5-4fa5-84b8-22d16f8f4063 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:01.986499 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fd9bc3d-f3b5-4fa5-84b8-22d16f8f4063 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:02.007745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9fd9bc3d-f3b5-4fa5-84b8-22d16f8f4063 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:02.011305 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9fd9bc3d-f3b5-4fa5-84b8-22d16f8f4063 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:02.107351 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9fd9bc3d-f3b5-4fa5-84b8-22d16f8f4063 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.455622 Aug 04 17:10:02.118171 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1801/3679] 10.222.0.93 () {60 vars in 1187 bytes} [Thu Aug 4 17:10:01 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:02.143311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-52426548-2d5c-4823-9efe-12a0aa6ed934 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:02.144376 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-52426548-2d5c-4823-9efe-12a0aa6ed934 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:02.156037 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52426548-2d5c-4823-9efe-12a0aa6ed934 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:02.156958 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52426548-2d5c-4823-9efe-12a0aa6ed934 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:02.157843 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52426548-2d5c-4823-9efe-12a0aa6ed934 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:02.159367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52426548-2d5c-4823-9efe-12a0aa6ed934 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:02.159995 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52426548-2d5c-4823-9efe-12a0aa6ed934 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:02.160650 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52426548-2d5c-4823-9efe-12a0aa6ed934 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:02.207714 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-52426548-2d5c-4823-9efe-12a0aa6ed934 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:10:02.345040 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5710694e-7551-405b-8eb3-a20114a59eb4 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:02.356512 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-52426548-2d5c-4823-9efe-12a0aa6ed934 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "DELETE /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e" status: 204 len: 0 microversion: 2.47 time: 0.194967 Aug 04 17:10:02.361221 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1802/3680] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Aug 4 17:10:02 2022] DELETE /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:10:02.361347 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5710694e-7551-405b-8eb3-a20114a59eb4 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1321 microversion: 2.1 time: 0.599469 Aug 04 17:10:02.380030 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1879/3681] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:01 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1321 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:02.385453 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ac5cd838-52c9-4ac2-8ce6-3b7c4dc5ddb4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:02.386215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ac5cd838-52c9-4ac2-8ce6-3b7c4dc5ddb4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:02.389073 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3d72e114-f567-4ac8-953d-33258bf60f0c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:02.389812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3d72e114-f567-4ac8-953d-33258bf60f0c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: 6728b692-24d5-4a20-ab3a-fc1630a75d64] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:02.400388 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d72e114-f567-4ac8-953d-33258bf60f0c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:02.402444 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d72e114-f567-4ac8-953d-33258bf60f0c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:02.403356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d72e114-f567-4ac8-953d-33258bf60f0c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:02.404486 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d72e114-f567-4ac8-953d-33258bf60f0c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:02.406058 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac5cd838-52c9-4ac2-8ce6-3b7c4dc5ddb4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:02.406675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac5cd838-52c9-4ac2-8ce6-3b7c4dc5ddb4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:02.407131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac5cd838-52c9-4ac2-8ce6-3b7c4dc5ddb4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:02.407856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac5cd838-52c9-4ac2-8ce6-3b7c4dc5ddb4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:02.408329 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac5cd838-52c9-4ac2-8ce6-3b7c4dc5ddb4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:02.408781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac5cd838-52c9-4ac2-8ce6-3b7c4dc5ddb4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:02.411724 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d72e114-f567-4ac8-953d-33258bf60f0c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:02.412282 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d72e114-f567-4ac8-953d-33258bf60f0c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:03.029612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3d72e114-f567-4ac8-953d-33258bf60f0c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:03.044069 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3d72e114-f567-4ac8-953d-33258bf60f0c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64" status: 200 len: 1318 microversion: 2.1 time: 0.683317 Aug 04 17:10:03.046274 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1803/3682] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:02 2022] GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64 => generated 1318 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:03.052368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7c21d14e-e60f-4850-b916-d62547fae4ef tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:03.053202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7c21d14e-e60f-4850-b916-d62547fae4ef tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:03.084360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c21d14e-e60f-4850-b916-d62547fae4ef tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:03.085666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c21d14e-e60f-4850-b916-d62547fae4ef tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:03.087778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c21d14e-e60f-4850-b916-d62547fae4ef tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:03.089387 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c21d14e-e60f-4850-b916-d62547fae4ef tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:03.090822 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c21d14e-e60f-4850-b916-d62547fae4ef tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:03.093906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c21d14e-e60f-4850-b916-d62547fae4ef tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:03.122215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ac5cd838-52c9-4ac2-8ce6-3b7c4dc5ddb4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:03.145078 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ac5cd838-52c9-4ac2-8ce6-3b7c4dc5ddb4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1314 microversion: 2.1 time: 0.763812 Aug 04 17:10:03.152128 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1880/3683] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:02 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1314 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:03.175609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3dba96df-b2a8-4fc0-a086-c7d60ba6000d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:03.176812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3dba96df-b2a8-4fc0-a086-c7d60ba6000d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:03.202223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3dba96df-b2a8-4fc0-a086-c7d60ba6000d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:03.215543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3dba96df-b2a8-4fc0-a086-c7d60ba6000d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:03.216322 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3dba96df-b2a8-4fc0-a086-c7d60ba6000d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:03.217132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3dba96df-b2a8-4fc0-a086-c7d60ba6000d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:03.217628 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3dba96df-b2a8-4fc0-a086-c7d60ba6000d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:03.220728 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3dba96df-b2a8-4fc0-a086-c7d60ba6000d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:03.267104 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7c21d14e-e60f-4850-b916-d62547fae4ef tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:03.281485 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7c21d14e-e60f-4850-b916-d62547fae4ef tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:03.284736 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7c21d14e-e60f-4850-b916-d62547fae4ef tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:03.286716 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7c21d14e-e60f-4850-b916-d62547fae4ef tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e" status: 200 len: 1362 microversion: 2.47 time: 0.239110 Aug 04 17:10:03.287817 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1804/3684] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:03 2022] GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:03.293514 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-38e9a97c-131b-4429-bb95-66fcf6fa4794 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-938267029", "imageRef": "2c15ef6b-b25c-4777-942b-1340580dc6b7", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "3d112425-48d9-4a9e-8955-5e2db478d163"}], "security_groups": [{"name": "tempest-securitygroup--259583269"}], "key_name": "tempest-keypair-200109654", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:03.561861 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-38e9a97c-131b-4429-bb95-66fcf6fa4794 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] validate_networks() for [('3d112425-48d9-4a9e-8955-5e2db478d163', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:10:03.571895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3dba96df-b2a8-4fc0-a086-c7d60ba6000d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:03.580843 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3dba96df-b2a8-4fc0-a086-c7d60ba6000d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1723 microversion: 2.1 time: 0.425267 Aug 04 17:10:03.581651 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1881/3685] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:03 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1723 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:03.591776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-758da28a-3f4a-4464-ab8c-f2e6bed3a741 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:03.599075 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-758da28a-3f4a-4464-ab8c-f2e6bed3a741 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:03.623355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-758da28a-3f4a-4464-ab8c-f2e6bed3a741 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:03.624316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-758da28a-3f4a-4464-ab8c-f2e6bed3a741 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:03.625114 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-758da28a-3f4a-4464-ab8c-f2e6bed3a741 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:03.626264 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-758da28a-3f4a-4464-ab8c-f2e6bed3a741 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:03.626935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-758da28a-3f4a-4464-ab8c-f2e6bed3a741 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:03.627414 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-758da28a-3f4a-4464-ab8c-f2e6bed3a741 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:04.254850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-758da28a-3f4a-4464-ab8c-f2e6bed3a741 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:04.273678 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-758da28a-3f4a-4464-ab8c-f2e6bed3a741 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1514 microversion: 2.1 time: 0.689991 Aug 04 17:10:04.274304 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1882/3686] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:03 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1514 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:04.291976 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a959165c-a58e-40f2-8bfc-0a9d461c8f58 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:04.292607 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a959165c-a58e-40f2-8bfc-0a9d461c8f58 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: 6728b692-24d5-4a20-ab3a-fc1630a75d64] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:04.299221 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a959165c-a58e-40f2-8bfc-0a9d461c8f58 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:04.300020 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a959165c-a58e-40f2-8bfc-0a9d461c8f58 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:04.300491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a959165c-a58e-40f2-8bfc-0a9d461c8f58 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:04.301199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a959165c-a58e-40f2-8bfc-0a9d461c8f58 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:04.301672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a959165c-a58e-40f2-8bfc-0a9d461c8f58 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:04.302228 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a959165c-a58e-40f2-8bfc-0a9d461c8f58 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:04.551973 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a959165c-a58e-40f2-8bfc-0a9d461c8f58 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:04.560993 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a959165c-a58e-40f2-8bfc-0a9d461c8f58 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64" status: 200 len: 1507 microversion: 2.1 time: 0.273152 Aug 04 17:10:04.576915 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1883/3687] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:04 2022] GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64 => generated 1507 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:04.590213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c41885f1-ba81-4b7d-a46f-4a5be02e56dd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:04.591149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-38e9a97c-131b-4429-bb95-66fcf6fa4794 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:10:04.591623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-38e9a97c-131b-4429-bb95-66fcf6fa4794 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:10:04.591947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c41885f1-ba81-4b7d-a46f-4a5be02e56dd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:04.592074 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-38e9a97c-131b-4429-bb95-66fcf6fa4794 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:10:04.598075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-38e9a97c-131b-4429-bb95-66fcf6fa4794 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:10:04.598526 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-38e9a97c-131b-4429-bb95-66fcf6fa4794 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:10:04.602685 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c41885f1-ba81-4b7d-a46f-4a5be02e56dd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:04.603572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c41885f1-ba81-4b7d-a46f-4a5be02e56dd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:04.604231 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c41885f1-ba81-4b7d-a46f-4a5be02e56dd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:04.605469 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c41885f1-ba81-4b7d-a46f-4a5be02e56dd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:04.606190 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c41885f1-ba81-4b7d-a46f-4a5be02e56dd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:04.606828 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c41885f1-ba81-4b7d-a46f-4a5be02e56dd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:04.609400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38e9a97c-131b-4429-bb95-66fcf6fa4794 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:04.609895 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38e9a97c-131b-4429-bb95-66fcf6fa4794 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:04.610356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38e9a97c-131b-4429-bb95-66fcf6fa4794 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:04.611302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38e9a97c-131b-4429-bb95-66fcf6fa4794 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:04.611929 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38e9a97c-131b-4429-bb95-66fcf6fa4794 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:04.612523 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38e9a97c-131b-4429-bb95-66fcf6fa4794 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:04.635543 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-38e9a97c-131b-4429-bb95-66fcf6fa4794 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Getting quotas for project 6bd0b59b952a4a1d8cbc68b4448dfc0a. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:10:04.642227 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-38e9a97c-131b-4429-bb95-66fcf6fa4794 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Getting quotas for user c3243fe2bab64fbf8ea77b4f969b16db and project 6bd0b59b952a4a1d8cbc68b4448dfc0a. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:10:04.659548 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:04.666861 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-38e9a97c-131b-4429-bb95-66fcf6fa4794 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:10:04.673258 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-38e9a97c-131b-4429-bb95-66fcf6fa4794 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c15ef6b-b25c-4777-942b-1340580dc6b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:10:04.779524 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-38e9a97c-131b-4429-bb95-66fcf6fa4794 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.489478 Aug 04 17:10:04.780548 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1805/3688] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:10:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 1492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:10:04.795202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c41885f1-ba81-4b7d-a46f-4a5be02e56dd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:04.804611 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c41885f1-ba81-4b7d-a46f-4a5be02e56dd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1314 microversion: 2.1 time: 0.225811 Aug 04 17:10:04.805648 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1884/3689] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:04 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:04.810894 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a8c78afd-e6bd-41b0-8a0a-8a8b11e0a377 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:04.811810 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a8c78afd-e6bd-41b0-8a0a-8a8b11e0a377 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:04.818481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8c78afd-e6bd-41b0-8a0a-8a8b11e0a377 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:04.819290 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8c78afd-e6bd-41b0-8a0a-8a8b11e0a377 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:04.820601 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8c78afd-e6bd-41b0-8a0a-8a8b11e0a377 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:04.821572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8c78afd-e6bd-41b0-8a0a-8a8b11e0a377 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:04.822314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8c78afd-e6bd-41b0-8a0a-8a8b11e0a377 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:04.822972 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8c78afd-e6bd-41b0-8a0a-8a8b11e0a377 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:04.825543 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-066dde80-ac27-4537-9aa5-fe1290bc6cbc tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:04.843360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-066dde80-ac27-4537-9aa5-fe1290bc6cbc tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:04.861890 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-066dde80-ac27-4537-9aa5-fe1290bc6cbc tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:04.864069 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-066dde80-ac27-4537-9aa5-fe1290bc6cbc tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:04.865748 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-066dde80-ac27-4537-9aa5-fe1290bc6cbc tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:04.883183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-066dde80-ac27-4537-9aa5-fe1290bc6cbc tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:04.884042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-066dde80-ac27-4537-9aa5-fe1290bc6cbc tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:04.884846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-066dde80-ac27-4537-9aa5-fe1290bc6cbc tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:04.943942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-066dde80-ac27-4537-9aa5-fe1290bc6cbc tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lazy-loading 'flavor' on Instance uuid 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:10:04.963581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a8c78afd-e6bd-41b0-8a0a-8a8b11e0a377 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:04.972896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a8c78afd-e6bd-41b0-8a0a-8a8b11e0a377 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:04.974771 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a8c78afd-e6bd-41b0-8a0a-8a8b11e0a377 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:04.976342 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a8c78afd-e6bd-41b0-8a0a-8a8b11e0a377 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e" status: 200 len: 1362 microversion: 2.47 time: 0.169242 Aug 04 17:10:04.977560 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1885/3690] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:04 2022] GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:04.982580 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-aa0e12d2-8fa1-4a54-890a-2928dec4852c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:04.983406 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-aa0e12d2-8fa1-4a54-890a-2928dec4852c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: 6728b692-24d5-4a20-ab3a-fc1630a75d64] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:04.990412 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa0e12d2-8fa1-4a54-890a-2928dec4852c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:04.992057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa0e12d2-8fa1-4a54-890a-2928dec4852c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:04.992797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa0e12d2-8fa1-4a54-890a-2928dec4852c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:04.993834 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa0e12d2-8fa1-4a54-890a-2928dec4852c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:04.994534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa0e12d2-8fa1-4a54-890a-2928dec4852c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:04.995171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa0e12d2-8fa1-4a54-890a-2928dec4852c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:05.085623 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-066dde80-ac27-4537-9aa5-fe1290bc6cbc tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "POST /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7/action" status: 200 len: 32 microversion: 2.1 time: 0.302353 Aug 04 17:10:05.093719 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1806/3691] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:10:04 2022] POST /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7/action => generated 32 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:10:05.099715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-328c242b-056c-4d18-89fa-3d7b73b3c49a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:05.101753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-328c242b-056c-4d18-89fa-3d7b73b3c49a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:05.109108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-328c242b-056c-4d18-89fa-3d7b73b3c49a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:05.109865 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-328c242b-056c-4d18-89fa-3d7b73b3c49a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:05.110213 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-328c242b-056c-4d18-89fa-3d7b73b3c49a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:05.111603 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-328c242b-056c-4d18-89fa-3d7b73b3c49a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:05.112339 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-328c242b-056c-4d18-89fa-3d7b73b3c49a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:05.112933 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-328c242b-056c-4d18-89fa-3d7b73b3c49a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:05.321618 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-aa0e12d2-8fa1-4a54-890a-2928dec4852c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:05.332941 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-aa0e12d2-8fa1-4a54-890a-2928dec4852c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64" status: 200 len: 1507 microversion: 2.1 time: 0.354037 Aug 04 17:10:05.337189 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1886/3692] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:04 2022] GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64 => generated 1507 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:05.359792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-97bf2c5a-800e-44d4-b748-8487df3f7f36 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:05.361508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-97bf2c5a-800e-44d4-b748-8487df3f7f36 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:05.392435 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-328c242b-056c-4d18-89fa-3d7b73b3c49a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:05.406818 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-328c242b-056c-4d18-89fa-3d7b73b3c49a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1723 microversion: 2.1 time: 0.310295 Aug 04 17:10:05.411677 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1807/3693] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:05 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1723 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:05.422911 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-46b9f23c-15ef-4bf9-886f-a6340cde8399 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:05.423694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-46b9f23c-15ef-4bf9-886f-a6340cde8399 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:05.442855 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46b9f23c-15ef-4bf9-886f-a6340cde8399 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:05.447730 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46b9f23c-15ef-4bf9-886f-a6340cde8399 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:05.448189 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46b9f23c-15ef-4bf9-886f-a6340cde8399 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:05.448934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46b9f23c-15ef-4bf9-886f-a6340cde8399 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:05.449390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46b9f23c-15ef-4bf9-886f-a6340cde8399 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:05.449824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46b9f23c-15ef-4bf9-886f-a6340cde8399 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:05.565935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-97bf2c5a-800e-44d4-b748-8487df3f7f36 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3243fe2bab64fbf8ea77b4f969b16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd0b59b952a4a1d8cbc68b4448dfc0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:05.583168 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-97bf2c5a-800e-44d4-b748-8487df3f7f36 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334" status: 200 len: 1244 microversion: 2.1 time: 0.227103 Aug 04 17:10:05.587211 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1887/3694] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:05 2022] GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334 => generated 1244 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:05.605606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2a706270-3287-4b55-baef-e33300bdae14 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:05.619500 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2a706270-3287-4b55-baef-e33300bdae14 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: 6728b692-24d5-4a20-ab3a-fc1630a75d64] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:05.641130 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2a706270-3287-4b55-baef-e33300bdae14 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:05.641958 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2a706270-3287-4b55-baef-e33300bdae14 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:05.642680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2a706270-3287-4b55-baef-e33300bdae14 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:05.644265 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2a706270-3287-4b55-baef-e33300bdae14 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:05.662134 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2a706270-3287-4b55-baef-e33300bdae14 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:05.662689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2a706270-3287-4b55-baef-e33300bdae14 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:05.812811 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2a706270-3287-4b55-baef-e33300bdae14 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "PUT /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64" status: 200 len: 1079 microversion: 2.1 time: 0.223528 Aug 04 17:10:05.827902 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1888/3695] 10.222.0.93 () {60 vars in 1256 bytes} [Thu Aug 4 17:10:05 2022] PUT /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64 => generated 1079 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:05.833690 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-00fa6951-361a-4b7f-bb8a-74e3f44d0da2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:05.836734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-00fa6951-361a-4b7f-bb8a-74e3f44d0da2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:05.843999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00fa6951-361a-4b7f-bb8a-74e3f44d0da2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:05.844865 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00fa6951-361a-4b7f-bb8a-74e3f44d0da2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:05.845520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00fa6951-361a-4b7f-bb8a-74e3f44d0da2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:05.846465 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00fa6951-361a-4b7f-bb8a-74e3f44d0da2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:05.847106 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00fa6951-361a-4b7f-bb8a-74e3f44d0da2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:05.848086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-00fa6951-361a-4b7f-bb8a-74e3f44d0da2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:06.090007 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-46b9f23c-15ef-4bf9-886f-a6340cde8399 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:06.099658 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-46b9f23c-15ef-4bf9-886f-a6340cde8399 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1520 microversion: 2.1 time: 0.686756 Aug 04 17:10:06.107304 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1808/3696] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:05 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1520 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:06.112898 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3657a7bb-9e34-47f8-a016-537c0c0d3641 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:06.114623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3657a7bb-9e34-47f8-a016-537c0c0d3641 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: 6728b692-24d5-4a20-ab3a-fc1630a75d64] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:06.130562 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3657a7bb-9e34-47f8-a016-537c0c0d3641 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:06.131222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3657a7bb-9e34-47f8-a016-537c0c0d3641 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:06.132302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3657a7bb-9e34-47f8-a016-537c0c0d3641 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:06.133101 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3657a7bb-9e34-47f8-a016-537c0c0d3641 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:06.133659 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3657a7bb-9e34-47f8-a016-537c0c0d3641 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:06.136001 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3657a7bb-9e34-47f8-a016-537c0c0d3641 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:06.386788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-00fa6951-361a-4b7f-bb8a-74e3f44d0da2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:06.398931 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-00fa6951-361a-4b7f-bb8a-74e3f44d0da2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1314 microversion: 2.1 time: 0.569182 Aug 04 17:10:06.400369 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1889/3697] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:05 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1314 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:06.408937 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2fbfb596-7a4b-40d6-a761-f8340b56493d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:06.410629 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2fbfb596-7a4b-40d6-a761-f8340b56493d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: eacae492-2cfe-48f9-ad6a-60b961640a3e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:06.424526 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2fbfb596-7a4b-40d6-a761-f8340b56493d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:06.425108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2fbfb596-7a4b-40d6-a761-f8340b56493d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:06.425592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2fbfb596-7a4b-40d6-a761-f8340b56493d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:06.426717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2fbfb596-7a4b-40d6-a761-f8340b56493d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:06.426899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2fbfb596-7a4b-40d6-a761-f8340b56493d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:06.427229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2fbfb596-7a4b-40d6-a761-f8340b56493d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:06.454777 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-2fbfb596-7a4b-40d6-a761-f8340b56493d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] HTTP exception thrown: Instance eacae492-2cfe-48f9-ad6a-60b961640a3e could not be found. Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2fbfb596-7a4b-40d6-a761-f8340b56493d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Request method failure captured: Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e HTTP/1.1 Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_001BAyfVZnj869SCcLcTNKAagFHz0-ELCuUmg7vpiSTe1Rsi7Dr6QfdfhMaEQwrTgCTp1ZGuMSHGm9RMVVu2X9HyQ7pFMCsOf_K5VcsFuGauZQJlhR0wwV059y0NOM-qJcEo-ufPT7JgJdOlbTo88NuPBsQSi_3H7d91N7fVesxoI Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: X-Openstack-Nova-Api-Version: 2.47 Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 538e626497154361a47f81781bce54a0 Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerShowV247Test-832347210 Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/538e626497154361a47f81781bce54a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/538e626497154361a47f81781bce54a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_538e626497154361a47f81781bce54a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/538e626497154361a47f81781bce54a0"}]}] Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerShowV247Test-832347210 Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 538e626497154361a47f81781bce54a0 Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerShowV247Test-832347210 Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerShowV247Test-832347210-project Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: b819c1114b2941688b7edb7180df8592 Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerShowV247Test-832347210-project Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance eacae492-2cfe-48f9-ad6a-60b961640a3e could not be found. Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'eacae492-2cfe-48f9-ad6a-60b961640a3e'} Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eacae492-2cfe-48f9-ad6a-60b961640a3e could not be found. Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eacae492-2cfe-48f9-ad6a-60b961640a3e could not be found. Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:10:06.458793 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:06.465810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:06.465810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:10:06.465810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:10:06.465810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:10:06.465810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:10:06.465810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eacae492-2cfe-48f9-ad6a-60b961640a3e could not be found. Aug 04 17:10:06.465810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:06.472595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3657a7bb-9e34-47f8-a016-537c0c0d3641 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:06.482943 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2fbfb596-7a4b-40d6-a761-f8340b56493d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Returning 404 to user: Instance eacae492-2cfe-48f9-ad6a-60b961640a3e could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:10:06.483868 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2fbfb596-7a4b-40d6-a761-f8340b56493d tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e" status: 404 len: 111 microversion: 2.47 time: 0.081887 Aug 04 17:10:06.484527 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1890/3698] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:06 2022] GET /compute/v2.1/servers/eacae492-2cfe-48f9-ad6a-60b961640a3e => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:10:06.490271 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3657a7bb-9e34-47f8-a016-537c0c0d3641 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64" status: 200 len: 1505 microversion: 2.1 time: 0.381315 Aug 04 17:10:06.491927 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1809/3699] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:06 2022] GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64 => generated 1505 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:06.516926 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-31f0148d-de97-4ebf-9dc9-254530500a2a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:06.518583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-31f0148d-de97-4ebf-9dc9-254530500a2a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:06.522330 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-78116604-9399-49b5-b523-a08968abc12a tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:06.528758 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-78116604-9399-49b5-b523-a08968abc12a tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: 3e9ff0d0-6db8-4db9-a5a9-94f0aeab93c5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:06.542754 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:06.578748 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78116604-9399-49b5-b523-a08968abc12a tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:06.579330 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78116604-9399-49b5-b523-a08968abc12a tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:06.579719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78116604-9399-49b5-b523-a08968abc12a tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:06.580455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78116604-9399-49b5-b523-a08968abc12a tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:06.580916 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78116604-9399-49b5-b523-a08968abc12a tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:06.583023 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31f0148d-de97-4ebf-9dc9-254530500a2a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:06.584240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31f0148d-de97-4ebf-9dc9-254530500a2a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:06.584994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31f0148d-de97-4ebf-9dc9-254530500a2a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:06.587656 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31f0148d-de97-4ebf-9dc9-254530500a2a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:06.588352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78116604-9399-49b5-b523-a08968abc12a tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:06.589121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31f0148d-de97-4ebf-9dc9-254530500a2a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:06.591602 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31f0148d-de97-4ebf-9dc9-254530500a2a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:06.714317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-78116604-9399-49b5-b523-a08968abc12a tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: 3e9ff0d0-6db8-4db9-a5a9-94f0aeab93c5] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:10:06.796508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:06.922920 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-78116604-9399-49b5-b523-a08968abc12a tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "DELETE /compute/v2.1/servers/3e9ff0d0-6db8-4db9-a5a9-94f0aeab93c5" status: 204 len: 0 microversion: 2.47 time: 0.427976 Aug 04 17:10:06.924013 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1810/3700] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Aug 4 17:10:06 2022] DELETE /compute/v2.1/servers/3e9ff0d0-6db8-4db9-a5a9-94f0aeab93c5 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:10:06.934326 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ccf541d5-77ed-40ae-9202-117f160d963d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:06.935206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ccf541d5-77ed-40ae-9202-117f160d963d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: 6728b692-24d5-4a20-ab3a-fc1630a75d64] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:06.942747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ccf541d5-77ed-40ae-9202-117f160d963d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:06.943428 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ccf541d5-77ed-40ae-9202-117f160d963d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:06.943963 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ccf541d5-77ed-40ae-9202-117f160d963d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:06.944826 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ccf541d5-77ed-40ae-9202-117f160d963d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:06.945415 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ccf541d5-77ed-40ae-9202-117f160d963d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:06.945947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ccf541d5-77ed-40ae-9202-117f160d963d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:07.220191 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-31f0148d-de97-4ebf-9dc9-254530500a2a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:07.234669 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-31f0148d-de97-4ebf-9dc9-254530500a2a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1723 microversion: 2.1 time: 0.741429 Aug 04 17:10:07.245404 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1891/3701] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:06 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1723 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:07.252341 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a20f8a5c-a64c-4e6b-8c30-5f4fc766ead0 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:07.253306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a20f8a5c-a64c-4e6b-8c30-5f4fc766ead0 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:07.260692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ccf541d5-77ed-40ae-9202-117f160d963d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:07.266460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a20f8a5c-a64c-4e6b-8c30-5f4fc766ead0 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:07.267239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a20f8a5c-a64c-4e6b-8c30-5f4fc766ead0 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:07.267916 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a20f8a5c-a64c-4e6b-8c30-5f4fc766ead0 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:07.268877 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a20f8a5c-a64c-4e6b-8c30-5f4fc766ead0 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:07.270084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a20f8a5c-a64c-4e6b-8c30-5f4fc766ead0 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:07.270730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a20f8a5c-a64c-4e6b-8c30-5f4fc766ead0 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:07.304022 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ccf541d5-77ed-40ae-9202-117f160d963d tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64" status: 200 len: 1505 microversion: 2.1 time: 0.377833 Aug 04 17:10:07.305259 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1811/3702] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:06 2022] GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64 => generated 1505 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:07.313765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-6b8ee743-d7e2-499a-98b7-5d2cc1bfa82f req-b2a09e02-e45e-4398-bd41-fc797de953c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2f9bc6d-2c94-4ca6-ab81-62a991e04693", "name": "network-vif-plugged", "status": "completed", "tag": "195b4d22-104f-4024-9610-835ea111782f"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:07.326028 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6b8ee743-d7e2-499a-98b7-5d2cc1bfa82f req-b2a09e02-e45e-4398-bd41-fc797de953c6 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:07.326759 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6b8ee743-d7e2-499a-98b7-5d2cc1bfa82f req-b2a09e02-e45e-4398-bd41-fc797de953c6 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:07.327716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6b8ee743-d7e2-499a-98b7-5d2cc1bfa82f req-b2a09e02-e45e-4398-bd41-fc797de953c6 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:07.344486 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-6b8ee743-d7e2-499a-98b7-5d2cc1bfa82f req-b2a09e02-e45e-4398-bd41-fc797de953c6 service nova] Creating event network-vif-plugged:195b4d22-104f-4024-9610-835ea111782f for instance c2f9bc6d-2c94-4ca6-ab81-62a991e04693 on n-h1-851359-3 Aug 04 17:10:07.354513 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-6b8ee743-d7e2-499a-98b7-5d2cc1bfa82f req-b2a09e02-e45e-4398-bd41-fc797de953c6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046971 Aug 04 17:10:07.355368 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1812/3703] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:10:07.372448 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-48ac2ce2-5ac5-450a-ab1a-3811ff7edf61 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:07.373434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-48ac2ce2-5ac5-450a-ab1a-3811ff7edf61 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: 3e9ff0d0-6db8-4db9-a5a9-94f0aeab93c5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:07.385676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48ac2ce2-5ac5-450a-ab1a-3811ff7edf61 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:07.388964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48ac2ce2-5ac5-450a-ab1a-3811ff7edf61 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:07.389527 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48ac2ce2-5ac5-450a-ab1a-3811ff7edf61 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:07.390646 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48ac2ce2-5ac5-450a-ab1a-3811ff7edf61 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:07.392317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48ac2ce2-5ac5-450a-ab1a-3811ff7edf61 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:07.393160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48ac2ce2-5ac5-450a-ab1a-3811ff7edf61 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:07.418194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a20f8a5c-a64c-4e6b-8c30-5f4fc766ead0 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3243fe2bab64fbf8ea77b4f969b16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd0b59b952a4a1d8cbc68b4448dfc0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:07.420399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:07.429689 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a20f8a5c-a64c-4e6b-8c30-5f4fc766ead0 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334" status: 200 len: 1302 microversion: 2.1 time: 0.181682 Aug 04 17:10:07.442476 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1892/3704] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:07 2022] GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334 => generated 1302 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:07.458091 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c035c53b-7bea-4a81-a5f7-0c62f7d81038 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:07.459010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c035c53b-7bea-4a81-a5f7-0c62f7d81038 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:07.467825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c035c53b-7bea-4a81-a5f7-0c62f7d81038 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:07.469457 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c035c53b-7bea-4a81-a5f7-0c62f7d81038 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:07.471942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c035c53b-7bea-4a81-a5f7-0c62f7d81038 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:07.472813 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c035c53b-7bea-4a81-a5f7-0c62f7d81038 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:07.473392 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c035c53b-7bea-4a81-a5f7-0c62f7d81038 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:07.474611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c035c53b-7bea-4a81-a5f7-0c62f7d81038 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:07.528762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-48ac2ce2-5ac5-450a-ab1a-3811ff7edf61 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:07.545622 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-48ac2ce2-5ac5-450a-ab1a-3811ff7edf61 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:07.553650 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-48ac2ce2-5ac5-450a-ab1a-3811ff7edf61 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:07.554976 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-48ac2ce2-5ac5-450a-ab1a-3811ff7edf61 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/3e9ff0d0-6db8-4db9-a5a9-94f0aeab93c5" status: 200 len: 1362 microversion: 2.47 time: 0.198283 Aug 04 17:10:07.555748 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1813/3705] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:07 2022] GET /compute/v2.1/servers/3e9ff0d0-6db8-4db9-a5a9-94f0aeab93c5 => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:07.560507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-10200576-8a3a-428f-86fd-2a903169e33c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:07.562968 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-10200576-8a3a-428f-86fd-2a903169e33c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: 6728b692-24d5-4a20-ab3a-fc1630a75d64] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:07.576447 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10200576-8a3a-428f-86fd-2a903169e33c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:07.577481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10200576-8a3a-428f-86fd-2a903169e33c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:07.578195 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10200576-8a3a-428f-86fd-2a903169e33c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:07.579181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10200576-8a3a-428f-86fd-2a903169e33c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:07.580222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10200576-8a3a-428f-86fd-2a903169e33c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:07.580928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10200576-8a3a-428f-86fd-2a903169e33c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:07.693654 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-10200576-8a3a-428f-86fd-2a903169e33c tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "PUT /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64" status: 200 len: 1081 microversion: 2.1 time: 0.136721 Aug 04 17:10:07.695043 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1814/3706] 10.222.0.93 () {60 vars in 1256 bytes} [Thu Aug 4 17:10:07 2022] PUT /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64 => generated 1081 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:07.705142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c93fddc6-72ba-4300-b155-3c249942b4af tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:07.707812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c93fddc6-72ba-4300-b155-3c249942b4af tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:07.723799 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c93fddc6-72ba-4300-b155-3c249942b4af tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:07.724283 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c93fddc6-72ba-4300-b155-3c249942b4af tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:07.724734 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c93fddc6-72ba-4300-b155-3c249942b4af tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:07.725446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c93fddc6-72ba-4300-b155-3c249942b4af tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:07.725947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c93fddc6-72ba-4300-b155-3c249942b4af tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:07.726423 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c93fddc6-72ba-4300-b155-3c249942b4af tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:07.770773 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c035c53b-7bea-4a81-a5f7-0c62f7d81038 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:07.797729 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c035c53b-7bea-4a81-a5f7-0c62f7d81038 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1520 microversion: 2.1 time: 0.353791 Aug 04 17:10:07.798405 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1893/3707] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:07 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1520 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:07.817199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dde49ea6-c77c-47b4-9bec-98e505c4900e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:07.817825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dde49ea6-c77c-47b4-9bec-98e505c4900e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: 6728b692-24d5-4a20-ab3a-fc1630a75d64] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:07.825271 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dde49ea6-c77c-47b4-9bec-98e505c4900e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:07.826035 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dde49ea6-c77c-47b4-9bec-98e505c4900e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:07.826747 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dde49ea6-c77c-47b4-9bec-98e505c4900e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:07.827696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dde49ea6-c77c-47b4-9bec-98e505c4900e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:07.828387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dde49ea6-c77c-47b4-9bec-98e505c4900e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:07.829034 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dde49ea6-c77c-47b4-9bec-98e505c4900e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:08.250388 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c93fddc6-72ba-4300-b155-3c249942b4af tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:08.268254 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c93fddc6-72ba-4300-b155-3c249942b4af tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1314 microversion: 2.1 time: 0.572179 Aug 04 17:10:08.274108 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1815/3708] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:07 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1314 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:08.290533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-52a3b7cb-5372-4a9e-a9df-9d8071c6e2a8 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:08.292860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-52a3b7cb-5372-4a9e-a9df-9d8071c6e2a8 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:08.325849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52a3b7cb-5372-4a9e-a9df-9d8071c6e2a8 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:08.326731 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52a3b7cb-5372-4a9e-a9df-9d8071c6e2a8 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:08.327405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52a3b7cb-5372-4a9e-a9df-9d8071c6e2a8 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:08.334165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52a3b7cb-5372-4a9e-a9df-9d8071c6e2a8 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:08.336081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52a3b7cb-5372-4a9e-a9df-9d8071c6e2a8 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:08.336849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52a3b7cb-5372-4a9e-a9df-9d8071c6e2a8 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:08.349193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dde49ea6-c77c-47b4-9bec-98e505c4900e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:08.357734 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dde49ea6-c77c-47b4-9bec-98e505c4900e tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64" status: 200 len: 1507 microversion: 2.1 time: 0.544725 Aug 04 17:10:08.363543 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1894/3709] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:07 2022] GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64 => generated 1507 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:08.390288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e5cd5ca7-4cba-4ece-9597-26fcdbf9f806 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:08.391282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e5cd5ca7-4cba-4ece-9597-26fcdbf9f806 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: 6728b692-24d5-4a20-ab3a-fc1630a75d64] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:08.403162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e5cd5ca7-4cba-4ece-9597-26fcdbf9f806 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:08.404284 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e5cd5ca7-4cba-4ece-9597-26fcdbf9f806 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:08.405291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e5cd5ca7-4cba-4ece-9597-26fcdbf9f806 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:08.410840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e5cd5ca7-4cba-4ece-9597-26fcdbf9f806 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:08.411425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e5cd5ca7-4cba-4ece-9597-26fcdbf9f806 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:08.411889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e5cd5ca7-4cba-4ece-9597-26fcdbf9f806 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:08.898739 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e5cd5ca7-4cba-4ece-9597-26fcdbf9f806 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:08.911799 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e5cd5ca7-4cba-4ece-9597-26fcdbf9f806 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64" status: 200 len: 1507 microversion: 2.1 time: 0.521937 Aug 04 17:10:08.913525 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1895/3710] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:08 2022] GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64 => generated 1507 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:10:08.934820 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-52a3b7cb-5372-4a9e-a9df-9d8071c6e2a8 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:08.943130 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-828f8d18-ac1d-4c47-822b-ff4560520085 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:08.945625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-828f8d18-ac1d-4c47-822b-ff4560520085 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:08.950585 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-52a3b7cb-5372-4a9e-a9df-9d8071c6e2a8 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1723 microversion: 2.1 time: 0.669878 Aug 04 17:10:08.951455 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1816/3711] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:08 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1723 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:08.957300 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-69c5f549-05f7-4dd6-8401-2f2710688952 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:08.958286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-69c5f549-05f7-4dd6-8401-2f2710688952 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: 3e9ff0d0-6db8-4db9-a5a9-94f0aeab93c5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:08.960222 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-828f8d18-ac1d-4c47-822b-ff4560520085 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:08.960729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-828f8d18-ac1d-4c47-822b-ff4560520085 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:08.961188 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-828f8d18-ac1d-4c47-822b-ff4560520085 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:08.961911 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-828f8d18-ac1d-4c47-822b-ff4560520085 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:08.967218 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-828f8d18-ac1d-4c47-822b-ff4560520085 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:08.971460 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69c5f549-05f7-4dd6-8401-2f2710688952 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:08.973056 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69c5f549-05f7-4dd6-8401-2f2710688952 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:08.974285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69c5f549-05f7-4dd6-8401-2f2710688952 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:08.975394 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69c5f549-05f7-4dd6-8401-2f2710688952 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:08.976469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69c5f549-05f7-4dd6-8401-2f2710688952 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:08.976901 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69c5f549-05f7-4dd6-8401-2f2710688952 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:08.977696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-828f8d18-ac1d-4c47-822b-ff4560520085 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:09.086427 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-69c5f549-05f7-4dd6-8401-2f2710688952 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:09.088683 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-828f8d18-ac1d-4c47-822b-ff4560520085 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3243fe2bab64fbf8ea77b4f969b16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd0b59b952a4a1d8cbc68b4448dfc0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:09.096026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-69c5f549-05f7-4dd6-8401-2f2710688952 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:09.098085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-69c5f549-05f7-4dd6-8401-2f2710688952 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:09.099722 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-69c5f549-05f7-4dd6-8401-2f2710688952 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/3e9ff0d0-6db8-4db9-a5a9-94f0aeab93c5" status: 200 len: 1362 microversion: 2.47 time: 0.146881 Aug 04 17:10:09.115314 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1817/3712] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:08 2022] GET /compute/v2.1/servers/3e9ff0d0-6db8-4db9-a5a9-94f0aeab93c5 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:09.115523 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-828f8d18-ac1d-4c47-822b-ff4560520085 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334" status: 200 len: 1302 microversion: 2.1 time: 0.184604 Aug 04 17:10:09.115523 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1896/3713] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:08 2022] GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334 => generated 1302 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:09.115523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1075787d-cc8a-411e-9200-d28a12d67ed9 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:09.115523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1075787d-cc8a-411e-9200-d28a12d67ed9 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: 6728b692-24d5-4a20-ab3a-fc1630a75d64] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:09.118459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1075787d-cc8a-411e-9200-d28a12d67ed9 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:09.118630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2c5b5a33-ed3e-4440-9d7a-dbfb8e37b250 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:09.119435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1075787d-cc8a-411e-9200-d28a12d67ed9 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:09.119650 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2c5b5a33-ed3e-4440-9d7a-dbfb8e37b250 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:09.120035 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1075787d-cc8a-411e-9200-d28a12d67ed9 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:09.120763 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1075787d-cc8a-411e-9200-d28a12d67ed9 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:09.121295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1075787d-cc8a-411e-9200-d28a12d67ed9 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:09.121732 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1075787d-cc8a-411e-9200-d28a12d67ed9 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:09.125872 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c5b5a33-ed3e-4440-9d7a-dbfb8e37b250 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:09.126653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c5b5a33-ed3e-4440-9d7a-dbfb8e37b250 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:09.127109 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c5b5a33-ed3e-4440-9d7a-dbfb8e37b250 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:09.127818 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c5b5a33-ed3e-4440-9d7a-dbfb8e37b250 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:09.128284 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c5b5a33-ed3e-4440-9d7a-dbfb8e37b250 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:09.128710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c5b5a33-ed3e-4440-9d7a-dbfb8e37b250 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:09.164880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1075787d-cc8a-411e-9200-d28a12d67ed9 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: 6728b692-24d5-4a20-ab3a-fc1630a75d64] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:10:09.295885 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1075787d-cc8a-411e-9200-d28a12d67ed9 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64" status: 204 len: 0 microversion: 2.1 time: 0.191712 Aug 04 17:10:09.302609 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1897/3714] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:10:09 2022] DELETE /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:10:09.308883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-50bac889-016e-40d5-bcb0-dde258c76048 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:09.309950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-50bac889-016e-40d5-bcb0-dde258c76048 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:09.317633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50bac889-016e-40d5-bcb0-dde258c76048 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:09.318625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50bac889-016e-40d5-bcb0-dde258c76048 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:09.319466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50bac889-016e-40d5-bcb0-dde258c76048 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:09.320445 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50bac889-016e-40d5-bcb0-dde258c76048 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:09.321497 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50bac889-016e-40d5-bcb0-dde258c76048 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:09.322212 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50bac889-016e-40d5-bcb0-dde258c76048 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:09.330458 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2c5b5a33-ed3e-4440-9d7a-dbfb8e37b250 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:09.346842 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2c5b5a33-ed3e-4440-9d7a-dbfb8e37b250 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1520 microversion: 2.1 time: 0.237727 Aug 04 17:10:09.366948 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1818/3715] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:09 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1520 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:09.372236 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c7ceb23a-40aa-446f-9c15-265d4a932194 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:09.377027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c7ceb23a-40aa-446f-9c15-265d4a932194 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: 6728b692-24d5-4a20-ab3a-fc1630a75d64] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:09.393388 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7ceb23a-40aa-446f-9c15-265d4a932194 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:09.395043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7ceb23a-40aa-446f-9c15-265d4a932194 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:09.395735 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7ceb23a-40aa-446f-9c15-265d4a932194 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:09.410102 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7ceb23a-40aa-446f-9c15-265d4a932194 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:09.411727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7ceb23a-40aa-446f-9c15-265d4a932194 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:09.412566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7ceb23a-40aa-446f-9c15-265d4a932194 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:09.467384 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c7ceb23a-40aa-446f-9c15-265d4a932194 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: 6728b692-24d5-4a20-ab3a-fc1630a75d64] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:10:09.564253 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.compute.api [None req-c7ceb23a-40aa-446f-9c15-265d4a932194 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: 6728b692-24d5-4a20-ab3a-fc1630a75d64] Instance is already in deleting state, ignoring this request Aug 04 17:10:09.565664 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c7ceb23a-40aa-446f-9c15-265d4a932194 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64" status: 204 len: 0 microversion: 2.1 time: 0.197142 Aug 04 17:10:09.570363 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1819/3716] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:10:09 2022] DELETE /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:10:09.587998 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7ece36bf-643f-49c7-b6b6-c34df3f79c82 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:09.588713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7ece36bf-643f-49c7-b6b6-c34df3f79c82 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: 6728b692-24d5-4a20-ab3a-fc1630a75d64] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:09.601723 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ece36bf-643f-49c7-b6b6-c34df3f79c82 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:09.604831 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ece36bf-643f-49c7-b6b6-c34df3f79c82 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:09.605585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ece36bf-643f-49c7-b6b6-c34df3f79c82 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:09.608780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ece36bf-643f-49c7-b6b6-c34df3f79c82 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:09.609330 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ece36bf-643f-49c7-b6b6-c34df3f79c82 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:09.609780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ece36bf-643f-49c7-b6b6-c34df3f79c82 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:09.635901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-50bac889-016e-40d5-bcb0-dde258c76048 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:09.652219 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-50bac889-016e-40d5-bcb0-dde258c76048 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1314 microversion: 2.1 time: 0.347531 Aug 04 17:10:09.665438 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1898/3717] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:09 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:09.886968 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7ece36bf-643f-49c7-b6b6-c34df3f79c82 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:09.902491 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7ece36bf-643f-49c7-b6b6-c34df3f79c82 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64" status: 200 len: 1513 microversion: 2.1 time: 0.330256 Aug 04 17:10:09.903733 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1820/3718] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:09 2022] GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64 => generated 1513 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:09.976454 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fbadf5dd-4468-4f5a-afb8-24010b713a85 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:09.977089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fbadf5dd-4468-4f5a-afb8-24010b713a85 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:09.987131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fbadf5dd-4468-4f5a-afb8-24010b713a85 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:09.990575 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fbadf5dd-4468-4f5a-afb8-24010b713a85 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:09.991561 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fbadf5dd-4468-4f5a-afb8-24010b713a85 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:09.992342 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fbadf5dd-4468-4f5a-afb8-24010b713a85 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:09.992915 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fbadf5dd-4468-4f5a-afb8-24010b713a85 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:09.993377 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fbadf5dd-4468-4f5a-afb8-24010b713a85 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:10.123520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6cc50a8a-d264-43e4-90e8-20d48ae41b69 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:10.124151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6cc50a8a-d264-43e4-90e8-20d48ae41b69 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:10.137090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6cc50a8a-d264-43e4-90e8-20d48ae41b69 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:10.137593 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6cc50a8a-d264-43e4-90e8-20d48ae41b69 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:10.138068 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6cc50a8a-d264-43e4-90e8-20d48ae41b69 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:10.143928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6cc50a8a-d264-43e4-90e8-20d48ae41b69 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:10.144471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6cc50a8a-d264-43e4-90e8-20d48ae41b69 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:10.144931 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6cc50a8a-d264-43e4-90e8-20d48ae41b69 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:10.539897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6cc50a8a-d264-43e4-90e8-20d48ae41b69 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3243fe2bab64fbf8ea77b4f969b16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd0b59b952a4a1d8cbc68b4448dfc0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:10.563104 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6cc50a8a-d264-43e4-90e8-20d48ae41b69 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334" status: 200 len: 1369 microversion: 2.1 time: 0.443202 Aug 04 17:10:10.567371 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1821/3719] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:10 2022] GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334 => generated 1369 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:10.617390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-756d6bb3-ab24-4647-9091-e339d583f4b9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:10.619241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-756d6bb3-ab24-4647-9091-e339d583f4b9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: 3e9ff0d0-6db8-4db9-a5a9-94f0aeab93c5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:10.637921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fbadf5dd-4468-4f5a-afb8-24010b713a85 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:10.652083 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fbadf5dd-4468-4f5a-afb8-24010b713a85 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1723 microversion: 2.1 time: 0.678689 Aug 04 17:10:10.656998 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1899/3720] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:09 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1723 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:10.661732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-756d6bb3-ab24-4647-9091-e339d583f4b9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:10.662519 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-756d6bb3-ab24-4647-9091-e339d583f4b9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:10.663174 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-756d6bb3-ab24-4647-9091-e339d583f4b9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:10.667461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dc19855d-bc60-4d8e-9f83-6d0a71002c50 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:10.667680 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-756d6bb3-ab24-4647-9091-e339d583f4b9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:10.668364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-756d6bb3-ab24-4647-9091-e339d583f4b9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:10.668980 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-756d6bb3-ab24-4647-9091-e339d583f4b9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:10.676970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dc19855d-bc60-4d8e-9f83-6d0a71002c50 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:10.701062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc19855d-bc60-4d8e-9f83-6d0a71002c50 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:10.704158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc19855d-bc60-4d8e-9f83-6d0a71002c50 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:10.707301 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc19855d-bc60-4d8e-9f83-6d0a71002c50 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:10.712852 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc19855d-bc60-4d8e-9f83-6d0a71002c50 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:10.716902 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc19855d-bc60-4d8e-9f83-6d0a71002c50 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:10.718128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc19855d-bc60-4d8e-9f83-6d0a71002c50 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:10.863106 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-756d6bb3-ab24-4647-9091-e339d583f4b9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:10.877102 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-756d6bb3-ab24-4647-9091-e339d583f4b9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:10.891513 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-756d6bb3-ab24-4647-9091-e339d583f4b9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:10.892973 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-756d6bb3-ab24-4647-9091-e339d583f4b9 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/3e9ff0d0-6db8-4db9-a5a9-94f0aeab93c5" status: 200 len: 1362 microversion: 2.47 time: 0.303171 Aug 04 17:10:10.893955 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1822/3721] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:10 2022] GET /compute/v2.1/servers/3e9ff0d0-6db8-4db9-a5a9-94f0aeab93c5 => generated 1362 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:10.899325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0580582a-6fcb-445b-a860-95837826bbdc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:10.914707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0580582a-6fcb-445b-a860-95837826bbdc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:10.924040 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0580582a-6fcb-445b-a860-95837826bbdc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:10.932614 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0580582a-6fcb-445b-a860-95837826bbdc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:10.934139 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0580582a-6fcb-445b-a860-95837826bbdc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:10.935029 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0580582a-6fcb-445b-a860-95837826bbdc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:10.935579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0580582a-6fcb-445b-a860-95837826bbdc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:10.936091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0580582a-6fcb-445b-a860-95837826bbdc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:11.053696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dc19855d-bc60-4d8e-9f83-6d0a71002c50 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:11.067375 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dc19855d-bc60-4d8e-9f83-6d0a71002c50 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1520 microversion: 2.1 time: 0.407900 Aug 04 17:10:11.081874 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1900/3722] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:10 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1520 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:11.097267 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-390774c6-6a50-4c98-95cb-771ebaaea378 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:11.099502 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-390774c6-6a50-4c98-95cb-771ebaaea378 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: 6728b692-24d5-4a20-ab3a-fc1630a75d64] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:11.123306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-390774c6-6a50-4c98-95cb-771ebaaea378 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:11.123831 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-390774c6-6a50-4c98-95cb-771ebaaea378 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:11.124257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-390774c6-6a50-4c98-95cb-771ebaaea378 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:11.124984 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-390774c6-6a50-4c98-95cb-771ebaaea378 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:11.125429 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-390774c6-6a50-4c98-95cb-771ebaaea378 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:11.126075 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-390774c6-6a50-4c98-95cb-771ebaaea378 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:11.440848 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0580582a-6fcb-445b-a860-95837826bbdc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:11.455469 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0580582a-6fcb-445b-a860-95837826bbdc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1314 microversion: 2.1 time: 0.559033 Aug 04 17:10:11.460726 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1823/3723] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:10 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1314 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:11.575674 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-390774c6-6a50-4c98-95cb-771ebaaea378 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:11.588436 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-35db95b5-6210-49fe-8308-974bf7ea6d43 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:11.589051 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-35db95b5-6210-49fe-8308-974bf7ea6d43 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:11.601157 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-390774c6-6a50-4c98-95cb-771ebaaea378 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64" status: 200 len: 1513 microversion: 2.1 time: 0.510974 Aug 04 17:10:11.610330 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1901/3724] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:11 2022] GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64 => generated 1513 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:11.611296 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35db95b5-6210-49fe-8308-974bf7ea6d43 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:11.611980 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35db95b5-6210-49fe-8308-974bf7ea6d43 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:11.612654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35db95b5-6210-49fe-8308-974bf7ea6d43 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:11.614025 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35db95b5-6210-49fe-8308-974bf7ea6d43 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:11.614735 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35db95b5-6210-49fe-8308-974bf7ea6d43 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:11.615556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35db95b5-6210-49fe-8308-974bf7ea6d43 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:11.677360 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e20b2aad-01db-4f20-bcf5-c300e7679ed0 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:11.679026 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e20b2aad-01db-4f20-bcf5-c300e7679ed0 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:11.688745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e20b2aad-01db-4f20-bcf5-c300e7679ed0 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:11.695088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e20b2aad-01db-4f20-bcf5-c300e7679ed0 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:11.695770 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e20b2aad-01db-4f20-bcf5-c300e7679ed0 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:11.702902 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e20b2aad-01db-4f20-bcf5-c300e7679ed0 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:11.703601 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e20b2aad-01db-4f20-bcf5-c300e7679ed0 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:11.706698 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e20b2aad-01db-4f20-bcf5-c300e7679ed0 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:12.301487 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-35db95b5-6210-49fe-8308-974bf7ea6d43 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3243fe2bab64fbf8ea77b4f969b16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd0b59b952a4a1d8cbc68b4448dfc0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:12.317938 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-35db95b5-6210-49fe-8308-974bf7ea6d43 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334" status: 200 len: 1369 microversion: 2.1 time: 0.728459 Aug 04 17:10:12.320707 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1824/3725] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:11 2022] GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334 => generated 1369 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:10:12.330438 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bd6bab5f-b381-485c-95bf-612d53aec0d1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:12.334606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e20b2aad-01db-4f20-bcf5-c300e7679ed0 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:12.343715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bd6bab5f-b381-485c-95bf-612d53aec0d1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: 3e9ff0d0-6db8-4db9-a5a9-94f0aeab93c5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:12.348757 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e20b2aad-01db-4f20-bcf5-c300e7679ed0 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1723 microversion: 2.1 time: 0.675641 Aug 04 17:10:12.365919 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1902/3726] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:11 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1723 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:10:12.383934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a600be0d-4397-4277-8916-87e644b6c68e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:12.385445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd6bab5f-b381-485c-95bf-612d53aec0d1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:12.386713 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a600be0d-4397-4277-8916-87e644b6c68e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:12.387202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd6bab5f-b381-485c-95bf-612d53aec0d1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:12.387886 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd6bab5f-b381-485c-95bf-612d53aec0d1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:12.389552 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd6bab5f-b381-485c-95bf-612d53aec0d1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:12.392940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd6bab5f-b381-485c-95bf-612d53aec0d1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:12.393683 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd6bab5f-b381-485c-95bf-612d53aec0d1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:12.411380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a600be0d-4397-4277-8916-87e644b6c68e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:12.412298 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a600be0d-4397-4277-8916-87e644b6c68e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:12.413854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:12.415187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a600be0d-4397-4277-8916-87e644b6c68e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:12.418734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a600be0d-4397-4277-8916-87e644b6c68e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:12.419668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a600be0d-4397-4277-8916-87e644b6c68e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:12.420403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a600be0d-4397-4277-8916-87e644b6c68e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:12.517612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd6bab5f-b381-485c-95bf-612d53aec0d1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:12.530690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd6bab5f-b381-485c-95bf-612d53aec0d1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:12.533708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd6bab5f-b381-485c-95bf-612d53aec0d1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:12.535355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-bd6bab5f-b381-485c-95bf-612d53aec0d1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lazy-loading 'fault' on Instance uuid 3e9ff0d0-6db8-4db9-a5a9-94f0aeab93c5 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:10:12.626406 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bd6bab5f-b381-485c-95bf-612d53aec0d1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:12.639890 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bd6bab5f-b381-485c-95bf-612d53aec0d1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:12.644815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bd6bab5f-b381-485c-95bf-612d53aec0d1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b819c1114b2941688b7edb7180df8592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538e626497154361a47f81781bce54a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:12.649254 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bd6bab5f-b381-485c-95bf-612d53aec0d1 tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/3e9ff0d0-6db8-4db9-a5a9-94f0aeab93c5" status: 200 len: 1367 microversion: 2.47 time: 0.325640 Aug 04 17:10:12.651256 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1825/3727] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:12 2022] GET /compute/v2.1/servers/3e9ff0d0-6db8-4db9-a5a9-94f0aeab93c5 => generated 1367 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:12.669592 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-775bda1b-1a3b-4dd7-adb7-fa3111f52919 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:12.671418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-775bda1b-1a3b-4dd7-adb7-fa3111f52919 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:12.687014 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-775bda1b-1a3b-4dd7-adb7-fa3111f52919 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:12.688050 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-775bda1b-1a3b-4dd7-adb7-fa3111f52919 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:12.690265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-775bda1b-1a3b-4dd7-adb7-fa3111f52919 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:12.691493 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-775bda1b-1a3b-4dd7-adb7-fa3111f52919 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:12.693317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-775bda1b-1a3b-4dd7-adb7-fa3111f52919 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:12.694694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-775bda1b-1a3b-4dd7-adb7-fa3111f52919 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:12.783082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a600be0d-4397-4277-8916-87e644b6c68e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:12.797483 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a600be0d-4397-4277-8916-87e644b6c68e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1520 microversion: 2.1 time: 0.420828 Aug 04 17:10:12.799116 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1903/3728] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:12 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1520 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:12.807268 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-77fc30de-3140-441f-b665-66ca64ca1510 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:12.809766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-77fc30de-3140-441f-b665-66ca64ca1510 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: 6728b692-24d5-4a20-ab3a-fc1630a75d64] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:12.821853 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77fc30de-3140-441f-b665-66ca64ca1510 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:12.828455 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77fc30de-3140-441f-b665-66ca64ca1510 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:12.829477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77fc30de-3140-441f-b665-66ca64ca1510 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:12.830548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77fc30de-3140-441f-b665-66ca64ca1510 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:12.831254 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77fc30de-3140-441f-b665-66ca64ca1510 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:12.831933 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77fc30de-3140-441f-b665-66ca64ca1510 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:13.004629 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-775bda1b-1a3b-4dd7-adb7-fa3111f52919 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:13.014096 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-775bda1b-1a3b-4dd7-adb7-fa3111f52919 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1500 microversion: 2.1 time: 0.361453 Aug 04 17:10:13.017644 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1826/3729] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:12 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1500 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:13.098534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9573a682-dfec-4fa3-bf42-d7b3e2b5f642 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:13.120140 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9573a682-dfec-4fa3-bf42-d7b3e2b5f642 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:13.121921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9573a682-dfec-4fa3-bf42-d7b3e2b5f642 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:13.123132 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9573a682-dfec-4fa3-bf42-d7b3e2b5f642 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:13.237042 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-77fc30de-3140-441f-b665-66ca64ca1510 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:13.277139 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-77fc30de-3140-441f-b665-66ca64ca1510 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64" status: 200 len: 1513 microversion: 2.1 time: 0.476585 Aug 04 17:10:13.284762 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1904/3730] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:12 2022] GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64 => generated 1513 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:13.341846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0cdc95e0-db2d-49c0-b982-d8299b23e8ba tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:13.351374 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0cdc95e0-db2d-49c0-b982-d8299b23e8ba tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:13.366224 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9573a682-dfec-4fa3-bf42-d7b3e2b5f642 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Going to try to stop instance {{(pid=131044) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 17:10:13.380212 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0cdc95e0-db2d-49c0-b982-d8299b23e8ba tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:13.385053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0cdc95e0-db2d-49c0-b982-d8299b23e8ba tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:13.386174 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0cdc95e0-db2d-49c0-b982-d8299b23e8ba tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:13.387817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0cdc95e0-db2d-49c0-b982-d8299b23e8ba tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:13.390053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0cdc95e0-db2d-49c0-b982-d8299b23e8ba tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:13.390961 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0cdc95e0-db2d-49c0-b982-d8299b23e8ba tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:13.485253 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9573a682-dfec-4fa3-bf42-d7b3e2b5f642 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693/action" status: 202 len: 0 microversion: 2.1 time: 0.433619 Aug 04 17:10:13.504140 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1827/3731] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:10:13 2022] POST /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:10:13.534786 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ea27b0a9-4288-4c4a-9e95-ff8b4bd20548 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:13.541988 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ea27b0a9-4288-4c4a-9e95-ff8b4bd20548 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:13.578923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea27b0a9-4288-4c4a-9e95-ff8b4bd20548 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:13.610452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea27b0a9-4288-4c4a-9e95-ff8b4bd20548 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:13.615852 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea27b0a9-4288-4c4a-9e95-ff8b4bd20548 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:13.619073 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea27b0a9-4288-4c4a-9e95-ff8b4bd20548 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:13.621480 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea27b0a9-4288-4c4a-9e95-ff8b4bd20548 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:13.622023 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea27b0a9-4288-4c4a-9e95-ff8b4bd20548 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:13.984674 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0cdc95e0-db2d-49c0-b982-d8299b23e8ba tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3243fe2bab64fbf8ea77b4f969b16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd0b59b952a4a1d8cbc68b4448dfc0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:14.001938 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0cdc95e0-db2d-49c0-b982-d8299b23e8ba tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334" status: 200 len: 1369 microversion: 2.1 time: 0.663844 Aug 04 17:10:14.007421 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1905/3732] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:13 2022] GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334 => generated 1369 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:14.023492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b4a45119-338d-424a-ac37-40b92cd30bd8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:14.027521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b4a45119-338d-424a-ac37-40b92cd30bd8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:14.044205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b4a45119-338d-424a-ac37-40b92cd30bd8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:14.049362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b4a45119-338d-424a-ac37-40b92cd30bd8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:14.050062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b4a45119-338d-424a-ac37-40b92cd30bd8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:14.050985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b4a45119-338d-424a-ac37-40b92cd30bd8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:14.051680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b4a45119-338d-424a-ac37-40b92cd30bd8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:14.052285 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b4a45119-338d-424a-ac37-40b92cd30bd8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:14.187565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ea27b0a9-4288-4c4a-9e95-ff8b4bd20548 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:14.203005 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ea27b0a9-4288-4c4a-9e95-ff8b4bd20548 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1723 microversion: 2.1 time: 0.696769 Aug 04 17:10:14.206312 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1828/3733] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:13 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1723 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:14.217024 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e8370afa-1c8a-4d74-a86c-2e0d6b8949ac tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:14.220974 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e8370afa-1c8a-4d74-a86c-2e0d6b8949ac tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] [instance: 3e9ff0d0-6db8-4db9-a5a9-94f0aeab93c5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:14.241490 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8370afa-1c8a-4d74-a86c-2e0d6b8949ac tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:14.241813 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8370afa-1c8a-4d74-a86c-2e0d6b8949ac tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:14.242280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8370afa-1c8a-4d74-a86c-2e0d6b8949ac tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:14.252077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8370afa-1c8a-4d74-a86c-2e0d6b8949ac tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:14.253851 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8370afa-1c8a-4d74-a86c-2e0d6b8949ac tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:14.257301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8370afa-1c8a-4d74-a86c-2e0d6b8949ac tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:14.331484 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-e8370afa-1c8a-4d74-a86c-2e0d6b8949ac tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] HTTP exception thrown: Instance 3e9ff0d0-6db8-4db9-a5a9-94f0aeab93c5 could not be found. Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e8370afa-1c8a-4d74-a86c-2e0d6b8949ac tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Request method failure captured: Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/3e9ff0d0-6db8-4db9-a5a9-94f0aeab93c5 HTTP/1.1 Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_001BAyfVZnj869SCcLcTNKAagFHz0-ELCuUmg7vpiSTe1Rsi7Dr6QfdfhMaEQwrTgCTp1ZGuMSHGm9RMVVu2X9HyQ7pFMCsOf_K5VcsFuGauZQJlhR0wwV059y0NOM-qJcEo-ufPT7JgJdOlbTo88NuPBsQSi_3H7d91N7fVesxoI Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.47 Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 538e626497154361a47f81781bce54a0 Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerShowV247Test-832347210 Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/538e626497154361a47f81781bce54a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/538e626497154361a47f81781bce54a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_538e626497154361a47f81781bce54a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/538e626497154361a47f81781bce54a0"}]}] Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServerShowV247Test-832347210 Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 538e626497154361a47f81781bce54a0 Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerShowV247Test-832347210 Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServerShowV247Test-832347210-project Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: b819c1114b2941688b7edb7180df8592 Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServerShowV247Test-832347210-project Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 3e9ff0d0-6db8-4db9-a5a9-94f0aeab93c5 could not be found. Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '3e9ff0d0-6db8-4db9-a5a9-94f0aeab93c5'} Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e9ff0d0-6db8-4db9-a5a9-94f0aeab93c5 could not be found. Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e9ff0d0-6db8-4db9-a5a9-94f0aeab93c5 could not be found. Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:10:14.337441 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:10:14.342689 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:14.342689 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:10:14.342689 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:10:14.342689 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:10:14.342689 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:10:14.342689 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e9ff0d0-6db8-4db9-a5a9-94f0aeab93c5 could not be found. Aug 04 17:10:14.342689 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:10:14.345252 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e8370afa-1c8a-4d74-a86c-2e0d6b8949ac tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] Returning 404 to user: Instance 3e9ff0d0-6db8-4db9-a5a9-94f0aeab93c5 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:10:14.353067 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e8370afa-1c8a-4d74-a86c-2e0d6b8949ac tempest-ServerShowV247Test-832347210 tempest-ServerShowV247Test-832347210-project] 10.222.0.93 "GET /compute/v2.1/servers/3e9ff0d0-6db8-4db9-a5a9-94f0aeab93c5" status: 404 len: 111 microversion: 2.47 time: 0.145350 Aug 04 17:10:14.358240 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1829/3734] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:14 2022] GET /compute/v2.1/servers/3e9ff0d0-6db8-4db9-a5a9-94f0aeab93c5 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:10:14.365168 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-02d0ef67-1137-48e1-a9c1-d0940ee6f708 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:14.368826 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-02d0ef67-1137-48e1-a9c1-d0940ee6f708 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:14.393188 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02d0ef67-1137-48e1-a9c1-d0940ee6f708 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:14.394032 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02d0ef67-1137-48e1-a9c1-d0940ee6f708 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:14.394737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02d0ef67-1137-48e1-a9c1-d0940ee6f708 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:14.395639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02d0ef67-1137-48e1-a9c1-d0940ee6f708 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:14.402712 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02d0ef67-1137-48e1-a9c1-d0940ee6f708 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:14.403658 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02d0ef67-1137-48e1-a9c1-d0940ee6f708 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:14.497356 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b4a45119-338d-424a-ac37-40b92cd30bd8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:14.519502 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b4a45119-338d-424a-ac37-40b92cd30bd8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1510 microversion: 2.1 time: 0.507311 Aug 04 17:10:14.533864 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1906/3735] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:14 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1510 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:14.543397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-329bf3b6-85d3-4445-a31f-0868c0d9e442 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:14.544466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-329bf3b6-85d3-4445-a31f-0868c0d9e442 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: 6728b692-24d5-4a20-ab3a-fc1630a75d64] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:14.557041 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-329bf3b6-85d3-4445-a31f-0868c0d9e442 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:14.557913 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-329bf3b6-85d3-4445-a31f-0868c0d9e442 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:14.558662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-329bf3b6-85d3-4445-a31f-0868c0d9e442 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:14.559687 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-329bf3b6-85d3-4445-a31f-0868c0d9e442 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:14.560384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-329bf3b6-85d3-4445-a31f-0868c0d9e442 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:14.560982 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-329bf3b6-85d3-4445-a31f-0868c0d9e442 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:14.608273 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-329bf3b6-85d3-4445-a31f-0868c0d9e442 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:14.609117 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-329bf3b6-85d3-4445-a31f-0868c0d9e442 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:14.609810 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-329bf3b6-85d3-4445-a31f-0868c0d9e442 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:14.610564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-329bf3b6-85d3-4445-a31f-0868c0d9e442 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lazy-loading 'fault' on Instance uuid 6728b692-24d5-4a20-ab3a-fc1630a75d64 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:10:14.613642 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:14.626045 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:14.655695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=8 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:14.737869 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-329bf3b6-85d3-4445-a31f-0868c0d9e442 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b17ad6c3c53441dbd0c648db7b649b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e503687666f4ca59d4ea4d9f9771917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:14.755676 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-329bf3b6-85d3-4445-a31f-0868c0d9e442 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64" status: 200 len: 1308 microversion: 2.1 time: 0.216287 Aug 04 17:10:14.763581 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1907/3736] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:14 2022] GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64 => generated 1308 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:14.778892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-7deed5bb-2a40-4d76-b812-680e0766566f req-d755d5f1-0876-48a5-9c63-4278c1d9ebae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6728b692-24d5-4a20-ab3a-fc1630a75d64", "name": "network-vif-deleted", "tag": "1b5fbe39-cbd2-4db1-92b2-fae6005216b5"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:14.811935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7deed5bb-2a40-4d76-b812-680e0766566f req-d755d5f1-0876-48a5-9c63-4278c1d9ebae service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:14.812422 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7deed5bb-2a40-4d76-b812-680e0766566f req-d755d5f1-0876-48a5-9c63-4278c1d9ebae service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:14.812863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7deed5bb-2a40-4d76-b812-680e0766566f req-d755d5f1-0876-48a5-9c63-4278c1d9ebae service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:14.865027 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-7deed5bb-2a40-4d76-b812-680e0766566f req-d755d5f1-0876-48a5-9c63-4278c1d9ebae service nova] Creating event network-vif-deleted:1b5fbe39-cbd2-4db1-92b2-fae6005216b5 for instance 6728b692-24d5-4a20-ab3a-fc1630a75d64 on n-h1-851359-3 Aug 04 17:10:14.889147 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-7deed5bb-2a40-4d76-b812-680e0766566f req-d755d5f1-0876-48a5-9c63-4278c1d9ebae service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121563 Aug 04 17:10:14.889765 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1908/3737] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:10:14.896976 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-02d0ef67-1137-48e1-a9c1-d0940ee6f708 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:14.913537 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-02d0ef67-1137-48e1-a9c1-d0940ee6f708 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1520 microversion: 2.1 time: 0.553292 Aug 04 17:10:14.936421 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1830/3738] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:14 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1520 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:15.037165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6116cda6-62d6-4305-8b0c-b777f5816c6d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:15.038464 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6116cda6-62d6-4305-8b0c-b777f5816c6d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:15.058268 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6116cda6-62d6-4305-8b0c-b777f5816c6d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:15.058954 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6116cda6-62d6-4305-8b0c-b777f5816c6d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:15.059567 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6116cda6-62d6-4305-8b0c-b777f5816c6d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:15.060468 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6116cda6-62d6-4305-8b0c-b777f5816c6d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:15.061800 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6116cda6-62d6-4305-8b0c-b777f5816c6d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:15.062900 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6116cda6-62d6-4305-8b0c-b777f5816c6d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:15.232958 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-04516864-2d45-4ac3-924b-94898a423dfd tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:15.234762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-04516864-2d45-4ac3-924b-94898a423dfd tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:15.258771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04516864-2d45-4ac3-924b-94898a423dfd tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:15.271527 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04516864-2d45-4ac3-924b-94898a423dfd tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:15.274463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04516864-2d45-4ac3-924b-94898a423dfd tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:15.275852 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04516864-2d45-4ac3-924b-94898a423dfd tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:15.285902 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04516864-2d45-4ac3-924b-94898a423dfd tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:15.288648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04516864-2d45-4ac3-924b-94898a423dfd tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:15.581513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=8 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:15.735452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6116cda6-62d6-4305-8b0c-b777f5816c6d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3243fe2bab64fbf8ea77b4f969b16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd0b59b952a4a1d8cbc68b4448dfc0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:15.750657 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6116cda6-62d6-4305-8b0c-b777f5816c6d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334" status: 200 len: 1369 microversion: 2.1 time: 0.719777 Aug 04 17:10:15.768435 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1909/3739] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:15 2022] GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334 => generated 1369 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:15.797216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-df440cd1-b020-4e82-bfd1-39121af8b54d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:15.804718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-df440cd1-b020-4e82-bfd1-39121af8b54d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:15.826458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df440cd1-b020-4e82-bfd1-39121af8b54d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:15.830008 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df440cd1-b020-4e82-bfd1-39121af8b54d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:15.830660 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df440cd1-b020-4e82-bfd1-39121af8b54d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:15.831569 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df440cd1-b020-4e82-bfd1-39121af8b54d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:15.832214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df440cd1-b020-4e82-bfd1-39121af8b54d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:15.841427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df440cd1-b020-4e82-bfd1-39121af8b54d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:16.214794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-04516864-2d45-4ac3-924b-94898a423dfd tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:16.226146 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-04516864-2d45-4ac3-924b-94898a423dfd tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1723 microversion: 2.1 time: 0.997900 Aug 04 17:10:16.226847 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1831/3740] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:15 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1723 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:10:16.247505 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d52bb597-f4cb-40c7-8cac-aa177e2f98a0 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:16.251140 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d52bb597-f4cb-40c7-8cac-aa177e2f98a0 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: 6728b692-24d5-4a20-ab3a-fc1630a75d64] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:16.265791 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d52bb597-f4cb-40c7-8cac-aa177e2f98a0 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:16.266611 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d52bb597-f4cb-40c7-8cac-aa177e2f98a0 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:16.267237 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d52bb597-f4cb-40c7-8cac-aa177e2f98a0 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:16.268149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d52bb597-f4cb-40c7-8cac-aa177e2f98a0 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:16.269299 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d52bb597-f4cb-40c7-8cac-aa177e2f98a0 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:16.272764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d52bb597-f4cb-40c7-8cac-aa177e2f98a0 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:16.311015 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-d52bb597-f4cb-40c7-8cac-aa177e2f98a0 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] HTTP exception thrown: Instance 6728b692-24d5-4a20-ab3a-fc1630a75d64 could not be found. Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d52bb597-f4cb-40c7-8cac-aa177e2f98a0 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Request method failure captured: Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64 HTTP/1.1 Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_yzmd_xhGXXK8lbgthaexECKq3gzZeQncIjPu-2dxpItnK6Jj0pj_a7muxf10B7KTvsm5NifocUIVOMq49yFaG6lXwic5TNwV9GC7BDRHUO6aXt4QkXJB3vu2I_17b85lN3qVug7iZxpP-MWhiBJYr3ji5yoAIGC5y539f2_Km4BZw Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 0e503687666f4ca59d4ea4d9f9771917 Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerDiskConfigTestJSON-509035340 Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0e503687666f4ca59d4ea4d9f9771917"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0e503687666f4ca59d4ea4d9f9771917"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0e503687666f4ca59d4ea4d9f9771917"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0e503687666f4ca59d4ea4d9f9771917"}]}] Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServerDiskConfigTestJSON-509035340 Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 0e503687666f4ca59d4ea4d9f9771917 Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-509035340 Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServerDiskConfigTestJSON-509035340-project Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 4b17ad6c3c53441dbd0c648db7b649b5 Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServerDiskConfigTestJSON-509035340-project Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 6728b692-24d5-4a20-ab3a-fc1630a75d64 could not be found. Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '6728b692-24d5-4a20-ab3a-fc1630a75d64'} Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6728b692-24d5-4a20-ab3a-fc1630a75d64 could not be found. Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6728b692-24d5-4a20-ab3a-fc1630a75d64 could not be found. Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:10:16.315454 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:10:16.321045 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:16.321045 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:10:16.321045 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:10:16.321045 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:10:16.321045 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:10:16.321045 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6728b692-24d5-4a20-ab3a-fc1630a75d64 could not be found. Aug 04 17:10:16.321045 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:10:16.323769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d52bb597-f4cb-40c7-8cac-aa177e2f98a0 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Returning 404 to user: Instance 6728b692-24d5-4a20-ab3a-fc1630a75d64 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:10:16.324865 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d52bb597-f4cb-40c7-8cac-aa177e2f98a0 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64" status: 404 len: 111 microversion: 2.1 time: 0.090123 Aug 04 17:10:16.330764 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1832/3741] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:16 2022] GET /compute/v2.1/servers/6728b692-24d5-4a20-ab3a-fc1630a75d64 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:10:16.336337 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-509affd9-0285-4aec-91fa-6e42f239e589 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:16.342259 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-df440cd1-b020-4e82-bfd1-39121af8b54d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:16.352879 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-df440cd1-b020-4e82-bfd1-39121af8b54d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1510 microversion: 2.1 time: 0.577979 Aug 04 17:10:16.354365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-509affd9-0285-4aec-91fa-6e42f239e589 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:16.358472 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1910/3742] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:15 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1510 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:16.372702 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a34958ce-759e-46ff-b3b4-0b518987dff5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:16.376835 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-509affd9-0285-4aec-91fa-6e42f239e589 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:16.380797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a34958ce-759e-46ff-b3b4-0b518987dff5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:16.382727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-509affd9-0285-4aec-91fa-6e42f239e589 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:16.383187 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-509affd9-0285-4aec-91fa-6e42f239e589 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:16.383921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-509affd9-0285-4aec-91fa-6e42f239e589 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:16.386822 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-509affd9-0285-4aec-91fa-6e42f239e589 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:16.390956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-509affd9-0285-4aec-91fa-6e42f239e589 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:16.400390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a34958ce-759e-46ff-b3b4-0b518987dff5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:16.403624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a34958ce-759e-46ff-b3b4-0b518987dff5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:16.404250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a34958ce-759e-46ff-b3b4-0b518987dff5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:16.405162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a34958ce-759e-46ff-b3b4-0b518987dff5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:16.407386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a34958ce-759e-46ff-b3b4-0b518987dff5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:16.408033 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a34958ce-759e-46ff-b3b4-0b518987dff5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:16.438628 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-a34958ce-759e-46ff-b3b4-0b518987dff5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] HTTP exception thrown: Instance a592dcbd-6b85-4d18-acdb-82f579be9067 could not be found. Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a34958ce-759e-46ff-b3b4-0b518987dff5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Request method failure captured: Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 HTTP/1.1 Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_yzmd_xhGXXK8lbgthaexECKq3gzZeQncIjPu-2dxpItnK6Jj0pj_a7muxf10B7KTvsm5NifocUIVOMq49yFaG6lXwic5TNwV9GC7BDRHUO6aXt4QkXJB3vu2I_17b85lN3qVug7iZxpP-MWhiBJYr3ji5yoAIGC5y539f2_Km4BZw Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 0e503687666f4ca59d4ea4d9f9771917 Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerDiskConfigTestJSON-509035340 Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0e503687666f4ca59d4ea4d9f9771917"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0e503687666f4ca59d4ea4d9f9771917"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0e503687666f4ca59d4ea4d9f9771917"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0e503687666f4ca59d4ea4d9f9771917"}]}] Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerDiskConfigTestJSON-509035340 Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 0e503687666f4ca59d4ea4d9f9771917 Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-509035340 Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerDiskConfigTestJSON-509035340-project Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 4b17ad6c3c53441dbd0c648db7b649b5 Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerDiskConfigTestJSON-509035340-project Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance a592dcbd-6b85-4d18-acdb-82f579be9067 could not be found. Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'a592dcbd-6b85-4d18-acdb-82f579be9067'} Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a592dcbd-6b85-4d18-acdb-82f579be9067 could not be found. Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:10:16.440680 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:10:16.446458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a592dcbd-6b85-4d18-acdb-82f579be9067 could not be found. Aug 04 17:10:16.446458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:16.446458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:10:16.446458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:16.446458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:16.446458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:10:16.446458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:10:16.446458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:10:16.446458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:10:16.446458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a592dcbd-6b85-4d18-acdb-82f579be9067 could not be found. Aug 04 17:10:16.446458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:16.450465 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a34958ce-759e-46ff-b3b4-0b518987dff5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Returning 404 to user: Instance a592dcbd-6b85-4d18-acdb-82f579be9067 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:10:16.456122 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a34958ce-759e-46ff-b3b4-0b518987dff5 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "DELETE /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 404 len: 111 microversion: 2.1 time: 0.096364 Aug 04 17:10:16.457246 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1911/3743] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:10:16 2022] DELETE /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:10:16.465944 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-09a5d94b-1724-49df-8d87-b34bbe3ba37b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:16.470972 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-09a5d94b-1724-49df-8d87-b34bbe3ba37b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: a592dcbd-6b85-4d18-acdb-82f579be9067] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:16.483956 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-09a5d94b-1724-49df-8d87-b34bbe3ba37b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:16.484673 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-09a5d94b-1724-49df-8d87-b34bbe3ba37b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:16.485286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-09a5d94b-1724-49df-8d87-b34bbe3ba37b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:16.500199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-09a5d94b-1724-49df-8d87-b34bbe3ba37b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:16.500968 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-09a5d94b-1724-49df-8d87-b34bbe3ba37b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:16.501499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-09a5d94b-1724-49df-8d87-b34bbe3ba37b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:16.518222 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-09a5d94b-1724-49df-8d87-b34bbe3ba37b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] HTTP exception thrown: Instance a592dcbd-6b85-4d18-acdb-82f579be9067 could not be found. Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-09a5d94b-1724-49df-8d87-b34bbe3ba37b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Request method failure captured: Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 HTTP/1.1 Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_yzmd_xhGXXK8lbgthaexECKq3gzZeQncIjPu-2dxpItnK6Jj0pj_a7muxf10B7KTvsm5NifocUIVOMq49yFaG6lXwic5TNwV9GC7BDRHUO6aXt4QkXJB3vu2I_17b85lN3qVug7iZxpP-MWhiBJYr3ji5yoAIGC5y539f2_Km4BZw Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 0e503687666f4ca59d4ea4d9f9771917 Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerDiskConfigTestJSON-509035340 Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0e503687666f4ca59d4ea4d9f9771917"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0e503687666f4ca59d4ea4d9f9771917"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0e503687666f4ca59d4ea4d9f9771917"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0e503687666f4ca59d4ea4d9f9771917"}]}] Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerDiskConfigTestJSON-509035340 Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 0e503687666f4ca59d4ea4d9f9771917 Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-509035340 Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerDiskConfigTestJSON-509035340-project Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 4b17ad6c3c53441dbd0c648db7b649b5 Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerDiskConfigTestJSON-509035340-project Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance a592dcbd-6b85-4d18-acdb-82f579be9067 could not be found. Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'a592dcbd-6b85-4d18-acdb-82f579be9067'} Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a592dcbd-6b85-4d18-acdb-82f579be9067 could not be found. Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a592dcbd-6b85-4d18-acdb-82f579be9067 could not be found. Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:10:16.531176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:16.537428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:16.537428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:10:16.537428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:10:16.537428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:10:16.537428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:10:16.537428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a592dcbd-6b85-4d18-acdb-82f579be9067 could not be found. Aug 04 17:10:16.537428 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:16.540773 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-09a5d94b-1724-49df-8d87-b34bbe3ba37b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Returning 404 to user: Instance a592dcbd-6b85-4d18-acdb-82f579be9067 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:10:16.551094 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-09a5d94b-1724-49df-8d87-b34bbe3ba37b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067" status: 404 len: 111 microversion: 2.1 time: 0.079720 Aug 04 17:10:16.555888 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1912/3744] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:16 2022] GET /compute/v2.1/servers/a592dcbd-6b85-4d18-acdb-82f579be9067 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:10:16.561518 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-59cdae8d-ef1f-4951-a7cf-d4ddf2a70653 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:16.572629 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-59cdae8d-ef1f-4951-a7cf-d4ddf2a70653 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:16.581930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59cdae8d-ef1f-4951-a7cf-d4ddf2a70653 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:16.583250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59cdae8d-ef1f-4951-a7cf-d4ddf2a70653 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:16.583879 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59cdae8d-ef1f-4951-a7cf-d4ddf2a70653 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:16.585519 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59cdae8d-ef1f-4951-a7cf-d4ddf2a70653 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:16.586389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59cdae8d-ef1f-4951-a7cf-d4ddf2a70653 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:16.587132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59cdae8d-ef1f-4951-a7cf-d4ddf2a70653 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:16.616615 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-59cdae8d-ef1f-4951-a7cf-d4ddf2a70653 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] HTTP exception thrown: Instance ec6241cf-bde4-47ad-9e71-7a95f04844b2 could not be found. Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-59cdae8d-ef1f-4951-a7cf-d4ddf2a70653 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Request method failure captured: Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 HTTP/1.1 Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_yzmd_xhGXXK8lbgthaexECKq3gzZeQncIjPu-2dxpItnK6Jj0pj_a7muxf10B7KTvsm5NifocUIVOMq49yFaG6lXwic5TNwV9GC7BDRHUO6aXt4QkXJB3vu2I_17b85lN3qVug7iZxpP-MWhiBJYr3ji5yoAIGC5y539f2_Km4BZw Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 0e503687666f4ca59d4ea4d9f9771917 Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerDiskConfigTestJSON-509035340 Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0e503687666f4ca59d4ea4d9f9771917"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0e503687666f4ca59d4ea4d9f9771917"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0e503687666f4ca59d4ea4d9f9771917"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0e503687666f4ca59d4ea4d9f9771917"}]}] Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerDiskConfigTestJSON-509035340 Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 0e503687666f4ca59d4ea4d9f9771917 Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-509035340 Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerDiskConfigTestJSON-509035340-project Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 4b17ad6c3c53441dbd0c648db7b649b5 Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerDiskConfigTestJSON-509035340-project Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance ec6241cf-bde4-47ad-9e71-7a95f04844b2 could not be found. Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'ec6241cf-bde4-47ad-9e71-7a95f04844b2'} Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec6241cf-bde4-47ad-9e71-7a95f04844b2 could not be found. Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:10:16.619533 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:10:16.626257 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec6241cf-bde4-47ad-9e71-7a95f04844b2 could not be found. Aug 04 17:10:16.626257 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:16.626257 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:10:16.626257 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:16.626257 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:16.626257 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:10:16.626257 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:10:16.626257 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:10:16.626257 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:10:16.626257 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec6241cf-bde4-47ad-9e71-7a95f04844b2 could not be found. Aug 04 17:10:16.626257 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:16.629205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-59cdae8d-ef1f-4951-a7cf-d4ddf2a70653 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Returning 404 to user: Instance ec6241cf-bde4-47ad-9e71-7a95f04844b2 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:10:16.630803 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-59cdae8d-ef1f-4951-a7cf-d4ddf2a70653 tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "DELETE /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 404 len: 111 microversion: 2.1 time: 0.073453 Aug 04 17:10:16.632898 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1913/3745] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:10:16 2022] DELETE /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:10:16.642134 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2f99094b-aa54-48c8-bcd1-6e5bdcfe281b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:16.648878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2f99094b-aa54-48c8-bcd1-6e5bdcfe281b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] [instance: ec6241cf-bde4-47ad-9e71-7a95f04844b2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:16.656129 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f99094b-aa54-48c8-bcd1-6e5bdcfe281b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:16.656767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f99094b-aa54-48c8-bcd1-6e5bdcfe281b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:16.657215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f99094b-aa54-48c8-bcd1-6e5bdcfe281b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:16.657965 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f99094b-aa54-48c8-bcd1-6e5bdcfe281b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:16.658445 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f99094b-aa54-48c8-bcd1-6e5bdcfe281b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:16.660274 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f99094b-aa54-48c8-bcd1-6e5bdcfe281b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:16.664938 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-509affd9-0285-4aec-91fa-6e42f239e589 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:16.680946 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-2f99094b-aa54-48c8-bcd1-6e5bdcfe281b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] HTTP exception thrown: Instance ec6241cf-bde4-47ad-9e71-7a95f04844b2 could not be found. Aug 04 17:10:16.682611 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-509affd9-0285-4aec-91fa-6e42f239e589 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1520 microversion: 2.1 time: 0.348718 Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2f99094b-aa54-48c8-bcd1-6e5bdcfe281b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Request method failure captured: Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 HTTP/1.1 Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_yzmd_xhGXXK8lbgthaexECKq3gzZeQncIjPu-2dxpItnK6Jj0pj_a7muxf10B7KTvsm5NifocUIVOMq49yFaG6lXwic5TNwV9GC7BDRHUO6aXt4QkXJB3vu2I_17b85lN3qVug7iZxpP-MWhiBJYr3ji5yoAIGC5y539f2_Km4BZw Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 0e503687666f4ca59d4ea4d9f9771917 Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerDiskConfigTestJSON-509035340 Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0e503687666f4ca59d4ea4d9f9771917"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0e503687666f4ca59d4ea4d9f9771917"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0e503687666f4ca59d4ea4d9f9771917"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0e503687666f4ca59d4ea4d9f9771917"}]}] Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerDiskConfigTestJSON-509035340 Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 0e503687666f4ca59d4ea4d9f9771917 Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-509035340 Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerDiskConfigTestJSON-509035340-project Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 4b17ad6c3c53441dbd0c648db7b649b5 Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerDiskConfigTestJSON-509035340-project Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance ec6241cf-bde4-47ad-9e71-7a95f04844b2 could not be found. Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'ec6241cf-bde4-47ad-9e71-7a95f04844b2'} Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec6241cf-bde4-47ad-9e71-7a95f04844b2 could not be found. Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec6241cf-bde4-47ad-9e71-7a95f04844b2 could not be found. Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:10:16.683130 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:16.688657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:16.688657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:10:16.688657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:10:16.688657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:10:16.688657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:10:16.688657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec6241cf-bde4-47ad-9e71-7a95f04844b2 could not be found. Aug 04 17:10:16.688657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:16.689674 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1833/3746] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:16 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1520 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:16.691574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2f99094b-aa54-48c8-bcd1-6e5bdcfe281b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] Returning 404 to user: Instance ec6241cf-bde4-47ad-9e71-7a95f04844b2 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:10:16.692703 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2f99094b-aa54-48c8-bcd1-6e5bdcfe281b tempest-ServerDiskConfigTestJSON-509035340 tempest-ServerDiskConfigTestJSON-509035340-project] 10.222.0.93 "GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2" status: 404 len: 111 microversion: 2.1 time: 0.055567 Aug 04 17:10:16.693781 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1914/3747] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:16 2022] GET /compute/v2.1/servers/ec6241cf-bde4-47ad-9e71-7a95f04844b2 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:10:16.774953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-179280df-cbc2-4312-a9f5-9e180eff6a3f tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:16.775869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-179280df-cbc2-4312-a9f5-9e180eff6a3f tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:16.793921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-179280df-cbc2-4312-a9f5-9e180eff6a3f tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:16.795711 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-179280df-cbc2-4312-a9f5-9e180eff6a3f tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:16.799943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-179280df-cbc2-4312-a9f5-9e180eff6a3f tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:16.800725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-179280df-cbc2-4312-a9f5-9e180eff6a3f tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:16.805187 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-179280df-cbc2-4312-a9f5-9e180eff6a3f tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:16.806306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-179280df-cbc2-4312-a9f5-9e180eff6a3f tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:17.044709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-6dc97409-537a-4756-90b9-f37626e44c53 req-f1fbfd33-566b-4ee2-b182-cdb9fe5a02e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1af7e3f-723f-40e1-b968-bc7aeaa95334", "tag": "bf74ae8e-ca14-433b-901b-3ed2e54ec681"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:17.066889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6dc97409-537a-4756-90b9-f37626e44c53 req-f1fbfd33-566b-4ee2-b182-cdb9fe5a02e8 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:17.070933 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6dc97409-537a-4756-90b9-f37626e44c53 req-f1fbfd33-566b-4ee2-b182-cdb9fe5a02e8 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:17.071601 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6dc97409-537a-4756-90b9-f37626e44c53 req-f1fbfd33-566b-4ee2-b182-cdb9fe5a02e8 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:17.106809 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-6dc97409-537a-4756-90b9-f37626e44c53 req-f1fbfd33-566b-4ee2-b182-cdb9fe5a02e8 service nova] Creating event network-changed:bf74ae8e-ca14-433b-901b-3ed2e54ec681 for instance b1af7e3f-723f-40e1-b968-bc7aeaa95334 on n-h2-851359-3 Aug 04 17:10:17.115048 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-6dc97409-537a-4756-90b9-f37626e44c53 req-f1fbfd33-566b-4ee2-b182-cdb9fe5a02e8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079106 Aug 04 17:10:17.117664 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1915/3748] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:10:17.156366 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-179280df-cbc2-4312-a9f5-9e180eff6a3f tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3243fe2bab64fbf8ea77b4f969b16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd0b59b952a4a1d8cbc68b4448dfc0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:17.166241 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-179280df-cbc2-4312-a9f5-9e180eff6a3f tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334" status: 200 len: 1369 microversion: 2.1 time: 0.395757 Aug 04 17:10:17.171434 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1834/3749] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:16 2022] GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334 => generated 1369 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:17.252238 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9af06f41-ee22-402f-8919-8400df138356 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:17.252868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9af06f41-ee22-402f-8919-8400df138356 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:17.266088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9af06f41-ee22-402f-8919-8400df138356 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:17.270804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9af06f41-ee22-402f-8919-8400df138356 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:17.271387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9af06f41-ee22-402f-8919-8400df138356 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:17.272201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9af06f41-ee22-402f-8919-8400df138356 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:17.272689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9af06f41-ee22-402f-8919-8400df138356 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:17.273123 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9af06f41-ee22-402f-8919-8400df138356 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:17.376234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-49762292-97e5-430e-8dd0-cbe03f049a39 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:17.377709 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-49762292-97e5-430e-8dd0-cbe03f049a39 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:17.395244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49762292-97e5-430e-8dd0-cbe03f049a39 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:17.398846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49762292-97e5-430e-8dd0-cbe03f049a39 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:17.399776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49762292-97e5-430e-8dd0-cbe03f049a39 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:17.406108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49762292-97e5-430e-8dd0-cbe03f049a39 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:17.407042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49762292-97e5-430e-8dd0-cbe03f049a39 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:17.407770 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49762292-97e5-430e-8dd0-cbe03f049a39 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:17.711585 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9af06f41-ee22-402f-8919-8400df138356 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:17.740548 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9af06f41-ee22-402f-8919-8400df138356 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1700 microversion: 2.1 time: 0.491226 Aug 04 17:10:17.745721 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1916/3750] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:17 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1700 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:17.764811 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c99f389c-c68b-4998-96d6-00cf7b5ff183 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:17.766469 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c99f389c-c68b-4998-96d6-00cf7b5ff183 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:17.784426 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c99f389c-c68b-4998-96d6-00cf7b5ff183 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:17.785627 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c99f389c-c68b-4998-96d6-00cf7b5ff183 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:17.788590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c99f389c-c68b-4998-96d6-00cf7b5ff183 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:17.789624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c99f389c-c68b-4998-96d6-00cf7b5ff183 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:17.791056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c99f389c-c68b-4998-96d6-00cf7b5ff183 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:17.793934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c99f389c-c68b-4998-96d6-00cf7b5ff183 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:17.923993 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-49762292-97e5-430e-8dd0-cbe03f049a39 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:17.940560 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-49762292-97e5-430e-8dd0-cbe03f049a39 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1510 microversion: 2.1 time: 0.568682 Aug 04 17:10:17.963043 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1835/3751] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:17 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1510 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:10:17.968989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8b57c9d6-9450-44f4-b7cd-9a9f80589279 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:17.981481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b57c9d6-9450-44f4-b7cd-9a9f80589279 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:17.982020 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b57c9d6-9450-44f4-b7cd-9a9f80589279 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:17.988785 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b57c9d6-9450-44f4-b7cd-9a9f80589279 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:18.064705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8b57c9d6-9450-44f4-b7cd-9a9f80589279 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Going to try to start instance {{(pid=131044) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 17:10:18.206879 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c99f389c-c68b-4998-96d6-00cf7b5ff183 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:18.220471 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8b57c9d6-9450-44f4-b7cd-9a9f80589279 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "POST /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3/action" status: 202 len: 0 microversion: 2.1 time: 0.268617 Aug 04 17:10:18.221135 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1836/3752] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:10:17 2022] POST /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:10:18.231232 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c99f389c-c68b-4998-96d6-00cf7b5ff183 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1520 microversion: 2.1 time: 0.473633 Aug 04 17:10:18.236643 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1917/3753] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:17 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1520 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:18.244950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-511ad69d-47d6-4364-ba48-204ca368647c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:18.245886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-511ad69d-47d6-4364-ba48-204ca368647c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:18.252523 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1541716b-fbbe-4d99-8a33-e2c1bef09ad3 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:18.254150 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1541716b-fbbe-4d99-8a33-e2c1bef09ad3 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:18.255235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-511ad69d-47d6-4364-ba48-204ca368647c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:18.256559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-511ad69d-47d6-4364-ba48-204ca368647c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:18.257482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-511ad69d-47d6-4364-ba48-204ca368647c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:18.264073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-511ad69d-47d6-4364-ba48-204ca368647c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:18.265428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-511ad69d-47d6-4364-ba48-204ca368647c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:18.266381 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-511ad69d-47d6-4364-ba48-204ca368647c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:18.273555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1541716b-fbbe-4d99-8a33-e2c1bef09ad3 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:18.274504 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1541716b-fbbe-4d99-8a33-e2c1bef09ad3 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:18.274910 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1541716b-fbbe-4d99-8a33-e2c1bef09ad3 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:18.275662 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1541716b-fbbe-4d99-8a33-e2c1bef09ad3 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:18.276124 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1541716b-fbbe-4d99-8a33-e2c1bef09ad3 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:18.278620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1541716b-fbbe-4d99-8a33-e2c1bef09ad3 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:18.677002 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1541716b-fbbe-4d99-8a33-e2c1bef09ad3 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3243fe2bab64fbf8ea77b4f969b16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd0b59b952a4a1d8cbc68b4448dfc0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:18.686241 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-511ad69d-47d6-4364-ba48-204ca368647c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:18.695007 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1541716b-fbbe-4d99-8a33-e2c1bef09ad3 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334" status: 200 len: 1369 microversion: 2.1 time: 0.472467 Aug 04 17:10:18.695986 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1837/3754] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:18 2022] GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334 => generated 1369 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:18.696836 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-511ad69d-47d6-4364-ba48-204ca368647c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1709 microversion: 2.1 time: 0.458586 Aug 04 17:10:18.706481 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1918/3755] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:18 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1709 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:18.915745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-46b6b4f6-f98f-4659-ac7a-020e685dacac tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-98145030", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": "none"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:18.970711 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-adec9d34-d446-4ceb-beec-47ff3f280ee3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:18.972245 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-adec9d34-d446-4ceb-beec-47ff3f280ee3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:18.984734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-adec9d34-d446-4ceb-beec-47ff3f280ee3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:18.985520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-adec9d34-d446-4ceb-beec-47ff3f280ee3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:18.986172 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-adec9d34-d446-4ceb-beec-47ff3f280ee3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:18.989242 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-adec9d34-d446-4ceb-beec-47ff3f280ee3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:18.989907 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-adec9d34-d446-4ceb-beec-47ff3f280ee3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:18.990537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-adec9d34-d446-4ceb-beec-47ff3f280ee3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:19.035705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-46b6b4f6-f98f-4659-ac7a-020e685dacac tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:10:19.036396 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-46b6b4f6-f98f-4659-ac7a-020e685dacac tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:10:19.037042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-46b6b4f6-f98f-4659-ac7a-020e685dacac tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:10:19.039877 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-46b6b4f6-f98f-4659-ac7a-020e685dacac tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:10:19.040682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-46b6b4f6-f98f-4659-ac7a-020e685dacac tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:10:19.073563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46b6b4f6-f98f-4659-ac7a-020e685dacac tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:19.074656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46b6b4f6-f98f-4659-ac7a-020e685dacac tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:19.076519 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46b6b4f6-f98f-4659-ac7a-020e685dacac tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:19.077476 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46b6b4f6-f98f-4659-ac7a-020e685dacac tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:19.079099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46b6b4f6-f98f-4659-ac7a-020e685dacac tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:19.081588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46b6b4f6-f98f-4659-ac7a-020e685dacac tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:19.148729 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-46b6b4f6-f98f-4659-ac7a-020e685dacac tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Getting quotas for project 64a0fa6086f24cf88cb5c172b36788f8. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:10:19.167350 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-46b6b4f6-f98f-4659-ac7a-020e685dacac tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Getting quotas for user f036da5a777b4bfba62508ab9cec1251 and project 64a0fa6086f24cf88cb5c172b36788f8. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:10:19.201793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-46b6b4f6-f98f-4659-ac7a-020e685dacac tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:10:19.210018 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-46b6b4f6-f98f-4659-ac7a-020e685dacac tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:10:19.337669 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-46b6b4f6-f98f-4659-ac7a-020e685dacac tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.639947 Aug 04 17:10:19.344054 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1838/3756] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Aug 4 17:10:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 17:10:19.357330 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3f133a97-ed1d-43d5-99b9-62ee85870914 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:19.358548 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3f133a97-ed1d-43d5-99b9-62ee85870914 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:19.371655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-adec9d34-d446-4ceb-beec-47ff3f280ee3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:19.373773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f133a97-ed1d-43d5-99b9-62ee85870914 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:19.375256 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f133a97-ed1d-43d5-99b9-62ee85870914 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:19.376611 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f133a97-ed1d-43d5-99b9-62ee85870914 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:19.378859 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f133a97-ed1d-43d5-99b9-62ee85870914 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:19.380287 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f133a97-ed1d-43d5-99b9-62ee85870914 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:19.381940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f133a97-ed1d-43d5-99b9-62ee85870914 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:19.386655 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-adec9d34-d446-4ceb-beec-47ff3f280ee3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1510 microversion: 2.1 time: 0.420236 Aug 04 17:10:19.392267 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1919/3757] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:18 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1510 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:19.410597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d0a54fdb-c2bf-48e1-ad28-abe9cf1fbc2a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:19.414731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d0a54fdb-c2bf-48e1-ad28-abe9cf1fbc2a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:19.581078 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d0a54fdb-c2bf-48e1-ad28-abe9cf1fbc2a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:19.601883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d0a54fdb-c2bf-48e1-ad28-abe9cf1fbc2a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:19.608372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d0a54fdb-c2bf-48e1-ad28-abe9cf1fbc2a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:19.609570 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d0a54fdb-c2bf-48e1-ad28-abe9cf1fbc2a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1276 microversion: 2.57 time: 0.215588 Aug 04 17:10:19.618596 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1920/3758] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:19 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1276 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:19.720626 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7ea0a22c-0ce4-49e5-b3e8-fd1730d89542 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:19.721575 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7ea0a22c-0ce4-49e5-b3e8-fd1730d89542 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:19.731897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7ea0a22c-0ce4-49e5-b3e8-fd1730d89542 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:19.735031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7ea0a22c-0ce4-49e5-b3e8-fd1730d89542 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:19.735733 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7ea0a22c-0ce4-49e5-b3e8-fd1730d89542 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:19.736770 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7ea0a22c-0ce4-49e5-b3e8-fd1730d89542 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:19.739009 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7ea0a22c-0ce4-49e5-b3e8-fd1730d89542 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:19.740534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7ea0a22c-0ce4-49e5-b3e8-fd1730d89542 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:20.303125 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7ea0a22c-0ce4-49e5-b3e8-fd1730d89542 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:20.314776 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7ea0a22c-0ce4-49e5-b3e8-fd1730d89542 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1709 microversion: 2.1 time: 0.596471 Aug 04 17:10:20.315734 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1921/3759] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:19 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1709 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:20.320419 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-98289dc8-e582-4c45-b9a6-e60c52102443 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:20.321100 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-98289dc8-e582-4c45-b9a6-e60c52102443 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:20.341874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98289dc8-e582-4c45-b9a6-e60c52102443 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:20.342429 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98289dc8-e582-4c45-b9a6-e60c52102443 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:20.342988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98289dc8-e582-4c45-b9a6-e60c52102443 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:20.343582 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98289dc8-e582-4c45-b9a6-e60c52102443 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:20.344019 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98289dc8-e582-4c45-b9a6-e60c52102443 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:20.344449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98289dc8-e582-4c45-b9a6-e60c52102443 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:20.550718 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3f133a97-ed1d-43d5-99b9-62ee85870914 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:20.586008 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3f133a97-ed1d-43d5-99b9-62ee85870914 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1520 microversion: 2.1 time: 1.240480 Aug 04 17:10:20.613504 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1839/3760] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:19 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1520 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:20.615506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-420f626a-25c3-414e-8c9b-13b5139ad72a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:20.616688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-420f626a-25c3-414e-8c9b-13b5139ad72a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:20.646634 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-420f626a-25c3-414e-8c9b-13b5139ad72a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:20.647197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-420f626a-25c3-414e-8c9b-13b5139ad72a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:20.649651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-420f626a-25c3-414e-8c9b-13b5139ad72a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:20.653047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-420f626a-25c3-414e-8c9b-13b5139ad72a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:20.653563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-420f626a-25c3-414e-8c9b-13b5139ad72a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:20.655237 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-420f626a-25c3-414e-8c9b-13b5139ad72a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:21.000599 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-98289dc8-e582-4c45-b9a6-e60c52102443 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3243fe2bab64fbf8ea77b4f969b16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd0b59b952a4a1d8cbc68b4448dfc0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:21.014009 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-98289dc8-e582-4c45-b9a6-e60c52102443 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334" status: 200 len: 1369 microversion: 2.1 time: 0.696893 Aug 04 17:10:21.016064 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1922/3761] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:20 2022] GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334 => generated 1369 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:21.022765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8ec344e0-2470-4ec0-a526-4c866a7b89c2 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:21.023627 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8ec344e0-2470-4ec0-a526-4c866a7b89c2 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:21.030453 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ec344e0-2470-4ec0-a526-4c866a7b89c2 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:21.031218 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ec344e0-2470-4ec0-a526-4c866a7b89c2 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:21.031890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ec344e0-2470-4ec0-a526-4c866a7b89c2 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:21.033149 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ec344e0-2470-4ec0-a526-4c866a7b89c2 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:21.034051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ec344e0-2470-4ec0-a526-4c866a7b89c2 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:21.034827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ec344e0-2470-4ec0-a526-4c866a7b89c2 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:21.151701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8ec344e0-2470-4ec0-a526-4c866a7b89c2 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:21.167555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8ec344e0-2470-4ec0-a526-4c866a7b89c2 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:21.169069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8ec344e0-2470-4ec0-a526-4c866a7b89c2 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:21.170409 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8ec344e0-2470-4ec0-a526-4c866a7b89c2 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1328 microversion: 2.57 time: 0.153153 Aug 04 17:10:21.170977 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1923/3762] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:21 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1328 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:21.263114 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-420f626a-25c3-414e-8c9b-13b5139ad72a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:21.273026 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-420f626a-25c3-414e-8c9b-13b5139ad72a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1510 microversion: 2.1 time: 0.669578 Aug 04 17:10:21.274427 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1840/3763] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:20 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1510 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:21.337953 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-da2c8d89-757f-49fa-a309-c8d5e88272fc tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:21.338975 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-da2c8d89-757f-49fa-a309-c8d5e88272fc tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:21.347776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-da2c8d89-757f-49fa-a309-c8d5e88272fc tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:21.349282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-da2c8d89-757f-49fa-a309-c8d5e88272fc tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:21.349756 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-da2c8d89-757f-49fa-a309-c8d5e88272fc tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:21.351097 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-da2c8d89-757f-49fa-a309-c8d5e88272fc tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:21.351571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-da2c8d89-757f-49fa-a309-c8d5e88272fc tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:21.353101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-da2c8d89-757f-49fa-a309-c8d5e88272fc tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:21.625571 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a086cf29-9d90-4c9d-8283-5be7f957aef4 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:21.626516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a086cf29-9d90-4c9d-8283-5be7f957aef4 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:21.636672 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a086cf29-9d90-4c9d-8283-5be7f957aef4 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:21.637311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a086cf29-9d90-4c9d-8283-5be7f957aef4 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:21.638621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a086cf29-9d90-4c9d-8283-5be7f957aef4 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:21.640167 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a086cf29-9d90-4c9d-8283-5be7f957aef4 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:21.640977 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a086cf29-9d90-4c9d-8283-5be7f957aef4 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:21.642334 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a086cf29-9d90-4c9d-8283-5be7f957aef4 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:21.644272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-da2c8d89-757f-49fa-a309-c8d5e88272fc tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:21.656143 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-da2c8d89-757f-49fa-a309-c8d5e88272fc tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1709 microversion: 2.1 time: 0.323396 Aug 04 17:10:21.672180 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1924/3764] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:21 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1709 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:21.691273 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:21.894053 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a086cf29-9d90-4c9d-8283-5be7f957aef4 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:21.902671 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a086cf29-9d90-4c9d-8283-5be7f957aef4 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1520 microversion: 2.1 time: 0.284133 Aug 04 17:10:21.903428 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1841/3765] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:21 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1520 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:10:22.041639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e984cf70-8890-4128-a3a9-f68ee3f6986d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:22.043435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e984cf70-8890-4128-a3a9-f68ee3f6986d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:22.056007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e984cf70-8890-4128-a3a9-f68ee3f6986d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:22.060141 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e984cf70-8890-4128-a3a9-f68ee3f6986d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:22.060933 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e984cf70-8890-4128-a3a9-f68ee3f6986d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:22.061921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e984cf70-8890-4128-a3a9-f68ee3f6986d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:22.062651 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e984cf70-8890-4128-a3a9-f68ee3f6986d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:22.064088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e984cf70-8890-4128-a3a9-f68ee3f6986d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:22.196887 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b25e2416-29c0-4c57-896d-8c0e4ac32b20 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:22.197736 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b25e2416-29c0-4c57-896d-8c0e4ac32b20 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:22.201878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:22.230284 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b25e2416-29c0-4c57-896d-8c0e4ac32b20 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:22.230829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b25e2416-29c0-4c57-896d-8c0e4ac32b20 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:22.231610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b25e2416-29c0-4c57-896d-8c0e4ac32b20 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:22.233055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b25e2416-29c0-4c57-896d-8c0e4ac32b20 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:22.233588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b25e2416-29c0-4c57-896d-8c0e4ac32b20 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:22.234061 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b25e2416-29c0-4c57-896d-8c0e4ac32b20 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:22.358272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b25e2416-29c0-4c57-896d-8c0e4ac32b20 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:22.369784 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b25e2416-29c0-4c57-896d-8c0e4ac32b20 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:22.372110 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b25e2416-29c0-4c57-896d-8c0e4ac32b20 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:22.373348 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b25e2416-29c0-4c57-896d-8c0e4ac32b20 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1334 microversion: 2.57 time: 0.181639 Aug 04 17:10:22.386002 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1842/3766] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:22 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1334 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:22.386397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e984cf70-8890-4128-a3a9-f68ee3f6986d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3243fe2bab64fbf8ea77b4f969b16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd0b59b952a4a1d8cbc68b4448dfc0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:22.390791 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e984cf70-8890-4128-a3a9-f68ee3f6986d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334" status: 200 len: 1369 microversion: 2.1 time: 0.354360 Aug 04 17:10:22.392311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a17a596a-d77b-4079-a1fa-af289e423ba5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:22.393057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a17a596a-d77b-4079-a1fa-af289e423ba5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:22.398323 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1925/3767] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:22 2022] GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334 => generated 1369 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:22.404722 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a17a596a-d77b-4079-a1fa-af289e423ba5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:22.405476 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a17a596a-d77b-4079-a1fa-af289e423ba5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:22.406135 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a17a596a-d77b-4079-a1fa-af289e423ba5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:22.406880 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a17a596a-d77b-4079-a1fa-af289e423ba5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:22.407364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a17a596a-d77b-4079-a1fa-af289e423ba5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:22.408124 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a17a596a-d77b-4079-a1fa-af289e423ba5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:22.641728 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a17a596a-d77b-4079-a1fa-af289e423ba5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:22.659772 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a17a596a-d77b-4079-a1fa-af289e423ba5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1510 microversion: 2.1 time: 0.284018 Aug 04 17:10:22.674589 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1843/3768] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:22 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1510 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:22.680065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1f1391de-084c-4dee-9169-2b9d67602a4c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:22.681018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1f1391de-084c-4dee-9169-2b9d67602a4c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:22.689140 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f1391de-084c-4dee-9169-2b9d67602a4c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:22.689962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f1391de-084c-4dee-9169-2b9d67602a4c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:22.690654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f1391de-084c-4dee-9169-2b9d67602a4c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:22.691603 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f1391de-084c-4dee-9169-2b9d67602a4c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:22.692272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f1391de-084c-4dee-9169-2b9d67602a4c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:22.692910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f1391de-084c-4dee-9169-2b9d67602a4c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:22.931962 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d27c540b-5711-4875-8a1f-74f2b763ca4b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:22.934229 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d27c540b-5711-4875-8a1f-74f2b763ca4b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:22.945050 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d27c540b-5711-4875-8a1f-74f2b763ca4b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:22.945620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d27c540b-5711-4875-8a1f-74f2b763ca4b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:22.946305 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d27c540b-5711-4875-8a1f-74f2b763ca4b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:22.947015 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d27c540b-5711-4875-8a1f-74f2b763ca4b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:22.947470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d27c540b-5711-4875-8a1f-74f2b763ca4b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:22.948063 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d27c540b-5711-4875-8a1f-74f2b763ca4b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:22.992964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1f1391de-084c-4dee-9169-2b9d67602a4c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:23.002245 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1f1391de-084c-4dee-9169-2b9d67602a4c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1709 microversion: 2.1 time: 0.325815 Aug 04 17:10:23.010856 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1926/3769] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:22 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1709 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:10:23.318530 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d27c540b-5711-4875-8a1f-74f2b763ca4b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:23.330401 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d27c540b-5711-4875-8a1f-74f2b763ca4b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1520 microversion: 2.1 time: 0.407066 Aug 04 17:10:23.331559 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1844/3770] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:22 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1520 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:23.400434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-95b505e7-4deb-42d2-be18-4f2d540178d5 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:23.401695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-95b505e7-4deb-42d2-be18-4f2d540178d5 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:23.408512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9be93b76-81e8-4b45-8f12-1c6dee9c1727 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:23.409134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9be93b76-81e8-4b45-8f12-1c6dee9c1727 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:23.409516 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95b505e7-4deb-42d2-be18-4f2d540178d5 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:23.410155 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95b505e7-4deb-42d2-be18-4f2d540178d5 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:23.410700 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95b505e7-4deb-42d2-be18-4f2d540178d5 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:23.411616 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95b505e7-4deb-42d2-be18-4f2d540178d5 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:23.412086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95b505e7-4deb-42d2-be18-4f2d540178d5 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:23.412551 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95b505e7-4deb-42d2-be18-4f2d540178d5 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:23.417914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9be93b76-81e8-4b45-8f12-1c6dee9c1727 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:23.421769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9be93b76-81e8-4b45-8f12-1c6dee9c1727 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:23.422531 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9be93b76-81e8-4b45-8f12-1c6dee9c1727 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:23.423628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9be93b76-81e8-4b45-8f12-1c6dee9c1727 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:23.424327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9be93b76-81e8-4b45-8f12-1c6dee9c1727 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:23.425415 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9be93b76-81e8-4b45-8f12-1c6dee9c1727 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:23.612642 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-95b505e7-4deb-42d2-be18-4f2d540178d5 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:23.625355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-95b505e7-4deb-42d2-be18-4f2d540178d5 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:23.627202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-95b505e7-4deb-42d2-be18-4f2d540178d5 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:23.628976 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-95b505e7-4deb-42d2-be18-4f2d540178d5 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1334 microversion: 2.57 time: 0.233910 Aug 04 17:10:23.650321 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1927/3771] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:23 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1334 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:23.684655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8135319a-078b-4ad9-9eb2-c5360c86d58e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:23.685687 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8135319a-078b-4ad9-9eb2-c5360c86d58e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:23.695472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8135319a-078b-4ad9-9eb2-c5360c86d58e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:23.696703 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8135319a-078b-4ad9-9eb2-c5360c86d58e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:23.697359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8135319a-078b-4ad9-9eb2-c5360c86d58e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:23.711978 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8135319a-078b-4ad9-9eb2-c5360c86d58e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:23.712654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8135319a-078b-4ad9-9eb2-c5360c86d58e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:23.713863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8135319a-078b-4ad9-9eb2-c5360c86d58e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:23.858846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9be93b76-81e8-4b45-8f12-1c6dee9c1727 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3243fe2bab64fbf8ea77b4f969b16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd0b59b952a4a1d8cbc68b4448dfc0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:23.870325 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9be93b76-81e8-4b45-8f12-1c6dee9c1727 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334" status: 200 len: 1369 microversion: 2.1 time: 0.461398 Aug 04 17:10:23.871785 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1845/3772] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:23 2022] GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334 => generated 1369 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:24.005682 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8135319a-078b-4ad9-9eb2-c5360c86d58e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:24.014177 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8135319a-078b-4ad9-9eb2-c5360c86d58e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1510 microversion: 2.1 time: 0.337288 Aug 04 17:10:24.019281 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1928/3773] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:23 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1510 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:10:24.026110 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a608433b-6584-4bb6-8c08-fab1f814c3dd tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1449857519", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "f9102c3d-4b85-458d-8baa-df7cf603050a"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:24.033072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-54ac72f7-b0a3-4485-90fd-156627d61d74 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:24.033790 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-54ac72f7-b0a3-4485-90fd-156627d61d74 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:24.040434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-54ac72f7-b0a3-4485-90fd-156627d61d74 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:24.041180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-54ac72f7-b0a3-4485-90fd-156627d61d74 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:24.041824 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-54ac72f7-b0a3-4485-90fd-156627d61d74 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:24.043490 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-54ac72f7-b0a3-4485-90fd-156627d61d74 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:24.044124 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-54ac72f7-b0a3-4485-90fd-156627d61d74 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:24.044718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-54ac72f7-b0a3-4485-90fd-156627d61d74 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:24.067593 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:24.108386 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-a608433b-6584-4bb6-8c08-fab1f814c3dd tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] validate_networks() for [('f9102c3d-4b85-458d-8baa-df7cf603050a', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:10:24.429294 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-54ac72f7-b0a3-4485-90fd-156627d61d74 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:24.451377 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-54ac72f7-b0a3-4485-90fd-156627d61d74 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1709 microversion: 2.1 time: 0.429701 Aug 04 17:10:24.472027 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1929/3774] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:24 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1709 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:24.478119 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e8dcef23-ab5c-408a-8070-035204ea7525 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:24.480917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e8dcef23-ab5c-408a-8070-035204ea7525 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:24.496946 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8dcef23-ab5c-408a-8070-035204ea7525 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:24.497723 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8dcef23-ab5c-408a-8070-035204ea7525 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:24.498464 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8dcef23-ab5c-408a-8070-035204ea7525 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:24.500672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8dcef23-ab5c-408a-8070-035204ea7525 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:24.501157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8dcef23-ab5c-408a-8070-035204ea7525 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:24.502527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8dcef23-ab5c-408a-8070-035204ea7525 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:24.679494 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e8dcef23-ab5c-408a-8070-035204ea7525 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:24.687210 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e8dcef23-ab5c-408a-8070-035204ea7525 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1520 microversion: 2.1 time: 0.213574 Aug 04 17:10:24.688616 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1930/3775] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:24 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:24.706045 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-205ed8cb-a3ae-4acc-b256-fab9e4cbf834 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:24.706900 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-205ed8cb-a3ae-4acc-b256-fab9e4cbf834 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:24.713555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-205ed8cb-a3ae-4acc-b256-fab9e4cbf834 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:24.714343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-205ed8cb-a3ae-4acc-b256-fab9e4cbf834 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:24.715166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-205ed8cb-a3ae-4acc-b256-fab9e4cbf834 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:24.716068 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-205ed8cb-a3ae-4acc-b256-fab9e4cbf834 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:24.716714 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-205ed8cb-a3ae-4acc-b256-fab9e4cbf834 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:24.717313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-205ed8cb-a3ae-4acc-b256-fab9e4cbf834 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:24.803514 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-205ed8cb-a3ae-4acc-b256-fab9e4cbf834 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:24.822425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-205ed8cb-a3ae-4acc-b256-fab9e4cbf834 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:24.823941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-205ed8cb-a3ae-4acc-b256-fab9e4cbf834 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:24.825139 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-205ed8cb-a3ae-4acc-b256-fab9e4cbf834 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1355 microversion: 2.57 time: 0.135429 Aug 04 17:10:24.825830 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1931/3776] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:24 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1355 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:24.856198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5044b0bb-0fe6-4d54-b371-ccefef440620 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:24.858815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5044b0bb-0fe6-4d54-b371-ccefef440620 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:24.870171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5044b0bb-0fe6-4d54-b371-ccefef440620 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:24.870966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5044b0bb-0fe6-4d54-b371-ccefef440620 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:24.871413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5044b0bb-0fe6-4d54-b371-ccefef440620 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:24.872609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5044b0bb-0fe6-4d54-b371-ccefef440620 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:24.873935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5044b0bb-0fe6-4d54-b371-ccefef440620 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:24.875054 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5044b0bb-0fe6-4d54-b371-ccefef440620 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:24.981088 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-a608433b-6584-4bb6-8c08-fab1f814c3dd tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:10:24.982231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-a608433b-6584-4bb6-8c08-fab1f814c3dd tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:10:24.984942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-a608433b-6584-4bb6-8c08-fab1f814c3dd tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:10:24.987020 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-a608433b-6584-4bb6-8c08-fab1f814c3dd tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:10:24.987679 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-a608433b-6584-4bb6-8c08-fab1f814c3dd tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:10:25.009241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a608433b-6584-4bb6-8c08-fab1f814c3dd tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:25.010286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a608433b-6584-4bb6-8c08-fab1f814c3dd tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:25.011078 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a608433b-6584-4bb6-8c08-fab1f814c3dd tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:25.012012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5044b0bb-0fe6-4d54-b371-ccefef440620 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:10:25.012502 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5044b0bb-0fe6-4d54-b371-ccefef440620 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:10:25.013550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5044b0bb-0fe6-4d54-b371-ccefef440620 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:10:25.013920 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5044b0bb-0fe6-4d54-b371-ccefef440620 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:10:25.014735 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5044b0bb-0fe6-4d54-b371-ccefef440620 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:10:25.014996 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a608433b-6584-4bb6-8c08-fab1f814c3dd tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:25.015556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a608433b-6584-4bb6-8c08-fab1f814c3dd tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:25.017554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a608433b-6584-4bb6-8c08-fab1f814c3dd tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:25.048165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-a608433b-6584-4bb6-8c08-fab1f814c3dd tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Getting quotas for project 6ada0dfbe888415881ee6cd85264ada7. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:10:25.056835 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-a608433b-6584-4bb6-8c08-fab1f814c3dd tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Getting quotas for user 25aafff9f4984e0dac87c362d3f1eeb4 and project 6ada0dfbe888415881ee6cd85264ada7. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:10:25.091017 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a608433b-6584-4bb6-8c08-fab1f814c3dd tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:10:25.095481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a608433b-6584-4bb6-8c08-fab1f814c3dd tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] [instance: 20e4091a-1d92-475e-866b-46bd7e9ed57e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:10:25.109329 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5044b0bb-0fe6-4d54-b371-ccefef440620 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:25.126253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5044b0bb-0fe6-4d54-b371-ccefef440620 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:25.127749 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5044b0bb-0fe6-4d54-b371-ccefef440620 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:25.128216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5044b0bb-0fe6-4d54-b371-ccefef440620 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:25.128966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5044b0bb-0fe6-4d54-b371-ccefef440620 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:25.129440 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5044b0bb-0fe6-4d54-b371-ccefef440620 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:25.129877 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5044b0bb-0fe6-4d54-b371-ccefef440620 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:25.195816 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a608433b-6584-4bb6-8c08-fab1f814c3dd tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.248127 Aug 04 17:10:25.197679 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1846/3777] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:10:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1252 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 17:10:25.202739 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5044b0bb-0fe6-4d54-b371-ccefef440620 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "POST /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d/action" status: 202 len: 1136 microversion: 2.57 time: 0.346625 Aug 04 17:10:25.203780 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1932/3778] 10.222.0.93 () {62 vars in 1320 bytes} [Thu Aug 4 17:10:24 2022] POST /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d/action => generated 1136 bytes in 353 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 04 17:10:25.205235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-61998ec1-9529-45b4-91cc-9cd610f075b5 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:25.206132 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-61998ec1-9529-45b4-91cc-9cd610f075b5 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:25.214699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-61998ec1-9529-45b4-91cc-9cd610f075b5 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:25.215629 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-61998ec1-9529-45b4-91cc-9cd610f075b5 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:25.216434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-61998ec1-9529-45b4-91cc-9cd610f075b5 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:25.216577 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-df58a7d3-6b95-4606-a09c-5f849fe8d51a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:25.217173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-df58a7d3-6b95-4606-a09c-5f849fe8d51a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:25.217678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-61998ec1-9529-45b4-91cc-9cd610f075b5 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:25.218369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-61998ec1-9529-45b4-91cc-9cd610f075b5 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:25.219003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-61998ec1-9529-45b4-91cc-9cd610f075b5 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:25.224023 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df58a7d3-6b95-4606-a09c-5f849fe8d51a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:25.224534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df58a7d3-6b95-4606-a09c-5f849fe8d51a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:25.225012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df58a7d3-6b95-4606-a09c-5f849fe8d51a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:25.225727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df58a7d3-6b95-4606-a09c-5f849fe8d51a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:25.226231 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df58a7d3-6b95-4606-a09c-5f849fe8d51a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:25.226666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df58a7d3-6b95-4606-a09c-5f849fe8d51a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:25.442294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-61998ec1-9529-45b4-91cc-9cd610f075b5 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3243fe2bab64fbf8ea77b4f969b16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd0b59b952a4a1d8cbc68b4448dfc0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:25.455562 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-61998ec1-9529-45b4-91cc-9cd610f075b5 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334" status: 200 len: 1369 microversion: 2.1 time: 0.255074 Aug 04 17:10:25.458251 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1847/3779] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:25 2022] GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334 => generated 1369 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:25.466553 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5ceed82f-edfb-4a26-8ba0-b8f9f12de568 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:25.472760 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5ceed82f-edfb-4a26-8ba0-b8f9f12de568 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] [instance: 20e4091a-1d92-475e-866b-46bd7e9ed57e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:25.599174 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-df58a7d3-6b95-4606-a09c-5f849fe8d51a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:25.623124 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-df58a7d3-6b95-4606-a09c-5f849fe8d51a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1510 microversion: 2.1 time: 0.416787 Aug 04 17:10:25.623971 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1933/3780] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:25 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1510 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:25.625605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5ceed82f-edfb-4a26-8ba0-b8f9f12de568 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aafff9f4984e0dac87c362d3f1eeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada0dfbe888415881ee6cd85264ada7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:25.630565 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-40a30f6f-3da0-40f2-be06-12e7e14a803e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:25.631728 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-40a30f6f-3da0-40f2-be06-12e7e14a803e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:25.634844 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:25.639535 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-40a30f6f-3da0-40f2-be06-12e7e14a803e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:25.640039 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-40a30f6f-3da0-40f2-be06-12e7e14a803e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:25.640487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-40a30f6f-3da0-40f2-be06-12e7e14a803e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:25.641378 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-40a30f6f-3da0-40f2-be06-12e7e14a803e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:25.642049 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-40a30f6f-3da0-40f2-be06-12e7e14a803e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:25.642831 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-40a30f6f-3da0-40f2-be06-12e7e14a803e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:25.647126 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5ceed82f-edfb-4a26-8ba0-b8f9f12de568 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] 10.222.0.93 "GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e" status: 200 len: 1228 microversion: 2.1 time: 0.173189 Aug 04 17:10:25.650754 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1848/3781] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:25 2022] GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e => generated 1228 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:25.662183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-55fe3fa5-3a3e-49ea-8423-27e017ae05ec tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:25.665938 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-55fe3fa5-3a3e-49ea-8423-27e017ae05ec tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:25.696559 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55fe3fa5-3a3e-49ea-8423-27e017ae05ec tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:25.697065 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55fe3fa5-3a3e-49ea-8423-27e017ae05ec tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:25.697511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55fe3fa5-3a3e-49ea-8423-27e017ae05ec tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:25.703825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55fe3fa5-3a3e-49ea-8423-27e017ae05ec tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:25.705112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55fe3fa5-3a3e-49ea-8423-27e017ae05ec tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:25.705592 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55fe3fa5-3a3e-49ea-8423-27e017ae05ec tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:25.722644 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-40a30f6f-3da0-40f2-be06-12e7e14a803e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:25.736625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-40a30f6f-3da0-40f2-be06-12e7e14a803e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:25.738687 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-40a30f6f-3da0-40f2-be06-12e7e14a803e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:25.740248 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-40a30f6f-3da0-40f2-be06-12e7e14a803e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1364 microversion: 2.57 time: 0.113804 Aug 04 17:10:25.743407 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1934/3782] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:25 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1364 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:25.750215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-72bcaba6-7f86-4a86-b5f3-d086abcec6a9 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:25.750983 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-72bcaba6-7f86-4a86-b5f3-d086abcec6a9 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:25.759791 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-72bcaba6-7f86-4a86-b5f3-d086abcec6a9 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:25.760546 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-72bcaba6-7f86-4a86-b5f3-d086abcec6a9 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:25.761039 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-72bcaba6-7f86-4a86-b5f3-d086abcec6a9 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:25.761745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-72bcaba6-7f86-4a86-b5f3-d086abcec6a9 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:25.762343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-72bcaba6-7f86-4a86-b5f3-d086abcec6a9 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:25.762785 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-72bcaba6-7f86-4a86-b5f3-d086abcec6a9 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:26.047106 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-72bcaba6-7f86-4a86-b5f3-d086abcec6a9 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:26.099292 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-72bcaba6-7f86-4a86-b5f3-d086abcec6a9 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1520 microversion: 2.1 time: 0.353356 Aug 04 17:10:26.114084 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1935/3783] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:25 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1520 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:26.114342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-55fe3fa5-3a3e-49ea-8423-27e017ae05ec tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:26.125878 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-55fe3fa5-3a3e-49ea-8423-27e017ae05ec tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1713 microversion: 2.1 time: 0.472804 Aug 04 17:10:26.126917 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1849/3784] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:25 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1713 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:26.478029 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6168905a-9acd-4969-b5d3-bc4a4a273454 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:26.478652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6168905a-9acd-4969-b5d3-bc4a4a273454 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:26.485427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6168905a-9acd-4969-b5d3-bc4a4a273454 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:26.486189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6168905a-9acd-4969-b5d3-bc4a4a273454 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:26.486641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6168905a-9acd-4969-b5d3-bc4a4a273454 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:26.487359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6168905a-9acd-4969-b5d3-bc4a4a273454 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:26.487829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6168905a-9acd-4969-b5d3-bc4a4a273454 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:26.488263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6168905a-9acd-4969-b5d3-bc4a4a273454 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:26.645677 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d4a58940-15d2-4ef1-8bc7-b015c6cddf09 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:26.646256 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d4a58940-15d2-4ef1-8bc7-b015c6cddf09 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:26.661947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4a58940-15d2-4ef1-8bc7-b015c6cddf09 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:26.662408 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4a58940-15d2-4ef1-8bc7-b015c6cddf09 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:26.663394 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4a58940-15d2-4ef1-8bc7-b015c6cddf09 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:26.664623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4a58940-15d2-4ef1-8bc7-b015c6cddf09 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:26.665257 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4a58940-15d2-4ef1-8bc7-b015c6cddf09 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:26.665860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4a58940-15d2-4ef1-8bc7-b015c6cddf09 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:26.703483 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6168905a-9acd-4969-b5d3-bc4a4a273454 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3243fe2bab64fbf8ea77b4f969b16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd0b59b952a4a1d8cbc68b4448dfc0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:26.722364 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6168905a-9acd-4969-b5d3-bc4a4a273454 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334" status: 200 len: 1369 microversion: 2.1 time: 0.248827 Aug 04 17:10:26.727409 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1936/3785] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:26 2022] GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334 => generated 1369 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:26.739745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c6051819-108b-463e-9a73-8f87cb28c4e6 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:26.740733 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c6051819-108b-463e-9a73-8f87cb28c4e6 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] [instance: 20e4091a-1d92-475e-866b-46bd7e9ed57e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:26.752524 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6051819-108b-463e-9a73-8f87cb28c4e6 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:26.753026 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6051819-108b-463e-9a73-8f87cb28c4e6 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:26.753564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6051819-108b-463e-9a73-8f87cb28c4e6 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:26.754443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6051819-108b-463e-9a73-8f87cb28c4e6 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:26.754936 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6051819-108b-463e-9a73-8f87cb28c4e6 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:26.755455 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6051819-108b-463e-9a73-8f87cb28c4e6 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:26.848306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c6051819-108b-463e-9a73-8f87cb28c4e6 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aafff9f4984e0dac87c362d3f1eeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada0dfbe888415881ee6cd85264ada7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:26.865560 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c6051819-108b-463e-9a73-8f87cb28c4e6 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] 10.222.0.93 "GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e" status: 200 len: 1232 microversion: 2.1 time: 0.136762 Aug 04 17:10:26.880972 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1937/3786] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:26 2022] GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e => generated 1232 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:26.883603 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d4a58940-15d2-4ef1-8bc7-b015c6cddf09 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:26.892546 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d4a58940-15d2-4ef1-8bc7-b015c6cddf09 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1510 microversion: 2.1 time: 0.252095 Aug 04 17:10:26.897065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ca1d990f-7721-4c8a-b58e-911ec5719b2a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:26.898529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ca1d990f-7721-4c8a-b58e-911ec5719b2a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:26.899167 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1850/3787] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:26 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1510 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:26.905295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca1d990f-7721-4c8a-b58e-911ec5719b2a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:26.906184 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca1d990f-7721-4c8a-b58e-911ec5719b2a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:26.906730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca1d990f-7721-4c8a-b58e-911ec5719b2a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:26.907558 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca1d990f-7721-4c8a-b58e-911ec5719b2a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:26.908129 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca1d990f-7721-4c8a-b58e-911ec5719b2a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:26.908671 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca1d990f-7721-4c8a-b58e-911ec5719b2a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:26.997633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ca1d990f-7721-4c8a-b58e-911ec5719b2a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:27.006063 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ca1d990f-7721-4c8a-b58e-911ec5719b2a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:27.008488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ca1d990f-7721-4c8a-b58e-911ec5719b2a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:27.010004 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ca1d990f-7721-4c8a-b58e-911ec5719b2a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1364 microversion: 2.57 time: 0.123920 Aug 04 17:10:27.011329 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1938/3788] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:26 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1364 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:27.130597 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-716daca0-1660-4e27-9978-921047a36806 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:27.131856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-716daca0-1660-4e27-9978-921047a36806 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:27.141802 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-716daca0-1660-4e27-9978-921047a36806 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:27.142338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-716daca0-1660-4e27-9978-921047a36806 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:27.142792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-716daca0-1660-4e27-9978-921047a36806 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:27.145629 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-716daca0-1660-4e27-9978-921047a36806 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:27.148304 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-716daca0-1660-4e27-9978-921047a36806 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:27.149003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-716daca0-1660-4e27-9978-921047a36806 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:27.394510 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-716daca0-1660-4e27-9978-921047a36806 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:27.405644 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-716daca0-1660-4e27-9978-921047a36806 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1520 microversion: 2.1 time: 0.282432 Aug 04 17:10:27.406277 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1851/3789] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:27 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1520 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:27.648916 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ab8fafca-226c-4c79-b231-1c11e0529c6a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-727969488", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "54a674d1-14ad-48d0-9d57-c183bfdfcf31"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:27.712388 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-ab8fafca-226c-4c79-b231-1c11e0529c6a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] validate_networks() for [('54a674d1-14ad-48d0-9d57-c183bfdfcf31', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:10:27.744606 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-34c7b024-eff1-41d9-8558-a4c6a7ce1e2d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:27.746380 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-34c7b024-eff1-41d9-8558-a4c6a7ce1e2d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:27.766611 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34c7b024-eff1-41d9-8558-a4c6a7ce1e2d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:27.769228 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34c7b024-eff1-41d9-8558-a4c6a7ce1e2d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:27.772086 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34c7b024-eff1-41d9-8558-a4c6a7ce1e2d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:27.773469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34c7b024-eff1-41d9-8558-a4c6a7ce1e2d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:27.776941 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34c7b024-eff1-41d9-8558-a4c6a7ce1e2d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:27.777638 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34c7b024-eff1-41d9-8558-a4c6a7ce1e2d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:28.513668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-34c7b024-eff1-41d9-8558-a4c6a7ce1e2d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3243fe2bab64fbf8ea77b4f969b16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd0b59b952a4a1d8cbc68b4448dfc0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:28.523514 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-34c7b024-eff1-41d9-8558-a4c6a7ce1e2d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334" status: 200 len: 1369 microversion: 2.1 time: 0.783657 Aug 04 17:10:28.524149 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1852/3790] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:27 2022] GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334 => generated 1369 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:28.531377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-19f95118-0a7e-450d-aa6a-fc8dbd2568b7 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:28.532271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-19f95118-0a7e-450d-aa6a-fc8dbd2568b7 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] [instance: 20e4091a-1d92-475e-866b-46bd7e9ed57e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:28.546022 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19f95118-0a7e-450d-aa6a-fc8dbd2568b7 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:28.546816 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19f95118-0a7e-450d-aa6a-fc8dbd2568b7 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:28.547485 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19f95118-0a7e-450d-aa6a-fc8dbd2568b7 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:28.548203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19f95118-0a7e-450d-aa6a-fc8dbd2568b7 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:28.548891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19f95118-0a7e-450d-aa6a-fc8dbd2568b7 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:28.549481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19f95118-0a7e-450d-aa6a-fc8dbd2568b7 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:28.671916 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-19f95118-0a7e-450d-aa6a-fc8dbd2568b7 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aafff9f4984e0dac87c362d3f1eeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada0dfbe888415881ee6cd85264ada7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:28.680612 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-19f95118-0a7e-450d-aa6a-fc8dbd2568b7 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] 10.222.0.93 "GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e" status: 200 len: 1286 microversion: 2.1 time: 0.152905 Aug 04 17:10:28.682306 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1853/3791] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:28 2022] GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e => generated 1286 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:28.687788 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0687c2e7-2c50-4ddf-a3b0-cbcc7090740b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:28.689080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0687c2e7-2c50-4ddf-a3b0-cbcc7090740b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:28.696850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0687c2e7-2c50-4ddf-a3b0-cbcc7090740b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:28.697273 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0687c2e7-2c50-4ddf-a3b0-cbcc7090740b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:28.697897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0687c2e7-2c50-4ddf-a3b0-cbcc7090740b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:28.698780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0687c2e7-2c50-4ddf-a3b0-cbcc7090740b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:28.699242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0687c2e7-2c50-4ddf-a3b0-cbcc7090740b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:28.699810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0687c2e7-2c50-4ddf-a3b0-cbcc7090740b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:28.734138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-ab8fafca-226c-4c79-b231-1c11e0529c6a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:10:28.735175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-ab8fafca-226c-4c79-b231-1c11e0529c6a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:10:28.735658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-ab8fafca-226c-4c79-b231-1c11e0529c6a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:10:28.736074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-ab8fafca-226c-4c79-b231-1c11e0529c6a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:10:28.736491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-ab8fafca-226c-4c79-b231-1c11e0529c6a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:10:28.746972 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ab8fafca-226c-4c79-b231-1c11e0529c6a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:28.747460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ab8fafca-226c-4c79-b231-1c11e0529c6a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:28.747902 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ab8fafca-226c-4c79-b231-1c11e0529c6a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:28.748641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ab8fafca-226c-4c79-b231-1c11e0529c6a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:28.749103 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ab8fafca-226c-4c79-b231-1c11e0529c6a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:28.749530 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ab8fafca-226c-4c79-b231-1c11e0529c6a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:28.767824 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-ab8fafca-226c-4c79-b231-1c11e0529c6a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Getting quotas for project e61b34a0cac845c49d7c334921af14c1. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:10:28.774345 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-ab8fafca-226c-4c79-b231-1c11e0529c6a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Getting quotas for user 556b051e0d244645a851888bb6bcc265 and project e61b34a0cac845c49d7c334921af14c1. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:10:28.793264 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ab8fafca-226c-4c79-b231-1c11e0529c6a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:10:28.795727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ab8fafca-226c-4c79-b231-1c11e0529c6a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 01c2f9e6-2bf7-4013-b254-0dac8e579962] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:10:28.846318 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ab8fafca-226c-4c79-b231-1c11e0529c6a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.333882 Aug 04 17:10:28.857794 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1939/3792] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:10:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:10:28.857794 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-952ec8a8-3ff3-4b98-8081-e80fc2391eef tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:28.857794 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-952ec8a8-3ff3-4b98-8081-e80fc2391eef tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:28.865745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-952ec8a8-3ff3-4b98-8081-e80fc2391eef tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:28.866305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-952ec8a8-3ff3-4b98-8081-e80fc2391eef tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:28.866767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-952ec8a8-3ff3-4b98-8081-e80fc2391eef tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:28.868344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-952ec8a8-3ff3-4b98-8081-e80fc2391eef tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:28.868928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-952ec8a8-3ff3-4b98-8081-e80fc2391eef tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:28.869373 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-952ec8a8-3ff3-4b98-8081-e80fc2391eef tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:28.873431 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0687c2e7-2c50-4ddf-a3b0-cbcc7090740b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:28.884083 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0687c2e7-2c50-4ddf-a3b0-cbcc7090740b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1510 microversion: 2.1 time: 0.200469 Aug 04 17:10:28.892842 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1854/3793] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:28 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1510 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:28.901412 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-39b1e030-7645-4d99-adf5-4c5b7164d0a0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:28.902279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-39b1e030-7645-4d99-adf5-4c5b7164d0a0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:28.925738 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39b1e030-7645-4d99-adf5-4c5b7164d0a0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:28.931545 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39b1e030-7645-4d99-adf5-4c5b7164d0a0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:28.932541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39b1e030-7645-4d99-adf5-4c5b7164d0a0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:28.933485 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39b1e030-7645-4d99-adf5-4c5b7164d0a0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:28.934629 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39b1e030-7645-4d99-adf5-4c5b7164d0a0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:28.935757 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39b1e030-7645-4d99-adf5-4c5b7164d0a0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:28.989498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-952ec8a8-3ff3-4b98-8081-e80fc2391eef tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:28.997854 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-952ec8a8-3ff3-4b98-8081-e80fc2391eef tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:28.999497 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-952ec8a8-3ff3-4b98-8081-e80fc2391eef tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:29.001742 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-952ec8a8-3ff3-4b98-8081-e80fc2391eef tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1364 microversion: 2.57 time: 0.153451 Aug 04 17:10:29.002358 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1940/3794] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:28 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:29.024386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2ed80aec-1d30-46e3-9498-832c9d6b6210 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1584309718", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "54a674d1-14ad-48d0-9d57-c183bfdfcf31"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:29.131886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-2ed80aec-1d30-46e3-9498-832c9d6b6210 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] validate_networks() for [('54a674d1-14ad-48d0-9d57-c183bfdfcf31', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:10:29.509246 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-39b1e030-7645-4d99-adf5-4c5b7164d0a0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:29.523885 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-39b1e030-7645-4d99-adf5-4c5b7164d0a0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1520 microversion: 2.1 time: 0.628496 Aug 04 17:10:29.526652 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1855/3795] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:28 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1520 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:29.551578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-058208ef-551a-44f8-9741-df98c838c2b3 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:29.553709 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-058208ef-551a-44f8-9741-df98c838c2b3 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:29.573592 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-058208ef-551a-44f8-9741-df98c838c2b3 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:29.578286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-058208ef-551a-44f8-9741-df98c838c2b3 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:29.582928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-058208ef-551a-44f8-9741-df98c838c2b3 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:29.584053 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-058208ef-551a-44f8-9741-df98c838c2b3 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:29.585851 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-058208ef-551a-44f8-9741-df98c838c2b3 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:29.589084 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-058208ef-551a-44f8-9741-df98c838c2b3 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:29.886433 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-058208ef-551a-44f8-9741-df98c838c2b3 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3243fe2bab64fbf8ea77b4f969b16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd0b59b952a4a1d8cbc68b4448dfc0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:29.899666 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-058208ef-551a-44f8-9741-df98c838c2b3 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334" status: 200 len: 1369 microversion: 2.1 time: 0.356572 Aug 04 17:10:29.900761 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1856/3796] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:29 2022] GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334 => generated 1369 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:29.920723 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e0782565-5783-4389-8183-863e4e87c427 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:29.930872 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e0782565-5783-4389-8183-863e4e87c427 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] [instance: 20e4091a-1d92-475e-866b-46bd7e9ed57e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:29.940094 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0782565-5783-4389-8183-863e4e87c427 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:29.941027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0782565-5783-4389-8183-863e4e87c427 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:29.941682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0782565-5783-4389-8183-863e4e87c427 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:29.944232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0782565-5783-4389-8183-863e4e87c427 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:29.944893 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0782565-5783-4389-8183-863e4e87c427 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:29.946105 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0782565-5783-4389-8183-863e4e87c427 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:30.038633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-2ed80aec-1d30-46e3-9498-832c9d6b6210 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:10:30.039986 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-2ed80aec-1d30-46e3-9498-832c9d6b6210 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:10:30.040743 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-2ed80aec-1d30-46e3-9498-832c9d6b6210 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:10:30.041480 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-2ed80aec-1d30-46e3-9498-832c9d6b6210 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:10:30.042310 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-2ed80aec-1d30-46e3-9498-832c9d6b6210 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:10:30.051940 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ed80aec-1d30-46e3-9498-832c9d6b6210 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:30.053025 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ed80aec-1d30-46e3-9498-832c9d6b6210 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:30.054160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ed80aec-1d30-46e3-9498-832c9d6b6210 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:30.055092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ed80aec-1d30-46e3-9498-832c9d6b6210 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:30.055725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ed80aec-1d30-46e3-9498-832c9d6b6210 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:30.056803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ed80aec-1d30-46e3-9498-832c9d6b6210 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:30.082900 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-2ed80aec-1d30-46e3-9498-832c9d6b6210 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Getting quotas for project e61b34a0cac845c49d7c334921af14c1. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:10:30.091426 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-2ed80aec-1d30-46e3-9498-832c9d6b6210 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Getting quotas for user 556b051e0d244645a851888bb6bcc265 and project e61b34a0cac845c49d7c334921af14c1. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:10:30.110001 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2ed80aec-1d30-46e3-9498-832c9d6b6210 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:10:30.112738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2ed80aec-1d30-46e3-9498-832c9d6b6210 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: e67fc2ff-0549-433f-9385-cc71740b93c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:10:30.184988 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2ed80aec-1d30-46e3-9498-832c9d6b6210 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.181346 Aug 04 17:10:30.197414 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1941/3797] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:10:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:10:30.204694 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-14b82d51-e669-4d03-87dc-901f9c68e075 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:30.205897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-14b82d51-e669-4d03-87dc-901f9c68e075 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:30.215578 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14b82d51-e669-4d03-87dc-901f9c68e075 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:30.216343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14b82d51-e669-4d03-87dc-901f9c68e075 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:30.217549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14b82d51-e669-4d03-87dc-901f9c68e075 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:30.218855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14b82d51-e669-4d03-87dc-901f9c68e075 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:30.219490 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14b82d51-e669-4d03-87dc-901f9c68e075 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:30.220096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14b82d51-e669-4d03-87dc-901f9c68e075 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:30.222595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e0782565-5783-4389-8183-863e4e87c427 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aafff9f4984e0dac87c362d3f1eeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada0dfbe888415881ee6cd85264ada7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:30.235960 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e0782565-5783-4389-8183-863e4e87c427 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] 10.222.0.93 "GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e" status: 200 len: 1328 microversion: 2.1 time: 0.333680 Aug 04 17:10:30.243185 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1857/3798] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:29 2022] GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e => generated 1328 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:30.250660 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c8fb543f-95bf-49cb-85d4-803bbb1bd386 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:30.252764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c8fb543f-95bf-49cb-85d4-803bbb1bd386 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:30.277332 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8fb543f-95bf-49cb-85d4-803bbb1bd386 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:30.281490 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8fb543f-95bf-49cb-85d4-803bbb1bd386 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:30.282405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8fb543f-95bf-49cb-85d4-803bbb1bd386 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:30.284405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8fb543f-95bf-49cb-85d4-803bbb1bd386 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:30.287351 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8fb543f-95bf-49cb-85d4-803bbb1bd386 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:30.288352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8fb543f-95bf-49cb-85d4-803bbb1bd386 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:30.463823 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c8fb543f-95bf-49cb-85d4-803bbb1bd386 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:30.477643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c8fb543f-95bf-49cb-85d4-803bbb1bd386 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:30.491001 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c8fb543f-95bf-49cb-85d4-803bbb1bd386 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:30.492253 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c8fb543f-95bf-49cb-85d4-803bbb1bd386 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1364 microversion: 2.57 time: 0.247656 Aug 04 17:10:30.492825 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1858/3799] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:30 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1364 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:30.507556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-dc880d84-f022-4051-9ecf-abf4c52028ad req-36269b00-5f53-49be-9768-a784809a5d44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20e4091a-1d92-475e-866b-46bd7e9ed57e", "tag": "4c13ab9f-a1f2-434e-b381-a9ba9d982436"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:30.553578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-dc880d84-f022-4051-9ecf-abf4c52028ad req-36269b00-5f53-49be-9768-a784809a5d44 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:30.556466 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-dc880d84-f022-4051-9ecf-abf4c52028ad req-36269b00-5f53-49be-9768-a784809a5d44 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:30.558190 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-dc880d84-f022-4051-9ecf-abf4c52028ad req-36269b00-5f53-49be-9768-a784809a5d44 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:30.603660 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-dc880d84-f022-4051-9ecf-abf4c52028ad req-36269b00-5f53-49be-9768-a784809a5d44 service nova] Creating event network-changed:4c13ab9f-a1f2-434e-b381-a9ba9d982436 for instance 20e4091a-1d92-475e-866b-46bd7e9ed57e on n-h2-851359-3 Aug 04 17:10:30.611044 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-dc880d84-f022-4051-9ecf-abf4c52028ad req-36269b00-5f53-49be-9768-a784809a5d44 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116571 Aug 04 17:10:30.611535 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-14b82d51-e669-4d03-87dc-901f9c68e075 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:30.612232 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1859/3800] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:10:30.617772 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e3fa8b7f-64ee-4c89-a55e-6a77da24f219 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1944657385", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "451", "networks": [{"uuid": "54a674d1-14ad-48d0-9d57-c183bfdfcf31"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:30.622160 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-14b82d51-e669-4d03-87dc-901f9c68e075 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1510 microversion: 2.1 time: 0.420987 Aug 04 17:10:30.622760 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1942/3801] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:30 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1510 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:30.635858 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-616d20ce-1891-468f-a25c-6be04164b829 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:30.639353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-616d20ce-1891-468f-a25c-6be04164b829 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:30.651819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-616d20ce-1891-468f-a25c-6be04164b829 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:30.652337 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-616d20ce-1891-468f-a25c-6be04164b829 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:30.652850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-616d20ce-1891-468f-a25c-6be04164b829 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:30.653480 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-616d20ce-1891-468f-a25c-6be04164b829 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:30.653938 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-616d20ce-1891-468f-a25c-6be04164b829 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:30.654404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-616d20ce-1891-468f-a25c-6be04164b829 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:30.721512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-e3fa8b7f-64ee-4c89-a55e-6a77da24f219 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] validate_networks() for [('54a674d1-14ad-48d0-9d57-c183bfdfcf31', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:10:31.064754 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-616d20ce-1891-468f-a25c-6be04164b829 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:31.078511 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-616d20ce-1891-468f-a25c-6be04164b829 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1520 microversion: 2.1 time: 0.448995 Aug 04 17:10:31.098208 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1943/3802] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:30 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1520 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:31.110677 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-c931e471-3ea1-4483-83bd-bcafcc509667 req-91471175-1c17-4635-8e9e-6831a34041a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1af7e3f-723f-40e1-b968-bc7aeaa95334", "name": "network-vif-plugged", "status": "completed", "tag": "bf74ae8e-ca14-433b-901b-3ed2e54ec681"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:31.133510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c931e471-3ea1-4483-83bd-bcafcc509667 req-91471175-1c17-4635-8e9e-6831a34041a0 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:31.136624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c931e471-3ea1-4483-83bd-bcafcc509667 req-91471175-1c17-4635-8e9e-6831a34041a0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:31.138993 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c931e471-3ea1-4483-83bd-bcafcc509667 req-91471175-1c17-4635-8e9e-6831a34041a0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:31.159709 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-c931e471-3ea1-4483-83bd-bcafcc509667 req-91471175-1c17-4635-8e9e-6831a34041a0 service nova] Creating event network-vif-plugged:bf74ae8e-ca14-433b-901b-3ed2e54ec681 for instance b1af7e3f-723f-40e1-b968-bc7aeaa95334 on n-h2-851359-3 Aug 04 17:10:31.167089 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-c931e471-3ea1-4483-83bd-bcafcc509667 req-91471175-1c17-4635-8e9e-6831a34041a0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067085 Aug 04 17:10:31.168361 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1944/3803] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:10:31.174987 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b80d7994-508e-4570-97db-acc6c893e8e4 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:31.176085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b80d7994-508e-4570-97db-acc6c893e8e4 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:31.183459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b80d7994-508e-4570-97db-acc6c893e8e4 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:31.184277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b80d7994-508e-4570-97db-acc6c893e8e4 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:31.184887 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b80d7994-508e-4570-97db-acc6c893e8e4 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:31.185821 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b80d7994-508e-4570-97db-acc6c893e8e4 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:31.186641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b80d7994-508e-4570-97db-acc6c893e8e4 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:31.187230 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b80d7994-508e-4570-97db-acc6c893e8e4 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:31.427685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e3fa8b7f-64ee-4c89-a55e-6a77da24f219 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:10:31.428242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e3fa8b7f-64ee-4c89-a55e-6a77da24f219 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:10:31.429014 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e3fa8b7f-64ee-4c89-a55e-6a77da24f219 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:10:31.429491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e3fa8b7f-64ee-4c89-a55e-6a77da24f219 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:10:31.430029 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e3fa8b7f-64ee-4c89-a55e-6a77da24f219 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:10:31.439671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3fa8b7f-64ee-4c89-a55e-6a77da24f219 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:31.440160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3fa8b7f-64ee-4c89-a55e-6a77da24f219 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:31.440600 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3fa8b7f-64ee-4c89-a55e-6a77da24f219 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:31.441332 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3fa8b7f-64ee-4c89-a55e-6a77da24f219 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:31.441967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3fa8b7f-64ee-4c89-a55e-6a77da24f219 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:31.442615 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3fa8b7f-64ee-4c89-a55e-6a77da24f219 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:31.452606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b80d7994-508e-4570-97db-acc6c893e8e4 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3243fe2bab64fbf8ea77b4f969b16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd0b59b952a4a1d8cbc68b4448dfc0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:31.455994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:31.461764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e3fa8b7f-64ee-4c89-a55e-6a77da24f219 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Getting quotas for project e61b34a0cac845c49d7c334921af14c1. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:10:31.462903 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b80d7994-508e-4570-97db-acc6c893e8e4 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334" status: 200 len: 1369 microversion: 2.1 time: 0.293100 Aug 04 17:10:31.467839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e3fa8b7f-64ee-4c89-a55e-6a77da24f219 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Getting quotas for user 556b051e0d244645a851888bb6bcc265 and project e61b34a0cac845c49d7c334921af14c1. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:10:31.475028 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1945/3804] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:31 2022] GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334 => generated 1369 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:31.483307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-98b2d94f-e395-4a78-99d9-0d03799ea2cf tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:31.484482 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e3fa8b7f-64ee-4c89-a55e-6a77da24f219 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:10:31.484954 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-98b2d94f-e395-4a78-99d9-0d03799ea2cf tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] [instance: 20e4091a-1d92-475e-866b-46bd7e9ed57e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:31.487047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e3fa8b7f-64ee-4c89-a55e-6a77da24f219 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 016fbd16-b01e-4ebf-ad2f-3495970feb96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:10:31.492917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98b2d94f-e395-4a78-99d9-0d03799ea2cf tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:31.493837 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98b2d94f-e395-4a78-99d9-0d03799ea2cf tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:31.494441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98b2d94f-e395-4a78-99d9-0d03799ea2cf tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:31.495198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98b2d94f-e395-4a78-99d9-0d03799ea2cf tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:31.495670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98b2d94f-e395-4a78-99d9-0d03799ea2cf tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:31.496850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98b2d94f-e395-4a78-99d9-0d03799ea2cf tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:31.538728 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e3fa8b7f-64ee-4c89-a55e-6a77da24f219 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.925270 Aug 04 17:10:31.539474 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1860/3805] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:10:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:10:31.544845 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-442b4cef-09b9-496d-8e48-d0f326ee1b2d tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:31.545719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-442b4cef-09b9-496d-8e48-d0f326ee1b2d tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:31.553870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-442b4cef-09b9-496d-8e48-d0f326ee1b2d tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:31.555220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-442b4cef-09b9-496d-8e48-d0f326ee1b2d tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:31.555904 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-442b4cef-09b9-496d-8e48-d0f326ee1b2d tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:31.556856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-442b4cef-09b9-496d-8e48-d0f326ee1b2d tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:31.557528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-442b4cef-09b9-496d-8e48-d0f326ee1b2d tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:31.558244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-442b4cef-09b9-496d-8e48-d0f326ee1b2d tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:31.586390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:31.638098 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-442b4cef-09b9-496d-8e48-d0f326ee1b2d tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:31.649091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-442b4cef-09b9-496d-8e48-d0f326ee1b2d tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:31.651484 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-442b4cef-09b9-496d-8e48-d0f326ee1b2d tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:31.653144 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-442b4cef-09b9-496d-8e48-d0f326ee1b2d tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1364 microversion: 2.57 time: 0.112352 Aug 04 17:10:31.667159 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1861/3806] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:31 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1364 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:31.672185 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-696b4302-ee06-4f59-94fe-e5154b264a7e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:31.673028 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-696b4302-ee06-4f59-94fe-e5154b264a7e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 016fbd16-b01e-4ebf-ad2f-3495970feb96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:31.750655 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-696b4302-ee06-4f59-94fe-e5154b264a7e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:31.760588 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-98b2d94f-e395-4a78-99d9-0d03799ea2cf tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aafff9f4984e0dac87c362d3f1eeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada0dfbe888415881ee6cd85264ada7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:31.761693 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-696b4302-ee06-4f59-94fe-e5154b264a7e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96" status: 200 len: 1221 microversion: 2.1 time: 0.092938 Aug 04 17:10:31.762373 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1862/3807] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:31 2022] GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96 => generated 1221 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:31.768373 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-98b2d94f-e395-4a78-99d9-0d03799ea2cf tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] 10.222.0.93 "GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e" status: 200 len: 1328 microversion: 2.1 time: 0.291269 Aug 04 17:10:31.769173 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1946/3808] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:31 2022] GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e => generated 1328 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:31.770271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0a76ef13-dca2-4bd4-85c3-0f381846bbed tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:31.771158 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0a76ef13-dca2-4bd4-85c3-0f381846bbed tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:31.789016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a76ef13-dca2-4bd4-85c3-0f381846bbed tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:31.789528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a76ef13-dca2-4bd4-85c3-0f381846bbed tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:31.790028 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a76ef13-dca2-4bd4-85c3-0f381846bbed tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:31.791270 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a76ef13-dca2-4bd4-85c3-0f381846bbed tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:31.791736 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a76ef13-dca2-4bd4-85c3-0f381846bbed tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:31.792520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a76ef13-dca2-4bd4-85c3-0f381846bbed tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:31.974060 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0a76ef13-dca2-4bd4-85c3-0f381846bbed tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:31.981959 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0a76ef13-dca2-4bd4-85c3-0f381846bbed tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1510 microversion: 2.1 time: 0.217856 Aug 04 17:10:31.997740 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1863/3809] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:31 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1510 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:32.106406 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-be920d24-7a93-4fcf-9a38-7a7e3bee6364 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:32.107193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-be920d24-7a93-4fcf-9a38-7a7e3bee6364 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:32.113749 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be920d24-7a93-4fcf-9a38-7a7e3bee6364 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:32.114536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be920d24-7a93-4fcf-9a38-7a7e3bee6364 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:32.115265 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be920d24-7a93-4fcf-9a38-7a7e3bee6364 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:32.116797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be920d24-7a93-4fcf-9a38-7a7e3bee6364 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:32.117474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be920d24-7a93-4fcf-9a38-7a7e3bee6364 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:32.117911 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be920d24-7a93-4fcf-9a38-7a7e3bee6364 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:32.258417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-be920d24-7a93-4fcf-9a38-7a7e3bee6364 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:32.268230 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-be920d24-7a93-4fcf-9a38-7a7e3bee6364 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1520 microversion: 2.1 time: 0.166396 Aug 04 17:10:32.282461 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1947/3810] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:32 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:10:32.483744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-85ebc65d-f015-4637-9f53-dd08d9020f92 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:32.484741 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-85ebc65d-f015-4637-9f53-dd08d9020f92 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:32.491873 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85ebc65d-f015-4637-9f53-dd08d9020f92 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:32.492574 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85ebc65d-f015-4637-9f53-dd08d9020f92 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:32.493183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85ebc65d-f015-4637-9f53-dd08d9020f92 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:32.493879 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85ebc65d-f015-4637-9f53-dd08d9020f92 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:32.494368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85ebc65d-f015-4637-9f53-dd08d9020f92 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:32.494795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85ebc65d-f015-4637-9f53-dd08d9020f92 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:32.632964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-85ebc65d-f015-4637-9f53-dd08d9020f92 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3243fe2bab64fbf8ea77b4f969b16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd0b59b952a4a1d8cbc68b4448dfc0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:32.641025 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-85ebc65d-f015-4637-9f53-dd08d9020f92 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334" status: 200 len: 1369 microversion: 2.1 time: 0.161043 Aug 04 17:10:32.641832 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1864/3811] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:32 2022] GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334 => generated 1369 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:32.644177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-049394bf-74e2-4c22-8194-2069a48194ca req-f13f1646-a950-405c-b1f3-d1c780535e21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01c2f9e6-2bf7-4013-b254-0dac8e579962", "tag": "67f0534c-f1d3-4c4f-99d8-fed5bd714025"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:32.655589 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-049394bf-74e2-4c22-8194-2069a48194ca req-f13f1646-a950-405c-b1f3-d1c780535e21 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:32.656082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-049394bf-74e2-4c22-8194-2069a48194ca req-f13f1646-a950-405c-b1f3-d1c780535e21 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:32.656521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-049394bf-74e2-4c22-8194-2069a48194ca req-f13f1646-a950-405c-b1f3-d1c780535e21 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:32.669754 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-049394bf-74e2-4c22-8194-2069a48194ca req-f13f1646-a950-405c-b1f3-d1c780535e21 service nova] Creating event network-changed:67f0534c-f1d3-4c4f-99d8-fed5bd714025 for instance 01c2f9e6-2bf7-4013-b254-0dac8e579962 on n-h1-851359-3 Aug 04 17:10:32.674826 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-049394bf-74e2-4c22-8194-2069a48194ca req-f13f1646-a950-405c-b1f3-d1c780535e21 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034351 Aug 04 17:10:32.676249 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1948/3812] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:10:32.681136 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-69479627-e3ed-41fb-8f4f-2b653acea8b2 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:32.681782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-69479627-e3ed-41fb-8f4f-2b653acea8b2 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:32.688245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69479627-e3ed-41fb-8f4f-2b653acea8b2 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:32.689128 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69479627-e3ed-41fb-8f4f-2b653acea8b2 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:32.689582 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69479627-e3ed-41fb-8f4f-2b653acea8b2 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:32.690334 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69479627-e3ed-41fb-8f4f-2b653acea8b2 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:32.690799 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69479627-e3ed-41fb-8f4f-2b653acea8b2 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:32.691234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69479627-e3ed-41fb-8f4f-2b653acea8b2 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:32.759939 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-69479627-e3ed-41fb-8f4f-2b653acea8b2 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:32.768325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-69479627-e3ed-41fb-8f4f-2b653acea8b2 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:32.770036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-69479627-e3ed-41fb-8f4f-2b653acea8b2 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:32.771203 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-69479627-e3ed-41fb-8f4f-2b653acea8b2 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1364 microversion: 2.57 time: 0.094616 Aug 04 17:10:32.772415 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1865/3813] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:32 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1364 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:10:32.793612 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7a6cff93-4656-4e9e-8b4a-44d325067453 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:32.794351 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7a6cff93-4656-4e9e-8b4a-44d325067453 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 016fbd16-b01e-4ebf-ad2f-3495970feb96] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:32.796402 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7a0a3efb-7129-4dc6-8374-01e80a12d35d tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:32.797482 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7a0a3efb-7129-4dc6-8374-01e80a12d35d tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] [instance: 20e4091a-1d92-475e-866b-46bd7e9ed57e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:32.801384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7a6cff93-4656-4e9e-8b4a-44d325067453 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:32.802103 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7a6cff93-4656-4e9e-8b4a-44d325067453 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:32.802741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7a6cff93-4656-4e9e-8b4a-44d325067453 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:32.803490 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7a6cff93-4656-4e9e-8b4a-44d325067453 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:32.803616 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a0a3efb-7129-4dc6-8374-01e80a12d35d tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:32.803956 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7a6cff93-4656-4e9e-8b4a-44d325067453 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:32.804082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a0a3efb-7129-4dc6-8374-01e80a12d35d tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:32.804391 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7a6cff93-4656-4e9e-8b4a-44d325067453 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:32.804732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a0a3efb-7129-4dc6-8374-01e80a12d35d tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:32.806044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a0a3efb-7129-4dc6-8374-01e80a12d35d tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:32.806044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a0a3efb-7129-4dc6-8374-01e80a12d35d tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:32.806521 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a0a3efb-7129-4dc6-8374-01e80a12d35d tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:32.877205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7a6cff93-4656-4e9e-8b4a-44d325067453 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:32.886230 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7a6cff93-4656-4e9e-8b4a-44d325067453 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96" status: 200 len: 1225 microversion: 2.1 time: 0.096717 Aug 04 17:10:32.887901 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1949/3814] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:32 2022] GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:32.961489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7a0a3efb-7129-4dc6-8374-01e80a12d35d tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aafff9f4984e0dac87c362d3f1eeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada0dfbe888415881ee6cd85264ada7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:32.968911 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7a0a3efb-7129-4dc6-8374-01e80a12d35d tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] 10.222.0.93 "GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e" status: 200 len: 1328 microversion: 2.1 time: 0.176328 Aug 04 17:10:32.969699 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1866/3815] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:32 2022] GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e => generated 1328 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:10:33.004946 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d23a3bd3-78c8-4a62-a36b-995e0d5173ee tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:33.005604 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d23a3bd3-78c8-4a62-a36b-995e0d5173ee tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:33.012938 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d23a3bd3-78c8-4a62-a36b-995e0d5173ee tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:33.013434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d23a3bd3-78c8-4a62-a36b-995e0d5173ee tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:33.013883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d23a3bd3-78c8-4a62-a36b-995e0d5173ee tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:33.014619 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d23a3bd3-78c8-4a62-a36b-995e0d5173ee tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:33.015089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d23a3bd3-78c8-4a62-a36b-995e0d5173ee tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:33.015518 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d23a3bd3-78c8-4a62-a36b-995e0d5173ee tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:33.152982 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d23a3bd3-78c8-4a62-a36b-995e0d5173ee tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:33.160843 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d23a3bd3-78c8-4a62-a36b-995e0d5173ee tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1510 microversion: 2.1 time: 0.159896 Aug 04 17:10:33.161414 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1950/3816] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:32 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:33.289574 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6a21003b-5fbe-428e-9333-a5ca6f11190d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:33.290215 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6a21003b-5fbe-428e-9333-a5ca6f11190d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:33.296129 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a21003b-5fbe-428e-9333-a5ca6f11190d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:33.296650 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a21003b-5fbe-428e-9333-a5ca6f11190d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:33.297069 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a21003b-5fbe-428e-9333-a5ca6f11190d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:33.297774 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a21003b-5fbe-428e-9333-a5ca6f11190d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:33.298253 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a21003b-5fbe-428e-9333-a5ca6f11190d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:33.298675 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a21003b-5fbe-428e-9333-a5ca6f11190d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:33.434344 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6a21003b-5fbe-428e-9333-a5ca6f11190d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:33.442555 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6a21003b-5fbe-428e-9333-a5ca6f11190d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1520 microversion: 2.1 time: 0.156815 Aug 04 17:10:33.443119 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1867/3817] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:33 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:33.666682 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b9c5bc1d-7815-449b-b1df-68f035c2c9ed tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:33.667303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b9c5bc1d-7815-449b-b1df-68f035c2c9ed tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:33.674139 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9c5bc1d-7815-449b-b1df-68f035c2c9ed tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:33.674627 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9c5bc1d-7815-449b-b1df-68f035c2c9ed tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:33.675065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9c5bc1d-7815-449b-b1df-68f035c2c9ed tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:33.675755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9c5bc1d-7815-449b-b1df-68f035c2c9ed tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:33.676209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9c5bc1d-7815-449b-b1df-68f035c2c9ed tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:33.676638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9c5bc1d-7815-449b-b1df-68f035c2c9ed tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:33.796876 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cc80e3cc-7fdd-498f-90aa-73793c5ca831 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:33.797802 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cc80e3cc-7fdd-498f-90aa-73793c5ca831 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:33.805734 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc80e3cc-7fdd-498f-90aa-73793c5ca831 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:33.806369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc80e3cc-7fdd-498f-90aa-73793c5ca831 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:33.807035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc80e3cc-7fdd-498f-90aa-73793c5ca831 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:33.808212 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc80e3cc-7fdd-498f-90aa-73793c5ca831 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:33.808780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc80e3cc-7fdd-498f-90aa-73793c5ca831 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:33.809431 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc80e3cc-7fdd-498f-90aa-73793c5ca831 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:33.825515 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b9c5bc1d-7815-449b-b1df-68f035c2c9ed tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3243fe2bab64fbf8ea77b4f969b16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd0b59b952a4a1d8cbc68b4448dfc0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:33.837538 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b9c5bc1d-7815-449b-b1df-68f035c2c9ed tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334" status: 200 len: 1369 microversion: 2.1 time: 0.174104 Aug 04 17:10:33.840766 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1951/3818] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:33 2022] GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334 => generated 1369 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:33.888270 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cc80e3cc-7fdd-498f-90aa-73793c5ca831 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:33.896815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cc80e3cc-7fdd-498f-90aa-73793c5ca831 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:33.898448 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cc80e3cc-7fdd-498f-90aa-73793c5ca831 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:33.899756 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cc80e3cc-7fdd-498f-90aa-73793c5ca831 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1364 microversion: 2.57 time: 0.106821 Aug 04 17:10:33.900439 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1868/3819] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:33 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1364 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:33.912701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-77bad48e-d8e5-40f4-a909-e79fe7f70090 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:33.913379 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-77bad48e-d8e5-40f4-a909-e79fe7f70090 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 016fbd16-b01e-4ebf-ad2f-3495970feb96] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:33.920202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77bad48e-d8e5-40f4-a909-e79fe7f70090 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:33.920721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77bad48e-d8e5-40f4-a909-e79fe7f70090 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:33.921197 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77bad48e-d8e5-40f4-a909-e79fe7f70090 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:33.922004 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77bad48e-d8e5-40f4-a909-e79fe7f70090 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:33.922472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77bad48e-d8e5-40f4-a909-e79fe7f70090 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:33.922910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77bad48e-d8e5-40f4-a909-e79fe7f70090 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:33.983154 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-77bad48e-d8e5-40f4-a909-e79fe7f70090 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:33.988931 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3d044aee-a913-4af2-8dfc-f03944890dc3 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:33.989546 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3d044aee-a913-4af2-8dfc-f03944890dc3 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] [instance: 20e4091a-1d92-475e-866b-46bd7e9ed57e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:33.991206 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-77bad48e-d8e5-40f4-a909-e79fe7f70090 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96" status: 200 len: 1217 microversion: 2.1 time: 0.083103 Aug 04 17:10:33.992003 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1952/3820] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:33 2022] GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:33.996130 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d044aee-a913-4af2-8dfc-f03944890dc3 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:33.996613 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d044aee-a913-4af2-8dfc-f03944890dc3 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:33.997045 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d044aee-a913-4af2-8dfc-f03944890dc3 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:33.997734 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d044aee-a913-4af2-8dfc-f03944890dc3 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:33.998225 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d044aee-a913-4af2-8dfc-f03944890dc3 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:33.998648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d044aee-a913-4af2-8dfc-f03944890dc3 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:34.135544 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3d044aee-a913-4af2-8dfc-f03944890dc3 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aafff9f4984e0dac87c362d3f1eeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada0dfbe888415881ee6cd85264ada7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:34.143107 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3d044aee-a913-4af2-8dfc-f03944890dc3 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] 10.222.0.93 "GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e" status: 200 len: 1328 microversion: 2.1 time: 0.157952 Aug 04 17:10:34.143870 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1869/3821] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:33 2022] GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e => generated 1328 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:10:34.181641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-388a8b5f-ce87-4c4d-a8b5-34367b2edbf3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:34.182486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-388a8b5f-ce87-4c4d-a8b5-34367b2edbf3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:34.188959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-388a8b5f-ce87-4c4d-a8b5-34367b2edbf3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:34.189453 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-388a8b5f-ce87-4c4d-a8b5-34367b2edbf3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:34.189903 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-388a8b5f-ce87-4c4d-a8b5-34367b2edbf3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:34.190679 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-388a8b5f-ce87-4c4d-a8b5-34367b2edbf3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:34.191142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-388a8b5f-ce87-4c4d-a8b5-34367b2edbf3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:34.191607 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-388a8b5f-ce87-4c4d-a8b5-34367b2edbf3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:34.323915 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-388a8b5f-ce87-4c4d-a8b5-34367b2edbf3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:34.333615 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-388a8b5f-ce87-4c4d-a8b5-34367b2edbf3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1510 microversion: 2.1 time: 0.156268 Aug 04 17:10:34.334864 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1953/3822] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:34 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:10:34.464930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-68b975f9-a87c-4fd6-8c58-e4e5deff5af1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:34.465580 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-68b975f9-a87c-4fd6-8c58-e4e5deff5af1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:34.471559 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68b975f9-a87c-4fd6-8c58-e4e5deff5af1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:34.472037 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68b975f9-a87c-4fd6-8c58-e4e5deff5af1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:34.472472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68b975f9-a87c-4fd6-8c58-e4e5deff5af1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:34.473153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68b975f9-a87c-4fd6-8c58-e4e5deff5af1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:34.473604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68b975f9-a87c-4fd6-8c58-e4e5deff5af1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:34.474049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68b975f9-a87c-4fd6-8c58-e4e5deff5af1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:34.607966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-68b975f9-a87c-4fd6-8c58-e4e5deff5af1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:34.617049 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-68b975f9-a87c-4fd6-8c58-e4e5deff5af1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1520 microversion: 2.1 time: 0.156151 Aug 04 17:10:34.631462 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1870/3823] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:34 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:10:34.862768 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-99b3f179-3480-49dc-bbda-a745b21befa4 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:34.863398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-99b3f179-3480-49dc-bbda-a745b21befa4 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:34.871564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99b3f179-3480-49dc-bbda-a745b21befa4 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:34.872548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99b3f179-3480-49dc-bbda-a745b21befa4 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:34.873341 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99b3f179-3480-49dc-bbda-a745b21befa4 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:34.874709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99b3f179-3480-49dc-bbda-a745b21befa4 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:34.875180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99b3f179-3480-49dc-bbda-a745b21befa4 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:34.876101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99b3f179-3480-49dc-bbda-a745b21befa4 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:34.925093 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-44d027f2-d6cd-44f4-b3f2-8b6659ea620e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:34.925793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-44d027f2-d6cd-44f4-b3f2-8b6659ea620e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:34.933110 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44d027f2-d6cd-44f4-b3f2-8b6659ea620e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:34.933586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44d027f2-d6cd-44f4-b3f2-8b6659ea620e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:34.934220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44d027f2-d6cd-44f4-b3f2-8b6659ea620e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:34.935264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44d027f2-d6cd-44f4-b3f2-8b6659ea620e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:34.935393 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44d027f2-d6cd-44f4-b3f2-8b6659ea620e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:34.935815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44d027f2-d6cd-44f4-b3f2-8b6659ea620e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:35.015077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-44d027f2-d6cd-44f4-b3f2-8b6659ea620e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:35.023875 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-44d027f2-d6cd-44f4-b3f2-8b6659ea620e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:35.026813 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-44d027f2-d6cd-44f4-b3f2-8b6659ea620e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:35.028965 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-44d027f2-d6cd-44f4-b3f2-8b6659ea620e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1364 microversion: 2.57 time: 0.107517 Aug 04 17:10:35.029895 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1871/3824] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:34 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1364 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:10:35.035034 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-73086049-6b8e-499a-bc6c-0d4764fe425f tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:35.035661 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-73086049-6b8e-499a-bc6c-0d4764fe425f tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 016fbd16-b01e-4ebf-ad2f-3495970feb96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:35.043298 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73086049-6b8e-499a-bc6c-0d4764fe425f tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:35.043793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73086049-6b8e-499a-bc6c-0d4764fe425f tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:35.044240 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73086049-6b8e-499a-bc6c-0d4764fe425f tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:35.044950 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73086049-6b8e-499a-bc6c-0d4764fe425f tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:35.045415 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73086049-6b8e-499a-bc6c-0d4764fe425f tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:35.045841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73086049-6b8e-499a-bc6c-0d4764fe425f tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:35.058227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-99b3f179-3480-49dc-bbda-a745b21befa4 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3243fe2bab64fbf8ea77b4f969b16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd0b59b952a4a1d8cbc68b4448dfc0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:35.066232 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-99b3f179-3480-49dc-bbda-a745b21befa4 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334" status: 200 len: 1369 microversion: 2.1 time: 0.207301 Aug 04 17:10:35.067021 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1954/3825] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:34 2022] GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334 => generated 1369 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:35.111125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-73086049-6b8e-499a-bc6c-0d4764fe425f tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:35.119397 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-73086049-6b8e-499a-bc6c-0d4764fe425f tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96" status: 200 len: 1273 microversion: 2.1 time: 0.088232 Aug 04 17:10:35.119967 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1872/3826] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:35 2022] GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96 => generated 1273 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:35.164819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d1f2b948-a6b0-4068-b905-8691ae01a61b tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:35.165325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d1f2b948-a6b0-4068-b905-8691ae01a61b tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] [instance: 20e4091a-1d92-475e-866b-46bd7e9ed57e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:35.171351 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1f2b948-a6b0-4068-b905-8691ae01a61b tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:35.171909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1f2b948-a6b0-4068-b905-8691ae01a61b tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:35.172361 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1f2b948-a6b0-4068-b905-8691ae01a61b tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:35.173069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1f2b948-a6b0-4068-b905-8691ae01a61b tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:35.173566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1f2b948-a6b0-4068-b905-8691ae01a61b tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:35.174026 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1f2b948-a6b0-4068-b905-8691ae01a61b tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:35.309456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d1f2b948-a6b0-4068-b905-8691ae01a61b tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aafff9f4984e0dac87c362d3f1eeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada0dfbe888415881ee6cd85264ada7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:35.317144 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d1f2b948-a6b0-4068-b905-8691ae01a61b tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] 10.222.0.93 "GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e" status: 200 len: 1328 microversion: 2.1 time: 0.156888 Aug 04 17:10:35.317718 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1955/3827] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:35 2022] GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e => generated 1328 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:35.356596 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-789aeafa-fbcd-44f5-bb96-8ed3a2b5e746 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:35.357211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-789aeafa-fbcd-44f5-bb96-8ed3a2b5e746 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:35.363322 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-789aeafa-fbcd-44f5-bb96-8ed3a2b5e746 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:35.363815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-789aeafa-fbcd-44f5-bb96-8ed3a2b5e746 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:35.364278 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-789aeafa-fbcd-44f5-bb96-8ed3a2b5e746 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:35.364980 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-789aeafa-fbcd-44f5-bb96-8ed3a2b5e746 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:35.366051 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-789aeafa-fbcd-44f5-bb96-8ed3a2b5e746 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:35.366484 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-789aeafa-fbcd-44f5-bb96-8ed3a2b5e746 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:35.492253 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-789aeafa-fbcd-44f5-bb96-8ed3a2b5e746 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:35.499728 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-789aeafa-fbcd-44f5-bb96-8ed3a2b5e746 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1510 microversion: 2.1 time: 0.147014 Aug 04 17:10:35.500288 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1873/3828] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:35 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:35.637855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-730ff04b-e8a3-4d45-bb66-4abfadf6184d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:35.638516 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-730ff04b-e8a3-4d45-bb66-4abfadf6184d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:35.645740 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-730ff04b-e8a3-4d45-bb66-4abfadf6184d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:35.646271 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-730ff04b-e8a3-4d45-bb66-4abfadf6184d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:35.647222 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-730ff04b-e8a3-4d45-bb66-4abfadf6184d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:35.648061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-730ff04b-e8a3-4d45-bb66-4abfadf6184d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:35.648451 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-730ff04b-e8a3-4d45-bb66-4abfadf6184d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:35.648863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-730ff04b-e8a3-4d45-bb66-4abfadf6184d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:35.782803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-730ff04b-e8a3-4d45-bb66-4abfadf6184d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:35.790903 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-730ff04b-e8a3-4d45-bb66-4abfadf6184d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1520 microversion: 2.1 time: 0.156795 Aug 04 17:10:35.791655 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1956/3829] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:35 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:36.053427 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-83b2a017-c406-41c7-8154-4cbf3d4b5bb3 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:36.054733 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-83b2a017-c406-41c7-8154-4cbf3d4b5bb3 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:36.062110 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83b2a017-c406-41c7-8154-4cbf3d4b5bb3 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:36.062930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83b2a017-c406-41c7-8154-4cbf3d4b5bb3 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:36.063981 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83b2a017-c406-41c7-8154-4cbf3d4b5bb3 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:36.064860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83b2a017-c406-41c7-8154-4cbf3d4b5bb3 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:36.065607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83b2a017-c406-41c7-8154-4cbf3d4b5bb3 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:36.066327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83b2a017-c406-41c7-8154-4cbf3d4b5bb3 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:36.096506 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c5644d42-35ad-45cd-88f5-3b3b9f2b0d0a tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:36.097323 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c5644d42-35ad-45cd-88f5-3b3b9f2b0d0a tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:36.108771 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c5644d42-35ad-45cd-88f5-3b3b9f2b0d0a tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:36.110032 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c5644d42-35ad-45cd-88f5-3b3b9f2b0d0a tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:36.110668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c5644d42-35ad-45cd-88f5-3b3b9f2b0d0a tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:36.111577 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c5644d42-35ad-45cd-88f5-3b3b9f2b0d0a tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:36.112235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c5644d42-35ad-45cd-88f5-3b3b9f2b0d0a tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:36.125696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c5644d42-35ad-45cd-88f5-3b3b9f2b0d0a tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:36.148146 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-83b2a017-c406-41c7-8154-4cbf3d4b5bb3 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:36.158830 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-83b2a017-c406-41c7-8154-4cbf3d4b5bb3 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:36.160355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-83b2a017-c406-41c7-8154-4cbf3d4b5bb3 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:36.161549 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-83b2a017-c406-41c7-8154-4cbf3d4b5bb3 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1364 microversion: 2.57 time: 0.112096 Aug 04 17:10:36.162161 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1874/3830] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:36 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1364 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:36.167451 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ac49ec2a-9353-45dd-8a96-3ed2cbf4625e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:36.168299 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ac49ec2a-9353-45dd-8a96-3ed2cbf4625e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 016fbd16-b01e-4ebf-ad2f-3495970feb96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:36.190184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac49ec2a-9353-45dd-8a96-3ed2cbf4625e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:36.190852 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac49ec2a-9353-45dd-8a96-3ed2cbf4625e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:36.191568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac49ec2a-9353-45dd-8a96-3ed2cbf4625e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:36.192511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac49ec2a-9353-45dd-8a96-3ed2cbf4625e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:36.194033 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac49ec2a-9353-45dd-8a96-3ed2cbf4625e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:36.194696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac49ec2a-9353-45dd-8a96-3ed2cbf4625e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:36.284135 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ac49ec2a-9353-45dd-8a96-3ed2cbf4625e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:36.296958 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ac49ec2a-9353-45dd-8a96-3ed2cbf4625e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96" status: 200 len: 1273 microversion: 2.1 time: 0.132684 Aug 04 17:10:36.299567 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1875/3831] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:36 2022] GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96 => generated 1273 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:36.338658 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-59d506f8-3519-4b4a-bbfd-bdbcd97c3695 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:36.339386 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-59d506f8-3519-4b4a-bbfd-bdbcd97c3695 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] [instance: 20e4091a-1d92-475e-866b-46bd7e9ed57e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:36.346932 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:36.348356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59d506f8-3519-4b4a-bbfd-bdbcd97c3695 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:36.348934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59d506f8-3519-4b4a-bbfd-bdbcd97c3695 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:36.349377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59d506f8-3519-4b4a-bbfd-bdbcd97c3695 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:36.350179 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59d506f8-3519-4b4a-bbfd-bdbcd97c3695 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:36.351481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59d506f8-3519-4b4a-bbfd-bdbcd97c3695 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:36.351712 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59d506f8-3519-4b4a-bbfd-bdbcd97c3695 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:36.363925 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c5644d42-35ad-45cd-88f5-3b3b9f2b0d0a tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3243fe2bab64fbf8ea77b4f969b16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd0b59b952a4a1d8cbc68b4448dfc0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:36.386326 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c5644d42-35ad-45cd-88f5-3b3b9f2b0d0a tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334" status: 200 len: 1369 microversion: 2.1 time: 0.299326 Aug 04 17:10:36.388293 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1957/3832] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:36 2022] GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334 => generated 1369 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:36.516687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-59d506f8-3519-4b4a-bbfd-bdbcd97c3695 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aafff9f4984e0dac87c362d3f1eeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada0dfbe888415881ee6cd85264ada7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:36.522404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-aa405d30-fcac-4430-8ba1-8e9456ab668d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:36.523588 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-aa405d30-fcac-4430-8ba1-8e9456ab668d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:36.533630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa405d30-fcac-4430-8ba1-8e9456ab668d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:36.534640 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-59d506f8-3519-4b4a-bbfd-bdbcd97c3695 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] 10.222.0.93 "GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e" status: 200 len: 1328 microversion: 2.1 time: 0.201421 Aug 04 17:10:36.534943 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa405d30-fcac-4430-8ba1-8e9456ab668d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:36.535652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa405d30-fcac-4430-8ba1-8e9456ab668d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:36.536485 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa405d30-fcac-4430-8ba1-8e9456ab668d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:36.536697 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1876/3833] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:36 2022] GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e => generated 1328 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:10:36.538230 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa405d30-fcac-4430-8ba1-8e9456ab668d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:36.538877 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa405d30-fcac-4430-8ba1-8e9456ab668d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:36.559005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-2acdabaf-19a4-4532-a0d2-3e2afb2073bb req-f8a79827-f1ba-46de-b705-1d5abb1071ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20e4091a-1d92-475e-866b-46bd7e9ed57e", "name": "network-vif-plugged", "status": "completed", "tag": "4c13ab9f-a1f2-434e-b381-a9ba9d982436"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:36.577428 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2acdabaf-19a4-4532-a0d2-3e2afb2073bb req-f8a79827-f1ba-46de-b705-1d5abb1071ee service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:36.577908 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2acdabaf-19a4-4532-a0d2-3e2afb2073bb req-f8a79827-f1ba-46de-b705-1d5abb1071ee service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:36.578554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2acdabaf-19a4-4532-a0d2-3e2afb2073bb req-f8a79827-f1ba-46de-b705-1d5abb1071ee service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:36.600957 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-2acdabaf-19a4-4532-a0d2-3e2afb2073bb req-f8a79827-f1ba-46de-b705-1d5abb1071ee service nova] Creating event network-vif-plugged:4c13ab9f-a1f2-434e-b381-a9ba9d982436 for instance 20e4091a-1d92-475e-866b-46bd7e9ed57e on n-h2-851359-3 Aug 04 17:10:36.606716 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-2acdabaf-19a4-4532-a0d2-3e2afb2073bb req-f8a79827-f1ba-46de-b705-1d5abb1071ee service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051695 Aug 04 17:10:36.607536 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1877/3834] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:10:36.708204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-aa405d30-fcac-4430-8ba1-8e9456ab668d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:36.719029 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-aa405d30-fcac-4430-8ba1-8e9456ab668d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1510 microversion: 2.1 time: 0.202595 Aug 04 17:10:36.719612 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1958/3835] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:36 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1510 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:10:36.812391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e9b7ec64-dfb6-4df3-b219-37027d0a002b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:36.813097 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e9b7ec64-dfb6-4df3-b219-37027d0a002b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:36.820117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9b7ec64-dfb6-4df3-b219-37027d0a002b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:36.820601 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9b7ec64-dfb6-4df3-b219-37027d0a002b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:36.821049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9b7ec64-dfb6-4df3-b219-37027d0a002b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:36.821742 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9b7ec64-dfb6-4df3-b219-37027d0a002b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:36.822250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9b7ec64-dfb6-4df3-b219-37027d0a002b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:36.822681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9b7ec64-dfb6-4df3-b219-37027d0a002b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:36.971991 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e9b7ec64-dfb6-4df3-b219-37027d0a002b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:36.982882 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e9b7ec64-dfb6-4df3-b219-37027d0a002b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1520 microversion: 2.1 time: 0.174589 Aug 04 17:10:36.991713 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1878/3836] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:36 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:37.185121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6c4bff41-2f8d-4d78-997e-9988f8d540e6 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:37.185759 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6c4bff41-2f8d-4d78-997e-9988f8d540e6 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:37.193745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c4bff41-2f8d-4d78-997e-9988f8d540e6 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:37.194283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c4bff41-2f8d-4d78-997e-9988f8d540e6 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:37.194721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c4bff41-2f8d-4d78-997e-9988f8d540e6 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:37.195553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c4bff41-2f8d-4d78-997e-9988f8d540e6 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:37.196015 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c4bff41-2f8d-4d78-997e-9988f8d540e6 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:37.196604 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c4bff41-2f8d-4d78-997e-9988f8d540e6 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:37.264310 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6c4bff41-2f8d-4d78-997e-9988f8d540e6 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:37.272407 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6c4bff41-2f8d-4d78-997e-9988f8d540e6 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:37.274372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6c4bff41-2f8d-4d78-997e-9988f8d540e6 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:37.275244 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6c4bff41-2f8d-4d78-997e-9988f8d540e6 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1364 microversion: 2.57 time: 0.094280 Aug 04 17:10:37.275800 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1959/3837] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:37 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1364 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:37.321364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3d287d2b-474a-46c7-b565-67733f338e69 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:37.322000 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3d287d2b-474a-46c7-b565-67733f338e69 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 016fbd16-b01e-4ebf-ad2f-3495970feb96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:37.332564 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d287d2b-474a-46c7-b565-67733f338e69 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:37.333272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d287d2b-474a-46c7-b565-67733f338e69 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:37.334271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d287d2b-474a-46c7-b565-67733f338e69 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:37.335885 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d287d2b-474a-46c7-b565-67733f338e69 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:37.336710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d287d2b-474a-46c7-b565-67733f338e69 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:37.337356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d287d2b-474a-46c7-b565-67733f338e69 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:37.357180 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:37.408438 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3d287d2b-474a-46c7-b565-67733f338e69 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:37.409255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4c1dd406-f10b-4459-ad77-02de40adb241 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:37.409884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4c1dd406-f10b-4459-ad77-02de40adb241 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:37.416594 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c1dd406-f10b-4459-ad77-02de40adb241 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:37.417113 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c1dd406-f10b-4459-ad77-02de40adb241 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:37.417740 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c1dd406-f10b-4459-ad77-02de40adb241 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:37.418650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c1dd406-f10b-4459-ad77-02de40adb241 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:37.419115 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c1dd406-f10b-4459-ad77-02de40adb241 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:37.419548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c1dd406-f10b-4459-ad77-02de40adb241 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:37.420154 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3d287d2b-474a-46c7-b565-67733f338e69 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96" status: 200 len: 1281 microversion: 2.1 time: 0.103038 Aug 04 17:10:37.420713 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1879/3838] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:37 2022] GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96 => generated 1281 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:37.563032 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8bd36994-8acf-4fa7-9812-fca99d71afc8 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:37.565764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8bd36994-8acf-4fa7-9812-fca99d71afc8 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] [instance: 20e4091a-1d92-475e-866b-46bd7e9ed57e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:37.603740 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8bd36994-8acf-4fa7-9812-fca99d71afc8 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:37.604492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8bd36994-8acf-4fa7-9812-fca99d71afc8 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:37.606363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8bd36994-8acf-4fa7-9812-fca99d71afc8 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:37.608815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8bd36994-8acf-4fa7-9812-fca99d71afc8 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:37.612312 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8bd36994-8acf-4fa7-9812-fca99d71afc8 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:37.613100 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8bd36994-8acf-4fa7-9812-fca99d71afc8 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:37.882918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4c1dd406-f10b-4459-ad77-02de40adb241 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3243fe2bab64fbf8ea77b4f969b16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd0b59b952a4a1d8cbc68b4448dfc0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:37.901660 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4c1dd406-f10b-4459-ad77-02de40adb241 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334" status: 200 len: 1554 microversion: 2.1 time: 0.495184 Aug 04 17:10:37.906778 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1960/3839] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:37 2022] GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334 => generated 1554 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:10:37.914059 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-86a797e4-f239-4b2a-b195-6a47f3a88ab3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:37.917135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-86a797e4-f239-4b2a-b195-6a47f3a88ab3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:37.930670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86a797e4-f239-4b2a-b195-6a47f3a88ab3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:37.931642 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86a797e4-f239-4b2a-b195-6a47f3a88ab3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:37.932724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86a797e4-f239-4b2a-b195-6a47f3a88ab3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:37.933623 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86a797e4-f239-4b2a-b195-6a47f3a88ab3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:37.934317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8bd36994-8acf-4fa7-9812-fca99d71afc8 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aafff9f4984e0dac87c362d3f1eeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada0dfbe888415881ee6cd85264ada7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:37.934527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86a797e4-f239-4b2a-b195-6a47f3a88ab3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:37.935123 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86a797e4-f239-4b2a-b195-6a47f3a88ab3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:37.945085 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8bd36994-8acf-4fa7-9812-fca99d71afc8 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] 10.222.0.93 "GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e" status: 200 len: 1328 microversion: 2.1 time: 0.390820 Aug 04 17:10:37.946150 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1880/3840] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:37 2022] GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e => generated 1328 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:37.962977 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-315286ab-6d07-44fb-a00f-9d60df1909c7 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:37.963644 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-315286ab-6d07-44fb-a00f-9d60df1909c7 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:37.970185 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-315286ab-6d07-44fb-a00f-9d60df1909c7 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:37.970933 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-315286ab-6d07-44fb-a00f-9d60df1909c7 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:37.971558 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-315286ab-6d07-44fb-a00f-9d60df1909c7 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:37.972342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-315286ab-6d07-44fb-a00f-9d60df1909c7 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:37.972824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-315286ab-6d07-44fb-a00f-9d60df1909c7 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:37.973279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-315286ab-6d07-44fb-a00f-9d60df1909c7 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:38.117511 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-315286ab-6d07-44fb-a00f-9d60df1909c7 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.170110 Aug 04 17:10:38.118339 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1881/3841] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Aug 4 17:10:37 2022] GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334/os-interface => generated 284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:10:38.123678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9c4537e3-2209-4b37-a2b0-69dc4bfd7cc2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:38.124506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9c4537e3-2209-4b37-a2b0-69dc4bfd7cc2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:38.140077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c4537e3-2209-4b37-a2b0-69dc4bfd7cc2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:38.140761 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c4537e3-2209-4b37-a2b0-69dc4bfd7cc2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:38.142420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c4537e3-2209-4b37-a2b0-69dc4bfd7cc2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:38.143946 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c4537e3-2209-4b37-a2b0-69dc4bfd7cc2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:38.150331 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c4537e3-2209-4b37-a2b0-69dc4bfd7cc2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:38.151017 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c4537e3-2209-4b37-a2b0-69dc4bfd7cc2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:38.212753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-86a797e4-f239-4b2a-b195-6a47f3a88ab3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:38.227838 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-86a797e4-f239-4b2a-b195-6a47f3a88ab3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1510 microversion: 2.1 time: 0.319566 Aug 04 17:10:38.228732 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1961/3842] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:37 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1510 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:38.300561 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cb37fa36-de5b-4f38-a46d-98b0a4730263 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:38.302133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cb37fa36-de5b-4f38-a46d-98b0a4730263 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:38.314180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb37fa36-de5b-4f38-a46d-98b0a4730263 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:38.314870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb37fa36-de5b-4f38-a46d-98b0a4730263 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:38.316394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb37fa36-de5b-4f38-a46d-98b0a4730263 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:38.320719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb37fa36-de5b-4f38-a46d-98b0a4730263 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:38.324266 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb37fa36-de5b-4f38-a46d-98b0a4730263 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:38.326024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb37fa36-de5b-4f38-a46d-98b0a4730263 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:38.493412 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cb37fa36-de5b-4f38-a46d-98b0a4730263 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:38.507093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cb37fa36-de5b-4f38-a46d-98b0a4730263 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:38.508889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cb37fa36-de5b-4f38-a46d-98b0a4730263 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:38.510341 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cb37fa36-de5b-4f38-a46d-98b0a4730263 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1364 microversion: 2.57 time: 0.215271 Aug 04 17:10:38.511156 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1962/3843] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:38 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:10:38.515830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5837eb95-dea6-4b84-9f0d-62f0de058585 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:38.516641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5837eb95-dea6-4b84-9f0d-62f0de058585 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 016fbd16-b01e-4ebf-ad2f-3495970feb96] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:38.530882 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5837eb95-dea6-4b84-9f0d-62f0de058585 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:38.531694 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5837eb95-dea6-4b84-9f0d-62f0de058585 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:38.532314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5837eb95-dea6-4b84-9f0d-62f0de058585 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:38.533855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5837eb95-dea6-4b84-9f0d-62f0de058585 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:38.534542 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5837eb95-dea6-4b84-9f0d-62f0de058585 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:38.534980 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5837eb95-dea6-4b84-9f0d-62f0de058585 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:38.545611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:38.603692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9c4537e3-2209-4b37-a2b0-69dc4bfd7cc2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:38.621086 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9c4537e3-2209-4b37-a2b0-69dc4bfd7cc2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1520 microversion: 2.1 time: 0.494760 Aug 04 17:10:38.622995 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1882/3844] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:38 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1520 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:38.638995 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-2c752fcb-05f9-4a7d-9953-e3c56af0b5f7 req-8ab2ac26-9fbb-4ace-8120-21c808b87cfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01c2f9e6-2bf7-4013-b254-0dac8e579962", "name": "network-vif-plugged", "status": "completed", "tag": "67f0534c-f1d3-4c4f-99d8-fed5bd714025"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:38.651779 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2c752fcb-05f9-4a7d-9953-e3c56af0b5f7 req-8ab2ac26-9fbb-4ace-8120-21c808b87cfb service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:38.652261 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2c752fcb-05f9-4a7d-9953-e3c56af0b5f7 req-8ab2ac26-9fbb-4ace-8120-21c808b87cfb service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:38.652691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2c752fcb-05f9-4a7d-9953-e3c56af0b5f7 req-8ab2ac26-9fbb-4ace-8120-21c808b87cfb service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:38.667030 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-2c752fcb-05f9-4a7d-9953-e3c56af0b5f7 req-8ab2ac26-9fbb-4ace-8120-21c808b87cfb service nova] Creating event network-vif-plugged:67f0534c-f1d3-4c4f-99d8-fed5bd714025 for instance 01c2f9e6-2bf7-4013-b254-0dac8e579962 on n-h1-851359-3 Aug 04 17:10:38.673153 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-2c752fcb-05f9-4a7d-9953-e3c56af0b5f7 req-8ab2ac26-9fbb-4ace-8120-21c808b87cfb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048753 Aug 04 17:10:38.673678 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1883/3845] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:10:38.703498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5837eb95-dea6-4b84-9f0d-62f0de058585 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:38.711151 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5837eb95-dea6-4b84-9f0d-62f0de058585 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96" status: 200 len: 1279 microversion: 2.1 time: 0.198824 Aug 04 17:10:38.712354 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1963/3846] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:38 2022] GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96 => generated 1279 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:38.967546 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fdf7b5f0-12f4-4b13-b4ab-6c8f4389804e tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:38.968566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fdf7b5f0-12f4-4b13-b4ab-6c8f4389804e tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] [instance: 20e4091a-1d92-475e-866b-46bd7e9ed57e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:38.975481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdf7b5f0-12f4-4b13-b4ab-6c8f4389804e tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:38.976038 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdf7b5f0-12f4-4b13-b4ab-6c8f4389804e tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:38.976733 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdf7b5f0-12f4-4b13-b4ab-6c8f4389804e tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:38.977504 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdf7b5f0-12f4-4b13-b4ab-6c8f4389804e tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:38.978201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdf7b5f0-12f4-4b13-b4ab-6c8f4389804e tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:38.978785 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdf7b5f0-12f4-4b13-b4ab-6c8f4389804e tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:39.252791 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e68f7e95-8933-46f4-9df9-90bab7951e8d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:39.253592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e68f7e95-8933-46f4-9df9-90bab7951e8d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:39.264514 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e68f7e95-8933-46f4-9df9-90bab7951e8d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:39.265072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e68f7e95-8933-46f4-9df9-90bab7951e8d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:39.266138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e68f7e95-8933-46f4-9df9-90bab7951e8d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:39.266873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e68f7e95-8933-46f4-9df9-90bab7951e8d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:39.267339 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e68f7e95-8933-46f4-9df9-90bab7951e8d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:39.267918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e68f7e95-8933-46f4-9df9-90bab7951e8d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:39.731712 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fdf7b5f0-12f4-4b13-b4ab-6c8f4389804e tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aafff9f4984e0dac87c362d3f1eeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada0dfbe888415881ee6cd85264ada7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:39.742419 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fdf7b5f0-12f4-4b13-b4ab-6c8f4389804e tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] 10.222.0.93 "GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e" status: 200 len: 1328 microversion: 2.1 time: 0.779436 Aug 04 17:10:39.756305 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1884/3847] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:38 2022] GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e => generated 1328 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:10:39.761951 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1e0cbe6d-2ab1-46e7-b7b5-c3b94ffef426 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:39.762950 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1e0cbe6d-2ab1-46e7-b7b5-c3b94ffef426 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:39.769239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e0cbe6d-2ab1-46e7-b7b5-c3b94ffef426 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:39.770258 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e0cbe6d-2ab1-46e7-b7b5-c3b94ffef426 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:39.771441 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e0cbe6d-2ab1-46e7-b7b5-c3b94ffef426 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:39.772240 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e0cbe6d-2ab1-46e7-b7b5-c3b94ffef426 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:39.772956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e0cbe6d-2ab1-46e7-b7b5-c3b94ffef426 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:39.773484 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e0cbe6d-2ab1-46e7-b7b5-c3b94ffef426 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:39.893429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1e0cbe6d-2ab1-46e7-b7b5-c3b94ffef426 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:39.906318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1e0cbe6d-2ab1-46e7-b7b5-c3b94ffef426 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:39.908566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1e0cbe6d-2ab1-46e7-b7b5-c3b94ffef426 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:39.911042 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1e0cbe6d-2ab1-46e7-b7b5-c3b94ffef426 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1364 microversion: 2.57 time: 0.153110 Aug 04 17:10:39.912813 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1885/3848] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:39 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:39.918297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2c7afa03-d972-4d37-85b6-540b8c5f0e55 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:39.918908 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2c7afa03-d972-4d37-85b6-540b8c5f0e55 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:39.925154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c7afa03-d972-4d37-85b6-540b8c5f0e55 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:39.925844 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c7afa03-d972-4d37-85b6-540b8c5f0e55 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:39.926469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c7afa03-d972-4d37-85b6-540b8c5f0e55 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:39.927346 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c7afa03-d972-4d37-85b6-540b8c5f0e55 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:39.928735 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c7afa03-d972-4d37-85b6-540b8c5f0e55 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:39.929389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c7afa03-d972-4d37-85b6-540b8c5f0e55 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:39.979469 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e68f7e95-8933-46f4-9df9-90bab7951e8d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:39.988907 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e68f7e95-8933-46f4-9df9-90bab7951e8d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1510 microversion: 2.1 time: 0.743779 Aug 04 17:10:39.990758 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1964/3849] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:39 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1510 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:39.996988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-79f64709-cae3-49c6-86dd-015e872842a6 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:39.997919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-79f64709-cae3-49c6-86dd-015e872842a6 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 016fbd16-b01e-4ebf-ad2f-3495970feb96] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:40.004215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79f64709-cae3-49c6-86dd-015e872842a6 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:40.005024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79f64709-cae3-49c6-86dd-015e872842a6 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:40.005760 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79f64709-cae3-49c6-86dd-015e872842a6 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:40.007278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79f64709-cae3-49c6-86dd-015e872842a6 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:40.008561 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79f64709-cae3-49c6-86dd-015e872842a6 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:40.009522 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79f64709-cae3-49c6-86dd-015e872842a6 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:40.072207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=4 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:40.103219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=14 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:40.141538 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-79f64709-cae3-49c6-86dd-015e872842a6 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:40.150277 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-79f64709-cae3-49c6-86dd-015e872842a6 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96" status: 200 len: 1279 microversion: 2.1 time: 0.157557 Aug 04 17:10:40.151280 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1965/3850] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:39 2022] GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96 => generated 1279 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:40.245776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2c7afa03-d972-4d37-85b6-540b8c5f0e55 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:40.259496 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2c7afa03-d972-4d37-85b6-540b8c5f0e55 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1520 microversion: 2.1 time: 0.342889 Aug 04 17:10:40.260674 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1886/3851] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:39 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1520 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:40.763782 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-07d64742-79eb-4bd7-8f8d-71d05b81cff1 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:40.764426 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-07d64742-79eb-4bd7-8f8d-71d05b81cff1 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] [instance: 20e4091a-1d92-475e-866b-46bd7e9ed57e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:40.782536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-07d64742-79eb-4bd7-8f8d-71d05b81cff1 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:40.783472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-07d64742-79eb-4bd7-8f8d-71d05b81cff1 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:40.784142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-07d64742-79eb-4bd7-8f8d-71d05b81cff1 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:40.784876 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-07d64742-79eb-4bd7-8f8d-71d05b81cff1 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:40.785346 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-07d64742-79eb-4bd7-8f8d-71d05b81cff1 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:40.785776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-07d64742-79eb-4bd7-8f8d-71d05b81cff1 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:41.230557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-07d64742-79eb-4bd7-8f8d-71d05b81cff1 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aafff9f4984e0dac87c362d3f1eeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada0dfbe888415881ee6cd85264ada7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:41.242446 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-07d64742-79eb-4bd7-8f8d-71d05b81cff1 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] 10.222.0.93 "GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e" status: 200 len: 1528 microversion: 2.1 time: 0.482448 Aug 04 17:10:41.254835 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1966/3852] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:40 2022] GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e => generated 1528 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:41.264940 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1e93292d-6067-4d3c-95c4-f9aa1e7f911b tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:41.265712 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1e93292d-6067-4d3c-95c4-f9aa1e7f911b tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:41.281346 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e93292d-6067-4d3c-95c4-f9aa1e7f911b tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:41.281870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e93292d-6067-4d3c-95c4-f9aa1e7f911b tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:41.283609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e93292d-6067-4d3c-95c4-f9aa1e7f911b tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:41.286538 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e93292d-6067-4d3c-95c4-f9aa1e7f911b tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:41.287668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e93292d-6067-4d3c-95c4-f9aa1e7f911b tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:41.288152 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e93292d-6067-4d3c-95c4-f9aa1e7f911b tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:41.331449 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-2ae57f00-12ca-4163-9b64-4a0a0aab1e10 req-eb34b728-7a85-4771-a99b-b889a5d075d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1af7e3f-723f-40e1-b968-bc7aeaa95334", "tag": "bf74ae8e-ca14-433b-901b-3ed2e54ec681"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:41.354502 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2ae57f00-12ca-4163-9b64-4a0a0aab1e10 req-eb34b728-7a85-4771-a99b-b889a5d075d1 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:41.355008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2ae57f00-12ca-4163-9b64-4a0a0aab1e10 req-eb34b728-7a85-4771-a99b-b889a5d075d1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:41.355445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2ae57f00-12ca-4163-9b64-4a0a0aab1e10 req-eb34b728-7a85-4771-a99b-b889a5d075d1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:41.400318 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-2ae57f00-12ca-4163-9b64-4a0a0aab1e10 req-eb34b728-7a85-4771-a99b-b889a5d075d1 service nova] Creating event network-changed:bf74ae8e-ca14-433b-901b-3ed2e54ec681 for instance b1af7e3f-723f-40e1-b968-bc7aeaa95334 on n-h2-851359-3 Aug 04 17:10:41.414815 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-2ae57f00-12ca-4163-9b64-4a0a0aab1e10 req-eb34b728-7a85-4771-a99b-b889a5d075d1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.575591 Aug 04 17:10:41.416639 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1887/3853] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:10:41.427037 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1e93292d-6067-4d3c-95c4-f9aa1e7f911b tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:41.431705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-344ca050-dc42-4f08-878a-b15f9ad7451c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:41.440333 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-344ca050-dc42-4f08-878a-b15f9ad7451c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:41.448235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1e93292d-6067-4d3c-95c4-f9aa1e7f911b tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:41.450139 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1e93292d-6067-4d3c-95c4-f9aa1e7f911b tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:41.451739 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1e93292d-6067-4d3c-95c4-f9aa1e7f911b tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1364 microversion: 2.57 time: 0.199636 Aug 04 17:10:41.452999 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1967/3854] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:41 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1364 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:41.457493 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:41.464537 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-344ca050-dc42-4f08-878a-b15f9ad7451c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:41.465026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-344ca050-dc42-4f08-878a-b15f9ad7451c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:41.465462 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-344ca050-dc42-4f08-878a-b15f9ad7451c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:41.466196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-344ca050-dc42-4f08-878a-b15f9ad7451c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:41.468827 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-344ca050-dc42-4f08-878a-b15f9ad7451c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:41.469276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-344ca050-dc42-4f08-878a-b15f9ad7451c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:41.492121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0d7e2319-ea39-4b0b-afd2-25b556b05810 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:41.493318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0d7e2319-ea39-4b0b-afd2-25b556b05810 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 016fbd16-b01e-4ebf-ad2f-3495970feb96] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:41.502401 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d7e2319-ea39-4b0b-afd2-25b556b05810 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:41.503236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d7e2319-ea39-4b0b-afd2-25b556b05810 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:41.504224 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d7e2319-ea39-4b0b-afd2-25b556b05810 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:41.505364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d7e2319-ea39-4b0b-afd2-25b556b05810 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:41.506899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d7e2319-ea39-4b0b-afd2-25b556b05810 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:41.507692 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d7e2319-ea39-4b0b-afd2-25b556b05810 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:41.760400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=22 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:42.031133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0d7e2319-ea39-4b0b-afd2-25b556b05810 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:42.044987 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0d7e2319-ea39-4b0b-afd2-25b556b05810 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96" status: 200 len: 1321 microversion: 2.1 time: 0.590689 Aug 04 17:10:42.045593 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1968/3855] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:41 2022] GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96 => generated 1321 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:42.058426 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-37dfe6ee-b49f-4488-a058-e33da1b91fe8 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:42.058426 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-37dfe6ee-b49f-4488-a058-e33da1b91fe8 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] [instance: 20e4091a-1d92-475e-866b-46bd7e9ed57e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:42.077003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37dfe6ee-b49f-4488-a058-e33da1b91fe8 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:42.077509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37dfe6ee-b49f-4488-a058-e33da1b91fe8 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:42.077959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37dfe6ee-b49f-4488-a058-e33da1b91fe8 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:42.078709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37dfe6ee-b49f-4488-a058-e33da1b91fe8 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:42.079176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37dfe6ee-b49f-4488-a058-e33da1b91fe8 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:42.079607 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37dfe6ee-b49f-4488-a058-e33da1b91fe8 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:42.176596 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-344ca050-dc42-4f08-878a-b15f9ad7451c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:42.186513 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-344ca050-dc42-4f08-878a-b15f9ad7451c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1510 microversion: 2.1 time: 0.765132 Aug 04 17:10:42.187827 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1888/3856] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:41 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1510 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:42.193834 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3b448a9f-0ed0-4783-afc7-93c3ebd039cd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:42.195069 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3b448a9f-0ed0-4783-afc7-93c3ebd039cd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:42.203159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b448a9f-0ed0-4783-afc7-93c3ebd039cd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:42.204130 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b448a9f-0ed0-4783-afc7-93c3ebd039cd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:42.204827 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b448a9f-0ed0-4783-afc7-93c3ebd039cd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:42.205862 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b448a9f-0ed0-4783-afc7-93c3ebd039cd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:42.206575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b448a9f-0ed0-4783-afc7-93c3ebd039cd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:42.207305 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b448a9f-0ed0-4783-afc7-93c3ebd039cd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:42.459860 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-37dfe6ee-b49f-4488-a058-e33da1b91fe8 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aafff9f4984e0dac87c362d3f1eeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada0dfbe888415881ee6cd85264ada7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:42.469826 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-37dfe6ee-b49f-4488-a058-e33da1b91fe8 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] 10.222.0.93 "GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e" status: 200 len: 1528 microversion: 2.1 time: 0.423099 Aug 04 17:10:42.470648 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1969/3857] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:42 2022] GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e => generated 1528 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:42.477201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-9aee9dbd-1f45-48b6-be5b-b89a756f3621 req-0972d788-aae4-4749-9b12-6485a3c0e2e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e67fc2ff-0549-433f-9385-cc71740b93c4", "tag": "50db24c4-a63b-4eaa-a3aa-9b7c1c1dadd4"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:42.486840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:42.489737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3b448a9f-0ed0-4783-afc7-93c3ebd039cd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:42.490506 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9aee9dbd-1f45-48b6-be5b-b89a756f3621 req-0972d788-aae4-4749-9b12-6485a3c0e2e5 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:42.491233 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9aee9dbd-1f45-48b6-be5b-b89a756f3621 req-0972d788-aae4-4749-9b12-6485a3c0e2e5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:42.492100 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9aee9dbd-1f45-48b6-be5b-b89a756f3621 req-0972d788-aae4-4749-9b12-6485a3c0e2e5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:42.499387 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3b448a9f-0ed0-4783-afc7-93c3ebd039cd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1500 microversion: 2.1 time: 0.309034 Aug 04 17:10:42.500253 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1889/3858] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:42 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1500 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:42.506721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ef9caa6b-87e3-4293-aa82-3a4ab7de9c1c tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:42.507337 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ef9caa6b-87e3-4293-aa82-3a4ab7de9c1c tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:42.524070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef9caa6b-87e3-4293-aa82-3a4ab7de9c1c tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:42.526080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef9caa6b-87e3-4293-aa82-3a4ab7de9c1c tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:42.531151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef9caa6b-87e3-4293-aa82-3a4ab7de9c1c tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:42.532404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef9caa6b-87e3-4293-aa82-3a4ab7de9c1c tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:42.533271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef9caa6b-87e3-4293-aa82-3a4ab7de9c1c tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:42.534032 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef9caa6b-87e3-4293-aa82-3a4ab7de9c1c tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:42.560375 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-9aee9dbd-1f45-48b6-be5b-b89a756f3621 req-0972d788-aae4-4749-9b12-6485a3c0e2e5 service nova] Creating event network-changed:50db24c4-a63b-4eaa-a3aa-9b7c1c1dadd4 for instance e67fc2ff-0549-433f-9385-cc71740b93c4 on n-h2-851359-3 Aug 04 17:10:42.576640 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-9aee9dbd-1f45-48b6-be5b-b89a756f3621 req-0972d788-aae4-4749-9b12-6485a3c0e2e5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103496 Aug 04 17:10:42.578141 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1970/3859] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:10:42.647896 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ef9caa6b-87e3-4293-aa82-3a4ab7de9c1c tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:42.660598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ef9caa6b-87e3-4293-aa82-3a4ab7de9c1c tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:42.662396 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ef9caa6b-87e3-4293-aa82-3a4ab7de9c1c tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:42.663888 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ef9caa6b-87e3-4293-aa82-3a4ab7de9c1c tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1364 microversion: 2.57 time: 0.162575 Aug 04 17:10:42.664749 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1890/3860] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:42 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:42.670103 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-797574a2-36ec-4577-a920-4b5f0348612c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:42.671029 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-797574a2-36ec-4577-a920-4b5f0348612c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:42.680271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-797574a2-36ec-4577-a920-4b5f0348612c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:42.681061 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-797574a2-36ec-4577-a920-4b5f0348612c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:42.681843 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-797574a2-36ec-4577-a920-4b5f0348612c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:42.682936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-797574a2-36ec-4577-a920-4b5f0348612c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:42.683840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-797574a2-36ec-4577-a920-4b5f0348612c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:42.684459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-797574a2-36ec-4577-a920-4b5f0348612c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:42.853729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-94d4ac27-a85f-4d5d-bcb5-a29d7f43bc02 tempest-ServersNegativeTestMultiTenantJSON-427530487 tempest-ServersNegativeTestMultiTenantJSON-427530487-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:42.854442 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-94d4ac27-a85f-4d5d-bcb5-a29d7f43bc02 tempest-ServersNegativeTestMultiTenantJSON-427530487 tempest-ServersNegativeTestMultiTenantJSON-427530487-project] [instance: 20e4091a-1d92-475e-866b-46bd7e9ed57e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:42.860824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-797574a2-36ec-4577-a920-4b5f0348612c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:42.864185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94d4ac27-a85f-4d5d-bcb5-a29d7f43bc02 tempest-ServersNegativeTestMultiTenantJSON-427530487 tempest-ServersNegativeTestMultiTenantJSON-427530487-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:42.866069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94d4ac27-a85f-4d5d-bcb5-a29d7f43bc02 tempest-ServersNegativeTestMultiTenantJSON-427530487 tempest-ServersNegativeTestMultiTenantJSON-427530487-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:42.866909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94d4ac27-a85f-4d5d-bcb5-a29d7f43bc02 tempest-ServersNegativeTestMultiTenantJSON-427530487 tempest-ServersNegativeTestMultiTenantJSON-427530487-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:42.867889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94d4ac27-a85f-4d5d-bcb5-a29d7f43bc02 tempest-ServersNegativeTestMultiTenantJSON-427530487 tempest-ServersNegativeTestMultiTenantJSON-427530487-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:42.868609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94d4ac27-a85f-4d5d-bcb5-a29d7f43bc02 tempest-ServersNegativeTestMultiTenantJSON-427530487 tempest-ServersNegativeTestMultiTenantJSON-427530487-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:42.869500 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94d4ac27-a85f-4d5d-bcb5-a29d7f43bc02 tempest-ServersNegativeTestMultiTenantJSON-427530487 tempest-ServersNegativeTestMultiTenantJSON-427530487-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:42.872017 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-797574a2-36ec-4577-a920-4b5f0348612c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 200 len: 1516 microversion: 2.1 time: 0.205354 Aug 04 17:10:42.873017 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1891/3861] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:42 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 1516 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:42.895718 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e1f0beca-8d78-4f24-a02f-516fcddb37fd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:42.898604 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-94d4ac27-a85f-4d5d-bcb5-a29d7f43bc02 tempest-ServersNegativeTestMultiTenantJSON-427530487 tempest-ServersNegativeTestMultiTenantJSON-427530487-project] HTTP exception thrown: Instance 20e4091a-1d92-475e-866b-46bd7e9ed57e could not be found. Aug 04 17:10:42.900009 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e1f0beca-8d78-4f24-a02f-516fcddb37fd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: ae028846-2ee0-4d13-8e16-caa7ab9762a6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-94d4ac27-a85f-4d5d-bcb5-a29d7f43bc02 tempest-ServersNegativeTestMultiTenantJSON-427530487 tempest-ServersNegativeTestMultiTenantJSON-427530487-project] Request method failure captured: Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e HTTP/1.1 Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_1_OuXabOW6zlOtGHgdE9BouMgeYBqjDkjj1KkJNt4ZBYmBP_37rUNRBKeqt386ykuEJFTY4cdl_4hLTlz7_0hbDtJ1txSLtmj3StX0hhnEcxCYIqGZKsM9HKpH-D1KVJBr6gj9lY-QBAE_mzmvZrAYE7z47_4BgUVCvNMag6TGW-c Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: b353ebbfb8494a7696eda056213b83d6 Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-427530487 Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b353ebbfb8494a7696eda056213b83d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b353ebbfb8494a7696eda056213b83d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b353ebbfb8494a7696eda056213b83d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b353ebbfb8494a7696eda056213b83d6"}]}] Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-427530487 Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: b353ebbfb8494a7696eda056213b83d6 Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-427530487 Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersNegativeTestMultiTenantJSON-427530487-project Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 4bdb413ea7454d2faf22c8cc557c1107 Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-427530487-project Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 20e4091a-1d92-475e-866b-46bd7e9ed57e could not be found. Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '20e4091a-1d92-475e-866b-46bd7e9ed57e'} Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20e4091a-1d92-475e-866b-46bd7e9ed57e could not be found. Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:10:42.900936 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:10:42.905658 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20e4091a-1d92-475e-866b-46bd7e9ed57e could not be found. Aug 04 17:10:42.905658 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:42.905658 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:10:42.905658 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:42.905658 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:42.905658 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:10:42.905658 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:10:42.905658 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:10:42.905658 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:10:42.905658 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20e4091a-1d92-475e-866b-46bd7e9ed57e could not be found. Aug 04 17:10:42.905658 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:42.906460 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-e1f0beca-8d78-4f24-a02f-516fcddb37fd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] HTTP exception thrown: Instance ae028846-2ee0-4d13-8e16-caa7ab9762a6 could not be found. Aug 04 17:10:42.914254 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-94d4ac27-a85f-4d5d-bcb5-a29d7f43bc02 tempest-ServersNegativeTestMultiTenantJSON-427530487 tempest-ServersNegativeTestMultiTenantJSON-427530487-project] Returning 404 to user: Instance 20e4091a-1d92-475e-866b-46bd7e9ed57e could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:10:42.915420 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-94d4ac27-a85f-4d5d-bcb5-a29d7f43bc02 tempest-ServersNegativeTestMultiTenantJSON-427530487 tempest-ServersNegativeTestMultiTenantJSON-427530487-project] 10.222.0.93 "DELETE /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e" status: 404 len: 111 microversion: 2.1 time: 0.333661 Aug 04 17:10:42.916764 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1971/3862] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:10:42 2022] DELETE /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e => generated 111 bytes in 336 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e1f0beca-8d78-4f24-a02f-516fcddb37fd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Request method failure captured: Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/ae028846-2ee0-4d13-8e16-caa7ab9762a6/action HTTP/1.1 Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 14 Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_1KcpG4juUr2VEfzShlgrBBMonXazIZnBtgobublSG0FrbL-f6glawbXIezuRVmeGIpCPKZ2_FVYi6XXX8bEGfzlmqPmHXf6Tacw6jDfV9QuP1xJWCSlbaybEtYK4vIloCt34qv4iEL4IzCpH1AIgjNgga3059ie-t_wAucPvDkWig Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 50d2f7cd670340adb1b4187754e302c5 Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1121530457 Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/50d2f7cd670340adb1b4187754e302c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/50d2f7cd670340adb1b4187754e302c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_50d2f7cd670340adb1b4187754e302c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/50d2f7cd670340adb1b4187754e302c5"}]}] Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1121530457 Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 50d2f7cd670340adb1b4187754e302c5 Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1121530457 Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServerRescueNegativeTestJSON-1121530457-project Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 067e98d624234a48bb0ea3bde77c049c Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1121530457-project Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: {"rescue": {}} Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance ae028846-2ee0-4d13-8e16-caa7ab9762a6 could not be found. Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'ae028846-2ee0-4d13-8e16-caa7ab9762a6', 'body': {'rescue': {}}} Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae028846-2ee0-4d13-8e16-caa7ab9762a6 could not be found. Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae028846-2ee0-4d13-8e16-caa7ab9762a6 could not be found. Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:10:42.918710 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:42.923880 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:10:42.923880 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:10:42.923880 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:10:42.923880 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:10:42.923880 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae028846-2ee0-4d13-8e16-caa7ab9762a6 could not be found. Aug 04 17:10:42.923880 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:10:42.923880 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e1f0beca-8d78-4f24-a02f-516fcddb37fd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Returning 404 to user: Instance ae028846-2ee0-4d13-8e16-caa7ab9762a6 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:10:42.923880 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e1f0beca-8d78-4f24-a02f-516fcddb37fd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "POST /compute/v2.1/servers/ae028846-2ee0-4d13-8e16-caa7ab9762a6/action" status: 404 len: 111 microversion: 2.1 time: 0.030069 Aug 04 17:10:42.923880 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1892/3863] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:10:42 2022] POST /compute/v2.1/servers/ae028846-2ee0-4d13-8e16-caa7ab9762a6/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:10:42.934002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b4f666e7-c105-4ca5-b890-37f4651555bf tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:42.934283 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-928004e2-bd41-4589-a633-a640ce051f0b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:42.934832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-928004e2-bd41-4589-a633-a640ce051f0b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:42.935419 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b4f666e7-c105-4ca5-b890-37f4651555bf tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] [instance: 20e4091a-1d92-475e-866b-46bd7e9ed57e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:42.942617 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-928004e2-bd41-4589-a633-a640ce051f0b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:42.943824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-928004e2-bd41-4589-a633-a640ce051f0b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:42.944314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-928004e2-bd41-4589-a633-a640ce051f0b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:42.944898 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b4f666e7-c105-4ca5-b890-37f4651555bf tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:42.945054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-928004e2-bd41-4589-a633-a640ce051f0b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:42.945470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-928004e2-bd41-4589-a633-a640ce051f0b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:42.945605 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b4f666e7-c105-4ca5-b890-37f4651555bf tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:42.945902 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-928004e2-bd41-4589-a633-a640ce051f0b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:42.946266 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b4f666e7-c105-4ca5-b890-37f4651555bf tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:42.950430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b4f666e7-c105-4ca5-b890-37f4651555bf tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:42.950931 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b4f666e7-c105-4ca5-b890-37f4651555bf tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:42.951394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b4f666e7-c105-4ca5-b890-37f4651555bf tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:43.022846 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-928004e2-bd41-4589-a633-a640ce051f0b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "POST /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb/action" status: 202 len: 0 microversion: 2.1 time: 0.092630 Aug 04 17:10:43.023486 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1893/3864] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:10:42 2022] POST /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:10:43.034214 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-179a21c8-6e6e-4c7b-8617-97ef3794c6d8 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:43.035354 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-179a21c8-6e6e-4c7b-8617-97ef3794c6d8 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:43.042622 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-179a21c8-6e6e-4c7b-8617-97ef3794c6d8 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:43.043460 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-179a21c8-6e6e-4c7b-8617-97ef3794c6d8 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:43.044259 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-179a21c8-6e6e-4c7b-8617-97ef3794c6d8 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:43.045141 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-179a21c8-6e6e-4c7b-8617-97ef3794c6d8 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:43.045788 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-179a21c8-6e6e-4c7b-8617-97ef3794c6d8 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:43.046538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-179a21c8-6e6e-4c7b-8617-97ef3794c6d8 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:43.159855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b4f666e7-c105-4ca5-b890-37f4651555bf tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aafff9f4984e0dac87c362d3f1eeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada0dfbe888415881ee6cd85264ada7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:43.167724 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b4f666e7-c105-4ca5-b890-37f4651555bf tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] 10.222.0.93 "GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e" status: 200 len: 1528 microversion: 2.1 time: 0.237931 Aug 04 17:10:43.168306 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1972/3865] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:42 2022] GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e => generated 1528 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:43.187970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6e46c23d-ecce-4ea5-bc0b-9cb14e383a5a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:43.189225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6e46c23d-ecce-4ea5-bc0b-9cb14e383a5a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 016fbd16-b01e-4ebf-ad2f-3495970feb96] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:43.197093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6e46c23d-ecce-4ea5-bc0b-9cb14e383a5a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:43.197857 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6e46c23d-ecce-4ea5-bc0b-9cb14e383a5a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:43.198521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6e46c23d-ecce-4ea5-bc0b-9cb14e383a5a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:43.199893 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6e46c23d-ecce-4ea5-bc0b-9cb14e383a5a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:43.200491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6e46c23d-ecce-4ea5-bc0b-9cb14e383a5a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:43.201121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6e46c23d-ecce-4ea5-bc0b-9cb14e383a5a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:43.221692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-179a21c8-6e6e-4c7b-8617-97ef3794c6d8 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:43.231531 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-179a21c8-6e6e-4c7b-8617-97ef3794c6d8 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 200 len: 1521 microversion: 2.1 time: 0.203412 Aug 04 17:10:43.232357 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1894/3866] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:43 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:10:43.237867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d78b63fd-bd58-45e3-96ae-1c562b76472f tempest-ServersNegativeTestMultiTenantJSON-427530487 tempest-ServersNegativeTestMultiTenantJSON-427530487-project] Action: 'update', calling method: >, body: {"server": {"name": "20e4091a-1d92-475e-866b-46bd7e9ed57e_new"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:43.241714 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d78b63fd-bd58-45e3-96ae-1c562b76472f tempest-ServersNegativeTestMultiTenantJSON-427530487 tempest-ServersNegativeTestMultiTenantJSON-427530487-project] [instance: 20e4091a-1d92-475e-866b-46bd7e9ed57e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:43.251607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d78b63fd-bd58-45e3-96ae-1c562b76472f tempest-ServersNegativeTestMultiTenantJSON-427530487 tempest-ServersNegativeTestMultiTenantJSON-427530487-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:43.252522 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d78b63fd-bd58-45e3-96ae-1c562b76472f tempest-ServersNegativeTestMultiTenantJSON-427530487 tempest-ServersNegativeTestMultiTenantJSON-427530487-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:43.253199 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d78b63fd-bd58-45e3-96ae-1c562b76472f tempest-ServersNegativeTestMultiTenantJSON-427530487 tempest-ServersNegativeTestMultiTenantJSON-427530487-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:43.254510 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d78b63fd-bd58-45e3-96ae-1c562b76472f tempest-ServersNegativeTestMultiTenantJSON-427530487 tempest-ServersNegativeTestMultiTenantJSON-427530487-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:43.256580 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d78b63fd-bd58-45e3-96ae-1c562b76472f tempest-ServersNegativeTestMultiTenantJSON-427530487 tempest-ServersNegativeTestMultiTenantJSON-427530487-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:43.257351 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d78b63fd-bd58-45e3-96ae-1c562b76472f tempest-ServersNegativeTestMultiTenantJSON-427530487 tempest-ServersNegativeTestMultiTenantJSON-427530487-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:43.276964 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-d78b63fd-bd58-45e3-96ae-1c562b76472f tempest-ServersNegativeTestMultiTenantJSON-427530487 tempest-ServersNegativeTestMultiTenantJSON-427530487-project] HTTP exception thrown: Instance 20e4091a-1d92-475e-866b-46bd7e9ed57e could not be found. Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d78b63fd-bd58-45e3-96ae-1c562b76472f tempest-ServersNegativeTestMultiTenantJSON-427530487 tempest-ServersNegativeTestMultiTenantJSON-427530487-project] Request method failure captured: Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: request: PUT /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e HTTP/1.1 Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 64 Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_1_OuXabOW6zlOtGHgdE9BouMgeYBqjDkjj1KkJNt4ZBYmBP_37rUNRBKeqt386ykuEJFTY4cdl_4hLTlz7_0hbDtJ1txSLtmj3StX0hhnEcxCYIqGZKsM9HKpH-D1KVJBr6gj9lY-QBAE_mzmvZrAYE7z47_4BgUVCvNMag6TGW-c Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: b353ebbfb8494a7696eda056213b83d6 Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-427530487 Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b353ebbfb8494a7696eda056213b83d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/b353ebbfb8494a7696eda056213b83d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_b353ebbfb8494a7696eda056213b83d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/b353ebbfb8494a7696eda056213b83d6"}]}] Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-427530487 Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: b353ebbfb8494a7696eda056213b83d6 Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-427530487 Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestMultiTenantJSON-427530487-project Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 4bdb413ea7454d2faf22c8cc557c1107 Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-427530487-project Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: {"server": {"name": "20e4091a-1d92-475e-866b-46bd7e9ed57e_new"}} Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 20e4091a-1d92-475e-866b-46bd7e9ed57e could not be found. Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '20e4091a-1d92-475e-866b-46bd7e9ed57e', 'body': {'server': {'name': '20e4091a-1d92-475e-866b-46bd7e9ed57e_new'}}} Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20e4091a-1d92-475e-866b-46bd7e9ed57e could not be found. Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:10:43.279961 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 04 17:10:43.286685 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 04 17:10:43.286685 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 04 17:10:43.286685 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:10:43.286685 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:10:43.286685 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:10:43.286685 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:10:43.286685 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20e4091a-1d92-475e-866b-46bd7e9ed57e could not be found. Aug 04 17:10:43.286685 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:10:43.286685 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:10:43.286685 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:10:43.286685 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:43.286685 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:10:43.286685 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:10:43.286685 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:10:43.286685 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:10:43.286685 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20e4091a-1d92-475e-866b-46bd7e9ed57e could not be found. Aug 04 17:10:43.286685 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:10:43.286685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d78b63fd-bd58-45e3-96ae-1c562b76472f tempest-ServersNegativeTestMultiTenantJSON-427530487 tempest-ServersNegativeTestMultiTenantJSON-427530487-project] Returning 404 to user: Instance 20e4091a-1d92-475e-866b-46bd7e9ed57e could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:10:43.286685 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d78b63fd-bd58-45e3-96ae-1c562b76472f tempest-ServersNegativeTestMultiTenantJSON-427530487 tempest-ServersNegativeTestMultiTenantJSON-427530487-project] 10.222.0.93 "PUT /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e" status: 404 len: 111 microversion: 2.1 time: 0.048630 Aug 04 17:10:43.286685 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1895/3867] 10.222.0.93 () {60 vars in 1256 bytes} [Thu Aug 4 17:10:43 2022] PUT /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:10:43.294742 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d55b8c7e-3a5b-4e19-bb25-ff444d728434 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:43.295371 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d55b8c7e-3a5b-4e19-bb25-ff444d728434 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:43.303055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d55b8c7e-3a5b-4e19-bb25-ff444d728434 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:43.303621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d55b8c7e-3a5b-4e19-bb25-ff444d728434 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:43.304067 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d55b8c7e-3a5b-4e19-bb25-ff444d728434 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:43.304779 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d55b8c7e-3a5b-4e19-bb25-ff444d728434 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:43.305247 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d55b8c7e-3a5b-4e19-bb25-ff444d728434 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:43.305671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d55b8c7e-3a5b-4e19-bb25-ff444d728434 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:43.454089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6e46c23d-ecce-4ea5-bc0b-9cb14e383a5a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:43.461729 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6e46c23d-ecce-4ea5-bc0b-9cb14e383a5a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96" status: 200 len: 1321 microversion: 2.1 time: 0.278051 Aug 04 17:10:43.474208 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1973/3868] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:43 2022] GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96 => generated 1321 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:43.474208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-98df7719-80ac-4f3e-9f62-58f1feccd210 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:43.474208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-98df7719-80ac-4f3e-9f62-58f1feccd210 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] [instance: 20e4091a-1d92-475e-866b-46bd7e9ed57e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:43.474208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98df7719-80ac-4f3e-9f62-58f1feccd210 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:43.474208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98df7719-80ac-4f3e-9f62-58f1feccd210 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:43.474208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98df7719-80ac-4f3e-9f62-58f1feccd210 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:43.475434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98df7719-80ac-4f3e-9f62-58f1feccd210 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:43.475885 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98df7719-80ac-4f3e-9f62-58f1feccd210 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:43.476524 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98df7719-80ac-4f3e-9f62-58f1feccd210 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:43.503202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-98df7719-80ac-4f3e-9f62-58f1feccd210 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] [instance: 20e4091a-1d92-475e-866b-46bd7e9ed57e] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:10:43.507471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d55b8c7e-3a5b-4e19-bb25-ff444d728434 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:43.517321 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d55b8c7e-3a5b-4e19-bb25-ff444d728434 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1510 microversion: 2.1 time: 0.226322 Aug 04 17:10:43.522302 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1896/3869] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:43 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1510 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:43.527280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-449446ff-2ed0-478b-bf20-ddf5049e0c91 req-c0d63f5f-ac55-42bf-bed3-7a9a115daebd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "016fbd16-b01e-4ebf-ad2f-3495970feb96", "tag": "421a0ea1-5687-4e41-8da8-9b1d6e68d02d"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:43.540548 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-449446ff-2ed0-478b-bf20-ddf5049e0c91 req-c0d63f5f-ac55-42bf-bed3-7a9a115daebd service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:43.541239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-449446ff-2ed0-478b-bf20-ddf5049e0c91 req-c0d63f5f-ac55-42bf-bed3-7a9a115daebd service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:43.541675 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-449446ff-2ed0-478b-bf20-ddf5049e0c91 req-c0d63f5f-ac55-42bf-bed3-7a9a115daebd service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:43.554087 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-449446ff-2ed0-478b-bf20-ddf5049e0c91 req-c0d63f5f-ac55-42bf-bed3-7a9a115daebd service nova] Creating event network-changed:421a0ea1-5687-4e41-8da8-9b1d6e68d02d for instance 016fbd16-b01e-4ebf-ad2f-3495970feb96 on n-h2-851359-3 Aug 04 17:10:43.558999 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-449446ff-2ed0-478b-bf20-ddf5049e0c91 req-c0d63f5f-ac55-42bf-bed3-7a9a115daebd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035375 Aug 04 17:10:43.559595 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1897/3870] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:10:43.583965 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-98df7719-80ac-4f3e-9f62-58f1feccd210 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] 10.222.0.93 "DELETE /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e" status: 204 len: 0 microversion: 2.1 time: 0.120177 Aug 04 17:10:43.584776 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1974/3871] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:10:43 2022] DELETE /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:10:43.593719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1b2f918b-44a8-4ae3-9e44-318354db4f21 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:43.594746 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1b2f918b-44a8-4ae3-9e44-318354db4f21 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] [instance: 20e4091a-1d92-475e-866b-46bd7e9ed57e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:43.601915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b2f918b-44a8-4ae3-9e44-318354db4f21 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:43.602485 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b2f918b-44a8-4ae3-9e44-318354db4f21 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:43.602933 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b2f918b-44a8-4ae3-9e44-318354db4f21 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:43.603743 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b2f918b-44a8-4ae3-9e44-318354db4f21 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:43.604231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b2f918b-44a8-4ae3-9e44-318354db4f21 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:43.604661 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b2f918b-44a8-4ae3-9e44-318354db4f21 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:43.688620 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-70e9ee31-bcf8-438c-a80a-faa11fc1c7a9 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:43.689330 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-70e9ee31-bcf8-438c-a80a-faa11fc1c7a9 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:43.695679 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70e9ee31-bcf8-438c-a80a-faa11fc1c7a9 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:43.696388 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70e9ee31-bcf8-438c-a80a-faa11fc1c7a9 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:43.696987 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70e9ee31-bcf8-438c-a80a-faa11fc1c7a9 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:43.697575 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70e9ee31-bcf8-438c-a80a-faa11fc1c7a9 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:43.698062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70e9ee31-bcf8-438c-a80a-faa11fc1c7a9 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:43.698493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70e9ee31-bcf8-438c-a80a-faa11fc1c7a9 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:43.753899 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1b2f918b-44a8-4ae3-9e44-318354db4f21 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aafff9f4984e0dac87c362d3f1eeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada0dfbe888415881ee6cd85264ada7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:43.772248 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1b2f918b-44a8-4ae3-9e44-318354db4f21 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] 10.222.0.93 "GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e" status: 200 len: 1534 microversion: 2.1 time: 0.182343 Aug 04 17:10:43.772921 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1898/3872] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:43 2022] GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e => generated 1534 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:43.773224 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-70e9ee31-bcf8-438c-a80a-faa11fc1c7a9 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:43.782693 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-70e9ee31-bcf8-438c-a80a-faa11fc1c7a9 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:43.784204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-70e9ee31-bcf8-438c-a80a-faa11fc1c7a9 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:43.785760 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-70e9ee31-bcf8-438c-a80a-faa11fc1c7a9 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1364 microversion: 2.57 time: 0.102318 Aug 04 17:10:43.786473 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1975/3873] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:43 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1364 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:10:44.252499 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5defebf5-63fe-4868-9761-4a7160bd900c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:44.253150 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5defebf5-63fe-4868-9761-4a7160bd900c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:44.260747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5defebf5-63fe-4868-9761-4a7160bd900c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:44.261233 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5defebf5-63fe-4868-9761-4a7160bd900c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:44.261676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5defebf5-63fe-4868-9761-4a7160bd900c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:44.262399 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5defebf5-63fe-4868-9761-4a7160bd900c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:44.262858 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5defebf5-63fe-4868-9761-4a7160bd900c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:44.263508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5defebf5-63fe-4868-9761-4a7160bd900c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:44.267943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:44.405729 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5defebf5-63fe-4868-9761-4a7160bd900c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:44.413680 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5defebf5-63fe-4868-9761-4a7160bd900c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 200 len: 1501 microversion: 2.1 time: 0.165046 Aug 04 17:10:44.414283 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1899/3874] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:44 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 1501 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:44.435408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cd1a6aa3-1517-4b3a-8228-d11a30e65905 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:44.438678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cd1a6aa3-1517-4b3a-8228-d11a30e65905 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:44.447765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd1a6aa3-1517-4b3a-8228-d11a30e65905 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:44.448932 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd1a6aa3-1517-4b3a-8228-d11a30e65905 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:44.449751 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd1a6aa3-1517-4b3a-8228-d11a30e65905 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:44.451231 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd1a6aa3-1517-4b3a-8228-d11a30e65905 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:44.452215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd1a6aa3-1517-4b3a-8228-d11a30e65905 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:44.452664 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd1a6aa3-1517-4b3a-8228-d11a30e65905 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:44.485659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-cd1a6aa3-1517-4b3a-8228-d11a30e65905 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lazy-loading 'flavor' on Instance uuid 930cda99-f658-44c9-bb85-da349e9e5aeb {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:10:44.487288 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4f70ad77-0833-464b-8122-e8e393aa14d1 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:44.488121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4f70ad77-0833-464b-8122-e8e393aa14d1 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 016fbd16-b01e-4ebf-ad2f-3495970feb96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:44.495435 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f70ad77-0833-464b-8122-e8e393aa14d1 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:44.496097 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f70ad77-0833-464b-8122-e8e393aa14d1 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:44.496728 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f70ad77-0833-464b-8122-e8e393aa14d1 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:44.497678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f70ad77-0833-464b-8122-e8e393aa14d1 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:44.498408 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f70ad77-0833-464b-8122-e8e393aa14d1 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:44.499422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f70ad77-0833-464b-8122-e8e393aa14d1 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:44.503228 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-cd1a6aa3-1517-4b3a-8228-d11a30e65905 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] HTTP exception thrown: Cannot 'rescue' instance 930cda99-f658-44c9-bb85-da349e9e5aeb while it is in vm_state paused Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cd1a6aa3-1517-4b3a-8228-d11a30e65905 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Request method failure captured: Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb/action HTTP/1.1 Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 14 Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_1KcpG4juUr2VEfzShlgrBBMonXazIZnBtgobublSG0FrbL-f6glawbXIezuRVmeGIpCPKZ2_FVYi6XXX8bEGfzlmqPmHXf6Tacw6jDfV9QuP1xJWCSlbaybEtYK4vIloCt34qv4iEL4IzCpH1AIgjNgga3059ie-t_wAucPvDkWig Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 50d2f7cd670340adb1b4187754e302c5 Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1121530457 Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/50d2f7cd670340adb1b4187754e302c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/50d2f7cd670340adb1b4187754e302c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_50d2f7cd670340adb1b4187754e302c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/50d2f7cd670340adb1b4187754e302c5"}]}] Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1121530457 Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 50d2f7cd670340adb1b4187754e302c5 Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1121530457 Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerRescueNegativeTestJSON-1121530457-project Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 067e98d624234a48bb0ea3bde77c049c Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1121530457-project Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: {"rescue": {}} Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: exception: Cannot 'rescue' instance 930cda99-f658-44c9-bb85-da349e9e5aeb while it is in vm_state paused Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '930cda99-f658-44c9-bb85-da349e9e5aeb', 'body': {'rescue': {}}} Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 930cda99-f658-44c9-bb85-da349e9e5aeb in vm_state paused. Cannot rescue while the instance is in this state. Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 930cda99-f658-44c9-bb85-da349e9e5aeb while it is in vm_state paused Aug 04 17:10:44.506613 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:44.512205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:10:44.512205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:44.512205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:44.512205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:10:44.512205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:10:44.512205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:10:44.512205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:10:44.512205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 930cda99-f658-44c9-bb85-da349e9e5aeb while it is in vm_state paused Aug 04 17:10:44.512205 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:10:44.512205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cd1a6aa3-1517-4b3a-8228-d11a30e65905 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Returning 409 to user: Cannot 'rescue' instance 930cda99-f658-44c9-bb85-da349e9e5aeb while it is in vm_state paused {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:10:44.512205 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cd1a6aa3-1517-4b3a-8228-d11a30e65905 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "POST /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb/action" status: 409 len: 144 microversion: 2.1 time: 0.077437 Aug 04 17:10:44.512205 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1976/3875] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:10:44 2022] POST /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb/action => generated 144 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:10:44.521298 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-98d4c514-4192-4b9c-8296-e663b11543d0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:44.521931 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-98d4c514-4192-4b9c-8296-e663b11543d0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:44.528120 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98d4c514-4192-4b9c-8296-e663b11543d0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:44.528704 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98d4c514-4192-4b9c-8296-e663b11543d0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:44.529223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98d4c514-4192-4b9c-8296-e663b11543d0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:44.530238 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98d4c514-4192-4b9c-8296-e663b11543d0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:44.530983 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98d4c514-4192-4b9c-8296-e663b11543d0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:44.531623 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98d4c514-4192-4b9c-8296-e663b11543d0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:44.611304 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-98d4c514-4192-4b9c-8296-e663b11543d0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "POST /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb/action" status: 202 len: 0 microversion: 2.1 time: 0.096274 Aug 04 17:10:44.611977 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1977/3876] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:10:44 2022] POST /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:10:44.625781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2be77313-f7ad-40eb-a756-2a91404e5a97 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:44.626612 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2be77313-f7ad-40eb-a756-2a91404e5a97 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:44.633204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2be77313-f7ad-40eb-a756-2a91404e5a97 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:44.633936 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2be77313-f7ad-40eb-a756-2a91404e5a97 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:44.634724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2be77313-f7ad-40eb-a756-2a91404e5a97 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:44.635634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2be77313-f7ad-40eb-a756-2a91404e5a97 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:44.636290 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2be77313-f7ad-40eb-a756-2a91404e5a97 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:44.636891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2be77313-f7ad-40eb-a756-2a91404e5a97 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:44.657717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:44.675338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4f70ad77-0833-464b-8122-e8e393aa14d1 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:44.685230 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4f70ad77-0833-464b-8122-e8e393aa14d1 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96" status: 200 len: 1321 microversion: 2.1 time: 0.203998 Aug 04 17:10:44.685921 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1900/3877] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:44 2022] GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96 => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:44.692406 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-02601c62-bd30-412d-b342-3fb3d175d1c5 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:44.693364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-02601c62-bd30-412d-b342-3fb3d175d1c5 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:44.700117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02601c62-bd30-412d-b342-3fb3d175d1c5 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:44.700694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02601c62-bd30-412d-b342-3fb3d175d1c5 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:44.703023 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02601c62-bd30-412d-b342-3fb3d175d1c5 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:44.703773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02601c62-bd30-412d-b342-3fb3d175d1c5 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:44.704298 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02601c62-bd30-412d-b342-3fb3d175d1c5 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:44.705017 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02601c62-bd30-412d-b342-3fb3d175d1c5 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:44.843452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2be77313-f7ad-40eb-a756-2a91404e5a97 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:44.852442 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2be77313-f7ad-40eb-a756-2a91404e5a97 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1510 microversion: 2.1 time: 0.238935 Aug 04 17:10:44.853123 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1978/3878] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:44 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1510 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:44.857823 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2673bcaa-6ad9-427e-ba99-120b0f2598a9 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:44.858607 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2673bcaa-6ad9-427e-ba99-120b0f2598a9 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] [instance: 20e4091a-1d92-475e-866b-46bd7e9ed57e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:44.864467 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2673bcaa-6ad9-427e-ba99-120b0f2598a9 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:44.864991 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2673bcaa-6ad9-427e-ba99-120b0f2598a9 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:44.865651 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2673bcaa-6ad9-427e-ba99-120b0f2598a9 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:44.866413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2673bcaa-6ad9-427e-ba99-120b0f2598a9 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:44.866886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2673bcaa-6ad9-427e-ba99-120b0f2598a9 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:44.867324 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2673bcaa-6ad9-427e-ba99-120b0f2598a9 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:44.901725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-02601c62-bd30-412d-b342-3fb3d175d1c5 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:44.912036 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-02601c62-bd30-412d-b342-3fb3d175d1c5 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 200 len: 1508 microversion: 2.1 time: 0.224535 Aug 04 17:10:44.912621 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1901/3879] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:44 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 1508 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:44.918440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f69ddaf8-b677-4931-947d-06bd78c0872c tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:44.919277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f69ddaf8-b677-4931-947d-06bd78c0872c tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:44.925516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f69ddaf8-b677-4931-947d-06bd78c0872c tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:44.926835 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f69ddaf8-b677-4931-947d-06bd78c0872c tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:44.927480 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f69ddaf8-b677-4931-947d-06bd78c0872c tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:44.928348 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f69ddaf8-b677-4931-947d-06bd78c0872c tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:44.928993 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f69ddaf8-b677-4931-947d-06bd78c0872c tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:44.929723 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f69ddaf8-b677-4931-947d-06bd78c0872c tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:45.028534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f69ddaf8-b677-4931-947d-06bd78c0872c tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:45.037551 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f69ddaf8-b677-4931-947d-06bd78c0872c tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:45.039073 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f69ddaf8-b677-4931-947d-06bd78c0872c tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:45.040396 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f69ddaf8-b677-4931-947d-06bd78c0872c tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1364 microversion: 2.57 time: 0.126469 Aug 04 17:10:45.041465 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1902/3880] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:44 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1364 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:45.083593 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2673bcaa-6ad9-427e-ba99-120b0f2598a9 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aafff9f4984e0dac87c362d3f1eeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada0dfbe888415881ee6cd85264ada7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:45.092353 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2673bcaa-6ad9-427e-ba99-120b0f2598a9 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] 10.222.0.93 "GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e" status: 200 len: 1534 microversion: 2.1 time: 0.238052 Aug 04 17:10:45.092928 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1979/3881] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:44 2022] GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e => generated 1534 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:45.706207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a19d0090-7369-4441-975d-c839a783895c tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:45.706837 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a19d0090-7369-4441-975d-c839a783895c tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 016fbd16-b01e-4ebf-ad2f-3495970feb96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:45.713321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a19d0090-7369-4441-975d-c839a783895c tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:45.713806 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a19d0090-7369-4441-975d-c839a783895c tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:45.714271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a19d0090-7369-4441-975d-c839a783895c tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:45.714959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a19d0090-7369-4441-975d-c839a783895c tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:45.715411 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a19d0090-7369-4441-975d-c839a783895c tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:45.715836 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a19d0090-7369-4441-975d-c839a783895c tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:45.847419 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a19d0090-7369-4441-975d-c839a783895c tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:45.855819 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a19d0090-7369-4441-975d-c839a783895c tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96" status: 200 len: 1321 microversion: 2.1 time: 0.153477 Aug 04 17:10:45.856376 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1903/3882] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:45 2022] GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:45.872437 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9795729e-ea48-4890-8832-c3a7a22efaf6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:45.873062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9795729e-ea48-4890-8832-c3a7a22efaf6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:45.879904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9795729e-ea48-4890-8832-c3a7a22efaf6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:45.880398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9795729e-ea48-4890-8832-c3a7a22efaf6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:45.880843 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9795729e-ea48-4890-8832-c3a7a22efaf6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:45.881539 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9795729e-ea48-4890-8832-c3a7a22efaf6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:45.882027 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9795729e-ea48-4890-8832-c3a7a22efaf6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:45.882465 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9795729e-ea48-4890-8832-c3a7a22efaf6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:45.942358 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-33811d5c-7c76-44af-a16b-cdb0950ac8bf tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:45.943878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-33811d5c-7c76-44af-a16b-cdb0950ac8bf tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:45.949920 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33811d5c-7c76-44af-a16b-cdb0950ac8bf tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:45.950676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33811d5c-7c76-44af-a16b-cdb0950ac8bf tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:45.951315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33811d5c-7c76-44af-a16b-cdb0950ac8bf tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:45.952023 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33811d5c-7c76-44af-a16b-cdb0950ac8bf tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:45.952662 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33811d5c-7c76-44af-a16b-cdb0950ac8bf tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:45.953090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33811d5c-7c76-44af-a16b-cdb0950ac8bf tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:46.059283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9795729e-ea48-4890-8832-c3a7a22efaf6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:46.070357 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9795729e-ea48-4890-8832-c3a7a22efaf6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1487 microversion: 2.1 time: 0.201627 Aug 04 17:10:46.071466 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1980/3883] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:45 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1487 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:10:46.079613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-763c941b-3560-4d24-a347-3d3813111c83 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:46.081032 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-763c941b-3560-4d24-a347-3d3813111c83 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:46.095147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-763c941b-3560-4d24-a347-3d3813111c83 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:46.095727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-763c941b-3560-4d24-a347-3d3813111c83 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:46.096508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-763c941b-3560-4d24-a347-3d3813111c83 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:46.097606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-763c941b-3560-4d24-a347-3d3813111c83 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:46.098106 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-763c941b-3560-4d24-a347-3d3813111c83 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:46.098546 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-763c941b-3560-4d24-a347-3d3813111c83 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:46.126398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-33811d5c-7c76-44af-a16b-cdb0950ac8bf tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:46.135176 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-33811d5c-7c76-44af-a16b-cdb0950ac8bf tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 200 len: 1516 microversion: 2.1 time: 0.197020 Aug 04 17:10:46.136645 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1904/3884] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:45 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 1516 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:10:46.144202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0443c9a6-8b44-41fe-86ce-e9a503ebec9d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:46.147473 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0443c9a6-8b44-41fe-86ce-e9a503ebec9d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:46.157131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0443c9a6-8b44-41fe-86ce-e9a503ebec9d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:46.157779 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0443c9a6-8b44-41fe-86ce-e9a503ebec9d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:46.158254 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0443c9a6-8b44-41fe-86ce-e9a503ebec9d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:46.158968 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0443c9a6-8b44-41fe-86ce-e9a503ebec9d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:46.159573 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0443c9a6-8b44-41fe-86ce-e9a503ebec9d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:46.160180 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0443c9a6-8b44-41fe-86ce-e9a503ebec9d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:46.179033 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-763c941b-3560-4d24-a347-3d3813111c83 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:46.187467 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-763c941b-3560-4d24-a347-3d3813111c83 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:46.189571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-763c941b-3560-4d24-a347-3d3813111c83 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:46.197935 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-763c941b-3560-4d24-a347-3d3813111c83 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1364 microversion: 2.57 time: 0.125235 Aug 04 17:10:46.198680 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1981/3885] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:46 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1364 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:46.213072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-11ce9f54-7474-48e5-a564-54aa17da6bc2 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:46.213778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-11ce9f54-7474-48e5-a564-54aa17da6bc2 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] [instance: 20e4091a-1d92-475e-866b-46bd7e9ed57e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:46.220513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-11ce9f54-7474-48e5-a564-54aa17da6bc2 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:46.221016 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-11ce9f54-7474-48e5-a564-54aa17da6bc2 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:46.221458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-11ce9f54-7474-48e5-a564-54aa17da6bc2 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:46.222195 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-11ce9f54-7474-48e5-a564-54aa17da6bc2 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:46.222745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-11ce9f54-7474-48e5-a564-54aa17da6bc2 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:46.223157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-11ce9f54-7474-48e5-a564-54aa17da6bc2 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:46.240996 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0443c9a6-8b44-41fe-86ce-e9a503ebec9d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action" status: 200 len: 108 microversion: 2.1 time: 0.102020 Aug 04 17:10:46.242222 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1905/3886] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:10:46 2022] POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action => generated 108 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:10:46.258071 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f5837ab4-e76b-4d23-84d2-a465c5f43d39 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:46.259671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f5837ab4-e76b-4d23-84d2-a465c5f43d39 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:46.274090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5837ab4-e76b-4d23-84d2-a465c5f43d39 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:46.274737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5837ab4-e76b-4d23-84d2-a465c5f43d39 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:46.275414 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5837ab4-e76b-4d23-84d2-a465c5f43d39 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:46.276308 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5837ab4-e76b-4d23-84d2-a465c5f43d39 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:46.277474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5837ab4-e76b-4d23-84d2-a465c5f43d39 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:46.278160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5837ab4-e76b-4d23-84d2-a465c5f43d39 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:46.441922 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-11ce9f54-7474-48e5-a564-54aa17da6bc2 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aafff9f4984e0dac87c362d3f1eeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada0dfbe888415881ee6cd85264ada7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:46.452483 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-11ce9f54-7474-48e5-a564-54aa17da6bc2 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] 10.222.0.93 "GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e" status: 200 len: 1534 microversion: 2.1 time: 0.252052 Aug 04 17:10:46.454512 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1982/3887] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:46 2022] GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e => generated 1534 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:46.499836 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f5837ab4-e76b-4d23-84d2-a465c5f43d39 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:46.508452 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f5837ab4-e76b-4d23-84d2-a465c5f43d39 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.260161 Aug 04 17:10:46.510889 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1906/3888] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:46 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:10:46.536618 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e4031f16-79c8-4b26-8cc3-d0c6bc7c930b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:46.537798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e4031f16-79c8-4b26-8cc3-d0c6bc7c930b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:46.547108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4031f16-79c8-4b26-8cc3-d0c6bc7c930b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:46.548171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4031f16-79c8-4b26-8cc3-d0c6bc7c930b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:46.548625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4031f16-79c8-4b26-8cc3-d0c6bc7c930b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:46.556701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4031f16-79c8-4b26-8cc3-d0c6bc7c930b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:46.557300 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4031f16-79c8-4b26-8cc3-d0c6bc7c930b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:46.558592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4031f16-79c8-4b26-8cc3-d0c6bc7c930b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:46.746226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e4031f16-79c8-4b26-8cc3-d0c6bc7c930b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:46.755163 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e4031f16-79c8-4b26-8cc3-d0c6bc7c930b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.222754 Aug 04 17:10:46.756284 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1983/3889] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:46 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:46.776204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6f7218d6-02d0-4e4c-959e-580c80218ac5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:46.776915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6f7218d6-02d0-4e4c-959e-580c80218ac5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:46.792816 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f7218d6-02d0-4e4c-959e-580c80218ac5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:46.793337 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f7218d6-02d0-4e4c-959e-580c80218ac5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:46.793783 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f7218d6-02d0-4e4c-959e-580c80218ac5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:46.802425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f7218d6-02d0-4e4c-959e-580c80218ac5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:46.803466 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f7218d6-02d0-4e4c-959e-580c80218ac5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:46.804124 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f7218d6-02d0-4e4c-959e-580c80218ac5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:46.894148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-42e91b0e-027c-4554-a4ab-0d6849c19b91 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:46.906586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-42e91b0e-027c-4554-a4ab-0d6849c19b91 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 016fbd16-b01e-4ebf-ad2f-3495970feb96] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:46.943180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42e91b0e-027c-4554-a4ab-0d6849c19b91 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:46.948272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42e91b0e-027c-4554-a4ab-0d6849c19b91 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:46.948639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42e91b0e-027c-4554-a4ab-0d6849c19b91 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:46.949542 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42e91b0e-027c-4554-a4ab-0d6849c19b91 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:46.950357 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42e91b0e-027c-4554-a4ab-0d6849c19b91 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:46.951284 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42e91b0e-027c-4554-a4ab-0d6849c19b91 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:47.205011 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6f7218d6-02d0-4e4c-959e-580c80218ac5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:47.215990 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6f7218d6-02d0-4e4c-959e-580c80218ac5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.443587 Aug 04 17:10:47.216814 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1907/3890] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:46 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:47.257948 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-42e91b0e-027c-4554-a4ab-0d6849c19b91 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:47.266755 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-42e91b0e-027c-4554-a4ab-0d6849c19b91 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96" status: 200 len: 1321 microversion: 2.1 time: 0.393397 Aug 04 17:10:47.270105 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-084f82c7-d079-4907-9b94-18da6c05e25a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:47.271133 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1984/3891] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:46 2022] GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96 => generated 1321 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:47.271554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-084f82c7-d079-4907-9b94-18da6c05e25a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:47.283743 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4abc89ac-bbdc-462b-ae68-eabee7c288f8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:47.284380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4abc89ac-bbdc-462b-ae68-eabee7c288f8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:47.286648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-084f82c7-d079-4907-9b94-18da6c05e25a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:47.289579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-084f82c7-d079-4907-9b94-18da6c05e25a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:47.290130 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-084f82c7-d079-4907-9b94-18da6c05e25a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:47.292594 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-084f82c7-d079-4907-9b94-18da6c05e25a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:47.294630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-084f82c7-d079-4907-9b94-18da6c05e25a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:47.294802 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4abc89ac-bbdc-462b-ae68-eabee7c288f8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:47.295522 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4abc89ac-bbdc-462b-ae68-eabee7c288f8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:47.296186 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4abc89ac-bbdc-462b-ae68-eabee7c288f8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:47.297235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4abc89ac-bbdc-462b-ae68-eabee7c288f8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:47.297373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-084f82c7-d079-4907-9b94-18da6c05e25a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:47.297949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4abc89ac-bbdc-462b-ae68-eabee7c288f8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:47.301620 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4abc89ac-bbdc-462b-ae68-eabee7c288f8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:47.595204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-084f82c7-d079-4907-9b94-18da6c05e25a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:47.620407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-084f82c7-d079-4907-9b94-18da6c05e25a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:47.628269 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-084f82c7-d079-4907-9b94-18da6c05e25a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:47.629577 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-084f82c7-d079-4907-9b94-18da6c05e25a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1364 microversion: 2.57 time: 0.410150 Aug 04 17:10:47.630132 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1908/3892] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:47 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1364 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:47.646541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1dd8fe01-6fe8-4dd6-a836-50012a9dc9f7 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:47.649945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1dd8fe01-6fe8-4dd6-a836-50012a9dc9f7 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] [instance: 20e4091a-1d92-475e-866b-46bd7e9ed57e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:47.662789 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dd8fe01-6fe8-4dd6-a836-50012a9dc9f7 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:47.665120 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dd8fe01-6fe8-4dd6-a836-50012a9dc9f7 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:47.666039 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dd8fe01-6fe8-4dd6-a836-50012a9dc9f7 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:47.666353 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dd8fe01-6fe8-4dd6-a836-50012a9dc9f7 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:47.666795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dd8fe01-6fe8-4dd6-a836-50012a9dc9f7 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:47.667297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dd8fe01-6fe8-4dd6-a836-50012a9dc9f7 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:47.805071 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4abc89ac-bbdc-462b-ae68-eabee7c288f8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:47.843552 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4abc89ac-bbdc-462b-ae68-eabee7c288f8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.570777 Aug 04 17:10:47.844468 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1985/3893] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:47 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:47.982664 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1dd8fe01-6fe8-4dd6-a836-50012a9dc9f7 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aafff9f4984e0dac87c362d3f1eeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada0dfbe888415881ee6cd85264ada7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:47.996402 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1dd8fe01-6fe8-4dd6-a836-50012a9dc9f7 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] 10.222.0.93 "GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e" status: 200 len: 1534 microversion: 2.1 time: 0.361474 Aug 04 17:10:47.996987 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1909/3894] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:47 2022] GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e => generated 1534 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:48.047176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ec064670-e258-4169-9472-314438e797e4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1746159737", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "b3c59640-cdc1-4b7c-beb0-ca591646427e"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:48.136296 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-ec064670-e258-4169-9472-314438e797e4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] validate_networks() for [('b3c59640-cdc1-4b7c-beb0-ca591646427e', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:10:48.304309 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d3854370-924f-4906-80cf-e6ef65cdb461 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:48.307813 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d3854370-924f-4906-80cf-e6ef65cdb461 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 016fbd16-b01e-4ebf-ad2f-3495970feb96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:48.319920 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3854370-924f-4906-80cf-e6ef65cdb461 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:48.320510 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3854370-924f-4906-80cf-e6ef65cdb461 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:48.321040 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3854370-924f-4906-80cf-e6ef65cdb461 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:48.323023 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3854370-924f-4906-80cf-e6ef65cdb461 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:48.323718 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3854370-924f-4906-80cf-e6ef65cdb461 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:48.324602 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3854370-924f-4906-80cf-e6ef65cdb461 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:48.619903 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d3854370-924f-4906-80cf-e6ef65cdb461 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:48.635802 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d3854370-924f-4906-80cf-e6ef65cdb461 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96" status: 200 len: 1321 microversion: 2.1 time: 0.349160 Aug 04 17:10:48.654045 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1910/3895] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:48 2022] GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96 => generated 1321 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:10:48.672741 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-cf57508d-b369-4ee9-8e43-424a63caaa8f req-b240ed70-cc1e-4ba9-97b6-766f0871a9ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20e4091a-1d92-475e-866b-46bd7e9ed57e", "name": "network-vif-deleted", "tag": "4c13ab9f-a1f2-434e-b381-a9ba9d982436"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:48.706240 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-cf57508d-b369-4ee9-8e43-424a63caaa8f req-b240ed70-cc1e-4ba9-97b6-766f0871a9ee service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:48.707690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-cf57508d-b369-4ee9-8e43-424a63caaa8f req-b240ed70-cc1e-4ba9-97b6-766f0871a9ee service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:48.708467 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-cf57508d-b369-4ee9-8e43-424a63caaa8f req-b240ed70-cc1e-4ba9-97b6-766f0871a9ee service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:48.748640 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-cf57508d-b369-4ee9-8e43-424a63caaa8f req-b240ed70-cc1e-4ba9-97b6-766f0871a9ee service nova] Creating event network-vif-deleted:4c13ab9f-a1f2-434e-b381-a9ba9d982436 for instance 20e4091a-1d92-475e-866b-46bd7e9ed57e on n-h2-851359-3 Aug 04 17:10:48.764210 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-cf57508d-b369-4ee9-8e43-424a63caaa8f req-b240ed70-cc1e-4ba9-97b6-766f0871a9ee service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104679 Aug 04 17:10:48.764210 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1911/3896] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:10:48.777937 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e7e55244-ef56-4518-9d25-0c235576abfb tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:48.779031 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e7e55244-ef56-4518-9d25-0c235576abfb tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:48.797265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7e55244-ef56-4518-9d25-0c235576abfb tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:48.797958 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7e55244-ef56-4518-9d25-0c235576abfb tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:48.798599 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7e55244-ef56-4518-9d25-0c235576abfb tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:48.799561 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7e55244-ef56-4518-9d25-0c235576abfb tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:48.800198 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7e55244-ef56-4518-9d25-0c235576abfb tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:48.801125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7e55244-ef56-4518-9d25-0c235576abfb tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:48.901609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e7e55244-ef56-4518-9d25-0c235576abfb tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:48.923550 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e7e55244-ef56-4518-9d25-0c235576abfb tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:48.927216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e7e55244-ef56-4518-9d25-0c235576abfb tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:48.929552 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e7e55244-ef56-4518-9d25-0c235576abfb tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1364 microversion: 2.57 time: 0.165120 Aug 04 17:10:48.931698 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1912/3897] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:48 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:48.952073 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f7114971-b228-4f48-849e-5cf676ecc108 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:48.957263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f7114971-b228-4f48-849e-5cf676ecc108 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:48.963514 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7114971-b228-4f48-849e-5cf676ecc108 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:48.964295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7114971-b228-4f48-849e-5cf676ecc108 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:48.964946 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7114971-b228-4f48-849e-5cf676ecc108 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:48.966984 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7114971-b228-4f48-849e-5cf676ecc108 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:48.967680 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7114971-b228-4f48-849e-5cf676ecc108 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:48.968316 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7114971-b228-4f48-849e-5cf676ecc108 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:48.995773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-f7114971-b228-4f48-849e-5cf676ecc108 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lazy-loading 'flavor' on Instance uuid 930cda99-f658-44c9-bb85-da349e9e5aeb {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:10:49.090805 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f7114971-b228-4f48-849e-5cf676ecc108 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "POST /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb/action" status: 200 len: 32 microversion: 2.1 time: 0.156519 Aug 04 17:10:49.091769 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1913/3898] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:10:48 2022] POST /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb/action => generated 32 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:10:49.106841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-e2c23e3f-bb89-40cf-869f-e60105c75a3b req-3b269ab9-dadf-40f5-b748-a658ac836f26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e67fc2ff-0549-433f-9385-cc71740b93c4", "name": "network-vif-plugged", "status": "completed", "tag": "50db24c4-a63b-4eaa-a3aa-9b7c1c1dadd4"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:49.116789 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e2c23e3f-bb89-40cf-869f-e60105c75a3b req-3b269ab9-dadf-40f5-b748-a658ac836f26 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:49.117274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e2c23e3f-bb89-40cf-869f-e60105c75a3b req-3b269ab9-dadf-40f5-b748-a658ac836f26 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:49.117873 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e2c23e3f-bb89-40cf-869f-e60105c75a3b req-3b269ab9-dadf-40f5-b748-a658ac836f26 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:49.128699 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-e2c23e3f-bb89-40cf-869f-e60105c75a3b req-3b269ab9-dadf-40f5-b748-a658ac836f26 service nova] Creating event network-vif-plugged:50db24c4-a63b-4eaa-a3aa-9b7c1c1dadd4 for instance e67fc2ff-0549-433f-9385-cc71740b93c4 on n-h2-851359-3 Aug 04 17:10:49.133572 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-e2c23e3f-bb89-40cf-869f-e60105c75a3b req-3b269ab9-dadf-40f5-b748-a658ac836f26 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040375 Aug 04 17:10:49.134186 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1914/3899] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:10:49.139327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5995184d-9060-4802-ad13-04553857aa75 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:49.140029 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5995184d-9060-4802-ad13-04553857aa75 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] [instance: 20e4091a-1d92-475e-866b-46bd7e9ed57e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:49.146795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5995184d-9060-4802-ad13-04553857aa75 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:49.147288 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5995184d-9060-4802-ad13-04553857aa75 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:49.147724 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5995184d-9060-4802-ad13-04553857aa75 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:49.148424 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5995184d-9060-4802-ad13-04553857aa75 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:49.148881 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5995184d-9060-4802-ad13-04553857aa75 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:49.149312 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5995184d-9060-4802-ad13-04553857aa75 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:49.169033 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:49.184901 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5995184d-9060-4802-ad13-04553857aa75 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:49.185397 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5995184d-9060-4802-ad13-04553857aa75 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:49.186018 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5995184d-9060-4802-ad13-04553857aa75 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:49.186487 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-5995184d-9060-4802-ad13-04553857aa75 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lazy-loading 'fault' on Instance uuid 20e4091a-1d92-475e-866b-46bd7e9ed57e {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:10:49.523211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5995184d-9060-4802-ad13-04553857aa75 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aafff9f4984e0dac87c362d3f1eeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada0dfbe888415881ee6cd85264ada7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:49.531479 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5995184d-9060-4802-ad13-04553857aa75 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] 10.222.0.93 "GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e" status: 200 len: 1318 microversion: 2.1 time: 0.396020 Aug 04 17:10:49.539867 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1915/3900] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:49 2022] GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e => generated 1318 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:49.551319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a84a5038-0a3b-4b5c-a6d8-b63e3392cfe3 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:49.552425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a84a5038-0a3b-4b5c-a6d8-b63e3392cfe3 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:49.559169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a84a5038-0a3b-4b5c-a6d8-b63e3392cfe3 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:49.559672 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a84a5038-0a3b-4b5c-a6d8-b63e3392cfe3 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:49.560114 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a84a5038-0a3b-4b5c-a6d8-b63e3392cfe3 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:49.560817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a84a5038-0a3b-4b5c-a6d8-b63e3392cfe3 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:49.561271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a84a5038-0a3b-4b5c-a6d8-b63e3392cfe3 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:49.561696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a84a5038-0a3b-4b5c-a6d8-b63e3392cfe3 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:49.603246 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-ec064670-e258-4169-9472-314438e797e4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:10:49.603732 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-ec064670-e258-4169-9472-314438e797e4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:10:49.604276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-ec064670-e258-4169-9472-314438e797e4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:10:49.605093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-ec064670-e258-4169-9472-314438e797e4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:10:49.605520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-ec064670-e258-4169-9472-314438e797e4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:10:49.616863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec064670-e258-4169-9472-314438e797e4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:49.618066 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec064670-e258-4169-9472-314438e797e4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:49.619102 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec064670-e258-4169-9472-314438e797e4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:49.620768 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec064670-e258-4169-9472-314438e797e4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:49.621732 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec064670-e258-4169-9472-314438e797e4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:49.622457 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec064670-e258-4169-9472-314438e797e4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:49.645586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-ec064670-e258-4169-9472-314438e797e4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Getting quotas for project 683ce999e25e42a4a57b3c24a1fd24ef. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:10:49.654276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-ec064670-e258-4169-9472-314438e797e4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Getting quotas for user 01e6f70936a14e67aecaf71fb615fffa and project 683ce999e25e42a4a57b3c24a1fd24ef. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:10:49.669917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ec064670-e258-4169-9472-314438e797e4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:10:49.672380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ec064670-e258-4169-9472-314438e797e4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 4fcbd3c0-2201-41bb-ab2a-31262aba36dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:10:49.730016 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ec064670-e258-4169-9472-314438e797e4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.686909 Aug 04 17:10:49.731565 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1986/3901] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:10:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:10:49.737801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-75422e8e-3475-459e-bc6a-1c550b5d2228 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:49.738673 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-75422e8e-3475-459e-bc6a-1c550b5d2228 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 016fbd16-b01e-4ebf-ad2f-3495970feb96] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:49.745807 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75422e8e-3475-459e-bc6a-1c550b5d2228 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:49.746560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75422e8e-3475-459e-bc6a-1c550b5d2228 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:49.747179 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75422e8e-3475-459e-bc6a-1c550b5d2228 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:49.748096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75422e8e-3475-459e-bc6a-1c550b5d2228 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:49.748726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75422e8e-3475-459e-bc6a-1c550b5d2228 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:49.749336 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75422e8e-3475-459e-bc6a-1c550b5d2228 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:49.776348 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a84a5038-0a3b-4b5c-a6d8-b63e3392cfe3 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:49.793395 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a84a5038-0a3b-4b5c-a6d8-b63e3392cfe3 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 200 len: 1522 microversion: 2.1 time: 0.245808 Aug 04 17:10:49.797789 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1916/3902] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:49 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:49.822754 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fac89145-7709-4e75-b0f1-51357713a8d7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:49.823525 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fac89145-7709-4e75-b0f1-51357713a8d7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 4fcbd3c0-2201-41bb-ab2a-31262aba36dd] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:49.901944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fac89145-7709-4e75-b0f1-51357713a8d7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:49.909771 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fac89145-7709-4e75-b0f1-51357713a8d7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd" status: 200 len: 1215 microversion: 2.1 time: 0.094675 Aug 04 17:10:49.910490 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1917/3903] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:49 2022] GET /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd => generated 1215 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:49.947977 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-75422e8e-3475-459e-bc6a-1c550b5d2228 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:49.957704 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6b64a489-669c-4336-b8e6-a4a4bf38bf0d tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:49.958961 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6b64a489-669c-4336-b8e6-a4a4bf38bf0d tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:49.968722 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b64a489-669c-4336-b8e6-a4a4bf38bf0d tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:49.969288 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b64a489-669c-4336-b8e6-a4a4bf38bf0d tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:49.969740 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b64a489-669c-4336-b8e6-a4a4bf38bf0d tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:49.970504 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b64a489-669c-4336-b8e6-a4a4bf38bf0d tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:49.970970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b64a489-669c-4336-b8e6-a4a4bf38bf0d tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:49.971402 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b64a489-669c-4336-b8e6-a4a4bf38bf0d tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:49.988272 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-75422e8e-3475-459e-bc6a-1c550b5d2228 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96" status: 200 len: 1321 microversion: 2.1 time: 0.255296 Aug 04 17:10:49.991531 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1987/3904] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:49 2022] GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96 => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:50.041185 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6b64a489-669c-4336-b8e6-a4a4bf38bf0d tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:50.053021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6b64a489-669c-4336-b8e6-a4a4bf38bf0d tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:50.054602 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6b64a489-669c-4336-b8e6-a4a4bf38bf0d tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:50.055929 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6b64a489-669c-4336-b8e6-a4a4bf38bf0d tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1364 microversion: 2.57 time: 0.102617 Aug 04 17:10:50.056819 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1918/3905] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:49 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1364 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:50.552577 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8cf881d6-161a-4199-82d4-ee23d13e675d tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:50.553219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8cf881d6-161a-4199-82d4-ee23d13e675d tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] [instance: 20e4091a-1d92-475e-866b-46bd7e9ed57e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:50.560097 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8cf881d6-161a-4199-82d4-ee23d13e675d tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:50.560595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8cf881d6-161a-4199-82d4-ee23d13e675d tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:50.561122 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8cf881d6-161a-4199-82d4-ee23d13e675d tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:50.561740 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8cf881d6-161a-4199-82d4-ee23d13e675d tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:50.562236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8cf881d6-161a-4199-82d4-ee23d13e675d tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:50.562673 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8cf881d6-161a-4199-82d4-ee23d13e675d tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:50.602288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8cf881d6-161a-4199-82d4-ee23d13e675d tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:50.602873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8cf881d6-161a-4199-82d4-ee23d13e675d tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:50.603383 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8cf881d6-161a-4199-82d4-ee23d13e675d tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:50.604452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-8cf881d6-161a-4199-82d4-ee23d13e675d tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lazy-loading 'fault' on Instance uuid 20e4091a-1d92-475e-866b-46bd7e9ed57e {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:10:50.646497 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8cf881d6-161a-4199-82d4-ee23d13e675d tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aafff9f4984e0dac87c362d3f1eeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada0dfbe888415881ee6cd85264ada7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:50.654735 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8cf881d6-161a-4199-82d4-ee23d13e675d tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] 10.222.0.93 "GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e" status: 200 len: 1318 microversion: 2.1 time: 0.107026 Aug 04 17:10:50.655306 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1988/3906] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:50 2022] GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e => generated 1318 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:10:50.819793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-964bf018-8854-4984-98fa-782f7ec6843c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:50.820531 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-964bf018-8854-4984-98fa-782f7ec6843c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:50.827357 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-964bf018-8854-4984-98fa-782f7ec6843c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:50.828014 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-964bf018-8854-4984-98fa-782f7ec6843c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:50.828618 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-964bf018-8854-4984-98fa-782f7ec6843c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:50.829327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-964bf018-8854-4984-98fa-782f7ec6843c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:50.829861 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-964bf018-8854-4984-98fa-782f7ec6843c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:50.830239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-964bf018-8854-4984-98fa-782f7ec6843c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:50.931715 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e20200d1-e494-4a8b-a89d-267612eaa0b2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:50.932851 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e20200d1-e494-4a8b-a89d-267612eaa0b2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 4fcbd3c0-2201-41bb-ab2a-31262aba36dd] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:50.939630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e20200d1-e494-4a8b-a89d-267612eaa0b2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:50.940431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e20200d1-e494-4a8b-a89d-267612eaa0b2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:50.940946 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e20200d1-e494-4a8b-a89d-267612eaa0b2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:50.941903 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e20200d1-e494-4a8b-a89d-267612eaa0b2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:50.942689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e20200d1-e494-4a8b-a89d-267612eaa0b2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:50.943900 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e20200d1-e494-4a8b-a89d-267612eaa0b2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:50.977783 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-964bf018-8854-4984-98fa-782f7ec6843c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:50.986115 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-964bf018-8854-4984-98fa-782f7ec6843c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 200 len: 1522 microversion: 2.1 time: 0.170009 Aug 04 17:10:50.986998 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1919/3907] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:50 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:51.016197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d863350a-d040-4524-b7f2-2ee26f4bda37 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:51.017270 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d863350a-d040-4524-b7f2-2ee26f4bda37 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 016fbd16-b01e-4ebf-ad2f-3495970feb96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:51.024113 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d863350a-d040-4524-b7f2-2ee26f4bda37 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:51.024870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d863350a-d040-4524-b7f2-2ee26f4bda37 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:51.025566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d863350a-d040-4524-b7f2-2ee26f4bda37 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:51.026388 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d863350a-d040-4524-b7f2-2ee26f4bda37 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:51.027016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d863350a-d040-4524-b7f2-2ee26f4bda37 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:51.027613 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d863350a-d040-4524-b7f2-2ee26f4bda37 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:51.041150 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e20200d1-e494-4a8b-a89d-267612eaa0b2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:51.049364 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e20200d1-e494-4a8b-a89d-267612eaa0b2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd" status: 200 len: 1267 microversion: 2.1 time: 0.122912 Aug 04 17:10:51.050618 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1989/3908] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:50 2022] GET /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd => generated 1267 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:10:51.085313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0517f9b6-47e2-4e5e-bd43-b49fc582e4e4 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:51.087449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0517f9b6-47e2-4e5e-bd43-b49fc582e4e4 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:51.106229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0517f9b6-47e2-4e5e-bd43-b49fc582e4e4 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:51.107385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0517f9b6-47e2-4e5e-bd43-b49fc582e4e4 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:51.108069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0517f9b6-47e2-4e5e-bd43-b49fc582e4e4 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:51.108816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0517f9b6-47e2-4e5e-bd43-b49fc582e4e4 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:51.109290 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0517f9b6-47e2-4e5e-bd43-b49fc582e4e4 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:51.112496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0517f9b6-47e2-4e5e-bd43-b49fc582e4e4 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:51.204277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0517f9b6-47e2-4e5e-bd43-b49fc582e4e4 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:51.217020 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0517f9b6-47e2-4e5e-bd43-b49fc582e4e4 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:51.219748 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0517f9b6-47e2-4e5e-bd43-b49fc582e4e4 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:51.221158 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0517f9b6-47e2-4e5e-bd43-b49fc582e4e4 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1364 microversion: 2.57 time: 0.144858 Aug 04 17:10:51.221913 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1990/3909] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:51 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1364 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:51.248362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d863350a-d040-4524-b7f2-2ee26f4bda37 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:51.264119 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d863350a-d040-4524-b7f2-2ee26f4bda37 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96" status: 200 len: 1321 microversion: 2.1 time: 0.256668 Aug 04 17:10:51.264767 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1920/3910] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:51 2022] GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96 => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:10:51.676653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b02e841d-09c2-4291-be60-c2d24ab8b903 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:51.678075 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b02e841d-09c2-4291-be60-c2d24ab8b903 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] [instance: 20e4091a-1d92-475e-866b-46bd7e9ed57e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:51.685772 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b02e841d-09c2-4291-be60-c2d24ab8b903 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:51.686677 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b02e841d-09c2-4291-be60-c2d24ab8b903 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:51.687165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b02e841d-09c2-4291-be60-c2d24ab8b903 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:51.687925 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b02e841d-09c2-4291-be60-c2d24ab8b903 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:51.688690 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b02e841d-09c2-4291-be60-c2d24ab8b903 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:51.689041 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b02e841d-09c2-4291-be60-c2d24ab8b903 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:51.721699 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b02e841d-09c2-4291-be60-c2d24ab8b903 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:51.722024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b02e841d-09c2-4291-be60-c2d24ab8b903 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:51.722481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b02e841d-09c2-4291-be60-c2d24ab8b903 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:51.722926 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-b02e841d-09c2-4291-be60-c2d24ab8b903 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lazy-loading 'fault' on Instance uuid 20e4091a-1d92-475e-866b-46bd7e9ed57e {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:10:51.768129 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b02e841d-09c2-4291-be60-c2d24ab8b903 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25aafff9f4984e0dac87c362d3f1eeb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada0dfbe888415881ee6cd85264ada7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:51.776293 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b02e841d-09c2-4291-be60-c2d24ab8b903 tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] 10.222.0.93 "GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e" status: 200 len: 1318 microversion: 2.1 time: 0.104388 Aug 04 17:10:51.789837 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1991/3911] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:51 2022] GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e => generated 1318 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:52.009194 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8f05a04b-1f65-4078-9aa9-7fa5c9df86f6 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:52.009811 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8f05a04b-1f65-4078-9aa9-7fa5c9df86f6 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:52.024447 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f05a04b-1f65-4078-9aa9-7fa5c9df86f6 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:52.030763 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f05a04b-1f65-4078-9aa9-7fa5c9df86f6 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:52.031626 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f05a04b-1f65-4078-9aa9-7fa5c9df86f6 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:52.032618 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f05a04b-1f65-4078-9aa9-7fa5c9df86f6 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:52.033244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f05a04b-1f65-4078-9aa9-7fa5c9df86f6 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:52.033849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f05a04b-1f65-4078-9aa9-7fa5c9df86f6 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:52.071474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c9cd4734-8101-4c9c-a2c8-fa43ba12f552 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:52.072415 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c9cd4734-8101-4c9c-a2c8-fa43ba12f552 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 4fcbd3c0-2201-41bb-ab2a-31262aba36dd] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:52.089960 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9cd4734-8101-4c9c-a2c8-fa43ba12f552 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:52.090749 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9cd4734-8101-4c9c-a2c8-fa43ba12f552 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:52.092018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9cd4734-8101-4c9c-a2c8-fa43ba12f552 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:52.094247 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9cd4734-8101-4c9c-a2c8-fa43ba12f552 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:52.095055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9cd4734-8101-4c9c-a2c8-fa43ba12f552 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:52.098540 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9cd4734-8101-4c9c-a2c8-fa43ba12f552 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:52.286570 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8f05a04b-1f65-4078-9aa9-7fa5c9df86f6 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:52.299413 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8f05a04b-1f65-4078-9aa9-7fa5c9df86f6 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 200 len: 1522 microversion: 2.1 time: 0.293988 Aug 04 17:10:52.301058 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1921/3912] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:52 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:52.310128 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-97de8ca5-e78f-4dae-a8a6-dc67a1852bbc tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:52.311824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-97de8ca5-e78f-4dae-a8a6-dc67a1852bbc tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:52.315991 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c9cd4734-8101-4c9c-a2c8-fa43ba12f552 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:52.329458 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c9cd4734-8101-4c9c-a2c8-fa43ba12f552 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd" status: 200 len: 1315 microversion: 2.1 time: 0.262413 Aug 04 17:10:52.330352 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1992/3913] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:52 2022] GET /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:52.335563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-106d79f1-1939-48db-9a2a-743faae87b77 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:52.336396 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-106d79f1-1939-48db-9a2a-743faae87b77 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 016fbd16-b01e-4ebf-ad2f-3495970feb96] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:52.342711 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97de8ca5-e78f-4dae-a8a6-dc67a1852bbc tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:52.343214 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97de8ca5-e78f-4dae-a8a6-dc67a1852bbc tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:52.343620 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-106d79f1-1939-48db-9a2a-743faae87b77 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:52.343759 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97de8ca5-e78f-4dae-a8a6-dc67a1852bbc tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:52.344593 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-106d79f1-1939-48db-9a2a-743faae87b77 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:52.344957 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97de8ca5-e78f-4dae-a8a6-dc67a1852bbc tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:52.345416 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97de8ca5-e78f-4dae-a8a6-dc67a1852bbc tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:52.346849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-106d79f1-1939-48db-9a2a-743faae87b77 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:52.347824 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-106d79f1-1939-48db-9a2a-743faae87b77 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:52.347949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97de8ca5-e78f-4dae-a8a6-dc67a1852bbc tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:52.348634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-106d79f1-1939-48db-9a2a-743faae87b77 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:52.349799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-106d79f1-1939-48db-9a2a-743faae87b77 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:52.463528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-97de8ca5-e78f-4dae-a8a6-dc67a1852bbc tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:52.475580 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-97de8ca5-e78f-4dae-a8a6-dc67a1852bbc tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:52.479158 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-97de8ca5-e78f-4dae-a8a6-dc67a1852bbc tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:52.480982 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-97de8ca5-e78f-4dae-a8a6-dc67a1852bbc tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1364 microversion: 2.57 time: 0.178800 Aug 04 17:10:52.481829 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1922/3914] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:52 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:52.550730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-106d79f1-1939-48db-9a2a-743faae87b77 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:52.559963 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-106d79f1-1939-48db-9a2a-743faae87b77 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96" status: 200 len: 1321 microversion: 2.1 time: 0.228078 Aug 04 17:10:52.560646 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1993/3915] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:52 2022] GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:52.798949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-94317cfd-2225-43d3-9d6c-f9bc07cfa26b tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:52.799842 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-94317cfd-2225-43d3-9d6c-f9bc07cfa26b tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] [instance: 20e4091a-1d92-475e-866b-46bd7e9ed57e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:52.807482 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94317cfd-2225-43d3-9d6c-f9bc07cfa26b tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:52.808302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94317cfd-2225-43d3-9d6c-f9bc07cfa26b tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:52.808881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-2bd70b54-f7d4-4902-896a-fa23d0d75734 req-21e6ea5b-bad8-4d74-8d7c-15b6fcc3010d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fcbd3c0-2201-41bb-ab2a-31262aba36dd", "tag": "aba4b667-0fd9-49e8-8c50-799f4932f9f7"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:52.809494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94317cfd-2225-43d3-9d6c-f9bc07cfa26b tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:52.810454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94317cfd-2225-43d3-9d6c-f9bc07cfa26b tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:52.811261 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94317cfd-2225-43d3-9d6c-f9bc07cfa26b tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:52.811883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94317cfd-2225-43d3-9d6c-f9bc07cfa26b tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:52.828372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-2bd70b54-f7d4-4902-896a-fa23d0d75734 req-21e6ea5b-bad8-4d74-8d7c-15b6fcc3010d service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:52.834824 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-2bd70b54-f7d4-4902-896a-fa23d0d75734 req-21e6ea5b-bad8-4d74-8d7c-15b6fcc3010d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:52.835406 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-2bd70b54-f7d4-4902-896a-fa23d0d75734 req-21e6ea5b-bad8-4d74-8d7c-15b6fcc3010d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:52.845041 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-94317cfd-2225-43d3-9d6c-f9bc07cfa26b tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] HTTP exception thrown: Instance 20e4091a-1d92-475e-866b-46bd7e9ed57e could not be found. Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-94317cfd-2225-43d3-9d6c-f9bc07cfa26b tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Request method failure captured: Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e HTTP/1.1 Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_1vG0ATuBrNSOxjl_2dOuFO6Vlr4FT6t0wt_1UqSkJie4pEYWM5T4aDU1n6B9i3OpRHmZ3oD1lxEeu1jtoq5d6kHYOw9yghBSDsm7rdgmZAuH3UAkTS57fwRwnqDZvmMggQQT10ryVKJue0QNH4OQpN8k2sNGgu0tyvixvyADIgKLE Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 6ada0dfbe888415881ee6cd85264ada7 Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1587298258 Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6ada0dfbe888415881ee6cd85264ada7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6ada0dfbe888415881ee6cd85264ada7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6ada0dfbe888415881ee6cd85264ada7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6ada0dfbe888415881ee6cd85264ada7"}]}] Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1587298258 Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 6ada0dfbe888415881ee6cd85264ada7 Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1587298258 Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1587298258-project Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 25aafff9f4984e0dac87c362d3f1eeb4 Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1587298258-project Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 20e4091a-1d92-475e-866b-46bd7e9ed57e could not be found. Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '20e4091a-1d92-475e-866b-46bd7e9ed57e'} Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20e4091a-1d92-475e-866b-46bd7e9ed57e could not be found. Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20e4091a-1d92-475e-866b-46bd7e9ed57e could not be found. Aug 04 17:10:52.847053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:10:52.853400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:10:52.853400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:10:52.853400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:10:52.853400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:10:52.853400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:10:52.853400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:10:52.853400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:10:52.853400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20e4091a-1d92-475e-866b-46bd7e9ed57e could not be found. Aug 04 17:10:52.853400 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:10:52.862024 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-2bd70b54-f7d4-4902-896a-fa23d0d75734 req-21e6ea5b-bad8-4d74-8d7c-15b6fcc3010d service nova] Creating event network-changed:aba4b667-0fd9-49e8-8c50-799f4932f9f7 for instance 4fcbd3c0-2201-41bb-ab2a-31262aba36dd on n-h1-851359-3 Aug 04 17:10:52.865812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-94317cfd-2225-43d3-9d6c-f9bc07cfa26b tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] Returning 404 to user: Instance 20e4091a-1d92-475e-866b-46bd7e9ed57e could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:10:52.869707 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-94317cfd-2225-43d3-9d6c-f9bc07cfa26b tempest-ServersNegativeTestMultiTenantJSON-1587298258 tempest-ServersNegativeTestMultiTenantJSON-1587298258-project] 10.222.0.93 "GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e" status: 404 len: 111 microversion: 2.1 time: 0.076723 Aug 04 17:10:52.877583 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1923/3916] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:52 2022] GET /compute/v2.1/servers/20e4091a-1d92-475e-866b-46bd7e9ed57e => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:10:52.889712 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-2bd70b54-f7d4-4902-896a-fa23d0d75734 req-21e6ea5b-bad8-4d74-8d7c-15b6fcc3010d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084617 Aug 04 17:10:52.891144 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1994/3917] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:10:53.323263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1916408b-5cd9-43a9-bbf0-e4d7c8f59038 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:53.323967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1916408b-5cd9-43a9-bbf0-e4d7c8f59038 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:53.335091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:53.336932 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1916408b-5cd9-43a9-bbf0-e4d7c8f59038 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:53.338616 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1916408b-5cd9-43a9-bbf0-e4d7c8f59038 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:53.339116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1916408b-5cd9-43a9-bbf0-e4d7c8f59038 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:53.340036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1916408b-5cd9-43a9-bbf0-e4d7c8f59038 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:53.340511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1916408b-5cd9-43a9-bbf0-e4d7c8f59038 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:53.340921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1916408b-5cd9-43a9-bbf0-e4d7c8f59038 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:53.367856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7652935e-d485-4f92-840c-fc85a05a612f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:53.368912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7652935e-d485-4f92-840c-fc85a05a612f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 4fcbd3c0-2201-41bb-ab2a-31262aba36dd] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:53.376792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7652935e-d485-4f92-840c-fc85a05a612f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:53.377288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7652935e-d485-4f92-840c-fc85a05a612f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:53.377735 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7652935e-d485-4f92-840c-fc85a05a612f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:53.378498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7652935e-d485-4f92-840c-fc85a05a612f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:53.379155 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7652935e-d485-4f92-840c-fc85a05a612f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:53.379590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7652935e-d485-4f92-840c-fc85a05a612f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:53.676123 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1916408b-5cd9-43a9-bbf0-e4d7c8f59038 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:53.684657 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1916408b-5cd9-43a9-bbf0-e4d7c8f59038 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 200 len: 1522 microversion: 2.1 time: 0.365213 Aug 04 17:10:53.685030 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7652935e-d485-4f92-840c-fc85a05a612f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:53.685509 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1924/3918] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:53 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 1522 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:53.687407 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:53.703797 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3c67c63d-6dd1-4797-90c4-23156b865f2e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:53.705274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3c67c63d-6dd1-4797-90c4-23156b865f2e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:53.705601 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7652935e-d485-4f92-840c-fc85a05a612f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd" status: 200 len: 1315 microversion: 2.1 time: 0.355193 Aug 04 17:10:53.718330 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1995/3919] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:53 2022] GET /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:53.728108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c67c63d-6dd1-4797-90c4-23156b865f2e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:53.728802 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-42b1e9c2-86f3-4b5b-85c9-eccb45856028 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:53.728948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c67c63d-6dd1-4797-90c4-23156b865f2e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:53.729488 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c67c63d-6dd1-4797-90c4-23156b865f2e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:53.729910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-42b1e9c2-86f3-4b5b-85c9-eccb45856028 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 016fbd16-b01e-4ebf-ad2f-3495970feb96] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:53.730493 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c67c63d-6dd1-4797-90c4-23156b865f2e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:53.731595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c67c63d-6dd1-4797-90c4-23156b865f2e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:53.732125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c67c63d-6dd1-4797-90c4-23156b865f2e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:53.738320 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42b1e9c2-86f3-4b5b-85c9-eccb45856028 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:53.739055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42b1e9c2-86f3-4b5b-85c9-eccb45856028 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:53.740229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42b1e9c2-86f3-4b5b-85c9-eccb45856028 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:53.741155 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42b1e9c2-86f3-4b5b-85c9-eccb45856028 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:53.741795 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42b1e9c2-86f3-4b5b-85c9-eccb45856028 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:53.742436 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42b1e9c2-86f3-4b5b-85c9-eccb45856028 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:53.839893 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3c67c63d-6dd1-4797-90c4-23156b865f2e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:53.851030 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3c67c63d-6dd1-4797-90c4-23156b865f2e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:53.852607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3c67c63d-6dd1-4797-90c4-23156b865f2e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:53.853997 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3c67c63d-6dd1-4797-90c4-23156b865f2e tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1364 microversion: 2.57 time: 0.167215 Aug 04 17:10:53.854685 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1925/3920] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:53 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:53.998955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-42b1e9c2-86f3-4b5b-85c9-eccb45856028 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:54.010155 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-42b1e9c2-86f3-4b5b-85c9-eccb45856028 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96" status: 200 len: 1321 microversion: 2.1 time: 0.290394 Aug 04 17:10:54.011050 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1996/3921] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:53 2022] GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96 => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:54.706971 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6dcbd47a-dcdd-4875-80c3-da664c41b3f4 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:54.707616 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6dcbd47a-dcdd-4875-80c3-da664c41b3f4 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:54.715921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6dcbd47a-dcdd-4875-80c3-da664c41b3f4 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:54.716690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6dcbd47a-dcdd-4875-80c3-da664c41b3f4 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:54.717365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6dcbd47a-dcdd-4875-80c3-da664c41b3f4 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:54.718179 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6dcbd47a-dcdd-4875-80c3-da664c41b3f4 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:54.718729 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6dcbd47a-dcdd-4875-80c3-da664c41b3f4 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:54.719229 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6dcbd47a-dcdd-4875-80c3-da664c41b3f4 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:54.732410 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f32fb39b-bad4-4c8c-a2dd-c14bf442ce82 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:54.733388 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f32fb39b-bad4-4c8c-a2dd-c14bf442ce82 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 4fcbd3c0-2201-41bb-ab2a-31262aba36dd] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:54.744945 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f32fb39b-bad4-4c8c-a2dd-c14bf442ce82 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:54.744945 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f32fb39b-bad4-4c8c-a2dd-c14bf442ce82 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:54.749168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f32fb39b-bad4-4c8c-a2dd-c14bf442ce82 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:54.750027 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f32fb39b-bad4-4c8c-a2dd-c14bf442ce82 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:54.750579 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f32fb39b-bad4-4c8c-a2dd-c14bf442ce82 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:54.751780 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f32fb39b-bad4-4c8c-a2dd-c14bf442ce82 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:55.116270 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6dcbd47a-dcdd-4875-80c3-da664c41b3f4 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:55.125055 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6dcbd47a-dcdd-4875-80c3-da664c41b3f4 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 200 len: 1522 microversion: 2.1 time: 0.421784 Aug 04 17:10:55.130604 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1926/3922] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:54 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 1522 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:55.135839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e6075c47-4e43-4d9d-b6bd-6a475936b1f1 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:55.147232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e6075c47-4e43-4d9d-b6bd-6a475936b1f1 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:55.154321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6075c47-4e43-4d9d-b6bd-6a475936b1f1 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:55.155170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6075c47-4e43-4d9d-b6bd-6a475936b1f1 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:55.158252 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6075c47-4e43-4d9d-b6bd-6a475936b1f1 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:55.159260 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6075c47-4e43-4d9d-b6bd-6a475936b1f1 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:55.160612 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f32fb39b-bad4-4c8c-a2dd-c14bf442ce82 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:55.161650 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6075c47-4e43-4d9d-b6bd-6a475936b1f1 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:55.162363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6075c47-4e43-4d9d-b6bd-6a475936b1f1 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:55.185233 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f32fb39b-bad4-4c8c-a2dd-c14bf442ce82 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd" status: 200 len: 1315 microversion: 2.1 time: 0.455252 Aug 04 17:10:55.199954 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1997/3923] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:54 2022] GET /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:10:55.199954 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b0a74f48-2ff3-41ff-b985-b43b1a9a65e8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:55.199954 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b0a74f48-2ff3-41ff-b985-b43b1a9a65e8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 016fbd16-b01e-4ebf-ad2f-3495970feb96] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:55.215484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0a74f48-2ff3-41ff-b985-b43b1a9a65e8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:55.216423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0a74f48-2ff3-41ff-b985-b43b1a9a65e8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:55.216889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0a74f48-2ff3-41ff-b985-b43b1a9a65e8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:55.217650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0a74f48-2ff3-41ff-b985-b43b1a9a65e8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:55.218150 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0a74f48-2ff3-41ff-b985-b43b1a9a65e8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:55.218587 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0a74f48-2ff3-41ff-b985-b43b1a9a65e8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:55.296725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e6075c47-4e43-4d9d-b6bd-6a475936b1f1 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:55.306873 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e6075c47-4e43-4d9d-b6bd-6a475936b1f1 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:55.309162 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e6075c47-4e43-4d9d-b6bd-6a475936b1f1 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:55.313258 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e6075c47-4e43-4d9d-b6bd-6a475936b1f1 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1364 microversion: 2.57 time: 0.181198 Aug 04 17:10:55.314758 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1927/3924] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:55 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:55.337194 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-56bbef3c-64be-4b88-a7e0-f744ef458d6d req-2d44df67-c08a-402c-a449-15922f21d020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016fbd16-b01e-4ebf-ad2f-3495970feb96", "name": "network-vif-plugged", "status": "completed", "tag": "421a0ea1-5687-4e41-8da8-9b1d6e68d02d"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:55.367036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-56bbef3c-64be-4b88-a7e0-f744ef458d6d req-2d44df67-c08a-402c-a449-15922f21d020 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:55.368239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-56bbef3c-64be-4b88-a7e0-f744ef458d6d req-2d44df67-c08a-402c-a449-15922f21d020 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:55.368929 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-56bbef3c-64be-4b88-a7e0-f744ef458d6d req-2d44df67-c08a-402c-a449-15922f21d020 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:55.392043 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-56bbef3c-64be-4b88-a7e0-f744ef458d6d req-2d44df67-c08a-402c-a449-15922f21d020 service nova] Creating event network-vif-plugged:421a0ea1-5687-4e41-8da8-9b1d6e68d02d for instance 016fbd16-b01e-4ebf-ad2f-3495970feb96 on n-h2-851359-3 Aug 04 17:10:55.402574 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-56bbef3c-64be-4b88-a7e0-f744ef458d6d req-2d44df67-c08a-402c-a449-15922f21d020 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084909 Aug 04 17:10:55.407289 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1928/3925] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:10:55.628980 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b0a74f48-2ff3-41ff-b985-b43b1a9a65e8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:55.646800 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b0a74f48-2ff3-41ff-b985-b43b1a9a65e8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96" status: 200 len: 1321 microversion: 2.1 time: 0.453132 Aug 04 17:10:55.647779 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1998/3926] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:55 2022] GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96 => generated 1321 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:56.157837 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9b3f5038-ad53-42ab-914b-d23cfc5bdd5c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:56.158596 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9b3f5038-ad53-42ab-914b-d23cfc5bdd5c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:56.164765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b3f5038-ad53-42ab-914b-d23cfc5bdd5c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:56.165267 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b3f5038-ad53-42ab-914b-d23cfc5bdd5c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:56.165934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b3f5038-ad53-42ab-914b-d23cfc5bdd5c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:56.166678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b3f5038-ad53-42ab-914b-d23cfc5bdd5c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:56.167149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b3f5038-ad53-42ab-914b-d23cfc5bdd5c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:56.167585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b3f5038-ad53-42ab-914b-d23cfc5bdd5c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:56.207835 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ef7d3c2e-0a4b-4378-b0ae-2aefe28f2f89 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:56.208706 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ef7d3c2e-0a4b-4378-b0ae-2aefe28f2f89 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 4fcbd3c0-2201-41bb-ab2a-31262aba36dd] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:56.216344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ef7d3c2e-0a4b-4378-b0ae-2aefe28f2f89 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:56.217104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ef7d3c2e-0a4b-4378-b0ae-2aefe28f2f89 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:56.217742 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ef7d3c2e-0a4b-4378-b0ae-2aefe28f2f89 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:56.218671 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ef7d3c2e-0a4b-4378-b0ae-2aefe28f2f89 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:56.219319 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ef7d3c2e-0a4b-4378-b0ae-2aefe28f2f89 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:56.219758 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ef7d3c2e-0a4b-4378-b0ae-2aefe28f2f89 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:56.766919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ef7d3c2e-0a4b-4378-b0ae-2aefe28f2f89 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:56.778318 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ef7d3c2e-0a4b-4378-b0ae-2aefe28f2f89 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd" status: 200 len: 1315 microversion: 2.1 time: 0.574314 Aug 04 17:10:56.780993 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 1999/3927] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:56 2022] GET /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd => generated 1315 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:10:56.798282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7c73815b-3202-4cd9-8d7d-e4a68adf973a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:56.799521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7c73815b-3202-4cd9-8d7d-e4a68adf973a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:56.807473 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c73815b-3202-4cd9-8d7d-e4a68adf973a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:56.808056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c73815b-3202-4cd9-8d7d-e4a68adf973a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:56.808688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c73815b-3202-4cd9-8d7d-e4a68adf973a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:56.809613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c73815b-3202-4cd9-8d7d-e4a68adf973a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:56.810174 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c73815b-3202-4cd9-8d7d-e4a68adf973a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:56.811520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c73815b-3202-4cd9-8d7d-e4a68adf973a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:56.817778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9b3f5038-ad53-42ab-914b-d23cfc5bdd5c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:56.833174 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9b3f5038-ad53-42ab-914b-d23cfc5bdd5c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 200 len: 1522 microversion: 2.1 time: 0.679724 Aug 04 17:10:56.835660 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1929/3928] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:56 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 1522 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:56.843164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8f6ded2b-d72f-464b-89ec-865e9b3c6be0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:56.844028 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8f6ded2b-d72f-464b-89ec-865e9b3c6be0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 016fbd16-b01e-4ebf-ad2f-3495970feb96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:56.850823 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f6ded2b-d72f-464b-89ec-865e9b3c6be0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:56.851451 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f6ded2b-d72f-464b-89ec-865e9b3c6be0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:56.851964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f6ded2b-d72f-464b-89ec-865e9b3c6be0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:56.852752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f6ded2b-d72f-464b-89ec-865e9b3c6be0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:56.853423 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f6ded2b-d72f-464b-89ec-865e9b3c6be0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:56.853953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f6ded2b-d72f-464b-89ec-865e9b3c6be0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:56.927366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7c73815b-3202-4cd9-8d7d-e4a68adf973a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:56.935360 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7c73815b-3202-4cd9-8d7d-e4a68adf973a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:56.936864 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7c73815b-3202-4cd9-8d7d-e4a68adf973a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:56.938785 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7c73815b-3202-4cd9-8d7d-e4a68adf973a tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1364 microversion: 2.57 time: 0.156171 Aug 04 17:10:56.939788 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2000/3929] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:56 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:57.134619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8f6ded2b-d72f-464b-89ec-865e9b3c6be0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:57.160768 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8f6ded2b-d72f-464b-89ec-865e9b3c6be0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96" status: 200 len: 1321 microversion: 2.1 time: 0.323680 Aug 04 17:10:57.162971 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1930/3930] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:56 2022] GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96 => generated 1321 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:57.809916 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-498a7a27-c076-45a0-8a68-3e1ff1f8c1d5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:57.811762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-498a7a27-c076-45a0-8a68-3e1ff1f8c1d5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 4fcbd3c0-2201-41bb-ab2a-31262aba36dd] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:57.821499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-498a7a27-c076-45a0-8a68-3e1ff1f8c1d5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:57.822930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-498a7a27-c076-45a0-8a68-3e1ff1f8c1d5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:57.823545 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-498a7a27-c076-45a0-8a68-3e1ff1f8c1d5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:57.824400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-498a7a27-c076-45a0-8a68-3e1ff1f8c1d5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:57.825230 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-498a7a27-c076-45a0-8a68-3e1ff1f8c1d5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:57.825934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-498a7a27-c076-45a0-8a68-3e1ff1f8c1d5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:57.859694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-28ddbb74-ada0-499c-b8ef-8ac49e2be41c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:57.861739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-28ddbb74-ada0-499c-b8ef-8ac49e2be41c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:57.879176 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28ddbb74-ada0-499c-b8ef-8ac49e2be41c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:57.879929 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28ddbb74-ada0-499c-b8ef-8ac49e2be41c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:57.883100 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28ddbb74-ada0-499c-b8ef-8ac49e2be41c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:57.884080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28ddbb74-ada0-499c-b8ef-8ac49e2be41c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:57.886463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28ddbb74-ada0-499c-b8ef-8ac49e2be41c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:57.887974 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28ddbb74-ada0-499c-b8ef-8ac49e2be41c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:58.272399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-498a7a27-c076-45a0-8a68-3e1ff1f8c1d5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:58.279014 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-28ddbb74-ada0-499c-b8ef-8ac49e2be41c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:58.279976 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-498a7a27-c076-45a0-8a68-3e1ff1f8c1d5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd" status: 200 len: 1315 microversion: 2.1 time: 0.475986 Aug 04 17:10:58.280744 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2001/3931] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:57 2022] GET /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd => generated 1315 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:58.285626 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fc9c4ddf-f79b-443e-a949-aa7217e78dab tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:58.286420 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fc9c4ddf-f79b-443e-a949-aa7217e78dab tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:58.287043 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-28ddbb74-ada0-499c-b8ef-8ac49e2be41c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 200 len: 1522 microversion: 2.1 time: 0.431451 Aug 04 17:10:58.287613 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1931/3932] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:57 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 1522 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:10:58.292372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc9c4ddf-f79b-443e-a949-aa7217e78dab tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:58.292868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc9c4ddf-f79b-443e-a949-aa7217e78dab tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:58.293322 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc9c4ddf-f79b-443e-a949-aa7217e78dab tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:58.294055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc9c4ddf-f79b-443e-a949-aa7217e78dab tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:58.294693 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc9c4ddf-f79b-443e-a949-aa7217e78dab tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:58.295288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc9c4ddf-f79b-443e-a949-aa7217e78dab tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:58.301842 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7d410465-06b4-447d-a2b9-815439817afa tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:58.302986 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7d410465-06b4-447d-a2b9-815439817afa tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 016fbd16-b01e-4ebf-ad2f-3495970feb96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:58.309316 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d410465-06b4-447d-a2b9-815439817afa tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:58.310044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d410465-06b4-447d-a2b9-815439817afa tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:58.310468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d410465-06b4-447d-a2b9-815439817afa tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:58.311618 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d410465-06b4-447d-a2b9-815439817afa tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:58.312146 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d410465-06b4-447d-a2b9-815439817afa tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:58.312587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d410465-06b4-447d-a2b9-815439817afa tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:58.448425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fc9c4ddf-f79b-443e-a949-aa7217e78dab tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:58.457111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fc9c4ddf-f79b-443e-a949-aa7217e78dab tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:58.459796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fc9c4ddf-f79b-443e-a949-aa7217e78dab tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:58.462724 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fc9c4ddf-f79b-443e-a949-aa7217e78dab tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1370 microversion: 2.57 time: 0.179974 Aug 04 17:10:58.463886 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2002/3933] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:58 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:10:58.627140 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-cf275dcf-2615-438f-a88c-ca6ee3932d1c req-11cb5ba1-98ca-425f-861b-d26d8ead7ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fcbd3c0-2201-41bb-ab2a-31262aba36dd", "name": "network-vif-plugged", "status": "completed", "tag": "aba4b667-0fd9-49e8-8c50-799f4932f9f7"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:10:58.651450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-cf275dcf-2615-438f-a88c-ca6ee3932d1c req-11cb5ba1-98ca-425f-861b-d26d8ead7ce0 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:58.651949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-cf275dcf-2615-438f-a88c-ca6ee3932d1c req-11cb5ba1-98ca-425f-861b-d26d8ead7ce0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:58.655647 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7d410465-06b4-447d-a2b9-815439817afa tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:58.658321 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-cf275dcf-2615-438f-a88c-ca6ee3932d1c req-11cb5ba1-98ca-425f-861b-d26d8ead7ce0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:58.667743 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7d410465-06b4-447d-a2b9-815439817afa tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96" status: 200 len: 1512 microversion: 2.1 time: 0.378734 Aug 04 17:10:58.669098 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1932/3934] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:58 2022] GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96 => generated 1512 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:58.681452 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-cf275dcf-2615-438f-a88c-ca6ee3932d1c req-11cb5ba1-98ca-425f-861b-d26d8ead7ce0 service nova] Creating event network-vif-plugged:aba4b667-0fd9-49e8-8c50-799f4932f9f7 for instance 4fcbd3c0-2201-41bb-ab2a-31262aba36dd on n-h1-851359-3 Aug 04 17:10:58.689762 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-cf275dcf-2615-438f-a88c-ca6ee3932d1c req-11cb5ba1-98ca-425f-861b-d26d8ead7ce0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066178 Aug 04 17:10:58.690617 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2003/3935] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:10:58.691150 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3ab208d6-e8df-46f0-840a-7d2896bdd02c tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:58.691778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3ab208d6-e8df-46f0-840a-7d2896bdd02c tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 01c2f9e6-2bf7-4013-b254-0dac8e579962] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:58.699477 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ab208d6-e8df-46f0-840a-7d2896bdd02c tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:58.699973 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ab208d6-e8df-46f0-840a-7d2896bdd02c tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:58.700904 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ab208d6-e8df-46f0-840a-7d2896bdd02c tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:58.701626 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ab208d6-e8df-46f0-840a-7d2896bdd02c tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:58.702128 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ab208d6-e8df-46f0-840a-7d2896bdd02c tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:58.702566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ab208d6-e8df-46f0-840a-7d2896bdd02c tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:58.974132 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3ab208d6-e8df-46f0-840a-7d2896bdd02c tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:58.982912 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3ab208d6-e8df-46f0-840a-7d2896bdd02c tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962" status: 200 len: 1511 microversion: 2.1 time: 0.296460 Aug 04 17:10:58.984879 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1933/3936] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:58 2022] GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962 => generated 1511 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:10:59.006787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5d1c750e-0d62-4501-8ca3-86da930c5f68 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:59.008303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5d1c750e-0d62-4501-8ca3-86da930c5f68 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: e67fc2ff-0549-433f-9385-cc71740b93c4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:59.021256 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d1c750e-0d62-4501-8ca3-86da930c5f68 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:59.022203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d1c750e-0d62-4501-8ca3-86da930c5f68 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:59.022853 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d1c750e-0d62-4501-8ca3-86da930c5f68 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:59.024971 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d1c750e-0d62-4501-8ca3-86da930c5f68 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:59.025663 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d1c750e-0d62-4501-8ca3-86da930c5f68 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:59.026873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d1c750e-0d62-4501-8ca3-86da930c5f68 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:59.301778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d08c9aed-0008-472f-8cca-8438d15de3e2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:59.302475 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d08c9aed-0008-472f-8cca-8438d15de3e2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 4fcbd3c0-2201-41bb-ab2a-31262aba36dd] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:59.310041 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d08c9aed-0008-472f-8cca-8438d15de3e2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:59.310538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d08c9aed-0008-472f-8cca-8438d15de3e2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:59.311034 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d08c9aed-0008-472f-8cca-8438d15de3e2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:59.311970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d08c9aed-0008-472f-8cca-8438d15de3e2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:59.312602 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d08c9aed-0008-472f-8cca-8438d15de3e2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:59.313041 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d08c9aed-0008-472f-8cca-8438d15de3e2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:59.318254 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:59.428648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5d1c750e-0d62-4501-8ca3-86da930c5f68 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:59.439008 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5d1c750e-0d62-4501-8ca3-86da930c5f68 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/e67fc2ff-0549-433f-9385-cc71740b93c4" status: 200 len: 1512 microversion: 2.1 time: 0.438099 Aug 04 17:10:59.439539 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2004/3937] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:58 2022] GET /compute/v2.1/servers/e67fc2ff-0549-433f-9385-cc71740b93c4 => generated 1512 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:59.460767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d3786894-96fe-4b77-b666-97d9031566a7 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:59.470896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d3786894-96fe-4b77-b666-97d9031566a7 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:59.477443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3786894-96fe-4b77-b666-97d9031566a7 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:59.477936 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3786894-96fe-4b77-b666-97d9031566a7 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:59.478533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3786894-96fe-4b77-b666-97d9031566a7 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:59.479249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3786894-96fe-4b77-b666-97d9031566a7 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:59.479707 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3786894-96fe-4b77-b666-97d9031566a7 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:59.480165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3786894-96fe-4b77-b666-97d9031566a7 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:59.637773 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:59.660202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d08c9aed-0008-472f-8cca-8438d15de3e2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:59.662178 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:10:59.668477 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d08c9aed-0008-472f-8cca-8438d15de3e2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd" status: 200 len: 1315 microversion: 2.1 time: 0.370669 Aug 04 17:10:59.682262 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1934/3938] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:59 2022] GET /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:59.687108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7d386db8-c583-46ff-b993-a34939af899d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:59.692319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7d386db8-c583-46ff-b993-a34939af899d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:59.693181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7d386db8-c583-46ff-b993-a34939af899d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'e61b34a0cac845c49d7c334921af14c1'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:10:59.705908 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d386db8-c583-46ff-b993-a34939af899d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:59.706429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d386db8-c583-46ff-b993-a34939af899d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:59.706930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d386db8-c583-46ff-b993-a34939af899d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:59.707663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d386db8-c583-46ff-b993-a34939af899d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:59.708120 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d386db8-c583-46ff-b993-a34939af899d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:59.708579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d386db8-c583-46ff-b993-a34939af899d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:59.800248 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-7d386db8-c583-46ff-b993-a34939af899d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:10:59.825645 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d3786894-96fe-4b77-b666-97d9031566a7 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:59.835277 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d3786894-96fe-4b77-b666-97d9031566a7 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 200 len: 1522 microversion: 2.1 time: 0.383828 Aug 04 17:10:59.849593 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2005/3939] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:10:59 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:10:59.849593 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b6f41d9b-125f-47aa-a131-1ecf1394e187 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:10:59.849593 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b6f41d9b-125f-47aa-a131-1ecf1394e187 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:10:59.851166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6f41d9b-125f-47aa-a131-1ecf1394e187 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:59.851882 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6f41d9b-125f-47aa-a131-1ecf1394e187 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:59.852393 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6f41d9b-125f-47aa-a131-1ecf1394e187 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:59.853198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6f41d9b-125f-47aa-a131-1ecf1394e187 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:59.853731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6f41d9b-125f-47aa-a131-1ecf1394e187 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:59.854252 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6f41d9b-125f-47aa-a131-1ecf1394e187 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:59.873896 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7d386db8-c583-46ff-b993-a34939af899d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:59.880601 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d386db8-c583-46ff-b993-a34939af899d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:10:59.881098 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d386db8-c583-46ff-b993-a34939af899d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:10:59.881541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d386db8-c583-46ff-b993-a34939af899d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:10:59.986658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b6f41d9b-125f-47aa-a131-1ecf1394e187 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:59.995176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b6f41d9b-125f-47aa-a131-1ecf1394e187 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:59.996720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b6f41d9b-125f-47aa-a131-1ecf1394e187 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:10:59.997942 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b6f41d9b-125f-47aa-a131-1ecf1394e187 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1370 microversion: 2.57 time: 0.160481 Aug 04 17:11:00.010802 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2006/3940] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:10:59 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:11:00.252605 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7d386db8-c583-46ff-b993-a34939af899d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.569153 Aug 04 17:11:00.253191 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1935/3941] 10.222.0.93 () {58 vars in 1167 bytes} [Thu Aug 4 17:10:59 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:00.278317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f4516ac1-fec5-4b20-a875-fbbec5fc60c0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:00.283624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f4516ac1-fec5-4b20-a875-fbbec5fc60c0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:00.284580 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f4516ac1-fec5-4b20-a875-fbbec5fc60c0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-727969488', 'deleted': False, 'project_id': 'e61b34a0cac845c49d7c334921af14c1'} {{(pid=131043) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:11:00.291775 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f4516ac1-fec5-4b20-a875-fbbec5fc60c0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:00.292264 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f4516ac1-fec5-4b20-a875-fbbec5fc60c0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:00.292702 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f4516ac1-fec5-4b20-a875-fbbec5fc60c0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:00.293427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f4516ac1-fec5-4b20-a875-fbbec5fc60c0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:00.294099 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f4516ac1-fec5-4b20-a875-fbbec5fc60c0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:00.294698 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f4516ac1-fec5-4b20-a875-fbbec5fc60c0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:00.397271 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.multi_cell_list [None req-f4516ac1-fec5-4b20-a875-fbbec5fc60c0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:11:00.472968 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f4516ac1-fec5-4b20-a875-fbbec5fc60c0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:00.478125 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:00.480998 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f4516ac1-fec5-4b20-a875-fbbec5fc60c0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:00.481645 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f4516ac1-fec5-4b20-a875-fbbec5fc60c0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:00.482233 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f4516ac1-fec5-4b20-a875-fbbec5fc60c0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:00.689728 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a40287c0-2ba9-4cc5-abe5-833896fbcc54 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:00.690518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a40287c0-2ba9-4cc5-abe5-833896fbcc54 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 4fcbd3c0-2201-41bb-ab2a-31262aba36dd] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:00.697044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a40287c0-2ba9-4cc5-abe5-833896fbcc54 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:00.697539 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a40287c0-2ba9-4cc5-abe5-833896fbcc54 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:00.698028 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a40287c0-2ba9-4cc5-abe5-833896fbcc54 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:00.698736 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a40287c0-2ba9-4cc5-abe5-833896fbcc54 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:00.699197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a40287c0-2ba9-4cc5-abe5-833896fbcc54 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:00.699627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a40287c0-2ba9-4cc5-abe5-833896fbcc54 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:01.107875 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f4516ac1-fec5-4b20-a875-fbbec5fc60c0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-727969488" status: 200 len: 1514 microversion: 2.1 time: 0.828437 Aug 04 17:11:01.112817 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2007/3942] 10.222.0.93 () {58 vars in 1261 bytes} [Thu Aug 4 17:11:00 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-727969488 => generated 1514 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:11:01.136004 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e0496d7f-98e8-443d-8752-2b06a0773b09 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:01.136921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e0496d7f-98e8-443d-8752-2b06a0773b09 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:01.142968 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0496d7f-98e8-443d-8752-2b06a0773b09 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:01.143458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0496d7f-98e8-443d-8752-2b06a0773b09 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:01.144273 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0496d7f-98e8-443d-8752-2b06a0773b09 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:01.144993 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0496d7f-98e8-443d-8752-2b06a0773b09 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:01.145454 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0496d7f-98e8-443d-8752-2b06a0773b09 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:01.146253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0496d7f-98e8-443d-8752-2b06a0773b09 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:01.376278 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a40287c0-2ba9-4cc5-abe5-833896fbcc54 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:01.383832 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a40287c0-2ba9-4cc5-abe5-833896fbcc54 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd" status: 200 len: 1315 microversion: 2.1 time: 0.699083 Aug 04 17:11:01.384409 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1936/3943] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:00 2022] GET /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd => generated 1315 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:11:01.388911 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-418f9a15-7a53-443d-94e8-6cb433be71dc tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:01.389522 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-418f9a15-7a53-443d-94e8-6cb433be71dc tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:01.395451 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-418f9a15-7a53-443d-94e8-6cb433be71dc tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:01.395944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-418f9a15-7a53-443d-94e8-6cb433be71dc tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:01.396384 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-418f9a15-7a53-443d-94e8-6cb433be71dc tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:01.397084 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-418f9a15-7a53-443d-94e8-6cb433be71dc tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:01.397543 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-418f9a15-7a53-443d-94e8-6cb433be71dc tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:01.397993 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-418f9a15-7a53-443d-94e8-6cb433be71dc tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:01.533060 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-418f9a15-7a53-443d-94e8-6cb433be71dc tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:01.541482 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-418f9a15-7a53-443d-94e8-6cb433be71dc tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:01.543016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-418f9a15-7a53-443d-94e8-6cb433be71dc tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:01.544189 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-418f9a15-7a53-443d-94e8-6cb433be71dc tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1355 microversion: 2.57 time: 0.158854 Aug 04 17:11:01.544773 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1937/3944] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:11:01 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1355 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:11:01.549089 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3d38167d-d826-48c1-9ea5-b05808166ba5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:01.554387 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3d38167d-d826-48c1-9ea5-b05808166ba5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:01.555198 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3d38167d-d826-48c1-9ea5-b05808166ba5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'e61b34a0cac845c49d7c334921af14c1'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:11:01.562485 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d38167d-d826-48c1-9ea5-b05808166ba5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:01.563184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d38167d-d826-48c1-9ea5-b05808166ba5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:01.563878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d38167d-d826-48c1-9ea5-b05808166ba5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:01.564779 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d38167d-d826-48c1-9ea5-b05808166ba5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:01.565471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d38167d-d826-48c1-9ea5-b05808166ba5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:01.566367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d38167d-d826-48c1-9ea5-b05808166ba5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:01.595124 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e0496d7f-98e8-443d-8752-2b06a0773b09 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:01.618116 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e0496d7f-98e8-443d-8752-2b06a0773b09 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 200 len: 1522 microversion: 2.1 time: 0.492371 Aug 04 17:11:01.621008 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2008/3945] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:01 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 1522 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:01.632548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-38261092-a66e-4a7b-ad68-b0469b8cdaba tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:01.633525 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-38261092-a66e-4a7b-ad68-b0469b8cdaba tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:01.652720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38261092-a66e-4a7b-ad68-b0469b8cdaba tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:01.653233 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38261092-a66e-4a7b-ad68-b0469b8cdaba tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:01.653684 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38261092-a66e-4a7b-ad68-b0469b8cdaba tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:01.654435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38261092-a66e-4a7b-ad68-b0469b8cdaba tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:01.654897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38261092-a66e-4a7b-ad68-b0469b8cdaba tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:01.670544 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38261092-a66e-4a7b-ad68-b0469b8cdaba tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:01.709262 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-38261092-a66e-4a7b-ad68-b0469b8cdaba tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:11:01.862509 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-38261092-a66e-4a7b-ad68-b0469b8cdaba tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "DELETE /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 204 len: 0 microversion: 2.57 time: 0.239769 Aug 04 17:11:01.863497 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2009/3946] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Aug 4 17:11:01 2022] DELETE /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:11:01.872988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-258a69a3-56b5-4897-9c44-ce6c7812b751 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:01.874043 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-258a69a3-56b5-4897-9c44-ce6c7812b751 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:01.882549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-258a69a3-56b5-4897-9c44-ce6c7812b751 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:01.883827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-258a69a3-56b5-4897-9c44-ce6c7812b751 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:01.884490 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-258a69a3-56b5-4897-9c44-ce6c7812b751 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:01.885634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-258a69a3-56b5-4897-9c44-ce6c7812b751 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:01.888553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-258a69a3-56b5-4897-9c44-ce6c7812b751 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:01.889273 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-258a69a3-56b5-4897-9c44-ce6c7812b751 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:02.039608 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-258a69a3-56b5-4897-9c44-ce6c7812b751 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:02.043137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:02.051510 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-3d38167d-d826-48c1-9ea5-b05808166ba5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:11:02.056721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-258a69a3-56b5-4897-9c44-ce6c7812b751 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:02.059099 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-258a69a3-56b5-4897-9c44-ce6c7812b751 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:02.061105 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-258a69a3-56b5-4897-9c44-ce6c7812b751 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1361 microversion: 2.57 time: 0.193078 Aug 04 17:11:02.062449 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2010/3947] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:11:01 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1361 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:11:02.128748 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3d38167d-d826-48c1-9ea5-b05808166ba5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:02.139712 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d38167d-d826-48c1-9ea5-b05808166ba5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:02.140418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d38167d-d826-48c1-9ea5-b05808166ba5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:02.141050 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d38167d-d826-48c1-9ea5-b05808166ba5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:02.406255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9b49f8e3-f225-4e9a-947f-1f3ea77491d6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:02.406873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9b49f8e3-f225-4e9a-947f-1f3ea77491d6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 4fcbd3c0-2201-41bb-ab2a-31262aba36dd] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:02.422668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b49f8e3-f225-4e9a-947f-1f3ea77491d6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:02.423196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b49f8e3-f225-4e9a-947f-1f3ea77491d6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:02.423650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b49f8e3-f225-4e9a-947f-1f3ea77491d6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:02.424382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b49f8e3-f225-4e9a-947f-1f3ea77491d6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:02.424851 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b49f8e3-f225-4e9a-947f-1f3ea77491d6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:02.425294 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b49f8e3-f225-4e9a-947f-1f3ea77491d6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:02.447949 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3d38167d-d826-48c1-9ea5-b05808166ba5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4518 microversion: 2.1 time: 0.901752 Aug 04 17:11:02.449218 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1938/3948] 10.222.0.93 () {58 vars in 1173 bytes} [Thu Aug 4 17:11:01 2022] GET /compute/v2.1/servers/detail?status=active => generated 4518 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:02.473884 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-177674a5-6ac8-432d-89f1-d7960c2ed176 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:02.479363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-177674a5-6ac8-432d-89f1-d7960c2ed176 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:02.479595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.compute.servers [None req-177674a5-6ac8-432d-89f1-d7960c2ed176 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Removing options 'limit' from query {{(pid=131044) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 04 17:11:02.480335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-177674a5-6ac8-432d-89f1-d7960c2ed176 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Searching by: {'deleted': False, 'project_id': 'e61b34a0cac845c49d7c334921af14c1'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:11:02.485830 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-177674a5-6ac8-432d-89f1-d7960c2ed176 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:02.486363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-177674a5-6ac8-432d-89f1-d7960c2ed176 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:02.486799 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-177674a5-6ac8-432d-89f1-d7960c2ed176 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:02.487540 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-177674a5-6ac8-432d-89f1-d7960c2ed176 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:02.487999 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-177674a5-6ac8-432d-89f1-d7960c2ed176 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:02.488429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-177674a5-6ac8-432d-89f1-d7960c2ed176 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:02.527623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-177674a5-6ac8-432d-89f1-d7960c2ed176 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:02.534462 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-177674a5-6ac8-432d-89f1-d7960c2ed176 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:02.534947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-177674a5-6ac8-432d-89f1-d7960c2ed176 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:02.535390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-177674a5-6ac8-432d-89f1-d7960c2ed176 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:02.685615 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-177674a5-6ac8-432d-89f1-d7960c2ed176 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.215580 Aug 04 17:11:02.686458 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1939/3949] 10.222.0.93 () {58 vars in 1161 bytes} [Thu Aug 4 17:11:02 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:11:02.691942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e11c8180-3fbe-4ee8-b3f8-78e8ecb91cd9 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:02.693212 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e11c8180-3fbe-4ee8-b3f8-78e8ecb91cd9 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:02.699530 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e11c8180-3fbe-4ee8-b3f8-78e8ecb91cd9 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:02.700028 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e11c8180-3fbe-4ee8-b3f8-78e8ecb91cd9 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:02.700470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e11c8180-3fbe-4ee8-b3f8-78e8ecb91cd9 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:02.701608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e11c8180-3fbe-4ee8-b3f8-78e8ecb91cd9 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:02.703090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e11c8180-3fbe-4ee8-b3f8-78e8ecb91cd9 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:02.703560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e11c8180-3fbe-4ee8-b3f8-78e8ecb91cd9 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:02.889468 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9b49f8e3-f225-4e9a-947f-1f3ea77491d6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:02.898183 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9b49f8e3-f225-4e9a-947f-1f3ea77491d6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd" status: 200 len: 1501 microversion: 2.1 time: 0.495746 Aug 04 17:11:02.899337 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2011/3950] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:02 2022] GET /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd => generated 1501 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:11:02.904445 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0a97b921-db6a-46d6-8ac9-5ad7bb3df454 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:02.911246 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0a97b921-db6a-46d6-8ac9-5ad7bb3df454 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:02.912117 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0a97b921-db6a-46d6-8ac9-5ad7bb3df454 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'e61b34a0cac845c49d7c334921af14c1'} {{(pid=131043) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:11:02.917543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0a97b921-db6a-46d6-8ac9-5ad7bb3df454 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:02.918229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0a97b921-db6a-46d6-8ac9-5ad7bb3df454 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:02.919003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0a97b921-db6a-46d6-8ac9-5ad7bb3df454 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:02.919750 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0a97b921-db6a-46d6-8ac9-5ad7bb3df454 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:02.920219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0a97b921-db6a-46d6-8ac9-5ad7bb3df454 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:02.920798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0a97b921-db6a-46d6-8ac9-5ad7bb3df454 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:02.923364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e11c8180-3fbe-4ee8-b3f8-78e8ecb91cd9 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:02.937604 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e11c8180-3fbe-4ee8-b3f8-78e8ecb91cd9 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 200 len: 1522 microversion: 2.1 time: 0.250276 Aug 04 17:11:02.940731 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1940/3951] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:02 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:02.946347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fd7bb24c-85ce-46cc-b815-58bd70629077 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:02.952472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.multi_cell_list [None req-0a97b921-db6a-46d6-8ac9-5ad7bb3df454 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:11:02.955246 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fd7bb24c-85ce-46cc-b815-58bd70629077 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 4fcbd3c0-2201-41bb-ab2a-31262aba36dd] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:02.962475 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd7bb24c-85ce-46cc-b815-58bd70629077 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:02.963254 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd7bb24c-85ce-46cc-b815-58bd70629077 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:02.964971 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd7bb24c-85ce-46cc-b815-58bd70629077 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:02.965965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd7bb24c-85ce-46cc-b815-58bd70629077 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:02.966607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd7bb24c-85ce-46cc-b815-58bd70629077 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:02.967108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd7bb24c-85ce-46cc-b815-58bd70629077 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:02.988295 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0a97b921-db6a-46d6-8ac9-5ad7bb3df454 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.087244 Aug 04 17:11:02.988944 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2012/3952] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Aug 4 17:11:02 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:03.002458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-16d0781c-21c5-410b-953d-353264101565 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:03.008331 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-16d0781c-21c5-410b-953d-353264101565 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:03.009057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.compute.servers [None req-16d0781c-21c5-410b-953d-353264101565 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Removing options 'limit' from query {{(pid=131043) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 04 17:11:03.010173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-16d0781c-21c5-410b-953d-353264101565 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Searching by: {'deleted': False, 'project_id': 'e61b34a0cac845c49d7c334921af14c1'} {{(pid=131043) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:11:03.015666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16d0781c-21c5-410b-953d-353264101565 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:03.016159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16d0781c-21c5-410b-953d-353264101565 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:03.016609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16d0781c-21c5-410b-953d-353264101565 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:03.017345 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16d0781c-21c5-410b-953d-353264101565 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:03.017804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16d0781c-21c5-410b-953d-353264101565 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:03.018262 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16d0781c-21c5-410b-953d-353264101565 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:03.046734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.multi_cell_list [None req-16d0781c-21c5-410b-953d-353264101565 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:11:03.077891 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-16d0781c-21c5-410b-953d-353264101565 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.080167 Aug 04 17:11:03.087182 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2013/3953] 10.222.0.93 () {58 vars in 1150 bytes} [Thu Aug 4 17:11:02 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:11:03.087182 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-21741a5c-a136-4e7a-a9ae-80de60cbe885 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:03.087182 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-21741a5c-a136-4e7a-a9ae-80de60cbe885 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:03.093461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-21741a5c-a136-4e7a-a9ae-80de60cbe885 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:03.094169 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-21741a5c-a136-4e7a-a9ae-80de60cbe885 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:03.094788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-21741a5c-a136-4e7a-a9ae-80de60cbe885 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:03.095510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-21741a5c-a136-4e7a-a9ae-80de60cbe885 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:03.095978 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-21741a5c-a136-4e7a-a9ae-80de60cbe885 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:03.096471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-21741a5c-a136-4e7a-a9ae-80de60cbe885 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:03.172711 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-21741a5c-a136-4e7a-a9ae-80de60cbe885 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:03.181094 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-21741a5c-a136-4e7a-a9ae-80de60cbe885 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:03.182686 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-21741a5c-a136-4e7a-a9ae-80de60cbe885 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:03.184196 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-21741a5c-a136-4e7a-a9ae-80de60cbe885 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1361 microversion: 2.57 time: 0.102901 Aug 04 17:11:03.194837 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2014/3954] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:11:03 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1361 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:11:03.204399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d93e1239-53b9-4a5a-ab4e-54f2e04fbebf tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:03.210335 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d93e1239-53b9-4a5a-ab4e-54f2e04fbebf tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:03.211315 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d93e1239-53b9-4a5a-ab4e-54f2e04fbebf tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Searching by: {'deleted': False, 'project_id': 'e61b34a0cac845c49d7c334921af14c1'} {{(pid=131043) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:11:03.218563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d93e1239-53b9-4a5a-ab4e-54f2e04fbebf tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:03.219066 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d93e1239-53b9-4a5a-ab4e-54f2e04fbebf tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:03.219507 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d93e1239-53b9-4a5a-ab4e-54f2e04fbebf tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:03.220403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d93e1239-53b9-4a5a-ab4e-54f2e04fbebf tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:03.220877 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d93e1239-53b9-4a5a-ab4e-54f2e04fbebf tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:03.221334 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d93e1239-53b9-4a5a-ab4e-54f2e04fbebf tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:03.256227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.multi_cell_list [None req-d93e1239-53b9-4a5a-ab4e-54f2e04fbebf tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:11:03.289637 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d93e1239-53b9-4a5a-ab4e-54f2e04fbebf tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.092072 Aug 04 17:11:03.298287 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2015/3955] 10.222.0.93 () {58 vars in 1125 bytes} [Thu Aug 4 17:11:03 2022] GET /compute/v2.1/servers => generated 1011 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:03.305772 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9063ef99-6779-4797-bef8-441befd7ea55 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:03.313167 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9063ef99-6779-4797-bef8-441befd7ea55 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:03.314812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9063ef99-6779-4797-bef8-441befd7ea55 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'e61b34a0cac845c49d7c334921af14c1'} {{(pid=131043) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:11:03.335878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9063ef99-6779-4797-bef8-441befd7ea55 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:03.336381 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9063ef99-6779-4797-bef8-441befd7ea55 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:03.336827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9063ef99-6779-4797-bef8-441befd7ea55 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:03.337562 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9063ef99-6779-4797-bef8-441befd7ea55 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:03.338045 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9063ef99-6779-4797-bef8-441befd7ea55 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:03.339836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9063ef99-6779-4797-bef8-441befd7ea55 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:03.465359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.multi_cell_list [None req-9063ef99-6779-4797-bef8-441befd7ea55 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:11:03.535420 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9063ef99-6779-4797-bef8-441befd7ea55 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.235294 Aug 04 17:11:03.545007 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2016/3956] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 17:11:03 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:11:03.555700 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3b6062a9-78e9-425c-99dc-1b9c654ace68 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:03.562392 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3b6062a9-78e9-425c-99dc-1b9c654ace68 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:03.565687 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fd7bb24c-85ce-46cc-b815-58bd70629077 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd/action" status: 200 len: 14 microversion: 2.1 time: 0.623537 Aug 04 17:11:03.567140 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1941/3957] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:11:02 2022] POST /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd/action => generated 14 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:11:03.568571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.compute.servers [None req-3b6062a9-78e9-425c-99dc-1b9c654ace68 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Removing options 'limit' from query {{(pid=131043) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 04 17:11:03.569539 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3b6062a9-78e9-425c-99dc-1b9c654ace68 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Searching by: {'deleted': False, 'project_id': 'e61b34a0cac845c49d7c334921af14c1'} {{(pid=131043) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:11:03.577639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b6062a9-78e9-425c-99dc-1b9c654ace68 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:03.583149 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b6062a9-78e9-425c-99dc-1b9c654ace68 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:03.583623 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b6062a9-78e9-425c-99dc-1b9c654ace68 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:03.584464 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b6062a9-78e9-425c-99dc-1b9c654ace68 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:03.584942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b6062a9-78e9-425c-99dc-1b9c654ace68 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:03.585379 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b6062a9-78e9-425c-99dc-1b9c654ace68 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:03.631217 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3b6062a9-78e9-425c-99dc-1b9c654ace68 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.078624 Aug 04 17:11:03.631995 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2017/3958] 10.222.0.93 () {58 vars in 1140 bytes} [Thu Aug 4 17:11:03 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:11:03.647595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-983650bc-c12b-4d56-ae57-de16bcbb4e75 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:03.653319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-983650bc-c12b-4d56-ae57-de16bcbb4e75 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:03.654401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-983650bc-c12b-4d56-ae57-de16bcbb4e75 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-727969488', 'deleted': False, 'project_id': 'e61b34a0cac845c49d7c334921af14c1'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:11:03.668272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-983650bc-c12b-4d56-ae57-de16bcbb4e75 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:03.669090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-983650bc-c12b-4d56-ae57-de16bcbb4e75 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:03.669694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-983650bc-c12b-4d56-ae57-de16bcbb4e75 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:03.671601 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-983650bc-c12b-4d56-ae57-de16bcbb4e75 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:03.674571 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-983650bc-c12b-4d56-ae57-de16bcbb4e75 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:03.675203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-983650bc-c12b-4d56-ae57-de16bcbb4e75 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:03.786036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-983650bc-c12b-4d56-ae57-de16bcbb4e75 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:11:03.885620 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-983650bc-c12b-4d56-ae57-de16bcbb4e75 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-727969488" status: 200 len: 345 microversion: 2.1 time: 0.244116 Aug 04 17:11:03.886808 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1942/3959] 10.222.0.93 () {58 vars in 1240 bytes} [Thu Aug 4 17:11:03 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-727969488 => generated 345 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:11:03.901471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ee5a29cc-0a3e-4715-9c4b-8ebc75e36727 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:03.913756 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee5a29cc-0a3e-4715-9c4b-8ebc75e36727 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:03.914645 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee5a29cc-0a3e-4715-9c4b-8ebc75e36727 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:03.915307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee5a29cc-0a3e-4715-9c4b-8ebc75e36727 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:03.960981 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-835200ba-c783-4586-9aab-fb982b611802 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:03.961770 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-835200ba-c783-4586-9aab-fb982b611802 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:03.971281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-835200ba-c783-4586-9aab-fb982b611802 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:03.971783 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-835200ba-c783-4586-9aab-fb982b611802 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:03.976864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-835200ba-c783-4586-9aab-fb982b611802 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:03.978067 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-835200ba-c783-4586-9aab-fb982b611802 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:03.978560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-835200ba-c783-4586-9aab-fb982b611802 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:03.979007 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-835200ba-c783-4586-9aab-fb982b611802 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:03.996002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ee5a29cc-0a3e-4715-9c4b-8ebc75e36727 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 01c2f9e6-2bf7-4013-b254-0dac8e579962] Going to try to stop instance {{(pid=131043) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 17:11:04.071835 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ee5a29cc-0a3e-4715-9c4b-8ebc75e36727 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "POST /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962/action" status: 202 len: 0 microversion: 2.1 time: 0.175281 Aug 04 17:11:04.073183 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2018/3960] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:11:03 2022] POST /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:11:04.081894 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-73d64b07-6aa4-473f-92a4-f939a47795d0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:04.083513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-73d64b07-6aa4-473f-92a4-f939a47795d0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 01c2f9e6-2bf7-4013-b254-0dac8e579962] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:04.094894 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73d64b07-6aa4-473f-92a4-f939a47795d0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:04.095677 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73d64b07-6aa4-473f-92a4-f939a47795d0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:04.096309 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73d64b07-6aa4-473f-92a4-f939a47795d0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:04.097660 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73d64b07-6aa4-473f-92a4-f939a47795d0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:04.098362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73d64b07-6aa4-473f-92a4-f939a47795d0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:04.099546 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73d64b07-6aa4-473f-92a4-f939a47795d0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:04.357581 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-835200ba-c783-4586-9aab-fb982b611802 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:04.369892 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-835200ba-c783-4586-9aab-fb982b611802 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 200 len: 1522 microversion: 2.1 time: 0.412977 Aug 04 17:11:04.372326 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1943/3961] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:03 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:04.378074 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-065aa018-ec63-4f9b-b6cc-61965b5a6447 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:04.378724 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-065aa018-ec63-4f9b-b6cc-61965b5a6447 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:04.394009 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-065aa018-ec63-4f9b-b6cc-61965b5a6447 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:04.394560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-065aa018-ec63-4f9b-b6cc-61965b5a6447 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:04.395057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-065aa018-ec63-4f9b-b6cc-61965b5a6447 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:04.396504 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-065aa018-ec63-4f9b-b6cc-61965b5a6447 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:04.396972 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-065aa018-ec63-4f9b-b6cc-61965b5a6447 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:04.399006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-065aa018-ec63-4f9b-b6cc-61965b5a6447 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:04.427833 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-73d64b07-6aa4-473f-92a4-f939a47795d0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:04.437860 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-73d64b07-6aa4-473f-92a4-f939a47795d0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962" status: 200 len: 1521 microversion: 2.1 time: 0.360243 Aug 04 17:11:04.439714 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2019/3962] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:04 2022] GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962 => generated 1521 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:11:04.457627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-065aa018-ec63-4f9b-b6cc-61965b5a6447 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:04.459745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-065aa018-ec63-4f9b-b6cc-61965b5a6447 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:04.460605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-065aa018-ec63-4f9b-b6cc-61965b5a6447 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:04.461381 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-065aa018-ec63-4f9b-b6cc-61965b5a6447 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lazy-loading 'fault' on Instance uuid 65404708-44f2-451f-9064-a2eb36cd568d {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:11:04.529881 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-065aa018-ec63-4f9b-b6cc-61965b5a6447 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:04.548568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-065aa018-ec63-4f9b-b6cc-61965b5a6447 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:04.550232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-065aa018-ec63-4f9b-b6cc-61965b5a6447 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f036da5a777b4bfba62508ab9cec1251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64a0fa6086f24cf88cb5c172b36788f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:04.551705 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-065aa018-ec63-4f9b-b6cc-61965b5a6447 tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 200 len: 1366 microversion: 2.57 time: 0.178268 Aug 04 17:11:04.553011 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1944/3963] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:11:04 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:11:04.580418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f927887f-d21e-4c50-901c-9567862fac6d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:04.583001 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f927887f-d21e-4c50-901c-9567862fac6d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 4fcbd3c0-2201-41bb-ab2a-31262aba36dd] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:04.589693 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f927887f-d21e-4c50-901c-9567862fac6d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:04.590236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f927887f-d21e-4c50-901c-9567862fac6d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:04.590688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f927887f-d21e-4c50-901c-9567862fac6d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:04.591386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f927887f-d21e-4c50-901c-9567862fac6d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:04.591856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f927887f-d21e-4c50-901c-9567862fac6d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:04.592293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f927887f-d21e-4c50-901c-9567862fac6d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:04.660876 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f927887f-d21e-4c50-901c-9567862fac6d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd/action" status: 200 len: 14 microversion: 2.1 time: 0.085448 Aug 04 17:11:04.662496 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2020/3964] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:11:04 2022] POST /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:11:05.397473 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4c85d3c1-2864-4159-a92e-ab8637808934 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:05.398935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4c85d3c1-2864-4159-a92e-ab8637808934 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:05.407595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c85d3c1-2864-4159-a92e-ab8637808934 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:05.408459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c85d3c1-2864-4159-a92e-ab8637808934 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:05.409731 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c85d3c1-2864-4159-a92e-ab8637808934 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:05.411012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c85d3c1-2864-4159-a92e-ab8637808934 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:05.411742 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c85d3c1-2864-4159-a92e-ab8637808934 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:05.412393 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c85d3c1-2864-4159-a92e-ab8637808934 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:05.465040 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2b822d1f-e729-4e97-b30c-e40859ec2376 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:05.465745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2b822d1f-e729-4e97-b30c-e40859ec2376 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 01c2f9e6-2bf7-4013-b254-0dac8e579962] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:05.474323 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b822d1f-e729-4e97-b30c-e40859ec2376 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:05.474954 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b822d1f-e729-4e97-b30c-e40859ec2376 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:05.475401 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b822d1f-e729-4e97-b30c-e40859ec2376 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:05.476108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b822d1f-e729-4e97-b30c-e40859ec2376 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:05.476568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b822d1f-e729-4e97-b30c-e40859ec2376 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:05.476998 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b822d1f-e729-4e97-b30c-e40859ec2376 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:05.789995 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4c85d3c1-2864-4159-a92e-ab8637808934 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:05.798790 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4c85d3c1-2864-4159-a92e-ab8637808934 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 200 len: 1522 microversion: 2.1 time: 0.405758 Aug 04 17:11:05.800249 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1945/3965] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:05 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:05.807383 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0bc8f614-1fbe-404d-a0e0-497e94d73e3b tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:05.808250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0bc8f614-1fbe-404d-a0e0-497e94d73e3b tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] [instance: 65404708-44f2-451f-9064-a2eb36cd568d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:05.816432 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bc8f614-1fbe-404d-a0e0-497e94d73e3b tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:05.817307 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bc8f614-1fbe-404d-a0e0-497e94d73e3b tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:05.818638 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bc8f614-1fbe-404d-a0e0-497e94d73e3b tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:05.820057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bc8f614-1fbe-404d-a0e0-497e94d73e3b tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:05.820751 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bc8f614-1fbe-404d-a0e0-497e94d73e3b tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:05.821404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bc8f614-1fbe-404d-a0e0-497e94d73e3b tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:05.838001 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-0bc8f614-1fbe-404d-a0e0-497e94d73e3b tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] HTTP exception thrown: Instance 65404708-44f2-451f-9064-a2eb36cd568d could not be found. Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0bc8f614-1fbe-404d-a0e0-497e94d73e3b tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Request method failure captured: Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d HTTP/1.1 Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_16TXnTHM8Ed1IMhryW712D9fK5Tn7T3gv4DtXugpQoENShMXBmIuzUDYZhAgDkmy_dnqdSLxjrQ9CfXb7ZErew6o8c_4kA7XblAtYaaPKU0B2WND_0e3-BLvSRhuOsIiI75VJSYaJgWIURhpVPlzf7vB43Xgkq-yXUBf7LcZDpLLo Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.57 Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 64a0fa6086f24cf88cb5c172b36788f8 Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerShowV257Test-1234486187 Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/64a0fa6086f24cf88cb5c172b36788f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/64a0fa6086f24cf88cb5c172b36788f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_64a0fa6086f24cf88cb5c172b36788f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/64a0fa6086f24cf88cb5c172b36788f8"}]}] Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServerShowV257Test-1234486187 Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 64a0fa6086f24cf88cb5c172b36788f8 Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerShowV257Test-1234486187 Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServerShowV257Test-1234486187-project Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: f036da5a777b4bfba62508ab9cec1251 Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServerShowV257Test-1234486187-project Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 65404708-44f2-451f-9064-a2eb36cd568d could not be found. Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '65404708-44f2-451f-9064-a2eb36cd568d'} Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65404708-44f2-451f-9064-a2eb36cd568d could not be found. Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65404708-44f2-451f-9064-a2eb36cd568d could not be found. Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:11:05.839974 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:11:05.845041 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:05.845041 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:11:05.845041 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:11:05.845041 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:11:05.845041 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:11:05.845041 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65404708-44f2-451f-9064-a2eb36cd568d could not be found. Aug 04 17:11:05.845041 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:11:05.845041 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0bc8f614-1fbe-404d-a0e0-497e94d73e3b tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] Returning 404 to user: Instance 65404708-44f2-451f-9064-a2eb36cd568d could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:11:05.845041 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0bc8f614-1fbe-404d-a0e0-497e94d73e3b tempest-ServerShowV257Test-1234486187 tempest-ServerShowV257Test-1234486187-project] 10.222.0.93 "GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d" status: 404 len: 111 microversion: 2.57 time: 0.040036 Aug 04 17:11:05.845041 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1946/3966] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:11:05 2022] GET /compute/v2.1/servers/65404708-44f2-451f-9064-a2eb36cd568d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:11:05.849354 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2b822d1f-e729-4e97-b30c-e40859ec2376 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:05.851541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c71aa8ab-284a-4df1-9788-91c91d3afe2a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:05.853752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c71aa8ab-284a-4df1-9788-91c91d3afe2a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 4fcbd3c0-2201-41bb-ab2a-31262aba36dd] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:05.860208 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2b822d1f-e729-4e97-b30c-e40859ec2376 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962" status: 200 len: 1521 microversion: 2.1 time: 0.399439 Aug 04 17:11:05.862566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c71aa8ab-284a-4df1-9788-91c91d3afe2a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:05.862724 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2021/3967] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:05 2022] GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962 => generated 1521 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:11:05.863065 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c71aa8ab-284a-4df1-9788-91c91d3afe2a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:05.863509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c71aa8ab-284a-4df1-9788-91c91d3afe2a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:05.864280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c71aa8ab-284a-4df1-9788-91c91d3afe2a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:05.865055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c71aa8ab-284a-4df1-9788-91c91d3afe2a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:05.865773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c71aa8ab-284a-4df1-9788-91c91d3afe2a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:05.939780 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c71aa8ab-284a-4df1-9788-91c91d3afe2a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd/action" status: 200 len: 14 microversion: 2.1 time: 0.094064 Aug 04 17:11:05.941283 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1947/3968] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:11:05 2022] POST /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:11:06.826230 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3652381e-a79a-4ad5-bffb-e696bb54e66a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:06.827057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3652381e-a79a-4ad5-bffb-e696bb54e66a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:06.839797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3652381e-a79a-4ad5-bffb-e696bb54e66a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:06.840376 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3652381e-a79a-4ad5-bffb-e696bb54e66a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:06.840839 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3652381e-a79a-4ad5-bffb-e696bb54e66a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:06.841571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3652381e-a79a-4ad5-bffb-e696bb54e66a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:06.842678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3652381e-a79a-4ad5-bffb-e696bb54e66a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:06.843122 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3652381e-a79a-4ad5-bffb-e696bb54e66a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:06.884555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-077aafb4-eebd-4658-9ff7-02ef88a8b169 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:06.885874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-077aafb4-eebd-4658-9ff7-02ef88a8b169 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 01c2f9e6-2bf7-4013-b254-0dac8e579962] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:06.894686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-077aafb4-eebd-4658-9ff7-02ef88a8b169 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:06.895184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-077aafb4-eebd-4658-9ff7-02ef88a8b169 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:06.895855 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-077aafb4-eebd-4658-9ff7-02ef88a8b169 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:06.896765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-077aafb4-eebd-4658-9ff7-02ef88a8b169 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:06.897728 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-077aafb4-eebd-4658-9ff7-02ef88a8b169 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:06.898524 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-077aafb4-eebd-4658-9ff7-02ef88a8b169 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:07.170364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3652381e-a79a-4ad5-bffb-e696bb54e66a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:07.179109 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3652381e-a79a-4ad5-bffb-e696bb54e66a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 200 len: 1522 microversion: 2.1 time: 0.356992 Aug 04 17:11:07.180026 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2022/3969] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:06 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:07.190319 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fdf21ca6-16a0-4a60-abd1-d083c5c8c97d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:07.193220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fdf21ca6-16a0-4a60-abd1-d083c5c8c97d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 4fcbd3c0-2201-41bb-ab2a-31262aba36dd] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:07.203802 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdf21ca6-16a0-4a60-abd1-d083c5c8c97d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:07.204478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdf21ca6-16a0-4a60-abd1-d083c5c8c97d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:07.205156 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdf21ca6-16a0-4a60-abd1-d083c5c8c97d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:07.205994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdf21ca6-16a0-4a60-abd1-d083c5c8c97d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:07.206489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdf21ca6-16a0-4a60-abd1-d083c5c8c97d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:07.207472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdf21ca6-16a0-4a60-abd1-d083c5c8c97d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:07.274339 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fdf21ca6-16a0-4a60-abd1-d083c5c8c97d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd/action" status: 200 len: 14 microversion: 2.1 time: 0.092583 Aug 04 17:11:07.275214 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2023/3970] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:11:07 2022] POST /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:11:07.568947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-077aafb4-eebd-4658-9ff7-02ef88a8b169 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:07.582129 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-077aafb4-eebd-4658-9ff7-02ef88a8b169 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962" status: 200 len: 1521 microversion: 2.1 time: 0.702616 Aug 04 17:11:07.583980 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1948/3971] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:06 2022] GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962 => generated 1521 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:08.205114 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c256c571-b505-4841-9e0f-bfde7d754366 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:08.206748 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c256c571-b505-4841-9e0f-bfde7d754366 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:08.222706 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c256c571-b505-4841-9e0f-bfde7d754366 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:08.224952 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c256c571-b505-4841-9e0f-bfde7d754366 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:08.226559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c256c571-b505-4841-9e0f-bfde7d754366 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:08.229774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c256c571-b505-4841-9e0f-bfde7d754366 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:08.231091 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c256c571-b505-4841-9e0f-bfde7d754366 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:08.231672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c256c571-b505-4841-9e0f-bfde7d754366 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:08.285859 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bf1a51dc-f077-4338-a693-8909a7005a8a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:08.288193 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bf1a51dc-f077-4338-a693-8909a7005a8a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 4fcbd3c0-2201-41bb-ab2a-31262aba36dd] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:08.298020 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf1a51dc-f077-4338-a693-8909a7005a8a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:08.299212 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf1a51dc-f077-4338-a693-8909a7005a8a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:08.299818 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf1a51dc-f077-4338-a693-8909a7005a8a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:08.300901 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf1a51dc-f077-4338-a693-8909a7005a8a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:08.301534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf1a51dc-f077-4338-a693-8909a7005a8a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:08.302204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf1a51dc-f077-4338-a693-8909a7005a8a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:08.380929 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bf1a51dc-f077-4338-a693-8909a7005a8a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd/action" status: 200 len: 14 microversion: 2.1 time: 0.098738 Aug 04 17:11:08.381708 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1949/3972] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:11:08 2022] POST /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 17:11:08.441014 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c256c571-b505-4841-9e0f-bfde7d754366 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:08.456768 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c256c571-b505-4841-9e0f-bfde7d754366 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 200 len: 1522 microversion: 2.1 time: 0.257951 Aug 04 17:11:08.462063 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2024/3973] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:08 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:08.606428 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5b08b8e5-ac33-4d67-9f7a-a776ce39c046 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:08.607379 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5b08b8e5-ac33-4d67-9f7a-a776ce39c046 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 01c2f9e6-2bf7-4013-b254-0dac8e579962] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:08.616073 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b08b8e5-ac33-4d67-9f7a-a776ce39c046 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:08.616840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b08b8e5-ac33-4d67-9f7a-a776ce39c046 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:08.617752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b08b8e5-ac33-4d67-9f7a-a776ce39c046 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:08.618805 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b08b8e5-ac33-4d67-9f7a-a776ce39c046 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:08.619460 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b08b8e5-ac33-4d67-9f7a-a776ce39c046 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:08.620062 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b08b8e5-ac33-4d67-9f7a-a776ce39c046 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:08.921864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5b08b8e5-ac33-4d67-9f7a-a776ce39c046 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:08.925640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:08.934184 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5b08b8e5-ac33-4d67-9f7a-a776ce39c046 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962" status: 200 len: 1521 microversion: 2.1 time: 0.334301 Aug 04 17:11:08.935537 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1950/3974] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:08 2022] GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962 => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:09.399487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7cdd0b30-cc81-4431-ae85-ae5c37db6cb1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:09.402989 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7cdd0b30-cc81-4431-ae85-ae5c37db6cb1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 4fcbd3c0-2201-41bb-ab2a-31262aba36dd] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:09.414671 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7cdd0b30-cc81-4431-ae85-ae5c37db6cb1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:09.415563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7cdd0b30-cc81-4431-ae85-ae5c37db6cb1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:09.416707 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7cdd0b30-cc81-4431-ae85-ae5c37db6cb1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:09.417969 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7cdd0b30-cc81-4431-ae85-ae5c37db6cb1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:09.418770 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7cdd0b30-cc81-4431-ae85-ae5c37db6cb1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:09.419473 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7cdd0b30-cc81-4431-ae85-ae5c37db6cb1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:09.482945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-225a6d66-536e-4050-a541-4bde68eaf047 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:09.484446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-225a6d66-536e-4050-a541-4bde68eaf047 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:09.492963 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7cdd0b30-cc81-4431-ae85-ae5c37db6cb1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd/action" status: 200 len: 14 microversion: 2.1 time: 0.104815 Aug 04 17:11:09.496066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-225a6d66-536e-4050-a541-4bde68eaf047 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:09.497284 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2025/3975] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:11:09 2022] POST /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:11:09.498107 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-225a6d66-536e-4050-a541-4bde68eaf047 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:09.498798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-225a6d66-536e-4050-a541-4bde68eaf047 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:09.499725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-225a6d66-536e-4050-a541-4bde68eaf047 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:09.500806 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-225a6d66-536e-4050-a541-4bde68eaf047 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:09.501466 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-225a6d66-536e-4050-a541-4bde68eaf047 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:09.810738 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-225a6d66-536e-4050-a541-4bde68eaf047 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:09.820990 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-225a6d66-536e-4050-a541-4bde68eaf047 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 200 len: 1522 microversion: 2.1 time: 0.343714 Aug 04 17:11:09.824448 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1951/3976] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:09 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:09.970858 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6b5f99d9-a1fd-45a7-96b2-2109020ca250 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:09.971767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6b5f99d9-a1fd-45a7-96b2-2109020ca250 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 01c2f9e6-2bf7-4013-b254-0dac8e579962] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:10.011799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6b5f99d9-a1fd-45a7-96b2-2109020ca250 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:10.012318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6b5f99d9-a1fd-45a7-96b2-2109020ca250 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:10.012770 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6b5f99d9-a1fd-45a7-96b2-2109020ca250 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:10.013496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6b5f99d9-a1fd-45a7-96b2-2109020ca250 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:10.014279 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6b5f99d9-a1fd-45a7-96b2-2109020ca250 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:10.022600 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6b5f99d9-a1fd-45a7-96b2-2109020ca250 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:10.071659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:10.436003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6b5f99d9-a1fd-45a7-96b2-2109020ca250 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:10.452969 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6b5f99d9-a1fd-45a7-96b2-2109020ca250 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962" status: 200 len: 1521 microversion: 2.1 time: 0.498112 Aug 04 17:11:10.453924 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2026/3977] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:09 2022] GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962 => generated 1521 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:10.509360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cae8b33c-5acf-45b9-a1b9-c69ff2861935 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:10.512466 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cae8b33c-5acf-45b9-a1b9-c69ff2861935 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 4fcbd3c0-2201-41bb-ab2a-31262aba36dd] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:10.521157 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cae8b33c-5acf-45b9-a1b9-c69ff2861935 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:10.522028 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cae8b33c-5acf-45b9-a1b9-c69ff2861935 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:10.522537 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cae8b33c-5acf-45b9-a1b9-c69ff2861935 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:10.523466 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cae8b33c-5acf-45b9-a1b9-c69ff2861935 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:10.524016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cae8b33c-5acf-45b9-a1b9-c69ff2861935 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:10.524548 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cae8b33c-5acf-45b9-a1b9-c69ff2861935 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:10.849923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5ffac533-b36b-453b-b3b1-3ecffe844f01 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:10.850698 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5ffac533-b36b-453b-b3b1-3ecffe844f01 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:10.857209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:10.876384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ffac533-b36b-453b-b3b1-3ecffe844f01 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:10.877124 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ffac533-b36b-453b-b3b1-3ecffe844f01 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:10.877591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ffac533-b36b-453b-b3b1-3ecffe844f01 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:10.879076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ffac533-b36b-453b-b3b1-3ecffe844f01 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:10.879574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ffac533-b36b-453b-b3b1-3ecffe844f01 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:10.880074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ffac533-b36b-453b-b3b1-3ecffe844f01 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:11.106251 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cae8b33c-5acf-45b9-a1b9-c69ff2861935 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd/action" status: 200 len: 14 microversion: 2.1 time: 0.601269 Aug 04 17:11:11.110476 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1952/3978] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:11:10 2022] POST /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd/action => generated 14 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:11:11.476630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8bf5cd95-cd19-4547-8c37-b06de69ffe01 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:11.477692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8bf5cd95-cd19-4547-8c37-b06de69ffe01 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 01c2f9e6-2bf7-4013-b254-0dac8e579962] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:11.489651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8bf5cd95-cd19-4547-8c37-b06de69ffe01 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:11.490390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8bf5cd95-cd19-4547-8c37-b06de69ffe01 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:11.491005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8bf5cd95-cd19-4547-8c37-b06de69ffe01 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:11.492643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8bf5cd95-cd19-4547-8c37-b06de69ffe01 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:11.493286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8bf5cd95-cd19-4547-8c37-b06de69ffe01 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:11.494442 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8bf5cd95-cd19-4547-8c37-b06de69ffe01 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:11.549094 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5ffac533-b36b-453b-b3b1-3ecffe844f01 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:11.565729 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5ffac533-b36b-453b-b3b1-3ecffe844f01 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 200 len: 1522 microversion: 2.1 time: 0.716774 Aug 04 17:11:11.566517 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2027/3979] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:10 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 1522 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:11.890832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8bf5cd95-cd19-4547-8c37-b06de69ffe01 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:11.921191 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8bf5cd95-cd19-4547-8c37-b06de69ffe01 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962" status: 200 len: 1521 microversion: 2.1 time: 0.449552 Aug 04 17:11:11.923063 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1953/3980] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:11 2022] GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962 => generated 1521 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:12.119487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d6358654-49c4-4e52-a341-f5262db6789c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:12.122607 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d6358654-49c4-4e52-a341-f5262db6789c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 4fcbd3c0-2201-41bb-ab2a-31262aba36dd] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:12.139973 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6358654-49c4-4e52-a341-f5262db6789c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:12.140667 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6358654-49c4-4e52-a341-f5262db6789c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:12.141299 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6358654-49c4-4e52-a341-f5262db6789c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:12.145290 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6358654-49c4-4e52-a341-f5262db6789c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:12.148161 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6358654-49c4-4e52-a341-f5262db6789c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:12.148889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6358654-49c4-4e52-a341-f5262db6789c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:12.317210 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d6358654-49c4-4e52-a341-f5262db6789c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd/action" status: 200 len: 14 microversion: 2.1 time: 0.203025 Aug 04 17:11:12.317862 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2028/3981] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:11:12 2022] POST /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd/action => generated 14 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:11:12.592502 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b3b1b0ae-3439-46dc-82a7-491c3f329b66 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:12.593136 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b3b1b0ae-3439-46dc-82a7-491c3f329b66 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:12.602749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=8 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:12.610854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3b1b0ae-3439-46dc-82a7-491c3f329b66 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:12.611619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3b1b0ae-3439-46dc-82a7-491c3f329b66 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:12.612283 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3b1b0ae-3439-46dc-82a7-491c3f329b66 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:12.615556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3b1b0ae-3439-46dc-82a7-491c3f329b66 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:12.617349 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3b1b0ae-3439-46dc-82a7-491c3f329b66 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:12.626767 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3b1b0ae-3439-46dc-82a7-491c3f329b66 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:12.947217 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a15cd948-2419-4dca-87d8-d93779775f2d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:12.948014 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a15cd948-2419-4dca-87d8-d93779775f2d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 01c2f9e6-2bf7-4013-b254-0dac8e579962] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:12.965061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a15cd948-2419-4dca-87d8-d93779775f2d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:12.967049 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a15cd948-2419-4dca-87d8-d93779775f2d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:12.967526 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a15cd948-2419-4dca-87d8-d93779775f2d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:12.968284 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a15cd948-2419-4dca-87d8-d93779775f2d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:12.968770 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a15cd948-2419-4dca-87d8-d93779775f2d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:12.969213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a15cd948-2419-4dca-87d8-d93779775f2d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:13.076981 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b3b1b0ae-3439-46dc-82a7-491c3f329b66 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:13.105867 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b3b1b0ae-3439-46dc-82a7-491c3f329b66 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 200 len: 1522 microversion: 2.1 time: 0.503620 Aug 04 17:11:13.107188 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1954/3982] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:12 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 1522 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:13.282821 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a15cd948-2419-4dca-87d8-d93779775f2d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:13.292202 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a15cd948-2419-4dca-87d8-d93779775f2d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962" status: 200 len: 1521 microversion: 2.1 time: 0.351574 Aug 04 17:11:13.307050 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2029/3983] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:12 2022] GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962 => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:13.328460 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ad36d813-0d0b-40f6-92de-a1377296ae21 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:13.332491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ad36d813-0d0b-40f6-92de-a1377296ae21 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 4fcbd3c0-2201-41bb-ab2a-31262aba36dd] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:13.343049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad36d813-0d0b-40f6-92de-a1377296ae21 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:13.343749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad36d813-0d0b-40f6-92de-a1377296ae21 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:13.344206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad36d813-0d0b-40f6-92de-a1377296ae21 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:13.345136 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad36d813-0d0b-40f6-92de-a1377296ae21 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:13.345609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad36d813-0d0b-40f6-92de-a1377296ae21 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:13.346264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad36d813-0d0b-40f6-92de-a1377296ae21 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:13.414513 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ad36d813-0d0b-40f6-92de-a1377296ae21 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd/action" status: 200 len: 14 microversion: 2.1 time: 0.089845 Aug 04 17:11:13.415269 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1955/3984] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:11:13 2022] POST /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:11:14.129289 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ec2bd5f4-a963-452b-891c-9e0d2bdafd4f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:14.130588 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ec2bd5f4-a963-452b-891c-9e0d2bdafd4f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:14.140002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=12 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:14.143826 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec2bd5f4-a963-452b-891c-9e0d2bdafd4f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:14.144752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec2bd5f4-a963-452b-891c-9e0d2bdafd4f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:14.145420 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec2bd5f4-a963-452b-891c-9e0d2bdafd4f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:14.146446 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec2bd5f4-a963-452b-891c-9e0d2bdafd4f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:14.147152 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec2bd5f4-a963-452b-891c-9e0d2bdafd4f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:14.147825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec2bd5f4-a963-452b-891c-9e0d2bdafd4f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:14.313368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2911b247-1402-4ac6-9ded-bbd5962d0820 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:14.314534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2911b247-1402-4ac6-9ded-bbd5962d0820 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 01c2f9e6-2bf7-4013-b254-0dac8e579962] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:14.318183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=8 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:14.332049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2911b247-1402-4ac6-9ded-bbd5962d0820 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:14.336493 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2911b247-1402-4ac6-9ded-bbd5962d0820 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:14.337078 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2911b247-1402-4ac6-9ded-bbd5962d0820 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:14.337943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2911b247-1402-4ac6-9ded-bbd5962d0820 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:14.339082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2911b247-1402-4ac6-9ded-bbd5962d0820 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:14.340739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2911b247-1402-4ac6-9ded-bbd5962d0820 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:14.386807 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ec2bd5f4-a963-452b-891c-9e0d2bdafd4f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:14.394860 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ec2bd5f4-a963-452b-891c-9e0d2bdafd4f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 200 len: 1502 microversion: 2.1 time: 0.269822 Aug 04 17:11:14.410698 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2030/3985] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:14 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 1502 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:14.422027 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f70db0b3-b60e-474f-a8c0-64749fc44234 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e1e77de-0a25-4bc3-ba28-e57a7711c24e"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:14.424881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f70db0b3-b60e-474f-a8c0-64749fc44234 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:14.451007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f70db0b3-b60e-474f-a8c0-64749fc44234 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:14.453622 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f70db0b3-b60e-474f-a8c0-64749fc44234 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:14.466407 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f70db0b3-b60e-474f-a8c0-64749fc44234 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:14.467715 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f70db0b3-b60e-474f-a8c0-64749fc44234 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:14.468233 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f70db0b3-b60e-474f-a8c0-64749fc44234 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:14.468703 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f70db0b3-b60e-474f-a8c0-64749fc44234 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:14.534901 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-f70db0b3-b60e-474f-a8c0-64749fc44234 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] HTTP exception thrown: Cannot 'attach_volume' instance 930cda99-f658-44c9-bb85-da349e9e5aeb while it is in vm_state rescued Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f70db0b3-b60e-474f-a8c0-64749fc44234 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Request method failure captured: Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb/os-volume_attachments HTTP/1.1 Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 74 Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_1KcpG4juUr2VEfzShlgrBBMonXazIZnBtgobublSG0FrbL-f6glawbXIezuRVmeGIpCPKZ2_FVYi6XXX8bEGfzlmqPmHXf6Tacw6jDfV9QuP1xJWCSlbaybEtYK4vIloCt34qv4iEL4IzCpH1AIgjNgga3059ie-t_wAucPvDkWig Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 50d2f7cd670340adb1b4187754e302c5 Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1121530457 Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/50d2f7cd670340adb1b4187754e302c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/50d2f7cd670340adb1b4187754e302c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_50d2f7cd670340adb1b4187754e302c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/50d2f7cd670340adb1b4187754e302c5"}]}] Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1121530457 Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 50d2f7cd670340adb1b4187754e302c5 Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1121530457 Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerRescueNegativeTestJSON-1121530457-project Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 067e98d624234a48bb0ea3bde77c049c Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1121530457-project Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: {"volumeAttachment": {"volumeId": "6e1e77de-0a25-4bc3-ba28-e57a7711c24e"}} Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: exception: Cannot 'attach_volume' instance 930cda99-f658-44c9-bb85-da349e9e5aeb while it is in vm_state rescued Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'server_id': '930cda99-f658-44c9-bb85-da349e9e5aeb', 'body': {'volumeAttachment': {'volumeId': '6e1e77de-0a25-4bc3-ba28-e57a7711c24e'}}} Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 930cda99-f658-44c9-bb85-da349e9e5aeb in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 04 17:11:14.536691 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 17:11:14.542868 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 17:11:14.542868 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 17:11:14.542868 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 930cda99-f658-44c9-bb85-da349e9e5aeb while it is in vm_state rescued Aug 04 17:11:14.542868 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:11:14.542868 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:11:14.542868 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:11:14.542868 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:14.542868 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:11:14.542868 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:11:14.542868 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:11:14.542868 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:11:14.542868 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 930cda99-f658-44c9-bb85-da349e9e5aeb while it is in vm_state rescued Aug 04 17:11:14.542868 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:11:14.542868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f70db0b3-b60e-474f-a8c0-64749fc44234 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Returning 409 to user: Cannot 'attach_volume' instance 930cda99-f658-44c9-bb85-da349e9e5aeb while it is in vm_state rescued {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:11:14.542868 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f70db0b3-b60e-474f-a8c0-64749fc44234 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "POST /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.124256 Aug 04 17:11:14.545627 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2031/3986] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Aug 4 17:11:14 2022] POST /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb/os-volume_attachments => generated 152 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:11:14.552563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9d3af9ab-5a01-4a07-8949-0a466b8563fa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:14.555214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9d3af9ab-5a01-4a07-8949-0a466b8563fa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 4fcbd3c0-2201-41bb-ab2a-31262aba36dd] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:14.581735 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d3af9ab-5a01-4a07-8949-0a466b8563fa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:14.582171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d3af9ab-5a01-4a07-8949-0a466b8563fa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:14.582656 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d3af9ab-5a01-4a07-8949-0a466b8563fa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:14.583800 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d3af9ab-5a01-4a07-8949-0a466b8563fa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:14.583944 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d3af9ab-5a01-4a07-8949-0a466b8563fa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:14.584290 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d3af9ab-5a01-4a07-8949-0a466b8563fa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:14.675744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2911b247-1402-4ac6-9ded-bbd5962d0820 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:14.692665 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2911b247-1402-4ac6-9ded-bbd5962d0820 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962" status: 200 len: 1521 microversion: 2.1 time: 0.383551 Aug 04 17:11:14.694103 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1956/3987] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:14 2022] GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962 => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:11:14.699431 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a533da88-8bd2-4150-b471-8a90e8bc011f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:14.700245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a533da88-8bd2-4150-b471-8a90e8bc011f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:14.708778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a533da88-8bd2-4150-b471-8a90e8bc011f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:14.709617 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a533da88-8bd2-4150-b471-8a90e8bc011f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:14.710379 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a533da88-8bd2-4150-b471-8a90e8bc011f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:14.711569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a533da88-8bd2-4150-b471-8a90e8bc011f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:14.714653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a533da88-8bd2-4150-b471-8a90e8bc011f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:14.715123 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a533da88-8bd2-4150-b471-8a90e8bc011f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:14.728754 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9d3af9ab-5a01-4a07-8949-0a466b8563fa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd/action" status: 200 len: 8208 microversion: 2.1 time: 0.181906 Aug 04 17:11:14.729417 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2032/3988] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:11:14 2022] POST /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd/action => generated 8208 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:14.747992 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-327a4bc4-089a-4ac5-9be5-cbcd44a0a73e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:14.748725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-327a4bc4-089a-4ac5-9be5-cbcd44a0a73e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:14.756542 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-327a4bc4-089a-4ac5-9be5-cbcd44a0a73e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:14.757009 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-327a4bc4-089a-4ac5-9be5-cbcd44a0a73e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:14.757463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-327a4bc4-089a-4ac5-9be5-cbcd44a0a73e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:14.758221 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-327a4bc4-089a-4ac5-9be5-cbcd44a0a73e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:14.758696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-327a4bc4-089a-4ac5-9be5-cbcd44a0a73e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:14.759137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-327a4bc4-089a-4ac5-9be5-cbcd44a0a73e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:14.808908 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a533da88-8bd2-4150-b471-8a90e8bc011f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "POST /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb/action" status: 202 len: 0 microversion: 2.1 time: 0.113133 Aug 04 17:11:14.809847 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1957/3989] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:11:14 2022] POST /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:11:14.836268 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2329185d-9f78-4742-ac8c-30e2e63a579f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:14.836996 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2329185d-9f78-4742-ac8c-30e2e63a579f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:14.854964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2329185d-9f78-4742-ac8c-30e2e63a579f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:14.856642 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2329185d-9f78-4742-ac8c-30e2e63a579f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:14.857180 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2329185d-9f78-4742-ac8c-30e2e63a579f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:14.859029 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2329185d-9f78-4742-ac8c-30e2e63a579f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:14.859521 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2329185d-9f78-4742-ac8c-30e2e63a579f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:14.860117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2329185d-9f78-4742-ac8c-30e2e63a579f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:15.016478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-327a4bc4-089a-4ac5-9be5-cbcd44a0a73e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:15.024909 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-327a4bc4-089a-4ac5-9be5-cbcd44a0a73e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.289528 Aug 04 17:11:15.038431 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2033/3990] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:14 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:15.052532 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4a08d07a-b012-4787-b5d2-81ac6564355c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:15.053475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4a08d07a-b012-4787-b5d2-81ac6564355c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:15.060065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a08d07a-b012-4787-b5d2-81ac6564355c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:15.060950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a08d07a-b012-4787-b5d2-81ac6564355c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:15.061668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a08d07a-b012-4787-b5d2-81ac6564355c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:15.062674 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a08d07a-b012-4787-b5d2-81ac6564355c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:15.063379 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a08d07a-b012-4787-b5d2-81ac6564355c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:15.064299 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a08d07a-b012-4787-b5d2-81ac6564355c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:15.081640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2329185d-9f78-4742-ac8c-30e2e63a579f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:15.092920 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2329185d-9f78-4742-ac8c-30e2e63a579f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 200 len: 1510 microversion: 2.1 time: 0.264351 Aug 04 17:11:15.094103 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1958/3991] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:14 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 1510 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:15.359352 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4a08d07a-b012-4787-b5d2-81ac6564355c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:15.385168 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4a08d07a-b012-4787-b5d2-81ac6564355c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.335664 Aug 04 17:11:15.385785 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2034/3992] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:15 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:11:15.406217 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8dddfef8-7a0c-4ada-aa78-b091cca2b9e8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:15.412417 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8dddfef8-7a0c-4ada-aa78-b091cca2b9e8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:15.420095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dddfef8-7a0c-4ada-aa78-b091cca2b9e8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:15.421291 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dddfef8-7a0c-4ada-aa78-b091cca2b9e8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:15.422169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dddfef8-7a0c-4ada-aa78-b091cca2b9e8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:15.423063 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dddfef8-7a0c-4ada-aa78-b091cca2b9e8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:15.423698 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dddfef8-7a0c-4ada-aa78-b091cca2b9e8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:15.424303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dddfef8-7a0c-4ada-aa78-b091cca2b9e8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:15.718991 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8dddfef8-7a0c-4ada-aa78-b091cca2b9e8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:15.719263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-40f41353-4df4-4b52-87aa-5bdbc52792c6 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:15.719676 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-40f41353-4df4-4b52-87aa-5bdbc52792c6 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 01c2f9e6-2bf7-4013-b254-0dac8e579962] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:15.728248 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8dddfef8-7a0c-4ada-aa78-b091cca2b9e8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.325895 Aug 04 17:11:15.729117 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1959/3993] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:15 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:15.730368 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-40f41353-4df4-4b52-87aa-5bdbc52792c6 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:15.731568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-40f41353-4df4-4b52-87aa-5bdbc52792c6 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:15.733121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-40f41353-4df4-4b52-87aa-5bdbc52792c6 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:15.735531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-40f41353-4df4-4b52-87aa-5bdbc52792c6 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:15.737398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-40f41353-4df4-4b52-87aa-5bdbc52792c6 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:15.738079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-40f41353-4df4-4b52-87aa-5bdbc52792c6 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:15.754092 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-641e3e96-015a-419e-8438-52f742c267d6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:15.755617 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-641e3e96-015a-419e-8438-52f742c267d6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:15.766055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-641e3e96-015a-419e-8438-52f742c267d6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:15.767534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-641e3e96-015a-419e-8438-52f742c267d6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:15.768314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-641e3e96-015a-419e-8438-52f742c267d6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:15.769819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-641e3e96-015a-419e-8438-52f742c267d6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:15.771263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-641e3e96-015a-419e-8438-52f742c267d6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:15.771896 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-641e3e96-015a-419e-8438-52f742c267d6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:16.125169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-641e3e96-015a-419e-8438-52f742c267d6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:16.143982 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-641e3e96-015a-419e-8438-52f742c267d6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.396151 Aug 04 17:11:16.160349 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1960/3994] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:15 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:11:16.166515 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-74b44a57-3cce-4fca-8ea8-efca5760400d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:16.167459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-74b44a57-3cce-4fca-8ea8-efca5760400d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:16.174595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74b44a57-3cce-4fca-8ea8-efca5760400d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:16.175453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74b44a57-3cce-4fca-8ea8-efca5760400d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:16.176305 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74b44a57-3cce-4fca-8ea8-efca5760400d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:16.177846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74b44a57-3cce-4fca-8ea8-efca5760400d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:16.178584 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74b44a57-3cce-4fca-8ea8-efca5760400d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:16.179252 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74b44a57-3cce-4fca-8ea8-efca5760400d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:16.451029 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-40f41353-4df4-4b52-87aa-5bdbc52792c6 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:16.465308 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-40f41353-4df4-4b52-87aa-5bdbc52792c6 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962" status: 200 len: 1498 microversion: 2.1 time: 0.750138 Aug 04 17:11:16.465906 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2035/3995] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:15 2022] GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962 => generated 1498 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:16.483581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a786728d-88c5-411c-b40f-a798130c9675 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:16.484107 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a786728d-88c5-411c-b40f-a798130c9675 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:16.495092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a786728d-88c5-411c-b40f-a798130c9675 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:16.496133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a786728d-88c5-411c-b40f-a798130c9675 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:16.496777 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a786728d-88c5-411c-b40f-a798130c9675 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:16.500529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a786728d-88c5-411c-b40f-a798130c9675 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:16.501195 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a786728d-88c5-411c-b40f-a798130c9675 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:16.504484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a786728d-88c5-411c-b40f-a798130c9675 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:16.702245 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a786728d-88c5-411c-b40f-a798130c9675 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Locking {{(pid=131043) lock /opt/stack/nova/nova/compute/api.py:4781}} Aug 04 17:11:16.870150 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a786728d-88c5-411c-b40f-a798130c9675 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action" status: 202 len: 0 microversion: 2.1 time: 0.390674 Aug 04 17:11:16.871154 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2036/3996] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:11:16 2022] POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:11:16.881386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-82bfeb77-fe4c-4c09-a894-6f5fc0e71089 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:16.901151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-82bfeb77-fe4c-4c09-a894-6f5fc0e71089 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:16.901151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-82bfeb77-fe4c-4c09-a894-6f5fc0e71089 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'e61b34a0cac845c49d7c334921af14c1'} {{(pid=131043) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:11:16.917060 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82bfeb77-fe4c-4c09-a894-6f5fc0e71089 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:16.918384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82bfeb77-fe4c-4c09-a894-6f5fc0e71089 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:16.919208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82bfeb77-fe4c-4c09-a894-6f5fc0e71089 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:16.920893 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82bfeb77-fe4c-4c09-a894-6f5fc0e71089 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:16.922390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82bfeb77-fe4c-4c09-a894-6f5fc0e71089 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:16.923092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82bfeb77-fe4c-4c09-a894-6f5fc0e71089 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:16.961303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-74b44a57-3cce-4fca-8ea8-efca5760400d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:16.976534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.multi_cell_list [None req-82bfeb77-fe4c-4c09-a894-6f5fc0e71089 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:11:16.987735 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-74b44a57-3cce-4fca-8ea8-efca5760400d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 200 len: 1510 microversion: 2.1 time: 0.815181 Aug 04 17:11:17.003998 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1961/3997] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:16 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 1510 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:17.026940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e12555bd-51ec-4fbd-8200-0b5f320ed2a7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:17.037115 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e12555bd-51ec-4fbd-8200-0b5f320ed2a7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:17.053916 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e12555bd-51ec-4fbd-8200-0b5f320ed2a7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:17.056853 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e12555bd-51ec-4fbd-8200-0b5f320ed2a7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:17.057638 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e12555bd-51ec-4fbd-8200-0b5f320ed2a7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:17.058785 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e12555bd-51ec-4fbd-8200-0b5f320ed2a7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:17.061303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e12555bd-51ec-4fbd-8200-0b5f320ed2a7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:17.062072 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e12555bd-51ec-4fbd-8200-0b5f320ed2a7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:17.068590 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-82bfeb77-fe4c-4c09-a894-6f5fc0e71089 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.195120 Aug 04 17:11:17.069365 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2037/3998] 10.222.0.93 () {58 vars in 1154 bytes} [Thu Aug 4 17:11:16 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:11:17.383680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3aa8a3fb-cd69-457f-b04e-b1bdaf677c7c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Action: 'create', calling method: .version_select at 0x7f1e5a898160>, body: {"keypair": {"name": "tempest-keypair-1111498967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYymWvwBk6jHEb67AAR3IylMM7wJB1lV0say+okri+Lf6y+MA8WEdpsqDkXebJi9gj0D6vyUoqb+2XfD7wQQADg8rAJ/BIcpKze/edeLlM7Cn5XtFsNzdLGmCq6FOzvKw=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:17.407995 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e12555bd-51ec-4fbd-8200-0b5f320ed2a7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:17.417025 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-3aa8a3fb-cd69-457f-b04e-b1bdaf677c7c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Getting quotas for project 80bc576163414daba5f5315c4a785533. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:11:17.420934 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e12555bd-51ec-4fbd-8200-0b5f320ed2a7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.415100 Aug 04 17:11:17.421536 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1962/3999] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:17 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:17.432223 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-402854d7-b192-44ae-a027-d335a47564e2 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:17.432776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-3aa8a3fb-cd69-457f-b04e-b1bdaf677c7c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Getting quotas for user 5b10b58bf3df46d18bff092022b08e0f and project 80bc576163414daba5f5315c4a785533. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:11:17.448327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-402854d7-b192-44ae-a027-d335a47564e2 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:17.448825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-402854d7-b192-44ae-a027-d335a47564e2 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:17.454395 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-402854d7-b192-44ae-a027-d335a47564e2 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:17.479794 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3aa8a3fb-cd69-457f-b04e-b1bdaf677c7c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.408739 Aug 04 17:11:17.486325 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2038/4000] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:11:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:11:17.492854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-402854d7-b192-44ae-a027-d335a47564e2 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 01c2f9e6-2bf7-4013-b254-0dac8e579962] Going to try to start instance {{(pid=131044) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 17:11:17.498520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f1dab3de-9af9-4bbe-a4ae-b03788bb58d2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:17.509785 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1dab3de-9af9-4bbe-a4ae-b03788bb58d2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:17.517853 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1dab3de-9af9-4bbe-a4ae-b03788bb58d2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:17.518475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1dab3de-9af9-4bbe-a4ae-b03788bb58d2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:17.587223 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-f1dab3de-9af9-4bbe-a4ae-b03788bb58d2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] HTTP exception thrown: Instance 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a is locked Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f1dab3de-9af9-4bbe-a4ae-b03788bb58d2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Request method failure captured: Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action HTTP/1.1 Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 15 Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_yRMj5TmiUiePuxSnga_Pnns-Bpj5aA4uGmfrVKNtT7pLSLMV6hR6GdWVQMcx558mTVagVc5ritEKmEaG9jlrpABFcQhDSxLCEoyLH_vWnRVJyVNaLifB4cbPIAOTPDtpOkRM4AqnGVUyNlNzo9X9IxkbuoayvWNyDPnSX0E0uErX8 Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 683ce999e25e42a4a57b3c24a1fd24ef Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerActionsTestJSON-1286399382 Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/683ce999e25e42a4a57b3c24a1fd24ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/683ce999e25e42a4a57b3c24a1fd24ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_683ce999e25e42a4a57b3c24a1fd24ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/683ce999e25e42a4a57b3c24a1fd24ef"}]}] Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerActionsTestJSON-1286399382 Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 683ce999e25e42a4a57b3c24a1fd24ef Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerActionsTestJSON-1286399382 Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerActionsTestJSON-1286399382-project Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 01e6f70936a14e67aecaf71fb615fffa Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerActionsTestJSON-1286399382-project Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: {"os-stop": {}} Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a is locked Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '10991c59-c7d8-447e-8f2b-3f5ea5d8d62a', 'body': {'os-stop': {}}} Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a is locked Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a is locked Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a is locked Aug 04 17:11:17.588850 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:11:17.594114 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f1dab3de-9af9-4bbe-a4ae-b03788bb58d2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Returning 409 to user: Instance 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a is locked {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:11:17.596472 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-402854d7-b192-44ae-a027-d335a47564e2 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "POST /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962/action" status: 202 len: 0 microversion: 2.1 time: 0.164661 Aug 04 17:11:17.603982 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1963/4001] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:11:17 2022] POST /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:11:17.604653 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f1dab3de-9af9-4bbe-a4ae-b03788bb58d2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action" status: 409 len: 107 microversion: 2.1 time: 0.102889 Aug 04 17:11:17.608302 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2039/4002] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:11:17 2022] POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action => generated 107 bytes in 119 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:11:17.614525 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5785bf61-4881-4cd4-a5b8-91694e3e4c0b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:17.614917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5785bf61-4881-4cd4-a5b8-91694e3e4c0b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:17.618392 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7e947e89-7777-494b-9159-538be373aa07 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:17.620264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7e947e89-7777-494b-9159-538be373aa07 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 01c2f9e6-2bf7-4013-b254-0dac8e579962] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:17.627248 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5785bf61-4881-4cd4-a5b8-91694e3e4c0b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:17.627758 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5785bf61-4881-4cd4-a5b8-91694e3e4c0b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:17.628199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5785bf61-4881-4cd4-a5b8-91694e3e4c0b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:17.634260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5785bf61-4881-4cd4-a5b8-91694e3e4c0b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:17.635019 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5785bf61-4881-4cd4-a5b8-91694e3e4c0b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:17.635639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5785bf61-4881-4cd4-a5b8-91694e3e4c0b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:17.644521 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e947e89-7777-494b-9159-538be373aa07 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:17.646578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e947e89-7777-494b-9159-538be373aa07 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:17.647829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e947e89-7777-494b-9159-538be373aa07 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:17.650953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e947e89-7777-494b-9159-538be373aa07 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:17.652180 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e947e89-7777-494b-9159-538be373aa07 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:17.655505 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e947e89-7777-494b-9159-538be373aa07 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:17.724988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5785bf61-4881-4cd4-a5b8-91694e3e4c0b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Unlocking {{(pid=131043) unlock /opt/stack/nova/nova/compute/api.py:4810}} Aug 04 17:11:17.863198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:17.870783 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5785bf61-4881-4cd4-a5b8-91694e3e4c0b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action" status: 202 len: 0 microversion: 2.1 time: 0.260832 Aug 04 17:11:17.873367 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2040/4003] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:11:17 2022] POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:11:17.899112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-928774ac-30c4-43a4-8f06-615aac2aa567 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:17.920297 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-928774ac-30c4-43a4-8f06-615aac2aa567 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:17.920830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-928774ac-30c4-43a4-8f06-615aac2aa567 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:17.921295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-928774ac-30c4-43a4-8f06-615aac2aa567 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:17.967511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-928774ac-30c4-43a4-8f06-615aac2aa567 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Going to try to stop instance {{(pid=131043) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 17:11:18.045613 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-928774ac-30c4-43a4-8f06-615aac2aa567 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action" status: 202 len: 0 microversion: 2.1 time: 0.167860 Aug 04 17:11:18.046250 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2041/4004] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:11:17 2022] POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:11:18.197776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ac517d16-65d1-4a47-a9ae-936fb53100d7 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Action: 'create', calling method: .version_select at 0x7f1e5aa56f70>, body: {"keypair": {"name": "tempest-keypair-579541935", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9ky8+jkXgsOtMald59ai3fCaIPVtYh0e4sqiBmdt1nh+WWoluhFW0A+sm+sCoohAQNCI3Q1Zl1zPkwNcO1cFc4ZrqkiJzwJCROFybeIxVxMc1C2fEr7qwl9KSNUpECtw=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:18.242246 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-ac517d16-65d1-4a47-a9ae-936fb53100d7 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Getting quotas for project a2cc22c8c06b40ae961464cb3e300cba. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:11:18.253594 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-ac517d16-65d1-4a47-a9ae-936fb53100d7 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Getting quotas for user 023dd49bea644899a427669f3c1b461e and project a2cc22c8c06b40ae961464cb3e300cba. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:11:18.316793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7e947e89-7777-494b-9159-538be373aa07 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:18.327485 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ac517d16-65d1-4a47-a9ae-936fb53100d7 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.277363 Aug 04 17:11:18.328463 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2042/4005] 10.222.0.93 () {62 vars in 1200 bytes} [Thu Aug 4 17:11:18 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 281 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 17:11:18.340039 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-32dddd58-4d59-4da4-bc8c-30f698d26e1d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:18.340878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-32dddd58-4d59-4da4-bc8c-30f698d26e1d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:18.342844 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7e947e89-7777-494b-9159-538be373aa07 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962" status: 200 len: 1507 microversion: 2.1 time: 0.735588 Aug 04 17:11:18.346991 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1964/4006] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:17 2022] GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962 => generated 1507 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:18.347151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:18.366192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32dddd58-4d59-4da4-bc8c-30f698d26e1d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:18.366411 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-611882db-5ffb-4f5b-94ef-25f17484b0e5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:18.366678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32dddd58-4d59-4da4-bc8c-30f698d26e1d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:18.366810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-611882db-5ffb-4f5b-94ef-25f17484b0e5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:18.366918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32dddd58-4d59-4da4-bc8c-30f698d26e1d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:18.366918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32dddd58-4d59-4da4-bc8c-30f698d26e1d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:18.366918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32dddd58-4d59-4da4-bc8c-30f698d26e1d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:18.366918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32dddd58-4d59-4da4-bc8c-30f698d26e1d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:18.381071 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-611882db-5ffb-4f5b-94ef-25f17484b0e5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:18.382426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-611882db-5ffb-4f5b-94ef-25f17484b0e5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:18.382888 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-611882db-5ffb-4f5b-94ef-25f17484b0e5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:18.385835 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-611882db-5ffb-4f5b-94ef-25f17484b0e5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:18.386572 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-611882db-5ffb-4f5b-94ef-25f17484b0e5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:18.387586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-611882db-5ffb-4f5b-94ef-25f17484b0e5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:19.147765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-32dddd58-4d59-4da4-bc8c-30f698d26e1d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:19.157999 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-32dddd58-4d59-4da4-bc8c-30f698d26e1d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 200 len: 1510 microversion: 2.1 time: 0.828398 Aug 04 17:11:19.184317 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2043/4007] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:18 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 1510 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:19.202503 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-611882db-5ffb-4f5b-94ef-25f17484b0e5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:19.222392 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-611882db-5ffb-4f5b-94ef-25f17484b0e5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1680 microversion: 2.1 time: 0.872491 Aug 04 17:11:19.238357 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1965/4008] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:18 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1680 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:19.378398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a37a5cc6-9fef-49a8-925d-516ad49acc24 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:19.379030 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a37a5cc6-9fef-49a8-925d-516ad49acc24 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 01c2f9e6-2bf7-4013-b254-0dac8e579962] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:19.393801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a37a5cc6-9fef-49a8-925d-516ad49acc24 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:19.394584 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a37a5cc6-9fef-49a8-925d-516ad49acc24 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:19.395276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a37a5cc6-9fef-49a8-925d-516ad49acc24 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:19.396700 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a37a5cc6-9fef-49a8-925d-516ad49acc24 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:19.397825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a37a5cc6-9fef-49a8-925d-516ad49acc24 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:19.398877 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a37a5cc6-9fef-49a8-925d-516ad49acc24 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:19.844536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a37a5cc6-9fef-49a8-925d-516ad49acc24 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:19.854964 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a37a5cc6-9fef-49a8-925d-516ad49acc24 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962" status: 200 len: 1507 microversion: 2.1 time: 0.480420 Aug 04 17:11:19.856260 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2044/4009] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:19 2022] GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962 => generated 1507 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:20.198260 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8611d481-b52a-48c2-8fb3-dbe888de07e2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:20.201150 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8611d481-b52a-48c2-8fb3-dbe888de07e2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:20.221378 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8611d481-b52a-48c2-8fb3-dbe888de07e2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:20.222242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8611d481-b52a-48c2-8fb3-dbe888de07e2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:20.224787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8611d481-b52a-48c2-8fb3-dbe888de07e2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:20.226187 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8611d481-b52a-48c2-8fb3-dbe888de07e2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:20.226927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8611d481-b52a-48c2-8fb3-dbe888de07e2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:20.227639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8611d481-b52a-48c2-8fb3-dbe888de07e2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:20.237921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:20.263023 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c2a8c15a-7b02-4d1d-aba4-2623b1648639 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:20.263809 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c2a8c15a-7b02-4d1d-aba4-2623b1648639 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:20.289962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2a8c15a-7b02-4d1d-aba4-2623b1648639 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:20.299613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2a8c15a-7b02-4d1d-aba4-2623b1648639 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:20.304722 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2a8c15a-7b02-4d1d-aba4-2623b1648639 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:20.321441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2a8c15a-7b02-4d1d-aba4-2623b1648639 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:20.322818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2a8c15a-7b02-4d1d-aba4-2623b1648639 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:20.323559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2a8c15a-7b02-4d1d-aba4-2623b1648639 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:20.920542 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c2a8c15a-7b02-4d1d-aba4-2623b1648639 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:20.932815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8611d481-b52a-48c2-8fb3-dbe888de07e2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:20.933695 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c2a8c15a-7b02-4d1d-aba4-2623b1648639 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1680 microversion: 2.1 time: 0.677596 Aug 04 17:11:20.935715 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2045/4010] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:20 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1680 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:20.943021 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8611d481-b52a-48c2-8fb3-dbe888de07e2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 200 len: 1516 microversion: 2.1 time: 0.751704 Aug 04 17:11:20.951359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-506b390b-aedf-4718-ad0c-5c901ec5f2d5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:20.952463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-506b390b-aedf-4718-ad0c-5c901ec5f2d5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 01c2f9e6-2bf7-4013-b254-0dac8e579962] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:20.960301 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1966/4011] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:20 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 1516 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:20.991252 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-506b390b-aedf-4718-ad0c-5c901ec5f2d5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:20.991788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-506b390b-aedf-4718-ad0c-5c901ec5f2d5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:20.992435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-506b390b-aedf-4718-ad0c-5c901ec5f2d5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:20.993195 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-506b390b-aedf-4718-ad0c-5c901ec5f2d5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:20.993665 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-506b390b-aedf-4718-ad0c-5c901ec5f2d5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:20.994134 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-506b390b-aedf-4718-ad0c-5c901ec5f2d5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:21.651067 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-506b390b-aedf-4718-ad0c-5c901ec5f2d5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:21.663029 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-506b390b-aedf-4718-ad0c-5c901ec5f2d5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962" status: 200 len: 1511 microversion: 2.1 time: 0.726171 Aug 04 17:11:21.666508 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2046/4012] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:20 2022] GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962 => generated 1511 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:21.693584 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5cb1b460-c005-475a-b0d4-cafb38e1b5fd tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:21.704455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5cb1b460-c005-475a-b0d4-cafb38e1b5fd tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:21.705390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.compute.servers [None req-5cb1b460-c005-475a-b0d4-cafb38e1b5fd tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Removing options 'limit' from query {{(pid=131044) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 04 17:11:21.722154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5cb1b460-c005-475a-b0d4-cafb38e1b5fd tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Searching by: {'deleted': False, 'project_id': 'e61b34a0cac845c49d7c334921af14c1'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:11:21.724255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5cb1b460-c005-475a-b0d4-cafb38e1b5fd tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:21.724998 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5cb1b460-c005-475a-b0d4-cafb38e1b5fd tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:21.727232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5cb1b460-c005-475a-b0d4-cafb38e1b5fd tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:21.728243 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5cb1b460-c005-475a-b0d4-cafb38e1b5fd tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:21.729591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5cb1b460-c005-475a-b0d4-cafb38e1b5fd tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:21.730266 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5cb1b460-c005-475a-b0d4-cafb38e1b5fd tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:21.733902 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5cb1b460-c005-475a-b0d4-cafb38e1b5fd tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.045341 Aug 04 17:11:21.735546 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1967/4013] 10.222.0.93 () {58 vars in 1140 bytes} [Thu Aug 4 17:11:21 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:11:21.751065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e4f66ff1-73f6-42f0-a339-d93d4ae97727 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:21.753108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e4f66ff1-73f6-42f0-a339-d93d4ae97727 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 01c2f9e6-2bf7-4013-b254-0dac8e579962] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:21.764353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4f66ff1-73f6-42f0-a339-d93d4ae97727 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:21.765109 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4f66ff1-73f6-42f0-a339-d93d4ae97727 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:21.765745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4f66ff1-73f6-42f0-a339-d93d4ae97727 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:21.766543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4f66ff1-73f6-42f0-a339-d93d4ae97727 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:21.767234 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4f66ff1-73f6-42f0-a339-d93d4ae97727 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:21.767634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4f66ff1-73f6-42f0-a339-d93d4ae97727 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:21.803433 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7ed52d52-e1c3-4aab-ac89-5eb10e6d056b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-396580674", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "779f24e1-21b5-406f-8c13-50f72d42c29c"}], "security_groups": [{"name": "tempest-securitygroup--1018348705"}], "key_name": "tempest-keypair-1111498967", "user_data": "}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:22.049203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-7ed52d52-e1c3-4aab-ac89-5eb10e6d056b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] validate_networks() for [('779f24e1-21b5-406f-8c13-50f72d42c29c', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:11:22.278129 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e4f66ff1-73f6-42f0-a339-d93d4ae97727 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:22.302185 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e4f66ff1-73f6-42f0-a339-d93d4ae97727 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962" status: 200 len: 1511 microversion: 2.1 time: 0.551045 Aug 04 17:11:22.302185 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2047/4014] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:21 2022] GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962 => generated 1511 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:22.316784 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-40d49a9d-723d-4c1d-a826-64aa2c1807ff tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:22.318089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-40d49a9d-723d-4c1d-a826-64aa2c1807ff tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:22.339601 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-40d49a9d-723d-4c1d-a826-64aa2c1807ff tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:22.340124 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-40d49a9d-723d-4c1d-a826-64aa2c1807ff tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:22.340577 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-40d49a9d-723d-4c1d-a826-64aa2c1807ff tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:22.341445 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-40d49a9d-723d-4c1d-a826-64aa2c1807ff tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:22.341776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-40d49a9d-723d-4c1d-a826-64aa2c1807ff tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:22.342251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-40d49a9d-723d-4c1d-a826-64aa2c1807ff tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:22.899387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-40d49a9d-723d-4c1d-a826-64aa2c1807ff tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:22.928841 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-40d49a9d-723d-4c1d-a826-64aa2c1807ff tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1680 microversion: 2.1 time: 0.625360 Aug 04 17:11:22.930978 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2048/4015] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:22 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1680 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:22.940081 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d4a7e218-72f2-4bee-b505-192543485c26 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:22.941015 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d4a7e218-72f2-4bee-b505-192543485c26 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: e67fc2ff-0549-433f-9385-cc71740b93c4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:22.952615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d4a7e218-72f2-4bee-b505-192543485c26 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:22.953372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d4a7e218-72f2-4bee-b505-192543485c26 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:22.954104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d4a7e218-72f2-4bee-b505-192543485c26 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:22.955496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d4a7e218-72f2-4bee-b505-192543485c26 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:22.956202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d4a7e218-72f2-4bee-b505-192543485c26 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:22.956863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d4a7e218-72f2-4bee-b505-192543485c26 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:23.080456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7ed52d52-e1c3-4aab-ac89-5eb10e6d056b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:11:23.080965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7ed52d52-e1c3-4aab-ac89-5eb10e6d056b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:11:23.081363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7ed52d52-e1c3-4aab-ac89-5eb10e6d056b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:11:23.081787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7ed52d52-e1c3-4aab-ac89-5eb10e6d056b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:11:23.082521 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7ed52d52-e1c3-4aab-ac89-5eb10e6d056b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:11:23.092822 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:23.109393 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ed52d52-e1c3-4aab-ac89-5eb10e6d056b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:23.109933 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ed52d52-e1c3-4aab-ac89-5eb10e6d056b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:23.110727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ed52d52-e1c3-4aab-ac89-5eb10e6d056b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:23.111488 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ed52d52-e1c3-4aab-ac89-5eb10e6d056b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:23.111962 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ed52d52-e1c3-4aab-ac89-5eb10e6d056b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:23.112403 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ed52d52-e1c3-4aab-ac89-5eb10e6d056b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:23.153940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-7ed52d52-e1c3-4aab-ac89-5eb10e6d056b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Getting quotas for project 80bc576163414daba5f5315c4a785533. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:11:23.169773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-7ed52d52-e1c3-4aab-ac89-5eb10e6d056b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Getting quotas for user 5b10b58bf3df46d18bff092022b08e0f and project 80bc576163414daba5f5315c4a785533. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:11:23.199577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7ed52d52-e1c3-4aab-ac89-5eb10e6d056b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:11:23.203246 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7ed52d52-e1c3-4aab-ac89-5eb10e6d056b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 947ffe69-3080-4602-872d-1bb16591d34e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:11:23.242386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d4a7e218-72f2-4bee-b505-192543485c26 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:23.253540 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d4a7e218-72f2-4bee-b505-192543485c26 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/e67fc2ff-0549-433f-9385-cc71740b93c4" status: 200 len: 1512 microversion: 2.1 time: 0.321161 Aug 04 17:11:23.255371 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2049/4016] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:22 2022] GET /compute/v2.1/servers/e67fc2ff-0549-433f-9385-cc71740b93c4 => generated 1512 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:23.275507 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-70529a21-4f4f-4fea-936a-1c86f31436ee tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1096660566", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2bcc362-f0e4-432b-a05f-b91ea4a73652"}], "security_groups": [{"name": "tempest-securitygroup--800556745"}], "key_name": "tempest-keypair-579541935", "user_data": "}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:23.283113 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7ed52d52-e1c3-4aab-ac89-5eb10e6d056b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.491739 Aug 04 17:11:23.284093 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1968/4017] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:11:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:11:23.290402 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-933c7455-8a01-4ae6-825c-3e26e424528a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:23.290942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-933c7455-8a01-4ae6-825c-3e26e424528a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 016fbd16-b01e-4ebf-ad2f-3495970feb96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:23.297949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-933c7455-8a01-4ae6-825c-3e26e424528a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:23.298713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-933c7455-8a01-4ae6-825c-3e26e424528a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:23.299334 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-933c7455-8a01-4ae6-825c-3e26e424528a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:23.300220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-933c7455-8a01-4ae6-825c-3e26e424528a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:23.300858 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-933c7455-8a01-4ae6-825c-3e26e424528a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:23.301321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-933c7455-8a01-4ae6-825c-3e26e424528a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:23.508538 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-70529a21-4f4f-4fea-936a-1c86f31436ee tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] validate_networks() for [('e2bcc362-f0e4-432b-a05f-b91ea4a73652', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:11:23.525954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-933c7455-8a01-4ae6-825c-3e26e424528a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:23.541752 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-933c7455-8a01-4ae6-825c-3e26e424528a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96" status: 200 len: 1512 microversion: 2.1 time: 0.249939 Aug 04 17:11:23.542670 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1969/4018] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:23 2022] GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96 => generated 1512 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:23.571006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cad18514-be56-4886-b45d-a6f075c60a5f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:23.574276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cad18514-be56-4886-b45d-a6f075c60a5f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 947ffe69-3080-4602-872d-1bb16591d34e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:23.713862 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cad18514-be56-4886-b45d-a6f075c60a5f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:23.744253 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cad18514-be56-4886-b45d-a6f075c60a5f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e" status: 200 len: 1241 microversion: 2.1 time: 0.200350 Aug 04 17:11:23.757852 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1970/4019] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:23 2022] GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e => generated 1241 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:23.757852 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4fbf9fdd-7e6b-4d04-82b3-ebca61ab4af8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:23.762920 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4fbf9fdd-7e6b-4d04-82b3-ebca61ab4af8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:23.763682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4fbf9fdd-7e6b-4d04-82b3-ebca61ab4af8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Searching by: {'ip': '172.20.0.9', 'deleted': False, 'project_id': 'e61b34a0cac845c49d7c334921af14c1'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:11:24.011356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4fbf9fdd-7e6b-4d04-82b3-ebca61ab4af8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:24.011857 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4fbf9fdd-7e6b-4d04-82b3-ebca61ab4af8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:24.012693 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4fbf9fdd-7e6b-4d04-82b3-ebca61ab4af8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:24.013621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4fbf9fdd-7e6b-4d04-82b3-ebca61ab4af8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:24.014301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4fbf9fdd-7e6b-4d04-82b3-ebca61ab4af8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:24.015213 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4fbf9fdd-7e6b-4d04-82b3-ebca61ab4af8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:24.149394 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-4fbf9fdd-7e6b-4d04-82b3-ebca61ab4af8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:11:24.232419 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4fbf9fdd-7e6b-4d04-82b3-ebca61ab4af8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers?ip=172.20.0.9" status: 200 len: 346 microversion: 2.1 time: 0.485494 Aug 04 17:11:24.236046 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1971/4020] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Aug 4 17:11:23 2022] GET /compute/v2.1/servers?ip=172.20.0.9 => generated 346 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:11:24.249291 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e54d8f6a-7cc3-4d47-a649-d81266a6344f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Action: 'create', calling method: .version_select at 0x7f1e5aa84a60>, body: {"keypair": {"name": "tempest-keypair-68181367", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIKLqZp761zorTOeesbv9KAw4v28R++O9XKA9aPjIjPRqOkR60nxxfOqDwDqIr+MVX2fM4rbx0LymJMocrwf/ZEfz3V1Ai4POoTHxN1OosmCilOhMBDDpOns72RFYJZ0w=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:24.266562 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e54d8f6a-7cc3-4d47-a649-d81266a6344f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Getting quotas for project 50d2f7cd670340adb1b4187754e302c5. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:11:24.273736 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e54d8f6a-7cc3-4d47-a649-d81266a6344f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Getting quotas for user 067e98d624234a48bb0ea3bde77c049c and project 50d2f7cd670340adb1b4187754e302c5. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:11:24.304852 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e54d8f6a-7cc3-4d47-a649-d81266a6344f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.059592 Aug 04 17:11:24.305525 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1972/4021] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:11:24 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:11:24.310356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-37015da6-a855-4696-9c0f-64f1bc4c59be tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:24.311335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-37015da6-a855-4696-9c0f-64f1bc4c59be tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:24.318540 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37015da6-a855-4696-9c0f-64f1bc4c59be tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:24.319358 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37015da6-a855-4696-9c0f-64f1bc4c59be tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:24.319996 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37015da6-a855-4696-9c0f-64f1bc4c59be tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:24.321857 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37015da6-a855-4696-9c0f-64f1bc4c59be tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:24.334302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37015da6-a855-4696-9c0f-64f1bc4c59be tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:24.336830 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37015da6-a855-4696-9c0f-64f1bc4c59be tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:24.358928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-70529a21-4f4f-4fea-936a-1c86f31436ee tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:11:24.359413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-70529a21-4f4f-4fea-936a-1c86f31436ee tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:11:24.359727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-70529a21-4f4f-4fea-936a-1c86f31436ee tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:11:24.360344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-70529a21-4f4f-4fea-936a-1c86f31436ee tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:11:24.360955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-70529a21-4f4f-4fea-936a-1c86f31436ee tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:11:24.376855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70529a21-4f4f-4fea-936a-1c86f31436ee tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:24.377389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70529a21-4f4f-4fea-936a-1c86f31436ee tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:24.377843 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70529a21-4f4f-4fea-936a-1c86f31436ee tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:24.378652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70529a21-4f4f-4fea-936a-1c86f31436ee tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:24.379113 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70529a21-4f4f-4fea-936a-1c86f31436ee tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:24.379654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70529a21-4f4f-4fea-936a-1c86f31436ee tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:24.428784 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-70529a21-4f4f-4fea-936a-1c86f31436ee tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Getting quotas for project a2cc22c8c06b40ae961464cb3e300cba. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:11:24.437462 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-70529a21-4f4f-4fea-936a-1c86f31436ee tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Getting quotas for user 023dd49bea644899a427669f3c1b461e and project a2cc22c8c06b40ae961464cb3e300cba. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:11:24.457833 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-70529a21-4f4f-4fea-936a-1c86f31436ee tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:11:24.461216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-70529a21-4f4f-4fea-936a-1c86f31436ee tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:11:24.547985 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-37015da6-a855-4696-9c0f-64f1bc4c59be tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:24.548270 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-70529a21-4f4f-4fea-936a-1c86f31436ee tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.289500 Aug 04 17:11:24.551024 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2050/4022] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Aug 4 17:11:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 1295 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 17:11:24.560465 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-37015da6-a855-4696-9c0f-64f1bc4c59be tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1680 microversion: 2.1 time: 0.253769 Aug 04 17:11:24.563392 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1973/4023] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:24 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1680 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:24.567707 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6635a05e-493f-40b1-9584-abfa04254704 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:24.570707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-50c478eb-5963-43fd-9833-386ff3bbb496 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:24.571582 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6635a05e-493f-40b1-9584-abfa04254704 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 01c2f9e6-2bf7-4013-b254-0dac8e579962] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:24.571954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-50c478eb-5963-43fd-9833-386ff3bbb496 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:24.580056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6635a05e-493f-40b1-9584-abfa04254704 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:24.581082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6635a05e-493f-40b1-9584-abfa04254704 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:24.581906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6635a05e-493f-40b1-9584-abfa04254704 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:24.584476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6635a05e-493f-40b1-9584-abfa04254704 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:24.585792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6635a05e-493f-40b1-9584-abfa04254704 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:24.586731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6635a05e-493f-40b1-9584-abfa04254704 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:24.675944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-50c478eb-5963-43fd-9833-386ff3bbb496 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:24.691154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-50c478eb-5963-43fd-9833-386ff3bbb496 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:24.692718 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-50c478eb-5963-43fd-9833-386ff3bbb496 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:24.701327 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-50c478eb-5963-43fd-9833-386ff3bbb496 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1281 microversion: 2.20 time: 0.136332 Aug 04 17:11:24.715578 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1974/4024] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:11:24 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1281 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:11:24.765871 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0b48bfa2-fe58-4966-9f27-327be9b83340 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:24.766986 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0b48bfa2-fe58-4966-9f27-327be9b83340 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 947ffe69-3080-4602-872d-1bb16591d34e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:24.775969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b48bfa2-fe58-4966-9f27-327be9b83340 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:24.776725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b48bfa2-fe58-4966-9f27-327be9b83340 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:24.777448 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b48bfa2-fe58-4966-9f27-327be9b83340 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:24.779038 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b48bfa2-fe58-4966-9f27-327be9b83340 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:24.779754 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b48bfa2-fe58-4966-9f27-327be9b83340 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:24.780400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b48bfa2-fe58-4966-9f27-327be9b83340 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:24.893499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6635a05e-493f-40b1-9584-abfa04254704 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:24.903181 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6635a05e-493f-40b1-9584-abfa04254704 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962" status: 200 len: 1511 microversion: 2.1 time: 0.348382 Aug 04 17:11:24.907679 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2051/4025] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:24 2022] GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962 => generated 1511 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:24.953075 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b93392ab-f744-4559-8e0e-428a216ac8d2 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:24.953788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b93392ab-f744-4559-8e0e-428a216ac8d2 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: e67fc2ff-0549-433f-9385-cc71740b93c4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:24.979770 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0b48bfa2-fe58-4966-9f27-327be9b83340 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:24.980059 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b93392ab-f744-4559-8e0e-428a216ac8d2 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:24.980270 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b93392ab-f744-4559-8e0e-428a216ac8d2 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:24.983471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b93392ab-f744-4559-8e0e-428a216ac8d2 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:24.985875 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b93392ab-f744-4559-8e0e-428a216ac8d2 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:24.989929 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b93392ab-f744-4559-8e0e-428a216ac8d2 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:24.990240 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0b48bfa2-fe58-4966-9f27-327be9b83340 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e" status: 200 len: 1293 microversion: 2.1 time: 0.228706 Aug 04 17:11:24.990410 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b93392ab-f744-4559-8e0e-428a216ac8d2 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:24.992481 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1975/4026] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:24 2022] GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e => generated 1293 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:25.194176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b93392ab-f744-4559-8e0e-428a216ac8d2 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:25.204372 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b93392ab-f744-4559-8e0e-428a216ac8d2 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/e67fc2ff-0549-433f-9385-cc71740b93c4" status: 200 len: 1512 microversion: 2.1 time: 0.278929 Aug 04 17:11:25.218001 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2052/4027] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:24 2022] GET /compute/v2.1/servers/e67fc2ff-0549-433f-9385-cc71740b93c4 => generated 1512 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:11:25.227995 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e55b85c7-bea7-4441-99b1-4f8605c04bce tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:25.229384 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e55b85c7-bea7-4441-99b1-4f8605c04bce tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 016fbd16-b01e-4ebf-ad2f-3495970feb96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:25.236555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e55b85c7-bea7-4441-99b1-4f8605c04bce tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:25.237614 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e55b85c7-bea7-4441-99b1-4f8605c04bce tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:25.238339 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e55b85c7-bea7-4441-99b1-4f8605c04bce tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:25.239648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e55b85c7-bea7-4441-99b1-4f8605c04bce tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:25.240338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e55b85c7-bea7-4441-99b1-4f8605c04bce tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:25.240842 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e55b85c7-bea7-4441-99b1-4f8605c04bce tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:25.483370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e55b85c7-bea7-4441-99b1-4f8605c04bce tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:25.505547 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e55b85c7-bea7-4441-99b1-4f8605c04bce tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96" status: 200 len: 1512 microversion: 2.1 time: 0.283645 Aug 04 17:11:25.525841 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1976/4028] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:25 2022] GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96 => generated 1512 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:25.533185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-081e6ff6-2d98-4e52-861c-9883c4d21df8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:25.543963 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-081e6ff6-2d98-4e52-861c-9883c4d21df8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:25.550315 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-081e6ff6-2d98-4e52-861c-9883c4d21df8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Searching by: {'deleted': False, 'project_id': 'e61b34a0cac845c49d7c334921af14c1'} {{(pid=131043) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:11:25.566605 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-081e6ff6-2d98-4e52-861c-9883c4d21df8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:25.568007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-081e6ff6-2d98-4e52-861c-9883c4d21df8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:25.568889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-081e6ff6-2d98-4e52-861c-9883c4d21df8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:25.569832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-081e6ff6-2d98-4e52-861c-9883c4d21df8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:25.570496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-081e6ff6-2d98-4e52-861c-9883c4d21df8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:25.571111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-081e6ff6-2d98-4e52-861c-9883c4d21df8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:25.594468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-acb9d89b-c830-4b9b-a1d8-1044d89103c8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:25.606787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-acb9d89b-c830-4b9b-a1d8-1044d89103c8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:25.618343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acb9d89b-c830-4b9b-a1d8-1044d89103c8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:25.619223 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acb9d89b-c830-4b9b-a1d8-1044d89103c8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:25.619834 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acb9d89b-c830-4b9b-a1d8-1044d89103c8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:25.620997 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acb9d89b-c830-4b9b-a1d8-1044d89103c8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:25.621618 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acb9d89b-c830-4b9b-a1d8-1044d89103c8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:25.622322 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acb9d89b-c830-4b9b-a1d8-1044d89103c8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:25.642004 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.multi_cell_list [None req-081e6ff6-2d98-4e52-861c-9883c4d21df8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:11:25.711885 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-081e6ff6-2d98-4e52-861c-9883c4d21df8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:25.721852 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-081e6ff6-2d98-4e52-861c-9883c4d21df8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:25.722819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-081e6ff6-2d98-4e52-861c-9883c4d21df8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:25.723579 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-081e6ff6-2d98-4e52-861c-9883c4d21df8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:25.994940 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-081e6ff6-2d98-4e52-861c-9883c4d21df8 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/detail" status: 200 len: 4518 microversion: 2.1 time: 0.467687 Aug 04 17:11:25.998360 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2053/4029] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 17:11:25 2022] GET /compute/v2.1/servers/detail => generated 4518 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:26.005162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-92745b87-a063-448b-9720-1969184fd537 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:26.005797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-92745b87-a063-448b-9720-1969184fd537 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:26.026828 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92745b87-a063-448b-9720-1969184fd537 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:26.027585 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92745b87-a063-448b-9720-1969184fd537 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:26.027778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92745b87-a063-448b-9720-1969184fd537 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:26.028707 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92745b87-a063-448b-9720-1969184fd537 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:26.029346 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92745b87-a063-448b-9720-1969184fd537 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:26.029958 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92745b87-a063-448b-9720-1969184fd537 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:26.192082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-92745b87-a063-448b-9720-1969184fd537 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:26.204802 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-92745b87-a063-448b-9720-1969184fd537 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:26.206366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-92745b87-a063-448b-9720-1969184fd537 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:26.207586 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-92745b87-a063-448b-9720-1969184fd537 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1333 microversion: 2.20 time: 0.207916 Aug 04 17:11:26.226401 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2054/4030] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:11:25 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1333 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:11:26.240386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-50dd31f9-bfb4-49dd-9058-8a0fde206716 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:26.241313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-50dd31f9-bfb4-49dd-9058-8a0fde206716 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 947ffe69-3080-4602-872d-1bb16591d34e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:26.244810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-acb9d89b-c830-4b9b-a1d8-1044d89103c8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:26.253434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50dd31f9-bfb4-49dd-9058-8a0fde206716 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:26.260121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50dd31f9-bfb4-49dd-9058-8a0fde206716 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:26.260651 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50dd31f9-bfb4-49dd-9058-8a0fde206716 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:26.261421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50dd31f9-bfb4-49dd-9058-8a0fde206716 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:26.261908 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50dd31f9-bfb4-49dd-9058-8a0fde206716 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:26.262377 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50dd31f9-bfb4-49dd-9058-8a0fde206716 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:26.263137 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-acb9d89b-c830-4b9b-a1d8-1044d89103c8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1680 microversion: 2.1 time: 0.676473 Aug 04 17:11:26.264864 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1977/4031] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:25 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1680 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:11:26.278258 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b1e8b516-b01f-43ac-9e43-fc3522ebb2f5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:26.288459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b1e8b516-b01f-43ac-9e43-fc3522ebb2f5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:26.289176 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b1e8b516-b01f-43ac-9e43-fc3522ebb2f5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'e61b34a0cac845c49d7c334921af14c1'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:11:26.668611 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1e8b516-b01f-43ac-9e43-fc3522ebb2f5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:26.669095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1e8b516-b01f-43ac-9e43-fc3522ebb2f5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:26.669534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1e8b516-b01f-43ac-9e43-fc3522ebb2f5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:26.671043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1e8b516-b01f-43ac-9e43-fc3522ebb2f5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:26.671668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1e8b516-b01f-43ac-9e43-fc3522ebb2f5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:26.672290 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-50dd31f9-bfb4-49dd-9058-8a0fde206716 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:26.673016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1e8b516-b01f-43ac-9e43-fc3522ebb2f5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:26.680102 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-50dd31f9-bfb4-49dd-9058-8a0fde206716 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e" status: 200 len: 1299 microversion: 2.1 time: 0.452051 Aug 04 17:11:26.686673 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2055/4032] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:26 2022] GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e => generated 1299 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:26.735986 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-b1e8b516-b01f-43ac-9e43-fc3522ebb2f5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:11:26.779006 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b1e8b516-b01f-43ac-9e43-fc3522ebb2f5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.511658 Aug 04 17:11:26.780398 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1978/4033] 10.222.0.93 () {58 vars in 1150 bytes} [Thu Aug 4 17:11:26 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:26.794221 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-652e8f93-4bc1-4f93-96a2-32342a493965 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:26.802396 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-652e8f93-4bc1-4f93-96a2-32342a493965 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:26.803317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-652e8f93-4bc1-4f93-96a2-32342a493965 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'e61b34a0cac845c49d7c334921af14c1'} {{(pid=131043) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:11:26.809269 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-652e8f93-4bc1-4f93-96a2-32342a493965 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:26.810032 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-652e8f93-4bc1-4f93-96a2-32342a493965 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:26.810653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-652e8f93-4bc1-4f93-96a2-32342a493965 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:26.811576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-652e8f93-4bc1-4f93-96a2-32342a493965 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:26.812242 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-652e8f93-4bc1-4f93-96a2-32342a493965 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:26.812871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-652e8f93-4bc1-4f93-96a2-32342a493965 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:26.934232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.multi_cell_list [None req-652e8f93-4bc1-4f93-96a2-32342a493965 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:11:26.955919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:27.023144 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-652e8f93-4bc1-4f93-96a2-32342a493965 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.232682 Aug 04 17:11:27.024345 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2056/4034] 10.222.0.93 () {58 vars in 1212 bytes} [Thu Aug 4 17:11:26 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:27.036034 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4c1a7205-dc38-49d3-a300-07034688fcbe tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:27.043603 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4c1a7205-dc38-49d3-a300-07034688fcbe tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:27.044324 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4c1a7205-dc38-49d3-a300-07034688fcbe tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'e61b34a0cac845c49d7c334921af14c1'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:11:27.059598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c1a7205-dc38-49d3-a300-07034688fcbe tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:27.060108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c1a7205-dc38-49d3-a300-07034688fcbe tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:27.062445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c1a7205-dc38-49d3-a300-07034688fcbe tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:27.063287 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c1a7205-dc38-49d3-a300-07034688fcbe tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:27.064024 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c1a7205-dc38-49d3-a300-07034688fcbe tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:27.064462 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c1a7205-dc38-49d3-a300-07034688fcbe tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:27.189093 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-4c1a7205-dc38-49d3-a300-07034688fcbe tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:11:27.233752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9509a190-184c-47fc-a7d8-84b67a04a939 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:27.234617 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9509a190-184c-47fc-a7d8-84b67a04a939 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:27.247761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9509a190-184c-47fc-a7d8-84b67a04a939 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:27.248270 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9509a190-184c-47fc-a7d8-84b67a04a939 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:27.248716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9509a190-184c-47fc-a7d8-84b67a04a939 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:27.252674 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9509a190-184c-47fc-a7d8-84b67a04a939 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:27.253250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9509a190-184c-47fc-a7d8-84b67a04a939 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:27.253704 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9509a190-184c-47fc-a7d8-84b67a04a939 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:27.263960 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4c1a7205-dc38-49d3-a300-07034688fcbe tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.231384 Aug 04 17:11:27.267154 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1979/4035] 10.222.0.93 () {58 vars in 1196 bytes} [Thu Aug 4 17:11:27 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:27.293117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b5e53f52-75a5-41a3-be27-87e9806b8105 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:27.302980 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b5e53f52-75a5-41a3-be27-87e9806b8105 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:27.304159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b5e53f52-75a5-41a3-be27-87e9806b8105 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Searching by: {'name': '-727969488', 'deleted': False, 'project_id': 'e61b34a0cac845c49d7c334921af14c1'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:11:27.310226 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5e53f52-75a5-41a3-be27-87e9806b8105 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:27.310988 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5e53f52-75a5-41a3-be27-87e9806b8105 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:27.311435 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5e53f52-75a5-41a3-be27-87e9806b8105 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:27.312166 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5e53f52-75a5-41a3-be27-87e9806b8105 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:27.312639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5e53f52-75a5-41a3-be27-87e9806b8105 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:27.313073 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5e53f52-75a5-41a3-be27-87e9806b8105 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:27.352072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9509a190-184c-47fc-a7d8-84b67a04a939 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:27.363196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9509a190-184c-47fc-a7d8-84b67a04a939 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:27.365406 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9509a190-184c-47fc-a7d8-84b67a04a939 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:27.366716 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9509a190-184c-47fc-a7d8-84b67a04a939 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1339 microversion: 2.20 time: 0.136814 Aug 04 17:11:27.367609 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2057/4036] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:11:27 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1339 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:11:27.372667 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-84a05924-aa7b-451c-a4a6-de4f42773e3c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:27.373730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-84a05924-aa7b-451c-a4a6-de4f42773e3c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:27.381513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84a05924-aa7b-451c-a4a6-de4f42773e3c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:27.382357 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84a05924-aa7b-451c-a4a6-de4f42773e3c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:27.382997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84a05924-aa7b-451c-a4a6-de4f42773e3c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:27.383711 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84a05924-aa7b-451c-a4a6-de4f42773e3c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:27.384175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84a05924-aa7b-451c-a4a6-de4f42773e3c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:27.384604 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84a05924-aa7b-451c-a4a6-de4f42773e3c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:27.445771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-b5e53f52-75a5-41a3-be27-87e9806b8105 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:11:27.510495 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b5e53f52-75a5-41a3-be27-87e9806b8105 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers?name=-727969488" status: 200 len: 345 microversion: 2.1 time: 0.230477 Aug 04 17:11:27.511678 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1980/4037] 10.222.0.93 () {58 vars in 1156 bytes} [Thu Aug 4 17:11:27 2022] GET /compute/v2.1/servers?name=-727969488 => generated 345 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:11:27.517124 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2da26ca3-aa78-41c3-85c7-eca48ccd5ae2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-638550475", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0112e6ac-257e-4b1b-a397-d0c577c627fb"}], "security_groups": [{"name": "tempest-securitygroup--1056972067"}], "key_name": "tempest-keypair-68181367", "user_data": "}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:27.621214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-84a05924-aa7b-451c-a4a6-de4f42773e3c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:27.630433 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-84a05924-aa7b-451c-a4a6-de4f42773e3c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1680 microversion: 2.1 time: 0.261348 Aug 04 17:11:27.631302 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2058/4038] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:27 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1680 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:27.636084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-19a8d05d-867c-4a47-bba8-44a6f2fd4912 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:27.641513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-19a8d05d-867c-4a47-bba8-44a6f2fd4912 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:27.642451 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-19a8d05d-867c-4a47-bba8-44a6f2fd4912 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'e61b34a0cac845c49d7c334921af14c1'} {{(pid=131043) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:11:27.650347 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19a8d05d-867c-4a47-bba8-44a6f2fd4912 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:27.651212 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19a8d05d-867c-4a47-bba8-44a6f2fd4912 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:27.651974 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19a8d05d-867c-4a47-bba8-44a6f2fd4912 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:27.652916 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19a8d05d-867c-4a47-bba8-44a6f2fd4912 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:27.653563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19a8d05d-867c-4a47-bba8-44a6f2fd4912 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:27.654217 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19a8d05d-867c-4a47-bba8-44a6f2fd4912 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:27.658568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-2da26ca3-aa78-41c3-85c7-eca48ccd5ae2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] validate_networks() for [('0112e6ac-257e-4b1b-a397-d0c577c627fb', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:11:27.756080 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.multi_cell_list [None req-19a8d05d-867c-4a47-bba8-44a6f2fd4912 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:11:27.819913 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-19a8d05d-867c-4a47-bba8-44a6f2fd4912 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.187361 Aug 04 17:11:27.821193 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2059/4039] 10.222.0.93 () {58 vars in 1154 bytes} [Thu Aug 4 17:11:27 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:27.826065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-22de48b6-a239-42ee-b48a-ca8701c9e0c0 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:27.827009 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-22de48b6-a239-42ee-b48a-ca8701c9e0c0 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 947ffe69-3080-4602-872d-1bb16591d34e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:27.833587 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-22de48b6-a239-42ee-b48a-ca8701c9e0c0 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:27.834328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-22de48b6-a239-42ee-b48a-ca8701c9e0c0 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:27.834957 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-22de48b6-a239-42ee-b48a-ca8701c9e0c0 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:27.835835 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-22de48b6-a239-42ee-b48a-ca8701c9e0c0 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:27.836459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-22de48b6-a239-42ee-b48a-ca8701c9e0c0 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:27.837081 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-22de48b6-a239-42ee-b48a-ca8701c9e0c0 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:28.156314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-22de48b6-a239-42ee-b48a-ca8701c9e0c0 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:28.173537 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-22de48b6-a239-42ee-b48a-ca8701c9e0c0 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e" status: 200 len: 1367 microversion: 2.1 time: 0.350983 Aug 04 17:11:28.175512 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2060/4040] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:27 2022] GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e => generated 1367 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:28.181371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bef3120b-8806-4733-ae33-5a9e2d2c8a18 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:28.187827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bef3120b-8806-4733-ae33-5a9e2d2c8a18 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:28.189072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bef3120b-8806-4733-ae33-5a9e2d2c8a18 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-72796948', 'deleted': False, 'project_id': 'e61b34a0cac845c49d7c334921af14c1'} {{(pid=131043) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:11:28.200112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bef3120b-8806-4733-ae33-5a9e2d2c8a18 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:28.201513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bef3120b-8806-4733-ae33-5a9e2d2c8a18 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:28.202249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bef3120b-8806-4733-ae33-5a9e2d2c8a18 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:28.203958 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bef3120b-8806-4733-ae33-5a9e2d2c8a18 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:28.205443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bef3120b-8806-4733-ae33-5a9e2d2c8a18 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:28.207057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bef3120b-8806-4733-ae33-5a9e2d2c8a18 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:28.347698 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.multi_cell_list [None req-bef3120b-8806-4733-ae33-5a9e2d2c8a18 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:11:28.393853 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-2da26ca3-aa78-41c3-85c7-eca48ccd5ae2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:11:28.394383 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-2da26ca3-aa78-41c3-85c7-eca48ccd5ae2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:11:28.395361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-2da26ca3-aa78-41c3-85c7-eca48ccd5ae2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:11:28.395786 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-2da26ca3-aa78-41c3-85c7-eca48ccd5ae2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:11:28.396210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-2da26ca3-aa78-41c3-85c7-eca48ccd5ae2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:11:28.415683 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2da26ca3-aa78-41c3-85c7-eca48ccd5ae2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:28.416429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2da26ca3-aa78-41c3-85c7-eca48ccd5ae2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:28.417065 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2da26ca3-aa78-41c3-85c7-eca48ccd5ae2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:28.418011 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2da26ca3-aa78-41c3-85c7-eca48ccd5ae2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:28.418907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2da26ca3-aa78-41c3-85c7-eca48ccd5ae2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:28.419520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2da26ca3-aa78-41c3-85c7-eca48ccd5ae2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:28.425927 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bef3120b-8806-4733-ae33-5a9e2d2c8a18 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-72796948" status: 200 len: 345 microversion: 2.1 time: 0.248433 Aug 04 17:11:28.427970 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2061/4041] 10.222.0.93 () {58 vars in 1226 bytes} [Thu Aug 4 17:11:28 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-72796948 => generated 345 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:11:28.434973 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ca652a35-e22b-4098-aa81-7cac5d3eef2a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:28.436935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ca652a35-e22b-4098-aa81-7cac5d3eef2a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:28.446744 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca652a35-e22b-4098-aa81-7cac5d3eef2a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:28.447460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca652a35-e22b-4098-aa81-7cac5d3eef2a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:28.448334 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca652a35-e22b-4098-aa81-7cac5d3eef2a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:28.449221 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca652a35-e22b-4098-aa81-7cac5d3eef2a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:28.450250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca652a35-e22b-4098-aa81-7cac5d3eef2a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:28.451524 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca652a35-e22b-4098-aa81-7cac5d3eef2a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:28.463704 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-2da26ca3-aa78-41c3-85c7-eca48ccd5ae2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Getting quotas for project 50d2f7cd670340adb1b4187754e302c5. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:11:28.482015 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-2da26ca3-aa78-41c3-85c7-eca48ccd5ae2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Getting quotas for user 067e98d624234a48bb0ea3bde77c049c and project 50d2f7cd670340adb1b4187754e302c5. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:11:28.498392 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2da26ca3-aa78-41c3-85c7-eca48ccd5ae2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:11:28.500749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2da26ca3-aa78-41c3-85c7-eca48ccd5ae2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:11:28.555508 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2da26ca3-aa78-41c3-85c7-eca48ccd5ae2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.042621 Aug 04 17:11:28.562272 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1981/4042] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:11:27 2022] POST /compute/v2.1/servers => generated 409 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:11:28.564361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-403249d4-20e8-47b0-bca3-3728a458291e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:28.564874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-403249d4-20e8-47b0-bca3-3728a458291e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 016fbd16-b01e-4ebf-ad2f-3495970feb96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:28.587258 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-403249d4-20e8-47b0-bca3-3728a458291e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:28.587997 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-403249d4-20e8-47b0-bca3-3728a458291e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:28.588820 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-403249d4-20e8-47b0-bca3-3728a458291e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:28.590140 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-403249d4-20e8-47b0-bca3-3728a458291e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:28.590668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-403249d4-20e8-47b0-bca3-3728a458291e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:28.591330 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-403249d4-20e8-47b0-bca3-3728a458291e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:28.634852 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-403249d4-20e8-47b0-bca3-3728a458291e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 016fbd16-b01e-4ebf-ad2f-3495970feb96] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:11:28.750176 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-403249d4-20e8-47b0-bca3-3728a458291e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "DELETE /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96" status: 204 len: 0 microversion: 2.1 time: 0.191692 Aug 04 17:11:28.751322 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1982/4043] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:11:28 2022] DELETE /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:11:28.761291 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-54ffb9d2-2d52-489a-b58a-1c444c172291 req-9df78827-b1d7-4619-b79f-2ac4c9055ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "947ffe69-3080-4602-872d-1bb16591d34e", "tag": "fd65889d-9876-40e8-8ee4-deac7525c417"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:28.775589 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ca652a35-e22b-4098-aa81-7cac5d3eef2a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:28.776292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-54ffb9d2-2d52-489a-b58a-1c444c172291 req-9df78827-b1d7-4619-b79f-2ac4c9055ff2 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:28.776887 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-54ffb9d2-2d52-489a-b58a-1c444c172291 req-9df78827-b1d7-4619-b79f-2ac4c9055ff2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:28.777339 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-54ffb9d2-2d52-489a-b58a-1c444c172291 req-9df78827-b1d7-4619-b79f-2ac4c9055ff2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:28.787499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ca652a35-e22b-4098-aa81-7cac5d3eef2a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:28.789060 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ca652a35-e22b-4098-aa81-7cac5d3eef2a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:28.790187 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ca652a35-e22b-4098-aa81-7cac5d3eef2a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1406 microversion: 2.20 time: 0.361059 Aug 04 17:11:28.790756 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2062/4044] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:11:28 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1406 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:11:28.806938 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-54ffb9d2-2d52-489a-b58a-1c444c172291 req-9df78827-b1d7-4619-b79f-2ac4c9055ff2 service nova] Creating event network-changed:fd65889d-9876-40e8-8ee4-deac7525c417 for instance 947ffe69-3080-4602-872d-1bb16591d34e on n-h1-851359-3 Aug 04 17:11:28.810860 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f5dc3213-631b-49a1-94ca-d636a9170621 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:28.811641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f5dc3213-631b-49a1-94ca-d636a9170621 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:28.838560 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-54ffb9d2-2d52-489a-b58a-1c444c172291 req-9df78827-b1d7-4619-b79f-2ac4c9055ff2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085676 Aug 04 17:11:28.841713 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1983/4045] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:11:28.865644 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-77056130-d88b-4aad-89c2-d46fbcb5b11e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:28.868750 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-77056130-d88b-4aad-89c2-d46fbcb5b11e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:28.874163 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f5dc3213-631b-49a1-94ca-d636a9170621 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:28.881394 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f5dc3213-631b-49a1-94ca-d636a9170621 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1243 microversion: 2.1 time: 0.074308 Aug 04 17:11:28.884773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77056130-d88b-4aad-89c2-d46fbcb5b11e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:28.887944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77056130-d88b-4aad-89c2-d46fbcb5b11e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:28.888619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77056130-d88b-4aad-89c2-d46fbcb5b11e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:28.890802 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77056130-d88b-4aad-89c2-d46fbcb5b11e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:28.892437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77056130-d88b-4aad-89c2-d46fbcb5b11e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:28.894424 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2063/4046] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:28 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1243 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:28.895537 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77056130-d88b-4aad-89c2-d46fbcb5b11e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:28.900370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-77f1e0f3-8c8b-4fc6-88fd-c3b7ad523003 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:28.901255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-77f1e0f3-8c8b-4fc6-88fd-c3b7ad523003 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 016fbd16-b01e-4ebf-ad2f-3495970feb96] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:28.908378 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77f1e0f3-8c8b-4fc6-88fd-c3b7ad523003 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:28.909204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77f1e0f3-8c8b-4fc6-88fd-c3b7ad523003 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:28.909887 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77f1e0f3-8c8b-4fc6-88fd-c3b7ad523003 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:28.911452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77f1e0f3-8c8b-4fc6-88fd-c3b7ad523003 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:28.912157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77f1e0f3-8c8b-4fc6-88fd-c3b7ad523003 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:28.912850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77f1e0f3-8c8b-4fc6-88fd-c3b7ad523003 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:29.199395 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-77056130-d88b-4aad-89c2-d46fbcb5b11e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:29.204860 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-77f1e0f3-8c8b-4fc6-88fd-c3b7ad523003 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:29.211496 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-77056130-d88b-4aad-89c2-d46fbcb5b11e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1680 microversion: 2.1 time: 0.364835 Aug 04 17:11:29.212337 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1984/4047] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:28 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1680 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:29.213818 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-77f1e0f3-8c8b-4fc6-88fd-c3b7ad523003 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96" status: 200 len: 1518 microversion: 2.1 time: 0.317149 Aug 04 17:11:29.221784 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a6f3f756-96ca-4cb9-85ff-b5130e33875e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:29.225264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a6f3f756-96ca-4cb9-85ff-b5130e33875e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 947ffe69-3080-4602-872d-1bb16591d34e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:29.226540 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2064/4048] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:28 2022] GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96 => generated 1518 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:29.239289 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6f3f756-96ca-4cb9-85ff-b5130e33875e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:29.242038 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6f3f756-96ca-4cb9-85ff-b5130e33875e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:29.243195 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6f3f756-96ca-4cb9-85ff-b5130e33875e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:29.244545 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6f3f756-96ca-4cb9-85ff-b5130e33875e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:29.245205 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6f3f756-96ca-4cb9-85ff-b5130e33875e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:29.245872 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6f3f756-96ca-4cb9-85ff-b5130e33875e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:29.412323 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a6f3f756-96ca-4cb9-85ff-b5130e33875e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:29.417469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:29.431127 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a6f3f756-96ca-4cb9-85ff-b5130e33875e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e" status: 200 len: 1367 microversion: 2.1 time: 0.216313 Aug 04 17:11:29.432210 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1985/4049] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:29 2022] GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:29.812560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-91900e05-81b6-4cc8-afdd-7775937b598d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:29.813175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-91900e05-81b6-4cc8-afdd-7775937b598d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:29.820704 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91900e05-81b6-4cc8-afdd-7775937b598d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:29.821196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91900e05-81b6-4cc8-afdd-7775937b598d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:29.821688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91900e05-81b6-4cc8-afdd-7775937b598d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:29.822490 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91900e05-81b6-4cc8-afdd-7775937b598d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:29.822967 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91900e05-81b6-4cc8-afdd-7775937b598d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:29.823491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91900e05-81b6-4cc8-afdd-7775937b598d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:29.902280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1cd0be80-de90-4354-9e0b-c81f35777ec0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:29.902818 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1cd0be80-de90-4354-9e0b-c81f35777ec0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:29.911674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cd0be80-de90-4354-9e0b-c81f35777ec0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:29.912167 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cd0be80-de90-4354-9e0b-c81f35777ec0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:29.912604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cd0be80-de90-4354-9e0b-c81f35777ec0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:29.913297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cd0be80-de90-4354-9e0b-c81f35777ec0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:29.913752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cd0be80-de90-4354-9e0b-c81f35777ec0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:29.914205 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cd0be80-de90-4354-9e0b-c81f35777ec0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:29.994336 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1cd0be80-de90-4354-9e0b-c81f35777ec0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:30.002810 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1cd0be80-de90-4354-9e0b-c81f35777ec0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1295 microversion: 2.1 time: 0.104613 Aug 04 17:11:30.010132 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1986/4050] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:29 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1295 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:11:30.027543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-91900e05-81b6-4cc8-afdd-7775937b598d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:30.038316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-91900e05-81b6-4cc8-afdd-7775937b598d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:30.040439 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-91900e05-81b6-4cc8-afdd-7775937b598d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:30.042095 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-91900e05-81b6-4cc8-afdd-7775937b598d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1406 microversion: 2.20 time: 0.233326 Aug 04 17:11:30.043276 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2065/4051] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:11:29 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:11:30.237673 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3da5b4f8-3cfb-480e-8274-aa93de921642 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:30.237884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4e35c4bd-5ec9-4bab-8ac6-6d28bff6e39b tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:30.239547 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3da5b4f8-3cfb-480e-8274-aa93de921642 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:30.239722 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4e35c4bd-5ec9-4bab-8ac6-6d28bff6e39b tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 016fbd16-b01e-4ebf-ad2f-3495970feb96] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:30.248871 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3da5b4f8-3cfb-480e-8274-aa93de921642 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:30.249417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e35c4bd-5ec9-4bab-8ac6-6d28bff6e39b tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:30.249854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3da5b4f8-3cfb-480e-8274-aa93de921642 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:30.250140 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e35c4bd-5ec9-4bab-8ac6-6d28bff6e39b tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:30.250690 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e35c4bd-5ec9-4bab-8ac6-6d28bff6e39b tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:30.250861 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3da5b4f8-3cfb-480e-8274-aa93de921642 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:30.251719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e35c4bd-5ec9-4bab-8ac6-6d28bff6e39b tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:30.252193 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3da5b4f8-3cfb-480e-8274-aa93de921642 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:30.252446 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e35c4bd-5ec9-4bab-8ac6-6d28bff6e39b tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:30.252980 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e35c4bd-5ec9-4bab-8ac6-6d28bff6e39b tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:30.253367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3da5b4f8-3cfb-480e-8274-aa93de921642 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:30.253962 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3da5b4f8-3cfb-480e-8274-aa93de921642 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:30.497043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3da5b4f8-3cfb-480e-8274-aa93de921642 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:30.504881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4e35c4bd-5ec9-4bab-8ac6-6d28bff6e39b tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:30.505822 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3da5b4f8-3cfb-480e-8274-aa93de921642 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1657 microversion: 2.1 time: 0.272734 Aug 04 17:11:30.506570 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1987/4052] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:30 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1657 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:30.511856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b872afa7-771a-4b23-84d2-01405864ab63 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:30.512768 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b872afa7-771a-4b23-84d2-01405864ab63 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 947ffe69-3080-4602-872d-1bb16591d34e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:30.518167 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4e35c4bd-5ec9-4bab-8ac6-6d28bff6e39b tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96" status: 200 len: 1518 microversion: 2.1 time: 0.285345 Aug 04 17:11:30.519468 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2066/4053] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:30 2022] GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96 => generated 1518 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:30.527880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-38f75e16-50b5-4d15-adaf-bf0d11d80b05 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:30.528294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b872afa7-771a-4b23-84d2-01405864ab63 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:30.528939 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b872afa7-771a-4b23-84d2-01405864ab63 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:30.529502 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b872afa7-771a-4b23-84d2-01405864ab63 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:30.530552 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b872afa7-771a-4b23-84d2-01405864ab63 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:30.531133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b872afa7-771a-4b23-84d2-01405864ab63 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:30.531648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b872afa7-771a-4b23-84d2-01405864ab63 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:30.538540 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38f75e16-50b5-4d15-adaf-bf0d11d80b05 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:30.539375 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38f75e16-50b5-4d15-adaf-bf0d11d80b05 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:30.540016 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38f75e16-50b5-4d15-adaf-bf0d11d80b05 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:30.570542 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-38f75e16-50b5-4d15-adaf-bf0d11d80b05 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Going to try to start instance {{(pid=131043) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 17:11:30.632883 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-38f75e16-50b5-4d15-adaf-bf0d11d80b05 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action" status: 202 len: 0 microversion: 2.1 time: 0.109605 Aug 04 17:11:30.637453 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2067/4054] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:11:30 2022] POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:11:30.644111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d59e0f4d-1f8d-4a72-bee7-1a5a96ecd066 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:30.645414 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d59e0f4d-1f8d-4a72-bee7-1a5a96ecd066 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:30.652563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d59e0f4d-1f8d-4a72-bee7-1a5a96ecd066 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:30.653072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d59e0f4d-1f8d-4a72-bee7-1a5a96ecd066 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:30.653519 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d59e0f4d-1f8d-4a72-bee7-1a5a96ecd066 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:30.654277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d59e0f4d-1f8d-4a72-bee7-1a5a96ecd066 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:30.654743 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d59e0f4d-1f8d-4a72-bee7-1a5a96ecd066 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:30.655180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d59e0f4d-1f8d-4a72-bee7-1a5a96ecd066 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:30.696801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b872afa7-771a-4b23-84d2-01405864ab63 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:30.707042 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b872afa7-771a-4b23-84d2-01405864ab63 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e" status: 200 len: 1367 microversion: 2.1 time: 0.198981 Aug 04 17:11:30.708743 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1988/4055] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:30 2022] GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:30.858985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d59e0f4d-1f8d-4a72-bee7-1a5a96ecd066 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:30.867220 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d59e0f4d-1f8d-4a72-bee7-1a5a96ecd066 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1666 microversion: 2.1 time: 0.227281 Aug 04 17:11:30.867929 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2068/4056] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:30 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1666 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:30.894240 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-323ca26a-e10d-45d6-8b59-ae5a8045ff52 req-f85c5c60-bf41-4447-a79a-0640b7e4a154 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c682c4f-3eed-44cd-9782-3ed12f2d8f0d", "tag": "8b60e742-6e36-45ea-a5d7-62315ea560df"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:30.905479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-323ca26a-e10d-45d6-8b59-ae5a8045ff52 req-f85c5c60-bf41-4447-a79a-0640b7e4a154 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:30.906388 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-323ca26a-e10d-45d6-8b59-ae5a8045ff52 req-f85c5c60-bf41-4447-a79a-0640b7e4a154 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:30.907063 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-323ca26a-e10d-45d6-8b59-ae5a8045ff52 req-f85c5c60-bf41-4447-a79a-0640b7e4a154 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:30.921882 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-323ca26a-e10d-45d6-8b59-ae5a8045ff52 req-f85c5c60-bf41-4447-a79a-0640b7e4a154 service nova] Creating event network-changed:8b60e742-6e36-45ea-a5d7-62315ea560df for instance 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d on n-h2-851359-3 Aug 04 17:11:30.927535 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-323ca26a-e10d-45d6-8b59-ae5a8045ff52 req-f85c5c60-bf41-4447-a79a-0640b7e4a154 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037542 Aug 04 17:11:30.928380 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1989/4057] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:11:31.025431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3cbc2a31-a1c5-4784-acc7-b3958e7b312b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:31.026162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3cbc2a31-a1c5-4784-acc7-b3958e7b312b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:31.032338 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3cbc2a31-a1c5-4784-acc7-b3958e7b312b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:31.032965 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3cbc2a31-a1c5-4784-acc7-b3958e7b312b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:31.033633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3cbc2a31-a1c5-4784-acc7-b3958e7b312b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:31.034376 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3cbc2a31-a1c5-4784-acc7-b3958e7b312b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:31.034845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3cbc2a31-a1c5-4784-acc7-b3958e7b312b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:31.036015 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3cbc2a31-a1c5-4784-acc7-b3958e7b312b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:31.067622 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6c0622bf-9b2a-420e-b5dc-ab5071bb0063 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:31.068473 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6c0622bf-9b2a-420e-b5dc-ab5071bb0063 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:31.077544 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c0622bf-9b2a-420e-b5dc-ab5071bb0063 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:31.078070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c0622bf-9b2a-420e-b5dc-ab5071bb0063 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:31.078708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c0622bf-9b2a-420e-b5dc-ab5071bb0063 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:31.079434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c0622bf-9b2a-420e-b5dc-ab5071bb0063 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:31.080071 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c0622bf-9b2a-420e-b5dc-ab5071bb0063 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:31.080715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c0622bf-9b2a-420e-b5dc-ab5071bb0063 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:31.125322 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3cbc2a31-a1c5-4784-acc7-b3958e7b312b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:31.132936 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3cbc2a31-a1c5-4784-acc7-b3958e7b312b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1303 microversion: 2.1 time: 0.111697 Aug 04 17:11:31.142743 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2069/4058] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:31 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1303 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:31.227756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6c0622bf-9b2a-420e-b5dc-ab5071bb0063 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:31.236333 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6c0622bf-9b2a-420e-b5dc-ab5071bb0063 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:31.237948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6c0622bf-9b2a-420e-b5dc-ab5071bb0063 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:31.239176 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6c0622bf-9b2a-420e-b5dc-ab5071bb0063 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1406 microversion: 2.20 time: 0.176903 Aug 04 17:11:31.239821 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1990/4059] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:11:31 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:11:31.541126 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d3426888-e8f3-4de2-a3f6-06af4a8cfb05 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:31.541759 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d3426888-e8f3-4de2-a3f6-06af4a8cfb05 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 016fbd16-b01e-4ebf-ad2f-3495970feb96] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:31.557177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3426888-e8f3-4de2-a3f6-06af4a8cfb05 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:31.564015 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3426888-e8f3-4de2-a3f6-06af4a8cfb05 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:31.564579 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3426888-e8f3-4de2-a3f6-06af4a8cfb05 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:31.565358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3426888-e8f3-4de2-a3f6-06af4a8cfb05 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:31.565842 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3426888-e8f3-4de2-a3f6-06af4a8cfb05 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:31.566400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3426888-e8f3-4de2-a3f6-06af4a8cfb05 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:31.713559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d3426888-e8f3-4de2-a3f6-06af4a8cfb05 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:31.722402 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d3426888-e8f3-4de2-a3f6-06af4a8cfb05 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96" status: 200 len: 1476 microversion: 2.1 time: 0.185636 Aug 04 17:11:31.723419 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2070/4060] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:31 2022] GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96 => generated 1476 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:31.730895 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3133d6c1-393b-48a3-b617-b5e1c63aff42 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:31.731600 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3133d6c1-393b-48a3-b617-b5e1c63aff42 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 947ffe69-3080-4602-872d-1bb16591d34e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:31.740738 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3133d6c1-393b-48a3-b617-b5e1c63aff42 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:31.741307 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3133d6c1-393b-48a3-b617-b5e1c63aff42 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:31.741840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3133d6c1-393b-48a3-b617-b5e1c63aff42 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:31.742650 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3133d6c1-393b-48a3-b617-b5e1c63aff42 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:31.743116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3133d6c1-393b-48a3-b617-b5e1c63aff42 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:31.743544 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3133d6c1-393b-48a3-b617-b5e1c63aff42 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:31.890902 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8bc443e4-2b95-4bd4-8d44-62eddc99f2fd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:31.892087 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8bc443e4-2b95-4bd4-8d44-62eddc99f2fd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:31.899249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8bc443e4-2b95-4bd4-8d44-62eddc99f2fd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:31.899748 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8bc443e4-2b95-4bd4-8d44-62eddc99f2fd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:31.900196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8bc443e4-2b95-4bd4-8d44-62eddc99f2fd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:31.911372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8bc443e4-2b95-4bd4-8d44-62eddc99f2fd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:31.912259 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8bc443e4-2b95-4bd4-8d44-62eddc99f2fd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:31.913159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8bc443e4-2b95-4bd4-8d44-62eddc99f2fd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:32.203887 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3133d6c1-393b-48a3-b617-b5e1c63aff42 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:32.214845 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3133d6c1-393b-48a3-b617-b5e1c63aff42 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e" status: 200 len: 1367 microversion: 2.1 time: 0.487689 Aug 04 17:11:32.215683 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1991/4061] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:31 2022] GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e => generated 1367 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:32.232204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6e2b9355-e5a2-4cbe-9963-bbce0c559ff0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:32.233614 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6e2b9355-e5a2-4cbe-9963-bbce0c559ff0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:32.241399 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e2b9355-e5a2-4cbe-9963-bbce0c559ff0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:32.242308 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e2b9355-e5a2-4cbe-9963-bbce0c559ff0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:32.242939 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e2b9355-e5a2-4cbe-9963-bbce0c559ff0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:32.243668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e2b9355-e5a2-4cbe-9963-bbce0c559ff0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:32.244129 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e2b9355-e5a2-4cbe-9963-bbce0c559ff0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:32.244560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e2b9355-e5a2-4cbe-9963-bbce0c559ff0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:32.331960 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8bc443e4-2b95-4bd4-8d44-62eddc99f2fd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:32.340237 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8bc443e4-2b95-4bd4-8d44-62eddc99f2fd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1666 microversion: 2.1 time: 0.456089 Aug 04 17:11:32.347496 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2071/4062] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:31 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1666 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:32.354935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-11d1c6b0-ddb3-4468-a34b-3c9695b83725 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:32.355640 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-11d1c6b0-ddb3-4468-a34b-3c9695b83725 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:32.361865 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-11d1c6b0-ddb3-4468-a34b-3c9695b83725 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:32.362487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-11d1c6b0-ddb3-4468-a34b-3c9695b83725 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:32.363084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-11d1c6b0-ddb3-4468-a34b-3c9695b83725 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:32.364473 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-11d1c6b0-ddb3-4468-a34b-3c9695b83725 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:32.365010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-11d1c6b0-ddb3-4468-a34b-3c9695b83725 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:32.366206 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-11d1c6b0-ddb3-4468-a34b-3c9695b83725 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:32.378969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6e2b9355-e5a2-4cbe-9963-bbce0c559ff0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:32.390871 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6e2b9355-e5a2-4cbe-9963-bbce0c559ff0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1301 microversion: 2.1 time: 0.163937 Aug 04 17:11:32.391709 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1992/4063] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:32 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1301 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:32.405826 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:32.748221 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-626238ba-5580-47a5-b166-22a6184463c0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:32.749177 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-626238ba-5580-47a5-b166-22a6184463c0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 016fbd16-b01e-4ebf-ad2f-3495970feb96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:32.756751 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-626238ba-5580-47a5-b166-22a6184463c0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:32.757390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-626238ba-5580-47a5-b166-22a6184463c0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:32.757840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-626238ba-5580-47a5-b166-22a6184463c0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:32.758623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-626238ba-5580-47a5-b166-22a6184463c0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:32.759199 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-626238ba-5580-47a5-b166-22a6184463c0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:32.759637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-626238ba-5580-47a5-b166-22a6184463c0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:32.920179 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-626238ba-5580-47a5-b166-22a6184463c0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:32.947341 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-626238ba-5580-47a5-b166-22a6184463c0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96" status: 200 len: 1476 microversion: 2.1 time: 0.203560 Aug 04 17:11:32.952138 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1993/4064] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:32 2022] GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96 => generated 1476 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:32.961011 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-11d1c6b0-ddb3-4468-a34b-3c9695b83725 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:32.971581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-11d1c6b0-ddb3-4468-a34b-3c9695b83725 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:32.973120 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-11d1c6b0-ddb3-4468-a34b-3c9695b83725 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:32.974282 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-11d1c6b0-ddb3-4468-a34b-3c9695b83725 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1406 microversion: 2.20 time: 0.624749 Aug 04 17:11:32.982024 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0945d97c-34f7-462e-af6c-dd8856a6d071 req-7774f7a2-f57c-4c14-98bf-830fb11b123b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016fbd16-b01e-4ebf-ad2f-3495970feb96", "name": "network-vif-deleted", "tag": "421a0ea1-5687-4e41-8da8-9b1d6e68d02d"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:32.982442 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2072/4065] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:11:32 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1406 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:11:32.990714 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0945d97c-34f7-462e-af6c-dd8856a6d071 req-7774f7a2-f57c-4c14-98bf-830fb11b123b service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:32.991245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0945d97c-34f7-462e-af6c-dd8856a6d071 req-7774f7a2-f57c-4c14-98bf-830fb11b123b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:32.991835 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0945d97c-34f7-462e-af6c-dd8856a6d071 req-7774f7a2-f57c-4c14-98bf-830fb11b123b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:33.006960 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0945d97c-34f7-462e-af6c-dd8856a6d071 req-7774f7a2-f57c-4c14-98bf-830fb11b123b service nova] Creating event network-vif-deleted:421a0ea1-5687-4e41-8da8-9b1d6e68d02d for instance 016fbd16-b01e-4ebf-ad2f-3495970feb96 on n-h2-851359-3 Aug 04 17:11:33.012018 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0945d97c-34f7-462e-af6c-dd8856a6d071 req-7774f7a2-f57c-4c14-98bf-830fb11b123b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047612 Aug 04 17:11:33.012911 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1994/4066] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:11:33.236226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b7e92800-762e-4c6b-8355-dcee28b5ef75 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:33.237023 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b7e92800-762e-4c6b-8355-dcee28b5ef75 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 947ffe69-3080-4602-872d-1bb16591d34e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:33.250633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bbfbaf74-e6aa-43d5-b1cc-834f7d27360f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:33.251374 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bbfbaf74-e6aa-43d5-b1cc-834f7d27360f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:33.271650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b7e92800-762e-4c6b-8355-dcee28b5ef75 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:33.274288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b7e92800-762e-4c6b-8355-dcee28b5ef75 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:33.277174 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b7e92800-762e-4c6b-8355-dcee28b5ef75 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:33.279628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bbfbaf74-e6aa-43d5-b1cc-834f7d27360f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:33.280590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b7e92800-762e-4c6b-8355-dcee28b5ef75 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:33.281147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b7e92800-762e-4c6b-8355-dcee28b5ef75 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:33.281666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b7e92800-762e-4c6b-8355-dcee28b5ef75 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:33.283751 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bbfbaf74-e6aa-43d5-b1cc-834f7d27360f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:33.284425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bbfbaf74-e6aa-43d5-b1cc-834f7d27360f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:33.286333 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bbfbaf74-e6aa-43d5-b1cc-834f7d27360f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:33.288161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bbfbaf74-e6aa-43d5-b1cc-834f7d27360f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:33.288675 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bbfbaf74-e6aa-43d5-b1cc-834f7d27360f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:33.460969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-bbfbaf74-e6aa-43d5-b1cc-834f7d27360f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lazy-loading 'services' on Instance uuid 8865e4da-4c6b-4f67-bfdc-547839d7dab3 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:11:33.584655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b7e92800-762e-4c6b-8355-dcee28b5ef75 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:33.606989 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b7e92800-762e-4c6b-8355-dcee28b5ef75 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e" status: 200 len: 1367 microversion: 2.1 time: 0.369076 Aug 04 17:11:33.608259 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2073/4067] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:33 2022] GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e => generated 1367 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:33.613119 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c211a709-e0be-431f-8db1-7d6fe531576b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:33.616514 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c211a709-e0be-431f-8db1-7d6fe531576b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:33.629000 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bbfbaf74-e6aa-43d5-b1cc-834f7d27360f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3/os-volume_attachments/2ac06449-f32f-4900-b6e1-3d091ce3fd88" status: 202 len: 0 microversion: 2.1 time: 0.362265 Aug 04 17:11:33.630039 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c211a709-e0be-431f-8db1-7d6fe531576b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:33.630195 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1995/4068] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Aug 4 17:11:33 2022] DELETE /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3/os-volume_attachments/2ac06449-f32f-4900-b6e1-3d091ce3fd88 => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:11:33.630845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c211a709-e0be-431f-8db1-7d6fe531576b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:33.633660 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c211a709-e0be-431f-8db1-7d6fe531576b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:33.635260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c211a709-e0be-431f-8db1-7d6fe531576b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:33.635984 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c211a709-e0be-431f-8db1-7d6fe531576b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:33.638531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c211a709-e0be-431f-8db1-7d6fe531576b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:33.643827 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4abc881f-8246-497c-8a50-9aa54e9e74cf tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:33.644587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4abc881f-8246-497c-8a50-9aa54e9e74cf tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:33.650550 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:33.652143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4abc881f-8246-497c-8a50-9aa54e9e74cf tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:33.652969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4abc881f-8246-497c-8a50-9aa54e9e74cf tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:33.653605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4abc881f-8246-497c-8a50-9aa54e9e74cf tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:33.654370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4abc881f-8246-497c-8a50-9aa54e9e74cf tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:33.655115 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4abc881f-8246-497c-8a50-9aa54e9e74cf tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:33.657077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4abc881f-8246-497c-8a50-9aa54e9e74cf tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:33.980043 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c211a709-e0be-431f-8db1-7d6fe531576b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:33.992745 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c211a709-e0be-431f-8db1-7d6fe531576b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1666 microversion: 2.1 time: 0.383217 Aug 04 17:11:34.002713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4abc881f-8246-497c-8a50-9aa54e9e74cf tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:34.007250 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2074/4069] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:33 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1666 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:34.012641 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4abc881f-8246-497c-8a50-9aa54e9e74cf tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1369 microversion: 2.1 time: 0.380990 Aug 04 17:11:34.013073 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1996/4070] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:33 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1369 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:34.014129 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e8ddc7d5-7496-4feb-a7ef-7dfbbc607a19 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:34.014996 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e8ddc7d5-7496-4feb-a7ef-7dfbbc607a19 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 016fbd16-b01e-4ebf-ad2f-3495970feb96] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:34.018243 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1e74e9f2-7dc1-48a8-b5c9-f4468a92b85b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:34.018853 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1e74e9f2-7dc1-48a8-b5c9-f4468a92b85b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:34.022979 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8ddc7d5-7496-4feb-a7ef-7dfbbc607a19 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:34.024144 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8ddc7d5-7496-4feb-a7ef-7dfbbc607a19 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:34.024812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8ddc7d5-7496-4feb-a7ef-7dfbbc607a19 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:34.025757 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8ddc7d5-7496-4feb-a7ef-7dfbbc607a19 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:34.026560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8ddc7d5-7496-4feb-a7ef-7dfbbc607a19 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:34.027465 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8ddc7d5-7496-4feb-a7ef-7dfbbc607a19 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:34.028444 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e74e9f2-7dc1-48a8-b5c9-f4468a92b85b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:34.028945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e74e9f2-7dc1-48a8-b5c9-f4468a92b85b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:34.029392 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e74e9f2-7dc1-48a8-b5c9-f4468a92b85b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:34.030719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e74e9f2-7dc1-48a8-b5c9-f4468a92b85b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:34.031188 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e74e9f2-7dc1-48a8-b5c9-f4468a92b85b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:34.032336 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e74e9f2-7dc1-48a8-b5c9-f4468a92b85b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:34.063502 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8ddc7d5-7496-4feb-a7ef-7dfbbc607a19 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:34.064655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8ddc7d5-7496-4feb-a7ef-7dfbbc607a19 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:34.065320 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8ddc7d5-7496-4feb-a7ef-7dfbbc607a19 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:34.066018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-e8ddc7d5-7496-4feb-a7ef-7dfbbc607a19 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lazy-loading 'fault' on Instance uuid 016fbd16-b01e-4ebf-ad2f-3495970feb96 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:11:34.145677 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e8ddc7d5-7496-4feb-a7ef-7dfbbc607a19 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:34.156263 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e8ddc7d5-7496-4feb-a7ef-7dfbbc607a19 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96" status: 200 len: 1311 microversion: 2.1 time: 0.146950 Aug 04 17:11:34.157453 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2075/4071] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:34 2022] GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96 => generated 1311 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:34.252874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1e74e9f2-7dc1-48a8-b5c9-f4468a92b85b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:34.263260 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1e74e9f2-7dc1-48a8-b5c9-f4468a92b85b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:34.265334 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1e74e9f2-7dc1-48a8-b5c9-f4468a92b85b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:34.266873 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1e74e9f2-7dc1-48a8-b5c9-f4468a92b85b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1406 microversion: 2.20 time: 0.252583 Aug 04 17:11:34.268156 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1997/4072] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:11:34 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1406 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:11:34.628450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a3682435-0210-4c8e-bb32-716925b266ed tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:34.629537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a3682435-0210-4c8e-bb32-716925b266ed tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 947ffe69-3080-4602-872d-1bb16591d34e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:34.637896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3682435-0210-4c8e-bb32-716925b266ed tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:34.638434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3682435-0210-4c8e-bb32-716925b266ed tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:34.639177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3682435-0210-4c8e-bb32-716925b266ed tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:34.640051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3682435-0210-4c8e-bb32-716925b266ed tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:34.640533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3682435-0210-4c8e-bb32-716925b266ed tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:34.641109 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3682435-0210-4c8e-bb32-716925b266ed tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:34.862399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a3682435-0210-4c8e-bb32-716925b266ed tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:34.871587 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a3682435-0210-4c8e-bb32-716925b266ed tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e" status: 200 len: 1367 microversion: 2.1 time: 0.247348 Aug 04 17:11:34.873460 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2076/4073] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:34 2022] GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:35.015340 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-41144166-bd73-4dff-b4e5-77604a3edbc3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:35.015973 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-41144166-bd73-4dff-b4e5-77604a3edbc3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:35.031203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-205ede33-dfb6-4f19-98d5-942633791c58 req-7345f635-f95b-4191-83a8-f2e95d4babf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c74445a-b3fe-4d2a-9dd3-43ab834d369a", "tag": "70fcf2fa-c35a-42df-b9ec-1cb4ff3a8d65"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:35.031825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41144166-bd73-4dff-b4e5-77604a3edbc3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:35.035935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41144166-bd73-4dff-b4e5-77604a3edbc3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:35.037221 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41144166-bd73-4dff-b4e5-77604a3edbc3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:35.040310 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41144166-bd73-4dff-b4e5-77604a3edbc3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:35.040869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41144166-bd73-4dff-b4e5-77604a3edbc3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:35.041324 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41144166-bd73-4dff-b4e5-77604a3edbc3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:35.061152 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-205ede33-dfb6-4f19-98d5-942633791c58 req-7345f635-f95b-4191-83a8-f2e95d4babf8 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:35.063326 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-205ede33-dfb6-4f19-98d5-942633791c58 req-7345f635-f95b-4191-83a8-f2e95d4babf8 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:35.067202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-205ede33-dfb6-4f19-98d5-942633791c58 req-7345f635-f95b-4191-83a8-f2e95d4babf8 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:35.096576 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-205ede33-dfb6-4f19-98d5-942633791c58 req-7345f635-f95b-4191-83a8-f2e95d4babf8 service nova] Creating event network-changed:70fcf2fa-c35a-42df-b9ec-1cb4ff3a8d65 for instance 0c74445a-b3fe-4d2a-9dd3-43ab834d369a on n-h1-851359-3 Aug 04 17:11:35.105325 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-205ede33-dfb6-4f19-98d5-942633791c58 req-7345f635-f95b-4191-83a8-f2e95d4babf8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079039 Aug 04 17:11:35.106641 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2077/4074] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:11:35.113141 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ab1338fe-0f6b-4d9c-a08e-a92a0463f728 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:35.114743 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ab1338fe-0f6b-4d9c-a08e-a92a0463f728 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:35.128022 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ab1338fe-0f6b-4d9c-a08e-a92a0463f728 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:35.129396 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ab1338fe-0f6b-4d9c-a08e-a92a0463f728 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:35.130242 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ab1338fe-0f6b-4d9c-a08e-a92a0463f728 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:35.131570 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ab1338fe-0f6b-4d9c-a08e-a92a0463f728 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:35.132302 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ab1338fe-0f6b-4d9c-a08e-a92a0463f728 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:35.132930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ab1338fe-0f6b-4d9c-a08e-a92a0463f728 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:35.372466 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-41144166-bd73-4dff-b4e5-77604a3edbc3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:35.385484 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-41144166-bd73-4dff-b4e5-77604a3edbc3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.374342 Aug 04 17:11:35.386114 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1998/4075] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:35 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:35.402295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-67d6ec5b-9269-42b9-9958-adfe0c94b553 req-904940a0-3038-4b05-923b-627dd78434be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "947ffe69-3080-4602-872d-1bb16591d34e", "name": "network-vif-plugged", "status": "completed", "tag": "fd65889d-9876-40e8-8ee4-deac7525c417"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:35.409098 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ab1338fe-0f6b-4d9c-a08e-a92a0463f728 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:35.427281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-67d6ec5b-9269-42b9-9958-adfe0c94b553 req-904940a0-3038-4b05-923b-627dd78434be service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:35.427767 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-67d6ec5b-9269-42b9-9958-adfe0c94b553 req-904940a0-3038-4b05-923b-627dd78434be service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:35.428201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-67d6ec5b-9269-42b9-9958-adfe0c94b553 req-904940a0-3038-4b05-923b-627dd78434be service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:35.428346 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ab1338fe-0f6b-4d9c-a08e-a92a0463f728 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1369 microversion: 2.1 time: 0.319594 Aug 04 17:11:35.430074 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2078/4076] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:35 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1369 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:35.435661 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4de1da8e-367f-44a0-85be-35b077f14075 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:35.436505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4de1da8e-367f-44a0-85be-35b077f14075 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 016fbd16-b01e-4ebf-ad2f-3495970feb96] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:35.444255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4de1da8e-367f-44a0-85be-35b077f14075 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:35.445809 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4de1da8e-367f-44a0-85be-35b077f14075 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:35.446845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4de1da8e-367f-44a0-85be-35b077f14075 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:35.447772 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4de1da8e-367f-44a0-85be-35b077f14075 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:35.448410 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4de1da8e-367f-44a0-85be-35b077f14075 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:35.449077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4de1da8e-367f-44a0-85be-35b077f14075 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:35.456831 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-67d6ec5b-9269-42b9-9958-adfe0c94b553 req-904940a0-3038-4b05-923b-627dd78434be service nova] Creating event network-vif-plugged:fd65889d-9876-40e8-8ee4-deac7525c417 for instance 947ffe69-3080-4602-872d-1bb16591d34e on n-h1-851359-3 Aug 04 17:11:35.471474 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-67d6ec5b-9269-42b9-9958-adfe0c94b553 req-904940a0-3038-4b05-923b-627dd78434be service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084029 Aug 04 17:11:35.473171 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1999/4077] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:11:35.479993 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-4de1da8e-367f-44a0-85be-35b077f14075 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] HTTP exception thrown: Instance 016fbd16-b01e-4ebf-ad2f-3495970feb96 could not be found. Aug 04 17:11:35.481738 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2f8fa927-c7a8-4958-bd76-97ad6dc37aef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:35.482474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2f8fa927-c7a8-4958-bd76-97ad6dc37aef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4de1da8e-367f-44a0-85be-35b077f14075 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Request method failure captured: Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96 HTTP/1.1 Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_2DmxIPcyTb1cOGoxQ8GwU8cw1giYiRUIGyNybORXieuBCt1rXk9izpSOtS_kRgjgRO6Z6D9MGEQxdcKX76BD3EWlB_ROjXF4lYZRcH454h9mSvCckuq7_UcfeD6wAIWYtG1gPddBnTivj8s9OfwgeqLXhhbGdWZX3mJjw5_JiDqXM Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: e61b34a0cac845c49d7c334921af14c1 Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ListServerFiltersTestJSON-1976597098 Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e61b34a0cac845c49d7c334921af14c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e61b34a0cac845c49d7c334921af14c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e61b34a0cac845c49d7c334921af14c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e61b34a0cac845c49d7c334921af14c1"}]}] Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ListServerFiltersTestJSON-1976597098 Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: e61b34a0cac845c49d7c334921af14c1 Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1976597098 Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ListServerFiltersTestJSON-1976597098-project Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 556b051e0d244645a851888bb6bcc265 Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ListServerFiltersTestJSON-1976597098-project Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 016fbd16-b01e-4ebf-ad2f-3495970feb96 could not be found. Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '016fbd16-b01e-4ebf-ad2f-3495970feb96'} Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 016fbd16-b01e-4ebf-ad2f-3495970feb96 could not be found. Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 016fbd16-b01e-4ebf-ad2f-3495970feb96 could not be found. Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:11:35.483193 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:11:35.492615 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:35.492615 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:11:35.492615 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:11:35.492615 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:11:35.492615 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:11:35.492615 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 016fbd16-b01e-4ebf-ad2f-3495970feb96 could not be found. Aug 04 17:11:35.492615 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:11:35.492615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4de1da8e-367f-44a0-85be-35b077f14075 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Returning 404 to user: Instance 016fbd16-b01e-4ebf-ad2f-3495970feb96 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:11:35.492615 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4de1da8e-367f-44a0-85be-35b077f14075 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96" status: 404 len: 111 microversion: 2.1 time: 0.053798 Aug 04 17:11:35.492615 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2079/4078] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:35 2022] GET /compute/v2.1/servers/016fbd16-b01e-4ebf-ad2f-3495970feb96 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:11:35.492615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-326f553e-5df3-48b3-9d3b-58e6c7728e05 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:35.492615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-326f553e-5df3-48b3-9d3b-58e6c7728e05 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:35.500340 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f8fa927-c7a8-4958-bd76-97ad6dc37aef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:35.500549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-326f553e-5df3-48b3-9d3b-58e6c7728e05 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:35.500733 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f8fa927-c7a8-4958-bd76-97ad6dc37aef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:35.500914 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-326f553e-5df3-48b3-9d3b-58e6c7728e05 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:35.501092 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f8fa927-c7a8-4958-bd76-97ad6dc37aef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:35.501259 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-326f553e-5df3-48b3-9d3b-58e6c7728e05 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:35.501434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f8fa927-c7a8-4958-bd76-97ad6dc37aef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:35.501600 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-326f553e-5df3-48b3-9d3b-58e6c7728e05 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:35.501764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f8fa927-c7a8-4958-bd76-97ad6dc37aef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:35.501944 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-326f553e-5df3-48b3-9d3b-58e6c7728e05 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:35.502177 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f8fa927-c7a8-4958-bd76-97ad6dc37aef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:35.502343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-326f553e-5df3-48b3-9d3b-58e6c7728e05 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:35.765539 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-326f553e-5df3-48b3-9d3b-58e6c7728e05 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:35.771807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2f8fa927-c7a8-4958-bd76-97ad6dc37aef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:35.776543 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-326f553e-5df3-48b3-9d3b-58e6c7728e05 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.289712 Aug 04 17:11:35.777212 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2080/4079] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:35 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:35.782282 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2f8fa927-c7a8-4958-bd76-97ad6dc37aef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:35.782282 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2f8fa927-c7a8-4958-bd76-97ad6dc37aef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:35.783101 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2f8fa927-c7a8-4958-bd76-97ad6dc37aef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1406 microversion: 2.20 time: 0.308628 Aug 04 17:11:35.787371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9795f3c5-42b0-415e-ba18-d07dbcfedd5a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:35.788000 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9795f3c5-42b0-415e-ba18-d07dbcfedd5a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: e67fc2ff-0549-433f-9385-cc71740b93c4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:35.794770 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2000/4080] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:11:35 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1406 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:11:35.796659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9795f3c5-42b0-415e-ba18-d07dbcfedd5a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:35.797724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9795f3c5-42b0-415e-ba18-d07dbcfedd5a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:35.798312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9795f3c5-42b0-415e-ba18-d07dbcfedd5a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:35.800572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9795f3c5-42b0-415e-ba18-d07dbcfedd5a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:35.801293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9795f3c5-42b0-415e-ba18-d07dbcfedd5a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:35.801430 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6c3a2ade-ce56-4061-acc9-d262d1d3e2f0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:35.801842 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6c3a2ade-ce56-4061-acc9-d262d1d3e2f0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:35.802092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9795f3c5-42b0-415e-ba18-d07dbcfedd5a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:35.807845 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c3a2ade-ce56-4061-acc9-d262d1d3e2f0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:35.808337 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c3a2ade-ce56-4061-acc9-d262d1d3e2f0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:35.808978 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c3a2ade-ce56-4061-acc9-d262d1d3e2f0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:35.809868 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c3a2ade-ce56-4061-acc9-d262d1d3e2f0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:35.810541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c3a2ade-ce56-4061-acc9-d262d1d3e2f0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:35.811159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c3a2ade-ce56-4061-acc9-d262d1d3e2f0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:35.837297 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9795f3c5-42b0-415e-ba18-d07dbcfedd5a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: e67fc2ff-0549-433f-9385-cc71740b93c4] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:11:35.868446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6c3a2ade-ce56-4061-acc9-d262d1d3e2f0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Unlocking {{(pid=131044) unlock /opt/stack/nova/nova/compute/api.py:4810}} Aug 04 17:11:35.917752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:35.932370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:35.952943 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6c3a2ade-ce56-4061-acc9-d262d1d3e2f0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action" status: 202 len: 0 microversion: 2.1 time: 0.156671 Aug 04 17:11:35.953287 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9795f3c5-42b0-415e-ba18-d07dbcfedd5a tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e67fc2ff-0549-433f-9385-cc71740b93c4" status: 204 len: 0 microversion: 2.1 time: 0.174111 Aug 04 17:11:35.954282 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2001/4081] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:11:35 2022] POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:11:35.958503 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2081/4082] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:11:35 2022] DELETE /compute/v2.1/servers/e67fc2ff-0549-433f-9385-cc71740b93c4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:11:35.961519 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8ee0f141-b394-4c4f-8aaa-bef17ee423af tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:35.962426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8ee0f141-b394-4c4f-8aaa-bef17ee423af tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 947ffe69-3080-4602-872d-1bb16591d34e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:35.964453 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-328e5853-7c44-42c7-94bf-5beb12c480d1 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:35.965223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-328e5853-7c44-42c7-94bf-5beb12c480d1 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: e67fc2ff-0549-433f-9385-cc71740b93c4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:35.969957 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ee0f141-b394-4c4f-8aaa-bef17ee423af tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:35.970804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ee0f141-b394-4c4f-8aaa-bef17ee423af tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:35.971577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ee0f141-b394-4c4f-8aaa-bef17ee423af tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:35.972467 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ee0f141-b394-4c4f-8aaa-bef17ee423af tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:35.972739 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-328e5853-7c44-42c7-94bf-5beb12c480d1 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:35.973324 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-328e5853-7c44-42c7-94bf-5beb12c480d1 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:35.973476 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ee0f141-b394-4c4f-8aaa-bef17ee423af tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:35.973808 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-328e5853-7c44-42c7-94bf-5beb12c480d1 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:35.974247 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ee0f141-b394-4c4f-8aaa-bef17ee423af tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:35.974564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-328e5853-7c44-42c7-94bf-5beb12c480d1 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:35.975072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-328e5853-7c44-42c7-94bf-5beb12c480d1 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:35.975534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-328e5853-7c44-42c7-94bf-5beb12c480d1 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:36.197547 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8ee0f141-b394-4c4f-8aaa-bef17ee423af tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:36.207985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-328e5853-7c44-42c7-94bf-5beb12c480d1 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:36.210115 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8ee0f141-b394-4c4f-8aaa-bef17ee423af tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e" status: 200 len: 1367 microversion: 2.1 time: 0.254059 Aug 04 17:11:36.223178 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2002/4083] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:35 2022] GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:36.223178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2a7a8d1f-bf67-47e8-9607-0e02502028f1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:36.223178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2a7a8d1f-bf67-47e8-9607-0e02502028f1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:36.224423 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a7a8d1f-bf67-47e8-9607-0e02502028f1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:36.224918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a7a8d1f-bf67-47e8-9607-0e02502028f1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:36.225355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a7a8d1f-bf67-47e8-9607-0e02502028f1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:36.226082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a7a8d1f-bf67-47e8-9607-0e02502028f1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:36.226541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a7a8d1f-bf67-47e8-9607-0e02502028f1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:36.226962 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a7a8d1f-bf67-47e8-9607-0e02502028f1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:36.232779 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-328e5853-7c44-42c7-94bf-5beb12c480d1 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/e67fc2ff-0549-433f-9385-cc71740b93c4" status: 200 len: 1518 microversion: 2.1 time: 0.272936 Aug 04 17:11:36.236708 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2082/4084] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:35 2022] GET /compute/v2.1/servers/e67fc2ff-0549-433f-9385-cc71740b93c4 => generated 1518 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:36.367575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2a7a8d1f-bf67-47e8-9607-0e02502028f1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:36.375653 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2a7a8d1f-bf67-47e8-9607-0e02502028f1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.163587 Aug 04 17:11:36.376238 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2003/4085] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:36 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:36.401826 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-edbf4153-91d5-40e4-93da-1370abc1ece0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:36.402727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-edbf4153-91d5-40e4-93da-1370abc1ece0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:36.408635 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-edbf4153-91d5-40e4-93da-1370abc1ece0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:36.409130 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-edbf4153-91d5-40e4-93da-1370abc1ece0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:36.409643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-edbf4153-91d5-40e4-93da-1370abc1ece0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:36.410435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-edbf4153-91d5-40e4-93da-1370abc1ece0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:36.410940 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-edbf4153-91d5-40e4-93da-1370abc1ece0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:36.411380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-edbf4153-91d5-40e4-93da-1370abc1ece0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:36.457503 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fc64ee48-f7a2-4db7-8e8e-a43760d22fc0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:36.458272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fc64ee48-f7a2-4db7-8e8e-a43760d22fc0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:36.470144 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc64ee48-f7a2-4db7-8e8e-a43760d22fc0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:36.470144 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc64ee48-f7a2-4db7-8e8e-a43760d22fc0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:36.470144 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc64ee48-f7a2-4db7-8e8e-a43760d22fc0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:36.470144 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc64ee48-f7a2-4db7-8e8e-a43760d22fc0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:36.470144 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc64ee48-f7a2-4db7-8e8e-a43760d22fc0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:36.470608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc64ee48-f7a2-4db7-8e8e-a43760d22fc0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:36.612324 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-edbf4153-91d5-40e4-93da-1370abc1ece0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:36.621438 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-edbf4153-91d5-40e4-93da-1370abc1ece0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.227926 Aug 04 17:11:36.622340 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2083/4086] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:36 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:36.641461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e4e77f52-5050-41ac-a52b-a774e754c1f7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:36.642467 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e4e77f52-5050-41ac-a52b-a774e754c1f7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:36.649100 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4e77f52-5050-41ac-a52b-a774e754c1f7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:36.649883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4e77f52-5050-41ac-a52b-a774e754c1f7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:36.650585 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4e77f52-5050-41ac-a52b-a774e754c1f7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:36.651528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4e77f52-5050-41ac-a52b-a774e754c1f7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:36.652458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4e77f52-5050-41ac-a52b-a774e754c1f7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:36.653128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4e77f52-5050-41ac-a52b-a774e754c1f7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:36.654655 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fc64ee48-f7a2-4db7-8e8e-a43760d22fc0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:36.663039 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fc64ee48-f7a2-4db7-8e8e-a43760d22fc0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1369 microversion: 2.1 time: 0.210259 Aug 04 17:11:36.663617 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2004/4087] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:36 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1369 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:11:36.788783 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e4e77f52-5050-41ac-a52b-a774e754c1f7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:36.796730 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e4e77f52-5050-41ac-a52b-a774e754c1f7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.158845 Aug 04 17:11:36.797322 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2084/4088] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:36 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:11:36.805826 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-158ab56c-1bf0-4849-a1bd-c443f3fd6b59 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:36.807095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-158ab56c-1bf0-4849-a1bd-c443f3fd6b59 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:36.814455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-158ab56c-1bf0-4849-a1bd-c443f3fd6b59 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:36.815091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-158ab56c-1bf0-4849-a1bd-c443f3fd6b59 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:36.815630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-158ab56c-1bf0-4849-a1bd-c443f3fd6b59 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:36.816459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-158ab56c-1bf0-4849-a1bd-c443f3fd6b59 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:36.817154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-158ab56c-1bf0-4849-a1bd-c443f3fd6b59 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:36.817684 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-158ab56c-1bf0-4849-a1bd-c443f3fd6b59 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:36.818656 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e0a2f1bf-3df5-4029-923c-594a407a32d7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:36.819219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e0a2f1bf-3df5-4029-923c-594a407a32d7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:36.827181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0a2f1bf-3df5-4029-923c-594a407a32d7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:36.827687 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0a2f1bf-3df5-4029-923c-594a407a32d7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:36.828140 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0a2f1bf-3df5-4029-923c-594a407a32d7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:36.828859 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0a2f1bf-3df5-4029-923c-594a407a32d7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:36.829330 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0a2f1bf-3df5-4029-923c-594a407a32d7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:36.829763 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0a2f1bf-3df5-4029-923c-594a407a32d7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:36.906925 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e0a2f1bf-3df5-4029-923c-594a407a32d7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action" status: 202 len: 0 microversion: 2.1 time: 0.092338 Aug 04 17:11:36.910560 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2085/4089] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:11:36 2022] POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:11:36.917407 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4201f193-c7da-410a-b4db-1b6df6bd496f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:36.918158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4201f193-c7da-410a-b4db-1b6df6bd496f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:36.924727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4201f193-c7da-410a-b4db-1b6df6bd496f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:36.925225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4201f193-c7da-410a-b4db-1b6df6bd496f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:36.926322 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4201f193-c7da-410a-b4db-1b6df6bd496f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:36.927048 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4201f193-c7da-410a-b4db-1b6df6bd496f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:36.927519 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4201f193-c7da-410a-b4db-1b6df6bd496f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:36.928004 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4201f193-c7da-410a-b4db-1b6df6bd496f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:36.964199 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-158ab56c-1bf0-4849-a1bd-c443f3fd6b59 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:36.973568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-158ab56c-1bf0-4849-a1bd-c443f3fd6b59 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:36.975114 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-158ab56c-1bf0-4849-a1bd-c443f3fd6b59 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:36.976397 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-158ab56c-1bf0-4849-a1bd-c443f3fd6b59 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1406 microversion: 2.20 time: 0.174463 Aug 04 17:11:36.977137 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2005/4090] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:11:36 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:11:37.071011 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4201f193-c7da-410a-b4db-1b6df6bd496f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:37.080105 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4201f193-c7da-410a-b4db-1b6df6bd496f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1675 microversion: 2.1 time: 0.167538 Aug 04 17:11:37.080671 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2086/4091] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:36 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1675 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:11:37.230534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a30c9f3e-81aa-4237-afa1-73391f7cea04 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:37.231871 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a30c9f3e-81aa-4237-afa1-73391f7cea04 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 947ffe69-3080-4602-872d-1bb16591d34e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:37.246936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a30c9f3e-81aa-4237-afa1-73391f7cea04 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:37.247445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a30c9f3e-81aa-4237-afa1-73391f7cea04 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:37.248106 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a30c9f3e-81aa-4237-afa1-73391f7cea04 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:37.248987 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a30c9f3e-81aa-4237-afa1-73391f7cea04 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:37.249623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a30c9f3e-81aa-4237-afa1-73391f7cea04 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:37.250303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a30c9f3e-81aa-4237-afa1-73391f7cea04 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:37.258040 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ded71c82-0983-46ec-bbf3-83f2b0fda34e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:37.259322 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ded71c82-0983-46ec-bbf3-83f2b0fda34e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: e67fc2ff-0549-433f-9385-cc71740b93c4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:37.266287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ded71c82-0983-46ec-bbf3-83f2b0fda34e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:37.267481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ded71c82-0983-46ec-bbf3-83f2b0fda34e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:37.268177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ded71c82-0983-46ec-bbf3-83f2b0fda34e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:37.270420 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ded71c82-0983-46ec-bbf3-83f2b0fda34e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:37.271123 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ded71c82-0983-46ec-bbf3-83f2b0fda34e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:37.271780 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ded71c82-0983-46ec-bbf3-83f2b0fda34e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:37.301623 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:37.611477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ded71c82-0983-46ec-bbf3-83f2b0fda34e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:37.619168 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ded71c82-0983-46ec-bbf3-83f2b0fda34e tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/e67fc2ff-0549-433f-9385-cc71740b93c4" status: 200 len: 1518 microversion: 2.1 time: 0.366349 Aug 04 17:11:37.623014 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a30c9f3e-81aa-4237-afa1-73391f7cea04 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:37.631454 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a30c9f3e-81aa-4237-afa1-73391f7cea04 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e" status: 200 len: 1367 microversion: 2.1 time: 0.405375 Aug 04 17:11:37.632225 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2006/4092] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:37 2022] GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e => generated 1367 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:37.632578 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2087/4093] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:37 2022] GET /compute/v2.1/servers/e67fc2ff-0549-433f-9385-cc71740b93c4 => generated 1518 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:11:37.651063 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-3eb086bf-68e9-4bf9-94bd-34094f5757ec req-6ce55d56-c4c4-481e-97f8-e59f8408f739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c682c4f-3eed-44cd-9782-3ed12f2d8f0d", "name": "network-vif-plugged", "status": "completed", "tag": "8b60e742-6e36-45ea-a5d7-62315ea560df"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:37.663832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-3eb086bf-68e9-4bf9-94bd-34094f5757ec req-6ce55d56-c4c4-481e-97f8-e59f8408f739 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:37.664653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-3eb086bf-68e9-4bf9-94bd-34094f5757ec req-6ce55d56-c4c4-481e-97f8-e59f8408f739 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:37.665505 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-3eb086bf-68e9-4bf9-94bd-34094f5757ec req-6ce55d56-c4c4-481e-97f8-e59f8408f739 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:37.677097 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-3eb086bf-68e9-4bf9-94bd-34094f5757ec req-6ce55d56-c4c4-481e-97f8-e59f8408f739 service nova] Creating event network-vif-plugged:8b60e742-6e36-45ea-a5d7-62315ea560df for instance 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d on n-h2-851359-3 Aug 04 17:11:37.683172 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-3eb086bf-68e9-4bf9-94bd-34094f5757ec req-6ce55d56-c4c4-481e-97f8-e59f8408f739 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049978 Aug 04 17:11:37.683861 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2007/4094] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:11:37.684726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7b6fc6f6-b3f5-427b-9fae-feec0fcd9cbd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:37.685699 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7b6fc6f6-b3f5-427b-9fae-feec0fcd9cbd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:37.694320 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b6fc6f6-b3f5-427b-9fae-feec0fcd9cbd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:37.695282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b6fc6f6-b3f5-427b-9fae-feec0fcd9cbd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:37.696140 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b6fc6f6-b3f5-427b-9fae-feec0fcd9cbd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:37.697398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b6fc6f6-b3f5-427b-9fae-feec0fcd9cbd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:37.698209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b6fc6f6-b3f5-427b-9fae-feec0fcd9cbd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:37.698893 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b6fc6f6-b3f5-427b-9fae-feec0fcd9cbd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:37.898899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7b6fc6f6-b3f5-427b-9fae-feec0fcd9cbd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:37.916931 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7b6fc6f6-b3f5-427b-9fae-feec0fcd9cbd tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1369 microversion: 2.1 time: 0.235913 Aug 04 17:11:37.923237 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2088/4095] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:37 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1369 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:11:37.999975 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5244179b-9246-4159-a289-b0e4404740a3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:38.000691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5244179b-9246-4159-a289-b0e4404740a3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:38.011870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5244179b-9246-4159-a289-b0e4404740a3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:38.019987 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5244179b-9246-4159-a289-b0e4404740a3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:38.022854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5244179b-9246-4159-a289-b0e4404740a3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:38.025920 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5244179b-9246-4159-a289-b0e4404740a3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:38.027468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5244179b-9246-4159-a289-b0e4404740a3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:38.029458 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5244179b-9246-4159-a289-b0e4404740a3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:38.103430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9f067e29-78d2-4fa6-b4e2-14c89d237960 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:38.103897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9f067e29-78d2-4fa6-b4e2-14c89d237960 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:38.125152 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f067e29-78d2-4fa6-b4e2-14c89d237960 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:38.125674 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f067e29-78d2-4fa6-b4e2-14c89d237960 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:38.126157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f067e29-78d2-4fa6-b4e2-14c89d237960 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:38.126895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f067e29-78d2-4fa6-b4e2-14c89d237960 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:38.127545 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f067e29-78d2-4fa6-b4e2-14c89d237960 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:38.127983 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f067e29-78d2-4fa6-b4e2-14c89d237960 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:38.259942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=12 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:38.357450 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5244179b-9246-4159-a289-b0e4404740a3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:38.371499 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5244179b-9246-4159-a289-b0e4404740a3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:38.373051 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5244179b-9246-4159-a289-b0e4404740a3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:38.374586 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5244179b-9246-4159-a289-b0e4404740a3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1406 microversion: 2.20 time: 0.379290 Aug 04 17:11:38.379536 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2008/4096] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:11:37 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1406 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:11:38.387046 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9f067e29-78d2-4fa6-b4e2-14c89d237960 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:38.396477 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9f067e29-78d2-4fa6-b4e2-14c89d237960 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1655 microversion: 2.1 time: 0.297487 Aug 04 17:11:38.409999 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2089/4097] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:38 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1655 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:38.417502 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9063eb65-1a67-48f9-9469-9cd82e41500e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:38.418465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9063eb65-1a67-48f9-9469-9cd82e41500e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:38.424798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9063eb65-1a67-48f9-9469-9cd82e41500e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:38.425478 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9063eb65-1a67-48f9-9469-9cd82e41500e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:38.426216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9063eb65-1a67-48f9-9469-9cd82e41500e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:38.427094 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9063eb65-1a67-48f9-9469-9cd82e41500e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:38.427789 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9063eb65-1a67-48f9-9469-9cd82e41500e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:38.428424 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9063eb65-1a67-48f9-9469-9cd82e41500e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:38.443865 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=12 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:38.500922 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=20 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:38.534545 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9063eb65-1a67-48f9-9469-9cd82e41500e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action" status: 202 len: 0 microversion: 2.1 time: 0.120927 Aug 04 17:11:38.536107 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2009/4098] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:11:38 2022] POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:11:38.543857 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0bb09d40-a8ba-42f1-b9be-daf9b4ac18d3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:38.544927 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0bb09d40-a8ba-42f1-b9be-daf9b4ac18d3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:38.560158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0bb09d40-a8ba-42f1-b9be-daf9b4ac18d3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:38.560992 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0bb09d40-a8ba-42f1-b9be-daf9b4ac18d3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:38.563303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0bb09d40-a8ba-42f1-b9be-daf9b4ac18d3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:38.564757 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0bb09d40-a8ba-42f1-b9be-daf9b4ac18d3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:38.575786 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0bb09d40-a8ba-42f1-b9be-daf9b4ac18d3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:38.576340 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0bb09d40-a8ba-42f1-b9be-daf9b4ac18d3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:38.628209 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-5f8c35b3-cc71-42aa-92d9-3d21a7614da5 req-8810a935-db45-4250-ad87-60d2a6804d5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e67fc2ff-0549-433f-9385-cc71740b93c4", "name": "network-vif-deleted", "tag": "50db24c4-a63b-4eaa-a3aa-9b7c1c1dadd4"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:38.656862 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5f8c35b3-cc71-42aa-92d9-3d21a7614da5 req-8810a935-db45-4250-ad87-60d2a6804d5e service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:38.657362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5f8c35b3-cc71-42aa-92d9-3d21a7614da5 req-8810a935-db45-4250-ad87-60d2a6804d5e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:38.660864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5f8c35b3-cc71-42aa-92d9-3d21a7614da5 req-8810a935-db45-4250-ad87-60d2a6804d5e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:38.688484 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-5f8c35b3-cc71-42aa-92d9-3d21a7614da5 req-8810a935-db45-4250-ad87-60d2a6804d5e service nova] Creating event network-vif-deleted:50db24c4-a63b-4eaa-a3aa-9b7c1c1dadd4 for instance e67fc2ff-0549-433f-9385-cc71740b93c4 on n-h2-851359-3 Aug 04 17:11:38.697790 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-5f8c35b3-cc71-42aa-92d9-3d21a7614da5 req-8810a935-db45-4250-ad87-60d2a6804d5e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074964 Aug 04 17:11:38.702939 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2010/4099] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:11:38.715526 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d2b58792-e880-451c-8c8f-f9483301ab24 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:38.716251 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d2b58792-e880-451c-8c8f-f9483301ab24 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: e67fc2ff-0549-433f-9385-cc71740b93c4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:38.731594 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2b58792-e880-451c-8c8f-f9483301ab24 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:38.732111 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2b58792-e880-451c-8c8f-f9483301ab24 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:38.735211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2b58792-e880-451c-8c8f-f9483301ab24 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:38.736032 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2b58792-e880-451c-8c8f-f9483301ab24 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:38.736524 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2b58792-e880-451c-8c8f-f9483301ab24 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:38.740743 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2b58792-e880-451c-8c8f-f9483301ab24 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:38.771351 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0bb09d40-a8ba-42f1-b9be-daf9b4ac18d3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:38.780161 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0bb09d40-a8ba-42f1-b9be-daf9b4ac18d3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1662 microversion: 2.1 time: 0.240154 Aug 04 17:11:38.785121 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2090/4100] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:38 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1662 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:38.803176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-80c55691-2a02-4b78-ad07-06d9bdfd9c45 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:38.803688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-80c55691-2a02-4b78-ad07-06d9bdfd9c45 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 947ffe69-3080-4602-872d-1bb16591d34e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:38.826988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80c55691-2a02-4b78-ad07-06d9bdfd9c45 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:38.827502 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80c55691-2a02-4b78-ad07-06d9bdfd9c45 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:38.827953 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80c55691-2a02-4b78-ad07-06d9bdfd9c45 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:38.828686 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80c55691-2a02-4b78-ad07-06d9bdfd9c45 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:38.830278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80c55691-2a02-4b78-ad07-06d9bdfd9c45 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:38.830789 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80c55691-2a02-4b78-ad07-06d9bdfd9c45 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:38.893405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d2b58792-e880-451c-8c8f-f9483301ab24 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:38.895874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=18 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:38.903860 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d2b58792-e880-451c-8c8f-f9483301ab24 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/e67fc2ff-0549-433f-9385-cc71740b93c4" status: 200 len: 1476 microversion: 2.1 time: 0.199536 Aug 04 17:11:38.904725 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2011/4101] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:38 2022] GET /compute/v2.1/servers/e67fc2ff-0549-433f-9385-cc71740b93c4 => generated 1476 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:38.941789 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7986a6c5-a4b4-4cda-b763-af3e564c23fb tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:38.942584 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7986a6c5-a4b4-4cda-b763-af3e564c23fb tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:38.955512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7986a6c5-a4b4-4cda-b763-af3e564c23fb tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:38.956016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7986a6c5-a4b4-4cda-b763-af3e564c23fb tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:38.956618 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7986a6c5-a4b4-4cda-b763-af3e564c23fb tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:38.957930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7986a6c5-a4b4-4cda-b763-af3e564c23fb tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:38.958419 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7986a6c5-a4b4-4cda-b763-af3e564c23fb tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:38.958855 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7986a6c5-a4b4-4cda-b763-af3e564c23fb tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:39.107267 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-80c55691-2a02-4b78-ad07-06d9bdfd9c45 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:39.123003 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-80c55691-2a02-4b78-ad07-06d9bdfd9c45 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e" status: 200 len: 1367 microversion: 2.1 time: 0.332530 Aug 04 17:11:39.127262 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2091/4102] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:38 2022] GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e => generated 1367 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:39.215734 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7986a6c5-a4b4-4cda-b763-af3e564c23fb tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:39.228637 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7986a6c5-a4b4-4cda-b763-af3e564c23fb tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1369 microversion: 2.1 time: 0.290834 Aug 04 17:11:39.229990 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2012/4103] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:38 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1369 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:39.402184 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e033d606-a1d7-441c-8b5c-cf8e742dd9c3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:39.402771 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e033d606-a1d7-441c-8b5c-cf8e742dd9c3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:39.411451 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e033d606-a1d7-441c-8b5c-cf8e742dd9c3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:39.412231 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e033d606-a1d7-441c-8b5c-cf8e742dd9c3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:39.412856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e033d606-a1d7-441c-8b5c-cf8e742dd9c3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:39.413800 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e033d606-a1d7-441c-8b5c-cf8e742dd9c3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:39.414505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e033d606-a1d7-441c-8b5c-cf8e742dd9c3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:39.415873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e033d606-a1d7-441c-8b5c-cf8e742dd9c3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:39.621214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e033d606-a1d7-441c-8b5c-cf8e742dd9c3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:39.629781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e033d606-a1d7-441c-8b5c-cf8e742dd9c3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:39.631575 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e033d606-a1d7-441c-8b5c-cf8e742dd9c3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:39.632919 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e033d606-a1d7-441c-8b5c-cf8e742dd9c3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1406 microversion: 2.20 time: 0.235418 Aug 04 17:11:39.633505 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2092/4104] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:11:39 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1406 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:11:39.811940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-717ae7f0-9775-460c-967e-b3f972d749cd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:39.813070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-717ae7f0-9775-460c-967e-b3f972d749cd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:39.822042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-717ae7f0-9775-460c-967e-b3f972d749cd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:39.822863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-717ae7f0-9775-460c-967e-b3f972d749cd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:39.823465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-717ae7f0-9775-460c-967e-b3f972d749cd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:39.824179 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-717ae7f0-9775-460c-967e-b3f972d749cd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:39.824641 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-717ae7f0-9775-460c-967e-b3f972d749cd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:39.825072 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-717ae7f0-9775-460c-967e-b3f972d749cd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:39.932910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ac43da50-92f4-47d6-adf7-982ac23cc912 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:39.934197 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ac43da50-92f4-47d6-adf7-982ac23cc912 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: e67fc2ff-0549-433f-9385-cc71740b93c4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:39.943563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac43da50-92f4-47d6-adf7-982ac23cc912 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:39.944500 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac43da50-92f4-47d6-adf7-982ac23cc912 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:39.945053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac43da50-92f4-47d6-adf7-982ac23cc912 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:39.946054 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac43da50-92f4-47d6-adf7-982ac23cc912 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:39.947141 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac43da50-92f4-47d6-adf7-982ac23cc912 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:39.947842 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac43da50-92f4-47d6-adf7-982ac23cc912 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:39.967414 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-717ae7f0-9775-460c-967e-b3f972d749cd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:39.981809 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-717ae7f0-9775-460c-967e-b3f972d749cd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.175300 Aug 04 17:11:39.982590 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2013/4105] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:39 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:11:39.990349 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac43da50-92f4-47d6-adf7-982ac23cc912 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:39.991114 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac43da50-92f4-47d6-adf7-982ac23cc912 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:39.991795 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac43da50-92f4-47d6-adf7-982ac23cc912 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:39.992594 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-ac43da50-92f4-47d6-adf7-982ac23cc912 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lazy-loading 'fault' on Instance uuid e67fc2ff-0549-433f-9385-cc71740b93c4 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:11:40.009943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-66bc80d3-7dba-4740-a52f-2b067118240a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:40.010651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-66bc80d3-7dba-4740-a52f-2b067118240a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:40.019089 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66bc80d3-7dba-4740-a52f-2b067118240a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:40.020214 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66bc80d3-7dba-4740-a52f-2b067118240a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:40.020670 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66bc80d3-7dba-4740-a52f-2b067118240a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:40.021407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66bc80d3-7dba-4740-a52f-2b067118240a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:40.022427 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66bc80d3-7dba-4740-a52f-2b067118240a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:40.022884 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66bc80d3-7dba-4740-a52f-2b067118240a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:40.056764 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ac43da50-92f4-47d6-adf7-982ac23cc912 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:40.067799 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ac43da50-92f4-47d6-adf7-982ac23cc912 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/e67fc2ff-0549-433f-9385-cc71740b93c4" status: 200 len: 1311 microversion: 2.1 time: 0.144149 Aug 04 17:11:40.069029 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2093/4106] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:39 2022] GET /compute/v2.1/servers/e67fc2ff-0549-433f-9385-cc71740b93c4 => generated 1311 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:40.153317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-73637c87-f712-4d33-928b-a034653d50e2 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:40.154928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-73637c87-f712-4d33-928b-a034653d50e2 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 947ffe69-3080-4602-872d-1bb16591d34e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:40.182031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73637c87-f712-4d33-928b-a034653d50e2 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:40.182890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73637c87-f712-4d33-928b-a034653d50e2 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:40.192031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73637c87-f712-4d33-928b-a034653d50e2 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:40.193165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73637c87-f712-4d33-928b-a034653d50e2 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:40.202134 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73637c87-f712-4d33-928b-a034653d50e2 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:40.203021 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73637c87-f712-4d33-928b-a034653d50e2 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:40.250052 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-66bc80d3-7dba-4740-a52f-2b067118240a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:40.261597 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-66bc80d3-7dba-4740-a52f-2b067118240a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.255789 Aug 04 17:11:40.263135 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2014/4107] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:40 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:40.268039 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2848c98b-62aa-4446-8169-ad31f3d6c08d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:40.281665 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2848c98b-62aa-4446-8169-ad31f3d6c08d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:40.293220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2848c98b-62aa-4446-8169-ad31f3d6c08d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:40.293997 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2848c98b-62aa-4446-8169-ad31f3d6c08d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:40.294626 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2848c98b-62aa-4446-8169-ad31f3d6c08d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:40.295541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2848c98b-62aa-4446-8169-ad31f3d6c08d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:40.309389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2848c98b-62aa-4446-8169-ad31f3d6c08d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:40.310275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2848c98b-62aa-4446-8169-ad31f3d6c08d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:40.500708 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-73637c87-f712-4d33-928b-a034653d50e2 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:40.515717 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-73637c87-f712-4d33-928b-a034653d50e2 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e" status: 200 len: 1557 microversion: 2.1 time: 0.367750 Aug 04 17:11:40.516457 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2094/4108] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:40 2022] GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e => generated 1557 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:40.528100 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-977b47df-115b-47a7-b15e-4311599cb9aa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:40.529001 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-977b47df-115b-47a7-b15e-4311599cb9aa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:40.540690 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-977b47df-115b-47a7-b15e-4311599cb9aa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:40.541210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-977b47df-115b-47a7-b15e-4311599cb9aa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:40.545055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-977b47df-115b-47a7-b15e-4311599cb9aa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:40.545817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-977b47df-115b-47a7-b15e-4311599cb9aa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:40.546336 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-977b47df-115b-47a7-b15e-4311599cb9aa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:40.546777 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-977b47df-115b-47a7-b15e-4311599cb9aa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:40.607684 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2848c98b-62aa-4446-8169-ad31f3d6c08d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:40.617246 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2848c98b-62aa-4446-8169-ad31f3d6c08d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1369 microversion: 2.1 time: 0.352670 Aug 04 17:11:40.617929 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2015/4109] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:40 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1369 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:40.623358 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f9a2cfbb-1376-4883-b690-73dd39c7c1e3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:40.631252 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9a2cfbb-1376-4883-b690-73dd39c7c1e3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:40.631879 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9a2cfbb-1376-4883-b690-73dd39c7c1e3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:40.632388 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9a2cfbb-1376-4883-b690-73dd39c7c1e3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:40.658266 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f9a2cfbb-1376-4883-b690-73dd39c7c1e3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Going to try to stop instance {{(pid=131044) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 17:11:40.709684 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f9a2cfbb-1376-4883-b690-73dd39c7c1e3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "POST /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3/action" status: 202 len: 0 microversion: 2.1 time: 0.089852 Aug 04 17:11:40.714941 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2016/4110] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:11:40 2022] POST /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:11:40.721883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4d7542b3-1d4b-48d0-903a-bdda16796e32 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:40.724350 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4d7542b3-1d4b-48d0-903a-bdda16796e32 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 947ffe69-3080-4602-872d-1bb16591d34e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:40.742823 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d7542b3-1d4b-48d0-903a-bdda16796e32 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:40.743340 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d7542b3-1d4b-48d0-903a-bdda16796e32 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:40.743788 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d7542b3-1d4b-48d0-903a-bdda16796e32 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:40.747172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d7542b3-1d4b-48d0-903a-bdda16796e32 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:40.747835 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d7542b3-1d4b-48d0-903a-bdda16796e32 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:40.748410 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d7542b3-1d4b-48d0-903a-bdda16796e32 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:40.770499 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:40.858390 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4d7542b3-1d4b-48d0-903a-bdda16796e32 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.144214 Aug 04 17:11:40.858935 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2017/4111] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Aug 4 17:11:40 2022] GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e/os-interface => generated 285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:11:40.864251 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ea40835b-063b-4aeb-a47a-62904d5f159c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:40.864864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ea40835b-063b-4aeb-a47a-62904d5f159c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:40.878016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea40835b-063b-4aeb-a47a-62904d5f159c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:40.879541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea40835b-063b-4aeb-a47a-62904d5f159c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:40.880430 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea40835b-063b-4aeb-a47a-62904d5f159c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:40.881343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea40835b-063b-4aeb-a47a-62904d5f159c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:40.882378 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea40835b-063b-4aeb-a47a-62904d5f159c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:40.882986 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea40835b-063b-4aeb-a47a-62904d5f159c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:40.894310 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-977b47df-115b-47a7-b15e-4311599cb9aa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:40.907539 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-977b47df-115b-47a7-b15e-4311599cb9aa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.389486 Aug 04 17:11:40.912954 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2095/4112] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:40 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:40.921577 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dd9cbd8d-cf6c-4ea9-8e10-fc213b6e41be tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:40.924935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dd9cbd8d-cf6c-4ea9-8e10-fc213b6e41be tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:40.938364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd9cbd8d-cf6c-4ea9-8e10-fc213b6e41be tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:40.939134 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd9cbd8d-cf6c-4ea9-8e10-fc213b6e41be tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:40.939588 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd9cbd8d-cf6c-4ea9-8e10-fc213b6e41be tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:40.946973 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd9cbd8d-cf6c-4ea9-8e10-fc213b6e41be tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:40.947476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd9cbd8d-cf6c-4ea9-8e10-fc213b6e41be tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:40.947927 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd9cbd8d-cf6c-4ea9-8e10-fc213b6e41be tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:41.325863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dd9cbd8d-cf6c-4ea9-8e10-fc213b6e41be tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:41.343387 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dd9cbd8d-cf6c-4ea9-8e10-fc213b6e41be tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1677 microversion: 2.1 time: 0.428938 Aug 04 17:11:41.345380 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ea40835b-063b-4aeb-a47a-62904d5f159c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:41.347238 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2096/4113] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:40 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1677 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:41.355842 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ea40835b-063b-4aeb-a47a-62904d5f159c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:41.356129 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-34b67cd0-12c2-4330-8d6d-52ff571cda55 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:41.357678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-34b67cd0-12c2-4330-8d6d-52ff571cda55 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:41.358441 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ea40835b-063b-4aeb-a47a-62904d5f159c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:41.359924 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ea40835b-063b-4aeb-a47a-62904d5f159c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1599 microversion: 2.20 time: 0.499868 Aug 04 17:11:41.361666 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2018/4114] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:11:40 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1599 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:11:41.369488 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4d187ef5-b704-4818-9d4d-ae3995296e2d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:41.370380 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4d187ef5-b704-4818-9d4d-ae3995296e2d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: e67fc2ff-0549-433f-9385-cc71740b93c4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:41.373228 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-34b67cd0-12c2-4330-8d6d-52ff571cda55 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:41.373830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-34b67cd0-12c2-4330-8d6d-52ff571cda55 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:41.374392 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-34b67cd0-12c2-4330-8d6d-52ff571cda55 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:41.375203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-34b67cd0-12c2-4330-8d6d-52ff571cda55 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:41.375768 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-34b67cd0-12c2-4330-8d6d-52ff571cda55 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:41.376318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-34b67cd0-12c2-4330-8d6d-52ff571cda55 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:41.379763 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d187ef5-b704-4818-9d4d-ae3995296e2d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:41.380441 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d187ef5-b704-4818-9d4d-ae3995296e2d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:41.381762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d187ef5-b704-4818-9d4d-ae3995296e2d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:41.382956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d187ef5-b704-4818-9d4d-ae3995296e2d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:41.385446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d187ef5-b704-4818-9d4d-ae3995296e2d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:41.386107 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d187ef5-b704-4818-9d4d-ae3995296e2d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:41.403656 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-4d187ef5-b704-4818-9d4d-ae3995296e2d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] HTTP exception thrown: Instance e67fc2ff-0549-433f-9385-cc71740b93c4 could not be found. Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4d187ef5-b704-4818-9d4d-ae3995296e2d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Request method failure captured: Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/e67fc2ff-0549-433f-9385-cc71740b93c4 HTTP/1.1 Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_2DmxIPcyTb1cOGoxQ8GwU8cw1giYiRUIGyNybORXieuBCt1rXk9izpSOtS_kRgjgRO6Z6D9MGEQxdcKX76BD3EWlB_ROjXF4lYZRcH454h9mSvCckuq7_UcfeD6wAIWYtG1gPddBnTivj8s9OfwgeqLXhhbGdWZX3mJjw5_JiDqXM Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: e61b34a0cac845c49d7c334921af14c1 Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ListServerFiltersTestJSON-1976597098 Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e61b34a0cac845c49d7c334921af14c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e61b34a0cac845c49d7c334921af14c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e61b34a0cac845c49d7c334921af14c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e61b34a0cac845c49d7c334921af14c1"}]}] Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ListServerFiltersTestJSON-1976597098 Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: e61b34a0cac845c49d7c334921af14c1 Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1976597098 Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ListServerFiltersTestJSON-1976597098-project Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 556b051e0d244645a851888bb6bcc265 Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ListServerFiltersTestJSON-1976597098-project Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance e67fc2ff-0549-433f-9385-cc71740b93c4 could not be found. Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'e67fc2ff-0549-433f-9385-cc71740b93c4'} Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e67fc2ff-0549-433f-9385-cc71740b93c4 could not be found. Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e67fc2ff-0549-433f-9385-cc71740b93c4 could not be found. Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:11:41.406080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:11:41.411629 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:41.411629 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:11:41.411629 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:11:41.411629 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:11:41.411629 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:11:41.411629 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e67fc2ff-0549-433f-9385-cc71740b93c4 could not be found. Aug 04 17:11:41.411629 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:11:41.413766 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4d187ef5-b704-4818-9d4d-ae3995296e2d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Returning 404 to user: Instance e67fc2ff-0549-433f-9385-cc71740b93c4 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:11:41.415310 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4d187ef5-b704-4818-9d4d-ae3995296e2d tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/e67fc2ff-0549-433f-9385-cc71740b93c4" status: 404 len: 111 microversion: 2.1 time: 0.050360 Aug 04 17:11:41.416280 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2019/4115] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:41 2022] GET /compute/v2.1/servers/e67fc2ff-0549-433f-9385-cc71740b93c4 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:11:41.421700 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d678623b-1725-46fa-b9f3-49ce0ccb2909 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:41.422252 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d678623b-1725-46fa-b9f3-49ce0ccb2909 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:41.430970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d678623b-1725-46fa-b9f3-49ce0ccb2909 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:41.431464 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d678623b-1725-46fa-b9f3-49ce0ccb2909 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:41.431968 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d678623b-1725-46fa-b9f3-49ce0ccb2909 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:41.432865 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d678623b-1725-46fa-b9f3-49ce0ccb2909 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:41.434209 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d678623b-1725-46fa-b9f3-49ce0ccb2909 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:41.434987 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d678623b-1725-46fa-b9f3-49ce0ccb2909 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:41.596654 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d678623b-1725-46fa-b9f3-49ce0ccb2909 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.177803 Aug 04 17:11:41.596654 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2020/4116] 10.222.0.93 () {60 vars in 1316 bytes} [Thu Aug 4 17:11:41 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d/os-interface => generated 285 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:11:41.611695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-580c01ba-ae68-4a7d-8d9d-e0c50ed188e0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:41.612294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-580c01ba-ae68-4a7d-8d9d-e0c50ed188e0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 01c2f9e6-2bf7-4013-b254-0dac8e579962] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:41.625131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-580c01ba-ae68-4a7d-8d9d-e0c50ed188e0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:41.625638 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-580c01ba-ae68-4a7d-8d9d-e0c50ed188e0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:41.626110 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-580c01ba-ae68-4a7d-8d9d-e0c50ed188e0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:41.626823 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-580c01ba-ae68-4a7d-8d9d-e0c50ed188e0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:41.627282 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-580c01ba-ae68-4a7d-8d9d-e0c50ed188e0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:41.633510 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-580c01ba-ae68-4a7d-8d9d-e0c50ed188e0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:41.671073 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-580c01ba-ae68-4a7d-8d9d-e0c50ed188e0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 01c2f9e6-2bf7-4013-b254-0dac8e579962] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:11:41.706318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-34b67cd0-12c2-4330-8d6d-52ff571cda55 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:41.716983 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-34b67cd0-12c2-4330-8d6d-52ff571cda55 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.368639 Aug 04 17:11:41.719934 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2097/4117] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:41 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:41.730354 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a6b3a024-d3fc-435e-9e19-793d07e71f5b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:41.730991 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a6b3a024-d3fc-435e-9e19-793d07e71f5b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:41.743907 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6b3a024-d3fc-435e-9e19-793d07e71f5b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:41.748068 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6b3a024-d3fc-435e-9e19-793d07e71f5b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:41.749432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6b3a024-d3fc-435e-9e19-793d07e71f5b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:41.750393 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6b3a024-d3fc-435e-9e19-793d07e71f5b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:41.750941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6b3a024-d3fc-435e-9e19-793d07e71f5b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:41.753648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6b3a024-d3fc-435e-9e19-793d07e71f5b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:41.889878 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-580c01ba-ae68-4a7d-8d9d-e0c50ed188e0 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "DELETE /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962" status: 204 len: 0 microversion: 2.1 time: 0.292363 Aug 04 17:11:41.895689 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2021/4118] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:11:41 2022] DELETE /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:11:41.903279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8798380c-55b6-4c48-b682-8fcd7692114b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:41.905109 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8798380c-55b6-4c48-b682-8fcd7692114b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:41.921387 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8798380c-55b6-4c48-b682-8fcd7692114b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:41.924699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8798380c-55b6-4c48-b682-8fcd7692114b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:41.925364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8798380c-55b6-4c48-b682-8fcd7692114b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:41.928965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8798380c-55b6-4c48-b682-8fcd7692114b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:41.930401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8798380c-55b6-4c48-b682-8fcd7692114b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:41.931259 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8798380c-55b6-4c48-b682-8fcd7692114b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:42.159973 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a6b3a024-d3fc-435e-9e19-793d07e71f5b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:42.174340 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a6b3a024-d3fc-435e-9e19-793d07e71f5b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1369 microversion: 2.1 time: 0.453272 Aug 04 17:11:42.175301 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2098/4119] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:41 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1369 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:42.180000 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3a7cc782-1b2c-46c4-b3ff-756285b31ced tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:42.184305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3a7cc782-1b2c-46c4-b3ff-756285b31ced tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 01c2f9e6-2bf7-4013-b254-0dac8e579962] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:42.198836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a7cc782-1b2c-46c4-b3ff-756285b31ced tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:42.204153 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a7cc782-1b2c-46c4-b3ff-756285b31ced tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:42.205130 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a7cc782-1b2c-46c4-b3ff-756285b31ced tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:42.206192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a7cc782-1b2c-46c4-b3ff-756285b31ced tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:42.210575 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a7cc782-1b2c-46c4-b3ff-756285b31ced tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:42.211393 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a7cc782-1b2c-46c4-b3ff-756285b31ced tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:42.241853 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8798380c-55b6-4c48-b682-8fcd7692114b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:42.251800 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8798380c-55b6-4c48-b682-8fcd7692114b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.354594 Aug 04 17:11:42.258116 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2022/4120] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:41 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:42.268563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-80dea1fb-b64a-4d79-9503-20fa2a7ece6d req-8437cb92-2248-4b08-b1da-d7d1d45d3277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c74445a-b3fe-4d2a-9dd3-43ab834d369a", "name": "network-vif-plugged", "status": "completed", "tag": "70fcf2fa-c35a-42df-b9ec-1cb4ff3a8d65"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:42.292372 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-80dea1fb-b64a-4d79-9503-20fa2a7ece6d req-8437cb92-2248-4b08-b1da-d7d1d45d3277 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:42.293021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-80dea1fb-b64a-4d79-9503-20fa2a7ece6d req-8437cb92-2248-4b08-b1da-d7d1d45d3277 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:42.295065 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-80dea1fb-b64a-4d79-9503-20fa2a7ece6d req-8437cb92-2248-4b08-b1da-d7d1d45d3277 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:42.314643 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-80dea1fb-b64a-4d79-9503-20fa2a7ece6d req-8437cb92-2248-4b08-b1da-d7d1d45d3277 service nova] Creating event network-vif-plugged:70fcf2fa-c35a-42df-b9ec-1cb4ff3a8d65 for instance 0c74445a-b3fe-4d2a-9dd3-43ab834d369a on n-h1-851359-3 Aug 04 17:11:42.323705 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-80dea1fb-b64a-4d79-9503-20fa2a7ece6d req-8437cb92-2248-4b08-b1da-d7d1d45d3277 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064169 Aug 04 17:11:42.328733 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2023/4121] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:11:42.336138 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1438b4cb-bee2-40a8-b209-3f91c076575f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:42.339066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1438b4cb-bee2-40a8-b209-3f91c076575f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:42.357280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1438b4cb-bee2-40a8-b209-3f91c076575f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:42.358579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1438b4cb-bee2-40a8-b209-3f91c076575f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:42.359076 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1438b4cb-bee2-40a8-b209-3f91c076575f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:42.362309 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1438b4cb-bee2-40a8-b209-3f91c076575f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:42.363833 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1438b4cb-bee2-40a8-b209-3f91c076575f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:42.366605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1438b4cb-bee2-40a8-b209-3f91c076575f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:42.830085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3a7cc782-1b2c-46c4-b3ff-756285b31ced tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:42.839489 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3a7cc782-1b2c-46c4-b3ff-756285b31ced tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962" status: 200 len: 1517 microversion: 2.1 time: 0.663003 Aug 04 17:11:42.842452 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2099/4122] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:42 2022] GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962 => generated 1517 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:42.848834 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-57b91b80-5abd-4661-a61b-d722b2c2681f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:42.849646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-57b91b80-5abd-4661-a61b-d722b2c2681f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:42.856187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57b91b80-5abd-4661-a61b-d722b2c2681f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:42.856895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57b91b80-5abd-4661-a61b-d722b2c2681f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:42.857629 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57b91b80-5abd-4661-a61b-d722b2c2681f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:42.858537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57b91b80-5abd-4661-a61b-d722b2c2681f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:42.859166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57b91b80-5abd-4661-a61b-d722b2c2681f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:42.859762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57b91b80-5abd-4661-a61b-d722b2c2681f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:42.987474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1438b4cb-bee2-40a8-b209-3f91c076575f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:43.002204 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1438b4cb-bee2-40a8-b209-3f91c076575f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.670006 Aug 04 17:11:43.003114 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2024/4123] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:42 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:43.081196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-e322065f-b8b1-4507-81a0-32c163040c89 req-ff09fb08-fcb7-4799-ada3-48282698f663 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c682c4f-3eed-44cd-9782-3ed12f2d8f0d", "tag": "8b60e742-6e36-45ea-a5d7-62315ea560df"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:43.094459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e322065f-b8b1-4507-81a0-32c163040c89 req-ff09fb08-fcb7-4799-ada3-48282698f663 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:43.095044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e322065f-b8b1-4507-81a0-32c163040c89 req-ff09fb08-fcb7-4799-ada3-48282698f663 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:43.095555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e322065f-b8b1-4507-81a0-32c163040c89 req-ff09fb08-fcb7-4799-ada3-48282698f663 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:43.104584 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-57b91b80-5abd-4661-a61b-d722b2c2681f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:43.109606 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-e322065f-b8b1-4507-81a0-32c163040c89 req-ff09fb08-fcb7-4799-ada3-48282698f663 service nova] Creating event network-changed:8b60e742-6e36-45ea-a5d7-62315ea560df for instance 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d on n-h2-851359-3 Aug 04 17:11:43.113590 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-57b91b80-5abd-4661-a61b-d722b2c2681f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1677 microversion: 2.1 time: 0.268854 Aug 04 17:11:43.117034 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2100/4124] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:42 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1677 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:43.128412 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-e322065f-b8b1-4507-81a0-32c163040c89 req-ff09fb08-fcb7-4799-ada3-48282698f663 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039735 Aug 04 17:11:43.130236 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2025/4125] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:11:43.169923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-e03cc7fe-c0b8-4c46-a531-0e3bc4991a24 req-d5d6e71b-5f6b-4294-9406-26a87765da92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "947ffe69-3080-4602-872d-1bb16591d34e", "tag": "fd65889d-9876-40e8-8ee4-deac7525c417"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:43.190991 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e03cc7fe-c0b8-4c46-a531-0e3bc4991a24 req-d5d6e71b-5f6b-4294-9406-26a87765da92 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:43.197753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-008433d8-0b96-4217-84d2-23f89cf6a3c2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:43.198495 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-008433d8-0b96-4217-84d2-23f89cf6a3c2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:43.201859 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e03cc7fe-c0b8-4c46-a531-0e3bc4991a24 req-d5d6e71b-5f6b-4294-9406-26a87765da92 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:43.204276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e03cc7fe-c0b8-4c46-a531-0e3bc4991a24 req-d5d6e71b-5f6b-4294-9406-26a87765da92 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:43.212009 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-008433d8-0b96-4217-84d2-23f89cf6a3c2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:43.212594 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-008433d8-0b96-4217-84d2-23f89cf6a3c2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:43.213043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-008433d8-0b96-4217-84d2-23f89cf6a3c2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:43.213763 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-008433d8-0b96-4217-84d2-23f89cf6a3c2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:43.216425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-008433d8-0b96-4217-84d2-23f89cf6a3c2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:43.216920 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-008433d8-0b96-4217-84d2-23f89cf6a3c2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:43.234808 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-e03cc7fe-c0b8-4c46-a531-0e3bc4991a24 req-d5d6e71b-5f6b-4294-9406-26a87765da92 service nova] Creating event network-changed:fd65889d-9876-40e8-8ee4-deac7525c417 for instance 947ffe69-3080-4602-872d-1bb16591d34e on n-h1-851359-3 Aug 04 17:11:43.246013 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-e03cc7fe-c0b8-4c46-a531-0e3bc4991a24 req-d5d6e71b-5f6b-4294-9406-26a87765da92 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079733 Aug 04 17:11:43.246881 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2101/4126] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:11:43.397133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-008433d8-0b96-4217-84d2-23f89cf6a3c2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:43.407208 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-008433d8-0b96-4217-84d2-23f89cf6a3c2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1369 microversion: 2.1 time: 0.213424 Aug 04 17:11:43.413269 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2026/4127] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:43 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1369 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:11:43.865968 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5c5b2f31-0ef5-4f12-9708-8c2817043597 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:43.867286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5c5b2f31-0ef5-4f12-9708-8c2817043597 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 01c2f9e6-2bf7-4013-b254-0dac8e579962] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:43.875686 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c5b2f31-0ef5-4f12-9708-8c2817043597 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:43.876479 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c5b2f31-0ef5-4f12-9708-8c2817043597 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:43.877113 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c5b2f31-0ef5-4f12-9708-8c2817043597 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:43.878090 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c5b2f31-0ef5-4f12-9708-8c2817043597 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:43.879318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c5b2f31-0ef5-4f12-9708-8c2817043597 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:43.879945 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c5b2f31-0ef5-4f12-9708-8c2817043597 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:44.088287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5c5b2f31-0ef5-4f12-9708-8c2817043597 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:44.096653 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5c5b2f31-0ef5-4f12-9708-8c2817043597 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962" status: 200 len: 1517 microversion: 2.1 time: 0.235440 Aug 04 17:11:44.110480 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2102/4128] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:43 2022] GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962 => generated 1517 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:44.138199 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-98865ab7-2c55-417e-adf8-426b6790b227 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:44.139750 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-98865ab7-2c55-417e-adf8-426b6790b227 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:44.153868 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98865ab7-2c55-417e-adf8-426b6790b227 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:44.154399 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98865ab7-2c55-417e-adf8-426b6790b227 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:44.154843 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98865ab7-2c55-417e-adf8-426b6790b227 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:44.155569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98865ab7-2c55-417e-adf8-426b6790b227 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:44.156032 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98865ab7-2c55-417e-adf8-426b6790b227 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:44.156461 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98865ab7-2c55-417e-adf8-426b6790b227 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:44.348925 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-98865ab7-2c55-417e-adf8-426b6790b227 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:44.360638 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-98865ab7-2c55-417e-adf8-426b6790b227 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1677 microversion: 2.1 time: 0.226325 Aug 04 17:11:44.363750 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2027/4129] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:44 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1677 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:44.428484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-da28e081-d788-41ad-a2df-f3d137371659 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:44.429105 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-da28e081-d788-41ad-a2df-f3d137371659 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:44.441900 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-da28e081-d788-41ad-a2df-f3d137371659 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:44.442485 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-da28e081-d788-41ad-a2df-f3d137371659 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:44.442941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-da28e081-d788-41ad-a2df-f3d137371659 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:44.443889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-da28e081-d788-41ad-a2df-f3d137371659 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:44.444364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-da28e081-d788-41ad-a2df-f3d137371659 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:44.444803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-da28e081-d788-41ad-a2df-f3d137371659 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:44.739175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-da28e081-d788-41ad-a2df-f3d137371659 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:44.748622 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-da28e081-d788-41ad-a2df-f3d137371659 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1369 microversion: 2.1 time: 0.324601 Aug 04 17:11:44.752981 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2103/4130] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:44 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1369 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:45.119542 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3b190d4d-4347-4090-858a-2d0d5f154c46 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:45.122240 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3b190d4d-4347-4090-858a-2d0d5f154c46 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 01c2f9e6-2bf7-4013-b254-0dac8e579962] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:45.130783 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b190d4d-4347-4090-858a-2d0d5f154c46 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:45.131277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b190d4d-4347-4090-858a-2d0d5f154c46 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:45.131728 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b190d4d-4347-4090-858a-2d0d5f154c46 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:45.132433 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b190d4d-4347-4090-858a-2d0d5f154c46 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:45.132897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b190d4d-4347-4090-858a-2d0d5f154c46 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:45.133335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b190d4d-4347-4090-858a-2d0d5f154c46 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:45.256839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3b190d4d-4347-4090-858a-2d0d5f154c46 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:45.267313 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3b190d4d-4347-4090-858a-2d0d5f154c46 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962" status: 200 len: 1475 microversion: 2.1 time: 0.152348 Aug 04 17:11:45.268220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-8807bc3e-9da7-4f7a-8d0c-d1e5fb978b4c req-620a3751-3f59-4330-8f95-a1b86dc6491a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01c2f9e6-2bf7-4013-b254-0dac8e579962", "name": "network-vif-deleted", "tag": "67f0534c-f1d3-4c4f-99d8-fed5bd714025"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:45.269052 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2028/4131] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:45 2022] GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962 => generated 1475 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:45.306333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8807bc3e-9da7-4f7a-8d0c-d1e5fb978b4c req-620a3751-3f59-4330-8f95-a1b86dc6491a service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:45.307215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8807bc3e-9da7-4f7a-8d0c-d1e5fb978b4c req-620a3751-3f59-4330-8f95-a1b86dc6491a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:45.308671 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8807bc3e-9da7-4f7a-8d0c-d1e5fb978b4c req-620a3751-3f59-4330-8f95-a1b86dc6491a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:45.322682 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-8807bc3e-9da7-4f7a-8d0c-d1e5fb978b4c req-620a3751-3f59-4330-8f95-a1b86dc6491a service nova] Creating event network-vif-deleted:67f0534c-f1d3-4c4f-99d8-fed5bd714025 for instance 01c2f9e6-2bf7-4013-b254-0dac8e579962 on n-h1-851359-3 Aug 04 17:11:45.330158 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-8807bc3e-9da7-4f7a-8d0c-d1e5fb978b4c req-620a3751-3f59-4330-8f95-a1b86dc6491a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065483 Aug 04 17:11:45.331393 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2104/4132] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:11:45.384053 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-80bf007a-b989-4c3f-b245-c81450ad4a04 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:45.384819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-80bf007a-b989-4c3f-b245-c81450ad4a04 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:45.393368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80bf007a-b989-4c3f-b245-c81450ad4a04 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:45.393959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80bf007a-b989-4c3f-b245-c81450ad4a04 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:45.395044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80bf007a-b989-4c3f-b245-c81450ad4a04 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:45.396073 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80bf007a-b989-4c3f-b245-c81450ad4a04 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:45.396862 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80bf007a-b989-4c3f-b245-c81450ad4a04 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:45.397382 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80bf007a-b989-4c3f-b245-c81450ad4a04 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:45.564447 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-80bf007a-b989-4c3f-b245-c81450ad4a04 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:45.573192 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-80bf007a-b989-4c3f-b245-c81450ad4a04 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1677 microversion: 2.1 time: 0.193572 Aug 04 17:11:45.587271 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2029/4133] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:45 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1677 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:45.773714 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7a620396-91a7-4a49-8b96-a64426e64d54 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:45.774451 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7a620396-91a7-4a49-8b96-a64426e64d54 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:45.781516 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7a620396-91a7-4a49-8b96-a64426e64d54 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:45.782033 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7a620396-91a7-4a49-8b96-a64426e64d54 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:45.782483 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7a620396-91a7-4a49-8b96-a64426e64d54 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:45.783184 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7a620396-91a7-4a49-8b96-a64426e64d54 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:45.783648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7a620396-91a7-4a49-8b96-a64426e64d54 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:45.784082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7a620396-91a7-4a49-8b96-a64426e64d54 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:45.788093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:45.924136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7a620396-91a7-4a49-8b96-a64426e64d54 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:45.931634 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7a620396-91a7-4a49-8b96-a64426e64d54 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1369 microversion: 2.1 time: 0.162723 Aug 04 17:11:45.932200 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2105/4134] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:45 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1369 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:46.292177 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-60375a93-b89f-46ad-826b-da4ea6d8cdd9 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:46.292967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-60375a93-b89f-46ad-826b-da4ea6d8cdd9 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 01c2f9e6-2bf7-4013-b254-0dac8e579962] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:46.299870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60375a93-b89f-46ad-826b-da4ea6d8cdd9 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:46.300396 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60375a93-b89f-46ad-826b-da4ea6d8cdd9 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:46.300841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60375a93-b89f-46ad-826b-da4ea6d8cdd9 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:46.301527 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60375a93-b89f-46ad-826b-da4ea6d8cdd9 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:46.302010 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60375a93-b89f-46ad-826b-da4ea6d8cdd9 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:46.302423 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60375a93-b89f-46ad-826b-da4ea6d8cdd9 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:46.371078 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-60375a93-b89f-46ad-826b-da4ea6d8cdd9 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:46.380789 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-60375a93-b89f-46ad-826b-da4ea6d8cdd9 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962" status: 200 len: 1305 microversion: 2.1 time: 0.092411 Aug 04 17:11:46.381638 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2030/4135] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:46 2022] GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962 => generated 1305 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:11:46.601787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dbbd6a3a-2ad8-4f9d-a44d-d6e0fac2547b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:46.603040 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dbbd6a3a-2ad8-4f9d-a44d-d6e0fac2547b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:46.612959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dbbd6a3a-2ad8-4f9d-a44d-d6e0fac2547b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:46.625488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dbbd6a3a-2ad8-4f9d-a44d-d6e0fac2547b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:46.625886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dbbd6a3a-2ad8-4f9d-a44d-d6e0fac2547b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:46.626676 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dbbd6a3a-2ad8-4f9d-a44d-d6e0fac2547b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:46.627148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dbbd6a3a-2ad8-4f9d-a44d-d6e0fac2547b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:46.627645 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dbbd6a3a-2ad8-4f9d-a44d-d6e0fac2547b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:46.770846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dbbd6a3a-2ad8-4f9d-a44d-d6e0fac2547b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:46.779446 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dbbd6a3a-2ad8-4f9d-a44d-d6e0fac2547b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1677 microversion: 2.1 time: 0.181521 Aug 04 17:11:46.780021 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2106/4136] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:46 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:11:46.953244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d304c4e1-63a6-4bfa-ba7e-9278e9be0cb1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:46.954557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d304c4e1-63a6-4bfa-ba7e-9278e9be0cb1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:46.962832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d304c4e1-63a6-4bfa-ba7e-9278e9be0cb1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:46.963625 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d304c4e1-63a6-4bfa-ba7e-9278e9be0cb1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:46.964265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d304c4e1-63a6-4bfa-ba7e-9278e9be0cb1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:46.965204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d304c4e1-63a6-4bfa-ba7e-9278e9be0cb1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:46.967304 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d304c4e1-63a6-4bfa-ba7e-9278e9be0cb1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:46.968175 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d304c4e1-63a6-4bfa-ba7e-9278e9be0cb1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:47.207275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d304c4e1-63a6-4bfa-ba7e-9278e9be0cb1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:47.215809 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d304c4e1-63a6-4bfa-ba7e-9278e9be0cb1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1562 microversion: 2.1 time: 0.266630 Aug 04 17:11:47.230410 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2031/4137] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:46 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1562 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:47.237613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3d1d150f-6280-4443-8e0a-bee27745807c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:47.238869 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3d1d150f-6280-4443-8e0a-bee27745807c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:47.248974 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d1d150f-6280-4443-8e0a-bee27745807c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:47.249902 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d1d150f-6280-4443-8e0a-bee27745807c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:47.250618 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d1d150f-6280-4443-8e0a-bee27745807c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:47.251511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d1d150f-6280-4443-8e0a-bee27745807c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:47.251991 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d1d150f-6280-4443-8e0a-bee27745807c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:47.252514 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d1d150f-6280-4443-8e0a-bee27745807c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:47.338666 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3d1d150f-6280-4443-8e0a-bee27745807c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105043 Aug 04 17:11:47.339397 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2107/4138] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Aug 4 17:11:47 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:11:47.401197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-93a0ab6e-f44b-46bb-885d-9bfb7c5182c5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:47.401758 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-93a0ab6e-f44b-46bb-885d-9bfb7c5182c5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 01c2f9e6-2bf7-4013-b254-0dac8e579962] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:47.408286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93a0ab6e-f44b-46bb-885d-9bfb7c5182c5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:47.408994 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93a0ab6e-f44b-46bb-885d-9bfb7c5182c5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:47.409609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93a0ab6e-f44b-46bb-885d-9bfb7c5182c5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:47.411048 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93a0ab6e-f44b-46bb-885d-9bfb7c5182c5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:47.411679 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93a0ab6e-f44b-46bb-885d-9bfb7c5182c5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:47.412279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93a0ab6e-f44b-46bb-885d-9bfb7c5182c5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:47.454134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93a0ab6e-f44b-46bb-885d-9bfb7c5182c5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:47.454893 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93a0ab6e-f44b-46bb-885d-9bfb7c5182c5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:47.455506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93a0ab6e-f44b-46bb-885d-9bfb7c5182c5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:47.456298 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-93a0ab6e-f44b-46bb-885d-9bfb7c5182c5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lazy-loading 'fault' on Instance uuid 01c2f9e6-2bf7-4013-b254-0dac8e579962 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:11:47.510994 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-93a0ab6e-f44b-46bb-885d-9bfb7c5182c5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556b051e0d244645a851888bb6bcc265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61b34a0cac845c49d7c334921af14c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:47.524585 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-93a0ab6e-f44b-46bb-885d-9bfb7c5182c5 tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962" status: 200 len: 1310 microversion: 2.1 time: 0.127150 Aug 04 17:11:47.539716 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2032/4139] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:47 2022] GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962 => generated 1310 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:47.801278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-41b11720-aa5d-4181-b389-672c718081f2 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:47.802089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-41b11720-aa5d-4181-b389-672c718081f2 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:47.815904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-41b11720-aa5d-4181-b389-672c718081f2 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:47.816683 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-41b11720-aa5d-4181-b389-672c718081f2 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:47.817333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-41b11720-aa5d-4181-b389-672c718081f2 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:47.818096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-41b11720-aa5d-4181-b389-672c718081f2 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:47.818574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-41b11720-aa5d-4181-b389-672c718081f2 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:47.819010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-41b11720-aa5d-4181-b389-672c718081f2 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:47.976112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-41b11720-aa5d-4181-b389-672c718081f2 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:47.985613 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-41b11720-aa5d-4181-b389-672c718081f2 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1677 microversion: 2.1 time: 0.188626 Aug 04 17:11:47.990409 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2108/4140] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:47 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1677 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:48.505897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0813f982-1410-4d04-90fd-a58bb5eb5320 req-4f8eb8f6-285f-4954-a7a1-2b08e2403b37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c74445a-b3fe-4d2a-9dd3-43ab834d369a", "tag": "70fcf2fa-c35a-42df-b9ec-1cb4ff3a8d65"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:48.521630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0813f982-1410-4d04-90fd-a58bb5eb5320 req-4f8eb8f6-285f-4954-a7a1-2b08e2403b37 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:48.522709 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0813f982-1410-4d04-90fd-a58bb5eb5320 req-4f8eb8f6-285f-4954-a7a1-2b08e2403b37 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:48.523408 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0813f982-1410-4d04-90fd-a58bb5eb5320 req-4f8eb8f6-285f-4954-a7a1-2b08e2403b37 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:48.536818 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0813f982-1410-4d04-90fd-a58bb5eb5320 req-4f8eb8f6-285f-4954-a7a1-2b08e2403b37 service nova] Creating event network-changed:70fcf2fa-c35a-42df-b9ec-1cb4ff3a8d65 for instance 0c74445a-b3fe-4d2a-9dd3-43ab834d369a on n-h1-851359-3 Aug 04 17:11:48.542763 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0813f982-1410-4d04-90fd-a58bb5eb5320 req-4f8eb8f6-285f-4954-a7a1-2b08e2403b37 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040553 Aug 04 17:11:48.543374 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2033/4141] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:11:48.547313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-54f7214d-16f2-4a6a-9e39-4fc83a97520f tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:48.547947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-54f7214d-16f2-4a6a-9e39-4fc83a97520f tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] [instance: 01c2f9e6-2bf7-4013-b254-0dac8e579962] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:48.554377 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-54f7214d-16f2-4a6a-9e39-4fc83a97520f tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:48.555099 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-54f7214d-16f2-4a6a-9e39-4fc83a97520f tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:48.555792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-54f7214d-16f2-4a6a-9e39-4fc83a97520f tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:48.556681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-54f7214d-16f2-4a6a-9e39-4fc83a97520f tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:48.557318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-54f7214d-16f2-4a6a-9e39-4fc83a97520f tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:48.557911 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-54f7214d-16f2-4a6a-9e39-4fc83a97520f tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:48.572533 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-54f7214d-16f2-4a6a-9e39-4fc83a97520f tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] HTTP exception thrown: Instance 01c2f9e6-2bf7-4013-b254-0dac8e579962 could not be found. Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-54f7214d-16f2-4a6a-9e39-4fc83a97520f tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Request method failure captured: Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962 HTTP/1.1 Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_2DmxIPcyTb1cOGoxQ8GwU8cw1giYiRUIGyNybORXieuBCt1rXk9izpSOtS_kRgjgRO6Z6D9MGEQxdcKX76BD3EWlB_ROjXF4lYZRcH454h9mSvCckuq7_UcfeD6wAIWYtG1gPddBnTivj8s9OfwgeqLXhhbGdWZX3mJjw5_JiDqXM Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: e61b34a0cac845c49d7c334921af14c1 Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ListServerFiltersTestJSON-1976597098 Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e61b34a0cac845c49d7c334921af14c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e61b34a0cac845c49d7c334921af14c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e61b34a0cac845c49d7c334921af14c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e61b34a0cac845c49d7c334921af14c1"}]}] Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ListServerFiltersTestJSON-1976597098 Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: e61b34a0cac845c49d7c334921af14c1 Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1976597098 Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ListServerFiltersTestJSON-1976597098-project Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 556b051e0d244645a851888bb6bcc265 Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ListServerFiltersTestJSON-1976597098-project Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 01c2f9e6-2bf7-4013-b254-0dac8e579962 could not be found. Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '01c2f9e6-2bf7-4013-b254-0dac8e579962'} Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01c2f9e6-2bf7-4013-b254-0dac8e579962 could not be found. Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01c2f9e6-2bf7-4013-b254-0dac8e579962 could not be found. Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:11:48.574365 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:11:48.579575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:11:48.579575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:11:48.579575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:11:48.579575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:11:48.579575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:11:48.579575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01c2f9e6-2bf7-4013-b254-0dac8e579962 could not be found. Aug 04 17:11:48.579575 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:11:48.581289 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-54f7214d-16f2-4a6a-9e39-4fc83a97520f tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] Returning 404 to user: Instance 01c2f9e6-2bf7-4013-b254-0dac8e579962 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:11:48.583571 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-54f7214d-16f2-4a6a-9e39-4fc83a97520f tempest-ListServerFiltersTestJSON-1976597098 tempest-ListServerFiltersTestJSON-1976597098-project] 10.222.0.93 "GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962" status: 404 len: 111 microversion: 2.1 time: 0.040043 Aug 04 17:11:48.584929 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2109/4142] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:48 2022] GET /compute/v2.1/servers/01c2f9e6-2bf7-4013-b254-0dac8e579962 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:11:49.021546 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e7b7a466-099f-4aa0-98a8-e058fa2d1950 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:49.022798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e7b7a466-099f-4aa0-98a8-e058fa2d1950 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:49.058182 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7b7a466-099f-4aa0-98a8-e058fa2d1950 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:49.062255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7b7a466-099f-4aa0-98a8-e058fa2d1950 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:49.063060 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7b7a466-099f-4aa0-98a8-e058fa2d1950 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:49.064305 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7b7a466-099f-4aa0-98a8-e058fa2d1950 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:49.065015 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7b7a466-099f-4aa0-98a8-e058fa2d1950 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:49.065733 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7b7a466-099f-4aa0-98a8-e058fa2d1950 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:49.401655 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e7b7a466-099f-4aa0-98a8-e058fa2d1950 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:49.410345 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e7b7a466-099f-4aa0-98a8-e058fa2d1950 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1677 microversion: 2.1 time: 0.403664 Aug 04 17:11:49.426467 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2034/4143] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:49 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1677 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:50.433371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d4f88d33-7277-4961-9495-8aa3e91bb4b8 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:50.434758 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d4f88d33-7277-4961-9495-8aa3e91bb4b8 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:50.443256 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d4f88d33-7277-4961-9495-8aa3e91bb4b8 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:50.443747 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d4f88d33-7277-4961-9495-8aa3e91bb4b8 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:50.444385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d4f88d33-7277-4961-9495-8aa3e91bb4b8 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:50.445157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d4f88d33-7277-4961-9495-8aa3e91bb4b8 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:50.445921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d4f88d33-7277-4961-9495-8aa3e91bb4b8 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:50.446687 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d4f88d33-7277-4961-9495-8aa3e91bb4b8 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:50.602661 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d4f88d33-7277-4961-9495-8aa3e91bb4b8 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:50.612244 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d4f88d33-7277-4961-9495-8aa3e91bb4b8 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1677 microversion: 2.1 time: 0.183367 Aug 04 17:11:50.626907 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2110/4144] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:50 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1677 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:11:51.635149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b7f22e3f-3308-4df5-978b-5975955dfccf tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:51.635788 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b7f22e3f-3308-4df5-978b-5975955dfccf tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:51.655887 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7f22e3f-3308-4df5-978b-5975955dfccf tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:51.656597 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7f22e3f-3308-4df5-978b-5975955dfccf tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:51.657260 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7f22e3f-3308-4df5-978b-5975955dfccf tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:51.658194 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7f22e3f-3308-4df5-978b-5975955dfccf tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:51.659298 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7f22e3f-3308-4df5-978b-5975955dfccf tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:51.660303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7f22e3f-3308-4df5-978b-5975955dfccf tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:51.666299 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:51.838622 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b7f22e3f-3308-4df5-978b-5975955dfccf tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:51.846866 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b7f22e3f-3308-4df5-978b-5975955dfccf tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1654 microversion: 2.1 time: 0.216512 Aug 04 17:11:51.849150 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2035/4145] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:51 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1654 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:51.871810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2312a155-50d0-4f3f-aa35-d7a8e66cfa96 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:51.878437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2312a155-50d0-4f3f-aa35-d7a8e66cfa96 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:51.879035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2312a155-50d0-4f3f-aa35-d7a8e66cfa96 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:51.880048 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2312a155-50d0-4f3f-aa35-d7a8e66cfa96 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:51.905664 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2312a155-50d0-4f3f-aa35-d7a8e66cfa96 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Going to try to start instance {{(pid=131044) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 17:11:51.967241 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2312a155-50d0-4f3f-aa35-d7a8e66cfa96 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "POST /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3/action" status: 202 len: 0 microversion: 2.1 time: 0.099233 Aug 04 17:11:51.968668 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2036/4146] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:11:51 2022] POST /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:11:51.973251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-df0b60d8-0592-419b-809e-80aae9652001 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-2031633023", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": "none"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:11:51.986102 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4f9ef1f8-9e9f-42d0-ac05-d9cf6043e8a6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:51.986823 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4f9ef1f8-9e9f-42d0-ac05-d9cf6043e8a6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:52.005940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f9ef1f8-9e9f-42d0-ac05-d9cf6043e8a6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:52.006645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f9ef1f8-9e9f-42d0-ac05-d9cf6043e8a6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:52.007096 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f9ef1f8-9e9f-42d0-ac05-d9cf6043e8a6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:52.007878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f9ef1f8-9e9f-42d0-ac05-d9cf6043e8a6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:52.009217 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f9ef1f8-9e9f-42d0-ac05-d9cf6043e8a6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:52.009217 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f9ef1f8-9e9f-42d0-ac05-d9cf6043e8a6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:52.088574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-df0b60d8-0592-419b-809e-80aae9652001 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:11:52.094297 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-df0b60d8-0592-419b-809e-80aae9652001 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:11:52.094827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-df0b60d8-0592-419b-809e-80aae9652001 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:11:52.095248 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-df0b60d8-0592-419b-809e-80aae9652001 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:11:52.095862 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-df0b60d8-0592-419b-809e-80aae9652001 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:11:52.105855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df0b60d8-0592-419b-809e-80aae9652001 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:52.106857 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df0b60d8-0592-419b-809e-80aae9652001 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:52.107312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df0b60d8-0592-419b-809e-80aae9652001 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:52.108038 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df0b60d8-0592-419b-809e-80aae9652001 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:52.108705 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df0b60d8-0592-419b-809e-80aae9652001 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:52.110145 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df0b60d8-0592-419b-809e-80aae9652001 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:52.138481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-df0b60d8-0592-419b-809e-80aae9652001 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Getting quotas for project 3e2e9f2f7f3e4c1db1fa1d35e307099c. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:11:52.144757 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-df0b60d8-0592-419b-809e-80aae9652001 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Getting quotas for user fa72243bdf6a4f5b9974694b521420db and project 3e2e9f2f7f3e4c1db1fa1d35e307099c. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:11:52.158742 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-df0b60d8-0592-419b-809e-80aae9652001 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:11:52.162601 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-df0b60d8-0592-419b-809e-80aae9652001 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] [instance: bf130e4a-1f2d-46a3-926a-1c4e309c886b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:11:52.203079 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4f9ef1f8-9e9f-42d0-ac05-d9cf6043e8a6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:52.214830 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4f9ef1f8-9e9f-42d0-ac05-d9cf6043e8a6 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1663 microversion: 2.1 time: 0.234327 Aug 04 17:11:52.216185 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2037/4147] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:51 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1663 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:52.249280 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-df0b60d8-0592-419b-809e-80aae9652001 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.520880 Aug 04 17:11:52.250966 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2111/4148] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Aug 4 17:11:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 04 17:11:52.262940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c4b16047-5776-4885-bf13-b8499acb9335 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:52.263709 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c4b16047-5776-4885-bf13-b8499acb9335 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] [instance: bf130e4a-1f2d-46a3-926a-1c4e309c886b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:52.345534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c4b16047-5776-4885-bf13-b8499acb9335 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:52.357435 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c4b16047-5776-4885-bf13-b8499acb9335 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:52.358974 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c4b16047-5776-4885-bf13-b8499acb9335 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:52.360401 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c4b16047-5776-4885-bf13-b8499acb9335 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] 10.222.0.93 "GET /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b" status: 200 len: 1281 microversion: 2.47 time: 0.102146 Aug 04 17:11:52.366352 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2038/4149] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:11:52 2022] GET /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b => generated 1281 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:11:53.236720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ae668116-49be-45ad-a16d-6ca1ab3e3102 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:53.237345 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ae668116-49be-45ad-a16d-6ca1ab3e3102 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:53.245171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae668116-49be-45ad-a16d-6ca1ab3e3102 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:53.245680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae668116-49be-45ad-a16d-6ca1ab3e3102 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:53.246176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae668116-49be-45ad-a16d-6ca1ab3e3102 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:53.246898 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae668116-49be-45ad-a16d-6ca1ab3e3102 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:53.247370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae668116-49be-45ad-a16d-6ca1ab3e3102 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:53.247798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae668116-49be-45ad-a16d-6ca1ab3e3102 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:53.388468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ec17d175-b0fa-47f1-8820-951c6f4525a5 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:53.389896 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ec17d175-b0fa-47f1-8820-951c6f4525a5 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] [instance: bf130e4a-1f2d-46a3-926a-1c4e309c886b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:53.400000 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec17d175-b0fa-47f1-8820-951c6f4525a5 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:53.400659 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec17d175-b0fa-47f1-8820-951c6f4525a5 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:53.401320 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec17d175-b0fa-47f1-8820-951c6f4525a5 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:53.403078 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec17d175-b0fa-47f1-8820-951c6f4525a5 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:53.403732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec17d175-b0fa-47f1-8820-951c6f4525a5 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:53.404349 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec17d175-b0fa-47f1-8820-951c6f4525a5 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:53.415381 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ae668116-49be-45ad-a16d-6ca1ab3e3102 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:53.430997 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ae668116-49be-45ad-a16d-6ca1ab3e3102 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1663 microversion: 2.1 time: 0.198138 Aug 04 17:11:53.431736 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2112/4150] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:53 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1663 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:53.494532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ec17d175-b0fa-47f1-8820-951c6f4525a5 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:53.502765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ec17d175-b0fa-47f1-8820-951c6f4525a5 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:53.504327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ec17d175-b0fa-47f1-8820-951c6f4525a5 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:53.505491 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ec17d175-b0fa-47f1-8820-951c6f4525a5 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] 10.222.0.93 "GET /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b" status: 200 len: 1341 microversion: 2.47 time: 0.123924 Aug 04 17:11:53.506065 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2039/4151] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:11:53 2022] GET /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b => generated 1341 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:11:54.452836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b142af48-ee3d-48ab-ae48-3bda84330ae5 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:54.453467 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b142af48-ee3d-48ab-ae48-3bda84330ae5 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:54.461149 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b142af48-ee3d-48ab-ae48-3bda84330ae5 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:54.461653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b142af48-ee3d-48ab-ae48-3bda84330ae5 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:54.462130 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b142af48-ee3d-48ab-ae48-3bda84330ae5 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:54.462846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b142af48-ee3d-48ab-ae48-3bda84330ae5 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:54.463309 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b142af48-ee3d-48ab-ae48-3bda84330ae5 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:54.463740 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b142af48-ee3d-48ab-ae48-3bda84330ae5 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:54.529058 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-55f58cb0-1f66-4211-a6b3-6a39e6562441 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:54.529714 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-55f58cb0-1f66-4211-a6b3-6a39e6562441 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] [instance: bf130e4a-1f2d-46a3-926a-1c4e309c886b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:54.537726 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55f58cb0-1f66-4211-a6b3-6a39e6562441 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:54.538398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55f58cb0-1f66-4211-a6b3-6a39e6562441 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:54.538843 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55f58cb0-1f66-4211-a6b3-6a39e6562441 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:54.539798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55f58cb0-1f66-4211-a6b3-6a39e6562441 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:54.541803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55f58cb0-1f66-4211-a6b3-6a39e6562441 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:54.542279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55f58cb0-1f66-4211-a6b3-6a39e6562441 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:54.626236 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-55f58cb0-1f66-4211-a6b3-6a39e6562441 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:54.630430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b142af48-ee3d-48ab-ae48-3bda84330ae5 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:54.636847 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-55f58cb0-1f66-4211-a6b3-6a39e6562441 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:54.638669 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-55f58cb0-1f66-4211-a6b3-6a39e6562441 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:54.639465 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b142af48-ee3d-48ab-ae48-3bda84330ae5 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1667 microversion: 2.1 time: 0.190636 Aug 04 17:11:54.640199 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-55f58cb0-1f66-4211-a6b3-6a39e6562441 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] 10.222.0.93 "GET /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b" status: 200 len: 1339 microversion: 2.47 time: 0.115319 Aug 04 17:11:54.642013 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2040/4152] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:11:54 2022] GET /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b => generated 1339 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:11:54.650125 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2113/4153] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:11:54 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1667 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:11:55.664748 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0b9fd783-c54e-4643-b28b-8fe587117cad tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:55.665915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0b9fd783-c54e-4643-b28b-8fe587117cad tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] [instance: bf130e4a-1f2d-46a3-926a-1c4e309c886b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:55.669956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:11:55.674777 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b9fd783-c54e-4643-b28b-8fe587117cad tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:55.675690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b9fd783-c54e-4643-b28b-8fe587117cad tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:55.676242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b9fd783-c54e-4643-b28b-8fe587117cad tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:55.677061 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b9fd783-c54e-4643-b28b-8fe587117cad tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:55.677648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b9fd783-c54e-4643-b28b-8fe587117cad tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:55.678220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b9fd783-c54e-4643-b28b-8fe587117cad tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:55.755427 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0b9fd783-c54e-4643-b28b-8fe587117cad tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:55.763738 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0b9fd783-c54e-4643-b28b-8fe587117cad tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:55.765355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0b9fd783-c54e-4643-b28b-8fe587117cad tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:55.766606 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0b9fd783-c54e-4643-b28b-8fe587117cad tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] 10.222.0.93 "GET /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b" status: 200 len: 1339 microversion: 2.47 time: 0.105840 Aug 04 17:11:55.767259 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2041/4154] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:11:55 2022] GET /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b => generated 1339 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:11:56.789849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1a29cd6b-6dd8-4804-82a5-37c71da66287 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:56.790515 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1a29cd6b-6dd8-4804-82a5-37c71da66287 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] [instance: bf130e4a-1f2d-46a3-926a-1c4e309c886b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:56.797381 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a29cd6b-6dd8-4804-82a5-37c71da66287 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:56.797877 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a29cd6b-6dd8-4804-82a5-37c71da66287 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:56.798358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a29cd6b-6dd8-4804-82a5-37c71da66287 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:56.799063 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a29cd6b-6dd8-4804-82a5-37c71da66287 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:56.799531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a29cd6b-6dd8-4804-82a5-37c71da66287 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:56.800483 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a29cd6b-6dd8-4804-82a5-37c71da66287 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:56.866551 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1a29cd6b-6dd8-4804-82a5-37c71da66287 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:56.875184 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1a29cd6b-6dd8-4804-82a5-37c71da66287 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:56.876711 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1a29cd6b-6dd8-4804-82a5-37c71da66287 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:56.877874 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1a29cd6b-6dd8-4804-82a5-37c71da66287 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] 10.222.0.93 "GET /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b" status: 200 len: 1339 microversion: 2.47 time: 0.091970 Aug 04 17:11:56.878494 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2114/4155] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:11:56 2022] GET /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b => generated 1339 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:11:57.901829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4c5f61f6-78a6-4ae1-ac77-79de2c0194c0 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:57.902482 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4c5f61f6-78a6-4ae1-ac77-79de2c0194c0 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] [instance: bf130e4a-1f2d-46a3-926a-1c4e309c886b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:57.911725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c5f61f6-78a6-4ae1-ac77-79de2c0194c0 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:57.912469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c5f61f6-78a6-4ae1-ac77-79de2c0194c0 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:57.913744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c5f61f6-78a6-4ae1-ac77-79de2c0194c0 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:57.913744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c5f61f6-78a6-4ae1-ac77-79de2c0194c0 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:57.914113 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c5f61f6-78a6-4ae1-ac77-79de2c0194c0 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:57.914540 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c5f61f6-78a6-4ae1-ac77-79de2c0194c0 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:57.983547 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4c5f61f6-78a6-4ae1-ac77-79de2c0194c0 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:57.992290 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4c5f61f6-78a6-4ae1-ac77-79de2c0194c0 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:57.993784 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4c5f61f6-78a6-4ae1-ac77-79de2c0194c0 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:57.994944 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4c5f61f6-78a6-4ae1-ac77-79de2c0194c0 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] 10.222.0.93 "GET /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b" status: 200 len: 1339 microversion: 2.47 time: 0.097407 Aug 04 17:11:57.995499 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2042/4156] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:11:57 2022] GET /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b => generated 1339 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:11:59.018245 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6876e1ce-d9b9-4c0c-923b-7fe3a8e87204 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:11:59.018995 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6876e1ce-d9b9-4c0c-923b-7fe3a8e87204 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] [instance: bf130e4a-1f2d-46a3-926a-1c4e309c886b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:11:59.026468 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6876e1ce-d9b9-4c0c-923b-7fe3a8e87204 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:59.026932 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6876e1ce-d9b9-4c0c-923b-7fe3a8e87204 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:59.027647 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6876e1ce-d9b9-4c0c-923b-7fe3a8e87204 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:59.028761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6876e1ce-d9b9-4c0c-923b-7fe3a8e87204 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:11:59.029637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6876e1ce-d9b9-4c0c-923b-7fe3a8e87204 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:11:59.030282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6876e1ce-d9b9-4c0c-923b-7fe3a8e87204 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:11:59.112063 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6876e1ce-d9b9-4c0c-923b-7fe3a8e87204 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:59.120939 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6876e1ce-d9b9-4c0c-923b-7fe3a8e87204 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:59.122528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6876e1ce-d9b9-4c0c-923b-7fe3a8e87204 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:11:59.123659 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6876e1ce-d9b9-4c0c-923b-7fe3a8e87204 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] 10.222.0.93 "GET /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b" status: 200 len: 1339 microversion: 2.47 time: 0.109437 Aug 04 17:11:59.124212 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2115/4157] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:11:59 2022] GET /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b => generated 1339 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:12:00.148207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b0139675-3f15-4f5f-b7dc-a002db3b5c9d tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:00.148921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b0139675-3f15-4f5f-b7dc-a002db3b5c9d tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] [instance: bf130e4a-1f2d-46a3-926a-1c4e309c886b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:00.157781 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0139675-3f15-4f5f-b7dc-a002db3b5c9d tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:00.158398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0139675-3f15-4f5f-b7dc-a002db3b5c9d tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:00.158919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0139675-3f15-4f5f-b7dc-a002db3b5c9d tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:00.159703 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0139675-3f15-4f5f-b7dc-a002db3b5c9d tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:00.160240 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0139675-3f15-4f5f-b7dc-a002db3b5c9d tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:00.160782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0139675-3f15-4f5f-b7dc-a002db3b5c9d tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:00.237953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b0139675-3f15-4f5f-b7dc-a002db3b5c9d tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:00.247292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b0139675-3f15-4f5f-b7dc-a002db3b5c9d tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:00.248948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b0139675-3f15-4f5f-b7dc-a002db3b5c9d tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:00.250411 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b0139675-3f15-4f5f-b7dc-a002db3b5c9d tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] 10.222.0.93 "GET /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b" status: 200 len: 1360 microversion: 2.47 time: 0.107447 Aug 04 17:12:00.261311 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2043/4158] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:12:00 2022] GET /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b => generated 1360 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:12:00.275875 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-91a06eac-a66c-42b9-94e7-010d5c0b938a tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1833558263"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:12:00.279243 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-91a06eac-a66c-42b9-94e7-010d5c0b938a tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] [instance: bf130e4a-1f2d-46a3-926a-1c4e309c886b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:00.287387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91a06eac-a66c-42b9-94e7-010d5c0b938a tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:00.288063 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91a06eac-a66c-42b9-94e7-010d5c0b938a tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:00.288522 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91a06eac-a66c-42b9-94e7-010d5c0b938a tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:00.289240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91a06eac-a66c-42b9-94e7-010d5c0b938a tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:00.289805 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91a06eac-a66c-42b9-94e7-010d5c0b938a tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:00.290443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91a06eac-a66c-42b9-94e7-010d5c0b938a tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:00.502576 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-91a06eac-a66c-42b9-94e7-010d5c0b938a tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] 10.222.0.93 "POST /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b/action" status: 202 len: 52 microversion: 2.47 time: 0.230633 Aug 04 17:12:00.503550 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2116/4159] 10.222.0.93 () {62 vars in 1319 bytes} [Thu Aug 4 17:12:00 2022] POST /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b/action => generated 52 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Aug 04 17:12:00.515286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ee0d9b62-7636-4f1f-99df-c77bba1b04fe tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:00.515846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ee0d9b62-7636-4f1f-99df-c77bba1b04fe tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] [instance: bf130e4a-1f2d-46a3-926a-1c4e309c886b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:00.522967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee0d9b62-7636-4f1f-99df-c77bba1b04fe tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:00.523462 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee0d9b62-7636-4f1f-99df-c77bba1b04fe tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:00.523903 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee0d9b62-7636-4f1f-99df-c77bba1b04fe tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:00.524927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee0d9b62-7636-4f1f-99df-c77bba1b04fe tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:00.525695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee0d9b62-7636-4f1f-99df-c77bba1b04fe tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:00.526024 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee0d9b62-7636-4f1f-99df-c77bba1b04fe tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:00.551712 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ee0d9b62-7636-4f1f-99df-c77bba1b04fe tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] [instance: bf130e4a-1f2d-46a3-926a-1c4e309c886b] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:12:00.637797 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ee0d9b62-7636-4f1f-99df-c77bba1b04fe tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] 10.222.0.93 "DELETE /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b" status: 204 len: 0 microversion: 2.47 time: 0.125916 Aug 04 17:12:00.639047 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2044/4160] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Aug 4 17:12:00 2022] DELETE /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 04 17:12:00.649012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9ae98d66-abbb-4cb1-b6f3-d133285341cb tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:00.650038 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9ae98d66-abbb-4cb1-b6f3-d133285341cb tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] [instance: bf130e4a-1f2d-46a3-926a-1c4e309c886b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:00.662181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9ae98d66-abbb-4cb1-b6f3-d133285341cb tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:00.662938 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9ae98d66-abbb-4cb1-b6f3-d133285341cb tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:00.663390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9ae98d66-abbb-4cb1-b6f3-d133285341cb tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:00.664107 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9ae98d66-abbb-4cb1-b6f3-d133285341cb tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:00.664571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9ae98d66-abbb-4cb1-b6f3-d133285341cb tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:00.665196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9ae98d66-abbb-4cb1-b6f3-d133285341cb tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:00.731468 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9ae98d66-abbb-4cb1-b6f3-d133285341cb tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:00.740219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9ae98d66-abbb-4cb1-b6f3-d133285341cb tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:00.741738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9ae98d66-abbb-4cb1-b6f3-d133285341cb tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:00.743010 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9ae98d66-abbb-4cb1-b6f3-d133285341cb tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] 10.222.0.93 "GET /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b" status: 200 len: 1366 microversion: 2.47 time: 0.099362 Aug 04 17:12:00.743778 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2117/4161] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:12:00 2022] GET /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b => generated 1366 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:12:01.767362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b37af463-2b9e-4cf9-ac3e-ab684f265bff tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:01.768133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b37af463-2b9e-4cf9-ac3e-ab684f265bff tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] [instance: bf130e4a-1f2d-46a3-926a-1c4e309c886b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:01.775399 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b37af463-2b9e-4cf9-ac3e-ab684f265bff tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:01.775953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b37af463-2b9e-4cf9-ac3e-ab684f265bff tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:01.776471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b37af463-2b9e-4cf9-ac3e-ab684f265bff tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:01.777164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b37af463-2b9e-4cf9-ac3e-ab684f265bff tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:01.777615 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b37af463-2b9e-4cf9-ac3e-ab684f265bff tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:01.778058 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b37af463-2b9e-4cf9-ac3e-ab684f265bff tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:01.841918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b37af463-2b9e-4cf9-ac3e-ab684f265bff tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:01.851348 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b37af463-2b9e-4cf9-ac3e-ab684f265bff tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:01.853037 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b37af463-2b9e-4cf9-ac3e-ab684f265bff tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:01.854345 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b37af463-2b9e-4cf9-ac3e-ab684f265bff tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] 10.222.0.93 "GET /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b" status: 200 len: 1366 microversion: 2.47 time: 0.091311 Aug 04 17:12:01.854988 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2045/4162] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:12:01 2022] GET /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b => generated 1366 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:12:02.876593 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8fc8507d-10df-4fdd-9483-1df1980e9add tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:02.877218 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8fc8507d-10df-4fdd-9483-1df1980e9add tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] [instance: bf130e4a-1f2d-46a3-926a-1c4e309c886b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:02.880478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:12:02.881151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:12:02.886822 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fc8507d-10df-4fdd-9483-1df1980e9add tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:02.887324 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fc8507d-10df-4fdd-9483-1df1980e9add tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:02.887762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fc8507d-10df-4fdd-9483-1df1980e9add tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:02.888465 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fc8507d-10df-4fdd-9483-1df1980e9add tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:02.888923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fc8507d-10df-4fdd-9483-1df1980e9add tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:02.889353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fc8507d-10df-4fdd-9483-1df1980e9add tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:02.959218 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8fc8507d-10df-4fdd-9483-1df1980e9add tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:02.967892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8fc8507d-10df-4fdd-9483-1df1980e9add tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:02.969411 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8fc8507d-10df-4fdd-9483-1df1980e9add tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:02.970615 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8fc8507d-10df-4fdd-9483-1df1980e9add tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] 10.222.0.93 "GET /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b" status: 200 len: 1366 microversion: 2.47 time: 0.097891 Aug 04 17:12:02.971166 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2118/4163] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:12:02 2022] GET /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b => generated 1366 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:12:03.993498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dbf8c358-44f7-4589-aa28-d069a2731605 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:03.994147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dbf8c358-44f7-4589-aa28-d069a2731605 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] [instance: bf130e4a-1f2d-46a3-926a-1c4e309c886b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:03.996173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:12:04.002394 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbf8c358-44f7-4589-aa28-d069a2731605 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:04.002875 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbf8c358-44f7-4589-aa28-d069a2731605 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:04.003317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbf8c358-44f7-4589-aa28-d069a2731605 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:04.004016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbf8c358-44f7-4589-aa28-d069a2731605 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:04.004477 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbf8c358-44f7-4589-aa28-d069a2731605 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:04.004907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbf8c358-44f7-4589-aa28-d069a2731605 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:04.067746 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dbf8c358-44f7-4589-aa28-d069a2731605 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:04.075595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dbf8c358-44f7-4589-aa28-d069a2731605 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:04.077085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dbf8c358-44f7-4589-aa28-d069a2731605 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:04.078262 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dbf8c358-44f7-4589-aa28-d069a2731605 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] 10.222.0.93 "GET /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b" status: 200 len: 1366 microversion: 2.47 time: 0.088762 Aug 04 17:12:04.078814 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2046/4164] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:12:03 2022] GET /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b => generated 1366 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:12:05.101855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-61905196-714c-427f-a864-4d44faa3d39f tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:05.102514 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-61905196-714c-427f-a864-4d44faa3d39f tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] [instance: bf130e4a-1f2d-46a3-926a-1c4e309c886b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:05.109390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61905196-714c-427f-a864-4d44faa3d39f tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:05.109877 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61905196-714c-427f-a864-4d44faa3d39f tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:05.110348 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61905196-714c-427f-a864-4d44faa3d39f tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:05.111035 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61905196-714c-427f-a864-4d44faa3d39f tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:05.111496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61905196-714c-427f-a864-4d44faa3d39f tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:05.111957 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61905196-714c-427f-a864-4d44faa3d39f tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:05.180102 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-61905196-714c-427f-a864-4d44faa3d39f tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:05.188200 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-61905196-714c-427f-a864-4d44faa3d39f tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:05.189999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-61905196-714c-427f-a864-4d44faa3d39f tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:05.191199 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-61905196-714c-427f-a864-4d44faa3d39f tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] 10.222.0.93 "GET /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b" status: 200 len: 1366 microversion: 2.47 time: 0.093290 Aug 04 17:12:05.191765 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2119/4165] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:12:05 2022] GET /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b => generated 1366 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:12:06.214409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-18e2cdf6-b55e-4026-926c-5c930d6454ef tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:06.215016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-18e2cdf6-b55e-4026-926c-5c930d6454ef tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] [instance: bf130e4a-1f2d-46a3-926a-1c4e309c886b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:06.221950 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18e2cdf6-b55e-4026-926c-5c930d6454ef tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:06.222460 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18e2cdf6-b55e-4026-926c-5c930d6454ef tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:06.222903 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18e2cdf6-b55e-4026-926c-5c930d6454ef tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:06.223586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18e2cdf6-b55e-4026-926c-5c930d6454ef tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:06.224041 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18e2cdf6-b55e-4026-926c-5c930d6454ef tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:06.224491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18e2cdf6-b55e-4026-926c-5c930d6454ef tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:06.286755 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-18e2cdf6-b55e-4026-926c-5c930d6454ef tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:06.294588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-18e2cdf6-b55e-4026-926c-5c930d6454ef tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:06.296054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-18e2cdf6-b55e-4026-926c-5c930d6454ef tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:06.297200 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-18e2cdf6-b55e-4026-926c-5c930d6454ef tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] 10.222.0.93 "GET /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b" status: 200 len: 1366 microversion: 2.47 time: 0.086772 Aug 04 17:12:06.297758 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2047/4166] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:12:06 2022] GET /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:12:07.320593 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5c59ff04-4d5a-408b-b749-884901811064 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:07.321214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5c59ff04-4d5a-408b-b749-884901811064 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] [instance: bf130e4a-1f2d-46a3-926a-1c4e309c886b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:07.323945 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:12:07.330165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c59ff04-4d5a-408b-b749-884901811064 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:07.330666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c59ff04-4d5a-408b-b749-884901811064 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:07.331625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c59ff04-4d5a-408b-b749-884901811064 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:07.332326 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c59ff04-4d5a-408b-b749-884901811064 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:07.332798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c59ff04-4d5a-408b-b749-884901811064 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:07.333224 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c59ff04-4d5a-408b-b749-884901811064 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:07.367216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c59ff04-4d5a-408b-b749-884901811064 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:07.367710 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c59ff04-4d5a-408b-b749-884901811064 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:07.368157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c59ff04-4d5a-408b-b749-884901811064 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:07.368612 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-5c59ff04-4d5a-408b-b749-884901811064 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lazy-loading 'fault' on Instance uuid bf130e4a-1f2d-46a3-926a-1c4e309c886b {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:12:07.417603 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5c59ff04-4d5a-408b-b749-884901811064 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:07.426069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5c59ff04-4d5a-408b-b749-884901811064 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:07.427572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5c59ff04-4d5a-408b-b749-884901811064 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa72243bdf6a4f5b9974694b521420db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e2e9f2f7f3e4c1db1fa1d35e307099c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:07.428814 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5c59ff04-4d5a-408b-b749-884901811064 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] 10.222.0.93 "GET /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b" status: 200 len: 1371 microversion: 2.47 time: 0.112180 Aug 04 17:12:07.429632 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2120/4167] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:12:07 2022] GET /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b => generated 1371 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:12:08.454588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a50662d2-d5ff-40b4-b5c6-199032c91891 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:08.455200 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a50662d2-d5ff-40b4-b5c6-199032c91891 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] [instance: bf130e4a-1f2d-46a3-926a-1c4e309c886b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:08.462013 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a50662d2-d5ff-40b4-b5c6-199032c91891 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:08.462501 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a50662d2-d5ff-40b4-b5c6-199032c91891 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:08.462940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a50662d2-d5ff-40b4-b5c6-199032c91891 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:08.463629 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a50662d2-d5ff-40b4-b5c6-199032c91891 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:08.464086 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a50662d2-d5ff-40b4-b5c6-199032c91891 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:08.464537 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a50662d2-d5ff-40b4-b5c6-199032c91891 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:08.478266 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-a50662d2-d5ff-40b4-b5c6-199032c91891 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] HTTP exception thrown: Instance bf130e4a-1f2d-46a3-926a-1c4e309c886b could not be found. Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a50662d2-d5ff-40b4-b5c6-199032c91891 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Request method failure captured: Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b HTTP/1.1 Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_3Xn417__XdF_zFCwRaBKxybHZwEOc-F5h1eNl7Aus4aNb3xz57_Yrh0I58bTTtkyFyMlkqkI6i66505AgZf5uOu4hUjdHgIZjCFYtTgiLj0A7ZrGDqpUh81s9hjl-zjzz_UPh5t4PNXLy71ZGuiT0m7cxvVZHdH7lzYL5zlwicb-M Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.47 Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 3e2e9f2f7f3e4c1db1fa1d35e307099c Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersAaction247Test-207083327 Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e2e9f2f7f3e4c1db1fa1d35e307099c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3e2e9f2f7f3e4c1db1fa1d35e307099c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3e2e9f2f7f3e4c1db1fa1d35e307099c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3e2e9f2f7f3e4c1db1fa1d35e307099c"}]}] Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersAaction247Test-207083327 Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 3e2e9f2f7f3e4c1db1fa1d35e307099c Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersAaction247Test-207083327 Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersAaction247Test-207083327-project Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: fa72243bdf6a4f5b9974694b521420db Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersAaction247Test-207083327-project Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance bf130e4a-1f2d-46a3-926a-1c4e309c886b could not be found. Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'bf130e4a-1f2d-46a3-926a-1c4e309c886b'} Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf130e4a-1f2d-46a3-926a-1c4e309c886b could not be found. Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf130e4a-1f2d-46a3-926a-1c4e309c886b could not be found. Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:12:08.479820 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:12:08.485875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:12:08.485875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:12:08.485875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:12:08.485875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:12:08.485875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:12:08.485875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf130e4a-1f2d-46a3-926a-1c4e309c886b could not be found. Aug 04 17:12:08.485875 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:12:08.485875 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a50662d2-d5ff-40b4-b5c6-199032c91891 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] Returning 404 to user: Instance bf130e4a-1f2d-46a3-926a-1c4e309c886b could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:12:08.485875 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a50662d2-d5ff-40b4-b5c6-199032c91891 tempest-ServersAaction247Test-207083327 tempest-ServersAaction247Test-207083327-project] 10.222.0.93 "GET /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b" status: 404 len: 111 microversion: 2.47 time: 0.030586 Aug 04 17:12:08.485875 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2048/4168] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:12:08 2022] GET /compute/v2.1/servers/bf130e4a-1f2d-46a3-926a-1c4e309c886b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:12:12.984267 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e3aa6016-386d-4fb3-879e-3f814dab279e tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f756d42-d4af-451c-b445-4a1d2354f6be"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:12:12.986776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e3aa6016-386d-4fb3-879e-3f814dab279e tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:12.994926 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e3aa6016-386d-4fb3-879e-3f814dab279e tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:12.995429 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e3aa6016-386d-4fb3-879e-3f814dab279e tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:12.996071 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e3aa6016-386d-4fb3-879e-3f814dab279e tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:12.996979 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e3aa6016-386d-4fb3-879e-3f814dab279e tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:12.997445 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e3aa6016-386d-4fb3-879e-3f814dab279e tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:12.998110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e3aa6016-386d-4fb3-879e-3f814dab279e tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:13.086180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:12:13.362927 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e3aa6016-386d-4fb3-879e-3f814dab279e tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "POST /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.382427 Aug 04 17:12:13.363970 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2121/4169] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Aug 4 17:12:12 2022] POST /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334/os-volume_attachments => generated 194 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:12:15.655381 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d60f5d64-738f-46b7-b4fe-7b0749c5bcb7 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-2090888306", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "6c611f4a-d7f8-457b-b098-72b4fd7334cf"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:12:15.746744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-d60f5d64-738f-46b7-b4fe-7b0749c5bcb7 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] validate_networks() for [('6c611f4a-d7f8-457b-b098-72b4fd7334cf', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:12:16.185454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d60f5d64-738f-46b7-b4fe-7b0749c5bcb7 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:12:16.185883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d60f5d64-738f-46b7-b4fe-7b0749c5bcb7 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:12:16.186391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d60f5d64-738f-46b7-b4fe-7b0749c5bcb7 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:12:16.186827 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d60f5d64-738f-46b7-b4fe-7b0749c5bcb7 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:12:16.187391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d60f5d64-738f-46b7-b4fe-7b0749c5bcb7 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:12:16.197155 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d60f5d64-738f-46b7-b4fe-7b0749c5bcb7 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:16.197649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d60f5d64-738f-46b7-b4fe-7b0749c5bcb7 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:16.198131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d60f5d64-738f-46b7-b4fe-7b0749c5bcb7 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:16.198871 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d60f5d64-738f-46b7-b4fe-7b0749c5bcb7 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:16.199329 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d60f5d64-738f-46b7-b4fe-7b0749c5bcb7 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:16.199760 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d60f5d64-738f-46b7-b4fe-7b0749c5bcb7 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:16.218131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-d60f5d64-738f-46b7-b4fe-7b0749c5bcb7 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Getting quotas for project 2c75e48f8537466cb522d528fe0cf33f. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:12:16.224232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-d60f5d64-738f-46b7-b4fe-7b0749c5bcb7 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Getting quotas for user 59b3f6c5a543499ab555fb8a413cea3f and project 2c75e48f8537466cb522d528fe0cf33f. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:12:16.239153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d60f5d64-738f-46b7-b4fe-7b0749c5bcb7 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:12:16.241476 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d60f5d64-738f-46b7-b4fe-7b0749c5bcb7 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] [instance: 7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:12:16.305057 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d60f5d64-738f-46b7-b4fe-7b0749c5bcb7 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.832843 Aug 04 17:12:16.318184 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2049/4170] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:12:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:12:16.319689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-98b0bc5d-807a-4d98-9d6d-d40304df614e tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:16.320418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-98b0bc5d-807a-4d98-9d6d-d40304df614e tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] [instance: 7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:16.389628 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-98b0bc5d-807a-4d98-9d6d-d40304df614e tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b3f6c5a543499ab555fb8a413cea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c75e48f8537466cb522d528fe0cf33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:16.398086 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-98b0bc5d-807a-4d98-9d6d-d40304df614e tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] 10.222.0.93 "GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec" status: 200 len: 1217 microversion: 2.1 time: 0.084829 Aug 04 17:12:16.399291 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2122/4171] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:16 2022] GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:12:17.421496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dbbdf4be-0e6c-4a7d-9d8e-5f52574fd38e tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:17.422155 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dbbdf4be-0e6c-4a7d-9d8e-5f52574fd38e tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] [instance: 7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:17.429505 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbbdf4be-0e6c-4a7d-9d8e-5f52574fd38e tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:17.430195 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbbdf4be-0e6c-4a7d-9d8e-5f52574fd38e tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:17.430507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbbdf4be-0e6c-4a7d-9d8e-5f52574fd38e tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:17.431207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbbdf4be-0e6c-4a7d-9d8e-5f52574fd38e tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:17.431663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbbdf4be-0e6c-4a7d-9d8e-5f52574fd38e tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:17.432154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbbdf4be-0e6c-4a7d-9d8e-5f52574fd38e tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:17.503717 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dbbdf4be-0e6c-4a7d-9d8e-5f52574fd38e tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b3f6c5a543499ab555fb8a413cea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c75e48f8537466cb522d528fe0cf33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:17.511728 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dbbdf4be-0e6c-4a7d-9d8e-5f52574fd38e tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] 10.222.0.93 "GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec" status: 200 len: 1269 microversion: 2.1 time: 0.095598 Aug 04 17:12:17.526294 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2050/4172] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:17 2022] GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec => generated 1269 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:18.532854 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c8fb1a01-a3f6-4582-b61f-a2291de018f0 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:18.533497 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c8fb1a01-a3f6-4582-b61f-a2291de018f0 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] [instance: 7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:18.562275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8fb1a01-a3f6-4582-b61f-a2291de018f0 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:18.562985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8fb1a01-a3f6-4582-b61f-a2291de018f0 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:18.563441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8fb1a01-a3f6-4582-b61f-a2291de018f0 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:18.564463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8fb1a01-a3f6-4582-b61f-a2291de018f0 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:18.565725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8fb1a01-a3f6-4582-b61f-a2291de018f0 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:18.566383 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8fb1a01-a3f6-4582-b61f-a2291de018f0 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:18.852150 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c8fb1a01-a3f6-4582-b61f-a2291de018f0 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b3f6c5a543499ab555fb8a413cea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c75e48f8537466cb522d528fe0cf33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:18.876820 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c8fb1a01-a3f6-4582-b61f-a2291de018f0 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] 10.222.0.93 "GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec" status: 200 len: 1317 microversion: 2.1 time: 0.340643 Aug 04 17:12:18.883119 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2123/4173] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:18 2022] GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec => generated 1317 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:19.365957 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-d69ad471-0294-49db-920f-396788c0fbc5 req-8df50f4a-2216-4ef3-93ee-d25a0082386c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec", "tag": "ef1a149e-c62d-4b42-bce4-43ec46c0f7d5"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:12:19.395296 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d69ad471-0294-49db-920f-396788c0fbc5 req-8df50f4a-2216-4ef3-93ee-d25a0082386c service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:19.396203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d69ad471-0294-49db-920f-396788c0fbc5 req-8df50f4a-2216-4ef3-93ee-d25a0082386c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:19.397023 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d69ad471-0294-49db-920f-396788c0fbc5 req-8df50f4a-2216-4ef3-93ee-d25a0082386c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:19.421911 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-d69ad471-0294-49db-920f-396788c0fbc5 req-8df50f4a-2216-4ef3-93ee-d25a0082386c service nova] Creating event network-changed:ef1a149e-c62d-4b42-bce4-43ec46c0f7d5 for instance 7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec on n-h2-851359-3 Aug 04 17:12:19.432962 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-d69ad471-0294-49db-920f-396788c0fbc5 req-8df50f4a-2216-4ef3-93ee-d25a0082386c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071908 Aug 04 17:12:19.443343 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2051/4174] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:12:19.909764 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b174f12b-f8aa-4942-a3e3-ece183b306d6 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:19.911382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b174f12b-f8aa-4942-a3e3-ece183b306d6 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] [instance: 7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:19.924916 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b174f12b-f8aa-4942-a3e3-ece183b306d6 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:19.929413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b174f12b-f8aa-4942-a3e3-ece183b306d6 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:19.930029 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b174f12b-f8aa-4942-a3e3-ece183b306d6 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:19.930661 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b174f12b-f8aa-4942-a3e3-ece183b306d6 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:19.931149 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b174f12b-f8aa-4942-a3e3-ece183b306d6 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:19.933694 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b174f12b-f8aa-4942-a3e3-ece183b306d6 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:20.167869 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b174f12b-f8aa-4942-a3e3-ece183b306d6 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b3f6c5a543499ab555fb8a413cea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c75e48f8537466cb522d528fe0cf33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:20.176892 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b174f12b-f8aa-4942-a3e3-ece183b306d6 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] 10.222.0.93 "GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec" status: 200 len: 1317 microversion: 2.1 time: 0.275225 Aug 04 17:12:20.178022 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2124/4175] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:19 2022] GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:21.199621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-db2fdc21-b740-4bb0-a775-a38f2e42b459 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:21.200335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-db2fdc21-b740-4bb0-a775-a38f2e42b459 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] [instance: 7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:21.206625 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db2fdc21-b740-4bb0-a775-a38f2e42b459 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:21.207111 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db2fdc21-b740-4bb0-a775-a38f2e42b459 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:21.207550 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db2fdc21-b740-4bb0-a775-a38f2e42b459 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:21.208244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db2fdc21-b740-4bb0-a775-a38f2e42b459 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:21.208710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db2fdc21-b740-4bb0-a775-a38f2e42b459 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:21.209139 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db2fdc21-b740-4bb0-a775-a38f2e42b459 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:21.213253 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:12:21.351438 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-db2fdc21-b740-4bb0-a775-a38f2e42b459 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b3f6c5a543499ab555fb8a413cea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c75e48f8537466cb522d528fe0cf33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:21.358930 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-db2fdc21-b740-4bb0-a775-a38f2e42b459 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] 10.222.0.93 "GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec" status: 200 len: 1317 microversion: 2.1 time: 0.164467 Aug 04 17:12:21.359506 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2052/4176] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:21 2022] GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:22.380137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fbb78942-0c60-4a8d-9ce9-b852f2444288 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:22.380768 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fbb78942-0c60-4a8d-9ce9-b852f2444288 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] [instance: 7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:22.387348 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fbb78942-0c60-4a8d-9ce9-b852f2444288 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:22.387845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fbb78942-0c60-4a8d-9ce9-b852f2444288 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:22.388297 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fbb78942-0c60-4a8d-9ce9-b852f2444288 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:22.389047 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fbb78942-0c60-4a8d-9ce9-b852f2444288 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:22.389520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fbb78942-0c60-4a8d-9ce9-b852f2444288 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:22.389959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fbb78942-0c60-4a8d-9ce9-b852f2444288 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:22.521441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fbb78942-0c60-4a8d-9ce9-b852f2444288 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b3f6c5a543499ab555fb8a413cea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c75e48f8537466cb522d528fe0cf33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:22.529110 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fbb78942-0c60-4a8d-9ce9-b852f2444288 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] 10.222.0.93 "GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec" status: 200 len: 1317 microversion: 2.1 time: 0.153246 Aug 04 17:12:22.529681 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2125/4177] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:22 2022] GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:22.915579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-72836bf0-2cb6-49ed-a8b7-aef10356d6ba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:12:22.917795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-72836bf0-2cb6-49ed-a8b7-aef10356d6ba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:22.925939 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72836bf0-2cb6-49ed-a8b7-aef10356d6ba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:22.926460 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72836bf0-2cb6-49ed-a8b7-aef10356d6ba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:22.926895 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72836bf0-2cb6-49ed-a8b7-aef10356d6ba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:22.927591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72836bf0-2cb6-49ed-a8b7-aef10356d6ba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:22.928082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72836bf0-2cb6-49ed-a8b7-aef10356d6ba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:22.928629 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72836bf0-2cb6-49ed-a8b7-aef10356d6ba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:23.001378 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-72836bf0-2cb6-49ed-a8b7-aef10356d6ba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action" status: 202 len: 0 microversion: 2.1 time: 0.089604 Aug 04 17:12:23.002389 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2053/4178] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:12:22 2022] POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:12:23.011310 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0c22afb8-5645-4267-b9f8-b4e57d482d29 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:23.012226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0c22afb8-5645-4267-b9f8-b4e57d482d29 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:23.019428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c22afb8-5645-4267-b9f8-b4e57d482d29 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:23.020014 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c22afb8-5645-4267-b9f8-b4e57d482d29 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:23.020581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c22afb8-5645-4267-b9f8-b4e57d482d29 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:23.021357 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c22afb8-5645-4267-b9f8-b4e57d482d29 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:23.021894 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c22afb8-5645-4267-b9f8-b4e57d482d29 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:23.022434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c22afb8-5645-4267-b9f8-b4e57d482d29 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:23.256255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0c22afb8-5645-4267-b9f8-b4e57d482d29 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:23.256255 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0c22afb8-5645-4267-b9f8-b4e57d482d29 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1672 microversion: 2.1 time: 0.182833 Aug 04 17:12:23.256255 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2126/4179] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:23 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1672 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:12:23.551894 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5008e120-3f44-4ff3-8492-e3425b46a307 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:23.552599 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5008e120-3f44-4ff3-8492-e3425b46a307 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] [instance: 7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:23.559453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5008e120-3f44-4ff3-8492-e3425b46a307 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:23.560076 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5008e120-3f44-4ff3-8492-e3425b46a307 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:23.561009 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5008e120-3f44-4ff3-8492-e3425b46a307 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:23.561817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5008e120-3f44-4ff3-8492-e3425b46a307 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:23.562474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5008e120-3f44-4ff3-8492-e3425b46a307 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:23.563107 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5008e120-3f44-4ff3-8492-e3425b46a307 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:23.708285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5008e120-3f44-4ff3-8492-e3425b46a307 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b3f6c5a543499ab555fb8a413cea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c75e48f8537466cb522d528fe0cf33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:23.717469 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5008e120-3f44-4ff3-8492-e3425b46a307 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] 10.222.0.93 "GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec" status: 200 len: 1317 microversion: 2.1 time: 0.170616 Aug 04 17:12:23.718213 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2054/4180] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:23 2022] GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:24.214069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bc66bf3e-a580-4c83-8604-c3aa1be01097 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:24.214701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bc66bf3e-a580-4c83-8604-c3aa1be01097 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:24.221738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc66bf3e-a580-4c83-8604-c3aa1be01097 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:24.222272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc66bf3e-a580-4c83-8604-c3aa1be01097 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:24.222717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc66bf3e-a580-4c83-8604-c3aa1be01097 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:24.223423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc66bf3e-a580-4c83-8604-c3aa1be01097 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:24.223953 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc66bf3e-a580-4c83-8604-c3aa1be01097 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:24.224462 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc66bf3e-a580-4c83-8604-c3aa1be01097 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:24.370644 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bc66bf3e-a580-4c83-8604-c3aa1be01097 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:24.378867 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bc66bf3e-a580-4c83-8604-c3aa1be01097 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1677 microversion: 2.1 time: 0.168698 Aug 04 17:12:24.379477 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2127/4181] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:24 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:24.738717 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-158b03a8-4ef0-4bb4-b84e-b6194f5c7c2b tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:24.739335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-158b03a8-4ef0-4bb4-b84e-b6194f5c7c2b tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] [instance: 7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:24.746107 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-158b03a8-4ef0-4bb4-b84e-b6194f5c7c2b tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:24.746592 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-158b03a8-4ef0-4bb4-b84e-b6194f5c7c2b tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:24.747025 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-158b03a8-4ef0-4bb4-b84e-b6194f5c7c2b tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:24.747713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-158b03a8-4ef0-4bb4-b84e-b6194f5c7c2b tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:24.748167 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-158b03a8-4ef0-4bb4-b84e-b6194f5c7c2b tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:24.748589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-158b03a8-4ef0-4bb4-b84e-b6194f5c7c2b tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:24.883371 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-158b03a8-4ef0-4bb4-b84e-b6194f5c7c2b tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b3f6c5a543499ab555fb8a413cea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c75e48f8537466cb522d528fe0cf33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:24.891028 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-158b03a8-4ef0-4bb4-b84e-b6194f5c7c2b tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] 10.222.0.93 "GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec" status: 200 len: 1317 microversion: 2.1 time: 0.156989 Aug 04 17:12:24.891598 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2055/4182] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:24 2022] GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:25.400248 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d86c0821-2735-44d1-aa1d-8c482d75cc16 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:25.400871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d86c0821-2735-44d1-aa1d-8c482d75cc16 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:25.409250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d86c0821-2735-44d1-aa1d-8c482d75cc16 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:25.409930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d86c0821-2735-44d1-aa1d-8c482d75cc16 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:25.410402 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d86c0821-2735-44d1-aa1d-8c482d75cc16 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:25.411114 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d86c0821-2735-44d1-aa1d-8c482d75cc16 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:25.411720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d86c0821-2735-44d1-aa1d-8c482d75cc16 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:25.412865 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d86c0821-2735-44d1-aa1d-8c482d75cc16 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:25.611229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d86c0821-2735-44d1-aa1d-8c482d75cc16 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:25.619287 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d86c0821-2735-44d1-aa1d-8c482d75cc16 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.222940 Aug 04 17:12:25.619861 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2128/4183] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:25 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:25.912714 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3c809d2f-05d8-43ec-8d4e-5715c89350a0 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:25.913470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3c809d2f-05d8-43ec-8d4e-5715c89350a0 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] [instance: 7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:25.917224 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:12:25.922888 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c809d2f-05d8-43ec-8d4e-5715c89350a0 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:25.923343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c809d2f-05d8-43ec-8d4e-5715c89350a0 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:25.923884 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c809d2f-05d8-43ec-8d4e-5715c89350a0 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:25.924633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c809d2f-05d8-43ec-8d4e-5715c89350a0 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:25.925100 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c809d2f-05d8-43ec-8d4e-5715c89350a0 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:25.925530 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c809d2f-05d8-43ec-8d4e-5715c89350a0 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:26.075559 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3c809d2f-05d8-43ec-8d4e-5715c89350a0 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b3f6c5a543499ab555fb8a413cea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c75e48f8537466cb522d528fe0cf33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:26.083925 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3c809d2f-05d8-43ec-8d4e-5715c89350a0 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] 10.222.0.93 "GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec" status: 200 len: 1317 microversion: 2.1 time: 0.175676 Aug 04 17:12:26.084499 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2056/4184] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:25 2022] GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:27.104937 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-94f2618b-8519-4bd1-8e19-c38e270b992d tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:27.105689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-94f2618b-8519-4bd1-8e19-c38e270b992d tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] [instance: 7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:27.107684 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:12:27.116150 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94f2618b-8519-4bd1-8e19-c38e270b992d tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:27.116682 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94f2618b-8519-4bd1-8e19-c38e270b992d tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:27.117123 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94f2618b-8519-4bd1-8e19-c38e270b992d tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:27.118912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94f2618b-8519-4bd1-8e19-c38e270b992d tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:27.118912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94f2618b-8519-4bd1-8e19-c38e270b992d tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:27.119361 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94f2618b-8519-4bd1-8e19-c38e270b992d tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:27.181422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2dba6567-bc7d-4c15-aa38-cc4a97a6903e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:27.182027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2dba6567-bc7d-4c15-aa38-cc4a97a6903e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 947ffe69-3080-4602-872d-1bb16591d34e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:27.183811 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:12:27.184687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:12:27.191661 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2dba6567-bc7d-4c15-aa38-cc4a97a6903e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:27.192150 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2dba6567-bc7d-4c15-aa38-cc4a97a6903e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:27.192609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2dba6567-bc7d-4c15-aa38-cc4a97a6903e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:27.193342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2dba6567-bc7d-4c15-aa38-cc4a97a6903e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:27.193801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2dba6567-bc7d-4c15-aa38-cc4a97a6903e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:27.199927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2dba6567-bc7d-4c15-aa38-cc4a97a6903e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:27.226182 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2dba6567-bc7d-4c15-aa38-cc4a97a6903e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e/ips" status: 200 len: 150 microversion: 2.1 time: 0.048663 Aug 04 17:12:27.226895 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2057/4185] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Aug 4 17:12:27 2022] GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e/ips => generated 150 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:12:27.311293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-94f2618b-8519-4bd1-8e19-c38e270b992d tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b3f6c5a543499ab555fb8a413cea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c75e48f8537466cb522d528fe0cf33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:27.324552 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-94f2618b-8519-4bd1-8e19-c38e270b992d tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] 10.222.0.93 "GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec" status: 200 len: 1317 microversion: 2.1 time: 0.223655 Aug 04 17:12:27.342737 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2129/4186] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:27 2022] GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:27.444867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b5d76f47-43e9-488c-9757-c113087b90d8 req-37dd3153-068d-4dd3-a78b-11e56acfd1ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec", "name": "network-vif-plugged", "status": "completed", "tag": "ef1a149e-c62d-4b42-bce4-43ec46c0f7d5"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:12:27.460116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b5d76f47-43e9-488c-9757-c113087b90d8 req-37dd3153-068d-4dd3-a78b-11e56acfd1ff service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:27.460604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b5d76f47-43e9-488c-9757-c113087b90d8 req-37dd3153-068d-4dd3-a78b-11e56acfd1ff service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:27.461035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b5d76f47-43e9-488c-9757-c113087b90d8 req-37dd3153-068d-4dd3-a78b-11e56acfd1ff service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:27.491279 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b5d76f47-43e9-488c-9757-c113087b90d8 req-37dd3153-068d-4dd3-a78b-11e56acfd1ff service nova] Creating event network-vif-plugged:ef1a149e-c62d-4b42-bce4-43ec46c0f7d5 for instance 7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec on n-h2-851359-3 Aug 04 17:12:27.507325 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b5d76f47-43e9-488c-9757-c113087b90d8 req-37dd3153-068d-4dd3-a78b-11e56acfd1ff service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066030 Aug 04 17:12:27.508466 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2058/4187] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:12:28.349490 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6cafe4bc-428c-48fd-ac7a-80add3080c93 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:28.350149 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6cafe4bc-428c-48fd-ac7a-80add3080c93 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] [instance: 7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:28.358107 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6cafe4bc-428c-48fd-ac7a-80add3080c93 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:28.358610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6cafe4bc-428c-48fd-ac7a-80add3080c93 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:28.359052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6cafe4bc-428c-48fd-ac7a-80add3080c93 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:28.359768 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6cafe4bc-428c-48fd-ac7a-80add3080c93 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:28.360230 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6cafe4bc-428c-48fd-ac7a-80add3080c93 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:28.360866 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6cafe4bc-428c-48fd-ac7a-80add3080c93 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:28.515214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6cafe4bc-428c-48fd-ac7a-80add3080c93 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b3f6c5a543499ab555fb8a413cea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c75e48f8537466cb522d528fe0cf33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:28.523891 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6cafe4bc-428c-48fd-ac7a-80add3080c93 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] 10.222.0.93 "GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec" status: 200 len: 1317 microversion: 2.1 time: 0.178855 Aug 04 17:12:28.524476 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2130/4188] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:28 2022] GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:28.682645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3716bf23-d023-4cc0-83d8-b8539a9f03dc tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8418314-721f-4e67-81d4-699a10c130ed"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:12:28.684992 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3716bf23-d023-4cc0-83d8-b8539a9f03dc tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 947ffe69-3080-4602-872d-1bb16591d34e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:28.691510 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3716bf23-d023-4cc0-83d8-b8539a9f03dc tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:28.691997 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3716bf23-d023-4cc0-83d8-b8539a9f03dc tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:28.692439 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3716bf23-d023-4cc0-83d8-b8539a9f03dc tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:28.693182 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3716bf23-d023-4cc0-83d8-b8539a9f03dc tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:28.693643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3716bf23-d023-4cc0-83d8-b8539a9f03dc tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:28.694116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3716bf23-d023-4cc0-83d8-b8539a9f03dc tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:28.967304 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3716bf23-d023-4cc0-83d8-b8539a9f03dc tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "POST /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289672 Aug 04 17:12:28.967911 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2059/4189] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Aug 4 17:12:28 2022] POST /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:12:29.545091 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-23e9868e-64e2-4685-8868-242d10fa8529 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:29.546425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-23e9868e-64e2-4685-8868-242d10fa8529 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] [instance: 7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:29.561286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23e9868e-64e2-4685-8868-242d10fa8529 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:29.562199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23e9868e-64e2-4685-8868-242d10fa8529 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:29.564092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23e9868e-64e2-4685-8868-242d10fa8529 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:29.566771 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23e9868e-64e2-4685-8868-242d10fa8529 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:29.569856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23e9868e-64e2-4685-8868-242d10fa8529 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:29.570879 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23e9868e-64e2-4685-8868-242d10fa8529 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:29.755795 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-23e9868e-64e2-4685-8868-242d10fa8529 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b3f6c5a543499ab555fb8a413cea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c75e48f8537466cb522d528fe0cf33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:29.763829 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-23e9868e-64e2-4685-8868-242d10fa8529 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] 10.222.0.93 "GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec" status: 200 len: 1507 microversion: 2.1 time: 0.222821 Aug 04 17:12:29.764968 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2131/4190] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:29 2022] GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec => generated 1507 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:29.790861 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5ce4a9ca-1c24-4d5c-8a2b-f6342af3bf43 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:29.792092 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5ce4a9ca-1c24-4d5c-8a2b-f6342af3bf43 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] [instance: 7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:29.800043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ce4a9ca-1c24-4d5c-8a2b-f6342af3bf43 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:29.800993 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ce4a9ca-1c24-4d5c-8a2b-f6342af3bf43 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:29.801612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ce4a9ca-1c24-4d5c-8a2b-f6342af3bf43 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:29.802692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ce4a9ca-1c24-4d5c-8a2b-f6342af3bf43 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:29.803562 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ce4a9ca-1c24-4d5c-8a2b-f6342af3bf43 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:29.804297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ce4a9ca-1c24-4d5c-8a2b-f6342af3bf43 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:29.838669 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5ce4a9ca-1c24-4d5c-8a2b-f6342af3bf43 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] 10.222.0.93 "GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec/ips" status: 200 len: 110 microversion: 2.1 time: 0.053379 Aug 04 17:12:29.851053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-75d335de-5b78-430c-81e8-0c0c06bdc06c tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:29.854898 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2060/4191] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Aug 4 17:12:29 2022] GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec/ips => generated 110 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:12:29.855252 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-75d335de-5b78-430c-81e8-0c0c06bdc06c tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:29.862851 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75d335de-5b78-430c-81e8-0c0c06bdc06c tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:29.863271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-303a4afd-4bad-4211-8daf-a2960a11fc71 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:29.863392 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75d335de-5b78-430c-81e8-0c0c06bdc06c tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:29.863807 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75d335de-5b78-430c-81e8-0c0c06bdc06c tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:29.864413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-303a4afd-4bad-4211-8daf-a2960a11fc71 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] [instance: 7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:29.864574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75d335de-5b78-430c-81e8-0c0c06bdc06c tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:29.865270 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75d335de-5b78-430c-81e8-0c0c06bdc06c tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:29.865783 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75d335de-5b78-430c-81e8-0c0c06bdc06c tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:29.872890 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-303a4afd-4bad-4211-8daf-a2960a11fc71 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:29.873659 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-303a4afd-4bad-4211-8daf-a2960a11fc71 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:29.874357 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-303a4afd-4bad-4211-8daf-a2960a11fc71 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:29.875645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-303a4afd-4bad-4211-8daf-a2960a11fc71 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:29.876409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-303a4afd-4bad-4211-8daf-a2960a11fc71 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:29.877468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-303a4afd-4bad-4211-8daf-a2960a11fc71 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:29.900581 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-75d335de-5b78-430c-81e8-0c0c06bdc06c tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055479 Aug 04 17:12:29.902228 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2132/4192] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:12:29 2022] GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:12:29.914354 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b191216d-d68c-4152-845b-aa2b62653681 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:29.915272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b191216d-d68c-4152-845b-aa2b62653681 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:29.918365 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-303a4afd-4bad-4211-8daf-a2960a11fc71 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] 10.222.0.93 "GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec/ips" status: 200 len: 110 microversion: 2.1 time: 0.060904 Aug 04 17:12:29.918957 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2061/4193] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Aug 4 17:12:29 2022] GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec/ips => generated 110 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:12:29.931339 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b191216d-d68c-4152-845b-aa2b62653681 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:29.932119 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b191216d-d68c-4152-845b-aa2b62653681 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:29.932769 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b191216d-d68c-4152-845b-aa2b62653681 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:29.933727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b191216d-d68c-4152-845b-aa2b62653681 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:29.934183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1149e617-453d-48cd-958b-9f0ce81f5bc3 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:29.934554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b191216d-d68c-4152-845b-aa2b62653681 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:29.935159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b191216d-d68c-4152-845b-aa2b62653681 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:29.935464 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1149e617-453d-48cd-958b-9f0ce81f5bc3 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] [instance: 7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:29.945314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1149e617-453d-48cd-958b-9f0ce81f5bc3 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:29.946119 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1149e617-453d-48cd-958b-9f0ce81f5bc3 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:29.946815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1149e617-453d-48cd-958b-9f0ce81f5bc3 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:29.947759 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1149e617-453d-48cd-958b-9f0ce81f5bc3 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:29.948466 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1149e617-453d-48cd-958b-9f0ce81f5bc3 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:29.949000 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1149e617-453d-48cd-958b-9f0ce81f5bc3 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:29.975202 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1149e617-453d-48cd-958b-9f0ce81f5bc3 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] 10.222.0.93 "GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec/ips/tempest-ServerAddressesTestJSON-1854474945-network" status: 200 len: 95 microversion: 2.1 time: 0.046218 Aug 04 17:12:29.975808 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2062/4194] 10.222.0.93 () {58 vars in 1401 bytes} [Thu Aug 4 17:12:29 2022] GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec/ips/tempest-ServerAddressesTestJSON-1854474945-network => generated 95 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:12:29.991235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ae264ef8-b585-49f2-bf68-0a557f318369 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:29.991758 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ae264ef8-b585-49f2-bf68-0a557f318369 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] [instance: 7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:30.000504 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae264ef8-b585-49f2-bf68-0a557f318369 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:30.001173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae264ef8-b585-49f2-bf68-0a557f318369 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:30.002564 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae264ef8-b585-49f2-bf68-0a557f318369 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:30.003671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae264ef8-b585-49f2-bf68-0a557f318369 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:30.004394 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae264ef8-b585-49f2-bf68-0a557f318369 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:30.004990 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae264ef8-b585-49f2-bf68-0a557f318369 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:30.040899 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ae264ef8-b585-49f2-bf68-0a557f318369 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] [instance: 7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:12:30.045872 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-b191216d-d68c-4152-845b-aa2b62653681 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lazy-loading 'services' on Instance uuid b1af7e3f-723f-40e1-b968-bc7aeaa95334 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:12:30.157814 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ae264ef8-b585-49f2-bf68-0a557f318369 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] 10.222.0.93 "DELETE /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec" status: 204 len: 0 microversion: 2.1 time: 0.171512 Aug 04 17:12:30.159913 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2063/4195] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:12:29 2022] DELETE /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:12:30.171427 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0418b2c1-4579-41b5-8cae-1e0530b0dcc4 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:30.172267 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0418b2c1-4579-41b5-8cae-1e0530b0dcc4 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] [instance: 7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:30.179879 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0418b2c1-4579-41b5-8cae-1e0530b0dcc4 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:30.180490 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0418b2c1-4579-41b5-8cae-1e0530b0dcc4 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:30.181005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0418b2c1-4579-41b5-8cae-1e0530b0dcc4 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:30.181802 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0418b2c1-4579-41b5-8cae-1e0530b0dcc4 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:30.182491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0418b2c1-4579-41b5-8cae-1e0530b0dcc4 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:30.183222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0418b2c1-4579-41b5-8cae-1e0530b0dcc4 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:30.184763 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b191216d-d68c-4152-845b-aa2b62653681 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334/os-volume_attachments/1f756d42-d4af-451c-b445-4a1d2354f6be" status: 202 len: 0 microversion: 2.1 time: 0.276243 Aug 04 17:12:30.185378 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2133/4196] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Aug 4 17:12:29 2022] DELETE /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334/os-volume_attachments/1f756d42-d4af-451c-b445-4a1d2354f6be => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 17:12:30.353964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0418b2c1-4579-41b5-8cae-1e0530b0dcc4 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b3f6c5a543499ab555fb8a413cea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c75e48f8537466cb522d528fe0cf33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:30.362951 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0418b2c1-4579-41b5-8cae-1e0530b0dcc4 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] 10.222.0.93 "GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec" status: 200 len: 1513 microversion: 2.1 time: 0.197347 Aug 04 17:12:30.364008 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2064/4197] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:30 2022] GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec => generated 1513 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:31.388447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-25b5b98b-8f25-4fda-955e-37a44c4bf01c tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:31.389495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-25b5b98b-8f25-4fda-955e-37a44c4bf01c tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] [instance: 7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:31.396423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25b5b98b-8f25-4fda-955e-37a44c4bf01c tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:31.396913 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25b5b98b-8f25-4fda-955e-37a44c4bf01c tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:31.397509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25b5b98b-8f25-4fda-955e-37a44c4bf01c tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:31.398236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25b5b98b-8f25-4fda-955e-37a44c4bf01c tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:31.398693 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25b5b98b-8f25-4fda-955e-37a44c4bf01c tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:31.402525 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25b5b98b-8f25-4fda-955e-37a44c4bf01c tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:31.586799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-25b5b98b-8f25-4fda-955e-37a44c4bf01c tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b3f6c5a543499ab555fb8a413cea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c75e48f8537466cb522d528fe0cf33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:31.597545 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-25b5b98b-8f25-4fda-955e-37a44c4bf01c tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] 10.222.0.93 "GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec" status: 200 len: 1513 microversion: 2.1 time: 0.214750 Aug 04 17:12:31.598422 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2134/4198] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:31 2022] GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec => generated 1513 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:32.618819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bcf3607f-b9f9-4e9f-973c-8688985a5fff tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:32.620005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bcf3607f-b9f9-4e9f-973c-8688985a5fff tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] [instance: 7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:32.655724 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bcf3607f-b9f9-4e9f-973c-8688985a5fff tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:32.660821 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bcf3607f-b9f9-4e9f-973c-8688985a5fff tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:32.661488 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bcf3607f-b9f9-4e9f-973c-8688985a5fff tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:32.665458 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bcf3607f-b9f9-4e9f-973c-8688985a5fff tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:32.666151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bcf3607f-b9f9-4e9f-973c-8688985a5fff tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:32.666742 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bcf3607f-b9f9-4e9f-973c-8688985a5fff tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:32.714878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-180f8a75-7ae8-4f15-873c-f383d83f15eb req-49ff1307-ec7f-4d03-ae89-5655c1017bdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec", "name": "network-vif-deleted", "tag": "ef1a149e-c62d-4b42-bce4-43ec46c0f7d5"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:12:32.741559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-180f8a75-7ae8-4f15-873c-f383d83f15eb req-49ff1307-ec7f-4d03-ae89-5655c1017bdb service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:32.743878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-180f8a75-7ae8-4f15-873c-f383d83f15eb req-49ff1307-ec7f-4d03-ae89-5655c1017bdb service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:32.744579 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-180f8a75-7ae8-4f15-873c-f383d83f15eb req-49ff1307-ec7f-4d03-ae89-5655c1017bdb service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:32.768100 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-180f8a75-7ae8-4f15-873c-f383d83f15eb req-49ff1307-ec7f-4d03-ae89-5655c1017bdb service nova] Creating event network-vif-deleted:ef1a149e-c62d-4b42-bce4-43ec46c0f7d5 for instance 7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec on n-h2-851359-3 Aug 04 17:12:32.777736 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bcf3607f-b9f9-4e9f-973c-8688985a5fff tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b3f6c5a543499ab555fb8a413cea3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c75e48f8537466cb522d528fe0cf33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:32.781024 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-180f8a75-7ae8-4f15-873c-f383d83f15eb req-49ff1307-ec7f-4d03-ae89-5655c1017bdb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070998 Aug 04 17:12:32.788521 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bcf3607f-b9f9-4e9f-973c-8688985a5fff tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] 10.222.0.93 "GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec" status: 200 len: 1471 microversion: 2.1 time: 0.173342 Aug 04 17:12:32.789278 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2065/4199] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:32 2022] GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec => generated 1471 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:32.795537 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3b1dbd8f-7bfa-4942-85a6-2f32f6e4ecbb tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4e5d209-60b8-4886-9ec6-6d54cdab2464"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:12:32.799539 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3b1dbd8f-7bfa-4942-85a6-2f32f6e4ecbb tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:32.803284 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2135/4200] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:12:32.811503 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b1dbd8f-7bfa-4942-85a6-2f32f6e4ecbb tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:32.812360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b1dbd8f-7bfa-4942-85a6-2f32f6e4ecbb tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:32.813118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b1dbd8f-7bfa-4942-85a6-2f32f6e4ecbb tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:32.814340 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b1dbd8f-7bfa-4942-85a6-2f32f6e4ecbb tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:32.815536 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b1dbd8f-7bfa-4942-85a6-2f32f6e4ecbb tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:32.816122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b1dbd8f-7bfa-4942-85a6-2f32f6e4ecbb tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:33.812221 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7edb4f10-fae1-41cd-aa6e-0c9c6daf5b28 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:33.814239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7edb4f10-fae1-41cd-aa6e-0c9c6daf5b28 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] [instance: 7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:33.825850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7edb4f10-fae1-41cd-aa6e-0c9c6daf5b28 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:33.826514 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7edb4f10-fae1-41cd-aa6e-0c9c6daf5b28 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:33.827035 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7edb4f10-fae1-41cd-aa6e-0c9c6daf5b28 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:33.827881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7edb4f10-fae1-41cd-aa6e-0c9c6daf5b28 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:33.828563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7edb4f10-fae1-41cd-aa6e-0c9c6daf5b28 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:33.829078 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7edb4f10-fae1-41cd-aa6e-0c9c6daf5b28 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:33.844055 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-7edb4f10-fae1-41cd-aa6e-0c9c6daf5b28 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] HTTP exception thrown: Instance 7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec could not be found. Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7edb4f10-fae1-41cd-aa6e-0c9c6daf5b28 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Request method failure captured: Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec HTTP/1.1 Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_3vPMfmuJub4UqH_Q5rvrJDSh4eCmrIRv3au5j_AyDVd1VPJzOaHMENpkZ1fpJf0MDF9YpF97BfY2DKuiMKE1h6eDB9i4p2DFg2kdnc5C6SmShpmV5so8c0Qww4SvB5F2MIUv7l3qM_XZTwl9mawb-VVVqa559caYkRCTRJxrpXYj8 Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 2c75e48f8537466cb522d528fe0cf33f Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerAddressesTestJSON-452307525 Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2c75e48f8537466cb522d528fe0cf33f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2c75e48f8537466cb522d528fe0cf33f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2c75e48f8537466cb522d528fe0cf33f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2c75e48f8537466cb522d528fe0cf33f"}]}] Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerAddressesTestJSON-452307525 Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 2c75e48f8537466cb522d528fe0cf33f Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerAddressesTestJSON-452307525 Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerAddressesTestJSON-452307525-project Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 59b3f6c5a543499ab555fb8a413cea3f Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerAddressesTestJSON-452307525-project Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec could not be found. Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec'} Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec could not be found. Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec could not be found. Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:12:33.846913 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:12:33.850787 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:12:33.850787 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:12:33.850787 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:12:33.850787 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:12:33.850787 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:12:33.850787 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec could not be found. Aug 04 17:12:33.850787 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:12:33.852137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7edb4f10-fae1-41cd-aa6e-0c9c6daf5b28 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] Returning 404 to user: Instance 7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:12:33.853243 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7edb4f10-fae1-41cd-aa6e-0c9c6daf5b28 tempest-ServerAddressesTestJSON-452307525 tempest-ServerAddressesTestJSON-452307525-project] 10.222.0.93 "GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec" status: 404 len: 111 microversion: 2.1 time: 0.045655 Aug 04 17:12:33.858566 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2136/4201] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:33 2022] GET /compute/v2.1/servers/7fdb01cf-1773-4d44-a8c2-58aa9ec8ddec => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:12:36.976510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e9d83d59-fa61-4547-b16b-04014f51995d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:36.978953 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e9d83d59-fa61-4547-b16b-04014f51995d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:36.994733 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9d83d59-fa61-4547-b16b-04014f51995d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:36.996962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9d83d59-fa61-4547-b16b-04014f51995d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:36.998057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9d83d59-fa61-4547-b16b-04014f51995d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:36.999030 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9d83d59-fa61-4547-b16b-04014f51995d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:36.999690 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9d83d59-fa61-4547-b16b-04014f51995d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:37.000337 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9d83d59-fa61-4547-b16b-04014f51995d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:37.052843 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e9d83d59-fa61-4547-b16b-04014f51995d tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080993 Aug 04 17:12:37.059034 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2137/4202] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:12:36 2022] GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:12:37.320520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:12:37.525390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6a2c57fd-4f27-4e91-8b61-4671c88636e4 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:37.528121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6a2c57fd-4f27-4e91-8b61-4671c88636e4 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:37.556306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=40 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:12:37.560034 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a2c57fd-4f27-4e91-8b61-4671c88636e4 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:37.564045 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a2c57fd-4f27-4e91-8b61-4671c88636e4 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:37.564895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a2c57fd-4f27-4e91-8b61-4671c88636e4 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:37.565936 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a2c57fd-4f27-4e91-8b61-4671c88636e4 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:37.566968 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a2c57fd-4f27-4e91-8b61-4671c88636e4 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:37.574164 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a2c57fd-4f27-4e91-8b61-4671c88636e4 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:37.631651 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:12:37.640903 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6a2c57fd-4f27-4e91-8b61-4671c88636e4 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.125208 Aug 04 17:12:37.642252 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2138/4203] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:12:37 2022] GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334/os-volume_attachments => generated 25 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:12:37.720438 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3b1dbd8f-7bfa-4942-85a6-2f32f6e4ecbb tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "POST /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.928488 Aug 04 17:12:37.728533 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2066/4204] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Aug 4 17:12:32 2022] POST /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a/os-volume_attachments => generated 194 bytes in 4932 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:12:37.824787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e662cd3d-9c1a-4569-bfcd-78a573557ae0 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:37.825440 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e662cd3d-9c1a-4569-bfcd-78a573557ae0 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:37.834679 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e662cd3d-9c1a-4569-bfcd-78a573557ae0 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:37.835347 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e662cd3d-9c1a-4569-bfcd-78a573557ae0 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:37.836616 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e662cd3d-9c1a-4569-bfcd-78a573557ae0 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:37.838447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e662cd3d-9c1a-4569-bfcd-78a573557ae0 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:37.839143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e662cd3d-9c1a-4569-bfcd-78a573557ae0 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:37.839782 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e662cd3d-9c1a-4569-bfcd-78a573557ae0 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:37.872138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e662cd3d-9c1a-4569-bfcd-78a573557ae0 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:12:37.980947 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e662cd3d-9c1a-4569-bfcd-78a573557ae0 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334" status: 204 len: 0 microversion: 2.1 time: 0.160129 Aug 04 17:12:37.981522 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2139/4205] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:12:37 2022] DELETE /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:12:37.991543 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-04a66ce6-26eb-4939-982b-c9f0010a4093 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:37.992747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-04a66ce6-26eb-4939-982b-c9f0010a4093 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:38.004901 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04a66ce6-26eb-4939-982b-c9f0010a4093 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:38.005437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04a66ce6-26eb-4939-982b-c9f0010a4093 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:38.005888 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04a66ce6-26eb-4939-982b-c9f0010a4093 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:38.006719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04a66ce6-26eb-4939-982b-c9f0010a4093 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:38.007679 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04a66ce6-26eb-4939-982b-c9f0010a4093 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:38.008127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04a66ce6-26eb-4939-982b-c9f0010a4093 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:38.175298 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-04a66ce6-26eb-4939-982b-c9f0010a4093 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3243fe2bab64fbf8ea77b4f969b16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd0b59b952a4a1d8cbc68b4448dfc0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:38.188180 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-04a66ce6-26eb-4939-982b-c9f0010a4093 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334" status: 200 len: 1678 microversion: 2.1 time: 0.201644 Aug 04 17:12:38.190365 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2067/4206] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:37 2022] GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334 => generated 1678 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:12:39.215807 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dd4d9a7c-083a-4e96-a1dc-bb4b3ebebfd6 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:39.216563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dd4d9a7c-083a-4e96-a1dc-bb4b3ebebfd6 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:39.226653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd4d9a7c-083a-4e96-a1dc-bb4b3ebebfd6 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:39.227761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd4d9a7c-083a-4e96-a1dc-bb4b3ebebfd6 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:39.228652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd4d9a7c-083a-4e96-a1dc-bb4b3ebebfd6 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:39.230540 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd4d9a7c-083a-4e96-a1dc-bb4b3ebebfd6 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:39.231235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd4d9a7c-083a-4e96-a1dc-bb4b3ebebfd6 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:39.232047 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd4d9a7c-083a-4e96-a1dc-bb4b3ebebfd6 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:39.405633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dd4d9a7c-083a-4e96-a1dc-bb4b3ebebfd6 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3243fe2bab64fbf8ea77b4f969b16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd0b59b952a4a1d8cbc68b4448dfc0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:39.416734 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dd4d9a7c-083a-4e96-a1dc-bb4b3ebebfd6 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334" status: 200 len: 1678 microversion: 2.1 time: 0.209850 Aug 04 17:12:39.430856 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2140/4207] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:39 2022] GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334 => generated 1678 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:40.440740 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-302bd40b-8428-48c4-84de-3184d2cb668e tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:40.441892 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-302bd40b-8428-48c4-84de-3184d2cb668e tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:40.456438 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-302bd40b-8428-48c4-84de-3184d2cb668e tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:40.457154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-302bd40b-8428-48c4-84de-3184d2cb668e tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:40.457763 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-302bd40b-8428-48c4-84de-3184d2cb668e tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:40.458809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-302bd40b-8428-48c4-84de-3184d2cb668e tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:40.459411 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-302bd40b-8428-48c4-84de-3184d2cb668e tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:40.461349 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-302bd40b-8428-48c4-84de-3184d2cb668e tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:40.920913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-302bd40b-8428-48c4-84de-3184d2cb668e tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3243fe2bab64fbf8ea77b4f969b16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd0b59b952a4a1d8cbc68b4448dfc0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:40.935607 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-302bd40b-8428-48c4-84de-3184d2cb668e tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334" status: 200 len: 1678 microversion: 2.1 time: 0.499284 Aug 04 17:12:40.936631 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2068/4208] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:40 2022] GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334 => generated 1678 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:41.957315 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-51b386dc-ec24-4d45-9540-94fe82d504cb tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:41.958644 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-51b386dc-ec24-4d45-9540-94fe82d504cb tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:41.965924 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-51b386dc-ec24-4d45-9540-94fe82d504cb tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:41.974950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-51b386dc-ec24-4d45-9540-94fe82d504cb tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:41.976287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-51b386dc-ec24-4d45-9540-94fe82d504cb tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:41.977486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-51b386dc-ec24-4d45-9540-94fe82d504cb tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:41.978189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-51b386dc-ec24-4d45-9540-94fe82d504cb tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:41.978815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-51b386dc-ec24-4d45-9540-94fe82d504cb tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:42.160296 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-725d5778-e94c-4331-9247-abe0746bdd1a req-71654506-eb90-4a3d-a393-dc8c87adcc7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1af7e3f-723f-40e1-b968-bc7aeaa95334", "name": "network-vif-deleted", "tag": "bf74ae8e-ca14-433b-901b-3ed2e54ec681"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:12:42.186019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-725d5778-e94c-4331-9247-abe0746bdd1a req-71654506-eb90-4a3d-a393-dc8c87adcc7f service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:42.188222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-725d5778-e94c-4331-9247-abe0746bdd1a req-71654506-eb90-4a3d-a393-dc8c87adcc7f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:42.190031 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-725d5778-e94c-4331-9247-abe0746bdd1a req-71654506-eb90-4a3d-a393-dc8c87adcc7f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:42.233461 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-725d5778-e94c-4331-9247-abe0746bdd1a req-71654506-eb90-4a3d-a393-dc8c87adcc7f service nova] Creating event network-vif-deleted:bf74ae8e-ca14-433b-901b-3ed2e54ec681 for instance b1af7e3f-723f-40e1-b968-bc7aeaa95334 on n-h2-851359-3 Aug 04 17:12:42.256211 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-725d5778-e94c-4331-9247-abe0746bdd1a req-71654506-eb90-4a3d-a393-dc8c87adcc7f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103543 Aug 04 17:12:42.257177 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2069/4209] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:12:42.404549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-51b386dc-ec24-4d45-9540-94fe82d504cb tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3243fe2bab64fbf8ea77b4f969b16db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd0b59b952a4a1d8cbc68b4448dfc0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:42.413341 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-51b386dc-ec24-4d45-9540-94fe82d504cb tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334" status: 200 len: 1611 microversion: 2.1 time: 0.460298 Aug 04 17:12:42.428482 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2141/4210] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:41 2022] GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334 => generated 1611 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:43.459104 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-272a0898-53f5-48a3-8393-1c11db5578ce tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:43.460217 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-272a0898-53f5-48a3-8393-1c11db5578ce tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:43.472766 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-272a0898-53f5-48a3-8393-1c11db5578ce tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:43.480778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-272a0898-53f5-48a3-8393-1c11db5578ce tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:43.481486 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-272a0898-53f5-48a3-8393-1c11db5578ce tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:43.482436 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-272a0898-53f5-48a3-8393-1c11db5578ce tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:43.483076 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-272a0898-53f5-48a3-8393-1c11db5578ce tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:43.483698 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-272a0898-53f5-48a3-8393-1c11db5578ce tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:43.523107 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-272a0898-53f5-48a3-8393-1c11db5578ce tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] HTTP exception thrown: Instance b1af7e3f-723f-40e1-b968-bc7aeaa95334 could not be found. Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-272a0898-53f5-48a3-8393-1c11db5578ce tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Request method failure captured: Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334 HTTP/1.1 Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_0rBvq_66dfL2o3F5Ee8GaAqPwdmF8Qq3l5eTbHFZV0vkwQok8jFBMdqzZw8nsqE9Goh-uRnvG-Vn00JvDOkufbqDdK8oJCwboSpmay3MlsUGfyA5V2XVheLOBU6CzflTj4ZzWxllqbCtE4XEBNGK_xBYYWRgnKQXOqjYqFp8dWl-k Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 6bd0b59b952a4a1d8cbc68b4448dfc0a Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1873025372 Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6bd0b59b952a4a1d8cbc68b4448dfc0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6bd0b59b952a4a1d8cbc68b4448dfc0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6bd0b59b952a4a1d8cbc68b4448dfc0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6bd0b59b952a4a1d8cbc68b4448dfc0a"}]}] Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1873025372 Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 6bd0b59b952a4a1d8cbc68b4448dfc0a Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1873025372 Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-AttachSCSIVolumeTestJSON-1873025372-project Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: c3243fe2bab64fbf8ea77b4f969b16db Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1873025372-project Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance b1af7e3f-723f-40e1-b968-bc7aeaa95334 could not be found. Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'b1af7e3f-723f-40e1-b968-bc7aeaa95334'} Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1af7e3f-723f-40e1-b968-bc7aeaa95334 could not be found. Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1af7e3f-723f-40e1-b968-bc7aeaa95334 could not be found. Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:12:43.527452 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:12:43.531561 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:12:43.531561 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:12:43.531561 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:12:43.531561 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:12:43.531561 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:12:43.531561 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1af7e3f-723f-40e1-b968-bc7aeaa95334 could not be found. Aug 04 17:12:43.531561 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:12:43.534897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-272a0898-53f5-48a3-8393-1c11db5578ce tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Returning 404 to user: Instance b1af7e3f-723f-40e1-b968-bc7aeaa95334 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:12:43.538943 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-272a0898-53f5-48a3-8393-1c11db5578ce tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334" status: 404 len: 111 microversion: 2.1 time: 0.086569 Aug 04 17:12:43.539603 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2070/4211] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:43 2022] GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:12:43.550226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9fd85c0c-e016-49aa-8d43-d6a94f7635ff tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '.version_select at 0x7f1e6c9494c0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:43.592508 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9fd85c0c-e016-49aa-8d43-d6a94f7635ff tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-200109654" status: 202 len: 0 microversion: 2.1 time: 0.047120 Aug 04 17:12:43.618277 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2142/4212] 10.222.0.93 () {58 vars in 1218 bytes} [Thu Aug 4 17:12:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-200109654 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:12:46.203543 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c9c484b0-b415-4fc0-bcd9-e87f8cd8c939 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Action: 'create', calling method: .version_select at 0x7f1e5b56dc10>, body: {"keypair": {"name": "tempest-keypair-1963770254", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUm7abcHhECNLLNLDza9wo7XtweIdRGF3Zhz3/6ylILjc1yvxlKQGihKfsjDuu7KklHjBNeArK3GU7eVXcwTZESx1xWs1GhBMn9FwVnGud9IyjA5JG5QR9AdCc1aME0ow=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:12:46.250934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-c9c484b0-b415-4fc0-bcd9-e87f8cd8c939 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Getting quotas for project 80bc576163414daba5f5315c4a785533. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:12:46.272302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-c9c484b0-b415-4fc0-bcd9-e87f8cd8c939 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Getting quotas for user 5b10b58bf3df46d18bff092022b08e0f and project 80bc576163414daba5f5315c4a785533. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:12:46.340949 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c9c484b0-b415-4fc0-bcd9-e87f8cd8c939 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.144490 Aug 04 17:12:46.344323 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2071/4213] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:12:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:12:47.965296 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-67a620c5-b91f-44d4-91c3-fecca8e83db2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1659790962", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "ec3b7b59-9fd4-4839-add6-43afeffa896c"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:12:48.067189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-67a620c5-b91f-44d4-91c3-fecca8e83db2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] validate_networks() for [('ec3b7b59-9fd4-4839-add6-43afeffa896c', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:12:48.654675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-67a620c5-b91f-44d4-91c3-fecca8e83db2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:12:48.655103 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-67a620c5-b91f-44d4-91c3-fecca8e83db2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:12:48.655580 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-67a620c5-b91f-44d4-91c3-fecca8e83db2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:12:48.655991 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-67a620c5-b91f-44d4-91c3-fecca8e83db2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:12:48.656409 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-67a620c5-b91f-44d4-91c3-fecca8e83db2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:12:48.683631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-67a620c5-b91f-44d4-91c3-fecca8e83db2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:48.684247 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-67a620c5-b91f-44d4-91c3-fecca8e83db2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:48.684708 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-67a620c5-b91f-44d4-91c3-fecca8e83db2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:48.685543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-67a620c5-b91f-44d4-91c3-fecca8e83db2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:48.687959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-67a620c5-b91f-44d4-91c3-fecca8e83db2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:48.688452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-67a620c5-b91f-44d4-91c3-fecca8e83db2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:48.727346 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-67a620c5-b91f-44d4-91c3-fecca8e83db2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Getting quotas for project d9911aeb77cd4ffb8c4e539998a04f3c. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:12:48.736026 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-67a620c5-b91f-44d4-91c3-fecca8e83db2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Getting quotas for user 8e840d06bb5d44e097e6f0855b04cb06 and project d9911aeb77cd4ffb8c4e539998a04f3c. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:12:48.788614 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-67a620c5-b91f-44d4-91c3-fecca8e83db2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:12:48.791052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-67a620c5-b91f-44d4-91c3-fecca8e83db2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 84f1b438-b552-41c0-9e85-bb9021c44a2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:12:48.826660 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6ef25444-238b-45cf-843b-9f5e7c064a92 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-911875532", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "779f24e1-21b5-406f-8c13-50f72d42c29c"}], "security_groups": [{"name": "tempest-securitygroup--1143355485"}], "key_name": "tempest-keypair-1963770254", "user_data": "}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:12:48.867658 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-67a620c5-b91f-44d4-91c3-fecca8e83db2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.150878 Aug 04 17:12:48.874797 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2143/4214] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:12:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:12:48.895005 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c8356d7c-9877-46a3-b3f4-e7c8c37266cd tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:48.905749 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c8356d7c-9877-46a3-b3f4-e7c8c37266cd tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 84f1b438-b552-41c0-9e85-bb9021c44a2a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:49.087552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c8356d7c-9877-46a3-b3f4-e7c8c37266cd tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:49.097445 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c8356d7c-9877-46a3-b3f4-e7c8c37266cd tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a" status: 200 len: 1193 microversion: 2.1 time: 0.211916 Aug 04 17:12:49.098089 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2144/4215] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:48 2022] GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a => generated 1193 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:49.100141 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-6ef25444-238b-45cf-843b-9f5e7c064a92 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] validate_networks() for [('779f24e1-21b5-406f-8c13-50f72d42c29c', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:12:50.095931 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6ef25444-238b-45cf-843b-9f5e7c064a92 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:12:50.096472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6ef25444-238b-45cf-843b-9f5e7c064a92 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:12:50.096973 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6ef25444-238b-45cf-843b-9f5e7c064a92 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:12:50.098176 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6ef25444-238b-45cf-843b-9f5e7c064a92 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:12:50.098670 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6ef25444-238b-45cf-843b-9f5e7c064a92 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:12:50.116846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ef25444-238b-45cf-843b-9f5e7c064a92 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:50.118265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ef25444-238b-45cf-843b-9f5e7c064a92 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:50.119948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ef25444-238b-45cf-843b-9f5e7c064a92 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:50.120210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b681caa6-6178-414a-8ffa-b24d27b6fb2d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:50.121121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b681caa6-6178-414a-8ffa-b24d27b6fb2d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 84f1b438-b552-41c0-9e85-bb9021c44a2a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:50.122411 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ef25444-238b-45cf-843b-9f5e7c064a92 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:50.123705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ef25444-238b-45cf-843b-9f5e7c064a92 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:50.124316 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ef25444-238b-45cf-843b-9f5e7c064a92 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:50.144996 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b681caa6-6178-414a-8ffa-b24d27b6fb2d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:50.147458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b681caa6-6178-414a-8ffa-b24d27b6fb2d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:50.149218 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b681caa6-6178-414a-8ffa-b24d27b6fb2d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:50.152330 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b681caa6-6178-414a-8ffa-b24d27b6fb2d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:50.154757 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b681caa6-6178-414a-8ffa-b24d27b6fb2d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:50.156630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b681caa6-6178-414a-8ffa-b24d27b6fb2d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:50.175196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-6ef25444-238b-45cf-843b-9f5e7c064a92 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Getting quotas for project 80bc576163414daba5f5315c4a785533. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:12:50.191661 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-6ef25444-238b-45cf-843b-9f5e7c064a92 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Getting quotas for user 5b10b58bf3df46d18bff092022b08e0f and project 80bc576163414daba5f5315c4a785533. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:12:50.228485 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6ef25444-238b-45cf-843b-9f5e7c064a92 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:12:50.232713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6ef25444-238b-45cf-843b-9f5e7c064a92 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: c75ee070-7154-4d00-add1-674bb1c4b2b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:12:50.338409 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6ef25444-238b-45cf-843b-9f5e7c064a92 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.517589 Aug 04 17:12:50.339651 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2072/4216] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:12:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 1520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 17:12:50.352826 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b681caa6-6178-414a-8ffa-b24d27b6fb2d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:50.354479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2b3fdc6c-e4d5-4c8a-b663-bd2f651da0ea tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:50.355200 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2b3fdc6c-e4d5-4c8a-b663-bd2f651da0ea tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: c75ee070-7154-4d00-add1-674bb1c4b2b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:50.366430 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b681caa6-6178-414a-8ffa-b24d27b6fb2d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a" status: 200 len: 1189 microversion: 2.1 time: 0.250911 Aug 04 17:12:50.384895 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2145/4217] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:50 2022] GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a => generated 1189 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:50.493993 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2b3fdc6c-e4d5-4c8a-b663-bd2f651da0ea tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:50.501666 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2b3fdc6c-e4d5-4c8a-b663-bd2f651da0ea tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0" status: 200 len: 1241 microversion: 2.1 time: 0.151875 Aug 04 17:12:50.505370 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2073/4218] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:50 2022] GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0 => generated 1241 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:51.389107 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-65905b52-b467-44ff-bb00-5aed128ec539 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:51.389733 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-65905b52-b467-44ff-bb00-5aed128ec539 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 84f1b438-b552-41c0-9e85-bb9021c44a2a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:51.402928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65905b52-b467-44ff-bb00-5aed128ec539 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:51.403644 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65905b52-b467-44ff-bb00-5aed128ec539 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:51.407136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65905b52-b467-44ff-bb00-5aed128ec539 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:51.408662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65905b52-b467-44ff-bb00-5aed128ec539 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:51.411376 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65905b52-b467-44ff-bb00-5aed128ec539 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:51.412130 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65905b52-b467-44ff-bb00-5aed128ec539 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:51.526539 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4a5e71ea-f6b3-4ac0-8152-d1ecca047b6f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:51.527345 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4a5e71ea-f6b3-4ac0-8152-d1ecca047b6f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: c75ee070-7154-4d00-add1-674bb1c4b2b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:51.536982 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a5e71ea-f6b3-4ac0-8152-d1ecca047b6f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:51.539149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a5e71ea-f6b3-4ac0-8152-d1ecca047b6f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:51.542389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a5e71ea-f6b3-4ac0-8152-d1ecca047b6f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:51.544774 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a5e71ea-f6b3-4ac0-8152-d1ecca047b6f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:51.547590 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a5e71ea-f6b3-4ac0-8152-d1ecca047b6f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:51.549670 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a5e71ea-f6b3-4ac0-8152-d1ecca047b6f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:51.624514 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-65905b52-b467-44ff-bb00-5aed128ec539 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:51.636741 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-65905b52-b467-44ff-bb00-5aed128ec539 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a" status: 200 len: 1251 microversion: 2.1 time: 0.251790 Aug 04 17:12:51.638063 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2146/4219] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:51 2022] GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a => generated 1251 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:51.685710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4a5e71ea-f6b3-4ac0-8152-d1ecca047b6f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:51.699664 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4a5e71ea-f6b3-4ac0-8152-d1ecca047b6f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0" status: 200 len: 1293 microversion: 2.1 time: 0.176773 Aug 04 17:12:51.707514 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2074/4220] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:51 2022] GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0 => generated 1293 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:12:52.000386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b0723ff1-2f74-49c0-ba20-29dded1421f1 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:52.001331 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b0723ff1-2f74-49c0-ba20-29dded1421f1 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:52.010937 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0723ff1-2f74-49c0-ba20-29dded1421f1 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:52.012647 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0723ff1-2f74-49c0-ba20-29dded1421f1 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:52.013319 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0723ff1-2f74-49c0-ba20-29dded1421f1 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:52.014319 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0723ff1-2f74-49c0-ba20-29dded1421f1 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:52.015002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0723ff1-2f74-49c0-ba20-29dded1421f1 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:52.016186 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0723ff1-2f74-49c0-ba20-29dded1421f1 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:52.052143 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-b0723ff1-2f74-49c0-ba20-29dded1421f1 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] HTTP exception thrown: Instance b1af7e3f-723f-40e1-b968-bc7aeaa95334 could not be found. Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b0723ff1-2f74-49c0-ba20-29dded1421f1 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Request method failure captured: Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334 HTTP/1.1 Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_0rBvq_66dfL2o3F5Ee8GaAqPwdmF8Qq3l5eTbHFZV0vkwQok8jFBMdqzZw8nsqE9Goh-uRnvG-Vn00JvDOkufbqDdK8oJCwboSpmay3MlsUGfyA5V2XVheLOBU6CzflTj4ZzWxllqbCtE4XEBNGK_xBYYWRgnKQXOqjYqFp8dWl-k Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 6bd0b59b952a4a1d8cbc68b4448dfc0a Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1873025372 Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6bd0b59b952a4a1d8cbc68b4448dfc0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6bd0b59b952a4a1d8cbc68b4448dfc0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6bd0b59b952a4a1d8cbc68b4448dfc0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6bd0b59b952a4a1d8cbc68b4448dfc0a"}]}] Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1873025372 Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 6bd0b59b952a4a1d8cbc68b4448dfc0a Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1873025372 Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-AttachSCSIVolumeTestJSON-1873025372-project Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: c3243fe2bab64fbf8ea77b4f969b16db Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1873025372-project Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance b1af7e3f-723f-40e1-b968-bc7aeaa95334 could not be found. Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'b1af7e3f-723f-40e1-b968-bc7aeaa95334'} Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1af7e3f-723f-40e1-b968-bc7aeaa95334 could not be found. Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:12:52.056022 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:12:52.059157 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1af7e3f-723f-40e1-b968-bc7aeaa95334 could not be found. Aug 04 17:12:52.059157 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:12:52.059157 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:12:52.059157 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:12:52.059157 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:12:52.059157 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:12:52.059157 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:12:52.059157 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:12:52.059157 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:12:52.059157 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1af7e3f-723f-40e1-b968-bc7aeaa95334 could not be found. Aug 04 17:12:52.059157 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:12:52.062341 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b0723ff1-2f74-49c0-ba20-29dded1421f1 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Returning 404 to user: Instance b1af7e3f-723f-40e1-b968-bc7aeaa95334 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:12:52.066599 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b0723ff1-2f74-49c0-ba20-29dded1421f1 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334" status: 404 len: 111 microversion: 2.1 time: 0.070229 Aug 04 17:12:52.067926 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2147/4221] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:12:51 2022] DELETE /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:12:52.076686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-24eb735b-92f8-4a0a-b06d-dffb3f20c145 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:52.077382 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-24eb735b-92f8-4a0a-b06d-dffb3f20c145 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] [instance: b1af7e3f-723f-40e1-b968-bc7aeaa95334] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:52.089108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24eb735b-92f8-4a0a-b06d-dffb3f20c145 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:52.089656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24eb735b-92f8-4a0a-b06d-dffb3f20c145 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:52.090131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24eb735b-92f8-4a0a-b06d-dffb3f20c145 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:52.090857 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24eb735b-92f8-4a0a-b06d-dffb3f20c145 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:52.091325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24eb735b-92f8-4a0a-b06d-dffb3f20c145 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:52.091760 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24eb735b-92f8-4a0a-b06d-dffb3f20c145 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:52.127291 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-24eb735b-92f8-4a0a-b06d-dffb3f20c145 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] HTTP exception thrown: Instance b1af7e3f-723f-40e1-b968-bc7aeaa95334 could not be found. Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-24eb735b-92f8-4a0a-b06d-dffb3f20c145 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Request method failure captured: Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334 HTTP/1.1 Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_0rBvq_66dfL2o3F5Ee8GaAqPwdmF8Qq3l5eTbHFZV0vkwQok8jFBMdqzZw8nsqE9Goh-uRnvG-Vn00JvDOkufbqDdK8oJCwboSpmay3MlsUGfyA5V2XVheLOBU6CzflTj4ZzWxllqbCtE4XEBNGK_xBYYWRgnKQXOqjYqFp8dWl-k Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 6bd0b59b952a4a1d8cbc68b4448dfc0a Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1873025372 Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6bd0b59b952a4a1d8cbc68b4448dfc0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6bd0b59b952a4a1d8cbc68b4448dfc0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6bd0b59b952a4a1d8cbc68b4448dfc0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6bd0b59b952a4a1d8cbc68b4448dfc0a"}]}] Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1873025372 Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 6bd0b59b952a4a1d8cbc68b4448dfc0a Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1873025372 Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-AttachSCSIVolumeTestJSON-1873025372-project Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: c3243fe2bab64fbf8ea77b4f969b16db Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1873025372-project Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance b1af7e3f-723f-40e1-b968-bc7aeaa95334 could not be found. Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'b1af7e3f-723f-40e1-b968-bc7aeaa95334'} Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1af7e3f-723f-40e1-b968-bc7aeaa95334 could not be found. Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1af7e3f-723f-40e1-b968-bc7aeaa95334 could not be found. Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:12:52.129357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:12:52.133072 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:12:52.133072 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:12:52.133072 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:12:52.133072 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:12:52.133072 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:12:52.133072 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1af7e3f-723f-40e1-b968-bc7aeaa95334 could not be found. Aug 04 17:12:52.133072 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:12:52.133072 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-24eb735b-92f8-4a0a-b06d-dffb3f20c145 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] Returning 404 to user: Instance b1af7e3f-723f-40e1-b968-bc7aeaa95334 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:12:52.133072 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-24eb735b-92f8-4a0a-b06d-dffb3f20c145 tempest-AttachSCSIVolumeTestJSON-1873025372 tempest-AttachSCSIVolumeTestJSON-1873025372-project] 10.222.0.93 "GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334" status: 404 len: 111 microversion: 2.1 time: 0.058490 Aug 04 17:12:52.136240 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2075/4222] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:52 2022] GET /compute/v2.1/servers/b1af7e3f-723f-40e1-b968-bc7aeaa95334 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:12:52.669465 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-716b1052-f769-4ea1-9339-75c856d74c62 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:52.670149 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-716b1052-f769-4ea1-9339-75c856d74c62 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 84f1b438-b552-41c0-9e85-bb9021c44a2a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:52.690304 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-716b1052-f769-4ea1-9339-75c856d74c62 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:52.691840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-716b1052-f769-4ea1-9339-75c856d74c62 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:52.694253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-716b1052-f769-4ea1-9339-75c856d74c62 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:52.695838 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-716b1052-f769-4ea1-9339-75c856d74c62 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:52.697505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-716b1052-f769-4ea1-9339-75c856d74c62 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:52.699054 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-716b1052-f769-4ea1-9339-75c856d74c62 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:52.726569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-952a7082-2750-46dd-880e-345dcd948e26 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:52.727738 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-952a7082-2750-46dd-880e-345dcd948e26 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: c75ee070-7154-4d00-add1-674bb1c4b2b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:52.739033 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-952a7082-2750-46dd-880e-345dcd948e26 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:52.746963 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-952a7082-2750-46dd-880e-345dcd948e26 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:52.749602 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-952a7082-2750-46dd-880e-345dcd948e26 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:52.750511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-952a7082-2750-46dd-880e-345dcd948e26 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:52.758777 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-952a7082-2750-46dd-880e-345dcd948e26 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:52.759517 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-952a7082-2750-46dd-880e-345dcd948e26 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:53.026016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-952a7082-2750-46dd-880e-345dcd948e26 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:53.054118 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-952a7082-2750-46dd-880e-345dcd948e26 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0" status: 200 len: 1299 microversion: 2.1 time: 0.331596 Aug 04 17:12:53.055231 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2076/4223] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:52 2022] GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0 => generated 1299 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:12:53.067727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ecabc038-f902-45a6-9e09-c2b0676b2244 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:12:53.074051 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ecabc038-f902-45a6-9e09-c2b0676b2244 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:53.088197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ecabc038-f902-45a6-9e09-c2b0676b2244 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:53.088710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ecabc038-f902-45a6-9e09-c2b0676b2244 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:53.091485 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ecabc038-f902-45a6-9e09-c2b0676b2244 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:53.092245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ecabc038-f902-45a6-9e09-c2b0676b2244 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:53.092722 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ecabc038-f902-45a6-9e09-c2b0676b2244 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:53.093167 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ecabc038-f902-45a6-9e09-c2b0676b2244 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:53.131594 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-ecabc038-f902-45a6-9e09-c2b0676b2244 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lazy-loading 'flavor' on Instance uuid 0c74445a-b3fe-4d2a-9dd3-43ab834d369a {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:12:53.344009 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-716b1052-f769-4ea1-9339-75c856d74c62 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:53.352507 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-716b1052-f769-4ea1-9339-75c856d74c62 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a" status: 200 len: 1293 microversion: 2.1 time: 0.697909 Aug 04 17:12:53.356985 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2148/4224] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:52 2022] GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a => generated 1293 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:53.361078 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ecabc038-f902-45a6-9e09-c2b0676b2244 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "POST /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a/action" status: 200 len: 32 microversion: 2.1 time: 0.303766 Aug 04 17:12:53.366031 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2077/4225] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:12:53 2022] POST /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a/action => generated 32 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:12:53.397535 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9e24341d-2aac-4c75-a660-91efb84e4e19 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:53.406067 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9e24341d-2aac-4c75-a660-91efb84e4e19 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:53.415276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e24341d-2aac-4c75-a660-91efb84e4e19 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:53.415787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e24341d-2aac-4c75-a660-91efb84e4e19 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:53.416263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e24341d-2aac-4c75-a660-91efb84e4e19 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:53.416957 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e24341d-2aac-4c75-a660-91efb84e4e19 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:53.422270 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e24341d-2aac-4c75-a660-91efb84e4e19 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:53.422782 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e24341d-2aac-4c75-a660-91efb84e4e19 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:54.028102 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9e24341d-2aac-4c75-a660-91efb84e4e19 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:54.042836 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9e24341d-2aac-4c75-a660-91efb84e4e19 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1732 microversion: 2.1 time: 0.659177 Aug 04 17:12:54.053996 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2149/4226] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:53 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1732 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:54.079285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-94e4093c-c251-4032-b182-0f23383c2c9f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:54.080761 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-94e4093c-c251-4032-b182-0f23383c2c9f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: c75ee070-7154-4d00-add1-674bb1c4b2b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:54.087561 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94e4093c-c251-4032-b182-0f23383c2c9f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:54.088367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94e4093c-c251-4032-b182-0f23383c2c9f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:54.089015 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94e4093c-c251-4032-b182-0f23383c2c9f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:54.089934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94e4093c-c251-4032-b182-0f23383c2c9f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:54.090761 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94e4093c-c251-4032-b182-0f23383c2c9f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:54.091399 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94e4093c-c251-4032-b182-0f23383c2c9f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:54.224496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-94e4093c-c251-4032-b182-0f23383c2c9f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:54.232724 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-94e4093c-c251-4032-b182-0f23383c2c9f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0" status: 200 len: 1299 microversion: 2.1 time: 0.158301 Aug 04 17:12:54.246288 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2078/4227] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:54 2022] GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0 => generated 1299 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:54.380850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a54ddae2-86bd-4059-9e6c-b93cd9513038 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:54.381484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a54ddae2-86bd-4059-9e6c-b93cd9513038 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 84f1b438-b552-41c0-9e85-bb9021c44a2a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:54.388560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a54ddae2-86bd-4059-9e6c-b93cd9513038 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:54.389291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a54ddae2-86bd-4059-9e6c-b93cd9513038 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:54.390328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a54ddae2-86bd-4059-9e6c-b93cd9513038 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:54.393307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a54ddae2-86bd-4059-9e6c-b93cd9513038 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:54.393967 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a54ddae2-86bd-4059-9e6c-b93cd9513038 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:54.394773 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a54ddae2-86bd-4059-9e6c-b93cd9513038 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:54.780816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a54ddae2-86bd-4059-9e6c-b93cd9513038 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:54.797943 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a54ddae2-86bd-4059-9e6c-b93cd9513038 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a" status: 200 len: 1293 microversion: 2.1 time: 0.421547 Aug 04 17:12:54.811973 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2150/4228] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:54 2022] GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a => generated 1293 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:54.990440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-935a4ebd-dfbe-4bc2-a04f-e848120ef5a2 req-27c0ef18-45fb-462a-96cf-58acd51fad52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84f1b438-b552-41c0-9e85-bb9021c44a2a", "tag": "487629c5-50cc-42f7-ad92-622f03c03177"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:12:55.009219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-935a4ebd-dfbe-4bc2-a04f-e848120ef5a2 req-27c0ef18-45fb-462a-96cf-58acd51fad52 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:55.010005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-935a4ebd-dfbe-4bc2-a04f-e848120ef5a2 req-27c0ef18-45fb-462a-96cf-58acd51fad52 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:55.010610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-935a4ebd-dfbe-4bc2-a04f-e848120ef5a2 req-27c0ef18-45fb-462a-96cf-58acd51fad52 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:55.024529 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-935a4ebd-dfbe-4bc2-a04f-e848120ef5a2 req-27c0ef18-45fb-462a-96cf-58acd51fad52 service nova] Creating event network-changed:487629c5-50cc-42f7-ad92-622f03c03177 for instance 84f1b438-b552-41c0-9e85-bb9021c44a2a on n-h2-851359-3 Aug 04 17:12:55.029917 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-935a4ebd-dfbe-4bc2-a04f-e848120ef5a2 req-27c0ef18-45fb-462a-96cf-58acd51fad52 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043995 Aug 04 17:12:55.031064 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2079/4229] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:12:55.066147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8289c0eb-2841-43cc-bffe-53a92e91b0db tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:55.067951 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8289c0eb-2841-43cc-bffe-53a92e91b0db tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:55.080582 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8289c0eb-2841-43cc-bffe-53a92e91b0db tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:55.081574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8289c0eb-2841-43cc-bffe-53a92e91b0db tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:55.082162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8289c0eb-2841-43cc-bffe-53a92e91b0db tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:55.083101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8289c0eb-2841-43cc-bffe-53a92e91b0db tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:55.083680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8289c0eb-2841-43cc-bffe-53a92e91b0db tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:55.084226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8289c0eb-2841-43cc-bffe-53a92e91b0db tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:55.254461 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-05f8f617-c7f7-43aa-8e19-032726045902 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:55.257037 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-05f8f617-c7f7-43aa-8e19-032726045902 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: c75ee070-7154-4d00-add1-674bb1c4b2b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:55.267745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05f8f617-c7f7-43aa-8e19-032726045902 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:55.269138 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05f8f617-c7f7-43aa-8e19-032726045902 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:55.269817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05f8f617-c7f7-43aa-8e19-032726045902 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:55.270829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05f8f617-c7f7-43aa-8e19-032726045902 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:55.271777 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05f8f617-c7f7-43aa-8e19-032726045902 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:55.272425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05f8f617-c7f7-43aa-8e19-032726045902 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:55.305695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8289c0eb-2841-43cc-bffe-53a92e91b0db tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:55.315275 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8289c0eb-2841-43cc-bffe-53a92e91b0db tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1732 microversion: 2.1 time: 0.254469 Aug 04 17:12:55.316455 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2151/4230] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:55 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1732 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:55.366420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-05f8f617-c7f7-43aa-8e19-032726045902 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:55.374914 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-05f8f617-c7f7-43aa-8e19-032726045902 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0" status: 200 len: 1299 microversion: 2.1 time: 0.125344 Aug 04 17:12:55.391200 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2080/4231] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:55 2022] GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0 => generated 1299 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:55.825048 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-da1e280d-8011-414c-a44a-acb7f3dac738 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:55.825639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-da1e280d-8011-414c-a44a-acb7f3dac738 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 84f1b438-b552-41c0-9e85-bb9021c44a2a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:55.844846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-da1e280d-8011-414c-a44a-acb7f3dac738 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:55.845363 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-da1e280d-8011-414c-a44a-acb7f3dac738 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:55.845817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-da1e280d-8011-414c-a44a-acb7f3dac738 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:55.847301 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-da1e280d-8011-414c-a44a-acb7f3dac738 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:55.847801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-da1e280d-8011-414c-a44a-acb7f3dac738 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:55.848247 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-da1e280d-8011-414c-a44a-acb7f3dac738 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:56.040752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-da1e280d-8011-414c-a44a-acb7f3dac738 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:56.053362 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-da1e280d-8011-414c-a44a-acb7f3dac738 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a" status: 200 len: 1293 microversion: 2.1 time: 0.232221 Aug 04 17:12:56.055856 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2152/4232] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:55 2022] GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a => generated 1293 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:56.336775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c30f63b5-b92a-4aeb-9b54-40a954d7799d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:56.339303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c30f63b5-b92a-4aeb-9b54-40a954d7799d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:56.342267 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:12:56.353248 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c30f63b5-b92a-4aeb-9b54-40a954d7799d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:56.353863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c30f63b5-b92a-4aeb-9b54-40a954d7799d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:56.354181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c30f63b5-b92a-4aeb-9b54-40a954d7799d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:56.354977 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c30f63b5-b92a-4aeb-9b54-40a954d7799d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:56.355616 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c30f63b5-b92a-4aeb-9b54-40a954d7799d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:56.355985 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c30f63b5-b92a-4aeb-9b54-40a954d7799d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:56.396790 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7c6e72be-48e1-462c-9ae4-18df9f523074 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:56.397410 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7c6e72be-48e1-462c-9ae4-18df9f523074 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: c75ee070-7154-4d00-add1-674bb1c4b2b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:56.405846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c6e72be-48e1-462c-9ae4-18df9f523074 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:56.406598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c6e72be-48e1-462c-9ae4-18df9f523074 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:56.407747 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c6e72be-48e1-462c-9ae4-18df9f523074 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:56.408646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c6e72be-48e1-462c-9ae4-18df9f523074 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:56.409255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c6e72be-48e1-462c-9ae4-18df9f523074 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:56.409834 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c6e72be-48e1-462c-9ae4-18df9f523074 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:56.658030 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7c6e72be-48e1-462c-9ae4-18df9f523074 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:56.668568 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7c6e72be-48e1-462c-9ae4-18df9f523074 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0" status: 200 len: 1367 microversion: 2.1 time: 0.275398 Aug 04 17:12:56.670288 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2153/4233] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:56 2022] GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0 => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:56.711207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c30f63b5-b92a-4aeb-9b54-40a954d7799d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:56.722197 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c30f63b5-b92a-4aeb-9b54-40a954d7799d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1732 microversion: 2.1 time: 0.389130 Aug 04 17:12:56.722799 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2081/4234] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:56 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1732 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:57.078185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3e769daa-490b-4281-bfa0-8487081962f7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:57.079121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3e769daa-490b-4281-bfa0-8487081962f7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 84f1b438-b552-41c0-9e85-bb9021c44a2a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:57.089284 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3e769daa-490b-4281-bfa0-8487081962f7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:57.089793 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3e769daa-490b-4281-bfa0-8487081962f7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:57.090275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3e769daa-490b-4281-bfa0-8487081962f7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:57.091467 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3e769daa-490b-4281-bfa0-8487081962f7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:57.092631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3e769daa-490b-4281-bfa0-8487081962f7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:57.093077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3e769daa-490b-4281-bfa0-8487081962f7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:57.310477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3e769daa-490b-4281-bfa0-8487081962f7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:57.323932 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3e769daa-490b-4281-bfa0-8487081962f7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a" status: 200 len: 1293 microversion: 2.1 time: 0.250843 Aug 04 17:12:57.324974 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2154/4235] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:57 2022] GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a => generated 1293 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:57.345608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-e1b11a5a-34df-4aae-903b-786cafc95f97 req-e575c752-abcc-476f-a9e4-41457f0bd73f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c75ee070-7154-4d00-add1-674bb1c4b2b0", "tag": "3a548778-fada-4b4d-96d6-d73cd5e7d8b5"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:12:57.365266 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e1b11a5a-34df-4aae-903b-786cafc95f97 req-e575c752-abcc-476f-a9e4-41457f0bd73f service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:57.365929 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e1b11a5a-34df-4aae-903b-786cafc95f97 req-e575c752-abcc-476f-a9e4-41457f0bd73f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:57.367222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e1b11a5a-34df-4aae-903b-786cafc95f97 req-e575c752-abcc-476f-a9e4-41457f0bd73f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:57.380265 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-e1b11a5a-34df-4aae-903b-786cafc95f97 req-e575c752-abcc-476f-a9e4-41457f0bd73f service nova] Creating event network-changed:3a548778-fada-4b4d-96d6-d73cd5e7d8b5 for instance c75ee070-7154-4d00-add1-674bb1c4b2b0 on n-h2-851359-3 Aug 04 17:12:57.385634 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-e1b11a5a-34df-4aae-903b-786cafc95f97 req-e575c752-abcc-476f-a9e4-41457f0bd73f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045766 Aug 04 17:12:57.386594 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2082/4236] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:12:57.697606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d5bb2926-0647-4878-afea-c333123e89fe tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:57.698454 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d5bb2926-0647-4878-afea-c333123e89fe tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: c75ee070-7154-4d00-add1-674bb1c4b2b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:57.707224 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d5bb2926-0647-4878-afea-c333123e89fe tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:57.710475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d5bb2926-0647-4878-afea-c333123e89fe tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:57.711956 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d5bb2926-0647-4878-afea-c333123e89fe tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:57.715289 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d5bb2926-0647-4878-afea-c333123e89fe tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:57.716522 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d5bb2926-0647-4878-afea-c333123e89fe tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:57.717079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d5bb2926-0647-4878-afea-c333123e89fe tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:57.756650 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1a01016a-c0f3-4a5f-b5bd-427ddeebff98 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:57.757636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1a01016a-c0f3-4a5f-b5bd-427ddeebff98 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:57.765997 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1a01016a-c0f3-4a5f-b5bd-427ddeebff98 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:57.767106 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1a01016a-c0f3-4a5f-b5bd-427ddeebff98 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:57.767795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1a01016a-c0f3-4a5f-b5bd-427ddeebff98 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:57.768817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1a01016a-c0f3-4a5f-b5bd-427ddeebff98 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:57.769436 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1a01016a-c0f3-4a5f-b5bd-427ddeebff98 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:57.770042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1a01016a-c0f3-4a5f-b5bd-427ddeebff98 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:58.093191 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d5bb2926-0647-4878-afea-c333123e89fe tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:58.106683 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d5bb2926-0647-4878-afea-c333123e89fe tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0" status: 200 len: 1367 microversion: 2.1 time: 0.419172 Aug 04 17:12:58.107860 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2155/4237] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:57 2022] GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0 => generated 1367 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:58.160489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1a01016a-c0f3-4a5f-b5bd-427ddeebff98 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:58.170227 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1a01016a-c0f3-4a5f-b5bd-427ddeebff98 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1732 microversion: 2.1 time: 0.429771 Aug 04 17:12:58.171603 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2083/4238] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:57 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1732 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:58.345150 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d3860495-4356-4088-884f-ceaf369dc3c9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:58.346093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d3860495-4356-4088-884f-ceaf369dc3c9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 84f1b438-b552-41c0-9e85-bb9021c44a2a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:58.352326 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3860495-4356-4088-884f-ceaf369dc3c9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:58.352903 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3860495-4356-4088-884f-ceaf369dc3c9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:58.353471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3860495-4356-4088-884f-ceaf369dc3c9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:58.354255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3860495-4356-4088-884f-ceaf369dc3c9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:58.354861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3860495-4356-4088-884f-ceaf369dc3c9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:58.355489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3860495-4356-4088-884f-ceaf369dc3c9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:58.393771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e59bb76b-2add-498d-8a09-779b1d89f056 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:58.395332 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e59bb76b-2add-498d-8a09-779b1d89f056 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:58.406555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e59bb76b-2add-498d-8a09-779b1d89f056 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:58.407109 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e59bb76b-2add-498d-8a09-779b1d89f056 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:58.407704 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e59bb76b-2add-498d-8a09-779b1d89f056 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:58.408613 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e59bb76b-2add-498d-8a09-779b1d89f056 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:58.409176 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e59bb76b-2add-498d-8a09-779b1d89f056 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:58.409762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e59bb76b-2add-498d-8a09-779b1d89f056 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:58.633867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d3860495-4356-4088-884f-ceaf369dc3c9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:58.645669 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d3860495-4356-4088-884f-ceaf369dc3c9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a" status: 200 len: 1293 microversion: 2.1 time: 0.304573 Aug 04 17:12:58.646987 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2156/4239] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:58 2022] GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a => generated 1293 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:58.680656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e59bb76b-2add-498d-8a09-779b1d89f056 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:58.688507 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e59bb76b-2add-498d-8a09-779b1d89f056 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.299245 Aug 04 17:12:58.689258 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2084/4240] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:58 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:58.710645 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7666e8f6-808d-46cc-a66d-a6a2f518edf7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:58.711830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7666e8f6-808d-46cc-a66d-a6a2f518edf7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:58.718232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:12:58.720430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7666e8f6-808d-46cc-a66d-a6a2f518edf7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:58.721087 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7666e8f6-808d-46cc-a66d-a6a2f518edf7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:58.721666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7666e8f6-808d-46cc-a66d-a6a2f518edf7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:58.722547 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7666e8f6-808d-46cc-a66d-a6a2f518edf7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:58.723190 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7666e8f6-808d-46cc-a66d-a6a2f518edf7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:58.723855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7666e8f6-808d-46cc-a66d-a6a2f518edf7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:58.747703 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:12:58.865823 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7666e8f6-808d-46cc-a66d-a6a2f518edf7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:58.873885 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7666e8f6-808d-46cc-a66d-a6a2f518edf7 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.166986 Aug 04 17:12:58.874517 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2157/4241] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:58 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:58.894878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2018f45f-be0b-42aa-9f7e-412f3c030d35 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:58.895500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2018f45f-be0b-42aa-9f7e-412f3c030d35 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:58.901669 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2018f45f-be0b-42aa-9f7e-412f3c030d35 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:58.902196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2018f45f-be0b-42aa-9f7e-412f3c030d35 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:58.902637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2018f45f-be0b-42aa-9f7e-412f3c030d35 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:58.903338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2018f45f-be0b-42aa-9f7e-412f3c030d35 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:58.903792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2018f45f-be0b-42aa-9f7e-412f3c030d35 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:58.904226 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2018f45f-be0b-42aa-9f7e-412f3c030d35 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:59.058917 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2018f45f-be0b-42aa-9f7e-412f3c030d35 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:59.067809 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2018f45f-be0b-42aa-9f7e-412f3c030d35 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.177435 Aug 04 17:12:59.068652 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2085/4242] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:58 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:59.091529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-163fb76e-423c-463d-b80e-f97472117574 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:59.092312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-163fb76e-423c-463d-b80e-f97472117574 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:59.098253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=8 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:12:59.100761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-163fb76e-423c-463d-b80e-f97472117574 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:59.101521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-163fb76e-423c-463d-b80e-f97472117574 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:59.102444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-163fb76e-423c-463d-b80e-f97472117574 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:59.103429 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-163fb76e-423c-463d-b80e-f97472117574 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:59.104101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-163fb76e-423c-463d-b80e-f97472117574 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:59.104740 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-163fb76e-423c-463d-b80e-f97472117574 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:59.128766 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ca73d8f2-0f15-4c01-b593-8098542c2ec9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:59.129542 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ca73d8f2-0f15-4c01-b593-8098542c2ec9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: c75ee070-7154-4d00-add1-674bb1c4b2b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:59.141354 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca73d8f2-0f15-4c01-b593-8098542c2ec9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:59.142581 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca73d8f2-0f15-4c01-b593-8098542c2ec9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:59.143153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca73d8f2-0f15-4c01-b593-8098542c2ec9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:59.146917 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca73d8f2-0f15-4c01-b593-8098542c2ec9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:59.147661 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca73d8f2-0f15-4c01-b593-8098542c2ec9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:59.148313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca73d8f2-0f15-4c01-b593-8098542c2ec9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:59.160818 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:12:59.376923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-163fb76e-423c-463d-b80e-f97472117574 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:59.389227 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ca73d8f2-0f15-4c01-b593-8098542c2ec9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:59.390044 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-163fb76e-423c-463d-b80e-f97472117574 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.304002 Aug 04 17:12:59.392382 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2158/4243] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:59 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:59.397965 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ca73d8f2-0f15-4c01-b593-8098542c2ec9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0" status: 200 len: 1367 microversion: 2.1 time: 0.273554 Aug 04 17:12:59.403031 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2086/4244] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:59 2022] GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0 => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:12:59.417494 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-eae8c433-1334-45a0-87f1-fd9e5624581d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:59.418168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-eae8c433-1334-45a0-87f1-fd9e5624581d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:59.425171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eae8c433-1334-45a0-87f1-fd9e5624581d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:59.425859 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eae8c433-1334-45a0-87f1-fd9e5624581d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:59.426494 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eae8c433-1334-45a0-87f1-fd9e5624581d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:59.427369 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eae8c433-1334-45a0-87f1-fd9e5624581d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:59.427966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eae8c433-1334-45a0-87f1-fd9e5624581d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:59.428563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eae8c433-1334-45a0-87f1-fd9e5624581d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:59.564885 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-169627e8-8982-41a7-8240-b236ce6cf405 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1364328010", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "b3c59640-cdc1-4b7c-beb0-ca591646427e"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:12:59.628021 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-eae8c433-1334-45a0-87f1-fd9e5624581d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:59.676008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-169627e8-8982-41a7-8240-b236ce6cf405 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] validate_networks() for [('b3c59640-cdc1-4b7c-beb0-ca591646427e', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:12:59.679741 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-eae8c433-1334-45a0-87f1-fd9e5624581d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1732 microversion: 2.1 time: 0.285896 Aug 04 17:12:59.682959 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2159/4245] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:59 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1732 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:12:59.690471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3543f13e-2a10-45e6-976f-8dcc692e579f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:12:59.695500 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3543f13e-2a10-45e6-976f-8dcc692e579f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 84f1b438-b552-41c0-9e85-bb9021c44a2a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:12:59.715314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3543f13e-2a10-45e6-976f-8dcc692e579f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:59.715953 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3543f13e-2a10-45e6-976f-8dcc692e579f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:59.716287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3543f13e-2a10-45e6-976f-8dcc692e579f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:59.719492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3543f13e-2a10-45e6-976f-8dcc692e579f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:12:59.722636 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3543f13e-2a10-45e6-976f-8dcc692e579f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:12:59.723811 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3543f13e-2a10-45e6-976f-8dcc692e579f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:12:59.976430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3543f13e-2a10-45e6-976f-8dcc692e579f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:12:59.984830 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3543f13e-2a10-45e6-976f-8dcc692e579f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a" status: 200 len: 1293 microversion: 2.1 time: 0.300750 Aug 04 17:13:00.000591 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2160/4246] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:12:59 2022] GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a => generated 1293 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:00.147549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:00.419041 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3419b401-7a1f-4269-a5fe-cdc57fb94e41 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:00.420018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3419b401-7a1f-4269-a5fe-cdc57fb94e41 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: c75ee070-7154-4d00-add1-674bb1c4b2b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:00.428407 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3419b401-7a1f-4269-a5fe-cdc57fb94e41 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:00.429288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3419b401-7a1f-4269-a5fe-cdc57fb94e41 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:00.429952 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3419b401-7a1f-4269-a5fe-cdc57fb94e41 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:00.430939 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3419b401-7a1f-4269-a5fe-cdc57fb94e41 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:00.431634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3419b401-7a1f-4269-a5fe-cdc57fb94e41 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:00.432278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3419b401-7a1f-4269-a5fe-cdc57fb94e41 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:00.501195 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=12 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:00.606829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-169627e8-8982-41a7-8240-b236ce6cf405 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:13:00.607263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-169627e8-8982-41a7-8240-b236ce6cf405 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:13:00.608537 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-169627e8-8982-41a7-8240-b236ce6cf405 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:13:00.608537 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-169627e8-8982-41a7-8240-b236ce6cf405 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:13:00.608537 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-169627e8-8982-41a7-8240-b236ce6cf405 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:13:00.619667 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-169627e8-8982-41a7-8240-b236ce6cf405 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:00.620536 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-169627e8-8982-41a7-8240-b236ce6cf405 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:00.621255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-169627e8-8982-41a7-8240-b236ce6cf405 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:00.622277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-169627e8-8982-41a7-8240-b236ce6cf405 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:00.623035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-169627e8-8982-41a7-8240-b236ce6cf405 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:00.623889 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-169627e8-8982-41a7-8240-b236ce6cf405 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:00.631012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3419b401-7a1f-4269-a5fe-cdc57fb94e41 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:00.642734 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3419b401-7a1f-4269-a5fe-cdc57fb94e41 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0" status: 200 len: 1367 microversion: 2.1 time: 0.226687 Aug 04 17:13:00.643331 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2161/4247] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:00 2022] GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:13:00.646335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-169627e8-8982-41a7-8240-b236ce6cf405 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Getting quotas for project 683ce999e25e42a4a57b3c24a1fd24ef. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:13:00.652022 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-169627e8-8982-41a7-8240-b236ce6cf405 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Getting quotas for user 01e6f70936a14e67aecaf71fb615fffa and project 683ce999e25e42a4a57b3c24a1fd24ef. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:13:00.667310 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-169627e8-8982-41a7-8240-b236ce6cf405 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:13:00.669746 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-169627e8-8982-41a7-8240-b236ce6cf405 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: eba6aa22-62ff-42e5-8401-f02b23ffeb85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:13:00.707574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7ea9716b-4d05-4f96-9b24-4791190c298c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:00.708758 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7ea9716b-4d05-4f96-9b24-4791190c298c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:00.716885 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7ea9716b-4d05-4f96-9b24-4791190c298c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:00.718293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7ea9716b-4d05-4f96-9b24-4791190c298c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:00.718971 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7ea9716b-4d05-4f96-9b24-4791190c298c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:00.720372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7ea9716b-4d05-4f96-9b24-4791190c298c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:00.720962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7ea9716b-4d05-4f96-9b24-4791190c298c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:00.721519 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7ea9716b-4d05-4f96-9b24-4791190c298c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:00.723452 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-169627e8-8982-41a7-8240-b236ce6cf405 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.163736 Aug 04 17:13:00.724628 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2087/4248] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:12:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 17:13:00.737861 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aacce97a-f75d-4902-b081-472a40cd2f5f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:00.738773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aacce97a-f75d-4902-b081-472a40cd2f5f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: eba6aa22-62ff-42e5-8401-f02b23ffeb85] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:00.812538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-aacce97a-f75d-4902-b081-472a40cd2f5f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:00.821897 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aacce97a-f75d-4902-b081-472a40cd2f5f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85" status: 200 len: 1215 microversion: 2.1 time: 0.089909 Aug 04 17:13:00.823750 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2088/4249] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:00 2022] GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85 => generated 1215 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:13:01.006715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bbd9e1f7-fb64-42ad-a8f7-bf2ee3450b8f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:01.007608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bbd9e1f7-fb64-42ad-a8f7-bf2ee3450b8f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 84f1b438-b552-41c0-9e85-bb9021c44a2a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:01.024592 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bbd9e1f7-fb64-42ad-a8f7-bf2ee3450b8f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:01.026526 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bbd9e1f7-fb64-42ad-a8f7-bf2ee3450b8f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:01.027936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bbd9e1f7-fb64-42ad-a8f7-bf2ee3450b8f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:01.029044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bbd9e1f7-fb64-42ad-a8f7-bf2ee3450b8f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:01.031334 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bbd9e1f7-fb64-42ad-a8f7-bf2ee3450b8f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:01.034552 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bbd9e1f7-fb64-42ad-a8f7-bf2ee3450b8f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:01.063070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7ea9716b-4d05-4f96-9b24-4791190c298c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:01.072198 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7ea9716b-4d05-4f96-9b24-4791190c298c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1732 microversion: 2.1 time: 0.371111 Aug 04 17:13:01.108631 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2162/4250] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:00 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1732 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:01.351019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bbd9e1f7-fb64-42ad-a8f7-bf2ee3450b8f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:01.364690 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bbd9e1f7-fb64-42ad-a8f7-bf2ee3450b8f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a" status: 200 len: 1293 microversion: 2.1 time: 0.361665 Aug 04 17:13:01.367051 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2089/4251] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:01 2022] GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a => generated 1293 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:01.664718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-02050fef-6ae7-45d6-b5ef-c9d0086dd9e8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:01.665435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-02050fef-6ae7-45d6-b5ef-c9d0086dd9e8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: c75ee070-7154-4d00-add1-674bb1c4b2b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:01.681639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02050fef-6ae7-45d6-b5ef-c9d0086dd9e8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:01.684166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02050fef-6ae7-45d6-b5ef-c9d0086dd9e8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:01.687739 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02050fef-6ae7-45d6-b5ef-c9d0086dd9e8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:01.688997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02050fef-6ae7-45d6-b5ef-c9d0086dd9e8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:01.689631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02050fef-6ae7-45d6-b5ef-c9d0086dd9e8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:01.690552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02050fef-6ae7-45d6-b5ef-c9d0086dd9e8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:01.852113 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-261a0393-5824-4d3f-983b-5cd9a45d3482 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:01.853422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-261a0393-5824-4d3f-983b-5cd9a45d3482 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: eba6aa22-62ff-42e5-8401-f02b23ffeb85] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:01.876681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-261a0393-5824-4d3f-983b-5cd9a45d3482 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:01.877447 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-261a0393-5824-4d3f-983b-5cd9a45d3482 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:01.877913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-261a0393-5824-4d3f-983b-5cd9a45d3482 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:01.878750 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-261a0393-5824-4d3f-983b-5cd9a45d3482 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:01.879262 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-261a0393-5824-4d3f-983b-5cd9a45d3482 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:01.879700 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-261a0393-5824-4d3f-983b-5cd9a45d3482 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:02.027654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-261a0393-5824-4d3f-983b-5cd9a45d3482 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:02.034518 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-02050fef-6ae7-45d6-b5ef-c9d0086dd9e8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:02.036704 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-261a0393-5824-4d3f-983b-5cd9a45d3482 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85" status: 200 len: 1267 microversion: 2.1 time: 0.188517 Aug 04 17:13:02.037762 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2090/4252] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:01 2022] GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85 => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:13:02.055311 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-02050fef-6ae7-45d6-b5ef-c9d0086dd9e8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0" status: 200 len: 1367 microversion: 2.1 time: 0.394630 Aug 04 17:13:02.056065 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2163/4253] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:01 2022] GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0 => generated 1367 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:02.100105 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8a3843ca-d325-4aeb-9d87-8b3f6b8f7490 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:02.100954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8a3843ca-d325-4aeb-9d87-8b3f6b8f7490 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:02.108212 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a3843ca-d325-4aeb-9d87-8b3f6b8f7490 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:02.108696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a3843ca-d325-4aeb-9d87-8b3f6b8f7490 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:02.117525 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a3843ca-d325-4aeb-9d87-8b3f6b8f7490 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:02.118404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a3843ca-d325-4aeb-9d87-8b3f6b8f7490 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:02.118819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a3843ca-d325-4aeb-9d87-8b3f6b8f7490 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:02.119260 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a3843ca-d325-4aeb-9d87-8b3f6b8f7490 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:02.332409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8a3843ca-d325-4aeb-9d87-8b3f6b8f7490 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:02.345531 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8a3843ca-d325-4aeb-9d87-8b3f6b8f7490 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1732 microversion: 2.1 time: 0.249529 Aug 04 17:13:02.358192 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2091/4254] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:02 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1732 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:02.387111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1fc20b26-341a-48b6-b724-c8d8e38c1683 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:02.388003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1fc20b26-341a-48b6-b724-c8d8e38c1683 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 84f1b438-b552-41c0-9e85-bb9021c44a2a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:02.395755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1fc20b26-341a-48b6-b724-c8d8e38c1683 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:02.403491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1fc20b26-341a-48b6-b724-c8d8e38c1683 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:02.403959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1fc20b26-341a-48b6-b724-c8d8e38c1683 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:02.404875 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1fc20b26-341a-48b6-b724-c8d8e38c1683 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:02.405347 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1fc20b26-341a-48b6-b724-c8d8e38c1683 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:02.405785 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1fc20b26-341a-48b6-b724-c8d8e38c1683 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:02.435474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aabe785f-6d2e-4ffb-a73d-59ac63a68c50 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:02.437874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aabe785f-6d2e-4ffb-a73d-59ac63a68c50 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:02.449943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aabe785f-6d2e-4ffb-a73d-59ac63a68c50 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:02.450636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aabe785f-6d2e-4ffb-a73d-59ac63a68c50 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:02.451056 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aabe785f-6d2e-4ffb-a73d-59ac63a68c50 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:02.451790 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aabe785f-6d2e-4ffb-a73d-59ac63a68c50 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:02.452259 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aabe785f-6d2e-4ffb-a73d-59ac63a68c50 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:02.452691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aabe785f-6d2e-4ffb-a73d-59ac63a68c50 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:02.504805 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aabe785f-6d2e-4ffb-a73d-59ac63a68c50 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073248 Aug 04 17:13:02.527316 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2092/4255] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:13:02 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:13:02.598200 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d80a6dc9-4a08-4320-a4cc-8685a2d2f85d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:02.598831 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d80a6dc9-4a08-4320-a4cc-8685a2d2f85d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:02.609269 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d80a6dc9-4a08-4320-a4cc-8685a2d2f85d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:02.609708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d80a6dc9-4a08-4320-a4cc-8685a2d2f85d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:02.610202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d80a6dc9-4a08-4320-a4cc-8685a2d2f85d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:02.610957 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d80a6dc9-4a08-4320-a4cc-8685a2d2f85d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:02.611382 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d80a6dc9-4a08-4320-a4cc-8685a2d2f85d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:02.611816 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d80a6dc9-4a08-4320-a4cc-8685a2d2f85d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:02.642539 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1fc20b26-341a-48b6-b724-c8d8e38c1683 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:02.648043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d80a6dc9-4a08-4320-a4cc-8685a2d2f85d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:13:02.659107 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1fc20b26-341a-48b6-b724-c8d8e38c1683 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a" status: 200 len: 1293 microversion: 2.1 time: 0.277745 Aug 04 17:13:02.659837 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2164/4256] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:02 2022] GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a => generated 1293 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:02.746348 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d80a6dc9-4a08-4320-a4cc-8685a2d2f85d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 204 len: 0 microversion: 2.1 time: 0.153859 Aug 04 17:13:02.750092 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2093/4257] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:13:02 2022] DELETE /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 17:13:02.755193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b9ec944a-3cf7-4e33-9089-5f491df73280 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:02.755818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b9ec944a-3cf7-4e33-9089-5f491df73280 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:02.762511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9ec944a-3cf7-4e33-9089-5f491df73280 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:02.763007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9ec944a-3cf7-4e33-9089-5f491df73280 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:02.763475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9ec944a-3cf7-4e33-9089-5f491df73280 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:02.764180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9ec944a-3cf7-4e33-9089-5f491df73280 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:02.764645 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9ec944a-3cf7-4e33-9089-5f491df73280 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:02.765153 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9ec944a-3cf7-4e33-9089-5f491df73280 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:02.919077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b9ec944a-3cf7-4e33-9089-5f491df73280 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:02.928584 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b9ec944a-3cf7-4e33-9089-5f491df73280 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1673 microversion: 2.1 time: 0.177241 Aug 04 17:13:02.929435 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2165/4258] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:02 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1673 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:03.060258 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9c9b6021-cdd9-4f05-9706-f4d967867bc3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:03.061062 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9c9b6021-cdd9-4f05-9706-f4d967867bc3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: eba6aa22-62ff-42e5-8401-f02b23ffeb85] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:03.069645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c9b6021-cdd9-4f05-9706-f4d967867bc3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:03.070503 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c9b6021-cdd9-4f05-9706-f4d967867bc3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:03.071166 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c9b6021-cdd9-4f05-9706-f4d967867bc3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:03.072111 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c9b6021-cdd9-4f05-9706-f4d967867bc3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:03.073264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c9b6021-cdd9-4f05-9706-f4d967867bc3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:03.073916 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c9b6021-cdd9-4f05-9706-f4d967867bc3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:03.081919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b297494f-a5a4-4dd5-8f5b-2192abfe436c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:03.083384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b297494f-a5a4-4dd5-8f5b-2192abfe436c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: c75ee070-7154-4d00-add1-674bb1c4b2b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:03.095142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b297494f-a5a4-4dd5-8f5b-2192abfe436c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:03.099125 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b297494f-a5a4-4dd5-8f5b-2192abfe436c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:03.099721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b297494f-a5a4-4dd5-8f5b-2192abfe436c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:03.101643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b297494f-a5a4-4dd5-8f5b-2192abfe436c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:03.102287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b297494f-a5a4-4dd5-8f5b-2192abfe436c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:03.103005 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b297494f-a5a4-4dd5-8f5b-2192abfe436c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:03.225446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9c9b6021-cdd9-4f05-9706-f4d967867bc3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:03.233688 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9c9b6021-cdd9-4f05-9706-f4d967867bc3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85" status: 200 len: 1273 microversion: 2.1 time: 0.177861 Aug 04 17:13:03.234639 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2094/4259] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:03 2022] GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85 => generated 1273 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:03.293664 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b297494f-a5a4-4dd5-8f5b-2192abfe436c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:03.301718 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b297494f-a5a4-4dd5-8f5b-2192abfe436c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0" status: 200 len: 1367 microversion: 2.1 time: 0.224800 Aug 04 17:13:03.302328 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2166/4260] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:03 2022] GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:03.370846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-984454a2-5ef6-4d90-9ba5-c0c01d404100 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:03.371467 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-984454a2-5ef6-4d90-9ba5-c0c01d404100 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:03.378354 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-984454a2-5ef6-4d90-9ba5-c0c01d404100 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:03.378845 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-984454a2-5ef6-4d90-9ba5-c0c01d404100 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:03.379287 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-984454a2-5ef6-4d90-9ba5-c0c01d404100 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:03.379987 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-984454a2-5ef6-4d90-9ba5-c0c01d404100 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:03.380450 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-984454a2-5ef6-4d90-9ba5-c0c01d404100 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:03.380881 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-984454a2-5ef6-4d90-9ba5-c0c01d404100 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:03.515705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-984454a2-5ef6-4d90-9ba5-c0c01d404100 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:03.524634 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-984454a2-5ef6-4d90-9ba5-c0c01d404100 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1732 microversion: 2.1 time: 0.157625 Aug 04 17:13:03.525525 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2095/4261] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:03 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:03.680086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b8267922-187f-4e34-a25f-7ba92ffc9e99 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:03.680712 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b8267922-187f-4e34-a25f-7ba92ffc9e99 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 84f1b438-b552-41c0-9e85-bb9021c44a2a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:03.694370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b8267922-187f-4e34-a25f-7ba92ffc9e99 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:03.694876 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b8267922-187f-4e34-a25f-7ba92ffc9e99 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:03.695319 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b8267922-187f-4e34-a25f-7ba92ffc9e99 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:03.696018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b8267922-187f-4e34-a25f-7ba92ffc9e99 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:03.696473 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b8267922-187f-4e34-a25f-7ba92ffc9e99 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:03.696901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b8267922-187f-4e34-a25f-7ba92ffc9e99 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:03.909378 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-4d99b339-7eea-4e58-a973-d34b2c9d4d06 req-a272a518-9ccc-4d3e-9e08-b94075dbc3fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84f1b438-b552-41c0-9e85-bb9021c44a2a", "name": "network-vif-plugged", "status": "completed", "tag": "487629c5-50cc-42f7-ad92-622f03c03177"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:03.920999 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4d99b339-7eea-4e58-a973-d34b2c9d4d06 req-a272a518-9ccc-4d3e-9e08-b94075dbc3fc service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:03.922510 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4d99b339-7eea-4e58-a973-d34b2c9d4d06 req-a272a518-9ccc-4d3e-9e08-b94075dbc3fc service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:03.923708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4d99b339-7eea-4e58-a973-d34b2c9d4d06 req-a272a518-9ccc-4d3e-9e08-b94075dbc3fc service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:03.952356 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-4d99b339-7eea-4e58-a973-d34b2c9d4d06 req-a272a518-9ccc-4d3e-9e08-b94075dbc3fc service nova] Creating event network-vif-plugged:487629c5-50cc-42f7-ad92-622f03c03177 for instance 84f1b438-b552-41c0-9e85-bb9021c44a2a on n-h2-851359-3 Aug 04 17:13:03.960246 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-4d99b339-7eea-4e58-a973-d34b2c9d4d06 req-a272a518-9ccc-4d3e-9e08-b94075dbc3fc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053637 Aug 04 17:13:03.970598 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2096/4262] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:13:03.983382 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-777340c0-c0c2-4432-b779-e8ac8d2f2be3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:03.984085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-777340c0-c0c2-4432-b779-e8ac8d2f2be3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:03.992581 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-777340c0-c0c2-4432-b779-e8ac8d2f2be3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:03.993117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-777340c0-c0c2-4432-b779-e8ac8d2f2be3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:03.993567 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-777340c0-c0c2-4432-b779-e8ac8d2f2be3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:03.994324 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-777340c0-c0c2-4432-b779-e8ac8d2f2be3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:03.994794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-777340c0-c0c2-4432-b779-e8ac8d2f2be3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:03.995295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-777340c0-c0c2-4432-b779-e8ac8d2f2be3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:04.019287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b8267922-187f-4e34-a25f-7ba92ffc9e99 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:04.034594 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b8267922-187f-4e34-a25f-7ba92ffc9e99 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a" status: 200 len: 1293 microversion: 2.1 time: 0.357711 Aug 04 17:13:04.035788 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2167/4263] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:03 2022] GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a => generated 1293 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:04.259996 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-93fde4da-d12a-4f06-943f-eeb34b889439 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:04.262656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-777340c0-c0c2-4432-b779-e8ac8d2f2be3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:04.268061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-93fde4da-d12a-4f06-943f-eeb34b889439 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: eba6aa22-62ff-42e5-8401-f02b23ffeb85] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:04.273963 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-777340c0-c0c2-4432-b779-e8ac8d2f2be3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1673 microversion: 2.1 time: 0.300526 Aug 04 17:13:04.274572 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2097/4264] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:03 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1673 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:04.296399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-93fde4da-d12a-4f06-943f-eeb34b889439 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:04.310379 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-93fde4da-d12a-4f06-943f-eeb34b889439 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:04.311646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-93fde4da-d12a-4f06-943f-eeb34b889439 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:04.319788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-93fde4da-d12a-4f06-943f-eeb34b889439 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:04.325689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-93fde4da-d12a-4f06-943f-eeb34b889439 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:04.327729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-93fde4da-d12a-4f06-943f-eeb34b889439 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:04.329617 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0fb8b7d9-f274-4ad9-a682-33c69452e6be tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:04.330807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0fb8b7d9-f274-4ad9-a682-33c69452e6be tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: c75ee070-7154-4d00-add1-674bb1c4b2b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:04.339437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fb8b7d9-f274-4ad9-a682-33c69452e6be tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:04.343570 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fb8b7d9-f274-4ad9-a682-33c69452e6be tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:04.348623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fb8b7d9-f274-4ad9-a682-33c69452e6be tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:04.349683 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fb8b7d9-f274-4ad9-a682-33c69452e6be tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:04.350409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fb8b7d9-f274-4ad9-a682-33c69452e6be tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:04.351055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fb8b7d9-f274-4ad9-a682-33c69452e6be tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:04.820858 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-93fde4da-d12a-4f06-943f-eeb34b889439 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:04.835947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0fb8b7d9-f274-4ad9-a682-33c69452e6be tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:04.837893 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-93fde4da-d12a-4f06-943f-eeb34b889439 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85" status: 200 len: 1315 microversion: 2.1 time: 0.586323 Aug 04 17:13:04.842698 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2168/4265] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:04 2022] GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85 => generated 1315 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:04.848398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c039a0b5-cce0-4bc9-bdec-3fe1d8e5700d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:04.849204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c039a0b5-cce0-4bc9-bdec-3fe1d8e5700d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:04.851846 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0fb8b7d9-f274-4ad9-a682-33c69452e6be tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0" status: 200 len: 1367 microversion: 2.1 time: 0.527102 Aug 04 17:13:04.852862 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2098/4266] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:04 2022] GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0 => generated 1367 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:04.859938 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c039a0b5-cce0-4bc9-bdec-3fe1d8e5700d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:04.861835 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c039a0b5-cce0-4bc9-bdec-3fe1d8e5700d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:04.862484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c039a0b5-cce0-4bc9-bdec-3fe1d8e5700d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:04.863563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c039a0b5-cce0-4bc9-bdec-3fe1d8e5700d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:04.865176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c039a0b5-cce0-4bc9-bdec-3fe1d8e5700d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:04.865801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c039a0b5-cce0-4bc9-bdec-3fe1d8e5700d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:05.060350 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e5e88acd-115b-450d-8da6-c13f51813522 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:05.061062 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e5e88acd-115b-450d-8da6-c13f51813522 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 84f1b438-b552-41c0-9e85-bb9021c44a2a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:05.069398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5e88acd-115b-450d-8da6-c13f51813522 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:05.069897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5e88acd-115b-450d-8da6-c13f51813522 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:05.070371 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5e88acd-115b-450d-8da6-c13f51813522 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:05.071187 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5e88acd-115b-450d-8da6-c13f51813522 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:05.071815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5e88acd-115b-450d-8da6-c13f51813522 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:05.072254 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5e88acd-115b-450d-8da6-c13f51813522 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:05.137684 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c039a0b5-cce0-4bc9-bdec-3fe1d8e5700d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:05.153001 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c039a0b5-cce0-4bc9-bdec-3fe1d8e5700d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1732 microversion: 2.1 time: 0.308490 Aug 04 17:13:05.153721 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2169/4267] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:04 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1732 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:05.296590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8ee8f7ce-fcbb-4696-bf41-33e160a5a07f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:05.298589 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8ee8f7ce-fcbb-4696-bf41-33e160a5a07f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:05.304706 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ee8f7ce-fcbb-4696-bf41-33e160a5a07f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:05.305208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ee8f7ce-fcbb-4696-bf41-33e160a5a07f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:05.305654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ee8f7ce-fcbb-4696-bf41-33e160a5a07f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:05.306557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ee8f7ce-fcbb-4696-bf41-33e160a5a07f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:05.307180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ee8f7ce-fcbb-4696-bf41-33e160a5a07f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:05.307621 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ee8f7ce-fcbb-4696-bf41-33e160a5a07f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:05.341325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e5e88acd-115b-450d-8da6-c13f51813522 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:05.353734 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e5e88acd-115b-450d-8da6-c13f51813522 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a" status: 200 len: 1293 microversion: 2.1 time: 0.300926 Aug 04 17:13:05.355026 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2099/4268] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:05 2022] GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a => generated 1293 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:13:05.526359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-d7b1f68b-e7c5-4d45-bb32-181802bf7553 req-4689e188-5918-4a0d-a203-15c48181944f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eba6aa22-62ff-42e5-8401-f02b23ffeb85", "tag": "f347cd22-db0b-4a20-abd4-efe2343e7d90"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:05.540725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d7b1f68b-e7c5-4d45-bb32-181802bf7553 req-4689e188-5918-4a0d-a203-15c48181944f service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:05.541480 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d7b1f68b-e7c5-4d45-bb32-181802bf7553 req-4689e188-5918-4a0d-a203-15c48181944f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:05.542081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d7b1f68b-e7c5-4d45-bb32-181802bf7553 req-4689e188-5918-4a0d-a203-15c48181944f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:05.549937 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8ee8f7ce-fcbb-4696-bf41-33e160a5a07f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:05.556749 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-d7b1f68b-e7c5-4d45-bb32-181802bf7553 req-4689e188-5918-4a0d-a203-15c48181944f service nova] Creating event network-changed:f347cd22-db0b-4a20-abd4-efe2343e7d90 for instance eba6aa22-62ff-42e5-8401-f02b23ffeb85 on n-h1-851359-3 Aug 04 17:13:05.559438 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8ee8f7ce-fcbb-4696-bf41-33e160a5a07f tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1673 microversion: 2.1 time: 0.265596 Aug 04 17:13:05.561855 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2170/4269] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:05 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1673 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:13:05.581923 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-d7b1f68b-e7c5-4d45-bb32-181802bf7553 req-4689e188-5918-4a0d-a203-15c48181944f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059616 Aug 04 17:13:05.583009 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2100/4270] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:13:05.607107 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c4d8d15c-f19c-4ed3-8547-6e4206dc2775 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:05.607793 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c4d8d15c-f19c-4ed3-8547-6e4206dc2775 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:05.614412 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4d8d15c-f19c-4ed3-8547-6e4206dc2775 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:05.615080 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4d8d15c-f19c-4ed3-8547-6e4206dc2775 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:05.615680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4d8d15c-f19c-4ed3-8547-6e4206dc2775 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:05.616546 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4d8d15c-f19c-4ed3-8547-6e4206dc2775 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:05.617162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4d8d15c-f19c-4ed3-8547-6e4206dc2775 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:05.617746 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4d8d15c-f19c-4ed3-8547-6e4206dc2775 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:05.647482 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c4d8d15c-f19c-4ed3-8547-6e4206dc2775 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d/ips" status: 200 len: 153 microversion: 2.20 time: 0.044327 Aug 04 17:13:05.650432 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2171/4271] 10.222.0.93 () {60 vars in 1289 bytes} [Thu Aug 4 17:13:05 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d/ips => generated 153 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:13:05.881234 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-452f1d02-8123-4c9f-b8d9-5893947fa3ad tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:05.885354 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4a985a97-4d85-41ae-bc29-d9bf9fb01d6b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:05.886687 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-452f1d02-8123-4c9f-b8d9-5893947fa3ad tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: c75ee070-7154-4d00-add1-674bb1c4b2b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:05.889753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4a985a97-4d85-41ae-bc29-d9bf9fb01d6b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: eba6aa22-62ff-42e5-8401-f02b23ffeb85] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:05.904092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-452f1d02-8123-4c9f-b8d9-5893947fa3ad tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:05.905192 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a985a97-4d85-41ae-bc29-d9bf9fb01d6b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:05.906064 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a985a97-4d85-41ae-bc29-d9bf9fb01d6b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:05.906818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-452f1d02-8123-4c9f-b8d9-5893947fa3ad tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:05.907618 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a985a97-4d85-41ae-bc29-d9bf9fb01d6b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:05.908292 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-452f1d02-8123-4c9f-b8d9-5893947fa3ad tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:05.909347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a985a97-4d85-41ae-bc29-d9bf9fb01d6b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:05.911004 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-452f1d02-8123-4c9f-b8d9-5893947fa3ad tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:05.911684 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a985a97-4d85-41ae-bc29-d9bf9fb01d6b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:05.912637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-452f1d02-8123-4c9f-b8d9-5893947fa3ad tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:05.913313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a985a97-4d85-41ae-bc29-d9bf9fb01d6b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:05.913970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-452f1d02-8123-4c9f-b8d9-5893947fa3ad tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:06.282582 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-452f1d02-8123-4c9f-b8d9-5893947fa3ad tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:06.291592 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-452f1d02-8123-4c9f-b8d9-5893947fa3ad tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0" status: 200 len: 1367 microversion: 2.1 time: 0.414026 Aug 04 17:13:06.295874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4a985a97-4d85-41ae-bc29-d9bf9fb01d6b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:06.306052 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2172/4272] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:05 2022] GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0 => generated 1367 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:06.310267 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4a985a97-4d85-41ae-bc29-d9bf9fb01d6b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85" status: 200 len: 1315 microversion: 2.1 time: 0.435124 Aug 04 17:13:06.311600 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2101/4273] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:05 2022] GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85 => generated 1315 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:06.323846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e2e82cab-9535-439f-abea-1bc31e3caf54 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:06.324715 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e2e82cab-9535-439f-abea-1bc31e3caf54 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:06.336377 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2e82cab-9535-439f-abea-1bc31e3caf54 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:06.346996 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2e82cab-9535-439f-abea-1bc31e3caf54 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:06.347842 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2e82cab-9535-439f-abea-1bc31e3caf54 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:06.348827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2e82cab-9535-439f-abea-1bc31e3caf54 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:06.349609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2e82cab-9535-439f-abea-1bc31e3caf54 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:06.350159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2e82cab-9535-439f-abea-1bc31e3caf54 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:06.376784 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-673d7c10-37b3-42e9-93fd-14fd870b7f0f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:06.378075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-673d7c10-37b3-42e9-93fd-14fd870b7f0f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 84f1b438-b552-41c0-9e85-bb9021c44a2a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:06.390890 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-673d7c10-37b3-42e9-93fd-14fd870b7f0f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:06.391651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-673d7c10-37b3-42e9-93fd-14fd870b7f0f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:06.392454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-673d7c10-37b3-42e9-93fd-14fd870b7f0f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:06.394289 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-673d7c10-37b3-42e9-93fd-14fd870b7f0f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:06.395739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-673d7c10-37b3-42e9-93fd-14fd870b7f0f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:06.396379 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-673d7c10-37b3-42e9-93fd-14fd870b7f0f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:06.672328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-673d7c10-37b3-42e9-93fd-14fd870b7f0f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:06.684761 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-673d7c10-37b3-42e9-93fd-14fd870b7f0f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a" status: 200 len: 1293 microversion: 2.1 time: 0.313118 Aug 04 17:13:06.686025 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2102/4274] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:06 2022] GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a => generated 1293 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:06.689998 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e2e82cab-9535-439f-abea-1bc31e3caf54 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:06.692577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-70a8c157-6508-44af-b8a9-f45d8aeae1ce tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:06.694954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-70a8c157-6508-44af-b8a9-f45d8aeae1ce tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:06.699061 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e2e82cab-9535-439f-abea-1bc31e3caf54 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1732 microversion: 2.1 time: 0.391085 Aug 04 17:13:06.702077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70a8c157-6508-44af-b8a9-f45d8aeae1ce tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:06.703045 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70a8c157-6508-44af-b8a9-f45d8aeae1ce tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:06.703668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70a8c157-6508-44af-b8a9-f45d8aeae1ce tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:06.706426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70a8c157-6508-44af-b8a9-f45d8aeae1ce tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:06.707208 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70a8c157-6508-44af-b8a9-f45d8aeae1ce tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:06.707798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70a8c157-6508-44af-b8a9-f45d8aeae1ce tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:06.714533 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2173/4275] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:06 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1732 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:06.919636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-70a8c157-6508-44af-b8a9-f45d8aeae1ce tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:06.928805 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-70a8c157-6508-44af-b8a9-f45d8aeae1ce tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1673 microversion: 2.1 time: 0.241660 Aug 04 17:13:06.942464 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2103/4276] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:06 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1673 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:07.337772 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f051e2c0-a4fe-436a-b3ce-35ffb09601c1 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:07.338905 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f051e2c0-a4fe-436a-b3ce-35ffb09601c1 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: c75ee070-7154-4d00-add1-674bb1c4b2b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:07.345059 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-968e55b7-bf02-4e33-88ff-b7f88181144e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:07.345674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-968e55b7-bf02-4e33-88ff-b7f88181144e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: eba6aa22-62ff-42e5-8401-f02b23ffeb85] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:07.362127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-968e55b7-bf02-4e33-88ff-b7f88181144e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:07.366993 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f051e2c0-a4fe-436a-b3ce-35ffb09601c1 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:07.368774 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-968e55b7-bf02-4e33-88ff-b7f88181144e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:07.368774 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-968e55b7-bf02-4e33-88ff-b7f88181144e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:07.368774 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-968e55b7-bf02-4e33-88ff-b7f88181144e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:07.369149 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f051e2c0-a4fe-436a-b3ce-35ffb09601c1 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:07.369929 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f051e2c0-a4fe-436a-b3ce-35ffb09601c1 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:07.370826 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f051e2c0-a4fe-436a-b3ce-35ffb09601c1 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:07.371437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-968e55b7-bf02-4e33-88ff-b7f88181144e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:07.372168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f051e2c0-a4fe-436a-b3ce-35ffb09601c1 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:07.372791 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-968e55b7-bf02-4e33-88ff-b7f88181144e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:07.373408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f051e2c0-a4fe-436a-b3ce-35ffb09601c1 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:07.382496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:07.384411 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:07.667458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f051e2c0-a4fe-436a-b3ce-35ffb09601c1 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:07.679831 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f051e2c0-a4fe-436a-b3ce-35ffb09601c1 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0" status: 200 len: 1367 microversion: 2.1 time: 0.346865 Aug 04 17:13:07.685073 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2174/4277] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:07 2022] GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0 => generated 1367 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:07.710526 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-373b95cd-193c-4264-94cb-ccd7175dd55b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:07.711645 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-373b95cd-193c-4264-94cb-ccd7175dd55b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 84f1b438-b552-41c0-9e85-bb9021c44a2a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:07.715277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:07.721173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-373b95cd-193c-4264-94cb-ccd7175dd55b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:07.722513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-373b95cd-193c-4264-94cb-ccd7175dd55b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:07.723206 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-373b95cd-193c-4264-94cb-ccd7175dd55b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:07.724273 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-373b95cd-193c-4264-94cb-ccd7175dd55b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:07.724980 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-373b95cd-193c-4264-94cb-ccd7175dd55b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:07.725781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-373b95cd-193c-4264-94cb-ccd7175dd55b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:07.774995 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-968e55b7-bf02-4e33-88ff-b7f88181144e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:07.785460 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-968e55b7-bf02-4e33-88ff-b7f88181144e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85" status: 200 len: 1315 microversion: 2.1 time: 0.443805 Aug 04 17:13:07.787407 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2104/4278] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:07 2022] GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85 => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:07.792399 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-53f1eb07-84df-4ae7-8c00-4ea9eecb6472 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:07.802234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-53f1eb07-84df-4ae7-8c00-4ea9eecb6472 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:07.816312 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53f1eb07-84df-4ae7-8c00-4ea9eecb6472 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:07.819804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53f1eb07-84df-4ae7-8c00-4ea9eecb6472 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:07.820343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53f1eb07-84df-4ae7-8c00-4ea9eecb6472 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:07.821165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53f1eb07-84df-4ae7-8c00-4ea9eecb6472 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:07.821699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53f1eb07-84df-4ae7-8c00-4ea9eecb6472 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:07.822274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53f1eb07-84df-4ae7-8c00-4ea9eecb6472 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:08.030736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-373b95cd-193c-4264-94cb-ccd7175dd55b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:08.044228 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-373b95cd-193c-4264-94cb-ccd7175dd55b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a" status: 200 len: 1475 microversion: 2.1 time: 0.338359 Aug 04 17:13:08.047902 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2175/4279] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:07 2022] GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a => generated 1475 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:13:08.062229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c4d6abac-499b-49f5-9cf3-2e42e75ad1d3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:08.064142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c4d6abac-499b-49f5-9cf3-2e42e75ad1d3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:08.080322 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4d6abac-499b-49f5-9cf3-2e42e75ad1d3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:08.082625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4d6abac-499b-49f5-9cf3-2e42e75ad1d3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:08.083338 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4d6abac-499b-49f5-9cf3-2e42e75ad1d3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:08.087806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4d6abac-499b-49f5-9cf3-2e42e75ad1d3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:08.088636 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4d6abac-499b-49f5-9cf3-2e42e75ad1d3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:08.089289 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4d6abac-499b-49f5-9cf3-2e42e75ad1d3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:08.108830 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-53f1eb07-84df-4ae7-8c00-4ea9eecb6472 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:08.124438 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-53f1eb07-84df-4ae7-8c00-4ea9eecb6472 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1732 microversion: 2.1 time: 0.333317 Aug 04 17:13:08.125260 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2105/4280] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:07 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1732 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:08.187908 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c4d6abac-499b-49f5-9cf3-2e42e75ad1d3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:08.198546 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c4d6abac-499b-49f5-9cf3-2e42e75ad1d3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 200 len: 1605 microversion: 2.1 time: 0.147730 Aug 04 17:13:08.199380 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2176/4281] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:08 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 1605 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:08.267314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-4decbd0e-5912-42a2-97b6-004fc1d88d65 req-4293ea6d-32f2-4e9d-8c14-d312dad96938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8865e4da-4c6b-4f67-bfdc-547839d7dab3", "name": "network-vif-deleted", "tag": "e75f336b-22b2-4da1-8e13-8616b6b93832"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:08.283259 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4decbd0e-5912-42a2-97b6-004fc1d88d65 req-4293ea6d-32f2-4e9d-8c14-d312dad96938 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:08.283757 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4decbd0e-5912-42a2-97b6-004fc1d88d65 req-4293ea6d-32f2-4e9d-8c14-d312dad96938 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:08.286650 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4decbd0e-5912-42a2-97b6-004fc1d88d65 req-4293ea6d-32f2-4e9d-8c14-d312dad96938 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:08.318256 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-4decbd0e-5912-42a2-97b6-004fc1d88d65 req-4293ea6d-32f2-4e9d-8c14-d312dad96938 service nova] Creating event network-vif-deleted:e75f336b-22b2-4da1-8e13-8616b6b93832 for instance 8865e4da-4c6b-4f67-bfdc-547839d7dab3 on n-h2-851359-3 Aug 04 17:13:08.328574 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-4decbd0e-5912-42a2-97b6-004fc1d88d65 req-4293ea6d-32f2-4e9d-8c14-d312dad96938 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065259 Aug 04 17:13:08.331096 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2106/4282] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:13:08.355535 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-609b505b-ffae-43ea-8501-b522caf3ceca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-640817754", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:08.450228 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-609b505b-ffae-43ea-8501-b522caf3ceca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] validate_networks() for [('ec3b7b59-9fd4-4839-add6-43afeffa896c', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:13:08.705817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c8dfe9d0-4502-428f-96b3-d6261454e553 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:08.706746 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c8dfe9d0-4502-428f-96b3-d6261454e553 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: c75ee070-7154-4d00-add1-674bb1c4b2b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:08.722637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8dfe9d0-4502-428f-96b3-d6261454e553 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:08.723137 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8dfe9d0-4502-428f-96b3-d6261454e553 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:08.723587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8dfe9d0-4502-428f-96b3-d6261454e553 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:08.726097 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8dfe9d0-4502-428f-96b3-d6261454e553 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:08.727516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8dfe9d0-4502-428f-96b3-d6261454e553 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:08.727962 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8dfe9d0-4502-428f-96b3-d6261454e553 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:09.049102 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c8dfe9d0-4502-428f-96b3-d6261454e553 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:09.071535 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c8dfe9d0-4502-428f-96b3-d6261454e553 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0" status: 200 len: 1367 microversion: 2.1 time: 0.370516 Aug 04 17:13:09.081108 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2107/4283] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:08 2022] GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0 => generated 1367 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:13:09.093826 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-647c2d01-2d09-43c0-ad67-03186dfd8a0f req-f39599ce-93e4-4842-afe5-5051ee59236c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c75ee070-7154-4d00-add1-674bb1c4b2b0", "name": "network-vif-plugged", "status": "completed", "tag": "3a548778-fada-4b4d-96d6-d73cd5e7d8b5"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:09.109647 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-647c2d01-2d09-43c0-ad67-03186dfd8a0f req-f39599ce-93e4-4842-afe5-5051ee59236c service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:09.110184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-647c2d01-2d09-43c0-ad67-03186dfd8a0f req-f39599ce-93e4-4842-afe5-5051ee59236c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:09.110962 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-647c2d01-2d09-43c0-ad67-03186dfd8a0f req-f39599ce-93e4-4842-afe5-5051ee59236c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:09.124763 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-647c2d01-2d09-43c0-ad67-03186dfd8a0f req-f39599ce-93e4-4842-afe5-5051ee59236c service nova] Creating event network-vif-plugged:3a548778-fada-4b4d-96d6-d73cd5e7d8b5 for instance c75ee070-7154-4d00-add1-674bb1c4b2b0 on n-h2-851359-3 Aug 04 17:13:09.130617 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-647c2d01-2d09-43c0-ad67-03186dfd8a0f req-f39599ce-93e4-4842-afe5-5051ee59236c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048177 Aug 04 17:13:09.132218 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2108/4284] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:13:09.140153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-862aaa59-3c2f-4626-80ae-1083510bb2e2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:09.140995 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-862aaa59-3c2f-4626-80ae-1083510bb2e2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: eba6aa22-62ff-42e5-8401-f02b23ffeb85] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:09.150385 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-862aaa59-3c2f-4626-80ae-1083510bb2e2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:09.150899 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-862aaa59-3c2f-4626-80ae-1083510bb2e2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:09.151479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-862aaa59-3c2f-4626-80ae-1083510bb2e2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:09.152441 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-862aaa59-3c2f-4626-80ae-1083510bb2e2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:09.153080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-862aaa59-3c2f-4626-80ae-1083510bb2e2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:09.153657 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-862aaa59-3c2f-4626-80ae-1083510bb2e2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:09.344616 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-609b505b-ffae-43ea-8501-b522caf3ceca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:13:09.344786 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-609b505b-ffae-43ea-8501-b522caf3ceca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:13:09.348090 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-609b505b-ffae-43ea-8501-b522caf3ceca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:13:09.348541 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-609b505b-ffae-43ea-8501-b522caf3ceca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:13:09.348976 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-609b505b-ffae-43ea-8501-b522caf3ceca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:13:09.367177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-609b505b-ffae-43ea-8501-b522caf3ceca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:09.370881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-609b505b-ffae-43ea-8501-b522caf3ceca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:09.371856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-609b505b-ffae-43ea-8501-b522caf3ceca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:09.372688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-609b505b-ffae-43ea-8501-b522caf3ceca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:09.373171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-609b505b-ffae-43ea-8501-b522caf3ceca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:09.373610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-609b505b-ffae-43ea-8501-b522caf3ceca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:09.407689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-609b505b-ffae-43ea-8501-b522caf3ceca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Getting quotas for project d9911aeb77cd4ffb8c4e539998a04f3c. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:13:09.419773 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-609b505b-ffae-43ea-8501-b522caf3ceca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Getting quotas for user 8e840d06bb5d44e097e6f0855b04cb06 and project d9911aeb77cd4ffb8c4e539998a04f3c. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:13:09.426479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-862aaa59-3c2f-4626-80ae-1083510bb2e2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:09.440103 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-862aaa59-3c2f-4626-80ae-1083510bb2e2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85" status: 200 len: 1315 microversion: 2.1 time: 0.305153 Aug 04 17:13:09.442653 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2109/4285] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:09 2022] GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85 => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:09.447931 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cf291283-32e6-4b71-b213-3b9a093206e4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:09.448754 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cf291283-32e6-4b71-b213-3b9a093206e4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:09.452285 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-609b505b-ffae-43ea-8501-b522caf3ceca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:13:09.460561 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf291283-32e6-4b71-b213-3b9a093206e4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:09.461342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf291283-32e6-4b71-b213-3b9a093206e4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:09.462059 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf291283-32e6-4b71-b213-3b9a093206e4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:09.463079 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf291283-32e6-4b71-b213-3b9a093206e4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:09.463808 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-609b505b-ffae-43ea-8501-b522caf3ceca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b7b3bed5-42ad-41df-a974-1be65d77ea0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:13:09.464398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf291283-32e6-4b71-b213-3b9a093206e4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:09.468864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf291283-32e6-4b71-b213-3b9a093206e4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:09.508445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-cf291283-32e6-4b71-b213-3b9a093206e4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lazy-loading 'flavor' on Instance uuid 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:13:09.565816 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-609b505b-ffae-43ea-8501-b522caf3ceca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.213111 Aug 04 17:13:09.577021 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2177/4286] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:13:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 17:13:09.591086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a23a8502-a11c-4076-9614-e08d8c74a633 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:09.592712 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a23a8502-a11c-4076-9614-e08d8c74a633 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:09.606798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a23a8502-a11c-4076-9614-e08d8c74a633 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:09.608124 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a23a8502-a11c-4076-9614-e08d8c74a633 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:09.616827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a23a8502-a11c-4076-9614-e08d8c74a633 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:09.618463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a23a8502-a11c-4076-9614-e08d8c74a633 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:09.619531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a23a8502-a11c-4076-9614-e08d8c74a633 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:09.620228 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a23a8502-a11c-4076-9614-e08d8c74a633 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:09.854441 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cf291283-32e6-4b71-b213-3b9a093206e4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "POST /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d/action" status: 202 len: 0 microversion: 2.20 time: 0.409783 Aug 04 17:13:09.855279 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2110/4287] 10.222.0.93 () {62 vars in 1319 bytes} [Thu Aug 4 17:13:09 2022] POST /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:13:09.867861 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-417aa843-f679-4f39-acd1-2e6f1a84cb9e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:09.872043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-417aa843-f679-4f39-acd1-2e6f1a84cb9e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:09.887578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-417aa843-f679-4f39-acd1-2e6f1a84cb9e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:09.888553 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-417aa843-f679-4f39-acd1-2e6f1a84cb9e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:09.889214 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-417aa843-f679-4f39-acd1-2e6f1a84cb9e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:09.890894 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-417aa843-f679-4f39-acd1-2e6f1a84cb9e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:09.892016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-417aa843-f679-4f39-acd1-2e6f1a84cb9e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:09.892449 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-417aa843-f679-4f39-acd1-2e6f1a84cb9e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:09.909799 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-417aa843-f679-4f39-acd1-2e6f1a84cb9e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] HTTP exception thrown: Instance 8865e4da-4c6b-4f67-bfdc-547839d7dab3 could not be found. Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-417aa843-f679-4f39-acd1-2e6f1a84cb9e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Request method failure captured: Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 HTTP/1.1 Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_zGCdsK5fTsJNuSOUxSWg-YTj1-lII6Z7pJ8BanEAMuYJecZRZb3pZbwuZ0In05o4XEYRTqt5hpx76W80TGbjmNpJfL5k9fXLc--Ib8YV9bL_XUOa3XoP2TnhEkLLeANN5OpwDqQFpjdtiXXvU36x8KyTPlzTPWEPSqKrOwevSP5rs Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 1765b9e2226349c5a88f4bc75f8d1029 Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-AttachVolumeTestJSON-1568891137 Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1765b9e2226349c5a88f4bc75f8d1029"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1765b9e2226349c5a88f4bc75f8d1029"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1765b9e2226349c5a88f4bc75f8d1029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1765b9e2226349c5a88f4bc75f8d1029"}]}] Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-AttachVolumeTestJSON-1568891137 Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 1765b9e2226349c5a88f4bc75f8d1029 Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1568891137 Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-AttachVolumeTestJSON-1568891137-project Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 810ad146d8cc4192a3ae68c58ed84d2b Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-AttachVolumeTestJSON-1568891137-project Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 8865e4da-4c6b-4f67-bfdc-547839d7dab3 could not be found. Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '8865e4da-4c6b-4f67-bfdc-547839d7dab3'} Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8865e4da-4c6b-4f67-bfdc-547839d7dab3 could not be found. Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8865e4da-4c6b-4f67-bfdc-547839d7dab3 could not be found. Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:13:09.911821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:13:09.915977 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:13:09.915977 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:13:09.915977 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:13:09.915977 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:13:09.915977 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:13:09.915977 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8865e4da-4c6b-4f67-bfdc-547839d7dab3 could not be found. Aug 04 17:13:09.915977 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:13:09.915977 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-417aa843-f679-4f39-acd1-2e6f1a84cb9e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Returning 404 to user: Instance 8865e4da-4c6b-4f67-bfdc-547839d7dab3 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:13:09.915977 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-417aa843-f679-4f39-acd1-2e6f1a84cb9e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 404 len: 111 microversion: 2.1 time: 0.056497 Aug 04 17:13:09.918157 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2111/4288] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:09 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:13:09.923430 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ae301d1d-057a-4877-89d7-317ad20a7435 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:09.923936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ae301d1d-057a-4877-89d7-317ad20a7435 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b7b3bed5-42ad-41df-a974-1be65d77ea0e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:09.945966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ae301d1d-057a-4877-89d7-317ad20a7435 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b7b3bed5-42ad-41df-a974-1be65d77ea0e] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:13:10.127126 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a23a8502-a11c-4076-9614-e08d8c74a633 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:10.138674 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a23a8502-a11c-4076-9614-e08d8c74a633 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1732 microversion: 2.1 time: 0.560066 Aug 04 17:13:10.139273 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2178/4289] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:09 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1732 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:10.156167 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ddfb98e5-6de7-4e62-8a8f-64f0277b5d8c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:10.160309 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ddfb98e5-6de7-4e62-8a8f-64f0277b5d8c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:10.169292 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ddfb98e5-6de7-4e62-8a8f-64f0277b5d8c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:10.169797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ddfb98e5-6de7-4e62-8a8f-64f0277b5d8c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:10.174801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ddfb98e5-6de7-4e62-8a8f-64f0277b5d8c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:10.175788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ddfb98e5-6de7-4e62-8a8f-64f0277b5d8c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:10.178624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ddfb98e5-6de7-4e62-8a8f-64f0277b5d8c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:10.179247 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ddfb98e5-6de7-4e62-8a8f-64f0277b5d8c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:10.388808 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.scheduler.client.report [None req-ae301d1d-057a-4877-89d7-317ad20a7435 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Deleted allocations for instance b7b3bed5-42ad-41df-a974-1be65d77ea0e Aug 04 17:13:10.394611 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.compute.api [None req-ae301d1d-057a-4877-89d7-317ad20a7435 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b7b3bed5-42ad-41df-a974-1be65d77ea0e] Instance Mapping does not exist while attempting local delete cleanup. Aug 04 17:13:10.395689 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ae301d1d-057a-4877-89d7-317ad20a7435 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b7b3bed5-42ad-41df-a974-1be65d77ea0e" status: 204 len: 0 microversion: 2.1 time: 0.476421 Aug 04 17:13:10.396604 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2112/4290] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:13:09 2022] DELETE /compute/v2.1/servers/b7b3bed5-42ad-41df-a974-1be65d77ea0e => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:13:10.410859 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a5cb6b25-bd1d-4c5b-bea0-5d24124fe5d2 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '.version_select at 0x7f1e6814e9d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:10.468686 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a5cb6b25-bd1d-4c5b-bea0-5d24124fe5d2 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1853399408" status: 202 len: 0 microversion: 2.1 time: 0.071034 Aug 04 17:13:10.470162 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2113/4291] 10.222.0.93 () {58 vars in 1221 bytes} [Thu Aug 4 17:13:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1853399408 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:13:10.474983 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-617091a8-b2f4-4447-9dac-a1cc24ab1408 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:10.483024 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-617091a8-b2f4-4447-9dac-a1cc24ab1408 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: c75ee070-7154-4d00-add1-674bb1c4b2b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:10.485858 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:10.494113 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-617091a8-b2f4-4447-9dac-a1cc24ab1408 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:10.494471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-617091a8-b2f4-4447-9dac-a1cc24ab1408 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:10.494916 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-617091a8-b2f4-4447-9dac-a1cc24ab1408 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:10.495629 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-617091a8-b2f4-4447-9dac-a1cc24ab1408 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:10.496105 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-617091a8-b2f4-4447-9dac-a1cc24ab1408 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:10.496524 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-617091a8-b2f4-4447-9dac-a1cc24ab1408 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:10.634952 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:10.640236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ddfb98e5-6de7-4e62-8a8f-64f0277b5d8c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:10.658498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ddfb98e5-6de7-4e62-8a8f-64f0277b5d8c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:10.662396 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ddfb98e5-6de7-4e62-8a8f-64f0277b5d8c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:10.665561 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ddfb98e5-6de7-4e62-8a8f-64f0277b5d8c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1724 microversion: 2.20 time: 0.524649 Aug 04 17:13:10.667378 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2179/4292] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:13:10 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1724 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:13:10.673577 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5a619a49-d1da-4e22-ab47-130fad3338b2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:10.674815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5a619a49-d1da-4e22-ab47-130fad3338b2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b7b3bed5-42ad-41df-a974-1be65d77ea0e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:10.683359 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-5a619a49-d1da-4e22-ab47-130fad3338b2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] HTTP exception thrown: Instance b7b3bed5-42ad-41df-a974-1be65d77ea0e could not be found. Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5a619a49-d1da-4e22-ab47-130fad3338b2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Request method failure captured: Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/b7b3bed5-42ad-41df-a974-1be65d77ea0e HTTP/1.1 Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_4PiXAoqFPCXVrtw_fcVtbWCRHCRY1BcfprLEe-EkZEFmD3rLGum9OIJcRnH-o3xr4k8T7yl4V2Hv5h2fEBByVUFBw2XIbz_i_ncVR1MMvkDEp1AvjPEGXUtr2hnsv9JoWINOTj84eRxq_Gac5VyTIxXMDaWbVLw5VeWNnbunOt5QM Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d9911aeb77cd4ffb8c4e539998a04f3c"}]}] Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersTestJSON-1653035612 Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersTestJSON-1653035612-project Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 8e840d06bb5d44e097e6f0855b04cb06 Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersTestJSON-1653035612-project Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance b7b3bed5-42ad-41df-a974-1be65d77ea0e could not be found. Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'b7b3bed5-42ad-41df-a974-1be65d77ea0e'} Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7b3bed5-42ad-41df-a974-1be65d77ea0e could not be found. Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7b3bed5-42ad-41df-a974-1be65d77ea0e could not be found. Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:13:10.685148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:13:10.688499 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:13:10.688499 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:13:10.688499 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:13:10.688499 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7b3bed5-42ad-41df-a974-1be65d77ea0e could not be found. Aug 04 17:13:10.688499 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:13:10.688499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5a619a49-d1da-4e22-ab47-130fad3338b2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Returning 404 to user: Instance b7b3bed5-42ad-41df-a974-1be65d77ea0e could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:13:10.688499 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5a619a49-d1da-4e22-ab47-130fad3338b2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/b7b3bed5-42ad-41df-a974-1be65d77ea0e" status: 404 len: 111 microversion: 2.1 time: 0.019543 Aug 04 17:13:10.690546 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2180/4293] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:10 2022] GET /compute/v2.1/servers/b7b3bed5-42ad-41df-a974-1be65d77ea0e => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:13:10.697204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a8e50afc-6c6e-472e-9282-245aec7ae980 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:10.698431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a8e50afc-6c6e-472e-9282-245aec7ae980 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: eba6aa22-62ff-42e5-8401-f02b23ffeb85] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:10.714458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8e50afc-6c6e-472e-9282-245aec7ae980 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:10.715409 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8e50afc-6c6e-472e-9282-245aec7ae980 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:10.716279 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8e50afc-6c6e-472e-9282-245aec7ae980 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:10.717964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8e50afc-6c6e-472e-9282-245aec7ae980 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:10.718811 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8e50afc-6c6e-472e-9282-245aec7ae980 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:10.720027 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8e50afc-6c6e-472e-9282-245aec7ae980 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:10.915237 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-617091a8-b2f4-4447-9dac-a1cc24ab1408 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:10.943449 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-617091a8-b2f4-4447-9dac-a1cc24ab1408 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0" status: 200 len: 1367 microversion: 2.1 time: 0.470999 Aug 04 17:13:10.946449 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2114/4294] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:10 2022] GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0 => generated 1367 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:10.963647 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-12a429c6-ae60-4ffc-94e0-5c11de78de4b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-329018530", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "ec3b7b59-9fd4-4839-add6-43afeffa896c"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:11.039145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-12a429c6-ae60-4ffc-94e0-5c11de78de4b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] validate_networks() for [('ec3b7b59-9fd4-4839-add6-43afeffa896c', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:13:11.269774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a8e50afc-6c6e-472e-9282-245aec7ae980 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:11.279677 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a8e50afc-6c6e-472e-9282-245aec7ae980 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85" status: 200 len: 1315 microversion: 2.1 time: 0.588481 Aug 04 17:13:11.280231 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2181/4295] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:10 2022] GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85 => generated 1315 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:11.287274 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6a4c54c8-19f1-4da1-8d62-3e02804920bc tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:11.288293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6a4c54c8-19f1-4da1-8d62-3e02804920bc tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:11.295216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a4c54c8-19f1-4da1-8d62-3e02804920bc tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:11.295743 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a4c54c8-19f1-4da1-8d62-3e02804920bc tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:11.296188 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a4c54c8-19f1-4da1-8d62-3e02804920bc tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:11.297001 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a4c54c8-19f1-4da1-8d62-3e02804920bc tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:11.298203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a4c54c8-19f1-4da1-8d62-3e02804920bc tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:11.298653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a4c54c8-19f1-4da1-8d62-3e02804920bc tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:11.636325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6a4c54c8-19f1-4da1-8d62-3e02804920bc tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:11.655157 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6a4c54c8-19f1-4da1-8d62-3e02804920bc tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1732 microversion: 2.1 time: 0.372978 Aug 04 17:13:11.655915 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2182/4296] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:11 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1732 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:11.661358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-32c43ba7-b940-44fb-8a58-5ff99ff0716d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Action: 'create', calling method: .version_select at 0x7f1e5b9d8310>, body: {"keypair": {"name": "tempest-keypair-2443255", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPI7iw906LV9sHKqsdhmcMuW5N4DlnqKhVbKiWRxP2GkuYz5Bi6IEmcTiG/fPPNlOEzszj8t80zV9288W9zPEwCYOQH9VtlnAaPVOSGJztY/VLcPqvgn5ywNECPiQCj/tQ=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:11.694467 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-32c43ba7-b940-44fb-8a58-5ff99ff0716d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Getting quotas for project 1765b9e2226349c5a88f4bc75f8d1029. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:13:11.700677 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-32c43ba7-b940-44fb-8a58-5ff99ff0716d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Getting quotas for user 810ad146d8cc4192a3ae68c58ed84d2b and project 1765b9e2226349c5a88f4bc75f8d1029. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:13:11.734885 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-32c43ba7-b940-44fb-8a58-5ff99ff0716d tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.077090 Aug 04 17:13:11.736144 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2183/4297] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:13:11 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:13:11.742950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cb9666af-0af4-45d3-83f4-342f9f404456 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:11.743732 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cb9666af-0af4-45d3-83f4-342f9f404456 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:11.754789 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb9666af-0af4-45d3-83f4-342f9f404456 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:11.755457 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb9666af-0af4-45d3-83f4-342f9f404456 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:11.756021 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb9666af-0af4-45d3-83f4-342f9f404456 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:11.757002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb9666af-0af4-45d3-83f4-342f9f404456 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:11.757624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb9666af-0af4-45d3-83f4-342f9f404456 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:11.758209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb9666af-0af4-45d3-83f4-342f9f404456 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:12.079392 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-12a429c6-ae60-4ffc-94e0-5c11de78de4b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:13:12.080559 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-12a429c6-ae60-4ffc-94e0-5c11de78de4b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:13:12.081239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-12a429c6-ae60-4ffc-94e0-5c11de78de4b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:13:12.082234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-12a429c6-ae60-4ffc-94e0-5c11de78de4b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:13:12.083293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-12a429c6-ae60-4ffc-94e0-5c11de78de4b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:13:12.105257 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12a429c6-ae60-4ffc-94e0-5c11de78de4b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:12.105830 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12a429c6-ae60-4ffc-94e0-5c11de78de4b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:12.107104 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12a429c6-ae60-4ffc-94e0-5c11de78de4b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:12.107927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12a429c6-ae60-4ffc-94e0-5c11de78de4b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:12.108201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cb9666af-0af4-45d3-83f4-342f9f404456 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:12.109651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12a429c6-ae60-4ffc-94e0-5c11de78de4b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:12.110664 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12a429c6-ae60-4ffc-94e0-5c11de78de4b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:12.122336 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cb9666af-0af4-45d3-83f4-342f9f404456 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:12.127716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cb9666af-0af4-45d3-83f4-342f9f404456 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:12.131935 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cb9666af-0af4-45d3-83f4-342f9f404456 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1724 microversion: 2.20 time: 0.391817 Aug 04 17:13:12.131935 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2184/4298] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:13:11 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1724 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:13:12.143358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-631a1a00-f412-4f8d-ba30-cb68a2cbabd8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:12.144008 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-631a1a00-f412-4f8d-ba30-cb68a2cbabd8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: c75ee070-7154-4d00-add1-674bb1c4b2b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:12.165179 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-631a1a00-f412-4f8d-ba30-cb68a2cbabd8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:12.166950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-631a1a00-f412-4f8d-ba30-cb68a2cbabd8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:12.168085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-631a1a00-f412-4f8d-ba30-cb68a2cbabd8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:12.168853 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-631a1a00-f412-4f8d-ba30-cb68a2cbabd8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:12.169329 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-631a1a00-f412-4f8d-ba30-cb68a2cbabd8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:12.169776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-631a1a00-f412-4f8d-ba30-cb68a2cbabd8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:12.170476 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-12a429c6-ae60-4ffc-94e0-5c11de78de4b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Getting quotas for project d9911aeb77cd4ffb8c4e539998a04f3c. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:13:12.183153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-12a429c6-ae60-4ffc-94e0-5c11de78de4b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Getting quotas for user 8e840d06bb5d44e097e6f0855b04cb06 and project d9911aeb77cd4ffb8c4e539998a04f3c. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:13:12.203525 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-12a429c6-ae60-4ffc-94e0-5c11de78de4b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:13:12.207130 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-12a429c6-ae60-4ffc-94e0-5c11de78de4b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 4b23ac31-0eda-4b24-b7ce-ed874fe75f90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:13:12.281818 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-12a429c6-ae60-4ffc-94e0-5c11de78de4b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.333997 Aug 04 17:13:12.293677 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2115/4299] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:13:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1346 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:13:12.318226 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-66ddd657-7cce-49e5-a1f8-437d69d1b5a3 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:12.331275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-66ddd657-7cce-49e5-a1f8-437d69d1b5a3 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 4b23ac31-0eda-4b24-b7ce-ed874fe75f90] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:12.465888 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-66ddd657-7cce-49e5-a1f8-437d69d1b5a3 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:12.478069 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-66ddd657-7cce-49e5-a1f8-437d69d1b5a3 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90" status: 200 len: 1220 microversion: 2.1 time: 0.182141 Aug 04 17:13:12.479342 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2116/4300] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:12 2022] GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90 => generated 1220 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:12.486431 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-567665c3-1f09-433b-afb5-50fcf3cb8c67 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:12.487832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-567665c3-1f09-433b-afb5-50fcf3cb8c67 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: eba6aa22-62ff-42e5-8401-f02b23ffeb85] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:12.496535 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-567665c3-1f09-433b-afb5-50fcf3cb8c67 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:12.497740 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-567665c3-1f09-433b-afb5-50fcf3cb8c67 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:12.498448 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-567665c3-1f09-433b-afb5-50fcf3cb8c67 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:12.499360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-567665c3-1f09-433b-afb5-50fcf3cb8c67 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:12.500235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-567665c3-1f09-433b-afb5-50fcf3cb8c67 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:12.502691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-567665c3-1f09-433b-afb5-50fcf3cb8c67 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:12.554838 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-631a1a00-f412-4f8d-ba30-cb68a2cbabd8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:12.580255 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-631a1a00-f412-4f8d-ba30-cb68a2cbabd8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0" status: 200 len: 1557 microversion: 2.1 time: 0.446279 Aug 04 17:13:12.584338 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2185/4301] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:12 2022] GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0 => generated 1557 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:12.617780 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dfbdd80c-c253-44ca-9231-09f8150dedba tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:12.618348 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dfbdd80c-c253-44ca-9231-09f8150dedba tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: c75ee070-7154-4d00-add1-674bb1c4b2b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:12.637587 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfbdd80c-c253-44ca-9231-09f8150dedba tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:12.638300 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfbdd80c-c253-44ca-9231-09f8150dedba tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:12.638743 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfbdd80c-c253-44ca-9231-09f8150dedba tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:12.639816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfbdd80c-c253-44ca-9231-09f8150dedba tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:12.640603 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfbdd80c-c253-44ca-9231-09f8150dedba tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:12.642071 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfbdd80c-c253-44ca-9231-09f8150dedba tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:12.870331 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dfbdd80c-c253-44ca-9231-09f8150dedba tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.264652 Aug 04 17:13:12.871233 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2186/4302] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Aug 4 17:13:12 2022] GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0/os-interface => generated 285 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:13:12.884731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-abfbd6dd-3dcf-449d-bfe5-58b3aa74c32c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:12.885015 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-abfbd6dd-3dcf-449d-bfe5-58b3aa74c32c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:12.891848 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-abfbd6dd-3dcf-449d-bfe5-58b3aa74c32c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:12.892354 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-abfbd6dd-3dcf-449d-bfe5-58b3aa74c32c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:12.892801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-abfbd6dd-3dcf-449d-bfe5-58b3aa74c32c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:12.893768 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-abfbd6dd-3dcf-449d-bfe5-58b3aa74c32c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:12.894311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-abfbd6dd-3dcf-449d-bfe5-58b3aa74c32c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:12.894762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-abfbd6dd-3dcf-449d-bfe5-58b3aa74c32c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:12.931136 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-567665c3-1f09-433b-afb5-50fcf3cb8c67 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:12.942562 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-567665c3-1f09-433b-afb5-50fcf3cb8c67 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85" status: 200 len: 1315 microversion: 2.1 time: 0.461759 Aug 04 17:13:12.943159 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2117/4303] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:12 2022] GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85 => generated 1315 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:12.965147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-d6981712-b492-4b6a-bbf4-ff2452ea1acb req-56bc6cb9-d68f-42ec-b966-3092e5f8c738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eba6aa22-62ff-42e5-8401-f02b23ffeb85", "name": "network-vif-plugged", "status": "completed", "tag": "f347cd22-db0b-4a20-abd4-efe2343e7d90"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:12.980689 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d6981712-b492-4b6a-bbf4-ff2452ea1acb req-56bc6cb9-d68f-42ec-b966-3092e5f8c738 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:12.981465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d6981712-b492-4b6a-bbf4-ff2452ea1acb req-56bc6cb9-d68f-42ec-b966-3092e5f8c738 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:12.982279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d6981712-b492-4b6a-bbf4-ff2452ea1acb req-56bc6cb9-d68f-42ec-b966-3092e5f8c738 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:13.002510 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-d6981712-b492-4b6a-bbf4-ff2452ea1acb req-56bc6cb9-d68f-42ec-b966-3092e5f8c738 service nova] Creating event network-vif-plugged:f347cd22-db0b-4a20-abd4-efe2343e7d90 for instance eba6aa22-62ff-42e5-8401-f02b23ffeb85 on n-h1-851359-3 Aug 04 17:13:13.012148 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-d6981712-b492-4b6a-bbf4-ff2452ea1acb req-56bc6cb9-d68f-42ec-b966-3092e5f8c738 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055325 Aug 04 17:13:13.018138 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2118/4304] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:13:13.160688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d1bccef4-8f08-49c7-9a55-99140e4d94fc tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:13.162443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d1bccef4-8f08-49c7-9a55-99140e4d94fc tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:13.177760 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1bccef4-8f08-49c7-9a55-99140e4d94fc tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:13.178492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-abfbd6dd-3dcf-449d-bfe5-58b3aa74c32c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:13.180671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1bccef4-8f08-49c7-9a55-99140e4d94fc tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:13.182782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1bccef4-8f08-49c7-9a55-99140e4d94fc tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:13.184260 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1bccef4-8f08-49c7-9a55-99140e4d94fc tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:13.185945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1bccef4-8f08-49c7-9a55-99140e4d94fc tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:13.187187 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1bccef4-8f08-49c7-9a55-99140e4d94fc tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:13.191199 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-abfbd6dd-3dcf-449d-bfe5-58b3aa74c32c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1732 microversion: 2.1 time: 0.310468 Aug 04 17:13:13.191802 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2187/4305] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:12 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1732 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:13.495601 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d1bccef4-8f08-49c7-9a55-99140e4d94fc tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:13.508879 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-edd870e9-bda6-4ab9-bd04-308acd0dbe51 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:13.509737 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-edd870e9-bda6-4ab9-bd04-308acd0dbe51 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 4b23ac31-0eda-4b24-b7ce-ed874fe75f90] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:13.510252 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d1bccef4-8f08-49c7-9a55-99140e4d94fc tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:13.511944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d1bccef4-8f08-49c7-9a55-99140e4d94fc tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:13.513199 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d1bccef4-8f08-49c7-9a55-99140e4d94fc tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1724 microversion: 2.20 time: 0.357972 Aug 04 17:13:13.513770 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2119/4306] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:13:13 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1724 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:13:13.525909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-edd870e9-bda6-4ab9-bd04-308acd0dbe51 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:13.526561 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-edd870e9-bda6-4ab9-bd04-308acd0dbe51 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:13.530780 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-edd870e9-bda6-4ab9-bd04-308acd0dbe51 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:13.532737 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-edd870e9-bda6-4ab9-bd04-308acd0dbe51 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:13.539181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-edd870e9-bda6-4ab9-bd04-308acd0dbe51 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:13.539738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-edd870e9-bda6-4ab9-bd04-308acd0dbe51 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:13.803462 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-edd870e9-bda6-4ab9-bd04-308acd0dbe51 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:13.817549 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-edd870e9-bda6-4ab9-bd04-308acd0dbe51 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90" status: 200 len: 1216 microversion: 2.1 time: 0.313462 Aug 04 17:13:13.821090 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2188/4307] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:13 2022] GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90 => generated 1216 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:13:13.969863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5c5f1334-c1f5-49b8-92de-0730e2c6b29e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:13.970863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5c5f1334-c1f5-49b8-92de-0730e2c6b29e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: eba6aa22-62ff-42e5-8401-f02b23ffeb85] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:13.980486 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c5f1334-c1f5-49b8-92de-0730e2c6b29e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:13.981324 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c5f1334-c1f5-49b8-92de-0730e2c6b29e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:13.982165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c5f1334-c1f5-49b8-92de-0730e2c6b29e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:13.983330 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c5f1334-c1f5-49b8-92de-0730e2c6b29e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:13.984030 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c5f1334-c1f5-49b8-92de-0730e2c6b29e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:13.986241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c5f1334-c1f5-49b8-92de-0730e2c6b29e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:14.217634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-38f28b72-0346-4918-ad3d-092ebb0959f0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:14.218553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-38f28b72-0346-4918-ad3d-092ebb0959f0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:14.227759 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38f28b72-0346-4918-ad3d-092ebb0959f0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:14.228658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38f28b72-0346-4918-ad3d-092ebb0959f0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:14.229344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38f28b72-0346-4918-ad3d-092ebb0959f0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:14.231067 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38f28b72-0346-4918-ad3d-092ebb0959f0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:14.231804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38f28b72-0346-4918-ad3d-092ebb0959f0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:14.232462 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38f28b72-0346-4918-ad3d-092ebb0959f0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:14.577159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5c5f1334-c1f5-49b8-92de-0730e2c6b29e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:14.586524 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5c5f1334-c1f5-49b8-92de-0730e2c6b29e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85" status: 200 len: 1315 microversion: 2.1 time: 0.622133 Aug 04 17:13:14.593959 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2120/4308] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:13 2022] GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85 => generated 1315 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:14.610389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4b2f7543-5f65-4ae9-a9d3-7f28369d7953 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:14.611188 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4b2f7543-5f65-4ae9-a9d3-7f28369d7953 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:14.618266 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b2f7543-5f65-4ae9-a9d3-7f28369d7953 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:14.618896 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b2f7543-5f65-4ae9-a9d3-7f28369d7953 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:14.619393 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b2f7543-5f65-4ae9-a9d3-7f28369d7953 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:14.620163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b2f7543-5f65-4ae9-a9d3-7f28369d7953 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:14.620786 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b2f7543-5f65-4ae9-a9d3-7f28369d7953 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:14.621379 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b2f7543-5f65-4ae9-a9d3-7f28369d7953 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:14.692928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-38f28b72-0346-4918-ad3d-092ebb0959f0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:14.705252 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-38f28b72-0346-4918-ad3d-092ebb0959f0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1732 microversion: 2.1 time: 0.492658 Aug 04 17:13:14.705961 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2189/4309] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:14 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1732 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:14.846904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4076da1b-3481-4ce8-92ea-b3031720eb69 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:14.847683 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4076da1b-3481-4ce8-92ea-b3031720eb69 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 4b23ac31-0eda-4b24-b7ce-ed874fe75f90] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:14.855147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4076da1b-3481-4ce8-92ea-b3031720eb69 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:14.856004 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4076da1b-3481-4ce8-92ea-b3031720eb69 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:14.856546 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4076da1b-3481-4ce8-92ea-b3031720eb69 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:14.857479 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4076da1b-3481-4ce8-92ea-b3031720eb69 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:14.858195 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4076da1b-3481-4ce8-92ea-b3031720eb69 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:14.858965 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4076da1b-3481-4ce8-92ea-b3031720eb69 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:14.921886 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4b2f7543-5f65-4ae9-a9d3-7f28369d7953 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:14.930709 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4b2f7543-5f65-4ae9-a9d3-7f28369d7953 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:14.932412 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4b2f7543-5f65-4ae9-a9d3-7f28369d7953 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:14.933814 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4b2f7543-5f65-4ae9-a9d3-7f28369d7953 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1724 microversion: 2.20 time: 0.337980 Aug 04 17:13:14.934486 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2121/4310] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:13:14 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1724 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:13:14.966901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4076da1b-3481-4ce8-92ea-b3031720eb69 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:14.975094 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4076da1b-3481-4ce8-92ea-b3031720eb69 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90" status: 200 len: 1272 microversion: 2.1 time: 0.132775 Aug 04 17:13:14.976004 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2190/4311] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:14 2022] GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90 => generated 1272 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:15.377733 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e9cd4842-3424-4ef6-b77d-a0d0cd735c0c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1627545836", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8402fb52-79f8-43d0-ac17-929a052b62e0"}], "security_groups": [{"name": "tempest-securitygroup--819552830"}], "key_name": "tempest-keypair-2443255", "user_data": "}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:15.606131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-e9cd4842-3424-4ef6-b77d-a0d0cd735c0c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] validate_networks() for [('8402fb52-79f8-43d0-ac17-929a052b62e0', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:13:15.620172 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-477a6734-4316-4ece-8ba0-c7aaf808d4a2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:15.620839 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-477a6734-4316-4ece-8ba0-c7aaf808d4a2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: eba6aa22-62ff-42e5-8401-f02b23ffeb85] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:15.641048 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-477a6734-4316-4ece-8ba0-c7aaf808d4a2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:15.644111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-477a6734-4316-4ece-8ba0-c7aaf808d4a2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:15.647278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-477a6734-4316-4ece-8ba0-c7aaf808d4a2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:15.648094 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-477a6734-4316-4ece-8ba0-c7aaf808d4a2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:15.648636 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-477a6734-4316-4ece-8ba0-c7aaf808d4a2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:15.650583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-477a6734-4316-4ece-8ba0-c7aaf808d4a2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:16.074745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-477a6734-4316-4ece-8ba0-c7aaf808d4a2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:16.087002 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-477a6734-4316-4ece-8ba0-c7aaf808d4a2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85" status: 200 len: 1502 microversion: 2.1 time: 0.470865 Aug 04 17:13:16.102328 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2191/4312] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:15 2022] GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85 => generated 1502 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:13:16.107502 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a337fa60-556c-4545-9603-f9d5ec9fd51e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:16.108160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a337fa60-556c-4545-9603-f9d5ec9fd51e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:16.137527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a337fa60-556c-4545-9603-f9d5ec9fd51e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:16.138278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a337fa60-556c-4545-9603-f9d5ec9fd51e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:16.138890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a337fa60-556c-4545-9603-f9d5ec9fd51e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:16.139845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a337fa60-556c-4545-9603-f9d5ec9fd51e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:16.140495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a337fa60-556c-4545-9603-f9d5ec9fd51e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:16.141168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a337fa60-556c-4545-9603-f9d5ec9fd51e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:16.796599 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a337fa60-556c-4545-9603-f9d5ec9fd51e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:16.811050 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a337fa60-556c-4545-9603-f9d5ec9fd51e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1732 microversion: 2.1 time: 0.707474 Aug 04 17:13:16.819239 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2192/4313] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:16 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1732 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:16.824442 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-14e32af2-f166-414f-80cf-72d45205627a req-6b64dfb2-2600-4a73-b670-febe25c829b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c75ee070-7154-4d00-add1-674bb1c4b2b0", "tag": "3a548778-fada-4b4d-96d6-d73cd5e7d8b5"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:16.871067 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-14e32af2-f166-414f-80cf-72d45205627a req-6b64dfb2-2600-4a73-b670-febe25c829b0 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:16.871739 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-14e32af2-f166-414f-80cf-72d45205627a req-6b64dfb2-2600-4a73-b670-febe25c829b0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:16.872335 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-14e32af2-f166-414f-80cf-72d45205627a req-6b64dfb2-2600-4a73-b670-febe25c829b0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:16.893212 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-14e32af2-f166-414f-80cf-72d45205627a req-6b64dfb2-2600-4a73-b670-febe25c829b0 service nova] Creating event network-changed:3a548778-fada-4b4d-96d6-d73cd5e7d8b5 for instance c75ee070-7154-4d00-add1-674bb1c4b2b0 on n-h2-851359-3 Aug 04 17:13:16.903260 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-14e32af2-f166-414f-80cf-72d45205627a req-6b64dfb2-2600-4a73-b670-febe25c829b0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081720 Aug 04 17:13:16.912218 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2193/4314] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:13:16.922962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2f692f02-5c84-4ae7-8150-560793f058bb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:16.924235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2f692f02-5c84-4ae7-8150-560793f058bb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:16.942063 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f692f02-5c84-4ae7-8150-560793f058bb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:16.942812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f692f02-5c84-4ae7-8150-560793f058bb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:16.943449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f692f02-5c84-4ae7-8150-560793f058bb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:16.944328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f692f02-5c84-4ae7-8150-560793f058bb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:16.944956 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f692f02-5c84-4ae7-8150-560793f058bb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:16.945552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f692f02-5c84-4ae7-8150-560793f058bb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:16.985100 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:17.419800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e9cd4842-3424-4ef6-b77d-a0d0cd735c0c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:13:17.420317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e9cd4842-3424-4ef6-b77d-a0d0cd735c0c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:13:17.421082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e9cd4842-3424-4ef6-b77d-a0d0cd735c0c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:13:17.421766 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e9cd4842-3424-4ef6-b77d-a0d0cd735c0c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:13:17.422514 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e9cd4842-3424-4ef6-b77d-a0d0cd735c0c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:13:17.444768 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9cd4842-3424-4ef6-b77d-a0d0cd735c0c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:17.445382 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9cd4842-3424-4ef6-b77d-a0d0cd735c0c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:17.445714 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9cd4842-3424-4ef6-b77d-a0d0cd735c0c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:17.446495 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9cd4842-3424-4ef6-b77d-a0d0cd735c0c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:17.446983 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9cd4842-3424-4ef6-b77d-a0d0cd735c0c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:17.447590 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9cd4842-3424-4ef6-b77d-a0d0cd735c0c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:17.481743 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e9cd4842-3424-4ef6-b77d-a0d0cd735c0c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Getting quotas for project 1765b9e2226349c5a88f4bc75f8d1029. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:13:17.493221 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e9cd4842-3424-4ef6-b77d-a0d0cd735c0c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Getting quotas for user 810ad146d8cc4192a3ae68c58ed84d2b and project 1765b9e2226349c5a88f4bc75f8d1029. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:13:17.530011 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e9cd4842-3424-4ef6-b77d-a0d0cd735c0c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:13:17.532496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e9cd4842-3424-4ef6-b77d-a0d0cd735c0c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:13:17.589646 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e9cd4842-3424-4ef6-b77d-a0d0cd735c0c tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.216494 Aug 04 17:13:17.590766 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2122/4315] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:13:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 2219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:13:17.596951 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b8981319-c2f2-4569-b9a7-8ea66b5c94c4 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:17.597834 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b8981319-c2f2-4569-b9a7-8ea66b5c94c4 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 4b23ac31-0eda-4b24-b7ce-ed874fe75f90] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:17.607640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8981319-c2f2-4569-b9a7-8ea66b5c94c4 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:17.608144 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8981319-c2f2-4569-b9a7-8ea66b5c94c4 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:17.616129 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8981319-c2f2-4569-b9a7-8ea66b5c94c4 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:17.617158 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8981319-c2f2-4569-b9a7-8ea66b5c94c4 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:17.617798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8981319-c2f2-4569-b9a7-8ea66b5c94c4 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:17.618420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8981319-c2f2-4569-b9a7-8ea66b5c94c4 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:17.748275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2f692f02-5c84-4ae7-8150-560793f058bb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:17.759903 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2f692f02-5c84-4ae7-8150-560793f058bb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:17.761602 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2f692f02-5c84-4ae7-8150-560793f058bb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:17.767745 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2f692f02-5c84-4ae7-8150-560793f058bb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1724 microversion: 2.20 time: 0.849459 Aug 04 17:13:17.768336 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2194/4316] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:13:16 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1724 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:13:17.773168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-270dd011-23ff-451e-b057-485a6a5ccdd1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:17.773726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-270dd011-23ff-451e-b057-485a6a5ccdd1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: eba6aa22-62ff-42e5-8401-f02b23ffeb85] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:17.800858 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-270dd011-23ff-451e-b057-485a6a5ccdd1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:17.801398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-270dd011-23ff-451e-b057-485a6a5ccdd1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:17.801798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-270dd011-23ff-451e-b057-485a6a5ccdd1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:17.806055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-270dd011-23ff-451e-b057-485a6a5ccdd1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:17.812119 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-270dd011-23ff-451e-b057-485a6a5ccdd1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:17.812818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-270dd011-23ff-451e-b057-485a6a5ccdd1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:18.003138 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b8981319-c2f2-4569-b9a7-8ea66b5c94c4 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:18.029014 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b8981319-c2f2-4569-b9a7-8ea66b5c94c4 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90" status: 200 len: 1320 microversion: 2.1 time: 0.436947 Aug 04 17:13:18.034989 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2123/4317] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:17 2022] GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90 => generated 1320 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:18.039902 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c1555980-3b90-4157-8493-f002af2dde95 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:18.050955 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c1555980-3b90-4157-8493-f002af2dde95 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:18.228041 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c1555980-3b90-4157-8493-f002af2dde95 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:18.238501 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c1555980-3b90-4157-8493-f002af2dde95 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba" status: 200 len: 1235 microversion: 2.1 time: 0.202146 Aug 04 17:13:18.239303 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2124/4318] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:18 2022] GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba => generated 1235 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:18.253289 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-449bd2c8-7207-4cd7-b318-a139e181dd72 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:18.253937 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-449bd2c8-7207-4cd7-b318-a139e181dd72 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:18.254673 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.network.security_group_api [None req-270dd011-23ff-451e-b057-485a6a5ccdd1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Removing security group 73fd86a6-dcf6-4eb1-9aa6-59db6c783c79 from port f347cd22-db0b-4a20-abd4-efe2343e7d90 Aug 04 17:13:18.273215 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-449bd2c8-7207-4cd7-b318-a139e181dd72 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:18.274133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-449bd2c8-7207-4cd7-b318-a139e181dd72 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:18.274850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-449bd2c8-7207-4cd7-b318-a139e181dd72 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:18.275874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-449bd2c8-7207-4cd7-b318-a139e181dd72 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:18.276521 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-449bd2c8-7207-4cd7-b318-a139e181dd72 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:18.285577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-449bd2c8-7207-4cd7-b318-a139e181dd72 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:18.666897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-449bd2c8-7207-4cd7-b318-a139e181dd72 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:18.681021 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-449bd2c8-7207-4cd7-b318-a139e181dd72 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1732 microversion: 2.1 time: 0.439782 Aug 04 17:13:18.702616 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2125/4319] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:18 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1732 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:18.795821 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a5512db2-8d6c-467a-98b8-5db8c525a2df tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:18.796792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a5512db2-8d6c-467a-98b8-5db8c525a2df tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:18.825226 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5512db2-8d6c-467a-98b8-5db8c525a2df tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:18.860406 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5512db2-8d6c-467a-98b8-5db8c525a2df tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:18.862504 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5512db2-8d6c-467a-98b8-5db8c525a2df tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:18.870389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5512db2-8d6c-467a-98b8-5db8c525a2df tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:18.889719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5512db2-8d6c-467a-98b8-5db8c525a2df tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:18.890588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5512db2-8d6c-467a-98b8-5db8c525a2df tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:19.309881 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-270dd011-23ff-451e-b057-485a6a5ccdd1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85/action" status: 202 len: 0 microversion: 2.1 time: 1.540412 Aug 04 17:13:19.310623 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2195/4320] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:13:17 2022] POST /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85/action => generated 0 bytes in 1542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:13:19.316590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cb256006-9e71-470b-9388-9b4584c33025 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:19.317218 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cb256006-9e71-470b-9388-9b4584c33025 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 4b23ac31-0eda-4b24-b7ce-ed874fe75f90] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:19.330486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb256006-9e71-470b-9388-9b4584c33025 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:19.332721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb256006-9e71-470b-9388-9b4584c33025 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:19.333285 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb256006-9e71-470b-9388-9b4584c33025 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:19.334071 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb256006-9e71-470b-9388-9b4584c33025 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:19.334706 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb256006-9e71-470b-9388-9b4584c33025 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:19.335154 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb256006-9e71-470b-9388-9b4584c33025 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:19.391429 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:19.517750 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a5512db2-8d6c-467a-98b8-5db8c525a2df tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:19.521481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:19.534006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a5512db2-8d6c-467a-98b8-5db8c525a2df tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:19.546712 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a5512db2-8d6c-467a-98b8-5db8c525a2df tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:19.550964 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a5512db2-8d6c-467a-98b8-5db8c525a2df tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1724 microversion: 2.20 time: 0.759135 Aug 04 17:13:19.555297 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2126/4321] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:13:18 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1724 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:13:19.602797 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-94e4e9c1-c940-469c-a6f9-45f5c022a4d2 req-a27fd7e7-d217-4e1b-9ae7-e1b68c8fc221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b23ac31-0eda-4b24-b7ce-ed874fe75f90", "tag": "f07b4a87-1111-4f9a-b68b-99b14b911c73"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:19.662425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-94e4e9c1-c940-469c-a6f9-45f5c022a4d2 req-a27fd7e7-d217-4e1b-9ae7-e1b68c8fc221 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:19.663042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-94e4e9c1-c940-469c-a6f9-45f5c022a4d2 req-a27fd7e7-d217-4e1b-9ae7-e1b68c8fc221 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:19.663495 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-94e4e9c1-c940-469c-a6f9-45f5c022a4d2 req-a27fd7e7-d217-4e1b-9ae7-e1b68c8fc221 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:19.681134 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cb256006-9e71-470b-9388-9b4584c33025 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:19.691316 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cb256006-9e71-470b-9388-9b4584c33025 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90" status: 200 len: 1320 microversion: 2.1 time: 0.379543 Aug 04 17:13:19.712387 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2196/4322] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:19 2022] GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90 => generated 1320 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:19.728930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-de8841f6-9ae6-4818-8520-5820e6af36cd tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:19.731348 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-94e4e9c1-c940-469c-a6f9-45f5c022a4d2 req-a27fd7e7-d217-4e1b-9ae7-e1b68c8fc221 service nova] Creating event network-changed:f07b4a87-1111-4f9a-b68b-99b14b911c73 for instance 4b23ac31-0eda-4b24-b7ce-ed874fe75f90 on n-h1-851359-3 Aug 04 17:13:19.733352 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-de8841f6-9ae6-4818-8520-5820e6af36cd tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:19.746469 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-94e4e9c1-c940-469c-a6f9-45f5c022a4d2 req-a27fd7e7-d217-4e1b-9ae7-e1b68c8fc221 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189840 Aug 04 17:13:19.748728 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2127/4323] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:13:19.749595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de8841f6-9ae6-4818-8520-5820e6af36cd tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:19.750320 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de8841f6-9ae6-4818-8520-5820e6af36cd tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:19.754305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de8841f6-9ae6-4818-8520-5820e6af36cd tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:19.755691 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de8841f6-9ae6-4818-8520-5820e6af36cd tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:19.756298 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de8841f6-9ae6-4818-8520-5820e6af36cd tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:19.756931 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de8841f6-9ae6-4818-8520-5820e6af36cd tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:19.761020 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0f59f32a-8a54-4e92-97ab-ee6947b18a03 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:19.767219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0f59f32a-8a54-4e92-97ab-ee6947b18a03 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: eba6aa22-62ff-42e5-8401-f02b23ffeb85] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:19.785539 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f59f32a-8a54-4e92-97ab-ee6947b18a03 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:19.789380 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f59f32a-8a54-4e92-97ab-ee6947b18a03 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:19.793222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f59f32a-8a54-4e92-97ab-ee6947b18a03 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:19.795389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f59f32a-8a54-4e92-97ab-ee6947b18a03 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:19.796139 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f59f32a-8a54-4e92-97ab-ee6947b18a03 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:19.797389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f59f32a-8a54-4e92-97ab-ee6947b18a03 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:19.933091 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-de8841f6-9ae6-4818-8520-5820e6af36cd tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:19.947641 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-de8841f6-9ae6-4818-8520-5820e6af36cd tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba" status: 200 len: 1287 microversion: 2.1 time: 0.226816 Aug 04 17:13:19.954257 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2197/4324] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:19 2022] GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba => generated 1287 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:19.966967 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-dcd03a2d-d641-402d-8f4f-13b368528136 req-f5004da6-10d6-4129-95dc-eb1462947ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eba6aa22-62ff-42e5-8401-f02b23ffeb85", "tag": "f347cd22-db0b-4a20-abd4-efe2343e7d90"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:19.999026 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-dcd03a2d-d641-402d-8f4f-13b368528136 req-f5004da6-10d6-4129-95dc-eb1462947ca7 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:19.999669 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-dcd03a2d-d641-402d-8f4f-13b368528136 req-f5004da6-10d6-4129-95dc-eb1462947ca7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:20.000259 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-dcd03a2d-d641-402d-8f4f-13b368528136 req-f5004da6-10d6-4129-95dc-eb1462947ca7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:20.048389 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-dcd03a2d-d641-402d-8f4f-13b368528136 req-f5004da6-10d6-4129-95dc-eb1462947ca7 service nova] Creating event network-changed:f347cd22-db0b-4a20-abd4-efe2343e7d90 for instance eba6aa22-62ff-42e5-8401-f02b23ffeb85 on n-h1-851359-3 Aug 04 17:13:20.066010 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-dcd03a2d-d641-402d-8f4f-13b368528136 req-f5004da6-10d6-4129-95dc-eb1462947ca7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103997 Aug 04 17:13:20.067734 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2198/4325] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:13:20.074990 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0f59f32a-8a54-4e92-97ab-ee6947b18a03 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:20.080987 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6137d7b5-34ba-4a3a-89fe-0ca3d1c5c958 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:20.081712 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6137d7b5-34ba-4a3a-89fe-0ca3d1c5c958 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:20.092911 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0f59f32a-8a54-4e92-97ab-ee6947b18a03 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85" status: 200 len: 1460 microversion: 2.1 time: 0.339310 Aug 04 17:13:20.096580 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2128/4326] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:19 2022] GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85 => generated 1460 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:20.098809 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6137d7b5-34ba-4a3a-89fe-0ca3d1c5c958 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:20.101592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6137d7b5-34ba-4a3a-89fe-0ca3d1c5c958 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:20.102125 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6137d7b5-34ba-4a3a-89fe-0ca3d1c5c958 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:20.103024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6137d7b5-34ba-4a3a-89fe-0ca3d1c5c958 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:20.104899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6137d7b5-34ba-4a3a-89fe-0ca3d1c5c958 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:20.105547 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6137d7b5-34ba-4a3a-89fe-0ca3d1c5c958 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:20.134093 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d406dd80-9e89-4baa-8335-27f35ada486a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:20.134785 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d406dd80-9e89-4baa-8335-27f35ada486a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:20.146874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d406dd80-9e89-4baa-8335-27f35ada486a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:20.155244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d406dd80-9e89-4baa-8335-27f35ada486a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:20.157213 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d406dd80-9e89-4baa-8335-27f35ada486a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:20.161191 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d406dd80-9e89-4baa-8335-27f35ada486a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:20.163842 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d406dd80-9e89-4baa-8335-27f35ada486a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:20.165102 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d406dd80-9e89-4baa-8335-27f35ada486a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:20.665761 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d406dd80-9e89-4baa-8335-27f35ada486a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:20.680042 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d406dd80-9e89-4baa-8335-27f35ada486a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.555693 Aug 04 17:13:20.684511 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2129/4327] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:20 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:20.693238 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-57903bc0-b511-43e1-9f18-d269b79825e6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:20.694790 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-57903bc0-b511-43e1-9f18-d269b79825e6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:20.710289 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57903bc0-b511-43e1-9f18-d269b79825e6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:20.710799 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57903bc0-b511-43e1-9f18-d269b79825e6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:20.716773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57903bc0-b511-43e1-9f18-d269b79825e6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:20.717776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57903bc0-b511-43e1-9f18-d269b79825e6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:20.719397 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57903bc0-b511-43e1-9f18-d269b79825e6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:20.721479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57903bc0-b511-43e1-9f18-d269b79825e6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:20.770798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6137d7b5-34ba-4a3a-89fe-0ca3d1c5c958 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:20.784721 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6137d7b5-34ba-4a3a-89fe-0ca3d1c5c958 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1712 microversion: 2.1 time: 0.715522 Aug 04 17:13:20.789828 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2199/4328] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:20 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1712 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:20.798069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7b0751b3-6896-4a89-bcec-faf5e8e99735 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:20.799256 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7b0751b3-6896-4a89-bcec-faf5e8e99735 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:20.828846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b0751b3-6896-4a89-bcec-faf5e8e99735 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:20.830434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b0751b3-6896-4a89-bcec-faf5e8e99735 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:20.831930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b0751b3-6896-4a89-bcec-faf5e8e99735 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:20.835105 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b0751b3-6896-4a89-bcec-faf5e8e99735 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:20.836493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b0751b3-6896-4a89-bcec-faf5e8e99735 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:20.837781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b0751b3-6896-4a89-bcec-faf5e8e99735 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:21.091707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-57903bc0-b511-43e1-9f18-d269b79825e6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:21.109002 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-57903bc0-b511-43e1-9f18-d269b79825e6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:21.118973 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-57903bc0-b511-43e1-9f18-d269b79825e6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:21.123059 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-57903bc0-b511-43e1-9f18-d269b79825e6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1724 microversion: 2.20 time: 0.437145 Aug 04 17:13:21.123744 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2130/4329] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:13:20 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1724 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:13:21.152916 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4c4c5935-2856-4c2f-a317-3de1a4327ba2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:21.153595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4c4c5935-2856-4c2f-a317-3de1a4327ba2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 4b23ac31-0eda-4b24-b7ce-ed874fe75f90] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:21.175380 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c4c5935-2856-4c2f-a317-3de1a4327ba2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:21.179217 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c4c5935-2856-4c2f-a317-3de1a4327ba2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:21.182090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c4c5935-2856-4c2f-a317-3de1a4327ba2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:21.182090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c4c5935-2856-4c2f-a317-3de1a4327ba2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:21.182314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c4c5935-2856-4c2f-a317-3de1a4327ba2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:21.183191 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c4c5935-2856-4c2f-a317-3de1a4327ba2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:21.257307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7b0751b3-6896-4a89-bcec-faf5e8e99735 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:21.266209 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7b0751b3-6896-4a89-bcec-faf5e8e99735 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.474156 Aug 04 17:13:21.266805 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2200/4330] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:20 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:21.272934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ee7cb83d-c9d3-4157-be4a-0f8844e1d141 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:21.273797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ee7cb83d-c9d3-4157-be4a-0f8844e1d141 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:21.280820 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee7cb83d-c9d3-4157-be4a-0f8844e1d141 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:21.282139 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee7cb83d-c9d3-4157-be4a-0f8844e1d141 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:21.282751 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee7cb83d-c9d3-4157-be4a-0f8844e1d141 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:21.283666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee7cb83d-c9d3-4157-be4a-0f8844e1d141 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:21.284431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee7cb83d-c9d3-4157-be4a-0f8844e1d141 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:21.284897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee7cb83d-c9d3-4157-be4a-0f8844e1d141 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:21.375353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ee7cb83d-c9d3-4157-be4a-0f8844e1d141 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:21.387209 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ee7cb83d-c9d3-4157-be4a-0f8844e1d141 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba" status: 200 len: 1293 microversion: 2.1 time: 0.119165 Aug 04 17:13:21.388465 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2201/4331] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:21 2022] GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba => generated 1293 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:21.393934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b171f288-4034-4cc4-9a4d-8630b2214b3f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:21.394519 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b171f288-4034-4cc4-9a4d-8630b2214b3f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:21.400753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b171f288-4034-4cc4-9a4d-8630b2214b3f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:21.401258 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b171f288-4034-4cc4-9a4d-8630b2214b3f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:21.401729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b171f288-4034-4cc4-9a4d-8630b2214b3f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:21.403169 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b171f288-4034-4cc4-9a4d-8630b2214b3f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:21.403809 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b171f288-4034-4cc4-9a4d-8630b2214b3f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:21.404250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b171f288-4034-4cc4-9a4d-8630b2214b3f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:21.527398 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-b171f288-4034-4cc4-9a4d-8630b2214b3f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] HTTP exception thrown: Cannot 'detach_volume' instance 0c74445a-b3fe-4d2a-9dd3-43ab834d369a while it is in vm_state rescued Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b171f288-4034-4cc4-9a4d-8630b2214b3f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Request method failure captured: Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a/os-volume_attachments/d4e5d209-60b8-4886-9ec6-6d54cdab2464 HTTP/1.1 Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_1KcpG4juUr2VEfzShlgrBBMonXazIZnBtgobublSG0FrbL-f6glawbXIezuRVmeGIpCPKZ2_FVYi6XXX8bEGfzlmqPmHXf6Tacw6jDfV9QuP1xJWCSlbaybEtYK4vIloCt34qv4iEL4IzCpH1AIgjNgga3059ie-t_wAucPvDkWig Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 50d2f7cd670340adb1b4187754e302c5 Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1121530457 Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/50d2f7cd670340adb1b4187754e302c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/50d2f7cd670340adb1b4187754e302c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_50d2f7cd670340adb1b4187754e302c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/50d2f7cd670340adb1b4187754e302c5"}]}] Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1121530457 Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 50d2f7cd670340adb1b4187754e302c5 Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1121530457 Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerRescueNegativeTestJSON-1121530457-project Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 067e98d624234a48bb0ea3bde77c049c Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1121530457-project Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: exception: Cannot 'detach_volume' instance 0c74445a-b3fe-4d2a-9dd3-43ab834d369a while it is in vm_state rescued Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'server_id': '0c74445a-b3fe-4d2a-9dd3-43ab834d369a', 'id': 'd4e5d209-60b8-4886-9ec6-6d54cdab2464'} Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0c74445a-b3fe-4d2a-9dd3-43ab834d369a in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0c74445a-b3fe-4d2a-9dd3-43ab834d369a while it is in vm_state rescued Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:13:21.530186 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:13:21.534967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:13:21.534967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:13:21.534967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:13:21.534967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:13:21.534967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0c74445a-b3fe-4d2a-9dd3-43ab834d369a while it is in vm_state rescued Aug 04 17:13:21.534967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:13:21.538412 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b171f288-4034-4cc4-9a4d-8630b2214b3f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Returning 409 to user: Cannot 'detach_volume' instance 0c74445a-b3fe-4d2a-9dd3-43ab834d369a while it is in vm_state rescued {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:13:21.540650 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b171f288-4034-4cc4-9a4d-8630b2214b3f tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a/os-volume_attachments/d4e5d209-60b8-4886-9ec6-6d54cdab2464" status: 409 len: 152 microversion: 2.1 time: 0.151090 Aug 04 17:13:21.544800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4c4c5935-2856-4c2f-a317-3de1a4327ba2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:21.545255 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2202/4332] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Aug 4 17:13:21 2022] DELETE /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a/os-volume_attachments/d4e5d209-60b8-4886-9ec6-6d54cdab2464 => generated 152 bytes in 156 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:13:21.552871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-769498ca-fe4f-4adb-bf49-8f6cb4628a4c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:21.553727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-769498ca-fe4f-4adb-bf49-8f6cb4628a4c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:21.555045 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4c4c5935-2856-4c2f-a317-3de1a4327ba2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90" status: 200 len: 1320 microversion: 2.1 time: 0.416824 Aug 04 17:13:21.562022 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2131/4333] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:21 2022] GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90 => generated 1320 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:21.563452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-db392097-41a2-4145-b050-466920548121 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:21.564685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-db392097-41a2-4145-b050-466920548121 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:21.570426 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-769498ca-fe4f-4adb-bf49-8f6cb4628a4c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:21.571213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-769498ca-fe4f-4adb-bf49-8f6cb4628a4c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:21.573087 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db392097-41a2-4145-b050-466920548121 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:21.574678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db392097-41a2-4145-b050-466920548121 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:21.575553 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db392097-41a2-4145-b050-466920548121 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:21.576478 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db392097-41a2-4145-b050-466920548121 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:21.577112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db392097-41a2-4145-b050-466920548121 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:21.577796 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db392097-41a2-4145-b050-466920548121 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:21.591598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-769498ca-fe4f-4adb-bf49-8f6cb4628a4c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:21.596681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-769498ca-fe4f-4adb-bf49-8f6cb4628a4c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:21.597197 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-769498ca-fe4f-4adb-bf49-8f6cb4628a4c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:21.597649 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-769498ca-fe4f-4adb-bf49-8f6cb4628a4c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:21.751647 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-db392097-41a2-4145-b050-466920548121 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "POST /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a/action" status: 202 len: 0 microversion: 2.1 time: 0.192795 Aug 04 17:13:21.759612 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=10 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:21.766416 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2132/4334] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:13:21 2022] POST /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:13:21.787648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d85c2069-3355-444b-8fd1-9abf9093070e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:21.788325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d85c2069-3355-444b-8fd1-9abf9093070e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:21.818734 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d85c2069-3355-444b-8fd1-9abf9093070e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:21.819244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d85c2069-3355-444b-8fd1-9abf9093070e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:21.819691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d85c2069-3355-444b-8fd1-9abf9093070e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:21.820418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d85c2069-3355-444b-8fd1-9abf9093070e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:21.820886 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d85c2069-3355-444b-8fd1-9abf9093070e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:21.829662 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d85c2069-3355-444b-8fd1-9abf9093070e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:22.769199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-769498ca-fe4f-4adb-bf49-8f6cb4628a4c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:22.778614 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-769498ca-fe4f-4adb-bf49-8f6cb4628a4c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 1.230970 Aug 04 17:13:22.784042 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2203/4335] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:21 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:22.789413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4b38f7d1-af83-4734-babf-3bf46d24bf41 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:22.794797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4b38f7d1-af83-4734-babf-3bf46d24bf41 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:22.808256 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b38f7d1-af83-4734-babf-3bf46d24bf41 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:22.809345 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b38f7d1-af83-4734-babf-3bf46d24bf41 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:22.810009 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b38f7d1-af83-4734-babf-3bf46d24bf41 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:22.811843 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b38f7d1-af83-4734-babf-3bf46d24bf41 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:22.814542 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b38f7d1-af83-4734-babf-3bf46d24bf41 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:22.815690 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b38f7d1-af83-4734-babf-3bf46d24bf41 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:22.846643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d85c2069-3355-444b-8fd1-9abf9093070e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:22.857422 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d85c2069-3355-444b-8fd1-9abf9093070e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1720 microversion: 2.1 time: 1.089297 Aug 04 17:13:22.864001 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2133/4336] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:21 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1720 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:23.067926 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4b38f7d1-af83-4734-babf-3bf46d24bf41 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:23.077378 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4b38f7d1-af83-4734-babf-3bf46d24bf41 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:23.087114 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4b38f7d1-af83-4734-babf-3bf46d24bf41 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:23.088650 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4b38f7d1-af83-4734-babf-3bf46d24bf41 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1745 microversion: 2.20 time: 0.303037 Aug 04 17:13:23.089799 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2204/4337] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:13:22 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1745 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:13:23.099934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4d31f2be-0f19-44b2-a31f-86917802d003 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:23.103074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4d31f2be-0f19-44b2-a31f-86917802d003 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:23.117606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d31f2be-0f19-44b2-a31f-86917802d003 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:23.122212 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d31f2be-0f19-44b2-a31f-86917802d003 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:23.123242 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d31f2be-0f19-44b2-a31f-86917802d003 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:23.124191 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d31f2be-0f19-44b2-a31f-86917802d003 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:23.124886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d31f2be-0f19-44b2-a31f-86917802d003 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:23.126496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d31f2be-0f19-44b2-a31f-86917802d003 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:23.181405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6f191782-0009-492e-b2e9-83b7f5c3558d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-612656712", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "3217db81-b57f-4c04-a0d3-93f4607c02ae"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:23.280566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-6f191782-0009-492e-b2e9-83b7f5c3558d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] validate_networks() for [('3217db81-b57f-4c04-a0d3-93f4607c02ae', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:13:23.445391 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4d31f2be-0f19-44b2-a31f-86917802d003 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:23.462249 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4d31f2be-0f19-44b2-a31f-86917802d003 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba" status: 200 len: 1360 microversion: 2.1 time: 0.370912 Aug 04 17:13:23.462949 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2205/4338] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:23 2022] GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba => generated 1360 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:23.477625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-26042e39-4467-4e87-addb-070aede24fcb tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:23.478437 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-26042e39-4467-4e87-addb-070aede24fcb tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 4b23ac31-0eda-4b24-b7ce-ed874fe75f90] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:23.503415 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-26042e39-4467-4e87-addb-070aede24fcb tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:23.505905 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-26042e39-4467-4e87-addb-070aede24fcb tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:23.509480 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-26042e39-4467-4e87-addb-070aede24fcb tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:23.510346 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-26042e39-4467-4e87-addb-070aede24fcb tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:23.510899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-26042e39-4467-4e87-addb-070aede24fcb tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:23.511410 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-26042e39-4467-4e87-addb-070aede24fcb tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:23.830627 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-26042e39-4467-4e87-addb-070aede24fcb tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:23.842603 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-26042e39-4467-4e87-addb-070aede24fcb tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90" status: 200 len: 1320 microversion: 2.1 time: 0.376842 Aug 04 17:13:23.845457 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2206/4339] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:23 2022] GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90 => generated 1320 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:23.864535 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8a478275-33cb-43d7-8aa3-13ba764af7da tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:23.867897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8a478275-33cb-43d7-8aa3-13ba764af7da tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:23.881832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a478275-33cb-43d7-8aa3-13ba764af7da tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:23.882599 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a478275-33cb-43d7-8aa3-13ba764af7da tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:23.886574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a478275-33cb-43d7-8aa3-13ba764af7da tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:23.887538 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a478275-33cb-43d7-8aa3-13ba764af7da tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:23.888024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a478275-33cb-43d7-8aa3-13ba764af7da tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:23.888463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a478275-33cb-43d7-8aa3-13ba764af7da tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:24.070264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6f191782-0009-492e-b2e9-83b7f5c3558d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:13:24.070863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6f191782-0009-492e-b2e9-83b7f5c3558d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:13:24.071498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6f191782-0009-492e-b2e9-83b7f5c3558d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:13:24.072197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6f191782-0009-492e-b2e9-83b7f5c3558d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:13:24.072830 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6f191782-0009-492e-b2e9-83b7f5c3558d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:13:24.094141 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f191782-0009-492e-b2e9-83b7f5c3558d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:24.095285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f191782-0009-492e-b2e9-83b7f5c3558d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:24.096716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f191782-0009-492e-b2e9-83b7f5c3558d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:24.098538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f191782-0009-492e-b2e9-83b7f5c3558d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:24.106301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f191782-0009-492e-b2e9-83b7f5c3558d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:24.107456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f191782-0009-492e-b2e9-83b7f5c3558d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:24.154246 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-6f191782-0009-492e-b2e9-83b7f5c3558d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Getting quotas for project 85c97e15d470473189d8a6c2068e9eac. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:13:24.168506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-6f191782-0009-492e-b2e9-83b7f5c3558d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Getting quotas for user 6791b833351c493a8e581154c2dfb8d7 and project 85c97e15d470473189d8a6c2068e9eac. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:13:24.203841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6f191782-0009-492e-b2e9-83b7f5c3558d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:13:24.206232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6f191782-0009-492e-b2e9-83b7f5c3558d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:13:24.246389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8a478275-33cb-43d7-8aa3-13ba764af7da tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:24.258401 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8a478275-33cb-43d7-8aa3-13ba764af7da tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.408948 Aug 04 17:13:24.270210 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2207/4340] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:23 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:24.276433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-823e0b0e-28a1-44bd-9fd0-6ca1435b0fca req-a76fb05c-c371-4f71-ac33-a0ad798c726f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81a3d940-08e3-4cb9-bbf2-360653411aba", "tag": "740dcb36-902c-495f-9a80-a8a83db55035"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:24.305837 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-823e0b0e-28a1-44bd-9fd0-6ca1435b0fca req-a76fb05c-c371-4f71-ac33-a0ad798c726f service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:24.309959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-823e0b0e-28a1-44bd-9fd0-6ca1435b0fca req-a76fb05c-c371-4f71-ac33-a0ad798c726f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:24.314015 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-823e0b0e-28a1-44bd-9fd0-6ca1435b0fca req-a76fb05c-c371-4f71-ac33-a0ad798c726f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:24.343213 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-823e0b0e-28a1-44bd-9fd0-6ca1435b0fca req-a76fb05c-c371-4f71-ac33-a0ad798c726f service nova] Creating event network-changed:740dcb36-902c-495f-9a80-a8a83db55035 for instance 81a3d940-08e3-4cb9-bbf2-360653411aba on n-h2-851359-3 Aug 04 17:13:24.349495 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-823e0b0e-28a1-44bd-9fd0-6ca1435b0fca req-a76fb05c-c371-4f71-ac33-a0ad798c726f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088788 Aug 04 17:13:24.350666 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2208/4341] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:13:24.351471 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6f191782-0009-492e-b2e9-83b7f5c3558d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.486108 Aug 04 17:13:24.355267 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2134/4342] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:13:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:13:24.357486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-88f43b03-6457-4d97-975b-bd20ef1a8e6b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:24.359123 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-88f43b03-6457-4d97-975b-bd20ef1a8e6b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:24.365430 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6565864e-7340-47db-8d3c-ec797eafa7a8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:24.366087 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6565864e-7340-47db-8d3c-ec797eafa7a8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:24.369549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88f43b03-6457-4d97-975b-bd20ef1a8e6b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:24.370286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88f43b03-6457-4d97-975b-bd20ef1a8e6b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:24.371311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88f43b03-6457-4d97-975b-bd20ef1a8e6b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:24.372389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88f43b03-6457-4d97-975b-bd20ef1a8e6b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:24.372969 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88f43b03-6457-4d97-975b-bd20ef1a8e6b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:24.374105 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88f43b03-6457-4d97-975b-bd20ef1a8e6b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:24.387007 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6565864e-7340-47db-8d3c-ec797eafa7a8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:24.387552 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6565864e-7340-47db-8d3c-ec797eafa7a8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:24.388007 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6565864e-7340-47db-8d3c-ec797eafa7a8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:24.388736 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6565864e-7340-47db-8d3c-ec797eafa7a8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:24.389198 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6565864e-7340-47db-8d3c-ec797eafa7a8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:24.389631 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6565864e-7340-47db-8d3c-ec797eafa7a8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:24.749061 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6565864e-7340-47db-8d3c-ec797eafa7a8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:24.761393 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6565864e-7340-47db-8d3c-ec797eafa7a8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:24.764391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6565864e-7340-47db-8d3c-ec797eafa7a8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:24.765957 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6565864e-7340-47db-8d3c-ec797eafa7a8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1745 microversion: 2.20 time: 0.409640 Aug 04 17:13:24.767081 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2135/4343] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:13:24 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1745 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:13:24.772218 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-640960b8-212b-4167-a49e-c134da61f256 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:24.773046 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-640960b8-212b-4167-a49e-c134da61f256 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:24.831836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-88f43b03-6457-4d97-975b-bd20ef1a8e6b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:24.843517 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-88f43b03-6457-4d97-975b-bd20ef1a8e6b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1720 microversion: 2.1 time: 0.491241 Aug 04 17:13:24.847187 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2209/4344] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:24 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1720 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:24.858841 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-cc452631-084a-4abf-9798-286e9873cc0f req-0d359daf-c4ee-49f7-a9a7-82dd67b0f106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c682c4f-3eed-44cd-9782-3ed12f2d8f0d", "name": "network-vif-plugged", "status": "completed", "tag": "8b60e742-6e36-45ea-a5d7-62315ea560df"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:24.887008 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-cc452631-084a-4abf-9798-286e9873cc0f req-0d359daf-c4ee-49f7-a9a7-82dd67b0f106 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:24.887791 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-cc452631-084a-4abf-9798-286e9873cc0f req-0d359daf-c4ee-49f7-a9a7-82dd67b0f106 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:24.890454 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-cc452631-084a-4abf-9798-286e9873cc0f req-0d359daf-c4ee-49f7-a9a7-82dd67b0f106 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:24.914254 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-cc452631-084a-4abf-9798-286e9873cc0f req-0d359daf-c4ee-49f7-a9a7-82dd67b0f106 service nova] Creating event network-vif-plugged:8b60e742-6e36-45ea-a5d7-62315ea560df for instance 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d on n-h2-851359-3 Aug 04 17:13:24.924577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-640960b8-212b-4167-a49e-c134da61f256 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:24.926770 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-cc452631-084a-4abf-9798-286e9873cc0f req-0d359daf-c4ee-49f7-a9a7-82dd67b0f106 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077585 Aug 04 17:13:24.927666 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2210/4345] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:13:24.932990 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-99ee3a06-3e0c-4d1d-972e-8a086c4f7fef tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:24.933945 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-99ee3a06-3e0c-4d1d-972e-8a086c4f7fef tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:24.939451 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-640960b8-212b-4167-a49e-c134da61f256 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1224 microversion: 2.1 time: 0.170700 Aug 04 17:13:24.942266 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99ee3a06-3e0c-4d1d-972e-8a086c4f7fef tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:24.943206 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99ee3a06-3e0c-4d1d-972e-8a086c4f7fef tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:24.944070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99ee3a06-3e0c-4d1d-972e-8a086c4f7fef tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:24.944319 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2136/4346] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:24 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1224 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:24.945082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99ee3a06-3e0c-4d1d-972e-8a086c4f7fef tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:24.945886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99ee3a06-3e0c-4d1d-972e-8a086c4f7fef tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:24.946481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99ee3a06-3e0c-4d1d-972e-8a086c4f7fef tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:24.976351 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-832ae8b8-b300-4454-bfea-a939581c3715 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1720169990", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "b3c59640-cdc1-4b7c-beb0-ca591646427e"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:25.116800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-832ae8b8-b300-4454-bfea-a939581c3715 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] validate_networks() for [('b3c59640-cdc1-4b7c-beb0-ca591646427e', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:13:25.295523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-99ee3a06-3e0c-4d1d-972e-8a086c4f7fef tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:25.304027 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-99ee3a06-3e0c-4d1d-972e-8a086c4f7fef tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba" status: 200 len: 1360 microversion: 2.1 time: 0.374955 Aug 04 17:13:25.308479 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2211/4347] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:24 2022] GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba => generated 1360 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:25.312976 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6d703259-8b31-492f-8344-a764380c4d13 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:25.313596 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6d703259-8b31-492f-8344-a764380c4d13 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 4b23ac31-0eda-4b24-b7ce-ed874fe75f90] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:25.332392 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d703259-8b31-492f-8344-a764380c4d13 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:25.332889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d703259-8b31-492f-8344-a764380c4d13 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:25.333536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d703259-8b31-492f-8344-a764380c4d13 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:25.336583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d703259-8b31-492f-8344-a764380c4d13 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:25.337059 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d703259-8b31-492f-8344-a764380c4d13 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:25.337502 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d703259-8b31-492f-8344-a764380c4d13 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:25.632634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6d703259-8b31-492f-8344-a764380c4d13 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:25.645427 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6d703259-8b31-492f-8344-a764380c4d13 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90" status: 200 len: 1320 microversion: 2.1 time: 0.335955 Aug 04 17:13:25.646890 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2212/4348] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:25 2022] GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90 => generated 1320 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:25.789286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-59279037-4edf-4272-9ad4-b2de021ef57d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:25.789905 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-59279037-4edf-4272-9ad4-b2de021ef57d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:25.792500 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:25.805003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59279037-4edf-4272-9ad4-b2de021ef57d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:25.808057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59279037-4edf-4272-9ad4-b2de021ef57d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:25.808517 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59279037-4edf-4272-9ad4-b2de021ef57d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:25.809387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59279037-4edf-4272-9ad4-b2de021ef57d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:25.809938 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59279037-4edf-4272-9ad4-b2de021ef57d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:25.813366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59279037-4edf-4272-9ad4-b2de021ef57d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:25.851474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-832ae8b8-b300-4454-bfea-a939581c3715 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:13:25.852005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-832ae8b8-b300-4454-bfea-a939581c3715 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:13:25.852365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-832ae8b8-b300-4454-bfea-a939581c3715 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:13:25.852575 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:25.852992 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-832ae8b8-b300-4454-bfea-a939581c3715 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:13:25.853383 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-832ae8b8-b300-4454-bfea-a939581c3715 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:13:25.872855 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-832ae8b8-b300-4454-bfea-a939581c3715 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:25.873359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-832ae8b8-b300-4454-bfea-a939581c3715 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:25.873809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-832ae8b8-b300-4454-bfea-a939581c3715 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:25.878792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-832ae8b8-b300-4454-bfea-a939581c3715 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:25.879288 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-832ae8b8-b300-4454-bfea-a939581c3715 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:25.879745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-832ae8b8-b300-4454-bfea-a939581c3715 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:25.918016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:25.933620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-832ae8b8-b300-4454-bfea-a939581c3715 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Getting quotas for project 683ce999e25e42a4a57b3c24a1fd24ef. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:13:25.943168 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-832ae8b8-b300-4454-bfea-a939581c3715 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Getting quotas for user 01e6f70936a14e67aecaf71fb615fffa and project 683ce999e25e42a4a57b3c24a1fd24ef. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:13:25.961752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-832ae8b8-b300-4454-bfea-a939581c3715 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:13:25.964682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-832ae8b8-b300-4454-bfea-a939581c3715 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:13:26.032918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-59279037-4edf-4272-9ad4-b2de021ef57d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:26.044635 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-59279037-4edf-4272-9ad4-b2de021ef57d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:26.047950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-59279037-4edf-4272-9ad4-b2de021ef57d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:26.049323 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-59279037-4edf-4272-9ad4-b2de021ef57d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1745 microversion: 2.20 time: 0.264303 Aug 04 17:13:26.061655 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-832ae8b8-b300-4454-bfea-a939581c3715 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.116099 Aug 04 17:13:26.066205 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2213/4349] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:13:25 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1745 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:13:26.070964 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2137/4350] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:13:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:13:26.074254 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-60f5c5e0-f922-4ad1-abaf-2e0017d89afe tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:26.075246 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-60f5c5e0-f922-4ad1-abaf-2e0017d89afe tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:26.081175 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-02231af3-c16e-4f03-9b46-aa9244e3b37d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:26.082113 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-02231af3-c16e-4f03-9b46-aa9244e3b37d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:26.083527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60f5c5e0-f922-4ad1-abaf-2e0017d89afe tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:26.084191 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60f5c5e0-f922-4ad1-abaf-2e0017d89afe tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:26.085208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60f5c5e0-f922-4ad1-abaf-2e0017d89afe tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:26.086131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60f5c5e0-f922-4ad1-abaf-2e0017d89afe tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:26.086753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60f5c5e0-f922-4ad1-abaf-2e0017d89afe tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:26.089668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60f5c5e0-f922-4ad1-abaf-2e0017d89afe tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:26.092926 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02231af3-c16e-4f03-9b46-aa9244e3b37d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:26.094390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02231af3-c16e-4f03-9b46-aa9244e3b37d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:26.095277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02231af3-c16e-4f03-9b46-aa9244e3b37d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:26.096458 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02231af3-c16e-4f03-9b46-aa9244e3b37d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:26.097044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02231af3-c16e-4f03-9b46-aa9244e3b37d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:26.097545 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02231af3-c16e-4f03-9b46-aa9244e3b37d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:26.236369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-02231af3-c16e-4f03-9b46-aa9244e3b37d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:26.254101 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-02231af3-c16e-4f03-9b46-aa9244e3b37d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1228 microversion: 2.1 time: 0.179461 Aug 04 17:13:26.255344 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2138/4351] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:26 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1228 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:26.260575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4adf1edb-b98b-45f9-b630-e48b179d3ea6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:26.261204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4adf1edb-b98b-45f9-b630-e48b179d3ea6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:26.330889 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4adf1edb-b98b-45f9-b630-e48b179d3ea6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:26.347376 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4adf1edb-b98b-45f9-b630-e48b179d3ea6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1215 microversion: 2.1 time: 0.090668 Aug 04 17:13:26.348656 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2139/4352] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:26 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1215 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:26.352626 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-60f5c5e0-f922-4ad1-abaf-2e0017d89afe tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:26.360999 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d9155b65-542e-401c-801c-15318a670457 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:26.361621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d9155b65-542e-401c-801c-15318a670457 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:26.365651 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-60f5c5e0-f922-4ad1-abaf-2e0017d89afe tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1720 microversion: 2.1 time: 0.297873 Aug 04 17:13:26.367178 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2214/4353] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:26 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1720 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:26.371397 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9155b65-542e-401c-801c-15318a670457 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:26.371946 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9155b65-542e-401c-801c-15318a670457 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:26.372394 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9155b65-542e-401c-801c-15318a670457 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:26.373204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9155b65-542e-401c-801c-15318a670457 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:26.373674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9155b65-542e-401c-801c-15318a670457 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:26.374266 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9155b65-542e-401c-801c-15318a670457 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:26.520993 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d9155b65-542e-401c-801c-15318a670457 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:26.532906 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d9155b65-542e-401c-801c-15318a670457 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba" status: 200 len: 1360 microversion: 2.1 time: 0.183169 Aug 04 17:13:26.533469 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2140/4354] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:26 2022] GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba => generated 1360 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:26.669185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-89d156f8-d1df-4343-8062-b858db41e4a0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:26.669805 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-89d156f8-d1df-4343-8062-b858db41e4a0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 4b23ac31-0eda-4b24-b7ce-ed874fe75f90] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:26.676316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89d156f8-d1df-4343-8062-b858db41e4a0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:26.676819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89d156f8-d1df-4343-8062-b858db41e4a0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:26.677275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89d156f8-d1df-4343-8062-b858db41e4a0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:26.678015 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89d156f8-d1df-4343-8062-b858db41e4a0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:26.678483 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89d156f8-d1df-4343-8062-b858db41e4a0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:26.678922 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89d156f8-d1df-4343-8062-b858db41e4a0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:26.822949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-89d156f8-d1df-4343-8062-b858db41e4a0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:26.833321 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-89d156f8-d1df-4343-8062-b858db41e4a0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90" status: 200 len: 1320 microversion: 2.1 time: 0.168281 Aug 04 17:13:26.833898 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2215/4355] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:26 2022] GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90 => generated 1320 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:27.078715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-08d7cd43-ee3e-4ff3-89ee-629cb041e78e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:27.079711 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-08d7cd43-ee3e-4ff3-89ee-629cb041e78e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:27.086683 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08d7cd43-ee3e-4ff3-89ee-629cb041e78e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:27.087300 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08d7cd43-ee3e-4ff3-89ee-629cb041e78e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:27.087965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08d7cd43-ee3e-4ff3-89ee-629cb041e78e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:27.088846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08d7cd43-ee3e-4ff3-89ee-629cb041e78e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:27.089476 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08d7cd43-ee3e-4ff3-89ee-629cb041e78e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:27.089911 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08d7cd43-ee3e-4ff3-89ee-629cb041e78e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:27.251226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-4b729588-b8e8-4a4f-a2c5-614f19b45064 req-15cd89ad-c95e-4f4e-9b75-3a2fe4fb9622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b23ac31-0eda-4b24-b7ce-ed874fe75f90", "name": "network-vif-plugged", "status": "completed", "tag": "f07b4a87-1111-4f9a-b68b-99b14b911c73"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:27.257674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-08d7cd43-ee3e-4ff3-89ee-629cb041e78e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:27.264999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-4b729588-b8e8-4a4f-a2c5-614f19b45064 req-15cd89ad-c95e-4f4e-9b75-3a2fe4fb9622 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:27.266031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-4b729588-b8e8-4a4f-a2c5-614f19b45064 req-15cd89ad-c95e-4f4e-9b75-3a2fe4fb9622 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:27.266523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-4b729588-b8e8-4a4f-a2c5-614f19b45064 req-15cd89ad-c95e-4f4e-9b75-3a2fe4fb9622 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:27.274114 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-08d7cd43-ee3e-4ff3-89ee-629cb041e78e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:27.275636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-08d7cd43-ee3e-4ff3-89ee-629cb041e78e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:27.276822 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-08d7cd43-ee3e-4ff3-89ee-629cb041e78e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1745 microversion: 2.20 time: 0.202204 Aug 04 17:13:27.277436 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2141/4356] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:13:27 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1745 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:13:27.283170 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-4b729588-b8e8-4a4f-a2c5-614f19b45064 req-15cd89ad-c95e-4f4e-9b75-3a2fe4fb9622 service nova] Creating event network-vif-plugged:f07b4a87-1111-4f9a-b68b-99b14b911c73 for instance 4b23ac31-0eda-4b24-b7ce-ed874fe75f90 on n-h1-851359-3 Aug 04 17:13:27.283378 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8a440df2-b5ae-48eb-aeb9-1b35ee92f414 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:27.283996 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8a440df2-b5ae-48eb-aeb9-1b35ee92f414 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:27.290032 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a440df2-b5ae-48eb-aeb9-1b35ee92f414 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:27.290526 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a440df2-b5ae-48eb-aeb9-1b35ee92f414 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:27.290969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a440df2-b5ae-48eb-aeb9-1b35ee92f414 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:27.291668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a440df2-b5ae-48eb-aeb9-1b35ee92f414 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:27.292131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a440df2-b5ae-48eb-aeb9-1b35ee92f414 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:27.292561 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a440df2-b5ae-48eb-aeb9-1b35ee92f414 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:27.294852 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-4b729588-b8e8-4a4f-a2c5-614f19b45064 req-15cd89ad-c95e-4f4e-9b75-3a2fe4fb9622 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048361 Aug 04 17:13:27.296170 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2216/4357] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:13:27.364816 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8a440df2-b5ae-48eb-aeb9-1b35ee92f414 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:27.369160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8f74d5dc-52db-4f89-9a8d-4836ed0336ce tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:27.369874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8f74d5dc-52db-4f89-9a8d-4836ed0336ce tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:27.374714 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8a440df2-b5ae-48eb-aeb9-1b35ee92f414 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1228 microversion: 2.1 time: 0.096194 Aug 04 17:13:27.375678 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2142/4358] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:27 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1228 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:27.388632 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8f74d5dc-52db-4f89-9a8d-4836ed0336ce tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:27.388943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e463fd40-dd7b-46e3-9631-5be4ce87587c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:27.389162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8f74d5dc-52db-4f89-9a8d-4836ed0336ce tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:27.389618 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8f74d5dc-52db-4f89-9a8d-4836ed0336ce tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:27.389733 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e463fd40-dd7b-46e3-9631-5be4ce87587c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:27.390387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8f74d5dc-52db-4f89-9a8d-4836ed0336ce tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:27.391475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8f74d5dc-52db-4f89-9a8d-4836ed0336ce tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:27.391906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8f74d5dc-52db-4f89-9a8d-4836ed0336ce tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:27.399949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e463fd40-dd7b-46e3-9631-5be4ce87587c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:27.400529 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e463fd40-dd7b-46e3-9631-5be4ce87587c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:27.401042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e463fd40-dd7b-46e3-9631-5be4ce87587c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:27.402108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e463fd40-dd7b-46e3-9631-5be4ce87587c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:27.402779 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e463fd40-dd7b-46e3-9631-5be4ce87587c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:27.403295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e463fd40-dd7b-46e3-9631-5be4ce87587c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:27.474980 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8f74d5dc-52db-4f89-9a8d-4836ed0336ce tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:27.482834 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8f74d5dc-52db-4f89-9a8d-4836ed0336ce tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1219 microversion: 2.1 time: 0.117889 Aug 04 17:13:27.496376 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2217/4359] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:27 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1219 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:13:27.554471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4088c699-12f3-4b80-9b40-76ef9bc1fe8e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:27.555095 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4088c699-12f3-4b80-9b40-76ef9bc1fe8e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:27.561418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4088c699-12f3-4b80-9b40-76ef9bc1fe8e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:27.561919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4088c699-12f3-4b80-9b40-76ef9bc1fe8e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:27.563021 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4088c699-12f3-4b80-9b40-76ef9bc1fe8e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:27.563983 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4088c699-12f3-4b80-9b40-76ef9bc1fe8e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:27.567251 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e463fd40-dd7b-46e3-9631-5be4ce87587c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:27.575282 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e463fd40-dd7b-46e3-9631-5be4ce87587c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1726 microversion: 2.1 time: 0.190431 Aug 04 17:13:27.575882 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2143/4360] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:27 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1726 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:27.576111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4088c699-12f3-4b80-9b40-76ef9bc1fe8e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:27.576687 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4088c699-12f3-4b80-9b40-76ef9bc1fe8e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:27.597480 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2dbf58aa-538c-48c7-87e9-64e20a65f175 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:27.598001 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2dbf58aa-538c-48c7-87e9-64e20a65f175 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:27.607281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2dbf58aa-538c-48c7-87e9-64e20a65f175 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:27.608011 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2dbf58aa-538c-48c7-87e9-64e20a65f175 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:27.608626 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2dbf58aa-538c-48c7-87e9-64e20a65f175 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:27.610541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2dbf58aa-538c-48c7-87e9-64e20a65f175 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:27.610873 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2dbf58aa-538c-48c7-87e9-64e20a65f175 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:27.611304 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2dbf58aa-538c-48c7-87e9-64e20a65f175 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:27.733319 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2dbf58aa-538c-48c7-87e9-64e20a65f175 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.140952 Aug 04 17:13:27.733910 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2144/4361] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Aug 4 17:13:27 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:13:27.786435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4088c699-12f3-4b80-9b40-76ef9bc1fe8e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:27.800391 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4088c699-12f3-4b80-9b40-76ef9bc1fe8e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba" status: 200 len: 1360 microversion: 2.1 time: 0.249826 Aug 04 17:13:27.801909 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2218/4362] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:27 2022] GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba => generated 1360 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:27.854295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0aaf174d-c20d-42f1-98ba-7d3ec6f04429 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:27.855108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0aaf174d-c20d-42f1-98ba-7d3ec6f04429 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 4b23ac31-0eda-4b24-b7ce-ed874fe75f90] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:27.862092 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0aaf174d-c20d-42f1-98ba-7d3ec6f04429 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:27.862593 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0aaf174d-c20d-42f1-98ba-7d3ec6f04429 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:27.863044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0aaf174d-c20d-42f1-98ba-7d3ec6f04429 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:27.864276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0aaf174d-c20d-42f1-98ba-7d3ec6f04429 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:27.864276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0aaf174d-c20d-42f1-98ba-7d3ec6f04429 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:27.864911 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0aaf174d-c20d-42f1-98ba-7d3ec6f04429 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:28.006859 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0aaf174d-c20d-42f1-98ba-7d3ec6f04429 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:28.015315 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0aaf174d-c20d-42f1-98ba-7d3ec6f04429 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90" status: 200 len: 1320 microversion: 2.1 time: 0.164895 Aug 04 17:13:28.029243 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2145/4363] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:27 2022] GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90 => generated 1320 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:28.300572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9e22f745-b8a0-40d9-b606-b06230860522 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:28.302083 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9e22f745-b8a0-40d9-b606-b06230860522 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:28.309609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e22f745-b8a0-40d9-b606-b06230860522 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:28.310265 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e22f745-b8a0-40d9-b606-b06230860522 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:28.310735 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e22f745-b8a0-40d9-b606-b06230860522 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:28.311450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e22f745-b8a0-40d9-b606-b06230860522 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:28.312342 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e22f745-b8a0-40d9-b606-b06230860522 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:28.313006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e22f745-b8a0-40d9-b606-b06230860522 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:28.397172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-97287523-b6bb-4e32-bbcf-b567003a16c7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:28.397713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-97287523-b6bb-4e32-bbcf-b567003a16c7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:28.406365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97287523-b6bb-4e32-bbcf-b567003a16c7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:28.407949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97287523-b6bb-4e32-bbcf-b567003a16c7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:28.408874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97287523-b6bb-4e32-bbcf-b567003a16c7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:28.409872 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97287523-b6bb-4e32-bbcf-b567003a16c7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:28.414463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97287523-b6bb-4e32-bbcf-b567003a16c7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:28.414951 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97287523-b6bb-4e32-bbcf-b567003a16c7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:28.510716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-97287523-b6bb-4e32-bbcf-b567003a16c7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:28.514160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:28.517100 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9e22f745-b8a0-40d9-b606-b06230860522 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:28.519935 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-97287523-b6bb-4e32-bbcf-b567003a16c7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1228 microversion: 2.1 time: 0.127529 Aug 04 17:13:28.520927 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2146/4364] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:28 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1228 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:28.526263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9e22f745-b8a0-40d9-b606-b06230860522 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:28.527785 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9e22f745-b8a0-40d9-b606-b06230860522 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:28.529135 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9e22f745-b8a0-40d9-b606-b06230860522 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1745 microversion: 2.20 time: 0.232580 Aug 04 17:13:28.538457 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2219/4365] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:13:28 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1745 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:13:28.544848 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e4d88b49-5071-45ac-8bce-c87de82e3afb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:28.545935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e4d88b49-5071-45ac-8bce-c87de82e3afb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:28.553915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4d88b49-5071-45ac-8bce-c87de82e3afb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:28.554693 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4d88b49-5071-45ac-8bce-c87de82e3afb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:28.555295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4d88b49-5071-45ac-8bce-c87de82e3afb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:28.556008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4d88b49-5071-45ac-8bce-c87de82e3afb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:28.556869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4d88b49-5071-45ac-8bce-c87de82e3afb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:28.557704 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4d88b49-5071-45ac-8bce-c87de82e3afb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:28.635354 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e4d88b49-5071-45ac-8bce-c87de82e3afb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:28.648256 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e4d88b49-5071-45ac-8bce-c87de82e3afb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1219 microversion: 2.1 time: 0.109908 Aug 04 17:13:28.648773 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2147/4366] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:28 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1219 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:28.712657 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-8469b68f-c91c-4448-93e4-b25c1be7f7d3 req-f13a001d-e243-4355-8663-8849533f4dfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c74445a-b3fe-4d2a-9dd3-43ab834d369a", "tag": "70fcf2fa-c35a-42df-b9ec-1cb4ff3a8d65"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:28.729545 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8469b68f-c91c-4448-93e4-b25c1be7f7d3 req-f13a001d-e243-4355-8663-8849533f4dfb service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:28.730303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8469b68f-c91c-4448-93e4-b25c1be7f7d3 req-f13a001d-e243-4355-8663-8849533f4dfb service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:28.731021 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8469b68f-c91c-4448-93e4-b25c1be7f7d3 req-f13a001d-e243-4355-8663-8849533f4dfb service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:28.745498 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-8469b68f-c91c-4448-93e4-b25c1be7f7d3 req-f13a001d-e243-4355-8663-8849533f4dfb service nova] Creating event network-changed:70fcf2fa-c35a-42df-b9ec-1cb4ff3a8d65 for instance 0c74445a-b3fe-4d2a-9dd3-43ab834d369a on n-h1-851359-3 Aug 04 17:13:28.750464 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-8469b68f-c91c-4448-93e4-b25c1be7f7d3 req-f13a001d-e243-4355-8663-8849533f4dfb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042559 Aug 04 17:13:28.751069 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2220/4367] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:13:28.821920 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-05910aca-320a-4a15-b903-5cc80f23a29e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:28.822719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-05910aca-320a-4a15-b903-5cc80f23a29e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:28.829889 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05910aca-320a-4a15-b903-5cc80f23a29e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:28.830722 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05910aca-320a-4a15-b903-5cc80f23a29e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:28.831284 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05910aca-320a-4a15-b903-5cc80f23a29e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:28.832161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05910aca-320a-4a15-b903-5cc80f23a29e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:28.832718 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05910aca-320a-4a15-b903-5cc80f23a29e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:28.833358 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05910aca-320a-4a15-b903-5cc80f23a29e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:29.022808 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-05910aca-320a-4a15-b903-5cc80f23a29e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:29.034385 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-05910aca-320a-4a15-b903-5cc80f23a29e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba" status: 200 len: 1360 microversion: 2.1 time: 0.216303 Aug 04 17:13:29.044052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ba23288f-1309-487d-afef-d626559dc255 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:29.046251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ba23288f-1309-487d-afef-d626559dc255 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 4b23ac31-0eda-4b24-b7ce-ed874fe75f90] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:29.050874 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2148/4368] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:28 2022] GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba => generated 1360 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:13:29.079763 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba23288f-1309-487d-afef-d626559dc255 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:29.080708 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba23288f-1309-487d-afef-d626559dc255 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:29.081431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba23288f-1309-487d-afef-d626559dc255 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:29.082656 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba23288f-1309-487d-afef-d626559dc255 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:29.083222 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba23288f-1309-487d-afef-d626559dc255 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:29.084007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba23288f-1309-487d-afef-d626559dc255 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:29.319249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ba23288f-1309-487d-afef-d626559dc255 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:29.327417 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ba23288f-1309-487d-afef-d626559dc255 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90" status: 200 len: 1502 microversion: 2.1 time: 0.293829 Aug 04 17:13:29.338611 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2221/4369] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:29 2022] GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90 => generated 1502 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:13:29.350240 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-277e5f8d-03fe-4fbe-af2d-d0a05b6a50cb tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:29.350881 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-277e5f8d-03fe-4fbe-af2d-d0a05b6a50cb tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 4b23ac31-0eda-4b24-b7ce-ed874fe75f90] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:29.364281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-277e5f8d-03fe-4fbe-af2d-d0a05b6a50cb tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:29.364782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-277e5f8d-03fe-4fbe-af2d-d0a05b6a50cb tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:29.365217 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-277e5f8d-03fe-4fbe-af2d-d0a05b6a50cb tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:29.365923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-277e5f8d-03fe-4fbe-af2d-d0a05b6a50cb tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:29.366427 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-277e5f8d-03fe-4fbe-af2d-d0a05b6a50cb tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:29.366852 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-277e5f8d-03fe-4fbe-af2d-d0a05b6a50cb tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:29.544568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b0b65471-fd73-410a-9db2-b36643528c3f tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:29.545207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b0b65471-fd73-410a-9db2-b36643528c3f tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:29.558201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0b65471-fd73-410a-9db2-b36643528c3f tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:29.558794 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0b65471-fd73-410a-9db2-b36643528c3f tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:29.561020 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0b65471-fd73-410a-9db2-b36643528c3f tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:29.561782 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0b65471-fd73-410a-9db2-b36643528c3f tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:29.562399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0b65471-fd73-410a-9db2-b36643528c3f tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:29.562839 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0b65471-fd73-410a-9db2-b36643528c3f tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:29.584978 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-277e5f8d-03fe-4fbe-af2d-d0a05b6a50cb tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:29.601709 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-277e5f8d-03fe-4fbe-af2d-d0a05b6a50cb tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90" status: 200 len: 1502 microversion: 2.1 time: 0.256035 Aug 04 17:13:29.614089 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2149/4370] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:29 2022] GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90 => generated 1502 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:29.620482 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4ed2cab0-60f2-4fb2-b041-8607c59f1e1d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:29.626211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4ed2cab0-60f2-4fb2-b041-8607c59f1e1d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:29.634133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ed2cab0-60f2-4fb2-b041-8607c59f1e1d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:29.635012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ed2cab0-60f2-4fb2-b041-8607c59f1e1d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:29.635681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ed2cab0-60f2-4fb2-b041-8607c59f1e1d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:29.636675 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ed2cab0-60f2-4fb2-b041-8607c59f1e1d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:29.637361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ed2cab0-60f2-4fb2-b041-8607c59f1e1d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:29.638194 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ed2cab0-60f2-4fb2-b041-8607c59f1e1d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:29.698142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b0b65471-fd73-410a-9db2-b36643528c3f tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:29.713010 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b0b65471-fd73-410a-9db2-b36643528c3f tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1276 microversion: 2.1 time: 0.172679 Aug 04 17:13:29.727539 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2222/4371] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:29 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1276 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:13:29.734452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5090b1c6-4f45-4c29-b694-3b3f33c84e58 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:29.735225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5090b1c6-4f45-4c29-b694-3b3f33c84e58 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 4b23ac31-0eda-4b24-b7ce-ed874fe75f90] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:29.741815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5090b1c6-4f45-4c29-b694-3b3f33c84e58 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:29.742549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5090b1c6-4f45-4c29-b694-3b3f33c84e58 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:29.743158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5090b1c6-4f45-4c29-b694-3b3f33c84e58 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:29.744223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5090b1c6-4f45-4c29-b694-3b3f33c84e58 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:29.744817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5090b1c6-4f45-4c29-b694-3b3f33c84e58 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:29.745379 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5090b1c6-4f45-4c29-b694-3b3f33c84e58 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:29.785720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5090b1c6-4f45-4c29-b694-3b3f33c84e58 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 4b23ac31-0eda-4b24-b7ce-ed874fe75f90] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:13:29.861685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4ed2cab0-60f2-4fb2-b041-8607c59f1e1d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:29.879329 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4ed2cab0-60f2-4fb2-b041-8607c59f1e1d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:29.881425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4ed2cab0-60f2-4fb2-b041-8607c59f1e1d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:29.883222 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4ed2cab0-60f2-4fb2-b041-8607c59f1e1d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1745 microversion: 2.20 time: 0.273369 Aug 04 17:13:29.884022 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2150/4372] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:13:29 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1745 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:13:29.892225 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ac85c6db-7539-4ac4-83d8-0706d586eee4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:29.893392 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ac85c6db-7539-4ac4-83d8-0706d586eee4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:29.902977 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac85c6db-7539-4ac4-83d8-0706d586eee4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:29.903819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac85c6db-7539-4ac4-83d8-0706d586eee4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:29.905169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac85c6db-7539-4ac4-83d8-0706d586eee4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:29.906291 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac85c6db-7539-4ac4-83d8-0706d586eee4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:29.912494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac85c6db-7539-4ac4-83d8-0706d586eee4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:29.913489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac85c6db-7539-4ac4-83d8-0706d586eee4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:29.981163 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5090b1c6-4f45-4c29-b694-3b3f33c84e58 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90" status: 204 len: 0 microversion: 2.1 time: 0.251830 Aug 04 17:13:29.981840 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2223/4373] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:13:29 2022] DELETE /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:13:30.003930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-87ee8eea-cf2f-4d5d-a484-6ae170c3200e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:30.004772 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-87ee8eea-cf2f-4d5d-a484-6ae170c3200e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 4b23ac31-0eda-4b24-b7ce-ed874fe75f90] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:30.019326 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87ee8eea-cf2f-4d5d-a484-6ae170c3200e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:30.019827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87ee8eea-cf2f-4d5d-a484-6ae170c3200e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:30.023681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87ee8eea-cf2f-4d5d-a484-6ae170c3200e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:30.024700 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87ee8eea-cf2f-4d5d-a484-6ae170c3200e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:30.025198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87ee8eea-cf2f-4d5d-a484-6ae170c3200e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:30.025637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87ee8eea-cf2f-4d5d-a484-6ae170c3200e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:30.032371 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ac85c6db-7539-4ac4-83d8-0706d586eee4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:30.046134 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ac85c6db-7539-4ac4-83d8-0706d586eee4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1267 microversion: 2.1 time: 0.159145 Aug 04 17:13:30.048734 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2151/4374] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:29 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:30.067923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ba253687-4b62-4ae7-ad91-5f2cea0a5df0 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:30.068528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ba253687-4b62-4ae7-ad91-5f2cea0a5df0 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:30.079678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba253687-4b62-4ae7-ad91-5f2cea0a5df0 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:30.080185 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba253687-4b62-4ae7-ad91-5f2cea0a5df0 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:30.084268 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba253687-4b62-4ae7-ad91-5f2cea0a5df0 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:30.085444 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba253687-4b62-4ae7-ad91-5f2cea0a5df0 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:30.085944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba253687-4b62-4ae7-ad91-5f2cea0a5df0 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:30.086451 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba253687-4b62-4ae7-ad91-5f2cea0a5df0 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:30.278804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ba253687-4b62-4ae7-ad91-5f2cea0a5df0 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:30.287619 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ba253687-4b62-4ae7-ad91-5f2cea0a5df0 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba" status: 200 len: 1360 microversion: 2.1 time: 0.226126 Aug 04 17:13:30.289087 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2152/4375] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:30 2022] GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba => generated 1360 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:13:30.355738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-87ee8eea-cf2f-4d5d-a484-6ae170c3200e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:30.366599 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-87ee8eea-cf2f-4d5d-a484-6ae170c3200e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90" status: 200 len: 1508 microversion: 2.1 time: 0.376331 Aug 04 17:13:30.367189 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2224/4376] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:29 2022] GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90 => generated 1508 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:30.739790 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1cdf3572-6ce9-456a-8fe6-80b9b4e0e091 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:30.740415 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1cdf3572-6ce9-456a-8fe6-80b9b4e0e091 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:30.748369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cdf3572-6ce9-456a-8fe6-80b9b4e0e091 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:30.748867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cdf3572-6ce9-456a-8fe6-80b9b4e0e091 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:30.749581 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cdf3572-6ce9-456a-8fe6-80b9b4e0e091 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:30.750390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cdf3572-6ce9-456a-8fe6-80b9b4e0e091 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:30.750857 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cdf3572-6ce9-456a-8fe6-80b9b4e0e091 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:30.751558 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cdf3572-6ce9-456a-8fe6-80b9b4e0e091 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:30.802790 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-4b4401f8-61fe-4dcf-b2f2-982721ecb51c req-cc6a9d33-a8a3-44b9-b3e2-03eba0ce4295 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c74445a-b3fe-4d2a-9dd3-43ab834d369a", "tag": "70fcf2fa-c35a-42df-b9ec-1cb4ff3a8d65"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:30.821011 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-4b4401f8-61fe-4dcf-b2f2-982721ecb51c req-cc6a9d33-a8a3-44b9-b3e2-03eba0ce4295 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:30.821599 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-4b4401f8-61fe-4dcf-b2f2-982721ecb51c req-cc6a9d33-a8a3-44b9-b3e2-03eba0ce4295 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:30.822191 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-4b4401f8-61fe-4dcf-b2f2-982721ecb51c req-cc6a9d33-a8a3-44b9-b3e2-03eba0ce4295 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:30.836499 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-4b4401f8-61fe-4dcf-b2f2-982721ecb51c req-cc6a9d33-a8a3-44b9-b3e2-03eba0ce4295 service nova] Creating event network-changed:70fcf2fa-c35a-42df-b9ec-1cb4ff3a8d65 for instance 0c74445a-b3fe-4d2a-9dd3-43ab834d369a on n-h1-851359-3 Aug 04 17:13:30.842581 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-4b4401f8-61fe-4dcf-b2f2-982721ecb51c req-cc6a9d33-a8a3-44b9-b3e2-03eba0ce4295 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045394 Aug 04 17:13:30.844888 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2225/4377] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:13:30.887326 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1cdf3572-6ce9-456a-8fe6-80b9b4e0e091 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:30.900622 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1cdf3572-6ce9-456a-8fe6-80b9b4e0e091 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1282 microversion: 2.1 time: 0.162393 Aug 04 17:13:30.914225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1fe6775c-a434-4c14-88e5-77bcdb48d775 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:30.914337 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1fe6775c-a434-4c14-88e5-77bcdb48d775 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:30.925904 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2153/4378] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:30 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1282 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:30.927774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1fe6775c-a434-4c14-88e5-77bcdb48d775 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:30.928723 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1fe6775c-a434-4c14-88e5-77bcdb48d775 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:30.929599 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1fe6775c-a434-4c14-88e5-77bcdb48d775 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:30.930495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1fe6775c-a434-4c14-88e5-77bcdb48d775 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:30.931110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1fe6775c-a434-4c14-88e5-77bcdb48d775 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:30.931557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1fe6775c-a434-4c14-88e5-77bcdb48d775 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:31.069770 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3f49cf84-dac0-4ce2-9a5d-b3eb577d6040 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:31.070771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3f49cf84-dac0-4ce2-9a5d-b3eb577d6040 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:31.086342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f49cf84-dac0-4ce2-9a5d-b3eb577d6040 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:31.087867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f49cf84-dac0-4ce2-9a5d-b3eb577d6040 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:31.088656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f49cf84-dac0-4ce2-9a5d-b3eb577d6040 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:31.091120 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f49cf84-dac0-4ce2-9a5d-b3eb577d6040 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:31.092561 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f49cf84-dac0-4ce2-9a5d-b3eb577d6040 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:31.093478 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f49cf84-dac0-4ce2-9a5d-b3eb577d6040 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:31.222906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1fe6775c-a434-4c14-88e5-77bcdb48d775 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:31.236161 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1fe6775c-a434-4c14-88e5-77bcdb48d775 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:31.238927 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1fe6775c-a434-4c14-88e5-77bcdb48d775 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:31.242042 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1fe6775c-a434-4c14-88e5-77bcdb48d775 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1740 microversion: 2.20 time: 0.334774 Aug 04 17:13:31.245857 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2226/4379] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:13:30 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1740 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:13:31.254317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3f49cf84-dac0-4ce2-9a5d-b3eb577d6040 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:31.265345 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3f49cf84-dac0-4ce2-9a5d-b3eb577d6040 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1273 microversion: 2.1 time: 0.200297 Aug 04 17:13:31.266298 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2154/4380] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:31 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1273 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:31.309469 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ebebb952-5760-4693-b5d3-f9939fe78c7a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:31.310131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ebebb952-5760-4693-b5d3-f9939fe78c7a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:31.321202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ebebb952-5760-4693-b5d3-f9939fe78c7a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:31.321799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ebebb952-5760-4693-b5d3-f9939fe78c7a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:31.322375 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ebebb952-5760-4693-b5d3-f9939fe78c7a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:31.323160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ebebb952-5760-4693-b5d3-f9939fe78c7a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:31.323667 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ebebb952-5760-4693-b5d3-f9939fe78c7a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:31.324160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ebebb952-5760-4693-b5d3-f9939fe78c7a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:31.390742 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cdc60067-4b43-4aae-b44e-652eb4b9cb09 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:31.391548 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cdc60067-4b43-4aae-b44e-652eb4b9cb09 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 4b23ac31-0eda-4b24-b7ce-ed874fe75f90] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:31.401621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cdc60067-4b43-4aae-b44e-652eb4b9cb09 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:31.402312 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cdc60067-4b43-4aae-b44e-652eb4b9cb09 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:31.402913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cdc60067-4b43-4aae-b44e-652eb4b9cb09 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:31.403788 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cdc60067-4b43-4aae-b44e-652eb4b9cb09 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:31.404388 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cdc60067-4b43-4aae-b44e-652eb4b9cb09 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:31.404886 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cdc60067-4b43-4aae-b44e-652eb4b9cb09 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:31.703887 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ebebb952-5760-4693-b5d3-f9939fe78c7a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:31.716753 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ebebb952-5760-4693-b5d3-f9939fe78c7a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba" status: 200 len: 1360 microversion: 2.1 time: 0.410563 Aug 04 17:13:31.731706 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2227/4381] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:31 2022] GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba => generated 1360 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:31.747048 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cdc60067-4b43-4aae-b44e-652eb4b9cb09 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:31.762289 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cdc60067-4b43-4aae-b44e-652eb4b9cb09 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90" status: 200 len: 1508 microversion: 2.1 time: 0.373400 Aug 04 17:13:31.764446 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2155/4382] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:31 2022] GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90 => generated 1508 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:31.927308 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f38bb2e6-1ba3-4e5a-aafa-13ef866d4091 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:31.928159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f38bb2e6-1ba3-4e5a-aafa-13ef866d4091 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:31.947952 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f38bb2e6-1ba3-4e5a-aafa-13ef866d4091 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:31.971333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f38bb2e6-1ba3-4e5a-aafa-13ef866d4091 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:31.971861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f38bb2e6-1ba3-4e5a-aafa-13ef866d4091 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:31.972639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f38bb2e6-1ba3-4e5a-aafa-13ef866d4091 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:31.973130 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f38bb2e6-1ba3-4e5a-aafa-13ef866d4091 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:31.973567 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f38bb2e6-1ba3-4e5a-aafa-13ef866d4091 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:32.270054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b506d66b-b681-4376-a6b6-42c910cae9ef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:32.270614 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b506d66b-b681-4376-a6b6-42c910cae9ef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:32.281379 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b506d66b-b681-4376-a6b6-42c910cae9ef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:32.281881 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b506d66b-b681-4376-a6b6-42c910cae9ef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:32.283136 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b506d66b-b681-4376-a6b6-42c910cae9ef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:32.285566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b506d66b-b681-4376-a6b6-42c910cae9ef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:32.285913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b506d66b-b681-4376-a6b6-42c910cae9ef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:32.287233 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b506d66b-b681-4376-a6b6-42c910cae9ef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:32.989374 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f38bb2e6-1ba3-4e5a-aafa-13ef866d4091 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:33.000841 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f38bb2e6-1ba3-4e5a-aafa-13ef866d4091 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1324 microversion: 2.1 time: 1.078268 Aug 04 17:13:33.017788 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2228/4383] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:31 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1324 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:33.023587 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-201b331b-a51a-4df8-9551-2d0854460d69 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:33.024575 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-201b331b-a51a-4df8-9551-2d0854460d69 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:33.033832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-201b331b-a51a-4df8-9551-2d0854460d69 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:33.034842 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-201b331b-a51a-4df8-9551-2d0854460d69 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:33.035648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-201b331b-a51a-4df8-9551-2d0854460d69 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:33.036887 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-201b331b-a51a-4df8-9551-2d0854460d69 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:33.041203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-201b331b-a51a-4df8-9551-2d0854460d69 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:33.041889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-201b331b-a51a-4df8-9551-2d0854460d69 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:33.173479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b506d66b-b681-4376-a6b6-42c910cae9ef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:33.190828 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b506d66b-b681-4376-a6b6-42c910cae9ef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:33.192356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b506d66b-b681-4376-a6b6-42c910cae9ef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:33.210190 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b506d66b-b681-4376-a6b6-42c910cae9ef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1740 microversion: 2.20 time: 0.941485 Aug 04 17:13:33.213154 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2156/4384] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:13:32 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1740 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:13:33.224908 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f7b1e913-42f4-4ba3-aa8f-65b30c9ff5c1 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:33.237217 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f7b1e913-42f4-4ba3-aa8f-65b30c9ff5c1 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:33.254568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7b1e913-42f4-4ba3-aa8f-65b30c9ff5c1 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:33.256757 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7b1e913-42f4-4ba3-aa8f-65b30c9ff5c1 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:33.257268 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7b1e913-42f4-4ba3-aa8f-65b30c9ff5c1 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:33.259811 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7b1e913-42f4-4ba3-aa8f-65b30c9ff5c1 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:33.262163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7b1e913-42f4-4ba3-aa8f-65b30c9ff5c1 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:33.262626 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7b1e913-42f4-4ba3-aa8f-65b30c9ff5c1 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:34.023311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-201b331b-a51a-4df8-9551-2d0854460d69 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:34.036177 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-201b331b-a51a-4df8-9551-2d0854460d69 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1315 microversion: 2.1 time: 1.016908 Aug 04 17:13:34.043849 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2229/4385] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:33 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1315 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:34.052868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d156fbc0-021f-4b39-b4f6-fd93295415e5 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:34.061457 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d156fbc0-021f-4b39-b4f6-fd93295415e5 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 4b23ac31-0eda-4b24-b7ce-ed874fe75f90] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:34.081512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f7b1e913-42f4-4ba3-aa8f-65b30c9ff5c1 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:34.096872 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f7b1e913-42f4-4ba3-aa8f-65b30c9ff5c1 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba" status: 200 len: 1360 microversion: 2.1 time: 0.876511 Aug 04 17:13:34.097851 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2157/4386] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:33 2022] GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba => generated 1360 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:34.099363 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d156fbc0-021f-4b39-b4f6-fd93295415e5 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:34.102024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d156fbc0-021f-4b39-b4f6-fd93295415e5 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:34.106148 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-f0efbbc9-f415-4cae-8adc-d1a28ac0c421 req-fcedc45b-76fe-49f0-b62d-67530661a0ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b23ac31-0eda-4b24-b7ce-ed874fe75f90", "name": "network-vif-deleted", "tag": "f07b4a87-1111-4f9a-b68b-99b14b911c73"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:34.106952 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d156fbc0-021f-4b39-b4f6-fd93295415e5 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:34.110586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d156fbc0-021f-4b39-b4f6-fd93295415e5 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:34.112165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d156fbc0-021f-4b39-b4f6-fd93295415e5 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:34.114318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d156fbc0-021f-4b39-b4f6-fd93295415e5 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:34.160791 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f0efbbc9-f415-4cae-8adc-d1a28ac0c421 req-fcedc45b-76fe-49f0-b62d-67530661a0ac service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:34.165327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f0efbbc9-f415-4cae-8adc-d1a28ac0c421 req-fcedc45b-76fe-49f0-b62d-67530661a0ac service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:34.166112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f0efbbc9-f415-4cae-8adc-d1a28ac0c421 req-fcedc45b-76fe-49f0-b62d-67530661a0ac service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:34.207596 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:34.210996 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-f0efbbc9-f415-4cae-8adc-d1a28ac0c421 req-fcedc45b-76fe-49f0-b62d-67530661a0ac service nova] Creating event network-vif-deleted:f07b4a87-1111-4f9a-b68b-99b14b911c73 for instance 4b23ac31-0eda-4b24-b7ce-ed874fe75f90 on n-h1-851359-3 Aug 04 17:13:34.240541 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-f0efbbc9-f415-4cae-8adc-d1a28ac0c421 req-fcedc45b-76fe-49f0-b62d-67530661a0ac service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132758 Aug 04 17:13:34.241640 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2158/4387] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:13:34.266717 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a5ed3b0b-4e54-4ed5-9ec6-cd94723deeae tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:34.275357 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a5ed3b0b-4e54-4ed5-9ec6-cd94723deeae tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:34.285793 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d156fbc0-021f-4b39-b4f6-fd93295415e5 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:34.308557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d156fbc0-021f-4b39-b4f6-fd93295415e5 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:34.309533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d156fbc0-021f-4b39-b4f6-fd93295415e5 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:34.310300 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-d156fbc0-021f-4b39-b4f6-fd93295415e5 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lazy-loading 'fault' on Instance uuid 4b23ac31-0eda-4b24-b7ce-ed874fe75f90 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:13:34.317587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5ed3b0b-4e54-4ed5-9ec6-cd94723deeae tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:34.321355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5ed3b0b-4e54-4ed5-9ec6-cd94723deeae tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:34.322123 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5ed3b0b-4e54-4ed5-9ec6-cd94723deeae tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:34.323094 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5ed3b0b-4e54-4ed5-9ec6-cd94723deeae tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:34.325703 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5ed3b0b-4e54-4ed5-9ec6-cd94723deeae tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:34.327873 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5ed3b0b-4e54-4ed5-9ec6-cd94723deeae tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:34.642100 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d156fbc0-021f-4b39-b4f6-fd93295415e5 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:34.651837 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d156fbc0-021f-4b39-b4f6-fd93295415e5 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90" status: 200 len: 1310 microversion: 2.1 time: 0.606465 Aug 04 17:13:34.653280 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2230/4388] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:34 2022] GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90 => generated 1310 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:34.661571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-25cdec7d-4b83-4fc0-9088-35671425a4c0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:34.662514 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-25cdec7d-4b83-4fc0-9088-35671425a4c0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:34.670558 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25cdec7d-4b83-4fc0-9088-35671425a4c0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:34.672292 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25cdec7d-4b83-4fc0-9088-35671425a4c0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:34.672909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25cdec7d-4b83-4fc0-9088-35671425a4c0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:34.673804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25cdec7d-4b83-4fc0-9088-35671425a4c0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:34.674439 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25cdec7d-4b83-4fc0-9088-35671425a4c0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:34.675013 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25cdec7d-4b83-4fc0-9088-35671425a4c0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:34.877565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a5ed3b0b-4e54-4ed5-9ec6-cd94723deeae tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:34.890926 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a5ed3b0b-4e54-4ed5-9ec6-cd94723deeae tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1324 microversion: 2.1 time: 0.636500 Aug 04 17:13:34.908055 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2159/4389] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:34 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1324 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:35.066265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-21d5cc56-f1bd-4a36-8c5b-84aa6b420332 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:35.067136 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-21d5cc56-f1bd-4a36-8c5b-84aa6b420332 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:35.083681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-25cdec7d-4b83-4fc0-9088-35671425a4c0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:35.084220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21d5cc56-f1bd-4a36-8c5b-84aa6b420332 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:35.087655 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21d5cc56-f1bd-4a36-8c5b-84aa6b420332 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:35.091404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21d5cc56-f1bd-4a36-8c5b-84aa6b420332 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:35.095580 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21d5cc56-f1bd-4a36-8c5b-84aa6b420332 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:35.096631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-25cdec7d-4b83-4fc0-9088-35671425a4c0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:35.098012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21d5cc56-f1bd-4a36-8c5b-84aa6b420332 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:35.100908 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21d5cc56-f1bd-4a36-8c5b-84aa6b420332 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:35.103324 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-25cdec7d-4b83-4fc0-9088-35671425a4c0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:35.107375 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-25cdec7d-4b83-4fc0-9088-35671425a4c0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1740 microversion: 2.20 time: 0.452789 Aug 04 17:13:35.108167 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2231/4390] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:13:34 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1740 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:13:35.118574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d295ed11-0912-492c-ae7c-1dcab2216fca tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:35.123833 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d295ed11-0912-492c-ae7c-1dcab2216fca tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:35.141814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d295ed11-0912-492c-ae7c-1dcab2216fca tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:35.144102 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d295ed11-0912-492c-ae7c-1dcab2216fca tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:35.146042 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d295ed11-0912-492c-ae7c-1dcab2216fca tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:35.146965 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d295ed11-0912-492c-ae7c-1dcab2216fca tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:35.151173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d295ed11-0912-492c-ae7c-1dcab2216fca tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:35.151819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d295ed11-0912-492c-ae7c-1dcab2216fca tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:35.536613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d295ed11-0912-492c-ae7c-1dcab2216fca tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:35.548338 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d295ed11-0912-492c-ae7c-1dcab2216fca tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba" status: 200 len: 1360 microversion: 2.1 time: 0.433481 Aug 04 17:13:35.554717 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2232/4391] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:35 2022] GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba => generated 1360 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:13:35.574887 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-21d5cc56-f1bd-4a36-8c5b-84aa6b420332 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:35.595333 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-21d5cc56-f1bd-4a36-8c5b-84aa6b420332 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1315 microversion: 2.1 time: 0.534088 Aug 04 17:13:35.596108 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2160/4392] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:35 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1315 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:35.639813 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-65553a9a-9883-4e52-b6b9-608c3e1cff0c req-4950e2cd-bf6d-43b6-bd43-cbcddef2db90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9567ac7-9ee0-4ae3-b7c7-6033039de89d", "tag": "aca16109-3001-402b-99ec-6923c19c2dfc"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:35.655037 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-65553a9a-9883-4e52-b6b9-608c3e1cff0c req-4950e2cd-bf6d-43b6-bd43-cbcddef2db90 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:35.655522 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-65553a9a-9883-4e52-b6b9-608c3e1cff0c req-4950e2cd-bf6d-43b6-bd43-cbcddef2db90 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:35.656626 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-65553a9a-9883-4e52-b6b9-608c3e1cff0c req-4950e2cd-bf6d-43b6-bd43-cbcddef2db90 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:35.677837 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e2e1ca51-3453-4eb1-8754-a03db47ccd07 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:35.678529 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e2e1ca51-3453-4eb1-8754-a03db47ccd07 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 4b23ac31-0eda-4b24-b7ce-ed874fe75f90] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:35.687391 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-65553a9a-9883-4e52-b6b9-608c3e1cff0c req-4950e2cd-bf6d-43b6-bd43-cbcddef2db90 service nova] Creating event network-changed:aca16109-3001-402b-99ec-6923c19c2dfc for instance a9567ac7-9ee0-4ae3-b7c7-6033039de89d on n-h2-851359-3 Aug 04 17:13:35.699342 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-65553a9a-9883-4e52-b6b9-608c3e1cff0c req-4950e2cd-bf6d-43b6-bd43-cbcddef2db90 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065949 Aug 04 17:13:35.700211 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2233/4393] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:13:35.704804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2e1ca51-3453-4eb1-8754-a03db47ccd07 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:35.705856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2e1ca51-3453-4eb1-8754-a03db47ccd07 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:35.706558 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2e1ca51-3453-4eb1-8754-a03db47ccd07 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:35.708225 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2e1ca51-3453-4eb1-8754-a03db47ccd07 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:35.708762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2e1ca51-3453-4eb1-8754-a03db47ccd07 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:35.709268 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2e1ca51-3453-4eb1-8754-a03db47ccd07 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:35.727325 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-e2e1ca51-3453-4eb1-8754-a03db47ccd07 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] HTTP exception thrown: Instance 4b23ac31-0eda-4b24-b7ce-ed874fe75f90 could not be found. Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e2e1ca51-3453-4eb1-8754-a03db47ccd07 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Request method failure captured: Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90 HTTP/1.1 Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_4PiXAoqFPCXVrtw_fcVtbWCRHCRY1BcfprLEe-EkZEFmD3rLGum9OIJcRnH-o3xr4k8T7yl4V2Hv5h2fEBByVUFBw2XIbz_i_ncVR1MMvkDEp1AvjPEGXUtr2hnsv9JoWINOTj84eRxq_Gac5VyTIxXMDaWbVLw5VeWNnbunOt5QM Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d9911aeb77cd4ffb8c4e539998a04f3c"}]}] Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersTestJSON-1653035612 Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersTestJSON-1653035612-project Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 8e840d06bb5d44e097e6f0855b04cb06 Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersTestJSON-1653035612-project Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 4b23ac31-0eda-4b24-b7ce-ed874fe75f90 could not be found. Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '4b23ac31-0eda-4b24-b7ce-ed874fe75f90'} Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b23ac31-0eda-4b24-b7ce-ed874fe75f90 could not be found. Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b23ac31-0eda-4b24-b7ce-ed874fe75f90 could not be found. Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:13:35.729110 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:13:35.733577 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:13:35.733577 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:13:35.733577 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:13:35.733577 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:13:35.733577 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:13:35.733577 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b23ac31-0eda-4b24-b7ce-ed874fe75f90 could not be found. Aug 04 17:13:35.733577 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:13:35.733577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e2e1ca51-3453-4eb1-8754-a03db47ccd07 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Returning 404 to user: Instance 4b23ac31-0eda-4b24-b7ce-ed874fe75f90 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:13:35.733577 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e2e1ca51-3453-4eb1-8754-a03db47ccd07 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90" status: 404 len: 111 microversion: 2.1 time: 0.058542 Aug 04 17:13:35.735325 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2161/4394] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:35 2022] GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:13:35.747856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d8d21936-6c9e-4d07-9d40-275e2192a61e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Action: 'create', calling method: .version_select at 0x7f1e5ac2b280>, body: {"keypair": {"name": "tempest-key-1724597866", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1lVjI5hafkUCw9q/FGFwMo1Q1yJGEJpnjDPIpgNxd3b9U8geQHqMDwbHR1405pkaZt6thqLnQk6ZBBAePfrEWWVh7268vFs2M1ToxBg1LYZlSF9V188pP2n3S5aAufWw=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:35.779352 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-d8d21936-6c9e-4d07-9d40-275e2192a61e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Getting quotas for project d9911aeb77cd4ffb8c4e539998a04f3c. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:13:35.785694 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-d8d21936-6c9e-4d07-9d40-275e2192a61e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Getting quotas for user 8e840d06bb5d44e097e6f0855b04cb06 and project d9911aeb77cd4ffb8c4e539998a04f3c. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:13:35.814773 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d8d21936-6c9e-4d07-9d40-275e2192a61e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.070938 Aug 04 17:13:35.816780 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2234/4395] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:13:35 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:13:35.827330 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-719eefe9-8eb7-4abb-a9c1-5b20a08a973c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '.version_select at 0x7f1e5b3b2a60>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:35.832732 n-d-851359-3 devstack@n-api.service[131044]: WARNING oslo_db.sqlalchemy.utils [None req-719eefe9-8eb7-4abb-a9c1-5b20a08a973c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 04 17:13:35.840900 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-719eefe9-8eb7-4abb-a9c1-5b20a08a973c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.018092 Aug 04 17:13:35.841748 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2162/4396] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Aug 4 17:13:35 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:13:35.912755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-80fa979c-31c0-4fe6-aec6-87023d4f9120 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:35.913612 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-80fa979c-31c0-4fe6-aec6-87023d4f9120 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:35.920149 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80fa979c-31c0-4fe6-aec6-87023d4f9120 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:35.920911 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80fa979c-31c0-4fe6-aec6-87023d4f9120 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:35.921500 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80fa979c-31c0-4fe6-aec6-87023d4f9120 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:35.922338 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80fa979c-31c0-4fe6-aec6-87023d4f9120 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:35.922928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80fa979c-31c0-4fe6-aec6-87023d4f9120 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:35.923445 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80fa979c-31c0-4fe6-aec6-87023d4f9120 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:35.992349 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7967c2de-0f3d-41ea-8fbd-cf39e280a39a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-367379681", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "key_name": "tempest-key-1724597866", "networks": [{"uuid": "ec3b7b59-9fd4-4839-add6-43afeffa896c"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:36.016449 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=8 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:36.092807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-7967c2de-0f3d-41ea-8fbd-cf39e280a39a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] validate_networks() for [('ec3b7b59-9fd4-4839-add6-43afeffa896c', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:13:36.202966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-80fa979c-31c0-4fe6-aec6-87023d4f9120 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:36.213115 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-80fa979c-31c0-4fe6-aec6-87023d4f9120 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1324 microversion: 2.1 time: 0.304168 Aug 04 17:13:36.223196 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2235/4397] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:35 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1324 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:36.243117 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-32434d86-af8a-48fd-a041-7616a579a9f7 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:36.246947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-32434d86-af8a-48fd-a041-7616a579a9f7 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:36.261941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32434d86-af8a-48fd-a041-7616a579a9f7 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:36.262736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32434d86-af8a-48fd-a041-7616a579a9f7 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:36.263325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32434d86-af8a-48fd-a041-7616a579a9f7 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:36.264199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32434d86-af8a-48fd-a041-7616a579a9f7 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:36.268563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32434d86-af8a-48fd-a041-7616a579a9f7 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:36.269194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32434d86-af8a-48fd-a041-7616a579a9f7 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:36.339026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=42 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:36.596650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-32434d86-af8a-48fd-a041-7616a579a9f7 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:36.628183 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-32434d86-af8a-48fd-a041-7616a579a9f7 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:36.630773 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-32434d86-af8a-48fd-a041-7616a579a9f7 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:36.632555 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-32434d86-af8a-48fd-a041-7616a579a9f7 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1740 microversion: 2.20 time: 0.406343 Aug 04 17:13:36.633870 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2236/4398] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:13:36 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1740 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:13:36.655804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-4e43e841-a2ad-4906-b787-0d36fa65ad70 req-6f807982-7807-42e4-97d3-b7c6bec7b4c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a741b004-2f32-419c-aada-de12ed0cd36e", "tag": "4ce7718f-85dc-4011-b3ce-a182614aceb6"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:36.684778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-4e43e841-a2ad-4906-b787-0d36fa65ad70 req-6f807982-7807-42e4-97d3-b7c6bec7b4c5 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:36.685612 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-4e43e841-a2ad-4906-b787-0d36fa65ad70 req-6f807982-7807-42e4-97d3-b7c6bec7b4c5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:36.686339 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-4e43e841-a2ad-4906-b787-0d36fa65ad70 req-6f807982-7807-42e4-97d3-b7c6bec7b4c5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:36.700293 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-4e43e841-a2ad-4906-b787-0d36fa65ad70 req-6f807982-7807-42e4-97d3-b7c6bec7b4c5 service nova] Creating event network-changed:4ce7718f-85dc-4011-b3ce-a182614aceb6 for instance a741b004-2f32-419c-aada-de12ed0cd36e on n-h2-851359-3 Aug 04 17:13:36.707087 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-4e43e841-a2ad-4906-b787-0d36fa65ad70 req-6f807982-7807-42e4-97d3-b7c6bec7b4c5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071276 Aug 04 17:13:36.719995 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2237/4399] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:13:36.727655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-55cb7522-55bc-4c6f-8cee-49e46c1bf08c req-4cfe9efc-af1e-40c0-ac80-c6541be78816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81a3d940-08e3-4cb9-bbf2-360653411aba", "name": "network-vif-plugged", "status": "completed", "tag": "740dcb36-902c-495f-9a80-a8a83db55035"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:36.739967 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-55cb7522-55bc-4c6f-8cee-49e46c1bf08c req-4cfe9efc-af1e-40c0-ac80-c6541be78816 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:36.740682 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-55cb7522-55bc-4c6f-8cee-49e46c1bf08c req-4cfe9efc-af1e-40c0-ac80-c6541be78816 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:36.741309 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-55cb7522-55bc-4c6f-8cee-49e46c1bf08c req-4cfe9efc-af1e-40c0-ac80-c6541be78816 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:36.753831 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-55cb7522-55bc-4c6f-8cee-49e46c1bf08c req-4cfe9efc-af1e-40c0-ac80-c6541be78816 service nova] Creating event network-vif-plugged:740dcb36-902c-495f-9a80-a8a83db55035 for instance 81a3d940-08e3-4cb9-bbf2-360653411aba on n-h2-851359-3 Aug 04 17:13:36.759118 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-55cb7522-55bc-4c6f-8cee-49e46c1bf08c req-4cfe9efc-af1e-40c0-ac80-c6541be78816 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037141 Aug 04 17:13:36.759943 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2238/4400] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:13:36.769517 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-27e55240-01e3-4950-85a5-97c13759f08a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:36.770465 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-27e55240-01e3-4950-85a5-97c13759f08a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:36.776980 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-27e55240-01e3-4950-85a5-97c13759f08a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:36.777484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-27e55240-01e3-4950-85a5-97c13759f08a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:36.777934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-27e55240-01e3-4950-85a5-97c13759f08a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:36.778682 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-27e55240-01e3-4950-85a5-97c13759f08a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:36.779144 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-27e55240-01e3-4950-85a5-97c13759f08a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:36.779575 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-27e55240-01e3-4950-85a5-97c13759f08a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:36.780290 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7967c2de-0f3d-41ea-8fbd-cf39e280a39a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:13:36.781000 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7967c2de-0f3d-41ea-8fbd-cf39e280a39a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:13:36.781582 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7967c2de-0f3d-41ea-8fbd-cf39e280a39a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:13:36.782518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7967c2de-0f3d-41ea-8fbd-cf39e280a39a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:13:36.782518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7967c2de-0f3d-41ea-8fbd-cf39e280a39a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:13:36.793683 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7967c2de-0f3d-41ea-8fbd-cf39e280a39a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:36.794197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7967c2de-0f3d-41ea-8fbd-cf39e280a39a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:36.794636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7967c2de-0f3d-41ea-8fbd-cf39e280a39a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:36.795677 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7967c2de-0f3d-41ea-8fbd-cf39e280a39a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:36.796843 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7967c2de-0f3d-41ea-8fbd-cf39e280a39a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:36.797273 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7967c2de-0f3d-41ea-8fbd-cf39e280a39a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:36.822647 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-7967c2de-0f3d-41ea-8fbd-cf39e280a39a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Getting quotas for project d9911aeb77cd4ffb8c4e539998a04f3c. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:13:36.829407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-7967c2de-0f3d-41ea-8fbd-cf39e280a39a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Getting quotas for user 8e840d06bb5d44e097e6f0855b04cb06 and project d9911aeb77cd4ffb8c4e539998a04f3c. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:13:36.844651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7967c2de-0f3d-41ea-8fbd-cf39e280a39a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:13:36.848133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7967c2de-0f3d-41ea-8fbd-cf39e280a39a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 43df9f1d-da75-43f5-90ae-e5eaacdb4f02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:13:36.935890 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7967c2de-0f3d-41ea-8fbd-cf39e280a39a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.942460 Aug 04 17:13:36.936827 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2163/4401] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:13:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 17:13:36.943946 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-27e55240-01e3-4950-85a5-97c13759f08a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:36.950389 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-27e55240-01e3-4950-85a5-97c13759f08a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba" status: 200 len: 1360 microversion: 2.1 time: 0.185218 Aug 04 17:13:36.951077 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2239/4402] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:36 2022] GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba => generated 1360 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:36.957788 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e440d52e-96e8-49af-b17a-56004fb328bd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:36.958729 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e440d52e-96e8-49af-b17a-56004fb328bd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:36.970444 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e440d52e-96e8-49af-b17a-56004fb328bd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:36.971811 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e440d52e-96e8-49af-b17a-56004fb328bd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:36.972096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-45682e46-cd18-41a7-87be-ba63b2d4eb5a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:36.972977 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-45682e46-cd18-41a7-87be-ba63b2d4eb5a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 43df9f1d-da75-43f5-90ae-e5eaacdb4f02] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:36.973615 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e440d52e-96e8-49af-b17a-56004fb328bd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:36.974609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e440d52e-96e8-49af-b17a-56004fb328bd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:36.975234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e440d52e-96e8-49af-b17a-56004fb328bd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:36.992708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e440d52e-96e8-49af-b17a-56004fb328bd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:37.049492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-45682e46-cd18-41a7-87be-ba63b2d4eb5a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:37.067849 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-45682e46-cd18-41a7-87be-ba63b2d4eb5a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02" status: 200 len: 1228 microversion: 2.1 time: 0.115473 Aug 04 17:13:37.071054 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2240/4403] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:36 2022] GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02 => generated 1228 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:37.223761 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e440d52e-96e8-49af-b17a-56004fb328bd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:37.235669 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e440d52e-96e8-49af-b17a-56004fb328bd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1315 microversion: 2.1 time: 0.287624 Aug 04 17:13:37.238362 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2164/4404] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:36 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:37.251881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a88d6de6-c27c-4c89-8393-e16676486a6b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:37.252531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a88d6de6-c27c-4c89-8393-e16676486a6b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:37.266903 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a88d6de6-c27c-4c89-8393-e16676486a6b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:37.268006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a88d6de6-c27c-4c89-8393-e16676486a6b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:37.268666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a88d6de6-c27c-4c89-8393-e16676486a6b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:37.270016 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a88d6de6-c27c-4c89-8393-e16676486a6b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:37.270597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a88d6de6-c27c-4c89-8393-e16676486a6b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:37.271843 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a88d6de6-c27c-4c89-8393-e16676486a6b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:37.493071 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a88d6de6-c27c-4c89-8393-e16676486a6b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:37.504982 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a88d6de6-c27c-4c89-8393-e16676486a6b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1324 microversion: 2.1 time: 0.272428 Aug 04 17:13:37.514331 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2241/4405] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:37 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1324 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:13:37.657716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-65c84289-ee0c-4163-a20d-73a3e90b76ee tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:37.658602 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-65c84289-ee0c-4163-a20d-73a3e90b76ee tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:37.667279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65c84289-ee0c-4163-a20d-73a3e90b76ee tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:37.668179 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65c84289-ee0c-4163-a20d-73a3e90b76ee tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:37.668970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65c84289-ee0c-4163-a20d-73a3e90b76ee tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:37.670719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65c84289-ee0c-4163-a20d-73a3e90b76ee tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:37.672901 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65c84289-ee0c-4163-a20d-73a3e90b76ee tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:37.674327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65c84289-ee0c-4163-a20d-73a3e90b76ee tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:37.862238 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-65c84289-ee0c-4163-a20d-73a3e90b76ee tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:37.871401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-65c84289-ee0c-4163-a20d-73a3e90b76ee tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:37.873563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-65c84289-ee0c-4163-a20d-73a3e90b76ee tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:37.875046 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-65c84289-ee0c-4163-a20d-73a3e90b76ee tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1740 microversion: 2.20 time: 0.222185 Aug 04 17:13:37.876290 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2165/4406] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:13:37 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1740 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:13:37.972636 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d52d9a2e-6b60-4b0f-8f58-1a829be3d351 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:37.973540 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d52d9a2e-6b60-4b0f-8f58-1a829be3d351 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:37.986910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d52d9a2e-6b60-4b0f-8f58-1a829be3d351 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:37.990165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d52d9a2e-6b60-4b0f-8f58-1a829be3d351 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:37.990799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d52d9a2e-6b60-4b0f-8f58-1a829be3d351 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:37.991688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d52d9a2e-6b60-4b0f-8f58-1a829be3d351 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:37.995418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d52d9a2e-6b60-4b0f-8f58-1a829be3d351 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:37.996059 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d52d9a2e-6b60-4b0f-8f58-1a829be3d351 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:38.100796 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-241fcb17-f80c-4667-9836-e1041c6f9b8d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:38.102754 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-241fcb17-f80c-4667-9836-e1041c6f9b8d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 43df9f1d-da75-43f5-90ae-e5eaacdb4f02] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:38.123335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-241fcb17-f80c-4667-9836-e1041c6f9b8d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:38.125624 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-241fcb17-f80c-4667-9836-e1041c6f9b8d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:38.126246 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-241fcb17-f80c-4667-9836-e1041c6f9b8d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:38.127161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-241fcb17-f80c-4667-9836-e1041c6f9b8d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:38.130584 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-241fcb17-f80c-4667-9836-e1041c6f9b8d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:38.131238 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-241fcb17-f80c-4667-9836-e1041c6f9b8d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:38.218381 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:38.235195 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d52d9a2e-6b60-4b0f-8f58-1a829be3d351 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:38.244422 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d52d9a2e-6b60-4b0f-8f58-1a829be3d351 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba" status: 200 len: 1360 microversion: 2.1 time: 0.276979 Aug 04 17:13:38.245620 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2242/4407] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:37 2022] GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba => generated 1360 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:38.267329 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0ea13af8-03ba-4062-b908-249df66deb2e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:38.268762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0ea13af8-03ba-4062-b908-249df66deb2e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:38.277931 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ea13af8-03ba-4062-b908-249df66deb2e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:38.278789 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ea13af8-03ba-4062-b908-249df66deb2e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:38.279493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ea13af8-03ba-4062-b908-249df66deb2e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:38.280744 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ea13af8-03ba-4062-b908-249df66deb2e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:38.281702 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ea13af8-03ba-4062-b908-249df66deb2e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:38.282493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ea13af8-03ba-4062-b908-249df66deb2e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:38.288133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-241fcb17-f80c-4667-9836-e1041c6f9b8d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:38.299880 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-241fcb17-f80c-4667-9836-e1041c6f9b8d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02" status: 200 len: 1280 microversion: 2.1 time: 0.210139 Aug 04 17:13:38.301262 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2166/4408] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:38 2022] GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02 => generated 1280 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:38.454903 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0ea13af8-03ba-4062-b908-249df66deb2e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:38.464538 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0ea13af8-03ba-4062-b908-249df66deb2e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1315 microversion: 2.1 time: 0.210397 Aug 04 17:13:38.466312 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2243/4409] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:38 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:38.527141 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-76c6d491-368a-4c71-9db1-afec1c5edee5 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:38.528070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-76c6d491-368a-4c71-9db1-afec1c5edee5 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:38.535721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76c6d491-368a-4c71-9db1-afec1c5edee5 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:38.536468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76c6d491-368a-4c71-9db1-afec1c5edee5 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:38.537366 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76c6d491-368a-4c71-9db1-afec1c5edee5 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:38.538330 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76c6d491-368a-4c71-9db1-afec1c5edee5 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:38.538982 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76c6d491-368a-4c71-9db1-afec1c5edee5 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:38.539616 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76c6d491-368a-4c71-9db1-afec1c5edee5 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:38.799279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-76c6d491-368a-4c71-9db1-afec1c5edee5 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:38.813211 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-76c6d491-368a-4c71-9db1-afec1c5edee5 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1324 microversion: 2.1 time: 0.289379 Aug 04 17:13:38.826009 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2167/4410] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:38 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1324 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:38.899074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5945a5d4-cbc9-4867-9658-6d851d5183b6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:38.900096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5945a5d4-cbc9-4867-9658-6d851d5183b6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:38.909887 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5945a5d4-cbc9-4867-9658-6d851d5183b6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:38.910637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5945a5d4-cbc9-4867-9658-6d851d5183b6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:38.911257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5945a5d4-cbc9-4867-9658-6d851d5183b6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:38.916946 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5945a5d4-cbc9-4867-9658-6d851d5183b6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:38.917656 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5945a5d4-cbc9-4867-9658-6d851d5183b6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:38.918296 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5945a5d4-cbc9-4867-9658-6d851d5183b6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:39.232936 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5945a5d4-cbc9-4867-9658-6d851d5183b6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:39.248198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5945a5d4-cbc9-4867-9658-6d851d5183b6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:39.249884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5945a5d4-cbc9-4867-9658-6d851d5183b6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:39.254741 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5945a5d4-cbc9-4867-9658-6d851d5183b6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1740 microversion: 2.20 time: 0.359493 Aug 04 17:13:39.258317 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2244/4411] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:13:38 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1740 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:13:39.271271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a66e1109-6126-4c3e-a748-79258c94ee58 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:39.272413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a66e1109-6126-4c3e-a748-79258c94ee58 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:39.280342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a66e1109-6126-4c3e-a748-79258c94ee58 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:39.282839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a66e1109-6126-4c3e-a748-79258c94ee58 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:39.283491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a66e1109-6126-4c3e-a748-79258c94ee58 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:39.284394 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a66e1109-6126-4c3e-a748-79258c94ee58 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:39.285019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a66e1109-6126-4c3e-a748-79258c94ee58 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:39.285632 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a66e1109-6126-4c3e-a748-79258c94ee58 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:39.330788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bfae2f69-56d4-400d-b598-459bbae4f255 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:39.332440 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bfae2f69-56d4-400d-b598-459bbae4f255 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 43df9f1d-da75-43f5-90ae-e5eaacdb4f02] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:39.345140 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bfae2f69-56d4-400d-b598-459bbae4f255 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:39.346750 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bfae2f69-56d4-400d-b598-459bbae4f255 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:39.347369 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bfae2f69-56d4-400d-b598-459bbae4f255 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:39.348547 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bfae2f69-56d4-400d-b598-459bbae4f255 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:39.349165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bfae2f69-56d4-400d-b598-459bbae4f255 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:39.349871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bfae2f69-56d4-400d-b598-459bbae4f255 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:39.439877 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bfae2f69-56d4-400d-b598-459bbae4f255 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:39.451595 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bfae2f69-56d4-400d-b598-459bbae4f255 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02" status: 200 len: 1286 microversion: 2.1 time: 0.126149 Aug 04 17:13:39.466701 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2245/4412] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:39 2022] GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02 => generated 1286 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:13:39.484986 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1fd73fa1-450e-47d6-bac0-35d9d0ab1eaa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:39.493239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1fd73fa1-450e-47d6-bac0-35d9d0ab1eaa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:39.506164 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1fd73fa1-450e-47d6-bac0-35d9d0ab1eaa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:39.506877 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1fd73fa1-450e-47d6-bac0-35d9d0ab1eaa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:39.507447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1fd73fa1-450e-47d6-bac0-35d9d0ab1eaa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:39.508272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1fd73fa1-450e-47d6-bac0-35d9d0ab1eaa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:39.508858 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1fd73fa1-450e-47d6-bac0-35d9d0ab1eaa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:39.509408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1fd73fa1-450e-47d6-bac0-35d9d0ab1eaa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:39.526949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a66e1109-6126-4c3e-a748-79258c94ee58 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:39.540102 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a66e1109-6126-4c3e-a748-79258c94ee58 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba" status: 200 len: 1360 microversion: 2.1 time: 0.273976 Aug 04 17:13:39.553178 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2168/4413] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:39 2022] GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba => generated 1360 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:39.718272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1fd73fa1-450e-47d6-bac0-35d9d0ab1eaa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:39.729716 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1fd73fa1-450e-47d6-bac0-35d9d0ab1eaa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1315 microversion: 2.1 time: 0.248719 Aug 04 17:13:39.730700 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2246/4414] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:39 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:39.836897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-530bd053-8f5e-403a-ac8e-34c8d775f015 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:39.837520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-530bd053-8f5e-403a-ac8e-34c8d775f015 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:39.844250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-530bd053-8f5e-403a-ac8e-34c8d775f015 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:39.845725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-530bd053-8f5e-403a-ac8e-34c8d775f015 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:39.846375 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-530bd053-8f5e-403a-ac8e-34c8d775f015 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:39.847269 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-530bd053-8f5e-403a-ac8e-34c8d775f015 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:39.847881 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-530bd053-8f5e-403a-ac8e-34c8d775f015 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:39.848464 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-530bd053-8f5e-403a-ac8e-34c8d775f015 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:40.054761 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-530bd053-8f5e-403a-ac8e-34c8d775f015 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:40.066872 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-530bd053-8f5e-403a-ac8e-34c8d775f015 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1324 microversion: 2.1 time: 0.234355 Aug 04 17:13:40.067468 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2169/4415] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:39 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1324 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:40.278490 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9951d34a-5161-46a2-8806-9acf45eddc4e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:40.279563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9951d34a-5161-46a2-8806-9acf45eddc4e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:40.290862 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9951d34a-5161-46a2-8806-9acf45eddc4e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:40.295189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9951d34a-5161-46a2-8806-9acf45eddc4e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:40.295662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9951d34a-5161-46a2-8806-9acf45eddc4e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:40.299631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9951d34a-5161-46a2-8806-9acf45eddc4e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:40.300488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9951d34a-5161-46a2-8806-9acf45eddc4e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:40.303770 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9951d34a-5161-46a2-8806-9acf45eddc4e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:40.476160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b33c881e-b890-4d95-9817-e3bca8eb3499 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:40.477362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b33c881e-b890-4d95-9817-e3bca8eb3499 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 43df9f1d-da75-43f5-90ae-e5eaacdb4f02] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:40.487622 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b33c881e-b890-4d95-9817-e3bca8eb3499 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:40.492517 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b33c881e-b890-4d95-9817-e3bca8eb3499 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:40.494937 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b33c881e-b890-4d95-9817-e3bca8eb3499 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:40.496015 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b33c881e-b890-4d95-9817-e3bca8eb3499 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:40.497506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b33c881e-b890-4d95-9817-e3bca8eb3499 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:40.501756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b33c881e-b890-4d95-9817-e3bca8eb3499 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:40.877858 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9951d34a-5161-46a2-8806-9acf45eddc4e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:40.892251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9951d34a-5161-46a2-8806-9acf45eddc4e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:40.897747 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9951d34a-5161-46a2-8806-9acf45eddc4e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:40.901759 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9951d34a-5161-46a2-8806-9acf45eddc4e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1740 microversion: 2.20 time: 0.627529 Aug 04 17:13:40.902786 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2247/4416] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:13:40 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1740 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:13:40.915081 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-50638b7a-bf31-41cb-b12e-56112d67e239 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:40.918640 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-50638b7a-bf31-41cb-b12e-56112d67e239 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:40.933964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50638b7a-bf31-41cb-b12e-56112d67e239 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:40.938471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50638b7a-bf31-41cb-b12e-56112d67e239 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:40.939630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50638b7a-bf31-41cb-b12e-56112d67e239 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:40.940617 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50638b7a-bf31-41cb-b12e-56112d67e239 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:40.942513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50638b7a-bf31-41cb-b12e-56112d67e239 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:40.943302 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50638b7a-bf31-41cb-b12e-56112d67e239 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:41.241542 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b33c881e-b890-4d95-9817-e3bca8eb3499 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:41.263427 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b33c881e-b890-4d95-9817-e3bca8eb3499 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02" status: 200 len: 1328 microversion: 2.1 time: 0.785567 Aug 04 17:13:41.268561 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2170/4417] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:40 2022] GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02 => generated 1328 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:13:41.292579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6d739a8e-d952-4347-aa2e-b00121efbb0c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:41.293572 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6d739a8e-d952-4347-aa2e-b00121efbb0c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:41.308961 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d739a8e-d952-4347-aa2e-b00121efbb0c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:41.310575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d739a8e-d952-4347-aa2e-b00121efbb0c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:41.312470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d739a8e-d952-4347-aa2e-b00121efbb0c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:41.313490 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d739a8e-d952-4347-aa2e-b00121efbb0c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:41.315604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d739a8e-d952-4347-aa2e-b00121efbb0c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:41.316300 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d739a8e-d952-4347-aa2e-b00121efbb0c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:41.404346 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-50638b7a-bf31-41cb-b12e-56112d67e239 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:41.419340 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-50638b7a-bf31-41cb-b12e-56112d67e239 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba" status: 200 len: 1360 microversion: 2.1 time: 0.515257 Aug 04 17:13:41.427604 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2248/4418] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:40 2022] GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba => generated 1360 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:41.435171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9562e690-575e-428f-bd89-e4478c6741bd tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:41.443482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9562e690-575e-428f-bd89-e4478c6741bd tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:41.454558 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9562e690-575e-428f-bd89-e4478c6741bd tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:41.455490 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9562e690-575e-428f-bd89-e4478c6741bd tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:41.459069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9562e690-575e-428f-bd89-e4478c6741bd tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:41.460108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9562e690-575e-428f-bd89-e4478c6741bd tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:41.460801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9562e690-575e-428f-bd89-e4478c6741bd tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:41.461449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9562e690-575e-428f-bd89-e4478c6741bd tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:41.685496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6d739a8e-d952-4347-aa2e-b00121efbb0c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:41.698216 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6d739a8e-d952-4347-aa2e-b00121efbb0c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1315 microversion: 2.1 time: 0.420881 Aug 04 17:13:41.699026 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2171/4419] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:41 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:41.711302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-c0573d65-c95f-40de-bae1-34201c2ed34f req-7823e0ae-4b69-4d49-8019-0e9290228e82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43df9f1d-da75-43f5-90ae-e5eaacdb4f02", "tag": "48ef7ce8-e421-4826-8d51-a6914da2fc4c"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:41.727019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c0573d65-c95f-40de-bae1-34201c2ed34f req-7823e0ae-4b69-4d49-8019-0e9290228e82 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:41.737592 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c0573d65-c95f-40de-bae1-34201c2ed34f req-7823e0ae-4b69-4d49-8019-0e9290228e82 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:41.738403 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c0573d65-c95f-40de-bae1-34201c2ed34f req-7823e0ae-4b69-4d49-8019-0e9290228e82 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:41.775610 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-c0573d65-c95f-40de-bae1-34201c2ed34f req-7823e0ae-4b69-4d49-8019-0e9290228e82 service nova] Creating event network-changed:48ef7ce8-e421-4826-8d51-a6914da2fc4c for instance 43df9f1d-da75-43f5-90ae-e5eaacdb4f02 on n-h1-851359-3 Aug 04 17:13:41.784100 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9562e690-575e-428f-bd89-e4478c6741bd tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:41.795152 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9562e690-575e-428f-bd89-e4478c6741bd tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1324 microversion: 2.1 time: 0.363995 Aug 04 17:13:41.806008 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-c0573d65-c95f-40de-bae1-34201c2ed34f req-7823e0ae-4b69-4d49-8019-0e9290228e82 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096016 Aug 04 17:13:41.806008 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2172/4420] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:13:41.810038 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2249/4421] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:41 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1324 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:41.931141 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f6b74559-55d1-4bfd-a551-2bbd0de32663 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:41.931950 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f6b74559-55d1-4bfd-a551-2bbd0de32663 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:41.934206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:41.951045 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6b74559-55d1-4bfd-a551-2bbd0de32663 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:41.954210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6b74559-55d1-4bfd-a551-2bbd0de32663 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:41.956509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6b74559-55d1-4bfd-a551-2bbd0de32663 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:41.957523 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6b74559-55d1-4bfd-a551-2bbd0de32663 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:41.960227 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6b74559-55d1-4bfd-a551-2bbd0de32663 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:41.960921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6b74559-55d1-4bfd-a551-2bbd0de32663 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:42.182276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f6b74559-55d1-4bfd-a551-2bbd0de32663 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:42.197775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f6b74559-55d1-4bfd-a551-2bbd0de32663 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:42.200360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f6b74559-55d1-4bfd-a551-2bbd0de32663 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:42.202062 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f6b74559-55d1-4bfd-a551-2bbd0de32663 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1740 microversion: 2.20 time: 0.275552 Aug 04 17:13:42.203870 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2173/4422] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:13:41 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1740 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:13:42.290882 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3cad43a2-7224-48e4-9adb-dc1197833653 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:42.291582 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3cad43a2-7224-48e4-9adb-dc1197833653 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 43df9f1d-da75-43f5-90ae-e5eaacdb4f02] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:42.310243 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3cad43a2-7224-48e4-9adb-dc1197833653 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:42.312744 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3cad43a2-7224-48e4-9adb-dc1197833653 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:42.315836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3cad43a2-7224-48e4-9adb-dc1197833653 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:42.318488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3cad43a2-7224-48e4-9adb-dc1197833653 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:42.318997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3cad43a2-7224-48e4-9adb-dc1197833653 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:42.319449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3cad43a2-7224-48e4-9adb-dc1197833653 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:42.453253 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b2d30dbd-36c8-4735-a9e3-d157c8735c06 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:42.454698 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b2d30dbd-36c8-4735-a9e3-d157c8735c06 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:42.469183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2d30dbd-36c8-4735-a9e3-d157c8735c06 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:42.469900 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2d30dbd-36c8-4735-a9e3-d157c8735c06 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:42.471369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2d30dbd-36c8-4735-a9e3-d157c8735c06 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:42.472161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2d30dbd-36c8-4735-a9e3-d157c8735c06 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:42.472650 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2d30dbd-36c8-4735-a9e3-d157c8735c06 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:42.477522 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2d30dbd-36c8-4735-a9e3-d157c8735c06 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:42.661349 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3cad43a2-7224-48e4-9adb-dc1197833653 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:42.665420 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:42.678320 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3cad43a2-7224-48e4-9adb-dc1197833653 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02" status: 200 len: 1328 microversion: 2.1 time: 0.392274 Aug 04 17:13:42.681203 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2250/4423] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:42 2022] GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02 => generated 1328 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:42.721812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3a98876c-8d12-40ea-8ce3-681495ad5e00 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:42.722858 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3a98876c-8d12-40ea-8ce3-681495ad5e00 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:42.731718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a98876c-8d12-40ea-8ce3-681495ad5e00 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:42.732295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a98876c-8d12-40ea-8ce3-681495ad5e00 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:42.732776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a98876c-8d12-40ea-8ce3-681495ad5e00 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:42.733475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a98876c-8d12-40ea-8ce3-681495ad5e00 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:42.734001 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a98876c-8d12-40ea-8ce3-681495ad5e00 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:42.734562 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a98876c-8d12-40ea-8ce3-681495ad5e00 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:42.779544 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b2d30dbd-36c8-4735-a9e3-d157c8735c06 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:42.789663 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b2d30dbd-36c8-4735-a9e3-d157c8735c06 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba" status: 200 len: 1547 microversion: 2.1 time: 0.342158 Aug 04 17:13:42.790315 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2174/4424] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:42 2022] GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba => generated 1547 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:13:42.819609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-62a58b1c-e5ff-49a9-84df-cfaa2864e003 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:42.820480 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-62a58b1c-e5ff-49a9-84df-cfaa2864e003 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:42.846412 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62a58b1c-e5ff-49a9-84df-cfaa2864e003 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:42.847244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62a58b1c-e5ff-49a9-84df-cfaa2864e003 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:42.848240 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62a58b1c-e5ff-49a9-84df-cfaa2864e003 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:42.849295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62a58b1c-e5ff-49a9-84df-cfaa2864e003 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:42.849851 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62a58b1c-e5ff-49a9-84df-cfaa2864e003 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:42.850420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62a58b1c-e5ff-49a9-84df-cfaa2864e003 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:43.002254 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-62a58b1c-e5ff-49a9-84df-cfaa2864e003 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.188547 Aug 04 17:13:43.011334 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2175/4425] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Aug 4 17:13:42 2022] GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba/os-interface => generated 285 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:13:43.017152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c939080e-5e8b-44d8-9402-cf7854114a32 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:43.017926 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c939080e-5e8b-44d8-9402-cf7854114a32 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:43.024802 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3a98876c-8d12-40ea-8ce3-681495ad5e00 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:43.025615 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c939080e-5e8b-44d8-9402-cf7854114a32 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:43.026318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c939080e-5e8b-44d8-9402-cf7854114a32 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:43.026944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c939080e-5e8b-44d8-9402-cf7854114a32 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:43.027822 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c939080e-5e8b-44d8-9402-cf7854114a32 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:43.028441 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c939080e-5e8b-44d8-9402-cf7854114a32 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:43.029021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c939080e-5e8b-44d8-9402-cf7854114a32 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:43.034156 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3a98876c-8d12-40ea-8ce3-681495ad5e00 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1315 microversion: 2.1 time: 0.317851 Aug 04 17:13:43.035378 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2251/4426] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:42 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:43.231120 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-88525ba7-f2ad-4a88-a8cf-0c3ba5a15180 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:43.232081 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-88525ba7-f2ad-4a88-a8cf-0c3ba5a15180 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:43.241011 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88525ba7-f2ad-4a88-a8cf-0c3ba5a15180 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:43.243968 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c939080e-5e8b-44d8-9402-cf7854114a32 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:43.244767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88525ba7-f2ad-4a88-a8cf-0c3ba5a15180 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:43.246371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88525ba7-f2ad-4a88-a8cf-0c3ba5a15180 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:43.247341 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88525ba7-f2ad-4a88-a8cf-0c3ba5a15180 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:43.250630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88525ba7-f2ad-4a88-a8cf-0c3ba5a15180 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:43.251339 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88525ba7-f2ad-4a88-a8cf-0c3ba5a15180 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:43.252166 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c939080e-5e8b-44d8-9402-cf7854114a32 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1324 microversion: 2.1 time: 0.239683 Aug 04 17:13:43.253602 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2176/4427] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:43 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1324 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:43.550031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-88525ba7-f2ad-4a88-a8cf-0c3ba5a15180 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:43.556454 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-88525ba7-f2ad-4a88-a8cf-0c3ba5a15180 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:43.558009 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-88525ba7-f2ad-4a88-a8cf-0c3ba5a15180 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:43.559222 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-88525ba7-f2ad-4a88-a8cf-0c3ba5a15180 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1740 microversion: 2.20 time: 0.332246 Aug 04 17:13:43.581526 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2252/4428] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:13:43 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1740 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:13:43.671750 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-21847ea8-cc32-47e0-8f7a-c4cfdf20da20 req-5269ab77-bb4a-4016-8a40-da07b05f5859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a741b004-2f32-419c-aada-de12ed0cd36e", "name": "network-vif-plugged", "status": "completed", "tag": "4ce7718f-85dc-4011-b3ce-a182614aceb6"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:43.684801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-21847ea8-cc32-47e0-8f7a-c4cfdf20da20 req-5269ab77-bb4a-4016-8a40-da07b05f5859 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:43.685579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-21847ea8-cc32-47e0-8f7a-c4cfdf20da20 req-5269ab77-bb4a-4016-8a40-da07b05f5859 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:43.686521 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-21847ea8-cc32-47e0-8f7a-c4cfdf20da20 req-5269ab77-bb4a-4016-8a40-da07b05f5859 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:43.703614 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c48177ca-663b-4ecf-92cb-019600a6ad6a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:43.704712 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c48177ca-663b-4ecf-92cb-019600a6ad6a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 43df9f1d-da75-43f5-90ae-e5eaacdb4f02] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:43.712403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:43.714070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c48177ca-663b-4ecf-92cb-019600a6ad6a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:43.714723 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c48177ca-663b-4ecf-92cb-019600a6ad6a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:43.715321 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c48177ca-663b-4ecf-92cb-019600a6ad6a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:43.716190 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c48177ca-663b-4ecf-92cb-019600a6ad6a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:43.716363 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-21847ea8-cc32-47e0-8f7a-c4cfdf20da20 req-5269ab77-bb4a-4016-8a40-da07b05f5859 service nova] Creating event network-vif-plugged:4ce7718f-85dc-4011-b3ce-a182614aceb6 for instance a741b004-2f32-419c-aada-de12ed0cd36e on n-h2-851359-3 Aug 04 17:13:43.716978 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c48177ca-663b-4ecf-92cb-019600a6ad6a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:43.717564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c48177ca-663b-4ecf-92cb-019600a6ad6a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:43.727801 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-21847ea8-cc32-47e0-8f7a-c4cfdf20da20 req-5269ab77-bb4a-4016-8a40-da07b05f5859 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061418 Aug 04 17:13:43.728896 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2177/4429] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:13:43.906540 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c48177ca-663b-4ecf-92cb-019600a6ad6a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:43.914709 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c48177ca-663b-4ecf-92cb-019600a6ad6a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02" status: 200 len: 1328 microversion: 2.1 time: 0.215870 Aug 04 17:13:43.915664 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2253/4430] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:43 2022] GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02 => generated 1328 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:13:44.061340 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-75d1ac1d-c0fc-4536-aa87-71f23d165002 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:44.064677 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-75d1ac1d-c0fc-4536-aa87-71f23d165002 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:44.072072 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75d1ac1d-c0fc-4536-aa87-71f23d165002 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:44.074052 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75d1ac1d-c0fc-4536-aa87-71f23d165002 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:44.074948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75d1ac1d-c0fc-4536-aa87-71f23d165002 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:44.075962 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75d1ac1d-c0fc-4536-aa87-71f23d165002 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:44.077027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75d1ac1d-c0fc-4536-aa87-71f23d165002 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:44.077762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75d1ac1d-c0fc-4536-aa87-71f23d165002 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:44.272507 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d07ea7a3-6c52-4593-8e3d-e787cdb2d640 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:44.273143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d07ea7a3-6c52-4593-8e3d-e787cdb2d640 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:44.284159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d07ea7a3-6c52-4593-8e3d-e787cdb2d640 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:44.285738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d07ea7a3-6c52-4593-8e3d-e787cdb2d640 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:44.286257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d07ea7a3-6c52-4593-8e3d-e787cdb2d640 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:44.286989 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d07ea7a3-6c52-4593-8e3d-e787cdb2d640 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:44.289927 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d07ea7a3-6c52-4593-8e3d-e787cdb2d640 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:44.290498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d07ea7a3-6c52-4593-8e3d-e787cdb2d640 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:44.321399 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-75d1ac1d-c0fc-4536-aa87-71f23d165002 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:44.334129 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-75d1ac1d-c0fc-4536-aa87-71f23d165002 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1315 microversion: 2.1 time: 0.277597 Aug 04 17:13:44.359481 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2178/4431] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:44 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:44.567850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d07ea7a3-6c52-4593-8e3d-e787cdb2d640 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:44.590454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-739ca4fd-59f8-4f98-b4fc-468866db13f1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:44.592257 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-739ca4fd-59f8-4f98-b4fc-468866db13f1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:44.614474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-739ca4fd-59f8-4f98-b4fc-468866db13f1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:44.615223 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-739ca4fd-59f8-4f98-b4fc-468866db13f1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:44.615804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-739ca4fd-59f8-4f98-b4fc-468866db13f1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:44.616738 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-739ca4fd-59f8-4f98-b4fc-468866db13f1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:44.617292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-739ca4fd-59f8-4f98-b4fc-468866db13f1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:44.617739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-739ca4fd-59f8-4f98-b4fc-468866db13f1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:44.638829 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d07ea7a3-6c52-4593-8e3d-e787cdb2d640 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1324 microversion: 2.1 time: 0.356351 Aug 04 17:13:44.653282 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2254/4432] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:44 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1324 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:44.943285 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-280d6ae5-b69d-4fc8-a18d-6b25afa31156 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:44.943914 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-280d6ae5-b69d-4fc8-a18d-6b25afa31156 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 43df9f1d-da75-43f5-90ae-e5eaacdb4f02] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:44.960073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-280d6ae5-b69d-4fc8-a18d-6b25afa31156 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:44.960482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-280d6ae5-b69d-4fc8-a18d-6b25afa31156 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:44.960939 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-280d6ae5-b69d-4fc8-a18d-6b25afa31156 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:44.961652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-280d6ae5-b69d-4fc8-a18d-6b25afa31156 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:44.962147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-280d6ae5-b69d-4fc8-a18d-6b25afa31156 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:44.962583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-280d6ae5-b69d-4fc8-a18d-6b25afa31156 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:45.398138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-280d6ae5-b69d-4fc8-a18d-6b25afa31156 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:45.403924 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-739ca4fd-59f8-4f98-b4fc-468866db13f1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:45.421897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-739ca4fd-59f8-4f98-b4fc-468866db13f1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:45.423455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-739ca4fd-59f8-4f98-b4fc-468866db13f1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:45.424689 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-739ca4fd-59f8-4f98-b4fc-468866db13f1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1740 microversion: 2.20 time: 0.838291 Aug 04 17:13:45.425253 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2179/4433] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:13:44 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1740 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:13:45.447203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-84d3b078-deb2-4868-802d-4f6ffd2d54d1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:45.449395 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-280d6ae5-b69d-4fc8-a18d-6b25afa31156 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02" status: 200 len: 1328 microversion: 2.1 time: 0.513559 Aug 04 17:13:45.451126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-84d3b078-deb2-4868-802d-4f6ffd2d54d1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:45.458763 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2255/4434] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:44 2022] GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02 => generated 1328 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:45.491105 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84d3b078-deb2-4868-802d-4f6ffd2d54d1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:45.491809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84d3b078-deb2-4868-802d-4f6ffd2d54d1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:45.492266 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84d3b078-deb2-4868-802d-4f6ffd2d54d1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:45.493001 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84d3b078-deb2-4868-802d-4f6ffd2d54d1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:45.493471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84d3b078-deb2-4868-802d-4f6ffd2d54d1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:45.493906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84d3b078-deb2-4868-802d-4f6ffd2d54d1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:45.672701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6a481f26-d8e1-43f0-8aac-623715ed2561 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:45.673238 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6a481f26-d8e1-43f0-8aac-623715ed2561 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:45.684616 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a481f26-d8e1-43f0-8aac-623715ed2561 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:45.685365 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a481f26-d8e1-43f0-8aac-623715ed2561 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:45.686016 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a481f26-d8e1-43f0-8aac-623715ed2561 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:45.690498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a481f26-d8e1-43f0-8aac-623715ed2561 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:45.691197 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a481f26-d8e1-43f0-8aac-623715ed2561 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:45.691818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a481f26-d8e1-43f0-8aac-623715ed2561 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:46.029708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-84d3b078-deb2-4868-802d-4f6ffd2d54d1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:46.039665 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-84d3b078-deb2-4868-802d-4f6ffd2d54d1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1315 microversion: 2.1 time: 0.610829 Aug 04 17:13:46.059418 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2180/4435] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:45 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1315 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:46.132794 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6a481f26-d8e1-43f0-8aac-623715ed2561 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:46.142960 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6a481f26-d8e1-43f0-8aac-623715ed2561 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1324 microversion: 2.1 time: 0.474648 Aug 04 17:13:46.143864 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2256/4436] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:45 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1324 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:46.307398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-ca6ec926-db9f-4386-b33a-41176018fdf3 req-39e45f1a-893f-4268-bd56-e301c80140f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81a3d940-08e3-4cb9-bbf2-360653411aba", "tag": "740dcb36-902c-495f-9a80-a8a83db55035"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:46.317142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ca6ec926-db9f-4386-b33a-41176018fdf3 req-39e45f1a-893f-4268-bd56-e301c80140f5 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:46.317904 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ca6ec926-db9f-4386-b33a-41176018fdf3 req-39e45f1a-893f-4268-bd56-e301c80140f5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:46.318515 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ca6ec926-db9f-4386-b33a-41176018fdf3 req-39e45f1a-893f-4268-bd56-e301c80140f5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:46.338554 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-ca6ec926-db9f-4386-b33a-41176018fdf3 req-39e45f1a-893f-4268-bd56-e301c80140f5 service nova] Creating event network-changed:740dcb36-902c-495f-9a80-a8a83db55035 for instance 81a3d940-08e3-4cb9-bbf2-360653411aba on n-h2-851359-3 Aug 04 17:13:46.350652 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-ca6ec926-db9f-4386-b33a-41176018fdf3 req-39e45f1a-893f-4268-bd56-e301c80140f5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044674 Aug 04 17:13:46.351413 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2181/4437] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:13:46.456325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5d5c9f21-9de7-4fcf-8b82-feb1573e0225 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:46.457362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5d5c9f21-9de7-4fcf-8b82-feb1573e0225 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:46.469420 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d5c9f21-9de7-4fcf-8b82-feb1573e0225 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:46.469863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d5c9f21-9de7-4fcf-8b82-feb1573e0225 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:46.472136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d5c9f21-9de7-4fcf-8b82-feb1573e0225 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:46.472136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d5c9f21-9de7-4fcf-8b82-feb1573e0225 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:46.472136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d5c9f21-9de7-4fcf-8b82-feb1573e0225 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:46.472136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d5c9f21-9de7-4fcf-8b82-feb1573e0225 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:46.487869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-69d3fde4-f36d-483e-8255-8debd4e8be8e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:46.495629 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-69d3fde4-f36d-483e-8255-8debd4e8be8e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 43df9f1d-da75-43f5-90ae-e5eaacdb4f02] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:46.509604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69d3fde4-f36d-483e-8255-8debd4e8be8e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:46.516183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69d3fde4-f36d-483e-8255-8debd4e8be8e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:46.517011 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69d3fde4-f36d-483e-8255-8debd4e8be8e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:46.521382 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69d3fde4-f36d-483e-8255-8debd4e8be8e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:46.523271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69d3fde4-f36d-483e-8255-8debd4e8be8e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:46.525477 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69d3fde4-f36d-483e-8255-8debd4e8be8e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:46.813673 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:46.837338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:46.973146 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-69d3fde4-f36d-483e-8255-8debd4e8be8e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:46.989638 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-69d3fde4-f36d-483e-8255-8debd4e8be8e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02" status: 200 len: 1328 microversion: 2.1 time: 0.509265 Aug 04 17:13:47.002085 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2182/4438] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:46 2022] GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02 => generated 1328 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:47.047598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5d5c9f21-9de7-4fcf-8b82-feb1573e0225 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:47.063355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6748e49e-f50b-4776-ba0e-06786e6a8f4b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:47.064243 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6748e49e-f50b-4776-ba0e-06786e6a8f4b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:47.068379 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:47.076461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5d5c9f21-9de7-4fcf-8b82-feb1573e0225 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:47.078174 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5d5c9f21-9de7-4fcf-8b82-feb1573e0225 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:47.079449 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5d5c9f21-9de7-4fcf-8b82-feb1573e0225 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1740 microversion: 2.20 time: 0.628368 Aug 04 17:13:47.097196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6748e49e-f50b-4776-ba0e-06786e6a8f4b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:47.097196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6748e49e-f50b-4776-ba0e-06786e6a8f4b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:47.097196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6748e49e-f50b-4776-ba0e-06786e6a8f4b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:47.097196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6748e49e-f50b-4776-ba0e-06786e6a8f4b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:47.097196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6748e49e-f50b-4776-ba0e-06786e6a8f4b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:47.097196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6748e49e-f50b-4776-ba0e-06786e6a8f4b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:47.105472 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2257/4439] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:13:46 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1740 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:13:47.164287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ff4c02b9-278d-4afd-a85f-f1e975cbf30f tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:47.164539 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ff4c02b9-278d-4afd-a85f-f1e975cbf30f tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:47.171958 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ff4c02b9-278d-4afd-a85f-f1e975cbf30f tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:47.172466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ff4c02b9-278d-4afd-a85f-f1e975cbf30f tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:47.172915 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ff4c02b9-278d-4afd-a85f-f1e975cbf30f tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:47.173637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ff4c02b9-278d-4afd-a85f-f1e975cbf30f tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:47.174132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ff4c02b9-278d-4afd-a85f-f1e975cbf30f tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:47.174571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ff4c02b9-278d-4afd-a85f-f1e975cbf30f tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:47.404760 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6748e49e-f50b-4776-ba0e-06786e6a8f4b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:47.418439 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6748e49e-f50b-4776-ba0e-06786e6a8f4b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1315 microversion: 2.1 time: 0.360192 Aug 04 17:13:47.420780 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2183/4440] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:47 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:13:47.504792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ff4c02b9-278d-4afd-a85f-f1e975cbf30f tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:47.522325 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ff4c02b9-278d-4afd-a85f-f1e975cbf30f tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1324 microversion: 2.1 time: 0.361701 Aug 04 17:13:47.534017 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2258/4441] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:47 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1324 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:13:48.012478 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c6dab4cf-1d05-4614-98fd-a9ab43254e1b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:48.013527 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c6dab4cf-1d05-4614-98fd-a9ab43254e1b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 43df9f1d-da75-43f5-90ae-e5eaacdb4f02] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:48.023782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6dab4cf-1d05-4614-98fd-a9ab43254e1b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:48.027970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6dab4cf-1d05-4614-98fd-a9ab43254e1b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:48.028623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6dab4cf-1d05-4614-98fd-a9ab43254e1b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:48.030912 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6dab4cf-1d05-4614-98fd-a9ab43254e1b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:48.031571 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6dab4cf-1d05-4614-98fd-a9ab43254e1b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:48.034573 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6dab4cf-1d05-4614-98fd-a9ab43254e1b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:48.105347 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3e4f5a7d-fe43-483f-a74c-609bb82a4c4f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:48.106485 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3e4f5a7d-fe43-483f-a74c-609bb82a4c4f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:48.118104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3e4f5a7d-fe43-483f-a74c-609bb82a4c4f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:48.121410 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3e4f5a7d-fe43-483f-a74c-609bb82a4c4f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:48.123385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3e4f5a7d-fe43-483f-a74c-609bb82a4c4f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:48.124879 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3e4f5a7d-fe43-483f-a74c-609bb82a4c4f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:48.128295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3e4f5a7d-fe43-483f-a74c-609bb82a4c4f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:48.129632 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3e4f5a7d-fe43-483f-a74c-609bb82a4c4f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:48.401320 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c6dab4cf-1d05-4614-98fd-a9ab43254e1b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:48.414152 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c6dab4cf-1d05-4614-98fd-a9ab43254e1b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02" status: 200 len: 1328 microversion: 2.1 time: 0.405408 Aug 04 17:13:48.420146 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2184/4442] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:48 2022] GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02 => generated 1328 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:48.443214 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e4dfd5f8-c5d4-46f8-b6f3-dc22d62780f4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:48.443851 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e4dfd5f8-c5d4-46f8-b6f3-dc22d62780f4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:48.456648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4dfd5f8-c5d4-46f8-b6f3-dc22d62780f4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:48.457155 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4dfd5f8-c5d4-46f8-b6f3-dc22d62780f4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:48.457725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4dfd5f8-c5d4-46f8-b6f3-dc22d62780f4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:48.458479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4dfd5f8-c5d4-46f8-b6f3-dc22d62780f4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:48.463299 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4dfd5f8-c5d4-46f8-b6f3-dc22d62780f4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:48.463758 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4dfd5f8-c5d4-46f8-b6f3-dc22d62780f4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:48.512650 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:48.613419 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3e4f5a7d-fe43-483f-a74c-609bb82a4c4f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:48.625745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3e4f5a7d-fe43-483f-a74c-609bb82a4c4f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:48.628007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3e4f5a7d-fe43-483f-a74c-609bb82a4c4f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:48.629805 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3e4f5a7d-fe43-483f-a74c-609bb82a4c4f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1740 microversion: 2.20 time: 0.528555 Aug 04 17:13:48.630419 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2259/4443] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:13:48 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1740 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:13:48.635065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7ad5ee9c-8027-4d0a-a5b9-22e339227ad2 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:48.635685 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7ad5ee9c-8027-4d0a-a5b9-22e339227ad2 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:48.649199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7ad5ee9c-8027-4d0a-a5b9-22e339227ad2 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:48.651550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7ad5ee9c-8027-4d0a-a5b9-22e339227ad2 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:48.652012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7ad5ee9c-8027-4d0a-a5b9-22e339227ad2 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:48.652733 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7ad5ee9c-8027-4d0a-a5b9-22e339227ad2 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:48.653194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7ad5ee9c-8027-4d0a-a5b9-22e339227ad2 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:48.653623 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7ad5ee9c-8027-4d0a-a5b9-22e339227ad2 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:48.755703 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e4dfd5f8-c5d4-46f8-b6f3-dc22d62780f4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:48.771948 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e4dfd5f8-c5d4-46f8-b6f3-dc22d62780f4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1315 microversion: 2.1 time: 0.331469 Aug 04 17:13:48.772911 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2185/4444] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:48 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:48.891542 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7ad5ee9c-8027-4d0a-a5b9-22e339227ad2 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:48.901188 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7ad5ee9c-8027-4d0a-a5b9-22e339227ad2 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1521 microversion: 2.1 time: 0.269503 Aug 04 17:13:48.901941 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2260/4445] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:48 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:48.923563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f801984e-8330-4ecc-bb23-08b88a646bb5 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:48.930001 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f801984e-8330-4ecc-bb23-08b88a646bb5 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:48.940088 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f801984e-8330-4ecc-bb23-08b88a646bb5 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:48.940819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f801984e-8330-4ecc-bb23-08b88a646bb5 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:48.943022 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f801984e-8330-4ecc-bb23-08b88a646bb5 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:48.944102 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f801984e-8330-4ecc-bb23-08b88a646bb5 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:48.944968 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f801984e-8330-4ecc-bb23-08b88a646bb5 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:48.945619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f801984e-8330-4ecc-bb23-08b88a646bb5 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:49.208913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f801984e-8330-4ecc-bb23-08b88a646bb5 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:49.214552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-2a773898-a927-4c5a-b66b-fae9975911d5 req-e3c8b6ac-9f76-449d-8669-be9fa05ee33d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9567ac7-9ee0-4ae3-b7c7-6033039de89d", "name": "network-vif-plugged", "status": "completed", "tag": "aca16109-3001-402b-99ec-6923c19c2dfc"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:49.228962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-2a773898-a927-4c5a-b66b-fae9975911d5 req-e3c8b6ac-9f76-449d-8669-be9fa05ee33d service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:49.229896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-2a773898-a927-4c5a-b66b-fae9975911d5 req-e3c8b6ac-9f76-449d-8669-be9fa05ee33d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:49.230606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-2a773898-a927-4c5a-b66b-fae9975911d5 req-e3c8b6ac-9f76-449d-8669-be9fa05ee33d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:49.231542 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f801984e-8330-4ecc-bb23-08b88a646bb5 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1521 microversion: 2.1 time: 0.312283 Aug 04 17:13:49.246012 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2186/4446] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:48 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:49.256817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bba940ab-06dc-42a6-a2b3-287106be63e5 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1096045168", "metadata": {"": ""}}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:49.260951 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-2a773898-a927-4c5a-b66b-fae9975911d5 req-e3c8b6ac-9f76-449d-8669-be9fa05ee33d service nova] Creating event network-vif-plugged:aca16109-3001-402b-99ec-6923c19c2dfc for instance a9567ac7-9ee0-4ae3-b7c7-6033039de89d on n-h2-851359-3 Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bba940ab-06dc-42a6-a2b3-287106be63e5 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Request method failure captured: Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e/action HTTP/1.1 Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 107 Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_4xbB8fnr17iZxpZmQfQZiM2JCxKiVWWUXjZiHpHTuUHHVw7ao4oT_uZW8wxu89NvTWOIVQIIqQPmHAao-lpxs7gxXuSYKOkaP9AGGwPUmZ0l1sD6ZLIZdH6-nP_cliwrHT6QFXnVMcXHLYBwQRQIzx4m2gYEscPKDx2pEzeM4vYGU Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 85c97e15d470473189d8a6c2068e9eac Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/85c97e15d470473189d8a6c2068e9eac"}]}] Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 85c97e15d470473189d8a6c2068e9eac Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ImagesOneServerNegativeTestJSON-1209884465-project Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 6791b833351c493a8e581154c2dfb8d7 Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465-project Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1096045168", "metadata": {"": ""}}} Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'a741b004-2f32-419c-aada-de12ed0cd36e', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1096045168', 'metadata': {'': ''}}}} Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'': ''} Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:13:49.264202 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:13:49.269189 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:13:49.269189 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:13:49.269189 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:13:49.269189 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:13:49.269189 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:13:49.269189 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 17:13:49.269189 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:13:49.269189 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:13:49.269189 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:13:49.269189 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:13:49.269189 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:13:49.269189 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:13:49.269189 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:13:49.269189 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:13:49.269189 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 17:13:49.269189 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:13:49.272884 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bba940ab-06dc-42a6-a2b3-287106be63e5 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:13:49.273861 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bba940ab-06dc-42a6-a2b3-287106be63e5 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "POST /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e/action" status: 400 len: 170 microversion: 2.1 time: 0.022773 Aug 04 17:13:49.276596 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-2a773898-a927-4c5a-b66b-fae9975911d5 req-e3c8b6ac-9f76-449d-8669-be9fa05ee33d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074610 Aug 04 17:13:49.281200 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2187/4447] 10.222.0.93 () {60 vars in 1279 bytes} [Thu Aug 4 17:13:49 2022] POST /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e/action => generated 170 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:13:49.281376 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2261/4448] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:13:49.289267 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6b19e766-c521-4d97-b59b-017d81d09a7b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:49.291576 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6b19e766-c521-4d97-b59b-017d81d09a7b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:49.300713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b19e766-c521-4d97-b59b-017d81d09a7b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:49.301324 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b19e766-c521-4d97-b59b-017d81d09a7b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:49.301834 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b19e766-c521-4d97-b59b-017d81d09a7b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:49.302798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b19e766-c521-4d97-b59b-017d81d09a7b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:49.303468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b19e766-c521-4d97-b59b-017d81d09a7b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:49.303946 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b19e766-c521-4d97-b59b-017d81d09a7b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:49.446801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-197c05d9-5c2f-49d9-aa6c-ae76f837651b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:49.449304 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-197c05d9-5c2f-49d9-aa6c-ae76f837651b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 43df9f1d-da75-43f5-90ae-e5eaacdb4f02] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:49.520003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-197c05d9-5c2f-49d9-aa6c-ae76f837651b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:49.520606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-197c05d9-5c2f-49d9-aa6c-ae76f837651b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:49.521167 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-197c05d9-5c2f-49d9-aa6c-ae76f837651b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:49.522965 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-197c05d9-5c2f-49d9-aa6c-ae76f837651b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:49.526189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-197c05d9-5c2f-49d9-aa6c-ae76f837651b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:49.526903 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-197c05d9-5c2f-49d9-aa6c-ae76f837651b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:49.793372 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6b19e766-c521-4d97-b59b-017d81d09a7b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:49.808862 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6b19e766-c521-4d97-b59b-017d81d09a7b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1521 microversion: 2.1 time: 0.526175 Aug 04 17:13:49.809459 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2188/4449] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:49 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1521 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:49.819400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bf476844-7bf6-46d4-be89-0a22fbf02f51 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:49.820021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bf476844-7bf6-46d4-be89-0a22fbf02f51 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:49.838704 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf476844-7bf6-46d4-be89-0a22fbf02f51 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:49.839853 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf476844-7bf6-46d4-be89-0a22fbf02f51 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:49.840302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf476844-7bf6-46d4-be89-0a22fbf02f51 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:49.841019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf476844-7bf6-46d4-be89-0a22fbf02f51 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:49.841480 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf476844-7bf6-46d4-be89-0a22fbf02f51 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:49.841912 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf476844-7bf6-46d4-be89-0a22fbf02f51 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:49.968427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-197c05d9-5c2f-49d9-aa6c-ae76f837651b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:49.984338 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-197c05d9-5c2f-49d9-aa6c-ae76f837651b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02" status: 200 len: 1328 microversion: 2.1 time: 0.545636 Aug 04 17:13:49.997624 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2262/4450] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:49 2022] GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02 => generated 1328 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:50.003362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-690f9a00-ad0c-4286-a84b-1845d0a136f2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:50.004175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-690f9a00-ad0c-4286-a84b-1845d0a136f2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:50.010399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-690f9a00-ad0c-4286-a84b-1845d0a136f2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:50.011107 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-690f9a00-ad0c-4286-a84b-1845d0a136f2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:50.011706 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-690f9a00-ad0c-4286-a84b-1845d0a136f2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:50.012584 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-690f9a00-ad0c-4286-a84b-1845d0a136f2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:50.013205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-690f9a00-ad0c-4286-a84b-1845d0a136f2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:50.013805 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-690f9a00-ad0c-4286-a84b-1845d0a136f2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:50.265327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bf476844-7bf6-46d4-be89-0a22fbf02f51 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:50.271321 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-690f9a00-ad0c-4286-a84b-1845d0a136f2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:50.276211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bf476844-7bf6-46d4-be89-0a22fbf02f51 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:50.278255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bf476844-7bf6-46d4-be89-0a22fbf02f51 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:50.279930 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bf476844-7bf6-46d4-be89-0a22fbf02f51 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1740 microversion: 2.20 time: 0.464531 Aug 04 17:13:50.281846 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2189/4451] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:13:49 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1740 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:13:50.287095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-738f924e-2255-437a-9c84-45b5acf5bf12 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:50.287899 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-738f924e-2255-437a-9c84-45b5acf5bf12 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:50.300997 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-738f924e-2255-437a-9c84-45b5acf5bf12 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:50.303081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-738f924e-2255-437a-9c84-45b5acf5bf12 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:50.304803 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-690f9a00-ad0c-4286-a84b-1845d0a136f2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1315 microversion: 2.1 time: 0.297198 Aug 04 17:13:50.310298 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-738f924e-2255-437a-9c84-45b5acf5bf12 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:50.310709 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2263/4452] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:49 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:50.352872 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-738f924e-2255-437a-9c84-45b5acf5bf12 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:50.353375 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-738f924e-2255-437a-9c84-45b5acf5bf12 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:50.353823 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-738f924e-2255-437a-9c84-45b5acf5bf12 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:50.585940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-738f924e-2255-437a-9c84-45b5acf5bf12 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:50.597863 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-738f924e-2255-437a-9c84-45b5acf5bf12 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1521 microversion: 2.1 time: 0.314720 Aug 04 17:13:50.617032 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2190/4453] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:50 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:50.622803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b0833422-2054-4a3e-ac93-a23619772d90 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-132239883", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b0833422-2054-4a3e-ac93-a23619772d90 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Request method failure captured: Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e/action HTTP/1.1 Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 618 Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_4xbB8fnr17iZxpZmQfQZiM2JCxKiVWWUXjZiHpHTuUHHVw7ao4oT_uZW8wxu89NvTWOIVQIIqQPmHAao-lpxs7gxXuSYKOkaP9AGGwPUmZ0l1sD6ZLIZdH6-nP_cliwrHT6QFXnVMcXHLYBwQRQIzx4m2gYEscPKDx2pEzeM4vYGU Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 85c97e15d470473189d8a6c2068e9eac Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/85c97e15d470473189d8a6c2068e9eac"}]}] Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 85c97e15d470473189d8a6c2068e9eac Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ImagesOneServerNegativeTestJSON-1209884465-project Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 6791b833351c493a8e581154c2dfb8d7 Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465-project Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-132239883", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'a741b004-2f32-419c-aada-de12ed0cd36e', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-132239883', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:13:50.627472 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 04 17:13:50.630406 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:13:50.633065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b0833422-2054-4a3e-ac93-a23619772d90 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:13:50.638860 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b0833422-2054-4a3e-ac93-a23619772d90 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "POST /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e/action" status: 400 len: 938 microversion: 2.1 time: 0.011834 Aug 04 17:13:50.641113 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2264/4454] 10.222.0.93 () {60 vars in 1279 bytes} [Thu Aug 4 17:13:50 2022] POST /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e/action => generated 938 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:13:50.649155 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eb07dccb-e2f9-4b48-869e-7875fe9de1cf tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:50.649879 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eb07dccb-e2f9-4b48-869e-7875fe9de1cf tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:50.660139 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb07dccb-e2f9-4b48-869e-7875fe9de1cf tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:50.660833 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb07dccb-e2f9-4b48-869e-7875fe9de1cf tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:50.661465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb07dccb-e2f9-4b48-869e-7875fe9de1cf tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:50.662655 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb07dccb-e2f9-4b48-869e-7875fe9de1cf tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:50.663274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb07dccb-e2f9-4b48-869e-7875fe9de1cf tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:50.664272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb07dccb-e2f9-4b48-869e-7875fe9de1cf tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:50.832052 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eb07dccb-e2f9-4b48-869e-7875fe9de1cf tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:50.844804 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eb07dccb-e2f9-4b48-869e-7875fe9de1cf tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1521 microversion: 2.1 time: 0.199220 Aug 04 17:13:50.850409 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2191/4455] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:50 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:50.869236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c3a92147-1aa0-42e6-a132-e034b6168eb6 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:50.869874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c3a92147-1aa0-42e6-a132-e034b6168eb6 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:50.878833 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c3a92147-1aa0-42e6-a132-e034b6168eb6 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:50.879332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c3a92147-1aa0-42e6-a132-e034b6168eb6 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:50.879962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c3a92147-1aa0-42e6-a132-e034b6168eb6 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:50.881095 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c3a92147-1aa0-42e6-a132-e034b6168eb6 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:50.881737 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c3a92147-1aa0-42e6-a132-e034b6168eb6 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:50.882335 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c3a92147-1aa0-42e6-a132-e034b6168eb6 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:51.006081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c4e656f0-26bf-4985-adc4-19617a40a533 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:51.006883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c4e656f0-26bf-4985-adc4-19617a40a533 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 43df9f1d-da75-43f5-90ae-e5eaacdb4f02] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:51.014556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4e656f0-26bf-4985-adc4-19617a40a533 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:51.015299 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4e656f0-26bf-4985-adc4-19617a40a533 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:51.015915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4e656f0-26bf-4985-adc4-19617a40a533 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:51.017070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4e656f0-26bf-4985-adc4-19617a40a533 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:51.017696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4e656f0-26bf-4985-adc4-19617a40a533 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:51.018152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4e656f0-26bf-4985-adc4-19617a40a533 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:51.029226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c3a92147-1aa0-42e6-a132-e034b6168eb6 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:51.038934 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c3a92147-1aa0-42e6-a132-e034b6168eb6 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1521 microversion: 2.1 time: 0.174468 Aug 04 17:13:51.042171 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2265/4456] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:50 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:51.060611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-96e2f738-1094-498a-846e-c77964e4bc61 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-96e2f738-1094-498a-846e-c77964e4bc61 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Request method failure captured: Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e/action HTTP/1.1 Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 285 Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_4xbB8fnr17iZxpZmQfQZiM2JCxKiVWWUXjZiHpHTuUHHVw7ao4oT_uZW8wxu89NvTWOIVQIIqQPmHAao-lpxs7gxXuSYKOkaP9AGGwPUmZ0l1sD6ZLIZdH6-nP_cliwrHT6QFXnVMcXHLYBwQRQIzx4m2gYEscPKDx2pEzeM4vYGU Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 85c97e15d470473189d8a6c2068e9eac Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/85c97e15d470473189d8a6c2068e9eac"}]}] Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 85c97e15d470473189d8a6c2068e9eac Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ImagesOneServerNegativeTestJSON-1209884465-project Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 6791b833351c493a8e581154c2dfb8d7 Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465-project Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'a741b004-2f32-419c-aada-de12ed0cd36e', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:13:51.066314 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:13:51.069631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:13:51.069631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:13:51.069631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:13:51.069631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:13:51.069631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:13:51.069631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:13:51.069631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:13:51.069631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:13:51.069631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:13:51.069631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:13:51.069631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:13:51.069631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:13:51.069631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:13:51.069631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:13:51.069631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:13:51.069631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 17:13:51.069631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:13:51.069631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:13:51.069631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:13:51.069631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:13:51.069631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:13:51.069631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:13:51.069631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:13:51.069631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:13:51.069631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 17:13:51.069631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:13:51.072607 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-96e2f738-1094-498a-846e-c77964e4bc61 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:13:51.073701 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-96e2f738-1094-498a-846e-c77964e4bc61 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "POST /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e/action" status: 400 len: 619 microversion: 2.1 time: 0.017900 Aug 04 17:13:51.074301 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2266/4457] 10.222.0.93 () {60 vars in 1279 bytes} [Thu Aug 4 17:13:51 2022] POST /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e/action => generated 619 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:13:51.084012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-85f6d45c-e4ff-4627-8378-4696c668989a tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:51.084791 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-85f6d45c-e4ff-4627-8378-4696c668989a tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:51.094689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85f6d45c-e4ff-4627-8378-4696c668989a tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:51.094689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85f6d45c-e4ff-4627-8378-4696c668989a tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:51.094689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85f6d45c-e4ff-4627-8378-4696c668989a tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:51.094972 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85f6d45c-e4ff-4627-8378-4696c668989a tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:51.095513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85f6d45c-e4ff-4627-8378-4696c668989a tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:51.096016 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85f6d45c-e4ff-4627-8378-4696c668989a tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:51.217605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c4e656f0-26bf-4985-adc4-19617a40a533 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:51.226486 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c4e656f0-26bf-4985-adc4-19617a40a533 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02" status: 200 len: 1328 microversion: 2.1 time: 0.225465 Aug 04 17:13:51.228214 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2192/4458] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:50 2022] GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02 => generated 1328 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:13:51.275051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-85f6d45c-e4ff-4627-8378-4696c668989a tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:51.283550 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-85f6d45c-e4ff-4627-8378-4696c668989a tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1521 microversion: 2.1 time: 0.204604 Aug 04 17:13:51.284251 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2267/4459] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:51 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:13:51.307365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1664b690-5b42-4ff7-8978-0b7ee425da25 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:51.308269 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-eefa22c7-66a4-4776-a998-996ca8f39860 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:51.308426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1664b690-5b42-4ff7-8978-0b7ee425da25 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:51.308921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-eefa22c7-66a4-4776-a998-996ca8f39860 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:51.315807 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eefa22c7-66a4-4776-a998-996ca8f39860 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:51.316285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1664b690-5b42-4ff7-8978-0b7ee425da25 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:51.316443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eefa22c7-66a4-4776-a998-996ca8f39860 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:51.316728 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eefa22c7-66a4-4776-a998-996ca8f39860 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:51.316843 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1664b690-5b42-4ff7-8978-0b7ee425da25 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:51.317216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1664b690-5b42-4ff7-8978-0b7ee425da25 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:51.317464 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eefa22c7-66a4-4776-a998-996ca8f39860 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:51.318086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eefa22c7-66a4-4776-a998-996ca8f39860 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:51.318207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1664b690-5b42-4ff7-8978-0b7ee425da25 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:51.318596 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1664b690-5b42-4ff7-8978-0b7ee425da25 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:51.319056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eefa22c7-66a4-4776-a998-996ca8f39860 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:51.320216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1664b690-5b42-4ff7-8978-0b7ee425da25 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:51.535398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-eefa22c7-66a4-4776-a998-996ca8f39860 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:51.542235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1664b690-5b42-4ff7-8978-0b7ee425da25 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:51.544147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-eefa22c7-66a4-4776-a998-996ca8f39860 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:51.545867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-eefa22c7-66a4-4776-a998-996ca8f39860 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:51.547069 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-eefa22c7-66a4-4776-a998-996ca8f39860 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1740 microversion: 2.20 time: 0.242877 Aug 04 17:13:51.547773 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2268/4460] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:13:51 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1740 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:13:51.553051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-66ebbb4e-5bc9-48f0-8e81-739420a1bacc req-a0e17c30-4c3d-4a3a-87d8-69b4f9291c2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43df9f1d-da75-43f5-90ae-e5eaacdb4f02", "name": "network-vif-plugged", "status": "completed", "tag": "48ef7ce8-e421-4826-8d51-a6914da2fc4c"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:51.562447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-66ebbb4e-5bc9-48f0-8e81-739420a1bacc req-a0e17c30-4c3d-4a3a-87d8-69b4f9291c2e service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:51.562927 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-66ebbb4e-5bc9-48f0-8e81-739420a1bacc req-a0e17c30-4c3d-4a3a-87d8-69b4f9291c2e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:51.563571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-66ebbb4e-5bc9-48f0-8e81-739420a1bacc req-a0e17c30-4c3d-4a3a-87d8-69b4f9291c2e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:51.571637 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1664b690-5b42-4ff7-8978-0b7ee425da25 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1521 microversion: 2.1 time: 0.269439 Aug 04 17:13:51.572986 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2193/4461] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:51 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:51.575165 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-66ebbb4e-5bc9-48f0-8e81-739420a1bacc req-a0e17c30-4c3d-4a3a-87d8-69b4f9291c2e service nova] Creating event network-vif-plugged:48ef7ce8-e421-4826-8d51-a6914da2fc4c for instance 43df9f1d-da75-43f5-90ae-e5eaacdb4f02 on n-h1-851359-3 Aug 04 17:13:51.580744 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-66ebbb4e-5bc9-48f0-8e81-739420a1bacc req-a0e17c30-4c3d-4a3a-87d8-69b4f9291c2e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031525 Aug 04 17:13:51.581919 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2269/4462] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:13:51.598164 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3cdc538b-fe46-4a7e-af8e-aa79ba1fa8af tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2060821885"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:51.599450 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cd908fc3-5084-4395-82ca-5ed4b6f0b62f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:51.600255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cd908fc3-5084-4395-82ca-5ed4b6f0b62f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:51.601735 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3cdc538b-fe46-4a7e-af8e-aa79ba1fa8af tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:51.609138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3cdc538b-fe46-4a7e-af8e-aa79ba1fa8af tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:51.609774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3cdc538b-fe46-4a7e-af8e-aa79ba1fa8af tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:51.610348 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd908fc3-5084-4395-82ca-5ed4b6f0b62f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:51.610739 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3cdc538b-fe46-4a7e-af8e-aa79ba1fa8af tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:51.611761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3cdc538b-fe46-4a7e-af8e-aa79ba1fa8af tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:51.612233 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3cdc538b-fe46-4a7e-af8e-aa79ba1fa8af tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:51.612642 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd908fc3-5084-4395-82ca-5ed4b6f0b62f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:51.612785 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3cdc538b-fe46-4a7e-af8e-aa79ba1fa8af tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:51.613532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd908fc3-5084-4395-82ca-5ed4b6f0b62f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:51.614449 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd908fc3-5084-4395-82ca-5ed4b6f0b62f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:51.615193 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd908fc3-5084-4395-82ca-5ed4b6f0b62f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:51.615818 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd908fc3-5084-4395-82ca-5ed4b6f0b62f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:51.655867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:51.791724 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cd908fc3-5084-4395-82ca-5ed4b6f0b62f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:51.800804 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cd908fc3-5084-4395-82ca-5ed4b6f0b62f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1315 microversion: 2.1 time: 0.226586 Aug 04 17:13:51.807736 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2194/4463] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:51 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:51.879785 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3cdc538b-fe46-4a7e-af8e-aa79ba1fa8af tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "POST /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e/action" status: 202 len: 0 microversion: 2.1 time: 0.288527 Aug 04 17:13:51.880441 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2270/4464] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:13:51 2022] POST /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 04 17:13:51.891532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ab7778c6-3921-46f7-9c87-f48a14a81be4 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-621632714"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:51.893956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ab7778c6-3921-46f7-9c87-f48a14a81be4 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:51.899855 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab7778c6-3921-46f7-9c87-f48a14a81be4 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:51.900343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab7778c6-3921-46f7-9c87-f48a14a81be4 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:51.900828 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab7778c6-3921-46f7-9c87-f48a14a81be4 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:51.901521 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab7778c6-3921-46f7-9c87-f48a14a81be4 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:51.902019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab7778c6-3921-46f7-9c87-f48a14a81be4 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:51.902451 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab7778c6-3921-46f7-9c87-f48a14a81be4 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:51.933899 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-ab7778c6-3921-46f7-9c87-f48a14a81be4 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] HTTP exception thrown: Cannot 'createImage' instance a741b004-2f32-419c-aada-de12ed0cd36e while it is in task_state image_snapshot_pending Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ab7778c6-3921-46f7-9c87-f48a14a81be4 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Request method failure captured: Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e/action HTTP/1.1 Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 84 Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_4xbB8fnr17iZxpZmQfQZiM2JCxKiVWWUXjZiHpHTuUHHVw7ao4oT_uZW8wxu89NvTWOIVQIIqQPmHAao-lpxs7gxXuSYKOkaP9AGGwPUmZ0l1sD6ZLIZdH6-nP_cliwrHT6QFXnVMcXHLYBwQRQIzx4m2gYEscPKDx2pEzeM4vYGU Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 85c97e15d470473189d8a6c2068e9eac Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/85c97e15d470473189d8a6c2068e9eac"}]}] Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 85c97e15d470473189d8a6c2068e9eac Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ImagesOneServerNegativeTestJSON-1209884465-project Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 6791b833351c493a8e581154c2dfb8d7 Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465-project Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-621632714"}} Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: exception: Cannot 'createImage' instance a741b004-2f32-419c-aada-de12ed0cd36e while it is in task_state image_snapshot_pending Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'a741b004-2f32-419c-aada-de12ed0cd36e', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-621632714'}}} Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a741b004-2f32-419c-aada-de12ed0cd36e in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 17:13:51.935560 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 17:13:51.943821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance a741b004-2f32-419c-aada-de12ed0cd36e while it is in task_state image_snapshot_pending Aug 04 17:13:51.943821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:13:51.943821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:13:51.943821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:13:51.943821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:13:51.943821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:13:51.943821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:13:51.943821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:13:51.943821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:13:51.943821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance a741b004-2f32-419c-aada-de12ed0cd36e while it is in task_state image_snapshot_pending Aug 04 17:13:51.943821 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:13:51.943821 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ab7778c6-3921-46f7-9c87-f48a14a81be4 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Returning 409 to user: Cannot 'createImage' instance a741b004-2f32-419c-aada-de12ed0cd36e while it is in task_state image_snapshot_pending {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:13:51.943821 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ab7778c6-3921-46f7-9c87-f48a14a81be4 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "POST /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e/action" status: 409 len: 167 microversion: 2.1 time: 0.050547 Aug 04 17:13:51.943821 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2195/4465] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:13:51 2022] POST /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e/action => generated 167 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:13:51.947089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a3b3e676-db09-4c28-b21e-a9902de90f2c tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '.version_select at 0x7f1e5ab02430>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:52.090616 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a3b3e676-db09-4c28-b21e-a9902de90f2c tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "DELETE /compute/v2.1/images/02386db1-6cd7-4656-9f74-d157e1a9d05d" status: 204 len: 0 microversion: 2.1 time: 0.147360 Aug 04 17:13:52.091513 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2271/4466] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:51 2022] DELETE /compute/v2.1/images/02386db1-6cd7-4656-9f74-d157e1a9d05d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 17:13:52.101145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-027fa04d-ab0f-4e17-995e-07f183b7df5c tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:52.101796 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-027fa04d-ab0f-4e17-995e-07f183b7df5c tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:52.108803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-027fa04d-ab0f-4e17-995e-07f183b7df5c tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:52.109292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-027fa04d-ab0f-4e17-995e-07f183b7df5c tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:52.109731 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-027fa04d-ab0f-4e17-995e-07f183b7df5c tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:52.110462 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-027fa04d-ab0f-4e17-995e-07f183b7df5c tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:52.111039 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-027fa04d-ab0f-4e17-995e-07f183b7df5c tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:52.111478 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-027fa04d-ab0f-4e17-995e-07f183b7df5c tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:52.248294 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d1ebdc72-233a-44f9-9819-500a320de7bf tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:52.250343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d1ebdc72-233a-44f9-9819-500a320de7bf tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 43df9f1d-da75-43f5-90ae-e5eaacdb4f02] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:52.255280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-027fa04d-ab0f-4e17-995e-07f183b7df5c tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:52.263325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1ebdc72-233a-44f9-9819-500a320de7bf tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:52.263826 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-027fa04d-ab0f-4e17-995e-07f183b7df5c tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1533 microversion: 2.1 time: 0.166487 Aug 04 17:13:52.264298 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1ebdc72-233a-44f9-9819-500a320de7bf tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:52.274137 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2196/4467] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:52 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1533 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:52.275330 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1ebdc72-233a-44f9-9819-500a320de7bf tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:52.276967 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1ebdc72-233a-44f9-9819-500a320de7bf tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:52.277459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1ebdc72-233a-44f9-9819-500a320de7bf tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:52.277925 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1ebdc72-233a-44f9-9819-500a320de7bf tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:52.417161 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d1ebdc72-233a-44f9-9819-500a320de7bf tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:52.426096 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d1ebdc72-233a-44f9-9819-500a320de7bf tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02" status: 200 len: 1328 microversion: 2.1 time: 0.181922 Aug 04 17:13:52.427223 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2272/4468] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:52 2022] GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02 => generated 1328 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:13:52.572804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b2e7df94-3850-43e7-b88b-1a892590c3b6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:52.573524 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b2e7df94-3850-43e7-b88b-1a892590c3b6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:52.579812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2e7df94-3850-43e7-b88b-1a892590c3b6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:52.580302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2e7df94-3850-43e7-b88b-1a892590c3b6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:52.580965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2e7df94-3850-43e7-b88b-1a892590c3b6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:52.581672 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2e7df94-3850-43e7-b88b-1a892590c3b6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:52.582216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2e7df94-3850-43e7-b88b-1a892590c3b6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:52.582654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2e7df94-3850-43e7-b88b-1a892590c3b6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:52.738160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b2e7df94-3850-43e7-b88b-1a892590c3b6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:52.746727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b2e7df94-3850-43e7-b88b-1a892590c3b6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:52.748371 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b2e7df94-3850-43e7-b88b-1a892590c3b6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:52.749685 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b2e7df94-3850-43e7-b88b-1a892590c3b6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1722 microversion: 2.20 time: 0.180859 Aug 04 17:13:52.750496 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2197/4469] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:13:52 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:13:52.828685 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-134dda9c-9007-4cfd-b49c-c182174854aa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:52.829308 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-134dda9c-9007-4cfd-b49c-c182174854aa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:52.836051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-134dda9c-9007-4cfd-b49c-c182174854aa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:52.836554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-134dda9c-9007-4cfd-b49c-c182174854aa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:52.836997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-134dda9c-9007-4cfd-b49c-c182174854aa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:52.837731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-134dda9c-9007-4cfd-b49c-c182174854aa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:52.838218 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-134dda9c-9007-4cfd-b49c-c182174854aa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:52.838651 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-134dda9c-9007-4cfd-b49c-c182174854aa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:52.988776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-134dda9c-9007-4cfd-b49c-c182174854aa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:52.996527 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-134dda9c-9007-4cfd-b49c-c182174854aa tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1501 microversion: 2.1 time: 0.172913 Aug 04 17:13:52.997093 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2273/4470] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:52 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1501 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:53.019176 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cf1522db-97dd-4207-b102-b5693edd9925 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:53.020010 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cf1522db-97dd-4207-b102-b5693edd9925 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:53.026684 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf1522db-97dd-4207-b102-b5693edd9925 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:53.027467 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf1522db-97dd-4207-b102-b5693edd9925 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:53.028064 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf1522db-97dd-4207-b102-b5693edd9925 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:53.042152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf1522db-97dd-4207-b102-b5693edd9925 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:53.043204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf1522db-97dd-4207-b102-b5693edd9925 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:53.043648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf1522db-97dd-4207-b102-b5693edd9925 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:53.132055 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cf1522db-97dd-4207-b102-b5693edd9925 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d/action" status: 202 len: 0 microversion: 2.1 time: 0.117484 Aug 04 17:13:53.134375 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2198/4471] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:13:53 2022] POST /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 17:13:53.142239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-75f47a13-985b-4b15-a03b-96b5519e8a50 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:53.142529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-75f47a13-985b-4b15-a03b-96b5519e8a50 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:53.148797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75f47a13-985b-4b15-a03b-96b5519e8a50 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:53.149298 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75f47a13-985b-4b15-a03b-96b5519e8a50 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:53.149782 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75f47a13-985b-4b15-a03b-96b5519e8a50 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:53.150717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75f47a13-985b-4b15-a03b-96b5519e8a50 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:53.151183 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75f47a13-985b-4b15-a03b-96b5519e8a50 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:53.151820 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75f47a13-985b-4b15-a03b-96b5519e8a50 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:53.285760 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-89b3d79b-05f7-4c11-bc4e-d95447df9b7f tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:53.286676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-89b3d79b-05f7-4c11-bc4e-d95447df9b7f tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:53.293596 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-89b3d79b-05f7-4c11-bc4e-d95447df9b7f tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:53.294356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-89b3d79b-05f7-4c11-bc4e-d95447df9b7f tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:53.295184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-89b3d79b-05f7-4c11-bc4e-d95447df9b7f tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:53.296693 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-89b3d79b-05f7-4c11-bc4e-d95447df9b7f tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:53.297420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-89b3d79b-05f7-4c11-bc4e-d95447df9b7f tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:53.297987 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-89b3d79b-05f7-4c11-bc4e-d95447df9b7f tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:53.302529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-75f47a13-985b-4b15-a03b-96b5519e8a50 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:53.311743 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-75f47a13-985b-4b15-a03b-96b5519e8a50 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1506 microversion: 2.1 time: 0.174312 Aug 04 17:13:53.312338 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2274/4472] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:53 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1506 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:53.442095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-89b3d79b-05f7-4c11-bc4e-d95447df9b7f tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:53.450300 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-89b3d79b-05f7-4c11-bc4e-d95447df9b7f tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1533 microversion: 2.1 time: 0.168963 Aug 04 17:13:53.450564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a21ec4e5-ac1d-4567-b6f9-2c40eb0cb5c1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:53.458023 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a21ec4e5-ac1d-4567-b6f9-2c40eb0cb5c1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 43df9f1d-da75-43f5-90ae-e5eaacdb4f02] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:53.458176 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2199/4473] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:53 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1533 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:13:53.458272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a21ec4e5-ac1d-4567-b6f9-2c40eb0cb5c1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:53.458272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a21ec4e5-ac1d-4567-b6f9-2c40eb0cb5c1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:53.458564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a21ec4e5-ac1d-4567-b6f9-2c40eb0cb5c1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:53.459339 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a21ec4e5-ac1d-4567-b6f9-2c40eb0cb5c1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:53.459870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a21ec4e5-ac1d-4567-b6f9-2c40eb0cb5c1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:53.460375 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a21ec4e5-ac1d-4567-b6f9-2c40eb0cb5c1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:53.600798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a21ec4e5-ac1d-4567-b6f9-2c40eb0cb5c1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:53.609776 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a21ec4e5-ac1d-4567-b6f9-2c40eb0cb5c1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02" status: 200 len: 1510 microversion: 2.1 time: 0.163007 Aug 04 17:13:53.610374 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2275/4474] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:53 2022] GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02 => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:53.630471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-823123d0-302f-4bae-a549-437de3e8f960 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:53.631127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-823123d0-302f-4bae-a549-437de3e8f960 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 43df9f1d-da75-43f5-90ae-e5eaacdb4f02] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:53.637014 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-823123d0-302f-4bae-a549-437de3e8f960 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:53.637509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-823123d0-302f-4bae-a549-437de3e8f960 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:53.637952 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-823123d0-302f-4bae-a549-437de3e8f960 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:53.638676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-823123d0-302f-4bae-a549-437de3e8f960 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:53.639140 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-823123d0-302f-4bae-a549-437de3e8f960 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:53.640116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-823123d0-302f-4bae-a549-437de3e8f960 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:53.773305 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-823123d0-302f-4bae-a549-437de3e8f960 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:53.774481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4acab6f9-ae94-42e8-9cc0-f82b19fff977 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:53.775104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4acab6f9-ae94-42e8-9cc0-f82b19fff977 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:53.781881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4acab6f9-ae94-42e8-9cc0-f82b19fff977 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:53.782611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4acab6f9-ae94-42e8-9cc0-f82b19fff977 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:53.783054 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4acab6f9-ae94-42e8-9cc0-f82b19fff977 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:53.783369 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-823123d0-302f-4bae-a549-437de3e8f960 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02" status: 200 len: 1510 microversion: 2.1 time: 0.156769 Aug 04 17:13:53.783810 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4acab6f9-ae94-42e8-9cc0-f82b19fff977 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:53.783953 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2200/4475] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:53 2022] GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:53.784269 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4acab6f9-ae94-42e8-9cc0-f82b19fff977 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:53.784765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4acab6f9-ae94-42e8-9cc0-f82b19fff977 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:53.802932 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-392fdf91-303a-4cd8-a9fa-80bb56270455 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:53.803432 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-392fdf91-303a-4cd8-a9fa-80bb56270455 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 43df9f1d-da75-43f5-90ae-e5eaacdb4f02] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:53.809427 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-392fdf91-303a-4cd8-a9fa-80bb56270455 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:53.810172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-392fdf91-303a-4cd8-a9fa-80bb56270455 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:53.811044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-392fdf91-303a-4cd8-a9fa-80bb56270455 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:53.812222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-392fdf91-303a-4cd8-a9fa-80bb56270455 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:53.812919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-392fdf91-303a-4cd8-a9fa-80bb56270455 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:53.813495 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-392fdf91-303a-4cd8-a9fa-80bb56270455 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:53.841911 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-392fdf91-303a-4cd8-a9fa-80bb56270455 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 43df9f1d-da75-43f5-90ae-e5eaacdb4f02] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:13:53.857602 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:53.935734 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-392fdf91-303a-4cd8-a9fa-80bb56270455 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "DELETE /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02" status: 204 len: 0 microversion: 2.1 time: 0.136224 Aug 04 17:13:53.938323 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2201/4476] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:13:53 2022] DELETE /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 17:13:53.940000 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4acab6f9-ae94-42e8-9cc0-f82b19fff977 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:53.948928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-184e5764-22b1-4493-9538-7177e64f59c7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:53.950178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-184e5764-22b1-4493-9538-7177e64f59c7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 43df9f1d-da75-43f5-90ae-e5eaacdb4f02] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:53.951085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4acab6f9-ae94-42e8-9cc0-f82b19fff977 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:53.955397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4acab6f9-ae94-42e8-9cc0-f82b19fff977 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:53.956645 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4acab6f9-ae94-42e8-9cc0-f82b19fff977 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1722 microversion: 2.20 time: 0.186866 Aug 04 17:13:53.957963 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2276/4477] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:13:53 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:13:53.959508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-184e5764-22b1-4493-9538-7177e64f59c7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:53.960180 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-184e5764-22b1-4493-9538-7177e64f59c7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:53.960627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-184e5764-22b1-4493-9538-7177e64f59c7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:53.961363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-184e5764-22b1-4493-9538-7177e64f59c7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:53.961812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-184e5764-22b1-4493-9538-7177e64f59c7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:53.962281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-184e5764-22b1-4493-9538-7177e64f59c7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:54.099029 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-184e5764-22b1-4493-9538-7177e64f59c7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:54.107015 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-184e5764-22b1-4493-9538-7177e64f59c7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02" status: 200 len: 1516 microversion: 2.1 time: 0.164019 Aug 04 17:13:54.107624 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2202/4478] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:53 2022] GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02 => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:54.333248 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5ca70c0d-37a0-4de1-a2a0-ae73b7d91c8f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:54.333879 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5ca70c0d-37a0-4de1-a2a0-ae73b7d91c8f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:54.340229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ca70c0d-37a0-4de1-a2a0-ae73b7d91c8f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:54.340730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ca70c0d-37a0-4de1-a2a0-ae73b7d91c8f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:54.341180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ca70c0d-37a0-4de1-a2a0-ae73b7d91c8f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:54.341884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ca70c0d-37a0-4de1-a2a0-ae73b7d91c8f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:54.342389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ca70c0d-37a0-4de1-a2a0-ae73b7d91c8f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:54.342866 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ca70c0d-37a0-4de1-a2a0-ae73b7d91c8f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:54.471351 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f014e7b6-9231-4413-87b0-6c88d9ef69a4 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:54.471972 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f014e7b6-9231-4413-87b0-6c88d9ef69a4 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:54.482937 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5ca70c0d-37a0-4de1-a2a0-ae73b7d91c8f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:54.490665 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f014e7b6-9231-4413-87b0-6c88d9ef69a4 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:54.491103 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5ca70c0d-37a0-4de1-a2a0-ae73b7d91c8f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1506 microversion: 2.1 time: 0.161703 Aug 04 17:13:54.491222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f014e7b6-9231-4413-87b0-6c88d9ef69a4 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:54.491605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f014e7b6-9231-4413-87b0-6c88d9ef69a4 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:54.491754 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2277/4479] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:54 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:54.492319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f014e7b6-9231-4413-87b0-6c88d9ef69a4 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:54.492784 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f014e7b6-9231-4413-87b0-6c88d9ef69a4 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:54.493211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f014e7b6-9231-4413-87b0-6c88d9ef69a4 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:54.631591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f014e7b6-9231-4413-87b0-6c88d9ef69a4 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:54.639217 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f014e7b6-9231-4413-87b0-6c88d9ef69a4 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1533 microversion: 2.1 time: 0.172068 Aug 04 17:13:54.639885 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2203/4480] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:54 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1533 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:54.980502 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e69c80e0-45df-496f-a1fc-35bb4aacecf8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:54.981223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e69c80e0-45df-496f-a1fc-35bb4aacecf8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:54.989163 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e69c80e0-45df-496f-a1fc-35bb4aacecf8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:54.989419 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e69c80e0-45df-496f-a1fc-35bb4aacecf8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:54.990358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e69c80e0-45df-496f-a1fc-35bb4aacecf8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:54.990705 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e69c80e0-45df-496f-a1fc-35bb4aacecf8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:54.991234 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e69c80e0-45df-496f-a1fc-35bb4aacecf8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:54.991734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e69c80e0-45df-496f-a1fc-35bb4aacecf8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:55.009147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-4736fa65-0669-4d7e-8f6d-e2a497189ddb req-178294dc-b896-4fcb-83fc-e4d1dfc9126d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c682c4f-3eed-44cd-9782-3ed12f2d8f0d", "name": "network-vif-unplugged", "status": "completed", "tag": "8b60e742-6e36-45ea-a5d7-62315ea560df"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:55.027243 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4736fa65-0669-4d7e-8f6d-e2a497189ddb req-178294dc-b896-4fcb-83fc-e4d1dfc9126d service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:55.028052 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4736fa65-0669-4d7e-8f6d-e2a497189ddb req-178294dc-b896-4fcb-83fc-e4d1dfc9126d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:55.028688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4736fa65-0669-4d7e-8f6d-e2a497189ddb req-178294dc-b896-4fcb-83fc-e4d1dfc9126d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:55.043300 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-4736fa65-0669-4d7e-8f6d-e2a497189ddb req-178294dc-b896-4fcb-83fc-e4d1dfc9126d service nova] Creating event network-vif-unplugged:8b60e742-6e36-45ea-a5d7-62315ea560df for instance 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d on n-h2-851359-3 Aug 04 17:13:55.050416 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-4736fa65-0669-4d7e-8f6d-e2a497189ddb req-178294dc-b896-4fcb-83fc-e4d1dfc9126d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049699 Aug 04 17:13:55.051666 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2204/4481] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:13:55.129200 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7514bab9-eda4-4a95-80c7-4d293341c897 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:55.129910 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7514bab9-eda4-4a95-80c7-4d293341c897 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 43df9f1d-da75-43f5-90ae-e5eaacdb4f02] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:55.136208 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7514bab9-eda4-4a95-80c7-4d293341c897 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:55.136997 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7514bab9-eda4-4a95-80c7-4d293341c897 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:55.137440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7514bab9-eda4-4a95-80c7-4d293341c897 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:55.138686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7514bab9-eda4-4a95-80c7-4d293341c897 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:55.139306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7514bab9-eda4-4a95-80c7-4d293341c897 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:55.140437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7514bab9-eda4-4a95-80c7-4d293341c897 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:55.141418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e69c80e0-45df-496f-a1fc-35bb4aacecf8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:55.152475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e69c80e0-45df-496f-a1fc-35bb4aacecf8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:55.153965 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e69c80e0-45df-496f-a1fc-35bb4aacecf8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:55.155782 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e69c80e0-45df-496f-a1fc-35bb4aacecf8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1722 microversion: 2.20 time: 0.178950 Aug 04 17:13:55.156462 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2278/4482] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:13:54 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:13:55.303125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7514bab9-eda4-4a95-80c7-4d293341c897 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:55.311109 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7514bab9-eda4-4a95-80c7-4d293341c897 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02" status: 200 len: 1516 microversion: 2.1 time: 0.186565 Aug 04 17:13:55.311769 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2205/4483] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:55 2022] GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02 => generated 1516 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:13:55.512411 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-46f08544-82a8-4b19-bbad-862d9247b2d4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:55.513193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-46f08544-82a8-4b19-bbad-862d9247b2d4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:55.520798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-46f08544-82a8-4b19-bbad-862d9247b2d4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:55.521337 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-46f08544-82a8-4b19-bbad-862d9247b2d4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:55.521785 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-46f08544-82a8-4b19-bbad-862d9247b2d4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:55.522534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-46f08544-82a8-4b19-bbad-862d9247b2d4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:55.523099 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-46f08544-82a8-4b19-bbad-862d9247b2d4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:55.523628 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-46f08544-82a8-4b19-bbad-862d9247b2d4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:55.660917 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6cadb0b8-d7de-40d9-9f22-1a40bb39a766 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:55.662089 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6cadb0b8-d7de-40d9-9f22-1a40bb39a766 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:55.669711 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6cadb0b8-d7de-40d9-9f22-1a40bb39a766 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:55.670450 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6cadb0b8-d7de-40d9-9f22-1a40bb39a766 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:55.671147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6cadb0b8-d7de-40d9-9f22-1a40bb39a766 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:55.684311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6cadb0b8-d7de-40d9-9f22-1a40bb39a766 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:55.686203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-46f08544-82a8-4b19-bbad-862d9247b2d4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:55.691279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6cadb0b8-d7de-40d9-9f22-1a40bb39a766 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:55.692024 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6cadb0b8-d7de-40d9-9f22-1a40bb39a766 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:55.706281 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-46f08544-82a8-4b19-bbad-862d9247b2d4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1506 microversion: 2.1 time: 0.197658 Aug 04 17:13:55.706905 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2279/4484] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:55 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1506 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:55.850191 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6cadb0b8-d7de-40d9-9f22-1a40bb39a766 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:55.857786 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6cadb0b8-d7de-40d9-9f22-1a40bb39a766 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1539 microversion: 2.1 time: 0.201636 Aug 04 17:13:55.858901 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2206/4485] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:55 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1539 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:13:56.180997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-888f2309-5058-4918-9f73-b1663b02173a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:56.182428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-888f2309-5058-4918-9f73-b1663b02173a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:56.193523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-888f2309-5058-4918-9f73-b1663b02173a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:56.194134 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-888f2309-5058-4918-9f73-b1663b02173a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:56.194788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-888f2309-5058-4918-9f73-b1663b02173a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:56.195668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-888f2309-5058-4918-9f73-b1663b02173a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:56.196132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-888f2309-5058-4918-9f73-b1663b02173a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:56.196734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-888f2309-5058-4918-9f73-b1663b02173a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:56.336961 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-94625c29-d868-4c53-b912-38cb0de96f7c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:56.337898 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-94625c29-d868-4c53-b912-38cb0de96f7c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 43df9f1d-da75-43f5-90ae-e5eaacdb4f02] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:56.346438 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94625c29-d868-4c53-b912-38cb0de96f7c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:56.347302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94625c29-d868-4c53-b912-38cb0de96f7c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:56.347977 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94625c29-d868-4c53-b912-38cb0de96f7c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:56.348905 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94625c29-d868-4c53-b912-38cb0de96f7c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:56.349812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94625c29-d868-4c53-b912-38cb0de96f7c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:56.350483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94625c29-d868-4c53-b912-38cb0de96f7c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:56.354597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-888f2309-5058-4918-9f73-b1663b02173a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:56.364562 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-888f2309-5058-4918-9f73-b1663b02173a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:56.366537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-888f2309-5058-4918-9f73-b1663b02173a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:56.367731 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-888f2309-5058-4918-9f73-b1663b02173a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1665 microversion: 2.20 time: 0.192184 Aug 04 17:13:56.382033 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2280/4486] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:13:56 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1665 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:13:56.401366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-455a3878-ecf6-4040-b2b9-82a38e2621e3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4925f9db-0493-477b-b82e-0ec04b19368c"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:56.406641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-455a3878-ecf6-4040-b2b9-82a38e2621e3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:56.414355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-455a3878-ecf6-4040-b2b9-82a38e2621e3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:56.415164 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-455a3878-ecf6-4040-b2b9-82a38e2621e3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:56.415942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-455a3878-ecf6-4040-b2b9-82a38e2621e3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:56.416975 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-455a3878-ecf6-4040-b2b9-82a38e2621e3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:56.417595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-455a3878-ecf6-4040-b2b9-82a38e2621e3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:56.418307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-455a3878-ecf6-4040-b2b9-82a38e2621e3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:56.555383 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-94625c29-d868-4c53-b912-38cb0de96f7c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:56.568472 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-94625c29-d868-4c53-b912-38cb0de96f7c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02" status: 200 len: 1516 microversion: 2.1 time: 0.239205 Aug 04 17:13:56.586174 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2207/4487] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:56 2022] GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02 => generated 1516 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:13:56.599341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-996eac61-494c-4542-8bcc-390b85457ea3 req-d8096326-4d89-4e4d-88df-a7b1e1555a38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43df9f1d-da75-43f5-90ae-e5eaacdb4f02", "name": "network-vif-deleted", "tag": "48ef7ce8-e421-4826-8d51-a6914da2fc4c"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:56.628545 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-996eac61-494c-4542-8bcc-390b85457ea3 req-d8096326-4d89-4e4d-88df-a7b1e1555a38 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:56.629270 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-996eac61-494c-4542-8bcc-390b85457ea3 req-d8096326-4d89-4e4d-88df-a7b1e1555a38 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:56.630083 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-996eac61-494c-4542-8bcc-390b85457ea3 req-d8096326-4d89-4e4d-88df-a7b1e1555a38 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:56.657727 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-996eac61-494c-4542-8bcc-390b85457ea3 req-d8096326-4d89-4e4d-88df-a7b1e1555a38 service nova] Creating event network-vif-deleted:48ef7ce8-e421-4826-8d51-a6914da2fc4c for instance 43df9f1d-da75-43f5-90ae-e5eaacdb4f02 on n-h1-851359-3 Aug 04 17:13:56.675762 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-996eac61-494c-4542-8bcc-390b85457ea3 req-d8096326-4d89-4e4d-88df-a7b1e1555a38 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083914 Aug 04 17:13:56.678696 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2208/4488] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:13:56.730793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c487b9e0-16d9-43a8-b10e-3ac9fa36d23e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:56.731512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c487b9e0-16d9-43a8-b10e-3ac9fa36d23e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:56.740543 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c487b9e0-16d9-43a8-b10e-3ac9fa36d23e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:56.741166 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c487b9e0-16d9-43a8-b10e-3ac9fa36d23e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:56.741685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c487b9e0-16d9-43a8-b10e-3ac9fa36d23e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:56.742522 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c487b9e0-16d9-43a8-b10e-3ac9fa36d23e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:56.743747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c487b9e0-16d9-43a8-b10e-3ac9fa36d23e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:56.744601 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c487b9e0-16d9-43a8-b10e-3ac9fa36d23e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:56.953427 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-455a3878-ecf6-4040-b2b9-82a38e2621e3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "POST /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.559408 Aug 04 17:13:56.961872 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2281/4489] 10.222.0.93 () {62 vars in 1364 bytes} [Thu Aug 4 17:13:56 2022] POST /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d/os-volume_attachments => generated 188 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:13:56.970129 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-73e792c9-1290-4ab6-99de-e68edc6b3b68 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:56.970987 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-73e792c9-1290-4ab6-99de-e68edc6b3b68 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:56.979918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73e792c9-1290-4ab6-99de-e68edc6b3b68 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:56.980978 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73e792c9-1290-4ab6-99de-e68edc6b3b68 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:56.981993 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73e792c9-1290-4ab6-99de-e68edc6b3b68 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:56.983144 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73e792c9-1290-4ab6-99de-e68edc6b3b68 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:56.983803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73e792c9-1290-4ab6-99de-e68edc6b3b68 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:56.984430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73e792c9-1290-4ab6-99de-e68edc6b3b68 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:56.987363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c487b9e0-16d9-43a8-b10e-3ac9fa36d23e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:56.997994 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c487b9e0-16d9-43a8-b10e-3ac9fa36d23e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1486 microversion: 2.1 time: 0.273616 Aug 04 17:13:56.999663 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2209/4490] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:56 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1486 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:57.037203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fa3cc400-3b2a-48cc-8a8d-98039420bbb5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:57.038040 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fa3cc400-3b2a-48cc-8a8d-98039420bbb5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:57.045350 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa3cc400-3b2a-48cc-8a8d-98039420bbb5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:57.046634 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa3cc400-3b2a-48cc-8a8d-98039420bbb5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:57.047256 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa3cc400-3b2a-48cc-8a8d-98039420bbb5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:57.048456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa3cc400-3b2a-48cc-8a8d-98039420bbb5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:57.050905 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa3cc400-3b2a-48cc-8a8d-98039420bbb5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:57.051932 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa3cc400-3b2a-48cc-8a8d-98039420bbb5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:57.079115 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-fa3cc400-3b2a-48cc-8a8d-98039420bbb5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lazy-loading 'flavor' on Instance uuid a9567ac7-9ee0-4ae3-b7c7-6033039de89d {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:13:57.176118 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-73e792c9-1290-4ab6-99de-e68edc6b3b68 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:57.185751 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-73e792c9-1290-4ab6-99de-e68edc6b3b68 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1539 microversion: 2.1 time: 0.222136 Aug 04 17:13:57.195223 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2282/4491] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:56 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1539 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:57.200867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8d15ebf2-e648-433f-a078-650d9f5f3ad8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:57.201806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8d15ebf2-e648-433f-a078-650d9f5f3ad8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:57.209715 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d15ebf2-e648-433f-a078-650d9f5f3ad8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:57.210906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d15ebf2-e648-433f-a078-650d9f5f3ad8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:57.211457 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d15ebf2-e648-433f-a078-650d9f5f3ad8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:57.212670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d15ebf2-e648-433f-a078-650d9f5f3ad8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:57.218494 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d15ebf2-e648-433f-a078-650d9f5f3ad8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:57.220343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d15ebf2-e648-433f-a078-650d9f5f3ad8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:57.277358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8d15ebf2-e648-433f-a078-650d9f5f3ad8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=131043) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 17:13:57.354484 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fa3cc400-3b2a-48cc-8a8d-98039420bbb5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d/action" status: 202 len: 0 microversion: 2.1 time: 0.319885 Aug 04 17:13:57.355104 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2210/4492] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:13:57 2022] POST /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:13:57.363060 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:13:57.364961 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-56a8dfb3-71f5-4993-8807-dce4140e9cf6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:57.365815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-56a8dfb3-71f5-4993-8807-dce4140e9cf6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:57.373820 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56a8dfb3-71f5-4993-8807-dce4140e9cf6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:57.374347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56a8dfb3-71f5-4993-8807-dce4140e9cf6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:57.374778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56a8dfb3-71f5-4993-8807-dce4140e9cf6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:57.375511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56a8dfb3-71f5-4993-8807-dce4140e9cf6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:57.375953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56a8dfb3-71f5-4993-8807-dce4140e9cf6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:57.377008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56a8dfb3-71f5-4993-8807-dce4140e9cf6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:57.392835 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8d15ebf2-e648-433f-a078-650d9f5f3ad8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "POST /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d/action" status: 202 len: 0 microversion: 2.20 time: 0.196275 Aug 04 17:13:57.394031 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2283/4493] 10.222.0.93 () {62 vars in 1319 bytes} [Thu Aug 4 17:13:57 2022] POST /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:13:57.401376 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3eeb908c-4cdc-4ec4-b775-16e96c76a36d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:57.402010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3eeb908c-4cdc-4ec4-b775-16e96c76a36d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:57.408840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3eeb908c-4cdc-4ec4-b775-16e96c76a36d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:57.409210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3eeb908c-4cdc-4ec4-b775-16e96c76a36d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:57.410061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3eeb908c-4cdc-4ec4-b775-16e96c76a36d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:57.410928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3eeb908c-4cdc-4ec4-b775-16e96c76a36d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:57.411543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3eeb908c-4cdc-4ec4-b775-16e96c76a36d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:57.412304 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3eeb908c-4cdc-4ec4-b775-16e96c76a36d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:57.665434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3eeb908c-4cdc-4ec4-b775-16e96c76a36d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:57.680475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3eeb908c-4cdc-4ec4-b775-16e96c76a36d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:57.683566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3eeb908c-4cdc-4ec4-b775-16e96c76a36d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:57.687292 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3eeb908c-4cdc-4ec4-b775-16e96c76a36d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1751 microversion: 2.20 time: 0.289674 Aug 04 17:13:57.689748 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2284/4494] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:13:57 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1751 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:13:57.700932 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7ddd3cdf-6230-49ce-ae78-df342b3fdfc0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:57.702002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7ddd3cdf-6230-49ce-ae78-df342b3fdfc0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 43df9f1d-da75-43f5-90ae-e5eaacdb4f02] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:57.715086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7ddd3cdf-6230-49ce-ae78-df342b3fdfc0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:57.715981 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7ddd3cdf-6230-49ce-ae78-df342b3fdfc0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:57.716876 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7ddd3cdf-6230-49ce-ae78-df342b3fdfc0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:57.719312 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-56a8dfb3-71f5-4993-8807-dce4140e9cf6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:57.720271 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7ddd3cdf-6230-49ce-ae78-df342b3fdfc0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:57.720952 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7ddd3cdf-6230-49ce-ae78-df342b3fdfc0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:57.721592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7ddd3cdf-6230-49ce-ae78-df342b3fdfc0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:57.730638 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-56a8dfb3-71f5-4993-8807-dce4140e9cf6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1492 microversion: 2.1 time: 0.370086 Aug 04 17:13:57.731668 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2211/4495] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:57 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1492 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:57.749520 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-7ddd3cdf-6230-49ce-ae78-df342b3fdfc0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] HTTP exception thrown: Instance 43df9f1d-da75-43f5-90ae-e5eaacdb4f02 could not be found. Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7ddd3cdf-6230-49ce-ae78-df342b3fdfc0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Request method failure captured: Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02 HTTP/1.1 Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_4PiXAoqFPCXVrtw_fcVtbWCRHCRY1BcfprLEe-EkZEFmD3rLGum9OIJcRnH-o3xr4k8T7yl4V2Hv5h2fEBByVUFBw2XIbz_i_ncVR1MMvkDEp1AvjPEGXUtr2hnsv9JoWINOTj84eRxq_Gac5VyTIxXMDaWbVLw5VeWNnbunOt5QM Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d9911aeb77cd4ffb8c4e539998a04f3c"}]}] Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersTestJSON-1653035612 Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersTestJSON-1653035612-project Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 8e840d06bb5d44e097e6f0855b04cb06 Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersTestJSON-1653035612-project Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 43df9f1d-da75-43f5-90ae-e5eaacdb4f02 could not be found. Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '43df9f1d-da75-43f5-90ae-e5eaacdb4f02'} Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43df9f1d-da75-43f5-90ae-e5eaacdb4f02 could not be found. Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43df9f1d-da75-43f5-90ae-e5eaacdb4f02 could not be found. Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:13:57.756950 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:13:57.761216 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:13:57.761216 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:13:57.761216 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:13:57.761216 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:13:57.761216 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:13:57.761216 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43df9f1d-da75-43f5-90ae-e5eaacdb4f02 could not be found. Aug 04 17:13:57.761216 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:13:57.764185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7ddd3cdf-6230-49ce-ae78-df342b3fdfc0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Returning 404 to user: Instance 43df9f1d-da75-43f5-90ae-e5eaacdb4f02 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:13:57.766914 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7ddd3cdf-6230-49ce-ae78-df342b3fdfc0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02" status: 404 len: 111 microversion: 2.1 time: 0.075769 Aug 04 17:13:57.767482 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2285/4496] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:57 2022] GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:13:57.776789 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cfdea17f-82ae-4b6f-81e1-7db52b350d3b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '.version_select at 0x7f1e5ac8ae50>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:57.803802 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cfdea17f-82ae-4b6f-81e1-7db52b350d3b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-key-1724597866" status: 202 len: 0 microversion: 2.1 time: 0.031491 Aug 04 17:13:57.811109 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2212/4497] 10.222.0.93 () {58 vars in 1209 bytes} [Thu Aug 4 17:13:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1724597866 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:13:57.931053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f29731b2-2ebd-4e33-a31c-fa712e0e196e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1535580831", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "ec3b7b59-9fd4-4839-add6-43afeffa896c"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:57.998215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-f29731b2-2ebd-4e33-a31c-fa712e0e196e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] validate_networks() for [('ec3b7b59-9fd4-4839-add6-43afeffa896c', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:13:58.211194 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-762b26ed-81b9-4639-b790-f80400fec10b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:58.211809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-762b26ed-81b9-4639-b790-f80400fec10b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:58.222186 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-762b26ed-81b9-4639-b790-f80400fec10b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:58.222695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-762b26ed-81b9-4639-b790-f80400fec10b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:58.223281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-762b26ed-81b9-4639-b790-f80400fec10b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:58.224196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-762b26ed-81b9-4639-b790-f80400fec10b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:58.224655 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-762b26ed-81b9-4639-b790-f80400fec10b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:58.225077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-762b26ed-81b9-4639-b790-f80400fec10b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:58.517682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-762b26ed-81b9-4639-b790-f80400fec10b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:58.529872 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-762b26ed-81b9-4639-b790-f80400fec10b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1539 microversion: 2.1 time: 0.322525 Aug 04 17:13:58.546883 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2213/4498] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:58 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1539 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:58.570203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-f29731b2-2ebd-4e33-a31c-fa712e0e196e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:13:58.570203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-f29731b2-2ebd-4e33-a31c-fa712e0e196e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:13:58.570203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-f29731b2-2ebd-4e33-a31c-fa712e0e196e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:13:58.570608 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-f29731b2-2ebd-4e33-a31c-fa712e0e196e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:13:58.571600 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-f29731b2-2ebd-4e33-a31c-fa712e0e196e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:13:58.585385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f29731b2-2ebd-4e33-a31c-fa712e0e196e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:58.586881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f29731b2-2ebd-4e33-a31c-fa712e0e196e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:58.587441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f29731b2-2ebd-4e33-a31c-fa712e0e196e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:58.588397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f29731b2-2ebd-4e33-a31c-fa712e0e196e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:58.588985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f29731b2-2ebd-4e33-a31c-fa712e0e196e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:58.589537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f29731b2-2ebd-4e33-a31c-fa712e0e196e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:58.614818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-f29731b2-2ebd-4e33-a31c-fa712e0e196e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Getting quotas for project d9911aeb77cd4ffb8c4e539998a04f3c. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:13:58.620751 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-f29731b2-2ebd-4e33-a31c-fa712e0e196e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Getting quotas for user 8e840d06bb5d44e097e6f0855b04cb06 and project d9911aeb77cd4ffb8c4e539998a04f3c. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:13:58.634417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f29731b2-2ebd-4e33-a31c-fa712e0e196e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:13:58.636917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f29731b2-2ebd-4e33-a31c-fa712e0e196e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: edc8a6ac-f4f5-496f-867e-27b1ed15c833] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:13:58.693143 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f29731b2-2ebd-4e33-a31c-fa712e0e196e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.765675 Aug 04 17:13:58.694044 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2286/4499] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:13:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:13:58.706039 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-838834d6-7240-4065-bd48-93935b7f6a83 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:58.706719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-838834d6-7240-4065-bd48-93935b7f6a83 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: edc8a6ac-f4f5-496f-867e-27b1ed15c833] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:58.716143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0bd0c434-0d6d-40b2-8d21-6136e70092f9 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:58.718223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0bd0c434-0d6d-40b2-8d21-6136e70092f9 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:58.726565 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0bd0c434-0d6d-40b2-8d21-6136e70092f9 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:58.727349 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0bd0c434-0d6d-40b2-8d21-6136e70092f9 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:58.727968 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0bd0c434-0d6d-40b2-8d21-6136e70092f9 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:58.729690 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0bd0c434-0d6d-40b2-8d21-6136e70092f9 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:58.730642 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0bd0c434-0d6d-40b2-8d21-6136e70092f9 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:58.731245 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0bd0c434-0d6d-40b2-8d21-6136e70092f9 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:58.804816 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-838834d6-7240-4065-bd48-93935b7f6a83 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:58.818766 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-838834d6-7240-4065-bd48-93935b7f6a83 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833" status: 200 len: 1209 microversion: 2.1 time: 0.118018 Aug 04 17:13:58.819767 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2214/4500] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:58 2022] GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833 => generated 1209 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:58.827768 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-db5b6a47-f22e-49fb-b4bc-c7d750d90201 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:58.828908 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-db5b6a47-f22e-49fb-b4bc-c7d750d90201 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:58.836911 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db5b6a47-f22e-49fb-b4bc-c7d750d90201 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:58.838556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db5b6a47-f22e-49fb-b4bc-c7d750d90201 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:58.839566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db5b6a47-f22e-49fb-b4bc-c7d750d90201 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:58.840936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db5b6a47-f22e-49fb-b4bc-c7d750d90201 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:58.843240 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db5b6a47-f22e-49fb-b4bc-c7d750d90201 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:58.843887 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db5b6a47-f22e-49fb-b4bc-c7d750d90201 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:59.061863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0bd0c434-0d6d-40b2-8d21-6136e70092f9 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:59.080842 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0bd0c434-0d6d-40b2-8d21-6136e70092f9 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:59.083818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0bd0c434-0d6d-40b2-8d21-6136e70092f9 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:59.091042 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0bd0c434-0d6d-40b2-8d21-6136e70092f9 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1751 microversion: 2.20 time: 0.378554 Aug 04 17:13:59.093183 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2287/4501] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:13:58 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1751 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:13:59.138843 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-db5b6a47-f22e-49fb-b4bc-c7d750d90201 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:59.157813 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-db5b6a47-f22e-49fb-b4bc-c7d750d90201 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1492 microversion: 2.1 time: 0.336646 Aug 04 17:13:59.163260 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2215/4502] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:58 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1492 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:59.512048 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-01445041-d880-4cdc-a3ee-cc2ffd164592 req-01acf7d2-6f0e-4f26-b43d-ea0c6c2f5859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a741b004-2f32-419c-aada-de12ed0cd36e", "name": "network-vif-plugged", "status": "completed", "tag": "4ce7718f-85dc-4011-b3ce-a182614aceb6"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:13:59.523324 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-01445041-d880-4cdc-a3ee-cc2ffd164592 req-01acf7d2-6f0e-4f26-b43d-ea0c6c2f5859 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:59.523846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-01445041-d880-4cdc-a3ee-cc2ffd164592 req-01acf7d2-6f0e-4f26-b43d-ea0c6c2f5859 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:59.527664 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-01445041-d880-4cdc-a3ee-cc2ffd164592 req-01acf7d2-6f0e-4f26-b43d-ea0c6c2f5859 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:59.547402 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-01445041-d880-4cdc-a3ee-cc2ffd164592 req-01acf7d2-6f0e-4f26-b43d-ea0c6c2f5859 service nova] Creating event network-vif-plugged:4ce7718f-85dc-4011-b3ce-a182614aceb6 for instance a741b004-2f32-419c-aada-de12ed0cd36e on n-h2-851359-3 Aug 04 17:13:59.554325 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-01445041-d880-4cdc-a3ee-cc2ffd164592 req-01acf7d2-6f0e-4f26-b43d-ea0c6c2f5859 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045766 Aug 04 17:13:59.555890 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2288/4503] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:13:59.629214 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3f5759c2-708a-4739-8d29-67de6b775a95 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:59.629875 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3f5759c2-708a-4739-8d29-67de6b775a95 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:59.639509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f5759c2-708a-4739-8d29-67de6b775a95 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:59.640010 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f5759c2-708a-4739-8d29-67de6b775a95 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:59.640454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f5759c2-708a-4739-8d29-67de6b775a95 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:59.641165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f5759c2-708a-4739-8d29-67de6b775a95 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:59.641627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f5759c2-708a-4739-8d29-67de6b775a95 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:59.642141 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f5759c2-708a-4739-8d29-67de6b775a95 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:59.821919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3f5759c2-708a-4739-8d29-67de6b775a95 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:59.831000 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3f5759c2-708a-4739-8d29-67de6b775a95 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1539 microversion: 2.1 time: 0.205866 Aug 04 17:13:59.831937 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2216/4504] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:59 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1539 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:13:59.841802 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ff298128-858f-406f-ae66-960b6de923c8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:13:59.843181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ff298128-858f-406f-ae66-960b6de923c8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: edc8a6ac-f4f5-496f-867e-27b1ed15c833] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:13:59.850216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ff298128-858f-406f-ae66-960b6de923c8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:59.850924 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ff298128-858f-406f-ae66-960b6de923c8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:59.851415 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ff298128-858f-406f-ae66-960b6de923c8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:59.852124 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ff298128-858f-406f-ae66-960b6de923c8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:13:59.852587 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ff298128-858f-406f-ae66-960b6de923c8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:13:59.853040 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ff298128-858f-406f-ae66-960b6de923c8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:13:59.919774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ff298128-858f-406f-ae66-960b6de923c8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:13:59.928066 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ff298128-858f-406f-ae66-960b6de923c8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833" status: 200 len: 1261 microversion: 2.1 time: 0.090935 Aug 04 17:13:59.929081 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2289/4505] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:13:59 2022] GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833 => generated 1261 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:00.116151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-11841e32-d257-41b8-a725-416ce1be157a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:00.117008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-11841e32-d257-41b8-a725-416ce1be157a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:00.123529 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11841e32-d257-41b8-a725-416ce1be157a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:00.124358 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11841e32-d257-41b8-a725-416ce1be157a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:00.124945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11841e32-d257-41b8-a725-416ce1be157a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:00.125794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11841e32-d257-41b8-a725-416ce1be157a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:00.126431 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11841e32-d257-41b8-a725-416ce1be157a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:00.126995 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11841e32-d257-41b8-a725-416ce1be157a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:00.184076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f1b4474c-3e72-4738-a3cf-34da56f7f5d3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:00.185340 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f1b4474c-3e72-4738-a3cf-34da56f7f5d3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:00.195399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1b4474c-3e72-4738-a3cf-34da56f7f5d3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:00.196110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1b4474c-3e72-4738-a3cf-34da56f7f5d3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:00.196703 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1b4474c-3e72-4738-a3cf-34da56f7f5d3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:00.203351 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1b4474c-3e72-4738-a3cf-34da56f7f5d3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:00.204001 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1b4474c-3e72-4738-a3cf-34da56f7f5d3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:00.204727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1b4474c-3e72-4738-a3cf-34da56f7f5d3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:00.368820 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-11841e32-d257-41b8-a725-416ce1be157a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:00.381526 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-11841e32-d257-41b8-a725-416ce1be157a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:00.386502 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-11841e32-d257-41b8-a725-416ce1be157a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:00.387967 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-11841e32-d257-41b8-a725-416ce1be157a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1753 microversion: 2.20 time: 0.275910 Aug 04 17:14:00.391237 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2217/4506] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:00 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1753 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:14:00.426072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f1b4474c-3e72-4738-a3cf-34da56f7f5d3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:00.434837 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f1b4474c-3e72-4738-a3cf-34da56f7f5d3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1492 microversion: 2.1 time: 0.255019 Aug 04 17:14:00.435897 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2290/4507] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:00 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1492 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:00.853926 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-54ba13a6-ce5e-4178-b8cf-c46715eae4d0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:00.854707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-54ba13a6-ce5e-4178-b8cf-c46715eae4d0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:00.875464 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54ba13a6-ce5e-4178-b8cf-c46715eae4d0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:00.876065 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54ba13a6-ce5e-4178-b8cf-c46715eae4d0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:00.876730 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54ba13a6-ce5e-4178-b8cf-c46715eae4d0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:00.877457 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54ba13a6-ce5e-4178-b8cf-c46715eae4d0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:00.877925 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54ba13a6-ce5e-4178-b8cf-c46715eae4d0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:00.878401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54ba13a6-ce5e-4178-b8cf-c46715eae4d0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:00.918193 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:00.948587 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-339cd7e0-01d2-4cc7-9dd6-cea3a094fd82 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:00.957565 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-339cd7e0-01d2-4cc7-9dd6-cea3a094fd82 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: edc8a6ac-f4f5-496f-867e-27b1ed15c833] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:00.965248 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-339cd7e0-01d2-4cc7-9dd6-cea3a094fd82 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:00.968096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-339cd7e0-01d2-4cc7-9dd6-cea3a094fd82 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:00.968730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-339cd7e0-01d2-4cc7-9dd6-cea3a094fd82 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:00.969643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-339cd7e0-01d2-4cc7-9dd6-cea3a094fd82 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:00.970304 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-339cd7e0-01d2-4cc7-9dd6-cea3a094fd82 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:00.970881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-339cd7e0-01d2-4cc7-9dd6-cea3a094fd82 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:01.056074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-339cd7e0-01d2-4cc7-9dd6-cea3a094fd82 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:01.065939 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-339cd7e0-01d2-4cc7-9dd6-cea3a094fd82 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833" status: 200 len: 1267 microversion: 2.1 time: 0.121159 Aug 04 17:14:01.066776 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2291/4508] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:00 2022] GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833 => generated 1267 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:14:01.131818 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-54ba13a6-ce5e-4178-b8cf-c46715eae4d0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:01.142101 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-54ba13a6-ce5e-4178-b8cf-c46715eae4d0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1539 microversion: 2.1 time: 0.293094 Aug 04 17:14:01.147284 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2218/4509] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:00 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1539 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:01.414045 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4aa192a3-b4a9-4d65-b9a0-bf27911423d5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:01.416605 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4aa192a3-b4a9-4d65-b9a0-bf27911423d5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:01.427132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4aa192a3-b4a9-4d65-b9a0-bf27911423d5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:01.427632 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4aa192a3-b4a9-4d65-b9a0-bf27911423d5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:01.428062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4aa192a3-b4a9-4d65-b9a0-bf27911423d5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:01.428796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4aa192a3-b4a9-4d65-b9a0-bf27911423d5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:01.429275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4aa192a3-b4a9-4d65-b9a0-bf27911423d5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:01.429687 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4aa192a3-b4a9-4d65-b9a0-bf27911423d5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:01.457234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d53a805c-e0e1-4504-93b1-9f4ef8e09a87 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:01.457927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d53a805c-e0e1-4504-93b1-9f4ef8e09a87 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:01.461318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:01.470039 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d53a805c-e0e1-4504-93b1-9f4ef8e09a87 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:01.472635 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d53a805c-e0e1-4504-93b1-9f4ef8e09a87 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:01.473097 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d53a805c-e0e1-4504-93b1-9f4ef8e09a87 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:01.476824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d53a805c-e0e1-4504-93b1-9f4ef8e09a87 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:01.477484 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d53a805c-e0e1-4504-93b1-9f4ef8e09a87 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:01.477940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d53a805c-e0e1-4504-93b1-9f4ef8e09a87 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:01.752379 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4aa192a3-b4a9-4d65-b9a0-bf27911423d5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:01.765791 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4aa192a3-b4a9-4d65-b9a0-bf27911423d5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:01.770080 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4aa192a3-b4a9-4d65-b9a0-bf27911423d5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:01.771528 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4aa192a3-b4a9-4d65-b9a0-bf27911423d5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1753 microversion: 2.20 time: 0.362889 Aug 04 17:14:01.774767 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2292/4510] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:01 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1753 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:14:01.809858 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d53a805c-e0e1-4504-93b1-9f4ef8e09a87 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:01.819767 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d53a805c-e0e1-4504-93b1-9f4ef8e09a87 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1513 microversion: 2.1 time: 0.367180 Aug 04 17:14:01.821057 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2219/4511] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:01 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1513 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:02.091763 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-78da54d2-669e-4c13-81e3-d9f7931c24c8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:02.093225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-78da54d2-669e-4c13-81e3-d9f7931c24c8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: edc8a6ac-f4f5-496f-867e-27b1ed15c833] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:02.101273 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78da54d2-669e-4c13-81e3-d9f7931c24c8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:02.101917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78da54d2-669e-4c13-81e3-d9f7931c24c8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:02.102604 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78da54d2-669e-4c13-81e3-d9f7931c24c8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:02.103352 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78da54d2-669e-4c13-81e3-d9f7931c24c8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:02.103981 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78da54d2-669e-4c13-81e3-d9f7931c24c8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:02.104423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78da54d2-669e-4c13-81e3-d9f7931c24c8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:02.169115 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0b7c841e-4bd6-4f16-b40f-39752396060c tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:02.169694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0b7c841e-4bd6-4f16-b40f-39752396060c tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:02.178755 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b7c841e-4bd6-4f16-b40f-39752396060c tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:02.179533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b7c841e-4bd6-4f16-b40f-39752396060c tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:02.180380 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b7c841e-4bd6-4f16-b40f-39752396060c tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:02.181769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b7c841e-4bd6-4f16-b40f-39752396060c tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:02.182775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b7c841e-4bd6-4f16-b40f-39752396060c tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:02.183431 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b7c841e-4bd6-4f16-b40f-39752396060c tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:02.313522 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-78da54d2-669e-4c13-81e3-d9f7931c24c8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:02.340710 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-78da54d2-669e-4c13-81e3-d9f7931c24c8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833" status: 200 len: 1309 microversion: 2.1 time: 0.240548 Aug 04 17:14:02.346327 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2293/4512] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:02 2022] GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833 => generated 1309 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:02.400130 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0b7c841e-4bd6-4f16-b40f-39752396060c tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:02.409233 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-041421fc-b50d-4c61-b592-ee889a6dcfb3 req-bc88c55b-d65d-4a7f-a031-dac5a939a289 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edc8a6ac-f4f5-496f-867e-27b1ed15c833", "tag": "fef85cf0-8d56-4436-817e-3bc44fd6688a"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:02.417673 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0b7c841e-4bd6-4f16-b40f-39752396060c tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1521 microversion: 2.1 time: 0.253118 Aug 04 17:14:02.421241 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2220/4513] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:02 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:02.437145 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-041421fc-b50d-4c61-b592-ee889a6dcfb3 req-bc88c55b-d65d-4a7f-a031-dac5a939a289 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:02.437682 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-041421fc-b50d-4c61-b592-ee889a6dcfb3 req-bc88c55b-d65d-4a7f-a031-dac5a939a289 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:02.438108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-041421fc-b50d-4c61-b592-ee889a6dcfb3 req-bc88c55b-d65d-4a7f-a031-dac5a939a289 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:02.444531 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8aecbb81-d6b1-4f3e-86b2-a5f9d1be0ab0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:02.445037 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8aecbb81-d6b1-4f3e-86b2-a5f9d1be0ab0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:02.451585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8aecbb81-d6b1-4f3e-86b2-a5f9d1be0ab0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:02.452804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8aecbb81-d6b1-4f3e-86b2-a5f9d1be0ab0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:02.453564 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8aecbb81-d6b1-4f3e-86b2-a5f9d1be0ab0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:02.454465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8aecbb81-d6b1-4f3e-86b2-a5f9d1be0ab0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:02.455375 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8aecbb81-d6b1-4f3e-86b2-a5f9d1be0ab0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:02.455473 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-041421fc-b50d-4c61-b592-ee889a6dcfb3 req-bc88c55b-d65d-4a7f-a031-dac5a939a289 service nova] Creating event network-changed:fef85cf0-8d56-4436-817e-3bc44fd6688a for instance edc8a6ac-f4f5-496f-867e-27b1ed15c833 on n-h2-851359-3 Aug 04 17:14:02.456134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8aecbb81-d6b1-4f3e-86b2-a5f9d1be0ab0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:02.462126 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-041421fc-b50d-4c61-b592-ee889a6dcfb3 req-bc88c55b-d65d-4a7f-a031-dac5a939a289 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055528 Aug 04 17:14:02.462721 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2294/4514] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:14:02.483971 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8aecbb81-d6b1-4f3e-86b2-a5f9d1be0ab0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:14:02.614644 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8aecbb81-d6b1-4f3e-86b2-a5f9d1be0ab0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "DELETE /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 204 len: 0 microversion: 2.1 time: 0.173486 Aug 04 17:14:02.619999 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2221/4515] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:14:02 2022] DELETE /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:14:02.628561 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7b9d06e0-41b6-4298-821b-2e3b0ba55452 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:02.629552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7b9d06e0-41b6-4298-821b-2e3b0ba55452 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:02.645512 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b9d06e0-41b6-4298-821b-2e3b0ba55452 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:02.646063 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b9d06e0-41b6-4298-821b-2e3b0ba55452 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:02.646511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b9d06e0-41b6-4298-821b-2e3b0ba55452 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:02.647213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b9d06e0-41b6-4298-821b-2e3b0ba55452 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:02.648816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b9d06e0-41b6-4298-821b-2e3b0ba55452 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:02.653505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b9d06e0-41b6-4298-821b-2e3b0ba55452 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:02.798456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a9e4cdf1-65e7-404f-9a76-28618f4fb24b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:02.799317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a9e4cdf1-65e7-404f-9a76-28618f4fb24b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:02.806477 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9e4cdf1-65e7-404f-9a76-28618f4fb24b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:02.807080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9e4cdf1-65e7-404f-9a76-28618f4fb24b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:02.807624 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9e4cdf1-65e7-404f-9a76-28618f4fb24b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:02.808429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9e4cdf1-65e7-404f-9a76-28618f4fb24b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:02.808973 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9e4cdf1-65e7-404f-9a76-28618f4fb24b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:02.809498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9e4cdf1-65e7-404f-9a76-28618f4fb24b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:02.843424 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7b9d06e0-41b6-4298-821b-2e3b0ba55452 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:02.853582 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7b9d06e0-41b6-4298-821b-2e3b0ba55452 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1527 microversion: 2.1 time: 0.230122 Aug 04 17:14:02.854435 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2295/4516] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:02 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1527 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:02.860452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4d226e72-29cc-443f-8439-5fd279ed58fb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:02.861057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4d226e72-29cc-443f-8439-5fd279ed58fb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:02.864373 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:02.868310 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d226e72-29cc-443f-8439-5fd279ed58fb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:02.868812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d226e72-29cc-443f-8439-5fd279ed58fb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:02.869252 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d226e72-29cc-443f-8439-5fd279ed58fb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:02.877565 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d226e72-29cc-443f-8439-5fd279ed58fb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:02.878108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d226e72-29cc-443f-8439-5fd279ed58fb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:02.878589 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d226e72-29cc-443f-8439-5fd279ed58fb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:03.032718 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a9e4cdf1-65e7-404f-9a76-28618f4fb24b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:03.045612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a9e4cdf1-65e7-404f-9a76-28618f4fb24b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:03.047911 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a9e4cdf1-65e7-404f-9a76-28618f4fb24b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:03.049417 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a9e4cdf1-65e7-404f-9a76-28618f4fb24b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1753 microversion: 2.20 time: 0.255590 Aug 04 17:14:03.050632 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2222/4517] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:02 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1753 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:14:03.072823 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4d226e72-29cc-443f-8439-5fd279ed58fb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:03.081243 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4d226e72-29cc-443f-8439-5fd279ed58fb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1513 microversion: 2.1 time: 0.225676 Aug 04 17:14:03.082093 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2296/4518] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:02 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1513 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:03.361626 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-83cc62e2-a784-455a-821a-556b0789d75e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:03.362580 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-83cc62e2-a784-455a-821a-556b0789d75e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: edc8a6ac-f4f5-496f-867e-27b1ed15c833] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:03.369471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83cc62e2-a784-455a-821a-556b0789d75e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:03.370104 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83cc62e2-a784-455a-821a-556b0789d75e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:03.370645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83cc62e2-a784-455a-821a-556b0789d75e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:03.371442 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83cc62e2-a784-455a-821a-556b0789d75e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:03.372004 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83cc62e2-a784-455a-821a-556b0789d75e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:03.372655 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83cc62e2-a784-455a-821a-556b0789d75e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:03.513766 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-83cc62e2-a784-455a-821a-556b0789d75e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:03.521947 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-83cc62e2-a784-455a-821a-556b0789d75e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833" status: 200 len: 1309 microversion: 2.1 time: 0.165031 Aug 04 17:14:03.522823 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2223/4519] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:03 2022] GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833 => generated 1309 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:03.794734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-c1dfcddd-27c4-4b21-8d35-1496bdb9115b req-59dacf2a-f957-439c-8b51-a078a540a72d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9567ac7-9ee0-4ae3-b7c7-6033039de89d", "name": "network-vif-plugged", "status": "completed", "tag": "aca16109-3001-402b-99ec-6923c19c2dfc"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:03.811076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c1dfcddd-27c4-4b21-8d35-1496bdb9115b req-59dacf2a-f957-439c-8b51-a078a540a72d service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:03.811743 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c1dfcddd-27c4-4b21-8d35-1496bdb9115b req-59dacf2a-f957-439c-8b51-a078a540a72d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:03.812366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c1dfcddd-27c4-4b21-8d35-1496bdb9115b req-59dacf2a-f957-439c-8b51-a078a540a72d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:03.826072 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-c1dfcddd-27c4-4b21-8d35-1496bdb9115b req-59dacf2a-f957-439c-8b51-a078a540a72d service nova] Creating event network-vif-plugged:aca16109-3001-402b-99ec-6923c19c2dfc for instance a9567ac7-9ee0-4ae3-b7c7-6033039de89d on n-h2-851359-3 Aug 04 17:14:03.832081 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-c1dfcddd-27c4-4b21-8d35-1496bdb9115b req-59dacf2a-f957-439c-8b51-a078a540a72d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043283 Aug 04 17:14:03.834447 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2297/4520] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:14:03.885095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0fc09068-7083-4b3e-9726-0ee6109d25b7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:03.885730 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0fc09068-7083-4b3e-9726-0ee6109d25b7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:03.902149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fc09068-7083-4b3e-9726-0ee6109d25b7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:03.902843 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fc09068-7083-4b3e-9726-0ee6109d25b7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:03.903300 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fc09068-7083-4b3e-9726-0ee6109d25b7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:03.904032 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fc09068-7083-4b3e-9726-0ee6109d25b7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:03.904499 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fc09068-7083-4b3e-9726-0ee6109d25b7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:03.905637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fc09068-7083-4b3e-9726-0ee6109d25b7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:04.072433 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0fc09068-7083-4b3e-9726-0ee6109d25b7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:04.074545 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e97337cd-0843-4f89-a94d-c8459a26a8a2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:04.075297 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e97337cd-0843-4f89-a94d-c8459a26a8a2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:04.082255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e97337cd-0843-4f89-a94d-c8459a26a8a2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:04.083222 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e97337cd-0843-4f89-a94d-c8459a26a8a2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:04.083852 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e97337cd-0843-4f89-a94d-c8459a26a8a2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:04.084767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e97337cd-0843-4f89-a94d-c8459a26a8a2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:04.085408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e97337cd-0843-4f89-a94d-c8459a26a8a2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:04.085563 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0fc09068-7083-4b3e-9726-0ee6109d25b7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1527 microversion: 2.1 time: 0.209723 Aug 04 17:14:04.086193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e97337cd-0843-4f89-a94d-c8459a26a8a2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:04.086696 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2224/4521] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:03 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1527 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:04.114114 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2171fdef-e136-448c-b42c-e9f9ad1edb30 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:04.114863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2171fdef-e136-448c-b42c-e9f9ad1edb30 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:04.130454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2171fdef-e136-448c-b42c-e9f9ad1edb30 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:04.131047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2171fdef-e136-448c-b42c-e9f9ad1edb30 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:04.131611 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2171fdef-e136-448c-b42c-e9f9ad1edb30 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:04.132461 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2171fdef-e136-448c-b42c-e9f9ad1edb30 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:04.133152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2171fdef-e136-448c-b42c-e9f9ad1edb30 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:04.134232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2171fdef-e136-448c-b42c-e9f9ad1edb30 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:04.308602 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e97337cd-0843-4f89-a94d-c8459a26a8a2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:04.319513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e97337cd-0843-4f89-a94d-c8459a26a8a2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:04.321215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e97337cd-0843-4f89-a94d-c8459a26a8a2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:04.322500 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e97337cd-0843-4f89-a94d-c8459a26a8a2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1753 microversion: 2.20 time: 0.252509 Aug 04 17:14:04.335155 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2171fdef-e136-448c-b42c-e9f9ad1edb30 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:04.335363 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2298/4522] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:04 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1753 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:14:04.343656 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2171fdef-e136-448c-b42c-e9f9ad1edb30 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1513 microversion: 2.1 time: 0.235278 Aug 04 17:14:04.344234 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2225/4523] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:04 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1513 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:14:04.543502 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c96516d1-a074-4802-87fc-8a131ee2e5db tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:04.544622 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c96516d1-a074-4802-87fc-8a131ee2e5db tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: edc8a6ac-f4f5-496f-867e-27b1ed15c833] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:04.551458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c96516d1-a074-4802-87fc-8a131ee2e5db tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:04.552032 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c96516d1-a074-4802-87fc-8a131ee2e5db tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:04.552897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c96516d1-a074-4802-87fc-8a131ee2e5db tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:04.553673 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c96516d1-a074-4802-87fc-8a131ee2e5db tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:04.554258 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c96516d1-a074-4802-87fc-8a131ee2e5db tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:04.554758 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c96516d1-a074-4802-87fc-8a131ee2e5db tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:04.725047 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c96516d1-a074-4802-87fc-8a131ee2e5db tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:04.736126 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c96516d1-a074-4802-87fc-8a131ee2e5db tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833" status: 200 len: 1309 microversion: 2.1 time: 0.196779 Aug 04 17:14:04.736864 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2299/4524] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:04 2022] GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833 => generated 1309 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:05.113506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8710da94-c280-4924-ad36-089cc0633c76 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:05.114152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8710da94-c280-4924-ad36-089cc0633c76 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:05.123960 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8710da94-c280-4924-ad36-089cc0633c76 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:05.124451 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8710da94-c280-4924-ad36-089cc0633c76 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:05.124886 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8710da94-c280-4924-ad36-089cc0633c76 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:05.125588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8710da94-c280-4924-ad36-089cc0633c76 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:05.126069 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8710da94-c280-4924-ad36-089cc0633c76 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:05.126496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8710da94-c280-4924-ad36-089cc0633c76 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:05.264215 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8710da94-c280-4924-ad36-089cc0633c76 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:05.273582 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8710da94-c280-4924-ad36-089cc0633c76 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1527 microversion: 2.1 time: 0.163751 Aug 04 17:14:05.274473 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2226/4525] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:05 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1527 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:05.347729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8c9bb41c-be73-4419-9e3b-5a57e3aaab0d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:05.348341 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8c9bb41c-be73-4419-9e3b-5a57e3aaab0d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:05.355232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c9bb41c-be73-4419-9e3b-5a57e3aaab0d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:05.355785 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c9bb41c-be73-4419-9e3b-5a57e3aaab0d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:05.356224 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c9bb41c-be73-4419-9e3b-5a57e3aaab0d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:05.357121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c9bb41c-be73-4419-9e3b-5a57e3aaab0d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:05.357589 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c9bb41c-be73-4419-9e3b-5a57e3aaab0d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:05.358762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c9bb41c-be73-4419-9e3b-5a57e3aaab0d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:05.364710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0b00e20a-d6a7-454c-94ef-c8973f95fcf2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:05.365546 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0b00e20a-d6a7-454c-94ef-c8973f95fcf2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:05.375727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b00e20a-d6a7-454c-94ef-c8973f95fcf2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:05.376247 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b00e20a-d6a7-454c-94ef-c8973f95fcf2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:05.376692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b00e20a-d6a7-454c-94ef-c8973f95fcf2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:05.377410 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b00e20a-d6a7-454c-94ef-c8973f95fcf2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:05.377867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b00e20a-d6a7-454c-94ef-c8973f95fcf2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:05.378329 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b00e20a-d6a7-454c-94ef-c8973f95fcf2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:05.587132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8c9bb41c-be73-4419-9e3b-5a57e3aaab0d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:05.603511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8c9bb41c-be73-4419-9e3b-5a57e3aaab0d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:05.605515 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8c9bb41c-be73-4419-9e3b-5a57e3aaab0d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:05.607075 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8c9bb41c-be73-4419-9e3b-5a57e3aaab0d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1753 microversion: 2.20 time: 0.263165 Aug 04 17:14:05.608063 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2300/4526] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:05 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1753 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:14:05.642672 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0b00e20a-d6a7-454c-94ef-c8973f95fcf2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:05.652020 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0b00e20a-d6a7-454c-94ef-c8973f95fcf2 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1513 microversion: 2.1 time: 0.291041 Aug 04 17:14:05.653362 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2227/4527] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:05 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1513 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:14:05.762647 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4c7a669a-1b4c-46be-bbbc-b8c04e408a43 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:05.765248 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4c7a669a-1b4c-46be-bbbc-b8c04e408a43 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: edc8a6ac-f4f5-496f-867e-27b1ed15c833] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:05.779688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c7a669a-1b4c-46be-bbbc-b8c04e408a43 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:05.780860 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c7a669a-1b4c-46be-bbbc-b8c04e408a43 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:05.781408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c7a669a-1b4c-46be-bbbc-b8c04e408a43 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:05.782388 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c7a669a-1b4c-46be-bbbc-b8c04e408a43 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:05.783056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c7a669a-1b4c-46be-bbbc-b8c04e408a43 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:05.783570 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c7a669a-1b4c-46be-bbbc-b8c04e408a43 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:05.864824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-d7d98c63-6095-4101-bb45-4a14fd28e781 req-f56b2ea5-9c77-4aca-beda-94aaf4af23ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a741b004-2f32-419c-aada-de12ed0cd36e", "name": "network-vif-unplugged", "status": "completed", "tag": "4ce7718f-85dc-4011-b3ce-a182614aceb6"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:05.882812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d7d98c63-6095-4101-bb45-4a14fd28e781 req-f56b2ea5-9c77-4aca-beda-94aaf4af23ca service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:05.883497 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d7d98c63-6095-4101-bb45-4a14fd28e781 req-f56b2ea5-9c77-4aca-beda-94aaf4af23ca service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:05.883944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d7d98c63-6095-4101-bb45-4a14fd28e781 req-f56b2ea5-9c77-4aca-beda-94aaf4af23ca service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:05.897790 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-d7d98c63-6095-4101-bb45-4a14fd28e781 req-f56b2ea5-9c77-4aca-beda-94aaf4af23ca service nova] Creating event network-vif-unplugged:4ce7718f-85dc-4011-b3ce-a182614aceb6 for instance a741b004-2f32-419c-aada-de12ed0cd36e on n-h2-851359-3 Aug 04 17:14:05.903111 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-d7d98c63-6095-4101-bb45-4a14fd28e781 req-f56b2ea5-9c77-4aca-beda-94aaf4af23ca service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044756 Aug 04 17:14:05.907874 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2228/4528] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:14:05.952613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4c7a669a-1b4c-46be-bbbc-b8c04e408a43 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:05.960348 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4c7a669a-1b4c-46be-bbbc-b8c04e408a43 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833" status: 200 len: 1309 microversion: 2.1 time: 0.207436 Aug 04 17:14:05.960995 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2301/4529] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:05 2022] GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833 => generated 1309 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:06.298800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-71c71a2a-5176-46e4-9500-54c344f6ed69 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:06.300242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-71c71a2a-5176-46e4-9500-54c344f6ed69 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:06.306433 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71c71a2a-5176-46e4-9500-54c344f6ed69 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:06.306930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71c71a2a-5176-46e4-9500-54c344f6ed69 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:06.307372 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71c71a2a-5176-46e4-9500-54c344f6ed69 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:06.308084 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71c71a2a-5176-46e4-9500-54c344f6ed69 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:06.308707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71c71a2a-5176-46e4-9500-54c344f6ed69 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:06.308970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71c71a2a-5176-46e4-9500-54c344f6ed69 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:06.505200 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-71c71a2a-5176-46e4-9500-54c344f6ed69 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:06.512646 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-71c71a2a-5176-46e4-9500-54c344f6ed69 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1527 microversion: 2.1 time: 0.220435 Aug 04 17:14:06.513222 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2229/4530] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:06 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1527 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:06.630107 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2b49b126-a0fd-43ff-bd5c-dc32fc6cc7aa tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:06.630740 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2b49b126-a0fd-43ff-bd5c-dc32fc6cc7aa tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:06.637791 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b49b126-a0fd-43ff-bd5c-dc32fc6cc7aa tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:06.638326 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b49b126-a0fd-43ff-bd5c-dc32fc6cc7aa tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:06.638770 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b49b126-a0fd-43ff-bd5c-dc32fc6cc7aa tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:06.640063 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b49b126-a0fd-43ff-bd5c-dc32fc6cc7aa tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:06.640530 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b49b126-a0fd-43ff-bd5c-dc32fc6cc7aa tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:06.640979 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b49b126-a0fd-43ff-bd5c-dc32fc6cc7aa tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:06.675559 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c788c44a-f3f7-4166-9c40-f372cf12b571 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:06.676812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c788c44a-f3f7-4166-9c40-f372cf12b571 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:06.683130 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c788c44a-f3f7-4166-9c40-f372cf12b571 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:06.683769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c788c44a-f3f7-4166-9c40-f372cf12b571 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:06.684337 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c788c44a-f3f7-4166-9c40-f372cf12b571 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:06.685445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c788c44a-f3f7-4166-9c40-f372cf12b571 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:06.687300 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c788c44a-f3f7-4166-9c40-f372cf12b571 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:06.687950 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c788c44a-f3f7-4166-9c40-f372cf12b571 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:07.118765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2b49b126-a0fd-43ff-bd5c-dc32fc6cc7aa tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:07.122070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c788c44a-f3f7-4166-9c40-f372cf12b571 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:07.131615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2b49b126-a0fd-43ff-bd5c-dc32fc6cc7aa tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:07.133487 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c788c44a-f3f7-4166-9c40-f372cf12b571 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1513 microversion: 2.1 time: 0.462290 Aug 04 17:14:07.133643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2b49b126-a0fd-43ff-bd5c-dc32fc6cc7aa tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:07.140694 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2230/4531] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:06 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1513 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:14:07.140945 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2b49b126-a0fd-43ff-bd5c-dc32fc6cc7aa tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1753 microversion: 2.20 time: 0.508596 Aug 04 17:14:07.140945 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2302/4532] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:06 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1753 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:14:07.151386 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5d48b6ed-9312-49d5-bbcc-08ce185b72dc tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:07.152117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5d48b6ed-9312-49d5-bbcc-08ce185b72dc tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: edc8a6ac-f4f5-496f-867e-27b1ed15c833] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:07.158274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d48b6ed-9312-49d5-bbcc-08ce185b72dc tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:07.158813 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d48b6ed-9312-49d5-bbcc-08ce185b72dc tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:07.159253 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d48b6ed-9312-49d5-bbcc-08ce185b72dc tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:07.159954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d48b6ed-9312-49d5-bbcc-08ce185b72dc tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:07.160414 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d48b6ed-9312-49d5-bbcc-08ce185b72dc tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:07.160844 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d48b6ed-9312-49d5-bbcc-08ce185b72dc tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:07.316763 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5d48b6ed-9312-49d5-bbcc-08ce185b72dc tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:07.324324 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5d48b6ed-9312-49d5-bbcc-08ce185b72dc tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833" status: 200 len: 1309 microversion: 2.1 time: 0.189043 Aug 04 17:14:07.324979 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2231/4533] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:07 2022] GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833 => generated 1309 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:07.535269 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4d9bdbde-559d-4f6a-81df-7d5110fae481 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:07.535927 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4d9bdbde-559d-4f6a-81df-7d5110fae481 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:07.541923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d9bdbde-559d-4f6a-81df-7d5110fae481 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:07.542448 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d9bdbde-559d-4f6a-81df-7d5110fae481 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:07.542892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d9bdbde-559d-4f6a-81df-7d5110fae481 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:07.543593 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d9bdbde-559d-4f6a-81df-7d5110fae481 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:07.544056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d9bdbde-559d-4f6a-81df-7d5110fae481 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:07.544488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d9bdbde-559d-4f6a-81df-7d5110fae481 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:07.566293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:07.630773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-63fdbb51-0231-417d-ba0b-9f254cbdcc96 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:07.631334 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-63fdbb51-0231-417d-ba0b-9f254cbdcc96 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:07.638302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63fdbb51-0231-417d-ba0b-9f254cbdcc96 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:07.638893 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63fdbb51-0231-417d-ba0b-9f254cbdcc96 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:07.639456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63fdbb51-0231-417d-ba0b-9f254cbdcc96 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:07.640235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63fdbb51-0231-417d-ba0b-9f254cbdcc96 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:07.640770 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63fdbb51-0231-417d-ba0b-9f254cbdcc96 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:07.641207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63fdbb51-0231-417d-ba0b-9f254cbdcc96 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:07.704001 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4d9bdbde-559d-4f6a-81df-7d5110fae481 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:07.712208 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4d9bdbde-559d-4f6a-81df-7d5110fae481 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1527 microversion: 2.1 time: 0.181011 Aug 04 17:14:07.712825 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2303/4534] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:07 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1527 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:07.732058 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-63fdbb51-0231-417d-ba0b-9f254cbdcc96 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lazy-loading 'services' on Instance uuid 0c74445a-b3fe-4d2a-9dd3-43ab834d369a {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:14:07.806175 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-63fdbb51-0231-417d-ba0b-9f254cbdcc96 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a/os-volume_attachments/d4e5d209-60b8-4886-9ec6-6d54cdab2464" status: 202 len: 0 microversion: 2.1 time: 0.180735 Aug 04 17:14:07.816025 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e7b14620-0c85-43d4-9371-f04f384a4de0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:07.818447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e7b14620-0c85-43d4-9371-f04f384a4de0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:07.821928 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2232/4535] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Aug 4 17:14:07 2022] DELETE /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a/os-volume_attachments/d4e5d209-60b8-4886-9ec6-6d54cdab2464 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 17:14:07.825770 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7b14620-0c85-43d4-9371-f04f384a4de0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:07.827095 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7b14620-0c85-43d4-9371-f04f384a4de0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:07.828102 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7b14620-0c85-43d4-9371-f04f384a4de0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:07.829077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7b14620-0c85-43d4-9371-f04f384a4de0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:07.829557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7b14620-0c85-43d4-9371-f04f384a4de0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:07.830646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7b14620-0c85-43d4-9371-f04f384a4de0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:07.870686 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e7b14620-0c85-43d4-9371-f04f384a4de0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059002 Aug 04 17:14:07.871265 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2304/4536] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:14:07 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:14:08.157242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6108153d-bf7f-45cd-96b6-f536ee3108a6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:08.157842 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-652844a0-f3c3-4ee0-aaf9-eeff3e380378 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:08.158614 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-652844a0-f3c3-4ee0-aaf9-eeff3e380378 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:08.160636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6108153d-bf7f-45cd-96b6-f536ee3108a6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:08.165804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-652844a0-f3c3-4ee0-aaf9-eeff3e380378 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:08.166489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-652844a0-f3c3-4ee0-aaf9-eeff3e380378 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:08.167103 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-652844a0-f3c3-4ee0-aaf9-eeff3e380378 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:08.168055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-652844a0-f3c3-4ee0-aaf9-eeff3e380378 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:08.168250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6108153d-bf7f-45cd-96b6-f536ee3108a6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:08.168657 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-652844a0-f3c3-4ee0-aaf9-eeff3e380378 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:08.168758 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6108153d-bf7f-45cd-96b6-f536ee3108a6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:08.169408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-652844a0-f3c3-4ee0-aaf9-eeff3e380378 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:08.169599 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6108153d-bf7f-45cd-96b6-f536ee3108a6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:08.170067 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6108153d-bf7f-45cd-96b6-f536ee3108a6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:08.170615 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6108153d-bf7f-45cd-96b6-f536ee3108a6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:08.171588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6108153d-bf7f-45cd-96b6-f536ee3108a6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:08.193461 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:08.383724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-652844a0-f3c3-4ee0-aaf9-eeff3e380378 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:08.394878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6108153d-bf7f-45cd-96b6-f536ee3108a6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:08.403524 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6108153d-bf7f-45cd-96b6-f536ee3108a6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1513 microversion: 2.1 time: 0.251275 Aug 04 17:14:08.404101 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2233/4537] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:08 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1513 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:14:08.408118 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-652844a0-f3c3-4ee0-aaf9-eeff3e380378 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:08.409630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-652844a0-f3c3-4ee0-aaf9-eeff3e380378 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:08.410899 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-652844a0-f3c3-4ee0-aaf9-eeff3e380378 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1753 microversion: 2.20 time: 0.258293 Aug 04 17:14:08.411449 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2305/4538] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:08 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1753 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:14:08.415276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3c416f68-4889-45eb-bcc9-4096a293152f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:08.415892 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3c416f68-4889-45eb-bcc9-4096a293152f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: edc8a6ac-f4f5-496f-867e-27b1ed15c833] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:08.423192 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c416f68-4889-45eb-bcc9-4096a293152f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:08.423926 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c416f68-4889-45eb-bcc9-4096a293152f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:08.424371 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c416f68-4889-45eb-bcc9-4096a293152f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:08.425075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c416f68-4889-45eb-bcc9-4096a293152f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:08.425543 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c416f68-4889-45eb-bcc9-4096a293152f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:08.425967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c416f68-4889-45eb-bcc9-4096a293152f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:08.580539 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3c416f68-4889-45eb-bcc9-4096a293152f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:08.588306 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3c416f68-4889-45eb-bcc9-4096a293152f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833" status: 200 len: 1309 microversion: 2.1 time: 0.182675 Aug 04 17:14:08.588904 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2234/4539] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:08 2022] GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833 => generated 1309 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:08.735064 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-518a80b9-a883-4749-9c46-01e74dbc0fec tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:08.735694 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-518a80b9-a883-4749-9c46-01e74dbc0fec tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:08.737752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:08.738625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:08.745312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-518a80b9-a883-4749-9c46-01e74dbc0fec tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:08.745816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-518a80b9-a883-4749-9c46-01e74dbc0fec tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:08.746304 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-518a80b9-a883-4749-9c46-01e74dbc0fec tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:08.747018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-518a80b9-a883-4749-9c46-01e74dbc0fec tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:08.747482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-518a80b9-a883-4749-9c46-01e74dbc0fec tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:08.747913 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-518a80b9-a883-4749-9c46-01e74dbc0fec tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:08.884055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-42d4ee9c-7c23-42a7-a0aa-28c2919da002 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:08.887560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-42d4ee9c-7c23-42a7-a0aa-28c2919da002 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:08.890057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:08.903083 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-42d4ee9c-7c23-42a7-a0aa-28c2919da002 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:08.903583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-42d4ee9c-7c23-42a7-a0aa-28c2919da002 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:08.904030 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-42d4ee9c-7c23-42a7-a0aa-28c2919da002 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:08.904277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-518a80b9-a883-4749-9c46-01e74dbc0fec tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:08.905710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-42d4ee9c-7c23-42a7-a0aa-28c2919da002 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:08.906574 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-42d4ee9c-7c23-42a7-a0aa-28c2919da002 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:08.907015 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-42d4ee9c-7c23-42a7-a0aa-28c2919da002 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:08.916627 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-518a80b9-a883-4749-9c46-01e74dbc0fec tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1527 microversion: 2.1 time: 0.185497 Aug 04 17:14:08.917821 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2306/4540] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:08 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1527 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:08.944157 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-42d4ee9c-7c23-42a7-a0aa-28c2919da002 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064555 Aug 04 17:14:08.945289 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2235/4541] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:14:08 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:14:09.425969 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8d4230bc-1693-47c7-8ac0-7713065c7dd8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:09.426614 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8d4230bc-1693-47c7-8ac0-7713065c7dd8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:09.435231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eff7e0aa-2bd7-465a-958f-9ace628bf939 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:09.437050 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eff7e0aa-2bd7-465a-958f-9ace628bf939 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:09.441306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d4230bc-1693-47c7-8ac0-7713065c7dd8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:09.441806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d4230bc-1693-47c7-8ac0-7713065c7dd8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:09.442276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d4230bc-1693-47c7-8ac0-7713065c7dd8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:09.443153 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d4230bc-1693-47c7-8ac0-7713065c7dd8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:09.443787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d4230bc-1693-47c7-8ac0-7713065c7dd8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:09.444367 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d4230bc-1693-47c7-8ac0-7713065c7dd8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:09.452435 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eff7e0aa-2bd7-465a-958f-9ace628bf939 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:09.453450 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eff7e0aa-2bd7-465a-958f-9ace628bf939 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:09.454349 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eff7e0aa-2bd7-465a-958f-9ace628bf939 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:09.455659 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eff7e0aa-2bd7-465a-958f-9ace628bf939 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:09.456131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eff7e0aa-2bd7-465a-958f-9ace628bf939 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:09.456752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eff7e0aa-2bd7-465a-958f-9ace628bf939 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:09.866538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eff7e0aa-2bd7-465a-958f-9ace628bf939 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:09.878319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eff7e0aa-2bd7-465a-958f-9ace628bf939 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:09.890031 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eff7e0aa-2bd7-465a-958f-9ace628bf939 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:09.891556 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eff7e0aa-2bd7-465a-958f-9ace628bf939 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1753 microversion: 2.20 time: 0.460691 Aug 04 17:14:09.892277 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2236/4542] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:09 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1753 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:14:09.896949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1aae2509-7b61-4c77-84ae-d10264afac1e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:09.897568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1aae2509-7b61-4c77-84ae-d10264afac1e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: edc8a6ac-f4f5-496f-867e-27b1ed15c833] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:09.913280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1aae2509-7b61-4c77-84ae-d10264afac1e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:09.913802 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1aae2509-7b61-4c77-84ae-d10264afac1e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:09.917231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1aae2509-7b61-4c77-84ae-d10264afac1e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:09.918250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1aae2509-7b61-4c77-84ae-d10264afac1e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:09.918250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1aae2509-7b61-4c77-84ae-d10264afac1e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:09.920184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1aae2509-7b61-4c77-84ae-d10264afac1e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:09.929537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8d4230bc-1693-47c7-8ac0-7713065c7dd8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:09.940578 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8d4230bc-1693-47c7-8ac0-7713065c7dd8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1513 microversion: 2.1 time: 0.518368 Aug 04 17:14:09.943000 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2307/4543] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:09 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1513 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:09.947670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b2b3f512-0943-4687-8e15-c3c186c96dc0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:09.948294 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b2b3f512-0943-4687-8e15-c3c186c96dc0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:09.963214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2b3f512-0943-4687-8e15-c3c186c96dc0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:09.963726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2b3f512-0943-4687-8e15-c3c186c96dc0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:09.964173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2b3f512-0943-4687-8e15-c3c186c96dc0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:09.964893 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2b3f512-0943-4687-8e15-c3c186c96dc0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:09.965357 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2b3f512-0943-4687-8e15-c3c186c96dc0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:09.965791 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2b3f512-0943-4687-8e15-c3c186c96dc0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:10.291775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1aae2509-7b61-4c77-84ae-d10264afac1e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:10.304783 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1aae2509-7b61-4c77-84ae-d10264afac1e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833" status: 200 len: 1309 microversion: 2.1 time: 0.410774 Aug 04 17:14:10.305641 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2237/4544] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:09 2022] GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833 => generated 1309 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:10.311940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3ee0a292-0665-464c-a2fa-befaf250b1f8 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:10.314715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3ee0a292-0665-464c-a2fa-befaf250b1f8 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:10.322058 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ee0a292-0665-464c-a2fa-befaf250b1f8 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:10.322926 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ee0a292-0665-464c-a2fa-befaf250b1f8 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:10.323462 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ee0a292-0665-464c-a2fa-befaf250b1f8 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:10.324364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ee0a292-0665-464c-a2fa-befaf250b1f8 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:10.324913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ee0a292-0665-464c-a2fa-befaf250b1f8 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:10.329238 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ee0a292-0665-464c-a2fa-befaf250b1f8 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:10.343135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b2b3f512-0943-4687-8e15-c3c186c96dc0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:10.357466 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b2b3f512-0943-4687-8e15-c3c186c96dc0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1527 microversion: 2.1 time: 0.409881 Aug 04 17:14:10.359537 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2308/4545] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:09 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1527 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:10.383169 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3ee0a292-0665-464c-a2fa-befaf250b1f8 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075844 Aug 04 17:14:10.384937 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2238/4546] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:14:10 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:14:10.689212 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-e51eebb3-3207-40c8-96e0-72f4069fd384 req-27df1dc5-7335-496e-88ed-3286714229f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a741b004-2f32-419c-aada-de12ed0cd36e", "name": "network-vif-deleted", "tag": "4ce7718f-85dc-4011-b3ce-a182614aceb6"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:10.707681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e51eebb3-3207-40c8-96e0-72f4069fd384 req-27df1dc5-7335-496e-88ed-3286714229f9 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:10.708176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e51eebb3-3207-40c8-96e0-72f4069fd384 req-27df1dc5-7335-496e-88ed-3286714229f9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:10.708617 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e51eebb3-3207-40c8-96e0-72f4069fd384 req-27df1dc5-7335-496e-88ed-3286714229f9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:10.742537 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-e51eebb3-3207-40c8-96e0-72f4069fd384 req-27df1dc5-7335-496e-88ed-3286714229f9 service nova] Creating event network-vif-deleted:4ce7718f-85dc-4011-b3ce-a182614aceb6 for instance a741b004-2f32-419c-aada-de12ed0cd36e on n-h2-851359-3 Aug 04 17:14:10.753470 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-e51eebb3-3207-40c8-96e0-72f4069fd384 req-27df1dc5-7335-496e-88ed-3286714229f9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068149 Aug 04 17:14:10.754785 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2309/4547] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:14:10.925445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a145fa43-691b-4c30-a98b-a4ef49a9a234 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:10.928238 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a145fa43-691b-4c30-a98b-a4ef49a9a234 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:10.939030 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a145fa43-691b-4c30-a98b-a4ef49a9a234 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:10.939859 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a145fa43-691b-4c30-a98b-a4ef49a9a234 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:10.940616 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a145fa43-691b-4c30-a98b-a4ef49a9a234 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:10.941530 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a145fa43-691b-4c30-a98b-a4ef49a9a234 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:10.942437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a145fa43-691b-4c30-a98b-a4ef49a9a234 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:10.943064 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a145fa43-691b-4c30-a98b-a4ef49a9a234 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:10.966326 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f27d2cc4-3844-4d96-adbd-f277327dba5b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:10.968792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f27d2cc4-3844-4d96-adbd-f277327dba5b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:10.984039 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f27d2cc4-3844-4d96-adbd-f277327dba5b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:10.984881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f27d2cc4-3844-4d96-adbd-f277327dba5b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:10.986446 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f27d2cc4-3844-4d96-adbd-f277327dba5b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:10.990739 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f27d2cc4-3844-4d96-adbd-f277327dba5b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:10.991466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f27d2cc4-3844-4d96-adbd-f277327dba5b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:10.992543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f27d2cc4-3844-4d96-adbd-f277327dba5b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:11.228707 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f27d2cc4-3844-4d96-adbd-f277327dba5b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:11.231906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a145fa43-691b-4c30-a98b-a4ef49a9a234 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:11.241109 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f27d2cc4-3844-4d96-adbd-f277327dba5b tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1508 microversion: 2.1 time: 0.279942 Aug 04 17:14:11.243003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a145fa43-691b-4c30-a98b-a4ef49a9a234 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:11.245395 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2310/4548] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:10 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1508 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:14:11.261543 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a145fa43-691b-4c30-a98b-a4ef49a9a234 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:11.265821 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a145fa43-691b-4c30-a98b-a4ef49a9a234 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1809 microversion: 2.20 time: 0.350505 Aug 04 17:14:11.266438 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2239/4549] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:10 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1809 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:14:11.333783 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2b688810-9acf-4467-82ca-69b4715f5dad tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:11.338151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2b688810-9acf-4467-82ca-69b4715f5dad tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: edc8a6ac-f4f5-496f-867e-27b1ed15c833] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:11.350055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b688810-9acf-4467-82ca-69b4715f5dad tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:11.351363 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b688810-9acf-4467-82ca-69b4715f5dad tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:11.352317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b688810-9acf-4467-82ca-69b4715f5dad tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:11.355047 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b688810-9acf-4467-82ca-69b4715f5dad tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:11.356031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b688810-9acf-4467-82ca-69b4715f5dad tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:11.357384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b688810-9acf-4467-82ca-69b4715f5dad tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:11.388256 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-720635a9-c7cf-4af6-b2ef-b6323c5b3fb7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:11.391292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-720635a9-c7cf-4af6-b2ef-b6323c5b3fb7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:11.402274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-720635a9-c7cf-4af6-b2ef-b6323c5b3fb7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:11.414466 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-720635a9-c7cf-4af6-b2ef-b6323c5b3fb7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:11.416026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-720635a9-c7cf-4af6-b2ef-b6323c5b3fb7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:11.416634 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-720635a9-c7cf-4af6-b2ef-b6323c5b3fb7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:11.417294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-720635a9-c7cf-4af6-b2ef-b6323c5b3fb7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:11.417771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-720635a9-c7cf-4af6-b2ef-b6323c5b3fb7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:11.512117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-720635a9-c7cf-4af6-b2ef-b6323c5b3fb7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:11.512915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-720635a9-c7cf-4af6-b2ef-b6323c5b3fb7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:11.513587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-720635a9-c7cf-4af6-b2ef-b6323c5b3fb7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:11.514306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-720635a9-c7cf-4af6-b2ef-b6323c5b3fb7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lazy-loading 'fault' on Instance uuid a741b004-2f32-419c-aada-de12ed0cd36e {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:14:11.646105 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2b688810-9acf-4467-82ca-69b4715f5dad tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:11.656499 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2b688810-9acf-4467-82ca-69b4715f5dad tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833" status: 200 len: 1309 microversion: 2.1 time: 0.330603 Aug 04 17:14:11.663858 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2311/4550] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:11 2022] GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833 => generated 1309 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:11.675350 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1251b5c3-ed3f-4cae-8be6-acad16ec2007 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:11.682297 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1251b5c3-ed3f-4cae-8be6-acad16ec2007 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:11.693610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1251b5c3-ed3f-4cae-8be6-acad16ec2007 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:11.697781 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-720635a9-c7cf-4af6-b2ef-b6323c5b3fb7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:11.706084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1251b5c3-ed3f-4cae-8be6-acad16ec2007 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:11.707138 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-720635a9-c7cf-4af6-b2ef-b6323c5b3fb7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 200 len: 1314 microversion: 2.1 time: 0.328326 Aug 04 17:14:11.707567 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2240/4551] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:11 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:11.708255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1251b5c3-ed3f-4cae-8be6-acad16ec2007 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:11.709209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1251b5c3-ed3f-4cae-8be6-acad16ec2007 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:11.709898 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1251b5c3-ed3f-4cae-8be6-acad16ec2007 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:11.710546 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1251b5c3-ed3f-4cae-8be6-acad16ec2007 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:11.792498 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1251b5c3-ed3f-4cae-8be6-acad16ec2007 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123470 Aug 04 17:14:11.800752 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2312/4552] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:14:11 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:14:11.985929 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-e7fd9b4e-b0f3-43cf-9c32-2f0a663d87c1 req-35fe21b7-b698-45af-9a32-1cbb0b91e81b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc8a6ac-f4f5-496f-867e-27b1ed15c833", "name": "network-vif-plugged", "status": "completed", "tag": "fef85cf0-8d56-4436-817e-3bc44fd6688a"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:11.998882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e7fd9b4e-b0f3-43cf-9c32-2f0a663d87c1 req-35fe21b7-b698-45af-9a32-1cbb0b91e81b service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:12.002232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e7fd9b4e-b0f3-43cf-9c32-2f0a663d87c1 req-35fe21b7-b698-45af-9a32-1cbb0b91e81b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:12.005433 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e7fd9b4e-b0f3-43cf-9c32-2f0a663d87c1 req-35fe21b7-b698-45af-9a32-1cbb0b91e81b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:12.032064 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-e7fd9b4e-b0f3-43cf-9c32-2f0a663d87c1 req-35fe21b7-b698-45af-9a32-1cbb0b91e81b service nova] Creating event network-vif-plugged:fef85cf0-8d56-4436-817e-3bc44fd6688a for instance edc8a6ac-f4f5-496f-867e-27b1ed15c833 on n-h2-851359-3 Aug 04 17:14:12.039347 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-e7fd9b4e-b0f3-43cf-9c32-2f0a663d87c1 req-35fe21b7-b698-45af-9a32-1cbb0b91e81b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060520 Aug 04 17:14:12.041857 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2241/4553] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:14:12.272584 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6f2a2cc7-164a-4c71-8b4b-e0fad1046bd8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:12.273214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6f2a2cc7-164a-4c71-8b4b-e0fad1046bd8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:12.288966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f2a2cc7-164a-4c71-8b4b-e0fad1046bd8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:12.289340 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a95f6b6d-2c13-46bc-896a-33cb78dcd16b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:12.290403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f2a2cc7-164a-4c71-8b4b-e0fad1046bd8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:12.290556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a95f6b6d-2c13-46bc-896a-33cb78dcd16b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:12.292656 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f2a2cc7-164a-4c71-8b4b-e0fad1046bd8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:12.293576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f2a2cc7-164a-4c71-8b4b-e0fad1046bd8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:12.296591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f2a2cc7-164a-4c71-8b4b-e0fad1046bd8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:12.300209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f2a2cc7-164a-4c71-8b4b-e0fad1046bd8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:12.303962 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a95f6b6d-2c13-46bc-896a-33cb78dcd16b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:12.304934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a95f6b6d-2c13-46bc-896a-33cb78dcd16b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:12.305398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a95f6b6d-2c13-46bc-896a-33cb78dcd16b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:12.306594 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a95f6b6d-2c13-46bc-896a-33cb78dcd16b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:12.306734 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a95f6b6d-2c13-46bc-896a-33cb78dcd16b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:12.307133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a95f6b6d-2c13-46bc-896a-33cb78dcd16b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:12.674680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6f2a2cc7-164a-4c71-8b4b-e0fad1046bd8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:12.683675 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6f2a2cc7-164a-4c71-8b4b-e0fad1046bd8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1508 microversion: 2.1 time: 0.414971 Aug 04 17:14:12.688387 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2313/4554] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:12 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1508 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:12.697297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a95f6b6d-2c13-46bc-896a-33cb78dcd16b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:12.704419 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ddbd5a25-4373-4c3d-a712-14772c688ce4 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:12.705217 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ddbd5a25-4373-4c3d-a712-14772c688ce4 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: edc8a6ac-f4f5-496f-867e-27b1ed15c833] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:12.710361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a95f6b6d-2c13-46bc-896a-33cb78dcd16b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:12.714152 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ddbd5a25-4373-4c3d-a712-14772c688ce4 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:12.714988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ddbd5a25-4373-4c3d-a712-14772c688ce4 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:12.715668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ddbd5a25-4373-4c3d-a712-14772c688ce4 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:12.716126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a95f6b6d-2c13-46bc-896a-33cb78dcd16b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:12.716867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ddbd5a25-4373-4c3d-a712-14772c688ce4 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:12.717445 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a95f6b6d-2c13-46bc-896a-33cb78dcd16b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1809 microversion: 2.20 time: 0.432532 Aug 04 17:14:12.717829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ddbd5a25-4373-4c3d-a712-14772c688ce4 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:12.718519 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ddbd5a25-4373-4c3d-a712-14772c688ce4 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:12.721755 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2242/4555] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:12 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1809 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:14:12.733750 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-408120c6-d113-4673-9309-7697864da5bb tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:12.737847 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-408120c6-d113-4673-9309-7697864da5bb tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:12.751528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-408120c6-d113-4673-9309-7697864da5bb tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:12.754338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-408120c6-d113-4673-9309-7697864da5bb tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:12.756422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-408120c6-d113-4673-9309-7697864da5bb tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:12.758016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-408120c6-d113-4673-9309-7697864da5bb tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:12.759375 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-408120c6-d113-4673-9309-7697864da5bb tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:12.760620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-408120c6-d113-4673-9309-7697864da5bb tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:12.781626 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-408120c6-d113-4673-9309-7697864da5bb tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] HTTP exception thrown: Instance a741b004-2f32-419c-aada-de12ed0cd36e could not be found. Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-408120c6-d113-4673-9309-7697864da5bb tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Request method failure captured: Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e HTTP/1.1 Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_4xbB8fnr17iZxpZmQfQZiM2JCxKiVWWUXjZiHpHTuUHHVw7ao4oT_uZW8wxu89NvTWOIVQIIqQPmHAao-lpxs7gxXuSYKOkaP9AGGwPUmZ0l1sD6ZLIZdH6-nP_cliwrHT6QFXnVMcXHLYBwQRQIzx4m2gYEscPKDx2pEzeM4vYGU Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 85c97e15d470473189d8a6c2068e9eac Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/85c97e15d470473189d8a6c2068e9eac"}]}] Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 85c97e15d470473189d8a6c2068e9eac Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ImagesOneServerNegativeTestJSON-1209884465-project Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 6791b833351c493a8e581154c2dfb8d7 Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465-project Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance a741b004-2f32-419c-aada-de12ed0cd36e could not be found. Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'a741b004-2f32-419c-aada-de12ed0cd36e'} Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a741b004-2f32-419c-aada-de12ed0cd36e could not be found. Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a741b004-2f32-419c-aada-de12ed0cd36e could not be found. Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:14:12.784678 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:14:12.789227 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:14:12.789227 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:14:12.789227 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:14:12.789227 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:14:12.789227 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:14:12.789227 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:14:12.789227 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a741b004-2f32-419c-aada-de12ed0cd36e could not be found. Aug 04 17:14:12.789227 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:14:12.790518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-408120c6-d113-4673-9309-7697864da5bb tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Returning 404 to user: Instance a741b004-2f32-419c-aada-de12ed0cd36e could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:14:12.791538 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-408120c6-d113-4673-9309-7697864da5bb tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 404 len: 111 microversion: 2.1 time: 0.065573 Aug 04 17:14:12.792115 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2243/4556] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:12 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:14:12.803636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-423f6d4f-5e21-44c9-b72d-7e423d880937 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Action: 'create', calling method: .version_select at 0x7f1e5b3b2310>, body: {"keypair": {"name": "tempest-keypair-1765922725", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqUtHMAOsKlch5ZbrPx0n4qgf50CuG2Vn4pn1GSrNP4jT/3u7/Ib4K+ActuBddMAR/R79rM90HfYbloaQs4sR3Q6sg8npu/idOv7PrByZN/ukgdI++BmmiPwvYDDxtnSg=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:12.821542 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-423f6d4f-5e21-44c9-b72d-7e423d880937 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Getting quotas for project 85c97e15d470473189d8a6c2068e9eac. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:14:12.828132 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-423f6d4f-5e21-44c9-b72d-7e423d880937 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Getting quotas for user 6791b833351c493a8e581154c2dfb8d7 and project 85c97e15d470473189d8a6c2068e9eac. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:14:12.887352 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-423f6d4f-5e21-44c9-b72d-7e423d880937 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.087240 Aug 04 17:14:12.891368 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2244/4557] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:14:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:14:12.900861 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9c0b26fa-c548-4cb8-ba59-297cbea4d929 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:12.905862 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9c0b26fa-c548-4cb8-ba59-297cbea4d929 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:12.921056 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c0b26fa-c548-4cb8-ba59-297cbea4d929 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:12.922485 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c0b26fa-c548-4cb8-ba59-297cbea4d929 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:12.923248 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c0b26fa-c548-4cb8-ba59-297cbea4d929 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:12.924276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c0b26fa-c548-4cb8-ba59-297cbea4d929 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:12.925139 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c0b26fa-c548-4cb8-ba59-297cbea4d929 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:12.925790 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c0b26fa-c548-4cb8-ba59-297cbea4d929 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:13.036542 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ddbd5a25-4373-4c3d-a712-14772c688ce4 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:13.041400 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9c0b26fa-c548-4cb8-ba59-297cbea4d929 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148849 Aug 04 17:14:13.042006 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2245/4558] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:14:12 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:14:13.049963 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ddbd5a25-4373-4c3d-a712-14772c688ce4 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833" status: 200 len: 1309 microversion: 2.1 time: 0.358058 Aug 04 17:14:13.050770 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2314/4559] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:12 2022] GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833 => generated 1309 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:13.707560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eab0338f-3ea0-437a-bbbd-730d33cd7d83 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:13.708484 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eab0338f-3ea0-437a-bbbd-730d33cd7d83 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:13.719687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eab0338f-3ea0-437a-bbbd-730d33cd7d83 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:13.720450 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eab0338f-3ea0-437a-bbbd-730d33cd7d83 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:13.721714 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eab0338f-3ea0-437a-bbbd-730d33cd7d83 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:13.723494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eab0338f-3ea0-437a-bbbd-730d33cd7d83 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:13.725013 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eab0338f-3ea0-437a-bbbd-730d33cd7d83 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:13.725653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eab0338f-3ea0-437a-bbbd-730d33cd7d83 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:13.742277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1a8974ef-5161-466c-852d-3bf221058201 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:13.743704 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1a8974ef-5161-466c-852d-3bf221058201 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:13.755308 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a8974ef-5161-466c-852d-3bf221058201 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:13.756041 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a8974ef-5161-466c-852d-3bf221058201 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:13.756639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a8974ef-5161-466c-852d-3bf221058201 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:13.759260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a8974ef-5161-466c-852d-3bf221058201 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:13.759924 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a8974ef-5161-466c-852d-3bf221058201 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:13.761139 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a8974ef-5161-466c-852d-3bf221058201 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:14.152102 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1a8974ef-5161-466c-852d-3bf221058201 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:14.161228 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eab0338f-3ea0-437a-bbbd-730d33cd7d83 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:14.163389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1a8974ef-5161-466c-852d-3bf221058201 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:14.164901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1a8974ef-5161-466c-852d-3bf221058201 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:14.171247 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eab0338f-3ea0-437a-bbbd-730d33cd7d83 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1508 microversion: 2.1 time: 0.467591 Aug 04 17:14:14.172061 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2246/4560] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:13 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1508 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:14.176276 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1a8974ef-5161-466c-852d-3bf221058201 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1809 microversion: 2.20 time: 0.428040 Aug 04 17:14:14.177339 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2315/4561] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:13 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1809 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:14:14.189454 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-029d4917-2e06-4f5f-b0ed-d25d8ab58787 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:14.198263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-029d4917-2e06-4f5f-b0ed-d25d8ab58787 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: edc8a6ac-f4f5-496f-867e-27b1ed15c833] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:14.200310 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d40eff2f-5d8d-41c7-a5b3-a52efaf3ba1e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:14.209143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d40eff2f-5d8d-41c7-a5b3-a52efaf3ba1e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:14.228459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-029d4917-2e06-4f5f-b0ed-d25d8ab58787 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:14.228670 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d40eff2f-5d8d-41c7-a5b3-a52efaf3ba1e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:14.228867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-029d4917-2e06-4f5f-b0ed-d25d8ab58787 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:14.229214 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d40eff2f-5d8d-41c7-a5b3-a52efaf3ba1e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:14.229834 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d40eff2f-5d8d-41c7-a5b3-a52efaf3ba1e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:14.234309 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-029d4917-2e06-4f5f-b0ed-d25d8ab58787 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:14.235108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-029d4917-2e06-4f5f-b0ed-d25d8ab58787 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:14.235455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d40eff2f-5d8d-41c7-a5b3-a52efaf3ba1e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:14.235583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-029d4917-2e06-4f5f-b0ed-d25d8ab58787 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:14.235999 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d40eff2f-5d8d-41c7-a5b3-a52efaf3ba1e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:14.236128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-029d4917-2e06-4f5f-b0ed-d25d8ab58787 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:14.236725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d40eff2f-5d8d-41c7-a5b3-a52efaf3ba1e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:14.313024 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d40eff2f-5d8d-41c7-a5b3-a52efaf3ba1e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139654 Aug 04 17:14:14.313626 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2247/4562] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:14:14 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:14:14.577869 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-029d4917-2e06-4f5f-b0ed-d25d8ab58787 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:14.602876 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-029d4917-2e06-4f5f-b0ed-d25d8ab58787 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833" status: 200 len: 1491 microversion: 2.1 time: 0.417844 Aug 04 17:14:14.603824 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2316/4563] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:14 2022] GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833 => generated 1491 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:14.803066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b809948b-7315-47e2-8d2b-500ac99cd56f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1535580831", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "ec3b7b59-9fd4-4839-add6-43afeffa896c"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:15.215353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-99e2ffc9-9b7c-4d08-8f35-bde264389abd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:15.215990 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-99e2ffc9-9b7c-4d08-8f35-bde264389abd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:15.230858 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99e2ffc9-9b7c-4d08-8f35-bde264389abd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:15.231970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99e2ffc9-9b7c-4d08-8f35-bde264389abd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:15.233214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99e2ffc9-9b7c-4d08-8f35-bde264389abd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:15.234164 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99e2ffc9-9b7c-4d08-8f35-bde264389abd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:15.235011 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99e2ffc9-9b7c-4d08-8f35-bde264389abd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:15.235658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99e2ffc9-9b7c-4d08-8f35-bde264389abd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:15.433333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-99e2ffc9-9b7c-4d08-8f35-bde264389abd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:15.442591 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-99e2ffc9-9b7c-4d08-8f35-bde264389abd tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1508 microversion: 2.1 time: 0.233421 Aug 04 17:14:15.458266 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2317/4564] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:15 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1508 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:15.463588 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ada61171-b86f-4c80-8e84-24015a8ed3a3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:15.464219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ada61171-b86f-4c80-8e84-24015a8ed3a3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:15.470870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ada61171-b86f-4c80-8e84-24015a8ed3a3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:15.471585 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ada61171-b86f-4c80-8e84-24015a8ed3a3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:15.472176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ada61171-b86f-4c80-8e84-24015a8ed3a3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:15.473031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ada61171-b86f-4c80-8e84-24015a8ed3a3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:15.473635 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ada61171-b86f-4c80-8e84-24015a8ed3a3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:15.474253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ada61171-b86f-4c80-8e84-24015a8ed3a3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:15.652472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ada61171-b86f-4c80-8e84-24015a8ed3a3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:15.662588 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ada61171-b86f-4c80-8e84-24015a8ed3a3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:15.665520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ada61171-b86f-4c80-8e84-24015a8ed3a3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:15.667200 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ada61171-b86f-4c80-8e84-24015a8ed3a3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1809 microversion: 2.20 time: 0.207422 Aug 04 17:14:15.668146 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2318/4565] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:15 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1809 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:14:15.680777 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a021b495-d3ba-4cba-9a6d-0a7d9575f7fa tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:15.694723 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a021b495-d3ba-4cba-9a6d-0a7d9575f7fa tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:15.702764 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a021b495-d3ba-4cba-9a6d-0a7d9575f7fa tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:15.703430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a021b495-d3ba-4cba-9a6d-0a7d9575f7fa tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:15.705436 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a021b495-d3ba-4cba-9a6d-0a7d9575f7fa tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:15.706218 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a021b495-d3ba-4cba-9a6d-0a7d9575f7fa tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:15.706863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a021b495-d3ba-4cba-9a6d-0a7d9575f7fa tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:15.712140 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a021b495-d3ba-4cba-9a6d-0a7d9575f7fa tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:15.747956 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a021b495-d3ba-4cba-9a6d-0a7d9575f7fa tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078325 Aug 04 17:14:15.748560 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2319/4566] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:14:15 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:14:15.754640 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b358e54d-4f96-4af7-9749-a34da3cd8d7d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1769307638", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:22.846573 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:23.031447 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-b809948b-7315-47e2-8d2b-500ac99cd56f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] validate_networks() for [('ec3b7b59-9fd4-4839-add6-43afeffa896c', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:14:23.044931 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-b358e54d-4f96-4af7-9749-a34da3cd8d7d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] validate_networks() for [('3217db81-b57f-4c04-a0d3-93f4607c02ae', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:14:23.709073 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-b809948b-7315-47e2-8d2b-500ac99cd56f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:14:23.709756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-b809948b-7315-47e2-8d2b-500ac99cd56f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:14:23.710523 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-b809948b-7315-47e2-8d2b-500ac99cd56f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:14:23.711202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-b809948b-7315-47e2-8d2b-500ac99cd56f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:14:23.711806 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-b809948b-7315-47e2-8d2b-500ac99cd56f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:14:23.748740 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b809948b-7315-47e2-8d2b-500ac99cd56f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:23.749234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b809948b-7315-47e2-8d2b-500ac99cd56f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:23.749863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b809948b-7315-47e2-8d2b-500ac99cd56f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:23.750820 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b809948b-7315-47e2-8d2b-500ac99cd56f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:23.751459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b809948b-7315-47e2-8d2b-500ac99cd56f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:23.752104 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b809948b-7315-47e2-8d2b-500ac99cd56f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:23.772909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-b809948b-7315-47e2-8d2b-500ac99cd56f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Getting quotas for project d9911aeb77cd4ffb8c4e539998a04f3c. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:14:23.779150 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-b809948b-7315-47e2-8d2b-500ac99cd56f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Getting quotas for user 8e840d06bb5d44e097e6f0855b04cb06 and project d9911aeb77cd4ffb8c4e539998a04f3c. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:14:23.798369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b809948b-7315-47e2-8d2b-500ac99cd56f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:14:23.801129 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b809948b-7315-47e2-8d2b-500ac99cd56f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b27bb91b-1dab-4d8a-b388-09b2427931a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:14:23.855338 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b809948b-7315-47e2-8d2b-500ac99cd56f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.061563 Aug 04 17:14:23.857095 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2248/4567] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:14:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 9068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:14:23.891892 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5037598a-e132-4f71-a96f-740c9d213c5d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:23.894542 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5037598a-e132-4f71-a96f-740c9d213c5d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:23.908822 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5037598a-e132-4f71-a96f-740c9d213c5d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:23.909510 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5037598a-e132-4f71-a96f-740c9d213c5d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:23.910075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5037598a-e132-4f71-a96f-740c9d213c5d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:23.911928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5037598a-e132-4f71-a96f-740c9d213c5d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:23.912622 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5037598a-e132-4f71-a96f-740c9d213c5d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:23.913369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5037598a-e132-4f71-a96f-740c9d213c5d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:23.960971 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-5037598a-e132-4f71-a96f-740c9d213c5d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] HTTP exception thrown: Cannot 'reboot' instance 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 while it is in vm_state rescued Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5037598a-e132-4f71-a96f-740c9d213c5d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Request method failure captured: Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7/action HTTP/1.1 Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 28 Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_1KcpG4juUr2VEfzShlgrBBMonXazIZnBtgobublSG0FrbL-f6glawbXIezuRVmeGIpCPKZ2_FVYi6XXX8bEGfzlmqPmHXf6Tacw6jDfV9QuP1xJWCSlbaybEtYK4vIloCt34qv4iEL4IzCpH1AIgjNgga3059ie-t_wAucPvDkWig Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 50d2f7cd670340adb1b4187754e302c5 Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1121530457 Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/50d2f7cd670340adb1b4187754e302c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/50d2f7cd670340adb1b4187754e302c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_50d2f7cd670340adb1b4187754e302c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/50d2f7cd670340adb1b4187754e302c5"}]}] Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1121530457 Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 50d2f7cd670340adb1b4187754e302c5 Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1121530457 Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServerRescueNegativeTestJSON-1121530457-project Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 067e98d624234a48bb0ea3bde77c049c Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1121530457-project Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: {"reboot": {"type": "HARD"}} Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: exception: Cannot 'reboot' instance 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 while it is in vm_state rescued Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '6b958ca6-2ca6-41ac-b4f2-f28d2b031de7', 'body': {'reboot': {'type': 'HARD'}}} Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3499, in reboot Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 17:14:23.968206 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 17:14:23.971955 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 while it is in vm_state rescued Aug 04 17:14:23.971955 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:14:23.971955 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:14:23.971955 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:14:23.971955 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:14:23.971955 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:14:23.971955 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:14:23.971955 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:14:23.971955 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:14:23.971955 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 while it is in vm_state rescued Aug 04 17:14:23.971955 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:14:23.982331 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5037598a-e132-4f71-a96f-740c9d213c5d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Returning 409 to user: Cannot 'reboot' instance 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 while it is in vm_state rescued {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:14:23.984043 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5037598a-e132-4f71-a96f-740c9d213c5d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "POST /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7/action" status: 409 len: 145 microversion: 2.1 time: 0.118855 Aug 04 17:14:23.997532 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2249/4568] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:14:23 2022] POST /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7/action => generated 145 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:14:24.003196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f859c71d-a89f-4e64-8ef5-f85e17726057 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:24.004192 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f859c71d-a89f-4e64-8ef5-f85e17726057 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:24.011797 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f859c71d-a89f-4e64-8ef5-f85e17726057 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:24.012498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f859c71d-a89f-4e64-8ef5-f85e17726057 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:24.013493 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f859c71d-a89f-4e64-8ef5-f85e17726057 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:24.014468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f859c71d-a89f-4e64-8ef5-f85e17726057 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:24.015088 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f859c71d-a89f-4e64-8ef5-f85e17726057 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:24.015776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f859c71d-a89f-4e64-8ef5-f85e17726057 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:24.179535 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-b358e54d-4f96-4af7-9749-a34da3cd8d7d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:14:24.180477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-b358e54d-4f96-4af7-9749-a34da3cd8d7d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:14:24.181108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-b358e54d-4f96-4af7-9749-a34da3cd8d7d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:14:24.181692 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-b358e54d-4f96-4af7-9749-a34da3cd8d7d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:14:24.182282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-b358e54d-4f96-4af7-9749-a34da3cd8d7d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:14:24.207914 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b358e54d-4f96-4af7-9749-a34da3cd8d7d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:24.210581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b358e54d-4f96-4af7-9749-a34da3cd8d7d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:24.212001 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b358e54d-4f96-4af7-9749-a34da3cd8d7d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:24.213631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b358e54d-4f96-4af7-9749-a34da3cd8d7d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:24.215007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b358e54d-4f96-4af7-9749-a34da3cd8d7d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:24.216326 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b358e54d-4f96-4af7-9749-a34da3cd8d7d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:24.265341 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-b358e54d-4f96-4af7-9749-a34da3cd8d7d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Getting quotas for project 85c97e15d470473189d8a6c2068e9eac. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:14:24.285341 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-b358e54d-4f96-4af7-9749-a34da3cd8d7d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Getting quotas for user 6791b833351c493a8e581154c2dfb8d7 and project 85c97e15d470473189d8a6c2068e9eac. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:14:24.311501 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b358e54d-4f96-4af7-9749-a34da3cd8d7d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:14:24.314511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b358e54d-4f96-4af7-9749-a34da3cd8d7d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 134ac071-c06f-4195-9405-37e71e6d08a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:14:24.330173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f859c71d-a89f-4e64-8ef5-f85e17726057 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:24.341657 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f859c71d-a89f-4e64-8ef5-f85e17726057 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1508 microversion: 2.1 time: 0.342366 Aug 04 17:14:24.343934 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2250/4569] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:23 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1508 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:24.359173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-34efe98b-8260-45fa-b0ad-62f4dc100ee6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:24.360108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-34efe98b-8260-45fa-b0ad-62f4dc100ee6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:24.375120 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34efe98b-8260-45fa-b0ad-62f4dc100ee6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:24.377588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34efe98b-8260-45fa-b0ad-62f4dc100ee6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:24.378608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34efe98b-8260-45fa-b0ad-62f4dc100ee6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:24.394640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34efe98b-8260-45fa-b0ad-62f4dc100ee6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:24.396356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34efe98b-8260-45fa-b0ad-62f4dc100ee6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:24.398009 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34efe98b-8260-45fa-b0ad-62f4dc100ee6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:24.425941 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b358e54d-4f96-4af7-9749-a34da3cd8d7d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 8.676265 Aug 04 17:14:24.431423 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2320/4570] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:14:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 8682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:14:24.450126 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3ca12857-1540-4b71-a18d-a1a00ffe6440 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:24.455271 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3ca12857-1540-4b71-a18d-a1a00ffe6440 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b27bb91b-1dab-4d8a-b388-09b2427931a9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:24.590961 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3ca12857-1540-4b71-a18d-a1a00ffe6440 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:24.608997 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3ca12857-1540-4b71-a18d-a1a00ffe6440 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9" status: 200 len: 1209 microversion: 2.1 time: 0.175453 Aug 04 17:14:24.610238 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2321/4571] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:24 2022] GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9 => generated 1209 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:24.625319 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1298674e-5b57-471d-9ac3-eb46dbce79ab tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:24.636819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1298674e-5b57-471d-9ac3-eb46dbce79ab tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:24.658601 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1298674e-5b57-471d-9ac3-eb46dbce79ab tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:24.660626 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1298674e-5b57-471d-9ac3-eb46dbce79ab tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:24.662460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1298674e-5b57-471d-9ac3-eb46dbce79ab tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:24.665021 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1298674e-5b57-471d-9ac3-eb46dbce79ab tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:24.667290 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1298674e-5b57-471d-9ac3-eb46dbce79ab tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:24.668791 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1298674e-5b57-471d-9ac3-eb46dbce79ab tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:24.716425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:24.771737 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-1298674e-5b57-471d-9ac3-eb46dbce79ab tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] HTTP exception thrown: Cannot 'rebuild' instance 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 while it is in vm_state rescued Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1298674e-5b57-471d-9ac3-eb46dbce79ab tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Request method failure captured: Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7/action HTTP/1.1 Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 65 Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_1KcpG4juUr2VEfzShlgrBBMonXazIZnBtgobublSG0FrbL-f6glawbXIezuRVmeGIpCPKZ2_FVYi6XXX8bEGfzlmqPmHXf6Tacw6jDfV9QuP1xJWCSlbaybEtYK4vIloCt34qv4iEL4IzCpH1AIgjNgga3059ie-t_wAucPvDkWig Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 50d2f7cd670340adb1b4187754e302c5 Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1121530457 Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/50d2f7cd670340adb1b4187754e302c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/50d2f7cd670340adb1b4187754e302c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_50d2f7cd670340adb1b4187754e302c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/50d2f7cd670340adb1b4187754e302c5"}]}] Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1121530457 Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 50d2f7cd670340adb1b4187754e302c5 Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1121530457 Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerRescueNegativeTestJSON-1121530457-project Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 067e98d624234a48bb0ea3bde77c049c Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1121530457-project Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: {"rebuild": {"imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9"}} Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: exception: Cannot 'rebuild' instance 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 while it is in vm_state rescued Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '6b958ca6-2ca6-41ac-b4f2-f28d2b031de7', 'body': {'rebuild': {'imageRef': '93ebc91d-2d7a-4ab2-b133-dcf9559166d9'}}} Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:14:24.779183 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:14:24.782834 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:14:24.782834 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 04 17:14:24.782834 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 04 17:14:24.782834 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 17:14:24.782834 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 17:14:24.782834 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 17:14:24.782834 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 while it is in vm_state rescued Aug 04 17:14:24.782834 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:14:24.782834 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:14:24.782834 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:14:24.782834 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:14:24.782834 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:14:24.782834 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:14:24.782834 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:14:24.782834 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:14:24.782834 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 while it is in vm_state rescued Aug 04 17:14:24.782834 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:14:24.791288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1298674e-5b57-471d-9ac3-eb46dbce79ab tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Returning 409 to user: Cannot 'rebuild' instance 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 while it is in vm_state rescued {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:14:24.792419 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1298674e-5b57-471d-9ac3-eb46dbce79ab tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "POST /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7/action" status: 409 len: 146 microversion: 2.1 time: 0.179280 Aug 04 17:14:24.800717 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2322/4572] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:14:24 2022] POST /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7/action => generated 146 bytes in 190 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:14:24.813600 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-34efe98b-8260-45fa-b0ad-62f4dc100ee6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:24.828335 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-29c35888-eab3-404e-b6b3-cda310b356ff tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:24.832594 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-29c35888-eab3-404e-b6b3-cda310b356ff tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 134ac071-c06f-4195-9405-37e71e6d08a9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:24.843333 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-34efe98b-8260-45fa-b0ad-62f4dc100ee6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:24.845621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-34efe98b-8260-45fa-b0ad-62f4dc100ee6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:24.847098 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-34efe98b-8260-45fa-b0ad-62f4dc100ee6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1809 microversion: 2.20 time: 0.501017 Aug 04 17:14:24.864787 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2251/4573] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:24 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1809 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:14:24.878764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9069af3e-4439-4c87-a1bb-1375ac8048f2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:24.880256 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9069af3e-4439-4c87-a1bb-1375ac8048f2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:24.897501 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9069af3e-4439-4c87-a1bb-1375ac8048f2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:24.898246 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9069af3e-4439-4c87-a1bb-1375ac8048f2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:24.899671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9069af3e-4439-4c87-a1bb-1375ac8048f2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:24.902129 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9069af3e-4439-4c87-a1bb-1375ac8048f2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:24.911161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9069af3e-4439-4c87-a1bb-1375ac8048f2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:24.911645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9069af3e-4439-4c87-a1bb-1375ac8048f2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:24.961398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9069af3e-4439-4c87-a1bb-1375ac8048f2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:14:24.978995 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-29c35888-eab3-404e-b6b3-cda310b356ff tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:24.987961 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-29c35888-eab3-404e-b6b3-cda310b356ff tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9" status: 200 len: 1225 microversion: 2.1 time: 0.185548 Aug 04 17:14:24.988891 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2323/4574] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:24 2022] GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9 => generated 1225 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:25.006805 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:25.118202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:25.155541 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9069af3e-4439-4c87-a1bb-1375ac8048f2 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 204 len: 0 microversion: 2.1 time: 0.289016 Aug 04 17:14:25.158700 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2252/4575] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:14:24 2022] DELETE /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:14:25.166652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-181ebc6c-33af-4911-b622-586bac1b647c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:25.167290 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-181ebc6c-33af-4911-b622-586bac1b647c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:25.183440 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-181ebc6c-33af-4911-b622-586bac1b647c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:25.184052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-181ebc6c-33af-4911-b622-586bac1b647c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:25.184686 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-181ebc6c-33af-4911-b622-586bac1b647c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:25.185919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-181ebc6c-33af-4911-b622-586bac1b647c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:25.186408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-181ebc6c-33af-4911-b622-586bac1b647c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:25.188567 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-181ebc6c-33af-4911-b622-586bac1b647c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:25.367084 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-85237e28-bdeb-437d-9280-07cbcbb736f8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:25.368231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-85237e28-bdeb-437d-9280-07cbcbb736f8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:25.385176 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85237e28-bdeb-437d-9280-07cbcbb736f8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:25.389339 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85237e28-bdeb-437d-9280-07cbcbb736f8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:25.390069 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85237e28-bdeb-437d-9280-07cbcbb736f8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:25.390992 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85237e28-bdeb-437d-9280-07cbcbb736f8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:25.391630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85237e28-bdeb-437d-9280-07cbcbb736f8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:25.393681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85237e28-bdeb-437d-9280-07cbcbb736f8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:25.513521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-181ebc6c-33af-4911-b622-586bac1b647c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:25.522746 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-181ebc6c-33af-4911-b622-586bac1b647c tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1686 microversion: 2.1 time: 0.360061 Aug 04 17:14:25.526312 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2324/4576] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:25 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1686 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:25.605437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-85237e28-bdeb-437d-9280-07cbcbb736f8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:25.614486 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-85237e28-bdeb-437d-9280-07cbcbb736f8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1508 microversion: 2.1 time: 0.252812 Aug 04 17:14:25.615291 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2253/4577] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:25 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1508 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:14:25.632328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-31c0a4ca-bed1-483b-a300-e9f216b29e05 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:25.633134 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-31c0a4ca-bed1-483b-a300-e9f216b29e05 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b27bb91b-1dab-4d8a-b388-09b2427931a9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:25.652362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31c0a4ca-bed1-483b-a300-e9f216b29e05 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:25.653174 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31c0a4ca-bed1-483b-a300-e9f216b29e05 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:25.653625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31c0a4ca-bed1-483b-a300-e9f216b29e05 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:25.654418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31c0a4ca-bed1-483b-a300-e9f216b29e05 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:25.654882 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31c0a4ca-bed1-483b-a300-e9f216b29e05 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:25.655311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31c0a4ca-bed1-483b-a300-e9f216b29e05 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:25.737912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-31c0a4ca-bed1-483b-a300-e9f216b29e05 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:25.748274 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-31c0a4ca-bed1-483b-a300-e9f216b29e05 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9" status: 200 len: 1261 microversion: 2.1 time: 0.119263 Aug 04 17:14:25.749413 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2325/4578] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:25 2022] GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9 => generated 1261 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:25.875581 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8fd8c96d-4ae3-4822-a07b-bea411ff5291 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:25.876749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8fd8c96d-4ae3-4822-a07b-bea411ff5291 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:25.885783 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fd8c96d-4ae3-4822-a07b-bea411ff5291 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:25.889273 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fd8c96d-4ae3-4822-a07b-bea411ff5291 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:25.889944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fd8c96d-4ae3-4822-a07b-bea411ff5291 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:25.890914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fd8c96d-4ae3-4822-a07b-bea411ff5291 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:25.891869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fd8c96d-4ae3-4822-a07b-bea411ff5291 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:25.892477 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fd8c96d-4ae3-4822-a07b-bea411ff5291 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:26.028699 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7bba4556-4875-487d-b0dd-4c6b8e35dac1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:26.029413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7bba4556-4875-487d-b0dd-4c6b8e35dac1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 134ac071-c06f-4195-9405-37e71e6d08a9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:26.051263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7bba4556-4875-487d-b0dd-4c6b8e35dac1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:26.056487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7bba4556-4875-487d-b0dd-4c6b8e35dac1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:26.057260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7bba4556-4875-487d-b0dd-4c6b8e35dac1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:26.058306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7bba4556-4875-487d-b0dd-4c6b8e35dac1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:26.058949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7bba4556-4875-487d-b0dd-4c6b8e35dac1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:26.059629 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7bba4556-4875-487d-b0dd-4c6b8e35dac1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:26.140393 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8fd8c96d-4ae3-4822-a07b-bea411ff5291 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:26.160915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8fd8c96d-4ae3-4822-a07b-bea411ff5291 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:26.170651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8fd8c96d-4ae3-4822-a07b-bea411ff5291 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:26.175540 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8fd8c96d-4ae3-4822-a07b-bea411ff5291 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1809 microversion: 2.20 time: 0.301476 Aug 04 17:14:26.177102 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2254/4579] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:25 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1809 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:14:26.244096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7bba4556-4875-487d-b0dd-4c6b8e35dac1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:26.255156 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7bba4556-4875-487d-b0dd-4c6b8e35dac1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9" status: 200 len: 1229 microversion: 2.1 time: 0.233525 Aug 04 17:14:26.258661 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2326/4580] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:26 2022] GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9 => generated 1229 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:26.548288 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d8d07f96-a945-4e51-a7b5-0df49b1cd0db tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:26.549475 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d8d07f96-a945-4e51-a7b5-0df49b1cd0db tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:26.556216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8d07f96-a945-4e51-a7b5-0df49b1cd0db tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:26.556971 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8d07f96-a945-4e51-a7b5-0df49b1cd0db tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:26.557412 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8d07f96-a945-4e51-a7b5-0df49b1cd0db tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:26.558152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8d07f96-a945-4e51-a7b5-0df49b1cd0db tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:26.558611 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8d07f96-a945-4e51-a7b5-0df49b1cd0db tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:26.559188 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8d07f96-a945-4e51-a7b5-0df49b1cd0db tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:26.636692 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5808d2b2-28d6-4e1b-851e-aaf047d3c027 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:26.637557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5808d2b2-28d6-4e1b-851e-aaf047d3c027 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:26.653507 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5808d2b2-28d6-4e1b-851e-aaf047d3c027 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:26.654555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5808d2b2-28d6-4e1b-851e-aaf047d3c027 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:26.655200 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5808d2b2-28d6-4e1b-851e-aaf047d3c027 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:26.656076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5808d2b2-28d6-4e1b-851e-aaf047d3c027 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:26.656701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5808d2b2-28d6-4e1b-851e-aaf047d3c027 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:26.657140 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5808d2b2-28d6-4e1b-851e-aaf047d3c027 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:26.795583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d8d07f96-a945-4e51-a7b5-0df49b1cd0db tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:26.804415 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d8d07f96-a945-4e51-a7b5-0df49b1cd0db tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1686 microversion: 2.1 time: 0.260105 Aug 04 17:14:26.811362 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2255/4581] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:26 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1686 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:26.824167 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a473e986-b4e8-4ee7-be24-de405cb8b8fd tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:26.836846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a473e986-b4e8-4ee7-be24-de405cb8b8fd tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b27bb91b-1dab-4d8a-b388-09b2427931a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:26.849000 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a473e986-b4e8-4ee7-be24-de405cb8b8fd tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:26.853913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a473e986-b4e8-4ee7-be24-de405cb8b8fd tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:26.854320 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a473e986-b4e8-4ee7-be24-de405cb8b8fd tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:26.855625 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a473e986-b4e8-4ee7-be24-de405cb8b8fd tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:26.856183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a473e986-b4e8-4ee7-be24-de405cb8b8fd tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:26.857369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a473e986-b4e8-4ee7-be24-de405cb8b8fd tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:26.899888 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5808d2b2-28d6-4e1b-851e-aaf047d3c027 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:26.911101 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5808d2b2-28d6-4e1b-851e-aaf047d3c027 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1508 microversion: 2.1 time: 0.278060 Aug 04 17:14:26.912396 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2327/4582] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:26 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1508 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:14:26.959844 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a473e986-b4e8-4ee7-be24-de405cb8b8fd tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:26.970088 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a473e986-b4e8-4ee7-be24-de405cb8b8fd tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9" status: 200 len: 1261 microversion: 2.1 time: 0.153561 Aug 04 17:14:26.970648 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2256/4583] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:26 2022] GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:27.203663 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ad2ad67f-5ee0-4a15-a9ba-8fb2e3448128 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:27.204635 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ad2ad67f-5ee0-4a15-a9ba-8fb2e3448128 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:27.223891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad2ad67f-5ee0-4a15-a9ba-8fb2e3448128 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:27.224509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad2ad67f-5ee0-4a15-a9ba-8fb2e3448128 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:27.225027 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad2ad67f-5ee0-4a15-a9ba-8fb2e3448128 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:27.225817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad2ad67f-5ee0-4a15-a9ba-8fb2e3448128 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:27.226435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad2ad67f-5ee0-4a15-a9ba-8fb2e3448128 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:27.226910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad2ad67f-5ee0-4a15-a9ba-8fb2e3448128 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:27.280210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-adaedd50-d1c7-4fde-9601-73a48ea1e249 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:27.281082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-adaedd50-d1c7-4fde-9601-73a48ea1e249 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 134ac071-c06f-4195-9405-37e71e6d08a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:27.291541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adaedd50-d1c7-4fde-9601-73a48ea1e249 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:27.294122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adaedd50-d1c7-4fde-9601-73a48ea1e249 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:27.294683 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adaedd50-d1c7-4fde-9601-73a48ea1e249 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:27.296059 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adaedd50-d1c7-4fde-9601-73a48ea1e249 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:27.296059 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adaedd50-d1c7-4fde-9601-73a48ea1e249 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:27.296433 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adaedd50-d1c7-4fde-9601-73a48ea1e249 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:27.414621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-adaedd50-d1c7-4fde-9601-73a48ea1e249 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:27.423117 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-adaedd50-d1c7-4fde-9601-73a48ea1e249 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9" status: 200 len: 1229 microversion: 2.1 time: 0.147388 Aug 04 17:14:27.424198 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2257/4584] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:27 2022] GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9 => generated 1229 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:27.434949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ad2ad67f-5ee0-4a15-a9ba-8fb2e3448128 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:27.444804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ad2ad67f-5ee0-4a15-a9ba-8fb2e3448128 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:27.446422 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ad2ad67f-5ee0-4a15-a9ba-8fb2e3448128 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:27.447597 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ad2ad67f-5ee0-4a15-a9ba-8fb2e3448128 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1809 microversion: 2.20 time: 0.249626 Aug 04 17:14:27.448378 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2328/4585] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:27 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1809 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:14:27.838673 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eb0dbdc7-e221-4c9e-af9c-c43a1a67fee0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:27.839625 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eb0dbdc7-e221-4c9e-af9c-c43a1a67fee0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:27.847099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb0dbdc7-e221-4c9e-af9c-c43a1a67fee0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:27.847594 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb0dbdc7-e221-4c9e-af9c-c43a1a67fee0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:27.848040 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb0dbdc7-e221-4c9e-af9c-c43a1a67fee0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:27.848751 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb0dbdc7-e221-4c9e-af9c-c43a1a67fee0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:27.849211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb0dbdc7-e221-4c9e-af9c-c43a1a67fee0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:27.849640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb0dbdc7-e221-4c9e-af9c-c43a1a67fee0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:27.937727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4ac8bbb1-9f64-4f33-b60e-45bca7faecd6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:27.938462 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4ac8bbb1-9f64-4f33-b60e-45bca7faecd6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:27.945035 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4ac8bbb1-9f64-4f33-b60e-45bca7faecd6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:27.945816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4ac8bbb1-9f64-4f33-b60e-45bca7faecd6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:27.946358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4ac8bbb1-9f64-4f33-b60e-45bca7faecd6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:27.947238 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4ac8bbb1-9f64-4f33-b60e-45bca7faecd6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:27.947851 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4ac8bbb1-9f64-4f33-b60e-45bca7faecd6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:27.948431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4ac8bbb1-9f64-4f33-b60e-45bca7faecd6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:28.024219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eb0dbdc7-e221-4c9e-af9c-c43a1a67fee0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:28.042118 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eb0dbdc7-e221-4c9e-af9c-c43a1a67fee0 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1686 microversion: 2.1 time: 0.207535 Aug 04 17:14:28.053386 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2258/4586] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:27 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1686 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:28.059257 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d88a31bd-4deb-4f0c-bd36-8b4718987bcd tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:28.067979 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d88a31bd-4deb-4f0c-bd36-8b4718987bcd tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b27bb91b-1dab-4d8a-b388-09b2427931a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:28.083379 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d88a31bd-4deb-4f0c-bd36-8b4718987bcd tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:28.084048 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d88a31bd-4deb-4f0c-bd36-8b4718987bcd tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:28.084756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d88a31bd-4deb-4f0c-bd36-8b4718987bcd tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:28.085696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d88a31bd-4deb-4f0c-bd36-8b4718987bcd tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:28.095143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d88a31bd-4deb-4f0c-bd36-8b4718987bcd tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:28.101882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d88a31bd-4deb-4f0c-bd36-8b4718987bcd tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:28.250700 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d88a31bd-4deb-4f0c-bd36-8b4718987bcd tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:28.260395 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d88a31bd-4deb-4f0c-bd36-8b4718987bcd tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9" status: 200 len: 1261 microversion: 2.1 time: 0.205650 Aug 04 17:14:28.260999 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2259/4587] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:28 2022] GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9 => generated 1261 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:28.310147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4ac8bbb1-9f64-4f33-b60e-45bca7faecd6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:28.320700 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4ac8bbb1-9f64-4f33-b60e-45bca7faecd6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1508 microversion: 2.1 time: 0.388311 Aug 04 17:14:28.321248 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2329/4588] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:27 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1508 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:14:28.445702 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6aca3b3d-88a7-4cf8-862c-1984de07b77b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:28.446637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6aca3b3d-88a7-4cf8-862c-1984de07b77b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 134ac071-c06f-4195-9405-37e71e6d08a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:28.454131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aca3b3d-88a7-4cf8-862c-1984de07b77b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:28.454822 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aca3b3d-88a7-4cf8-862c-1984de07b77b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:28.455363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aca3b3d-88a7-4cf8-862c-1984de07b77b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:28.456316 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aca3b3d-88a7-4cf8-862c-1984de07b77b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:28.456933 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aca3b3d-88a7-4cf8-862c-1984de07b77b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:28.457546 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aca3b3d-88a7-4cf8-862c-1984de07b77b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:28.472254 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-df2c3e9c-bea7-47e8-beba-7013a46b4021 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:28.472882 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-df2c3e9c-bea7-47e8-beba-7013a46b4021 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:28.482680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df2c3e9c-bea7-47e8-beba-7013a46b4021 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:28.483188 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df2c3e9c-bea7-47e8-beba-7013a46b4021 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:28.483639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df2c3e9c-bea7-47e8-beba-7013a46b4021 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:28.484396 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df2c3e9c-bea7-47e8-beba-7013a46b4021 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:28.484862 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df2c3e9c-bea7-47e8-beba-7013a46b4021 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:28.485482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df2c3e9c-bea7-47e8-beba-7013a46b4021 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:28.545389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6aca3b3d-88a7-4cf8-862c-1984de07b77b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:28.582719 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6aca3b3d-88a7-4cf8-862c-1984de07b77b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9" status: 200 len: 1221 microversion: 2.1 time: 0.140895 Aug 04 17:14:28.598521 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2260/4589] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:28 2022] GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9 => generated 1221 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:14:29.065946 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5d339348-43ac-4d43-ad1b-eec2d2465ddc tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:29.070680 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5d339348-43ac-4d43-ad1b-eec2d2465ddc tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:29.098057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d339348-43ac-4d43-ad1b-eec2d2465ddc tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:29.100274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d339348-43ac-4d43-ad1b-eec2d2465ddc tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:29.100996 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d339348-43ac-4d43-ad1b-eec2d2465ddc tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:29.102963 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d339348-43ac-4d43-ad1b-eec2d2465ddc tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:29.103696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d339348-43ac-4d43-ad1b-eec2d2465ddc tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:29.105405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d339348-43ac-4d43-ad1b-eec2d2465ddc tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:29.165867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-df2c3e9c-bea7-47e8-beba-7013a46b4021 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:29.185087 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-df2c3e9c-bea7-47e8-beba-7013a46b4021 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:29.192513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-df2c3e9c-bea7-47e8-beba-7013a46b4021 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:29.195993 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-df2c3e9c-bea7-47e8-beba-7013a46b4021 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1809 microversion: 2.20 time: 0.725549 Aug 04 17:14:29.221594 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2330/4590] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:28 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1809 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:14:29.287210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e9f7e66b-4f1f-4fcf-bf43-b477c79b13b0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:29.287970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e9f7e66b-4f1f-4fcf-bf43-b477c79b13b0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b27bb91b-1dab-4d8a-b388-09b2427931a9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:29.344580 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9f7e66b-4f1f-4fcf-bf43-b477c79b13b0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:29.349747 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9f7e66b-4f1f-4fcf-bf43-b477c79b13b0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:29.353779 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9f7e66b-4f1f-4fcf-bf43-b477c79b13b0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:29.361495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9f7e66b-4f1f-4fcf-bf43-b477c79b13b0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:29.369566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9f7e66b-4f1f-4fcf-bf43-b477c79b13b0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:29.375027 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e9f7e66b-4f1f-4fcf-bf43-b477c79b13b0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:29.591782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5d339348-43ac-4d43-ad1b-eec2d2465ddc tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:29.621151 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5d339348-43ac-4d43-ad1b-eec2d2465ddc tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1686 microversion: 2.1 time: 0.551124 Aug 04 17:14:29.621151 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2261/4591] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:29 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1686 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:29.621400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e9f7e66b-4f1f-4fcf-bf43-b477c79b13b0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:29.625970 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e9f7e66b-4f1f-4fcf-bf43-b477c79b13b0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9" status: 200 len: 1267 microversion: 2.1 time: 0.345406 Aug 04 17:14:29.629117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6fe8e8b2-7cb5-4b50-948f-1bd21766b7a1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:29.631630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6fe8e8b2-7cb5-4b50-948f-1bd21766b7a1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:29.637845 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2331/4592] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:29 2022] GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9 => generated 1267 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:29.666878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7d57a660-c39c-4488-bdff-0896da3a4b8d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:29.670347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6fe8e8b2-7cb5-4b50-948f-1bd21766b7a1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:29.672663 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7d57a660-c39c-4488-bdff-0896da3a4b8d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 134ac071-c06f-4195-9405-37e71e6d08a9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:29.674804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6fe8e8b2-7cb5-4b50-948f-1bd21766b7a1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:29.676627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6fe8e8b2-7cb5-4b50-948f-1bd21766b7a1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:29.679901 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6fe8e8b2-7cb5-4b50-948f-1bd21766b7a1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:29.684748 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6fe8e8b2-7cb5-4b50-948f-1bd21766b7a1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:29.689845 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6fe8e8b2-7cb5-4b50-948f-1bd21766b7a1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:29.708948 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d57a660-c39c-4488-bdff-0896da3a4b8d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:29.712741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d57a660-c39c-4488-bdff-0896da3a4b8d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:29.713719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d57a660-c39c-4488-bdff-0896da3a4b8d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:29.717481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d57a660-c39c-4488-bdff-0896da3a4b8d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:29.719644 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d57a660-c39c-4488-bdff-0896da3a4b8d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:29.720123 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d57a660-c39c-4488-bdff-0896da3a4b8d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:30.429054 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7d57a660-c39c-4488-bdff-0896da3a4b8d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:30.442337 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7d57a660-c39c-4488-bdff-0896da3a4b8d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9" status: 200 len: 1285 microversion: 2.1 time: 0.796266 Aug 04 17:14:30.447098 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2332/4593] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:29 2022] GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9 => generated 1285 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:30.460444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5cc915f9-db74-4166-b327-f400dc8abcc6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:30.461661 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5cc915f9-db74-4166-b327-f400dc8abcc6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:30.477242 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5cc915f9-db74-4166-b327-f400dc8abcc6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:30.479010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5cc915f9-db74-4166-b327-f400dc8abcc6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:30.480861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5cc915f9-db74-4166-b327-f400dc8abcc6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:30.483418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5cc915f9-db74-4166-b327-f400dc8abcc6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:30.486246 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5cc915f9-db74-4166-b327-f400dc8abcc6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:30.486949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5cc915f9-db74-4166-b327-f400dc8abcc6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:30.740207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6fe8e8b2-7cb5-4b50-948f-1bd21766b7a1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:30.750011 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6fe8e8b2-7cb5-4b50-948f-1bd21766b7a1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1508 microversion: 2.1 time: 1.132678 Aug 04 17:14:30.765026 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2262/4594] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:29 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1508 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:30.939205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5cc915f9-db74-4166-b327-f400dc8abcc6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:30.953499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5cc915f9-db74-4166-b327-f400dc8abcc6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:30.955024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5cc915f9-db74-4166-b327-f400dc8abcc6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:30.955998 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-79920f67-c329-48b9-b27b-de6d11a5033b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:30.956213 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5cc915f9-db74-4166-b327-f400dc8abcc6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1809 microversion: 2.20 time: 0.507924 Aug 04 17:14:30.956992 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2333/4595] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:30 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1809 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:14:30.958067 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-79920f67-c329-48b9-b27b-de6d11a5033b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:30.967752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-79920f67-c329-48b9-b27b-de6d11a5033b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:30.968600 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-79920f67-c329-48b9-b27b-de6d11a5033b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:30.969272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-79920f67-c329-48b9-b27b-de6d11a5033b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:30.969737 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3d8bf217-ca56-4365-a4ab-ad05c6f9e256 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:30.970847 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-79920f67-c329-48b9-b27b-de6d11a5033b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:30.971691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-79920f67-c329-48b9-b27b-de6d11a5033b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:30.972597 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-79920f67-c329-48b9-b27b-de6d11a5033b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:30.982389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3d8bf217-ca56-4365-a4ab-ad05c6f9e256 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b27bb91b-1dab-4d8a-b388-09b2427931a9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:30.989832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d8bf217-ca56-4365-a4ab-ad05c6f9e256 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:30.999597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d8bf217-ca56-4365-a4ab-ad05c6f9e256 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:31.000093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d8bf217-ca56-4365-a4ab-ad05c6f9e256 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:31.000854 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d8bf217-ca56-4365-a4ab-ad05c6f9e256 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:31.003446 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d8bf217-ca56-4365-a4ab-ad05c6f9e256 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:31.003909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d8bf217-ca56-4365-a4ab-ad05c6f9e256 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:31.113711 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-79920f67-c329-48b9-b27b-de6d11a5033b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:31.157874 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-79920f67-c329-48b9-b27b-de6d11a5033b tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 200 len: 1618 microversion: 2.1 time: 0.390910 Aug 04 17:14:31.159625 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2263/4596] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:30 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 1618 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:31.487526 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-962a6b42-bf37-4308-9883-27d3e2946695 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:31.488081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-962a6b42-bf37-4308-9883-27d3e2946695 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 134ac071-c06f-4195-9405-37e71e6d08a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:31.499352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-962a6b42-bf37-4308-9883-27d3e2946695 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:31.502383 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-962a6b42-bf37-4308-9883-27d3e2946695 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:31.505856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-962a6b42-bf37-4308-9883-27d3e2946695 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:31.510625 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-962a6b42-bf37-4308-9883-27d3e2946695 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:31.511326 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-962a6b42-bf37-4308-9883-27d3e2946695 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:31.511958 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-962a6b42-bf37-4308-9883-27d3e2946695 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:31.932399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3d8bf217-ca56-4365-a4ab-ad05c6f9e256 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:31.944601 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3d8bf217-ca56-4365-a4ab-ad05c6f9e256 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9" status: 200 len: 1309 microversion: 2.1 time: 0.979192 Aug 04 17:14:31.948011 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2334/4597] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:30 2022] GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9 => generated 1309 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:31.956300 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-04f3ef09-1320-4d65-b8db-f27e456bf9c8 req-024752e5-600a-4fc3-931a-399ef3e73da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c74445a-b3fe-4d2a-9dd3-43ab834d369a", "name": "network-vif-deleted", "tag": "70fcf2fa-c35a-42df-b9ec-1cb4ff3a8d65"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:31.989626 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-04f3ef09-1320-4d65-b8db-f27e456bf9c8 req-024752e5-600a-4fc3-931a-399ef3e73da3 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:32.006590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-04f3ef09-1320-4d65-b8db-f27e456bf9c8 req-024752e5-600a-4fc3-931a-399ef3e73da3 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:32.007337 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-04f3ef09-1320-4d65-b8db-f27e456bf9c8 req-024752e5-600a-4fc3-931a-399ef3e73da3 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:32.039412 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-04f3ef09-1320-4d65-b8db-f27e456bf9c8 req-024752e5-600a-4fc3-931a-399ef3e73da3 service nova] Creating event network-vif-deleted:70fcf2fa-c35a-42df-b9ec-1cb4ff3a8d65 for instance 0c74445a-b3fe-4d2a-9dd3-43ab834d369a on n-h1-851359-3 Aug 04 17:14:32.052231 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-04f3ef09-1320-4d65-b8db-f27e456bf9c8 req-024752e5-600a-4fc3-931a-399ef3e73da3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100546 Aug 04 17:14:32.053243 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2335/4598] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:14:32.063513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fec830ca-c346-4062-a7f9-f44c1336f78e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:32.064716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fec830ca-c346-4062-a7f9-f44c1336f78e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:32.093002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fec830ca-c346-4062-a7f9-f44c1336f78e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:32.094197 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fec830ca-c346-4062-a7f9-f44c1336f78e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:32.094874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fec830ca-c346-4062-a7f9-f44c1336f78e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:32.096041 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fec830ca-c346-4062-a7f9-f44c1336f78e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:32.108529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fec830ca-c346-4062-a7f9-f44c1336f78e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:32.110068 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fec830ca-c346-4062-a7f9-f44c1336f78e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:32.715891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-962a6b42-bf37-4308-9883-27d3e2946695 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:32.735082 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-962a6b42-bf37-4308-9883-27d3e2946695 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9" status: 200 len: 1325 microversion: 2.1 time: 1.253925 Aug 04 17:14:32.736851 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2264/4599] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:31 2022] GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9 => generated 1325 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:32.746541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5100bfec-873c-4d86-8578-ed1cac00fcac tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:32.747724 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5100bfec-873c-4d86-8578-ed1cac00fcac tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:32.757903 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5100bfec-873c-4d86-8578-ed1cac00fcac tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:32.758717 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5100bfec-873c-4d86-8578-ed1cac00fcac tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:32.759789 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5100bfec-873c-4d86-8578-ed1cac00fcac tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:32.761054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5100bfec-873c-4d86-8578-ed1cac00fcac tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:32.762213 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5100bfec-873c-4d86-8578-ed1cac00fcac tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:32.762876 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5100bfec-873c-4d86-8578-ed1cac00fcac tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:32.801073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fec830ca-c346-4062-a7f9-f44c1336f78e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:32.810264 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fec830ca-c346-4062-a7f9-f44c1336f78e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1505 microversion: 2.1 time: 0.755410 Aug 04 17:14:32.810876 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2336/4600] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:32 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1505 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:32.817456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d619a310-8ed8-4eb3-8c61-7e1c322af940 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:32.818107 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d619a310-8ed8-4eb3-8c61-7e1c322af940 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 0c74445a-b3fe-4d2a-9dd3-43ab834d369a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:32.827762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:32.840010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d619a310-8ed8-4eb3-8c61-7e1c322af940 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:32.840524 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d619a310-8ed8-4eb3-8c61-7e1c322af940 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:32.841031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d619a310-8ed8-4eb3-8c61-7e1c322af940 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:32.846566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d619a310-8ed8-4eb3-8c61-7e1c322af940 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:32.847095 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d619a310-8ed8-4eb3-8c61-7e1c322af940 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:32.847553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d619a310-8ed8-4eb3-8c61-7e1c322af940 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:32.875739 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-d619a310-8ed8-4eb3-8c61-7e1c322af940 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] HTTP exception thrown: Instance 0c74445a-b3fe-4d2a-9dd3-43ab834d369a could not be found. Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d619a310-8ed8-4eb3-8c61-7e1c322af940 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Request method failure captured: Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a HTTP/1.1 Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_1KcpG4juUr2VEfzShlgrBBMonXazIZnBtgobublSG0FrbL-f6glawbXIezuRVmeGIpCPKZ2_FVYi6XXX8bEGfzlmqPmHXf6Tacw6jDfV9QuP1xJWCSlbaybEtYK4vIloCt34qv4iEL4IzCpH1AIgjNgga3059ie-t_wAucPvDkWig Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 50d2f7cd670340adb1b4187754e302c5 Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1121530457 Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/50d2f7cd670340adb1b4187754e302c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/50d2f7cd670340adb1b4187754e302c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_50d2f7cd670340adb1b4187754e302c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/50d2f7cd670340adb1b4187754e302c5"}]}] Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1121530457 Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 50d2f7cd670340adb1b4187754e302c5 Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1121530457 Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerRescueNegativeTestJSON-1121530457-project Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 067e98d624234a48bb0ea3bde77c049c Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1121530457-project Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 0c74445a-b3fe-4d2a-9dd3-43ab834d369a could not be found. Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '0c74445a-b3fe-4d2a-9dd3-43ab834d369a'} Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c74445a-b3fe-4d2a-9dd3-43ab834d369a could not be found. Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c74445a-b3fe-4d2a-9dd3-43ab834d369a could not be found. Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:14:32.883021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:14:32.889816 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:14:32.889816 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:14:32.889816 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:14:32.889816 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:14:32.889816 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:14:32.889816 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:14:32.889816 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c74445a-b3fe-4d2a-9dd3-43ab834d369a could not be found. Aug 04 17:14:32.889816 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:14:32.889816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d619a310-8ed8-4eb3-8c61-7e1c322af940 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Returning 404 to user: Instance 0c74445a-b3fe-4d2a-9dd3-43ab834d369a could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:14:32.889816 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d619a310-8ed8-4eb3-8c61-7e1c322af940 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a" status: 404 len: 111 microversion: 2.1 time: 0.072777 Aug 04 17:14:32.889816 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2337/4601] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:32 2022] GET /compute/v2.1/servers/0c74445a-b3fe-4d2a-9dd3-43ab834d369a => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:14:32.902942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-51a5d428-744b-4414-8727-9353bdb9dbdb tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '.version_select at 0x7f1e5ab05280>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:32.945098 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-51a5d428-744b-4414-8727-9353bdb9dbdb tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-68181367" status: 202 len: 0 microversion: 2.1 time: 0.045829 Aug 04 17:14:32.945755 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2338/4602] 10.222.0.93 () {58 vars in 1215 bytes} [Thu Aug 4 17:14:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-68181367 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:14:32.974044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-adb56a6e-8b4d-405e-966c-3be831f3d590 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:32.974678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-adb56a6e-8b4d-405e-966c-3be831f3d590 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b27bb91b-1dab-4d8a-b388-09b2427931a9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:32.991910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-adb56a6e-8b4d-405e-966c-3be831f3d590 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:32.992674 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-adb56a6e-8b4d-405e-966c-3be831f3d590 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:32.993290 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-adb56a6e-8b4d-405e-966c-3be831f3d590 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:32.994237 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-adb56a6e-8b4d-405e-966c-3be831f3d590 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:32.994713 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-adb56a6e-8b4d-405e-966c-3be831f3d590 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:32.995274 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-adb56a6e-8b4d-405e-966c-3be831f3d590 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:33.174422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5100bfec-873c-4d86-8578-ed1cac00fcac tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:33.232069 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5100bfec-873c-4d86-8578-ed1cac00fcac tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:33.234641 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5100bfec-873c-4d86-8578-ed1cac00fcac tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:33.235974 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5100bfec-873c-4d86-8578-ed1cac00fcac tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1809 microversion: 2.20 time: 0.495232 Aug 04 17:14:33.236557 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2265/4603] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:32 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1809 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:14:33.364071 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-adb56a6e-8b4d-405e-966c-3be831f3d590 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:33.373731 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-adb56a6e-8b4d-405e-966c-3be831f3d590 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9" status: 200 len: 1309 microversion: 2.1 time: 0.404830 Aug 04 17:14:33.379781 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2339/4604] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:32 2022] GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9 => generated 1309 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:14:33.760123 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3a880ebf-525c-445e-ab2a-def9268ebfae tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:33.760898 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3a880ebf-525c-445e-ab2a-def9268ebfae tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 134ac071-c06f-4195-9405-37e71e6d08a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:33.770426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:33.775756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a880ebf-525c-445e-ab2a-def9268ebfae tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:33.778841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a880ebf-525c-445e-ab2a-def9268ebfae tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:33.780671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a880ebf-525c-445e-ab2a-def9268ebfae tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:33.782506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a880ebf-525c-445e-ab2a-def9268ebfae tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:33.784885 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a880ebf-525c-445e-ab2a-def9268ebfae tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:33.785347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a880ebf-525c-445e-ab2a-def9268ebfae tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:33.793558 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:33.835541 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4e74ff35-4b25-4a48-8cd3-d1d4ac7c9683 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:33.836550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4e74ff35-4b25-4a48-8cd3-d1d4ac7c9683 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:33.845712 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e74ff35-4b25-4a48-8cd3-d1d4ac7c9683 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:33.849351 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e74ff35-4b25-4a48-8cd3-d1d4ac7c9683 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:33.852091 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e74ff35-4b25-4a48-8cd3-d1d4ac7c9683 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:33.853089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e74ff35-4b25-4a48-8cd3-d1d4ac7c9683 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:33.853773 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e74ff35-4b25-4a48-8cd3-d1d4ac7c9683 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:33.857268 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e74ff35-4b25-4a48-8cd3-d1d4ac7c9683 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:34.247038 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:34.287323 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3a880ebf-525c-445e-ab2a-def9268ebfae tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:34.292610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4e74ff35-4b25-4a48-8cd3-d1d4ac7c9683 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:34.305717 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3a880ebf-525c-445e-ab2a-def9268ebfae tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9" status: 200 len: 1325 microversion: 2.1 time: 0.549847 Aug 04 17:14:34.306782 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4e74ff35-4b25-4a48-8cd3-d1d4ac7c9683 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1505 microversion: 2.1 time: 0.476096 Aug 04 17:14:34.318292 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2266/4605] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:33 2022] GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9 => generated 1325 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:34.318292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b613e2c4-f1cd-47ea-a7c3-e08ee10eadbd req-20e7160a-db10-48dc-8c82-74ab38470067 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9567ac7-9ee0-4ae3-b7c7-6033039de89d", "name": "network-vif-unplugged", "status": "completed", "tag": "aca16109-3001-402b-99ec-6923c19c2dfc"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:34.321000 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2340/4606] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:33 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1505 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:14:34.329499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-5327935b-226e-4117-be00-8b31750fc406 req-eca77fc5-b70b-4a68-bf94-9e4ecf50317c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b27bb91b-1dab-4d8a-b388-09b2427931a9", "tag": "bd052304-65d1-4a92-b871-4dde00c61773"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:34.331707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b613e2c4-f1cd-47ea-a7c3-e08ee10eadbd req-20e7160a-db10-48dc-8c82-74ab38470067 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:34.332418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b613e2c4-f1cd-47ea-a7c3-e08ee10eadbd req-20e7160a-db10-48dc-8c82-74ab38470067 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:34.332958 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b613e2c4-f1cd-47ea-a7c3-e08ee10eadbd req-20e7160a-db10-48dc-8c82-74ab38470067 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:34.342970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-5327935b-226e-4117-be00-8b31750fc406 req-eca77fc5-b70b-4a68-bf94-9e4ecf50317c service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:34.343463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-5327935b-226e-4117-be00-8b31750fc406 req-eca77fc5-b70b-4a68-bf94-9e4ecf50317c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:34.343899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-5327935b-226e-4117-be00-8b31750fc406 req-eca77fc5-b70b-4a68-bf94-9e4ecf50317c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:34.356222 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-5327935b-226e-4117-be00-8b31750fc406 req-eca77fc5-b70b-4a68-bf94-9e4ecf50317c service nova] Creating event network-changed:bd052304-65d1-4a92-b871-4dde00c61773 for instance b27bb91b-1dab-4d8a-b388-09b2427931a9 on n-h1-851359-3 Aug 04 17:14:34.362269 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b613e2c4-f1cd-47ea-a7c3-e08ee10eadbd req-20e7160a-db10-48dc-8c82-74ab38470067 service nova] Creating event network-vif-unplugged:aca16109-3001-402b-99ec-6923c19c2dfc for instance a9567ac7-9ee0-4ae3-b7c7-6033039de89d on n-h2-851359-3 Aug 04 17:14:34.362719 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-5327935b-226e-4117-be00-8b31750fc406 req-eca77fc5-b70b-4a68-bf94-9e4ecf50317c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038306 Aug 04 17:14:34.363824 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2341/4607] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:14:34.371146 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c2b26362-1c58-410d-a0a6-251ff0436fbe tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:34.371635 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b613e2c4-f1cd-47ea-a7c3-e08ee10eadbd req-20e7160a-db10-48dc-8c82-74ab38470067 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062786 Aug 04 17:14:34.371872 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c2b26362-1c58-410d-a0a6-251ff0436fbe tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:34.373168 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2267/4608] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:14:34.380447 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-85cb8ff7-a0f8-48f0-a54e-1bfa8152b4f9 req-1f505ce5-2d32-49e2-869b-b64916dfbf74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "134ac071-c06f-4195-9405-37e71e6d08a9", "tag": "0cab5fbd-8e6f-4623-a7d3-44f33d164fda"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:34.380954 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2b26362-1c58-410d-a0a6-251ff0436fbe tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:34.381482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2b26362-1c58-410d-a0a6-251ff0436fbe tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:34.382069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2b26362-1c58-410d-a0a6-251ff0436fbe tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:34.382900 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2b26362-1c58-410d-a0a6-251ff0436fbe tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:34.383528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2b26362-1c58-410d-a0a6-251ff0436fbe tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:34.384028 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2b26362-1c58-410d-a0a6-251ff0436fbe tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:34.395988 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-85cb8ff7-a0f8-48f0-a54e-1bfa8152b4f9 req-1f505ce5-2d32-49e2-869b-b64916dfbf74 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:34.397052 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-85cb8ff7-a0f8-48f0-a54e-1bfa8152b4f9 req-1f505ce5-2d32-49e2-869b-b64916dfbf74 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:34.397710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-85cb8ff7-a0f8-48f0-a54e-1bfa8152b4f9 req-1f505ce5-2d32-49e2-869b-b64916dfbf74 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:34.416979 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-85cb8ff7-a0f8-48f0-a54e-1bfa8152b4f9 req-1f505ce5-2d32-49e2-869b-b64916dfbf74 service nova] Creating event network-changed:0cab5fbd-8e6f-4623-a7d3-44f33d164fda for instance 134ac071-c06f-4195-9405-37e71e6d08a9 on n-h1-851359-3 Aug 04 17:14:34.424021 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-85cb8ff7-a0f8-48f0-a54e-1bfa8152b4f9 req-1f505ce5-2d32-49e2-869b-b64916dfbf74 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049258 Aug 04 17:14:34.425347 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2268/4609] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:14:34.432781 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-61d57936-b22d-44ff-bb24-bbeb07477bf4 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:34.433774 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-61d57936-b22d-44ff-bb24-bbeb07477bf4 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b27bb91b-1dab-4d8a-b388-09b2427931a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:34.441668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-61d57936-b22d-44ff-bb24-bbeb07477bf4 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:34.442501 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-61d57936-b22d-44ff-bb24-bbeb07477bf4 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:34.443168 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-61d57936-b22d-44ff-bb24-bbeb07477bf4 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:34.444308 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-61d57936-b22d-44ff-bb24-bbeb07477bf4 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:34.445153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-61d57936-b22d-44ff-bb24-bbeb07477bf4 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:34.445707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-61d57936-b22d-44ff-bb24-bbeb07477bf4 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:34.476456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:34.714136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c2b26362-1c58-410d-a0a6-251ff0436fbe tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:34.716285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-61d57936-b22d-44ff-bb24-bbeb07477bf4 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:34.726028 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-61d57936-b22d-44ff-bb24-bbeb07477bf4 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9" status: 200 len: 1309 microversion: 2.1 time: 0.299187 Aug 04 17:14:34.726169 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c2b26362-1c58-410d-a0a6-251ff0436fbe tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:34.726658 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2269/4610] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:34 2022] GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9 => generated 1309 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:34.729142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c2b26362-1c58-410d-a0a6-251ff0436fbe tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:34.729528 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c2b26362-1c58-410d-a0a6-251ff0436fbe tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1809 microversion: 2.20 time: 0.364408 Aug 04 17:14:34.730114 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2342/4611] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:34 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1809 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:14:35.332321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-90b48444-9bc9-4a82-8dfc-76ca3b43ff64 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:35.334408 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-90b48444-9bc9-4a82-8dfc-76ca3b43ff64 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 134ac071-c06f-4195-9405-37e71e6d08a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:35.340784 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-20ac339a-4f52-4447-8d4c-5b50dcfe096a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:35.342938 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-20ac339a-4f52-4447-8d4c-5b50dcfe096a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:35.345115 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=10 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:35.351750 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90b48444-9bc9-4a82-8dfc-76ca3b43ff64 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:35.352865 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90b48444-9bc9-4a82-8dfc-76ca3b43ff64 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:35.355035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90b48444-9bc9-4a82-8dfc-76ca3b43ff64 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:35.355993 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90b48444-9bc9-4a82-8dfc-76ca3b43ff64 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:35.357369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90b48444-9bc9-4a82-8dfc-76ca3b43ff64 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:35.358024 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90b48444-9bc9-4a82-8dfc-76ca3b43ff64 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:35.360550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20ac339a-4f52-4447-8d4c-5b50dcfe096a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:35.361955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20ac339a-4f52-4447-8d4c-5b50dcfe096a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:35.362593 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20ac339a-4f52-4447-8d4c-5b50dcfe096a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:35.364890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20ac339a-4f52-4447-8d4c-5b50dcfe096a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:35.365388 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20ac339a-4f52-4447-8d4c-5b50dcfe096a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:35.367649 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20ac339a-4f52-4447-8d4c-5b50dcfe096a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:35.427150 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:35.959302 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-20ac339a-4f52-4447-8d4c-5b50dcfe096a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:35.964208 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-90b48444-9bc9-4a82-8dfc-76ca3b43ff64 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:35.975833 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-90b48444-9bc9-4a82-8dfc-76ca3b43ff64 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9" status: 200 len: 1325 microversion: 2.1 time: 0.648415 Aug 04 17:14:35.976551 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-20ac339a-4f52-4447-8d4c-5b50dcfe096a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1505 microversion: 2.1 time: 0.639154 Aug 04 17:14:35.989661 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2270/4612] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:35 2022] GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9 => generated 1325 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:35.991301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-589ce32a-8e2f-4bc1-ad45-df7f5e78faad tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:35.991941 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-589ce32a-8e2f-4bc1-ad45-df7f5e78faad tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b27bb91b-1dab-4d8a-b388-09b2427931a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:35.992654 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2343/4613] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:35 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1505 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:35.999386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3743cda8-529c-4413-bf10-1d4227c99e8c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:36.000127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-589ce32a-8e2f-4bc1-ad45-df7f5e78faad tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:36.000267 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3743cda8-529c-4413-bf10-1d4227c99e8c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:36.000624 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-589ce32a-8e2f-4bc1-ad45-df7f5e78faad tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:36.001066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-589ce32a-8e2f-4bc1-ad45-df7f5e78faad tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:36.001783 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-589ce32a-8e2f-4bc1-ad45-df7f5e78faad tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:36.002272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-589ce32a-8e2f-4bc1-ad45-df7f5e78faad tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:36.002706 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-589ce32a-8e2f-4bc1-ad45-df7f5e78faad tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:36.009412 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3743cda8-529c-4413-bf10-1d4227c99e8c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:36.010160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3743cda8-529c-4413-bf10-1d4227c99e8c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:36.010714 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3743cda8-529c-4413-bf10-1d4227c99e8c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:36.011536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3743cda8-529c-4413-bf10-1d4227c99e8c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:36.012101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3743cda8-529c-4413-bf10-1d4227c99e8c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:36.012652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3743cda8-529c-4413-bf10-1d4227c99e8c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:36.345786 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3743cda8-529c-4413-bf10-1d4227c99e8c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:36.356316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3743cda8-529c-4413-bf10-1d4227c99e8c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:36.358252 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-589ce32a-8e2f-4bc1-ad45-df7f5e78faad tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:36.358789 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3743cda8-529c-4413-bf10-1d4227c99e8c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:36.360323 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3743cda8-529c-4413-bf10-1d4227c99e8c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1809 microversion: 2.20 time: 0.366507 Aug 04 17:14:36.361218 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2344/4614] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:35 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1809 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:14:36.382862 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-589ce32a-8e2f-4bc1-ad45-df7f5e78faad tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9" status: 200 len: 1309 microversion: 2.1 time: 0.404121 Aug 04 17:14:36.384326 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2271/4615] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:35 2022] GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9 => generated 1309 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:36.999371 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0847c174-0e35-43d4-88d4-c6d9615307ed tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:36.999994 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0847c174-0e35-43d4-88d4-c6d9615307ed tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:37.004744 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bbfab34a-2ac9-4831-a68e-c9fff59b4346 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:37.005374 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bbfab34a-2ac9-4831-a68e-c9fff59b4346 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 134ac071-c06f-4195-9405-37e71e6d08a9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:37.011658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bbfab34a-2ac9-4831-a68e-c9fff59b4346 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:37.012153 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bbfab34a-2ac9-4831-a68e-c9fff59b4346 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:37.012599 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bbfab34a-2ac9-4831-a68e-c9fff59b4346 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:37.013347 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bbfab34a-2ac9-4831-a68e-c9fff59b4346 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:37.013810 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bbfab34a-2ac9-4831-a68e-c9fff59b4346 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:37.014185 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0847c174-0e35-43d4-88d4-c6d9615307ed tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:37.014394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bbfab34a-2ac9-4831-a68e-c9fff59b4346 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:37.014694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0847c174-0e35-43d4-88d4-c6d9615307ed tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:37.015139 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0847c174-0e35-43d4-88d4-c6d9615307ed tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:37.015843 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0847c174-0e35-43d4-88d4-c6d9615307ed tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:37.016304 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0847c174-0e35-43d4-88d4-c6d9615307ed tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:37.016739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0847c174-0e35-43d4-88d4-c6d9615307ed tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:37.222528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bbfab34a-2ac9-4831-a68e-c9fff59b4346 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:37.226899 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0847c174-0e35-43d4-88d4-c6d9615307ed tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:37.230970 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bbfab34a-2ac9-4831-a68e-c9fff59b4346 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9" status: 200 len: 1325 microversion: 2.1 time: 0.237446 Aug 04 17:14:37.231655 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2345/4616] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:36 2022] GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9 => generated 1325 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:37.235724 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0847c174-0e35-43d4-88d4-c6d9615307ed tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1505 microversion: 2.1 time: 0.240709 Aug 04 17:14:37.236585 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2272/4617] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:36 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1505 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:37.388387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9ac6ebd2-b86a-4330-a600-2db3cae0474f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:37.389597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9ac6ebd2-b86a-4330-a600-2db3cae0474f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:37.396610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9ac6ebd2-b86a-4330-a600-2db3cae0474f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:37.397354 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9ac6ebd2-b86a-4330-a600-2db3cae0474f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:37.397798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9ac6ebd2-b86a-4330-a600-2db3cae0474f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:37.398705 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9ac6ebd2-b86a-4330-a600-2db3cae0474f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:37.399326 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9ac6ebd2-b86a-4330-a600-2db3cae0474f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:37.405070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-97868c04-6198-46c0-bbba-9b6e30f56aaf tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:37.405685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-97868c04-6198-46c0-bbba-9b6e30f56aaf tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b27bb91b-1dab-4d8a-b388-09b2427931a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:37.410644 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9ac6ebd2-b86a-4330-a600-2db3cae0474f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:37.417535 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97868c04-6198-46c0-bbba-9b6e30f56aaf tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:37.418091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97868c04-6198-46c0-bbba-9b6e30f56aaf tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:37.418529 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97868c04-6198-46c0-bbba-9b6e30f56aaf tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:37.419870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97868c04-6198-46c0-bbba-9b6e30f56aaf tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:37.420344 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97868c04-6198-46c0-bbba-9b6e30f56aaf tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:37.420776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97868c04-6198-46c0-bbba-9b6e30f56aaf tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:37.642855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9ac6ebd2-b86a-4330-a600-2db3cae0474f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:37.661420 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9ac6ebd2-b86a-4330-a600-2db3cae0474f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:37.666398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9ac6ebd2-b86a-4330-a600-2db3cae0474f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:37.667682 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9ac6ebd2-b86a-4330-a600-2db3cae0474f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1809 microversion: 2.20 time: 0.283606 Aug 04 17:14:37.668180 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-97868c04-6198-46c0-bbba-9b6e30f56aaf tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:37.676960 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2346/4618] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:37 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1809 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:14:37.685591 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-97868c04-6198-46c0-bbba-9b6e30f56aaf tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9" status: 200 len: 1309 microversion: 2.1 time: 0.284781 Aug 04 17:14:37.686242 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2273/4619] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:37 2022] GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9 => generated 1309 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:38.254939 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1f7e532e-4f0a-432c-b460-c7edeb315317 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:38.255940 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1f7e532e-4f0a-432c-b460-c7edeb315317 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 134ac071-c06f-4195-9405-37e71e6d08a9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:38.257275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-95bfb8bf-0507-41a0-9d4b-0ad96fd1d368 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:38.258061 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-95bfb8bf-0507-41a0-9d4b-0ad96fd1d368 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:38.263933 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f7e532e-4f0a-432c-b460-c7edeb315317 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:38.264476 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95bfb8bf-0507-41a0-9d4b-0ad96fd1d368 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:38.264962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f7e532e-4f0a-432c-b460-c7edeb315317 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:38.265250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95bfb8bf-0507-41a0-9d4b-0ad96fd1d368 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:38.265854 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f7e532e-4f0a-432c-b460-c7edeb315317 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:38.266370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95bfb8bf-0507-41a0-9d4b-0ad96fd1d368 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:38.267060 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f7e532e-4f0a-432c-b460-c7edeb315317 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:38.267172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95bfb8bf-0507-41a0-9d4b-0ad96fd1d368 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:38.267549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95bfb8bf-0507-41a0-9d4b-0ad96fd1d368 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:38.267977 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95bfb8bf-0507-41a0-9d4b-0ad96fd1d368 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:38.268281 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f7e532e-4f0a-432c-b460-c7edeb315317 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:38.268927 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f7e532e-4f0a-432c-b460-c7edeb315317 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:38.545541 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1f7e532e-4f0a-432c-b460-c7edeb315317 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:38.556766 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1f7e532e-4f0a-432c-b460-c7edeb315317 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9" status: 200 len: 1325 microversion: 2.1 time: 0.307114 Aug 04 17:14:38.559186 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2347/4620] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:38 2022] GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9 => generated 1325 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:38.561557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-95bfb8bf-0507-41a0-9d4b-0ad96fd1d368 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:38.575248 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-95bfb8bf-0507-41a0-9d4b-0ad96fd1d368 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1505 microversion: 2.1 time: 0.322222 Aug 04 17:14:38.578309 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2274/4621] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:38 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1505 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:38.736510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a0fe73e8-a52f-4f21-bdd7-491d1730ee4d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:38.737492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a0fe73e8-a52f-4f21-bdd7-491d1730ee4d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:38.739998 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a9329373-3af0-4339-9870-052f2ec804c9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:38.740920 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a9329373-3af0-4339-9870-052f2ec804c9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b27bb91b-1dab-4d8a-b388-09b2427931a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:38.744720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a0fe73e8-a52f-4f21-bdd7-491d1730ee4d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:38.745348 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a0fe73e8-a52f-4f21-bdd7-491d1730ee4d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:38.745894 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a0fe73e8-a52f-4f21-bdd7-491d1730ee4d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:38.746728 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a0fe73e8-a52f-4f21-bdd7-491d1730ee4d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:38.747340 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a0fe73e8-a52f-4f21-bdd7-491d1730ee4d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:38.748016 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a0fe73e8-a52f-4f21-bdd7-491d1730ee4d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:38.750768 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9329373-3af0-4339-9870-052f2ec804c9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:38.752081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9329373-3af0-4339-9870-052f2ec804c9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:38.752836 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9329373-3af0-4339-9870-052f2ec804c9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:38.753707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9329373-3af0-4339-9870-052f2ec804c9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:38.754355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9329373-3af0-4339-9870-052f2ec804c9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:38.754929 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9329373-3af0-4339-9870-052f2ec804c9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:38.990615 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a9329373-3af0-4339-9870-052f2ec804c9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:38.998062 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a9329373-3af0-4339-9870-052f2ec804c9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9" status: 200 len: 1309 microversion: 2.1 time: 0.261852 Aug 04 17:14:39.010209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a0fe73e8-a52f-4f21-bdd7-491d1730ee4d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:39.010865 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2275/4622] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:38 2022] GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9 => generated 1309 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:39.014944 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a0fe73e8-a52f-4f21-bdd7-491d1730ee4d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:39.016600 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a0fe73e8-a52f-4f21-bdd7-491d1730ee4d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:39.017966 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a0fe73e8-a52f-4f21-bdd7-491d1730ee4d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1809 microversion: 2.20 time: 0.286961 Aug 04 17:14:39.020690 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2348/4623] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:38 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1809 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:14:39.580008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2159a729-785c-43dc-943e-766a61b11248 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:39.581175 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2159a729-785c-43dc-943e-766a61b11248 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 134ac071-c06f-4195-9405-37e71e6d08a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:39.588774 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2159a729-785c-43dc-943e-766a61b11248 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:39.589270 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2159a729-785c-43dc-943e-766a61b11248 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:39.606397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9f4e19d2-822b-48b6-8680-3409bbc20fee tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:39.608588 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9f4e19d2-822b-48b6-8680-3409bbc20fee tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:39.614211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2159a729-785c-43dc-943e-766a61b11248 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:39.616410 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2159a729-785c-43dc-943e-766a61b11248 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:39.617104 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2159a729-785c-43dc-943e-766a61b11248 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:39.618881 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2159a729-785c-43dc-943e-766a61b11248 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:39.624010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f4e19d2-822b-48b6-8680-3409bbc20fee tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:39.625949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f4e19d2-822b-48b6-8680-3409bbc20fee tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:39.626580 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f4e19d2-822b-48b6-8680-3409bbc20fee tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:39.627465 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f4e19d2-822b-48b6-8680-3409bbc20fee tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:39.628768 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f4e19d2-822b-48b6-8680-3409bbc20fee tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:39.629378 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f4e19d2-822b-48b6-8680-3409bbc20fee tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:39.850691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2159a729-785c-43dc-943e-766a61b11248 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:39.862935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9f4e19d2-822b-48b6-8680-3409bbc20fee tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:39.864108 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2159a729-785c-43dc-943e-766a61b11248 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9" status: 200 len: 1325 microversion: 2.1 time: 0.287821 Aug 04 17:14:39.865370 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2276/4624] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:39 2022] GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9 => generated 1325 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:39.870405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-9d0649af-90a6-49b7-81c5-a02a5834893f req-08069355-2a76-47d5-863d-e32159272284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b27bb91b-1dab-4d8a-b388-09b2427931a9", "name": "network-vif-plugged", "status": "completed", "tag": "bd052304-65d1-4a92-b871-4dde00c61773"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:39.881454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9d0649af-90a6-49b7-81c5-a02a5834893f req-08069355-2a76-47d5-863d-e32159272284 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:39.882209 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9d0649af-90a6-49b7-81c5-a02a5834893f req-08069355-2a76-47d5-863d-e32159272284 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:39.882918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9d0649af-90a6-49b7-81c5-a02a5834893f req-08069355-2a76-47d5-863d-e32159272284 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:39.885996 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9f4e19d2-822b-48b6-8680-3409bbc20fee tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1505 microversion: 2.1 time: 0.293029 Aug 04 17:14:39.895185 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-9d0649af-90a6-49b7-81c5-a02a5834893f req-08069355-2a76-47d5-863d-e32159272284 service nova] Creating event network-vif-plugged:bd052304-65d1-4a92-b871-4dde00c61773 for instance b27bb91b-1dab-4d8a-b388-09b2427931a9 on n-h1-851359-3 Aug 04 17:14:39.899933 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-9d0649af-90a6-49b7-81c5-a02a5834893f req-08069355-2a76-47d5-863d-e32159272284 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033159 Aug 04 17:14:39.900389 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2349/4625] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:39 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1505 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:39.900648 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2277/4626] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:14:40.020165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-92c40e33-fa15-4527-9795-90304e8dafeb tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:40.021114 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-92c40e33-fa15-4527-9795-90304e8dafeb tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b27bb91b-1dab-4d8a-b388-09b2427931a9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:40.028373 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92c40e33-fa15-4527-9795-90304e8dafeb tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:40.029475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92c40e33-fa15-4527-9795-90304e8dafeb tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:40.030097 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92c40e33-fa15-4527-9795-90304e8dafeb tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:40.030714 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92c40e33-fa15-4527-9795-90304e8dafeb tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:40.031191 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92c40e33-fa15-4527-9795-90304e8dafeb tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:40.031755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92c40e33-fa15-4527-9795-90304e8dafeb tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:40.045738 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d6841996-8792-4405-98a7-0c539519b715 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:40.046769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d6841996-8792-4405-98a7-0c539519b715 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:40.062795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6841996-8792-4405-98a7-0c539519b715 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:40.065560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6841996-8792-4405-98a7-0c539519b715 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:40.066405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6841996-8792-4405-98a7-0c539519b715 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:40.071817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6841996-8792-4405-98a7-0c539519b715 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:40.072500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6841996-8792-4405-98a7-0c539519b715 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:40.073113 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6841996-8792-4405-98a7-0c539519b715 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:40.385723 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-92c40e33-fa15-4527-9795-90304e8dafeb tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:40.400049 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-92c40e33-fa15-4527-9795-90304e8dafeb tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9" status: 200 len: 1309 microversion: 2.1 time: 0.384241 Aug 04 17:14:40.413774 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2350/4627] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:40 2022] GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9 => generated 1309 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:40.472222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d6841996-8792-4405-98a7-0c539519b715 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:40.492106 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d6841996-8792-4405-98a7-0c539519b715 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:40.494445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d6841996-8792-4405-98a7-0c539519b715 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:40.496130 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d6841996-8792-4405-98a7-0c539519b715 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1809 microversion: 2.20 time: 0.455638 Aug 04 17:14:40.511008 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2278/4628] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:40 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1809 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:14:40.885450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-126e9a65-bfd1-425b-a19d-d0941cda3a9e tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:40.886789 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-126e9a65-bfd1-425b-a19d-d0941cda3a9e tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 134ac071-c06f-4195-9405-37e71e6d08a9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:40.895448 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-126e9a65-bfd1-425b-a19d-d0941cda3a9e tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:40.896265 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-126e9a65-bfd1-425b-a19d-d0941cda3a9e tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:40.896921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-126e9a65-bfd1-425b-a19d-d0941cda3a9e tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:40.898110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-126e9a65-bfd1-425b-a19d-d0941cda3a9e tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:40.898798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-126e9a65-bfd1-425b-a19d-d0941cda3a9e tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:40.899506 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-126e9a65-bfd1-425b-a19d-d0941cda3a9e tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:40.907362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-58ef7f3e-be00-4956-9e12-6a88439582dc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:40.908625 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-58ef7f3e-be00-4956-9e12-6a88439582dc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:40.925039 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58ef7f3e-be00-4956-9e12-6a88439582dc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:40.925930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58ef7f3e-be00-4956-9e12-6a88439582dc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:40.927637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58ef7f3e-be00-4956-9e12-6a88439582dc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:40.928909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58ef7f3e-be00-4956-9e12-6a88439582dc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:40.929630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58ef7f3e-be00-4956-9e12-6a88439582dc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:40.930317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58ef7f3e-be00-4956-9e12-6a88439582dc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:41.165428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-126e9a65-bfd1-425b-a19d-d0941cda3a9e tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:41.168036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-58ef7f3e-be00-4956-9e12-6a88439582dc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:41.177101 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-58ef7f3e-be00-4956-9e12-6a88439582dc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1505 microversion: 2.1 time: 0.273599 Aug 04 17:14:41.190041 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2279/4629] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:40 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1505 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:14:41.192776 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-126e9a65-bfd1-425b-a19d-d0941cda3a9e tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9" status: 200 len: 1325 microversion: 2.1 time: 0.311556 Aug 04 17:14:41.194801 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2351/4630] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:40 2022] GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9 => generated 1325 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:41.254607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-86f0de29-d2c8-4bad-b41d-f3f2a167668d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:41.255224 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-86f0de29-d2c8-4bad-b41d-f3f2a167668d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:41.263370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86f0de29-d2c8-4bad-b41d-f3f2a167668d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:41.264013 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86f0de29-d2c8-4bad-b41d-f3f2a167668d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:41.264725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86f0de29-d2c8-4bad-b41d-f3f2a167668d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:41.265998 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86f0de29-d2c8-4bad-b41d-f3f2a167668d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:41.267231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86f0de29-d2c8-4bad-b41d-f3f2a167668d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:41.268076 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86f0de29-d2c8-4bad-b41d-f3f2a167668d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:41.313435 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-86f0de29-d2c8-4bad-b41d-f3f2a167668d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:14:41.422209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2159aa55-0919-497c-a5a4-3f927e7b0cc7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:41.423216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2159aa55-0919-497c-a5a4-3f927e7b0cc7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b27bb91b-1dab-4d8a-b388-09b2427931a9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:41.440364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2159aa55-0919-497c-a5a4-3f927e7b0cc7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:41.442208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2159aa55-0919-497c-a5a4-3f927e7b0cc7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:41.444910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2159aa55-0919-497c-a5a4-3f927e7b0cc7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:41.448284 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2159aa55-0919-497c-a5a4-3f927e7b0cc7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:41.450744 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2159aa55-0919-497c-a5a4-3f927e7b0cc7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:41.451893 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2159aa55-0919-497c-a5a4-3f927e7b0cc7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:41.458075 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-86f0de29-d2c8-4bad-b41d-f3f2a167668d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 204 len: 0 microversion: 2.1 time: 0.206830 Aug 04 17:14:41.458260 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2280/4631] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:14:41 2022] DELETE /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:14:41.469183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9e4f34e1-7457-45f8-9288-fc0add27cbba tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:41.469924 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9e4f34e1-7457-45f8-9288-fc0add27cbba tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:41.480633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e4f34e1-7457-45f8-9288-fc0add27cbba tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:41.481134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e4f34e1-7457-45f8-9288-fc0add27cbba tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:41.482154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e4f34e1-7457-45f8-9288-fc0add27cbba tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:41.482875 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e4f34e1-7457-45f8-9288-fc0add27cbba tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:41.487582 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e4f34e1-7457-45f8-9288-fc0add27cbba tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:41.488047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e4f34e1-7457-45f8-9288-fc0add27cbba tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:41.832728 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2159aa55-0919-497c-a5a4-3f927e7b0cc7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:41.842930 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2159aa55-0919-497c-a5a4-3f927e7b0cc7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9" status: 200 len: 1309 microversion: 2.1 time: 0.426359 Aug 04 17:14:41.848538 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2352/4632] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:41 2022] GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9 => generated 1309 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:14:41.855348 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-af5aa46b-9506-4cc8-9b52-09715d186ed2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:41.855974 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-af5aa46b-9506-4cc8-9b52-09715d186ed2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:41.863655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af5aa46b-9506-4cc8-9b52-09715d186ed2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:41.864441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af5aa46b-9506-4cc8-9b52-09715d186ed2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:41.864825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af5aa46b-9506-4cc8-9b52-09715d186ed2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:41.865709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af5aa46b-9506-4cc8-9b52-09715d186ed2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:41.866603 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af5aa46b-9506-4cc8-9b52-09715d186ed2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:41.867045 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af5aa46b-9506-4cc8-9b52-09715d186ed2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:41.912377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9e4f34e1-7457-45f8-9288-fc0add27cbba tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:41.923693 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9e4f34e1-7457-45f8-9288-fc0add27cbba tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1506 microversion: 2.1 time: 0.460625 Aug 04 17:14:41.925228 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2281/4633] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:41 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1506 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:14:41.931017 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-8b9be112-2fc2-4781-b03d-4cca1f665955 req-2ef1272e-1cd6-429e-8981-de7c6b3f5976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "134ac071-c06f-4195-9405-37e71e6d08a9", "name": "network-vif-plugged", "status": "completed", "tag": "0cab5fbd-8e6f-4623-a7d3-44f33d164fda"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:41.943716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8b9be112-2fc2-4781-b03d-4cca1f665955 req-2ef1272e-1cd6-429e-8981-de7c6b3f5976 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:41.944518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8b9be112-2fc2-4781-b03d-4cca1f665955 req-2ef1272e-1cd6-429e-8981-de7c6b3f5976 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:41.945643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8b9be112-2fc2-4781-b03d-4cca1f665955 req-2ef1272e-1cd6-429e-8981-de7c6b3f5976 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:41.960790 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-8b9be112-2fc2-4781-b03d-4cca1f665955 req-2ef1272e-1cd6-429e-8981-de7c6b3f5976 service nova] Creating event network-vif-plugged:0cab5fbd-8e6f-4623-a7d3-44f33d164fda for instance 134ac071-c06f-4195-9405-37e71e6d08a9 on n-h1-851359-3 Aug 04 17:14:41.967751 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-8b9be112-2fc2-4781-b03d-4cca1f665955 req-2ef1272e-1cd6-429e-8981-de7c6b3f5976 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040734 Aug 04 17:14:41.968725 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2282/4634] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:14:42.040136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-af5aa46b-9506-4cc8-9b52-09715d186ed2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:42.050389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-af5aa46b-9506-4cc8-9b52-09715d186ed2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:42.051998 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-af5aa46b-9506-4cc8-9b52-09715d186ed2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:42.053248 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-af5aa46b-9506-4cc8-9b52-09715d186ed2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1809 microversion: 2.20 time: 0.203700 Aug 04 17:14:42.053886 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2353/4635] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:41 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:14:42.203159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1659e247-bd33-40e3-9528-8691ec56c771 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:42.203875 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1659e247-bd33-40e3-9528-8691ec56c771 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:42.210063 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1659e247-bd33-40e3-9528-8691ec56c771 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:42.210553 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1659e247-bd33-40e3-9528-8691ec56c771 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:42.210993 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1659e247-bd33-40e3-9528-8691ec56c771 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:42.211690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1659e247-bd33-40e3-9528-8691ec56c771 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:42.212149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1659e247-bd33-40e3-9528-8691ec56c771 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:42.212579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1659e247-bd33-40e3-9528-8691ec56c771 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:42.213903 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-04ac1722-0cdb-4329-bfe0-7e3755318563 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:42.214560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-04ac1722-0cdb-4329-bfe0-7e3755318563 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 134ac071-c06f-4195-9405-37e71e6d08a9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:42.221907 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-04ac1722-0cdb-4329-bfe0-7e3755318563 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:42.222492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-04ac1722-0cdb-4329-bfe0-7e3755318563 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:42.223127 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-04ac1722-0cdb-4329-bfe0-7e3755318563 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:42.224346 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-04ac1722-0cdb-4329-bfe0-7e3755318563 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:42.224993 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-04ac1722-0cdb-4329-bfe0-7e3755318563 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:42.225444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-04ac1722-0cdb-4329-bfe0-7e3755318563 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:42.455347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1659e247-bd33-40e3-9528-8691ec56c771 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:42.459796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-04ac1722-0cdb-4329-bfe0-7e3755318563 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:42.464925 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1659e247-bd33-40e3-9528-8691ec56c771 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 200 len: 1508 microversion: 2.1 time: 0.266057 Aug 04 17:14:42.467063 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2283/4636] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:42 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 1508 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:42.468624 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-04ac1722-0cdb-4329-bfe0-7e3755318563 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9" status: 200 len: 1325 microversion: 2.1 time: 0.258452 Aug 04 17:14:42.469296 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2354/4637] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:42 2022] GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9 => generated 1325 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:14:42.491476 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d4e1e07b-a37b-4f7a-aec8-9a5b8cd417e4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:42.492097 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d4e1e07b-a37b-4f7a-aec8-9a5b8cd417e4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:42.498251 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4e1e07b-a37b-4f7a-aec8-9a5b8cd417e4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:42.498736 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4e1e07b-a37b-4f7a-aec8-9a5b8cd417e4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:42.499171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4e1e07b-a37b-4f7a-aec8-9a5b8cd417e4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:42.499865 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4e1e07b-a37b-4f7a-aec8-9a5b8cd417e4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:42.500319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4e1e07b-a37b-4f7a-aec8-9a5b8cd417e4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:42.500747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4e1e07b-a37b-4f7a-aec8-9a5b8cd417e4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:42.650780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d4e1e07b-a37b-4f7a-aec8-9a5b8cd417e4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:42.659110 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d4e1e07b-a37b-4f7a-aec8-9a5b8cd417e4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.171419 Aug 04 17:14:42.659707 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2284/4638] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:42 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:42.689184 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fec7f5e7-4aa2-4704-8098-3ff3d3886704 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:42.689799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fec7f5e7-4aa2-4704-8098-3ff3d3886704 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:42.696135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fec7f5e7-4aa2-4704-8098-3ff3d3886704 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:42.696627 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fec7f5e7-4aa2-4704-8098-3ff3d3886704 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:42.697067 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fec7f5e7-4aa2-4704-8098-3ff3d3886704 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:42.697779 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fec7f5e7-4aa2-4704-8098-3ff3d3886704 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:42.698284 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fec7f5e7-4aa2-4704-8098-3ff3d3886704 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:42.698943 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fec7f5e7-4aa2-4704-8098-3ff3d3886704 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:42.846400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fec7f5e7-4aa2-4704-8098-3ff3d3886704 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:42.854554 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fec7f5e7-4aa2-4704-8098-3ff3d3886704 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.169667 Aug 04 17:14:42.855151 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2355/4639] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:42 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:42.866216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d02f366d-743d-460b-aef9-8bd9692bbde3 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:42.866216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d02f366d-743d-460b-aef9-8bd9692bbde3 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b27bb91b-1dab-4d8a-b388-09b2427931a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:42.871479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d02f366d-743d-460b-aef9-8bd9692bbde3 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:42.872201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d02f366d-743d-460b-aef9-8bd9692bbde3 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:42.872780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d02f366d-743d-460b-aef9-8bd9692bbde3 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:42.873589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d02f366d-743d-460b-aef9-8bd9692bbde3 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:42.874196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d02f366d-743d-460b-aef9-8bd9692bbde3 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:42.874724 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d02f366d-743d-460b-aef9-8bd9692bbde3 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:42.876079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6a58cc48-789c-4e0f-ae32-5f2f4489c4e9 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:42.877142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6a58cc48-789c-4e0f-ae32-5f2f4489c4e9 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:42.885863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a58cc48-789c-4e0f-ae32-5f2f4489c4e9 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:42.886432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a58cc48-789c-4e0f-ae32-5f2f4489c4e9 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:42.887210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a58cc48-789c-4e0f-ae32-5f2f4489c4e9 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:42.888724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a58cc48-789c-4e0f-ae32-5f2f4489c4e9 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:42.889685 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a58cc48-789c-4e0f-ae32-5f2f4489c4e9 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:42.890325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a58cc48-789c-4e0f-ae32-5f2f4489c4e9 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:43.098810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d02f366d-743d-460b-aef9-8bd9692bbde3 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:43.103521 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:43.109546 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d02f366d-743d-460b-aef9-8bd9692bbde3 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9" status: 200 len: 1490 microversion: 2.1 time: 0.249637 Aug 04 17:14:43.113378 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6a58cc48-789c-4e0f-ae32-5f2f4489c4e9 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:43.114122 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2285/4640] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:42 2022] GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9 => generated 1490 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:14:43.116584 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-00e08c8f-1548-421b-bbcc-af45d7940635 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:43.117328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-00e08c8f-1548-421b-bbcc-af45d7940635 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:43.126892 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00e08c8f-1548-421b-bbcc-af45d7940635 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:43.127563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00e08c8f-1548-421b-bbcc-af45d7940635 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:43.127802 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6a58cc48-789c-4e0f-ae32-5f2f4489c4e9 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.255615 Aug 04 17:14:43.128241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00e08c8f-1548-421b-bbcc-af45d7940635 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:43.129046 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2356/4641] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:42 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:14:43.129181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00e08c8f-1548-421b-bbcc-af45d7940635 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:43.132189 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00e08c8f-1548-421b-bbcc-af45d7940635 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:43.132189 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00e08c8f-1548-421b-bbcc-af45d7940635 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:43.138518 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ed6befbb-9ce2-47b8-b030-f5ba68342c63 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:43.139636 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ed6befbb-9ce2-47b8-b030-f5ba68342c63 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:43.150789 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed6befbb-9ce2-47b8-b030-f5ba68342c63 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:43.151606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed6befbb-9ce2-47b8-b030-f5ba68342c63 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:43.152326 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed6befbb-9ce2-47b8-b030-f5ba68342c63 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:43.153592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed6befbb-9ce2-47b8-b030-f5ba68342c63 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:43.154527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed6befbb-9ce2-47b8-b030-f5ba68342c63 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:43.155562 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed6befbb-9ce2-47b8-b030-f5ba68342c63 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:43.357856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ed6befbb-9ce2-47b8-b030-f5ba68342c63 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:43.369079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ed6befbb-9ce2-47b8-b030-f5ba68342c63 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:43.370962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ed6befbb-9ce2-47b8-b030-f5ba68342c63 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:43.373501 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ed6befbb-9ce2-47b8-b030-f5ba68342c63 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1809 microversion: 2.20 time: 0.243279 Aug 04 17:14:43.374248 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2357/4642] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:43 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1809 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:14:43.379015 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-86837c5a-9bef-4707-889f-5db1e4fa9a68 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:43.379753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-86837c5a-9bef-4707-889f-5db1e4fa9a68 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: edc8a6ac-f4f5-496f-867e-27b1ed15c833] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:43.386311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86837c5a-9bef-4707-889f-5db1e4fa9a68 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:43.386965 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86837c5a-9bef-4707-889f-5db1e4fa9a68 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:43.387517 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86837c5a-9bef-4707-889f-5db1e4fa9a68 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:43.389226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86837c5a-9bef-4707-889f-5db1e4fa9a68 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:43.389808 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86837c5a-9bef-4707-889f-5db1e4fa9a68 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:43.390380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86837c5a-9bef-4707-889f-5db1e4fa9a68 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:43.616280 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-86837c5a-9bef-4707-889f-5db1e4fa9a68 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:43.624669 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-86837c5a-9bef-4707-889f-5db1e4fa9a68 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833" status: 200 len: 1491 microversion: 2.1 time: 0.249319 Aug 04 17:14:43.634177 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2358/4643] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:43 2022] GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833 => generated 1491 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:43.642676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-00e08c8f-1548-421b-bbcc-af45d7940635 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:43.644814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-eec64679-0df9-4250-a659-b51bafd2f142 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:43.645440 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-eec64679-0df9-4250-a659-b51bafd2f142 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:43.651042 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-00e08c8f-1548-421b-bbcc-af45d7940635 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1506 microversion: 2.1 time: 0.539235 Aug 04 17:14:43.651510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eec64679-0df9-4250-a659-b51bafd2f142 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:43.651640 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2286/4644] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:43 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1506 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:43.652000 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eec64679-0df9-4250-a659-b51bafd2f142 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:43.652443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eec64679-0df9-4250-a659-b51bafd2f142 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:43.653272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eec64679-0df9-4250-a659-b51bafd2f142 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:43.654389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eec64679-0df9-4250-a659-b51bafd2f142 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:43.654820 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eec64679-0df9-4250-a659-b51bafd2f142 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:43.656828 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bcc49dc3-aaea-462c-9a9e-ea63936dc7a8 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:43.657444 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bcc49dc3-aaea-462c-9a9e-ea63936dc7a8 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 134ac071-c06f-4195-9405-37e71e6d08a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:43.663714 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bcc49dc3-aaea-462c-9a9e-ea63936dc7a8 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:43.664210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bcc49dc3-aaea-462c-9a9e-ea63936dc7a8 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:43.664655 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bcc49dc3-aaea-462c-9a9e-ea63936dc7a8 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:43.665357 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bcc49dc3-aaea-462c-9a9e-ea63936dc7a8 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:43.665814 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bcc49dc3-aaea-462c-9a9e-ea63936dc7a8 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:43.667195 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bcc49dc3-aaea-462c-9a9e-ea63936dc7a8 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:43.868413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-eec64679-0df9-4250-a659-b51bafd2f142 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:43.878487 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-eec64679-0df9-4250-a659-b51bafd2f142 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.243201 Aug 04 17:14:43.879270 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2359/4645] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:43 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:43.904620 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-99b610ee-ebf8-4bbf-8051-15da5c870e0a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:43.905501 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-99b610ee-ebf8-4bbf-8051-15da5c870e0a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b27bb91b-1dab-4d8a-b388-09b2427931a9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:43.910746 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bcc49dc3-aaea-462c-9a9e-ea63936dc7a8 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:43.921266 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bcc49dc3-aaea-462c-9a9e-ea63936dc7a8 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9" status: 200 len: 1521 microversion: 2.1 time: 0.268417 Aug 04 17:14:43.923184 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2287/4646] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:43 2022] GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:43.929419 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99b610ee-ebf8-4bbf-8051-15da5c870e0a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:43.932792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1cc38c6c-3036-4a7f-ae2c-a898d6563da1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:43.933447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99b610ee-ebf8-4bbf-8051-15da5c870e0a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:43.934183 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99b610ee-ebf8-4bbf-8051-15da5c870e0a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:43.935736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99b610ee-ebf8-4bbf-8051-15da5c870e0a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:43.947418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99b610ee-ebf8-4bbf-8051-15da5c870e0a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:43.947418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99b610ee-ebf8-4bbf-8051-15da5c870e0a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:43.974815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cc38c6c-3036-4a7f-ae2c-a898d6563da1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:43.975341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cc38c6c-3036-4a7f-ae2c-a898d6563da1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:43.975803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cc38c6c-3036-4a7f-ae2c-a898d6563da1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:43.989891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:44.011422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1cc38c6c-3036-4a7f-ae2c-a898d6563da1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Going to try to stop instance {{(pid=131044) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 17:14:44.073630 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1cc38c6c-3036-4a7f-ae2c-a898d6563da1 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action" status: 202 len: 0 microversion: 2.1 time: 0.148187 Aug 04 17:14:44.074479 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2288/4647] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:14:43 2022] POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:14:44.081173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e34a0f8d-bc1b-45c6-a457-16c899ea9ab0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:44.081891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e34a0f8d-bc1b-45c6-a457-16c899ea9ab0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 134ac071-c06f-4195-9405-37e71e6d08a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:44.089150 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e34a0f8d-bc1b-45c6-a457-16c899ea9ab0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:44.089645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e34a0f8d-bc1b-45c6-a457-16c899ea9ab0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:44.090136 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e34a0f8d-bc1b-45c6-a457-16c899ea9ab0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:44.090912 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e34a0f8d-bc1b-45c6-a457-16c899ea9ab0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:44.095245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e34a0f8d-bc1b-45c6-a457-16c899ea9ab0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:44.095245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e34a0f8d-bc1b-45c6-a457-16c899ea9ab0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:44.215297 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-99b610ee-ebf8-4bbf-8051-15da5c870e0a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:44.226075 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-99b610ee-ebf8-4bbf-8051-15da5c870e0a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9" status: 200 len: 1490 microversion: 2.1 time: 0.345083 Aug 04 17:14:44.238001 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2360/4648] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:43 2022] GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9 => generated 1490 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:44.238001 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7416c808-48c2-4131-861c-0d93d23dc15d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:44.238001 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7416c808-48c2-4131-861c-0d93d23dc15d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:44.243030 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7416c808-48c2-4131-861c-0d93d23dc15d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:44.243030 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7416c808-48c2-4131-861c-0d93d23dc15d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:44.243657 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7416c808-48c2-4131-861c-0d93d23dc15d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:44.244333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7416c808-48c2-4131-861c-0d93d23dc15d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:44.244815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7416c808-48c2-4131-861c-0d93d23dc15d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:44.245252 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7416c808-48c2-4131-861c-0d93d23dc15d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:44.275512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e34a0f8d-bc1b-45c6-a457-16c899ea9ab0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:44.283383 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e34a0f8d-bc1b-45c6-a457-16c899ea9ab0 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9" status: 200 len: 1521 microversion: 2.1 time: 0.207654 Aug 04 17:14:44.284104 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2289/4649] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:44 2022] GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:44.288559 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2fa021aa-f554-4b87-8cd1-8833cddbe62d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:44.289060 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2fa021aa-f554-4b87-8cd1-8833cddbe62d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b27bb91b-1dab-4d8a-b388-09b2427931a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:44.295852 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fa021aa-f554-4b87-8cd1-8833cddbe62d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:44.296444 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fa021aa-f554-4b87-8cd1-8833cddbe62d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:44.296982 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fa021aa-f554-4b87-8cd1-8833cddbe62d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:44.297790 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fa021aa-f554-4b87-8cd1-8833cddbe62d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:44.298377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fa021aa-f554-4b87-8cd1-8833cddbe62d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:44.299453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fa021aa-f554-4b87-8cd1-8833cddbe62d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:44.328474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2fa021aa-f554-4b87-8cd1-8833cddbe62d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b27bb91b-1dab-4d8a-b388-09b2427931a9] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:14:44.404830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7416c808-48c2-4131-861c-0d93d23dc15d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:44.413901 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7416c808-48c2-4131-861c-0d93d23dc15d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1680 microversion: 2.1 time: 0.185194 Aug 04 17:14:44.414228 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2fa021aa-f554-4b87-8cd1-8833cddbe62d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9" status: 204 len: 0 microversion: 2.1 time: 0.128359 Aug 04 17:14:44.424475 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2361/4650] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:44 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1680 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:44.424670 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2290/4651] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:14:44 2022] DELETE /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:14:44.424756 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-84004b5e-cb81-4312-b5cc-34becd87176b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-577574682"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:44.424756 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-84004b5e-cb81-4312-b5cc-34becd87176b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 134ac071-c06f-4195-9405-37e71e6d08a9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:44.424902 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-60000120-1487-49d1-9c52-11175d3ca040 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:44.425193 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-60000120-1487-49d1-9c52-11175d3ca040 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:44.428694 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84004b5e-cb81-4312-b5cc-34becd87176b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:44.429318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84004b5e-cb81-4312-b5cc-34becd87176b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:44.429843 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84004b5e-cb81-4312-b5cc-34becd87176b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:44.430674 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84004b5e-cb81-4312-b5cc-34becd87176b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:44.431212 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84004b5e-cb81-4312-b5cc-34becd87176b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:44.431719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84004b5e-cb81-4312-b5cc-34becd87176b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:44.436480 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60000120-1487-49d1-9c52-11175d3ca040 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:44.437314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60000120-1487-49d1-9c52-11175d3ca040 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:44.438101 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60000120-1487-49d1-9c52-11175d3ca040 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:44.439568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60000120-1487-49d1-9c52-11175d3ca040 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:44.440217 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60000120-1487-49d1-9c52-11175d3ca040 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:44.440651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60000120-1487-49d1-9c52-11175d3ca040 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:44.588718 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-60000120-1487-49d1-9c52-11175d3ca040 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:44.598426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-60000120-1487-49d1-9c52-11175d3ca040 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:44.600311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-60000120-1487-49d1-9c52-11175d3ca040 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:44.601699 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-60000120-1487-49d1-9c52-11175d3ca040 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1809 microversion: 2.20 time: 0.185103 Aug 04 17:14:44.615123 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2291/4652] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:44 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:14:44.615123 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-283d3ce3-c001-4677-b235-8e79b85ed3d1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:44.615123 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-283d3ce3-c001-4677-b235-8e79b85ed3d1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b27bb91b-1dab-4d8a-b388-09b2427931a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:44.626064 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-283d3ce3-c001-4677-b235-8e79b85ed3d1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:44.626064 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-283d3ce3-c001-4677-b235-8e79b85ed3d1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:44.626064 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-283d3ce3-c001-4677-b235-8e79b85ed3d1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:44.626064 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-283d3ce3-c001-4677-b235-8e79b85ed3d1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:44.626064 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-283d3ce3-c001-4677-b235-8e79b85ed3d1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:44.626064 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-283d3ce3-c001-4677-b235-8e79b85ed3d1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:44.714292 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-84004b5e-cb81-4312-b5cc-34becd87176b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "POST /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9/action" status: 202 len: 0 microversion: 2.1 time: 0.298405 Aug 04 17:14:44.715196 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2362/4653] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:14:44 2022] POST /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 17:14:44.720681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-93dca800-4f2a-4b21-bd89-78f0ba98471a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:44.721311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-93dca800-4f2a-4b21-bd89-78f0ba98471a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:44.728045 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-93dca800-4f2a-4b21-bd89-78f0ba98471a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:44.728567 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-93dca800-4f2a-4b21-bd89-78f0ba98471a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:44.728995 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-93dca800-4f2a-4b21-bd89-78f0ba98471a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:44.729704 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-93dca800-4f2a-4b21-bd89-78f0ba98471a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:44.730209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-93dca800-4f2a-4b21-bd89-78f0ba98471a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:44.730637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-93dca800-4f2a-4b21-bd89-78f0ba98471a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:44.909915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-283d3ce3-c001-4677-b235-8e79b85ed3d1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:44.927372 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-283d3ce3-c001-4677-b235-8e79b85ed3d1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9" status: 200 len: 1496 microversion: 2.1 time: 0.322803 Aug 04 17:14:44.946133 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2292/4654] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:44 2022] GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9 => generated 1496 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:44.946133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-462defd3-9c91-491f-b21d-fe8deb5682a4 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '.version_select at 0x7f1e5a5a5c10>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:44.984761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-93dca800-4f2a-4b21-bd89-78f0ba98471a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:44.999031 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-93dca800-4f2a-4b21-bd89-78f0ba98471a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 200 len: 1506 microversion: 2.1 time: 0.280438 Aug 04 17:14:45.000017 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2363/4655] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:44 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 1506 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:45.096433 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-462defd3-9c91-491f-b21d-fe8deb5682a4 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "DELETE /compute/v2.1/images/5e234254-1703-4df6-9cf1-aac955e74dd3" status: 204 len: 0 microversion: 2.1 time: 0.158412 Aug 04 17:14:45.097223 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2293/4656] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:44 2022] DELETE /compute/v2.1/images/5e234254-1703-4df6-9cf1-aac955e74dd3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:14:45.105618 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d66444e0-5047-43e9-99a3-979461329985 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '.version_select at 0x7f1e5ab050d0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:45.128217 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-d66444e0-5047-43e9-99a3-979461329985 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] HTTP exception thrown: Image not found. Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d66444e0-5047-43e9-99a3-979461329985 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Request method failure captured: Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/images/5e234254-1703-4df6-9cf1-aac955e74dd3 HTTP/1.1 Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_4xbB8fnr17iZxpZmQfQZiM2JCxKiVWWUXjZiHpHTuUHHVw7ao4oT_uZW8wxu89NvTWOIVQIIqQPmHAao-lpxs7gxXuSYKOkaP9AGGwPUmZ0l1sD6ZLIZdH6-nP_cliwrHT6QFXnVMcXHLYBwQRQIzx4m2gYEscPKDx2pEzeM4vYGU Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 85c97e15d470473189d8a6c2068e9eac Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/85c97e15d470473189d8a6c2068e9eac"}]}] Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 85c97e15d470473189d8a6c2068e9eac Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ImagesOneServerNegativeTestJSON-1209884465-project Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 6791b833351c493a8e581154c2dfb8d7 Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465-project Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: exception: Image not found. Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '5e234254-1703-4df6-9cf1-aac955e74dd3'} Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5e234254-1703-4df6-9cf1-aac955e74dd3 Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 04 17:14:45.132894 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5e234254-1703-4df6-9cf1-aac955e74dd3 could not be found. Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d66444e0-5047-43e9-99a3-979461329985 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Returning 404 to user: Image not found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d66444e0-5047-43e9-99a3-979461329985 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/images/5e234254-1703-4df6-9cf1-aac955e74dd3" status: 404 len: 62 microversion: 2.1 time: 0.032850 Aug 04 17:14:45.140842 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2364/4657] 10.222.0.93 () {58 vars in 1233 bytes} [Thu Aug 4 17:14:45 2022] GET /compute/v2.1/images/5e234254-1703-4df6-9cf1-aac955e74dd3 => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 04 17:14:45.150953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-56deeced-4844-4825-a0ef-5cf6e09b71b6 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:45.151770 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-56deeced-4844-4825-a0ef-5cf6e09b71b6 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 134ac071-c06f-4195-9405-37e71e6d08a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:45.158184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56deeced-4844-4825-a0ef-5cf6e09b71b6 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:45.158642 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56deeced-4844-4825-a0ef-5cf6e09b71b6 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:45.159086 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56deeced-4844-4825-a0ef-5cf6e09b71b6 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:45.159802 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56deeced-4844-4825-a0ef-5cf6e09b71b6 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:45.160453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56deeced-4844-4825-a0ef-5cf6e09b71b6 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:45.160894 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56deeced-4844-4825-a0ef-5cf6e09b71b6 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:45.331446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-56deeced-4844-4825-a0ef-5cf6e09b71b6 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:45.341962 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-56deeced-4844-4825-a0ef-5cf6e09b71b6 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9" status: 200 len: 1541 microversion: 2.1 time: 0.194524 Aug 04 17:14:45.356072 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2294/4658] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:45 2022] GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9 => generated 1541 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:45.370183 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-dc83e0b1-cbc5-4ebb-875e-26b43fe9618f req-97f7f906-96b6-4875-a0fd-4832906ad6a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b958ca6-2ca6-41ac-b4f2-f28d2b031de7", "name": "network-vif-deleted", "tag": "fc77b974-f9c9-468a-8a2a-e5a28d0c750d"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:45.381062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-dc83e0b1-cbc5-4ebb-875e-26b43fe9618f req-97f7f906-96b6-4875-a0fd-4832906ad6a3 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:45.381799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-dc83e0b1-cbc5-4ebb-875e-26b43fe9618f req-97f7f906-96b6-4875-a0fd-4832906ad6a3 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:45.382465 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-dc83e0b1-cbc5-4ebb-875e-26b43fe9618f req-97f7f906-96b6-4875-a0fd-4832906ad6a3 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:45.393801 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-dc83e0b1-cbc5-4ebb-875e-26b43fe9618f req-97f7f906-96b6-4875-a0fd-4832906ad6a3 service nova] Creating event network-vif-deleted:fc77b974-f9c9-468a-8a2a-e5a28d0c750d for instance 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 on n-h2-851359-3 Aug 04 17:14:45.398897 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-dc83e0b1-cbc5-4ebb-875e-26b43fe9618f req-97f7f906-96b6-4875-a0fd-4832906ad6a3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148390 Aug 04 17:14:45.400045 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2365/4659] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:14:45.440314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3ab81ad7-c3d2-4639-be5a-e83ac774cc52 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:45.440872 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3ab81ad7-c3d2-4639-be5a-e83ac774cc52 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:45.445576 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:45.450165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ab81ad7-c3d2-4639-be5a-e83ac774cc52 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:45.450664 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ab81ad7-c3d2-4639-be5a-e83ac774cc52 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:45.451113 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ab81ad7-c3d2-4639-be5a-e83ac774cc52 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:45.451834 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ab81ad7-c3d2-4639-be5a-e83ac774cc52 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:45.452552 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ab81ad7-c3d2-4639-be5a-e83ac774cc52 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:45.453015 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ab81ad7-c3d2-4639-be5a-e83ac774cc52 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:45.601350 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3ab81ad7-c3d2-4639-be5a-e83ac774cc52 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:45.611600 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3ab81ad7-c3d2-4639-be5a-e83ac774cc52 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1680 microversion: 2.1 time: 0.177029 Aug 04 17:14:45.614091 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2295/4660] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:45 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:45.640393 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-014a6d66-db70-44a9-a4ad-712db6f1ce1e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:45.641427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-014a6d66-db70-44a9-a4ad-712db6f1ce1e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:45.648485 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-014a6d66-db70-44a9-a4ad-712db6f1ce1e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:45.649240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-014a6d66-db70-44a9-a4ad-712db6f1ce1e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:45.649873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-014a6d66-db70-44a9-a4ad-712db6f1ce1e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:45.650803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-014a6d66-db70-44a9-a4ad-712db6f1ce1e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:45.651519 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-014a6d66-db70-44a9-a4ad-712db6f1ce1e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:45.652106 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-014a6d66-db70-44a9-a4ad-712db6f1ce1e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:45.835776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-014a6d66-db70-44a9-a4ad-712db6f1ce1e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:45.856292 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-014a6d66-db70-44a9-a4ad-712db6f1ce1e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:45.858729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-014a6d66-db70-44a9-a4ad-712db6f1ce1e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:45.860128 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-014a6d66-db70-44a9-a4ad-712db6f1ce1e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1809 microversion: 2.20 time: 0.224142 Aug 04 17:14:45.860946 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2366/4661] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:45 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1809 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:14:45.969755 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a4a917d2-bfcd-4263-9fdd-e93bf3d566ac tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:45.970454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a4a917d2-bfcd-4263-9fdd-e93bf3d566ac tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b27bb91b-1dab-4d8a-b388-09b2427931a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:45.977417 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4a917d2-bfcd-4263-9fdd-e93bf3d566ac tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:45.978022 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4a917d2-bfcd-4263-9fdd-e93bf3d566ac tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:45.978787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4a917d2-bfcd-4263-9fdd-e93bf3d566ac tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:45.979561 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4a917d2-bfcd-4263-9fdd-e93bf3d566ac tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:45.980099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4a917d2-bfcd-4263-9fdd-e93bf3d566ac tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:45.980628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4a917d2-bfcd-4263-9fdd-e93bf3d566ac tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:46.022519 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6b4d1eec-c4b4-4ff5-a37c-0110372bae07 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:46.023126 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6b4d1eec-c4b4-4ff5-a37c-0110372bae07 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:46.031310 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6b4d1eec-c4b4-4ff5-a37c-0110372bae07 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:46.031818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6b4d1eec-c4b4-4ff5-a37c-0110372bae07 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:46.032338 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6b4d1eec-c4b4-4ff5-a37c-0110372bae07 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:46.033127 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6b4d1eec-c4b4-4ff5-a37c-0110372bae07 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:46.033953 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6b4d1eec-c4b4-4ff5-a37c-0110372bae07 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:46.034207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6b4d1eec-c4b4-4ff5-a37c-0110372bae07 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:46.052072 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-6b4d1eec-c4b4-4ff5-a37c-0110372bae07 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] HTTP exception thrown: Instance 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 could not be found. Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6b4d1eec-c4b4-4ff5-a37c-0110372bae07 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Request method failure captured: Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 HTTP/1.1 Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_1KcpG4juUr2VEfzShlgrBBMonXazIZnBtgobublSG0FrbL-f6glawbXIezuRVmeGIpCPKZ2_FVYi6XXX8bEGfzlmqPmHXf6Tacw6jDfV9QuP1xJWCSlbaybEtYK4vIloCt34qv4iEL4IzCpH1AIgjNgga3059ie-t_wAucPvDkWig Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 50d2f7cd670340adb1b4187754e302c5 Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1121530457 Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/50d2f7cd670340adb1b4187754e302c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/50d2f7cd670340adb1b4187754e302c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_50d2f7cd670340adb1b4187754e302c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/50d2f7cd670340adb1b4187754e302c5"}]}] Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1121530457 Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 50d2f7cd670340adb1b4187754e302c5 Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1121530457 Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerRescueNegativeTestJSON-1121530457-project Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 067e98d624234a48bb0ea3bde77c049c Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1121530457-project Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 could not be found. Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '6b958ca6-2ca6-41ac-b4f2-f28d2b031de7'} Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 could not be found. Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 could not be found. Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:14:46.054780 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:14:46.061488 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:14:46.061488 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:14:46.061488 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:14:46.061488 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:14:46.061488 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:14:46.061488 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:14:46.061488 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 could not be found. Aug 04 17:14:46.061488 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:14:46.061488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6b4d1eec-c4b4-4ff5-a37c-0110372bae07 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Returning 404 to user: Instance 6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:14:46.061488 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6b4d1eec-c4b4-4ff5-a37c-0110372bae07 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7" status: 404 len: 111 microversion: 2.1 time: 0.040222 Aug 04 17:14:46.061488 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2367/4662] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:46 2022] GET /compute/v2.1/servers/6b958ca6-2ca6-41ac-b4f2-f28d2b031de7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:14:46.067678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0ff924ef-a243-41ce-8913-b7aa57dd75d1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:46.068190 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0ff924ef-a243-41ce-8913-b7aa57dd75d1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:46.077650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ff924ef-a243-41ce-8913-b7aa57dd75d1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:46.079842 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ff924ef-a243-41ce-8913-b7aa57dd75d1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:46.080484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ff924ef-a243-41ce-8913-b7aa57dd75d1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:46.082617 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ff924ef-a243-41ce-8913-b7aa57dd75d1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:46.083262 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ff924ef-a243-41ce-8913-b7aa57dd75d1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:46.083861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ff924ef-a243-41ce-8913-b7aa57dd75d1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:46.119725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0ff924ef-a243-41ce-8913-b7aa57dd75d1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:14:46.238428 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0ff924ef-a243-41ce-8913-b7aa57dd75d1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "DELETE /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 204 len: 0 microversion: 2.1 time: 0.173227 Aug 04 17:14:46.239660 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2368/4663] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:14:46 2022] DELETE /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:14:46.250976 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dca7b4e4-b3d7-4d6e-aa97-23e4c1e51e90 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:46.253245 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dca7b4e4-b3d7-4d6e-aa97-23e4c1e51e90 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:46.261488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dca7b4e4-b3d7-4d6e-aa97-23e4c1e51e90 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:46.262088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dca7b4e4-b3d7-4d6e-aa97-23e4c1e51e90 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:46.262571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dca7b4e4-b3d7-4d6e-aa97-23e4c1e51e90 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:46.263965 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dca7b4e4-b3d7-4d6e-aa97-23e4c1e51e90 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:46.264450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dca7b4e4-b3d7-4d6e-aa97-23e4c1e51e90 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:46.264891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dca7b4e4-b3d7-4d6e-aa97-23e4c1e51e90 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:46.273318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a4a917d2-bfcd-4263-9fdd-e93bf3d566ac tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:46.289189 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a4a917d2-bfcd-4263-9fdd-e93bf3d566ac tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9" status: 200 len: 1496 microversion: 2.1 time: 0.323708 Aug 04 17:14:46.290092 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2296/4664] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:45 2022] GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9 => generated 1496 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:46.364102 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4ff154cc-d006-485c-928c-00a3a5c92403 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:46.364747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4ff154cc-d006-485c-928c-00a3a5c92403 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 134ac071-c06f-4195-9405-37e71e6d08a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:46.371401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ff154cc-d006-485c-928c-00a3a5c92403 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:46.372678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ff154cc-d006-485c-928c-00a3a5c92403 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:46.373122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ff154cc-d006-485c-928c-00a3a5c92403 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:46.373836 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ff154cc-d006-485c-928c-00a3a5c92403 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:46.374340 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ff154cc-d006-485c-928c-00a3a5c92403 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:46.374822 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ff154cc-d006-485c-928c-00a3a5c92403 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:46.462547 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dca7b4e4-b3d7-4d6e-aa97-23e4c1e51e90 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:46.473189 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dca7b4e4-b3d7-4d6e-aa97-23e4c1e51e90 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 200 len: 1522 microversion: 2.1 time: 0.228448 Aug 04 17:14:46.474003 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2369/4665] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:46 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:46.530132 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4ff154cc-d006-485c-928c-00a3a5c92403 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:46.538103 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4ff154cc-d006-485c-928c-00a3a5c92403 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9" status: 200 len: 1533 microversion: 2.1 time: 0.178218 Aug 04 17:14:46.538668 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2297/4666] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:46 2022] GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9 => generated 1533 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:14:46.633047 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-85ec6707-a078-487d-bd25-c01c8e3e08cb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:46.633599 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-85ec6707-a078-487d-bd25-c01c8e3e08cb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:46.640234 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85ec6707-a078-487d-bd25-c01c8e3e08cb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:46.640736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85ec6707-a078-487d-bd25-c01c8e3e08cb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:46.641182 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85ec6707-a078-487d-bd25-c01c8e3e08cb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:46.641886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85ec6707-a078-487d-bd25-c01c8e3e08cb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:46.642384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85ec6707-a078-487d-bd25-c01c8e3e08cb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:46.642817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85ec6707-a078-487d-bd25-c01c8e3e08cb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:46.813713 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-85ec6707-a078-487d-bd25-c01c8e3e08cb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:46.821734 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-85ec6707-a078-487d-bd25-c01c8e3e08cb tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1680 microversion: 2.1 time: 0.192742 Aug 04 17:14:46.822337 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2370/4667] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:46 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1680 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:46.883463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b5efc960-8ca9-4c27-b7b8-e2d1afcf7f46 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:46.883983 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b5efc960-8ca9-4c27-b7b8-e2d1afcf7f46 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:46.890863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5efc960-8ca9-4c27-b7b8-e2d1afcf7f46 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:46.891356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5efc960-8ca9-4c27-b7b8-e2d1afcf7f46 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:46.891803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5efc960-8ca9-4c27-b7b8-e2d1afcf7f46 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:46.892506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5efc960-8ca9-4c27-b7b8-e2d1afcf7f46 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:46.892970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5efc960-8ca9-4c27-b7b8-e2d1afcf7f46 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:46.893400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5efc960-8ca9-4c27-b7b8-e2d1afcf7f46 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:47.048033 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b5efc960-8ca9-4c27-b7b8-e2d1afcf7f46 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:47.057263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b5efc960-8ca9-4c27-b7b8-e2d1afcf7f46 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:47.058877 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b5efc960-8ca9-4c27-b7b8-e2d1afcf7f46 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:47.060176 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b5efc960-8ca9-4c27-b7b8-e2d1afcf7f46 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1809 microversion: 2.20 time: 0.181124 Aug 04 17:14:47.060795 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2298/4668] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:46 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:14:47.316688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-be6491dd-f701-4aaf-ad83-e7ed1f063664 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:47.318125 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-be6491dd-f701-4aaf-ad83-e7ed1f063664 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b27bb91b-1dab-4d8a-b388-09b2427931a9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:47.330471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be6491dd-f701-4aaf-ad83-e7ed1f063664 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:47.331371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be6491dd-f701-4aaf-ad83-e7ed1f063664 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:47.332180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be6491dd-f701-4aaf-ad83-e7ed1f063664 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:47.333448 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be6491dd-f701-4aaf-ad83-e7ed1f063664 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:47.334398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be6491dd-f701-4aaf-ad83-e7ed1f063664 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:47.335205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be6491dd-f701-4aaf-ad83-e7ed1f063664 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:47.495120 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2ed4abb5-8377-4800-96e7-bbae4edcd8d3 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:47.496892 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2ed4abb5-8377-4800-96e7-bbae4edcd8d3 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:47.502459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ed4abb5-8377-4800-96e7-bbae4edcd8d3 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:47.502954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ed4abb5-8377-4800-96e7-bbae4edcd8d3 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:47.503401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ed4abb5-8377-4800-96e7-bbae4edcd8d3 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:47.504117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ed4abb5-8377-4800-96e7-bbae4edcd8d3 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:47.504830 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ed4abb5-8377-4800-96e7-bbae4edcd8d3 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:47.505636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ed4abb5-8377-4800-96e7-bbae4edcd8d3 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:47.513598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-be6491dd-f701-4aaf-ad83-e7ed1f063664 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:47.542148 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-be6491dd-f701-4aaf-ad83-e7ed1f063664 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9" status: 200 len: 1496 microversion: 2.1 time: 0.231703 Aug 04 17:14:47.543307 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2371/4669] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:47 2022] GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9 => generated 1496 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:47.561230 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-494b6c42-7d2a-406c-a5de-56e05da1eff3 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:47.561869 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-494b6c42-7d2a-406c-a5de-56e05da1eff3 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 134ac071-c06f-4195-9405-37e71e6d08a9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:47.571877 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-494b6c42-7d2a-406c-a5de-56e05da1eff3 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:47.575931 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-494b6c42-7d2a-406c-a5de-56e05da1eff3 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:47.576565 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-494b6c42-7d2a-406c-a5de-56e05da1eff3 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:47.577481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-494b6c42-7d2a-406c-a5de-56e05da1eff3 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:47.578109 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-494b6c42-7d2a-406c-a5de-56e05da1eff3 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:47.578652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-494b6c42-7d2a-406c-a5de-56e05da1eff3 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:47.741473 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2ed4abb5-8377-4800-96e7-bbae4edcd8d3 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:47.758906 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2ed4abb5-8377-4800-96e7-bbae4edcd8d3 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 200 len: 1522 microversion: 2.1 time: 0.266395 Aug 04 17:14:47.760175 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2299/4670] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:47 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:14:47.804353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-494b6c42-7d2a-406c-a5de-56e05da1eff3 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:47.812961 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-494b6c42-7d2a-406c-a5de-56e05da1eff3 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9" status: 200 len: 1533 microversion: 2.1 time: 0.256794 Aug 04 17:14:47.818013 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2372/4671] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:47 2022] GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9 => generated 1533 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:14:47.844507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b6c818da-347b-41a2-9903-2057f287241a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:47.845205 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b6c818da-347b-41a2-9903-2057f287241a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:47.851651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6c818da-347b-41a2-9903-2057f287241a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:47.852145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6c818da-347b-41a2-9903-2057f287241a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:47.852640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6c818da-347b-41a2-9903-2057f287241a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:47.853294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6c818da-347b-41a2-9903-2057f287241a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:47.853761 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6c818da-347b-41a2-9903-2057f287241a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:47.854224 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6c818da-347b-41a2-9903-2057f287241a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:48.052907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b6c818da-347b-41a2-9903-2057f287241a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:48.059947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:48.072452 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b6c818da-347b-41a2-9903-2057f287241a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1680 microversion: 2.1 time: 0.232313 Aug 04 17:14:48.083031 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2300/4672] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:47 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1680 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:48.090759 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b5f4c1bb-380e-4202-ae9f-1b0da8310551 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:48.090759 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b5f4c1bb-380e-4202-ae9f-1b0da8310551 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:48.092825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b5f4c1bb-380e-4202-ae9f-1b0da8310551 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:48.093557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b5f4c1bb-380e-4202-ae9f-1b0da8310551 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:48.094204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b5f4c1bb-380e-4202-ae9f-1b0da8310551 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:48.095130 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b5f4c1bb-380e-4202-ae9f-1b0da8310551 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:48.095774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b5f4c1bb-380e-4202-ae9f-1b0da8310551 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:48.096356 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b5f4c1bb-380e-4202-ae9f-1b0da8310551 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:48.252564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b5f4c1bb-380e-4202-ae9f-1b0da8310551 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:48.261605 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b5f4c1bb-380e-4202-ae9f-1b0da8310551 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:48.263740 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b5f4c1bb-380e-4202-ae9f-1b0da8310551 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:48.264993 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b5f4c1bb-380e-4202-ae9f-1b0da8310551 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1809 microversion: 2.20 time: 0.185869 Aug 04 17:14:48.265592 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2373/4673] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:48 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:14:48.578446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bf3e732e-98d5-4fd4-b173-7097b1ffad2c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:48.579077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bf3e732e-98d5-4fd4-b173-7097b1ffad2c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b27bb91b-1dab-4d8a-b388-09b2427931a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:48.586859 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf3e732e-98d5-4fd4-b173-7097b1ffad2c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:48.587352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf3e732e-98d5-4fd4-b173-7097b1ffad2c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:48.587807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf3e732e-98d5-4fd4-b173-7097b1ffad2c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:48.588532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf3e732e-98d5-4fd4-b173-7097b1ffad2c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:48.588988 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf3e732e-98d5-4fd4-b173-7097b1ffad2c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:48.589420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf3e732e-98d5-4fd4-b173-7097b1ffad2c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:48.737470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bf3e732e-98d5-4fd4-b173-7097b1ffad2c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:48.745412 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bf3e732e-98d5-4fd4-b173-7097b1ffad2c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9" status: 200 len: 1496 microversion: 2.1 time: 0.172097 Aug 04 17:14:48.746080 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2301/4674] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:48 2022] GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9 => generated 1496 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:48.788445 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9e414193-b443-43a5-9d87-a940b1438fb1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:48.789371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9e414193-b443-43a5-9d87-a940b1438fb1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:48.798391 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e414193-b443-43a5-9d87-a940b1438fb1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:48.798867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e414193-b443-43a5-9d87-a940b1438fb1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:48.799315 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e414193-b443-43a5-9d87-a940b1438fb1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:48.800017 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e414193-b443-43a5-9d87-a940b1438fb1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:48.800475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e414193-b443-43a5-9d87-a940b1438fb1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:48.800900 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e414193-b443-43a5-9d87-a940b1438fb1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:48.836511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8e53e0b5-d40d-4317-a141-6303cd749c6a tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:48.837508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8e53e0b5-d40d-4317-a141-6303cd749c6a tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 134ac071-c06f-4195-9405-37e71e6d08a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:48.846063 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e53e0b5-d40d-4317-a141-6303cd749c6a tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:48.847030 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e53e0b5-d40d-4317-a141-6303cd749c6a tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:48.847787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e53e0b5-d40d-4317-a141-6303cd749c6a tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:48.848910 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e53e0b5-d40d-4317-a141-6303cd749c6a tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:48.849504 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e53e0b5-d40d-4317-a141-6303cd749c6a tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:48.850099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e53e0b5-d40d-4317-a141-6303cd749c6a tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:49.018999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9e414193-b443-43a5-9d87-a940b1438fb1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:49.027527 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9e414193-b443-43a5-9d87-a940b1438fb1 tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 200 len: 1522 microversion: 2.1 time: 0.245062 Aug 04 17:14:49.028940 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2374/4675] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:48 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:49.066617 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8e53e0b5-d40d-4317-a141-6303cd749c6a tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:49.083745 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8e53e0b5-d40d-4317-a141-6303cd749c6a tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9" status: 200 len: 1533 microversion: 2.1 time: 0.251872 Aug 04 17:14:49.097909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-de5792bb-5372-424f-b5d4-4513cd6f0025 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:49.098705 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-de5792bb-5372-424f-b5d4-4513cd6f0025 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:49.101381 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2302/4676] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:48 2022] GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9 => generated 1533 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:14:49.124020 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de5792bb-5372-424f-b5d4-4513cd6f0025 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:49.124678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de5792bb-5372-424f-b5d4-4513cd6f0025 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:49.125246 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de5792bb-5372-424f-b5d4-4513cd6f0025 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:49.132631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de5792bb-5372-424f-b5d4-4513cd6f0025 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:49.133754 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de5792bb-5372-424f-b5d4-4513cd6f0025 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:49.134535 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de5792bb-5372-424f-b5d4-4513cd6f0025 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:49.288643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2ad5fe2e-cfcb-4d9b-b6d6-0423b17e4962 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:49.289267 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2ad5fe2e-cfcb-4d9b-b6d6-0423b17e4962 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:49.302218 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ad5fe2e-cfcb-4d9b-b6d6-0423b17e4962 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:49.302719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ad5fe2e-cfcb-4d9b-b6d6-0423b17e4962 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:49.303158 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ad5fe2e-cfcb-4d9b-b6d6-0423b17e4962 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:49.303880 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ad5fe2e-cfcb-4d9b-b6d6-0423b17e4962 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:49.304339 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ad5fe2e-cfcb-4d9b-b6d6-0423b17e4962 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:49.304765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ad5fe2e-cfcb-4d9b-b6d6-0423b17e4962 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:49.758184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2ad5fe2e-cfcb-4d9b-b6d6-0423b17e4962 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:49.792261 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2ad5fe2e-cfcb-4d9b-b6d6-0423b17e4962 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:49.793807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2ad5fe2e-cfcb-4d9b-b6d6-0423b17e4962 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:49.799714 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2ad5fe2e-cfcb-4d9b-b6d6-0423b17e4962 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1809 microversion: 2.20 time: 0.513499 Aug 04 17:14:49.815583 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2303/4677] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:49 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1809 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:14:49.829585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-73ad3c9c-9f5d-4af9-bbc3-3537a738d137 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:49.831056 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-73ad3c9c-9f5d-4af9-bbc3-3537a738d137 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b27bb91b-1dab-4d8a-b388-09b2427931a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:49.848528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73ad3c9c-9f5d-4af9-bbc3-3537a738d137 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:49.849249 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73ad3c9c-9f5d-4af9-bbc3-3537a738d137 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:49.849878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73ad3c9c-9f5d-4af9-bbc3-3537a738d137 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:49.855449 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73ad3c9c-9f5d-4af9-bbc3-3537a738d137 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:49.860322 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73ad3c9c-9f5d-4af9-bbc3-3537a738d137 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:49.864610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73ad3c9c-9f5d-4af9-bbc3-3537a738d137 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:50.155925 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-73ad3c9c-9f5d-4af9-bbc3-3537a738d137 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:50.166893 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-73ad3c9c-9f5d-4af9-bbc3-3537a738d137 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9" status: 200 len: 1454 microversion: 2.1 time: 0.350055 Aug 04 17:14:50.167479 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2304/4678] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:49 2022] GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9 => generated 1454 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:50.185262 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-ab126c6e-c06e-4c80-a9af-039fb852c8b0 req-26344523-f927-4464-a265-ac65b2f220b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b27bb91b-1dab-4d8a-b388-09b2427931a9", "name": "network-vif-unplugged", "status": "completed", "tag": "bd052304-65d1-4a92-b871-4dde00c61773"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:50.213723 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ab126c6e-c06e-4c80-a9af-039fb852c8b0 req-26344523-f927-4464-a265-ac65b2f220b1 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:50.214532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ab126c6e-c06e-4c80-a9af-039fb852c8b0 req-26344523-f927-4464-a265-ac65b2f220b1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:50.215152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ab126c6e-c06e-4c80-a9af-039fb852c8b0 req-26344523-f927-4464-a265-ac65b2f220b1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:50.246245 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-ab126c6e-c06e-4c80-a9af-039fb852c8b0 req-26344523-f927-4464-a265-ac65b2f220b1 service nova] Creating event network-vif-unplugged:bd052304-65d1-4a92-b871-4dde00c61773 for instance b27bb91b-1dab-4d8a-b388-09b2427931a9 on n-h1-851359-3 Aug 04 17:14:50.261861 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-ab126c6e-c06e-4c80-a9af-039fb852c8b0 req-26344523-f927-4464-a265-ac65b2f220b1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088177 Aug 04 17:14:50.264251 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2305/4679] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:14:50.277771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-752688c6-9929-49a5-88d4-cbc9dcddc54a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:50.278577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-752688c6-9929-49a5-88d4-cbc9dcddc54a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:50.291391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-752688c6-9929-49a5-88d4-cbc9dcddc54a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:50.294612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-752688c6-9929-49a5-88d4-cbc9dcddc54a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:50.295952 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-752688c6-9929-49a5-88d4-cbc9dcddc54a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:50.297930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-752688c6-9929-49a5-88d4-cbc9dcddc54a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:50.304942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-752688c6-9929-49a5-88d4-cbc9dcddc54a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:50.306816 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-752688c6-9929-49a5-88d4-cbc9dcddc54a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:50.851947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-de5792bb-5372-424f-b5d4-4513cd6f0025 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:50.881152 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-de5792bb-5372-424f-b5d4-4513cd6f0025 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1680 microversion: 2.1 time: 1.787837 Aug 04 17:14:50.882231 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2375/4680] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:49 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1680 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:14:50.889609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e879d1fc-7ec8-4c24-b0d9-8ae904c1b637 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:50.891066 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e879d1fc-7ec8-4c24-b0d9-8ae904c1b637 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 134ac071-c06f-4195-9405-37e71e6d08a9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:50.904108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e879d1fc-7ec8-4c24-b0d9-8ae904c1b637 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:50.907675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e879d1fc-7ec8-4c24-b0d9-8ae904c1b637 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:50.909346 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e879d1fc-7ec8-4c24-b0d9-8ae904c1b637 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:50.924190 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e879d1fc-7ec8-4c24-b0d9-8ae904c1b637 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:50.925196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e879d1fc-7ec8-4c24-b0d9-8ae904c1b637 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:50.926400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e879d1fc-7ec8-4c24-b0d9-8ae904c1b637 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:50.932299 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:51.483966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-752688c6-9929-49a5-88d4-cbc9dcddc54a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:51.497401 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-752688c6-9929-49a5-88d4-cbc9dcddc54a tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 200 len: 1522 microversion: 2.1 time: 1.228543 Aug 04 17:14:51.501944 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2306/4681] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:50 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 1522 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:51.507781 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-15178179-85e8-43dd-8af9-b4f83c221cf0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:51.508791 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-15178179-85e8-43dd-8af9-b4f83c221cf0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:51.516437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15178179-85e8-43dd-8af9-b4f83c221cf0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:51.517352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15178179-85e8-43dd-8af9-b4f83c221cf0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:51.518105 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15178179-85e8-43dd-8af9-b4f83c221cf0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:51.518302 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e879d1fc-7ec8-4c24-b0d9-8ae904c1b637 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:51.519401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15178179-85e8-43dd-8af9-b4f83c221cf0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:51.520153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15178179-85e8-43dd-8af9-b4f83c221cf0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:51.520819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15178179-85e8-43dd-8af9-b4f83c221cf0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:51.529220 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e879d1fc-7ec8-4c24-b0d9-8ae904c1b637 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9" status: 200 len: 1539 microversion: 2.1 time: 0.645503 Aug 04 17:14:51.542936 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2376/4682] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:50 2022] GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9 => generated 1539 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:51.548465 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-21442a00-e4a3-4100-98c4-bd78f9459331 req-eec13d5e-928e-4d33-a74f-b6f67d859672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b27bb91b-1dab-4d8a-b388-09b2427931a9", "name": "network-vif-deleted", "tag": "bd052304-65d1-4a92-b871-4dde00c61773"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:51.561453 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-21442a00-e4a3-4100-98c4-bd78f9459331 req-eec13d5e-928e-4d33-a74f-b6f67d859672 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:51.561950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-21442a00-e4a3-4100-98c4-bd78f9459331 req-eec13d5e-928e-4d33-a74f-b6f67d859672 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:51.563028 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-21442a00-e4a3-4100-98c4-bd78f9459331 req-eec13d5e-928e-4d33-a74f-b6f67d859672 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:51.578914 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-21442a00-e4a3-4100-98c4-bd78f9459331 req-eec13d5e-928e-4d33-a74f-b6f67d859672 service nova] Creating event network-vif-deleted:bd052304-65d1-4a92-b871-4dde00c61773 for instance b27bb91b-1dab-4d8a-b388-09b2427931a9 on n-h1-851359-3 Aug 04 17:14:51.594481 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-21442a00-e4a3-4100-98c4-bd78f9459331 req-eec13d5e-928e-4d33-a74f-b6f67d859672 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050084 Aug 04 17:14:51.595343 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2377/4683] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:14:51.603457 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ecf6ffb7-f88f-460b-b151-f095ceb7a26d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:51.604465 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ecf6ffb7-f88f-460b-b151-f095ceb7a26d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b27bb91b-1dab-4d8a-b388-09b2427931a9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:51.613566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecf6ffb7-f88f-460b-b151-f095ceb7a26d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:51.615908 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecf6ffb7-f88f-460b-b151-f095ceb7a26d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:51.617092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecf6ffb7-f88f-460b-b151-f095ceb7a26d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:51.618150 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecf6ffb7-f88f-460b-b151-f095ceb7a26d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:51.618784 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecf6ffb7-f88f-460b-b151-f095ceb7a26d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:51.619372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecf6ffb7-f88f-460b-b151-f095ceb7a26d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:51.673211 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecf6ffb7-f88f-460b-b151-f095ceb7a26d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:51.676906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecf6ffb7-f88f-460b-b151-f095ceb7a26d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:51.677479 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecf6ffb7-f88f-460b-b151-f095ceb7a26d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:51.680304 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-ecf6ffb7-f88f-460b-b151-f095ceb7a26d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lazy-loading 'fault' on Instance uuid b27bb91b-1dab-4d8a-b388-09b2427931a9 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:14:51.724323 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-15178179-85e8-43dd-8af9-b4f83c221cf0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:51.742219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ecf6ffb7-f88f-460b-b151-f095ceb7a26d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:51.750510 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ecf6ffb7-f88f-460b-b151-f095ceb7a26d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9" status: 200 len: 1299 microversion: 2.1 time: 0.151145 Aug 04 17:14:51.751118 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2378/4684] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:51 2022] GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9 => generated 1299 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:51.751843 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-15178179-85e8-43dd-8af9-b4f83c221cf0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:51.753857 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-15178179-85e8-43dd-8af9-b4f83c221cf0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:51.755885 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-15178179-85e8-43dd-8af9-b4f83c221cf0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1809 microversion: 2.20 time: 0.252376 Aug 04 17:14:51.760666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-d98feb0a-505f-4337-8168-3398acd18d22 req-361173ef-11a0-4de8-8eee-233440e77208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "930cda99-f658-44c9-bb85-da349e9e5aeb", "name": "network-vif-deleted", "tag": "fc731c29-573c-4fea-bc67-f7db2218ed58"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:51.767302 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2307/4685] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:51 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1809 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:14:51.778886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d98feb0a-505f-4337-8168-3398acd18d22 req-361173ef-11a0-4de8-8eee-233440e77208 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:51.779641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d98feb0a-505f-4337-8168-3398acd18d22 req-361173ef-11a0-4de8-8eee-233440e77208 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:51.781362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d98feb0a-505f-4337-8168-3398acd18d22 req-361173ef-11a0-4de8-8eee-233440e77208 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:51.807305 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-d98feb0a-505f-4337-8168-3398acd18d22 req-361173ef-11a0-4de8-8eee-233440e77208 service nova] Creating event network-vif-deleted:fc731c29-573c-4fea-bc67-f7db2218ed58 for instance 930cda99-f658-44c9-bb85-da349e9e5aeb on n-h1-851359-3 Aug 04 17:14:51.818265 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-d98feb0a-505f-4337-8168-3398acd18d22 req-361173ef-11a0-4de8-8eee-233440e77208 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061054 Aug 04 17:14:51.823200 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2379/4686] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:14:51.908753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cd38d8b7-7586-4913-97ed-46bc294428e6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:51.909306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cd38d8b7-7586-4913-97ed-46bc294428e6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:51.915348 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd38d8b7-7586-4913-97ed-46bc294428e6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:51.915845 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd38d8b7-7586-4913-97ed-46bc294428e6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:51.916285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd38d8b7-7586-4913-97ed-46bc294428e6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:51.917048 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd38d8b7-7586-4913-97ed-46bc294428e6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:51.917568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd38d8b7-7586-4913-97ed-46bc294428e6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:51.918052 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd38d8b7-7586-4913-97ed-46bc294428e6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:52.059847 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cd38d8b7-7586-4913-97ed-46bc294428e6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:52.067837 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cd38d8b7-7586-4913-97ed-46bc294428e6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1680 microversion: 2.1 time: 0.163274 Aug 04 17:14:52.068417 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2308/4687] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:51 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:52.396268 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-f5196041-920e-4221-8eab-247ed8421f52 req-35adeef4-af67-4139-b05a-e12350c14473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c682c4f-3eed-44cd-9782-3ed12f2d8f0d", "name": "network-vif-plugged", "status": "completed", "tag": "8b60e742-6e36-45ea-a5d7-62315ea560df"}, {"server_uuid": "134ac071-c06f-4195-9405-37e71e6d08a9", "name": "network-vif-plugged", "status": "completed", "tag": "0cab5fbd-8e6f-4623-a7d3-44f33d164fda"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:52.408717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f5196041-920e-4221-8eab-247ed8421f52 req-35adeef4-af67-4139-b05a-e12350c14473 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:52.409503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f5196041-920e-4221-8eab-247ed8421f52 req-35adeef4-af67-4139-b05a-e12350c14473 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:52.410176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f5196041-920e-4221-8eab-247ed8421f52 req-35adeef4-af67-4139-b05a-e12350c14473 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:52.424889 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-f5196041-920e-4221-8eab-247ed8421f52 req-35adeef4-af67-4139-b05a-e12350c14473 service nova] Creating event network-vif-plugged:8b60e742-6e36-45ea-a5d7-62315ea560df for instance 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d on n-h2-851359-3 Aug 04 17:14:52.425673 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-f5196041-920e-4221-8eab-247ed8421f52 req-35adeef4-af67-4139-b05a-e12350c14473 service nova] Creating event network-vif-plugged:0cab5fbd-8e6f-4623-a7d3-44f33d164fda for instance 134ac071-c06f-4195-9405-37e71e6d08a9 on n-h1-851359-3 Aug 04 17:14:52.435707 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-f5196041-920e-4221-8eab-247ed8421f52 req-35adeef4-af67-4139-b05a-e12350c14473 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042859 Aug 04 17:14:52.436742 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2380/4688] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:14:52.526495 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-98ac883d-1b2d-4a5b-80a8-fb410600864d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:52.527118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-98ac883d-1b2d-4a5b-80a8-fb410600864d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:52.537826 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98ac883d-1b2d-4a5b-80a8-fb410600864d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:52.539008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98ac883d-1b2d-4a5b-80a8-fb410600864d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:52.541193 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98ac883d-1b2d-4a5b-80a8-fb410600864d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:52.541938 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98ac883d-1b2d-4a5b-80a8-fb410600864d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:52.542435 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98ac883d-1b2d-4a5b-80a8-fb410600864d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:52.543162 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98ac883d-1b2d-4a5b-80a8-fb410600864d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:52.561422 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-15ea5350-c174-41d1-b40d-535be188bbef tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:52.562874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-15ea5350-c174-41d1-b40d-535be188bbef tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 134ac071-c06f-4195-9405-37e71e6d08a9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:52.580826 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-15ea5350-c174-41d1-b40d-535be188bbef tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:52.581348 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-15ea5350-c174-41d1-b40d-535be188bbef tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:52.582476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-15ea5350-c174-41d1-b40d-535be188bbef tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:52.585459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-15ea5350-c174-41d1-b40d-535be188bbef tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:52.586861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-15ea5350-c174-41d1-b40d-535be188bbef tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:52.587330 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-15ea5350-c174-41d1-b40d-535be188bbef tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:52.615284 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98ac883d-1b2d-4a5b-80a8-fb410600864d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:52.615830 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98ac883d-1b2d-4a5b-80a8-fb410600864d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:52.618286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98ac883d-1b2d-4a5b-80a8-fb410600864d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:52.618773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-98ac883d-1b2d-4a5b-80a8-fb410600864d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lazy-loading 'fault' on Instance uuid 930cda99-f658-44c9-bb85-da349e9e5aeb {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:14:52.692285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-98ac883d-1b2d-4a5b-80a8-fb410600864d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067e98d624234a48bb0ea3bde77c049c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d2f7cd670340adb1b4187754e302c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:52.704772 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-98ac883d-1b2d-4a5b-80a8-fb410600864d tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 200 len: 1312 microversion: 2.1 time: 0.182480 Aug 04 17:14:52.707743 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2309/4689] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:52 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 1312 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:52.776125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b2380b45-fbbe-4c51-bb09-4466d26acfb8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:52.777122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b2380b45-fbbe-4c51-bb09-4466d26acfb8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b27bb91b-1dab-4d8a-b388-09b2427931a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:52.791424 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2380b45-fbbe-4c51-bb09-4466d26acfb8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:52.792220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2380b45-fbbe-4c51-bb09-4466d26acfb8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:52.794769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2380b45-fbbe-4c51-bb09-4466d26acfb8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:52.795737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2380b45-fbbe-4c51-bb09-4466d26acfb8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:52.796323 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2380b45-fbbe-4c51-bb09-4466d26acfb8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:52.797609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2380b45-fbbe-4c51-bb09-4466d26acfb8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:52.805898 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-15ea5350-c174-41d1-b40d-535be188bbef tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:52.814755 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-15ea5350-c174-41d1-b40d-535be188bbef tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9" status: 200 len: 1521 microversion: 2.1 time: 0.259980 Aug 04 17:14:52.815346 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2381/4690] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:52 2022] GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:14:52.823388 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-23fc08ed-b84d-4735-bbb2-ea3c8f8ffc91 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:52.824228 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-23fc08ed-b84d-4735-bbb2-ea3c8f8ffc91 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:52.824741 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-b2380b45-fbbe-4c51-bb09-4466d26acfb8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] HTTP exception thrown: Instance b27bb91b-1dab-4d8a-b388-09b2427931a9 could not be found. Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b2380b45-fbbe-4c51-bb09-4466d26acfb8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Request method failure captured: Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9 HTTP/1.1 Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_4PiXAoqFPCXVrtw_fcVtbWCRHCRY1BcfprLEe-EkZEFmD3rLGum9OIJcRnH-o3xr4k8T7yl4V2Hv5h2fEBByVUFBw2XIbz_i_ncVR1MMvkDEp1AvjPEGXUtr2hnsv9JoWINOTj84eRxq_Gac5VyTIxXMDaWbVLw5VeWNnbunOt5QM Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d9911aeb77cd4ffb8c4e539998a04f3c"}]}] Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersTestJSON-1653035612 Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersTestJSON-1653035612-project Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 8e840d06bb5d44e097e6f0855b04cb06 Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersTestJSON-1653035612-project Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance b27bb91b-1dab-4d8a-b388-09b2427931a9 could not be found. Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'b27bb91b-1dab-4d8a-b388-09b2427931a9'} Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b27bb91b-1dab-4d8a-b388-09b2427931a9 could not be found. Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b27bb91b-1dab-4d8a-b388-09b2427931a9 could not be found. Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:14:52.827162 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:14:52.831532 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:14:52.831532 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:14:52.831532 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:14:52.831532 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:14:52.831532 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:14:52.831532 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b27bb91b-1dab-4d8a-b388-09b2427931a9 could not be found. Aug 04 17:14:52.831532 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:14:52.831532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b2380b45-fbbe-4c51-bb09-4466d26acfb8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Returning 404 to user: Instance b27bb91b-1dab-4d8a-b388-09b2427931a9 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:14:52.833321 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b2380b45-fbbe-4c51-bb09-4466d26acfb8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9" status: 404 len: 111 microversion: 2.1 time: 0.060766 Aug 04 17:14:52.834475 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2310/4691] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:52 2022] GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:14:52.842216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a1e73954-7b4b-49e8-b6d2-1cce13731597 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:52.843141 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a1e73954-7b4b-49e8-b6d2-1cce13731597 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 134ac071-c06f-4195-9405-37e71e6d08a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:52.851844 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1e73954-7b4b-49e8-b6d2-1cce13731597 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:52.852567 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1e73954-7b4b-49e8-b6d2-1cce13731597 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:52.853343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1e73954-7b4b-49e8-b6d2-1cce13731597 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:52.854628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1e73954-7b4b-49e8-b6d2-1cce13731597 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:52.855253 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1e73954-7b4b-49e8-b6d2-1cce13731597 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:52.855815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23fc08ed-b84d-4735-bbb2-ea3c8f8ffc91 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:52.856019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1e73954-7b4b-49e8-b6d2-1cce13731597 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:52.857097 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23fc08ed-b84d-4735-bbb2-ea3c8f8ffc91 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:52.858523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23fc08ed-b84d-4735-bbb2-ea3c8f8ffc91 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:52.862539 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23fc08ed-b84d-4735-bbb2-ea3c8f8ffc91 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:52.863255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23fc08ed-b84d-4735-bbb2-ea3c8f8ffc91 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:52.863778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23fc08ed-b84d-4735-bbb2-ea3c8f8ffc91 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:52.897256 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a1e73954-7b4b-49e8-b6d2-1cce13731597 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 134ac071-c06f-4195-9405-37e71e6d08a9] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:14:53.022250 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a1e73954-7b4b-49e8-b6d2-1cce13731597 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "DELETE /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9" status: 204 len: 0 microversion: 2.1 time: 0.185610 Aug 04 17:14:53.026604 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2311/4692] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:14:52 2022] DELETE /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:14:53.033695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b50d72ad-7333-49b6-aed7-ee2a1f0d32fe tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:53.034652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b50d72ad-7333-49b6-aed7-ee2a1f0d32fe tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: edc8a6ac-f4f5-496f-867e-27b1ed15c833] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:53.042623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b50d72ad-7333-49b6-aed7-ee2a1f0d32fe tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:53.043124 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b50d72ad-7333-49b6-aed7-ee2a1f0d32fe tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:53.044718 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b50d72ad-7333-49b6-aed7-ee2a1f0d32fe tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:53.045103 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b50d72ad-7333-49b6-aed7-ee2a1f0d32fe tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:53.045563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b50d72ad-7333-49b6-aed7-ee2a1f0d32fe tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:53.046008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b50d72ad-7333-49b6-aed7-ee2a1f0d32fe tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:53.082843 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-23fc08ed-b84d-4735-bbb2-ea3c8f8ffc91 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:53.091170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b50d72ad-7333-49b6-aed7-ee2a1f0d32fe tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: edc8a6ac-f4f5-496f-867e-27b1ed15c833] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:14:53.092707 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-23fc08ed-b84d-4735-bbb2-ea3c8f8ffc91 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:53.095550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-23fc08ed-b84d-4735-bbb2-ea3c8f8ffc91 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:53.096732 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-23fc08ed-b84d-4735-bbb2-ea3c8f8ffc91 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1809 microversion: 2.20 time: 0.280471 Aug 04 17:14:53.099439 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2382/4693] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:52 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1809 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:14:53.104958 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ea01fc74-72a7-432a-afeb-f1689acab78b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:53.108832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ea01fc74-72a7-432a-afeb-f1689acab78b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 134ac071-c06f-4195-9405-37e71e6d08a9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:53.123893 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:53.126864 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea01fc74-72a7-432a-afeb-f1689acab78b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:53.127627 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea01fc74-72a7-432a-afeb-f1689acab78b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:53.128288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea01fc74-72a7-432a-afeb-f1689acab78b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:53.129230 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea01fc74-72a7-432a-afeb-f1689acab78b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:53.129925 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea01fc74-72a7-432a-afeb-f1689acab78b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:53.130593 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea01fc74-72a7-432a-afeb-f1689acab78b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:53.198091 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b50d72ad-7333-49b6-aed7-ee2a1f0d32fe tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "DELETE /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833" status: 204 len: 0 microversion: 2.1 time: 0.169393 Aug 04 17:14:53.198738 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2312/4694] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:14:53 2022] DELETE /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:14:53.205575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b9acb535-08e4-4aba-9fa4-8c2b900eb630 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:53.206547 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b9acb535-08e4-4aba-9fa4-8c2b900eb630 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:53.214784 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9acb535-08e4-4aba-9fa4-8c2b900eb630 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:53.215612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9acb535-08e4-4aba-9fa4-8c2b900eb630 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:53.216352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9acb535-08e4-4aba-9fa4-8c2b900eb630 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:53.218376 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9acb535-08e4-4aba-9fa4-8c2b900eb630 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:53.219122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9acb535-08e4-4aba-9fa4-8c2b900eb630 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:53.219764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9acb535-08e4-4aba-9fa4-8c2b900eb630 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:53.348532 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ea01fc74-72a7-432a-afeb-f1689acab78b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:53.365849 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ea01fc74-72a7-432a-afeb-f1689acab78b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9" status: 200 len: 1527 microversion: 2.1 time: 0.263564 Aug 04 17:14:53.366748 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2383/4695] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:53 2022] GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9 => generated 1527 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:53.391715 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bdf2e7c9-3c29-467a-96c9-59fea1a48bec tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:53.392789 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bdf2e7c9-3c29-467a-96c9-59fea1a48bec tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: edc8a6ac-f4f5-496f-867e-27b1ed15c833] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:53.401279 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bdf2e7c9-3c29-467a-96c9-59fea1a48bec tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:53.402967 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bdf2e7c9-3c29-467a-96c9-59fea1a48bec tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:53.402967 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bdf2e7c9-3c29-467a-96c9-59fea1a48bec tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:53.403281 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bdf2e7c9-3c29-467a-96c9-59fea1a48bec tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:53.404051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bdf2e7c9-3c29-467a-96c9-59fea1a48bec tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:53.415251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bdf2e7c9-3c29-467a-96c9-59fea1a48bec tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:53.477936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b9acb535-08e4-4aba-9fa4-8c2b900eb630 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:53.486247 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b9acb535-08e4-4aba-9fa4-8c2b900eb630 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1680 microversion: 2.1 time: 0.286201 Aug 04 17:14:53.487114 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2313/4696] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:53 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1680 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:53.620983 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bdf2e7c9-3c29-467a-96c9-59fea1a48bec tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:53.637149 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bdf2e7c9-3c29-467a-96c9-59fea1a48bec tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833" status: 200 len: 1497 microversion: 2.1 time: 0.268959 Aug 04 17:14:53.637831 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2384/4697] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:53 2022] GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833 => generated 1497 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:53.734481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6d5e59a2-44ec-48a2-9b84-3c24a11ca05e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:53.735102 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6d5e59a2-44ec-48a2-9b84-3c24a11ca05e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] [instance: 930cda99-f658-44c9-bb85-da349e9e5aeb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:53.741156 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d5e59a2-44ec-48a2-9b84-3c24a11ca05e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:53.741655 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d5e59a2-44ec-48a2-9b84-3c24a11ca05e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:53.742183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d5e59a2-44ec-48a2-9b84-3c24a11ca05e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:53.742897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d5e59a2-44ec-48a2-9b84-3c24a11ca05e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:53.743368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d5e59a2-44ec-48a2-9b84-3c24a11ca05e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:53.743804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d5e59a2-44ec-48a2-9b84-3c24a11ca05e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:53.759645 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-6d5e59a2-44ec-48a2-9b84-3c24a11ca05e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] HTTP exception thrown: Instance 930cda99-f658-44c9-bb85-da349e9e5aeb could not be found. Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6d5e59a2-44ec-48a2-9b84-3c24a11ca05e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Request method failure captured: Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb HTTP/1.1 Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_1KcpG4juUr2VEfzShlgrBBMonXazIZnBtgobublSG0FrbL-f6glawbXIezuRVmeGIpCPKZ2_FVYi6XXX8bEGfzlmqPmHXf6Tacw6jDfV9QuP1xJWCSlbaybEtYK4vIloCt34qv4iEL4IzCpH1AIgjNgga3059ie-t_wAucPvDkWig Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 50d2f7cd670340adb1b4187754e302c5 Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1121530457 Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/50d2f7cd670340adb1b4187754e302c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/50d2f7cd670340adb1b4187754e302c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_50d2f7cd670340adb1b4187754e302c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/50d2f7cd670340adb1b4187754e302c5"}]}] Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1121530457 Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 50d2f7cd670340adb1b4187754e302c5 Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1121530457 Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServerRescueNegativeTestJSON-1121530457-project Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 067e98d624234a48bb0ea3bde77c049c Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1121530457-project Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 930cda99-f658-44c9-bb85-da349e9e5aeb could not be found. Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '930cda99-f658-44c9-bb85-da349e9e5aeb'} Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 930cda99-f658-44c9-bb85-da349e9e5aeb could not be found. Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 930cda99-f658-44c9-bb85-da349e9e5aeb could not be found. Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:14:53.761303 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:14:53.765046 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:14:53.765046 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:14:53.765046 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:14:53.765046 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:14:53.765046 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:14:53.765046 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:14:53.765046 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 930cda99-f658-44c9-bb85-da349e9e5aeb could not be found. Aug 04 17:14:53.765046 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:14:53.766739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6d5e59a2-44ec-48a2-9b84-3c24a11ca05e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] Returning 404 to user: Instance 930cda99-f658-44c9-bb85-da349e9e5aeb could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:14:53.767805 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6d5e59a2-44ec-48a2-9b84-3c24a11ca05e tempest-ServerRescueNegativeTestJSON-1121530457 tempest-ServerRescueNegativeTestJSON-1121530457-project] 10.222.0.93 "GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb" status: 404 len: 111 microversion: 2.1 time: 0.037829 Aug 04 17:14:53.768451 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2314/4698] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:53 2022] GET /compute/v2.1/servers/930cda99-f658-44c9-bb85-da349e9e5aeb => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:14:54.125088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-84482e83-c48c-4cf3-9882-e796058fb1eb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:54.125632 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-84482e83-c48c-4cf3-9882-e796058fb1eb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:54.132722 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84482e83-c48c-4cf3-9882-e796058fb1eb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:54.133214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84482e83-c48c-4cf3-9882-e796058fb1eb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:54.133656 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84482e83-c48c-4cf3-9882-e796058fb1eb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:54.134402 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84482e83-c48c-4cf3-9882-e796058fb1eb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:54.135044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84482e83-c48c-4cf3-9882-e796058fb1eb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:54.135481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84482e83-c48c-4cf3-9882-e796058fb1eb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:54.352936 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-84482e83-c48c-4cf3-9882-e796058fb1eb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:54.361768 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-84482e83-c48c-4cf3-9882-e796058fb1eb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:54.363994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-84482e83-c48c-4cf3-9882-e796058fb1eb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:54.365536 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-84482e83-c48c-4cf3-9882-e796058fb1eb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1809 microversion: 2.20 time: 0.244370 Aug 04 17:14:54.377309 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2385/4699] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:54 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1809 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:14:54.392302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-99250e91-f006-423c-ae8c-ce0fcb9a6d6b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:54.394225 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-99250e91-f006-423c-ae8c-ce0fcb9a6d6b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 134ac071-c06f-4195-9405-37e71e6d08a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:54.402663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99250e91-f006-423c-ae8c-ce0fcb9a6d6b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:54.403291 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99250e91-f006-423c-ae8c-ce0fcb9a6d6b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:54.403803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99250e91-f006-423c-ae8c-ce0fcb9a6d6b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:54.404765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99250e91-f006-423c-ae8c-ce0fcb9a6d6b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:54.405364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99250e91-f006-423c-ae8c-ce0fcb9a6d6b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:54.405873 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99250e91-f006-423c-ae8c-ce0fcb9a6d6b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:54.509363 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7d668fcc-7df1-44d3-8713-5c6d75e10e09 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:54.510350 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7d668fcc-7df1-44d3-8713-5c6d75e10e09 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:54.517319 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d668fcc-7df1-44d3-8713-5c6d75e10e09 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:54.518089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d668fcc-7df1-44d3-8713-5c6d75e10e09 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:54.519088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d668fcc-7df1-44d3-8713-5c6d75e10e09 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:54.519670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d668fcc-7df1-44d3-8713-5c6d75e10e09 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:54.520379 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d668fcc-7df1-44d3-8713-5c6d75e10e09 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:54.521028 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d668fcc-7df1-44d3-8713-5c6d75e10e09 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:54.712224 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-99250e91-f006-423c-ae8c-ce0fcb9a6d6b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:54.716683 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:14:54.722111 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-99250e91-f006-423c-ae8c-ce0fcb9a6d6b tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9" status: 200 len: 1527 microversion: 2.1 time: 0.335097 Aug 04 17:14:54.746607 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2315/4700] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:54 2022] GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9 => generated 1527 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:14:54.760304 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-04346d51-fe88-43af-bca7-e56967c77d5d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:54.760957 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-04346d51-fe88-43af-bca7-e56967c77d5d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: edc8a6ac-f4f5-496f-867e-27b1ed15c833] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:54.769277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04346d51-fe88-43af-bca7-e56967c77d5d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:54.769795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04346d51-fe88-43af-bca7-e56967c77d5d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:54.770250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04346d51-fe88-43af-bca7-e56967c77d5d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:54.771022 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04346d51-fe88-43af-bca7-e56967c77d5d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:54.771469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04346d51-fe88-43af-bca7-e56967c77d5d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:54.771900 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04346d51-fe88-43af-bca7-e56967c77d5d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:54.781031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7d668fcc-7df1-44d3-8713-5c6d75e10e09 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:54.792636 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7d668fcc-7df1-44d3-8713-5c6d75e10e09 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1680 microversion: 2.1 time: 0.288648 Aug 04 17:14:54.797731 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2386/4701] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:54 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1680 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:14:55.005300 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-04346d51-fe88-43af-bca7-e56967c77d5d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:55.015486 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-04346d51-fe88-43af-bca7-e56967c77d5d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833" status: 200 len: 1497 microversion: 2.1 time: 0.266940 Aug 04 17:14:55.030072 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2316/4702] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:54 2022] GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833 => generated 1497 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:55.391957 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4bc979b9-98af-4f1f-8185-3104948e19f2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:55.392173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4bc979b9-98af-4f1f-8185-3104948e19f2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:55.399999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4bc979b9-98af-4f1f-8185-3104948e19f2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:55.400728 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4bc979b9-98af-4f1f-8185-3104948e19f2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:55.401545 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4bc979b9-98af-4f1f-8185-3104948e19f2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:55.402547 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4bc979b9-98af-4f1f-8185-3104948e19f2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:55.403158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4bc979b9-98af-4f1f-8185-3104948e19f2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:55.403740 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4bc979b9-98af-4f1f-8185-3104948e19f2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:55.747447 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2dfbff76-27eb-411f-bd8d-2e1839dc0ea3 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:55.750337 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2dfbff76-27eb-411f-bd8d-2e1839dc0ea3 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 134ac071-c06f-4195-9405-37e71e6d08a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:55.774214 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2dfbff76-27eb-411f-bd8d-2e1839dc0ea3 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:55.778849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2dfbff76-27eb-411f-bd8d-2e1839dc0ea3 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:55.780041 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2dfbff76-27eb-411f-bd8d-2e1839dc0ea3 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:55.780862 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2dfbff76-27eb-411f-bd8d-2e1839dc0ea3 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:55.781337 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2dfbff76-27eb-411f-bd8d-2e1839dc0ea3 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:55.781763 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2dfbff76-27eb-411f-bd8d-2e1839dc0ea3 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:55.785657 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4bc979b9-98af-4f1f-8185-3104948e19f2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:55.803213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4bc979b9-98af-4f1f-8185-3104948e19f2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:55.814111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4bc979b9-98af-4f1f-8185-3104948e19f2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:55.816180 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4bc979b9-98af-4f1f-8185-3104948e19f2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1809 microversion: 2.20 time: 0.429121 Aug 04 17:14:55.831508 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2387/4703] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:55 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1809 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:14:55.863613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9bac78c2-223b-49f6-996a-fb7223b49a38 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:55.864434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9bac78c2-223b-49f6-996a-fb7223b49a38 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:55.876681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9bac78c2-223b-49f6-996a-fb7223b49a38 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:55.878234 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9bac78c2-223b-49f6-996a-fb7223b49a38 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:55.879285 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9bac78c2-223b-49f6-996a-fb7223b49a38 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:55.880955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9bac78c2-223b-49f6-996a-fb7223b49a38 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:55.882019 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9bac78c2-223b-49f6-996a-fb7223b49a38 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:55.883052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9bac78c2-223b-49f6-996a-fb7223b49a38 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:56.163771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2dfbff76-27eb-411f-bd8d-2e1839dc0ea3 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:56.176160 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2dfbff76-27eb-411f-bd8d-2e1839dc0ea3 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9" status: 200 len: 1485 microversion: 2.1 time: 0.435205 Aug 04 17:14:56.178052 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2317/4704] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:55 2022] GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9 => generated 1485 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:56.183612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-49bf2516-b3b2-478a-93e5-e7bdacb4a99b req-40429c20-67a8-4f03-a471-d8647ff328a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "134ac071-c06f-4195-9405-37e71e6d08a9", "name": "network-vif-deleted", "tag": "0cab5fbd-8e6f-4623-a7d3-44f33d164fda"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:56.195234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-49bf2516-b3b2-478a-93e5-e7bdacb4a99b req-40429c20-67a8-4f03-a471-d8647ff328a3 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:56.195966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-49bf2516-b3b2-478a-93e5-e7bdacb4a99b req-40429c20-67a8-4f03-a471-d8647ff328a3 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:56.196474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-49bf2516-b3b2-478a-93e5-e7bdacb4a99b req-40429c20-67a8-4f03-a471-d8647ff328a3 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:56.210655 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-49bf2516-b3b2-478a-93e5-e7bdacb4a99b req-40429c20-67a8-4f03-a471-d8647ff328a3 service nova] Creating event network-vif-deleted:0cab5fbd-8e6f-4623-a7d3-44f33d164fda for instance 134ac071-c06f-4195-9405-37e71e6d08a9 on n-h1-851359-3 Aug 04 17:14:56.218509 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-49bf2516-b3b2-478a-93e5-e7bdacb4a99b req-40429c20-67a8-4f03-a471-d8647ff328a3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038105 Aug 04 17:14:56.223000 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2318/4705] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:14:56.230364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fd6639f4-4936-438d-a5aa-08e4c1643e7a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:56.231832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fd6639f4-4936-438d-a5aa-08e4c1643e7a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: edc8a6ac-f4f5-496f-867e-27b1ed15c833] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:56.239922 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd6639f4-4936-438d-a5aa-08e4c1643e7a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:56.240627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd6639f4-4936-438d-a5aa-08e4c1643e7a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:56.241291 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd6639f4-4936-438d-a5aa-08e4c1643e7a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:56.242202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd6639f4-4936-438d-a5aa-08e4c1643e7a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:56.242832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd6639f4-4936-438d-a5aa-08e4c1643e7a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:56.243602 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd6639f4-4936-438d-a5aa-08e4c1643e7a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:57.245216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9bac78c2-223b-49f6-996a-fb7223b49a38 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:57.260927 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9bac78c2-223b-49f6-996a-fb7223b49a38 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1657 microversion: 2.1 time: 1.427625 Aug 04 17:14:57.261862 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2388/4706] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:55 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1657 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:57.288536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-37444c1e-7fa9-4f12-ae92-ae3978bcaaa4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:57.301254 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-37444c1e-7fa9-4f12-ae92-ae3978bcaaa4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:57.345420 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37444c1e-7fa9-4f12-ae92-ae3978bcaaa4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:57.351491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37444c1e-7fa9-4f12-ae92-ae3978bcaaa4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:57.356939 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37444c1e-7fa9-4f12-ae92-ae3978bcaaa4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:57.357760 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37444c1e-7fa9-4f12-ae92-ae3978bcaaa4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:57.358295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37444c1e-7fa9-4f12-ae92-ae3978bcaaa4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:57.358741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37444c1e-7fa9-4f12-ae92-ae3978bcaaa4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:57.653804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fd6639f4-4936-438d-a5aa-08e4c1643e7a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:57.668248 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fd6639f4-4936-438d-a5aa-08e4c1643e7a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833" status: 200 len: 1497 microversion: 2.1 time: 1.443736 Aug 04 17:14:57.670004 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2319/4707] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:56 2022] GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833 => generated 1497 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:57.675469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a777ad56-c0a3-4e49-ae65-6602f4d33ad8 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:57.677012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a777ad56-c0a3-4e49-ae65-6602f4d33ad8 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 134ac071-c06f-4195-9405-37e71e6d08a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:57.688704 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a777ad56-c0a3-4e49-ae65-6602f4d33ad8 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:57.689383 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a777ad56-c0a3-4e49-ae65-6602f4d33ad8 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:57.689860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a777ad56-c0a3-4e49-ae65-6602f4d33ad8 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:57.690565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a777ad56-c0a3-4e49-ae65-6602f4d33ad8 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:57.691044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a777ad56-c0a3-4e49-ae65-6602f4d33ad8 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:57.691473 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a777ad56-c0a3-4e49-ae65-6602f4d33ad8 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:57.707285 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-a777ad56-c0a3-4e49-ae65-6602f4d33ad8 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] HTTP exception thrown: Instance 134ac071-c06f-4195-9405-37e71e6d08a9 could not be found. Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a777ad56-c0a3-4e49-ae65-6602f4d33ad8 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Request method failure captured: Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9 HTTP/1.1 Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_4xbB8fnr17iZxpZmQfQZiM2JCxKiVWWUXjZiHpHTuUHHVw7ao4oT_uZW8wxu89NvTWOIVQIIqQPmHAao-lpxs7gxXuSYKOkaP9AGGwPUmZ0l1sD6ZLIZdH6-nP_cliwrHT6QFXnVMcXHLYBwQRQIzx4m2gYEscPKDx2pEzeM4vYGU Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 85c97e15d470473189d8a6c2068e9eac Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/85c97e15d470473189d8a6c2068e9eac"}]}] Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 85c97e15d470473189d8a6c2068e9eac Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ImagesOneServerNegativeTestJSON-1209884465-project Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 6791b833351c493a8e581154c2dfb8d7 Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465-project Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 134ac071-c06f-4195-9405-37e71e6d08a9 could not be found. Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '134ac071-c06f-4195-9405-37e71e6d08a9'} Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 134ac071-c06f-4195-9405-37e71e6d08a9 could not be found. Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 134ac071-c06f-4195-9405-37e71e6d08a9 could not be found. Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:14:57.709733 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:14:57.713831 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:14:57.713831 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:14:57.713831 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:14:57.713831 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:14:57.713831 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:14:57.713831 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:14:57.713831 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 134ac071-c06f-4195-9405-37e71e6d08a9 could not be found. Aug 04 17:14:57.713831 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:14:57.715578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a777ad56-c0a3-4e49-ae65-6602f4d33ad8 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Returning 404 to user: Instance 134ac071-c06f-4195-9405-37e71e6d08a9 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:14:57.716792 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a777ad56-c0a3-4e49-ae65-6602f4d33ad8 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9" status: 404 len: 111 microversion: 2.1 time: 0.045606 Aug 04 17:14:57.717728 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2320/4708] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:57 2022] GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:14:57.722968 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2831f878-a997-45db-8e53-8e8ced7bb233 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:57.766985 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2831f878-a997-45db-8e53-8e8ced7bb233 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:57.769610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2831f878-a997-45db-8e53-8e8ced7bb233 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:57.770303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2831f878-a997-45db-8e53-8e8ced7bb233 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:57.826159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2831f878-a997-45db-8e53-8e8ced7bb233 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Going to try to start instance {{(pid=131044) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 17:14:57.985548 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2831f878-a997-45db-8e53-8e8ced7bb233 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action" status: 202 len: 0 microversion: 2.1 time: 0.264526 Aug 04 17:14:57.995286 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2321/4709] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:14:57 2022] POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:14:57.999989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-427580e7-714c-426c-8c98-1fd09ad4cf18 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1846564292", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:58.113219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-427580e7-714c-426c-8c98-1fd09ad4cf18 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] validate_networks() for [('3217db81-b57f-4c04-a0d3-93f4607c02ae', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:14:58.321946 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-37444c1e-7fa9-4f12-ae92-ae3978bcaaa4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:58.336014 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-37444c1e-7fa9-4f12-ae92-ae3978bcaaa4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:58.340116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-37444c1e-7fa9-4f12-ae92-ae3978bcaaa4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:58.347363 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-37444c1e-7fa9-4f12-ae92-ae3978bcaaa4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1809 microversion: 2.20 time: 1.083368 Aug 04 17:14:58.348122 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2389/4710] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:14:57 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1809 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:14:58.357186 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7fe358f7-279b-456c-a7f0-b691441439c6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:58.363624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7fe358f7-279b-456c-a7f0-b691441439c6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:58.376850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7fe358f7-279b-456c-a7f0-b691441439c6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:58.378394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7fe358f7-279b-456c-a7f0-b691441439c6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:58.384068 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7fe358f7-279b-456c-a7f0-b691441439c6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:58.390536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7fe358f7-279b-456c-a7f0-b691441439c6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:58.391351 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7fe358f7-279b-456c-a7f0-b691441439c6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:58.392551 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7fe358f7-279b-456c-a7f0-b691441439c6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:58.655679 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7fe358f7-279b-456c-a7f0-b691441439c6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:14:58.669824 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7fe358f7-279b-456c-a7f0-b691441439c6 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1666 microversion: 2.1 time: 0.315358 Aug 04 17:14:58.682056 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2390/4711] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:58 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1666 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:14:58.683205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-3a18da29-9dfc-4e37-badf-a24a447ebea9 req-02ea255d-250a-4cd7-897e-68005d4bf3fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc8a6ac-f4f5-496f-867e-27b1ed15c833", "name": "network-vif-deleted", "tag": "fef85cf0-8d56-4436-817e-3bc44fd6688a"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:58.700567 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-3a18da29-9dfc-4e37-badf-a24a447ebea9 req-02ea255d-250a-4cd7-897e-68005d4bf3fd service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:58.701915 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-3a18da29-9dfc-4e37-badf-a24a447ebea9 req-02ea255d-250a-4cd7-897e-68005d4bf3fd service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:58.703287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-3a18da29-9dfc-4e37-badf-a24a447ebea9 req-02ea255d-250a-4cd7-897e-68005d4bf3fd service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:58.723794 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-3a18da29-9dfc-4e37-badf-a24a447ebea9 req-02ea255d-250a-4cd7-897e-68005d4bf3fd service nova] Creating event network-vif-deleted:fef85cf0-8d56-4436-817e-3bc44fd6688a for instance edc8a6ac-f4f5-496f-867e-27b1ed15c833 on n-h2-851359-3 Aug 04 17:14:58.731978 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-3a18da29-9dfc-4e37-badf-a24a447ebea9 req-02ea255d-250a-4cd7-897e-68005d4bf3fd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058378 Aug 04 17:14:58.733294 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2391/4712] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:14:58.741403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-06f157b4-69dd-48d0-957e-cb674d3c770f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:58.742539 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-06f157b4-69dd-48d0-957e-cb674d3c770f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: edc8a6ac-f4f5-496f-867e-27b1ed15c833] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:58.753066 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-06f157b4-69dd-48d0-957e-cb674d3c770f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:58.753913 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-06f157b4-69dd-48d0-957e-cb674d3c770f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:58.754595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-06f157b4-69dd-48d0-957e-cb674d3c770f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:58.755728 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-06f157b4-69dd-48d0-957e-cb674d3c770f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:58.756382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-06f157b4-69dd-48d0-957e-cb674d3c770f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:58.757090 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-06f157b4-69dd-48d0-957e-cb674d3c770f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:58.790704 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-06f157b4-69dd-48d0-957e-cb674d3c770f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] HTTP exception thrown: Instance edc8a6ac-f4f5-496f-867e-27b1ed15c833 could not be found. Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-06f157b4-69dd-48d0-957e-cb674d3c770f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Request method failure captured: Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833 HTTP/1.1 Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_4PiXAoqFPCXVrtw_fcVtbWCRHCRY1BcfprLEe-EkZEFmD3rLGum9OIJcRnH-o3xr4k8T7yl4V2Hv5h2fEBByVUFBw2XIbz_i_ncVR1MMvkDEp1AvjPEGXUtr2hnsv9JoWINOTj84eRxq_Gac5VyTIxXMDaWbVLw5VeWNnbunOt5QM Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d9911aeb77cd4ffb8c4e539998a04f3c"}]}] Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersTestJSON-1653035612 Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersTestJSON-1653035612-project Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 8e840d06bb5d44e097e6f0855b04cb06 Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersTestJSON-1653035612-project Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance edc8a6ac-f4f5-496f-867e-27b1ed15c833 could not be found. Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'edc8a6ac-f4f5-496f-867e-27b1ed15c833'} Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc8a6ac-f4f5-496f-867e-27b1ed15c833 could not be found. Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc8a6ac-f4f5-496f-867e-27b1ed15c833 could not be found. Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:14:58.795989 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:14:58.799629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:14:58.799629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:14:58.799629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:14:58.799629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:14:58.799629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:14:58.799629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc8a6ac-f4f5-496f-867e-27b1ed15c833 could not be found. Aug 04 17:14:58.799629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:14:58.799629 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-06f157b4-69dd-48d0-957e-cb674d3c770f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Returning 404 to user: Instance edc8a6ac-f4f5-496f-867e-27b1ed15c833 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:14:58.800082 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-06f157b4-69dd-48d0-957e-cb674d3c770f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833" status: 404 len: 111 microversion: 2.1 time: 0.063909 Aug 04 17:14:58.804095 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2392/4713] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:14:58 2022] GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:14:58.966585 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-41136b94-5294-4097-b07d-04811edc7fbe tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1634218549", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "ec3b7b59-9fd4-4839-add6-43afeffa896c"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:14:59.081441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-41136b94-5294-4097-b07d-04811edc7fbe tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] validate_networks() for [('ec3b7b59-9fd4-4839-add6-43afeffa896c', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:14:59.733209 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-427580e7-714c-426c-8c98-1fd09ad4cf18 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:14:59.733716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-427580e7-714c-426c-8c98-1fd09ad4cf18 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:14:59.734508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-427580e7-714c-426c-8c98-1fd09ad4cf18 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:14:59.734962 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-427580e7-714c-426c-8c98-1fd09ad4cf18 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:14:59.735419 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-427580e7-714c-426c-8c98-1fd09ad4cf18 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:14:59.749070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-427580e7-714c-426c-8c98-1fd09ad4cf18 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:59.755104 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-427580e7-714c-426c-8c98-1fd09ad4cf18 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:59.755850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-427580e7-714c-426c-8c98-1fd09ad4cf18 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:59.756937 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-427580e7-714c-426c-8c98-1fd09ad4cf18 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:59.757434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-427580e7-714c-426c-8c98-1fd09ad4cf18 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:59.757861 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-427580e7-714c-426c-8c98-1fd09ad4cf18 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:59.795882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-427580e7-714c-426c-8c98-1fd09ad4cf18 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Getting quotas for project 85c97e15d470473189d8a6c2068e9eac. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:14:59.817668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-427580e7-714c-426c-8c98-1fd09ad4cf18 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Getting quotas for user 6791b833351c493a8e581154c2dfb8d7 and project 85c97e15d470473189d8a6c2068e9eac. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:14:59.858176 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-427580e7-714c-426c-8c98-1fd09ad4cf18 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:14:59.860764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-427580e7-714c-426c-8c98-1fd09ad4cf18 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 1a45e4c9-c9bd-4715-847d-6688654383c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:14:59.951527 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-427580e7-714c-426c-8c98-1fd09ad4cf18 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.957783 Aug 04 17:14:59.959329 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2322/4714] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:14:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 1966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:14:59.968065 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-46619bac-c368-44fa-adf5-5ff2eb736f08 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:14:59.968839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-46619bac-c368-44fa-adf5-5ff2eb736f08 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: c75ee070-7154-4d00-add1-674bb1c4b2b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:14:59.976463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46619bac-c368-44fa-adf5-5ff2eb736f08 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:59.977367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46619bac-c368-44fa-adf5-5ff2eb736f08 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:59.978019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46619bac-c368-44fa-adf5-5ff2eb736f08 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:14:59.985418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46619bac-c368-44fa-adf5-5ff2eb736f08 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:14:59.986177 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46619bac-c368-44fa-adf5-5ff2eb736f08 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:14:59.986809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46619bac-c368-44fa-adf5-5ff2eb736f08 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:00.038879 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-46619bac-c368-44fa-adf5-5ff2eb736f08 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0/ips" status: 200 len: 150 microversion: 2.1 time: 0.077947 Aug 04 17:15:00.043461 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2323/4715] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Aug 4 17:14:59 2022] GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0/ips => generated 150 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:00.059543 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-35620382-5709-4935-b809-e79bda05d143 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:00.062210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-35620382-5709-4935-b809-e79bda05d143 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:00.078313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35620382-5709-4935-b809-e79bda05d143 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:00.078735 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35620382-5709-4935-b809-e79bda05d143 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:00.079192 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35620382-5709-4935-b809-e79bda05d143 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:00.079924 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35620382-5709-4935-b809-e79bda05d143 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:00.080393 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35620382-5709-4935-b809-e79bda05d143 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:00.080831 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35620382-5709-4935-b809-e79bda05d143 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:00.497753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-35620382-5709-4935-b809-e79bda05d143 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:00.508267 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-35620382-5709-4935-b809-e79bda05d143 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:00.510833 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-35620382-5709-4935-b809-e79bda05d143 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:00.512803 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-35620382-5709-4935-b809-e79bda05d143 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1796 microversion: 2.20 time: 0.467554 Aug 04 17:15:00.513932 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2324/4716] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:15:00 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1796 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:15:00.530979 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-63109b5e-5ce9-422a-96cb-956a1bab5acf tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:00.532614 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-63109b5e-5ce9-422a-96cb-956a1bab5acf tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:00.545409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63109b5e-5ce9-422a-96cb-956a1bab5acf tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:00.548695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63109b5e-5ce9-422a-96cb-956a1bab5acf tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:00.549346 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63109b5e-5ce9-422a-96cb-956a1bab5acf tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:00.550544 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63109b5e-5ce9-422a-96cb-956a1bab5acf tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:00.551470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63109b5e-5ce9-422a-96cb-956a1bab5acf tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:00.552983 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63109b5e-5ce9-422a-96cb-956a1bab5acf tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:00.567244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-41136b94-5294-4097-b07d-04811edc7fbe tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:15:00.568566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-41136b94-5294-4097-b07d-04811edc7fbe tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:15:00.569444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-41136b94-5294-4097-b07d-04811edc7fbe tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:15:00.570128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-41136b94-5294-4097-b07d-04811edc7fbe tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:15:00.570719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-41136b94-5294-4097-b07d-04811edc7fbe tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:15:00.625707 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-41136b94-5294-4097-b07d-04811edc7fbe tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:00.626240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-41136b94-5294-4097-b07d-04811edc7fbe tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:00.626686 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-41136b94-5294-4097-b07d-04811edc7fbe tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:00.627433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-41136b94-5294-4097-b07d-04811edc7fbe tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:00.627895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-41136b94-5294-4097-b07d-04811edc7fbe tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:00.628330 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-41136b94-5294-4097-b07d-04811edc7fbe tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:00.690142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-41136b94-5294-4097-b07d-04811edc7fbe tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Getting quotas for project d9911aeb77cd4ffb8c4e539998a04f3c. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:15:00.699867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-41136b94-5294-4097-b07d-04811edc7fbe tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Getting quotas for user 8e840d06bb5d44e097e6f0855b04cb06 and project d9911aeb77cd4ffb8c4e539998a04f3c. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:15:00.735952 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-41136b94-5294-4097-b07d-04811edc7fbe tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:15:00.739149 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-41136b94-5294-4097-b07d-04811edc7fbe tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 314e3218-a990-4be2-aef1-d69a055897e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:15:00.835884 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-41136b94-5294-4097-b07d-04811edc7fbe tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.873836 Aug 04 17:15:00.837295 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2393/4717] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:14:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 17:15:00.845138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-36a39ca4-3d86-479d-b889-a1909a8e4bda tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:00.846237 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-36a39ca4-3d86-479d-b889-a1909a8e4bda tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 1a45e4c9-c9bd-4715-847d-6688654383c7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:01.109192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-36a39ca4-3d86-479d-b889-a1909a8e4bda tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:01.117483 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-36a39ca4-3d86-479d-b889-a1909a8e4bda tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7" status: 200 len: 1225 microversion: 2.1 time: 0.278644 Aug 04 17:15:01.118532 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2394/4718] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:00 2022] GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7 => generated 1225 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:01.125208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-69cf3795-3b5d-4fc4-b2d9-f0cac4a8e4c2 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8418314-721f-4e67-81d4-699a10c130ed"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:01.128484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-69cf3795-3b5d-4fc4-b2d9-f0cac4a8e4c2 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: c75ee070-7154-4d00-add1-674bb1c4b2b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:01.140630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-69cf3795-3b5d-4fc4-b2d9-f0cac4a8e4c2 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:01.141238 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-69cf3795-3b5d-4fc4-b2d9-f0cac4a8e4c2 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:01.141754 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-69cf3795-3b5d-4fc4-b2d9-f0cac4a8e4c2 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:01.142852 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-69cf3795-3b5d-4fc4-b2d9-f0cac4a8e4c2 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:01.143419 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-69cf3795-3b5d-4fc4-b2d9-f0cac4a8e4c2 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:01.143913 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-69cf3795-3b5d-4fc4-b2d9-f0cac4a8e4c2 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:01.291081 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-69cf3795-3b5d-4fc4-b2d9-f0cac4a8e4c2 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] HTTP exception thrown: Invalid volume: volume e8418314-721f-4e67-81d4-699a10c130ed is already attached to instances: 947ffe69-3080-4602-872d-1bb16591d34e Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-69cf3795-3b5d-4fc4-b2d9-f0cac4a8e4c2 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Request method failure captured: Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0/os-volume_attachments HTTP/1.1 Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 74 Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_20IgjlzOhiiXNFc-NV1FHodxKmWXqSdjZ2I3CqIylUHNkhkG-JAGdMPdYL-8rZzM7v2_0KXVTorBGskuo6vUXRtOSVoO1KTIHw44-u5yCDnlwK7XKRi3uI2OBhda5ANtzdvy-06i9FyD27hM6LxpcHB7QNnHGthqSv2gOLnkKiVjg Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 80bc576163414daba5f5315c4a785533 Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/80bc576163414daba5f5315c4a785533"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/80bc576163414daba5f5315c4a785533"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_80bc576163414daba5f5315c4a785533"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/80bc576163414daba5f5315c4a785533"}]}] Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 80bc576163414daba5f5315c4a785533 Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-AttachVolumeNegativeTest-1565246319-project Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 5b10b58bf3df46d18bff092022b08e0f Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-AttachVolumeNegativeTest-1565246319-project Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: {"volumeAttachment": {"volumeId": "e8418314-721f-4e67-81d4-699a10c130ed"}} Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: exception: Invalid volume: volume e8418314-721f-4e67-81d4-699a10c130ed is already attached to instances: 947ffe69-3080-4602-872d-1bb16591d34e Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'server_id': 'c75ee070-7154-4d00-add1-674bb1c4b2b0', 'body': {'volumeAttachment': {'volumeId': 'e8418314-721f-4e67-81d4-699a10c130ed'}}} Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e8418314-721f-4e67-81d4-699a10c130ed is already attached to instances: 947ffe69-3080-4602-872d-1bb16591d34e Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:15:01.297503 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:15:01.302361 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:15:01.302361 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:15:01.302361 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 04 17:15:01.302361 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 17:15:01.302361 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e8418314-721f-4e67-81d4-699a10c130ed is already attached to instances: 947ffe69-3080-4602-872d-1bb16591d34e Aug 04 17:15:01.302361 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:01.302361 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:01.302361 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:01.302361 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:01.302361 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:01.302361 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:01.302361 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:15:01.302361 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:15:01.302361 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e8418314-721f-4e67-81d4-699a10c130ed is already attached to instances: 947ffe69-3080-4602-872d-1bb16591d34e Aug 04 17:15:01.302361 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:01.311015 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-69cf3795-3b5d-4fc4-b2d9-f0cac4a8e4c2 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Returning 400 to user: Invalid volume: volume e8418314-721f-4e67-81d4-699a10c130ed is already attached to instances: 947ffe69-3080-4602-872d-1bb16591d34e {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:15:01.312194 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-69cf3795-3b5d-4fc4-b2d9-f0cac4a8e4c2 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "POST /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.191501 Aug 04 17:15:01.315202 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2395/4719] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Aug 4 17:15:01 2022] POST /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0/os-volume_attachments => generated 174 bytes in 196 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:15:01.326124 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a7740673-22d9-4126-84d6-e01dffdf5e7d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:01.327056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a7740673-22d9-4126-84d6-e01dffdf5e7d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 314e3218-a990-4be2-aef1-d69a055897e9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:01.411606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a7740673-22d9-4126-84d6-e01dffdf5e7d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:01.421885 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a7740673-22d9-4126-84d6-e01dffdf5e7d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9" status: 200 len: 1209 microversion: 2.1 time: 0.104838 Aug 04 17:15:01.422144 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-63109b5e-5ce9-422a-96cb-956a1bab5acf tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:01.422624 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2396/4720] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:01 2022] GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9 => generated 1209 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:01.432822 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1f40a94e-127f-4d44-9399-896a1e4d7d5d tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:01.433341 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1f40a94e-127f-4d44-9399-896a1e4d7d5d tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: c75ee070-7154-4d00-add1-674bb1c4b2b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:01.444220 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-63109b5e-5ce9-422a-96cb-956a1bab5acf tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.928668 Aug 04 17:15:01.444813 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2325/4721] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:00 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:01.467628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4dda5820-1b6c-413d-b4ad-2d51c69b7953 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:01.467844 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f40a94e-127f-4d44-9399-896a1e4d7d5d tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:01.468437 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f40a94e-127f-4d44-9399-896a1e4d7d5d tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:01.468652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4dda5820-1b6c-413d-b4ad-2d51c69b7953 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:01.469877 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f40a94e-127f-4d44-9399-896a1e4d7d5d tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:01.472622 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f40a94e-127f-4d44-9399-896a1e4d7d5d tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:01.473414 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f40a94e-127f-4d44-9399-896a1e4d7d5d tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:01.474198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f40a94e-127f-4d44-9399-896a1e4d7d5d tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:01.485094 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dda5820-1b6c-413d-b4ad-2d51c69b7953 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:01.485605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dda5820-1b6c-413d-b4ad-2d51c69b7953 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:01.486081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dda5820-1b6c-413d-b4ad-2d51c69b7953 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:01.490194 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dda5820-1b6c-413d-b4ad-2d51c69b7953 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:01.490975 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dda5820-1b6c-413d-b4ad-2d51c69b7953 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:01.491958 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dda5820-1b6c-413d-b4ad-2d51c69b7953 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:01.509097 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1f40a94e-127f-4d44-9399-896a1e4d7d5d tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: c75ee070-7154-4d00-add1-674bb1c4b2b0] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:15:01.566778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:01.666222 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1f40a94e-127f-4d44-9399-896a1e4d7d5d tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "DELETE /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0" status: 204 len: 0 microversion: 2.1 time: 0.241550 Aug 04 17:15:01.666917 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2397/4722] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:15:01 2022] DELETE /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:15:01.679054 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c40788b4-fab9-4550-a48d-1dc4a0f24b6b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:01.680922 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c40788b4-fab9-4550-a48d-1dc4a0f24b6b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: c75ee070-7154-4d00-add1-674bb1c4b2b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:01.689912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c40788b4-fab9-4550-a48d-1dc4a0f24b6b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:01.692388 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c40788b4-fab9-4550-a48d-1dc4a0f24b6b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:01.694643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c40788b4-fab9-4550-a48d-1dc4a0f24b6b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:01.697149 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c40788b4-fab9-4550-a48d-1dc4a0f24b6b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:01.699238 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c40788b4-fab9-4550-a48d-1dc4a0f24b6b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:01.702610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c40788b4-fab9-4550-a48d-1dc4a0f24b6b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:01.963077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4dda5820-1b6c-413d-b4ad-2d51c69b7953 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:01.975093 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4dda5820-1b6c-413d-b4ad-2d51c69b7953 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.512345 Aug 04 17:15:01.993053 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2326/4723] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:01 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:15:02.000859 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8488c794-483a-4ca9-877b-b3c52ff590a3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:02.002542 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8488c794-483a-4ca9-877b-b3c52ff590a3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:02.010916 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8488c794-483a-4ca9-877b-b3c52ff590a3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:02.013169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8488c794-483a-4ca9-877b-b3c52ff590a3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:02.013952 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8488c794-483a-4ca9-877b-b3c52ff590a3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:02.015084 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8488c794-483a-4ca9-877b-b3c52ff590a3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:02.015725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8488c794-483a-4ca9-877b-b3c52ff590a3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:02.016329 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8488c794-483a-4ca9-877b-b3c52ff590a3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:02.040495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c40788b4-fab9-4550-a48d-1dc4a0f24b6b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:02.053218 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c40788b4-fab9-4550-a48d-1dc4a0f24b6b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0" status: 200 len: 1682 microversion: 2.1 time: 0.381212 Aug 04 17:15:02.054453 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2398/4724] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:01 2022] GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0 => generated 1682 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:02.143971 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b62893de-6cfc-4433-857b-f5060223cda1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:02.144595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b62893de-6cfc-4433-857b-f5060223cda1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 1a45e4c9-c9bd-4715-847d-6688654383c7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:02.151369 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b62893de-6cfc-4433-857b-f5060223cda1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:02.152212 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b62893de-6cfc-4433-857b-f5060223cda1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:02.153410 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b62893de-6cfc-4433-857b-f5060223cda1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:02.154489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b62893de-6cfc-4433-857b-f5060223cda1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:02.155109 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b62893de-6cfc-4433-857b-f5060223cda1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:02.156246 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b62893de-6cfc-4433-857b-f5060223cda1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:02.273791 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b62893de-6cfc-4433-857b-f5060223cda1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:02.285656 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b62893de-6cfc-4433-857b-f5060223cda1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7" status: 200 len: 1285 microversion: 2.1 time: 0.145593 Aug 04 17:15:02.286749 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2399/4725] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:02 2022] GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7 => generated 1285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:15:02.300520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8488c794-483a-4ca9-877b-b3c52ff590a3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:02.309924 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8488c794-483a-4ca9-877b-b3c52ff590a3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.313818 Aug 04 17:15:02.322889 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2327/4726] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:01 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:02.332914 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f9f49e4a-a656-4ee8-b8f0-d45d28629ba8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:02.333700 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f9f49e4a-a656-4ee8-b8f0-d45d28629ba8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:02.343993 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9f49e4a-a656-4ee8-b8f0-d45d28629ba8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:02.343993 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9f49e4a-a656-4ee8-b8f0-d45d28629ba8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:02.343993 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9f49e4a-a656-4ee8-b8f0-d45d28629ba8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:02.343993 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9f49e4a-a656-4ee8-b8f0-d45d28629ba8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:02.343993 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9f49e4a-a656-4ee8-b8f0-d45d28629ba8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:02.344640 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9f49e4a-a656-4ee8-b8f0-d45d28629ba8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:02.446246 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-97a6762f-95fc-4779-a928-6e05d356ec61 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:02.447507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-97a6762f-95fc-4779-a928-6e05d356ec61 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 314e3218-a990-4be2-aef1-d69a055897e9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:02.456106 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97a6762f-95fc-4779-a928-6e05d356ec61 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:02.456809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97a6762f-95fc-4779-a928-6e05d356ec61 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:02.457484 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97a6762f-95fc-4779-a928-6e05d356ec61 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:02.458547 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97a6762f-95fc-4779-a928-6e05d356ec61 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:02.459538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97a6762f-95fc-4779-a928-6e05d356ec61 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:02.460085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97a6762f-95fc-4779-a928-6e05d356ec61 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:02.553089 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-97a6762f-95fc-4779-a928-6e05d356ec61 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:02.563635 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-97a6762f-95fc-4779-a928-6e05d356ec61 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9" status: 200 len: 1213 microversion: 2.1 time: 0.122986 Aug 04 17:15:02.564704 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2328/4727] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:02 2022] GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9 => generated 1213 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:02.649492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f9f49e4a-a656-4ee8-b8f0-d45d28629ba8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:02.662014 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f9f49e4a-a656-4ee8-b8f0-d45d28629ba8 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.332986 Aug 04 17:15:02.672789 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2400/4728] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:02 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:02.683123 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7b9d3680-05a3-468c-9a2e-44041e633381 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:02.684608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7b9d3680-05a3-468c-9a2e-44041e633381 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:02.692917 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b9d3680-05a3-468c-9a2e-44041e633381 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:02.693630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b9d3680-05a3-468c-9a2e-44041e633381 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:02.694275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b9d3680-05a3-468c-9a2e-44041e633381 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:02.695188 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b9d3680-05a3-468c-9a2e-44041e633381 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:02.695811 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b9d3680-05a3-468c-9a2e-44041e633381 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:02.696399 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b9d3680-05a3-468c-9a2e-44041e633381 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:02.955641 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7b9d3680-05a3-468c-9a2e-44041e633381 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:02.966932 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7b9d3680-05a3-468c-9a2e-44041e633381 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.288059 Aug 04 17:15:02.969204 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2329/4729] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:02 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:02.996161 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-98889d83-a5a9-4265-ad95-67f76fa437d0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:02.999172 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-98889d83-a5a9-4265-ad95-67f76fa437d0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:03.012626 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98889d83-a5a9-4265-ad95-67f76fa437d0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:03.017856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98889d83-a5a9-4265-ad95-67f76fa437d0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:03.018536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98889d83-a5a9-4265-ad95-67f76fa437d0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:03.021078 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98889d83-a5a9-4265-ad95-67f76fa437d0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:03.022324 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98889d83-a5a9-4265-ad95-67f76fa437d0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:03.023446 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98889d83-a5a9-4265-ad95-67f76fa437d0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:03.078082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a3bde2e0-69e0-4d88-ac4d-9db60dd9541f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:03.078867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a3bde2e0-69e0-4d88-ac4d-9db60dd9541f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: c75ee070-7154-4d00-add1-674bb1c4b2b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:03.083791 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-98889d83-a5a9-4265-ad95-67f76fa437d0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lazy-loading 'flavor' on Instance uuid 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:15:03.088115 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3bde2e0-69e0-4d88-ac4d-9db60dd9541f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:03.088669 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3bde2e0-69e0-4d88-ac4d-9db60dd9541f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:03.089171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3bde2e0-69e0-4d88-ac4d-9db60dd9541f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:03.090678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3bde2e0-69e0-4d88-ac4d-9db60dd9541f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:03.095353 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3bde2e0-69e0-4d88-ac4d-9db60dd9541f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:03.102430 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3bde2e0-69e0-4d88-ac4d-9db60dd9541f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:03.245828 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-98889d83-a5a9-4265-ad95-67f76fa437d0 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action" status: 202 len: 0 microversion: 2.1 time: 0.257946 Aug 04 17:15:03.251323 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2401/4730] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:15:02 2022] POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:15:03.260559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-75f3bc71-9b23-402f-a5a3-68b611b576a4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:03.261734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-75f3bc71-9b23-402f-a5a3-68b611b576a4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:03.278270 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75f3bc71-9b23-402f-a5a3-68b611b576a4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:03.278744 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75f3bc71-9b23-402f-a5a3-68b611b576a4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:03.280556 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75f3bc71-9b23-402f-a5a3-68b611b576a4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:03.281376 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75f3bc71-9b23-402f-a5a3-68b611b576a4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:03.282969 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75f3bc71-9b23-402f-a5a3-68b611b576a4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:03.283536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75f3bc71-9b23-402f-a5a3-68b611b576a4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:03.560662 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a3bde2e0-69e0-4d88-ac4d-9db60dd9541f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:03.576245 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a3bde2e0-69e0-4d88-ac4d-9db60dd9541f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0" status: 200 len: 1682 microversion: 2.1 time: 0.503998 Aug 04 17:15:03.578408 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2330/4731] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:03 2022] GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0 => generated 1682 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:03.590185 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0b70053a-ee53-4d0e-a57c-2ef8e77776e1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:03.592443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0b70053a-ee53-4d0e-a57c-2ef8e77776e1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 1a45e4c9-c9bd-4715-847d-6688654383c7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:03.596507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:03.610112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b70053a-ee53-4d0e-a57c-2ef8e77776e1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:03.610908 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b70053a-ee53-4d0e-a57c-2ef8e77776e1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:03.611689 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b70053a-ee53-4d0e-a57c-2ef8e77776e1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:03.612657 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b70053a-ee53-4d0e-a57c-2ef8e77776e1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:03.613285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b70053a-ee53-4d0e-a57c-2ef8e77776e1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:03.613892 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b70053a-ee53-4d0e-a57c-2ef8e77776e1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:03.779163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0b70053a-ee53-4d0e-a57c-2ef8e77776e1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:03.790321 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0b70053a-ee53-4d0e-a57c-2ef8e77776e1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7" status: 200 len: 1283 microversion: 2.1 time: 0.209388 Aug 04 17:15:03.791729 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2331/4732] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:03 2022] GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7 => generated 1283 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:03.796908 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b1af2df5-8e30-4946-b317-a12a1d27b5de tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:03.797869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b1af2df5-8e30-4946-b317-a12a1d27b5de tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 314e3218-a990-4be2-aef1-d69a055897e9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:03.804848 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1af2df5-8e30-4946-b317-a12a1d27b5de tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:03.805793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1af2df5-8e30-4946-b317-a12a1d27b5de tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:03.806496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1af2df5-8e30-4946-b317-a12a1d27b5de tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:03.807469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1af2df5-8e30-4946-b317-a12a1d27b5de tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:03.808224 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1af2df5-8e30-4946-b317-a12a1d27b5de tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:03.809421 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1af2df5-8e30-4946-b317-a12a1d27b5de tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:03.819133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-75f3bc71-9b23-402f-a5a3-68b611b576a4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:03.839739 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-75f3bc71-9b23-402f-a5a3-68b611b576a4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1678 microversion: 2.1 time: 0.586828 Aug 04 17:15:03.859634 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2402/4733] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:03 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1678 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:04.006105 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b1af2df5-8e30-4946-b317-a12a1d27b5de tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:04.020013 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b1af2df5-8e30-4946-b317-a12a1d27b5de tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9" status: 200 len: 1261 microversion: 2.1 time: 0.225900 Aug 04 17:15:04.022232 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2332/4734] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:03 2022] GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9 => generated 1261 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:04.279533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e7b443d9-d827-4eec-b30a-87859cfe5b5a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-772098337", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": "none"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:04.383738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-e7b443d9-d827-4eec-b30a-87859cfe5b5a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:15:04.399464 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-e7b443d9-d827-4eec-b30a-87859cfe5b5a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:15:04.400433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-e7b443d9-d827-4eec-b30a-87859cfe5b5a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:15:04.402301 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-e7b443d9-d827-4eec-b30a-87859cfe5b5a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:15:04.408677 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-e7b443d9-d827-4eec-b30a-87859cfe5b5a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:15:04.429772 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7b443d9-d827-4eec-b30a-87859cfe5b5a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:04.430692 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7b443d9-d827-4eec-b30a-87859cfe5b5a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:04.431403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7b443d9-d827-4eec-b30a-87859cfe5b5a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:04.432734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7b443d9-d827-4eec-b30a-87859cfe5b5a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:04.440717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7b443d9-d827-4eec-b30a-87859cfe5b5a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:04.451071 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7b443d9-d827-4eec-b30a-87859cfe5b5a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:04.478366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-e7b443d9-d827-4eec-b30a-87859cfe5b5a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Getting quotas for project 405d9c2091d34ceb8e14f7eeec941f43. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:15:04.485660 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-e7b443d9-d827-4eec-b30a-87859cfe5b5a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Getting quotas for user 95f3e0b46bcc423493d73ff3262f4697 and project 405d9c2091d34ceb8e14f7eeec941f43. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:15:04.501300 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e7b443d9-d827-4eec-b30a-87859cfe5b5a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:15:04.509081 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e7b443d9-d827-4eec-b30a-87859cfe5b5a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:15:04.563327 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e7b443d9-d827-4eec-b30a-87859cfe5b5a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.596662 Aug 04 17:15:04.564793 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2403/4735] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Aug 4 17:15:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 17:15:04.581081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c0a89dfd-63ed-43ca-b924-699d5bfb2756 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:04.581698 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c0a89dfd-63ed-43ca-b924-699d5bfb2756 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:04.600643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d45e60f1-0033-4af9-8250-8398ae25a15b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:04.601383 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d45e60f1-0033-4af9-8250-8398ae25a15b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: c75ee070-7154-4d00-add1-674bb1c4b2b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:04.612503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d45e60f1-0033-4af9-8250-8398ae25a15b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:04.613366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d45e60f1-0033-4af9-8250-8398ae25a15b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:04.615225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d45e60f1-0033-4af9-8250-8398ae25a15b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:04.618499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d45e60f1-0033-4af9-8250-8398ae25a15b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:04.619027 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d45e60f1-0033-4af9-8250-8398ae25a15b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:04.619483 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d45e60f1-0033-4af9-8250-8398ae25a15b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:05.155345 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c0a89dfd-63ed-43ca-b924-699d5bfb2756 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:05.164919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c0a89dfd-63ed-43ca-b924-699d5bfb2756 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:05.167321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c0a89dfd-63ed-43ca-b924-699d5bfb2756 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:05.169444 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c0a89dfd-63ed-43ca-b924-699d5bfb2756 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a" status: 200 len: 1277 microversion: 2.54 time: 0.595115 Aug 04 17:15:05.170617 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2333/4736] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:15:04 2022] GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a => generated 1277 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:15:05.177544 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-51c5d53f-48ee-46ae-a5d2-fd0754abdbc2 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:05.180250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-51c5d53f-48ee-46ae-a5d2-fd0754abdbc2 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 1a45e4c9-c9bd-4715-847d-6688654383c7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:05.207898 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51c5d53f-48ee-46ae-a5d2-fd0754abdbc2 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:05.208700 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51c5d53f-48ee-46ae-a5d2-fd0754abdbc2 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:05.209419 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51c5d53f-48ee-46ae-a5d2-fd0754abdbc2 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:05.210512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51c5d53f-48ee-46ae-a5d2-fd0754abdbc2 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:05.213229 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51c5d53f-48ee-46ae-a5d2-fd0754abdbc2 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:05.214014 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51c5d53f-48ee-46ae-a5d2-fd0754abdbc2 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:05.617255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d45e60f1-0033-4af9-8250-8398ae25a15b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:05.628369 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d45e60f1-0033-4af9-8250-8398ae25a15b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0" status: 200 len: 1682 microversion: 2.1 time: 1.030004 Aug 04 17:15:05.629563 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2404/4737] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:04 2022] GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0 => generated 1682 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:05.639248 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-acca63e2-32c1-4a1d-b60a-e255aa3893c3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:05.640166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-acca63e2-32c1-4a1d-b60a-e255aa3893c3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:05.646849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-acca63e2-32c1-4a1d-b60a-e255aa3893c3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:05.648458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-acca63e2-32c1-4a1d-b60a-e255aa3893c3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:05.649170 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-acca63e2-32c1-4a1d-b60a-e255aa3893c3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:05.650217 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-acca63e2-32c1-4a1d-b60a-e255aa3893c3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:05.650902 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-acca63e2-32c1-4a1d-b60a-e255aa3893c3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:05.651587 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-acca63e2-32c1-4a1d-b60a-e255aa3893c3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:05.654634 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-51c5d53f-48ee-46ae-a5d2-fd0754abdbc2 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:05.658173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:05.664249 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-51c5d53f-48ee-46ae-a5d2-fd0754abdbc2 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7" status: 200 len: 1325 microversion: 2.1 time: 0.491623 Aug 04 17:15:05.670433 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2334/4738] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:05 2022] GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7 => generated 1325 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:05.710379 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f798b0f6-441c-4700-8a06-18880886846b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:05.711236 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f798b0f6-441c-4700-8a06-18880886846b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 314e3218-a990-4be2-aef1-d69a055897e9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:05.742700 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f798b0f6-441c-4700-8a06-18880886846b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:05.743602 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f798b0f6-441c-4700-8a06-18880886846b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:05.743727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f798b0f6-441c-4700-8a06-18880886846b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:05.745708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f798b0f6-441c-4700-8a06-18880886846b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:05.745708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f798b0f6-441c-4700-8a06-18880886846b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:05.745708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f798b0f6-441c-4700-8a06-18880886846b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:06.015403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-acca63e2-32c1-4a1d-b60a-e255aa3893c3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:06.025720 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-acca63e2-32c1-4a1d-b60a-e255aa3893c3 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1661 microversion: 2.1 time: 0.393312 Aug 04 17:15:06.027639 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2405/4739] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:05 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1661 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:06.034194 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f798b0f6-441c-4700-8a06-18880886846b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:06.047492 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f798b0f6-441c-4700-8a06-18880886846b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9" status: 200 len: 1267 microversion: 2.1 time: 0.363342 Aug 04 17:15:06.048820 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-53a3b1cc-a6e0-45b9-bb2a-32eec3c9c6cc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:06.050956 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2335/4740] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:05 2022] GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9 => generated 1267 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:06.053281 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-53a3b1cc-a6e0-45b9-bb2a-32eec3c9c6cc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:06.067121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53a3b1cc-a6e0-45b9-bb2a-32eec3c9c6cc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:06.068922 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53a3b1cc-a6e0-45b9-bb2a-32eec3c9c6cc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:06.071257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53a3b1cc-a6e0-45b9-bb2a-32eec3c9c6cc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:06.073128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53a3b1cc-a6e0-45b9-bb2a-32eec3c9c6cc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:06.075609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53a3b1cc-a6e0-45b9-bb2a-32eec3c9c6cc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:06.076234 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53a3b1cc-a6e0-45b9-bb2a-32eec3c9c6cc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:06.202569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9f2120a0-431c-43d7-8e22-09d938627d56 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:06.203370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9f2120a0-431c-43d7-8e22-09d938627d56 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:06.243573 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f2120a0-431c-43d7-8e22-09d938627d56 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:06.245496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f2120a0-431c-43d7-8e22-09d938627d56 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:06.246657 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f2120a0-431c-43d7-8e22-09d938627d56 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:06.250389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f2120a0-431c-43d7-8e22-09d938627d56 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:06.255698 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f2120a0-431c-43d7-8e22-09d938627d56 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:06.260342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f2120a0-431c-43d7-8e22-09d938627d56 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:06.291762 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-53a3b1cc-a6e0-45b9-bb2a-32eec3c9c6cc tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action" status: 202 len: 0 microversion: 2.1 time: 0.246746 Aug 04 17:15:06.298223 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2406/4741] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:15:06 2022] POST /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:15:06.312479 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-023f8be8-386d-40f3-9fd9-59feb5839f29 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:06.313625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-023f8be8-386d-40f3-9fd9-59feb5839f29 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:06.339134 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-023f8be8-386d-40f3-9fd9-59feb5839f29 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:06.340460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-023f8be8-386d-40f3-9fd9-59feb5839f29 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:06.341185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-023f8be8-386d-40f3-9fd9-59feb5839f29 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:06.342354 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-023f8be8-386d-40f3-9fd9-59feb5839f29 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:06.344183 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-023f8be8-386d-40f3-9fd9-59feb5839f29 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:06.351447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-023f8be8-386d-40f3-9fd9-59feb5839f29 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:06.667744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9f2120a0-431c-43d7-8e22-09d938627d56 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:06.694247 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9f2120a0-431c-43d7-8e22-09d938627d56 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:06.706503 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9f2120a0-431c-43d7-8e22-09d938627d56 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:06.715660 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9f2120a0-431c-43d7-8e22-09d938627d56 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a" status: 200 len: 1329 microversion: 2.54 time: 0.512440 Aug 04 17:15:06.732189 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2336/4742] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:15:06 2022] GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a => generated 1329 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:15:06.738077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a7f6acb9-e151-493b-a9a7-0e7615f4197c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:06.738865 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a7f6acb9-e151-493b-a9a7-0e7615f4197c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: c75ee070-7154-4d00-add1-674bb1c4b2b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:06.748956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7f6acb9-e151-493b-a9a7-0e7615f4197c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:06.749522 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7f6acb9-e151-493b-a9a7-0e7615f4197c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:06.750501 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7f6acb9-e151-493b-a9a7-0e7615f4197c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:06.751473 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7f6acb9-e151-493b-a9a7-0e7615f4197c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:06.752105 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7f6acb9-e151-493b-a9a7-0e7615f4197c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:06.752697 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7f6acb9-e151-493b-a9a7-0e7615f4197c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:06.759346 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-023f8be8-386d-40f3-9fd9-59feb5839f29 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:06.769424 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-023f8be8-386d-40f3-9fd9-59feb5839f29 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1667 microversion: 2.1 time: 0.469369 Aug 04 17:15:06.771518 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2407/4743] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:06 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1667 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:06.786688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e0e24b01-7d58-4543-acd4-5efb45f5e207 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:06.793781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e0e24b01-7d58-4543-acd4-5efb45f5e207 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 1a45e4c9-c9bd-4715-847d-6688654383c7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:06.816524 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0e24b01-7d58-4543-acd4-5efb45f5e207 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:06.817375 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0e24b01-7d58-4543-acd4-5efb45f5e207 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:06.817834 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0e24b01-7d58-4543-acd4-5efb45f5e207 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:06.819736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0e24b01-7d58-4543-acd4-5efb45f5e207 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:06.820223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0e24b01-7d58-4543-acd4-5efb45f5e207 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:06.820668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0e24b01-7d58-4543-acd4-5efb45f5e207 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:06.903605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a7f6acb9-e151-493b-a9a7-0e7615f4197c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:06.919296 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a7f6acb9-e151-493b-a9a7-0e7615f4197c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0" status: 200 len: 1614 microversion: 2.1 time: 0.185875 Aug 04 17:15:06.933286 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2337/4744] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:06 2022] GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0 => generated 1614 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:06.995257 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-25a0b4b1-8906-4d7f-ae29-e583b49b942d req-cf42f23c-410e-46ab-9e4d-7901297d3cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c75ee070-7154-4d00-add1-674bb1c4b2b0", "name": "network-vif-deleted", "tag": "3a548778-fada-4b4d-96d6-d73cd5e7d8b5"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:07.025503 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-25a0b4b1-8906-4d7f-ae29-e583b49b942d req-cf42f23c-410e-46ab-9e4d-7901297d3cb9 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:07.026270 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-25a0b4b1-8906-4d7f-ae29-e583b49b942d req-cf42f23c-410e-46ab-9e4d-7901297d3cb9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:07.026859 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-25a0b4b1-8906-4d7f-ae29-e583b49b942d req-cf42f23c-410e-46ab-9e4d-7901297d3cb9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:07.053102 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-25a0b4b1-8906-4d7f-ae29-e583b49b942d req-cf42f23c-410e-46ab-9e4d-7901297d3cb9 service nova] Creating event network-vif-deleted:3a548778-fada-4b4d-96d6-d73cd5e7d8b5 for instance c75ee070-7154-4d00-add1-674bb1c4b2b0 on n-h2-851359-3 Aug 04 17:15:07.083060 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-25a0b4b1-8906-4d7f-ae29-e583b49b942d req-cf42f23c-410e-46ab-9e4d-7901297d3cb9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080295 Aug 04 17:15:07.084584 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2338/4745] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:15:07.096866 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-84fafd2e-b17b-4262-ad0a-404a047be243 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:07.109099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-84fafd2e-b17b-4262-ad0a-404a047be243 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 314e3218-a990-4be2-aef1-d69a055897e9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:07.125009 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84fafd2e-b17b-4262-ad0a-404a047be243 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:07.127056 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84fafd2e-b17b-4262-ad0a-404a047be243 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:07.130165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84fafd2e-b17b-4262-ad0a-404a047be243 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:07.131567 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84fafd2e-b17b-4262-ad0a-404a047be243 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:07.135744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84fafd2e-b17b-4262-ad0a-404a047be243 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:07.136699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84fafd2e-b17b-4262-ad0a-404a047be243 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:07.216185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e0e24b01-7d58-4543-acd4-5efb45f5e207 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:07.235657 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e0e24b01-7d58-4543-acd4-5efb45f5e207 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7" status: 200 len: 1325 microversion: 2.1 time: 0.457457 Aug 04 17:15:07.262499 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2408/4746] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:06 2022] GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7 => generated 1325 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:07.763725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5f657c65-aceb-4539-81fd-06d1a21f3195 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:07.767952 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5f657c65-aceb-4539-81fd-06d1a21f3195 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:07.799458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5f657c65-aceb-4539-81fd-06d1a21f3195 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:07.802999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5f657c65-aceb-4539-81fd-06d1a21f3195 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:07.806978 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5f657c65-aceb-4539-81fd-06d1a21f3195 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:07.816133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-84fafd2e-b17b-4262-ad0a-404a047be243 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:07.820128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5f657c65-aceb-4539-81fd-06d1a21f3195 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:07.823528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5f657c65-aceb-4539-81fd-06d1a21f3195 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:07.827127 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5f657c65-aceb-4539-81fd-06d1a21f3195 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:07.845185 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-84fafd2e-b17b-4262-ad0a-404a047be243 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9" status: 200 len: 1309 microversion: 2.1 time: 0.756336 Aug 04 17:15:07.845802 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2339/4747] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:07 2022] GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9 => generated 1309 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:07.902948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-06dcffeb-3378-4eaa-9d86-4e34aae4867c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:07.904157 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-06dcffeb-3378-4eaa-9d86-4e34aae4867c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:07.955416 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06dcffeb-3378-4eaa-9d86-4e34aae4867c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:07.962728 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06dcffeb-3378-4eaa-9d86-4e34aae4867c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:07.965999 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06dcffeb-3378-4eaa-9d86-4e34aae4867c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:07.970202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06dcffeb-3378-4eaa-9d86-4e34aae4867c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:07.973413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06dcffeb-3378-4eaa-9d86-4e34aae4867c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:07.976399 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06dcffeb-3378-4eaa-9d86-4e34aae4867c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:08.251966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5f657c65-aceb-4539-81fd-06d1a21f3195 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:08.274356 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5f657c65-aceb-4539-81fd-06d1a21f3195 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:08.276480 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5f657c65-aceb-4539-81fd-06d1a21f3195 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:08.279962 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5f657c65-aceb-4539-81fd-06d1a21f3195 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a" status: 200 len: 1335 microversion: 2.54 time: 0.542230 Aug 04 17:15:08.282675 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2409/4748] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:15:07 2022] GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a => generated 1335 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:15:08.295391 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-96914de5-94fd-4e56-aff8-f65b1f440c0d tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:08.296209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-96914de5-94fd-4e56-aff8-f65b1f440c0d tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: c75ee070-7154-4d00-add1-674bb1c4b2b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:08.312385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-96914de5-94fd-4e56-aff8-f65b1f440c0d tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:08.313144 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-96914de5-94fd-4e56-aff8-f65b1f440c0d tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:08.314011 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-96914de5-94fd-4e56-aff8-f65b1f440c0d tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:08.315034 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-96914de5-94fd-4e56-aff8-f65b1f440c0d tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:08.319355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-96914de5-94fd-4e56-aff8-f65b1f440c0d tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:08.320164 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-96914de5-94fd-4e56-aff8-f65b1f440c0d tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:08.357304 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-96914de5-94fd-4e56-aff8-f65b1f440c0d tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] HTTP exception thrown: Instance c75ee070-7154-4d00-add1-674bb1c4b2b0 could not be found. Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-96914de5-94fd-4e56-aff8-f65b1f440c0d tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Request method failure captured: Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0 HTTP/1.1 Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_20IgjlzOhiiXNFc-NV1FHodxKmWXqSdjZ2I3CqIylUHNkhkG-JAGdMPdYL-8rZzM7v2_0KXVTorBGskuo6vUXRtOSVoO1KTIHw44-u5yCDnlwK7XKRi3uI2OBhda5ANtzdvy-06i9FyD27hM6LxpcHB7QNnHGthqSv2gOLnkKiVjg Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 80bc576163414daba5f5315c4a785533 Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/80bc576163414daba5f5315c4a785533"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/80bc576163414daba5f5315c4a785533"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_80bc576163414daba5f5315c4a785533"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/80bc576163414daba5f5315c4a785533"}]}] Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 80bc576163414daba5f5315c4a785533 Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-AttachVolumeNegativeTest-1565246319-project Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 5b10b58bf3df46d18bff092022b08e0f Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-AttachVolumeNegativeTest-1565246319-project Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance c75ee070-7154-4d00-add1-674bb1c4b2b0 could not be found. Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'c75ee070-7154-4d00-add1-674bb1c4b2b0'} Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c75ee070-7154-4d00-add1-674bb1c4b2b0 could not be found. Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c75ee070-7154-4d00-add1-674bb1c4b2b0 could not be found. Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:08.359035 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:08.363111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:08.363111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:08.363111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:08.363111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:15:08.363111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:15:08.363111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c75ee070-7154-4d00-add1-674bb1c4b2b0 could not be found. Aug 04 17:15:08.363111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:08.363111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-96914de5-94fd-4e56-aff8-f65b1f440c0d tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Returning 404 to user: Instance c75ee070-7154-4d00-add1-674bb1c4b2b0 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:15:08.363111 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-96914de5-94fd-4e56-aff8-f65b1f440c0d tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0" status: 404 len: 111 microversion: 2.1 time: 0.074494 Aug 04 17:15:08.369619 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2410/4749] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:08 2022] GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:15:08.380807 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c82bec8f-94f5-4f6d-9260-f6b1e13b9004 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:08.381444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c82bec8f-94f5-4f6d-9260-f6b1e13b9004 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 1a45e4c9-c9bd-4715-847d-6688654383c7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:08.404323 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c82bec8f-94f5-4f6d-9260-f6b1e13b9004 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:08.405045 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c82bec8f-94f5-4f6d-9260-f6b1e13b9004 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:08.405830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c82bec8f-94f5-4f6d-9260-f6b1e13b9004 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:08.407154 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c82bec8f-94f5-4f6d-9260-f6b1e13b9004 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:08.407995 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c82bec8f-94f5-4f6d-9260-f6b1e13b9004 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:08.408626 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c82bec8f-94f5-4f6d-9260-f6b1e13b9004 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:08.472570 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-06dcffeb-3378-4eaa-9d86-4e34aae4867c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:08.481401 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-06dcffeb-3378-4eaa-9d86-4e34aae4867c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1667 microversion: 2.1 time: 0.606777 Aug 04 17:15:08.489484 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2340/4750] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:07 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1667 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:08.500772 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cae6bb60-e225-418e-837e-458486639dc7 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '.version_select at 0x7f1e5ac761f0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:08.549527 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cae6bb60-e225-418e-837e-458486639dc7 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1963770254" status: 202 len: 0 microversion: 2.1 time: 0.058525 Aug 04 17:15:08.554452 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2341/4751] 10.222.0.93 () {58 vars in 1221 bytes} [Thu Aug 4 17:15:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1963770254 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:15:08.856443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c82bec8f-94f5-4f6d-9260-f6b1e13b9004 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:08.867957 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8f68a929-34e2-4bf6-9b0f-b2d74ca2f7ca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:08.869610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8f68a929-34e2-4bf6-9b0f-b2d74ca2f7ca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 314e3218-a990-4be2-aef1-d69a055897e9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:08.873417 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c82bec8f-94f5-4f6d-9260-f6b1e13b9004 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7" status: 200 len: 1325 microversion: 2.1 time: 0.502543 Aug 04 17:15:08.874829 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2411/4752] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:08 2022] GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7 => generated 1325 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:08.880064 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f68a929-34e2-4bf6-9b0f-b2d74ca2f7ca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:08.882184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f68a929-34e2-4bf6-9b0f-b2d74ca2f7ca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:08.882817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f68a929-34e2-4bf6-9b0f-b2d74ca2f7ca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:08.883870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f68a929-34e2-4bf6-9b0f-b2d74ca2f7ca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:08.884511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f68a929-34e2-4bf6-9b0f-b2d74ca2f7ca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:08.890020 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f68a929-34e2-4bf6-9b0f-b2d74ca2f7ca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:09.159713 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-3cb44f8c-5e0e-4c4e-a2cb-3551efb5b3e1 req-b0c6385b-4a3f-4187-982b-85700445e9ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "314e3218-a990-4be2-aef1-d69a055897e9", "tag": "3d5e1fae-5919-469b-addc-bb208c32cdc6"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:09.177548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-3cb44f8c-5e0e-4c4e-a2cb-3551efb5b3e1 req-b0c6385b-4a3f-4187-982b-85700445e9ec service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:09.178587 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-3cb44f8c-5e0e-4c4e-a2cb-3551efb5b3e1 req-b0c6385b-4a3f-4187-982b-85700445e9ec service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:09.179234 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-3cb44f8c-5e0e-4c4e-a2cb-3551efb5b3e1 req-b0c6385b-4a3f-4187-982b-85700445e9ec service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:09.202726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:09.206584 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-3cb44f8c-5e0e-4c4e-a2cb-3551efb5b3e1 req-b0c6385b-4a3f-4187-982b-85700445e9ec service nova] Creating event network-changed:3d5e1fae-5919-469b-addc-bb208c32cdc6 for instance 314e3218-a990-4be2-aef1-d69a055897e9 on n-h2-851359-3 Aug 04 17:15:09.213436 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-3cb44f8c-5e0e-4c4e-a2cb-3551efb5b3e1 req-b0c6385b-4a3f-4187-982b-85700445e9ec service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059420 Aug 04 17:15:09.216309 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2412/4753] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:15:09.257561 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8f68a929-34e2-4bf6-9b0f-b2d74ca2f7ca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:09.279264 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8f68a929-34e2-4bf6-9b0f-b2d74ca2f7ca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9" status: 200 len: 1309 microversion: 2.1 time: 0.416462 Aug 04 17:15:09.281651 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2342/4754] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:08 2022] GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9 => generated 1309 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:09.315446 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e8a014e9-a8bb-43ff-b2a0-b5a49f513142 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:09.330170 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e8a014e9-a8bb-43ff-b2a0-b5a49f513142 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:09.360164 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8a014e9-a8bb-43ff-b2a0-b5a49f513142 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:09.360958 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8a014e9-a8bb-43ff-b2a0-b5a49f513142 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:09.361560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8a014e9-a8bb-43ff-b2a0-b5a49f513142 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:09.363361 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8a014e9-a8bb-43ff-b2a0-b5a49f513142 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:09.365828 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8a014e9-a8bb-43ff-b2a0-b5a49f513142 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:09.366725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8a014e9-a8bb-43ff-b2a0-b5a49f513142 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:09.423737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0e7e101b-728a-4ce8-a2b5-5f820aefcabb req-741ade6a-228f-49c2-b5fe-0eae3a19a686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a45e4c9-c9bd-4715-847d-6688654383c7", "tag": "42f0cb89-bdf2-4789-8374-f82df66286fc"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:09.460499 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0e7e101b-728a-4ce8-a2b5-5f820aefcabb req-741ade6a-228f-49c2-b5fe-0eae3a19a686 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:09.465348 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0e7e101b-728a-4ce8-a2b5-5f820aefcabb req-741ade6a-228f-49c2-b5fe-0eae3a19a686 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:09.468343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0e7e101b-728a-4ce8-a2b5-5f820aefcabb req-741ade6a-228f-49c2-b5fe-0eae3a19a686 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:09.502675 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0e7e101b-728a-4ce8-a2b5-5f820aefcabb req-741ade6a-228f-49c2-b5fe-0eae3a19a686 service nova] Creating event network-changed:42f0cb89-bdf2-4789-8374-f82df66286fc for instance 1a45e4c9-c9bd-4715-847d-6688654383c7 on n-h2-851359-3 Aug 04 17:15:09.515555 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0e7e101b-728a-4ce8-a2b5-5f820aefcabb req-741ade6a-228f-49c2-b5fe-0eae3a19a686 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097360 Aug 04 17:15:09.518413 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2343/4755] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:09.534273 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d3cfe342-a0f2-40f4-b1b1-55d78af12858 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:09.535321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d3cfe342-a0f2-40f4-b1b1-55d78af12858 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:09.545426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3cfe342-a0f2-40f4-b1b1-55d78af12858 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:09.548535 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3cfe342-a0f2-40f4-b1b1-55d78af12858 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:09.549160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3cfe342-a0f2-40f4-b1b1-55d78af12858 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:09.550088 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3cfe342-a0f2-40f4-b1b1-55d78af12858 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:09.558028 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3cfe342-a0f2-40f4-b1b1-55d78af12858 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:09.559340 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3cfe342-a0f2-40f4-b1b1-55d78af12858 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:09.613559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e8a014e9-a8bb-43ff-b2a0-b5a49f513142 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:09.625093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e8a014e9-a8bb-43ff-b2a0-b5a49f513142 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:09.626981 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e8a014e9-a8bb-43ff-b2a0-b5a49f513142 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:09.629447 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e8a014e9-a8bb-43ff-b2a0-b5a49f513142 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a" status: 200 len: 1335 microversion: 2.54 time: 0.322640 Aug 04 17:15:09.631247 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2413/4756] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:15:09 2022] GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a => generated 1335 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:15:09.784761 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:09.834089 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d3cfe342-a0f2-40f4-b1b1-55d78af12858 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:09.852245 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d3cfe342-a0f2-40f4-b1b1-55d78af12858 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1667 microversion: 2.1 time: 0.332063 Aug 04 17:15:09.853946 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2344/4757] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:09 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1667 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:09.910890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1b31ac5a-10e9-4154-8dac-e63c3a8004dc tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:09.920073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1b31ac5a-10e9-4154-8dac-e63c3a8004dc tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 1a45e4c9-c9bd-4715-847d-6688654383c7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:09.946224 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:09.953324 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1b31ac5a-10e9-4154-8dac-e63c3a8004dc tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:09.954534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1b31ac5a-10e9-4154-8dac-e63c3a8004dc tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:09.955479 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1b31ac5a-10e9-4154-8dac-e63c3a8004dc tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:09.957004 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1b31ac5a-10e9-4154-8dac-e63c3a8004dc tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:09.958727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1b31ac5a-10e9-4154-8dac-e63c3a8004dc tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:09.959438 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1b31ac5a-10e9-4154-8dac-e63c3a8004dc tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:10.265217 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1b31ac5a-10e9-4154-8dac-e63c3a8004dc tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:10.284117 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1b31ac5a-10e9-4154-8dac-e63c3a8004dc tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7" status: 200 len: 1325 microversion: 2.1 time: 0.385175 Aug 04 17:15:10.308389 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2414/4758] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:09 2022] GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7 => generated 1325 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:10.312586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e10a5751-f5fd-47ad-a3cd-d4f7207315ee tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:10.314315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e10a5751-f5fd-47ad-a3cd-d4f7207315ee tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 314e3218-a990-4be2-aef1-d69a055897e9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:10.339131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e10a5751-f5fd-47ad-a3cd-d4f7207315ee tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:10.341335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e10a5751-f5fd-47ad-a3cd-d4f7207315ee tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:10.342507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e10a5751-f5fd-47ad-a3cd-d4f7207315ee tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:10.344995 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e10a5751-f5fd-47ad-a3cd-d4f7207315ee tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:10.346341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e10a5751-f5fd-47ad-a3cd-d4f7207315ee tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:10.348326 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e10a5751-f5fd-47ad-a3cd-d4f7207315ee tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:10.656158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c811da6b-4c99-4955-8187-c5bfb41ce0a5 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:10.656805 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c811da6b-4c99-4955-8187-c5bfb41ce0a5 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:10.664612 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c811da6b-4c99-4955-8187-c5bfb41ce0a5 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:10.666053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c811da6b-4c99-4955-8187-c5bfb41ce0a5 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:10.666747 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c811da6b-4c99-4955-8187-c5bfb41ce0a5 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:10.667989 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c811da6b-4c99-4955-8187-c5bfb41ce0a5 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:10.669187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c811da6b-4c99-4955-8187-c5bfb41ce0a5 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:10.669825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c811da6b-4c99-4955-8187-c5bfb41ce0a5 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:10.696288 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e10a5751-f5fd-47ad-a3cd-d4f7207315ee tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:10.721433 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e10a5751-f5fd-47ad-a3cd-d4f7207315ee tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9" status: 200 len: 1309 microversion: 2.1 time: 0.418265 Aug 04 17:15:10.734063 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2345/4759] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:10 2022] GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9 => generated 1309 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:10.785804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c811da6b-4c99-4955-8187-c5bfb41ce0a5 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:10.797967 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c811da6b-4c99-4955-8187-c5bfb41ce0a5 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:10.799689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c811da6b-4c99-4955-8187-c5bfb41ce0a5 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:10.801085 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c811da6b-4c99-4955-8187-c5bfb41ce0a5 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a" status: 200 len: 1356 microversion: 2.54 time: 0.150993 Aug 04 17:15:10.807092 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2415/4760] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:15:10 2022] GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a => generated 1356 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:15:10.833515 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2bc0635c-46f5-4cbc-92ea-60fec93b79e8 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Action: 'create', calling method: .version_select at 0x7f1e5b3b24c0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-249898636", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfFfwS2g8iV2SgFxR+KPrQfoiRRMVmhspXz//zYSZS73S8H/mpLstz66IwfFc2Kng6SZR8rHN0j5oIoQdZMd6wSzysOFo+cu/Vd8LfDTI74LER1G+q+vSdIxStiZs4zFQ=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:10.879059 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-528b705d-373d-49e1-a849-98079a385744 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:10.880248 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-528b705d-373d-49e1-a849-98079a385744 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:10.883892 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-2bc0635c-46f5-4cbc-92ea-60fec93b79e8 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Getting quotas for project 405d9c2091d34ceb8e14f7eeec941f43. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:15:10.897215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-528b705d-373d-49e1-a849-98079a385744 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:10.897816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-528b705d-373d-49e1-a849-98079a385744 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:10.899417 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-2bc0635c-46f5-4cbc-92ea-60fec93b79e8 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Getting quotas for user 95f3e0b46bcc423493d73ff3262f4697 and project 405d9c2091d34ceb8e14f7eeec941f43. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:15:10.903047 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-528b705d-373d-49e1-a849-98079a385744 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:10.903759 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-528b705d-373d-49e1-a849-98079a385744 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:10.904246 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-528b705d-373d-49e1-a849-98079a385744 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:10.904691 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-528b705d-373d-49e1-a849-98079a385744 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:10.954195 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2bc0635c-46f5-4cbc-92ea-60fec93b79e8 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.124792 Aug 04 17:15:10.962478 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2346/4761] 10.222.0.93 () {62 vars in 1200 bytes} [Thu Aug 4 17:15:10 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 134 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 17:15:10.974208 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c4fe6143-4a54-4e1f-8501-5e2ec214e53d tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-249898636", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:10.977766 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c4fe6143-4a54-4e1f-8501-5e2ec214e53d tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:10.990801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4fe6143-4a54-4e1f-8501-5e2ec214e53d tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:10.991573 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4fe6143-4a54-4e1f-8501-5e2ec214e53d tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:10.992208 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4fe6143-4a54-4e1f-8501-5e2ec214e53d tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:10.993540 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4fe6143-4a54-4e1f-8501-5e2ec214e53d tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:10.994225 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4fe6143-4a54-4e1f-8501-5e2ec214e53d tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:10.994848 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4fe6143-4a54-4e1f-8501-5e2ec214e53d tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:11.151989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-c4fe6143-4a54-4e1f-8501-5e2ec214e53d tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:15:11.151989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-c4fe6143-4a54-4e1f-8501-5e2ec214e53d tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:15:11.151989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-c4fe6143-4a54-4e1f-8501-5e2ec214e53d tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:15:11.151989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-c4fe6143-4a54-4e1f-8501-5e2ec214e53d tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:15:11.151989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-c4fe6143-4a54-4e1f-8501-5e2ec214e53d tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:15:11.153391 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-528b705d-373d-49e1-a849-98079a385744 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:11.160720 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-528b705d-373d-49e1-a849-98079a385744 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.288186 Aug 04 17:15:11.163371 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2416/4762] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:10 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:11.169147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-456f5cc5-d48b-402c-a9f2-85991c8602fe tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:11.169715 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-456f5cc5-d48b-402c-a9f2-85991c8602fe tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 947ffe69-3080-4602-872d-1bb16591d34e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:11.187487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-456f5cc5-d48b-402c-a9f2-85991c8602fe tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:11.188257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-456f5cc5-d48b-402c-a9f2-85991c8602fe tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:11.189555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-456f5cc5-d48b-402c-a9f2-85991c8602fe tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:11.190505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-456f5cc5-d48b-402c-a9f2-85991c8602fe tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:11.191286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-456f5cc5-d48b-402c-a9f2-85991c8602fe tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:11.191936 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-456f5cc5-d48b-402c-a9f2-85991c8602fe tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:11.259037 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c4fe6143-4a54-4e1f-8501-5e2ec214e53d tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:11.267799 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4fe6143-4a54-4e1f-8501-5e2ec214e53d tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:11.268378 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4fe6143-4a54-4e1f-8501-5e2ec214e53d tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:11.268936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4fe6143-4a54-4e1f-8501-5e2ec214e53d tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:11.269673 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4fe6143-4a54-4e1f-8501-5e2ec214e53d tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:11.270306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4fe6143-4a54-4e1f-8501-5e2ec214e53d tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:11.270996 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4fe6143-4a54-4e1f-8501-5e2ec214e53d tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:11.328747 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-456f5cc5-d48b-402c-a9f2-85991c8602fe tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lazy-loading 'services' on Instance uuid 947ffe69-3080-4602-872d-1bb16591d34e {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:15:11.347985 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c4fe6143-4a54-4e1f-8501-5e2ec214e53d tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "POST /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a/action" status: 202 len: 1138 microversion: 2.54 time: 0.383370 Aug 04 17:15:11.348639 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2347/4763] 10.222.0.93 () {62 vars in 1320 bytes} [Thu Aug 4 17:15:10 2022] POST /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a/action => generated 1138 bytes in 385 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 04 17:15:11.367521 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7d3c08b1-8330-4695-b701-6f5a83527630 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:11.368334 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7d3c08b1-8330-4695-b701-6f5a83527630 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:11.376588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d3c08b1-8330-4695-b701-6f5a83527630 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:11.377381 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d3c08b1-8330-4695-b701-6f5a83527630 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:11.378143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d3c08b1-8330-4695-b701-6f5a83527630 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:11.379068 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d3c08b1-8330-4695-b701-6f5a83527630 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:11.379801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d3c08b1-8330-4695-b701-6f5a83527630 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:11.380410 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d3c08b1-8330-4695-b701-6f5a83527630 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:11.460231 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-456f5cc5-d48b-402c-a9f2-85991c8602fe tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "DELETE /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e/os-volume_attachments/e8418314-721f-4e67-81d4-699a10c130ed" status: 202 len: 0 microversion: 2.1 time: 0.295765 Aug 04 17:15:11.479020 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2417/4764] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Aug 4 17:15:11 2022] DELETE /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e/os-volume_attachments/e8418314-721f-4e67-81d4-699a10c130ed => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:15:11.497569 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-be8dc867-c042-4bce-b208-88a9d8a4ddd8 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:11.498755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-be8dc867-c042-4bce-b208-88a9d8a4ddd8 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 1a45e4c9-c9bd-4715-847d-6688654383c7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:11.524135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be8dc867-c042-4bce-b208-88a9d8a4ddd8 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:11.525384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be8dc867-c042-4bce-b208-88a9d8a4ddd8 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:11.526470 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be8dc867-c042-4bce-b208-88a9d8a4ddd8 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:11.527461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be8dc867-c042-4bce-b208-88a9d8a4ddd8 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:11.527988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be8dc867-c042-4bce-b208-88a9d8a4ddd8 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:11.528458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be8dc867-c042-4bce-b208-88a9d8a4ddd8 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:11.649499 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7d3c08b1-8330-4695-b701-6f5a83527630 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:11.658167 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7d3c08b1-8330-4695-b701-6f5a83527630 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1670 microversion: 2.1 time: 0.294581 Aug 04 17:15:11.659480 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2348/4765] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:11 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1670 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:11.664758 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b02af541-69a7-4924-b4e2-702efe1c3971 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:11.665731 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b02af541-69a7-4924-b4e2-702efe1c3971 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:11.678910 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b02af541-69a7-4924-b4e2-702efe1c3971 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:11.679450 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b02af541-69a7-4924-b4e2-702efe1c3971 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:11.679947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b02af541-69a7-4924-b4e2-702efe1c3971 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:11.680603 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b02af541-69a7-4924-b4e2-702efe1c3971 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:11.681061 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b02af541-69a7-4924-b4e2-702efe1c3971 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:11.681491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b02af541-69a7-4924-b4e2-702efe1c3971 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:11.795740 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b02af541-69a7-4924-b4e2-702efe1c3971 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:11.805011 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b02af541-69a7-4924-b4e2-702efe1c3971 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:11.806458 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b02af541-69a7-4924-b4e2-702efe1c3971 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:11.807641 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b02af541-69a7-4924-b4e2-702efe1c3971 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a" status: 200 len: 1407 microversion: 2.54 time: 0.147056 Aug 04 17:15:11.808581 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2349/4766] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:15:11 2022] GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:15:11.823572 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e4c76462-7ec7-4a75-af65-da2796c16e20 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:11.827707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e4c76462-7ec7-4a75-af65-da2796c16e20 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 947ffe69-3080-4602-872d-1bb16591d34e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:11.834520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4c76462-7ec7-4a75-af65-da2796c16e20 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:11.835268 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4c76462-7ec7-4a75-af65-da2796c16e20 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:11.835878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4c76462-7ec7-4a75-af65-da2796c16e20 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:11.836750 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4c76462-7ec7-4a75-af65-da2796c16e20 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:11.837519 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4c76462-7ec7-4a75-af65-da2796c16e20 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:11.838156 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4c76462-7ec7-4a75-af65-da2796c16e20 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:11.859748 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-be8dc867-c042-4bce-b208-88a9d8a4ddd8 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:11.868771 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-be8dc867-c042-4bce-b208-88a9d8a4ddd8 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7" status: 200 len: 1325 microversion: 2.1 time: 0.386668 Aug 04 17:15:11.870164 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2418/4767] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:11 2022] GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7 => generated 1325 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:11.875976 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8cbe5496-f052-4ffa-8f0b-5d84a09d8df4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:11.876795 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8cbe5496-f052-4ffa-8f0b-5d84a09d8df4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:11.889262 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e4c76462-7ec7-4a75-af65-da2796c16e20 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078843 Aug 04 17:15:11.892453 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2350/4768] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:15:11 2022] GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:11.897496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-48e2b8aa-4f57-44cb-bbb6-4ef2153daddf tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:11.898386 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-48e2b8aa-4f57-44cb-bbb6-4ef2153daddf tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 314e3218-a990-4be2-aef1-d69a055897e9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:11.899968 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8cbe5496-f052-4ffa-8f0b-5d84a09d8df4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:11.900482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8cbe5496-f052-4ffa-8f0b-5d84a09d8df4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:11.900936 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8cbe5496-f052-4ffa-8f0b-5d84a09d8df4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:11.901646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8cbe5496-f052-4ffa-8f0b-5d84a09d8df4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:11.902367 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8cbe5496-f052-4ffa-8f0b-5d84a09d8df4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:11.902816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8cbe5496-f052-4ffa-8f0b-5d84a09d8df4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:11.905231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48e2b8aa-4f57-44cb-bbb6-4ef2153daddf tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:11.905968 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48e2b8aa-4f57-44cb-bbb6-4ef2153daddf tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:11.909334 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48e2b8aa-4f57-44cb-bbb6-4ef2153daddf tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:11.910125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48e2b8aa-4f57-44cb-bbb6-4ef2153daddf tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:11.911035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48e2b8aa-4f57-44cb-bbb6-4ef2153daddf tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:11.911620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48e2b8aa-4f57-44cb-bbb6-4ef2153daddf tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:11.939173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8cbe5496-f052-4ffa-8f0b-5d84a09d8df4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:15:11.958633 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.compute.api [None req-8cbe5496-f052-4ffa-8f0b-5d84a09d8df4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Working on deleting snapshot 09e8910c-44de-4145-b573-5fbf5d2afb91 from shelved instance... Aug 04 17:15:12.081066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-48e2b8aa-4f57-44cb-bbb6-4ef2153daddf tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:12.092368 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-48e2b8aa-4f57-44cb-bbb6-4ef2153daddf tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9" status: 200 len: 1309 microversion: 2.1 time: 0.198368 Aug 04 17:15:12.093839 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2351/4769] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:11 2022] GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9 => generated 1309 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:12.851357 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3046771b-334f-4fa6-8850-e929e5cc1e1b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:12.853016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3046771b-334f-4fa6-8850-e929e5cc1e1b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:12.868098 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3046771b-334f-4fa6-8850-e929e5cc1e1b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:12.868918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3046771b-334f-4fa6-8850-e929e5cc1e1b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:12.869867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3046771b-334f-4fa6-8850-e929e5cc1e1b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:12.871654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3046771b-334f-4fa6-8850-e929e5cc1e1b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:12.872725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3046771b-334f-4fa6-8850-e929e5cc1e1b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:12.873389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3046771b-334f-4fa6-8850-e929e5cc1e1b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:12.911512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:12.996470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3046771b-334f-4fa6-8850-e929e5cc1e1b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:13.017730 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3046771b-334f-4fa6-8850-e929e5cc1e1b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:13.023325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3046771b-334f-4fa6-8850-e929e5cc1e1b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:13.032117 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3046771b-334f-4fa6-8850-e929e5cc1e1b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a" status: 200 len: 1407 microversion: 2.54 time: 0.184409 Aug 04 17:15:13.043692 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2352/4770] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:15:12 2022] GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:15:13.050172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1ff2404a-f323-47ab-a67c-7dd048d97365 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:13.050833 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1ff2404a-f323-47ab-a67c-7dd048d97365 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 1a45e4c9-c9bd-4715-847d-6688654383c7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:13.069695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ff2404a-f323-47ab-a67c-7dd048d97365 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:13.070282 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ff2404a-f323-47ab-a67c-7dd048d97365 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:13.071234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ff2404a-f323-47ab-a67c-7dd048d97365 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:13.071422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ff2404a-f323-47ab-a67c-7dd048d97365 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:13.071856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ff2404a-f323-47ab-a67c-7dd048d97365 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:13.072289 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ff2404a-f323-47ab-a67c-7dd048d97365 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:13.213132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8cbe5496-f052-4ffa-8f0b-5d84a09d8df4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Doing local delete in cell 435e901d-6672-4284-ad57-58e647e6e99d(cell1) {{(pid=131043) _delete /opt/stack/nova/nova/compute/api.py:2491}} Aug 04 17:15:13.216219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8cbe5496-f052-4ffa-8f0b-5d84a09d8df4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:13.217015 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8cbe5496-f052-4ffa-8f0b-5d84a09d8df4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:13.217502 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8cbe5496-f052-4ffa-8f0b-5d84a09d8df4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:13.219728 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.compute.api [None req-8cbe5496-f052-4ffa-8f0b-5d84a09d8df4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 04 17:15:13.228432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-8cbe5496-f052-4ffa-8f0b-5d84a09d8df4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] deallocate_for_instance() {{(pid=131043) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 04 17:15:13.718866 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1ff2404a-f323-47ab-a67c-7dd048d97365 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:13.737549 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1ff2404a-f323-47ab-a67c-7dd048d97365 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7" status: 200 len: 1325 microversion: 2.1 time: 0.684882 Aug 04 17:15:13.739951 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2353/4771] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:13 2022] GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7 => generated 1325 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:13.762644 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d8225b32-73c1-4de4-916a-aa4031833b9d tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:13.765109 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d8225b32-73c1-4de4-916a-aa4031833b9d tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 947ffe69-3080-4602-872d-1bb16591d34e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:13.787568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8225b32-73c1-4de4-916a-aa4031833b9d tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:13.788078 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8225b32-73c1-4de4-916a-aa4031833b9d tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:13.788518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8225b32-73c1-4de4-916a-aa4031833b9d tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:13.789243 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8225b32-73c1-4de4-916a-aa4031833b9d tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:13.789696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8225b32-73c1-4de4-916a-aa4031833b9d tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:13.793651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8225b32-73c1-4de4-916a-aa4031833b9d tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:13.857781 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d8225b32-73c1-4de4-916a-aa4031833b9d tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116699 Aug 04 17:15:13.858482 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2354/4772] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:15:13 2022] GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:13.867910 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fd9a3973-d201-41fe-941f-ad871ad0668b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:13.869054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fd9a3973-d201-41fe-941f-ad871ad0668b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 314e3218-a990-4be2-aef1-d69a055897e9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:13.878064 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd9a3973-d201-41fe-941f-ad871ad0668b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:13.878737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd9a3973-d201-41fe-941f-ad871ad0668b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:13.879360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd9a3973-d201-41fe-941f-ad871ad0668b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:13.880081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd9a3973-d201-41fe-941f-ad871ad0668b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:13.880542 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd9a3973-d201-41fe-941f-ad871ad0668b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:13.880971 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd9a3973-d201-41fe-941f-ad871ad0668b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:14.278520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fd9a3973-d201-41fe-941f-ad871ad0668b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:14.294801 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fd9a3973-d201-41fe-941f-ad871ad0668b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9" status: 200 len: 1309 microversion: 2.1 time: 0.435316 Aug 04 17:15:14.308264 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2355/4773] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:13 2022] GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9 => generated 1309 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:14.308264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-accfe161-986e-46ba-b4c3-309891b3f4fa tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:14.308264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-accfe161-986e-46ba-b4c3-309891b3f4fa tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:14.314918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-accfe161-986e-46ba-b4c3-309891b3f4fa tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:14.315583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-accfe161-986e-46ba-b4c3-309891b3f4fa tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:14.317482 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-accfe161-986e-46ba-b4c3-309891b3f4fa tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:14.318248 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-accfe161-986e-46ba-b4c3-309891b3f4fa tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:14.318962 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-accfe161-986e-46ba-b4c3-309891b3f4fa tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:14.319919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-accfe161-986e-46ba-b4c3-309891b3f4fa tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:14.435966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-accfe161-986e-46ba-b4c3-309891b3f4fa tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:14.455234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-accfe161-986e-46ba-b4c3-309891b3f4fa tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:14.458255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-accfe161-986e-46ba-b4c3-309891b3f4fa tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:14.460885 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-accfe161-986e-46ba-b4c3-309891b3f4fa tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a" status: 200 len: 1407 microversion: 2.54 time: 0.159851 Aug 04 17:15:14.462054 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2356/4774] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:15:14 2022] GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:15:14.469278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=4 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:14.495818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=16 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:14.764410 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dab23651-f29b-41c7-af08-9e93547e0348 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:14.765438 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dab23651-f29b-41c7-af08-9e93547e0348 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 1a45e4c9-c9bd-4715-847d-6688654383c7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:14.775377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dab23651-f29b-41c7-af08-9e93547e0348 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:14.776955 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dab23651-f29b-41c7-af08-9e93547e0348 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:14.777687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dab23651-f29b-41c7-af08-9e93547e0348 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:14.779344 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dab23651-f29b-41c7-af08-9e93547e0348 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:14.780079 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dab23651-f29b-41c7-af08-9e93547e0348 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:14.782177 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dab23651-f29b-41c7-af08-9e93547e0348 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:15.010351 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-8cbe5496-f052-4ffa-8f0b-5d84a09d8df4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Updating instance_info_cache with network_info: [] {{(pid=131043) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 17:15:15.296082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dab23651-f29b-41c7-af08-9e93547e0348 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:15.312304 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dab23651-f29b-41c7-af08-9e93547e0348 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7" status: 200 len: 1325 microversion: 2.1 time: 0.552799 Aug 04 17:15:15.316274 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2357/4775] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:14 2022] GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7 => generated 1325 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:15.324928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d3e3d5ff-977c-41e9-b7f9-8a13b9617d6e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:15.336955 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d3e3d5ff-977c-41e9-b7f9-8a13b9617d6e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 947ffe69-3080-4602-872d-1bb16591d34e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:15.374980 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3e3d5ff-977c-41e9-b7f9-8a13b9617d6e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:15.378071 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3e3d5ff-977c-41e9-b7f9-8a13b9617d6e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:15.379557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3e3d5ff-977c-41e9-b7f9-8a13b9617d6e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:15.382161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3e3d5ff-977c-41e9-b7f9-8a13b9617d6e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:15.387769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3e3d5ff-977c-41e9-b7f9-8a13b9617d6e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:15.388508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3e3d5ff-977c-41e9-b7f9-8a13b9617d6e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:15.467320 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d3e3d5ff-977c-41e9-b7f9-8a13b9617d6e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149609 Aug 04 17:15:15.471737 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2358/4776] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:15:15 2022] GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:15.473303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-2f0b0b88-24bf-4788-9f48-ae1f6f3f2883 req-1069cef4-8d27-4228-bd15-6a834ce228c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9567ac7-9ee0-4ae3-b7c7-6033039de89d", "name": "network-vif-deleted", "tag": "aca16109-3001-402b-99ec-6923c19c2dfc"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:15.491181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2f0b0b88-24bf-4788-9f48-ae1f6f3f2883 req-1069cef4-8d27-4228-bd15-6a834ce228c1 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:15.491181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2f0b0b88-24bf-4788-9f48-ae1f6f3f2883 req-1069cef4-8d27-4228-bd15-6a834ce228c1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:15.491181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2f0b0b88-24bf-4788-9f48-ae1f6f3f2883 req-1069cef4-8d27-4228-bd15-6a834ce228c1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:15.516291 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.compute.server_external_events [req-2f0b0b88-24bf-4788-9f48-ae1f6f3f2883 req-1069cef4-8d27-4228-bd15-6a834ce228c1 service nova] Unable to find a host for instance a9567ac7-9ee0-4ae3-b7c7-6033039de89d. Dropping event network-vif-deleted {{(pid=131044) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 04 17:15:15.517265 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-2f0b0b88-24bf-4788-9f48-ae1f6f3f2883 req-1069cef4-8d27-4228-bd15-6a834ce228c1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.047992 Aug 04 17:15:15.517905 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2359/4777] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 49 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 04 17:15:15.529082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-966d1f8e-5865-4454-9d6b-bd29f8a943f2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:15.530160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-966d1f8e-5865-4454-9d6b-bd29f8a943f2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 314e3218-a990-4be2-aef1-d69a055897e9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:15.547862 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-966d1f8e-5865-4454-9d6b-bd29f8a943f2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:15.548374 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-966d1f8e-5865-4454-9d6b-bd29f8a943f2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:15.548935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-966d1f8e-5865-4454-9d6b-bd29f8a943f2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:15.549570 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-966d1f8e-5865-4454-9d6b-bd29f8a943f2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:15.550071 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-966d1f8e-5865-4454-9d6b-bd29f8a943f2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:15.550655 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-966d1f8e-5865-4454-9d6b-bd29f8a943f2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:15.638008 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8cbe5496-f052-4ffa-8f0b-5d84a09d8df4 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "DELETE /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 204 len: 0 microversion: 2.1 time: 3.766225 Aug 04 17:15:15.639760 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2419/4778] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:15:11 2022] DELETE /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 0 bytes in 3769 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:15:15.646986 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fd41d24a-d5cb-474d-9539-1b1a400251df tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:15.647674 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fd41d24a-d5cb-474d-9539-1b1a400251df tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:15.659528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd41d24a-d5cb-474d-9539-1b1a400251df tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:15.661668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd41d24a-d5cb-474d-9539-1b1a400251df tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:15.662219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd41d24a-d5cb-474d-9539-1b1a400251df tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:15.663007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd41d24a-d5cb-474d-9539-1b1a400251df tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:15.663495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd41d24a-d5cb-474d-9539-1b1a400251df tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:15.664662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd41d24a-d5cb-474d-9539-1b1a400251df tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:15.802995 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fd41d24a-d5cb-474d-9539-1b1a400251df tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:15.817070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fd41d24a-d5cb-474d-9539-1b1a400251df tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:15.819064 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fd41d24a-d5cb-474d-9539-1b1a400251df tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:15.821034 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fd41d24a-d5cb-474d-9539-1b1a400251df tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a" status: 200 len: 1407 microversion: 2.54 time: 0.179009 Aug 04 17:15:15.848654 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2420/4779] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:15:15 2022] GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:15:15.854452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-019021c9-d5fa-4afb-8f27-2c9408981828 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:15.855082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-019021c9-d5fa-4afb-8f27-2c9408981828 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: a9567ac7-9ee0-4ae3-b7c7-6033039de89d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:15.862400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-019021c9-d5fa-4afb-8f27-2c9408981828 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:15.863159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-019021c9-d5fa-4afb-8f27-2c9408981828 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:15.863728 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-019021c9-d5fa-4afb-8f27-2c9408981828 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:15.864451 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-019021c9-d5fa-4afb-8f27-2c9408981828 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:15.864923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-019021c9-d5fa-4afb-8f27-2c9408981828 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:15.865363 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-019021c9-d5fa-4afb-8f27-2c9408981828 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:15.880450 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-019021c9-d5fa-4afb-8f27-2c9408981828 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] HTTP exception thrown: Instance a9567ac7-9ee0-4ae3-b7c7-6033039de89d could not be found. Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-019021c9-d5fa-4afb-8f27-2c9408981828 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Request method failure captured: Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d HTTP/1.1 Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_yRMj5TmiUiePuxSnga_Pnns-Bpj5aA4uGmfrVKNtT7pLSLMV6hR6GdWVQMcx558mTVagVc5ritEKmEaG9jlrpABFcQhDSxLCEoyLH_vWnRVJyVNaLifB4cbPIAOTPDtpOkRM4AqnGVUyNlNzo9X9IxkbuoayvWNyDPnSX0E0uErX8 Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 683ce999e25e42a4a57b3c24a1fd24ef Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerActionsTestJSON-1286399382 Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/683ce999e25e42a4a57b3c24a1fd24ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/683ce999e25e42a4a57b3c24a1fd24ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_683ce999e25e42a4a57b3c24a1fd24ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/683ce999e25e42a4a57b3c24a1fd24ef"}]}] Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerActionsTestJSON-1286399382 Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 683ce999e25e42a4a57b3c24a1fd24ef Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerActionsTestJSON-1286399382 Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerActionsTestJSON-1286399382-project Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 01e6f70936a14e67aecaf71fb615fffa Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerActionsTestJSON-1286399382-project Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance a9567ac7-9ee0-4ae3-b7c7-6033039de89d could not be found. Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'a9567ac7-9ee0-4ae3-b7c7-6033039de89d'} Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9567ac7-9ee0-4ae3-b7c7-6033039de89d could not be found. Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9567ac7-9ee0-4ae3-b7c7-6033039de89d could not be found. Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:15.883078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:15.887617 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:15.887617 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:15.887617 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:15.887617 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:15:15.887617 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:15:15.887617 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9567ac7-9ee0-4ae3-b7c7-6033039de89d could not be found. Aug 04 17:15:15.887617 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:15.890031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-019021c9-d5fa-4afb-8f27-2c9408981828 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Returning 404 to user: Instance a9567ac7-9ee0-4ae3-b7c7-6033039de89d could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:15:15.891868 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-019021c9-d5fa-4afb-8f27-2c9408981828 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d" status: 404 len: 111 microversion: 2.1 time: 0.041143 Aug 04 17:15:15.893818 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2421/4780] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:15 2022] GET /compute/v2.1/servers/a9567ac7-9ee0-4ae3-b7c7-6033039de89d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:15:15.901887 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c650d26a-d3bf-477e-82ac-24dfae4c2e42 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:15.903788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c650d26a-d3bf-477e-82ac-24dfae4c2e42 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: eba6aa22-62ff-42e5-8401-f02b23ffeb85] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:15.920208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c650d26a-d3bf-477e-82ac-24dfae4c2e42 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:15.920972 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c650d26a-d3bf-477e-82ac-24dfae4c2e42 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:15.921610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c650d26a-d3bf-477e-82ac-24dfae4c2e42 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:15.922660 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c650d26a-d3bf-477e-82ac-24dfae4c2e42 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:15.923414 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c650d26a-d3bf-477e-82ac-24dfae4c2e42 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:15.924035 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c650d26a-d3bf-477e-82ac-24dfae4c2e42 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:15.960109 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c650d26a-d3bf-477e-82ac-24dfae4c2e42 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: eba6aa22-62ff-42e5-8401-f02b23ffeb85] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:15:16.015081 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=1,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:16.125214 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c650d26a-d3bf-477e-82ac-24dfae4c2e42 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "DELETE /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85" status: 204 len: 0 microversion: 2.1 time: 0.226881 Aug 04 17:15:16.129469 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2422/4781] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:15:15 2022] DELETE /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:15:16.130745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-966d1f8e-5865-4454-9d6b-bd29f8a943f2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:16.135663 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-07f0d8e5-4eb9-4fcc-9b7c-41a98e9ff432 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:16.137245 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-07f0d8e5-4eb9-4fcc-9b7c-41a98e9ff432 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: eba6aa22-62ff-42e5-8401-f02b23ffeb85] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:16.142929 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-966d1f8e-5865-4454-9d6b-bd29f8a943f2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9" status: 200 len: 1309 microversion: 2.1 time: 0.623801 Aug 04 17:15:16.151216 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2360/4782] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:15 2022] GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9 => generated 1309 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:16.161130 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-07f0d8e5-4eb9-4fcc-9b7c-41a98e9ff432 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:16.162094 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-07f0d8e5-4eb9-4fcc-9b7c-41a98e9ff432 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:16.162881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-07f0d8e5-4eb9-4fcc-9b7c-41a98e9ff432 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:16.163853 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-07f0d8e5-4eb9-4fcc-9b7c-41a98e9ff432 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:16.164578 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-07f0d8e5-4eb9-4fcc-9b7c-41a98e9ff432 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:16.165118 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-07f0d8e5-4eb9-4fcc-9b7c-41a98e9ff432 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:16.579545 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-032ea7ce-fb5b-4dc5-8146-1b41c0182032 req-337ff052-027d-4702-9829-6b996ff29b8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a45e4c9-c9bd-4715-847d-6688654383c7", "name": "network-vif-plugged", "status": "completed", "tag": "42f0cb89-bdf2-4789-8374-f82df66286fc"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:16.599692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-032ea7ce-fb5b-4dc5-8146-1b41c0182032 req-337ff052-027d-4702-9829-6b996ff29b8f service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:16.600331 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-032ea7ce-fb5b-4dc5-8146-1b41c0182032 req-337ff052-027d-4702-9829-6b996ff29b8f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:16.600765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-032ea7ce-fb5b-4dc5-8146-1b41c0182032 req-337ff052-027d-4702-9829-6b996ff29b8f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:16.617743 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-032ea7ce-fb5b-4dc5-8146-1b41c0182032 req-337ff052-027d-4702-9829-6b996ff29b8f service nova] Creating event network-vif-plugged:42f0cb89-bdf2-4789-8374-f82df66286fc for instance 1a45e4c9-c9bd-4715-847d-6688654383c7 on n-h2-851359-3 Aug 04 17:15:16.627571 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-032ea7ce-fb5b-4dc5-8146-1b41c0182032 req-337ff052-027d-4702-9829-6b996ff29b8f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.351006 Aug 04 17:15:16.633078 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2361/4783] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:16.639314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3fb9e0b6-5c5c-429e-9901-911e0729e031 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:16.640211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3fb9e0b6-5c5c-429e-9901-911e0729e031 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 1a45e4c9-c9bd-4715-847d-6688654383c7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:16.648902 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3fb9e0b6-5c5c-429e-9901-911e0729e031 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:16.649404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3fb9e0b6-5c5c-429e-9901-911e0729e031 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:16.649843 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3fb9e0b6-5c5c-429e-9901-911e0729e031 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:16.650579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3fb9e0b6-5c5c-429e-9901-911e0729e031 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:16.651034 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3fb9e0b6-5c5c-429e-9901-911e0729e031 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:16.651459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3fb9e0b6-5c5c-429e-9901-911e0729e031 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:16.698531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-07f0d8e5-4eb9-4fcc-9b7c-41a98e9ff432 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:16.707945 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-07f0d8e5-4eb9-4fcc-9b7c-41a98e9ff432 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85" status: 200 len: 1466 microversion: 2.1 time: 0.576397 Aug 04 17:15:16.721789 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2423/4784] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:16 2022] GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85 => generated 1466 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:16.721789 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c7a54550-ee05-4eb1-9828-103a989e6023 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:16.721789 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c7a54550-ee05-4eb1-9828-103a989e6023 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 947ffe69-3080-4602-872d-1bb16591d34e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:16.728260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c7a54550-ee05-4eb1-9828-103a989e6023 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:16.728572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c7a54550-ee05-4eb1-9828-103a989e6023 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:16.729091 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c7a54550-ee05-4eb1-9828-103a989e6023 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:16.729818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c7a54550-ee05-4eb1-9828-103a989e6023 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:16.730303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c7a54550-ee05-4eb1-9828-103a989e6023 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:16.730729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c7a54550-ee05-4eb1-9828-103a989e6023 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:16.771714 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c7a54550-ee05-4eb1-9828-103a989e6023 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060234 Aug 04 17:15:16.773128 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2424/4785] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:15:16 2022] GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:16.837640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3fb9e0b6-5c5c-429e-9901-911e0729e031 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:16.846711 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3fb9e0b6-5c5c-429e-9901-911e0729e031 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7" status: 200 len: 1325 microversion: 2.1 time: 0.212204 Aug 04 17:15:16.847558 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2362/4786] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:16 2022] GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7 => generated 1325 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:16.859573 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-60d11530-d118-48a8-92c1-60146e105731 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:16.860861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-60d11530-d118-48a8-92c1-60146e105731 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:16.868135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60d11530-d118-48a8-92c1-60146e105731 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:16.868875 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60d11530-d118-48a8-92c1-60146e105731 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:16.869503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60d11530-d118-48a8-92c1-60146e105731 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:16.870421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60d11530-d118-48a8-92c1-60146e105731 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:16.871662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60d11530-d118-48a8-92c1-60146e105731 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:16.872097 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60d11530-d118-48a8-92c1-60146e105731 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:16.944572 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e5b78a36-1e43-41b3-ad98-762fed8c045e tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1074442261", "availability_zone": "foo_zone"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:16.948135 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:15:16.948135 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 17:15:16.949133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.aggregate [None req-e5b78a36-1e43-41b3-ad98-762fed8c045e tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] Generated uuid 8b89174c-501e-4e25-bcb1-a97a75c4e273 for aggregate {{(pid=131044) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 04 17:15:16.951901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-60d11530-d118-48a8-92c1-60146e105731 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:16.961095 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-60d11530-d118-48a8-92c1-60146e105731 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:16.962786 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-60d11530-d118-48a8-92c1-60146e105731 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:16.963980 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-60d11530-d118-48a8-92c1-60146e105731 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a" status: 200 len: 1407 microversion: 2.54 time: 0.112668 Aug 04 17:15:16.964563 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2425/4787] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:15:16 2022] GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a => generated 1407 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:15:16.993540 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e5b78a36-1e43-41b3-ad98-762fed8c045e tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.107611 Aug 04 17:15:16.994797 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2363/4788] 10.222.0.93 () {60 vars in 1164 bytes} [Thu Aug 4 17:15:16 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:17.009183 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-58c130e3-eaba-42db-8dbb-39859b340e62 tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:17.012783 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:15:17.012783 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 17:15:17.036030 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-58c130e3-eaba-42db-8dbb-39859b340e62 tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.031835 Aug 04 17:15:17.037005 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2426/4789] 10.222.0.93 () {60 vars in 1194 bytes} [Thu Aug 4 17:15:17 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:15:17.048632 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bb2a2dd7-c53a-4c78-8f53-fc2975188d43 tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:17.051222 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:15:17.051222 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 17:15:17.053101 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb2a2dd7-c53a-4c78-8f53-fc2975188d43 tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:17.053599 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb2a2dd7-c53a-4c78-8f53-fc2975188d43 tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:17.054120 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb2a2dd7-c53a-4c78-8f53-fc2975188d43 tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:17.054869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb2a2dd7-c53a-4c78-8f53-fc2975188d43 tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:17.055343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb2a2dd7-c53a-4c78-8f53-fc2975188d43 tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:17.055756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb2a2dd7-c53a-4c78-8f53-fc2975188d43 tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:17.093651 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bb2a2dd7-c53a-4c78-8f53-fc2975188d43 tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] 10.222.0.93 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.049104 Aug 04 17:15:17.095372 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2364/4790] 10.222.0.93 () {58 vars in 1176 bytes} [Thu Aug 4 17:15:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:17.108895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c5c03971-6524-48cc-9683-39aa66615159 tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:17.109800 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:15:17.109800 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 17:15:17.117811 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c5c03971-6524-48cc-9683-39aa66615159 tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.013072 Aug 04 17:15:17.118694 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2427/4791] 10.222.0.93 () {58 vars in 1143 bytes} [Thu Aug 4 17:15:17 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:17.136016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7b4cda11-72bc-417a-9a98-a094e18e3fd4 tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-851359-3"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:17.138645 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:15:17.138645 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 17:15:17.147408 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b4cda11-72bc-417a-9a98-a094e18e3fd4 tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:17.148163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b4cda11-72bc-417a-9a98-a094e18e3fd4 tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:17.148762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b4cda11-72bc-417a-9a98-a094e18e3fd4 tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:17.164642 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-de764250-0019-4b26-8b92-174e4ae7fcb8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:17.165502 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-de764250-0019-4b26-8b92-174e4ae7fcb8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 314e3218-a990-4be2-aef1-d69a055897e9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:17.165623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:17.174638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de764250-0019-4b26-8b92-174e4ae7fcb8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:17.175973 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de764250-0019-4b26-8b92-174e4ae7fcb8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:17.179427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de764250-0019-4b26-8b92-174e4ae7fcb8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:17.180995 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de764250-0019-4b26-8b92-174e4ae7fcb8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:17.182240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de764250-0019-4b26-8b92-174e4ae7fcb8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:17.186763 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de764250-0019-4b26-8b92-174e4ae7fcb8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:17.442306 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7b4cda11-72bc-417a-9a98-a094e18e3fd4 tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.315398 Aug 04 17:15:17.443318 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2365/4792] 10.222.0.93 () {60 vars in 1194 bytes} [Thu Aug 4 17:15:17 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:17.455299 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-230beab9-e186-42d9-a908-dd9d8117b7c1 tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:17.456466 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:15:17.456466 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 17:15:17.464288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-de764250-0019-4b26-8b92-174e4ae7fcb8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:17.466970 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-230beab9-e186-42d9-a908-dd9d8117b7c1 tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.016420 Aug 04 17:15:17.468450 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2366/4793] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Aug 4 17:15:17 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:15:17.480082 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-de764250-0019-4b26-8b92-174e4ae7fcb8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9" status: 200 len: 1309 microversion: 2.1 time: 0.319495 Aug 04 17:15:17.481622 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2428/4794] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:17 2022] GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9 => generated 1309 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:17.482577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-071f1110-8d86-4888-a50d-e9d2c6d7b9d2 tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1818185086", "availability_zone": "foo_zone"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:17.488031 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:15:17.488031 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 17:15:17.537871 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-071f1110-8d86-4888-a50d-e9d2c6d7b9d2 tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] 10.222.0.93 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.061553 Aug 04 17:15:17.541953 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2367/4795] 10.222.0.93 () {60 vars in 1173 bytes} [Thu Aug 4 17:15:17 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:17.554449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-aa90d867-6a31-4dc7-ab4f-b4bf188bf54d tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:17.557035 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:15:17.557035 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 17:15:17.584828 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-aa90d867-6a31-4dc7-ab4f-b4bf188bf54d tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.034968 Aug 04 17:15:17.585442 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2429/4796] 10.222.0.93 () {60 vars in 1194 bytes} [Thu Aug 4 17:15:17 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:15:17.597276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d7000393-a429-44d7-938b-d71ff5585180 tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:17.598083 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:15:17.598083 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 17:15:17.606130 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d7000393-a429-44d7-938b-d71ff5585180 tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] 10.222.0.93 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.012718 Aug 04 17:15:17.606704 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2368/4797] 10.222.0.93 () {58 vars in 1152 bytes} [Thu Aug 4 17:15:17 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:17.619612 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e4901614-5008-4c40-8499-14d4a1584660 tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-851359-3"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:17.622361 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:15:17.622361 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 17:15:17.631485 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4901614-5008-4c40-8499-14d4a1584660 tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:17.632043 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4901614-5008-4c40-8499-14d4a1584660 tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:17.632553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4901614-5008-4c40-8499-14d4a1584660 tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:17.729297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d8a21fcd-feec-41ec-8cf9-4062c6300898 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:17.730232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d8a21fcd-feec-41ec-8cf9-4062c6300898 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: eba6aa22-62ff-42e5-8401-f02b23ffeb85] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:17.743611 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8a21fcd-feec-41ec-8cf9-4062c6300898 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:17.755864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8a21fcd-feec-41ec-8cf9-4062c6300898 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:17.756748 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8a21fcd-feec-41ec-8cf9-4062c6300898 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:17.757526 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8a21fcd-feec-41ec-8cf9-4062c6300898 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:17.758807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8a21fcd-feec-41ec-8cf9-4062c6300898 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:17.759285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8a21fcd-feec-41ec-8cf9-4062c6300898 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:17.907529 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e4901614-5008-4c40-8499-14d4a1584660 tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] 10.222.0.93 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.292106 Aug 04 17:15:17.908611 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2430/4798] 10.222.0.93 () {60 vars in 1194 bytes} [Thu Aug 4 17:15:17 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:17.914233 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ba388edf-7174-4852-b516-0d6e1cd80da8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:17.916777 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ba388edf-7174-4852-b516-0d6e1cd80da8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 947ffe69-3080-4602-872d-1bb16591d34e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:17.932513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba388edf-7174-4852-b516-0d6e1cd80da8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:17.935609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba388edf-7174-4852-b516-0d6e1cd80da8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:17.936511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba388edf-7174-4852-b516-0d6e1cd80da8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:17.939220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba388edf-7174-4852-b516-0d6e1cd80da8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:17.942876 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba388edf-7174-4852-b516-0d6e1cd80da8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:17.945199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba388edf-7174-4852-b516-0d6e1cd80da8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:18.011442 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d8a21fcd-feec-41ec-8cf9-4062c6300898 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:18.022294 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d8a21fcd-feec-41ec-8cf9-4062c6300898 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85" status: 200 len: 1470 microversion: 2.1 time: 0.297135 Aug 04 17:15:18.023392 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2369/4799] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:17 2022] GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85 => generated 1470 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:18.029061 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3ae1de47-2b6a-4ee4-97a0-e90d17e1ebcc tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:18.030021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3ae1de47-2b6a-4ee4-97a0-e90d17e1ebcc tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 1a45e4c9-c9bd-4715-847d-6688654383c7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:18.037691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ae1de47-2b6a-4ee4-97a0-e90d17e1ebcc tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:18.038592 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ae1de47-2b6a-4ee4-97a0-e90d17e1ebcc tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:18.039314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ae1de47-2b6a-4ee4-97a0-e90d17e1ebcc tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:18.040433 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ae1de47-2b6a-4ee4-97a0-e90d17e1ebcc tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:18.041418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ae1de47-2b6a-4ee4-97a0-e90d17e1ebcc tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:18.042151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ae1de47-2b6a-4ee4-97a0-e90d17e1ebcc tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:18.050686 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ba388edf-7174-4852-b516-0d6e1cd80da8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139859 Aug 04 17:15:18.055126 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2431/4800] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:15:17 2022] GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:18.065333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-296b36fb-3cbb-46eb-b115-13257f3e21c8 tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:18.069514 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:15:18.069514 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 17:15:18.099526 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-296b36fb-3cbb-46eb-b115-13257f3e21c8 tempest-TestAggregatesBasicOps-933703659 tempest-TestAggregatesBasicOps-933703659-project-admin] 10.222.0.93 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.045985 Aug 04 17:15:18.106812 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2432/4801] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Aug 4 17:15:18 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 04 17:15:18.118534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e1cda28e-acc5-45c2-b507-3035b35b17fb tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:18.119402 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e1cda28e-acc5-45c2-b507-3035b35b17fb tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:18.128729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1cda28e-acc5-45c2-b507-3035b35b17fb tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:18.129530 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1cda28e-acc5-45c2-b507-3035b35b17fb tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:18.130358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1cda28e-acc5-45c2-b507-3035b35b17fb tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:18.131076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1cda28e-acc5-45c2-b507-3035b35b17fb tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:18.131689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1cda28e-acc5-45c2-b507-3035b35b17fb tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:18.132275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1cda28e-acc5-45c2-b507-3035b35b17fb tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:18.243942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e1cda28e-acc5-45c2-b507-3035b35b17fb tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:18.260883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e1cda28e-acc5-45c2-b507-3035b35b17fb tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:18.266564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e1cda28e-acc5-45c2-b507-3035b35b17fb tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:18.267860 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e1cda28e-acc5-45c2-b507-3035b35b17fb tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a" status: 200 len: 1407 microversion: 2.54 time: 0.159492 Aug 04 17:15:18.268441 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2433/4802] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:15:18 2022] GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:15:18.288775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3ae1de47-2b6a-4ee4-97a0-e90d17e1ebcc tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:18.300876 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3ae1de47-2b6a-4ee4-97a0-e90d17e1ebcc tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7" status: 200 len: 1325 microversion: 2.1 time: 0.276038 Aug 04 17:15:18.301869 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2370/4803] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:18 2022] GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7 => generated 1325 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:18.504453 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c111eeb4-e8bc-4e6d-8442-ed2d58225572 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:18.505088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c111eeb4-e8bc-4e6d-8442-ed2d58225572 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 314e3218-a990-4be2-aef1-d69a055897e9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:18.512575 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c111eeb4-e8bc-4e6d-8442-ed2d58225572 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:18.512790 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c111eeb4-e8bc-4e6d-8442-ed2d58225572 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:18.515969 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c111eeb4-e8bc-4e6d-8442-ed2d58225572 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:18.516769 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c111eeb4-e8bc-4e6d-8442-ed2d58225572 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:18.517259 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c111eeb4-e8bc-4e6d-8442-ed2d58225572 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:18.517712 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c111eeb4-e8bc-4e6d-8442-ed2d58225572 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:18.751394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c111eeb4-e8bc-4e6d-8442-ed2d58225572 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:18.763276 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c111eeb4-e8bc-4e6d-8442-ed2d58225572 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9" status: 200 len: 1309 microversion: 2.1 time: 0.262897 Aug 04 17:15:18.765542 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2434/4804] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:18 2022] GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9 => generated 1309 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:18.873646 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-c08809cc-1162-4ad4-b6fc-bc58b19e0614 req-8e3b89ce-add0-490a-9ac3-939240bfb104 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eba6aa22-62ff-42e5-8401-f02b23ffeb85", "name": "network-vif-deleted", "tag": "f347cd22-db0b-4a20-abd4-efe2343e7d90"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:18.889825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c08809cc-1162-4ad4-b6fc-bc58b19e0614 req-8e3b89ce-add0-490a-9ac3-939240bfb104 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:18.890340 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c08809cc-1162-4ad4-b6fc-bc58b19e0614 req-8e3b89ce-add0-490a-9ac3-939240bfb104 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:18.890777 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c08809cc-1162-4ad4-b6fc-bc58b19e0614 req-8e3b89ce-add0-490a-9ac3-939240bfb104 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:18.910208 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-c08809cc-1162-4ad4-b6fc-bc58b19e0614 req-8e3b89ce-add0-490a-9ac3-939240bfb104 service nova] Creating event network-vif-deleted:f347cd22-db0b-4a20-abd4-efe2343e7d90 for instance eba6aa22-62ff-42e5-8401-f02b23ffeb85 on n-h1-851359-3 Aug 04 17:15:18.916942 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-c08809cc-1162-4ad4-b6fc-bc58b19e0614 req-8e3b89ce-add0-490a-9ac3-939240bfb104 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048619 Aug 04 17:15:18.918980 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2371/4805] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:15:19.045419 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-96174f23-b531-421b-9981-359f9198cf3a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:19.047484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-96174f23-b531-421b-9981-359f9198cf3a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: eba6aa22-62ff-42e5-8401-f02b23ffeb85] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:19.065922 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-34d567ab-f69f-4c37-a226-21a65a6f1231 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:19.070932 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-34d567ab-f69f-4c37-a226-21a65a6f1231 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 947ffe69-3080-4602-872d-1bb16591d34e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:19.092159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34d567ab-f69f-4c37-a226-21a65a6f1231 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:19.094296 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34d567ab-f69f-4c37-a226-21a65a6f1231 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:19.095417 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34d567ab-f69f-4c37-a226-21a65a6f1231 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:19.096351 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34d567ab-f69f-4c37-a226-21a65a6f1231 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:19.097958 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34d567ab-f69f-4c37-a226-21a65a6f1231 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:19.101944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34d567ab-f69f-4c37-a226-21a65a6f1231 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:19.103714 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-96174f23-b531-421b-9981-359f9198cf3a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:19.106901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-96174f23-b531-421b-9981-359f9198cf3a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:19.110108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-96174f23-b531-421b-9981-359f9198cf3a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:19.113876 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-96174f23-b531-421b-9981-359f9198cf3a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:19.114686 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-96174f23-b531-421b-9981-359f9198cf3a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:19.115254 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-96174f23-b531-421b-9981-359f9198cf3a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:19.185260 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-34d567ab-f69f-4c37-a226-21a65a6f1231 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.124961 Aug 04 17:15:19.186135 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2372/4806] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:15:19 2022] GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e/os-volume_attachments => generated 25 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:15:19.228023 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-96174f23-b531-421b-9981-359f9198cf3a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:19.228732 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-96174f23-b531-421b-9981-359f9198cf3a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:19.229193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-96174f23-b531-421b-9981-359f9198cf3a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:19.229660 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-96174f23-b531-421b-9981-359f9198cf3a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lazy-loading 'fault' on Instance uuid eba6aa22-62ff-42e5-8401-f02b23ffeb85 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:15:19.291858 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1e90e858-ecf4-4642-811f-52ba02c9430a tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:19.292420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1e90e858-ecf4-4642-811f-52ba02c9430a tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 947ffe69-3080-4602-872d-1bb16591d34e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:19.300913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e90e858-ecf4-4642-811f-52ba02c9430a tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:19.301411 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e90e858-ecf4-4642-811f-52ba02c9430a tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:19.301855 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e90e858-ecf4-4642-811f-52ba02c9430a tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:19.302590 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e90e858-ecf4-4642-811f-52ba02c9430a tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:19.303044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e90e858-ecf4-4642-811f-52ba02c9430a tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:19.306142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e90e858-ecf4-4642-811f-52ba02c9430a tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:19.317965 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-96174f23-b531-421b-9981-359f9198cf3a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:19.327131 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-96174f23-b531-421b-9981-359f9198cf3a tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85" status: 200 len: 1305 microversion: 2.1 time: 0.287022 Aug 04 17:15:19.327935 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2435/4807] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:19 2022] GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85 => generated 1305 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:19.333770 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f6ec6a3a-102c-4c81-9c3f-40e27855db31 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:19.334626 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f6ec6a3a-102c-4c81-9c3f-40e27855db31 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:19.340361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1e90e858-ecf4-4642-811f-52ba02c9430a tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 947ffe69-3080-4602-872d-1bb16591d34e] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:15:19.354150 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f6ec6a3a-102c-4c81-9c3f-40e27855db31 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:19.354658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f6ec6a3a-102c-4c81-9c3f-40e27855db31 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:19.355627 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f6ec6a3a-102c-4c81-9c3f-40e27855db31 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:19.356534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f6ec6a3a-102c-4c81-9c3f-40e27855db31 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:19.357003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f6ec6a3a-102c-4c81-9c3f-40e27855db31 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:19.357836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f6ec6a3a-102c-4c81-9c3f-40e27855db31 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:19.472251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f6ec6a3a-102c-4c81-9c3f-40e27855db31 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:19.478669 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1e90e858-ecf4-4642-811f-52ba02c9430a tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "DELETE /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e" status: 204 len: 0 microversion: 2.1 time: 0.191130 Aug 04 17:15:19.479454 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2373/4808] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:15:19 2022] DELETE /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 17:15:19.483650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f6ec6a3a-102c-4c81-9c3f-40e27855db31 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:19.485340 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f6ec6a3a-102c-4c81-9c3f-40e27855db31 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:19.486585 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f6ec6a3a-102c-4c81-9c3f-40e27855db31 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a" status: 200 len: 1407 microversion: 2.54 time: 0.157537 Aug 04 17:15:19.486732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5216370f-c4f3-4359-a109-e562b540da2d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:19.487146 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2436/4809] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:15:19 2022] GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:15:19.492547 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-86af729b-d605-46d5-8109-f5dd711fd705 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:19.493301 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-86af729b-d605-46d5-8109-f5dd711fd705 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 947ffe69-3080-4602-872d-1bb16591d34e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:19.499676 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86af729b-d605-46d5-8109-f5dd711fd705 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:19.500126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5216370f-c4f3-4359-a109-e562b540da2d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 1a45e4c9-c9bd-4715-847d-6688654383c7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:19.500249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86af729b-d605-46d5-8109-f5dd711fd705 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:19.500698 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86af729b-d605-46d5-8109-f5dd711fd705 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:19.501456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86af729b-d605-46d5-8109-f5dd711fd705 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:19.501923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86af729b-d605-46d5-8109-f5dd711fd705 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:19.502386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86af729b-d605-46d5-8109-f5dd711fd705 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:19.511067 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5216370f-c4f3-4359-a109-e562b540da2d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:19.511602 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5216370f-c4f3-4359-a109-e562b540da2d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:19.512047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5216370f-c4f3-4359-a109-e562b540da2d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:19.512767 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5216370f-c4f3-4359-a109-e562b540da2d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:19.513229 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5216370f-c4f3-4359-a109-e562b540da2d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:19.513659 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5216370f-c4f3-4359-a109-e562b540da2d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:19.536819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:19.711964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-86af729b-d605-46d5-8109-f5dd711fd705 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:19.721847 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-86af729b-d605-46d5-8109-f5dd711fd705 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e" status: 200 len: 1682 microversion: 2.1 time: 0.233296 Aug 04 17:15:19.722168 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2437/4810] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:19 2022] GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e => generated 1682 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:19.770647 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5216370f-c4f3-4359-a109-e562b540da2d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:19.783128 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5216370f-c4f3-4359-a109-e562b540da2d tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7" status: 200 len: 1521 microversion: 2.1 time: 0.302614 Aug 04 17:15:19.783722 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2374/4811] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:19 2022] GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:19.799136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dc5a2c4c-6cad-4f28-8be4-b165c1b4cf24 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:19.799769 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dc5a2c4c-6cad-4f28-8be4-b165c1b4cf24 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 314e3218-a990-4be2-aef1-d69a055897e9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:19.809237 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d395af7c-bc47-442f-ad55-e12ed0d11d4c tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:19.810213 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d395af7c-bc47-442f-ad55-e12ed0d11d4c tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 1a45e4c9-c9bd-4715-847d-6688654383c7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:19.817587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d395af7c-bc47-442f-ad55-e12ed0d11d4c tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:19.818271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d395af7c-bc47-442f-ad55-e12ed0d11d4c tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:19.818872 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d395af7c-bc47-442f-ad55-e12ed0d11d4c tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:19.819769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d395af7c-bc47-442f-ad55-e12ed0d11d4c tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:19.820506 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc5a2c4c-6cad-4f28-8be4-b165c1b4cf24 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:19.820781 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d395af7c-bc47-442f-ad55-e12ed0d11d4c tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:19.821015 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc5a2c4c-6cad-4f28-8be4-b165c1b4cf24 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:19.821463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc5a2c4c-6cad-4f28-8be4-b165c1b4cf24 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:19.821704 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d395af7c-bc47-442f-ad55-e12ed0d11d4c tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:19.822770 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc5a2c4c-6cad-4f28-8be4-b165c1b4cf24 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:19.823335 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc5a2c4c-6cad-4f28-8be4-b165c1b4cf24 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:19.824306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc5a2c4c-6cad-4f28-8be4-b165c1b4cf24 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:19.871168 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d395af7c-bc47-442f-ad55-e12ed0d11d4c tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 1a45e4c9-c9bd-4715-847d-6688654383c7] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:15:20.036178 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d395af7c-bc47-442f-ad55-e12ed0d11d4c tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "DELETE /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7" status: 204 len: 0 microversion: 2.1 time: 0.224824 Aug 04 17:15:20.039966 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2375/4812] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:15:19 2022] DELETE /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:15:20.047932 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e11aa5c2-9d0b-4433-a366-ea4424db2c6e tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:20.049106 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e11aa5c2-9d0b-4433-a366-ea4424db2c6e tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 1a45e4c9-c9bd-4715-847d-6688654383c7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:20.058989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e11aa5c2-9d0b-4433-a366-ea4424db2c6e tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:20.059651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e11aa5c2-9d0b-4433-a366-ea4424db2c6e tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:20.060390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e11aa5c2-9d0b-4433-a366-ea4424db2c6e tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:20.061378 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e11aa5c2-9d0b-4433-a366-ea4424db2c6e tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:20.062050 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e11aa5c2-9d0b-4433-a366-ea4424db2c6e tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:20.062713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e11aa5c2-9d0b-4433-a366-ea4424db2c6e tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:20.092622 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dc5a2c4c-6cad-4f28-8be4-b165c1b4cf24 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:20.104133 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dc5a2c4c-6cad-4f28-8be4-b165c1b4cf24 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9" status: 200 len: 1309 microversion: 2.1 time: 0.319348 Aug 04 17:15:20.107161 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2438/4813] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:19 2022] GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9 => generated 1309 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:15:20.236607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e11aa5c2-9d0b-4433-a366-ea4424db2c6e tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:20.245192 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e11aa5c2-9d0b-4433-a366-ea4424db2c6e tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7" status: 200 len: 1527 microversion: 2.1 time: 0.203073 Aug 04 17:15:20.246812 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2376/4814] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:20 2022] GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7 => generated 1527 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:20.349584 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-682c2a4d-c086-4d10-9fac-3e84d0294a4d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:20.350913 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-682c2a4d-c086-4d10-9fac-3e84d0294a4d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: eba6aa22-62ff-42e5-8401-f02b23ffeb85] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:20.358200 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-682c2a4d-c086-4d10-9fac-3e84d0294a4d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:20.358933 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-682c2a4d-c086-4d10-9fac-3e84d0294a4d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:20.359476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-682c2a4d-c086-4d10-9fac-3e84d0294a4d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:20.360292 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-682c2a4d-c086-4d10-9fac-3e84d0294a4d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:20.360909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-682c2a4d-c086-4d10-9fac-3e84d0294a4d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:20.361435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-682c2a4d-c086-4d10-9fac-3e84d0294a4d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:20.399202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-682c2a4d-c086-4d10-9fac-3e84d0294a4d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:20.399802 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-682c2a4d-c086-4d10-9fac-3e84d0294a4d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:20.400321 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-682c2a4d-c086-4d10-9fac-3e84d0294a4d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:20.400930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-682c2a4d-c086-4d10-9fac-3e84d0294a4d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lazy-loading 'fault' on Instance uuid eba6aa22-62ff-42e5-8401-f02b23ffeb85 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:15:20.450360 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-682c2a4d-c086-4d10-9fac-3e84d0294a4d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:20.458831 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-682c2a4d-c086-4d10-9fac-3e84d0294a4d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85" status: 200 len: 1305 microversion: 2.1 time: 0.113902 Aug 04 17:15:20.470289 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2439/4815] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:20 2022] GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85 => generated 1305 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:20.517173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5030f24d-dde2-4127-9333-af8c1555a198 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:20.518014 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5030f24d-dde2-4127-9333-af8c1555a198 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:20.527494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5030f24d-dde2-4127-9333-af8c1555a198 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:20.528190 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5030f24d-dde2-4127-9333-af8c1555a198 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:20.528800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5030f24d-dde2-4127-9333-af8c1555a198 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:20.529688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5030f24d-dde2-4127-9333-af8c1555a198 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:20.530368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5030f24d-dde2-4127-9333-af8c1555a198 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:20.531115 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5030f24d-dde2-4127-9333-af8c1555a198 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:20.614964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5030f24d-dde2-4127-9333-af8c1555a198 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:20.629279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5030f24d-dde2-4127-9333-af8c1555a198 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:20.631354 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5030f24d-dde2-4127-9333-af8c1555a198 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:20.632811 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5030f24d-dde2-4127-9333-af8c1555a198 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a" status: 200 len: 1407 microversion: 2.54 time: 0.122471 Aug 04 17:15:20.634153 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2377/4816] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:15:20 2022] GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a => generated 1407 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:15:20.680580 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-de6e15c1-cd21-402c-ae37-a2d3cf50c446 req-280f59cc-2b96-4c62-b94a-4dd83d8d3617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "314e3218-a990-4be2-aef1-d69a055897e9", "name": "network-vif-plugged", "status": "completed", "tag": "3d5e1fae-5919-469b-addc-bb208c32cdc6"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:20.694688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-de6e15c1-cd21-402c-ae37-a2d3cf50c446 req-280f59cc-2b96-4c62-b94a-4dd83d8d3617 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:20.695464 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-de6e15c1-cd21-402c-ae37-a2d3cf50c446 req-280f59cc-2b96-4c62-b94a-4dd83d8d3617 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:20.696004 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-de6e15c1-cd21-402c-ae37-a2d3cf50c446 req-280f59cc-2b96-4c62-b94a-4dd83d8d3617 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:20.711443 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-de6e15c1-cd21-402c-ae37-a2d3cf50c446 req-280f59cc-2b96-4c62-b94a-4dd83d8d3617 service nova] Creating event network-vif-plugged:3d5e1fae-5919-469b-addc-bb208c32cdc6 for instance 314e3218-a990-4be2-aef1-d69a055897e9 on n-h2-851359-3 Aug 04 17:15:20.721895 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-de6e15c1-cd21-402c-ae37-a2d3cf50c446 req-280f59cc-2b96-4c62-b94a-4dd83d8d3617 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044495 Aug 04 17:15:20.722533 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2440/4817] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:20.745096 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-25d5fed5-8dff-4163-a9c2-12dfb19247c1 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:20.746761 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-25d5fed5-8dff-4163-a9c2-12dfb19247c1 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 947ffe69-3080-4602-872d-1bb16591d34e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:20.754457 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25d5fed5-8dff-4163-a9c2-12dfb19247c1 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:20.755459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25d5fed5-8dff-4163-a9c2-12dfb19247c1 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:20.756066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25d5fed5-8dff-4163-a9c2-12dfb19247c1 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:20.758265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25d5fed5-8dff-4163-a9c2-12dfb19247c1 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:20.759129 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25d5fed5-8dff-4163-a9c2-12dfb19247c1 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:20.759600 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25d5fed5-8dff-4163-a9c2-12dfb19247c1 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:20.920882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=12 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:20.944719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-25d5fed5-8dff-4163-a9c2-12dfb19247c1 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:20.958358 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-25d5fed5-8dff-4163-a9c2-12dfb19247c1 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e" status: 200 len: 1682 microversion: 2.1 time: 0.218290 Aug 04 17:15:20.974068 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2378/4818] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:20 2022] GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e => generated 1682 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:21.126022 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c9611790-e608-4cab-ba01-875dba542086 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:21.127562 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c9611790-e608-4cab-ba01-875dba542086 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 314e3218-a990-4be2-aef1-d69a055897e9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:21.135018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9611790-e608-4cab-ba01-875dba542086 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:21.135899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9611790-e608-4cab-ba01-875dba542086 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:21.137239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9611790-e608-4cab-ba01-875dba542086 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:21.138229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9611790-e608-4cab-ba01-875dba542086 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:21.138874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9611790-e608-4cab-ba01-875dba542086 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:21.140367 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9611790-e608-4cab-ba01-875dba542086 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:21.267521 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7ec3d324-7a56-4a77-a7d4-b262e2643024 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:21.268150 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7ec3d324-7a56-4a77-a7d4-b262e2643024 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 1a45e4c9-c9bd-4715-847d-6688654383c7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:21.280410 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ec3d324-7a56-4a77-a7d4-b262e2643024 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:21.281007 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ec3d324-7a56-4a77-a7d4-b262e2643024 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:21.281463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ec3d324-7a56-4a77-a7d4-b262e2643024 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:21.282236 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ec3d324-7a56-4a77-a7d4-b262e2643024 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:21.282700 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ec3d324-7a56-4a77-a7d4-b262e2643024 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:21.283133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ec3d324-7a56-4a77-a7d4-b262e2643024 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:21.385281 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c9611790-e608-4cab-ba01-875dba542086 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:21.395721 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c9611790-e608-4cab-ba01-875dba542086 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9" status: 200 len: 1309 microversion: 2.1 time: 0.273751 Aug 04 17:15:21.402192 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2441/4819] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:21 2022] GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9 => generated 1309 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:21.481560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1d82ec6e-2dca-4456-be4a-29579964b532 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:21.482405 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1d82ec6e-2dca-4456-be4a-29579964b532 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: eba6aa22-62ff-42e5-8401-f02b23ffeb85] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:21.489021 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d82ec6e-2dca-4456-be4a-29579964b532 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:21.489651 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d82ec6e-2dca-4456-be4a-29579964b532 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:21.490452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d82ec6e-2dca-4456-be4a-29579964b532 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:21.491267 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d82ec6e-2dca-4456-be4a-29579964b532 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:21.491837 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d82ec6e-2dca-4456-be4a-29579964b532 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:21.492367 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d82ec6e-2dca-4456-be4a-29579964b532 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:21.494699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7ec3d324-7a56-4a77-a7d4-b262e2643024 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:21.508080 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-1d82ec6e-2dca-4456-be4a-29579964b532 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] HTTP exception thrown: Instance eba6aa22-62ff-42e5-8401-f02b23ffeb85 could not be found. Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1d82ec6e-2dca-4456-be4a-29579964b532 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Request method failure captured: Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85 HTTP/1.1 Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_yRMj5TmiUiePuxSnga_Pnns-Bpj5aA4uGmfrVKNtT7pLSLMV6hR6GdWVQMcx558mTVagVc5ritEKmEaG9jlrpABFcQhDSxLCEoyLH_vWnRVJyVNaLifB4cbPIAOTPDtpOkRM4AqnGVUyNlNzo9X9IxkbuoayvWNyDPnSX0E0uErX8 Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 683ce999e25e42a4a57b3c24a1fd24ef Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerActionsTestJSON-1286399382 Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/683ce999e25e42a4a57b3c24a1fd24ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/683ce999e25e42a4a57b3c24a1fd24ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_683ce999e25e42a4a57b3c24a1fd24ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/683ce999e25e42a4a57b3c24a1fd24ef"}]}] Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerActionsTestJSON-1286399382 Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 683ce999e25e42a4a57b3c24a1fd24ef Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerActionsTestJSON-1286399382 Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerActionsTestJSON-1286399382-project Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 01e6f70936a14e67aecaf71fb615fffa Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerActionsTestJSON-1286399382-project Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance eba6aa22-62ff-42e5-8401-f02b23ffeb85 could not be found. Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'eba6aa22-62ff-42e5-8401-f02b23ffeb85'} Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eba6aa22-62ff-42e5-8401-f02b23ffeb85 could not be found. Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eba6aa22-62ff-42e5-8401-f02b23ffeb85 could not be found. Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:21.509884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:21.514386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:21.514386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:21.514386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:21.514386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:15:21.514386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:15:21.514386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eba6aa22-62ff-42e5-8401-f02b23ffeb85 could not be found. Aug 04 17:15:21.514386 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:21.514386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1d82ec6e-2dca-4456-be4a-29579964b532 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Returning 404 to user: Instance eba6aa22-62ff-42e5-8401-f02b23ffeb85 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:15:21.514386 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1d82ec6e-2dca-4456-be4a-29579964b532 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85" status: 404 len: 111 microversion: 2.1 time: 0.037537 Aug 04 17:15:21.515233 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2442/4820] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:21 2022] GET /compute/v2.1/servers/eba6aa22-62ff-42e5-8401-f02b23ffeb85 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:15:21.523672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-363104e9-7bd4-4195-8d2e-9a0e36bd4468 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:21.524550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-363104e9-7bd4-4195-8d2e-9a0e36bd4468 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 4fcbd3c0-2201-41bb-ab2a-31262aba36dd] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:21.527173 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7ec3d324-7a56-4a77-a7d4-b262e2643024 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7" status: 200 len: 1527 microversion: 2.1 time: 0.263513 Aug 04 17:15:21.538022 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2379/4821] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:21 2022] GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7 => generated 1527 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:15:21.538219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-363104e9-7bd4-4195-8d2e-9a0e36bd4468 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:21.538219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-363104e9-7bd4-4195-8d2e-9a0e36bd4468 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:21.538219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-363104e9-7bd4-4195-8d2e-9a0e36bd4468 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:21.538219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-363104e9-7bd4-4195-8d2e-9a0e36bd4468 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:21.538219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-363104e9-7bd4-4195-8d2e-9a0e36bd4468 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:21.538219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-363104e9-7bd4-4195-8d2e-9a0e36bd4468 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:21.552796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:21.561519 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-363104e9-7bd4-4195-8d2e-9a0e36bd4468 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 4fcbd3c0-2201-41bb-ab2a-31262aba36dd] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:15:21.660227 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-70c807f2-8e94-44af-ac95-509a5e8a488e tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:21.661047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-70c807f2-8e94-44af-ac95-509a5e8a488e tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:21.672312 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-363104e9-7bd4-4195-8d2e-9a0e36bd4468 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd" status: 204 len: 0 microversion: 2.1 time: 0.147789 Aug 04 17:15:21.672975 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2443/4822] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:15:21 2022] DELETE /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:15:21.691012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dc05ec95-61de-44ae-be4b-3fe7fdde20d5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:21.691727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70c807f2-8e94-44af-ac95-509a5e8a488e tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:21.691970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dc05ec95-61de-44ae-be4b-3fe7fdde20d5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 4fcbd3c0-2201-41bb-ab2a-31262aba36dd] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:21.692230 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70c807f2-8e94-44af-ac95-509a5e8a488e tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:21.692677 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70c807f2-8e94-44af-ac95-509a5e8a488e tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:21.693414 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70c807f2-8e94-44af-ac95-509a5e8a488e tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:21.693874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70c807f2-8e94-44af-ac95-509a5e8a488e tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:21.698583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70c807f2-8e94-44af-ac95-509a5e8a488e tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:21.698775 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:21.707554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc05ec95-61de-44ae-be4b-3fe7fdde20d5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:21.708264 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc05ec95-61de-44ae-be4b-3fe7fdde20d5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:21.709182 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc05ec95-61de-44ae-be4b-3fe7fdde20d5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:21.710822 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc05ec95-61de-44ae-be4b-3fe7fdde20d5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:21.711416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc05ec95-61de-44ae-be4b-3fe7fdde20d5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:21.711966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc05ec95-61de-44ae-be4b-3fe7fdde20d5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:21.793656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-70c807f2-8e94-44af-ac95-509a5e8a488e tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:21.810273 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-70c807f2-8e94-44af-ac95-509a5e8a488e tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:21.811945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-70c807f2-8e94-44af-ac95-509a5e8a488e tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:21.813166 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-70c807f2-8e94-44af-ac95-509a5e8a488e tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a" status: 200 len: 1407 microversion: 2.54 time: 0.160160 Aug 04 17:15:21.821720 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2380/4823] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:15:21 2022] GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:15:21.962510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dc05ec95-61de-44ae-be4b-3fe7fdde20d5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:21.977705 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dc05ec95-61de-44ae-be4b-3fe7fdde20d5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd" status: 200 len: 1507 microversion: 2.1 time: 0.300432 Aug 04 17:15:21.998341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-20ef7a92-b75f-4002-8527-8e264d83293c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:21.998971 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-20ef7a92-b75f-4002-8527-8e264d83293c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 947ffe69-3080-4602-872d-1bb16591d34e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:22.002728 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2444/4824] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:21 2022] GET /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd => generated 1507 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:22.005925 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20ef7a92-b75f-4002-8527-8e264d83293c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:22.006452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20ef7a92-b75f-4002-8527-8e264d83293c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:22.006891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20ef7a92-b75f-4002-8527-8e264d83293c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:22.007599 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20ef7a92-b75f-4002-8527-8e264d83293c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:22.008057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20ef7a92-b75f-4002-8527-8e264d83293c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:22.013487 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20ef7a92-b75f-4002-8527-8e264d83293c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:22.283153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-20ef7a92-b75f-4002-8527-8e264d83293c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:22.307856 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-20ef7a92-b75f-4002-8527-8e264d83293c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e" status: 200 len: 1682 microversion: 2.1 time: 0.316092 Aug 04 17:15:22.328651 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2381/4825] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:21 2022] GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e => generated 1682 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:22.423762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-29f3b4f4-dbc0-488f-bb19-81820cab5268 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:22.425218 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-29f3b4f4-dbc0-488f-bb19-81820cab5268 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 314e3218-a990-4be2-aef1-d69a055897e9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:22.435992 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29f3b4f4-dbc0-488f-bb19-81820cab5268 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:22.440180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29f3b4f4-dbc0-488f-bb19-81820cab5268 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:22.440792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29f3b4f4-dbc0-488f-bb19-81820cab5268 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:22.441817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29f3b4f4-dbc0-488f-bb19-81820cab5268 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:22.445406 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29f3b4f4-dbc0-488f-bb19-81820cab5268 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:22.446053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29f3b4f4-dbc0-488f-bb19-81820cab5268 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:22.551306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0d2d52b7-7c60-4c5c-ad38-9e298abfc0e7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:22.551998 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0d2d52b7-7c60-4c5c-ad38-9e298abfc0e7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 1a45e4c9-c9bd-4715-847d-6688654383c7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:22.558839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d2d52b7-7c60-4c5c-ad38-9e298abfc0e7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:22.559643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d2d52b7-7c60-4c5c-ad38-9e298abfc0e7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:22.560331 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d2d52b7-7c60-4c5c-ad38-9e298abfc0e7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:22.561850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d2d52b7-7c60-4c5c-ad38-9e298abfc0e7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:22.562481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d2d52b7-7c60-4c5c-ad38-9e298abfc0e7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:22.563065 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d2d52b7-7c60-4c5c-ad38-9e298abfc0e7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:22.780607 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-29f3b4f4-dbc0-488f-bb19-81820cab5268 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:22.796653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0d2d52b7-7c60-4c5c-ad38-9e298abfc0e7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:22.806685 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-29f3b4f4-dbc0-488f-bb19-81820cab5268 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9" status: 200 len: 1309 microversion: 2.1 time: 0.387162 Aug 04 17:15:22.809329 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0d2d52b7-7c60-4c5c-ad38-9e298abfc0e7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7" status: 200 len: 1527 microversion: 2.1 time: 0.262116 Aug 04 17:15:22.810540 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2445/4826] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:22 2022] GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9 => generated 1309 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:22.811379 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2382/4827] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:22 2022] GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7 => generated 1527 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:22.842822 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c2dd9fc3-79d3-4ad0-9236-7927ba6a34fd tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:22.843548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c2dd9fc3-79d3-4ad0-9236-7927ba6a34fd tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:22.850414 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2dd9fc3-79d3-4ad0-9236-7927ba6a34fd tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:22.850984 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2dd9fc3-79d3-4ad0-9236-7927ba6a34fd tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:22.851495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2dd9fc3-79d3-4ad0-9236-7927ba6a34fd tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:22.852277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2dd9fc3-79d3-4ad0-9236-7927ba6a34fd tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:22.853024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2dd9fc3-79d3-4ad0-9236-7927ba6a34fd tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:22.853790 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2dd9fc3-79d3-4ad0-9236-7927ba6a34fd tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:22.941183 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c2dd9fc3-79d3-4ad0-9236-7927ba6a34fd tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:22.955023 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c2dd9fc3-79d3-4ad0-9236-7927ba6a34fd tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:22.956795 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c2dd9fc3-79d3-4ad0-9236-7927ba6a34fd tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:22.959068 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c2dd9fc3-79d3-4ad0-9236-7927ba6a34fd tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a" status: 200 len: 1407 microversion: 2.54 time: 0.121921 Aug 04 17:15:22.965603 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2446/4828] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:15:22 2022] GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a => generated 1407 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:15:23.005487 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-95706562-822d-40a4-84c8-c2ee272c8e6e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:23.006212 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-95706562-822d-40a4-84c8-c2ee272c8e6e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 4fcbd3c0-2201-41bb-ab2a-31262aba36dd] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:23.013205 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95706562-822d-40a4-84c8-c2ee272c8e6e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:23.013932 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95706562-822d-40a4-84c8-c2ee272c8e6e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:23.014680 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95706562-822d-40a4-84c8-c2ee272c8e6e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:23.015560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95706562-822d-40a4-84c8-c2ee272c8e6e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:23.016172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95706562-822d-40a4-84c8-c2ee272c8e6e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:23.016749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95706562-822d-40a4-84c8-c2ee272c8e6e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:23.219234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-95706562-822d-40a4-84c8-c2ee272c8e6e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:23.227105 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-95706562-822d-40a4-84c8-c2ee272c8e6e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd" status: 200 len: 1507 microversion: 2.1 time: 0.226006 Aug 04 17:15:23.227897 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2383/4829] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:22 2022] GET /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd => generated 1507 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:23.250713 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-6e0d4241-03bc-4942-aae9-c2843aff0631 req-751fb662-238b-430b-9659-f13bde645042 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "947ffe69-3080-4602-872d-1bb16591d34e", "name": "network-vif-deleted", "tag": "fd65889d-9876-40e8-8ee4-deac7525c417"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:23.269119 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6e0d4241-03bc-4942-aae9-c2843aff0631 req-751fb662-238b-430b-9659-f13bde645042 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:23.269631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6e0d4241-03bc-4942-aae9-c2843aff0631 req-751fb662-238b-430b-9659-f13bde645042 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:23.270106 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6e0d4241-03bc-4942-aae9-c2843aff0631 req-751fb662-238b-430b-9659-f13bde645042 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:23.286379 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-6e0d4241-03bc-4942-aae9-c2843aff0631 req-751fb662-238b-430b-9659-f13bde645042 service nova] Creating event network-vif-deleted:fd65889d-9876-40e8-8ee4-deac7525c417 for instance 947ffe69-3080-4602-872d-1bb16591d34e on n-h1-851359-3 Aug 04 17:15:23.292249 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-6e0d4241-03bc-4942-aae9-c2843aff0631 req-751fb662-238b-430b-9659-f13bde645042 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045948 Aug 04 17:15:23.294070 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2447/4830] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:23.337737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-24a217d6-48d4-45e7-aaaa-c9c3b042e099 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:23.340147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-24a217d6-48d4-45e7-aaaa-c9c3b042e099 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 947ffe69-3080-4602-872d-1bb16591d34e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:23.349896 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24a217d6-48d4-45e7-aaaa-c9c3b042e099 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:23.350652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24a217d6-48d4-45e7-aaaa-c9c3b042e099 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:23.351293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24a217d6-48d4-45e7-aaaa-c9c3b042e099 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:23.352379 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24a217d6-48d4-45e7-aaaa-c9c3b042e099 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:23.354387 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24a217d6-48d4-45e7-aaaa-c9c3b042e099 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:23.355878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24a217d6-48d4-45e7-aaaa-c9c3b042e099 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:23.453629 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-24a217d6-48d4-45e7-aaaa-c9c3b042e099 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:23.463017 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-24a217d6-48d4-45e7-aaaa-c9c3b042e099 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e" status: 200 len: 1326 microversion: 2.1 time: 0.130660 Aug 04 17:15:23.465914 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2384/4831] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:23 2022] GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e => generated 1326 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:23.835812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-94abb95e-cfe2-4df2-86d4-64002509c3f2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:23.837245 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-94abb95e-cfe2-4df2-86d4-64002509c3f2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 314e3218-a990-4be2-aef1-d69a055897e9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:23.847413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94abb95e-cfe2-4df2-86d4-64002509c3f2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:23.853806 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aeb1b238-41d6-4c9d-a0d7-3a8fa62a3231 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:23.855621 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94abb95e-cfe2-4df2-86d4-64002509c3f2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:23.855749 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94abb95e-cfe2-4df2-86d4-64002509c3f2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:23.856767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94abb95e-cfe2-4df2-86d4-64002509c3f2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:23.856921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aeb1b238-41d6-4c9d-a0d7-3a8fa62a3231 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 1a45e4c9-c9bd-4715-847d-6688654383c7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:23.857532 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94abb95e-cfe2-4df2-86d4-64002509c3f2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:23.858257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94abb95e-cfe2-4df2-86d4-64002509c3f2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:23.876243 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aeb1b238-41d6-4c9d-a0d7-3a8fa62a3231 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:23.877626 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aeb1b238-41d6-4c9d-a0d7-3a8fa62a3231 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:23.879724 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aeb1b238-41d6-4c9d-a0d7-3a8fa62a3231 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:23.880720 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aeb1b238-41d6-4c9d-a0d7-3a8fa62a3231 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:23.894606 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aeb1b238-41d6-4c9d-a0d7-3a8fa62a3231 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:23.897512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aeb1b238-41d6-4c9d-a0d7-3a8fa62a3231 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:24.556050 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-aeb1b238-41d6-4c9d-a0d7-3a8fa62a3231 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6791b833351c493a8e581154c2dfb8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c97e15d470473189d8a6c2068e9eac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:24.596045 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aeb1b238-41d6-4c9d-a0d7-3a8fa62a3231 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7" status: 200 len: 1485 microversion: 2.1 time: 0.751447 Aug 04 17:15:24.614121 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2385/4832] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:23 2022] GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7 => generated 1485 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:24.627674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ddb7f7ee-cfa8-43e2-86d2-2f0eaae7f60b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:24.628518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ddb7f7ee-cfa8-43e2-86d2-2f0eaae7f60b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:24.639673 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ddb7f7ee-cfa8-43e2-86d2-2f0eaae7f60b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:24.640528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ddb7f7ee-cfa8-43e2-86d2-2f0eaae7f60b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:24.641112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ddb7f7ee-cfa8-43e2-86d2-2f0eaae7f60b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:24.641915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ddb7f7ee-cfa8-43e2-86d2-2f0eaae7f60b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:24.642481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ddb7f7ee-cfa8-43e2-86d2-2f0eaae7f60b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:24.643973 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ddb7f7ee-cfa8-43e2-86d2-2f0eaae7f60b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:24.727815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-94abb95e-cfe2-4df2-86d4-64002509c3f2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:24.739729 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-94abb95e-cfe2-4df2-86d4-64002509c3f2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9" status: 200 len: 1490 microversion: 2.1 time: 0.907992 Aug 04 17:15:24.744172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ddb7f7ee-cfa8-43e2-86d2-2f0eaae7f60b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:24.750932 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2448/4833] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:23 2022] GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9 => generated 1490 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:24.758332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-97263d78-ed21-48bc-a275-c5aef6c63733 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:24.765684 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ddb7f7ee-cfa8-43e2-86d2-2f0eaae7f60b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:24.766993 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-97263d78-ed21-48bc-a275-c5aef6c63733 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 4fcbd3c0-2201-41bb-ab2a-31262aba36dd] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:24.776319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ddb7f7ee-cfa8-43e2-86d2-2f0eaae7f60b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:24.778021 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ddb7f7ee-cfa8-43e2-86d2-2f0eaae7f60b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a" status: 200 len: 1407 microversion: 2.54 time: 0.162393 Aug 04 17:15:24.781779 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-97263d78-ed21-48bc-a275-c5aef6c63733 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:24.782571 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2386/4834] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:15:24 2022] GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:15:24.789950 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-25ff1c7a-bab4-4fd5-b752-c946bc1e8d9e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:24.792021 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-97263d78-ed21-48bc-a275-c5aef6c63733 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:24.795651 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-97263d78-ed21-48bc-a275-c5aef6c63733 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:24.796760 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-97263d78-ed21-48bc-a275-c5aef6c63733 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:24.797352 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-97263d78-ed21-48bc-a275-c5aef6c63733 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:24.797840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-97263d78-ed21-48bc-a275-c5aef6c63733 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:24.802605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-25ff1c7a-bab4-4fd5-b752-c946bc1e8d9e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 947ffe69-3080-4602-872d-1bb16591d34e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:24.811134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25ff1c7a-bab4-4fd5-b752-c946bc1e8d9e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:24.822787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25ff1c7a-bab4-4fd5-b752-c946bc1e8d9e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:24.823479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25ff1c7a-bab4-4fd5-b752-c946bc1e8d9e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:24.825042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25ff1c7a-bab4-4fd5-b752-c946bc1e8d9e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:24.825673 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25ff1c7a-bab4-4fd5-b752-c946bc1e8d9e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:24.826293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25ff1c7a-bab4-4fd5-b752-c946bc1e8d9e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:24.844252 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-25ff1c7a-bab4-4fd5-b752-c946bc1e8d9e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] HTTP exception thrown: Instance 947ffe69-3080-4602-872d-1bb16591d34e could not be found. Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-25ff1c7a-bab4-4fd5-b752-c946bc1e8d9e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Request method failure captured: Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e HTTP/1.1 Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_20IgjlzOhiiXNFc-NV1FHodxKmWXqSdjZ2I3CqIylUHNkhkG-JAGdMPdYL-8rZzM7v2_0KXVTorBGskuo6vUXRtOSVoO1KTIHw44-u5yCDnlwK7XKRi3uI2OBhda5ANtzdvy-06i9FyD27hM6LxpcHB7QNnHGthqSv2gOLnkKiVjg Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 80bc576163414daba5f5315c4a785533 Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/80bc576163414daba5f5315c4a785533"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/80bc576163414daba5f5315c4a785533"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_80bc576163414daba5f5315c4a785533"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/80bc576163414daba5f5315c4a785533"}]}] Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 80bc576163414daba5f5315c4a785533 Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-AttachVolumeNegativeTest-1565246319-project Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 5b10b58bf3df46d18bff092022b08e0f Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-AttachVolumeNegativeTest-1565246319-project Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 947ffe69-3080-4602-872d-1bb16591d34e could not be found. Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '947ffe69-3080-4602-872d-1bb16591d34e'} Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 947ffe69-3080-4602-872d-1bb16591d34e could not be found. Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 947ffe69-3080-4602-872d-1bb16591d34e could not be found. Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:24.850866 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:24.856769 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:24.856769 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:24.856769 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:24.856769 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:15:24.856769 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:15:24.856769 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 947ffe69-3080-4602-872d-1bb16591d34e could not be found. Aug 04 17:15:24.856769 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:24.858305 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-25ff1c7a-bab4-4fd5-b752-c946bc1e8d9e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Returning 404 to user: Instance 947ffe69-3080-4602-872d-1bb16591d34e could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:15:24.859391 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-25ff1c7a-bab4-4fd5-b752-c946bc1e8d9e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e" status: 404 len: 111 microversion: 2.1 time: 0.074197 Aug 04 17:15:24.865309 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2387/4835] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:24 2022] GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:15:24.871516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-049da20d-c6f8-4a34-a6fe-d0c5a0e9ed5a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:24.875442 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-049da20d-c6f8-4a34-a6fe-d0c5a0e9ed5a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 314e3218-a990-4be2-aef1-d69a055897e9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:24.882300 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-049da20d-c6f8-4a34-a6fe-d0c5a0e9ed5a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:24.883255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-049da20d-c6f8-4a34-a6fe-d0c5a0e9ed5a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:24.884087 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-049da20d-c6f8-4a34-a6fe-d0c5a0e9ed5a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:24.885031 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-049da20d-c6f8-4a34-a6fe-d0c5a0e9ed5a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:24.885662 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-049da20d-c6f8-4a34-a6fe-d0c5a0e9ed5a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:24.886878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-049da20d-c6f8-4a34-a6fe-d0c5a0e9ed5a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:24.963504 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-97263d78-ed21-48bc-a275-c5aef6c63733 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:24.968058 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-049da20d-c6f8-4a34-a6fe-d0c5a0e9ed5a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "PUT /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9" status: 200 len: 1085 microversion: 2.1 time: 0.101168 Aug 04 17:15:24.969031 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2388/4836] 10.222.0.93 () {60 vars in 1256 bytes} [Thu Aug 4 17:15:24 2022] PUT /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9 => generated 1085 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:24.982665 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6956db28-6025-4374-b83d-fd52d1518345 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '.version_select at 0x7f1e5bfa8c10>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:24.982964 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-97263d78-ed21-48bc-a275-c5aef6c63733 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd" status: 200 len: 1300 microversion: 2.1 time: 0.228517 Aug 04 17:15:24.982964 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2449/4837] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:24 2022] GET /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd => generated 1300 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:24.999859 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3323bece-d277-45a1-a082-648c5f9bd692 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:25.000277 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6956db28-6025-4374-b83d-fd52d1518345 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1111498967" status: 202 len: 0 microversion: 2.1 time: 0.029938 Aug 04 17:15:25.000644 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3323bece-d277-45a1-a082-648c5f9bd692 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 314e3218-a990-4be2-aef1-d69a055897e9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:25.001187 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2389/4838] 10.222.0.93 () {58 vars in 1221 bytes} [Thu Aug 4 17:15:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1111498967 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:15:25.007365 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3323bece-d277-45a1-a082-648c5f9bd692 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:25.007941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3323bece-d277-45a1-a082-648c5f9bd692 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:25.008457 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3323bece-d277-45a1-a082-648c5f9bd692 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:25.009264 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3323bece-d277-45a1-a082-648c5f9bd692 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:25.009810 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3323bece-d277-45a1-a082-648c5f9bd692 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:25.010336 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3323bece-d277-45a1-a082-648c5f9bd692 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:25.299329 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3323bece-d277-45a1-a082-648c5f9bd692 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:25.325732 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3323bece-d277-45a1-a082-648c5f9bd692 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9" status: 200 len: 1511 microversion: 2.1 time: 0.342448 Aug 04 17:15:25.336066 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2450/4839] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:24 2022] GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9 => generated 1511 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:15:25.338648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-18372497-b638-45b0-b50e-2c6740b39998 req-4f7ffb65-3b07-493e-9a82-3fc7e59c5f30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a45e4c9-c9bd-4715-847d-6688654383c7", "name": "network-vif-deleted", "tag": "42f0cb89-bdf2-4789-8374-f82df66286fc"}, {"server_uuid": "4fcbd3c0-2201-41bb-ab2a-31262aba36dd", "name": "network-vif-deleted", "tag": "aba4b667-0fd9-49e8-8c50-799f4932f9f7"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:25.352149 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a57a8d47-0ccd-4eb0-aa0f-226d4e529cd9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:25.353078 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a57a8d47-0ccd-4eb0-aa0f-226d4e529cd9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 314e3218-a990-4be2-aef1-d69a055897e9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:25.361711 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-18372497-b638-45b0-b50e-2c6740b39998 req-4f7ffb65-3b07-493e-9a82-3fc7e59c5f30 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:25.362363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-18372497-b638-45b0-b50e-2c6740b39998 req-4f7ffb65-3b07-493e-9a82-3fc7e59c5f30 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:25.363042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-18372497-b638-45b0-b50e-2c6740b39998 req-4f7ffb65-3b07-493e-9a82-3fc7e59c5f30 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:25.372214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a57a8d47-0ccd-4eb0-aa0f-226d4e529cd9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:25.372735 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a57a8d47-0ccd-4eb0-aa0f-226d4e529cd9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:25.373242 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a57a8d47-0ccd-4eb0-aa0f-226d4e529cd9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:25.374157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a57a8d47-0ccd-4eb0-aa0f-226d4e529cd9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:25.374858 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a57a8d47-0ccd-4eb0-aa0f-226d4e529cd9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:25.375339 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a57a8d47-0ccd-4eb0-aa0f-226d4e529cd9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:25.383638 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-18372497-b638-45b0-b50e-2c6740b39998 req-4f7ffb65-3b07-493e-9a82-3fc7e59c5f30 service nova] Creating event network-vif-deleted:42f0cb89-bdf2-4789-8374-f82df66286fc for instance 1a45e4c9-c9bd-4715-847d-6688654383c7 on n-h2-851359-3 Aug 04 17:15:25.384291 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-18372497-b638-45b0-b50e-2c6740b39998 req-4f7ffb65-3b07-493e-9a82-3fc7e59c5f30 service nova] Creating event network-vif-deleted:aba4b667-0fd9-49e8-8c50-799f4932f9f7 for instance 4fcbd3c0-2201-41bb-ab2a-31262aba36dd on n-h1-851359-3 Aug 04 17:15:25.395436 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-18372497-b638-45b0-b50e-2c6740b39998 req-4f7ffb65-3b07-493e-9a82-3fc7e59c5f30 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.060583 Aug 04 17:15:25.396859 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2390/4840] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:15:25.608117 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a57a8d47-0ccd-4eb0-aa0f-226d4e529cd9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:25.618957 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a57a8d47-0ccd-4eb0-aa0f-226d4e529cd9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9" status: 200 len: 1511 microversion: 2.1 time: 0.274217 Aug 04 17:15:25.621117 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2451/4841] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:25 2022] GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9 => generated 1511 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:15:25.628176 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f94505a9-8d59-4eea-9f9d-91767db397ad tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:25.630111 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f94505a9-8d59-4eea-9f9d-91767db397ad tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 1a45e4c9-c9bd-4715-847d-6688654383c7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:25.645803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-900c545a-8002-412a-aa35-c06b26bae05c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:25.647980 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f94505a9-8d59-4eea-9f9d-91767db397ad tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:25.648624 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f94505a9-8d59-4eea-9f9d-91767db397ad tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:25.649243 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-900c545a-8002-412a-aa35-c06b26bae05c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 314e3218-a990-4be2-aef1-d69a055897e9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:25.649804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f94505a9-8d59-4eea-9f9d-91767db397ad tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:25.652425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f94505a9-8d59-4eea-9f9d-91767db397ad tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:25.653057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f94505a9-8d59-4eea-9f9d-91767db397ad tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:25.654583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f94505a9-8d59-4eea-9f9d-91767db397ad tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:25.658627 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-900c545a-8002-412a-aa35-c06b26bae05c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:25.659398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-900c545a-8002-412a-aa35-c06b26bae05c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:25.660312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-900c545a-8002-412a-aa35-c06b26bae05c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:25.661263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-900c545a-8002-412a-aa35-c06b26bae05c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:25.661952 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-900c545a-8002-412a-aa35-c06b26bae05c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:25.662814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-900c545a-8002-412a-aa35-c06b26bae05c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:25.691789 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-900c545a-8002-412a-aa35-c06b26bae05c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 314e3218-a990-4be2-aef1-d69a055897e9] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:15:25.729153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:25.737253 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-f94505a9-8d59-4eea-9f9d-91767db397ad tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] HTTP exception thrown: Instance 1a45e4c9-c9bd-4715-847d-6688654383c7 could not be found. Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f94505a9-8d59-4eea-9f9d-91767db397ad tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Request method failure captured: Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7 HTTP/1.1 Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_4xbB8fnr17iZxpZmQfQZiM2JCxKiVWWUXjZiHpHTuUHHVw7ao4oT_uZW8wxu89NvTWOIVQIIqQPmHAao-lpxs7gxXuSYKOkaP9AGGwPUmZ0l1sD6ZLIZdH6-nP_cliwrHT6QFXnVMcXHLYBwQRQIzx4m2gYEscPKDx2pEzeM4vYGU Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 85c97e15d470473189d8a6c2068e9eac Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/85c97e15d470473189d8a6c2068e9eac"}]}] Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 85c97e15d470473189d8a6c2068e9eac Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ImagesOneServerNegativeTestJSON-1209884465-project Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 6791b833351c493a8e581154c2dfb8d7 Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465-project Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 1a45e4c9-c9bd-4715-847d-6688654383c7 could not be found. Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '1a45e4c9-c9bd-4715-847d-6688654383c7'} Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a45e4c9-c9bd-4715-847d-6688654383c7 could not be found. Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a45e4c9-c9bd-4715-847d-6688654383c7 could not be found. Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:25.740092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:25.744661 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:25.744661 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:25.744661 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:25.744661 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:25.744661 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:15:25.744661 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:15:25.744661 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a45e4c9-c9bd-4715-847d-6688654383c7 could not be found. Aug 04 17:15:25.744661 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:25.744661 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f94505a9-8d59-4eea-9f9d-91767db397ad tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Returning 404 to user: Instance 1a45e4c9-c9bd-4715-847d-6688654383c7 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:15:25.744661 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f94505a9-8d59-4eea-9f9d-91767db397ad tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7" status: 404 len: 111 microversion: 2.1 time: 0.129814 Aug 04 17:15:25.746997 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2391/4842] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:25 2022] GET /compute/v2.1/servers/1a45e4c9-c9bd-4715-847d-6688654383c7 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:15:25.752725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dd737d1a-4603-4da9-af07-9938bb8387b4 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Action: 'create', calling method: .version_select at 0x7f1e5ac1a1f0>, body: {"keypair": {"name": "tempest-keypair-916789404", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgOMshF3DXp6GGWnWs555lxmugrrDDZTiMXFInuERNC2ClJZGDfclJLWA/0mqydvmLgoYBmPy5jfY/wVClDbGnsNUXf04ByqtmxZK8jN7G1kgRmalcOhTYslhb3VkMjIQ=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:25.776346 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-dd737d1a-4603-4da9-af07-9938bb8387b4 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Getting quotas for project 80bc576163414daba5f5315c4a785533. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:15:25.782149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-dd737d1a-4603-4da9-af07-9938bb8387b4 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Getting quotas for user 5b10b58bf3df46d18bff092022b08e0f and project 80bc576163414daba5f5315c4a785533. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:15:25.810092 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-900c545a-8002-412a-aa35-c06b26bae05c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "DELETE /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9" status: 204 len: 0 microversion: 2.1 time: 0.166427 Aug 04 17:15:25.814617 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2452/4843] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:15:25 2022] DELETE /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 17:15:25.820438 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2c13bb62-e09a-4044-8762-905f18ba9701 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '.version_select at 0x7f1e5ab0c160>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:25.822542 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dd737d1a-4603-4da9-af07-9938bb8387b4 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.075059 Aug 04 17:15:25.823592 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2392/4844] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:15:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:25.834147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-07134d42-3d83-4032-a773-23f937cc4b29 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:25.835280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-07134d42-3d83-4032-a773-23f937cc4b29 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:25.844535 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07134d42-3d83-4032-a773-23f937cc4b29 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:25.845866 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07134d42-3d83-4032-a773-23f937cc4b29 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:25.845866 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07134d42-3d83-4032-a773-23f937cc4b29 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:25.847038 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07134d42-3d83-4032-a773-23f937cc4b29 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:25.847471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07134d42-3d83-4032-a773-23f937cc4b29 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:25.848011 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07134d42-3d83-4032-a773-23f937cc4b29 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:25.850784 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-2c13bb62-e09a-4044-8762-905f18ba9701 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] HTTP exception thrown: Image not found. Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2c13bb62-e09a-4044-8762-905f18ba9701 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Request method failure captured: Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/images/5e234254-1703-4df6-9cf1-aac955e74dd3 HTTP/1.1 Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_4xbB8fnr17iZxpZmQfQZiM2JCxKiVWWUXjZiHpHTuUHHVw7ao4oT_uZW8wxu89NvTWOIVQIIqQPmHAao-lpxs7gxXuSYKOkaP9AGGwPUmZ0l1sD6ZLIZdH6-nP_cliwrHT6QFXnVMcXHLYBwQRQIzx4m2gYEscPKDx2pEzeM4vYGU Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 85c97e15d470473189d8a6c2068e9eac Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/85c97e15d470473189d8a6c2068e9eac"}]}] Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 85c97e15d470473189d8a6c2068e9eac Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ImagesOneServerNegativeTestJSON-1209884465-project Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 6791b833351c493a8e581154c2dfb8d7 Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465-project Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: exception: Image not found. Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '5e234254-1703-4df6-9cf1-aac955e74dd3'} Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5e234254-1703-4df6-9cf1-aac955e74dd3 to delete Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5e234254-1703-4df6-9cf1-aac955e74dd3 could not be found. Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:25.852745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:25.857584 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:25.857584 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:25.857584 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:25.857584 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:15:25.857584 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:15:25.857584 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:15:25.857584 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:15:25.857584 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:15:25.857584 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:15:25.857584 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 17:15:25.857584 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 17:15:25.857584 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 17:15:25.857584 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:25.857584 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:25.857584 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:25.857584 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:25.857584 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:25.857584 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:25.857584 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:15:25.857584 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:15:25.857584 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 17:15:25.857584 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:25.857584 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2c13bb62-e09a-4044-8762-905f18ba9701 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Returning 404 to user: Image not found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:15:25.857584 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2c13bb62-e09a-4044-8762-905f18ba9701 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "DELETE /compute/v2.1/images/5e234254-1703-4df6-9cf1-aac955e74dd3" status: 404 len: 62 microversion: 2.1 time: 0.038330 Aug 04 17:15:25.857584 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2453/4845] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:25 2022] DELETE /compute/v2.1/images/5e234254-1703-4df6-9cf1-aac955e74dd3 => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:15:25.866303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1f0fbfbd-21a4-4145-a7ea-42d2fd2d66a1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:25.868136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1f0fbfbd-21a4-4145-a7ea-42d2fd2d66a1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 314e3218-a990-4be2-aef1-d69a055897e9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:25.886903 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f0fbfbd-21a4-4145-a7ea-42d2fd2d66a1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:25.887410 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f0fbfbd-21a4-4145-a7ea-42d2fd2d66a1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:25.887923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f0fbfbd-21a4-4145-a7ea-42d2fd2d66a1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:25.888568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f0fbfbd-21a4-4145-a7ea-42d2fd2d66a1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:25.889027 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f0fbfbd-21a4-4145-a7ea-42d2fd2d66a1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:25.891527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f0fbfbd-21a4-4145-a7ea-42d2fd2d66a1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:25.971803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-07134d42-3d83-4032-a773-23f937cc4b29 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:25.982989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-07134d42-3d83-4032-a773-23f937cc4b29 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:25.986022 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-07134d42-3d83-4032-a773-23f937cc4b29 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:25.987477 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-07134d42-3d83-4032-a773-23f937cc4b29 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a" status: 200 len: 1407 microversion: 2.54 time: 0.162711 Aug 04 17:15:25.988479 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2393/4846] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:15:25 2022] GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:15:25.993656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dcf24d92-cdc9-4446-b1c7-78a948bf3127 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:25.994321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dcf24d92-cdc9-4446-b1c7-78a948bf3127 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 134ac071-c06f-4195-9405-37e71e6d08a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:26.003466 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcf24d92-cdc9-4446-b1c7-78a948bf3127 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:26.004459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcf24d92-cdc9-4446-b1c7-78a948bf3127 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:26.005133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcf24d92-cdc9-4446-b1c7-78a948bf3127 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:26.007653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcf24d92-cdc9-4446-b1c7-78a948bf3127 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:26.008399 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcf24d92-cdc9-4446-b1c7-78a948bf3127 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:26.010504 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcf24d92-cdc9-4446-b1c7-78a948bf3127 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:26.032488 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-dcf24d92-cdc9-4446-b1c7-78a948bf3127 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] HTTP exception thrown: Instance 134ac071-c06f-4195-9405-37e71e6d08a9 could not be found. Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dcf24d92-cdc9-4446-b1c7-78a948bf3127 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Request method failure captured: Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9 HTTP/1.1 Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_4xbB8fnr17iZxpZmQfQZiM2JCxKiVWWUXjZiHpHTuUHHVw7ao4oT_uZW8wxu89NvTWOIVQIIqQPmHAao-lpxs7gxXuSYKOkaP9AGGwPUmZ0l1sD6ZLIZdH6-nP_cliwrHT6QFXnVMcXHLYBwQRQIzx4m2gYEscPKDx2pEzeM4vYGU Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 85c97e15d470473189d8a6c2068e9eac Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/85c97e15d470473189d8a6c2068e9eac"}]}] Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 85c97e15d470473189d8a6c2068e9eac Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ImagesOneServerNegativeTestJSON-1209884465-project Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 6791b833351c493a8e581154c2dfb8d7 Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465-project Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 134ac071-c06f-4195-9405-37e71e6d08a9 could not be found. Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '134ac071-c06f-4195-9405-37e71e6d08a9'} Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 134ac071-c06f-4195-9405-37e71e6d08a9 could not be found. Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:15:26.035290 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:15:26.040390 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 134ac071-c06f-4195-9405-37e71e6d08a9 could not be found. Aug 04 17:15:26.040390 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:26.040390 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:26.040390 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:26.040390 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:26.040390 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:26.040390 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:26.040390 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:15:26.040390 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:15:26.040390 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 134ac071-c06f-4195-9405-37e71e6d08a9 could not be found. Aug 04 17:15:26.040390 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:26.040390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dcf24d92-cdc9-4446-b1c7-78a948bf3127 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Returning 404 to user: Instance 134ac071-c06f-4195-9405-37e71e6d08a9 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:15:26.040390 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dcf24d92-cdc9-4446-b1c7-78a948bf3127 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "DELETE /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9" status: 404 len: 111 microversion: 2.1 time: 0.050381 Aug 04 17:15:26.041540 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2394/4847] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:15:25 2022] DELETE /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:15:26.049233 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-75ab5062-06a2-41ea-a356-d8f4e593478c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:26.049816 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-75ab5062-06a2-41ea-a356-d8f4e593478c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 4fcbd3c0-2201-41bb-ab2a-31262aba36dd] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:26.053668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:26.058044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75ab5062-06a2-41ea-a356-d8f4e593478c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:26.060070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75ab5062-06a2-41ea-a356-d8f4e593478c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:26.060513 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75ab5062-06a2-41ea-a356-d8f4e593478c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:26.061411 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75ab5062-06a2-41ea-a356-d8f4e593478c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:26.062275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75ab5062-06a2-41ea-a356-d8f4e593478c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:26.062715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75ab5062-06a2-41ea-a356-d8f4e593478c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:26.082071 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-75ab5062-06a2-41ea-a356-d8f4e593478c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] HTTP exception thrown: Instance 4fcbd3c0-2201-41bb-ab2a-31262aba36dd could not be found. Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-75ab5062-06a2-41ea-a356-d8f4e593478c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Request method failure captured: Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd HTTP/1.1 Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_yRMj5TmiUiePuxSnga_Pnns-Bpj5aA4uGmfrVKNtT7pLSLMV6hR6GdWVQMcx558mTVagVc5ritEKmEaG9jlrpABFcQhDSxLCEoyLH_vWnRVJyVNaLifB4cbPIAOTPDtpOkRM4AqnGVUyNlNzo9X9IxkbuoayvWNyDPnSX0E0uErX8 Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 683ce999e25e42a4a57b3c24a1fd24ef Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerActionsTestJSON-1286399382 Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/683ce999e25e42a4a57b3c24a1fd24ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/683ce999e25e42a4a57b3c24a1fd24ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_683ce999e25e42a4a57b3c24a1fd24ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/683ce999e25e42a4a57b3c24a1fd24ef"}]}] Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServerActionsTestJSON-1286399382 Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 683ce999e25e42a4a57b3c24a1fd24ef Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerActionsTestJSON-1286399382 Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServerActionsTestJSON-1286399382-project Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 01e6f70936a14e67aecaf71fb615fffa Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServerActionsTestJSON-1286399382-project Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 4fcbd3c0-2201-41bb-ab2a-31262aba36dd could not be found. Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '4fcbd3c0-2201-41bb-ab2a-31262aba36dd'} Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fcbd3c0-2201-41bb-ab2a-31262aba36dd could not be found. Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fcbd3c0-2201-41bb-ab2a-31262aba36dd could not be found. Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:26.084355 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:26.089261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:26.089261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:26.089261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:26.089261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:15:26.089261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:15:26.089261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fcbd3c0-2201-41bb-ab2a-31262aba36dd could not be found. Aug 04 17:15:26.089261 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:26.090758 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-75ab5062-06a2-41ea-a356-d8f4e593478c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Returning 404 to user: Instance 4fcbd3c0-2201-41bb-ab2a-31262aba36dd could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:15:26.091983 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-75ab5062-06a2-41ea-a356-d8f4e593478c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd" status: 404 len: 111 microversion: 2.1 time: 0.046770 Aug 04 17:15:26.092712 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2395/4848] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:26 2022] GET /compute/v2.1/servers/4fcbd3c0-2201-41bb-ab2a-31262aba36dd => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:15:26.097931 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-654dac44-e574-4fed-a1c3-c4a6fb733f81 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:26.099102 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-654dac44-e574-4fed-a1c3-c4a6fb733f81 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: 134ac071-c06f-4195-9405-37e71e6d08a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:26.107813 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-654dac44-e574-4fed-a1c3-c4a6fb733f81 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:26.108863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-654dac44-e574-4fed-a1c3-c4a6fb733f81 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:26.109528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-654dac44-e574-4fed-a1c3-c4a6fb733f81 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:26.110671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-654dac44-e574-4fed-a1c3-c4a6fb733f81 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:26.111298 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-654dac44-e574-4fed-a1c3-c4a6fb733f81 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:26.111897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-654dac44-e574-4fed-a1c3-c4a6fb733f81 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:26.128258 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-654dac44-e574-4fed-a1c3-c4a6fb733f81 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] HTTP exception thrown: Instance 134ac071-c06f-4195-9405-37e71e6d08a9 could not be found. Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-654dac44-e574-4fed-a1c3-c4a6fb733f81 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Request method failure captured: Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9 HTTP/1.1 Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_4xbB8fnr17iZxpZmQfQZiM2JCxKiVWWUXjZiHpHTuUHHVw7ao4oT_uZW8wxu89NvTWOIVQIIqQPmHAao-lpxs7gxXuSYKOkaP9AGGwPUmZ0l1sD6ZLIZdH6-nP_cliwrHT6QFXnVMcXHLYBwQRQIzx4m2gYEscPKDx2pEzeM4vYGU Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 85c97e15d470473189d8a6c2068e9eac Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/85c97e15d470473189d8a6c2068e9eac"}]}] Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 85c97e15d470473189d8a6c2068e9eac Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ImagesOneServerNegativeTestJSON-1209884465-project Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 6791b833351c493a8e581154c2dfb8d7 Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465-project Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 134ac071-c06f-4195-9405-37e71e6d08a9 could not be found. Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '134ac071-c06f-4195-9405-37e71e6d08a9'} Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 134ac071-c06f-4195-9405-37e71e6d08a9 could not be found. Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 134ac071-c06f-4195-9405-37e71e6d08a9 could not be found. Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:26.129814 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:26.134015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:26.134015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:26.134015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:26.134015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:26.134015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:15:26.134015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:15:26.134015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 134ac071-c06f-4195-9405-37e71e6d08a9 could not be found. Aug 04 17:15:26.134015 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:26.135569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-654dac44-e574-4fed-a1c3-c4a6fb733f81 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Returning 404 to user: Instance 134ac071-c06f-4195-9405-37e71e6d08a9 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:15:26.136625 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-654dac44-e574-4fed-a1c3-c4a6fb733f81 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9" status: 404 len: 111 microversion: 2.1 time: 0.042670 Aug 04 17:15:26.140964 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2396/4849] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:26 2022] GET /compute/v2.1/servers/134ac071-c06f-4195-9405-37e71e6d08a9 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:15:26.146695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-93c6a66c-205a-4acc-9603-a28582200e9e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:26.147403 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-93c6a66c-205a-4acc-9603-a28582200e9e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:26.156484 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93c6a66c-205a-4acc-9603-a28582200e9e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:26.156984 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93c6a66c-205a-4acc-9603-a28582200e9e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:26.157428 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93c6a66c-205a-4acc-9603-a28582200e9e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:26.158287 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93c6a66c-205a-4acc-9603-a28582200e9e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:26.158692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93c6a66c-205a-4acc-9603-a28582200e9e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:26.159146 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93c6a66c-205a-4acc-9603-a28582200e9e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:26.186888 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-93c6a66c-205a-4acc-9603-a28582200e9e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:15:26.210158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1f0fbfbd-21a4-4145-a7ea-42d2fd2d66a1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:26.220331 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1f0fbfbd-21a4-4145-a7ea-42d2fd2d66a1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9" status: 200 len: 1517 microversion: 2.1 time: 0.362478 Aug 04 17:15:26.233999 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2454/4850] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:25 2022] GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9 => generated 1517 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:26.233999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b0e508c2-8080-44e8-86bc-390f546ff2bf tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '.version_select at 0x7f1e5ab0c430>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:26.250084 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b0e508c2-8080-44e8-86bc-390f546ff2bf tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1765922725" status: 202 len: 0 microversion: 2.1 time: 0.027386 Aug 04 17:15:26.251508 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2455/4851] 10.222.0.93 () {58 vars in 1221 bytes} [Thu Aug 4 17:15:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1765922725 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:15:26.295055 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-93c6a66c-205a-4acc-9603-a28582200e9e tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "DELETE /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 204 len: 0 microversion: 2.1 time: 0.152486 Aug 04 17:15:26.298758 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2397/4852] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:15:26 2022] DELETE /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:15:26.305941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1e0d6d63-e6af-45f2-90aa-936ecc2e9aba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:26.306891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1e0d6d63-e6af-45f2-90aa-936ecc2e9aba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:26.315174 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e0d6d63-e6af-45f2-90aa-936ecc2e9aba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:26.316125 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e0d6d63-e6af-45f2-90aa-936ecc2e9aba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:26.316774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e0d6d63-e6af-45f2-90aa-936ecc2e9aba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:26.317517 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e0d6d63-e6af-45f2-90aa-936ecc2e9aba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:26.318007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e0d6d63-e6af-45f2-90aa-936ecc2e9aba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:26.318653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e0d6d63-e6af-45f2-90aa-936ecc2e9aba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:26.665364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1e0d6d63-e6af-45f2-90aa-936ecc2e9aba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:26.674252 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1e0d6d63-e6af-45f2-90aa-936ecc2e9aba tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1493 microversion: 2.1 time: 0.373739 Aug 04 17:15:26.675093 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2456/4853] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:26 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1493 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:27.016920 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-562d912c-c74f-446f-b011-3243241f0a5a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:27.018850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-562d912c-c74f-446f-b011-3243241f0a5a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:27.025604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-562d912c-c74f-446f-b011-3243241f0a5a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:27.026152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-562d912c-c74f-446f-b011-3243241f0a5a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:27.026599 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-562d912c-c74f-446f-b011-3243241f0a5a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:27.027365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-562d912c-c74f-446f-b011-3243241f0a5a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:27.027829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-562d912c-c74f-446f-b011-3243241f0a5a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:27.028261 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-562d912c-c74f-446f-b011-3243241f0a5a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:27.064566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:27.245057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f3e603a5-93da-4d2e-bd61-da44ecd64a0f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:27.247527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f3e603a5-93da-4d2e-bd61-da44ecd64a0f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 314e3218-a990-4be2-aef1-d69a055897e9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:27.254042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-562d912c-c74f-446f-b011-3243241f0a5a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:27.254862 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f3e603a5-93da-4d2e-bd61-da44ecd64a0f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:27.255367 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f3e603a5-93da-4d2e-bd61-da44ecd64a0f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:27.255822 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f3e603a5-93da-4d2e-bd61-da44ecd64a0f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:27.256678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f3e603a5-93da-4d2e-bd61-da44ecd64a0f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:27.257280 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f3e603a5-93da-4d2e-bd61-da44ecd64a0f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:27.258267 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f3e603a5-93da-4d2e-bd61-da44ecd64a0f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:27.278697 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-562d912c-c74f-446f-b011-3243241f0a5a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:27.281473 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-562d912c-c74f-446f-b011-3243241f0a5a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:27.284271 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-562d912c-c74f-446f-b011-3243241f0a5a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a" status: 200 len: 1407 microversion: 2.54 time: 0.271724 Aug 04 17:15:27.298010 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2398/4854] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:15:27 2022] GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a => generated 1407 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:15:27.520720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f3e603a5-93da-4d2e-bd61-da44ecd64a0f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:27.533257 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f3e603a5-93da-4d2e-bd61-da44ecd64a0f tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9" status: 200 len: 1517 microversion: 2.1 time: 0.292492 Aug 04 17:15:27.537791 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2457/4855] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:27 2022] GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9 => generated 1517 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:27.602806 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fd3712b9-0736-4848-8632-bf4c761044a7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '.version_select at 0x7f1e5b366d30>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:27.630350 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-fd3712b9-0736-4848-8632-bf4c761044a7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] HTTP exception thrown: Image not found. Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fd3712b9-0736-4848-8632-bf4c761044a7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Request method failure captured: Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/images/02386db1-6cd7-4656-9f74-d157e1a9d05d HTTP/1.1 Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_4xbB8fnr17iZxpZmQfQZiM2JCxKiVWWUXjZiHpHTuUHHVw7ao4oT_uZW8wxu89NvTWOIVQIIqQPmHAao-lpxs7gxXuSYKOkaP9AGGwPUmZ0l1sD6ZLIZdH6-nP_cliwrHT6QFXnVMcXHLYBwQRQIzx4m2gYEscPKDx2pEzeM4vYGU Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 85c97e15d470473189d8a6c2068e9eac Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/85c97e15d470473189d8a6c2068e9eac"}]}] Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 85c97e15d470473189d8a6c2068e9eac Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ImagesOneServerNegativeTestJSON-1209884465-project Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 6791b833351c493a8e581154c2dfb8d7 Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465-project Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: exception: Image not found. Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '02386db1-6cd7-4656-9f74-d157e1a9d05d'} Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 02386db1-6cd7-4656-9f74-d157e1a9d05d to delete Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 02386db1-6cd7-4656-9f74-d157e1a9d05d could not be found. Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:27.632500 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:27.636445 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:27.636445 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:27.636445 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:27.636445 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:15:27.636445 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:15:27.636445 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:15:27.636445 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:15:27.636445 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:15:27.636445 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:15:27.636445 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 04 17:15:27.636445 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 04 17:15:27.636445 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 04 17:15:27.636445 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:27.636445 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:27.636445 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:27.636445 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:27.636445 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:27.636445 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:27.636445 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:15:27.636445 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:15:27.636445 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 04 17:15:27.636445 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:27.636445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fd3712b9-0736-4848-8632-bf4c761044a7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Returning 404 to user: Image not found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:15:27.636445 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fd3712b9-0736-4848-8632-bf4c761044a7 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "DELETE /compute/v2.1/images/02386db1-6cd7-4656-9f74-d157e1a9d05d" status: 404 len: 62 microversion: 2.1 time: 0.035089 Aug 04 17:15:27.636445 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2399/4856] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:27 2022] DELETE /compute/v2.1/images/02386db1-6cd7-4656-9f74-d157e1a9d05d => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:15:27.642828 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-477cd91c-8c83-4e2e-ab15-566ceb582e22 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:27.643357 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-477cd91c-8c83-4e2e-ab15-566ceb582e22 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:27.649820 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-477cd91c-8c83-4e2e-ab15-566ceb582e22 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:27.650358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-477cd91c-8c83-4e2e-ab15-566ceb582e22 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:27.651042 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-477cd91c-8c83-4e2e-ab15-566ceb582e22 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:27.652032 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-477cd91c-8c83-4e2e-ab15-566ceb582e22 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:27.652704 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-477cd91c-8c83-4e2e-ab15-566ceb582e22 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:27.653348 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-477cd91c-8c83-4e2e-ab15-566ceb582e22 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:27.669632 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-477cd91c-8c83-4e2e-ab15-566ceb582e22 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] HTTP exception thrown: Instance a741b004-2f32-419c-aada-de12ed0cd36e could not be found. Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-477cd91c-8c83-4e2e-ab15-566ceb582e22 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Request method failure captured: Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e HTTP/1.1 Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_4xbB8fnr17iZxpZmQfQZiM2JCxKiVWWUXjZiHpHTuUHHVw7ao4oT_uZW8wxu89NvTWOIVQIIqQPmHAao-lpxs7gxXuSYKOkaP9AGGwPUmZ0l1sD6ZLIZdH6-nP_cliwrHT6QFXnVMcXHLYBwQRQIzx4m2gYEscPKDx2pEzeM4vYGU Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 85c97e15d470473189d8a6c2068e9eac Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/85c97e15d470473189d8a6c2068e9eac"}]}] Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 85c97e15d470473189d8a6c2068e9eac Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ImagesOneServerNegativeTestJSON-1209884465-project Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 6791b833351c493a8e581154c2dfb8d7 Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465-project Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance a741b004-2f32-419c-aada-de12ed0cd36e could not be found. Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'a741b004-2f32-419c-aada-de12ed0cd36e'} Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a741b004-2f32-419c-aada-de12ed0cd36e could not be found. Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:15:27.671635 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:15:27.675422 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a741b004-2f32-419c-aada-de12ed0cd36e could not be found. Aug 04 17:15:27.675422 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:27.675422 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:27.675422 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:27.675422 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:27.675422 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:27.675422 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:27.675422 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:15:27.675422 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:15:27.675422 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a741b004-2f32-419c-aada-de12ed0cd36e could not be found. Aug 04 17:15:27.675422 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:27.678332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-477cd91c-8c83-4e2e-ab15-566ceb582e22 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Returning 404 to user: Instance a741b004-2f32-419c-aada-de12ed0cd36e could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:15:27.679469 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-477cd91c-8c83-4e2e-ab15-566ceb582e22 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "DELETE /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 404 len: 111 microversion: 2.1 time: 0.040662 Aug 04 17:15:27.680275 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2458/4857] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:15:27 2022] DELETE /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:15:27.689627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-47bdea0e-703f-477a-bacc-571c999fdda1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:27.690848 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-47bdea0e-703f-477a-bacc-571c999fdda1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] [instance: a741b004-2f32-419c-aada-de12ed0cd36e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:27.697044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0ab8a4b2-9a1b-4a39-adf4-b656f76f40c5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:27.697689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0ab8a4b2-9a1b-4a39-adf4-b656f76f40c5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:27.700118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47bdea0e-703f-477a-bacc-571c999fdda1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:27.700804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47bdea0e-703f-477a-bacc-571c999fdda1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:27.701669 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47bdea0e-703f-477a-bacc-571c999fdda1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:27.702441 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47bdea0e-703f-477a-bacc-571c999fdda1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:27.703785 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47bdea0e-703f-477a-bacc-571c999fdda1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:27.704239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47bdea0e-703f-477a-bacc-571c999fdda1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:27.706421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ab8a4b2-9a1b-4a39-adf4-b656f76f40c5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:27.711025 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ab8a4b2-9a1b-4a39-adf4-b656f76f40c5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:27.711585 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ab8a4b2-9a1b-4a39-adf4-b656f76f40c5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:27.712356 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ab8a4b2-9a1b-4a39-adf4-b656f76f40c5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:27.712851 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ab8a4b2-9a1b-4a39-adf4-b656f76f40c5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:27.713306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ab8a4b2-9a1b-4a39-adf4-b656f76f40c5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:27.737846 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-47bdea0e-703f-477a-bacc-571c999fdda1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] HTTP exception thrown: Instance a741b004-2f32-419c-aada-de12ed0cd36e could not be found. Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-47bdea0e-703f-477a-bacc-571c999fdda1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Request method failure captured: Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e HTTP/1.1 Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_4xbB8fnr17iZxpZmQfQZiM2JCxKiVWWUXjZiHpHTuUHHVw7ao4oT_uZW8wxu89NvTWOIVQIIqQPmHAao-lpxs7gxXuSYKOkaP9AGGwPUmZ0l1sD6ZLIZdH6-nP_cliwrHT6QFXnVMcXHLYBwQRQIzx4m2gYEscPKDx2pEzeM4vYGU Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 85c97e15d470473189d8a6c2068e9eac Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_85c97e15d470473189d8a6c2068e9eac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/85c97e15d470473189d8a6c2068e9eac"}]}] Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 85c97e15d470473189d8a6c2068e9eac Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465 Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ImagesOneServerNegativeTestJSON-1209884465-project Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 6791b833351c493a8e581154c2dfb8d7 Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1209884465-project Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance a741b004-2f32-419c-aada-de12ed0cd36e could not be found. Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'a741b004-2f32-419c-aada-de12ed0cd36e'} Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a741b004-2f32-419c-aada-de12ed0cd36e could not be found. Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a741b004-2f32-419c-aada-de12ed0cd36e could not be found. Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:27.740568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:27.744778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:27.744778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:27.744778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:27.744778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:27.744778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:15:27.744778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:15:27.744778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a741b004-2f32-419c-aada-de12ed0cd36e could not be found. Aug 04 17:15:27.744778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:27.746729 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-47bdea0e-703f-477a-bacc-571c999fdda1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] Returning 404 to user: Instance a741b004-2f32-419c-aada-de12ed0cd36e could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:15:27.747783 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-47bdea0e-703f-477a-bacc-571c999fdda1 tempest-ImagesOneServerNegativeTestJSON-1209884465 tempest-ImagesOneServerNegativeTestJSON-1209884465-project] 10.222.0.93 "GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e" status: 404 len: 111 microversion: 2.1 time: 0.062636 Aug 04 17:15:27.748815 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2400/4858] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:27 2022] GET /compute/v2.1/servers/a741b004-2f32-419c-aada-de12ed0cd36e => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:15:28.006718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0ab8a4b2-9a1b-4a39-adf4-b656f76f40c5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:28.010930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:28.019961 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0ab8a4b2-9a1b-4a39-adf4-b656f76f40c5 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 200 len: 1493 microversion: 2.1 time: 0.327811 Aug 04 17:15:28.026368 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2459/4859] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:27 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 1493 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:28.289808 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-376ecc33-c79b-401f-b994-e6ab693db20e req-569f048a-95af-4af8-aff8-43ae7c85bbfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2f9bc6d-2c94-4ca6-ab81-62a991e04693", "name": "network-vif-deleted", "tag": "195b4d22-104f-4024-9610-835ea111782f"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:28.317368 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9d51cc5b-91b0-4c85-b8cf-60e83535f237 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:28.319021 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9d51cc5b-91b0-4c85-b8cf-60e83535f237 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:28.324460 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-376ecc33-c79b-401f-b994-e6ab693db20e req-569f048a-95af-4af8-aff8-43ae7c85bbfc service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:28.325110 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-376ecc33-c79b-401f-b994-e6ab693db20e req-569f048a-95af-4af8-aff8-43ae7c85bbfc service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:28.325877 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-376ecc33-c79b-401f-b994-e6ab693db20e req-569f048a-95af-4af8-aff8-43ae7c85bbfc service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:28.333256 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d51cc5b-91b0-4c85-b8cf-60e83535f237 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:28.334024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d51cc5b-91b0-4c85-b8cf-60e83535f237 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:28.334845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d51cc5b-91b0-4c85-b8cf-60e83535f237 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:28.335738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d51cc5b-91b0-4c85-b8cf-60e83535f237 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:28.336476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d51cc5b-91b0-4c85-b8cf-60e83535f237 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:28.337068 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d51cc5b-91b0-4c85-b8cf-60e83535f237 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:28.347251 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-376ecc33-c79b-401f-b994-e6ab693db20e req-569f048a-95af-4af8-aff8-43ae7c85bbfc service nova] Creating event network-vif-deleted:195b4d22-104f-4024-9610-835ea111782f for instance c2f9bc6d-2c94-4ca6-ab81-62a991e04693 on n-h1-851359-3 Aug 04 17:15:28.357816 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-376ecc33-c79b-401f-b994-e6ab693db20e req-569f048a-95af-4af8-aff8-43ae7c85bbfc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076127 Aug 04 17:15:28.360892 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2401/4860] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:28.461925 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9d51cc5b-91b0-4c85-b8cf-60e83535f237 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:28.472093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9d51cc5b-91b0-4c85-b8cf-60e83535f237 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:28.474074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9d51cc5b-91b0-4c85-b8cf-60e83535f237 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:28.475647 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9d51cc5b-91b0-4c85-b8cf-60e83535f237 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a" status: 200 len: 1407 microversion: 2.54 time: 0.165828 Aug 04 17:15:28.476221 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2460/4861] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:15:28 2022] GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:15:28.556190 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1d899318-24cc-4cea-86c8-ca14782a12d2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:28.556912 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1d899318-24cc-4cea-86c8-ca14782a12d2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 314e3218-a990-4be2-aef1-d69a055897e9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:28.565256 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d899318-24cc-4cea-86c8-ca14782a12d2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:28.565787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d899318-24cc-4cea-86c8-ca14782a12d2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:28.566252 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d899318-24cc-4cea-86c8-ca14782a12d2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:28.566969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d899318-24cc-4cea-86c8-ca14782a12d2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:28.567428 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d899318-24cc-4cea-86c8-ca14782a12d2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:28.567986 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d899318-24cc-4cea-86c8-ca14782a12d2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:28.838520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1d899318-24cc-4cea-86c8-ca14782a12d2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:28.862235 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1d899318-24cc-4cea-86c8-ca14782a12d2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9" status: 200 len: 1517 microversion: 2.1 time: 0.309662 Aug 04 17:15:28.863985 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2402/4862] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:28 2022] GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9 => generated 1517 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:28.945870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3fe9a7f7-e0de-4354-b943-6cc09dc35d55 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:28.946587 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3fe9a7f7-e0de-4354-b943-6cc09dc35d55 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:28.960123 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3fe9a7f7-e0de-4354-b943-6cc09dc35d55 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:28.961682 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3fe9a7f7-e0de-4354-b943-6cc09dc35d55 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:28.962372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3fe9a7f7-e0de-4354-b943-6cc09dc35d55 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:28.964024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3fe9a7f7-e0de-4354-b943-6cc09dc35d55 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:28.965332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3fe9a7f7-e0de-4354-b943-6cc09dc35d55 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:28.965927 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3fe9a7f7-e0de-4354-b943-6cc09dc35d55 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:28.997535 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3fe9a7f7-e0de-4354-b943-6cc09dc35d55 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba/ips" status: 200 len: 146 microversion: 2.1 time: 0.055590 Aug 04 17:15:28.999689 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2461/4863] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Aug 4 17:15:28 2022] GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba/ips => generated 146 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:29.044409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9b530e4b-99f5-422e-9b63-aa35032ed217 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:29.044938 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-88560d28-8de3-4617-bc3e-c0d70d0bd6aa tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1607216905", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "779f24e1-21b5-406f-8c13-50f72d42c29c"}], "security_groups": [{"name": "tempest-securitygroup--1823695646"}], "key_name": "tempest-keypair-916789404", "user_data": "}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:29.045761 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9b530e4b-99f5-422e-9b63-aa35032ed217 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: c2f9bc6d-2c94-4ca6-ab81-62a991e04693] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:29.053591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b530e4b-99f5-422e-9b63-aa35032ed217 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:29.055028 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b530e4b-99f5-422e-9b63-aa35032ed217 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:29.055856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b530e4b-99f5-422e-9b63-aa35032ed217 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:29.056862 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b530e4b-99f5-422e-9b63-aa35032ed217 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:29.057541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b530e4b-99f5-422e-9b63-aa35032ed217 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:29.058475 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b530e4b-99f5-422e-9b63-aa35032ed217 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:29.079374 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-9b530e4b-99f5-422e-9b63-aa35032ed217 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] HTTP exception thrown: Instance c2f9bc6d-2c94-4ca6-ab81-62a991e04693 could not be found. Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9b530e4b-99f5-422e-9b63-aa35032ed217 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Request method failure captured: Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 HTTP/1.1 Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_yRMj5TmiUiePuxSnga_Pnns-Bpj5aA4uGmfrVKNtT7pLSLMV6hR6GdWVQMcx558mTVagVc5ritEKmEaG9jlrpABFcQhDSxLCEoyLH_vWnRVJyVNaLifB4cbPIAOTPDtpOkRM4AqnGVUyNlNzo9X9IxkbuoayvWNyDPnSX0E0uErX8 Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 683ce999e25e42a4a57b3c24a1fd24ef Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerActionsTestJSON-1286399382 Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/683ce999e25e42a4a57b3c24a1fd24ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/683ce999e25e42a4a57b3c24a1fd24ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_683ce999e25e42a4a57b3c24a1fd24ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/683ce999e25e42a4a57b3c24a1fd24ef"}]}] Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServerActionsTestJSON-1286399382 Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 683ce999e25e42a4a57b3c24a1fd24ef Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerActionsTestJSON-1286399382 Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServerActionsTestJSON-1286399382-project Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 01e6f70936a14e67aecaf71fb615fffa Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServerActionsTestJSON-1286399382-project Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance c2f9bc6d-2c94-4ca6-ab81-62a991e04693 could not be found. Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'c2f9bc6d-2c94-4ca6-ab81-62a991e04693'} Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2f9bc6d-2c94-4ca6-ab81-62a991e04693 could not be found. Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2f9bc6d-2c94-4ca6-ab81-62a991e04693 could not be found. Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:29.081655 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:29.085445 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:29.085445 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:29.085445 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:29.085445 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:15:29.085445 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:15:29.085445 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2f9bc6d-2c94-4ca6-ab81-62a991e04693 could not be found. Aug 04 17:15:29.085445 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:29.085445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9b530e4b-99f5-422e-9b63-aa35032ed217 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Returning 404 to user: Instance c2f9bc6d-2c94-4ca6-ab81-62a991e04693 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:15:29.085445 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9b530e4b-99f5-422e-9b63-aa35032ed217 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693" status: 404 len: 111 microversion: 2.1 time: 0.044362 Aug 04 17:15:29.088479 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2403/4864] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:29 2022] GET /compute/v2.1/servers/c2f9bc6d-2c94-4ca6-ab81-62a991e04693 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:15:29.095231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dafc5ec2-a5ce-4ad5-90ec-e45608589c8d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:29.095829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dafc5ec2-a5ce-4ad5-90ec-e45608589c8d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:29.102756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dafc5ec2-a5ce-4ad5-90ec-e45608589c8d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:29.103822 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dafc5ec2-a5ce-4ad5-90ec-e45608589c8d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:29.104275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dafc5ec2-a5ce-4ad5-90ec-e45608589c8d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:29.105530 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dafc5ec2-a5ce-4ad5-90ec-e45608589c8d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:29.106053 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dafc5ec2-a5ce-4ad5-90ec-e45608589c8d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:29.106456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dafc5ec2-a5ce-4ad5-90ec-e45608589c8d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:29.157015 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dafc5ec2-a5ce-4ad5-90ec-e45608589c8d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:15:29.322113 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dafc5ec2-a5ce-4ad5-90ec-e45608589c8d tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "DELETE /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 204 len: 0 microversion: 2.1 time: 0.231173 Aug 04 17:15:29.327102 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2404/4865] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:15:29 2022] DELETE /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:15:29.344367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c33f9ba6-554a-43fc-a563-e9b6f1cfa25c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:29.345131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c33f9ba6-554a-43fc-a563-e9b6f1cfa25c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:29.365217 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c33f9ba6-554a-43fc-a563-e9b6f1cfa25c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:29.365752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c33f9ba6-554a-43fc-a563-e9b6f1cfa25c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:29.366294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c33f9ba6-554a-43fc-a563-e9b6f1cfa25c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:29.367057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c33f9ba6-554a-43fc-a563-e9b6f1cfa25c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:29.369899 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c33f9ba6-554a-43fc-a563-e9b6f1cfa25c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:29.372700 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c33f9ba6-554a-43fc-a563-e9b6f1cfa25c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:29.496007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-88560d28-8de3-4617-bc3e-c0d70d0bd6aa tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] validate_networks() for [('779f24e1-21b5-406f-8c13-50f72d42c29c', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:15:29.885461 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c33f9ba6-554a-43fc-a563-e9b6f1cfa25c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:29.903291 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c33f9ba6-554a-43fc-a563-e9b6f1cfa25c tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1676 microversion: 2.1 time: 0.573679 Aug 04 17:15:29.904237 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2405/4866] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:29 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1676 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:29.909192 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bfb2b2c1-a8de-45d7-9f60-aa5118daaadc tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:29.923722 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bfb2b2c1-a8de-45d7-9f60-aa5118daaadc tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:29.942814 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bfb2b2c1-a8de-45d7-9f60-aa5118daaadc tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:29.943566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bfb2b2c1-a8de-45d7-9f60-aa5118daaadc tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:29.944820 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bfb2b2c1-a8de-45d7-9f60-aa5118daaadc tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:29.945772 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bfb2b2c1-a8de-45d7-9f60-aa5118daaadc tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:29.947399 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bfb2b2c1-a8de-45d7-9f60-aa5118daaadc tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:29.948015 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bfb2b2c1-a8de-45d7-9f60-aa5118daaadc tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:30.093362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bfb2b2c1-a8de-45d7-9f60-aa5118daaadc tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:30.108388 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bfb2b2c1-a8de-45d7-9f60-aa5118daaadc tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:30.110151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bfb2b2c1-a8de-45d7-9f60-aa5118daaadc tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:30.111729 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bfb2b2c1-a8de-45d7-9f60-aa5118daaadc tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a" status: 200 len: 1407 microversion: 2.54 time: 0.206033 Aug 04 17:15:30.112481 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2406/4867] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:15:29 2022] GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:15:30.130257 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9d16c1b5-3dc3-4f82-9aab-98bce67e3dca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:30.139026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9d16c1b5-3dc3-4f82-9aab-98bce67e3dca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 314e3218-a990-4be2-aef1-d69a055897e9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:30.157537 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d16c1b5-3dc3-4f82-9aab-98bce67e3dca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:30.158397 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d16c1b5-3dc3-4f82-9aab-98bce67e3dca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:30.159004 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d16c1b5-3dc3-4f82-9aab-98bce67e3dca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:30.159881 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d16c1b5-3dc3-4f82-9aab-98bce67e3dca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:30.160491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d16c1b5-3dc3-4f82-9aab-98bce67e3dca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:30.161085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d16c1b5-3dc3-4f82-9aab-98bce67e3dca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:30.221832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d16c1b5-3dc3-4f82-9aab-98bce67e3dca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:30.223256 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d16c1b5-3dc3-4f82-9aab-98bce67e3dca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:30.223946 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d16c1b5-3dc3-4f82-9aab-98bce67e3dca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:30.224510 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-9d16c1b5-3dc3-4f82-9aab-98bce67e3dca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lazy-loading 'fault' on Instance uuid 314e3218-a990-4be2-aef1-d69a055897e9 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:15:30.310385 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9d16c1b5-3dc3-4f82-9aab-98bce67e3dca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:30.320905 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9d16c1b5-3dc3-4f82-9aab-98bce67e3dca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9" status: 200 len: 1320 microversion: 2.1 time: 0.207173 Aug 04 17:15:30.321815 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2407/4868] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:30 2022] GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9 => generated 1320 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:30.407274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-8c4a87b2-f892-428a-b52a-4870fbbf0496 req-c649fbeb-c77f-44b5-95d9-1bafcd94ca2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "314e3218-a990-4be2-aef1-d69a055897e9", "name": "network-vif-deleted", "tag": "3d5e1fae-5919-469b-addc-bb208c32cdc6"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:30.440620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8c4a87b2-f892-428a-b52a-4870fbbf0496 req-c649fbeb-c77f-44b5-95d9-1bafcd94ca2c service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:30.443761 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8c4a87b2-f892-428a-b52a-4870fbbf0496 req-c649fbeb-c77f-44b5-95d9-1bafcd94ca2c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:30.444247 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8c4a87b2-f892-428a-b52a-4870fbbf0496 req-c649fbeb-c77f-44b5-95d9-1bafcd94ca2c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:30.465609 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-8c4a87b2-f892-428a-b52a-4870fbbf0496 req-c649fbeb-c77f-44b5-95d9-1bafcd94ca2c service nova] Creating event network-vif-deleted:3d5e1fae-5919-469b-addc-bb208c32cdc6 for instance 314e3218-a990-4be2-aef1-d69a055897e9 on n-h2-851359-3 Aug 04 17:15:30.479076 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-8c4a87b2-f892-428a-b52a-4870fbbf0496 req-c649fbeb-c77f-44b5-95d9-1bafcd94ca2c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077581 Aug 04 17:15:30.480436 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2408/4869] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:30.804452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-88560d28-8de3-4617-bc3e-c0d70d0bd6aa tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:15:30.805825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-88560d28-8de3-4617-bc3e-c0d70d0bd6aa tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:15:30.806863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-88560d28-8de3-4617-bc3e-c0d70d0bd6aa tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:15:30.807712 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-88560d28-8de3-4617-bc3e-c0d70d0bd6aa tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:15:30.808815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-88560d28-8de3-4617-bc3e-c0d70d0bd6aa tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:15:30.823539 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88560d28-8de3-4617-bc3e-c0d70d0bd6aa tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:30.824066 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88560d28-8de3-4617-bc3e-c0d70d0bd6aa tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:30.824596 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88560d28-8de3-4617-bc3e-c0d70d0bd6aa tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:30.826945 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88560d28-8de3-4617-bc3e-c0d70d0bd6aa tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:30.828828 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88560d28-8de3-4617-bc3e-c0d70d0bd6aa tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:30.829518 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88560d28-8de3-4617-bc3e-c0d70d0bd6aa tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:30.863447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-88560d28-8de3-4617-bc3e-c0d70d0bd6aa tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Getting quotas for project 80bc576163414daba5f5315c4a785533. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:15:30.875968 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-88560d28-8de3-4617-bc3e-c0d70d0bd6aa tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Getting quotas for user 5b10b58bf3df46d18bff092022b08e0f and project 80bc576163414daba5f5315c4a785533. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:15:30.899933 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-88560d28-8de3-4617-bc3e-c0d70d0bd6aa tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:15:30.904698 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-88560d28-8de3-4617-bc3e-c0d70d0bd6aa tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:15:30.925126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fd1c847e-81d5-433e-84b6-e82a867c4a96 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:30.926121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fd1c847e-81d5-433e-84b6-e82a867c4a96 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:30.939009 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd1c847e-81d5-433e-84b6-e82a867c4a96 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:30.940262 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd1c847e-81d5-433e-84b6-e82a867c4a96 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:30.941204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd1c847e-81d5-433e-84b6-e82a867c4a96 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:30.943312 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd1c847e-81d5-433e-84b6-e82a867c4a96 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:30.949719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd1c847e-81d5-433e-84b6-e82a867c4a96 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:30.950520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd1c847e-81d5-433e-84b6-e82a867c4a96 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:31.000642 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-88560d28-8de3-4617-bc3e-c0d70d0bd6aa tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.960047 Aug 04 17:15:31.005383 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2462/4870] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:15:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 1965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 17:15:31.019645 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1d027665-a56f-4fdc-8fb4-cdd276857b6c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:31.022611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1d027665-a56f-4fdc-8fb4-cdd276857b6c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:31.614736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1d027665-a56f-4fdc-8fb4-cdd276857b6c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:31.636900 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1d027665-a56f-4fdc-8fb4-cdd276857b6c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee" status: 200 len: 1241 microversion: 2.1 time: 0.622781 Aug 04 17:15:31.637501 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2463/4871] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:31 2022] GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee => generated 1241 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:31.652125 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-23665d9f-2f48-4418-8b22-e67f1711c986 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:31.657923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-23665d9f-2f48-4418-8b22-e67f1711c986 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:31.672860 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23665d9f-2f48-4418-8b22-e67f1711c986 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:31.675428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23665d9f-2f48-4418-8b22-e67f1711c986 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:31.676093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23665d9f-2f48-4418-8b22-e67f1711c986 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:31.677578 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23665d9f-2f48-4418-8b22-e67f1711c986 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:31.678291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23665d9f-2f48-4418-8b22-e67f1711c986 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:31.679651 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23665d9f-2f48-4418-8b22-e67f1711c986 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:31.851870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fd1c847e-81d5-433e-84b6-e82a867c4a96 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:31.866945 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fd1c847e-81d5-433e-84b6-e82a867c4a96 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1676 microversion: 2.1 time: 0.946117 Aug 04 17:15:31.867853 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2409/4872] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:30 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1676 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:31.887631 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5d080505-58a5-47ac-8c66-e363e3a7421c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:31.888938 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5d080505-58a5-47ac-8c66-e363e3a7421c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 314e3218-a990-4be2-aef1-d69a055897e9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:31.899371 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d080505-58a5-47ac-8c66-e363e3a7421c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:31.899874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d080505-58a5-47ac-8c66-e363e3a7421c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:31.900343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d080505-58a5-47ac-8c66-e363e3a7421c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:31.901087 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d080505-58a5-47ac-8c66-e363e3a7421c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:31.901589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d080505-58a5-47ac-8c66-e363e3a7421c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:31.902450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-23665d9f-2f48-4418-8b22-e67f1711c986 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:31.908428 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d080505-58a5-47ac-8c66-e363e3a7421c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:31.916228 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-23665d9f-2f48-4418-8b22-e67f1711c986 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:31.923065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-23665d9f-2f48-4418-8b22-e67f1711c986 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:31.934178 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-5d080505-58a5-47ac-8c66-e363e3a7421c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] HTTP exception thrown: Instance 314e3218-a990-4be2-aef1-d69a055897e9 could not be found. Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5d080505-58a5-47ac-8c66-e363e3a7421c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Request method failure captured: Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9 HTTP/1.1 Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_4PiXAoqFPCXVrtw_fcVtbWCRHCRY1BcfprLEe-EkZEFmD3rLGum9OIJcRnH-o3xr4k8T7yl4V2Hv5h2fEBByVUFBw2XIbz_i_ncVR1MMvkDEp1AvjPEGXUtr2hnsv9JoWINOTj84eRxq_Gac5VyTIxXMDaWbVLw5VeWNnbunOt5QM Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d9911aeb77cd4ffb8c4e539998a04f3c"}]}] Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersTestJSON-1653035612 Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersTestJSON-1653035612-project Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 8e840d06bb5d44e097e6f0855b04cb06 Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersTestJSON-1653035612-project Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 314e3218-a990-4be2-aef1-d69a055897e9 could not be found. Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '314e3218-a990-4be2-aef1-d69a055897e9'} Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 314e3218-a990-4be2-aef1-d69a055897e9 could not be found. Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 314e3218-a990-4be2-aef1-d69a055897e9 could not be found. Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:31.945667 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:31.964558 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:31.964558 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:31.964558 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:31.964558 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:15:31.964558 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:15:31.964558 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 314e3218-a990-4be2-aef1-d69a055897e9 could not be found. Aug 04 17:15:31.964558 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:31.964558 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5d080505-58a5-47ac-8c66-e363e3a7421c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Returning 404 to user: Instance 314e3218-a990-4be2-aef1-d69a055897e9 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:15:31.964558 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5d080505-58a5-47ac-8c66-e363e3a7421c tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9" status: 404 len: 111 microversion: 2.1 time: 0.064551 Aug 04 17:15:31.966832 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-23665d9f-2f48-4418-8b22-e67f1711c986 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a" status: 200 len: 1407 microversion: 2.54 time: 0.300487 Aug 04 17:15:31.966832 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2464/4873] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:15:31 2022] GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a => generated 1407 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:15:31.966832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5a6e2397-5e4e-473f-8cf2-04c3bc9877e5 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13f4b91d-6781-4d5c-8d02-e6fd9b41e854"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:31.967236 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2410/4874] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:31 2022] GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:15:31.973360 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5a6e2397-5e4e-473f-8cf2-04c3bc9877e5 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:31.989966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5a6e2397-5e4e-473f-8cf2-04c3bc9877e5 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:31.993289 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5a6e2397-5e4e-473f-8cf2-04c3bc9877e5 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:31.993799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5a6e2397-5e4e-473f-8cf2-04c3bc9877e5 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:31.997389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5a6e2397-5e4e-473f-8cf2-04c3bc9877e5 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:31.997879 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5a6e2397-5e4e-473f-8cf2-04c3bc9877e5 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:32.000718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5a6e2397-5e4e-473f-8cf2-04c3bc9877e5 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:32.076654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5f87d74b-6966-4169-9dd3-69d7f6811400 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-216570738", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "ec3b7b59-9fd4-4839-add6-43afeffa896c"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:32.159365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-5f87d74b-6966-4169-9dd3-69d7f6811400 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] validate_networks() for [('ec3b7b59-9fd4-4839-add6-43afeffa896c', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:15:32.729273 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5a6e2397-5e4e-473f-8cf2-04c3bc9877e5 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "POST /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.775690 Aug 04 17:15:32.734556 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2465/4875] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Aug 4 17:15:31 2022] POST /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba/os-volume_attachments => generated 194 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:32.784584 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d621df29-e798-44c9-b859-e02da195718e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:32.788632 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d621df29-e798-44c9-b859-e02da195718e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:32.797787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d621df29-e798-44c9-b859-e02da195718e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:32.798519 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d621df29-e798-44c9-b859-e02da195718e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:32.799136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d621df29-e798-44c9-b859-e02da195718e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:32.800022 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d621df29-e798-44c9-b859-e02da195718e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:32.800642 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d621df29-e798-44c9-b859-e02da195718e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:32.801227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d621df29-e798-44c9-b859-e02da195718e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:32.975940 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d621df29-e798-44c9-b859-e02da195718e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:32.996401 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d621df29-e798-44c9-b859-e02da195718e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee" status: 200 len: 1311 microversion: 2.1 time: 0.258028 Aug 04 17:15:33.001542 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2466/4876] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:32 2022] GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee => generated 1311 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:33.014175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-1201bb1e-080d-46d7-8ab7-96d54229766d req-dd9c047d-949e-4e57-b6fb-0742173ff8c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10991c59-c7d8-447e-8f2b-3f5ea5d8d62a", "name": "network-vif-deleted", "tag": "d34d92ed-1a8a-4623-be8e-630b78a99ac4"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:33.039739 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1201bb1e-080d-46d7-8ab7-96d54229766d req-dd9c047d-949e-4e57-b6fb-0742173ff8c7 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:33.043214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1201bb1e-080d-46d7-8ab7-96d54229766d req-dd9c047d-949e-4e57-b6fb-0742173ff8c7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:33.043708 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1201bb1e-080d-46d7-8ab7-96d54229766d req-dd9c047d-949e-4e57-b6fb-0742173ff8c7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:33.079955 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-1201bb1e-080d-46d7-8ab7-96d54229766d req-dd9c047d-949e-4e57-b6fb-0742173ff8c7 service nova] Creating event network-vif-deleted:d34d92ed-1a8a-4623-be8e-630b78a99ac4 for instance 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a on n-h1-851359-3 Aug 04 17:15:33.091736 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-1201bb1e-080d-46d7-8ab7-96d54229766d req-dd9c047d-949e-4e57-b6fb-0742173ff8c7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085856 Aug 04 17:15:33.092391 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2467/4877] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:33.122568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-29bafd9a-2f64-4c4e-a6d8-f04444924134 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:33.124410 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-29bafd9a-2f64-4c4e-a6d8-f04444924134 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:33.135278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29bafd9a-2f64-4c4e-a6d8-f04444924134 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:33.135902 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29bafd9a-2f64-4c4e-a6d8-f04444924134 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:33.136353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29bafd9a-2f64-4c4e-a6d8-f04444924134 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:33.137755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29bafd9a-2f64-4c4e-a6d8-f04444924134 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:33.138500 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29bafd9a-2f64-4c4e-a6d8-f04444924134 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:33.139114 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29bafd9a-2f64-4c4e-a6d8-f04444924134 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:33.193321 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29bafd9a-2f64-4c4e-a6d8-f04444924134 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:33.194655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29bafd9a-2f64-4c4e-a6d8-f04444924134 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:33.195708 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29bafd9a-2f64-4c4e-a6d8-f04444924134 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:33.196341 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-29bafd9a-2f64-4c4e-a6d8-f04444924134 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lazy-loading 'fault' on Instance uuid 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:15:33.649050 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-29bafd9a-2f64-4c4e-a6d8-f04444924134 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e6f70936a14e67aecaf71fb615fffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '683ce999e25e42a4a57b3c24a1fd24ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:33.665000 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-29bafd9a-2f64-4c4e-a6d8-f04444924134 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 200 len: 1329 microversion: 2.1 time: 0.566467 Aug 04 17:15:33.678002 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2468/4878] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:33 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 1329 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:33.680102 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f461457f-b170-465b-9f3e-dc6bb5740a4c tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:33.680836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f461457f-b170-465b-9f3e-dc6bb5740a4c tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:33.700216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f461457f-b170-465b-9f3e-dc6bb5740a4c tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:33.700742 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f461457f-b170-465b-9f3e-dc6bb5740a4c tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:33.701419 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f461457f-b170-465b-9f3e-dc6bb5740a4c tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:33.701965 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f461457f-b170-465b-9f3e-dc6bb5740a4c tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:33.702664 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f461457f-b170-465b-9f3e-dc6bb5740a4c tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:33.704247 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f461457f-b170-465b-9f3e-dc6bb5740a4c tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:33.955003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f461457f-b170-465b-9f3e-dc6bb5740a4c tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:33.976422 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f461457f-b170-465b-9f3e-dc6bb5740a4c tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:33.980443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f461457f-b170-465b-9f3e-dc6bb5740a4c tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:33.986403 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f461457f-b170-465b-9f3e-dc6bb5740a4c tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a" status: 200 len: 1407 microversion: 2.54 time: 0.315100 Aug 04 17:15:33.989779 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2469/4879] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:15:33 2022] GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a => generated 1407 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:15:34.023318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6cc8ceb5-ba7d-4f7b-89f3-11715287f0a9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:34.024450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6cc8ceb5-ba7d-4f7b-89f3-11715287f0a9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:34.033596 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6cc8ceb5-ba7d-4f7b-89f3-11715287f0a9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:34.036069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6cc8ceb5-ba7d-4f7b-89f3-11715287f0a9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:34.036637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6cc8ceb5-ba7d-4f7b-89f3-11715287f0a9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:34.037501 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6cc8ceb5-ba7d-4f7b-89f3-11715287f0a9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:34.038173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6cc8ceb5-ba7d-4f7b-89f3-11715287f0a9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:34.038868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6cc8ceb5-ba7d-4f7b-89f3-11715287f0a9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:34.364221 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-5f87d74b-6966-4169-9dd3-69d7f6811400 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:15:34.364890 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-5f87d74b-6966-4169-9dd3-69d7f6811400 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:15:34.365190 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-5f87d74b-6966-4169-9dd3-69d7f6811400 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:15:34.365634 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-5f87d74b-6966-4169-9dd3-69d7f6811400 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:15:34.366093 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-5f87d74b-6966-4169-9dd3-69d7f6811400 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:15:34.391172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f87d74b-6966-4169-9dd3-69d7f6811400 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:34.391707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f87d74b-6966-4169-9dd3-69d7f6811400 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:34.392176 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f87d74b-6966-4169-9dd3-69d7f6811400 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:34.392931 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f87d74b-6966-4169-9dd3-69d7f6811400 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:34.393401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f87d74b-6966-4169-9dd3-69d7f6811400 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:34.393840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f87d74b-6966-4169-9dd3-69d7f6811400 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:34.463020 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6cc8ceb5-ba7d-4f7b-89f3-11715287f0a9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:34.474565 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6cc8ceb5-ba7d-4f7b-89f3-11715287f0a9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee" status: 200 len: 1367 microversion: 2.1 time: 0.455339 Aug 04 17:15:34.475262 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2470/4880] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:34 2022] GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee => generated 1367 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:15:34.497772 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-5f87d74b-6966-4169-9dd3-69d7f6811400 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Getting quotas for project d9911aeb77cd4ffb8c4e539998a04f3c. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:15:34.506611 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-5f87d74b-6966-4169-9dd3-69d7f6811400 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Getting quotas for user 8e840d06bb5d44e097e6f0855b04cb06 and project d9911aeb77cd4ffb8c4e539998a04f3c. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:15:34.547692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5f87d74b-6966-4169-9dd3-69d7f6811400 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:15:34.556576 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5f87d74b-6966-4169-9dd3-69d7f6811400 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:15:34.644013 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5f87d74b-6966-4169-9dd3-69d7f6811400 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.572647 Aug 04 17:15:34.645270 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2411/4881] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:15:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 17:15:34.660597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0ddaef0f-c391-4bd0-a46f-757fc059d8d3 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:34.661246 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0ddaef0f-c391-4bd0-a46f-757fc059d8d3 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:34.700118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e811fe8e-b041-4503-ba1d-6ac80e8e0e3f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:34.701601 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e811fe8e-b041-4503-ba1d-6ac80e8e0e3f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] [instance: 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:34.720350 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e811fe8e-b041-4503-ba1d-6ac80e8e0e3f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:34.721952 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e811fe8e-b041-4503-ba1d-6ac80e8e0e3f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:34.724038 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e811fe8e-b041-4503-ba1d-6ac80e8e0e3f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:34.727777 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e811fe8e-b041-4503-ba1d-6ac80e8e0e3f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:34.728572 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e811fe8e-b041-4503-ba1d-6ac80e8e0e3f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:34.730555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e811fe8e-b041-4503-ba1d-6ac80e8e0e3f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:34.775603 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-e811fe8e-b041-4503-ba1d-6ac80e8e0e3f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] HTTP exception thrown: Instance 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a could not be found. Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e811fe8e-b041-4503-ba1d-6ac80e8e0e3f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Request method failure captured: Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a HTTP/1.1 Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_yRMj5TmiUiePuxSnga_Pnns-Bpj5aA4uGmfrVKNtT7pLSLMV6hR6GdWVQMcx558mTVagVc5ritEKmEaG9jlrpABFcQhDSxLCEoyLH_vWnRVJyVNaLifB4cbPIAOTPDtpOkRM4AqnGVUyNlNzo9X9IxkbuoayvWNyDPnSX0E0uErX8 Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 683ce999e25e42a4a57b3c24a1fd24ef Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerActionsTestJSON-1286399382 Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/683ce999e25e42a4a57b3c24a1fd24ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/683ce999e25e42a4a57b3c24a1fd24ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_683ce999e25e42a4a57b3c24a1fd24ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/683ce999e25e42a4a57b3c24a1fd24ef"}]}] Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServerActionsTestJSON-1286399382 Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 683ce999e25e42a4a57b3c24a1fd24ef Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerActionsTestJSON-1286399382 Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServerActionsTestJSON-1286399382-project Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 01e6f70936a14e67aecaf71fb615fffa Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServerActionsTestJSON-1286399382-project Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a could not be found. Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '10991c59-c7d8-447e-8f2b-3f5ea5d8d62a'} Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a could not be found. Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a could not be found. Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:34.779739 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:34.785501 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:34.785501 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:34.785501 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:34.785501 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:15:34.785501 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:15:34.785501 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a could not be found. Aug 04 17:15:34.785501 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:15:34.787531 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e811fe8e-b041-4503-ba1d-6ac80e8e0e3f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Returning 404 to user: Instance 10991c59-c7d8-447e-8f2b-3f5ea5d8d62a could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:15:34.788829 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e811fe8e-b041-4503-ba1d-6ac80e8e0e3f tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a" status: 404 len: 111 microversion: 2.1 time: 0.105268 Aug 04 17:15:34.790113 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2412/4882] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:34 2022] GET /compute/v2.1/servers/10991c59-c7d8-447e-8f2b-3f5ea5d8d62a => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:15:34.814044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-62612cbb-353a-4e84-9c21-528c223e8d71 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] Calling method '.version_select at 0x7f1e6c959820>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:34.836064 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-62612cbb-353a-4e84-9c21-528c223e8d71 tempest-ServerActionsTestJSON-1286399382 tempest-ServerActionsTestJSON-1286399382-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2051236122" status: 202 len: 0 microversion: 2.1 time: 0.041255 Aug 04 17:15:34.842418 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2413/4883] 10.222.0.93 () {58 vars in 1221 bytes} [Thu Aug 4 17:15:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2051236122 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:15:34.855322 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0ddaef0f-c391-4bd0-a46f-757fc059d8d3 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:34.864123 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0ddaef0f-c391-4bd0-a46f-757fc059d8d3 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 200 len: 1208 microversion: 2.1 time: 0.212009 Aug 04 17:15:34.879685 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2471/4884] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:34 2022] GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 1208 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:35.023048 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4e701b88-eea4-4cdf-a21f-fdd437c3348c tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:35.023686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4e701b88-eea4-4cdf-a21f-fdd437c3348c tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:35.033310 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e701b88-eea4-4cdf-a21f-fdd437c3348c tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:35.033800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e701b88-eea4-4cdf-a21f-fdd437c3348c tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:35.035433 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e701b88-eea4-4cdf-a21f-fdd437c3348c tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:35.039085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e701b88-eea4-4cdf-a21f-fdd437c3348c tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:35.040328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e701b88-eea4-4cdf-a21f-fdd437c3348c tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:35.043021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e701b88-eea4-4cdf-a21f-fdd437c3348c tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:35.108599 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:35.268792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4e701b88-eea4-4cdf-a21f-fdd437c3348c tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:35.278656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4e701b88-eea4-4cdf-a21f-fdd437c3348c tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:35.284749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4e701b88-eea4-4cdf-a21f-fdd437c3348c tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:35.286020 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4e701b88-eea4-4cdf-a21f-fdd437c3348c tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a" status: 200 len: 1407 microversion: 2.54 time: 0.275889 Aug 04 17:15:35.286607 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2414/4885] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:15:35 2022] GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a => generated 1407 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:15:35.498543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-374791f5-7104-4dbf-89a3-5c23e571b20f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:35.499621 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-374791f5-7104-4dbf-89a3-5c23e571b20f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:35.511427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-374791f5-7104-4dbf-89a3-5c23e571b20f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:35.511948 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-374791f5-7104-4dbf-89a3-5c23e571b20f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:35.512304 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-374791f5-7104-4dbf-89a3-5c23e571b20f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:35.513033 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-374791f5-7104-4dbf-89a3-5c23e571b20f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:35.513552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-374791f5-7104-4dbf-89a3-5c23e571b20f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:35.513993 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-374791f5-7104-4dbf-89a3-5c23e571b20f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:35.885293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f50c95df-6d8c-4c5a-a6ee-4b6d88f74a97 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:35.886148 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f50c95df-6d8c-4c5a-a6ee-4b6d88f74a97 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:35.921494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f50c95df-6d8c-4c5a-a6ee-4b6d88f74a97 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:35.926436 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f50c95df-6d8c-4c5a-a6ee-4b6d88f74a97 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:35.927024 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f50c95df-6d8c-4c5a-a6ee-4b6d88f74a97 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:35.930694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f50c95df-6d8c-4c5a-a6ee-4b6d88f74a97 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:35.931210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f50c95df-6d8c-4c5a-a6ee-4b6d88f74a97 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:35.931663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f50c95df-6d8c-4c5a-a6ee-4b6d88f74a97 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:35.983218 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-374791f5-7104-4dbf-89a3-5c23e571b20f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:35.995957 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-374791f5-7104-4dbf-89a3-5c23e571b20f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee" status: 200 len: 1367 microversion: 2.1 time: 0.501752 Aug 04 17:15:35.996382 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2472/4886] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:35 2022] GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee => generated 1367 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:36.109301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f50c95df-6d8c-4c5a-a6ee-4b6d88f74a97 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:36.121548 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f50c95df-6d8c-4c5a-a6ee-4b6d88f74a97 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 200 len: 1260 microversion: 2.1 time: 0.239658 Aug 04 17:15:36.128379 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2415/4887] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:35 2022] GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 1260 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:15:36.313998 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c674a240-c6d3-4234-bd50-9f6177a53940 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:36.314783 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c674a240-c6d3-4234-bd50-9f6177a53940 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:36.329251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c674a240-c6d3-4234-bd50-9f6177a53940 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:36.330815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c674a240-c6d3-4234-bd50-9f6177a53940 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:36.332548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c674a240-c6d3-4234-bd50-9f6177a53940 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:36.333627 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c674a240-c6d3-4234-bd50-9f6177a53940 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:36.334611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c674a240-c6d3-4234-bd50-9f6177a53940 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:36.335317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c674a240-c6d3-4234-bd50-9f6177a53940 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:36.492690 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c674a240-c6d3-4234-bd50-9f6177a53940 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:36.510062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c674a240-c6d3-4234-bd50-9f6177a53940 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:36.516881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c674a240-c6d3-4234-bd50-9f6177a53940 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:36.519972 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c674a240-c6d3-4234-bd50-9f6177a53940 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a" status: 200 len: 1407 microversion: 2.54 time: 0.212268 Aug 04 17:15:36.522500 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2473/4888] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:15:36 2022] GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:15:37.018108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e793e7da-21bd-4065-a123-e817ab306e08 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:37.019259 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e793e7da-21bd-4065-a123-e817ab306e08 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:37.033206 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e793e7da-21bd-4065-a123-e817ab306e08 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:37.034089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e793e7da-21bd-4065-a123-e817ab306e08 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:37.034895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e793e7da-21bd-4065-a123-e817ab306e08 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:37.036783 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e793e7da-21bd-4065-a123-e817ab306e08 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:37.039744 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e793e7da-21bd-4065-a123-e817ab306e08 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:37.040521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e793e7da-21bd-4065-a123-e817ab306e08 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:37.168685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-abc20d87-2ff2-4e59-a441-ccb2c955c8f3 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Action: 'create', calling method: .version_select at 0x7f1e5b6dd820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1881716587", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5wkXOl7ZzJcii+e/OA/SuqB4sm92kp8NXhgUiespfOuDBklMCadW3th9BDuYTViLAteP40ACmlYASO8csGsr07KiP1mZWE0AXifFJ8JmO4F8WXUMAJrYyL8AqMe0A9UA=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:37.199685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-abc20d87-2ff2-4e59-a441-ccb2c955c8f3 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Getting quotas for project 9c69a3e46122413f928fe20a76b0cf94. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:15:37.213035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-abc20d87-2ff2-4e59-a441-ccb2c955c8f3 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Getting quotas for user f27a58cf36934daeabff9e35c05d4c19 and project 9c69a3e46122413f928fe20a76b0cf94. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:15:37.254035 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-abc20d87-2ff2-4e59-a441-ccb2c955c8f3 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.300871 Aug 04 17:15:37.254683 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2416/4889] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:15:36 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:37.259349 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b6be3750-6bd8-4eaa-911d-0ed5c791110b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:37.270426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b6be3750-6bd8-4eaa-911d-0ed5c791110b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:37.283148 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6be3750-6bd8-4eaa-911d-0ed5c791110b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:37.286100 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6be3750-6bd8-4eaa-911d-0ed5c791110b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:37.286627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6be3750-6bd8-4eaa-911d-0ed5c791110b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:37.287423 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6be3750-6bd8-4eaa-911d-0ed5c791110b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:37.287895 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6be3750-6bd8-4eaa-911d-0ed5c791110b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:37.290495 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6be3750-6bd8-4eaa-911d-0ed5c791110b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:37.478887 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b6be3750-6bd8-4eaa-911d-0ed5c791110b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:37.494048 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b6be3750-6bd8-4eaa-911d-0ed5c791110b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 200 len: 1266 microversion: 2.1 time: 0.238239 Aug 04 17:15:37.496570 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2417/4890] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:37 2022] GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:37.509832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-ac6954d0-140f-461c-810b-86a9b5c3171e req-5f95931a-81b5-4d3f-bc8f-bf3893b4d390 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50cacda1-31c5-4417-8013-9c603340c3ee", "tag": "e2dac34a-108c-4215-a062-121a43ee48ad"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:37.535337 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ac6954d0-140f-461c-810b-86a9b5c3171e req-5f95931a-81b5-4d3f-bc8f-bf3893b4d390 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:37.537223 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ac6954d0-140f-461c-810b-86a9b5c3171e req-5f95931a-81b5-4d3f-bc8f-bf3893b4d390 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:37.537671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ac6954d0-140f-461c-810b-86a9b5c3171e req-5f95931a-81b5-4d3f-bc8f-bf3893b4d390 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:37.561199 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-ac6954d0-140f-461c-810b-86a9b5c3171e req-5f95931a-81b5-4d3f-bc8f-bf3893b4d390 service nova] Creating event network-changed:e2dac34a-108c-4215-a062-121a43ee48ad for instance 50cacda1-31c5-4417-8013-9c603340c3ee on n-h2-851359-3 Aug 04 17:15:37.568686 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-ac6954d0-140f-461c-810b-86a9b5c3171e req-5f95931a-81b5-4d3f-bc8f-bf3893b4d390 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069477 Aug 04 17:15:37.570306 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2418/4891] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:37.580349 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8c6ef215-7aa7-4dec-86c6-704fc530681a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:37.581592 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8c6ef215-7aa7-4dec-86c6-704fc530681a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:37.589873 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c6ef215-7aa7-4dec-86c6-704fc530681a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:37.591668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c6ef215-7aa7-4dec-86c6-704fc530681a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:37.592301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c6ef215-7aa7-4dec-86c6-704fc530681a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:37.593207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c6ef215-7aa7-4dec-86c6-704fc530681a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:37.594094 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c6ef215-7aa7-4dec-86c6-704fc530681a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:37.594719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c6ef215-7aa7-4dec-86c6-704fc530681a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:37.611027 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e793e7da-21bd-4065-a123-e817ab306e08 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:37.638458 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e793e7da-21bd-4065-a123-e817ab306e08 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee" status: 200 len: 1367 microversion: 2.1 time: 0.622080 Aug 04 17:15:37.654061 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2474/4892] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:37 2022] GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee => generated 1367 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:15:37.819012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8c6ef215-7aa7-4dec-86c6-704fc530681a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:37.836623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8c6ef215-7aa7-4dec-86c6-704fc530681a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:37.845032 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8c6ef215-7aa7-4dec-86c6-704fc530681a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:37.849565 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8c6ef215-7aa7-4dec-86c6-704fc530681a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a" status: 200 len: 1407 microversion: 2.54 time: 0.277680 Aug 04 17:15:37.852810 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2419/4893] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:15:37 2022] GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:15:38.519689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d8f505e3-2e21-4a1a-9813-7dbab3adceba tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:38.520541 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d8f505e3-2e21-4a1a-9813-7dbab3adceba tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:38.547639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8f505e3-2e21-4a1a-9813-7dbab3adceba tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:38.548512 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8f505e3-2e21-4a1a-9813-7dbab3adceba tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:38.549745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8f505e3-2e21-4a1a-9813-7dbab3adceba tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:38.553093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8f505e3-2e21-4a1a-9813-7dbab3adceba tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:38.553660 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8f505e3-2e21-4a1a-9813-7dbab3adceba tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:38.558329 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8f505e3-2e21-4a1a-9813-7dbab3adceba tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:38.661615 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dddb100b-9521-40bb-a4bf-0bed6f667275 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:38.662446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dddb100b-9521-40bb-a4bf-0bed6f667275 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:38.672622 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dddb100b-9521-40bb-a4bf-0bed6f667275 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:38.673283 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dddb100b-9521-40bb-a4bf-0bed6f667275 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:38.673995 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dddb100b-9521-40bb-a4bf-0bed6f667275 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:38.675116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dddb100b-9521-40bb-a4bf-0bed6f667275 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:38.676031 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dddb100b-9521-40bb-a4bf-0bed6f667275 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:38.677472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dddb100b-9521-40bb-a4bf-0bed6f667275 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:39.230174 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d8f505e3-2e21-4a1a-9813-7dbab3adceba tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:39.242337 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d8f505e3-2e21-4a1a-9813-7dbab3adceba tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 200 len: 1308 microversion: 2.1 time: 0.726089 Aug 04 17:15:39.259514 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2475/4894] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:38 2022] GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 1308 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:39.266081 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2f644fe3-42cb-4ce8-af15-15e0a445da3f tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:39.266983 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2f644fe3-42cb-4ce8-af15-15e0a445da3f tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:39.275561 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f644fe3-42cb-4ce8-af15-15e0a445da3f tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:39.276378 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f644fe3-42cb-4ce8-af15-15e0a445da3f tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:39.277046 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f644fe3-42cb-4ce8-af15-15e0a445da3f tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:39.278487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f644fe3-42cb-4ce8-af15-15e0a445da3f tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:39.279718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f644fe3-42cb-4ce8-af15-15e0a445da3f tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:39.280337 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f644fe3-42cb-4ce8-af15-15e0a445da3f tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:39.567159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2f644fe3-42cb-4ce8-af15-15e0a445da3f tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:39.588529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2f644fe3-42cb-4ce8-af15-15e0a445da3f tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:39.592338 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2f644fe3-42cb-4ce8-af15-15e0a445da3f tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:39.594500 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2f644fe3-42cb-4ce8-af15-15e0a445da3f tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a" status: 200 len: 1407 microversion: 2.54 time: 0.333360 Aug 04 17:15:39.595242 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2476/4895] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:15:39 2022] GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a => generated 1407 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:15:39.628479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dddb100b-9521-40bb-a4bf-0bed6f667275 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:39.639726 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dddb100b-9521-40bb-a4bf-0bed6f667275 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee" status: 200 len: 1367 microversion: 2.1 time: 0.981849 Aug 04 17:15:39.640423 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2420/4896] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:38 2022] GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee => generated 1367 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:15:40.267170 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2d52f492-9b61-4a8d-86fc-cadb2a4d08a2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:40.268699 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2d52f492-9b61-4a8d-86fc-cadb2a4d08a2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:40.280641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d52f492-9b61-4a8d-86fc-cadb2a4d08a2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:40.281884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d52f492-9b61-4a8d-86fc-cadb2a4d08a2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:40.282666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d52f492-9b61-4a8d-86fc-cadb2a4d08a2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:40.284930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d52f492-9b61-4a8d-86fc-cadb2a4d08a2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:40.286394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d52f492-9b61-4a8d-86fc-cadb2a4d08a2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:40.287078 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d52f492-9b61-4a8d-86fc-cadb2a4d08a2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:40.622117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cde6415d-2a85-42a9-869f-df7cfa956ecc tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:40.622926 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cde6415d-2a85-42a9-869f-df7cfa956ecc tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:40.669710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cde6415d-2a85-42a9-869f-df7cfa956ecc tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:40.672443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cde6415d-2a85-42a9-869f-df7cfa956ecc tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:40.676856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cde6415d-2a85-42a9-869f-df7cfa956ecc tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:40.682277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cde6415d-2a85-42a9-869f-df7cfa956ecc tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:40.683721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cde6415d-2a85-42a9-869f-df7cfa956ecc tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:40.686936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cde6415d-2a85-42a9-869f-df7cfa956ecc tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:40.848707 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:41.035817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cde6415d-2a85-42a9-869f-df7cfa956ecc tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:41.052561 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cde6415d-2a85-42a9-869f-df7cfa956ecc tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:41.054139 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cde6415d-2a85-42a9-869f-df7cfa956ecc tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:41.070856 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cde6415d-2a85-42a9-869f-df7cfa956ecc tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a" status: 200 len: 1413 microversion: 2.54 time: 0.451779 Aug 04 17:15:41.094131 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2421/4897] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:15:40 2022] GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a => generated 1413 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:15:41.106644 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5c49de41-7935-4815-a09f-c7552f08ebc0 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:41.108868 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5c49de41-7935-4815-a09f-c7552f08ebc0 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:41.118300 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c49de41-7935-4815-a09f-c7552f08ebc0 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:41.120304 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c49de41-7935-4815-a09f-c7552f08ebc0 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:41.121240 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c49de41-7935-4815-a09f-c7552f08ebc0 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:41.122448 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c49de41-7935-4815-a09f-c7552f08ebc0 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:41.123242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c49de41-7935-4815-a09f-c7552f08ebc0 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:41.123948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c49de41-7935-4815-a09f-c7552f08ebc0 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:41.325573 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2d52f492-9b61-4a8d-86fc-cadb2a4d08a2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:41.347136 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2d52f492-9b61-4a8d-86fc-cadb2a4d08a2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 200 len: 1308 microversion: 2.1 time: 1.086872 Aug 04 17:15:41.349248 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2477/4898] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:40 2022] GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 1308 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:41.362758 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-017dc101-57d7-4a74-aa18-b04575f09898 req-596d8bc4-5bb3-4fef-9a87-94c51c1b3dfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03515f0c-da1f-4541-82b2-6b83b1b2e594", "tag": "4e1c6c3d-0baa-4054-ac8f-d8eea01402f1"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:41.396658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-017dc101-57d7-4a74-aa18-b04575f09898 req-596d8bc4-5bb3-4fef-9a87-94c51c1b3dfd service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:41.397537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-017dc101-57d7-4a74-aa18-b04575f09898 req-596d8bc4-5bb3-4fef-9a87-94c51c1b3dfd service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:41.398104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-017dc101-57d7-4a74-aa18-b04575f09898 req-596d8bc4-5bb3-4fef-9a87-94c51c1b3dfd service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:41.415780 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-017dc101-57d7-4a74-aa18-b04575f09898 req-596d8bc4-5bb3-4fef-9a87-94c51c1b3dfd service nova] Creating event network-changed:4e1c6c3d-0baa-4054-ac8f-d8eea01402f1 for instance 03515f0c-da1f-4541-82b2-6b83b1b2e594 on n-h1-851359-3 Aug 04 17:15:41.426256 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-017dc101-57d7-4a74-aa18-b04575f09898 req-596d8bc4-5bb3-4fef-9a87-94c51c1b3dfd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072528 Aug 04 17:15:41.427748 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2478/4899] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:41.672055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5c49de41-7935-4815-a09f-c7552f08ebc0 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:41.701098 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5c49de41-7935-4815-a09f-c7552f08ebc0 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee" status: 200 len: 1367 microversion: 2.1 time: 0.591332 Aug 04 17:15:41.712191 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2422/4900] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:41 2022] GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee => generated 1367 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:42.111763 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c59dd9f8-a023-44bc-9d30-4020e00a9a3a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:42.121856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c59dd9f8-a023-44bc-9d30-4020e00a9a3a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:42.137752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c59dd9f8-a023-44bc-9d30-4020e00a9a3a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:42.138369 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c59dd9f8-a023-44bc-9d30-4020e00a9a3a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:42.138738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c59dd9f8-a023-44bc-9d30-4020e00a9a3a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:42.148871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c59dd9f8-a023-44bc-9d30-4020e00a9a3a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:42.150005 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c59dd9f8-a023-44bc-9d30-4020e00a9a3a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:42.158533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c59dd9f8-a023-44bc-9d30-4020e00a9a3a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:42.172369 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:42.282442 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c59dd9f8-a023-44bc-9d30-4020e00a9a3a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:42.297861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c59dd9f8-a023-44bc-9d30-4020e00a9a3a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:42.301448 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c59dd9f8-a023-44bc-9d30-4020e00a9a3a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:42.303501 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c59dd9f8-a023-44bc-9d30-4020e00a9a3a tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a" status: 200 len: 1398 microversion: 2.54 time: 0.205952 Aug 04 17:15:42.304870 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2479/4901] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:15:42 2022] GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a => generated 1398 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:15:42.333355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-69c20645-e33c-44f2-967e-abb79b35491e tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '.version_select at 0x7f1e5b409d30>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:42.371855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ae4c2410-2d34-47ce-ba6c-ff54eccb7c49 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:42.373054 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ae4c2410-2d34-47ce-ba6c-ff54eccb7c49 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:42.391173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:42.406518 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae4c2410-2d34-47ce-ba6c-ff54eccb7c49 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:42.407042 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae4c2410-2d34-47ce-ba6c-ff54eccb7c49 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:42.407493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae4c2410-2d34-47ce-ba6c-ff54eccb7c49 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:42.408224 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae4c2410-2d34-47ce-ba6c-ff54eccb7c49 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:42.413782 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-69c20645-e33c-44f2-967e-abb79b35491e tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-249898636" status: 204 len: 0 microversion: 2.54 time: 0.086193 Aug 04 17:15:42.414420 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2423/4902] 10.222.0.93 () {60 vars in 1316 bytes} [Thu Aug 4 17:15:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-249898636 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:15:42.425088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae4c2410-2d34-47ce-ba6c-ff54eccb7c49 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:42.427099 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae4c2410-2d34-47ce-ba6c-ff54eccb7c49 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:42.489327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4e7095e2-8048-40c1-9c8d-7bdfe916ce27 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:42.491158 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4e7095e2-8048-40c1-9c8d-7bdfe916ce27 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:42.506481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e7095e2-8048-40c1-9c8d-7bdfe916ce27 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:42.507237 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e7095e2-8048-40c1-9c8d-7bdfe916ce27 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:42.507850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e7095e2-8048-40c1-9c8d-7bdfe916ce27 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:42.508733 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e7095e2-8048-40c1-9c8d-7bdfe916ce27 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:42.509387 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e7095e2-8048-40c1-9c8d-7bdfe916ce27 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:42.510036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e7095e2-8048-40c1-9c8d-7bdfe916ce27 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:42.568692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4e7095e2-8048-40c1-9c8d-7bdfe916ce27 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:15:42.701503 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:42.733798 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4e7095e2-8048-40c1-9c8d-7bdfe916ce27 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a" status: 204 len: 0 microversion: 2.54 time: 0.304028 Aug 04 17:15:42.738580 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2424/4903] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Aug 4 17:15:42 2022] DELETE /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:15:42.749272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b599e4a1-9420-4480-a320-f45133c0f5c4 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:42.750336 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b599e4a1-9420-4480-a320-f45133c0f5c4 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:42.759747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b599e4a1-9420-4480-a320-f45133c0f5c4 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:42.761294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b599e4a1-9420-4480-a320-f45133c0f5c4 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:42.761962 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b599e4a1-9420-4480-a320-f45133c0f5c4 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:42.763099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b599e4a1-9420-4480-a320-f45133c0f5c4 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:42.765465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b599e4a1-9420-4480-a320-f45133c0f5c4 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:42.766172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b599e4a1-9420-4480-a320-f45133c0f5c4 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:42.920269 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ae4c2410-2d34-47ce-ba6c-ff54eccb7c49 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:42.933938 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ae4c2410-2d34-47ce-ba6c-ff54eccb7c49 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 200 len: 1308 microversion: 2.1 time: 0.565408 Aug 04 17:15:42.936428 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2480/4904] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:42 2022] GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 1308 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:42.949250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-496e53e8-d805-4c43-895d-4db35dbfdef5 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:42.950595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-496e53e8-d805-4c43-895d-4db35dbfdef5 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:42.967709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-496e53e8-d805-4c43-895d-4db35dbfdef5 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:42.968986 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-496e53e8-d805-4c43-895d-4db35dbfdef5 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:42.970156 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-496e53e8-d805-4c43-895d-4db35dbfdef5 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:42.972080 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-496e53e8-d805-4c43-895d-4db35dbfdef5 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:42.974055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-496e53e8-d805-4c43-895d-4db35dbfdef5 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:42.982595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-496e53e8-d805-4c43-895d-4db35dbfdef5 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:43.342193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-496e53e8-d805-4c43-895d-4db35dbfdef5 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:43.360354 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-496e53e8-d805-4c43-895d-4db35dbfdef5 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:43.363272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-496e53e8-d805-4c43-895d-4db35dbfdef5 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:43.365739 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-496e53e8-d805-4c43-895d-4db35dbfdef5 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a" status: 200 len: 1404 microversion: 2.54 time: 0.427720 Aug 04 17:15:43.384812 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2481/4905] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:15:42 2022] GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a => generated 1404 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:15:43.579292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b599e4a1-9420-4480-a320-f45133c0f5c4 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:43.590961 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b599e4a1-9420-4480-a320-f45133c0f5c4 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee" status: 200 len: 1367 microversion: 2.1 time: 0.850327 Aug 04 17:15:43.602715 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2425/4906] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:42 2022] GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee => generated 1367 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:43.956611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b0e86c59-f72f-4783-9e9b-6121e1b61d98 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:43.957322 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b0e86c59-f72f-4783-9e9b-6121e1b61d98 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:43.964759 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0e86c59-f72f-4783-9e9b-6121e1b61d98 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:43.966108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0e86c59-f72f-4783-9e9b-6121e1b61d98 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:43.966927 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0e86c59-f72f-4783-9e9b-6121e1b61d98 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:43.969257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0e86c59-f72f-4783-9e9b-6121e1b61d98 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:43.969965 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0e86c59-f72f-4783-9e9b-6121e1b61d98 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:43.970836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0e86c59-f72f-4783-9e9b-6121e1b61d98 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:44.214320 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b0e86c59-f72f-4783-9e9b-6121e1b61d98 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:44.223009 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b0e86c59-f72f-4783-9e9b-6121e1b61d98 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 200 len: 1308 microversion: 2.1 time: 0.270298 Aug 04 17:15:44.234523 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2482/4907] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:43 2022] GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 1308 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:44.395391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2f5b7040-23ec-44a2-8ce8-0784dd70d0e4 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:44.396607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2f5b7040-23ec-44a2-8ce8-0784dd70d0e4 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:44.404098 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f5b7040-23ec-44a2-8ce8-0784dd70d0e4 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:44.405046 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f5b7040-23ec-44a2-8ce8-0784dd70d0e4 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:44.405644 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f5b7040-23ec-44a2-8ce8-0784dd70d0e4 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:44.406551 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f5b7040-23ec-44a2-8ce8-0784dd70d0e4 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:44.407368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f5b7040-23ec-44a2-8ce8-0784dd70d0e4 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:44.408004 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f5b7040-23ec-44a2-8ce8-0784dd70d0e4 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:44.438399 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:44.517119 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2f5b7040-23ec-44a2-8ce8-0784dd70d0e4 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:44.529376 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2f5b7040-23ec-44a2-8ce8-0784dd70d0e4 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:44.530949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2f5b7040-23ec-44a2-8ce8-0784dd70d0e4 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:44.533388 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2f5b7040-23ec-44a2-8ce8-0784dd70d0e4 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a" status: 200 len: 1404 microversion: 2.54 time: 0.141843 Aug 04 17:15:44.534414 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2426/4908] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:15:44 2022] GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a => generated 1404 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:15:44.613856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6a396047-0856-431e-802c-b029b3659982 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:44.614736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6a396047-0856-431e-802c-b029b3659982 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:44.624953 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a396047-0856-431e-802c-b029b3659982 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:44.625851 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a396047-0856-431e-802c-b029b3659982 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:44.626542 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a396047-0856-431e-802c-b029b3659982 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:44.627511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a396047-0856-431e-802c-b029b3659982 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:44.628368 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a396047-0856-431e-802c-b029b3659982 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:44.629078 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a396047-0856-431e-802c-b029b3659982 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:44.860082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=10 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:45.198612 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6a396047-0856-431e-802c-b029b3659982 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:45.207006 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6a396047-0856-431e-802c-b029b3659982 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee" status: 200 len: 1367 microversion: 2.1 time: 0.598022 Aug 04 17:15:45.211372 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2483/4909] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:44 2022] GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee => generated 1367 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:45.244469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aa1a05ee-1c37-40dc-8a70-742d4c071b5d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:45.245139 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aa1a05ee-1c37-40dc-8a70-742d4c071b5d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:45.251840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa1a05ee-1c37-40dc-8a70-742d4c071b5d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:45.252343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa1a05ee-1c37-40dc-8a70-742d4c071b5d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:45.252800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa1a05ee-1c37-40dc-8a70-742d4c071b5d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:45.253692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa1a05ee-1c37-40dc-8a70-742d4c071b5d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:45.254007 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa1a05ee-1c37-40dc-8a70-742d4c071b5d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:45.254442 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa1a05ee-1c37-40dc-8a70-742d4c071b5d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:45.559408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-661dc844-b3fe-4295-acec-a3d43a06cad8 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:45.560075 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-661dc844-b3fe-4295-acec-a3d43a06cad8 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:45.577442 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-661dc844-b3fe-4295-acec-a3d43a06cad8 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:45.577954 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-661dc844-b3fe-4295-acec-a3d43a06cad8 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:45.578432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-661dc844-b3fe-4295-acec-a3d43a06cad8 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:45.579148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-661dc844-b3fe-4295-acec-a3d43a06cad8 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:45.585201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-661dc844-b3fe-4295-acec-a3d43a06cad8 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:45.585668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-661dc844-b3fe-4295-acec-a3d43a06cad8 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:45.743256 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-661dc844-b3fe-4295-acec-a3d43a06cad8 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:45.768824 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-661dc844-b3fe-4295-acec-a3d43a06cad8 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:45.778058 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-661dc844-b3fe-4295-acec-a3d43a06cad8 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '95f3e0b46bcc423493d73ff3262f4697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405d9c2091d34ceb8e14f7eeec941f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:45.779866 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-661dc844-b3fe-4295-acec-a3d43a06cad8 tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a" status: 200 len: 1404 microversion: 2.54 time: 0.224720 Aug 04 17:15:45.783328 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2484/4910] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:15:45 2022] GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a => generated 1404 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:15:45.799329 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-7df507ba-5195-428d-abdb-5dc43c7d627c req-b53053e9-d4f7-4c79-9c60-cb4c7ec9cee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50cacda1-31c5-4417-8013-9c603340c3ee", "name": "network-vif-plugged", "status": "completed", "tag": "e2dac34a-108c-4215-a062-121a43ee48ad"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:45.814164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-aa1a05ee-1c37-40dc-8a70-742d4c071b5d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:45.820076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7df507ba-5195-428d-abdb-5dc43c7d627c req-b53053e9-d4f7-4c79-9c60-cb4c7ec9cee7 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:45.820578 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7df507ba-5195-428d-abdb-5dc43c7d627c req-b53053e9-d4f7-4c79-9c60-cb4c7ec9cee7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:45.821200 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7df507ba-5195-428d-abdb-5dc43c7d627c req-b53053e9-d4f7-4c79-9c60-cb4c7ec9cee7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:45.842776 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aa1a05ee-1c37-40dc-8a70-742d4c071b5d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 200 len: 1308 microversion: 2.1 time: 0.599400 Aug 04 17:15:45.843410 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2427/4911] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:45 2022] GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 1308 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:45.844936 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-7df507ba-5195-428d-abdb-5dc43c7d627c req-b53053e9-d4f7-4c79-9c60-cb4c7ec9cee7 service nova] Creating event network-vif-plugged:e2dac34a-108c-4215-a062-121a43ee48ad for instance 50cacda1-31c5-4417-8013-9c603340c3ee on n-h2-851359-3 Aug 04 17:15:45.856309 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-7df507ba-5195-428d-abdb-5dc43c7d627c req-b53053e9-d4f7-4c79-9c60-cb4c7ec9cee7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065500 Aug 04 17:15:45.857526 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2485/4912] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:15:46.247588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e7ae5e17-ff03-4cbb-ad5b-c22e7d5f8b30 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:46.250976 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e7ae5e17-ff03-4cbb-ad5b-c22e7d5f8b30 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:46.266165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7ae5e17-ff03-4cbb-ad5b-c22e7d5f8b30 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:46.266986 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7ae5e17-ff03-4cbb-ad5b-c22e7d5f8b30 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:46.267989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7ae5e17-ff03-4cbb-ad5b-c22e7d5f8b30 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:46.269321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7ae5e17-ff03-4cbb-ad5b-c22e7d5f8b30 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:46.270578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7ae5e17-ff03-4cbb-ad5b-c22e7d5f8b30 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:46.271344 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7ae5e17-ff03-4cbb-ad5b-c22e7d5f8b30 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:46.808641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6191b341-064a-4a56-b84c-5766437f591b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:46.810015 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6191b341-064a-4a56-b84c-5766437f591b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] [instance: 0090a192-2abd-472c-b38c-5f129d82168a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:46.811717 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e7ae5e17-ff03-4cbb-ad5b-c22e7d5f8b30 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:46.819985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6191b341-064a-4a56-b84c-5766437f591b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:46.820486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6191b341-064a-4a56-b84c-5766437f591b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:46.820940 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6191b341-064a-4a56-b84c-5766437f591b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:46.821366 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e7ae5e17-ff03-4cbb-ad5b-c22e7d5f8b30 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee" status: 200 len: 1367 microversion: 2.1 time: 0.586976 Aug 04 17:15:46.821837 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6191b341-064a-4a56-b84c-5766437f591b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:46.822198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6191b341-064a-4a56-b84c-5766437f591b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:46.822635 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6191b341-064a-4a56-b84c-5766437f591b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:46.826169 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2428/4913] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:46 2022] GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee => generated 1367 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:46.854387 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-6191b341-064a-4a56-b84c-5766437f591b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] HTTP exception thrown: Instance 0090a192-2abd-472c-b38c-5f129d82168a could not be found. Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6191b341-064a-4a56-b84c-5766437f591b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Request method failure captured: Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a HTTP/1.1 Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_6XZ1cma9T2-N9fvi1lTlbd50fmmFmn0GA0hL8ugxHSGR3uEtOEPe-xzE2sBJG-x9JGgoputHOkdmtG_0FOue66USO05guFoR-amE85R7Q6irTp1-zFPCFmKqHMdeRUrnCqJ0k8Dept87m2fve3NnVCHGPW-Z67TD_fGwP_Kf0dr2g Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: X-Openstack-Nova-Api-Version: 2.54 Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 405d9c2091d34ceb8e14f7eeec941f43 Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerShowV254Test-1477290948 Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/405d9c2091d34ceb8e14f7eeec941f43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/405d9c2091d34ceb8e14f7eeec941f43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_405d9c2091d34ceb8e14f7eeec941f43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/405d9c2091d34ceb8e14f7eeec941f43"}]}] Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerShowV254Test-1477290948 Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 405d9c2091d34ceb8e14f7eeec941f43 Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerShowV254Test-1477290948 Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerShowV254Test-1477290948-project Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 95f3e0b46bcc423493d73ff3262f4697 Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerShowV254Test-1477290948-project Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 0090a192-2abd-472c-b38c-5f129d82168a could not be found. Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '0090a192-2abd-472c-b38c-5f129d82168a'} Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0090a192-2abd-472c-b38c-5f129d82168a could not be found. Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0090a192-2abd-472c-b38c-5f129d82168a could not be found. Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:15:46.856316 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:46.861190 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:15:46.861190 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:15:46.861190 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:15:46.861190 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:15:46.861190 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:15:46.861190 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0090a192-2abd-472c-b38c-5f129d82168a could not be found. Aug 04 17:15:46.861190 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:15:46.862840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6191b341-064a-4a56-b84c-5766437f591b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] Returning 404 to user: Instance 0090a192-2abd-472c-b38c-5f129d82168a could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:15:46.863909 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6191b341-064a-4a56-b84c-5766437f591b tempest-ServerShowV254Test-1477290948 tempest-ServerShowV254Test-1477290948-project] 10.222.0.93 "GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a" status: 404 len: 111 microversion: 2.54 time: 0.060613 Aug 04 17:15:46.864635 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2486/4914] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:15:46 2022] GET /compute/v2.1/servers/0090a192-2abd-472c-b38c-5f129d82168a => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:15:46.875896 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0868fdf2-0b87-4628-bd2d-92d57e581422 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:46.876597 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0868fdf2-0b87-4628-bd2d-92d57e581422 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:46.887223 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0868fdf2-0b87-4628-bd2d-92d57e581422 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:46.887997 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0868fdf2-0b87-4628-bd2d-92d57e581422 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:46.888592 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0868fdf2-0b87-4628-bd2d-92d57e581422 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:46.889528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0868fdf2-0b87-4628-bd2d-92d57e581422 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:46.892321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0868fdf2-0b87-4628-bd2d-92d57e581422 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:46.919629 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0868fdf2-0b87-4628-bd2d-92d57e581422 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:47.225902 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=14 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:47.655386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6d1b0b29-e3ec-4b59-a348-a6c1d38332d4 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:47.657642 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6d1b0b29-e3ec-4b59-a348-a6c1d38332d4 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:47.674732 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d1b0b29-e3ec-4b59-a348-a6c1d38332d4 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:47.675275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d1b0b29-e3ec-4b59-a348-a6c1d38332d4 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:47.675727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d1b0b29-e3ec-4b59-a348-a6c1d38332d4 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:47.676452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d1b0b29-e3ec-4b59-a348-a6c1d38332d4 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:47.676927 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d1b0b29-e3ec-4b59-a348-a6c1d38332d4 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:47.677365 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d1b0b29-e3ec-4b59-a348-a6c1d38332d4 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:47.741587 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6d1b0b29-e3ec-4b59-a348-a6c1d38332d4 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082614 Aug 04 17:15:47.745834 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2487/4915] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:15:47 2022] GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:15:47.765415 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-853a5b89-5625-4e91-9710-ceb2feda7ca7 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:47.767109 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-853a5b89-5625-4e91-9710-ceb2feda7ca7 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:47.790283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-853a5b89-5625-4e91-9710-ceb2feda7ca7 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:47.792618 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-853a5b89-5625-4e91-9710-ceb2feda7ca7 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:47.797545 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0868fdf2-0b87-4628-bd2d-92d57e581422 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:47.819659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-853a5b89-5625-4e91-9710-ceb2feda7ca7 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:47.827725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-853a5b89-5625-4e91-9710-ceb2feda7ca7 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:47.829797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-853a5b89-5625-4e91-9710-ceb2feda7ca7 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:47.832679 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0868fdf2-0b87-4628-bd2d-92d57e581422 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 200 len: 1308 microversion: 2.1 time: 0.960855 Aug 04 17:15:47.833920 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-853a5b89-5625-4e91-9710-ceb2feda7ca7 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:47.837862 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2429/4916] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:46 2022] GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 1308 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:47.870458 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5a0120fe-6d50-4dd0-953b-1633d15a4742 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:47.871514 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5a0120fe-6d50-4dd0-953b-1633d15a4742 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:47.910852 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a0120fe-6d50-4dd0-953b-1633d15a4742 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:47.912534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a0120fe-6d50-4dd0-953b-1633d15a4742 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:47.914204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a0120fe-6d50-4dd0-953b-1633d15a4742 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:47.919376 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a0120fe-6d50-4dd0-953b-1633d15a4742 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:47.920313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a0120fe-6d50-4dd0-953b-1633d15a4742 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:47.921063 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a0120fe-6d50-4dd0-953b-1633d15a4742 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:47.976128 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-853a5b89-5625-4e91-9710-ceb2feda7ca7 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba/os-volume_attachments/13f4b91d-6781-4d5c-8d02-e6fd9b41e854" status: 200 len: 194 microversion: 2.1 time: 0.222809 Aug 04 17:15:47.982490 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2488/4917] 10.222.0.93 () {58 vars in 1413 bytes} [Thu Aug 4 17:15:47 2022] GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba/os-volume_attachments/13f4b91d-6781-4d5c-8d02-e6fd9b41e854 => generated 194 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:15:48.867512 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f8508003-b819-4445-95b9-73c853aaed32 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:48.868268 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f8508003-b819-4445-95b9-73c853aaed32 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:48.887742 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8508003-b819-4445-95b9-73c853aaed32 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:48.891518 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8508003-b819-4445-95b9-73c853aaed32 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:48.892233 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8508003-b819-4445-95b9-73c853aaed32 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:48.894432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8508003-b819-4445-95b9-73c853aaed32 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:48.895139 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8508003-b819-4445-95b9-73c853aaed32 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:48.896311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f8508003-b819-4445-95b9-73c853aaed32 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:49.136492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5a0120fe-6d50-4dd0-953b-1633d15a4742 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:49.155694 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5a0120fe-6d50-4dd0-953b-1633d15a4742 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee" status: 200 len: 1367 microversion: 2.1 time: 1.302135 Aug 04 17:15:49.166174 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2430/4918] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:47 2022] GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee => generated 1367 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:49.563641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f8508003-b819-4445-95b9-73c853aaed32 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:49.576596 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f8508003-b819-4445-95b9-73c853aaed32 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 200 len: 1308 microversion: 2.1 time: 0.716264 Aug 04 17:15:49.580031 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2489/4919] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:48 2022] GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 1308 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:50.180990 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f45d2d89-208b-4a69-8bf2-328f277856c7 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:50.187263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f45d2d89-208b-4a69-8bf2-328f277856c7 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:50.205406 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f45d2d89-208b-4a69-8bf2-328f277856c7 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:50.209647 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f45d2d89-208b-4a69-8bf2-328f277856c7 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:50.210393 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f45d2d89-208b-4a69-8bf2-328f277856c7 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:50.211385 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f45d2d89-208b-4a69-8bf2-328f277856c7 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:50.213538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f45d2d89-208b-4a69-8bf2-328f277856c7 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:50.214243 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f45d2d89-208b-4a69-8bf2-328f277856c7 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:50.947497 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-64b2d57c-53f7-47f2-857a-066589e32c7e tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Action: 'create', calling method: .version_select at 0x7f1e5acbf820>, body: {"keypair": {"name": "tempest-keypair-1513265033", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYElUPpCUfVO8zPruBhuT7i1P6K8EfPTPdfRZ/ZSkUeeUNOjignOv2a3vMjJOfzGIY8A6fwFJlplt0DDUmRfTzABzTP/FgNIw07kczncnDZiBHHibHAcB1QxYiQZCBesg=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:50.966692 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-64b2d57c-53f7-47f2-857a-066589e32c7e tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Getting quotas for project 95a334b70c2e46c087201aa6787accba. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:15:50.973825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-64b2d57c-53f7-47f2-857a-066589e32c7e tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Getting quotas for user 3544002a75c946cda1586cd21f999aa0 and project 95a334b70c2e46c087201aa6787accba. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:15:51.003766 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-64b2d57c-53f7-47f2-857a-066589e32c7e tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.652148 Aug 04 17:15:51.005042 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2490/4920] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:15:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:51.011855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-63dc4bcf-c246-4b49-9158-a1b2b453479d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:51.013023 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-63dc4bcf-c246-4b49-9158-a1b2b453479d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:51.024999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63dc4bcf-c246-4b49-9158-a1b2b453479d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:51.027183 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63dc4bcf-c246-4b49-9158-a1b2b453479d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:51.028295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63dc4bcf-c246-4b49-9158-a1b2b453479d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:51.029603 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63dc4bcf-c246-4b49-9158-a1b2b453479d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:51.031402 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63dc4bcf-c246-4b49-9158-a1b2b453479d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:51.032127 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63dc4bcf-c246-4b49-9158-a1b2b453479d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:51.045894 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f45d2d89-208b-4a69-8bf2-328f277856c7 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:51.075423 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f45d2d89-208b-4a69-8bf2-328f277856c7 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee" status: 200 len: 1557 microversion: 2.1 time: 0.897543 Aug 04 17:15:51.078717 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2431/4921] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:50 2022] GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee => generated 1557 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:51.101758 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-33e190e6-acbb-481a-8ce0-86829453ed43 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b1288c3-4110-4905-836a-126b5081349f"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:51.112596 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-33e190e6-acbb-481a-8ce0-86829453ed43 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:51.135046 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33e190e6-acbb-481a-8ce0-86829453ed43 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:51.138916 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33e190e6-acbb-481a-8ce0-86829453ed43 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:51.140643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33e190e6-acbb-481a-8ce0-86829453ed43 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:51.144137 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33e190e6-acbb-481a-8ce0-86829453ed43 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:51.144981 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33e190e6-acbb-481a-8ce0-86829453ed43 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:51.147386 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33e190e6-acbb-481a-8ce0-86829453ed43 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:51.199540 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:15:51.717757 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-33e190e6-acbb-481a-8ce0-86829453ed43 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "POST /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.630751 Aug 04 17:15:51.734999 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2432/4922] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Aug 4 17:15:51 2022] POST /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba/os-volume_attachments => generated 194 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:51.753267 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a9869229-ea59-42e0-9e08-c68998a1d04f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:51.759809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a9869229-ea59-42e0-9e08-c68998a1d04f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:51.773012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9869229-ea59-42e0-9e08-c68998a1d04f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:51.774884 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9869229-ea59-42e0-9e08-c68998a1d04f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:51.777057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9869229-ea59-42e0-9e08-c68998a1d04f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:51.780057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9869229-ea59-42e0-9e08-c68998a1d04f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:51.780869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9869229-ea59-42e0-9e08-c68998a1d04f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:51.781570 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9869229-ea59-42e0-9e08-c68998a1d04f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:51.980723 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a9869229-ea59-42e0-9e08-c68998a1d04f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.244160 Aug 04 17:15:51.995413 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2433/4923] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Aug 4 17:15:51 2022] GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee/os-interface => generated 285 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:52.108420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-9261669d-050e-4846-82f7-ce9b17bbdbe2 req-032af7b0-8950-4bf9-858d-b9275a55ebe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03515f0c-da1f-4541-82b2-6b83b1b2e594", "name": "network-vif-plugged", "status": "completed", "tag": "4e1c6c3d-0baa-4054-ac8f-d8eea01402f1"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:52.130739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9261669d-050e-4846-82f7-ce9b17bbdbe2 req-032af7b0-8950-4bf9-858d-b9275a55ebe8 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:52.131563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9261669d-050e-4846-82f7-ce9b17bbdbe2 req-032af7b0-8950-4bf9-858d-b9275a55ebe8 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:52.132204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9261669d-050e-4846-82f7-ce9b17bbdbe2 req-032af7b0-8950-4bf9-858d-b9275a55ebe8 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:52.170266 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-9261669d-050e-4846-82f7-ce9b17bbdbe2 req-032af7b0-8950-4bf9-858d-b9275a55ebe8 service nova] Creating event network-vif-plugged:4e1c6c3d-0baa-4054-ac8f-d8eea01402f1 for instance 03515f0c-da1f-4541-82b2-6b83b1b2e594 on n-h1-851359-3 Aug 04 17:15:52.184405 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-9261669d-050e-4846-82f7-ce9b17bbdbe2 req-032af7b0-8950-4bf9-858d-b9275a55ebe8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080324 Aug 04 17:15:52.185423 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2434/4924] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:15:52.191832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-63dc4bcf-c246-4b49-9158-a1b2b453479d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:52.200617 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-63dc4bcf-c246-4b49-9158-a1b2b453479d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 200 len: 1308 microversion: 2.1 time: 1.194263 Aug 04 17:15:52.204410 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2491/4925] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:51 2022] GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 1308 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:53.229167 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2d0dfecd-3284-463a-9b7b-8e45698d8d93 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:53.230004 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2d0dfecd-3284-463a-9b7b-8e45698d8d93 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:53.248445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d0dfecd-3284-463a-9b7b-8e45698d8d93 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:53.249008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d0dfecd-3284-463a-9b7b-8e45698d8d93 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:53.249539 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d0dfecd-3284-463a-9b7b-8e45698d8d93 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:53.253415 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d0dfecd-3284-463a-9b7b-8e45698d8d93 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:53.253924 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d0dfecd-3284-463a-9b7b-8e45698d8d93 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:53.254437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d0dfecd-3284-463a-9b7b-8e45698d8d93 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:56.141256 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2d0dfecd-3284-463a-9b7b-8e45698d8d93 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:56.151505 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2d0dfecd-3284-463a-9b7b-8e45698d8d93 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 200 len: 1308 microversion: 2.1 time: 2.927868 Aug 04 17:15:56.156952 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2435/4926] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:53 2022] GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 1308 bytes in 2935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:57.177627 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-48bff8d6-1b17-43e9-aa56-541dcd4f3b75 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:57.178226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-48bff8d6-1b17-43e9-aa56-541dcd4f3b75 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:57.189855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-48bff8d6-1b17-43e9-aa56-541dcd4f3b75 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:57.193908 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-48bff8d6-1b17-43e9-aa56-541dcd4f3b75 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:57.194435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-48bff8d6-1b17-43e9-aa56-541dcd4f3b75 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:57.195195 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-48bff8d6-1b17-43e9-aa56-541dcd4f3b75 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:57.195681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-48bff8d6-1b17-43e9-aa56-541dcd4f3b75 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:57.196128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-48bff8d6-1b17-43e9-aa56-541dcd4f3b75 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:57.809045 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-48bff8d6-1b17-43e9-aa56-541dcd4f3b75 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:57.817459 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-48bff8d6-1b17-43e9-aa56-541dcd4f3b75 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 200 len: 1490 microversion: 2.1 time: 0.644502 Aug 04 17:15:57.818715 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2492/4927] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:57 2022] GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 1490 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:15:57.843830 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9c20c5d4-adb3-494f-9bff-9b44fec78a74 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-94266911"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:15:57.846563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9c20c5d4-adb3-494f-9bff-9b44fec78a74 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:57.884025 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c20c5d4-adb3-494f-9bff-9b44fec78a74 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:57.891341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c20c5d4-adb3-494f-9bff-9b44fec78a74 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:57.892765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c20c5d4-adb3-494f-9bff-9b44fec78a74 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:57.894528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c20c5d4-adb3-494f-9bff-9b44fec78a74 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:57.899494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c20c5d4-adb3-494f-9bff-9b44fec78a74 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:57.901502 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c20c5d4-adb3-494f-9bff-9b44fec78a74 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:58.037717 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9c20c5d4-adb3-494f-9bff-9b44fec78a74 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "PUT /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 200 len: 1074 microversion: 2.1 time: 0.198069 Aug 04 17:15:58.040733 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2436/4928] 10.222.0.93 () {60 vars in 1256 bytes} [Thu Aug 4 17:15:57 2022] PUT /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 1074 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:58.064861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d5c7b984-1bfb-46e3-857e-0e23dd6cd53e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:58.065909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d5c7b984-1bfb-46e3-857e-0e23dd6cd53e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:58.082083 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d5c7b984-1bfb-46e3-857e-0e23dd6cd53e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:58.083190 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d5c7b984-1bfb-46e3-857e-0e23dd6cd53e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:58.083880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d5c7b984-1bfb-46e3-857e-0e23dd6cd53e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:58.084855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d5c7b984-1bfb-46e3-857e-0e23dd6cd53e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:58.085563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d5c7b984-1bfb-46e3-857e-0e23dd6cd53e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:58.086268 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d5c7b984-1bfb-46e3-857e-0e23dd6cd53e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:59.621598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d5c7b984-1bfb-46e3-857e-0e23dd6cd53e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:15:59.652700 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d5c7b984-1bfb-46e3-857e-0e23dd6cd53e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 200 len: 1500 microversion: 2.1 time: 1.593512 Aug 04 17:15:59.653594 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2493/4929] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:58 2022] GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 1500 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:15:59.676716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-81380628-3b52-4150-9802-5ecbab901103 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:15:59.677336 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-81380628-3b52-4150-9802-5ecbab901103 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:15:59.696434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81380628-3b52-4150-9802-5ecbab901103 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:59.696935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81380628-3b52-4150-9802-5ecbab901103 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:59.697920 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81380628-3b52-4150-9802-5ecbab901103 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:15:59.710158 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81380628-3b52-4150-9802-5ecbab901103 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:15:59.710954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81380628-3b52-4150-9802-5ecbab901103 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:15:59.711850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81380628-3b52-4150-9802-5ecbab901103 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:00.143178 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-c71728c7-16f8-4587-b873-8c63eb6681ea req-509548df-e84e-4428-a1d4-3673dca706cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50cacda1-31c5-4417-8013-9c603340c3ee", "tag": "e2dac34a-108c-4215-a062-121a43ee48ad"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:00.161751 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c71728c7-16f8-4587-b873-8c63eb6681ea req-509548df-e84e-4428-a1d4-3673dca706cd service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:00.162010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c71728c7-16f8-4587-b873-8c63eb6681ea req-509548df-e84e-4428-a1d4-3673dca706cd service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:00.162531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c71728c7-16f8-4587-b873-8c63eb6681ea req-509548df-e84e-4428-a1d4-3673dca706cd service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:00.213676 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-c71728c7-16f8-4587-b873-8c63eb6681ea req-509548df-e84e-4428-a1d4-3673dca706cd service nova] Creating event network-changed:e2dac34a-108c-4215-a062-121a43ee48ad for instance 50cacda1-31c5-4417-8013-9c603340c3ee on n-h2-851359-3 Aug 04 17:16:00.242325 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-c71728c7-16f8-4587-b873-8c63eb6681ea req-509548df-e84e-4428-a1d4-3673dca706cd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.346517 Aug 04 17:16:00.245782 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2494/4930] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:16:00.352296 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-81380628-3b52-4150-9802-5ecbab901103 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:00.360730 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-81380628-3b52-4150-9802-5ecbab901103 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 200 len: 1500 microversion: 2.1 time: 0.687881 Aug 04 17:16:00.361337 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2437/4931] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:15:59 2022] GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 1500 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:00.398343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b352db1e-2035-4e71-a46d-16f857d37016 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:00.416552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b352db1e-2035-4e71-a46d-16f857d37016 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:00.417387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b352db1e-2035-4e71-a46d-16f857d37016 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:00.418501 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b352db1e-2035-4e71-a46d-16f857d37016 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:00.493123 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b352db1e-2035-4e71-a46d-16f857d37016 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Going to try to stop instance {{(pid=131043) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 17:16:00.591181 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b352db1e-2035-4e71-a46d-16f857d37016 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "POST /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594/action" status: 202 len: 0 microversion: 2.1 time: 0.202649 Aug 04 17:16:00.597452 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2495/4932] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:16:00 2022] POST /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:16:00.601347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-784e161a-a3f5-4361-9f92-97dadcee2fa8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:00.602006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-784e161a-a3f5-4361-9f92-97dadcee2fa8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:00.609263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-784e161a-a3f5-4361-9f92-97dadcee2fa8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:00.609851 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-784e161a-a3f5-4361-9f92-97dadcee2fa8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:00.624157 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-784e161a-a3f5-4361-9f92-97dadcee2fa8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:00.628739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-784e161a-a3f5-4361-9f92-97dadcee2fa8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:00.631101 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-784e161a-a3f5-4361-9f92-97dadcee2fa8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:00.633077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-784e161a-a3f5-4361-9f92-97dadcee2fa8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:01.222860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-784e161a-a3f5-4361-9f92-97dadcee2fa8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:01.245843 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-784e161a-a3f5-4361-9f92-97dadcee2fa8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 200 len: 1510 microversion: 2.1 time: 0.648450 Aug 04 17:16:01.266748 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2438/4933] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:00 2022] GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 1510 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:16:01.482747 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5b01939b-369e-46df-8302-d3412953f376 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-547604382", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "975bc596-b53b-4d1f-9835-ba5a52960910"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1881716587", "security_groups": [{"name": "tempest-secgroup-smoke-1788312789"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:01.509644 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=4 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:01.734146 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-5b01939b-369e-46df-8302-d3412953f376 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] validate_networks() for [('975bc596-b53b-4d1f-9835-ba5a52960910', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:16:02.287254 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cc68cc79-d1eb-4c15-90dc-aeb55ed002ca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:02.288029 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cc68cc79-d1eb-4c15-90dc-aeb55ed002ca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:02.315853 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc68cc79-d1eb-4c15-90dc-aeb55ed002ca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:02.318937 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc68cc79-d1eb-4c15-90dc-aeb55ed002ca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:02.319520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc68cc79-d1eb-4c15-90dc-aeb55ed002ca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:02.320399 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc68cc79-d1eb-4c15-90dc-aeb55ed002ca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:02.322829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc68cc79-d1eb-4c15-90dc-aeb55ed002ca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:02.323570 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc68cc79-d1eb-4c15-90dc-aeb55ed002ca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:03.088244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cc68cc79-d1eb-4c15-90dc-aeb55ed002ca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:03.098199 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cc68cc79-d1eb-4c15-90dc-aeb55ed002ca tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 200 len: 1510 microversion: 2.1 time: 0.815055 Aug 04 17:16:03.107265 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2439/4934] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:02 2022] GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 1510 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:03.186560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5b01939b-369e-46df-8302-d3412953f376 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:16:03.187158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5b01939b-369e-46df-8302-d3412953f376 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:16:03.187544 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5b01939b-369e-46df-8302-d3412953f376 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:16:03.187970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5b01939b-369e-46df-8302-d3412953f376 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:16:03.188402 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5b01939b-369e-46df-8302-d3412953f376 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:16:03.209527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b01939b-369e-46df-8302-d3412953f376 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:03.210166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b01939b-369e-46df-8302-d3412953f376 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:03.210641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b01939b-369e-46df-8302-d3412953f376 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:03.211466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b01939b-369e-46df-8302-d3412953f376 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:03.211939 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b01939b-369e-46df-8302-d3412953f376 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:03.212386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b01939b-369e-46df-8302-d3412953f376 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:03.263592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-5b01939b-369e-46df-8302-d3412953f376 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Getting quotas for project 9c69a3e46122413f928fe20a76b0cf94. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:16:03.272277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-5b01939b-369e-46df-8302-d3412953f376 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Getting quotas for user f27a58cf36934daeabff9e35c05d4c19 and project 9c69a3e46122413f928fe20a76b0cf94. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:16:03.307494 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5b01939b-369e-46df-8302-d3412953f376 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:16:03.315715 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5b01939b-369e-46df-8302-d3412953f376 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:16:03.432736 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5b01939b-369e-46df-8302-d3412953f376 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.951473 Aug 04 17:16:03.433812 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2496/4935] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:16:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 1957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:16:03.444973 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ee2eefc3-87d2-4a56-bced-41d1974bd3bd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:03.445357 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ee2eefc3-87d2-4a56-bced-41d1974bd3bd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:03.638955 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ee2eefc3-87d2-4a56-bced-41d1974bd3bd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:03.642716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-65185d55-742a-4cbc-b0ad-ec5310455204 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-2101610714", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:03.647614 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ee2eefc3-87d2-4a56-bced-41d1974bd3bd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1266 microversion: 2.1 time: 0.206812 Aug 04 17:16:03.661165 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2440/4936] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:03 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:03.751409 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-65185d55-742a-4cbc-b0ad-ec5310455204 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] validate_networks() for [('08d140c2-1440-4b11-ba32-8e51799b617e', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:16:04.120806 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dd9b5f47-137f-47b4-93bc-43202a41cd71 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:04.121994 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dd9b5f47-137f-47b4-93bc-43202a41cd71 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:04.139867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd9b5f47-137f-47b4-93bc-43202a41cd71 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:04.147854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd9b5f47-137f-47b4-93bc-43202a41cd71 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:04.151147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd9b5f47-137f-47b4-93bc-43202a41cd71 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:04.152433 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd9b5f47-137f-47b4-93bc-43202a41cd71 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:04.153149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd9b5f47-137f-47b4-93bc-43202a41cd71 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:04.154750 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd9b5f47-137f-47b4-93bc-43202a41cd71 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:04.665367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dd9b5f47-137f-47b4-93bc-43202a41cd71 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:04.710586 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dd9b5f47-137f-47b4-93bc-43202a41cd71 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 200 len: 1510 microversion: 2.1 time: 0.592679 Aug 04 17:16:04.715045 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2441/4937] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:04 2022] GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 1510 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:16:04.727683 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-29e1de8d-5079-4814-ba0c-0b66dc149887 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:04.728733 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-29e1de8d-5079-4814-ba0c-0b66dc149887 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:04.748105 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29e1de8d-5079-4814-ba0c-0b66dc149887 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:04.749033 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29e1de8d-5079-4814-ba0c-0b66dc149887 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:04.750774 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29e1de8d-5079-4814-ba0c-0b66dc149887 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:04.751738 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29e1de8d-5079-4814-ba0c-0b66dc149887 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:04.753545 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29e1de8d-5079-4814-ba0c-0b66dc149887 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:04.757096 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29e1de8d-5079-4814-ba0c-0b66dc149887 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:05.061652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-29e1de8d-5079-4814-ba0c-0b66dc149887 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:05.080766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-65185d55-742a-4cbc-b0ad-ec5310455204 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:16:05.081346 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-65185d55-742a-4cbc-b0ad-ec5310455204 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:16:05.082284 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-65185d55-742a-4cbc-b0ad-ec5310455204 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:16:05.082805 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-65185d55-742a-4cbc-b0ad-ec5310455204 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:16:05.084076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-65185d55-742a-4cbc-b0ad-ec5310455204 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:16:05.093509 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-29e1de8d-5079-4814-ba0c-0b66dc149887 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1270 microversion: 2.1 time: 0.376889 Aug 04 17:16:05.094940 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2442/4938] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:04 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1270 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:05.104116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65185d55-742a-4cbc-b0ad-ec5310455204 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:05.104793 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65185d55-742a-4cbc-b0ad-ec5310455204 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:05.105441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65185d55-742a-4cbc-b0ad-ec5310455204 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:05.106764 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65185d55-742a-4cbc-b0ad-ec5310455204 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:05.109921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65185d55-742a-4cbc-b0ad-ec5310455204 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:05.110712 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65185d55-742a-4cbc-b0ad-ec5310455204 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:05.191560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-65185d55-742a-4cbc-b0ad-ec5310455204 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Getting quotas for project 98a0bf705e624fe796abcfd60aac6061. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:16:05.206751 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-65185d55-742a-4cbc-b0ad-ec5310455204 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Getting quotas for user 4aad71e7276844ae802ce34cb4231be3 and project 98a0bf705e624fe796abcfd60aac6061. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:16:05.251941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-65185d55-742a-4cbc-b0ad-ec5310455204 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:16:05.255679 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-65185d55-742a-4cbc-b0ad-ec5310455204 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:16:05.381498 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-65185d55-742a-4cbc-b0ad-ec5310455204 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.899431 Aug 04 17:16:05.382779 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2497/4939] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:16:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 1901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:16:05.394529 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ce070412-cc07-466d-9150-77346c925885 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:05.395305 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ce070412-cc07-466d-9150-77346c925885 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:05.646454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ce070412-cc07-466d-9150-77346c925885 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:05.646454 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ce070412-cc07-466d-9150-77346c925885 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1223 microversion: 2.1 time: 0.255476 Aug 04 17:16:05.655255 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2443/4940] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:05 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1223 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:16:05.739054 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-03ac7e2a-0a72-4435-aa21-e00246853bb5 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:05.740278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-03ac7e2a-0a72-4435-aa21-e00246853bb5 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:05.756508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03ac7e2a-0a72-4435-aa21-e00246853bb5 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:05.757020 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03ac7e2a-0a72-4435-aa21-e00246853bb5 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:05.757824 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03ac7e2a-0a72-4435-aa21-e00246853bb5 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:05.759964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03ac7e2a-0a72-4435-aa21-e00246853bb5 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:05.760511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03ac7e2a-0a72-4435-aa21-e00246853bb5 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:05.760964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03ac7e2a-0a72-4435-aa21-e00246853bb5 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:06.065445 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-03ac7e2a-0a72-4435-aa21-e00246853bb5 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:06.088692 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-03ac7e2a-0a72-4435-aa21-e00246853bb5 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 200 len: 1510 microversion: 2.1 time: 0.353317 Aug 04 17:16:06.090019 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2498/4941] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:05 2022] GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 1510 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:06.115140 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6ee1fcac-a6e9-463f-aa01-05eaa694e3b2 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:06.115770 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6ee1fcac-a6e9-463f-aa01-05eaa694e3b2 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:06.129260 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ee1fcac-a6e9-463f-aa01-05eaa694e3b2 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:06.130119 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ee1fcac-a6e9-463f-aa01-05eaa694e3b2 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:06.130856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ee1fcac-a6e9-463f-aa01-05eaa694e3b2 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:06.132114 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ee1fcac-a6e9-463f-aa01-05eaa694e3b2 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:06.137188 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ee1fcac-a6e9-463f-aa01-05eaa694e3b2 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:06.138150 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ee1fcac-a6e9-463f-aa01-05eaa694e3b2 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:06.197766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-03ac7e2a-0a72-4435-aa21-e00246853bb5 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:06.198789 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-03ac7e2a-0a72-4435-aa21-e00246853bb5 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001945 Aug 04 17:16:06.199420 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2499/4942] 10.222.0.93 () {56 vars in 886 bytes} [Thu Aug 4 17:16:06 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 04 17:16:06.273819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6ee1fcac-a6e9-463f-aa01-05eaa694e3b2 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:06.282805 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6ee1fcac-a6e9-463f-aa01-05eaa694e3b2 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1324 microversion: 2.1 time: 0.171423 Aug 04 17:16:06.297346 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2444/4943] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:06 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1324 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:06.671011 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-83293300-f677-4f8f-ab67-998a1512ec57 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:06.671647 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-83293300-f677-4f8f-ab67-998a1512ec57 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:06.688575 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83293300-f677-4f8f-ab67-998a1512ec57 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:06.689795 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83293300-f677-4f8f-ab67-998a1512ec57 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:06.690781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83293300-f677-4f8f-ab67-998a1512ec57 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:06.696366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83293300-f677-4f8f-ab67-998a1512ec57 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:06.699708 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83293300-f677-4f8f-ab67-998a1512ec57 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:06.702383 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83293300-f677-4f8f-ab67-998a1512ec57 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:06.721065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:06.875012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-83293300-f677-4f8f-ab67-998a1512ec57 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:06.883372 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-83293300-f677-4f8f-ab67-998a1512ec57 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1219 microversion: 2.1 time: 0.216660 Aug 04 17:16:06.883976 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2500/4944] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:06 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1219 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:07.110860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0097c745-c058-4ee4-a0f6-822a95dad4e1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:07.111589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0097c745-c058-4ee4-a0f6-822a95dad4e1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:07.118958 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0097c745-c058-4ee4-a0f6-822a95dad4e1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:07.120649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0097c745-c058-4ee4-a0f6-822a95dad4e1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:07.121537 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0097c745-c058-4ee4-a0f6-822a95dad4e1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:07.122942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0097c745-c058-4ee4-a0f6-822a95dad4e1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:07.124020 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0097c745-c058-4ee4-a0f6-822a95dad4e1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:07.124976 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0097c745-c058-4ee4-a0f6-822a95dad4e1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:07.303620 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cfbba349-3b88-471e-af3d-4823b082a13f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:07.304249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cfbba349-3b88-471e-af3d-4823b082a13f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:07.316416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cfbba349-3b88-471e-af3d-4823b082a13f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:07.317175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cfbba349-3b88-471e-af3d-4823b082a13f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:07.318367 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cfbba349-3b88-471e-af3d-4823b082a13f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:07.319296 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cfbba349-3b88-471e-af3d-4823b082a13f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:07.320813 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cfbba349-3b88-471e-af3d-4823b082a13f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:07.322537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cfbba349-3b88-471e-af3d-4823b082a13f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:07.436030 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cfbba349-3b88-471e-af3d-4823b082a13f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:07.457422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0097c745-c058-4ee4-a0f6-822a95dad4e1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:07.462006 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cfbba349-3b88-471e-af3d-4823b082a13f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1324 microversion: 2.1 time: 0.151943 Aug 04 17:16:07.467629 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0097c745-c058-4ee4-a0f6-822a95dad4e1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 200 len: 1510 microversion: 2.1 time: 0.360667 Aug 04 17:16:07.469277 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2501/4945] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:07 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1324 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:07.498465 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2445/4946] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:07 2022] GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 1510 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:07.907064 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-877268f8-cc50-49cd-bebd-a9775d998e06 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:07.907702 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-877268f8-cc50-49cd-bebd-a9775d998e06 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:07.920804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-877268f8-cc50-49cd-bebd-a9775d998e06 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:07.921312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-877268f8-cc50-49cd-bebd-a9775d998e06 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:07.922340 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-877268f8-cc50-49cd-bebd-a9775d998e06 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:07.923091 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-877268f8-cc50-49cd-bebd-a9775d998e06 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:07.923546 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-877268f8-cc50-49cd-bebd-a9775d998e06 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:07.923985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-877268f8-cc50-49cd-bebd-a9775d998e06 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:08.138797 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4210c100-6ecf-4da1-8fef-aaaa82c9cd92 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:08.139245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4210c100-6ecf-4da1-8fef-aaaa82c9cd92 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:08.171979 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4210c100-6ecf-4da1-8fef-aaaa82c9cd92 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:08.172397 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4210c100-6ecf-4da1-8fef-aaaa82c9cd92 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:08.172860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4210c100-6ecf-4da1-8fef-aaaa82c9cd92 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:08.185188 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4210c100-6ecf-4da1-8fef-aaaa82c9cd92 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:08.185815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4210c100-6ecf-4da1-8fef-aaaa82c9cd92 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:08.186416 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4210c100-6ecf-4da1-8fef-aaaa82c9cd92 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:08.309285 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4210c100-6ecf-4da1-8fef-aaaa82c9cd92 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d/os-volume_attachments/4925f9db-0493-477b-b82e-0ec04b19368c" status: 200 len: 194 microversion: 2.20 time: 0.176513 Aug 04 17:16:08.316431 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2446/4947] 10.222.0.93 () {60 vars in 1454 bytes} [Thu Aug 4 17:16:08 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d/os-volume_attachments/4925f9db-0493-477b-b82e-0ec04b19368c => generated 194 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:16:08.336450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-877268f8-cc50-49cd-bebd-a9775d998e06 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:08.350945 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-877268f8-cc50-49cd-bebd-a9775d998e06 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1281 microversion: 2.1 time: 0.448506 Aug 04 17:16:08.352952 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2502/4948] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:07 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1281 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:08.475043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cb691995-c154-4e4f-bed8-30eb808ec484 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:08.475563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cb691995-c154-4e4f-bed8-30eb808ec484 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:08.489672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e24981ad-a7a8-47ac-bcfb-15a596b63bb1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:08.490332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e24981ad-a7a8-47ac-bcfb-15a596b63bb1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:08.500025 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb691995-c154-4e4f-bed8-30eb808ec484 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:08.503612 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e24981ad-a7a8-47ac-bcfb-15a596b63bb1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:08.504221 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb691995-c154-4e4f-bed8-30eb808ec484 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:08.504913 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e24981ad-a7a8-47ac-bcfb-15a596b63bb1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:08.505153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb691995-c154-4e4f-bed8-30eb808ec484 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:08.506623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb691995-c154-4e4f-bed8-30eb808ec484 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:08.507307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e24981ad-a7a8-47ac-bcfb-15a596b63bb1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:08.508459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e24981ad-a7a8-47ac-bcfb-15a596b63bb1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:08.508614 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb691995-c154-4e4f-bed8-30eb808ec484 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:08.510499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e24981ad-a7a8-47ac-bcfb-15a596b63bb1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:08.510962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e24981ad-a7a8-47ac-bcfb-15a596b63bb1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:08.511331 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb691995-c154-4e4f-bed8-30eb808ec484 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:08.720409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-cb691995-c154-4e4f-bed8-30eb808ec484 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lazy-loading 'services' on Instance uuid 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:16:08.865466 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cb691995-c154-4e4f-bed8-30eb808ec484 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d/os-volume_attachments/4925f9db-0493-477b-b82e-0ec04b19368c" status: 202 len: 0 microversion: 2.20 time: 0.392927 Aug 04 17:16:08.867008 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2447/4949] 10.222.0.93 () {60 vars in 1457 bytes} [Thu Aug 4 17:16:08 2022] DELETE /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d/os-volume_attachments/4925f9db-0493-477b-b82e-0ec04b19368c => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:16:08.874561 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fde13b1b-76b1-4bac-ab1c-019c6a520465 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:08.875954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fde13b1b-76b1-4bac-ab1c-019c6a520465 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:08.916943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fde13b1b-76b1-4bac-ab1c-019c6a520465 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:08.917810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fde13b1b-76b1-4bac-ab1c-019c6a520465 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:08.922415 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fde13b1b-76b1-4bac-ab1c-019c6a520465 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:08.924440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fde13b1b-76b1-4bac-ab1c-019c6a520465 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:08.928644 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fde13b1b-76b1-4bac-ab1c-019c6a520465 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:08.930012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fde13b1b-76b1-4bac-ab1c-019c6a520465 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:09.340813 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e24981ad-a7a8-47ac-bcfb-15a596b63bb1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:09.349111 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e24981ad-a7a8-47ac-bcfb-15a596b63bb1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1392 microversion: 2.1 time: 0.863554 Aug 04 17:16:09.352883 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2503/4950] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:08 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1392 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:09.366193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3fa6a099-b11d-4eb6-b69f-66b9c70ca53d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:09.368674 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3fa6a099-b11d-4eb6-b69f-66b9c70ca53d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:09.380997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3fa6a099-b11d-4eb6-b69f-66b9c70ca53d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:09.383665 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3fa6a099-b11d-4eb6-b69f-66b9c70ca53d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:09.384272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3fa6a099-b11d-4eb6-b69f-66b9c70ca53d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:09.385657 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3fa6a099-b11d-4eb6-b69f-66b9c70ca53d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:09.398719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3fa6a099-b11d-4eb6-b69f-66b9c70ca53d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:09.399298 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3fa6a099-b11d-4eb6-b69f-66b9c70ca53d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:09.455165 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3fa6a099-b11d-4eb6-b69f-66b9c70ca53d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.100873 Aug 04 17:16:09.461357 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2504/4951] 10.222.0.93 () {60 vars in 1343 bytes} [Thu Aug 4 17:16:09 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:16:09.469016 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9771f0d5-a3d8-424e-8f04-e91f08bfa208 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:09.471821 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9771f0d5-a3d8-424e-8f04-e91f08bfa208 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:09.479382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9771f0d5-a3d8-424e-8f04-e91f08bfa208 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:09.480171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9771f0d5-a3d8-424e-8f04-e91f08bfa208 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:09.480784 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9771f0d5-a3d8-424e-8f04-e91f08bfa208 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:09.481683 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9771f0d5-a3d8-424e-8f04-e91f08bfa208 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:09.482350 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9771f0d5-a3d8-424e-8f04-e91f08bfa208 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:09.482476 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fde13b1b-76b1-4bac-ab1c-019c6a520465 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:09.483627 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9771f0d5-a3d8-424e-8f04-e91f08bfa208 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:09.498739 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fde13b1b-76b1-4bac-ab1c-019c6a520465 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 200 len: 1510 microversion: 2.1 time: 0.629858 Aug 04 17:16:09.501484 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2448/4952] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:08 2022] GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 1510 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:09.510809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6e51f178-b7e8-4d55-ab29-1e5b8c1753ed tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:09.511680 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6e51f178-b7e8-4d55-ab29-1e5b8c1753ed tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:09.519681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e51f178-b7e8-4d55-ab29-1e5b8c1753ed tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:09.520400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e51f178-b7e8-4d55-ab29-1e5b8c1753ed tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:09.521065 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e51f178-b7e8-4d55-ab29-1e5b8c1753ed tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:09.522049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e51f178-b7e8-4d55-ab29-1e5b8c1753ed tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:09.522738 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e51f178-b7e8-4d55-ab29-1e5b8c1753ed tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:09.523373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e51f178-b7e8-4d55-ab29-1e5b8c1753ed tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:09.546735 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9771f0d5-a3d8-424e-8f04-e91f08bfa208 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.083871 Aug 04 17:16:09.549232 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2505/4953] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:16:09 2022] GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba/os-volume_attachments => generated 371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:16:09.550452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:09.659425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0764f265-887b-471c-9cf7-b5659aec99c3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:09.661005 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0764f265-887b-471c-9cf7-b5659aec99c3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:09.675873 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6e51f178-b7e8-4d55-ab29-1e5b8c1753ed tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:09.701141 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0764f265-887b-471c-9cf7-b5659aec99c3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:09.701671 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0764f265-887b-471c-9cf7-b5659aec99c3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:09.717451 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0764f265-887b-471c-9cf7-b5659aec99c3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:09.719621 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0764f265-887b-471c-9cf7-b5659aec99c3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:09.722928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0764f265-887b-471c-9cf7-b5659aec99c3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:09.723634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0764f265-887b-471c-9cf7-b5659aec99c3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:09.739249 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6e51f178-b7e8-4d55-ab29-1e5b8c1753ed tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1281 microversion: 2.1 time: 0.228497 Aug 04 17:16:09.750645 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2449/4954] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:09 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1281 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:09.864503 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0764f265-887b-471c-9cf7-b5659aec99c3 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba/os-volume_attachments/13f4b91d-6781-4d5c-8d02-e6fd9b41e854" status: 200 len: 194 microversion: 2.1 time: 0.209629 Aug 04 17:16:09.867428 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2506/4955] 10.222.0.93 () {58 vars in 1413 bytes} [Thu Aug 4 17:16:09 2022] GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba/os-volume_attachments/13f4b91d-6781-4d5c-8d02-e6fd9b41e854 => generated 194 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:16:09.878077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-701beed9-2331-4936-886d-3e7b6f1fdb2e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:09.878964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-701beed9-2331-4936-886d-3e7b6f1fdb2e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:09.886303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-701beed9-2331-4936-886d-3e7b6f1fdb2e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:09.890937 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-701beed9-2331-4936-886d-3e7b6f1fdb2e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:09.891761 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-701beed9-2331-4936-886d-3e7b6f1fdb2e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:09.892938 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-701beed9-2331-4936-886d-3e7b6f1fdb2e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:09.893650 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-701beed9-2331-4936-886d-3e7b6f1fdb2e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:09.896490 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-701beed9-2331-4936-886d-3e7b6f1fdb2e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:10.051446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-701beed9-2331-4936-886d-3e7b6f1fdb2e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lazy-loading 'services' on Instance uuid 81a3d940-08e3-4cb9-bbf2-360653411aba {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:16:10.186755 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-701beed9-2331-4936-886d-3e7b6f1fdb2e tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "DELETE /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba/os-volume_attachments/13f4b91d-6781-4d5c-8d02-e6fd9b41e854" status: 202 len: 0 microversion: 2.1 time: 0.312671 Aug 04 17:16:10.187982 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2450/4956] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Aug 4 17:16:09 2022] DELETE /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba/os-volume_attachments/13f4b91d-6781-4d5c-8d02-e6fd9b41e854 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:16:10.376517 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7d6af03a-ebee-429d-a59d-a740d97929a8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:10.377255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7d6af03a-ebee-429d-a59d-a740d97929a8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:10.395115 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d6af03a-ebee-429d-a59d-a740d97929a8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:10.399125 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d6af03a-ebee-429d-a59d-a740d97929a8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:10.399829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d6af03a-ebee-429d-a59d-a740d97929a8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:10.402819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d6af03a-ebee-429d-a59d-a740d97929a8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:10.408969 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d6af03a-ebee-429d-a59d-a740d97929a8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:10.412851 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d6af03a-ebee-429d-a59d-a740d97929a8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:10.431069 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b8710464-617c-41f4-84bc-97c80e791c6e req-431bfcb0-2b45-4920-b93e-056e61a9acc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c6b1716-bb14-4f97-bc75-38403c1c1af0", "tag": "1e3189db-ad91-4d9e-bfe5-7b700963e0d9"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:10.468876 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b8710464-617c-41f4-84bc-97c80e791c6e req-431bfcb0-2b45-4920-b93e-056e61a9acc8 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:10.469364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b8710464-617c-41f4-84bc-97c80e791c6e req-431bfcb0-2b45-4920-b93e-056e61a9acc8 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:10.479211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b8710464-617c-41f4-84bc-97c80e791c6e req-431bfcb0-2b45-4920-b93e-056e61a9acc8 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:10.519133 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b8710464-617c-41f4-84bc-97c80e791c6e req-431bfcb0-2b45-4920-b93e-056e61a9acc8 service nova] Creating event network-changed:1e3189db-ad91-4d9e-bfe5-7b700963e0d9 for instance 9c6b1716-bb14-4f97-bc75-38403c1c1af0 on n-h2-851359-3 Aug 04 17:16:10.533336 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b8710464-617c-41f4-84bc-97c80e791c6e req-431bfcb0-2b45-4920-b93e-056e61a9acc8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106293 Aug 04 17:16:10.533953 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2451/4957] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:16:10.548904 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cc9fd82c-45ad-4b2d-842a-2e2f694efea0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:10.554015 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cc9fd82c-45ad-4b2d-842a-2e2f694efea0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:10.561884 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc9fd82c-45ad-4b2d-842a-2e2f694efea0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:10.562799 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc9fd82c-45ad-4b2d-842a-2e2f694efea0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:10.563377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc9fd82c-45ad-4b2d-842a-2e2f694efea0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:10.564592 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc9fd82c-45ad-4b2d-842a-2e2f694efea0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:10.565265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc9fd82c-45ad-4b2d-842a-2e2f694efea0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:10.565854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc9fd82c-45ad-4b2d-842a-2e2f694efea0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:10.609093 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cc9fd82c-45ad-4b2d-842a-2e2f694efea0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066777 Aug 04 17:16:10.610773 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2452/4958] 10.222.0.93 () {60 vars in 1343 bytes} [Thu Aug 4 17:16:10 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:16:10.622585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b7e4842a-8f58-4ff7-a817-1914bdb4a147 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:10.623693 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b7e4842a-8f58-4ff7-a817-1914bdb4a147 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:10.663709 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7e4842a-8f58-4ff7-a817-1914bdb4a147 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:10.664453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7e4842a-8f58-4ff7-a817-1914bdb4a147 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:10.665072 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7e4842a-8f58-4ff7-a817-1914bdb4a147 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:10.666306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7e4842a-8f58-4ff7-a817-1914bdb4a147 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:10.667132 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7e4842a-8f58-4ff7-a817-1914bdb4a147 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:10.667722 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7e4842a-8f58-4ff7-a817-1914bdb4a147 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:11.126225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7d6af03a-ebee-429d-a59d-a740d97929a8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:11.143112 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7d6af03a-ebee-429d-a59d-a740d97929a8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1392 microversion: 2.1 time: 0.771001 Aug 04 17:16:11.156867 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2507/4959] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:10 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1392 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:11.156867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-624752de-9b45-4e3b-95ff-a3731620522d tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:11.156867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-624752de-9b45-4e3b-95ff-a3731620522d tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:11.169658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-624752de-9b45-4e3b-95ff-a3731620522d tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:11.172111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-624752de-9b45-4e3b-95ff-a3731620522d tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:11.172659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-624752de-9b45-4e3b-95ff-a3731620522d tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:11.174119 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-624752de-9b45-4e3b-95ff-a3731620522d tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:11.178848 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-624752de-9b45-4e3b-95ff-a3731620522d tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:11.179413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-624752de-9b45-4e3b-95ff-a3731620522d tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:11.216605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b7e4842a-8f58-4ff7-a817-1914bdb4a147 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:11.225616 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b7e4842a-8f58-4ff7-a817-1914bdb4a147 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 200 len: 1510 microversion: 2.1 time: 0.613599 Aug 04 17:16:11.234316 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2453/4960] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:10 2022] GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 1510 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:11.546316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-624752de-9b45-4e3b-95ff-a3731620522d tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:11.554080 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-624752de-9b45-4e3b-95ff-a3731620522d tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1323 microversion: 2.1 time: 0.408683 Aug 04 17:16:11.558479 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2508/4961] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:11 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1323 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:11.622816 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4170afa2-8dd9-43c7-a306-7103b6a0646c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:11.626388 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4170afa2-8dd9-43c7-a306-7103b6a0646c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:11.639899 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4170afa2-8dd9-43c7-a306-7103b6a0646c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:11.641447 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4170afa2-8dd9-43c7-a306-7103b6a0646c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:11.642875 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4170afa2-8dd9-43c7-a306-7103b6a0646c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:11.646498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4170afa2-8dd9-43c7-a306-7103b6a0646c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:11.647619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4170afa2-8dd9-43c7-a306-7103b6a0646c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:11.648673 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4170afa2-8dd9-43c7-a306-7103b6a0646c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:11.726386 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4170afa2-8dd9-43c7-a306-7103b6a0646c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.108662 Aug 04 17:16:11.731551 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2454/4962] 10.222.0.93 () {60 vars in 1343 bytes} [Thu Aug 4 17:16:11 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:16:11.762906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-19222534-00ce-4b52-b453-16ae1aab7ef2 req-62a5c09b-9803-4eee-a609-e25eb6ccf225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4", "tag": "55706834-8e3f-467d-8a7e-fdc1e5f26df2"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:11.782675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-19222534-00ce-4b52-b453-16ae1aab7ef2 req-62a5c09b-9803-4eee-a609-e25eb6ccf225 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:11.785566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-19222534-00ce-4b52-b453-16ae1aab7ef2 req-62a5c09b-9803-4eee-a609-e25eb6ccf225 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:11.786060 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-19222534-00ce-4b52-b453-16ae1aab7ef2 req-62a5c09b-9803-4eee-a609-e25eb6ccf225 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:11.824302 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-19222534-00ce-4b52-b453-16ae1aab7ef2 req-62a5c09b-9803-4eee-a609-e25eb6ccf225 service nova] Creating event network-changed:55706834-8e3f-467d-8a7e-fdc1e5f26df2 for instance dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 on n-h1-851359-3 Aug 04 17:16:11.834815 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-19222534-00ce-4b52-b453-16ae1aab7ef2 req-62a5c09b-9803-4eee-a609-e25eb6ccf225 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073896 Aug 04 17:16:11.835918 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2509/4963] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:16:12.166248 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bca89015-e378-4dea-bcb6-095e669020df tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:12.166881 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bca89015-e378-4dea-bcb6-095e669020df tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:12.185243 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bca89015-e378-4dea-bcb6-095e669020df tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:12.185772 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bca89015-e378-4dea-bcb6-095e669020df tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:12.186244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bca89015-e378-4dea-bcb6-095e669020df tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:12.186957 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bca89015-e378-4dea-bcb6-095e669020df tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:12.187422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bca89015-e378-4dea-bcb6-095e669020df tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:12.187851 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bca89015-e378-4dea-bcb6-095e669020df tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:12.247469 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-522b2604-1260-4e09-8dcf-173940f32f2d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:12.248173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-522b2604-1260-4e09-8dcf-173940f32f2d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:12.263649 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-522b2604-1260-4e09-8dcf-173940f32f2d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:12.264155 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-522b2604-1260-4e09-8dcf-173940f32f2d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:12.264600 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-522b2604-1260-4e09-8dcf-173940f32f2d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:12.265314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-522b2604-1260-4e09-8dcf-173940f32f2d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:12.265773 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-522b2604-1260-4e09-8dcf-173940f32f2d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:12.266235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-522b2604-1260-4e09-8dcf-173940f32f2d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:12.613446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bca89015-e378-4dea-bcb6-095e669020df tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:12.619767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-522b2604-1260-4e09-8dcf-173940f32f2d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:12.628797 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bca89015-e378-4dea-bcb6-095e669020df tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1392 microversion: 2.1 time: 0.468350 Aug 04 17:16:12.637484 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-522b2604-1260-4e09-8dcf-173940f32f2d tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 200 len: 1510 microversion: 2.1 time: 0.394096 Aug 04 17:16:12.643750 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2455/4964] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:12 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1392 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:12.650703 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d7e8e24f-8dcb-4777-9803-f3ef4037ac43 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:12.651515 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d7e8e24f-8dcb-4777-9803-f3ef4037ac43 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:12.652078 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2510/4965] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:12 2022] GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 1510 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:16:12.669142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7e8e24f-8dcb-4777-9803-f3ef4037ac43 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:12.670648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7e8e24f-8dcb-4777-9803-f3ef4037ac43 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:12.674052 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7e8e24f-8dcb-4777-9803-f3ef4037ac43 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:12.676423 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7e8e24f-8dcb-4777-9803-f3ef4037ac43 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:12.677732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7e8e24f-8dcb-4777-9803-f3ef4037ac43 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:12.679302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7e8e24f-8dcb-4777-9803-f3ef4037ac43 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:12.739593 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6e9e9004-b5a4-4c14-a454-9a7237afd0d2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:12.742762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6e9e9004-b5a4-4c14-a454-9a7237afd0d2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:12.771060 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:12.788444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6e9e9004-b5a4-4c14-a454-9a7237afd0d2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:12.789819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6e9e9004-b5a4-4c14-a454-9a7237afd0d2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:12.792175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6e9e9004-b5a4-4c14-a454-9a7237afd0d2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:12.794244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6e9e9004-b5a4-4c14-a454-9a7237afd0d2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:12.794954 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6e9e9004-b5a4-4c14-a454-9a7237afd0d2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:12.795732 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6e9e9004-b5a4-4c14-a454-9a7237afd0d2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:12.848880 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6e9e9004-b5a4-4c14-a454-9a7237afd0d2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.113631 Aug 04 17:16:12.850172 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2511/4966] 10.222.0.93 () {60 vars in 1343 bytes} [Thu Aug 4 17:16:12 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:16:12.890212 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d7e8e24f-8dcb-4777-9803-f3ef4037ac43 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:12.898127 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d7e8e24f-8dcb-4777-9803-f3ef4037ac43 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1323 microversion: 2.1 time: 0.252870 Aug 04 17:16:12.898717 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2456/4967] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:12 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1323 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:13.655771 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-87cbc59d-b947-4b86-bcb5-3252e3267855 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:13.657595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-87cbc59d-b947-4b86-bcb5-3252e3267855 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:13.662966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9bc21cf1-6b42-4ed3-bc63-85834d29806a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:13.663675 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9bc21cf1-6b42-4ed3-bc63-85834d29806a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:13.671068 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:13.672577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9bc21cf1-6b42-4ed3-bc63-85834d29806a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:13.673297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9bc21cf1-6b42-4ed3-bc63-85834d29806a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:13.673903 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9bc21cf1-6b42-4ed3-bc63-85834d29806a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:13.674535 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9bc21cf1-6b42-4ed3-bc63-85834d29806a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:13.675005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9bc21cf1-6b42-4ed3-bc63-85834d29806a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:13.675437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9bc21cf1-6b42-4ed3-bc63-85834d29806a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:13.682178 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87cbc59d-b947-4b86-bcb5-3252e3267855 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:13.685522 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87cbc59d-b947-4b86-bcb5-3252e3267855 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:13.688528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87cbc59d-b947-4b86-bcb5-3252e3267855 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:13.689561 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87cbc59d-b947-4b86-bcb5-3252e3267855 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:13.690074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87cbc59d-b947-4b86-bcb5-3252e3267855 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:13.690521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87cbc59d-b947-4b86-bcb5-3252e3267855 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:14.318030 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-87cbc59d-b947-4b86-bcb5-3252e3267855 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:14.330220 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-87cbc59d-b947-4b86-bcb5-3252e3267855 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1392 microversion: 2.1 time: 0.678651 Aug 04 17:16:14.330827 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2512/4968] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:13 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1392 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:14.346617 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9bc21cf1-6b42-4ed3-bc63-85834d29806a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:14.350558 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9af34bae-0f82-4604-9c6d-d8ef68bbed61 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:14.352830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9af34bae-0f82-4604-9c6d-d8ef68bbed61 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:14.357311 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9bc21cf1-6b42-4ed3-bc63-85834d29806a tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 200 len: 1510 microversion: 2.1 time: 0.700545 Aug 04 17:16:14.358910 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2457/4969] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:13 2022] GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 1510 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:16:14.369951 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f0fefb69-e137-4b23-92e0-5a9afc984547 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:14.370602 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f0fefb69-e137-4b23-92e0-5a9afc984547 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:14.380424 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9af34bae-0f82-4604-9c6d-d8ef68bbed61 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:14.382785 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9af34bae-0f82-4604-9c6d-d8ef68bbed61 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:14.383168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9af34bae-0f82-4604-9c6d-d8ef68bbed61 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:14.389618 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9af34bae-0f82-4604-9c6d-d8ef68bbed61 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:14.390202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9af34bae-0f82-4604-9c6d-d8ef68bbed61 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:14.398559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9af34bae-0f82-4604-9c6d-d8ef68bbed61 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:14.406251 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0fefb69-e137-4b23-92e0-5a9afc984547 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:14.407110 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0fefb69-e137-4b23-92e0-5a9afc984547 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:14.407742 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0fefb69-e137-4b23-92e0-5a9afc984547 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:14.408725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0fefb69-e137-4b23-92e0-5a9afc984547 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:14.409350 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0fefb69-e137-4b23-92e0-5a9afc984547 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:14.418906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0fefb69-e137-4b23-92e0-5a9afc984547 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:14.473302 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9af34bae-0f82-4604-9c6d-d8ef68bbed61 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.141374 Aug 04 17:16:14.473892 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2513/4970] 10.222.0.93 () {60 vars in 1343 bytes} [Thu Aug 4 17:16:14 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:16:14.772793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f0fefb69-e137-4b23-92e0-5a9afc984547 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:14.800538 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f0fefb69-e137-4b23-92e0-5a9afc984547 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1323 microversion: 2.1 time: 0.438363 Aug 04 17:16:14.801739 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2458/4971] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:14 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1323 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:15.367639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8c4bfa3c-ff8e-4082-b7f7-d3781de0613e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:15.368219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8c4bfa3c-ff8e-4082-b7f7-d3781de0613e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:15.386040 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=4 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:15.389051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=12 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:15.411427 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4361ab6b-9ea8-44b6-a727-46ef3455d1ed tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:15.412673 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4361ab6b-9ea8-44b6-a727-46ef3455d1ed tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:15.430883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4361ab6b-9ea8-44b6-a727-46ef3455d1ed tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:15.431477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c4bfa3c-ff8e-4082-b7f7-d3781de0613e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:15.433700 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c4bfa3c-ff8e-4082-b7f7-d3781de0613e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:15.434232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c4bfa3c-ff8e-4082-b7f7-d3781de0613e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:15.434856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4361ab6b-9ea8-44b6-a727-46ef3455d1ed tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:15.436357 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4361ab6b-9ea8-44b6-a727-46ef3455d1ed tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:15.439368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4361ab6b-9ea8-44b6-a727-46ef3455d1ed tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:15.440065 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4361ab6b-9ea8-44b6-a727-46ef3455d1ed tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:15.440242 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c4bfa3c-ff8e-4082-b7f7-d3781de0613e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:15.440771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4361ab6b-9ea8-44b6-a727-46ef3455d1ed tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:15.443193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c4bfa3c-ff8e-4082-b7f7-d3781de0613e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:15.444793 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c4bfa3c-ff8e-4082-b7f7-d3781de0613e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:15.646137 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:15.761264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4361ab6b-9ea8-44b6-a727-46ef3455d1ed tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:15.771572 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4361ab6b-9ea8-44b6-a727-46ef3455d1ed tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 200 len: 1510 microversion: 2.1 time: 0.376010 Aug 04 17:16:15.776320 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2459/4972] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:15 2022] GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 1510 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:15.796944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3a666fa7-ffe7-4733-8697-22331e0b0efb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:15.799604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3a666fa7-ffe7-4733-8697-22331e0b0efb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:15.803765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8c4bfa3c-ff8e-4082-b7f7-d3781de0613e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:15.812501 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8c4bfa3c-ff8e-4082-b7f7-d3781de0613e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1392 microversion: 2.1 time: 0.461105 Aug 04 17:16:15.816328 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2514/4973] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:15 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1392 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:15.832729 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a666fa7-ffe7-4733-8697-22331e0b0efb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:15.833879 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a666fa7-ffe7-4733-8697-22331e0b0efb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:15.834835 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a666fa7-ffe7-4733-8697-22331e0b0efb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:15.835963 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a666fa7-ffe7-4733-8697-22331e0b0efb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:15.836604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a666fa7-ffe7-4733-8697-22331e0b0efb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:15.838027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a666fa7-ffe7-4733-8697-22331e0b0efb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:15.885788 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3a666fa7-ffe7-4733-8697-22331e0b0efb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.107333 Aug 04 17:16:15.888142 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2460/4974] 10.222.0.93 () {60 vars in 1343 bytes} [Thu Aug 4 17:16:15 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:16:15.896249 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-18919abd-8fb7-460d-9657-334cafb2bd38 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:15.903434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-18919abd-8fb7-460d-9657-334cafb2bd38 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:15.920264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18919abd-8fb7-460d-9657-334cafb2bd38 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:15.920817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18919abd-8fb7-460d-9657-334cafb2bd38 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:15.922305 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18919abd-8fb7-460d-9657-334cafb2bd38 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:15.923454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18919abd-8fb7-460d-9657-334cafb2bd38 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:15.924150 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18919abd-8fb7-460d-9657-334cafb2bd38 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:15.924772 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18919abd-8fb7-460d-9657-334cafb2bd38 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:16.048648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-633618af-4b9a-408b-adac-7787755e70c4 tempest-ExtensionsTest-152401087 tempest-ExtensionsTest-152401087-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:16.060306 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-633618af-4b9a-408b-adac-7787755e70c4 tempest-ExtensionsTest-152401087 tempest-ExtensionsTest-152401087-project] 10.222.0.93 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.231042 Aug 04 17:16:16.060948 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2515/4975] 10.222.0.93 () {58 vars in 1170 bytes} [Thu Aug 4 17:16:15 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:16:16.076093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4055edb2-3b0d-4c39-8672-5b97eae185f3 tempest-ExtensionsTest-152401087 tempest-ExtensionsTest-152401087-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:16.082347 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4055edb2-3b0d-4c39-8672-5b97eae185f3 tempest-ExtensionsTest-152401087 tempest-ExtensionsTest-152401087-project] 10.222.0.93 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.013572 Aug 04 17:16:16.083109 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2516/4976] 10.222.0.93 () {58 vars in 1134 bytes} [Thu Aug 4 17:16:16 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:16:16.186215 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-18919abd-8fb7-460d-9657-334cafb2bd38 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:16.194143 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-18919abd-8fb7-460d-9657-334cafb2bd38 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1323 microversion: 2.1 time: 0.302078 Aug 04 17:16:16.198970 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2461/4977] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:15 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1323 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:16.797162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-816df01d-b049-4b25-9144-4bd1ccb17ca1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:16.798551 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-816df01d-b049-4b25-9144-4bd1ccb17ca1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:16.810124 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-816df01d-b049-4b25-9144-4bd1ccb17ca1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:16.811238 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-816df01d-b049-4b25-9144-4bd1ccb17ca1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:16.812713 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-816df01d-b049-4b25-9144-4bd1ccb17ca1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:16.814723 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-816df01d-b049-4b25-9144-4bd1ccb17ca1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:16.816539 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-816df01d-b049-4b25-9144-4bd1ccb17ca1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:16.816647 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-816df01d-b049-4b25-9144-4bd1ccb17ca1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:16.841520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7539a625-c847-4236-a628-048f455179e7 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:16.841932 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7539a625-c847-4236-a628-048f455179e7 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:16.870470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7539a625-c847-4236-a628-048f455179e7 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:16.871068 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7539a625-c847-4236-a628-048f455179e7 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:16.871702 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7539a625-c847-4236-a628-048f455179e7 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:16.872545 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7539a625-c847-4236-a628-048f455179e7 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:16.874766 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7539a625-c847-4236-a628-048f455179e7 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:16.876355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7539a625-c847-4236-a628-048f455179e7 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:17.068712 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-816df01d-b049-4b25-9144-4bd1ccb17ca1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:17.078432 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-816df01d-b049-4b25-9144-4bd1ccb17ca1 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 200 len: 1487 microversion: 2.1 time: 0.285985 Aug 04 17:16:17.079653 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2517/4978] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:16 2022] GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 1487 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:17.084663 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b610d305-5ace-4189-9a59-39ce81acc281 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:17.087221 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b610d305-5ace-4189-9a59-39ce81acc281 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:17.096788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b610d305-5ace-4189-9a59-39ce81acc281 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:17.097300 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b610d305-5ace-4189-9a59-39ce81acc281 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:17.098521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b610d305-5ace-4189-9a59-39ce81acc281 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:17.099452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b610d305-5ace-4189-9a59-39ce81acc281 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:17.100168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b610d305-5ace-4189-9a59-39ce81acc281 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:17.100814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b610d305-5ace-4189-9a59-39ce81acc281 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:17.142274 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b610d305-5ace-4189-9a59-39ce81acc281 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.061012 Aug 04 17:16:17.143604 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2518/4979] 10.222.0.93 () {60 vars in 1343 bytes} [Thu Aug 4 17:16:17 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:17.158166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2990a183-bba6-46a7-ac24-88faf9d7deb8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-471356652"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:17.169137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2990a183-bba6-46a7-ac24-88faf9d7deb8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:17.179000 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2990a183-bba6-46a7-ac24-88faf9d7deb8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:17.179914 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2990a183-bba6-46a7-ac24-88faf9d7deb8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:17.181286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2990a183-bba6-46a7-ac24-88faf9d7deb8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:17.182345 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2990a183-bba6-46a7-ac24-88faf9d7deb8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:17.182985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2990a183-bba6-46a7-ac24-88faf9d7deb8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:17.183587 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2990a183-bba6-46a7-ac24-88faf9d7deb8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:17.187672 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7539a625-c847-4236-a628-048f455179e7 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:17.197520 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7539a625-c847-4236-a628-048f455179e7 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1392 microversion: 2.1 time: 0.365038 Aug 04 17:16:17.199800 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2462/4980] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:16 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1392 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:17.216796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:17.219306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-29cf4306-3191-41c7-a3b1-b46cda2a9895 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:17.220088 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-29cf4306-3191-41c7-a3b1-b46cda2a9895 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:17.230965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29cf4306-3191-41c7-a3b1-b46cda2a9895 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:17.231474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29cf4306-3191-41c7-a3b1-b46cda2a9895 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:17.231979 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29cf4306-3191-41c7-a3b1-b46cda2a9895 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:17.232701 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29cf4306-3191-41c7-a3b1-b46cda2a9895 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:17.233164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29cf4306-3191-41c7-a3b1-b46cda2a9895 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:17.233601 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29cf4306-3191-41c7-a3b1-b46cda2a9895 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:17.310626 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2990a183-bba6-46a7-ac24-88faf9d7deb8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "PUT /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 200 len: 1061 microversion: 2.1 time: 0.160091 Aug 04 17:16:17.311899 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2519/4981] 10.222.0.93 () {60 vars in 1256 bytes} [Thu Aug 4 17:16:17 2022] PUT /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 1061 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:17.318317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0194b3b1-d691-45ac-b973-876d091c044b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:17.319028 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0194b3b1-d691-45ac-b973-876d091c044b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:17.327026 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0194b3b1-d691-45ac-b973-876d091c044b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:17.327976 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0194b3b1-d691-45ac-b973-876d091c044b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:17.328616 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0194b3b1-d691-45ac-b973-876d091c044b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:17.333222 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0194b3b1-d691-45ac-b973-876d091c044b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:17.333918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0194b3b1-d691-45ac-b973-876d091c044b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:17.334561 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0194b3b1-d691-45ac-b973-876d091c044b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:17.376139 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0194b3b1-d691-45ac-b973-876d091c044b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:16:17.432645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-29cf4306-3191-41c7-a3b1-b46cda2a9895 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:17.445675 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-29cf4306-3191-41c7-a3b1-b46cda2a9895 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1323 microversion: 2.1 time: 0.228921 Aug 04 17:16:17.446707 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2463/4982] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:17 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1323 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:16:17.452371 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2abe6b5c-f291-4d89-a1f1-ea4da66b6c77 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:17.453303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2abe6b5c-f291-4d89-a1f1-ea4da66b6c77 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:17.461075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2abe6b5c-f291-4d89-a1f1-ea4da66b6c77 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:17.463168 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2abe6b5c-f291-4d89-a1f1-ea4da66b6c77 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:17.463900 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2abe6b5c-f291-4d89-a1f1-ea4da66b6c77 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:17.466248 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2abe6b5c-f291-4d89-a1f1-ea4da66b6c77 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:17.467381 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2abe6b5c-f291-4d89-a1f1-ea4da66b6c77 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:17.468348 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2abe6b5c-f291-4d89-a1f1-ea4da66b6c77 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:17.543324 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0194b3b1-d691-45ac-b973-876d091c044b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 204 len: 0 microversion: 2.20 time: 0.224459 Aug 04 17:16:17.546914 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2520/4983] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Aug 4 17:16:17 2022] DELETE /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:16:17.566031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bcceb616-9abe-49da-9dd4-ab448e1ac9bb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:17.567633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bcceb616-9abe-49da-9dd4-ab448e1ac9bb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:17.589488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bcceb616-9abe-49da-9dd4-ab448e1ac9bb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:17.596737 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bcceb616-9abe-49da-9dd4-ab448e1ac9bb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:17.607720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bcceb616-9abe-49da-9dd4-ab448e1ac9bb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:17.608520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bcceb616-9abe-49da-9dd4-ab448e1ac9bb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:17.609009 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bcceb616-9abe-49da-9dd4-ab448e1ac9bb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:17.609455 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bcceb616-9abe-49da-9dd4-ab448e1ac9bb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:17.916624 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2abe6b5c-f291-4d89-a1f1-ea4da66b6c77 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:17.928017 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2abe6b5c-f291-4d89-a1f1-ea4da66b6c77 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 200 len: 1488 microversion: 2.1 time: 0.478445 Aug 04 17:16:17.928632 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2464/4984] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:17 2022] GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 1488 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:17.966262 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bcceb616-9abe-49da-9dd4-ab448e1ac9bb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:17.975778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bcceb616-9abe-49da-9dd4-ab448e1ac9bb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:17.983417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bcceb616-9abe-49da-9dd4-ab448e1ac9bb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:17.984018 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9d949ba5-ef1a-4235-b55f-f9d7c10c4ed7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:17.985674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9d949ba5-ef1a-4235-b55f-f9d7c10c4ed7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:17.987770 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bcceb616-9abe-49da-9dd4-ab448e1ac9bb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1724 microversion: 2.20 time: 0.436454 Aug 04 17:16:17.990358 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2521/4985] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:16:17 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1724 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:16:17.996924 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d949ba5-ef1a-4235-b55f-f9d7c10c4ed7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:17.998337 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d949ba5-ef1a-4235-b55f-f9d7c10c4ed7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:17.999192 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d949ba5-ef1a-4235-b55f-f9d7c10c4ed7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:18.000125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d949ba5-ef1a-4235-b55f-f9d7c10c4ed7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:18.000792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d949ba5-ef1a-4235-b55f-f9d7c10c4ed7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:18.001399 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d949ba5-ef1a-4235-b55f-f9d7c10c4ed7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:18.221789 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-57c2f210-53b0-4fa4-aa44-58011efb757a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:18.222731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-57c2f210-53b0-4fa4-aa44-58011efb757a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:18.230962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57c2f210-53b0-4fa4-aa44-58011efb757a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:18.232775 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57c2f210-53b0-4fa4-aa44-58011efb757a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:18.233753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57c2f210-53b0-4fa4-aa44-58011efb757a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:18.234996 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57c2f210-53b0-4fa4-aa44-58011efb757a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:18.235638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57c2f210-53b0-4fa4-aa44-58011efb757a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:18.237457 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57c2f210-53b0-4fa4-aa44-58011efb757a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:18.273849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9d949ba5-ef1a-4235-b55f-f9d7c10c4ed7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:18.279961 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:18.295268 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9d949ba5-ef1a-4235-b55f-f9d7c10c4ed7 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 200 len: 1488 microversion: 2.1 time: 0.342340 Aug 04 17:16:18.296241 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2465/4986] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:17 2022] GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 1488 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:18.321288 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e3c23d9c-b2a8-4d48-9233-6417a0a9a9f3 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:18.322165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e3c23d9c-b2a8-4d48-9233-6417a0a9a9f3 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:18.334116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3c23d9c-b2a8-4d48-9233-6417a0a9a9f3 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:18.335066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3c23d9c-b2a8-4d48-9233-6417a0a9a9f3 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:18.335704 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3c23d9c-b2a8-4d48-9233-6417a0a9a9f3 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:18.337405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3c23d9c-b2a8-4d48-9233-6417a0a9a9f3 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:18.338157 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3c23d9c-b2a8-4d48-9233-6417a0a9a9f3 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:18.339241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3c23d9c-b2a8-4d48-9233-6417a0a9a9f3 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:18.384990 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e3c23d9c-b2a8-4d48-9233-6417a0a9a9f3 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:16:18.513970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-57c2f210-53b0-4fa4-aa44-58011efb757a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:18.529825 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-57c2f210-53b0-4fa4-aa44-58011efb757a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1392 microversion: 2.1 time: 0.314311 Aug 04 17:16:18.530456 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2522/4987] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:18 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1392 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:18.544219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-aec7b964-47fc-4ca1-b9b4-9e0bb0b54a02 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:18.555764 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-aec7b964-47fc-4ca1-b9b4-9e0bb0b54a02 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:18.566683 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e3c23d9c-b2a8-4d48-9233-6417a0a9a9f3 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "DELETE /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 204 len: 0 microversion: 2.1 time: 0.249746 Aug 04 17:16:18.568624 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2466/4988] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:16:18 2022] DELETE /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:16:18.578334 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-8ed0d534-a78b-4a6b-9df0-dd50c0f0d771 req-f3c866a3-fac4-4942-886f-d0db0a3d2055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4", "name": "network-vif-plugged", "status": "completed", "tag": "55706834-8e3f-467d-8a7e-fdc1e5f26df2"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:18.578504 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aec7b964-47fc-4ca1-b9b4-9e0bb0b54a02 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:18.578972 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aec7b964-47fc-4ca1-b9b4-9e0bb0b54a02 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:18.579422 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aec7b964-47fc-4ca1-b9b4-9e0bb0b54a02 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:18.580141 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aec7b964-47fc-4ca1-b9b4-9e0bb0b54a02 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:18.580607 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aec7b964-47fc-4ca1-b9b4-9e0bb0b54a02 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:18.583792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aec7b964-47fc-4ca1-b9b4-9e0bb0b54a02 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:18.592498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8ed0d534-a78b-4a6b-9df0-dd50c0f0d771 req-f3c866a3-fac4-4942-886f-d0db0a3d2055 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:18.592987 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8ed0d534-a78b-4a6b-9df0-dd50c0f0d771 req-f3c866a3-fac4-4942-886f-d0db0a3d2055 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:18.593521 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8ed0d534-a78b-4a6b-9df0-dd50c0f0d771 req-f3c866a3-fac4-4942-886f-d0db0a3d2055 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:18.615092 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-8ed0d534-a78b-4a6b-9df0-dd50c0f0d771 req-f3c866a3-fac4-4942-886f-d0db0a3d2055 service nova] Creating event network-vif-plugged:55706834-8e3f-467d-8a7e-fdc1e5f26df2 for instance dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 on n-h1-851359-3 Aug 04 17:16:18.631317 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-8ed0d534-a78b-4a6b-9df0-dd50c0f0d771 req-f3c866a3-fac4-4942-886f-d0db0a3d2055 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059518 Aug 04 17:16:18.632908 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2467/4989] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:16:18.644416 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-88ddfeee-d165-47b5-b062-a040357cfc10 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:18.645139 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-88ddfeee-d165-47b5-b062-a040357cfc10 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:18.654328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88ddfeee-d165-47b5-b062-a040357cfc10 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:18.654928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88ddfeee-d165-47b5-b062-a040357cfc10 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:18.655377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88ddfeee-d165-47b5-b062-a040357cfc10 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:18.656090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88ddfeee-d165-47b5-b062-a040357cfc10 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:18.657720 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88ddfeee-d165-47b5-b062-a040357cfc10 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:18.657720 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88ddfeee-d165-47b5-b062-a040357cfc10 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:18.919013 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-aec7b964-47fc-4ca1-b9b4-9e0bb0b54a02 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:18.932088 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-88ddfeee-d165-47b5-b062-a040357cfc10 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:18.936508 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-aec7b964-47fc-4ca1-b9b4-9e0bb0b54a02 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1323 microversion: 2.1 time: 0.404968 Aug 04 17:16:18.939536 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2523/4990] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:18 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1323 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:18.952586 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-88ddfeee-d165-47b5-b062-a040357cfc10 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 200 len: 1494 microversion: 2.1 time: 0.318298 Aug 04 17:16:18.953384 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2468/4991] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:18 2022] GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 1494 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:19.238766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-286a1a68-10a9-434d-b22f-dfe1dc3852bd tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:19.239984 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-286a1a68-10a9-434d-b22f-dfe1dc3852bd tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:19.247562 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-286a1a68-10a9-434d-b22f-dfe1dc3852bd tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:19.248283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-286a1a68-10a9-434d-b22f-dfe1dc3852bd tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:19.249291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-286a1a68-10a9-434d-b22f-dfe1dc3852bd tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:19.250240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-286a1a68-10a9-434d-b22f-dfe1dc3852bd tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:19.250891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-286a1a68-10a9-434d-b22f-dfe1dc3852bd tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:19.251508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-286a1a68-10a9-434d-b22f-dfe1dc3852bd tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:19.551641 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b48771f3-63c5-4ccb-93e6-fb938946f65b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:19.552419 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b48771f3-63c5-4ccb-93e6-fb938946f65b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:19.561208 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b48771f3-63c5-4ccb-93e6-fb938946f65b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:19.565010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-286a1a68-10a9-434d-b22f-dfe1dc3852bd tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:19.574708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b48771f3-63c5-4ccb-93e6-fb938946f65b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:19.575189 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b48771f3-63c5-4ccb-93e6-fb938946f65b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:19.575960 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b48771f3-63c5-4ccb-93e6-fb938946f65b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:19.576435 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b48771f3-63c5-4ccb-93e6-fb938946f65b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:19.576877 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b48771f3-63c5-4ccb-93e6-fb938946f65b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:19.579889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-286a1a68-10a9-434d-b22f-dfe1dc3852bd tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:19.581629 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-286a1a68-10a9-434d-b22f-dfe1dc3852bd tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:19.583302 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-286a1a68-10a9-434d-b22f-dfe1dc3852bd tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1724 microversion: 2.20 time: 0.571240 Aug 04 17:16:19.600860 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2524/4992] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:16:19 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1724 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:16:19.862130 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b48771f3-63c5-4ccb-93e6-fb938946f65b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:19.881506 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b48771f3-63c5-4ccb-93e6-fb938946f65b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1392 microversion: 2.1 time: 0.333839 Aug 04 17:16:19.882156 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2469/4993] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:19 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1392 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:19.954548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f2df015c-cd4c-4560-8a2f-677641e097e6 tempest-ComputeTenantNetworksTest-1482477778 tempest-ComputeTenantNetworksTest-1482477778-project] Calling method '.version_select at 0x7f1e6c9fc310>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:19.956785 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4c9d366c-97ae-4966-8c82-8c8a5f5656d4 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:19.957423 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4c9d366c-97ae-4966-8c82-8c8a5f5656d4 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:19.965826 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c9d366c-97ae-4966-8c82-8c8a5f5656d4 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:19.966365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c9d366c-97ae-4966-8c82-8c8a5f5656d4 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:19.966816 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c9d366c-97ae-4966-8c82-8c8a5f5656d4 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:19.967541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c9d366c-97ae-4966-8c82-8c8a5f5656d4 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:19.968007 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c9d366c-97ae-4966-8c82-8c8a5f5656d4 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:19.968440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c9d366c-97ae-4966-8c82-8c8a5f5656d4 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:20.720389 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f2df015c-cd4c-4560-8a2f-677641e097e6 tempest-ComputeTenantNetworksTest-1482477778 tempest-ComputeTenantNetworksTest-1482477778-project] 10.222.0.93 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.847448 Aug 04 17:16:20.721205 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2525/4994] 10.222.0.93 () {58 vars in 1158 bytes} [Thu Aug 4 17:16:19 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:16:20.732653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-90b24684-866e-4018-a3f2-1c9612640778 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:20.733538 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-90b24684-866e-4018-a3f2-1c9612640778 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:20.753407 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90b24684-866e-4018-a3f2-1c9612640778 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:20.759570 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90b24684-866e-4018-a3f2-1c9612640778 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:20.760312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90b24684-866e-4018-a3f2-1c9612640778 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:20.761251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90b24684-866e-4018-a3f2-1c9612640778 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:20.761884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90b24684-866e-4018-a3f2-1c9612640778 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:20.762707 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90b24684-866e-4018-a3f2-1c9612640778 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:20.819528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4c9d366c-97ae-4966-8c82-8c8a5f5656d4 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:20.835683 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4c9d366c-97ae-4966-8c82-8c8a5f5656d4 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1323 microversion: 2.1 time: 0.882669 Aug 04 17:16:20.839656 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2470/4995] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:19 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1323 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:20.856590 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-135a464d-92f7-4fed-b0f5-b0787fb56689 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:20.857385 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-135a464d-92f7-4fed-b0f5-b0787fb56689 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:20.876911 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-135a464d-92f7-4fed-b0f5-b0787fb56689 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:20.877790 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-135a464d-92f7-4fed-b0f5-b0787fb56689 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:20.879286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-135a464d-92f7-4fed-b0f5-b0787fb56689 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:20.882633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-135a464d-92f7-4fed-b0f5-b0787fb56689 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:20.883552 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-135a464d-92f7-4fed-b0f5-b0787fb56689 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:20.885936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-135a464d-92f7-4fed-b0f5-b0787fb56689 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:21.051635 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-135a464d-92f7-4fed-b0f5-b0787fb56689 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:21.079041 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-135a464d-92f7-4fed-b0f5-b0787fb56689 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:21.081401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-135a464d-92f7-4fed-b0f5-b0787fb56689 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:21.087857 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-135a464d-92f7-4fed-b0f5-b0787fb56689 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1657 microversion: 2.20 time: 0.245726 Aug 04 17:16:21.092686 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2471/4996] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:16:20 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1657 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:16:21.104868 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-4b211936-f346-468d-abd4-4120be739e22 req-fbb6166e-a997-4ebe-8d13-6b6e94b1dd25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6b1716-bb14-4f97-bc75-38403c1c1af0", "name": "network-vif-plugged", "status": "completed", "tag": "1e3189db-ad91-4d9e-bfe5-7b700963e0d9"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:21.117361 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-90b24684-866e-4018-a3f2-1c9612640778 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:21.132893 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-90b24684-866e-4018-a3f2-1c9612640778 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 200 len: 1494 microversion: 2.1 time: 0.404230 Aug 04 17:16:21.136519 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2526/4997] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:20 2022] GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 1494 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:21.145261 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3071bf5b-cd32-44a8-ad6f-94c7de1aaf52 tempest-ComputeTenantNetworksTest-1482477778 tempest-ComputeTenantNetworksTest-1482477778-project] Calling method '.version_select at 0x7f1e5ad38040>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:21.148669 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4b211936-f346-468d-abd4-4120be739e22 req-fbb6166e-a997-4ebe-8d13-6b6e94b1dd25 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:21.156664 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4b211936-f346-468d-abd4-4120be739e22 req-fbb6166e-a997-4ebe-8d13-6b6e94b1dd25 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:21.157211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4b211936-f346-468d-abd4-4120be739e22 req-fbb6166e-a997-4ebe-8d13-6b6e94b1dd25 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:21.185557 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-4b211936-f346-468d-abd4-4120be739e22 req-fbb6166e-a997-4ebe-8d13-6b6e94b1dd25 service nova] Creating event network-vif-plugged:1e3189db-ad91-4d9e-bfe5-7b700963e0d9 for instance 9c6b1716-bb14-4f97-bc75-38403c1c1af0 on n-h2-851359-3 Aug 04 17:16:21.195004 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-4b211936-f346-468d-abd4-4120be739e22 req-fbb6166e-a997-4ebe-8d13-6b6e94b1dd25 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100637 Aug 04 17:16:21.197380 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2472/4998] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:16:21.209472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-773a87b3-5c23-482a-b1a6-74726b3b0c9a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:21.210091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-773a87b3-5c23-482a-b1a6-74726b3b0c9a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:21.226106 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-773a87b3-5c23-482a-b1a6-74726b3b0c9a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:21.229610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-773a87b3-5c23-482a-b1a6-74726b3b0c9a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:21.231196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-773a87b3-5c23-482a-b1a6-74726b3b0c9a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:21.232120 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-773a87b3-5c23-482a-b1a6-74726b3b0c9a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:21.232961 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-773a87b3-5c23-482a-b1a6-74726b3b0c9a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:21.257385 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-773a87b3-5c23-482a-b1a6-74726b3b0c9a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:21.650290 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3071bf5b-cd32-44a8-ad6f-94c7de1aaf52 tempest-ComputeTenantNetworksTest-1482477778 tempest-ComputeTenantNetworksTest-1482477778-project] 10.222.0.93 "GET /compute/v2.1/os-tenant-networks/5da6b8ed-4a67-42d1-b8c7-f795641c3bb2" status: 200 len: 140 microversion: 2.1 time: 0.512537 Aug 04 17:16:21.651204 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2527/4999] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Aug 4 17:16:21 2022] GET /compute/v2.1/os-tenant-networks/5da6b8ed-4a67-42d1-b8c7-f795641c3bb2 => generated 140 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:16:21.655991 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-74fe5c6e-39bb-416d-be49-c97ccf30ef7f req-7044d6e5-acbe-4c09-8581-0045a2b9f7b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c682c4f-3eed-44cd-9782-3ed12f2d8f0d", "name": "network-vif-deleted", "tag": "8b60e742-6e36-45ea-a5d7-62315ea560df"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:21.678182 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-74fe5c6e-39bb-416d-be49-c97ccf30ef7f req-7044d6e5-acbe-4c09-8581-0045a2b9f7b8 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:21.678696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-74fe5c6e-39bb-416d-be49-c97ccf30ef7f req-7044d6e5-acbe-4c09-8581-0045a2b9f7b8 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:21.679143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-74fe5c6e-39bb-416d-be49-c97ccf30ef7f req-7044d6e5-acbe-4c09-8581-0045a2b9f7b8 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:21.705424 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-74fe5c6e-39bb-416d-be49-c97ccf30ef7f req-7044d6e5-acbe-4c09-8581-0045a2b9f7b8 service nova] Creating event network-vif-deleted:8b60e742-6e36-45ea-a5d7-62315ea560df for instance 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d on n-h2-851359-3 Aug 04 17:16:21.724339 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-74fe5c6e-39bb-416d-be49-c97ccf30ef7f req-7044d6e5-acbe-4c09-8581-0045a2b9f7b8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071462 Aug 04 17:16:21.725677 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2528/5000] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:16:21.828823 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-773a87b3-5c23-482a-b1a6-74726b3b0c9a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:21.832835 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-35502f0c-b97e-4254-97c3-58c0b0bf5295 req-87ec39fe-9f7b-4a02-8921-d724819a3518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03515f0c-da1f-4541-82b2-6b83b1b2e594", "name": "network-vif-deleted", "tag": "4e1c6c3d-0baa-4054-ac8f-d8eea01402f1"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:21.845730 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-773a87b3-5c23-482a-b1a6-74726b3b0c9a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1392 microversion: 2.1 time: 0.639604 Aug 04 17:16:21.848848 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2473/5001] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:21 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1392 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:21.873292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e7f1b5df-35c9-4afe-9ed5-5da5f8ba9949 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:21.874301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e7f1b5df-35c9-4afe-9ed5-5da5f8ba9949 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:21.875449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-35502f0c-b97e-4254-97c3-58c0b0bf5295 req-87ec39fe-9f7b-4a02-8921-d724819a3518 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:21.882448 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7f1b5df-35c9-4afe-9ed5-5da5f8ba9949 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:21.883511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7f1b5df-35c9-4afe-9ed5-5da5f8ba9949 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:21.884633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-35502f0c-b97e-4254-97c3-58c0b0bf5295 req-87ec39fe-9f7b-4a02-8921-d724819a3518 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:21.885086 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7f1b5df-35c9-4afe-9ed5-5da5f8ba9949 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:21.886129 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7f1b5df-35c9-4afe-9ed5-5da5f8ba9949 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:21.886803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7f1b5df-35c9-4afe-9ed5-5da5f8ba9949 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:21.887672 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7f1b5df-35c9-4afe-9ed5-5da5f8ba9949 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:21.899348 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-35502f0c-b97e-4254-97c3-58c0b0bf5295 req-87ec39fe-9f7b-4a02-8921-d724819a3518 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:21.956678 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-35502f0c-b97e-4254-97c3-58c0b0bf5295 req-87ec39fe-9f7b-4a02-8921-d724819a3518 service nova] Creating event network-vif-deleted:4e1c6c3d-0baa-4054-ac8f-d8eea01402f1 for instance 03515f0c-da1f-4541-82b2-6b83b1b2e594 on n-h1-851359-3 Aug 04 17:16:21.972509 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-35502f0c-b97e-4254-97c3-58c0b0bf5295 req-87ec39fe-9f7b-4a02-8921-d724819a3518 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143959 Aug 04 17:16:21.978256 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2529/5002] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:16:22.123901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ec3f204b-ee33-4a05-8665-5bbd8b5f863e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:22.125027 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ec3f204b-ee33-4a05-8665-5bbd8b5f863e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:22.168608 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec3f204b-ee33-4a05-8665-5bbd8b5f863e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:22.169694 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec3f204b-ee33-4a05-8665-5bbd8b5f863e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:22.171376 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec3f204b-ee33-4a05-8665-5bbd8b5f863e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:22.172619 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec3f204b-ee33-4a05-8665-5bbd8b5f863e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:22.175889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec3f204b-ee33-4a05-8665-5bbd8b5f863e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:22.176306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec3f204b-ee33-4a05-8665-5bbd8b5f863e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:22.272131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec3f204b-ee33-4a05-8665-5bbd8b5f863e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:22.273724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec3f204b-ee33-4a05-8665-5bbd8b5f863e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:22.274338 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec3f204b-ee33-4a05-8665-5bbd8b5f863e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:22.276320 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-ec3f204b-ee33-4a05-8665-5bbd8b5f863e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lazy-loading 'fault' on Instance uuid 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:16:22.307409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e7f1b5df-35c9-4afe-9ed5-5da5f8ba9949 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:22.328246 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e7f1b5df-35c9-4afe-9ed5-5da5f8ba9949 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1519 microversion: 2.1 time: 0.461709 Aug 04 17:16:22.328948 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2474/5003] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:21 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1519 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:22.346286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-30049e5a-fee6-4c18-8f76-556737a11f28 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:22.347355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-30049e5a-fee6-4c18-8f76-556737a11f28 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:22.380568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-30049e5a-fee6-4c18-8f76-556737a11f28 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:22.385504 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-30049e5a-fee6-4c18-8f76-556737a11f28 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:22.389122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-30049e5a-fee6-4c18-8f76-556737a11f28 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:22.391935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-30049e5a-fee6-4c18-8f76-556737a11f28 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:22.393122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-30049e5a-fee6-4c18-8f76-556737a11f28 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:22.394233 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-30049e5a-fee6-4c18-8f76-556737a11f28 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:22.408686 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ec3f204b-ee33-4a05-8665-5bbd8b5f863e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:22.442554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ec3f204b-ee33-4a05-8665-5bbd8b5f863e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:22.448225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ec3f204b-ee33-4a05-8665-5bbd8b5f863e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:22.452952 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ec3f204b-ee33-4a05-8665-5bbd8b5f863e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 200 len: 1371 microversion: 2.20 time: 0.337133 Aug 04 17:16:22.485359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-30049e5a-fee6-4c18-8f76-556737a11f28 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:22.486279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-30049e5a-fee6-4c18-8f76-556737a11f28 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:22.486956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-30049e5a-fee6-4c18-8f76-556737a11f28 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:22.487642 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-30049e5a-fee6-4c18-8f76-556737a11f28 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lazy-loading 'fault' on Instance uuid 03515f0c-da1f-4541-82b2-6b83b1b2e594 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:16:22.489167 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2530/5004] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:16:22 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 1371 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:16:22.503709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-78ed1306-3ab5-468a-aec1-efb575c9465a tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:22.521886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-78ed1306-3ab5-468a-aec1-efb575c9465a tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:22.538495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78ed1306-3ab5-468a-aec1-efb575c9465a tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:22.539220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78ed1306-3ab5-468a-aec1-efb575c9465a tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:22.545483 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78ed1306-3ab5-468a-aec1-efb575c9465a tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:22.546413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78ed1306-3ab5-468a-aec1-efb575c9465a tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:22.546993 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78ed1306-3ab5-468a-aec1-efb575c9465a tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:22.547455 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78ed1306-3ab5-468a-aec1-efb575c9465a tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:22.593296 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-30049e5a-fee6-4c18-8f76-556737a11f28 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:22.604896 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-30049e5a-fee6-4c18-8f76-556737a11f28 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 200 len: 1309 microversion: 2.1 time: 0.274499 Aug 04 17:16:22.605783 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2475/5005] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:22 2022] GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 1309 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:22.633480 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-78ed1306-3ab5-468a-aec1-efb575c9465a tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lazy-loading 'flavor' on Instance uuid dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:16:22.798522 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-78ed1306-3ab5-468a-aec1-efb575c9465a tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "POST /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4/action" status: 200 len: 32 microversion: 2.1 time: 0.304821 Aug 04 17:16:22.803549 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2531/5006] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:16:22 2022] POST /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4/action => generated 32 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:16:22.808813 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c3d3e726-c745-4e36-8739-fc949542eb25 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:22.809441 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c3d3e726-c745-4e36-8739-fc949542eb25 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:22.819297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3d3e726-c745-4e36-8739-fc949542eb25 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:22.822270 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3d3e726-c745-4e36-8739-fc949542eb25 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:22.823715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3d3e726-c745-4e36-8739-fc949542eb25 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:22.824468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3d3e726-c745-4e36-8739-fc949542eb25 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:22.827365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3d3e726-c745-4e36-8739-fc949542eb25 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:22.827878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3d3e726-c745-4e36-8739-fc949542eb25 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:22.874736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c739503b-2120-4b91-89b8-98d3b3ab902b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:22.875568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c739503b-2120-4b91-89b8-98d3b3ab902b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:22.905704 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c739503b-2120-4b91-89b8-98d3b3ab902b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:22.916093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c739503b-2120-4b91-89b8-98d3b3ab902b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:22.916649 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c739503b-2120-4b91-89b8-98d3b3ab902b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:22.917433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c739503b-2120-4b91-89b8-98d3b3ab902b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:22.917915 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c739503b-2120-4b91-89b8-98d3b3ab902b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:22.918446 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c739503b-2120-4b91-89b8-98d3b3ab902b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:23.275760 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c3d3e726-c745-4e36-8739-fc949542eb25 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:23.290231 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c3d3e726-c745-4e36-8739-fc949542eb25 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1525 microversion: 2.1 time: 0.485175 Aug 04 17:16:23.308503 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2476/5007] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:22 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1525 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:23.358879 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c739503b-2120-4b91-89b8-98d3b3ab902b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:23.373935 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c739503b-2120-4b91-89b8-98d3b3ab902b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1392 microversion: 2.1 time: 0.504130 Aug 04 17:16:23.378100 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2532/5008] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:22 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1392 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:23.408730 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-653694a6-8958-4ddb-b4b9-ddf0f711481b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:23.409247 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-653694a6-8958-4ddb-b4b9-ddf0f711481b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:23.415992 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-653694a6-8958-4ddb-b4b9-ddf0f711481b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:23.416697 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-653694a6-8958-4ddb-b4b9-ddf0f711481b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:23.417153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-653694a6-8958-4ddb-b4b9-ddf0f711481b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:23.417908 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-653694a6-8958-4ddb-b4b9-ddf0f711481b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:23.418408 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-653694a6-8958-4ddb-b4b9-ddf0f711481b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:23.418844 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-653694a6-8958-4ddb-b4b9-ddf0f711481b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:23.454255 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-653694a6-8958-4ddb-b4b9-ddf0f711481b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba/os-volume_attachments/9b1288c3-4110-4905-836a-126b5081349f" status: 200 len: 194 microversion: 2.1 time: 0.049925 Aug 04 17:16:23.465648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-19d78a16-1cfd-48b2-9d8e-51d5e62598bb tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:23.466215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-19d78a16-1cfd-48b2-9d8e-51d5e62598bb tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:23.469549 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2477/5009] 10.222.0.93 () {58 vars in 1413 bytes} [Thu Aug 4 17:16:23 2022] GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba/os-volume_attachments/9b1288c3-4110-4905-836a-126b5081349f => generated 194 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:16:23.490671 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19d78a16-1cfd-48b2-9d8e-51d5e62598bb tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:23.490995 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1ced954a-6c7a-4e44-9252-bc166e561cef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:23.491262 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19d78a16-1cfd-48b2-9d8e-51d5e62598bb tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:23.491571 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1ced954a-6c7a-4e44-9252-bc166e561cef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:23.491713 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19d78a16-1cfd-48b2-9d8e-51d5e62598bb tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:23.492464 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19d78a16-1cfd-48b2-9d8e-51d5e62598bb tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:23.492936 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19d78a16-1cfd-48b2-9d8e-51d5e62598bb tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:23.497045 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19d78a16-1cfd-48b2-9d8e-51d5e62598bb tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:23.500536 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ced954a-6c7a-4e44-9252-bc166e561cef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:23.501912 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ced954a-6c7a-4e44-9252-bc166e561cef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:23.503064 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ced954a-6c7a-4e44-9252-bc166e561cef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:23.504062 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ced954a-6c7a-4e44-9252-bc166e561cef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:23.505151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ced954a-6c7a-4e44-9252-bc166e561cef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:23.506426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ced954a-6c7a-4e44-9252-bc166e561cef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:23.536827 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-1ced954a-6c7a-4e44-9252-bc166e561cef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] HTTP exception thrown: Instance 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d could not be found. Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1ced954a-6c7a-4e44-9252-bc166e561cef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Request method failure captured: Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d HTTP/1.1 Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_21cg1PqIDvYXgybLbIpUp4-HNyMc1ajyJOqZi0IDAb3yTDXkMJQy5pICV1Wkh8n1jB3os8RCllz2dxAPec7OcKYuuzrI5PO5yGCPDwvLtZPgHWq1aD9IW2AQdVTCs4RoF5aEJRSI9MSs9bRRtuDuDXQAsaGi4ERRQKwRryAc3dfuo Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: a2cc22c8c06b40ae961464cb3e300cba Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2110834559 Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a2cc22c8c06b40ae961464cb3e300cba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a2cc22c8c06b40ae961464cb3e300cba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a2cc22c8c06b40ae961464cb3e300cba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a2cc22c8c06b40ae961464cb3e300cba"}]}] Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2110834559 Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: a2cc22c8c06b40ae961464cb3e300cba Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2110834559 Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-AttachVolumeShelveTestJSON-2110834559-project Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 023dd49bea644899a427669f3c1b461e Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2110834559-project Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d could not be found. Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '9c682c4f-3eed-44cd-9782-3ed12f2d8f0d'} Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d could not be found. Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d could not be found. Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:23.539232 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:23.545123 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:23.545123 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:23.545123 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:23.545123 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:23.545123 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:16:23.545123 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:16:23.545123 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d could not be found. Aug 04 17:16:23.545123 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:23.548090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1ced954a-6c7a-4e44-9252-bc166e561cef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Returning 404 to user: Instance 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:16:23.549144 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1ced954a-6c7a-4e44-9252-bc166e561cef tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 404 len: 111 microversion: 2.20 time: 0.074591 Aug 04 17:16:23.552272 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2478/5010] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:16:23 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:16:23.562290 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aa46ce7f-9cb3-4b73-bbc3-1563d4a13b0f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '.version_select at 0x7f1e6c959f70>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:23.612919 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aa46ce7f-9cb3-4b73-bbc3-1563d4a13b0f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-579541935" status: 204 len: 0 microversion: 2.20 time: 0.058574 Aug 04 17:16:23.614139 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2479/5011] 10.222.0.93 () {60 vars in 1259 bytes} [Thu Aug 4 17:16:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-579541935 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 04 17:16:23.645737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d1a870d1-1330-4146-92f9-0bdd81acb240 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:23.652737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d1a870d1-1330-4146-92f9-0bdd81acb240 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:23.667745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1a870d1-1330-4146-92f9-0bdd81acb240 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:23.668832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1a870d1-1330-4146-92f9-0bdd81acb240 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:23.669507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1a870d1-1330-4146-92f9-0bdd81acb240 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:23.670536 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1a870d1-1330-4146-92f9-0bdd81acb240 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:23.673348 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1a870d1-1330-4146-92f9-0bdd81acb240 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:23.674255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1a870d1-1330-4146-92f9-0bdd81acb240 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:23.700471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-19d78a16-1cfd-48b2-9d8e-51d5e62598bb tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lazy-loading 'services' on Instance uuid 81a3d940-08e3-4cb9-bbf2-360653411aba {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:16:23.704443 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-d1a870d1-1330-4146-92f9-0bdd81acb240 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] HTTP exception thrown: Instance 03515f0c-da1f-4541-82b2-6b83b1b2e594 could not be found. Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d1a870d1-1330-4146-92f9-0bdd81acb240 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Request method failure captured: Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 HTTP/1.1 Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_4PiXAoqFPCXVrtw_fcVtbWCRHCRY1BcfprLEe-EkZEFmD3rLGum9OIJcRnH-o3xr4k8T7yl4V2Hv5h2fEBByVUFBw2XIbz_i_ncVR1MMvkDEp1AvjPEGXUtr2hnsv9JoWINOTj84eRxq_Gac5VyTIxXMDaWbVLw5VeWNnbunOt5QM Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d9911aeb77cd4ffb8c4e539998a04f3c"}]}] Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersTestJSON-1653035612 Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersTestJSON-1653035612-project Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 8e840d06bb5d44e097e6f0855b04cb06 Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersTestJSON-1653035612-project Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 03515f0c-da1f-4541-82b2-6b83b1b2e594 could not be found. Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '03515f0c-da1f-4541-82b2-6b83b1b2e594'} Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03515f0c-da1f-4541-82b2-6b83b1b2e594 could not be found. Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03515f0c-da1f-4541-82b2-6b83b1b2e594 could not be found. Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:23.706649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:23.710799 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:23.710799 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:23.710799 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:23.710799 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:16:23.710799 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:16:23.710799 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03515f0c-da1f-4541-82b2-6b83b1b2e594 could not be found. Aug 04 17:16:23.710799 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:23.710799 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d1a870d1-1330-4146-92f9-0bdd81acb240 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Returning 404 to user: Instance 03515f0c-da1f-4541-82b2-6b83b1b2e594 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:16:23.710799 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d1a870d1-1330-4146-92f9-0bdd81acb240 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 404 len: 111 microversion: 2.1 time: 0.080397 Aug 04 17:16:23.715919 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2480/5012] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:23 2022] GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:16:23.725499 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b7a934c9-9b4f-4f47-a98a-2f35a49f98ee tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:23.733507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b7a934c9-9b4f-4f47-a98a-2f35a49f98ee tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:23.752163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7a934c9-9b4f-4f47-a98a-2f35a49f98ee tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:23.752787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7a934c9-9b4f-4f47-a98a-2f35a49f98ee tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:23.755781 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7a934c9-9b4f-4f47-a98a-2f35a49f98ee tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:23.759292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7a934c9-9b4f-4f47-a98a-2f35a49f98ee tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:23.761017 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7a934c9-9b4f-4f47-a98a-2f35a49f98ee tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:23.761673 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7a934c9-9b4f-4f47-a98a-2f35a49f98ee tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:23.808351 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-b7a934c9-9b4f-4f47-a98a-2f35a49f98ee tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] HTTP exception thrown: Instance 03515f0c-da1f-4541-82b2-6b83b1b2e594 could not be found. Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b7a934c9-9b4f-4f47-a98a-2f35a49f98ee tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Request method failure captured: Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 HTTP/1.1 Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_4PiXAoqFPCXVrtw_fcVtbWCRHCRY1BcfprLEe-EkZEFmD3rLGum9OIJcRnH-o3xr4k8T7yl4V2Hv5h2fEBByVUFBw2XIbz_i_ncVR1MMvkDEp1AvjPEGXUtr2hnsv9JoWINOTj84eRxq_Gac5VyTIxXMDaWbVLw5VeWNnbunOt5QM Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d9911aeb77cd4ffb8c4e539998a04f3c"}]}] Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersTestJSON-1653035612 Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersTestJSON-1653035612-project Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 8e840d06bb5d44e097e6f0855b04cb06 Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersTestJSON-1653035612-project Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 03515f0c-da1f-4541-82b2-6b83b1b2e594 could not be found. Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '03515f0c-da1f-4541-82b2-6b83b1b2e594'} Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03515f0c-da1f-4541-82b2-6b83b1b2e594 could not be found. Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:16:23.815885 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03515f0c-da1f-4541-82b2-6b83b1b2e594 could not be found. Aug 04 17:16:23.820068 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:23.820068 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:23.820068 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:23.820068 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:23.820068 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:23.820068 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:23.820068 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:16:23.820068 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:16:23.820068 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03515f0c-da1f-4541-82b2-6b83b1b2e594 could not be found. Aug 04 17:16:23.820068 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:23.820068 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b7a934c9-9b4f-4f47-a98a-2f35a49f98ee tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Returning 404 to user: Instance 03515f0c-da1f-4541-82b2-6b83b1b2e594 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:16:23.820068 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b7a934c9-9b4f-4f47-a98a-2f35a49f98ee tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "DELETE /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 404 len: 111 microversion: 2.1 time: 0.096845 Aug 04 17:16:23.825251 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2481/5013] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:16:23 2022] DELETE /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:16:23.839906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fe8c6522-5e32-4442-9009-2443755c8ad0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:23.840571 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fe8c6522-5e32-4442-9009-2443755c8ad0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 03515f0c-da1f-4541-82b2-6b83b1b2e594] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:23.855640 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-19d78a16-1cfd-48b2-9d8e-51d5e62598bb tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "DELETE /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba/os-volume_attachments/9b1288c3-4110-4905-836a-126b5081349f" status: 202 len: 0 microversion: 2.1 time: 0.393877 Aug 04 17:16:23.866532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe8c6522-5e32-4442-9009-2443755c8ad0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:23.867041 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe8c6522-5e32-4442-9009-2443755c8ad0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:23.867493 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe8c6522-5e32-4442-9009-2443755c8ad0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:23.869030 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe8c6522-5e32-4442-9009-2443755c8ad0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:23.869345 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe8c6522-5e32-4442-9009-2443755c8ad0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:23.869682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe8c6522-5e32-4442-9009-2443755c8ad0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:23.876414 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2533/5014] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Aug 4 17:16:23 2022] DELETE /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba/os-volume_attachments/9b1288c3-4110-4905-836a-126b5081349f => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:16:23.931642 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-fe8c6522-5e32-4442-9009-2443755c8ad0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] HTTP exception thrown: Instance 03515f0c-da1f-4541-82b2-6b83b1b2e594 could not be found. Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fe8c6522-5e32-4442-9009-2443755c8ad0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Request method failure captured: Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 HTTP/1.1 Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_4PiXAoqFPCXVrtw_fcVtbWCRHCRY1BcfprLEe-EkZEFmD3rLGum9OIJcRnH-o3xr4k8T7yl4V2Hv5h2fEBByVUFBw2XIbz_i_ncVR1MMvkDEp1AvjPEGXUtr2hnsv9JoWINOTj84eRxq_Gac5VyTIxXMDaWbVLw5VeWNnbunOt5QM Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d9911aeb77cd4ffb8c4e539998a04f3c"}]}] Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersTestJSON-1653035612 Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersTestJSON-1653035612-project Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 8e840d06bb5d44e097e6f0855b04cb06 Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersTestJSON-1653035612-project Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 03515f0c-da1f-4541-82b2-6b83b1b2e594 could not be found. Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '03515f0c-da1f-4541-82b2-6b83b1b2e594'} Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03515f0c-da1f-4541-82b2-6b83b1b2e594 could not be found. Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03515f0c-da1f-4541-82b2-6b83b1b2e594 could not be found. Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:23.939220 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:23.944009 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:23.944009 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:23.944009 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:23.944009 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:16:23.944009 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:16:23.944009 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03515f0c-da1f-4541-82b2-6b83b1b2e594 could not be found. Aug 04 17:16:23.944009 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:23.945510 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fe8c6522-5e32-4442-9009-2443755c8ad0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Returning 404 to user: Instance 03515f0c-da1f-4541-82b2-6b83b1b2e594 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:16:23.948550 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fe8c6522-5e32-4442-9009-2443755c8ad0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594" status: 404 len: 111 microversion: 2.1 time: 0.122241 Aug 04 17:16:23.951668 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2482/5015] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:23 2022] GET /compute/v2.1/servers/03515f0c-da1f-4541-82b2-6b83b1b2e594 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:16:23.964291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-924c2bda-bfbf-456a-ae65-0b73eeeecc88 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:23.964905 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-924c2bda-bfbf-456a-ae65-0b73eeeecc88 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 314e3218-a990-4be2-aef1-d69a055897e9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:24.006061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-924c2bda-bfbf-456a-ae65-0b73eeeecc88 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:24.013563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-924c2bda-bfbf-456a-ae65-0b73eeeecc88 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:24.014424 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-924c2bda-bfbf-456a-ae65-0b73eeeecc88 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:24.016288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-924c2bda-bfbf-456a-ae65-0b73eeeecc88 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:24.016795 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-924c2bda-bfbf-456a-ae65-0b73eeeecc88 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:24.017325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-924c2bda-bfbf-456a-ae65-0b73eeeecc88 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:24.080518 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:24.081903 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-924c2bda-bfbf-456a-ae65-0b73eeeecc88 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] HTTP exception thrown: Instance 314e3218-a990-4be2-aef1-d69a055897e9 could not be found. Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-924c2bda-bfbf-456a-ae65-0b73eeeecc88 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Request method failure captured: Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9 HTTP/1.1 Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_4PiXAoqFPCXVrtw_fcVtbWCRHCRY1BcfprLEe-EkZEFmD3rLGum9OIJcRnH-o3xr4k8T7yl4V2Hv5h2fEBByVUFBw2XIbz_i_ncVR1MMvkDEp1AvjPEGXUtr2hnsv9JoWINOTj84eRxq_Gac5VyTIxXMDaWbVLw5VeWNnbunOt5QM Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d9911aeb77cd4ffb8c4e539998a04f3c"}]}] Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersTestJSON-1653035612 Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersTestJSON-1653035612-project Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 8e840d06bb5d44e097e6f0855b04cb06 Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersTestJSON-1653035612-project Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 314e3218-a990-4be2-aef1-d69a055897e9 could not be found. Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '314e3218-a990-4be2-aef1-d69a055897e9'} Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 314e3218-a990-4be2-aef1-d69a055897e9 could not be found. Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:16:24.084255 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 314e3218-a990-4be2-aef1-d69a055897e9 could not be found. Aug 04 17:16:24.088867 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.088867 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:24.088867 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.088867 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:24.088867 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:24.088867 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:24.088867 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:16:24.088867 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:16:24.088867 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 314e3218-a990-4be2-aef1-d69a055897e9 could not be found. Aug 04 17:16:24.088867 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.093147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-924c2bda-bfbf-456a-ae65-0b73eeeecc88 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Returning 404 to user: Instance 314e3218-a990-4be2-aef1-d69a055897e9 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:16:24.097305 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-924c2bda-bfbf-456a-ae65-0b73eeeecc88 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "DELETE /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9" status: 404 len: 111 microversion: 2.1 time: 0.140225 Aug 04 17:16:24.100874 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2534/5016] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:16:23 2022] DELETE /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:16:24.109666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-25d6a964-b9a9-4d24-8cd3-3af62ef0f4d0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:24.110482 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-25d6a964-b9a9-4d24-8cd3-3af62ef0f4d0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 314e3218-a990-4be2-aef1-d69a055897e9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:24.121131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25d6a964-b9a9-4d24-8cd3-3af62ef0f4d0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:24.121652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25d6a964-b9a9-4d24-8cd3-3af62ef0f4d0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:24.122145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25d6a964-b9a9-4d24-8cd3-3af62ef0f4d0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:24.122873 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25d6a964-b9a9-4d24-8cd3-3af62ef0f4d0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:24.123347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25d6a964-b9a9-4d24-8cd3-3af62ef0f4d0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:24.123764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25d6a964-b9a9-4d24-8cd3-3af62ef0f4d0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:24.158744 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-25d6a964-b9a9-4d24-8cd3-3af62ef0f4d0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] HTTP exception thrown: Instance 314e3218-a990-4be2-aef1-d69a055897e9 could not be found. Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-25d6a964-b9a9-4d24-8cd3-3af62ef0f4d0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Request method failure captured: Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9 HTTP/1.1 Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_4PiXAoqFPCXVrtw_fcVtbWCRHCRY1BcfprLEe-EkZEFmD3rLGum9OIJcRnH-o3xr4k8T7yl4V2Hv5h2fEBByVUFBw2XIbz_i_ncVR1MMvkDEp1AvjPEGXUtr2hnsv9JoWINOTj84eRxq_Gac5VyTIxXMDaWbVLw5VeWNnbunOt5QM Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d9911aeb77cd4ffb8c4e539998a04f3c"}]}] Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersTestJSON-1653035612 Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersTestJSON-1653035612-project Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 8e840d06bb5d44e097e6f0855b04cb06 Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersTestJSON-1653035612-project Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 314e3218-a990-4be2-aef1-d69a055897e9 could not be found. Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '314e3218-a990-4be2-aef1-d69a055897e9'} Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 314e3218-a990-4be2-aef1-d69a055897e9 could not be found. Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 314e3218-a990-4be2-aef1-d69a055897e9 could not be found. Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:24.166361 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.170695 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:24.170695 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:24.170695 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:24.170695 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:16:24.170695 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:16:24.170695 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 314e3218-a990-4be2-aef1-d69a055897e9 could not be found. Aug 04 17:16:24.170695 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.174005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-25d6a964-b9a9-4d24-8cd3-3af62ef0f4d0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Returning 404 to user: Instance 314e3218-a990-4be2-aef1-d69a055897e9 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:16:24.176163 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-25d6a964-b9a9-4d24-8cd3-3af62ef0f4d0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9" status: 404 len: 111 microversion: 2.1 time: 0.070338 Aug 04 17:16:24.178854 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2483/5017] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:24 2022] GET /compute/v2.1/servers/314e3218-a990-4be2-aef1-d69a055897e9 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:16:24.187255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5aa938b9-fa5b-4191-af2c-0ee502bb35aa tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:24.187774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5aa938b9-fa5b-4191-af2c-0ee502bb35aa tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b27bb91b-1dab-4d8a-b388-09b2427931a9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:24.197251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5aa938b9-fa5b-4191-af2c-0ee502bb35aa tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:24.199927 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5aa938b9-fa5b-4191-af2c-0ee502bb35aa tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:24.200411 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5aa938b9-fa5b-4191-af2c-0ee502bb35aa tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:24.201157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5aa938b9-fa5b-4191-af2c-0ee502bb35aa tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:24.201629 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5aa938b9-fa5b-4191-af2c-0ee502bb35aa tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:24.202101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5aa938b9-fa5b-4191-af2c-0ee502bb35aa tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:24.226067 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-5aa938b9-fa5b-4191-af2c-0ee502bb35aa tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] HTTP exception thrown: Instance b27bb91b-1dab-4d8a-b388-09b2427931a9 could not be found. Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5aa938b9-fa5b-4191-af2c-0ee502bb35aa tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Request method failure captured: Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9 HTTP/1.1 Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_4PiXAoqFPCXVrtw_fcVtbWCRHCRY1BcfprLEe-EkZEFmD3rLGum9OIJcRnH-o3xr4k8T7yl4V2Hv5h2fEBByVUFBw2XIbz_i_ncVR1MMvkDEp1AvjPEGXUtr2hnsv9JoWINOTj84eRxq_Gac5VyTIxXMDaWbVLw5VeWNnbunOt5QM Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d9911aeb77cd4ffb8c4e539998a04f3c"}]}] Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersTestJSON-1653035612 Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersTestJSON-1653035612-project Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 8e840d06bb5d44e097e6f0855b04cb06 Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersTestJSON-1653035612-project Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance b27bb91b-1dab-4d8a-b388-09b2427931a9 could not be found. Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'b27bb91b-1dab-4d8a-b388-09b2427931a9'} Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b27bb91b-1dab-4d8a-b388-09b2427931a9 could not be found. Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:16:24.228425 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b27bb91b-1dab-4d8a-b388-09b2427931a9 could not be found. Aug 04 17:16:24.232388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.232388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:24.232388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.232388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:24.232388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:24.232388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:24.232388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:16:24.232388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:16:24.232388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b27bb91b-1dab-4d8a-b388-09b2427931a9 could not be found. Aug 04 17:16:24.232388 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.234631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5aa938b9-fa5b-4191-af2c-0ee502bb35aa tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Returning 404 to user: Instance b27bb91b-1dab-4d8a-b388-09b2427931a9 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:16:24.235980 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5aa938b9-fa5b-4191-af2c-0ee502bb35aa tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9" status: 404 len: 111 microversion: 2.1 time: 0.052705 Aug 04 17:16:24.237114 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2535/5018] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:16:24 2022] DELETE /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:16:24.246446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0144e5ea-7d32-4b43-953e-b4a67b4e890b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:24.247499 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0144e5ea-7d32-4b43-953e-b4a67b4e890b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b27bb91b-1dab-4d8a-b388-09b2427931a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:24.254767 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0144e5ea-7d32-4b43-953e-b4a67b4e890b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:24.255669 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0144e5ea-7d32-4b43-953e-b4a67b4e890b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:24.256438 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0144e5ea-7d32-4b43-953e-b4a67b4e890b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:24.257457 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0144e5ea-7d32-4b43-953e-b4a67b4e890b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:24.258202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0144e5ea-7d32-4b43-953e-b4a67b4e890b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:24.258906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0144e5ea-7d32-4b43-953e-b4a67b4e890b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:24.294890 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-0144e5ea-7d32-4b43-953e-b4a67b4e890b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] HTTP exception thrown: Instance b27bb91b-1dab-4d8a-b388-09b2427931a9 could not be found. Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0144e5ea-7d32-4b43-953e-b4a67b4e890b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Request method failure captured: Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9 HTTP/1.1 Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_4PiXAoqFPCXVrtw_fcVtbWCRHCRY1BcfprLEe-EkZEFmD3rLGum9OIJcRnH-o3xr4k8T7yl4V2Hv5h2fEBByVUFBw2XIbz_i_ncVR1MMvkDEp1AvjPEGXUtr2hnsv9JoWINOTj84eRxq_Gac5VyTIxXMDaWbVLw5VeWNnbunOt5QM Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d9911aeb77cd4ffb8c4e539998a04f3c"}]}] Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersTestJSON-1653035612 Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersTestJSON-1653035612-project Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 8e840d06bb5d44e097e6f0855b04cb06 Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersTestJSON-1653035612-project Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance b27bb91b-1dab-4d8a-b388-09b2427931a9 could not be found. Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'b27bb91b-1dab-4d8a-b388-09b2427931a9'} Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b27bb91b-1dab-4d8a-b388-09b2427931a9 could not be found. Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b27bb91b-1dab-4d8a-b388-09b2427931a9 could not be found. Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:24.296492 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.300299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:24.300299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:24.300299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:24.300299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:16:24.300299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:16:24.300299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b27bb91b-1dab-4d8a-b388-09b2427931a9 could not be found. Aug 04 17:16:24.300299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.300299 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0144e5ea-7d32-4b43-953e-b4a67b4e890b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Returning 404 to user: Instance b27bb91b-1dab-4d8a-b388-09b2427931a9 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:16:24.300299 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0144e5ea-7d32-4b43-953e-b4a67b4e890b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9" status: 404 len: 111 microversion: 2.1 time: 0.056311 Aug 04 17:16:24.301553 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2484/5019] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:24 2022] GET /compute/v2.1/servers/b27bb91b-1dab-4d8a-b388-09b2427931a9 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:16:24.313139 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-12703ec1-fc5c-412e-a303-16205de1c9dc tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:24.314049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-12703ec1-fc5c-412e-a303-16205de1c9dc tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:24.318972 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d673b207-f60a-490a-b897-84178c71e55b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:24.321026 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d673b207-f60a-490a-b897-84178c71e55b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: edc8a6ac-f4f5-496f-867e-27b1ed15c833] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:24.332371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d673b207-f60a-490a-b897-84178c71e55b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:24.332977 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d673b207-f60a-490a-b897-84178c71e55b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:24.333523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d673b207-f60a-490a-b897-84178c71e55b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:24.334599 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d673b207-f60a-490a-b897-84178c71e55b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:24.335191 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d673b207-f60a-490a-b897-84178c71e55b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:24.335841 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d673b207-f60a-490a-b897-84178c71e55b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:24.340410 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12703ec1-fc5c-412e-a303-16205de1c9dc tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:24.341035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12703ec1-fc5c-412e-a303-16205de1c9dc tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:24.342249 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12703ec1-fc5c-412e-a303-16205de1c9dc tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:24.343479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12703ec1-fc5c-412e-a303-16205de1c9dc tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:24.343982 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12703ec1-fc5c-412e-a303-16205de1c9dc tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:24.344425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12703ec1-fc5c-412e-a303-16205de1c9dc tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:24.354450 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-d673b207-f60a-490a-b897-84178c71e55b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] HTTP exception thrown: Instance edc8a6ac-f4f5-496f-867e-27b1ed15c833 could not be found. Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d673b207-f60a-490a-b897-84178c71e55b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Request method failure captured: Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833 HTTP/1.1 Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_4PiXAoqFPCXVrtw_fcVtbWCRHCRY1BcfprLEe-EkZEFmD3rLGum9OIJcRnH-o3xr4k8T7yl4V2Hv5h2fEBByVUFBw2XIbz_i_ncVR1MMvkDEp1AvjPEGXUtr2hnsv9JoWINOTj84eRxq_Gac5VyTIxXMDaWbVLw5VeWNnbunOt5QM Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d9911aeb77cd4ffb8c4e539998a04f3c"}]}] Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersTestJSON-1653035612 Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersTestJSON-1653035612-project Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 8e840d06bb5d44e097e6f0855b04cb06 Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersTestJSON-1653035612-project Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance edc8a6ac-f4f5-496f-867e-27b1ed15c833 could not be found. Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'edc8a6ac-f4f5-496f-867e-27b1ed15c833'} Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc8a6ac-f4f5-496f-867e-27b1ed15c833 could not be found. Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:16:24.356433 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc8a6ac-f4f5-496f-867e-27b1ed15c833 could not be found. Aug 04 17:16:24.360231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.360231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:24.360231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.360231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:24.360231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:24.360231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:24.360231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:16:24.360231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:16:24.360231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc8a6ac-f4f5-496f-867e-27b1ed15c833 could not be found. Aug 04 17:16:24.360231 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.362521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d673b207-f60a-490a-b897-84178c71e55b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Returning 404 to user: Instance edc8a6ac-f4f5-496f-867e-27b1ed15c833 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:16:24.363620 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d673b207-f60a-490a-b897-84178c71e55b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "DELETE /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833" status: 404 len: 111 microversion: 2.1 time: 0.057583 Aug 04 17:16:24.364703 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2536/5020] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:16:24 2022] DELETE /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:16:24.375927 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-770ee6a7-08cb-488c-bb04-3b0b04fc0447 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:24.378231 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-770ee6a7-08cb-488c-bb04-3b0b04fc0447 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: edc8a6ac-f4f5-496f-867e-27b1ed15c833] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:24.389878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-770ee6a7-08cb-488c-bb04-3b0b04fc0447 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:24.390576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-770ee6a7-08cb-488c-bb04-3b0b04fc0447 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:24.391519 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-770ee6a7-08cb-488c-bb04-3b0b04fc0447 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:24.392342 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-770ee6a7-08cb-488c-bb04-3b0b04fc0447 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:24.393018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-770ee6a7-08cb-488c-bb04-3b0b04fc0447 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:24.393539 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-770ee6a7-08cb-488c-bb04-3b0b04fc0447 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:24.419415 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-770ee6a7-08cb-488c-bb04-3b0b04fc0447 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] HTTP exception thrown: Instance edc8a6ac-f4f5-496f-867e-27b1ed15c833 could not be found. Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-770ee6a7-08cb-488c-bb04-3b0b04fc0447 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Request method failure captured: Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833 HTTP/1.1 Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_4PiXAoqFPCXVrtw_fcVtbWCRHCRY1BcfprLEe-EkZEFmD3rLGum9OIJcRnH-o3xr4k8T7yl4V2Hv5h2fEBByVUFBw2XIbz_i_ncVR1MMvkDEp1AvjPEGXUtr2hnsv9JoWINOTj84eRxq_Gac5VyTIxXMDaWbVLw5VeWNnbunOt5QM Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d9911aeb77cd4ffb8c4e539998a04f3c"}]}] Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersTestJSON-1653035612 Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersTestJSON-1653035612-project Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 8e840d06bb5d44e097e6f0855b04cb06 Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersTestJSON-1653035612-project Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance edc8a6ac-f4f5-496f-867e-27b1ed15c833 could not be found. Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'edc8a6ac-f4f5-496f-867e-27b1ed15c833'} Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc8a6ac-f4f5-496f-867e-27b1ed15c833 could not be found. Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc8a6ac-f4f5-496f-867e-27b1ed15c833 could not be found. Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:24.422881 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.426749 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:24.426749 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:24.426749 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:24.426749 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:16:24.426749 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:16:24.426749 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc8a6ac-f4f5-496f-867e-27b1ed15c833 could not be found. Aug 04 17:16:24.426749 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.426749 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-770ee6a7-08cb-488c-bb04-3b0b04fc0447 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Returning 404 to user: Instance edc8a6ac-f4f5-496f-867e-27b1ed15c833 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:16:24.426749 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-770ee6a7-08cb-488c-bb04-3b0b04fc0447 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833" status: 404 len: 111 microversion: 2.1 time: 0.053289 Aug 04 17:16:24.426749 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2537/5021] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:24 2022] GET /compute/v2.1/servers/edc8a6ac-f4f5-496f-867e-27b1ed15c833 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:16:24.438027 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f9455935-81ad-4601-870a-ec3b7a2643b7 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:24.438926 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f9455935-81ad-4601-870a-ec3b7a2643b7 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:24.444998 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9455935-81ad-4601-870a-ec3b7a2643b7 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:24.445496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9455935-81ad-4601-870a-ec3b7a2643b7 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:24.445937 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9455935-81ad-4601-870a-ec3b7a2643b7 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:24.446736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9455935-81ad-4601-870a-ec3b7a2643b7 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:24.447209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9455935-81ad-4601-870a-ec3b7a2643b7 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:24.447648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9455935-81ad-4601-870a-ec3b7a2643b7 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:24.599329 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-12703ec1-fc5c-412e-a303-16205de1c9dc tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:24.610100 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-12703ec1-fc5c-412e-a303-16205de1c9dc tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1525 microversion: 2.1 time: 0.299680 Aug 04 17:16:24.611318 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2485/5022] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:24 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1525 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:16:24.627833 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3c77a146-0d18-4482-a222-ec4dc92cfd8b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:24.628362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3c77a146-0d18-4482-a222-ec4dc92cfd8b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 43df9f1d-da75-43f5-90ae-e5eaacdb4f02] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:24.635767 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c77a146-0d18-4482-a222-ec4dc92cfd8b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:24.636639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c77a146-0d18-4482-a222-ec4dc92cfd8b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:24.637254 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c77a146-0d18-4482-a222-ec4dc92cfd8b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:24.638164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c77a146-0d18-4482-a222-ec4dc92cfd8b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:24.639110 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c77a146-0d18-4482-a222-ec4dc92cfd8b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:24.639711 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c77a146-0d18-4482-a222-ec4dc92cfd8b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:24.660670 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-3c77a146-0d18-4482-a222-ec4dc92cfd8b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] HTTP exception thrown: Instance 43df9f1d-da75-43f5-90ae-e5eaacdb4f02 could not be found. Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3c77a146-0d18-4482-a222-ec4dc92cfd8b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Request method failure captured: Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02 HTTP/1.1 Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_4PiXAoqFPCXVrtw_fcVtbWCRHCRY1BcfprLEe-EkZEFmD3rLGum9OIJcRnH-o3xr4k8T7yl4V2Hv5h2fEBByVUFBw2XIbz_i_ncVR1MMvkDEp1AvjPEGXUtr2hnsv9JoWINOTj84eRxq_Gac5VyTIxXMDaWbVLw5VeWNnbunOt5QM Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d9911aeb77cd4ffb8c4e539998a04f3c"}]}] Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersTestJSON-1653035612 Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersTestJSON-1653035612-project Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 8e840d06bb5d44e097e6f0855b04cb06 Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersTestJSON-1653035612-project Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 43df9f1d-da75-43f5-90ae-e5eaacdb4f02 could not be found. Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '43df9f1d-da75-43f5-90ae-e5eaacdb4f02'} Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43df9f1d-da75-43f5-90ae-e5eaacdb4f02 could not be found. Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:16:24.664459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43df9f1d-da75-43f5-90ae-e5eaacdb4f02 could not be found. Aug 04 17:16:24.668690 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.668690 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:24.668690 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.668690 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:24.668690 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:24.668690 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:24.668690 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:16:24.668690 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:16:24.668690 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43df9f1d-da75-43f5-90ae-e5eaacdb4f02 could not be found. Aug 04 17:16:24.668690 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.670237 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f9455935-81ad-4601-870a-ec3b7a2643b7 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:24.671470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3c77a146-0d18-4482-a222-ec4dc92cfd8b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Returning 404 to user: Instance 43df9f1d-da75-43f5-90ae-e5eaacdb4f02 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:16:24.673001 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3c77a146-0d18-4482-a222-ec4dc92cfd8b tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "DELETE /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02" status: 404 len: 111 microversion: 2.1 time: 0.059896 Aug 04 17:16:24.673373 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f9455935-81ad-4601-870a-ec3b7a2643b7 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1564 microversion: 2.1 time: 0.247336 Aug 04 17:16:24.674335 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2538/5023] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:24 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1564 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:24.686644 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2486/5024] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:16:24 2022] DELETE /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:16:24.698270 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-84589d0d-ea23-494b-abb3-958f32efbcd0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:24.699374 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b0d9a4bc-433b-4525-814b-bfe6c18eae6d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:24.699923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-84589d0d-ea23-494b-abb3-958f32efbcd0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 43df9f1d-da75-43f5-90ae-e5eaacdb4f02] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:24.700633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b0d9a4bc-433b-4525-814b-bfe6c18eae6d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:24.707707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0d9a4bc-433b-4525-814b-bfe6c18eae6d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:24.708263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84589d0d-ea23-494b-abb3-958f32efbcd0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:24.708898 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0d9a4bc-433b-4525-814b-bfe6c18eae6d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:24.709058 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84589d0d-ea23-494b-abb3-958f32efbcd0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:24.709422 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84589d0d-ea23-494b-abb3-958f32efbcd0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:24.710087 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0d9a4bc-433b-4525-814b-bfe6c18eae6d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:24.710224 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84589d0d-ea23-494b-abb3-958f32efbcd0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:24.710613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84589d0d-ea23-494b-abb3-958f32efbcd0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:24.711371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84589d0d-ea23-494b-abb3-958f32efbcd0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:24.726327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0d9a4bc-433b-4525-814b-bfe6c18eae6d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:24.727049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0d9a4bc-433b-4525-814b-bfe6c18eae6d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:24.729120 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0d9a4bc-433b-4525-814b-bfe6c18eae6d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:24.730639 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-84589d0d-ea23-494b-abb3-958f32efbcd0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] HTTP exception thrown: Instance 43df9f1d-da75-43f5-90ae-e5eaacdb4f02 could not be found. Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-84589d0d-ea23-494b-abb3-958f32efbcd0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Request method failure captured: Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02 HTTP/1.1 Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_4PiXAoqFPCXVrtw_fcVtbWCRHCRY1BcfprLEe-EkZEFmD3rLGum9OIJcRnH-o3xr4k8T7yl4V2Hv5h2fEBByVUFBw2XIbz_i_ncVR1MMvkDEp1AvjPEGXUtr2hnsv9JoWINOTj84eRxq_Gac5VyTIxXMDaWbVLw5VeWNnbunOt5QM Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d9911aeb77cd4ffb8c4e539998a04f3c"}]}] Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersTestJSON-1653035612 Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersTestJSON-1653035612-project Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 8e840d06bb5d44e097e6f0855b04cb06 Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersTestJSON-1653035612-project Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 43df9f1d-da75-43f5-90ae-e5eaacdb4f02 could not be found. Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '43df9f1d-da75-43f5-90ae-e5eaacdb4f02'} Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43df9f1d-da75-43f5-90ae-e5eaacdb4f02 could not be found. Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43df9f1d-da75-43f5-90ae-e5eaacdb4f02 could not be found. Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:24.734818 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.738783 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:24.738783 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:24.738783 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:24.738783 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:16:24.738783 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:16:24.738783 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43df9f1d-da75-43f5-90ae-e5eaacdb4f02 could not be found. Aug 04 17:16:24.738783 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:24.740527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-84589d0d-ea23-494b-abb3-958f32efbcd0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Returning 404 to user: Instance 43df9f1d-da75-43f5-90ae-e5eaacdb4f02 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:16:24.741656 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-84589d0d-ea23-494b-abb3-958f32efbcd0 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02" status: 404 len: 111 microversion: 2.1 time: 0.049633 Aug 04 17:16:24.742272 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2539/5025] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:24 2022] GET /compute/v2.1/servers/43df9f1d-da75-43f5-90ae-e5eaacdb4f02 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:16:24.753131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4323be3b-a7cf-48b4-8d7d-651fc0ab5236 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1617971918", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "abe9f060-f80d-4e98-9fa9-f5ba838ab58c"}], "security_groups": [{"name": "tempest-securitygroup--1819242827"}], "key_name": "tempest-keypair-1513265033", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "6d5f301c-6578-448d-93b9-4d1ce067ba74", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:24.760447 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:24.949161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b0d9a4bc-433b-4525-814b-bfe6c18eae6d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:24.957242 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b0d9a4bc-433b-4525-814b-bfe6c18eae6d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1564 microversion: 2.1 time: 0.264516 Aug 04 17:16:24.959189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-4323be3b-a7cf-48b4-8d7d-651fc0ab5236 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] validate_networks() for [('abe9f060-f80d-4e98-9fa9-f5ba838ab58c', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:16:24.970692 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2487/5026] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:24 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1564 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:24.978974 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-79aa6f5e-e344-4d00-8b45-d85c47e446d9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:24.979673 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-79aa6f5e-e344-4d00-8b45-d85c47e446d9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 4b23ac31-0eda-4b24-b7ce-ed874fe75f90] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:24.986400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-79aa6f5e-e344-4d00-8b45-d85c47e446d9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:24.987131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-79aa6f5e-e344-4d00-8b45-d85c47e446d9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:24.987754 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-79aa6f5e-e344-4d00-8b45-d85c47e446d9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:24.988638 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-79aa6f5e-e344-4d00-8b45-d85c47e446d9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:24.989258 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-79aa6f5e-e344-4d00-8b45-d85c47e446d9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:24.989839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-79aa6f5e-e344-4d00-8b45-d85c47e446d9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:25.005385 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-79aa6f5e-e344-4d00-8b45-d85c47e446d9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] HTTP exception thrown: Instance 4b23ac31-0eda-4b24-b7ce-ed874fe75f90 could not be found. Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-79aa6f5e-e344-4d00-8b45-d85c47e446d9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Request method failure captured: Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90 HTTP/1.1 Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_4PiXAoqFPCXVrtw_fcVtbWCRHCRY1BcfprLEe-EkZEFmD3rLGum9OIJcRnH-o3xr4k8T7yl4V2Hv5h2fEBByVUFBw2XIbz_i_ncVR1MMvkDEp1AvjPEGXUtr2hnsv9JoWINOTj84eRxq_Gac5VyTIxXMDaWbVLw5VeWNnbunOt5QM Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d9911aeb77cd4ffb8c4e539998a04f3c"}]}] Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersTestJSON-1653035612 Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersTestJSON-1653035612-project Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 8e840d06bb5d44e097e6f0855b04cb06 Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersTestJSON-1653035612-project Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 4b23ac31-0eda-4b24-b7ce-ed874fe75f90 could not be found. Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '4b23ac31-0eda-4b24-b7ce-ed874fe75f90'} Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b23ac31-0eda-4b24-b7ce-ed874fe75f90 could not be found. Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:16:25.007234 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b23ac31-0eda-4b24-b7ce-ed874fe75f90 could not be found. Aug 04 17:16:25.012357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:25.012357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:25.012357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:25.012357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:25.012357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:25.012357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:25.012357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:16:25.012357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:16:25.012357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b23ac31-0eda-4b24-b7ce-ed874fe75f90 could not be found. Aug 04 17:16:25.012357 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:25.013952 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-79aa6f5e-e344-4d00-8b45-d85c47e446d9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Returning 404 to user: Instance 4b23ac31-0eda-4b24-b7ce-ed874fe75f90 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:16:25.014994 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-79aa6f5e-e344-4d00-8b45-d85c47e446d9 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90" status: 404 len: 111 microversion: 2.1 time: 0.043157 Aug 04 17:16:25.018778 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2488/5027] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:16:24 2022] DELETE /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:16:25.023967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a85bf1f6-ba3f-4f4b-9010-87882857a57e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Action: 'create', calling method: .version_select at 0x7f1e5aac4820>, body: {"keypair": {"name": "tempest-keypair-1401727609", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXSh/HlTqzHbwG3AGLQucUMP/rYFicJ2Mm6RyYq0o7NVUhgTRxxIaqt70iodhAEi8TMhUDNlSxaLzWUJo6QFd5uOH7ZgVwopIpM3AyzjGx4vjycP5xnWfaeu70ZXZRUMg=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:25.048646 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-a85bf1f6-ba3f-4f4b-9010-87882857a57e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Getting quotas for project a2cc22c8c06b40ae961464cb3e300cba. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:16:25.057008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-a85bf1f6-ba3f-4f4b-9010-87882857a57e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Getting quotas for user 023dd49bea644899a427669f3c1b461e and project a2cc22c8c06b40ae961464cb3e300cba. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:16:25.091528 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a85bf1f6-ba3f-4f4b-9010-87882857a57e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.071348 Aug 04 17:16:25.095679 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2489/5028] 10.222.0.93 () {62 vars in 1200 bytes} [Thu Aug 4 17:16:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 76 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 17:16:25.105267 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2a3b739d-76f6-4df5-b7d5-3d9050d87748 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:25.106182 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2a3b739d-76f6-4df5-b7d5-3d9050d87748 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 4b23ac31-0eda-4b24-b7ce-ed874fe75f90] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:25.121377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a3b739d-76f6-4df5-b7d5-3d9050d87748 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:25.121877 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a3b739d-76f6-4df5-b7d5-3d9050d87748 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:25.122371 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a3b739d-76f6-4df5-b7d5-3d9050d87748 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:25.123063 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a3b739d-76f6-4df5-b7d5-3d9050d87748 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:25.123530 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a3b739d-76f6-4df5-b7d5-3d9050d87748 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:25.123967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a3b739d-76f6-4df5-b7d5-3d9050d87748 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:25.162950 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-2a3b739d-76f6-4df5-b7d5-3d9050d87748 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] HTTP exception thrown: Instance 4b23ac31-0eda-4b24-b7ce-ed874fe75f90 could not be found. Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2a3b739d-76f6-4df5-b7d5-3d9050d87748 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Request method failure captured: Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90 HTTP/1.1 Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_4PiXAoqFPCXVrtw_fcVtbWCRHCRY1BcfprLEe-EkZEFmD3rLGum9OIJcRnH-o3xr4k8T7yl4V2Hv5h2fEBByVUFBw2XIbz_i_ncVR1MMvkDEp1AvjPEGXUtr2hnsv9JoWINOTj84eRxq_Gac5VyTIxXMDaWbVLw5VeWNnbunOt5QM Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d9911aeb77cd4ffb8c4e539998a04f3c"}]}] Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersTestJSON-1653035612 Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersTestJSON-1653035612-project Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 8e840d06bb5d44e097e6f0855b04cb06 Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersTestJSON-1653035612-project Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 4b23ac31-0eda-4b24-b7ce-ed874fe75f90 could not be found. Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '4b23ac31-0eda-4b24-b7ce-ed874fe75f90'} Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b23ac31-0eda-4b24-b7ce-ed874fe75f90 could not be found. Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b23ac31-0eda-4b24-b7ce-ed874fe75f90 could not be found. Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:25.164905 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:25.170315 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:25.170315 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:25.170315 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:25.170315 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:16:25.170315 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:16:25.170315 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b23ac31-0eda-4b24-b7ce-ed874fe75f90 could not be found. Aug 04 17:16:25.170315 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:25.170315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2a3b739d-76f6-4df5-b7d5-3d9050d87748 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Returning 404 to user: Instance 4b23ac31-0eda-4b24-b7ce-ed874fe75f90 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:16:25.170315 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2a3b739d-76f6-4df5-b7d5-3d9050d87748 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90" status: 404 len: 111 microversion: 2.1 time: 0.069862 Aug 04 17:16:25.170315 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2490/5029] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:25 2022] GET /compute/v2.1/servers/4b23ac31-0eda-4b24-b7ce-ed874fe75f90 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:16:25.175065 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ee7656c8-e3b1-4fb0-b37c-e946907f69b2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:25.175578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ee7656c8-e3b1-4fb0-b37c-e946907f69b2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b7b3bed5-42ad-41df-a974-1be65d77ea0e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:25.182140 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-ee7656c8-e3b1-4fb0-b37c-e946907f69b2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] HTTP exception thrown: Instance b7b3bed5-42ad-41df-a974-1be65d77ea0e could not be found. Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ee7656c8-e3b1-4fb0-b37c-e946907f69b2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Request method failure captured: Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/b7b3bed5-42ad-41df-a974-1be65d77ea0e HTTP/1.1 Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_4PiXAoqFPCXVrtw_fcVtbWCRHCRY1BcfprLEe-EkZEFmD3rLGum9OIJcRnH-o3xr4k8T7yl4V2Hv5h2fEBByVUFBw2XIbz_i_ncVR1MMvkDEp1AvjPEGXUtr2hnsv9JoWINOTj84eRxq_Gac5VyTIxXMDaWbVLw5VeWNnbunOt5QM Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d9911aeb77cd4ffb8c4e539998a04f3c"}]}] Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersTestJSON-1653035612 Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersTestJSON-1653035612-project Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 8e840d06bb5d44e097e6f0855b04cb06 Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersTestJSON-1653035612-project Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance b7b3bed5-42ad-41df-a974-1be65d77ea0e could not be found. Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'b7b3bed5-42ad-41df-a974-1be65d77ea0e'} Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7b3bed5-42ad-41df-a974-1be65d77ea0e could not be found. Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7b3bed5-42ad-41df-a974-1be65d77ea0e could not be found. Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:25.183698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:25.189026 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:25.189026 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:25.189026 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:25.189026 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:16:25.189026 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:16:25.189026 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7b3bed5-42ad-41df-a974-1be65d77ea0e could not be found. Aug 04 17:16:25.189026 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:25.189026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ee7656c8-e3b1-4fb0-b37c-e946907f69b2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Returning 404 to user: Instance b7b3bed5-42ad-41df-a974-1be65d77ea0e could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:16:25.189026 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ee7656c8-e3b1-4fb0-b37c-e946907f69b2 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b7b3bed5-42ad-41df-a974-1be65d77ea0e" status: 404 len: 111 microversion: 2.1 time: 0.014147 Aug 04 17:16:25.189026 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2491/5030] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:16:25 2022] DELETE /compute/v2.1/servers/b7b3bed5-42ad-41df-a974-1be65d77ea0e => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:16:25.196732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cb7d936c-e823-4664-b5c1-8e52a9add84e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:25.197452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cb7d936c-e823-4664-b5c1-8e52a9add84e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: b7b3bed5-42ad-41df-a974-1be65d77ea0e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:25.204192 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-cb7d936c-e823-4664-b5c1-8e52a9add84e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] HTTP exception thrown: Instance b7b3bed5-42ad-41df-a974-1be65d77ea0e could not be found. Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cb7d936c-e823-4664-b5c1-8e52a9add84e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Request method failure captured: Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/b7b3bed5-42ad-41df-a974-1be65d77ea0e HTTP/1.1 Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_4PiXAoqFPCXVrtw_fcVtbWCRHCRY1BcfprLEe-EkZEFmD3rLGum9OIJcRnH-o3xr4k8T7yl4V2Hv5h2fEBByVUFBw2XIbz_i_ncVR1MMvkDEp1AvjPEGXUtr2hnsv9JoWINOTj84eRxq_Gac5VyTIxXMDaWbVLw5VeWNnbunOt5QM Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d9911aeb77cd4ffb8c4e539998a04f3c"}]}] Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersTestJSON-1653035612 Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersTestJSON-1653035612-project Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 8e840d06bb5d44e097e6f0855b04cb06 Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersTestJSON-1653035612-project Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance b7b3bed5-42ad-41df-a974-1be65d77ea0e could not be found. Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'b7b3bed5-42ad-41df-a974-1be65d77ea0e'} Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7b3bed5-42ad-41df-a974-1be65d77ea0e could not be found. Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7b3bed5-42ad-41df-a974-1be65d77ea0e could not be found. Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:25.206177 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:25.210598 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:25.210598 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:16:25.210598 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:16:25.210598 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7b3bed5-42ad-41df-a974-1be65d77ea0e could not be found. Aug 04 17:16:25.210598 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:25.210598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cb7d936c-e823-4664-b5c1-8e52a9add84e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Returning 404 to user: Instance b7b3bed5-42ad-41df-a974-1be65d77ea0e could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:16:25.210598 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cb7d936c-e823-4664-b5c1-8e52a9add84e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/b7b3bed5-42ad-41df-a974-1be65d77ea0e" status: 404 len: 111 microversion: 2.1 time: 0.015415 Aug 04 17:16:25.210598 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2492/5031] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:25 2022] GET /compute/v2.1/servers/b7b3bed5-42ad-41df-a974-1be65d77ea0e => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:16:25.217021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1e9512b6-7ca6-4b96-a69c-fb2e7202fa06 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:25.217715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1e9512b6-7ca6-4b96-a69c-fb2e7202fa06 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 84f1b438-b552-41c0-9e85-bb9021c44a2a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:25.224272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e9512b6-7ca6-4b96-a69c-fb2e7202fa06 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:25.224994 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e9512b6-7ca6-4b96-a69c-fb2e7202fa06 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:25.225603 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e9512b6-7ca6-4b96-a69c-fb2e7202fa06 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:25.226776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e9512b6-7ca6-4b96-a69c-fb2e7202fa06 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:25.227393 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e9512b6-7ca6-4b96-a69c-fb2e7202fa06 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:25.228547 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e9512b6-7ca6-4b96-a69c-fb2e7202fa06 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:25.273663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1e9512b6-7ca6-4b96-a69c-fb2e7202fa06 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 84f1b438-b552-41c0-9e85-bb9021c44a2a] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:16:25.441364 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1e9512b6-7ca6-4b96-a69c-fb2e7202fa06 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "DELETE /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a" status: 204 len: 0 microversion: 2.1 time: 0.227867 Aug 04 17:16:25.447410 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2493/5032] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:16:25 2022] DELETE /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 17:16:25.457846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4a8df0e4-51a3-4708-a222-f23c28c78484 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:25.459999 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4a8df0e4-51a3-4708-a222-f23c28c78484 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 84f1b438-b552-41c0-9e85-bb9021c44a2a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:25.470297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:25.481505 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a8df0e4-51a3-4708-a222-f23c28c78484 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:25.482305 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a8df0e4-51a3-4708-a222-f23c28c78484 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:25.494588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a8df0e4-51a3-4708-a222-f23c28c78484 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:25.497561 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a8df0e4-51a3-4708-a222-f23c28c78484 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:25.499662 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a8df0e4-51a3-4708-a222-f23c28c78484 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:25.500143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a8df0e4-51a3-4708-a222-f23c28c78484 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:25.909344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-4323be3b-a7cf-48b4-8d7d-651fc0ab5236 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Getting quotas for project 95a334b70c2e46c087201aa6787accba. Resources: dict_keys(['metadata_items']) {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:16:25.925283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-4323be3b-a7cf-48b4-8d7d-651fc0ab5236 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Getting quotas for user 3544002a75c946cda1586cd21f999aa0 and project 95a334b70c2e46c087201aa6787accba. Resources: dict_keys(['metadata_items']) {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:16:25.961731 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4a8df0e4-51a3-4708-a222-f23c28c78484 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:25.969063 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-4323be3b-a7cf-48b4-8d7d-651fc0ab5236 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:16:25.969556 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-4323be3b-a7cf-48b4-8d7d-651fc0ab5236 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:16:25.969656 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4a8df0e4-51a3-4708-a222-f23c28c78484 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a" status: 200 len: 1481 microversion: 2.1 time: 0.520048 Aug 04 17:16:25.969957 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-4323be3b-a7cf-48b4-8d7d-651fc0ab5236 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:16:25.970556 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-4323be3b-a7cf-48b4-8d7d-651fc0ab5236 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:16:25.971149 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-4323be3b-a7cf-48b4-8d7d-651fc0ab5236 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:16:25.982100 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4323be3b-a7cf-48b4-8d7d-651fc0ab5236 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:25.983044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4323be3b-a7cf-48b4-8d7d-651fc0ab5236 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:25.983710 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4323be3b-a7cf-48b4-8d7d-651fc0ab5236 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:25.984983 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4323be3b-a7cf-48b4-8d7d-651fc0ab5236 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:25.986390 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2494/5033] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:25 2022] GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a => generated 1481 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:25.986671 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4323be3b-a7cf-48b4-8d7d-651fc0ab5236 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:25.987291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4323be3b-a7cf-48b4-8d7d-651fc0ab5236 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:25.997075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-95794c44-93d7-45e9-a4e6-144051dbeb6e tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:25.997918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-95794c44-93d7-45e9-a4e6-144051dbeb6e tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:26.008169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95794c44-93d7-45e9-a4e6-144051dbeb6e tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:26.009560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95794c44-93d7-45e9-a4e6-144051dbeb6e tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:26.015560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-4323be3b-a7cf-48b4-8d7d-651fc0ab5236 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Getting quotas for project 95a334b70c2e46c087201aa6787accba. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:16:26.017099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95794c44-93d7-45e9-a4e6-144051dbeb6e tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:26.017867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95794c44-93d7-45e9-a4e6-144051dbeb6e tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:26.018340 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95794c44-93d7-45e9-a4e6-144051dbeb6e tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:26.018974 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95794c44-93d7-45e9-a4e6-144051dbeb6e tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:26.023670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-4323be3b-a7cf-48b4-8d7d-651fc0ab5236 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Getting quotas for user 3544002a75c946cda1586cd21f999aa0 and project 95a334b70c2e46c087201aa6787accba. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:16:26.129075 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4323be3b-a7cf-48b4-8d7d-651fc0ab5236 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:16:26.133529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4323be3b-a7cf-48b4-8d7d-651fc0ab5236 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6d5f301c-6578-448d-93b9-4d1ce067ba74',volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:16:26.250551 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-95794c44-93d7-45e9-a4e6-144051dbeb6e tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:26.262606 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-95794c44-93d7-45e9-a4e6-144051dbeb6e tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1525 microversion: 2.1 time: 0.272944 Aug 04 17:16:26.263875 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2495/5034] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:25 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1525 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:26.413417 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4323be3b-a7cf-48b4-8d7d-651fc0ab5236 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.665806 Aug 04 17:16:26.414490 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2540/5035] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:16:24 2022] POST /compute/v2.1/servers => generated 407 bytes in 1668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:16:26.426692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8807c9f7-52e1-4b32-833b-b661fe59a728 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:26.427603 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8807c9f7-52e1-4b32-833b-b661fe59a728 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:26.548652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8807c9f7-52e1-4b32-833b-b661fe59a728 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544002a75c946cda1586cd21f999aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a334b70c2e46c087201aa6787accba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:26.557937 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8807c9f7-52e1-4b32-833b-b661fe59a728 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2" status: 200 len: 1122 microversion: 2.1 time: 0.135552 Aug 04 17:16:26.561421 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2496/5036] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:26 2022] GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2 => generated 1122 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:26.997012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-14020339-31aa-4958-9520-442ab89de5c8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:26.998696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-14020339-31aa-4958-9520-442ab89de5c8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 84f1b438-b552-41c0-9e85-bb9021c44a2a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:27.012325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14020339-31aa-4958-9520-442ab89de5c8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:27.013965 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14020339-31aa-4958-9520-442ab89de5c8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:27.015101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14020339-31aa-4958-9520-442ab89de5c8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:27.016648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14020339-31aa-4958-9520-442ab89de5c8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:27.019373 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14020339-31aa-4958-9520-442ab89de5c8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:27.022599 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14020339-31aa-4958-9520-442ab89de5c8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:27.285046 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f92c6635-87db-4821-be0f-d6bb7d97e65d tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:27.286184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f92c6635-87db-4821-be0f-d6bb7d97e65d tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:27.307829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f92c6635-87db-4821-be0f-d6bb7d97e65d tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:27.310273 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f92c6635-87db-4821-be0f-d6bb7d97e65d tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:27.312137 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f92c6635-87db-4821-be0f-d6bb7d97e65d tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:27.313493 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f92c6635-87db-4821-be0f-d6bb7d97e65d tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:27.315247 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f92c6635-87db-4821-be0f-d6bb7d97e65d tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:27.315752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f92c6635-87db-4821-be0f-d6bb7d97e65d tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:27.778370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f92c6635-87db-4821-be0f-d6bb7d97e65d tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:27.785451 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-14020339-31aa-4958-9520-442ab89de5c8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:27.787819 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f92c6635-87db-4821-be0f-d6bb7d97e65d tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1525 microversion: 2.1 time: 0.506781 Aug 04 17:16:27.790584 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2497/5037] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:27 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1525 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:27.799345 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-37cfc969-9a6c-4027-8337-552ac87b411d tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:27.803166 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-37cfc969-9a6c-4027-8337-552ac87b411d tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:27.809525 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-14020339-31aa-4958-9520-442ab89de5c8 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a" status: 200 len: 1481 microversion: 2.1 time: 0.820167 Aug 04 17:16:27.822413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37cfc969-9a6c-4027-8337-552ac87b411d tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:27.822413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37cfc969-9a6c-4027-8337-552ac87b411d tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:27.822413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37cfc969-9a6c-4027-8337-552ac87b411d tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:27.823722 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2541/5038] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:26 2022] GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a => generated 1481 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:27.824737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37cfc969-9a6c-4027-8337-552ac87b411d tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:27.825529 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37cfc969-9a6c-4027-8337-552ac87b411d tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:27.827596 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37cfc969-9a6c-4027-8337-552ac87b411d tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:27.927372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4f9512dd-da90-4ffc-8f14-c0e600d2f3d8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:27.928403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4f9512dd-da90-4ffc-8f14-c0e600d2f3d8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:27.937609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f9512dd-da90-4ffc-8f14-c0e600d2f3d8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:27.939002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f9512dd-da90-4ffc-8f14-c0e600d2f3d8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:27.940357 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f9512dd-da90-4ffc-8f14-c0e600d2f3d8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:27.941740 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f9512dd-da90-4ffc-8f14-c0e600d2f3d8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:27.942831 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f9512dd-da90-4ffc-8f14-c0e600d2f3d8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:27.944120 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f9512dd-da90-4ffc-8f14-c0e600d2f3d8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:27.978240 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-37cfc969-9a6c-4027-8337-552ac87b411d tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544002a75c946cda1586cd21f999aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a334b70c2e46c087201aa6787accba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:27.994458 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-37cfc969-9a6c-4027-8337-552ac87b411d tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2" status: 200 len: 1220 microversion: 2.1 time: 0.198492 Aug 04 17:16:27.999127 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2498/5039] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:27 2022] GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2 => generated 1220 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:28.020540 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-f0fc4f65-4eee-451e-b5b2-9b82ae99c828 req-ac088f3c-0b1b-495f-b700-bd18be4af8bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c6b1716-bb14-4f97-bc75-38403c1c1af0", "tag": "1e3189db-ad91-4d9e-bfe5-7b700963e0d9"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:28.051663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f0fc4f65-4eee-451e-b5b2-9b82ae99c828 req-ac088f3c-0b1b-495f-b700-bd18be4af8bb service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:28.057117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f0fc4f65-4eee-451e-b5b2-9b82ae99c828 req-ac088f3c-0b1b-495f-b700-bd18be4af8bb service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:28.057857 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f0fc4f65-4eee-451e-b5b2-9b82ae99c828 req-ac088f3c-0b1b-495f-b700-bd18be4af8bb service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:28.083648 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-f0fc4f65-4eee-451e-b5b2-9b82ae99c828 req-ac088f3c-0b1b-495f-b700-bd18be4af8bb service nova] Creating event network-changed:1e3189db-ad91-4d9e-bfe5-7b700963e0d9 for instance 9c6b1716-bb14-4f97-bc75-38403c1c1af0 on n-h2-851359-3 Aug 04 17:16:28.100761 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-f0fc4f65-4eee-451e-b5b2-9b82ae99c828 req-ac088f3c-0b1b-495f-b700-bd18be4af8bb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099403 Aug 04 17:16:28.104033 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2499/5040] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:16:28.715316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4f9512dd-da90-4ffc-8f14-c0e600d2f3d8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:28.731631 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4f9512dd-da90-4ffc-8f14-c0e600d2f3d8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1564 microversion: 2.1 time: 0.810605 Aug 04 17:16:28.734425 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2542/5041] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:27 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1564 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:28.811142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4e8c7df8-a229-4602-8c8e-02eac3f7f803 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:28.812518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4e8c7df8-a229-4602-8c8e-02eac3f7f803 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:28.831495 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e8c7df8-a229-4602-8c8e-02eac3f7f803 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:28.832405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e8c7df8-a229-4602-8c8e-02eac3f7f803 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:28.834236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5b379e43-4293-4552-8546-2f0a3964e657 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:28.834840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e8c7df8-a229-4602-8c8e-02eac3f7f803 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:28.834975 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5b379e43-4293-4552-8546-2f0a3964e657 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 84f1b438-b552-41c0-9e85-bb9021c44a2a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:28.835954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e8c7df8-a229-4602-8c8e-02eac3f7f803 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:28.838575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e8c7df8-a229-4602-8c8e-02eac3f7f803 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:28.839421 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e8c7df8-a229-4602-8c8e-02eac3f7f803 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:28.846513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b379e43-4293-4552-8546-2f0a3964e657 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:28.847259 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b379e43-4293-4552-8546-2f0a3964e657 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:28.847878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b379e43-4293-4552-8546-2f0a3964e657 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:28.849738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b379e43-4293-4552-8546-2f0a3964e657 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:28.850980 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b379e43-4293-4552-8546-2f0a3964e657 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:28.854303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b379e43-4293-4552-8546-2f0a3964e657 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:29.852914 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5b379e43-4293-4552-8546-2f0a3964e657 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e840d06bb5d44e097e6f0855b04cb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9911aeb77cd4ffb8c4e539998a04f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:29.870264 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5b379e43-4293-4552-8546-2f0a3964e657 tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a" status: 200 len: 1481 microversion: 2.1 time: 1.040083 Aug 04 17:16:29.887534 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2543/5042] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:28 2022] GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a => generated 1481 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:16:29.898143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-64dcf399-d60f-428a-8163-30b8a8dcc8ea tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:29.898979 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-64dcf399-d60f-428a-8163-30b8a8dcc8ea tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:29.908146 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64dcf399-d60f-428a-8163-30b8a8dcc8ea tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:29.908662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64dcf399-d60f-428a-8163-30b8a8dcc8ea tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:29.909111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64dcf399-d60f-428a-8163-30b8a8dcc8ea tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:29.909895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64dcf399-d60f-428a-8163-30b8a8dcc8ea tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:29.910392 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64dcf399-d60f-428a-8163-30b8a8dcc8ea tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:29.910828 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64dcf399-d60f-428a-8163-30b8a8dcc8ea tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:29.912854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4e8c7df8-a229-4602-8c8e-02eac3f7f803 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:29.925919 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4e8c7df8-a229-4602-8c8e-02eac3f7f803 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1525 microversion: 2.1 time: 1.121023 Aug 04 17:16:29.934991 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2500/5043] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:28 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1525 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:29.949995 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-51c3db10-5ef2-45a9-9bd4-3321991910ff tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1849883370", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2bcc362-f0e4-432b-a05f-b91ea4a73652"}], "security_groups": [{"name": "tempest-securitygroup--1960417425"}], "key_name": "tempest-keypair-1401727609", "user_data": "}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:30.016110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-64dcf399-d60f-428a-8163-30b8a8dcc8ea tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544002a75c946cda1586cd21f999aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a334b70c2e46c087201aa6787accba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:30.029879 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-64dcf399-d60f-428a-8163-30b8a8dcc8ea tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2" status: 200 len: 1238 microversion: 2.1 time: 0.140432 Aug 04 17:16:30.032367 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2544/5044] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:29 2022] GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2 => generated 1238 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:30.178317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-66227f4e-11e0-4a56-9cff-18d377bef9e3 req-fd9dacc1-cb75-4bbe-acbc-31f2de3756b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84f1b438-b552-41c0-9e85-bb9021c44a2a", "name": "network-vif-deleted", "tag": "487629c5-50cc-42f7-ad92-622f03c03177"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:30.181145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-51c3db10-5ef2-45a9-9bd4-3321991910ff tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] validate_networks() for [('e2bcc362-f0e4-432b-a05f-b91ea4a73652', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:16:30.203424 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-66227f4e-11e0-4a56-9cff-18d377bef9e3 req-fd9dacc1-cb75-4bbe-acbc-31f2de3756b3 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:30.204681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-66227f4e-11e0-4a56-9cff-18d377bef9e3 req-fd9dacc1-cb75-4bbe-acbc-31f2de3756b3 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:30.205383 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-66227f4e-11e0-4a56-9cff-18d377bef9e3 req-fd9dacc1-cb75-4bbe-acbc-31f2de3756b3 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:30.218625 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-66227f4e-11e0-4a56-9cff-18d377bef9e3 req-fd9dacc1-cb75-4bbe-acbc-31f2de3756b3 service nova] Creating event network-vif-deleted:487629c5-50cc-42f7-ad92-622f03c03177 for instance 84f1b438-b552-41c0-9e85-bb9021c44a2a on n-h2-851359-3 Aug 04 17:16:30.225357 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-66227f4e-11e0-4a56-9cff-18d377bef9e3 req-fd9dacc1-cb75-4bbe-acbc-31f2de3756b3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056238 Aug 04 17:16:30.226524 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2545/5045] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:16:30.900320 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-249d3f45-7dd9-4e1c-ab79-9e99a35c343e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:30.902304 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-249d3f45-7dd9-4e1c-ab79-9e99a35c343e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] [instance: 84f1b438-b552-41c0-9e85-bb9021c44a2a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:30.905204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-51c3db10-5ef2-45a9-9bd4-3321991910ff tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:16:30.905668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-51c3db10-5ef2-45a9-9bd4-3321991910ff tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:16:30.906222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-51c3db10-5ef2-45a9-9bd4-3321991910ff tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:16:30.907144 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-51c3db10-5ef2-45a9-9bd4-3321991910ff tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:16:30.907144 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-51c3db10-5ef2-45a9-9bd4-3321991910ff tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:16:30.911507 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-249d3f45-7dd9-4e1c-ab79-9e99a35c343e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:30.912021 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-249d3f45-7dd9-4e1c-ab79-9e99a35c343e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:30.912628 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-249d3f45-7dd9-4e1c-ab79-9e99a35c343e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:30.913862 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-249d3f45-7dd9-4e1c-ab79-9e99a35c343e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:30.914667 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-249d3f45-7dd9-4e1c-ab79-9e99a35c343e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:30.915581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-249d3f45-7dd9-4e1c-ab79-9e99a35c343e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:30.927060 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51c3db10-5ef2-45a9-9bd4-3321991910ff tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:30.927625 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51c3db10-5ef2-45a9-9bd4-3321991910ff tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:30.928026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51c3db10-5ef2-45a9-9bd4-3321991910ff tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:30.928900 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51c3db10-5ef2-45a9-9bd4-3321991910ff tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:30.929424 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51c3db10-5ef2-45a9-9bd4-3321991910ff tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:30.929862 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51c3db10-5ef2-45a9-9bd4-3321991910ff tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:30.942121 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-249d3f45-7dd9-4e1c-ab79-9e99a35c343e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] HTTP exception thrown: Instance 84f1b438-b552-41c0-9e85-bb9021c44a2a could not be found. Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-249d3f45-7dd9-4e1c-ab79-9e99a35c343e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Request method failure captured: Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a HTTP/1.1 Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_4PiXAoqFPCXVrtw_fcVtbWCRHCRY1BcfprLEe-EkZEFmD3rLGum9OIJcRnH-o3xr4k8T7yl4V2Hv5h2fEBByVUFBw2XIbz_i_ncVR1MMvkDEp1AvjPEGXUtr2hnsv9JoWINOTj84eRxq_Gac5VyTIxXMDaWbVLw5VeWNnbunOt5QM Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d9911aeb77cd4ffb8c4e539998a04f3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d9911aeb77cd4ffb8c4e539998a04f3c"}]}] Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersTestJSON-1653035612 Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: d9911aeb77cd4ffb8c4e539998a04f3c Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersTestJSON-1653035612 Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersTestJSON-1653035612-project Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 8e840d06bb5d44e097e6f0855b04cb06 Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersTestJSON-1653035612-project Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 84f1b438-b552-41c0-9e85-bb9021c44a2a could not be found. Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '84f1b438-b552-41c0-9e85-bb9021c44a2a'} Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84f1b438-b552-41c0-9e85-bb9021c44a2a could not be found. Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84f1b438-b552-41c0-9e85-bb9021c44a2a could not be found. Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:30.944873 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:30.951767 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:30.951767 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:30.951767 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:30.951767 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:16:30.951767 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:16:30.951767 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84f1b438-b552-41c0-9e85-bb9021c44a2a could not be found. Aug 04 17:16:30.951767 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:30.951767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-249d3f45-7dd9-4e1c-ab79-9e99a35c343e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] Returning 404 to user: Instance 84f1b438-b552-41c0-9e85-bb9021c44a2a could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:16:30.956107 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-249d3f45-7dd9-4e1c-ab79-9e99a35c343e tempest-ServersTestJSON-1653035612 tempest-ServersTestJSON-1653035612-project] 10.222.0.93 "GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a" status: 404 len: 111 microversion: 2.1 time: 0.067416 Aug 04 17:16:30.964924 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2546/5046] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:30 2022] GET /compute/v2.1/servers/84f1b438-b552-41c0-9e85-bb9021c44a2a => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:16:30.994289 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-51c3db10-5ef2-45a9-9bd4-3321991910ff tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Getting quotas for project a2cc22c8c06b40ae961464cb3e300cba. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:16:30.995996 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0e3c8014-0ced-444b-966a-0c1363bfb3d9 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:30.996954 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0e3c8014-0ced-444b-966a-0c1363bfb3d9 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:31.015405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-51c3db10-5ef2-45a9-9bd4-3321991910ff tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Getting quotas for user 023dd49bea644899a427669f3c1b461e and project a2cc22c8c06b40ae961464cb3e300cba. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:16:31.016608 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e3c8014-0ced-444b-966a-0c1363bfb3d9 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:31.017012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e3c8014-0ced-444b-966a-0c1363bfb3d9 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:31.017474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e3c8014-0ced-444b-966a-0c1363bfb3d9 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:31.018247 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e3c8014-0ced-444b-966a-0c1363bfb3d9 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:31.018724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e3c8014-0ced-444b-966a-0c1363bfb3d9 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:31.022009 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e3c8014-0ced-444b-966a-0c1363bfb3d9 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:31.042253 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-51c3db10-5ef2-45a9-9bd4-3321991910ff tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:16:31.044597 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-51c3db10-5ef2-45a9-9bd4-3321991910ff tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:16:31.170148 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-51c3db10-5ef2-45a9-9bd4-3321991910ff tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.221308 Aug 04 17:16:31.171348 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2501/5047] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Aug 4 17:16:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 1228 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 04 17:16:31.183168 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a16a38ee-a939-4c3c-bb95-1532c622683f tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:31.184091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a16a38ee-a939-4c3c-bb95-1532c622683f tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:31.206102 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a16a38ee-a939-4c3c-bb95-1532c622683f tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:31.206779 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a16a38ee-a939-4c3c-bb95-1532c622683f tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:31.208552 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a16a38ee-a939-4c3c-bb95-1532c622683f tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:31.210928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a16a38ee-a939-4c3c-bb95-1532c622683f tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:31.225289 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a16a38ee-a939-4c3c-bb95-1532c622683f tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:31.227259 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a16a38ee-a939-4c3c-bb95-1532c622683f tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:32.092089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0e3c8014-0ced-444b-966a-0c1363bfb3d9 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:32.110765 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0e3c8014-0ced-444b-966a-0c1363bfb3d9 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1525 microversion: 2.1 time: 1.144058 Aug 04 17:16:32.111367 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2547/5048] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:30 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1525 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:32.125202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9a6f545f-b59a-4988-9e9c-b4b3cffb1237 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:32.130101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9a6f545f-b59a-4988-9e9c-b4b3cffb1237 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:32.162581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9a6f545f-b59a-4988-9e9c-b4b3cffb1237 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:32.163595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9a6f545f-b59a-4988-9e9c-b4b3cffb1237 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:32.164582 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9a6f545f-b59a-4988-9e9c-b4b3cffb1237 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:32.165594 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9a6f545f-b59a-4988-9e9c-b4b3cffb1237 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:32.166223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9a6f545f-b59a-4988-9e9c-b4b3cffb1237 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:32.167880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9a6f545f-b59a-4988-9e9c-b4b3cffb1237 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:32.179108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a16a38ee-a939-4c3c-bb95-1532c622683f tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544002a75c946cda1586cd21f999aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a334b70c2e46c087201aa6787accba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:32.194578 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a16a38ee-a939-4c3c-bb95-1532c622683f tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2" status: 200 len: 1306 microversion: 2.1 time: 1.021786 Aug 04 17:16:32.195784 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2502/5049] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:31 2022] GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2 => generated 1306 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:32.212417 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e851919c-45ad-46d1-b05e-543fdaf168dc tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:32.214942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e851919c-45ad-46d1-b05e-543fdaf168dc tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:32.223391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e851919c-45ad-46d1-b05e-543fdaf168dc tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:32.226220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e851919c-45ad-46d1-b05e-543fdaf168dc tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:32.229127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e851919c-45ad-46d1-b05e-543fdaf168dc tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:32.229880 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e851919c-45ad-46d1-b05e-543fdaf168dc tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:32.232520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e851919c-45ad-46d1-b05e-543fdaf168dc tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:32.232969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e851919c-45ad-46d1-b05e-543fdaf168dc tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:32.299100 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e851919c-45ad-46d1-b05e-543fdaf168dc tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.100266 Aug 04 17:16:32.305096 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2503/5050] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:16:32 2022] GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba/os-volume_attachments => generated 25 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:16:32.387434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9a6f545f-b59a-4988-9e9c-b4b3cffb1237 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:32.400257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9a6f545f-b59a-4988-9e9c-b4b3cffb1237 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:32.402513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9a6f545f-b59a-4988-9e9c-b4b3cffb1237 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:32.404118 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9a6f545f-b59a-4988-9e9c-b4b3cffb1237 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1278 microversion: 2.20 time: 0.289958 Aug 04 17:16:32.405050 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2548/5051] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:16:32 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1278 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:16:32.487360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1cac646a-6887-43ff-81ae-c6e4c7a44438 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:32.491979 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1cac646a-6887-43ff-81ae-c6e4c7a44438 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:32.509574 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cac646a-6887-43ff-81ae-c6e4c7a44438 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:32.511070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cac646a-6887-43ff-81ae-c6e4c7a44438 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:32.512409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cac646a-6887-43ff-81ae-c6e4c7a44438 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:32.514221 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cac646a-6887-43ff-81ae-c6e4c7a44438 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:32.514873 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cac646a-6887-43ff-81ae-c6e4c7a44438 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:32.515526 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cac646a-6887-43ff-81ae-c6e4c7a44438 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:32.589831 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1cac646a-6887-43ff-81ae-c6e4c7a44438 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106853 Aug 04 17:16:32.590472 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2504/5052] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:16:32 2022] GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba/os-volume_attachments => generated 25 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:16:32.686991 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6e78b614-9388-4c3d-b8a0-fcaef64cf09b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:32.687508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6e78b614-9388-4c3d-b8a0-fcaef64cf09b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:32.689385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-54e24a23-ba3c-4c5f-bc3c-5dcdeb52eaa3 req-c4440ef4-e6fb-459d-8728-ec5561d71246 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b49ca99e-4a64-4d5d-aeb8-f61760944ce2", "tag": "0427cc5e-0bd3-4508-b821-5cc6d9a8ed83"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:32.716455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e78b614-9388-4c3d-b8a0-fcaef64cf09b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:32.721456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e78b614-9388-4c3d-b8a0-fcaef64cf09b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:32.721456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e78b614-9388-4c3d-b8a0-fcaef64cf09b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:32.724010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:32.725539 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e78b614-9388-4c3d-b8a0-fcaef64cf09b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:32.728149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e78b614-9388-4c3d-b8a0-fcaef64cf09b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:32.728638 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e78b614-9388-4c3d-b8a0-fcaef64cf09b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:32.732053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-54e24a23-ba3c-4c5f-bc3c-5dcdeb52eaa3 req-c4440ef4-e6fb-459d-8728-ec5561d71246 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:32.732569 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-54e24a23-ba3c-4c5f-bc3c-5dcdeb52eaa3 req-c4440ef4-e6fb-459d-8728-ec5561d71246 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:32.735380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-54e24a23-ba3c-4c5f-bc3c-5dcdeb52eaa3 req-c4440ef4-e6fb-459d-8728-ec5561d71246 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:32.776975 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-54e24a23-ba3c-4c5f-bc3c-5dcdeb52eaa3 req-c4440ef4-e6fb-459d-8728-ec5561d71246 service nova] Creating event network-changed:0427cc5e-0bd3-4508-b821-5cc6d9a8ed83 for instance b49ca99e-4a64-4d5d-aeb8-f61760944ce2 on n-h1-851359-3 Aug 04 17:16:32.801079 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-54e24a23-ba3c-4c5f-bc3c-5dcdeb52eaa3 req-c4440ef4-e6fb-459d-8728-ec5561d71246 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137223 Aug 04 17:16:32.803489 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2549/5053] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:16:32.824384 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6e78b614-9388-4c3d-b8a0-fcaef64cf09b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:16:32.988591 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6e78b614-9388-4c3d-b8a0-fcaef64cf09b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "DELETE /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba" status: 204 len: 0 microversion: 2.1 time: 0.305237 Aug 04 17:16:32.992311 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2505/5054] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:16:32 2022] DELETE /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 17:16:33.003062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3147d33d-f33c-4c4c-8940-04658bc584d4 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:33.004140 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3147d33d-f33c-4c4c-8940-04658bc584d4 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:33.033731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3147d33d-f33c-4c4c-8940-04658bc584d4 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:33.034637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3147d33d-f33c-4c4c-8940-04658bc584d4 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:33.035315 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3147d33d-f33c-4c4c-8940-04658bc584d4 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:33.036986 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3147d33d-f33c-4c4c-8940-04658bc584d4 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:33.037691 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3147d33d-f33c-4c4c-8940-04658bc584d4 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:33.039266 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3147d33d-f33c-4c4c-8940-04658bc584d4 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:33.133115 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-966151cb-4aff-4ae4-9f2a-eaa3b1331680 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:33.134137 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-966151cb-4aff-4ae4-9f2a-eaa3b1331680 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:33.141949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-966151cb-4aff-4ae4-9f2a-eaa3b1331680 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:33.142667 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-966151cb-4aff-4ae4-9f2a-eaa3b1331680 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:33.143221 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-966151cb-4aff-4ae4-9f2a-eaa3b1331680 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:33.144050 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-966151cb-4aff-4ae4-9f2a-eaa3b1331680 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:33.144685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-966151cb-4aff-4ae4-9f2a-eaa3b1331680 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:33.145245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-966151cb-4aff-4ae4-9f2a-eaa3b1331680 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:33.549425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3147d33d-f33c-4c4c-8940-04658bc584d4 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:33.575618 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3147d33d-f33c-4c4c-8940-04658bc584d4 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba" status: 200 len: 1671 microversion: 2.1 time: 0.566402 Aug 04 17:16:33.585895 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2550/5055] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:32 2022] GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba => generated 1671 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:33.597933 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f5cd1101-bc4d-4943-98d5-0248b735c7df tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:33.598919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f5cd1101-bc4d-4943-98d5-0248b735c7df tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:33.612335 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5cd1101-bc4d-4943-98d5-0248b735c7df tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:33.613196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5cd1101-bc4d-4943-98d5-0248b735c7df tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:33.615796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5cd1101-bc4d-4943-98d5-0248b735c7df tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:33.616726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5cd1101-bc4d-4943-98d5-0248b735c7df tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:33.617368 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5cd1101-bc4d-4943-98d5-0248b735c7df tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:33.618586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5cd1101-bc4d-4943-98d5-0248b735c7df tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:33.638202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-966151cb-4aff-4ae4-9f2a-eaa3b1331680 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:33.651068 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-966151cb-4aff-4ae4-9f2a-eaa3b1331680 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1525 microversion: 2.1 time: 0.523089 Aug 04 17:16:33.655756 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2506/5056] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:33 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1525 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:33.661552 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-603659e8-99a4-4263-9322-a961b5257448 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:33.667020 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-603659e8-99a4-4263-9322-a961b5257448 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:33.675362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-603659e8-99a4-4263-9322-a961b5257448 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:33.676222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-603659e8-99a4-4263-9322-a961b5257448 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:33.676829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-603659e8-99a4-4263-9322-a961b5257448 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:33.677723 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-603659e8-99a4-4263-9322-a961b5257448 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:33.678390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-603659e8-99a4-4263-9322-a961b5257448 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:33.678984 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-603659e8-99a4-4263-9322-a961b5257448 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:33.716023 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:33.804112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-603659e8-99a4-4263-9322-a961b5257448 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:33.818131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-603659e8-99a4-4263-9322-a961b5257448 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:33.820645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-603659e8-99a4-4263-9322-a961b5257448 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:33.822099 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-603659e8-99a4-4263-9322-a961b5257448 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1352 microversion: 2.20 time: 0.165083 Aug 04 17:16:33.823276 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2507/5057] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:16:33 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1352 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:16:34.104824 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f5cd1101-bc4d-4943-98d5-0248b735c7df tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544002a75c946cda1586cd21f999aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a334b70c2e46c087201aa6787accba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:34.118131 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f5cd1101-bc4d-4943-98d5-0248b735c7df tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2" status: 200 len: 1306 microversion: 2.1 time: 0.530074 Aug 04 17:16:34.138873 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2551/5058] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:33 2022] GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2 => generated 1306 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:34.613163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3d996d1b-ca85-4987-a73a-08b9693e6eb4 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:34.613306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3d996d1b-ca85-4987-a73a-08b9693e6eb4 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:34.628010 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d996d1b-ca85-4987-a73a-08b9693e6eb4 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:34.628542 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d996d1b-ca85-4987-a73a-08b9693e6eb4 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:34.629042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d996d1b-ca85-4987-a73a-08b9693e6eb4 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:34.635618 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d996d1b-ca85-4987-a73a-08b9693e6eb4 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:34.643415 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d996d1b-ca85-4987-a73a-08b9693e6eb4 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:34.644791 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d996d1b-ca85-4987-a73a-08b9693e6eb4 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:34.683239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1387b1aa-4e36-4ca3-842a-f143b77bd489 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:34.684464 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1387b1aa-4e36-4ca3-842a-f143b77bd489 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:34.703392 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1387b1aa-4e36-4ca3-842a-f143b77bd489 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:34.704144 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1387b1aa-4e36-4ca3-842a-f143b77bd489 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:34.705914 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1387b1aa-4e36-4ca3-842a-f143b77bd489 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:34.706708 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1387b1aa-4e36-4ca3-842a-f143b77bd489 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:34.707188 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1387b1aa-4e36-4ca3-842a-f143b77bd489 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:34.713270 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1387b1aa-4e36-4ca3-842a-f143b77bd489 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:35.095987 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1387b1aa-4e36-4ca3-842a-f143b77bd489 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:35.107320 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1387b1aa-4e36-4ca3-842a-f143b77bd489 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1525 microversion: 2.1 time: 0.428814 Aug 04 17:16:35.108437 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2552/5059] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:34 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1525 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:16:35.128663 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b57d1f41-2f64-43e5-adc5-ae467ef0002c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:35.129935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b57d1f41-2f64-43e5-adc5-ae467ef0002c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:35.135969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3d996d1b-ca85-4987-a73a-08b9693e6eb4 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:35.137595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b57d1f41-2f64-43e5-adc5-ae467ef0002c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:35.138250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b57d1f41-2f64-43e5-adc5-ae467ef0002c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:35.138932 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b57d1f41-2f64-43e5-adc5-ae467ef0002c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:35.140382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b57d1f41-2f64-43e5-adc5-ae467ef0002c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:35.141357 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b57d1f41-2f64-43e5-adc5-ae467ef0002c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:35.142215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b57d1f41-2f64-43e5-adc5-ae467ef0002c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:35.145762 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3d996d1b-ca85-4987-a73a-08b9693e6eb4 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba" status: 200 len: 1671 microversion: 2.1 time: 0.537383 Aug 04 17:16:35.158471 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2508/5060] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:34 2022] GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba => generated 1671 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:16:35.176648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-27d34550-0420-4dac-bfae-4125cb654bf8 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:35.177643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-27d34550-0420-4dac-bfae-4125cb654bf8 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:35.191051 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27d34550-0420-4dac-bfae-4125cb654bf8 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:35.193909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27d34550-0420-4dac-bfae-4125cb654bf8 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:35.195048 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27d34550-0420-4dac-bfae-4125cb654bf8 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:35.197266 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27d34550-0420-4dac-bfae-4125cb654bf8 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:35.198056 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27d34550-0420-4dac-bfae-4125cb654bf8 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:35.199136 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27d34550-0420-4dac-bfae-4125cb654bf8 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:35.349944 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b57d1f41-2f64-43e5-adc5-ae467ef0002c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:35.362739 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b57d1f41-2f64-43e5-adc5-ae467ef0002c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:35.369524 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b57d1f41-2f64-43e5-adc5-ae467ef0002c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:35.372162 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b57d1f41-2f64-43e5-adc5-ae467ef0002c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1340 microversion: 2.20 time: 0.248303 Aug 04 17:16:35.378745 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2553/5061] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:16:35 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1340 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:16:36.013507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-27d34550-0420-4dac-bfae-4125cb654bf8 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544002a75c946cda1586cd21f999aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a334b70c2e46c087201aa6787accba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:36.022795 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-27d34550-0420-4dac-bfae-4125cb654bf8 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2" status: 200 len: 1306 microversion: 2.1 time: 0.862803 Aug 04 17:16:36.028062 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2509/5062] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:35 2022] GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2 => generated 1306 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:36.129655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6348efd6-fc23-4f8a-9536-2967c0d1d5e2 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:36.131148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6348efd6-fc23-4f8a-9536-2967c0d1d5e2 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:36.137514 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:36.143900 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=10 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:36.183749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-41ab2a01-8aaa-4991-b898-6c9a2231a61b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:36.184923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-41ab2a01-8aaa-4991-b898-6c9a2231a61b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:36.197948 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6348efd6-fc23-4f8a-9536-2967c0d1d5e2 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:36.199667 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6348efd6-fc23-4f8a-9536-2967c0d1d5e2 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:36.202261 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6348efd6-fc23-4f8a-9536-2967c0d1d5e2 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:36.205844 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41ab2a01-8aaa-4991-b898-6c9a2231a61b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:36.206275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6348efd6-fc23-4f8a-9536-2967c0d1d5e2 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:36.210864 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6348efd6-fc23-4f8a-9536-2967c0d1d5e2 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:36.212194 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41ab2a01-8aaa-4991-b898-6c9a2231a61b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:36.212695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6348efd6-fc23-4f8a-9536-2967c0d1d5e2 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:36.215195 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41ab2a01-8aaa-4991-b898-6c9a2231a61b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:36.216147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41ab2a01-8aaa-4991-b898-6c9a2231a61b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:36.221180 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41ab2a01-8aaa-4991-b898-6c9a2231a61b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:36.225373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41ab2a01-8aaa-4991-b898-6c9a2231a61b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:36.786264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-41ab2a01-8aaa-4991-b898-6c9a2231a61b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:36.801188 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-41ab2a01-8aaa-4991-b898-6c9a2231a61b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba" status: 200 len: 1671 microversion: 2.1 time: 0.618579 Aug 04 17:16:36.814049 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2510/5063] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:36 2022] GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba => generated 1671 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:36.816308 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c8e4f30e-97b9-4a55-a967-64148fa23d5f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:36.817145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c8e4f30e-97b9-4a55-a967-64148fa23d5f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:36.830173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6348efd6-fc23-4f8a-9536-2967c0d1d5e2 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:36.837179 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8e4f30e-97b9-4a55-a967-64148fa23d5f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:36.839904 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8e4f30e-97b9-4a55-a967-64148fa23d5f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:36.840363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8e4f30e-97b9-4a55-a967-64148fa23d5f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:36.841108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8e4f30e-97b9-4a55-a967-64148fa23d5f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:36.841576 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8e4f30e-97b9-4a55-a967-64148fa23d5f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:36.842029 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8e4f30e-97b9-4a55-a967-64148fa23d5f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:36.843950 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6348efd6-fc23-4f8a-9536-2967c0d1d5e2 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1525 microversion: 2.1 time: 0.718756 Aug 04 17:16:36.874858 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2554/5064] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:36 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1525 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:37.049470 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dee8b4e4-b43a-45d6-9be6-9cf962f4e147 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:37.050605 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dee8b4e4-b43a-45d6-9be6-9cf962f4e147 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:37.069146 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dee8b4e4-b43a-45d6-9be6-9cf962f4e147 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:37.069693 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dee8b4e4-b43a-45d6-9be6-9cf962f4e147 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:37.070201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dee8b4e4-b43a-45d6-9be6-9cf962f4e147 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:37.071892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dee8b4e4-b43a-45d6-9be6-9cf962f4e147 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:37.072396 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dee8b4e4-b43a-45d6-9be6-9cf962f4e147 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:37.074120 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dee8b4e4-b43a-45d6-9be6-9cf962f4e147 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:37.306271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c8e4f30e-97b9-4a55-a967-64148fa23d5f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:37.325651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c8e4f30e-97b9-4a55-a967-64148fa23d5f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:37.332392 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c8e4f30e-97b9-4a55-a967-64148fa23d5f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:37.336280 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c8e4f30e-97b9-4a55-a967-64148fa23d5f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1408 microversion: 2.20 time: 0.531671 Aug 04 17:16:37.339732 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2511/5065] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:16:36 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1408 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:16:37.357845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dee8b4e4-b43a-45d6-9be6-9cf962f4e147 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544002a75c946cda1586cd21f999aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a334b70c2e46c087201aa6787accba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:37.365861 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dee8b4e4-b43a-45d6-9be6-9cf962f4e147 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2" status: 200 len: 1306 microversion: 2.1 time: 0.320791 Aug 04 17:16:37.368676 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2555/5066] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:37 2022] GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2 => generated 1306 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:37.824145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cd8adc84-d13c-43c2-bf9c-fa8ede807961 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:37.825394 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cd8adc84-d13c-43c2-bf9c-fa8ede807961 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:37.844424 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd8adc84-d13c-43c2-bf9c-fa8ede807961 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:37.844962 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd8adc84-d13c-43c2-bf9c-fa8ede807961 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:37.845545 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd8adc84-d13c-43c2-bf9c-fa8ede807961 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:37.846539 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd8adc84-d13c-43c2-bf9c-fa8ede807961 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:37.847011 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd8adc84-d13c-43c2-bf9c-fa8ede807961 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:37.847455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd8adc84-d13c-43c2-bf9c-fa8ede807961 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:37.865936 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-585aac63-f47b-4fd6-aa51-401e9ca0db1b tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:37.866347 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-585aac63-f47b-4fd6-aa51-401e9ca0db1b tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:37.886833 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-585aac63-f47b-4fd6-aa51-401e9ca0db1b tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:37.891272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-585aac63-f47b-4fd6-aa51-401e9ca0db1b tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:37.894186 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-585aac63-f47b-4fd6-aa51-401e9ca0db1b tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:37.904487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-585aac63-f47b-4fd6-aa51-401e9ca0db1b tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:37.906739 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-585aac63-f47b-4fd6-aa51-401e9ca0db1b tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:37.907791 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-585aac63-f47b-4fd6-aa51-401e9ca0db1b tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:38.269843 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cd8adc84-d13c-43c2-bf9c-fa8ede807961 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '810ad146d8cc4192a3ae68c58ed84d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1765b9e2226349c5a88f4bc75f8d1029', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:38.280678 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cd8adc84-d13c-43c2-bf9c-fa8ede807961 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba" status: 200 len: 1604 microversion: 2.1 time: 0.460483 Aug 04 17:16:38.283590 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2512/5067] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:37 2022] GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba => generated 1604 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:38.298004 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-e318ccea-1c6c-4138-8141-39f02c3301c2 req-d3fb8034-a516-4e4e-a5ec-b0fc5ba1a75a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7dd09c1-f3da-438a-b0d8-1102ee2d67f8", "tag": "1dd4fc9a-a07b-4b63-82e0-ad9da9f1b5b2"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:38.318465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e318ccea-1c6c-4138-8141-39f02c3301c2 req-d3fb8034-a516-4e4e-a5ec-b0fc5ba1a75a service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:38.324819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e318ccea-1c6c-4138-8141-39f02c3301c2 req-d3fb8034-a516-4e4e-a5ec-b0fc5ba1a75a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:38.325814 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e318ccea-1c6c-4138-8141-39f02c3301c2 req-d3fb8034-a516-4e4e-a5ec-b0fc5ba1a75a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:38.360057 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-e318ccea-1c6c-4138-8141-39f02c3301c2 req-d3fb8034-a516-4e4e-a5ec-b0fc5ba1a75a service nova] Creating event network-changed:1dd4fc9a-a07b-4b63-82e0-ad9da9f1b5b2 for instance e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 on n-h2-851359-3 Aug 04 17:16:38.374360 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-e318ccea-1c6c-4138-8141-39f02c3301c2 req-d3fb8034-a516-4e4e-a5ec-b0fc5ba1a75a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089141 Aug 04 17:16:38.375138 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2513/5068] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:16:38.392829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-83b13a5a-8579-4a5c-b542-e1a54c420801 req-a8af29a8-9ccf-401d-a1f5-54b0ab82de49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81a3d940-08e3-4cb9-bbf2-360653411aba", "name": "network-vif-deleted", "tag": "740dcb36-902c-495f-9a80-a8a83db55035"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:38.419201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-83b13a5a-8579-4a5c-b542-e1a54c420801 req-a8af29a8-9ccf-401d-a1f5-54b0ab82de49 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:38.421370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-83b13a5a-8579-4a5c-b542-e1a54c420801 req-a8af29a8-9ccf-401d-a1f5-54b0ab82de49 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:38.424895 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-83b13a5a-8579-4a5c-b542-e1a54c420801 req-a8af29a8-9ccf-401d-a1f5-54b0ab82de49 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:38.440617 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-83b13a5a-8579-4a5c-b542-e1a54c420801 req-a8af29a8-9ccf-401d-a1f5-54b0ab82de49 service nova] Creating event network-vif-deleted:740dcb36-902c-495f-9a80-a8a83db55035 for instance 81a3d940-08e3-4cb9-bbf2-360653411aba on n-h2-851359-3 Aug 04 17:16:38.454002 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-83b13a5a-8579-4a5c-b542-e1a54c420801 req-a8af29a8-9ccf-401d-a1f5-54b0ab82de49 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077306 Aug 04 17:16:38.454675 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2514/5069] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:16:38.460463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f505d271-e2fa-4803-95d4-ff8a5af0403f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:38.460944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f505d271-e2fa-4803-95d4-ff8a5af0403f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:38.468188 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f505d271-e2fa-4803-95d4-ff8a5af0403f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:38.468690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f505d271-e2fa-4803-95d4-ff8a5af0403f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:38.469136 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f505d271-e2fa-4803-95d4-ff8a5af0403f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:38.469900 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f505d271-e2fa-4803-95d4-ff8a5af0403f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:38.470392 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f505d271-e2fa-4803-95d4-ff8a5af0403f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:38.470856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f505d271-e2fa-4803-95d4-ff8a5af0403f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:38.615306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-585aac63-f47b-4fd6-aa51-401e9ca0db1b tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:38.621287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:38.634591 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-585aac63-f47b-4fd6-aa51-401e9ca0db1b tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1525 microversion: 2.1 time: 0.771935 Aug 04 17:16:38.636652 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2556/5070] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:37 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1525 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:38.652348 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-704c9e58-f550-4eed-a64a-bed9bb4314c9 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:38.654646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-704c9e58-f550-4eed-a64a-bed9bb4314c9 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:38.674835 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-704c9e58-f550-4eed-a64a-bed9bb4314c9 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:38.675370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-704c9e58-f550-4eed-a64a-bed9bb4314c9 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:38.675832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-704c9e58-f550-4eed-a64a-bed9bb4314c9 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:38.676577 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-704c9e58-f550-4eed-a64a-bed9bb4314c9 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:38.677082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-704c9e58-f550-4eed-a64a-bed9bb4314c9 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:38.677482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-704c9e58-f550-4eed-a64a-bed9bb4314c9 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:38.772793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f505d271-e2fa-4803-95d4-ff8a5af0403f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:38.791367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f505d271-e2fa-4803-95d4-ff8a5af0403f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:38.792917 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f505d271-e2fa-4803-95d4-ff8a5af0403f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:38.796993 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f505d271-e2fa-4803-95d4-ff8a5af0403f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1408 microversion: 2.20 time: 0.338344 Aug 04 17:16:38.810494 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2515/5071] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:16:38 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1408 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:16:39.071524 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-704c9e58-f550-4eed-a64a-bed9bb4314c9 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544002a75c946cda1586cd21f999aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a334b70c2e46c087201aa6787accba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:39.096091 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-704c9e58-f550-4eed-a64a-bed9bb4314c9 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2" status: 200 len: 1294 microversion: 2.1 time: 0.455528 Aug 04 17:16:39.097111 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2557/5072] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:38 2022] GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2 => generated 1294 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:39.308370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-783c4531-5dda-4500-aa33-8d7b989b596a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:39.309450 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-783c4531-5dda-4500-aa33-8d7b989b596a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:39.319643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-783c4531-5dda-4500-aa33-8d7b989b596a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:39.322009 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-783c4531-5dda-4500-aa33-8d7b989b596a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:39.322652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-783c4531-5dda-4500-aa33-8d7b989b596a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:39.323718 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-783c4531-5dda-4500-aa33-8d7b989b596a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:39.324648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-783c4531-5dda-4500-aa33-8d7b989b596a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:39.325276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-783c4531-5dda-4500-aa33-8d7b989b596a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:39.346262 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-783c4531-5dda-4500-aa33-8d7b989b596a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] HTTP exception thrown: Instance 81a3d940-08e3-4cb9-bbf2-360653411aba could not be found. Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-783c4531-5dda-4500-aa33-8d7b989b596a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Request method failure captured: Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba HTTP/1.1 Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_zGCdsK5fTsJNuSOUxSWg-YTj1-lII6Z7pJ8BanEAMuYJecZRZb3pZbwuZ0In05o4XEYRTqt5hpx76W80TGbjmNpJfL5k9fXLc--Ib8YV9bL_XUOa3XoP2TnhEkLLeANN5OpwDqQFpjdtiXXvU36x8KyTPlzTPWEPSqKrOwevSP5rs Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 1765b9e2226349c5a88f4bc75f8d1029 Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-AttachVolumeTestJSON-1568891137 Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1765b9e2226349c5a88f4bc75f8d1029"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1765b9e2226349c5a88f4bc75f8d1029"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1765b9e2226349c5a88f4bc75f8d1029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1765b9e2226349c5a88f4bc75f8d1029"}]}] Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-AttachVolumeTestJSON-1568891137 Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 1765b9e2226349c5a88f4bc75f8d1029 Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1568891137 Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-AttachVolumeTestJSON-1568891137-project Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 810ad146d8cc4192a3ae68c58ed84d2b Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-AttachVolumeTestJSON-1568891137-project Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 81a3d940-08e3-4cb9-bbf2-360653411aba could not be found. Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '81a3d940-08e3-4cb9-bbf2-360653411aba'} Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81a3d940-08e3-4cb9-bbf2-360653411aba could not be found. Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81a3d940-08e3-4cb9-bbf2-360653411aba could not be found. Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:39.348016 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:39.352748 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:39.352748 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:39.352748 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:39.352748 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:16:39.352748 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:16:39.352748 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81a3d940-08e3-4cb9-bbf2-360653411aba could not be found. Aug 04 17:16:39.352748 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:39.352748 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-783c4531-5dda-4500-aa33-8d7b989b596a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Returning 404 to user: Instance 81a3d940-08e3-4cb9-bbf2-360653411aba could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:16:39.352748 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-783c4531-5dda-4500-aa33-8d7b989b596a tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba" status: 404 len: 111 microversion: 2.1 time: 0.047722 Aug 04 17:16:39.352748 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2516/5073] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:39 2022] GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:16:39.365574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bd84cf93-1614-4daa-802d-73616b5ed292 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '.version_select at 0x7f1e5b7cc4c0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:39.393577 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bd84cf93-1614-4daa-802d-73616b5ed292 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2443255" status: 202 len: 0 microversion: 2.1 time: 0.034318 Aug 04 17:16:39.401024 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2558/5074] 10.222.0.93 () {58 vars in 1212 bytes} [Thu Aug 4 17:16:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2443255 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:16:39.656604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1b7846b6-77f5-47f2-ac99-e156ae726222 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:39.657225 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1b7846b6-77f5-47f2-ac99-e156ae726222 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:39.678972 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b7846b6-77f5-47f2-ac99-e156ae726222 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:39.680498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b7846b6-77f5-47f2-ac99-e156ae726222 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:39.684089 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b7846b6-77f5-47f2-ac99-e156ae726222 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:39.685115 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b7846b6-77f5-47f2-ac99-e156ae726222 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:39.686458 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b7846b6-77f5-47f2-ac99-e156ae726222 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:39.687123 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b7846b6-77f5-47f2-ac99-e156ae726222 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:39.820096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-45fe1574-51fe-42f2-8c63-1f4d7704f573 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:39.822163 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-45fe1574-51fe-42f2-8c63-1f4d7704f573 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:39.841294 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-45fe1574-51fe-42f2-8c63-1f4d7704f573 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:39.844319 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-45fe1574-51fe-42f2-8c63-1f4d7704f573 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:39.847852 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-45fe1574-51fe-42f2-8c63-1f4d7704f573 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:39.849261 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-45fe1574-51fe-42f2-8c63-1f4d7704f573 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:39.849754 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-45fe1574-51fe-42f2-8c63-1f4d7704f573 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:39.850233 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-45fe1574-51fe-42f2-8c63-1f4d7704f573 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:39.942284 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1b7846b6-77f5-47f2-ac99-e156ae726222 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:39.955859 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1b7846b6-77f5-47f2-ac99-e156ae726222 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1525 microversion: 2.1 time: 0.303006 Aug 04 17:16:39.957455 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2517/5075] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:39 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1525 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:40.097517 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-45fe1574-51fe-42f2-8c63-1f4d7704f573 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:40.110093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-45fe1574-51fe-42f2-8c63-1f4d7704f573 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:40.113812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-45fe1574-51fe-42f2-8c63-1f4d7704f573 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:40.115507 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-45fe1574-51fe-42f2-8c63-1f4d7704f573 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1408 microversion: 2.20 time: 0.299679 Aug 04 17:16:40.116525 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2559/5076] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:16:39 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1408 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:16:40.134631 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2c6df049-9fe6-4e2a-a9bf-0d0e9cb23377 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:40.135738 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2c6df049-9fe6-4e2a-a9bf-0d0e9cb23377 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:40.145079 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c6df049-9fe6-4e2a-a9bf-0d0e9cb23377 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:40.146853 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c6df049-9fe6-4e2a-a9bf-0d0e9cb23377 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:40.148011 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c6df049-9fe6-4e2a-a9bf-0d0e9cb23377 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:40.149810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c6df049-9fe6-4e2a-a9bf-0d0e9cb23377 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:40.150590 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c6df049-9fe6-4e2a-a9bf-0d0e9cb23377 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:40.152598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c6df049-9fe6-4e2a-a9bf-0d0e9cb23377 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:40.394308 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2c6df049-9fe6-4e2a-a9bf-0d0e9cb23377 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544002a75c946cda1586cd21f999aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a334b70c2e46c087201aa6787accba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:40.406815 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2c6df049-9fe6-4e2a-a9bf-0d0e9cb23377 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2" status: 200 len: 1294 microversion: 2.1 time: 0.291344 Aug 04 17:16:40.407427 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2518/5077] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:40 2022] GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2 => generated 1294 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:40.978220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-55ab47f7-a2a9-4141-8d97-fdd8bfcf76a7 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:40.979622 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-55ab47f7-a2a9-4141-8d97-fdd8bfcf76a7 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:40.987875 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-55ab47f7-a2a9-4141-8d97-fdd8bfcf76a7 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:40.989289 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-55ab47f7-a2a9-4141-8d97-fdd8bfcf76a7 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:40.990364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-55ab47f7-a2a9-4141-8d97-fdd8bfcf76a7 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:40.991756 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-55ab47f7-a2a9-4141-8d97-fdd8bfcf76a7 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:40.993278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-55ab47f7-a2a9-4141-8d97-fdd8bfcf76a7 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:40.993999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-55ab47f7-a2a9-4141-8d97-fdd8bfcf76a7 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:41.139974 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b6a361a7-313e-4338-b3ee-ab2af16a43f3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:41.140610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b6a361a7-313e-4338-b3ee-ab2af16a43f3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:41.143010 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:41.144286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=12 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:41.155358 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6a361a7-313e-4338-b3ee-ab2af16a43f3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:41.155794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6a361a7-313e-4338-b3ee-ab2af16a43f3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:41.156241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6a361a7-313e-4338-b3ee-ab2af16a43f3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:41.156965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6a361a7-313e-4338-b3ee-ab2af16a43f3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:41.157435 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6a361a7-313e-4338-b3ee-ab2af16a43f3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:41.164616 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6a361a7-313e-4338-b3ee-ab2af16a43f3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:41.616395 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-55ab47f7-a2a9-4141-8d97-fdd8bfcf76a7 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:41.632607 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-55ab47f7-a2a9-4141-8d97-fdd8bfcf76a7 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1525 microversion: 2.1 time: 0.659514 Aug 04 17:16:41.634529 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2560/5078] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:40 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1525 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:41.639598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6aa98786-f1a0-45f5-a931-f51632a85f51 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:41.640942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6aa98786-f1a0-45f5-a931-f51632a85f51 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:41.671606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6aa98786-f1a0-45f5-a931-f51632a85f51 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:41.673105 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6aa98786-f1a0-45f5-a931-f51632a85f51 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:41.673719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6aa98786-f1a0-45f5-a931-f51632a85f51 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:41.674606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6aa98786-f1a0-45f5-a931-f51632a85f51 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:41.675977 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6aa98786-f1a0-45f5-a931-f51632a85f51 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:41.676540 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6aa98786-f1a0-45f5-a931-f51632a85f51 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:41.708995 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b6a361a7-313e-4338-b3ee-ab2af16a43f3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:41.728598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b6a361a7-313e-4338-b3ee-ab2af16a43f3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:41.733968 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b6a361a7-313e-4338-b3ee-ab2af16a43f3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:41.737026 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b6a361a7-313e-4338-b3ee-ab2af16a43f3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1408 microversion: 2.20 time: 0.599944 Aug 04 17:16:41.737648 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2519/5079] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:16:41 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1408 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:16:42.620277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6aa98786-f1a0-45f5-a931-f51632a85f51 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544002a75c946cda1586cd21f999aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a334b70c2e46c087201aa6787accba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:42.636193 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6aa98786-f1a0-45f5-a931-f51632a85f51 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2" status: 200 len: 1294 microversion: 2.1 time: 1.000279 Aug 04 17:16:42.638711 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2561/5080] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:41 2022] GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2 => generated 1294 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:42.663348 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dc9e132f-1dd0-4253-a953-0d5f5c1dd1ba tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:42.664096 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dc9e132f-1dd0-4253-a953-0d5f5c1dd1ba tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:42.676506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc9e132f-1dd0-4253-a953-0d5f5c1dd1ba tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:42.677117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc9e132f-1dd0-4253-a953-0d5f5c1dd1ba tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:42.677691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc9e132f-1dd0-4253-a953-0d5f5c1dd1ba tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:42.678522 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc9e132f-1dd0-4253-a953-0d5f5c1dd1ba tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:42.679066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc9e132f-1dd0-4253-a953-0d5f5c1dd1ba tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:42.679599 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc9e132f-1dd0-4253-a953-0d5f5c1dd1ba tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:42.761524 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3ae9917b-e8b6-418e-8535-32cd137999e8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:42.762592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3ae9917b-e8b6-418e-8535-32cd137999e8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:42.770217 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ae9917b-e8b6-418e-8535-32cd137999e8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:42.771110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ae9917b-e8b6-418e-8535-32cd137999e8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:42.771827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ae9917b-e8b6-418e-8535-32cd137999e8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:42.772717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ae9917b-e8b6-418e-8535-32cd137999e8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:42.773184 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ae9917b-e8b6-418e-8535-32cd137999e8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:42.773734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ae9917b-e8b6-418e-8535-32cd137999e8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:43.204448 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3ae9917b-e8b6-418e-8535-32cd137999e8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:43.227847 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3ae9917b-e8b6-418e-8535-32cd137999e8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:43.230232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3ae9917b-e8b6-418e-8535-32cd137999e8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:43.232053 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3ae9917b-e8b6-418e-8535-32cd137999e8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1408 microversion: 2.20 time: 0.475552 Aug 04 17:16:43.233166 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2562/5081] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:16:42 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1408 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:16:43.306866 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dc9e132f-1dd0-4253-a953-0d5f5c1dd1ba tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:43.320345 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dc9e132f-1dd0-4253-a953-0d5f5c1dd1ba tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1525 microversion: 2.1 time: 0.664930 Aug 04 17:16:43.341054 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2520/5082] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:42 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1525 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:43.660599 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ba6be23b-515f-4798-ab46-18a11037720b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:43.661220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ba6be23b-515f-4798-ab46-18a11037720b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:43.670348 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba6be23b-515f-4798-ab46-18a11037720b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:43.671127 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba6be23b-515f-4798-ab46-18a11037720b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:43.677034 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba6be23b-515f-4798-ab46-18a11037720b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:43.678168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba6be23b-515f-4798-ab46-18a11037720b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:43.680318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba6be23b-515f-4798-ab46-18a11037720b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:43.680990 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba6be23b-515f-4798-ab46-18a11037720b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:44.182460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ba6be23b-515f-4798-ab46-18a11037720b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544002a75c946cda1586cd21f999aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a334b70c2e46c087201aa6787accba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:44.191767 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ba6be23b-515f-4798-ab46-18a11037720b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2" status: 200 len: 1294 microversion: 2.1 time: 0.534943 Aug 04 17:16:44.210985 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2563/5083] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:43 2022] GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2 => generated 1294 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:44.255237 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1b5da058-e828-4345-8b2d-4beb0e89f67f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:44.256743 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1b5da058-e828-4345-8b2d-4beb0e89f67f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:44.269284 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b5da058-e828-4345-8b2d-4beb0e89f67f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:44.276499 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b5da058-e828-4345-8b2d-4beb0e89f67f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:44.277284 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b5da058-e828-4345-8b2d-4beb0e89f67f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:44.279942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b5da058-e828-4345-8b2d-4beb0e89f67f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:44.280587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b5da058-e828-4345-8b2d-4beb0e89f67f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:44.283168 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b5da058-e828-4345-8b2d-4beb0e89f67f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:44.347873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-91c30388-941c-4202-9961-79183eef4482 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:44.348945 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-91c30388-941c-4202-9961-79183eef4482 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:44.360355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91c30388-941c-4202-9961-79183eef4482 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:44.360705 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91c30388-941c-4202-9961-79183eef4482 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:44.361673 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91c30388-941c-4202-9961-79183eef4482 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:44.362642 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91c30388-941c-4202-9961-79183eef4482 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:44.363533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91c30388-941c-4202-9961-79183eef4482 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:44.364133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91c30388-941c-4202-9961-79183eef4482 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:44.661577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1b5da058-e828-4345-8b2d-4beb0e89f67f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:44.675293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1b5da058-e828-4345-8b2d-4beb0e89f67f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:44.677064 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1b5da058-e828-4345-8b2d-4beb0e89f67f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:44.678396 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1b5da058-e828-4345-8b2d-4beb0e89f67f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1408 microversion: 2.20 time: 0.427294 Aug 04 17:16:44.681782 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-91c30388-941c-4202-9961-79183eef4482 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:44.684952 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2521/5084] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:16:44 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1408 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:16:44.700746 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-91c30388-941c-4202-9961-79183eef4482 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1525 microversion: 2.1 time: 0.358349 Aug 04 17:16:44.701581 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2564/5085] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:44 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1525 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:45.220598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eef2edc2-1843-4648-86fa-73bad7e34220 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:45.221485 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eef2edc2-1843-4648-86fa-73bad7e34220 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:45.233294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eef2edc2-1843-4648-86fa-73bad7e34220 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:45.235158 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eef2edc2-1843-4648-86fa-73bad7e34220 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:45.236882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eef2edc2-1843-4648-86fa-73bad7e34220 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:45.239139 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eef2edc2-1843-4648-86fa-73bad7e34220 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:45.239847 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eef2edc2-1843-4648-86fa-73bad7e34220 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:45.241131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eef2edc2-1843-4648-86fa-73bad7e34220 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:45.584228 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eef2edc2-1843-4648-86fa-73bad7e34220 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544002a75c946cda1586cd21f999aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a334b70c2e46c087201aa6787accba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:45.592028 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eef2edc2-1843-4648-86fa-73bad7e34220 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2" status: 200 len: 1294 microversion: 2.1 time: 0.379373 Aug 04 17:16:45.593075 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2522/5086] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:45 2022] GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2 => generated 1294 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:45.706725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c2634418-5968-4098-b4a6-541b4e4d430d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:45.707356 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c2634418-5968-4098-b4a6-541b4e4d430d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:45.722807 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2634418-5968-4098-b4a6-541b4e4d430d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:45.723130 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7bd43032-c93c-4b6e-80d5-bf7369761b6f tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:45.724267 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2634418-5968-4098-b4a6-541b4e4d430d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:45.724758 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7bd43032-c93c-4b6e-80d5-bf7369761b6f tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:45.725077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2634418-5968-4098-b4a6-541b4e4d430d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:45.726049 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2634418-5968-4098-b4a6-541b4e4d430d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:45.728077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2634418-5968-4098-b4a6-541b4e4d430d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:45.728737 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2634418-5968-4098-b4a6-541b4e4d430d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:45.737551 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7bd43032-c93c-4b6e-80d5-bf7369761b6f tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:45.739042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7bd43032-c93c-4b6e-80d5-bf7369761b6f tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:45.740328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7bd43032-c93c-4b6e-80d5-bf7369761b6f tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:45.742297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7bd43032-c93c-4b6e-80d5-bf7369761b6f tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:45.744839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7bd43032-c93c-4b6e-80d5-bf7369761b6f tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:45.745300 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7bd43032-c93c-4b6e-80d5-bf7369761b6f tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:46.243955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c2634418-5968-4098-b4a6-541b4e4d430d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:46.256815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c2634418-5968-4098-b4a6-541b4e4d430d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:46.259101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c2634418-5968-4098-b4a6-541b4e4d430d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:46.264574 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c2634418-5968-4098-b4a6-541b4e4d430d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1408 microversion: 2.20 time: 0.562147 Aug 04 17:16:46.266385 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2565/5087] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:16:45 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1408 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:16:46.278282 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7bd43032-c93c-4b6e-80d5-bf7369761b6f tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:46.303292 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7bd43032-c93c-4b6e-80d5-bf7369761b6f tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1525 microversion: 2.1 time: 0.583099 Aug 04 17:16:46.306120 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2523/5088] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:45 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1525 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:16:46.613379 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3ac97935-11cb-4528-8c06-01569a2c9fe9 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:46.614682 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3ac97935-11cb-4528-8c06-01569a2c9fe9 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:46.626728 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ac97935-11cb-4528-8c06-01569a2c9fe9 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:46.630854 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ac97935-11cb-4528-8c06-01569a2c9fe9 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:46.631695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ac97935-11cb-4528-8c06-01569a2c9fe9 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:46.632817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ac97935-11cb-4528-8c06-01569a2c9fe9 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:46.634137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ac97935-11cb-4528-8c06-01569a2c9fe9 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:46.636421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ac97935-11cb-4528-8c06-01569a2c9fe9 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:46.932340 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3ac97935-11cb-4528-8c06-01569a2c9fe9 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544002a75c946cda1586cd21f999aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a334b70c2e46c087201aa6787accba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:46.948541 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3ac97935-11cb-4528-8c06-01569a2c9fe9 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2" status: 200 len: 1294 microversion: 2.1 time: 0.339372 Aug 04 17:16:46.949135 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2566/5089] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:46 2022] GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2 => generated 1294 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:47.058077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-7f2acdaf-9289-4506-991d-3bcc8ae98fa2 req-0f849e14-2cd8-4c79-99cf-7683a080f2bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7dd09c1-f3da-438a-b0d8-1102ee2d67f8", "name": "network-vif-plugged", "status": "completed", "tag": "1dd4fc9a-a07b-4b63-82e0-ad9da9f1b5b2"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:47.077892 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7f2acdaf-9289-4506-991d-3bcc8ae98fa2 req-0f849e14-2cd8-4c79-99cf-7683a080f2bb service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:47.078076 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7f2acdaf-9289-4506-991d-3bcc8ae98fa2 req-0f849e14-2cd8-4c79-99cf-7683a080f2bb service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:47.083752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7f2acdaf-9289-4506-991d-3bcc8ae98fa2 req-0f849e14-2cd8-4c79-99cf-7683a080f2bb service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:47.118786 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-7f2acdaf-9289-4506-991d-3bcc8ae98fa2 req-0f849e14-2cd8-4c79-99cf-7683a080f2bb service nova] Creating event network-vif-plugged:1dd4fc9a-a07b-4b63-82e0-ad9da9f1b5b2 for instance e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 on n-h2-851359-3 Aug 04 17:16:47.132055 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-7f2acdaf-9289-4506-991d-3bcc8ae98fa2 req-0f849e14-2cd8-4c79-99cf-7683a080f2bb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081364 Aug 04 17:16:47.132770 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2524/5090] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:16:47.291631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bf14bbb1-bfd7-4177-b878-a41c2ad6df12 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:47.292615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bf14bbb1-bfd7-4177-b878-a41c2ad6df12 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:47.312572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf14bbb1-bfd7-4177-b878-a41c2ad6df12 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:47.313568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf14bbb1-bfd7-4177-b878-a41c2ad6df12 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:47.314377 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf14bbb1-bfd7-4177-b878-a41c2ad6df12 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:47.315396 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf14bbb1-bfd7-4177-b878-a41c2ad6df12 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:47.316288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf14bbb1-bfd7-4177-b878-a41c2ad6df12 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:47.317141 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf14bbb1-bfd7-4177-b878-a41c2ad6df12 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:47.328800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9408f730-6dde-4865-ae9e-66f023843660 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:47.329595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9408f730-6dde-4865-ae9e-66f023843660 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:47.360990 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9408f730-6dde-4865-ae9e-66f023843660 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:47.362854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9408f730-6dde-4865-ae9e-66f023843660 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:47.366764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9408f730-6dde-4865-ae9e-66f023843660 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:47.368101 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9408f730-6dde-4865-ae9e-66f023843660 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:47.368580 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9408f730-6dde-4865-ae9e-66f023843660 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:47.369021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9408f730-6dde-4865-ae9e-66f023843660 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:47.792721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bf14bbb1-bfd7-4177-b878-a41c2ad6df12 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:47.803146 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bf14bbb1-bfd7-4177-b878-a41c2ad6df12 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:47.805027 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bf14bbb1-bfd7-4177-b878-a41c2ad6df12 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:47.806267 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bf14bbb1-bfd7-4177-b878-a41c2ad6df12 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1408 microversion: 2.20 time: 0.520690 Aug 04 17:16:47.822497 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2567/5091] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:16:47 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1408 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:16:47.825042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9408f730-6dde-4865-ae9e-66f023843660 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:47.846346 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9408f730-6dde-4865-ae9e-66f023843660 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1525 microversion: 2.1 time: 0.524867 Aug 04 17:16:47.847371 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2525/5092] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:47 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1525 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:16:47.970012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-daecc778-b825-4c5c-a65d-4270f4ce78af tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:47.970797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-daecc778-b825-4c5c-a65d-4270f4ce78af tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:47.977156 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-daecc778-b825-4c5c-a65d-4270f4ce78af tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:47.982295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-daecc778-b825-4c5c-a65d-4270f4ce78af tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:47.982819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-daecc778-b825-4c5c-a65d-4270f4ce78af tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:47.983884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-daecc778-b825-4c5c-a65d-4270f4ce78af tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:47.984433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-daecc778-b825-4c5c-a65d-4270f4ce78af tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:47.984942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-daecc778-b825-4c5c-a65d-4270f4ce78af tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:48.191191 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-daecc778-b825-4c5c-a65d-4270f4ce78af tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544002a75c946cda1586cd21f999aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a334b70c2e46c087201aa6787accba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:48.202535 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-daecc778-b825-4c5c-a65d-4270f4ce78af tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2" status: 200 len: 1294 microversion: 2.1 time: 0.237011 Aug 04 17:16:48.217494 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2568/5093] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:47 2022] GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2 => generated 1294 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:48.548525 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-20743dc8-480b-46e4-b8c7-06b25fc8617e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1993929122", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "f20ac3e7-ddd2-4167-bdf1-b8b75ff31772"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:48.691422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-20743dc8-480b-46e4-b8c7-06b25fc8617e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] validate_networks() for [('f20ac3e7-ddd2-4167-bdf1-b8b75ff31772', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:16:48.829136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1574af45-4462-4606-862c-044eaf9c0a9f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:48.829864 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1574af45-4462-4606-862c-044eaf9c0a9f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:48.842223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1574af45-4462-4606-862c-044eaf9c0a9f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:48.843064 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1574af45-4462-4606-862c-044eaf9c0a9f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:48.844384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1574af45-4462-4606-862c-044eaf9c0a9f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:48.846170 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1574af45-4462-4606-862c-044eaf9c0a9f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:48.851522 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1574af45-4462-4606-862c-044eaf9c0a9f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:48.852506 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1574af45-4462-4606-862c-044eaf9c0a9f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:49.622158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1574af45-4462-4606-862c-044eaf9c0a9f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:49.633417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1574af45-4462-4606-862c-044eaf9c0a9f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:49.635412 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1574af45-4462-4606-862c-044eaf9c0a9f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:49.636704 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1574af45-4462-4606-862c-044eaf9c0a9f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1408 microversion: 2.20 time: 0.811579 Aug 04 17:16:49.637269 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2569/5094] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:16:48 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1408 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:16:49.642343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-01f600b6-d9b8-45f3-86dd-a10f9754aa7e tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:49.643175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-01f600b6-d9b8-45f3-86dd-a10f9754aa7e tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:49.653122 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01f600b6-d9b8-45f3-86dd-a10f9754aa7e tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:49.653859 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01f600b6-d9b8-45f3-86dd-a10f9754aa7e tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:49.654489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01f600b6-d9b8-45f3-86dd-a10f9754aa7e tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:49.655374 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01f600b6-d9b8-45f3-86dd-a10f9754aa7e tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:49.655955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01f600b6-d9b8-45f3-86dd-a10f9754aa7e tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:49.656415 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01f600b6-d9b8-45f3-86dd-a10f9754aa7e tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:49.957067 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-01f600b6-d9b8-45f3-86dd-a10f9754aa7e tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:49.967869 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-01f600b6-d9b8-45f3-86dd-a10f9754aa7e tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1525 microversion: 2.1 time: 0.329548 Aug 04 17:16:49.974544 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-20743dc8-480b-46e4-b8c7-06b25fc8617e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:16:49.975018 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-20743dc8-480b-46e4-b8c7-06b25fc8617e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:16:49.975440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-20743dc8-480b-46e4-b8c7-06b25fc8617e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:16:49.975858 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-20743dc8-480b-46e4-b8c7-06b25fc8617e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:16:49.976282 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-20743dc8-480b-46e4-b8c7-06b25fc8617e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:16:49.981597 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2570/5095] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:49 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1525 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:49.987848 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20743dc8-480b-46e4-b8c7-06b25fc8617e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:49.988571 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20743dc8-480b-46e4-b8c7-06b25fc8617e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:49.989177 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20743dc8-480b-46e4-b8c7-06b25fc8617e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:49.990271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20743dc8-480b-46e4-b8c7-06b25fc8617e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:49.990898 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20743dc8-480b-46e4-b8c7-06b25fc8617e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:49.991425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8b6048aa-cc66-4025-ab30-066bf54256dc tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:49.991756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20743dc8-480b-46e4-b8c7-06b25fc8617e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:49.992516 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8b6048aa-cc66-4025-ab30-066bf54256dc tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:50.011583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8b6048aa-cc66-4025-ab30-066bf54256dc tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:50.012485 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8b6048aa-cc66-4025-ab30-066bf54256dc tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:50.018965 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8b6048aa-cc66-4025-ab30-066bf54256dc tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:50.020165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8b6048aa-cc66-4025-ab30-066bf54256dc tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:50.020899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8b6048aa-cc66-4025-ab30-066bf54256dc tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:50.021800 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8b6048aa-cc66-4025-ab30-066bf54256dc tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:50.028786 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-20743dc8-480b-46e4-b8c7-06b25fc8617e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Getting quotas for project 5f7878e13541477b80e6ede62a2a8554. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:16:50.036080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-20743dc8-480b-46e4-b8c7-06b25fc8617e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Getting quotas for user 3f21709d5ed549ffae941a6060ea6dcb and project 5f7878e13541477b80e6ede62a2a8554. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:16:50.055359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-20743dc8-480b-46e4-b8c7-06b25fc8617e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:16:50.059810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-20743dc8-480b-46e4-b8c7-06b25fc8617e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:16:50.122564 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:50.154887 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-20743dc8-480b-46e4-b8c7-06b25fc8617e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.838875 Aug 04 17:16:50.156150 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2526/5096] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:16:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:16:50.163136 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-87c596e9-9ee2-40f1-a143-bd15afabaf32 req-83810623-c96b-4595-bffd-d45b2bd537b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b49ca99e-4a64-4d5d-aeb8-f61760944ce2", "name": "network-vif-plugged", "status": "completed", "tag": "0427cc5e-0bd3-4508-b821-5cc6d9a8ed83"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:50.176116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-87c596e9-9ee2-40f1-a143-bd15afabaf32 req-83810623-c96b-4595-bffd-d45b2bd537b0 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:50.176921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-87c596e9-9ee2-40f1-a143-bd15afabaf32 req-83810623-c96b-4595-bffd-d45b2bd537b0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:50.177505 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-87c596e9-9ee2-40f1-a143-bd15afabaf32 req-83810623-c96b-4595-bffd-d45b2bd537b0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:50.215966 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-87c596e9-9ee2-40f1-a143-bd15afabaf32 req-83810623-c96b-4595-bffd-d45b2bd537b0 service nova] Creating event network-vif-plugged:0427cc5e-0bd3-4508-b821-5cc6d9a8ed83 for instance b49ca99e-4a64-4d5d-aeb8-f61760944ce2 on n-h1-851359-3 Aug 04 17:16:50.225425 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-87c596e9-9ee2-40f1-a143-bd15afabaf32 req-83810623-c96b-4595-bffd-d45b2bd537b0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067525 Aug 04 17:16:50.226054 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2527/5097] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:16:50.231168 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8b612c5d-9136-4b74-b4b4-295886e54ac5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:50.231871 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8b612c5d-9136-4b74-b4b4-295886e54ac5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:50.324103 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8b6048aa-cc66-4025-ab30-066bf54256dc tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544002a75c946cda1586cd21f999aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a334b70c2e46c087201aa6787accba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:50.343614 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8b6048aa-cc66-4025-ab30-066bf54256dc tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2" status: 200 len: 1294 microversion: 2.1 time: 0.359853 Aug 04 17:16:50.344324 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2571/5098] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:49 2022] GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2 => generated 1294 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:50.352586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8b612c5d-9136-4b74-b4b4-295886e54ac5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:50.361723 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8b612c5d-9136-4b74-b4b4-295886e54ac5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1217 microversion: 2.1 time: 0.134441 Aug 04 17:16:50.362627 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2528/5099] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:50 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1217 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:50.484627 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-16fa0463-f850-4d82-9f3f-3c63865fea74 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:50.486205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-16fa0463-f850-4d82-9f3f-3c63865fea74 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:50.498397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16fa0463-f850-4d82-9f3f-3c63865fea74 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:50.498908 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16fa0463-f850-4d82-9f3f-3c63865fea74 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:50.499354 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16fa0463-f850-4d82-9f3f-3c63865fea74 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:50.500287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16fa0463-f850-4d82-9f3f-3c63865fea74 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:50.500756 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16fa0463-f850-4d82-9f3f-3c63865fea74 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:50.501191 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16fa0463-f850-4d82-9f3f-3c63865fea74 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:50.555665 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-16fa0463-f850-4d82-9f3f-3c63865fea74 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] HTTP exception thrown: Instance 81a3d940-08e3-4cb9-bbf2-360653411aba could not be found. Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-16fa0463-f850-4d82-9f3f-3c63865fea74 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Request method failure captured: Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba HTTP/1.1 Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_zGCdsK5fTsJNuSOUxSWg-YTj1-lII6Z7pJ8BanEAMuYJecZRZb3pZbwuZ0In05o4XEYRTqt5hpx76W80TGbjmNpJfL5k9fXLc--Ib8YV9bL_XUOa3XoP2TnhEkLLeANN5OpwDqQFpjdtiXXvU36x8KyTPlzTPWEPSqKrOwevSP5rs Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 1765b9e2226349c5a88f4bc75f8d1029 Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-AttachVolumeTestJSON-1568891137 Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1765b9e2226349c5a88f4bc75f8d1029"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1765b9e2226349c5a88f4bc75f8d1029"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1765b9e2226349c5a88f4bc75f8d1029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1765b9e2226349c5a88f4bc75f8d1029"}]}] Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-AttachVolumeTestJSON-1568891137 Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 1765b9e2226349c5a88f4bc75f8d1029 Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1568891137 Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-AttachVolumeTestJSON-1568891137-project Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 810ad146d8cc4192a3ae68c58ed84d2b Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-AttachVolumeTestJSON-1568891137-project Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 81a3d940-08e3-4cb9-bbf2-360653411aba could not be found. Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '81a3d940-08e3-4cb9-bbf2-360653411aba'} Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81a3d940-08e3-4cb9-bbf2-360653411aba could not be found. Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:16:50.559441 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:16:50.563529 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81a3d940-08e3-4cb9-bbf2-360653411aba could not be found. Aug 04 17:16:50.563529 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:50.563529 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:50.563529 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:50.563529 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:50.563529 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:50.563529 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:50.563529 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:16:50.563529 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:16:50.563529 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81a3d940-08e3-4cb9-bbf2-360653411aba could not be found. Aug 04 17:16:50.563529 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:50.563529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-16fa0463-f850-4d82-9f3f-3c63865fea74 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Returning 404 to user: Instance 81a3d940-08e3-4cb9-bbf2-360653411aba could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:16:50.563529 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-16fa0463-f850-4d82-9f3f-3c63865fea74 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "DELETE /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba" status: 404 len: 111 microversion: 2.1 time: 0.081608 Aug 04 17:16:50.563529 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2572/5100] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:16:50 2022] DELETE /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:16:50.572732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-03d94364-f025-4afb-acae-40994e72a84b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:50.573938 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-03d94364-f025-4afb-acae-40994e72a84b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 81a3d940-08e3-4cb9-bbf2-360653411aba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:50.583216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03d94364-f025-4afb-acae-40994e72a84b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:50.584075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03d94364-f025-4afb-acae-40994e72a84b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:50.584511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03d94364-f025-4afb-acae-40994e72a84b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:50.585330 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03d94364-f025-4afb-acae-40994e72a84b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:50.585801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03d94364-f025-4afb-acae-40994e72a84b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:50.586312 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03d94364-f025-4afb-acae-40994e72a84b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:50.591746 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:50.604373 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-03d94364-f025-4afb-acae-40994e72a84b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] HTTP exception thrown: Instance 81a3d940-08e3-4cb9-bbf2-360653411aba could not be found. Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-03d94364-f025-4afb-acae-40994e72a84b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Request method failure captured: Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba HTTP/1.1 Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_zGCdsK5fTsJNuSOUxSWg-YTj1-lII6Z7pJ8BanEAMuYJecZRZb3pZbwuZ0In05o4XEYRTqt5hpx76W80TGbjmNpJfL5k9fXLc--Ib8YV9bL_XUOa3XoP2TnhEkLLeANN5OpwDqQFpjdtiXXvU36x8KyTPlzTPWEPSqKrOwevSP5rs Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 1765b9e2226349c5a88f4bc75f8d1029 Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-AttachVolumeTestJSON-1568891137 Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1765b9e2226349c5a88f4bc75f8d1029"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1765b9e2226349c5a88f4bc75f8d1029"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1765b9e2226349c5a88f4bc75f8d1029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1765b9e2226349c5a88f4bc75f8d1029"}]}] Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-AttachVolumeTestJSON-1568891137 Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 1765b9e2226349c5a88f4bc75f8d1029 Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1568891137 Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-AttachVolumeTestJSON-1568891137-project Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 810ad146d8cc4192a3ae68c58ed84d2b Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-AttachVolumeTestJSON-1568891137-project Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 81a3d940-08e3-4cb9-bbf2-360653411aba could not be found. Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '81a3d940-08e3-4cb9-bbf2-360653411aba'} Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81a3d940-08e3-4cb9-bbf2-360653411aba could not be found. Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81a3d940-08e3-4cb9-bbf2-360653411aba could not be found. Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:50.606630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:50.611165 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:50.611165 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:50.611165 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:50.611165 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:16:50.611165 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:16:50.611165 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81a3d940-08e3-4cb9-bbf2-360653411aba could not be found. Aug 04 17:16:50.611165 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:16:50.611165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-03d94364-f025-4afb-acae-40994e72a84b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Returning 404 to user: Instance 81a3d940-08e3-4cb9-bbf2-360653411aba could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:16:50.611165 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-03d94364-f025-4afb-acae-40994e72a84b tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba" status: 404 len: 111 microversion: 2.1 time: 0.042191 Aug 04 17:16:50.611165 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2529/5101] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:50 2022] GET /compute/v2.1/servers/81a3d940-08e3-4cb9-bbf2-360653411aba => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:16:50.663609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-caaec5b7-9ba8-4fb6-9549-82bfdb92d4e6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:50.664281 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-caaec5b7-9ba8-4fb6-9549-82bfdb92d4e6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:50.673787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-caaec5b7-9ba8-4fb6-9549-82bfdb92d4e6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:50.680295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-caaec5b7-9ba8-4fb6-9549-82bfdb92d4e6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:50.681047 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-caaec5b7-9ba8-4fb6-9549-82bfdb92d4e6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:50.681563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-caaec5b7-9ba8-4fb6-9549-82bfdb92d4e6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:50.682069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-caaec5b7-9ba8-4fb6-9549-82bfdb92d4e6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:50.687305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-caaec5b7-9ba8-4fb6-9549-82bfdb92d4e6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:51.003117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ce2a190d-138f-459c-8633-b87870699681 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:51.003981 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ce2a190d-138f-459c-8633-b87870699681 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:51.032367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce2a190d-138f-459c-8633-b87870699681 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:51.033600 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce2a190d-138f-459c-8633-b87870699681 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:51.034347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce2a190d-138f-459c-8633-b87870699681 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:51.041844 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce2a190d-138f-459c-8633-b87870699681 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:51.043538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce2a190d-138f-459c-8633-b87870699681 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:51.045306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce2a190d-138f-459c-8633-b87870699681 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:51.262905 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-caaec5b7-9ba8-4fb6-9549-82bfdb92d4e6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:51.282844 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-caaec5b7-9ba8-4fb6-9549-82bfdb92d4e6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:51.284288 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ce2a190d-138f-459c-8633-b87870699681 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:51.284907 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-caaec5b7-9ba8-4fb6-9549-82bfdb92d4e6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:51.286280 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-caaec5b7-9ba8-4fb6-9549-82bfdb92d4e6 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1600 microversion: 2.20 time: 0.626583 Aug 04 17:16:51.286928 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2573/5102] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:16:50 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1600 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:16:51.295458 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ce2a190d-138f-459c-8633-b87870699681 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1525 microversion: 2.1 time: 0.298258 Aug 04 17:16:51.296673 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2530/5103] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:50 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1525 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:16:51.313300 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-81290aba-1734-4fb5-af2c-e77a3070826d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:51.314257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-81290aba-1734-4fb5-af2c-e77a3070826d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:51.321090 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81290aba-1734-4fb5-af2c-e77a3070826d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:51.322082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81290aba-1734-4fb5-af2c-e77a3070826d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:51.322850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81290aba-1734-4fb5-af2c-e77a3070826d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:51.323774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81290aba-1734-4fb5-af2c-e77a3070826d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:51.324442 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81290aba-1734-4fb5-af2c-e77a3070826d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:51.325079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81290aba-1734-4fb5-af2c-e77a3070826d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:51.372201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-69dd19a6-5d12-4f25-b5f8-0f591b513f9b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:51.377103 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-69dd19a6-5d12-4f25-b5f8-0f591b513f9b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:51.390904 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69dd19a6-5d12-4f25-b5f8-0f591b513f9b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:51.391530 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69dd19a6-5d12-4f25-b5f8-0f591b513f9b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:51.392050 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69dd19a6-5d12-4f25-b5f8-0f591b513f9b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:51.396377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69dd19a6-5d12-4f25-b5f8-0f591b513f9b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:51.396878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69dd19a6-5d12-4f25-b5f8-0f591b513f9b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:51.397334 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69dd19a6-5d12-4f25-b5f8-0f591b513f9b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:51.509625 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-81290aba-1734-4fb5-af2c-e77a3070826d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.200042 Aug 04 17:16:51.511159 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2574/5104] 10.222.0.93 () {60 vars in 1316 bytes} [Thu Aug 4 17:16:51 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8/os-interface => generated 284 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:16:51.516489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7974d439-3390-480d-a725-79a08407b0c5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:51.517336 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7974d439-3390-480d-a725-79a08407b0c5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:51.537007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7974d439-3390-480d-a725-79a08407b0c5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:51.538922 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7974d439-3390-480d-a725-79a08407b0c5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:51.540040 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7974d439-3390-480d-a725-79a08407b0c5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:51.550161 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7974d439-3390-480d-a725-79a08407b0c5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:51.550161 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7974d439-3390-480d-a725-79a08407b0c5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:51.550615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7974d439-3390-480d-a725-79a08407b0c5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:51.628127 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:16:51.709008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-69dd19a6-5d12-4f25-b5f8-0f591b513f9b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544002a75c946cda1586cd21f999aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a334b70c2e46c087201aa6787accba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:51.725505 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-69dd19a6-5d12-4f25-b5f8-0f591b513f9b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2" status: 200 len: 1294 microversion: 2.1 time: 0.362806 Aug 04 17:16:51.727471 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2531/5105] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:51 2022] GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2 => generated 1294 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:51.734465 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7974d439-3390-480d-a725-79a08407b0c5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:51.754514 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7974d439-3390-480d-a725-79a08407b0c5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1221 microversion: 2.1 time: 0.239494 Aug 04 17:16:51.755874 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2575/5106] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:51 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1221 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:52.322950 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-852915ac-1529-4cc7-877c-90db733200a5 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:52.323867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-852915ac-1529-4cc7-877c-90db733200a5 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:52.333286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-852915ac-1529-4cc7-877c-90db733200a5 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:52.334640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-852915ac-1529-4cc7-877c-90db733200a5 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:52.335540 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-852915ac-1529-4cc7-877c-90db733200a5 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:52.337488 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-852915ac-1529-4cc7-877c-90db733200a5 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:52.339825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-852915ac-1529-4cc7-877c-90db733200a5 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:52.340872 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-852915ac-1529-4cc7-877c-90db733200a5 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:52.589344 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-852915ac-1529-4cc7-877c-90db733200a5 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:52.605482 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-852915ac-1529-4cc7-877c-90db733200a5 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1525 microversion: 2.1 time: 0.291380 Aug 04 17:16:52.621938 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2532/5107] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:52 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1525 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:52.759143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bca6963e-2e20-462e-bb48-a21ba016abba tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:52.762578 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bca6963e-2e20-462e-bb48-a21ba016abba tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:52.781250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bca6963e-2e20-462e-bb48-a21ba016abba tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:52.782101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bca6963e-2e20-462e-bb48-a21ba016abba tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:52.783530 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bca6963e-2e20-462e-bb48-a21ba016abba tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:52.785709 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cf0d6fd5-b53f-4829-a75e-c9f1a53e3dfb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:52.786298 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bca6963e-2e20-462e-bb48-a21ba016abba tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:52.787934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cf0d6fd5-b53f-4829-a75e-c9f1a53e3dfb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:52.788250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bca6963e-2e20-462e-bb48-a21ba016abba tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:52.789531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bca6963e-2e20-462e-bb48-a21ba016abba tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:52.812279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf0d6fd5-b53f-4829-a75e-c9f1a53e3dfb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:52.814694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf0d6fd5-b53f-4829-a75e-c9f1a53e3dfb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:52.815194 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf0d6fd5-b53f-4829-a75e-c9f1a53e3dfb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:52.819270 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf0d6fd5-b53f-4829-a75e-c9f1a53e3dfb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:52.821756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf0d6fd5-b53f-4829-a75e-c9f1a53e3dfb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:52.824894 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf0d6fd5-b53f-4829-a75e-c9f1a53e3dfb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:53.039713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cf0d6fd5-b53f-4829-a75e-c9f1a53e3dfb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:53.060746 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cf0d6fd5-b53f-4829-a75e-c9f1a53e3dfb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1213 microversion: 2.1 time: 0.282087 Aug 04 17:16:53.061830 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2533/5108] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:52 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1213 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:16:53.197746 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bca6963e-2e20-462e-bb48-a21ba016abba tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544002a75c946cda1586cd21f999aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a334b70c2e46c087201aa6787accba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:53.210458 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bca6963e-2e20-462e-bb48-a21ba016abba tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2" status: 200 len: 1294 microversion: 2.1 time: 0.462246 Aug 04 17:16:53.227260 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2576/5109] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:52 2022] GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2 => generated 1294 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:53.633300 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8292f2d6-73ce-4053-bc8d-37b80f0a53f4 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:53.635180 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8292f2d6-73ce-4053-bc8d-37b80f0a53f4 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:53.655975 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8292f2d6-73ce-4053-bc8d-37b80f0a53f4 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:53.656754 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8292f2d6-73ce-4053-bc8d-37b80f0a53f4 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:53.659564 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8292f2d6-73ce-4053-bc8d-37b80f0a53f4 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:53.660586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8292f2d6-73ce-4053-bc8d-37b80f0a53f4 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:53.661286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8292f2d6-73ce-4053-bc8d-37b80f0a53f4 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:53.661890 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8292f2d6-73ce-4053-bc8d-37b80f0a53f4 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:53.835156 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-b558050c-a622-4edb-90c6-16e253266341 req-d121659a-0167-4cab-9b5a-40738955da3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7dd09c1-f3da-438a-b0d8-1102ee2d67f8", "tag": "1dd4fc9a-a07b-4b63-82e0-ad9da9f1b5b2"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:53.869220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b558050c-a622-4edb-90c6-16e253266341 req-d121659a-0167-4cab-9b5a-40738955da3d service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:53.870332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b558050c-a622-4edb-90c6-16e253266341 req-d121659a-0167-4cab-9b5a-40738955da3d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:53.871725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b558050c-a622-4edb-90c6-16e253266341 req-d121659a-0167-4cab-9b5a-40738955da3d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:53.897100 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-b558050c-a622-4edb-90c6-16e253266341 req-d121659a-0167-4cab-9b5a-40738955da3d service nova] Creating event network-changed:1dd4fc9a-a07b-4b63-82e0-ad9da9f1b5b2 for instance e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 on n-h2-851359-3 Aug 04 17:16:53.904512 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-b558050c-a622-4edb-90c6-16e253266341 req-d121659a-0167-4cab-9b5a-40738955da3d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073836 Aug 04 17:16:53.906118 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2577/5110] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:16:54.085153 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4de1cb9d-ae26-440d-a36e-c6d75f5bda9c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:54.086461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4de1cb9d-ae26-440d-a36e-c6d75f5bda9c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:54.099115 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4de1cb9d-ae26-440d-a36e-c6d75f5bda9c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:54.099610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4de1cb9d-ae26-440d-a36e-c6d75f5bda9c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:54.100068 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4de1cb9d-ae26-440d-a36e-c6d75f5bda9c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:54.100805 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4de1cb9d-ae26-440d-a36e-c6d75f5bda9c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:54.101281 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4de1cb9d-ae26-440d-a36e-c6d75f5bda9c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:54.103433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4de1cb9d-ae26-440d-a36e-c6d75f5bda9c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:54.375125 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4de1cb9d-ae26-440d-a36e-c6d75f5bda9c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:54.383526 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4de1cb9d-ae26-440d-a36e-c6d75f5bda9c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1275 microversion: 2.1 time: 0.301931 Aug 04 17:16:54.401517 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2578/5111] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:54 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1275 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:16:54.417088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-82bbee8d-907b-4d0b-8dce-dfef35ebeb9c tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:54.418046 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-82bbee8d-907b-4d0b-8dce-dfef35ebeb9c tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:54.431447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82bbee8d-907b-4d0b-8dce-dfef35ebeb9c tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:54.432534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82bbee8d-907b-4d0b-8dce-dfef35ebeb9c tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:54.433492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82bbee8d-907b-4d0b-8dce-dfef35ebeb9c tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:54.434625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82bbee8d-907b-4d0b-8dce-dfef35ebeb9c tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:54.435606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82bbee8d-907b-4d0b-8dce-dfef35ebeb9c tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:54.437636 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82bbee8d-907b-4d0b-8dce-dfef35ebeb9c tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:54.615143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8292f2d6-73ce-4053-bc8d-37b80f0a53f4 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:54.624873 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8292f2d6-73ce-4053-bc8d-37b80f0a53f4 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1505 microversion: 2.1 time: 0.999976 Aug 04 17:16:54.625472 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2534/5112] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:53 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1505 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:54.647953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-117bc00c-33fc-4269-87c3-8ebfc679f19c tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Action: 'create', calling method: .version_select at 0x7f1e5be30940>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1261521882", "description": "tempest-description-2090864907"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:55.047263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-82bbee8d-907b-4d0b-8dce-dfef35ebeb9c tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544002a75c946cda1586cd21f999aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a334b70c2e46c087201aa6787accba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:55.062875 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-82bbee8d-907b-4d0b-8dce-dfef35ebeb9c tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2" status: 200 len: 1485 microversion: 2.1 time: 0.659789 Aug 04 17:16:55.063467 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2579/5113] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:54 2022] GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2 => generated 1485 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:55.087291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-eaf9f2e5-88a8-4000-a603-4b6a07a60311 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:55.087864 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-eaf9f2e5-88a8-4000-a603-4b6a07a60311 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:55.102910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eaf9f2e5-88a8-4000-a603-4b6a07a60311 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:55.103416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eaf9f2e5-88a8-4000-a603-4b6a07a60311 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:55.103865 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eaf9f2e5-88a8-4000-a603-4b6a07a60311 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:55.104586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eaf9f2e5-88a8-4000-a603-4b6a07a60311 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:55.105051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eaf9f2e5-88a8-4000-a603-4b6a07a60311 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:55.105486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eaf9f2e5-88a8-4000-a603-4b6a07a60311 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:55.387968 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-eaf9f2e5-88a8-4000-a603-4b6a07a60311 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.304749 Aug 04 17:16:55.389609 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2580/5114] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Aug 4 17:16:55 2022] GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2/os-interface => generated 285 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:16:55.406978 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-117bc00c-33fc-4269-87c3-8ebfc679f19c tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.762771 Aug 04 17:16:55.407585 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2535/5115] 10.222.0.93 () {60 vars in 1180 bytes} [Thu Aug 4 17:16:54 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:16:55.421359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7f1f2826-5afd-4b86-b3db-995529fdb686 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1261521882"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:55.422693 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7f1f2826-5afd-4b86-b3db-995529fdb686 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:55.426985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-04add78b-ca5d-4ac3-8d64-ef73ba803c2e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:55.430784 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-04add78b-ca5d-4ac3-8d64-ef73ba803c2e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:55.433837 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f1f2826-5afd-4b86-b3db-995529fdb686 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:55.434687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f1f2826-5afd-4b86-b3db-995529fdb686 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:55.435364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f1f2826-5afd-4b86-b3db-995529fdb686 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:55.436269 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f1f2826-5afd-4b86-b3db-995529fdb686 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:55.436890 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f1f2826-5afd-4b86-b3db-995529fdb686 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:55.437701 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f1f2826-5afd-4b86-b3db-995529fdb686 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:55.451530 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-04add78b-ca5d-4ac3-8d64-ef73ba803c2e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:55.452065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-04add78b-ca5d-4ac3-8d64-ef73ba803c2e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:55.452537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-04add78b-ca5d-4ac3-8d64-ef73ba803c2e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:55.459520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-04add78b-ca5d-4ac3-8d64-ef73ba803c2e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:55.461164 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-04add78b-ca5d-4ac3-8d64-ef73ba803c2e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:55.462870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-04add78b-ca5d-4ac3-8d64-ef73ba803c2e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:55.743890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-04add78b-ca5d-4ac3-8d64-ef73ba803c2e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:55.754832 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-04add78b-ca5d-4ac3-8d64-ef73ba803c2e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1275 microversion: 2.1 time: 0.342031 Aug 04 17:16:55.755587 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2581/5116] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:55 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1275 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:56.032269 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.network.security_group_api [None req-7f1f2826-5afd-4b86-b3db-995529fdb686 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Adding security group 369b7d4c-2429-41f6-97df-6baa9536b2cb to port 55706834-8e3f-467d-8a7e-fdc1e5f26df2 Aug 04 17:16:56.374699 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-72af03e6-ee21-4ccc-96d2-be4df5d2d602 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:56.375284 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-72af03e6-ee21-4ccc-96d2-be4df5d2d602 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:56.384272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-72af03e6-ee21-4ccc-96d2-be4df5d2d602 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:56.385162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-72af03e6-ee21-4ccc-96d2-be4df5d2d602 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:56.385784 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-72af03e6-ee21-4ccc-96d2-be4df5d2d602 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:56.387068 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-72af03e6-ee21-4ccc-96d2-be4df5d2d602 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:56.387708 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-72af03e6-ee21-4ccc-96d2-be4df5d2d602 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:56.388381 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-72af03e6-ee21-4ccc-96d2-be4df5d2d602 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:56.411065 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-72af03e6-ee21-4ccc-96d2-be4df5d2d602 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] HTTP exception thrown: Instance 8865e4da-4c6b-4f67-bfdc-547839d7dab3 could not be found. Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-72af03e6-ee21-4ccc-96d2-be4df5d2d602 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Request method failure captured: Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 HTTP/1.1 Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_zGCdsK5fTsJNuSOUxSWg-YTj1-lII6Z7pJ8BanEAMuYJecZRZb3pZbwuZ0In05o4XEYRTqt5hpx76W80TGbjmNpJfL5k9fXLc--Ib8YV9bL_XUOa3XoP2TnhEkLLeANN5OpwDqQFpjdtiXXvU36x8KyTPlzTPWEPSqKrOwevSP5rs Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 1765b9e2226349c5a88f4bc75f8d1029 Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-AttachVolumeTestJSON-1568891137 Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1765b9e2226349c5a88f4bc75f8d1029"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1765b9e2226349c5a88f4bc75f8d1029"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1765b9e2226349c5a88f4bc75f8d1029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1765b9e2226349c5a88f4bc75f8d1029"}]}] Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-AttachVolumeTestJSON-1568891137 Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 1765b9e2226349c5a88f4bc75f8d1029 Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1568891137 Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-AttachVolumeTestJSON-1568891137-project Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 810ad146d8cc4192a3ae68c58ed84d2b Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-AttachVolumeTestJSON-1568891137-project Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 8865e4da-4c6b-4f67-bfdc-547839d7dab3 could not be found. Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '8865e4da-4c6b-4f67-bfdc-547839d7dab3'} Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8865e4da-4c6b-4f67-bfdc-547839d7dab3 could not be found. Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:16:56.415912 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:16:56.421021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8865e4da-4c6b-4f67-bfdc-547839d7dab3 could not be found. Aug 04 17:16:56.421021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:56.421021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:56.421021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:56.421021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:56.421021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:56.421021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:56.421021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:16:56.421021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:16:56.421021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8865e4da-4c6b-4f67-bfdc-547839d7dab3 could not be found. Aug 04 17:16:56.421021 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:56.423379 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-72af03e6-ee21-4ccc-96d2-be4df5d2d602 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Returning 404 to user: Instance 8865e4da-4c6b-4f67-bfdc-547839d7dab3 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:16:56.424555 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-72af03e6-ee21-4ccc-96d2-be4df5d2d602 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 404 len: 111 microversion: 2.1 time: 0.055214 Aug 04 17:16:56.428873 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2582/5117] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:16:56 2022] DELETE /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:16:56.436276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f6a4e5ea-a7dd-45d6-ae46-5b2a73cee8f5 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:56.437167 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f6a4e5ea-a7dd-45d6-ae46-5b2a73cee8f5 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] [instance: 8865e4da-4c6b-4f67-bfdc-547839d7dab3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:56.444479 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f6a4e5ea-a7dd-45d6-ae46-5b2a73cee8f5 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:56.444992 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f6a4e5ea-a7dd-45d6-ae46-5b2a73cee8f5 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:56.446410 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f6a4e5ea-a7dd-45d6-ae46-5b2a73cee8f5 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:56.447242 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f6a4e5ea-a7dd-45d6-ae46-5b2a73cee8f5 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:56.448006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f6a4e5ea-a7dd-45d6-ae46-5b2a73cee8f5 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:56.449382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f6a4e5ea-a7dd-45d6-ae46-5b2a73cee8f5 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:56.471460 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-f6a4e5ea-a7dd-45d6-ae46-5b2a73cee8f5 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] HTTP exception thrown: Instance 8865e4da-4c6b-4f67-bfdc-547839d7dab3 could not be found. Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f6a4e5ea-a7dd-45d6-ae46-5b2a73cee8f5 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Request method failure captured: Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 HTTP/1.1 Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_zGCdsK5fTsJNuSOUxSWg-YTj1-lII6Z7pJ8BanEAMuYJecZRZb3pZbwuZ0In05o4XEYRTqt5hpx76W80TGbjmNpJfL5k9fXLc--Ib8YV9bL_XUOa3XoP2TnhEkLLeANN5OpwDqQFpjdtiXXvU36x8KyTPlzTPWEPSqKrOwevSP5rs Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 1765b9e2226349c5a88f4bc75f8d1029 Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-AttachVolumeTestJSON-1568891137 Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1765b9e2226349c5a88f4bc75f8d1029"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1765b9e2226349c5a88f4bc75f8d1029"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1765b9e2226349c5a88f4bc75f8d1029"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1765b9e2226349c5a88f4bc75f8d1029"}]}] Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-AttachVolumeTestJSON-1568891137 Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 1765b9e2226349c5a88f4bc75f8d1029 Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1568891137 Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-AttachVolumeTestJSON-1568891137-project Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 810ad146d8cc4192a3ae68c58ed84d2b Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-AttachVolumeTestJSON-1568891137-project Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 8865e4da-4c6b-4f67-bfdc-547839d7dab3 could not be found. Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '8865e4da-4c6b-4f67-bfdc-547839d7dab3'} Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8865e4da-4c6b-4f67-bfdc-547839d7dab3 could not be found. Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8865e4da-4c6b-4f67-bfdc-547839d7dab3 could not be found. Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:16:56.473044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:56.478500 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:16:56.478500 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:16:56.478500 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:16:56.478500 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:16:56.478500 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:16:56.478500 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8865e4da-4c6b-4f67-bfdc-547839d7dab3 could not be found. Aug 04 17:16:56.478500 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:16:56.478500 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f6a4e5ea-a7dd-45d6-ae46-5b2a73cee8f5 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] Returning 404 to user: Instance 8865e4da-4c6b-4f67-bfdc-547839d7dab3 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:16:56.478500 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f6a4e5ea-a7dd-45d6-ae46-5b2a73cee8f5 tempest-AttachVolumeTestJSON-1568891137 tempest-AttachVolumeTestJSON-1568891137-project] 10.222.0.93 "GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3" status: 404 len: 111 microversion: 2.1 time: 0.044395 Aug 04 17:16:56.478500 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2583/5118] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:56 2022] GET /compute/v2.1/servers/8865e4da-4c6b-4f67-bfdc-547839d7dab3 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:16:56.775950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-941bac34-fa6f-4124-81d4-7f005d56e172 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:56.780385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-941bac34-fa6f-4124-81d4-7f005d56e172 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:56.788684 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-941bac34-fa6f-4124-81d4-7f005d56e172 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:56.789244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-941bac34-fa6f-4124-81d4-7f005d56e172 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:56.789700 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-941bac34-fa6f-4124-81d4-7f005d56e172 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:56.799961 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-941bac34-fa6f-4124-81d4-7f005d56e172 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:56.801599 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-941bac34-fa6f-4124-81d4-7f005d56e172 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:56.802655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-941bac34-fa6f-4124-81d4-7f005d56e172 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:57.294462 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7f1f2826-5afd-4b86-b3db-995529fdb686 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "POST /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4/action" status: 202 len: 0 microversion: 2.1 time: 1.877220 Aug 04 17:16:57.299882 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2536/5119] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:16:55 2022] POST /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4/action => generated 0 bytes in 1880 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 17:16:57.309370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bd2314a2-94d7-4390-a3fe-7496ef0f7d47 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1261521882"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:57.310154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bd2314a2-94d7-4390-a3fe-7496ef0f7d47 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:57.335082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-941bac34-fa6f-4124-81d4-7f005d56e172 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:57.340386 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd2314a2-94d7-4390-a3fe-7496ef0f7d47 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:57.342605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd2314a2-94d7-4390-a3fe-7496ef0f7d47 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:57.345599 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd2314a2-94d7-4390-a3fe-7496ef0f7d47 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:57.346767 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-941bac34-fa6f-4124-81d4-7f005d56e172 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1317 microversion: 2.1 time: 0.575096 Aug 04 17:16:57.347132 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd2314a2-94d7-4390-a3fe-7496ef0f7d47 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:57.347400 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2584/5120] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:56 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1317 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:57.349024 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd2314a2-94d7-4390-a3fe-7496ef0f7d47 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:57.349636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd2314a2-94d7-4390-a3fe-7496ef0f7d47 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:57.361110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-810433af-273c-4806-b3cc-48c3c22c419a req-a3f6e6f3-5ac2-411c-9003-92a5ca60f1c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4", "tag": "55706834-8e3f-467d-8a7e-fdc1e5f26df2"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:57.380495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-810433af-273c-4806-b3cc-48c3c22c419a req-a3f6e6f3-5ac2-411c-9003-92a5ca60f1c6 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:57.381178 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-810433af-273c-4806-b3cc-48c3c22c419a req-a3f6e6f3-5ac2-411c-9003-92a5ca60f1c6 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:57.381413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-810433af-273c-4806-b3cc-48c3c22c419a req-a3f6e6f3-5ac2-411c-9003-92a5ca60f1c6 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:57.416687 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-810433af-273c-4806-b3cc-48c3c22c419a req-a3f6e6f3-5ac2-411c-9003-92a5ca60f1c6 service nova] Creating event network-changed:55706834-8e3f-467d-8a7e-fdc1e5f26df2 for instance dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 on n-h1-851359-3 Aug 04 17:16:57.422010 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-810433af-273c-4806-b3cc-48c3c22c419a req-a3f6e6f3-5ac2-411c-9003-92a5ca60f1c6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073390 Aug 04 17:16:57.422925 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2585/5121] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:16:57.882406 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.network.security_group_api [None req-bd2314a2-94d7-4390-a3fe-7496ef0f7d47 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Removing security group 369b7d4c-2429-41f6-97df-6baa9536b2cb from port 55706834-8e3f-467d-8a7e-fdc1e5f26df2 Aug 04 17:16:58.378711 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dd45b68f-8a66-42f2-b8a5-a5dc9b737a98 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:58.381445 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dd45b68f-8a66-42f2-b8a5-a5dc9b737a98 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:58.395695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd45b68f-8a66-42f2-b8a5-a5dc9b737a98 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:58.397195 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd45b68f-8a66-42f2-b8a5-a5dc9b737a98 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:58.398666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd45b68f-8a66-42f2-b8a5-a5dc9b737a98 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:58.400402 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd45b68f-8a66-42f2-b8a5-a5dc9b737a98 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:58.401253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd45b68f-8a66-42f2-b8a5-a5dc9b737a98 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:58.403577 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd45b68f-8a66-42f2-b8a5-a5dc9b737a98 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:59.313912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dd45b68f-8a66-42f2-b8a5-a5dc9b737a98 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:59.321967 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bd2314a2-94d7-4390-a3fe-7496ef0f7d47 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "POST /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4/action" status: 202 len: 0 microversion: 2.1 time: 2.021803 Aug 04 17:16:59.322630 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2537/5122] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:16:57 2022] POST /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4/action => generated 0 bytes in 2024 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:16:59.331949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b92e312f-5b69-4f77-8662-18cb5b5ac916 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Action: 'create', calling method: .version_select at 0x7f1e5bc0d790>, body: {"pool": null} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:16:59.356242 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dd45b68f-8a66-42f2-b8a5-a5dc9b737a98 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1317 microversion: 2.1 time: 0.985040 Aug 04 17:16:59.357804 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2586/5123] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:58 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1317 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:16:59.400466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4d319713-234b-4768-9dc6-020560fb125b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:16:59.401483 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4d319713-234b-4768-9dc6-020560fb125b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:16:59.412783 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d319713-234b-4768-9dc6-020560fb125b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:59.419509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d319713-234b-4768-9dc6-020560fb125b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:59.420409 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d319713-234b-4768-9dc6-020560fb125b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:59.421498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d319713-234b-4768-9dc6-020560fb125b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:16:59.425392 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d319713-234b-4768-9dc6-020560fb125b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:16:59.426847 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d319713-234b-4768-9dc6-020560fb125b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:16:59.963317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4d319713-234b-4768-9dc6-020560fb125b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544002a75c946cda1586cd21f999aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a334b70c2e46c087201aa6787accba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:16:59.992243 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4d319713-234b-4768-9dc6-020560fb125b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2" status: 200 len: 1485 microversion: 2.1 time: 0.596495 Aug 04 17:16:59.993130 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2587/5124] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:16:59 2022] GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2 => generated 1485 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:17:00.012491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:17:00.018908 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-a48b86e9-7228-4f6d-81c5-87698f39ee57 req-400fefe2-a624-4981-b0a1-09de9013e387 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4", "tag": "55706834-8e3f-467d-8a7e-fdc1e5f26df2"}, {"name": "network-changed", "server_uuid": "b49ca99e-4a64-4d5d-aeb8-f61760944ce2", "tag": "0427cc5e-0bd3-4508-b821-5cc6d9a8ed83"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:00.033885 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a48b86e9-7228-4f6d-81c5-87698f39ee57 req-400fefe2-a624-4981-b0a1-09de9013e387 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:00.034695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a48b86e9-7228-4f6d-81c5-87698f39ee57 req-400fefe2-a624-4981-b0a1-09de9013e387 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:00.035306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a48b86e9-7228-4f6d-81c5-87698f39ee57 req-400fefe2-a624-4981-b0a1-09de9013e387 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:00.051609 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-a48b86e9-7228-4f6d-81c5-87698f39ee57 req-400fefe2-a624-4981-b0a1-09de9013e387 service nova] Creating event network-changed:55706834-8e3f-467d-8a7e-fdc1e5f26df2 for instance dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 on n-h1-851359-3 Aug 04 17:17:00.052411 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-a48b86e9-7228-4f6d-81c5-87698f39ee57 req-400fefe2-a624-4981-b0a1-09de9013e387 service nova] Creating event network-changed:0427cc5e-0bd3-4508-b821-5cc6d9a8ed83 for instance b49ca99e-4a64-4d5d-aeb8-f61760944ce2 on n-h1-851359-3 Aug 04 17:17:00.061194 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-a48b86e9-7228-4f6d-81c5-87698f39ee57 req-400fefe2-a624-4981-b0a1-09de9013e387 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.047271 Aug 04 17:17:00.062013 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2588/5125] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:00.358697 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=8 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:17:00.380213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-626d568e-351f-45a6-b283-bac0620da5f3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:00.381349 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-626d568e-351f-45a6-b283-bac0620da5f3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:00.400620 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-626d568e-351f-45a6-b283-bac0620da5f3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:00.402211 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-626d568e-351f-45a6-b283-bac0620da5f3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:00.403534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-626d568e-351f-45a6-b283-bac0620da5f3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:00.404547 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-626d568e-351f-45a6-b283-bac0620da5f3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:00.405194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-626d568e-351f-45a6-b283-bac0620da5f3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:00.405814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-626d568e-351f-45a6-b283-bac0620da5f3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:00.832495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-626d568e-351f-45a6-b283-bac0620da5f3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:00.844227 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-626d568e-351f-45a6-b283-bac0620da5f3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1317 microversion: 2.1 time: 0.467657 Aug 04 17:17:00.845825 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2589/5126] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:00 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1317 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:01.592726 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b92e312f-5b69-4f77-8662-18cb5b5ac916 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.264010 Aug 04 17:17:01.594943 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2538/5127] 10.222.0.93 () {60 vars in 1170 bytes} [Thu Aug 4 17:16:59 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:01.606555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e7d17d72-b68d-4405-a36c-c42350ba1eef tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.30"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:01.609873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e7d17d72-b68d-4405-a36c-c42350ba1eef tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:01.617478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7d17d72-b68d-4405-a36c-c42350ba1eef tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:01.618212 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7d17d72-b68d-4405-a36c-c42350ba1eef tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:01.618857 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7d17d72-b68d-4405-a36c-c42350ba1eef tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:01.619748 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7d17d72-b68d-4405-a36c-c42350ba1eef tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:01.620207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7d17d72-b68d-4405-a36c-c42350ba1eef tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:01.620876 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7d17d72-b68d-4405-a36c-c42350ba1eef tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:01.654075 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7d17d72-b68d-4405-a36c-c42350ba1eef tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "refresh_cache-dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" {{(pid=131043) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 04 17:17:01.655380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7d17d72-b68d-4405-a36c-c42350ba1eef tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquired lock "refresh_cache-dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" {{(pid=131043) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 04 17:17:01.872731 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7827e2a1-8572-4a6d-b35e-196b8c39ff3b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:01.873617 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7827e2a1-8572-4a6d-b35e-196b8c39ff3b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:01.888301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7827e2a1-8572-4a6d-b35e-196b8c39ff3b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:01.893774 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7827e2a1-8572-4a6d-b35e-196b8c39ff3b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:01.894468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7827e2a1-8572-4a6d-b35e-196b8c39ff3b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:01.895564 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7827e2a1-8572-4a6d-b35e-196b8c39ff3b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:01.896149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7827e2a1-8572-4a6d-b35e-196b8c39ff3b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:01.899815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7827e2a1-8572-4a6d-b35e-196b8c39ff3b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:02.275059 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7827e2a1-8572-4a6d-b35e-196b8c39ff3b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:02.290592 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7827e2a1-8572-4a6d-b35e-196b8c39ff3b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1317 microversion: 2.1 time: 0.423090 Aug 04 17:17:02.292452 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2539/5128] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:01 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1317 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:02.299351 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-f207cf4c-cb24-4ab6-bb91-5efb975cb0ed req-3d4fee96-f766-4f1a-af60-121eb2c529fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5248dcdc-5a16-4036-9537-eb84f73dc372", "tag": "620457fa-43b8-4d5c-9ed1-44c49f63239c"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:02.322319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f207cf4c-cb24-4ab6-bb91-5efb975cb0ed req-3d4fee96-f766-4f1a-af60-121eb2c529fc service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:02.325457 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f207cf4c-cb24-4ab6-bb91-5efb975cb0ed req-3d4fee96-f766-4f1a-af60-121eb2c529fc service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:02.326179 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f207cf4c-cb24-4ab6-bb91-5efb975cb0ed req-3d4fee96-f766-4f1a-af60-121eb2c529fc service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:02.349366 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-f207cf4c-cb24-4ab6-bb91-5efb975cb0ed req-3d4fee96-f766-4f1a-af60-121eb2c529fc service nova] Creating event network-changed:620457fa-43b8-4d5c-9ed1-44c49f63239c for instance 5248dcdc-5a16-4036-9537-eb84f73dc372 on n-h1-851359-3 Aug 04 17:17:02.360007 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-f207cf4c-cb24-4ab6-bb91-5efb975cb0ed req-3d4fee96-f766-4f1a-af60-121eb2c529fc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065963 Aug 04 17:17:02.364578 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2540/5129] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:03.321224 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-82cdba5b-1ef4-42f3-9422-23fbe14a2c99 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:03.322643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-82cdba5b-1ef4-42f3-9422-23fbe14a2c99 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:03.329786 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82cdba5b-1ef4-42f3-9422-23fbe14a2c99 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:03.330909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82cdba5b-1ef4-42f3-9422-23fbe14a2c99 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:03.331579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82cdba5b-1ef4-42f3-9422-23fbe14a2c99 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:03.332507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82cdba5b-1ef4-42f3-9422-23fbe14a2c99 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:03.333183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82cdba5b-1ef4-42f3-9422-23fbe14a2c99 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:03.333829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82cdba5b-1ef4-42f3-9422-23fbe14a2c99 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:03.754709 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-82cdba5b-1ef4-42f3-9422-23fbe14a2c99 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:03.764614 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-82cdba5b-1ef4-42f3-9422-23fbe14a2c99 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1317 microversion: 2.1 time: 0.448713 Aug 04 17:17:03.765475 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2541/5130] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:03 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1317 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:17:04.032904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-e7d17d72-b68d-4405-a36c-c42350ba1eef tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Building network info cache for instance {{(pid=131043) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 17:17:04.461003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-aa1f7772-24cd-4e5b-b378-2c7bc38d4d00 req-a3213116-4198-454b-ae88-e6478a3a5dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4", "tag": "55706834-8e3f-467d-8a7e-fdc1e5f26df2"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:04.485801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-aa1f7772-24cd-4e5b-b378-2c7bc38d4d00 req-a3213116-4198-454b-ae88-e6478a3a5dc3 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:04.486396 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-aa1f7772-24cd-4e5b-b378-2c7bc38d4d00 req-a3213116-4198-454b-ae88-e6478a3a5dc3 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:04.489842 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-aa1f7772-24cd-4e5b-b378-2c7bc38d4d00 req-a3213116-4198-454b-ae88-e6478a3a5dc3 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:04.523157 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-aa1f7772-24cd-4e5b-b378-2c7bc38d4d00 req-a3213116-4198-454b-ae88-e6478a3a5dc3 service nova] Creating event network-changed:55706834-8e3f-467d-8a7e-fdc1e5f26df2 for instance dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 on n-h1-851359-3 Aug 04 17:17:04.548417 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-aa1f7772-24cd-4e5b-b378-2c7bc38d4d00 req-a3213116-4198-454b-ae88-e6478a3a5dc3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091866 Aug 04 17:17:04.549052 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2542/5131] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:17:04.578448 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5a548689-a4fd-43f1-a0bc-0b4d9f316c6c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:04.587286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5a548689-a4fd-43f1-a0bc-0b4d9f316c6c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:04.611697 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a548689-a4fd-43f1-a0bc-0b4d9f316c6c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:04.614582 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a548689-a4fd-43f1-a0bc-0b4d9f316c6c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:04.615451 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a548689-a4fd-43f1-a0bc-0b4d9f316c6c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:04.618535 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a548689-a4fd-43f1-a0bc-0b4d9f316c6c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:04.620316 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a548689-a4fd-43f1-a0bc-0b4d9f316c6c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:04.621036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a548689-a4fd-43f1-a0bc-0b4d9f316c6c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:04.746196 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5a548689-a4fd-43f1-a0bc-0b4d9f316c6c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "POST /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0/action" status: 200 len: 24565 microversion: 2.1 time: 0.176687 Aug 04 17:17:04.754498 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2543/5132] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:17:04 2022] POST /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0/action => generated 24565 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:17:04.790049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-62001d6a-14a8-400e-828e-dd7db7fedb71 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:04.790775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-62001d6a-14a8-400e-828e-dd7db7fedb71 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:04.801602 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62001d6a-14a8-400e-828e-dd7db7fedb71 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:04.802124 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62001d6a-14a8-400e-828e-dd7db7fedb71 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:04.802566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62001d6a-14a8-400e-828e-dd7db7fedb71 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:04.803872 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62001d6a-14a8-400e-828e-dd7db7fedb71 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:04.803872 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62001d6a-14a8-400e-828e-dd7db7fedb71 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:04.804795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62001d6a-14a8-400e-828e-dd7db7fedb71 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:05.056780 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-e7d17d72-b68d-4405-a36c-c42350ba1eef tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Updating instance_info_cache with network_info: [{"id": "55706834-8e3f-467d-8a7e-fdc1e5f26df2", "address": "fa:16:3e:c4:1d:6d", "network": {"id": "08d140c2-1440-4b11-ba32-8e51799b617e", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1604999276-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "98a0bf705e624fe796abcfd60aac6061", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap55706834-8e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131043) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 17:17:05.075037 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e7d17d72-b68d-4405-a36c-c42350ba1eef tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Releasing lock "refresh_cache-dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" {{(pid=131043) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 04 17:17:05.076337 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e7d17d72-b68d-4405-a36c-c42350ba1eef tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "POST /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4/action" status: 202 len: 0 microversion: 2.1 time: 3.474295 Aug 04 17:17:05.078295 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2590/5133] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:17:01 2022] POST /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4/action => generated 0 bytes in 3477 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 04 17:17:05.082616 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-62001d6a-14a8-400e-828e-dd7db7fedb71 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:05.093452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1d6b23c9-32b5-4a2d-a838-48d5ad6df4e1 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Action: 'action', calling method: .version_select at 0x7f1e6a4d1c10>, body: {"removeFloatingIp": {"address": "172.25.9.30"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:05.098974 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-62001d6a-14a8-400e-828e-dd7db7fedb71 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1317 microversion: 2.1 time: 0.315777 Aug 04 17:17:05.116257 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2544/5134] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:04 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:17:05.427127 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1d6b23c9-32b5-4a2d-a838-48d5ad6df4e1 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:05.434786 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:17:05.450038 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d6b23c9-32b5-4a2d-a838-48d5ad6df4e1 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:05.450681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d6b23c9-32b5-4a2d-a838-48d5ad6df4e1 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:05.451171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d6b23c9-32b5-4a2d-a838-48d5ad6df4e1 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:05.451903 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d6b23c9-32b5-4a2d-a838-48d5ad6df4e1 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:05.452374 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d6b23c9-32b5-4a2d-a838-48d5ad6df4e1 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:05.452850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d6b23c9-32b5-4a2d-a838-48d5ad6df4e1 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:05.823140 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d6b23c9-32b5-4a2d-a838-48d5ad6df4e1 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "refresh_cache-dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" {{(pid=131043) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 04 17:17:05.823550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d6b23c9-32b5-4a2d-a838-48d5ad6df4e1 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquired lock "refresh_cache-dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" {{(pid=131043) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 04 17:17:06.121915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-670aa191-429a-4477-b41a-c78ab4614927 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:06.123163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-670aa191-429a-4477-b41a-c78ab4614927 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:06.129806 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-670aa191-429a-4477-b41a-c78ab4614927 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:06.130750 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-670aa191-429a-4477-b41a-c78ab4614927 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:06.131198 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-670aa191-429a-4477-b41a-c78ab4614927 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:06.132729 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-670aa191-429a-4477-b41a-c78ab4614927 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:06.133436 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-670aa191-429a-4477-b41a-c78ab4614927 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:06.133949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-670aa191-429a-4477-b41a-c78ab4614927 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:06.398150 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-670aa191-429a-4477-b41a-c78ab4614927 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:06.408124 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-670aa191-429a-4477-b41a-c78ab4614927 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1317 microversion: 2.1 time: 0.290005 Aug 04 17:17:06.408714 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2545/5135] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:06 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1317 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:17:06.440249 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-c2e48182-0d51-4c1d-b016-6c29c58347a2 req-5c85feeb-07d2-40cc-97e3-113c72dd799d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5248dcdc-5a16-4036-9537-eb84f73dc372", "name": "network-vif-plugged", "status": "completed", "tag": "620457fa-43b8-4d5c-9ed1-44c49f63239c"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:06.451339 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c2e48182-0d51-4c1d-b016-6c29c58347a2 req-5c85feeb-07d2-40cc-97e3-113c72dd799d service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:06.452187 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c2e48182-0d51-4c1d-b016-6c29c58347a2 req-5c85feeb-07d2-40cc-97e3-113c72dd799d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:06.452862 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c2e48182-0d51-4c1d-b016-6c29c58347a2 req-5c85feeb-07d2-40cc-97e3-113c72dd799d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:06.470962 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-c2e48182-0d51-4c1d-b016-6c29c58347a2 req-5c85feeb-07d2-40cc-97e3-113c72dd799d service nova] Creating event network-vif-plugged:620457fa-43b8-4d5c-9ed1-44c49f63239c for instance 5248dcdc-5a16-4036-9537-eb84f73dc372 on n-h1-851359-3 Aug 04 17:17:06.481181 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-c2e48182-0d51-4c1d-b016-6c29c58347a2 req-5c85feeb-07d2-40cc-97e3-113c72dd799d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049407 Aug 04 17:17:06.482470 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2546/5136] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:06.688193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-1d6b23c9-32b5-4a2d-a838-48d5ad6df4e1 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Building network info cache for instance {{(pid=131043) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 04 17:17:06.734993 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-8444ae38-c951-4f12-843a-dc13c309780b req-40bc4320-c89f-4627-b93b-adc48738da48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4", "tag": "55706834-8e3f-467d-8a7e-fdc1e5f26df2"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:06.750915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8444ae38-c951-4f12-843a-dc13c309780b req-40bc4320-c89f-4627-b93b-adc48738da48 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:06.752380 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8444ae38-c951-4f12-843a-dc13c309780b req-40bc4320-c89f-4627-b93b-adc48738da48 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:06.752987 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8444ae38-c951-4f12-843a-dc13c309780b req-40bc4320-c89f-4627-b93b-adc48738da48 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:06.773841 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-8444ae38-c951-4f12-843a-dc13c309780b req-40bc4320-c89f-4627-b93b-adc48738da48 service nova] Creating event network-changed:55706834-8e3f-467d-8a7e-fdc1e5f26df2 for instance dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 on n-h1-851359-3 Aug 04 17:17:06.780973 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-8444ae38-c951-4f12-843a-dc13c309780b req-40bc4320-c89f-4627-b93b-adc48738da48 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056533 Aug 04 17:17:06.782895 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2547/5137] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:07.429864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7e68cdfb-ae54-49f9-a750-3b755e28bc27 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:07.430675 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7e68cdfb-ae54-49f9-a750-3b755e28bc27 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:07.447684 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e68cdfb-ae54-49f9-a750-3b755e28bc27 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:07.448542 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e68cdfb-ae54-49f9-a750-3b755e28bc27 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:07.450520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e68cdfb-ae54-49f9-a750-3b755e28bc27 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:07.451277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e68cdfb-ae54-49f9-a750-3b755e28bc27 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:07.454057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e68cdfb-ae54-49f9-a750-3b755e28bc27 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:07.454526 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e68cdfb-ae54-49f9-a750-3b755e28bc27 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:07.865804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7e68cdfb-ae54-49f9-a750-3b755e28bc27 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:07.877340 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7e68cdfb-ae54-49f9-a750-3b755e28bc27 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1317 microversion: 2.1 time: 0.452314 Aug 04 17:17:07.878507 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2548/5138] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:07 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1317 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:17:07.940939 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-1d6b23c9-32b5-4a2d-a838-48d5ad6df4e1 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Updating instance_info_cache with network_info: [{"id": "55706834-8e3f-467d-8a7e-fdc1e5f26df2", "address": "fa:16:3e:c4:1d:6d", "network": {"id": "08d140c2-1440-4b11-ba32-8e51799b617e", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1604999276-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "98a0bf705e624fe796abcfd60aac6061", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap55706834-8e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131043) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 04 17:17:07.961595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d6b23c9-32b5-4a2d-a838-48d5ad6df4e1 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Releasing lock "refresh_cache-dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" {{(pid=131043) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 04 17:17:07.963397 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1d6b23c9-32b5-4a2d-a838-48d5ad6df4e1 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "POST /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4/action" status: 202 len: 0 microversion: 2.1 time: 2.881951 Aug 04 17:17:07.964022 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2591/5139] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:17:05 2022] POST /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4/action => generated 0 bytes in 2883 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Aug 04 17:17:07.972624 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-06aa3bb2-a03f-4d51-a4db-4a4128357c95 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '.version_select at 0x7f1e5baad040>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:08.906380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-023ced96-d1f2-4310-a442-34845c95d656 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:08.908389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-023ced96-d1f2-4310-a442-34845c95d656 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:08.921221 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-023ced96-d1f2-4310-a442-34845c95d656 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:08.922368 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-023ced96-d1f2-4310-a442-34845c95d656 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:08.923746 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-023ced96-d1f2-4310-a442-34845c95d656 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:08.925305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-023ced96-d1f2-4310-a442-34845c95d656 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:08.926082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-023ced96-d1f2-4310-a442-34845c95d656 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:08.926674 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-023ced96-d1f2-4310-a442-34845c95d656 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:09.196547 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-023ced96-d1f2-4310-a442-34845c95d656 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:09.204173 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-023ced96-d1f2-4310-a442-34845c95d656 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.304317 Aug 04 17:17:09.223781 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2592/5140] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:08 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:09.227147 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-06aa3bb2-a03f-4d51-a4db-4a4128357c95 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "DELETE /compute/v2.1/os-floating-ips/3c28538d-ef70-41e2-b4ed-a2844d96d4fc" status: 202 len: 0 microversion: 2.1 time: 1.257753 Aug 04 17:17:09.227846 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2549/5141] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Aug 4 17:17:07 2022] DELETE /compute/v2.1/os-floating-ips/3c28538d-ef70-41e2-b4ed-a2844d96d4fc => generated 0 bytes in 1260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:17:09.237706 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c297de77-9794-423c-9946-dbfe237d1847 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '.version_select at 0x7f1e5afd5280>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:09.395978 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ad67577c-9a23-4d5d-9c3c-348bbf25c10e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1664209369", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "f20ac3e7-ddd2-4167-bdf1-b8b75ff31772"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:09.465332 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-ad67577c-9a23-4d5d-9c3c-348bbf25c10e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] validate_networks() for [('f20ac3e7-ddd2-4167-bdf1-b8b75ff31772', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:17:09.465833 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c297de77-9794-423c-9946-dbfe237d1847 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "DELETE /compute/v2.1/os-security-groups/369b7d4c-2429-41f6-97df-6baa9536b2cb" status: 202 len: 0 microversion: 2.1 time: 0.232573 Aug 04 17:17:09.466963 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2593/5142] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 17:17:09 2022] DELETE /compute/v2.1/os-security-groups/369b7d4c-2429-41f6-97df-6baa9536b2cb => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:17:09.475457 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-70b18e24-2786-4d5e-95c2-04054884321a tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:09.476511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-70b18e24-2786-4d5e-95c2-04054884321a tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:09.483614 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70b18e24-2786-4d5e-95c2-04054884321a tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:09.484305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70b18e24-2786-4d5e-95c2-04054884321a tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:09.484954 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70b18e24-2786-4d5e-95c2-04054884321a tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:09.485831 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70b18e24-2786-4d5e-95c2-04054884321a tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:09.486490 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70b18e24-2786-4d5e-95c2-04054884321a tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:09.487083 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70b18e24-2786-4d5e-95c2-04054884321a tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:09.543378 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-70b18e24-2786-4d5e-95c2-04054884321a tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:17:09.561877 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:17:09.651994 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-70b18e24-2786-4d5e-95c2-04054884321a tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "DELETE /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 204 len: 0 microversion: 2.1 time: 0.180600 Aug 04 17:17:09.652819 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2594/5143] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:17:09 2022] DELETE /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 17:17:09.663370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8d60595a-8365-4815-ad7c-243a920e6acc tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:09.664821 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8d60595a-8365-4815-ad7c-243a920e6acc tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:09.678666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d60595a-8365-4815-ad7c-243a920e6acc tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:09.679908 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d60595a-8365-4815-ad7c-243a920e6acc tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:09.680354 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d60595a-8365-4815-ad7c-243a920e6acc tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:09.681237 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d60595a-8365-4815-ad7c-243a920e6acc tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:09.681700 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d60595a-8365-4815-ad7c-243a920e6acc tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:09.682233 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d60595a-8365-4815-ad7c-243a920e6acc tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:09.910550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8d60595a-8365-4815-ad7c-243a920e6acc tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:09.918683 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8d60595a-8365-4815-ad7c-243a920e6acc tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1511 microversion: 2.1 time: 0.260892 Aug 04 17:17:09.919715 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2595/5144] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:09 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1511 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:10.043003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-ad67577c-9a23-4d5d-9c3c-348bbf25c10e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:17:10.043424 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-ad67577c-9a23-4d5d-9c3c-348bbf25c10e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:17:10.043915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-ad67577c-9a23-4d5d-9c3c-348bbf25c10e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:17:10.044309 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-ad67577c-9a23-4d5d-9c3c-348bbf25c10e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:17:10.044723 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-ad67577c-9a23-4d5d-9c3c-348bbf25c10e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:17:10.055855 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad67577c-9a23-4d5d-9c3c-348bbf25c10e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:10.056348 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad67577c-9a23-4d5d-9c3c-348bbf25c10e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:10.056768 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad67577c-9a23-4d5d-9c3c-348bbf25c10e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:10.057492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad67577c-9a23-4d5d-9c3c-348bbf25c10e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:10.057947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad67577c-9a23-4d5d-9c3c-348bbf25c10e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:10.058398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad67577c-9a23-4d5d-9c3c-348bbf25c10e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:10.080327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-ad67577c-9a23-4d5d-9c3c-348bbf25c10e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Getting quotas for project 5f7878e13541477b80e6ede62a2a8554. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:17:10.086739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-ad67577c-9a23-4d5d-9c3c-348bbf25c10e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Getting quotas for user 3f21709d5ed549ffae941a6060ea6dcb and project 5f7878e13541477b80e6ede62a2a8554. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:17:10.099559 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ad67577c-9a23-4d5d-9c3c-348bbf25c10e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:17:10.101892 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ad67577c-9a23-4d5d-9c3c-348bbf25c10e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:17:10.149748 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ad67577c-9a23-4d5d-9c3c-348bbf25c10e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.757876 Aug 04 17:17:10.150425 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2550/5145] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:17:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 17:17:10.161603 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ad207f1a-2f20-46a8-8b22-1655de003adb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:10.162674 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ad207f1a-2f20-46a8-8b22-1655de003adb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:10.249462 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ad207f1a-2f20-46a8-8b22-1655de003adb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:10.257653 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ad207f1a-2f20-46a8-8b22-1655de003adb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb" status: 200 len: 1217 microversion: 2.1 time: 0.100161 Aug 04 17:17:10.258513 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2596/5146] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:10 2022] GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:10.942004 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6f050203-3fb7-4808-98a9-3291f8641732 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:10.942661 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6f050203-3fb7-4808-98a9-3291f8641732 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:10.950935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f050203-3fb7-4808-98a9-3291f8641732 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:10.951831 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f050203-3fb7-4808-98a9-3291f8641732 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:10.952503 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f050203-3fb7-4808-98a9-3291f8641732 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:10.953378 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f050203-3fb7-4808-98a9-3291f8641732 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:10.954014 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f050203-3fb7-4808-98a9-3291f8641732 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:10.954603 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f050203-3fb7-4808-98a9-3291f8641732 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:11.125109 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6f050203-3fb7-4808-98a9-3291f8641732 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:11.132609 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6f050203-3fb7-4808-98a9-3291f8641732 tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1511 microversion: 2.1 time: 0.194687 Aug 04 17:17:11.133380 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2551/5147] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:10 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1511 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:11.280442 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-39525984-f17d-4042-858f-2f5859453fad tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:11.281220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-39525984-f17d-4042-858f-2f5859453fad tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:11.289919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39525984-f17d-4042-858f-2f5859453fad tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:11.290757 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39525984-f17d-4042-858f-2f5859453fad tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:11.291743 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39525984-f17d-4042-858f-2f5859453fad tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:11.292713 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39525984-f17d-4042-858f-2f5859453fad tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:11.293406 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39525984-f17d-4042-858f-2f5859453fad tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:11.293936 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39525984-f17d-4042-858f-2f5859453fad tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:11.366702 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-39525984-f17d-4042-858f-2f5859453fad tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:11.387242 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-39525984-f17d-4042-858f-2f5859453fad tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb" status: 200 len: 1269 microversion: 2.1 time: 0.110600 Aug 04 17:17:11.388020 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2597/5148] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:11 2022] GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb => generated 1269 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:17:12.157637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b6361956-0285-495c-b91d-4896dfd9c82d tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:12.158551 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b6361956-0285-495c-b91d-4896dfd9c82d tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:12.171022 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6361956-0285-495c-b91d-4896dfd9c82d tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:12.173492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6361956-0285-495c-b91d-4896dfd9c82d tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:12.178614 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6361956-0285-495c-b91d-4896dfd9c82d tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:12.182622 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6361956-0285-495c-b91d-4896dfd9c82d tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:12.183324 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6361956-0285-495c-b91d-4896dfd9c82d tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:12.185241 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6361956-0285-495c-b91d-4896dfd9c82d tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:12.514705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b3c8746c-b933-4cb8-ac17-15795d1773d2 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:12.516291 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b3c8746c-b933-4cb8-ac17-15795d1773d2 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:12.526674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3c8746c-b933-4cb8-ac17-15795d1773d2 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:12.528933 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3c8746c-b933-4cb8-ac17-15795d1773d2 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:12.530368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3c8746c-b933-4cb8-ac17-15795d1773d2 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:12.532200 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3c8746c-b933-4cb8-ac17-15795d1773d2 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:12.534319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3c8746c-b933-4cb8-ac17-15795d1773d2 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:12.535862 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3c8746c-b933-4cb8-ac17-15795d1773d2 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:12.582995 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b3c8746c-b933-4cb8-ac17-15795d1773d2 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee/ips" status: 200 len: 149 microversion: 2.1 time: 0.461663 Aug 04 17:17:12.583574 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2552/5149] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Aug 4 17:17:12 2022] GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee/ips => generated 149 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:12.588568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e9bdd612-2628-4571-a0de-6c10961d559f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:12.589404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e9bdd612-2628-4571-a0de-6c10961d559f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:12.610642 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9bdd612-2628-4571-a0de-6c10961d559f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:12.612453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9bdd612-2628-4571-a0de-6c10961d559f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:12.613083 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9bdd612-2628-4571-a0de-6c10961d559f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:12.613826 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9bdd612-2628-4571-a0de-6c10961d559f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:12.617329 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9bdd612-2628-4571-a0de-6c10961d559f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:12.617727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9bdd612-2628-4571-a0de-6c10961d559f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:12.629061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b6361956-0285-495c-b91d-4896dfd9c82d tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:12.645184 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b6361956-0285-495c-b91d-4896dfd9c82d tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1511 microversion: 2.1 time: 0.489621 Aug 04 17:17:12.645968 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2598/5150] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:12 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1511 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:17:13.512764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e9bdd612-2628-4571-a0de-6c10961d559f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:13.534378 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e9bdd612-2628-4571-a0de-6c10961d559f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb" status: 200 len: 1317 microversion: 2.1 time: 0.948481 Aug 04 17:17:13.544596 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2553/5151] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:12 2022] GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb => generated 1317 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:13.668654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e8346715-cb7a-4399-a4ca-7f4288ace70c tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:13.671275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e8346715-cb7a-4399-a4ca-7f4288ace70c tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:13.689650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8346715-cb7a-4399-a4ca-7f4288ace70c tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:13.690883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8346715-cb7a-4399-a4ca-7f4288ace70c tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:13.691955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8346715-cb7a-4399-a4ca-7f4288ace70c tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:13.693659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8346715-cb7a-4399-a4ca-7f4288ace70c tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:13.694531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8346715-cb7a-4399-a4ca-7f4288ace70c tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:13.695276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8346715-cb7a-4399-a4ca-7f4288ace70c tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:14.092168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e8346715-cb7a-4399-a4ca-7f4288ace70c tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aad71e7276844ae802ce34cb4231be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0bf705e624fe796abcfd60aac6061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:14.134029 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e8346715-cb7a-4399-a4ca-7f4288ace70c tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 200 len: 1511 microversion: 2.1 time: 0.466580 Aug 04 17:17:14.141589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-99aeeb08-995a-400e-8e7d-f739707b5adb req-a0fbde8c-45fe-43a8-b57a-5ddc3291f582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4", "name": "network-vif-deleted", "tag": "55706834-8e3f-467d-8a7e-fdc1e5f26df2"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:14.153467 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-99aeeb08-995a-400e-8e7d-f739707b5adb req-a0fbde8c-45fe-43a8-b57a-5ddc3291f582 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:14.156602 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2599/5152] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:13 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 1511 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:14.162724 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-99aeeb08-995a-400e-8e7d-f739707b5adb req-a0fbde8c-45fe-43a8-b57a-5ddc3291f582 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:14.166682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-99aeeb08-995a-400e-8e7d-f739707b5adb req-a0fbde8c-45fe-43a8-b57a-5ddc3291f582 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:14.171802 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:17:14.203590 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-99aeeb08-995a-400e-8e7d-f739707b5adb req-a0fbde8c-45fe-43a8-b57a-5ddc3291f582 service nova] Creating event network-vif-deleted:55706834-8e3f-467d-8a7e-fdc1e5f26df2 for instance dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 on n-h1-851359-3 Aug 04 17:17:14.223222 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-99aeeb08-995a-400e-8e7d-f739707b5adb req-a0fbde8c-45fe-43a8-b57a-5ddc3291f582 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085061 Aug 04 17:17:14.223783 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2554/5153] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:17:14.557317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c7ab5a34-c6ea-4bad-9805-5adf6e3d17dd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:14.557941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c7ab5a34-c6ea-4bad-9805-5adf6e3d17dd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:14.565735 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c7ab5a34-c6ea-4bad-9805-5adf6e3d17dd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:14.566481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c7ab5a34-c6ea-4bad-9805-5adf6e3d17dd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:14.566999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c7ab5a34-c6ea-4bad-9805-5adf6e3d17dd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:14.567741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c7ab5a34-c6ea-4bad-9805-5adf6e3d17dd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:14.568206 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c7ab5a34-c6ea-4bad-9805-5adf6e3d17dd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:14.568832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c7ab5a34-c6ea-4bad-9805-5adf6e3d17dd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:14.890012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c7ab5a34-c6ea-4bad-9805-5adf6e3d17dd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:14.900765 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c7ab5a34-c6ea-4bad-9805-5adf6e3d17dd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb" status: 200 len: 1317 microversion: 2.1 time: 0.347738 Aug 04 17:17:14.901634 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2600/5154] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:14 2022] GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb => generated 1317 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:15.164370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e40aab2e-b3a1-480c-bd96-d3e7c098b11e tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:15.165091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e40aab2e-b3a1-480c-bd96-d3e7c098b11e tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] [instance: dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:15.172758 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e40aab2e-b3a1-480c-bd96-d3e7c098b11e tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:15.173594 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e40aab2e-b3a1-480c-bd96-d3e7c098b11e tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:15.174330 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e40aab2e-b3a1-480c-bd96-d3e7c098b11e tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:15.175064 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e40aab2e-b3a1-480c-bd96-d3e7c098b11e tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:15.175536 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e40aab2e-b3a1-480c-bd96-d3e7c098b11e tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:15.175969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e40aab2e-b3a1-480c-bd96-d3e7c098b11e tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:15.193478 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-e40aab2e-b3a1-480c-bd96-d3e7c098b11e tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] HTTP exception thrown: Instance dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 could not be found. Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e40aab2e-b3a1-480c-bd96-d3e7c098b11e tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Request method failure captured: Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 HTTP/1.1 Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_7TDBnsMY11JkMV4U_jzW8Wyay2pmS2Qd6VNONqY6fGKqH77ASaXK8HG6lBElCN77H3PhJ7Ws1dTdm__g-1AprPgBDLEqGA_WKtXg_pG1LsDDPB4hYlucVgdwy6S7CwRxYdZbcZRud5rKVcq8dc398UXloD--7Y9KRngBf7sBZMGj0 Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 98a0bf705e624fe796abcfd60aac6061 Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1474687011 Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/98a0bf705e624fe796abcfd60aac6061"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/98a0bf705e624fe796abcfd60aac6061"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_98a0bf705e624fe796abcfd60aac6061"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/98a0bf705e624fe796abcfd60aac6061"}]}] Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1474687011 Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 98a0bf705e624fe796abcfd60aac6061 Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1474687011 Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServerRescueTestJSONUnderV235-1474687011-project Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 4aad71e7276844ae802ce34cb4231be3 Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1474687011-project Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 could not be found. Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4'} Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 could not be found. Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 could not be found. Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:17:15.196010 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:15.201557 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:17:15.201557 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:15.201557 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:15.201557 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:15.201557 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:17:15.201557 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:17:15.201557 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 could not be found. Aug 04 17:17:15.201557 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:17:15.201557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e40aab2e-b3a1-480c-bd96-d3e7c098b11e tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] Returning 404 to user: Instance dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:17:15.201557 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e40aab2e-b3a1-480c-bd96-d3e7c098b11e tempest-ServerRescueTestJSONUnderV235-1474687011 tempest-ServerRescueTestJSONUnderV235-1474687011-project] 10.222.0.93 "GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4" status: 404 len: 111 microversion: 2.1 time: 0.042385 Aug 04 17:17:15.206125 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2555/5155] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:15 2022] GET /compute/v2.1/servers/dc2eb207-aba8-4bb1-ae0b-8e98796a3dc4 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:17:15.268025 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b1336761-74f5-489b-902c-3789b6745126 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65fc8e77-26f9-4d0d-b5d8-0a325e6d2fbc"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:15.270639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b1336761-74f5-489b-902c-3789b6745126 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:15.277120 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1336761-74f5-489b-902c-3789b6745126 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:15.277880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1336761-74f5-489b-902c-3789b6745126 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:15.278486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1336761-74f5-489b-902c-3789b6745126 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:15.279353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1336761-74f5-489b-902c-3789b6745126 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:15.280001 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1336761-74f5-489b-902c-3789b6745126 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:15.280598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1336761-74f5-489b-902c-3789b6745126 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:15.922396 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-54960b73-1f9f-4458-973a-b8f6f626da46 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:15.923445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-54960b73-1f9f-4458-973a-b8f6f626da46 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:15.939087 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54960b73-1f9f-4458-973a-b8f6f626da46 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:15.940952 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54960b73-1f9f-4458-973a-b8f6f626da46 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:15.941507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54960b73-1f9f-4458-973a-b8f6f626da46 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:15.942016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54960b73-1f9f-4458-973a-b8f6f626da46 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:15.945409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54960b73-1f9f-4458-973a-b8f6f626da46 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:15.945894 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54960b73-1f9f-4458-973a-b8f6f626da46 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:16.206443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-54960b73-1f9f-4458-973a-b8f6f626da46 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:16.219544 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-54960b73-1f9f-4458-973a-b8f6f626da46 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb" status: 200 len: 1317 microversion: 2.1 time: 0.302020 Aug 04 17:17:16.221068 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2556/5156] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:15 2022] GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb => generated 1317 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:17:16.260212 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-463736aa-bd4a-43d3-bb1a-3e78b590b267 req-4354d133-bfbd-4bde-80a5-0370deecbc7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb", "tag": "a5b3c56b-ab06-4753-874a-74aeaed349a0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:16.275275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-463736aa-bd4a-43d3-bb1a-3e78b590b267 req-4354d133-bfbd-4bde-80a5-0370deecbc7c service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:16.275921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-463736aa-bd4a-43d3-bb1a-3e78b590b267 req-4354d133-bfbd-4bde-80a5-0370deecbc7c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:16.276438 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-463736aa-bd4a-43d3-bb1a-3e78b590b267 req-4354d133-bfbd-4bde-80a5-0370deecbc7c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:16.289249 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-463736aa-bd4a-43d3-bb1a-3e78b590b267 req-4354d133-bfbd-4bde-80a5-0370deecbc7c service nova] Creating event network-changed:a5b3c56b-ab06-4753-874a-74aeaed349a0 for instance aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb on n-h2-851359-3 Aug 04 17:17:16.296963 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-463736aa-bd4a-43d3-bb1a-3e78b590b267 req-4354d133-bfbd-4bde-80a5-0370deecbc7c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042168 Aug 04 17:17:16.298738 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2557/5157] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:17:17.242835 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-29d5d7ae-f1ef-4151-bd8a-89d8cac476ce tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:17.243685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-29d5d7ae-f1ef-4151-bd8a-89d8cac476ce tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:17.260611 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29d5d7ae-f1ef-4151-bd8a-89d8cac476ce tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:17.261490 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29d5d7ae-f1ef-4151-bd8a-89d8cac476ce tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:17.266330 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29d5d7ae-f1ef-4151-bd8a-89d8cac476ce tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:17.268942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29d5d7ae-f1ef-4151-bd8a-89d8cac476ce tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:17.271780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29d5d7ae-f1ef-4151-bd8a-89d8cac476ce tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:17.273020 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29d5d7ae-f1ef-4151-bd8a-89d8cac476ce tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:17.549009 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-29d5d7ae-f1ef-4151-bd8a-89d8cac476ce tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:17.563481 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-29d5d7ae-f1ef-4151-bd8a-89d8cac476ce tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb" status: 200 len: 1317 microversion: 2.1 time: 0.325282 Aug 04 17:17:17.565950 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2558/5158] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:17 2022] GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:17:18.166575 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b1336761-74f5-489b-902c-3789b6745126 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "POST /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.902948 Aug 04 17:17:18.168213 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2601/5159] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Aug 4 17:17:15 2022] POST /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee/os-volume_attachments => generated 194 bytes in 2906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:18.596248 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9cab68f4-47e9-4d36-92a1-7263497cf3cf tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:18.597926 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9cab68f4-47e9-4d36-92a1-7263497cf3cf tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:18.618356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9cab68f4-47e9-4d36-92a1-7263497cf3cf tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:18.619100 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9cab68f4-47e9-4d36-92a1-7263497cf3cf tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:18.621345 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9cab68f4-47e9-4d36-92a1-7263497cf3cf tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:18.622283 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9cab68f4-47e9-4d36-92a1-7263497cf3cf tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:18.623568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9cab68f4-47e9-4d36-92a1-7263497cf3cf tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:18.625142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9cab68f4-47e9-4d36-92a1-7263497cf3cf tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:19.011303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9cab68f4-47e9-4d36-92a1-7263497cf3cf tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:19.024907 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9cab68f4-47e9-4d36-92a1-7263497cf3cf tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb" status: 200 len: 1317 microversion: 2.1 time: 0.435570 Aug 04 17:17:19.029817 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2559/5160] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:18 2022] GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb => generated 1317 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:20.056241 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1100f864-1136-4102-8351-7d5ec2698f89 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:20.058028 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1100f864-1136-4102-8351-7d5ec2698f89 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:20.065091 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1100f864-1136-4102-8351-7d5ec2698f89 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:20.065968 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1100f864-1136-4102-8351-7d5ec2698f89 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:20.066650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1100f864-1136-4102-8351-7d5ec2698f89 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:20.067595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1100f864-1136-4102-8351-7d5ec2698f89 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:20.068285 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1100f864-1136-4102-8351-7d5ec2698f89 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:20.068950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1100f864-1136-4102-8351-7d5ec2698f89 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:20.233348 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1100f864-1136-4102-8351-7d5ec2698f89 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:20.241515 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1100f864-1136-4102-8351-7d5ec2698f89 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb" status: 200 len: 1317 microversion: 2.1 time: 0.191021 Aug 04 17:17:20.254967 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2602/5161] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:20 2022] GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:20.747435 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-886dc92d-edc6-4af1-a6ff-f092f7ed08f8 req-4c123aaf-fafa-464b-9547-e648485097a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb", "name": "network-vif-plugged", "status": "completed", "tag": "a5b3c56b-ab06-4753-874a-74aeaed349a0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:20.759310 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:17:20.761669 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:17:20.762852 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=74 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:17:20.772027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-886dc92d-edc6-4af1-a6ff-f092f7ed08f8 req-4c123aaf-fafa-464b-9547-e648485097a0 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:20.774531 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-886dc92d-edc6-4af1-a6ff-f092f7ed08f8 req-4c123aaf-fafa-464b-9547-e648485097a0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:20.776889 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-886dc92d-edc6-4af1-a6ff-f092f7ed08f8 req-4c123aaf-fafa-464b-9547-e648485097a0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:20.796182 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-886dc92d-edc6-4af1-a6ff-f092f7ed08f8 req-4c123aaf-fafa-464b-9547-e648485097a0 service nova] Creating event network-vif-plugged:a5b3c56b-ab06-4753-874a-74aeaed349a0 for instance aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb on n-h2-851359-3 Aug 04 17:17:20.801454 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-886dc92d-edc6-4af1-a6ff-f092f7ed08f8 req-4c123aaf-fafa-464b-9547-e648485097a0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059251 Aug 04 17:17:20.802218 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2560/5162] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:21.264217 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7475dbff-ad34-4860-9b4a-df328a53501a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:21.266423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7475dbff-ad34-4860-9b4a-df328a53501a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:21.276974 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:17:21.280485 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7475dbff-ad34-4860-9b4a-df328a53501a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:21.281538 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7475dbff-ad34-4860-9b4a-df328a53501a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:21.282029 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7475dbff-ad34-4860-9b4a-df328a53501a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:21.283014 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7475dbff-ad34-4860-9b4a-df328a53501a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:21.283800 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7475dbff-ad34-4860-9b4a-df328a53501a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:21.284540 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7475dbff-ad34-4860-9b4a-df328a53501a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:21.526077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7475dbff-ad34-4860-9b4a-df328a53501a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:21.550779 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7475dbff-ad34-4860-9b4a-df328a53501a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb" status: 200 len: 1317 microversion: 2.1 time: 0.291762 Aug 04 17:17:21.569958 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2603/5163] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:21 2022] GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb => generated 1317 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:17:22.121855 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-886dc92d-edc6-4af1-a6ff-f092f7ed08f8 req-4c123aaf-fafa-464b-9547-e648485097a0 service nova] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:22.123061 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-886dc92d-edc6-4af1-a6ff-f092f7ed08f8 req-4c123aaf-fafa-464b-9547-e648485097a0 service nova] 10.222.0.93 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001710 Aug 04 17:17:22.123683 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2561/5164] 10.222.0.93 () {56 vars in 886 bytes} [Thu Aug 4 17:17:22 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 04 17:17:22.131324 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7475dbff-ad34-4860-9b4a-df328a53501a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:22.133306 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7475dbff-ad34-4860-9b4a-df328a53501a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002482 Aug 04 17:17:22.140162 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2604/5165] 10.222.0.93 () {54 vars in 1035 bytes} [Thu Aug 4 17:17:22 2022] GET /compute/v2/ => generated 379 bytes in 10 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Aug 04 17:17:22.142219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-886dc92d-edc6-4af1-a6ff-f092f7ed08f8 req-4c123aaf-fafa-464b-9547-e648485097a0 service nova] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:22.143498 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-886dc92d-edc6-4af1-a6ff-f092f7ed08f8 req-4c123aaf-fafa-464b-9547-e648485097a0 service nova] 10.222.0.93 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001746 Aug 04 17:17:22.152212 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7475dbff-ad34-4860-9b4a-df328a53501a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:22.153591 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7475dbff-ad34-4860-9b4a-df328a53501a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001752 Aug 04 17:17:22.161195 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2562/5166] 10.222.0.93 () {54 vars in 1041 bytes} [Thu Aug 4 17:17:22 2022] GET /compute/v2.1/ => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:17:22.161720 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2605/5167] 10.222.0.93 () {56 vars in 886 bytes} [Thu Aug 4 17:17:22 2022] GET /compute/ => generated 377 bytes in 10 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 04 17:17:22.578524 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6b6e8453-0175-4040-970b-669112a99ac1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:22.579291 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6b6e8453-0175-4040-970b-669112a99ac1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:22.590586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b6e8453-0175-4040-970b-669112a99ac1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:22.595322 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b6e8453-0175-4040-970b-669112a99ac1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:22.599306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b6e8453-0175-4040-970b-669112a99ac1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:22.600983 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b6e8453-0175-4040-970b-669112a99ac1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:22.601919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b6e8453-0175-4040-970b-669112a99ac1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:22.603756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b6e8453-0175-4040-970b-669112a99ac1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:22.931523 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6b6e8453-0175-4040-970b-669112a99ac1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:22.946264 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6b6e8453-0175-4040-970b-669112a99ac1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb" status: 200 len: 1317 microversion: 2.1 time: 0.373326 Aug 04 17:17:22.948132 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2563/5168] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:22 2022] GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb => generated 1317 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:23.971705 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-36ed4fba-f61d-47a4-a78a-01a3ef7c6ed1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:23.973087 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-36ed4fba-f61d-47a4-a78a-01a3ef7c6ed1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:23.984489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-36ed4fba-f61d-47a4-a78a-01a3ef7c6ed1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:23.985362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-36ed4fba-f61d-47a4-a78a-01a3ef7c6ed1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:23.986487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-36ed4fba-f61d-47a4-a78a-01a3ef7c6ed1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:23.988140 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-36ed4fba-f61d-47a4-a78a-01a3ef7c6ed1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:23.989513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-36ed4fba-f61d-47a4-a78a-01a3ef7c6ed1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:23.990292 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-36ed4fba-f61d-47a4-a78a-01a3ef7c6ed1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:24.225582 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-36ed4fba-f61d-47a4-a78a-01a3ef7c6ed1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:24.238650 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-36ed4fba-f61d-47a4-a78a-01a3ef7c6ed1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb" status: 200 len: 1506 microversion: 2.1 time: 0.270600 Aug 04 17:17:24.240138 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2606/5169] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:23 2022] GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb => generated 1506 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:24.266954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d66bedcb-fe83-4094-b98b-d88e39de0298 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:24.268428 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d66bedcb-fe83-4094-b98b-d88e39de0298 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:24.278600 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d66bedcb-fe83-4094-b98b-d88e39de0298 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:24.279491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d66bedcb-fe83-4094-b98b-d88e39de0298 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:24.280316 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d66bedcb-fe83-4094-b98b-d88e39de0298 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:24.282715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d66bedcb-fe83-4094-b98b-d88e39de0298 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:24.283605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d66bedcb-fe83-4094-b98b-d88e39de0298 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:24.284508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d66bedcb-fe83-4094-b98b-d88e39de0298 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:24.326106 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d66bedcb-fe83-4094-b98b-d88e39de0298 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:17:24.463833 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d66bedcb-fe83-4094-b98b-d88e39de0298 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "DELETE /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb" status: 204 len: 0 microversion: 2.1 time: 0.202687 Aug 04 17:17:24.467516 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2564/5170] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:17:24 2022] DELETE /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:17:24.474478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6281898c-5eea-4e06-90e2-b63ec9248971 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:24.475646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6281898c-5eea-4e06-90e2-b63ec9248971 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:24.483652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6281898c-5eea-4e06-90e2-b63ec9248971 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:24.484133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6281898c-5eea-4e06-90e2-b63ec9248971 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:24.484829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6281898c-5eea-4e06-90e2-b63ec9248971 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:24.485901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6281898c-5eea-4e06-90e2-b63ec9248971 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:24.486631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6281898c-5eea-4e06-90e2-b63ec9248971 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:24.487185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6281898c-5eea-4e06-90e2-b63ec9248971 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:24.674681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6281898c-5eea-4e06-90e2-b63ec9248971 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:24.685005 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6281898c-5eea-4e06-90e2-b63ec9248971 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb" status: 200 len: 1512 microversion: 2.1 time: 0.214348 Aug 04 17:17:24.686962 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2607/5171] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:24 2022] GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb => generated 1512 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:25.649284 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-06adc29c-ed9b-4a65-ba08-6f5c16d5fa58 tempest-VolumesGetTestJSON-1194217654 tempest-VolumesGetTestJSON-1194217654-project] Action: 'create', calling method: .version_select at 0x7f1e6c944670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-877270626", "metadata": {"Type": "work"}}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:25.717675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c80ef19a-5a6e-45e8-995e-a0cd28f5026e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:25.719701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c80ef19a-5a6e-45e8-995e-a0cd28f5026e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:25.737650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c80ef19a-5a6e-45e8-995e-a0cd28f5026e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:25.739362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c80ef19a-5a6e-45e8-995e-a0cd28f5026e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:25.740957 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c80ef19a-5a6e-45e8-995e-a0cd28f5026e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:25.743593 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c80ef19a-5a6e-45e8-995e-a0cd28f5026e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:25.744984 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c80ef19a-5a6e-45e8-995e-a0cd28f5026e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:25.746163 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c80ef19a-5a6e-45e8-995e-a0cd28f5026e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:26.014099 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c80ef19a-5a6e-45e8-995e-a0cd28f5026e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:26.033316 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c80ef19a-5a6e-45e8-995e-a0cd28f5026e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb" status: 200 len: 1512 microversion: 2.1 time: 0.325454 Aug 04 17:17:26.046669 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2608/5172] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:25 2022] GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb => generated 1512 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:17:26.343687 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-06adc29c-ed9b-4a65-ba08-6f5c16d5fa58 tempest-VolumesGetTestJSON-1194217654 tempest-VolumesGetTestJSON-1194217654-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.119637 Aug 04 17:17:26.350036 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2565/5173] 10.222.0.93 () {60 vars in 1156 bytes} [Thu Aug 4 17:17:25 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1122 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 04 17:17:26.361507 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e6504cc6-a345-4061-80c1-2a5d10943b36 tempest-VolumesGetTestJSON-1194217654 tempest-VolumesGetTestJSON-1194217654-project] Calling method '.version_select at 0x7f1e5af55ca0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:26.495582 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e6504cc6-a345-4061-80c1-2a5d10943b36 tempest-VolumesGetTestJSON-1194217654 tempest-VolumesGetTestJSON-1194217654-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/de2be911-66c5-43fa-b6a4-813db019561f" status: 200 len: 352 microversion: 2.1 time: 0.140396 Aug 04 17:17:26.508414 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2609/5174] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Aug 4 17:17:26 2022] GET /compute/v2.1/os-volumes/de2be911-66c5-43fa-b6a4-813db019561f => generated 352 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:17:27.057657 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-ac0bbbe9-f007-4d36-bbd4-da81d010de39 req-722b7f77-586b-4630-a848-7b3315e4e2fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb", "name": "network-vif-deleted", "tag": "a5b3c56b-ab06-4753-874a-74aeaed349a0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:27.068355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8c96bb70-95d5-4987-ac8d-49287d0b00d2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:27.069182 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8c96bb70-95d5-4987-ac8d-49287d0b00d2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:27.081203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ac0bbbe9-f007-4d36-bbd4-da81d010de39 req-722b7f77-586b-4630-a848-7b3315e4e2fe service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:27.092791 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ac0bbbe9-f007-4d36-bbd4-da81d010de39 req-722b7f77-586b-4630-a848-7b3315e4e2fe service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:27.093017 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c96bb70-95d5-4987-ac8d-49287d0b00d2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:27.093633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c96bb70-95d5-4987-ac8d-49287d0b00d2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:27.095060 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ac0bbbe9-f007-4d36-bbd4-da81d010de39 req-722b7f77-586b-4630-a848-7b3315e4e2fe service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:27.095769 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c96bb70-95d5-4987-ac8d-49287d0b00d2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:27.102603 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c96bb70-95d5-4987-ac8d-49287d0b00d2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:27.103518 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c96bb70-95d5-4987-ac8d-49287d0b00d2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:27.104214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c96bb70-95d5-4987-ac8d-49287d0b00d2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:27.135134 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-ac0bbbe9-f007-4d36-bbd4-da81d010de39 req-722b7f77-586b-4630-a848-7b3315e4e2fe service nova] Creating event network-vif-deleted:a5b3c56b-ab06-4753-874a-74aeaed349a0 for instance aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb on n-h2-851359-3 Aug 04 17:17:27.145467 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-ac0bbbe9-f007-4d36-bbd4-da81d010de39 req-722b7f77-586b-4630-a848-7b3315e4e2fe service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094385 Aug 04 17:17:27.149161 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2566/5175] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:27.314857 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8c96bb70-95d5-4987-ac8d-49287d0b00d2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:27.325272 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8c96bb70-95d5-4987-ac8d-49287d0b00d2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb" status: 200 len: 1302 microversion: 2.1 time: 0.261748 Aug 04 17:17:27.326099 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2610/5176] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:27 2022] GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb => generated 1302 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:27.514506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-39f72c07-6a69-4525-bcdc-717525f2b75b tempest-VolumesGetTestJSON-1194217654 tempest-VolumesGetTestJSON-1194217654-project] Calling method '.version_select at 0x7f1e6c910e50>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:27.592489 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-39f72c07-6a69-4525-bcdc-717525f2b75b tempest-VolumesGetTestJSON-1194217654 tempest-VolumesGetTestJSON-1194217654-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/de2be911-66c5-43fa-b6a4-813db019561f" status: 200 len: 352 microversion: 2.1 time: 0.082210 Aug 04 17:17:27.593232 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2567/5177] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Aug 4 17:17:27 2022] GET /compute/v2.1/os-volumes/de2be911-66c5-43fa-b6a4-813db019561f => generated 352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:28.348032 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-48add8a3-fd93-4612-9672-f8364c0fe29c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:28.348813 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-48add8a3-fd93-4612-9672-f8364c0fe29c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:28.356757 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-48add8a3-fd93-4612-9672-f8364c0fe29c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:28.357253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-48add8a3-fd93-4612-9672-f8364c0fe29c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:28.357693 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-48add8a3-fd93-4612-9672-f8364c0fe29c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:28.358657 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-48add8a3-fd93-4612-9672-f8364c0fe29c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:28.359118 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-48add8a3-fd93-4612-9672-f8364c0fe29c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:28.359549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-48add8a3-fd93-4612-9672-f8364c0fe29c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:28.373223 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-48add8a3-fd93-4612-9672-f8364c0fe29c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Instance aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb could not be found. Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-48add8a3-fd93-4612-9672-f8364c0fe29c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb HTTP/1.1 Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb could not be found. Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb'} Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb could not be found. Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb could not be found. Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:28.375040 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:28.379431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:28.379431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:28.379431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:28.379431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:17:28.379431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:17:28.379431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb could not be found. Aug 04 17:17:28.379431 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:28.379431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-48add8a3-fd93-4612-9672-f8364c0fe29c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 404 to user: Instance aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:17:28.379431 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-48add8a3-fd93-4612-9672-f8364c0fe29c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb" status: 404 len: 111 microversion: 2.1 time: 0.033048 Aug 04 17:17:28.379431 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2611/5178] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:28 2022] GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:17:28.385705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9dacbddd-fd43-4f31-ba41-53b4e1b46363 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:28.386492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9dacbddd-fd43-4f31-ba41-53b4e1b46363 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:28.393036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dacbddd-fd43-4f31-ba41-53b4e1b46363 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:28.393523 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dacbddd-fd43-4f31-ba41-53b4e1b46363 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:28.393957 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dacbddd-fd43-4f31-ba41-53b4e1b46363 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:28.394677 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dacbddd-fd43-4f31-ba41-53b4e1b46363 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:28.395134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dacbddd-fd43-4f31-ba41-53b4e1b46363 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:28.395563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dacbddd-fd43-4f31-ba41-53b4e1b46363 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:28.570425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9dacbddd-fd43-4f31-ba41-53b4e1b46363 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:28.578720 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9dacbddd-fd43-4f31-ba41-53b4e1b46363 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.196718 Aug 04 17:17:28.579318 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2568/5179] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:28 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:28.606839 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-28b67dab-14b7-4def-b55c-5244f64c69f1 tempest-VolumesGetTestJSON-1194217654 tempest-VolumesGetTestJSON-1194217654-project] Calling method '.version_select at 0x7f1e5ac2be50>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:28.672487 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-28b67dab-14b7-4def-b55c-5244f64c69f1 tempest-VolumesGetTestJSON-1194217654 tempest-VolumesGetTestJSON-1194217654-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/de2be911-66c5-43fa-b6a4-813db019561f" status: 200 len: 353 microversion: 2.1 time: 0.070018 Aug 04 17:17:28.673072 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2612/5180] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Aug 4 17:17:28 2022] GET /compute/v2.1/os-volumes/de2be911-66c5-43fa-b6a4-813db019561f => generated 353 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:28.685910 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5beaa86b-beb5-4b57-9009-819ddc3ad3db tempest-VolumesGetTestJSON-1194217654 tempest-VolumesGetTestJSON-1194217654-project] Calling method '.version_select at 0x7f1e5b3898b0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:28.732155 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5bbb1fd6-5bc4-4451-bef5-f7a1b7572ec7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "f20ac3e7-ddd2-4167-bdf1-b8b75ff31772"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5bbb1fd6-5bc4-4451-bef5-f7a1b7572ec7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 163 Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: {"server": {"name": 12345, "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "f20ac3e7-ddd2-4167-bdf1-b8b75ff31772"}]}} Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '93ebc91d-2d7a-4ab2-b133-dcf9559166d9', 'flavorRef': '452', 'networks': [{'uuid': 'f20ac3e7-ddd2-4167-bdf1-b8b75ff31772'}]}}} Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi 12345 Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:17:28.736528 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:17:28.740728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:17:28.740728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 04 17:17:28.740728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:28.740728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:28.740728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:28.740728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:28.740728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:28.740728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:28.740728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:17:28.740728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:17:28.740728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 04 17:17:28.740728 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:28.740728 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5bbb1fd6-5bc4-4451-bef5-f7a1b7572ec7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:17:28.740728 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5bbb1fd6-5bc4-4451-bef5-f7a1b7572ec7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.013260 Aug 04 17:17:28.743797 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2613/5181] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:17:28 2022] POST /compute/v2.1/servers => generated 127 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:17:28.755080 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f17ece28-27bc-427b-995c-8ef97f188962 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:28.755740 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f17ece28-27bc-427b-995c-8ef97f188962 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:28.765389 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5beaa86b-beb5-4b57-9009-819ddc3ad3db tempest-VolumesGetTestJSON-1194217654 tempest-VolumesGetTestJSON-1194217654-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/de2be911-66c5-43fa-b6a4-813db019561f" status: 200 len: 353 microversion: 2.1 time: 0.083455 Aug 04 17:17:28.766026 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2569/5182] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Aug 4 17:17:28 2022] GET /compute/v2.1/os-volumes/de2be911-66c5-43fa-b6a4-813db019561f => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:17:28.767590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f17ece28-27bc-427b-995c-8ef97f188962 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:28.768116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f17ece28-27bc-427b-995c-8ef97f188962 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:28.768576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f17ece28-27bc-427b-995c-8ef97f188962 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:28.769350 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f17ece28-27bc-427b-995c-8ef97f188962 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:28.769901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f17ece28-27bc-427b-995c-8ef97f188962 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:28.770441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f17ece28-27bc-427b-995c-8ef97f188962 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:28.784112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-726d4aaa-68cd-4146-96c6-e760aec0cd35 tempest-VolumesGetTestJSON-1194217654 tempest-VolumesGetTestJSON-1194217654-project] Calling method '.version_select at 0x7f1e5b3899d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:28.861918 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-726d4aaa-68cd-4146-96c6-e760aec0cd35 tempest-VolumesGetTestJSON-1194217654 tempest-VolumesGetTestJSON-1194217654-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/de2be911-66c5-43fa-b6a4-813db019561f" status: 202 len: 0 microversion: 2.1 time: 0.085329 Aug 04 17:17:28.862976 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2570/5183] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Aug 4 17:17:28 2022] DELETE /compute/v2.1/os-volumes/de2be911-66c5-43fa-b6a4-813db019561f => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 17:17:28.874528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-33a83095-90af-4470-883b-1c676160b03a tempest-VolumesGetTestJSON-1194217654 tempest-VolumesGetTestJSON-1194217654-project] Calling method '.version_select at 0x7f1e5aa84280>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:28.949939 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-33a83095-90af-4470-883b-1c676160b03a tempest-VolumesGetTestJSON-1194217654 tempest-VolumesGetTestJSON-1194217654-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/de2be911-66c5-43fa-b6a4-813db019561f" status: 200 len: 352 microversion: 2.1 time: 0.080680 Aug 04 17:17:28.950673 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2571/5184] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Aug 4 17:17:28 2022] GET /compute/v2.1/os-volumes/de2be911-66c5-43fa-b6a4-813db019561f => generated 352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:17:28.976353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f17ece28-27bc-427b-995c-8ef97f188962 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:28.989619 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f17ece28-27bc-427b-995c-8ef97f188962 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.242532 Aug 04 17:17:28.991467 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2614/5185] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:28 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:29.019644 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-78b59a39-53f2-4386-9c76-7552f140a27a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:29.020479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-78b59a39-53f2-4386-9c76-7552f140a27a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:29.028434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78b59a39-53f2-4386-9c76-7552f140a27a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:29.029353 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78b59a39-53f2-4386-9c76-7552f140a27a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:29.030075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78b59a39-53f2-4386-9c76-7552f140a27a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:29.031706 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78b59a39-53f2-4386-9c76-7552f140a27a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:29.032710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78b59a39-53f2-4386-9c76-7552f140a27a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:29.033327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78b59a39-53f2-4386-9c76-7552f140a27a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:29.562311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-78b59a39-53f2-4386-9c76-7552f140a27a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:29.573487 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-78b59a39-53f2-4386-9c76-7552f140a27a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.558268 Aug 04 17:17:29.574466 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2572/5186] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:29 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:29.964283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-79f8553e-7b0e-4647-88bc-42637ae2ca6f tempest-VolumesGetTestJSON-1194217654 tempest-VolumesGetTestJSON-1194217654-project] Calling method '.version_select at 0x7f1e5ad38dc0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:30.039441 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-79f8553e-7b0e-4647-88bc-42637ae2ca6f tempest-VolumesGetTestJSON-1194217654 tempest-VolumesGetTestJSON-1194217654-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/de2be911-66c5-43fa-b6a4-813db019561f" status: 200 len: 352 microversion: 2.1 time: 0.079552 Aug 04 17:17:30.040365 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2615/5187] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Aug 4 17:17:29 2022] GET /compute/v2.1/os-volumes/de2be911-66c5-43fa-b6a4-813db019561f => generated 352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:31.054332 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cd7f5dcd-7996-46c8-a9da-561df50e173b tempest-VolumesGetTestJSON-1194217654 tempest-VolumesGetTestJSON-1194217654-project] Calling method '.version_select at 0x7f1e5b948f70>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:31.139797 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cd7f5dcd-7996-46c8-a9da-561df50e173b tempest-VolumesGetTestJSON-1194217654 tempest-VolumesGetTestJSON-1194217654-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/de2be911-66c5-43fa-b6a4-813db019561f" status: 200 len: 352 microversion: 2.1 time: 0.090275 Aug 04 17:17:31.140628 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2573/5188] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Aug 4 17:17:31 2022] GET /compute/v2.1/os-volumes/de2be911-66c5-43fa-b6a4-813db019561f => generated 352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:31.749714 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c8adbc86-90fd-4a29-bec9-dcc5d3a239fc tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65fc8e77-26f9-4d0d-b5d8-0a325e6d2fbc"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:31.752583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c8adbc86-90fd-4a29-bec9-dcc5d3a239fc tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:31.760925 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8adbc86-90fd-4a29-bec9-dcc5d3a239fc tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:31.761554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8adbc86-90fd-4a29-bec9-dcc5d3a239fc tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:31.762157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8adbc86-90fd-4a29-bec9-dcc5d3a239fc tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:31.763007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8adbc86-90fd-4a29-bec9-dcc5d3a239fc tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:31.763870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8adbc86-90fd-4a29-bec9-dcc5d3a239fc tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:31.764536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8adbc86-90fd-4a29-bec9-dcc5d3a239fc tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:31.790278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:17:31.877131 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-c8adbc86-90fd-4a29-bec9-dcc5d3a239fc tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] HTTP exception thrown: Invalid volume: volume 65fc8e77-26f9-4d0d-b5d8-0a325e6d2fbc is already attached to instances: 50cacda1-31c5-4417-8013-9c603340c3ee Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c8adbc86-90fd-4a29-bec9-dcc5d3a239fc tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Request method failure captured: Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee/os-volume_attachments HTTP/1.1 Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 74 Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_20IgjlzOhiiXNFc-NV1FHodxKmWXqSdjZ2I3CqIylUHNkhkG-JAGdMPdYL-8rZzM7v2_0KXVTorBGskuo6vUXRtOSVoO1KTIHw44-u5yCDnlwK7XKRi3uI2OBhda5ANtzdvy-06i9FyD27hM6LxpcHB7QNnHGthqSv2gOLnkKiVjg Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 80bc576163414daba5f5315c4a785533 Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/80bc576163414daba5f5315c4a785533"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/80bc576163414daba5f5315c4a785533"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_80bc576163414daba5f5315c4a785533"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/80bc576163414daba5f5315c4a785533"}]}] Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 80bc576163414daba5f5315c4a785533 Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-AttachVolumeNegativeTest-1565246319-project Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 5b10b58bf3df46d18bff092022b08e0f Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-AttachVolumeNegativeTest-1565246319-project Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: {"volumeAttachment": {"volumeId": "65fc8e77-26f9-4d0d-b5d8-0a325e6d2fbc"}} Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: exception: Invalid volume: volume 65fc8e77-26f9-4d0d-b5d8-0a325e6d2fbc is already attached to instances: 50cacda1-31c5-4417-8013-9c603340c3ee Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'server_id': '50cacda1-31c5-4417-8013-9c603340c3ee', 'body': {'volumeAttachment': {'volumeId': '65fc8e77-26f9-4d0d-b5d8-0a325e6d2fbc'}}} Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 65fc8e77-26f9-4d0d-b5d8-0a325e6d2fbc is already attached to instances: 50cacda1-31c5-4417-8013-9c603340c3ee Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:17:31.878944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:17:31.883663 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:17:31.883663 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:17:31.883663 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 04 17:17:31.883663 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 17:17:31.883663 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 65fc8e77-26f9-4d0d-b5d8-0a325e6d2fbc is already attached to instances: 50cacda1-31c5-4417-8013-9c603340c3ee Aug 04 17:17:31.883663 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:31.883663 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:31.883663 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:31.883663 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:31.883663 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:31.883663 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:31.883663 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:17:31.883663 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:17:31.883663 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 65fc8e77-26f9-4d0d-b5d8-0a325e6d2fbc is already attached to instances: 50cacda1-31c5-4417-8013-9c603340c3ee Aug 04 17:17:31.883663 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:31.883663 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c8adbc86-90fd-4a29-bec9-dcc5d3a239fc tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Returning 400 to user: Invalid volume: volume 65fc8e77-26f9-4d0d-b5d8-0a325e6d2fbc is already attached to instances: 50cacda1-31c5-4417-8013-9c603340c3ee {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:17:31.883663 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c8adbc86-90fd-4a29-bec9-dcc5d3a239fc tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "POST /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.136086 Aug 04 17:17:31.883663 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2616/5189] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Aug 4 17:17:31 2022] POST /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee/os-volume_attachments => generated 174 bytes in 137 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 17:17:31.965605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5107337a-a8af-4592-a416-d67e750d1aa3 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:31.966233 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5107337a-a8af-4592-a416-d67e750d1aa3 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:31.978484 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5107337a-a8af-4592-a416-d67e750d1aa3 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:31.979396 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5107337a-a8af-4592-a416-d67e750d1aa3 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:31.980132 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5107337a-a8af-4592-a416-d67e750d1aa3 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:31.982941 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5107337a-a8af-4592-a416-d67e750d1aa3 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:31.983943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5107337a-a8af-4592-a416-d67e750d1aa3 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:31.984462 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5107337a-a8af-4592-a416-d67e750d1aa3 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:32.091092 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-5107337a-a8af-4592-a416-d67e750d1aa3 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lazy-loading 'services' on Instance uuid 50cacda1-31c5-4417-8013-9c603340c3ee {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:17:32.155357 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6adfc444-09a8-4c5b-8399-192336767826 tempest-VolumesGetTestJSON-1194217654 tempest-VolumesGetTestJSON-1194217654-project] Calling method '.version_select at 0x7f1e5ab0cdc0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:32.195514 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5107337a-a8af-4592-a416-d67e750d1aa3 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "DELETE /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee/os-volume_attachments/65fc8e77-26f9-4d0d-b5d8-0a325e6d2fbc" status: 202 len: 0 microversion: 2.1 time: 0.233665 Aug 04 17:17:32.196946 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2574/5190] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Aug 4 17:17:31 2022] DELETE /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee/os-volume_attachments/65fc8e77-26f9-4d0d-b5d8-0a325e6d2fbc => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:17:32.203832 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-6adfc444-09a8-4c5b-8399-192336767826 tempest-VolumesGetTestJSON-1194217654 tempest-VolumesGetTestJSON-1194217654-project] HTTP exception thrown: Volume de2be911-66c5-43fa-b6a4-813db019561f could not be found. Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6adfc444-09a8-4c5b-8399-192336767826 tempest-VolumesGetTestJSON-1194217654 tempest-VolumesGetTestJSON-1194217654-project] Request method failure captured: Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/os-volumes/de2be911-66c5-43fa-b6a4-813db019561f HTTP/1.1 Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_8lHOGIIXaopCQGri5kEqHl6WSWLKCy57Rd7Ay2Zb7rj4tCgX8eovgCnadhFP0iVO6Xfdx9r_zn7m4u1bRpz27ucx6PROKxbm_XeE94HsWfpH2bDQd3YbLvXJgxqARit2hsOLMxTwoaXjKXl8AbOdzLUDocm0bvDncwSf2_iYEnVEI Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 1dac689c92eb43c8ab48ba1ba47965e6 Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-VolumesGetTestJSON-1194217654 Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1dac689c92eb43c8ab48ba1ba47965e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/1dac689c92eb43c8ab48ba1ba47965e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_1dac689c92eb43c8ab48ba1ba47965e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/1dac689c92eb43c8ab48ba1ba47965e6"}]}] Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-VolumesGetTestJSON-1194217654 Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 1dac689c92eb43c8ab48ba1ba47965e6 Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-VolumesGetTestJSON-1194217654 Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-VolumesGetTestJSON-1194217654-project Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 71a53105105e466c8e2246795b519b67 Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-VolumesGetTestJSON-1194217654-project Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: exception: Volume de2be911-66c5-43fa-b6a4-813db019561f could not be found. Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'de2be911-66c5-43fa-b6a4-813db019561f'} Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume de2be911-66c5-43fa-b6a4-813db019561f could not be found. (HTTP 404) (Request-ID: req-ac690e23-22cf-4468-ad06-30abc4f99ddd) Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 17:17:32.208458 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume de2be911-66c5-43fa-b6a4-813db019561f could not be found. Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume de2be911-66c5-43fa-b6a4-813db019561f could not be found. Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume de2be911-66c5-43fa-b6a4-813db019561f could not be found. Aug 04 17:17:32.213340 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:32.219385 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bb087060-4fb9-443b-afaa-4d11ad277973 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:32.220856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6adfc444-09a8-4c5b-8399-192336767826 tempest-VolumesGetTestJSON-1194217654 tempest-VolumesGetTestJSON-1194217654-project] Returning 404 to user: Volume de2be911-66c5-43fa-b6a4-813db019561f could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:17:32.221381 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bb087060-4fb9-443b-afaa-4d11ad277973 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:32.222202 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6adfc444-09a8-4c5b-8399-192336767826 tempest-VolumesGetTestJSON-1194217654 tempest-VolumesGetTestJSON-1194217654-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/de2be911-66c5-43fa-b6a4-813db019561f" status: 404 len: 109 microversion: 2.1 time: 0.071848 Aug 04 17:17:32.223308 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2617/5191] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Aug 4 17:17:32 2022] GET /compute/v2.1/os-volumes/de2be911-66c5-43fa-b6a4-813db019561f => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:17:32.239896 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb087060-4fb9-443b-afaa-4d11ad277973 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:32.241554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb087060-4fb9-443b-afaa-4d11ad277973 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:32.242526 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb087060-4fb9-443b-afaa-4d11ad277973 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:32.245111 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb087060-4fb9-443b-afaa-4d11ad277973 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:32.247515 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb087060-4fb9-443b-afaa-4d11ad277973 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:32.248294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb087060-4fb9-443b-afaa-4d11ad277973 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:32.353874 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bb087060-4fb9-443b-afaa-4d11ad277973 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151802 Aug 04 17:17:32.377214 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2575/5192] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:17:32 2022] GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:32.705022 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5cf756f8-927b-4e87-bb93-1f0bf4e9dffd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1860637670", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "5db37786-dc9f-435b-9b8b-f5f2fcbc565b", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "f20ac3e7-ddd2-4167-bdf1-b8b75ff31772"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:32.811108 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-5cf756f8-927b-4e87-bb93-1f0bf4e9dffd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Block Device 5db37786-dc9f-435b-9b8b-f5f2fcbc565b is not bootable. Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5cf756f8-927b-4e87-bb93-1f0bf4e9dffd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 358 Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1860637670", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "5db37786-dc9f-435b-9b8b-f5f2fcbc565b", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "f20ac3e7-ddd2-4167-bdf1-b8b75ff31772"}]}} Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: exception: Block Device 5db37786-dc9f-435b-9b8b-f5f2fcbc565b is not bootable. Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1860637670', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '5db37786-dc9f-435b-9b8b-f5f2fcbc565b'}], 'networks': [{'uuid': 'f20ac3e7-ddd2-4167-bdf1-b8b75ff31772'}]}}} Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1624, in _create_instance Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 5db37786-dc9f-435b-9b8b-f5f2fcbc565b is not bootable. Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:17:32.816113 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:17:32.820014 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:17:32.820014 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:17:32.820014 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:17:32.820014 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 17:17:32.820014 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 04 17:17:32.820014 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 04 17:17:32.820014 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 5db37786-dc9f-435b-9b8b-f5f2fcbc565b is not bootable. Aug 04 17:17:32.820014 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:32.820014 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:32.820014 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:32.820014 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:32.820014 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:32.820014 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:32.820014 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:17:32.820014 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:17:32.820014 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 5db37786-dc9f-435b-9b8b-f5f2fcbc565b is not bootable. Aug 04 17:17:32.820014 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:32.820014 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5cf756f8-927b-4e87-bb93-1f0bf4e9dffd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 400 to user: Block Device 5db37786-dc9f-435b-9b8b-f5f2fcbc565b is not bootable. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:17:32.820014 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5cf756f8-927b-4e87-bb93-1f0bf4e9dffd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.120327 Aug 04 17:17:32.820014 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2618/5193] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:17:32 2022] POST /compute/v2.1/servers => generated 110 bytes in 122 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:17:32.829967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-81b63796-669e-4dc8-bb7f-0f07cc061de1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:32.831164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-81b63796-669e-4dc8-bb7f-0f07cc061de1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:32.840015 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81b63796-669e-4dc8-bb7f-0f07cc061de1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:32.841497 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81b63796-669e-4dc8-bb7f-0f07cc061de1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:32.842245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81b63796-669e-4dc8-bb7f-0f07cc061de1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:32.843551 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81b63796-669e-4dc8-bb7f-0f07cc061de1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:32.844293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81b63796-669e-4dc8-bb7f-0f07cc061de1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:32.844885 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81b63796-669e-4dc8-bb7f-0f07cc061de1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:33.208801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-81b63796-669e-4dc8-bb7f-0f07cc061de1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:33.227825 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-81b63796-669e-4dc8-bb7f-0f07cc061de1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.400075 Aug 04 17:17:33.244884 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2576/5194] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:32 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:17:33.259740 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d8cc6278-9ffc-48e4-b866-e773d4f3cd42 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:33.260377 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d8cc6278-9ffc-48e4-b866-e773d4f3cd42 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:33.276923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8cc6278-9ffc-48e4-b866-e773d4f3cd42 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:33.278636 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8cc6278-9ffc-48e4-b866-e773d4f3cd42 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:33.280594 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8cc6278-9ffc-48e4-b866-e773d4f3cd42 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:33.283001 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8cc6278-9ffc-48e4-b866-e773d4f3cd42 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:33.286733 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8cc6278-9ffc-48e4-b866-e773d4f3cd42 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:33.287891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8cc6278-9ffc-48e4-b866-e773d4f3cd42 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:33.372744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3ef2fbc9-9248-4160-9c35-5169fc1b7c84 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:33.376093 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3ef2fbc9-9248-4160-9c35-5169fc1b7c84 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:33.392870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ef2fbc9-9248-4160-9c35-5169fc1b7c84 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:33.393969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ef2fbc9-9248-4160-9c35-5169fc1b7c84 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:33.394724 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ef2fbc9-9248-4160-9c35-5169fc1b7c84 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:33.396139 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ef2fbc9-9248-4160-9c35-5169fc1b7c84 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:33.396895 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ef2fbc9-9248-4160-9c35-5169fc1b7c84 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:33.397695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ef2fbc9-9248-4160-9c35-5169fc1b7c84 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:33.450005 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3ef2fbc9-9248-4160-9c35-5169fc1b7c84 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082901 Aug 04 17:17:33.450908 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2577/5195] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:17:33 2022] GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:17:33.635886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d8cc6278-9ffc-48e4-b866-e773d4f3cd42 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:33.646548 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d8cc6278-9ffc-48e4-b866-e773d4f3cd42 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.392425 Aug 04 17:17:33.647822 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2619/5196] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:33 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:34.467282 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3986447f-3762-45c7-8636-1b5d3f8f1369 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:34.470615 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3986447f-3762-45c7-8636-1b5d3f8f1369 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:34.488235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3986447f-3762-45c7-8636-1b5d3f8f1369 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:34.489691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3986447f-3762-45c7-8636-1b5d3f8f1369 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:34.490724 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3986447f-3762-45c7-8636-1b5d3f8f1369 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:34.491938 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3986447f-3762-45c7-8636-1b5d3f8f1369 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:34.492776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3986447f-3762-45c7-8636-1b5d3f8f1369 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:34.493795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3986447f-3762-45c7-8636-1b5d3f8f1369 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:34.543245 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3986447f-3762-45c7-8636-1b5d3f8f1369 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083447 Aug 04 17:17:34.545169 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2578/5197] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:17:34 2022] GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:34.836165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9e0de8cc-4a06-4117-b67f-307a06018af3 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:34.843555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9e0de8cc-4a06-4117-b67f-307a06018af3 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3544002a75c946cda1586cd21f999aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a334b70c2e46c087201aa6787accba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:34.845255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9e0de8cc-4a06-4117-b67f-307a06018af3 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Searching by: {'deleted': False, 'project_id': '95a334b70c2e46c087201aa6787accba'} {{(pid=131043) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:17:34.853909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e0de8cc-4a06-4117-b67f-307a06018af3 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:34.854839 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e0de8cc-4a06-4117-b67f-307a06018af3 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:34.855604 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e0de8cc-4a06-4117-b67f-307a06018af3 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:34.856810 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e0de8cc-4a06-4117-b67f-307a06018af3 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:34.857523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e0de8cc-4a06-4117-b67f-307a06018af3 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:34.858203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9e0de8cc-4a06-4117-b67f-307a06018af3 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:34.891592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.multi_cell_list [None req-9e0de8cc-4a06-4117-b67f-307a06018af3 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:17:34.932841 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9e0de8cc-4a06-4117-b67f-307a06018af3 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.102584 Aug 04 17:17:34.933985 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2620/5198] 10.222.0.93 () {58 vars in 1125 bytes} [Thu Aug 4 17:17:34 2022] GET /compute/v2.1/servers => generated 344 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:34.951135 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c1d66eb8-4a62-49c6-8319-71ef460b40a3 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:34.958476 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c1d66eb8-4a62-49c6-8319-71ef460b40a3 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3544002a75c946cda1586cd21f999aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a334b70c2e46c087201aa6787accba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:34.961311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c1d66eb8-4a62-49c6-8319-71ef460b40a3 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Searching by: {'deleted': False, 'project_id': '95a334b70c2e46c087201aa6787accba'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 17:17:34.969723 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c1d66eb8-4a62-49c6-8319-71ef460b40a3 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:34.972194 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c1d66eb8-4a62-49c6-8319-71ef460b40a3 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:34.973298 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c1d66eb8-4a62-49c6-8319-71ef460b40a3 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:34.974324 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c1d66eb8-4a62-49c6-8319-71ef460b40a3 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:34.975464 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c1d66eb8-4a62-49c6-8319-71ef460b40a3 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:34.977200 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c1d66eb8-4a62-49c6-8319-71ef460b40a3 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:35.015923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-c1d66eb8-4a62-49c6-8319-71ef460b40a3 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 17:17:35.036982 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:17:35.067814 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c1d66eb8-4a62-49c6-8319-71ef460b40a3 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544002a75c946cda1586cd21f999aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a334b70c2e46c087201aa6787accba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:35.076223 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c1d66eb8-4a62-49c6-8319-71ef460b40a3 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:35.076951 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c1d66eb8-4a62-49c6-8319-71ef460b40a3 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:35.077676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c1d66eb8-4a62-49c6-8319-71ef460b40a3 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:35.399097 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c1d66eb8-4a62-49c6-8319-71ef460b40a3 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/servers/detail" status: 200 len: 1607 microversion: 2.1 time: 0.454806 Aug 04 17:17:35.421588 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2579/5199] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 17:17:34 2022] GET /compute/v2.1/servers/detail => generated 1607 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:35.429521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-511bc466-6cab-43f4-9ea7-f395315bbc50 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:35.457711 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-511bc466-6cab-43f4-9ea7-f395315bbc50 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032369 Aug 04 17:17:35.465011 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2621/5200] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Aug 4 17:17:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:17:35.559579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-70136031-6bf6-4294-ac5a-30e3e667a8b4 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:35.562534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-70136031-6bf6-4294-ac5a-30e3e667a8b4 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:35.587222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70136031-6bf6-4294-ac5a-30e3e667a8b4 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:35.588123 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70136031-6bf6-4294-ac5a-30e3e667a8b4 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:35.588237 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70136031-6bf6-4294-ac5a-30e3e667a8b4 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:35.588860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70136031-6bf6-4294-ac5a-30e3e667a8b4 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:35.589318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70136031-6bf6-4294-ac5a-30e3e667a8b4 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:35.589765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70136031-6bf6-4294-ac5a-30e3e667a8b4 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:35.650357 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-70136031-6bf6-4294-ac5a-30e3e667a8b4 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097182 Aug 04 17:17:35.651032 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2580/5201] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:17:35 2022] GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:35.804906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ce4c7ab9-d51f-40db-b57b-6dce08c10d74 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:35.805333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ce4c7ab9-d51f-40db-b57b-6dce08c10d74 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:35.823056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:17:35.824658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ce4c7ab9-d51f-40db-b57b-6dce08c10d74 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:35.825164 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ce4c7ab9-d51f-40db-b57b-6dce08c10d74 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:35.825614 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ce4c7ab9-d51f-40db-b57b-6dce08c10d74 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:35.826509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ce4c7ab9-d51f-40db-b57b-6dce08c10d74 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:35.827132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ce4c7ab9-d51f-40db-b57b-6dce08c10d74 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:35.827564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ce4c7ab9-d51f-40db-b57b-6dce08c10d74 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:35.892374 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ce4c7ab9-d51f-40db-b57b-6dce08c10d74 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:17:36.041879 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ce4c7ab9-d51f-40db-b57b-6dce08c10d74 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2" status: 204 len: 0 microversion: 2.1 time: 0.240690 Aug 04 17:17:36.044587 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2622/5202] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:17:35 2022] DELETE /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:17:36.052544 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-189af273-e530-4326-8ca8-e96994ee6b76 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:36.054711 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-189af273-e530-4326-8ca8-e96994ee6b76 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:36.063816 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-189af273-e530-4326-8ca8-e96994ee6b76 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:36.065436 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-189af273-e530-4326-8ca8-e96994ee6b76 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:36.066315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-189af273-e530-4326-8ca8-e96994ee6b76 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:36.067486 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-189af273-e530-4326-8ca8-e96994ee6b76 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:36.069147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-189af273-e530-4326-8ca8-e96994ee6b76 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:36.069928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-189af273-e530-4326-8ca8-e96994ee6b76 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:36.354446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-189af273-e530-4326-8ca8-e96994ee6b76 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544002a75c946cda1586cd21f999aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a334b70c2e46c087201aa6787accba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:36.362360 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-189af273-e530-4326-8ca8-e96994ee6b76 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2" status: 200 len: 1610 microversion: 2.1 time: 0.313272 Aug 04 17:17:36.363588 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2581/5203] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:36 2022] GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2 => generated 1610 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:36.633670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9d3b57af-224e-4482-bf9a-bd764c81b83f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1089604220", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "destination_type": "local"}, {"source_type": "volume", "uuid": "d5e7fe21-c400-48e9-8a18-3c69ebeef87d", "destination_type": "invalid"}], "networks": [{"uuid": "f20ac3e7-ddd2-4167-bdf1-b8b75ff31772"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9d3b57af-224e-4482-bf9a-bd764c81b83f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 495 Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1089604220", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "destination_type": "local"}, {"source_type": "volume", "uuid": "d5e7fe21-c400-48e9-8a18-3c69ebeef87d", "destination_type": "invalid"}], "networks": [{"uuid": "f20ac3e7-ddd2-4167-bdf1-b8b75ff31772"}]}} Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1089604220', 'imageRef': '93ebc91d-2d7a-4ab2-b133-dcf9559166d9', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '93ebc91d-2d7a-4ab2-b133-dcf9559166d9', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'd5e7fe21-c400-48e9-8a18-3c69ebeef87d', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'f20ac3e7-ddd2-4167-bdf1-b8b75ff31772'}]}}} Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi 'invalid' Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:17:36.640696 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:17:36.644542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:17:36.644542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:17:36.644542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:17:36.644542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:17:36.644542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:17:36.644542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:17:36.644542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:17:36.644542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:17:36.644542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 04 17:17:36.644542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:36.644542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:36.644542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:36.644542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:36.644542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:36.644542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:36.644542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:17:36.644542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:17:36.644542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 04 17:17:36.644542 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:36.647392 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9d3b57af-224e-4482-bf9a-bd764c81b83f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:17:36.648760 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9d3b57af-224e-4482-bf9a-bd764c81b83f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.021259 Aug 04 17:17:36.650349 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2623/5204] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:17:36 2022] POST /compute/v2.1/servers => generated 155 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:17:36.670910 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8117e4c5-7b3a-4635-a4bb-637706f280e3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:36.676928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8117e4c5-7b3a-4635-a4bb-637706f280e3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:36.700092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5ffe6006-fc64-4590-8cea-579a2f8b591f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:36.703738 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8117e4c5-7b3a-4635-a4bb-637706f280e3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:36.705617 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5ffe6006-fc64-4590-8cea-579a2f8b591f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:36.706412 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8117e4c5-7b3a-4635-a4bb-637706f280e3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:36.707095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8117e4c5-7b3a-4635-a4bb-637706f280e3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:36.709766 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8117e4c5-7b3a-4635-a4bb-637706f280e3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:36.711164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8117e4c5-7b3a-4635-a4bb-637706f280e3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:36.713789 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8117e4c5-7b3a-4635-a4bb-637706f280e3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:36.731534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ffe6006-fc64-4590-8cea-579a2f8b591f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:36.732625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ffe6006-fc64-4590-8cea-579a2f8b591f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:36.733326 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ffe6006-fc64-4590-8cea-579a2f8b591f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:36.734494 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ffe6006-fc64-4590-8cea-579a2f8b591f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:36.735266 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ffe6006-fc64-4590-8cea-579a2f8b591f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:36.735922 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ffe6006-fc64-4590-8cea-579a2f8b591f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:36.773002 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5ffe6006-fc64-4590-8cea-579a2f8b591f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086587 Aug 04 17:17:36.774311 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2624/5205] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:17:36 2022] GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:36.933047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8117e4c5-7b3a-4635-a4bb-637706f280e3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:36.949722 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8117e4c5-7b3a-4635-a4bb-637706f280e3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.290977 Aug 04 17:17:36.951325 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2582/5206] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:36 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:36.976209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c6b67eee-d3cb-4de0-848a-f310f5d10257 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:36.977007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c6b67eee-d3cb-4de0-848a-f310f5d10257 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:36.992804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6b67eee-d3cb-4de0-848a-f310f5d10257 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:36.993767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6b67eee-d3cb-4de0-848a-f310f5d10257 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:36.994499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6b67eee-d3cb-4de0-848a-f310f5d10257 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:36.996662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6b67eee-d3cb-4de0-848a-f310f5d10257 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:36.999566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6b67eee-d3cb-4de0-848a-f310f5d10257 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:37.000273 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6b67eee-d3cb-4de0-848a-f310f5d10257 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:37.278150 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c6b67eee-d3cb-4de0-848a-f310f5d10257 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:37.288740 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c6b67eee-d3cb-4de0-848a-f310f5d10257 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.317258 Aug 04 17:17:37.292788 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2625/5207] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:36 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:37.400739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2a684819-ad62-40f1-97d4-48783a30c179 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:37.402082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2a684819-ad62-40f1-97d4-48783a30c179 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:37.440739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a684819-ad62-40f1-97d4-48783a30c179 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:37.446516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a684819-ad62-40f1-97d4-48783a30c179 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:37.449542 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a684819-ad62-40f1-97d4-48783a30c179 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:37.453434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a684819-ad62-40f1-97d4-48783a30c179 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:37.454248 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a684819-ad62-40f1-97d4-48783a30c179 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:37.454995 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a684819-ad62-40f1-97d4-48783a30c179 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:37.676033 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fe496c9c-f07d-42b5-858b-6cc6ad8efa01 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1914604608", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "f20ac3e7-ddd2-4167-bdf1-b8b75ff31772"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fe496c9c-f07d-42b5-858b-6cc6ad8efa01 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 492 Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1914604608", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "f20ac3e7-ddd2-4167-bdf1-b8b75ff31772"}]}} Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1914604608', 'imageRef': '93ebc91d-2d7a-4ab2-b133-dcf9559166d9', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'f20ac3e7-ddd2-4167-bdf1-b8b75ff31772'}]}}} Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:37.680634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 04 17:17:37.684426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 04 17:17:37.684426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:37.684426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:37.684426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:37.684426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:37.684426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:37.684426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:37.684426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:17:37.684426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:17:37.684426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:17:37.684426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:17:37.684426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:17:37.684426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:17:37.684426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:17:37.684426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:17:37.684426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:17:37.684426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:17:37.684426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:17:37.684426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:17:37.684426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 04 17:17:37.684426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:37.684426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:37.684426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:37.684426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:37.684426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:37.684426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:37.684426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:17:37.684426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:17:37.684426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 04 17:17:37.684426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:37.689712 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fe496c9c-f07d-42b5-858b-6cc6ad8efa01 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:17:37.696959 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fe496c9c-f07d-42b5-858b-6cc6ad8efa01 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.024887 Aug 04 17:17:37.701488 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2626/5208] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:17:37 2022] POST /compute/v2.1/servers => generated 624 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:17:37.722474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-25ef9e57-5a4d-4468-b173-3d571d02bd69 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:37.726354 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-25ef9e57-5a4d-4468-b173-3d571d02bd69 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:37.744932 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25ef9e57-5a4d-4468-b173-3d571d02bd69 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:37.747461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25ef9e57-5a4d-4468-b173-3d571d02bd69 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:37.748123 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25ef9e57-5a4d-4468-b173-3d571d02bd69 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:37.751577 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25ef9e57-5a4d-4468-b173-3d571d02bd69 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:37.753021 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25ef9e57-5a4d-4468-b173-3d571d02bd69 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:37.754966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25ef9e57-5a4d-4468-b173-3d571d02bd69 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:38.008245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2a684819-ad62-40f1-97d4-48783a30c179 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544002a75c946cda1586cd21f999aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a334b70c2e46c087201aa6787accba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:38.027536 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2a684819-ad62-40f1-97d4-48783a30c179 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2" status: 200 len: 1610 microversion: 2.1 time: 0.630485 Aug 04 17:17:38.028953 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2583/5209] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:37 2022] GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2 => generated 1610 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:38.039195 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f411d619-4083-4c8b-b6c7-def2530047b9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:38.053739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f411d619-4083-4c8b-b6c7-def2530047b9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:38.061151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f411d619-4083-4c8b-b6c7-def2530047b9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:38.061876 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f411d619-4083-4c8b-b6c7-def2530047b9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:38.062506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f411d619-4083-4c8b-b6c7-def2530047b9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:38.065236 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f411d619-4083-4c8b-b6c7-def2530047b9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:38.066044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f411d619-4083-4c8b-b6c7-def2530047b9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:38.069784 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f411d619-4083-4c8b-b6c7-def2530047b9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:38.135428 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f411d619-4083-4c8b-b6c7-def2530047b9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104637 Aug 04 17:17:38.136418 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2584/5210] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:17:38 2022] GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:38.213152 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-25ef9e57-5a4d-4468-b173-3d571d02bd69 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:38.224107 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-25ef9e57-5a4d-4468-b173-3d571d02bd69 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.518355 Aug 04 17:17:38.225965 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2627/5211] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:37 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:17:38.258567 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f7509f99-6b77-4da1-a931-e5936dc94543 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:38.259213 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f7509f99-6b77-4da1-a931-e5936dc94543 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:38.269477 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7509f99-6b77-4da1-a931-e5936dc94543 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:38.270591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7509f99-6b77-4da1-a931-e5936dc94543 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:38.271234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7509f99-6b77-4da1-a931-e5936dc94543 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:38.272539 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7509f99-6b77-4da1-a931-e5936dc94543 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:38.273475 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7509f99-6b77-4da1-a931-e5936dc94543 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:38.274173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7509f99-6b77-4da1-a931-e5936dc94543 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:38.567555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f7509f99-6b77-4da1-a931-e5936dc94543 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:38.581902 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f7509f99-6b77-4da1-a931-e5936dc94543 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.327673 Aug 04 17:17:38.585574 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2585/5212] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:38 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:38.805890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-da866577-b7fa-4fe9-a569-bd892b4e6fb3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "f20ac3e7-ddd2-4167-bdf1-b8b75ff31772"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:38.806420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c2027d08-a419-4fa2-bb65-6438a84f2d5a tempest-VolumesTestJSON-1709760491 tempest-VolumesTestJSON-1709760491-project] Calling method '.version_select at 0x7f1e5b5b8670>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-da866577-b7fa-4fe9-a569-bd892b4e6fb3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 416 Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "f20ac3e7-ddd2-4167-bdf1-b8b75ff31772"}]}} Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '93ebc91d-2d7a-4ab2-b133-dcf9559166d9', 'flavorRef': '452', 'networks': [{'uuid': 'f20ac3e7-ddd2-4167-bdf1-b8b75ff31772'}]}}} Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:38.813799 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:38.817442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:38.817442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:38.817442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:38.817442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:38.817442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:17:38.817442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:17:38.817442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:17:38.817442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:17:38.817442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:17:38.817442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:17:38.817442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:17:38.817442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:17:38.817442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:17:38.817442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:17:38.817442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:17:38.817442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:17:38.817442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 17:17:38.817442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:38.817442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:38.817442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:38.817442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:38.817442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:38.817442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:38.817442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:17:38.817442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:17:38.817442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 17:17:38.817442 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:38.817442 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-da866577-b7fa-4fe9-a569-bd892b4e6fb3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:17:38.820001 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-da866577-b7fa-4fe9-a569-bd892b4e6fb3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.022785 Aug 04 17:17:38.820001 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2628/5213] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:17:38 2022] POST /compute/v2.1/servers => generated 619 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:17:38.844711 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c752fc08-45dc-4bef-89c0-47c008dea502 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:38.845400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c752fc08-45dc-4bef-89c0-47c008dea502 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:38.876819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c752fc08-45dc-4bef-89c0-47c008dea502 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:38.877345 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c752fc08-45dc-4bef-89c0-47c008dea502 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:38.877803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c752fc08-45dc-4bef-89c0-47c008dea502 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:38.878564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c752fc08-45dc-4bef-89c0-47c008dea502 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:38.883098 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c752fc08-45dc-4bef-89c0-47c008dea502 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:38.883678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c752fc08-45dc-4bef-89c0-47c008dea502 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:38.917008 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c2027d08-a419-4fa2-bb65-6438a84f2d5a tempest-VolumesTestJSON-1709760491 tempest-VolumesTestJSON-1709760491-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/40acb323-2810-4a84-989e-75cf5db07f7e" status: 200 len: 351 microversion: 2.1 time: 0.114363 Aug 04 17:17:38.928302 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2586/5214] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Aug 4 17:17:38 2022] GET /compute/v2.1/os-volumes/40acb323-2810-4a84-989e-75cf5db07f7e => generated 351 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:39.049073 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0f2419fb-ec2d-484a-b29b-65c571eae896 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:39.050672 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0f2419fb-ec2d-484a-b29b-65c571eae896 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:39.065670 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f2419fb-ec2d-484a-b29b-65c571eae896 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:39.075011 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f2419fb-ec2d-484a-b29b-65c571eae896 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:39.076058 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f2419fb-ec2d-484a-b29b-65c571eae896 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:39.078662 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f2419fb-ec2d-484a-b29b-65c571eae896 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:39.082845 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f2419fb-ec2d-484a-b29b-65c571eae896 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:39.095575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f2419fb-ec2d-484a-b29b-65c571eae896 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:39.885754 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c752fc08-45dc-4bef-89c0-47c008dea502 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:39.905080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0f2419fb-ec2d-484a-b29b-65c571eae896 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544002a75c946cda1586cd21f999aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a334b70c2e46c087201aa6787accba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:39.918582 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c752fc08-45dc-4bef-89c0-47c008dea502 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 1.094077 Aug 04 17:17:39.923433 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0f2419fb-ec2d-484a-b29b-65c571eae896 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2" status: 200 len: 1610 microversion: 2.1 time: 0.878440 Aug 04 17:17:39.930067 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2629/5215] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:38 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:17:39.942805 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2587/5216] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:39 2022] GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2 => generated 1610 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:39.960503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ed686a87-ec8d-4d47-8d1a-673fe0501e7a tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:39.964483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dc916351-497b-48d7-93f2-a6f8add924df tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:39.968210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dc916351-497b-48d7-93f2-a6f8add924df tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:39.972428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ed686a87-ec8d-4d47-8d1a-673fe0501e7a tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:40.003893 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc916351-497b-48d7-93f2-a6f8add924df tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:40.012533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc916351-497b-48d7-93f2-a6f8add924df tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:40.014146 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed686a87-ec8d-4d47-8d1a-673fe0501e7a tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:40.015579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc916351-497b-48d7-93f2-a6f8add924df tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:40.023859 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc916351-497b-48d7-93f2-a6f8add924df tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:40.025708 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed686a87-ec8d-4d47-8d1a-673fe0501e7a tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:40.031247 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc916351-497b-48d7-93f2-a6f8add924df tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:40.032698 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed686a87-ec8d-4d47-8d1a-673fe0501e7a tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:40.035676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc916351-497b-48d7-93f2-a6f8add924df tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:40.036741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed686a87-ec8d-4d47-8d1a-673fe0501e7a tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:40.038443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed686a87-ec8d-4d47-8d1a-673fe0501e7a tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:40.045868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed686a87-ec8d-4d47-8d1a-673fe0501e7a tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:40.205511 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ed686a87-ec8d-4d47-8d1a-673fe0501e7a tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.273671 Aug 04 17:17:40.206475 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2630/5217] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:17:39 2022] GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee/os-volume_attachments => generated 25 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:17:40.301855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5594dfd0-1b5a-45ce-aeb6-783e29fd5d54 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:40.303248 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5594dfd0-1b5a-45ce-aeb6-783e29fd5d54 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:40.315754 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5594dfd0-1b5a-45ce-aeb6-783e29fd5d54 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:40.323388 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5594dfd0-1b5a-45ce-aeb6-783e29fd5d54 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:40.324638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5594dfd0-1b5a-45ce-aeb6-783e29fd5d54 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:40.328948 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5594dfd0-1b5a-45ce-aeb6-783e29fd5d54 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:40.329786 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5594dfd0-1b5a-45ce-aeb6-783e29fd5d54 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:40.331372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5594dfd0-1b5a-45ce-aeb6-783e29fd5d54 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:40.413840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5594dfd0-1b5a-45ce-aeb6-783e29fd5d54 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:17:40.712360 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5594dfd0-1b5a-45ce-aeb6-783e29fd5d54 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "DELETE /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee" status: 204 len: 0 microversion: 2.1 time: 0.416663 Aug 04 17:17:40.713995 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2631/5218] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:17:40 2022] DELETE /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 17:17:40.723273 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-05689c92-f272-46a2-870e-dec593f8d57b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:40.726887 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-05689c92-f272-46a2-870e-dec593f8d57b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:40.736423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05689c92-f272-46a2-870e-dec593f8d57b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:40.737277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05689c92-f272-46a2-870e-dec593f8d57b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:40.738008 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05689c92-f272-46a2-870e-dec593f8d57b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:40.739136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05689c92-f272-46a2-870e-dec593f8d57b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:40.739899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05689c92-f272-46a2-870e-dec593f8d57b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:40.740592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05689c92-f272-46a2-870e-dec593f8d57b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:41.207480 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dc916351-497b-48d7-93f2-a6f8add924df tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:41.227235 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dc916351-497b-48d7-93f2-a6f8add924df tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 1.275853 Aug 04 17:17:41.229013 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2588/5219] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:39 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:41.238639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-34726d5e-fb9b-4b89-a41a-fff94b439256 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:41.243158 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-34726d5e-fb9b-4b89-a41a-fff94b439256 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:41.256947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34726d5e-fb9b-4b89-a41a-fff94b439256 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:41.257653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34726d5e-fb9b-4b89-a41a-fff94b439256 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:41.258867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34726d5e-fb9b-4b89-a41a-fff94b439256 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:41.260152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34726d5e-fb9b-4b89-a41a-fff94b439256 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:41.260974 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34726d5e-fb9b-4b89-a41a-fff94b439256 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:41.262010 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34726d5e-fb9b-4b89-a41a-fff94b439256 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:41.284823 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-05689c92-f272-46a2-870e-dec593f8d57b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:41.297275 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-05689c92-f272-46a2-870e-dec593f8d57b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee" status: 200 len: 1681 microversion: 2.1 time: 0.579084 Aug 04 17:17:41.298239 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2632/5220] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:40 2022] GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee => generated 1681 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:41.412568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cb835a26-2823-4cb6-a98c-cd455c2bbc2f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1763178944", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": -1, "networks": [{"uuid": "f20ac3e7-ddd2-4167-bdf1-b8b75ff31772"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:41.418782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-34726d5e-fb9b-4b89-a41a-fff94b439256 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544002a75c946cda1586cd21f999aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a334b70c2e46c087201aa6787accba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:41.428089 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-cb835a26-2823-4cb6-a98c-cd455c2bbc2f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Flavor -1 could not be found. Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cb835a26-2823-4cb6-a98c-cd455c2bbc2f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 206 Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1763178944", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": -1, "networks": [{"uuid": "f20ac3e7-ddd2-4167-bdf1-b8b75ff31772"}]}} Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: exception: Flavor -1 could not be found. Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1763178944', 'imageRef': '93ebc91d-2d7a-4ab2-b133-dcf9559166d9', 'flavorRef': -1, 'networks': [{'uuid': 'f20ac3e7-ddd2-4167-bdf1-b8b75ff31772'}]}}} Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:17:41.431407 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:17:41.435497 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:17:41.435497 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:17:41.435497 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:17:41.435497 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:17:41.435497 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 17:17:41.435497 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 04 17:17:41.435497 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 04 17:17:41.435497 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 04 17:17:41.435497 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:41.435497 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:41.435497 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:41.435497 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:41.435497 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:41.435497 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:41.435497 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:17:41.435497 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:17:41.435497 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 04 17:17:41.435497 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:41.439629 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cb835a26-2823-4cb6-a98c-cd455c2bbc2f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:17:41.440438 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-34726d5e-fb9b-4b89-a41a-fff94b439256 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2" status: 200 len: 1542 microversion: 2.1 time: 0.208726 Aug 04 17:17:41.441122 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2589/5221] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:41 2022] GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2 => generated 1542 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:41.442062 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cb835a26-2823-4cb6-a98c-cd455c2bbc2f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.032669 Aug 04 17:17:41.444561 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2633/5222] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:17:41 2022] POST /compute/v2.1/servers => generated 73 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 04 17:17:41.464874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4c5a4ee0-ae89-4cab-a234-bb0476e608a6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:41.467081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4c5a4ee0-ae89-4cab-a234-bb0476e608a6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:41.480112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c5a4ee0-ae89-4cab-a234-bb0476e608a6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:41.480632 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c5a4ee0-ae89-4cab-a234-bb0476e608a6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:41.481083 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c5a4ee0-ae89-4cab-a234-bb0476e608a6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:41.482704 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c5a4ee0-ae89-4cab-a234-bb0476e608a6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:41.484071 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c5a4ee0-ae89-4cab-a234-bb0476e608a6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:41.487056 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c5a4ee0-ae89-4cab-a234-bb0476e608a6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:41.655774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-d3a6d2a4-3cfc-4e07-a97e-ed67f409c0c7 req-6e61a94a-3f59-496c-871c-8d3dbf453481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b49ca99e-4a64-4d5d-aeb8-f61760944ce2", "name": "network-vif-deleted", "tag": "0427cc5e-0bd3-4508-b821-5cc6d9a8ed83"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:41.684564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d3a6d2a4-3cfc-4e07-a97e-ed67f409c0c7 req-6e61a94a-3f59-496c-871c-8d3dbf453481 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:41.695895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d3a6d2a4-3cfc-4e07-a97e-ed67f409c0c7 req-6e61a94a-3f59-496c-871c-8d3dbf453481 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:41.698224 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d3a6d2a4-3cfc-4e07-a97e-ed67f409c0c7 req-6e61a94a-3f59-496c-871c-8d3dbf453481 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:41.730804 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-d3a6d2a4-3cfc-4e07-a97e-ed67f409c0c7 req-6e61a94a-3f59-496c-871c-8d3dbf453481 service nova] Creating event network-vif-deleted:0427cc5e-0bd3-4508-b821-5cc6d9a8ed83 for instance b49ca99e-4a64-4d5d-aeb8-f61760944ce2 on n-h1-851359-3 Aug 04 17:17:41.753477 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-d3a6d2a4-3cfc-4e07-a97e-ed67f409c0c7 req-6e61a94a-3f59-496c-871c-8d3dbf453481 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103209 Aug 04 17:17:41.754443 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2634/5223] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:17:41.867260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-308d4266-f0f5-4698-b717-284313185d61 tempest-VolumesTestJSON-1709760491 tempest-VolumesTestJSON-1709760491-project] Calling method '.version_select at 0x7f1e6c9ada60>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:42.039575 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-308d4266-f0f5-4698-b717-284313185d61 tempest-VolumesTestJSON-1709760491 tempest-VolumesTestJSON-1709760491-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/861460bb-20a8-49e8-820b-2a1cae9e6d25" status: 200 len: 351 microversion: 2.1 time: 0.177780 Aug 04 17:17:42.047969 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2635/5224] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Aug 4 17:17:41 2022] GET /compute/v2.1/os-volumes/861460bb-20a8-49e8-820b-2a1cae9e6d25 => generated 351 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:42.064157 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4c5a4ee0-ae89-4cab-a234-bb0476e608a6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:42.074417 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4c5a4ee0-ae89-4cab-a234-bb0476e608a6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.625042 Aug 04 17:17:42.078520 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2590/5225] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:41 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:42.102437 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-224413af-2f1e-4fb8-859e-3e637f1cc552 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:42.103447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-224413af-2f1e-4fb8-859e-3e637f1cc552 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:42.131643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-224413af-2f1e-4fb8-859e-3e637f1cc552 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:42.132289 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-224413af-2f1e-4fb8-859e-3e637f1cc552 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:42.134828 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-224413af-2f1e-4fb8-859e-3e637f1cc552 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:42.138546 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-224413af-2f1e-4fb8-859e-3e637f1cc552 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:42.139061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-224413af-2f1e-4fb8-859e-3e637f1cc552 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:42.141878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-224413af-2f1e-4fb8-859e-3e637f1cc552 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:42.319599 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-26470d0b-107f-4668-a3bc-6076764763d9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:42.321070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-26470d0b-107f-4668-a3bc-6076764763d9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:42.338651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26470d0b-107f-4668-a3bc-6076764763d9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:42.340131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26470d0b-107f-4668-a3bc-6076764763d9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:42.342168 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26470d0b-107f-4668-a3bc-6076764763d9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:42.343473 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26470d0b-107f-4668-a3bc-6076764763d9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:42.348977 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26470d0b-107f-4668-a3bc-6076764763d9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:42.350006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26470d0b-107f-4668-a3bc-6076764763d9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:42.632006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-224413af-2f1e-4fb8-859e-3e637f1cc552 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:42.646848 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-224413af-2f1e-4fb8-859e-3e637f1cc552 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.548721 Aug 04 17:17:42.648839 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2636/5226] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:42 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:42.662516 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-50e4bc1e-141c-49d7-9706-0a9db742d03b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:42.669619 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-50e4bc1e-141c-49d7-9706-0a9db742d03b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:42.687003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50e4bc1e-141c-49d7-9706-0a9db742d03b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:42.691622 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50e4bc1e-141c-49d7-9706-0a9db742d03b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:42.692221 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50e4bc1e-141c-49d7-9706-0a9db742d03b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:42.693088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50e4bc1e-141c-49d7-9706-0a9db742d03b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:42.694421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50e4bc1e-141c-49d7-9706-0a9db742d03b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:42.697583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50e4bc1e-141c-49d7-9706-0a9db742d03b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:42.741149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-26470d0b-107f-4668-a3bc-6076764763d9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:42.750003 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-26470d0b-107f-4668-a3bc-6076764763d9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee" status: 200 len: 1681 microversion: 2.1 time: 0.434563 Aug 04 17:17:42.751254 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2591/5227] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:42 2022] GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee => generated 1681 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:17:42.857391 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-50e4bc1e-141c-49d7-9706-0a9db742d03b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544002a75c946cda1586cd21f999aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a334b70c2e46c087201aa6787accba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:42.868051 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-50e4bc1e-141c-49d7-9706-0a9db742d03b tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2" status: 200 len: 1253 microversion: 2.1 time: 0.214701 Aug 04 17:17:42.878615 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2637/5228] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:42 2022] GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2 => generated 1253 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:42.917336 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-85000b84-5e93-45c5-b3fe-4519c84f5758 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1708102253", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "f20ac3e7-ddd2-4167-bdf1-b8b75ff31772"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-85000b84-5e93-45c5-b3fe-4519c84f5758 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 173 Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1708102253", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "f20ac3e7-ddd2-4167-bdf1-b8b75ff31772"}]}} Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1708102253', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'f20ac3e7-ddd2-4167-bdf1-b8b75ff31772'}]}}} Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi -1 Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:17:42.922382 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:17:42.927411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:17:42.927411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:17:42.927411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 04 17:17:42.927411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:17:42.927411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:42.927411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:17:42.927411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:42.927411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:42.927411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:42.927411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:17:42.927411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:17:42.927411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 04 17:17:42.927411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:17:42.929265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-85000b84-5e93-45c5-b3fe-4519c84f5758 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:17:42.930405 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-85000b84-5e93-45c5-b3fe-4519c84f5758 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.018713 Aug 04 17:17:42.931797 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2592/5229] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:17:42 2022] POST /compute/v2.1/servers => generated 145 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:17:42.944227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8e0e039e-9db4-4601-818c-57a1eccae2e7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:42.945151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8e0e039e-9db4-4601-818c-57a1eccae2e7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:42.958202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e0e039e-9db4-4601-818c-57a1eccae2e7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:42.959941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e0e039e-9db4-4601-818c-57a1eccae2e7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:42.960578 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e0e039e-9db4-4601-818c-57a1eccae2e7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:42.963581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e0e039e-9db4-4601-818c-57a1eccae2e7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:42.964534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e0e039e-9db4-4601-818c-57a1eccae2e7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:42.965154 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e0e039e-9db4-4601-818c-57a1eccae2e7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:42.977689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:17:43.522525 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-45d18259-22bf-4025-baef-b81146992e55 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:43.523293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-45d18259-22bf-4025-baef-b81146992e55 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:43.541219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45d18259-22bf-4025-baef-b81146992e55 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:43.548888 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45d18259-22bf-4025-baef-b81146992e55 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:43.550767 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45d18259-22bf-4025-baef-b81146992e55 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:43.552500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45d18259-22bf-4025-baef-b81146992e55 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:43.556045 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45d18259-22bf-4025-baef-b81146992e55 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:43.565686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45d18259-22bf-4025-baef-b81146992e55 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:44.392041 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8e0e039e-9db4-4601-818c-57a1eccae2e7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:44.410629 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8e0e039e-9db4-4601-818c-57a1eccae2e7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 1.472174 Aug 04 17:17:44.430789 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2638/5230] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:42 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:44.437835 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d8b83b39-717f-47b5-9644-93a25d14512f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:44.438846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d8b83b39-717f-47b5-9644-93a25d14512f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:44.453964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8b83b39-717f-47b5-9644-93a25d14512f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:44.454801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8b83b39-717f-47b5-9644-93a25d14512f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:44.455474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8b83b39-717f-47b5-9644-93a25d14512f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:44.456442 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8b83b39-717f-47b5-9644-93a25d14512f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:44.458733 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8b83b39-717f-47b5-9644-93a25d14512f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:44.460131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8b83b39-717f-47b5-9644-93a25d14512f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:44.865890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:17:44.995043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:17:45.063059 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:17:45.210809 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d8b83b39-717f-47b5-9644-93a25d14512f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:45.221937 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d8b83b39-717f-47b5-9644-93a25d14512f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee" status: 200 len: 1681 microversion: 2.1 time: 0.789703 Aug 04 17:17:45.224623 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2639/5231] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:44 2022] GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee => generated 1681 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:45.241728 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6a730655-04b7-42ab-93c1-840f00d985c1 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:45.242468 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6a730655-04b7-42ab-93c1-840f00d985c1 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:45.253576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a730655-04b7-42ab-93c1-840f00d985c1 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:45.260621 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a730655-04b7-42ab-93c1-840f00d985c1 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:45.261628 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a730655-04b7-42ab-93c1-840f00d985c1 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:45.262724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a730655-04b7-42ab-93c1-840f00d985c1 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:45.263498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a730655-04b7-42ab-93c1-840f00d985c1 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:45.264205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a730655-04b7-42ab-93c1-840f00d985c1 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:45.313076 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-45d18259-22bf-4025-baef-b81146992e55 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1834 microversion: 2.1 time: 1.791856 Aug 04 17:17:45.316984 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2593/5232] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:43 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1834 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:17:45.344042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5ee8233d-8d7d-4299-92ac-1530021e805a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:45.344827 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5ee8233d-8d7d-4299-92ac-1530021e805a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:45.366310 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ee8233d-8d7d-4299-92ac-1530021e805a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:45.367273 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ee8233d-8d7d-4299-92ac-1530021e805a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:45.367732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ee8233d-8d7d-4299-92ac-1530021e805a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:45.370680 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ee8233d-8d7d-4299-92ac-1530021e805a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:45.372280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ee8233d-8d7d-4299-92ac-1530021e805a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:45.373454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ee8233d-8d7d-4299-92ac-1530021e805a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:45.434209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6a730655-04b7-42ab-93c1-840f00d985c1 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544002a75c946cda1586cd21f999aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a334b70c2e46c087201aa6787accba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:45.451724 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6a730655-04b7-42ab-93c1-840f00d985c1 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2" status: 200 len: 1253 microversion: 2.1 time: 0.219930 Aug 04 17:17:45.453338 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2640/5233] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:45 2022] GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2 => generated 1253 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:45.461745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e0f82ce1-9855-43f5-955d-84584588a627 tempest-VolumesTestJSON-1709760491 tempest-VolumesTestJSON-1709760491-project] Calling method '.version_select at 0x7f1e5bb11e50>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:45.584336 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e0f82ce1-9855-43f5-955d-84584588a627 tempest-VolumesTestJSON-1709760491 tempest-VolumesTestJSON-1709760491-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/af2a9940-ce69-45b1-ba67-3a585dff82c7" status: 200 len: 350 microversion: 2.1 time: 0.129170 Aug 04 17:17:45.585498 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2641/5234] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Aug 4 17:17:45 2022] GET /compute/v2.1/os-volumes/af2a9940-ce69-45b1-ba67-3a585dff82c7 => generated 350 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:45.604275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-af4d0fb4-14b6-46e1-9155-0768075b293e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:45.605665 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-af4d0fb4-14b6-46e1-9155-0768075b293e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:45.614724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af4d0fb4-14b6-46e1-9155-0768075b293e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:45.616188 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af4d0fb4-14b6-46e1-9155-0768075b293e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:45.616829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af4d0fb4-14b6-46e1-9155-0768075b293e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:45.617762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af4d0fb4-14b6-46e1-9155-0768075b293e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:45.618491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af4d0fb4-14b6-46e1-9155-0768075b293e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:45.619172 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af4d0fb4-14b6-46e1-9155-0768075b293e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:45.887811 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5ee8233d-8d7d-4299-92ac-1530021e805a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:45.918792 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5ee8233d-8d7d-4299-92ac-1530021e805a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.598844 Aug 04 17:17:45.922475 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2594/5235] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:45 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:45.939027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-28ed6887-19b5-47b4-af67-4d7c47cd6773 tempest-VolumesTestJSON-1709760491 tempest-VolumesTestJSON-1709760491-project] Calling method '.version_select at 0x7f1e5b9489d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:46.037268 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-af4d0fb4-14b6-46e1-9155-0768075b293e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:46.049912 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-af4d0fb4-14b6-46e1-9155-0768075b293e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1683 microversion: 2.1 time: 0.461969 Aug 04 17:17:46.050753 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2642/5236] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:45 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1683 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:46.174919 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-28ed6887-19b5-47b4-af67-4d7c47cd6773 tempest-VolumesTestJSON-1709760491 tempest-VolumesTestJSON-1709760491-project] 10.222.0.93 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.250566 Aug 04 17:17:46.177285 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2595/5237] 10.222.0.93 () {58 vars in 1134 bytes} [Thu Aug 4 17:17:45 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:46.195564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3ac55bfb-0170-4c88-9083-266f4599462c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-647211635", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:46.197344 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b9a94ca3-6fae-4207-bf91-db18b51ac1b8 tempest-VolumesTestJSON-1709760491 tempest-VolumesTestJSON-1709760491-project] Calling method '.version_select at 0x7f1e5aa84b80>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:46.203836 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-3ac55bfb-0170-4c88-9083-266f4599462c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3ac55bfb-0170-4c88-9083-266f4599462c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 215 Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-647211635", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-647211635', 'imageRef': '93ebc91d-2d7a-4ab2-b133-dcf9559166d9', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:46.213263 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:46.218658 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:46.218658 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:46.218658 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:46.218658 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:17:46.218658 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:17:46.218658 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 04 17:17:46.218658 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:46.218658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3ac55bfb-0170-4c88-9083-266f4599462c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:17:46.221134 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3ac55bfb-0170-4c88-9083-266f4599462c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.031088 Aug 04 17:17:46.222234 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2643/5238] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:17:46 2022] POST /compute/v2.1/servers => generated 123 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:17:46.231212 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-69f192ef-b431-4c06-9c16-c5e714b77e95 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:46.231840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-69f192ef-b431-4c06-9c16-c5e714b77e95 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:46.261349 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-69f192ef-b431-4c06-9c16-c5e714b77e95 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:46.264773 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-69f192ef-b431-4c06-9c16-c5e714b77e95 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:46.265221 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-69f192ef-b431-4c06-9c16-c5e714b77e95 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:46.271678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-69f192ef-b431-4c06-9c16-c5e714b77e95 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:46.272416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-69f192ef-b431-4c06-9c16-c5e714b77e95 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:46.273026 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-69f192ef-b431-4c06-9c16-c5e714b77e95 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:46.414448 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b9a94ca3-6fae-4207-bf91-db18b51ac1b8 tempest-VolumesTestJSON-1709760491 tempest-VolumesTestJSON-1709760491-project] 10.222.0.93 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.224514 Aug 04 17:17:46.415409 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2596/5239] 10.222.0.93 () {58 vars in 1149 bytes} [Thu Aug 4 17:17:46 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:46.422301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3b5a7f26-ca9d-4f97-bd99-9a5369d38a4e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:46.424039 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3b5a7f26-ca9d-4f97-bd99-9a5369d38a4e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:46.445765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b5a7f26-ca9d-4f97-bd99-9a5369d38a4e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:46.446535 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b5a7f26-ca9d-4f97-bd99-9a5369d38a4e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:46.448509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b5a7f26-ca9d-4f97-bd99-9a5369d38a4e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:46.451405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b5a7f26-ca9d-4f97-bd99-9a5369d38a4e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:46.452112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b5a7f26-ca9d-4f97-bd99-9a5369d38a4e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:46.455201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b5a7f26-ca9d-4f97-bd99-9a5369d38a4e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:46.687773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3b5a7f26-ca9d-4f97-bd99-9a5369d38a4e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:46.699650 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3b5a7f26-ca9d-4f97-bd99-9a5369d38a4e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee" status: 200 len: 1613 microversion: 2.1 time: 0.282680 Aug 04 17:17:46.703184 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2597/5240] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:46 2022] GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee => generated 1613 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:46.727839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3938d135-e2dc-4e0b-bbb9-ab32620f98bd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:46.735119 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3938d135-e2dc-4e0b-bbb9-ab32620f98bd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:46.749187 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3938d135-e2dc-4e0b-bbb9-ab32620f98bd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:46.749693 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3938d135-e2dc-4e0b-bbb9-ab32620f98bd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:46.751476 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3938d135-e2dc-4e0b-bbb9-ab32620f98bd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:46.752214 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3938d135-e2dc-4e0b-bbb9-ab32620f98bd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:46.752688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3938d135-e2dc-4e0b-bbb9-ab32620f98bd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:46.753690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3938d135-e2dc-4e0b-bbb9-ab32620f98bd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:46.802182 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-69f192ef-b431-4c06-9c16-c5e714b77e95 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:46.816944 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-69f192ef-b431-4c06-9c16-c5e714b77e95 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.589969 Aug 04 17:17:46.819756 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2644/5241] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:46 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:46.854044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d4fc851d-1feb-430f-94c9-884ff8e2095f tempest-VolumesTestJSON-1709760491 tempest-VolumesTestJSON-1709760491-project] Calling method '.version_select at 0x7f1e5aedfb80>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:46.891160 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3938d135-e2dc-4e0b-bbb9-ab32620f98bd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "POST /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0/action" status: 200 len: 32630 microversion: 2.1 time: 0.186207 Aug 04 17:17:46.892968 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2598/5242] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:17:46 2022] POST /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0/action => generated 32630 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:17:46.902041 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e6786520-15e3-466e-bb22-865dffa73374 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:46.903270 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e6786520-15e3-466e-bb22-865dffa73374 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:46.913458 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6786520-15e3-466e-bb22-865dffa73374 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:46.914533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6786520-15e3-466e-bb22-865dffa73374 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:46.915750 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6786520-15e3-466e-bb22-865dffa73374 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:46.916742 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6786520-15e3-466e-bb22-865dffa73374 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:46.917364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6786520-15e3-466e-bb22-865dffa73374 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:46.917954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6786520-15e3-466e-bb22-865dffa73374 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:47.045933 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d4fc851d-1feb-430f-94c9-884ff8e2095f tempest-VolumesTestJSON-1709760491 tempest-VolumesTestJSON-1709760491-project] 10.222.0.93 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.224266 Aug 04 17:17:47.046654 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2645/5243] 10.222.0.93 () {58 vars in 1134 bytes} [Thu Aug 4 17:17:46 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:47.051817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cec6d55e-db83-494d-bc55-414694182812 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:47.053538 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cec6d55e-db83-494d-bc55-414694182812 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:47.071092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cec6d55e-db83-494d-bc55-414694182812 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:47.072036 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cec6d55e-db83-494d-bc55-414694182812 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:47.073621 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cec6d55e-db83-494d-bc55-414694182812 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:47.081132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cec6d55e-db83-494d-bc55-414694182812 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:47.082022 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cec6d55e-db83-494d-bc55-414694182812 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:47.082866 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cec6d55e-db83-494d-bc55-414694182812 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:47.090274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e6786520-15e3-466e-bb22-865dffa73374 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544002a75c946cda1586cd21f999aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a334b70c2e46c087201aa6787accba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:47.100824 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e6786520-15e3-466e-bb22-865dffa73374 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2" status: 200 len: 1253 microversion: 2.1 time: 0.206169 Aug 04 17:17:47.103264 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2599/5244] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:46 2022] GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2 => generated 1253 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:47.115529 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-5fe1ed4a-1a4f-4d56-9af0-19821770aaae req-9de2d892-f58e-4540-b8f9-a1e329edcd24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50cacda1-31c5-4417-8013-9c603340c3ee", "name": "network-vif-deleted", "tag": "e2dac34a-108c-4215-a062-121a43ee48ad"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:47.148402 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5fe1ed4a-1a4f-4d56-9af0-19821770aaae req-9de2d892-f58e-4540-b8f9-a1e329edcd24 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:47.166598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5fe1ed4a-1a4f-4d56-9af0-19821770aaae req-9de2d892-f58e-4540-b8f9-a1e329edcd24 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:47.168258 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5fe1ed4a-1a4f-4d56-9af0-19821770aaae req-9de2d892-f58e-4540-b8f9-a1e329edcd24 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:47.234197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:17:47.243937 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-5fe1ed4a-1a4f-4d56-9af0-19821770aaae req-9de2d892-f58e-4540-b8f9-a1e329edcd24 service nova] Creating event network-vif-deleted:e2dac34a-108c-4215-a062-121a43ee48ad for instance 50cacda1-31c5-4417-8013-9c603340c3ee on n-h2-851359-3 Aug 04 17:17:47.254271 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-5fe1ed4a-1a4f-4d56-9af0-19821770aaae req-9de2d892-f58e-4540-b8f9-a1e329edcd24 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148816 Aug 04 17:17:47.255178 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2600/5245] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:47.262146 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ee9ac86e-2604-4078-9a51-c74c5264c497 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:47.263108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ee9ac86e-2604-4078-9a51-c74c5264c497 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:47.276276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee9ac86e-2604-4078-9a51-c74c5264c497 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:47.276792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee9ac86e-2604-4078-9a51-c74c5264c497 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:47.277407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee9ac86e-2604-4078-9a51-c74c5264c497 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:47.278164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee9ac86e-2604-4078-9a51-c74c5264c497 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:47.278670 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee9ac86e-2604-4078-9a51-c74c5264c497 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:47.280253 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee9ac86e-2604-4078-9a51-c74c5264c497 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:47.341693 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cec6d55e-db83-494d-bc55-414694182812 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:47.351576 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cec6d55e-db83-494d-bc55-414694182812 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.303630 Aug 04 17:17:47.352947 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2646/5246] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:47 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:47.358650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cd11c8c7-cbff-49e7-8744-047f2c9e1480 tempest-VolumesTestJSON-1709760491 tempest-VolumesTestJSON-1709760491-project] Calling method '.version_select at 0x7f1e5afcda60>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:47.528467 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ee9ac86e-2604-4078-9a51-c74c5264c497 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '00b0c65b4bdb4eaa9143b040ee970c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1191cd534df349d6b7bee43b152bec3c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:47.529008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ee9ac86e-2604-4078-9a51-c74c5264c497 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] flavor_id is None. Assuming migration. {{(pid=131044) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 04 17:17:47.529461 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ee9ac86e-2604-4078-9a51-c74c5264c497 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=131044) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 17:17:47.545035 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cd11c8c7-cbff-49e7-8744-047f2c9e1480 tempest-VolumesTestJSON-1709760491 tempest-VolumesTestJSON-1709760491-project] 10.222.0.93 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.190899 Aug 04 17:17:47.555815 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2647/5247] 10.222.0.93 () {58 vars in 1167 bytes} [Thu Aug 4 17:17:47 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:47.563501 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1c5859c9-4c20-47b6-8aa6-420eb1d0da52 tempest-VolumesTestJSON-1709760491 tempest-VolumesTestJSON-1709760491-project] Calling method '.version_select at 0x7f1e5b75ed30>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:47.812359 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1c5859c9-4c20-47b6-8aa6-420eb1d0da52 tempest-VolumesTestJSON-1709760491 tempest-VolumesTestJSON-1709760491-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.255269 Aug 04 17:17:47.821569 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2648/5248] 10.222.0.93 () {58 vars in 1170 bytes} [Thu Aug 4 17:17:47 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:47.826751 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-92a083e4-2a81-4132-9119-a5af16ae7668 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-548346287", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "key_name": "tempest-key-2114453988", "networks": [{"uuid": "f20ac3e7-ddd2-4167-bdf1-b8b75ff31772"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:47.928513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-92a083e4-2a81-4132-9119-a5af16ae7668 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] validate_networks() for [('f20ac3e7-ddd2-4167-bdf1-b8b75ff31772', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:17:48.305035 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ee9ac86e-2604-4078-9a51-c74c5264c497 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0/action" status: 202 len: 0 microversion: 2.1 time: 1.047337 Aug 04 17:17:48.308435 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2601/5249] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:17:47 2022] POST /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0/action => generated 0 bytes in 1052 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:17:48.333171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-90447cef-9aa7-4a96-a700-eea6160c3d20 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:48.335096 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-90447cef-9aa7-4a96-a700-eea6160c3d20 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:48.360966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90447cef-9aa7-4a96-a700-eea6160c3d20 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:48.361481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90447cef-9aa7-4a96-a700-eea6160c3d20 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:48.361927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90447cef-9aa7-4a96-a700-eea6160c3d20 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:48.362695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90447cef-9aa7-4a96-a700-eea6160c3d20 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:48.363160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90447cef-9aa7-4a96-a700-eea6160c3d20 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:48.376553 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90447cef-9aa7-4a96-a700-eea6160c3d20 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:48.417656 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-90447cef-9aa7-4a96-a700-eea6160c3d20 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] HTTP exception thrown: Instance 50cacda1-31c5-4417-8013-9c603340c3ee could not be found. Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-90447cef-9aa7-4a96-a700-eea6160c3d20 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Request method failure captured: Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee HTTP/1.1 Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_20IgjlzOhiiXNFc-NV1FHodxKmWXqSdjZ2I3CqIylUHNkhkG-JAGdMPdYL-8rZzM7v2_0KXVTorBGskuo6vUXRtOSVoO1KTIHw44-u5yCDnlwK7XKRi3uI2OBhda5ANtzdvy-06i9FyD27hM6LxpcHB7QNnHGthqSv2gOLnkKiVjg Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 80bc576163414daba5f5315c4a785533 Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/80bc576163414daba5f5315c4a785533"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/80bc576163414daba5f5315c4a785533"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_80bc576163414daba5f5315c4a785533"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/80bc576163414daba5f5315c4a785533"}]}] Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 80bc576163414daba5f5315c4a785533 Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-AttachVolumeNegativeTest-1565246319-project Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 5b10b58bf3df46d18bff092022b08e0f Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-AttachVolumeNegativeTest-1565246319-project Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 50cacda1-31c5-4417-8013-9c603340c3ee could not be found. Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '50cacda1-31c5-4417-8013-9c603340c3ee'} Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50cacda1-31c5-4417-8013-9c603340c3ee could not be found. Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50cacda1-31c5-4417-8013-9c603340c3ee could not be found. Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:48.419865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:17:48.424369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:48.424369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:48.424369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:48.424369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:17:48.424369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:17:48.424369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50cacda1-31c5-4417-8013-9c603340c3ee could not be found. Aug 04 17:17:48.424369 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:17:48.432662 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-90447cef-9aa7-4a96-a700-eea6160c3d20 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Returning 404 to user: Instance 50cacda1-31c5-4417-8013-9c603340c3ee could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:17:48.433759 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-90447cef-9aa7-4a96-a700-eea6160c3d20 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee" status: 404 len: 111 microversion: 2.1 time: 0.121535 Aug 04 17:17:48.434545 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2602/5250] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:48 2022] GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:17:48.440407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e509c9f9-aa55-4b16-85cb-b5930f3fe6e0 tempest-VolumesTestJSON-1709760491 tempest-VolumesTestJSON-1709760491-project] Calling method '.version_select at 0x7f1e5b41ad30>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:48.640538 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e509c9f9-aa55-4b16-85cb-b5930f3fe6e0 tempest-VolumesTestJSON-1709760491 tempest-VolumesTestJSON-1709760491-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.204728 Aug 04 17:17:48.662553 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2603/5251] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Aug 4 17:17:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:48.689451 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-12b1564b-4b5f-4b43-a675-e934171d98fb tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:48.698242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-12b1564b-4b5f-4b43-a675-e934171d98fb tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:48.709430 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-92a083e4-2a81-4132-9119-a5af16ae7668 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Invalid key_name provided. Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-92a083e4-2a81-4132-9119-a5af16ae7668 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 246 Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-548346287", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "key_name": "tempest-key-2114453988", "networks": [{"uuid": "f20ac3e7-ddd2-4167-bdf1-b8b75ff31772"}]}} Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: exception: Invalid key_name provided. Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-548346287', 'imageRef': '93ebc91d-2d7a-4ab2-b133-dcf9559166d9', 'flavorRef': '452', 'key_name': 'tempest-key-2114453988', 'networks': [{'uuid': 'f20ac3e7-ddd2-4167-bdf1-b8b75ff31772'}]}}} Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1077, in _validate_and_build_base_options Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-2114453988 not found for user 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:48.711262 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:48.716294 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:48.716294 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:17:48.716294 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:17:48.716294 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:17:48.716294 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:17:48.716294 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:17:48.716294 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:17:48.716294 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:17:48.716294 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:17:48.716294 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:17:48.716294 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:17:48.716294 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 17:17:48.716294 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 04 17:17:48.716294 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 04 17:17:48.716294 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 04 17:17:48.716294 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:48.716294 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:48.716294 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:48.716294 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:48.716294 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:48.716294 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:48.716294 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:17:48.716294 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:17:48.716294 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 04 17:17:48.716294 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:48.726069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-92a083e4-2a81-4132-9119-a5af16ae7668 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 400 to user: Invalid key_name provided. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:17:48.726069 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-92a083e4-2a81-4132-9119-a5af16ae7668 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.898335 Aug 04 17:17:48.726069 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2649/5252] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:17:47 2022] POST /compute/v2.1/servers => generated 70 bytes in 900 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 17:17:48.731391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12b1564b-4b5f-4b43-a675-e934171d98fb tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:48.735517 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-417213f1-7f94-487f-a4b9-cb94317a34df tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:48.736326 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12b1564b-4b5f-4b43-a675-e934171d98fb tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:48.736566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-417213f1-7f94-487f-a4b9-cb94317a34df tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:48.738299 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12b1564b-4b5f-4b43-a675-e934171d98fb tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:48.741559 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12b1564b-4b5f-4b43-a675-e934171d98fb tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:48.745858 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12b1564b-4b5f-4b43-a675-e934171d98fb tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:48.746822 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12b1564b-4b5f-4b43-a675-e934171d98fb tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:48.751496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-417213f1-7f94-487f-a4b9-cb94317a34df tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:48.752435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-417213f1-7f94-487f-a4b9-cb94317a34df tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:48.753105 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-417213f1-7f94-487f-a4b9-cb94317a34df tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:48.754169 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-417213f1-7f94-487f-a4b9-cb94317a34df tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:48.755007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-417213f1-7f94-487f-a4b9-cb94317a34df tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:48.755717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-417213f1-7f94-487f-a4b9-cb94317a34df tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:48.889334 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-12b1564b-4b5f-4b43-a675-e934171d98fb tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544002a75c946cda1586cd21f999aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a334b70c2e46c087201aa6787accba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:48.898773 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-12b1564b-4b5f-4b43-a675-e934171d98fb tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2" status: 200 len: 1253 microversion: 2.1 time: 0.234741 Aug 04 17:17:48.906794 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2604/5253] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:48 2022] GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2 => generated 1253 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:48.917526 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-19d28980-c22e-4af7-8044-86f832f2ef9c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '.version_select at 0x7f1e6c9445e0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:48.975554 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-19d28980-c22e-4af7-8044-86f832f2ef9c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-916789404" status: 202 len: 0 microversion: 2.1 time: 0.066714 Aug 04 17:17:48.986183 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2605/5254] 10.222.0.93 () {58 vars in 1218 bytes} [Thu Aug 4 17:17:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-916789404 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:17:48.991694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-397d501a-fbfd-4a7b-a806-c13b9e826fed tempest-VolumesTestJSON-1709760491 tempest-VolumesTestJSON-1709760491-project] Calling method '.version_select at 0x7f1e5bb950d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:49.229460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-417213f1-7f94-487f-a4b9-cb94317a34df tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:49.246115 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-397d501a-fbfd-4a7b-a806-c13b9e826fed tempest-VolumesTestJSON-1709760491 tempest-VolumesTestJSON-1709760491-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.248657 Aug 04 17:17:49.246115 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2606/5255] 10.222.0.93 () {58 vars in 1188 bytes} [Thu Aug 4 17:17:48 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:49.251612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ee54cf08-0d25-489b-afae-c33297afbad3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:49.252236 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ee54cf08-0d25-489b-afae-c33297afbad3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:49.256356 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-417213f1-7f94-487f-a4b9-cb94317a34df tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1692 microversion: 2.1 time: 0.526468 Aug 04 17:17:49.257379 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2650/5256] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:48 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1692 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:49.272143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee54cf08-0d25-489b-afae-c33297afbad3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:49.273098 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee54cf08-0d25-489b-afae-c33297afbad3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:49.273584 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee54cf08-0d25-489b-afae-c33297afbad3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:49.276620 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c0b33586-67c3-40c0-ad17-e5cc0a611431 tempest-VolumesTestJSON-1709760491 tempest-VolumesTestJSON-1709760491-project] Calling method '.version_select at 0x7f1e5ab0cca0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:49.281565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee54cf08-0d25-489b-afae-c33297afbad3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:49.282164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee54cf08-0d25-489b-afae-c33297afbad3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:49.283080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee54cf08-0d25-489b-afae-c33297afbad3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:49.427258 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c0b33586-67c3-40c0-ad17-e5cc0a611431 tempest-VolumesTestJSON-1709760491 tempest-VolumesTestJSON-1709760491-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.168416 Aug 04 17:17:49.427909 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2651/5257] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Aug 4 17:17:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:49.846833 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ee54cf08-0d25-489b-afae-c33297afbad3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:49.855117 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ee54cf08-0d25-489b-afae-c33297afbad3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.616572 Aug 04 17:17:49.860733 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2607/5258] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:49 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:49.885326 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bee94c13-4fc2-4498-a6d8-2f77621bb24c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:49.888210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bee94c13-4fc2-4498-a6d8-2f77621bb24c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:49.920690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fd762119-1eb3-4942-af12-f58ccb796d9d tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:49.924645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fd762119-1eb3-4942-af12-f58ccb796d9d tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:49.930962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bee94c13-4fc2-4498-a6d8-2f77621bb24c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:49.932148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bee94c13-4fc2-4498-a6d8-2f77621bb24c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:49.932615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bee94c13-4fc2-4498-a6d8-2f77621bb24c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:49.933381 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bee94c13-4fc2-4498-a6d8-2f77621bb24c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:49.933869 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bee94c13-4fc2-4498-a6d8-2f77621bb24c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:49.935257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bee94c13-4fc2-4498-a6d8-2f77621bb24c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:49.942156 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd762119-1eb3-4942-af12-f58ccb796d9d tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:49.944551 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd762119-1eb3-4942-af12-f58ccb796d9d tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:49.945358 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd762119-1eb3-4942-af12-f58ccb796d9d tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:49.949959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd762119-1eb3-4942-af12-f58ccb796d9d tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:49.950675 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd762119-1eb3-4942-af12-f58ccb796d9d tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:49.951274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd762119-1eb3-4942-af12-f58ccb796d9d tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:50.327946 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fd762119-1eb3-4942-af12-f58ccb796d9d tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544002a75c946cda1586cd21f999aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a334b70c2e46c087201aa6787accba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:50.348476 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fd762119-1eb3-4942-af12-f58ccb796d9d tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2" status: 200 len: 1253 microversion: 2.1 time: 0.431584 Aug 04 17:17:50.350534 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2608/5259] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:49 2022] GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2 => generated 1253 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:17:50.369790 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bee94c13-4fc2-4498-a6d8-2f77621bb24c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:50.374366 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-14cedd8a-c32f-469e-ad0b-6ecb2e8ab22a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:50.375390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-14cedd8a-c32f-469e-ad0b-6ecb2e8ab22a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:50.394452 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bee94c13-4fc2-4498-a6d8-2f77621bb24c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.514928 Aug 04 17:17:50.410313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14cedd8a-c32f-469e-ad0b-6ecb2e8ab22a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:50.410868 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14cedd8a-c32f-469e-ad0b-6ecb2e8ab22a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:50.411286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14cedd8a-c32f-469e-ad0b-6ecb2e8ab22a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:50.412053 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14cedd8a-c32f-469e-ad0b-6ecb2e8ab22a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:50.412517 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14cedd8a-c32f-469e-ad0b-6ecb2e8ab22a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:50.412952 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14cedd8a-c32f-469e-ad0b-6ecb2e8ab22a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:50.416765 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2652/5260] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:49 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:50.730906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6d31011d-760d-4523-8a8d-835cf4f01100 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-546269669", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "f20ac3e7-ddd2-4167-bdf1-b8b75ff31772"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:51.161166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.security_group_api [None req-6d31011d-760d-4523-8a8d-835cf4f01100 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Neutron security group does_not_exist not found {{(pid=131043) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 04 17:17:51.162610 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-6d31011d-760d-4523-8a8d-835cf4f01100 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6d31011d-760d-4523-8a8d-835cf4f01100 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 257 Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-546269669", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "f20ac3e7-ddd2-4167-bdf1-b8b75ff31772"}]}} Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-546269669', 'imageRef': '93ebc91d-2d7a-4ab2-b133-dcf9559166d9', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'f20ac3e7-ddd2-4167-bdf1-b8b75ff31772'}]}}} Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 04 17:17:51.179598 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1062, in _validate_and_build_base_options Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 509, in _check_requested_secgroups Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:51.184568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6d31011d-760d-4523-8a8d-835cf4f01100 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:17:51.190370 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6d31011d-760d-4523-8a8d-835cf4f01100 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.460209 Aug 04 17:17:51.192595 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2653/5261] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:17:50 2022] POST /compute/v2.1/servers => generated 106 bytes in 467 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:17:51.200526 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f1168d2e-cd69-4a30-a7c8-9ea328eaca6a tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Action: 'create', calling method: .version_select at 0x7f1e5b75e940>, body: {"keypair": {"name": "tempest-keypair-20804503", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrZsu7mA7AgyUedU6md/SfMpEiqvjg8f1JgvO+tHE5tB3UPSEWkgHLaLTfgcMGXms0BBFtCbNX8cXZKGjb9ciftIFQ9MvS+tow77W7y9kKqKC6EqmhMNZdVuaBlyryBpg=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:51.237095 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-f1168d2e-cd69-4a30-a7c8-9ea328eaca6a tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Getting quotas for project 80bc576163414daba5f5315c4a785533. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:17:51.255530 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-f1168d2e-cd69-4a30-a7c8-9ea328eaca6a tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Getting quotas for user 5b10b58bf3df46d18bff092022b08e0f and project 80bc576163414daba5f5315c4a785533. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:17:51.309602 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f1168d2e-cd69-4a30-a7c8-9ea328eaca6a tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.115296 Aug 04 17:17:51.310968 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2654/5262] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:17:51 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:17:51.317101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f2bc8925-777c-4643-9f7a-ccb9f4dee0f0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:51.318119 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f2bc8925-777c-4643-9f7a-ccb9f4dee0f0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:51.326922 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2bc8925-777c-4643-9f7a-ccb9f4dee0f0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:51.327890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2bc8925-777c-4643-9f7a-ccb9f4dee0f0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:51.328915 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2bc8925-777c-4643-9f7a-ccb9f4dee0f0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:51.330142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2bc8925-777c-4643-9f7a-ccb9f4dee0f0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:51.330862 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2bc8925-777c-4643-9f7a-ccb9f4dee0f0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:51.331679 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2bc8925-777c-4643-9f7a-ccb9f4dee0f0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:51.405814 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-14cedd8a-c32f-469e-ad0b-6ecb2e8ab22a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:51.417441 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-14cedd8a-c32f-469e-ad0b-6ecb2e8ab22a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1692 microversion: 2.1 time: 1.065400 Aug 04 17:17:51.418845 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2609/5263] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:50 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1692 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:51.445876 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-508e2639-ab71-4a62-890e-fc614d001792 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:51.446544 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-508e2639-ab71-4a62-890e-fc614d001792 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:51.463916 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-508e2639-ab71-4a62-890e-fc614d001792 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:51.464471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-508e2639-ab71-4a62-890e-fc614d001792 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:51.465420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-508e2639-ab71-4a62-890e-fc614d001792 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:51.466772 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-508e2639-ab71-4a62-890e-fc614d001792 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:51.468219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-508e2639-ab71-4a62-890e-fc614d001792 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:51.469019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-508e2639-ab71-4a62-890e-fc614d001792 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:51.693829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-508e2639-ab71-4a62-890e-fc614d001792 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3544002a75c946cda1586cd21f999aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a334b70c2e46c087201aa6787accba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:51.704289 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-508e2639-ab71-4a62-890e-fc614d001792 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2" status: 200 len: 1253 microversion: 2.1 time: 0.283955 Aug 04 17:17:51.720037 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2610/5264] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:51 2022] GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2 => generated 1253 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:51.993390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f2bc8925-777c-4643-9f7a-ccb9f4dee0f0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:52.007423 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f2bc8925-777c-4643-9f7a-ccb9f4dee0f0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.694976 Aug 04 17:17:52.010837 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2655/5265] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:51 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:52.040459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b2330e82-736d-4989-9872-d5a3127d391c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:52.041691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b2330e82-736d-4989-9872-d5a3127d391c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:52.068203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2330e82-736d-4989-9872-d5a3127d391c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:52.071008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2330e82-736d-4989-9872-d5a3127d391c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:52.075091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2330e82-736d-4989-9872-d5a3127d391c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:52.076127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2330e82-736d-4989-9872-d5a3127d391c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:52.076793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2330e82-736d-4989-9872-d5a3127d391c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:52.077442 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2330e82-736d-4989-9872-d5a3127d391c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:52.443896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d41b8409-76c6-4c43-a279-90df1f44441d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:52.444890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d41b8409-76c6-4c43-a279-90df1f44441d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:52.465894 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d41b8409-76c6-4c43-a279-90df1f44441d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:52.469213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d41b8409-76c6-4c43-a279-90df1f44441d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:52.472745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d41b8409-76c6-4c43-a279-90df1f44441d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:52.476204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d41b8409-76c6-4c43-a279-90df1f44441d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:52.479307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d41b8409-76c6-4c43-a279-90df1f44441d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:52.479882 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d41b8409-76c6-4c43-a279-90df1f44441d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:53.011778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b2330e82-736d-4989-9872-d5a3127d391c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:53.041486 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b2330e82-736d-4989-9872-d5a3127d391c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 1.007045 Aug 04 17:17:53.050576 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2611/5266] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:52 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:53.078122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-684e5b7f-d3d6-4bc1-a4c8-5aabc243a226 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:53.079508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-684e5b7f-d3d6-4bc1-a4c8-5aabc243a226 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] [instance: b49ca99e-4a64-4d5d-aeb8-f61760944ce2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:53.085091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:17:53.098100 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-684e5b7f-d3d6-4bc1-a4c8-5aabc243a226 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:53.100439 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-684e5b7f-d3d6-4bc1-a4c8-5aabc243a226 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:53.101762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-684e5b7f-d3d6-4bc1-a4c8-5aabc243a226 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:53.103363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-684e5b7f-d3d6-4bc1-a4c8-5aabc243a226 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:53.105280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-684e5b7f-d3d6-4bc1-a4c8-5aabc243a226 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:53.105943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-684e5b7f-d3d6-4bc1-a4c8-5aabc243a226 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:53.144447 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-684e5b7f-d3d6-4bc1-a4c8-5aabc243a226 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] HTTP exception thrown: Instance b49ca99e-4a64-4d5d-aeb8-f61760944ce2 could not be found. Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-684e5b7f-d3d6-4bc1-a4c8-5aabc243a226 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Request method failure captured: Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2 HTTP/1.1 Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_7GzGEfRV91yk7i3KyN-ZaXDGUqEoFEsi5KY4RT-ethnY0B4nNE4zy4VadfjICHXAHI7KWU5dfJJyEEDhFLTuaNIg0TK12ZJNP185suQIBKalIJY3JkZ9q1unPQiqW9cCQ4xEu1fyBpTzB94kwlAmYApuAOwj-uqqSt47w7zPO2kJY Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 95a334b70c2e46c087201aa6787accba Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersTestBootFromVolume-856306380 Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/95a334b70c2e46c087201aa6787accba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/95a334b70c2e46c087201aa6787accba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_95a334b70c2e46c087201aa6787accba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/95a334b70c2e46c087201aa6787accba"}]}] Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersTestBootFromVolume-856306380 Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 95a334b70c2e46c087201aa6787accba Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersTestBootFromVolume-856306380 Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersTestBootFromVolume-856306380-project Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 3544002a75c946cda1586cd21f999aa0 Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersTestBootFromVolume-856306380-project Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance b49ca99e-4a64-4d5d-aeb8-f61760944ce2 could not be found. Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'b49ca99e-4a64-4d5d-aeb8-f61760944ce2'} Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b49ca99e-4a64-4d5d-aeb8-f61760944ce2 could not be found. Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b49ca99e-4a64-4d5d-aeb8-f61760944ce2 could not be found. Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:53.147682 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:17:53.151737 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:53.151737 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:53.151737 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:53.151737 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:17:53.151737 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:17:53.151737 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b49ca99e-4a64-4d5d-aeb8-f61760944ce2 could not be found. Aug 04 17:17:53.151737 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:17:53.153553 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-684e5b7f-d3d6-4bc1-a4c8-5aabc243a226 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Returning 404 to user: Instance b49ca99e-4a64-4d5d-aeb8-f61760944ce2 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:17:53.154764 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-684e5b7f-d3d6-4bc1-a4c8-5aabc243a226 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2" status: 404 len: 111 microversion: 2.1 time: 0.099496 Aug 04 17:17:53.160446 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2612/5267] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:53 2022] GET /compute/v2.1/servers/b49ca99e-4a64-4d5d-aeb8-f61760944ce2 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:17:53.167807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aa2275af-2ebb-420a-ad2e-fa3389d6a6c0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:53.169389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aa2275af-2ebb-420a-ad2e-fa3389d6a6c0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: b05acb98-5918-4d5c-b5ee-58ad3e11303d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:53.179115 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-aa2275af-2ebb-420a-ad2e-fa3389d6a6c0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Instance b05acb98-5918-4d5c-b5ee-58ad3e11303d could not be found. Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aa2275af-2ebb-420a-ad2e-fa3389d6a6c0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/b05acb98-5918-4d5c-b5ee-58ad3e11303d HTTP/1.1 Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance b05acb98-5918-4d5c-b5ee-58ad3e11303d could not be found. Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'b05acb98-5918-4d5c-b5ee-58ad3e11303d'} Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b05acb98-5918-4d5c-b5ee-58ad3e11303d could not be found. Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b05acb98-5918-4d5c-b5ee-58ad3e11303d could not be found. Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:17:53.181251 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:53.185559 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:17:53.185559 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:53.185559 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:53.185559 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:53.185559 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:17:53.185559 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:17:53.185559 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b05acb98-5918-4d5c-b5ee-58ad3e11303d could not be found. Aug 04 17:17:53.185559 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:17:53.189135 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aa2275af-2ebb-420a-ad2e-fa3389d6a6c0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 404 to user: Instance b05acb98-5918-4d5c-b5ee-58ad3e11303d could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:17:53.190291 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aa2275af-2ebb-420a-ad2e-fa3389d6a6c0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b05acb98-5918-4d5c-b5ee-58ad3e11303d" status: 404 len: 111 microversion: 2.1 time: 0.028482 Aug 04 17:17:53.195776 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2613/5268] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:17:53 2022] DELETE /compute/v2.1/servers/b05acb98-5918-4d5c-b5ee-58ad3e11303d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:17:53.202498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f7f97d62-ba46-40cb-a99a-0777f2f492e5 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] Calling method '.version_select at 0x7f1e5bb95f70>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:53.229310 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f7f97d62-ba46-40cb-a99a-0777f2f492e5 tempest-ServersTestBootFromVolume-856306380 tempest-ServersTestBootFromVolume-856306380-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1513265033" status: 202 len: 0 microversion: 2.1 time: 0.032008 Aug 04 17:17:53.235308 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2614/5269] 10.222.0.93 () {58 vars in 1221 bytes} [Thu Aug 4 17:17:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1513265033 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:17:53.248536 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-38fb3163-ab37-4c16-a111-68f986503aad tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:53.249769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-38fb3163-ab37-4c16-a111-68f986503aad tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:53.263979 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38fb3163-ab37-4c16-a111-68f986503aad tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:53.264783 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38fb3163-ab37-4c16-a111-68f986503aad tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:53.265710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38fb3163-ab37-4c16-a111-68f986503aad tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:53.266764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38fb3163-ab37-4c16-a111-68f986503aad tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:53.267469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38fb3163-ab37-4c16-a111-68f986503aad tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:53.268276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38fb3163-ab37-4c16-a111-68f986503aad tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:54.577966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d41b8409-76c6-4c43-a279-90df1f44441d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:54.593148 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d41b8409-76c6-4c43-a279-90df1f44441d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1692 microversion: 2.1 time: 2.154592 Aug 04 17:17:54.595112 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2656/5270] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:52 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1692 bytes in 2160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:17:54.799202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-38fb3163-ab37-4c16-a111-68f986503aad tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:54.814759 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-38fb3163-ab37-4c16-a111-68f986503aad tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 1.575646 Aug 04 17:17:54.815960 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2615/5271] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:53 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:54.843412 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-415a2f99-4cf5-4bb1-aac6-3f7d12ace886 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:54.844291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-415a2f99-4cf5-4bb1-aac6-3f7d12ace886 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:54.860955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-415a2f99-4cf5-4bb1-aac6-3f7d12ace886 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:54.863993 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-415a2f99-4cf5-4bb1-aac6-3f7d12ace886 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:54.865295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-415a2f99-4cf5-4bb1-aac6-3f7d12ace886 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:54.868391 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-415a2f99-4cf5-4bb1-aac6-3f7d12ace886 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:54.869089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-415a2f99-4cf5-4bb1-aac6-3f7d12ace886 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:54.870136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-415a2f99-4cf5-4bb1-aac6-3f7d12ace886 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:55.624112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7d279228-ad96-41a1-a731-6a4d73d339a9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:55.624752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7d279228-ad96-41a1-a731-6a4d73d339a9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:55.655643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d279228-ad96-41a1-a731-6a4d73d339a9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:55.656267 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d279228-ad96-41a1-a731-6a4d73d339a9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:55.664555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d279228-ad96-41a1-a731-6a4d73d339a9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:55.668985 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d279228-ad96-41a1-a731-6a4d73d339a9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:55.681528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d279228-ad96-41a1-a731-6a4d73d339a9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:55.685036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d279228-ad96-41a1-a731-6a4d73d339a9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:55.707559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-415a2f99-4cf5-4bb1-aac6-3f7d12ace886 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:55.735651 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-415a2f99-4cf5-4bb1-aac6-3f7d12ace886 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.895939 Aug 04 17:17:55.739405 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2657/5272] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:54 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:55.768794 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-86a9b84b-fcd5-47a4-8357-46b4f0c82973 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:55.769969 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-86a9b84b-fcd5-47a4-8357-46b4f0c82973 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Failed to fetch instance by id 9223372036854775808 {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 04 17:17:55.775985 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-86a9b84b-fcd5-47a4-8357-46b4f0c82973 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-86a9b84b-fcd5-47a4-8357-46b4f0c82973 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 9223372036854775808 could not be found. Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '9223372036854775808'} Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:55.780073 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:55.788571 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:55.788571 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:17:55.788571 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:17:55.788571 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 04 17:17:55.788571 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:55.788571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-86a9b84b-fcd5-47a4-8357-46b4f0c82973 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:17:55.788571 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-86a9b84b-fcd5-47a4-8357-46b4f0c82973 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.021959 Aug 04 17:17:55.798888 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2658/5273] 10.222.0.93 () {58 vars in 1188 bytes} [Thu Aug 4 17:17:55 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:17:55.816634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-075dc54a-b12b-4f54-8c6e-61ce336d4fd4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:55.821714 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-075dc54a-b12b-4f54-8c6e-61ce336d4fd4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:55.852057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-075dc54a-b12b-4f54-8c6e-61ce336d4fd4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:55.852576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-075dc54a-b12b-4f54-8c6e-61ce336d4fd4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:55.856604 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-075dc54a-b12b-4f54-8c6e-61ce336d4fd4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:55.858634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-075dc54a-b12b-4f54-8c6e-61ce336d4fd4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:55.860784 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-075dc54a-b12b-4f54-8c6e-61ce336d4fd4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:55.861265 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-075dc54a-b12b-4f54-8c6e-61ce336d4fd4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:56.499728 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7d279228-ad96-41a1-a731-6a4d73d339a9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:56.510705 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7d279228-ad96-41a1-a731-6a4d73d339a9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1692 microversion: 2.1 time: 0.893981 Aug 04 17:17:56.511763 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2616/5274] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:55 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1692 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:56.679616 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-075dc54a-b12b-4f54-8c6e-61ce336d4fd4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:56.698643 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-075dc54a-b12b-4f54-8c6e-61ce336d4fd4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.893774 Aug 04 17:17:56.703774 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2659/5275] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:55 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:56.733128 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-32a6d9b5-804b-4388-b7b3-63c1e9a97fdb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:56.734408 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-32a6d9b5-804b-4388-b7b3-63c1e9a97fdb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:56.755030 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32a6d9b5-804b-4388-b7b3-63c1e9a97fdb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:56.760263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32a6d9b5-804b-4388-b7b3-63c1e9a97fdb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:56.766386 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32a6d9b5-804b-4388-b7b3-63c1e9a97fdb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:56.770415 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32a6d9b5-804b-4388-b7b3-63c1e9a97fdb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:56.771261 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32a6d9b5-804b-4388-b7b3-63c1e9a97fdb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:56.776118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32a6d9b5-804b-4388-b7b3-63c1e9a97fdb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:57.186238 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-32a6d9b5-804b-4388-b7b3-63c1e9a97fdb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:57.198235 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-32a6d9b5-804b-4388-b7b3-63c1e9a97fdb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.469881 Aug 04 17:17:57.199527 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2617/5276] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:56 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:17:57.228995 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2c90affe-fcc7-44e3-9692-e8a5ebbf6715 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:57.230757 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2c90affe-fcc7-44e3-9692-e8a5ebbf6715 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Failed to fetch instance by id -1 {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 04 17:17:57.231369 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-2c90affe-fcc7-44e3-9692-e8a5ebbf6715 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Instance -1 could not be found. Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2c90affe-fcc7-44e3-9692-e8a5ebbf6715 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance -1 could not be found. Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '-1'} Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:57.236165 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:57.242240 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:17:57.242240 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:17:57.242240 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 04 17:17:57.242240 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:57.242240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2c90affe-fcc7-44e3-9692-e8a5ebbf6715 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 404 to user: Instance -1 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:17:57.244545 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2c90affe-fcc7-44e3-9692-e8a5ebbf6715 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.028709 Aug 04 17:17:57.246252 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2660/5277] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Aug 4 17:17:57 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:17:57.254554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c17307af-1601-44c6-b84c-70efcd086a6a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:57.255535 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c17307af-1601-44c6-b84c-70efcd086a6a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:57.267219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c17307af-1601-44c6-b84c-70efcd086a6a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:57.268687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c17307af-1601-44c6-b84c-70efcd086a6a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:57.270532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c17307af-1601-44c6-b84c-70efcd086a6a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:57.271576 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c17307af-1601-44c6-b84c-70efcd086a6a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:57.271997 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c17307af-1601-44c6-b84c-70efcd086a6a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:57.274251 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c17307af-1601-44c6-b84c-70efcd086a6a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:57.544304 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0f55428b-0c89-4fb3-9bfd-89a2cb41e90b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:57.544940 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0f55428b-0c89-4fb3-9bfd-89a2cb41e90b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:57.579613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f55428b-0c89-4fb3-9bfd-89a2cb41e90b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:57.580121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f55428b-0c89-4fb3-9bfd-89a2cb41e90b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:57.580572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f55428b-0c89-4fb3-9bfd-89a2cb41e90b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:57.581505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f55428b-0c89-4fb3-9bfd-89a2cb41e90b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:57.582173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f55428b-0c89-4fb3-9bfd-89a2cb41e90b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:57.582780 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f55428b-0c89-4fb3-9bfd-89a2cb41e90b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:57.612636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c17307af-1601-44c6-b84c-70efcd086a6a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:57.622592 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c17307af-1601-44c6-b84c-70efcd086a6a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.372115 Aug 04 17:17:57.643833 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2618/5278] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:57 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:57.651713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8ec5c8d2-b0d2-4313-865e-0981633d2a65 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:57.652341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8ec5c8d2-b0d2-4313-865e-0981633d2a65 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:57.666855 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ec5c8d2-b0d2-4313-865e-0981633d2a65 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:57.667358 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ec5c8d2-b0d2-4313-865e-0981633d2a65 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:57.667801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ec5c8d2-b0d2-4313-865e-0981633d2a65 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:57.668508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ec5c8d2-b0d2-4313-865e-0981633d2a65 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:57.674026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ec5c8d2-b0d2-4313-865e-0981633d2a65 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:57.674737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ec5c8d2-b0d2-4313-865e-0981633d2a65 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:58.299537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0f55428b-0c89-4fb3-9bfd-89a2cb41e90b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:58.317086 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0f55428b-0c89-4fb3-9bfd-89a2cb41e90b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1697 microversion: 2.1 time: 0.780959 Aug 04 17:17:58.331300 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2661/5279] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:57 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1697 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:17:58.376393 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8ec5c8d2-b0d2-4313-865e-0981633d2a65 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:58.392074 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8ec5c8d2-b0d2-4313-865e-0981633d2a65 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.745359 Aug 04 17:17:58.394878 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2619/5280] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:57 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:58.423775 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e429f4a4-f5b3-4f8b-8beb-bc8318b7e5a6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:58.424886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e429f4a4-f5b3-4f8b-8beb-bc8318b7e5a6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 88ef89b6-39e3-421b-8dd6-1c5fa3a87216] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:58.437923 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-e429f4a4-f5b3-4f8b-8beb-bc8318b7e5a6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Instance 88ef89b6-39e3-421b-8dd6-1c5fa3a87216 could not be found. Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e429f4a4-f5b3-4f8b-8beb-bc8318b7e5a6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers/88ef89b6-39e3-421b-8dd6-1c5fa3a87216/action HTTP/1.1 Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 19 Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: {"forceDelete": {}} Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 88ef89b6-39e3-421b-8dd6-1c5fa3a87216 could not be found. Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '88ef89b6-39e3-421b-8dd6-1c5fa3a87216', 'body': {'forceDelete': {}}} Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88ef89b6-39e3-421b-8dd6-1c5fa3a87216 could not be found. Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88ef89b6-39e3-421b-8dd6-1c5fa3a87216 could not be found. Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:17:58.446402 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:17:58.451740 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:17:58.451740 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:17:58.451740 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88ef89b6-39e3-421b-8dd6-1c5fa3a87216 could not be found. Aug 04 17:17:58.451740 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:17:58.464274 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e429f4a4-f5b3-4f8b-8beb-bc8318b7e5a6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 404 to user: Instance 88ef89b6-39e3-421b-8dd6-1c5fa3a87216 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:17:58.471200 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e429f4a4-f5b3-4f8b-8beb-bc8318b7e5a6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers/88ef89b6-39e3-421b-8dd6-1c5fa3a87216/action" status: 404 len: 111 microversion: 2.1 time: 0.052067 Aug 04 17:17:58.479146 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2662/5281] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:17:58 2022] POST /compute/v2.1/servers/88ef89b6-39e3-421b-8dd6-1c5fa3a87216/action => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:17:58.490463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1f58e5f0-196a-41cb-972c-3dc00941b8ba tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:58.491458 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1f58e5f0-196a-41cb-972c-3dc00941b8ba tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:58.500874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f58e5f0-196a-41cb-972c-3dc00941b8ba tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:58.501907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f58e5f0-196a-41cb-972c-3dc00941b8ba tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:58.502576 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f58e5f0-196a-41cb-972c-3dc00941b8ba tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:58.504745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f58e5f0-196a-41cb-972c-3dc00941b8ba tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:58.507649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f58e5f0-196a-41cb-972c-3dc00941b8ba tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:58.508358 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f58e5f0-196a-41cb-972c-3dc00941b8ba tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:58.860057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1f58e5f0-196a-41cb-972c-3dc00941b8ba tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:58.870553 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1f58e5f0-196a-41cb-972c-3dc00941b8ba tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.386794 Aug 04 17:17:58.871154 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2620/5282] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:58 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:58.900291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2f362e09-570b-4d95-bcbf-798d17164128 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:58.901010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2f362e09-570b-4d95-bcbf-798d17164128 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:58.920891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f362e09-570b-4d95-bcbf-798d17164128 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:58.925920 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f362e09-570b-4d95-bcbf-798d17164128 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:58.927394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f362e09-570b-4d95-bcbf-798d17164128 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:58.928626 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f362e09-570b-4d95-bcbf-798d17164128 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:58.929279 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f362e09-570b-4d95-bcbf-798d17164128 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:58.930443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f362e09-570b-4d95-bcbf-798d17164128 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:59.223405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-654255d0-d244-4001-9f9d-4081c5bf41cb tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1050169611", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "779f24e1-21b5-406f-8c13-50f72d42c29c"}], "security_groups": [{"name": "tempest-securitygroup--55086480"}], "key_name": "tempest-keypair-20804503", "user_data": "}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:17:59.545156 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-654255d0-d244-4001-9f9d-4081c5bf41cb tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] validate_networks() for [('779f24e1-21b5-406f-8c13-50f72d42c29c', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:17:59.869492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2f362e09-570b-4d95-bcbf-798d17164128 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:17:59.880762 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2f362e09-570b-4d95-bcbf-798d17164128 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.986333 Aug 04 17:17:59.891984 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2663/5283] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:58 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:17:59.901283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-57b1c3f1-9f2d-49bd-9f6c-d90d89f3bde1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:17:59.914991 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-57b1c3f1-9f2d-49bd-9f6c-d90d89f3bde1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:17:59.922569 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57b1c3f1-9f2d-49bd-9f6c-d90d89f3bde1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:59.923330 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57b1c3f1-9f2d-49bd-9f6c-d90d89f3bde1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:59.923959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57b1c3f1-9f2d-49bd-9f6c-d90d89f3bde1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:17:59.925013 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57b1c3f1-9f2d-49bd-9f6c-d90d89f3bde1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:17:59.925671 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57b1c3f1-9f2d-49bd-9f6c-d90d89f3bde1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:17:59.926333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57b1c3f1-9f2d-49bd-9f6c-d90d89f3bde1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:00.794822 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-57b1c3f1-9f2d-49bd-9f6c-d90d89f3bde1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:00.806776 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-57b1c3f1-9f2d-49bd-9f6c-d90d89f3bde1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1697 microversion: 2.1 time: 0.912355 Aug 04 17:18:00.807947 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2664/5284] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:17:59 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1697 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:00.817019 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a982f016-535a-4814-b9a7-f6b340a197a9 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:00.821591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a982f016-535a-4814-b9a7-f6b340a197a9 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 2653442e-013a-45e0-b9b8-ab7609eaffff] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:00.832031 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-a982f016-535a-4814-b9a7-f6b340a197a9 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Instance 2653442e-013a-45e0-b9b8-ab7609eaffff could not be found. Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a982f016-535a-4814-b9a7-f6b340a197a9 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers/2653442e-013a-45e0-b9b8-ab7609eaffff/action HTTP/1.1 Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 39 Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: {"os-getConsoleOutput": {"length": 10}} Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 2653442e-013a-45e0-b9b8-ab7609eaffff could not be found. Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '2653442e-013a-45e0-b9b8-ab7609eaffff', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2653442e-013a-45e0-b9b8-ab7609eaffff could not be found. Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2653442e-013a-45e0-b9b8-ab7609eaffff could not be found. Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:00.841459 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:00.845736 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:00.845736 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:00.845736 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:18:00.845736 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:18:00.845736 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2653442e-013a-45e0-b9b8-ab7609eaffff could not be found. Aug 04 17:18:00.845736 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:00.845736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a982f016-535a-4814-b9a7-f6b340a197a9 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 404 to user: Instance 2653442e-013a-45e0-b9b8-ab7609eaffff could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:18:00.845736 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a982f016-535a-4814-b9a7-f6b340a197a9 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers/2653442e-013a-45e0-b9b8-ab7609eaffff/action" status: 404 len: 111 microversion: 2.1 time: 0.034730 Aug 04 17:18:00.845736 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2665/5285] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:18:00 2022] POST /compute/v2.1/servers/2653442e-013a-45e0-b9b8-ab7609eaffff/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:18:00.853351 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a1ce5c20-1a09-430e-8162-ccd33e91e348 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:00.854283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a1ce5c20-1a09-430e-8162-ccd33e91e348 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:00.861623 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a1ce5c20-1a09-430e-8162-ccd33e91e348 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:00.862444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a1ce5c20-1a09-430e-8162-ccd33e91e348 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:00.863108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a1ce5c20-1a09-430e-8162-ccd33e91e348 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:00.865078 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a1ce5c20-1a09-430e-8162-ccd33e91e348 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:00.865399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a1ce5c20-1a09-430e-8162-ccd33e91e348 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:00.866033 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a1ce5c20-1a09-430e-8162-ccd33e91e348 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:01.057599 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-654255d0-d244-4001-9f9d-4081c5bf41cb tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:18:01.058437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-654255d0-d244-4001-9f9d-4081c5bf41cb tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:18:01.058814 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-654255d0-d244-4001-9f9d-4081c5bf41cb tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:18:01.059121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-654255d0-d244-4001-9f9d-4081c5bf41cb tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:18:01.059547 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-654255d0-d244-4001-9f9d-4081c5bf41cb tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:18:01.088955 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-654255d0-d244-4001-9f9d-4081c5bf41cb tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:01.089461 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-654255d0-d244-4001-9f9d-4081c5bf41cb tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:01.089918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-654255d0-d244-4001-9f9d-4081c5bf41cb tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:01.092274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-654255d0-d244-4001-9f9d-4081c5bf41cb tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:01.092763 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-654255d0-d244-4001-9f9d-4081c5bf41cb tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:01.093199 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-654255d0-d244-4001-9f9d-4081c5bf41cb tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:01.151827 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-654255d0-d244-4001-9f9d-4081c5bf41cb tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Getting quotas for project 80bc576163414daba5f5315c4a785533. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:18:01.167846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-654255d0-d244-4001-9f9d-4081c5bf41cb tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Getting quotas for user 5b10b58bf3df46d18bff092022b08e0f and project 80bc576163414daba5f5315c4a785533. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:18:01.211773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-654255d0-d244-4001-9f9d-4081c5bf41cb tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:18:01.221583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-654255d0-d244-4001-9f9d-4081c5bf41cb tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:18:01.276711 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=4 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:18:01.314964 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-654255d0-d244-4001-9f9d-4081c5bf41cb tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.095553 Aug 04 17:18:01.315915 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2621/5286] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:17:59 2022] POST /compute/v2.1/servers => generated 400 bytes in 2100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:18:01.340077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5a7751aa-230b-4995-b030-71a491966421 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:01.340077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5a7751aa-230b-4995-b030-71a491966421 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:01.559141 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5a7751aa-230b-4995-b030-71a491966421 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:01.574755 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5a7751aa-230b-4995-b030-71a491966421 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b" status: 200 len: 1240 microversion: 2.1 time: 0.251602 Aug 04 17:18:01.577105 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2622/5287] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:01 2022] GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b => generated 1240 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:01.833459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4129a6a8-9741-4285-9c10-3464adccd62b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:01.834942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4129a6a8-9741-4285-9c10-3464adccd62b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:01.861863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4129a6a8-9741-4285-9c10-3464adccd62b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:01.868869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4129a6a8-9741-4285-9c10-3464adccd62b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:01.869965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4129a6a8-9741-4285-9c10-3464adccd62b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:01.871207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4129a6a8-9741-4285-9c10-3464adccd62b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:01.872010 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4129a6a8-9741-4285-9c10-3464adccd62b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:01.872995 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4129a6a8-9741-4285-9c10-3464adccd62b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:01.949397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a1ce5c20-1a09-430e-8162-ccd33e91e348 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:01.966885 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a1ce5c20-1a09-430e-8162-ccd33e91e348 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 1.117914 Aug 04 17:18:01.978116 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2666/5288] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:00 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:02.017834 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f923aa3f-6ba8-478e-afc7-cc4fefe816d0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:02.018903 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f923aa3f-6ba8-478e-afc7-cc4fefe816d0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:02.027083 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f923aa3f-6ba8-478e-afc7-cc4fefe816d0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:02.027937 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f923aa3f-6ba8-478e-afc7-cc4fefe816d0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:02.028599 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f923aa3f-6ba8-478e-afc7-cc4fefe816d0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:02.029568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f923aa3f-6ba8-478e-afc7-cc4fefe816d0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:02.030282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f923aa3f-6ba8-478e-afc7-cc4fefe816d0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:02.030929 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f923aa3f-6ba8-478e-afc7-cc4fefe816d0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:02.581004 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f923aa3f-6ba8-478e-afc7-cc4fefe816d0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:02.592352 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:18:02.603152 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f923aa3f-6ba8-478e-afc7-cc4fefe816d0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.582907 Aug 04 17:18:02.619932 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2667/5289] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:02 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:18:02.623129 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4129a6a8-9741-4285-9c10-3464adccd62b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:02.627877 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:18:02.629896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8fc6e1f2-d58b-4cad-9f58-46c1d4bbf89c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:02.630860 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8fc6e1f2-d58b-4cad-9f58-46c1d4bbf89c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:02.640524 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fc6e1f2-d58b-4cad-9f58-46c1d4bbf89c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:02.641233 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fc6e1f2-d58b-4cad-9f58-46c1d4bbf89c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:02.642055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fc6e1f2-d58b-4cad-9f58-46c1d4bbf89c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:02.643074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fc6e1f2-d58b-4cad-9f58-46c1d4bbf89c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:02.643846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fc6e1f2-d58b-4cad-9f58-46c1d4bbf89c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:02.644487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fc6e1f2-d58b-4cad-9f58-46c1d4bbf89c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:02.653454 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4129a6a8-9741-4285-9c10-3464adccd62b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1697 microversion: 2.1 time: 0.826974 Aug 04 17:18:02.657611 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2623/5290] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:01 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1697 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:18:02.685340 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-519567fc-e55d-4d2b-b1b0-d2d5de8c8076 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:02.686091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-519567fc-e55d-4d2b-b1b0-d2d5de8c8076 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 4bbdde5a-5ecd-47d4-961b-8adf557e94b5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:02.697322 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-519567fc-e55d-4d2b-b1b0-d2d5de8c8076 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Instance 4bbdde5a-5ecd-47d4-961b-8adf557e94b5 could not be found. Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-519567fc-e55d-4d2b-b1b0-d2d5de8c8076 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/4bbdde5a-5ecd-47d4-961b-8adf557e94b5 HTTP/1.1 Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 4bbdde5a-5ecd-47d4-961b-8adf557e94b5 could not be found. Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '4bbdde5a-5ecd-47d4-961b-8adf557e94b5'} Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bbdde5a-5ecd-47d4-961b-8adf557e94b5 could not be found. Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bbdde5a-5ecd-47d4-961b-8adf557e94b5 could not be found. Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:02.703067 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:02.709793 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:02.709793 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:18:02.709793 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:18:02.709793 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bbdde5a-5ecd-47d4-961b-8adf557e94b5 could not be found. Aug 04 17:18:02.709793 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:02.714108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-519567fc-e55d-4d2b-b1b0-d2d5de8c8076 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 404 to user: Instance 4bbdde5a-5ecd-47d4-961b-8adf557e94b5 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:18:02.715388 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-519567fc-e55d-4d2b-b1b0-d2d5de8c8076 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/4bbdde5a-5ecd-47d4-961b-8adf557e94b5" status: 404 len: 111 microversion: 2.1 time: 0.056458 Aug 04 17:18:02.718135 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2624/5291] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:02 2022] GET /compute/v2.1/servers/4bbdde5a-5ecd-47d4-961b-8adf557e94b5 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:18:02.728987 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-27a9b5a2-1267-4448-86ff-9cf9bc6c96b2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:02.730076 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-27a9b5a2-1267-4448-86ff-9cf9bc6c96b2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:02.752953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27a9b5a2-1267-4448-86ff-9cf9bc6c96b2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:02.754352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27a9b5a2-1267-4448-86ff-9cf9bc6c96b2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:02.755068 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27a9b5a2-1267-4448-86ff-9cf9bc6c96b2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:02.756015 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27a9b5a2-1267-4448-86ff-9cf9bc6c96b2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:02.757295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27a9b5a2-1267-4448-86ff-9cf9bc6c96b2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:02.757896 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27a9b5a2-1267-4448-86ff-9cf9bc6c96b2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:02.900330 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8fc6e1f2-d58b-4cad-9f58-46c1d4bbf89c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:02.910390 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8fc6e1f2-d58b-4cad-9f58-46c1d4bbf89c tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b" status: 200 len: 1236 microversion: 2.1 time: 0.288881 Aug 04 17:18:02.912178 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2668/5292] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:02 2022] GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b => generated 1236 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:03.454618 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-27a9b5a2-1267-4448-86ff-9cf9bc6c96b2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:03.463858 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-27a9b5a2-1267-4448-86ff-9cf9bc6c96b2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.739804 Aug 04 17:18:03.471741 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2625/5293] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:02 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:03.506922 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-79846464-1d70-4ba3-8d96-3f46b156a7c7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:03.508085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-79846464-1d70-4ba3-8d96-3f46b156a7c7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:03.533454 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79846464-1d70-4ba3-8d96-3f46b156a7c7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:03.535448 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79846464-1d70-4ba3-8d96-3f46b156a7c7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:03.538958 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79846464-1d70-4ba3-8d96-3f46b156a7c7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:03.541861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79846464-1d70-4ba3-8d96-3f46b156a7c7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:03.543510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79846464-1d70-4ba3-8d96-3f46b156a7c7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:03.546491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79846464-1d70-4ba3-8d96-3f46b156a7c7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:03.685601 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2b3a90c5-4f08-4a52-8981-59cafa76bc8b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:03.687573 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2b3a90c5-4f08-4a52-8981-59cafa76bc8b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:03.711239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b3a90c5-4f08-4a52-8981-59cafa76bc8b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:03.719354 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b3a90c5-4f08-4a52-8981-59cafa76bc8b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:03.720680 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b3a90c5-4f08-4a52-8981-59cafa76bc8b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:03.728864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b3a90c5-4f08-4a52-8981-59cafa76bc8b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:03.730586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b3a90c5-4f08-4a52-8981-59cafa76bc8b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:03.731325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b3a90c5-4f08-4a52-8981-59cafa76bc8b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:04.330484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-79846464-1d70-4ba3-8d96-3f46b156a7c7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:04.342602 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-79846464-1d70-4ba3-8d96-3f46b156a7c7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.842383 Aug 04 17:18:04.346792 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2669/5294] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:03 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:04.358724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8d01b4cd-7182-42fa-bdcc-9021779fb1ad tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:04.360427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8d01b4cd-7182-42fa-bdcc-9021779fb1ad tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:04.377693 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d01b4cd-7182-42fa-bdcc-9021779fb1ad tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:04.378275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d01b4cd-7182-42fa-bdcc-9021779fb1ad tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:04.378755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d01b4cd-7182-42fa-bdcc-9021779fb1ad tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:04.379553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d01b4cd-7182-42fa-bdcc-9021779fb1ad tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:04.380638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d01b4cd-7182-42fa-bdcc-9021779fb1ad tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:04.381128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d01b4cd-7182-42fa-bdcc-9021779fb1ad tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:04.690998 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2b3a90c5-4f08-4a52-8981-59cafa76bc8b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:04.693330 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8d01b4cd-7182-42fa-bdcc-9021779fb1ad tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:04.706909 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2b3a90c5-4f08-4a52-8981-59cafa76bc8b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1697 microversion: 2.1 time: 1.027398 Aug 04 17:18:04.707779 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2626/5295] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:03 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1697 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:18:04.712104 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8d01b4cd-7182-42fa-bdcc-9021779fb1ad tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b" status: 200 len: 1298 microversion: 2.1 time: 0.363898 Aug 04 17:18:04.713053 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2670/5296] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:04 2022] GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b => generated 1298 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:04.726350 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a32cdc8c-be4b-4126-bede-9de407d18d4b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-656169450", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "f20ac3e7-ddd2-4167-bdf1-b8b75ff31772"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a32cdc8c-be4b-4126-bede-9de407d18d4b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 237 Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-656169450", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "f20ac3e7-ddd2-4167-bdf1-b8b75ff31772"}]}} Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-656169450', 'imageRef': '93ebc91d-2d7a-4ab2-b133-dcf9559166d9', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'f20ac3e7-ddd2-4167-bdf1-b8b75ff31772'}]}}} Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:04.766335 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:04.772856 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:04.772856 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:04.772856 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:18:04.772856 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:18:04.772856 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:18:04.772856 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:18:04.772856 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:18:04.772856 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:18:04.772856 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:18:04.772856 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:18:04.772856 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:18:04.772856 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:18:04.772856 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:18:04.772856 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:18:04.772856 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 04 17:18:04.772856 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:04.772856 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:04.772856 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:04.772856 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:04.772856 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:04.772856 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:04.772856 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:18:04.772856 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:18:04.772856 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 04 17:18:04.772856 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:04.777364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a32cdc8c-be4b-4126-bede-9de407d18d4b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:18:04.778462 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a32cdc8c-be4b-4126-bede-9de407d18d4b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.067077 Aug 04 17:18:04.779376 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2627/5297] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:18:04 2022] POST /compute/v2.1/servers => generated 139 bytes in 70 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:18:04.790178 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3aef1f16-354d-4bd8-be89-c7790fd81f3b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:04.790835 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3aef1f16-354d-4bd8-be89-c7790fd81f3b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:04.798721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3aef1f16-354d-4bd8-be89-c7790fd81f3b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:04.799298 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3aef1f16-354d-4bd8-be89-c7790fd81f3b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:04.799638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3aef1f16-354d-4bd8-be89-c7790fd81f3b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:04.800396 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3aef1f16-354d-4bd8-be89-c7790fd81f3b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:04.801023 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3aef1f16-354d-4bd8-be89-c7790fd81f3b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:04.801530 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3aef1f16-354d-4bd8-be89-c7790fd81f3b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:05.323907 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3aef1f16-354d-4bd8-be89-c7790fd81f3b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:05.341825 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3aef1f16-354d-4bd8-be89-c7790fd81f3b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.550600 Aug 04 17:18:05.343273 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2671/5298] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:04 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:05.367346 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-20f9301e-64cd-4ab2-a97d-60045b217684 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:05.368002 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-20f9301e-64cd-4ab2-a97d-60045b217684 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:05.375511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20f9301e-64cd-4ab2-a97d-60045b217684 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:05.376040 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20f9301e-64cd-4ab2-a97d-60045b217684 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:05.376493 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20f9301e-64cd-4ab2-a97d-60045b217684 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:05.377236 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20f9301e-64cd-4ab2-a97d-60045b217684 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:05.377710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20f9301e-64cd-4ab2-a97d-60045b217684 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:05.378397 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20f9301e-64cd-4ab2-a97d-60045b217684 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:05.737178 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-508cc919-c4f6-4230-887d-63ef21544f56 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:05.739057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-508cc919-c4f6-4230-887d-63ef21544f56 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:05.762556 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:18:05.773474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-508cc919-c4f6-4230-887d-63ef21544f56 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:05.774282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-508cc919-c4f6-4230-887d-63ef21544f56 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:05.775154 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-508cc919-c4f6-4230-887d-63ef21544f56 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:05.776252 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-508cc919-c4f6-4230-887d-63ef21544f56 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:05.786409 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-508cc919-c4f6-4230-887d-63ef21544f56 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:05.787048 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-508cc919-c4f6-4230-887d-63ef21544f56 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:06.184405 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-508cc919-c4f6-4230-887d-63ef21544f56 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:06.195859 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-508cc919-c4f6-4230-887d-63ef21544f56 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b" status: 200 len: 1298 microversion: 2.1 time: 0.464903 Aug 04 17:18:06.209051 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2672/5299] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:05 2022] GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b => generated 1298 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:06.214924 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-76b482ce-1084-4678-9501-d7d1df3c727a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:06.215554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-76b482ce-1084-4678-9501-d7d1df3c727a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:06.242568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76b482ce-1084-4678-9501-d7d1df3c727a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:06.248294 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76b482ce-1084-4678-9501-d7d1df3c727a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:06.249119 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76b482ce-1084-4678-9501-d7d1df3c727a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:06.250080 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76b482ce-1084-4678-9501-d7d1df3c727a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:06.250745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76b482ce-1084-4678-9501-d7d1df3c727a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:06.251518 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76b482ce-1084-4678-9501-d7d1df3c727a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:06.610082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-20f9301e-64cd-4ab2-a97d-60045b217684 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:06.624080 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-20f9301e-64cd-4ab2-a97d-60045b217684 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 1.262780 Aug 04 17:18:06.630399 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2628/5300] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:05 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:06.797868 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-80bfc7b6-8fa9-42e7-b00f-0249832112cd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1243978157", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "f20ac3e7-ddd2-4167-bdf1-b8b75ff31772"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-80bfc7b6-8fa9-42e7-b00f-0249832112cd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 235 Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1243978157", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "f20ac3e7-ddd2-4167-bdf1-b8b75ff31772"}]}} Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1243978157', 'imageRef': '93ebc91d-2d7a-4ab2-b133-dcf9559166d9', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'f20ac3e7-ddd2-4167-bdf1-b8b75ff31772'}]}}} Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:06.802749 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:06.806984 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:06.806984 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:06.806984 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:18:06.806984 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:18:06.806984 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:18:06.806984 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:18:06.806984 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:18:06.806984 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:18:06.806984 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:18:06.806984 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:18:06.806984 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:18:06.806984 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:18:06.806984 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:18:06.806984 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:18:06.806984 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 04 17:18:06.806984 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:06.806984 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:06.806984 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:06.806984 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:06.806984 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:06.806984 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:06.806984 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:18:06.806984 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:18:06.806984 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 04 17:18:06.806984 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:06.811737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-80bfc7b6-8fa9-42e7-b00f-0249832112cd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:18:06.812929 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-80bfc7b6-8fa9-42e7-b00f-0249832112cd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.019087 Aug 04 17:18:06.814588 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2629/5301] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:18:06 2022] POST /compute/v2.1/servers => generated 133 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 17:18:06.824685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3070f9fe-340b-4299-a939-216a9d61ddcb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:06.837745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3070f9fe-340b-4299-a939-216a9d61ddcb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:06.848315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3070f9fe-340b-4299-a939-216a9d61ddcb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:06.849084 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3070f9fe-340b-4299-a939-216a9d61ddcb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:06.849702 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3070f9fe-340b-4299-a939-216a9d61ddcb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:06.850804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3070f9fe-340b-4299-a939-216a9d61ddcb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:06.851422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3070f9fe-340b-4299-a939-216a9d61ddcb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:06.852010 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3070f9fe-340b-4299-a939-216a9d61ddcb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:07.222079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-76b482ce-1084-4678-9501-d7d1df3c727a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:07.234248 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-76b482ce-1084-4678-9501-d7d1df3c727a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1697 microversion: 2.1 time: 1.023362 Aug 04 17:18:07.235280 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2673/5302] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:06 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1697 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:07.241997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e1d7beff-d89e-499c-9153-ecace28fc384 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:07.244090 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e1d7beff-d89e-499c-9153-ecace28fc384 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:07.257313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1d7beff-d89e-499c-9153-ecace28fc384 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:07.259682 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1d7beff-d89e-499c-9153-ecace28fc384 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:07.261254 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1d7beff-d89e-499c-9153-ecace28fc384 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:07.264147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1d7beff-d89e-499c-9153-ecace28fc384 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:07.265914 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1d7beff-d89e-499c-9153-ecace28fc384 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:07.266567 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e1d7beff-d89e-499c-9153-ecace28fc384 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:07.499888 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e1d7beff-d89e-499c-9153-ecace28fc384 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:07.515358 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3070f9fe-340b-4299-a939-216a9d61ddcb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:07.527089 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e1d7beff-d89e-499c-9153-ecace28fc384 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b" status: 200 len: 1298 microversion: 2.1 time: 0.290050 Aug 04 17:18:07.534748 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2674/5303] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:07 2022] GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b => generated 1298 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:07.556859 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3070f9fe-340b-4299-a939-216a9d61ddcb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.734257 Aug 04 17:18:07.557496 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2630/5304] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:06 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:07.593380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-319fa416-c6ae-4f00-b0fb-54b4428b254c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:07.599183 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-319fa416-c6ae-4f00-b0fb-54b4428b254c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:07.627333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-319fa416-c6ae-4f00-b0fb-54b4428b254c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:07.628762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-319fa416-c6ae-4f00-b0fb-54b4428b254c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:07.631277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-319fa416-c6ae-4f00-b0fb-54b4428b254c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:07.633324 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-319fa416-c6ae-4f00-b0fb-54b4428b254c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:07.635272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-319fa416-c6ae-4f00-b0fb-54b4428b254c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:07.636671 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-319fa416-c6ae-4f00-b0fb-54b4428b254c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:07.901484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-319fa416-c6ae-4f00-b0fb-54b4428b254c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:07.909998 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-319fa416-c6ae-4f00-b0fb-54b4428b254c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.331306 Aug 04 17:18:07.926005 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2675/5305] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:07 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:07.936369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-25b8bef4-dadb-496d-9aeb-449b3e15f0a0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:07.937042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-25b8bef4-dadb-496d-9aeb-449b3e15f0a0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 626e025e-f770-499c-86b4-3f0414cb7773] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:07.954016 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-25b8bef4-dadb-496d-9aeb-449b3e15f0a0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Instance 626e025e-f770-499c-86b4-3f0414cb7773 could not be found. Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-25b8bef4-dadb-496d-9aeb-449b3e15f0a0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/626e025e-f770-499c-86b4-3f0414cb7773/action HTTP/1.1 Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 13 Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: {"pause": {}} Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 626e025e-f770-499c-86b4-3f0414cb7773 could not be found. Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '626e025e-f770-499c-86b4-3f0414cb7773', 'body': {'pause': {}}} Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 626e025e-f770-499c-86b4-3f0414cb7773 could not be found. Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 626e025e-f770-499c-86b4-3f0414cb7773 could not be found. Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:07.963778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:07.968630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:18:07.968630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:18:07.968630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 626e025e-f770-499c-86b4-3f0414cb7773 could not be found. Aug 04 17:18:07.968630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:07.968630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-25b8bef4-dadb-496d-9aeb-449b3e15f0a0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 404 to user: Instance 626e025e-f770-499c-86b4-3f0414cb7773 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:18:07.968630 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-25b8bef4-dadb-496d-9aeb-449b3e15f0a0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers/626e025e-f770-499c-86b4-3f0414cb7773/action" status: 404 len: 111 microversion: 2.1 time: 0.034370 Aug 04 17:18:07.968630 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2631/5306] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:18:07 2022] POST /compute/v2.1/servers/626e025e-f770-499c-86b4-3f0414cb7773/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:18:07.978540 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a1324614-c975-4da8-8d6d-6b7fa2c258a8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:07.979199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a1324614-c975-4da8-8d6d-6b7fa2c258a8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:07.993222 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a1324614-c975-4da8-8d6d-6b7fa2c258a8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:07.993740 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a1324614-c975-4da8-8d6d-6b7fa2c258a8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:07.994244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a1324614-c975-4da8-8d6d-6b7fa2c258a8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:07.994987 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a1324614-c975-4da8-8d6d-6b7fa2c258a8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:07.995475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a1324614-c975-4da8-8d6d-6b7fa2c258a8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:07.995991 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a1324614-c975-4da8-8d6d-6b7fa2c258a8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:08.262718 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1de93b1c-9d94-4d3d-aab0-89a82a652328 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:08.263556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1de93b1c-9d94-4d3d-aab0-89a82a652328 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:08.275293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1de93b1c-9d94-4d3d-aab0-89a82a652328 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:08.279795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1de93b1c-9d94-4d3d-aab0-89a82a652328 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:08.282415 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1de93b1c-9d94-4d3d-aab0-89a82a652328 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:08.284817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1de93b1c-9d94-4d3d-aab0-89a82a652328 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:08.288721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1de93b1c-9d94-4d3d-aab0-89a82a652328 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:08.290248 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1de93b1c-9d94-4d3d-aab0-89a82a652328 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:08.299798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a1324614-c975-4da8-8d6d-6b7fa2c258a8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:08.313908 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a1324614-c975-4da8-8d6d-6b7fa2c258a8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.343050 Aug 04 17:18:08.319936 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2676/5307] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:07 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:08.344274 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b1ae5b04-d1ee-496e-9a1f-01e978260798 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:08.345238 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b1ae5b04-d1ee-496e-9a1f-01e978260798 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:08.357475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1ae5b04-d1ee-496e-9a1f-01e978260798 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:08.358787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1ae5b04-d1ee-496e-9a1f-01e978260798 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:08.359277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1ae5b04-d1ee-496e-9a1f-01e978260798 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:08.360042 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1ae5b04-d1ee-496e-9a1f-01e978260798 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:08.360522 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1ae5b04-d1ee-496e-9a1f-01e978260798 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:08.360961 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1ae5b04-d1ee-496e-9a1f-01e978260798 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:08.960745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b1ae5b04-d1ee-496e-9a1f-01e978260798 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:08.976138 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b1ae5b04-d1ee-496e-9a1f-01e978260798 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.636724 Aug 04 17:18:08.990017 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2677/5308] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:08 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:08.991424 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f5b9a8b7-f86d-4c84-ae20-1a3a2a8399d8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:08.992077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f5b9a8b7-f86d-4c84-ae20-1a3a2a8399d8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:09.011056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5b9a8b7-f86d-4c84-ae20-1a3a2a8399d8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:09.011291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5b9a8b7-f86d-4c84-ae20-1a3a2a8399d8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:09.012598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5b9a8b7-f86d-4c84-ae20-1a3a2a8399d8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:09.017343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5b9a8b7-f86d-4c84-ae20-1a3a2a8399d8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:09.017674 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5b9a8b7-f86d-4c84-ae20-1a3a2a8399d8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:09.018160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f5b9a8b7-f86d-4c84-ae20-1a3a2a8399d8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:09.053187 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1de93b1c-9d94-4d3d-aab0-89a82a652328 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:09.099368 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1de93b1c-9d94-4d3d-aab0-89a82a652328 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1697 microversion: 2.1 time: 0.842664 Aug 04 17:18:09.120366 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2632/5309] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:08 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1697 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:09.163565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d88c7782-30d4-4191-b301-63833d759755 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:09.167094 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d88c7782-30d4-4191-b301-63833d759755 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:09.195465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d88c7782-30d4-4191-b301-63833d759755 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:09.196054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d88c7782-30d4-4191-b301-63833d759755 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:09.200214 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d88c7782-30d4-4191-b301-63833d759755 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:09.206587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d88c7782-30d4-4191-b301-63833d759755 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:09.210362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d88c7782-30d4-4191-b301-63833d759755 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:09.213764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d88c7782-30d4-4191-b301-63833d759755 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:09.448188 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d88c7782-30d4-4191-b301-63833d759755 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372/action" status: 202 len: 0 microversion: 2.1 time: 0.323888 Aug 04 17:18:09.450418 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2633/5310] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:18:09 2022] POST /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:18:09.470403 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aa11a588-4273-4158-b73a-4682c3b08243 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:09.471474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aa11a588-4273-4158-b73a-4682c3b08243 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:09.480639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f5b9a8b7-f86d-4c84-ae20-1a3a2a8399d8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:09.496464 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f5b9a8b7-f86d-4c84-ae20-1a3a2a8399d8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b" status: 200 len: 1364 microversion: 2.1 time: 0.516108 Aug 04 17:18:09.497099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa11a588-4273-4158-b73a-4682c3b08243 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:09.497637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa11a588-4273-4158-b73a-4682c3b08243 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:09.501202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa11a588-4273-4158-b73a-4682c3b08243 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:09.503367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa11a588-4273-4158-b73a-4682c3b08243 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:09.506303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa11a588-4273-4158-b73a-4682c3b08243 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:09.506970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa11a588-4273-4158-b73a-4682c3b08243 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:09.515378 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2678/5311] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:08 2022] GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b => generated 1364 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:09.757208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-13946592-95b5-496b-a788-86e4a673780a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:09.757796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-13946592-95b5-496b-a788-86e4a673780a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:09.787812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13946592-95b5-496b-a788-86e4a673780a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:09.789626 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13946592-95b5-496b-a788-86e4a673780a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:09.791207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13946592-95b5-496b-a788-86e4a673780a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:09.794220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13946592-95b5-496b-a788-86e4a673780a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:09.798270 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13946592-95b5-496b-a788-86e4a673780a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:09.806870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13946592-95b5-496b-a788-86e4a673780a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:09.868733 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-13946592-95b5-496b-a788-86e4a673780a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8/ips" status: 200 len: 151 microversion: 2.20 time: 0.121305 Aug 04 17:18:09.881035 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2679/5312] 10.222.0.93 () {60 vars in 1289 bytes} [Thu Aug 4 17:18:09 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8/ips => generated 151 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:18:10.150084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-688a63f7-3cf6-433e-9446-3e391b79fd34 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:10.151578 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-688a63f7-3cf6-433e-9446-3e391b79fd34 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:10.165210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-688a63f7-3cf6-433e-9446-3e391b79fd34 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:10.165812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-688a63f7-3cf6-433e-9446-3e391b79fd34 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:10.166334 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-688a63f7-3cf6-433e-9446-3e391b79fd34 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:10.167260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-688a63f7-3cf6-433e-9446-3e391b79fd34 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:10.167806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-688a63f7-3cf6-433e-9446-3e391b79fd34 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:10.168296 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-688a63f7-3cf6-433e-9446-3e391b79fd34 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:10.722863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-aa11a588-4273-4158-b73a-4682c3b08243 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:10.750757 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aa11a588-4273-4158-b73a-4682c3b08243 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1511 microversion: 2.1 time: 1.287732 Aug 04 17:18:10.751792 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2634/5313] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:09 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1511 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:10.766865 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-65939c87-e1cd-48ca-b487-3b947a53a37b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:10.771448 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-65939c87-e1cd-48ca-b487-3b947a53a37b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:10.784774 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65939c87-e1cd-48ca-b487-3b947a53a37b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:10.789059 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65939c87-e1cd-48ca-b487-3b947a53a37b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:10.789731 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65939c87-e1cd-48ca-b487-3b947a53a37b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:10.790677 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65939c87-e1cd-48ca-b487-3b947a53a37b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:10.792952 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65939c87-e1cd-48ca-b487-3b947a53a37b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:10.793990 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65939c87-e1cd-48ca-b487-3b947a53a37b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:11.129238 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:18:11.194603 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-688a63f7-3cf6-433e-9446-3e391b79fd34 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:11.207351 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-688a63f7-3cf6-433e-9446-3e391b79fd34 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1697 microversion: 2.1 time: 1.062027 Aug 04 17:18:11.221931 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2680/5314] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:10 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1697 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:18:11.510644 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-65939c87-e1cd-48ca-b487-3b947a53a37b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:11.540506 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-65939c87-e1cd-48ca-b487-3b947a53a37b tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b" status: 200 len: 1364 microversion: 2.1 time: 0.779764 Aug 04 17:18:11.545189 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2635/5315] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:10 2022] GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b => generated 1364 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:11.594700 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-fd4c4f7e-e2d4-4551-ad5d-fc9e9365ae38 req-190c13f7-47bb-49f4-9280-09717be02bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42ede9b2-fe57-4ea9-99e0-a4617a87425b", "tag": "1a4b3e2d-010e-4229-81db-257ae011d245"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:11.625462 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-fd4c4f7e-e2d4-4551-ad5d-fc9e9365ae38 req-190c13f7-47bb-49f4-9280-09717be02bb1 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:11.626325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-fd4c4f7e-e2d4-4551-ad5d-fc9e9365ae38 req-190c13f7-47bb-49f4-9280-09717be02bb1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:11.627806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-fd4c4f7e-e2d4-4551-ad5d-fc9e9365ae38 req-190c13f7-47bb-49f4-9280-09717be02bb1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:11.686663 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-fd4c4f7e-e2d4-4551-ad5d-fc9e9365ae38 req-190c13f7-47bb-49f4-9280-09717be02bb1 service nova] Creating event network-changed:1a4b3e2d-010e-4229-81db-257ae011d245 for instance 42ede9b2-fe57-4ea9-99e0-a4617a87425b on n-h1-851359-3 Aug 04 17:18:11.712993 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-fd4c4f7e-e2d4-4551-ad5d-fc9e9365ae38 req-190c13f7-47bb-49f4-9280-09717be02bb1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128194 Aug 04 17:18:11.720646 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2681/5316] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:18:11.778977 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3e209260-8876-484b-8385-3eba55790b6f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:11.779805 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3e209260-8876-484b-8385-3eba55790b6f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:11.788026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=8 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:18:11.805497 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e209260-8876-484b-8385-3eba55790b6f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:11.813044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e209260-8876-484b-8385-3eba55790b6f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:11.814364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e209260-8876-484b-8385-3eba55790b6f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:11.818241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e209260-8876-484b-8385-3eba55790b6f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:11.819794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e209260-8876-484b-8385-3eba55790b6f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:11.823032 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e209260-8876-484b-8385-3eba55790b6f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:12.250846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-242548cd-d2f3-4b28-b7d2-735ff23472cf tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:12.254820 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-242548cd-d2f3-4b28-b7d2-735ff23472cf tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:12.274193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-242548cd-d2f3-4b28-b7d2-735ff23472cf tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:12.275286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-242548cd-d2f3-4b28-b7d2-735ff23472cf tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:12.275937 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-242548cd-d2f3-4b28-b7d2-735ff23472cf tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:12.279177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-242548cd-d2f3-4b28-b7d2-735ff23472cf tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:12.280251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-242548cd-d2f3-4b28-b7d2-735ff23472cf tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:12.281030 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-242548cd-d2f3-4b28-b7d2-735ff23472cf tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:13.107474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-242548cd-d2f3-4b28-b7d2-735ff23472cf tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:13.116329 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-242548cd-d2f3-4b28-b7d2-735ff23472cf tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1697 microversion: 2.1 time: 0.889939 Aug 04 17:18:13.147337 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2682/5317] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:12 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1697 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:13.154269 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f0e4fd8b-baa4-4916-83b7-fc594dbb59c7 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:13.155156 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f0e4fd8b-baa4-4916-83b7-fc594dbb59c7 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:13.162511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f0e4fd8b-baa4-4916-83b7-fc594dbb59c7 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:13.163684 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f0e4fd8b-baa4-4916-83b7-fc594dbb59c7 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:13.164327 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f0e4fd8b-baa4-4916-83b7-fc594dbb59c7 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:13.165762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f0e4fd8b-baa4-4916-83b7-fc594dbb59c7 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:13.166445 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f0e4fd8b-baa4-4916-83b7-fc594dbb59c7 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:13.167050 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f0e4fd8b-baa4-4916-83b7-fc594dbb59c7 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:13.241001 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3e209260-8876-484b-8385-3eba55790b6f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:13.258102 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3e209260-8876-484b-8385-3eba55790b6f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1491 microversion: 2.1 time: 1.482636 Aug 04 17:18:13.258102 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2636/5318] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:11 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1491 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:18:13.278639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c38f22f7-7c83-4fe8-a86f-addcc0cee1a5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:13.279191 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c38f22f7-7c83-4fe8-a86f-addcc0cee1a5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:13.286825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c38f22f7-7c83-4fe8-a86f-addcc0cee1a5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:13.287424 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c38f22f7-7c83-4fe8-a86f-addcc0cee1a5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:13.288100 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c38f22f7-7c83-4fe8-a86f-addcc0cee1a5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:13.289963 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c38f22f7-7c83-4fe8-a86f-addcc0cee1a5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:13.291207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c38f22f7-7c83-4fe8-a86f-addcc0cee1a5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:13.292888 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c38f22f7-7c83-4fe8-a86f-addcc0cee1a5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:13.345374 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-c38f22f7-7c83-4fe8-a86f-addcc0cee1a5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Cannot 'pause' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state paused Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c38f22f7-7c83-4fe8-a86f-addcc0cee1a5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372/action HTTP/1.1 Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 13 Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: {"pause": {}} Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: exception: Cannot 'pause' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state paused Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '5248dcdc-5a16-4036-9537-eb84f73dc372', 'body': {'pause': {}}} Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5248dcdc-5a16-4036-9537-eb84f73dc372 in vm_state paused. Cannot pause while the instance is in this state. Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state paused Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:13.347080 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:13.353283 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:13.353283 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:18:13.353283 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:18:13.353283 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state paused Aug 04 17:18:13.353283 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:13.353283 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c38f22f7-7c83-4fe8-a86f-addcc0cee1a5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 409 to user: Cannot 'pause' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state paused {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:18:13.353283 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c38f22f7-7c83-4fe8-a86f-addcc0cee1a5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372/action" status: 409 len: 143 microversion: 2.1 time: 0.073864 Aug 04 17:18:13.353283 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2637/5319] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:18:13 2022] POST /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372/action => generated 143 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 04 17:18:13.364366 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8bf4261d-4fd2-41d2-9959-43e885ad1713 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:13.364897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8bf4261d-4fd2-41d2-9959-43e885ad1713 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:13.374400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8bf4261d-4fd2-41d2-9959-43e885ad1713 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:13.375061 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8bf4261d-4fd2-41d2-9959-43e885ad1713 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:13.375512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8bf4261d-4fd2-41d2-9959-43e885ad1713 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:13.376240 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8bf4261d-4fd2-41d2-9959-43e885ad1713 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:13.376702 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8bf4261d-4fd2-41d2-9959-43e885ad1713 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:13.377125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8bf4261d-4fd2-41d2-9959-43e885ad1713 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:13.534183 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8bf4261d-4fd2-41d2-9959-43e885ad1713 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372/action" status: 202 len: 0 microversion: 2.1 time: 0.179720 Aug 04 17:18:13.536262 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2638/5320] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:18:13 2022] POST /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:18:13.548027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-477928f8-c8e0-471f-9895-9a1ea128afe3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:13.549047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-477928f8-c8e0-471f-9895-9a1ea128afe3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:13.561430 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-477928f8-c8e0-471f-9895-9a1ea128afe3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:13.562622 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-477928f8-c8e0-471f-9895-9a1ea128afe3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:13.563346 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-477928f8-c8e0-471f-9895-9a1ea128afe3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:13.565173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-477928f8-c8e0-471f-9895-9a1ea128afe3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:13.566172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-477928f8-c8e0-471f-9895-9a1ea128afe3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:13.566862 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-477928f8-c8e0-471f-9895-9a1ea128afe3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:13.636228 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-477928f8-c8e0-471f-9895-9a1ea128afe3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lazy-loading 'flavor' on Instance uuid e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:18:13.805058 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f0e4fd8b-baa4-4916-83b7-fc594dbb59c7 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:13.814815 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f0e4fd8b-baa4-4916-83b7-fc594dbb59c7 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b" status: 200 len: 1364 microversion: 2.1 time: 0.665812 Aug 04 17:18:13.821298 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2683/5321] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:13 2022] GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b => generated 1364 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:13.841704 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-782090c4-c73f-4544-b5d7-fdba3502aab1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:13.846405 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-782090c4-c73f-4544-b5d7-fdba3502aab1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:13.870172 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-782090c4-c73f-4544-b5d7-fdba3502aab1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:13.871279 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-782090c4-c73f-4544-b5d7-fdba3502aab1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:13.871971 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-782090c4-c73f-4544-b5d7-fdba3502aab1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:13.873245 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-782090c4-c73f-4544-b5d7-fdba3502aab1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:13.874269 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-782090c4-c73f-4544-b5d7-fdba3502aab1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:13.875093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-782090c4-c73f-4544-b5d7-fdba3502aab1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:14.075694 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-477928f8-c8e0-471f-9895-9a1ea128afe3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "POST /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8/action" status: 202 len: 0 microversion: 2.20 time: 0.535661 Aug 04 17:18:14.077514 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2639/5322] 10.222.0.93 () {62 vars in 1319 bytes} [Thu Aug 4 17:18:13 2022] POST /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8/action => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:18:14.099430 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c62d9d5f-d352-4ac5-9835-91537403ff5a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:14.101652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c62d9d5f-d352-4ac5-9835-91537403ff5a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:14.118955 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c62d9d5f-d352-4ac5-9835-91537403ff5a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:14.119991 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c62d9d5f-d352-4ac5-9835-91537403ff5a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:14.120851 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c62d9d5f-d352-4ac5-9835-91537403ff5a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:14.122017 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c62d9d5f-d352-4ac5-9835-91537403ff5a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:14.122971 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c62d9d5f-d352-4ac5-9835-91537403ff5a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:14.123816 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c62d9d5f-d352-4ac5-9835-91537403ff5a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:14.393875 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-782090c4-c73f-4544-b5d7-fdba3502aab1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:14.402985 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-782090c4-c73f-4544-b5d7-fdba3502aab1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1498 microversion: 2.1 time: 0.578162 Aug 04 17:18:14.403473 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2684/5323] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:13 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1498 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:14.423077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-88e90744-0f94-468d-a13f-9f1badfcd1ea tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:14.423977 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-88e90744-0f94-468d-a13f-9f1badfcd1ea tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:14.444496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88e90744-0f94-468d-a13f-9f1badfcd1ea tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:14.445541 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88e90744-0f94-468d-a13f-9f1badfcd1ea tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:14.446662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88e90744-0f94-468d-a13f-9f1badfcd1ea tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:14.451812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88e90744-0f94-468d-a13f-9f1badfcd1ea tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:14.452751 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88e90744-0f94-468d-a13f-9f1badfcd1ea tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:14.453537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-88e90744-0f94-468d-a13f-9f1badfcd1ea tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:14.514936 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:18:14.555732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c62d9d5f-d352-4ac5-9835-91537403ff5a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:14.560634 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:18:14.601795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c62d9d5f-d352-4ac5-9835-91537403ff5a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:14.603850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c62d9d5f-d352-4ac5-9835-91537403ff5a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:14.607427 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c62d9d5f-d352-4ac5-9835-91537403ff5a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1724 microversion: 2.20 time: 0.521061 Aug 04 17:18:14.611056 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2640/5324] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:18:14 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1724 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:18:14.844784 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a0f0c227-2114-44d2-81d1-b90e022d549f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:14.845649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a0f0c227-2114-44d2-81d1-b90e022d549f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:14.862797 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0f0c227-2114-44d2-81d1-b90e022d549f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:14.863702 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0f0c227-2114-44d2-81d1-b90e022d549f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:14.864496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0f0c227-2114-44d2-81d1-b90e022d549f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:14.865834 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0f0c227-2114-44d2-81d1-b90e022d549f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:14.866568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0f0c227-2114-44d2-81d1-b90e022d549f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:14.867265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0f0c227-2114-44d2-81d1-b90e022d549f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:15.205701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-88e90744-0f94-468d-a13f-9f1badfcd1ea tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:15.220885 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-88e90744-0f94-468d-a13f-9f1badfcd1ea tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1697 microversion: 2.1 time: 0.799975 Aug 04 17:18:15.222117 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2685/5325] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:14 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1697 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:15.437371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-354b58eb-b068-442e-8697-e1dcb75c351b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:15.438037 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-354b58eb-b068-442e-8697-e1dcb75c351b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:15.455057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-354b58eb-b068-442e-8697-e1dcb75c351b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:15.455511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-354b58eb-b068-442e-8697-e1dcb75c351b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:15.456150 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-354b58eb-b068-442e-8697-e1dcb75c351b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:15.456884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-354b58eb-b068-442e-8697-e1dcb75c351b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:15.457524 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-354b58eb-b068-442e-8697-e1dcb75c351b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:15.470705 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-354b58eb-b068-442e-8697-e1dcb75c351b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:15.723117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a0f0c227-2114-44d2-81d1-b90e022d549f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:15.735662 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a0f0c227-2114-44d2-81d1-b90e022d549f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b" status: 200 len: 1364 microversion: 2.1 time: 0.894519 Aug 04 17:18:15.746192 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2641/5326] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:14 2022] GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b => generated 1364 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:18:15.762624 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-528b74b0-e8a5-4622-ba75-013d8b268ea3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:15.764175 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-528b74b0-e8a5-4622-ba75-013d8b268ea3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:15.787036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-528b74b0-e8a5-4622-ba75-013d8b268ea3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:15.787778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-528b74b0-e8a5-4622-ba75-013d8b268ea3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:15.788507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-528b74b0-e8a5-4622-ba75-013d8b268ea3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:15.789571 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-528b74b0-e8a5-4622-ba75-013d8b268ea3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:15.790739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-528b74b0-e8a5-4622-ba75-013d8b268ea3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:15.790987 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-528b74b0-e8a5-4622-ba75-013d8b268ea3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:16.045608 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-354b58eb-b068-442e-8697-e1dcb75c351b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:16.066279 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-354b58eb-b068-442e-8697-e1dcb75c351b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.631931 Aug 04 17:18:16.069439 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2686/5327] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:15 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:18:16.108419 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-73fadf19-8ffd-4671-9f18-e3e4c1a3a2f7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:16.111411 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-73fadf19-8ffd-4671-9f18-e3e4c1a3a2f7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:16.138450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73fadf19-8ffd-4671-9f18-e3e4c1a3a2f7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:16.141383 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73fadf19-8ffd-4671-9f18-e3e4c1a3a2f7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:16.143881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73fadf19-8ffd-4671-9f18-e3e4c1a3a2f7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:16.144491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73fadf19-8ffd-4671-9f18-e3e4c1a3a2f7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:16.145859 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73fadf19-8ffd-4671-9f18-e3e4c1a3a2f7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:16.146804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73fadf19-8ffd-4671-9f18-e3e4c1a3a2f7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:17.015360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-528b74b0-e8a5-4622-ba75-013d8b268ea3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:17.043060 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-528b74b0-e8a5-4622-ba75-013d8b268ea3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:17.046733 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-528b74b0-e8a5-4622-ba75-013d8b268ea3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:17.053133 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-528b74b0-e8a5-4622-ba75-013d8b268ea3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1724 microversion: 2.20 time: 1.301936 Aug 04 17:18:17.056520 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2642/5328] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:18:15 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1724 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:18:17.075087 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1068bf27-941f-42de-acd3-292a79fd4019 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:17.077732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1068bf27-941f-42de-acd3-292a79fd4019 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:17.104239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1068bf27-941f-42de-acd3-292a79fd4019 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:17.105768 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1068bf27-941f-42de-acd3-292a79fd4019 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:17.108737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1068bf27-941f-42de-acd3-292a79fd4019 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:17.110229 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1068bf27-941f-42de-acd3-292a79fd4019 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:17.114352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1068bf27-941f-42de-acd3-292a79fd4019 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:17.117453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1068bf27-941f-42de-acd3-292a79fd4019 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:17.119249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-73fadf19-8ffd-4671-9f18-e3e4c1a3a2f7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:17.127793 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-73fadf19-8ffd-4671-9f18-e3e4c1a3a2f7 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 1.036590 Aug 04 17:18:17.133906 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2687/5329] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:16 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:17.150078 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3304c325-48e4-4227-b321-f83e35cf53f8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:17.151110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3304c325-48e4-4227-b321-f83e35cf53f8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:17.157825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3304c325-48e4-4227-b321-f83e35cf53f8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:17.166796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3304c325-48e4-4227-b321-f83e35cf53f8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:17.167412 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3304c325-48e4-4227-b321-f83e35cf53f8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:17.168307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3304c325-48e4-4227-b321-f83e35cf53f8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:17.168899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3304c325-48e4-4227-b321-f83e35cf53f8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:17.169441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3304c325-48e4-4227-b321-f83e35cf53f8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:18.397576 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1068bf27-941f-42de-acd3-292a79fd4019 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:18.428245 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1068bf27-941f-42de-acd3-292a79fd4019 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1697 microversion: 2.1 time: 1.366421 Aug 04 17:18:18.451907 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2643/5330] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:17 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1697 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:18.476205 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dd4543a2-6736-400c-baf2-064ba6313ac8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:18.488827 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dd4543a2-6736-400c-baf2-064ba6313ac8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:18.516881 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd4543a2-6736-400c-baf2-064ba6313ac8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:18.520701 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd4543a2-6736-400c-baf2-064ba6313ac8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:18.522245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd4543a2-6736-400c-baf2-064ba6313ac8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:18.528758 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd4543a2-6736-400c-baf2-064ba6313ac8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:18.530279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd4543a2-6736-400c-baf2-064ba6313ac8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:18.531126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd4543a2-6736-400c-baf2-064ba6313ac8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:18.573151 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-dd4543a2-6736-400c-baf2-064ba6313ac8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Instance aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb could not be found. Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dd4543a2-6736-400c-baf2-064ba6313ac8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb/action HTTP/1.1 Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 28 Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: {"reboot": {"type": "SOFT"}} Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb could not be found. Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb', 'body': {'reboot': {'type': 'SOFT'}}} Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb could not be found. Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:18:18.580402 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:18:18.587511 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb could not be found. Aug 04 17:18:18.587511 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:18.587511 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:18.587511 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:18.587511 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:18.587511 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:18.587511 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:18.587511 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:18:18.587511 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:18:18.587511 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb could not be found. Aug 04 17:18:18.587511 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:18.592185 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dd4543a2-6736-400c-baf2-064ba6313ac8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 404 to user: Instance aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:18:18.597330 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dd4543a2-6736-400c-baf2-064ba6313ac8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb/action" status: 404 len: 111 microversion: 2.1 time: 0.143628 Aug 04 17:18:18.599532 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2644/5331] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:18:18 2022] POST /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb/action => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:18:18.615298 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b4a13d98-a963-4cfe-a40b-b00edf06010a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:18.615926 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b4a13d98-a963-4cfe-a40b-b00edf06010a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:18.630940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4a13d98-a963-4cfe-a40b-b00edf06010a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:18.631439 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4a13d98-a963-4cfe-a40b-b00edf06010a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:18.631882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4a13d98-a963-4cfe-a40b-b00edf06010a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:18.632592 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4a13d98-a963-4cfe-a40b-b00edf06010a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:18.634836 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4a13d98-a963-4cfe-a40b-b00edf06010a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:18.635312 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4a13d98-a963-4cfe-a40b-b00edf06010a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:19.116148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3304c325-48e4-4227-b321-f83e35cf53f8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:19.126450 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3304c325-48e4-4227-b321-f83e35cf53f8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b" status: 200 len: 1364 microversion: 2.1 time: 1.990811 Aug 04 17:18:19.132120 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2688/5332] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:17 2022] GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b => generated 1364 bytes in 1997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:19.144884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-95e6b66b-4b30-4f73-a536-a81f03b06cb0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:19.148498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-95e6b66b-4b30-4f73-a536-a81f03b06cb0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:19.161370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95e6b66b-4b30-4f73-a536-a81f03b06cb0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:19.164807 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95e6b66b-4b30-4f73-a536-a81f03b06cb0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:19.165430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95e6b66b-4b30-4f73-a536-a81f03b06cb0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:19.167215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95e6b66b-4b30-4f73-a536-a81f03b06cb0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:19.168970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95e6b66b-4b30-4f73-a536-a81f03b06cb0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:19.178942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95e6b66b-4b30-4f73-a536-a81f03b06cb0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:19.687440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b4a13d98-a963-4cfe-a40b-b00edf06010a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:19.706642 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b4a13d98-a963-4cfe-a40b-b00edf06010a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:19.713803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b4a13d98-a963-4cfe-a40b-b00edf06010a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:19.719228 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b4a13d98-a963-4cfe-a40b-b00edf06010a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1724 microversion: 2.20 time: 1.116965 Aug 04 17:18:19.730611 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2645/5333] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:18:18 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1724 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:18:19.741197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2879be25-38a4-4fe5-bc7a-d04756eb92c4 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:19.742346 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2879be25-38a4-4fe5-bc7a-d04756eb92c4 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:19.757401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2879be25-38a4-4fe5-bc7a-d04756eb92c4 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:19.757911 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2879be25-38a4-4fe5-bc7a-d04756eb92c4 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:19.758382 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2879be25-38a4-4fe5-bc7a-d04756eb92c4 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:19.763679 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2879be25-38a4-4fe5-bc7a-d04756eb92c4 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:19.764245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2879be25-38a4-4fe5-bc7a-d04756eb92c4 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:19.764770 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2879be25-38a4-4fe5-bc7a-d04756eb92c4 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:19.765720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-95e6b66b-4b30-4f73-a536-a81f03b06cb0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:19.780993 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-95e6b66b-4b30-4f73-a536-a81f03b06cb0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.647557 Aug 04 17:18:19.794101 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2689/5334] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:19 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:19.820780 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b3f0bd75-e08e-4871-9710-5f2a546cf720 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:19.821570 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b3f0bd75-e08e-4871-9710-5f2a546cf720 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:19.834552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3f0bd75-e08e-4871-9710-5f2a546cf720 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:19.835211 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3f0bd75-e08e-4871-9710-5f2a546cf720 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:19.835815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3f0bd75-e08e-4871-9710-5f2a546cf720 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:19.836650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3f0bd75-e08e-4871-9710-5f2a546cf720 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:19.844774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3f0bd75-e08e-4871-9710-5f2a546cf720 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:19.845299 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3f0bd75-e08e-4871-9710-5f2a546cf720 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:20.443602 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2879be25-38a4-4fe5-bc7a-d04756eb92c4 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:20.452338 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2879be25-38a4-4fe5-bc7a-d04756eb92c4 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1697 microversion: 2.1 time: 0.727595 Aug 04 17:18:20.452928 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2646/5335] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:19 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1697 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:20.473467 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7e06c16f-593b-42a1-a27b-e4172bf27bb0 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:20.474472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7e06c16f-593b-42a1-a27b-e4172bf27bb0 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:20.492093 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e06c16f-593b-42a1-a27b-e4172bf27bb0 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:20.492788 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e06c16f-593b-42a1-a27b-e4172bf27bb0 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:20.493446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e06c16f-593b-42a1-a27b-e4172bf27bb0 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:20.496458 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e06c16f-593b-42a1-a27b-e4172bf27bb0 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:20.498221 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e06c16f-593b-42a1-a27b-e4172bf27bb0 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:20.501763 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e06c16f-593b-42a1-a27b-e4172bf27bb0 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:20.588155 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b3f0bd75-e08e-4871-9710-5f2a546cf720 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:20.650854 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b3f0bd75-e08e-4871-9710-5f2a546cf720 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.830147 Aug 04 17:18:20.654739 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2690/5336] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:19 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:18:20.684793 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e251b6ec-3539-442b-95fc-b08c5e2401b1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:20.693560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e251b6ec-3539-442b-95fc-b08c5e2401b1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 55ec41fc-bf91-4a31-832b-567c9143892d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:20.712703 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-e251b6ec-3539-442b-95fc-b08c5e2401b1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Instance 55ec41fc-bf91-4a31-832b-567c9143892d could not be found. Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e251b6ec-3539-442b-95fc-b08c5e2401b1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers/55ec41fc-bf91-4a31-832b-567c9143892d/action HTTP/1.1 Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 28 Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: {"reboot": {"type": "SOFT"}} Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 55ec41fc-bf91-4a31-832b-567c9143892d could not be found. Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '55ec41fc-bf91-4a31-832b-567c9143892d', 'body': {'reboot': {'type': 'SOFT'}}} Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55ec41fc-bf91-4a31-832b-567c9143892d could not be found. Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55ec41fc-bf91-4a31-832b-567c9143892d could not be found. Aug 04 17:18:20.725037 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:20.730189 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:20.730189 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:20.730189 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:20.730189 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:20.730189 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:20.730189 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:18:20.730189 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:18:20.730189 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55ec41fc-bf91-4a31-832b-567c9143892d could not be found. Aug 04 17:18:20.730189 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:20.732970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e251b6ec-3539-442b-95fc-b08c5e2401b1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 404 to user: Instance 55ec41fc-bf91-4a31-832b-567c9143892d could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:18:20.734105 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e251b6ec-3539-442b-95fc-b08c5e2401b1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers/55ec41fc-bf91-4a31-832b-567c9143892d/action" status: 404 len: 111 microversion: 2.1 time: 0.058040 Aug 04 17:18:20.735724 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2691/5337] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:18:20 2022] POST /compute/v2.1/servers/55ec41fc-bf91-4a31-832b-567c9143892d/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:18:20.764486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d60940e9-74c3-4b61-a74d-cf1444d1a87b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:20.772236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d60940e9-74c3-4b61-a74d-cf1444d1a87b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:20.782975 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d60940e9-74c3-4b61-a74d-cf1444d1a87b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:20.783829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d60940e9-74c3-4b61-a74d-cf1444d1a87b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:20.784527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d60940e9-74c3-4b61-a74d-cf1444d1a87b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:20.786102 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d60940e9-74c3-4b61-a74d-cf1444d1a87b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:20.786758 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d60940e9-74c3-4b61-a74d-cf1444d1a87b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:20.787362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d60940e9-74c3-4b61-a74d-cf1444d1a87b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:20.847070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7e06c16f-593b-42a1-a27b-e4172bf27bb0 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:20.859329 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7e06c16f-593b-42a1-a27b-e4172bf27bb0 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b" status: 200 len: 1364 microversion: 2.1 time: 0.391875 Aug 04 17:18:20.860199 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2647/5338] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:20 2022] GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b => generated 1364 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:20.866506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-54ecc603-1feb-439a-adcd-ff70966ccefe tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:20.867937 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-54ecc603-1feb-439a-adcd-ff70966ccefe tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:20.882728 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54ecc603-1feb-439a-adcd-ff70966ccefe tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:20.883521 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54ecc603-1feb-439a-adcd-ff70966ccefe tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:20.884156 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54ecc603-1feb-439a-adcd-ff70966ccefe tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:20.885563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54ecc603-1feb-439a-adcd-ff70966ccefe tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:20.886867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54ecc603-1feb-439a-adcd-ff70966ccefe tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:20.887953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54ecc603-1feb-439a-adcd-ff70966ccefe tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:21.375125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-54ecc603-1feb-439a-adcd-ff70966ccefe tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:21.383394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d60940e9-74c3-4b61-a74d-cf1444d1a87b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:21.396231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-54ecc603-1feb-439a-adcd-ff70966ccefe tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:21.398599 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-54ecc603-1feb-439a-adcd-ff70966ccefe tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:21.400843 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-54ecc603-1feb-439a-adcd-ff70966ccefe tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1724 microversion: 2.20 time: 0.539113 Aug 04 17:18:21.402504 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d60940e9-74c3-4b61-a74d-cf1444d1a87b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.660300 Aug 04 17:18:21.403856 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2692/5339] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:20 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:21.404917 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2648/5340] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:18:20 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1724 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:18:21.423002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-15762e2f-6f35-4ed1-90e2-397571577467 req-962edc7d-fd07-44ef-8ca8-af1e4cd46586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42ede9b2-fe57-4ea9-99e0-a4617a87425b", "name": "network-vif-plugged", "status": "completed", "tag": "1a4b3e2d-010e-4229-81db-257ae011d245"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:21.432445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a28dc5c2-8db4-4b29-9d94-18a8b5ad2e3c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:21.439628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a28dc5c2-8db4-4b29-9d94-18a8b5ad2e3c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:21.444213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-15762e2f-6f35-4ed1-90e2-397571577467 req-962edc7d-fd07-44ef-8ca8-af1e4cd46586 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:21.444965 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-15762e2f-6f35-4ed1-90e2-397571577467 req-962edc7d-fd07-44ef-8ca8-af1e4cd46586 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:21.445568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-15762e2f-6f35-4ed1-90e2-397571577467 req-962edc7d-fd07-44ef-8ca8-af1e4cd46586 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:21.448904 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a28dc5c2-8db4-4b29-9d94-18a8b5ad2e3c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:21.449747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a28dc5c2-8db4-4b29-9d94-18a8b5ad2e3c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:21.458429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a28dc5c2-8db4-4b29-9d94-18a8b5ad2e3c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:21.459800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a28dc5c2-8db4-4b29-9d94-18a8b5ad2e3c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:21.460607 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-15762e2f-6f35-4ed1-90e2-397571577467 req-962edc7d-fd07-44ef-8ca8-af1e4cd46586 service nova] Creating event network-vif-plugged:1a4b3e2d-010e-4229-81db-257ae011d245 for instance 42ede9b2-fe57-4ea9-99e0-a4617a87425b on n-h1-851359-3 Aug 04 17:18:21.460764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a28dc5c2-8db4-4b29-9d94-18a8b5ad2e3c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:21.461140 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a28dc5c2-8db4-4b29-9d94-18a8b5ad2e3c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:21.466489 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-15762e2f-6f35-4ed1-90e2-397571577467 req-962edc7d-fd07-44ef-8ca8-af1e4cd46586 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047257 Aug 04 17:18:21.473350 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2693/5341] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:18:21.480035 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bc7bdd13-b114-4cdd-9a59-2cf16725db43 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:21.481001 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bc7bdd13-b114-4cdd-9a59-2cf16725db43 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:21.490071 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc7bdd13-b114-4cdd-9a59-2cf16725db43 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:21.491432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc7bdd13-b114-4cdd-9a59-2cf16725db43 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:21.492461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc7bdd13-b114-4cdd-9a59-2cf16725db43 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:21.493392 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc7bdd13-b114-4cdd-9a59-2cf16725db43 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:21.494054 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc7bdd13-b114-4cdd-9a59-2cf16725db43 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:21.494734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc7bdd13-b114-4cdd-9a59-2cf16725db43 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:21.876732 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bc7bdd13-b114-4cdd-9a59-2cf16725db43 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:21.878673 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a28dc5c2-8db4-4b29-9d94-18a8b5ad2e3c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:21.888866 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a28dc5c2-8db4-4b29-9d94-18a8b5ad2e3c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.461173 Aug 04 17:18:21.889465 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2649/5342] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:21 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:18:21.909094 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-4e4f10c9-0f0a-458a-81db-f102b11a35bd req-23c32340-7ef0-4e97-b0a4-3cf380c27fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6b1716-bb14-4f97-bc75-38403c1c1af0", "name": "network-vif-unplugged", "status": "completed", "tag": "1e3189db-ad91-4d9e-bfe5-7b700963e0d9"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:21.917008 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bc7bdd13-b114-4cdd-9a59-2cf16725db43 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1696 microversion: 2.1 time: 0.441573 Aug 04 17:18:21.918038 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2694/5343] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:21 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1696 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:21.937400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4e4f10c9-0f0a-458a-81db-f102b11a35bd req-23c32340-7ef0-4e97-b0a4-3cf380c27fb5 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:21.937557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4e4f10c9-0f0a-458a-81db-f102b11a35bd req-23c32340-7ef0-4e97-b0a4-3cf380c27fb5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:21.938001 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4e4f10c9-0f0a-458a-81db-f102b11a35bd req-23c32340-7ef0-4e97-b0a4-3cf380c27fb5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:21.944550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ed3c3303-7301-45b8-9914-e2b7f8640280 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:21.955611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ed3c3303-7301-45b8-9914-e2b7f8640280 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:21.975770 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed3c3303-7301-45b8-9914-e2b7f8640280 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:21.984651 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed3c3303-7301-45b8-9914-e2b7f8640280 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:21.985219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed3c3303-7301-45b8-9914-e2b7f8640280 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:21.986034 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed3c3303-7301-45b8-9914-e2b7f8640280 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:21.986510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed3c3303-7301-45b8-9914-e2b7f8640280 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:21.986949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed3c3303-7301-45b8-9914-e2b7f8640280 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:21.997641 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-4e4f10c9-0f0a-458a-81db-f102b11a35bd req-23c32340-7ef0-4e97-b0a4-3cf380c27fb5 service nova] Creating event network-vif-unplugged:1e3189db-ad91-4d9e-bfe5-7b700963e0d9 for instance 9c6b1716-bb14-4f97-bc75-38403c1c1af0 on n-h1-851359-3 Aug 04 17:18:22.015302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-4e4f10c9-0f0a-458a-81db-f102b11a35bd req-23c32340-7ef0-4e97-b0a4-3cf380c27fb5 service nova] Instance 9c6b1716-bb14-4f97-bc75-38403c1c1af0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:18:22.046627 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-4e4f10c9-0f0a-458a-81db-f102b11a35bd req-23c32340-7ef0-4e97-b0a4-3cf380c27fb5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.155575 Aug 04 17:18:22.047405 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2650/5344] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:18:22.065464 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-84bdba96-ff1b-44ad-8fbe-5a71b178d209 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:22.079630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-84bdba96-ff1b-44ad-8fbe-5a71b178d209 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:22.096703 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84bdba96-ff1b-44ad-8fbe-5a71b178d209 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:22.097657 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84bdba96-ff1b-44ad-8fbe-5a71b178d209 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:22.098604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84bdba96-ff1b-44ad-8fbe-5a71b178d209 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:22.105945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84bdba96-ff1b-44ad-8fbe-5a71b178d209 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:22.106757 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84bdba96-ff1b-44ad-8fbe-5a71b178d209 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:22.107557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84bdba96-ff1b-44ad-8fbe-5a71b178d209 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:22.163121 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-84bdba96-ff1b-44ad-8fbe-5a71b178d209 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Instance aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb could not be found. Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-84bdba96-ff1b-44ad-8fbe-5a71b178d209 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb/action HTTP/1.1 Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 65 Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: {"rebuild": {"imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9"}} Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb could not be found. Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb', 'body': {'rebuild': {'imageRef': '93ebc91d-2d7a-4ab2-b133-dcf9559166d9'}}} Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb could not be found. Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 04 17:18:22.172363 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 04 17:18:22.177598 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 04 17:18:22.177598 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:18:22.177598 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:18:22.177598 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:18:22.177598 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:18:22.177598 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb could not be found. Aug 04 17:18:22.177598 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:22.177598 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:22.177598 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:22.177598 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:22.177598 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:22.177598 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:22.177598 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:18:22.177598 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:18:22.177598 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb could not be found. Aug 04 17:18:22.177598 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:22.181488 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-84bdba96-ff1b-44ad-8fbe-5a71b178d209 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 404 to user: Instance aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:18:22.183113 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-84bdba96-ff1b-44ad-8fbe-5a71b178d209 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb/action" status: 404 len: 111 microversion: 2.1 time: 0.133414 Aug 04 17:18:22.183912 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2651/5345] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:18:22 2022] POST /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb/action => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:18:22.194606 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-568b8373-68c9-4029-a0fb-f736e25d86b6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:22.195588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-568b8373-68c9-4029-a0fb-f736e25d86b6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:22.211705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-568b8373-68c9-4029-a0fb-f736e25d86b6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:22.212218 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-568b8373-68c9-4029-a0fb-f736e25d86b6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:22.212661 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-568b8373-68c9-4029-a0fb-f736e25d86b6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:22.219808 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-568b8373-68c9-4029-a0fb-f736e25d86b6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:22.220450 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-568b8373-68c9-4029-a0fb-f736e25d86b6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:22.220902 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-568b8373-68c9-4029-a0fb-f736e25d86b6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:23.069541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-568b8373-68c9-4029-a0fb-f736e25d86b6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:23.077943 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-568b8373-68c9-4029-a0fb-f736e25d86b6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.889283 Aug 04 17:18:23.093540 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2652/5346] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:22 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:18:23.093955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ed3c3303-7301-45b8-9914-e2b7f8640280 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:23.093955 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ed3c3303-7301-45b8-9914-e2b7f8640280 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b" status: 200 len: 1364 microversion: 2.1 time: 1.170345 Aug 04 17:18:23.093955 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2695/5347] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:21 2022] GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b => generated 1364 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:23.104697 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3bbd3b8d-85f5-4ab0-8079-2d595dc506c1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:23.105595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3bbd3b8d-85f5-4ab0-8079-2d595dc506c1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:23.109496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bf82c6d6-7e08-472b-88ff-4e95098cc1a8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:23.110409 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bf82c6d6-7e08-472b-88ff-4e95098cc1a8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:23.117268 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bbd3b8d-85f5-4ab0-8079-2d595dc506c1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:23.118269 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bbd3b8d-85f5-4ab0-8079-2d595dc506c1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:23.119055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bbd3b8d-85f5-4ab0-8079-2d595dc506c1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:23.119885 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf82c6d6-7e08-472b-88ff-4e95098cc1a8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:23.120150 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bbd3b8d-85f5-4ab0-8079-2d595dc506c1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:23.120618 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf82c6d6-7e08-472b-88ff-4e95098cc1a8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:23.120976 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bbd3b8d-85f5-4ab0-8079-2d595dc506c1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:23.121279 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf82c6d6-7e08-472b-88ff-4e95098cc1a8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:23.121769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bbd3b8d-85f5-4ab0-8079-2d595dc506c1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:23.122316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf82c6d6-7e08-472b-88ff-4e95098cc1a8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:23.122902 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf82c6d6-7e08-472b-88ff-4e95098cc1a8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:23.124400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf82c6d6-7e08-472b-88ff-4e95098cc1a8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:23.607376 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3bbd3b8d-85f5-4ab0-8079-2d595dc506c1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:23.620149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3bbd3b8d-85f5-4ab0-8079-2d595dc506c1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:23.620953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3bbd3b8d-85f5-4ab0-8079-2d595dc506c1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:23.625811 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3bbd3b8d-85f5-4ab0-8079-2d595dc506c1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1724 microversion: 2.20 time: 0.542642 Aug 04 17:18:23.631150 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bf82c6d6-7e08-472b-88ff-4e95098cc1a8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:23.661542 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2653/5348] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:18:23 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1724 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:18:23.666189 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bf82c6d6-7e08-472b-88ff-4e95098cc1a8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1696 microversion: 2.1 time: 0.564832 Aug 04 17:18:23.687145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7e60fa7a-254f-4fbc-bb9c-b671713ab2c9 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:23.687695 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2696/5349] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:23 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1696 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:23.692369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7e60fa7a-254f-4fbc-bb9c-b671713ab2c9 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:23.706430 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:18:23.709768 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e60fa7a-254f-4fbc-bb9c-b671713ab2c9 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:23.710795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e60fa7a-254f-4fbc-bb9c-b671713ab2c9 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:23.711501 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e60fa7a-254f-4fbc-bb9c-b671713ab2c9 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:23.716653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e60fa7a-254f-4fbc-bb9c-b671713ab2c9 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:23.719858 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e60fa7a-254f-4fbc-bb9c-b671713ab2c9 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:23.720840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e60fa7a-254f-4fbc-bb9c-b671713ab2c9 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:24.124616 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-03f3b980-4882-4aec-8069-010ce1029671 req-8b3d1c80-baa1-43d0-aa74-3bf89b9c0030 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c6b1716-bb14-4f97-bc75-38403c1c1af0", "tag": "1e3189db-ad91-4d9e-bfe5-7b700963e0d9"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:24.175444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-03f3b980-4882-4aec-8069-010ce1029671 req-8b3d1c80-baa1-43d0-aa74-3bf89b9c0030 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:24.176898 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-03f3b980-4882-4aec-8069-010ce1029671 req-8b3d1c80-baa1-43d0-aa74-3bf89b9c0030 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:24.180261 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-03f3b980-4882-4aec-8069-010ce1029671 req-8b3d1c80-baa1-43d0-aa74-3bf89b9c0030 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:24.238222 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-03f3b980-4882-4aec-8069-010ce1029671 req-8b3d1c80-baa1-43d0-aa74-3bf89b9c0030 service nova] Creating event network-changed:1e3189db-ad91-4d9e-bfe5-7b700963e0d9 for instance 9c6b1716-bb14-4f97-bc75-38403c1c1af0 on n-h1-851359-3 Aug 04 17:18:24.245399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [req-03f3b980-4882-4aec-8069-010ce1029671 req-8b3d1c80-baa1-43d0-aa74-3bf89b9c0030 service nova] Instance 9c6b1716-bb14-4f97-bc75-38403c1c1af0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:18:24.273527 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-03f3b980-4882-4aec-8069-010ce1029671 req-8b3d1c80-baa1-43d0-aa74-3bf89b9c0030 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155459 Aug 04 17:18:24.277840 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2697/5350] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:18:24.288144 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-df36dcd4-a6de-4dee-86b5-2da020923629 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:24.297499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-df36dcd4-a6de-4dee-86b5-2da020923629 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:24.308428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df36dcd4-a6de-4dee-86b5-2da020923629 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:24.311011 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df36dcd4-a6de-4dee-86b5-2da020923629 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:24.317196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df36dcd4-a6de-4dee-86b5-2da020923629 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:24.318419 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df36dcd4-a6de-4dee-86b5-2da020923629 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:24.319627 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df36dcd4-a6de-4dee-86b5-2da020923629 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:24.320587 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-df36dcd4-a6de-4dee-86b5-2da020923629 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:24.480472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7e60fa7a-254f-4fbc-bb9c-b671713ab2c9 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:24.492060 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7e60fa7a-254f-4fbc-bb9c-b671713ab2c9 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.828754 Aug 04 17:18:24.498363 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2654/5351] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:23 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:24.518342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0fdacf49-45d7-4a04-b0c8-3e9a14dd5462 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:24.522664 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0fdacf49-45d7-4a04-b0c8-3e9a14dd5462 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 66586459-05f5-4607-9c93-d2a6b3c5abc4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:24.537186 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-0fdacf49-45d7-4a04-b0c8-3e9a14dd5462 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Instance 66586459-05f5-4607-9c93-d2a6b3c5abc4 could not be found. Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0fdacf49-45d7-4a04-b0c8-3e9a14dd5462 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/66586459-05f5-4607-9c93-d2a6b3c5abc4/action HTTP/1.1 Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 65 Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: {"rebuild": {"imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9"}} Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 66586459-05f5-4607-9c93-d2a6b3c5abc4 could not be found. Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '66586459-05f5-4607-9c93-d2a6b3c5abc4', 'body': {'rebuild': {'imageRef': '93ebc91d-2d7a-4ab2-b133-dcf9559166d9'}}} Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66586459-05f5-4607-9c93-d2a6b3c5abc4 could not be found. Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 04 17:18:24.549047 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:18:24.561965 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:18:24.561965 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:18:24.561965 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:18:24.561965 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66586459-05f5-4607-9c93-d2a6b3c5abc4 could not be found. Aug 04 17:18:24.561965 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:24.561965 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:24.561965 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:24.561965 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:24.561965 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:24.561965 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:24.561965 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:18:24.561965 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:18:24.561965 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66586459-05f5-4607-9c93-d2a6b3c5abc4 could not be found. Aug 04 17:18:24.561965 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:24.561965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0fdacf49-45d7-4a04-b0c8-3e9a14dd5462 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 404 to user: Instance 66586459-05f5-4607-9c93-d2a6b3c5abc4 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:18:24.561965 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0fdacf49-45d7-4a04-b0c8-3e9a14dd5462 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers/66586459-05f5-4607-9c93-d2a6b3c5abc4/action" status: 404 len: 111 microversion: 2.1 time: 0.036785 Aug 04 17:18:24.561965 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2655/5352] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:18:24 2022] POST /compute/v2.1/servers/66586459-05f5-4607-9c93-d2a6b3c5abc4/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:18:24.561965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f6f27cb3-d88a-458f-825b-f9a7132b4f86 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:24.561965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f6f27cb3-d88a-458f-825b-f9a7132b4f86 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:24.581819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6f27cb3-d88a-458f-825b-f9a7132b4f86 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:24.582934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6f27cb3-d88a-458f-825b-f9a7132b4f86 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:24.583397 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6f27cb3-d88a-458f-825b-f9a7132b4f86 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:24.584121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6f27cb3-d88a-458f-825b-f9a7132b4f86 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:24.584592 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6f27cb3-d88a-458f-825b-f9a7132b4f86 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:24.585031 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6f27cb3-d88a-458f-825b-f9a7132b4f86 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:25.041608 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-df36dcd4-a6de-4dee-86b5-2da020923629 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:25.060311 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-df36dcd4-a6de-4dee-86b5-2da020923629 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b" status: 200 len: 1554 microversion: 2.1 time: 0.777245 Aug 04 17:18:25.061533 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2698/5353] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:24 2022] GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b => generated 1554 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:25.066858 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-969c5ce8-b170-4832-a628-a938b64ca28a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:25.067491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-969c5ce8-b170-4832-a628-a938b64ca28a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:25.084562 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-969c5ce8-b170-4832-a628-a938b64ca28a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:25.085081 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-969c5ce8-b170-4832-a628-a938b64ca28a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:25.085536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-969c5ce8-b170-4832-a628-a938b64ca28a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:25.086303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-969c5ce8-b170-4832-a628-a938b64ca28a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:25.086782 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-969c5ce8-b170-4832-a628-a938b64ca28a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:25.087221 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-969c5ce8-b170-4832-a628-a938b64ca28a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:25.114625 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f6f27cb3-d88a-458f-825b-f9a7132b4f86 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:25.125862 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f6f27cb3-d88a-458f-825b-f9a7132b4f86 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.569611 Aug 04 17:18:25.142746 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2656/5354] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:24 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:18:25.154652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3d1e56db-a79d-4730-842b-9e3fde639e9b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:25.158855 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3d1e56db-a79d-4730-842b-9e3fde639e9b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:25.183999 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d1e56db-a79d-4730-842b-9e3fde639e9b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:25.184690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d1e56db-a79d-4730-842b-9e3fde639e9b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:25.185440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d1e56db-a79d-4730-842b-9e3fde639e9b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:25.186367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d1e56db-a79d-4730-842b-9e3fde639e9b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:25.186996 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d1e56db-a79d-4730-842b-9e3fde639e9b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:25.187595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d1e56db-a79d-4730-842b-9e3fde639e9b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:25.689109 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-969c5ce8-b170-4832-a628-a938b64ca28a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:25.709002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-969c5ce8-b170-4832-a628-a938b64ca28a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:25.720992 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3d1e56db-a79d-4730-842b-9e3fde639e9b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:25.722173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-969c5ce8-b170-4832-a628-a938b64ca28a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:25.724877 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-969c5ce8-b170-4832-a628-a938b64ca28a tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1724 microversion: 2.20 time: 0.661540 Aug 04 17:18:25.726147 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2699/5355] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:18:25 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1724 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:18:25.733354 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c65a192f-5d7c-4d7c-bcdc-d92003467022 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:25.736158 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3d1e56db-a79d-4730-842b-9e3fde639e9b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1696 microversion: 2.1 time: 0.592077 Aug 04 17:18:25.737247 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2657/5356] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:25 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1696 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:25.750398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7b25f93e-ca97-4d05-996f-a49987fd3066 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:25.751380 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7b25f93e-ca97-4d05-996f-a49987fd3066 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:25.760907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b25f93e-ca97-4d05-996f-a49987fd3066 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:25.762822 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b25f93e-ca97-4d05-996f-a49987fd3066 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:25.763631 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b25f93e-ca97-4d05-996f-a49987fd3066 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:25.766759 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b25f93e-ca97-4d05-996f-a49987fd3066 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:25.767653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b25f93e-ca97-4d05-996f-a49987fd3066 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:25.768806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c65a192f-5d7c-4d7c-bcdc-d92003467022 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:25.769539 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b25f93e-ca97-4d05-996f-a49987fd3066 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:25.782702 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c65a192f-5d7c-4d7c-bcdc-d92003467022 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:25.783219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c65a192f-5d7c-4d7c-bcdc-d92003467022 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:25.784260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c65a192f-5d7c-4d7c-bcdc-d92003467022 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:25.785220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c65a192f-5d7c-4d7c-bcdc-d92003467022 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:25.785955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c65a192f-5d7c-4d7c-bcdc-d92003467022 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:25.786603 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c65a192f-5d7c-4d7c-bcdc-d92003467022 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:26.093946 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c65a192f-5d7c-4d7c-bcdc-d92003467022 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.365150 Aug 04 17:18:26.094632 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2700/5357] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Aug 4 17:18:25 2022] GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b/os-interface => generated 285 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:18:26.523554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7b25f93e-ca97-4d05-996f-a49987fd3066 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:26.541333 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7b25f93e-ca97-4d05-996f-a49987fd3066 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.800589 Aug 04 17:18:26.541992 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2658/5358] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:25 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:26.567591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ec3a894c-d9e0-432e-aa67-07c2be6c9027 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:26.568662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ec3a894c-d9e0-432e-aa67-07c2be6c9027 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 6989c6fe-ab49-4a2a-a766-18bd157d3de2] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:26.600374 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-ec3a894c-d9e0-432e-aa67-07c2be6c9027 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Instance 6989c6fe-ab49-4a2a-a766-18bd157d3de2 could not be found. Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ec3a894c-d9e0-432e-aa67-07c2be6c9027 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers/6989c6fe-ab49-4a2a-a766-18bd157d3de2/action HTTP/1.1 Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 15 Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: {"restore": {}} Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 6989c6fe-ab49-4a2a-a766-18bd157d3de2 could not be found. Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '6989c6fe-ab49-4a2a-a766-18bd157d3de2', 'body': {'restore': {}}} Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6989c6fe-ab49-4a2a-a766-18bd157d3de2 could not be found. Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6989c6fe-ab49-4a2a-a766-18bd157d3de2 could not be found. Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:26.609059 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:26.616535 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:18:26.616535 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:18:26.616535 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6989c6fe-ab49-4a2a-a766-18bd157d3de2 could not be found. Aug 04 17:18:26.616535 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:26.619937 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ec3a894c-d9e0-432e-aa67-07c2be6c9027 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 404 to user: Instance 6989c6fe-ab49-4a2a-a766-18bd157d3de2 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:18:26.627358 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ec3a894c-d9e0-432e-aa67-07c2be6c9027 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers/6989c6fe-ab49-4a2a-a766-18bd157d3de2/action" status: 404 len: 111 microversion: 2.1 time: 0.060631 Aug 04 17:18:26.630159 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2701/5359] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:18:26 2022] POST /compute/v2.1/servers/6989c6fe-ab49-4a2a-a766-18bd157d3de2/action => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:18:26.638865 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2805b6e9-f912-4f5b-a96b-0eb7002aa457 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:26.639496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2805b6e9-f912-4f5b-a96b-0eb7002aa457 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:26.652455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2805b6e9-f912-4f5b-a96b-0eb7002aa457 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:26.652950 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2805b6e9-f912-4f5b-a96b-0eb7002aa457 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:26.657356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2805b6e9-f912-4f5b-a96b-0eb7002aa457 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:26.660273 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2805b6e9-f912-4f5b-a96b-0eb7002aa457 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:26.661581 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2805b6e9-f912-4f5b-a96b-0eb7002aa457 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:26.667266 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2805b6e9-f912-4f5b-a96b-0eb7002aa457 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:26.765956 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7774bf3c-e432-4205-878d-ba7d43385250 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:26.767911 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7774bf3c-e432-4205-878d-ba7d43385250 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:26.788074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7774bf3c-e432-4205-878d-ba7d43385250 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:26.793677 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7774bf3c-e432-4205-878d-ba7d43385250 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:26.795774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7774bf3c-e432-4205-878d-ba7d43385250 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:26.798654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7774bf3c-e432-4205-878d-ba7d43385250 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:26.800829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7774bf3c-e432-4205-878d-ba7d43385250 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:26.803141 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7774bf3c-e432-4205-878d-ba7d43385250 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:27.597429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2805b6e9-f912-4f5b-a96b-0eb7002aa457 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:27.616010 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2805b6e9-f912-4f5b-a96b-0eb7002aa457 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.982308 Aug 04 17:18:27.619445 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2659/5360] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:26 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:27.625535 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d78f4919-9978-4729-b036-d7ad1e41cfd5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:27.626839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d78f4919-9978-4729-b036-d7ad1e41cfd5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:27.634250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d78f4919-9978-4729-b036-d7ad1e41cfd5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:27.635512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d78f4919-9978-4729-b036-d7ad1e41cfd5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:27.636296 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d78f4919-9978-4729-b036-d7ad1e41cfd5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:27.637287 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d78f4919-9978-4729-b036-d7ad1e41cfd5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:27.638141 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d78f4919-9978-4729-b036-d7ad1e41cfd5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:27.638810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d78f4919-9978-4729-b036-d7ad1e41cfd5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:27.658976 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7774bf3c-e432-4205-878d-ba7d43385250 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:27.672607 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7774bf3c-e432-4205-878d-ba7d43385250 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:27.682131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7774bf3c-e432-4205-878d-ba7d43385250 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:27.683576 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:18:27.686250 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7774bf3c-e432-4205-878d-ba7d43385250 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1745 microversion: 2.20 time: 0.922628 Aug 04 17:18:27.686919 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2702/5361] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:18:26 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1745 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:18:27.719766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e4c45b94-e545-41c5-83f0-a90696494570 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:27.720411 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e4c45b94-e545-41c5-83f0-a90696494570 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:27.728471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4c45b94-e545-41c5-83f0-a90696494570 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:27.729295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4c45b94-e545-41c5-83f0-a90696494570 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:27.729989 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4c45b94-e545-41c5-83f0-a90696494570 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:27.730920 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4c45b94-e545-41c5-83f0-a90696494570 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:27.732031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4c45b94-e545-41c5-83f0-a90696494570 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:27.732665 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4c45b94-e545-41c5-83f0-a90696494570 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:28.220904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e4c45b94-e545-41c5-83f0-a90696494570 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:28.232213 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e4c45b94-e545-41c5-83f0-a90696494570 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.524122 Aug 04 17:18:28.232812 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2703/5362] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:27 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:28.245006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d78f4919-9978-4729-b036-d7ad1e41cfd5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:28.266620 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1ad000b9-5b36-48af-ae42-cecfec679bf4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:28.267616 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1ad000b9-5b36-48af-ae42-cecfec679bf4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:28.273707 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d78f4919-9978-4729-b036-d7ad1e41cfd5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1694 microversion: 2.1 time: 0.651429 Aug 04 17:18:28.274757 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2660/5363] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:27 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1694 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:28.275513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ad000b9-5b36-48af-ae42-cecfec679bf4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:28.276239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ad000b9-5b36-48af-ae42-cecfec679bf4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:28.276934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ad000b9-5b36-48af-ae42-cecfec679bf4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:28.277889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ad000b9-5b36-48af-ae42-cecfec679bf4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:28.278604 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ad000b9-5b36-48af-ae42-cecfec679bf4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:28.279280 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ad000b9-5b36-48af-ae42-cecfec679bf4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:28.332972 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-1ad000b9-5b36-48af-ae42-cecfec679bf4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Cannot 'restore' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state active Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1ad000b9-5b36-48af-ae42-cecfec679bf4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372/action HTTP/1.1 Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 15 Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: {"restore": {}} Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: exception: Cannot 'restore' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state active Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '5248dcdc-5a16-4036-9537-eb84f73dc372', 'body': {'restore': {}}} Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5248dcdc-5a16-4036-9537-eb84f73dc372 in vm_state active. Cannot restore while the instance is in this state. Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state active Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:28.334682 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:28.342513 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:28.342513 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:18:28.342513 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:18:28.342513 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state active Aug 04 17:18:28.342513 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:28.342513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1ad000b9-5b36-48af-ae42-cecfec679bf4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 409 to user: Cannot 'restore' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state active {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:18:28.342513 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1ad000b9-5b36-48af-ae42-cecfec679bf4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372/action" status: 409 len: 145 microversion: 2.1 time: 0.075757 Aug 04 17:18:28.350754 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2704/5364] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:18:28 2022] POST /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372/action => generated 145 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 04 17:18:28.351494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-48de4025-4270-41cb-9058-3410090dbfc5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:28.354202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-48de4025-4270-41cb-9058-3410090dbfc5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:28.370613 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48de4025-4270-41cb-9058-3410090dbfc5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:28.371492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48de4025-4270-41cb-9058-3410090dbfc5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:28.372218 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48de4025-4270-41cb-9058-3410090dbfc5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:28.374500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48de4025-4270-41cb-9058-3410090dbfc5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:28.375297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48de4025-4270-41cb-9058-3410090dbfc5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:28.376309 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48de4025-4270-41cb-9058-3410090dbfc5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:28.721290 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cc0d6d19-3b8b-4a92-ac76-89c0cab1d676 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:28.721933 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cc0d6d19-3b8b-4a92-ac76-89c0cab1d676 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:28.736227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc0d6d19-3b8b-4a92-ac76-89c0cab1d676 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:28.736725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc0d6d19-3b8b-4a92-ac76-89c0cab1d676 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:28.757924 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc0d6d19-3b8b-4a92-ac76-89c0cab1d676 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:28.759492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc0d6d19-3b8b-4a92-ac76-89c0cab1d676 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:28.761736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc0d6d19-3b8b-4a92-ac76-89c0cab1d676 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:28.762420 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc0d6d19-3b8b-4a92-ac76-89c0cab1d676 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:28.933909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-48de4025-4270-41cb-9058-3410090dbfc5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:28.944273 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-48de4025-4270-41cb-9058-3410090dbfc5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.602577 Aug 04 17:18:28.945793 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2661/5365] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:28 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:28.972276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2d526b54-c770-4deb-af8d-3b06b4cd61ac tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:28.973457 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2d526b54-c770-4deb-af8d-3b06b4cd61ac tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:28.991890 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d526b54-c770-4deb-af8d-3b06b4cd61ac tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:28.992405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d526b54-c770-4deb-af8d-3b06b4cd61ac tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:28.992847 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d526b54-c770-4deb-af8d-3b06b4cd61ac tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:28.993571 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d526b54-c770-4deb-af8d-3b06b4cd61ac tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:28.994063 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d526b54-c770-4deb-af8d-3b06b4cd61ac tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:28.994723 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d526b54-c770-4deb-af8d-3b06b4cd61ac tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:29.369963 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cc0d6d19-3b8b-4a92-ac76-89c0cab1d676 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:29.384962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:18:29.396812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cc0d6d19-3b8b-4a92-ac76-89c0cab1d676 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:29.403213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cc0d6d19-3b8b-4a92-ac76-89c0cab1d676 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:29.404628 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cc0d6d19-3b8b-4a92-ac76-89c0cab1d676 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1745 microversion: 2.20 time: 0.692112 Aug 04 17:18:29.405408 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2705/5366] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:18:28 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1745 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:18:29.440969 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-81c8ca6a-ebd1-47b8-b700-21d82001bd3a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:29.442008 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-81c8ca6a-ebd1-47b8-b700-21d82001bd3a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:29.452857 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81c8ca6a-ebd1-47b8-b700-21d82001bd3a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:29.454391 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81c8ca6a-ebd1-47b8-b700-21d82001bd3a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:29.455201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81c8ca6a-ebd1-47b8-b700-21d82001bd3a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:29.469671 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81c8ca6a-ebd1-47b8-b700-21d82001bd3a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:29.473180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81c8ca6a-ebd1-47b8-b700-21d82001bd3a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:29.482783 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81c8ca6a-ebd1-47b8-b700-21d82001bd3a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:30.283940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2d526b54-c770-4deb-af8d-3b06b4cd61ac tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:30.303104 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2d526b54-c770-4deb-af8d-3b06b4cd61ac tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 1.334788 Aug 04 17:18:30.309901 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2662/5367] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:28 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:18:30.350977 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-c0503314-aa06-4e6b-89ec-1cb8ed62971d req-c9952a75-2a48-44a0-9e6b-3fbd61a371c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42ede9b2-fe57-4ea9-99e0-a4617a87425b", "tag": "1a4b3e2d-010e-4229-81db-257ae011d245"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:30.366449 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c0503314-aa06-4e6b-89ec-1cb8ed62971d req-c9952a75-2a48-44a0-9e6b-3fbd61a371c6 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:30.367762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c0503314-aa06-4e6b-89ec-1cb8ed62971d req-c9952a75-2a48-44a0-9e6b-3fbd61a371c6 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:30.368788 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c0503314-aa06-4e6b-89ec-1cb8ed62971d req-c9952a75-2a48-44a0-9e6b-3fbd61a371c6 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:30.389446 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-c0503314-aa06-4e6b-89ec-1cb8ed62971d req-c9952a75-2a48-44a0-9e6b-3fbd61a371c6 service nova] Creating event network-changed:1a4b3e2d-010e-4229-81db-257ae011d245 for instance 42ede9b2-fe57-4ea9-99e0-a4617a87425b on n-h1-851359-3 Aug 04 17:18:30.397218 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-c0503314-aa06-4e6b-89ec-1cb8ed62971d req-c9952a75-2a48-44a0-9e6b-3fbd61a371c6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085363 Aug 04 17:18:30.398691 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2663/5368] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:18:30.409184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cebc23fb-5bad-4a02-8af4-c44968cfad99 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:30.411226 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cebc23fb-5bad-4a02-8af4-c44968cfad99 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 4045d4c4-89b2-48ca-a21d-7249c7d3ed32] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:30.428588 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-cebc23fb-5bad-4a02-8af4-c44968cfad99 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Instance 4045d4c4-89b2-48ca-a21d-7249c7d3ed32 could not be found. Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cebc23fb-5bad-4a02-8af4-c44968cfad99 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/4045d4c4-89b2-48ca-a21d-7249c7d3ed32/action HTTP/1.1 Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 14 Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: {"resume": {}} Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 4045d4c4-89b2-48ca-a21d-7249c7d3ed32 could not be found. Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '4045d4c4-89b2-48ca-a21d-7249c7d3ed32', 'body': {'resume': {}}} Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4045d4c4-89b2-48ca-a21d-7249c7d3ed32 could not be found. Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4045d4c4-89b2-48ca-a21d-7249c7d3ed32 could not be found. Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:30.438289 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:30.445860 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:18:30.445860 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:18:30.445860 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4045d4c4-89b2-48ca-a21d-7249c7d3ed32 could not be found. Aug 04 17:18:30.445860 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:18:30.450506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cebc23fb-5bad-4a02-8af4-c44968cfad99 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 404 to user: Instance 4045d4c4-89b2-48ca-a21d-7249c7d3ed32 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:18:30.452841 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cebc23fb-5bad-4a02-8af4-c44968cfad99 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers/4045d4c4-89b2-48ca-a21d-7249c7d3ed32/action" status: 404 len: 111 microversion: 2.1 time: 0.052298 Aug 04 17:18:30.459040 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2664/5369] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:18:30 2022] POST /compute/v2.1/servers/4045d4c4-89b2-48ca-a21d-7249c7d3ed32/action => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:18:30.474042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8e1ce7ea-5a98-4038-8b94-cb9f5349c1cb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:30.476308 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8e1ce7ea-5a98-4038-8b94-cb9f5349c1cb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:30.492156 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e1ce7ea-5a98-4038-8b94-cb9f5349c1cb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:30.492674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e1ce7ea-5a98-4038-8b94-cb9f5349c1cb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:30.493166 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e1ce7ea-5a98-4038-8b94-cb9f5349c1cb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:30.493945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e1ce7ea-5a98-4038-8b94-cb9f5349c1cb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:30.494471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e1ce7ea-5a98-4038-8b94-cb9f5349c1cb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:30.494956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e1ce7ea-5a98-4038-8b94-cb9f5349c1cb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:30.608489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-81c8ca6a-ebd1-47b8-b700-21d82001bd3a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:30.621169 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-81c8ca6a-ebd1-47b8-b700-21d82001bd3a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1691 microversion: 2.1 time: 1.205841 Aug 04 17:18:30.622299 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2706/5370] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:29 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1691 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:30.629458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-111d7bc0-d9ab-4fbd-915f-0d6919b6b1b4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:30.630664 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-111d7bc0-d9ab-4fbd-915f-0d6919b6b1b4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:30.644263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-111d7bc0-d9ab-4fbd-915f-0d6919b6b1b4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:30.646457 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-111d7bc0-d9ab-4fbd-915f-0d6919b6b1b4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:30.648105 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-111d7bc0-d9ab-4fbd-915f-0d6919b6b1b4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:30.649202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-111d7bc0-d9ab-4fbd-915f-0d6919b6b1b4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:30.649968 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-111d7bc0-d9ab-4fbd-915f-0d6919b6b1b4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:30.651264 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-111d7bc0-d9ab-4fbd-915f-0d6919b6b1b4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:31.218183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8e1ce7ea-5a98-4038-8b94-cb9f5349c1cb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:31.228250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8e1ce7ea-5a98-4038-8b94-cb9f5349c1cb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:31.240676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8e1ce7ea-5a98-4038-8b94-cb9f5349c1cb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:31.242412 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8e1ce7ea-5a98-4038-8b94-cb9f5349c1cb tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1745 microversion: 2.20 time: 0.780962 Aug 04 17:18:31.246289 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2665/5371] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:18:30 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1745 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:18:31.259522 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c2c32839-0e5d-4c08-86cf-79e8e58bc385 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:31.263272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c2c32839-0e5d-4c08-86cf-79e8e58bc385 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:31.281566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2c32839-0e5d-4c08-86cf-79e8e58bc385 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:31.282680 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2c32839-0e5d-4c08-86cf-79e8e58bc385 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:31.283364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2c32839-0e5d-4c08-86cf-79e8e58bc385 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:31.284704 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2c32839-0e5d-4c08-86cf-79e8e58bc385 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:31.287081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2c32839-0e5d-4c08-86cf-79e8e58bc385 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:31.293181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2c32839-0e5d-4c08-86cf-79e8e58bc385 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:31.445530 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c2c32839-0e5d-4c08-86cf-79e8e58bc385 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "POST /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0/action" status: 204 len: 0 microversion: 2.1 time: 0.197663 Aug 04 17:18:31.451733 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2666/5372] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:18:31 2022] POST /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0/action => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:18:31.464097 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-693bb0a1-9166-4910-80c0-92a2b0518e6d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:31.475010 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-693bb0a1-9166-4910-80c0-92a2b0518e6d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:31.492059 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-693bb0a1-9166-4910-80c0-92a2b0518e6d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:31.492631 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-693bb0a1-9166-4910-80c0-92a2b0518e6d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:31.493189 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-693bb0a1-9166-4910-80c0-92a2b0518e6d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:31.494164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-693bb0a1-9166-4910-80c0-92a2b0518e6d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:31.495918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-693bb0a1-9166-4910-80c0-92a2b0518e6d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:31.496471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-693bb0a1-9166-4910-80c0-92a2b0518e6d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:32.012384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-111d7bc0-d9ab-4fbd-915f-0d6919b6b1b4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:32.034859 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-111d7bc0-d9ab-4fbd-915f-0d6919b6b1b4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 1.411028 Aug 04 17:18:32.042819 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2707/5373] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:30 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:32.072551 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-17107f74-19d4-43de-8c82-ae5bbdd9ada2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:32.073874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-17107f74-19d4-43de-8c82-ae5bbdd9ada2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:32.099939 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-17107f74-19d4-43de-8c82-ae5bbdd9ada2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:32.107296 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-17107f74-19d4-43de-8c82-ae5bbdd9ada2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:32.107964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-17107f74-19d4-43de-8c82-ae5bbdd9ada2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:32.108832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-17107f74-19d4-43de-8c82-ae5bbdd9ada2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:32.109586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-17107f74-19d4-43de-8c82-ae5bbdd9ada2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:32.110523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-17107f74-19d4-43de-8c82-ae5bbdd9ada2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:33.372076 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-693bb0a1-9166-4910-80c0-92a2b0518e6d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:33.392343 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-693bb0a1-9166-4910-80c0-92a2b0518e6d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1691 microversion: 2.1 time: 1.932348 Aug 04 17:18:33.395436 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2667/5374] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:31 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1691 bytes in 1943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:33.414953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3bfa71cc-a9d2-4e40-8595-2ad3147dde9b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:33.422060 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3bfa71cc-a9d2-4e40-8595-2ad3147dde9b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:33.447994 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bfa71cc-a9d2-4e40-8595-2ad3147dde9b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:33.448780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bfa71cc-a9d2-4e40-8595-2ad3147dde9b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:33.449445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bfa71cc-a9d2-4e40-8595-2ad3147dde9b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:33.450628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bfa71cc-a9d2-4e40-8595-2ad3147dde9b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:33.451326 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bfa71cc-a9d2-4e40-8595-2ad3147dde9b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:33.461680 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bfa71cc-a9d2-4e40-8595-2ad3147dde9b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:33.563942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-17107f74-19d4-43de-8c82-ae5bbdd9ada2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:33.634095 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-17107f74-19d4-43de-8c82-ae5bbdd9ada2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 1.567961 Aug 04 17:18:33.637730 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2708/5375] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:32 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:18:33.667299 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-85b293ed-f2b8-40cb-9f27-b200d20bb14d req-546ba713-c376-4ee0-9bc2-eb05f9020bbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7dd09c1-f3da-438a-b0d8-1102ee2d67f8", "name": "network-vif-plugged", "status": "completed", "tag": "1dd4fc9a-a07b-4b63-82e0-ad9da9f1b5b2"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:33.716319 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-85b293ed-f2b8-40cb-9f27-b200d20bb14d req-546ba713-c376-4ee0-9bc2-eb05f9020bbe service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:33.717412 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-85b293ed-f2b8-40cb-9f27-b200d20bb14d req-546ba713-c376-4ee0-9bc2-eb05f9020bbe service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:33.718280 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-85b293ed-f2b8-40cb-9f27-b200d20bb14d req-546ba713-c376-4ee0-9bc2-eb05f9020bbe service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:33.775881 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-85b293ed-f2b8-40cb-9f27-b200d20bb14d req-546ba713-c376-4ee0-9bc2-eb05f9020bbe service nova] Creating event network-vif-plugged:1dd4fc9a-a07b-4b63-82e0-ad9da9f1b5b2 for instance e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 on n-h2-851359-3 Aug 04 17:18:33.799242 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-85b293ed-f2b8-40cb-9f27-b200d20bb14d req-546ba713-c376-4ee0-9bc2-eb05f9020bbe service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159248 Aug 04 17:18:33.806632 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2709/5376] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:18:33.828585 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-875a4e2d-faad-465c-88c6-790e1cf8ae1c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:33.838525 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-875a4e2d-faad-465c-88c6-790e1cf8ae1c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:33.865129 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-875a4e2d-faad-465c-88c6-790e1cf8ae1c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:33.885921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-875a4e2d-faad-465c-88c6-790e1cf8ae1c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:33.886305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-875a4e2d-faad-465c-88c6-790e1cf8ae1c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:33.887083 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-875a4e2d-faad-465c-88c6-790e1cf8ae1c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:33.887565 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-875a4e2d-faad-465c-88c6-790e1cf8ae1c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:33.887997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-875a4e2d-faad-465c-88c6-790e1cf8ae1c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:34.048287 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-875a4e2d-faad-465c-88c6-790e1cf8ae1c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Cannot 'resume' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state active Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-875a4e2d-faad-465c-88c6-790e1cf8ae1c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372/action HTTP/1.1 Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 14 Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: {"resume": {}} Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: exception: Cannot 'resume' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state active Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '5248dcdc-5a16-4036-9537-eb84f73dc372', 'body': {'resume': {}}} Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5248dcdc-5a16-4036-9537-eb84f73dc372 in vm_state active. Cannot resume while the instance is in this state. Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state active Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:34.078687 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:34.083479 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:34.083479 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:18:34.083479 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:18:34.083479 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state active Aug 04 17:18:34.083479 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:34.083479 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-875a4e2d-faad-465c-88c6-790e1cf8ae1c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 409 to user: Cannot 'resume' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state active {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:18:34.083479 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-875a4e2d-faad-465c-88c6-790e1cf8ae1c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372/action" status: 409 len: 144 microversion: 2.1 time: 0.272808 Aug 04 17:18:34.094161 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2710/5377] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:18:33 2022] POST /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372/action => generated 144 bytes in 287 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:18:34.129471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c62b14d3-1643-422b-a480-fd70c8d3b21c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:34.133681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c62b14d3-1643-422b-a480-fd70c8d3b21c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:34.174520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c62b14d3-1643-422b-a480-fd70c8d3b21c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:34.175029 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c62b14d3-1643-422b-a480-fd70c8d3b21c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:34.175476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c62b14d3-1643-422b-a480-fd70c8d3b21c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:34.186562 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c62b14d3-1643-422b-a480-fd70c8d3b21c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:34.193312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c62b14d3-1643-422b-a480-fd70c8d3b21c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:34.196360 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c62b14d3-1643-422b-a480-fd70c8d3b21c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:35.898322 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3bfa71cc-a9d2-4e40-8595-2ad3147dde9b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:35.917457 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3bfa71cc-a9d2-4e40-8595-2ad3147dde9b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:35.930840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3bfa71cc-a9d2-4e40-8595-2ad3147dde9b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:35.935642 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3bfa71cc-a9d2-4e40-8595-2ad3147dde9b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1740 microversion: 2.20 time: 2.528045 Aug 04 17:18:35.939176 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2668/5378] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:18:33 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1740 bytes in 2532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:18:35.948152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0159268c-c782-40b8-9f74-bec0c876e0d9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:35.955153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0159268c-c782-40b8-9f74-bec0c876e0d9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:35.981216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0159268c-c782-40b8-9f74-bec0c876e0d9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:35.982129 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0159268c-c782-40b8-9f74-bec0c876e0d9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:35.982809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0159268c-c782-40b8-9f74-bec0c876e0d9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:35.983769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0159268c-c782-40b8-9f74-bec0c876e0d9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:35.986585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0159268c-c782-40b8-9f74-bec0c876e0d9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:35.987429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0159268c-c782-40b8-9f74-bec0c876e0d9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:36.248069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c62b14d3-1643-422b-a480-fd70c8d3b21c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:36.268692 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c62b14d3-1643-422b-a480-fd70c8d3b21c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 2.166420 Aug 04 17:18:36.269375 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2711/5379] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:34 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 2168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:36.298079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4b01dad7-ac2c-4553-9c18-de96411e2b25 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:36.298973 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4b01dad7-ac2c-4553-9c18-de96411e2b25 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:36.301248 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=80 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:18:36.315829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b01dad7-ac2c-4553-9c18-de96411e2b25 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:36.316699 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b01dad7-ac2c-4553-9c18-de96411e2b25 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:36.317312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b01dad7-ac2c-4553-9c18-de96411e2b25 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:36.320237 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b01dad7-ac2c-4553-9c18-de96411e2b25 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:36.320899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b01dad7-ac2c-4553-9c18-de96411e2b25 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:36.321769 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b01dad7-ac2c-4553-9c18-de96411e2b25 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:36.784445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0159268c-c782-40b8-9f74-bec0c876e0d9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:36.799431 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0159268c-c782-40b8-9f74-bec0c876e0d9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1691 microversion: 2.1 time: 0.858772 Aug 04 17:18:36.814003 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2669/5380] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:35 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1691 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:36.967339 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a30b1ab0-c1e4-4ada-9aad-e75ea9f75b77 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:36.968218 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a30b1ab0-c1e4-4ada-9aad-e75ea9f75b77 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:36.982424 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a30b1ab0-c1e4-4ada-9aad-e75ea9f75b77 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:36.982971 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a30b1ab0-c1e4-4ada-9aad-e75ea9f75b77 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:36.983428 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a30b1ab0-c1e4-4ada-9aad-e75ea9f75b77 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:36.987856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a30b1ab0-c1e4-4ada-9aad-e75ea9f75b77 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:36.988549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a30b1ab0-c1e4-4ada-9aad-e75ea9f75b77 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:36.989072 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a30b1ab0-c1e4-4ada-9aad-e75ea9f75b77 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:37.043004 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4b01dad7-ac2c-4553-9c18-de96411e2b25 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:37.059316 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4b01dad7-ac2c-4553-9c18-de96411e2b25 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.765465 Aug 04 17:18:37.059896 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2712/5381] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:36 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:18:37.376215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a7a50677-e9f4-447e-aac7-e37d516cc14c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "f20ac3e7-ddd2-4167-bdf1-b8b75ff31772"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a7a50677-e9f4-447e-aac7-e37d516cc14c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 160 Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: {"server": {"name": "", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "f20ac3e7-ddd2-4167-bdf1-b8b75ff31772"}]}} Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'body': {'server': {'name': '', 'imageRef': '93ebc91d-2d7a-4ab2-b133-dcf9559166d9', 'flavorRef': '452', 'networks': [{'uuid': 'f20ac3e7-ddd2-4167-bdf1-b8b75ff31772'}]}}} Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi '' Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:18:37.382149 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:18:37.387753 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:18:37.387753 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 04 17:18:37.387753 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:37.387753 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:37.387753 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:37.387753 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:37.387753 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:37.387753 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:37.387753 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:18:37.387753 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:18:37.387753 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 04 17:18:37.387753 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:37.390764 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a7a50677-e9f4-447e-aac7-e37d516cc14c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:18:37.399364 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a7a50677-e9f4-447e-aac7-e37d516cc14c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.026660 Aug 04 17:18:37.403622 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2713/5382] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:18:37 2022] POST /compute/v2.1/servers => generated 108 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 17:18:37.432455 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8a084459-9643-4f8a-9d3c-e5727d11bef2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:37.437282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8a084459-9643-4f8a-9d3c-e5727d11bef2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:37.468339 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a084459-9643-4f8a-9d3c-e5727d11bef2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:37.472877 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a084459-9643-4f8a-9d3c-e5727d11bef2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:37.474595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a084459-9643-4f8a-9d3c-e5727d11bef2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:37.478727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a084459-9643-4f8a-9d3c-e5727d11bef2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:37.480110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a084459-9643-4f8a-9d3c-e5727d11bef2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:37.482814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a084459-9643-4f8a-9d3c-e5727d11bef2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:38.034000 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a30b1ab0-c1e4-4ada-9aad-e75ea9f75b77 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:38.049900 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a30b1ab0-c1e4-4ada-9aad-e75ea9f75b77 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:38.060544 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a30b1ab0-c1e4-4ada-9aad-e75ea9f75b77 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:38.069163 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a30b1ab0-c1e4-4ada-9aad-e75ea9f75b77 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1740 microversion: 2.20 time: 1.106262 Aug 04 17:18:38.069773 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2670/5383] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:18:36 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1740 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:18:38.089788 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-6b2ac945-7281-4a26-bc52-d4a8878da1c6 req-031a223d-aa44-4523-af0e-5fcb7e1c6c3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6b1716-bb14-4f97-bc75-38403c1c1af0", "name": "network-vif-plugged", "status": "completed", "tag": "1e3189db-ad91-4d9e-bfe5-7b700963e0d9"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:38.128030 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6b2ac945-7281-4a26-bc52-d4a8878da1c6 req-031a223d-aa44-4523-af0e-5fcb7e1c6c3e service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:38.132005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6b2ac945-7281-4a26-bc52-d4a8878da1c6 req-031a223d-aa44-4523-af0e-5fcb7e1c6c3e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:38.132561 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6b2ac945-7281-4a26-bc52-d4a8878da1c6 req-031a223d-aa44-4523-af0e-5fcb7e1c6c3e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:38.177271 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-6b2ac945-7281-4a26-bc52-d4a8878da1c6 req-031a223d-aa44-4523-af0e-5fcb7e1c6c3e service nova] Creating event network-vif-plugged:1e3189db-ad91-4d9e-bfe5-7b700963e0d9 for instance 9c6b1716-bb14-4f97-bc75-38403c1c1af0 on n-h1-851359-3 Aug 04 17:18:38.202731 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-6b2ac945-7281-4a26-bc52-d4a8878da1c6 req-031a223d-aa44-4523-af0e-5fcb7e1c6c3e service nova] Instance 9c6b1716-bb14-4f97-bc75-38403c1c1af0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:18:38.228683 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-6b2ac945-7281-4a26-bc52-d4a8878da1c6 req-031a223d-aa44-4523-af0e-5fcb7e1c6c3e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157531 Aug 04 17:18:38.234050 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2671/5384] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:18:38.244420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-24fd84c5-2ff6-4929-ab23-99825c752d6c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:38.245150 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-24fd84c5-2ff6-4929-ab23-99825c752d6c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:38.268152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24fd84c5-2ff6-4929-ab23-99825c752d6c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:38.268969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24fd84c5-2ff6-4929-ab23-99825c752d6c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:38.269627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24fd84c5-2ff6-4929-ab23-99825c752d6c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:38.270557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24fd84c5-2ff6-4929-ab23-99825c752d6c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:38.272281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24fd84c5-2ff6-4929-ab23-99825c752d6c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:38.273181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24fd84c5-2ff6-4929-ab23-99825c752d6c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:38.475450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8a084459-9643-4f8a-9d3c-e5727d11bef2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:38.483802 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8a084459-9643-4f8a-9d3c-e5727d11bef2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 1.069224 Aug 04 17:18:38.498579 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2714/5385] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:37 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:38.536006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-641fb794-cb25-44b3-bedc-8bdb606d8b60 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:38.536930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-641fb794-cb25-44b3-bedc-8bdb606d8b60 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:38.549878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-641fb794-cb25-44b3-bedc-8bdb606d8b60 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:38.551273 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-641fb794-cb25-44b3-bedc-8bdb606d8b60 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:38.551879 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-641fb794-cb25-44b3-bedc-8bdb606d8b60 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:38.552786 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-641fb794-cb25-44b3-bedc-8bdb606d8b60 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:38.555511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-641fb794-cb25-44b3-bedc-8bdb606d8b60 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:38.556147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-641fb794-cb25-44b3-bedc-8bdb606d8b60 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:38.951355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-641fb794-cb25-44b3-bedc-8bdb606d8b60 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:38.963905 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-24fd84c5-2ff6-4929-ab23-99825c752d6c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:38.966276 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-641fb794-cb25-44b3-bedc-8bdb606d8b60 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.434569 Aug 04 17:18:38.968531 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2715/5386] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:38 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:18:38.976260 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-24fd84c5-2ff6-4929-ab23-99825c752d6c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1691 microversion: 2.1 time: 0.740806 Aug 04 17:18:38.977177 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2672/5387] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:38 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1691 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:39.002925 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e3adfa40-0783-4179-a07a-4749742e9d41 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:39.005343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e3adfa40-0783-4179-a07a-4749742e9d41 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 29d879df-bd51-434c-9658-cf496eb256ce] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:39.024739 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-e3adfa40-0783-4179-a07a-4749742e9d41 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Instance 29d879df-bd51-434c-9658-cf496eb256ce could not be found. Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e3adfa40-0783-4179-a07a-4749742e9d41 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers/29d879df-bd51-434c-9658-cf496eb256ce/action HTTP/1.1 Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 14 Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: {"shelve": {}} Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 29d879df-bd51-434c-9658-cf496eb256ce could not be found. Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '29d879df-bd51-434c-9658-cf496eb256ce', 'body': {'shelve': {}}} Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29d879df-bd51-434c-9658-cf496eb256ce could not be found. Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29d879df-bd51-434c-9658-cf496eb256ce could not be found. Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:18:39.031996 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:18:39.037557 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:18:39.037557 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:18:39.037557 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29d879df-bd51-434c-9658-cf496eb256ce could not be found. Aug 04 17:18:39.037557 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:18:39.044434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e3adfa40-0783-4179-a07a-4749742e9d41 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 404 to user: Instance 29d879df-bd51-434c-9658-cf496eb256ce could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:18:39.046217 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e3adfa40-0783-4179-a07a-4749742e9d41 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers/29d879df-bd51-434c-9658-cf496eb256ce/action" status: 404 len: 111 microversion: 2.1 time: 0.053827 Aug 04 17:18:39.049083 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2716/5388] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:18:38 2022] POST /compute/v2.1/servers/29d879df-bd51-434c-9658-cf496eb256ce/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:18:39.059068 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3cde6f7c-752f-4909-8f95-47560099fc7a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:39.063227 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3cde6f7c-752f-4909-8f95-47560099fc7a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:39.081751 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3cde6f7c-752f-4909-8f95-47560099fc7a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:39.082790 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3cde6f7c-752f-4909-8f95-47560099fc7a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:39.083245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3cde6f7c-752f-4909-8f95-47560099fc7a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:39.083978 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3cde6f7c-752f-4909-8f95-47560099fc7a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:39.102102 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e749aae3-1700-4e29-96e4-6951942483e5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:39.103417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e749aae3-1700-4e29-96e4-6951942483e5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:39.110765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3cde6f7c-752f-4909-8f95-47560099fc7a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:39.111322 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3cde6f7c-752f-4909-8f95-47560099fc7a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:39.120254 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e749aae3-1700-4e29-96e4-6951942483e5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:39.120804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e749aae3-1700-4e29-96e4-6951942483e5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:39.121261 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e749aae3-1700-4e29-96e4-6951942483e5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:39.126428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e749aae3-1700-4e29-96e4-6951942483e5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:39.126950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e749aae3-1700-4e29-96e4-6951942483e5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:39.127416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e749aae3-1700-4e29-96e4-6951942483e5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:39.902451 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e749aae3-1700-4e29-96e4-6951942483e5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:39.915165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e749aae3-1700-4e29-96e4-6951942483e5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:39.916687 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e749aae3-1700-4e29-96e4-6951942483e5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:39.917910 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e749aae3-1700-4e29-96e4-6951942483e5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1740 microversion: 2.20 time: 0.821965 Aug 04 17:18:39.931783 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3cde6f7c-752f-4909-8f95-47560099fc7a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:39.945591 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3cde6f7c-752f-4909-8f95-47560099fc7a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.892317 Aug 04 17:18:39.950238 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2673/5390] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:39 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:39.950826 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2717/5390] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:18:39 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1740 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:18:39.974496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-63401887-11c7-4e4d-a5b8-333c324834f6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:39.978004 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-63401887-11c7-4e4d-a5b8-333c324834f6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:39.986345 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63401887-11c7-4e4d-a5b8-333c324834f6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:39.987274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63401887-11c7-4e4d-a5b8-333c324834f6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:39.988023 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63401887-11c7-4e4d-a5b8-333c324834f6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:39.989508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63401887-11c7-4e4d-a5b8-333c324834f6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:39.990233 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63401887-11c7-4e4d-a5b8-333c324834f6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:39.990894 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63401887-11c7-4e4d-a5b8-333c324834f6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:40.004857 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8377ebdd-774f-43a0-bb7e-ec152ee3aa5c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:40.005507 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8377ebdd-774f-43a0-bb7e-ec152ee3aa5c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:40.019872 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8377ebdd-774f-43a0-bb7e-ec152ee3aa5c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:40.022563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8377ebdd-774f-43a0-bb7e-ec152ee3aa5c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:40.024324 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8377ebdd-774f-43a0-bb7e-ec152ee3aa5c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:40.028861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8377ebdd-774f-43a0-bb7e-ec152ee3aa5c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:40.032445 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8377ebdd-774f-43a0-bb7e-ec152ee3aa5c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:40.034090 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8377ebdd-774f-43a0-bb7e-ec152ee3aa5c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:40.560998 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-63401887-11c7-4e4d-a5b8-333c324834f6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:40.583918 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-63401887-11c7-4e4d-a5b8-333c324834f6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.615119 Aug 04 17:18:40.588633 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2674/5391] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:39 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:40.610250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3c9b8a9a-edb0-42b7-8f35-39aa73dc9867 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:40.611690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3c9b8a9a-edb0-42b7-8f35-39aa73dc9867 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:40.624919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c9b8a9a-edb0-42b7-8f35-39aa73dc9867 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:40.627898 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c9b8a9a-edb0-42b7-8f35-39aa73dc9867 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:40.628695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c9b8a9a-edb0-42b7-8f35-39aa73dc9867 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:40.629857 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c9b8a9a-edb0-42b7-8f35-39aa73dc9867 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:40.634868 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c9b8a9a-edb0-42b7-8f35-39aa73dc9867 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:40.635653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c9b8a9a-edb0-42b7-8f35-39aa73dc9867 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:40.735414 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-3c9b8a9a-edb0-42b7-8f35-39aa73dc9867 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lazy-loading 'flavor' on Instance uuid 5248dcdc-5a16-4036-9537-eb84f73dc372 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:18:40.848560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8377ebdd-774f-43a0-bb7e-ec152ee3aa5c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:40.885694 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8377ebdd-774f-43a0-bb7e-ec152ee3aa5c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1683 microversion: 2.1 time: 0.879084 Aug 04 17:18:40.888626 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2718/5392] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:39 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1683 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:18:40.913633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:18:40.961567 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-822d782c-6d12-45ad-b720-3ed9779dce29 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:40.962925 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-822d782c-6d12-45ad-b720-3ed9779dce29 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:40.980282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-822d782c-6d12-45ad-b720-3ed9779dce29 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:40.983863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-822d782c-6d12-45ad-b720-3ed9779dce29 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:40.984497 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-822d782c-6d12-45ad-b720-3ed9779dce29 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:40.986007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-822d782c-6d12-45ad-b720-3ed9779dce29 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:40.988491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-822d782c-6d12-45ad-b720-3ed9779dce29 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:40.989020 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-822d782c-6d12-45ad-b720-3ed9779dce29 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:41.212477 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3c9b8a9a-edb0-42b7-8f35-39aa73dc9867 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372/action" status: 202 len: 0 microversion: 2.1 time: 0.590174 Aug 04 17:18:41.213716 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2675/5393] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:18:40 2022] POST /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372/action => generated 0 bytes in 609 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:18:41.231725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9b67c7e7-630f-4318-b0f0-943f97b786ee tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:41.236263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9b67c7e7-630f-4318-b0f0-943f97b786ee tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:41.264654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b67c7e7-630f-4318-b0f0-943f97b786ee tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:41.271481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b67c7e7-630f-4318-b0f0-943f97b786ee tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:41.272920 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b67c7e7-630f-4318-b0f0-943f97b786ee tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:41.274648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b67c7e7-630f-4318-b0f0-943f97b786ee tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:41.275963 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b67c7e7-630f-4318-b0f0-943f97b786ee tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:41.276666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b67c7e7-630f-4318-b0f0-943f97b786ee tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:42.445160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-822d782c-6d12-45ad-b720-3ed9779dce29 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:42.456676 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-822d782c-6d12-45ad-b720-3ed9779dce29 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:42.461137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-822d782c-6d12-45ad-b720-3ed9779dce29 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:42.467254 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-822d782c-6d12-45ad-b720-3ed9779dce29 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1740 microversion: 2.20 time: 1.510845 Aug 04 17:18:42.470132 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2719/5394] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:18:40 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1740 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:18:42.638861 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9b67c7e7-630f-4318-b0f0-943f97b786ee tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:42.650851 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9b67c7e7-630f-4318-b0f0-943f97b786ee tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1512 microversion: 2.1 time: 1.430631 Aug 04 17:18:42.651629 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2676/5395] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:41 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1512 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:43.492511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9fc8f7f9-6ab9-451e-98b0-72b57af60698 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:43.493486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9fc8f7f9-6ab9-451e-98b0-72b57af60698 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:43.520576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9fc8f7f9-6ab9-451e-98b0-72b57af60698 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:43.523612 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9fc8f7f9-6ab9-451e-98b0-72b57af60698 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:43.524901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9fc8f7f9-6ab9-451e-98b0-72b57af60698 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:43.527291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9fc8f7f9-6ab9-451e-98b0-72b57af60698 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:43.528712 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9fc8f7f9-6ab9-451e-98b0-72b57af60698 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:43.531107 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9fc8f7f9-6ab9-451e-98b0-72b57af60698 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:43.673206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e0347b5a-a00c-46b0-be5d-97e637f828aa tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:43.674737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e0347b5a-a00c-46b0-be5d-97e637f828aa tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:43.706811 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0347b5a-a00c-46b0-be5d-97e637f828aa tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:43.707883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0347b5a-a00c-46b0-be5d-97e637f828aa tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:43.710807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0347b5a-a00c-46b0-be5d-97e637f828aa tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:43.712146 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0347b5a-a00c-46b0-be5d-97e637f828aa tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:43.715442 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0347b5a-a00c-46b0-be5d-97e637f828aa tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:43.718284 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0347b5a-a00c-46b0-be5d-97e637f828aa tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:44.580591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e0347b5a-a00c-46b0-be5d-97e637f828aa tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:44.618030 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e0347b5a-a00c-46b0-be5d-97e637f828aa tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1512 microversion: 2.1 time: 0.948602 Aug 04 17:18:44.618682 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2677/5396] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:43 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1512 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:44.837113 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9fc8f7f9-6ab9-451e-98b0-72b57af60698 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:44.886189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9fc8f7f9-6ab9-451e-98b0-72b57af60698 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:44.892426 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9fc8f7f9-6ab9-451e-98b0-72b57af60698 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:44.904314 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9fc8f7f9-6ab9-451e-98b0-72b57af60698 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1740 microversion: 2.20 time: 1.415346 Aug 04 17:18:44.906882 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2720/5397] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:18:43 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1740 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:18:45.641794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a8f7a41d-310d-40fb-85d8-007135b63bcd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:45.643388 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a8f7a41d-310d-40fb-85d8-007135b63bcd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:45.672985 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8f7a41d-310d-40fb-85d8-007135b63bcd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:45.676439 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8f7a41d-310d-40fb-85d8-007135b63bcd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:45.677597 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8f7a41d-310d-40fb-85d8-007135b63bcd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:45.683401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8f7a41d-310d-40fb-85d8-007135b63bcd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:45.686427 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8f7a41d-310d-40fb-85d8-007135b63bcd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:45.695548 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8f7a41d-310d-40fb-85d8-007135b63bcd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:45.941503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b09e5bb3-66d5-4f15-a7dc-fdc0f7635014 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:45.942207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b09e5bb3-66d5-4f15-a7dc-fdc0f7635014 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:45.958021 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b09e5bb3-66d5-4f15-a7dc-fdc0f7635014 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:45.961193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b09e5bb3-66d5-4f15-a7dc-fdc0f7635014 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:45.961701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b09e5bb3-66d5-4f15-a7dc-fdc0f7635014 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:45.962489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b09e5bb3-66d5-4f15-a7dc-fdc0f7635014 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:45.963078 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b09e5bb3-66d5-4f15-a7dc-fdc0f7635014 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:45.963560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b09e5bb3-66d5-4f15-a7dc-fdc0f7635014 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:46.299055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a8f7a41d-310d-40fb-85d8-007135b63bcd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:46.308870 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a8f7a41d-310d-40fb-85d8-007135b63bcd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1512 microversion: 2.1 time: 0.672063 Aug 04 17:18:46.329692 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2678/5398] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:45 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1512 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:46.491277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b09e5bb3-66d5-4f15-a7dc-fdc0f7635014 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:46.509889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b09e5bb3-66d5-4f15-a7dc-fdc0f7635014 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:46.511727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b09e5bb3-66d5-4f15-a7dc-fdc0f7635014 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:46.521285 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b09e5bb3-66d5-4f15-a7dc-fdc0f7635014 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1740 microversion: 2.20 time: 0.584447 Aug 04 17:18:46.534275 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2721/5399] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:18:45 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1740 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:18:47.340849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2b2c9133-da6b-404e-89bc-7ab7f51f15b1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:47.345424 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2b2c9133-da6b-404e-89bc-7ab7f51f15b1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:47.376292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b2c9133-da6b-404e-89bc-7ab7f51f15b1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:47.381133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b2c9133-da6b-404e-89bc-7ab7f51f15b1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:47.382217 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b2c9133-da6b-404e-89bc-7ab7f51f15b1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:47.384614 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b2c9133-da6b-404e-89bc-7ab7f51f15b1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:47.387325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b2c9133-da6b-404e-89bc-7ab7f51f15b1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:47.388002 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b2c9133-da6b-404e-89bc-7ab7f51f15b1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:47.561398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-056cf2ab-e97a-458f-a44f-4d945e2fef3d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:47.562672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-056cf2ab-e97a-458f-a44f-4d945e2fef3d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:47.577034 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-056cf2ab-e97a-458f-a44f-4d945e2fef3d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:47.579097 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-056cf2ab-e97a-458f-a44f-4d945e2fef3d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:47.579806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-056cf2ab-e97a-458f-a44f-4d945e2fef3d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:47.580865 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-056cf2ab-e97a-458f-a44f-4d945e2fef3d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:47.582483 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-056cf2ab-e97a-458f-a44f-4d945e2fef3d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:47.583154 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-056cf2ab-e97a-458f-a44f-4d945e2fef3d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:48.440684 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-056cf2ab-e97a-458f-a44f-4d945e2fef3d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:48.458065 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2b2c9133-da6b-404e-89bc-7ab7f51f15b1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:48.465509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-056cf2ab-e97a-458f-a44f-4d945e2fef3d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:48.478853 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-056cf2ab-e97a-458f-a44f-4d945e2fef3d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:48.480110 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2b2c9133-da6b-404e-89bc-7ab7f51f15b1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1512 microversion: 2.1 time: 1.145783 Aug 04 17:18:48.480773 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2679/5400] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:47 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1512 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:48.482581 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-056cf2ab-e97a-458f-a44f-4d945e2fef3d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1740 microversion: 2.20 time: 0.923537 Aug 04 17:18:48.485366 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2722/5401] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:18:47 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1740 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:18:49.516672 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9f794611-638a-4a43-9ec8-56d5d3db6b75 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:49.518067 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9f794611-638a-4a43-9ec8-56d5d3db6b75 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:49.537407 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7ddf6d18-2e8e-4e6c-bec7-a50cb9406c25 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:49.538792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7ddf6d18-2e8e-4e6c-bec7-a50cb9406c25 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:49.554902 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f794611-638a-4a43-9ec8-56d5d3db6b75 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:49.555994 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f794611-638a-4a43-9ec8-56d5d3db6b75 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:49.558603 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f794611-638a-4a43-9ec8-56d5d3db6b75 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:49.560616 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f794611-638a-4a43-9ec8-56d5d3db6b75 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:49.561701 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f794611-638a-4a43-9ec8-56d5d3db6b75 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:49.562436 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7ddf6d18-2e8e-4e6c-bec7-a50cb9406c25 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:49.562994 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f794611-638a-4a43-9ec8-56d5d3db6b75 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:49.575270 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7ddf6d18-2e8e-4e6c-bec7-a50cb9406c25 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:49.577283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7ddf6d18-2e8e-4e6c-bec7-a50cb9406c25 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:49.583188 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7ddf6d18-2e8e-4e6c-bec7-a50cb9406c25 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:49.583976 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7ddf6d18-2e8e-4e6c-bec7-a50cb9406c25 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:49.585789 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7ddf6d18-2e8e-4e6c-bec7-a50cb9406c25 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:50.845686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9f794611-638a-4a43-9ec8-56d5d3db6b75 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:50.860625 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9f794611-638a-4a43-9ec8-56d5d3db6b75 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1512 microversion: 2.1 time: 1.344196 Aug 04 17:18:50.862099 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2680/5402] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:49 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1512 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:51.140699 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7ddf6d18-2e8e-4e6c-bec7-a50cb9406c25 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:51.178014 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7ddf6d18-2e8e-4e6c-bec7-a50cb9406c25 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:51.195012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7ddf6d18-2e8e-4e6c-bec7-a50cb9406c25 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:51.201885 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7ddf6d18-2e8e-4e6c-bec7-a50cb9406c25 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1740 microversion: 2.20 time: 1.665105 Aug 04 17:18:51.208180 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2723/5403] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:18:49 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1740 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:18:51.885258 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fc168403-42c6-45dc-8010-33b733654a5a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:51.886974 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fc168403-42c6-45dc-8010-33b733654a5a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:51.900954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc168403-42c6-45dc-8010-33b733654a5a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:51.901825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc168403-42c6-45dc-8010-33b733654a5a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:51.903275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc168403-42c6-45dc-8010-33b733654a5a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:51.905575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc168403-42c6-45dc-8010-33b733654a5a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:51.906889 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc168403-42c6-45dc-8010-33b733654a5a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:51.912891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc168403-42c6-45dc-8010-33b733654a5a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:52.238554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-64055505-b2a0-4d09-bb37-da99798996bc tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:52.240137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-64055505-b2a0-4d09-bb37-da99798996bc tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:52.251297 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64055505-b2a0-4d09-bb37-da99798996bc tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:52.259467 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64055505-b2a0-4d09-bb37-da99798996bc tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:52.260222 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64055505-b2a0-4d09-bb37-da99798996bc tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:52.261453 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64055505-b2a0-4d09-bb37-da99798996bc tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:52.272693 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64055505-b2a0-4d09-bb37-da99798996bc tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:52.273487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64055505-b2a0-4d09-bb37-da99798996bc tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:52.504237 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fc168403-42c6-45dc-8010-33b733654a5a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:52.517188 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fc168403-42c6-45dc-8010-33b733654a5a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1512 microversion: 2.1 time: 0.636079 Aug 04 17:18:52.527040 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2681/5404] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:51 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1512 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:53.009825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-64055505-b2a0-4d09-bb37-da99798996bc tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:53.025882 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-64055505-b2a0-4d09-bb37-da99798996bc tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:53.033370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-64055505-b2a0-4d09-bb37-da99798996bc tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:53.035750 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-64055505-b2a0-4d09-bb37-da99798996bc tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1740 microversion: 2.20 time: 0.810505 Aug 04 17:18:53.065732 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2724/5405] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:18:52 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1740 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:18:53.553054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4728ad89-5cfc-43c9-941f-fed33c07caca tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:53.554383 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4728ad89-5cfc-43c9-941f-fed33c07caca tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:53.568198 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4728ad89-5cfc-43c9-941f-fed33c07caca tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:53.575196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4728ad89-5cfc-43c9-941f-fed33c07caca tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:53.577697 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4728ad89-5cfc-43c9-941f-fed33c07caca tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:53.584374 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4728ad89-5cfc-43c9-941f-fed33c07caca tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:53.585131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4728ad89-5cfc-43c9-941f-fed33c07caca tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:53.586507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4728ad89-5cfc-43c9-941f-fed33c07caca tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:54.061202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8a2bb0b6-68d9-49c0-845a-466ab1682f49 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:54.062518 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8a2bb0b6-68d9-49c0-845a-466ab1682f49 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:54.088945 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a2bb0b6-68d9-49c0-845a-466ab1682f49 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:54.089452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a2bb0b6-68d9-49c0-845a-466ab1682f49 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:54.089890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a2bb0b6-68d9-49c0-845a-466ab1682f49 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:54.090653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a2bb0b6-68d9-49c0-845a-466ab1682f49 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:54.091373 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a2bb0b6-68d9-49c0-845a-466ab1682f49 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:54.091569 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a2bb0b6-68d9-49c0-845a-466ab1682f49 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:54.163121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:18:54.614223 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4728ad89-5cfc-43c9-941f-fed33c07caca tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:54.622509 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4728ad89-5cfc-43c9-941f-fed33c07caca tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1512 microversion: 2.1 time: 1.075087 Aug 04 17:18:54.645002 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2682/5406] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:53 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1512 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:54.824359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8a2bb0b6-68d9-49c0-845a-466ab1682f49 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:54.832871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8a2bb0b6-68d9-49c0-845a-466ab1682f49 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:54.837864 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8a2bb0b6-68d9-49c0-845a-466ab1682f49 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:54.843427 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8a2bb0b6-68d9-49c0-845a-466ab1682f49 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1740 microversion: 2.20 time: 0.786413 Aug 04 17:18:54.844129 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2725/5407] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:18:54 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1740 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:18:55.652937 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-777171f1-c3c3-41c6-9939-9084953bbf03 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:55.653596 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-777171f1-c3c3-41c6-9939-9084953bbf03 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:55.664958 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=58 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:18:55.672187 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-777171f1-c3c3-41c6-9939-9084953bbf03 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:55.674469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-777171f1-c3c3-41c6-9939-9084953bbf03 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:55.675326 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-777171f1-c3c3-41c6-9939-9084953bbf03 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:55.678278 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-777171f1-c3c3-41c6-9939-9084953bbf03 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:55.678957 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-777171f1-c3c3-41c6-9939-9084953bbf03 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:55.681381 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-777171f1-c3c3-41c6-9939-9084953bbf03 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:55.867944 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3ed66d92-5800-478a-b496-e73b34824c53 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:55.869194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3ed66d92-5800-478a-b496-e73b34824c53 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:55.880250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ed66d92-5800-478a-b496-e73b34824c53 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:55.888032 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ed66d92-5800-478a-b496-e73b34824c53 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:55.888850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ed66d92-5800-478a-b496-e73b34824c53 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:55.889822 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ed66d92-5800-478a-b496-e73b34824c53 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:55.890506 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ed66d92-5800-478a-b496-e73b34824c53 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:55.891393 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ed66d92-5800-478a-b496-e73b34824c53 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:56.082039 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-777171f1-c3c3-41c6-9939-9084953bbf03 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:56.092775 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-777171f1-c3c3-41c6-9939-9084953bbf03 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1512 microversion: 2.1 time: 0.444204 Aug 04 17:18:56.114380 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2683/5408] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:55 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1512 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:56.174265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-97151913-f5f3-4ef6-9db8-76a438ae600e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:18:56.177123 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-97151913-f5f3-4ef6-9db8-76a438ae600e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:56.190194 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97151913-f5f3-4ef6-9db8-76a438ae600e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:56.190381 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97151913-f5f3-4ef6-9db8-76a438ae600e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:56.191296 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97151913-f5f3-4ef6-9db8-76a438ae600e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:56.192028 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97151913-f5f3-4ef6-9db8-76a438ae600e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:56.192497 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97151913-f5f3-4ef6-9db8-76a438ae600e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:56.192921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97151913-f5f3-4ef6-9db8-76a438ae600e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:56.211230 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3ed66d92-5800-478a-b496-e73b34824c53 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:56.220018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3ed66d92-5800-478a-b496-e73b34824c53 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:56.222218 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3ed66d92-5800-478a-b496-e73b34824c53 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:56.235502 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3ed66d92-5800-478a-b496-e73b34824c53 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1740 microversion: 2.20 time: 0.371684 Aug 04 17:18:56.236109 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2726/5409] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:18:55 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1740 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:18:56.321932 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-97151913-f5f3-4ef6-9db8-76a438ae600e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "POST /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0/action" status: 200 len: 24561 microversion: 2.1 time: 0.151638 Aug 04 17:18:56.323366 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2684/5410] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:18:56 2022] POST /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0/action => generated 24561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 17:18:57.117277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-69117882-8969-471e-96d0-f3744d353618 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:57.117966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-69117882-8969-471e-96d0-f3744d353618 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:57.140034 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-69117882-8969-471e-96d0-f3744d353618 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:57.143456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-69117882-8969-471e-96d0-f3744d353618 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:57.144203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-69117882-8969-471e-96d0-f3744d353618 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:57.150754 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-69117882-8969-471e-96d0-f3744d353618 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:57.151313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-69117882-8969-471e-96d0-f3744d353618 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:57.151771 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-69117882-8969-471e-96d0-f3744d353618 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:57.269258 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4ad89f6b-3be2-4f98-adc7-1012dfbb5268 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:57.269942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4ad89f6b-3be2-4f98-adc7-1012dfbb5268 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:57.290567 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ad89f6b-3be2-4f98-adc7-1012dfbb5268 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:57.291479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ad89f6b-3be2-4f98-adc7-1012dfbb5268 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:57.293074 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ad89f6b-3be2-4f98-adc7-1012dfbb5268 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:57.294081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ad89f6b-3be2-4f98-adc7-1012dfbb5268 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:57.294763 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ad89f6b-3be2-4f98-adc7-1012dfbb5268 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:57.296244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ad89f6b-3be2-4f98-adc7-1012dfbb5268 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:58.125922 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4ad89f6b-3be2-4f98-adc7-1012dfbb5268 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:58.155302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4ad89f6b-3be2-4f98-adc7-1012dfbb5268 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:58.160975 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4ad89f6b-3be2-4f98-adc7-1012dfbb5268 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:58.168217 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4ad89f6b-3be2-4f98-adc7-1012dfbb5268 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1740 microversion: 2.20 time: 0.900377 Aug 04 17:18:58.168885 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2685/5411] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:18:57 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1740 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:18:58.722921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-69117882-8969-471e-96d0-f3744d353618 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:18:58.731400 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-69117882-8969-471e-96d0-f3744d353618 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1533 microversion: 2.1 time: 1.619168 Aug 04 17:18:58.732433 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2727/5412] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:57 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1533 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:18:59.196940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a3a7091e-c47f-4ceb-90da-2fafd18ce4e4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:59.198481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a3a7091e-c47f-4ceb-90da-2fafd18ce4e4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:59.250536 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3a7091e-c47f-4ceb-90da-2fafd18ce4e4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:59.251187 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3a7091e-c47f-4ceb-90da-2fafd18ce4e4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:59.251657 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3a7091e-c47f-4ceb-90da-2fafd18ce4e4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:59.252743 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3a7091e-c47f-4ceb-90da-2fafd18ce4e4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:59.253354 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3a7091e-c47f-4ceb-90da-2fafd18ce4e4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:59.254063 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3a7091e-c47f-4ceb-90da-2fafd18ce4e4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:59.768179 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bd1220d8-41f1-4a22-83db-b08ad029093c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:18:59.769663 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bd1220d8-41f1-4a22-83db-b08ad029093c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:18:59.814089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bd1220d8-41f1-4a22-83db-b08ad029093c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:59.818262 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bd1220d8-41f1-4a22-83db-b08ad029093c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:59.822098 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bd1220d8-41f1-4a22-83db-b08ad029093c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:59.828039 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bd1220d8-41f1-4a22-83db-b08ad029093c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:18:59.829622 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bd1220d8-41f1-4a22-83db-b08ad029093c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:18:59.833327 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bd1220d8-41f1-4a22-83db-b08ad029093c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:18:59.981611 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a3a7091e-c47f-4ceb-90da-2fafd18ce4e4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:00.008226 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a3a7091e-c47f-4ceb-90da-2fafd18ce4e4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:00.021339 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a3a7091e-c47f-4ceb-90da-2fafd18ce4e4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:00.028225 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a3a7091e-c47f-4ceb-90da-2fafd18ce4e4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1740 microversion: 2.20 time: 0.837502 Aug 04 17:19:00.029748 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2686/5413] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:18:59 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1740 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:19:00.650881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bd1220d8-41f1-4a22-83db-b08ad029093c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:00.666971 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bd1220d8-41f1-4a22-83db-b08ad029093c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1533 microversion: 2.1 time: 0.905286 Aug 04 17:19:00.669526 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2728/5414] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:18:59 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1533 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:19:01.101495 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-86959039-2359-4a62-ad8e-cc8090accc77 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:01.102311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-86959039-2359-4a62-ad8e-cc8090accc77 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:01.133957 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86959039-2359-4a62-ad8e-cc8090accc77 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:01.135064 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86959039-2359-4a62-ad8e-cc8090accc77 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:01.135791 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86959039-2359-4a62-ad8e-cc8090accc77 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:01.137055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86959039-2359-4a62-ad8e-cc8090accc77 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:01.137741 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86959039-2359-4a62-ad8e-cc8090accc77 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:01.138281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86959039-2359-4a62-ad8e-cc8090accc77 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:01.701850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e0e534ee-0944-4a5a-96f9-2bfbeaacef04 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:01.702611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e0e534ee-0944-4a5a-96f9-2bfbeaacef04 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:01.728341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-86959039-2359-4a62-ad8e-cc8090accc77 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:01.742681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0e534ee-0944-4a5a-96f9-2bfbeaacef04 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:01.745418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0e534ee-0944-4a5a-96f9-2bfbeaacef04 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:01.749375 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0e534ee-0944-4a5a-96f9-2bfbeaacef04 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:01.749610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-86959039-2359-4a62-ad8e-cc8090accc77 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:01.752424 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0e534ee-0944-4a5a-96f9-2bfbeaacef04 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:01.753497 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0e534ee-0944-4a5a-96f9-2bfbeaacef04 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:01.754003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0e534ee-0944-4a5a-96f9-2bfbeaacef04 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:01.764116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-86959039-2359-4a62-ad8e-cc8090accc77 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:01.775693 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-86959039-2359-4a62-ad8e-cc8090accc77 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1740 microversion: 2.20 time: 0.669664 Aug 04 17:19:01.775693 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2687/5415] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:19:01 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1740 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:19:02.115688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-3c386c74-0195-44a1-8159-921dd34b6a8a req-bf3ea05f-3441-4fc9-9962-0783b7c58f7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5248dcdc-5a16-4036-9537-eb84f73dc372", "name": "network-vif-plugged", "status": "completed", "tag": "620457fa-43b8-4d5c-9ed1-44c49f63239c"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:19:02.144606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e0e534ee-0944-4a5a-96f9-2bfbeaacef04 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:02.163127 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e0e534ee-0944-4a5a-96f9-2bfbeaacef04 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1528 microversion: 2.1 time: 0.466721 Aug 04 17:19:02.167990 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2729/5416] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:01 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1528 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:19:02.173588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-3c386c74-0195-44a1-8159-921dd34b6a8a req-bf3ea05f-3441-4fc9-9962-0783b7c58f7c service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:02.174119 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-3c386c74-0195-44a1-8159-921dd34b6a8a req-bf3ea05f-3441-4fc9-9962-0783b7c58f7c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:02.184371 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-3c386c74-0195-44a1-8159-921dd34b6a8a req-bf3ea05f-3441-4fc9-9962-0783b7c58f7c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:02.243955 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-3c386c74-0195-44a1-8159-921dd34b6a8a req-bf3ea05f-3441-4fc9-9962-0783b7c58f7c service nova] Creating event network-vif-plugged:620457fa-43b8-4d5c-9ed1-44c49f63239c for instance 5248dcdc-5a16-4036-9537-eb84f73dc372 on n-h1-851359-3 Aug 04 17:19:02.271628 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-3c386c74-0195-44a1-8159-921dd34b6a8a req-bf3ea05f-3441-4fc9-9962-0783b7c58f7c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163607 Aug 04 17:19:02.281213 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2688/5417] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:19:02.803573 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-74cf353d-1bb1-45fa-bd09-3d188be40d28 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:02.804114 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-74cf353d-1bb1-45fa-bd09-3d188be40d28 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:02.840624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-74cf353d-1bb1-45fa-bd09-3d188be40d28 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:02.847626 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-74cf353d-1bb1-45fa-bd09-3d188be40d28 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:02.848518 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-74cf353d-1bb1-45fa-bd09-3d188be40d28 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:02.850709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-74cf353d-1bb1-45fa-bd09-3d188be40d28 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:02.855497 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-74cf353d-1bb1-45fa-bd09-3d188be40d28 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:02.857474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-74cf353d-1bb1-45fa-bd09-3d188be40d28 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:03.195739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-97243063-59fd-469f-9781-79f8258485b2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:03.196523 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-97243063-59fd-469f-9781-79f8258485b2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:03.221163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97243063-59fd-469f-9781-79f8258485b2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:03.240274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97243063-59fd-469f-9781-79f8258485b2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:03.243955 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97243063-59fd-469f-9781-79f8258485b2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:03.245206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97243063-59fd-469f-9781-79f8258485b2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:03.246142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97243063-59fd-469f-9781-79f8258485b2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:03.246806 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97243063-59fd-469f-9781-79f8258485b2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:03.549157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-74cf353d-1bb1-45fa-bd09-3d188be40d28 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:03.563128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-74cf353d-1bb1-45fa-bd09-3d188be40d28 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:03.565244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-74cf353d-1bb1-45fa-bd09-3d188be40d28 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:03.566681 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-74cf353d-1bb1-45fa-bd09-3d188be40d28 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1740 microversion: 2.20 time: 0.769848 Aug 04 17:19:03.569778 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2730/5418] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:19:02 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1740 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:19:03.882469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-97243063-59fd-469f-9781-79f8258485b2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:03.892884 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-97243063-59fd-469f-9781-79f8258485b2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1528 microversion: 2.1 time: 0.707954 Aug 04 17:19:03.907562 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2689/5419] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:03 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1528 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:04.591290 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-af6c7c80-90cf-4e3c-8d6d-7951f1a29f24 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:04.591912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-af6c7c80-90cf-4e3c-8d6d-7951f1a29f24 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:04.612461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af6c7c80-90cf-4e3c-8d6d-7951f1a29f24 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:04.614061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af6c7c80-90cf-4e3c-8d6d-7951f1a29f24 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:04.614715 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af6c7c80-90cf-4e3c-8d6d-7951f1a29f24 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:04.617492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af6c7c80-90cf-4e3c-8d6d-7951f1a29f24 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:04.619520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af6c7c80-90cf-4e3c-8d6d-7951f1a29f24 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:04.620409 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af6c7c80-90cf-4e3c-8d6d-7951f1a29f24 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:04.925511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cafceeb6-f007-44ab-9f9a-5f845c751e72 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:04.927743 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cafceeb6-f007-44ab-9f9a-5f845c751e72 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:04.943850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cafceeb6-f007-44ab-9f9a-5f845c751e72 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:04.949627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cafceeb6-f007-44ab-9f9a-5f845c751e72 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:04.950391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cafceeb6-f007-44ab-9f9a-5f845c751e72 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:04.953073 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cafceeb6-f007-44ab-9f9a-5f845c751e72 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:04.954490 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cafceeb6-f007-44ab-9f9a-5f845c751e72 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:04.959182 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cafceeb6-f007-44ab-9f9a-5f845c751e72 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:05.400942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-af6c7c80-90cf-4e3c-8d6d-7951f1a29f24 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:05.425178 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-af6c7c80-90cf-4e3c-8d6d-7951f1a29f24 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:05.427363 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-af6c7c80-90cf-4e3c-8d6d-7951f1a29f24 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:05.428835 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-af6c7c80-90cf-4e3c-8d6d-7951f1a29f24 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1740 microversion: 2.20 time: 0.841608 Aug 04 17:19:05.431244 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2731/5420] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:19:04 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1740 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:19:05.859918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cafceeb6-f007-44ab-9f9a-5f845c751e72 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:05.878892 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cafceeb6-f007-44ab-9f9a-5f845c751e72 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1528 microversion: 2.1 time: 0.957861 Aug 04 17:19:05.879932 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2690/5421] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:04 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1528 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:06.060663 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-27847c57-8d96-4e10-a981-ce34ce17e2cd tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:06.061326 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-27847c57-8d96-4e10-a981-ce34ce17e2cd tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:06.069487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-27847c57-8d96-4e10-a981-ce34ce17e2cd tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:06.078941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-27847c57-8d96-4e10-a981-ce34ce17e2cd tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:06.081271 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-27847c57-8d96-4e10-a981-ce34ce17e2cd tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:06.083094 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-27847c57-8d96-4e10-a981-ce34ce17e2cd tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:06.087163 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-27847c57-8d96-4e10-a981-ce34ce17e2cd tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:06.088713 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-27847c57-8d96-4e10-a981-ce34ce17e2cd tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:06.157858 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-27847c57-8d96-4e10-a981-ce34ce17e2cd tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b/ips" status: 200 len: 150 microversion: 2.1 time: 0.101264 Aug 04 17:19:06.161580 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2732/5422] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Aug 4 17:19:06 2022] GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b/ips => generated 150 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:19:06.462425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2e4d0a7c-5e08-4ca1-a1d2-7437b5e4354b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:06.464118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2e4d0a7c-5e08-4ca1-a1d2-7437b5e4354b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:06.474250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e4d0a7c-5e08-4ca1-a1d2-7437b5e4354b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:06.474991 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e4d0a7c-5e08-4ca1-a1d2-7437b5e4354b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:06.475626 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e4d0a7c-5e08-4ca1-a1d2-7437b5e4354b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:06.476543 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e4d0a7c-5e08-4ca1-a1d2-7437b5e4354b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:06.477169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e4d0a7c-5e08-4ca1-a1d2-7437b5e4354b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:06.477782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e4d0a7c-5e08-4ca1-a1d2-7437b5e4354b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:06.906076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9b20107d-f657-42a8-b368-7ffe49703686 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:06.906994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9b20107d-f657-42a8-b368-7ffe49703686 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:06.909220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=40 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:19:06.919568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b20107d-f657-42a8-b368-7ffe49703686 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:06.924739 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b20107d-f657-42a8-b368-7ffe49703686 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:06.925458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b20107d-f657-42a8-b368-7ffe49703686 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:06.926404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b20107d-f657-42a8-b368-7ffe49703686 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:06.927030 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b20107d-f657-42a8-b368-7ffe49703686 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:06.927725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b20107d-f657-42a8-b368-7ffe49703686 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:07.946701 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2e4d0a7c-5e08-4ca1-a1d2-7437b5e4354b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:07.968553 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2e4d0a7c-5e08-4ca1-a1d2-7437b5e4354b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:07.971213 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2e4d0a7c-5e08-4ca1-a1d2-7437b5e4354b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:07.973534 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2e4d0a7c-5e08-4ca1-a1d2-7437b5e4354b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1722 microversion: 2.20 time: 1.517567 Aug 04 17:19:07.987165 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2691/5423] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:19:06 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1722 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:19:08.004982 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4eff961f-cad0-4c7f-b5d2-bd9fef5a8643 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:08.023976 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4eff961f-cad0-4c7f-b5d2-bd9fef5a8643 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:08.063974 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4eff961f-cad0-4c7f-b5d2-bd9fef5a8643 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:08.076337 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4eff961f-cad0-4c7f-b5d2-bd9fef5a8643 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:08.077170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4eff961f-cad0-4c7f-b5d2-bd9fef5a8643 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:08.077688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9b20107d-f657-42a8-b368-7ffe49703686 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:08.078832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4eff961f-cad0-4c7f-b5d2-bd9fef5a8643 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:08.079555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4eff961f-cad0-4c7f-b5d2-bd9fef5a8643 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:08.080277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4eff961f-cad0-4c7f-b5d2-bd9fef5a8643 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:08.115511 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9b20107d-f657-42a8-b368-7ffe49703686 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1528 microversion: 2.1 time: 1.209733 Aug 04 17:19:08.116045 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2733/5424] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:06 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1528 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:09.028492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bbb494b3-7640-4239-aed7-23249afe2f78 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:09.035851 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bbb494b3-7640-4239-aed7-23249afe2f78 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:09.065927 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bbb494b3-7640-4239-aed7-23249afe2f78 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:09.082007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bbb494b3-7640-4239-aed7-23249afe2f78 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:09.083375 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bbb494b3-7640-4239-aed7-23249afe2f78 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:09.088121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bbb494b3-7640-4239-aed7-23249afe2f78 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:09.112305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bbb494b3-7640-4239-aed7-23249afe2f78 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:09.114483 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bbb494b3-7640-4239-aed7-23249afe2f78 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:09.129463 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4eff961f-cad0-4c7f-b5d2-bd9fef5a8643 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1834 microversion: 2.1 time: 1.140907 Aug 04 17:19:09.130087 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2692/5425] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:07 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1834 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:09.167072 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b471a31c-8322-40b0-a110-1bd63c7d2094 req-459c7aaa-d2cf-4a6a-a8eb-11230b10d550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7dd09c1-f3da-438a-b0d8-1102ee2d67f8", "name": "network-vif-unplugged", "status": "completed", "tag": "1dd4fc9a-a07b-4b63-82e0-ad9da9f1b5b2"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:19:09.208047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b471a31c-8322-40b0-a110-1bd63c7d2094 req-459c7aaa-d2cf-4a6a-a8eb-11230b10d550 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:09.213010 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b471a31c-8322-40b0-a110-1bd63c7d2094 req-459c7aaa-d2cf-4a6a-a8eb-11230b10d550 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:09.216099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b471a31c-8322-40b0-a110-1bd63c7d2094 req-459c7aaa-d2cf-4a6a-a8eb-11230b10d550 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:09.248760 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b471a31c-8322-40b0-a110-1bd63c7d2094 req-459c7aaa-d2cf-4a6a-a8eb-11230b10d550 service nova] Creating event network-vif-unplugged:1dd4fc9a-a07b-4b63-82e0-ad9da9f1b5b2 for instance e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 on n-h2-851359-3 Aug 04 17:19:09.271818 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b471a31c-8322-40b0-a110-1bd63c7d2094 req-459c7aaa-d2cf-4a6a-a8eb-11230b10d550 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115759 Aug 04 17:19:09.272445 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2693/5426] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:19:09.285304 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e04ea322-cb5d-4d80-9d3e-8ecb6f61e24e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:09.286047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e04ea322-cb5d-4d80-9d3e-8ecb6f61e24e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:09.319425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e04ea322-cb5d-4d80-9d3e-8ecb6f61e24e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:09.319943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e04ea322-cb5d-4d80-9d3e-8ecb6f61e24e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:09.325406 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e04ea322-cb5d-4d80-9d3e-8ecb6f61e24e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:09.329917 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e04ea322-cb5d-4d80-9d3e-8ecb6f61e24e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:09.332664 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e04ea322-cb5d-4d80-9d3e-8ecb6f61e24e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:09.333821 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e04ea322-cb5d-4d80-9d3e-8ecb6f61e24e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:09.359758 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:19:09.990532 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bbb494b3-7640-4239-aed7-23249afe2f78 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:10.010566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bbb494b3-7640-4239-aed7-23249afe2f78 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:10.016836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bbb494b3-7640-4239-aed7-23249afe2f78 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:10.021591 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bbb494b3-7640-4239-aed7-23249afe2f78 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1722 microversion: 2.20 time: 1.008906 Aug 04 17:19:10.022618 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2734/5427] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:19:09 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1722 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:19:10.036041 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b0b1c512-e7fe-4254-a0e7-35336c84a3bf tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e173729-c2a9-416d-bfb2-e8b5bbc3548e"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:19:10.039320 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b0b1c512-e7fe-4254-a0e7-35336c84a3bf tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:10.054462 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0b1c512-e7fe-4254-a0e7-35336c84a3bf tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:10.055257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0b1c512-e7fe-4254-a0e7-35336c84a3bf tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:10.055891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0b1c512-e7fe-4254-a0e7-35336c84a3bf tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:10.056796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0b1c512-e7fe-4254-a0e7-35336c84a3bf tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:10.058693 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0b1c512-e7fe-4254-a0e7-35336c84a3bf tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:10.059366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0b1c512-e7fe-4254-a0e7-35336c84a3bf tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:10.720548 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e04ea322-cb5d-4d80-9d3e-8ecb6f61e24e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:10.742318 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e04ea322-cb5d-4d80-9d3e-8ecb6f61e24e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1528 microversion: 2.1 time: 1.456173 Aug 04 17:19:10.742995 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2694/5428] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:09 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1528 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:10.773032 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b0b1c512-e7fe-4254-a0e7-35336c84a3bf tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "POST /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.748296 Aug 04 17:19:10.783440 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2735/5429] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Aug 4 17:19:10 2022] POST /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b/os-volume_attachments => generated 194 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:19:11.050495 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6797970e-36fc-4abe-90dd-8716209a6ff8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:11.051219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6797970e-36fc-4abe-90dd-8716209a6ff8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:11.066058 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6797970e-36fc-4abe-90dd-8716209a6ff8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:11.067664 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6797970e-36fc-4abe-90dd-8716209a6ff8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:11.071571 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6797970e-36fc-4abe-90dd-8716209a6ff8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:11.077112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6797970e-36fc-4abe-90dd-8716209a6ff8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:11.078825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6797970e-36fc-4abe-90dd-8716209a6ff8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:11.082272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6797970e-36fc-4abe-90dd-8716209a6ff8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:11.769034 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d76683b6-40db-4ceb-ae16-62266c48447f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:11.770153 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d76683b6-40db-4ceb-ae16-62266c48447f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:11.785587 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d76683b6-40db-4ceb-ae16-62266c48447f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:11.787959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d76683b6-40db-4ceb-ae16-62266c48447f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:11.788593 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d76683b6-40db-4ceb-ae16-62266c48447f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:11.790292 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d76683b6-40db-4ceb-ae16-62266c48447f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:11.793564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d76683b6-40db-4ceb-ae16-62266c48447f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:11.794879 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d76683b6-40db-4ceb-ae16-62266c48447f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:12.178168 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6797970e-36fc-4abe-90dd-8716209a6ff8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:12.189487 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6797970e-36fc-4abe-90dd-8716209a6ff8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:12.191600 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6797970e-36fc-4abe-90dd-8716209a6ff8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:12.206946 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6797970e-36fc-4abe-90dd-8716209a6ff8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1722 microversion: 2.20 time: 1.162299 Aug 04 17:19:12.207576 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2695/5430] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:19:11 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1722 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:19:12.698778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d76683b6-40db-4ceb-ae16-62266c48447f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:12.709252 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d76683b6-40db-4ceb-ae16-62266c48447f tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1528 microversion: 2.1 time: 0.947890 Aug 04 17:19:12.713957 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2736/5431] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:11 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1528 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:13.243030 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-576bed7e-032f-4f57-b5aa-f32494ef71be tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:13.243776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-576bed7e-032f-4f57-b5aa-f32494ef71be tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:13.265419 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-576bed7e-032f-4f57-b5aa-f32494ef71be tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:13.273889 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-576bed7e-032f-4f57-b5aa-f32494ef71be tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:13.275316 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-576bed7e-032f-4f57-b5aa-f32494ef71be tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:13.276311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-576bed7e-032f-4f57-b5aa-f32494ef71be tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:13.282832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-576bed7e-032f-4f57-b5aa-f32494ef71be tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:13.287107 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-576bed7e-032f-4f57-b5aa-f32494ef71be tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:13.732780 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-61d1fc3f-acc4-43af-8717-23ab391594f3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:13.734126 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-61d1fc3f-acc4-43af-8717-23ab391594f3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:13.745939 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61d1fc3f-acc4-43af-8717-23ab391594f3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:13.746904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61d1fc3f-acc4-43af-8717-23ab391594f3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:13.747586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61d1fc3f-acc4-43af-8717-23ab391594f3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:13.748551 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61d1fc3f-acc4-43af-8717-23ab391594f3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:13.749259 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61d1fc3f-acc4-43af-8717-23ab391594f3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:13.749943 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61d1fc3f-acc4-43af-8717-23ab391594f3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:14.361493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-61d1fc3f-acc4-43af-8717-23ab391594f3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:14.379095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-576bed7e-032f-4f57-b5aa-f32494ef71be tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:14.390143 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-61d1fc3f-acc4-43af-8717-23ab391594f3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1528 microversion: 2.1 time: 0.660007 Aug 04 17:19:14.390775 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2737/5432] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:13 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1528 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:19:14.409311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-576bed7e-032f-4f57-b5aa-f32494ef71be tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:14.409311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-576bed7e-032f-4f57-b5aa-f32494ef71be tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:14.410596 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-576bed7e-032f-4f57-b5aa-f32494ef71be tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1665 microversion: 2.20 time: 1.167928 Aug 04 17:19:14.429874 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2696/5433] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:19:13 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1665 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:19:14.434930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4f8cfbf4-24b4-4df8-bc49-7b0c1ef8136f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "124d1cdd-6e9b-441b-9bb7-c58bfad6e11e"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:19:14.437948 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4f8cfbf4-24b4-4df8-bc49-7b0c1ef8136f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:14.446982 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f8cfbf4-24b4-4df8-bc49-7b0c1ef8136f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:14.447647 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f8cfbf4-24b4-4df8-bc49-7b0c1ef8136f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:14.448973 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f8cfbf4-24b4-4df8-bc49-7b0c1ef8136f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:14.449708 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f8cfbf4-24b4-4df8-bc49-7b0c1ef8136f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:14.450236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f8cfbf4-24b4-4df8-bc49-7b0c1ef8136f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:14.450673 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f8cfbf4-24b4-4df8-bc49-7b0c1ef8136f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:14.775130 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2b61d90d-3b2e-47d6-b190-69259acca153 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:14.776271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2b61d90d-3b2e-47d6-b190-69259acca153 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:14.804061 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b61d90d-3b2e-47d6-b190-69259acca153 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:14.808452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b61d90d-3b2e-47d6-b190-69259acca153 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:14.813960 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b61d90d-3b2e-47d6-b190-69259acca153 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:14.816173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b61d90d-3b2e-47d6-b190-69259acca153 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:14.822428 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b61d90d-3b2e-47d6-b190-69259acca153 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:14.824341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b61d90d-3b2e-47d6-b190-69259acca153 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:14.921575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2b61d90d-3b2e-47d6-b190-69259acca153 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:19:15.306715 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2b61d90d-3b2e-47d6-b190-69259acca153 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 204 len: 0 microversion: 2.1 time: 0.537815 Aug 04 17:19:15.317949 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2697/5434] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:19:14 2022] DELETE /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:19:15.343788 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-866ac29b-340c-47c1-839e-7f3478e705ba req-da311979-43e9-4f90-ac6d-122e30e8c43e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c6b1716-bb14-4f97-bc75-38403c1c1af0", "tag": "1e3189db-ad91-4d9e-bfe5-7b700963e0d9"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:19:15.380861 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-866ac29b-340c-47c1-839e-7f3478e705ba req-da311979-43e9-4f90-ac6d-122e30e8c43e service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:15.382803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-866ac29b-340c-47c1-839e-7f3478e705ba req-da311979-43e9-4f90-ac6d-122e30e8c43e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:15.383448 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-866ac29b-340c-47c1-839e-7f3478e705ba req-da311979-43e9-4f90-ac6d-122e30e8c43e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:15.443565 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-866ac29b-340c-47c1-839e-7f3478e705ba req-da311979-43e9-4f90-ac6d-122e30e8c43e service nova] Creating event network-changed:1e3189db-ad91-4d9e-bfe5-7b700963e0d9 for instance 9c6b1716-bb14-4f97-bc75-38403c1c1af0 on n-h1-851359-3 Aug 04 17:19:15.481052 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-866ac29b-340c-47c1-839e-7f3478e705ba req-da311979-43e9-4f90-ac6d-122e30e8c43e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159744 Aug 04 17:19:15.482843 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2698/5435] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:19:15.502244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-96d2e7f5-3b1d-4687-b093-39393ca667c9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:15.504326 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-96d2e7f5-3b1d-4687-b093-39393ca667c9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:15.531574 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96d2e7f5-3b1d-4687-b093-39393ca667c9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:15.534497 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96d2e7f5-3b1d-4687-b093-39393ca667c9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:15.535260 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96d2e7f5-3b1d-4687-b093-39393ca667c9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:15.540810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96d2e7f5-3b1d-4687-b093-39393ca667c9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:15.541587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96d2e7f5-3b1d-4687-b093-39393ca667c9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:15.542496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96d2e7f5-3b1d-4687-b093-39393ca667c9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:15.603514 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:19:15.667052 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4f8cfbf4-24b4-4df8-bc49-7b0c1ef8136f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "POST /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.233022 Aug 04 17:19:15.673706 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2738/5436] 10.222.0.93 () {62 vars in 1364 bytes} [Thu Aug 4 17:19:14 2022] POST /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8/os-volume_attachments => generated 188 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:19:15.746688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cdf1657d-cb1a-4a04-be92-5648b62ab7a5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:15.747759 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cdf1657d-cb1a-4a04-be92-5648b62ab7a5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:15.792788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cdf1657d-cb1a-4a04-be92-5648b62ab7a5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:15.797120 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cdf1657d-cb1a-4a04-be92-5648b62ab7a5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:15.799931 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cdf1657d-cb1a-4a04-be92-5648b62ab7a5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:15.804272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cdf1657d-cb1a-4a04-be92-5648b62ab7a5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:15.805844 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cdf1657d-cb1a-4a04-be92-5648b62ab7a5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:15.806750 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cdf1657d-cb1a-4a04-be92-5648b62ab7a5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:16.410118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-96d2e7f5-3b1d-4687-b093-39393ca667c9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:16.419648 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-96d2e7f5-3b1d-4687-b093-39393ca667c9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1689 microversion: 2.1 time: 0.933966 Aug 04 17:19:16.420244 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2699/5437] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:15 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1689 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:16.445996 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0e3db667-9865-43e5-90c3-60e73221449f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:16.446749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0e3db667-9865-43e5-90c3-60e73221449f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:16.468005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e3db667-9865-43e5-90c3-60e73221449f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:16.468836 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e3db667-9865-43e5-90c3-60e73221449f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:16.469468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e3db667-9865-43e5-90c3-60e73221449f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:16.470603 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e3db667-9865-43e5-90c3-60e73221449f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:16.471770 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e3db667-9865-43e5-90c3-60e73221449f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:16.472377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e3db667-9865-43e5-90c3-60e73221449f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:16.697216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cdf1657d-cb1a-4a04-be92-5648b62ab7a5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:16.711148 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cdf1657d-cb1a-4a04-be92-5648b62ab7a5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1528 microversion: 2.1 time: 1.028543 Aug 04 17:19:16.713367 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2739/5438] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:15 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1528 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:17.121254 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0e3db667-9865-43e5-90c3-60e73221449f tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8/os-volume_attachments/124d1cdd-6e9b-441b-9bb7-c58bfad6e11e" status: 202 len: 0 microversion: 2.20 time: 0.690586 Aug 04 17:19:17.122486 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2700/5439] 10.222.0.93 () {60 vars in 1457 bytes} [Thu Aug 4 17:19:16 2022] DELETE /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8/os-volume_attachments/124d1cdd-6e9b-441b-9bb7-c58bfad6e11e => generated 0 bytes in 692 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:19:17.441477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b2cf1c21-8723-47ca-a9e9-66e167ee7f94 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:17.442370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b2cf1c21-8723-47ca-a9e9-66e167ee7f94 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:17.464033 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2cf1c21-8723-47ca-a9e9-66e167ee7f94 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:17.464546 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2cf1c21-8723-47ca-a9e9-66e167ee7f94 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:17.471556 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2cf1c21-8723-47ca-a9e9-66e167ee7f94 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:17.482217 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2cf1c21-8723-47ca-a9e9-66e167ee7f94 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:17.485100 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2cf1c21-8723-47ca-a9e9-66e167ee7f94 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:17.487135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2cf1c21-8723-47ca-a9e9-66e167ee7f94 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:17.677079 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eeb90e04-5937-4370-9966-a4b0a4a1a79e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:19:17.677794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eeb90e04-5937-4370-9966-a4b0a4a1a79e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:17.711462 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eeb90e04-5937-4370-9966-a4b0a4a1a79e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:17.711993 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eeb90e04-5937-4370-9966-a4b0a4a1a79e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:17.712508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eeb90e04-5937-4370-9966-a4b0a4a1a79e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:17.731584 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eeb90e04-5937-4370-9966-a4b0a4a1a79e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:17.732188 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eeb90e04-5937-4370-9966-a4b0a4a1a79e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:17.732741 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eeb90e04-5937-4370-9966-a4b0a4a1a79e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:18.022813 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eeb90e04-5937-4370-9966-a4b0a4a1a79e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=131044) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 17:19:18.404739 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eeb90e04-5937-4370-9966-a4b0a4a1a79e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "POST /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8/action" status: 202 len: 0 microversion: 2.20 time: 0.733014 Aug 04 17:19:18.420764 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2701/5440] 10.222.0.93 () {62 vars in 1319 bytes} [Thu Aug 4 17:19:17 2022] POST /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8/action => generated 0 bytes in 750 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:19:18.446472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0ded9bd2-ccf6-446d-9f41-6ea9aa8012a3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:18.455751 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0ded9bd2-ccf6-446d-9f41-6ea9aa8012a3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:18.498878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ded9bd2-ccf6-446d-9f41-6ea9aa8012a3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:18.499485 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ded9bd2-ccf6-446d-9f41-6ea9aa8012a3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:18.499949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ded9bd2-ccf6-446d-9f41-6ea9aa8012a3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:18.500708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ded9bd2-ccf6-446d-9f41-6ea9aa8012a3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:18.501176 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ded9bd2-ccf6-446d-9f41-6ea9aa8012a3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:18.501611 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ded9bd2-ccf6-446d-9f41-6ea9aa8012a3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:18.509051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b2cf1c21-8723-47ca-a9e9-66e167ee7f94 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:18.526061 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b2cf1c21-8723-47ca-a9e9-66e167ee7f94 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1689 microversion: 2.1 time: 1.085430 Aug 04 17:19:18.529781 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2740/5441] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:17 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1689 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:18.550085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2d4be536-e22f-43e0-844d-4942038a45ba tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:18.550085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2d4be536-e22f-43e0-844d-4942038a45ba tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:18.579195 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d4be536-e22f-43e0-844d-4942038a45ba tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:18.584725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d4be536-e22f-43e0-844d-4942038a45ba tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:18.588266 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d4be536-e22f-43e0-844d-4942038a45ba tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:18.589871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d4be536-e22f-43e0-844d-4942038a45ba tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:18.600921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d4be536-e22f-43e0-844d-4942038a45ba tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:18.601557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d4be536-e22f-43e0-844d-4942038a45ba tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:19.587359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0ded9bd2-ccf6-446d-9f41-6ea9aa8012a3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:19.602599 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0ded9bd2-ccf6-446d-9f41-6ea9aa8012a3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1528 microversion: 2.1 time: 1.178648 Aug 04 17:19:19.603676 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2702/5442] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:18 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1528 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:19.617823 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-62e029e8-0ace-479e-882a-12bb4346ff94 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:19.621745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-62e029e8-0ace-479e-882a-12bb4346ff94 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:19.646799 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62e029e8-0ace-479e-882a-12bb4346ff94 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:19.652449 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62e029e8-0ace-479e-882a-12bb4346ff94 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:19.653181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62e029e8-0ace-479e-882a-12bb4346ff94 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:19.656875 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62e029e8-0ace-479e-882a-12bb4346ff94 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:19.657683 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62e029e8-0ace-479e-882a-12bb4346ff94 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:19.659726 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62e029e8-0ace-479e-882a-12bb4346ff94 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:19.919656 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2d4be536-e22f-43e0-844d-4942038a45ba tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:19.929433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2d4be536-e22f-43e0-844d-4942038a45ba tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:19.942373 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2d4be536-e22f-43e0-844d-4942038a45ba tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:19.944777 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2d4be536-e22f-43e0-844d-4942038a45ba tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1673 microversion: 2.20 time: 1.413840 Aug 04 17:19:19.951767 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2741/5443] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:19:18 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1673 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:19:19.953789 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-62e029e8-0ace-479e-882a-12bb4346ff94 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:19.970279 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-62e029e8-0ace-479e-882a-12bb4346ff94 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 200 len: 1502 microversion: 2.1 time: 0.363581 Aug 04 17:19:19.976552 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2703/5444] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:19 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 1502 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:20.123555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-15b1fcd0-7e3e-4bd2-88a7-6db680269424 req-3583c1c5-02e6-479e-9ff2-5782f3ab6ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6b1716-bb14-4f97-bc75-38403c1c1af0", "name": "network-vif-deleted", "tag": "1e3189db-ad91-4d9e-bfe5-7b700963e0d9"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:19:20.149738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-15b1fcd0-7e3e-4bd2-88a7-6db680269424 req-3583c1c5-02e6-479e-9ff2-5782f3ab6ac1 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:20.152386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-15b1fcd0-7e3e-4bd2-88a7-6db680269424 req-3583c1c5-02e6-479e-9ff2-5782f3ab6ac1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:20.152858 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-15b1fcd0-7e3e-4bd2-88a7-6db680269424 req-3583c1c5-02e6-479e-9ff2-5782f3ab6ac1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:20.182092 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-15b1fcd0-7e3e-4bd2-88a7-6db680269424 req-3583c1c5-02e6-479e-9ff2-5782f3ab6ac1 service nova] Creating event network-vif-deleted:1e3189db-ad91-4d9e-bfe5-7b700963e0d9 for instance 9c6b1716-bb14-4f97-bc75-38403c1c1af0 on n-h1-851359-3 Aug 04 17:19:20.192500 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-15b1fcd0-7e3e-4bd2-88a7-6db680269424 req-3583c1c5-02e6-479e-9ff2-5782f3ab6ac1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070287 Aug 04 17:19:20.193546 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2742/5445] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:19:20.624112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6e439bb0-ef71-4d57-9c08-fe91d448be4e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:20.624723 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6e439bb0-ef71-4d57-9c08-fe91d448be4e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:20.636310 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e439bb0-ef71-4d57-9c08-fe91d448be4e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:20.636949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e439bb0-ef71-4d57-9c08-fe91d448be4e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:20.637887 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e439bb0-ef71-4d57-9c08-fe91d448be4e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:20.638725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e439bb0-ef71-4d57-9c08-fe91d448be4e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:20.639192 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e439bb0-ef71-4d57-9c08-fe91d448be4e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:20.639683 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e439bb0-ef71-4d57-9c08-fe91d448be4e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:20.980211 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-311e393e-70df-4d32-88db-06adb0d4e747 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:20.980932 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-311e393e-70df-4d32-88db-06adb0d4e747 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:21.029482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-311e393e-70df-4d32-88db-06adb0d4e747 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:21.030023 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-311e393e-70df-4d32-88db-06adb0d4e747 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:21.030500 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-311e393e-70df-4d32-88db-06adb0d4e747 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:21.037009 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-311e393e-70df-4d32-88db-06adb0d4e747 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:21.037666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-311e393e-70df-4d32-88db-06adb0d4e747 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:21.038151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-311e393e-70df-4d32-88db-06adb0d4e747 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:21.838494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6e439bb0-ef71-4d57-9c08-fe91d448be4e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:21.852056 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6e439bb0-ef71-4d57-9c08-fe91d448be4e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1528 microversion: 2.1 time: 1.231844 Aug 04 17:19:21.856509 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2704/5446] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:20 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1528 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:21.871287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-311e393e-70df-4d32-88db-06adb0d4e747 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:21.881378 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-405c6dac-ffa4-4e82-98e0-2ddb911f84aa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:21.885217 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-405c6dac-ffa4-4e82-98e0-2ddb911f84aa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 9c6b1716-bb14-4f97-bc75-38403c1c1af0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:21.894027 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-311e393e-70df-4d32-88db-06adb0d4e747 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:21.905471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-405c6dac-ffa4-4e82-98e0-2ddb911f84aa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:21.914697 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-405c6dac-ffa4-4e82-98e0-2ddb911f84aa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:21.915493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-311e393e-70df-4d32-88db-06adb0d4e747 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:21.918301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-405c6dac-ffa4-4e82-98e0-2ddb911f84aa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:21.919156 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-311e393e-70df-4d32-88db-06adb0d4e747 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1673 microversion: 2.20 time: 0.947432 Aug 04 17:19:21.919821 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-405c6dac-ffa4-4e82-98e0-2ddb911f84aa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:21.923029 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-405c6dac-ffa4-4e82-98e0-2ddb911f84aa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:21.923343 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2743/5447] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:19:20 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1673 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:19:21.929917 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-405c6dac-ffa4-4e82-98e0-2ddb911f84aa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:22.003757 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-405c6dac-ffa4-4e82-98e0-2ddb911f84aa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] HTTP exception thrown: Instance 9c6b1716-bb14-4f97-bc75-38403c1c1af0 could not be found. Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-405c6dac-ffa4-4e82-98e0-2ddb911f84aa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Request method failure captured: Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 HTTP/1.1 Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_63t572KuanVtq4R8MzvDbiJ5v4ZNLlIXNSeyaKZEreu-AZsY7LrigOd4ifgpCoVaTwnv6OlvH-5A4ZEjIVqN__JovdO3v25O3MH0-YQTpeaIifMEkPAJkS3gutHWKyi3cRSKLpwrID6LrAGigELMSbch6EEsMqa6Zl19KmfJ88KcE Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 9c69a3e46122413f928fe20a76b0cf94 Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1197876832 Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9c69a3e46122413f928fe20a76b0cf94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9c69a3e46122413f928fe20a76b0cf94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9c69a3e46122413f928fe20a76b0cf94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9c69a3e46122413f928fe20a76b0cf94"}]}] Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1197876832 Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 9c69a3e46122413f928fe20a76b0cf94 Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1197876832 Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TestNetworkAdvancedServerOps-1197876832-project Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: f27a58cf36934daeabff9e35c05d4c19 Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1197876832-project Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 9c6b1716-bb14-4f97-bc75-38403c1c1af0 could not be found. Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '9c6b1716-bb14-4f97-bc75-38403c1c1af0'} Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c6b1716-bb14-4f97-bc75-38403c1c1af0 could not be found. Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c6b1716-bb14-4f97-bc75-38403c1c1af0 could not be found. Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:19:22.008628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:19:22.013447 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:19:22.013447 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:19:22.013447 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:19:22.013447 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:19:22.013447 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:19:22.013447 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:19:22.013447 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c6b1716-bb14-4f97-bc75-38403c1c1af0 could not be found. Aug 04 17:19:22.013447 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:19:22.026337 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-405c6dac-ffa4-4e82-98e0-2ddb911f84aa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Returning 404 to user: Instance 9c6b1716-bb14-4f97-bc75-38403c1c1af0 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:19:22.035504 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-405c6dac-ffa4-4e82-98e0-2ddb911f84aa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0" status: 404 len: 111 microversion: 2.1 time: 0.169927 Aug 04 17:19:22.043316 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2705/5448] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:21 2022] GET /compute/v2.1/servers/9c6b1716-bb14-4f97-bc75-38403c1c1af0 => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:19:22.879111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-220104ed-a08a-405b-bcfc-ccabe38a46b1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:22.880398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-220104ed-a08a-405b-bcfc-ccabe38a46b1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:22.896734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-220104ed-a08a-405b-bcfc-ccabe38a46b1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:22.901344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-220104ed-a08a-405b-bcfc-ccabe38a46b1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:22.904675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-220104ed-a08a-405b-bcfc-ccabe38a46b1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:22.906680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-220104ed-a08a-405b-bcfc-ccabe38a46b1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:22.910093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-220104ed-a08a-405b-bcfc-ccabe38a46b1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:22.914859 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-220104ed-a08a-405b-bcfc-ccabe38a46b1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:22.952664 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9fca8276-591b-4ab6-bc4b-6b427c3dc130 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:22.953284 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9fca8276-591b-4ab6-bc4b-6b427c3dc130 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:22.969874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fca8276-591b-4ab6-bc4b-6b427c3dc130 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:22.980636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fca8276-591b-4ab6-bc4b-6b427c3dc130 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:22.983975 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fca8276-591b-4ab6-bc4b-6b427c3dc130 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:22.989319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fca8276-591b-4ab6-bc4b-6b427c3dc130 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:22.993311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fca8276-591b-4ab6-bc4b-6b427c3dc130 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:22.998058 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fca8276-591b-4ab6-bc4b-6b427c3dc130 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:23.160258 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:19:23.160876 n-d-851359-3 devstack@n-api.service[131043]: Thu Aug 4 17:19:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 (ip 10.222.0.93) !!! Aug 04 17:19:24.015482 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9fca8276-591b-4ab6-bc4b-6b427c3dc130 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:24.028109 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:19:24.038764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9fca8276-591b-4ab6-bc4b-6b427c3dc130 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:24.040293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9fca8276-591b-4ab6-bc4b-6b427c3dc130 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:24.056697 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9fca8276-591b-4ab6-bc4b-6b427c3dc130 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1731 microversion: 2.20 time: 1.104225 Aug 04 17:19:24.060752 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2706/5449] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:19:22 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1731 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:19:24.291081 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-220104ed-a08a-405b-bcfc-ccabe38a46b1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:24.319801 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-220104ed-a08a-405b-bcfc-ccabe38a46b1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1528 microversion: 2.1 time: 1.444631 Aug 04 17:19:24.320514 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2744/5450] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:22 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1528 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:25.099948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-944f82eb-bc8a-4d4b-83b5-89d07fa839e7 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:25.101438 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-944f82eb-bc8a-4d4b-83b5-89d07fa839e7 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:25.117233 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-944f82eb-bc8a-4d4b-83b5-89d07fa839e7 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:25.118183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-944f82eb-bc8a-4d4b-83b5-89d07fa839e7 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:25.119087 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-944f82eb-bc8a-4d4b-83b5-89d07fa839e7 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:25.123732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-944f82eb-bc8a-4d4b-83b5-89d07fa839e7 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:25.125624 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-944f82eb-bc8a-4d4b-83b5-89d07fa839e7 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:25.126465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-944f82eb-bc8a-4d4b-83b5-89d07fa839e7 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:25.350576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3b7c5b00-dbbe-4e99-afdf-1faccf7f74ad tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:25.352016 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3b7c5b00-dbbe-4e99-afdf-1faccf7f74ad tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:25.362346 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b7c5b00-dbbe-4e99-afdf-1faccf7f74ad tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:25.363397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b7c5b00-dbbe-4e99-afdf-1faccf7f74ad tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:25.364023 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b7c5b00-dbbe-4e99-afdf-1faccf7f74ad tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:25.364963 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b7c5b00-dbbe-4e99-afdf-1faccf7f74ad tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:25.366350 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b7c5b00-dbbe-4e99-afdf-1faccf7f74ad tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:25.366981 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b7c5b00-dbbe-4e99-afdf-1faccf7f74ad tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:26.473258 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-944f82eb-bc8a-4d4b-83b5-89d07fa839e7 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:26.485669 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-944f82eb-bc8a-4d4b-83b5-89d07fa839e7 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:26.495912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3b7c5b00-dbbe-4e99-afdf-1faccf7f74ad tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:26.496761 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-944f82eb-bc8a-4d4b-83b5-89d07fa839e7 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:26.498426 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-944f82eb-bc8a-4d4b-83b5-89d07fa839e7 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1731 microversion: 2.20 time: 1.404037 Aug 04 17:19:26.499189 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2707/5451] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:19:25 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1731 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:19:26.505071 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3b7c5b00-dbbe-4e99-afdf-1faccf7f74ad tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1528 microversion: 2.1 time: 1.164068 Aug 04 17:19:26.520542 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2745/5452] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:25 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1528 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:27.526532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b4731687-4813-4d8f-8115-a735c02a8362 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:27.527134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b4731687-4813-4d8f-8115-a735c02a8362 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:27.530366 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:19:27.533592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4c62a2dc-1222-4dc6-97b6-a27c9a1dfde5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:27.535207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4c62a2dc-1222-4dc6-97b6-a27c9a1dfde5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:27.553126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4731687-4813-4d8f-8115-a735c02a8362 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:27.556031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c62a2dc-1222-4dc6-97b6-a27c9a1dfde5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:27.556588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4731687-4813-4d8f-8115-a735c02a8362 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:27.559463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4731687-4813-4d8f-8115-a735c02a8362 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:27.560334 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c62a2dc-1222-4dc6-97b6-a27c9a1dfde5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:27.560880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c62a2dc-1222-4dc6-97b6-a27c9a1dfde5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:27.562002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c62a2dc-1222-4dc6-97b6-a27c9a1dfde5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:27.562808 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c62a2dc-1222-4dc6-97b6-a27c9a1dfde5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:27.563180 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4731687-4813-4d8f-8115-a735c02a8362 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:27.563678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c62a2dc-1222-4dc6-97b6-a27c9a1dfde5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:27.569249 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4731687-4813-4d8f-8115-a735c02a8362 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:27.570128 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4731687-4813-4d8f-8115-a735c02a8362 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:28.687373 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4c62a2dc-1222-4dc6-97b6-a27c9a1dfde5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:28.712772 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4c62a2dc-1222-4dc6-97b6-a27c9a1dfde5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1528 microversion: 2.1 time: 1.184078 Aug 04 17:19:28.713393 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2746/5453] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:27 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1528 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:28.974373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b4731687-4813-4d8f-8115-a735c02a8362 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:28.989526 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b4731687-4813-4d8f-8115-a735c02a8362 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:28.999418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b4731687-4813-4d8f-8115-a735c02a8362 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:29.010608 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b4731687-4813-4d8f-8115-a735c02a8362 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1731 microversion: 2.20 time: 1.487956 Aug 04 17:19:29.026665 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2708/5454] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:19:27 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1731 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:19:29.744980 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f0c6835a-3019-4af7-81c1-f281ad6d64fc tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:29.745628 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f0c6835a-3019-4af7-81c1-f281ad6d64fc tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:29.767918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f0c6835a-3019-4af7-81c1-f281ad6d64fc tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:29.772840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f0c6835a-3019-4af7-81c1-f281ad6d64fc tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:29.774983 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f0c6835a-3019-4af7-81c1-f281ad6d64fc tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:29.776032 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f0c6835a-3019-4af7-81c1-f281ad6d64fc tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:29.792251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f0c6835a-3019-4af7-81c1-f281ad6d64fc tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:29.792974 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f0c6835a-3019-4af7-81c1-f281ad6d64fc tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:30.038391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3bc4b932-c728-4967-b604-dadad0805e43 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:30.039809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3bc4b932-c728-4967-b604-dadad0805e43 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:30.077806 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bc4b932-c728-4967-b604-dadad0805e43 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:30.082670 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bc4b932-c728-4967-b604-dadad0805e43 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:30.083513 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bc4b932-c728-4967-b604-dadad0805e43 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:30.089052 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bc4b932-c728-4967-b604-dadad0805e43 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:30.093554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bc4b932-c728-4967-b604-dadad0805e43 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:30.097351 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bc4b932-c728-4967-b604-dadad0805e43 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:30.726625 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3bc4b932-c728-4967-b604-dadad0805e43 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:30.747357 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3bc4b932-c728-4967-b604-dadad0805e43 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:30.748920 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3bc4b932-c728-4967-b604-dadad0805e43 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:30.758859 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3bc4b932-c728-4967-b604-dadad0805e43 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1731 microversion: 2.20 time: 0.728667 Aug 04 17:19:30.759802 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2709/5455] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:19:30 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1731 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:19:31.034991 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f0c6835a-3019-4af7-81c1-f281ad6d64fc tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:31.047825 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f0c6835a-3019-4af7-81c1-f281ad6d64fc tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1528 microversion: 2.1 time: 1.311635 Aug 04 17:19:31.075778 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2747/5456] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:29 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1528 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:31.791445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1d7955fb-d063-447a-9a01-6ea0bcb284c5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:31.792913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1d7955fb-d063-447a-9a01-6ea0bcb284c5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:31.813515 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d7955fb-d063-447a-9a01-6ea0bcb284c5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:31.814658 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d7955fb-d063-447a-9a01-6ea0bcb284c5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:31.816382 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d7955fb-d063-447a-9a01-6ea0bcb284c5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:31.818305 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d7955fb-d063-447a-9a01-6ea0bcb284c5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:31.830952 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d7955fb-d063-447a-9a01-6ea0bcb284c5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:31.831636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d7955fb-d063-447a-9a01-6ea0bcb284c5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:31.855483 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-99fa2108-38a7-4dd0-9a2e-74af08db7d31 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:31.856001 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-99fa2108-38a7-4dd0-9a2e-74af08db7d31 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:31.875828 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99fa2108-38a7-4dd0-9a2e-74af08db7d31 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:31.876342 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99fa2108-38a7-4dd0-9a2e-74af08db7d31 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:31.877360 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99fa2108-38a7-4dd0-9a2e-74af08db7d31 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:31.878223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99fa2108-38a7-4dd0-9a2e-74af08db7d31 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:31.878696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99fa2108-38a7-4dd0-9a2e-74af08db7d31 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:31.879157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99fa2108-38a7-4dd0-9a2e-74af08db7d31 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:32.194540 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-99fa2108-38a7-4dd0-9a2e-74af08db7d31 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lazy-loading 'services' on Instance uuid 42ede9b2-fe57-4ea9-99e0-a4617a87425b {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:19:32.381856 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-99fa2108-38a7-4dd0-9a2e-74af08db7d31 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "DELETE /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b/os-volume_attachments/9e173729-c2a9-416d-bfb2-e8b5bbc3548e" status: 202 len: 0 microversion: 2.1 time: 0.530246 Aug 04 17:19:32.382835 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2748/5457] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Aug 4 17:19:31 2022] DELETE /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b/os-volume_attachments/9e173729-c2a9-416d-bfb2-e8b5bbc3548e => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 17:19:32.393448 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ec70a9bb-dab2-4055-b2c4-cb8afd3feb19 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:32.395883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ec70a9bb-dab2-4055-b2c4-cb8afd3feb19 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:32.416731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec70a9bb-dab2-4055-b2c4-cb8afd3feb19 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:32.417494 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec70a9bb-dab2-4055-b2c4-cb8afd3feb19 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:32.422493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec70a9bb-dab2-4055-b2c4-cb8afd3feb19 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:32.424009 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec70a9bb-dab2-4055-b2c4-cb8afd3feb19 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:32.424670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec70a9bb-dab2-4055-b2c4-cb8afd3feb19 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:32.425483 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec70a9bb-dab2-4055-b2c4-cb8afd3feb19 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:33.231890 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1d7955fb-d063-447a-9a01-6ea0bcb284c5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:33.255203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1d7955fb-d063-447a-9a01-6ea0bcb284c5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:33.265357 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1d7955fb-d063-447a-9a01-6ea0bcb284c5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:33.267721 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1d7955fb-d063-447a-9a01-6ea0bcb284c5 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1731 microversion: 2.20 time: 1.480139 Aug 04 17:19:33.273760 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2710/5458] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:19:31 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1731 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:19:33.291490 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-537473dd-9c09-486d-900e-a689d0bda329 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:33.308782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-537473dd-9c09-486d-900e-a689d0bda329 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:33.336053 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-537473dd-9c09-486d-900e-a689d0bda329 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:33.342117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-537473dd-9c09-486d-900e-a689d0bda329 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:33.343611 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-537473dd-9c09-486d-900e-a689d0bda329 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:33.345933 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-537473dd-9c09-486d-900e-a689d0bda329 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:33.348052 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-537473dd-9c09-486d-900e-a689d0bda329 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:33.353753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-537473dd-9c09-486d-900e-a689d0bda329 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:33.434529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ec70a9bb-dab2-4055-b2c4-cb8afd3feb19 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:33.448187 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ec70a9bb-dab2-4055-b2c4-cb8afd3feb19 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1528 microversion: 2.1 time: 1.063756 Aug 04 17:19:33.457711 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2749/5459] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:32 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1528 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:33.520141 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-537473dd-9c09-486d-900e-a689d0bda329 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.235934 Aug 04 17:19:33.522910 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2711/5460] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:19:33 2022] GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b/os-volume_attachments => generated 197 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:19:34.304600 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a4849dd4-37e7-4525-a3c0-46bbf404bcb3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:34.305537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a4849dd4-37e7-4525-a3c0-46bbf404bcb3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:34.318374 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a4849dd4-37e7-4525-a3c0-46bbf404bcb3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:34.322659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a4849dd4-37e7-4525-a3c0-46bbf404bcb3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:34.323323 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a4849dd4-37e7-4525-a3c0-46bbf404bcb3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:34.324521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a4849dd4-37e7-4525-a3c0-46bbf404bcb3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:34.325255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a4849dd4-37e7-4525-a3c0-46bbf404bcb3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:34.326508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a4849dd4-37e7-4525-a3c0-46bbf404bcb3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:34.486658 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1b2ac221-4a42-4f93-b0a3-528c9d76a5d0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:34.488297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1b2ac221-4a42-4f93-b0a3-528c9d76a5d0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:34.504355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b2ac221-4a42-4f93-b0a3-528c9d76a5d0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:34.506427 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b2ac221-4a42-4f93-b0a3-528c9d76a5d0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:34.508857 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b2ac221-4a42-4f93-b0a3-528c9d76a5d0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:34.510944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b2ac221-4a42-4f93-b0a3-528c9d76a5d0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:34.512281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b2ac221-4a42-4f93-b0a3-528c9d76a5d0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:34.514450 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b2ac221-4a42-4f93-b0a3-528c9d76a5d0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:35.382392 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a4849dd4-37e7-4525-a3c0-46bbf404bcb3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:35.391750 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1b2ac221-4a42-4f93-b0a3-528c9d76a5d0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:35.399821 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a4849dd4-37e7-4525-a3c0-46bbf404bcb3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:35.401906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a4849dd4-37e7-4525-a3c0-46bbf404bcb3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:35.403867 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1b2ac221-4a42-4f93-b0a3-528c9d76a5d0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1528 microversion: 2.1 time: 0.923285 Aug 04 17:19:35.404595 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a4849dd4-37e7-4525-a3c0-46bbf404bcb3 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1731 microversion: 2.20 time: 1.103724 Aug 04 17:19:35.406777 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2712/5461] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:34 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1528 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:35.409731 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2750/5462] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:19:34 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1731 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:19:35.418012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ad366f6b-f2a7-4caa-99a0-ba6468738384 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:35.454098 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ad366f6b-f2a7-4caa-99a0-ba6468738384 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:35.487272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad366f6b-f2a7-4caa-99a0-ba6468738384 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:35.490941 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad366f6b-f2a7-4caa-99a0-ba6468738384 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:35.495991 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad366f6b-f2a7-4caa-99a0-ba6468738384 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:35.497029 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad366f6b-f2a7-4caa-99a0-ba6468738384 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:35.498701 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad366f6b-f2a7-4caa-99a0-ba6468738384 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:35.499142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad366f6b-f2a7-4caa-99a0-ba6468738384 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:35.607639 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ad366f6b-f2a7-4caa-99a0-ba6468738384 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.198096 Aug 04 17:19:35.608280 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2713/5463] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:19:35 2022] GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:19:36.426931 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-82ab3bf7-7b9b-419c-aa47-30ca639617fd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:36.427800 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-82ab3bf7-7b9b-419c-aa47-30ca639617fd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:36.447188 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82ab3bf7-7b9b-419c-aa47-30ca639617fd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:36.450103 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bffb3a13-3d2a-45cb-bec4-c63f364c30e1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:36.452064 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bffb3a13-3d2a-45cb-bec4-c63f364c30e1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:36.457723 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82ab3bf7-7b9b-419c-aa47-30ca639617fd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:36.459198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82ab3bf7-7b9b-419c-aa47-30ca639617fd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:36.464501 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82ab3bf7-7b9b-419c-aa47-30ca639617fd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:36.471620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bffb3a13-3d2a-45cb-bec4-c63f364c30e1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:36.472017 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82ab3bf7-7b9b-419c-aa47-30ca639617fd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:36.472801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bffb3a13-3d2a-45cb-bec4-c63f364c30e1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:36.473254 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bffb3a13-3d2a-45cb-bec4-c63f364c30e1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:36.474027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bffb3a13-3d2a-45cb-bec4-c63f364c30e1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:36.475446 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82ab3bf7-7b9b-419c-aa47-30ca639617fd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:36.478276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bffb3a13-3d2a-45cb-bec4-c63f364c30e1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:36.480449 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bffb3a13-3d2a-45cb-bec4-c63f364c30e1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:37.165558 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-82ab3bf7-7b9b-419c-aa47-30ca639617fd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:37.178267 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-82ab3bf7-7b9b-419c-aa47-30ca639617fd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1528 microversion: 2.1 time: 0.755997 Aug 04 17:19:37.178948 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2751/5464] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:36 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1528 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:37.181885 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bffb3a13-3d2a-45cb-bec4-c63f364c30e1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:37.200853 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bffb3a13-3d2a-45cb-bec4-c63f364c30e1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:37.204327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bffb3a13-3d2a-45cb-bec4-c63f364c30e1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:37.205261 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1d414272-bd2d-4e7d-aa11-1a6faad77da7 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:37.214729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1d414272-bd2d-4e7d-aa11-1a6faad77da7 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:37.217790 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bffb3a13-3d2a-45cb-bec4-c63f364c30e1 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1731 microversion: 2.20 time: 0.775175 Aug 04 17:19:37.219547 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2714/5465] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:19:36 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1731 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:19:37.228231 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=38 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:19:37.245177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d414272-bd2d-4e7d-aa11-1a6faad77da7 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:37.246459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d414272-bd2d-4e7d-aa11-1a6faad77da7 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:37.247099 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d414272-bd2d-4e7d-aa11-1a6faad77da7 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:37.248609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d414272-bd2d-4e7d-aa11-1a6faad77da7 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:37.252683 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d414272-bd2d-4e7d-aa11-1a6faad77da7 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:37.257065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d414272-bd2d-4e7d-aa11-1a6faad77da7 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:37.353075 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1d414272-bd2d-4e7d-aa11-1a6faad77da7 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155075 Aug 04 17:19:37.360233 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2752/5466] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:19:37 2022] GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:19:38.217605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-658fe40b-79b6-4278-a192-dc64f53a3b42 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:38.219524 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-658fe40b-79b6-4278-a192-dc64f53a3b42 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:38.249613 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-658fe40b-79b6-4278-a192-dc64f53a3b42 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:38.251671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-658fe40b-79b6-4278-a192-dc64f53a3b42 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:38.252716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-658fe40b-79b6-4278-a192-dc64f53a3b42 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:38.253681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-658fe40b-79b6-4278-a192-dc64f53a3b42 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:38.254408 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-658fe40b-79b6-4278-a192-dc64f53a3b42 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:38.255105 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-658fe40b-79b6-4278-a192-dc64f53a3b42 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:38.262573 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-177aedc3-0100-4480-a1a1-f495e40ed292 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:38.263912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-177aedc3-0100-4480-a1a1-f495e40ed292 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:38.285393 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-177aedc3-0100-4480-a1a1-f495e40ed292 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:38.286168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-177aedc3-0100-4480-a1a1-f495e40ed292 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:38.298814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-177aedc3-0100-4480-a1a1-f495e40ed292 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:38.299934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-177aedc3-0100-4480-a1a1-f495e40ed292 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:38.300606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-177aedc3-0100-4480-a1a1-f495e40ed292 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:38.304109 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-177aedc3-0100-4480-a1a1-f495e40ed292 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:39.582504 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-658fe40b-79b6-4278-a192-dc64f53a3b42 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:39.593568 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-658fe40b-79b6-4278-a192-dc64f53a3b42 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1510 microversion: 2.1 time: 1.394251 Aug 04 17:19:39.598802 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2715/5467] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:38 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1510 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:39.618202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c0707e56-7258-40db-b321-bef3aa6a2917 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:39.622054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c0707e56-7258-40db-b321-bef3aa6a2917 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:39.634638 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0707e56-7258-40db-b321-bef3aa6a2917 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:39.635544 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0707e56-7258-40db-b321-bef3aa6a2917 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:39.636418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0707e56-7258-40db-b321-bef3aa6a2917 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:39.637465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0707e56-7258-40db-b321-bef3aa6a2917 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:39.638242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0707e56-7258-40db-b321-bef3aa6a2917 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:39.638941 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0707e56-7258-40db-b321-bef3aa6a2917 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:39.670407 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-177aedc3-0100-4480-a1a1-f495e40ed292 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:39.679836 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c0707e56-7258-40db-b321-bef3aa6a2917 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079300 Aug 04 17:19:39.682842 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2716/5468] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:19:39 2022] GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:19:39.684557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-177aedc3-0100-4480-a1a1-f495e40ed292 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:39.686171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-177aedc3-0100-4480-a1a1-f495e40ed292 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:39.687420 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-177aedc3-0100-4480-a1a1-f495e40ed292 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1731 microversion: 2.20 time: 1.438504 Aug 04 17:19:39.693436 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dccd7b47-58a2-49cf-bd11-fd2fa3299c3e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '.version_select at 0x7f1e5a4e2790>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:39.695324 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2753/5469] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:19:38 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1731 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:19:39.781284 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dccd7b47-58a2-49cf-bd11-fd2fa3299c3e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1881716587" status: 202 len: 0 microversion: 2.1 time: 0.098751 Aug 04 17:19:39.782305 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2717/5470] 10.222.0.93 () {58 vars in 1284 bytes} [Thu Aug 4 17:19:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1881716587 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:19:39.851943 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b54c013d-c656-43f8-899f-c44d86c324d8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Action: 'create', calling method: .version_select at 0x7f1e5a816ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-79789233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmRl4T7VWyTzTWuFLttXxIugvTrJnQjDcidRo9iZceHk2DMii3OVAsZYNk5nlUbmlRaxpFIGPiEpJbK5J7tH+AaF9JOuZkJ0LBYWVsrEkO91cbmNN2VMlattyS62Bs3ag=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:19:39.899961 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-b54c013d-c656-43f8-899f-c44d86c324d8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Getting quotas for project 9c69a3e46122413f928fe20a76b0cf94. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:19:39.906610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-b54c013d-c656-43f8-899f-c44d86c324d8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Getting quotas for user f27a58cf36934daeabff9e35c05d4c19 and project 9c69a3e46122413f928fe20a76b0cf94. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:19:39.989676 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b54c013d-c656-43f8-899f-c44d86c324d8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.141283 Aug 04 17:19:39.990800 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2754/5471] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:19:39 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:19:40.618744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-40850c1b-b7d8-42bb-9e7a-1cec96129675 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:40.619743 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-40850c1b-b7d8-42bb-9e7a-1cec96129675 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:40.642428 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40850c1b-b7d8-42bb-9e7a-1cec96129675 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:40.643767 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40850c1b-b7d8-42bb-9e7a-1cec96129675 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:40.644303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40850c1b-b7d8-42bb-9e7a-1cec96129675 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:40.645056 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40850c1b-b7d8-42bb-9e7a-1cec96129675 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:40.645511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40850c1b-b7d8-42bb-9e7a-1cec96129675 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:40.646001 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40850c1b-b7d8-42bb-9e7a-1cec96129675 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:40.702092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-32713617-c32a-4ea0-b40f-fdcb1534d3ff tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:40.714530 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-32713617-c32a-4ea0-b40f-fdcb1534d3ff tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:40.762773 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32713617-c32a-4ea0-b40f-fdcb1534d3ff tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:40.769774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32713617-c32a-4ea0-b40f-fdcb1534d3ff tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:40.772017 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32713617-c32a-4ea0-b40f-fdcb1534d3ff tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:40.772876 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32713617-c32a-4ea0-b40f-fdcb1534d3ff tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:40.773332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32713617-c32a-4ea0-b40f-fdcb1534d3ff tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:40.773770 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32713617-c32a-4ea0-b40f-fdcb1534d3ff tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:40.904979 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-32713617-c32a-4ea0-b40f-fdcb1534d3ff tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.211288 Aug 04 17:19:40.918179 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2755/5472] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:19:40 2022] GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b/os-volume_attachments => generated 197 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:19:40.924819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3694c48c-f5d9-4598-a6e7-13d9743f9470 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:40.925455 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3694c48c-f5d9-4598-a6e7-13d9743f9470 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:40.939147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3694c48c-f5d9-4598-a6e7-13d9743f9470 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:40.939677 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3694c48c-f5d9-4598-a6e7-13d9743f9470 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:40.940105 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3694c48c-f5d9-4598-a6e7-13d9743f9470 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:40.940861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3694c48c-f5d9-4598-a6e7-13d9743f9470 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:40.941610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3694c48c-f5d9-4598-a6e7-13d9743f9470 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:40.942100 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3694c48c-f5d9-4598-a6e7-13d9743f9470 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:41.023254 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:19:41.137104 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-40850c1b-b7d8-42bb-9e7a-1cec96129675 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:41.158828 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-40850c1b-b7d8-42bb-9e7a-1cec96129675 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1510 microversion: 2.1 time: 0.544815 Aug 04 17:19:41.160221 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2718/5473] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:40 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1510 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:19:41.617225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3694c48c-f5d9-4598-a6e7-13d9743f9470 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:41.629576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3694c48c-f5d9-4598-a6e7-13d9743f9470 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:41.635971 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3694c48c-f5d9-4598-a6e7-13d9743f9470 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:41.644624 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3694c48c-f5d9-4598-a6e7-13d9743f9470 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1731 microversion: 2.20 time: 0.724490 Aug 04 17:19:41.662388 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2756/5474] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:19:40 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1731 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:19:41.923840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7dfd3205-8757-49dd-b1d1-855d0a199a6f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:41.928251 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7dfd3205-8757-49dd-b1d1-855d0a199a6f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:41.974484 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7dfd3205-8757-49dd-b1d1-855d0a199a6f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:41.975601 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7dfd3205-8757-49dd-b1d1-855d0a199a6f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:41.977279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7dfd3205-8757-49dd-b1d1-855d0a199a6f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:41.987716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7dfd3205-8757-49dd-b1d1-855d0a199a6f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:41.988927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7dfd3205-8757-49dd-b1d1-855d0a199a6f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:41.996087 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7dfd3205-8757-49dd-b1d1-855d0a199a6f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:42.110750 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7dfd3205-8757-49dd-b1d1-855d0a199a6f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.181307 Aug 04 17:19:42.111405 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2719/5475] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:19:41 2022] GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:19:42.180899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dfd7c4a4-dc4f-48f7-ae1d-1d52c79e0908 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:42.181751 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dfd7c4a4-dc4f-48f7-ae1d-1d52c79e0908 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:42.196791 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfd7c4a4-dc4f-48f7-ae1d-1d52c79e0908 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:42.204893 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfd7c4a4-dc4f-48f7-ae1d-1d52c79e0908 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:42.205840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfd7c4a4-dc4f-48f7-ae1d-1d52c79e0908 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:42.207155 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfd7c4a4-dc4f-48f7-ae1d-1d52c79e0908 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:42.208051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfd7c4a4-dc4f-48f7-ae1d-1d52c79e0908 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:42.208883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfd7c4a4-dc4f-48f7-ae1d-1d52c79e0908 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:42.552345 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b9b16865-cc22-40d2-873e-2675cc38d79a req-91e780a6-4f96-486b-9aae-05305241831d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5248dcdc-5a16-4036-9537-eb84f73dc372", "name": "network-vif-unplugged", "status": "completed", "tag": "620457fa-43b8-4d5c-9ed1-44c49f63239c"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:19:42.582873 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b9b16865-cc22-40d2-873e-2675cc38d79a req-91e780a6-4f96-486b-9aae-05305241831d service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:42.584034 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b9b16865-cc22-40d2-873e-2675cc38d79a req-91e780a6-4f96-486b-9aae-05305241831d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:42.590308 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b9b16865-cc22-40d2-873e-2675cc38d79a req-91e780a6-4f96-486b-9aae-05305241831d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:42.633450 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b9b16865-cc22-40d2-873e-2675cc38d79a req-91e780a6-4f96-486b-9aae-05305241831d service nova] Creating event network-vif-unplugged:620457fa-43b8-4d5c-9ed1-44c49f63239c for instance 5248dcdc-5a16-4036-9537-eb84f73dc372 on n-h1-851359-3 Aug 04 17:19:42.641030 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b9b16865-cc22-40d2-873e-2675cc38d79a req-91e780a6-4f96-486b-9aae-05305241831d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095199 Aug 04 17:19:42.643181 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2720/5476] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:19:42.696945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ff043f45-5948-4adc-a471-e11bd564a72d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:42.700367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ff043f45-5948-4adc-a471-e11bd564a72d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:42.740767 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff043f45-5948-4adc-a471-e11bd564a72d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:42.742408 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff043f45-5948-4adc-a471-e11bd564a72d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:42.743657 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff043f45-5948-4adc-a471-e11bd564a72d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:42.756716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff043f45-5948-4adc-a471-e11bd564a72d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:42.766104 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff043f45-5948-4adc-a471-e11bd564a72d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:42.767562 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff043f45-5948-4adc-a471-e11bd564a72d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:43.876197 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dfd7c4a4-dc4f-48f7-ae1d-1d52c79e0908 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:43.884284 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dfd7c4a4-dc4f-48f7-ae1d-1d52c79e0908 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1510 microversion: 2.1 time: 1.707133 Aug 04 17:19:43.898409 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2757/5477] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:42 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1510 bytes in 1722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:43.904994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-360871fc-3f2f-4e4a-a25a-cfcfe7217c74 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:43.907894 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-360871fc-3f2f-4e4a-a25a-cfcfe7217c74 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:43.938196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-360871fc-3f2f-4e4a-a25a-cfcfe7217c74 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:43.939430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-360871fc-3f2f-4e4a-a25a-cfcfe7217c74 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:43.940073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-360871fc-3f2f-4e4a-a25a-cfcfe7217c74 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:43.941003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-360871fc-3f2f-4e4a-a25a-cfcfe7217c74 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:43.941657 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-360871fc-3f2f-4e4a-a25a-cfcfe7217c74 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:43.943816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-360871fc-3f2f-4e4a-a25a-cfcfe7217c74 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:44.002939 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-360871fc-3f2f-4e4a-a25a-cfcfe7217c74 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103146 Aug 04 17:19:44.003613 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2758/5478] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:19:43 2022] GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:19:44.750203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ff043f45-5948-4adc-a471-e11bd564a72d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:44.800678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ff043f45-5948-4adc-a471-e11bd564a72d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:44.804135 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ff043f45-5948-4adc-a471-e11bd564a72d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:44.818087 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ff043f45-5948-4adc-a471-e11bd564a72d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1731 microversion: 2.20 time: 2.144264 Aug 04 17:19:44.822643 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2721/5479] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:19:42 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1731 bytes in 2152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:19:44.916062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3481fe40-3b6c-4c07-9136-ceaf64c6901c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:44.930444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3481fe40-3b6c-4c07-9136-ceaf64c6901c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:44.965339 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3481fe40-3b6c-4c07-9136-ceaf64c6901c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:44.974459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3481fe40-3b6c-4c07-9136-ceaf64c6901c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:44.992495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3481fe40-3b6c-4c07-9136-ceaf64c6901c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:44.997530 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3481fe40-3b6c-4c07-9136-ceaf64c6901c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:44.998675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3481fe40-3b6c-4c07-9136-ceaf64c6901c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:45.006061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3481fe40-3b6c-4c07-9136-ceaf64c6901c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:45.026314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fa52f7b8-8a9f-4d34-b60e-5681632e0793 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:45.058846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fa52f7b8-8a9f-4d34-b60e-5681632e0793 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:45.083261 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa52f7b8-8a9f-4d34-b60e-5681632e0793 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:45.100882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa52f7b8-8a9f-4d34-b60e-5681632e0793 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:45.106290 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa52f7b8-8a9f-4d34-b60e-5681632e0793 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:45.111006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa52f7b8-8a9f-4d34-b60e-5681632e0793 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:45.123220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa52f7b8-8a9f-4d34-b60e-5681632e0793 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:45.126263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa52f7b8-8a9f-4d34-b60e-5681632e0793 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:45.256075 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fa52f7b8-8a9f-4d34-b60e-5681632e0793 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.243055 Aug 04 17:19:45.257180 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2722/5480] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:19:45 2022] GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b/os-volume_attachments => generated 197 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:19:45.561731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3481fe40-3b6c-4c07-9136-ceaf64c6901c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:45.602259 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3481fe40-3b6c-4c07-9136-ceaf64c6901c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1510 microversion: 2.1 time: 0.695637 Aug 04 17:19:45.638077 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2759/5481] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:44 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1510 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:45.858112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8ca8e939-127c-40d9-a654-1e9276368cd4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:45.858752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8ca8e939-127c-40d9-a654-1e9276368cd4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:45.875183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ca8e939-127c-40d9-a654-1e9276368cd4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:45.877926 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ca8e939-127c-40d9-a654-1e9276368cd4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:45.879944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ca8e939-127c-40d9-a654-1e9276368cd4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:45.881013 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ca8e939-127c-40d9-a654-1e9276368cd4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:45.881667 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ca8e939-127c-40d9-a654-1e9276368cd4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:45.884643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ca8e939-127c-40d9-a654-1e9276368cd4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:46.281743 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-275f779a-1b07-451b-b98b-d32f42ee0fa9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:46.310458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-275f779a-1b07-451b-b98b-d32f42ee0fa9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:46.341295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-275f779a-1b07-451b-b98b-d32f42ee0fa9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:46.346385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-275f779a-1b07-451b-b98b-d32f42ee0fa9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:46.347639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-275f779a-1b07-451b-b98b-d32f42ee0fa9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:46.349224 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-275f779a-1b07-451b-b98b-d32f42ee0fa9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:46.350849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-275f779a-1b07-451b-b98b-d32f42ee0fa9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:46.351865 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-275f779a-1b07-451b-b98b-d32f42ee0fa9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:46.439150 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-275f779a-1b07-451b-b98b-d32f42ee0fa9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.170236 Aug 04 17:19:46.442598 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2760/5482] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 17:19:46 2022] GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b/os-volume_attachments => generated 25 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 17:19:46.565419 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b8c25843-980f-41c2-add4-d7298b7749a8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:46.566974 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b8c25843-980f-41c2-add4-d7298b7749a8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:46.607545 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b8c25843-980f-41c2-add4-d7298b7749a8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:46.608126 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b8c25843-980f-41c2-add4-d7298b7749a8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:46.611648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b8c25843-980f-41c2-add4-d7298b7749a8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:46.612650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b8c25843-980f-41c2-add4-d7298b7749a8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:46.617251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b8c25843-980f-41c2-add4-d7298b7749a8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:46.617962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b8c25843-980f-41c2-add4-d7298b7749a8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:46.745318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b8c25843-980f-41c2-add4-d7298b7749a8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:19:46.882301 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b8c25843-980f-41c2-add4-d7298b7749a8 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "DELETE /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b" status: 204 len: 0 microversion: 2.1 time: 0.323498 Aug 04 17:19:46.883403 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2761/5483] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:19:46 2022] DELETE /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 17:19:46.890355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-852e132d-06fd-44a0-80f6-d9f2ee8082ae tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:46.891058 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-852e132d-06fd-44a0-80f6-d9f2ee8082ae tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:46.906254 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-852e132d-06fd-44a0-80f6-d9f2ee8082ae tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:46.907062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-852e132d-06fd-44a0-80f6-d9f2ee8082ae tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:46.908956 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-852e132d-06fd-44a0-80f6-d9f2ee8082ae tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:46.909489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8ca8e939-127c-40d9-a654-1e9276368cd4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:46.910646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-852e132d-06fd-44a0-80f6-d9f2ee8082ae tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:46.911314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-852e132d-06fd-44a0-80f6-d9f2ee8082ae tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:46.911915 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-852e132d-06fd-44a0-80f6-d9f2ee8082ae tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:46.923480 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8ca8e939-127c-40d9-a654-1e9276368cd4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:46.927959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8ca8e939-127c-40d9-a654-1e9276368cd4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:46.932856 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8ca8e939-127c-40d9-a654-1e9276368cd4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1731 microversion: 2.20 time: 1.077610 Aug 04 17:19:46.947480 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2723/5484] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:19:45 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1731 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:19:46.954837 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-be82473c-cd00-49fe-a2d9-42b138b9d63a tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:46.954837 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-be82473c-cd00-49fe-a2d9-42b138b9d63a tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:46.963854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be82473c-cd00-49fe-a2d9-42b138b9d63a tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:46.964866 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be82473c-cd00-49fe-a2d9-42b138b9d63a tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:46.965737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be82473c-cd00-49fe-a2d9-42b138b9d63a tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:46.966817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be82473c-cd00-49fe-a2d9-42b138b9d63a tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:46.967573 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be82473c-cd00-49fe-a2d9-42b138b9d63a tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:46.968127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be82473c-cd00-49fe-a2d9-42b138b9d63a tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:47.339877 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-852e132d-06fd-44a0-80f6-d9f2ee8082ae tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:47.357717 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-852e132d-06fd-44a0-80f6-d9f2ee8082ae tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1453 microversion: 2.1 time: 0.472744 Aug 04 17:19:47.360895 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2762/5485] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:46 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1453 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:47.384290 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-be82473c-cd00-49fe-a2d9-42b138b9d63a tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:47.392322 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-33e97b67-0d23-4316-823d-e9b00065a3e9 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:47.394703 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-be82473c-cd00-49fe-a2d9-42b138b9d63a tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b" status: 200 len: 1679 microversion: 2.1 time: 0.458013 Aug 04 17:19:47.396273 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2724/5486] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:46 2022] GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b => generated 1679 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:47.397011 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-33e97b67-0d23-4316-823d-e9b00065a3e9 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:47.404831 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33e97b67-0d23-4316-823d-e9b00065a3e9 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:47.405637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33e97b67-0d23-4316-823d-e9b00065a3e9 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:47.406359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33e97b67-0d23-4316-823d-e9b00065a3e9 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:47.407932 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33e97b67-0d23-4316-823d-e9b00065a3e9 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:47.409766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33e97b67-0d23-4316-823d-e9b00065a3e9 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:47.410530 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33e97b67-0d23-4316-823d-e9b00065a3e9 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:47.962670 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-05334ed8-1290-4aa6-aba3-d08be327307e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:47.964170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-05334ed8-1290-4aa6-aba3-d08be327307e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:47.978503 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05334ed8-1290-4aa6-aba3-d08be327307e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:47.979627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05334ed8-1290-4aa6-aba3-d08be327307e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:47.981230 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05334ed8-1290-4aa6-aba3-d08be327307e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:47.982331 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05334ed8-1290-4aa6-aba3-d08be327307e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:47.989024 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05334ed8-1290-4aa6-aba3-d08be327307e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:47.992005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05334ed8-1290-4aa6-aba3-d08be327307e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:48.000153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:19:48.364934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-33e97b67-0d23-4316-823d-e9b00065a3e9 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:48.390446 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-33e97b67-0d23-4316-823d-e9b00065a3e9 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1453 microversion: 2.1 time: 1.010541 Aug 04 17:19:48.393148 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2763/5487] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:47 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1453 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:48.431196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-388aded7-f93f-4470-8cee-8e6d12578cac tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:48.432256 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-388aded7-f93f-4470-8cee-8e6d12578cac tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:48.462737 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-388aded7-f93f-4470-8cee-8e6d12578cac tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:48.463682 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-388aded7-f93f-4470-8cee-8e6d12578cac tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:48.464400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-388aded7-f93f-4470-8cee-8e6d12578cac tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:48.466607 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-388aded7-f93f-4470-8cee-8e6d12578cac tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:48.470564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-388aded7-f93f-4470-8cee-8e6d12578cac tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:48.481756 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-388aded7-f93f-4470-8cee-8e6d12578cac tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:48.548649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-05334ed8-1290-4aa6-aba3-d08be327307e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:48.564071 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-05334ed8-1290-4aa6-aba3-d08be327307e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:48.571058 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-05334ed8-1290-4aa6-aba3-d08be327307e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:48.572665 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-05334ed8-1290-4aa6-aba3-d08be327307e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1731 microversion: 2.20 time: 0.613981 Aug 04 17:19:48.587078 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2725/5488] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:19:47 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1731 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:19:48.610705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-66a85593-acb0-42a2-a11a-9455e3dfa853 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:19:48.612948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-66a85593-acb0-42a2-a11a-9455e3dfa853 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:48.624952 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66a85593-acb0-42a2-a11a-9455e3dfa853 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:48.626183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66a85593-acb0-42a2-a11a-9455e3dfa853 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:48.627581 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66a85593-acb0-42a2-a11a-9455e3dfa853 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:48.629515 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66a85593-acb0-42a2-a11a-9455e3dfa853 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:48.631347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66a85593-acb0-42a2-a11a-9455e3dfa853 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:48.633879 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66a85593-acb0-42a2-a11a-9455e3dfa853 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:48.681756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-66a85593-acb0-42a2-a11a-9455e3dfa853 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lazy-loading 'flavor' on Instance uuid 5248dcdc-5a16-4036-9537-eb84f73dc372 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:19:48.733143 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-66a85593-acb0-42a2-a11a-9455e3dfa853 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Cannot 'shelve' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state shelved_offloaded Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-66a85593-acb0-42a2-a11a-9455e3dfa853 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372/action HTTP/1.1 Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 14 Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: {"shelve": {}} Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: exception: Cannot 'shelve' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state shelved_offloaded Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '5248dcdc-5a16-4036-9537-eb84f73dc372', 'body': {'shelve': {}}} Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5248dcdc-5a16-4036-9537-eb84f73dc372 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 04 17:19:48.735453 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 17:19:48.744299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 17:19:48.744299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 17:19:48.744299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state shelved_offloaded Aug 04 17:19:48.744299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:19:48.744299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:19:48.744299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:19:48.744299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:19:48.744299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:19:48.744299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:19:48.744299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:19:48.744299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:19:48.744299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state shelved_offloaded Aug 04 17:19:48.744299 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:19:48.744299 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-66a85593-acb0-42a2-a11a-9455e3dfa853 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 409 to user: Cannot 'shelve' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state shelved_offloaded {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:19:48.744299 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-66a85593-acb0-42a2-a11a-9455e3dfa853 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372/action" status: 409 len: 155 microversion: 2.1 time: 0.148737 Aug 04 17:19:48.744299 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2726/5489] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:19:48 2022] POST /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372/action => generated 155 bytes in 150 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:19:48.747623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-07493836-379c-4fa0-bd11-5bf284d07c93 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:19:48.748238 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-07493836-379c-4fa0-bd11-5bf284d07c93 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:48.761647 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07493836-379c-4fa0-bd11-5bf284d07c93 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:48.762410 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07493836-379c-4fa0-bd11-5bf284d07c93 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:48.763034 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07493836-379c-4fa0-bd11-5bf284d07c93 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:48.763777 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07493836-379c-4fa0-bd11-5bf284d07c93 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:48.764710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07493836-379c-4fa0-bd11-5bf284d07c93 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:48.765563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07493836-379c-4fa0-bd11-5bf284d07c93 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:48.840802 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-07493836-379c-4fa0-bd11-5bf284d07c93 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=131044) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 17:19:48.974079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-388aded7-f93f-4470-8cee-8e6d12578cac tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:48.978851 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-07493836-379c-4fa0-bd11-5bf284d07c93 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372/action" status: 202 len: 0 microversion: 2.1 time: 0.236022 Aug 04 17:19:48.981026 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2727/5490] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:19:48 2022] POST /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 17:19:48.990570 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f20da62a-9e8f-40cc-904a-e7407606b43c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:48.991244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f20da62a-9e8f-40cc-904a-e7407606b43c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:48.997338 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-388aded7-f93f-4470-8cee-8e6d12578cac tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b" status: 200 len: 1679 microversion: 2.1 time: 0.572517 Aug 04 17:19:48.998768 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2764/5491] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:48 2022] GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b => generated 1679 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:49.004937 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f20da62a-9e8f-40cc-904a-e7407606b43c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:49.005761 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f20da62a-9e8f-40cc-904a-e7407606b43c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:49.006423 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f20da62a-9e8f-40cc-904a-e7407606b43c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:49.008049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f20da62a-9e8f-40cc-904a-e7407606b43c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:49.009301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f20da62a-9e8f-40cc-904a-e7407606b43c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:49.010266 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f20da62a-9e8f-40cc-904a-e7407606b43c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:49.533758 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f20da62a-9e8f-40cc-904a-e7407606b43c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:49.560238 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f20da62a-9e8f-40cc-904a-e7407606b43c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1461 microversion: 2.1 time: 0.574262 Aug 04 17:19:49.565359 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2728/5492] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:48 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1461 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:49.602340 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-13293980-48fc-413f-a983-44592571421b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:49.603284 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-13293980-48fc-413f-a983-44592571421b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:49.628052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13293980-48fc-413f-a983-44592571421b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:49.628762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13293980-48fc-413f-a983-44592571421b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:49.629239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13293980-48fc-413f-a983-44592571421b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:49.631160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13293980-48fc-413f-a983-44592571421b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:49.633366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13293980-48fc-413f-a983-44592571421b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:49.640801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13293980-48fc-413f-a983-44592571421b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:49.938658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=4 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:19:50.025513 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fbb2d5d4-9d0f-42f7-87e2-e47ff06dd0c4 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:50.027614 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fbb2d5d4-9d0f-42f7-87e2-e47ff06dd0c4 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:50.058976 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbb2d5d4-9d0f-42f7-87e2-e47ff06dd0c4 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:50.060510 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbb2d5d4-9d0f-42f7-87e2-e47ff06dd0c4 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:50.062142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbb2d5d4-9d0f-42f7-87e2-e47ff06dd0c4 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:50.066066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbb2d5d4-9d0f-42f7-87e2-e47ff06dd0c4 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:50.066771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbb2d5d4-9d0f-42f7-87e2-e47ff06dd0c4 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:50.068034 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbb2d5d4-9d0f-42f7-87e2-e47ff06dd0c4 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:50.104555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-13293980-48fc-413f-a983-44592571421b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:50.133196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-13293980-48fc-413f-a983-44592571421b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:50.134763 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-13293980-48fc-413f-a983-44592571421b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:50.136238 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-13293980-48fc-413f-a983-44592571421b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1731 microversion: 2.20 time: 0.538123 Aug 04 17:19:50.150453 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2765/5493] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:19:49 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1731 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:19:50.584845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-788451ff-d6d3-4f2b-b910-366371a928e4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:50.585570 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-788451ff-d6d3-4f2b-b910-366371a928e4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:50.596137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-788451ff-d6d3-4f2b-b910-366371a928e4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:50.602128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-788451ff-d6d3-4f2b-b910-366371a928e4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:50.603208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-788451ff-d6d3-4f2b-b910-366371a928e4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:50.605151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-788451ff-d6d3-4f2b-b910-366371a928e4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:50.607495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-788451ff-d6d3-4f2b-b910-366371a928e4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:50.609934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-788451ff-d6d3-4f2b-b910-366371a928e4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:50.661759 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fbb2d5d4-9d0f-42f7-87e2-e47ff06dd0c4 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:50.669573 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fbb2d5d4-9d0f-42f7-87e2-e47ff06dd0c4 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b" status: 200 len: 1679 microversion: 2.1 time: 0.651757 Aug 04 17:19:50.674384 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2729/5494] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:50 2022] GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b => generated 1679 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:19:51.077930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-788451ff-d6d3-4f2b-b910-366371a928e4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:51.091823 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-788451ff-d6d3-4f2b-b910-366371a928e4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1461 microversion: 2.1 time: 0.510815 Aug 04 17:19:51.092429 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2766/5495] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:50 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1461 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:19:51.164940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a23ce972-3743-4139-b0d3-9159b2f1c3d0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:51.166890 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a23ce972-3743-4139-b0d3-9159b2f1c3d0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:51.179364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a23ce972-3743-4139-b0d3-9159b2f1c3d0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:51.180621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a23ce972-3743-4139-b0d3-9159b2f1c3d0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:51.181618 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a23ce972-3743-4139-b0d3-9159b2f1c3d0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:51.182869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a23ce972-3743-4139-b0d3-9159b2f1c3d0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:51.184151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a23ce972-3743-4139-b0d3-9159b2f1c3d0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:51.184899 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a23ce972-3743-4139-b0d3-9159b2f1c3d0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:51.692923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1b9261a4-c86f-446d-a2b0-66b99aaa2b34 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:51.693569 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1b9261a4-c86f-446d-a2b0-66b99aaa2b34 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:51.701465 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1b9261a4-c86f-446d-a2b0-66b99aaa2b34 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:51.702002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1b9261a4-c86f-446d-a2b0-66b99aaa2b34 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:51.705550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1b9261a4-c86f-446d-a2b0-66b99aaa2b34 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:51.708147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1b9261a4-c86f-446d-a2b0-66b99aaa2b34 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:51.709083 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1b9261a4-c86f-446d-a2b0-66b99aaa2b34 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:51.711689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1b9261a4-c86f-446d-a2b0-66b99aaa2b34 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:51.786629 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a23ce972-3743-4139-b0d3-9159b2f1c3d0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:51.816715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a23ce972-3743-4139-b0d3-9159b2f1c3d0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:51.827161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a23ce972-3743-4139-b0d3-9159b2f1c3d0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:51.831361 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a23ce972-3743-4139-b0d3-9159b2f1c3d0 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1731 microversion: 2.20 time: 0.673595 Aug 04 17:19:51.832080 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2730/5496] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:19:51 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1731 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:19:51.925638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1b9261a4-c86f-446d-a2b0-66b99aaa2b34 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:51.934262 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1b9261a4-c86f-446d-a2b0-66b99aaa2b34 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b" status: 200 len: 1613 microversion: 2.1 time: 0.245701 Aug 04 17:19:51.946892 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2767/5497] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:51 2022] GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b => generated 1613 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:19:52.115252 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5ff28260-1a50-4a98-9266-7ac8d42805af tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:52.116071 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5ff28260-1a50-4a98-9266-7ac8d42805af tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:52.157640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ff28260-1a50-4a98-9266-7ac8d42805af tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:52.158589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ff28260-1a50-4a98-9266-7ac8d42805af tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:52.159395 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ff28260-1a50-4a98-9266-7ac8d42805af tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:52.160686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ff28260-1a50-4a98-9266-7ac8d42805af tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:52.161535 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ff28260-1a50-4a98-9266-7ac8d42805af tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:52.173311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ff28260-1a50-4a98-9266-7ac8d42805af tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:52.745333 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5ff28260-1a50-4a98-9266-7ac8d42805af tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:52.766040 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5ff28260-1a50-4a98-9266-7ac8d42805af tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1519 microversion: 2.1 time: 0.656064 Aug 04 17:19:52.768739 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2731/5498] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:52 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1519 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:52.861049 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-af335c3e-d949-4839-83b4-afd212362a26 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:52.861847 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-af335c3e-d949-4839-83b4-afd212362a26 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:52.881765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af335c3e-d949-4839-83b4-afd212362a26 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:52.882571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af335c3e-d949-4839-83b4-afd212362a26 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:52.883118 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af335c3e-d949-4839-83b4-afd212362a26 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:52.884230 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af335c3e-d949-4839-83b4-afd212362a26 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:52.884838 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af335c3e-d949-4839-83b4-afd212362a26 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:52.885507 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af335c3e-d949-4839-83b4-afd212362a26 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:52.980310 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3c6bf573-f610-4581-89ed-a5e668a28922 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:52.984219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3c6bf573-f610-4581-89ed-a5e668a28922 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:52.997248 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c6bf573-f610-4581-89ed-a5e668a28922 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:52.998067 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c6bf573-f610-4581-89ed-a5e668a28922 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:52.998716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c6bf573-f610-4581-89ed-a5e668a28922 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:52.999666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c6bf573-f610-4581-89ed-a5e668a28922 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:53.001023 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c6bf573-f610-4581-89ed-a5e668a28922 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:53.001659 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c6bf573-f610-4581-89ed-a5e668a28922 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:53.124027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3c6bf573-f610-4581-89ed-a5e668a28922 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b10b58bf3df46d18bff092022b08e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bc576163414daba5f5315c4a785533', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:53.136748 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3c6bf573-f610-4581-89ed-a5e668a28922 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b" status: 200 len: 1613 microversion: 2.1 time: 0.165644 Aug 04 17:19:53.140528 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2732/5499] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:52 2022] GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b => generated 1613 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:53.292357 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0f54901d-f825-4b3f-b39a-64f720f9266e req-f3c47f34-efda-44cf-bd44-242e21e08889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42ede9b2-fe57-4ea9-99e0-a4617a87425b", "name": "network-vif-deleted", "tag": "1a4b3e2d-010e-4229-81db-257ae011d245"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:19:53.308932 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0f54901d-f825-4b3f-b39a-64f720f9266e req-f3c47f34-efda-44cf-bd44-242e21e08889 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:53.309802 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0f54901d-f825-4b3f-b39a-64f720f9266e req-f3c47f34-efda-44cf-bd44-242e21e08889 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:53.310506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0f54901d-f825-4b3f-b39a-64f720f9266e req-f3c47f34-efda-44cf-bd44-242e21e08889 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:53.325637 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0f54901d-f825-4b3f-b39a-64f720f9266e req-f3c47f34-efda-44cf-bd44-242e21e08889 service nova] Creating event network-vif-deleted:1a4b3e2d-010e-4229-81db-257ae011d245 for instance 42ede9b2-fe57-4ea9-99e0-a4617a87425b on n-h1-851359-3 Aug 04 17:19:53.333394 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0f54901d-f825-4b3f-b39a-64f720f9266e req-f3c47f34-efda-44cf-bd44-242e21e08889 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190985 Aug 04 17:19:53.336229 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2733/5500] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:19:53.827572 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-25681633-cf77-4ed7-ad80-19de9420d50d tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:53.833341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-25681633-cf77-4ed7-ad80-19de9420d50d tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:53.883687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25681633-cf77-4ed7-ad80-19de9420d50d tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:53.888405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25681633-cf77-4ed7-ad80-19de9420d50d tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:53.896771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25681633-cf77-4ed7-ad80-19de9420d50d tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:53.898018 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25681633-cf77-4ed7-ad80-19de9420d50d tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:53.898626 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25681633-cf77-4ed7-ad80-19de9420d50d tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:53.899178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25681633-cf77-4ed7-ad80-19de9420d50d tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:54.410653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-af335c3e-d949-4839-83b4-afd212362a26 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:54.421914 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-af335c3e-d949-4839-83b4-afd212362a26 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:54.425244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-af335c3e-d949-4839-83b4-afd212362a26 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:54.428399 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-af335c3e-d949-4839-83b4-afd212362a26 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1731 microversion: 2.20 time: 1.571031 Aug 04 17:19:54.443896 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2768/5501] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:19:52 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1731 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:19:54.451305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-53551132-c0e3-415a-a31a-e4a038085acd tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:54.453017 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-53551132-c0e3-415a-a31a-e4a038085acd tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:54.463520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53551132-c0e3-415a-a31a-e4a038085acd tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:54.464243 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53551132-c0e3-415a-a31a-e4a038085acd tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:54.465089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53551132-c0e3-415a-a31a-e4a038085acd tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:54.467201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53551132-c0e3-415a-a31a-e4a038085acd tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:54.468593 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53551132-c0e3-415a-a31a-e4a038085acd tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:54.469847 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53551132-c0e3-415a-a31a-e4a038085acd tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:54.510675 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-53551132-c0e3-415a-a31a-e4a038085acd tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] HTTP exception thrown: Instance 42ede9b2-fe57-4ea9-99e0-a4617a87425b could not be found. Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-53551132-c0e3-415a-a31a-e4a038085acd tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Request method failure captured: Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b HTTP/1.1 Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_20IgjlzOhiiXNFc-NV1FHodxKmWXqSdjZ2I3CqIylUHNkhkG-JAGdMPdYL-8rZzM7v2_0KXVTorBGskuo6vUXRtOSVoO1KTIHw44-u5yCDnlwK7XKRi3uI2OBhda5ANtzdvy-06i9FyD27hM6LxpcHB7QNnHGthqSv2gOLnkKiVjg Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 80bc576163414daba5f5315c4a785533 Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/80bc576163414daba5f5315c4a785533"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/80bc576163414daba5f5315c4a785533"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_80bc576163414daba5f5315c4a785533"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/80bc576163414daba5f5315c4a785533"}]}] Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 80bc576163414daba5f5315c4a785533 Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-AttachVolumeNegativeTest-1565246319-project Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 5b10b58bf3df46d18bff092022b08e0f Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-AttachVolumeNegativeTest-1565246319-project Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 42ede9b2-fe57-4ea9-99e0-a4617a87425b could not be found. Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '42ede9b2-fe57-4ea9-99e0-a4617a87425b'} Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42ede9b2-fe57-4ea9-99e0-a4617a87425b could not be found. Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42ede9b2-fe57-4ea9-99e0-a4617a87425b could not be found. Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:19:54.515060 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:19:54.520245 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:19:54.520245 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:19:54.520245 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:19:54.520245 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:19:54.520245 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:19:54.520245 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42ede9b2-fe57-4ea9-99e0-a4617a87425b could not be found. Aug 04 17:19:54.520245 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:19:54.524937 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-53551132-c0e3-415a-a31a-e4a038085acd tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Returning 404 to user: Instance 42ede9b2-fe57-4ea9-99e0-a4617a87425b could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:19:54.530906 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-53551132-c0e3-415a-a31a-e4a038085acd tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b" status: 404 len: 111 microversion: 2.1 time: 0.085138 Aug 04 17:19:54.532229 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2769/5502] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:54 2022] GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:19:54.550575 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f7cd5784-a834-4b56-97b7-105961fc7ba5 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '.version_select at 0x7f1e5a411820>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:54.597229 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f7cd5784-a834-4b56-97b7-105961fc7ba5 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-20804503" status: 202 len: 0 microversion: 2.1 time: 0.059196 Aug 04 17:19:54.600371 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2770/5503] 10.222.0.93 () {58 vars in 1215 bytes} [Thu Aug 4 17:19:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-20804503 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 17:19:54.930555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-25681633-cf77-4ed7-ad80-19de9420d50d tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:54.950158 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-25681633-cf77-4ed7-ad80-19de9420d50d tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1519 microversion: 2.1 time: 1.163297 Aug 04 17:19:54.951614 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2734/5504] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:53 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1519 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:55.462674 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-06009771-72b6-4347-9b05-942d7fc6ce44 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:55.464160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-06009771-72b6-4347-9b05-942d7fc6ce44 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:55.484171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-06009771-72b6-4347-9b05-942d7fc6ce44 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:55.488692 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-06009771-72b6-4347-9b05-942d7fc6ce44 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:55.489172 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-06009771-72b6-4347-9b05-942d7fc6ce44 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:55.489951 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-06009771-72b6-4347-9b05-942d7fc6ce44 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:55.490454 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-06009771-72b6-4347-9b05-942d7fc6ce44 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:55.490950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-06009771-72b6-4347-9b05-942d7fc6ce44 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:55.816685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8b798e51-e0f1-4c42-98a5-f431138dfa2f tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Action: 'create', calling method: .version_select at 0x7f1e5a340af0>, body: {"keypair": {"name": "tempest-keypair-478931768", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVdrTyXtjNhtX3AIzwotQHtc1lm8YOh7eo04wQzQDtmXhGxRlTOdZZPL0g250slS6vZKdfHTm9pgEZHUIQ5mMGi77lcAnPqGGaxhZ7IYoi4kTLQ9tHYZCa3+b0JyjA9HA=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:19:55.865013 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8b798e51-e0f1-4c42-98a5-f431138dfa2f tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Getting quotas for project 60a0b5a8d12f49ffbb7570bec11538f7. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:19:55.874025 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8b798e51-e0f1-4c42-98a5-f431138dfa2f tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Getting quotas for user 0ed7b7928cdb49659150b9e89d86e8c8 and project 60a0b5a8d12f49ffbb7570bec11538f7. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:19:55.908786 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8b798e51-e0f1-4c42-98a5-f431138dfa2f tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.100279 Aug 04 17:19:55.912055 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2735/5505] 10.222.0.93 () {62 vars in 1200 bytes} [Thu Aug 4 17:19:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 104 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 04 17:19:55.979477 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-80ffa08d-97a9-4525-9a13-1f40353903f8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:55.981139 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-80ffa08d-97a9-4525-9a13-1f40353903f8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:56.001799 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80ffa08d-97a9-4525-9a13-1f40353903f8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:56.002723 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80ffa08d-97a9-4525-9a13-1f40353903f8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:56.003511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80ffa08d-97a9-4525-9a13-1f40353903f8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:56.006331 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80ffa08d-97a9-4525-9a13-1f40353903f8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:56.008068 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80ffa08d-97a9-4525-9a13-1f40353903f8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:56.008569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80ffa08d-97a9-4525-9a13-1f40353903f8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:56.729055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-06009771-72b6-4347-9b05-942d7fc6ce44 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:56.758784 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-06009771-72b6-4347-9b05-942d7fc6ce44 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:56.762042 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-06009771-72b6-4347-9b05-942d7fc6ce44 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:56.764220 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-06009771-72b6-4347-9b05-942d7fc6ce44 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1731 microversion: 2.20 time: 1.306850 Aug 04 17:19:56.778024 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2771/5506] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:19:55 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1731 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:19:56.784508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-28ce6bde-49ec-41b9-8f9b-db2b41a2edb3 req-7da965dc-b71b-49aa-b073-0148a7fa64c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5248dcdc-5a16-4036-9537-eb84f73dc372", "tag": "620457fa-43b8-4d5c-9ed1-44c49f63239c"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:19:56.808745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-28ce6bde-49ec-41b9-8f9b-db2b41a2edb3 req-7da965dc-b71b-49aa-b073-0148a7fa64c9 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:56.809574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-28ce6bde-49ec-41b9-8f9b-db2b41a2edb3 req-7da965dc-b71b-49aa-b073-0148a7fa64c9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:56.810394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-28ce6bde-49ec-41b9-8f9b-db2b41a2edb3 req-7da965dc-b71b-49aa-b073-0148a7fa64c9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:56.851928 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-28ce6bde-49ec-41b9-8f9b-db2b41a2edb3 req-7da965dc-b71b-49aa-b073-0148a7fa64c9 service nova] Creating event network-changed:620457fa-43b8-4d5c-9ed1-44c49f63239c for instance 5248dcdc-5a16-4036-9537-eb84f73dc372 on n-h2-851359-3 Aug 04 17:19:56.864357 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-28ce6bde-49ec-41b9-8f9b-db2b41a2edb3 req-7da965dc-b71b-49aa-b073-0148a7fa64c9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084632 Aug 04 17:19:56.865617 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2772/5507] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:19:56.902792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-80ffa08d-97a9-4525-9a13-1f40353903f8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:56.919044 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-80ffa08d-97a9-4525-9a13-1f40353903f8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1519 microversion: 2.1 time: 0.945287 Aug 04 17:19:56.919666 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2736/5508] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:55 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1519 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:19:57.805866 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-39b7fe9f-37ff-4315-afae-69455172a581 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:57.808585 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-39b7fe9f-37ff-4315-afae-69455172a581 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:57.831415 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39b7fe9f-37ff-4315-afae-69455172a581 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:57.831889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39b7fe9f-37ff-4315-afae-69455172a581 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:57.832753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39b7fe9f-37ff-4315-afae-69455172a581 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:57.858503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39b7fe9f-37ff-4315-afae-69455172a581 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:57.868151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39b7fe9f-37ff-4315-afae-69455172a581 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:57.868923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-39b7fe9f-37ff-4315-afae-69455172a581 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:57.923623 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:19:57.947670 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a04921fb-5e6e-404f-a1db-4396ce77eab8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:57.950531 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a04921fb-5e6e-404f-a1db-4396ce77eab8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:57.954923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:19:57.983350 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a04921fb-5e6e-404f-a1db-4396ce77eab8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:57.984114 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a04921fb-5e6e-404f-a1db-4396ce77eab8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:57.984426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a04921fb-5e6e-404f-a1db-4396ce77eab8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:57.985768 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a04921fb-5e6e-404f-a1db-4396ce77eab8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:57.986339 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a04921fb-5e6e-404f-a1db-4396ce77eab8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:57.986785 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a04921fb-5e6e-404f-a1db-4396ce77eab8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:58.788300 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a04921fb-5e6e-404f-a1db-4396ce77eab8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:58.819730 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a04921fb-5e6e-404f-a1db-4396ce77eab8 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1519 microversion: 2.1 time: 0.877357 Aug 04 17:19:58.826016 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2737/5509] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:57 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1519 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:19:58.977861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-39b7fe9f-37ff-4315-afae-69455172a581 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:59.019694 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-39b7fe9f-37ff-4315-afae-69455172a581 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:59.031032 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-39b7fe9f-37ff-4315-afae-69455172a581 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:19:59.042003 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-39b7fe9f-37ff-4315-afae-69455172a581 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1731 microversion: 2.20 time: 1.232591 Aug 04 17:19:59.064906 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2773/5510] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:19:57 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1731 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:19:59.392260 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-43c8c3af-5ec0-400e-ab22-351583877570 req-c0849930-5b05-4a01-8bc3-349f26c2b5c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7dd09c1-f3da-438a-b0d8-1102ee2d67f8", "name": "network-vif-plugged", "status": "completed", "tag": "1dd4fc9a-a07b-4b63-82e0-ad9da9f1b5b2"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:19:59.441496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-43c8c3af-5ec0-400e-ab22-351583877570 req-c0849930-5b05-4a01-8bc3-349f26c2b5c2 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:59.444167 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-43c8c3af-5ec0-400e-ab22-351583877570 req-c0849930-5b05-4a01-8bc3-349f26c2b5c2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:59.448244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-43c8c3af-5ec0-400e-ab22-351583877570 req-c0849930-5b05-4a01-8bc3-349f26c2b5c2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:59.469794 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-43c8c3af-5ec0-400e-ab22-351583877570 req-c0849930-5b05-4a01-8bc3-349f26c2b5c2 service nova] Creating event network-vif-plugged:1dd4fc9a-a07b-4b63-82e0-ad9da9f1b5b2 for instance e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 on n-h2-851359-3 Aug 04 17:19:59.476532 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-43c8c3af-5ec0-400e-ab22-351583877570 req-c0849930-5b05-4a01-8bc3-349f26c2b5c2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096432 Aug 04 17:19:59.477788 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2738/5511] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:19:59.849365 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-96d7e187-df57-461d-8bba-05ea35df75f1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:19:59.850505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-96d7e187-df57-461d-8bba-05ea35df75f1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:19:59.867120 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-96d7e187-df57-461d-8bba-05ea35df75f1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:59.867671 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-96d7e187-df57-461d-8bba-05ea35df75f1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:59.868312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-96d7e187-df57-461d-8bba-05ea35df75f1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:19:59.868831 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-96d7e187-df57-461d-8bba-05ea35df75f1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:19:59.873392 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-96d7e187-df57-461d-8bba-05ea35df75f1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:19:59.874077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-96d7e187-df57-461d-8bba-05ea35df75f1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:00.077128 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-66ae8018-7cc6-458a-8ce1-c7afd3c4f540 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:00.077824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-66ae8018-7cc6-458a-8ce1-c7afd3c4f540 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:00.103263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66ae8018-7cc6-458a-8ce1-c7afd3c4f540 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:00.105584 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66ae8018-7cc6-458a-8ce1-c7afd3c4f540 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:00.106270 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66ae8018-7cc6-458a-8ce1-c7afd3c4f540 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:00.109006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66ae8018-7cc6-458a-8ce1-c7afd3c4f540 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:00.113089 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66ae8018-7cc6-458a-8ce1-c7afd3c4f540 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:00.114180 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66ae8018-7cc6-458a-8ce1-c7afd3c4f540 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:01.512891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-66ae8018-7cc6-458a-8ce1-c7afd3c4f540 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:01.530047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-66ae8018-7cc6-458a-8ce1-c7afd3c4f540 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:01.557647 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-66ae8018-7cc6-458a-8ce1-c7afd3c4f540 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:01.600871 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-66ae8018-7cc6-458a-8ce1-c7afd3c4f540 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1731 microversion: 2.20 time: 1.490573 Aug 04 17:20:01.624045 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2739/5512] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:20:00 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1731 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:20:01.728597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-96d7e187-df57-461d-8bba-05ea35df75f1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:01.757360 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-96d7e187-df57-461d-8bba-05ea35df75f1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1519 microversion: 2.1 time: 1.910733 Aug 04 17:20:01.757849 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2774/5513] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:19:59 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1519 bytes in 1917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:02.650583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-45126642-cd12-4cfd-bf1f-0e3820ecdb2c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:02.654085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-45126642-cd12-4cfd-bf1f-0e3820ecdb2c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:02.684707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45126642-cd12-4cfd-bf1f-0e3820ecdb2c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:02.689897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45126642-cd12-4cfd-bf1f-0e3820ecdb2c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:02.692166 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45126642-cd12-4cfd-bf1f-0e3820ecdb2c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:02.695611 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45126642-cd12-4cfd-bf1f-0e3820ecdb2c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:02.700577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45126642-cd12-4cfd-bf1f-0e3820ecdb2c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:02.702065 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45126642-cd12-4cfd-bf1f-0e3820ecdb2c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:02.795064 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-280cd279-4323-439e-af39-74e7e13e70d2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:02.796493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-280cd279-4323-439e-af39-74e7e13e70d2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:02.819980 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-280cd279-4323-439e-af39-74e7e13e70d2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:02.821175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-280cd279-4323-439e-af39-74e7e13e70d2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:02.821994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-280cd279-4323-439e-af39-74e7e13e70d2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:02.823688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-280cd279-4323-439e-af39-74e7e13e70d2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:02.824882 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-280cd279-4323-439e-af39-74e7e13e70d2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:02.826306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-280cd279-4323-439e-af39-74e7e13e70d2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:04.236058 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-45126642-cd12-4cfd-bf1f-0e3820ecdb2c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:04.251917 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-45126642-cd12-4cfd-bf1f-0e3820ecdb2c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:04.253822 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-45126642-cd12-4cfd-bf1f-0e3820ecdb2c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:04.260530 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-45126642-cd12-4cfd-bf1f-0e3820ecdb2c tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1731 microversion: 2.20 time: 1.623193 Aug 04 17:20:04.283757 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2740/5514] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:20:02 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1731 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:20:04.693386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-280cd279-4323-439e-af39-74e7e13e70d2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:04.733944 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-280cd279-4323-439e-af39-74e7e13e70d2 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1519 microversion: 2.1 time: 1.945936 Aug 04 17:20:04.751340 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2775/5515] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:02 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1519 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:05.309587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-331b09e0-df9e-497f-9866-04f6e8885bab tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:05.315505 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-331b09e0-df9e-497f-9866-04f6e8885bab tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:05.340041 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-331b09e0-df9e-497f-9866-04f6e8885bab tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:05.342722 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-331b09e0-df9e-497f-9866-04f6e8885bab tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:05.345783 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-331b09e0-df9e-497f-9866-04f6e8885bab tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:05.347806 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-331b09e0-df9e-497f-9866-04f6e8885bab tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:05.351495 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-331b09e0-df9e-497f-9866-04f6e8885bab tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:05.357187 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-331b09e0-df9e-497f-9866-04f6e8885bab tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:05.758777 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ad5954bc-0cad-4b8d-95d4-beedf854d9ce tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:05.759752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ad5954bc-0cad-4b8d-95d4-beedf854d9ce tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:05.780544 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad5954bc-0cad-4b8d-95d4-beedf854d9ce tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:05.782472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad5954bc-0cad-4b8d-95d4-beedf854d9ce tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:05.782991 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad5954bc-0cad-4b8d-95d4-beedf854d9ce tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:05.783765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad5954bc-0cad-4b8d-95d4-beedf854d9ce tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:05.784241 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad5954bc-0cad-4b8d-95d4-beedf854d9ce tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:05.784687 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad5954bc-0cad-4b8d-95d4-beedf854d9ce tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:05.883048 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:20:05.897870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-331b09e0-df9e-497f-9866-04f6e8885bab tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:05.917723 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-331b09e0-df9e-497f-9866-04f6e8885bab tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:05.919560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-331b09e0-df9e-497f-9866-04f6e8885bab tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:05.928411 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-331b09e0-df9e-497f-9866-04f6e8885bab tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1718 microversion: 2.20 time: 0.628556 Aug 04 17:20:05.929962 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2741/5516] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:20:05 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1718 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:20:06.724281 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ad5954bc-0cad-4b8d-95d4-beedf854d9ce tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:06.769617 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ad5954bc-0cad-4b8d-95d4-beedf854d9ce tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1519 microversion: 2.1 time: 1.013771 Aug 04 17:20:06.773900 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2776/5517] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:05 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1519 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:20:07.071022 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a6357088-fd9d-40d2-a803-079728f2904e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:07.071703 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a6357088-fd9d-40d2-a803-079728f2904e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:07.088581 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6357088-fd9d-40d2-a803-079728f2904e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:07.090545 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6357088-fd9d-40d2-a803-079728f2904e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:07.092272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6357088-fd9d-40d2-a803-079728f2904e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:07.093474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6357088-fd9d-40d2-a803-079728f2904e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:07.095382 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6357088-fd9d-40d2-a803-079728f2904e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:07.098635 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6357088-fd9d-40d2-a803-079728f2904e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:07.173734 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-a6357088-fd9d-40d2-a803-079728f2904e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] HTTP exception thrown: Instance 42ede9b2-fe57-4ea9-99e0-a4617a87425b could not be found. Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a6357088-fd9d-40d2-a803-079728f2904e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Request method failure captured: Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b HTTP/1.1 Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_20IgjlzOhiiXNFc-NV1FHodxKmWXqSdjZ2I3CqIylUHNkhkG-JAGdMPdYL-8rZzM7v2_0KXVTorBGskuo6vUXRtOSVoO1KTIHw44-u5yCDnlwK7XKRi3uI2OBhda5ANtzdvy-06i9FyD27hM6LxpcHB7QNnHGthqSv2gOLnkKiVjg Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 80bc576163414daba5f5315c4a785533 Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/80bc576163414daba5f5315c4a785533"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/80bc576163414daba5f5315c4a785533"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_80bc576163414daba5f5315c4a785533"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/80bc576163414daba5f5315c4a785533"}]}] Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 80bc576163414daba5f5315c4a785533 Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-AttachVolumeNegativeTest-1565246319-project Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 5b10b58bf3df46d18bff092022b08e0f Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-AttachVolumeNegativeTest-1565246319-project Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 42ede9b2-fe57-4ea9-99e0-a4617a87425b could not be found. Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '42ede9b2-fe57-4ea9-99e0-a4617a87425b'} Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42ede9b2-fe57-4ea9-99e0-a4617a87425b could not be found. Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:20:07.177022 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:20:07.191306 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42ede9b2-fe57-4ea9-99e0-a4617a87425b could not be found. Aug 04 17:20:07.191306 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:07.191306 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:07.191306 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:07.191306 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:07.191306 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:07.191306 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:07.191306 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:20:07.191306 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:20:07.191306 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42ede9b2-fe57-4ea9-99e0-a4617a87425b could not be found. Aug 04 17:20:07.191306 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:07.191306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a6357088-fd9d-40d2-a803-079728f2904e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Returning 404 to user: Instance 42ede9b2-fe57-4ea9-99e0-a4617a87425b could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:20:07.191306 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a6357088-fd9d-40d2-a803-079728f2904e tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "DELETE /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b" status: 404 len: 111 microversion: 2.1 time: 0.116179 Aug 04 17:20:07.194195 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2742/5518] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:20:07 2022] DELETE /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:20:07.209026 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c6691f68-3a03-493d-a4bb-3eeda72a38e9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:07.211467 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c6691f68-3a03-493d-a4bb-3eeda72a38e9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 42ede9b2-fe57-4ea9-99e0-a4617a87425b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:07.222438 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6691f68-3a03-493d-a4bb-3eeda72a38e9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:07.223844 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6691f68-3a03-493d-a4bb-3eeda72a38e9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:07.226441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6691f68-3a03-493d-a4bb-3eeda72a38e9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:07.231019 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6691f68-3a03-493d-a4bb-3eeda72a38e9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:07.233696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6691f68-3a03-493d-a4bb-3eeda72a38e9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:07.236239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6691f68-3a03-493d-a4bb-3eeda72a38e9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:07.292157 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-c6691f68-3a03-493d-a4bb-3eeda72a38e9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] HTTP exception thrown: Instance 42ede9b2-fe57-4ea9-99e0-a4617a87425b could not be found. Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c6691f68-3a03-493d-a4bb-3eeda72a38e9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Request method failure captured: Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b HTTP/1.1 Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_20IgjlzOhiiXNFc-NV1FHodxKmWXqSdjZ2I3CqIylUHNkhkG-JAGdMPdYL-8rZzM7v2_0KXVTorBGskuo6vUXRtOSVoO1KTIHw44-u5yCDnlwK7XKRi3uI2OBhda5ANtzdvy-06i9FyD27hM6LxpcHB7QNnHGthqSv2gOLnkKiVjg Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 80bc576163414daba5f5315c4a785533 Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/80bc576163414daba5f5315c4a785533"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/80bc576163414daba5f5315c4a785533"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_80bc576163414daba5f5315c4a785533"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/80bc576163414daba5f5315c4a785533"}]}] Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 80bc576163414daba5f5315c4a785533 Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-AttachVolumeNegativeTest-1565246319-project Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 5b10b58bf3df46d18bff092022b08e0f Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-AttachVolumeNegativeTest-1565246319-project Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 42ede9b2-fe57-4ea9-99e0-a4617a87425b could not be found. Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '42ede9b2-fe57-4ea9-99e0-a4617a87425b'} Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42ede9b2-fe57-4ea9-99e0-a4617a87425b could not be found. Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42ede9b2-fe57-4ea9-99e0-a4617a87425b could not be found. Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:07.299010 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:07.305534 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:07.305534 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:07.305534 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:07.305534 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:20:07.305534 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:20:07.305534 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42ede9b2-fe57-4ea9-99e0-a4617a87425b could not be found. Aug 04 17:20:07.305534 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:07.306860 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c6691f68-3a03-493d-a4bb-3eeda72a38e9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Returning 404 to user: Instance 42ede9b2-fe57-4ea9-99e0-a4617a87425b could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:20:07.308353 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c6691f68-3a03-493d-a4bb-3eeda72a38e9 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b" status: 404 len: 111 microversion: 2.1 time: 0.110667 Aug 04 17:20:07.315680 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2777/5519] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:07 2022] GET /compute/v2.1/servers/42ede9b2-fe57-4ea9-99e0-a4617a87425b => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:20:07.805256 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5f246a03-1adc-45fb-a2dd-8ecfc4d43f01 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:07.806339 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5f246a03-1adc-45fb-a2dd-8ecfc4d43f01 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:07.860016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f246a03-1adc-45fb-a2dd-8ecfc4d43f01 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:07.860747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f246a03-1adc-45fb-a2dd-8ecfc4d43f01 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:07.862060 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f246a03-1adc-45fb-a2dd-8ecfc4d43f01 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:07.869110 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f246a03-1adc-45fb-a2dd-8ecfc4d43f01 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:07.870056 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f246a03-1adc-45fb-a2dd-8ecfc4d43f01 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:07.871123 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f246a03-1adc-45fb-a2dd-8ecfc4d43f01 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:08.881069 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5f246a03-1adc-45fb-a2dd-8ecfc4d43f01 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:08.885563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:20:08.918274 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5f246a03-1adc-45fb-a2dd-8ecfc4d43f01 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1519 microversion: 2.1 time: 1.121189 Aug 04 17:20:08.918910 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2743/5520] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:07 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1519 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:09.958268 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ac205711-6879-4ece-b4f8-6565787a2e6d tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:09.959927 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ac205711-6879-4ece-b4f8-6565787a2e6d tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:09.978754 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:20:09.983527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac205711-6879-4ece-b4f8-6565787a2e6d tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:09.986253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac205711-6879-4ece-b4f8-6565787a2e6d tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:09.987233 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac205711-6879-4ece-b4f8-6565787a2e6d tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:09.988808 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac205711-6879-4ece-b4f8-6565787a2e6d tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:09.990202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac205711-6879-4ece-b4f8-6565787a2e6d tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:09.994625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac205711-6879-4ece-b4f8-6565787a2e6d tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:10.724766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ac205711-6879-4ece-b4f8-6565787a2e6d tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:10.740653 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ac205711-6879-4ece-b4f8-6565787a2e6d tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1519 microversion: 2.1 time: 0.791154 Aug 04 17:20:10.748730 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2778/5521] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:09 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1519 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:11.772962 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c6fa7b6f-241a-4e8a-b6a5-a3904eef29fc tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:11.773838 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c6fa7b6f-241a-4e8a-b6a5-a3904eef29fc tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:11.814783 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6fa7b6f-241a-4e8a-b6a5-a3904eef29fc tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:11.815950 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6fa7b6f-241a-4e8a-b6a5-a3904eef29fc tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:11.816608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6fa7b6f-241a-4e8a-b6a5-a3904eef29fc tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:11.817600 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6fa7b6f-241a-4e8a-b6a5-a3904eef29fc tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:11.818771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6fa7b6f-241a-4e8a-b6a5-a3904eef29fc tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:11.820044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6fa7b6f-241a-4e8a-b6a5-a3904eef29fc tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:12.804722 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e5e634b9-b698-48d1-83c2-43dc0a66bcc7 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-552956718", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "545a7a1c-c8f0-45e2-82e4-11740223fd78"}, {"port": "9af8c8e0-eab5-4884-8cf2-8ebe6aa58e3c", "tag": "port-1"}, {"port": "485e15db-88a6-41d7-ad94-dc268d623543", "tag": "port-2"}, {"uuid": "fff3ad2c-43a9-4b1f-a4fa-bd9339d9ce39", "tag": "net-1"}, {"uuid": "fff3ad2c-43a9-4b1f-a4fa-bd9339d9ce39"}, {"uuid": "10063706-e5f3-4ae2-805f-d6474b9a9ff5", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "10063706-e5f3-4ae2-805f-d6474b9a9ff5", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "44e22b04-9a0a-492f-9a92-5c6731312115", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "c566acf7-612b-4318-8bc3-9ee73ab3ee15", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "71943056-7687-477d-9e3d-b196e7e1d49b", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--424977301"}], "key_name": "tempest-keypair-478931768", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:20:13.442949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-e5e634b9-b698-48d1-83c2-43dc0a66bcc7 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] validate_networks() for [('545a7a1c-c8f0-45e2-82e4-11740223fd78', None, None, None, None, None), (None, None, '9af8c8e0-eab5-4884-8cf2-8ebe6aa58e3c', None, None, None), (None, None, '485e15db-88a6-41d7-ad94-dc268d623543', None, None, None), ('fff3ad2c-43a9-4b1f-a4fa-bd9339d9ce39', None, None, None, None, None), ('fff3ad2c-43a9-4b1f-a4fa-bd9339d9ce39', None, None, None, None, None), ('10063706-e5f3-4ae2-805f-d6474b9a9ff5', '10.2.2.100', None, None, None, None), ('10063706-e5f3-4ae2-805f-d6474b9a9ff5', '10.2.2.200', None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:20:14.533734 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c6fa7b6f-241a-4e8a-b6a5-a3904eef29fc tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:14.547973 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c6fa7b6f-241a-4e8a-b6a5-a3904eef29fc tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1519 microversion: 2.1 time: 2.781443 Aug 04 17:20:14.567038 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2744/5522] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:11 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1519 bytes in 2803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:15.574449 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b05f506e-a57f-4e53-8dc5-e90563bb5a4c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:15.575117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b05f506e-a57f-4e53-8dc5-e90563bb5a4c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:15.594970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b05f506e-a57f-4e53-8dc5-e90563bb5a4c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:15.596094 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b05f506e-a57f-4e53-8dc5-e90563bb5a4c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:15.596782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b05f506e-a57f-4e53-8dc5-e90563bb5a4c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:15.599420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b05f506e-a57f-4e53-8dc5-e90563bb5a4c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:15.602917 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b05f506e-a57f-4e53-8dc5-e90563bb5a4c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:15.604254 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b05f506e-a57f-4e53-8dc5-e90563bb5a4c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:16.854606 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b05f506e-a57f-4e53-8dc5-e90563bb5a4c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:16.889819 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b05f506e-a57f-4e53-8dc5-e90563bb5a4c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1519 microversion: 2.1 time: 1.319053 Aug 04 17:20:16.899888 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2745/5523] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:15 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1519 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:17.389499 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e7e53f87-6a2a-41a8-b004-82dd5fa9b378 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:17.391256 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e7e53f87-6a2a-41a8-b004-82dd5fa9b378 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:17.406785 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7e53f87-6a2a-41a8-b004-82dd5fa9b378 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:17.407727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7e53f87-6a2a-41a8-b004-82dd5fa9b378 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:17.408504 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7e53f87-6a2a-41a8-b004-82dd5fa9b378 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:17.411146 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7e53f87-6a2a-41a8-b004-82dd5fa9b378 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:17.412833 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7e53f87-6a2a-41a8-b004-82dd5fa9b378 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:17.415365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7e53f87-6a2a-41a8-b004-82dd5fa9b378 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:17.438712 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-e7e53f87-6a2a-41a8-b004-82dd5fa9b378 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] HTTP exception thrown: Instance 50cacda1-31c5-4417-8013-9c603340c3ee could not be found. Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e7e53f87-6a2a-41a8-b004-82dd5fa9b378 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Request method failure captured: Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee HTTP/1.1 Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_20IgjlzOhiiXNFc-NV1FHodxKmWXqSdjZ2I3CqIylUHNkhkG-JAGdMPdYL-8rZzM7v2_0KXVTorBGskuo6vUXRtOSVoO1KTIHw44-u5yCDnlwK7XKRi3uI2OBhda5ANtzdvy-06i9FyD27hM6LxpcHB7QNnHGthqSv2gOLnkKiVjg Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 80bc576163414daba5f5315c4a785533 Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/80bc576163414daba5f5315c4a785533"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/80bc576163414daba5f5315c4a785533"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_80bc576163414daba5f5315c4a785533"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/80bc576163414daba5f5315c4a785533"}]}] Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 80bc576163414daba5f5315c4a785533 Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-AttachVolumeNegativeTest-1565246319-project Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 5b10b58bf3df46d18bff092022b08e0f Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-AttachVolumeNegativeTest-1565246319-project Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 50cacda1-31c5-4417-8013-9c603340c3ee could not be found. Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '50cacda1-31c5-4417-8013-9c603340c3ee'} Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50cacda1-31c5-4417-8013-9c603340c3ee could not be found. Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:20:17.447485 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:20:17.455447 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50cacda1-31c5-4417-8013-9c603340c3ee could not be found. Aug 04 17:20:17.455447 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:17.455447 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:17.455447 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:17.455447 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:17.455447 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:17.455447 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:17.455447 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:20:17.455447 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:20:17.455447 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50cacda1-31c5-4417-8013-9c603340c3ee could not be found. Aug 04 17:20:17.455447 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:17.455447 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e7e53f87-6a2a-41a8-b004-82dd5fa9b378 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Returning 404 to user: Instance 50cacda1-31c5-4417-8013-9c603340c3ee could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:20:17.455447 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e7e53f87-6a2a-41a8-b004-82dd5fa9b378 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "DELETE /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee" status: 404 len: 111 microversion: 2.1 time: 0.066820 Aug 04 17:20:17.455447 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2746/5524] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:20:17 2022] DELETE /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:20:17.466094 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a686303e-c5db-4135-a039-5a84112ea769 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:17.466737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a686303e-c5db-4135-a039-5a84112ea769 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 50cacda1-31c5-4417-8013-9c603340c3ee] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:17.488191 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a686303e-c5db-4135-a039-5a84112ea769 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:17.489021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a686303e-c5db-4135-a039-5a84112ea769 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:17.489749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a686303e-c5db-4135-a039-5a84112ea769 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:17.490691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a686303e-c5db-4135-a039-5a84112ea769 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:17.491344 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a686303e-c5db-4135-a039-5a84112ea769 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:17.491975 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a686303e-c5db-4135-a039-5a84112ea769 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:17.532605 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-a686303e-c5db-4135-a039-5a84112ea769 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] HTTP exception thrown: Instance 50cacda1-31c5-4417-8013-9c603340c3ee could not be found. Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a686303e-c5db-4135-a039-5a84112ea769 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Request method failure captured: Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee HTTP/1.1 Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_20IgjlzOhiiXNFc-NV1FHodxKmWXqSdjZ2I3CqIylUHNkhkG-JAGdMPdYL-8rZzM7v2_0KXVTorBGskuo6vUXRtOSVoO1KTIHw44-u5yCDnlwK7XKRi3uI2OBhda5ANtzdvy-06i9FyD27hM6LxpcHB7QNnHGthqSv2gOLnkKiVjg Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 80bc576163414daba5f5315c4a785533 Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/80bc576163414daba5f5315c4a785533"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/80bc576163414daba5f5315c4a785533"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_80bc576163414daba5f5315c4a785533"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/80bc576163414daba5f5315c4a785533"}]}] Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 80bc576163414daba5f5315c4a785533 Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-AttachVolumeNegativeTest-1565246319-project Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 5b10b58bf3df46d18bff092022b08e0f Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-AttachVolumeNegativeTest-1565246319-project Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 50cacda1-31c5-4417-8013-9c603340c3ee could not be found. Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '50cacda1-31c5-4417-8013-9c603340c3ee'} Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50cacda1-31c5-4417-8013-9c603340c3ee could not be found. Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50cacda1-31c5-4417-8013-9c603340c3ee could not be found. Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:17.534291 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:17.539698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:17.539698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:17.539698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:17.539698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:20:17.539698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:20:17.539698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50cacda1-31c5-4417-8013-9c603340c3ee could not be found. Aug 04 17:20:17.539698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:17.547323 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a686303e-c5db-4135-a039-5a84112ea769 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Returning 404 to user: Instance 50cacda1-31c5-4417-8013-9c603340c3ee could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:20:17.548412 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a686303e-c5db-4135-a039-5a84112ea769 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee" status: 404 len: 111 microversion: 2.1 time: 0.094203 Aug 04 17:20:17.553267 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2747/5525] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:17 2022] GET /compute/v2.1/servers/50cacda1-31c5-4417-8013-9c603340c3ee => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:20:17.563785 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2e55102b-9351-415a-b8c6-2af6114024af tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:17.564283 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2e55102b-9351-415a-b8c6-2af6114024af tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: c75ee070-7154-4d00-add1-674bb1c4b2b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:17.591517 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e55102b-9351-415a-b8c6-2af6114024af tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:17.592028 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e55102b-9351-415a-b8c6-2af6114024af tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:17.592624 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e55102b-9351-415a-b8c6-2af6114024af tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:17.594089 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e55102b-9351-415a-b8c6-2af6114024af tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:17.594453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e55102b-9351-415a-b8c6-2af6114024af tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:17.594892 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e55102b-9351-415a-b8c6-2af6114024af tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:17.613299 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-2e55102b-9351-415a-b8c6-2af6114024af tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] HTTP exception thrown: Instance c75ee070-7154-4d00-add1-674bb1c4b2b0 could not be found. Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2e55102b-9351-415a-b8c6-2af6114024af tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Request method failure captured: Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0 HTTP/1.1 Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_20IgjlzOhiiXNFc-NV1FHodxKmWXqSdjZ2I3CqIylUHNkhkG-JAGdMPdYL-8rZzM7v2_0KXVTorBGskuo6vUXRtOSVoO1KTIHw44-u5yCDnlwK7XKRi3uI2OBhda5ANtzdvy-06i9FyD27hM6LxpcHB7QNnHGthqSv2gOLnkKiVjg Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 80bc576163414daba5f5315c4a785533 Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/80bc576163414daba5f5315c4a785533"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/80bc576163414daba5f5315c4a785533"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_80bc576163414daba5f5315c4a785533"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/80bc576163414daba5f5315c4a785533"}]}] Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 80bc576163414daba5f5315c4a785533 Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-AttachVolumeNegativeTest-1565246319-project Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 5b10b58bf3df46d18bff092022b08e0f Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-AttachVolumeNegativeTest-1565246319-project Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance c75ee070-7154-4d00-add1-674bb1c4b2b0 could not be found. Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'c75ee070-7154-4d00-add1-674bb1c4b2b0'} Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c75ee070-7154-4d00-add1-674bb1c4b2b0 could not be found. Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:20:17.615472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:20:17.621101 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c75ee070-7154-4d00-add1-674bb1c4b2b0 could not be found. Aug 04 17:20:17.621101 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:17.621101 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:17.621101 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:17.621101 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:17.621101 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:17.621101 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:17.621101 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:20:17.621101 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:20:17.621101 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c75ee070-7154-4d00-add1-674bb1c4b2b0 could not be found. Aug 04 17:20:17.621101 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:17.621101 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2e55102b-9351-415a-b8c6-2af6114024af tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Returning 404 to user: Instance c75ee070-7154-4d00-add1-674bb1c4b2b0 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:20:17.621101 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2e55102b-9351-415a-b8c6-2af6114024af tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "DELETE /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0" status: 404 len: 111 microversion: 2.1 time: 0.063329 Aug 04 17:20:17.623308 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2748/5526] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:20:17 2022] DELETE /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:20:17.628560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b8e464d1-f0e3-4abc-83d5-0ced1eb36e76 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:17.629057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b8e464d1-f0e3-4abc-83d5-0ced1eb36e76 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: c75ee070-7154-4d00-add1-674bb1c4b2b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:17.635709 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8e464d1-f0e3-4abc-83d5-0ced1eb36e76 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:17.636206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8e464d1-f0e3-4abc-83d5-0ced1eb36e76 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:17.636820 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8e464d1-f0e3-4abc-83d5-0ced1eb36e76 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:17.637550 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8e464d1-f0e3-4abc-83d5-0ced1eb36e76 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:17.638041 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8e464d1-f0e3-4abc-83d5-0ced1eb36e76 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:17.638471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8e464d1-f0e3-4abc-83d5-0ced1eb36e76 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:17.668487 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-b8e464d1-f0e3-4abc-83d5-0ced1eb36e76 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] HTTP exception thrown: Instance c75ee070-7154-4d00-add1-674bb1c4b2b0 could not be found. Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b8e464d1-f0e3-4abc-83d5-0ced1eb36e76 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Request method failure captured: Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0 HTTP/1.1 Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_20IgjlzOhiiXNFc-NV1FHodxKmWXqSdjZ2I3CqIylUHNkhkG-JAGdMPdYL-8rZzM7v2_0KXVTorBGskuo6vUXRtOSVoO1KTIHw44-u5yCDnlwK7XKRi3uI2OBhda5ANtzdvy-06i9FyD27hM6LxpcHB7QNnHGthqSv2gOLnkKiVjg Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 80bc576163414daba5f5315c4a785533 Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/80bc576163414daba5f5315c4a785533"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/80bc576163414daba5f5315c4a785533"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_80bc576163414daba5f5315c4a785533"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/80bc576163414daba5f5315c4a785533"}]}] Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 80bc576163414daba5f5315c4a785533 Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-AttachVolumeNegativeTest-1565246319-project Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 5b10b58bf3df46d18bff092022b08e0f Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-AttachVolumeNegativeTest-1565246319-project Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance c75ee070-7154-4d00-add1-674bb1c4b2b0 could not be found. Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'c75ee070-7154-4d00-add1-674bb1c4b2b0'} Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c75ee070-7154-4d00-add1-674bb1c4b2b0 could not be found. Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c75ee070-7154-4d00-add1-674bb1c4b2b0 could not be found. Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:17.670319 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:17.675755 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:17.675755 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:17.675755 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:17.675755 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:20:17.675755 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:20:17.675755 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c75ee070-7154-4d00-add1-674bb1c4b2b0 could not be found. Aug 04 17:20:17.675755 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:17.677229 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b8e464d1-f0e3-4abc-83d5-0ced1eb36e76 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Returning 404 to user: Instance c75ee070-7154-4d00-add1-674bb1c4b2b0 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:20:17.678432 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b8e464d1-f0e3-4abc-83d5-0ced1eb36e76 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0" status: 404 len: 111 microversion: 2.1 time: 0.054106 Aug 04 17:20:17.679597 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2749/5527] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:17 2022] GET /compute/v2.1/servers/c75ee070-7154-4d00-add1-674bb1c4b2b0 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:20:17.922849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9d1ec67f-faa2-4007-848e-0cb5410b3a75 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:17.924210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9d1ec67f-faa2-4007-848e-0cb5410b3a75 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:17.934840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d1ec67f-faa2-4007-848e-0cb5410b3a75 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:17.938582 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d1ec67f-faa2-4007-848e-0cb5410b3a75 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:17.939411 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d1ec67f-faa2-4007-848e-0cb5410b3a75 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:17.940369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d1ec67f-faa2-4007-848e-0cb5410b3a75 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:17.945546 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d1ec67f-faa2-4007-848e-0cb5410b3a75 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:17.946248 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d1ec67f-faa2-4007-848e-0cb5410b3a75 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:18.493635 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9d1ec67f-faa2-4007-848e-0cb5410b3a75 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:18.502215 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9d1ec67f-faa2-4007-848e-0cb5410b3a75 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1519 microversion: 2.1 time: 0.583898 Aug 04 17:20:18.502820 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2750/5528] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:17 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1519 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:20:19.528954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-00fbbf50-0491-42c0-a025-ad9ed2c442b5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:19.529691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-00fbbf50-0491-42c0-a025-ad9ed2c442b5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:19.546234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00fbbf50-0491-42c0-a025-ad9ed2c442b5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:19.549021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00fbbf50-0491-42c0-a025-ad9ed2c442b5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:19.549904 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00fbbf50-0491-42c0-a025-ad9ed2c442b5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:19.555598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00fbbf50-0491-42c0-a025-ad9ed2c442b5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:19.558016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00fbbf50-0491-42c0-a025-ad9ed2c442b5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:19.558564 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00fbbf50-0491-42c0-a025-ad9ed2c442b5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:20.495695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-00fbbf50-0491-42c0-a025-ad9ed2c442b5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:20.514044 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-00fbbf50-0491-42c0-a025-ad9ed2c442b5 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1519 microversion: 2.1 time: 0.990021 Aug 04 17:20:20.532262 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2751/5529] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:19 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1519 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:20:20.539025 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-208a76a7-ba87-45f9-b597-9c2b5c6e973d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-562929383", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "f18dcfc7-f4b8-4413-b554-5a70abd5f6a5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-79789233", "security_groups": [{"name": "tempest-secgroup-smoke-1359055735"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:20:20.738559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=28 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:20:20.768100 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-208a76a7-ba87-45f9-b597-9c2b5c6e973d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] validate_networks() for [('f18dcfc7-f4b8-4413-b554-5a70abd5f6a5', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:20:21.856208 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-208a76a7-ba87-45f9-b597-9c2b5c6e973d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:20:21.857477 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-208a76a7-ba87-45f9-b597-9c2b5c6e973d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:20:21.858328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-208a76a7-ba87-45f9-b597-9c2b5c6e973d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:20:21.859763 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-208a76a7-ba87-45f9-b597-9c2b5c6e973d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:20:21.860364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-208a76a7-ba87-45f9-b597-9c2b5c6e973d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:20:21.875734 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-208a76a7-ba87-45f9-b597-9c2b5c6e973d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:21.880929 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-208a76a7-ba87-45f9-b597-9c2b5c6e973d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:21.881595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-208a76a7-ba87-45f9-b597-9c2b5c6e973d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:21.884406 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-208a76a7-ba87-45f9-b597-9c2b5c6e973d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:21.885392 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-208a76a7-ba87-45f9-b597-9c2b5c6e973d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:21.888579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-208a76a7-ba87-45f9-b597-9c2b5c6e973d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:21.942468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-208a76a7-ba87-45f9-b597-9c2b5c6e973d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Getting quotas for project 9c69a3e46122413f928fe20a76b0cf94. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:20:21.958944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-208a76a7-ba87-45f9-b597-9c2b5c6e973d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Getting quotas for user f27a58cf36934daeabff9e35c05d4c19 and project 9c69a3e46122413f928fe20a76b0cf94. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:20:22.011299 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-208a76a7-ba87-45f9-b597-9c2b5c6e973d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:20:22.016806 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-208a76a7-ba87-45f9-b597-9c2b5c6e973d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:20:22.244919 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-208a76a7-ba87-45f9-b597-9c2b5c6e973d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.710530 Aug 04 17:20:22.245587 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2752/5530] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:20:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:20:22.268405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aec13251-8ceb-4e0d-a48a-24c1d1eb3d38 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:22.269397 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aec13251-8ceb-4e0d-a48a-24c1d1eb3d38 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:22.284255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aec13251-8ceb-4e0d-a48a-24c1d1eb3d38 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:22.284916 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aec13251-8ceb-4e0d-a48a-24c1d1eb3d38 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:22.285488 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aec13251-8ceb-4e0d-a48a-24c1d1eb3d38 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:22.286349 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aec13251-8ceb-4e0d-a48a-24c1d1eb3d38 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:22.288356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aec13251-8ceb-4e0d-a48a-24c1d1eb3d38 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:22.288918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aec13251-8ceb-4e0d-a48a-24c1d1eb3d38 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:22.802044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-aec13251-8ceb-4e0d-a48a-24c1d1eb3d38 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:22.814989 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aec13251-8ceb-4e0d-a48a-24c1d1eb3d38 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1519 microversion: 2.1 time: 0.566567 Aug 04 17:20:22.816734 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2753/5531] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:22 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1519 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:22.835203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eba4d163-70ac-4ed7-8e57-c7e451769ccd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:22.838054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eba4d163-70ac-4ed7-8e57-c7e451769ccd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:23.092711 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eba4d163-70ac-4ed7-8e57-c7e451769ccd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:23.104931 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eba4d163-70ac-4ed7-8e57-c7e451769ccd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1264 microversion: 2.1 time: 0.280285 Aug 04 17:20:23.106314 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2754/5532] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:22 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1264 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:23.424577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-11f71835-d393-4a8f-84d5-edd2f9713c62 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:23.425091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-11f71835-d393-4a8f-84d5-edd2f9713c62 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 947ffe69-3080-4602-872d-1bb16591d34e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:23.435112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11f71835-d393-4a8f-84d5-edd2f9713c62 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:23.442877 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11f71835-d393-4a8f-84d5-edd2f9713c62 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:23.443633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11f71835-d393-4a8f-84d5-edd2f9713c62 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:23.445678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11f71835-d393-4a8f-84d5-edd2f9713c62 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:23.446641 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11f71835-d393-4a8f-84d5-edd2f9713c62 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:23.451050 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11f71835-d393-4a8f-84d5-edd2f9713c62 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:23.455899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-e5e634b9-b698-48d1-83c2-43dc0a66bcc7 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:20:23.456482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-e5e634b9-b698-48d1-83c2-43dc0a66bcc7 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:20:23.456815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-e5e634b9-b698-48d1-83c2-43dc0a66bcc7 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:20:23.457228 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-e5e634b9-b698-48d1-83c2-43dc0a66bcc7 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:20:23.457681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-e5e634b9-b698-48d1-83c2-43dc0a66bcc7 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:20:23.485408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e5e634b9-b698-48d1-83c2-43dc0a66bcc7 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:23.485889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e5e634b9-b698-48d1-83c2-43dc0a66bcc7 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:23.486406 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e5e634b9-b698-48d1-83c2-43dc0a66bcc7 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:23.487231 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e5e634b9-b698-48d1-83c2-43dc0a66bcc7 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:23.487728 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e5e634b9-b698-48d1-83c2-43dc0a66bcc7 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:23.488200 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e5e634b9-b698-48d1-83c2-43dc0a66bcc7 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:23.492804 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-11f71835-d393-4a8f-84d5-edd2f9713c62 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] HTTP exception thrown: Instance 947ffe69-3080-4602-872d-1bb16591d34e could not be found. Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-11f71835-d393-4a8f-84d5-edd2f9713c62 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Request method failure captured: Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e HTTP/1.1 Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_20IgjlzOhiiXNFc-NV1FHodxKmWXqSdjZ2I3CqIylUHNkhkG-JAGdMPdYL-8rZzM7v2_0KXVTorBGskuo6vUXRtOSVoO1KTIHw44-u5yCDnlwK7XKRi3uI2OBhda5ANtzdvy-06i9FyD27hM6LxpcHB7QNnHGthqSv2gOLnkKiVjg Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 80bc576163414daba5f5315c4a785533 Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/80bc576163414daba5f5315c4a785533"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/80bc576163414daba5f5315c4a785533"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_80bc576163414daba5f5315c4a785533"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/80bc576163414daba5f5315c4a785533"}]}] Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 80bc576163414daba5f5315c4a785533 Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-AttachVolumeNegativeTest-1565246319-project Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 5b10b58bf3df46d18bff092022b08e0f Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-AttachVolumeNegativeTest-1565246319-project Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 947ffe69-3080-4602-872d-1bb16591d34e could not be found. Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '947ffe69-3080-4602-872d-1bb16591d34e'} Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 947ffe69-3080-4602-872d-1bb16591d34e could not be found. Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:20:23.501865 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:20:23.509175 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 947ffe69-3080-4602-872d-1bb16591d34e could not be found. Aug 04 17:20:23.509175 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:23.509175 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:23.509175 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:23.509175 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:23.509175 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:23.509175 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:23.509175 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:20:23.509175 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:20:23.509175 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 947ffe69-3080-4602-872d-1bb16591d34e could not be found. Aug 04 17:20:23.509175 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:23.509175 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-11f71835-d393-4a8f-84d5-edd2f9713c62 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Returning 404 to user: Instance 947ffe69-3080-4602-872d-1bb16591d34e could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:20:23.509175 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-11f71835-d393-4a8f-84d5-edd2f9713c62 tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "DELETE /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e" status: 404 len: 111 microversion: 2.1 time: 0.084270 Aug 04 17:20:23.513795 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2755/5533] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:20:23 2022] DELETE /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:20:23.533176 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-04b15988-e054-4104-9f71-2eb4d4d8f34f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:23.536797 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-04b15988-e054-4104-9f71-2eb4d4d8f34f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] [instance: 947ffe69-3080-4602-872d-1bb16591d34e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:23.562660 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-e5e634b9-b698-48d1-83c2-43dc0a66bcc7 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Getting quotas for project 60a0b5a8d12f49ffbb7570bec11538f7. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:20:23.563695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04b15988-e054-4104-9f71-2eb4d4d8f34f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:23.568867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04b15988-e054-4104-9f71-2eb4d4d8f34f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:23.570453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04b15988-e054-4104-9f71-2eb4d4d8f34f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:23.570930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-e5e634b9-b698-48d1-83c2-43dc0a66bcc7 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Getting quotas for user 0ed7b7928cdb49659150b9e89d86e8c8 and project 60a0b5a8d12f49ffbb7570bec11538f7. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:20:23.572095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04b15988-e054-4104-9f71-2eb4d4d8f34f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:23.575470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04b15988-e054-4104-9f71-2eb4d4d8f34f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:23.575470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04b15988-e054-4104-9f71-2eb4d4d8f34f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:23.623475 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-04b15988-e054-4104-9f71-2eb4d4d8f34f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] HTTP exception thrown: Instance 947ffe69-3080-4602-872d-1bb16591d34e could not be found. Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-04b15988-e054-4104-9f71-2eb4d4d8f34f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Request method failure captured: Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e HTTP/1.1 Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_20IgjlzOhiiXNFc-NV1FHodxKmWXqSdjZ2I3CqIylUHNkhkG-JAGdMPdYL-8rZzM7v2_0KXVTorBGskuo6vUXRtOSVoO1KTIHw44-u5yCDnlwK7XKRi3uI2OBhda5ANtzdvy-06i9FyD27hM6LxpcHB7QNnHGthqSv2gOLnkKiVjg Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 80bc576163414daba5f5315c4a785533 Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/80bc576163414daba5f5315c4a785533"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/80bc576163414daba5f5315c4a785533"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_80bc576163414daba5f5315c4a785533"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/80bc576163414daba5f5315c4a785533"}]}] Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 80bc576163414daba5f5315c4a785533 Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1565246319 Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-AttachVolumeNegativeTest-1565246319-project Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 5b10b58bf3df46d18bff092022b08e0f Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-AttachVolumeNegativeTest-1565246319-project Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 947ffe69-3080-4602-872d-1bb16591d34e could not be found. Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '947ffe69-3080-4602-872d-1bb16591d34e'} Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 947ffe69-3080-4602-872d-1bb16591d34e could not be found. Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 947ffe69-3080-4602-872d-1bb16591d34e could not be found. Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:23.634938 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:23.646782 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:23.646782 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:23.646782 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:23.646782 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:20:23.646782 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:20:23.646782 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 947ffe69-3080-4602-872d-1bb16591d34e could not be found. Aug 04 17:20:23.646782 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:23.646782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-04b15988-e054-4104-9f71-2eb4d4d8f34f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] Returning 404 to user: Instance 947ffe69-3080-4602-872d-1bb16591d34e could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:20:23.646782 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-04b15988-e054-4104-9f71-2eb4d4d8f34f tempest-AttachVolumeNegativeTest-1565246319 tempest-AttachVolumeNegativeTest-1565246319-project] 10.222.0.93 "GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e" status: 404 len: 111 microversion: 2.1 time: 0.121662 Aug 04 17:20:23.646782 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2756/5534] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:23 2022] GET /compute/v2.1/servers/947ffe69-3080-4602-872d-1bb16591d34e => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:20:23.947780 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e5e634b9-b698-48d1-83c2-43dc0a66bcc7 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:20:23.951932 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e5e634b9-b698-48d1-83c2-43dc0a66bcc7 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='44e22b04-9a0a-492f-9a92-5c6731312115',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='c566acf7-612b-4318-8bc3-9ee73ab3ee15',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='71943056-7687-477d-9e3d-b196e7e1d49b',volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:20:24.010208 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-1197e859-a293-4d5f-9ba1-981fd1bf39c6 req-187099a0-70c9-4933-8919-232d5c5fce1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5248dcdc-5a16-4036-9537-eb84f73dc372", "name": "network-vif-plugged", "status": "completed", "tag": "620457fa-43b8-4d5c-9ed1-44c49f63239c"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:20:24.038904 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1197e859-a293-4d5f-9ba1-981fd1bf39c6 req-187099a0-70c9-4933-8919-232d5c5fce1a service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:24.041654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1197e859-a293-4d5f-9ba1-981fd1bf39c6 req-187099a0-70c9-4933-8919-232d5c5fce1a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:24.044984 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1197e859-a293-4d5f-9ba1-981fd1bf39c6 req-187099a0-70c9-4933-8919-232d5c5fce1a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:24.095516 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-1197e859-a293-4d5f-9ba1-981fd1bf39c6 req-187099a0-70c9-4933-8919-232d5c5fce1a service nova] Creating event network-vif-plugged:620457fa-43b8-4d5c-9ed1-44c49f63239c for instance 5248dcdc-5a16-4036-9537-eb84f73dc372 on n-h2-851359-3 Aug 04 17:20:24.107560 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-1197e859-a293-4d5f-9ba1-981fd1bf39c6 req-187099a0-70c9-4933-8919-232d5c5fce1a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.468597 Aug 04 17:20:24.109257 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2757/5535] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:20:24.138714 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5b74a791-1694-4ff3-b313-58a7d681a9cf tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:24.139516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5b74a791-1694-4ff3-b313-58a7d681a9cf tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:24.161624 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b74a791-1694-4ff3-b313-58a7d681a9cf tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:24.162200 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b74a791-1694-4ff3-b313-58a7d681a9cf tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:24.162652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b74a791-1694-4ff3-b313-58a7d681a9cf tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:24.163472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b74a791-1694-4ff3-b313-58a7d681a9cf tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:24.163998 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b74a791-1694-4ff3-b313-58a7d681a9cf tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:24.164486 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b74a791-1694-4ff3-b313-58a7d681a9cf tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:24.756593 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e5e634b9-b698-48d1-83c2-43dc0a66bcc7 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 11.958331 Aug 04 17:20:24.761364 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2779/5536] 10.222.0.93 () {62 vars in 1189 bytes} [Thu Aug 4 17:20:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 11964 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 17:20:24.779489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-66c4151b-d8f2-40b7-af7c-b0678f9f7f9f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:24.780170 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-66c4151b-d8f2-40b7-af7c-b0678f9f7f9f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:24.811168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66c4151b-d8f2-40b7-af7c-b0678f9f7f9f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:24.811700 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66c4151b-d8f2-40b7-af7c-b0678f9f7f9f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:24.812307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66c4151b-d8f2-40b7-af7c-b0678f9f7f9f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:24.813352 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66c4151b-d8f2-40b7-af7c-b0678f9f7f9f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:24.813840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66c4151b-d8f2-40b7-af7c-b0678f9f7f9f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:24.819441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66c4151b-d8f2-40b7-af7c-b0678f9f7f9f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:25.115472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-66c4151b-d8f2-40b7-af7c-b0678f9f7f9f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:25.137092 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-66c4151b-d8f2-40b7-af7c-b0678f9f7f9f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1316 microversion: 2.1 time: 0.374344 Aug 04 17:20:25.138896 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2780/5537] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:24 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1316 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:25.157672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4ec218a7-d79a-4499-b0ba-c245e06b1855 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:25.158597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4ec218a7-d79a-4499-b0ba-c245e06b1855 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:25.252075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5b74a791-1694-4ff3-b313-58a7d681a9cf tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:25.277920 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5b74a791-1694-4ff3-b313-58a7d681a9cf tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1519 microversion: 2.1 time: 1.167012 Aug 04 17:20:25.278972 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2758/5538] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:24 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1519 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:25.955895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4ec218a7-d79a-4499-b0ba-c245e06b1855 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:25.997442 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4ec218a7-d79a-4499-b0ba-c245e06b1855 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:25.999533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4ec218a7-d79a-4499-b0ba-c245e06b1855 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:26.001246 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4ec218a7-d79a-4499-b0ba-c245e06b1855 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1284 microversion: 2.42 time: 0.861452 Aug 04 17:20:26.012886 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2781/5539] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:20:25 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1284 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:20:26.186215 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a7625e0c-8e88-4bd4-8c62-260d74546668 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:26.188375 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a7625e0c-8e88-4bd4-8c62-260d74546668 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:26.199535 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7625e0c-8e88-4bd4-8c62-260d74546668 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:26.200041 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7625e0c-8e88-4bd4-8c62-260d74546668 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:26.200492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7625e0c-8e88-4bd4-8c62-260d74546668 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:26.201227 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7625e0c-8e88-4bd4-8c62-260d74546668 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:26.201697 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7625e0c-8e88-4bd4-8c62-260d74546668 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:26.202339 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7625e0c-8e88-4bd4-8c62-260d74546668 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:26.314716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-aa69ed6e-d88c-4b43-b14e-bdf60eed9ed3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:26.315455 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-aa69ed6e-d88c-4b43-b14e-bdf60eed9ed3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:26.342440 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa69ed6e-d88c-4b43-b14e-bdf60eed9ed3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:26.343851 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa69ed6e-d88c-4b43-b14e-bdf60eed9ed3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:26.345070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa69ed6e-d88c-4b43-b14e-bdf60eed9ed3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:26.347256 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa69ed6e-d88c-4b43-b14e-bdf60eed9ed3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:26.348043 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa69ed6e-d88c-4b43-b14e-bdf60eed9ed3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:26.348668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa69ed6e-d88c-4b43-b14e-bdf60eed9ed3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:26.392521 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a7625e0c-8e88-4bd4-8c62-260d74546668 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:26.413067 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a7625e0c-8e88-4bd4-8c62-260d74546668 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1322 microversion: 2.1 time: 0.234462 Aug 04 17:20:26.433317 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2759/5540] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:26 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:26.801587 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-aa69ed6e-d88c-4b43-b14e-bdf60eed9ed3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:26.828560 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-aa69ed6e-d88c-4b43-b14e-bdf60eed9ed3 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1519 microversion: 2.1 time: 0.520607 Aug 04 17:20:26.829347 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2782/5541] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:26 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1519 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:27.057801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-57a77de5-0666-4b93-acc5-68ce6d4a73da tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:27.058875 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-57a77de5-0666-4b93-acc5-68ce6d4a73da tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:27.074797 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57a77de5-0666-4b93-acc5-68ce6d4a73da tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:27.075633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57a77de5-0666-4b93-acc5-68ce6d4a73da tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:27.076386 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57a77de5-0666-4b93-acc5-68ce6d4a73da tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:27.077624 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57a77de5-0666-4b93-acc5-68ce6d4a73da tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:27.083143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57a77de5-0666-4b93-acc5-68ce6d4a73da tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:27.086455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57a77de5-0666-4b93-acc5-68ce6d4a73da tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:27.240850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-57a77de5-0666-4b93-acc5-68ce6d4a73da tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:27.261295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-57a77de5-0666-4b93-acc5-68ce6d4a73da tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:27.265716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-57a77de5-0666-4b93-acc5-68ce6d4a73da tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:27.267730 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-57a77de5-0666-4b93-acc5-68ce6d4a73da tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1518 microversion: 2.42 time: 0.216878 Aug 04 17:20:27.269286 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2760/5542] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:20:27 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1518 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:20:27.451921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-31eb29c5-4fde-4e06-b629-786852e6b5b5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:27.454387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-31eb29c5-4fde-4e06-b629-786852e6b5b5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:27.476964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31eb29c5-4fde-4e06-b629-786852e6b5b5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:27.479937 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31eb29c5-4fde-4e06-b629-786852e6b5b5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:27.481892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31eb29c5-4fde-4e06-b629-786852e6b5b5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:27.488939 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31eb29c5-4fde-4e06-b629-786852e6b5b5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:27.491224 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31eb29c5-4fde-4e06-b629-786852e6b5b5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:27.492232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31eb29c5-4fde-4e06-b629-786852e6b5b5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:27.726229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-31eb29c5-4fde-4e06-b629-786852e6b5b5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:27.736621 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-31eb29c5-4fde-4e06-b629-786852e6b5b5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1322 microversion: 2.1 time: 0.292201 Aug 04 17:20:27.737419 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2783/5543] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:27 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1322 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:27.868015 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-62a17eb2-6a4a-4c75-99df-48825d42311a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:27.871384 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-62a17eb2-6a4a-4c75-99df-48825d42311a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:27.906510 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62a17eb2-6a4a-4c75-99df-48825d42311a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:27.907472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62a17eb2-6a4a-4c75-99df-48825d42311a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:27.908884 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62a17eb2-6a4a-4c75-99df-48825d42311a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:27.909536 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62a17eb2-6a4a-4c75-99df-48825d42311a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:27.910353 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62a17eb2-6a4a-4c75-99df-48825d42311a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:27.910994 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62a17eb2-6a4a-4c75-99df-48825d42311a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:28.311722 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-59e9f4c5-d2d5-4d8a-8494-0f6a6aa45aaa tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:28.314248 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-59e9f4c5-d2d5-4d8a-8494-0f6a6aa45aaa tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:28.337862 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59e9f4c5-d2d5-4d8a-8494-0f6a6aa45aaa tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:28.338480 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59e9f4c5-d2d5-4d8a-8494-0f6a6aa45aaa tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:28.338934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59e9f4c5-d2d5-4d8a-8494-0f6a6aa45aaa tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:28.339841 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59e9f4c5-d2d5-4d8a-8494-0f6a6aa45aaa tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:28.340392 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59e9f4c5-d2d5-4d8a-8494-0f6a6aa45aaa tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:28.345500 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59e9f4c5-d2d5-4d8a-8494-0f6a6aa45aaa tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:28.546096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-59e9f4c5-d2d5-4d8a-8494-0f6a6aa45aaa tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:28.575997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-59e9f4c5-d2d5-4d8a-8494-0f6a6aa45aaa tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:28.582202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-59e9f4c5-d2d5-4d8a-8494-0f6a6aa45aaa tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:28.587530 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-59e9f4c5-d2d5-4d8a-8494-0f6a6aa45aaa tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1592 microversion: 2.42 time: 0.281394 Aug 04 17:20:28.589092 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2784/5544] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:20:28 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1592 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:20:28.759354 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1cfbc724-0797-44e8-924f-77e438752f50 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:28.760019 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1cfbc724-0797-44e8-924f-77e438752f50 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:28.780225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1cfbc724-0797-44e8-924f-77e438752f50 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:28.781618 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1cfbc724-0797-44e8-924f-77e438752f50 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:28.783699 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1cfbc724-0797-44e8-924f-77e438752f50 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:28.785957 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1cfbc724-0797-44e8-924f-77e438752f50 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:28.788986 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1cfbc724-0797-44e8-924f-77e438752f50 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:28.791217 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1cfbc724-0797-44e8-924f-77e438752f50 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:28.930033 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-62a17eb2-6a4a-4c75-99df-48825d42311a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:28.967545 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-62a17eb2-6a4a-4c75-99df-48825d42311a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1519 microversion: 2.1 time: 1.105814 Aug 04 17:20:28.972568 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2761/5545] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:27 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1519 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:20:29.297493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1cfbc724-0797-44e8-924f-77e438752f50 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:29.305760 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1cfbc724-0797-44e8-924f-77e438752f50 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1390 microversion: 2.1 time: 0.551376 Aug 04 17:20:29.306587 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2785/5546] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:28 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1390 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:20:29.629138 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-27a2529c-4a67-426f-a03e-f3f77a882b3c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:29.630500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-27a2529c-4a67-426f-a03e-f3f77a882b3c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:29.643417 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:20:29.652079 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27a2529c-4a67-426f-a03e-f3f77a882b3c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:29.653014 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27a2529c-4a67-426f-a03e-f3f77a882b3c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:29.653686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27a2529c-4a67-426f-a03e-f3f77a882b3c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:29.654700 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27a2529c-4a67-426f-a03e-f3f77a882b3c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:29.655440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27a2529c-4a67-426f-a03e-f3f77a882b3c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:29.656634 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27a2529c-4a67-426f-a03e-f3f77a882b3c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:30.009777 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6de46446-b32e-411e-9c05-5ccc11364d13 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:30.011180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6de46446-b32e-411e-9c05-5ccc11364d13 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:30.019240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6de46446-b32e-411e-9c05-5ccc11364d13 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:30.020138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6de46446-b32e-411e-9c05-5ccc11364d13 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:30.020828 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6de46446-b32e-411e-9c05-5ccc11364d13 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:30.021802 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6de46446-b32e-411e-9c05-5ccc11364d13 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:30.022528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6de46446-b32e-411e-9c05-5ccc11364d13 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:30.023195 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6de46446-b32e-411e-9c05-5ccc11364d13 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:30.031259 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-27a2529c-4a67-426f-a03e-f3f77a882b3c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:30.048853 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-27a2529c-4a67-426f-a03e-f3f77a882b3c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:30.050459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-27a2529c-4a67-426f-a03e-f3f77a882b3c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:30.051653 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-27a2529c-4a67-426f-a03e-f3f77a882b3c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1592 microversion: 2.42 time: 0.436635 Aug 04 17:20:30.052238 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2762/5547] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:20:29 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1592 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:20:30.329450 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3101179d-f66d-4e5c-b977-081313995ff8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:30.330114 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3101179d-f66d-4e5c-b977-081313995ff8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:30.350401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3101179d-f66d-4e5c-b977-081313995ff8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:30.351335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3101179d-f66d-4e5c-b977-081313995ff8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:30.352822 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3101179d-f66d-4e5c-b977-081313995ff8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:30.355288 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3101179d-f66d-4e5c-b977-081313995ff8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:30.356170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3101179d-f66d-4e5c-b977-081313995ff8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:30.358583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3101179d-f66d-4e5c-b977-081313995ff8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:30.443246 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6de46446-b32e-411e-9c05-5ccc11364d13 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:30.472917 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6de46446-b32e-411e-9c05-5ccc11364d13 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.466976 Aug 04 17:20:30.474664 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2786/5548] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:30 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:20:30.517266 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-61037273-22f1-4a5b-ab8c-bc96b445f4cd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:30.518470 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-61037273-22f1-4a5b-ab8c-bc96b445f4cd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:30.530992 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61037273-22f1-4a5b-ab8c-bc96b445f4cd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:30.532788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61037273-22f1-4a5b-ab8c-bc96b445f4cd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:30.533855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61037273-22f1-4a5b-ab8c-bc96b445f4cd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:30.535845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61037273-22f1-4a5b-ab8c-bc96b445f4cd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:30.537050 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61037273-22f1-4a5b-ab8c-bc96b445f4cd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:30.538686 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61037273-22f1-4a5b-ab8c-bc96b445f4cd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:31.004787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3101179d-f66d-4e5c-b977-081313995ff8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:31.021757 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3101179d-f66d-4e5c-b977-081313995ff8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1390 microversion: 2.1 time: 0.696729 Aug 04 17:20:31.024372 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2763/5549] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:30 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1390 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:20:31.083815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4e508ed5-8ed2-4bb2-a8c8-79121a273473 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:31.087689 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4e508ed5-8ed2-4bb2-a8c8-79121a273473 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:31.095076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-61037273-22f1-4a5b-ab8c-bc96b445f4cd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:31.117533 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-61037273-22f1-4a5b-ab8c-bc96b445f4cd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.613386 Aug 04 17:20:31.121194 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2787/5550] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:30 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:31.124690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e508ed5-8ed2-4bb2-a8c8-79121a273473 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:31.125602 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e508ed5-8ed2-4bb2-a8c8-79121a273473 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:31.126335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e508ed5-8ed2-4bb2-a8c8-79121a273473 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:31.127686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e508ed5-8ed2-4bb2-a8c8-79121a273473 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:31.128378 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e508ed5-8ed2-4bb2-a8c8-79121a273473 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:31.128995 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e508ed5-8ed2-4bb2-a8c8-79121a273473 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:31.165525 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f7999a96-a8e2-43c0-9e71-74a5753d584a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:31.166566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f7999a96-a8e2-43c0-9e71-74a5753d584a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:31.175596 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7999a96-a8e2-43c0-9e71-74a5753d584a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:31.176386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7999a96-a8e2-43c0-9e71-74a5753d584a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:31.177870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7999a96-a8e2-43c0-9e71-74a5753d584a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:31.178875 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7999a96-a8e2-43c0-9e71-74a5753d584a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:31.179513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7999a96-a8e2-43c0-9e71-74a5753d584a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:31.180115 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7999a96-a8e2-43c0-9e71-74a5753d584a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:31.264373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4e508ed5-8ed2-4bb2-a8c8-79121a273473 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:31.275539 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4e508ed5-8ed2-4bb2-a8c8-79121a273473 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:31.277409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4e508ed5-8ed2-4bb2-a8c8-79121a273473 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:31.278934 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4e508ed5-8ed2-4bb2-a8c8-79121a273473 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1592 microversion: 2.42 time: 0.200801 Aug 04 17:20:31.280192 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2764/5551] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:20:31 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1592 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:20:31.553220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f7999a96-a8e2-43c0-9e71-74a5753d584a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:31.571299 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f7999a96-a8e2-43c0-9e71-74a5753d584a tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.412354 Aug 04 17:20:31.572814 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2788/5552] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:31 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:20:31.593515 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-1875543d-de85-471c-b540-c83dd148ea6c req-f08175f9-8355-4f84-a4de-c28dc9d1be33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "596804f9-9964-419e-bed5-d24e20805b57", "tag": "51b8ad4a-9d13-46c2-a8d0-1daea7b6bced"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:20:31.596417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2a6f3dfd-f3bb-45c2-9170-6c09418adf47 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:20:31.613288 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-2a6f3dfd-f3bb-45c2-9170-6c09418adf47 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Instance b8ff4b8b-b67f-4de7-b278-165e634a8e1a has no mapping to a cell. Aug 04 17:20:31.616208 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1875543d-de85-471c-b540-c83dd148ea6c req-f08175f9-8355-4f84-a4de-c28dc9d1be33 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:31.616772 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1875543d-de85-471c-b540-c83dd148ea6c req-f08175f9-8355-4f84-a4de-c28dc9d1be33 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:31.617209 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1875543d-de85-471c-b540-c83dd148ea6c req-f08175f9-8355-4f84-a4de-c28dc9d1be33 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2a6f3dfd-f3bb-45c2-9170-6c09418adf47 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers/b8ff4b8b-b67f-4de7-b278-165e634a8e1a/action HTTP/1.1 Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 15 Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: {"os-stop": {}} Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance b8ff4b8b-b67f-4de7-b278-165e634a8e1a has no mapping to a cell. Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'b8ff4b8b-b67f-4de7-b278-165e634a8e1a', 'body': {'os-stop': {}}} Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance b8ff4b8b-b67f-4de7-b278-165e634a8e1a has no mapping to a cell. Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:20:31.629640 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8ff4b8b-b67f-4de7-b278-165e634a8e1a has no mapping to a cell. Aug 04 17:20:31.634874 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:31.634874 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:31.634874 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:31.634874 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:31.634874 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:31.634874 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:31.634874 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:20:31.634874 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:20:31.634874 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8ff4b8b-b67f-4de7-b278-165e634a8e1a has no mapping to a cell. Aug 04 17:20:31.634874 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:31.641818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2a6f3dfd-f3bb-45c2-9170-6c09418adf47 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 404 to user: Instance b8ff4b8b-b67f-4de7-b278-165e634a8e1a has no mapping to a cell. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:20:31.644281 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2a6f3dfd-f3bb-45c2-9170-6c09418adf47 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers/b8ff4b8b-b67f-4de7-b278-165e634a8e1a/action" status: 404 len: 117 microversion: 2.1 time: 0.051552 Aug 04 17:20:31.645240 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2789/5553] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:20:31 2022] POST /compute/v2.1/servers/b8ff4b8b-b67f-4de7-b278-165e634a8e1a/action => generated 117 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:20:31.662401 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-97a437ac-479c-4921-82eb-8f146780886b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:31.665824 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-97a437ac-479c-4921-82eb-8f146780886b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:31.694105 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-97a437ac-479c-4921-82eb-8f146780886b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:31.698121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-97a437ac-479c-4921-82eb-8f146780886b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:31.699929 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-97a437ac-479c-4921-82eb-8f146780886b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:31.701262 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-97a437ac-479c-4921-82eb-8f146780886b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:31.702923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-97a437ac-479c-4921-82eb-8f146780886b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:31.703685 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-97a437ac-479c-4921-82eb-8f146780886b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:31.717425 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-1875543d-de85-471c-b540-c83dd148ea6c req-f08175f9-8355-4f84-a4de-c28dc9d1be33 service nova] Creating event network-changed:51b8ad4a-9d13-46c2-a8d0-1daea7b6bced for instance 596804f9-9964-419e-bed5-d24e20805b57 on n-h1-851359-3 Aug 04 17:20:31.728076 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-1875543d-de85-471c-b540-c83dd148ea6c req-f08175f9-8355-4f84-a4de-c28dc9d1be33 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138654 Aug 04 17:20:31.729617 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2765/5554] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:20:32.039997 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:20:32.046969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f534b8b6-124d-4340-b6fe-b17dbb9ac57a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:32.048003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f534b8b6-124d-4340-b6fe-b17dbb9ac57a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:32.070416 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f534b8b6-124d-4340-b6fe-b17dbb9ac57a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:32.073953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f534b8b6-124d-4340-b6fe-b17dbb9ac57a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:32.076792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f534b8b6-124d-4340-b6fe-b17dbb9ac57a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:32.079608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f534b8b6-124d-4340-b6fe-b17dbb9ac57a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:32.081473 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f534b8b6-124d-4340-b6fe-b17dbb9ac57a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:32.083197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f534b8b6-124d-4340-b6fe-b17dbb9ac57a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:33.099109 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=8 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:20:33.435752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-97a437ac-479c-4921-82eb-8f146780886b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:33.450382 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-97a437ac-479c-4921-82eb-8f146780886b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 1.794450 Aug 04 17:20:33.451356 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2790/5555] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:31 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:33.486921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-954b1f0c-1f07-417c-b914-d0af035f948b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:33.488523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-954b1f0c-1f07-417c-b914-d0af035f948b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:33.501177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-954b1f0c-1f07-417c-b914-d0af035f948b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:33.502101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-954b1f0c-1f07-417c-b914-d0af035f948b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:33.502269 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-954b1f0c-1f07-417c-b914-d0af035f948b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:33.502872 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-954b1f0c-1f07-417c-b914-d0af035f948b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:33.503341 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-954b1f0c-1f07-417c-b914-d0af035f948b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:33.503782 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-954b1f0c-1f07-417c-b914-d0af035f948b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:33.539273 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:20:33.607981 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f534b8b6-124d-4340-b6fe-b17dbb9ac57a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:33.629550 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f534b8b6-124d-4340-b6fe-b17dbb9ac57a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1390 microversion: 2.1 time: 1.590383 Aug 04 17:20:33.630474 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2766/5556] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:32 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1390 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:33.635847 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fdb3a3a9-8bac-4ac3-8b72-d3e2d1591882 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:33.636750 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fdb3a3a9-8bac-4ac3-8b72-d3e2d1591882 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:33.650190 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdb3a3a9-8bac-4ac3-8b72-d3e2d1591882 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:33.654881 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdb3a3a9-8bac-4ac3-8b72-d3e2d1591882 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:33.656010 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdb3a3a9-8bac-4ac3-8b72-d3e2d1591882 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:33.656999 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdb3a3a9-8bac-4ac3-8b72-d3e2d1591882 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:33.657677 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdb3a3a9-8bac-4ac3-8b72-d3e2d1591882 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:33.658378 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdb3a3a9-8bac-4ac3-8b72-d3e2d1591882 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:33.710703 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:20:34.199297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fdb3a3a9-8bac-4ac3-8b72-d3e2d1591882 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:34.210670 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fdb3a3a9-8bac-4ac3-8b72-d3e2d1591882 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.578809 Aug 04 17:20:34.226728 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2767/5557] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:33 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:34.243600 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-50924ac0-0f7e-48bb-b130-f60a23e3e072 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:20:34.244452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-50924ac0-0f7e-48bb-b130-f60a23e3e072 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 3f367e4d-d003-47d9-b456-1d7f6288a0fb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:34.263748 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-50924ac0-0f7e-48bb-b130-f60a23e3e072 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Instance 3f367e4d-d003-47d9-b456-1d7f6288a0fb could not be found. Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-50924ac0-0f7e-48bb-b130-f60a23e3e072 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/3f367e4d-d003-47d9-b456-1d7f6288a0fb/action HTTP/1.1 Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 15 Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: {"suspend": {}} Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 3f367e4d-d003-47d9-b456-1d7f6288a0fb could not be found. Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '3f367e4d-d003-47d9-b456-1d7f6288a0fb', 'body': {'suspend': {}}} Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f367e4d-d003-47d9-b456-1d7f6288a0fb could not be found. Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f367e4d-d003-47d9-b456-1d7f6288a0fb could not be found. Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:34.266508 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:34.271166 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:20:34.271166 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:20:34.271166 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f367e4d-d003-47d9-b456-1d7f6288a0fb could not be found. Aug 04 17:20:34.271166 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:34.272948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-50924ac0-0f7e-48bb-b130-f60a23e3e072 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 404 to user: Instance 3f367e4d-d003-47d9-b456-1d7f6288a0fb could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:20:34.273843 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-50924ac0-0f7e-48bb-b130-f60a23e3e072 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers/3f367e4d-d003-47d9-b456-1d7f6288a0fb/action" status: 404 len: 111 microversion: 2.1 time: 0.044479 Aug 04 17:20:34.274484 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2768/5558] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:20:34 2022] POST /compute/v2.1/servers/3f367e4d-d003-47d9-b456-1d7f6288a0fb/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:20:34.283555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-51189c67-5f56-4461-93a9-fc44db54e6a0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:34.295123 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-51189c67-5f56-4461-93a9-fc44db54e6a0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:34.302881 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51189c67-5f56-4461-93a9-fc44db54e6a0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:34.303640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51189c67-5f56-4461-93a9-fc44db54e6a0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:34.304315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51189c67-5f56-4461-93a9-fc44db54e6a0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:34.310464 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51189c67-5f56-4461-93a9-fc44db54e6a0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:34.311190 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51189c67-5f56-4461-93a9-fc44db54e6a0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:34.311877 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51189c67-5f56-4461-93a9-fc44db54e6a0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:34.456510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-954b1f0c-1f07-417c-b914-d0af035f948b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:34.470806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-954b1f0c-1f07-417c-b914-d0af035f948b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:34.475430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-954b1f0c-1f07-417c-b914-d0af035f948b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:34.476651 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-954b1f0c-1f07-417c-b914-d0af035f948b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1659 microversion: 2.42 time: 1.008330 Aug 04 17:20:34.498537 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2791/5559] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:20:33 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1659 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:20:34.662845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-129174bc-31f4-452a-97ea-12a5d9b45637 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:34.663472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-129174bc-31f4-452a-97ea-12a5d9b45637 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:34.673611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-129174bc-31f4-452a-97ea-12a5d9b45637 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:34.681380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-129174bc-31f4-452a-97ea-12a5d9b45637 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:34.682515 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-129174bc-31f4-452a-97ea-12a5d9b45637 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:34.683473 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-129174bc-31f4-452a-97ea-12a5d9b45637 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:34.684867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-129174bc-31f4-452a-97ea-12a5d9b45637 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:34.686465 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-129174bc-31f4-452a-97ea-12a5d9b45637 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:34.953274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-51189c67-5f56-4461-93a9-fc44db54e6a0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:34.979129 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-51189c67-5f56-4461-93a9-fc44db54e6a0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.699892 Aug 04 17:20:35.027222 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2769/5560] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:34 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:20:35.068285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-95d2012f-0990-481e-b8f2-5bfa0e9ab349 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:35.070468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-95d2012f-0990-481e-b8f2-5bfa0e9ab349 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:35.085493 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95d2012f-0990-481e-b8f2-5bfa0e9ab349 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:35.086784 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95d2012f-0990-481e-b8f2-5bfa0e9ab349 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:35.087800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95d2012f-0990-481e-b8f2-5bfa0e9ab349 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:35.089960 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95d2012f-0990-481e-b8f2-5bfa0e9ab349 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:35.091122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95d2012f-0990-481e-b8f2-5bfa0e9ab349 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:35.092101 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95d2012f-0990-481e-b8f2-5bfa0e9ab349 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:35.215249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-129174bc-31f4-452a-97ea-12a5d9b45637 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:35.247759 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-129174bc-31f4-452a-97ea-12a5d9b45637 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1390 microversion: 2.1 time: 0.585269 Aug 04 17:20:35.263484 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2792/5561] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:34 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1390 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:20:35.504790 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-15647bc2-00c0-4c01-afc1-a880565e57c3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:35.506294 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-15647bc2-00c0-4c01-afc1-a880565e57c3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:35.527470 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-15647bc2-00c0-4c01-afc1-a880565e57c3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:35.528007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-15647bc2-00c0-4c01-afc1-a880565e57c3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:35.531292 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-15647bc2-00c0-4c01-afc1-a880565e57c3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:35.532088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-15647bc2-00c0-4c01-afc1-a880565e57c3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:35.532571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-15647bc2-00c0-4c01-afc1-a880565e57c3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:35.536764 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-15647bc2-00c0-4c01-afc1-a880565e57c3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:35.657290 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-95d2012f-0990-481e-b8f2-5bfa0e9ab349 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:35.679744 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-95d2012f-0990-481e-b8f2-5bfa0e9ab349 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.650219 Aug 04 17:20:35.712161 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2770/5562] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:35 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:35.741840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3ec8a06e-d227-40c5-a88d-72c952fd62e0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:20:35.743578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3ec8a06e-d227-40c5-a88d-72c952fd62e0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:35.760798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ec8a06e-d227-40c5-a88d-72c952fd62e0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:35.762007 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ec8a06e-d227-40c5-a88d-72c952fd62e0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:35.763688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ec8a06e-d227-40c5-a88d-72c952fd62e0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:35.765275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ec8a06e-d227-40c5-a88d-72c952fd62e0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:35.766359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ec8a06e-d227-40c5-a88d-72c952fd62e0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:35.767326 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ec8a06e-d227-40c5-a88d-72c952fd62e0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:35.883699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-3ec8a06e-d227-40c5-a88d-72c952fd62e0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lazy-loading 'flavor' on Instance uuid 5248dcdc-5a16-4036-9537-eb84f73dc372 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:20:35.972217 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=8 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:20:36.251706 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3ec8a06e-d227-40c5-a88d-72c952fd62e0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372/action" status: 202 len: 0 microversion: 2.1 time: 0.493368 Aug 04 17:20:36.253476 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2771/5563] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:20:35 2022] POST /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372/action => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:20:36.282246 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fb73b091-c0c0-49bf-8b05-32902272203d tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:36.284171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fb73b091-c0c0-49bf-8b05-32902272203d tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:36.292265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb73b091-c0c0-49bf-8b05-32902272203d tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:36.293049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb73b091-c0c0-49bf-8b05-32902272203d tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:36.293527 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb73b091-c0c0-49bf-8b05-32902272203d tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:36.294468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb73b091-c0c0-49bf-8b05-32902272203d tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:36.294952 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb73b091-c0c0-49bf-8b05-32902272203d tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:36.295393 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb73b091-c0c0-49bf-8b05-32902272203d tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:36.696639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-15647bc2-00c0-4c01-afc1-a880565e57c3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:36.716763 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-15647bc2-00c0-4c01-afc1-a880565e57c3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:36.728631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-15647bc2-00c0-4c01-afc1-a880565e57c3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:36.730889 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-15647bc2-00c0-4c01-afc1-a880565e57c3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1705 microversion: 2.42 time: 1.233319 Aug 04 17:20:36.735533 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2793/5564] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:20:35 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1705 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:20:36.755021 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2f6bdb3d-ffcd-455c-80e6-cfa1e75b1432 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:36.757783 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2f6bdb3d-ffcd-455c-80e6-cfa1e75b1432 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:36.780990 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f6bdb3d-ffcd-455c-80e6-cfa1e75b1432 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:36.788998 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f6bdb3d-ffcd-455c-80e6-cfa1e75b1432 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:36.789874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f6bdb3d-ffcd-455c-80e6-cfa1e75b1432 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:36.791408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f6bdb3d-ffcd-455c-80e6-cfa1e75b1432 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:36.802119 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f6bdb3d-ffcd-455c-80e6-cfa1e75b1432 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:36.803031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f6bdb3d-ffcd-455c-80e6-cfa1e75b1432 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:37.131831 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fb73b091-c0c0-49bf-8b05-32902272203d tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:37.147453 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fb73b091-c0c0-49bf-8b05-32902272203d tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1514 microversion: 2.1 time: 0.885998 Aug 04 17:20:37.148074 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2772/5565] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:36 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1514 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:37.759085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a13e402d-dfb4-428b-8df9-2fb3ac3d24e8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:37.760034 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a13e402d-dfb4-428b-8df9-2fb3ac3d24e8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:37.779791 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a13e402d-dfb4-428b-8df9-2fb3ac3d24e8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:37.782172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a13e402d-dfb4-428b-8df9-2fb3ac3d24e8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:37.783109 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a13e402d-dfb4-428b-8df9-2fb3ac3d24e8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:37.787631 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a13e402d-dfb4-428b-8df9-2fb3ac3d24e8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:37.790028 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a13e402d-dfb4-428b-8df9-2fb3ac3d24e8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:37.790871 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a13e402d-dfb4-428b-8df9-2fb3ac3d24e8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:38.144849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2f6bdb3d-ffcd-455c-80e6-cfa1e75b1432 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:38.153764 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2f6bdb3d-ffcd-455c-80e6-cfa1e75b1432 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1390 microversion: 2.1 time: 1.414657 Aug 04 17:20:38.160079 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2794/5566] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:36 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1390 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:38.182589 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5984d6ba-5dbc-42e4-b30e-0a2184aa38b4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:38.183924 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5984d6ba-5dbc-42e4-b30e-0a2184aa38b4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:38.209876 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5984d6ba-5dbc-42e4-b30e-0a2184aa38b4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:38.214893 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5984d6ba-5dbc-42e4-b30e-0a2184aa38b4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:38.216935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5984d6ba-5dbc-42e4-b30e-0a2184aa38b4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:38.219690 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5984d6ba-5dbc-42e4-b30e-0a2184aa38b4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:38.225510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5984d6ba-5dbc-42e4-b30e-0a2184aa38b4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:38.228356 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5984d6ba-5dbc-42e4-b30e-0a2184aa38b4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:38.705464 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a13e402d-dfb4-428b-8df9-2fb3ac3d24e8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:38.717790 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a13e402d-dfb4-428b-8df9-2fb3ac3d24e8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:38.723786 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a13e402d-dfb4-428b-8df9-2fb3ac3d24e8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:38.730961 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a13e402d-dfb4-428b-8df9-2fb3ac3d24e8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1705 microversion: 2.42 time: 0.975857 Aug 04 17:20:38.731987 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2773/5567] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:20:37 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1705 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:20:39.023906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5984d6ba-5dbc-42e4-b30e-0a2184aa38b4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:39.064039 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5984d6ba-5dbc-42e4-b30e-0a2184aa38b4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1497 microversion: 2.1 time: 0.886727 Aug 04 17:20:39.066221 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2795/5568] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:38 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1497 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:20:39.100942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b9a52fc8-68fa-4b99-a34e-ce1c92b9e06b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:20:39.105275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b9a52fc8-68fa-4b99-a34e-ce1c92b9e06b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:39.146967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9a52fc8-68fa-4b99-a34e-ce1c92b9e06b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:39.147989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9a52fc8-68fa-4b99-a34e-ce1c92b9e06b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:39.148720 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9a52fc8-68fa-4b99-a34e-ce1c92b9e06b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:39.150062 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9a52fc8-68fa-4b99-a34e-ce1c92b9e06b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:39.155470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9a52fc8-68fa-4b99-a34e-ce1c92b9e06b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:39.156952 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9a52fc8-68fa-4b99-a34e-ce1c92b9e06b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:39.190640 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-79996e25-dd88-42d1-a785-93f34a60a27d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:39.197188 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-79996e25-dd88-42d1-a785-93f34a60a27d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:39.199564 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-b9a52fc8-68fa-4b99-a34e-ce1c92b9e06b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lazy-loading 'flavor' on Instance uuid 5248dcdc-5a16-4036-9537-eb84f73dc372 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:20:39.222223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79996e25-dd88-42d1-a785-93f34a60a27d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:39.222751 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79996e25-dd88-42d1-a785-93f34a60a27d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:39.223199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79996e25-dd88-42d1-a785-93f34a60a27d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:39.228358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79996e25-dd88-42d1-a785-93f34a60a27d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:39.229186 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79996e25-dd88-42d1-a785-93f34a60a27d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:39.229668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79996e25-dd88-42d1-a785-93f34a60a27d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:39.238645 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-b9a52fc8-68fa-4b99-a34e-ce1c92b9e06b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Cannot 'suspend' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state suspended Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b9a52fc8-68fa-4b99-a34e-ce1c92b9e06b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372/action HTTP/1.1 Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 15 Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: {"suspend": {}} Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: exception: Cannot 'suspend' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state suspended Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '5248dcdc-5a16-4036-9537-eb84f73dc372', 'body': {'suspend': {}}} Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5248dcdc-5a16-4036-9537-eb84f73dc372 in vm_state suspended. Cannot suspend while the instance is in this state. Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 04 17:20:39.240493 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 17:20:39.250695 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 17:20:39.250695 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 17:20:39.250695 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state suspended Aug 04 17:20:39.250695 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:39.250695 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:39.250695 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:39.250695 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:39.250695 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:39.250695 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:39.250695 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:20:39.250695 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:20:39.250695 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state suspended Aug 04 17:20:39.250695 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:39.250695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b9a52fc8-68fa-4b99-a34e-ce1c92b9e06b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 409 to user: Cannot 'suspend' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state suspended {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:20:39.250695 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b9a52fc8-68fa-4b99-a34e-ce1c92b9e06b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372/action" status: 409 len: 148 microversion: 2.1 time: 0.152907 Aug 04 17:20:39.250695 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2774/5569] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:20:39 2022] POST /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372/action => generated 148 bytes in 158 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 04 17:20:39.254544 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cb4c09cc-482b-4df7-be51-e610cc429c26 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:20:39.255295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cb4c09cc-482b-4df7-be51-e610cc429c26 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:39.264209 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb4c09cc-482b-4df7-be51-e610cc429c26 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:39.265649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb4c09cc-482b-4df7-be51-e610cc429c26 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:39.266355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb4c09cc-482b-4df7-be51-e610cc429c26 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:39.267332 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb4c09cc-482b-4df7-be51-e610cc429c26 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:39.268222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb4c09cc-482b-4df7-be51-e610cc429c26 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:39.268838 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb4c09cc-482b-4df7-be51-e610cc429c26 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:39.470656 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cb4c09cc-482b-4df7-be51-e610cc429c26 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372/action" status: 202 len: 0 microversion: 2.1 time: 0.221572 Aug 04 17:20:39.480060 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2775/5570] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:20:39 2022] POST /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:20:39.498229 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cf2b77ac-4395-4b0d-8058-e00c95a2e362 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:39.503548 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cf2b77ac-4395-4b0d-8058-e00c95a2e362 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:39.542663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf2b77ac-4395-4b0d-8058-e00c95a2e362 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:39.543275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf2b77ac-4395-4b0d-8058-e00c95a2e362 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:39.543863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf2b77ac-4395-4b0d-8058-e00c95a2e362 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:39.544629 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf2b77ac-4395-4b0d-8058-e00c95a2e362 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:39.545092 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf2b77ac-4395-4b0d-8058-e00c95a2e362 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:39.546178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf2b77ac-4395-4b0d-8058-e00c95a2e362 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:40.180342 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-79996e25-dd88-42d1-a785-93f34a60a27d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:40.189072 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-79996e25-dd88-42d1-a785-93f34a60a27d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1390 microversion: 2.1 time: 1.008137 Aug 04 17:20:40.194775 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2796/5571] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:39 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1390 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:40.200744 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-22a8b3fd-4912-4ea0-b5d1-d98effffbdb1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:40.210556 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-22a8b3fd-4912-4ea0-b5d1-d98effffbdb1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:40.213272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:20:40.226198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-22a8b3fd-4912-4ea0-b5d1-d98effffbdb1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:40.226710 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-22a8b3fd-4912-4ea0-b5d1-d98effffbdb1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:40.227158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-22a8b3fd-4912-4ea0-b5d1-d98effffbdb1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:40.227889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-22a8b3fd-4912-4ea0-b5d1-d98effffbdb1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:40.235857 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-22a8b3fd-4912-4ea0-b5d1-d98effffbdb1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:40.236331 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-22a8b3fd-4912-4ea0-b5d1-d98effffbdb1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:40.280603 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cf2b77ac-4395-4b0d-8058-e00c95a2e362 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:40.301383 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cf2b77ac-4395-4b0d-8058-e00c95a2e362 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1503 microversion: 2.1 time: 0.819785 Aug 04 17:20:40.321242 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2776/5572] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:39 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1503 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:40.337671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-e8fb41f9-dc89-411d-800b-6823b6be4e77 req-7b3cba8e-c124-46dc-b92f-4524403ea678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "596804f9-9964-419e-bed5-d24e20805b57", "name": "network-vif-plugged", "status": "completed", "tag": "51b8ad4a-9d13-46c2-a8d0-1daea7b6bced"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:20:40.372293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e8fb41f9-dc89-411d-800b-6823b6be4e77 req-7b3cba8e-c124-46dc-b92f-4524403ea678 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:40.373176 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e8fb41f9-dc89-411d-800b-6823b6be4e77 req-7b3cba8e-c124-46dc-b92f-4524403ea678 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:40.376187 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e8fb41f9-dc89-411d-800b-6823b6be4e77 req-7b3cba8e-c124-46dc-b92f-4524403ea678 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:40.409669 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-e8fb41f9-dc89-411d-800b-6823b6be4e77 req-7b3cba8e-c124-46dc-b92f-4524403ea678 service nova] Creating event network-vif-plugged:51b8ad4a-9d13-46c2-a8d0-1daea7b6bced for instance 596804f9-9964-419e-bed5-d24e20805b57 on n-h1-851359-3 Aug 04 17:20:40.416491 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-e8fb41f9-dc89-411d-800b-6823b6be4e77 req-7b3cba8e-c124-46dc-b92f-4524403ea678 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105681 Aug 04 17:20:40.417838 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2777/5573] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:20:40.986227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-22a8b3fd-4912-4ea0-b5d1-d98effffbdb1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:41.018986 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-22a8b3fd-4912-4ea0-b5d1-d98effffbdb1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:41.024490 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-22a8b3fd-4912-4ea0-b5d1-d98effffbdb1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:41.025683 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-22a8b3fd-4912-4ea0-b5d1-d98effffbdb1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1751 microversion: 2.42 time: 0.829180 Aug 04 17:20:41.029123 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2797/5574] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:20:40 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1751 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:20:41.220483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cf4fa241-1263-4c46-a6d2-b4836498d8fa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:41.221626 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cf4fa241-1263-4c46-a6d2-b4836498d8fa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:41.231459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf4fa241-1263-4c46-a6d2-b4836498d8fa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:41.232549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf4fa241-1263-4c46-a6d2-b4836498d8fa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:41.234472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf4fa241-1263-4c46-a6d2-b4836498d8fa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:41.235573 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf4fa241-1263-4c46-a6d2-b4836498d8fa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:41.236286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf4fa241-1263-4c46-a6d2-b4836498d8fa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:41.237012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf4fa241-1263-4c46-a6d2-b4836498d8fa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:41.340995 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8745d376-fbf4-4763-b55e-40531a1c6706 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:41.346390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8745d376-fbf4-4763-b55e-40531a1c6706 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:41.387979 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8745d376-fbf4-4763-b55e-40531a1c6706 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:41.394966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8745d376-fbf4-4763-b55e-40531a1c6706 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:41.398202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8745d376-fbf4-4763-b55e-40531a1c6706 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:41.400323 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8745d376-fbf4-4763-b55e-40531a1c6706 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:41.404473 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8745d376-fbf4-4763-b55e-40531a1c6706 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:41.406802 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8745d376-fbf4-4763-b55e-40531a1c6706 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:41.489643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:20:42.190010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8745d376-fbf4-4763-b55e-40531a1c6706 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:42.228565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cf4fa241-1263-4c46-a6d2-b4836498d8fa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:42.229928 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8745d376-fbf4-4763-b55e-40531a1c6706 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1503 microversion: 2.1 time: 0.895303 Aug 04 17:20:42.246009 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2798/5575] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:41 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1503 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:42.246509 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cf4fa241-1263-4c46-a6d2-b4836498d8fa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1390 microversion: 2.1 time: 1.029631 Aug 04 17:20:42.260160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4286d83b-6817-428c-a037-04c42dc6addc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:42.260615 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2778/5576] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:41 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1390 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:20:42.262738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4286d83b-6817-428c-a037-04c42dc6addc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:42.276877 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4286d83b-6817-428c-a037-04c42dc6addc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:42.277730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4286d83b-6817-428c-a037-04c42dc6addc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:42.278539 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4286d83b-6817-428c-a037-04c42dc6addc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:42.280336 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4286d83b-6817-428c-a037-04c42dc6addc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:42.281242 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4286d83b-6817-428c-a037-04c42dc6addc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:42.282060 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4286d83b-6817-428c-a037-04c42dc6addc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:43.052558 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4286d83b-6817-428c-a037-04c42dc6addc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:43.092640 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4286d83b-6817-428c-a037-04c42dc6addc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:43.096373 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4286d83b-6817-428c-a037-04c42dc6addc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:43.098828 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4286d83b-6817-428c-a037-04c42dc6addc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1751 microversion: 2.42 time: 0.861524 Aug 04 17:20:43.100407 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2799/5577] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:20:42 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1751 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:20:43.267677 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5beb56e1-e67b-48bc-8454-163753dfc654 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:43.268972 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5beb56e1-e67b-48bc-8454-163753dfc654 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:43.272357 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2204720b-275a-40a3-813e-7e62ff0021a6 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:43.275172 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2204720b-275a-40a3-813e-7e62ff0021a6 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:43.283314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5beb56e1-e67b-48bc-8454-163753dfc654 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:43.284234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5beb56e1-e67b-48bc-8454-163753dfc654 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:43.284875 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5beb56e1-e67b-48bc-8454-163753dfc654 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:43.293568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5beb56e1-e67b-48bc-8454-163753dfc654 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:43.294462 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5beb56e1-e67b-48bc-8454-163753dfc654 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:43.295089 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5beb56e1-e67b-48bc-8454-163753dfc654 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:43.307865 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2204720b-275a-40a3-813e-7e62ff0021a6 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:43.316782 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2204720b-275a-40a3-813e-7e62ff0021a6 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:43.318548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2204720b-275a-40a3-813e-7e62ff0021a6 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:43.338326 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2204720b-275a-40a3-813e-7e62ff0021a6 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:43.343921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2204720b-275a-40a3-813e-7e62ff0021a6 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:43.350862 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2204720b-275a-40a3-813e-7e62ff0021a6 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:44.229811 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5beb56e1-e67b-48bc-8454-163753dfc654 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:44.252159 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5beb56e1-e67b-48bc-8454-163753dfc654 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1503 microversion: 2.1 time: 0.990501 Aug 04 17:20:44.254937 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2779/5578] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:43 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1503 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:44.266215 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-03b86bd7-a79d-43fe-9f90-b312a7916622 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:44.266215 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-03b86bd7-a79d-43fe-9f90-b312a7916622 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:44.272848 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2204720b-275a-40a3-813e-7e62ff0021a6 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:44.285355 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2204720b-275a-40a3-813e-7e62ff0021a6 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1390 microversion: 2.1 time: 1.020769 Aug 04 17:20:44.285599 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03b86bd7-a79d-43fe-9f90-b312a7916622 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:44.289802 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03b86bd7-a79d-43fe-9f90-b312a7916622 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:44.290668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03b86bd7-a79d-43fe-9f90-b312a7916622 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:44.291799 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03b86bd7-a79d-43fe-9f90-b312a7916622 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:44.292475 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03b86bd7-a79d-43fe-9f90-b312a7916622 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:44.293125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03b86bd7-a79d-43fe-9f90-b312a7916622 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:44.306971 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2800/5579] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:43 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1390 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:44.896534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-03b86bd7-a79d-43fe-9f90-b312a7916622 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:44.907241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-03b86bd7-a79d-43fe-9f90-b312a7916622 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:44.924872 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-03b86bd7-a79d-43fe-9f90-b312a7916622 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:44.926154 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-03b86bd7-a79d-43fe-9f90-b312a7916622 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1797 microversion: 2.42 time: 0.669586 Aug 04 17:20:44.926831 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2780/5580] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:20:44 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1797 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:20:45.284846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c7ae883b-026a-4446-a583-69219d905684 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:45.296106 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c7ae883b-026a-4446-a583-69219d905684 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:45.319227 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-677e03d0-1bf8-4ff1-a215-a3645f889666 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:45.320305 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-677e03d0-1bf8-4ff1-a215-a3645f889666 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:45.355615 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-677e03d0-1bf8-4ff1-a215-a3645f889666 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:45.357141 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-677e03d0-1bf8-4ff1-a215-a3645f889666 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:45.357852 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-677e03d0-1bf8-4ff1-a215-a3645f889666 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:45.358791 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c7ae883b-026a-4446-a583-69219d905684 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:45.359628 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c7ae883b-026a-4446-a583-69219d905684 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:45.360801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-677e03d0-1bf8-4ff1-a215-a3645f889666 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:45.361736 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-677e03d0-1bf8-4ff1-a215-a3645f889666 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:45.362854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-677e03d0-1bf8-4ff1-a215-a3645f889666 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:45.379214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c7ae883b-026a-4446-a583-69219d905684 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:45.380501 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c7ae883b-026a-4446-a583-69219d905684 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:45.381359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c7ae883b-026a-4446-a583-69219d905684 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:45.382206 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c7ae883b-026a-4446-a583-69219d905684 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:46.076266 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-677e03d0-1bf8-4ff1-a215-a3645f889666 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:46.097035 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-677e03d0-1bf8-4ff1-a215-a3645f889666 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1562 microversion: 2.1 time: 0.781795 Aug 04 17:20:46.098813 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2781/5581] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:45 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1562 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:46.115301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-63509e87-46a5-492d-acf4-bfe861bb3e65 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:46.116694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-63509e87-46a5-492d-acf4-bfe861bb3e65 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:46.123157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c7ae883b-026a-4446-a583-69219d905684 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:46.133459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63509e87-46a5-492d-acf4-bfe861bb3e65 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:46.137953 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c7ae883b-026a-4446-a583-69219d905684 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.859851 Aug 04 17:20:46.138406 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63509e87-46a5-492d-acf4-bfe861bb3e65 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:46.150030 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2801/5582] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:45 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:46.152703 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63509e87-46a5-492d-acf4-bfe861bb3e65 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:46.153842 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-523409fe-1092-4bda-bfa7-92d17ad8de1c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:46.162446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63509e87-46a5-492d-acf4-bfe861bb3e65 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:46.162789 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-523409fe-1092-4bda-bfa7-92d17ad8de1c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:46.165476 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63509e87-46a5-492d-acf4-bfe861bb3e65 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:46.166986 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63509e87-46a5-492d-acf4-bfe861bb3e65 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:46.183888 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-523409fe-1092-4bda-bfa7-92d17ad8de1c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:46.187962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-523409fe-1092-4bda-bfa7-92d17ad8de1c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:46.191882 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-523409fe-1092-4bda-bfa7-92d17ad8de1c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:46.193107 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-523409fe-1092-4bda-bfa7-92d17ad8de1c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:46.196242 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-523409fe-1092-4bda-bfa7-92d17ad8de1c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:46.198416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-523409fe-1092-4bda-bfa7-92d17ad8de1c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:46.879963 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-63509e87-46a5-492d-acf4-bfe861bb3e65 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:46.893817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-63509e87-46a5-492d-acf4-bfe861bb3e65 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:46.906639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-523409fe-1092-4bda-bfa7-92d17ad8de1c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:46.913539 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-63509e87-46a5-492d-acf4-bfe861bb3e65 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:46.915646 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-63509e87-46a5-492d-acf4-bfe861bb3e65 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1797 microversion: 2.42 time: 0.814388 Aug 04 17:20:46.917542 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2782/5583] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:20:46 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1797 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:20:46.921771 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-523409fe-1092-4bda-bfa7-92d17ad8de1c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1562 microversion: 2.1 time: 0.780590 Aug 04 17:20:46.925094 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2802/5584] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:46 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1562 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:46.932511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-20c20d27-e140-4086-aac9-3cafa3b3f3d6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:46.946054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-20c20d27-e140-4086-aac9-3cafa3b3f3d6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:46.946054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20c20d27-e140-4086-aac9-3cafa3b3f3d6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:46.946054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20c20d27-e140-4086-aac9-3cafa3b3f3d6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:46.948237 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20c20d27-e140-4086-aac9-3cafa3b3f3d6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:46.958541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20c20d27-e140-4086-aac9-3cafa3b3f3d6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:46.959045 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20c20d27-e140-4086-aac9-3cafa3b3f3d6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:46.959492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20c20d27-e140-4086-aac9-3cafa3b3f3d6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:47.008937 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:20:47.954466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5fb523ad-7bd1-4183-a520-28375fccc4cc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:47.956243 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5fb523ad-7bd1-4183-a520-28375fccc4cc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:47.966139 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5fb523ad-7bd1-4183-a520-28375fccc4cc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:47.966886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5fb523ad-7bd1-4183-a520-28375fccc4cc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:47.967771 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5fb523ad-7bd1-4183-a520-28375fccc4cc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:47.969360 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5fb523ad-7bd1-4183-a520-28375fccc4cc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:47.970227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5fb523ad-7bd1-4183-a520-28375fccc4cc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:47.970831 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5fb523ad-7bd1-4183-a520-28375fccc4cc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:48.563706 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-20c20d27-e140-4086-aac9-3cafa3b3f3d6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:48.588297 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-20c20d27-e140-4086-aac9-3cafa3b3f3d6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 1.667334 Aug 04 17:20:48.588940 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2783/5585] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:46 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:48.626343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e83a3d2a-4187-4cfa-b793-8cd9f9359a99 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:20:48.626900 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e83a3d2a-4187-4cfa-b793-8cd9f9359a99 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 2ca39ac2-1a01-44ef-9d71-b854f0e0e5d7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:48.637727 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-e83a3d2a-4187-4cfa-b793-8cd9f9359a99 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Instance 2ca39ac2-1a01-44ef-9d71-b854f0e0e5d7 could not be found. Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e83a3d2a-4187-4cfa-b793-8cd9f9359a99 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/2ca39ac2-1a01-44ef-9d71-b854f0e0e5d7/action HTTP/1.1 Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 15 Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: {"unpause": {}} Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 2ca39ac2-1a01-44ef-9d71-b854f0e0e5d7 could not be found. Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '2ca39ac2-1a01-44ef-9d71-b854f0e0e5d7', 'body': {'unpause': {}}} Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ca39ac2-1a01-44ef-9d71-b854f0e0e5d7 could not be found. Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ca39ac2-1a01-44ef-9d71-b854f0e0e5d7 could not be found. Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:48.640376 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:48.645347 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:20:48.645347 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:20:48.645347 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ca39ac2-1a01-44ef-9d71-b854f0e0e5d7 could not be found. Aug 04 17:20:48.645347 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:48.645347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e83a3d2a-4187-4cfa-b793-8cd9f9359a99 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 404 to user: Instance 2ca39ac2-1a01-44ef-9d71-b854f0e0e5d7 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:20:48.645347 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e83a3d2a-4187-4cfa-b793-8cd9f9359a99 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers/2ca39ac2-1a01-44ef-9d71-b854f0e0e5d7/action" status: 404 len: 111 microversion: 2.1 time: 0.019556 Aug 04 17:20:48.645347 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2784/5586] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:20:48 2022] POST /compute/v2.1/servers/2ca39ac2-1a01-44ef-9d71-b854f0e0e5d7/action => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:20:48.669711 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a118239e-0ad2-43c4-b50f-4bdbfa70ea5e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:48.670431 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a118239e-0ad2-43c4-b50f-4bdbfa70ea5e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:48.707529 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a118239e-0ad2-43c4-b50f-4bdbfa70ea5e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:48.708247 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a118239e-0ad2-43c4-b50f-4bdbfa70ea5e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:48.709077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a118239e-0ad2-43c4-b50f-4bdbfa70ea5e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:48.709991 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a118239e-0ad2-43c4-b50f-4bdbfa70ea5e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:48.710711 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a118239e-0ad2-43c4-b50f-4bdbfa70ea5e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:48.711563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a118239e-0ad2-43c4-b50f-4bdbfa70ea5e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:48.793172 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5fb523ad-7bd1-4183-a520-28375fccc4cc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:48.812493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5fb523ad-7bd1-4183-a520-28375fccc4cc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:48.817252 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5fb523ad-7bd1-4183-a520-28375fccc4cc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:48.827526 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5fb523ad-7bd1-4183-a520-28375fccc4cc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1843 microversion: 2.42 time: 0.876129 Aug 04 17:20:48.828664 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2803/5587] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:20:47 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1843 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:20:49.283898 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-f2c549a0-3038-42d8-8d8b-e62436268d6c req-9423cb45-e410-4572-b1a7-fcea0e078c3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "726db447-1df7-417d-a9e0-1c832e299621", "tag": "046e0a45-4ead-4c1d-a197-0872ec3beff4"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:20:49.302702 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f2c549a0-3038-42d8-8d8b-e62436268d6c req-9423cb45-e410-4572-b1a7-fcea0e078c3f service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:49.303195 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f2c549a0-3038-42d8-8d8b-e62436268d6c req-9423cb45-e410-4572-b1a7-fcea0e078c3f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:49.307820 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f2c549a0-3038-42d8-8d8b-e62436268d6c req-9423cb45-e410-4572-b1a7-fcea0e078c3f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:49.334886 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-f2c549a0-3038-42d8-8d8b-e62436268d6c req-9423cb45-e410-4572-b1a7-fcea0e078c3f service nova] Creating event network-changed:046e0a45-4ead-4c1d-a197-0872ec3beff4 for instance 726db447-1df7-417d-a9e0-1c832e299621 on n-h2-851359-3 Aug 04 17:20:49.345037 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-f2c549a0-3038-42d8-8d8b-e62436268d6c req-9423cb45-e410-4572-b1a7-fcea0e078c3f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065037 Aug 04 17:20:49.345694 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2804/5588] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:20:49.484428 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a118239e-0ad2-43c4-b50f-4bdbfa70ea5e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:49.500973 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a118239e-0ad2-43c4-b50f-4bdbfa70ea5e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.838265 Aug 04 17:20:49.501648 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2785/5589] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:48 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:49.524726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1a391210-6141-4dd1-9304-beaf88bfdb85 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:49.525689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1a391210-6141-4dd1-9304-beaf88bfdb85 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:49.532932 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a391210-6141-4dd1-9304-beaf88bfdb85 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:49.533765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a391210-6141-4dd1-9304-beaf88bfdb85 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:49.534450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a391210-6141-4dd1-9304-beaf88bfdb85 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:49.535448 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a391210-6141-4dd1-9304-beaf88bfdb85 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:49.536232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a391210-6141-4dd1-9304-beaf88bfdb85 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:49.536887 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a391210-6141-4dd1-9304-beaf88bfdb85 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:49.791220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1a391210-6141-4dd1-9304-beaf88bfdb85 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:49.804860 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1a391210-6141-4dd1-9304-beaf88bfdb85 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.285546 Aug 04 17:20:49.805917 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2805/5590] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:49 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:49.830688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3a68c1e1-ac17-423e-bd8e-a1448e806f70 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:20:49.837615 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3a68c1e1-ac17-423e-bd8e-a1448e806f70 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:49.859709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f91df643-41b2-413b-b5c7-b464468107f8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:49.859709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f91df643-41b2-413b-b5c7-b464468107f8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:49.865021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a68c1e1-ac17-423e-bd8e-a1448e806f70 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:49.866238 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a68c1e1-ac17-423e-bd8e-a1448e806f70 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:49.867968 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f91df643-41b2-413b-b5c7-b464468107f8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:49.872885 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a68c1e1-ac17-423e-bd8e-a1448e806f70 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:49.874076 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a68c1e1-ac17-423e-bd8e-a1448e806f70 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:49.875005 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f91df643-41b2-413b-b5c7-b464468107f8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:49.875805 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a68c1e1-ac17-423e-bd8e-a1448e806f70 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:49.878174 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f91df643-41b2-413b-b5c7-b464468107f8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:49.879032 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a68c1e1-ac17-423e-bd8e-a1448e806f70 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:49.880076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f91df643-41b2-413b-b5c7-b464468107f8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:49.884126 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f91df643-41b2-413b-b5c7-b464468107f8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:49.886283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f91df643-41b2-413b-b5c7-b464468107f8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:49.989048 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-3a68c1e1-ac17-423e-bd8e-a1448e806f70 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Cannot 'unpause' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state active Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3a68c1e1-ac17-423e-bd8e-a1448e806f70 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372/action HTTP/1.1 Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 15 Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: {"unpause": {}} Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: exception: Cannot 'unpause' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state active Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '5248dcdc-5a16-4036-9537-eb84f73dc372', 'body': {'unpause': {}}} Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5248dcdc-5a16-4036-9537-eb84f73dc372 in vm_state active. Cannot unpause while the instance is in this state. Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state active Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:49.991615 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:50.000099 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:50.000099 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:20:50.000099 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:20:50.000099 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state active Aug 04 17:20:50.000099 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:20:50.000099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3a68c1e1-ac17-423e-bd8e-a1448e806f70 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 409 to user: Cannot 'unpause' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state active {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:20:50.004373 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3a68c1e1-ac17-423e-bd8e-a1448e806f70 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372/action" status: 409 len: 145 microversion: 2.1 time: 0.168121 Aug 04 17:20:50.005670 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2786/5591] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:20:49 2022] POST /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372/action => generated 145 bytes in 181 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:20:50.025719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f33b727f-469b-43ed-a89e-14d750e29a5e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:50.027090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f33b727f-469b-43ed-a89e-14d750e29a5e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:50.041919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f33b727f-469b-43ed-a89e-14d750e29a5e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:50.043221 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f33b727f-469b-43ed-a89e-14d750e29a5e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:50.044188 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f33b727f-469b-43ed-a89e-14d750e29a5e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:50.046267 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f33b727f-469b-43ed-a89e-14d750e29a5e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:50.047376 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f33b727f-469b-43ed-a89e-14d750e29a5e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:50.048589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f33b727f-469b-43ed-a89e-14d750e29a5e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:50.952850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f33b727f-469b-43ed-a89e-14d750e29a5e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:50.961718 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f33b727f-469b-43ed-a89e-14d750e29a5e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.951204 Aug 04 17:20:50.965601 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2787/5592] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:50 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:20:50.989835 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9169b3d9-4b4c-44a4-9af9-04001da9c9a0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:50.990587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9169b3d9-4b4c-44a4-9af9-04001da9c9a0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:51.003117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9169b3d9-4b4c-44a4-9af9-04001da9c9a0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:51.003637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9169b3d9-4b4c-44a4-9af9-04001da9c9a0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:51.004086 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9169b3d9-4b4c-44a4-9af9-04001da9c9a0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:51.004830 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9169b3d9-4b4c-44a4-9af9-04001da9c9a0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:51.005296 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9169b3d9-4b4c-44a4-9af9-04001da9c9a0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:51.005738 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9169b3d9-4b4c-44a4-9af9-04001da9c9a0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:51.315201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f91df643-41b2-413b-b5c7-b464468107f8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:51.343187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f91df643-41b2-413b-b5c7-b464468107f8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:51.345012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f91df643-41b2-413b-b5c7-b464468107f8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:51.362500 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f91df643-41b2-413b-b5c7-b464468107f8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1843 microversion: 2.42 time: 1.492543 Aug 04 17:20:51.374047 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2806/5593] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:20:49 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1843 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:20:51.679961 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9169b3d9-4b4c-44a4-9af9-04001da9c9a0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:51.693247 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9169b3d9-4b4c-44a4-9af9-04001da9c9a0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.708299 Aug 04 17:20:51.694415 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2788/5594] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:50 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:51.724105 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-338ee054-b1ad-41d8-8602-a6addb4d7072 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:20:51.725435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-338ee054-b1ad-41d8-8602-a6addb4d7072 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 89c678ad-78f8-4057-8ea9-661a31aa5905] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:51.733942 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-338ee054-b1ad-41d8-8602-a6addb4d7072 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Instance 89c678ad-78f8-4057-8ea9-661a31aa5905 could not be found. Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-338ee054-b1ad-41d8-8602-a6addb4d7072 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers/89c678ad-78f8-4057-8ea9-661a31aa5905/action HTTP/1.1 Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 18 Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: {"unshelve": null} Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 89c678ad-78f8-4057-8ea9-661a31aa5905 could not be found. Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '89c678ad-78f8-4057-8ea9-661a31aa5905', 'body': {'unshelve': None}} Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89c678ad-78f8-4057-8ea9-661a31aa5905 could not be found. Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89c678ad-78f8-4057-8ea9-661a31aa5905 could not be found. Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:51.736657 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:51.741619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:51.741619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:51.741619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:51.741619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:51.741619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:20:51.741619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:20:51.741619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89c678ad-78f8-4057-8ea9-661a31aa5905 could not be found. Aug 04 17:20:51.741619 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:51.744208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-338ee054-b1ad-41d8-8602-a6addb4d7072 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 404 to user: Instance 89c678ad-78f8-4057-8ea9-661a31aa5905 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:20:51.746593 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-338ee054-b1ad-41d8-8602-a6addb4d7072 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers/89c678ad-78f8-4057-8ea9-661a31aa5905/action" status: 404 len: 111 microversion: 2.1 time: 0.028066 Aug 04 17:20:51.748007 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2807/5595] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:20:51 2022] POST /compute/v2.1/servers/89c678ad-78f8-4057-8ea9-661a31aa5905/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:20:51.757159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-74d44024-aed2-48cf-9d5e-2bb968b6b9dd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:51.757793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-74d44024-aed2-48cf-9d5e-2bb968b6b9dd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:51.765297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74d44024-aed2-48cf-9d5e-2bb968b6b9dd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:51.765802 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74d44024-aed2-48cf-9d5e-2bb968b6b9dd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:51.766299 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74d44024-aed2-48cf-9d5e-2bb968b6b9dd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:51.767027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74d44024-aed2-48cf-9d5e-2bb968b6b9dd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:51.767493 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74d44024-aed2-48cf-9d5e-2bb968b6b9dd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:51.767929 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74d44024-aed2-48cf-9d5e-2bb968b6b9dd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:52.401558 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cc624793-7774-4ec9-93dd-38c5cf1a057b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:52.402910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cc624793-7774-4ec9-93dd-38c5cf1a057b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:52.422397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc624793-7774-4ec9-93dd-38c5cf1a057b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:52.423035 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc624793-7774-4ec9-93dd-38c5cf1a057b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:52.428711 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc624793-7774-4ec9-93dd-38c5cf1a057b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:52.432414 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc624793-7774-4ec9-93dd-38c5cf1a057b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:52.434567 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc624793-7774-4ec9-93dd-38c5cf1a057b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:52.435135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc624793-7774-4ec9-93dd-38c5cf1a057b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:52.470064 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-74d44024-aed2-48cf-9d5e-2bb968b6b9dd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:52.485393 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-74d44024-aed2-48cf-9d5e-2bb968b6b9dd tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.731809 Aug 04 17:20:52.486344 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2789/5596] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:51 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:52.518295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-313c4214-8f7f-48e8-a817-a9b61a9ae704 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:52.521061 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-313c4214-8f7f-48e8-a817-a9b61a9ae704 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:52.551780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-313c4214-8f7f-48e8-a817-a9b61a9ae704 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:52.555639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-313c4214-8f7f-48e8-a817-a9b61a9ae704 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:52.559474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-313c4214-8f7f-48e8-a817-a9b61a9ae704 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:52.568481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-313c4214-8f7f-48e8-a817-a9b61a9ae704 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:52.573818 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-313c4214-8f7f-48e8-a817-a9b61a9ae704 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:52.574662 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-313c4214-8f7f-48e8-a817-a9b61a9ae704 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:53.499897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cc624793-7774-4ec9-93dd-38c5cf1a057b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:53.542303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cc624793-7774-4ec9-93dd-38c5cf1a057b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:53.569638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cc624793-7774-4ec9-93dd-38c5cf1a057b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:53.574128 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cc624793-7774-4ec9-93dd-38c5cf1a057b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1864 microversion: 2.42 time: 1.178642 Aug 04 17:20:53.577815 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2808/5597] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:20:52 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1864 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:20:53.590960 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-6c9a3a40-643b-4623-b272-ab805e83477e req-43ffa6a9-a632-43f0-867e-d23255228985 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "726db447-1df7-417d-a9e0-1c832e299621", "tag": "9af8c8e0-eab5-4884-8cf2-8ebe6aa58e3c"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:20:53.615819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6c9a3a40-643b-4623-b272-ab805e83477e req-43ffa6a9-a632-43f0-867e-d23255228985 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:53.619794 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6c9a3a40-643b-4623-b272-ab805e83477e req-43ffa6a9-a632-43f0-867e-d23255228985 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:53.622716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6c9a3a40-643b-4623-b272-ab805e83477e req-43ffa6a9-a632-43f0-867e-d23255228985 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:53.647065 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-6c9a3a40-643b-4623-b272-ab805e83477e req-43ffa6a9-a632-43f0-867e-d23255228985 service nova] Creating event network-changed:9af8c8e0-eab5-4884-8cf2-8ebe6aa58e3c for instance 726db447-1df7-417d-a9e0-1c832e299621 on n-h2-851359-3 Aug 04 17:20:53.660685 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-6c9a3a40-643b-4623-b272-ab805e83477e req-43ffa6a9-a632-43f0-867e-d23255228985 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078400 Aug 04 17:20:53.661612 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2809/5598] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:20:53.791671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-313c4214-8f7f-48e8-a817-a9b61a9ae704 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:53.818942 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-313c4214-8f7f-48e8-a817-a9b61a9ae704 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 1.315182 Aug 04 17:20:53.823185 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2790/5599] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:52 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:20:53.872999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-58daceb6-5156-4b26-91b3-bb713bb8d09c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:20:53.874841 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-58daceb6-5156-4b26-91b3-bb713bb8d09c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:53.893659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-58daceb6-5156-4b26-91b3-bb713bb8d09c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:53.894544 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-58daceb6-5156-4b26-91b3-bb713bb8d09c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:53.898693 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-58daceb6-5156-4b26-91b3-bb713bb8d09c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:53.900415 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-58daceb6-5156-4b26-91b3-bb713bb8d09c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:53.903580 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-58daceb6-5156-4b26-91b3-bb713bb8d09c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:53.905315 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-58daceb6-5156-4b26-91b3-bb713bb8d09c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:54.023415 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-58daceb6-5156-4b26-91b3-bb713bb8d09c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Cannot 'unshelve' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state active Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-58daceb6-5156-4b26-91b3-bb713bb8d09c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372/action HTTP/1.1 Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 18 Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: {"unshelve": null} Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: exception: Cannot 'unshelve' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state active Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '5248dcdc-5a16-4036-9537-eb84f73dc372', 'body': {'unshelve': None}} Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5248dcdc-5a16-4036-9537-eb84f73dc372 in vm_state active. Cannot unshelve while the instance is in this state. Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 17:20:54.027967 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 17:20:54.036608 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state active Aug 04 17:20:54.036608 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:54.036608 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:54.036608 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:54.036608 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:54.036608 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:54.036608 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:54.036608 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:20:54.036608 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:20:54.036608 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state active Aug 04 17:20:54.036608 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:54.040485 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-58daceb6-5156-4b26-91b3-bb713bb8d09c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 409 to user: Cannot 'unshelve' instance 5248dcdc-5a16-4036-9537-eb84f73dc372 while it is in vm_state active {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:20:54.041920 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-58daceb6-5156-4b26-91b3-bb713bb8d09c tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "POST /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372/action" status: 409 len: 146 microversion: 2.1 time: 0.179128 Aug 04 17:20:54.043205 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2810/5600] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:20:53 2022] POST /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372/action => generated 146 bytes in 181 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 04 17:20:54.070390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0810ea55-3cc9-4afc-b55a-8c943405d42b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:54.071479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0810ea55-3cc9-4afc-b55a-8c943405d42b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:54.083171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0810ea55-3cc9-4afc-b55a-8c943405d42b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:54.084090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0810ea55-3cc9-4afc-b55a-8c943405d42b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:54.084757 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0810ea55-3cc9-4afc-b55a-8c943405d42b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:54.085950 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0810ea55-3cc9-4afc-b55a-8c943405d42b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:54.087003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0810ea55-3cc9-4afc-b55a-8c943405d42b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:54.088809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0810ea55-3cc9-4afc-b55a-8c943405d42b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:54.621673 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b200ddf9-6046-4273-9ab6-a53e708040bd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:54.631957 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b200ddf9-6046-4273-9ab6-a53e708040bd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:54.678208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b200ddf9-6046-4273-9ab6-a53e708040bd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:54.683117 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b200ddf9-6046-4273-9ab6-a53e708040bd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:54.684353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b200ddf9-6046-4273-9ab6-a53e708040bd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:54.694148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b200ddf9-6046-4273-9ab6-a53e708040bd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:54.699027 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b200ddf9-6046-4273-9ab6-a53e708040bd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:54.699921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b200ddf9-6046-4273-9ab6-a53e708040bd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:54.788036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0810ea55-3cc9-4afc-b55a-8c943405d42b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:54.800856 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0810ea55-3cc9-4afc-b55a-8c943405d42b tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.750784 Aug 04 17:20:54.801537 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2791/5601] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:54 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:54.832767 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-addbf08b-b888-4cc6-a18f-768033a65799 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:54.834032 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-addbf08b-b888-4cc6-a18f-768033a65799 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:54.841415 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-addbf08b-b888-4cc6-a18f-768033a65799 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:54.841956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-addbf08b-b888-4cc6-a18f-768033a65799 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:54.846793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-addbf08b-b888-4cc6-a18f-768033a65799 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:54.847648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-addbf08b-b888-4cc6-a18f-768033a65799 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:54.848138 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-addbf08b-b888-4cc6-a18f-768033a65799 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:54.848600 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-addbf08b-b888-4cc6-a18f-768033a65799 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:55.547393 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b200ddf9-6046-4273-9ab6-a53e708040bd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:55.576130 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b200ddf9-6046-4273-9ab6-a53e708040bd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:55.585736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b200ddf9-6046-4273-9ab6-a53e708040bd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:55.591643 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b200ddf9-6046-4273-9ab6-a53e708040bd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1864 microversion: 2.42 time: 0.970478 Aug 04 17:20:55.591643 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2811/5602] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:20:54 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1864 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:20:56.081704 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-addbf08b-b888-4cc6-a18f-768033a65799 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:56.098082 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-addbf08b-b888-4cc6-a18f-768033a65799 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 1.269035 Aug 04 17:20:56.102917 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2792/5603] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:54 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:56.139647 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-51253a2e-35e3-4d77-8f6a-d0667985ccdb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1259791705_updated"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:20:56.145415 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-51253a2e-35e3-4d77-8f6a-d0667985ccdb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 68525a64-2927-46f1-9807-22c6bda4061d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:56.158564 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-51253a2e-35e3-4d77-8f6a-d0667985ccdb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Instance 68525a64-2927-46f1-9807-22c6bda4061d could not be found. Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-51253a2e-35e3-4d77-8f6a-d0667985ccdb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: request: PUT /compute/v2.1/servers/68525a64-2927-46f1-9807-22c6bda4061d HTTP/1.1 Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 81 Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1259791705_updated"}} Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 68525a64-2927-46f1-9807-22c6bda4061d could not be found. Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '68525a64-2927-46f1-9807-22c6bda4061d', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1259791705_updated'}}} Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68525a64-2927-46f1-9807-22c6bda4061d could not be found. Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 04 17:20:56.163176 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:20:56.172355 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:20:56.172355 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:20:56.172355 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:20:56.172355 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68525a64-2927-46f1-9807-22c6bda4061d could not be found. Aug 04 17:20:56.172355 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:56.172355 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:56.172355 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:56.172355 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:56.172355 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:56.172355 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:56.172355 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:20:56.172355 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:20:56.172355 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68525a64-2927-46f1-9807-22c6bda4061d could not be found. Aug 04 17:20:56.172355 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:56.174728 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-51253a2e-35e3-4d77-8f6a-d0667985ccdb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 404 to user: Instance 68525a64-2927-46f1-9807-22c6bda4061d could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:20:56.176301 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-51253a2e-35e3-4d77-8f6a-d0667985ccdb tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "PUT /compute/v2.1/servers/68525a64-2927-46f1-9807-22c6bda4061d" status: 404 len: 111 microversion: 2.1 time: 0.044213 Aug 04 17:20:56.182692 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2812/5604] 10.222.0.93 () {60 vars in 1256 bytes} [Thu Aug 4 17:20:56 2022] PUT /compute/v2.1/servers/68525a64-2927-46f1-9807-22c6bda4061d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:20:56.196044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-57151402-1965-474b-849e-3df0f227ec33 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:56.198716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-57151402-1965-474b-849e-3df0f227ec33 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:56.213995 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57151402-1965-474b-849e-3df0f227ec33 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:56.215318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57151402-1965-474b-849e-3df0f227ec33 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:56.216019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57151402-1965-474b-849e-3df0f227ec33 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:56.218050 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57151402-1965-474b-849e-3df0f227ec33 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:56.218954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57151402-1965-474b-849e-3df0f227ec33 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:56.219842 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57151402-1965-474b-849e-3df0f227ec33 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:56.622334 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-59ef0d07-6266-4f5a-b6f0-dd892f13ea13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:56.623192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-59ef0d07-6266-4f5a-b6f0-dd892f13ea13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:56.639215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59ef0d07-6266-4f5a-b6f0-dd892f13ea13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:56.641090 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59ef0d07-6266-4f5a-b6f0-dd892f13ea13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:56.642460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59ef0d07-6266-4f5a-b6f0-dd892f13ea13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:56.643852 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59ef0d07-6266-4f5a-b6f0-dd892f13ea13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:56.644831 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59ef0d07-6266-4f5a-b6f0-dd892f13ea13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:56.647711 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59ef0d07-6266-4f5a-b6f0-dd892f13ea13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:56.943080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-57151402-1965-474b-849e-3df0f227ec33 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:56.960859 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-57151402-1965-474b-849e-3df0f227ec33 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.777033 Aug 04 17:20:56.963033 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2793/5605] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:56 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:56.978508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-75641844-f3aa-491b-93f3-bafcb53f835b req-142dc6e0-2d8e-4790-a86c-567d6340209d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "726db447-1df7-417d-a9e0-1c832e299621", "tag": "485e15db-88a6-41d7-ad94-dc268d623543"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:20:56.995185 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-75641844-f3aa-491b-93f3-bafcb53f835b req-142dc6e0-2d8e-4790-a86c-567d6340209d service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:56.996388 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-75641844-f3aa-491b-93f3-bafcb53f835b req-142dc6e0-2d8e-4790-a86c-567d6340209d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:56.997652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-75641844-f3aa-491b-93f3-bafcb53f835b req-142dc6e0-2d8e-4790-a86c-567d6340209d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:57.023486 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-75641844-f3aa-491b-93f3-bafcb53f835b req-142dc6e0-2d8e-4790-a86c-567d6340209d service nova] Creating event network-changed:485e15db-88a6-41d7-ad94-dc268d623543 for instance 726db447-1df7-417d-a9e0-1c832e299621 on n-h2-851359-3 Aug 04 17:20:57.044168 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-75641844-f3aa-491b-93f3-bafcb53f835b req-142dc6e0-2d8e-4790-a86c-567d6340209d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078693 Aug 04 17:20:57.049498 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2794/5606] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:20:57.061308 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f2ea5cfb-2938-4bcc-ac11-8698c922f492 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:57.064054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f2ea5cfb-2938-4bcc-ac11-8698c922f492 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:57.076789 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2ea5cfb-2938-4bcc-ac11-8698c922f492 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:57.078240 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2ea5cfb-2938-4bcc-ac11-8698c922f492 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:57.079804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2ea5cfb-2938-4bcc-ac11-8698c922f492 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:57.080610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2ea5cfb-2938-4bcc-ac11-8698c922f492 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:57.081183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2ea5cfb-2938-4bcc-ac11-8698c922f492 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:57.081688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2ea5cfb-2938-4bcc-ac11-8698c922f492 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:57.503353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-59ef0d07-6266-4f5a-b6f0-dd892f13ea13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:57.526476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-59ef0d07-6266-4f5a-b6f0-dd892f13ea13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:57.529118 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-59ef0d07-6266-4f5a-b6f0-dd892f13ea13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:57.531443 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-59ef0d07-6266-4f5a-b6f0-dd892f13ea13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 0.918477 Aug 04 17:20:57.531915 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2813/5607] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:20:56 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:20:57.648040 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f2ea5cfb-2938-4bcc-ac11-8698c922f492 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:57.681940 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f2ea5cfb-2938-4bcc-ac11-8698c922f492 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.630885 Aug 04 17:20:57.683458 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2795/5608] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:57 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:57.706581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-888036ed-dcaa-4752-abbc-2170778eeb10 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-888036ed-dcaa-4752-abbc-2170778eeb10 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: request: PUT /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 HTTP/1.1 Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 280 Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '5248dcdc-5a16-4036-9537-eb84f73dc372', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:57.711084 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:57.715878 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:57.715878 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:57.715878 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:20:57.715878 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:20:57.715878 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:20:57.715878 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:20:57.715878 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:20:57.715878 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:20:57.715878 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:20:57.715878 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:20:57.715878 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:20:57.715878 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:20:57.715878 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:20:57.715878 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:20:57.715878 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 17:20:57.715878 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:57.715878 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:57.715878 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:57.715878 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:57.715878 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:57.715878 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:57.715878 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:20:57.715878 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:20:57.715878 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 04 17:20:57.715878 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:57.719044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-888036ed-dcaa-4752-abbc-2170778eeb10 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:20:57.720277 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-888036ed-dcaa-4752-abbc-2170778eeb10 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "PUT /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 400 len: 619 microversion: 2.1 time: 0.019130 Aug 04 17:20:57.724744 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2814/5609] 10.222.0.93 () {60 vars in 1257 bytes} [Thu Aug 4 17:20:57 2022] PUT /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 619 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:20:57.734398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bed75ee8-3675-4e13-93ac-f9e32adc3ad1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:57.735355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bed75ee8-3675-4e13-93ac-f9e32adc3ad1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:57.742402 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a8c83ebb-313a-4bbc-9a19-1b7d2aa8b57e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:57.743542 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a8c83ebb-313a-4bbc-9a19-1b7d2aa8b57e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:57.746580 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bed75ee8-3675-4e13-93ac-f9e32adc3ad1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:57.747569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bed75ee8-3675-4e13-93ac-f9e32adc3ad1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:57.754459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8c83ebb-313a-4bbc-9a19-1b7d2aa8b57e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:57.754994 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bed75ee8-3675-4e13-93ac-f9e32adc3ad1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:57.755748 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8c83ebb-313a-4bbc-9a19-1b7d2aa8b57e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:57.756468 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8c83ebb-313a-4bbc-9a19-1b7d2aa8b57e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:57.757662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8c83ebb-313a-4bbc-9a19-1b7d2aa8b57e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:57.758456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8c83ebb-313a-4bbc-9a19-1b7d2aa8b57e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:57.759133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bed75ee8-3675-4e13-93ac-f9e32adc3ad1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:57.759438 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a8c83ebb-313a-4bbc-9a19-1b7d2aa8b57e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:57.759725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bed75ee8-3675-4e13-93ac-f9e32adc3ad1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:57.760328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bed75ee8-3675-4e13-93ac-f9e32adc3ad1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:58.235956 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a8c83ebb-313a-4bbc-9a19-1b7d2aa8b57e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:58.241930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bed75ee8-3675-4e13-93ac-f9e32adc3ad1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:58.254189 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a8c83ebb-313a-4bbc-9a19-1b7d2aa8b57e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1562 microversion: 2.1 time: 0.515552 Aug 04 17:20:58.255462 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2815/5610] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:57 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1562 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:20:58.258815 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bed75ee8-3675-4e13-93ac-f9e32adc3ad1 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.532897 Aug 04 17:20:58.263272 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2796/5611] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:57 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:20:58.285884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9967c713-ab33-4234-842e-5e99b7b9f102 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:58.286604 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9967c713-ab33-4234-842e-5e99b7b9f102 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:58.296550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9967c713-ab33-4234-842e-5e99b7b9f102 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:58.297462 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9967c713-ab33-4234-842e-5e99b7b9f102 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:58.298155 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9967c713-ab33-4234-842e-5e99b7b9f102 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:58.300054 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9967c713-ab33-4234-842e-5e99b7b9f102 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:58.301808 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9967c713-ab33-4234-842e-5e99b7b9f102 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:58.302476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9967c713-ab33-4234-842e-5e99b7b9f102 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:58.560612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9868301f-283c-4909-aed6-f4086ec76e40 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:58.561242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9868301f-283c-4909-aed6-f4086ec76e40 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:58.575798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9868301f-283c-4909-aed6-f4086ec76e40 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:58.576609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9868301f-283c-4909-aed6-f4086ec76e40 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:58.577264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9868301f-283c-4909-aed6-f4086ec76e40 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:58.582312 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9868301f-283c-4909-aed6-f4086ec76e40 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:58.583082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9868301f-283c-4909-aed6-f4086ec76e40 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:58.583704 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9868301f-283c-4909-aed6-f4086ec76e40 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:58.646067 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9967c713-ab33-4234-842e-5e99b7b9f102 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:58.675493 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9967c713-ab33-4234-842e-5e99b7b9f102 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.394139 Aug 04 17:20:58.676542 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2816/5612] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:58 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:20:58.704467 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-49d7aa8d-4ce9-40b2-92eb-962ef557038e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-49d7aa8d-4ce9-40b2-92eb-962ef557038e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: request: PUT /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 HTTP/1.1 Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 24 Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: {"server": {"name": ""}} Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '5248dcdc-5a16-4036-9537-eb84f73dc372', 'body': {'server': {'name': ''}}} Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi '' Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:20:58.710187 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 04 17:20:58.715435 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:58.715435 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:20:58.715435 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:58.715435 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:20:58.715435 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:20:58.715435 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:20:58.715435 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:20:58.715435 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:20:58.715435 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 04 17:20:58.715435 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:20:58.719168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-49d7aa8d-4ce9-40b2-92eb-962ef557038e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:20:58.720503 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-49d7aa8d-4ce9-40b2-92eb-962ef557038e tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "PUT /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 400 len: 108 microversion: 2.1 time: 0.020577 Aug 04 17:20:58.725055 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2817/5613] 10.222.0.93 () {60 vars in 1256 bytes} [Thu Aug 4 17:20:58 2022] PUT /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 108 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:20:58.732837 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4bbfe9c0-d21e-437c-9d47-c2b187258775 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:20:58.733723 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4bbfe9c0-d21e-437c-9d47-c2b187258775 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:20:58.742823 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4bbfe9c0-d21e-437c-9d47-c2b187258775 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:58.749805 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4bbfe9c0-d21e-437c-9d47-c2b187258775 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:58.750380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4bbfe9c0-d21e-437c-9d47-c2b187258775 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:58.751205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4bbfe9c0-d21e-437c-9d47-c2b187258775 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:20:58.758327 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4bbfe9c0-d21e-437c-9d47-c2b187258775 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:20:58.758920 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4bbfe9c0-d21e-437c-9d47-c2b187258775 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:20:59.407584 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9868301f-283c-4909-aed6-f4086ec76e40 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:59.433429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9868301f-283c-4909-aed6-f4086ec76e40 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:59.457682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9868301f-283c-4909-aed6-f4086ec76e40 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:59.459963 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9868301f-283c-4909-aed6-f4086ec76e40 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 0.903225 Aug 04 17:20:59.467508 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2797/5614] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:20:58 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:20:59.480997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4bbfe9c0-d21e-437c-9d47-c2b187258775 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:20:59.495882 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4bbfe9c0-d21e-437c-9d47-c2b187258775 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1506 microversion: 2.1 time: 0.768335 Aug 04 17:20:59.497190 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2818/5615] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:20:58 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1506 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:21:00.005173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-7c67d8a3-f1f4-4f2c-83c5-df3f2534efcc req-b30b8545-f6e7-4171-ab86-8df26bed2e4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "596804f9-9964-419e-bed5-d24e20805b57", "tag": "51b8ad4a-9d13-46c2-a8d0-1daea7b6bced"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:21:00.040874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=72 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:21:00.048486 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7c67d8a3-f1f4-4f2c-83c5-df3f2534efcc req-b30b8545-f6e7-4171-ab86-8df26bed2e4c service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:00.049402 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7c67d8a3-f1f4-4f2c-83c5-df3f2534efcc req-b30b8545-f6e7-4171-ab86-8df26bed2e4c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:00.049935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7c67d8a3-f1f4-4f2c-83c5-df3f2534efcc req-b30b8545-f6e7-4171-ab86-8df26bed2e4c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:00.106774 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-7c67d8a3-f1f4-4f2c-83c5-df3f2534efcc req-b30b8545-f6e7-4171-ab86-8df26bed2e4c service nova] Creating event network-changed:51b8ad4a-9d13-46c2-a8d0-1daea7b6bced for instance 596804f9-9964-419e-bed5-d24e20805b57 on n-h1-851359-3 Aug 04 17:21:00.120117 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-7c67d8a3-f1f4-4f2c-83c5-df3f2534efcc req-b30b8545-f6e7-4171-ab86-8df26bed2e4c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.644138 Aug 04 17:21:00.124649 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2798/5616] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:21:00.499402 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-584f936c-92ba-4f6f-8165-f04eb6fd5bb2 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:00.500229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-584f936c-92ba-4f6f-8165-f04eb6fd5bb2 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:00.512794 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-584f936c-92ba-4f6f-8165-f04eb6fd5bb2 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:00.514766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-584f936c-92ba-4f6f-8165-f04eb6fd5bb2 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:00.515483 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-584f936c-92ba-4f6f-8165-f04eb6fd5bb2 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:00.520151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-584f936c-92ba-4f6f-8165-f04eb6fd5bb2 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:00.521365 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-584f936c-92ba-4f6f-8165-f04eb6fd5bb2 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:00.523730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-584f936c-92ba-4f6f-8165-f04eb6fd5bb2 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:01.518974 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-584f936c-92ba-4f6f-8165-f04eb6fd5bb2 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:01.542173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-584f936c-92ba-4f6f-8165-f04eb6fd5bb2 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:01.547361 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-584f936c-92ba-4f6f-8165-f04eb6fd5bb2 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:01.552510 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-584f936c-92ba-4f6f-8165-f04eb6fd5bb2 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 1.057224 Aug 04 17:21:01.554977 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2819/5617] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:00 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:21:02.436928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-14382ced-a5ef-4912-b5f1-ea859dae3082 req-34ca8b51-aacf-4151-82e5-8a49d01f790e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "726db447-1df7-417d-a9e0-1c832e299621", "tag": "3e04b159-57ff-4d66-afba-9b463d3dbcad"}, {"name": "network-changed", "server_uuid": "726db447-1df7-417d-a9e0-1c832e299621", "tag": "e397d801-65f8-4228-9ea6-fb3cb8adfc19"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:21:02.469777 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-14382ced-a5ef-4912-b5f1-ea859dae3082 req-34ca8b51-aacf-4151-82e5-8a49d01f790e service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:02.471178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-14382ced-a5ef-4912-b5f1-ea859dae3082 req-34ca8b51-aacf-4151-82e5-8a49d01f790e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:02.474566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-14382ced-a5ef-4912-b5f1-ea859dae3082 req-34ca8b51-aacf-4151-82e5-8a49d01f790e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:02.496053 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-14382ced-a5ef-4912-b5f1-ea859dae3082 req-34ca8b51-aacf-4151-82e5-8a49d01f790e service nova] Creating event network-changed:3e04b159-57ff-4d66-afba-9b463d3dbcad for instance 726db447-1df7-417d-a9e0-1c832e299621 on n-h2-851359-3 Aug 04 17:21:02.506403 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-14382ced-a5ef-4912-b5f1-ea859dae3082 req-34ca8b51-aacf-4151-82e5-8a49d01f790e service nova] Creating event network-changed:e397d801-65f8-4228-9ea6-fb3cb8adfc19 for instance 726db447-1df7-417d-a9e0-1c832e299621 on n-h2-851359-3 Aug 04 17:21:02.518894 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-14382ced-a5ef-4912-b5f1-ea859dae3082 req-34ca8b51-aacf-4151-82e5-8a49d01f790e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.088669 Aug 04 17:21:02.520019 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2799/5618] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:21:02.603617 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b254ecac-73ba-4f63-8d0a-452f3e47aebe tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:02.604366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b254ecac-73ba-4f63-8d0a-452f3e47aebe tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:02.615642 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b254ecac-73ba-4f63-8d0a-452f3e47aebe tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:02.624037 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b254ecac-73ba-4f63-8d0a-452f3e47aebe tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:02.624810 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b254ecac-73ba-4f63-8d0a-452f3e47aebe tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:02.625763 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b254ecac-73ba-4f63-8d0a-452f3e47aebe tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:02.626452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b254ecac-73ba-4f63-8d0a-452f3e47aebe tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:02.627106 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b254ecac-73ba-4f63-8d0a-452f3e47aebe tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:02.677059 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:21:03.864787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b254ecac-73ba-4f63-8d0a-452f3e47aebe tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:03.878077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b254ecac-73ba-4f63-8d0a-452f3e47aebe tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:03.881693 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b254ecac-73ba-4f63-8d0a-452f3e47aebe tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:03.883266 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b254ecac-73ba-4f63-8d0a-452f3e47aebe tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 1.284994 Aug 04 17:21:03.885399 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2820/5619] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:02 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:21:04.911616 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9818e029-0681-4b9d-92e8-82ec88ced2bc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:04.912989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9818e029-0681-4b9d-92e8-82ec88ced2bc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:04.942505 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9818e029-0681-4b9d-92e8-82ec88ced2bc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:04.943311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9818e029-0681-4b9d-92e8-82ec88ced2bc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:04.944007 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9818e029-0681-4b9d-92e8-82ec88ced2bc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:04.945177 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9818e029-0681-4b9d-92e8-82ec88ced2bc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:04.945831 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9818e029-0681-4b9d-92e8-82ec88ced2bc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:04.946500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9818e029-0681-4b9d-92e8-82ec88ced2bc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:05.739279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9818e029-0681-4b9d-92e8-82ec88ced2bc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:05.767507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9818e029-0681-4b9d-92e8-82ec88ced2bc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:05.776574 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9818e029-0681-4b9d-92e8-82ec88ced2bc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:05.782611 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9818e029-0681-4b9d-92e8-82ec88ced2bc tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 0.876631 Aug 04 17:21:05.783253 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2800/5620] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:04 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:21:06.272788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-da43dce7-140a-4f18-ad47-1a4f9f97816d req-47210e17-13c6-4b2a-be8d-b27a390adcae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "726db447-1df7-417d-a9e0-1c832e299621", "tag": "fdb23d55-8a38-4aff-b71c-c6c9f6001dd5"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:21:06.297338 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-da43dce7-140a-4f18-ad47-1a4f9f97816d req-47210e17-13c6-4b2a-be8d-b27a390adcae service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:06.298461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-da43dce7-140a-4f18-ad47-1a4f9f97816d req-47210e17-13c6-4b2a-be8d-b27a390adcae service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:06.299168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-da43dce7-140a-4f18-ad47-1a4f9f97816d req-47210e17-13c6-4b2a-be8d-b27a390adcae service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:06.333680 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-da43dce7-140a-4f18-ad47-1a4f9f97816d req-47210e17-13c6-4b2a-be8d-b27a390adcae service nova] Creating event network-changed:fdb23d55-8a38-4aff-b71c-c6c9f6001dd5 for instance 726db447-1df7-417d-a9e0-1c832e299621 on n-h2-851359-3 Aug 04 17:21:06.353415 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-da43dce7-140a-4f18-ad47-1a4f9f97816d req-47210e17-13c6-4b2a-be8d-b27a390adcae service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081162 Aug 04 17:21:06.354811 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2821/5621] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:21:06.814957 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e44d193d-1e08-427f-9c3a-73152687924e tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:06.815860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e44d193d-1e08-427f-9c3a-73152687924e tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:06.834820 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e44d193d-1e08-427f-9c3a-73152687924e tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:06.835476 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e44d193d-1e08-427f-9c3a-73152687924e tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:06.836578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e44d193d-1e08-427f-9c3a-73152687924e tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:06.837827 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e44d193d-1e08-427f-9c3a-73152687924e tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:06.838584 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e44d193d-1e08-427f-9c3a-73152687924e tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:06.839547 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e44d193d-1e08-427f-9c3a-73152687924e tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:07.384569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e44d193d-1e08-427f-9c3a-73152687924e tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:07.403180 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e44d193d-1e08-427f-9c3a-73152687924e tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:07.405220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e44d193d-1e08-427f-9c3a-73152687924e tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:07.407444 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e44d193d-1e08-427f-9c3a-73152687924e tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 0.598997 Aug 04 17:21:07.408344 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2801/5622] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:06 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:21:08.437635 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6922fca9-5cea-4bed-9b99-000fbc285f78 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:08.438988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6922fca9-5cea-4bed-9b99-000fbc285f78 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:08.458178 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6922fca9-5cea-4bed-9b99-000fbc285f78 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:08.462005 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6922fca9-5cea-4bed-9b99-000fbc285f78 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:08.463431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6922fca9-5cea-4bed-9b99-000fbc285f78 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:08.468362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6922fca9-5cea-4bed-9b99-000fbc285f78 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:08.469377 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6922fca9-5cea-4bed-9b99-000fbc285f78 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:08.470899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6922fca9-5cea-4bed-9b99-000fbc285f78 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:08.521873 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-67b15c7f-237b-4f0f-8188-6e5c8748220d req-0d0e37f1-fdd0-491b-875a-8c7ac66b57c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "726db447-1df7-417d-a9e0-1c832e299621", "tag": "f6f39783-21ab-4cb8-8d8b-96d99d3f6366"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:21:08.554813 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-67b15c7f-237b-4f0f-8188-6e5c8748220d req-0d0e37f1-fdd0-491b-875a-8c7ac66b57c7 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:08.555341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-67b15c7f-237b-4f0f-8188-6e5c8748220d req-0d0e37f1-fdd0-491b-875a-8c7ac66b57c7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:08.560827 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-67b15c7f-237b-4f0f-8188-6e5c8748220d req-0d0e37f1-fdd0-491b-875a-8c7ac66b57c7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:08.594524 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-67b15c7f-237b-4f0f-8188-6e5c8748220d req-0d0e37f1-fdd0-491b-875a-8c7ac66b57c7 service nova] Creating event network-changed:f6f39783-21ab-4cb8-8d8b-96d99d3f6366 for instance 726db447-1df7-417d-a9e0-1c832e299621 on n-h2-851359-3 Aug 04 17:21:08.604145 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-67b15c7f-237b-4f0f-8188-6e5c8748220d req-0d0e37f1-fdd0-491b-875a-8c7ac66b57c7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087132 Aug 04 17:21:08.605501 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2802/5623] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:21:09.035599 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9a783dfe-d947-4379-8f00-ee072f0e6da0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:09.038145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9a783dfe-d947-4379-8f00-ee072f0e6da0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:09.061869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a783dfe-d947-4379-8f00-ee072f0e6da0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:09.062563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a783dfe-d947-4379-8f00-ee072f0e6da0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:09.066747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a783dfe-d947-4379-8f00-ee072f0e6da0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:09.070306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a783dfe-d947-4379-8f00-ee072f0e6da0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:09.071052 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a783dfe-d947-4379-8f00-ee072f0e6da0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:09.071415 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a783dfe-d947-4379-8f00-ee072f0e6da0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:09.100312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6922fca9-5cea-4bed-9b99-000fbc285f78 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:09.104624 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-9a783dfe-d947-4379-8f00-ee072f0e6da0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Instance aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb could not be found. Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9a783dfe-d947-4379-8f00-ee072f0e6da0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb HTTP/1.1 Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb could not be found. Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb'} Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb could not be found. Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:21:09.114722 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:21:09.119633 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb could not be found. Aug 04 17:21:09.119633 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:21:09.119633 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:21:09.119633 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:21:09.119633 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:21:09.119633 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:21:09.119633 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:21:09.119633 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:21:09.119633 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:21:09.119633 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb could not be found. Aug 04 17:21:09.119633 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:21:09.119633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9a783dfe-d947-4379-8f00-ee072f0e6da0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 404 to user: Instance aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:21:09.119633 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9a783dfe-d947-4379-8f00-ee072f0e6da0 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "DELETE /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb" status: 404 len: 111 microversion: 2.1 time: 0.088589 Aug 04 17:21:09.119633 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2803/5624] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:21:09 2022] DELETE /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:21:09.124141 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cbf1c29e-1544-4ed9-8ed1-e34f70ac8931 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:21:09.126496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cbf1c29e-1544-4ed9-8ed1-e34f70ac8931 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:09.145049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbf1c29e-1544-4ed9-8ed1-e34f70ac8931 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:09.145633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbf1c29e-1544-4ed9-8ed1-e34f70ac8931 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:09.146164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbf1c29e-1544-4ed9-8ed1-e34f70ac8931 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:09.147140 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6922fca9-5cea-4bed-9b99-000fbc285f78 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:09.149161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbf1c29e-1544-4ed9-8ed1-e34f70ac8931 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:09.149671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbf1c29e-1544-4ed9-8ed1-e34f70ac8931 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:09.152782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbf1c29e-1544-4ed9-8ed1-e34f70ac8931 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:09.158836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6922fca9-5cea-4bed-9b99-000fbc285f78 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:09.163760 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6922fca9-5cea-4bed-9b99-000fbc285f78 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 0.732990 Aug 04 17:21:09.163760 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2822/5625] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:08 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:21:09.175881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-30158042-b3e4-4629-8d36-bcdebd7bc411 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:09.176751 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-30158042-b3e4-4629-8d36-bcdebd7bc411 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:09.192291 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:21:09.193227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-30158042-b3e4-4629-8d36-bcdebd7bc411 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:09.193868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-30158042-b3e4-4629-8d36-bcdebd7bc411 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:09.194518 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-30158042-b3e4-4629-8d36-bcdebd7bc411 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:09.197187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-30158042-b3e4-4629-8d36-bcdebd7bc411 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:09.197761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-30158042-b3e4-4629-8d36-bcdebd7bc411 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:09.200039 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-30158042-b3e4-4629-8d36-bcdebd7bc411 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:09.235333 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-30158042-b3e4-4629-8d36-bcdebd7bc411 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Instance aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb could not be found. Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-30158042-b3e4-4629-8d36-bcdebd7bc411 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb HTTP/1.1 Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb could not be found. Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb'} Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb could not be found. Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb could not be found. Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:21:09.241907 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:21:09.246869 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:21:09.246869 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:21:09.246869 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:21:09.246869 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:21:09.246869 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:21:09.246869 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb could not be found. Aug 04 17:21:09.246869 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:21:09.246869 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-30158042-b3e4-4629-8d36-bcdebd7bc411 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 404 to user: Instance aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:21:09.246869 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-30158042-b3e4-4629-8d36-bcdebd7bc411 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb" status: 404 len: 111 microversion: 2.1 time: 0.079691 Aug 04 17:21:09.246869 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2823/5626] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:21:09 2022] GET /compute/v2.1/servers/aa4e513a-679a-4d3e-8b2c-ac8c9d8013eb => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:21:09.267173 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cbf1c29e-1544-4ed9-8ed1-e34f70ac8931 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "POST /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57/action" status: 200 len: 24573 microversion: 2.1 time: 0.148310 Aug 04 17:21:09.268292 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2804/5627] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:21:09 2022] POST /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57/action => generated 24573 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:21:09.286655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-09c9a57d-9cc5-47d5-9a0d-33a30822cfe4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:09.291566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-09c9a57d-9cc5-47d5-9a0d-33a30822cfe4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:09.320358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-09c9a57d-9cc5-47d5-9a0d-33a30822cfe4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:09.324038 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-09c9a57d-9cc5-47d5-9a0d-33a30822cfe4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:09.327627 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-09c9a57d-9cc5-47d5-9a0d-33a30822cfe4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:09.334397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-09c9a57d-9cc5-47d5-9a0d-33a30822cfe4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:09.337404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-09c9a57d-9cc5-47d5-9a0d-33a30822cfe4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:09.341860 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-09c9a57d-9cc5-47d5-9a0d-33a30822cfe4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:09.423350 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-09c9a57d-9cc5-47d5-9a0d-33a30822cfe4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:21:09.660221 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-09c9a57d-9cc5-47d5-9a0d-33a30822cfe4 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "DELETE /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 204 len: 0 microversion: 2.1 time: 0.401628 Aug 04 17:21:09.662037 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2824/5628] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:21:09 2022] DELETE /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:21:09.673099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5cfb2c91-3e75-47bf-80de-0d1979f1e0c6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:09.673877 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5cfb2c91-3e75-47bf-80de-0d1979f1e0c6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:09.696505 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5cfb2c91-3e75-47bf-80de-0d1979f1e0c6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:09.696823 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5cfb2c91-3e75-47bf-80de-0d1979f1e0c6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:09.702322 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5cfb2c91-3e75-47bf-80de-0d1979f1e0c6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:09.704143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5cfb2c91-3e75-47bf-80de-0d1979f1e0c6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:09.704143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5cfb2c91-3e75-47bf-80de-0d1979f1e0c6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:09.704532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5cfb2c91-3e75-47bf-80de-0d1979f1e0c6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:10.210333 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5cfb2c91-3e75-47bf-80de-0d1979f1e0c6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:10.214279 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a81a3c59-572f-4e81-ae2f-2aba43682491 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:10.218428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a81a3c59-572f-4e81-ae2f-2aba43682491 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:10.232510 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5cfb2c91-3e75-47bf-80de-0d1979f1e0c6 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1512 microversion: 2.1 time: 0.559744 Aug 04 17:21:10.233224 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2805/5629] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:21:09 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1512 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:21:10.235469 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a81a3c59-572f-4e81-ae2f-2aba43682491 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:10.235984 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a81a3c59-572f-4e81-ae2f-2aba43682491 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:10.236432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a81a3c59-572f-4e81-ae2f-2aba43682491 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:10.237161 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a81a3c59-572f-4e81-ae2f-2aba43682491 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:10.237625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a81a3c59-572f-4e81-ae2f-2aba43682491 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:10.238089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a81a3c59-572f-4e81-ae2f-2aba43682491 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:10.609582 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a81a3c59-572f-4e81-ae2f-2aba43682491 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:10.624058 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a81a3c59-572f-4e81-ae2f-2aba43682491 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:10.630928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a81a3c59-572f-4e81-ae2f-2aba43682491 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:10.633868 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a81a3c59-572f-4e81-ae2f-2aba43682491 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 0.431001 Aug 04 17:21:10.637410 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2825/5630] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:10 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:21:11.257838 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c71f9289-8578-4459-a1f4-1226a4f39cff tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:11.258517 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c71f9289-8578-4459-a1f4-1226a4f39cff tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:11.270482 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c71f9289-8578-4459-a1f4-1226a4f39cff tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:11.273287 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c71f9289-8578-4459-a1f4-1226a4f39cff tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:11.279634 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c71f9289-8578-4459-a1f4-1226a4f39cff tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:11.289785 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c71f9289-8578-4459-a1f4-1226a4f39cff tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:11.291912 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c71f9289-8578-4459-a1f4-1226a4f39cff tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:11.293856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c71f9289-8578-4459-a1f4-1226a4f39cff tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:11.663091 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1d462ba9-1c67-4e9c-a21c-e2b19d58c3b1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:11.663714 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1d462ba9-1c67-4e9c-a21c-e2b19d58c3b1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:11.667423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:21:11.702136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d462ba9-1c67-4e9c-a21c-e2b19d58c3b1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:11.709642 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d462ba9-1c67-4e9c-a21c-e2b19d58c3b1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:11.710556 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d462ba9-1c67-4e9c-a21c-e2b19d58c3b1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:11.711724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d462ba9-1c67-4e9c-a21c-e2b19d58c3b1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:11.712679 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d462ba9-1c67-4e9c-a21c-e2b19d58c3b1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:11.713306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d462ba9-1c67-4e9c-a21c-e2b19d58c3b1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:12.534789 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c71f9289-8578-4459-a1f4-1226a4f39cff tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:12.551354 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c71f9289-8578-4459-a1f4-1226a4f39cff tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1512 microversion: 2.1 time: 1.297754 Aug 04 17:21:12.557029 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2806/5631] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:21:11 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1512 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:21:12.756955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1d462ba9-1c67-4e9c-a21c-e2b19d58c3b1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:12.776989 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1d462ba9-1c67-4e9c-a21c-e2b19d58c3b1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:12.783673 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1d462ba9-1c67-4e9c-a21c-e2b19d58c3b1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:12.785268 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1d462ba9-1c67-4e9c-a21c-e2b19d58c3b1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 1.127725 Aug 04 17:21:12.786522 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2826/5632] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:11 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:21:13.582584 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d7ea9db7-c7d0-4d07-a516-e58c4e31fb27 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:13.583219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d7ea9db7-c7d0-4d07-a516-e58c4e31fb27 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:13.605882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7ea9db7-c7d0-4d07-a516-e58c4e31fb27 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:13.608845 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7ea9db7-c7d0-4d07-a516-e58c4e31fb27 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:13.611209 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7ea9db7-c7d0-4d07-a516-e58c4e31fb27 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:13.613560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7ea9db7-c7d0-4d07-a516-e58c4e31fb27 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:13.615095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7ea9db7-c7d0-4d07-a516-e58c4e31fb27 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:13.616574 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7ea9db7-c7d0-4d07-a516-e58c4e31fb27 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:13.812534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d7ea9db7-c7d0-4d07-a516-e58c4e31fb27 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f21709d5ed549ffae941a6060ea6dcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7878e13541477b80e6ede62a2a8554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:13.814229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2af7848d-10ed-410a-b7c6-0f9b9fdd0068 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:13.814872 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2af7848d-10ed-410a-b7c6-0f9b9fdd0068 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:13.833492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2af7848d-10ed-410a-b7c6-0f9b9fdd0068 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:13.834100 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2af7848d-10ed-410a-b7c6-0f9b9fdd0068 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:13.834495 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d7ea9db7-c7d0-4d07-a516-e58c4e31fb27 tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 200 len: 1470 microversion: 2.1 time: 0.257642 Aug 04 17:21:13.834642 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2af7848d-10ed-410a-b7c6-0f9b9fdd0068 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:13.835339 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2af7848d-10ed-410a-b7c6-0f9b9fdd0068 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:13.835806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2af7848d-10ed-410a-b7c6-0f9b9fdd0068 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:13.836243 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2af7848d-10ed-410a-b7c6-0f9b9fdd0068 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:13.851484 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2807/5633] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:21:13 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 1470 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:21:14.002510 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-4767bb1e-6563-44a2-adf3-2355af1c4517 req-13f0b711-53dd-438d-9769-ac63014e4e31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5248dcdc-5a16-4036-9537-eb84f73dc372", "name": "network-vif-deleted", "tag": "620457fa-43b8-4d5c-9ed1-44c49f63239c"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:21:14.047427 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4767bb1e-6563-44a2-adf3-2355af1c4517 req-13f0b711-53dd-438d-9769-ac63014e4e31 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:14.051513 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4767bb1e-6563-44a2-adf3-2355af1c4517 req-13f0b711-53dd-438d-9769-ac63014e4e31 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:14.052053 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4767bb1e-6563-44a2-adf3-2355af1c4517 req-13f0b711-53dd-438d-9769-ac63014e4e31 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:14.088155 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-4767bb1e-6563-44a2-adf3-2355af1c4517 req-13f0b711-53dd-438d-9769-ac63014e4e31 service nova] Creating event network-vif-deleted:620457fa-43b8-4d5c-9ed1-44c49f63239c for instance 5248dcdc-5a16-4036-9537-eb84f73dc372 on n-h2-851359-3 Aug 04 17:21:14.095547 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-4767bb1e-6563-44a2-adf3-2355af1c4517 req-13f0b711-53dd-438d-9769-ac63014e4e31 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096781 Aug 04 17:21:14.096838 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2808/5634] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:21:14.876543 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6a8657d9-4f06-4545-8dc9-30190460ceaa tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:14.877769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6a8657d9-4f06-4545-8dc9-30190460ceaa tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] [instance: 5248dcdc-5a16-4036-9537-eb84f73dc372] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:14.931713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a8657d9-4f06-4545-8dc9-30190460ceaa tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:14.941485 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a8657d9-4f06-4545-8dc9-30190460ceaa tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:14.945717 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a8657d9-4f06-4545-8dc9-30190460ceaa tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:14.956798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a8657d9-4f06-4545-8dc9-30190460ceaa tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:14.964516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a8657d9-4f06-4545-8dc9-30190460ceaa tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:14.964762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a8657d9-4f06-4545-8dc9-30190460ceaa tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:15.010461 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-6a8657d9-4f06-4545-8dc9-30190460ceaa tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] HTTP exception thrown: Instance 5248dcdc-5a16-4036-9537-eb84f73dc372 could not be found. Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6a8657d9-4f06-4545-8dc9-30190460ceaa tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Request method failure captured: Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 HTTP/1.1 Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_7_-43-nhTRLEu9Zk--1yun8M60-bjPETxOSlpfT1zWa139I2Xa7XBaAtu3GNrfw3AtW1qQS8KiJr-RJMxVOz17wAr17tLwkHTVCNr4DCmrryOtuNd9s7ZATl2gqxzPDi4y8cDI2N0v0gEE_gvbyDxE4meq8pwA2fwSTF7I47q2tdI Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f7878e13541477b80e6ede62a2a8554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f7878e13541477b80e6ede62a2a8554"}]}] Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 5f7878e13541477b80e6ede62a2a8554 Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-995626917 Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 3f21709d5ed549ffae941a6060ea6dcb Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-995626917-project Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 5248dcdc-5a16-4036-9537-eb84f73dc372 could not be found. Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '5248dcdc-5a16-4036-9537-eb84f73dc372'} Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5248dcdc-5a16-4036-9537-eb84f73dc372 could not be found. Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5248dcdc-5a16-4036-9537-eb84f73dc372 could not be found. Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:21:15.014236 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:21:15.020639 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:21:15.020639 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:21:15.020639 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:21:15.020639 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:21:15.020639 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:21:15.020639 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5248dcdc-5a16-4036-9537-eb84f73dc372 could not be found. Aug 04 17:21:15.020639 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:21:15.022113 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6a8657d9-4f06-4545-8dc9-30190460ceaa tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] Returning 404 to user: Instance 5248dcdc-5a16-4036-9537-eb84f73dc372 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:21:15.024785 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6a8657d9-4f06-4545-8dc9-30190460ceaa tempest-ServersNegativeTestJSON-995626917 tempest-ServersNegativeTestJSON-995626917-project] 10.222.0.93 "GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372" status: 404 len: 111 microversion: 2.1 time: 0.156053 Aug 04 17:21:15.029711 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2809/5635] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:21:14 2022] GET /compute/v2.1/servers/5248dcdc-5a16-4036-9537-eb84f73dc372 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:21:15.374535 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2af7848d-10ed-410a-b7c6-0f9b9fdd0068 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:15.396468 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2af7848d-10ed-410a-b7c6-0f9b9fdd0068 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:15.401234 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2af7848d-10ed-410a-b7c6-0f9b9fdd0068 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:15.402838 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2af7848d-10ed-410a-b7c6-0f9b9fdd0068 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 1.592956 Aug 04 17:21:15.407909 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2827/5636] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:13 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:21:16.437371 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d271d2c7-3f0f-44c0-b4d7-ce2e0023a8f0 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:16.438477 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d271d2c7-3f0f-44c0-b4d7-ce2e0023a8f0 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:16.451971 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d271d2c7-3f0f-44c0-b4d7-ce2e0023a8f0 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:16.456614 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d271d2c7-3f0f-44c0-b4d7-ce2e0023a8f0 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:16.457256 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d271d2c7-3f0f-44c0-b4d7-ce2e0023a8f0 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:16.458358 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d271d2c7-3f0f-44c0-b4d7-ce2e0023a8f0 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:16.459104 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d271d2c7-3f0f-44c0-b4d7-ce2e0023a8f0 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:16.459640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d271d2c7-3f0f-44c0-b4d7-ce2e0023a8f0 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:17.460166 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d271d2c7-3f0f-44c0-b4d7-ce2e0023a8f0 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:17.484169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d271d2c7-3f0f-44c0-b4d7-ce2e0023a8f0 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:17.488186 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d271d2c7-3f0f-44c0-b4d7-ce2e0023a8f0 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:17.490528 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d271d2c7-3f0f-44c0-b4d7-ce2e0023a8f0 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 1.058522 Aug 04 17:21:17.492170 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2810/5637] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:16 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:21:18.526048 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9f699b0e-0665-49a1-8f93-7a470fb10681 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:18.527291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9f699b0e-0665-49a1-8f93-7a470fb10681 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:18.538949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f699b0e-0665-49a1-8f93-7a470fb10681 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:18.540489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f699b0e-0665-49a1-8f93-7a470fb10681 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:18.541212 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f699b0e-0665-49a1-8f93-7a470fb10681 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:18.544749 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f699b0e-0665-49a1-8f93-7a470fb10681 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:18.547364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f699b0e-0665-49a1-8f93-7a470fb10681 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:18.547800 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f699b0e-0665-49a1-8f93-7a470fb10681 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:19.069372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9f699b0e-0665-49a1-8f93-7a470fb10681 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:19.089458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9f699b0e-0665-49a1-8f93-7a470fb10681 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:19.092886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9f699b0e-0665-49a1-8f93-7a470fb10681 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:19.096355 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9f699b0e-0665-49a1-8f93-7a470fb10681 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 0.573467 Aug 04 17:21:19.098127 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2828/5638] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:18 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:21:20.138960 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4d214e1e-48f7-48f4-a9d7-f243ddebed6c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:20.139818 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4d214e1e-48f7-48f4-a9d7-f243ddebed6c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:20.151862 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d214e1e-48f7-48f4-a9d7-f243ddebed6c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:20.152270 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d214e1e-48f7-48f4-a9d7-f243ddebed6c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:20.152977 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d214e1e-48f7-48f4-a9d7-f243ddebed6c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:20.158118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d214e1e-48f7-48f4-a9d7-f243ddebed6c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:20.158663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d214e1e-48f7-48f4-a9d7-f243ddebed6c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:20.159130 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d214e1e-48f7-48f4-a9d7-f243ddebed6c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:20.246435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1fcd7c51-3251-4840-a3d2-400b5d43bc52 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:20.249103 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1fcd7c51-3251-4840-a3d2-400b5d43bc52 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:20.272184 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1fcd7c51-3251-4840-a3d2-400b5d43bc52 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:20.272691 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1fcd7c51-3251-4840-a3d2-400b5d43bc52 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:20.273145 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1fcd7c51-3251-4840-a3d2-400b5d43bc52 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:20.273883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1fcd7c51-3251-4840-a3d2-400b5d43bc52 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:20.285464 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1fcd7c51-3251-4840-a3d2-400b5d43bc52 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:20.288998 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1fcd7c51-3251-4840-a3d2-400b5d43bc52 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:21.011750 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1fcd7c51-3251-4840-a3d2-400b5d43bc52 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1832 microversion: 2.1 time: 0.772565 Aug 04 17:21:21.013404 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2829/5639] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:21:20 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1832 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:21:21.037469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4d214e1e-48f7-48f4-a9d7-f243ddebed6c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:21.037818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-19e55167-f48b-4486-8b92-ebbb36dc47ff tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:21.038269 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-19e55167-f48b-4486-8b92-ebbb36dc47ff tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:21.048760 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19e55167-f48b-4486-8b92-ebbb36dc47ff tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:21.050247 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19e55167-f48b-4486-8b92-ebbb36dc47ff tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:21.050721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19e55167-f48b-4486-8b92-ebbb36dc47ff tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:21.052438 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19e55167-f48b-4486-8b92-ebbb36dc47ff tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:21.054093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19e55167-f48b-4486-8b92-ebbb36dc47ff tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:21.054909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-19e55167-f48b-4486-8b92-ebbb36dc47ff tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:21.058081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4d214e1e-48f7-48f4-a9d7-f243ddebed6c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:21.061937 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4d214e1e-48f7-48f4-a9d7-f243ddebed6c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:21.066006 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4d214e1e-48f7-48f4-a9d7-f243ddebed6c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 0.933936 Aug 04 17:21:21.074996 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2811/5640] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:20 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:21:21.554397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-19e55167-f48b-4486-8b92-ebbb36dc47ff tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:21.571627 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-19e55167-f48b-4486-8b92-ebbb36dc47ff tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1681 microversion: 2.1 time: 0.538729 Aug 04 17:21:21.573206 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2830/5641] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:21:21 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1681 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:21:22.104655 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b04cc9d3-2b1a-4af4-9da4-811f64a9bbde tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:22.111262 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b04cc9d3-2b1a-4af4-9da4-811f64a9bbde tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:22.138693 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b04cc9d3-2b1a-4af4-9da4-811f64a9bbde tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:22.153627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b04cc9d3-2b1a-4af4-9da4-811f64a9bbde tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:22.160696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b04cc9d3-2b1a-4af4-9da4-811f64a9bbde tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:22.186287 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b04cc9d3-2b1a-4af4-9da4-811f64a9bbde tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:22.187441 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b04cc9d3-2b1a-4af4-9da4-811f64a9bbde tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:22.188745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b04cc9d3-2b1a-4af4-9da4-811f64a9bbde tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:22.388937 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2762a87e-3c3b-49c7-8d7a-c685f4d768f1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:21:22.393133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2762a87e-3c3b-49c7-8d7a-c685f4d768f1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:22.423541 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2762a87e-3c3b-49c7-8d7a-c685f4d768f1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:22.424289 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2762a87e-3c3b-49c7-8d7a-c685f4d768f1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:22.425581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2762a87e-3c3b-49c7-8d7a-c685f4d768f1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:22.427532 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2762a87e-3c3b-49c7-8d7a-c685f4d768f1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:22.429696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2762a87e-3c3b-49c7-8d7a-c685f4d768f1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:22.431317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2762a87e-3c3b-49c7-8d7a-c685f4d768f1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:22.567200 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2762a87e-3c3b-49c7-8d7a-c685f4d768f1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "POST /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57/action" status: 200 len: 32648 microversion: 2.1 time: 0.184826 Aug 04 17:21:22.571773 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2831/5642] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:21:22 2022] POST /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57/action => generated 32648 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 17:21:22.728436 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c150ccb9-d0ba-46ef-a603-2126e4789b98 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:21:22.729530 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c150ccb9-d0ba-46ef-a603-2126e4789b98 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:22.740563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c150ccb9-d0ba-46ef-a603-2126e4789b98 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:22.755646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c150ccb9-d0ba-46ef-a603-2126e4789b98 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:22.758707 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c150ccb9-d0ba-46ef-a603-2126e4789b98 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:22.759985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c150ccb9-d0ba-46ef-a603-2126e4789b98 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:22.760883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c150ccb9-d0ba-46ef-a603-2126e4789b98 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:22.774056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c150ccb9-d0ba-46ef-a603-2126e4789b98 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:23.484334 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b04cc9d3-2b1a-4af4-9da4-811f64a9bbde tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:23.501212 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b04cc9d3-2b1a-4af4-9da4-811f64a9bbde tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:23.502816 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b04cc9d3-2b1a-4af4-9da4-811f64a9bbde tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:23.508251 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b04cc9d3-2b1a-4af4-9da4-811f64a9bbde tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 1.410756 Aug 04 17:21:23.513555 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2812/5643] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:22 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:21:23.767127 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c150ccb9-d0ba-46ef-a603-2126e4789b98 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '00b0c65b4bdb4eaa9143b040ee970c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1191cd534df349d6b7bee43b152bec3c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:23.768236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c150ccb9-d0ba-46ef-a603-2126e4789b98 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] [instance: 596804f9-9964-419e-bed5-d24e20805b57] flavor_id is None. Assuming migration. {{(pid=131043) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 04 17:21:23.769352 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c150ccb9-d0ba-46ef-a603-2126e4789b98 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=131043) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 17:21:23.772813 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f6cf2b1f-1518-4019-9da4-5835ce7db457 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:23.775611 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f6cf2b1f-1518-4019-9da4-5835ce7db457 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:23.799793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6cf2b1f-1518-4019-9da4-5835ce7db457 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:23.800549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6cf2b1f-1518-4019-9da4-5835ce7db457 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:23.816270 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6cf2b1f-1518-4019-9da4-5835ce7db457 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:23.817483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6cf2b1f-1518-4019-9da4-5835ce7db457 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:23.825470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6cf2b1f-1518-4019-9da4-5835ce7db457 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:23.827972 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6cf2b1f-1518-4019-9da4-5835ce7db457 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:23.943204 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f6cf2b1f-1518-4019-9da4-5835ce7db457 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.173609 Aug 04 17:21:23.953910 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2813/5644] 10.222.0.93 () {60 vars in 1343 bytes} [Thu Aug 4 17:21:23 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8/os-volume_attachments => generated 25 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:21:24.115685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-76aade65-0173-480a-ac4e-cdac404cdfc2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:24.116188 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-76aade65-0173-480a-ac4e-cdac404cdfc2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:24.130844 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76aade65-0173-480a-ac4e-cdac404cdfc2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:24.132601 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76aade65-0173-480a-ac4e-cdac404cdfc2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:24.134726 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76aade65-0173-480a-ac4e-cdac404cdfc2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:24.135931 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76aade65-0173-480a-ac4e-cdac404cdfc2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:24.136693 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76aade65-0173-480a-ac4e-cdac404cdfc2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:24.137596 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76aade65-0173-480a-ac4e-cdac404cdfc2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:24.202390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-76aade65-0173-480a-ac4e-cdac404cdfc2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:21:24.511961 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-76aade65-0173-480a-ac4e-cdac404cdfc2 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 204 len: 0 microversion: 2.20 time: 0.400664 Aug 04 17:21:24.512758 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2814/5645] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Aug 4 17:21:24 2022] DELETE /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 04 17:21:24.555186 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fbfcd57b-fb8c-4183-9e8b-9e6c9fed512e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:24.558568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fbfcd57b-fb8c-4183-9e8b-9e6c9fed512e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:24.595799 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbfcd57b-fb8c-4183-9e8b-9e6c9fed512e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:24.596827 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbfcd57b-fb8c-4183-9e8b-9e6c9fed512e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:24.597510 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbfcd57b-fb8c-4183-9e8b-9e6c9fed512e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:24.598577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbfcd57b-fb8c-4183-9e8b-9e6c9fed512e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:24.599620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbfcd57b-fb8c-4183-9e8b-9e6c9fed512e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:24.600730 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbfcd57b-fb8c-4183-9e8b-9e6c9fed512e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:24.771810 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c150ccb9-d0ba-46ef-a603-2126e4789b98 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57/action" status: 202 len: 0 microversion: 2.1 time: 2.053685 Aug 04 17:21:24.774662 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2832/5646] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:21:22 2022] POST /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57/action => generated 0 bytes in 2058 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:21:24.787259 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-58a08479-6f07-4c52-9554-58cae675c154 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:24.811997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-58a08479-6f07-4c52-9554-58cae675c154 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:24.843193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-58a08479-6f07-4c52-9554-58cae675c154 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:24.844506 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-58a08479-6f07-4c52-9554-58cae675c154 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:24.845591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-58a08479-6f07-4c52-9554-58cae675c154 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:24.846909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-58a08479-6f07-4c52-9554-58cae675c154 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:24.848317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-58a08479-6f07-4c52-9554-58cae675c154 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:24.855229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-58a08479-6f07-4c52-9554-58cae675c154 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:25.356041 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fbfcd57b-fb8c-4183-9e8b-9e6c9fed512e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:25.366506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fbfcd57b-fb8c-4183-9e8b-9e6c9fed512e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:25.368489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fbfcd57b-fb8c-4183-9e8b-9e6c9fed512e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:25.370076 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fbfcd57b-fb8c-4183-9e8b-9e6c9fed512e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1724 microversion: 2.20 time: 0.845254 Aug 04 17:21:25.371664 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2815/5647] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:24 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1724 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:21:25.376915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-37cb697a-3858-4f1c-9e54-6e2e9cbe842d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:25.377841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-37cb697a-3858-4f1c-9e54-6e2e9cbe842d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:25.390843 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37cb697a-3858-4f1c-9e54-6e2e9cbe842d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:25.392591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37cb697a-3858-4f1c-9e54-6e2e9cbe842d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:25.393249 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37cb697a-3858-4f1c-9e54-6e2e9cbe842d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:25.394224 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37cb697a-3858-4f1c-9e54-6e2e9cbe842d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:25.397407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37cb697a-3858-4f1c-9e54-6e2e9cbe842d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:25.398227 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37cb697a-3858-4f1c-9e54-6e2e9cbe842d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:25.488334 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-58a08479-6f07-4c52-9554-58cae675c154 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:25.525890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-58a08479-6f07-4c52-9554-58cae675c154 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:25.527800 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-58a08479-6f07-4c52-9554-58cae675c154 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:25.529145 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-58a08479-6f07-4c52-9554-58cae675c154 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 0.753232 Aug 04 17:21:25.548817 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2833/5648] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:24 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:21:25.969812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-37cb697a-3858-4f1c-9e54-6e2e9cbe842d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:25.995910 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-37cb697a-3858-4f1c-9e54-6e2e9cbe842d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1690 microversion: 2.1 time: 0.619009 Aug 04 17:21:25.997382 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2816/5649] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:21:25 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1690 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:21:26.399262 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-36bcfa0b-6a4c-44b1-ada5-267f1ed220f4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:26.400371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-36bcfa0b-6a4c-44b1-ada5-267f1ed220f4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:26.427202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-36bcfa0b-6a4c-44b1-ada5-267f1ed220f4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:26.427716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-36bcfa0b-6a4c-44b1-ada5-267f1ed220f4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:26.428173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-36bcfa0b-6a4c-44b1-ada5-267f1ed220f4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:26.428913 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-36bcfa0b-6a4c-44b1-ada5-267f1ed220f4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:26.429390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-36bcfa0b-6a4c-44b1-ada5-267f1ed220f4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:26.429832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-36bcfa0b-6a4c-44b1-ada5-267f1ed220f4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:26.561827 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3f696a99-55e9-4f53-a19a-550fe53a9057 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:26.583070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3f696a99-55e9-4f53-a19a-550fe53a9057 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:26.610632 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f696a99-55e9-4f53-a19a-550fe53a9057 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:26.623043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f696a99-55e9-4f53-a19a-550fe53a9057 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:26.624224 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f696a99-55e9-4f53-a19a-550fe53a9057 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:26.625314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f696a99-55e9-4f53-a19a-550fe53a9057 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:26.625967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f696a99-55e9-4f53-a19a-550fe53a9057 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:26.626614 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f696a99-55e9-4f53-a19a-550fe53a9057 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:27.466661 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3f696a99-55e9-4f53-a19a-550fe53a9057 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:27.478813 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3f696a99-55e9-4f53-a19a-550fe53a9057 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:27.493655 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3f696a99-55e9-4f53-a19a-550fe53a9057 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:27.495074 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3f696a99-55e9-4f53-a19a-550fe53a9057 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 0.941803 Aug 04 17:21:27.496923 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2817/5650] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:26 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:21:27.512034 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7e5c5a44-2f8a-4585-a98b-2ddd46735402 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:27.513023 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7e5c5a44-2f8a-4585-a98b-2ddd46735402 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:27.532521 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e5c5a44-2f8a-4585-a98b-2ddd46735402 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:27.533237 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e5c5a44-2f8a-4585-a98b-2ddd46735402 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:27.534142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e5c5a44-2f8a-4585-a98b-2ddd46735402 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:27.538747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e5c5a44-2f8a-4585-a98b-2ddd46735402 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:27.539794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e5c5a44-2f8a-4585-a98b-2ddd46735402 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:27.540584 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e5c5a44-2f8a-4585-a98b-2ddd46735402 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:27.629418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-36bcfa0b-6a4c-44b1-ada5-267f1ed220f4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:27.686675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-36bcfa0b-6a4c-44b1-ada5-267f1ed220f4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:27.697484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-36bcfa0b-6a4c-44b1-ada5-267f1ed220f4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:27.704076 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-36bcfa0b-6a4c-44b1-ada5-267f1ed220f4 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1724 microversion: 2.20 time: 1.311616 Aug 04 17:21:27.707587 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2834/5651] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:26 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1724 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:21:28.289927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7e5c5a44-2f8a-4585-a98b-2ddd46735402 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:28.319053 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7e5c5a44-2f8a-4585-a98b-2ddd46735402 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1690 microversion: 2.1 time: 0.820283 Aug 04 17:21:28.338072 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2818/5652] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:21:27 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1690 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:21:28.526405 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4e27105a-509e-4211-b4b0-ccd4c31ba4b1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:28.528670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4e27105a-509e-4211-b4b0-ccd4c31ba4b1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:28.538911 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e27105a-509e-4211-b4b0-ccd4c31ba4b1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:28.540461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e27105a-509e-4211-b4b0-ccd4c31ba4b1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:28.541434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e27105a-509e-4211-b4b0-ccd4c31ba4b1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:28.542794 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e27105a-509e-4211-b4b0-ccd4c31ba4b1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:28.543596 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e27105a-509e-4211-b4b0-ccd4c31ba4b1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:28.544894 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e27105a-509e-4211-b4b0-ccd4c31ba4b1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:28.580299 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:21:28.732272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d9940933-dd10-496a-af4d-7fdad5a1b41b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:28.732907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d9940933-dd10-496a-af4d-7fdad5a1b41b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:28.743884 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9940933-dd10-496a-af4d-7fdad5a1b41b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:28.744530 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9940933-dd10-496a-af4d-7fdad5a1b41b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:28.745096 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9940933-dd10-496a-af4d-7fdad5a1b41b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:28.746040 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9940933-dd10-496a-af4d-7fdad5a1b41b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:28.746814 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9940933-dd10-496a-af4d-7fdad5a1b41b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:28.747422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9940933-dd10-496a-af4d-7fdad5a1b41b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:29.284930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4e27105a-509e-4211-b4b0-ccd4c31ba4b1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:29.301503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4e27105a-509e-4211-b4b0-ccd4c31ba4b1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:29.304192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4e27105a-509e-4211-b4b0-ccd4c31ba4b1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:29.306153 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4e27105a-509e-4211-b4b0-ccd4c31ba4b1 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 0.784904 Aug 04 17:21:29.322814 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2835/5653] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:28 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:21:29.383841 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5b152b16-3271-40e8-a914-65d9d7a34681 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:29.388158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5b152b16-3271-40e8-a914-65d9d7a34681 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:29.403734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b152b16-3271-40e8-a914-65d9d7a34681 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:29.404866 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b152b16-3271-40e8-a914-65d9d7a34681 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:29.405798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b152b16-3271-40e8-a914-65d9d7a34681 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:29.407486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b152b16-3271-40e8-a914-65d9d7a34681 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:29.408532 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b152b16-3271-40e8-a914-65d9d7a34681 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:29.410153 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b152b16-3271-40e8-a914-65d9d7a34681 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:29.531888 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d9940933-dd10-496a-af4d-7fdad5a1b41b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:29.565009 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d9940933-dd10-496a-af4d-7fdad5a1b41b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:29.573700 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d9940933-dd10-496a-af4d-7fdad5a1b41b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:29.584684 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d9940933-dd10-496a-af4d-7fdad5a1b41b tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1724 microversion: 2.20 time: 0.856584 Aug 04 17:21:29.599625 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2819/5654] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:28 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1724 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:21:29.943819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5b152b16-3271-40e8-a914-65d9d7a34681 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:29.971705 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5b152b16-3271-40e8-a914-65d9d7a34681 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1690 microversion: 2.1 time: 0.610209 Aug 04 17:21:29.978250 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2836/5655] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:21:29 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1690 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:21:30.348267 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1817f5a9-2c3d-44fe-8aa4-8ca11e755f21 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:30.349651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1817f5a9-2c3d-44fe-8aa4-8ca11e755f21 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:30.365557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1817f5a9-2c3d-44fe-8aa4-8ca11e755f21 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:30.368272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1817f5a9-2c3d-44fe-8aa4-8ca11e755f21 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:30.369411 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1817f5a9-2c3d-44fe-8aa4-8ca11e755f21 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:30.374308 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1817f5a9-2c3d-44fe-8aa4-8ca11e755f21 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:30.375638 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1817f5a9-2c3d-44fe-8aa4-8ca11e755f21 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:30.378429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1817f5a9-2c3d-44fe-8aa4-8ca11e755f21 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:30.594516 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-0265a961-8676-42e0-8920-b66061f5ffa7 req-d0a1fd28-c7f3-4754-8e78-64a26c817544 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7dd09c1-f3da-438a-b0d8-1102ee2d67f8", "name": "network-vif-deleted", "tag": "1dd4fc9a-a07b-4b63-82e0-ad9da9f1b5b2"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:21:30.618294 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-0265a961-8676-42e0-8920-b66061f5ffa7 req-d0a1fd28-c7f3-4754-8e78-64a26c817544 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:30.618883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-0265a961-8676-42e0-8920-b66061f5ffa7 req-d0a1fd28-c7f3-4754-8e78-64a26c817544 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:30.620029 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-0265a961-8676-42e0-8920-b66061f5ffa7 req-d0a1fd28-c7f3-4754-8e78-64a26c817544 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:30.656946 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-0265a961-8676-42e0-8920-b66061f5ffa7 req-d0a1fd28-c7f3-4754-8e78-64a26c817544 service nova] Creating event network-vif-deleted:1dd4fc9a-a07b-4b63-82e0-ad9da9f1b5b2 for instance e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 on n-h2-851359-3 Aug 04 17:21:30.669423 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-0265a961-8676-42e0-8920-b66061f5ffa7 req-d0a1fd28-c7f3-4754-8e78-64a26c817544 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072886 Aug 04 17:21:30.670691 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2837/5656] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:21:30.681676 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c29dce69-f250-490a-96ce-020f903828d8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:30.689490 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c29dce69-f250-490a-96ce-020f903828d8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:30.703474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c29dce69-f250-490a-96ce-020f903828d8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:30.708148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c29dce69-f250-490a-96ce-020f903828d8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:30.709027 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c29dce69-f250-490a-96ce-020f903828d8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:30.715993 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c29dce69-f250-490a-96ce-020f903828d8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:30.716813 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c29dce69-f250-490a-96ce-020f903828d8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:30.717448 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c29dce69-f250-490a-96ce-020f903828d8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:30.877745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c29dce69-f250-490a-96ce-020f903828d8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:30.904667 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c29dce69-f250-490a-96ce-020f903828d8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:30.911862 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c29dce69-f250-490a-96ce-020f903828d8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '023dd49bea644899a427669f3c1b461e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cc22c8c06b40ae961464cb3e300cba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:30.916279 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c29dce69-f250-490a-96ce-020f903828d8 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 200 len: 1367 microversion: 2.20 time: 0.241645 Aug 04 17:21:30.918382 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2838/5657] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:30 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:21:31.005013 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1817f5a9-2c3d-44fe-8aa4-8ca11e755f21 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:31.005757 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f894795c-0cf1-4423-a5ea-b50cb9a1ef8a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:31.008131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f894795c-0cf1-4423-a5ea-b50cb9a1ef8a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:31.032430 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1817f5a9-2c3d-44fe-8aa4-8ca11e755f21 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:31.036199 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1817f5a9-2c3d-44fe-8aa4-8ca11e755f21 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:31.037811 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1817f5a9-2c3d-44fe-8aa4-8ca11e755f21 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 0.694582 Aug 04 17:21:31.039182 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f894795c-0cf1-4423-a5ea-b50cb9a1ef8a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:31.040363 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f894795c-0cf1-4423-a5ea-b50cb9a1ef8a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:31.041450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f894795c-0cf1-4423-a5ea-b50cb9a1ef8a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:31.043026 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f894795c-0cf1-4423-a5ea-b50cb9a1ef8a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:31.044925 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f894795c-0cf1-4423-a5ea-b50cb9a1ef8a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:31.045949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f894795c-0cf1-4423-a5ea-b50cb9a1ef8a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:31.059089 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2820/5658] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:30 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:21:31.533625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f894795c-0cf1-4423-a5ea-b50cb9a1ef8a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:31.559671 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f894795c-0cf1-4423-a5ea-b50cb9a1ef8a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1690 microversion: 2.1 time: 0.560876 Aug 04 17:21:31.560673 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2839/5659] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:21:30 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1690 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:21:31.943555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5cdf1f8b-cb29-4156-a29e-676c8efe6580 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:31.944510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5cdf1f8b-cb29-4156-a29e-676c8efe6580 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:31.964851 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5cdf1f8b-cb29-4156-a29e-676c8efe6580 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:31.965765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5cdf1f8b-cb29-4156-a29e-676c8efe6580 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:31.966521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5cdf1f8b-cb29-4156-a29e-676c8efe6580 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:31.968197 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5cdf1f8b-cb29-4156-a29e-676c8efe6580 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:31.969302 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5cdf1f8b-cb29-4156-a29e-676c8efe6580 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:31.971428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5cdf1f8b-cb29-4156-a29e-676c8efe6580 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:32.011851 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-5cdf1f8b-cb29-4156-a29e-676c8efe6580 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] HTTP exception thrown: Instance e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 could not be found. Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5cdf1f8b-cb29-4156-a29e-676c8efe6580 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Request method failure captured: Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 HTTP/1.1 Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_21cg1PqIDvYXgybLbIpUp4-HNyMc1ajyJOqZi0IDAb3yTDXkMJQy5pICV1Wkh8n1jB3os8RCllz2dxAPec7OcKYuuzrI5PO5yGCPDwvLtZPgHWq1aD9IW2AQdVTCs4RoF5aEJRSI9MSs9bRRtuDuDXQAsaGi4ERRQKwRryAc3dfuo Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: a2cc22c8c06b40ae961464cb3e300cba Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2110834559 Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a2cc22c8c06b40ae961464cb3e300cba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a2cc22c8c06b40ae961464cb3e300cba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a2cc22c8c06b40ae961464cb3e300cba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a2cc22c8c06b40ae961464cb3e300cba"}]}] Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2110834559 Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: a2cc22c8c06b40ae961464cb3e300cba Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2110834559 Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-AttachVolumeShelveTestJSON-2110834559-project Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 023dd49bea644899a427669f3c1b461e Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2110834559-project Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 could not be found. Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'e7dd09c1-f3da-438a-b0d8-1102ee2d67f8'} Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 could not be found. Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 could not be found. Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:21:32.013919 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:21:32.023232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:21:32.023232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:21:32.023232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:21:32.023232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:21:32.023232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:21:32.023232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:21:32.023232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 could not be found. Aug 04 17:21:32.023232 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:21:32.023232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5cdf1f8b-cb29-4156-a29e-676c8efe6580 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Returning 404 to user: Instance e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:21:32.023232 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5cdf1f8b-cb29-4156-a29e-676c8efe6580 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 404 len: 111 microversion: 2.20 time: 0.077421 Aug 04 17:21:32.023232 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2840/5660] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:31 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 04 17:21:32.030461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a3091eae-1097-4b58-9004-7e0136604502 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '.version_select at 0x7f1e5bd6a700>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:32.082388 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a3091eae-1097-4b58-9004-7e0136604502 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1401727609" status: 204 len: 0 microversion: 2.20 time: 0.058485 Aug 04 17:21:32.086094 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2841/5661] 10.222.0.93 () {60 vars in 1262 bytes} [Thu Aug 4 17:21:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1401727609 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:21:32.110707 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0c3af61e-4e59-4530-9f88-a5ad15fde8a4 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:32.113537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0c3af61e-4e59-4530-9f88-a5ad15fde8a4 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:32.153698 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c3af61e-4e59-4530-9f88-a5ad15fde8a4 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:32.160278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c3af61e-4e59-4530-9f88-a5ad15fde8a4 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:32.161449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c3af61e-4e59-4530-9f88-a5ad15fde8a4 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:32.166089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c3af61e-4e59-4530-9f88-a5ad15fde8a4 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:32.166610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c3af61e-4e59-4530-9f88-a5ad15fde8a4 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:32.167083 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0c3af61e-4e59-4530-9f88-a5ad15fde8a4 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:32.258214 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-94b25111-a0bb-40c5-8a8f-fdb971954be3 tempest-PortsAdminExtendedAttrsTestJSON-2037058629 tempest-PortsAdminExtendedAttrsTestJSON-2037058629-project-admin] Calling method '.version_select at 0x7f1e6c908c10>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:32.259947 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:21:32.259947 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 17:21:32.261882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94b25111-a0bb-40c5-8a8f-fdb971954be3 tempest-PortsAdminExtendedAttrsTestJSON-2037058629 tempest-PortsAdminExtendedAttrsTestJSON-2037058629-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:32.275502 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94b25111-a0bb-40c5-8a8f-fdb971954be3 tempest-PortsAdminExtendedAttrsTestJSON-2037058629 tempest-PortsAdminExtendedAttrsTestJSON-2037058629-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:32.277049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94b25111-a0bb-40c5-8a8f-fdb971954be3 tempest-PortsAdminExtendedAttrsTestJSON-2037058629 tempest-PortsAdminExtendedAttrsTestJSON-2037058629-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:32.316021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:21:32.376365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94b25111-a0bb-40c5-8a8f-fdb971954be3 tempest-PortsAdminExtendedAttrsTestJSON-2037058629 tempest-PortsAdminExtendedAttrsTestJSON-2037058629-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:32.379157 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94b25111-a0bb-40c5-8a8f-fdb971954be3 tempest-PortsAdminExtendedAttrsTestJSON-2037058629 tempest-PortsAdminExtendedAttrsTestJSON-2037058629-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:32.382195 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94b25111-a0bb-40c5-8a8f-fdb971954be3 tempest-PortsAdminExtendedAttrsTestJSON-2037058629 tempest-PortsAdminExtendedAttrsTestJSON-2037058629-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:32.432511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94b25111-a0bb-40c5-8a8f-fdb971954be3 tempest-PortsAdminExtendedAttrsTestJSON-2037058629 tempest-PortsAdminExtendedAttrsTestJSON-2037058629-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:32.435069 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94b25111-a0bb-40c5-8a8f-fdb971954be3 tempest-PortsAdminExtendedAttrsTestJSON-2037058629 tempest-PortsAdminExtendedAttrsTestJSON-2037058629-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:32.437306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94b25111-a0bb-40c5-8a8f-fdb971954be3 tempest-PortsAdminExtendedAttrsTestJSON-2037058629 tempest-PortsAdminExtendedAttrsTestJSON-2037058629-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:32.454312 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-94b25111-a0bb-40c5-8a8f-fdb971954be3 tempest-PortsAdminExtendedAttrsTestJSON-2037058629 tempest-PortsAdminExtendedAttrsTestJSON-2037058629-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.876551 Aug 04 17:21:32.457512 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2821/5662] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 17:21:31 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:21:32.610764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-11643c8d-3566-4200-bf7a-52fcff59c44d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:32.612376 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-11643c8d-3566-4200-bf7a-52fcff59c44d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:32.623053 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:21:32.631118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11643c8d-3566-4200-bf7a-52fcff59c44d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:32.633524 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11643c8d-3566-4200-bf7a-52fcff59c44d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:32.635070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11643c8d-3566-4200-bf7a-52fcff59c44d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:32.636659 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11643c8d-3566-4200-bf7a-52fcff59c44d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:32.637557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11643c8d-3566-4200-bf7a-52fcff59c44d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:32.638986 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11643c8d-3566-4200-bf7a-52fcff59c44d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:32.662065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0c3af61e-4e59-4530-9f88-a5ad15fde8a4 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:32.685332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0c3af61e-4e59-4530-9f88-a5ad15fde8a4 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:32.693312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0c3af61e-4e59-4530-9f88-a5ad15fde8a4 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:32.696731 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0c3af61e-4e59-4530-9f88-a5ad15fde8a4 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 0.606282 Aug 04 17:21:32.702510 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2842/5663] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:32 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:21:33.113143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-11643c8d-3566-4200-bf7a-52fcff59c44d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:33.128936 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-11643c8d-3566-4200-bf7a-52fcff59c44d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1695 microversion: 2.1 time: 0.539199 Aug 04 17:21:33.129545 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2822/5664] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:21:32 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1695 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:21:33.633603 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0c3af61e-4e59-4530-9f88-a5ad15fde8a4 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:33.639218 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0c3af61e-4e59-4530-9f88-a5ad15fde8a4 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute//" status: 200 len: 377 microversion: - time: 0.005759 Aug 04 17:21:33.641775 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2843/5665] 10.222.0.93 () {56 vars in 886 bytes} [Thu Aug 4 17:21:33 2022] GET /compute/ => generated 377 bytes in 10 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 04 17:21:33.750937 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-62d25b19-e6df-4114-a6bc-bb36219d461a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:33.751736 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-62d25b19-e6df-4114-a6bc-bb36219d461a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:33.804248 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62d25b19-e6df-4114-a6bc-bb36219d461a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:33.804977 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62d25b19-e6df-4114-a6bc-bb36219d461a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:33.806766 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62d25b19-e6df-4114-a6bc-bb36219d461a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:33.808558 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62d25b19-e6df-4114-a6bc-bb36219d461a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:33.812731 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62d25b19-e6df-4114-a6bc-bb36219d461a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:33.814574 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62d25b19-e6df-4114-a6bc-bb36219d461a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:34.153579 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8d32f673-1049-4173-af80-b7ea102dd1cd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:34.154643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8d32f673-1049-4173-af80-b7ea102dd1cd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:34.176790 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d32f673-1049-4173-af80-b7ea102dd1cd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:34.179150 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d32f673-1049-4173-af80-b7ea102dd1cd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:34.180020 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d32f673-1049-4173-af80-b7ea102dd1cd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:34.181363 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d32f673-1049-4173-af80-b7ea102dd1cd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:34.182571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d32f673-1049-4173-af80-b7ea102dd1cd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:34.187494 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d32f673-1049-4173-af80-b7ea102dd1cd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:35.308150 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-62d25b19-e6df-4114-a6bc-bb36219d461a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:35.325886 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-62d25b19-e6df-4114-a6bc-bb36219d461a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:35.330439 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-62d25b19-e6df-4114-a6bc-bb36219d461a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:35.332188 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-62d25b19-e6df-4114-a6bc-bb36219d461a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 1.588072 Aug 04 17:21:35.333559 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2823/5666] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:33 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:21:35.492551 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8d32f673-1049-4173-af80-b7ea102dd1cd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:35.507503 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8d32f673-1049-4173-af80-b7ea102dd1cd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1695 microversion: 2.1 time: 1.360173 Aug 04 17:21:35.526035 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2844/5667] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:21:34 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1695 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:21:36.369216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cda4c4da-9fc1-419e-98eb-3d25a6824b5b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:36.374577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cda4c4da-9fc1-419e-98eb-3d25a6824b5b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:36.400043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cda4c4da-9fc1-419e-98eb-3d25a6824b5b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:36.400043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cda4c4da-9fc1-419e-98eb-3d25a6824b5b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:36.400630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cda4c4da-9fc1-419e-98eb-3d25a6824b5b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:36.401792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cda4c4da-9fc1-419e-98eb-3d25a6824b5b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:36.402653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cda4c4da-9fc1-419e-98eb-3d25a6824b5b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:36.403345 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cda4c4da-9fc1-419e-98eb-3d25a6824b5b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:36.529945 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4415d2ed-6c08-409e-8006-6fbed036a171 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:36.531137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4415d2ed-6c08-409e-8006-6fbed036a171 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:36.544093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4415d2ed-6c08-409e-8006-6fbed036a171 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:36.550467 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4415d2ed-6c08-409e-8006-6fbed036a171 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:36.551122 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4415d2ed-6c08-409e-8006-6fbed036a171 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:36.559620 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4415d2ed-6c08-409e-8006-6fbed036a171 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:36.560384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4415d2ed-6c08-409e-8006-6fbed036a171 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:36.561204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4415d2ed-6c08-409e-8006-6fbed036a171 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:37.036281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cda4c4da-9fc1-419e-98eb-3d25a6824b5b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:37.048631 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cda4c4da-9fc1-419e-98eb-3d25a6824b5b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:37.060418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cda4c4da-9fc1-419e-98eb-3d25a6824b5b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:37.067812 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cda4c4da-9fc1-419e-98eb-3d25a6824b5b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 0.710505 Aug 04 17:21:37.069384 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2824/5668] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:36 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:21:37.107742 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4415d2ed-6c08-409e-8006-6fbed036a171 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:37.123617 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4415d2ed-6c08-409e-8006-6fbed036a171 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1695 microversion: 2.1 time: 0.597807 Aug 04 17:21:37.125129 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2845/5669] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:21:36 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1695 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:21:38.105281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3f6c76f0-6a68-4acb-98d1-05e87c44a94c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:38.107727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3f6c76f0-6a68-4acb-98d1-05e87c44a94c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:38.127191 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f6c76f0-6a68-4acb-98d1-05e87c44a94c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:38.132778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f6c76f0-6a68-4acb-98d1-05e87c44a94c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:38.133709 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f6c76f0-6a68-4acb-98d1-05e87c44a94c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:38.136622 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f6c76f0-6a68-4acb-98d1-05e87c44a94c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:38.138505 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f6c76f0-6a68-4acb-98d1-05e87c44a94c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:38.140110 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f6c76f0-6a68-4acb-98d1-05e87c44a94c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:38.154841 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-63a44340-6797-41d7-a3b4-49360815848a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:38.156304 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-63a44340-6797-41d7-a3b4-49360815848a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:38.176176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63a44340-6797-41d7-a3b4-49360815848a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:38.178891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63a44340-6797-41d7-a3b4-49360815848a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:38.181747 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63a44340-6797-41d7-a3b4-49360815848a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:38.186755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63a44340-6797-41d7-a3b4-49360815848a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:38.188967 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63a44340-6797-41d7-a3b4-49360815848a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:38.191000 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63a44340-6797-41d7-a3b4-49360815848a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:39.003858 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-63a44340-6797-41d7-a3b4-49360815848a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:39.022751 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-63a44340-6797-41d7-a3b4-49360815848a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1695 microversion: 2.1 time: 0.872090 Aug 04 17:21:39.031037 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2846/5670] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:21:38 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1695 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:21:39.042926 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3f6c76f0-6a68-4acb-98d1-05e87c44a94c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:39.066589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3f6c76f0-6a68-4acb-98d1-05e87c44a94c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:39.076325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3f6c76f0-6a68-4acb-98d1-05e87c44a94c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:39.079550 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3f6c76f0-6a68-4acb-98d1-05e87c44a94c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 0.979204 Aug 04 17:21:39.084471 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2825/5671] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:38 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:21:39.799274 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-150aebc1-5647-4cf8-bf68-33857e6b90b7 tempest-QuotasTestJSON-811286352 tempest-QuotasTestJSON-811286352-project] Calling method '.version_select at 0x7f1e5a396700>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:40.058342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bd59edc1-3633-4a19-bb82-c21e334db694 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:40.059733 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bd59edc1-3633-4a19-bb82-c21e334db694 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:40.071985 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd59edc1-3633-4a19-bb82-c21e334db694 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:40.072493 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd59edc1-3633-4a19-bb82-c21e334db694 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:40.072955 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd59edc1-3633-4a19-bb82-c21e334db694 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:40.073695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd59edc1-3633-4a19-bb82-c21e334db694 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:40.078864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd59edc1-3633-4a19-bb82-c21e334db694 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:40.079425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd59edc1-3633-4a19-bb82-c21e334db694 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:40.493312 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-150aebc1-5647-4cf8-bf68-33857e6b90b7 tempest-QuotasTestJSON-811286352 tempest-QuotasTestJSON-811286352-project] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/412fc44971234610a52e6f4c2c27bc53/defaults" status: 200 len: 371 microversion: 2.1 time: 1.441578 Aug 04 17:21:40.493915 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2847/5672] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Aug 4 17:21:39 2022] GET /compute/v2.1/os-quota-sets/412fc44971234610a52e6f4c2c27bc53/defaults => generated 371 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:21:40.516511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6afb9442-9719-46f9-8bd9-1a9bee19d1e3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:40.517754 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6afb9442-9719-46f9-8bd9-1a9bee19d1e3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:40.526781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6afb9442-9719-46f9-8bd9-1a9bee19d1e3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:40.528172 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6afb9442-9719-46f9-8bd9-1a9bee19d1e3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:40.529057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6afb9442-9719-46f9-8bd9-1a9bee19d1e3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:40.530726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6afb9442-9719-46f9-8bd9-1a9bee19d1e3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:40.534557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6afb9442-9719-46f9-8bd9-1a9bee19d1e3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:40.535741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6afb9442-9719-46f9-8bd9-1a9bee19d1e3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:40.769591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bd59edc1-3633-4a19-bb82-c21e334db694 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:40.789245 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bd59edc1-3633-4a19-bb82-c21e334db694 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1695 microversion: 2.1 time: 0.735008 Aug 04 17:21:40.790344 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2826/5673] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:21:40 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1695 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:21:40.811585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5eae399b-b7a6-4bea-ac9e-2eeec7284f96 tempest-QuotasTestJSON-811286352 tempest-QuotasTestJSON-811286352-project] Calling method '.version_select at 0x7f1e5a34d8b0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:41.310982 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6afb9442-9719-46f9-8bd9-1a9bee19d1e3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:41.334218 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6afb9442-9719-46f9-8bd9-1a9bee19d1e3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:41.342120 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6afb9442-9719-46f9-8bd9-1a9bee19d1e3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:41.348843 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6afb9442-9719-46f9-8bd9-1a9bee19d1e3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 0.849466 Aug 04 17:21:41.359701 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2848/5674] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:40 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:21:41.433378 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5eae399b-b7a6-4bea-ac9e-2eeec7284f96 tempest-QuotasTestJSON-811286352 tempest-QuotasTestJSON-811286352-project] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/412fc44971234610a52e6f4c2c27bc53" status: 200 len: 371 microversion: 2.1 time: 0.641234 Aug 04 17:21:41.442542 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2827/5675] 10.222.0.93 () {58 vars in 1242 bytes} [Thu Aug 4 17:21:40 2022] GET /compute/v2.1/os-quota-sets/412fc44971234610a52e6f4c2c27bc53 => generated 371 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:21:41.452147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d875cf11-d9cb-4cd2-9fad-91fed269f456 tempest-QuotasTestJSON-811286352 tempest-QuotasTestJSON-811286352-project] Calling method '.version_select at 0x7f1e5a398280>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:41.649286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3549e32d-e931-4006-b0ae-f49af16e0360 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:41.651116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3549e32d-e931-4006-b0ae-f49af16e0360 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:41.664508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3549e32d-e931-4006-b0ae-f49af16e0360 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:41.666060 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3549e32d-e931-4006-b0ae-f49af16e0360 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:41.666881 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3549e32d-e931-4006-b0ae-f49af16e0360 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:41.668036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3549e32d-e931-4006-b0ae-f49af16e0360 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:41.668798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3549e32d-e931-4006-b0ae-f49af16e0360 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:41.669496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3549e32d-e931-4006-b0ae-f49af16e0360 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:41.702189 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-3549e32d-e931-4006-b0ae-f49af16e0360 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] HTTP exception thrown: Instance e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 could not be found. Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3549e32d-e931-4006-b0ae-f49af16e0360 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Request method failure captured: Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 HTTP/1.1 Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_21cg1PqIDvYXgybLbIpUp4-HNyMc1ajyJOqZi0IDAb3yTDXkMJQy5pICV1Wkh8n1jB3os8RCllz2dxAPec7OcKYuuzrI5PO5yGCPDwvLtZPgHWq1aD9IW2AQdVTCs4RoF5aEJRSI9MSs9bRRtuDuDXQAsaGi4ERRQKwRryAc3dfuo Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: a2cc22c8c06b40ae961464cb3e300cba Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2110834559 Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a2cc22c8c06b40ae961464cb3e300cba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a2cc22c8c06b40ae961464cb3e300cba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a2cc22c8c06b40ae961464cb3e300cba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a2cc22c8c06b40ae961464cb3e300cba"}]}] Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2110834559 Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: a2cc22c8c06b40ae961464cb3e300cba Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2110834559 Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-AttachVolumeShelveTestJSON-2110834559-project Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 023dd49bea644899a427669f3c1b461e Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2110834559-project Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 could not be found. Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'e7dd09c1-f3da-438a-b0d8-1102ee2d67f8'} Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 could not be found. Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:21:41.704470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:21:41.709488 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 could not be found. Aug 04 17:21:41.709488 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:21:41.709488 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:21:41.709488 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:21:41.709488 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:21:41.709488 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:21:41.709488 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:21:41.709488 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:21:41.709488 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:21:41.709488 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 could not be found. Aug 04 17:21:41.709488 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:21:41.712747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3549e32d-e931-4006-b0ae-f49af16e0360 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Returning 404 to user: Instance e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:21:41.714469 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3549e32d-e931-4006-b0ae-f49af16e0360 tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 404 len: 111 microversion: 2.20 time: 0.071494 Aug 04 17:21:41.720606 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2828/5676] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Aug 4 17:21:41 2022] DELETE /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:21:41.727905 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-76f92292-f52d-4a89-a60a-e8c6eebdb64d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:41.728943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-76f92292-f52d-4a89-a60a-e8c6eebdb64d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: e7dd09c1-f3da-438a-b0d8-1102ee2d67f8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:41.740966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76f92292-f52d-4a89-a60a-e8c6eebdb64d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:41.742244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76f92292-f52d-4a89-a60a-e8c6eebdb64d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:41.743533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76f92292-f52d-4a89-a60a-e8c6eebdb64d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:41.744678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76f92292-f52d-4a89-a60a-e8c6eebdb64d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:41.745273 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76f92292-f52d-4a89-a60a-e8c6eebdb64d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:41.745817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76f92292-f52d-4a89-a60a-e8c6eebdb64d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:41.771641 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-76f92292-f52d-4a89-a60a-e8c6eebdb64d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] HTTP exception thrown: Instance e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 could not be found. Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-76f92292-f52d-4a89-a60a-e8c6eebdb64d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Request method failure captured: Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 HTTP/1.1 Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_21cg1PqIDvYXgybLbIpUp4-HNyMc1ajyJOqZi0IDAb3yTDXkMJQy5pICV1Wkh8n1jB3os8RCllz2dxAPec7OcKYuuzrI5PO5yGCPDwvLtZPgHWq1aD9IW2AQdVTCs4RoF5aEJRSI9MSs9bRRtuDuDXQAsaGi4ERRQKwRryAc3dfuo Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: a2cc22c8c06b40ae961464cb3e300cba Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2110834559 Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a2cc22c8c06b40ae961464cb3e300cba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a2cc22c8c06b40ae961464cb3e300cba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a2cc22c8c06b40ae961464cb3e300cba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a2cc22c8c06b40ae961464cb3e300cba"}]}] Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2110834559 Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: a2cc22c8c06b40ae961464cb3e300cba Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2110834559 Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-AttachVolumeShelveTestJSON-2110834559-project Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 023dd49bea644899a427669f3c1b461e Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2110834559-project Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 could not be found. Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'e7dd09c1-f3da-438a-b0d8-1102ee2d67f8'} Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 could not be found. Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 could not be found. Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:21:41.774310 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:21:41.780649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:21:41.780649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:21:41.780649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:21:41.780649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:21:41.780649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:21:41.780649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:21:41.780649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 could not be found. Aug 04 17:21:41.780649 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:21:41.783341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-76f92292-f52d-4a89-a60a-e8c6eebdb64d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Returning 404 to user: Instance e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:21:41.785567 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-76f92292-f52d-4a89-a60a-e8c6eebdb64d tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8" status: 404 len: 111 microversion: 2.20 time: 0.060654 Aug 04 17:21:41.792223 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2829/5677] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:41 2022] GET /compute/v2.1/servers/e7dd09c1-f3da-438a-b0d8-1102ee2d67f8 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:21:41.832783 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a0a1ba7d-ddd8-4c4b-a4b4-f86cbab94987 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:41.834004 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a0a1ba7d-ddd8-4c4b-a4b4-f86cbab94987 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:41.851130 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0a1ba7d-ddd8-4c4b-a4b4-f86cbab94987 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:41.851950 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0a1ba7d-ddd8-4c4b-a4b4-f86cbab94987 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:41.853466 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0a1ba7d-ddd8-4c4b-a4b4-f86cbab94987 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:41.858412 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0a1ba7d-ddd8-4c4b-a4b4-f86cbab94987 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:41.859828 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0a1ba7d-ddd8-4c4b-a4b4-f86cbab94987 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:41.860595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0a1ba7d-ddd8-4c4b-a4b4-f86cbab94987 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:42.227798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:21:42.234438 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d875cf11-d9cb-4cd2-9fad-91fed269f456 tempest-QuotasTestJSON-811286352 tempest-QuotasTestJSON-811286352-project] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/412fc44971234610a52e6f4c2c27bc53/defaults" status: 200 len: 371 microversion: 2.1 time: 0.789972 Aug 04 17:21:42.252560 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2849/5678] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Aug 4 17:21:41 2022] GET /compute/v2.1/os-quota-sets/412fc44971234610a52e6f4c2c27bc53/defaults => generated 371 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:21:42.267850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f1d06e9e-57ec-4767-8411-55967ecf4ea4 tempest-QuotasTestJSON-811286352 tempest-QuotasTestJSON-811286352-project] Calling method '.version_select at 0x7f1e5afcdf70>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:42.707193 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a0a1ba7d-ddd8-4c4b-a4b4-f86cbab94987 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:42.779853 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a0a1ba7d-ddd8-4c4b-a4b4-f86cbab94987 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1695 microversion: 2.1 time: 0.944253 Aug 04 17:21:42.780878 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2830/5679] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:21:41 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1695 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:21:42.803261 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-adb021a3-cad2-46ab-bb24-6e02bac59de6 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:42.807313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-adb021a3-cad2-46ab-bb24-6e02bac59de6 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:42.837373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adb021a3-cad2-46ab-bb24-6e02bac59de6 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:42.840565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adb021a3-cad2-46ab-bb24-6e02bac59de6 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:42.842220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adb021a3-cad2-46ab-bb24-6e02bac59de6 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:42.846688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adb021a3-cad2-46ab-bb24-6e02bac59de6 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:42.852468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adb021a3-cad2-46ab-bb24-6e02bac59de6 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:42.855390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adb021a3-cad2-46ab-bb24-6e02bac59de6 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:43.134417 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f1d06e9e-57ec-4767-8411-55967ecf4ea4 tempest-QuotasTestJSON-811286352 tempest-QuotasTestJSON-811286352-project] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/412fc44971234610a52e6f4c2c27bc53" status: 200 len: 371 microversion: 2.1 time: 0.870892 Aug 04 17:21:43.152086 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2850/5680] 10.222.0.93 () {58 vars in 1242 bytes} [Thu Aug 4 17:21:42 2022] GET /compute/v2.1/os-quota-sets/412fc44971234610a52e6f4c2c27bc53 => generated 371 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:21:43.165523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e171e315-ca5a-4c75-91fe-306a9d665afc tempest-QuotasTestJSON-811286352 tempest-QuotasTestJSON-811286352-project] Calling method '.version_select at 0x7f1e5a898ca0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:43.948188 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e171e315-ca5a-4c75-91fe-306a9d665afc tempest-QuotasTestJSON-811286352 tempest-QuotasTestJSON-811286352-project] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/412fc44971234610a52e6f4c2c27bc53?user_id=90819224ad3e408dbd2bb05940198585" status: 200 len: 371 microversion: 2.1 time: 0.794447 Aug 04 17:21:43.950678 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2851/5681] 10.222.0.93 () {58 vars in 1323 bytes} [Thu Aug 4 17:21:43 2022] GET /compute/v2.1/os-quota-sets/412fc44971234610a52e6f4c2c27bc53?user_id=90819224ad3e408dbd2bb05940198585 => generated 371 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:21:43.979077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-01f8cca4-1eae-448d-9258-f07bbeadc596 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:43.981664 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-01f8cca4-1eae-448d-9258-f07bbeadc596 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:43.998946 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01f8cca4-1eae-448d-9258-f07bbeadc596 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:44.001193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01f8cca4-1eae-448d-9258-f07bbeadc596 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:44.005120 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01f8cca4-1eae-448d-9258-f07bbeadc596 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:44.008692 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01f8cca4-1eae-448d-9258-f07bbeadc596 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:44.010329 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01f8cca4-1eae-448d-9258-f07bbeadc596 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:44.015806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01f8cca4-1eae-448d-9258-f07bbeadc596 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:44.421088 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-adb021a3-cad2-46ab-bb24-6e02bac59de6 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:44.477152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-adb021a3-cad2-46ab-bb24-6e02bac59de6 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:44.491969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-adb021a3-cad2-46ab-bb24-6e02bac59de6 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:44.497017 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-adb021a3-cad2-46ab-bb24-6e02bac59de6 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 1.707891 Aug 04 17:21:44.499862 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2831/5682] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:42 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:21:45.545246 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-01f8cca4-1eae-448d-9258-f07bbeadc596 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:45.556467 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-21f27052-f240-4971-9bad-51d9e9314d13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:45.564411 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-21f27052-f240-4971-9bad-51d9e9314d13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:45.597716 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-01f8cca4-1eae-448d-9258-f07bbeadc596 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1695 microversion: 2.1 time: 1.626729 Aug 04 17:21:45.604164 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2852/5683] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:21:43 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1695 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:21:45.610413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21f27052-f240-4971-9bad-51d9e9314d13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:45.611356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21f27052-f240-4971-9bad-51d9e9314d13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:45.612172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21f27052-f240-4971-9bad-51d9e9314d13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:45.616019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21f27052-f240-4971-9bad-51d9e9314d13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:45.619656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21f27052-f240-4971-9bad-51d9e9314d13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:45.620879 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21f27052-f240-4971-9bad-51d9e9314d13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:46.413484 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-21f27052-f240-4971-9bad-51d9e9314d13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:46.450262 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-21f27052-f240-4971-9bad-51d9e9314d13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:46.456492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-21f27052-f240-4971-9bad-51d9e9314d13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:46.466585 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-21f27052-f240-4971-9bad-51d9e9314d13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 0.929936 Aug 04 17:21:46.489517 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2832/5684] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:45 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:21:46.631261 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f9408fa7-e04d-4bbb-b1f8-519bc732d1fb tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:46.633046 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f9408fa7-e04d-4bbb-b1f8-519bc732d1fb tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:46.659787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9408fa7-e04d-4bbb-b1f8-519bc732d1fb tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:46.660724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9408fa7-e04d-4bbb-b1f8-519bc732d1fb tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:46.661461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9408fa7-e04d-4bbb-b1f8-519bc732d1fb tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:46.665946 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9408fa7-e04d-4bbb-b1f8-519bc732d1fb tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:46.666812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9408fa7-e04d-4bbb-b1f8-519bc732d1fb tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:46.674101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9408fa7-e04d-4bbb-b1f8-519bc732d1fb tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:47.502433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f9408fa7-e04d-4bbb-b1f8-519bc732d1fb tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:47.515343 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f9408fa7-e04d-4bbb-b1f8-519bc732d1fb tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1695 microversion: 2.1 time: 0.891509 Aug 04 17:21:47.518511 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2853/5685] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:21:46 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1695 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:21:47.518721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5b4dc690-84a5-4f2f-bd8e-1838ae915430 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:47.519400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5b4dc690-84a5-4f2f-bd8e-1838ae915430 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:47.531846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b4dc690-84a5-4f2f-bd8e-1838ae915430 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:47.532412 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b4dc690-84a5-4f2f-bd8e-1838ae915430 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:47.534032 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b4dc690-84a5-4f2f-bd8e-1838ae915430 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:47.534822 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b4dc690-84a5-4f2f-bd8e-1838ae915430 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:47.536478 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b4dc690-84a5-4f2f-bd8e-1838ae915430 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:47.536930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b4dc690-84a5-4f2f-bd8e-1838ae915430 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:48.553959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-aae8dc52-ee28-4ed4-af1e-021109565377 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:48.554816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-aae8dc52-ee28-4ed4-af1e-021109565377 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:48.564288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aae8dc52-ee28-4ed4-af1e-021109565377 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:48.565113 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aae8dc52-ee28-4ed4-af1e-021109565377 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:48.565831 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aae8dc52-ee28-4ed4-af1e-021109565377 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:48.567765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aae8dc52-ee28-4ed4-af1e-021109565377 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:48.568442 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aae8dc52-ee28-4ed4-af1e-021109565377 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:48.569043 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aae8dc52-ee28-4ed4-af1e-021109565377 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:49.416197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5b4dc690-84a5-4f2f-bd8e-1838ae915430 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:49.468996 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5b4dc690-84a5-4f2f-bd8e-1838ae915430 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:49.472157 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5b4dc690-84a5-4f2f-bd8e-1838ae915430 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:49.474295 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5b4dc690-84a5-4f2f-bd8e-1838ae915430 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 1.960314 Aug 04 17:21:49.497251 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2833/5686] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:47 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 1974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:21:49.864127 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-aae8dc52-ee28-4ed4-af1e-021109565377 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:49.885823 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-aae8dc52-ee28-4ed4-af1e-021109565377 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1695 microversion: 2.1 time: 1.335850 Aug 04 17:21:49.910833 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2854/5687] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:21:48 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1695 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:21:50.168998 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c62e2cc3-d798-4335-a0ea-50f01560e91e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:50.170679 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c62e2cc3-d798-4335-a0ea-50f01560e91e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:50.193260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c62e2cc3-d798-4335-a0ea-50f01560e91e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:50.195942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c62e2cc3-d798-4335-a0ea-50f01560e91e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:50.197752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c62e2cc3-d798-4335-a0ea-50f01560e91e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:50.199721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c62e2cc3-d798-4335-a0ea-50f01560e91e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:50.204706 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c62e2cc3-d798-4335-a0ea-50f01560e91e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:50.206589 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c62e2cc3-d798-4335-a0ea-50f01560e91e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:50.248429 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-c62e2cc3-d798-4335-a0ea-50f01560e91e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] HTTP exception thrown: Instance 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d could not be found. Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c62e2cc3-d798-4335-a0ea-50f01560e91e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Request method failure captured: Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d HTTP/1.1 Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_21cg1PqIDvYXgybLbIpUp4-HNyMc1ajyJOqZi0IDAb3yTDXkMJQy5pICV1Wkh8n1jB3os8RCllz2dxAPec7OcKYuuzrI5PO5yGCPDwvLtZPgHWq1aD9IW2AQdVTCs4RoF5aEJRSI9MSs9bRRtuDuDXQAsaGi4ERRQKwRryAc3dfuo Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: a2cc22c8c06b40ae961464cb3e300cba Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2110834559 Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a2cc22c8c06b40ae961464cb3e300cba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a2cc22c8c06b40ae961464cb3e300cba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a2cc22c8c06b40ae961464cb3e300cba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a2cc22c8c06b40ae961464cb3e300cba"}]}] Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2110834559 Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: a2cc22c8c06b40ae961464cb3e300cba Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2110834559 Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-AttachVolumeShelveTestJSON-2110834559-project Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 023dd49bea644899a427669f3c1b461e Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2110834559-project Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d could not be found. Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '9c682c4f-3eed-44cd-9782-3ed12f2d8f0d'} Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d could not be found. Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:21:50.250810 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:21:50.256738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d could not be found. Aug 04 17:21:50.256738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:21:50.256738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:21:50.256738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:21:50.256738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:21:50.256738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:21:50.256738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:21:50.256738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:21:50.256738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:21:50.256738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d could not be found. Aug 04 17:21:50.256738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:21:50.261299 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c62e2cc3-d798-4335-a0ea-50f01560e91e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Returning 404 to user: Instance 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:21:50.263312 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c62e2cc3-d798-4335-a0ea-50f01560e91e tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 404 len: 111 microversion: 2.20 time: 0.099321 Aug 04 17:21:50.264816 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2855/5688] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Aug 4 17:21:50 2022] DELETE /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 04 17:21:50.288035 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-33d656f3-0dc6-4ea3-a4d0-36673d1c24df tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:50.291003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-33d656f3-0dc6-4ea3-a4d0-36673d1c24df tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] [instance: 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:50.314805 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33d656f3-0dc6-4ea3-a4d0-36673d1c24df tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:50.315759 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33d656f3-0dc6-4ea3-a4d0-36673d1c24df tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:50.316393 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33d656f3-0dc6-4ea3-a4d0-36673d1c24df tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:50.318978 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33d656f3-0dc6-4ea3-a4d0-36673d1c24df tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:50.321531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33d656f3-0dc6-4ea3-a4d0-36673d1c24df tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:50.323189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33d656f3-0dc6-4ea3-a4d0-36673d1c24df tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:50.363278 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-33d656f3-0dc6-4ea3-a4d0-36673d1c24df tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] HTTP exception thrown: Instance 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d could not be found. Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-33d656f3-0dc6-4ea3-a4d0-36673d1c24df tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Request method failure captured: Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d HTTP/1.1 Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_21cg1PqIDvYXgybLbIpUp4-HNyMc1ajyJOqZi0IDAb3yTDXkMJQy5pICV1Wkh8n1jB3os8RCllz2dxAPec7OcKYuuzrI5PO5yGCPDwvLtZPgHWq1aD9IW2AQdVTCs4RoF5aEJRSI9MSs9bRRtuDuDXQAsaGi4ERRQKwRryAc3dfuo Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: a2cc22c8c06b40ae961464cb3e300cba Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2110834559 Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a2cc22c8c06b40ae961464cb3e300cba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a2cc22c8c06b40ae961464cb3e300cba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a2cc22c8c06b40ae961464cb3e300cba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a2cc22c8c06b40ae961464cb3e300cba"}]}] Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2110834559 Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: a2cc22c8c06b40ae961464cb3e300cba Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2110834559 Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-AttachVolumeShelveTestJSON-2110834559-project Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 023dd49bea644899a427669f3c1b461e Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2110834559-project Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d could not be found. Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '9c682c4f-3eed-44cd-9782-3ed12f2d8f0d'} Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d could not be found. Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d could not be found. Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:21:50.368966 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:21:50.374807 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:21:50.374807 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:21:50.374807 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:21:50.374807 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:21:50.374807 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:21:50.374807 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:21:50.374807 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d could not be found. Aug 04 17:21:50.374807 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:21:50.378184 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-33d656f3-0dc6-4ea3-a4d0-36673d1c24df tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] Returning 404 to user: Instance 9c682c4f-3eed-44cd-9782-3ed12f2d8f0d could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:21:50.382941 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-33d656f3-0dc6-4ea3-a4d0-36673d1c24df tempest-AttachVolumeShelveTestJSON-2110834559 tempest-AttachVolumeShelveTestJSON-2110834559-project] 10.222.0.93 "GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d" status: 404 len: 111 microversion: 2.20 time: 0.108922 Aug 04 17:21:50.384161 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2856/5689] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:50 2022] GET /compute/v2.1/servers/9c682c4f-3eed-44cd-9782-3ed12f2d8f0d => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:21:50.504757 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-56fca030-8e56-42d9-be2d-ab8ffffd5d13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:50.505686 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-56fca030-8e56-42d9-be2d-ab8ffffd5d13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:50.524948 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56fca030-8e56-42d9-be2d-ab8ffffd5d13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:50.533742 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56fca030-8e56-42d9-be2d-ab8ffffd5d13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:50.535085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56fca030-8e56-42d9-be2d-ab8ffffd5d13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:50.541230 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56fca030-8e56-42d9-be2d-ab8ffffd5d13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:50.549301 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56fca030-8e56-42d9-be2d-ab8ffffd5d13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:50.550402 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56fca030-8e56-42d9-be2d-ab8ffffd5d13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:50.890763 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ed4274ad-3bd6-4047-8023-6c071dee70b3 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] Action: 'create', calling method: .version_select at 0x7f1e5aae6280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1332510480"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:21:51.219278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-56fca030-8e56-42d9-be2d-ab8ffffd5d13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:51.250599 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-56fca030-8e56-42d9-be2d-ab8ffffd5d13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:51.263789 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-56fca030-8e56-42d9-be2d-ab8ffffd5d13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:51.271096 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-56fca030-8e56-42d9-be2d-ab8ffffd5d13 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 0.767612 Aug 04 17:21:51.274313 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2857/5690] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:50 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:21:51.293701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-315385bb-45b9-46c4-b0e0-cb8999a1b69e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:51.296894 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-315385bb-45b9-46c4-b0e0-cb8999a1b69e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:51.319627 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-315385bb-45b9-46c4-b0e0-cb8999a1b69e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:51.323416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-315385bb-45b9-46c4-b0e0-cb8999a1b69e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:51.325882 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-315385bb-45b9-46c4-b0e0-cb8999a1b69e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:51.328450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-315385bb-45b9-46c4-b0e0-cb8999a1b69e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:51.331867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-315385bb-45b9-46c4-b0e0-cb8999a1b69e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:51.333052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-315385bb-45b9-46c4-b0e0-cb8999a1b69e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:51.423328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:21:51.719941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-315385bb-45b9-46c4-b0e0-cb8999a1b69e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:51.735581 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-315385bb-45b9-46c4-b0e0-cb8999a1b69e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1694 microversion: 2.1 time: 0.455578 Aug 04 17:21:51.738915 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2858/5691] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:21:51 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1694 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:21:51.753091 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-ede134a9-474a-49ac-ab01-927ecb646c62 req-7cc3afb5-0267-4767-b61f-deb111c7d8f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "596804f9-9964-419e-bed5-d24e20805b57", "name": "network-vif-unplugged", "status": "completed", "tag": "51b8ad4a-9d13-46c2-a8d0-1daea7b6bced"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:21:51.775962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ede134a9-474a-49ac-ab01-927ecb646c62 req-7cc3afb5-0267-4767-b61f-deb111c7d8f7 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:51.781196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ede134a9-474a-49ac-ab01-927ecb646c62 req-7cc3afb5-0267-4767-b61f-deb111c7d8f7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:51.782206 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ede134a9-474a-49ac-ab01-927ecb646c62 req-7cc3afb5-0267-4767-b61f-deb111c7d8f7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:51.801957 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ed4274ad-3bd6-4047-8023-6c071dee70b3 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.762078 Aug 04 17:21:51.803203 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2834/5692] 10.222.0.93 () {60 vars in 1155 bytes} [Thu Aug 4 17:21:50 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1764 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 04 17:21:51.817229 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-89d7bb45-99b4-4f99-9576-cc0c0d6e0819 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] Calling method '.version_select at 0x7f1e5aae6790>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:51.817689 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-ede134a9-474a-49ac-ab01-927ecb646c62 req-7cc3afb5-0267-4767-b61f-deb111c7d8f7 service nova] Creating event network-vif-unplugged:51b8ad4a-9d13-46c2-a8d0-1daea7b6bced for instance 596804f9-9964-419e-bed5-d24e20805b57 on n-h2-851359-3 Aug 04 17:21:51.848602 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [req-ede134a9-474a-49ac-ab01-927ecb646c62 req-7cc3afb5-0267-4767-b61f-deb111c7d8f7 service nova] Instance 596804f9-9964-419e-bed5-d24e20805b57 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:21:51.879674 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-ede134a9-474a-49ac-ab01-927ecb646c62 req-7cc3afb5-0267-4767-b61f-deb111c7d8f7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.138875 Aug 04 17:21:51.883739 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2859/5693] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:21:51.906106 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-89d7bb45-99b4-4f99-9576-cc0c0d6e0819 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/0969e677-ccc3-4f3f-814d-581d70a6a9e9" status: 200 len: 345 microversion: 2.1 time: 0.092869 Aug 04 17:21:51.907742 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2835/5694] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Aug 4 17:21:51 2022] GET /compute/v2.1/os-volumes/0969e677-ccc3-4f3f-814d-581d70a6a9e9 => generated 345 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:21:52.307227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8ed14f73-0be9-4c25-a37a-8c178b28830c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:52.315646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8ed14f73-0be9-4c25-a37a-8c178b28830c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:52.335959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ed14f73-0be9-4c25-a37a-8c178b28830c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:52.340911 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ed14f73-0be9-4c25-a37a-8c178b28830c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:52.342278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ed14f73-0be9-4c25-a37a-8c178b28830c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:52.347108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ed14f73-0be9-4c25-a37a-8c178b28830c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:52.349168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ed14f73-0be9-4c25-a37a-8c178b28830c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:52.351207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8ed14f73-0be9-4c25-a37a-8c178b28830c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:52.779879 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8fa2fab7-f152-4e2b-9c2a-35631c932b22 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:52.783016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8fa2fab7-f152-4e2b-9c2a-35631c932b22 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:52.799121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fa2fab7-f152-4e2b-9c2a-35631c932b22 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:52.803185 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fa2fab7-f152-4e2b-9c2a-35631c932b22 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:52.807415 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fa2fab7-f152-4e2b-9c2a-35631c932b22 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:52.811108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fa2fab7-f152-4e2b-9c2a-35631c932b22 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:52.812002 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fa2fab7-f152-4e2b-9c2a-35631c932b22 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:52.813636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fa2fab7-f152-4e2b-9c2a-35631c932b22 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:53.202685 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8ed14f73-0be9-4c25-a37a-8c178b28830c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:53.241808 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8ed14f73-0be9-4c25-a37a-8c178b28830c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:53.244115 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8ed14f73-0be9-4c25-a37a-8c178b28830c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:53.256264 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8ed14f73-0be9-4c25-a37a-8c178b28830c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 0.953302 Aug 04 17:21:53.259539 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2860/5695] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:52 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:21:53.276577 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-507fe85c-70f2-4013-bec3-106b64d58569 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] Calling method '.version_select at 0x7f1e5a3f5820>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:53.419355 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-507fe85c-70f2-4013-bec3-106b64d58569 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/0969e677-ccc3-4f3f-814d-581d70a6a9e9" status: 200 len: 345 microversion: 2.1 time: 0.158207 Aug 04 17:21:53.420268 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2861/5696] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Aug 4 17:21:53 2022] GET /compute/v2.1/os-volumes/0969e677-ccc3-4f3f-814d-581d70a6a9e9 => generated 345 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:21:53.472708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8fa2fab7-f152-4e2b-9c2a-35631c932b22 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:53.504410 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8fa2fab7-f152-4e2b-9c2a-35631c932b22 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1694 microversion: 2.1 time: 0.726474 Aug 04 17:21:53.505293 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2836/5697] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:21:52 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1694 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:21:54.041727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:21:54.054593 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-7007a847-8de4-4d3d-9e85-446a786c84b0 req-4567e4f4-7b71-491c-9146-da5b6740bec8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "726db447-1df7-417d-a9e0-1c832e299621", "name": "network-vif-plugged", "status": "completed", "tag": "3e04b159-57ff-4d66-afba-9b463d3dbcad"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:21:54.088432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7007a847-8de4-4d3d-9e85-446a786c84b0 req-4567e4f4-7b71-491c-9146-da5b6740bec8 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:54.089280 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7007a847-8de4-4d3d-9e85-446a786c84b0 req-4567e4f4-7b71-491c-9146-da5b6740bec8 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:54.091569 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7007a847-8de4-4d3d-9e85-446a786c84b0 req-4567e4f4-7b71-491c-9146-da5b6740bec8 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:54.136908 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:21:54.141637 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-7007a847-8de4-4d3d-9e85-446a786c84b0 req-4567e4f4-7b71-491c-9146-da5b6740bec8 service nova] Creating event network-vif-plugged:3e04b159-57ff-4d66-afba-9b463d3dbcad for instance 726db447-1df7-417d-a9e0-1c832e299621 on n-h2-851359-3 Aug 04 17:21:54.155630 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-7007a847-8de4-4d3d-9e85-446a786c84b0 req-4567e4f4-7b71-491c-9146-da5b6740bec8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116581 Aug 04 17:21:54.156634 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2862/5698] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:21:54.163806 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-1c8c77f8-fae5-42bb-8c93-ca1c41202c16 req-f923ec38-89e1-4eb3-9fab-90f01bcfdfa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "596804f9-9964-419e-bed5-d24e20805b57", "tag": "51b8ad4a-9d13-46c2-a8d0-1daea7b6bced"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:21:54.191762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1c8c77f8-fae5-42bb-8c93-ca1c41202c16 req-f923ec38-89e1-4eb3-9fab-90f01bcfdfa8 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:54.192251 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1c8c77f8-fae5-42bb-8c93-ca1c41202c16 req-f923ec38-89e1-4eb3-9fab-90f01bcfdfa8 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:54.192931 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1c8c77f8-fae5-42bb-8c93-ca1c41202c16 req-f923ec38-89e1-4eb3-9fab-90f01bcfdfa8 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:54.221084 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-1c8c77f8-fae5-42bb-8c93-ca1c41202c16 req-f923ec38-89e1-4eb3-9fab-90f01bcfdfa8 service nova] Creating event network-changed:51b8ad4a-9d13-46c2-a8d0-1daea7b6bced for instance 596804f9-9964-419e-bed5-d24e20805b57 on n-h2-851359-3 Aug 04 17:21:54.252311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-1c8c77f8-fae5-42bb-8c93-ca1c41202c16 req-f923ec38-89e1-4eb3-9fab-90f01bcfdfa8 service nova] Instance 596804f9-9964-419e-bed5-d24e20805b57 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:21:54.280686 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-1c8c77f8-fae5-42bb-8c93-ca1c41202c16 req-f923ec38-89e1-4eb3-9fab-90f01bcfdfa8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119986 Aug 04 17:21:54.282472 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2837/5699] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:21:54.300450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1a7a0d8b-95ce-4069-9fb1-eec8d2f1f342 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:54.301820 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1a7a0d8b-95ce-4069-9fb1-eec8d2f1f342 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:54.321525 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a7a0d8b-95ce-4069-9fb1-eec8d2f1f342 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:54.323409 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a7a0d8b-95ce-4069-9fb1-eec8d2f1f342 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:54.325010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a7a0d8b-95ce-4069-9fb1-eec8d2f1f342 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:54.326976 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a7a0d8b-95ce-4069-9fb1-eec8d2f1f342 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:54.329919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a7a0d8b-95ce-4069-9fb1-eec8d2f1f342 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:54.330813 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a7a0d8b-95ce-4069-9fb1-eec8d2f1f342 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:54.436576 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9953d0a1-dbec-4c6e-ae7e-f76692e7fe44 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] Calling method '.version_select at 0x7f1e5aae60d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:54.549707 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9953d0a1-dbec-4c6e-ae7e-f76692e7fe44 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/0969e677-ccc3-4f3f-814d-581d70a6a9e9" status: 200 len: 346 microversion: 2.1 time: 0.117338 Aug 04 17:21:54.551927 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2838/5700] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Aug 4 17:21:54 2022] GET /compute/v2.1/os-volumes/0969e677-ccc3-4f3f-814d-581d70a6a9e9 => generated 346 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:21:54.568072 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0ff44413-e24a-44d3-84a9-e29adb8119a2 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:54.569495 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0ff44413-e24a-44d3-84a9-e29adb8119a2 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:54.584354 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ff44413-e24a-44d3-84a9-e29adb8119a2 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:54.585273 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ff44413-e24a-44d3-84a9-e29adb8119a2 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:54.586365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ff44413-e24a-44d3-84a9-e29adb8119a2 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:54.588453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ff44413-e24a-44d3-84a9-e29adb8119a2 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:54.589229 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ff44413-e24a-44d3-84a9-e29adb8119a2 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:54.590159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ff44413-e24a-44d3-84a9-e29adb8119a2 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:55.259695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0ff44413-e24a-44d3-84a9-e29adb8119a2 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:55.297674 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0ff44413-e24a-44d3-84a9-e29adb8119a2 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1694 microversion: 2.1 time: 0.743567 Aug 04 17:21:55.309724 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2839/5701] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:21:54 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1694 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:21:55.325580 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-37106667-187b-4056-8f3d-e40045d65271 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] Action: 'create', calling method: .version_select at 0x7f1e5aae6280>, body: {"snapshot": {"volume_id": "0969e677-ccc3-4f3f-814d-581d70a6a9e9", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1944361493"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:21:55.419311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1a7a0d8b-95ce-4069-9fb1-eec8d2f1f342 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:55.472568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1a7a0d8b-95ce-4069-9fb1-eec8d2f1f342 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:55.484138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1a7a0d8b-95ce-4069-9fb1-eec8d2f1f342 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:55.492044 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1a7a0d8b-95ce-4069-9fb1-eec8d2f1f342 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 1.194833 Aug 04 17:21:55.497707 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2863/5702] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:54 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:21:55.833405 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-37106667-187b-4056-8f3d-e40045d65271 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] 10.222.0.93 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.516473 Aug 04 17:21:55.844299 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2840/5703] 10.222.0.93 () {60 vars in 1162 bytes} [Thu Aug 4 17:21:55 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:21:55.858868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-88ae5275-e218-4b91-bbe8-45a290e5eb1e tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] Calling method '.version_select at 0x7f1e5a386d30>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:55.912795 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-88ae5275-e218-4b91-bbe8-45a290e5eb1e tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/007dca19-1f1b-46fd-b743-5fb3fb4485c2" status: 200 len: 287 microversion: 2.1 time: 0.066375 Aug 04 17:21:55.913379 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2864/5704] 10.222.0.93 () {58 vars in 1251 bytes} [Thu Aug 4 17:21:55 2022] GET /compute/v2.1/os-snapshots/007dca19-1f1b-46fd-b743-5fb3fb4485c2 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:21:55.938985 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7e47bcb2-272a-4dc1-b5ec-b86270fab09b tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] Calling method '.version_select at 0x7f1e6c942940>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:56.002599 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7e47bcb2-272a-4dc1-b5ec-b86270fab09b tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.074246 Aug 04 17:21:56.002968 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2841/5705] 10.222.0.93 () {58 vars in 1140 bytes} [Thu Aug 4 17:21:55 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:21:56.034223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-97d52944-bab3-4665-95bc-4f524ca5b0cd tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] Calling method '.version_select at 0x7f1e5a396550>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:56.133319 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-97d52944-bab3-4665-95bc-4f524ca5b0cd tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/007dca19-1f1b-46fd-b743-5fb3fb4485c2" status: 200 len: 287 microversion: 2.1 time: 0.112287 Aug 04 17:21:56.144048 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2865/5706] 10.222.0.93 () {58 vars in 1251 bytes} [Thu Aug 4 17:21:56 2022] GET /compute/v2.1/os-snapshots/007dca19-1f1b-46fd-b743-5fb3fb4485c2 => generated 287 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:21:56.332088 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1bea95b4-0126-4530-bba6-3775f9a34adb tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:56.333072 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1bea95b4-0126-4530-bba6-3775f9a34adb tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:56.355786 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1bea95b4-0126-4530-bba6-3775f9a34adb tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:56.356660 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1bea95b4-0126-4530-bba6-3775f9a34adb tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:56.357322 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1bea95b4-0126-4530-bba6-3775f9a34adb tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:56.358347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1bea95b4-0126-4530-bba6-3775f9a34adb tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:56.359547 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1bea95b4-0126-4530-bba6-3775f9a34adb tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:56.360401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1bea95b4-0126-4530-bba6-3775f9a34adb tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:56.526339 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8c9ebef0-44f3-4e6e-b479-35a6e4934407 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:56.527945 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8c9ebef0-44f3-4e6e-b479-35a6e4934407 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:56.563246 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c9ebef0-44f3-4e6e-b479-35a6e4934407 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:56.578473 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c9ebef0-44f3-4e6e-b479-35a6e4934407 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:56.579429 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c9ebef0-44f3-4e6e-b479-35a6e4934407 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:56.580751 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c9ebef0-44f3-4e6e-b479-35a6e4934407 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:56.582186 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c9ebef0-44f3-4e6e-b479-35a6e4934407 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:56.582429 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c9ebef0-44f3-4e6e-b479-35a6e4934407 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:57.170064 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1bea95b4-0126-4530-bba6-3775f9a34adb tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:57.180059 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1bea95b4-0126-4530-bba6-3775f9a34adb tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1692 microversion: 2.1 time: 0.855107 Aug 04 17:21:57.194783 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2842/5707] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:21:56 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1692 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:21:57.208907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c028ebf7-0161-4e34-b984-bc1b1ff0dcfb tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] Calling method '.version_select at 0x7f1e5a3703a0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:57.251873 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c028ebf7-0161-4e34-b984-bc1b1ff0dcfb tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/007dca19-1f1b-46fd-b743-5fb3fb4485c2" status: 200 len: 287 microversion: 2.1 time: 0.055314 Aug 04 17:21:57.253809 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2843/5708] 10.222.0.93 () {58 vars in 1251 bytes} [Thu Aug 4 17:21:57 2022] GET /compute/v2.1/os-snapshots/007dca19-1f1b-46fd-b743-5fb3fb4485c2 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:21:57.392367 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8c9ebef0-44f3-4e6e-b479-35a6e4934407 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:57.419614 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8c9ebef0-44f3-4e6e-b479-35a6e4934407 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:57.421636 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8c9ebef0-44f3-4e6e-b479-35a6e4934407 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:57.423147 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8c9ebef0-44f3-4e6e-b479-35a6e4934407 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 0.903811 Aug 04 17:21:57.439377 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2866/5709] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:56 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:21:58.220365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-78ff49f5-ce22-4e7a-aacd-02620233baa0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:58.221242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-78ff49f5-ce22-4e7a-aacd-02620233baa0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:58.231133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78ff49f5-ce22-4e7a-aacd-02620233baa0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:58.235882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78ff49f5-ce22-4e7a-aacd-02620233baa0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:58.236969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78ff49f5-ce22-4e7a-aacd-02620233baa0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:58.238287 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78ff49f5-ce22-4e7a-aacd-02620233baa0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:58.239053 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78ff49f5-ce22-4e7a-aacd-02620233baa0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:58.239836 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78ff49f5-ce22-4e7a-aacd-02620233baa0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:58.270553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cc4834ed-1d31-4527-ab63-ef89c07058be tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] Calling method '.version_select at 0x7f1e5a386550>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:58.466102 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cc4834ed-1d31-4527-ab63-ef89c07058be tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/007dca19-1f1b-46fd-b743-5fb3fb4485c2" status: 200 len: 287 microversion: 2.1 time: 0.202924 Aug 04 17:21:58.467514 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2867/5710] 10.222.0.93 () {58 vars in 1251 bytes} [Thu Aug 4 17:21:58 2022] GET /compute/v2.1/os-snapshots/007dca19-1f1b-46fd-b743-5fb3fb4485c2 => generated 287 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:21:58.479228 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a5264ad4-801e-45a1-8fbb-90d04f6ba383 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:58.481061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a5264ad4-801e-45a1-8fbb-90d04f6ba383 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:21:58.517776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a5264ad4-801e-45a1-8fbb-90d04f6ba383 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:58.519238 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a5264ad4-801e-45a1-8fbb-90d04f6ba383 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:58.520165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a5264ad4-801e-45a1-8fbb-90d04f6ba383 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:58.521823 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a5264ad4-801e-45a1-8fbb-90d04f6ba383 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:21:58.522825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a5264ad4-801e-45a1-8fbb-90d04f6ba383 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:21:58.523712 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a5264ad4-801e-45a1-8fbb-90d04f6ba383 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:21:59.465895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a5264ad4-801e-45a1-8fbb-90d04f6ba383 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:59.496067 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a5264ad4-801e-45a1-8fbb-90d04f6ba383 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:59.512146 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a5264ad4-801e-45a1-8fbb-90d04f6ba383 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:59.514199 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a5264ad4-801e-45a1-8fbb-90d04f6ba383 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 1.045008 Aug 04 17:21:59.527556 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2868/5711] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:21:58 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:21:59.544062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cde551ad-c3f1-4220-bc32-6edb0262efbc tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] Calling method '.version_select at 0x7f1e5a340820>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:59.638760 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-78ff49f5-ce22-4e7a-aacd-02620233baa0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:21:59.649673 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-78ff49f5-ce22-4e7a-aacd-02620233baa0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1692 microversion: 2.1 time: 1.439997 Aug 04 17:21:59.654684 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cde551ad-c3f1-4220-bc32-6edb0262efbc tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/007dca19-1f1b-46fd-b743-5fb3fb4485c2" status: 200 len: 288 microversion: 2.1 time: 0.125608 Aug 04 17:21:59.655588 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2869/5712] 10.222.0.93 () {58 vars in 1251 bytes} [Thu Aug 4 17:21:59 2022] GET /compute/v2.1/os-snapshots/007dca19-1f1b-46fd-b743-5fb3fb4485c2 => generated 288 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:21:59.672151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c47690b7-986e-4a80-a308-140b54e00e46 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] Calling method '.version_select at 0x7f1e5bd6a160>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:59.678824 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2844/5713] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:21:58 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1692 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:21:59.832045 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c47690b7-986e-4a80-a308-140b54e00e46 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] 10.222.0.93 "DELETE /compute/v2.1/os-snapshots/007dca19-1f1b-46fd-b743-5fb3fb4485c2" status: 202 len: 0 microversion: 2.1 time: 0.164705 Aug 04 17:21:59.833794 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2870/5714] 10.222.0.93 () {58 vars in 1254 bytes} [Thu Aug 4 17:21:59 2022] DELETE /compute/v2.1/os-snapshots/007dca19-1f1b-46fd-b743-5fb3fb4485c2 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:21:59.846307 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7077777d-6d6c-471a-9dbb-31531687b50d tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] Calling method '.version_select at 0x7f1e5b389f70>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:21:59.935608 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7077777d-6d6c-471a-9dbb-31531687b50d tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/007dca19-1f1b-46fd-b743-5fb3fb4485c2" status: 200 len: 287 microversion: 2.1 time: 0.095488 Aug 04 17:21:59.942539 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2845/5715] 10.222.0.93 () {58 vars in 1251 bytes} [Thu Aug 4 17:21:59 2022] GET /compute/v2.1/os-snapshots/007dca19-1f1b-46fd-b743-5fb3fb4485c2 => generated 287 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:22:00.549231 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-905ce6ef-859b-4cb9-a902-3411d11da451 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:22:00.550249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-905ce6ef-859b-4cb9-a902-3411d11da451 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:22:00.587505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-905ce6ef-859b-4cb9-a902-3411d11da451 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:00.588337 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-905ce6ef-859b-4cb9-a902-3411d11da451 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:00.594201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-905ce6ef-859b-4cb9-a902-3411d11da451 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:00.597688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-905ce6ef-859b-4cb9-a902-3411d11da451 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:00.607256 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-905ce6ef-859b-4cb9-a902-3411d11da451 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:00.608341 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-905ce6ef-859b-4cb9-a902-3411d11da451 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:00.706623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2a9ba468-9326-4bfe-a468-9e9863eb67d0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:22:00.707512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2a9ba468-9326-4bfe-a468-9e9863eb67d0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:22:00.726571 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a9ba468-9326-4bfe-a468-9e9863eb67d0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:00.727297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a9ba468-9326-4bfe-a468-9e9863eb67d0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:00.727778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a9ba468-9326-4bfe-a468-9e9863eb67d0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:00.728835 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a9ba468-9326-4bfe-a468-9e9863eb67d0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:00.729607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a9ba468-9326-4bfe-a468-9e9863eb67d0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:00.730994 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a9ba468-9326-4bfe-a468-9e9863eb67d0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:02.020044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-905ce6ef-859b-4cb9-a902-3411d11da451 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:22:02.039112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-905ce6ef-859b-4cb9-a902-3411d11da451 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:22:02.045199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-905ce6ef-859b-4cb9-a902-3411d11da451 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:22:02.055942 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-905ce6ef-859b-4cb9-a902-3411d11da451 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 1.512550 Aug 04 17:22:02.057672 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2871/5716] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:22:00 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:22:02.072270 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-61f3db0e-4cd0-42df-8e93-08135ca16b4c req-b7d73d8b-6243-4336-9f87-0e1fcf5215af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "726db447-1df7-417d-a9e0-1c832e299621", "name": "network-vif-plugged", "status": "completed", "tag": "485e15db-88a6-41d7-ad94-dc268d623543"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:22:02.078896 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2a9ba468-9326-4bfe-a468-9e9863eb67d0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:22:02.090933 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2a9ba468-9326-4bfe-a468-9e9863eb67d0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1689 microversion: 2.1 time: 1.388567 Aug 04 17:22:02.092880 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2846/5717] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:22:00 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1689 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:22:02.105599 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9df31362-92da-4dff-be81-03af944683ea tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] Calling method '.version_select at 0x7f1e5b3890d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:22:02.121919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-61f3db0e-4cd0-42df-8e93-08135ca16b4c req-b7d73d8b-6243-4336-9f87-0e1fcf5215af service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:02.123169 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-61f3db0e-4cd0-42df-8e93-08135ca16b4c req-b7d73d8b-6243-4336-9f87-0e1fcf5215af service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:02.125153 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-61f3db0e-4cd0-42df-8e93-08135ca16b4c req-b7d73d8b-6243-4336-9f87-0e1fcf5215af service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:02.170709 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-61f3db0e-4cd0-42df-8e93-08135ca16b4c req-b7d73d8b-6243-4336-9f87-0e1fcf5215af service nova] Creating event network-vif-plugged:485e15db-88a6-41d7-ad94-dc268d623543 for instance 726db447-1df7-417d-a9e0-1c832e299621 on n-h2-851359-3 Aug 04 17:22:02.180024 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-61f3db0e-4cd0-42df-8e93-08135ca16b4c req-b7d73d8b-6243-4336-9f87-0e1fcf5215af service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118904 Aug 04 17:22:02.181396 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2872/5718] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:22:02.191023 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-294b36fd-19ad-487b-b79e-353625612fca tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:22:02.192320 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-294b36fd-19ad-487b-b79e-353625612fca tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:22:02.202871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-294b36fd-19ad-487b-b79e-353625612fca tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:02.203732 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-294b36fd-19ad-487b-b79e-353625612fca tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:02.204556 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-294b36fd-19ad-487b-b79e-353625612fca tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:02.205563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-294b36fd-19ad-487b-b79e-353625612fca tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:02.206314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-294b36fd-19ad-487b-b79e-353625612fca tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:02.207165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-294b36fd-19ad-487b-b79e-353625612fca tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:02.254841 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9df31362-92da-4dff-be81-03af944683ea tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/007dca19-1f1b-46fd-b743-5fb3fb4485c2" status: 200 len: 287 microversion: 2.1 time: 0.160615 Aug 04 17:22:02.255727 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2847/5719] 10.222.0.93 () {58 vars in 1251 bytes} [Thu Aug 4 17:22:02 2022] GET /compute/v2.1/os-snapshots/007dca19-1f1b-46fd-b743-5fb3fb4485c2 => generated 287 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:22:02.422738 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-294b36fd-19ad-487b-b79e-353625612fca tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "POST /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57/action" status: 202 len: 0 microversion: 2.1 time: 0.237247 Aug 04 17:22:02.423446 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2873/5720] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:22:02 2022] POST /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:22:02.432627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-234867f9-fb28-4021-9083-bb3ed868b381 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:22:02.433813 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-234867f9-fb28-4021-9083-bb3ed868b381 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:22:02.443926 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-234867f9-fb28-4021-9083-bb3ed868b381 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:02.444440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-234867f9-fb28-4021-9083-bb3ed868b381 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:02.445137 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-234867f9-fb28-4021-9083-bb3ed868b381 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:02.445955 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-234867f9-fb28-4021-9083-bb3ed868b381 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:02.450706 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-234867f9-fb28-4021-9083-bb3ed868b381 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:02.451169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-234867f9-fb28-4021-9083-bb3ed868b381 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:02.509640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=97 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:22:03.096487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6fc7460a-72ac-44cc-8a9a-f82118e6c055 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:22:03.107871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6fc7460a-72ac-44cc-8a9a-f82118e6c055 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:22:03.132772 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6fc7460a-72ac-44cc-8a9a-f82118e6c055 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:03.138571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6fc7460a-72ac-44cc-8a9a-f82118e6c055 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:03.139232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6fc7460a-72ac-44cc-8a9a-f82118e6c055 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:03.143988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6fc7460a-72ac-44cc-8a9a-f82118e6c055 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:03.144404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6fc7460a-72ac-44cc-8a9a-f82118e6c055 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:03.144861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6fc7460a-72ac-44cc-8a9a-f82118e6c055 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:03.456362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-234867f9-fb28-4021-9083-bb3ed868b381 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:22:03.494549 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-234867f9-fb28-4021-9083-bb3ed868b381 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1688 microversion: 2.1 time: 1.065938 Aug 04 17:22:03.495162 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2848/5721] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:22:02 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1688 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:22:03.501407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bc0c799f-f5ba-4e2c-b51b-0468c8cae923 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] Calling method '.version_select at 0x7f1e5bdde280>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:22:03.542931 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-bc0c799f-f5ba-4e2c-b51b-0468c8cae923 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] HTTP exception thrown: Snapshot 007dca19-1f1b-46fd-b743-5fb3fb4485c2 could not be found. Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bc0c799f-f5ba-4e2c-b51b-0468c8cae923 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] Request method failure captured: Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-snapshots/007dca19-1f1b-46fd-b743-5fb3fb4485c2 HTTP/1.1 Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AAtJZk0zc8yL1XC2g8UsPiH9c4MPf3iZrQ44holt_omeU_g9lUtBEg7h8bq58G_97_Budvpdw4LRtfsXciFYoxDL8e517u4Xje1n3J6iUnuhr70ZAsOLP2w7pNt916q1wui3LpcvWhNhb15n5z25DGv8MI1I4YFkDTRqEdcYrxlSx0 Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 7555fd950a574534abfd74a8b10227ed Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-664304671 Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7555fd950a574534abfd74a8b10227ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7555fd950a574534abfd74a8b10227ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_7555fd950a574534abfd74a8b10227ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/7555fd950a574534abfd74a8b10227ed"}]}] Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-VolumesSnapshotsTestJSON-664304671 Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 7555fd950a574534abfd74a8b10227ed Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-664304671 Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-VolumesSnapshotsTestJSON-664304671-project Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 89fa1d1e1c61453c9c305d87337d6b35 Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-VolumesSnapshotsTestJSON-664304671-project Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: exception: Snapshot 007dca19-1f1b-46fd-b743-5fb3fb4485c2 could not be found. Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '007dca19-1f1b-46fd-b743-5fb3fb4485c2'} Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 007dca19-1f1b-46fd-b743-5fb3fb4485c2 could not be found. (HTTP 404) (Request-ID: req-40295b5f-7fce-4dda-90b6-38651b24d210) Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 17:22:03.554098 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 007dca19-1f1b-46fd-b743-5fb3fb4485c2 could not be found. Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 007dca19-1f1b-46fd-b743-5fb3fb4485c2 could not be found. Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 007dca19-1f1b-46fd-b743-5fb3fb4485c2 could not be found. Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bc0c799f-f5ba-4e2c-b51b-0468c8cae923 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] Returning 404 to user: Snapshot 007dca19-1f1b-46fd-b743-5fb3fb4485c2 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bc0c799f-f5ba-4e2c-b51b-0468c8cae923 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/007dca19-1f1b-46fd-b743-5fb3fb4485c2" status: 404 len: 111 microversion: 2.1 time: 0.058953 Aug 04 17:22:03.560327 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2849/5722] 10.222.0.93 () {58 vars in 1251 bytes} [Thu Aug 4 17:22:03 2022] GET /compute/v2.1/os-snapshots/007dca19-1f1b-46fd-b743-5fb3fb4485c2 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:22:03.578821 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5b6d931f-c185-4035-b58e-ac7d60f6e6a8 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] Calling method '.version_select at 0x7f1e5bb86790>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:22:03.690633 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5b6d931f-c185-4035-b58e-ac7d60f6e6a8 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/0969e677-ccc3-4f3f-814d-581d70a6a9e9" status: 202 len: 0 microversion: 2.1 time: 0.125141 Aug 04 17:22:03.691850 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2850/5723] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Aug 4 17:22:03 2022] DELETE /compute/v2.1/os-volumes/0969e677-ccc3-4f3f-814d-581d70a6a9e9 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:22:03.706604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6a50c698-5522-4bd4-9922-321d43b2d83a tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] Calling method '.version_select at 0x7f1e5a3703a0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:22:03.814440 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6a50c698-5522-4bd4-9922-321d43b2d83a tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/0969e677-ccc3-4f3f-814d-581d70a6a9e9" status: 200 len: 345 microversion: 2.1 time: 0.110667 Aug 04 17:22:03.816091 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2851/5724] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Aug 4 17:22:03 2022] GET /compute/v2.1/os-volumes/0969e677-ccc3-4f3f-814d-581d70a6a9e9 => generated 345 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:22:04.303494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-5bf70782-6951-4da4-b7ec-c7e018efea76 req-f161232d-0d93-4eb2-ab9e-5d4114b1a112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "726db447-1df7-417d-a9e0-1c832e299621", "name": "network-vif-plugged", "status": "completed", "tag": "9af8c8e0-eab5-4884-8cf2-8ebe6aa58e3c"}, {"server_uuid": "726db447-1df7-417d-a9e0-1c832e299621", "name": "network-vif-plugged", "status": "completed", "tag": "046e0a45-4ead-4c1d-a197-0872ec3beff4"}, {"server_uuid": "726db447-1df7-417d-a9e0-1c832e299621", "name": "network-vif-plugged", "status": "completed", "tag": "e397d801-65f8-4228-9ea6-fb3cb8adfc19"}, {"server_uuid": "726db447-1df7-417d-a9e0-1c832e299621", "name": "network-vif-plugged", "status": "completed", "tag": "f6f39783-21ab-4cb8-8d8b-96d99d3f6366"}, {"server_uuid": "726db447-1df7-417d-a9e0-1c832e299621", "name": "network-vif-plugged", "status": "completed", "tag": "fdb23d55-8a38-4aff-b71c-c6c9f6001dd5"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:22:04.352380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6fc7460a-72ac-44cc-8a9a-f82118e6c055 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:22:04.354368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=40 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:22:04.371544 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5bf70782-6951-4da4-b7ec-c7e018efea76 req-f161232d-0d93-4eb2-ab9e-5d4114b1a112 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:04.378130 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6fc7460a-72ac-44cc-8a9a-f82118e6c055 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:22:04.379043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5bf70782-6951-4da4-b7ec-c7e018efea76 req-f161232d-0d93-4eb2-ab9e-5d4114b1a112 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:04.379615 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5bf70782-6951-4da4-b7ec-c7e018efea76 req-f161232d-0d93-4eb2-ab9e-5d4114b1a112 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:04.380577 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6fc7460a-72ac-44cc-8a9a-f82118e6c055 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:22:04.382065 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6fc7460a-72ac-44cc-8a9a-f82118e6c055 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 1.302704 Aug 04 17:22:04.383513 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2874/5725] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:22:03 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:22:04.407417 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-5bf70782-6951-4da4-b7ec-c7e018efea76 req-f161232d-0d93-4eb2-ab9e-5d4114b1a112 service nova] Creating event network-vif-plugged:9af8c8e0-eab5-4884-8cf2-8ebe6aa58e3c for instance 726db447-1df7-417d-a9e0-1c832e299621 on n-h2-851359-3 Aug 04 17:22:04.407987 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-5bf70782-6951-4da4-b7ec-c7e018efea76 req-f161232d-0d93-4eb2-ab9e-5d4114b1a112 service nova] Creating event network-vif-plugged:046e0a45-4ead-4c1d-a197-0872ec3beff4 for instance 726db447-1df7-417d-a9e0-1c832e299621 on n-h2-851359-3 Aug 04 17:22:04.408520 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-5bf70782-6951-4da4-b7ec-c7e018efea76 req-f161232d-0d93-4eb2-ab9e-5d4114b1a112 service nova] Creating event network-vif-plugged:e397d801-65f8-4228-9ea6-fb3cb8adfc19 for instance 726db447-1df7-417d-a9e0-1c832e299621 on n-h2-851359-3 Aug 04 17:22:04.409026 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-5bf70782-6951-4da4-b7ec-c7e018efea76 req-f161232d-0d93-4eb2-ab9e-5d4114b1a112 service nova] Creating event network-vif-plugged:f6f39783-21ab-4cb8-8d8b-96d99d3f6366 for instance 726db447-1df7-417d-a9e0-1c832e299621 on n-h2-851359-3 Aug 04 17:22:04.409742 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-5bf70782-6951-4da4-b7ec-c7e018efea76 req-f161232d-0d93-4eb2-ab9e-5d4114b1a112 service nova] Creating event network-vif-plugged:fdb23d55-8a38-4aff-b71c-c6c9f6001dd5 for instance 726db447-1df7-417d-a9e0-1c832e299621 on n-h2-851359-3 Aug 04 17:22:04.426284 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-5bf70782-6951-4da4-b7ec-c7e018efea76 req-f161232d-0d93-4eb2-ab9e-5d4114b1a112 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.140417 Aug 04 17:22:04.428215 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2852/5726] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:22:04.528496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-935340d5-443d-48e3-817b-74e829f1e40b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:22:04.529246 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-935340d5-443d-48e3-817b-74e829f1e40b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:22:04.544432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-935340d5-443d-48e3-817b-74e829f1e40b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:04.546323 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-935340d5-443d-48e3-817b-74e829f1e40b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:04.547588 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-935340d5-443d-48e3-817b-74e829f1e40b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:04.549412 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-935340d5-443d-48e3-817b-74e829f1e40b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:04.550182 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-935340d5-443d-48e3-817b-74e829f1e40b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:04.550825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-935340d5-443d-48e3-817b-74e829f1e40b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:04.830218 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f51ef609-9b28-46e5-ad4b-ef0edc65eb82 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] Calling method '.version_select at 0x7f1e5b3a8820>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:22:04.955542 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f51ef609-9b28-46e5-ad4b-ef0edc65eb82 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/0969e677-ccc3-4f3f-814d-581d70a6a9e9" status: 200 len: 345 microversion: 2.1 time: 0.129839 Aug 04 17:22:04.963769 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2853/5727] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Aug 4 17:22:04 2022] GET /compute/v2.1/os-volumes/0969e677-ccc3-4f3f-814d-581d70a6a9e9 => generated 345 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:22:05.140343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-935340d5-443d-48e3-817b-74e829f1e40b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:22:05.152779 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-935340d5-443d-48e3-817b-74e829f1e40b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1688 microversion: 2.1 time: 0.629709 Aug 04 17:22:05.166126 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2875/5728] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:22:04 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1688 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:22:05.413638 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b8a9f553-a257-4731-8a41-f6a1e04d9ea8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:22:05.413638 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b8a9f553-a257-4731-8a41-f6a1e04d9ea8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:22:05.431203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8a9f553-a257-4731-8a41-f6a1e04d9ea8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:05.431606 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8a9f553-a257-4731-8a41-f6a1e04d9ea8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:05.432062 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8a9f553-a257-4731-8a41-f6a1e04d9ea8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:05.433343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8a9f553-a257-4731-8a41-f6a1e04d9ea8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:05.433818 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8a9f553-a257-4731-8a41-f6a1e04d9ea8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:05.434326 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8a9f553-a257-4731-8a41-f6a1e04d9ea8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:05.972297 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e8a27a61-9e19-4e6e-bd98-076445294326 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] Calling method '.version_select at 0x7f1e5a3f88b0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:22:06.086275 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e8a27a61-9e19-4e6e-bd98-076445294326 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/0969e677-ccc3-4f3f-814d-581d70a6a9e9" status: 200 len: 345 microversion: 2.1 time: 0.119581 Aug 04 17:22:06.087877 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2876/5729] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Aug 4 17:22:05 2022] GET /compute/v2.1/os-volumes/0969e677-ccc3-4f3f-814d-581d70a6a9e9 => generated 345 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:22:06.190665 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b7ad80f9-1733-4e22-8f5b-268764f5e76c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:22:06.191459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b7ad80f9-1733-4e22-8f5b-268764f5e76c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:22:06.208517 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b7ad80f9-1733-4e22-8f5b-268764f5e76c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:06.209446 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b7ad80f9-1733-4e22-8f5b-268764f5e76c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:06.210849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b7ad80f9-1733-4e22-8f5b-268764f5e76c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:06.212848 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b7ad80f9-1733-4e22-8f5b-268764f5e76c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:06.215448 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b7ad80f9-1733-4e22-8f5b-268764f5e76c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:06.216015 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b7ad80f9-1733-4e22-8f5b-268764f5e76c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:07.487440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b8a9f553-a257-4731-8a41-f6a1e04d9ea8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:22:07.512081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b8a9f553-a257-4731-8a41-f6a1e04d9ea8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:22:07.526905 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b8a9f553-a257-4731-8a41-f6a1e04d9ea8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:22:07.528927 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b8a9f553-a257-4731-8a41-f6a1e04d9ea8 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1873 microversion: 2.42 time: 2.123755 Aug 04 17:22:07.529770 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2854/5730] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:22:05 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1873 bytes in 2125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:22:07.556762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-60dd766b-b4c8-4ea1-94c3-2bff5d23fc1e req-29626625-8354-4faf-83b3-867f52a44d10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "596804f9-9964-419e-bed5-d24e20805b57", "name": "network-vif-plugged", "status": "completed", "tag": "51b8ad4a-9d13-46c2-a8d0-1daea7b6bced"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:22:07.586101 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-60dd766b-b4c8-4ea1-94c3-2bff5d23fc1e req-29626625-8354-4faf-83b3-867f52a44d10 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:07.593118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-60dd766b-b4c8-4ea1-94c3-2bff5d23fc1e req-29626625-8354-4faf-83b3-867f52a44d10 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:07.594532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-60dd766b-b4c8-4ea1-94c3-2bff5d23fc1e req-29626625-8354-4faf-83b3-867f52a44d10 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:07.624742 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b7ad80f9-1733-4e22-8f5b-268764f5e76c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:22:07.639330 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-60dd766b-b4c8-4ea1-94c3-2bff5d23fc1e req-29626625-8354-4faf-83b3-867f52a44d10 service nova] Creating event network-vif-plugged:51b8ad4a-9d13-46c2-a8d0-1daea7b6bced for instance 596804f9-9964-419e-bed5-d24e20805b57 on n-h2-851359-3 Aug 04 17:22:07.654174 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-60dd766b-b4c8-4ea1-94c3-2bff5d23fc1e req-29626625-8354-4faf-83b3-867f52a44d10 service nova] Instance 596804f9-9964-419e-bed5-d24e20805b57 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:22:07.662375 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b7ad80f9-1733-4e22-8f5b-268764f5e76c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1688 microversion: 2.1 time: 1.477695 Aug 04 17:22:07.671279 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2877/5731] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:22:06 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1688 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:22:07.689075 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-60dd766b-b4c8-4ea1-94c3-2bff5d23fc1e req-29626625-8354-4faf-83b3-867f52a44d10 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157635 Aug 04 17:22:07.696022 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5dd1a2cb-62e1-4994-9ab8-a3ef15da17f3 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] Calling method '.version_select at 0x7f1e5a3e29d0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:22:07.706804 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2855/5732] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:22:07.776975 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5dd1a2cb-62e1-4994-9ab8-a3ef15da17f3 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/0969e677-ccc3-4f3f-814d-581d70a6a9e9" status: 200 len: 345 microversion: 2.1 time: 0.096583 Aug 04 17:22:07.777566 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2878/5733] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Aug 4 17:22:07 2022] GET /compute/v2.1/os-volumes/0969e677-ccc3-4f3f-814d-581d70a6a9e9 => generated 345 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:22:08.567216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c5d6a027-1593-4b35-ae05-e3821be58393 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:22:08.568819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c5d6a027-1593-4b35-ae05-e3821be58393 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:22:08.582155 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5d6a027-1593-4b35-ae05-e3821be58393 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:08.582661 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5d6a027-1593-4b35-ae05-e3821be58393 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:08.583107 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5d6a027-1593-4b35-ae05-e3821be58393 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:08.583854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5d6a027-1593-4b35-ae05-e3821be58393 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:08.584313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5d6a027-1593-4b35-ae05-e3821be58393 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:08.584744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5d6a027-1593-4b35-ae05-e3821be58393 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:08.687982 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4423d077-5c7e-45ec-b559-b7f0ddb37c40 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:22:08.689120 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4423d077-5c7e-45ec-b559-b7f0ddb37c40 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:22:08.714611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4423d077-5c7e-45ec-b559-b7f0ddb37c40 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:08.715625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4423d077-5c7e-45ec-b559-b7f0ddb37c40 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:08.717752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4423d077-5c7e-45ec-b559-b7f0ddb37c40 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:08.721531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4423d077-5c7e-45ec-b559-b7f0ddb37c40 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:08.722576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4423d077-5c7e-45ec-b559-b7f0ddb37c40 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:08.723505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4423d077-5c7e-45ec-b559-b7f0ddb37c40 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:09.232974 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4423d077-5c7e-45ec-b559-b7f0ddb37c40 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:22:09.255086 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4423d077-5c7e-45ec-b559-b7f0ddb37c40 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1688 microversion: 2.1 time: 0.572414 Aug 04 17:22:09.266924 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2879/5734] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:22:08 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1688 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:22:09.275284 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-10abbe9e-e210-4069-95da-42fc5abb47a0 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] Calling method '.version_select at 0x7f1e5a40c820>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:22:09.371849 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-10abbe9e-e210-4069-95da-42fc5abb47a0 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] HTTP exception thrown: Volume 0969e677-ccc3-4f3f-814d-581d70a6a9e9 could not be found. Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-10abbe9e-e210-4069-95da-42fc5abb47a0 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] Request method failure captured: Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/os-volumes/0969e677-ccc3-4f3f-814d-581d70a6a9e9 HTTP/1.1 Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7AAtJZk0zc8yL1XC2g8UsPiH9c4MPf3iZrQ44holt_omeU_g9lUtBEg7h8bq58G_97_Budvpdw4LRtfsXciFYoxDL8e517u4Xje1n3J6iUnuhr70ZAsOLP2w7pNt916q1wui3LpcvWhNhb15n5z25DGv8MI1I4YFkDTRqEdcYrxlSx0 Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 7555fd950a574534abfd74a8b10227ed Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-664304671 Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7555fd950a574534abfd74a8b10227ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7555fd950a574534abfd74a8b10227ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_7555fd950a574534abfd74a8b10227ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/7555fd950a574534abfd74a8b10227ed"}]}] Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-VolumesSnapshotsTestJSON-664304671 Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 7555fd950a574534abfd74a8b10227ed Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-664304671 Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-VolumesSnapshotsTestJSON-664304671-project Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 89fa1d1e1c61453c9c305d87337d6b35 Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-VolumesSnapshotsTestJSON-664304671-project Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: exception: Volume 0969e677-ccc3-4f3f-814d-581d70a6a9e9 could not be found. Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '0969e677-ccc3-4f3f-814d-581d70a6a9e9'} Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0969e677-ccc3-4f3f-814d-581d70a6a9e9 could not be found. (HTTP 404) (Request-ID: req-2dc58806-a2ae-451a-aa6f-cafa42f1ee34) Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 17:22:09.381700 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0969e677-ccc3-4f3f-814d-581d70a6a9e9 could not be found. Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0969e677-ccc3-4f3f-814d-581d70a6a9e9 could not be found. Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0969e677-ccc3-4f3f-814d-581d70a6a9e9 could not be found. Aug 04 17:22:09.393601 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:22:09.403188 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-10abbe9e-e210-4069-95da-42fc5abb47a0 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] Returning 404 to user: Volume 0969e677-ccc3-4f3f-814d-581d70a6a9e9 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:22:09.408820 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-10abbe9e-e210-4069-95da-42fc5abb47a0 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/0969e677-ccc3-4f3f-814d-581d70a6a9e9" status: 404 len: 109 microversion: 2.1 time: 0.136696 Aug 04 17:22:09.410507 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2880/5735] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Aug 4 17:22:09 2022] GET /compute/v2.1/os-volumes/0969e677-ccc3-4f3f-814d-581d70a6a9e9 => generated 109 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:22:09.434817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d4ea4fa8-1fe4-48b4-abbd-e996d94b9192 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] Calling method '.version_select at 0x7f1e5a36ad30>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:22:09.536415 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-d4ea4fa8-1fe4-48b4-abbd-e996d94b9192 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] HTTP exception thrown: Volume 0969e677-ccc3-4f3f-814d-581d70a6a9e9 could not be found. Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d4ea4fa8-1fe4-48b4-abbd-e996d94b9192 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] Request method failure captured: Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/os-volumes/0969e677-ccc3-4f3f-814d-581d70a6a9e9 HTTP/1.1 Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7AAtJZk0zc8yL1XC2g8UsPiH9c4MPf3iZrQ44holt_omeU_g9lUtBEg7h8bq58G_97_Budvpdw4LRtfsXciFYoxDL8e517u4Xje1n3J6iUnuhr70ZAsOLP2w7pNt916q1wui3LpcvWhNhb15n5z25DGv8MI1I4YFkDTRqEdcYrxlSx0 Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 7555fd950a574534abfd74a8b10227ed Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-664304671 Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7555fd950a574534abfd74a8b10227ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7555fd950a574534abfd74a8b10227ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_7555fd950a574534abfd74a8b10227ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/7555fd950a574534abfd74a8b10227ed"}]}] Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-VolumesSnapshotsTestJSON-664304671 Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 7555fd950a574534abfd74a8b10227ed Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-664304671 Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-VolumesSnapshotsTestJSON-664304671-project Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 89fa1d1e1c61453c9c305d87337d6b35 Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-VolumesSnapshotsTestJSON-664304671-project Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: exception: Volume 0969e677-ccc3-4f3f-814d-581d70a6a9e9 could not be found. Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '0969e677-ccc3-4f3f-814d-581d70a6a9e9'} Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0969e677-ccc3-4f3f-814d-581d70a6a9e9 could not be found. (HTTP 404) (Request-ID: req-cb9fd160-7f87-4af8-9cfd-80303c61de0c) Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 17:22:09.538747 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0969e677-ccc3-4f3f-814d-581d70a6a9e9 could not be found. Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0969e677-ccc3-4f3f-814d-581d70a6a9e9 could not be found. Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0969e677-ccc3-4f3f-814d-581d70a6a9e9 could not be found. Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d4ea4fa8-1fe4-48b4-abbd-e996d94b9192 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] Returning 404 to user: Volume 0969e677-ccc3-4f3f-814d-581d70a6a9e9 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d4ea4fa8-1fe4-48b4-abbd-e996d94b9192 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/0969e677-ccc3-4f3f-814d-581d70a6a9e9" status: 404 len: 109 microversion: 2.1 time: 0.118683 Aug 04 17:22:09.544437 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2881/5736] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Aug 4 17:22:09 2022] DELETE /compute/v2.1/os-volumes/0969e677-ccc3-4f3f-814d-581d70a6a9e9 => generated 109 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:22:09.553077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c9eaabff-7578-479d-86ab-bedf8c9702d9 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] Calling method '.version_select at 0x7f1e5a40cca0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:22:09.612300 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-c9eaabff-7578-479d-86ab-bedf8c9702d9 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] HTTP exception thrown: Volume 0969e677-ccc3-4f3f-814d-581d70a6a9e9 could not be found. Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c9eaabff-7578-479d-86ab-bedf8c9702d9 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] Request method failure captured: Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/os-volumes/0969e677-ccc3-4f3f-814d-581d70a6a9e9 HTTP/1.1 Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7AAtJZk0zc8yL1XC2g8UsPiH9c4MPf3iZrQ44holt_omeU_g9lUtBEg7h8bq58G_97_Budvpdw4LRtfsXciFYoxDL8e517u4Xje1n3J6iUnuhr70ZAsOLP2w7pNt916q1wui3LpcvWhNhb15n5z25DGv8MI1I4YFkDTRqEdcYrxlSx0 Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 7555fd950a574534abfd74a8b10227ed Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-664304671 Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7555fd950a574534abfd74a8b10227ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7555fd950a574534abfd74a8b10227ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_7555fd950a574534abfd74a8b10227ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/7555fd950a574534abfd74a8b10227ed"}]}] Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-VolumesSnapshotsTestJSON-664304671 Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 7555fd950a574534abfd74a8b10227ed Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-664304671 Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-VolumesSnapshotsTestJSON-664304671-project Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 89fa1d1e1c61453c9c305d87337d6b35 Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-VolumesSnapshotsTestJSON-664304671-project Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: exception: Volume 0969e677-ccc3-4f3f-814d-581d70a6a9e9 could not be found. Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '0969e677-ccc3-4f3f-814d-581d70a6a9e9'} Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0969e677-ccc3-4f3f-814d-581d70a6a9e9 could not be found. (HTTP 404) (Request-ID: req-efa72745-5e1f-4e0e-8805-06e6e505cc1e) Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 17:22:09.615674 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0969e677-ccc3-4f3f-814d-581d70a6a9e9 could not be found. Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0969e677-ccc3-4f3f-814d-581d70a6a9e9 could not be found. Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0969e677-ccc3-4f3f-814d-581d70a6a9e9 could not be found. Aug 04 17:22:09.621051 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:22:09.627734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c9eaabff-7578-479d-86ab-bedf8c9702d9 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] Returning 404 to user: Volume 0969e677-ccc3-4f3f-814d-581d70a6a9e9 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:22:09.628987 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c9eaabff-7578-479d-86ab-bedf8c9702d9 tempest-VolumesSnapshotsTestJSON-664304671 tempest-VolumesSnapshotsTestJSON-664304671-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/0969e677-ccc3-4f3f-814d-581d70a6a9e9" status: 404 len: 109 microversion: 2.1 time: 0.076932 Aug 04 17:22:09.628987 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2882/5737] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Aug 4 17:22:09 2022] GET /compute/v2.1/os-volumes/0969e677-ccc3-4f3f-814d-581d70a6a9e9 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:22:09.783739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c5d6a027-1593-4b35-ae05-e3821be58393 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:22:09.798359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c5d6a027-1593-4b35-ae05-e3821be58393 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:22:09.800823 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c5d6a027-1593-4b35-ae05-e3821be58393 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:22:09.803148 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c5d6a027-1593-4b35-ae05-e3821be58393 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 2832 microversion: 2.42 time: 1.241561 Aug 04 17:22:09.829512 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2856/5738] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:22:08 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 2832 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:22:09.838074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-56a3d385-f46a-4738-adb6-14d8b696e688 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:22:09.840234 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-56a3d385-f46a-4738-adb6-14d8b696e688 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:22:09.853311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56a3d385-f46a-4738-adb6-14d8b696e688 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:09.854282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56a3d385-f46a-4738-adb6-14d8b696e688 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:09.855799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56a3d385-f46a-4738-adb6-14d8b696e688 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:09.856775 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56a3d385-f46a-4738-adb6-14d8b696e688 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:09.857452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56a3d385-f46a-4738-adb6-14d8b696e688 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:09.858173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56a3d385-f46a-4738-adb6-14d8b696e688 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:10.295546 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9c2ead51-70ac-4e5a-afd2-99b6dc864760 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:22:10.295546 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9c2ead51-70ac-4e5a-afd2-99b6dc864760 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:22:10.305400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c2ead51-70ac-4e5a-afd2-99b6dc864760 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:10.305916 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c2ead51-70ac-4e5a-afd2-99b6dc864760 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:10.306408 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c2ead51-70ac-4e5a-afd2-99b6dc864760 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:10.307171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c2ead51-70ac-4e5a-afd2-99b6dc864760 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:10.308254 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c2ead51-70ac-4e5a-afd2-99b6dc864760 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:10.308705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c2ead51-70ac-4e5a-afd2-99b6dc864760 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:10.363461 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-56a3d385-f46a-4738-adb6-14d8b696e688 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.532233 Aug 04 17:22:10.365333 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2883/5739] 10.222.0.93 () {60 vars in 1316 bytes} [Thu Aug 4 17:22:09 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621/os-interface => generated 1831 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:22:11.940876 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9c2ead51-70ac-4e5a-afd2-99b6dc864760 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:22:11.964589 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9c2ead51-70ac-4e5a-afd2-99b6dc864760 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1688 microversion: 2.1 time: 1.679402 Aug 04 17:22:11.965218 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2857/5740] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:22:10 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1688 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:22:12.735062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-62d64677-6f3a-48b5-9f5b-93514e3f2e7b req-20083590-b579-4aed-af70-f4923ce0f511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "596804f9-9964-419e-bed5-d24e20805b57", "name": "network-vif-unplugged", "status": "completed", "tag": "51b8ad4a-9d13-46c2-a8d0-1daea7b6bced"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:22:12.756695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=58 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:22:12.779380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-62d64677-6f3a-48b5-9f5b-93514e3f2e7b req-20083590-b579-4aed-af70-f4923ce0f511 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:12.779903 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-62d64677-6f3a-48b5-9f5b-93514e3f2e7b req-20083590-b579-4aed-af70-f4923ce0f511 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:12.780355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-62d64677-6f3a-48b5-9f5b-93514e3f2e7b req-20083590-b579-4aed-af70-f4923ce0f511 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:12.810006 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-62d64677-6f3a-48b5-9f5b-93514e3f2e7b req-20083590-b579-4aed-af70-f4923ce0f511 service nova] Creating event network-vif-unplugged:51b8ad4a-9d13-46c2-a8d0-1daea7b6bced for instance 596804f9-9964-419e-bed5-d24e20805b57 on n-h1-851359-3 Aug 04 17:22:12.826686 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [req-62d64677-6f3a-48b5-9f5b-93514e3f2e7b req-20083590-b579-4aed-af70-f4923ce0f511 service nova] Instance 596804f9-9964-419e-bed5-d24e20805b57 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:22:12.860306 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-62d64677-6f3a-48b5-9f5b-93514e3f2e7b req-20083590-b579-4aed-af70-f4923ce0f511 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125615 Aug 04 17:22:12.862699 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2884/5741] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:22:12.990343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f29e6ead-20d3-44b2-b886-a649c399a877 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:22:12.992286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f29e6ead-20d3-44b2-b886-a649c399a877 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:22:13.011735 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f29e6ead-20d3-44b2-b886-a649c399a877 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:13.013264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f29e6ead-20d3-44b2-b886-a649c399a877 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:13.014448 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f29e6ead-20d3-44b2-b886-a649c399a877 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:13.016054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f29e6ead-20d3-44b2-b886-a649c399a877 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:13.017170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f29e6ead-20d3-44b2-b886-a649c399a877 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:13.020707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f29e6ead-20d3-44b2-b886-a649c399a877 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:14.015778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f29e6ead-20d3-44b2-b886-a649c399a877 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:22:14.030842 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f29e6ead-20d3-44b2-b886-a649c399a877 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1688 microversion: 2.1 time: 1.045552 Aug 04 17:22:14.044301 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2858/5742] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:22:12 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1688 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:22:14.940439 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-4c868050-1ccf-4bf3-ab6c-0f5c3a30267a req-cd47f39f-515a-4e5a-a862-2e4560641b50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "596804f9-9964-419e-bed5-d24e20805b57", "tag": "51b8ad4a-9d13-46c2-a8d0-1daea7b6bced"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:22:14.953711 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-4c868050-1ccf-4bf3-ab6c-0f5c3a30267a req-cd47f39f-515a-4e5a-a862-2e4560641b50 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:14.954346 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-4c868050-1ccf-4bf3-ab6c-0f5c3a30267a req-cd47f39f-515a-4e5a-a862-2e4560641b50 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:14.955050 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-4c868050-1ccf-4bf3-ab6c-0f5c3a30267a req-cd47f39f-515a-4e5a-a862-2e4560641b50 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:14.972575 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-4c868050-1ccf-4bf3-ab6c-0f5c3a30267a req-cd47f39f-515a-4e5a-a862-2e4560641b50 service nova] Creating event network-changed:51b8ad4a-9d13-46c2-a8d0-1daea7b6bced for instance 596804f9-9964-419e-bed5-d24e20805b57 on n-h1-851359-3 Aug 04 17:22:14.981444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [req-4c868050-1ccf-4bf3-ab6c-0f5c3a30267a req-cd47f39f-515a-4e5a-a862-2e4560641b50 service nova] Instance 596804f9-9964-419e-bed5-d24e20805b57 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:22:15.005720 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-4c868050-1ccf-4bf3-ab6c-0f5c3a30267a req-cd47f39f-515a-4e5a-a862-2e4560641b50 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071990 Aug 04 17:22:15.007435 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2885/5743] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:22:15.071583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-995644b7-fc3d-4c65-9e75-1715fd276358 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:22:15.074350 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-995644b7-fc3d-4c65-9e75-1715fd276358 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:22:15.098316 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-995644b7-fc3d-4c65-9e75-1715fd276358 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:15.098884 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-995644b7-fc3d-4c65-9e75-1715fd276358 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:15.099351 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-995644b7-fc3d-4c65-9e75-1715fd276358 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:15.100111 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-995644b7-fc3d-4c65-9e75-1715fd276358 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:15.102628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-995644b7-fc3d-4c65-9e75-1715fd276358 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:15.103976 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-995644b7-fc3d-4c65-9e75-1715fd276358 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:16.553354 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-995644b7-fc3d-4c65-9e75-1715fd276358 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:22:16.586979 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-995644b7-fc3d-4c65-9e75-1715fd276358 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1688 microversion: 2.1 time: 1.526029 Aug 04 17:22:16.606195 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2859/5744] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:22:15 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1688 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:22:17.220257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-7dce9ba0-0457-48fb-8ba0-f8c92b13c3d4 req-1788489a-7ae6-4807-83e8-b2708f8f2d3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "726db447-1df7-417d-a9e0-1c832e299621", "tag": "046e0a45-4ead-4c1d-a197-0872ec3beff4"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:22:17.257325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7dce9ba0-0457-48fb-8ba0-f8c92b13c3d4 req-1788489a-7ae6-4807-83e8-b2708f8f2d3b service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:17.258181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7dce9ba0-0457-48fb-8ba0-f8c92b13c3d4 req-1788489a-7ae6-4807-83e8-b2708f8f2d3b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:17.259655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7dce9ba0-0457-48fb-8ba0-f8c92b13c3d4 req-1788489a-7ae6-4807-83e8-b2708f8f2d3b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:17.287231 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-7dce9ba0-0457-48fb-8ba0-f8c92b13c3d4 req-1788489a-7ae6-4807-83e8-b2708f8f2d3b service nova] Creating event network-changed:046e0a45-4ead-4c1d-a197-0872ec3beff4 for instance 726db447-1df7-417d-a9e0-1c832e299621 on n-h2-851359-3 Aug 04 17:22:17.315812 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-7dce9ba0-0457-48fb-8ba0-f8c92b13c3d4 req-1788489a-7ae6-4807-83e8-b2708f8f2d3b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098968 Aug 04 17:22:17.317742 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2886/5745] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:22:17.633210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-45da4f11-ecb8-41a9-a827-68be4864d67c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:22:17.634240 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-45da4f11-ecb8-41a9-a827-68be4864d67c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:22:17.664078 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45da4f11-ecb8-41a9-a827-68be4864d67c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:17.669384 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45da4f11-ecb8-41a9-a827-68be4864d67c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:17.671778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45da4f11-ecb8-41a9-a827-68be4864d67c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:17.677315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45da4f11-ecb8-41a9-a827-68be4864d67c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:17.678613 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45da4f11-ecb8-41a9-a827-68be4864d67c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:17.683282 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45da4f11-ecb8-41a9-a827-68be4864d67c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:18.795468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-45da4f11-ecb8-41a9-a827-68be4864d67c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:22:18.820990 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-45da4f11-ecb8-41a9-a827-68be4864d67c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1681 microversion: 2.1 time: 1.195561 Aug 04 17:22:18.827154 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2860/5746] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:22:17 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1681 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:22:20.784725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-7b58997d-6401-4103-82b8-222f5cf255a1 req-3151c3d9-564d-451f-aa9e-90bab5aa1420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "596804f9-9964-419e-bed5-d24e20805b57", "name": "network-vif-plugged", "status": "completed", "tag": "51b8ad4a-9d13-46c2-a8d0-1daea7b6bced"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:22:20.849324 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7b58997d-6401-4103-82b8-222f5cf255a1 req-3151c3d9-564d-451f-aa9e-90bab5aa1420 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:20.850433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7b58997d-6401-4103-82b8-222f5cf255a1 req-3151c3d9-564d-451f-aa9e-90bab5aa1420 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:20.857121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7b58997d-6401-4103-82b8-222f5cf255a1 req-3151c3d9-564d-451f-aa9e-90bab5aa1420 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:20.926028 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-7b58997d-6401-4103-82b8-222f5cf255a1 req-3151c3d9-564d-451f-aa9e-90bab5aa1420 service nova] Creating event network-vif-plugged:51b8ad4a-9d13-46c2-a8d0-1daea7b6bced for instance 596804f9-9964-419e-bed5-d24e20805b57 on n-h1-851359-3 Aug 04 17:22:20.955531 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-7b58997d-6401-4103-82b8-222f5cf255a1 req-3151c3d9-564d-451f-aa9e-90bab5aa1420 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182391 Aug 04 17:22:20.961094 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2887/5747] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:22:41.338161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0de487f2-7996-45f0-9ee2-77a29a8fe745 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:22:41.340974 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0de487f2-7996-45f0-9ee2-77a29a8fe745 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:22:41.396826 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=15 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:22:41.398610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=47 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:22:41.414696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0de487f2-7996-45f0-9ee2-77a29a8fe745 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:41.415537 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0de487f2-7996-45f0-9ee2-77a29a8fe745 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:41.416829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0de487f2-7996-45f0-9ee2-77a29a8fe745 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:41.439121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0de487f2-7996-45f0-9ee2-77a29a8fe745 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:41.440055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0de487f2-7996-45f0-9ee2-77a29a8fe745 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:41.442424 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0de487f2-7996-45f0-9ee2-77a29a8fe745 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:41.587481 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0de487f2-7996-45f0-9ee2-77a29a8fe745 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "POST /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57/action" status: 200 len: 63133 microversion: 2.1 time: 0.259216 Aug 04 17:22:41.598118 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2861/5748] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:22:41 2022] POST /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57/action => generated 63133 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:22:43.018592 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:22:43.019138 n-d-851359-3 devstack@n-api.service[131044]: Thu Aug 4 17:22:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 17:22:43.066268 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:22:43.066567 n-d-851359-3 devstack@n-api.service[131044]: Thu Aug 4 17:22:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 17:22:47.810737 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-66704b7f-e8e6-4e2b-bbfb-a84339d13afc tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:22:47.812402 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-66704b7f-e8e6-4e2b-bbfb-a84339d13afc tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:22:47.821378 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=7 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:22:47.825692 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:22:47.830873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66704b7f-e8e6-4e2b-bbfb-a84339d13afc tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:47.832878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66704b7f-e8e6-4e2b-bbfb-a84339d13afc tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:47.834410 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66704b7f-e8e6-4e2b-bbfb-a84339d13afc tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:47.837506 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66704b7f-e8e6-4e2b-bbfb-a84339d13afc tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:47.839895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66704b7f-e8e6-4e2b-bbfb-a84339d13afc tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:47.841384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66704b7f-e8e6-4e2b-bbfb-a84339d13afc tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:48.224603 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-66704b7f-e8e6-4e2b-bbfb-a84339d13afc tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1832 microversion: 2.1 time: 0.419664 Aug 04 17:22:48.250116 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2888/5749] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:22:47 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1832 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:22:51.603259 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a7a44ba3-4fed-4d6d-8158-e7d1be7e9ade tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:22:51.607488 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a7a44ba3-4fed-4d6d-8158-e7d1be7e9ade tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:22:51.633717 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:22:51.639697 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:22:51.649666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-adb58a17-7d3e-474d-a6e8-a2fc6635a0ee req-86dedd67-b686-4657-892b-3fbc3deecf61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "596804f9-9964-419e-bed5-d24e20805b57", "tag": "51b8ad4a-9d13-46c2-a8d0-1daea7b6bced"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:22:51.658474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7a44ba3-4fed-4d6d-8158-e7d1be7e9ade tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:51.659567 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7a44ba3-4fed-4d6d-8158-e7d1be7e9ade tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:51.668044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7a44ba3-4fed-4d6d-8158-e7d1be7e9ade tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:51.669379 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-adb58a17-7d3e-474d-a6e8-a2fc6635a0ee req-86dedd67-b686-4657-892b-3fbc3deecf61 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:51.670030 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-adb58a17-7d3e-474d-a6e8-a2fc6635a0ee req-86dedd67-b686-4657-892b-3fbc3deecf61 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:51.670642 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-adb58a17-7d3e-474d-a6e8-a2fc6635a0ee req-86dedd67-b686-4657-892b-3fbc3deecf61 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:51.679795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7a44ba3-4fed-4d6d-8158-e7d1be7e9ade tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:51.681494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7a44ba3-4fed-4d6d-8158-e7d1be7e9ade tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:51.682279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7a44ba3-4fed-4d6d-8158-e7d1be7e9ade tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:51.704155 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-adb58a17-7d3e-474d-a6e8-a2fc6635a0ee req-86dedd67-b686-4657-892b-3fbc3deecf61 service nova] Creating event network-changed:51b8ad4a-9d13-46c2-a8d0-1daea7b6bced for instance 596804f9-9964-419e-bed5-d24e20805b57 on n-h1-851359-3 Aug 04 17:22:51.713806 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-adb58a17-7d3e-474d-a6e8-a2fc6635a0ee req-86dedd67-b686-4657-892b-3fbc3deecf61 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073339 Aug 04 17:22:51.715031 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2889/5750] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:22:51.895567 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a7a44ba3-4fed-4d6d-8158-e7d1be7e9ade tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:22:52.268681 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a7a44ba3-4fed-4d6d-8158-e7d1be7e9ade tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "DELETE /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 204 len: 0 microversion: 2.1 time: 0.678427 Aug 04 17:22:52.283892 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2862/5751] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:22:51 2022] DELETE /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:22:52.288972 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8f9dc62a-f3a2-47fb-a6a5-ebf68bff5373 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:22:52.289951 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8f9dc62a-f3a2-47fb-a6a5-ebf68bff5373 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:22:52.316305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8f9dc62a-f3a2-47fb-a6a5-ebf68bff5373 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:52.317615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8f9dc62a-f3a2-47fb-a6a5-ebf68bff5373 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:52.320685 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8f9dc62a-f3a2-47fb-a6a5-ebf68bff5373 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:52.327633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8f9dc62a-f3a2-47fb-a6a5-ebf68bff5373 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:52.329055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8f9dc62a-f3a2-47fb-a6a5-ebf68bff5373 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:52.333508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8f9dc62a-f3a2-47fb-a6a5-ebf68bff5373 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:53.170806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8f9dc62a-f3a2-47fb-a6a5-ebf68bff5373 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:22:53.190315 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8f9dc62a-f3a2-47fb-a6a5-ebf68bff5373 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1687 microversion: 2.1 time: 0.902989 Aug 04 17:22:53.202113 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2890/5752] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:22:52 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1687 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:22:54.223665 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9111608a-f2f2-47c5-9e82-e3c678468cca tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:22:54.224814 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9111608a-f2f2-47c5-9e82-e3c678468cca tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:22:54.257069 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9111608a-f2f2-47c5-9e82-e3c678468cca tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:54.258695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9111608a-f2f2-47c5-9e82-e3c678468cca tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:54.261434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9111608a-f2f2-47c5-9e82-e3c678468cca tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:54.263593 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9111608a-f2f2-47c5-9e82-e3c678468cca tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:54.268309 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9111608a-f2f2-47c5-9e82-e3c678468cca tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:54.271841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9111608a-f2f2-47c5-9e82-e3c678468cca tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:54.734265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9111608a-f2f2-47c5-9e82-e3c678468cca tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:22:54.751896 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9111608a-f2f2-47c5-9e82-e3c678468cca tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1687 microversion: 2.1 time: 0.532949 Aug 04 17:22:54.754299 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2863/5753] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:22:54 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1687 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:22:55.356529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-7c266eb7-2aa9-442f-a550-21d0c5161118 req-9bbfd31f-397a-46ca-8072-12771ce8d072 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "596804f9-9964-419e-bed5-d24e20805b57", "name": "network-vif-deleted", "tag": "51b8ad4a-9d13-46c2-a8d0-1daea7b6bced"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:22:55.465319 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7c266eb7-2aa9-442f-a550-21d0c5161118 req-9bbfd31f-397a-46ca-8072-12771ce8d072 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:55.466044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7c266eb7-2aa9-442f-a550-21d0c5161118 req-9bbfd31f-397a-46ca-8072-12771ce8d072 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:55.466579 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7c266eb7-2aa9-442f-a550-21d0c5161118 req-9bbfd31f-397a-46ca-8072-12771ce8d072 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:55.523290 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-7c266eb7-2aa9-442f-a550-21d0c5161118 req-9bbfd31f-397a-46ca-8072-12771ce8d072 service nova] Creating event network-vif-deleted:51b8ad4a-9d13-46c2-a8d0-1daea7b6bced for instance 596804f9-9964-419e-bed5-d24e20805b57 on n-h1-851359-3 Aug 04 17:22:55.544108 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-7c266eb7-2aa9-442f-a550-21d0c5161118 req-9bbfd31f-397a-46ca-8072-12771ce8d072 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206876 Aug 04 17:22:55.547849 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2891/5754] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:22:55.844508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eb0fd643-d94d-4709-9b9a-909e1cafd109 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:22:55.845095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eb0fd643-d94d-4709-9b9a-909e1cafd109 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:22:55.927534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb0fd643-d94d-4709-9b9a-909e1cafd109 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:55.943014 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb0fd643-d94d-4709-9b9a-909e1cafd109 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:55.943526 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb0fd643-d94d-4709-9b9a-909e1cafd109 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:55.944315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb0fd643-d94d-4709-9b9a-909e1cafd109 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:55.944838 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb0fd643-d94d-4709-9b9a-909e1cafd109 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:55.945285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb0fd643-d94d-4709-9b9a-909e1cafd109 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:56.124927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb0fd643-d94d-4709-9b9a-909e1cafd109 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:56.131682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb0fd643-d94d-4709-9b9a-909e1cafd109 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:56.133390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb0fd643-d94d-4709-9b9a-909e1cafd109 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:56.134170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-eb0fd643-d94d-4709-9b9a-909e1cafd109 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lazy-loading 'fault' on Instance uuid 596804f9-9964-419e-bed5-d24e20805b57 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:22:56.412030 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eb0fd643-d94d-4709-9b9a-909e1cafd109 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:22:56.426663 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eb0fd643-d94d-4709-9b9a-909e1cafd109 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 200 len: 1354 microversion: 2.1 time: 0.599927 Aug 04 17:22:56.430631 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2864/5755] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:22:55 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 1354 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:22:56.701482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9ce99981-24c7-40cd-ac37-f251b7c75332 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:22:56.703291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9ce99981-24c7-40cd-ac37-f251b7c75332 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:22:56.728903 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9ce99981-24c7-40cd-ac37-f251b7c75332 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:56.729441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9ce99981-24c7-40cd-ac37-f251b7c75332 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:56.731084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9ce99981-24c7-40cd-ac37-f251b7c75332 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:56.733445 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9ce99981-24c7-40cd-ac37-f251b7c75332 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:56.735197 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9ce99981-24c7-40cd-ac37-f251b7c75332 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:56.735677 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9ce99981-24c7-40cd-ac37-f251b7c75332 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:57.329359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9ce99981-24c7-40cd-ac37-f251b7c75332 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:22:57.359702 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9ce99981-24c7-40cd-ac37-f251b7c75332 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:22:57.362044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9ce99981-24c7-40cd-ac37-f251b7c75332 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:22:57.363455 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9ce99981-24c7-40cd-ac37-f251b7c75332 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 2951 microversion: 2.42 time: 0.670137 Aug 04 17:22:57.364037 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2892/5756] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:22:56 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 2951 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:22:57.396318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-49f0a177-b8e1-4f82-84a0-f79b1d9cb76f tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:22:57.396910 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-49f0a177-b8e1-4f82-84a0-f79b1d9cb76f tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:22:57.411299 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49f0a177-b8e1-4f82-84a0-f79b1d9cb76f tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:57.415992 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49f0a177-b8e1-4f82-84a0-f79b1d9cb76f tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:57.416631 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49f0a177-b8e1-4f82-84a0-f79b1d9cb76f tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:57.418164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49f0a177-b8e1-4f82-84a0-f79b1d9cb76f tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:57.419304 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49f0a177-b8e1-4f82-84a0-f79b1d9cb76f tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:57.420325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49f0a177-b8e1-4f82-84a0-f79b1d9cb76f tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:57.462497 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-40c632d0-0689-49e5-9180-f1a2c1a38d04 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:22:57.463668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-40c632d0-0689-49e5-9180-f1a2c1a38d04 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: 596804f9-9964-419e-bed5-d24e20805b57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:22:57.489624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-40c632d0-0689-49e5-9180-f1a2c1a38d04 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:57.490171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-40c632d0-0689-49e5-9180-f1a2c1a38d04 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:57.490626 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-40c632d0-0689-49e5-9180-f1a2c1a38d04 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:57.491360 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-40c632d0-0689-49e5-9180-f1a2c1a38d04 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:22:57.491828 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-40c632d0-0689-49e5-9180-f1a2c1a38d04 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:22:57.492270 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-40c632d0-0689-49e5-9180-f1a2c1a38d04 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:22:57.575424 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-40c632d0-0689-49e5-9180-f1a2c1a38d04 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] HTTP exception thrown: Instance 596804f9-9964-419e-bed5-d24e20805b57 could not be found. Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-40c632d0-0689-49e5-9180-f1a2c1a38d04 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Request method failure captured: Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 HTTP/1.1 Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_63t572KuanVtq4R8MzvDbiJ5v4ZNLlIXNSeyaKZEreu-AZsY7LrigOd4ifgpCoVaTwnv6OlvH-5A4ZEjIVqN__JovdO3v25O3MH0-YQTpeaIifMEkPAJkS3gutHWKyi3cRSKLpwrID6LrAGigELMSbch6EEsMqa6Zl19KmfJ88KcE Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 9c69a3e46122413f928fe20a76b0cf94 Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1197876832 Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9c69a3e46122413f928fe20a76b0cf94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9c69a3e46122413f928fe20a76b0cf94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9c69a3e46122413f928fe20a76b0cf94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9c69a3e46122413f928fe20a76b0cf94"}]}] Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1197876832 Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 9c69a3e46122413f928fe20a76b0cf94 Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1197876832 Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-TestNetworkAdvancedServerOps-1197876832-project Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: f27a58cf36934daeabff9e35c05d4c19 Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1197876832-project Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 596804f9-9964-419e-bed5-d24e20805b57 could not be found. Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '596804f9-9964-419e-bed5-d24e20805b57'} Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 596804f9-9964-419e-bed5-d24e20805b57 could not be found. Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 596804f9-9964-419e-bed5-d24e20805b57 could not be found. Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:22:57.577410 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:22:57.580782 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:22:57.580782 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:22:57.580782 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:22:57.580782 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:22:57.580782 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:22:57.580782 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:22:57.580782 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 596804f9-9964-419e-bed5-d24e20805b57 could not be found. Aug 04 17:22:57.580782 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:22:57.580782 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-40c632d0-0689-49e5-9180-f1a2c1a38d04 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Returning 404 to user: Instance 596804f9-9964-419e-bed5-d24e20805b57 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:22:57.582444 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-40c632d0-0689-49e5-9180-f1a2c1a38d04 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57" status: 404 len: 111 microversion: 2.1 time: 0.133861 Aug 04 17:22:57.582444 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2893/5757] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:22:57 2022] GET /compute/v2.1/servers/596804f9-9964-419e-bed5-d24e20805b57 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:22:57.844117 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-49f0a177-b8e1-4f82-84a0-f79b1d9cb76f tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.452365 Aug 04 17:22:57.863957 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2865/5758] 10.222.0.93 () {60 vars in 1316 bytes} [Thu Aug 4 17:22:57 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621/os-interface => generated 1831 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:23:18.111406 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2509298d-1ff2-470b-be3a-b13d281245bb tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '.version_select at 0x7f1e5a3e2790>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:23:18.127984 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=12 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:23:18.129117 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=24 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:23:18.182038 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2509298d-1ff2-470b-be3a-b13d281245bb tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-79789233" status: 202 len: 0 microversion: 2.1 time: 0.075358 Aug 04 17:23:18.183927 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2894/5759] 10.222.0.93 () {58 vars in 1278 bytes} [Thu Aug 4 17:23:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-79789233 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:23:18.230297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:23:18.231192 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:23:18.235903 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6665eaa8-4d89-4725-9c0e-1cf665249c69 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Action: 'create', calling method: .version_select at 0x7f1e6c944550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1144795933", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaqMyrLu9XHlDiHEBS7OiUIy0ZU+7lJBNHikkYGGfPfKUeDxYoOb00nRbuUhXCtJg8SIU/8IrK5iv+069EnsU/DX6PvMqbA9UDre00vaP9sUTWRwQ3ztZUrPeoUKA2ouw=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:23:18.282803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-6665eaa8-4d89-4725-9c0e-1cf665249c69 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Getting quotas for project 9c69a3e46122413f928fe20a76b0cf94. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:23:18.295537 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-6665eaa8-4d89-4725-9c0e-1cf665249c69 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Getting quotas for user f27a58cf36934daeabff9e35c05d4c19 and project 9c69a3e46122413f928fe20a76b0cf94. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:23:18.358329 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6665eaa8-4d89-4725-9c0e-1cf665249c69 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.133438 Aug 04 17:23:18.359300 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2866/5760] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:23:18 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:23:43.293495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-16a9db11-b6df-4cb0-a0dc-699bd5cd55bc tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2078779214", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "3d59855b-7d60-403e-a946-200b84e156af"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1144795933", "security_groups": [{"name": "tempest-secgroup-smoke-60685578"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:23:43.335253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:23:43.655826 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-16a9db11-b6df-4cb0-a0dc-699bd5cd55bc tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] validate_networks() for [('3d59855b-7d60-403e-a946-200b84e156af', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:23:45.088134 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-16a9db11-b6df-4cb0-a0dc-699bd5cd55bc tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:23:45.090132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-16a9db11-b6df-4cb0-a0dc-699bd5cd55bc tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:23:45.090915 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-16a9db11-b6df-4cb0-a0dc-699bd5cd55bc tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:23:45.091554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-16a9db11-b6df-4cb0-a0dc-699bd5cd55bc tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:23:45.092487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-16a9db11-b6df-4cb0-a0dc-699bd5cd55bc tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:23:45.111421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16a9db11-b6df-4cb0-a0dc-699bd5cd55bc tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:23:45.114910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16a9db11-b6df-4cb0-a0dc-699bd5cd55bc tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:23:45.115654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16a9db11-b6df-4cb0-a0dc-699bd5cd55bc tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:23:45.119015 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16a9db11-b6df-4cb0-a0dc-699bd5cd55bc tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:23:45.120942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16a9db11-b6df-4cb0-a0dc-699bd5cd55bc tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:23:45.125020 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16a9db11-b6df-4cb0-a0dc-699bd5cd55bc tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:23:45.184618 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-16a9db11-b6df-4cb0-a0dc-699bd5cd55bc tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Getting quotas for project 9c69a3e46122413f928fe20a76b0cf94. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:23:45.204077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-16a9db11-b6df-4cb0-a0dc-699bd5cd55bc tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Getting quotas for user f27a58cf36934daeabff9e35c05d4c19 and project 9c69a3e46122413f928fe20a76b0cf94. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:23:45.233037 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-16a9db11-b6df-4cb0-a0dc-699bd5cd55bc tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:23:45.236148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-16a9db11-b6df-4cb0-a0dc-699bd5cd55bc tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:23:45.301347 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-16a9db11-b6df-4cb0-a0dc-699bd5cd55bc tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.012295 Aug 04 17:23:45.303101 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2895/5761] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:23:43 2022] POST /compute/v2.1/servers => generated 404 bytes in 2016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:23:45.318893 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6cb8e0fa-4715-428d-865f-bd89c6cecfb8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:23:45.321166 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6cb8e0fa-4715-428d-865f-bd89c6cecfb8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:23:45.331104 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:23:45.332407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:23:45.484673 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6cb8e0fa-4715-428d-865f-bd89c6cecfb8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:23:45.502251 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6cb8e0fa-4715-428d-865f-bd89c6cecfb8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1267 microversion: 2.1 time: 0.190998 Aug 04 17:23:45.523828 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2867/5762] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:23:45 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1267 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:23:46.536632 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a9bd5801-8939-4cf1-be87-89c4e18ec764 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:23:46.538208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a9bd5801-8939-4cf1-be87-89c4e18ec764 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:23:46.555837 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a9bd5801-8939-4cf1-be87-89c4e18ec764 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:23:46.557259 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a9bd5801-8939-4cf1-be87-89c4e18ec764 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:23:46.557945 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a9bd5801-8939-4cf1-be87-89c4e18ec764 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:23:46.559229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a9bd5801-8939-4cf1-be87-89c4e18ec764 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:23:46.559947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a9bd5801-8939-4cf1-be87-89c4e18ec764 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:23:46.565934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a9bd5801-8939-4cf1-be87-89c4e18ec764 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:23:47.148617 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a9bd5801-8939-4cf1-be87-89c4e18ec764 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:23:47.178991 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a9bd5801-8939-4cf1-be87-89c4e18ec764 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1271 microversion: 2.1 time: 0.648283 Aug 04 17:23:47.180297 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2896/5763] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:23:46 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1271 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:23:48.214154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b13fd86e-193a-4b08-967f-a457935c4f5b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:23:48.215476 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b13fd86e-193a-4b08-967f-a457935c4f5b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:23:48.231092 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b13fd86e-193a-4b08-967f-a457935c4f5b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:23:48.231956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b13fd86e-193a-4b08-967f-a457935c4f5b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:23:48.232563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b13fd86e-193a-4b08-967f-a457935c4f5b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:23:48.234140 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b13fd86e-193a-4b08-967f-a457935c4f5b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:23:48.235727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b13fd86e-193a-4b08-967f-a457935c4f5b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:23:48.236337 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b13fd86e-193a-4b08-967f-a457935c4f5b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:23:48.414923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b13fd86e-193a-4b08-967f-a457935c4f5b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:23:48.439827 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b13fd86e-193a-4b08-967f-a457935c4f5b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1319 microversion: 2.1 time: 0.239530 Aug 04 17:23:48.442853 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2868/5764] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:23:48 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:23:49.466968 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b27d1be1-c8c3-4546-a364-b53a79577fb6 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:23:49.468716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b27d1be1-c8c3-4546-a364-b53a79577fb6 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:23:49.484559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b27d1be1-c8c3-4546-a364-b53a79577fb6 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:23:49.485486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b27d1be1-c8c3-4546-a364-b53a79577fb6 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:23:49.486156 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b27d1be1-c8c3-4546-a364-b53a79577fb6 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:23:49.487736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b27d1be1-c8c3-4546-a364-b53a79577fb6 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:23:49.489362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b27d1be1-c8c3-4546-a364-b53a79577fb6 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:23:49.490640 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b27d1be1-c8c3-4546-a364-b53a79577fb6 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:23:49.689376 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b27d1be1-c8c3-4546-a364-b53a79577fb6 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:23:49.723193 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b27d1be1-c8c3-4546-a364-b53a79577fb6 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1325 microversion: 2.1 time: 0.260278 Aug 04 17:23:49.726819 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2897/5765] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:23:49 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1325 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:23:50.748472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-737f1dea-b59b-4a28-ba55-4a5fa57f24fa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:23:50.750907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-737f1dea-b59b-4a28-ba55-4a5fa57f24fa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:23:50.808782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-737f1dea-b59b-4a28-ba55-4a5fa57f24fa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:23:50.816227 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-737f1dea-b59b-4a28-ba55-4a5fa57f24fa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:23:50.817083 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-737f1dea-b59b-4a28-ba55-4a5fa57f24fa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:23:50.823855 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-737f1dea-b59b-4a28-ba55-4a5fa57f24fa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:23:50.824704 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-737f1dea-b59b-4a28-ba55-4a5fa57f24fa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:23:50.825281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-737f1dea-b59b-4a28-ba55-4a5fa57f24fa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:23:51.805606 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-737f1dea-b59b-4a28-ba55-4a5fa57f24fa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:23:51.824261 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-737f1dea-b59b-4a28-ba55-4a5fa57f24fa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1391 microversion: 2.1 time: 1.083305 Aug 04 17:23:51.825480 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2869/5766] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:23:50 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1391 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:23:52.852599 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-62dc4ad4-e9c5-46f8-bb3c-8dae3ff4ebb9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:23:52.853248 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-62dc4ad4-e9c5-46f8-bb3c-8dae3ff4ebb9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:23:52.864264 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-62dc4ad4-e9c5-46f8-bb3c-8dae3ff4ebb9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:23:52.864775 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-62dc4ad4-e9c5-46f8-bb3c-8dae3ff4ebb9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:23:52.874722 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-62dc4ad4-e9c5-46f8-bb3c-8dae3ff4ebb9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:23:52.875599 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-62dc4ad4-e9c5-46f8-bb3c-8dae3ff4ebb9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:23:52.876085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-62dc4ad4-e9c5-46f8-bb3c-8dae3ff4ebb9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:23:52.876528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-62dc4ad4-e9c5-46f8-bb3c-8dae3ff4ebb9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:23:53.179019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-cc9c8e4c-3c9d-4c98-8687-020567d9dc03 req-eacdd2f6-d9f0-4b42-9c54-e5d250064746 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acef330f-cbb0-4eda-aecd-23ddcf3916a7", "tag": "2701aeee-8c0b-4201-aa2f-2cc2c92c111d"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:23:53.207561 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-cc9c8e4c-3c9d-4c98-8687-020567d9dc03 req-eacdd2f6-d9f0-4b42-9c54-e5d250064746 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:23:53.208065 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-cc9c8e4c-3c9d-4c98-8687-020567d9dc03 req-eacdd2f6-d9f0-4b42-9c54-e5d250064746 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:23:53.208565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-cc9c8e4c-3c9d-4c98-8687-020567d9dc03 req-eacdd2f6-d9f0-4b42-9c54-e5d250064746 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:23:53.238598 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-cc9c8e4c-3c9d-4c98-8687-020567d9dc03 req-eacdd2f6-d9f0-4b42-9c54-e5d250064746 service nova] Creating event network-changed:2701aeee-8c0b-4201-aa2f-2cc2c92c111d for instance acef330f-cbb0-4eda-aecd-23ddcf3916a7 on n-h1-851359-3 Aug 04 17:23:53.246032 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-cc9c8e4c-3c9d-4c98-8687-020567d9dc03 req-eacdd2f6-d9f0-4b42-9c54-e5d250064746 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076785 Aug 04 17:23:53.246425 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2870/5767] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:23:53.706843 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-62dc4ad4-e9c5-46f8-bb3c-8dae3ff4ebb9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:23:53.720930 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-62dc4ad4-e9c5-46f8-bb3c-8dae3ff4ebb9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1391 microversion: 2.1 time: 0.872085 Aug 04 17:23:53.721548 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2898/5768] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:23:52 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1391 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:23:54.744780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3606884e-862f-4601-85b0-15c44d072920 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:23:54.745495 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3606884e-862f-4601-85b0-15c44d072920 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:23:54.755486 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3606884e-862f-4601-85b0-15c44d072920 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:23:54.756656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3606884e-862f-4601-85b0-15c44d072920 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:23:54.757371 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3606884e-862f-4601-85b0-15c44d072920 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:23:54.760555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3606884e-862f-4601-85b0-15c44d072920 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:23:54.761341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3606884e-862f-4601-85b0-15c44d072920 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:23:54.762172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3606884e-862f-4601-85b0-15c44d072920 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:23:55.191113 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3606884e-862f-4601-85b0-15c44d072920 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:23:55.206844 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3606884e-862f-4601-85b0-15c44d072920 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1391 microversion: 2.1 time: 0.463688 Aug 04 17:23:55.229679 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2871/5769] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:23:54 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1391 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:23:56.237276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b42941ac-54f7-431f-bc80-152cd95b7cc9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:23:56.243790 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b42941ac-54f7-431f-bc80-152cd95b7cc9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:23:56.255193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:23:56.256546 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:23:56.258791 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b42941ac-54f7-431f-bc80-152cd95b7cc9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:23:56.259306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b42941ac-54f7-431f-bc80-152cd95b7cc9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:23:56.259974 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b42941ac-54f7-431f-bc80-152cd95b7cc9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:23:56.261182 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b42941ac-54f7-431f-bc80-152cd95b7cc9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:23:56.261668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b42941ac-54f7-431f-bc80-152cd95b7cc9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:23:56.262272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b42941ac-54f7-431f-bc80-152cd95b7cc9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:23:57.031609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b42941ac-54f7-431f-bc80-152cd95b7cc9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:23:57.042302 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b42941ac-54f7-431f-bc80-152cd95b7cc9 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1391 microversion: 2.1 time: 0.813170 Aug 04 17:23:57.043592 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2899/5770] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:23:56 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1391 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:23:58.078119 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-42979936-f052-4d86-aef9-39dcee5ed4d0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:23:58.080389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-42979936-f052-4d86-aef9-39dcee5ed4d0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:23:58.092239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:23:58.124694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-42979936-f052-4d86-aef9-39dcee5ed4d0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:23:58.126368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-42979936-f052-4d86-aef9-39dcee5ed4d0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:23:58.126849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-42979936-f052-4d86-aef9-39dcee5ed4d0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:23:58.128274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-42979936-f052-4d86-aef9-39dcee5ed4d0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:23:58.128878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-42979936-f052-4d86-aef9-39dcee5ed4d0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:23:58.129347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-42979936-f052-4d86-aef9-39dcee5ed4d0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:23:58.600934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-42979936-f052-4d86-aef9-39dcee5ed4d0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:23:58.620557 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-42979936-f052-4d86-aef9-39dcee5ed4d0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1391 microversion: 2.1 time: 0.552963 Aug 04 17:23:58.627668 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2872/5771] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:23:58 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1391 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:23:59.653692 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e4312b9a-e00a-4e0b-8ba4-40ae00d42d24 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:23:59.654669 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e4312b9a-e00a-4e0b-8ba4-40ae00d42d24 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:23:59.674616 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4312b9a-e00a-4e0b-8ba4-40ae00d42d24 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:23:59.675185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4312b9a-e00a-4e0b-8ba4-40ae00d42d24 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:23:59.675656 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4312b9a-e00a-4e0b-8ba4-40ae00d42d24 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:23:59.676431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4312b9a-e00a-4e0b-8ba4-40ae00d42d24 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:23:59.676905 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4312b9a-e00a-4e0b-8ba4-40ae00d42d24 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:23:59.677348 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4312b9a-e00a-4e0b-8ba4-40ae00d42d24 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:23:59.860243 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-86563bde-a3ec-4c10-9888-a52b2d799d94 req-8548fab3-bc72-4c5e-a914-9dfe9af2a8a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acef330f-cbb0-4eda-aecd-23ddcf3916a7", "name": "network-vif-plugged", "status": "completed", "tag": "2701aeee-8c0b-4201-aa2f-2cc2c92c111d"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:23:59.885277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-86563bde-a3ec-4c10-9888-a52b2d799d94 req-8548fab3-bc72-4c5e-a914-9dfe9af2a8a1 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:23:59.886465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-86563bde-a3ec-4c10-9888-a52b2d799d94 req-8548fab3-bc72-4c5e-a914-9dfe9af2a8a1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:23:59.888261 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-86563bde-a3ec-4c10-9888-a52b2d799d94 req-8548fab3-bc72-4c5e-a914-9dfe9af2a8a1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:23:59.918854 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-86563bde-a3ec-4c10-9888-a52b2d799d94 req-8548fab3-bc72-4c5e-a914-9dfe9af2a8a1 service nova] Creating event network-vif-plugged:2701aeee-8c0b-4201-aa2f-2cc2c92c111d for instance acef330f-cbb0-4eda-aecd-23ddcf3916a7 on n-h1-851359-3 Aug 04 17:23:59.926819 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-86563bde-a3ec-4c10-9888-a52b2d799d94 req-8548fab3-bc72-4c5e-a914-9dfe9af2a8a1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072547 Aug 04 17:23:59.928876 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2873/5772] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:24:00.254206 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e4312b9a-e00a-4e0b-8ba4-40ae00d42d24 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:00.273527 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e4312b9a-e00a-4e0b-8ba4-40ae00d42d24 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1391 microversion: 2.1 time: 0.623274 Aug 04 17:24:00.275345 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2900/5773] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:23:59 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1391 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:01.314889 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7cb5e02f-4210-4544-ae84-64e92388fe7e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:01.316401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7cb5e02f-4210-4544-ae84-64e92388fe7e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:01.328905 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cb5e02f-4210-4544-ae84-64e92388fe7e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:01.331087 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cb5e02f-4210-4544-ae84-64e92388fe7e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:01.331743 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cb5e02f-4210-4544-ae84-64e92388fe7e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:01.332849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cb5e02f-4210-4544-ae84-64e92388fe7e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:01.333548 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cb5e02f-4210-4544-ae84-64e92388fe7e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:01.334825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cb5e02f-4210-4544-ae84-64e92388fe7e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:01.849424 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7cb5e02f-4210-4544-ae84-64e92388fe7e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:01.873739 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7cb5e02f-4210-4544-ae84-64e92388fe7e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1391 microversion: 2.1 time: 0.559697 Aug 04 17:24:01.877149 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2874/5774] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:01 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1391 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:02.901656 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ae91da2b-1c1a-4288-a5ac-b954d6e8cc30 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:02.902999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ae91da2b-1c1a-4288-a5ac-b954d6e8cc30 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:02.920018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae91da2b-1c1a-4288-a5ac-b954d6e8cc30 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:02.920528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae91da2b-1c1a-4288-a5ac-b954d6e8cc30 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:02.920993 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae91da2b-1c1a-4288-a5ac-b954d6e8cc30 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:02.922736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae91da2b-1c1a-4288-a5ac-b954d6e8cc30 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:02.923235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae91da2b-1c1a-4288-a5ac-b954d6e8cc30 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:02.923687 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae91da2b-1c1a-4288-a5ac-b954d6e8cc30 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:03.431840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ae91da2b-1c1a-4288-a5ac-b954d6e8cc30 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:03.458771 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ae91da2b-1c1a-4288-a5ac-b954d6e8cc30 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1563 microversion: 2.1 time: 0.564895 Aug 04 17:24:03.472288 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2901/5775] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:02 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1563 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:03.498729 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dcbbf84e-acdc-42b5-aeb8-9cfab531c4df tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:03.499434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dcbbf84e-acdc-42b5-aeb8-9cfab531c4df tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:03.512182 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcbbf84e-acdc-42b5-aeb8-9cfab531c4df tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:03.512694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcbbf84e-acdc-42b5-aeb8-9cfab531c4df tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:03.513173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcbbf84e-acdc-42b5-aeb8-9cfab531c4df tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:03.514006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcbbf84e-acdc-42b5-aeb8-9cfab531c4df tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:03.519973 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcbbf84e-acdc-42b5-aeb8-9cfab531c4df tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:03.520599 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcbbf84e-acdc-42b5-aeb8-9cfab531c4df tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:03.860399 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dcbbf84e-acdc-42b5-aeb8-9cfab531c4df tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:03.891466 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dcbbf84e-acdc-42b5-aeb8-9cfab531c4df tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1563 microversion: 2.1 time: 0.396834 Aug 04 17:24:03.892125 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2875/5776] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:03 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1563 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:09.466026 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f60f6abe-616b-41a1-a2af-46cfd4868741 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:09.466607 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f60f6abe-616b-41a1-a2af-46cfd4868741 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:09.478975 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f60f6abe-616b-41a1-a2af-46cfd4868741 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:09.482150 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f60f6abe-616b-41a1-a2af-46cfd4868741 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:09.482816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f60f6abe-616b-41a1-a2af-46cfd4868741 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:09.483586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f60f6abe-616b-41a1-a2af-46cfd4868741 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:09.484104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f60f6abe-616b-41a1-a2af-46cfd4868741 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:09.484516 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f60f6abe-616b-41a1-a2af-46cfd4868741 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:09.497275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-861c2b53-6418-43f6-b386-a7eee57220f3 req-e3a381d9-fede-4e16-a6c2-b2c51d75c56a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acef330f-cbb0-4eda-aecd-23ddcf3916a7", "tag": "2701aeee-8c0b-4201-aa2f-2cc2c92c111d"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:24:09.519896 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-861c2b53-6418-43f6-b386-a7eee57220f3 req-e3a381d9-fede-4e16-a6c2-b2c51d75c56a service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:09.520486 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-861c2b53-6418-43f6-b386-a7eee57220f3 req-e3a381d9-fede-4e16-a6c2-b2c51d75c56a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:09.520945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-861c2b53-6418-43f6-b386-a7eee57220f3 req-e3a381d9-fede-4e16-a6c2-b2c51d75c56a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:09.542308 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-861c2b53-6418-43f6-b386-a7eee57220f3 req-e3a381d9-fede-4e16-a6c2-b2c51d75c56a service nova] Creating event network-changed:2701aeee-8c0b-4201-aa2f-2cc2c92c111d for instance acef330f-cbb0-4eda-aecd-23ddcf3916a7 on n-h1-851359-3 Aug 04 17:24:09.551220 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-861c2b53-6418-43f6-b386-a7eee57220f3 req-e3a381d9-fede-4e16-a6c2-b2c51d75c56a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057604 Aug 04 17:24:09.552645 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2876/5777] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:24:09.816675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f60f6abe-616b-41a1-a2af-46cfd4868741 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:09.827321 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f60f6abe-616b-41a1-a2af-46cfd4868741 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1563 microversion: 2.1 time: 0.365602 Aug 04 17:24:09.827930 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2902/5778] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:09 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1563 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:28.492232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=22 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:24:28.493580 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=42 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:24:28.505717 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a1963f84-4dd4-4ae2-b653-97607984e258 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:24:28.515040 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a1963f84-4dd4-4ae2-b653-97607984e258 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:28.543704 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1963f84-4dd4-4ae2-b653-97607984e258 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:28.546321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1963f84-4dd4-4ae2-b653-97607984e258 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:28.547195 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1963f84-4dd4-4ae2-b653-97607984e258 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:28.549701 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1963f84-4dd4-4ae2-b653-97607984e258 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:28.553755 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1963f84-4dd4-4ae2-b653-97607984e258 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:28.557022 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1963f84-4dd4-4ae2-b653-97607984e258 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:28.665040 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a1963f84-4dd4-4ae2-b653-97607984e258 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "POST /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7/action" status: 200 len: 24548 microversion: 2.1 time: 0.176138 Aug 04 17:24:28.665727 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2877/5779] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:24:28 2022] POST /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7/action => generated 24548 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:24:39.679865 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a12150e7-3252-4ca6-bc98-909847562378 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:39.680487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a12150e7-3252-4ca6-bc98-909847562378 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:39.682890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:24:39.683567 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=44 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:24:39.697564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a12150e7-3252-4ca6-bc98-909847562378 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:39.698127 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a12150e7-3252-4ca6-bc98-909847562378 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:39.704739 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a12150e7-3252-4ca6-bc98-909847562378 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:39.705906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a12150e7-3252-4ca6-bc98-909847562378 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:39.707969 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a12150e7-3252-4ca6-bc98-909847562378 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:39.710984 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a12150e7-3252-4ca6-bc98-909847562378 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:40.673102 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a12150e7-3252-4ca6-bc98-909847562378 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:40.693686 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a12150e7-3252-4ca6-bc98-909847562378 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1681 microversion: 2.1 time: 1.011161 Aug 04 17:24:40.695474 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2903/5780] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:39 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1681 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:41.205281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-da885851-36df-412a-9bc8-f8e920986519 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:24:41.211856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-da885851-36df-412a-9bc8-f8e920986519 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:41.225757 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:24:41.226736 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:24:41.247407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da885851-36df-412a-9bc8-f8e920986519 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:41.247993 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da885851-36df-412a-9bc8-f8e920986519 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:41.251174 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da885851-36df-412a-9bc8-f8e920986519 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:41.255239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da885851-36df-412a-9bc8-f8e920986519 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:41.256280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da885851-36df-412a-9bc8-f8e920986519 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:41.257838 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da885851-36df-412a-9bc8-f8e920986519 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:41.349192 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-da885851-36df-412a-9bc8-f8e920986519 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "POST /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7/action" status: 200 len: 32621 microversion: 2.1 time: 0.150829 Aug 04 17:24:41.349869 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2878/5781] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:24:41 2022] POST /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7/action => generated 32621 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:24:41.503249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ac086a70-78c9-4866-a575-6711b6d5b5e5 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:41.504086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ac086a70-78c9-4866-a575-6711b6d5b5e5 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:41.515845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac086a70-78c9-4866-a575-6711b6d5b5e5 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:41.518562 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac086a70-78c9-4866-a575-6711b6d5b5e5 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:41.520423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac086a70-78c9-4866-a575-6711b6d5b5e5 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:41.522057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac086a70-78c9-4866-a575-6711b6d5b5e5 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:41.525850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac086a70-78c9-4866-a575-6711b6d5b5e5 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:41.526581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac086a70-78c9-4866-a575-6711b6d5b5e5 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:42.183798 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ac086a70-78c9-4866-a575-6711b6d5b5e5 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1832 microversion: 2.1 time: 0.684765 Aug 04 17:24:42.190024 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2904/5782] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:41 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1832 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:42.220558 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bfb7d0a2-9918-49ca-be27-f7c363476cdc tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:24:42.225009 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bfb7d0a2-9918-49ca-be27-f7c363476cdc tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:42.236936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bfb7d0a2-9918-49ca-be27-f7c363476cdc tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:42.237659 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bfb7d0a2-9918-49ca-be27-f7c363476cdc tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:42.238329 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bfb7d0a2-9918-49ca-be27-f7c363476cdc tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:42.239325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bfb7d0a2-9918-49ca-be27-f7c363476cdc tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:42.240345 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bfb7d0a2-9918-49ca-be27-f7c363476cdc tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:42.241309 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bfb7d0a2-9918-49ca-be27-f7c363476cdc tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:42.308659 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-bfb7d0a2-9918-49ca-be27-f7c363476cdc tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lazy-loading 'flavor' on Instance uuid acef330f-cbb0-4eda-aecd-23ddcf3916a7 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:24:42.346088 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bfb7d0a2-9918-49ca-be27-f7c363476cdc tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Going to try to live migrate instance to another host {{(pid=131044) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 04 17:24:46.435973 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bfb7d0a2-9918-49ca-be27-f7c363476cdc tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7/action" status: 202 len: 0 microversion: 2.1 time: 4.221804 Aug 04 17:24:46.438095 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2879/5783] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:24:42 2022] POST /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7/action => generated 0 bytes in 4225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:24:46.448903 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-921c92eb-7ee5-4b3a-ada6-54c122dcd154 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:46.450171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-921c92eb-7ee5-4b3a-ada6-54c122dcd154 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:46.467644 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-921c92eb-7ee5-4b3a-ada6-54c122dcd154 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:46.468509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-921c92eb-7ee5-4b3a-ada6-54c122dcd154 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:46.469347 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-921c92eb-7ee5-4b3a-ada6-54c122dcd154 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:46.470344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-921c92eb-7ee5-4b3a-ada6-54c122dcd154 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:46.471049 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-921c92eb-7ee5-4b3a-ada6-54c122dcd154 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:46.471693 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-921c92eb-7ee5-4b3a-ada6-54c122dcd154 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:47.291629 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-921c92eb-7ee5-4b3a-ada6-54c122dcd154 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:47.306425 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-921c92eb-7ee5-4b3a-ada6-54c122dcd154 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1691 microversion: 2.1 time: 0.862126 Aug 04 17:24:47.307012 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2905/5784] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:46 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1691 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:48.337948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b0fa6414-9f7e-4f1f-80d1-51c1a38ee21a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:48.341817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b0fa6414-9f7e-4f1f-80d1-51c1a38ee21a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:48.362284 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0fa6414-9f7e-4f1f-80d1-51c1a38ee21a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:48.363209 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0fa6414-9f7e-4f1f-80d1-51c1a38ee21a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:48.365578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0fa6414-9f7e-4f1f-80d1-51c1a38ee21a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:48.367200 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0fa6414-9f7e-4f1f-80d1-51c1a38ee21a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:48.368273 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0fa6414-9f7e-4f1f-80d1-51c1a38ee21a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:48.370243 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0fa6414-9f7e-4f1f-80d1-51c1a38ee21a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:48.909047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b0fa6414-9f7e-4f1f-80d1-51c1a38ee21a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:48.928679 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b0fa6414-9f7e-4f1f-80d1-51c1a38ee21a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1691 microversion: 2.1 time: 0.598186 Aug 04 17:24:48.930909 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2880/5785] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:48 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1691 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:49.951474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6f9192bc-4a9d-4d09-b74a-ce1ad0dac16a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:49.953160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6f9192bc-4a9d-4d09-b74a-ce1ad0dac16a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:49.974173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f9192bc-4a9d-4d09-b74a-ce1ad0dac16a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:49.977778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f9192bc-4a9d-4d09-b74a-ce1ad0dac16a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:49.980792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f9192bc-4a9d-4d09-b74a-ce1ad0dac16a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:49.982318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f9192bc-4a9d-4d09-b74a-ce1ad0dac16a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:49.990295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f9192bc-4a9d-4d09-b74a-ce1ad0dac16a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:49.991370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f9192bc-4a9d-4d09-b74a-ce1ad0dac16a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:50.340797 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-1e25115a-2ca5-4289-a17e-7a91d665e17f req-bb4a2d50-07b1-4e7d-bbc6-bfe4de57bd43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acef330f-cbb0-4eda-aecd-23ddcf3916a7", "name": "network-vif-unplugged", "status": "completed", "tag": "2701aeee-8c0b-4201-aa2f-2cc2c92c111d"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:24:50.406803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1e25115a-2ca5-4289-a17e-7a91d665e17f req-bb4a2d50-07b1-4e7d-bbc6-bfe4de57bd43 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:50.407314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1e25115a-2ca5-4289-a17e-7a91d665e17f req-bb4a2d50-07b1-4e7d-bbc6-bfe4de57bd43 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:50.407762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1e25115a-2ca5-4289-a17e-7a91d665e17f req-bb4a2d50-07b1-4e7d-bbc6-bfe4de57bd43 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:50.457933 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-1e25115a-2ca5-4289-a17e-7a91d665e17f req-bb4a2d50-07b1-4e7d-bbc6-bfe4de57bd43 service nova] Creating event network-vif-unplugged:2701aeee-8c0b-4201-aa2f-2cc2c92c111d for instance acef330f-cbb0-4eda-aecd-23ddcf3916a7 on n-h1-851359-3 Aug 04 17:24:50.467415 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-1e25115a-2ca5-4289-a17e-7a91d665e17f req-bb4a2d50-07b1-4e7d-bbc6-bfe4de57bd43 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128952 Aug 04 17:24:50.471234 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2881/5786] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:24:50.849760 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6f9192bc-4a9d-4d09-b74a-ce1ad0dac16a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:50.889073 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6f9192bc-4a9d-4d09-b74a-ce1ad0dac16a tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1691 microversion: 2.1 time: 0.941797 Aug 04 17:24:50.891307 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2906/5787] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:49 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1691 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:51.914361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a46b039a-7d81-4bae-97c8-67a96b646d4d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:51.915788 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a46b039a-7d81-4bae-97c8-67a96b646d4d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:51.936506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a46b039a-7d81-4bae-97c8-67a96b646d4d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:51.937660 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a46b039a-7d81-4bae-97c8-67a96b646d4d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:51.944383 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a46b039a-7d81-4bae-97c8-67a96b646d4d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:51.945398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a46b039a-7d81-4bae-97c8-67a96b646d4d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:51.949495 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a46b039a-7d81-4bae-97c8-67a96b646d4d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:51.950210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a46b039a-7d81-4bae-97c8-67a96b646d4d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:52.644501 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a46b039a-7d81-4bae-97c8-67a96b646d4d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:52.654566 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a46b039a-7d81-4bae-97c8-67a96b646d4d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1691 microversion: 2.1 time: 0.744977 Aug 04 17:24:52.666149 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2882/5788] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:51 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1691 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:52.938203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-dae0d7fb-29b5-420f-93c4-ceb8b133b4dd req-032ff60c-1e34-486a-a986-46151a1b685d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acef330f-cbb0-4eda-aecd-23ddcf3916a7", "tag": "2701aeee-8c0b-4201-aa2f-2cc2c92c111d"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:24:52.958915 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-dae0d7fb-29b5-420f-93c4-ceb8b133b4dd req-032ff60c-1e34-486a-a986-46151a1b685d service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:52.959300 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-dae0d7fb-29b5-420f-93c4-ceb8b133b4dd req-032ff60c-1e34-486a-a986-46151a1b685d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:52.959741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-dae0d7fb-29b5-420f-93c4-ceb8b133b4dd req-032ff60c-1e34-486a-a986-46151a1b685d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:52.986205 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-dae0d7fb-29b5-420f-93c4-ceb8b133b4dd req-032ff60c-1e34-486a-a986-46151a1b685d service nova] Creating event network-changed:2701aeee-8c0b-4201-aa2f-2cc2c92c111d for instance acef330f-cbb0-4eda-aecd-23ddcf3916a7 on n-h1-851359-3 Aug 04 17:24:53.001204 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-dae0d7fb-29b5-420f-93c4-ceb8b133b4dd req-032ff60c-1e34-486a-a986-46151a1b685d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.491561 Aug 04 17:24:53.007850 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2907/5789] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:24:53.689176 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1d7933af-716b-4ea5-ae07-ff90db00380c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:53.690411 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1d7933af-716b-4ea5-ae07-ff90db00380c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:53.698553 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d7933af-716b-4ea5-ae07-ff90db00380c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:53.699357 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d7933af-716b-4ea5-ae07-ff90db00380c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:53.699961 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d7933af-716b-4ea5-ae07-ff90db00380c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:53.700836 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d7933af-716b-4ea5-ae07-ff90db00380c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:53.701523 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d7933af-716b-4ea5-ae07-ff90db00380c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:53.702145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d7933af-716b-4ea5-ae07-ff90db00380c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:54.045452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1d7933af-716b-4ea5-ae07-ff90db00380c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:54.058684 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1d7933af-716b-4ea5-ae07-ff90db00380c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1691 microversion: 2.1 time: 0.373672 Aug 04 17:24:54.063061 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2883/5790] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:53 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1691 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:55.088329 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d10d9a56-144c-4564-a298-d5303d5244dd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:55.093009 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d10d9a56-144c-4564-a298-d5303d5244dd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:55.111445 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d10d9a56-144c-4564-a298-d5303d5244dd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:55.112798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d10d9a56-144c-4564-a298-d5303d5244dd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:55.117065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d10d9a56-144c-4564-a298-d5303d5244dd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:55.119089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d10d9a56-144c-4564-a298-d5303d5244dd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:55.122654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d10d9a56-144c-4564-a298-d5303d5244dd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:55.124304 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d10d9a56-144c-4564-a298-d5303d5244dd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:56.171089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d10d9a56-144c-4564-a298-d5303d5244dd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:56.180632 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d10d9a56-144c-4564-a298-d5303d5244dd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1691 microversion: 2.1 time: 1.097128 Aug 04 17:24:56.181868 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2908/5791] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:55 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1691 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:57.203889 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0679a6bc-3567-40ec-8355-34b6d0a56fc8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:57.204426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0679a6bc-3567-40ec-8355-34b6d0a56fc8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:57.217207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0679a6bc-3567-40ec-8355-34b6d0a56fc8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:57.221228 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0679a6bc-3567-40ec-8355-34b6d0a56fc8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:57.223092 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0679a6bc-3567-40ec-8355-34b6d0a56fc8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:57.231172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0679a6bc-3567-40ec-8355-34b6d0a56fc8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:57.231962 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0679a6bc-3567-40ec-8355-34b6d0a56fc8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:57.232592 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0679a6bc-3567-40ec-8355-34b6d0a56fc8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:57.715764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0679a6bc-3567-40ec-8355-34b6d0a56fc8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:57.728477 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0679a6bc-3567-40ec-8355-34b6d0a56fc8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1691 microversion: 2.1 time: 0.528307 Aug 04 17:24:57.729280 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2884/5792] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:57 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1691 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:24:58.752929 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f21d6d79-0607-4023-85a5-826c375c5430 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:24:58.753616 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f21d6d79-0607-4023-85a5-826c375c5430 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:24:58.766572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f21d6d79-0607-4023-85a5-826c375c5430 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:58.767282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f21d6d79-0607-4023-85a5-826c375c5430 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:58.768062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f21d6d79-0607-4023-85a5-826c375c5430 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:58.769081 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f21d6d79-0607-4023-85a5-826c375c5430 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:24:58.770236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f21d6d79-0607-4023-85a5-826c375c5430 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:24:58.770823 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f21d6d79-0607-4023-85a5-826c375c5430 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:24:59.105291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f21d6d79-0607-4023-85a5-826c375c5430 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:24:59.179818 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f21d6d79-0607-4023-85a5-826c375c5430 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1691 microversion: 2.1 time: 0.429401 Aug 04 17:24:59.184079 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2909/5793] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:24:58 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1691 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:00.217183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b578a626-2b7a-4393-b682-f50f1deefad1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:00.217838 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b578a626-2b7a-4393-b682-f50f1deefad1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:00.231753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b578a626-2b7a-4393-b682-f50f1deefad1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:00.232961 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b578a626-2b7a-4393-b682-f50f1deefad1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:00.233794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b578a626-2b7a-4393-b682-f50f1deefad1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:00.235108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b578a626-2b7a-4393-b682-f50f1deefad1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:00.236128 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b578a626-2b7a-4393-b682-f50f1deefad1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:00.236875 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b578a626-2b7a-4393-b682-f50f1deefad1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:00.987559 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b578a626-2b7a-4393-b682-f50f1deefad1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:00.999321 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b578a626-2b7a-4393-b682-f50f1deefad1 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1691 microversion: 2.1 time: 0.789616 Aug 04 17:25:01.000877 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2885/5794] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:00 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1691 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:02.023167 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d53d1951-5359-44cc-b208-dc1707006a84 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:02.023797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d53d1951-5359-44cc-b208-dc1707006a84 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:02.056207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d53d1951-5359-44cc-b208-dc1707006a84 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:02.057766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d53d1951-5359-44cc-b208-dc1707006a84 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:02.058658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d53d1951-5359-44cc-b208-dc1707006a84 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:02.061327 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d53d1951-5359-44cc-b208-dc1707006a84 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:02.072220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d53d1951-5359-44cc-b208-dc1707006a84 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:02.073045 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d53d1951-5359-44cc-b208-dc1707006a84 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:02.517960 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d53d1951-5359-44cc-b208-dc1707006a84 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:02.535979 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d53d1951-5359-44cc-b208-dc1707006a84 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1691 microversion: 2.1 time: 0.516331 Aug 04 17:25:02.544130 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2910/5795] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:02 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1691 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:03.563830 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5b618942-db3e-4058-a92a-0e1266b74c13 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:03.564809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5b618942-db3e-4058-a92a-0e1266b74c13 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:03.593148 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b618942-db3e-4058-a92a-0e1266b74c13 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:03.593926 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b618942-db3e-4058-a92a-0e1266b74c13 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:03.594558 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b618942-db3e-4058-a92a-0e1266b74c13 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:03.595441 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b618942-db3e-4058-a92a-0e1266b74c13 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:03.596057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b618942-db3e-4058-a92a-0e1266b74c13 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:03.602020 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b618942-db3e-4058-a92a-0e1266b74c13 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:04.132663 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-571ce807-e2c0-4aae-9bcf-3baa58dccf5d tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:04.133515 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-571ce807-e2c0-4aae-9bcf-3baa58dccf5d tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:04.144893 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-571ce807-e2c0-4aae-9bcf-3baa58dccf5d tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:04.146715 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-571ce807-e2c0-4aae-9bcf-3baa58dccf5d tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:04.147373 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-571ce807-e2c0-4aae-9bcf-3baa58dccf5d tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:04.150606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-571ce807-e2c0-4aae-9bcf-3baa58dccf5d tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:04.151482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-571ce807-e2c0-4aae-9bcf-3baa58dccf5d tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:04.152304 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-571ce807-e2c0-4aae-9bcf-3baa58dccf5d tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:04.181293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5b618942-db3e-4058-a92a-0e1266b74c13 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:04.200974 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5b618942-db3e-4058-a92a-0e1266b74c13 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1691 microversion: 2.1 time: 0.644862 Aug 04 17:25:04.202053 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2886/5796] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:03 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1691 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:04.242470 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-571ce807-e2c0-4aae-9bcf-3baa58dccf5d tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:25:04.385370 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-571ce807-e2c0-4aae-9bcf-3baa58dccf5d tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "DELETE /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 204 len: 0 microversion: 2.42 time: 0.807482 Aug 04 17:25:04.391693 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2911/5797] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Aug 4 17:25:03 2022] DELETE /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 0 bytes in 812 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:25:04.400745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-41d92521-f4c0-420e-bb3e-705ea0d42e5b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:04.404969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-41d92521-f4c0-420e-bb3e-705ea0d42e5b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:04.427839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41d92521-f4c0-420e-bb3e-705ea0d42e5b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:04.429258 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41d92521-f4c0-420e-bb3e-705ea0d42e5b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:04.430164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41d92521-f4c0-420e-bb3e-705ea0d42e5b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:04.431834 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41d92521-f4c0-420e-bb3e-705ea0d42e5b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:04.432983 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41d92521-f4c0-420e-bb3e-705ea0d42e5b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:04.434977 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41d92521-f4c0-420e-bb3e-705ea0d42e5b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:04.840258 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-41d92521-f4c0-420e-bb3e-705ea0d42e5b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:04.875202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-41d92521-f4c0-420e-bb3e-705ea0d42e5b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:04.877172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-41d92521-f4c0-420e-bb3e-705ea0d42e5b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:04.883635 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-41d92521-f4c0-420e-bb3e-705ea0d42e5b tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 2957 microversion: 2.42 time: 0.489225 Aug 04 17:25:04.898103 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2887/5798] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:25:04 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 2957 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:25:05.263536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-081e6938-2324-470d-a5b1-8b865bffac7e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:05.264250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-081e6938-2324-470d-a5b1-8b865bffac7e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:05.282645 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-081e6938-2324-470d-a5b1-8b865bffac7e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:05.283144 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-081e6938-2324-470d-a5b1-8b865bffac7e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:05.283592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-081e6938-2324-470d-a5b1-8b865bffac7e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:05.284305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-081e6938-2324-470d-a5b1-8b865bffac7e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:05.285291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-081e6938-2324-470d-a5b1-8b865bffac7e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:05.285724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-081e6938-2324-470d-a5b1-8b865bffac7e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:05.446759 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0807ca5a-2cf5-4545-a629-fc86847b7e5a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1264221016", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "03354645-8bc7-47a9-a14b-187c13a0bd39"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:25:05.541177 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-0807ca5a-2cf5-4545-a629-fc86847b7e5a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] validate_networks() for [('03354645-8bc7-47a9-a14b-187c13a0bd39', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:25:05.908067 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-081e6938-2324-470d-a5b1-8b865bffac7e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:05.921365 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-081e6938-2324-470d-a5b1-8b865bffac7e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1691 microversion: 2.1 time: 0.662251 Aug 04 17:25:05.922006 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2912/5799] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:05 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1691 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:25:05.937920 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-65be1f07-edaf-429d-93af-28325570bb45 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:05.938777 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-65be1f07-edaf-429d-93af-28325570bb45 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:05.959568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65be1f07-edaf-429d-93af-28325570bb45 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:05.960966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65be1f07-edaf-429d-93af-28325570bb45 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:05.961506 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65be1f07-edaf-429d-93af-28325570bb45 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:05.962302 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65be1f07-edaf-429d-93af-28325570bb45 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:05.962780 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65be1f07-edaf-429d-93af-28325570bb45 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:05.963211 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-65be1f07-edaf-429d-93af-28325570bb45 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:06.474801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-65be1f07-edaf-429d-93af-28325570bb45 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:06.486175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-65be1f07-edaf-429d-93af-28325570bb45 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:06.492479 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-65be1f07-edaf-429d-93af-28325570bb45 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:06.496501 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-65be1f07-edaf-429d-93af-28325570bb45 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 2957 microversion: 2.42 time: 0.571403 Aug 04 17:25:06.497107 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2913/5800] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:25:05 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 2957 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:25:06.679923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0807ca5a-2cf5-4545-a629-fc86847b7e5a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:25:06.684421 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0807ca5a-2cf5-4545-a629-fc86847b7e5a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:25:06.684955 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0807ca5a-2cf5-4545-a629-fc86847b7e5a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:25:06.685382 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0807ca5a-2cf5-4545-a629-fc86847b7e5a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:25:06.685810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0807ca5a-2cf5-4545-a629-fc86847b7e5a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:25:06.717893 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0807ca5a-2cf5-4545-a629-fc86847b7e5a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:06.721033 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0807ca5a-2cf5-4545-a629-fc86847b7e5a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:06.722069 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0807ca5a-2cf5-4545-a629-fc86847b7e5a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:06.726924 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0807ca5a-2cf5-4545-a629-fc86847b7e5a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:06.729244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0807ca5a-2cf5-4545-a629-fc86847b7e5a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:06.731305 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0807ca5a-2cf5-4545-a629-fc86847b7e5a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:06.756377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-0807ca5a-2cf5-4545-a629-fc86847b7e5a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Getting quotas for project aac01b1f04a148ce86e7610ac7a578b4. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:25:06.763127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-0807ca5a-2cf5-4545-a629-fc86847b7e5a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Getting quotas for user 7a22e74444594c43a655ae73d48dffe1 and project aac01b1f04a148ce86e7610ac7a578b4. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:25:06.780534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0807ca5a-2cf5-4545-a629-fc86847b7e5a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:25:06.784323 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0807ca5a-2cf5-4545-a629-fc86847b7e5a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: aa823d00-2c9d-4950-98cc-1cbd18bb3750] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:25:06.853616 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0807ca5a-2cf5-4545-a629-fc86847b7e5a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.412633 Aug 04 17:25:06.869697 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ea499782-84df-40a4-ad6b-bc2e07dcebfc tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:06.870903 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ea499782-84df-40a4-ad6b-bc2e07dcebfc tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: aa823d00-2c9d-4950-98cc-1cbd18bb3750] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:06.876851 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2888/5801] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:25:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:25:06.947414 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-62d0807f-1e92-4b42-84ec-a2c8606a6715 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:06.948360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-62d0807f-1e92-4b42-84ec-a2c8606a6715 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:06.959812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62d0807f-1e92-4b42-84ec-a2c8606a6715 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:06.961623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62d0807f-1e92-4b42-84ec-a2c8606a6715 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:06.962644 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62d0807f-1e92-4b42-84ec-a2c8606a6715 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:06.964116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62d0807f-1e92-4b42-84ec-a2c8606a6715 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:06.965466 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62d0807f-1e92-4b42-84ec-a2c8606a6715 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:06.966157 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62d0807f-1e92-4b42-84ec-a2c8606a6715 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:07.061617 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ea499782-84df-40a4-ad6b-bc2e07dcebfc tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a22e74444594c43a655ae73d48dffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac01b1f04a148ce86e7610ac7a578b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:07.084850 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ea499782-84df-40a4-ad6b-bc2e07dcebfc tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] 10.222.0.93 "GET /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750" status: 200 len: 1214 microversion: 2.1 time: 0.220009 Aug 04 17:25:07.088314 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2914/5802] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:06 2022] GET /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750 => generated 1214 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:07.385530 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-62d0807f-1e92-4b42-84ec-a2c8606a6715 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:07.446917 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-62d0807f-1e92-4b42-84ec-a2c8606a6715 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1691 microversion: 2.1 time: 0.505261 Aug 04 17:25:07.468739 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2889/5803] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:06 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1691 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:07.526131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dc4507b9-2170-486f-b612-9dc2750d8d7a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:07.528414 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dc4507b9-2170-486f-b612-9dc2750d8d7a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:07.546333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc4507b9-2170-486f-b612-9dc2750d8d7a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:07.547912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc4507b9-2170-486f-b612-9dc2750d8d7a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:07.549121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc4507b9-2170-486f-b612-9dc2750d8d7a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:07.550991 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc4507b9-2170-486f-b612-9dc2750d8d7a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:07.551783 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc4507b9-2170-486f-b612-9dc2750d8d7a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:07.552467 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc4507b9-2170-486f-b612-9dc2750d8d7a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:08.109746 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3bcce742-8384-421a-9857-8d89937a87a8 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:08.110406 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3bcce742-8384-421a-9857-8d89937a87a8 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: aa823d00-2c9d-4950-98cc-1cbd18bb3750] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:08.130503 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bcce742-8384-421a-9857-8d89937a87a8 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:08.130812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bcce742-8384-421a-9857-8d89937a87a8 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:08.131267 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bcce742-8384-421a-9857-8d89937a87a8 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:08.132005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bcce742-8384-421a-9857-8d89937a87a8 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:08.132506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bcce742-8384-421a-9857-8d89937a87a8 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:08.132967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bcce742-8384-421a-9857-8d89937a87a8 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:09.004029 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3bcce742-8384-421a-9857-8d89937a87a8 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a22e74444594c43a655ae73d48dffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac01b1f04a148ce86e7610ac7a578b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:09.028252 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3bcce742-8384-421a-9857-8d89937a87a8 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] 10.222.0.93 "GET /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750" status: 200 len: 1218 microversion: 2.1 time: 0.922343 Aug 04 17:25:09.034918 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2890/5804] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:08 2022] GET /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750 => generated 1218 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:09.053850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ef2cce2d-9663-4390-8073-0c5863f2f675 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:09.073968 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ef2cce2d-9663-4390-8073-0c5863f2f675 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:09.097478 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef2cce2d-9663-4390-8073-0c5863f2f675 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:09.098731 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef2cce2d-9663-4390-8073-0c5863f2f675 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:09.099767 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef2cce2d-9663-4390-8073-0c5863f2f675 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:09.101714 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef2cce2d-9663-4390-8073-0c5863f2f675 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:09.102828 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef2cce2d-9663-4390-8073-0c5863f2f675 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:09.103739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef2cce2d-9663-4390-8073-0c5863f2f675 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:09.468808 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dc4507b9-2170-486f-b612-9dc2750d8d7a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:09.500989 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dc4507b9-2170-486f-b612-9dc2750d8d7a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:09.513181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dc4507b9-2170-486f-b612-9dc2750d8d7a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:09.518645 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dc4507b9-2170-486f-b612-9dc2750d8d7a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 2957 microversion: 2.42 time: 1.998243 Aug 04 17:25:09.530010 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2915/5805] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:25:07 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 2957 bytes in 2001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:25:10.053350 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bc42b265-9e8b-47c7-8a45-3c0f016a8c02 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:10.054184 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bc42b265-9e8b-47c7-8a45-3c0f016a8c02 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: aa823d00-2c9d-4950-98cc-1cbd18bb3750] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:10.059850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:25:10.076881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc42b265-9e8b-47c7-8a45-3c0f016a8c02 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:10.077471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc42b265-9e8b-47c7-8a45-3c0f016a8c02 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:10.077997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc42b265-9e8b-47c7-8a45-3c0f016a8c02 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:10.079707 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc42b265-9e8b-47c7-8a45-3c0f016a8c02 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:10.080488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc42b265-9e8b-47c7-8a45-3c0f016a8c02 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:10.081371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc42b265-9e8b-47c7-8a45-3c0f016a8c02 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:10.085744 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:25:10.357025 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bc42b265-9e8b-47c7-8a45-3c0f016a8c02 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a22e74444594c43a655ae73d48dffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac01b1f04a148ce86e7610ac7a578b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:10.366293 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bc42b265-9e8b-47c7-8a45-3c0f016a8c02 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] 10.222.0.93 "GET /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750" status: 200 len: 1272 microversion: 2.1 time: 0.318419 Aug 04 17:25:10.371176 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2916/5806] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:10 2022] GET /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750 => generated 1272 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:10.525448 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ef2cce2d-9663-4390-8073-0c5863f2f675 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:10.539078 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ef2cce2d-9663-4390-8073-0c5863f2f675 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1691 microversion: 2.1 time: 1.501780 Aug 04 17:25:10.540067 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2891/5807] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:09 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1691 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:10.549174 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e452f440-bc8a-4b8d-a3a8-344f38bc89ec tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:10.551113 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e452f440-bc8a-4b8d-a3a8-344f38bc89ec tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:10.567733 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e452f440-bc8a-4b8d-a3a8-344f38bc89ec tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:10.569839 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e452f440-bc8a-4b8d-a3a8-344f38bc89ec tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:10.570622 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e452f440-bc8a-4b8d-a3a8-344f38bc89ec tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:10.571798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e452f440-bc8a-4b8d-a3a8-344f38bc89ec tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:10.574556 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e452f440-bc8a-4b8d-a3a8-344f38bc89ec tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:10.576357 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e452f440-bc8a-4b8d-a3a8-344f38bc89ec tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:11.392556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-68ce6976-75d4-464d-b18e-85d01a77356a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:11.393745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-68ce6976-75d4-464d-b18e-85d01a77356a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: aa823d00-2c9d-4950-98cc-1cbd18bb3750] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:11.401361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:25:11.403419 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68ce6976-75d4-464d-b18e-85d01a77356a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:11.404494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68ce6976-75d4-464d-b18e-85d01a77356a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:11.405179 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68ce6976-75d4-464d-b18e-85d01a77356a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:11.406538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68ce6976-75d4-464d-b18e-85d01a77356a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:11.407264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68ce6976-75d4-464d-b18e-85d01a77356a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:11.408088 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68ce6976-75d4-464d-b18e-85d01a77356a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:11.450941 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:25:11.631656 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e452f440-bc8a-4b8d-a3a8-344f38bc89ec tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:11.644633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e452f440-bc8a-4b8d-a3a8-344f38bc89ec tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:11.648172 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e452f440-bc8a-4b8d-a3a8-344f38bc89ec tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:11.650095 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e452f440-bc8a-4b8d-a3a8-344f38bc89ec tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 2957 microversion: 2.42 time: 1.105802 Aug 04 17:25:11.650915 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2917/5808] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:25:10 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 2957 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:25:11.655864 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6efb4623-7d57-4b91-8429-039d322adfa5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:11.656752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6efb4623-7d57-4b91-8429-039d322adfa5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:11.674312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6efb4623-7d57-4b91-8429-039d322adfa5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:11.675277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6efb4623-7d57-4b91-8429-039d322adfa5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:11.676624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6efb4623-7d57-4b91-8429-039d322adfa5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:11.677566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6efb4623-7d57-4b91-8429-039d322adfa5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:11.678227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6efb4623-7d57-4b91-8429-039d322adfa5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:11.678908 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6efb4623-7d57-4b91-8429-039d322adfa5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:11.767553 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-68ce6976-75d4-464d-b18e-85d01a77356a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a22e74444594c43a655ae73d48dffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac01b1f04a148ce86e7610ac7a578b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:11.782245 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-68ce6976-75d4-464d-b18e-85d01a77356a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] 10.222.0.93 "GET /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750" status: 200 len: 1272 microversion: 2.1 time: 0.393555 Aug 04 17:25:11.794753 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2892/5809] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:11 2022] GET /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750 => generated 1272 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:12.317316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6efb4623-7d57-4b91-8429-039d322adfa5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:12.336350 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6efb4623-7d57-4b91-8429-039d322adfa5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1681 microversion: 2.1 time: 0.683635 Aug 04 17:25:12.339646 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2918/5810] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:11 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1681 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:12.367522 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e6083309-c4ba-4d50-a0ca-ec24df09a5f4 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:12.368479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e6083309-c4ba-4d50-a0ca-ec24df09a5f4 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:12.384021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6083309-c4ba-4d50-a0ca-ec24df09a5f4 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:12.387456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6083309-c4ba-4d50-a0ca-ec24df09a5f4 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:12.388079 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6083309-c4ba-4d50-a0ca-ec24df09a5f4 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:12.389185 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6083309-c4ba-4d50-a0ca-ec24df09a5f4 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:12.390090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6083309-c4ba-4d50-a0ca-ec24df09a5f4 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:12.390887 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6083309-c4ba-4d50-a0ca-ec24df09a5f4 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:12.621695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-3250d1fe-6214-4b13-81a1-073ba7ce3fce req-d2954592-cf2c-4b0c-976d-bdb810563cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "726db447-1df7-417d-a9e0-1c832e299621", "name": "network-vif-unplugged", "status": "completed", "tag": "3e04b159-57ff-4d66-afba-9b463d3dbcad"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:25:12.646904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-3250d1fe-6214-4b13-81a1-073ba7ce3fce req-d2954592-cf2c-4b0c-976d-bdb810563cf4 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:12.648411 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-3250d1fe-6214-4b13-81a1-073ba7ce3fce req-d2954592-cf2c-4b0c-976d-bdb810563cf4 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:12.649836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-3250d1fe-6214-4b13-81a1-073ba7ce3fce req-d2954592-cf2c-4b0c-976d-bdb810563cf4 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:12.703923 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-3250d1fe-6214-4b13-81a1-073ba7ce3fce req-d2954592-cf2c-4b0c-976d-bdb810563cf4 service nova] Creating event network-vif-unplugged:3e04b159-57ff-4d66-afba-9b463d3dbcad for instance 726db447-1df7-417d-a9e0-1c832e299621 on n-h2-851359-3 Aug 04 17:25:12.714595 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-3250d1fe-6214-4b13-81a1-073ba7ce3fce req-d2954592-cf2c-4b0c-976d-bdb810563cf4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098077 Aug 04 17:25:12.716397 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2919/5811] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:25:12.732685 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8977f105-a457-4b84-b0b7-9e1302c1c4f0 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:12.734718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8977f105-a457-4b84-b0b7-9e1302c1c4f0 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:12.750522 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8977f105-a457-4b84-b0b7-9e1302c1c4f0 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:12.752289 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8977f105-a457-4b84-b0b7-9e1302c1c4f0 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:12.753030 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8977f105-a457-4b84-b0b7-9e1302c1c4f0 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:12.754198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8977f105-a457-4b84-b0b7-9e1302c1c4f0 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:12.755647 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8977f105-a457-4b84-b0b7-9e1302c1c4f0 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:12.756537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8977f105-a457-4b84-b0b7-9e1302c1c4f0 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:12.833482 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e6083309-c4ba-4d50-a0ca-ec24df09a5f4 tempest-TestNetworkAdvancedServerOps-84317129 tempest-TestNetworkAdvancedServerOps-84317129-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1832 microversion: 2.1 time: 0.474721 Aug 04 17:25:12.846015 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2893/5812] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:12 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1832 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:12.846015 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7abf50df-109e-4d84-9b33-0b64502a6594 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:12.846015 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7abf50df-109e-4d84-9b33-0b64502a6594 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: aa823d00-2c9d-4950-98cc-1cbd18bb3750] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:12.851472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7abf50df-109e-4d84-9b33-0b64502a6594 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:12.853373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7abf50df-109e-4d84-9b33-0b64502a6594 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:12.854704 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7abf50df-109e-4d84-9b33-0b64502a6594 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:12.855708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7abf50df-109e-4d84-9b33-0b64502a6594 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:12.856392 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7abf50df-109e-4d84-9b33-0b64502a6594 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:12.857356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7abf50df-109e-4d84-9b33-0b64502a6594 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:13.699122 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8977f105-a457-4b84-b0b7-9e1302c1c4f0 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:13.708800 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8977f105-a457-4b84-b0b7-9e1302c1c4f0 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:13.710353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8977f105-a457-4b84-b0b7-9e1302c1c4f0 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:13.720154 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8977f105-a457-4b84-b0b7-9e1302c1c4f0 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 2936 microversion: 2.42 time: 0.995904 Aug 04 17:25:13.734282 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2920/5813] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:25:12 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 2936 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:25:13.734282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1aad304a-8ca6-409d-9a0e-af77b738c689 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:13.734282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1aad304a-8ca6-409d-9a0e-af77b738c689 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:13.744248 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1aad304a-8ca6-409d-9a0e-af77b738c689 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:13.744600 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1aad304a-8ca6-409d-9a0e-af77b738c689 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:13.744787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1aad304a-8ca6-409d-9a0e-af77b738c689 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:13.745639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1aad304a-8ca6-409d-9a0e-af77b738c689 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:13.746254 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1aad304a-8ca6-409d-9a0e-af77b738c689 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:13.746816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1aad304a-8ca6-409d-9a0e-af77b738c689 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:13.967892 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7abf50df-109e-4d84-9b33-0b64502a6594 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a22e74444594c43a655ae73d48dffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac01b1f04a148ce86e7610ac7a578b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:13.991318 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7abf50df-109e-4d84-9b33-0b64502a6594 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] 10.222.0.93 "GET /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750" status: 200 len: 1314 microversion: 2.1 time: 1.152666 Aug 04 17:25:13.994635 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2894/5814] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:12 2022] GET /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750 => generated 1314 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:14.384434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1aad304a-8ca6-409d-9a0e-af77b738c689 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:14.406340 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1aad304a-8ca6-409d-9a0e-af77b738c689 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1681 microversion: 2.1 time: 0.684284 Aug 04 17:25:14.412388 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2921/5815] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:13 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1681 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:14.696012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a1112196-7382-4370-927b-7172e0b977ed tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:25:14.702694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a1112196-7382-4370-927b-7172e0b977ed tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:14.715658 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1112196-7382-4370-927b-7172e0b977ed tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:14.717585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1112196-7382-4370-927b-7172e0b977ed tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:14.719061 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1112196-7382-4370-927b-7172e0b977ed tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:14.720691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1112196-7382-4370-927b-7172e0b977ed tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:14.721745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1112196-7382-4370-927b-7172e0b977ed tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:14.723164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1112196-7382-4370-927b-7172e0b977ed tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:14.761954 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5657d3f6-f0f7-4e5d-837e-34cb5e3bae6c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:14.768287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5657d3f6-f0f7-4e5d-837e-34cb5e3bae6c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:14.787899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5657d3f6-f0f7-4e5d-837e-34cb5e3bae6c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:14.806969 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5657d3f6-f0f7-4e5d-837e-34cb5e3bae6c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:14.808663 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5657d3f6-f0f7-4e5d-837e-34cb5e3bae6c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:14.815292 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5657d3f6-f0f7-4e5d-837e-34cb5e3bae6c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:14.818086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5657d3f6-f0f7-4e5d-837e-34cb5e3bae6c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:14.820147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5657d3f6-f0f7-4e5d-837e-34cb5e3bae6c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:14.923589 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a1112196-7382-4370-927b-7172e0b977ed tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "POST /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7/action" status: 200 len: 38655 microversion: 2.1 time: 0.237489 Aug 04 17:25:14.925255 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2895/5816] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:25:14 2022] POST /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7/action => generated 38655 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:25:14.941320 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-5e32b6ac-569b-4fb3-842f-fa915d47555f req-abe2752f-c8cf-43da-9091-1b9c5ad47796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "726db447-1df7-417d-a9e0-1c832e299621", "name": "network-vif-unplugged", "status": "completed", "tag": "485e15db-88a6-41d7-ad94-dc268d623543"}, {"server_uuid": "726db447-1df7-417d-a9e0-1c832e299621", "name": "network-vif-unplugged", "status": "completed", "tag": "046e0a45-4ead-4c1d-a197-0872ec3beff4"}, {"server_uuid": "726db447-1df7-417d-a9e0-1c832e299621", "name": "network-vif-unplugged", "status": "completed", "tag": "e397d801-65f8-4228-9ea6-fb3cb8adfc19"}, {"server_uuid": "726db447-1df7-417d-a9e0-1c832e299621", "name": "network-vif-unplugged", "status": "completed", "tag": "f6f39783-21ab-4cb8-8d8b-96d99d3f6366"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:25:14.969431 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5e32b6ac-569b-4fb3-842f-fa915d47555f req-abe2752f-c8cf-43da-9091-1b9c5ad47796 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:14.970989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5e32b6ac-569b-4fb3-842f-fa915d47555f req-abe2752f-c8cf-43da-9091-1b9c5ad47796 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:14.971700 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5e32b6ac-569b-4fb3-842f-fa915d47555f req-abe2752f-c8cf-43da-9091-1b9c5ad47796 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:14.995329 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-5e32b6ac-569b-4fb3-842f-fa915d47555f req-abe2752f-c8cf-43da-9091-1b9c5ad47796 service nova] Creating event network-vif-unplugged:485e15db-88a6-41d7-ad94-dc268d623543 for instance 726db447-1df7-417d-a9e0-1c832e299621 on n-h2-851359-3 Aug 04 17:25:14.996204 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-5e32b6ac-569b-4fb3-842f-fa915d47555f req-abe2752f-c8cf-43da-9091-1b9c5ad47796 service nova] Creating event network-vif-unplugged:046e0a45-4ead-4c1d-a197-0872ec3beff4 for instance 726db447-1df7-417d-a9e0-1c832e299621 on n-h2-851359-3 Aug 04 17:25:14.997049 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-5e32b6ac-569b-4fb3-842f-fa915d47555f req-abe2752f-c8cf-43da-9091-1b9c5ad47796 service nova] Creating event network-vif-unplugged:e397d801-65f8-4228-9ea6-fb3cb8adfc19 for instance 726db447-1df7-417d-a9e0-1c832e299621 on n-h2-851359-3 Aug 04 17:25:14.997829 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-5e32b6ac-569b-4fb3-842f-fa915d47555f req-abe2752f-c8cf-43da-9091-1b9c5ad47796 service nova] Creating event network-vif-unplugged:f6f39783-21ab-4cb8-8d8b-96d99d3f6366 for instance 726db447-1df7-417d-a9e0-1c832e299621 on n-h2-851359-3 Aug 04 17:25:15.006591 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-5e32b6ac-569b-4fb3-842f-fa915d47555f req-abe2752f-c8cf-43da-9091-1b9c5ad47796 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.078729 Aug 04 17:25:15.007898 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2896/5817] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:25:15.023083 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-32ee418e-ef7a-461b-bb11-d020ad716f18 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:15.024210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-32ee418e-ef7a-461b-bb11-d020ad716f18 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: aa823d00-2c9d-4950-98cc-1cbd18bb3750] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:15.036957 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32ee418e-ef7a-461b-bb11-d020ad716f18 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:15.038804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32ee418e-ef7a-461b-bb11-d020ad716f18 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:15.040178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32ee418e-ef7a-461b-bb11-d020ad716f18 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:15.041316 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32ee418e-ef7a-461b-bb11-d020ad716f18 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:15.042036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32ee418e-ef7a-461b-bb11-d020ad716f18 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:15.042749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32ee418e-ef7a-461b-bb11-d020ad716f18 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:15.962927 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5657d3f6-f0f7-4e5d-837e-34cb5e3bae6c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:15.975167 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5657d3f6-f0f7-4e5d-837e-34cb5e3bae6c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:15.978040 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5657d3f6-f0f7-4e5d-837e-34cb5e3bae6c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:15.980479 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5657d3f6-f0f7-4e5d-837e-34cb5e3bae6c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 2936 microversion: 2.42 time: 1.227988 Aug 04 17:25:15.998013 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2922/5818] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:25:14 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 2936 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:25:16.005756 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-06499673-92a3-4bd9-8549-6583548f55e2 req-6ce91eb8-3c93-4f42-8fbe-95fcd641affb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa823d00-2c9d-4950-98cc-1cbd18bb3750", "tag": "efcde84d-2217-4fc6-a8be-da24dfb995d4"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:25:16.022820 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-06499673-92a3-4bd9-8549-6583548f55e2 req-6ce91eb8-3c93-4f42-8fbe-95fcd641affb service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:16.027732 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-06499673-92a3-4bd9-8549-6583548f55e2 req-6ce91eb8-3c93-4f42-8fbe-95fcd641affb service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:16.028432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-06499673-92a3-4bd9-8549-6583548f55e2 req-6ce91eb8-3c93-4f42-8fbe-95fcd641affb service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:16.042657 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-06499673-92a3-4bd9-8549-6583548f55e2 req-6ce91eb8-3c93-4f42-8fbe-95fcd641affb service nova] Creating event network-changed:efcde84d-2217-4fc6-a8be-da24dfb995d4 for instance aa823d00-2c9d-4950-98cc-1cbd18bb3750 on n-h1-851359-3 Aug 04 17:25:16.048434 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-06499673-92a3-4bd9-8549-6583548f55e2 req-6ce91eb8-3c93-4f42-8fbe-95fcd641affb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055086 Aug 04 17:25:16.049604 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2923/5819] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:25:16.076372 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-32ee418e-ef7a-461b-bb11-d020ad716f18 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a22e74444594c43a655ae73d48dffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac01b1f04a148ce86e7610ac7a578b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:16.090882 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-32ee418e-ef7a-461b-bb11-d020ad716f18 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] 10.222.0.93 "GET /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750" status: 200 len: 1314 microversion: 2.1 time: 1.074675 Aug 04 17:25:16.092160 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2897/5820] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:15 2022] GET /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750 => generated 1314 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:17.011857 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e536649e-4bab-4b54-9919-d47e9b854d04 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:17.014358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e536649e-4bab-4b54-9919-d47e9b854d04 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:17.031736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e536649e-4bab-4b54-9919-d47e9b854d04 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:17.033207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e536649e-4bab-4b54-9919-d47e9b854d04 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:17.034052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e536649e-4bab-4b54-9919-d47e9b854d04 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:17.035048 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e536649e-4bab-4b54-9919-d47e9b854d04 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:17.035997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e536649e-4bab-4b54-9919-d47e9b854d04 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:17.036660 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e536649e-4bab-4b54-9919-d47e9b854d04 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:17.106216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:25:17.117425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cd975bfc-6d4e-497e-9998-acc61bfdb65a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:17.118222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cd975bfc-6d4e-497e-9998-acc61bfdb65a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: aa823d00-2c9d-4950-98cc-1cbd18bb3750] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:17.122985 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:25:17.124082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:25:17.144757 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd975bfc-6d4e-497e-9998-acc61bfdb65a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:17.146176 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd975bfc-6d4e-497e-9998-acc61bfdb65a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:17.146896 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd975bfc-6d4e-497e-9998-acc61bfdb65a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:17.151158 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd975bfc-6d4e-497e-9998-acc61bfdb65a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:17.151913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd975bfc-6d4e-497e-9998-acc61bfdb65a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:17.156046 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd975bfc-6d4e-497e-9998-acc61bfdb65a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:17.966766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e536649e-4bab-4b54-9919-d47e9b854d04 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:17.978711 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e536649e-4bab-4b54-9919-d47e9b854d04 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:17.980730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e536649e-4bab-4b54-9919-d47e9b854d04 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:17.982370 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e536649e-4bab-4b54-9919-d47e9b854d04 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 2915 microversion: 2.42 time: 0.977736 Aug 04 17:25:17.983480 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2924/5821] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:25:17 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 2915 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:25:17.988758 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-1b9b33bb-8f12-48de-9333-b91168a85f98 req-fb77905c-aa7e-4ef3-ba92-86b38128b296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "726db447-1df7-417d-a9e0-1c832e299621", "name": "network-vif-unplugged", "status": "completed", "tag": "fdb23d55-8a38-4aff-b71c-c6c9f6001dd5"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:25:18.000807 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1b9b33bb-8f12-48de-9333-b91168a85f98 req-fb77905c-aa7e-4ef3-ba92-86b38128b296 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:18.001716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1b9b33bb-8f12-48de-9333-b91168a85f98 req-fb77905c-aa7e-4ef3-ba92-86b38128b296 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:18.002411 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1b9b33bb-8f12-48de-9333-b91168a85f98 req-fb77905c-aa7e-4ef3-ba92-86b38128b296 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:18.023417 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-1b9b33bb-8f12-48de-9333-b91168a85f98 req-fb77905c-aa7e-4ef3-ba92-86b38128b296 service nova] Creating event network-vif-unplugged:fdb23d55-8a38-4aff-b71c-c6c9f6001dd5 for instance 726db447-1df7-417d-a9e0-1c832e299621 on n-h2-851359-3 Aug 04 17:25:18.034431 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-1b9b33bb-8f12-48de-9333-b91168a85f98 req-fb77905c-aa7e-4ef3-ba92-86b38128b296 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049291 Aug 04 17:25:18.035359 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2925/5822] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:25:18.098819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cd975bfc-6d4e-497e-9998-acc61bfdb65a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a22e74444594c43a655ae73d48dffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac01b1f04a148ce86e7610ac7a578b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:18.112095 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cd975bfc-6d4e-497e-9998-acc61bfdb65a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] 10.222.0.93 "GET /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750" status: 200 len: 1314 microversion: 2.1 time: 1.001127 Aug 04 17:25:18.113418 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2898/5823] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:17 2022] GET /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750 => generated 1314 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:25:19.035825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6eb69e43-e6e9-40ba-8c55-97563c820734 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:19.037044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6eb69e43-e6e9-40ba-8c55-97563c820734 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:19.045309 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6eb69e43-e6e9-40ba-8c55-97563c820734 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:19.045805 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6eb69e43-e6e9-40ba-8c55-97563c820734 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:19.046449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6eb69e43-e6e9-40ba-8c55-97563c820734 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:19.047328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6eb69e43-e6e9-40ba-8c55-97563c820734 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:19.047794 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6eb69e43-e6e9-40ba-8c55-97563c820734 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:19.048841 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6eb69e43-e6e9-40ba-8c55-97563c820734 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:19.134824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c004581b-c63b-4808-b23f-b7721f11d2fe tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:19.136049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c004581b-c63b-4808-b23f-b7721f11d2fe tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: aa823d00-2c9d-4950-98cc-1cbd18bb3750] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:19.146128 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c004581b-c63b-4808-b23f-b7721f11d2fe tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:19.155084 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c004581b-c63b-4808-b23f-b7721f11d2fe tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:19.155926 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c004581b-c63b-4808-b23f-b7721f11d2fe tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:19.156869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c004581b-c63b-4808-b23f-b7721f11d2fe tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:19.157633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c004581b-c63b-4808-b23f-b7721f11d2fe tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:19.158255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c004581b-c63b-4808-b23f-b7721f11d2fe tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:19.847778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6eb69e43-e6e9-40ba-8c55-97563c820734 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:19.879508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6eb69e43-e6e9-40ba-8c55-97563c820734 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:19.881305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6eb69e43-e6e9-40ba-8c55-97563c820734 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:19.885951 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6eb69e43-e6e9-40ba-8c55-97563c820734 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 2915 microversion: 2.42 time: 0.859903 Aug 04 17:25:19.889102 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2926/5824] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:25:19 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 2915 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:25:20.048509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-f885a324-f770-480f-a3d1-2020b96bb76b req-b53d375d-3857-44ef-bd6d-11fac4b6b5dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "726db447-1df7-417d-a9e0-1c832e299621", "name": "network-vif-deleted", "tag": "f6f39783-21ab-4cb8-8d8b-96d99d3f6366"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:25:20.060226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f885a324-f770-480f-a3d1-2020b96bb76b req-b53d375d-3857-44ef-bd6d-11fac4b6b5dc service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:20.060718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f885a324-f770-480f-a3d1-2020b96bb76b req-b53d375d-3857-44ef-bd6d-11fac4b6b5dc service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:20.061577 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f885a324-f770-480f-a3d1-2020b96bb76b req-b53d375d-3857-44ef-bd6d-11fac4b6b5dc service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:20.079136 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-f885a324-f770-480f-a3d1-2020b96bb76b req-b53d375d-3857-44ef-bd6d-11fac4b6b5dc service nova] Creating event network-vif-deleted:f6f39783-21ab-4cb8-8d8b-96d99d3f6366 for instance 726db447-1df7-417d-a9e0-1c832e299621 on n-h2-851359-3 Aug 04 17:25:20.091336 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-f885a324-f770-480f-a3d1-2020b96bb76b req-b53d375d-3857-44ef-bd6d-11fac4b6b5dc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050735 Aug 04 17:25:20.092759 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2927/5825] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:25:20.156554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c004581b-c63b-4808-b23f-b7721f11d2fe tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a22e74444594c43a655ae73d48dffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac01b1f04a148ce86e7610ac7a578b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:20.177189 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c004581b-c63b-4808-b23f-b7721f11d2fe tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] 10.222.0.93 "GET /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750" status: 200 len: 1314 microversion: 2.1 time: 1.045288 Aug 04 17:25:20.195597 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2899/5826] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:19 2022] GET /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750 => generated 1314 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:20.924092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bfe2a537-36d0-45cc-a9d8-6e6889cfc788 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:20.924092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bfe2a537-36d0-45cc-a9d8-6e6889cfc788 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:20.947450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bfe2a537-36d0-45cc-a9d8-6e6889cfc788 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:20.949396 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bfe2a537-36d0-45cc-a9d8-6e6889cfc788 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:20.950732 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bfe2a537-36d0-45cc-a9d8-6e6889cfc788 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:20.951651 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bfe2a537-36d0-45cc-a9d8-6e6889cfc788 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:20.952221 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bfe2a537-36d0-45cc-a9d8-6e6889cfc788 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:20.953691 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bfe2a537-36d0-45cc-a9d8-6e6889cfc788 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:21.056599 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-db89c789-912a-433a-aced-56c964ece249 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:21.058127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-db89c789-912a-433a-aced-56c964ece249 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:21.067455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db89c789-912a-433a-aced-56c964ece249 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:21.068925 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db89c789-912a-433a-aced-56c964ece249 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:21.069588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db89c789-912a-433a-aced-56c964ece249 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:21.070652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db89c789-912a-433a-aced-56c964ece249 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:21.071518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db89c789-912a-433a-aced-56c964ece249 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:21.073042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db89c789-912a-433a-aced-56c964ece249 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:21.134404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-db89c789-912a-433a-aced-56c964ece249 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:25:21.283554 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-db89c789-912a-433a-aced-56c964ece249 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "DELETE /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 204 len: 0 microversion: 2.1 time: 0.231382 Aug 04 17:25:21.286008 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2900/5827] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:25:21 2022] DELETE /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:25:21.295979 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a092324f-12c1-4451-b629-4e295c6032d1 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:21.299011 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a092324f-12c1-4451-b629-4e295c6032d1 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: aa823d00-2c9d-4950-98cc-1cbd18bb3750] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:21.310254 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a092324f-12c1-4451-b629-4e295c6032d1 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:21.311269 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a092324f-12c1-4451-b629-4e295c6032d1 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:21.312241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a092324f-12c1-4451-b629-4e295c6032d1 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:21.313318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a092324f-12c1-4451-b629-4e295c6032d1 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:21.314171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a092324f-12c1-4451-b629-4e295c6032d1 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:21.315535 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a092324f-12c1-4451-b629-4e295c6032d1 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:22.187527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bfe2a537-36d0-45cc-a9d8-6e6889cfc788 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:22.199385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bfe2a537-36d0-45cc-a9d8-6e6889cfc788 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:22.201928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bfe2a537-36d0-45cc-a9d8-6e6889cfc788 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:22.203516 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bfe2a537-36d0-45cc-a9d8-6e6889cfc788 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 2755 microversion: 2.42 time: 1.292894 Aug 04 17:25:22.225766 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2928/5828] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:25:20 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 2755 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:25:22.226335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a092324f-12c1-4451-b629-4e295c6032d1 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a22e74444594c43a655ae73d48dffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac01b1f04a148ce86e7610ac7a578b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:22.231855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-61aef448-c3d2-4353-90d4-48eeca278d3e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:22.232909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-61aef448-c3d2-4353-90d4-48eeca278d3e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:22.239981 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61aef448-c3d2-4353-90d4-48eeca278d3e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:22.240772 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61aef448-c3d2-4353-90d4-48eeca278d3e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:22.241382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61aef448-c3d2-4353-90d4-48eeca278d3e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:22.242497 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61aef448-c3d2-4353-90d4-48eeca278d3e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:22.243426 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61aef448-c3d2-4353-90d4-48eeca278d3e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:22.244021 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61aef448-c3d2-4353-90d4-48eeca278d3e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:22.258228 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a092324f-12c1-4451-b629-4e295c6032d1 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] 10.222.0.93 "GET /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750" status: 200 len: 1314 microversion: 2.1 time: 0.966591 Aug 04 17:25:22.260146 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2901/5829] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:21 2022] GET /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750 => generated 1314 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:22.516063 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b900e019-f4b3-4260-8ac6-32783af66581 req-417efd44-c36c-4aab-bbc9-97de08219171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa823d00-2c9d-4950-98cc-1cbd18bb3750", "name": "network-vif-plugged", "status": "completed", "tag": "efcde84d-2217-4fc6-a8be-da24dfb995d4"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:25:22.536899 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b900e019-f4b3-4260-8ac6-32783af66581 req-417efd44-c36c-4aab-bbc9-97de08219171 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:22.538152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b900e019-f4b3-4260-8ac6-32783af66581 req-417efd44-c36c-4aab-bbc9-97de08219171 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:22.539129 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b900e019-f4b3-4260-8ac6-32783af66581 req-417efd44-c36c-4aab-bbc9-97de08219171 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:22.559746 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b900e019-f4b3-4260-8ac6-32783af66581 req-417efd44-c36c-4aab-bbc9-97de08219171 service nova] Creating event network-vif-plugged:efcde84d-2217-4fc6-a8be-da24dfb995d4 for instance aa823d00-2c9d-4950-98cc-1cbd18bb3750 on n-h1-851359-3 Aug 04 17:25:22.569469 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b900e019-f4b3-4260-8ac6-32783af66581 req-417efd44-c36c-4aab-bbc9-97de08219171 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.307092 Aug 04 17:25:22.570745 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2902/5830] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:25:22.587144 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-44da3c74-5459-492b-a2af-fab01beb594c req-cfde986a-7cd2-4cc5-a493-8330d3331bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acef330f-cbb0-4eda-aecd-23ddcf3916a7", "tag": "2701aeee-8c0b-4201-aa2f-2cc2c92c111d"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:25:22.649931 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-61aef448-c3d2-4353-90d4-48eeca278d3e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:22.650771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-44da3c74-5459-492b-a2af-fab01beb594c req-cfde986a-7cd2-4cc5-a493-8330d3331bb0 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:22.651927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-44da3c74-5459-492b-a2af-fab01beb594c req-cfde986a-7cd2-4cc5-a493-8330d3331bb0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:22.653786 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-44da3c74-5459-492b-a2af-fab01beb594c req-cfde986a-7cd2-4cc5-a493-8330d3331bb0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:22.669847 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-61aef448-c3d2-4353-90d4-48eeca278d3e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1687 microversion: 2.1 time: 0.436561 Aug 04 17:25:22.671603 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2929/5831] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:22 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1687 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:22.682564 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-44da3c74-5459-492b-a2af-fab01beb594c req-cfde986a-7cd2-4cc5-a493-8330d3331bb0 service nova] Creating event network-changed:2701aeee-8c0b-4201-aa2f-2cc2c92c111d for instance acef330f-cbb0-4eda-aecd-23ddcf3916a7 on n-h2-851359-3 Aug 04 17:25:22.692101 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-44da3c74-5459-492b-a2af-fab01beb594c req-cfde986a-7cd2-4cc5-a493-8330d3331bb0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119065 Aug 04 17:25:22.693576 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2903/5832] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:25:23.246352 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-087213f3-8e80-4ebd-9ce6-87660730b4a5 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:23.247757 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-087213f3-8e80-4ebd-9ce6-87660730b4a5 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:23.273200 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-087213f3-8e80-4ebd-9ce6-87660730b4a5 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:23.274098 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-087213f3-8e80-4ebd-9ce6-87660730b4a5 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:23.274815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-087213f3-8e80-4ebd-9ce6-87660730b4a5 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:23.275796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-087213f3-8e80-4ebd-9ce6-87660730b4a5 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:23.285180 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-baed4f7d-a0b7-40ac-8ef6-d27cabc61d89 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:23.287111 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-baed4f7d-a0b7-40ac-8ef6-d27cabc61d89 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: aa823d00-2c9d-4950-98cc-1cbd18bb3750] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:23.293652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-087213f3-8e80-4ebd-9ce6-87660730b4a5 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:23.294667 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-087213f3-8e80-4ebd-9ce6-87660730b4a5 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:23.307767 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-baed4f7d-a0b7-40ac-8ef6-d27cabc61d89 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:23.308690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-baed4f7d-a0b7-40ac-8ef6-d27cabc61d89 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:23.314452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-baed4f7d-a0b7-40ac-8ef6-d27cabc61d89 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:23.316111 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-baed4f7d-a0b7-40ac-8ef6-d27cabc61d89 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:23.316832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-baed4f7d-a0b7-40ac-8ef6-d27cabc61d89 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:23.317500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-baed4f7d-a0b7-40ac-8ef6-d27cabc61d89 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:23.941024 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-baed4f7d-a0b7-40ac-8ef6-d27cabc61d89 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a22e74444594c43a655ae73d48dffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac01b1f04a148ce86e7610ac7a578b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:23.955747 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-baed4f7d-a0b7-40ac-8ef6-d27cabc61d89 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] 10.222.0.93 "GET /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750" status: 200 len: 1314 microversion: 2.1 time: 0.677579 Aug 04 17:25:23.959881 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2904/5833] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:23 2022] GET /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750 => generated 1314 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:23.964790 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f49ac0ce-f32c-47b4-a4f3-052bc5789e2d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:23.965461 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f49ac0ce-f32c-47b4-a4f3-052bc5789e2d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:23.990397 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f49ac0ce-f32c-47b4-a4f3-052bc5789e2d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:23.991508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f49ac0ce-f32c-47b4-a4f3-052bc5789e2d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:23.992243 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f49ac0ce-f32c-47b4-a4f3-052bc5789e2d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:23.993231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f49ac0ce-f32c-47b4-a4f3-052bc5789e2d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:23.993847 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f49ac0ce-f32c-47b4-a4f3-052bc5789e2d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:23.998226 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f49ac0ce-f32c-47b4-a4f3-052bc5789e2d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:24.072204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-087213f3-8e80-4ebd-9ce6-87660730b4a5 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:24.083442 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-087213f3-8e80-4ebd-9ce6-87660730b4a5 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:24.086539 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-087213f3-8e80-4ebd-9ce6-87660730b4a5 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:24.088104 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-087213f3-8e80-4ebd-9ce6-87660730b4a5 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 2709 microversion: 2.42 time: 0.852641 Aug 04 17:25:24.089175 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2930/5834] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:25:23 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 2709 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:25:24.757904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-c3657e4e-6f76-4597-a036-bc1b19157368 req-d87c1b8d-651e-4fbf-b318-ec6d6083aace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "726db447-1df7-417d-a9e0-1c832e299621", "name": "network-vif-deleted", "tag": "046e0a45-4ead-4c1d-a197-0872ec3beff4"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:25:24.798553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c3657e4e-6f76-4597-a036-bc1b19157368 req-d87c1b8d-651e-4fbf-b318-ec6d6083aace service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:24.799400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c3657e4e-6f76-4597-a036-bc1b19157368 req-d87c1b8d-651e-4fbf-b318-ec6d6083aace service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:24.801137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c3657e4e-6f76-4597-a036-bc1b19157368 req-d87c1b8d-651e-4fbf-b318-ec6d6083aace service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:24.821674 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-c3657e4e-6f76-4597-a036-bc1b19157368 req-d87c1b8d-651e-4fbf-b318-ec6d6083aace service nova] Creating event network-vif-deleted:046e0a45-4ead-4c1d-a197-0872ec3beff4 for instance 726db447-1df7-417d-a9e0-1c832e299621 on n-h2-851359-3 Aug 04 17:25:24.828877 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-c3657e4e-6f76-4597-a036-bc1b19157368 req-d87c1b8d-651e-4fbf-b318-ec6d6083aace service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077678 Aug 04 17:25:24.830395 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2931/5835] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:25:24.972419 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f49ac0ce-f32c-47b4-a4f3-052bc5789e2d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:24.980814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-444a4ba0-03e7-43ee-af91-5a562b7c3c47 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:24.981660 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-444a4ba0-03e7-43ee-af91-5a562b7c3c47 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: aa823d00-2c9d-4950-98cc-1cbd18bb3750] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:24.982196 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f49ac0ce-f32c-47b4-a4f3-052bc5789e2d tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 200 len: 1687 microversion: 2.1 time: 1.021031 Aug 04 17:25:24.982903 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2905/5836] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:23 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 1687 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:25.015356 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-444a4ba0-03e7-43ee-af91-5a562b7c3c47 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:25.015983 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-444a4ba0-03e7-43ee-af91-5a562b7c3c47 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:25.017153 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-444a4ba0-03e7-43ee-af91-5a562b7c3c47 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:25.018771 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-444a4ba0-03e7-43ee-af91-5a562b7c3c47 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:25.020735 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-444a4ba0-03e7-43ee-af91-5a562b7c3c47 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:25.022316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-444a4ba0-03e7-43ee-af91-5a562b7c3c47 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:25.117178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8acc29f2-9cd6-4637-83ae-79ad9bed3d14 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:25.119782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8acc29f2-9cd6-4637-83ae-79ad9bed3d14 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:25.127547 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8acc29f2-9cd6-4637-83ae-79ad9bed3d14 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:25.128481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8acc29f2-9cd6-4637-83ae-79ad9bed3d14 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:25.129559 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8acc29f2-9cd6-4637-83ae-79ad9bed3d14 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:25.130589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8acc29f2-9cd6-4637-83ae-79ad9bed3d14 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:25.131262 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8acc29f2-9cd6-4637-83ae-79ad9bed3d14 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:25.132592 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8acc29f2-9cd6-4637-83ae-79ad9bed3d14 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:26.161219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-444a4ba0-03e7-43ee-af91-5a562b7c3c47 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a22e74444594c43a655ae73d48dffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac01b1f04a148ce86e7610ac7a578b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:26.170717 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-444a4ba0-03e7-43ee-af91-5a562b7c3c47 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] 10.222.0.93 "GET /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750" status: 200 len: 1314 microversion: 2.1 time: 1.196121 Aug 04 17:25:26.183892 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2932/5837] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:24 2022] GET /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750 => generated 1314 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:26.194536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-fe8b0958-1fc4-48d9-9084-bca8a8d35116 req-6f76108c-f421-43e6-8637-fcebcaf28867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acef330f-cbb0-4eda-aecd-23ddcf3916a7", "name": "network-vif-deleted", "tag": "2701aeee-8c0b-4201-aa2f-2cc2c92c111d"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:25:26.205758 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-fe8b0958-1fc4-48d9-9084-bca8a8d35116 req-6f76108c-f421-43e6-8637-fcebcaf28867 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:26.206393 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-fe8b0958-1fc4-48d9-9084-bca8a8d35116 req-6f76108c-f421-43e6-8637-fcebcaf28867 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:26.207291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-fe8b0958-1fc4-48d9-9084-bca8a8d35116 req-6f76108c-f421-43e6-8637-fcebcaf28867 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:26.224413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8acc29f2-9cd6-4637-83ae-79ad9bed3d14 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:26.253562 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8acc29f2-9cd6-4637-83ae-79ad9bed3d14 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:26.256552 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8acc29f2-9cd6-4637-83ae-79ad9bed3d14 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:26.258217 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8acc29f2-9cd6-4637-83ae-79ad9bed3d14 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 2416 microversion: 2.42 time: 1.146131 Aug 04 17:25:26.259380 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2906/5838] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:25:25 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 2416 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:25:26.265961 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a57a0fb5-6726-4427-b36b-0ecb317d47b7 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:26.267059 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a57a0fb5-6726-4427-b36b-0ecb317d47b7 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: acef330f-cbb0-4eda-aecd-23ddcf3916a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:26.275600 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a57a0fb5-6726-4427-b36b-0ecb317d47b7 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:26.278177 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a57a0fb5-6726-4427-b36b-0ecb317d47b7 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:26.279473 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a57a0fb5-6726-4427-b36b-0ecb317d47b7 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:26.280414 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a57a0fb5-6726-4427-b36b-0ecb317d47b7 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:26.281755 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a57a0fb5-6726-4427-b36b-0ecb317d47b7 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:26.282856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a57a0fb5-6726-4427-b36b-0ecb317d47b7 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:26.327208 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-a57a0fb5-6726-4427-b36b-0ecb317d47b7 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] HTTP exception thrown: Instance acef330f-cbb0-4eda-aecd-23ddcf3916a7 could not be found. Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a57a0fb5-6726-4427-b36b-0ecb317d47b7 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Request method failure captured: Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 HTTP/1.1 Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_63t572KuanVtq4R8MzvDbiJ5v4ZNLlIXNSeyaKZEreu-AZsY7LrigOd4ifgpCoVaTwnv6OlvH-5A4ZEjIVqN__JovdO3v25O3MH0-YQTpeaIifMEkPAJkS3gutHWKyi3cRSKLpwrID6LrAGigELMSbch6EEsMqa6Zl19KmfJ88KcE Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 9c69a3e46122413f928fe20a76b0cf94 Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1197876832 Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9c69a3e46122413f928fe20a76b0cf94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9c69a3e46122413f928fe20a76b0cf94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9c69a3e46122413f928fe20a76b0cf94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9c69a3e46122413f928fe20a76b0cf94"}]}] Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1197876832 Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 9c69a3e46122413f928fe20a76b0cf94 Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1197876832 Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TestNetworkAdvancedServerOps-1197876832-project Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: f27a58cf36934daeabff9e35c05d4c19 Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1197876832-project Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance acef330f-cbb0-4eda-aecd-23ddcf3916a7 could not be found. Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'acef330f-cbb0-4eda-aecd-23ddcf3916a7'} Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acef330f-cbb0-4eda-aecd-23ddcf3916a7 could not be found. Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acef330f-cbb0-4eda-aecd-23ddcf3916a7 could not be found. Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:25:26.332815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:25:26.339017 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:25:26.339017 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:25:26.339017 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:25:26.339017 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:25:26.339017 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:25:26.339017 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:25:26.339017 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acef330f-cbb0-4eda-aecd-23ddcf3916a7 could not be found. Aug 04 17:25:26.339017 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:25:26.339017 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a57a0fb5-6726-4427-b36b-0ecb317d47b7 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Returning 404 to user: Instance acef330f-cbb0-4eda-aecd-23ddcf3916a7 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:25:26.339678 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a57a0fb5-6726-4427-b36b-0ecb317d47b7 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7" status: 404 len: 111 microversion: 2.1 time: 0.078546 Aug 04 17:25:26.348734 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2907/5839] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:26 2022] GET /compute/v2.1/servers/acef330f-cbb0-4eda-aecd-23ddcf3916a7 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:25:26.584571 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-fe8b0958-1fc4-48d9-9084-bca8a8d35116 req-6f76108c-f421-43e6-8637-fcebcaf28867 service nova] Creating event network-vif-deleted:2701aeee-8c0b-4201-aa2f-2cc2c92c111d for instance acef330f-cbb0-4eda-aecd-23ddcf3916a7 on n-h2-851359-3 Aug 04 17:25:26.596046 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-fe8b0958-1fc4-48d9-9084-bca8a8d35116 req-6f76108c-f421-43e6-8637-fcebcaf28867 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.406070 Aug 04 17:25:26.596046 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2933/5840] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:25:27.196231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-059e2b70-7b0d-442d-bd3d-2b879737d350 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:27.197708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-059e2b70-7b0d-442d-bd3d-2b879737d350 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: aa823d00-2c9d-4950-98cc-1cbd18bb3750] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:27.208055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-059e2b70-7b0d-442d-bd3d-2b879737d350 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:27.209085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-059e2b70-7b0d-442d-bd3d-2b879737d350 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:27.209690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-059e2b70-7b0d-442d-bd3d-2b879737d350 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:27.210636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-059e2b70-7b0d-442d-bd3d-2b879737d350 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:27.211256 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-059e2b70-7b0d-442d-bd3d-2b879737d350 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:27.211840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-059e2b70-7b0d-442d-bd3d-2b879737d350 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:27.276442 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-638406cc-a25c-4435-a3b8-e1a4994395b4 req-df79325d-c9a1-474b-b5f2-626393abdeef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "726db447-1df7-417d-a9e0-1c832e299621", "name": "network-vif-deleted", "tag": "3e04b159-57ff-4d66-afba-9b463d3dbcad"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:25:27.298501 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-638406cc-a25c-4435-a3b8-e1a4994395b4 req-df79325d-c9a1-474b-b5f2-626393abdeef service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:27.300267 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-638406cc-a25c-4435-a3b8-e1a4994395b4 req-df79325d-c9a1-474b-b5f2-626393abdeef service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:27.301650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-638406cc-a25c-4435-a3b8-e1a4994395b4 req-df79325d-c9a1-474b-b5f2-626393abdeef service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:27.326153 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-638406cc-a25c-4435-a3b8-e1a4994395b4 req-df79325d-c9a1-474b-b5f2-626393abdeef service nova] Creating event network-vif-deleted:3e04b159-57ff-4d66-afba-9b463d3dbcad for instance 726db447-1df7-417d-a9e0-1c832e299621 on n-h2-851359-3 Aug 04 17:25:27.336519 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-638406cc-a25c-4435-a3b8-e1a4994395b4 req-df79325d-c9a1-474b-b5f2-626393abdeef service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069764 Aug 04 17:25:27.338837 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2934/5841] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:25:27.356007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-43b0f4d1-d872-4cd0-abb7-ae7da62bea19 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:27.357199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-43b0f4d1-d872-4cd0-abb7-ae7da62bea19 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:27.370015 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-43b0f4d1-d872-4cd0-abb7-ae7da62bea19 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:27.370818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-43b0f4d1-d872-4cd0-abb7-ae7da62bea19 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:27.371424 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-43b0f4d1-d872-4cd0-abb7-ae7da62bea19 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:27.372306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-43b0f4d1-d872-4cd0-abb7-ae7da62bea19 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:27.373497 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-43b0f4d1-d872-4cd0-abb7-ae7da62bea19 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:27.374767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-43b0f4d1-d872-4cd0-abb7-ae7da62bea19 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:27.980625 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-059e2b70-7b0d-442d-bd3d-2b879737d350 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a22e74444594c43a655ae73d48dffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac01b1f04a148ce86e7610ac7a578b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:28.000865 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-059e2b70-7b0d-442d-bd3d-2b879737d350 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] 10.222.0.93 "GET /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750" status: 200 len: 1497 microversion: 2.1 time: 0.810387 Aug 04 17:25:28.002868 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2908/5842] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:27 2022] GET /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750 => generated 1497 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:28.024675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-43b0f4d1-d872-4cd0-abb7-ae7da62bea19 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:28.048554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-43b0f4d1-d872-4cd0-abb7-ae7da62bea19 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:28.050213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-43b0f4d1-d872-4cd0-abb7-ae7da62bea19 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:28.051568 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-43b0f4d1-d872-4cd0-abb7-ae7da62bea19 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 2370 microversion: 2.42 time: 0.709576 Aug 04 17:25:28.052134 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2935/5843] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:25:27 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 2370 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:25:28.851388 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e22270da-82b6-4dfa-8a63-48d508ac6909 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:28.851996 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e22270da-82b6-4dfa-8a63-48d508ac6909 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: aa823d00-2c9d-4950-98cc-1cbd18bb3750] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:28.860714 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e22270da-82b6-4dfa-8a63-48d508ac6909 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:28.861242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e22270da-82b6-4dfa-8a63-48d508ac6909 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:28.861786 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e22270da-82b6-4dfa-8a63-48d508ac6909 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:28.862603 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e22270da-82b6-4dfa-8a63-48d508ac6909 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:28.863136 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e22270da-82b6-4dfa-8a63-48d508ac6909 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:28.863637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e22270da-82b6-4dfa-8a63-48d508ac6909 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:28.906782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e22270da-82b6-4dfa-8a63-48d508ac6909 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: aa823d00-2c9d-4950-98cc-1cbd18bb3750] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:25:28.926332 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:25:29.065206 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e22270da-82b6-4dfa-8a63-48d508ac6909 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] 10.222.0.93 "DELETE /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750" status: 204 len: 0 microversion: 2.1 time: 0.217004 Aug 04 17:25:29.069493 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2909/5844] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:25:28 2022] DELETE /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:25:29.077394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b6512f80-f686-4e3f-9c59-2fc1bb82a8d7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:29.079398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b6512f80-f686-4e3f-9c59-2fc1bb82a8d7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: aa823d00-2c9d-4950-98cc-1cbd18bb3750] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:29.099244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a1db1fd3-d367-4863-aedd-7c2d20e1a706 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:29.100529 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a1db1fd3-d367-4863-aedd-7c2d20e1a706 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:29.100866 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6512f80-f686-4e3f-9c59-2fc1bb82a8d7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:29.104037 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6512f80-f686-4e3f-9c59-2fc1bb82a8d7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:29.104664 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6512f80-f686-4e3f-9c59-2fc1bb82a8d7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:29.105715 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6512f80-f686-4e3f-9c59-2fc1bb82a8d7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:29.108082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6512f80-f686-4e3f-9c59-2fc1bb82a8d7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:29.110498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b6512f80-f686-4e3f-9c59-2fc1bb82a8d7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:29.122137 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1db1fd3-d367-4863-aedd-7c2d20e1a706 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:29.123261 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1db1fd3-d367-4863-aedd-7c2d20e1a706 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:29.124153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1db1fd3-d367-4863-aedd-7c2d20e1a706 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:29.125470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1db1fd3-d367-4863-aedd-7c2d20e1a706 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:29.126458 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1db1fd3-d367-4863-aedd-7c2d20e1a706 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:29.128639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1db1fd3-d367-4863-aedd-7c2d20e1a706 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:29.625433 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a1db1fd3-d367-4863-aedd-7c2d20e1a706 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:29.650821 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a1db1fd3-d367-4863-aedd-7c2d20e1a706 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:29.655275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a1db1fd3-d367-4863-aedd-7c2d20e1a706 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:29.656811 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a1db1fd3-d367-4863-aedd-7c2d20e1a706 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 2210 microversion: 2.42 time: 0.572156 Aug 04 17:25:29.659946 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2910/5845] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:25:29 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 2210 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:25:29.668234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-c2440720-c244-41b3-b4ae-0bd165d984c0 req-c7598dae-adaa-4ac8-b19f-92435efbb5dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "726db447-1df7-417d-a9e0-1c832e299621", "name": "network-vif-deleted", "tag": "e397d801-65f8-4228-9ea6-fb3cb8adfc19"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:25:29.687482 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c2440720-c244-41b3-b4ae-0bd165d984c0 req-c7598dae-adaa-4ac8-b19f-92435efbb5dd service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:29.689167 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c2440720-c244-41b3-b4ae-0bd165d984c0 req-c7598dae-adaa-4ac8-b19f-92435efbb5dd service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:29.689714 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c2440720-c244-41b3-b4ae-0bd165d984c0 req-c7598dae-adaa-4ac8-b19f-92435efbb5dd service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:29.712364 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-c2440720-c244-41b3-b4ae-0bd165d984c0 req-c7598dae-adaa-4ac8-b19f-92435efbb5dd service nova] Creating event network-vif-deleted:e397d801-65f8-4228-9ea6-fb3cb8adfc19 for instance 726db447-1df7-417d-a9e0-1c832e299621 on n-h2-851359-3 Aug 04 17:25:29.720917 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-c2440720-c244-41b3-b4ae-0bd165d984c0 req-c7598dae-adaa-4ac8-b19f-92435efbb5dd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059014 Aug 04 17:25:29.722883 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2911/5846] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:25:29.732625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b6512f80-f686-4e3f-9c59-2fc1bb82a8d7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a22e74444594c43a655ae73d48dffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac01b1f04a148ce86e7610ac7a578b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:29.751819 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b6512f80-f686-4e3f-9c59-2fc1bb82a8d7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] 10.222.0.93 "GET /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750" status: 200 len: 1503 microversion: 2.1 time: 0.680484 Aug 04 17:25:29.753159 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2936/5847] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:29 2022] GET /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750 => generated 1503 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:25:30.698803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ea3853a8-251d-4a45-9ccc-fc713621a4d3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:30.701209 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ea3853a8-251d-4a45-9ccc-fc713621a4d3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:30.720712 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea3853a8-251d-4a45-9ccc-fc713621a4d3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:30.721269 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea3853a8-251d-4a45-9ccc-fc713621a4d3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:30.721726 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea3853a8-251d-4a45-9ccc-fc713621a4d3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:30.722502 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea3853a8-251d-4a45-9ccc-fc713621a4d3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:30.722979 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea3853a8-251d-4a45-9ccc-fc713621a4d3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:30.723417 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea3853a8-251d-4a45-9ccc-fc713621a4d3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:30.776365 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b29c8fd0-f1c3-46cc-9b73-72feaf024810 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:30.777003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b29c8fd0-f1c3-46cc-9b73-72feaf024810 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: aa823d00-2c9d-4950-98cc-1cbd18bb3750] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:30.797045 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b29c8fd0-f1c3-46cc-9b73-72feaf024810 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:30.797584 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b29c8fd0-f1c3-46cc-9b73-72feaf024810 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:30.800645 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b29c8fd0-f1c3-46cc-9b73-72feaf024810 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:30.801548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b29c8fd0-f1c3-46cc-9b73-72feaf024810 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:30.802116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b29c8fd0-f1c3-46cc-9b73-72feaf024810 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:30.813742 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b29c8fd0-f1c3-46cc-9b73-72feaf024810 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:30.853006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:25:31.058237 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ea3853a8-251d-4a45-9ccc-fc713621a4d3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:31.079922 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ea3853a8-251d-4a45-9ccc-fc713621a4d3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:31.084799 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ea3853a8-251d-4a45-9ccc-fc713621a4d3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:31.089343 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ea3853a8-251d-4a45-9ccc-fc713621a4d3 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1603 microversion: 2.42 time: 0.403987 Aug 04 17:25:31.090229 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2912/5848] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:25:30 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1603 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:25:31.553295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b29c8fd0-f1c3-46cc-9b73-72feaf024810 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a22e74444594c43a655ae73d48dffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac01b1f04a148ce86e7610ac7a578b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:31.586432 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b29c8fd0-f1c3-46cc-9b73-72feaf024810 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] 10.222.0.93 "GET /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750" status: 200 len: 1503 microversion: 2.1 time: 0.812146 Aug 04 17:25:31.588418 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2937/5849] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:30 2022] GET /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750 => generated 1503 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:25:31.781333 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-cfa1dd91-a50e-4c51-adc2-41a3858f5e3c req-6ee842e7-ac8f-434e-ba9b-1a0114513ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "726db447-1df7-417d-a9e0-1c832e299621", "name": "network-vif-deleted", "tag": "fdb23d55-8a38-4aff-b71c-c6c9f6001dd5"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:25:31.808134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-cfa1dd91-a50e-4c51-adc2-41a3858f5e3c req-6ee842e7-ac8f-434e-ba9b-1a0114513ba1 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:31.808776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-cfa1dd91-a50e-4c51-adc2-41a3858f5e3c req-6ee842e7-ac8f-434e-ba9b-1a0114513ba1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:31.811619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-cfa1dd91-a50e-4c51-adc2-41a3858f5e3c req-6ee842e7-ac8f-434e-ba9b-1a0114513ba1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:31.827410 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-cfa1dd91-a50e-4c51-adc2-41a3858f5e3c req-6ee842e7-ac8f-434e-ba9b-1a0114513ba1 service nova] Creating event network-vif-deleted:fdb23d55-8a38-4aff-b71c-c6c9f6001dd5 for instance 726db447-1df7-417d-a9e0-1c832e299621 on n-h2-851359-3 Aug 04 17:25:31.834158 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-cfa1dd91-a50e-4c51-adc2-41a3858f5e3c req-6ee842e7-ac8f-434e-ba9b-1a0114513ba1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056545 Aug 04 17:25:31.835604 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2913/5850] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:25:32.122266 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-24ea6abc-cd41-4ef4-a442-ad7b56c68b06 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:32.124323 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-24ea6abc-cd41-4ef4-a442-ad7b56c68b06 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:32.152278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-24ea6abc-cd41-4ef4-a442-ad7b56c68b06 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:32.156239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-24ea6abc-cd41-4ef4-a442-ad7b56c68b06 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:32.159312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-24ea6abc-cd41-4ef4-a442-ad7b56c68b06 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:32.163249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-24ea6abc-cd41-4ef4-a442-ad7b56c68b06 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:32.165950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-24ea6abc-cd41-4ef4-a442-ad7b56c68b06 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:32.168592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-24ea6abc-cd41-4ef4-a442-ad7b56c68b06 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:32.328740 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-24ea6abc-cd41-4ef4-a442-ad7b56c68b06 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:32.345475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-24ea6abc-cd41-4ef4-a442-ad7b56c68b06 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:32.351695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-24ea6abc-cd41-4ef4-a442-ad7b56c68b06 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:32.353152 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-24ea6abc-cd41-4ef4-a442-ad7b56c68b06 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1603 microversion: 2.42 time: 0.239117 Aug 04 17:25:32.356614 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2938/5851] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:25:32 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1603 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:25:32.640568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-448520e2-e599-4b2d-afd6-0d8e5d107efd tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:32.646871 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-448520e2-e599-4b2d-afd6-0d8e5d107efd tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: aa823d00-2c9d-4950-98cc-1cbd18bb3750] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:32.678005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-448520e2-e599-4b2d-afd6-0d8e5d107efd tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:32.678897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-448520e2-e599-4b2d-afd6-0d8e5d107efd tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:32.681800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-448520e2-e599-4b2d-afd6-0d8e5d107efd tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:32.683433 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-448520e2-e599-4b2d-afd6-0d8e5d107efd tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:32.684967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-448520e2-e599-4b2d-afd6-0d8e5d107efd tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:32.684967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-448520e2-e599-4b2d-afd6-0d8e5d107efd tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:32.896008 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-73dcef3b-392e-461f-8454-c57e4bed0725 req-423eddf7-b9cb-4d5c-94ce-700c7d77ccc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa823d00-2c9d-4950-98cc-1cbd18bb3750", "name": "network-vif-deleted", "tag": "efcde84d-2217-4fc6-a8be-da24dfb995d4"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:25:32.915539 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-73dcef3b-392e-461f-8454-c57e4bed0725 req-423eddf7-b9cb-4d5c-94ce-700c7d77ccc4 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:32.919590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-73dcef3b-392e-461f-8454-c57e4bed0725 req-423eddf7-b9cb-4d5c-94ce-700c7d77ccc4 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:32.920242 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-73dcef3b-392e-461f-8454-c57e4bed0725 req-423eddf7-b9cb-4d5c-94ce-700c7d77ccc4 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:32.966771 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-73dcef3b-392e-461f-8454-c57e4bed0725 req-423eddf7-b9cb-4d5c-94ce-700c7d77ccc4 service nova] Creating event network-vif-deleted:efcde84d-2217-4fc6-a8be-da24dfb995d4 for instance aa823d00-2c9d-4950-98cc-1cbd18bb3750 on n-h1-851359-3 Aug 04 17:25:32.979555 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-73dcef3b-392e-461f-8454-c57e4bed0725 req-423eddf7-b9cb-4d5c-94ce-700c7d77ccc4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084418 Aug 04 17:25:32.983877 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2939/5852] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:25:33.388972 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1d509997-7d93-41ec-b156-1ca97a5e1510 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:33.390424 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1d509997-7d93-41ec-b156-1ca97a5e1510 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:33.419615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d509997-7d93-41ec-b156-1ca97a5e1510 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:33.420438 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d509997-7d93-41ec-b156-1ca97a5e1510 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:33.421053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d509997-7d93-41ec-b156-1ca97a5e1510 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:33.422069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d509997-7d93-41ec-b156-1ca97a5e1510 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:33.422695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d509997-7d93-41ec-b156-1ca97a5e1510 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:33.423285 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d509997-7d93-41ec-b156-1ca97a5e1510 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:33.831323 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1d509997-7d93-41ec-b156-1ca97a5e1510 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:33.833026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-448520e2-e599-4b2d-afd6-0d8e5d107efd tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a22e74444594c43a655ae73d48dffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac01b1f04a148ce86e7610ac7a578b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:33.844231 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-448520e2-e599-4b2d-afd6-0d8e5d107efd tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] 10.222.0.93 "GET /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750" status: 200 len: 1461 microversion: 2.1 time: 1.211427 Aug 04 17:25:33.851707 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2914/5853] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:32 2022] GET /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750 => generated 1461 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:33.881112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1d509997-7d93-41ec-b156-1ca97a5e1510 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:33.893305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1d509997-7d93-41ec-b156-1ca97a5e1510 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:33.896526 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1d509997-7d93-41ec-b156-1ca97a5e1510 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1603 microversion: 2.42 time: 0.512732 Aug 04 17:25:33.914769 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2940/5854] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:25:33 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1603 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:25:34.875252 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bf3363b0-5af4-4788-bda8-3e7a1da934e9 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:34.875874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bf3363b0-5af4-4788-bda8-3e7a1da934e9 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: aa823d00-2c9d-4950-98cc-1cbd18bb3750] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:34.895142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf3363b0-5af4-4788-bda8-3e7a1da934e9 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:34.899009 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf3363b0-5af4-4788-bda8-3e7a1da934e9 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:34.899869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf3363b0-5af4-4788-bda8-3e7a1da934e9 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:34.900829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf3363b0-5af4-4788-bda8-3e7a1da934e9 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:34.914833 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf3363b0-5af4-4788-bda8-3e7a1da934e9 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:34.915640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf3363b0-5af4-4788-bda8-3e7a1da934e9 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:34.922827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-61740dc5-651b-4f4f-8344-f37fd0502ee4 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:34.924678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-61740dc5-651b-4f4f-8344-f37fd0502ee4 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:34.934591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61740dc5-651b-4f4f-8344-f37fd0502ee4 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:34.936463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61740dc5-651b-4f4f-8344-f37fd0502ee4 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:34.937370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61740dc5-651b-4f4f-8344-f37fd0502ee4 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:34.938342 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61740dc5-651b-4f4f-8344-f37fd0502ee4 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:34.945842 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61740dc5-651b-4f4f-8344-f37fd0502ee4 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:34.947134 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61740dc5-651b-4f4f-8344-f37fd0502ee4 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:34.969792 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-bf3363b0-5af4-4788-bda8-3e7a1da934e9 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] HTTP exception thrown: Instance aa823d00-2c9d-4950-98cc-1cbd18bb3750 could not be found. Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bf3363b0-5af4-4788-bda8-3e7a1da934e9 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Request method failure captured: Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750 HTTP/1.1 Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7ADuOgyiDp0pKOw47fAer0ZtKLSDAG0DWi3Fe575F9QzKQWEMfsu9RKt7Fg7-IFDo8fCrUVoiDNBrwxXnhKGEOh_eBi6iJ46ganVaC7XEM41srfb1oss4hWZeR_I67evhtRWWdTl-qpD_4DKA3si-kaD68F33yT9LMLTPVCPCj6XUMo Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: aac01b1f04a148ce86e7610ac7a578b4 Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-VolumesActionsTest-1487023164 Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/aac01b1f04a148ce86e7610ac7a578b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/aac01b1f04a148ce86e7610ac7a578b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_aac01b1f04a148ce86e7610ac7a578b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/aac01b1f04a148ce86e7610ac7a578b4"}]}] Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-VolumesActionsTest-1487023164 Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: aac01b1f04a148ce86e7610ac7a578b4 Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-VolumesActionsTest-1487023164 Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-VolumesActionsTest-1487023164-project Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 7a22e74444594c43a655ae73d48dffe1 Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-VolumesActionsTest-1487023164-project Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance aa823d00-2c9d-4950-98cc-1cbd18bb3750 could not be found. Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'aa823d00-2c9d-4950-98cc-1cbd18bb3750'} Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa823d00-2c9d-4950-98cc-1cbd18bb3750 could not be found. Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa823d00-2c9d-4950-98cc-1cbd18bb3750 could not be found. Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:25:34.972628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:25:34.976415 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:25:34.976415 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:25:34.976415 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:25:34.976415 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:25:34.976415 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:25:34.976415 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa823d00-2c9d-4950-98cc-1cbd18bb3750 could not be found. Aug 04 17:25:34.976415 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:25:34.987364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bf3363b0-5af4-4788-bda8-3e7a1da934e9 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Returning 404 to user: Instance aa823d00-2c9d-4950-98cc-1cbd18bb3750 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:25:34.988606 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bf3363b0-5af4-4788-bda8-3e7a1da934e9 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] 10.222.0.93 "GET /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750" status: 404 len: 111 microversion: 2.1 time: 0.117377 Aug 04 17:25:34.989681 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2915/5855] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:34 2022] GET /compute/v2.1/servers/aa823d00-2c9d-4950-98cc-1cbd18bb3750 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:25:35.128141 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-61740dc5-651b-4f4f-8344-f37fd0502ee4 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:35.140321 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-61740dc5-651b-4f4f-8344-f37fd0502ee4 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:35.151635 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cbab8b72-6775-4ce8-89de-b9dbdc62380e tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1686864941", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "03354645-8bc7-47a9-a14b-187c13a0bd39"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:25:35.156337 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-61740dc5-651b-4f4f-8344-f37fd0502ee4 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:35.162915 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-61740dc5-651b-4f4f-8344-f37fd0502ee4 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1603 microversion: 2.42 time: 0.241241 Aug 04 17:25:35.166860 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2941/5856] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:25:34 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1603 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:25:35.243221 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-cbab8b72-6775-4ce8-89de-b9dbdc62380e tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] validate_networks() for [('03354645-8bc7-47a9-a14b-187c13a0bd39', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:25:36.207748 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-57a53ac4-6c84-47f9-bf64-ad9dfafc1c4a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:36.209650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-57a53ac4-6c84-47f9-bf64-ad9dfafc1c4a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:36.230355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57a53ac4-6c84-47f9-bf64-ad9dfafc1c4a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:36.232037 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57a53ac4-6c84-47f9-bf64-ad9dfafc1c4a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:36.234274 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57a53ac4-6c84-47f9-bf64-ad9dfafc1c4a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:36.235634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57a53ac4-6c84-47f9-bf64-ad9dfafc1c4a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:36.236432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57a53ac4-6c84-47f9-bf64-ad9dfafc1c4a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:36.237612 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57a53ac4-6c84-47f9-bf64-ad9dfafc1c4a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:36.879179 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-57a53ac4-6c84-47f9-bf64-ad9dfafc1c4a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:36.909756 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-57a53ac4-6c84-47f9-bf64-ad9dfafc1c4a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:36.915501 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-57a53ac4-6c84-47f9-bf64-ad9dfafc1c4a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:36.944212 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-57a53ac4-6c84-47f9-bf64-ad9dfafc1c4a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1603 microversion: 2.42 time: 0.750907 Aug 04 17:25:36.969023 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2942/5857] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:25:36 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1603 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:25:37.981141 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a16366ae-14d1-4e18-b8e9-8b8dda992e4a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:37.982293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a16366ae-14d1-4e18-b8e9-8b8dda992e4a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:38.000974 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a16366ae-14d1-4e18-b8e9-8b8dda992e4a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:38.013343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a16366ae-14d1-4e18-b8e9-8b8dda992e4a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:38.014215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a16366ae-14d1-4e18-b8e9-8b8dda992e4a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:38.018763 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a16366ae-14d1-4e18-b8e9-8b8dda992e4a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:38.019582 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a16366ae-14d1-4e18-b8e9-8b8dda992e4a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:38.034623 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a16366ae-14d1-4e18-b8e9-8b8dda992e4a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:38.363565 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a16366ae-14d1-4e18-b8e9-8b8dda992e4a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:38.396782 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a16366ae-14d1-4e18-b8e9-8b8dda992e4a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:38.408624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a16366ae-14d1-4e18-b8e9-8b8dda992e4a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:38.414655 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a16366ae-14d1-4e18-b8e9-8b8dda992e4a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1603 microversion: 2.42 time: 0.433990 Aug 04 17:25:38.420410 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2943/5858] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:25:37 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1603 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:25:38.504324 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-cbab8b72-6775-4ce8-89de-b9dbdc62380e tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:25:38.505043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-cbab8b72-6775-4ce8-89de-b9dbdc62380e tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:25:38.506000 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-cbab8b72-6775-4ce8-89de-b9dbdc62380e tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:25:38.506780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-cbab8b72-6775-4ce8-89de-b9dbdc62380e tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:25:38.507532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-cbab8b72-6775-4ce8-89de-b9dbdc62380e tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:25:38.527936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbab8b72-6775-4ce8-89de-b9dbdc62380e tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:38.538184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbab8b72-6775-4ce8-89de-b9dbdc62380e tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:38.539767 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbab8b72-6775-4ce8-89de-b9dbdc62380e tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:38.541232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbab8b72-6775-4ce8-89de-b9dbdc62380e tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:38.542857 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbab8b72-6775-4ce8-89de-b9dbdc62380e tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:38.543837 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbab8b72-6775-4ce8-89de-b9dbdc62380e tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:38.620110 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-cbab8b72-6775-4ce8-89de-b9dbdc62380e tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Getting quotas for project aac01b1f04a148ce86e7610ac7a578b4. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:25:38.631413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-cbab8b72-6775-4ce8-89de-b9dbdc62380e tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Getting quotas for user 7a22e74444594c43a655ae73d48dffe1 and project aac01b1f04a148ce86e7610ac7a578b4. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:25:38.683811 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cbab8b72-6775-4ce8-89de-b9dbdc62380e tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:25:38.687058 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cbab8b72-6775-4ce8-89de-b9dbdc62380e tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: d70a281a-2c1b-48f2-b74e-3870492a322c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:25:38.776209 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cbab8b72-6775-4ce8-89de-b9dbdc62380e tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.628424 Aug 04 17:25:38.791147 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2916/5859] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:25:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 3643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 17:25:38.792129 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bb55a792-eee3-4ab4-a4ea-a3d99172724d tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:38.794281 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bb55a792-eee3-4ab4-a4ea-a3d99172724d tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: d70a281a-2c1b-48f2-b74e-3870492a322c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:38.973754 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bb55a792-eee3-4ab4-a4ea-a3d99172724d tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a22e74444594c43a655ae73d48dffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac01b1f04a148ce86e7610ac7a578b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:38.994309 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bb55a792-eee3-4ab4-a4ea-a3d99172724d tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] 10.222.0.93 "GET /compute/v2.1/servers/d70a281a-2c1b-48f2-b74e-3870492a322c" status: 200 len: 1214 microversion: 2.1 time: 0.206613 Aug 04 17:25:38.996115 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2944/5860] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:38 2022] GET /compute/v2.1/servers/d70a281a-2c1b-48f2-b74e-3870492a322c => generated 1214 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:39.463255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f452b97d-32c1-48cb-8346-a6a3a51adc70 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:39.465302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f452b97d-32c1-48cb-8346-a6a3a51adc70 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:39.499412 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f452b97d-32c1-48cb-8346-a6a3a51adc70 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:39.500702 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f452b97d-32c1-48cb-8346-a6a3a51adc70 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:39.502549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f452b97d-32c1-48cb-8346-a6a3a51adc70 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:39.509208 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f452b97d-32c1-48cb-8346-a6a3a51adc70 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:39.509786 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f452b97d-32c1-48cb-8346-a6a3a51adc70 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:39.511447 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f452b97d-32c1-48cb-8346-a6a3a51adc70 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:40.024173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-580f8a86-05dc-4070-8222-13d4cfd33bf7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:40.026032 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-580f8a86-05dc-4070-8222-13d4cfd33bf7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: d70a281a-2c1b-48f2-b74e-3870492a322c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:40.287297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f452b97d-32c1-48cb-8346-a6a3a51adc70 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:40.306842 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f452b97d-32c1-48cb-8346-a6a3a51adc70 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:40.309459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f452b97d-32c1-48cb-8346-a6a3a51adc70 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:40.311086 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f452b97d-32c1-48cb-8346-a6a3a51adc70 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1603 microversion: 2.42 time: 0.870180 Aug 04 17:25:40.334260 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2917/5861] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:25:39 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1603 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:25:40.515717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-580f8a86-05dc-4070-8222-13d4cfd33bf7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a22e74444594c43a655ae73d48dffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac01b1f04a148ce86e7610ac7a578b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:40.525884 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-580f8a86-05dc-4070-8222-13d4cfd33bf7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] 10.222.0.93 "GET /compute/v2.1/servers/d70a281a-2c1b-48f2-b74e-3870492a322c" status: 200 len: 1214 microversion: 2.1 time: 0.506888 Aug 04 17:25:40.541905 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2945/5862] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:40 2022] GET /compute/v2.1/servers/d70a281a-2c1b-48f2-b74e-3870492a322c => generated 1214 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:25:41.216373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7ee2b47f-4319-431b-a664-2ab991e7b126 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '.version_select at 0x7f1e5b5c5280>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:41.281892 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7ee2b47f-4319-431b-a664-2ab991e7b126 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1144795933" status: 202 len: 0 microversion: 2.1 time: 0.067719 Aug 04 17:25:41.282960 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2918/5863] 10.222.0.93 () {58 vars in 1284 bytes} [Thu Aug 4 17:25:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1144795933 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:25:41.317694 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f68d9354-9576-4910-8903-3c57928611e6 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Action: 'create', calling method: .version_select at 0x7f1e5a3b6160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-572976559", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/idljkBkqXISs3sXqpa/wJUgjyVwlTkbr7z5KwgSUY82yk4Sdr26dalN599ivFWMOGq9g6aZtNiuG8+rbwxi0Beqm7YOcg0Vc7Wzjw8UhK2kzdaJHTQT1grSgXtT51aQ=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:25:41.348065 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0a889f4c-2ebf-459c-b802-bb508807233f tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:41.349080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0a889f4c-2ebf-459c-b802-bb508807233f tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:41.364758 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=64 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:25:41.384397 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a889f4c-2ebf-459c-b802-bb508807233f tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:41.387179 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a889f4c-2ebf-459c-b802-bb508807233f tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:41.391664 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a889f4c-2ebf-459c-b802-bb508807233f tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:41.393916 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a889f4c-2ebf-459c-b802-bb508807233f tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:41.394884 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a889f4c-2ebf-459c-b802-bb508807233f tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:41.398300 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a889f4c-2ebf-459c-b802-bb508807233f tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:41.410683 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-f68d9354-9576-4910-8903-3c57928611e6 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Getting quotas for project 9c69a3e46122413f928fe20a76b0cf94. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:25:41.437532 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-f68d9354-9576-4910-8903-3c57928611e6 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Getting quotas for user f27a58cf36934daeabff9e35c05d4c19 and project 9c69a3e46122413f928fe20a76b0cf94. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:25:41.506295 n-d-851359-3 devstack@n-api.service[131043]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f68d9354-9576-4910-8903-3c57928611e6 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [816f81a5-216e-4d76-a74c-6e2877133428] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 17:25:41.784043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0a889f4c-2ebf-459c-b802-bb508807233f tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:41.803295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0a889f4c-2ebf-459c-b802-bb508807233f tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:41.804966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0a889f4c-2ebf-459c-b802-bb508807233f tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:41.813141 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0a889f4c-2ebf-459c-b802-bb508807233f tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1603 microversion: 2.42 time: 0.463073 Aug 04 17:25:41.813818 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2919/5864] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:25:41 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1603 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:25:41.818854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ae330d40-4ca8-4159-a827-adcfca135db7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:41.836905 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ae330d40-4ca8-4159-a827-adcfca135db7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: d70a281a-2c1b-48f2-b74e-3870492a322c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:41.839111 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:25:41.858457 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae330d40-4ca8-4159-a827-adcfca135db7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:41.859255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae330d40-4ca8-4159-a827-adcfca135db7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:41.859727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae330d40-4ca8-4159-a827-adcfca135db7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:41.864274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae330d40-4ca8-4159-a827-adcfca135db7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:41.865147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae330d40-4ca8-4159-a827-adcfca135db7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:41.868046 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae330d40-4ca8-4159-a827-adcfca135db7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:42.258799 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ae330d40-4ca8-4159-a827-adcfca135db7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a22e74444594c43a655ae73d48dffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac01b1f04a148ce86e7610ac7a578b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:42.267364 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ae330d40-4ca8-4159-a827-adcfca135db7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] 10.222.0.93 "GET /compute/v2.1/servers/d70a281a-2c1b-48f2-b74e-3870492a322c" status: 200 len: 1272 microversion: 2.1 time: 0.452150 Aug 04 17:25:42.282064 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2920/5865] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:41 2022] GET /compute/v2.1/servers/d70a281a-2c1b-48f2-b74e-3870492a322c => generated 1272 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:42.520428 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [None req-f68d9354-9576-4910-8903-3c57928611e6 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [816f81a5-216e-4d76-a74c-6e2877133428] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 58658. Aug 04 17:25:42.545728 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f68d9354-9576-4910-8903-3c57928611e6 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.236058 Aug 04 17:25:42.548153 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2946/5866] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:25:41 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:25:42.836667 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bf5002f9-6e2a-45d0-bbb5-f7a20638302e tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:42.837552 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bf5002f9-6e2a-45d0-bbb5-f7a20638302e tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:42.849812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf5002f9-6e2a-45d0-bbb5-f7a20638302e tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:42.850614 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf5002f9-6e2a-45d0-bbb5-f7a20638302e tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:42.851217 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf5002f9-6e2a-45d0-bbb5-f7a20638302e tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:42.852134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf5002f9-6e2a-45d0-bbb5-f7a20638302e tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:42.852755 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf5002f9-6e2a-45d0-bbb5-f7a20638302e tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:42.853348 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf5002f9-6e2a-45d0-bbb5-f7a20638302e tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:43.041117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bf5002f9-6e2a-45d0-bbb5-f7a20638302e tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:43.059732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bf5002f9-6e2a-45d0-bbb5-f7a20638302e tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:43.061280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bf5002f9-6e2a-45d0-bbb5-f7a20638302e tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:43.065791 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bf5002f9-6e2a-45d0-bbb5-f7a20638302e tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1603 microversion: 2.42 time: 0.233044 Aug 04 17:25:43.066472 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2921/5867] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:25:42 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1603 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:25:43.297061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d061e067-7f03-4fb2-973e-0b09924d9342 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:43.297872 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d061e067-7f03-4fb2-973e-0b09924d9342 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: d70a281a-2c1b-48f2-b74e-3870492a322c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:43.320025 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d061e067-7f03-4fb2-973e-0b09924d9342 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:43.320537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d061e067-7f03-4fb2-973e-0b09924d9342 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:43.320982 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d061e067-7f03-4fb2-973e-0b09924d9342 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:43.321709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d061e067-7f03-4fb2-973e-0b09924d9342 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:43.322228 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d061e067-7f03-4fb2-973e-0b09924d9342 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:43.322664 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d061e067-7f03-4fb2-973e-0b09924d9342 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:43.544185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d061e067-7f03-4fb2-973e-0b09924d9342 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a22e74444594c43a655ae73d48dffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac01b1f04a148ce86e7610ac7a578b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:43.553853 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d061e067-7f03-4fb2-973e-0b09924d9342 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] 10.222.0.93 "GET /compute/v2.1/servers/d70a281a-2c1b-48f2-b74e-3870492a322c" status: 200 len: 1272 microversion: 2.1 time: 0.262563 Aug 04 17:25:43.559178 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2947/5868] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:43 2022] GET /compute/v2.1/servers/d70a281a-2c1b-48f2-b74e-3870492a322c => generated 1272 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:25:44.093179 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9616849a-99af-4b70-9fd8-5af94053d2fd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:44.093823 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9616849a-99af-4b70-9fd8-5af94053d2fd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:44.109799 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9616849a-99af-4b70-9fd8-5af94053d2fd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:44.110343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9616849a-99af-4b70-9fd8-5af94053d2fd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:44.110789 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9616849a-99af-4b70-9fd8-5af94053d2fd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:44.111568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9616849a-99af-4b70-9fd8-5af94053d2fd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:44.112033 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9616849a-99af-4b70-9fd8-5af94053d2fd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:44.112466 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9616849a-99af-4b70-9fd8-5af94053d2fd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:44.347084 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9616849a-99af-4b70-9fd8-5af94053d2fd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:44.365440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9616849a-99af-4b70-9fd8-5af94053d2fd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:44.372135 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9616849a-99af-4b70-9fd8-5af94053d2fd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:44.375624 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9616849a-99af-4b70-9fd8-5af94053d2fd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1603 microversion: 2.42 time: 0.286676 Aug 04 17:25:44.378352 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2922/5869] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:25:44 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1603 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:25:44.592141 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c22f9798-cbf0-4987-80de-6dd3a3ebaf9a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:44.593564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c22f9798-cbf0-4987-80de-6dd3a3ebaf9a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: d70a281a-2c1b-48f2-b74e-3870492a322c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:44.623213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c22f9798-cbf0-4987-80de-6dd3a3ebaf9a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:44.623660 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c22f9798-cbf0-4987-80de-6dd3a3ebaf9a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:44.626162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c22f9798-cbf0-4987-80de-6dd3a3ebaf9a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:44.634535 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c22f9798-cbf0-4987-80de-6dd3a3ebaf9a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:44.646987 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c22f9798-cbf0-4987-80de-6dd3a3ebaf9a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:44.649239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c22f9798-cbf0-4987-80de-6dd3a3ebaf9a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:45.404651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eb9a64c0-bc16-4734-86b8-646e72738602 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:45.405276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eb9a64c0-bc16-4734-86b8-646e72738602 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:45.416575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb9a64c0-bc16-4734-86b8-646e72738602 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:45.417075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb9a64c0-bc16-4734-86b8-646e72738602 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:45.417518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb9a64c0-bc16-4734-86b8-646e72738602 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:45.418268 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb9a64c0-bc16-4734-86b8-646e72738602 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:45.418735 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb9a64c0-bc16-4734-86b8-646e72738602 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:45.419167 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb9a64c0-bc16-4734-86b8-646e72738602 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:46.000674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eb9a64c0-bc16-4734-86b8-646e72738602 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:46.043053 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eb9a64c0-bc16-4734-86b8-646e72738602 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:46.053147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eb9a64c0-bc16-4734-86b8-646e72738602 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:46.056909 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eb9a64c0-bc16-4734-86b8-646e72738602 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1603 microversion: 2.42 time: 0.657807 Aug 04 17:25:46.056909 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2923/5870] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:25:45 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1603 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:25:46.065945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-ec9a1d1d-5a20-4448-a369-6c6eb400d73b req-4028904b-7f25-4cef-8312-ebf4b718c15b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d70a281a-2c1b-48f2-b74e-3870492a322c", "tag": "93e9613b-5083-48f2-ac17-11e4f8281b91"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:25:46.074234 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c22f9798-cbf0-4987-80de-6dd3a3ebaf9a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a22e74444594c43a655ae73d48dffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac01b1f04a148ce86e7610ac7a578b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:46.079998 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ec9a1d1d-5a20-4448-a369-6c6eb400d73b req-4028904b-7f25-4cef-8312-ebf4b718c15b service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:46.080833 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ec9a1d1d-5a20-4448-a369-6c6eb400d73b req-4028904b-7f25-4cef-8312-ebf4b718c15b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:46.081479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ec9a1d1d-5a20-4448-a369-6c6eb400d73b req-4028904b-7f25-4cef-8312-ebf4b718c15b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:46.082095 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c22f9798-cbf0-4987-80de-6dd3a3ebaf9a tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] 10.222.0.93 "GET /compute/v2.1/servers/d70a281a-2c1b-48f2-b74e-3870492a322c" status: 200 len: 1314 microversion: 2.1 time: 1.496272 Aug 04 17:25:46.085558 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2948/5871] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:44 2022] GET /compute/v2.1/servers/d70a281a-2c1b-48f2-b74e-3870492a322c => generated 1314 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:46.099026 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-ec9a1d1d-5a20-4448-a369-6c6eb400d73b req-4028904b-7f25-4cef-8312-ebf4b718c15b service nova] Creating event network-changed:93e9613b-5083-48f2-ac17-11e4f8281b91 for instance d70a281a-2c1b-48f2-b74e-3870492a322c on n-h1-851359-3 Aug 04 17:25:46.105228 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-ec9a1d1d-5a20-4448-a369-6c6eb400d73b req-4028904b-7f25-4cef-8312-ebf4b718c15b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045458 Aug 04 17:25:46.106208 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2924/5872] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:25:47.088727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a091cbac-7c61-4e18-864a-c06e518e60dd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:47.090277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a091cbac-7c61-4e18-864a-c06e518e60dd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:47.110117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3f7c3454-0ee4-464f-b11d-51d38cdf02a3 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:47.111031 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3f7c3454-0ee4-464f-b11d-51d38cdf02a3 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: d70a281a-2c1b-48f2-b74e-3870492a322c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:47.130082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f7c3454-0ee4-464f-b11d-51d38cdf02a3 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:47.130974 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f7c3454-0ee4-464f-b11d-51d38cdf02a3 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:47.131572 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f7c3454-0ee4-464f-b11d-51d38cdf02a3 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:47.134300 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f7c3454-0ee4-464f-b11d-51d38cdf02a3 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:47.136573 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f7c3454-0ee4-464f-b11d-51d38cdf02a3 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:47.144829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f7c3454-0ee4-464f-b11d-51d38cdf02a3 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:47.165756 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a091cbac-7c61-4e18-864a-c06e518e60dd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:47.172835 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a091cbac-7c61-4e18-864a-c06e518e60dd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:47.175667 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a091cbac-7c61-4e18-864a-c06e518e60dd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:47.178528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a091cbac-7c61-4e18-864a-c06e518e60dd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:47.179438 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a091cbac-7c61-4e18-864a-c06e518e60dd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:47.179973 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a091cbac-7c61-4e18-864a-c06e518e60dd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:47.756796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a091cbac-7c61-4e18-864a-c06e518e60dd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:47.775594 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a091cbac-7c61-4e18-864a-c06e518e60dd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:47.777136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a091cbac-7c61-4e18-864a-c06e518e60dd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:47.788518 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a091cbac-7c61-4e18-864a-c06e518e60dd tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1603 microversion: 2.42 time: 0.701600 Aug 04 17:25:47.790627 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2949/5873] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:25:47 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1603 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:25:48.586604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:25:48.667278 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:25:48.707966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3f7c3454-0ee4-464f-b11d-51d38cdf02a3 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a22e74444594c43a655ae73d48dffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac01b1f04a148ce86e7610ac7a578b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:48.723389 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3f7c3454-0ee4-464f-b11d-51d38cdf02a3 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] 10.222.0.93 "GET /compute/v2.1/servers/d70a281a-2c1b-48f2-b74e-3870492a322c" status: 200 len: 1314 microversion: 2.1 time: 1.618591 Aug 04 17:25:48.739640 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2925/5874] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:47 2022] GET /compute/v2.1/servers/d70a281a-2c1b-48f2-b74e-3870492a322c => generated 1314 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:25:48.817396 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-eba169ba-e415-498a-9d45-cc2249f41609 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:48.818036 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-eba169ba-e415-498a-9d45-cc2249f41609 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:48.841020 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eba169ba-e415-498a-9d45-cc2249f41609 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:48.844381 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eba169ba-e415-498a-9d45-cc2249f41609 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:48.847081 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eba169ba-e415-498a-9d45-cc2249f41609 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:48.852583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eba169ba-e415-498a-9d45-cc2249f41609 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:48.854756 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eba169ba-e415-498a-9d45-cc2249f41609 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:48.857095 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eba169ba-e415-498a-9d45-cc2249f41609 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:49.249736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-eba169ba-e415-498a-9d45-cc2249f41609 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:49.262465 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-eba169ba-e415-498a-9d45-cc2249f41609 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:49.264010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-eba169ba-e415-498a-9d45-cc2249f41609 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:49.269088 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-eba169ba-e415-498a-9d45-cc2249f41609 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1603 microversion: 2.42 time: 0.451962 Aug 04 17:25:49.272954 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2950/5875] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:25:48 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1603 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:25:49.751504 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ca8b3596-7370-4f8d-97f1-be22fd4e527f tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:49.754086 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ca8b3596-7370-4f8d-97f1-be22fd4e527f tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: d70a281a-2c1b-48f2-b74e-3870492a322c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:49.770710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca8b3596-7370-4f8d-97f1-be22fd4e527f tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:49.772729 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca8b3596-7370-4f8d-97f1-be22fd4e527f tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:49.773864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca8b3596-7370-4f8d-97f1-be22fd4e527f tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:49.776711 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca8b3596-7370-4f8d-97f1-be22fd4e527f tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:49.777349 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca8b3596-7370-4f8d-97f1-be22fd4e527f tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:49.778501 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca8b3596-7370-4f8d-97f1-be22fd4e527f tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:50.300603 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cc31186c-6fff-44f6-85ed-84e8a014e8f5 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:50.301289 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cc31186c-6fff-44f6-85ed-84e8a014e8f5 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:50.331216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc31186c-6fff-44f6-85ed-84e8a014e8f5 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:50.333125 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc31186c-6fff-44f6-85ed-84e8a014e8f5 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:50.333640 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc31186c-6fff-44f6-85ed-84e8a014e8f5 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:50.336344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc31186c-6fff-44f6-85ed-84e8a014e8f5 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:50.337849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc31186c-6fff-44f6-85ed-84e8a014e8f5 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:50.338519 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc31186c-6fff-44f6-85ed-84e8a014e8f5 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:50.851547 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cc31186c-6fff-44f6-85ed-84e8a014e8f5 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:50.870122 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cc31186c-6fff-44f6-85ed-84e8a014e8f5 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:50.871821 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cc31186c-6fff-44f6-85ed-84e8a014e8f5 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:50.873359 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cc31186c-6fff-44f6-85ed-84e8a014e8f5 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1603 microversion: 2.42 time: 0.578170 Aug 04 17:25:50.875821 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2951/5876] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:25:50 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1603 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:25:51.761618 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-11f213b1-b890-4964-9f45-10f8d88bee81 req-8cc2d65e-7563-4463-95f2-55297c3485cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d70a281a-2c1b-48f2-b74e-3870492a322c", "name": "network-vif-plugged", "status": "completed", "tag": "93e9613b-5083-48f2-ac17-11e4f8281b91"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:25:51.773069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=8 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:25:51.778385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-11f213b1-b890-4964-9f45-10f8d88bee81 req-8cc2d65e-7563-4463-95f2-55297c3485cc service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:51.779460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-11f213b1-b890-4964-9f45-10f8d88bee81 req-8cc2d65e-7563-4463-95f2-55297c3485cc service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:51.782165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-11f213b1-b890-4964-9f45-10f8d88bee81 req-8cc2d65e-7563-4463-95f2-55297c3485cc service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:51.787501 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ca8b3596-7370-4f8d-97f1-be22fd4e527f tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a22e74444594c43a655ae73d48dffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac01b1f04a148ce86e7610ac7a578b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:51.796131 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ca8b3596-7370-4f8d-97f1-be22fd4e527f tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] 10.222.0.93 "GET /compute/v2.1/servers/d70a281a-2c1b-48f2-b74e-3870492a322c" status: 200 len: 1314 microversion: 2.1 time: 2.054109 Aug 04 17:25:51.804056 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2926/5877] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:49 2022] GET /compute/v2.1/servers/d70a281a-2c1b-48f2-b74e-3870492a322c => generated 1314 bytes in 2063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:51.817913 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-11f213b1-b890-4964-9f45-10f8d88bee81 req-8cc2d65e-7563-4463-95f2-55297c3485cc service nova] Creating event network-vif-plugged:93e9613b-5083-48f2-ac17-11e4f8281b91 for instance d70a281a-2c1b-48f2-b74e-3870492a322c on n-h1-851359-3 Aug 04 17:25:51.852013 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-11f213b1-b890-4964-9f45-10f8d88bee81 req-8cc2d65e-7563-4463-95f2-55297c3485cc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091205 Aug 04 17:25:51.853139 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2952/5878] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:25:51.902890 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fcdd3edd-0c61-447f-b0b9-61e9b20ee51a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:51.903839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fcdd3edd-0c61-447f-b0b9-61e9b20ee51a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:51.924571 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fcdd3edd-0c61-447f-b0b9-61e9b20ee51a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:51.925085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fcdd3edd-0c61-447f-b0b9-61e9b20ee51a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:51.925535 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fcdd3edd-0c61-447f-b0b9-61e9b20ee51a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:51.926499 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fcdd3edd-0c61-447f-b0b9-61e9b20ee51a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:51.927153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fcdd3edd-0c61-447f-b0b9-61e9b20ee51a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:51.927776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fcdd3edd-0c61-447f-b0b9-61e9b20ee51a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:52.138227 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fcdd3edd-0c61-447f-b0b9-61e9b20ee51a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:52.149555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fcdd3edd-0c61-447f-b0b9-61e9b20ee51a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:52.155073 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fcdd3edd-0c61-447f-b0b9-61e9b20ee51a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:52.166947 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fcdd3edd-0c61-447f-b0b9-61e9b20ee51a tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1603 microversion: 2.42 time: 0.267998 Aug 04 17:25:52.168134 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2927/5879] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:25:51 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1603 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:25:52.828956 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fdf91211-0a49-48a6-9889-519bd4241dfd tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:52.829898 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fdf91211-0a49-48a6-9889-519bd4241dfd tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: d70a281a-2c1b-48f2-b74e-3870492a322c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:52.843540 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdf91211-0a49-48a6-9889-519bd4241dfd tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:52.847117 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdf91211-0a49-48a6-9889-519bd4241dfd tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:52.847712 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdf91211-0a49-48a6-9889-519bd4241dfd tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:52.850934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdf91211-0a49-48a6-9889-519bd4241dfd tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:52.851576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdf91211-0a49-48a6-9889-519bd4241dfd tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:52.852140 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdf91211-0a49-48a6-9889-519bd4241dfd tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:53.190737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-97ead235-7063-40ab-8ffa-8e402364a143 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:53.191373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-97ead235-7063-40ab-8ffa-8e402364a143 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:53.209860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97ead235-7063-40ab-8ffa-8e402364a143 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:53.210533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97ead235-7063-40ab-8ffa-8e402364a143 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:53.211037 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97ead235-7063-40ab-8ffa-8e402364a143 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:53.211830 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97ead235-7063-40ab-8ffa-8e402364a143 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:53.212530 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97ead235-7063-40ab-8ffa-8e402364a143 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:53.213162 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97ead235-7063-40ab-8ffa-8e402364a143 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:53.688369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-97ead235-7063-40ab-8ffa-8e402364a143 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:53.703542 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-97ead235-7063-40ab-8ffa-8e402364a143 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:53.711481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-97ead235-7063-40ab-8ffa-8e402364a143 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:53.713147 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-97ead235-7063-40ab-8ffa-8e402364a143 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1603 microversion: 2.42 time: 0.527368 Aug 04 17:25:53.714327 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2928/5880] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:25:53 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1603 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:25:53.920869 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fdf91211-0a49-48a6-9889-519bd4241dfd tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a22e74444594c43a655ae73d48dffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac01b1f04a148ce86e7610ac7a578b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:53.929405 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fdf91211-0a49-48a6-9889-519bd4241dfd tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] 10.222.0.93 "GET /compute/v2.1/servers/d70a281a-2c1b-48f2-b74e-3870492a322c" status: 200 len: 1314 microversion: 2.1 time: 1.104694 Aug 04 17:25:53.934866 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2953/5881] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:52 2022] GET /compute/v2.1/servers/d70a281a-2c1b-48f2-b74e-3870492a322c => generated 1314 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:54.741968 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d1e23729-730b-43f4-9467-3e72cbb98e0c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:54.742949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d1e23729-730b-43f4-9467-3e72cbb98e0c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:54.781885 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1e23729-730b-43f4-9467-3e72cbb98e0c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:54.786595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1e23729-730b-43f4-9467-3e72cbb98e0c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:54.788190 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1e23729-730b-43f4-9467-3e72cbb98e0c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:54.792923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1e23729-730b-43f4-9467-3e72cbb98e0c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:54.799970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1e23729-730b-43f4-9467-3e72cbb98e0c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:54.801489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1e23729-730b-43f4-9467-3e72cbb98e0c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:54.868935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:25:54.957396 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b80874be-a50d-4d8d-955c-7fea080a61a7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:54.958679 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b80874be-a50d-4d8d-955c-7fea080a61a7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: d70a281a-2c1b-48f2-b74e-3870492a322c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:54.965710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1e23729-730b-43f4-9467-3e72cbb98e0c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:54.967988 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1e23729-730b-43f4-9467-3e72cbb98e0c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:54.968829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1e23729-730b-43f4-9467-3e72cbb98e0c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:54.969800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-d1e23729-730b-43f4-9467-3e72cbb98e0c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lazy-loading 'fault' on Instance uuid 726db447-1df7-417d-a9e0-1c832e299621 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:25:54.972510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b80874be-a50d-4d8d-955c-7fea080a61a7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:54.974706 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b80874be-a50d-4d8d-955c-7fea080a61a7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:54.977874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b80874be-a50d-4d8d-955c-7fea080a61a7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:54.978959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b80874be-a50d-4d8d-955c-7fea080a61a7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:54.979771 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b80874be-a50d-4d8d-955c-7fea080a61a7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:54.982339 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b80874be-a50d-4d8d-955c-7fea080a61a7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:55.581053 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d1e23729-730b-43f4-9467-3e72cbb98e0c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:55.593494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d1e23729-730b-43f4-9467-3e72cbb98e0c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:55.601622 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d1e23729-730b-43f4-9467-3e72cbb98e0c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ed7b7928cdb49659150b9e89d86e8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a0b5a8d12f49ffbb7570bec11538f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:55.603328 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d1e23729-730b-43f4-9467-3e72cbb98e0c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 200 len: 1370 microversion: 2.42 time: 0.868376 Aug 04 17:25:55.609213 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2929/5882] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:25:54 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 1370 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:25:55.917336 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b80874be-a50d-4d8d-955c-7fea080a61a7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a22e74444594c43a655ae73d48dffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac01b1f04a148ce86e7610ac7a578b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:55.926157 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b80874be-a50d-4d8d-955c-7fea080a61a7 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] 10.222.0.93 "GET /compute/v2.1/servers/d70a281a-2c1b-48f2-b74e-3870492a322c" status: 200 len: 1498 microversion: 2.1 time: 0.973090 Aug 04 17:25:55.930665 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2954/5883] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:54 2022] GET /compute/v2.1/servers/d70a281a-2c1b-48f2-b74e-3870492a322c => generated 1498 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:25:56.631134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e0fa979e-355c-4a90-a46a-858faa10deb6 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:56.631900 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e0fa979e-355c-4a90-a46a-858faa10deb6 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:56.654520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0fa979e-355c-4a90-a46a-858faa10deb6 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:56.654520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0fa979e-355c-4a90-a46a-858faa10deb6 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:56.654520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0fa979e-355c-4a90-a46a-858faa10deb6 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:56.654520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0fa979e-355c-4a90-a46a-858faa10deb6 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:56.654520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0fa979e-355c-4a90-a46a-858faa10deb6 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:56.656829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0fa979e-355c-4a90-a46a-858faa10deb6 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:56.711230 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-e0fa979e-355c-4a90-a46a-858faa10deb6 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] HTTP exception thrown: Instance 726db447-1df7-417d-a9e0-1c832e299621 could not be found. Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e0fa979e-355c-4a90-a46a-858faa10deb6 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Request method failure captured: Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 HTTP/1.1 Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_9fmzJKXNeZYxwF1Q0tT_jWi7rqaQl61UJH-O8wGf64gqwggUfdAw7y4-W3o2IncvLYAqw9EaGw2viS0mcqpkCzxzKbmoJ2a4vXqrCy-8JAvrpvAUqSFv0uIdxV-CJtQFGQLQKV-Zg55ogIRzS5tnNDQv2TPG0S8XRk0Yjsa2JWLac Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.42 Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 60a0b5a8d12f49ffbb7570bec11538f7 Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-435089650 Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/60a0b5a8d12f49ffbb7570bec11538f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/60a0b5a8d12f49ffbb7570bec11538f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_60a0b5a8d12f49ffbb7570bec11538f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/60a0b5a8d12f49ffbb7570bec11538f7"}]}] Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TaggedBootDevicesTest_v242-435089650 Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 60a0b5a8d12f49ffbb7570bec11538f7 Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-435089650 Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TaggedBootDevicesTest_v242-435089650-project Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 0ed7b7928cdb49659150b9e89d86e8c8 Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TaggedBootDevicesTest_v242-435089650-project Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 726db447-1df7-417d-a9e0-1c832e299621 could not be found. Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '726db447-1df7-417d-a9e0-1c832e299621'} Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 726db447-1df7-417d-a9e0-1c832e299621 could not be found. Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 726db447-1df7-417d-a9e0-1c832e299621 could not be found. Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:25:56.717496 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:25:56.723192 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:25:56.723192 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:25:56.723192 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:25:56.723192 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:25:56.723192 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:25:56.723192 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:25:56.723192 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 726db447-1df7-417d-a9e0-1c832e299621 could not be found. Aug 04 17:25:56.723192 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:25:56.725197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e0fa979e-355c-4a90-a46a-858faa10deb6 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Returning 404 to user: Instance 726db447-1df7-417d-a9e0-1c832e299621 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:25:56.731250 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e0fa979e-355c-4a90-a46a-858faa10deb6 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 404 len: 111 microversion: 2.42 time: 0.102980 Aug 04 17:25:56.733110 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2930/5884] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:25:56 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:25:56.742477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bfc34916-5612-4aa1-9746-c307bce6312c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '.version_select at 0x7f1e5a33be50>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:56.828841 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bfc34916-5612-4aa1-9746-c307bce6312c tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-478931768" status: 204 len: 0 microversion: 2.42 time: 0.086890 Aug 04 17:25:56.835645 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2955/5885] 10.222.0.93 () {60 vars in 1259 bytes} [Thu Aug 4 17:25:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-478931768 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 17:25:56.981604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-99d402d7-fcc7-4abe-8da7-df17bbc2a8cc tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:56.982455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-99d402d7-fcc7-4abe-8da7-df17bbc2a8cc tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: d70a281a-2c1b-48f2-b74e-3870492a322c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:56.995551 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99d402d7-fcc7-4abe-8da7-df17bbc2a8cc tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:56.996090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99d402d7-fcc7-4abe-8da7-df17bbc2a8cc tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:56.996543 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99d402d7-fcc7-4abe-8da7-df17bbc2a8cc tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:56.997270 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99d402d7-fcc7-4abe-8da7-df17bbc2a8cc tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:56.997733 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99d402d7-fcc7-4abe-8da7-df17bbc2a8cc tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:56.998852 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99d402d7-fcc7-4abe-8da7-df17bbc2a8cc tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:57.046284 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-99d402d7-fcc7-4abe-8da7-df17bbc2a8cc tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: d70a281a-2c1b-48f2-b74e-3870492a322c] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:25:57.186140 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-99d402d7-fcc7-4abe-8da7-df17bbc2a8cc tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] 10.222.0.93 "DELETE /compute/v2.1/servers/d70a281a-2c1b-48f2-b74e-3870492a322c" status: 204 len: 0 microversion: 2.1 time: 0.212048 Aug 04 17:25:57.190837 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2931/5886] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:25:56 2022] DELETE /compute/v2.1/servers/d70a281a-2c1b-48f2-b74e-3870492a322c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:25:57.197084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0436addb-1746-417c-8aeb-ef1c550472c9 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:57.197735 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0436addb-1746-417c-8aeb-ef1c550472c9 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: d70a281a-2c1b-48f2-b74e-3870492a322c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:57.220755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0436addb-1746-417c-8aeb-ef1c550472c9 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:57.221289 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0436addb-1746-417c-8aeb-ef1c550472c9 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:57.221819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0436addb-1746-417c-8aeb-ef1c550472c9 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:57.222630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0436addb-1746-417c-8aeb-ef1c550472c9 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:57.224788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0436addb-1746-417c-8aeb-ef1c550472c9 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:57.225261 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0436addb-1746-417c-8aeb-ef1c550472c9 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:58.575430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0436addb-1746-417c-8aeb-ef1c550472c9 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a22e74444594c43a655ae73d48dffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac01b1f04a148ce86e7610ac7a578b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:25:58.584750 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0436addb-1746-417c-8aeb-ef1c550472c9 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] 10.222.0.93 "GET /compute/v2.1/servers/d70a281a-2c1b-48f2-b74e-3870492a322c" status: 200 len: 1504 microversion: 2.1 time: 1.392451 Aug 04 17:25:58.600773 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2956/5887] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:57 2022] GET /compute/v2.1/servers/d70a281a-2c1b-48f2-b74e-3870492a322c => generated 1504 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:25:59.617903 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bf76c72d-b663-40a6-a333-01fbb28ede4b tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:25:59.619314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bf76c72d-b663-40a6-a333-01fbb28ede4b tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: d70a281a-2c1b-48f2-b74e-3870492a322c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:25:59.638703 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf76c72d-b663-40a6-a333-01fbb28ede4b tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:59.642170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf76c72d-b663-40a6-a333-01fbb28ede4b tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:59.644005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf76c72d-b663-40a6-a333-01fbb28ede4b tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:25:59.646210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf76c72d-b663-40a6-a333-01fbb28ede4b tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:25:59.648955 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf76c72d-b663-40a6-a333-01fbb28ede4b tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:25:59.649687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf76c72d-b663-40a6-a333-01fbb28ede4b tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:00.085429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bf76c72d-b663-40a6-a333-01fbb28ede4b tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a22e74444594c43a655ae73d48dffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac01b1f04a148ce86e7610ac7a578b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:00.118405 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bf76c72d-b663-40a6-a333-01fbb28ede4b tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] 10.222.0.93 "GET /compute/v2.1/servers/d70a281a-2c1b-48f2-b74e-3870492a322c" status: 200 len: 1504 microversion: 2.1 time: 0.498780 Aug 04 17:26:00.121294 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2932/5888] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:25:59 2022] GET /compute/v2.1/servers/d70a281a-2c1b-48f2-b74e-3870492a322c => generated 1504 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:01.148501 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0b47f128-6127-4afd-b71a-493d0753c111 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:01.150946 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0b47f128-6127-4afd-b71a-493d0753c111 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: d70a281a-2c1b-48f2-b74e-3870492a322c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:01.175467 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b47f128-6127-4afd-b71a-493d0753c111 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:01.178736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b47f128-6127-4afd-b71a-493d0753c111 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:01.181955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b47f128-6127-4afd-b71a-493d0753c111 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:01.183007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b47f128-6127-4afd-b71a-493d0753c111 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:01.183651 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b47f128-6127-4afd-b71a-493d0753c111 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:01.184523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b47f128-6127-4afd-b71a-493d0753c111 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:01.204160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=86 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:26:01.846387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0b47f128-6127-4afd-b71a-493d0753c111 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a22e74444594c43a655ae73d48dffe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aac01b1f04a148ce86e7610ac7a578b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:01.861099 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0b47f128-6127-4afd-b71a-493d0753c111 tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] 10.222.0.93 "GET /compute/v2.1/servers/d70a281a-2c1b-48f2-b74e-3870492a322c" status: 200 len: 1462 microversion: 2.1 time: 0.713313 Aug 04 17:26:01.862357 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2957/5889] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:01 2022] GET /compute/v2.1/servers/d70a281a-2c1b-48f2-b74e-3870492a322c => generated 1462 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:01.900628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-00c11389-3811-4f01-9bd7-e4c1f391f8e0 req-43b2ff50-d1c9-459f-8f9f-95fbf3c4ccb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d70a281a-2c1b-48f2-b74e-3870492a322c", "name": "network-vif-deleted", "tag": "93e9613b-5083-48f2-ac17-11e4f8281b91"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:26:01.943946 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-00c11389-3811-4f01-9bd7-e4c1f391f8e0 req-43b2ff50-d1c9-459f-8f9f-95fbf3c4ccb1 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:01.944455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-00c11389-3811-4f01-9bd7-e4c1f391f8e0 req-43b2ff50-d1c9-459f-8f9f-95fbf3c4ccb1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:01.944901 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-00c11389-3811-4f01-9bd7-e4c1f391f8e0 req-43b2ff50-d1c9-459f-8f9f-95fbf3c4ccb1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:01.982119 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-00c11389-3811-4f01-9bd7-e4c1f391f8e0 req-43b2ff50-d1c9-459f-8f9f-95fbf3c4ccb1 service nova] Creating event network-vif-deleted:93e9613b-5083-48f2-ac17-11e4f8281b91 for instance d70a281a-2c1b-48f2-b74e-3870492a322c on n-h1-851359-3 Aug 04 17:26:01.995491 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-00c11389-3811-4f01-9bd7-e4c1f391f8e0 req-43b2ff50-d1c9-459f-8f9f-95fbf3c4ccb1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100186 Aug 04 17:26:01.997379 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2933/5890] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:26:02.887034 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-eba026b0-e138-47df-bec3-546e7f9e21ab tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:02.887947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-eba026b0-e138-47df-bec3-546e7f9e21ab tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] [instance: d70a281a-2c1b-48f2-b74e-3870492a322c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:02.906501 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eba026b0-e138-47df-bec3-546e7f9e21ab tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:02.908140 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eba026b0-e138-47df-bec3-546e7f9e21ab tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:02.912012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eba026b0-e138-47df-bec3-546e7f9e21ab tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:02.913878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eba026b0-e138-47df-bec3-546e7f9e21ab tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:02.914619 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eba026b0-e138-47df-bec3-546e7f9e21ab tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:02.919477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eba026b0-e138-47df-bec3-546e7f9e21ab tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:02.956163 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-eba026b0-e138-47df-bec3-546e7f9e21ab tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] HTTP exception thrown: Instance d70a281a-2c1b-48f2-b74e-3870492a322c could not be found. Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-eba026b0-e138-47df-bec3-546e7f9e21ab tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Request method failure captured: Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/d70a281a-2c1b-48f2-b74e-3870492a322c HTTP/1.1 Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7ADuOgyiDp0pKOw47fAer0ZtKLSDAG0DWi3Fe575F9QzKQWEMfsu9RKt7Fg7-IFDo8fCrUVoiDNBrwxXnhKGEOh_eBi6iJ46ganVaC7XEM41srfb1oss4hWZeR_I67evhtRWWdTl-qpD_4DKA3si-kaD68F33yT9LMLTPVCPCj6XUMo Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: aac01b1f04a148ce86e7610ac7a578b4 Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-VolumesActionsTest-1487023164 Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/aac01b1f04a148ce86e7610ac7a578b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/aac01b1f04a148ce86e7610ac7a578b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_aac01b1f04a148ce86e7610ac7a578b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/aac01b1f04a148ce86e7610ac7a578b4"}]}] Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-VolumesActionsTest-1487023164 Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: aac01b1f04a148ce86e7610ac7a578b4 Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-VolumesActionsTest-1487023164 Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-VolumesActionsTest-1487023164-project Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 7a22e74444594c43a655ae73d48dffe1 Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-VolumesActionsTest-1487023164-project Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance d70a281a-2c1b-48f2-b74e-3870492a322c could not be found. Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'd70a281a-2c1b-48f2-b74e-3870492a322c'} Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d70a281a-2c1b-48f2-b74e-3870492a322c could not be found. Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d70a281a-2c1b-48f2-b74e-3870492a322c could not be found. Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:26:02.961730 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:26:02.965990 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:26:02.965990 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:26:02.965990 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:26:02.965990 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:26:02.965990 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:26:02.965990 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d70a281a-2c1b-48f2-b74e-3870492a322c could not be found. Aug 04 17:26:02.965990 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:26:02.971116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-eba026b0-e138-47df-bec3-546e7f9e21ab tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] Returning 404 to user: Instance d70a281a-2c1b-48f2-b74e-3870492a322c could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:26:02.972207 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-eba026b0-e138-47df-bec3-546e7f9e21ab tempest-VolumesActionsTest-1487023164 tempest-VolumesActionsTest-1487023164-project] 10.222.0.93 "GET /compute/v2.1/servers/d70a281a-2c1b-48f2-b74e-3870492a322c" status: 404 len: 111 microversion: 2.1 time: 0.091141 Aug 04 17:26:02.976758 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2958/5891] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:02 2022] GET /compute/v2.1/servers/d70a281a-2c1b-48f2-b74e-3870492a322c => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:26:13.321056 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-15cb8d6e-01e7-4765-9d53-26d35229d925 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1454947613", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "532b70bc-7433-4547-9e7e-a2f45236d734"}], "key_name": "tempest-TestNetworkAdvancedServerOps-572976559", "security_groups": [{"name": "tempest-secgroup-smoke-1320130639"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:26:13.397750 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:26:13.398454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:26:14.533675 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-15cb8d6e-01e7-4765-9d53-26d35229d925 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] validate_networks() for [('532b70bc-7433-4547-9e7e-a2f45236d734', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:26:14.992383 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e2e0d89c-b906-4d68-a8c1-495f22517e34 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:14.997406 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e2e0d89c-b906-4d68-a8c1-495f22517e34 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:15.020486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:26:15.032774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=7 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:26:15.036352 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2e0d89c-b906-4d68-a8c1-495f22517e34 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:15.037669 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2e0d89c-b906-4d68-a8c1-495f22517e34 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:15.038796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2e0d89c-b906-4d68-a8c1-495f22517e34 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:15.040666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2e0d89c-b906-4d68-a8c1-495f22517e34 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:15.041822 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2e0d89c-b906-4d68-a8c1-495f22517e34 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:15.042950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2e0d89c-b906-4d68-a8c1-495f22517e34 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:15.083435 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-e2e0d89c-b906-4d68-a8c1-495f22517e34 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] HTTP exception thrown: Instance 726db447-1df7-417d-a9e0-1c832e299621 could not be found. Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e2e0d89c-b906-4d68-a8c1-495f22517e34 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Request method failure captured: Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 HTTP/1.1 Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_9fmzJKXNeZYxwF1Q0tT_jWi7rqaQl61UJH-O8wGf64gqwggUfdAw7y4-W3o2IncvLYAqw9EaGw2viS0mcqpkCzxzKbmoJ2a4vXqrCy-8JAvrpvAUqSFv0uIdxV-CJtQFGQLQKV-Zg55ogIRzS5tnNDQv2TPG0S8XRk0Yjsa2JWLac Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: X-Openstack-Nova-Api-Version: 2.42 Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 60a0b5a8d12f49ffbb7570bec11538f7 Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-435089650 Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/60a0b5a8d12f49ffbb7570bec11538f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/60a0b5a8d12f49ffbb7570bec11538f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_60a0b5a8d12f49ffbb7570bec11538f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/60a0b5a8d12f49ffbb7570bec11538f7"}]}] Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-TaggedBootDevicesTest_v242-435089650 Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 60a0b5a8d12f49ffbb7570bec11538f7 Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-435089650 Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-TaggedBootDevicesTest_v242-435089650-project Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 0ed7b7928cdb49659150b9e89d86e8c8 Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-TaggedBootDevicesTest_v242-435089650-project Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 726db447-1df7-417d-a9e0-1c832e299621 could not be found. Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '726db447-1df7-417d-a9e0-1c832e299621'} Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 726db447-1df7-417d-a9e0-1c832e299621 could not be found. Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:26:15.090185 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:26:15.106158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 726db447-1df7-417d-a9e0-1c832e299621 could not be found. Aug 04 17:26:15.106158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:26:15.106158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:26:15.106158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:26:15.106158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:26:15.106158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:26:15.106158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:26:15.106158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:26:15.106158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:26:15.106158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 726db447-1df7-417d-a9e0-1c832e299621 could not be found. Aug 04 17:26:15.106158 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:26:15.106158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e2e0d89c-b906-4d68-a8c1-495f22517e34 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Returning 404 to user: Instance 726db447-1df7-417d-a9e0-1c832e299621 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:26:15.109078 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e2e0d89c-b906-4d68-a8c1-495f22517e34 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "DELETE /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 404 len: 111 microversion: 2.42 time: 0.139091 Aug 04 17:26:15.110933 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2959/5892] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Aug 4 17:26:14 2022] DELETE /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 04 17:26:15.122681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-13fe1bb9-efb6-4b82-b7e7-e483a93b5349 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:15.123333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-13fe1bb9-efb6-4b82-b7e7-e483a93b5349 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] [instance: 726db447-1df7-417d-a9e0-1c832e299621] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:15.131007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13fe1bb9-efb6-4b82-b7e7-e483a93b5349 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:15.131516 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13fe1bb9-efb6-4b82-b7e7-e483a93b5349 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:15.131971 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13fe1bb9-efb6-4b82-b7e7-e483a93b5349 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:15.132697 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13fe1bb9-efb6-4b82-b7e7-e483a93b5349 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:15.133168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13fe1bb9-efb6-4b82-b7e7-e483a93b5349 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:15.133607 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-13fe1bb9-efb6-4b82-b7e7-e483a93b5349 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:15.155300 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-13fe1bb9-efb6-4b82-b7e7-e483a93b5349 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] HTTP exception thrown: Instance 726db447-1df7-417d-a9e0-1c832e299621 could not be found. Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-13fe1bb9-efb6-4b82-b7e7-e483a93b5349 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Request method failure captured: Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 HTTP/1.1 Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi6_9fmzJKXNeZYxwF1Q0tT_jWi7rqaQl61UJH-O8wGf64gqwggUfdAw7y4-W3o2IncvLYAqw9EaGw2viS0mcqpkCzxzKbmoJ2a4vXqrCy-8JAvrpvAUqSFv0uIdxV-CJtQFGQLQKV-Zg55ogIRzS5tnNDQv2TPG0S8XRk0Yjsa2JWLac Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: X-Openstack-Nova-Api-Version: 2.42 Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 60a0b5a8d12f49ffbb7570bec11538f7 Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-435089650 Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/60a0b5a8d12f49ffbb7570bec11538f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/60a0b5a8d12f49ffbb7570bec11538f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_60a0b5a8d12f49ffbb7570bec11538f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/60a0b5a8d12f49ffbb7570bec11538f7"}]}] Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-TaggedBootDevicesTest_v242-435089650 Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 60a0b5a8d12f49ffbb7570bec11538f7 Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-435089650 Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-TaggedBootDevicesTest_v242-435089650-project Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 0ed7b7928cdb49659150b9e89d86e8c8 Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-TaggedBootDevicesTest_v242-435089650-project Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 726db447-1df7-417d-a9e0-1c832e299621 could not be found. Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '726db447-1df7-417d-a9e0-1c832e299621'} Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 726db447-1df7-417d-a9e0-1c832e299621 could not be found. Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 726db447-1df7-417d-a9e0-1c832e299621 could not be found. Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:26:15.157587 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:26:15.165816 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:26:15.165816 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:26:15.165816 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:26:15.165816 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:26:15.165816 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:26:15.165816 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:26:15.165816 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 726db447-1df7-417d-a9e0-1c832e299621 could not be found. Aug 04 17:26:15.165816 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:26:15.165816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-13fe1bb9-efb6-4b82-b7e7-e483a93b5349 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] Returning 404 to user: Instance 726db447-1df7-417d-a9e0-1c832e299621 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:26:15.165816 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-13fe1bb9-efb6-4b82-b7e7-e483a93b5349 tempest-TaggedBootDevicesTest_v242-435089650 tempest-TaggedBootDevicesTest_v242-435089650-project] 10.222.0.93 "GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621" status: 404 len: 111 microversion: 2.42 time: 0.042348 Aug 04 17:26:15.165816 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2960/5893] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:26:15 2022] GET /compute/v2.1/servers/726db447-1df7-417d-a9e0-1c832e299621 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:26:17.625391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-15cb8d6e-01e7-4765-9d53-26d35229d925 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:26:17.628314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-15cb8d6e-01e7-4765-9d53-26d35229d925 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:26:17.629412 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-15cb8d6e-01e7-4765-9d53-26d35229d925 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:26:17.630114 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-15cb8d6e-01e7-4765-9d53-26d35229d925 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:26:17.630831 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-15cb8d6e-01e7-4765-9d53-26d35229d925 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:26:17.674276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15cb8d6e-01e7-4765-9d53-26d35229d925 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:17.678163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15cb8d6e-01e7-4765-9d53-26d35229d925 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:17.696932 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15cb8d6e-01e7-4765-9d53-26d35229d925 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:17.698965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15cb8d6e-01e7-4765-9d53-26d35229d925 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:17.700454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15cb8d6e-01e7-4765-9d53-26d35229d925 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:17.701154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15cb8d6e-01e7-4765-9d53-26d35229d925 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:17.819390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-15cb8d6e-01e7-4765-9d53-26d35229d925 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Getting quotas for project 9c69a3e46122413f928fe20a76b0cf94. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:26:17.871418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-15cb8d6e-01e7-4765-9d53-26d35229d925 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Getting quotas for user f27a58cf36934daeabff9e35c05d4c19 and project 9c69a3e46122413f928fe20a76b0cf94. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:26:17.977134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-15cb8d6e-01e7-4765-9d53-26d35229d925 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:26:17.988792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-15cb8d6e-01e7-4765-9d53-26d35229d925 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:26:18.151613 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-15cb8d6e-01e7-4765-9d53-26d35229d925 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.874567 Aug 04 17:26:18.159952 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2934/5894] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:26:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 4886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:26:18.164187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d548c95e-7eda-4bf4-bfbf-e82da611853c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:18.164828 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d548c95e-7eda-4bf4-bfbf-e82da611853c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:18.464238 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d548c95e-7eda-4bf4-bfbf-e82da611853c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:18.474685 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d548c95e-7eda-4bf4-bfbf-e82da611853c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1266 microversion: 2.1 time: 0.314675 Aug 04 17:26:18.488000 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2961/5895] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:18 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1266 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:19.513587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f47b238f-18cf-4694-9e34-d0bef29cf8d8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:19.521967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f47b238f-18cf-4694-9e34-d0bef29cf8d8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:19.590256 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f47b238f-18cf-4694-9e34-d0bef29cf8d8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:19.591216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f47b238f-18cf-4694-9e34-d0bef29cf8d8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:19.592729 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f47b238f-18cf-4694-9e34-d0bef29cf8d8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:19.595124 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f47b238f-18cf-4694-9e34-d0bef29cf8d8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:19.596794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f47b238f-18cf-4694-9e34-d0bef29cf8d8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:19.597367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f47b238f-18cf-4694-9e34-d0bef29cf8d8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:19.808217 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f47b238f-18cf-4694-9e34-d0bef29cf8d8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:19.857464 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f47b238f-18cf-4694-9e34-d0bef29cf8d8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1270 microversion: 2.1 time: 0.350495 Aug 04 17:26:19.861282 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2935/5896] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:19 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1270 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:20.890664 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-59670faf-42e2-486f-b2b0-3de0f94ff00b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:20.893594 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-59670faf-42e2-486f-b2b0-3de0f94ff00b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:20.919293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59670faf-42e2-486f-b2b0-3de0f94ff00b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:20.921887 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59670faf-42e2-486f-b2b0-3de0f94ff00b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:20.924797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59670faf-42e2-486f-b2b0-3de0f94ff00b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:20.926011 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59670faf-42e2-486f-b2b0-3de0f94ff00b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:20.929586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59670faf-42e2-486f-b2b0-3de0f94ff00b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:20.932441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59670faf-42e2-486f-b2b0-3de0f94ff00b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:21.326156 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-59670faf-42e2-486f-b2b0-3de0f94ff00b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:21.336056 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-59670faf-42e2-486f-b2b0-3de0f94ff00b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1324 microversion: 2.1 time: 0.449962 Aug 04 17:26:21.338694 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2962/5897] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:20 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1324 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:22.364971 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-316d4c66-ba35-4572-865a-2c165e7d23cf tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:22.365607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-316d4c66-ba35-4572-865a-2c165e7d23cf tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:22.383075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-316d4c66-ba35-4572-865a-2c165e7d23cf tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:22.385286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-316d4c66-ba35-4572-865a-2c165e7d23cf tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:22.385930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-316d4c66-ba35-4572-865a-2c165e7d23cf tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:22.388200 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-316d4c66-ba35-4572-865a-2c165e7d23cf tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:22.392154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-316d4c66-ba35-4572-865a-2c165e7d23cf tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:22.392809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-316d4c66-ba35-4572-865a-2c165e7d23cf tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:23.316567 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-316d4c66-ba35-4572-865a-2c165e7d23cf tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:23.335208 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-316d4c66-ba35-4572-865a-2c165e7d23cf tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1324 microversion: 2.1 time: 0.969307 Aug 04 17:26:23.346383 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2936/5898] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:22 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1324 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:24.361082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3b98a024-cf89-483f-bcdd-695b00aea87b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:24.362335 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3b98a024-cf89-483f-bcdd-695b00aea87b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:24.387896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b98a024-cf89-483f-bcdd-695b00aea87b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:24.393513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b98a024-cf89-483f-bcdd-695b00aea87b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:24.396117 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b98a024-cf89-483f-bcdd-695b00aea87b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:24.399850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b98a024-cf89-483f-bcdd-695b00aea87b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:24.404841 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b98a024-cf89-483f-bcdd-695b00aea87b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:24.405570 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b98a024-cf89-483f-bcdd-695b00aea87b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:25.055386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3b98a024-cf89-483f-bcdd-695b00aea87b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:25.073270 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3b98a024-cf89-483f-bcdd-695b00aea87b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1324 microversion: 2.1 time: 0.716653 Aug 04 17:26:25.080418 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2963/5899] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:24 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1324 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:26.103770 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-553b82f0-6bcd-4089-8d29-2ac61587bb63 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:26.105401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-553b82f0-6bcd-4089-8d29-2ac61587bb63 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:26.122503 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-553b82f0-6bcd-4089-8d29-2ac61587bb63 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:26.123559 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-553b82f0-6bcd-4089-8d29-2ac61587bb63 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:26.127950 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-553b82f0-6bcd-4089-8d29-2ac61587bb63 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:26.130694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-553b82f0-6bcd-4089-8d29-2ac61587bb63 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:26.138563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-553b82f0-6bcd-4089-8d29-2ac61587bb63 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:26.139561 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-553b82f0-6bcd-4089-8d29-2ac61587bb63 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:27.200662 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-553b82f0-6bcd-4089-8d29-2ac61587bb63 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:27.216411 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-553b82f0-6bcd-4089-8d29-2ac61587bb63 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1392 microversion: 2.1 time: 1.119757 Aug 04 17:26:27.224139 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2937/5900] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:26 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1392 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:28.246894 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-57b8791c-21c3-425a-bbe5-813e93c04227 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:28.253003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-57b8791c-21c3-425a-bbe5-813e93c04227 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:28.277074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57b8791c-21c3-425a-bbe5-813e93c04227 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:28.287883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57b8791c-21c3-425a-bbe5-813e93c04227 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:28.288742 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57b8791c-21c3-425a-bbe5-813e93c04227 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:28.290491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57b8791c-21c3-425a-bbe5-813e93c04227 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:28.293398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57b8791c-21c3-425a-bbe5-813e93c04227 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:28.294371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57b8791c-21c3-425a-bbe5-813e93c04227 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:28.470950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:26:28.830597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-57b8791c-21c3-425a-bbe5-813e93c04227 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:28.861310 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-57b8791c-21c3-425a-bbe5-813e93c04227 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1392 microversion: 2.1 time: 0.607407 Aug 04 17:26:28.873416 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2964/5901] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:28 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1392 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:29.905054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eb659cd6-4f73-403e-a987-18d47ac4ed44 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:29.913169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eb659cd6-4f73-403e-a987-18d47ac4ed44 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:29.938234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:26:29.941275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:26:29.978229 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb659cd6-4f73-403e-a987-18d47ac4ed44 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:29.980311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb659cd6-4f73-403e-a987-18d47ac4ed44 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:29.984838 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb659cd6-4f73-403e-a987-18d47ac4ed44 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:29.989805 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb659cd6-4f73-403e-a987-18d47ac4ed44 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:30.000335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb659cd6-4f73-403e-a987-18d47ac4ed44 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:30.003325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb659cd6-4f73-403e-a987-18d47ac4ed44 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:30.937264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eb659cd6-4f73-403e-a987-18d47ac4ed44 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:30.966306 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eb659cd6-4f73-403e-a987-18d47ac4ed44 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1392 microversion: 2.1 time: 1.068309 Aug 04 17:26:30.969274 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2938/5902] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:29 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1392 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:31.994295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f90ec87c-f5b4-4e43-a82c-b1534ab017ab tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:31.994926 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f90ec87c-f5b4-4e43-a82c-b1534ab017ab tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:32.016035 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f90ec87c-f5b4-4e43-a82c-b1534ab017ab tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:32.016537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f90ec87c-f5b4-4e43-a82c-b1534ab017ab tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:32.016980 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f90ec87c-f5b4-4e43-a82c-b1534ab017ab tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:32.017705 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f90ec87c-f5b4-4e43-a82c-b1534ab017ab tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:32.029499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f90ec87c-f5b4-4e43-a82c-b1534ab017ab tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:32.031917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f90ec87c-f5b4-4e43-a82c-b1534ab017ab tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:32.732966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f90ec87c-f5b4-4e43-a82c-b1534ab017ab tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:32.755369 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f90ec87c-f5b4-4e43-a82c-b1534ab017ab tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1392 microversion: 2.1 time: 0.765872 Aug 04 17:26:32.759903 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2965/5903] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:31 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1392 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:33.565204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-8b55c6b0-907b-4cc7-b87d-53b73a41904c req-a1f3a484-271a-42f0-9ecf-b479b1320250 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b70f57ec-990e-4d48-9b15-4556171b49b0", "tag": "52d8c6ee-3fc7-4187-8788-8f6bb135633e"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:26:33.641347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8b55c6b0-907b-4cc7-b87d-53b73a41904c req-a1f3a484-271a-42f0-9ecf-b479b1320250 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:33.642943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8b55c6b0-907b-4cc7-b87d-53b73a41904c req-a1f3a484-271a-42f0-9ecf-b479b1320250 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:33.644101 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8b55c6b0-907b-4cc7-b87d-53b73a41904c req-a1f3a484-271a-42f0-9ecf-b479b1320250 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:33.678480 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-8b55c6b0-907b-4cc7-b87d-53b73a41904c req-a1f3a484-271a-42f0-9ecf-b479b1320250 service nova] Creating event network-changed:52d8c6ee-3fc7-4187-8788-8f6bb135633e for instance b70f57ec-990e-4d48-9b15-4556171b49b0 on n-h1-851359-3 Aug 04 17:26:33.701170 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-8b55c6b0-907b-4cc7-b87d-53b73a41904c req-a1f3a484-271a-42f0-9ecf-b479b1320250 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148536 Aug 04 17:26:33.702396 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2939/5904] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:26:33.782553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f134ebb0-4156-40bc-8a98-cc105acb500e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:33.783854 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f134ebb0-4156-40bc-8a98-cc105acb500e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:33.810584 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f134ebb0-4156-40bc-8a98-cc105acb500e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:33.811117 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f134ebb0-4156-40bc-8a98-cc105acb500e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:33.814038 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f134ebb0-4156-40bc-8a98-cc105acb500e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:33.814847 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f134ebb0-4156-40bc-8a98-cc105acb500e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:33.815332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f134ebb0-4156-40bc-8a98-cc105acb500e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:33.818840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f134ebb0-4156-40bc-8a98-cc105acb500e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:34.666034 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f134ebb0-4156-40bc-8a98-cc105acb500e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:34.676435 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f134ebb0-4156-40bc-8a98-cc105acb500e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1392 microversion: 2.1 time: 0.897564 Aug 04 17:26:34.690598 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2966/5905] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:33 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1392 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:35.702501 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3565ee7a-dfa9-4a45-a2bb-fb0119d2de2f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:35.704456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3565ee7a-dfa9-4a45-a2bb-fb0119d2de2f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:35.724959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3565ee7a-dfa9-4a45-a2bb-fb0119d2de2f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:35.726394 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3565ee7a-dfa9-4a45-a2bb-fb0119d2de2f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:35.727852 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3565ee7a-dfa9-4a45-a2bb-fb0119d2de2f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:35.739045 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3565ee7a-dfa9-4a45-a2bb-fb0119d2de2f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:35.739988 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3565ee7a-dfa9-4a45-a2bb-fb0119d2de2f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:35.743318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3565ee7a-dfa9-4a45-a2bb-fb0119d2de2f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:37.806400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3565ee7a-dfa9-4a45-a2bb-fb0119d2de2f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:37.818262 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3565ee7a-dfa9-4a45-a2bb-fb0119d2de2f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1392 microversion: 2.1 time: 2.120440 Aug 04 17:26:37.843594 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2940/5906] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:35 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1392 bytes in 2147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:38.870214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bdd381a9-f7bb-4586-a68b-c8cdaf0312a4 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:38.870932 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bdd381a9-f7bb-4586-a68b-c8cdaf0312a4 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:38.882122 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bdd381a9-f7bb-4586-a68b-c8cdaf0312a4 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:38.887725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bdd381a9-f7bb-4586-a68b-c8cdaf0312a4 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:38.888463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bdd381a9-f7bb-4586-a68b-c8cdaf0312a4 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:38.890804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bdd381a9-f7bb-4586-a68b-c8cdaf0312a4 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:38.892287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bdd381a9-f7bb-4586-a68b-c8cdaf0312a4 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:38.894097 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bdd381a9-f7bb-4586-a68b-c8cdaf0312a4 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:39.612359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bdd381a9-f7bb-4586-a68b-c8cdaf0312a4 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:39.630211 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bdd381a9-f7bb-4586-a68b-c8cdaf0312a4 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1392 microversion: 2.1 time: 0.757324 Aug 04 17:26:39.631280 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2967/5907] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:38 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1392 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:40.652458 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e632d4f3-af2d-4e9d-8e60-8b5747fc429c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:40.653088 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e632d4f3-af2d-4e9d-8e60-8b5747fc429c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:40.682101 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e632d4f3-af2d-4e9d-8e60-8b5747fc429c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:40.682867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e632d4f3-af2d-4e9d-8e60-8b5747fc429c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:40.687482 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e632d4f3-af2d-4e9d-8e60-8b5747fc429c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:40.691438 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e632d4f3-af2d-4e9d-8e60-8b5747fc429c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:40.692277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e632d4f3-af2d-4e9d-8e60-8b5747fc429c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:40.696465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e632d4f3-af2d-4e9d-8e60-8b5747fc429c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:41.262902 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e632d4f3-af2d-4e9d-8e60-8b5747fc429c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:41.304515 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e632d4f3-af2d-4e9d-8e60-8b5747fc429c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1392 microversion: 2.1 time: 0.651950 Aug 04 17:26:41.306951 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2941/5908] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:40 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1392 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:42.327624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-969a1e8f-7bc7-4b6c-ad8f-f1d2511c6813 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:42.328563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-969a1e8f-7bc7-4b6c-ad8f-f1d2511c6813 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:42.348533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-969a1e8f-7bc7-4b6c-ad8f-f1d2511c6813 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:42.353733 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-969a1e8f-7bc7-4b6c-ad8f-f1d2511c6813 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:42.363658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-969a1e8f-7bc7-4b6c-ad8f-f1d2511c6813 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:42.366515 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-969a1e8f-7bc7-4b6c-ad8f-f1d2511c6813 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:42.367421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-969a1e8f-7bc7-4b6c-ad8f-f1d2511c6813 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:42.368119 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-969a1e8f-7bc7-4b6c-ad8f-f1d2511c6813 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:42.793965 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-969a1e8f-7bc7-4b6c-ad8f-f1d2511c6813 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:42.807037 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-969a1e8f-7bc7-4b6c-ad8f-f1d2511c6813 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1392 microversion: 2.1 time: 0.483290 Aug 04 17:26:42.810701 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2968/5909] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:42 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1392 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:43.836228 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6b23bcfe-0f2b-4e35-928e-ebb7ce4884ca tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:43.837617 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6b23bcfe-0f2b-4e35-928e-ebb7ce4884ca tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:43.841347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:26:43.870884 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b23bcfe-0f2b-4e35-928e-ebb7ce4884ca tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:43.873193 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b23bcfe-0f2b-4e35-928e-ebb7ce4884ca tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:43.873950 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b23bcfe-0f2b-4e35-928e-ebb7ce4884ca tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:43.878367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b23bcfe-0f2b-4e35-928e-ebb7ce4884ca tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:43.879649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b23bcfe-0f2b-4e35-928e-ebb7ce4884ca tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:43.882505 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b23bcfe-0f2b-4e35-928e-ebb7ce4884ca tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:43.891817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=41 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:26:44.525869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6b23bcfe-0f2b-4e35-928e-ebb7ce4884ca tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:44.543697 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6b23bcfe-0f2b-4e35-928e-ebb7ce4884ca tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1392 microversion: 2.1 time: 0.714080 Aug 04 17:26:44.547719 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2942/5910] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:43 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1392 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:45.571894 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b223f2f3-1c09-41cd-ae80-5d7e3ebb1c67 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:45.572892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b223f2f3-1c09-41cd-ae80-5d7e3ebb1c67 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:45.599156 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=23 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:26:45.606451 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b223f2f3-1c09-41cd-ae80-5d7e3ebb1c67 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:45.609183 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b223f2f3-1c09-41cd-ae80-5d7e3ebb1c67 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:45.609669 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b223f2f3-1c09-41cd-ae80-5d7e3ebb1c67 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:45.610450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b223f2f3-1c09-41cd-ae80-5d7e3ebb1c67 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:45.617410 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b223f2f3-1c09-41cd-ae80-5d7e3ebb1c67 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:45.619762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b223f2f3-1c09-41cd-ae80-5d7e3ebb1c67 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:45.640108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=47 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:26:46.068252 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b223f2f3-1c09-41cd-ae80-5d7e3ebb1c67 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:46.080342 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b223f2f3-1c09-41cd-ae80-5d7e3ebb1c67 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1392 microversion: 2.1 time: 0.514132 Aug 04 17:26:46.081385 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2969/5911] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:45 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1392 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:26:46.165018 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-a3ac251d-cbca-489e-a48e-a94a8975ef0b req-3c892ad8-1e46-4989-b4d1-34ed72e741a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b70f57ec-990e-4d48-9b15-4556171b49b0", "name": "network-vif-plugged", "status": "completed", "tag": "52d8c6ee-3fc7-4187-8788-8f6bb135633e"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:26:46.193285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a3ac251d-cbca-489e-a48e-a94a8975ef0b req-3c892ad8-1e46-4989-b4d1-34ed72e741a5 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:46.204131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a3ac251d-cbca-489e-a48e-a94a8975ef0b req-3c892ad8-1e46-4989-b4d1-34ed72e741a5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:46.208756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a3ac251d-cbca-489e-a48e-a94a8975ef0b req-3c892ad8-1e46-4989-b4d1-34ed72e741a5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:46.272595 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-a3ac251d-cbca-489e-a48e-a94a8975ef0b req-3c892ad8-1e46-4989-b4d1-34ed72e741a5 service nova] Creating event network-vif-plugged:52d8c6ee-3fc7-4187-8788-8f6bb135633e for instance b70f57ec-990e-4d48-9b15-4556171b49b0 on n-h1-851359-3 Aug 04 17:26:46.292195 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-a3ac251d-cbca-489e-a48e-a94a8975ef0b req-3c892ad8-1e46-4989-b4d1-34ed72e741a5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131662 Aug 04 17:26:46.292825 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2943/5912] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:26:47.109953 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6242a2b3-a2ac-4348-837e-74798d519206 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:47.112558 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6242a2b3-a2ac-4348-837e-74798d519206 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:47.121990 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6242a2b3-a2ac-4348-837e-74798d519206 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:47.122941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6242a2b3-a2ac-4348-837e-74798d519206 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:47.123646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6242a2b3-a2ac-4348-837e-74798d519206 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:47.124748 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6242a2b3-a2ac-4348-837e-74798d519206 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:47.125470 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6242a2b3-a2ac-4348-837e-74798d519206 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:47.126262 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6242a2b3-a2ac-4348-837e-74798d519206 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:47.862218 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6242a2b3-a2ac-4348-837e-74798d519206 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:47.875663 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6242a2b3-a2ac-4348-837e-74798d519206 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1392 microversion: 2.1 time: 0.771877 Aug 04 17:26:47.876800 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2970/5913] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:47 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1392 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:48.905724 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a4690561-7cd6-435a-9cbb-e46a905c1a9c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:48.918093 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a4690561-7cd6-435a-9cbb-e46a905c1a9c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:48.952880 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4690561-7cd6-435a-9cbb-e46a905c1a9c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:48.954317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4690561-7cd6-435a-9cbb-e46a905c1a9c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:48.955870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4690561-7cd6-435a-9cbb-e46a905c1a9c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:48.958183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4690561-7cd6-435a-9cbb-e46a905c1a9c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:48.959021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4690561-7cd6-435a-9cbb-e46a905c1a9c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:48.960375 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4690561-7cd6-435a-9cbb-e46a905c1a9c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:50.059721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a4690561-7cd6-435a-9cbb-e46a905c1a9c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:50.078267 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a4690561-7cd6-435a-9cbb-e46a905c1a9c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1563 microversion: 2.1 time: 1.178250 Aug 04 17:26:50.092663 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2944/5914] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:48 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1563 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:50.109310 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c8f3bcac-fee7-4bd7-901f-9500c52c22af tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:50.110793 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c8f3bcac-fee7-4bd7-901f-9500c52c22af tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:50.132376 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8f3bcac-fee7-4bd7-901f-9500c52c22af tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:50.134434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8f3bcac-fee7-4bd7-901f-9500c52c22af tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:50.135225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8f3bcac-fee7-4bd7-901f-9500c52c22af tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:50.136336 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8f3bcac-fee7-4bd7-901f-9500c52c22af tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:50.136983 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8f3bcac-fee7-4bd7-901f-9500c52c22af tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:50.137676 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8f3bcac-fee7-4bd7-901f-9500c52c22af tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:50.950051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c8f3bcac-fee7-4bd7-901f-9500c52c22af tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:26:50.981758 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c8f3bcac-fee7-4bd7-901f-9500c52c22af tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1563 microversion: 2.1 time: 0.876038 Aug 04 17:26:50.993352 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2971/5915] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:50 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1563 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:26:59.446977 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f01fcf2a-e1f5-449c-9474-e42a2a1b08a5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:26:59.447839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f01fcf2a-e1f5-449c-9474-e42a2a1b08a5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:26:59.460738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-a1a96f2c-3595-46f6-9e93-ef39a165f5f5 req-f970c7e7-f198-4dde-8a2e-047bdda1f380 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b70f57ec-990e-4d48-9b15-4556171b49b0", "tag": "52d8c6ee-3fc7-4187-8788-8f6bb135633e"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:26:59.484518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=5 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:26:59.500295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f01fcf2a-e1f5-449c-9474-e42a2a1b08a5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:59.504488 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f01fcf2a-e1f5-449c-9474-e42a2a1b08a5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:59.505287 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f01fcf2a-e1f5-449c-9474-e42a2a1b08a5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:59.506918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f01fcf2a-e1f5-449c-9474-e42a2a1b08a5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:59.507385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a1a96f2c-3595-46f6-9e93-ef39a165f5f5 req-f970c7e7-f198-4dde-8a2e-047bdda1f380 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:26:59.508359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a1a96f2c-3595-46f6-9e93-ef39a165f5f5 req-f970c7e7-f198-4dde-8a2e-047bdda1f380 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:59.509219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f01fcf2a-e1f5-449c-9474-e42a2a1b08a5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:26:59.509866 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a1a96f2c-3595-46f6-9e93-ef39a165f5f5 req-f970c7e7-f198-4dde-8a2e-047bdda1f380 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:59.510542 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f01fcf2a-e1f5-449c-9474-e42a2a1b08a5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:26:59.570991 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-a1a96f2c-3595-46f6-9e93-ef39a165f5f5 req-f970c7e7-f198-4dde-8a2e-047bdda1f380 service nova] Creating event network-changed:52d8c6ee-3fc7-4187-8788-8f6bb135633e for instance b70f57ec-990e-4d48-9b15-4556171b49b0 on n-h1-851359-3 Aug 04 17:26:59.596623 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-a1a96f2c-3595-46f6-9e93-ef39a165f5f5 req-f970c7e7-f198-4dde-8a2e-047bdda1f380 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142234 Aug 04 17:26:59.597768 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2972/5916] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:27:00.973055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f01fcf2a-e1f5-449c-9474-e42a2a1b08a5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:00.983275 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f01fcf2a-e1f5-449c-9474-e42a2a1b08a5 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1563 microversion: 2.1 time: 1.541756 Aug 04 17:27:00.990439 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2945/5917] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:26:59 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1563 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:27:15.414888 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b2b3fc3e-2890-4897-93b5-3f6b801e19e8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:27:15.417292 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b2b3fc3e-2890-4897-93b5-3f6b801e19e8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:15.440927 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=7 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:27:15.445521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=19 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:27:15.460168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2b3fc3e-2890-4897-93b5-3f6b801e19e8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:15.460747 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2b3fc3e-2890-4897-93b5-3f6b801e19e8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:15.464944 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2b3fc3e-2890-4897-93b5-3f6b801e19e8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:15.471498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2b3fc3e-2890-4897-93b5-3f6b801e19e8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:15.472181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2b3fc3e-2890-4897-93b5-3f6b801e19e8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:15.472663 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b2b3fc3e-2890-4897-93b5-3f6b801e19e8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:15.620839 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b2b3fc3e-2890-4897-93b5-3f6b801e19e8 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "POST /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0/action" status: 200 len: 24572 microversion: 2.1 time: 0.211993 Aug 04 17:27:15.622010 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2973/5918] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:27:15 2022] POST /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0/action => generated 24572 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:27:26.683143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d3836dc3-c760-459c-a858-fde7ea8e243f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:27:26.692578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d3836dc3-c760-459c-a858-fde7ea8e243f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:26.704796 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:27:26.708546 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=19 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:27:26.712373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3836dc3-c760-459c-a858-fde7ea8e243f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:26.714789 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3836dc3-c760-459c-a858-fde7ea8e243f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:26.720174 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3836dc3-c760-459c-a858-fde7ea8e243f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:26.721438 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3836dc3-c760-459c-a858-fde7ea8e243f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:26.722223 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3836dc3-c760-459c-a858-fde7ea8e243f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:26.723247 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3836dc3-c760-459c-a858-fde7ea8e243f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:26.965482 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d3836dc3-c760-459c-a858-fde7ea8e243f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:27:26.969961 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d3836dc3-c760-459c-a858-fde7ea8e243f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:27:26.970729 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d3836dc3-c760-459c-a858-fde7ea8e243f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:27:26.972480 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d3836dc3-c760-459c-a858-fde7ea8e243f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:27:26.973792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d3836dc3-c760-459c-a858-fde7ea8e243f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:27:27.127497 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d3836dc3-c760-459c-a858-fde7ea8e243f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:27.134340 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3836dc3-c760-459c-a858-fde7ea8e243f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:27.134850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3836dc3-c760-459c-a858-fde7ea8e243f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:27.135322 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3836dc3-c760-459c-a858-fde7ea8e243f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:27.136086 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3836dc3-c760-459c-a858-fde7ea8e243f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:27.136554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3836dc3-c760-459c-a858-fde7ea8e243f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:27.136986 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3836dc3-c760-459c-a858-fde7ea8e243f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:27.205787 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d3836dc3-c760-459c-a858-fde7ea8e243f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "POST /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0/action" status: 202 len: 1136 microversion: 2.1 time: 0.528218 Aug 04 17:27:27.229762 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2946/5919] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:27:26 2022] POST /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0/action => generated 1136 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 17:27:27.231181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-51e2407e-0585-44cf-bfd2-ffe56be21763 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:27.233751 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-51e2407e-0585-44cf-bfd2-ffe56be21763 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:27.251676 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:27:27.261346 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=4 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:27:27.295619 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-51e2407e-0585-44cf-bfd2-ffe56be21763 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:27.305384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-51e2407e-0585-44cf-bfd2-ffe56be21763 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:27.306100 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-51e2407e-0585-44cf-bfd2-ffe56be21763 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:27.327574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-51e2407e-0585-44cf-bfd2-ffe56be21763 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:27.328425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-51e2407e-0585-44cf-bfd2-ffe56be21763 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:27.329495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-51e2407e-0585-44cf-bfd2-ffe56be21763 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:28.035692 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-51e2407e-0585-44cf-bfd2-ffe56be21763 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:28.070668 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-51e2407e-0585-44cf-bfd2-ffe56be21763 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1690 microversion: 2.1 time: 0.848510 Aug 04 17:27:28.081722 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2974/5920] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:27 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1690 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:27:29.121802 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b0df2981-14e5-4623-be80-6da4fe165b2f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:29.128162 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b0df2981-14e5-4623-be80-6da4fe165b2f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:29.183077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0df2981-14e5-4623-be80-6da4fe165b2f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:29.188707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0df2981-14e5-4623-be80-6da4fe165b2f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:29.190511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0df2981-14e5-4623-be80-6da4fe165b2f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:29.198717 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0df2981-14e5-4623-be80-6da4fe165b2f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:29.201083 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0df2981-14e5-4623-be80-6da4fe165b2f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:29.204585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0df2981-14e5-4623-be80-6da4fe165b2f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:30.201307 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b0df2981-14e5-4623-be80-6da4fe165b2f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:30.210986 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b0df2981-14e5-4623-be80-6da4fe165b2f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1690 microversion: 2.1 time: 1.104192 Aug 04 17:27:30.213903 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2947/5921] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:29 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1690 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:27:31.239190 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e8e3ac9d-d234-486e-ab4a-b45bd93c5904 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:31.240535 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e8e3ac9d-d234-486e-ab4a-b45bd93c5904 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:31.249441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8e3ac9d-d234-486e-ab4a-b45bd93c5904 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:31.250575 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8e3ac9d-d234-486e-ab4a-b45bd93c5904 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:31.251115 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8e3ac9d-d234-486e-ab4a-b45bd93c5904 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:31.252283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8e3ac9d-d234-486e-ab4a-b45bd93c5904 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:31.252931 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8e3ac9d-d234-486e-ab4a-b45bd93c5904 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:31.253762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8e3ac9d-d234-486e-ab4a-b45bd93c5904 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:32.164661 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e8e3ac9d-d234-486e-ab4a-b45bd93c5904 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:32.191128 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e8e3ac9d-d234-486e-ab4a-b45bd93c5904 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1690 microversion: 2.1 time: 0.956316 Aug 04 17:27:32.192089 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2975/5922] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:31 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1690 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:27:33.226049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ffcf1f0b-0e55-4240-b1bb-85a2f7ddaa4f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:33.226919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ffcf1f0b-0e55-4240-b1bb-85a2f7ddaa4f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:33.252420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffcf1f0b-0e55-4240-b1bb-85a2f7ddaa4f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:33.261383 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffcf1f0b-0e55-4240-b1bb-85a2f7ddaa4f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:33.265865 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffcf1f0b-0e55-4240-b1bb-85a2f7ddaa4f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:33.273630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffcf1f0b-0e55-4240-b1bb-85a2f7ddaa4f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:33.276694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffcf1f0b-0e55-4240-b1bb-85a2f7ddaa4f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:33.279321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffcf1f0b-0e55-4240-b1bb-85a2f7ddaa4f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:34.084578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ffcf1f0b-0e55-4240-b1bb-85a2f7ddaa4f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:34.097604 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ffcf1f0b-0e55-4240-b1bb-85a2f7ddaa4f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1690 microversion: 2.1 time: 0.879618 Aug 04 17:27:34.100061 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2948/5923] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:33 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1690 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:27:35.129398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ceb1f5b3-2cad-4103-8ad5-30de5aa61209 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:35.130035 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ceb1f5b3-2cad-4103-8ad5-30de5aa61209 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:35.155192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ceb1f5b3-2cad-4103-8ad5-30de5aa61209 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:35.155842 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ceb1f5b3-2cad-4103-8ad5-30de5aa61209 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:35.156316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ceb1f5b3-2cad-4103-8ad5-30de5aa61209 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:35.159744 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ceb1f5b3-2cad-4103-8ad5-30de5aa61209 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:35.160330 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ceb1f5b3-2cad-4103-8ad5-30de5aa61209 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:35.160792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ceb1f5b3-2cad-4103-8ad5-30de5aa61209 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:36.362421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ceb1f5b3-2cad-4103-8ad5-30de5aa61209 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:36.395030 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ceb1f5b3-2cad-4103-8ad5-30de5aa61209 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1690 microversion: 2.1 time: 1.258969 Aug 04 17:27:36.409617 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2976/5924] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:35 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1690 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:27:37.448213 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a8bfd14a-d2ff-4abe-b399-16f2748b424f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:37.448839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a8bfd14a-d2ff-4abe-b399-16f2748b424f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:37.483774 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8bfd14a-d2ff-4abe-b399-16f2748b424f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:37.484536 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8bfd14a-d2ff-4abe-b399-16f2748b424f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:37.485161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8bfd14a-d2ff-4abe-b399-16f2748b424f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:37.486283 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8bfd14a-d2ff-4abe-b399-16f2748b424f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:37.486968 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8bfd14a-d2ff-4abe-b399-16f2748b424f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:37.487575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8bfd14a-d2ff-4abe-b399-16f2748b424f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:37.957263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a8bfd14a-d2ff-4abe-b399-16f2748b424f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:37.971234 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a8bfd14a-d2ff-4abe-b399-16f2748b424f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1690 microversion: 2.1 time: 0.527272 Aug 04 17:27:37.977921 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2949/5925] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:37 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1690 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:27:39.011300 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7350f871-e00b-4ccc-a9e8-c82168a78e3f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:39.013374 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7350f871-e00b-4ccc-a9e8-c82168a78e3f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:39.037010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7350f871-e00b-4ccc-a9e8-c82168a78e3f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:39.037528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7350f871-e00b-4ccc-a9e8-c82168a78e3f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:39.053732 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7350f871-e00b-4ccc-a9e8-c82168a78e3f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:39.064915 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7350f871-e00b-4ccc-a9e8-c82168a78e3f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:39.065433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7350f871-e00b-4ccc-a9e8-c82168a78e3f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:39.065889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7350f871-e00b-4ccc-a9e8-c82168a78e3f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:39.642460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7350f871-e00b-4ccc-a9e8-c82168a78e3f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:39.660209 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7350f871-e00b-4ccc-a9e8-c82168a78e3f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1690 microversion: 2.1 time: 0.648360 Aug 04 17:27:39.675235 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2977/5926] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:39 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1690 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:27:40.711465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5dcb5df6-4d7c-487d-b8a3-17b76b5c21dd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:40.712030 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5dcb5df6-4d7c-487d-b8a3-17b76b5c21dd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:40.727439 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5dcb5df6-4d7c-487d-b8a3-17b76b5c21dd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:40.727943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5dcb5df6-4d7c-487d-b8a3-17b76b5c21dd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:40.728390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5dcb5df6-4d7c-487d-b8a3-17b76b5c21dd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:40.729116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5dcb5df6-4d7c-487d-b8a3-17b76b5c21dd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:40.741122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5dcb5df6-4d7c-487d-b8a3-17b76b5c21dd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:40.741705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5dcb5df6-4d7c-487d-b8a3-17b76b5c21dd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:41.493144 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5dcb5df6-4d7c-487d-b8a3-17b76b5c21dd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:41.505024 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5dcb5df6-4d7c-487d-b8a3-17b76b5c21dd tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1690 microversion: 2.1 time: 0.798818 Aug 04 17:27:41.505869 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2950/5927] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:40 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1690 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:27:42.534186 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7fee286c-d192-40f2-b279-827fc2112eaa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:42.536075 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7fee286c-d192-40f2-b279-827fc2112eaa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:42.556473 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7fee286c-d192-40f2-b279-827fc2112eaa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:42.556995 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7fee286c-d192-40f2-b279-827fc2112eaa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:42.557456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7fee286c-d192-40f2-b279-827fc2112eaa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:42.561664 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7fee286c-d192-40f2-b279-827fc2112eaa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:42.563382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7fee286c-d192-40f2-b279-827fc2112eaa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:42.566192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7fee286c-d192-40f2-b279-827fc2112eaa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:43.034083 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:27:43.034531 n-d-851359-3 devstack@n-api.service[131044]: Thu Aug 4 17:27:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 17:27:43.551769 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7fee286c-d192-40f2-b279-827fc2112eaa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:43.569725 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7fee286c-d192-40f2-b279-827fc2112eaa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1690 microversion: 2.1 time: 1.045444 Aug 04 17:27:43.570561 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2978/5928] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:42 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1690 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:27:44.596776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e1a22c39-80a9-4db1-978b-859b92e9b20b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:44.598328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e1a22c39-80a9-4db1-978b-859b92e9b20b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:44.623587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1a22c39-80a9-4db1-978b-859b92e9b20b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:44.627401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1a22c39-80a9-4db1-978b-859b92e9b20b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:44.629711 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1a22c39-80a9-4db1-978b-859b92e9b20b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:44.631481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1a22c39-80a9-4db1-978b-859b92e9b20b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:44.633712 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1a22c39-80a9-4db1-978b-859b92e9b20b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:44.634228 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1a22c39-80a9-4db1-978b-859b92e9b20b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:45.178809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e1a22c39-80a9-4db1-978b-859b92e9b20b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:45.195325 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e1a22c39-80a9-4db1-978b-859b92e9b20b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1696 microversion: 2.1 time: 0.603819 Aug 04 17:27:45.198222 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2951/5929] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:44 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1696 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:27:46.230253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dd4afaf4-fb61-4c5f-aa16-ceae2442d03b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:46.230253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dd4afaf4-fb61-4c5f-aa16-ceae2442d03b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:46.250890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd4afaf4-fb61-4c5f-aa16-ceae2442d03b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:46.251431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd4afaf4-fb61-4c5f-aa16-ceae2442d03b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:46.251897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd4afaf4-fb61-4c5f-aa16-ceae2442d03b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:46.254306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd4afaf4-fb61-4c5f-aa16-ceae2442d03b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:46.256040 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd4afaf4-fb61-4c5f-aa16-ceae2442d03b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:46.256535 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd4afaf4-fb61-4c5f-aa16-ceae2442d03b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:46.708079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dd4afaf4-fb61-4c5f-aa16-ceae2442d03b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:46.724154 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dd4afaf4-fb61-4c5f-aa16-ceae2442d03b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1696 microversion: 2.1 time: 0.504856 Aug 04 17:27:46.741783 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2979/5930] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:46 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1696 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:27:47.759681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-72d1a795-c12a-49f3-9564-340e4df9600b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:47.760892 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-72d1a795-c12a-49f3-9564-340e4df9600b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:47.775389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72d1a795-c12a-49f3-9564-340e4df9600b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:47.777284 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72d1a795-c12a-49f3-9564-340e4df9600b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:47.779474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72d1a795-c12a-49f3-9564-340e4df9600b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:47.781020 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72d1a795-c12a-49f3-9564-340e4df9600b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:47.782847 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72d1a795-c12a-49f3-9564-340e4df9600b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:47.783500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72d1a795-c12a-49f3-9564-340e4df9600b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:48.552316 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-72d1a795-c12a-49f3-9564-340e4df9600b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:48.564757 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-72d1a795-c12a-49f3-9564-340e4df9600b tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1696 microversion: 2.1 time: 0.815302 Aug 04 17:27:48.566339 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2952/5931] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:47 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1696 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:27:49.605449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b90f57b7-0140-4f4e-9206-bac399f48eaa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:49.606179 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b90f57b7-0140-4f4e-9206-bac399f48eaa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:49.617378 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b90f57b7-0140-4f4e-9206-bac399f48eaa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:49.617888 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b90f57b7-0140-4f4e-9206-bac399f48eaa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:49.620151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b90f57b7-0140-4f4e-9206-bac399f48eaa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:49.620942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b90f57b7-0140-4f4e-9206-bac399f48eaa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:49.621992 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b90f57b7-0140-4f4e-9206-bac399f48eaa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:49.622455 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b90f57b7-0140-4f4e-9206-bac399f48eaa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:50.423124 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ed681824-b712-4ef9-a4f5-afc1385cb1cb tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1026700985", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "4a615c63-9daf-4606-bef8-91e3514a81bc"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:27:50.583604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-ed681824-b712-4ef9-a4f5-afc1385cb1cb tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] validate_networks() for [('4a615c63-9daf-4606-bef8-91e3514a81bc', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:27:51.051295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b90f57b7-0140-4f4e-9206-bac399f48eaa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:51.070693 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b90f57b7-0140-4f4e-9206-bac399f48eaa tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1681 microversion: 2.1 time: 1.478064 Aug 04 17:27:51.088203 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2980/5932] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:27:49 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1681 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:27:51.100619 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-703f01ba-6b72-4887-8c2a-45a50dba6800 req-3e3dd2be-533a-45a1-b5ec-961d4d77d3a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b70f57ec-990e-4d48-9b15-4556171b49b0", "name": "network-vif-unplugged", "status": "completed", "tag": "52d8c6ee-3fc7-4187-8788-8f6bb135633e"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:27:51.131047 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-703f01ba-6b72-4887-8c2a-45a50dba6800 req-3e3dd2be-533a-45a1-b5ec-961d4d77d3a6 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:51.143063 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-703f01ba-6b72-4887-8c2a-45a50dba6800 req-3e3dd2be-533a-45a1-b5ec-961d4d77d3a6 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:51.143639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-703f01ba-6b72-4887-8c2a-45a50dba6800 req-3e3dd2be-533a-45a1-b5ec-961d4d77d3a6 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:51.168882 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-703f01ba-6b72-4887-8c2a-45a50dba6800 req-3e3dd2be-533a-45a1-b5ec-961d4d77d3a6 service nova] Creating event network-vif-unplugged:52d8c6ee-3fc7-4187-8788-8f6bb135633e for instance b70f57ec-990e-4d48-9b15-4556171b49b0 on n-h1-851359-3 Aug 04 17:27:51.187136 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-703f01ba-6b72-4887-8c2a-45a50dba6800 req-3e3dd2be-533a-45a1-b5ec-961d4d77d3a6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094245 Aug 04 17:27:51.188595 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2981/5933] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:27:52.496829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-ed681824-b712-4ef9-a4f5-afc1385cb1cb tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:27:52.497404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-ed681824-b712-4ef9-a4f5-afc1385cb1cb tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:27:52.498816 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-ed681824-b712-4ef9-a4f5-afc1385cb1cb tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:27:52.499395 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-ed681824-b712-4ef9-a4f5-afc1385cb1cb tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:27:52.500584 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-ed681824-b712-4ef9-a4f5-afc1385cb1cb tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:27:52.564623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed681824-b712-4ef9-a4f5-afc1385cb1cb tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:52.565395 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed681824-b712-4ef9-a4f5-afc1385cb1cb tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:52.565868 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed681824-b712-4ef9-a4f5-afc1385cb1cb tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:52.568907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed681824-b712-4ef9-a4f5-afc1385cb1cb tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:52.569420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed681824-b712-4ef9-a4f5-afc1385cb1cb tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:52.569874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed681824-b712-4ef9-a4f5-afc1385cb1cb tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:52.605080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-ed681824-b712-4ef9-a4f5-afc1385cb1cb tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Getting quotas for project 9a3c9e49cbad4273ac336a42abc770bb. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:27:52.614961 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-ed681824-b712-4ef9-a4f5-afc1385cb1cb tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Getting quotas for user 1454987721d2462ab54f7a62c0ca26c9 and project 9a3c9e49cbad4273ac336a42abc770bb. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:27:52.633360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ed681824-b712-4ef9-a4f5-afc1385cb1cb tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:27:52.637934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ed681824-b712-4ef9-a4f5-afc1385cb1cb tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] [instance: 520a70a2-7301-4874-a01a-6516dafb7834] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:27:52.722511 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ed681824-b712-4ef9-a4f5-afc1385cb1cb tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.625297 Aug 04 17:27:52.724000 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2953/5934] 10.222.0.93 () {62 vars in 1188 bytes} [Thu Aug 4 17:27:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2628 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 17:27:52.737445 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6eabeda3-9fa1-4505-8085-cb5008829ecd tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:52.738290 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6eabeda3-9fa1-4505-8085-cb5008829ecd tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] [instance: 520a70a2-7301-4874-a01a-6516dafb7834] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:52.874256 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6eabeda3-9fa1-4505-8085-cb5008829ecd tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:52.888541 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6eabeda3-9fa1-4505-8085-cb5008829ecd tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:52.890768 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6eabeda3-9fa1-4505-8085-cb5008829ecd tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:52.892330 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6eabeda3-9fa1-4505-8085-cb5008829ecd tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] 10.222.0.93 "GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834" status: 200 len: 1259 microversion: 2.21 time: 0.160644 Aug 04 17:27:52.893527 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2982/5935] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:27:52 2022] GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:27:53.925602 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3133f005-6d93-48c9-98e1-eed714950c54 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:53.926750 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3133f005-6d93-48c9-98e1-eed714950c54 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] [instance: 520a70a2-7301-4874-a01a-6516dafb7834] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:54.121780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3133f005-6d93-48c9-98e1-eed714950c54 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:54.150825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3133f005-6d93-48c9-98e1-eed714950c54 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:54.159290 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3133f005-6d93-48c9-98e1-eed714950c54 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:54.164283 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3133f005-6d93-48c9-98e1-eed714950c54 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] 10.222.0.93 "GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834" status: 200 len: 1259 microversion: 2.21 time: 0.243814 Aug 04 17:27:54.167332 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2954/5936] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:27:53 2022] GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834 => generated 1259 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:27:55.207505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-aaf94bed-9138-4c8a-a99d-c5b06d6eca7d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:55.208842 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-aaf94bed-9138-4c8a-a99d-c5b06d6eca7d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] [instance: 520a70a2-7301-4874-a01a-6516dafb7834] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:55.219321 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aaf94bed-9138-4c8a-a99d-c5b06d6eca7d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:55.230256 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aaf94bed-9138-4c8a-a99d-c5b06d6eca7d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:55.230698 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aaf94bed-9138-4c8a-a99d-c5b06d6eca7d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:55.231838 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aaf94bed-9138-4c8a-a99d-c5b06d6eca7d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:55.232318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aaf94bed-9138-4c8a-a99d-c5b06d6eca7d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:55.234212 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aaf94bed-9138-4c8a-a99d-c5b06d6eca7d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:55.696770 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-aaf94bed-9138-4c8a-a99d-c5b06d6eca7d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:55.713554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-aaf94bed-9138-4c8a-a99d-c5b06d6eca7d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:55.715812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-aaf94bed-9138-4c8a-a99d-c5b06d6eca7d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:55.716978 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-aaf94bed-9138-4c8a-a99d-c5b06d6eca7d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] 10.222.0.93 "GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834" status: 200 len: 1311 microversion: 2.21 time: 0.513823 Aug 04 17:27:55.730055 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2983/5937] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:27:55 2022] GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834 => generated 1311 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:27:56.751174 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a580be16-5ca1-4e78-a930-5578a9209f2a tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:56.752431 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a580be16-5ca1-4e78-a930-5578a9209f2a tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] [instance: 520a70a2-7301-4874-a01a-6516dafb7834] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:56.783730 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a580be16-5ca1-4e78-a930-5578a9209f2a tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:56.784241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a580be16-5ca1-4e78-a930-5578a9209f2a tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:56.784694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a580be16-5ca1-4e78-a930-5578a9209f2a tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:56.785612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a580be16-5ca1-4e78-a930-5578a9209f2a tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:56.796608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a580be16-5ca1-4e78-a930-5578a9209f2a tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:56.797337 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a580be16-5ca1-4e78-a930-5578a9209f2a tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:56.865342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:27:57.108111 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a580be16-5ca1-4e78-a930-5578a9209f2a tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:57.117143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a580be16-5ca1-4e78-a930-5578a9209f2a tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:57.124220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a580be16-5ca1-4e78-a930-5578a9209f2a tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:57.125711 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a580be16-5ca1-4e78-a930-5578a9209f2a tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] 10.222.0.93 "GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834" status: 200 len: 1317 microversion: 2.21 time: 0.380675 Aug 04 17:27:57.126859 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2955/5938] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:27:56 2022] GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834 => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:27:57.687880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-4dc2eb01-5c38-4ed7-8bd4-06602fbd423a req-2da4f2c0-9a6a-45f7-8b2c-960f13a934de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b70f57ec-990e-4d48-9b15-4556171b49b0", "name": "network-vif-plugged", "status": "completed", "tag": "52d8c6ee-3fc7-4187-8788-8f6bb135633e"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:27:57.696086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=23 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:27:57.723867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-4dc2eb01-5c38-4ed7-8bd4-06602fbd423a req-2da4f2c0-9a6a-45f7-8b2c-960f13a934de service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:57.726773 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-4dc2eb01-5c38-4ed7-8bd4-06602fbd423a req-2da4f2c0-9a6a-45f7-8b2c-960f13a934de service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:57.732374 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-4dc2eb01-5c38-4ed7-8bd4-06602fbd423a req-2da4f2c0-9a6a-45f7-8b2c-960f13a934de service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:57.745289 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=51 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:27:57.758360 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-4dc2eb01-5c38-4ed7-8bd4-06602fbd423a req-2da4f2c0-9a6a-45f7-8b2c-960f13a934de service nova] Creating event network-vif-plugged:52d8c6ee-3fc7-4187-8788-8f6bb135633e for instance b70f57ec-990e-4d48-9b15-4556171b49b0 on n-h1-851359-3 Aug 04 17:27:57.779089 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-4dc2eb01-5c38-4ed7-8bd4-06602fbd423a req-2da4f2c0-9a6a-45f7-8b2c-960f13a934de service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097615 Aug 04 17:27:57.780442 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2984/5939] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:27:58.155970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c7a0fa52-6303-42ca-878e-c2c7d6d24afe tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:58.156691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c7a0fa52-6303-42ca-878e-c2c7d6d24afe tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] [instance: 520a70a2-7301-4874-a01a-6516dafb7834] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:58.159457 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:27:58.174508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7a0fa52-6303-42ca-878e-c2c7d6d24afe tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:58.175014 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7a0fa52-6303-42ca-878e-c2c7d6d24afe tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:58.175462 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7a0fa52-6303-42ca-878e-c2c7d6d24afe tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:58.176212 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7a0fa52-6303-42ca-878e-c2c7d6d24afe tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:58.176664 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7a0fa52-6303-42ca-878e-c2c7d6d24afe tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:58.177094 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7a0fa52-6303-42ca-878e-c2c7d6d24afe tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:58.529612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c7a0fa52-6303-42ca-878e-c2c7d6d24afe tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:58.548408 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c7a0fa52-6303-42ca-878e-c2c7d6d24afe tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:58.550725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c7a0fa52-6303-42ca-878e-c2c7d6d24afe tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:27:58.551925 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c7a0fa52-6303-42ca-878e-c2c7d6d24afe tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] 10.222.0.93 "GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834" status: 200 len: 1317 microversion: 2.21 time: 0.401450 Aug 04 17:27:58.553084 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2956/5940] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:27:58 2022] GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834 => generated 1317 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:27:59.578402 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-101d971f-b610-4e32-ae27-c9123cd38383 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:27:59.579116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-101d971f-b610-4e32-ae27-c9123cd38383 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] [instance: 520a70a2-7301-4874-a01a-6516dafb7834] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:27:59.590290 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-101d971f-b610-4e32-ae27-c9123cd38383 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:59.597328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-101d971f-b610-4e32-ae27-c9123cd38383 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:59.597805 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-101d971f-b610-4e32-ae27-c9123cd38383 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:27:59.598598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-101d971f-b610-4e32-ae27-c9123cd38383 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:27:59.599240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-101d971f-b610-4e32-ae27-c9123cd38383 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:27:59.603960 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-101d971f-b610-4e32-ae27-c9123cd38383 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:00.136277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-101d971f-b610-4e32-ae27-c9123cd38383 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:00.159428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-101d971f-b610-4e32-ae27-c9123cd38383 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:00.166449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-101d971f-b610-4e32-ae27-c9123cd38383 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:00.172836 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-101d971f-b610-4e32-ae27-c9123cd38383 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] 10.222.0.93 "GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834" status: 200 len: 1359 microversion: 2.21 time: 0.596909 Aug 04 17:28:00.173963 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2985/5941] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:27:59 2022] GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834 => generated 1359 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:28:00.685825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7dd9f2c7-5a7a-49db-b1b4-4196ec21af72 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1333314492", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "2e7f19ac-6b11-47a4-bbc6-084afb692699"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:28:00.808065 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-7dd9f2c7-5a7a-49db-b1b4-4196ec21af72 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] validate_networks() for [('2e7f19ac-6b11-47a4-bbc6-084afb692699', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:28:01.197429 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b9a28421-15cb-4567-a782-af3f5c2bb817 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:01.198684 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b9a28421-15cb-4567-a782-af3f5c2bb817 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] [instance: 520a70a2-7301-4874-a01a-6516dafb7834] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:01.216397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9a28421-15cb-4567-a782-af3f5c2bb817 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:01.216912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9a28421-15cb-4567-a782-af3f5c2bb817 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:01.217369 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9a28421-15cb-4567-a782-af3f5c2bb817 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:01.220525 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9a28421-15cb-4567-a782-af3f5c2bb817 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:01.222442 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9a28421-15cb-4567-a782-af3f5c2bb817 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:01.222928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9a28421-15cb-4567-a782-af3f5c2bb817 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:02.077466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b9a28421-15cb-4567-a782-af3f5c2bb817 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:02.108125 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b9a28421-15cb-4567-a782-af3f5c2bb817 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:02.110487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b9a28421-15cb-4567-a782-af3f5c2bb817 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:02.111690 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b9a28421-15cb-4567-a782-af3f5c2bb817 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] 10.222.0.93 "GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834" status: 200 len: 1359 microversion: 2.21 time: 0.919388 Aug 04 17:28:02.122357 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2986/5942] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:28:01 2022] GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834 => generated 1359 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:28:02.605875 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:28:02.996886 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7dd9f2c7-5a7a-49db-b1b4-4196ec21af72 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:28:02.997408 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7dd9f2c7-5a7a-49db-b1b4-4196ec21af72 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:28:02.998226 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7dd9f2c7-5a7a-49db-b1b4-4196ec21af72 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:28:02.998728 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7dd9f2c7-5a7a-49db-b1b4-4196ec21af72 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:28:02.999409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7dd9f2c7-5a7a-49db-b1b4-4196ec21af72 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:28:03.034323 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7dd9f2c7-5a7a-49db-b1b4-4196ec21af72 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:03.036941 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7dd9f2c7-5a7a-49db-b1b4-4196ec21af72 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:03.037496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7dd9f2c7-5a7a-49db-b1b4-4196ec21af72 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:03.043765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7dd9f2c7-5a7a-49db-b1b4-4196ec21af72 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:03.048603 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7dd9f2c7-5a7a-49db-b1b4-4196ec21af72 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:03.050141 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7dd9f2c7-5a7a-49db-b1b4-4196ec21af72 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:03.169242 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-326f5895-2b27-4918-a826-08457cd0a416 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:03.174533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-326f5895-2b27-4918-a826-08457cd0a416 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] [instance: 520a70a2-7301-4874-a01a-6516dafb7834] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:03.203598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:28:03.257949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-326f5895-2b27-4918-a826-08457cd0a416 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:03.259760 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-326f5895-2b27-4918-a826-08457cd0a416 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:03.262650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-326f5895-2b27-4918-a826-08457cd0a416 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:03.266811 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-326f5895-2b27-4918-a826-08457cd0a416 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:03.270378 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-326f5895-2b27-4918-a826-08457cd0a416 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:03.273032 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-326f5895-2b27-4918-a826-08457cd0a416 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:03.282601 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-7dd9f2c7-5a7a-49db-b1b4-4196ec21af72 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Getting quotas for project 3d54d10773dc4305888f80908e2e3acc. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:28:03.330347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-7dd9f2c7-5a7a-49db-b1b4-4196ec21af72 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Getting quotas for user 434e7398367f4039986de5dae5c47027 and project 3d54d10773dc4305888f80908e2e3acc. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:28:03.375138 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7dd9f2c7-5a7a-49db-b1b4-4196ec21af72 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:28:03.384640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7dd9f2c7-5a7a-49db-b1b4-4196ec21af72 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:28:03.542398 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7dd9f2c7-5a7a-49db-b1b4-4196ec21af72 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.158797 Aug 04 17:28:03.553297 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2957/5943] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:28:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 3174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:28:04.425823 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-ca97eb05-0154-46bc-bf17-8654a26279f3 req-50aa0269-fff0-4fed-9dba-6adf5623063f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "520a70a2-7301-4874-a01a-6516dafb7834", "tag": "9ff37644-9eae-477f-bf00-f9bd3595f469"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:28:04.478191 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ca97eb05-0154-46bc-bf17-8654a26279f3 req-50aa0269-fff0-4fed-9dba-6adf5623063f service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:04.485884 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ca97eb05-0154-46bc-bf17-8654a26279f3 req-50aa0269-fff0-4fed-9dba-6adf5623063f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:04.485884 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ca97eb05-0154-46bc-bf17-8654a26279f3 req-50aa0269-fff0-4fed-9dba-6adf5623063f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:04.533742 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-ca97eb05-0154-46bc-bf17-8654a26279f3 req-50aa0269-fff0-4fed-9dba-6adf5623063f service nova] Creating event network-changed:9ff37644-9eae-477f-bf00-f9bd3595f469 for instance 520a70a2-7301-4874-a01a-6516dafb7834 on n-h2-851359-3 Aug 04 17:28:04.571968 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-ca97eb05-0154-46bc-bf17-8654a26279f3 req-50aa0269-fff0-4fed-9dba-6adf5623063f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.017288 Aug 04 17:28:04.593002 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2958/5944] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:28:04.629856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d90afeb7-f37d-44eb-84df-3283ca03e84f tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:04.639742 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d90afeb7-f37d-44eb-84df-3283ca03e84f tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:04.674701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-326f5895-2b27-4918-a826-08457cd0a416 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:04.688135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-326f5895-2b27-4918-a826-08457cd0a416 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:04.719085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-326f5895-2b27-4918-a826-08457cd0a416 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:04.723530 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-326f5895-2b27-4918-a826-08457cd0a416 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] 10.222.0.93 "GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834" status: 200 len: 1359 microversion: 2.21 time: 1.586044 Aug 04 17:28:04.726800 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2987/5945] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:28:03 2022] GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834 => generated 1359 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:28:05.027641 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d90afeb7-f37d-44eb-84df-3283ca03e84f tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7398367f4039986de5dae5c47027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d54d10773dc4305888f80908e2e3acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:05.037202 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d90afeb7-f37d-44eb-84df-3283ca03e84f tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657" status: 200 len: 1215 microversion: 2.1 time: 0.439244 Aug 04 17:28:05.039333 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2959/5946] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:04 2022] GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657 => generated 1215 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:05.752983 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fefea17d-0f09-4186-8f26-f490d0a8791a tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:05.755094 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fefea17d-0f09-4186-8f26-f490d0a8791a tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] [instance: 520a70a2-7301-4874-a01a-6516dafb7834] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:05.784173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fefea17d-0f09-4186-8f26-f490d0a8791a tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:05.784704 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fefea17d-0f09-4186-8f26-f490d0a8791a tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:05.785175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fefea17d-0f09-4186-8f26-f490d0a8791a tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:05.787112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fefea17d-0f09-4186-8f26-f490d0a8791a tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:05.793702 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fefea17d-0f09-4186-8f26-f490d0a8791a tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:05.796371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fefea17d-0f09-4186-8f26-f490d0a8791a tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:06.059776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-67546267-afde-45c0-8e46-66edf01e433f tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:06.060991 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-67546267-afde-45c0-8e46-66edf01e433f tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:06.084818 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-67546267-afde-45c0-8e46-66edf01e433f tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:06.085334 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-67546267-afde-45c0-8e46-66edf01e433f tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:06.085787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-67546267-afde-45c0-8e46-66edf01e433f tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:06.089846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-67546267-afde-45c0-8e46-66edf01e433f tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:06.092122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-67546267-afde-45c0-8e46-66edf01e433f tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:06.092597 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-67546267-afde-45c0-8e46-66edf01e433f tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:06.449765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-67546267-afde-45c0-8e46-66edf01e433f tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7398367f4039986de5dae5c47027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d54d10773dc4305888f80908e2e3acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:06.475761 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-67546267-afde-45c0-8e46-66edf01e433f tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657" status: 200 len: 1267 microversion: 2.1 time: 0.416621 Aug 04 17:28:06.478889 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2960/5947] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:06 2022] GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657 => generated 1267 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:06.488884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fefea17d-0f09-4186-8f26-f490d0a8791a tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:06.504298 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fefea17d-0f09-4186-8f26-f490d0a8791a tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:06.506112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fefea17d-0f09-4186-8f26-f490d0a8791a tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:06.514147 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fefea17d-0f09-4186-8f26-f490d0a8791a tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] 10.222.0.93 "GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834" status: 200 len: 1359 microversion: 2.21 time: 0.760201 Aug 04 17:28:06.515636 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2988/5948] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:28:05 2022] GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834 => generated 1359 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:28:07.497969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8bd419b3-7813-425a-9ed4-5e75d6e49207 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:07.498888 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8bd419b3-7813-425a-9ed4-5e75d6e49207 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:07.524468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8bd419b3-7813-425a-9ed4-5e75d6e49207 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:07.525361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8bd419b3-7813-425a-9ed4-5e75d6e49207 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:07.527826 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8bd419b3-7813-425a-9ed4-5e75d6e49207 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:07.539134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8bd419b3-7813-425a-9ed4-5e75d6e49207 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:07.540923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8bd419b3-7813-425a-9ed4-5e75d6e49207 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:07.544533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8bd419b3-7813-425a-9ed4-5e75d6e49207 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:07.544817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c733d9ce-513c-4d36-8a42-a8aa386fcbea tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:07.545454 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c733d9ce-513c-4d36-8a42-a8aa386fcbea tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] [instance: 520a70a2-7301-4874-a01a-6516dafb7834] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:07.560110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c733d9ce-513c-4d36-8a42-a8aa386fcbea tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:07.568104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c733d9ce-513c-4d36-8a42-a8aa386fcbea tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:07.569041 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c733d9ce-513c-4d36-8a42-a8aa386fcbea tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:07.573305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c733d9ce-513c-4d36-8a42-a8aa386fcbea tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:07.574424 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c733d9ce-513c-4d36-8a42-a8aa386fcbea tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:07.577220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c733d9ce-513c-4d36-8a42-a8aa386fcbea tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:07.941903 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8bd419b3-7813-425a-9ed4-5e75d6e49207 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7398367f4039986de5dae5c47027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d54d10773dc4305888f80908e2e3acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:07.958210 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8bd419b3-7813-425a-9ed4-5e75d6e49207 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657" status: 200 len: 1273 microversion: 2.1 time: 0.465070 Aug 04 17:28:07.977657 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2961/5949] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:07 2022] GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657 => generated 1273 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:08.049477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c733d9ce-513c-4d36-8a42-a8aa386fcbea tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:08.066773 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c733d9ce-513c-4d36-8a42-a8aa386fcbea tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:08.073216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c733d9ce-513c-4d36-8a42-a8aa386fcbea tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:08.075358 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c733d9ce-513c-4d36-8a42-a8aa386fcbea tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] 10.222.0.93 "GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834" status: 200 len: 1359 microversion: 2.21 time: 0.535632 Aug 04 17:28:08.081617 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2989/5950] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:28:07 2022] GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834 => generated 1359 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:28:08.996824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d4485fc2-98dc-45c3-864e-c4ce47911475 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:08.997457 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d4485fc2-98dc-45c3-864e-c4ce47911475 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:09.022868 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4485fc2-98dc-45c3-864e-c4ce47911475 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:09.023445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4485fc2-98dc-45c3-864e-c4ce47911475 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:09.023902 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4485fc2-98dc-45c3-864e-c4ce47911475 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:09.024707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4485fc2-98dc-45c3-864e-c4ce47911475 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:09.035150 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4485fc2-98dc-45c3-864e-c4ce47911475 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:09.035636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4485fc2-98dc-45c3-864e-c4ce47911475 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:09.113132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b8577f7e-ece6-4498-b55d-41966be344ac tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:09.113763 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b8577f7e-ece6-4498-b55d-41966be344ac tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] [instance: 520a70a2-7301-4874-a01a-6516dafb7834] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:09.138910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b8577f7e-ece6-4498-b55d-41966be344ac tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:09.141104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b8577f7e-ece6-4498-b55d-41966be344ac tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:09.144240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b8577f7e-ece6-4498-b55d-41966be344ac tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:09.147719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b8577f7e-ece6-4498-b55d-41966be344ac tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:09.148229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b8577f7e-ece6-4498-b55d-41966be344ac tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:09.162614 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b8577f7e-ece6-4498-b55d-41966be344ac tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:09.338330 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d4485fc2-98dc-45c3-864e-c4ce47911475 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7398367f4039986de5dae5c47027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d54d10773dc4305888f80908e2e3acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:09.352477 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d4485fc2-98dc-45c3-864e-c4ce47911475 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657" status: 200 len: 1273 microversion: 2.1 time: 0.361091 Aug 04 17:28:09.358281 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2962/5951] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:08 2022] GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657 => generated 1273 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:09.889227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b8577f7e-ece6-4498-b55d-41966be344ac tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:09.898723 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b8577f7e-ece6-4498-b55d-41966be344ac tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:09.906392 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b8577f7e-ece6-4498-b55d-41966be344ac tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:09.907768 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b8577f7e-ece6-4498-b55d-41966be344ac tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] 10.222.0.93 "GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834" status: 200 len: 1359 microversion: 2.21 time: 0.798786 Aug 04 17:28:09.918416 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2990/5952] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:28:09 2022] GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834 => generated 1359 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:28:10.381823 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-93695424-a2eb-4eb5-9228-3c9ca842c2d6 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:10.386355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-93695424-a2eb-4eb5-9228-3c9ca842c2d6 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:10.418954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93695424-a2eb-4eb5-9228-3c9ca842c2d6 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:10.421630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93695424-a2eb-4eb5-9228-3c9ca842c2d6 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:10.423465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93695424-a2eb-4eb5-9228-3c9ca842c2d6 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:10.429618 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93695424-a2eb-4eb5-9228-3c9ca842c2d6 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:10.431490 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93695424-a2eb-4eb5-9228-3c9ca842c2d6 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:10.433890 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93695424-a2eb-4eb5-9228-3c9ca842c2d6 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:10.940684 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e8a10723-f0d7-4ae5-9123-4b37edc9e62f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:10.941936 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e8a10723-f0d7-4ae5-9123-4b37edc9e62f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] [instance: 520a70a2-7301-4874-a01a-6516dafb7834] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:10.970293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8a10723-f0d7-4ae5-9123-4b37edc9e62f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:10.970809 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8a10723-f0d7-4ae5-9123-4b37edc9e62f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:10.971263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8a10723-f0d7-4ae5-9123-4b37edc9e62f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:10.987396 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8a10723-f0d7-4ae5-9123-4b37edc9e62f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:10.992171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8a10723-f0d7-4ae5-9123-4b37edc9e62f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:10.999393 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8a10723-f0d7-4ae5-9123-4b37edc9e62f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:11.576806 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-93695424-a2eb-4eb5-9228-3c9ca842c2d6 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7398367f4039986de5dae5c47027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d54d10773dc4305888f80908e2e3acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:11.591131 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-93695424-a2eb-4eb5-9228-3c9ca842c2d6 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657" status: 200 len: 1315 microversion: 2.1 time: 1.210521 Aug 04 17:28:11.592460 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2963/5953] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:10 2022] GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657 => generated 1315 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:11.837285 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e8a10723-f0d7-4ae5-9123-4b37edc9e62f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:11.859970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e8a10723-f0d7-4ae5-9123-4b37edc9e62f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:11.869210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e8a10723-f0d7-4ae5-9123-4b37edc9e62f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:11.872604 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e8a10723-f0d7-4ae5-9123-4b37edc9e62f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] 10.222.0.93 "GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834" status: 200 len: 1359 microversion: 2.21 time: 0.939878 Aug 04 17:28:11.893773 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2991/5954] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:28:10 2022] GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834 => generated 1359 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:28:12.614735 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-733a4d21-b8c2-489d-beb2-da81ff4efde1 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:12.615538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-733a4d21-b8c2-489d-beb2-da81ff4efde1 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:12.651129 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-733a4d21-b8c2-489d-beb2-da81ff4efde1 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:12.656549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-733a4d21-b8c2-489d-beb2-da81ff4efde1 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:12.663639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-733a4d21-b8c2-489d-beb2-da81ff4efde1 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:12.677035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-733a4d21-b8c2-489d-beb2-da81ff4efde1 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:12.682873 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-733a4d21-b8c2-489d-beb2-da81ff4efde1 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:12.684387 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-733a4d21-b8c2-489d-beb2-da81ff4efde1 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:12.899313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5914c619-f859-47ce-b44a-60eb1e6bb09f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:12.900568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5914c619-f859-47ce-b44a-60eb1e6bb09f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] [instance: 520a70a2-7301-4874-a01a-6516dafb7834] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:12.922277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5914c619-f859-47ce-b44a-60eb1e6bb09f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:12.923197 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5914c619-f859-47ce-b44a-60eb1e6bb09f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:12.923731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5914c619-f859-47ce-b44a-60eb1e6bb09f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:12.924598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5914c619-f859-47ce-b44a-60eb1e6bb09f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:12.932705 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5914c619-f859-47ce-b44a-60eb1e6bb09f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:12.933235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5914c619-f859-47ce-b44a-60eb1e6bb09f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:13.123625 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:28:13.139872 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-733a4d21-b8c2-489d-beb2-da81ff4efde1 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7398367f4039986de5dae5c47027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d54d10773dc4305888f80908e2e3acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:13.151465 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-733a4d21-b8c2-489d-beb2-da81ff4efde1 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657" status: 200 len: 1315 microversion: 2.1 time: 0.541019 Aug 04 17:28:13.152684 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2964/5955] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:12 2022] GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657 => generated 1315 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:13.311554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5914c619-f859-47ce-b44a-60eb1e6bb09f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:13.328567 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5914c619-f859-47ce-b44a-60eb1e6bb09f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:13.330851 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5914c619-f859-47ce-b44a-60eb1e6bb09f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:13.340256 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5914c619-f859-47ce-b44a-60eb1e6bb09f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] 10.222.0.93 "GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834" status: 200 len: 1359 microversion: 2.21 time: 0.445472 Aug 04 17:28:13.340830 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2992/5956] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:28:12 2022] GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834 => generated 1359 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:28:14.172925 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-18dd13ae-606b-4963-8589-015016ac968d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:14.174326 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-18dd13ae-606b-4963-8589-015016ac968d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:14.188769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18dd13ae-606b-4963-8589-015016ac968d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:14.189479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18dd13ae-606b-4963-8589-015016ac968d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:14.190148 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18dd13ae-606b-4963-8589-015016ac968d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:14.191063 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18dd13ae-606b-4963-8589-015016ac968d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:14.194007 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18dd13ae-606b-4963-8589-015016ac968d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:14.194671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18dd13ae-606b-4963-8589-015016ac968d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:14.367092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-413e7c9e-bee2-4574-98fd-f8f4fe9cc00d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:14.367800 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-413e7c9e-bee2-4574-98fd-f8f4fe9cc00d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] [instance: 520a70a2-7301-4874-a01a-6516dafb7834] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:14.378790 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-413e7c9e-bee2-4574-98fd-f8f4fe9cc00d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:14.379303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-413e7c9e-bee2-4574-98fd-f8f4fe9cc00d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:14.379761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-413e7c9e-bee2-4574-98fd-f8f4fe9cc00d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:14.380504 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-413e7c9e-bee2-4574-98fd-f8f4fe9cc00d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:14.380976 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-413e7c9e-bee2-4574-98fd-f8f4fe9cc00d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:14.381416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-413e7c9e-bee2-4574-98fd-f8f4fe9cc00d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:15.034593 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=16 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:28:15.217250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-413e7c9e-bee2-4574-98fd-f8f4fe9cc00d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:15.227870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-413e7c9e-bee2-4574-98fd-f8f4fe9cc00d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:15.229414 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-413e7c9e-bee2-4574-98fd-f8f4fe9cc00d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:15.235243 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-413e7c9e-bee2-4574-98fd-f8f4fe9cc00d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] 10.222.0.93 "GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834" status: 200 len: 1359 microversion: 2.21 time: 0.872241 Aug 04 17:28:15.238945 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2993/5957] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:28:14 2022] GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834 => generated 1359 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:28:15.244371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-05f0f81f-8e1b-4ba7-ae3f-0ff10dc85e6b req-04a22772-9e0b-4137-b5a6-e58163b11771 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5727af86-68aa-4099-9a00-316085741657", "tag": "54d3a47e-0be3-4601-97f0-7f814def152f"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:28:15.264072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-05f0f81f-8e1b-4ba7-ae3f-0ff10dc85e6b req-04a22772-9e0b-4137-b5a6-e58163b11771 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:15.266575 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-05f0f81f-8e1b-4ba7-ae3f-0ff10dc85e6b req-04a22772-9e0b-4137-b5a6-e58163b11771 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:15.268314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-05f0f81f-8e1b-4ba7-ae3f-0ff10dc85e6b req-04a22772-9e0b-4137-b5a6-e58163b11771 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:15.287716 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-05f0f81f-8e1b-4ba7-ae3f-0ff10dc85e6b req-04a22772-9e0b-4137-b5a6-e58163b11771 service nova] Creating event network-changed:54d3a47e-0be3-4601-97f0-7f814def152f for instance 5727af86-68aa-4099-9a00-316085741657 on n-h1-851359-3 Aug 04 17:28:15.296071 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-05f0f81f-8e1b-4ba7-ae3f-0ff10dc85e6b req-04a22772-9e0b-4137-b5a6-e58163b11771 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055619 Aug 04 17:28:15.297191 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2994/5958] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:28:15.353494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-18dd13ae-606b-4963-8589-015016ac968d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7398367f4039986de5dae5c47027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d54d10773dc4305888f80908e2e3acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:15.365718 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-18dd13ae-606b-4963-8589-015016ac968d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657" status: 200 len: 1315 microversion: 2.1 time: 1.194078 Aug 04 17:28:15.378089 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2965/5959] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:14 2022] GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657 => generated 1315 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:15.637456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3b95e927-5e9b-4ef9-9e4c-8f27951bb86e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:28:15.642846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3b95e927-5e9b-4ef9-9e4c-8f27951bb86e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:15.685349 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b95e927-5e9b-4ef9-9e4c-8f27951bb86e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:15.687782 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b95e927-5e9b-4ef9-9e4c-8f27951bb86e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:15.689742 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b95e927-5e9b-4ef9-9e4c-8f27951bb86e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:15.693281 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b95e927-5e9b-4ef9-9e4c-8f27951bb86e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:15.694208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b95e927-5e9b-4ef9-9e4c-8f27951bb86e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:15.695611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b95e927-5e9b-4ef9-9e4c-8f27951bb86e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:16.268124 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-be79af6d-aa8d-40db-9e6b-8691d2c4e7c6 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:16.268762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-be79af6d-aa8d-40db-9e6b-8691d2c4e7c6 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] [instance: 520a70a2-7301-4874-a01a-6516dafb7834] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:16.286527 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be79af6d-aa8d-40db-9e6b-8691d2c4e7c6 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:16.287409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be79af6d-aa8d-40db-9e6b-8691d2c4e7c6 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:16.288029 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be79af6d-aa8d-40db-9e6b-8691d2c4e7c6 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:16.288954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be79af6d-aa8d-40db-9e6b-8691d2c4e7c6 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:16.289423 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be79af6d-aa8d-40db-9e6b-8691d2c4e7c6 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:16.289863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be79af6d-aa8d-40db-9e6b-8691d2c4e7c6 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:16.695888 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3b95e927-5e9b-4ef9-9e4c-8f27951bb86e tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "POST /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0/action" status: 200 len: 24570 microversion: 2.1 time: 1.066212 Aug 04 17:28:16.697567 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2995/5960] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:28:15 2022] POST /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0/action => generated 24570 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 17:28:16.710414 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e87db5d1-d3fd-4514-acd9-097dcc5d471b tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:16.715351 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e87db5d1-d3fd-4514-acd9-097dcc5d471b tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:16.732786 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e87db5d1-d3fd-4514-acd9-097dcc5d471b tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:16.736245 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e87db5d1-d3fd-4514-acd9-097dcc5d471b tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:16.736923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e87db5d1-d3fd-4514-acd9-097dcc5d471b tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:16.737692 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e87db5d1-d3fd-4514-acd9-097dcc5d471b tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:16.738204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e87db5d1-d3fd-4514-acd9-097dcc5d471b tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:16.738644 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e87db5d1-d3fd-4514-acd9-097dcc5d471b tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:17.278221 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-be79af6d-aa8d-40db-9e6b-8691d2c4e7c6 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:17.308704 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-be79af6d-aa8d-40db-9e6b-8691d2c4e7c6 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:17.316449 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-be79af6d-aa8d-40db-9e6b-8691d2c4e7c6 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:17.324356 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-be79af6d-aa8d-40db-9e6b-8691d2c4e7c6 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] 10.222.0.93 "GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834" status: 200 len: 1359 microversion: 2.21 time: 1.060269 Aug 04 17:28:17.325028 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2966/5961] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:28:16 2022] GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834 => generated 1359 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:28:17.352927 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e87db5d1-d3fd-4514-acd9-097dcc5d471b tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7398367f4039986de5dae5c47027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d54d10773dc4305888f80908e2e3acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:17.362057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-8bba5ae8-4a20-4fcd-b8e7-0305ac17f7bb req-751d7208-e662-4896-8e80-ddfe8c880fca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "520a70a2-7301-4874-a01a-6516dafb7834", "name": "network-vif-plugged", "status": "completed", "tag": "9ff37644-9eae-477f-bf00-f9bd3595f469"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:28:17.374741 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e87db5d1-d3fd-4514-acd9-097dcc5d471b tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657" status: 200 len: 1315 microversion: 2.1 time: 0.674876 Aug 04 17:28:17.390570 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2996/5962] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:16 2022] GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657 => generated 1315 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:17.420735 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8bba5ae8-4a20-4fcd-b8e7-0305ac17f7bb req-751d7208-e662-4896-8e80-ddfe8c880fca service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:17.422289 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8bba5ae8-4a20-4fcd-b8e7-0305ac17f7bb req-751d7208-e662-4896-8e80-ddfe8c880fca service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:17.423284 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8bba5ae8-4a20-4fcd-b8e7-0305ac17f7bb req-751d7208-e662-4896-8e80-ddfe8c880fca service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:17.476391 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-8bba5ae8-4a20-4fcd-b8e7-0305ac17f7bb req-751d7208-e662-4896-8e80-ddfe8c880fca service nova] Creating event network-vif-plugged:9ff37644-9eae-477f-bf00-f9bd3595f469 for instance 520a70a2-7301-4874-a01a-6516dafb7834 on n-h2-851359-3 Aug 04 17:28:17.486076 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-8bba5ae8-4a20-4fcd-b8e7-0305ac17f7bb req-751d7208-e662-4896-8e80-ddfe8c880fca service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140486 Aug 04 17:28:17.488026 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2967/5963] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:28:18.352570 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1729edf4-ec4a-4c9e-a82e-bb36ae6be165 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:18.355679 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1729edf4-ec4a-4c9e-a82e-bb36ae6be165 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] [instance: 520a70a2-7301-4874-a01a-6516dafb7834] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:18.372324 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1729edf4-ec4a-4c9e-a82e-bb36ae6be165 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:18.373096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1729edf4-ec4a-4c9e-a82e-bb36ae6be165 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:18.374759 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1729edf4-ec4a-4c9e-a82e-bb36ae6be165 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:18.375699 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1729edf4-ec4a-4c9e-a82e-bb36ae6be165 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:18.376699 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1729edf4-ec4a-4c9e-a82e-bb36ae6be165 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:18.379738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1729edf4-ec4a-4c9e-a82e-bb36ae6be165 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:18.423733 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7d3880ee-a921-44ac-a358-a189e57e9f89 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:18.424696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7d3880ee-a921-44ac-a358-a189e57e9f89 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:18.460625 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d3880ee-a921-44ac-a358-a189e57e9f89 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:18.462680 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d3880ee-a921-44ac-a358-a189e57e9f89 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:18.464962 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d3880ee-a921-44ac-a358-a189e57e9f89 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:18.467865 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d3880ee-a921-44ac-a358-a189e57e9f89 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:18.468519 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d3880ee-a921-44ac-a358-a189e57e9f89 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:18.473543 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d3880ee-a921-44ac-a358-a189e57e9f89 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:19.072614 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1729edf4-ec4a-4c9e-a82e-bb36ae6be165 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:19.091838 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1729edf4-ec4a-4c9e-a82e-bb36ae6be165 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:19.094417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1729edf4-ec4a-4c9e-a82e-bb36ae6be165 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:19.095851 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1729edf4-ec4a-4c9e-a82e-bb36ae6be165 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] 10.222.0.93 "GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834" status: 200 len: 1359 microversion: 2.21 time: 0.750838 Aug 04 17:28:19.096955 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2997/5964] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:28:18 2022] GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834 => generated 1359 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:28:19.182581 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7d3880ee-a921-44ac-a358-a189e57e9f89 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7398367f4039986de5dae5c47027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d54d10773dc4305888f80908e2e3acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:19.205398 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7d3880ee-a921-44ac-a358-a189e57e9f89 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657" status: 200 len: 1315 microversion: 2.1 time: 0.791935 Aug 04 17:28:19.208782 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2968/5965] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:18 2022] GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657 => generated 1315 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:20.122674 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1366d9b2-bcae-42b6-ad80-3e6a042d7cfa tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:20.124084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1366d9b2-bcae-42b6-ad80-3e6a042d7cfa tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] [instance: 520a70a2-7301-4874-a01a-6516dafb7834] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:20.161887 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1366d9b2-bcae-42b6-ad80-3e6a042d7cfa tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:20.165633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1366d9b2-bcae-42b6-ad80-3e6a042d7cfa tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:20.167619 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1366d9b2-bcae-42b6-ad80-3e6a042d7cfa tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:20.171040 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1366d9b2-bcae-42b6-ad80-3e6a042d7cfa tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:20.171905 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1366d9b2-bcae-42b6-ad80-3e6a042d7cfa tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:20.172771 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1366d9b2-bcae-42b6-ad80-3e6a042d7cfa tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:20.230219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4ace323b-4f6e-4c12-9332-816c890cc34e tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:20.231882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4ace323b-4f6e-4c12-9332-816c890cc34e tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:20.268412 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ace323b-4f6e-4c12-9332-816c890cc34e tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:20.276063 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ace323b-4f6e-4c12-9332-816c890cc34e tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:20.279026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ace323b-4f6e-4c12-9332-816c890cc34e tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:20.283101 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ace323b-4f6e-4c12-9332-816c890cc34e tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:20.283990 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ace323b-4f6e-4c12-9332-816c890cc34e tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:20.286773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ace323b-4f6e-4c12-9332-816c890cc34e tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:21.306196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1366d9b2-bcae-42b6-ad80-3e6a042d7cfa tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:21.326819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1366d9b2-bcae-42b6-ad80-3e6a042d7cfa tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:21.336728 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1366d9b2-bcae-42b6-ad80-3e6a042d7cfa tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:21.344604 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1366d9b2-bcae-42b6-ad80-3e6a042d7cfa tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] 10.222.0.93 "GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834" status: 200 len: 1551 microversion: 2.21 time: 1.226100 Aug 04 17:28:21.346892 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2998/5966] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:28:20 2022] GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834 => generated 1551 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:28:21.375596 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-90ba225c-19a4-4353-85ac-3531f9f7953b tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:21.376486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-90ba225c-19a4-4353-85ac-3531f9f7953b tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] [instance: 520a70a2-7301-4874-a01a-6516dafb7834] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:21.399740 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90ba225c-19a4-4353-85ac-3531f9f7953b tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:21.404139 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90ba225c-19a4-4353-85ac-3531f9f7953b tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:21.407928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90ba225c-19a4-4353-85ac-3531f9f7953b tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:21.408729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90ba225c-19a4-4353-85ac-3531f9f7953b tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:21.409235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90ba225c-19a4-4353-85ac-3531f9f7953b tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:21.409793 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90ba225c-19a4-4353-85ac-3531f9f7953b tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:21.421249 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4ace323b-4f6e-4c12-9332-816c890cc34e tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7398367f4039986de5dae5c47027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d54d10773dc4305888f80908e2e3acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:21.429496 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4ace323b-4f6e-4c12-9332-816c890cc34e tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657" status: 200 len: 1315 microversion: 2.1 time: 1.204468 Aug 04 17:28:21.430138 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2969/5967] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:20 2022] GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657 => generated 1315 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:21.474092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-90ba225c-19a4-4353-85ac-3531f9f7953b tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] [instance: 520a70a2-7301-4874-a01a-6516dafb7834] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:28:21.654994 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-90ba225c-19a4-4353-85ac-3531f9f7953b tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] 10.222.0.93 "DELETE /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834" status: 204 len: 0 microversion: 2.21 time: 0.284594 Aug 04 17:28:21.655851 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 2999/5968] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Aug 4 17:28:21 2022] DELETE /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 04 17:28:21.666687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2028fa17-c90b-4762-b7ae-b9bb6ff2ca33 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:21.668069 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2028fa17-c90b-4762-b7ae-b9bb6ff2ca33 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] [instance: 520a70a2-7301-4874-a01a-6516dafb7834] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:21.680703 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2028fa17-c90b-4762-b7ae-b9bb6ff2ca33 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:21.682934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2028fa17-c90b-4762-b7ae-b9bb6ff2ca33 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:21.684599 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2028fa17-c90b-4762-b7ae-b9bb6ff2ca33 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:21.686858 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2028fa17-c90b-4762-b7ae-b9bb6ff2ca33 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:21.688783 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2028fa17-c90b-4762-b7ae-b9bb6ff2ca33 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:21.689557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2028fa17-c90b-4762-b7ae-b9bb6ff2ca33 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:22.145181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2028fa17-c90b-4762-b7ae-b9bb6ff2ca33 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:22.170674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2028fa17-c90b-4762-b7ae-b9bb6ff2ca33 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:22.176698 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2028fa17-c90b-4762-b7ae-b9bb6ff2ca33 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:22.182323 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2028fa17-c90b-4762-b7ae-b9bb6ff2ca33 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] 10.222.0.93 "GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834" status: 200 len: 1557 microversion: 2.21 time: 0.518224 Aug 04 17:28:22.184129 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2970/5969] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:28:21 2022] GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834 => generated 1557 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:28:22.470268 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0a4ac0ad-edcc-42c9-86af-5b503c7bc8ca tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:22.472171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0a4ac0ad-edcc-42c9-86af-5b503c7bc8ca tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:22.491376 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0a4ac0ad-edcc-42c9-86af-5b503c7bc8ca tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:22.492098 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0a4ac0ad-edcc-42c9-86af-5b503c7bc8ca tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:22.492704 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0a4ac0ad-edcc-42c9-86af-5b503c7bc8ca tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:22.493929 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0a4ac0ad-edcc-42c9-86af-5b503c7bc8ca tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:22.494596 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0a4ac0ad-edcc-42c9-86af-5b503c7bc8ca tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:22.495229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0a4ac0ad-edcc-42c9-86af-5b503c7bc8ca tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:22.808053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0a4ac0ad-edcc-42c9-86af-5b503c7bc8ca tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7398367f4039986de5dae5c47027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d54d10773dc4305888f80908e2e3acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:22.811463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:28:22.827799 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0a4ac0ad-edcc-42c9-86af-5b503c7bc8ca tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657" status: 200 len: 1315 microversion: 2.1 time: 0.369077 Aug 04 17:28:22.846613 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3000/5970] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:22 2022] GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657 => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:28:23.207773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7c941bda-4678-4517-8d67-1ac08360fe0f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:23.208401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7c941bda-4678-4517-8d67-1ac08360fe0f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] [instance: 520a70a2-7301-4874-a01a-6516dafb7834] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:23.220847 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c941bda-4678-4517-8d67-1ac08360fe0f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:23.221688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c941bda-4678-4517-8d67-1ac08360fe0f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:23.223376 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c941bda-4678-4517-8d67-1ac08360fe0f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:23.225501 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c941bda-4678-4517-8d67-1ac08360fe0f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:23.227505 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c941bda-4678-4517-8d67-1ac08360fe0f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:23.228494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c941bda-4678-4517-8d67-1ac08360fe0f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:23.821932 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7c941bda-4678-4517-8d67-1ac08360fe0f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:23.839507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7c941bda-4678-4517-8d67-1ac08360fe0f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:23.841368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7c941bda-4678-4517-8d67-1ac08360fe0f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:23.842648 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7c941bda-4678-4517-8d67-1ac08360fe0f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] 10.222.0.93 "GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834" status: 200 len: 1557 microversion: 2.21 time: 0.638875 Aug 04 17:28:23.846430 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2971/5971] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:28:23 2022] GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834 => generated 1557 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:28:23.864571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5cce00c8-27a9-4d26-adc7-6a44f13d07a4 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:23.865209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5cce00c8-27a9-4d26-adc7-6a44f13d07a4 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:23.885968 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5cce00c8-27a9-4d26-adc7-6a44f13d07a4 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:23.886545 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5cce00c8-27a9-4d26-adc7-6a44f13d07a4 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:23.887007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5cce00c8-27a9-4d26-adc7-6a44f13d07a4 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:23.887755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5cce00c8-27a9-4d26-adc7-6a44f13d07a4 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:23.903244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5cce00c8-27a9-4d26-adc7-6a44f13d07a4 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:23.904002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5cce00c8-27a9-4d26-adc7-6a44f13d07a4 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:24.710249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5cce00c8-27a9-4d26-adc7-6a44f13d07a4 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7398367f4039986de5dae5c47027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d54d10773dc4305888f80908e2e3acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:24.723975 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5cce00c8-27a9-4d26-adc7-6a44f13d07a4 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657" status: 200 len: 1315 microversion: 2.1 time: 0.864262 Aug 04 17:28:24.725261 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3001/5972] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:23 2022] GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657 => generated 1315 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:24.760875 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-5657210d-0100-411d-b579-b86df4ffa5bb req-b459b1b3-5960-4875-abb9-957b46e51090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5727af86-68aa-4099-9a00-316085741657", "name": "network-vif-plugged", "status": "completed", "tag": "54d3a47e-0be3-4601-97f0-7f814def152f"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:28:24.781840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5657210d-0100-411d-b579-b86df4ffa5bb req-b459b1b3-5960-4875-abb9-957b46e51090 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:24.782737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5657210d-0100-411d-b579-b86df4ffa5bb req-b459b1b3-5960-4875-abb9-957b46e51090 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:24.783349 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5657210d-0100-411d-b579-b86df4ffa5bb req-b459b1b3-5960-4875-abb9-957b46e51090 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:24.805610 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-5657210d-0100-411d-b579-b86df4ffa5bb req-b459b1b3-5960-4875-abb9-957b46e51090 service nova] Creating event network-vif-plugged:54d3a47e-0be3-4601-97f0-7f814def152f for instance 5727af86-68aa-4099-9a00-316085741657 on n-h1-851359-3 Aug 04 17:28:24.819853 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-5657210d-0100-411d-b579-b86df4ffa5bb req-b459b1b3-5960-4875-abb9-957b46e51090 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063652 Aug 04 17:28:24.820483 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2972/5973] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:28:24.872141 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-362c6b7a-23b7-443b-aedd-f368a77caf90 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:24.872764 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-362c6b7a-23b7-443b-aedd-f368a77caf90 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] [instance: 520a70a2-7301-4874-a01a-6516dafb7834] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:24.891185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-362c6b7a-23b7-443b-aedd-f368a77caf90 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:24.892019 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-362c6b7a-23b7-443b-aedd-f368a77caf90 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:24.892653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-362c6b7a-23b7-443b-aedd-f368a77caf90 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:24.893573 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-362c6b7a-23b7-443b-aedd-f368a77caf90 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:24.894245 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-362c6b7a-23b7-443b-aedd-f368a77caf90 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:24.894883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-362c6b7a-23b7-443b-aedd-f368a77caf90 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:25.455555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-362c6b7a-23b7-443b-aedd-f368a77caf90 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:25.464480 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-362c6b7a-23b7-443b-aedd-f368a77caf90 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:25.466534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-362c6b7a-23b7-443b-aedd-f368a77caf90 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:25.468245 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-362c6b7a-23b7-443b-aedd-f368a77caf90 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] 10.222.0.93 "GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834" status: 200 len: 1557 microversion: 2.21 time: 0.600741 Aug 04 17:28:25.469087 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3002/5974] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:28:24 2022] GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834 => generated 1557 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 17:28:25.748494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3ae5bd65-ef37-43d0-a430-c1e04f6c7064 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:25.749358 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3ae5bd65-ef37-43d0-a430-c1e04f6c7064 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:25.757197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ae5bd65-ef37-43d0-a430-c1e04f6c7064 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:25.765416 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ae5bd65-ef37-43d0-a430-c1e04f6c7064 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:25.766671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ae5bd65-ef37-43d0-a430-c1e04f6c7064 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:25.767723 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ae5bd65-ef37-43d0-a430-c1e04f6c7064 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:25.768447 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ae5bd65-ef37-43d0-a430-c1e04f6c7064 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:25.769109 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ae5bd65-ef37-43d0-a430-c1e04f6c7064 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:26.185185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-1a1efb18-50aa-469b-8abb-43a0b32ba819 req-5c3d32e7-fa88-45d7-9bf1-71ba53a25ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "520a70a2-7301-4874-a01a-6516dafb7834", "name": "network-vif-deleted", "tag": "9ff37644-9eae-477f-bf00-f9bd3595f469"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:28:26.205537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1a1efb18-50aa-469b-8abb-43a0b32ba819 req-5c3d32e7-fa88-45d7-9bf1-71ba53a25ef5 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:26.206352 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1a1efb18-50aa-469b-8abb-43a0b32ba819 req-5c3d32e7-fa88-45d7-9bf1-71ba53a25ef5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:26.207604 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1a1efb18-50aa-469b-8abb-43a0b32ba819 req-5c3d32e7-fa88-45d7-9bf1-71ba53a25ef5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:26.285416 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-1a1efb18-50aa-469b-8abb-43a0b32ba819 req-5c3d32e7-fa88-45d7-9bf1-71ba53a25ef5 service nova] Creating event network-vif-deleted:9ff37644-9eae-477f-bf00-f9bd3595f469 for instance 520a70a2-7301-4874-a01a-6516dafb7834 on n-h2-851359-3 Aug 04 17:28:26.307946 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-1a1efb18-50aa-469b-8abb-43a0b32ba819 req-5c3d32e7-fa88-45d7-9bf1-71ba53a25ef5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129395 Aug 04 17:28:26.311246 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3003/5975] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:28:26.494196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fdad2326-8c72-4c33-8e23-fdc4d6e73650 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:26.495577 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fdad2326-8c72-4c33-8e23-fdc4d6e73650 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] [instance: 520a70a2-7301-4874-a01a-6516dafb7834] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:26.508350 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdad2326-8c72-4c33-8e23-fdc4d6e73650 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:26.508602 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdad2326-8c72-4c33-8e23-fdc4d6e73650 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:26.509112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdad2326-8c72-4c33-8e23-fdc4d6e73650 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:26.509904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdad2326-8c72-4c33-8e23-fdc4d6e73650 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:26.510592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdad2326-8c72-4c33-8e23-fdc4d6e73650 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:26.514602 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdad2326-8c72-4c33-8e23-fdc4d6e73650 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:26.533820 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3ae5bd65-ef37-43d0-a430-c1e04f6c7064 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7398367f4039986de5dae5c47027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d54d10773dc4305888f80908e2e3acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:26.546579 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3ae5bd65-ef37-43d0-a430-c1e04f6c7064 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657" status: 200 len: 1315 microversion: 2.1 time: 0.802970 Aug 04 17:28:26.551271 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2973/5976] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:25 2022] GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657 => generated 1315 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:26.621732 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdad2326-8c72-4c33-8e23-fdc4d6e73650 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:26.622278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdad2326-8c72-4c33-8e23-fdc4d6e73650 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:26.622724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fdad2326-8c72-4c33-8e23-fdc4d6e73650 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:26.623395 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-fdad2326-8c72-4c33-8e23-fdc4d6e73650 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lazy-loading 'fault' on Instance uuid 520a70a2-7301-4874-a01a-6516dafb7834 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:28:26.888896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fdad2326-8c72-4c33-8e23-fdc4d6e73650 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:26.931349 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fdad2326-8c72-4c33-8e23-fdc4d6e73650 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:26.939338 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fdad2326-8c72-4c33-8e23-fdc4d6e73650 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1454987721d2462ab54f7a62c0ca26c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3c9e49cbad4273ac336a42abc770bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:26.948189 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fdad2326-8c72-4c33-8e23-fdc4d6e73650 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] 10.222.0.93 "GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834" status: 200 len: 1349 microversion: 2.21 time: 0.458215 Aug 04 17:28:26.966221 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3004/5977] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:28:26 2022] GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834 => generated 1349 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 17:28:27.574970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-70186769-9754-4d8a-aa93-8abf3520180d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:27.575593 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-70186769-9754-4d8a-aa93-8abf3520180d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:27.587214 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70186769-9754-4d8a-aa93-8abf3520180d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:27.587721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70186769-9754-4d8a-aa93-8abf3520180d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:27.588177 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70186769-9754-4d8a-aa93-8abf3520180d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:27.589470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70186769-9754-4d8a-aa93-8abf3520180d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:27.589944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70186769-9754-4d8a-aa93-8abf3520180d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:27.590406 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70186769-9754-4d8a-aa93-8abf3520180d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:27.605852 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=92 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:28:27.980418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a15bee27-13a4-446f-bbba-61f39e73e69f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:27.981711 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a15bee27-13a4-446f-bbba-61f39e73e69f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] [instance: 520a70a2-7301-4874-a01a-6516dafb7834] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:27.985371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:28:27.999025 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a15bee27-13a4-446f-bbba-61f39e73e69f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:28.002646 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-70186769-9754-4d8a-aa93-8abf3520180d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7398367f4039986de5dae5c47027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d54d10773dc4305888f80908e2e3acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:28.003415 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a15bee27-13a4-446f-bbba-61f39e73e69f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:28.004070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a15bee27-13a4-446f-bbba-61f39e73e69f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:28.005060 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a15bee27-13a4-446f-bbba-61f39e73e69f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:28.005829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a15bee27-13a4-446f-bbba-61f39e73e69f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:28.006469 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a15bee27-13a4-446f-bbba-61f39e73e69f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:28.015182 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-70186769-9754-4d8a-aa93-8abf3520180d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657" status: 200 len: 1501 microversion: 2.1 time: 0.444546 Aug 04 17:28:28.031610 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2974/5978] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:27 2022] GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657 => generated 1501 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:28.043322 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-32a5936f-ea10-445f-94bd-fd2a10b81128 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:28.044219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-32a5936f-ea10-445f-94bd-fd2a10b81128 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:28.070706 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32a5936f-ea10-445f-94bd-fd2a10b81128 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:28.073638 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32a5936f-ea10-445f-94bd-fd2a10b81128 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:28.077528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32a5936f-ea10-445f-94bd-fd2a10b81128 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:28.078672 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32a5936f-ea10-445f-94bd-fd2a10b81128 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:28.081670 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32a5936f-ea10-445f-94bd-fd2a10b81128 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:28.082372 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32a5936f-ea10-445f-94bd-fd2a10b81128 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:28.089892 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-a15bee27-13a4-446f-bbba-61f39e73e69f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] HTTP exception thrown: Instance 520a70a2-7301-4874-a01a-6516dafb7834 could not be found. Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a15bee27-13a4-446f-bbba-61f39e73e69f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Request method failure captured: Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834 HTTP/1.1 Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7AGVqLwOiQzQA5fy7-7l-1lD7WEEWFPVZ7aCKuy3iUF9mhJZqm1NDKarbXsPgVIOxPZZtAN3Qs9LJB-31BjvI2fb0IzwR2UFidejM3RkOAdgP7y7TPEx6sDLQZ0Ojy-f5eLbhqVDckeH1KmeBRzMnUwtv8AmcU8Vq-k5sU-CP9IT7-Y Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: X-Openstack-Nova-Api-Version: 2.21 Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 9a3c9e49cbad4273ac336a42abc770bb Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1008739206 Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9a3c9e49cbad4273ac336a42abc770bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9a3c9e49cbad4273ac336a42abc770bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9a3c9e49cbad4273ac336a42abc770bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9a3c9e49cbad4273ac336a42abc770bb"}]}] Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-InstanceActionsV221TestJSON-1008739206 Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 9a3c9e49cbad4273ac336a42abc770bb Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1008739206 Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-InstanceActionsV221TestJSON-1008739206-project Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 1454987721d2462ab54f7a62c0ca26c9 Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-InstanceActionsV221TestJSON-1008739206-project Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 520a70a2-7301-4874-a01a-6516dafb7834 could not be found. Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '520a70a2-7301-4874-a01a-6516dafb7834'} Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 520a70a2-7301-4874-a01a-6516dafb7834 could not be found. Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 520a70a2-7301-4874-a01a-6516dafb7834 could not be found. Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:28:28.091641 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:28:28.096303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:28:28.096303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:28:28.096303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:28:28.096303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:28:28.096303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:28:28.096303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:28:28.096303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 520a70a2-7301-4874-a01a-6516dafb7834 could not be found. Aug 04 17:28:28.096303 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:28:28.096999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a15bee27-13a4-446f-bbba-61f39e73e69f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Returning 404 to user: Instance 520a70a2-7301-4874-a01a-6516dafb7834 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:28:28.098161 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a15bee27-13a4-446f-bbba-61f39e73e69f tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] 10.222.0.93 "GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834" status: 404 len: 111 microversion: 2.21 time: 0.122378 Aug 04 17:28:28.101177 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3005/5979] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:28:27 2022] GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:28:28.119307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c226a287-34ef-475e-8ba3-701214694849 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Calling method '.version_select at 0x7f1e5a8b35e0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:28.128369 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c226a287-34ef-475e-8ba3-701214694849 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] [instance: 520a70a2-7301-4874-a01a-6516dafb7834] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:28.156756 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c226a287-34ef-475e-8ba3-701214694849 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:28.158733 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c226a287-34ef-475e-8ba3-701214694849 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:28.159221 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c226a287-34ef-475e-8ba3-701214694849 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:28.160006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c226a287-34ef-475e-8ba3-701214694849 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:28.165427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c226a287-34ef-475e-8ba3-701214694849 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:28.166316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c226a287-34ef-475e-8ba3-701214694849 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:28.376816 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c226a287-34ef-475e-8ba3-701214694849 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] 10.222.0.93 "GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.269722 Aug 04 17:28:28.380267 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3006/5980] 10.222.0.93 () {60 vars in 1337 bytes} [Thu Aug 4 17:28:28 2022] GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834/os-instance-actions => generated 611 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:28:28.408744 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ba10f6dd-b5bc-4ac1-b442-5c2473efec40 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:28.409551 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ba10f6dd-b5bc-4ac1-b442-5c2473efec40 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:28.426978 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba10f6dd-b5bc-4ac1-b442-5c2473efec40 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:28.427921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba10f6dd-b5bc-4ac1-b442-5c2473efec40 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:28.428718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba10f6dd-b5bc-4ac1-b442-5c2473efec40 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:28.429724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba10f6dd-b5bc-4ac1-b442-5c2473efec40 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:28.430499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba10f6dd-b5bc-4ac1-b442-5c2473efec40 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:28.431230 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba10f6dd-b5bc-4ac1-b442-5c2473efec40 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:28.507677 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ba10f6dd-b5bc-4ac1-b442-5c2473efec40 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:28:28.705788 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ba10f6dd-b5bc-4ac1-b442-5c2473efec40 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 204 len: 0 microversion: 2.1 time: 0.323886 Aug 04 17:28:28.707067 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3007/5981] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:28:28 2022] DELETE /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:28:28.712717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-dfa274c5-0efe-42ce-b66e-bce9572bafed req-5d5b11ec-00f1-4fa9-bb50-fbcac21446fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b70f57ec-990e-4d48-9b15-4556171b49b0", "tag": "52d8c6ee-3fc7-4187-8788-8f6bb135633e"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:28:28.742433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-dfa274c5-0efe-42ce-b66e-bce9572bafed req-5d5b11ec-00f1-4fa9-bb50-fbcac21446fb service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:28.743514 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-dfa274c5-0efe-42ce-b66e-bce9572bafed req-5d5b11ec-00f1-4fa9-bb50-fbcac21446fb service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:28.744075 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-dfa274c5-0efe-42ce-b66e-bce9572bafed req-5d5b11ec-00f1-4fa9-bb50-fbcac21446fb service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:28.780952 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-dfa274c5-0efe-42ce-b66e-bce9572bafed req-5d5b11ec-00f1-4fa9-bb50-fbcac21446fb service nova] Creating event network-changed:52d8c6ee-3fc7-4187-8788-8f6bb135633e for instance b70f57ec-990e-4d48-9b15-4556171b49b0 on n-h1-851359-3 Aug 04 17:28:28.797256 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-dfa274c5-0efe-42ce-b66e-bce9572bafed req-5d5b11ec-00f1-4fa9-bb50-fbcac21446fb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088382 Aug 04 17:28:28.798545 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3008/5982] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:28:28.807204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3db00c75-df3d-4f60-88bc-d4cfad76ba9d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:28.809351 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3db00c75-df3d-4f60-88bc-d4cfad76ba9d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] [instance: 520a70a2-7301-4874-a01a-6516dafb7834] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:28.831195 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3db00c75-df3d-4f60-88bc-d4cfad76ba9d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:28.831942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3db00c75-df3d-4f60-88bc-d4cfad76ba9d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:28.832643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3db00c75-df3d-4f60-88bc-d4cfad76ba9d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:28.833675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3db00c75-df3d-4f60-88bc-d4cfad76ba9d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:28.834572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3db00c75-df3d-4f60-88bc-d4cfad76ba9d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:28.835496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3db00c75-df3d-4f60-88bc-d4cfad76ba9d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:28.874187 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-3db00c75-df3d-4f60-88bc-d4cfad76ba9d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] HTTP exception thrown: Instance 520a70a2-7301-4874-a01a-6516dafb7834 could not be found. Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3db00c75-df3d-4f60-88bc-d4cfad76ba9d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Request method failure captured: Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834 HTTP/1.1 Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7AGVqLwOiQzQA5fy7-7l-1lD7WEEWFPVZ7aCKuy3iUF9mhJZqm1NDKarbXsPgVIOxPZZtAN3Qs9LJB-31BjvI2fb0IzwR2UFidejM3RkOAdgP7y7TPEx6sDLQZ0Ojy-f5eLbhqVDckeH1KmeBRzMnUwtv8AmcU8Vq-k5sU-CP9IT7-Y Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: X-Openstack-Nova-Api-Version: 2.21 Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 9a3c9e49cbad4273ac336a42abc770bb Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1008739206 Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9a3c9e49cbad4273ac336a42abc770bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9a3c9e49cbad4273ac336a42abc770bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9a3c9e49cbad4273ac336a42abc770bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9a3c9e49cbad4273ac336a42abc770bb"}]}] Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-InstanceActionsV221TestJSON-1008739206 Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 9a3c9e49cbad4273ac336a42abc770bb Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1008739206 Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-InstanceActionsV221TestJSON-1008739206-project Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 1454987721d2462ab54f7a62c0ca26c9 Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-InstanceActionsV221TestJSON-1008739206-project Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 520a70a2-7301-4874-a01a-6516dafb7834 could not be found. Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '520a70a2-7301-4874-a01a-6516dafb7834'} Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 520a70a2-7301-4874-a01a-6516dafb7834 could not be found. Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:28:28.876210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:28:28.881049 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 520a70a2-7301-4874-a01a-6516dafb7834 could not be found. Aug 04 17:28:28.881049 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:28:28.881049 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:28:28.881049 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:28:28.881049 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:28:28.881049 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:28:28.881049 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:28:28.881049 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:28:28.881049 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:28:28.881049 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 520a70a2-7301-4874-a01a-6516dafb7834 could not be found. Aug 04 17:28:28.881049 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:28:28.886558 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3db00c75-df3d-4f60-88bc-d4cfad76ba9d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Returning 404 to user: Instance 520a70a2-7301-4874-a01a-6516dafb7834 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:28:28.889249 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3db00c75-df3d-4f60-88bc-d4cfad76ba9d tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] 10.222.0.93 "DELETE /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834" status: 404 len: 111 microversion: 2.21 time: 0.089456 Aug 04 17:28:28.894811 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3009/5983] 10.222.0.93 () {60 vars in 1280 bytes} [Thu Aug 4 17:28:28 2022] DELETE /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:28:28.906660 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-78372dc1-3fdb-451f-a594-a72383dc7e25 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:28.914755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-78372dc1-3fdb-451f-a594-a72383dc7e25 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:28.931237 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78372dc1-3fdb-451f-a594-a72383dc7e25 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:28.931965 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78372dc1-3fdb-451f-a594-a72383dc7e25 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:28.933156 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78372dc1-3fdb-451f-a594-a72383dc7e25 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:28.934262 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78372dc1-3fdb-451f-a594-a72383dc7e25 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:28.935061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78372dc1-3fdb-451f-a594-a72383dc7e25 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:28.935666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78372dc1-3fdb-451f-a594-a72383dc7e25 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:29.035331 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-32a5936f-ea10-445f-94bd-fd2a10b81128 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7398367f4039986de5dae5c47027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d54d10773dc4305888f80908e2e3acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:29.045094 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-32a5936f-ea10-445f-94bd-fd2a10b81128 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657" status: 200 len: 1501 microversion: 2.1 time: 1.009497 Aug 04 17:28:29.062937 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2975/5984] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:28 2022] GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657 => generated 1501 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:29.072197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5c6a8e1e-48d6-415c-a53b-1e36a471e510 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:29.073157 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5c6a8e1e-48d6-415c-a53b-1e36a471e510 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] [instance: 520a70a2-7301-4874-a01a-6516dafb7834] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:29.088579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:28:29.090195 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c6a8e1e-48d6-415c-a53b-1e36a471e510 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:29.090724 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c6a8e1e-48d6-415c-a53b-1e36a471e510 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:29.095742 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c6a8e1e-48d6-415c-a53b-1e36a471e510 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:29.098907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c6a8e1e-48d6-415c-a53b-1e36a471e510 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:29.099407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c6a8e1e-48d6-415c-a53b-1e36a471e510 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:29.101829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c6a8e1e-48d6-415c-a53b-1e36a471e510 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:29.150407 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-5c6a8e1e-48d6-415c-a53b-1e36a471e510 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] HTTP exception thrown: Instance 520a70a2-7301-4874-a01a-6516dafb7834 could not be found. Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5c6a8e1e-48d6-415c-a53b-1e36a471e510 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Request method failure captured: Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834 HTTP/1.1 Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AGVqLwOiQzQA5fy7-7l-1lD7WEEWFPVZ7aCKuy3iUF9mhJZqm1NDKarbXsPgVIOxPZZtAN3Qs9LJB-31BjvI2fb0IzwR2UFidejM3RkOAdgP7y7TPEx6sDLQZ0Ojy-f5eLbhqVDckeH1KmeBRzMnUwtv8AmcU8Vq-k5sU-CP9IT7-Y Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.21 Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 9a3c9e49cbad4273ac336a42abc770bb Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1008739206 Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9a3c9e49cbad4273ac336a42abc770bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9a3c9e49cbad4273ac336a42abc770bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9a3c9e49cbad4273ac336a42abc770bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9a3c9e49cbad4273ac336a42abc770bb"}]}] Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-InstanceActionsV221TestJSON-1008739206 Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 9a3c9e49cbad4273ac336a42abc770bb Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1008739206 Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-InstanceActionsV221TestJSON-1008739206-project Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 1454987721d2462ab54f7a62c0ca26c9 Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-InstanceActionsV221TestJSON-1008739206-project Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 520a70a2-7301-4874-a01a-6516dafb7834 could not be found. Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '520a70a2-7301-4874-a01a-6516dafb7834'} Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 520a70a2-7301-4874-a01a-6516dafb7834 could not be found. Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 520a70a2-7301-4874-a01a-6516dafb7834 could not be found. Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:28:29.154342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:28:29.158433 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:28:29.158433 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:28:29.158433 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:28:29.158433 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:28:29.158433 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:28:29.158433 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:28:29.158433 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 520a70a2-7301-4874-a01a-6516dafb7834 could not be found. Aug 04 17:28:29.158433 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:28:29.167861 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5c6a8e1e-48d6-415c-a53b-1e36a471e510 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] Returning 404 to user: Instance 520a70a2-7301-4874-a01a-6516dafb7834 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:28:29.169064 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5c6a8e1e-48d6-415c-a53b-1e36a471e510 tempest-InstanceActionsV221TestJSON-1008739206 tempest-InstanceActionsV221TestJSON-1008739206-project] 10.222.0.93 "GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834" status: 404 len: 111 microversion: 2.21 time: 0.104987 Aug 04 17:28:29.172121 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2976/5985] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Aug 4 17:28:29 2022] GET /compute/v2.1/servers/520a70a2-7301-4874-a01a-6516dafb7834 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:28:29.181856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-61252129-ad76-493d-b37c-3115cd9735b3 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:28:29.184583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-61252129-ad76-493d-b37c-3115cd9735b3 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:29.198112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-61252129-ad76-493d-b37c-3115cd9735b3 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:29.201354 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-61252129-ad76-493d-b37c-3115cd9735b3 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:29.203804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-61252129-ad76-493d-b37c-3115cd9735b3 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:29.204931 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-61252129-ad76-493d-b37c-3115cd9735b3 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:29.205839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-61252129-ad76-493d-b37c-3115cd9735b3 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:29.207859 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-61252129-ad76-493d-b37c-3115cd9735b3 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:29.265855 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-61252129-ad76-493d-b37c-3115cd9735b3 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lazy-loading 'flavor' on Instance uuid 5727af86-68aa-4099-9a00-316085741657 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:28:29.402917 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-61252129-ad76-493d-b37c-3115cd9735b3 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "POST /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657/action" status: 202 len: 0 microversion: 2.1 time: 0.229247 Aug 04 17:28:29.403804 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2977/5986] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:28:29 2022] POST /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:28:29.413361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cf0f7217-b834-4c22-abb8-e787ce486d0f tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:29.414685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cf0f7217-b834-4c22-abb8-e787ce486d0f tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:29.431277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf0f7217-b834-4c22-abb8-e787ce486d0f tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:29.433175 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf0f7217-b834-4c22-abb8-e787ce486d0f tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:29.434144 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf0f7217-b834-4c22-abb8-e787ce486d0f tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:29.436903 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf0f7217-b834-4c22-abb8-e787ce486d0f tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:29.438395 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf0f7217-b834-4c22-abb8-e787ce486d0f tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:29.442118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf0f7217-b834-4c22-abb8-e787ce486d0f tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:29.939136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-78372dc1-3fdb-451f-a594-a72383dc7e25 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:29.947374 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-78372dc1-3fdb-451f-a594-a72383dc7e25 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1687 microversion: 2.1 time: 1.050037 Aug 04 17:28:29.947987 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3010/5987] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:28 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1687 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:30.341883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cf0f7217-b834-4c22-abb8-e787ce486d0f tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7398367f4039986de5dae5c47027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d54d10773dc4305888f80908e2e3acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:30.371553 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cf0f7217-b834-4c22-abb8-e787ce486d0f tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657" status: 200 len: 1509 microversion: 2.1 time: 0.962734 Aug 04 17:28:30.372359 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2978/5988] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:29 2022] GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657 => generated 1509 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:28:30.975984 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9b827990-0aca-4f83-8923-a7df615d1a45 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:30.976618 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9b827990-0aca-4f83-8923-a7df615d1a45 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:30.991367 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b827990-0aca-4f83-8923-a7df615d1a45 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:30.996280 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b827990-0aca-4f83-8923-a7df615d1a45 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:30.997210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b827990-0aca-4f83-8923-a7df615d1a45 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:31.001679 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b827990-0aca-4f83-8923-a7df615d1a45 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:31.002787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b827990-0aca-4f83-8923-a7df615d1a45 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:31.003955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b827990-0aca-4f83-8923-a7df615d1a45 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:31.402108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4d927efb-9ec1-470e-93df-813120c01953 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:31.403520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4d927efb-9ec1-470e-93df-813120c01953 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:31.428126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d927efb-9ec1-470e-93df-813120c01953 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:31.428888 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d927efb-9ec1-470e-93df-813120c01953 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:31.429600 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d927efb-9ec1-470e-93df-813120c01953 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:31.432972 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d927efb-9ec1-470e-93df-813120c01953 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:31.434332 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d927efb-9ec1-470e-93df-813120c01953 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:31.435024 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d927efb-9ec1-470e-93df-813120c01953 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:31.528531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9b827990-0aca-4f83-8923-a7df615d1a45 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:31.543080 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9b827990-0aca-4f83-8923-a7df615d1a45 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1687 microversion: 2.1 time: 0.572374 Aug 04 17:28:31.543558 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3011/5989] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:30 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1687 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:32.569263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-33764d59-7f19-41d1-9fc9-8b12dc0f535f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:32.569901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-33764d59-7f19-41d1-9fc9-8b12dc0f535f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:32.586044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33764d59-7f19-41d1-9fc9-8b12dc0f535f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:32.586553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33764d59-7f19-41d1-9fc9-8b12dc0f535f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:32.587016 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33764d59-7f19-41d1-9fc9-8b12dc0f535f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:32.587835 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33764d59-7f19-41d1-9fc9-8b12dc0f535f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:32.588976 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33764d59-7f19-41d1-9fc9-8b12dc0f535f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:32.589435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33764d59-7f19-41d1-9fc9-8b12dc0f535f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:33.268511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4d927efb-9ec1-470e-93df-813120c01953 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7398367f4039986de5dae5c47027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d54d10773dc4305888f80908e2e3acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:33.292313 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4d927efb-9ec1-470e-93df-813120c01953 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657" status: 200 len: 1492 microversion: 2.1 time: 1.883487 Aug 04 17:28:33.293950 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2979/5990] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:31 2022] GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657 => generated 1492 bytes in 1897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:33.326106 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3bf9c906-3740-4b24-aff8-da1eab993c65 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:28:33.327090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3bf9c906-3740-4b24-aff8-da1eab993c65 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:33.340143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bf9c906-3740-4b24-aff8-da1eab993c65 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:33.343997 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bf9c906-3740-4b24-aff8-da1eab993c65 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:33.347154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bf9c906-3740-4b24-aff8-da1eab993c65 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:33.348892 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bf9c906-3740-4b24-aff8-da1eab993c65 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:33.350287 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bf9c906-3740-4b24-aff8-da1eab993c65 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:33.351971 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bf9c906-3740-4b24-aff8-da1eab993c65 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:33.675587 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3bf9c906-3740-4b24-aff8-da1eab993c65 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "POST /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657/action" status: 202 len: 0 microversion: 2.1 time: 0.358827 Aug 04 17:28:33.676573 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2980/5991] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:28:33 2022] POST /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:28:33.707159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-34bfc498-15c9-49ba-858f-ab3fe6d1a46d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:33.708237 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-34bfc498-15c9-49ba-858f-ab3fe6d1a46d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:33.738900 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34bfc498-15c9-49ba-858f-ab3fe6d1a46d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:33.745671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34bfc498-15c9-49ba-858f-ab3fe6d1a46d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:33.750735 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34bfc498-15c9-49ba-858f-ab3fe6d1a46d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:33.752014 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34bfc498-15c9-49ba-858f-ab3fe6d1a46d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:33.752718 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34bfc498-15c9-49ba-858f-ab3fe6d1a46d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:33.753429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34bfc498-15c9-49ba-858f-ab3fe6d1a46d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:34.087181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-33764d59-7f19-41d1-9fc9-8b12dc0f535f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:34.103290 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-33764d59-7f19-41d1-9fc9-8b12dc0f535f tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1687 microversion: 2.1 time: 1.537660 Aug 04 17:28:34.109348 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3012/5992] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:32 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1687 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:34.748845 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-34bfc498-15c9-49ba-858f-ab3fe6d1a46d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7398367f4039986de5dae5c47027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d54d10773dc4305888f80908e2e3acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:34.763648 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-34bfc498-15c9-49ba-858f-ab3fe6d1a46d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657" status: 200 len: 1498 microversion: 2.1 time: 1.070824 Aug 04 17:28:34.782468 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2981/5993] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:33 2022] GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657 => generated 1498 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:35.114864 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-1043c5fd-bb7b-4884-98a1-c37abf62369f req-856bce15-e8f3-4d24-a96c-c5ef3f14bb3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b70f57ec-990e-4d48-9b15-4556171b49b0", "name": "network-vif-deleted", "tag": "52d8c6ee-3fc7-4187-8788-8f6bb135633e"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:28:35.137408 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-38f8be7e-7ff5-43d8-916f-4b81081ce0d0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:35.138159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-38f8be7e-7ff5-43d8-916f-4b81081ce0d0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:35.150529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1043c5fd-bb7b-4884-98a1-c37abf62369f req-856bce15-e8f3-4d24-a96c-c5ef3f14bb3b service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:35.151413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1043c5fd-bb7b-4884-98a1-c37abf62369f req-856bce15-e8f3-4d24-a96c-c5ef3f14bb3b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:35.151859 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1043c5fd-bb7b-4884-98a1-c37abf62369f req-856bce15-e8f3-4d24-a96c-c5ef3f14bb3b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:35.154517 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38f8be7e-7ff5-43d8-916f-4b81081ce0d0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:35.155018 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38f8be7e-7ff5-43d8-916f-4b81081ce0d0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:35.155457 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38f8be7e-7ff5-43d8-916f-4b81081ce0d0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:35.156177 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38f8be7e-7ff5-43d8-916f-4b81081ce0d0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:35.177751 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38f8be7e-7ff5-43d8-916f-4b81081ce0d0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:35.178357 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38f8be7e-7ff5-43d8-916f-4b81081ce0d0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:35.230226 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-1043c5fd-bb7b-4884-98a1-c37abf62369f req-856bce15-e8f3-4d24-a96c-c5ef3f14bb3b service nova] Creating event network-vif-deleted:52d8c6ee-3fc7-4187-8788-8f6bb135633e for instance b70f57ec-990e-4d48-9b15-4556171b49b0 on n-h1-851359-3 Aug 04 17:28:35.267335 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-1043c5fd-bb7b-4884-98a1-c37abf62369f req-856bce15-e8f3-4d24-a96c-c5ef3f14bb3b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157826 Aug 04 17:28:35.276525 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3013/5994] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:28:35.437186 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-38f8be7e-7ff5-43d8-916f-4b81081ce0d0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a58cf36934daeabff9e35c05d4c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c69a3e46122413f928fe20a76b0cf94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:35.467914 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-38f8be7e-7ff5-43d8-916f-4b81081ce0d0 tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 200 len: 1351 microversion: 2.1 time: 0.334738 Aug 04 17:28:35.469161 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2982/5995] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:35 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 1351 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:35.787661 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-926e7a94-1fb3-49d7-83bd-25e2a8eef531 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:35.788394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-926e7a94-1fb3-49d7-83bd-25e2a8eef531 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:35.805074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-926e7a94-1fb3-49d7-83bd-25e2a8eef531 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:35.806382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-926e7a94-1fb3-49d7-83bd-25e2a8eef531 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:35.808061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-926e7a94-1fb3-49d7-83bd-25e2a8eef531 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:35.808890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-926e7a94-1fb3-49d7-83bd-25e2a8eef531 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:35.813772 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-926e7a94-1fb3-49d7-83bd-25e2a8eef531 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:35.814616 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-926e7a94-1fb3-49d7-83bd-25e2a8eef531 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:36.501116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-926e7a94-1fb3-49d7-83bd-25e2a8eef531 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7398367f4039986de5dae5c47027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d54d10773dc4305888f80908e2e3acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:36.504924 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c38baf11-1e8f-496a-bc93-245e726ae37c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:36.506588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c38baf11-1e8f-496a-bc93-245e726ae37c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] [instance: b70f57ec-990e-4d48-9b15-4556171b49b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:36.524431 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-926e7a94-1fb3-49d7-83bd-25e2a8eef531 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657" status: 200 len: 1498 microversion: 2.1 time: 0.742209 Aug 04 17:28:36.528968 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3014/5996] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:35 2022] GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657 => generated 1498 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:36.537207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c38baf11-1e8f-496a-bc93-245e726ae37c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:36.539709 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c38baf11-1e8f-496a-bc93-245e726ae37c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:36.541444 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c38baf11-1e8f-496a-bc93-245e726ae37c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:36.546906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c38baf11-1e8f-496a-bc93-245e726ae37c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:36.547635 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c38baf11-1e8f-496a-bc93-245e726ae37c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:36.548233 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c38baf11-1e8f-496a-bc93-245e726ae37c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:36.593509 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-c38baf11-1e8f-496a-bc93-245e726ae37c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] HTTP exception thrown: Instance b70f57ec-990e-4d48-9b15-4556171b49b0 could not be found. Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c38baf11-1e8f-496a-bc93-245e726ae37c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Request method failure captured: Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 HTTP/1.1 Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi6_63t572KuanVtq4R8MzvDbiJ5v4ZNLlIXNSeyaKZEreu-AZsY7LrigOd4ifgpCoVaTwnv6OlvH-5A4ZEjIVqN__JovdO3v25O3MH0-YQTpeaIifMEkPAJkS3gutHWKyi3cRSKLpwrID6LrAGigELMSbch6EEsMqa6Zl19KmfJ88KcE Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 9c69a3e46122413f928fe20a76b0cf94 Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1197876832 Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9c69a3e46122413f928fe20a76b0cf94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9c69a3e46122413f928fe20a76b0cf94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9c69a3e46122413f928fe20a76b0cf94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9c69a3e46122413f928fe20a76b0cf94"}]}] Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1197876832 Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 9c69a3e46122413f928fe20a76b0cf94 Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1197876832 Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TestNetworkAdvancedServerOps-1197876832-project Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: f27a58cf36934daeabff9e35c05d4c19 Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1197876832-project Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance b70f57ec-990e-4d48-9b15-4556171b49b0 could not be found. Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'b70f57ec-990e-4d48-9b15-4556171b49b0'} Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b70f57ec-990e-4d48-9b15-4556171b49b0 could not be found. Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b70f57ec-990e-4d48-9b15-4556171b49b0 could not be found. Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:28:36.595517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:28:36.599918 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:28:36.599918 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:28:36.599918 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:28:36.599918 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:28:36.599918 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:28:36.599918 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:28:36.599918 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b70f57ec-990e-4d48-9b15-4556171b49b0 could not be found. Aug 04 17:28:36.599918 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:28:36.603210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c38baf11-1e8f-496a-bc93-245e726ae37c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Returning 404 to user: Instance b70f57ec-990e-4d48-9b15-4556171b49b0 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:28:36.612177 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c38baf11-1e8f-496a-bc93-245e726ae37c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0" status: 404 len: 111 microversion: 2.1 time: 0.118651 Aug 04 17:28:36.613111 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2983/5997] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:36 2022] GET /compute/v2.1/servers/b70f57ec-990e-4d48-9b15-4556171b49b0 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:28:37.550609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-856cc2d2-8793-4000-b0a3-7bc1fb6a4b31 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:37.551814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-856cc2d2-8793-4000-b0a3-7bc1fb6a4b31 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:37.583999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-856cc2d2-8793-4000-b0a3-7bc1fb6a4b31 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:37.585388 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-856cc2d2-8793-4000-b0a3-7bc1fb6a4b31 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:37.587531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-856cc2d2-8793-4000-b0a3-7bc1fb6a4b31 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:37.589179 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-856cc2d2-8793-4000-b0a3-7bc1fb6a4b31 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:37.589843 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-856cc2d2-8793-4000-b0a3-7bc1fb6a4b31 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:37.591745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-856cc2d2-8793-4000-b0a3-7bc1fb6a4b31 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:38.946008 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-856cc2d2-8793-4000-b0a3-7bc1fb6a4b31 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7398367f4039986de5dae5c47027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d54d10773dc4305888f80908e2e3acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:38.960404 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-856cc2d2-8793-4000-b0a3-7bc1fb6a4b31 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657" status: 200 len: 1498 microversion: 2.1 time: 1.415556 Aug 04 17:28:38.963761 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3015/5998] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:37 2022] GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657 => generated 1498 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:39.985035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cda470ba-e857-4b16-b798-a245a0e8cd05 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:39.987148 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cda470ba-e857-4b16-b798-a245a0e8cd05 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:40.006537 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cda470ba-e857-4b16-b798-a245a0e8cd05 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:40.007437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cda470ba-e857-4b16-b798-a245a0e8cd05 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:40.008122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cda470ba-e857-4b16-b798-a245a0e8cd05 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:40.009149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cda470ba-e857-4b16-b798-a245a0e8cd05 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:40.009957 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cda470ba-e857-4b16-b798-a245a0e8cd05 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:40.011242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cda470ba-e857-4b16-b798-a245a0e8cd05 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:40.982936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cda470ba-e857-4b16-b798-a245a0e8cd05 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7398367f4039986de5dae5c47027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d54d10773dc4305888f80908e2e3acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:40.997445 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cda470ba-e857-4b16-b798-a245a0e8cd05 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657" status: 200 len: 1501 microversion: 2.1 time: 1.017392 Aug 04 17:28:41.010755 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2984/5999] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:39 2022] GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657 => generated 1501 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:41.023177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-520f155d-f78b-46fb-9a51-f4ebdf808de1 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:28:41.023770 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-520f155d-f78b-46fb-9a51-f4ebdf808de1 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:41.035885 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-520f155d-f78b-46fb-9a51-f4ebdf808de1 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:41.041747 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-520f155d-f78b-46fb-9a51-f4ebdf808de1 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:41.042481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-520f155d-f78b-46fb-9a51-f4ebdf808de1 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:41.043345 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-520f155d-f78b-46fb-9a51-f4ebdf808de1 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:41.043908 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-520f155d-f78b-46fb-9a51-f4ebdf808de1 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:41.044447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-520f155d-f78b-46fb-9a51-f4ebdf808de1 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:41.096776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-520f155d-f78b-46fb-9a51-f4ebdf808de1 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lazy-loading 'flavor' on Instance uuid 5727af86-68aa-4099-9a00-316085741657 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:28:41.260678 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-520f155d-f78b-46fb-9a51-f4ebdf808de1 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "POST /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657/action" status: 202 len: 0 microversion: 2.1 time: 0.240865 Aug 04 17:28:41.270743 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fa8127d9-c962-40df-8159-fa2860a77333 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:41.271529 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fa8127d9-c962-40df-8159-fa2860a77333 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:41.277539 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3016/6000] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:28:41 2022] POST /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:28:41.283606 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa8127d9-c962-40df-8159-fa2860a77333 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:41.284267 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa8127d9-c962-40df-8159-fa2860a77333 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:41.285964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa8127d9-c962-40df-8159-fa2860a77333 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:41.289557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa8127d9-c962-40df-8159-fa2860a77333 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:41.290397 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa8127d9-c962-40df-8159-fa2860a77333 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:41.291293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa8127d9-c962-40df-8159-fa2860a77333 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:42.940084 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fa8127d9-c962-40df-8159-fa2860a77333 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7398367f4039986de5dae5c47027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d54d10773dc4305888f80908e2e3acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:42.954713 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fa8127d9-c962-40df-8159-fa2860a77333 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657" status: 200 len: 1509 microversion: 2.1 time: 1.685843 Aug 04 17:28:42.958797 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2985/6001] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:41 2022] GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657 => generated 1509 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:43.995180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-92529c52-2739-445c-89e5-acd3be27ff2d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:43.996869 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-92529c52-2739-445c-89e5-acd3be27ff2d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:44.044606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92529c52-2739-445c-89e5-acd3be27ff2d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:44.046206 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92529c52-2739-445c-89e5-acd3be27ff2d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:44.048405 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92529c52-2739-445c-89e5-acd3be27ff2d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:44.051183 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92529c52-2739-445c-89e5-acd3be27ff2d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:44.052681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92529c52-2739-445c-89e5-acd3be27ff2d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:44.056432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92529c52-2739-445c-89e5-acd3be27ff2d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:44.068735 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:28:45.766219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-92529c52-2739-445c-89e5-acd3be27ff2d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7398367f4039986de5dae5c47027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d54d10773dc4305888f80908e2e3acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:45.776728 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-92529c52-2739-445c-89e5-acd3be27ff2d tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657" status: 200 len: 1492 microversion: 2.1 time: 1.801796 Aug 04 17:28:45.779098 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3017/6002] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:43 2022] GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657 => generated 1492 bytes in 1805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:45.806225 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-adcb14b0-e136-4ce9-b6a1-85c7b74432a7 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:28:45.806225 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-adcb14b0-e136-4ce9-b6a1-85c7b74432a7 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:45.829056 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adcb14b0-e136-4ce9-b6a1-85c7b74432a7 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:45.829569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adcb14b0-e136-4ce9-b6a1-85c7b74432a7 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:45.850152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adcb14b0-e136-4ce9-b6a1-85c7b74432a7 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:45.851062 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adcb14b0-e136-4ce9-b6a1-85c7b74432a7 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:45.858676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adcb14b0-e136-4ce9-b6a1-85c7b74432a7 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:45.859270 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adcb14b0-e136-4ce9-b6a1-85c7b74432a7 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:46.031416 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-adcb14b0-e136-4ce9-b6a1-85c7b74432a7 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "POST /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657/action" status: 202 len: 0 microversion: 2.1 time: 0.232690 Aug 04 17:28:46.036786 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2986/6003] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:28:45 2022] POST /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:28:46.044034 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e763c33e-38f3-473f-bb2e-ed29514be4bf tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:46.044888 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e763c33e-38f3-473f-bb2e-ed29514be4bf tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:46.078258 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e763c33e-38f3-473f-bb2e-ed29514be4bf tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:46.078888 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e763c33e-38f3-473f-bb2e-ed29514be4bf tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:46.083731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e763c33e-38f3-473f-bb2e-ed29514be4bf tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:46.085592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e763c33e-38f3-473f-bb2e-ed29514be4bf tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:46.087323 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e763c33e-38f3-473f-bb2e-ed29514be4bf tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:46.089169 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e763c33e-38f3-473f-bb2e-ed29514be4bf tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:47.048827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e763c33e-38f3-473f-bb2e-ed29514be4bf tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7398367f4039986de5dae5c47027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d54d10773dc4305888f80908e2e3acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:47.063157 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e763c33e-38f3-473f-bb2e-ed29514be4bf tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657" status: 200 len: 1498 microversion: 2.1 time: 1.024825 Aug 04 17:28:47.064084 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3018/6004] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:46 2022] GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657 => generated 1498 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:48.085570 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c823af15-3d91-433a-8338-2b0da5eeaec2 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:48.086315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c823af15-3d91-433a-8338-2b0da5eeaec2 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:48.110615 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c823af15-3d91-433a-8338-2b0da5eeaec2 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:48.111395 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c823af15-3d91-433a-8338-2b0da5eeaec2 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:48.111844 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c823af15-3d91-433a-8338-2b0da5eeaec2 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:48.112573 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c823af15-3d91-433a-8338-2b0da5eeaec2 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:48.115329 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c823af15-3d91-433a-8338-2b0da5eeaec2 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:48.118289 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c823af15-3d91-433a-8338-2b0da5eeaec2 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:48.548737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c823af15-3d91-433a-8338-2b0da5eeaec2 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7398367f4039986de5dae5c47027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d54d10773dc4305888f80908e2e3acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:48.559065 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c823af15-3d91-433a-8338-2b0da5eeaec2 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657" status: 200 len: 1498 microversion: 2.1 time: 0.478268 Aug 04 17:28:48.560416 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2987/6005] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:48 2022] GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657 => generated 1498 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:49.581279 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cdd9d107-5613-4596-93a6-8e5978ab4028 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:49.581924 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cdd9d107-5613-4596-93a6-8e5978ab4028 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:49.601712 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cdd9d107-5613-4596-93a6-8e5978ab4028 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:49.602255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cdd9d107-5613-4596-93a6-8e5978ab4028 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:49.602718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cdd9d107-5613-4596-93a6-8e5978ab4028 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:49.603503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cdd9d107-5613-4596-93a6-8e5978ab4028 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:49.603989 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cdd9d107-5613-4596-93a6-8e5978ab4028 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:49.604435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cdd9d107-5613-4596-93a6-8e5978ab4028 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:50.168075 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cdd9d107-5613-4596-93a6-8e5978ab4028 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7398367f4039986de5dae5c47027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d54d10773dc4305888f80908e2e3acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:50.178925 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cdd9d107-5613-4596-93a6-8e5978ab4028 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657" status: 200 len: 1498 microversion: 2.1 time: 0.601933 Aug 04 17:28:50.183187 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3019/6006] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:49 2022] GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657 => generated 1498 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:51.218085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-df5a3951-9dc4-4dae-841b-b54c59d0215b tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:51.218947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-df5a3951-9dc4-4dae-841b-b54c59d0215b tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:51.231305 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df5a3951-9dc4-4dae-841b-b54c59d0215b tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:51.232100 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df5a3951-9dc4-4dae-841b-b54c59d0215b tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:51.232717 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df5a3951-9dc4-4dae-841b-b54c59d0215b tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:51.238046 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df5a3951-9dc4-4dae-841b-b54c59d0215b tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:51.238742 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df5a3951-9dc4-4dae-841b-b54c59d0215b tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:51.239356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df5a3951-9dc4-4dae-841b-b54c59d0215b tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:51.281241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:28:51.678183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-df5a3951-9dc4-4dae-841b-b54c59d0215b tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7398367f4039986de5dae5c47027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d54d10773dc4305888f80908e2e3acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:51.708408 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-df5a3951-9dc4-4dae-841b-b54c59d0215b tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657" status: 200 len: 1501 microversion: 2.1 time: 0.500576 Aug 04 17:28:51.726227 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2988/6007] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:51 2022] GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657 => generated 1501 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:51.742297 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-82bbe120-9110-4340-a209-65593a237815 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:51.743413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-82bbe120-9110-4340-a209-65593a237815 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:51.754205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82bbe120-9110-4340-a209-65593a237815 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:51.755148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82bbe120-9110-4340-a209-65593a237815 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:51.755901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82bbe120-9110-4340-a209-65593a237815 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:51.757185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82bbe120-9110-4340-a209-65593a237815 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:51.758662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82bbe120-9110-4340-a209-65593a237815 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:51.760948 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82bbe120-9110-4340-a209-65593a237815 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:51.846056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-82bbe120-9110-4340-a209-65593a237815 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:28:52.002306 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-82bbe120-9110-4340-a209-65593a237815 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "DELETE /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657" status: 204 len: 0 microversion: 2.1 time: 0.275721 Aug 04 17:28:52.003727 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3020/6008] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:28:51 2022] DELETE /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 17:28:52.014329 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5f6bfef2-4941-4dd7-9b4b-d25df002f560 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:52.015204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5f6bfef2-4941-4dd7-9b4b-d25df002f560 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:52.024853 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f6bfef2-4941-4dd7-9b4b-d25df002f560 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:52.026293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f6bfef2-4941-4dd7-9b4b-d25df002f560 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:52.026920 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f6bfef2-4941-4dd7-9b4b-d25df002f560 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:52.027959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f6bfef2-4941-4dd7-9b4b-d25df002f560 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:52.028717 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f6bfef2-4941-4dd7-9b4b-d25df002f560 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:52.029377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f6bfef2-4941-4dd7-9b4b-d25df002f560 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:52.909636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5f6bfef2-4941-4dd7-9b4b-d25df002f560 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7398367f4039986de5dae5c47027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d54d10773dc4305888f80908e2e3acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:52.923789 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5f6bfef2-4941-4dd7-9b4b-d25df002f560 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657" status: 200 len: 1507 microversion: 2.1 time: 0.912715 Aug 04 17:28:52.939072 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2989/6009] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:52 2022] GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657 => generated 1507 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:53.845232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b3d43d31-710a-485b-8e51-32a92635089c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] Calling method '.version_select at 0x7f1e5aff90d0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:53.893610 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b3d43d31-710a-485b-8e51-32a92635089c tempest-TestNetworkAdvancedServerOps-1197876832 tempest-TestNetworkAdvancedServerOps-1197876832-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-572976559" status: 202 len: 0 microversion: 2.1 time: 0.053506 Aug 04 17:28:53.897253 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3021/6010] 10.222.0.93 () {58 vars in 1281 bytes} [Thu Aug 4 17:28:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-572976559 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:28:53.954704 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e60c43a1-9776-4699-9b77-d4eee3882aad tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:53.955338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e60c43a1-9776-4699-9b77-d4eee3882aad tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:53.990492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e60c43a1-9776-4699-9b77-d4eee3882aad tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:53.994297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e60c43a1-9776-4699-9b77-d4eee3882aad tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:53.994862 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e60c43a1-9776-4699-9b77-d4eee3882aad tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:54.000717 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e60c43a1-9776-4699-9b77-d4eee3882aad tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:54.005824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e60c43a1-9776-4699-9b77-d4eee3882aad tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:54.006528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e60c43a1-9776-4699-9b77-d4eee3882aad tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:54.536144 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e60c43a1-9776-4699-9b77-d4eee3882aad tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7398367f4039986de5dae5c47027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d54d10773dc4305888f80908e2e3acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:54.555494 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e60c43a1-9776-4699-9b77-d4eee3882aad tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657" status: 200 len: 1507 microversion: 2.1 time: 0.612933 Aug 04 17:28:54.561637 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2990/6011] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:53 2022] GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657 => generated 1507 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:55.592975 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f2f68e5e-c252-4970-ac63-e5f3e63a0620 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:55.593735 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f2f68e5e-c252-4970-ac63-e5f3e63a0620 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:55.608109 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2f68e5e-c252-4970-ac63-e5f3e63a0620 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:55.611477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2f68e5e-c252-4970-ac63-e5f3e63a0620 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:55.612471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2f68e5e-c252-4970-ac63-e5f3e63a0620 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:55.613820 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2f68e5e-c252-4970-ac63-e5f3e63a0620 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:55.619969 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2f68e5e-c252-4970-ac63-e5f3e63a0620 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:55.620706 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f2f68e5e-c252-4970-ac63-e5f3e63a0620 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:55.820475 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-8b3e750d-caab-49cb-9960-46d7351bff7d req-3bb88412-83f4-4e65-9a1f-d6ad13c3cac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5727af86-68aa-4099-9a00-316085741657", "name": "network-vif-deleted", "tag": "54d3a47e-0be3-4601-97f0-7f814def152f"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:28:55.839409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8b3e750d-caab-49cb-9960-46d7351bff7d req-3bb88412-83f4-4e65-9a1f-d6ad13c3cac2 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:55.840282 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8b3e750d-caab-49cb-9960-46d7351bff7d req-3bb88412-83f4-4e65-9a1f-d6ad13c3cac2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:55.840909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8b3e750d-caab-49cb-9960-46d7351bff7d req-3bb88412-83f4-4e65-9a1f-d6ad13c3cac2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:55.864072 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-8b3e750d-caab-49cb-9960-46d7351bff7d req-3bb88412-83f4-4e65-9a1f-d6ad13c3cac2 service nova] Creating event network-vif-deleted:54d3a47e-0be3-4601-97f0-7f814def152f for instance 5727af86-68aa-4099-9a00-316085741657 on n-h1-851359-3 Aug 04 17:28:55.882649 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-8b3e750d-caab-49cb-9960-46d7351bff7d req-3bb88412-83f4-4e65-9a1f-d6ad13c3cac2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067216 Aug 04 17:28:55.883565 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2991/6012] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:28:56.104181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f2f68e5e-c252-4970-ac63-e5f3e63a0620 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434e7398367f4039986de5dae5c47027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d54d10773dc4305888f80908e2e3acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:28:56.113072 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f2f68e5e-c252-4970-ac63-e5f3e63a0620 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657" status: 200 len: 1465 microversion: 2.1 time: 0.532809 Aug 04 17:28:56.138343 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3022/6013] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:55 2022] GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657 => generated 1465 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:28:57.146354 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6ddfcc51-8c5b-42c3-ad9e-0b090c365db9 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:28:57.148085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6ddfcc51-8c5b-42c3-ad9e-0b090c365db9 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] [instance: 5727af86-68aa-4099-9a00-316085741657] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:28:57.173556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ddfcc51-8c5b-42c3-ad9e-0b090c365db9 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:57.174992 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ddfcc51-8c5b-42c3-ad9e-0b090c365db9 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:57.175676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ddfcc51-8c5b-42c3-ad9e-0b090c365db9 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:57.177072 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ddfcc51-8c5b-42c3-ad9e-0b090c365db9 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:28:57.179083 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ddfcc51-8c5b-42c3-ad9e-0b090c365db9 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:28:57.180346 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ddfcc51-8c5b-42c3-ad9e-0b090c365db9 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:28:57.229348 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-6ddfcc51-8c5b-42c3-ad9e-0b090c365db9 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] HTTP exception thrown: Instance 5727af86-68aa-4099-9a00-316085741657 could not be found. Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6ddfcc51-8c5b-42c3-ad9e-0b090c365db9 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Request method failure captured: Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657 HTTP/1.1 Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AGZYvJbapbJyghfHamwsIlUsaRF8ZuRocscbeSBuoanRk39R_anIswwgM_ZK-5qRS5XIPvmoKiEQcmQncWfZu1nCMBdIDCl52Uz2AKLHW1BkD4dSaFS3uXHu7leNl4BksoaINuCoTZ3BOPw5OX42GQKAbUUAmvAPrdYFjXrUbNJLmA Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 3d54d10773dc4305888f80908e2e3acc Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TestServerAdvancedOps-1979322772 Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3d54d10773dc4305888f80908e2e3acc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/3d54d10773dc4305888f80908e2e3acc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_3d54d10773dc4305888f80908e2e3acc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/3d54d10773dc4305888f80908e2e3acc"}]}] Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TestServerAdvancedOps-1979322772 Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 3d54d10773dc4305888f80908e2e3acc Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestServerAdvancedOps-1979322772 Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TestServerAdvancedOps-1979322772-project Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 434e7398367f4039986de5dae5c47027 Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TestServerAdvancedOps-1979322772-project Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 5727af86-68aa-4099-9a00-316085741657 could not be found. Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '5727af86-68aa-4099-9a00-316085741657'} Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5727af86-68aa-4099-9a00-316085741657 could not be found. Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5727af86-68aa-4099-9a00-316085741657 could not be found. Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:28:57.235164 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:28:57.240528 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:28:57.240528 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:28:57.240528 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:28:57.240528 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:28:57.240528 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:28:57.240528 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5727af86-68aa-4099-9a00-316085741657 could not be found. Aug 04 17:28:57.240528 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:28:57.242437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6ddfcc51-8c5b-42c3-ad9e-0b090c365db9 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] Returning 404 to user: Instance 5727af86-68aa-4099-9a00-316085741657 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:28:57.245421 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6ddfcc51-8c5b-42c3-ad9e-0b090c365db9 tempest-TestServerAdvancedOps-1979322772 tempest-TestServerAdvancedOps-1979322772-project] 10.222.0.93 "GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657" status: 404 len: 111 microversion: 2.1 time: 0.107396 Aug 04 17:28:57.249754 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2992/6014] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:28:57 2022] GET /compute/v2.1/servers/5727af86-68aa-4099-9a00-316085741657 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:29:20.085036 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:29:20.086685 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:29:20.417096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-119c9ff4-c925-4019-ad4a-dc6da01b5ddc tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-653475160", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "908e9582-63f3-4ace-8cf1-09da0c9d0857"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:29:20.524416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-119c9ff4-c925-4019-ad4a-dc6da01b5ddc tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] validate_networks() for [('908e9582-63f3-4ace-8cf1-09da0c9d0857', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:29:23.189060 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:29:23.189619 n-d-851359-3 devstack@n-api.service[131043]: Thu Aug 4 17:29:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.93) !!! Aug 04 17:29:24.233322 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-119c9ff4-c925-4019-ad4a-dc6da01b5ddc tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:29:24.234066 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-119c9ff4-c925-4019-ad4a-dc6da01b5ddc tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:29:24.234613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-119c9ff4-c925-4019-ad4a-dc6da01b5ddc tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:29:24.235049 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-119c9ff4-c925-4019-ad4a-dc6da01b5ddc tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:29:24.235486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-119c9ff4-c925-4019-ad4a-dc6da01b5ddc tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:29:24.258266 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-119c9ff4-c925-4019-ad4a-dc6da01b5ddc tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:24.259228 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-119c9ff4-c925-4019-ad4a-dc6da01b5ddc tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:24.260096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-119c9ff4-c925-4019-ad4a-dc6da01b5ddc tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:24.261103 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-119c9ff4-c925-4019-ad4a-dc6da01b5ddc tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:24.270362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-119c9ff4-c925-4019-ad4a-dc6da01b5ddc tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:24.270835 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-119c9ff4-c925-4019-ad4a-dc6da01b5ddc tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:24.347868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-119c9ff4-c925-4019-ad4a-dc6da01b5ddc tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Getting quotas for project 2785f61d718048b3a38eb70afc8566ec. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:29:24.354708 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-119c9ff4-c925-4019-ad4a-dc6da01b5ddc tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Getting quotas for user 5690dbde4dee4363b87e6e29cd0ad691 and project 2785f61d718048b3a38eb70afc8566ec. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:29:24.393659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-119c9ff4-c925-4019-ad4a-dc6da01b5ddc tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:29:24.403832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-119c9ff4-c925-4019-ad4a-dc6da01b5ddc tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] [instance: dd450ad1-cac7-4e29-b65c-7a5232b85f46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:29:24.709194 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-119c9ff4-c925-4019-ad4a-dc6da01b5ddc tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.633527 Aug 04 17:29:24.709967 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3023/6015] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:29:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 4635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:29:24.737615 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b15ea1e3-0c93-49fe-80f4-5c84ff665627 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:24.745538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b15ea1e3-0c93-49fe-80f4-5c84ff665627 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] [instance: dd450ad1-cac7-4e29-b65c-7a5232b85f46] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:24.762401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=33 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:29:24.764016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=19 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:29:25.057814 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b15ea1e3-0c93-49fe-80f4-5c84ff665627 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5690dbde4dee4363b87e6e29cd0ad691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2785f61d718048b3a38eb70afc8566ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:25.075509 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b15ea1e3-0c93-49fe-80f4-5c84ff665627 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] 10.222.0.93 "GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46" status: 200 len: 1224 microversion: 2.1 time: 0.357943 Aug 04 17:29:25.076106 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2993/6016] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:24 2022] GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46 => generated 1224 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:29:26.104417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c8781056-0fc2-42ec-9704-5ec845847ea7 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:26.105210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c8781056-0fc2-42ec-9704-5ec845847ea7 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] [instance: dd450ad1-cac7-4e29-b65c-7a5232b85f46] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:26.841929 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c8781056-0fc2-42ec-9704-5ec845847ea7 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5690dbde4dee4363b87e6e29cd0ad691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2785f61d718048b3a38eb70afc8566ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:26.852935 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c8781056-0fc2-42ec-9704-5ec845847ea7 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] 10.222.0.93 "GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46" status: 200 len: 1224 microversion: 2.1 time: 0.754802 Aug 04 17:29:26.862767 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3024/6017] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:26 2022] GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46 => generated 1224 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:27.892726 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e48e7106-d645-4f53-b2a4-e1b8f2f076a1 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:27.894845 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e48e7106-d645-4f53-b2a4-e1b8f2f076a1 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] [instance: dd450ad1-cac7-4e29-b65c-7a5232b85f46] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:27.931673 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e48e7106-d645-4f53-b2a4-e1b8f2f076a1 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:27.932277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e48e7106-d645-4f53-b2a4-e1b8f2f076a1 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:27.932743 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e48e7106-d645-4f53-b2a4-e1b8f2f076a1 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:27.938545 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e48e7106-d645-4f53-b2a4-e1b8f2f076a1 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:27.939233 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e48e7106-d645-4f53-b2a4-e1b8f2f076a1 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:27.939699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e48e7106-d645-4f53-b2a4-e1b8f2f076a1 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:28.207789 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e48e7106-d645-4f53-b2a4-e1b8f2f076a1 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5690dbde4dee4363b87e6e29cd0ad691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2785f61d718048b3a38eb70afc8566ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:28.235100 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e48e7106-d645-4f53-b2a4-e1b8f2f076a1 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] 10.222.0.93 "GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46" status: 200 len: 1294 microversion: 2.1 time: 0.352644 Aug 04 17:29:28.254149 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2994/6018] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:27 2022] GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46 => generated 1294 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:29.259720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-aa067baa-f45f-4a03-b979-5527c38e57fa tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:29.261360 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-aa067baa-f45f-4a03-b979-5527c38e57fa tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] [instance: dd450ad1-cac7-4e29-b65c-7a5232b85f46] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:29.278249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa067baa-f45f-4a03-b979-5527c38e57fa tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:29.278533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa067baa-f45f-4a03-b979-5527c38e57fa tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:29.278847 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa067baa-f45f-4a03-b979-5527c38e57fa tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:29.279843 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa067baa-f45f-4a03-b979-5527c38e57fa tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:29.299654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa067baa-f45f-4a03-b979-5527c38e57fa tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:29.301708 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aa067baa-f45f-4a03-b979-5527c38e57fa tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:29.586011 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-aa067baa-f45f-4a03-b979-5527c38e57fa tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5690dbde4dee4363b87e6e29cd0ad691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2785f61d718048b3a38eb70afc8566ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:29.594707 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-aa067baa-f45f-4a03-b979-5527c38e57fa tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] 10.222.0.93 "GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46" status: 200 len: 1282 microversion: 2.1 time: 0.339605 Aug 04 17:29:29.599797 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3025/6019] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:29 2022] GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46 => generated 1282 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:30.627132 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-39e0e44c-3f79-4321-8d21-eb9b457f3241 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:30.629047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-39e0e44c-3f79-4321-8d21-eb9b457f3241 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] [instance: dd450ad1-cac7-4e29-b65c-7a5232b85f46] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:30.678062 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39e0e44c-3f79-4321-8d21-eb9b457f3241 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:30.679139 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39e0e44c-3f79-4321-8d21-eb9b457f3241 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:30.684707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39e0e44c-3f79-4321-8d21-eb9b457f3241 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:30.690189 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39e0e44c-3f79-4321-8d21-eb9b457f3241 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:30.691220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39e0e44c-3f79-4321-8d21-eb9b457f3241 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:30.696291 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39e0e44c-3f79-4321-8d21-eb9b457f3241 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:30.947766 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-39e0e44c-3f79-4321-8d21-eb9b457f3241 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5690dbde4dee4363b87e6e29cd0ad691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2785f61d718048b3a38eb70afc8566ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:30.962587 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-39e0e44c-3f79-4321-8d21-eb9b457f3241 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] 10.222.0.93 "GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46" status: 200 len: 1282 microversion: 2.1 time: 0.342769 Aug 04 17:29:30.963814 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2995/6020] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:30 2022] GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46 => generated 1282 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:31.992680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8e86fa1f-55b7-45a3-9940-34b7005094f5 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:31.993245 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8e86fa1f-55b7-45a3-9940-34b7005094f5 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] [instance: dd450ad1-cac7-4e29-b65c-7a5232b85f46] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:32.019945 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e86fa1f-55b7-45a3-9940-34b7005094f5 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:32.020464 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e86fa1f-55b7-45a3-9940-34b7005094f5 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:32.020926 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e86fa1f-55b7-45a3-9940-34b7005094f5 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:32.021670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e86fa1f-55b7-45a3-9940-34b7005094f5 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:32.022172 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e86fa1f-55b7-45a3-9940-34b7005094f5 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:32.022620 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e86fa1f-55b7-45a3-9940-34b7005094f5 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:32.277009 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8e86fa1f-55b7-45a3-9940-34b7005094f5 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5690dbde4dee4363b87e6e29cd0ad691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2785f61d718048b3a38eb70afc8566ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:32.286831 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8e86fa1f-55b7-45a3-9940-34b7005094f5 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] 10.222.0.93 "GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46" status: 200 len: 1282 microversion: 2.1 time: 0.298757 Aug 04 17:29:32.296746 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3026/6021] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:31 2022] GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46 => generated 1282 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:33.319915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-95a80cd1-8bce-4689-b38a-97cb25e4cc82 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:33.321191 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-95a80cd1-8bce-4689-b38a-97cb25e4cc82 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] [instance: dd450ad1-cac7-4e29-b65c-7a5232b85f46] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:33.332286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95a80cd1-8bce-4689-b38a-97cb25e4cc82 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:33.338350 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95a80cd1-8bce-4689-b38a-97cb25e4cc82 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:33.339106 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95a80cd1-8bce-4689-b38a-97cb25e4cc82 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:33.340678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95a80cd1-8bce-4689-b38a-97cb25e4cc82 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:33.341782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95a80cd1-8bce-4689-b38a-97cb25e4cc82 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:33.349170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95a80cd1-8bce-4689-b38a-97cb25e4cc82 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:33.573645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-95a80cd1-8bce-4689-b38a-97cb25e4cc82 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5690dbde4dee4363b87e6e29cd0ad691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2785f61d718048b3a38eb70afc8566ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:33.589953 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-95a80cd1-8bce-4689-b38a-97cb25e4cc82 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] 10.222.0.93 "GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46" status: 200 len: 1282 microversion: 2.1 time: 0.274039 Aug 04 17:29:33.593612 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2996/6022] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:33 2022] GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46 => generated 1282 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:34.617605 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ef8f6900-539d-40cb-8249-829e956987c6 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:34.618255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ef8f6900-539d-40cb-8249-829e956987c6 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] [instance: dd450ad1-cac7-4e29-b65c-7a5232b85f46] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:34.621070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:29:34.634229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ef8f6900-539d-40cb-8249-829e956987c6 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:34.634229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ef8f6900-539d-40cb-8249-829e956987c6 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:34.634229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ef8f6900-539d-40cb-8249-829e956987c6 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:34.634229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ef8f6900-539d-40cb-8249-829e956987c6 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:34.634229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ef8f6900-539d-40cb-8249-829e956987c6 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:34.634229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ef8f6900-539d-40cb-8249-829e956987c6 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:34.963174 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ef8f6900-539d-40cb-8249-829e956987c6 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5690dbde4dee4363b87e6e29cd0ad691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2785f61d718048b3a38eb70afc8566ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:34.972341 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ef8f6900-539d-40cb-8249-829e956987c6 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] 10.222.0.93 "GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46" status: 200 len: 1324 microversion: 2.1 time: 0.360404 Aug 04 17:29:34.978281 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3027/6023] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:34 2022] GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46 => generated 1324 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:36.010283 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bde2f448-cfbf-422c-973c-ab1dab08c7ca tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:36.011555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bde2f448-cfbf-422c-973c-ab1dab08c7ca tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] [instance: dd450ad1-cac7-4e29-b65c-7a5232b85f46] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:36.014757 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:29:36.021434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bde2f448-cfbf-422c-973c-ab1dab08c7ca tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:36.022469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bde2f448-cfbf-422c-973c-ab1dab08c7ca tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:36.023174 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bde2f448-cfbf-422c-973c-ab1dab08c7ca tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:36.024081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bde2f448-cfbf-422c-973c-ab1dab08c7ca tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:36.024767 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bde2f448-cfbf-422c-973c-ab1dab08c7ca tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:36.025402 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bde2f448-cfbf-422c-973c-ab1dab08c7ca tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:36.277581 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bde2f448-cfbf-422c-973c-ab1dab08c7ca tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5690dbde4dee4363b87e6e29cd0ad691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2785f61d718048b3a38eb70afc8566ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:36.293455 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bde2f448-cfbf-422c-973c-ab1dab08c7ca tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] 10.222.0.93 "GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46" status: 200 len: 1324 microversion: 2.1 time: 0.294656 Aug 04 17:29:36.294785 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2997/6024] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:35 2022] GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46 => generated 1324 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:37.319714 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fd78270f-1487-4074-91e4-47a83385045f tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:37.321544 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fd78270f-1487-4074-91e4-47a83385045f tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] [instance: dd450ad1-cac7-4e29-b65c-7a5232b85f46] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:37.327155 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=8 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:29:37.368988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd78270f-1487-4074-91e4-47a83385045f tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:37.374133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd78270f-1487-4074-91e4-47a83385045f tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:37.374977 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd78270f-1487-4074-91e4-47a83385045f tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:37.378627 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd78270f-1487-4074-91e4-47a83385045f tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:37.382922 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd78270f-1487-4074-91e4-47a83385045f tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:37.389018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd78270f-1487-4074-91e4-47a83385045f tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:38.207664 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fd78270f-1487-4074-91e4-47a83385045f tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5690dbde4dee4363b87e6e29cd0ad691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2785f61d718048b3a38eb70afc8566ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:38.218340 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fd78270f-1487-4074-91e4-47a83385045f tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] 10.222.0.93 "GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46" status: 200 len: 1324 microversion: 2.1 time: 0.905787 Aug 04 17:29:38.221361 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3028/6025] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:37 2022] GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46 => generated 1324 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:38.562416 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-9aa1d9dd-392f-4c3a-a587-39a5d822eb78 req-9f856a92-af3c-48bb-b9c4-3ea3c9e1c332 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd450ad1-cac7-4e29-b65c-7a5232b85f46", "tag": "5b464f94-604f-4dec-838c-d87b98b500b0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:29:38.583003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9aa1d9dd-392f-4c3a-a587-39a5d822eb78 req-9f856a92-af3c-48bb-b9c4-3ea3c9e1c332 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:38.583741 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9aa1d9dd-392f-4c3a-a587-39a5d822eb78 req-9f856a92-af3c-48bb-b9c4-3ea3c9e1c332 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:38.584701 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9aa1d9dd-392f-4c3a-a587-39a5d822eb78 req-9f856a92-af3c-48bb-b9c4-3ea3c9e1c332 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:38.620721 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-9aa1d9dd-392f-4c3a-a587-39a5d822eb78 req-9f856a92-af3c-48bb-b9c4-3ea3c9e1c332 service nova] Creating event network-changed:5b464f94-604f-4dec-838c-d87b98b500b0 for instance dd450ad1-cac7-4e29-b65c-7a5232b85f46 on n-h1-851359-3 Aug 04 17:29:38.626403 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-9aa1d9dd-392f-4c3a-a587-39a5d822eb78 req-9f856a92-af3c-48bb-b9c4-3ea3c9e1c332 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068838 Aug 04 17:29:38.627645 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2998/6026] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:29:39.255071 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-63650360-8b0e-41d3-9151-da38a4b52660 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:39.256911 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-63650360-8b0e-41d3-9151-da38a4b52660 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] [instance: dd450ad1-cac7-4e29-b65c-7a5232b85f46] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:39.272309 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63650360-8b0e-41d3-9151-da38a4b52660 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:39.274601 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63650360-8b0e-41d3-9151-da38a4b52660 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:39.276122 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63650360-8b0e-41d3-9151-da38a4b52660 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:39.279429 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63650360-8b0e-41d3-9151-da38a4b52660 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:39.280681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63650360-8b0e-41d3-9151-da38a4b52660 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:39.283050 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-63650360-8b0e-41d3-9151-da38a4b52660 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:40.784370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-63650360-8b0e-41d3-9151-da38a4b52660 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5690dbde4dee4363b87e6e29cd0ad691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2785f61d718048b3a38eb70afc8566ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:40.800595 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-63650360-8b0e-41d3-9151-da38a4b52660 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] 10.222.0.93 "GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46" status: 200 len: 1324 microversion: 2.1 time: 1.554452 Aug 04 17:29:40.808129 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3029/6027] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:39 2022] GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46 => generated 1324 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:41.832340 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1dcc0577-00c4-4147-9fca-adef5dc1a16c tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:41.833084 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1dcc0577-00c4-4147-9fca-adef5dc1a16c tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] [instance: dd450ad1-cac7-4e29-b65c-7a5232b85f46] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:41.855625 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dcc0577-00c4-4147-9fca-adef5dc1a16c tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:41.861898 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dcc0577-00c4-4147-9fca-adef5dc1a16c tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:41.864628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dcc0577-00c4-4147-9fca-adef5dc1a16c tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:41.865401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dcc0577-00c4-4147-9fca-adef5dc1a16c tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:41.865896 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dcc0577-00c4-4147-9fca-adef5dc1a16c tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:41.872815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dcc0577-00c4-4147-9fca-adef5dc1a16c tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:42.511399 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1dcc0577-00c4-4147-9fca-adef5dc1a16c tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5690dbde4dee4363b87e6e29cd0ad691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2785f61d718048b3a38eb70afc8566ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:42.544672 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1dcc0577-00c4-4147-9fca-adef5dc1a16c tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] 10.222.0.93 "GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46" status: 200 len: 1324 microversion: 2.1 time: 0.717683 Aug 04 17:29:42.545279 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2999/6028] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:41 2022] GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46 => generated 1324 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:43.568801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e56389d8-da97-4e7f-9163-f86b3ce778b5 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:43.570235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e56389d8-da97-4e7f-9163-f86b3ce778b5 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] [instance: dd450ad1-cac7-4e29-b65c-7a5232b85f46] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:43.591512 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e56389d8-da97-4e7f-9163-f86b3ce778b5 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:43.595711 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e56389d8-da97-4e7f-9163-f86b3ce778b5 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:43.596459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e56389d8-da97-4e7f-9163-f86b3ce778b5 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:43.599876 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e56389d8-da97-4e7f-9163-f86b3ce778b5 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:43.602904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e56389d8-da97-4e7f-9163-f86b3ce778b5 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:43.603591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e56389d8-da97-4e7f-9163-f86b3ce778b5 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:43.885749 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e56389d8-da97-4e7f-9163-f86b3ce778b5 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5690dbde4dee4363b87e6e29cd0ad691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2785f61d718048b3a38eb70afc8566ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:43.908525 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e56389d8-da97-4e7f-9163-f86b3ce778b5 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] 10.222.0.93 "GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46" status: 200 len: 1324 microversion: 2.1 time: 0.346176 Aug 04 17:29:43.909407 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3030/6029] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:43 2022] GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46 => generated 1324 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:44.930764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ebc902fc-df76-4333-b677-612d6fb56ccb tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:44.931567 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ebc902fc-df76-4333-b677-612d6fb56ccb tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] [instance: dd450ad1-cac7-4e29-b65c-7a5232b85f46] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:44.942965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ebc902fc-df76-4333-b677-612d6fb56ccb tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:44.951699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ebc902fc-df76-4333-b677-612d6fb56ccb tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:44.954213 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ebc902fc-df76-4333-b677-612d6fb56ccb tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:44.956639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ebc902fc-df76-4333-b677-612d6fb56ccb tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:44.964604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ebc902fc-df76-4333-b677-612d6fb56ccb tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:44.966595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ebc902fc-df76-4333-b677-612d6fb56ccb tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:45.851046 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ebc902fc-df76-4333-b677-612d6fb56ccb tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5690dbde4dee4363b87e6e29cd0ad691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2785f61d718048b3a38eb70afc8566ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:45.875641 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ebc902fc-df76-4333-b677-612d6fb56ccb tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] 10.222.0.93 "GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46" status: 200 len: 1324 microversion: 2.1 time: 0.949240 Aug 04 17:29:45.878432 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3000/6030] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:44 2022] GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46 => generated 1324 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:46.900443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1d3dfb2f-ceae-47bb-9349-0fb74a675cf0 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:46.901946 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1d3dfb2f-ceae-47bb-9349-0fb74a675cf0 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] [instance: dd450ad1-cac7-4e29-b65c-7a5232b85f46] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:46.932152 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d3dfb2f-ceae-47bb-9349-0fb74a675cf0 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:46.940180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d3dfb2f-ceae-47bb-9349-0fb74a675cf0 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:46.942933 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d3dfb2f-ceae-47bb-9349-0fb74a675cf0 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:46.943730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d3dfb2f-ceae-47bb-9349-0fb74a675cf0 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:46.944219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d3dfb2f-ceae-47bb-9349-0fb74a675cf0 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:46.950882 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d3dfb2f-ceae-47bb-9349-0fb74a675cf0 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:47.513262 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1d3dfb2f-ceae-47bb-9349-0fb74a675cf0 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5690dbde4dee4363b87e6e29cd0ad691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2785f61d718048b3a38eb70afc8566ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:47.530219 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1d3dfb2f-ceae-47bb-9349-0fb74a675cf0 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] 10.222.0.93 "GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46" status: 200 len: 1324 microversion: 2.1 time: 0.635517 Aug 04 17:29:47.553112 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3031/6031] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:46 2022] GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46 => generated 1324 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:48.560855 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2e82f298-f94f-4c23-8450-7105215d2ccf tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:48.565570 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2e82f298-f94f-4c23-8450-7105215d2ccf tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] [instance: dd450ad1-cac7-4e29-b65c-7a5232b85f46] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:48.597539 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e82f298-f94f-4c23-8450-7105215d2ccf tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:48.598437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e82f298-f94f-4c23-8450-7105215d2ccf tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:48.602333 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e82f298-f94f-4c23-8450-7105215d2ccf tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:48.603483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e82f298-f94f-4c23-8450-7105215d2ccf tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:48.604112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e82f298-f94f-4c23-8450-7105215d2ccf tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:48.604695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e82f298-f94f-4c23-8450-7105215d2ccf tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:49.990938 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2e82f298-f94f-4c23-8450-7105215d2ccf tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5690dbde4dee4363b87e6e29cd0ad691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2785f61d718048b3a38eb70afc8566ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:50.005885 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2e82f298-f94f-4c23-8450-7105215d2ccf tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] 10.222.0.93 "GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46" status: 200 len: 1324 microversion: 2.1 time: 1.448084 Aug 04 17:29:50.007846 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3001/6032] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:48 2022] GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46 => generated 1324 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:29:50.587624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-7cc0d8be-7237-4271-8bfb-6d496f9230c3 req-0c52032b-3cf1-4f3d-a6d4-a4bd083cf75c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd450ad1-cac7-4e29-b65c-7a5232b85f46", "name": "network-vif-plugged", "status": "completed", "tag": "5b464f94-604f-4dec-838c-d87b98b500b0"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:29:50.599716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:29:50.618889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7cc0d8be-7237-4271-8bfb-6d496f9230c3 req-0c52032b-3cf1-4f3d-a6d4-a4bd083cf75c service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:50.619537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7cc0d8be-7237-4271-8bfb-6d496f9230c3 req-0c52032b-3cf1-4f3d-a6d4-a4bd083cf75c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:50.620433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7cc0d8be-7237-4271-8bfb-6d496f9230c3 req-0c52032b-3cf1-4f3d-a6d4-a4bd083cf75c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:50.637930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=45 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:29:50.640275 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-7cc0d8be-7237-4271-8bfb-6d496f9230c3 req-0c52032b-3cf1-4f3d-a6d4-a4bd083cf75c service nova] Creating event network-vif-plugged:5b464f94-604f-4dec-838c-d87b98b500b0 for instance dd450ad1-cac7-4e29-b65c-7a5232b85f46 on n-h1-851359-3 Aug 04 17:29:50.646525 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-7cc0d8be-7237-4271-8bfb-6d496f9230c3 req-0c52032b-3cf1-4f3d-a6d4-a4bd083cf75c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065223 Aug 04 17:29:50.648620 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3032/6033] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:29:51.029636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4f14c529-966c-4c09-b259-320d1be9649f tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:51.030606 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4f14c529-966c-4c09-b259-320d1be9649f tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] [instance: dd450ad1-cac7-4e29-b65c-7a5232b85f46] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:51.043040 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f14c529-966c-4c09-b259-320d1be9649f tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:51.043694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f14c529-966c-4c09-b259-320d1be9649f tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:51.044430 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f14c529-966c-4c09-b259-320d1be9649f tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:51.045411 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f14c529-966c-4c09-b259-320d1be9649f tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:51.047033 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f14c529-966c-4c09-b259-320d1be9649f tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:51.048189 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f14c529-966c-4c09-b259-320d1be9649f tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:51.547957 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4f14c529-966c-4c09-b259-320d1be9649f tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5690dbde4dee4363b87e6e29cd0ad691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2785f61d718048b3a38eb70afc8566ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:51.588594 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4f14c529-966c-4c09-b259-320d1be9649f tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] 10.222.0.93 "GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46" status: 200 len: 1324 microversion: 2.1 time: 0.563234 Aug 04 17:29:51.610296 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3002/6034] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:51 2022] GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46 => generated 1324 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:52.636625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3269f075-0dd3-49dd-a965-a9609d36850f tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:52.645033 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3269f075-0dd3-49dd-a965-a9609d36850f tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] [instance: dd450ad1-cac7-4e29-b65c-7a5232b85f46] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:52.689302 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3269f075-0dd3-49dd-a965-a9609d36850f tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:52.690776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3269f075-0dd3-49dd-a965-a9609d36850f tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:52.692864 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3269f075-0dd3-49dd-a965-a9609d36850f tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:52.697896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3269f075-0dd3-49dd-a965-a9609d36850f tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:52.699120 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3269f075-0dd3-49dd-a965-a9609d36850f tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:52.705431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3269f075-0dd3-49dd-a965-a9609d36850f tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:54.064318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3269f075-0dd3-49dd-a965-a9609d36850f tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5690dbde4dee4363b87e6e29cd0ad691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2785f61d718048b3a38eb70afc8566ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:54.074276 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3269f075-0dd3-49dd-a965-a9609d36850f tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] 10.222.0.93 "GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46" status: 200 len: 1522 microversion: 2.1 time: 1.448551 Aug 04 17:29:54.090533 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3033/6035] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:52 2022] GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46 => generated 1522 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:54.096625 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b8b4ad31-513d-4d5b-8adf-adcadfc8c3fc tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:54.097763 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b8b4ad31-513d-4d5b-8adf-adcadfc8c3fc tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] [instance: dd450ad1-cac7-4e29-b65c-7a5232b85f46] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:54.106123 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8b4ad31-513d-4d5b-8adf-adcadfc8c3fc tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:54.106860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8b4ad31-513d-4d5b-8adf-adcadfc8c3fc tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:54.107499 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8b4ad31-513d-4d5b-8adf-adcadfc8c3fc tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:54.108414 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8b4ad31-513d-4d5b-8adf-adcadfc8c3fc tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:54.109042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8b4ad31-513d-4d5b-8adf-adcadfc8c3fc tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:54.109649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8b4ad31-513d-4d5b-8adf-adcadfc8c3fc tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:54.167738 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-b8b4ad31-513d-4d5b-8adf-adcadfc8c3fc tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] HTTP exception thrown: Action 999 not found Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b8b4ad31-513d-4d5b-8adf-adcadfc8c3fc tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Request method failure captured: Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46/os-instance-actions/999 HTTP/1.1 Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AHvYmge9SQYKXvPLgbAbnTuntCQA9Zp5pQgvaUiQ_6DKryG4MxYQeI1_7LcMDUaIoTQHIzo6Bd80QbSvkNZZMuPI_Z_EMyr7Kv_ylBaSSM0sPwZ93V-A9OxRRM4aXx1vmmtXC6DJoN1_d7N2EqmIEPF1WrvYm0uRgc9mIAVVm61tvk Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 2785f61d718048b3a38eb70afc8566ec Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1527655437 Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2785f61d718048b3a38eb70afc8566ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2785f61d718048b3a38eb70afc8566ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2785f61d718048b3a38eb70afc8566ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2785f61d718048b3a38eb70afc8566ec"}]}] Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1527655437 Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 2785f61d718048b3a38eb70afc8566ec Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1527655437 Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-InstanceActionsNegativeTestJSON-1527655437-project Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 5690dbde4dee4363b87e6e29cd0ad691 Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1527655437-project Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: exception: Action 999 not found Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'server_id': 'dd450ad1-cac7-4e29-b65c-7a5232b85f46', 'id': '999'} Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 04 17:29:54.173358 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:29:54.179304 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b8b4ad31-513d-4d5b-8adf-adcadfc8c3fc tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Returning 404 to user: Action 999 not found {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:29:54.180436 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b8b4ad31-513d-4d5b-8adf-adcadfc8c3fc tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] 10.222.0.93 "GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.088021 Aug 04 17:29:54.191571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6f7a7fc7-5bde-44f4-83ec-0c4d7878cbd9 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Calling method '.version_select at 0x7f1e5b75ed30>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:54.192496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6f7a7fc7-5bde-44f4-83ec-0c4d7878cbd9 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] [instance: 3420b04c-6c2b-4fe5-9a02-8d2470940878] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:54.194363 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3003/6036] 10.222.0.93 () {58 vars in 1308 bytes} [Thu Aug 4 17:29:54 2022] GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46/os-instance-actions/999 => generated 66 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 04 17:29:54.200969 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-6f7a7fc7-5bde-44f4-83ec-0c4d7878cbd9 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] HTTP exception thrown: Instance 3420b04c-6c2b-4fe5-9a02-8d2470940878 could not be found. Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6f7a7fc7-5bde-44f4-83ec-0c4d7878cbd9 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Request method failure captured: Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/3420b04c-6c2b-4fe5-9a02-8d2470940878/os-instance-actions HTTP/1.1 Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7AHvYmge9SQYKXvPLgbAbnTuntCQA9Zp5pQgvaUiQ_6DKryG4MxYQeI1_7LcMDUaIoTQHIzo6Bd80QbSvkNZZMuPI_Z_EMyr7Kv_ylBaSSM0sPwZ93V-A9OxRRM4aXx1vmmtXC6DJoN1_d7N2EqmIEPF1WrvYm0uRgc9mIAVVm61tvk Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 2785f61d718048b3a38eb70afc8566ec Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1527655437 Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2785f61d718048b3a38eb70afc8566ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2785f61d718048b3a38eb70afc8566ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2785f61d718048b3a38eb70afc8566ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2785f61d718048b3a38eb70afc8566ec"}]}] Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1527655437 Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 2785f61d718048b3a38eb70afc8566ec Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1527655437 Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-InstanceActionsNegativeTestJSON-1527655437-project Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 5690dbde4dee4363b87e6e29cd0ad691 Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1527655437-project Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 3420b04c-6c2b-4fe5-9a02-8d2470940878 could not be found. Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'server_id': '3420b04c-6c2b-4fe5-9a02-8d2470940878'} Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3420b04c-6c2b-4fe5-9a02-8d2470940878 could not be found. Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:29:54.209261 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:29:54.215339 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3420b04c-6c2b-4fe5-9a02-8d2470940878 could not be found. Aug 04 17:29:54.215339 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:29:54.215339 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:29:54.215339 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:29:54.215339 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:29:54.215339 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:29:54.215339 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:29:54.215339 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:29:54.215339 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:29:54.215339 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3420b04c-6c2b-4fe5-9a02-8d2470940878 could not be found. Aug 04 17:29:54.215339 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:29:54.218815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6f7a7fc7-5bde-44f4-83ec-0c4d7878cbd9 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Returning 404 to user: Instance 3420b04c-6c2b-4fe5-9a02-8d2470940878 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:29:54.221473 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6f7a7fc7-5bde-44f4-83ec-0c4d7878cbd9 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] 10.222.0.93 "GET /compute/v2.1/servers/3420b04c-6c2b-4fe5-9a02-8d2470940878/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.033984 Aug 04 17:29:54.232509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1539769c-8933-43f6-84a0-65f1d4061d45 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:54.233412 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1539769c-8933-43f6-84a0-65f1d4061d45 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] [instance: dd450ad1-cac7-4e29-b65c-7a5232b85f46] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:54.238076 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3034/6037] 10.222.0.93 () {58 vars in 1296 bytes} [Thu Aug 4 17:29:54 2022] GET /compute/v2.1/servers/3420b04c-6c2b-4fe5-9a02-8d2470940878/os-instance-actions => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:29:54.249127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1539769c-8933-43f6-84a0-65f1d4061d45 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:54.257737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1539769c-8933-43f6-84a0-65f1d4061d45 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:54.259048 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1539769c-8933-43f6-84a0-65f1d4061d45 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:54.260068 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1539769c-8933-43f6-84a0-65f1d4061d45 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:54.260792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1539769c-8933-43f6-84a0-65f1d4061d45 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:54.261655 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1539769c-8933-43f6-84a0-65f1d4061d45 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:54.292839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1539769c-8933-43f6-84a0-65f1d4061d45 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] [instance: dd450ad1-cac7-4e29-b65c-7a5232b85f46] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:29:54.449084 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1539769c-8933-43f6-84a0-65f1d4061d45 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] 10.222.0.93 "DELETE /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46" status: 204 len: 0 microversion: 2.1 time: 0.216133 Aug 04 17:29:54.461169 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-70f37dfc-6679-4903-8a0f-5292cee083ff tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:54.462092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-70f37dfc-6679-4903-8a0f-5292cee083ff tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] [instance: dd450ad1-cac7-4e29-b65c-7a5232b85f46] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:54.466704 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3004/6038] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:29:54 2022] DELETE /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:29:54.478029 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70f37dfc-6679-4903-8a0f-5292cee083ff tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:54.479333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70f37dfc-6679-4903-8a0f-5292cee083ff tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:54.480309 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70f37dfc-6679-4903-8a0f-5292cee083ff tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:54.481706 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70f37dfc-6679-4903-8a0f-5292cee083ff tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:54.483462 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70f37dfc-6679-4903-8a0f-5292cee083ff tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:54.484025 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70f37dfc-6679-4903-8a0f-5292cee083ff tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:55.066112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-70f37dfc-6679-4903-8a0f-5292cee083ff tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5690dbde4dee4363b87e6e29cd0ad691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2785f61d718048b3a38eb70afc8566ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:55.114935 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-70f37dfc-6679-4903-8a0f-5292cee083ff tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] 10.222.0.93 "GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46" status: 200 len: 1528 microversion: 2.1 time: 0.655865 Aug 04 17:29:55.128919 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3035/6039] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:54 2022] GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46 => generated 1528 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:56.137559 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8978ce79-1533-49a2-9155-6b0049e4ee0c tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:56.138922 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8978ce79-1533-49a2-9155-6b0049e4ee0c tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] [instance: dd450ad1-cac7-4e29-b65c-7a5232b85f46] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:56.148970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:29:56.153145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8978ce79-1533-49a2-9155-6b0049e4ee0c tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:56.154681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8978ce79-1533-49a2-9155-6b0049e4ee0c tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:56.155995 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8978ce79-1533-49a2-9155-6b0049e4ee0c tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:56.158191 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8978ce79-1533-49a2-9155-6b0049e4ee0c tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:56.158835 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8978ce79-1533-49a2-9155-6b0049e4ee0c tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:56.162003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8978ce79-1533-49a2-9155-6b0049e4ee0c tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:56.216683 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:29:56.641017 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8978ce79-1533-49a2-9155-6b0049e4ee0c tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5690dbde4dee4363b87e6e29cd0ad691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2785f61d718048b3a38eb70afc8566ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:56.649088 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8978ce79-1533-49a2-9155-6b0049e4ee0c tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] 10.222.0.93 "GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46" status: 200 len: 1528 microversion: 2.1 time: 0.515825 Aug 04 17:29:56.667068 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3005/6040] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:56 2022] GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46 => generated 1528 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:57.013628 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b8814ce2-b6fb-4d1a-b5f2-6f1a33197284 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Action: 'create', calling method: .version_select at 0x7f1e5b00ca60>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1890990777", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHA8HRbLQHqgsKqOG5+TSYPOtZkwaXqi3sHGQpXMFkFAP8QAcMF3Z5okopgO4b6rn1Zft+PxYPmdwvbQkpXTNcb5nZsio/k3ue0p0PENBHXKO9WkTXKOrxMgDzYfewu/Kw=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:29:57.075262 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-b8814ce2-b6fb-4d1a-b5f2-6f1a33197284 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Getting quotas for project 0211a3372bae447fbdfb4cb849a265d4. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:29:57.087311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-b8814ce2-b6fb-4d1a-b5f2-6f1a33197284 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Getting quotas for user 2210ca1cd35f43e8bc4b10710c2900ed and project 0211a3372bae447fbdfb4cb849a265d4. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:29:57.137171 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b8814ce2-b6fb-4d1a-b5f2-6f1a33197284 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.515344 Aug 04 17:29:57.143256 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3036/6041] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:29:56 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:29:57.675726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6b1ea541-c673-43ef-b95f-719014d90026 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:57.678079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6b1ea541-c673-43ef-b95f-719014d90026 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] [instance: dd450ad1-cac7-4e29-b65c-7a5232b85f46] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:57.691741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6b1ea541-c673-43ef-b95f-719014d90026 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:57.699484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6b1ea541-c673-43ef-b95f-719014d90026 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:57.702143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6b1ea541-c673-43ef-b95f-719014d90026 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:57.703233 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6b1ea541-c673-43ef-b95f-719014d90026 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:57.703955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6b1ea541-c673-43ef-b95f-719014d90026 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:57.707584 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6b1ea541-c673-43ef-b95f-719014d90026 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:57.736036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-8febfda8-3ba4-4ef0-9382-5723d6500d91 req-198f0d76-e1c0-4689-bc33-338d251379c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd450ad1-cac7-4e29-b65c-7a5232b85f46", "name": "network-vif-deleted", "tag": "5b464f94-604f-4dec-838c-d87b98b500b0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:29:57.754639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8febfda8-3ba4-4ef0-9382-5723d6500d91 req-198f0d76-e1c0-4689-bc33-338d251379c3 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:57.755051 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8febfda8-3ba4-4ef0-9382-5723d6500d91 req-198f0d76-e1c0-4689-bc33-338d251379c3 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:57.755494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8febfda8-3ba4-4ef0-9382-5723d6500d91 req-198f0d76-e1c0-4689-bc33-338d251379c3 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:57.837677 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-8febfda8-3ba4-4ef0-9382-5723d6500d91 req-198f0d76-e1c0-4689-bc33-338d251379c3 service nova] Creating event network-vif-deleted:5b464f94-604f-4dec-838c-d87b98b500b0 for instance dd450ad1-cac7-4e29-b65c-7a5232b85f46 on n-h1-851359-3 Aug 04 17:29:57.859877 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-8febfda8-3ba4-4ef0-9382-5723d6500d91 req-198f0d76-e1c0-4689-bc33-338d251379c3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.280856 Aug 04 17:29:57.861077 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3006/6042] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:29:57.955773 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6b1ea541-c673-43ef-b95f-719014d90026 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5690dbde4dee4363b87e6e29cd0ad691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2785f61d718048b3a38eb70afc8566ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:29:57.988798 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6b1ea541-c673-43ef-b95f-719014d90026 tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] 10.222.0.93 "GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46" status: 200 len: 1309 microversion: 2.1 time: 0.302613 Aug 04 17:29:58.014020 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3037/6043] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:57 2022] GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46 => generated 1309 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:29:59.024533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8f647206-a4ff-49a1-8ebf-e504d1380f1a tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:29:59.026400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8f647206-a4ff-49a1-8ebf-e504d1380f1a tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] [instance: dd450ad1-cac7-4e29-b65c-7a5232b85f46] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:29:59.042730 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f647206-a4ff-49a1-8ebf-e504d1380f1a tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:59.043719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f647206-a4ff-49a1-8ebf-e504d1380f1a tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:59.044891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f647206-a4ff-49a1-8ebf-e504d1380f1a tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:59.045862 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f647206-a4ff-49a1-8ebf-e504d1380f1a tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:29:59.046620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f647206-a4ff-49a1-8ebf-e504d1380f1a tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:29:59.047270 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f647206-a4ff-49a1-8ebf-e504d1380f1a tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:29:59.068716 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-8f647206-a4ff-49a1-8ebf-e504d1380f1a tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] HTTP exception thrown: Instance dd450ad1-cac7-4e29-b65c-7a5232b85f46 could not be found. Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8f647206-a4ff-49a1-8ebf-e504d1380f1a tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Request method failure captured: Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46 HTTP/1.1 Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AHvYmge9SQYKXvPLgbAbnTuntCQA9Zp5pQgvaUiQ_6DKryG4MxYQeI1_7LcMDUaIoTQHIzo6Bd80QbSvkNZZMuPI_Z_EMyr7Kv_ylBaSSM0sPwZ93V-A9OxRRM4aXx1vmmtXC6DJoN1_d7N2EqmIEPF1WrvYm0uRgc9mIAVVm61tvk Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 2785f61d718048b3a38eb70afc8566ec Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1527655437 Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2785f61d718048b3a38eb70afc8566ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/2785f61d718048b3a38eb70afc8566ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_2785f61d718048b3a38eb70afc8566ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/2785f61d718048b3a38eb70afc8566ec"}]}] Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1527655437 Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 2785f61d718048b3a38eb70afc8566ec Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1527655437 Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-InstanceActionsNegativeTestJSON-1527655437-project Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 5690dbde4dee4363b87e6e29cd0ad691 Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1527655437-project Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance dd450ad1-cac7-4e29-b65c-7a5232b85f46 could not be found. Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'dd450ad1-cac7-4e29-b65c-7a5232b85f46'} Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd450ad1-cac7-4e29-b65c-7a5232b85f46 could not be found. Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd450ad1-cac7-4e29-b65c-7a5232b85f46 could not be found. Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:29:59.071702 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:29:59.076042 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:29:59.076042 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:29:59.076042 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:29:59.076042 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:29:59.076042 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:29:59.076042 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:29:59.076042 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd450ad1-cac7-4e29-b65c-7a5232b85f46 could not be found. Aug 04 17:29:59.076042 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:29:59.079174 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8f647206-a4ff-49a1-8ebf-e504d1380f1a tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] Returning 404 to user: Instance dd450ad1-cac7-4e29-b65c-7a5232b85f46 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:29:59.080457 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8f647206-a4ff-49a1-8ebf-e504d1380f1a tempest-InstanceActionsNegativeTestJSON-1527655437 tempest-InstanceActionsNegativeTestJSON-1527655437-project] 10.222.0.93 "GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46" status: 404 len: 111 microversion: 2.1 time: 0.063074 Aug 04 17:29:59.085923 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3007/6044] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:29:59 2022] GET /compute/v2.1/servers/dd450ad1-cac7-4e29-b65c-7a5232b85f46 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:30:01.180589 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8fb04b06-f961-4d3b-a6ff-96d3eea01dc1 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1411652980", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1890990777", "security_groups": [{"name": "tempest-secgroup-smoke-1345451461"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "3ee9e979-2924-42e2-a0df-9342bbce2459"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:30:01.728121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-8fb04b06-f961-4d3b-a6ff-96d3eea01dc1 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] validate_networks() for [('3ee9e979-2924-42e2-a0df-9342bbce2459', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:30:03.137105 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-8fb04b06-f961-4d3b-a6ff-96d3eea01dc1 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Getting quotas for project 0211a3372bae447fbdfb4cb849a265d4. Resources: dict_keys(['metadata_items']) {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:30:03.157036 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-8fb04b06-f961-4d3b-a6ff-96d3eea01dc1 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Getting quotas for user 2210ca1cd35f43e8bc4b10710c2900ed and project 0211a3372bae447fbdfb4cb849a265d4. Resources: dict_keys(['metadata_items']) {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:30:03.191740 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-8fb04b06-f961-4d3b-a6ff-96d3eea01dc1 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:30:03.192275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-8fb04b06-f961-4d3b-a6ff-96d3eea01dc1 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:30:03.192870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-8fb04b06-f961-4d3b-a6ff-96d3eea01dc1 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:30:03.193473 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-8fb04b06-f961-4d3b-a6ff-96d3eea01dc1 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:30:03.194045 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-8fb04b06-f961-4d3b-a6ff-96d3eea01dc1 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:30:03.204768 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fb04b06-f961-4d3b-a6ff-96d3eea01dc1 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:03.205600 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fb04b06-f961-4d3b-a6ff-96d3eea01dc1 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:03.206381 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fb04b06-f961-4d3b-a6ff-96d3eea01dc1 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:03.207367 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fb04b06-f961-4d3b-a6ff-96d3eea01dc1 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:03.208053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fb04b06-f961-4d3b-a6ff-96d3eea01dc1 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:03.209352 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fb04b06-f961-4d3b-a6ff-96d3eea01dc1 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:03.246703 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-8fb04b06-f961-4d3b-a6ff-96d3eea01dc1 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Getting quotas for project 0211a3372bae447fbdfb4cb849a265d4. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:30:03.255155 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-8fb04b06-f961-4d3b-a6ff-96d3eea01dc1 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Getting quotas for user 2210ca1cd35f43e8bc4b10710c2900ed and project 0211a3372bae447fbdfb4cb849a265d4. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:30:03.272563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8fb04b06-f961-4d3b-a6ff-96d3eea01dc1 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:30:03.276545 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8fb04b06-f961-4d3b-a6ff-96d3eea01dc1 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] [instance: 4c54a751-dda6-452f-a556-028fdee6f15f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:30:03.443581 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8fb04b06-f961-4d3b-a6ff-96d3eea01dc1 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.267066 Aug 04 17:30:03.451280 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3038/6045] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:30:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 2270 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:30:03.461209 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4d9c441b-434a-4322-afab-c6958bc5a1b4 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:03.462697 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4d9c441b-434a-4322-afab-c6958bc5a1b4 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] [instance: 4c54a751-dda6-452f-a556-028fdee6f15f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:03.760985 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4d9c441b-434a-4322-afab-c6958bc5a1b4 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2210ca1cd35f43e8bc4b10710c2900ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0211a3372bae447fbdfb4cb849a265d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:03.774487 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4d9c441b-434a-4322-afab-c6958bc5a1b4 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] 10.222.0.93 "GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f" status: 200 len: 1303 microversion: 2.1 time: 0.321680 Aug 04 17:30:03.783500 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3008/6046] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:03 2022] GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f => generated 1303 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:04.815996 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-aeeafd66-26bc-4dda-b31f-ad05f9cc8470 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:04.818423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-aeeafd66-26bc-4dda-b31f-ad05f9cc8470 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] [instance: 4c54a751-dda6-452f-a556-028fdee6f15f] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:04.856418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aeeafd66-26bc-4dda-b31f-ad05f9cc8470 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:04.857327 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aeeafd66-26bc-4dda-b31f-ad05f9cc8470 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:04.860394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aeeafd66-26bc-4dda-b31f-ad05f9cc8470 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:04.861898 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aeeafd66-26bc-4dda-b31f-ad05f9cc8470 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:04.864272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aeeafd66-26bc-4dda-b31f-ad05f9cc8470 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:04.880432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aeeafd66-26bc-4dda-b31f-ad05f9cc8470 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:05.100627 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-aeeafd66-26bc-4dda-b31f-ad05f9cc8470 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2210ca1cd35f43e8bc4b10710c2900ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0211a3372bae447fbdfb4cb849a265d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:05.129418 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-aeeafd66-26bc-4dda-b31f-ad05f9cc8470 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] 10.222.0.93 "GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f" status: 200 len: 1299 microversion: 2.1 time: 0.324656 Aug 04 17:30:05.134631 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3039/6047] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:04 2022] GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f => generated 1299 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:06.155653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0163629b-c281-435e-a4d8-1955f2976dbe tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:06.156695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0163629b-c281-435e-a4d8-1955f2976dbe tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] [instance: 4c54a751-dda6-452f-a556-028fdee6f15f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:06.168218 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0163629b-c281-435e-a4d8-1955f2976dbe tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:06.168718 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0163629b-c281-435e-a4d8-1955f2976dbe tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:06.169181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0163629b-c281-435e-a4d8-1955f2976dbe tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:06.173125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0163629b-c281-435e-a4d8-1955f2976dbe tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:06.173821 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0163629b-c281-435e-a4d8-1955f2976dbe tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:06.176124 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0163629b-c281-435e-a4d8-1955f2976dbe tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:06.447616 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0163629b-c281-435e-a4d8-1955f2976dbe tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2210ca1cd35f43e8bc4b10710c2900ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0211a3372bae447fbdfb4cb849a265d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:06.464705 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0163629b-c281-435e-a4d8-1955f2976dbe tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] 10.222.0.93 "GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f" status: 200 len: 1361 microversion: 2.1 time: 0.312930 Aug 04 17:30:06.469221 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3009/6048] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:06 2022] GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f => generated 1361 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:07.496717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8e7a5e08-74b6-4ad4-ac47-75e430f63a51 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:07.497342 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8e7a5e08-74b6-4ad4-ac47-75e430f63a51 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] [instance: 4c54a751-dda6-452f-a556-028fdee6f15f] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:07.505040 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e7a5e08-74b6-4ad4-ac47-75e430f63a51 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:07.506098 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e7a5e08-74b6-4ad4-ac47-75e430f63a51 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:07.506880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e7a5e08-74b6-4ad4-ac47-75e430f63a51 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:07.507918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e7a5e08-74b6-4ad4-ac47-75e430f63a51 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:07.509206 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e7a5e08-74b6-4ad4-ac47-75e430f63a51 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:07.509805 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e7a5e08-74b6-4ad4-ac47-75e430f63a51 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:07.612546 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8e7a5e08-74b6-4ad4-ac47-75e430f63a51 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2210ca1cd35f43e8bc4b10710c2900ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0211a3372bae447fbdfb4cb849a265d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:07.623240 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8e7a5e08-74b6-4ad4-ac47-75e430f63a51 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] 10.222.0.93 "GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f" status: 200 len: 1361 microversion: 2.1 time: 0.130337 Aug 04 17:30:07.628902 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3040/6049] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:07 2022] GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f => generated 1361 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:08.650267 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-adba5d8a-f1de-436c-8713-890cb0aaaf51 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:08.650735 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-adba5d8a-f1de-436c-8713-890cb0aaaf51 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] [instance: 4c54a751-dda6-452f-a556-028fdee6f15f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:08.661807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adba5d8a-f1de-436c-8713-890cb0aaaf51 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:08.662966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adba5d8a-f1de-436c-8713-890cb0aaaf51 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:08.672457 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adba5d8a-f1de-436c-8713-890cb0aaaf51 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:08.673243 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adba5d8a-f1de-436c-8713-890cb0aaaf51 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:08.673728 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adba5d8a-f1de-436c-8713-890cb0aaaf51 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:08.685785 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adba5d8a-f1de-436c-8713-890cb0aaaf51 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:08.856856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-adba5d8a-f1de-436c-8713-890cb0aaaf51 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2210ca1cd35f43e8bc4b10710c2900ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0211a3372bae447fbdfb4cb849a265d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:08.865927 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-adba5d8a-f1de-436c-8713-890cb0aaaf51 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] 10.222.0.93 "GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f" status: 200 len: 1361 microversion: 2.1 time: 0.220286 Aug 04 17:30:08.882111 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3010/6050] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:08 2022] GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f => generated 1361 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:09.889070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-50595a47-1e44-415c-b261-2517c5487b42 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:09.889702 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-50595a47-1e44-415c-b261-2517c5487b42 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] [instance: 4c54a751-dda6-452f-a556-028fdee6f15f] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:09.906581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50595a47-1e44-415c-b261-2517c5487b42 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:09.907078 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50595a47-1e44-415c-b261-2517c5487b42 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:09.907524 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50595a47-1e44-415c-b261-2517c5487b42 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:09.911882 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50595a47-1e44-415c-b261-2517c5487b42 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:09.912419 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50595a47-1e44-415c-b261-2517c5487b42 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:09.913080 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50595a47-1e44-415c-b261-2517c5487b42 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:10.368228 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-50595a47-1e44-415c-b261-2517c5487b42 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2210ca1cd35f43e8bc4b10710c2900ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0211a3372bae447fbdfb4cb849a265d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:10.376275 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-50595a47-1e44-415c-b261-2517c5487b42 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] 10.222.0.93 "GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f" status: 200 len: 1429 microversion: 2.1 time: 0.491024 Aug 04 17:30:10.376875 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3041/6051] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:09 2022] GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f => generated 1429 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:11.400743 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bd9dc13f-9807-4c3f-9588-1478ddfa9092 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:11.402117 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bd9dc13f-9807-4c3f-9588-1478ddfa9092 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] [instance: 4c54a751-dda6-452f-a556-028fdee6f15f] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:11.415504 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bd9dc13f-9807-4c3f-9588-1478ddfa9092 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:11.416656 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bd9dc13f-9807-4c3f-9588-1478ddfa9092 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:11.417301 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bd9dc13f-9807-4c3f-9588-1478ddfa9092 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:11.421498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bd9dc13f-9807-4c3f-9588-1478ddfa9092 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:11.424382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bd9dc13f-9807-4c3f-9588-1478ddfa9092 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:11.425661 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bd9dc13f-9807-4c3f-9588-1478ddfa9092 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:11.670397 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bf29b756-3440-4709-900d-87dc3b0709aa tempest-MultipleCreateNegativeTestJSON-279586349 tempest-MultipleCreateNegativeTestJSON-279586349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-622886249", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:30:11.678370 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-bf29b756-3440-4709-900d-87dc3b0709aa tempest-MultipleCreateNegativeTestJSON-279586349 tempest-MultipleCreateNegativeTestJSON-279586349-project] HTTP exception thrown: min_count must be <= max_count Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bf29b756-3440-4709-900d-87dc3b0709aa tempest-MultipleCreateNegativeTestJSON-279586349 tempest-MultipleCreateNegativeTestJSON-279586349-project] Request method failure captured: Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 183 Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AIi24UnZA6oLlncjafLHfKxSvAmkBtpA3qvPYrMidQ8WfhSZkYrPPG4zHwTnk3hK9sqFjHqZjQKM48sULfl7hNP0kTS-Z9QTFJzHt2V3UF_h8gXNyjN0mYueIZ9PYH4pNZBOczblcjJoS3EnlMSj_FMOe2BxBb8d55VlnZg4wY_-IA Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 679ae8cb4af341c38742ce17d5c2f0fd Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-279586349 Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/679ae8cb4af341c38742ce17d5c2f0fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/679ae8cb4af341c38742ce17d5c2f0fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_679ae8cb4af341c38742ce17d5c2f0fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/679ae8cb4af341c38742ce17d5c2f0fd"}]}] Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-279586349 Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 679ae8cb4af341c38742ce17d5c2f0fd Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-279586349 Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-MultipleCreateNegativeTestJSON-279586349-project Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: d04b60c645a448a28ca8147d743827ee Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-279586349-project Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-622886249", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: exception: min_count must be <= max_count Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-622886249', 'imageRef': '93ebc91d-2d7a-4ab2-b133-dcf9559166d9', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 04 17:30:11.682853 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:11.687892 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bf29b756-3440-4709-900d-87dc3b0709aa tempest-MultipleCreateNegativeTestJSON-279586349 tempest-MultipleCreateNegativeTestJSON-279586349-project] Returning 400 to user: min_count must be <= max_count {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:30:11.687892 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bf29b756-3440-4709-900d-87dc3b0709aa tempest-MultipleCreateNegativeTestJSON-279586349 tempest-MultipleCreateNegativeTestJSON-279586349-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.515990 Aug 04 17:30:11.687892 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3011/6052] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:30:11 2022] POST /compute/v2.1/servers => generated 74 bytes in 517 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 04 17:30:11.818413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-968490fe-a085-4e75-96af-9e8a14475537 tempest-MultipleCreateNegativeTestJSON-279586349 tempest-MultipleCreateNegativeTestJSON-279586349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-467647134", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "max_count": 0}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-968490fe-a085-4e75-96af-9e8a14475537 tempest-MultipleCreateNegativeTestJSON-279586349 tempest-MultipleCreateNegativeTestJSON-279586349-project] Request method failure captured: Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 167 Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AIi24UnZA6oLlncjafLHfKxSvAmkBtpA3qvPYrMidQ8WfhSZkYrPPG4zHwTnk3hK9sqFjHqZjQKM48sULfl7hNP0kTS-Z9QTFJzHt2V3UF_h8gXNyjN0mYueIZ9PYH4pNZBOczblcjJoS3EnlMSj_FMOe2BxBb8d55VlnZg4wY_-IA Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 679ae8cb4af341c38742ce17d5c2f0fd Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-279586349 Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/679ae8cb4af341c38742ce17d5c2f0fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/679ae8cb4af341c38742ce17d5c2f0fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_679ae8cb4af341c38742ce17d5c2f0fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/679ae8cb4af341c38742ce17d5c2f0fd"}]}] Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-279586349 Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 679ae8cb4af341c38742ce17d5c2f0fd Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-279586349 Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-MultipleCreateNegativeTestJSON-279586349-project Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: d04b60c645a448a28ca8147d743827ee Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-279586349-project Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-467647134", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "max_count": 0}} Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-467647134', 'imageRef': '93ebc91d-2d7a-4ab2-b133-dcf9559166d9', 'flavorRef': '452', 'max_count': 0}}} Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 0 Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:30:11.831117 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:30:11.849470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:30:11.849470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:30:11.849470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:30:11.849470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:30:11.849470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 04 17:30:11.849470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:11.849470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:30:11.849470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:11.849470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:30:11.849470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:30:11.849470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:30:11.849470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:30:11.849470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:30:11.849470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 04 17:30:11.849470 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:11.849470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-968490fe-a085-4e75-96af-9e8a14475537 tempest-MultipleCreateNegativeTestJSON-279586349 tempest-MultipleCreateNegativeTestJSON-279586349-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:30:11.849470 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-968490fe-a085-4e75-96af-9e8a14475537 tempest-MultipleCreateNegativeTestJSON-279586349 tempest-MultipleCreateNegativeTestJSON-279586349-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.018704 Aug 04 17:30:11.849470 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3012/6053] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:30:11 2022] POST /compute/v2.1/servers => generated 130 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 17:30:11.937157 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cbe88995-066b-4dd4-a90d-1f6339bc920c tempest-MultipleCreateNegativeTestJSON-279586349 tempest-MultipleCreateNegativeTestJSON-279586349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1136967548", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "max_count": 2.5}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cbe88995-066b-4dd4-a90d-1f6339bc920c tempest-MultipleCreateNegativeTestJSON-279586349 tempest-MultipleCreateNegativeTestJSON-279586349-project] Request method failure captured: Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 170 Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AIi24UnZA6oLlncjafLHfKxSvAmkBtpA3qvPYrMidQ8WfhSZkYrPPG4zHwTnk3hK9sqFjHqZjQKM48sULfl7hNP0kTS-Z9QTFJzHt2V3UF_h8gXNyjN0mYueIZ9PYH4pNZBOczblcjJoS3EnlMSj_FMOe2BxBb8d55VlnZg4wY_-IA Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 679ae8cb4af341c38742ce17d5c2f0fd Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-279586349 Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/679ae8cb4af341c38742ce17d5c2f0fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/679ae8cb4af341c38742ce17d5c2f0fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_679ae8cb4af341c38742ce17d5c2f0fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/679ae8cb4af341c38742ce17d5c2f0fd"}]}] Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-279586349 Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 679ae8cb4af341c38742ce17d5c2f0fd Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-279586349 Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-MultipleCreateNegativeTestJSON-279586349-project Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: d04b60c645a448a28ca8147d743827ee Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-279586349-project Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1136967548", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "max_count": 2.5}} Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1136967548', 'imageRef': '93ebc91d-2d7a-4ab2-b133-dcf9559166d9', 'flavorRef': '452', 'max_count': 2.5}}} Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 2.5 Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:30:11.943036 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:30:11.948444 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:30:11.948444 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:30:11.948444 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:30:11.948444 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:30:11.948444 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 04 17:30:11.948444 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:11.948444 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:30:11.948444 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:11.948444 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:30:11.948444 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:30:11.948444 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:30:11.948444 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:30:11.948444 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:30:11.948444 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 04 17:30:11.948444 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:11.948444 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cbe88995-066b-4dd4-a90d-1f6339bc920c tempest-MultipleCreateNegativeTestJSON-279586349 tempest-MultipleCreateNegativeTestJSON-279586349-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:30:11.950424 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cbe88995-066b-4dd4-a90d-1f6339bc920c tempest-MultipleCreateNegativeTestJSON-279586349 tempest-MultipleCreateNegativeTestJSON-279586349-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.016886 Aug 04 17:30:11.951416 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3013/6054] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:30:11 2022] POST /compute/v2.1/servers => generated 139 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 17:30:12.016976 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eecd7966-9d4b-4ec5-9e15-9efe966799e6 tempest-MultipleCreateNegativeTestJSON-279586349 tempest-MultipleCreateNegativeTestJSON-279586349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-693537187", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "min_count": 0}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eecd7966-9d4b-4ec5-9e15-9efe966799e6 tempest-MultipleCreateNegativeTestJSON-279586349 tempest-MultipleCreateNegativeTestJSON-279586349-project] Request method failure captured: Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 167 Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AIi24UnZA6oLlncjafLHfKxSvAmkBtpA3qvPYrMidQ8WfhSZkYrPPG4zHwTnk3hK9sqFjHqZjQKM48sULfl7hNP0kTS-Z9QTFJzHt2V3UF_h8gXNyjN0mYueIZ9PYH4pNZBOczblcjJoS3EnlMSj_FMOe2BxBb8d55VlnZg4wY_-IA Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 679ae8cb4af341c38742ce17d5c2f0fd Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-279586349 Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/679ae8cb4af341c38742ce17d5c2f0fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/679ae8cb4af341c38742ce17d5c2f0fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_679ae8cb4af341c38742ce17d5c2f0fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/679ae8cb4af341c38742ce17d5c2f0fd"}]}] Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-279586349 Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 679ae8cb4af341c38742ce17d5c2f0fd Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-279586349 Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-MultipleCreateNegativeTestJSON-279586349-project Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: d04b60c645a448a28ca8147d743827ee Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-279586349-project Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-693537187", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "min_count": 0}} Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-693537187', 'imageRef': '93ebc91d-2d7a-4ab2-b133-dcf9559166d9', 'flavorRef': '452', 'min_count': 0}}} Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 0 Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:30:12.026092 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:30:12.030448 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:30:12.030448 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:30:12.030448 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:30:12.030448 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:30:12.030448 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 04 17:30:12.030448 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:12.030448 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:30:12.030448 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:12.030448 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:30:12.030448 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:30:12.030448 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:30:12.030448 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:30:12.030448 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:30:12.030448 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 04 17:30:12.030448 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:12.040849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eecd7966-9d4b-4ec5-9e15-9efe966799e6 tempest-MultipleCreateNegativeTestJSON-279586349 tempest-MultipleCreateNegativeTestJSON-279586349-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:30:12.042010 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eecd7966-9d4b-4ec5-9e15-9efe966799e6 tempest-MultipleCreateNegativeTestJSON-279586349 tempest-MultipleCreateNegativeTestJSON-279586349-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.030454 Aug 04 17:30:12.059295 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3014/6055] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:30:12 2022] POST /compute/v2.1/servers => generated 130 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 17:30:12.123272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f43815ee-40fc-4682-9fd8-12cd0ea2988d tempest-MultipleCreateNegativeTestJSON-279586349 tempest-MultipleCreateNegativeTestJSON-279586349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-148449806", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "min_count": 2.5}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f43815ee-40fc-4682-9fd8-12cd0ea2988d tempest-MultipleCreateNegativeTestJSON-279586349 tempest-MultipleCreateNegativeTestJSON-279586349-project] Request method failure captured: Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 169 Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AIi24UnZA6oLlncjafLHfKxSvAmkBtpA3qvPYrMidQ8WfhSZkYrPPG4zHwTnk3hK9sqFjHqZjQKM48sULfl7hNP0kTS-Z9QTFJzHt2V3UF_h8gXNyjN0mYueIZ9PYH4pNZBOczblcjJoS3EnlMSj_FMOe2BxBb8d55VlnZg4wY_-IA Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 679ae8cb4af341c38742ce17d5c2f0fd Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-279586349 Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/679ae8cb4af341c38742ce17d5c2f0fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/679ae8cb4af341c38742ce17d5c2f0fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_679ae8cb4af341c38742ce17d5c2f0fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/679ae8cb4af341c38742ce17d5c2f0fd"}]}] Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-279586349 Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 679ae8cb4af341c38742ce17d5c2f0fd Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-279586349 Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-MultipleCreateNegativeTestJSON-279586349-project Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: d04b60c645a448a28ca8147d743827ee Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-279586349-project Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-148449806", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "min_count": 2.5}} Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-148449806', 'imageRef': '93ebc91d-2d7a-4ab2-b133-dcf9559166d9', 'flavorRef': '452', 'min_count': 2.5}}} Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 2.5 Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:30:12.127717 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:30:12.133850 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:30:12.133850 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:30:12.133850 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:30:12.133850 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:30:12.133850 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 04 17:30:12.133850 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:12.133850 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:30:12.133850 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:12.133850 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:30:12.133850 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:30:12.133850 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:30:12.133850 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:30:12.133850 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:30:12.133850 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 04 17:30:12.133850 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:12.142192 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f43815ee-40fc-4682-9fd8-12cd0ea2988d tempest-MultipleCreateNegativeTestJSON-279586349 tempest-MultipleCreateNegativeTestJSON-279586349-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:30:12.143426 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f43815ee-40fc-4682-9fd8-12cd0ea2988d tempest-MultipleCreateNegativeTestJSON-279586349 tempest-MultipleCreateNegativeTestJSON-279586349-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.025593 Aug 04 17:30:12.144257 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3015/6056] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:30:12 2022] POST /compute/v2.1/servers => generated 139 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 17:30:12.223718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bd9dc13f-9807-4c3f-9588-1478ddfa9092 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2210ca1cd35f43e8bc4b10710c2900ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0211a3372bae447fbdfb4cb849a265d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:12.235174 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bd9dc13f-9807-4c3f-9588-1478ddfa9092 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] 10.222.0.93 "GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f" status: 200 len: 1429 microversion: 2.1 time: 0.839520 Aug 04 17:30:12.236930 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3042/6057] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:11 2022] GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f => generated 1429 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:30:12.554234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-9f2f50c9-3636-4c59-9821-c4660780c05a req-7b25ef92-9f6d-4b2d-937f-cbf087ab433c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c54a751-dda6-452f-a556-028fdee6f15f", "tag": "43bc5202-2365-49f7-96fe-75439b20aa08"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:30:12.601384 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9f2f50c9-3636-4c59-9821-c4660780c05a req-7b25ef92-9f6d-4b2d-937f-cbf087ab433c service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:12.605657 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9f2f50c9-3636-4c59-9821-c4660780c05a req-7b25ef92-9f6d-4b2d-937f-cbf087ab433c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:12.606668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9f2f50c9-3636-4c59-9821-c4660780c05a req-7b25ef92-9f6d-4b2d-937f-cbf087ab433c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:12.640407 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-9f2f50c9-3636-4c59-9821-c4660780c05a req-7b25ef92-9f6d-4b2d-937f-cbf087ab433c service nova] Creating event network-changed:43bc5202-2365-49f7-96fe-75439b20aa08 for instance 4c54a751-dda6-452f-a556-028fdee6f15f on n-h1-851359-3 Aug 04 17:30:12.655678 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-9f2f50c9-3636-4c59-9821-c4660780c05a req-7b25ef92-9f6d-4b2d-937f-cbf087ab433c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106392 Aug 04 17:30:12.659948 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3016/6058] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:30:13.260913 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2d4b269e-df9e-495f-ad53-c865172e4415 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:13.262915 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2d4b269e-df9e-495f-ad53-c865172e4415 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] [instance: 4c54a751-dda6-452f-a556-028fdee6f15f] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:13.270581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:30:13.272499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=14 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:30:13.274754 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d4b269e-df9e-495f-ad53-c865172e4415 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:13.277108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d4b269e-df9e-495f-ad53-c865172e4415 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:13.277968 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d4b269e-df9e-495f-ad53-c865172e4415 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:13.279189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d4b269e-df9e-495f-ad53-c865172e4415 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:13.280065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d4b269e-df9e-495f-ad53-c865172e4415 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:13.281016 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d4b269e-df9e-495f-ad53-c865172e4415 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:13.691537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2d4b269e-df9e-495f-ad53-c865172e4415 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2210ca1cd35f43e8bc4b10710c2900ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0211a3372bae447fbdfb4cb849a265d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:13.703339 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2d4b269e-df9e-495f-ad53-c865172e4415 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] 10.222.0.93 "GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f" status: 200 len: 1429 microversion: 2.1 time: 0.449078 Aug 04 17:30:13.706365 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3043/6059] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:13 2022] GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f => generated 1429 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:14.731031 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-945941b6-7e95-4810-b5d8-e4a4ca8f5240 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:14.732448 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-945941b6-7e95-4810-b5d8-e4a4ca8f5240 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] [instance: 4c54a751-dda6-452f-a556-028fdee6f15f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:14.742951 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:30:14.745253 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-945941b6-7e95-4810-b5d8-e4a4ca8f5240 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:14.746074 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-945941b6-7e95-4810-b5d8-e4a4ca8f5240 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:14.748263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-945941b6-7e95-4810-b5d8-e4a4ca8f5240 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:14.749269 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-945941b6-7e95-4810-b5d8-e4a4ca8f5240 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:14.773298 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-945941b6-7e95-4810-b5d8-e4a4ca8f5240 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:14.774829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-945941b6-7e95-4810-b5d8-e4a4ca8f5240 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:15.203131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-945941b6-7e95-4810-b5d8-e4a4ca8f5240 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2210ca1cd35f43e8bc4b10710c2900ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0211a3372bae447fbdfb4cb849a265d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:15.223292 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-945941b6-7e95-4810-b5d8-e4a4ca8f5240 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] 10.222.0.93 "GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f" status: 200 len: 1429 microversion: 2.1 time: 0.498186 Aug 04 17:30:15.226354 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3017/6060] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:14 2022] GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f => generated 1429 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:16.245314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c4b44693-d950-4f02-b495-a91608a957df tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:16.245947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c4b44693-d950-4f02-b495-a91608a957df tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] [instance: 4c54a751-dda6-452f-a556-028fdee6f15f] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:16.261364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4b44693-d950-4f02-b495-a91608a957df tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:16.262851 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4b44693-d950-4f02-b495-a91608a957df tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:16.264902 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4b44693-d950-4f02-b495-a91608a957df tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:16.269723 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4b44693-d950-4f02-b495-a91608a957df tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:16.270498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4b44693-d950-4f02-b495-a91608a957df tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:16.271121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4b44693-d950-4f02-b495-a91608a957df tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:16.838436 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c4b44693-d950-4f02-b495-a91608a957df tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2210ca1cd35f43e8bc4b10710c2900ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0211a3372bae447fbdfb4cb849a265d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:16.854934 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c4b44693-d950-4f02-b495-a91608a957df tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] 10.222.0.93 "GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f" status: 200 len: 1429 microversion: 2.1 time: 0.611740 Aug 04 17:30:16.871045 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3044/6061] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:16 2022] GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f => generated 1429 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:17.877423 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-825a9a35-96e8-40fe-a306-190b8a324749 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:17.879797 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-825a9a35-96e8-40fe-a306-190b8a324749 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] [instance: 4c54a751-dda6-452f-a556-028fdee6f15f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:17.898210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-825a9a35-96e8-40fe-a306-190b8a324749 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:17.903501 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-825a9a35-96e8-40fe-a306-190b8a324749 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:17.905321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-825a9a35-96e8-40fe-a306-190b8a324749 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:17.910816 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-825a9a35-96e8-40fe-a306-190b8a324749 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:17.911410 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-825a9a35-96e8-40fe-a306-190b8a324749 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:17.912601 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-825a9a35-96e8-40fe-a306-190b8a324749 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:18.339220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-825a9a35-96e8-40fe-a306-190b8a324749 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2210ca1cd35f43e8bc4b10710c2900ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0211a3372bae447fbdfb4cb849a265d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:18.351198 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-825a9a35-96e8-40fe-a306-190b8a324749 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] 10.222.0.93 "GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f" status: 200 len: 1429 microversion: 2.1 time: 0.477841 Aug 04 17:30:18.351623 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3018/6062] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:17 2022] GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f => generated 1429 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:19.280179 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-2216ce6c-029e-42e1-84f0-4f2497fba401 req-953e6e9b-8d58-4263-9ec8-b7548a8dcf95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c54a751-dda6-452f-a556-028fdee6f15f", "name": "network-vif-plugged", "status": "completed", "tag": "43bc5202-2365-49f7-96fe-75439b20aa08"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:30:19.297042 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-2216ce6c-029e-42e1-84f0-4f2497fba401 req-953e6e9b-8d58-4263-9ec8-b7548a8dcf95 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:19.303050 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-2216ce6c-029e-42e1-84f0-4f2497fba401 req-953e6e9b-8d58-4263-9ec8-b7548a8dcf95 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:19.303771 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-2216ce6c-029e-42e1-84f0-4f2497fba401 req-953e6e9b-8d58-4263-9ec8-b7548a8dcf95 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:19.339373 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-2216ce6c-029e-42e1-84f0-4f2497fba401 req-953e6e9b-8d58-4263-9ec8-b7548a8dcf95 service nova] Creating event network-vif-plugged:43bc5202-2365-49f7-96fe-75439b20aa08 for instance 4c54a751-dda6-452f-a556-028fdee6f15f on n-h1-851359-3 Aug 04 17:30:19.351809 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-2216ce6c-029e-42e1-84f0-4f2497fba401 req-953e6e9b-8d58-4263-9ec8-b7548a8dcf95 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075715 Aug 04 17:30:19.352901 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3045/6063] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:30:19.372431 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a81096af-c1f2-4f63-9807-8fa378fce46a tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:19.373320 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a81096af-c1f2-4f63-9807-8fa378fce46a tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] [instance: 4c54a751-dda6-452f-a556-028fdee6f15f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:19.384720 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a81096af-c1f2-4f63-9807-8fa378fce46a tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:19.385227 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a81096af-c1f2-4f63-9807-8fa378fce46a tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:19.385672 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a81096af-c1f2-4f63-9807-8fa378fce46a tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:19.391071 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a81096af-c1f2-4f63-9807-8fa378fce46a tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:19.392234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a81096af-c1f2-4f63-9807-8fa378fce46a tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:19.392863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a81096af-c1f2-4f63-9807-8fa378fce46a tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:19.934937 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a81096af-c1f2-4f63-9807-8fa378fce46a tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2210ca1cd35f43e8bc4b10710c2900ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0211a3372bae447fbdfb4cb849a265d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:19.952222 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a81096af-c1f2-4f63-9807-8fa378fce46a tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] 10.222.0.93 "GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f" status: 200 len: 1429 microversion: 2.1 time: 0.579593 Aug 04 17:30:19.953352 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3019/6064] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:19 2022] GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f => generated 1429 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:20.977685 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-57a69718-f1e2-4d1d-bc40-9bff69f92c68 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:20.979247 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-57a69718-f1e2-4d1d-bc40-9bff69f92c68 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] [instance: 4c54a751-dda6-452f-a556-028fdee6f15f] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:20.981460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:30:20.997707 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57a69718-f1e2-4d1d-bc40-9bff69f92c68 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:21.000239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57a69718-f1e2-4d1d-bc40-9bff69f92c68 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:21.001548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57a69718-f1e2-4d1d-bc40-9bff69f92c68 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:21.002529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57a69718-f1e2-4d1d-bc40-9bff69f92c68 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:21.010353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57a69718-f1e2-4d1d-bc40-9bff69f92c68 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:21.014372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57a69718-f1e2-4d1d-bc40-9bff69f92c68 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:21.088722 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=60 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:30:21.650996 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-57a69718-f1e2-4d1d-bc40-9bff69f92c68 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2210ca1cd35f43e8bc4b10710c2900ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0211a3372bae447fbdfb4cb849a265d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:21.690330 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-57a69718-f1e2-4d1d-bc40-9bff69f92c68 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] 10.222.0.93 "GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f" status: 200 len: 1429 microversion: 2.1 time: 0.716180 Aug 04 17:30:21.690995 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3046/6065] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:20 2022] GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f => generated 1429 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:30:22.713085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d40a1d94-2497-41a5-84fe-32d6a408a031 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:22.714612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d40a1d94-2497-41a5-84fe-32d6a408a031 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] [instance: 4c54a751-dda6-452f-a556-028fdee6f15f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:22.730615 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d40a1d94-2497-41a5-84fe-32d6a408a031 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:22.731914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d40a1d94-2497-41a5-84fe-32d6a408a031 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:22.733546 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d40a1d94-2497-41a5-84fe-32d6a408a031 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:22.735852 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d40a1d94-2497-41a5-84fe-32d6a408a031 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:22.737476 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d40a1d94-2497-41a5-84fe-32d6a408a031 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:22.742403 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d40a1d94-2497-41a5-84fe-32d6a408a031 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:23.938663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d40a1d94-2497-41a5-84fe-32d6a408a031 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2210ca1cd35f43e8bc4b10710c2900ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0211a3372bae447fbdfb4cb849a265d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:23.951291 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d40a1d94-2497-41a5-84fe-32d6a408a031 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] 10.222.0.93 "GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f" status: 200 len: 1608 microversion: 2.1 time: 1.240767 Aug 04 17:30:23.952160 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3020/6066] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:22 2022] GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f => generated 1608 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:23.977171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-783c985a-9976-4727-975e-34f677dea343 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:23.979223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-783c985a-9976-4727-975e-34f677dea343 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] [instance: 4c54a751-dda6-452f-a556-028fdee6f15f] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:23.994094 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-783c985a-9976-4727-975e-34f677dea343 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:24.000246 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-783c985a-9976-4727-975e-34f677dea343 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:24.003115 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-783c985a-9976-4727-975e-34f677dea343 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:24.017721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-783c985a-9976-4727-975e-34f677dea343 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:24.023937 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-783c985a-9976-4727-975e-34f677dea343 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:24.033839 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-783c985a-9976-4727-975e-34f677dea343 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:24.619132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-783c985a-9976-4727-975e-34f677dea343 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2210ca1cd35f43e8bc4b10710c2900ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0211a3372bae447fbdfb4cb849a265d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:24.629623 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-783c985a-9976-4727-975e-34f677dea343 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] 10.222.0.93 "GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f" status: 200 len: 1608 microversion: 2.1 time: 0.658254 Aug 04 17:30:24.631808 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3047/6067] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:23 2022] GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f => generated 1608 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:24.652418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2165359d-c2db-4e6f-bc6a-f93f3b0874dd tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:24.655133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2165359d-c2db-4e6f-bc6a-f93f3b0874dd tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] [instance: 4c54a751-dda6-452f-a556-028fdee6f15f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:24.670492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2165359d-c2db-4e6f-bc6a-f93f3b0874dd tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:24.672035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2165359d-c2db-4e6f-bc6a-f93f3b0874dd tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:24.673158 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2165359d-c2db-4e6f-bc6a-f93f3b0874dd tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:24.690009 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2165359d-c2db-4e6f-bc6a-f93f3b0874dd tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:24.699427 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2165359d-c2db-4e6f-bc6a-f93f3b0874dd tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:24.701511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2165359d-c2db-4e6f-bc6a-f93f3b0874dd tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:25.108748 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2165359d-c2db-4e6f-bc6a-f93f3b0874dd tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2210ca1cd35f43e8bc4b10710c2900ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0211a3372bae447fbdfb4cb849a265d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:25.121512 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2165359d-c2db-4e6f-bc6a-f93f3b0874dd tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] 10.222.0.93 "GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f" status: 200 len: 1608 microversion: 2.1 time: 0.473785 Aug 04 17:30:25.122775 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3021/6068] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:24 2022] GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f => generated 1608 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:25.280143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f1c5bc9e-70b9-4440-a33a-d3ca3a2f4e81 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Action: 'create', calling method: .version_select at 0x7f1e5b7e9e50>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1288627812", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXzz2clKNj/eza27hOJwN3Yg/bvEm4ATlSMDZqfEZOH8RP1xbdMilqrZWaJsVkJztUz/qIBKHXx9i6dYdLvP3ny1ixjSC+AD36E/FlHjQbnVaZ9Dj8wceXW10HOm+BOmA=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:30:25.309250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-f1c5bc9e-70b9-4440-a33a-d3ca3a2f4e81 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Getting quotas for project 9741bb2238ae4e019cadaa2db07bc5e6. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:30:25.327909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-f1c5bc9e-70b9-4440-a33a-d3ca3a2f4e81 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Getting quotas for user f4943545f6aa41aeaac744c9f422c822 and project 9741bb2238ae4e019cadaa2db07bc5e6. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:30:25.384385 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f1c5bc9e-70b9-4440-a33a-d3ca3a2f4e81 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.546567 Aug 04 17:30:25.385551 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3048/6069] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:30:24 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:30:28.689637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8ecdb08d-cb0e-4b26-b45f-2f087368e008 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1118928038", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "13eae226-1d69-4ed0-bee8-72a9122769cc"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:30:28.727860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=26 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:30:28.793070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-8ecdb08d-cb0e-4b26-b45f-2f087368e008 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] validate_networks() for [('13eae226-1d69-4ed0-bee8-72a9122769cc', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:30:31.142183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8ecdb08d-cb0e-4b26-b45f-2f087368e008 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:30:31.142754 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8ecdb08d-cb0e-4b26-b45f-2f087368e008 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:30:31.143081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8ecdb08d-cb0e-4b26-b45f-2f087368e008 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:30:31.143560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8ecdb08d-cb0e-4b26-b45f-2f087368e008 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:30:31.144559 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8ecdb08d-cb0e-4b26-b45f-2f087368e008 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:30:31.181824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ecdb08d-cb0e-4b26-b45f-2f087368e008 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:31.182365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ecdb08d-cb0e-4b26-b45f-2f087368e008 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:31.182958 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ecdb08d-cb0e-4b26-b45f-2f087368e008 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:31.183781 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ecdb08d-cb0e-4b26-b45f-2f087368e008 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:31.184174 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ecdb08d-cb0e-4b26-b45f-2f087368e008 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:31.185177 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ecdb08d-cb0e-4b26-b45f-2f087368e008 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:31.209077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=54 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:30:31.236667 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8ecdb08d-cb0e-4b26-b45f-2f087368e008 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Getting quotas for project 27e0a3d0cbda413a8522b19825d0140c. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:30:31.251365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8ecdb08d-cb0e-4b26-b45f-2f087368e008 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Getting quotas for user a5fea6c305d94f4f8b1815f4ecbca81f and project 27e0a3d0cbda413a8522b19825d0140c. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:30:31.288208 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8ecdb08d-cb0e-4b26-b45f-2f087368e008 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:30:31.290926 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8ecdb08d-cb0e-4b26-b45f-2f087368e008 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] [instance: 0aedbb6c-56be-45e6-bbb0-49252c9eb70c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:30:31.407328 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8ecdb08d-cb0e-4b26-b45f-2f087368e008 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.803203 Aug 04 17:30:31.408925 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3022/6070] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:30:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:30:31.421263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d7a06be1-fc2c-4ff6-bdb2-60ba9607ab05 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:31.422549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d7a06be1-fc2c-4ff6-bdb2-60ba9607ab05 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] [instance: 0aedbb6c-56be-45e6-bbb0-49252c9eb70c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:31.736965 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d7a06be1-fc2c-4ff6-bdb2-60ba9607ab05 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fea6c305d94f4f8b1815f4ecbca81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e0a3d0cbda413a8522b19825d0140c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:31.752339 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d7a06be1-fc2c-4ff6-bdb2-60ba9607ab05 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] 10.222.0.93 "GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c" status: 200 len: 1225 microversion: 2.1 time: 0.333083 Aug 04 17:30:31.771232 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3049/6071] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:31 2022] GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c => generated 1225 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:32.775658 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ca552ea4-62db-4360-a96f-1be09e5e2dd7 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:32.777011 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ca552ea4-62db-4360-a96f-1be09e5e2dd7 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] [instance: 0aedbb6c-56be-45e6-bbb0-49252c9eb70c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:32.809053 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca552ea4-62db-4360-a96f-1be09e5e2dd7 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:32.809554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca552ea4-62db-4360-a96f-1be09e5e2dd7 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:32.810032 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca552ea4-62db-4360-a96f-1be09e5e2dd7 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:32.821935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-d15ab616-e198-437a-9152-bdd7ad485012 req-80275910-17d3-42ec-96ca-96ff7c0c192c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c54a751-dda6-452f-a556-028fdee6f15f", "tag": "43bc5202-2365-49f7-96fe-75439b20aa08"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:30:32.823216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca552ea4-62db-4360-a96f-1be09e5e2dd7 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:32.832577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca552ea4-62db-4360-a96f-1be09e5e2dd7 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:32.833169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca552ea4-62db-4360-a96f-1be09e5e2dd7 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:32.846299 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d15ab616-e198-437a-9152-bdd7ad485012 req-80275910-17d3-42ec-96ca-96ff7c0c192c service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:32.850653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d15ab616-e198-437a-9152-bdd7ad485012 req-80275910-17d3-42ec-96ca-96ff7c0c192c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:32.851439 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d15ab616-e198-437a-9152-bdd7ad485012 req-80275910-17d3-42ec-96ca-96ff7c0c192c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:32.872074 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-d15ab616-e198-437a-9152-bdd7ad485012 req-80275910-17d3-42ec-96ca-96ff7c0c192c service nova] Creating event network-changed:43bc5202-2365-49f7-96fe-75439b20aa08 for instance 4c54a751-dda6-452f-a556-028fdee6f15f on n-h1-851359-3 Aug 04 17:30:32.886902 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-d15ab616-e198-437a-9152-bdd7ad485012 req-80275910-17d3-42ec-96ca-96ff7c0c192c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069903 Aug 04 17:30:32.888595 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3050/6072] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:30:33.765295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ca552ea4-62db-4360-a96f-1be09e5e2dd7 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fea6c305d94f4f8b1815f4ecbca81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e0a3d0cbda413a8522b19825d0140c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:33.778543 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ca552ea4-62db-4360-a96f-1be09e5e2dd7 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] 10.222.0.93 "GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c" status: 200 len: 1221 microversion: 2.1 time: 1.007484 Aug 04 17:30:33.779472 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3023/6073] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:32 2022] GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c => generated 1221 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:34.812954 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-efe5634d-a5e3-4e0c-a2b3-64b97eb19ed0 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:34.814858 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-efe5634d-a5e3-4e0c-a2b3-64b97eb19ed0 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] [instance: 0aedbb6c-56be-45e6-bbb0-49252c9eb70c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:34.840669 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-efe5634d-a5e3-4e0c-a2b3-64b97eb19ed0 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:34.854848 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-efe5634d-a5e3-4e0c-a2b3-64b97eb19ed0 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:34.856496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-efe5634d-a5e3-4e0c-a2b3-64b97eb19ed0 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:34.857468 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-efe5634d-a5e3-4e0c-a2b3-64b97eb19ed0 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:34.858171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-efe5634d-a5e3-4e0c-a2b3-64b97eb19ed0 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:34.858816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-efe5634d-a5e3-4e0c-a2b3-64b97eb19ed0 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:35.345401 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-efe5634d-a5e3-4e0c-a2b3-64b97eb19ed0 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fea6c305d94f4f8b1815f4ecbca81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e0a3d0cbda413a8522b19825d0140c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:35.358470 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-efe5634d-a5e3-4e0c-a2b3-64b97eb19ed0 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] 10.222.0.93 "GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c" status: 200 len: 1283 microversion: 2.1 time: 0.559039 Aug 04 17:30:35.362662 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3051/6074] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:34 2022] GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c => generated 1283 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:36.386456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e842317f-aefd-4631-ab25-ca76ff646f92 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:36.387304 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e842317f-aefd-4631-ab25-ca76ff646f92 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] [instance: 0aedbb6c-56be-45e6-bbb0-49252c9eb70c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:36.422563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e842317f-aefd-4631-ab25-ca76ff646f92 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:36.423404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e842317f-aefd-4631-ab25-ca76ff646f92 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:36.423669 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e842317f-aefd-4631-ab25-ca76ff646f92 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:36.424385 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e842317f-aefd-4631-ab25-ca76ff646f92 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:36.425060 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e842317f-aefd-4631-ab25-ca76ff646f92 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:36.425670 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e842317f-aefd-4631-ab25-ca76ff646f92 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:36.944971 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e842317f-aefd-4631-ab25-ca76ff646f92 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fea6c305d94f4f8b1815f4ecbca81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e0a3d0cbda413a8522b19825d0140c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:36.954899 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e842317f-aefd-4631-ab25-ca76ff646f92 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] 10.222.0.93 "GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c" status: 200 len: 1325 microversion: 2.1 time: 0.575122 Aug 04 17:30:36.969998 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3024/6075] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:36 2022] GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c => generated 1325 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:37.988012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c91dcbcf-c384-406e-8af8-8591db41dfae tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:37.992909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c91dcbcf-c384-406e-8af8-8591db41dfae tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] [instance: 0aedbb6c-56be-45e6-bbb0-49252c9eb70c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:38.005406 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c91dcbcf-c384-406e-8af8-8591db41dfae tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:38.006492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c91dcbcf-c384-406e-8af8-8591db41dfae tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:38.007769 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c91dcbcf-c384-406e-8af8-8591db41dfae tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:38.009349 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c91dcbcf-c384-406e-8af8-8591db41dfae tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:38.010268 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c91dcbcf-c384-406e-8af8-8591db41dfae tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:38.010964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c91dcbcf-c384-406e-8af8-8591db41dfae tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:38.586995 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c91dcbcf-c384-406e-8af8-8591db41dfae tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fea6c305d94f4f8b1815f4ecbca81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e0a3d0cbda413a8522b19825d0140c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:38.608026 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c91dcbcf-c384-406e-8af8-8591db41dfae tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] 10.222.0.93 "GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c" status: 200 len: 1325 microversion: 2.1 time: 0.630153 Aug 04 17:30:38.608899 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3052/6076] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:37 2022] GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c => generated 1325 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:39.044990 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-8b9a12d9-33aa-44c7-aec9-02c319b43e58 req-5608a296-8aa0-4bcd-beb8-a4a0340b1f05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aedbb6c-56be-45e6-bbb0-49252c9eb70c", "tag": "9197c0ec-2925-4874-a3e9-158820e05be1"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:30:39.104914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8b9a12d9-33aa-44c7-aec9-02c319b43e58 req-5608a296-8aa0-4bcd-beb8-a4a0340b1f05 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:39.108948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8b9a12d9-33aa-44c7-aec9-02c319b43e58 req-5608a296-8aa0-4bcd-beb8-a4a0340b1f05 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:39.111190 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8b9a12d9-33aa-44c7-aec9-02c319b43e58 req-5608a296-8aa0-4bcd-beb8-a4a0340b1f05 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:39.162599 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-8b9a12d9-33aa-44c7-aec9-02c319b43e58 req-5608a296-8aa0-4bcd-beb8-a4a0340b1f05 service nova] Creating event network-changed:9197c0ec-2925-4874-a3e9-158820e05be1 for instance 0aedbb6c-56be-45e6-bbb0-49252c9eb70c on n-h2-851359-3 Aug 04 17:30:39.169348 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-8b9a12d9-33aa-44c7-aec9-02c319b43e58 req-5608a296-8aa0-4bcd-beb8-a4a0340b1f05 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129787 Aug 04 17:30:39.173243 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3025/6077] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:30:39.635692 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e93fc4e8-a29b-4dea-92e5-3a343310924a tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:39.637670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e93fc4e8-a29b-4dea-92e5-3a343310924a tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] [instance: 0aedbb6c-56be-45e6-bbb0-49252c9eb70c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:39.660466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e93fc4e8-a29b-4dea-92e5-3a343310924a tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:39.669615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e93fc4e8-a29b-4dea-92e5-3a343310924a tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:39.678484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e93fc4e8-a29b-4dea-92e5-3a343310924a tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:39.679760 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e93fc4e8-a29b-4dea-92e5-3a343310924a tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:39.696531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e93fc4e8-a29b-4dea-92e5-3a343310924a tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:39.698688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e93fc4e8-a29b-4dea-92e5-3a343310924a tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:41.732010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e93fc4e8-a29b-4dea-92e5-3a343310924a tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fea6c305d94f4f8b1815f4ecbca81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e0a3d0cbda413a8522b19825d0140c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:41.741331 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e93fc4e8-a29b-4dea-92e5-3a343310924a tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] 10.222.0.93 "GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c" status: 200 len: 1325 microversion: 2.1 time: 2.116222 Aug 04 17:30:41.748035 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3053/6078] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:39 2022] GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c => generated 1325 bytes in 2124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:42.769169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-68c1d7fe-f4a9-4ef1-94d9-09523f50dd7f tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:42.770057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-68c1d7fe-f4a9-4ef1-94d9-09523f50dd7f tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] [instance: 0aedbb6c-56be-45e6-bbb0-49252c9eb70c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:42.773277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:30:42.775744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:30:42.813593 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68c1d7fe-f4a9-4ef1-94d9-09523f50dd7f tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:42.814280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68c1d7fe-f4a9-4ef1-94d9-09523f50dd7f tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:42.814934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68c1d7fe-f4a9-4ef1-94d9-09523f50dd7f tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:42.816191 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68c1d7fe-f4a9-4ef1-94d9-09523f50dd7f tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:42.823840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68c1d7fe-f4a9-4ef1-94d9-09523f50dd7f tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:42.826798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68c1d7fe-f4a9-4ef1-94d9-09523f50dd7f tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:43.844173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-68c1d7fe-f4a9-4ef1-94d9-09523f50dd7f tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fea6c305d94f4f8b1815f4ecbca81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e0a3d0cbda413a8522b19825d0140c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:43.889726 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-68c1d7fe-f4a9-4ef1-94d9-09523f50dd7f tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] 10.222.0.93 "GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c" status: 200 len: 1325 microversion: 2.1 time: 1.106805 Aug 04 17:30:43.907380 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3026/6079] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:42 2022] GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c => generated 1325 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:44.938790 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-47f129bc-048c-4cde-b5cb-6d5411b185c4 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:44.939494 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-47f129bc-048c-4cde-b5cb-6d5411b185c4 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] [instance: 0aedbb6c-56be-45e6-bbb0-49252c9eb70c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:44.952627 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:30:44.960094 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47f129bc-048c-4cde-b5cb-6d5411b185c4 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:44.961601 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47f129bc-048c-4cde-b5cb-6d5411b185c4 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:44.962272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47f129bc-048c-4cde-b5cb-6d5411b185c4 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:44.964304 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47f129bc-048c-4cde-b5cb-6d5411b185c4 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:44.967782 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47f129bc-048c-4cde-b5cb-6d5411b185c4 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:44.968872 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47f129bc-048c-4cde-b5cb-6d5411b185c4 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:45.505618 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-47f129bc-048c-4cde-b5cb-6d5411b185c4 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fea6c305d94f4f8b1815f4ecbca81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e0a3d0cbda413a8522b19825d0140c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:45.524490 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-47f129bc-048c-4cde-b5cb-6d5411b185c4 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] 10.222.0.93 "GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c" status: 200 len: 1325 microversion: 2.1 time: 0.595822 Aug 04 17:30:45.538208 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3054/6080] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:44 2022] GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c => generated 1325 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:45.795737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-50e07c98-39e2-4f24-8277-c359c34315a6 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1590022034-access_point-1375274484", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "7789015a-4ea3-49de-8ffd-0522865fbcaa"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1288627812", "security_groups": [{"name": "tempest-secgroup_access--394013878"}, {"name": "tempest-secgroup_general--297099632"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:30:46.031523 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-50e07c98-39e2-4f24-8277-c359c34315a6 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] validate_networks() for [('7789015a-4ea3-49de-8ffd-0522865fbcaa', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:30:46.556345 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e4c555b3-6a72-4195-bd27-189ba4cfa32b tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:46.559401 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e4c555b3-6a72-4195-bd27-189ba4cfa32b tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] [instance: 0aedbb6c-56be-45e6-bbb0-49252c9eb70c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:46.576296 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4c555b3-6a72-4195-bd27-189ba4cfa32b tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:46.577036 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4c555b3-6a72-4195-bd27-189ba4cfa32b tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:46.577491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4c555b3-6a72-4195-bd27-189ba4cfa32b tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:46.578404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4c555b3-6a72-4195-bd27-189ba4cfa32b tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:46.579088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4c555b3-6a72-4195-bd27-189ba4cfa32b tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:46.579536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e4c555b3-6a72-4195-bd27-189ba4cfa32b tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:46.698973 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-50e07c98-39e2-4f24-8277-c359c34315a6 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:30:46.704439 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-50e07c98-39e2-4f24-8277-c359c34315a6 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:30:46.705114 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-50e07c98-39e2-4f24-8277-c359c34315a6 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:30:46.705663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-50e07c98-39e2-4f24-8277-c359c34315a6 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:30:46.706246 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-50e07c98-39e2-4f24-8277-c359c34315a6 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:30:46.736063 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50e07c98-39e2-4f24-8277-c359c34315a6 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:46.736563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50e07c98-39e2-4f24-8277-c359c34315a6 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:46.737042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50e07c98-39e2-4f24-8277-c359c34315a6 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:46.747066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50e07c98-39e2-4f24-8277-c359c34315a6 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:46.747831 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50e07c98-39e2-4f24-8277-c359c34315a6 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:46.748668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50e07c98-39e2-4f24-8277-c359c34315a6 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:46.797369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-50e07c98-39e2-4f24-8277-c359c34315a6 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Getting quotas for project 9741bb2238ae4e019cadaa2db07bc5e6. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:30:46.811384 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-50e07c98-39e2-4f24-8277-c359c34315a6 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Getting quotas for user f4943545f6aa41aeaac744c9f422c822 and project 9741bb2238ae4e019cadaa2db07bc5e6. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:30:46.851436 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-50e07c98-39e2-4f24-8277-c359c34315a6 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:30:46.863630 n-d-851359-3 devstack@n-api.service[131044]: WARNING nova.utils [None req-50e07c98-39e2-4f24-8277-c359c34315a6 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1590022034-access_point-1375274484 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1590022034-ac Aug 04 17:30:46.864674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-50e07c98-39e2-4f24-8277-c359c34315a6 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 2bfea754-0ea9-4952-9e7c-51a86d45edec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:30:46.939735 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e4c555b3-6a72-4195-bd27-189ba4cfa32b tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fea6c305d94f4f8b1815f4ecbca81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e0a3d0cbda413a8522b19825d0140c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:46.974328 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e4c555b3-6a72-4195-bd27-189ba4cfa32b tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] 10.222.0.93 "GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c" status: 200 len: 1325 microversion: 2.1 time: 0.429232 Aug 04 17:30:46.988548 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3055/6081] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:46 2022] GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c => generated 1325 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:47.009472 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-50e07c98-39e2-4f24-8277-c359c34315a6 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 1.219649 Aug 04 17:30:47.010185 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3027/6082] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:30:45 2022] POST /compute/v2.1/servers => generated 456 bytes in 1221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:30:47.021479 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3cfd2da5-7a39-4c2b-a64c-ceaeed7dc226 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:47.023778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3cfd2da5-7a39-4c2b-a64c-ceaeed7dc226 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 2bfea754-0ea9-4952-9e7c-51a86d45edec] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:47.120974 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3cfd2da5-7a39-4c2b-a64c-ceaeed7dc226 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4943545f6aa41aeaac744c9f422c822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9741bb2238ae4e019cadaa2db07bc5e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:47.131074 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3cfd2da5-7a39-4c2b-a64c-ceaeed7dc226 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec" status: 200 len: 1295 microversion: 2.1 time: 0.113828 Aug 04 17:30:47.135064 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3056/6083] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:47 2022] GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec => generated 1295 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:48.012203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fdfd38db-a6a2-42c9-9fb6-dfeac6a53c3a tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:48.012663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fdfd38db-a6a2-42c9-9fb6-dfeac6a53c3a tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] [instance: 0aedbb6c-56be-45e6-bbb0-49252c9eb70c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:48.037847 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdfd38db-a6a2-42c9-9fb6-dfeac6a53c3a tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:48.039555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdfd38db-a6a2-42c9-9fb6-dfeac6a53c3a tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:48.040702 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdfd38db-a6a2-42c9-9fb6-dfeac6a53c3a tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:48.042405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdfd38db-a6a2-42c9-9fb6-dfeac6a53c3a tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:48.043293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdfd38db-a6a2-42c9-9fb6-dfeac6a53c3a tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:48.045403 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdfd38db-a6a2-42c9-9fb6-dfeac6a53c3a tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:48.157466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e0f047b4-e25d-47e4-a677-b763f905ae51 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:48.160364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e0f047b4-e25d-47e4-a677-b763f905ae51 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 2bfea754-0ea9-4952-9e7c-51a86d45edec] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:48.546920 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e0f047b4-e25d-47e4-a677-b763f905ae51 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4943545f6aa41aeaac744c9f422c822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9741bb2238ae4e019cadaa2db07bc5e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:48.557530 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e0f047b4-e25d-47e4-a677-b763f905ae51 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec" status: 200 len: 1295 microversion: 2.1 time: 0.406039 Aug 04 17:30:48.577745 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3057/6084] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:48 2022] GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec => generated 1295 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:48.603259 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fdfd38db-a6a2-42c9-9fb6-dfeac6a53c3a tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fea6c305d94f4f8b1815f4ecbca81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e0a3d0cbda413a8522b19825d0140c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:48.615438 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fdfd38db-a6a2-42c9-9fb6-dfeac6a53c3a tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] 10.222.0.93 "GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c" status: 200 len: 1325 microversion: 2.1 time: 0.623328 Aug 04 17:30:48.616036 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3028/6085] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:47 2022] GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c => generated 1325 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:49.586300 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-407b4cd5-115e-4a81-8c23-d2a90d8862e6 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:49.587178 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-407b4cd5-115e-4a81-8c23-d2a90d8862e6 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 2bfea754-0ea9-4952-9e7c-51a86d45edec] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:49.610333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-407b4cd5-115e-4a81-8c23-d2a90d8862e6 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:49.618038 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-407b4cd5-115e-4a81-8c23-d2a90d8862e6 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:49.618747 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-407b4cd5-115e-4a81-8c23-d2a90d8862e6 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:49.623781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-407b4cd5-115e-4a81-8c23-d2a90d8862e6 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:49.628100 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-407b4cd5-115e-4a81-8c23-d2a90d8862e6 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:49.634986 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-407b4cd5-115e-4a81-8c23-d2a90d8862e6 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:49.638562 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bc6772ac-fdc7-49f5-973d-714715444fef tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:49.639287 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bc6772ac-fdc7-49f5-973d-714715444fef tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] [instance: 0aedbb6c-56be-45e6-bbb0-49252c9eb70c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:49.655168 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc6772ac-fdc7-49f5-973d-714715444fef tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:49.655669 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc6772ac-fdc7-49f5-973d-714715444fef tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:49.656113 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc6772ac-fdc7-49f5-973d-714715444fef tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:49.657052 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc6772ac-fdc7-49f5-973d-714715444fef tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:49.657581 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc6772ac-fdc7-49f5-973d-714715444fef tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:49.670391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc6772ac-fdc7-49f5-973d-714715444fef tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:50.017250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-407b4cd5-115e-4a81-8c23-d2a90d8862e6 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4943545f6aa41aeaac744c9f422c822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9741bb2238ae4e019cadaa2db07bc5e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:50.035574 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-407b4cd5-115e-4a81-8c23-d2a90d8862e6 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec" status: 200 len: 1365 microversion: 2.1 time: 0.455373 Aug 04 17:30:50.037430 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3058/6086] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:49 2022] GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec => generated 1365 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:50.086934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bc6772ac-fdc7-49f5-973d-714715444fef tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fea6c305d94f4f8b1815f4ecbca81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e0a3d0cbda413a8522b19825d0140c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:50.100900 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bc6772ac-fdc7-49f5-973d-714715444fef tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] 10.222.0.93 "GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c" status: 200 len: 1325 microversion: 2.1 time: 0.466904 Aug 04 17:30:50.104330 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3029/6087] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:49 2022] GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c => generated 1325 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:30:51.057505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ae08dd28-c6b6-4474-9351-9daa432e47b5 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:51.058225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ae08dd28-c6b6-4474-9351-9daa432e47b5 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 2bfea754-0ea9-4952-9e7c-51a86d45edec] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:51.075298 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae08dd28-c6b6-4474-9351-9daa432e47b5 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:51.076276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae08dd28-c6b6-4474-9351-9daa432e47b5 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:51.077877 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae08dd28-c6b6-4474-9351-9daa432e47b5 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:51.080499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae08dd28-c6b6-4474-9351-9daa432e47b5 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:51.081834 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae08dd28-c6b6-4474-9351-9daa432e47b5 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:51.083335 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae08dd28-c6b6-4474-9351-9daa432e47b5 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:51.113672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=52 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:30:51.123343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-74775d8a-7370-498e-8d8c-7d46c341483d tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:51.124025 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-74775d8a-7370-498e-8d8c-7d46c341483d tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] [instance: 0aedbb6c-56be-45e6-bbb0-49252c9eb70c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:51.137442 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74775d8a-7370-498e-8d8c-7d46c341483d tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:51.143989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74775d8a-7370-498e-8d8c-7d46c341483d tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:51.144280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74775d8a-7370-498e-8d8c-7d46c341483d tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:51.145662 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74775d8a-7370-498e-8d8c-7d46c341483d tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:51.156219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74775d8a-7370-498e-8d8c-7d46c341483d tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:51.156763 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74775d8a-7370-498e-8d8c-7d46c341483d tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:51.543317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ae08dd28-c6b6-4474-9351-9daa432e47b5 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4943545f6aa41aeaac744c9f422c822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9741bb2238ae4e019cadaa2db07bc5e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:51.560482 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ae08dd28-c6b6-4474-9351-9daa432e47b5 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec" status: 200 len: 1471 microversion: 2.1 time: 0.506589 Aug 04 17:30:51.562573 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3059/6088] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:51 2022] GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec => generated 1471 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:52.078712 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-74775d8a-7370-498e-8d8c-7d46c341483d tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fea6c305d94f4f8b1815f4ecbca81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e0a3d0cbda413a8522b19825d0140c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:52.081331 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-e7df6890-5cb9-49fa-9386-49e46a3df818 req-118e4168-93ee-41e7-92ea-19e62d977835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aedbb6c-56be-45e6-bbb0-49252c9eb70c", "name": "network-vif-plugged", "status": "completed", "tag": "9197c0ec-2925-4874-a3e9-158820e05be1"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:30:52.092495 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-74775d8a-7370-498e-8d8c-7d46c341483d tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] 10.222.0.93 "GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c" status: 200 len: 1325 microversion: 2.1 time: 0.972741 Aug 04 17:30:52.104217 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:30:52.106998 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3030/6089] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:51 2022] GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c => generated 1325 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:52.108250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e7df6890-5cb9-49fa-9386-49e46a3df818 req-118e4168-93ee-41e7-92ea-19e62d977835 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:52.113752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e7df6890-5cb9-49fa-9386-49e46a3df818 req-118e4168-93ee-41e7-92ea-19e62d977835 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:52.114477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e7df6890-5cb9-49fa-9386-49e46a3df818 req-118e4168-93ee-41e7-92ea-19e62d977835 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:52.146627 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-e7df6890-5cb9-49fa-9386-49e46a3df818 req-118e4168-93ee-41e7-92ea-19e62d977835 service nova] Creating event network-vif-plugged:9197c0ec-2925-4874-a3e9-158820e05be1 for instance 0aedbb6c-56be-45e6-bbb0-49252c9eb70c on n-h2-851359-3 Aug 04 17:30:52.161089 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-e7df6890-5cb9-49fa-9386-49e46a3df818 req-118e4168-93ee-41e7-92ea-19e62d977835 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.595073 Aug 04 17:30:52.165540 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3060/6090] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:30:52.589841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fb357bfc-7e8f-4a90-8589-0bc6a97ac0f3 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:52.591231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fb357bfc-7e8f-4a90-8589-0bc6a97ac0f3 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 2bfea754-0ea9-4952-9e7c-51a86d45edec] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:52.607463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb357bfc-7e8f-4a90-8589-0bc6a97ac0f3 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:52.611055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb357bfc-7e8f-4a90-8589-0bc6a97ac0f3 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:52.614533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb357bfc-7e8f-4a90-8589-0bc6a97ac0f3 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:52.617568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb357bfc-7e8f-4a90-8589-0bc6a97ac0f3 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:52.618884 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb357bfc-7e8f-4a90-8589-0bc6a97ac0f3 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:52.624459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb357bfc-7e8f-4a90-8589-0bc6a97ac0f3 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:53.117771 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d7a857ae-1ab6-4462-b436-81c56be1d086 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:53.122194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d7a857ae-1ab6-4462-b436-81c56be1d086 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] [instance: 0aedbb6c-56be-45e6-bbb0-49252c9eb70c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:53.155860 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7a857ae-1ab6-4462-b436-81c56be1d086 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:53.157551 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7a857ae-1ab6-4462-b436-81c56be1d086 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:53.158608 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7a857ae-1ab6-4462-b436-81c56be1d086 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:53.162196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7a857ae-1ab6-4462-b436-81c56be1d086 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:53.162878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7a857ae-1ab6-4462-b436-81c56be1d086 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:53.168659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7a857ae-1ab6-4462-b436-81c56be1d086 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:53.555504 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fb357bfc-7e8f-4a90-8589-0bc6a97ac0f3 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4943545f6aa41aeaac744c9f422c822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9741bb2238ae4e019cadaa2db07bc5e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:53.567178 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fb357bfc-7e8f-4a90-8589-0bc6a97ac0f3 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec" status: 200 len: 1471 microversion: 2.1 time: 0.981898 Aug 04 17:30:53.572911 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3031/6091] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:52 2022] GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec => generated 1471 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:53.586803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-79f37e12-6d58-44e2-98ba-7d9b7d9c3491 req-74c5595d-1264-4646-a751-cc49aefe5e31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bfea754-0ea9-4952-9e7c-51a86d45edec", "tag": "baad8965-c7ab-4db1-af92-3b3785555d6d"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:30:53.619181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-79f37e12-6d58-44e2-98ba-7d9b7d9c3491 req-74c5595d-1264-4646-a751-cc49aefe5e31 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:53.620421 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-79f37e12-6d58-44e2-98ba-7d9b7d9c3491 req-74c5595d-1264-4646-a751-cc49aefe5e31 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:53.621093 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-79f37e12-6d58-44e2-98ba-7d9b7d9c3491 req-74c5595d-1264-4646-a751-cc49aefe5e31 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:53.643828 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-79f37e12-6d58-44e2-98ba-7d9b7d9c3491 req-74c5595d-1264-4646-a751-cc49aefe5e31 service nova] Creating event network-changed:baad8965-c7ab-4db1-af92-3b3785555d6d for instance 2bfea754-0ea9-4952-9e7c-51a86d45edec on n-h1-851359-3 Aug 04 17:30:53.655548 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-79f37e12-6d58-44e2-98ba-7d9b7d9c3491 req-74c5595d-1264-4646-a751-cc49aefe5e31 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080963 Aug 04 17:30:53.656066 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3032/6092] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:30:53.746802 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d7a857ae-1ab6-4462-b436-81c56be1d086 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fea6c305d94f4f8b1815f4ecbca81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e0a3d0cbda413a8522b19825d0140c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:53.759300 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d7a857ae-1ab6-4462-b436-81c56be1d086 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] 10.222.0.93 "GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c" status: 200 len: 1325 microversion: 2.1 time: 0.649022 Aug 04 17:30:53.759914 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3061/6093] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:53 2022] GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c => generated 1325 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:30:54.600295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d62a2f97-e0bf-4f18-b726-7bbc876c23f0 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:54.603697 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d62a2f97-e0bf-4f18-b726-7bbc876c23f0 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 2bfea754-0ea9-4952-9e7c-51a86d45edec] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:54.622500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d62a2f97-e0bf-4f18-b726-7bbc876c23f0 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:54.623348 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d62a2f97-e0bf-4f18-b726-7bbc876c23f0 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:54.636479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d62a2f97-e0bf-4f18-b726-7bbc876c23f0 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:54.638483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d62a2f97-e0bf-4f18-b726-7bbc876c23f0 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:54.639625 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d62a2f97-e0bf-4f18-b726-7bbc876c23f0 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:54.640582 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d62a2f97-e0bf-4f18-b726-7bbc876c23f0 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:54.787590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6379bf48-f4c5-4a7a-a35b-6bb1860ab84d tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:54.794345 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6379bf48-f4c5-4a7a-a35b-6bb1860ab84d tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] [instance: 0aedbb6c-56be-45e6-bbb0-49252c9eb70c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:54.816622 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6379bf48-f4c5-4a7a-a35b-6bb1860ab84d tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:54.817768 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6379bf48-f4c5-4a7a-a35b-6bb1860ab84d tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:54.820248 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6379bf48-f4c5-4a7a-a35b-6bb1860ab84d tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:54.824441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6379bf48-f4c5-4a7a-a35b-6bb1860ab84d tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:54.825242 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6379bf48-f4c5-4a7a-a35b-6bb1860ab84d tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:54.825942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6379bf48-f4c5-4a7a-a35b-6bb1860ab84d tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:55.014686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d62a2f97-e0bf-4f18-b726-7bbc876c23f0 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4943545f6aa41aeaac744c9f422c822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9741bb2238ae4e019cadaa2db07bc5e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:55.027472 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d62a2f97-e0bf-4f18-b726-7bbc876c23f0 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec" status: 200 len: 1471 microversion: 2.1 time: 0.433553 Aug 04 17:30:55.030834 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3033/6094] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:54 2022] GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec => generated 1471 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:55.129750 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6379bf48-f4c5-4a7a-a35b-6bb1860ab84d tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fea6c305d94f4f8b1815f4ecbca81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e0a3d0cbda413a8522b19825d0140c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:55.141464 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6379bf48-f4c5-4a7a-a35b-6bb1860ab84d tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] 10.222.0.93 "GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c" status: 200 len: 1521 microversion: 2.1 time: 0.361504 Aug 04 17:30:55.154325 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3062/6095] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:54 2022] GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:55.166945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c43ca018-bc24-4e42-bf20-b6ba547fe6f1 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:55.167681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c43ca018-bc24-4e42-bf20-b6ba547fe6f1 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] [instance: 0aedbb6c-56be-45e6-bbb0-49252c9eb70c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:55.176588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c43ca018-bc24-4e42-bf20-b6ba547fe6f1 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:55.183158 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c43ca018-bc24-4e42-bf20-b6ba547fe6f1 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:55.184399 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c43ca018-bc24-4e42-bf20-b6ba547fe6f1 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:55.186180 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c43ca018-bc24-4e42-bf20-b6ba547fe6f1 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:55.187201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c43ca018-bc24-4e42-bf20-b6ba547fe6f1 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:55.189647 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c43ca018-bc24-4e42-bf20-b6ba547fe6f1 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:55.255358 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-c43ca018-bc24-4e42-bf20-b6ba547fe6f1 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] HTTP exception thrown: Instance is not a member of specified network Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c43ca018-bc24-4e42-bf20-b6ba547fe6f1 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Request method failure captured: Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c/ips/invalid HTTP/1.1 Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AI0L7pYPC_jVk8OK8CfIwQNv_ps_D8L4IekECIzSIZw7WAGuKrkDuNlg5WQa_vbY9qh_UIUVRYY3F-dlKCkY2_DbIw_H9gkzgiYzJsZj7M3l1zO6MzON3cDPKDAz-B1iA_MVO_E_tvqIuXw-KqfWJGfGmqpv3fq9HRpbdgt1BNwPfM Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 27e0a3d0cbda413a8522b19825d0140c Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1773842688 Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/27e0a3d0cbda413a8522b19825d0140c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/27e0a3d0cbda413a8522b19825d0140c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_27e0a3d0cbda413a8522b19825d0140c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/27e0a3d0cbda413a8522b19825d0140c"}]}] Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1773842688 Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 27e0a3d0cbda413a8522b19825d0140c Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1773842688 Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServerAddressesNegativeTestJSON-1773842688-project Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: a5fea6c305d94f4f8b1815f4ecbca81f Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1773842688-project Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance is not a member of specified network Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'server_id': '0aedbb6c-56be-45e6-bbb0-49252c9eb70c', 'id': 'invalid'} Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 04 17:30:55.266596 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:30:55.282731 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c43ca018-bc24-4e42-bf20-b6ba547fe6f1 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Returning 404 to user: Instance is not a member of specified network {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:30:55.288302 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c43ca018-bc24-4e42-bf20-b6ba547fe6f1 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] 10.222.0.93 "GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.124464 Aug 04 17:30:55.293103 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3034/6096] 10.222.0.93 () {58 vars in 1272 bytes} [Thu Aug 4 17:30:55 2022] GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c/ips/invalid => generated 91 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:30:55.301849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f4a0ca08-4b83-42f7-895a-cf85be3879aa tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:55.302572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f4a0ca08-4b83-42f7-895a-cf85be3879aa tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Failed to fetch instance by id 999 {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 04 17:30:55.303180 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-f4a0ca08-4b83-42f7-895a-cf85be3879aa tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] HTTP exception thrown: Instance 999 could not be found. Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f4a0ca08-4b83-42f7-895a-cf85be3879aa tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Request method failure captured: Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7AI0L7pYPC_jVk8OK8CfIwQNv_ps_D8L4IekECIzSIZw7WAGuKrkDuNlg5WQa_vbY9qh_UIUVRYY3F-dlKCkY2_DbIw_H9gkzgiYzJsZj7M3l1zO6MzON3cDPKDAz-B1iA_MVO_E_tvqIuXw-KqfWJGfGmqpv3fq9HRpbdgt1BNwPfM Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 27e0a3d0cbda413a8522b19825d0140c Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1773842688 Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/27e0a3d0cbda413a8522b19825d0140c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/27e0a3d0cbda413a8522b19825d0140c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_27e0a3d0cbda413a8522b19825d0140c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/27e0a3d0cbda413a8522b19825d0140c"}]}] Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1773842688 Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 27e0a3d0cbda413a8522b19825d0140c Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1773842688 Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerAddressesNegativeTestJSON-1773842688-project Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: a5fea6c305d94f4f8b1815f4ecbca81f Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1773842688-project Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 999 could not be found. Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'server_id': '999'} Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 04 17:30:55.305044 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:30:55.315066 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f4a0ca08-4b83-42f7-895a-cf85be3879aa tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Returning 404 to user: Instance 999 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:30:55.315066 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f4a0ca08-4b83-42f7-895a-cf85be3879aa tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] 10.222.0.93 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.010036 Aug 04 17:30:55.317195 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3063/6097] 10.222.0.93 () {58 vars in 1149 bytes} [Thu Aug 4 17:30:55 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:30:55.327885 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e37ccc15-c4ab-4608-81e6-a5608b27022f tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:55.331747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e37ccc15-c4ab-4608-81e6-a5608b27022f tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] [instance: 0aedbb6c-56be-45e6-bbb0-49252c9eb70c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:55.371202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e37ccc15-c4ab-4608-81e6-a5608b27022f tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:55.373420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e37ccc15-c4ab-4608-81e6-a5608b27022f tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:55.374125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e37ccc15-c4ab-4608-81e6-a5608b27022f tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:55.377077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e37ccc15-c4ab-4608-81e6-a5608b27022f tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:55.377826 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e37ccc15-c4ab-4608-81e6-a5608b27022f tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:55.378559 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e37ccc15-c4ab-4608-81e6-a5608b27022f tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:55.539364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e37ccc15-c4ab-4608-81e6-a5608b27022f tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] [instance: 0aedbb6c-56be-45e6-bbb0-49252c9eb70c] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:30:55.659048 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e37ccc15-c4ab-4608-81e6-a5608b27022f tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c" status: 204 len: 0 microversion: 2.1 time: 0.340082 Aug 04 17:30:55.671322 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-202ec3d9-6bf7-4304-a0f1-17707c3f406b tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:55.672102 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-202ec3d9-6bf7-4304-a0f1-17707c3f406b tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] [instance: 0aedbb6c-56be-45e6-bbb0-49252c9eb70c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:55.675487 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3035/6098] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:30:55 2022] DELETE /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:30:55.679423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-202ec3d9-6bf7-4304-a0f1-17707c3f406b tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:55.680330 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-202ec3d9-6bf7-4304-a0f1-17707c3f406b tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:55.681027 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-202ec3d9-6bf7-4304-a0f1-17707c3f406b tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:55.682270 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-202ec3d9-6bf7-4304-a0f1-17707c3f406b tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:55.682988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-202ec3d9-6bf7-4304-a0f1-17707c3f406b tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:55.683666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-202ec3d9-6bf7-4304-a0f1-17707c3f406b tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:56.055253 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d3f9bea4-5094-438f-ae39-484848d2e13c tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:56.056387 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d3f9bea4-5094-438f-ae39-484848d2e13c tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 2bfea754-0ea9-4952-9e7c-51a86d45edec] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:56.068527 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3f9bea4-5094-438f-ae39-484848d2e13c tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:56.071754 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3f9bea4-5094-438f-ae39-484848d2e13c tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:56.072635 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3f9bea4-5094-438f-ae39-484848d2e13c tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:56.080459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3f9bea4-5094-438f-ae39-484848d2e13c tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:56.080459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3f9bea4-5094-438f-ae39-484848d2e13c tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:56.080459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3f9bea4-5094-438f-ae39-484848d2e13c tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:56.622562 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-202ec3d9-6bf7-4304-a0f1-17707c3f406b tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fea6c305d94f4f8b1815f4ecbca81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e0a3d0cbda413a8522b19825d0140c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:56.650592 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-202ec3d9-6bf7-4304-a0f1-17707c3f406b tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] 10.222.0.93 "GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c" status: 200 len: 1527 microversion: 2.1 time: 0.983632 Aug 04 17:30:56.651581 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3064/6099] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:55 2022] GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c => generated 1527 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:56.770501 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:30:56.839219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:30:56.939545 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d3f9bea4-5094-438f-ae39-484848d2e13c tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4943545f6aa41aeaac744c9f422c822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9741bb2238ae4e019cadaa2db07bc5e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:56.967544 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d3f9bea4-5094-438f-ae39-484848d2e13c tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec" status: 200 len: 1471 microversion: 2.1 time: 0.917978 Aug 04 17:30:56.969042 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3036/6100] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:56 2022] GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec => generated 1471 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:30:57.679512 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-18b9d811-7ad3-45f4-ac63-372a0c275fac tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:57.683453 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-18b9d811-7ad3-45f4-ac63-372a0c275fac tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] [instance: 0aedbb6c-56be-45e6-bbb0-49252c9eb70c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:57.749811 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-18b9d811-7ad3-45f4-ac63-372a0c275fac tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:57.750796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-18b9d811-7ad3-45f4-ac63-372a0c275fac tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:57.751590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-18b9d811-7ad3-45f4-ac63-372a0c275fac tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:57.752860 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-18b9d811-7ad3-45f4-ac63-372a0c275fac tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:57.758250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-18b9d811-7ad3-45f4-ac63-372a0c275fac tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:57.761836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-18b9d811-7ad3-45f4-ac63-372a0c275fac tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:57.998961 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a86ff7a9-8087-4a27-8208-93a77b8e309d tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:58.009313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a86ff7a9-8087-4a27-8208-93a77b8e309d tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 2bfea754-0ea9-4952-9e7c-51a86d45edec] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:58.058318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a86ff7a9-8087-4a27-8208-93a77b8e309d tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:58.060534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a86ff7a9-8087-4a27-8208-93a77b8e309d tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:58.062649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a86ff7a9-8087-4a27-8208-93a77b8e309d tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:58.069599 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a86ff7a9-8087-4a27-8208-93a77b8e309d tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:58.072020 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a86ff7a9-8087-4a27-8208-93a77b8e309d tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:58.073478 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a86ff7a9-8087-4a27-8208-93a77b8e309d tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:58.559799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=4 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:30:59.188356 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-18b9d811-7ad3-45f4-ac63-372a0c275fac tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fea6c305d94f4f8b1815f4ecbca81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e0a3d0cbda413a8522b19825d0140c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:59.201780 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-18b9d811-7ad3-45f4-ac63-372a0c275fac tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] 10.222.0.93 "GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c" status: 200 len: 1527 microversion: 2.1 time: 1.530566 Aug 04 17:30:59.202664 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3065/6101] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:57 2022] GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c => generated 1527 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:30:59.288810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a86ff7a9-8087-4a27-8208-93a77b8e309d tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4943545f6aa41aeaac744c9f422c822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9741bb2238ae4e019cadaa2db07bc5e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:30:59.310795 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a86ff7a9-8087-4a27-8208-93a77b8e309d tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec" status: 200 len: 1471 microversion: 2.1 time: 1.322127 Aug 04 17:30:59.326817 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3037/6102] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:30:57 2022] GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec => generated 1471 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:30:59.515020 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bdae5395-6da0-4abd-88b3-3273927078fe tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:30:59.515928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bdae5395-6da0-4abd-88b3-3273927078fe tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] [instance: 4c54a751-dda6-452f-a556-028fdee6f15f] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:30:59.530555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bdae5395-6da0-4abd-88b3-3273927078fe tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:59.531647 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bdae5395-6da0-4abd-88b3-3273927078fe tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:59.532594 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bdae5395-6da0-4abd-88b3-3273927078fe tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:59.534045 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bdae5395-6da0-4abd-88b3-3273927078fe tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:59.535467 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bdae5395-6da0-4abd-88b3-3273927078fe tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:59.536184 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bdae5395-6da0-4abd-88b3-3273927078fe tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:59.605122 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bdae5395-6da0-4abd-88b3-3273927078fe tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] 10.222.0.93 "GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.086480 Aug 04 17:30:59.610483 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3066/6103] 10.222.0.93 () {58 vars in 1293 bytes} [Thu Aug 4 17:30:59 2022] GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f/os-server-password => generated 116 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:30:59.940318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-9dad78d8-4c40-4ae5-bd90-067609dd4065 req-b8a7d00e-b7aa-4b3f-b331-a9080a736c75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aedbb6c-56be-45e6-bbb0-49252c9eb70c", "name": "network-vif-deleted", "tag": "9197c0ec-2925-4874-a3e9-158820e05be1"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:30:59.947455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:30:59.954709 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9dad78d8-4c40-4ae5-bd90-067609dd4065 req-b8a7d00e-b7aa-4b3f-b331-a9080a736c75 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:30:59.955203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9dad78d8-4c40-4ae5-bd90-067609dd4065 req-b8a7d00e-b7aa-4b3f-b331-a9080a736c75 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:30:59.955650 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9dad78d8-4c40-4ae5-bd90-067609dd4065 req-b8a7d00e-b7aa-4b3f-b331-a9080a736c75 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:30:59.972655 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-9dad78d8-4c40-4ae5-bd90-067609dd4065 req-b8a7d00e-b7aa-4b3f-b331-a9080a736c75 service nova] Creating event network-vif-deleted:9197c0ec-2925-4874-a3e9-158820e05be1 for instance 0aedbb6c-56be-45e6-bbb0-49252c9eb70c on n-h2-851359-3 Aug 04 17:30:59.992767 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-9dad78d8-4c40-4ae5-bd90-067609dd4065 req-b8a7d00e-b7aa-4b3f-b331-a9080a736c75 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057649 Aug 04 17:30:59.998400 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3038/6104] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 04 17:31:00.225336 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2b28ae6e-acbe-4ed3-99fb-7a72cfdf65c7 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:31:00.226991 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2b28ae6e-acbe-4ed3-99fb-7a72cfdf65c7 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] [instance: 0aedbb6c-56be-45e6-bbb0-49252c9eb70c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:31:00.234979 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b28ae6e-acbe-4ed3-99fb-7a72cfdf65c7 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:31:00.235907 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b28ae6e-acbe-4ed3-99fb-7a72cfdf65c7 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:31:00.236890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b28ae6e-acbe-4ed3-99fb-7a72cfdf65c7 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:31:00.237892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b28ae6e-acbe-4ed3-99fb-7a72cfdf65c7 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:31:00.238763 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b28ae6e-acbe-4ed3-99fb-7a72cfdf65c7 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:31:00.239447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b28ae6e-acbe-4ed3-99fb-7a72cfdf65c7 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:31:00.281619 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b28ae6e-acbe-4ed3-99fb-7a72cfdf65c7 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:31:00.283443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b28ae6e-acbe-4ed3-99fb-7a72cfdf65c7 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:31:00.284225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2b28ae6e-acbe-4ed3-99fb-7a72cfdf65c7 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:31:00.286331 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-2b28ae6e-acbe-4ed3-99fb-7a72cfdf65c7 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lazy-loading 'fault' on Instance uuid 0aedbb6c-56be-45e6-bbb0-49252c9eb70c {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:31:00.333863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-055c8105-5755-42ef-bcb9-8acba0dd104e tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:31:00.336186 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-055c8105-5755-42ef-bcb9-8acba0dd104e tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 2bfea754-0ea9-4952-9e7c-51a86d45edec] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:31:00.342947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2b28ae6e-acbe-4ed3-99fb-7a72cfdf65c7 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fea6c305d94f4f8b1815f4ecbca81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e0a3d0cbda413a8522b19825d0140c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:31:00.362857 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2b28ae6e-acbe-4ed3-99fb-7a72cfdf65c7 tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] 10.222.0.93 "GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c" status: 200 len: 1315 microversion: 2.1 time: 0.138638 Aug 04 17:31:00.378026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-055c8105-5755-42ef-bcb9-8acba0dd104e tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:31:00.378026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-055c8105-5755-42ef-bcb9-8acba0dd104e tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:31:00.380523 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3067/6105] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:31:00 2022] GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:31:00.385516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-055c8105-5755-42ef-bcb9-8acba0dd104e tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:31:00.386960 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-055c8105-5755-42ef-bcb9-8acba0dd104e tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:31:00.398637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-055c8105-5755-42ef-bcb9-8acba0dd104e tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:31:00.400702 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-055c8105-5755-42ef-bcb9-8acba0dd104e tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:31:00.414146 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-76e7d81e-87fa-4d7f-a279-fd28f36024e1 req-5c9c4488-0fe0-4919-9e73-2a86e7c44e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bfea754-0ea9-4952-9e7c-51a86d45edec", "name": "network-vif-plugged", "status": "completed", "tag": "baad8965-c7ab-4db1-af92-3b3785555d6d"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:31:00.427688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-76e7d81e-87fa-4d7f-a279-fd28f36024e1 req-5c9c4488-0fe0-4919-9e73-2a86e7c44e11 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:31:00.428523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-76e7d81e-87fa-4d7f-a279-fd28f36024e1 req-5c9c4488-0fe0-4919-9e73-2a86e7c44e11 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:31:00.429205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-76e7d81e-87fa-4d7f-a279-fd28f36024e1 req-5c9c4488-0fe0-4919-9e73-2a86e7c44e11 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:31:00.445352 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-76e7d81e-87fa-4d7f-a279-fd28f36024e1 req-5c9c4488-0fe0-4919-9e73-2a86e7c44e11 service nova] Creating event network-vif-plugged:baad8965-c7ab-4db1-af92-3b3785555d6d for instance 2bfea754-0ea9-4952-9e7c-51a86d45edec on n-h1-851359-3 Aug 04 17:31:00.451954 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-76e7d81e-87fa-4d7f-a279-fd28f36024e1 req-5c9c4488-0fe0-4919-9e73-2a86e7c44e11 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043328 Aug 04 17:31:00.453518 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3068/6106] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:31:00.680597 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-055c8105-5755-42ef-bcb9-8acba0dd104e tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4943545f6aa41aeaac744c9f422c822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9741bb2238ae4e019cadaa2db07bc5e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:31:00.694546 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-055c8105-5755-42ef-bcb9-8acba0dd104e tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec" status: 200 len: 1471 microversion: 2.1 time: 0.365265 Aug 04 17:31:00.710898 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3039/6107] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:31:00 2022] GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec => generated 1471 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:31:01.385817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-86d5dbb9-9967-4b63-be9c-cc7597c446fc tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:31:01.386641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-86d5dbb9-9967-4b63-be9c-cc7597c446fc tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] [instance: 0aedbb6c-56be-45e6-bbb0-49252c9eb70c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:31:01.407775 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86d5dbb9-9967-4b63-be9c-cc7597c446fc tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:31:01.408454 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86d5dbb9-9967-4b63-be9c-cc7597c446fc tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:31:01.409608 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86d5dbb9-9967-4b63-be9c-cc7597c446fc tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:31:01.410952 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86d5dbb9-9967-4b63-be9c-cc7597c446fc tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:31:01.411437 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86d5dbb9-9967-4b63-be9c-cc7597c446fc tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:31:01.411928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86d5dbb9-9967-4b63-be9c-cc7597c446fc tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:31:01.448634 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-86d5dbb9-9967-4b63-be9c-cc7597c446fc tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] HTTP exception thrown: Instance 0aedbb6c-56be-45e6-bbb0-49252c9eb70c could not be found. Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-86d5dbb9-9967-4b63-be9c-cc7597c446fc tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Request method failure captured: Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c HTTP/1.1 Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7AI0L7pYPC_jVk8OK8CfIwQNv_ps_D8L4IekECIzSIZw7WAGuKrkDuNlg5WQa_vbY9qh_UIUVRYY3F-dlKCkY2_DbIw_H9gkzgiYzJsZj7M3l1zO6MzON3cDPKDAz-B1iA_MVO_E_tvqIuXw-KqfWJGfGmqpv3fq9HRpbdgt1BNwPfM Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 27e0a3d0cbda413a8522b19825d0140c Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1773842688 Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/27e0a3d0cbda413a8522b19825d0140c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/27e0a3d0cbda413a8522b19825d0140c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_27e0a3d0cbda413a8522b19825d0140c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/27e0a3d0cbda413a8522b19825d0140c"}]}] Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1773842688 Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 27e0a3d0cbda413a8522b19825d0140c Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1773842688 Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerAddressesNegativeTestJSON-1773842688-project Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: a5fea6c305d94f4f8b1815f4ecbca81f Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1773842688-project Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 0aedbb6c-56be-45e6-bbb0-49252c9eb70c could not be found. Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '0aedbb6c-56be-45e6-bbb0-49252c9eb70c'} Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0aedbb6c-56be-45e6-bbb0-49252c9eb70c could not be found. Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aedbb6c-56be-45e6-bbb0-49252c9eb70c could not be found. Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:31:01.460359 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:31:01.466600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:31:01.466600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:31:01.466600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:31:01.466600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:31:01.466600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:31:01.466600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:31:01.466600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aedbb6c-56be-45e6-bbb0-49252c9eb70c could not be found. Aug 04 17:31:01.466600 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:31:01.466600 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-86d5dbb9-9967-4b63-be9c-cc7597c446fc tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] Returning 404 to user: Instance 0aedbb6c-56be-45e6-bbb0-49252c9eb70c could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:31:01.466600 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-86d5dbb9-9967-4b63-be9c-cc7597c446fc tempest-ServerAddressesNegativeTestJSON-1773842688 tempest-ServerAddressesNegativeTestJSON-1773842688-project] 10.222.0.93 "GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c" status: 404 len: 111 microversion: 2.1 time: 0.080415 Aug 04 17:31:01.466600 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3069/6108] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:31:01 2022] GET /compute/v2.1/servers/0aedbb6c-56be-45e6-bbb0-49252c9eb70c => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:31:01.718676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-86883ce8-58e7-4047-a346-cbb6ea2f5af5 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:31:01.719706 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-86883ce8-58e7-4047-a346-cbb6ea2f5af5 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 2bfea754-0ea9-4952-9e7c-51a86d45edec] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:31:01.731703 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86883ce8-58e7-4047-a346-cbb6ea2f5af5 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:31:01.733942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86883ce8-58e7-4047-a346-cbb6ea2f5af5 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:31:01.734476 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86883ce8-58e7-4047-a346-cbb6ea2f5af5 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:31:01.735334 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86883ce8-58e7-4047-a346-cbb6ea2f5af5 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:31:01.736677 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86883ce8-58e7-4047-a346-cbb6ea2f5af5 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:31:01.737145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86883ce8-58e7-4047-a346-cbb6ea2f5af5 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:31:01.749171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:31:02.121153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-86883ce8-58e7-4047-a346-cbb6ea2f5af5 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4943545f6aa41aeaac744c9f422c822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9741bb2238ae4e019cadaa2db07bc5e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:31:02.141539 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-86883ce8-58e7-4047-a346-cbb6ea2f5af5 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec" status: 200 len: 1471 microversion: 2.1 time: 0.428345 Aug 04 17:31:02.142660 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3040/6109] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:31:01 2022] GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec => generated 1471 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:31:03.046224 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:31:03.047727 n-d-851359-3 devstack@n-api.service[131044]: Thu Aug 4 17:31:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 17:31:03.164854 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7f5a7756-4457-41d9-87fb-4a7803177284 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:31:03.165498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7f5a7756-4457-41d9-87fb-4a7803177284 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 2bfea754-0ea9-4952-9e7c-51a86d45edec] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:31:03.184541 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7f5a7756-4457-41d9-87fb-4a7803177284 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:31:03.185475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7f5a7756-4457-41d9-87fb-4a7803177284 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:31:03.194715 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7f5a7756-4457-41d9-87fb-4a7803177284 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:31:03.198489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7f5a7756-4457-41d9-87fb-4a7803177284 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:31:03.199098 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7f5a7756-4457-41d9-87fb-4a7803177284 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:31:03.199806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7f5a7756-4457-41d9-87fb-4a7803177284 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:31:03.539101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7f5a7756-4457-41d9-87fb-4a7803177284 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4943545f6aa41aeaac744c9f422c822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9741bb2238ae4e019cadaa2db07bc5e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:31:03.557253 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7f5a7756-4457-41d9-87fb-4a7803177284 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec" status: 200 len: 1642 microversion: 2.1 time: 0.397130 Aug 04 17:31:03.570284 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3070/6110] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:31:03 2022] GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec => generated 1642 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:31:03.585310 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e736c323-9be1-4133-908f-b7295dc54c24 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:31:03.587008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e736c323-9be1-4133-908f-b7295dc54c24 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 2bfea754-0ea9-4952-9e7c-51a86d45edec] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:31:03.600843 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e736c323-9be1-4133-908f-b7295dc54c24 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:31:03.603477 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e736c323-9be1-4133-908f-b7295dc54c24 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:31:03.604007 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e736c323-9be1-4133-908f-b7295dc54c24 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:31:03.604774 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e736c323-9be1-4133-908f-b7295dc54c24 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:31:03.605258 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e736c323-9be1-4133-908f-b7295dc54c24 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:31:03.607976 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e736c323-9be1-4133-908f-b7295dc54c24 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:31:04.226014 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e736c323-9be1-4133-908f-b7295dc54c24 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4943545f6aa41aeaac744c9f422c822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9741bb2238ae4e019cadaa2db07bc5e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:31:04.241644 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e736c323-9be1-4133-908f-b7295dc54c24 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec" status: 200 len: 1642 microversion: 2.1 time: 0.661985 Aug 04 17:31:04.242890 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3041/6111] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:31:03 2022] GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec => generated 1642 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:31:04.264258 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-03ae20b9-824e-4b68-a83c-db097e9343cf tempest-TestSecurityGroupsBasicOps-315069139 tempest-TestSecurityGroupsBasicOps-315069139-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:31:04.264989 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-03ae20b9-824e-4b68-a83c-db097e9343cf tempest-TestSecurityGroupsBasicOps-315069139 tempest-TestSecurityGroupsBasicOps-315069139-project-admin] [instance: 2bfea754-0ea9-4952-9e7c-51a86d45edec] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:31:04.278044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03ae20b9-824e-4b68-a83c-db097e9343cf tempest-TestSecurityGroupsBasicOps-315069139 tempest-TestSecurityGroupsBasicOps-315069139-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:31:04.278545 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03ae20b9-824e-4b68-a83c-db097e9343cf tempest-TestSecurityGroupsBasicOps-315069139 tempest-TestSecurityGroupsBasicOps-315069139-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:31:04.279007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03ae20b9-824e-4b68-a83c-db097e9343cf tempest-TestSecurityGroupsBasicOps-315069139 tempest-TestSecurityGroupsBasicOps-315069139-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:31:04.279751 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03ae20b9-824e-4b68-a83c-db097e9343cf tempest-TestSecurityGroupsBasicOps-315069139 tempest-TestSecurityGroupsBasicOps-315069139-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:31:04.284657 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03ae20b9-824e-4b68-a83c-db097e9343cf tempest-TestSecurityGroupsBasicOps-315069139 tempest-TestSecurityGroupsBasicOps-315069139-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:31:04.285240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03ae20b9-824e-4b68-a83c-db097e9343cf tempest-TestSecurityGroupsBasicOps-315069139 tempest-TestSecurityGroupsBasicOps-315069139-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:31:05.468252 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-03ae20b9-824e-4b68-a83c-db097e9343cf tempest-TestSecurityGroupsBasicOps-315069139 tempest-TestSecurityGroupsBasicOps-315069139-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec" status: 200 len: 1793 microversion: 2.1 time: 1.207880 Aug 04 17:31:05.476354 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3071/6112] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:31:04 2022] GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec => generated 1793 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:31:10.881099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-5423f88b-a4a6-4994-bd0d-f61c1d6c00f2 req-a09ad3f5-b3fe-4956-ac0d-4d6bef3c755a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bfea754-0ea9-4952-9e7c-51a86d45edec", "tag": "baad8965-c7ab-4db1-af92-3b3785555d6d"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:31:10.920922 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5423f88b-a4a6-4994-bd0d-f61c1d6c00f2 req-a09ad3f5-b3fe-4956-ac0d-4d6bef3c755a service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:31:10.922467 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5423f88b-a4a6-4994-bd0d-f61c1d6c00f2 req-a09ad3f5-b3fe-4956-ac0d-4d6bef3c755a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:31:10.923666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5423f88b-a4a6-4994-bd0d-f61c1d6c00f2 req-a09ad3f5-b3fe-4956-ac0d-4d6bef3c755a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:31:10.956877 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-5423f88b-a4a6-4994-bd0d-f61c1d6c00f2 req-a09ad3f5-b3fe-4956-ac0d-4d6bef3c755a service nova] Creating event network-changed:baad8965-c7ab-4db1-af92-3b3785555d6d for instance 2bfea754-0ea9-4952-9e7c-51a86d45edec on n-h1-851359-3 Aug 04 17:31:10.968403 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-5423f88b-a4a6-4994-bd0d-f61c1d6c00f2 req-a09ad3f5-b3fe-4956-ac0d-4d6bef3c755a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094772 Aug 04 17:31:10.989133 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3042/6113] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:31:11.250707 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-69e37c27-daec-4406-87fe-82c00fc0df25 tempest-VolumesNegativeTest-1300675369 tempest-VolumesNegativeTest-1300675369-project] Action: 'create', calling method: .version_select at 0x7f1e5b7cc4c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1727925763", "metadata": {"Type": "work"}}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-69e37c27-daec-4406-87fe-82c00fc0df25 tempest-VolumesNegativeTest-1300675369 tempest-VolumesNegativeTest-1300675369-project] Request method failure captured: Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 122 Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7AJeTXFVMi9GDgAGYa_DyxZYD3-LcPoJGiBEBwHsWZ5qeLigb4UtAaZFUQ11bOqxY9eudUCdFet1otoswNOGyk3T5qgNVDc93to3YndKoeFJBp9eMbBzkljtD46IPfJvp6aeFK0zvOFr69ATKjiO2Q-b7HAKkr-kKZe7H8G30V8COMU Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: e1b0657a2fc94ae590dadad62a881a12 Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-VolumesNegativeTest-1300675369 Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e1b0657a2fc94ae590dadad62a881a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e1b0657a2fc94ae590dadad62a881a12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e1b0657a2fc94ae590dadad62a881a12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e1b0657a2fc94ae590dadad62a881a12"}]}] Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-VolumesNegativeTest-1300675369 Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: e1b0657a2fc94ae590dadad62a881a12 Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-VolumesNegativeTest-1300675369 Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-VolumesNegativeTest-1300675369-project Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 7b8b30bd1c294bff8826ea958909523f Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-VolumesNegativeTest-1300675369-project Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1727925763", "metadata": {"Type": "work"}}} Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1727925763', 'metadata': {'Type': 'work'}}}} Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi '#$%' Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:31:11.262738 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:31:11.275343 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 17:31:11.275343 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.275343 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:31:11.275343 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.275343 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:31:11.275343 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:31:11.275343 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:31:11.275343 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:31:11.275343 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:31:11.275343 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 17:31:11.275343 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.287635 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-69e37c27-daec-4406-87fe-82c00fc0df25 tempest-VolumesNegativeTest-1300675369 tempest-VolumesNegativeTest-1300675369-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:31:11.289591 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-69e37c27-daec-4406-87fe-82c00fc0df25 tempest-VolumesNegativeTest-1300675369 tempest-VolumesNegativeTest-1300675369-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.390960 Aug 04 17:31:11.322953 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3072/6114] 10.222.0.93 () {60 vars in 1156 bytes} [Thu Aug 4 17:31:10 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 425 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:31:11.323323 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-534af1f1-011e-43ad-b34f-754f0d32f20a tempest-VolumesNegativeTest-1300675369 tempest-VolumesNegativeTest-1300675369-project] Action: 'create', calling method: .version_select at 0x7f1e5a375ca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1755436715", "metadata": {"Type": "work"}}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-534af1f1-011e-43ad-b34f-754f0d32f20a tempest-VolumesNegativeTest-1300675369 tempest-VolumesNegativeTest-1300675369-project] Request method failure captured: Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 120 Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AJeTXFVMi9GDgAGYa_DyxZYD3-LcPoJGiBEBwHsWZ5qeLigb4UtAaZFUQ11bOqxY9eudUCdFet1otoswNOGyk3T5qgNVDc93to3YndKoeFJBp9eMbBzkljtD46IPfJvp6aeFK0zvOFr69ATKjiO2Q-b7HAKkr-kKZe7H8G30V8COMU Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: e1b0657a2fc94ae590dadad62a881a12 Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-VolumesNegativeTest-1300675369 Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e1b0657a2fc94ae590dadad62a881a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e1b0657a2fc94ae590dadad62a881a12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e1b0657a2fc94ae590dadad62a881a12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e1b0657a2fc94ae590dadad62a881a12"}]}] Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-VolumesNegativeTest-1300675369 Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: e1b0657a2fc94ae590dadad62a881a12 Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-VolumesNegativeTest-1300675369 Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-VolumesNegativeTest-1300675369-project Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 7b8b30bd1c294bff8826ea958909523f Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-VolumesNegativeTest-1300675369-project Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1755436715", "metadata": {"Type": "work"}}} Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1755436715', 'metadata': {'Type': 'work'}}}} Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi '0' Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:31:11.336043 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:31:11.345830 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 17:31:11.345830 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.345830 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:31:11.345830 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.345830 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:31:11.345830 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:31:11.345830 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:31:11.345830 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:31:11.345830 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:31:11.345830 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 17:31:11.345830 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.352581 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-534af1f1-011e-43ad-b34f-754f0d32f20a tempest-VolumesNegativeTest-1300675369 tempest-VolumesNegativeTest-1300675369-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:31:11.357497 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-534af1f1-011e-43ad-b34f-754f0d32f20a tempest-VolumesNegativeTest-1300675369 tempest-VolumesNegativeTest-1300675369-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.050624 Aug 04 17:31:11.367737 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3043/6115] 10.222.0.93 () {60 vars in 1156 bytes} [Thu Aug 4 17:31:11 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:31:11.411840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-81bdcf34-20a9-4e04-b21b-171794620891 tempest-VolumesNegativeTest-1300675369 tempest-VolumesNegativeTest-1300675369-project] Action: 'create', calling method: .version_select at 0x7f1e5a3713a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1754433151", "metadata": {"Type": "work"}}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-81bdcf34-20a9-4e04-b21b-171794620891 tempest-VolumesNegativeTest-1300675369 tempest-VolumesNegativeTest-1300675369-project] Request method failure captured: Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 119 Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7AJeTXFVMi9GDgAGYa_DyxZYD3-LcPoJGiBEBwHsWZ5qeLigb4UtAaZFUQ11bOqxY9eudUCdFet1otoswNOGyk3T5qgNVDc93to3YndKoeFJBp9eMbBzkljtD46IPfJvp6aeFK0zvOFr69ATKjiO2Q-b7HAKkr-kKZe7H8G30V8COMU Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: e1b0657a2fc94ae590dadad62a881a12 Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-VolumesNegativeTest-1300675369 Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e1b0657a2fc94ae590dadad62a881a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e1b0657a2fc94ae590dadad62a881a12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e1b0657a2fc94ae590dadad62a881a12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e1b0657a2fc94ae590dadad62a881a12"}]}] Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-VolumesNegativeTest-1300675369 Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: e1b0657a2fc94ae590dadad62a881a12 Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-VolumesNegativeTest-1300675369 Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-VolumesNegativeTest-1300675369-project Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 7b8b30bd1c294bff8826ea958909523f Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-VolumesNegativeTest-1300675369-project Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1754433151", "metadata": {"Type": "work"}}} Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1754433151', 'metadata': {'Type': 'work'}}}} Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise error Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi '' Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 17:31:11.431781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 17:31:11.442385 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 17:31:11.442385 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.442385 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:31:11.442385 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.442385 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:31:11.442385 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:31:11.442385 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:31:11.442385 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 17:31:11.442385 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 17:31:11.442385 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 17:31:11.442385 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.445750 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-81bdcf34-20a9-4e04-b21b-171794620891 tempest-VolumesNegativeTest-1300675369 tempest-VolumesNegativeTest-1300675369-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:31:11.445750 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-81bdcf34-20a9-4e04-b21b-171794620891 tempest-VolumesNegativeTest-1300675369 tempest-VolumesNegativeTest-1300675369-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.071996 Aug 04 17:31:11.445750 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3073/6116] 10.222.0.93 () {60 vars in 1156 bytes} [Thu Aug 4 17:31:11 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 17:31:11.466601 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4d9a87df-04bf-4037-ad61-11fc17a5e0d9 tempest-VolumesNegativeTest-1300675369 tempest-VolumesNegativeTest-1300675369-project] Calling method '.version_select at 0x7f1e5b3564c0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:31:11.586410 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-4d9a87df-04bf-4037-ad61-11fc17a5e0d9 tempest-VolumesNegativeTest-1300675369 tempest-VolumesNegativeTest-1300675369-project] HTTP exception thrown: Volume tempest-invalid-1027671965 could not be found. Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4d9a87df-04bf-4037-ad61-11fc17a5e0d9 tempest-VolumesNegativeTest-1300675369 tempest-VolumesNegativeTest-1300675369-project] Request method failure captured: Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1027671965 HTTP/1.1 Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AJeTXFVMi9GDgAGYa_DyxZYD3-LcPoJGiBEBwHsWZ5qeLigb4UtAaZFUQ11bOqxY9eudUCdFet1otoswNOGyk3T5qgNVDc93to3YndKoeFJBp9eMbBzkljtD46IPfJvp6aeFK0zvOFr69ATKjiO2Q-b7HAKkr-kKZe7H8G30V8COMU Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: e1b0657a2fc94ae590dadad62a881a12 Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-VolumesNegativeTest-1300675369 Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e1b0657a2fc94ae590dadad62a881a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e1b0657a2fc94ae590dadad62a881a12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e1b0657a2fc94ae590dadad62a881a12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e1b0657a2fc94ae590dadad62a881a12"}]}] Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-VolumesNegativeTest-1300675369 Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: e1b0657a2fc94ae590dadad62a881a12 Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-VolumesNegativeTest-1300675369 Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-VolumesNegativeTest-1300675369-project Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 7b8b30bd1c294bff8826ea958909523f Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-VolumesNegativeTest-1300675369-project Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: exception: Volume tempest-invalid-1027671965 could not be found. Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'tempest-invalid-1027671965'} Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1027671965 could not be found. (HTTP 404) (Request-ID: req-eedb1f26-050c-4100-a48e-06129f90d400) Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 17:31:11.589553 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1027671965 could not be found. Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1027671965 could not be found. Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1027671965 could not be found. Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4d9a87df-04bf-4037-ad61-11fc17a5e0d9 tempest-VolumesNegativeTest-1300675369 tempest-VolumesNegativeTest-1300675369-project] Returning 404 to user: Volume tempest-invalid-1027671965 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:31:11.601179 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4d9a87df-04bf-4037-ad61-11fc17a5e0d9 tempest-VolumesNegativeTest-1300675369 tempest-VolumesNegativeTest-1300675369-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1027671965" status: 404 len: 99 microversion: 2.1 time: 0.135737 Aug 04 17:31:11.607385 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3044/6117] 10.222.0.93 () {58 vars in 1218 bytes} [Thu Aug 4 17:31:11 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1027671965 => generated 99 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 17:31:11.608924 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8d9929e9-3d89-49fc-869c-0d0c2fc9abeb tempest-VolumesNegativeTest-1300675369 tempest-VolumesNegativeTest-1300675369-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003845 Aug 04 17:31:11.610021 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3074/6118] 10.222.0.93 () {58 vars in 1140 bytes} [Thu Aug 4 17:31:11 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 17:31:11.628000 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-afc837c6-e833-4d2f-8fa0-82d8d5234270 tempest-VolumesNegativeTest-1300675369 tempest-VolumesNegativeTest-1300675369-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007522 Aug 04 17:31:11.628790 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3045/6119] 10.222.0.93 () {58 vars in 1137 bytes} [Thu Aug 4 17:31:11 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 17:31:11.640116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-81616702-572b-4625-ab52-9afa6ba2dfa2 tempest-VolumesNegativeTest-1300675369 tempest-VolumesNegativeTest-1300675369-project] Calling method '.version_select at 0x7f1e5b00c4c0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:31:11.695276 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-81616702-572b-4625-ab52-9afa6ba2dfa2 tempest-VolumesNegativeTest-1300675369 tempest-VolumesNegativeTest-1300675369-project] HTTP exception thrown: Volume c46d600d-64bf-4eff-a756-e581fe94b6cf could not be found. Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-81616702-572b-4625-ab52-9afa6ba2dfa2 tempest-VolumesNegativeTest-1300675369 tempest-VolumesNegativeTest-1300675369-project] Request method failure captured: Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/os-volumes/c46d600d-64bf-4eff-a756-e581fe94b6cf HTTP/1.1 Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7AJeTXFVMi9GDgAGYa_DyxZYD3-LcPoJGiBEBwHsWZ5qeLigb4UtAaZFUQ11bOqxY9eudUCdFet1otoswNOGyk3T5qgNVDc93to3YndKoeFJBp9eMbBzkljtD46IPfJvp6aeFK0zvOFr69ATKjiO2Q-b7HAKkr-kKZe7H8G30V8COMU Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: e1b0657a2fc94ae590dadad62a881a12 Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-VolumesNegativeTest-1300675369 Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e1b0657a2fc94ae590dadad62a881a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e1b0657a2fc94ae590dadad62a881a12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e1b0657a2fc94ae590dadad62a881a12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e1b0657a2fc94ae590dadad62a881a12"}]}] Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-VolumesNegativeTest-1300675369 Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: e1b0657a2fc94ae590dadad62a881a12 Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-VolumesNegativeTest-1300675369 Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-VolumesNegativeTest-1300675369-project Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 7b8b30bd1c294bff8826ea958909523f Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-VolumesNegativeTest-1300675369-project Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: method: Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: exception: Volume c46d600d-64bf-4eff-a756-e581fe94b6cf could not be found. Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'c46d600d-64bf-4eff-a756-e581fe94b6cf'} Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c46d600d-64bf-4eff-a756-e581fe94b6cf could not be found. (HTTP 404) (Request-ID: req-1e7ce849-4cb7-4638-8577-d743f629134a) Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 17:31:11.697313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c46d600d-64bf-4eff-a756-e581fe94b6cf could not be found. Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c46d600d-64bf-4eff-a756-e581fe94b6cf could not be found. Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c46d600d-64bf-4eff-a756-e581fe94b6cf could not be found. Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-81616702-572b-4625-ab52-9afa6ba2dfa2 tempest-VolumesNegativeTest-1300675369 tempest-VolumesNegativeTest-1300675369-project] Returning 404 to user: Volume c46d600d-64bf-4eff-a756-e581fe94b6cf could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-81616702-572b-4625-ab52-9afa6ba2dfa2 tempest-VolumesNegativeTest-1300675369 tempest-VolumesNegativeTest-1300675369-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/c46d600d-64bf-4eff-a756-e581fe94b6cf" status: 404 len: 109 microversion: 2.1 time: 0.062598 Aug 04 17:31:11.719809 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3075/6120] 10.222.0.93 () {58 vars in 1248 bytes} [Thu Aug 4 17:31:11 2022] DELETE /compute/v2.1/os-volumes/c46d600d-64bf-4eff-a756-e581fe94b6cf => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:31:11.730665 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8c3a3558-f6d8-4fe6-82e8-052f9d883f7e tempest-VolumesNegativeTest-1300675369 tempest-VolumesNegativeTest-1300675369-project] Calling method '.version_select at 0x7f1e5b50caf0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:31:11.846702 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-8c3a3558-f6d8-4fe6-82e8-052f9d883f7e tempest-VolumesNegativeTest-1300675369 tempest-VolumesNegativeTest-1300675369-project] HTTP exception thrown: Volume 5ca62f51-4eb5-469a-afc4-668052646762 could not be found. Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8c3a3558-f6d8-4fe6-82e8-052f9d883f7e tempest-VolumesNegativeTest-1300675369 tempest-VolumesNegativeTest-1300675369-project] Request method failure captured: Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-volumes/5ca62f51-4eb5-469a-afc4-668052646762 HTTP/1.1 Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AJeTXFVMi9GDgAGYa_DyxZYD3-LcPoJGiBEBwHsWZ5qeLigb4UtAaZFUQ11bOqxY9eudUCdFet1otoswNOGyk3T5qgNVDc93to3YndKoeFJBp9eMbBzkljtD46IPfJvp6aeFK0zvOFr69ATKjiO2Q-b7HAKkr-kKZe7H8G30V8COMU Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: e1b0657a2fc94ae590dadad62a881a12 Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-VolumesNegativeTest-1300675369 Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e1b0657a2fc94ae590dadad62a881a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e1b0657a2fc94ae590dadad62a881a12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e1b0657a2fc94ae590dadad62a881a12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e1b0657a2fc94ae590dadad62a881a12"}]}] Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-VolumesNegativeTest-1300675369 Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: e1b0657a2fc94ae590dadad62a881a12 Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-VolumesNegativeTest-1300675369 Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-VolumesNegativeTest-1300675369-project Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 7b8b30bd1c294bff8826ea958909523f Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-VolumesNegativeTest-1300675369-project Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: method: Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: exception: Volume 5ca62f51-4eb5-469a-afc4-668052646762 could not be found. Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '5ca62f51-4eb5-469a-afc4-668052646762'} Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5ca62f51-4eb5-469a-afc4-668052646762 could not be found. (HTTP 404) (Request-ID: req-6fcd7d61-b613-4bb7-b41e-8c75c6ad4ca7) Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 17:31:11.851284 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5ca62f51-4eb5-469a-afc4-668052646762 could not be found. Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5ca62f51-4eb5-469a-afc4-668052646762 could not be found. Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5ca62f51-4eb5-469a-afc4-668052646762 could not be found. Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8c3a3558-f6d8-4fe6-82e8-052f9d883f7e tempest-VolumesNegativeTest-1300675369 tempest-VolumesNegativeTest-1300675369-project] Returning 404 to user: Volume 5ca62f51-4eb5-469a-afc4-668052646762 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8c3a3558-f6d8-4fe6-82e8-052f9d883f7e tempest-VolumesNegativeTest-1300675369 tempest-VolumesNegativeTest-1300675369-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/5ca62f51-4eb5-469a-afc4-668052646762" status: 404 len: 109 microversion: 2.1 time: 0.145559 Aug 04 17:31:11.858188 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3046/6121] 10.222.0.93 () {58 vars in 1245 bytes} [Thu Aug 4 17:31:11 2022] GET /compute/v2.1/os-volumes/5ca62f51-4eb5-469a-afc4-668052646762 => generated 109 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:31:51.100767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5ca9885e-1d87-4e33-9c97-d096a49bfea7 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-337992267", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "c96e2d53-5ac6-4f7f-8823-c1bfc6cb37be"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1288627812", "security_groups": []}, "os:scheduler_hints": {"different_host": ["2bfea754-0ea9-4952-9e7c-51a86d45edec"]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:31:51.123046 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=23 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:31:51.124285 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=57 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:31:51.304595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-5ca9885e-1d87-4e33-9c97-d096a49bfea7 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] validate_networks() for [('c96e2d53-5ac6-4f7f-8823-c1bfc6cb37be', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:31:52.421805 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5ca9885e-1d87-4e33-9c97-d096a49bfea7 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:31:52.422481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5ca9885e-1d87-4e33-9c97-d096a49bfea7 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:31:52.422749 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5ca9885e-1d87-4e33-9c97-d096a49bfea7 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:31:52.424182 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5ca9885e-1d87-4e33-9c97-d096a49bfea7 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:31:52.424806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5ca9885e-1d87-4e33-9c97-d096a49bfea7 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:31:52.449501 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ca9885e-1d87-4e33-9c97-d096a49bfea7 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:31:52.449671 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ca9885e-1d87-4e33-9c97-d096a49bfea7 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:31:52.450206 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ca9885e-1d87-4e33-9c97-d096a49bfea7 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:31:52.451010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ca9885e-1d87-4e33-9c97-d096a49bfea7 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:31:52.451474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ca9885e-1d87-4e33-9c97-d096a49bfea7 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:31:52.451909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ca9885e-1d87-4e33-9c97-d096a49bfea7 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:31:52.503738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-5ca9885e-1d87-4e33-9c97-d096a49bfea7 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Getting quotas for project 9741bb2238ae4e019cadaa2db07bc5e6. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:31:52.522646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-5ca9885e-1d87-4e33-9c97-d096a49bfea7 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Getting quotas for user f4943545f6aa41aeaac744c9f422c822 and project 9741bb2238ae4e019cadaa2db07bc5e6. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:31:52.551689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5ca9885e-1d87-4e33-9c97-d096a49bfea7 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:31:52.554345 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5ca9885e-1d87-4e33-9c97-d096a49bfea7 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 78fd0e7d-a493-433f-9a94-4919ccea5ac9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:31:52.682351 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5ca9885e-1d87-4e33-9c97-d096a49bfea7 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.583114 Aug 04 17:31:52.685299 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3076/6122] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:31:51 2022] POST /compute/v2.1/servers => generated 361 bytes in 1592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:31:52.696466 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=9 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:31:52.697127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=13 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:31:52.702853 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f2916ac4-9e91-4524-a008-2133490ce99d tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:31:52.704600 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f2916ac4-9e91-4524-a008-2133490ce99d tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 78fd0e7d-a493-433f-9a94-4919ccea5ac9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:31:52.840317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f2916ac4-9e91-4524-a008-2133490ce99d tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4943545f6aa41aeaac744c9f422c822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9741bb2238ae4e019cadaa2db07bc5e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:31:52.852885 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f2916ac4-9e91-4524-a008-2133490ce99d tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9" status: 200 len: 1241 microversion: 2.1 time: 0.159350 Aug 04 17:31:52.853482 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3047/6123] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:31:52 2022] GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9 => generated 1241 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:31:53.873862 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d3c60d99-9dc6-4f9d-9d5c-534abb40cb22 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:31:53.876070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d3c60d99-9dc6-4f9d-9d5c-534abb40cb22 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 78fd0e7d-a493-433f-9a94-4919ccea5ac9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:31:53.893490 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3c60d99-9dc6-4f9d-9d5c-534abb40cb22 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:31:53.893994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3c60d99-9dc6-4f9d-9d5c-534abb40cb22 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:31:53.894453 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3c60d99-9dc6-4f9d-9d5c-534abb40cb22 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:31:53.895186 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3c60d99-9dc6-4f9d-9d5c-534abb40cb22 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:31:53.895653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3c60d99-9dc6-4f9d-9d5c-534abb40cb22 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:31:53.917296 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3c60d99-9dc6-4f9d-9d5c-534abb40cb22 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:31:54.259717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d3c60d99-9dc6-4f9d-9d5c-534abb40cb22 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4943545f6aa41aeaac744c9f422c822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9741bb2238ae4e019cadaa2db07bc5e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:31:54.275749 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d3c60d99-9dc6-4f9d-9d5c-534abb40cb22 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9" status: 200 len: 1237 microversion: 2.1 time: 0.405717 Aug 04 17:31:54.281655 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3077/6124] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:31:53 2022] GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9 => generated 1237 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:31:55.302075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-977f52cd-fc79-47e1-b66b-69c7dbb8a270 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:31:55.303393 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-977f52cd-fc79-47e1-b66b-69c7dbb8a270 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 78fd0e7d-a493-433f-9a94-4919ccea5ac9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:31:55.317269 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-977f52cd-fc79-47e1-b66b-69c7dbb8a270 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:31:55.320664 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-977f52cd-fc79-47e1-b66b-69c7dbb8a270 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:31:55.321523 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-977f52cd-fc79-47e1-b66b-69c7dbb8a270 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:31:55.322493 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-977f52cd-fc79-47e1-b66b-69c7dbb8a270 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:31:55.323142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-977f52cd-fc79-47e1-b66b-69c7dbb8a270 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:31:55.324394 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-977f52cd-fc79-47e1-b66b-69c7dbb8a270 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:31:55.570917 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-977f52cd-fc79-47e1-b66b-69c7dbb8a270 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4943545f6aa41aeaac744c9f422c822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9741bb2238ae4e019cadaa2db07bc5e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:31:55.592740 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-977f52cd-fc79-47e1-b66b-69c7dbb8a270 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9" status: 200 len: 1299 microversion: 2.1 time: 0.295250 Aug 04 17:31:55.598884 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3048/6125] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:31:55 2022] GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9 => generated 1299 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:31:56.628567 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-99af2346-313e-40d7-9605-345f80dc4e5a tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:31:56.629123 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-99af2346-313e-40d7-9605-345f80dc4e5a tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 78fd0e7d-a493-433f-9a94-4919ccea5ac9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:31:56.640071 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99af2346-313e-40d7-9605-345f80dc4e5a tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:31:56.643588 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99af2346-313e-40d7-9605-345f80dc4e5a tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:31:56.648393 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99af2346-313e-40d7-9605-345f80dc4e5a tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:31:56.649586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99af2346-313e-40d7-9605-345f80dc4e5a tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:31:56.650270 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99af2346-313e-40d7-9605-345f80dc4e5a tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:31:56.650896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99af2346-313e-40d7-9605-345f80dc4e5a tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:31:57.121315 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-99af2346-313e-40d7-9605-345f80dc4e5a tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4943545f6aa41aeaac744c9f422c822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9741bb2238ae4e019cadaa2db07bc5e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:31:57.136013 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-99af2346-313e-40d7-9605-345f80dc4e5a tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9" status: 200 len: 1299 microversion: 2.1 time: 0.516824 Aug 04 17:31:57.145519 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3078/6126] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:31:56 2022] GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9 => generated 1299 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:31:58.158387 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9648c53e-a52a-4a54-8375-9d9dc81eb42f tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:31:58.159026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9648c53e-a52a-4a54-8375-9d9dc81eb42f tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 78fd0e7d-a493-433f-9a94-4919ccea5ac9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:31:58.172694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9648c53e-a52a-4a54-8375-9d9dc81eb42f tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:31:58.173273 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9648c53e-a52a-4a54-8375-9d9dc81eb42f tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:31:58.173716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9648c53e-a52a-4a54-8375-9d9dc81eb42f tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:31:58.174466 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9648c53e-a52a-4a54-8375-9d9dc81eb42f tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:31:58.174936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9648c53e-a52a-4a54-8375-9d9dc81eb42f tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:31:58.175370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9648c53e-a52a-4a54-8375-9d9dc81eb42f tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:31:58.580771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9648c53e-a52a-4a54-8375-9d9dc81eb42f tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4943545f6aa41aeaac744c9f422c822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9741bb2238ae4e019cadaa2db07bc5e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:31:58.630550 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9648c53e-a52a-4a54-8375-9d9dc81eb42f tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9" status: 200 len: 1299 microversion: 2.1 time: 0.471241 Aug 04 17:31:58.633314 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3049/6127] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:31:58 2022] GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9 => generated 1299 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:31:59.165825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-13ef93fb-67f9-4ae6-81d4-793ee47c501d req-1aa426ac-bbf4-4e5e-b589-d16ec134715a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78fd0e7d-a493-433f-9a94-4919ccea5ac9", "tag": "b9ae3b7b-8efa-43a3-b7a8-729cea564df7"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:31:59.194613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-13ef93fb-67f9-4ae6-81d4-793ee47c501d req-1aa426ac-bbf4-4e5e-b589-d16ec134715a service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:31:59.195465 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-13ef93fb-67f9-4ae6-81d4-793ee47c501d req-1aa426ac-bbf4-4e5e-b589-d16ec134715a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:31:59.196193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-13ef93fb-67f9-4ae6-81d4-793ee47c501d req-1aa426ac-bbf4-4e5e-b589-d16ec134715a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:31:59.215314 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-13ef93fb-67f9-4ae6-81d4-793ee47c501d req-1aa426ac-bbf4-4e5e-b589-d16ec134715a service nova] Creating event network-changed:b9ae3b7b-8efa-43a3-b7a8-729cea564df7 for instance 78fd0e7d-a493-433f-9a94-4919ccea5ac9 on n-h2-851359-3 Aug 04 17:31:59.237363 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-13ef93fb-67f9-4ae6-81d4-793ee47c501d req-1aa426ac-bbf4-4e5e-b589-d16ec134715a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076187 Aug 04 17:31:59.238002 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3079/6128] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:31:59.656706 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-289698e2-45a9-470c-bb1a-ee817b0b5c5e tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:31:59.658432 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-289698e2-45a9-470c-bb1a-ee817b0b5c5e tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 78fd0e7d-a493-433f-9a94-4919ccea5ac9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:31:59.677631 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-289698e2-45a9-470c-bb1a-ee817b0b5c5e tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:31:59.682297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-289698e2-45a9-470c-bb1a-ee817b0b5c5e tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:31:59.683076 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-289698e2-45a9-470c-bb1a-ee817b0b5c5e tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:31:59.683819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-289698e2-45a9-470c-bb1a-ee817b0b5c5e tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:31:59.687733 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-289698e2-45a9-470c-bb1a-ee817b0b5c5e tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:31:59.688202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-289698e2-45a9-470c-bb1a-ee817b0b5c5e tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:31:59.943374 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-289698e2-45a9-470c-bb1a-ee817b0b5c5e tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4943545f6aa41aeaac744c9f422c822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9741bb2238ae4e019cadaa2db07bc5e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:31:59.952196 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-289698e2-45a9-470c-bb1a-ee817b0b5c5e tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9" status: 200 len: 1299 microversion: 2.1 time: 0.302125 Aug 04 17:31:59.956883 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3050/6129] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:31:59 2022] GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9 => generated 1299 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:00.982879 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-81056994-1754-443f-9541-031eb97a42c5 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:00.984871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-81056994-1754-443f-9541-031eb97a42c5 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 78fd0e7d-a493-433f-9a94-4919ccea5ac9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:00.994651 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81056994-1754-443f-9541-031eb97a42c5 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:00.996288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81056994-1754-443f-9541-031eb97a42c5 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:00.997061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81056994-1754-443f-9541-031eb97a42c5 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:00.998472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81056994-1754-443f-9541-031eb97a42c5 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:00.999182 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81056994-1754-443f-9541-031eb97a42c5 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:01.000596 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81056994-1754-443f-9541-031eb97a42c5 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:01.127915 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-81056994-1754-443f-9541-031eb97a42c5 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4943545f6aa41aeaac744c9f422c822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9741bb2238ae4e019cadaa2db07bc5e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:01.139674 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-81056994-1754-443f-9541-031eb97a42c5 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9" status: 200 len: 1299 microversion: 2.1 time: 0.165878 Aug 04 17:32:01.140471 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3080/6130] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:00 2022] GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9 => generated 1299 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:02.162493 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-037b50be-d498-438d-b7e9-632f251b2642 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:02.164177 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-037b50be-d498-438d-b7e9-632f251b2642 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 78fd0e7d-a493-433f-9a94-4919ccea5ac9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:02.174012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-037b50be-d498-438d-b7e9-632f251b2642 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:02.174742 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-037b50be-d498-438d-b7e9-632f251b2642 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:02.175423 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-037b50be-d498-438d-b7e9-632f251b2642 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:02.176297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-037b50be-d498-438d-b7e9-632f251b2642 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:02.177026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-037b50be-d498-438d-b7e9-632f251b2642 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:02.177693 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-037b50be-d498-438d-b7e9-632f251b2642 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:02.337655 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-037b50be-d498-438d-b7e9-632f251b2642 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4943545f6aa41aeaac744c9f422c822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9741bb2238ae4e019cadaa2db07bc5e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:02.346371 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-037b50be-d498-438d-b7e9-632f251b2642 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9" status: 200 len: 1299 microversion: 2.1 time: 0.188245 Aug 04 17:32:02.347278 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3051/6131] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:02 2022] GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9 => generated 1299 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:03.369427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3a0898b3-2676-4347-8187-42e8a0e66fd4 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:03.380745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3a0898b3-2676-4347-8187-42e8a0e66fd4 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 78fd0e7d-a493-433f-9a94-4919ccea5ac9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:03.383878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:32:03.384577 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:32:03.400572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a0898b3-2676-4347-8187-42e8a0e66fd4 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:03.401390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a0898b3-2676-4347-8187-42e8a0e66fd4 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:03.402345 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a0898b3-2676-4347-8187-42e8a0e66fd4 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:03.403329 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a0898b3-2676-4347-8187-42e8a0e66fd4 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:03.403805 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a0898b3-2676-4347-8187-42e8a0e66fd4 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:03.410340 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a0898b3-2676-4347-8187-42e8a0e66fd4 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:03.639447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3a0898b3-2676-4347-8187-42e8a0e66fd4 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4943545f6aa41aeaac744c9f422c822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9741bb2238ae4e019cadaa2db07bc5e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:03.651502 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3a0898b3-2676-4347-8187-42e8a0e66fd4 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9" status: 200 len: 1299 microversion: 2.1 time: 0.285928 Aug 04 17:32:03.653017 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3081/6132] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:03 2022] GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9 => generated 1299 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:04.675091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eb4f46d6-6ae0-4e50-808b-245f5f5bb895 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:04.675897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eb4f46d6-6ae0-4e50-808b-245f5f5bb895 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 78fd0e7d-a493-433f-9a94-4919ccea5ac9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:04.677894 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:32:04.695303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb4f46d6-6ae0-4e50-808b-245f5f5bb895 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:04.695841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb4f46d6-6ae0-4e50-808b-245f5f5bb895 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:04.698639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb4f46d6-6ae0-4e50-808b-245f5f5bb895 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:04.699479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb4f46d6-6ae0-4e50-808b-245f5f5bb895 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:04.700047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb4f46d6-6ae0-4e50-808b-245f5f5bb895 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:04.700579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb4f46d6-6ae0-4e50-808b-245f5f5bb895 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:04.850016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eb4f46d6-6ae0-4e50-808b-245f5f5bb895 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4943545f6aa41aeaac744c9f422c822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9741bb2238ae4e019cadaa2db07bc5e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:04.865190 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eb4f46d6-6ae0-4e50-808b-245f5f5bb895 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9" status: 200 len: 1299 microversion: 2.1 time: 0.191752 Aug 04 17:32:04.866048 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3052/6133] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:04 2022] GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9 => generated 1299 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:05.887585 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-214f7721-f640-4637-9b84-d27f47348a0b tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:05.888112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-214f7721-f640-4637-9b84-d27f47348a0b tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 78fd0e7d-a493-433f-9a94-4919ccea5ac9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:05.897637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-214f7721-f640-4637-9b84-d27f47348a0b tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:05.898174 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-214f7721-f640-4637-9b84-d27f47348a0b tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:05.898619 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-214f7721-f640-4637-9b84-d27f47348a0b tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:05.899331 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-214f7721-f640-4637-9b84-d27f47348a0b tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:05.899779 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-214f7721-f640-4637-9b84-d27f47348a0b tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:05.900207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-214f7721-f640-4637-9b84-d27f47348a0b tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:06.078255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-214f7721-f640-4637-9b84-d27f47348a0b tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4943545f6aa41aeaac744c9f422c822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9741bb2238ae4e019cadaa2db07bc5e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:06.086250 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-214f7721-f640-4637-9b84-d27f47348a0b tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9" status: 200 len: 1299 microversion: 2.1 time: 0.203212 Aug 04 17:32:06.086832 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3082/6134] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:05 2022] GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9 => generated 1299 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:32:06.388020 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-8c8931fc-d84f-4fe9-937d-15ba3b2b19ad req-e31b39f7-35f0-4838-8715-19005ee0b4da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78fd0e7d-a493-433f-9a94-4919ccea5ac9", "name": "network-vif-plugged", "status": "completed", "tag": "b9ae3b7b-8efa-43a3-b7a8-729cea564df7"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:32:06.411527 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8c8931fc-d84f-4fe9-937d-15ba3b2b19ad req-e31b39f7-35f0-4838-8715-19005ee0b4da service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:06.414593 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8c8931fc-d84f-4fe9-937d-15ba3b2b19ad req-e31b39f7-35f0-4838-8715-19005ee0b4da service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:06.415240 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8c8931fc-d84f-4fe9-937d-15ba3b2b19ad req-e31b39f7-35f0-4838-8715-19005ee0b4da service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:06.463503 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-8c8931fc-d84f-4fe9-937d-15ba3b2b19ad req-e31b39f7-35f0-4838-8715-19005ee0b4da service nova] Creating event network-vif-plugged:b9ae3b7b-8efa-43a3-b7a8-729cea564df7 for instance 78fd0e7d-a493-433f-9a94-4919ccea5ac9 on n-h2-851359-3 Aug 04 17:32:06.490195 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-8c8931fc-d84f-4fe9-937d-15ba3b2b19ad req-e31b39f7-35f0-4838-8715-19005ee0b4da service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106487 Aug 04 17:32:06.493633 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3053/6135] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:32:07.114930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a5a09029-41d1-4c8b-b59a-07d984c31f25 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:07.115681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a5a09029-41d1-4c8b-b59a-07d984c31f25 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 78fd0e7d-a493-433f-9a94-4919ccea5ac9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:07.131057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a5a09029-41d1-4c8b-b59a-07d984c31f25 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:07.132988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a5a09029-41d1-4c8b-b59a-07d984c31f25 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:07.133458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a5a09029-41d1-4c8b-b59a-07d984c31f25 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:07.137114 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a5a09029-41d1-4c8b-b59a-07d984c31f25 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:07.138399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a5a09029-41d1-4c8b-b59a-07d984c31f25 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:07.138873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a5a09029-41d1-4c8b-b59a-07d984c31f25 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:07.341648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a5a09029-41d1-4c8b-b59a-07d984c31f25 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4943545f6aa41aeaac744c9f422c822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9741bb2238ae4e019cadaa2db07bc5e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:07.355082 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a5a09029-41d1-4c8b-b59a-07d984c31f25 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9" status: 200 len: 1299 microversion: 2.1 time: 0.246210 Aug 04 17:32:07.366616 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3083/6136] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:07 2022] GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9 => generated 1299 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:08.379140 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-64f2dd4c-dc98-45ff-a375-107a98c6aec8 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:08.384414 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-64f2dd4c-dc98-45ff-a375-107a98c6aec8 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 78fd0e7d-a493-433f-9a94-4919ccea5ac9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:08.393763 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64f2dd4c-dc98-45ff-a375-107a98c6aec8 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:08.394313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64f2dd4c-dc98-45ff-a375-107a98c6aec8 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:08.394761 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64f2dd4c-dc98-45ff-a375-107a98c6aec8 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:08.395494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64f2dd4c-dc98-45ff-a375-107a98c6aec8 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:08.396149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64f2dd4c-dc98-45ff-a375-107a98c6aec8 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:08.396764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64f2dd4c-dc98-45ff-a375-107a98c6aec8 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:08.609919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-64f2dd4c-dc98-45ff-a375-107a98c6aec8 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4943545f6aa41aeaac744c9f422c822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9741bb2238ae4e019cadaa2db07bc5e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:08.621679 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-64f2dd4c-dc98-45ff-a375-107a98c6aec8 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9" status: 200 len: 1472 microversion: 2.1 time: 0.248607 Aug 04 17:32:08.623105 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3054/6137] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:08 2022] GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9 => generated 1472 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:08.644112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d3d9a62a-48a0-481b-b293-770ae5473d82 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:08.645095 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d3d9a62a-48a0-481b-b293-770ae5473d82 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 78fd0e7d-a493-433f-9a94-4919ccea5ac9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:08.655131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3d9a62a-48a0-481b-b293-770ae5473d82 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:08.655642 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3d9a62a-48a0-481b-b293-770ae5473d82 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:08.656090 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3d9a62a-48a0-481b-b293-770ae5473d82 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:08.656816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3d9a62a-48a0-481b-b293-770ae5473d82 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:08.662563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3d9a62a-48a0-481b-b293-770ae5473d82 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:08.663180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3d9a62a-48a0-481b-b293-770ae5473d82 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:08.793641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d3d9a62a-48a0-481b-b293-770ae5473d82 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4943545f6aa41aeaac744c9f422c822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9741bb2238ae4e019cadaa2db07bc5e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:08.803821 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d3d9a62a-48a0-481b-b293-770ae5473d82 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9" status: 200 len: 1472 microversion: 2.1 time: 0.164284 Aug 04 17:32:08.804589 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3084/6138] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:08 2022] GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9 => generated 1472 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:08.830987 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-33160642-59a0-468e-ac4c-43c57a5539bf tempest-TestSecurityGroupsBasicOps-315069139 tempest-TestSecurityGroupsBasicOps-315069139-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:08.832042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-33160642-59a0-468e-ac4c-43c57a5539bf tempest-TestSecurityGroupsBasicOps-315069139 tempest-TestSecurityGroupsBasicOps-315069139-project-admin] [instance: 78fd0e7d-a493-433f-9a94-4919ccea5ac9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:08.845614 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33160642-59a0-468e-ac4c-43c57a5539bf tempest-TestSecurityGroupsBasicOps-315069139 tempest-TestSecurityGroupsBasicOps-315069139-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:08.846472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33160642-59a0-468e-ac4c-43c57a5539bf tempest-TestSecurityGroupsBasicOps-315069139 tempest-TestSecurityGroupsBasicOps-315069139-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:08.847189 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33160642-59a0-468e-ac4c-43c57a5539bf tempest-TestSecurityGroupsBasicOps-315069139 tempest-TestSecurityGroupsBasicOps-315069139-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:08.849000 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33160642-59a0-468e-ac4c-43c57a5539bf tempest-TestSecurityGroupsBasicOps-315069139 tempest-TestSecurityGroupsBasicOps-315069139-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:08.849793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33160642-59a0-468e-ac4c-43c57a5539bf tempest-TestSecurityGroupsBasicOps-315069139 tempest-TestSecurityGroupsBasicOps-315069139-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:08.850728 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33160642-59a0-468e-ac4c-43c57a5539bf tempest-TestSecurityGroupsBasicOps-315069139 tempest-TestSecurityGroupsBasicOps-315069139-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:09.025121 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-33160642-59a0-468e-ac4c-43c57a5539bf tempest-TestSecurityGroupsBasicOps-315069139 tempest-TestSecurityGroupsBasicOps-315069139-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9" status: 200 len: 1623 microversion: 2.1 time: 0.200070 Aug 04 17:32:09.028547 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3055/6139] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:08 2022] GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9 => generated 1623 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:09.044728 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-735b2ed4-fe09-4b52-91c0-c2f02a414d9d tempest-TestSecurityGroupsBasicOps-315069139 tempest-TestSecurityGroupsBasicOps-315069139-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:09.045403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-735b2ed4-fe09-4b52-91c0-c2f02a414d9d tempest-TestSecurityGroupsBasicOps-315069139 tempest-TestSecurityGroupsBasicOps-315069139-project-admin] [instance: 2bfea754-0ea9-4952-9e7c-51a86d45edec] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:09.058117 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-735b2ed4-fe09-4b52-91c0-c2f02a414d9d tempest-TestSecurityGroupsBasicOps-315069139 tempest-TestSecurityGroupsBasicOps-315069139-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:09.060684 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-735b2ed4-fe09-4b52-91c0-c2f02a414d9d tempest-TestSecurityGroupsBasicOps-315069139 tempest-TestSecurityGroupsBasicOps-315069139-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:09.061862 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-735b2ed4-fe09-4b52-91c0-c2f02a414d9d tempest-TestSecurityGroupsBasicOps-315069139 tempest-TestSecurityGroupsBasicOps-315069139-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:09.066201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-735b2ed4-fe09-4b52-91c0-c2f02a414d9d tempest-TestSecurityGroupsBasicOps-315069139 tempest-TestSecurityGroupsBasicOps-315069139-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:09.070957 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-735b2ed4-fe09-4b52-91c0-c2f02a414d9d tempest-TestSecurityGroupsBasicOps-315069139 tempest-TestSecurityGroupsBasicOps-315069139-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:09.071871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-735b2ed4-fe09-4b52-91c0-c2f02a414d9d tempest-TestSecurityGroupsBasicOps-315069139 tempest-TestSecurityGroupsBasicOps-315069139-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:09.272601 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-735b2ed4-fe09-4b52-91c0-c2f02a414d9d tempest-TestSecurityGroupsBasicOps-315069139 tempest-TestSecurityGroupsBasicOps-315069139-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec" status: 200 len: 1911 microversion: 2.1 time: 0.230281 Aug 04 17:32:09.274401 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3085/6140] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:09 2022] GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec => generated 1911 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:09.369079 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aafe290b-16fa-40af-85e3-4fd1a69417fc tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:09.369576 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aafe290b-16fa-40af-85e3-4fd1a69417fc tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 78fd0e7d-a493-433f-9a94-4919ccea5ac9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:09.380359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aafe290b-16fa-40af-85e3-4fd1a69417fc tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:09.381015 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aafe290b-16fa-40af-85e3-4fd1a69417fc tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:09.381297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aafe290b-16fa-40af-85e3-4fd1a69417fc tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:09.382764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aafe290b-16fa-40af-85e3-4fd1a69417fc tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:09.383231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aafe290b-16fa-40af-85e3-4fd1a69417fc tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:09.383938 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aafe290b-16fa-40af-85e3-4fd1a69417fc tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:09.432079 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aafe290b-16fa-40af-85e3-4fd1a69417fc tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 78fd0e7d-a493-433f-9a94-4919ccea5ac9] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:32:09.580965 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aafe290b-16fa-40af-85e3-4fd1a69417fc tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "DELETE /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9" status: 204 len: 0 microversion: 2.1 time: 0.215982 Aug 04 17:32:09.586805 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3056/6141] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:32:09 2022] DELETE /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:32:09.591764 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d737bac7-821e-4678-bb8a-601177485abc tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:09.592608 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d737bac7-821e-4678-bb8a-601177485abc tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 78fd0e7d-a493-433f-9a94-4919ccea5ac9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:09.602102 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d737bac7-821e-4678-bb8a-601177485abc tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:09.602782 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d737bac7-821e-4678-bb8a-601177485abc tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:09.603485 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d737bac7-821e-4678-bb8a-601177485abc tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:09.604382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d737bac7-821e-4678-bb8a-601177485abc tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:09.610010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d737bac7-821e-4678-bb8a-601177485abc tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:09.611159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d737bac7-821e-4678-bb8a-601177485abc tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:09.727627 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d737bac7-821e-4678-bb8a-601177485abc tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4943545f6aa41aeaac744c9f422c822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9741bb2238ae4e019cadaa2db07bc5e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:09.738104 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d737bac7-821e-4678-bb8a-601177485abc tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9" status: 200 len: 1478 microversion: 2.1 time: 0.150666 Aug 04 17:32:09.741006 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3086/6142] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:09 2022] GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9 => generated 1478 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:10.760851 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2ebca025-7cb1-4e16-b681-bed8ce7cf430 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:10.761567 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2ebca025-7cb1-4e16-b681-bed8ce7cf430 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 78fd0e7d-a493-433f-9a94-4919ccea5ac9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:10.787970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ebca025-7cb1-4e16-b681-bed8ce7cf430 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:10.788815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ebca025-7cb1-4e16-b681-bed8ce7cf430 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:10.790068 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ebca025-7cb1-4e16-b681-bed8ce7cf430 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:10.790977 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ebca025-7cb1-4e16-b681-bed8ce7cf430 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:10.791449 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ebca025-7cb1-4e16-b681-bed8ce7cf430 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:10.791890 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ebca025-7cb1-4e16-b681-bed8ce7cf430 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:10.971724 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2ebca025-7cb1-4e16-b681-bed8ce7cf430 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4943545f6aa41aeaac744c9f422c822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9741bb2238ae4e019cadaa2db07bc5e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:10.983667 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2ebca025-7cb1-4e16-b681-bed8ce7cf430 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9" status: 200 len: 1478 microversion: 2.1 time: 0.227104 Aug 04 17:32:10.998686 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3057/6143] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:10 2022] GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9 => generated 1478 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:12.007727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-57cf3783-d4a7-49e9-ab00-9b0a8d4cc961 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:12.010446 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-57cf3783-d4a7-49e9-ab00-9b0a8d4cc961 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 78fd0e7d-a493-433f-9a94-4919ccea5ac9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:12.025304 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57cf3783-d4a7-49e9-ab00-9b0a8d4cc961 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:12.026496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57cf3783-d4a7-49e9-ab00-9b0a8d4cc961 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:12.027188 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57cf3783-d4a7-49e9-ab00-9b0a8d4cc961 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:12.029402 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57cf3783-d4a7-49e9-ab00-9b0a8d4cc961 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:12.030200 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57cf3783-d4a7-49e9-ab00-9b0a8d4cc961 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:12.030877 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57cf3783-d4a7-49e9-ab00-9b0a8d4cc961 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:12.234807 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-57cf3783-d4a7-49e9-ab00-9b0a8d4cc961 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4943545f6aa41aeaac744c9f422c822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9741bb2238ae4e019cadaa2db07bc5e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:12.236561 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-7f4f471b-8bd5-48f4-946a-f722850e9780 req-3a9d039f-6b18-4585-ae5b-3e1a1653bb08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78fd0e7d-a493-433f-9a94-4919ccea5ac9", "name": "network-vif-deleted", "tag": "b9ae3b7b-8efa-43a3-b7a8-729cea564df7"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:32:12.257528 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-57cf3783-d4a7-49e9-ab00-9b0a8d4cc961 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9" status: 200 len: 1478 microversion: 2.1 time: 0.253584 Aug 04 17:32:12.259685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7f4f471b-8bd5-48f4-946a-f722850e9780 req-3a9d039f-6b18-4585-ae5b-3e1a1653bb08 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:12.260427 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7f4f471b-8bd5-48f4-946a-f722850e9780 req-3a9d039f-6b18-4585-ae5b-3e1a1653bb08 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:12.261132 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7f4f471b-8bd5-48f4-946a-f722850e9780 req-3a9d039f-6b18-4585-ae5b-3e1a1653bb08 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:12.263013 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3087/6144] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:12 2022] GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9 => generated 1478 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:12.291972 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-7f4f471b-8bd5-48f4-946a-f722850e9780 req-3a9d039f-6b18-4585-ae5b-3e1a1653bb08 service nova] Creating event network-vif-deleted:b9ae3b7b-8efa-43a3-b7a8-729cea564df7 for instance 78fd0e7d-a493-433f-9a94-4919ccea5ac9 on n-h2-851359-3 Aug 04 17:32:12.297434 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-7f4f471b-8bd5-48f4-946a-f722850e9780 req-3a9d039f-6b18-4585-ae5b-3e1a1653bb08 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066606 Aug 04 17:32:12.299344 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3058/6145] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:32:13.307158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4f9187d1-46a1-4af3-aec6-a8dba841a2fa tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:13.307158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4f9187d1-46a1-4af3-aec6-a8dba841a2fa tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 78fd0e7d-a493-433f-9a94-4919ccea5ac9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:13.310151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f9187d1-46a1-4af3-aec6-a8dba841a2fa tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:13.310151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f9187d1-46a1-4af3-aec6-a8dba841a2fa tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:13.310994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f9187d1-46a1-4af3-aec6-a8dba841a2fa tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:13.311428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f9187d1-46a1-4af3-aec6-a8dba841a2fa tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:13.311884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f9187d1-46a1-4af3-aec6-a8dba841a2fa tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:13.313704 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4f9187d1-46a1-4af3-aec6-a8dba841a2fa tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:13.337759 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-4f9187d1-46a1-4af3-aec6-a8dba841a2fa tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] HTTP exception thrown: Instance 78fd0e7d-a493-433f-9a94-4919ccea5ac9 could not be found. Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4f9187d1-46a1-4af3-aec6-a8dba841a2fa tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Request method failure captured: Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9 HTTP/1.1 Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7AIuERaQMVDObEfj3oEv7bPwQzjaUHia9-E5OBF6-grxZB8U-VndGHnO-6pb-qnVnUpbMaE8TZgkb73Zne-izHNFccAhue9X2Pg8SZht99NTxd4GRSJfHEH3r3CjhgWpnCwrjJXXAz7Y7U186eHdSeNnDWFuGRev1g2E5826VqlubQM Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 9741bb2238ae4e019cadaa2db07bc5e6 Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1590022034 Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9741bb2238ae4e019cadaa2db07bc5e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9741bb2238ae4e019cadaa2db07bc5e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9741bb2238ae4e019cadaa2db07bc5e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9741bb2238ae4e019cadaa2db07bc5e6"}]}] Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1590022034 Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 9741bb2238ae4e019cadaa2db07bc5e6 Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1590022034 Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-TestSecurityGroupsBasicOps-1590022034-project Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: f4943545f6aa41aeaac744c9f422c822 Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1590022034-project Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 78fd0e7d-a493-433f-9a94-4919ccea5ac9 could not be found. Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '78fd0e7d-a493-433f-9a94-4919ccea5ac9'} Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78fd0e7d-a493-433f-9a94-4919ccea5ac9 could not be found. Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78fd0e7d-a493-433f-9a94-4919ccea5ac9 could not be found. Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:32:13.339652 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:32:13.344371 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:32:13.344371 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:32:13.344371 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:32:13.344371 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:32:13.344371 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:32:13.344371 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:32:13.344371 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78fd0e7d-a493-433f-9a94-4919ccea5ac9 could not be found. Aug 04 17:32:13.344371 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:32:13.344371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4f9187d1-46a1-4af3-aec6-a8dba841a2fa tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Returning 404 to user: Instance 78fd0e7d-a493-433f-9a94-4919ccea5ac9 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:32:13.344371 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4f9187d1-46a1-4af3-aec6-a8dba841a2fa tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9" status: 404 len: 111 microversion: 2.1 time: 0.056767 Aug 04 17:32:13.344371 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3088/6146] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:13 2022] GET /compute/v2.1/servers/78fd0e7d-a493-433f-9a94-4919ccea5ac9 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:32:14.615067 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b3979633-aee8-4c50-a660-86aa64a7503f tempest-PortsAdminExtendedAttrsIpV6TestJSON-330808928 tempest-PortsAdminExtendedAttrsIpV6TestJSON-330808928-project-admin] Calling method '.version_select at 0x7f1e5aa771f0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:14.617078 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:32:14.617078 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 17:32:14.618725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3979633-aee8-4c50-a660-86aa64a7503f tempest-PortsAdminExtendedAttrsIpV6TestJSON-330808928 tempest-PortsAdminExtendedAttrsIpV6TestJSON-330808928-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:14.619600 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3979633-aee8-4c50-a660-86aa64a7503f tempest-PortsAdminExtendedAttrsIpV6TestJSON-330808928 tempest-PortsAdminExtendedAttrsIpV6TestJSON-330808928-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:14.620214 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3979633-aee8-4c50-a660-86aa64a7503f tempest-PortsAdminExtendedAttrsIpV6TestJSON-330808928 tempest-PortsAdminExtendedAttrsIpV6TestJSON-330808928-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:14.638801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3979633-aee8-4c50-a660-86aa64a7503f tempest-PortsAdminExtendedAttrsIpV6TestJSON-330808928 tempest-PortsAdminExtendedAttrsIpV6TestJSON-330808928-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:14.640621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3979633-aee8-4c50-a660-86aa64a7503f tempest-PortsAdminExtendedAttrsIpV6TestJSON-330808928 tempest-PortsAdminExtendedAttrsIpV6TestJSON-330808928-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:14.641083 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3979633-aee8-4c50-a660-86aa64a7503f tempest-PortsAdminExtendedAttrsIpV6TestJSON-330808928 tempest-PortsAdminExtendedAttrsIpV6TestJSON-330808928-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:14.653536 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3979633-aee8-4c50-a660-86aa64a7503f tempest-PortsAdminExtendedAttrsIpV6TestJSON-330808928 tempest-PortsAdminExtendedAttrsIpV6TestJSON-330808928-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:14.654150 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3979633-aee8-4c50-a660-86aa64a7503f tempest-PortsAdminExtendedAttrsIpV6TestJSON-330808928 tempest-PortsAdminExtendedAttrsIpV6TestJSON-330808928-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:14.654500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3979633-aee8-4c50-a660-86aa64a7503f tempest-PortsAdminExtendedAttrsIpV6TestJSON-330808928 tempest-PortsAdminExtendedAttrsIpV6TestJSON-330808928-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:14.670843 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b3979633-aee8-4c50-a660-86aa64a7503f tempest-PortsAdminExtendedAttrsIpV6TestJSON-330808928 tempest-PortsAdminExtendedAttrsIpV6TestJSON-330808928-project-admin] 10.222.0.93 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.419188 Aug 04 17:32:14.671540 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3059/6147] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 17:32:14 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:32:21.239863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6eedc618-14b1-4c10-8426-628063d028a0 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:21.240898 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6eedc618-14b1-4c10-8426-628063d028a0 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 2bfea754-0ea9-4952-9e7c-51a86d45edec] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:21.250070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:32:21.252843 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6eedc618-14b1-4c10-8426-628063d028a0 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:21.254124 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6eedc618-14b1-4c10-8426-628063d028a0 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:21.254856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6eedc618-14b1-4c10-8426-628063d028a0 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:21.255750 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6eedc618-14b1-4c10-8426-628063d028a0 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:21.256364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6eedc618-14b1-4c10-8426-628063d028a0 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:21.256941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6eedc618-14b1-4c10-8426-628063d028a0 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:21.271022 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-13c91aba-6776-4ee9-bf07-55fe90cc51c1 req-7ea741b8-1af1-4abd-a38d-85ed710481d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bfea754-0ea9-4952-9e7c-51a86d45edec", "tag": "baad8965-c7ab-4db1-af92-3b3785555d6d"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:32:21.271492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=67 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:32:21.290703 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-13c91aba-6776-4ee9-bf07-55fe90cc51c1 req-7ea741b8-1af1-4abd-a38d-85ed710481d8 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:21.295856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-13c91aba-6776-4ee9-bf07-55fe90cc51c1 req-7ea741b8-1af1-4abd-a38d-85ed710481d8 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:21.302074 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-13c91aba-6776-4ee9-bf07-55fe90cc51c1 req-7ea741b8-1af1-4abd-a38d-85ed710481d8 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:21.326716 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-13c91aba-6776-4ee9-bf07-55fe90cc51c1 req-7ea741b8-1af1-4abd-a38d-85ed710481d8 service nova] Creating event network-changed:baad8965-c7ab-4db1-af92-3b3785555d6d for instance 2bfea754-0ea9-4952-9e7c-51a86d45edec on n-h1-851359-3 Aug 04 17:32:21.335946 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-13c91aba-6776-4ee9-bf07-55fe90cc51c1 req-7ea741b8-1af1-4abd-a38d-85ed710481d8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087649 Aug 04 17:32:21.337773 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3060/6148] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:32:21.348338 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6eedc618-14b1-4c10-8426-628063d028a0 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 2bfea754-0ea9-4952-9e7c-51a86d45edec] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:32:21.588878 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6eedc618-14b1-4c10-8426-628063d028a0 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "DELETE /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec" status: 204 len: 0 microversion: 2.1 time: 0.371127 Aug 04 17:32:21.589808 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3089/6149] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:32:21 2022] DELETE /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:32:21.638541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c42a803c-5cc5-457d-8294-d443ab91e6fd tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:21.639926 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c42a803c-5cc5-457d-8294-d443ab91e6fd tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 2bfea754-0ea9-4952-9e7c-51a86d45edec] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:21.651245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c42a803c-5cc5-457d-8294-d443ab91e6fd tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:21.652538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c42a803c-5cc5-457d-8294-d443ab91e6fd tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:21.653393 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c42a803c-5cc5-457d-8294-d443ab91e6fd tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:21.654741 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c42a803c-5cc5-457d-8294-d443ab91e6fd tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:21.655721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c42a803c-5cc5-457d-8294-d443ab91e6fd tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:21.656601 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c42a803c-5cc5-457d-8294-d443ab91e6fd tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:22.464193 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c42a803c-5cc5-457d-8294-d443ab91e6fd tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4943545f6aa41aeaac744c9f422c822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9741bb2238ae4e019cadaa2db07bc5e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:22.478454 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c42a803c-5cc5-457d-8294-d443ab91e6fd tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec" status: 200 len: 1766 microversion: 2.1 time: 0.872062 Aug 04 17:32:22.479603 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3061/6150] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:21 2022] GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec => generated 1766 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:23.503514 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5a990fd0-37dc-4f02-8b50-85e05b6111ff tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:23.505513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5a990fd0-37dc-4f02-8b50-85e05b6111ff tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 2bfea754-0ea9-4952-9e7c-51a86d45edec] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:23.517911 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5a990fd0-37dc-4f02-8b50-85e05b6111ff tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:23.518611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5a990fd0-37dc-4f02-8b50-85e05b6111ff tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:23.519215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5a990fd0-37dc-4f02-8b50-85e05b6111ff tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:23.520194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5a990fd0-37dc-4f02-8b50-85e05b6111ff tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:23.521089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5a990fd0-37dc-4f02-8b50-85e05b6111ff tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:23.524350 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5a990fd0-37dc-4f02-8b50-85e05b6111ff tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:23.858317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5a990fd0-37dc-4f02-8b50-85e05b6111ff tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4943545f6aa41aeaac744c9f422c822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9741bb2238ae4e019cadaa2db07bc5e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:23.874625 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5a990fd0-37dc-4f02-8b50-85e05b6111ff tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec" status: 200 len: 1648 microversion: 2.1 time: 0.376307 Aug 04 17:32:23.876580 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3090/6151] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:23 2022] GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec => generated 1648 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:24.304974 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-e7dc2bc7-4aee-4f5e-a7b7-235d267e3a27 req-a0431919-5026-4cee-9a66-f4fc12193d58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bfea754-0ea9-4952-9e7c-51a86d45edec", "name": "network-vif-deleted", "tag": "baad8965-c7ab-4db1-af92-3b3785555d6d"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:32:24.316337 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:32:24.318508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e7dc2bc7-4aee-4f5e-a7b7-235d267e3a27 req-a0431919-5026-4cee-9a66-f4fc12193d58 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:24.319161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e7dc2bc7-4aee-4f5e-a7b7-235d267e3a27 req-a0431919-5026-4cee-9a66-f4fc12193d58 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:24.319654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e7dc2bc7-4aee-4f5e-a7b7-235d267e3a27 req-a0431919-5026-4cee-9a66-f4fc12193d58 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:24.326149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:32:24.338380 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-e7dc2bc7-4aee-4f5e-a7b7-235d267e3a27 req-a0431919-5026-4cee-9a66-f4fc12193d58 service nova] Creating event network-vif-deleted:baad8965-c7ab-4db1-af92-3b3785555d6d for instance 2bfea754-0ea9-4952-9e7c-51a86d45edec on n-h1-851359-3 Aug 04 17:32:24.367324 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-e7dc2bc7-4aee-4f5e-a7b7-235d267e3a27 req-a0431919-5026-4cee-9a66-f4fc12193d58 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065344 Aug 04 17:32:24.370550 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3062/6152] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:32:24.901330 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-58cb66f9-ab64-4cf2-be76-566192caad5d tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:24.902222 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-58cb66f9-ab64-4cf2-be76-566192caad5d tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 2bfea754-0ea9-4952-9e7c-51a86d45edec] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:24.918332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-58cb66f9-ab64-4cf2-be76-566192caad5d tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:24.920073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-58cb66f9-ab64-4cf2-be76-566192caad5d tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:24.920550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-58cb66f9-ab64-4cf2-be76-566192caad5d tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:24.923053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-58cb66f9-ab64-4cf2-be76-566192caad5d tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:24.923820 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-58cb66f9-ab64-4cf2-be76-566192caad5d tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:24.924861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-58cb66f9-ab64-4cf2-be76-566192caad5d tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:25.022572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-58cb66f9-ab64-4cf2-be76-566192caad5d tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:25.023237 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-58cb66f9-ab64-4cf2-be76-566192caad5d tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:25.023876 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-58cb66f9-ab64-4cf2-be76-566192caad5d tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:25.024632 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-58cb66f9-ab64-4cf2-be76-566192caad5d tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lazy-loading 'fault' on Instance uuid 2bfea754-0ea9-4952-9e7c-51a86d45edec {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:32:25.092436 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-58cb66f9-ab64-4cf2-be76-566192caad5d tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4943545f6aa41aeaac744c9f422c822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9741bb2238ae4e019cadaa2db07bc5e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:32:25.111931 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-58cb66f9-ab64-4cf2-be76-566192caad5d tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec" status: 200 len: 1385 microversion: 2.1 time: 0.215998 Aug 04 17:32:25.113313 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3091/6153] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:24 2022] GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec => generated 1385 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:32:26.151299 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0d7eec2d-5aaf-4018-8243-9d0d95b1653c tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:26.152162 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0d7eec2d-5aaf-4018-8243-9d0d95b1653c tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] [instance: 2bfea754-0ea9-4952-9e7c-51a86d45edec] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:32:26.169620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d7eec2d-5aaf-4018-8243-9d0d95b1653c tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:26.170352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d7eec2d-5aaf-4018-8243-9d0d95b1653c tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:26.170794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d7eec2d-5aaf-4018-8243-9d0d95b1653c tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:26.171536 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d7eec2d-5aaf-4018-8243-9d0d95b1653c tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:32:26.172027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d7eec2d-5aaf-4018-8243-9d0d95b1653c tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:32:26.174477 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d7eec2d-5aaf-4018-8243-9d0d95b1653c tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:32:26.205696 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-0d7eec2d-5aaf-4018-8243-9d0d95b1653c tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] HTTP exception thrown: Instance 2bfea754-0ea9-4952-9e7c-51a86d45edec could not be found. Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0d7eec2d-5aaf-4018-8243-9d0d95b1653c tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Request method failure captured: Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec HTTP/1.1 Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AIuERaQMVDObEfj3oEv7bPwQzjaUHia9-E5OBF6-grxZB8U-VndGHnO-6pb-qnVnUpbMaE8TZgkb73Zne-izHNFccAhue9X2Pg8SZht99NTxd4GRSJfHEH3r3CjhgWpnCwrjJXXAz7Y7U186eHdSeNnDWFuGRev1g2E5826VqlubQM Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 9741bb2238ae4e019cadaa2db07bc5e6 Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1590022034 Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9741bb2238ae4e019cadaa2db07bc5e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9741bb2238ae4e019cadaa2db07bc5e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9741bb2238ae4e019cadaa2db07bc5e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9741bb2238ae4e019cadaa2db07bc5e6"}]}] Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1590022034 Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 9741bb2238ae4e019cadaa2db07bc5e6 Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1590022034 Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TestSecurityGroupsBasicOps-1590022034-project Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: f4943545f6aa41aeaac744c9f422c822 Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1590022034-project Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 2bfea754-0ea9-4952-9e7c-51a86d45edec could not be found. Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '2bfea754-0ea9-4952-9e7c-51a86d45edec'} Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bfea754-0ea9-4952-9e7c-51a86d45edec could not be found. Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bfea754-0ea9-4952-9e7c-51a86d45edec could not be found. Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:32:26.207697 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:32:26.210915 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:32:26.210915 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:32:26.210915 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:32:26.210915 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:32:26.210915 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:32:26.210915 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:32:26.210915 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bfea754-0ea9-4952-9e7c-51a86d45edec could not be found. Aug 04 17:32:26.210915 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:32:26.212642 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0d7eec2d-5aaf-4018-8243-9d0d95b1653c tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Returning 404 to user: Instance 2bfea754-0ea9-4952-9e7c-51a86d45edec could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:32:26.213710 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0d7eec2d-5aaf-4018-8243-9d0d95b1653c tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec" status: 404 len: 111 microversion: 2.1 time: 0.071136 Aug 04 17:32:26.214891 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3063/6154] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:32:26 2022] GET /compute/v2.1/servers/2bfea754-0ea9-4952-9e7c-51a86d45edec => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:32:32.431945 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-37ceb0b0-ed11-4674-a6a6-ee8f875a3938 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] Calling method '.version_select at 0x7f1e5b7434c0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:32:32.475513 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-37ceb0b0-ed11-4674-a6a6-ee8f875a3938 tempest-TestSecurityGroupsBasicOps-1590022034 tempest-TestSecurityGroupsBasicOps-1590022034-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1288627812" status: 202 len: 0 microversion: 2.1 time: 0.048041 Aug 04 17:32:32.476466 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3092/6155] 10.222.0.93 () {58 vars in 1278 bytes} [Thu Aug 4 17:32:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1288627812 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:33:13.510669 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-85399336-0185-454e-8668-43f6206508ee tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Action: 'create', calling method: .version_select at 0x7f1e5b4ea160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1136431003", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmNbtelI5vDs9RZtsGdeVxakPdSQzOSI+iOcF3MlXzxo5KIKKT18/aHWeV3kKvxpqPkAf96MCffXph4WKuEcfnfAMKyEGnYgj+09J8kCc24aMojbqQxONtdBibJd+BbbQ=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:33:13.530846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:33:13.538957 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:33:13.564742 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-85399336-0185-454e-8668-43f6206508ee tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Getting quotas for project 12b4e49789d84ae29c3278fcb2303508. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:33:13.590397 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-85399336-0185-454e-8668-43f6206508ee tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Getting quotas for user 55283f1fd1af42ef87ee70f1554b0f6e and project 12b4e49789d84ae29c3278fcb2303508. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:33:13.689073 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-85399336-0185-454e-8668-43f6206508ee tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.182804 Aug 04 17:33:13.690513 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3064/6156] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:33:13 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:33:15.993573 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:33:15.994523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:33:15.999962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d351bd08-6847-46f0-92fc-0a5daedca411 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1931672242", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "8a8c51cd-c9fa-4cdd-8e06-d5df6e1215e8"}], "key_name": "tempest-TestNetworkBasicOps-1136431003", "security_groups": [{"name": "tempest-secgroup-smoke-981895959"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:33:16.213872 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-d351bd08-6847-46f0-92fc-0a5daedca411 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] validate_networks() for [('8a8c51cd-c9fa-4cdd-8e06-d5df6e1215e8', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:33:17.094935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-d351bd08-6847-46f0-92fc-0a5daedca411 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:33:17.095553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-d351bd08-6847-46f0-92fc-0a5daedca411 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:33:17.096000 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-d351bd08-6847-46f0-92fc-0a5daedca411 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:33:17.096543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-d351bd08-6847-46f0-92fc-0a5daedca411 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:33:17.097583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-d351bd08-6847-46f0-92fc-0a5daedca411 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:33:17.113743 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d351bd08-6847-46f0-92fc-0a5daedca411 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:17.114701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d351bd08-6847-46f0-92fc-0a5daedca411 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:17.115510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d351bd08-6847-46f0-92fc-0a5daedca411 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:17.116683 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d351bd08-6847-46f0-92fc-0a5daedca411 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:17.117553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d351bd08-6847-46f0-92fc-0a5daedca411 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:17.118398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d351bd08-6847-46f0-92fc-0a5daedca411 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:17.145815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-d351bd08-6847-46f0-92fc-0a5daedca411 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Getting quotas for project 12b4e49789d84ae29c3278fcb2303508. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:33:17.155999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-d351bd08-6847-46f0-92fc-0a5daedca411 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Getting quotas for user 55283f1fd1af42ef87ee70f1554b0f6e and project 12b4e49789d84ae29c3278fcb2303508. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:33:17.180397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d351bd08-6847-46f0-92fc-0a5daedca411 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:33:17.187289 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d351bd08-6847-46f0-92fc-0a5daedca411 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 89300174-0a17-4f0f-bfd5-40d472ae38a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:33:17.315407 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d351bd08-6847-46f0-92fc-0a5daedca411 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.323725 Aug 04 17:33:17.316086 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3093/6157] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:33:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 1325 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:33:17.329656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-90e12e74-6944-42f2-a1a5-953d3e93987b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:17.330323 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-90e12e74-6944-42f2-a1a5-953d3e93987b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 89300174-0a17-4f0f-bfd5-40d472ae38a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:17.475031 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-90e12e74-6944-42f2-a1a5-953d3e93987b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:17.495431 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-90e12e74-6944-42f2-a1a5-953d3e93987b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7" status: 200 len: 1249 microversion: 2.1 time: 0.171664 Aug 04 17:33:17.509772 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3065/6158] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:17 2022] GET /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7 => generated 1249 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:33:18.520502 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9bcc690b-b07e-4c11-b7f6-e5d19260306b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:18.522466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9bcc690b-b07e-4c11-b7f6-e5d19260306b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 89300174-0a17-4f0f-bfd5-40d472ae38a7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:18.532392 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9bcc690b-b07e-4c11-b7f6-e5d19260306b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:18.533215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9bcc690b-b07e-4c11-b7f6-e5d19260306b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:18.533880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9bcc690b-b07e-4c11-b7f6-e5d19260306b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:18.534986 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9bcc690b-b07e-4c11-b7f6-e5d19260306b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:18.535670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9bcc690b-b07e-4c11-b7f6-e5d19260306b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:18.536321 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9bcc690b-b07e-4c11-b7f6-e5d19260306b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:18.664519 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9bcc690b-b07e-4c11-b7f6-e5d19260306b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:18.672805 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9bcc690b-b07e-4c11-b7f6-e5d19260306b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7" status: 200 len: 1301 microversion: 2.1 time: 0.159825 Aug 04 17:33:18.682650 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3094/6159] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:18 2022] GET /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7 => generated 1301 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:19.696464 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-be47e494-a83a-4f8a-a4d0-24bad0f74b08 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:19.698140 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-be47e494-a83a-4f8a-a4d0-24bad0f74b08 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 89300174-0a17-4f0f-bfd5-40d472ae38a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:19.710838 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be47e494-a83a-4f8a-a4d0-24bad0f74b08 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:19.711620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be47e494-a83a-4f8a-a4d0-24bad0f74b08 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:19.712471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be47e494-a83a-4f8a-a4d0-24bad0f74b08 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:19.713690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be47e494-a83a-4f8a-a4d0-24bad0f74b08 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:19.714406 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be47e494-a83a-4f8a-a4d0-24bad0f74b08 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:19.715164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be47e494-a83a-4f8a-a4d0-24bad0f74b08 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:19.827596 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-be47e494-a83a-4f8a-a4d0-24bad0f74b08 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:19.836039 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-be47e494-a83a-4f8a-a4d0-24bad0f74b08 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7" status: 200 len: 1307 microversion: 2.1 time: 0.143751 Aug 04 17:33:19.837336 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3066/6160] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:19 2022] GET /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7 => generated 1307 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:20.861613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cdbfe0ba-c215-4d41-b7df-d8653f7212fc tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:20.862919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cdbfe0ba-c215-4d41-b7df-d8653f7212fc tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 89300174-0a17-4f0f-bfd5-40d472ae38a7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:20.884978 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cdbfe0ba-c215-4d41-b7df-d8653f7212fc tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:20.890052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cdbfe0ba-c215-4d41-b7df-d8653f7212fc tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:20.890626 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cdbfe0ba-c215-4d41-b7df-d8653f7212fc tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:20.891491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cdbfe0ba-c215-4d41-b7df-d8653f7212fc tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:20.892878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cdbfe0ba-c215-4d41-b7df-d8653f7212fc tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:20.893920 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cdbfe0ba-c215-4d41-b7df-d8653f7212fc tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:21.291336 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cdbfe0ba-c215-4d41-b7df-d8653f7212fc tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:21.301341 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cdbfe0ba-c215-4d41-b7df-d8653f7212fc tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7" status: 200 len: 1374 microversion: 2.1 time: 0.447436 Aug 04 17:33:21.304223 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3095/6161] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:20 2022] GET /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7 => generated 1374 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:22.224643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-89bba4d6-0b55-4ab4-b130-a84911c9458e req-c0eced9e-5cb9-4676-8e01-eb16f68f78fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89300174-0a17-4f0f-bfd5-40d472ae38a7", "tag": "c9515d37-34f5-4d6c-9f03-e0097c227141"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:33:22.264439 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-89bba4d6-0b55-4ab4-b130-a84911c9458e req-c0eced9e-5cb9-4676-8e01-eb16f68f78fd service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:22.264936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-89bba4d6-0b55-4ab4-b130-a84911c9458e req-c0eced9e-5cb9-4676-8e01-eb16f68f78fd service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:22.265417 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-89bba4d6-0b55-4ab4-b130-a84911c9458e req-c0eced9e-5cb9-4676-8e01-eb16f68f78fd service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:22.281233 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-89bba4d6-0b55-4ab4-b130-a84911c9458e req-c0eced9e-5cb9-4676-8e01-eb16f68f78fd service nova] Creating event network-changed:c9515d37-34f5-4d6c-9f03-e0097c227141 for instance 89300174-0a17-4f0f-bfd5-40d472ae38a7 on n-h2-851359-3 Aug 04 17:33:22.293572 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-89bba4d6-0b55-4ab4-b130-a84911c9458e req-c0eced9e-5cb9-4676-8e01-eb16f68f78fd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.522499 Aug 04 17:33:22.300958 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3067/6162] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:33:22.326329 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-79fd46ea-3df9-4448-9933-49548be4315f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:22.327039 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-79fd46ea-3df9-4448-9933-49548be4315f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 89300174-0a17-4f0f-bfd5-40d472ae38a7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:22.344559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79fd46ea-3df9-4448-9933-49548be4315f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:22.348277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79fd46ea-3df9-4448-9933-49548be4315f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:22.350609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79fd46ea-3df9-4448-9933-49548be4315f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:22.354267 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79fd46ea-3df9-4448-9933-49548be4315f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:22.355834 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79fd46ea-3df9-4448-9933-49548be4315f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:22.358768 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79fd46ea-3df9-4448-9933-49548be4315f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:23.027162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-79fd46ea-3df9-4448-9933-49548be4315f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:23.048378 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-79fd46ea-3df9-4448-9933-49548be4315f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7" status: 200 len: 1374 microversion: 2.1 time: 0.727369 Aug 04 17:33:23.049304 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3096/6163] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:22 2022] GET /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7 => generated 1374 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:24.084832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-df9f3a17-831a-4b59-a1f6-4aecdbc9fb02 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:24.086780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-df9f3a17-831a-4b59-a1f6-4aecdbc9fb02 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 89300174-0a17-4f0f-bfd5-40d472ae38a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:24.098848 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df9f3a17-831a-4b59-a1f6-4aecdbc9fb02 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:24.103859 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df9f3a17-831a-4b59-a1f6-4aecdbc9fb02 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:24.104318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df9f3a17-831a-4b59-a1f6-4aecdbc9fb02 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:24.105058 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df9f3a17-831a-4b59-a1f6-4aecdbc9fb02 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:24.105694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df9f3a17-831a-4b59-a1f6-4aecdbc9fb02 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:24.106172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df9f3a17-831a-4b59-a1f6-4aecdbc9fb02 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:24.335485 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-df9f3a17-831a-4b59-a1f6-4aecdbc9fb02 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:24.346796 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-df9f3a17-831a-4b59-a1f6-4aecdbc9fb02 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7" status: 200 len: 1374 microversion: 2.1 time: 0.268257 Aug 04 17:33:24.347852 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3068/6164] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:24 2022] GET /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7 => generated 1374 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:25.370464 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7d5f8e90-5044-402a-99a2-0f9fdc62b3bd tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:25.371667 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7d5f8e90-5044-402a-99a2-0f9fdc62b3bd tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 89300174-0a17-4f0f-bfd5-40d472ae38a7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:25.379059 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d5f8e90-5044-402a-99a2-0f9fdc62b3bd tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:25.380765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d5f8e90-5044-402a-99a2-0f9fdc62b3bd tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:25.381609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d5f8e90-5044-402a-99a2-0f9fdc62b3bd tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:25.382649 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d5f8e90-5044-402a-99a2-0f9fdc62b3bd tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:25.383280 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d5f8e90-5044-402a-99a2-0f9fdc62b3bd tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:25.383869 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d5f8e90-5044-402a-99a2-0f9fdc62b3bd tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:25.681491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7d5f8e90-5044-402a-99a2-0f9fdc62b3bd tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:25.695463 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7d5f8e90-5044-402a-99a2-0f9fdc62b3bd tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7" status: 200 len: 1374 microversion: 2.1 time: 0.329043 Aug 04 17:33:25.700258 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3097/6165] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:25 2022] GET /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7 => generated 1374 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:26.738632 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9a31a5fa-558c-4095-af57-4886b09364f4 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:26.739828 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9a31a5fa-558c-4095-af57-4886b09364f4 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 89300174-0a17-4f0f-bfd5-40d472ae38a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:26.750060 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a31a5fa-558c-4095-af57-4886b09364f4 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:26.751587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a31a5fa-558c-4095-af57-4886b09364f4 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:26.754799 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a31a5fa-558c-4095-af57-4886b09364f4 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:26.757282 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a31a5fa-558c-4095-af57-4886b09364f4 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:26.758201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a31a5fa-558c-4095-af57-4886b09364f4 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:26.758201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a31a5fa-558c-4095-af57-4886b09364f4 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:27.045531 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9a31a5fa-558c-4095-af57-4886b09364f4 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:27.070072 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9a31a5fa-558c-4095-af57-4886b09364f4 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7" status: 200 len: 1374 microversion: 2.1 time: 0.336482 Aug 04 17:33:27.071261 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3069/6166] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:26 2022] GET /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7 => generated 1374 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:28.092619 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-02b87ec0-05d6-43e4-8d2e-fefef67ad8fc tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:28.092619 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-02b87ec0-05d6-43e4-8d2e-fefef67ad8fc tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 89300174-0a17-4f0f-bfd5-40d472ae38a7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:28.096592 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:33:28.097505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:33:28.103019 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02b87ec0-05d6-43e4-8d2e-fefef67ad8fc tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:28.103767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02b87ec0-05d6-43e4-8d2e-fefef67ad8fc tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:28.104418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02b87ec0-05d6-43e4-8d2e-fefef67ad8fc tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:28.105525 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02b87ec0-05d6-43e4-8d2e-fefef67ad8fc tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:28.106203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02b87ec0-05d6-43e4-8d2e-fefef67ad8fc tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:28.106857 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02b87ec0-05d6-43e4-8d2e-fefef67ad8fc tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:28.312452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-02b87ec0-05d6-43e4-8d2e-fefef67ad8fc tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:28.322675 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-02b87ec0-05d6-43e4-8d2e-fefef67ad8fc tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7" status: 200 len: 1374 microversion: 2.1 time: 0.235281 Aug 04 17:33:28.324776 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3098/6167] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:28 2022] GET /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7 => generated 1374 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:28.703561 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:33:28.709994 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-017f97c2-b050-4b67-b78d-eaa38a6d11b8 req-adc4026c-f0af-436f-b05f-b0033eafacfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89300174-0a17-4f0f-bfd5-40d472ae38a7", "name": "network-vif-plugged", "status": "completed", "tag": "c9515d37-34f5-4d6c-9f03-e0097c227141"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:33:28.742835 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-017f97c2-b050-4b67-b78d-eaa38a6d11b8 req-adc4026c-f0af-436f-b05f-b0033eafacfa service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:28.750925 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-017f97c2-b050-4b67-b78d-eaa38a6d11b8 req-adc4026c-f0af-436f-b05f-b0033eafacfa service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:28.751940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-017f97c2-b050-4b67-b78d-eaa38a6d11b8 req-adc4026c-f0af-436f-b05f-b0033eafacfa service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:28.784329 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-017f97c2-b050-4b67-b78d-eaa38a6d11b8 req-adc4026c-f0af-436f-b05f-b0033eafacfa service nova] Creating event network-vif-plugged:c9515d37-34f5-4d6c-9f03-e0097c227141 for instance 89300174-0a17-4f0f-bfd5-40d472ae38a7 on n-h2-851359-3 Aug 04 17:33:28.792906 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-017f97c2-b050-4b67-b78d-eaa38a6d11b8 req-adc4026c-f0af-436f-b05f-b0033eafacfa service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089931 Aug 04 17:33:28.798153 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3070/6168] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:33:29.347355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-27da42df-67d6-4dc9-b071-c39e74ebe457 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:29.347355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-27da42df-67d6-4dc9-b071-c39e74ebe457 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 89300174-0a17-4f0f-bfd5-40d472ae38a7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:29.358677 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-27da42df-67d6-4dc9-b071-c39e74ebe457 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:29.359547 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-27da42df-67d6-4dc9-b071-c39e74ebe457 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:29.360211 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-27da42df-67d6-4dc9-b071-c39e74ebe457 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:29.365752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-27da42df-67d6-4dc9-b071-c39e74ebe457 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:29.366304 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-27da42df-67d6-4dc9-b071-c39e74ebe457 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:29.368443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-27da42df-67d6-4dc9-b071-c39e74ebe457 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:29.692589 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-27da42df-67d6-4dc9-b071-c39e74ebe457 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:29.701871 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-27da42df-67d6-4dc9-b071-c39e74ebe457 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7" status: 200 len: 1374 microversion: 2.1 time: 0.360942 Aug 04 17:33:29.703386 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3099/6169] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:29 2022] GET /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7 => generated 1374 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:30.727130 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3a4b8320-ba52-433a-939e-95ceb432de25 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:30.728418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3a4b8320-ba52-433a-939e-95ceb432de25 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 89300174-0a17-4f0f-bfd5-40d472ae38a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:30.761866 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a4b8320-ba52-433a-939e-95ceb432de25 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:30.766378 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a4b8320-ba52-433a-939e-95ceb432de25 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:30.766996 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a4b8320-ba52-433a-939e-95ceb432de25 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:30.767907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a4b8320-ba52-433a-939e-95ceb432de25 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:30.768515 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a4b8320-ba52-433a-939e-95ceb432de25 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:30.769112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a4b8320-ba52-433a-939e-95ceb432de25 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:31.015064 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3a4b8320-ba52-433a-939e-95ceb432de25 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:31.034265 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3a4b8320-ba52-433a-939e-95ceb432de25 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7" status: 200 len: 1545 microversion: 2.1 time: 0.311692 Aug 04 17:33:31.035235 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3071/6170] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:30 2022] GET /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7 => generated 1545 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:31.055070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-29f5da01-20ea-4a87-a0f0-59a1b17c2594 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:31.055765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-29f5da01-20ea-4a87-a0f0-59a1b17c2594 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 89300174-0a17-4f0f-bfd5-40d472ae38a7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:31.068041 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29f5da01-20ea-4a87-a0f0-59a1b17c2594 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:31.068540 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29f5da01-20ea-4a87-a0f0-59a1b17c2594 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:31.068996 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29f5da01-20ea-4a87-a0f0-59a1b17c2594 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:31.071748 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29f5da01-20ea-4a87-a0f0-59a1b17c2594 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:31.074003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29f5da01-20ea-4a87-a0f0-59a1b17c2594 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:31.074469 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29f5da01-20ea-4a87-a0f0-59a1b17c2594 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:31.340436 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-29f5da01-20ea-4a87-a0f0-59a1b17c2594 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:31.350139 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-29f5da01-20ea-4a87-a0f0-59a1b17c2594 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7" status: 200 len: 1545 microversion: 2.1 time: 0.299073 Aug 04 17:33:31.350726 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3100/6171] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:31 2022] GET /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7 => generated 1545 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:31.453185 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-17d3fd2e-0c65-439c-9663-fc6fb9f4de7a tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1643278116", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "89b878d1-52f4-47ae-a97e-7f475bee9eaf"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:33:31.532740 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-17d3fd2e-0c65-439c-9663-fc6fb9f4de7a tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] validate_networks() for [('89b878d1-52f4-47ae-a97e-7f475bee9eaf', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:33:31.993701 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-17d3fd2e-0c65-439c-9663-fc6fb9f4de7a tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:33:31.995092 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-17d3fd2e-0c65-439c-9663-fc6fb9f4de7a tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:33:31.995927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-17d3fd2e-0c65-439c-9663-fc6fb9f4de7a tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:33:31.996498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-17d3fd2e-0c65-439c-9663-fc6fb9f4de7a tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:33:31.998190 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-17d3fd2e-0c65-439c-9663-fc6fb9f4de7a tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:33:32.015546 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17d3fd2e-0c65-439c-9663-fc6fb9f4de7a tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:32.016389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17d3fd2e-0c65-439c-9663-fc6fb9f4de7a tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:32.017159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17d3fd2e-0c65-439c-9663-fc6fb9f4de7a tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:32.018604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17d3fd2e-0c65-439c-9663-fc6fb9f4de7a tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:32.019242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17d3fd2e-0c65-439c-9663-fc6fb9f4de7a tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:32.019812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17d3fd2e-0c65-439c-9663-fc6fb9f4de7a tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:32.042429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-17d3fd2e-0c65-439c-9663-fc6fb9f4de7a tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Getting quotas for project e6b7c7510d304b3e8dc1bf2dfb083d33. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:33:32.058386 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-17d3fd2e-0c65-439c-9663-fc6fb9f4de7a tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Getting quotas for user ef55a4caa57648729122f9a7b8134096 and project e6b7c7510d304b3e8dc1bf2dfb083d33. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:33:32.076883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-17d3fd2e-0c65-439c-9663-fc6fb9f4de7a tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:33:32.079465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-17d3fd2e-0c65-439c-9663-fc6fb9f4de7a tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] [instance: bdbbad3a-841c-4857-97d1-7cdff578e5db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:33:32.135691 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-17d3fd2e-0c65-439c-9663-fc6fb9f4de7a tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.844224 Aug 04 17:33:32.138772 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3072/6172] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:33:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:33:32.150897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-456b83a3-2cd8-4264-beac-458e7c85d1f6 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:32.167484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-456b83a3-2cd8-4264-beac-458e7c85d1f6 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] [instance: bdbbad3a-841c-4857-97d1-7cdff578e5db] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:32.246207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-456b83a3-2cd8-4264-beac-458e7c85d1f6 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef55a4caa57648729122f9a7b8134096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b7c7510d304b3e8dc1bf2dfb083d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:32.275170 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-456b83a3-2cd8-4264-beac-458e7c85d1f6 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] 10.222.0.93 "GET /compute/v2.1/servers/bdbbad3a-841c-4857-97d1-7cdff578e5db" status: 200 len: 1214 microversion: 2.1 time: 0.126469 Aug 04 17:33:32.275817 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3101/6173] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:32 2022] GET /compute/v2.1/servers/bdbbad3a-841c-4857-97d1-7cdff578e5db => generated 1214 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:33.297344 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-debf8640-f6f9-496b-9b12-f0e5e40e6d2f tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:33.298135 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-debf8640-f6f9-496b-9b12-f0e5e40e6d2f tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] [instance: bdbbad3a-841c-4857-97d1-7cdff578e5db] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:33.304978 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-debf8640-f6f9-496b-9b12-f0e5e40e6d2f tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:33.305583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-debf8640-f6f9-496b-9b12-f0e5e40e6d2f tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:33.306149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-debf8640-f6f9-496b-9b12-f0e5e40e6d2f tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:33.306935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-debf8640-f6f9-496b-9b12-f0e5e40e6d2f tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:33.307470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-debf8640-f6f9-496b-9b12-f0e5e40e6d2f tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:33.308123 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-debf8640-f6f9-496b-9b12-f0e5e40e6d2f tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:33.381643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-debf8640-f6f9-496b-9b12-f0e5e40e6d2f tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef55a4caa57648729122f9a7b8134096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b7c7510d304b3e8dc1bf2dfb083d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:33.389896 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-debf8640-f6f9-496b-9b12-f0e5e40e6d2f tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] 10.222.0.93 "GET /compute/v2.1/servers/bdbbad3a-841c-4857-97d1-7cdff578e5db" status: 200 len: 1266 microversion: 2.1 time: 0.097996 Aug 04 17:33:33.403123 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3073/6174] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:33 2022] GET /compute/v2.1/servers/bdbbad3a-841c-4857-97d1-7cdff578e5db => generated 1266 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:34.193938 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-f4f7d010-8b57-4a93-96ae-cfc81c42b3e2 req-553f830b-4680-4449-b1fd-cb8c1d2e2b55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89300174-0a17-4f0f-bfd5-40d472ae38a7", "tag": "c9515d37-34f5-4d6c-9f03-e0097c227141"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:33:34.234866 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f4f7d010-8b57-4a93-96ae-cfc81c42b3e2 req-553f830b-4680-4449-b1fd-cb8c1d2e2b55 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:34.235446 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f4f7d010-8b57-4a93-96ae-cfc81c42b3e2 req-553f830b-4680-4449-b1fd-cb8c1d2e2b55 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:34.235905 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f4f7d010-8b57-4a93-96ae-cfc81c42b3e2 req-553f830b-4680-4449-b1fd-cb8c1d2e2b55 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:34.280495 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-f4f7d010-8b57-4a93-96ae-cfc81c42b3e2 req-553f830b-4680-4449-b1fd-cb8c1d2e2b55 service nova] Creating event network-changed:c9515d37-34f5-4d6c-9f03-e0097c227141 for instance 89300174-0a17-4f0f-bfd5-40d472ae38a7 on n-h2-851359-3 Aug 04 17:33:34.310516 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-f4f7d010-8b57-4a93-96ae-cfc81c42b3e2 req-553f830b-4680-4449-b1fd-cb8c1d2e2b55 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118259 Aug 04 17:33:34.311441 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3102/6175] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:33:34.413900 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d962edb3-7ea9-47a5-9423-05680050900f tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:34.415078 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d962edb3-7ea9-47a5-9423-05680050900f tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] [instance: bdbbad3a-841c-4857-97d1-7cdff578e5db] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:34.436613 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d962edb3-7ea9-47a5-9423-05680050900f tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:34.437520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d962edb3-7ea9-47a5-9423-05680050900f tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:34.438186 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d962edb3-7ea9-47a5-9423-05680050900f tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:34.449282 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d962edb3-7ea9-47a5-9423-05680050900f tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:34.450427 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d962edb3-7ea9-47a5-9423-05680050900f tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:34.451219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d962edb3-7ea9-47a5-9423-05680050900f tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:34.616071 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d962edb3-7ea9-47a5-9423-05680050900f tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef55a4caa57648729122f9a7b8134096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b7c7510d304b3e8dc1bf2dfb083d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:34.625603 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d962edb3-7ea9-47a5-9423-05680050900f tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] 10.222.0.93 "GET /compute/v2.1/servers/bdbbad3a-841c-4857-97d1-7cdff578e5db" status: 200 len: 1272 microversion: 2.1 time: 0.216027 Aug 04 17:33:34.626953 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3074/6176] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:34 2022] GET /compute/v2.1/servers/bdbbad3a-841c-4857-97d1-7cdff578e5db => generated 1272 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:35.651937 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ac58f926-79d7-40e6-a74a-5181c65c2331 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:35.654351 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ac58f926-79d7-40e6-a74a-5181c65c2331 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] [instance: bdbbad3a-841c-4857-97d1-7cdff578e5db] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:35.689741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac58f926-79d7-40e6-a74a-5181c65c2331 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:35.690504 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac58f926-79d7-40e6-a74a-5181c65c2331 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:35.691105 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac58f926-79d7-40e6-a74a-5181c65c2331 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:35.692365 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac58f926-79d7-40e6-a74a-5181c65c2331 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:35.694019 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac58f926-79d7-40e6-a74a-5181c65c2331 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:35.695040 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac58f926-79d7-40e6-a74a-5181c65c2331 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:35.953385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ac58f926-79d7-40e6-a74a-5181c65c2331 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef55a4caa57648729122f9a7b8134096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b7c7510d304b3e8dc1bf2dfb083d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:35.962649 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ac58f926-79d7-40e6-a74a-5181c65c2331 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] 10.222.0.93 "GET /compute/v2.1/servers/bdbbad3a-841c-4857-97d1-7cdff578e5db" status: 200 len: 1314 microversion: 2.1 time: 0.319241 Aug 04 17:33:35.969755 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3103/6177] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:35 2022] GET /compute/v2.1/servers/bdbbad3a-841c-4857-97d1-7cdff578e5db => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:36.263735 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-dd5d62fc-8a1a-43f7-a08e-179674919b13 req-b00dc5be-3f92-40ee-97f2-86e979235bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdbbad3a-841c-4857-97d1-7cdff578e5db", "tag": "28a2776d-009e-4775-8b79-811f1decd95a"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:33:36.273804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-dd5d62fc-8a1a-43f7-a08e-179674919b13 req-b00dc5be-3f92-40ee-97f2-86e979235bd9 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:36.274831 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-dd5d62fc-8a1a-43f7-a08e-179674919b13 req-b00dc5be-3f92-40ee-97f2-86e979235bd9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:36.275368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-dd5d62fc-8a1a-43f7-a08e-179674919b13 req-b00dc5be-3f92-40ee-97f2-86e979235bd9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:36.300267 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-dd5d62fc-8a1a-43f7-a08e-179674919b13 req-b00dc5be-3f92-40ee-97f2-86e979235bd9 service nova] Creating event network-changed:28a2776d-009e-4775-8b79-811f1decd95a for instance bdbbad3a-841c-4857-97d1-7cdff578e5db on n-h1-851359-3 Aug 04 17:33:36.306704 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-dd5d62fc-8a1a-43f7-a08e-179674919b13 req-b00dc5be-3f92-40ee-97f2-86e979235bd9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046288 Aug 04 17:33:36.307608 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3075/6178] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:33:36.982688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f1f23e67-1d83-4c11-a6f5-402df40b8972 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:36.984127 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f1f23e67-1d83-4c11-a6f5-402df40b8972 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] [instance: bdbbad3a-841c-4857-97d1-7cdff578e5db] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:36.997790 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1f23e67-1d83-4c11-a6f5-402df40b8972 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:36.998394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1f23e67-1d83-4c11-a6f5-402df40b8972 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:36.999069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1f23e67-1d83-4c11-a6f5-402df40b8972 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:37.000025 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1f23e67-1d83-4c11-a6f5-402df40b8972 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:37.000689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1f23e67-1d83-4c11-a6f5-402df40b8972 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:37.001120 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1f23e67-1d83-4c11-a6f5-402df40b8972 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:37.155396 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f1f23e67-1d83-4c11-a6f5-402df40b8972 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef55a4caa57648729122f9a7b8134096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b7c7510d304b3e8dc1bf2dfb083d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:37.163555 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f1f23e67-1d83-4c11-a6f5-402df40b8972 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] 10.222.0.93 "GET /compute/v2.1/servers/bdbbad3a-841c-4857-97d1-7cdff578e5db" status: 200 len: 1314 microversion: 2.1 time: 0.184648 Aug 04 17:33:37.164455 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3104/6179] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:36 2022] GET /compute/v2.1/servers/bdbbad3a-841c-4857-97d1-7cdff578e5db => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:38.189146 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ec2d13c2-f7e1-4af0-bff1-490e832bad77 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:38.189992 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ec2d13c2-f7e1-4af0-bff1-490e832bad77 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] [instance: bdbbad3a-841c-4857-97d1-7cdff578e5db] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:38.196691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec2d13c2-f7e1-4af0-bff1-490e832bad77 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:38.197140 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec2d13c2-f7e1-4af0-bff1-490e832bad77 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:38.197638 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec2d13c2-f7e1-4af0-bff1-490e832bad77 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:38.198948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec2d13c2-f7e1-4af0-bff1-490e832bad77 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:38.199426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec2d13c2-f7e1-4af0-bff1-490e832bad77 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:38.199876 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec2d13c2-f7e1-4af0-bff1-490e832bad77 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:38.370870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ec2d13c2-f7e1-4af0-bff1-490e832bad77 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef55a4caa57648729122f9a7b8134096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b7c7510d304b3e8dc1bf2dfb083d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:38.379835 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ec2d13c2-f7e1-4af0-bff1-490e832bad77 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] 10.222.0.93 "GET /compute/v2.1/servers/bdbbad3a-841c-4857-97d1-7cdff578e5db" status: 200 len: 1314 microversion: 2.1 time: 0.196076 Aug 04 17:33:38.380641 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3076/6180] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:38 2022] GET /compute/v2.1/servers/bdbbad3a-841c-4857-97d1-7cdff578e5db => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:39.403057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-42fa0c39-3ee5-43c3-bb1f-04c5b5435383 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:39.404961 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-42fa0c39-3ee5-43c3-bb1f-04c5b5435383 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] [instance: bdbbad3a-841c-4857-97d1-7cdff578e5db] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:39.414236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42fa0c39-3ee5-43c3-bb1f-04c5b5435383 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:39.415236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42fa0c39-3ee5-43c3-bb1f-04c5b5435383 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:39.415832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42fa0c39-3ee5-43c3-bb1f-04c5b5435383 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:39.416709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42fa0c39-3ee5-43c3-bb1f-04c5b5435383 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:39.417319 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42fa0c39-3ee5-43c3-bb1f-04c5b5435383 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:39.417898 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42fa0c39-3ee5-43c3-bb1f-04c5b5435383 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:39.569753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-42fa0c39-3ee5-43c3-bb1f-04c5b5435383 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef55a4caa57648729122f9a7b8134096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b7c7510d304b3e8dc1bf2dfb083d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:39.581727 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-42fa0c39-3ee5-43c3-bb1f-04c5b5435383 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] 10.222.0.93 "GET /compute/v2.1/servers/bdbbad3a-841c-4857-97d1-7cdff578e5db" status: 200 len: 1314 microversion: 2.1 time: 0.184403 Aug 04 17:33:39.582937 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3105/6181] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:39 2022] GET /compute/v2.1/servers/bdbbad3a-841c-4857-97d1-7cdff578e5db => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:40.603132 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-82066ff0-61d9-4273-a705-528876051baa tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:40.603754 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-82066ff0-61d9-4273-a705-528876051baa tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] [instance: bdbbad3a-841c-4857-97d1-7cdff578e5db] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:40.617886 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82066ff0-61d9-4273-a705-528876051baa tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:40.618816 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82066ff0-61d9-4273-a705-528876051baa tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:40.619490 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82066ff0-61d9-4273-a705-528876051baa tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:40.620537 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82066ff0-61d9-4273-a705-528876051baa tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:40.621372 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82066ff0-61d9-4273-a705-528876051baa tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:40.626278 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82066ff0-61d9-4273-a705-528876051baa tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:40.837012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-56cdc442-99db-456d-8e40-2db736dc94e9 req-1c2e1acc-9d78-4840-bbf6-040c4b93b57e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdbbad3a-841c-4857-97d1-7cdff578e5db", "name": "network-vif-plugged", "status": "completed", "tag": "28a2776d-009e-4775-8b79-811f1decd95a"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:33:40.854184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-82066ff0-61d9-4273-a705-528876051baa tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef55a4caa57648729122f9a7b8134096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b7c7510d304b3e8dc1bf2dfb083d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:40.857856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-56cdc442-99db-456d-8e40-2db736dc94e9 req-1c2e1acc-9d78-4840-bbf6-040c4b93b57e service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:40.859140 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-56cdc442-99db-456d-8e40-2db736dc94e9 req-1c2e1acc-9d78-4840-bbf6-040c4b93b57e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:40.859632 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-56cdc442-99db-456d-8e40-2db736dc94e9 req-1c2e1acc-9d78-4840-bbf6-040c4b93b57e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:40.869560 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-82066ff0-61d9-4273-a705-528876051baa tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] 10.222.0.93 "GET /compute/v2.1/servers/bdbbad3a-841c-4857-97d1-7cdff578e5db" status: 200 len: 1314 microversion: 2.1 time: 0.269695 Aug 04 17:33:40.871004 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3077/6182] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:40 2022] GET /compute/v2.1/servers/bdbbad3a-841c-4857-97d1-7cdff578e5db => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:40.876652 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-56cdc442-99db-456d-8e40-2db736dc94e9 req-1c2e1acc-9d78-4840-bbf6-040c4b93b57e service nova] Creating event network-vif-plugged:28a2776d-009e-4775-8b79-811f1decd95a for instance bdbbad3a-841c-4857-97d1-7cdff578e5db on n-h1-851359-3 Aug 04 17:33:40.883391 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-56cdc442-99db-456d-8e40-2db736dc94e9 req-1c2e1acc-9d78-4840-bbf6-040c4b93b57e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050215 Aug 04 17:33:40.884310 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3106/6183] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:33:41.898041 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8a02b530-6702-4d04-8575-a7641e98a700 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:41.898828 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8a02b530-6702-4d04-8575-a7641e98a700 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] [instance: bdbbad3a-841c-4857-97d1-7cdff578e5db] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:41.905784 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a02b530-6702-4d04-8575-a7641e98a700 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:41.906674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a02b530-6702-4d04-8575-a7641e98a700 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:41.907276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a02b530-6702-4d04-8575-a7641e98a700 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:41.908188 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a02b530-6702-4d04-8575-a7641e98a700 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:41.908813 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a02b530-6702-4d04-8575-a7641e98a700 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:41.909407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a02b530-6702-4d04-8575-a7641e98a700 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:42.029425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:33:42.071891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:33:42.117264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8a02b530-6702-4d04-8575-a7641e98a700 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef55a4caa57648729122f9a7b8134096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b7c7510d304b3e8dc1bf2dfb083d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:42.133378 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8a02b530-6702-4d04-8575-a7641e98a700 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] 10.222.0.93 "GET /compute/v2.1/servers/bdbbad3a-841c-4857-97d1-7cdff578e5db" status: 200 len: 1314 microversion: 2.1 time: 0.234745 Aug 04 17:33:42.133967 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3078/6184] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:41 2022] GET /compute/v2.1/servers/bdbbad3a-841c-4857-97d1-7cdff578e5db => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:43.162094 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b0e8b098-a1a6-4447-954e-c7507962b03e tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:43.164186 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b0e8b098-a1a6-4447-954e-c7507962b03e tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] [instance: bdbbad3a-841c-4857-97d1-7cdff578e5db] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:43.188066 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:33:43.191830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0e8b098-a1a6-4447-954e-c7507962b03e tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:43.192615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0e8b098-a1a6-4447-954e-c7507962b03e tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:43.193074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0e8b098-a1a6-4447-954e-c7507962b03e tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:43.193858 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0e8b098-a1a6-4447-954e-c7507962b03e tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:43.194389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0e8b098-a1a6-4447-954e-c7507962b03e tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:43.195131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0e8b098-a1a6-4447-954e-c7507962b03e tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:43.372051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b0e8b098-a1a6-4447-954e-c7507962b03e tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef55a4caa57648729122f9a7b8134096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b7c7510d304b3e8dc1bf2dfb083d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:43.380796 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b0e8b098-a1a6-4447-954e-c7507962b03e tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] 10.222.0.93 "GET /compute/v2.1/servers/bdbbad3a-841c-4857-97d1-7cdff578e5db" status: 200 len: 1497 microversion: 2.1 time: 0.225301 Aug 04 17:33:43.381767 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3107/6185] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:43 2022] GET /compute/v2.1/servers/bdbbad3a-841c-4857-97d1-7cdff578e5db => generated 1497 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:45.963423 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5a6641cd-ac00-4860-9398-594c251c1648 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:45.963898 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5a6641cd-ac00-4860-9398-594c251c1648 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] [instance: bdbbad3a-841c-4857-97d1-7cdff578e5db] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:45.968345 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:33:45.972850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a6641cd-ac00-4860-9398-594c251c1648 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:45.973208 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a6641cd-ac00-4860-9398-594c251c1648 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:45.973649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a6641cd-ac00-4860-9398-594c251c1648 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:45.974436 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a6641cd-ac00-4860-9398-594c251c1648 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:45.975202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a6641cd-ac00-4860-9398-594c251c1648 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:45.975292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a6641cd-ac00-4860-9398-594c251c1648 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:45.978882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=63 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:33:46.012327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5a6641cd-ac00-4860-9398-594c251c1648 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] [instance: bdbbad3a-841c-4857-97d1-7cdff578e5db] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:33:46.111970 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5a6641cd-ac00-4860-9398-594c251c1648 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] 10.222.0.93 "DELETE /compute/v2.1/servers/bdbbad3a-841c-4857-97d1-7cdff578e5db" status: 204 len: 0 microversion: 2.1 time: 0.152164 Aug 04 17:33:46.112576 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3079/6186] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:33:45 2022] DELETE /compute/v2.1/servers/bdbbad3a-841c-4857-97d1-7cdff578e5db => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:33:46.121360 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c9a2e312-d6aa-4a3a-b785-1ad4b727e8b1 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:46.122742 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c9a2e312-d6aa-4a3a-b785-1ad4b727e8b1 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] [instance: bdbbad3a-841c-4857-97d1-7cdff578e5db] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:46.126174 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:33:46.133100 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9a2e312-d6aa-4a3a-b785-1ad4b727e8b1 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:46.133628 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9a2e312-d6aa-4a3a-b785-1ad4b727e8b1 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:46.134307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9a2e312-d6aa-4a3a-b785-1ad4b727e8b1 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:46.135404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9a2e312-d6aa-4a3a-b785-1ad4b727e8b1 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:46.136399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9a2e312-d6aa-4a3a-b785-1ad4b727e8b1 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:46.137124 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9a2e312-d6aa-4a3a-b785-1ad4b727e8b1 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:46.142993 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=73 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:33:46.322515 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c9a2e312-d6aa-4a3a-b785-1ad4b727e8b1 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef55a4caa57648729122f9a7b8134096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b7c7510d304b3e8dc1bf2dfb083d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:46.331713 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c9a2e312-d6aa-4a3a-b785-1ad4b727e8b1 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] 10.222.0.93 "GET /compute/v2.1/servers/bdbbad3a-841c-4857-97d1-7cdff578e5db" status: 200 len: 1503 microversion: 2.1 time: 0.214280 Aug 04 17:33:46.332301 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3108/6187] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:46 2022] GET /compute/v2.1/servers/bdbbad3a-841c-4857-97d1-7cdff578e5db => generated 1503 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:47.354394 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-70bd10e1-d806-4e3b-a20c-6c484300e638 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:47.357118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-70bd10e1-d806-4e3b-a20c-6c484300e638 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] [instance: bdbbad3a-841c-4857-97d1-7cdff578e5db] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:47.365462 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70bd10e1-d806-4e3b-a20c-6c484300e638 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:47.366122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70bd10e1-d806-4e3b-a20c-6c484300e638 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:47.366989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70bd10e1-d806-4e3b-a20c-6c484300e638 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:47.367940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70bd10e1-d806-4e3b-a20c-6c484300e638 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:47.368511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70bd10e1-d806-4e3b-a20c-6c484300e638 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:47.369214 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70bd10e1-d806-4e3b-a20c-6c484300e638 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:47.528526 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-70bd10e1-d806-4e3b-a20c-6c484300e638 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef55a4caa57648729122f9a7b8134096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b7c7510d304b3e8dc1bf2dfb083d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:47.538597 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-70bd10e1-d806-4e3b-a20c-6c484300e638 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] 10.222.0.93 "GET /compute/v2.1/servers/bdbbad3a-841c-4857-97d1-7cdff578e5db" status: 200 len: 1503 microversion: 2.1 time: 0.189226 Aug 04 17:33:47.539596 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3080/6188] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:47 2022] GET /compute/v2.1/servers/bdbbad3a-841c-4857-97d1-7cdff578e5db => generated 1503 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:48.573499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-8e67b064-f2a5-4405-b257-14d4acb1d385 req-8ac1fd03-031c-4482-8318-43ba9f462fcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdbbad3a-841c-4857-97d1-7cdff578e5db", "name": "network-vif-deleted", "tag": "28a2776d-009e-4775-8b79-811f1decd95a"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:33:48.584451 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4418ff71-922e-4fb5-b088-8cb5dd674621 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:48.587723 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4418ff71-922e-4fb5-b088-8cb5dd674621 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] [instance: bdbbad3a-841c-4857-97d1-7cdff578e5db] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:48.615673 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4418ff71-922e-4fb5-b088-8cb5dd674621 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:48.619316 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4418ff71-922e-4fb5-b088-8cb5dd674621 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:48.620318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4418ff71-922e-4fb5-b088-8cb5dd674621 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:48.621506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4418ff71-922e-4fb5-b088-8cb5dd674621 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:48.624434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4418ff71-922e-4fb5-b088-8cb5dd674621 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:48.624882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4418ff71-922e-4fb5-b088-8cb5dd674621 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:48.627621 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8e67b064-f2a5-4405-b257-14d4acb1d385 req-8ac1fd03-031c-4482-8318-43ba9f462fcb service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:48.628435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8e67b064-f2a5-4405-b257-14d4acb1d385 req-8ac1fd03-031c-4482-8318-43ba9f462fcb service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:48.629306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8e67b064-f2a5-4405-b257-14d4acb1d385 req-8ac1fd03-031c-4482-8318-43ba9f462fcb service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:48.657459 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-8e67b064-f2a5-4405-b257-14d4acb1d385 req-8ac1fd03-031c-4482-8318-43ba9f462fcb service nova] Creating event network-vif-deleted:28a2776d-009e-4775-8b79-811f1decd95a for instance bdbbad3a-841c-4857-97d1-7cdff578e5db on n-h1-851359-3 Aug 04 17:33:48.665299 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-8e67b064-f2a5-4405-b257-14d4acb1d385 req-8ac1fd03-031c-4482-8318-43ba9f462fcb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113614 Aug 04 17:33:48.666731 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3109/6189] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:33:48.741351 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4418ff71-922e-4fb5-b088-8cb5dd674621 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef55a4caa57648729122f9a7b8134096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6b7c7510d304b3e8dc1bf2dfb083d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:33:48.757042 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4418ff71-922e-4fb5-b088-8cb5dd674621 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] 10.222.0.93 "GET /compute/v2.1/servers/bdbbad3a-841c-4857-97d1-7cdff578e5db" status: 200 len: 1299 microversion: 2.1 time: 0.199487 Aug 04 17:33:48.759287 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3081/6190] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:48 2022] GET /compute/v2.1/servers/bdbbad3a-841c-4857-97d1-7cdff578e5db => generated 1299 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:33:49.783073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-84390590-15a4-447e-8644-8fa075e97fd7 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:33:49.784971 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-84390590-15a4-447e-8644-8fa075e97fd7 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] [instance: bdbbad3a-841c-4857-97d1-7cdff578e5db] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:33:49.791588 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84390590-15a4-447e-8644-8fa075e97fd7 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:49.792090 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84390590-15a4-447e-8644-8fa075e97fd7 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:49.792541 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84390590-15a4-447e-8644-8fa075e97fd7 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:49.793260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84390590-15a4-447e-8644-8fa075e97fd7 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:33:49.793724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84390590-15a4-447e-8644-8fa075e97fd7 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:33:49.794379 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84390590-15a4-447e-8644-8fa075e97fd7 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:33:49.808395 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-84390590-15a4-447e-8644-8fa075e97fd7 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] HTTP exception thrown: Instance bdbbad3a-841c-4857-97d1-7cdff578e5db could not be found. Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-84390590-15a4-447e-8644-8fa075e97fd7 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Request method failure captured: Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/bdbbad3a-841c-4857-97d1-7cdff578e5db HTTP/1.1 Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7ALpUkh-xZEvhNZBrhvkdgShJR5palk7VOB7JnVWHYIQjUg-3oudMkGjWWBV01eLp9t9_BHDHVPON_uLZMIkXy3QLf_YrW4Xp-mCusUiB3VbM6ROQG3oV0Q8zW-gZxsXOiQrWM_aq8X8ClNQDgwUhg4kJP_OXZN071JAx06s3uLCQ84 Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: e6b7c7510d304b3e8dc1bf2dfb083d33 Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-VolumesActionsTest-366254104 Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e6b7c7510d304b3e8dc1bf2dfb083d33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e6b7c7510d304b3e8dc1bf2dfb083d33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e6b7c7510d304b3e8dc1bf2dfb083d33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e6b7c7510d304b3e8dc1bf2dfb083d33"}]}] Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-VolumesActionsTest-366254104 Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: e6b7c7510d304b3e8dc1bf2dfb083d33 Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-VolumesActionsTest-366254104 Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-VolumesActionsTest-366254104-project Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: ef55a4caa57648729122f9a7b8134096 Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-VolumesActionsTest-366254104-project Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance bdbbad3a-841c-4857-97d1-7cdff578e5db could not be found. Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'bdbbad3a-841c-4857-97d1-7cdff578e5db'} Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdbbad3a-841c-4857-97d1-7cdff578e5db could not be found. Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdbbad3a-841c-4857-97d1-7cdff578e5db could not be found. Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:33:49.810634 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:33:49.817581 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:33:49.817581 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:33:49.817581 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:33:49.817581 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:33:49.817581 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:33:49.817581 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdbbad3a-841c-4857-97d1-7cdff578e5db could not be found. Aug 04 17:33:49.817581 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:33:49.817581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-84390590-15a4-447e-8644-8fa075e97fd7 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] Returning 404 to user: Instance bdbbad3a-841c-4857-97d1-7cdff578e5db could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:33:49.817581 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-84390590-15a4-447e-8644-8fa075e97fd7 tempest-VolumesActionsTest-366254104 tempest-VolumesActionsTest-366254104-project] 10.222.0.93 "GET /compute/v2.1/servers/bdbbad3a-841c-4857-97d1-7cdff578e5db" status: 404 len: 111 microversion: 2.1 time: 0.037459 Aug 04 17:33:49.817581 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3110/6191] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:33:49 2022] GET /compute/v2.1/servers/bdbbad3a-841c-4857-97d1-7cdff578e5db => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:34:06.682516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-86fde1f2-2dce-40a8-8d2c-72a638c71e33 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:34:06.684886 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-86fde1f2-2dce-40a8-8d2c-72a638c71e33 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 89300174-0a17-4f0f-bfd5-40d472ae38a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:34:06.692106 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:34:06.692106 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:34:06.692860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86fde1f2-2dce-40a8-8d2c-72a638c71e33 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:06.693565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86fde1f2-2dce-40a8-8d2c-72a638c71e33 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:06.693993 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86fde1f2-2dce-40a8-8d2c-72a638c71e33 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:06.694927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86fde1f2-2dce-40a8-8d2c-72a638c71e33 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:06.695438 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86fde1f2-2dce-40a8-8d2c-72a638c71e33 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:06.695852 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86fde1f2-2dce-40a8-8d2c-72a638c71e33 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:06.815815 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-86fde1f2-2dce-40a8-8d2c-72a638c71e33 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "POST /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7/action" status: 200 len: 24568 microversion: 2.1 time: 0.137473 Aug 04 17:34:06.817147 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3082/6192] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:34:06 2022] POST /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7/action => generated 24568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:34:09.873388 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4be5ac49-9980-4d66-ac9b-dbfe9149444c tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-942626968", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:34:09.894657 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=5 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:34:09.906519 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=9 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:34:09.955633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-4be5ac49-9980-4d66-ac9b-dbfe9149444c tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] validate_networks() for None {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:34:10.301830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-4be5ac49-9980-4d66-ac9b-dbfe9149444c tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:34:10.302486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-4be5ac49-9980-4d66-ac9b-dbfe9149444c tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:34:10.302940 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-4be5ac49-9980-4d66-ac9b-dbfe9149444c tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:34:10.303545 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-4be5ac49-9980-4d66-ac9b-dbfe9149444c tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:34:10.304457 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-4be5ac49-9980-4d66-ac9b-dbfe9149444c tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:34:10.316745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4be5ac49-9980-4d66-ac9b-dbfe9149444c tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:10.317262 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4be5ac49-9980-4d66-ac9b-dbfe9149444c tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:10.317716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4be5ac49-9980-4d66-ac9b-dbfe9149444c tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:10.318501 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4be5ac49-9980-4d66-ac9b-dbfe9149444c tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:10.318977 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4be5ac49-9980-4d66-ac9b-dbfe9149444c tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:10.319581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4be5ac49-9980-4d66-ac9b-dbfe9149444c tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:10.352817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-4be5ac49-9980-4d66-ac9b-dbfe9149444c tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Getting quotas for project 0374197b78be4d8daf63e8b0dfc4e227. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:34:10.366008 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-4be5ac49-9980-4d66-ac9b-dbfe9149444c tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Getting quotas for user 0ffc50d4aa8047a1a1a18dd97c395431 and project 0374197b78be4d8daf63e8b0dfc4e227. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:34:10.383464 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4be5ac49-9980-4d66-ac9b-dbfe9149444c tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:34:10.386009 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4be5ac49-9980-4d66-ac9b-dbfe9149444c tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] [instance: b49bddcd-130e-4ef2-b627-4d5c84740e36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:34:10.435737 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4be5ac49-9980-4d66-ac9b-dbfe9149444c tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.568130 Aug 04 17:34:10.436744 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3111/6193] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:34:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:34:10.450602 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-02703f9a-5514-4e96-97e1-a3a1ec6b3ad2 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:34:10.451891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-02703f9a-5514-4e96-97e1-a3a1ec6b3ad2 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] [instance: b49bddcd-130e-4ef2-b627-4d5c84740e36] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:34:10.526361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-02703f9a-5514-4e96-97e1-a3a1ec6b3ad2 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffc50d4aa8047a1a1a18dd97c395431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0374197b78be4d8daf63e8b0dfc4e227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:34:10.535248 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-02703f9a-5514-4e96-97e1-a3a1ec6b3ad2 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] 10.222.0.93 "GET /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36" status: 200 len: 1213 microversion: 2.1 time: 0.090163 Aug 04 17:34:10.535921 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3083/6194] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:34:10 2022] GET /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:34:11.557785 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f1981d39-b8af-4802-aa08-e763fdccd0af tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:34:11.560422 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f1981d39-b8af-4802-aa08-e763fdccd0af tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] [instance: b49bddcd-130e-4ef2-b627-4d5c84740e36] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:34:11.577511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1981d39-b8af-4802-aa08-e763fdccd0af tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:11.578243 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1981d39-b8af-4802-aa08-e763fdccd0af tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:11.578841 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1981d39-b8af-4802-aa08-e763fdccd0af tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:11.579728 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1981d39-b8af-4802-aa08-e763fdccd0af tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:11.583118 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1981d39-b8af-4802-aa08-e763fdccd0af tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:11.584720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1981d39-b8af-4802-aa08-e763fdccd0af tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:11.828766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f1981d39-b8af-4802-aa08-e763fdccd0af tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffc50d4aa8047a1a1a18dd97c395431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0374197b78be4d8daf63e8b0dfc4e227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:34:11.840012 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f1981d39-b8af-4802-aa08-e763fdccd0af tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] 10.222.0.93 "GET /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36" status: 200 len: 1265 microversion: 2.1 time: 0.286991 Aug 04 17:34:11.843021 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3112/6195] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:34:11 2022] GET /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36 => generated 1265 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:34:12.865687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-21de5af5-5edd-46ea-b29a-400f4e9f36d0 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:34:12.866371 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-21de5af5-5edd-46ea-b29a-400f4e9f36d0 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] [instance: b49bddcd-130e-4ef2-b627-4d5c84740e36] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:34:12.873592 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21de5af5-5edd-46ea-b29a-400f4e9f36d0 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:12.874124 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21de5af5-5edd-46ea-b29a-400f4e9f36d0 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:12.874577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21de5af5-5edd-46ea-b29a-400f4e9f36d0 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:12.875298 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21de5af5-5edd-46ea-b29a-400f4e9f36d0 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:12.875947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21de5af5-5edd-46ea-b29a-400f4e9f36d0 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:12.876387 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21de5af5-5edd-46ea-b29a-400f4e9f36d0 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:12.957651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-21de5af5-5edd-46ea-b29a-400f4e9f36d0 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffc50d4aa8047a1a1a18dd97c395431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0374197b78be4d8daf63e8b0dfc4e227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:34:12.968361 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-21de5af5-5edd-46ea-b29a-400f4e9f36d0 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] 10.222.0.93 "GET /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36" status: 200 len: 1271 microversion: 2.1 time: 0.106679 Aug 04 17:34:12.968971 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3084/6196] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:34:12 2022] GET /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36 => generated 1271 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:34:13.993002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-201d425d-8aca-4214-ac87-ed72fc2d66ef tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:34:13.994509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-201d425d-8aca-4214-ac87-ed72fc2d66ef tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] [instance: b49bddcd-130e-4ef2-b627-4d5c84740e36] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:34:14.002719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-201d425d-8aca-4214-ac87-ed72fc2d66ef tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:14.003567 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-201d425d-8aca-4214-ac87-ed72fc2d66ef tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:14.004128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-201d425d-8aca-4214-ac87-ed72fc2d66ef tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:14.005166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-201d425d-8aca-4214-ac87-ed72fc2d66ef tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:14.006274 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-201d425d-8aca-4214-ac87-ed72fc2d66ef tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:14.007079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-201d425d-8aca-4214-ac87-ed72fc2d66ef tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:14.055642 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-251b2b4f-e911-4636-acde-22553e1110d2 req-aa241c50-54c8-4b2b-a842-2c59cfccf39e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b49bddcd-130e-4ef2-b627-4d5c84740e36", "tag": "875768cf-7bf3-4cf5-9d1a-761592ff4dcc"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:34:14.069155 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-251b2b4f-e911-4636-acde-22553e1110d2 req-aa241c50-54c8-4b2b-a842-2c59cfccf39e service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:14.069664 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-251b2b4f-e911-4636-acde-22553e1110d2 req-aa241c50-54c8-4b2b-a842-2c59cfccf39e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:14.070245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-251b2b4f-e911-4636-acde-22553e1110d2 req-aa241c50-54c8-4b2b-a842-2c59cfccf39e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:14.085668 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-251b2b4f-e911-4636-acde-22553e1110d2 req-aa241c50-54c8-4b2b-a842-2c59cfccf39e service nova] Creating event network-changed:875768cf-7bf3-4cf5-9d1a-761592ff4dcc for instance b49bddcd-130e-4ef2-b627-4d5c84740e36 on n-h1-851359-3 Aug 04 17:34:14.103448 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-251b2b4f-e911-4636-acde-22553e1110d2 req-aa241c50-54c8-4b2b-a842-2c59cfccf39e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052515 Aug 04 17:34:14.104392 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3085/6197] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:34:14.288300 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-201d425d-8aca-4214-ac87-ed72fc2d66ef tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffc50d4aa8047a1a1a18dd97c395431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0374197b78be4d8daf63e8b0dfc4e227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:34:14.300858 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-201d425d-8aca-4214-ac87-ed72fc2d66ef tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] 10.222.0.93 "GET /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36" status: 200 len: 1313 microversion: 2.1 time: 0.312468 Aug 04 17:34:14.316700 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3113/6198] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:34:13 2022] GET /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36 => generated 1313 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:34:15.329434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b748a1f7-0f84-4b13-b541-a5fd070182ff tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:34:15.330757 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b748a1f7-0f84-4b13-b541-a5fd070182ff tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] [instance: b49bddcd-130e-4ef2-b627-4d5c84740e36] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:34:15.338489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b748a1f7-0f84-4b13-b541-a5fd070182ff tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:15.339760 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b748a1f7-0f84-4b13-b541-a5fd070182ff tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:15.340201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b748a1f7-0f84-4b13-b541-a5fd070182ff tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:15.340911 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b748a1f7-0f84-4b13-b541-a5fd070182ff tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:15.341365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b748a1f7-0f84-4b13-b541-a5fd070182ff tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:15.341794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b748a1f7-0f84-4b13-b541-a5fd070182ff tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:15.537040 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b748a1f7-0f84-4b13-b541-a5fd070182ff tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffc50d4aa8047a1a1a18dd97c395431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0374197b78be4d8daf63e8b0dfc4e227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:34:15.546145 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b748a1f7-0f84-4b13-b541-a5fd070182ff tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] 10.222.0.93 "GET /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36" status: 200 len: 1313 microversion: 2.1 time: 0.221102 Aug 04 17:34:15.548103 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3086/6199] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:34:15 2022] GET /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:34:16.579809 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-db7b0b6e-ede5-4e4f-b2ed-4d4e44065b18 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:34:16.579809 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-db7b0b6e-ede5-4e4f-b2ed-4d4e44065b18 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] [instance: b49bddcd-130e-4ef2-b627-4d5c84740e36] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:34:16.585447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db7b0b6e-ede5-4e4f-b2ed-4d4e44065b18 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:16.586070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db7b0b6e-ede5-4e4f-b2ed-4d4e44065b18 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:16.586560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db7b0b6e-ede5-4e4f-b2ed-4d4e44065b18 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:16.587303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db7b0b6e-ede5-4e4f-b2ed-4d4e44065b18 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:16.587775 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db7b0b6e-ede5-4e4f-b2ed-4d4e44065b18 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:16.588404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db7b0b6e-ede5-4e4f-b2ed-4d4e44065b18 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:16.748313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-db7b0b6e-ede5-4e4f-b2ed-4d4e44065b18 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffc50d4aa8047a1a1a18dd97c395431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0374197b78be4d8daf63e8b0dfc4e227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:34:16.756924 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-db7b0b6e-ede5-4e4f-b2ed-4d4e44065b18 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] 10.222.0.93 "GET /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36" status: 200 len: 1313 microversion: 2.1 time: 0.191844 Aug 04 17:34:16.758024 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3114/6200] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:34:16 2022] GET /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:34:17.782137 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-da42e935-448c-4d38-a42c-264c3f7d00a3 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:34:17.782771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-da42e935-448c-4d38-a42c-264c3f7d00a3 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] [instance: b49bddcd-130e-4ef2-b627-4d5c84740e36] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:34:17.789650 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da42e935-448c-4d38-a42c-264c3f7d00a3 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:17.790193 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da42e935-448c-4d38-a42c-264c3f7d00a3 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:17.790643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da42e935-448c-4d38-a42c-264c3f7d00a3 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:17.791425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da42e935-448c-4d38-a42c-264c3f7d00a3 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:17.794180 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da42e935-448c-4d38-a42c-264c3f7d00a3 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:17.794180 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da42e935-448c-4d38-a42c-264c3f7d00a3 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:17.953407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-da42e935-448c-4d38-a42c-264c3f7d00a3 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffc50d4aa8047a1a1a18dd97c395431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0374197b78be4d8daf63e8b0dfc4e227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:34:17.962899 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-da42e935-448c-4d38-a42c-264c3f7d00a3 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] 10.222.0.93 "GET /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36" status: 200 len: 1313 microversion: 2.1 time: 0.187585 Aug 04 17:34:17.963907 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3087/6201] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:34:17 2022] GET /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36 => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:34:18.990075 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-76c24885-971c-4255-92a0-1e2a76323344 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:34:18.991344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-76c24885-971c-4255-92a0-1e2a76323344 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] [instance: b49bddcd-130e-4ef2-b627-4d5c84740e36] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:34:19.000521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76c24885-971c-4255-92a0-1e2a76323344 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:19.001391 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76c24885-971c-4255-92a0-1e2a76323344 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:19.001952 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76c24885-971c-4255-92a0-1e2a76323344 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:19.003005 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76c24885-971c-4255-92a0-1e2a76323344 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:19.003723 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76c24885-971c-4255-92a0-1e2a76323344 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:19.004856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76c24885-971c-4255-92a0-1e2a76323344 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:19.077742 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-d50ce6a5-e5b4-4e55-b8c0-a1a59cb47cb5 req-546a60f7-9fd8-4be0-a079-336762704fae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b49bddcd-130e-4ef2-b627-4d5c84740e36", "name": "network-vif-plugged", "status": "completed", "tag": "875768cf-7bf3-4cf5-9d1a-761592ff4dcc"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:34:19.104096 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d50ce6a5-e5b4-4e55-b8c0-a1a59cb47cb5 req-546a60f7-9fd8-4be0-a079-336762704fae service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:19.105720 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d50ce6a5-e5b4-4e55-b8c0-a1a59cb47cb5 req-546a60f7-9fd8-4be0-a079-336762704fae service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:19.106651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d50ce6a5-e5b4-4e55-b8c0-a1a59cb47cb5 req-546a60f7-9fd8-4be0-a079-336762704fae service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:19.133584 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-d50ce6a5-e5b4-4e55-b8c0-a1a59cb47cb5 req-546a60f7-9fd8-4be0-a079-336762704fae service nova] Creating event network-vif-plugged:875768cf-7bf3-4cf5-9d1a-761592ff4dcc for instance b49bddcd-130e-4ef2-b627-4d5c84740e36 on n-h1-851359-3 Aug 04 17:34:19.142200 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-d50ce6a5-e5b4-4e55-b8c0-a1a59cb47cb5 req-546a60f7-9fd8-4be0-a079-336762704fae service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069840 Aug 04 17:34:19.143911 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3088/6202] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:34:19.178349 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-76c24885-971c-4255-92a0-1e2a76323344 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffc50d4aa8047a1a1a18dd97c395431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0374197b78be4d8daf63e8b0dfc4e227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:34:19.187181 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-76c24885-971c-4255-92a0-1e2a76323344 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] 10.222.0.93 "GET /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36" status: 200 len: 1313 microversion: 2.1 time: 0.201043 Aug 04 17:34:19.188047 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3115/6203] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:34:18 2022] GET /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:34:20.224756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ee40240c-9987-424b-97b7-bdaf0f2d0a35 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:34:20.225765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ee40240c-9987-424b-97b7-bdaf0f2d0a35 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] [instance: b49bddcd-130e-4ef2-b627-4d5c84740e36] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:34:20.238526 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee40240c-9987-424b-97b7-bdaf0f2d0a35 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:20.239191 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee40240c-9987-424b-97b7-bdaf0f2d0a35 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:20.239924 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee40240c-9987-424b-97b7-bdaf0f2d0a35 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:20.240852 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee40240c-9987-424b-97b7-bdaf0f2d0a35 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:20.241485 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee40240c-9987-424b-97b7-bdaf0f2d0a35 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:20.242104 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee40240c-9987-424b-97b7-bdaf0f2d0a35 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:20.492307 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ee40240c-9987-424b-97b7-bdaf0f2d0a35 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffc50d4aa8047a1a1a18dd97c395431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0374197b78be4d8daf63e8b0dfc4e227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:34:20.522389 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ee40240c-9987-424b-97b7-bdaf0f2d0a35 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] 10.222.0.93 "GET /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36" status: 200 len: 1313 microversion: 2.1 time: 0.305047 Aug 04 17:34:20.524170 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3089/6204] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:34:20 2022] GET /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:34:21.560833 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4eb38ff6-589f-47ab-9594-ba0cf4888594 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:34:21.561919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4eb38ff6-589f-47ab-9594-ba0cf4888594 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] [instance: b49bddcd-130e-4ef2-b627-4d5c84740e36] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:34:21.565372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:34:21.566130 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:34:21.573669 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4eb38ff6-589f-47ab-9594-ba0cf4888594 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:21.573669 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4eb38ff6-589f-47ab-9594-ba0cf4888594 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:21.573669 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4eb38ff6-589f-47ab-9594-ba0cf4888594 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:21.574194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4eb38ff6-589f-47ab-9594-ba0cf4888594 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:21.574672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4eb38ff6-589f-47ab-9594-ba0cf4888594 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:21.575404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4eb38ff6-589f-47ab-9594-ba0cf4888594 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:21.810406 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4eb38ff6-589f-47ab-9594-ba0cf4888594 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffc50d4aa8047a1a1a18dd97c395431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0374197b78be4d8daf63e8b0dfc4e227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:34:21.819028 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4eb38ff6-589f-47ab-9594-ba0cf4888594 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] 10.222.0.93 "GET /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36" status: 200 len: 1463 microversion: 2.1 time: 0.266522 Aug 04 17:34:21.820155 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3116/6205] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:34:21 2022] GET /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36 => generated 1463 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:34:21.842811 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-096227ae-eb2d-4aa4-ad96-c6ea2d6a531e tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ada1f906-a60d-4ece-9230-f6be8998adc6", "device": "/dev/sdb"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:34:21.847579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-096227ae-eb2d-4aa4-ad96-c6ea2d6a531e tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] [instance: b49bddcd-130e-4ef2-b627-4d5c84740e36] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:34:21.851061 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:34:21.858218 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-096227ae-eb2d-4aa4-ad96-c6ea2d6a531e tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:21.858735 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-096227ae-eb2d-4aa4-ad96-c6ea2d6a531e tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:21.859187 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-096227ae-eb2d-4aa4-ad96-c6ea2d6a531e tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:21.859912 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-096227ae-eb2d-4aa4-ad96-c6ea2d6a531e tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:21.860397 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-096227ae-eb2d-4aa4-ad96-c6ea2d6a531e tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:21.860836 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-096227ae-eb2d-4aa4-ad96-c6ea2d6a531e tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:22.243920 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-096227ae-eb2d-4aa4-ad96-c6ea2d6a531e tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] 10.222.0.93 "POST /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.405668 Aug 04 17:34:22.244782 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3090/6206] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Aug 4 17:34:21 2022] POST /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36/os-volume_attachments => generated 194 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:34:49.702710 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e33c12ef-93f4-4756-927e-4694e0f41940 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Action: 'create', calling method: .version_select at 0x7f1e5b05f0d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1337893055", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNy/hnlCmkobfl8GhErIJVzc0gTkpttqcpQFkVNrSIU0rFXGvyl08Bw3Bo1KpFwfw9HM75nbBKdwmFVlQfQiyO6RL5IR/qvhiOXtu9UK6xdfo9UEUkjjqBccD+VcuMWtHw=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:34:49.712067 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:34:49.713453 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=32 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:34:49.737436 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-e33c12ef-93f4-4756-927e-4694e0f41940 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Getting quotas for project 12b4e49789d84ae29c3278fcb2303508. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:34:49.748299 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-e33c12ef-93f4-4756-927e-4694e0f41940 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Getting quotas for user 55283f1fd1af42ef87ee70f1554b0f6e and project 12b4e49789d84ae29c3278fcb2303508. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:34:49.785513 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e33c12ef-93f4-4756-927e-4694e0f41940 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.088228 Aug 04 17:34:49.791987 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3117/6207] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:34:49 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:34:51.438272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-725343d9-70ec-40cf-a705-cc09abe9e8b8 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-489027090", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "e91ed810-dfd2-40af-9242-d775f79e3ff5"}], "key_name": "tempest-TestNetworkBasicOps-1337893055", "security_groups": [{"name": "tempest-secgroup-smoke-1850354449"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:34:51.461764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=20 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:34:51.462746 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:34:51.876766 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-725343d9-70ec-40cf-a705-cc09abe9e8b8 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] validate_networks() for [('e91ed810-dfd2-40af-9242-d775f79e3ff5', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:34:52.346015 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-725343d9-70ec-40cf-a705-cc09abe9e8b8 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:34:52.346446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-725343d9-70ec-40cf-a705-cc09abe9e8b8 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:34:52.346961 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-725343d9-70ec-40cf-a705-cc09abe9e8b8 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:34:52.347528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-725343d9-70ec-40cf-a705-cc09abe9e8b8 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:34:52.347999 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-725343d9-70ec-40cf-a705-cc09abe9e8b8 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:34:52.362202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-725343d9-70ec-40cf-a705-cc09abe9e8b8 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:52.366315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-725343d9-70ec-40cf-a705-cc09abe9e8b8 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:52.368001 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-725343d9-70ec-40cf-a705-cc09abe9e8b8 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:52.368825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-725343d9-70ec-40cf-a705-cc09abe9e8b8 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:52.369303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-725343d9-70ec-40cf-a705-cc09abe9e8b8 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:52.369783 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-725343d9-70ec-40cf-a705-cc09abe9e8b8 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:52.407652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-725343d9-70ec-40cf-a705-cc09abe9e8b8 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Getting quotas for project 12b4e49789d84ae29c3278fcb2303508. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:34:52.414161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-725343d9-70ec-40cf-a705-cc09abe9e8b8 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Getting quotas for user 55283f1fd1af42ef87ee70f1554b0f6e and project 12b4e49789d84ae29c3278fcb2303508. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:34:52.432038 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-725343d9-70ec-40cf-a705-cc09abe9e8b8 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:34:52.435501 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-725343d9-70ec-40cf-a705-cc09abe9e8b8 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 027e0611-05ee-493f-a704-7e2d2d2bd50c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:34:52.499200 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-725343d9-70ec-40cf-a705-cc09abe9e8b8 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.065794 Aug 04 17:34:52.500697 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3091/6208] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:34:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 1068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:34:52.514231 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-614acab0-d6d5-4a3e-9b8d-4436e425801c tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:34:52.515633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-614acab0-d6d5-4a3e-9b8d-4436e425801c tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 027e0611-05ee-493f-a704-7e2d2d2bd50c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:34:52.793538 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-614acab0-d6d5-4a3e-9b8d-4436e425801c tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:34:52.804217 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-614acab0-d6d5-4a3e-9b8d-4436e425801c tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/027e0611-05ee-493f-a704-7e2d2d2bd50c" status: 200 len: 1248 microversion: 2.1 time: 0.295785 Aug 04 17:34:52.818015 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3118/6209] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:34:52 2022] GET /compute/v2.1/servers/027e0611-05ee-493f-a704-7e2d2d2bd50c => generated 1248 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:34:53.828437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b7b4487e-6c77-4787-93ee-ae937931334f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:34:53.829223 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b7b4487e-6c77-4787-93ee-ae937931334f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 027e0611-05ee-493f-a704-7e2d2d2bd50c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:34:53.844508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7b4487e-6c77-4787-93ee-ae937931334f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:53.845134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7b4487e-6c77-4787-93ee-ae937931334f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:53.846380 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7b4487e-6c77-4787-93ee-ae937931334f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:53.847849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7b4487e-6c77-4787-93ee-ae937931334f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:53.850666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7b4487e-6c77-4787-93ee-ae937931334f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:53.851340 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7b4487e-6c77-4787-93ee-ae937931334f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:53.984514 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b7b4487e-6c77-4787-93ee-ae937931334f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:34:53.993417 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b7b4487e-6c77-4787-93ee-ae937931334f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/027e0611-05ee-493f-a704-7e2d2d2bd50c" status: 200 len: 1318 microversion: 2.1 time: 0.169448 Aug 04 17:34:53.996428 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3092/6210] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:34:53 2022] GET /compute/v2.1/servers/027e0611-05ee-493f-a704-7e2d2d2bd50c => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:34:55.017703 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-72eadce9-a975-45f6-9eaf-a0fb10d652f3 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:34:55.018936 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-72eadce9-a975-45f6-9eaf-a0fb10d652f3 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 027e0611-05ee-493f-a704-7e2d2d2bd50c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:34:55.026563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-72eadce9-a975-45f6-9eaf-a0fb10d652f3 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:55.027200 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-72eadce9-a975-45f6-9eaf-a0fb10d652f3 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:55.028435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-72eadce9-a975-45f6-9eaf-a0fb10d652f3 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:55.029243 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-72eadce9-a975-45f6-9eaf-a0fb10d652f3 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:55.029810 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-72eadce9-a975-45f6-9eaf-a0fb10d652f3 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:55.030369 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-72eadce9-a975-45f6-9eaf-a0fb10d652f3 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:55.264159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-72eadce9-a975-45f6-9eaf-a0fb10d652f3 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:34:55.272216 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-72eadce9-a975-45f6-9eaf-a0fb10d652f3 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/027e0611-05ee-493f-a704-7e2d2d2bd50c" status: 200 len: 1374 microversion: 2.1 time: 0.258584 Aug 04 17:34:55.282408 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3119/6211] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:34:55 2022] GET /compute/v2.1/servers/027e0611-05ee-493f-a704-7e2d2d2bd50c => generated 1374 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:34:55.619597 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-ee77a8b0-615a-4309-a741-cda8b6af3f55 req-20492d40-ff40-4fed-a4b1-f40ec5d65248 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "027e0611-05ee-493f-a704-7e2d2d2bd50c", "tag": "eefd7d9f-8f1f-48ce-a8f7-7cea54d51d63"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:34:55.634494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ee77a8b0-615a-4309-a741-cda8b6af3f55 req-20492d40-ff40-4fed-a4b1-f40ec5d65248 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:55.635340 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ee77a8b0-615a-4309-a741-cda8b6af3f55 req-20492d40-ff40-4fed-a4b1-f40ec5d65248 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:55.635891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ee77a8b0-615a-4309-a741-cda8b6af3f55 req-20492d40-ff40-4fed-a4b1-f40ec5d65248 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:55.649105 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-ee77a8b0-615a-4309-a741-cda8b6af3f55 req-20492d40-ff40-4fed-a4b1-f40ec5d65248 service nova] Creating event network-changed:eefd7d9f-8f1f-48ce-a8f7-7cea54d51d63 for instance 027e0611-05ee-493f-a704-7e2d2d2bd50c on n-h2-851359-3 Aug 04 17:34:55.656207 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-ee77a8b0-615a-4309-a741-cda8b6af3f55 req-20492d40-ff40-4fed-a4b1-f40ec5d65248 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041294 Aug 04 17:34:55.670051 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3093/6212] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:34:56.294930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-586554d9-b3b2-4029-a4ba-fc689401d60b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:34:56.295876 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-586554d9-b3b2-4029-a4ba-fc689401d60b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 027e0611-05ee-493f-a704-7e2d2d2bd50c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:34:56.303800 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-586554d9-b3b2-4029-a4ba-fc689401d60b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:56.304346 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-586554d9-b3b2-4029-a4ba-fc689401d60b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:56.304787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-586554d9-b3b2-4029-a4ba-fc689401d60b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:56.305521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-586554d9-b3b2-4029-a4ba-fc689401d60b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:56.306094 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-586554d9-b3b2-4029-a4ba-fc689401d60b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:56.306460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-586554d9-b3b2-4029-a4ba-fc689401d60b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:56.472560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-586554d9-b3b2-4029-a4ba-fc689401d60b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:34:56.482729 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-586554d9-b3b2-4029-a4ba-fc689401d60b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/027e0611-05ee-493f-a704-7e2d2d2bd50c" status: 200 len: 1374 microversion: 2.1 time: 0.192065 Aug 04 17:34:56.483350 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3120/6213] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:34:56 2022] GET /compute/v2.1/servers/027e0611-05ee-493f-a704-7e2d2d2bd50c => generated 1374 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:34:57.516963 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-70003f67-5a5b-4a4d-92c9-b8de3ecaa73b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:34:57.517641 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-70003f67-5a5b-4a4d-92c9-b8de3ecaa73b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 027e0611-05ee-493f-a704-7e2d2d2bd50c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:34:57.528417 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70003f67-5a5b-4a4d-92c9-b8de3ecaa73b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:57.529777 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70003f67-5a5b-4a4d-92c9-b8de3ecaa73b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:57.530798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70003f67-5a5b-4a4d-92c9-b8de3ecaa73b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:57.532516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70003f67-5a5b-4a4d-92c9-b8de3ecaa73b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:57.533403 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70003f67-5a5b-4a4d-92c9-b8de3ecaa73b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:57.533938 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70003f67-5a5b-4a4d-92c9-b8de3ecaa73b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:57.693270 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-70003f67-5a5b-4a4d-92c9-b8de3ecaa73b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:34:57.702184 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-70003f67-5a5b-4a4d-92c9-b8de3ecaa73b tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/027e0611-05ee-493f-a704-7e2d2d2bd50c" status: 200 len: 1374 microversion: 2.1 time: 0.194379 Aug 04 17:34:57.702778 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3094/6214] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:34:57 2022] GET /compute/v2.1/servers/027e0611-05ee-493f-a704-7e2d2d2bd50c => generated 1374 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:34:58.725608 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ecf87b25-4a60-406f-af5f-73f6b5c10c71 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:34:58.728274 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ecf87b25-4a60-406f-af5f-73f6b5c10c71 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 027e0611-05ee-493f-a704-7e2d2d2bd50c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:34:58.737177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecf87b25-4a60-406f-af5f-73f6b5c10c71 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:58.737687 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecf87b25-4a60-406f-af5f-73f6b5c10c71 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:58.738159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecf87b25-4a60-406f-af5f-73f6b5c10c71 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:58.739232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecf87b25-4a60-406f-af5f-73f6b5c10c71 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:58.740136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecf87b25-4a60-406f-af5f-73f6b5c10c71 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:58.740843 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecf87b25-4a60-406f-af5f-73f6b5c10c71 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:58.954447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ecf87b25-4a60-406f-af5f-73f6b5c10c71 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:34:58.962489 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ecf87b25-4a60-406f-af5f-73f6b5c10c71 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/027e0611-05ee-493f-a704-7e2d2d2bd50c" status: 200 len: 1374 microversion: 2.1 time: 0.241756 Aug 04 17:34:58.963456 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3121/6215] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:34:58 2022] GET /compute/v2.1/servers/027e0611-05ee-493f-a704-7e2d2d2bd50c => generated 1374 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:34:59.984410 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cfdda438-7ffb-464f-af06-8a924b604b1e tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:34:59.984981 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cfdda438-7ffb-464f-af06-8a924b604b1e tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 027e0611-05ee-493f-a704-7e2d2d2bd50c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:34:59.994807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfdda438-7ffb-464f-af06-8a924b604b1e tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:59.995488 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfdda438-7ffb-464f-af06-8a924b604b1e tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:59.995928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfdda438-7ffb-464f-af06-8a924b604b1e tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:34:59.996803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfdda438-7ffb-464f-af06-8a924b604b1e tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:34:59.997436 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfdda438-7ffb-464f-af06-8a924b604b1e tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:34:59.997893 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfdda438-7ffb-464f-af06-8a924b604b1e tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:00.160017 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cfdda438-7ffb-464f-af06-8a924b604b1e tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:00.169672 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cfdda438-7ffb-464f-af06-8a924b604b1e tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/027e0611-05ee-493f-a704-7e2d2d2bd50c" status: 200 len: 1374 microversion: 2.1 time: 0.189179 Aug 04 17:35:00.171130 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3095/6216] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:34:59 2022] GET /compute/v2.1/servers/027e0611-05ee-493f-a704-7e2d2d2bd50c => generated 1374 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:00.984119 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-ce4e0a07-8c6f-4031-a09e-e31b2019af76 req-d82bdd38-aa7f-4058-8167-eee4e3e5e1c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "027e0611-05ee-493f-a704-7e2d2d2bd50c", "name": "network-vif-plugged", "status": "completed", "tag": "eefd7d9f-8f1f-48ce-a8f7-7cea54d51d63"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:35:00.998810 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ce4e0a07-8c6f-4031-a09e-e31b2019af76 req-d82bdd38-aa7f-4058-8167-eee4e3e5e1c3 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:00.999995 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ce4e0a07-8c6f-4031-a09e-e31b2019af76 req-d82bdd38-aa7f-4058-8167-eee4e3e5e1c3 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:01.000639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ce4e0a07-8c6f-4031-a09e-e31b2019af76 req-d82bdd38-aa7f-4058-8167-eee4e3e5e1c3 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:01.017250 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-ce4e0a07-8c6f-4031-a09e-e31b2019af76 req-d82bdd38-aa7f-4058-8167-eee4e3e5e1c3 service nova] Creating event network-vif-plugged:eefd7d9f-8f1f-48ce-a8f7-7cea54d51d63 for instance 027e0611-05ee-493f-a704-7e2d2d2bd50c on n-h2-851359-3 Aug 04 17:35:01.024245 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-ce4e0a07-8c6f-4031-a09e-e31b2019af76 req-d82bdd38-aa7f-4058-8167-eee4e3e5e1c3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045931 Aug 04 17:35:01.025383 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3122/6217] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:35:01.192961 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c79a4a8f-e230-4ace-a945-1283707e08e2 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:01.194405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c79a4a8f-e230-4ace-a945-1283707e08e2 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 027e0611-05ee-493f-a704-7e2d2d2bd50c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:01.202629 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c79a4a8f-e230-4ace-a945-1283707e08e2 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:01.203372 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c79a4a8f-e230-4ace-a945-1283707e08e2 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:01.204134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c79a4a8f-e230-4ace-a945-1283707e08e2 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:01.205125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c79a4a8f-e230-4ace-a945-1283707e08e2 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:01.205989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c79a4a8f-e230-4ace-a945-1283707e08e2 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:01.206579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c79a4a8f-e230-4ace-a945-1283707e08e2 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:01.394107 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c79a4a8f-e230-4ace-a945-1283707e08e2 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:01.403715 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c79a4a8f-e230-4ace-a945-1283707e08e2 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/027e0611-05ee-493f-a704-7e2d2d2bd50c" status: 200 len: 1374 microversion: 2.1 time: 0.215827 Aug 04 17:35:01.404423 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3096/6218] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:01 2022] GET /compute/v2.1/servers/027e0611-05ee-493f-a704-7e2d2d2bd50c => generated 1374 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:02.425484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fa1a8e94-3ef1-4515-99d2-49dc3ef9b492 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:02.427056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fa1a8e94-3ef1-4515-99d2-49dc3ef9b492 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 027e0611-05ee-493f-a704-7e2d2d2bd50c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:02.436652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fa1a8e94-3ef1-4515-99d2-49dc3ef9b492 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:02.437291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fa1a8e94-3ef1-4515-99d2-49dc3ef9b492 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:02.437845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fa1a8e94-3ef1-4515-99d2-49dc3ef9b492 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:02.438709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fa1a8e94-3ef1-4515-99d2-49dc3ef9b492 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:02.439436 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fa1a8e94-3ef1-4515-99d2-49dc3ef9b492 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:02.439893 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fa1a8e94-3ef1-4515-99d2-49dc3ef9b492 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:02.643948 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fa1a8e94-3ef1-4515-99d2-49dc3ef9b492 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:02.658785 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fa1a8e94-3ef1-4515-99d2-49dc3ef9b492 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/027e0611-05ee-493f-a704-7e2d2d2bd50c" status: 200 len: 1374 microversion: 2.1 time: 0.237415 Aug 04 17:35:02.666169 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3123/6219] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:02 2022] GET /compute/v2.1/servers/027e0611-05ee-493f-a704-7e2d2d2bd50c => generated 1374 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:03.147131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:35:03.148592 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:35:03.336748 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-89dab4f0-435c-4a1e-86be-5d234f3b4d08 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:03.337648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-89dab4f0-435c-4a1e-86be-5d234f3b4d08 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] [instance: 4c54a751-dda6-452f-a556-028fdee6f15f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:03.346806 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-89dab4f0-435c-4a1e-86be-5d234f3b4d08 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:03.347561 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-89dab4f0-435c-4a1e-86be-5d234f3b4d08 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:03.348163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-89dab4f0-435c-4a1e-86be-5d234f3b4d08 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:03.350371 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-89dab4f0-435c-4a1e-86be-5d234f3b4d08 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:03.351180 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-89dab4f0-435c-4a1e-86be-5d234f3b4d08 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:03.351807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-89dab4f0-435c-4a1e-86be-5d234f3b4d08 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:03.383180 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-89dab4f0-435c-4a1e-86be-5d234f3b4d08 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] [instance: 4c54a751-dda6-452f-a556-028fdee6f15f] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:35:03.494468 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-89dab4f0-435c-4a1e-86be-5d234f3b4d08 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f" status: 204 len: 0 microversion: 2.1 time: 0.359258 Aug 04 17:35:03.495440 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3097/6220] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:35:03 2022] DELETE /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:35:03.504351 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-025ed94a-552b-48e0-b8b7-d35c41860d42 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:03.505838 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-025ed94a-552b-48e0-b8b7-d35c41860d42 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] [instance: 4c54a751-dda6-452f-a556-028fdee6f15f] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:03.513178 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:35:03.516690 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-025ed94a-552b-48e0-b8b7-d35c41860d42 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:03.517401 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-025ed94a-552b-48e0-b8b7-d35c41860d42 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:03.517857 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-025ed94a-552b-48e0-b8b7-d35c41860d42 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:03.518813 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-025ed94a-552b-48e0-b8b7-d35c41860d42 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:03.519287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-025ed94a-552b-48e0-b8b7-d35c41860d42 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:03.519729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-025ed94a-552b-48e0-b8b7-d35c41860d42 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:03.688975 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ea891792-b569-4894-b8e6-aa765b8ca45d tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:03.690008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ea891792-b569-4894-b8e6-aa765b8ca45d tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 027e0611-05ee-493f-a704-7e2d2d2bd50c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:03.696713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea891792-b569-4894-b8e6-aa765b8ca45d tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:03.697742 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea891792-b569-4894-b8e6-aa765b8ca45d tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:03.697949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea891792-b569-4894-b8e6-aa765b8ca45d tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:03.699401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea891792-b569-4894-b8e6-aa765b8ca45d tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:03.700016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea891792-b569-4894-b8e6-aa765b8ca45d tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:03.700590 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea891792-b569-4894-b8e6-aa765b8ca45d tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:03.726661 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-025ed94a-552b-48e0-b8b7-d35c41860d42 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2210ca1cd35f43e8bc4b10710c2900ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0211a3372bae447fbdfb4cb849a265d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:03.736183 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-025ed94a-552b-48e0-b8b7-d35c41860d42 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] 10.222.0.93 "GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f" status: 200 len: 1732 microversion: 2.1 time: 0.236158 Aug 04 17:35:03.737130 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3124/6221] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:03 2022] GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f => generated 1732 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:03.904051 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ea891792-b569-4894-b8e6-aa765b8ca45d tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:03.930384 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ea891792-b569-4894-b8e6-aa765b8ca45d tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/027e0611-05ee-493f-a704-7e2d2d2bd50c" status: 200 len: 1546 microversion: 2.1 time: 0.231993 Aug 04 17:35:03.931053 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3098/6222] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:03 2022] GET /compute/v2.1/servers/027e0611-05ee-493f-a704-7e2d2d2bd50c => generated 1546 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:03.954408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-03b82f7f-9f43-4b6d-b32d-5d683a26bd83 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:03.955425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-03b82f7f-9f43-4b6d-b32d-5d683a26bd83 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 027e0611-05ee-493f-a704-7e2d2d2bd50c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:03.963848 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03b82f7f-9f43-4b6d-b32d-5d683a26bd83 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:03.964496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03b82f7f-9f43-4b6d-b32d-5d683a26bd83 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:03.974726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03b82f7f-9f43-4b6d-b32d-5d683a26bd83 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:03.975695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03b82f7f-9f43-4b6d-b32d-5d683a26bd83 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:03.976203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03b82f7f-9f43-4b6d-b32d-5d683a26bd83 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:03.978089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03b82f7f-9f43-4b6d-b32d-5d683a26bd83 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:04.221079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-03b82f7f-9f43-4b6d-b32d-5d683a26bd83 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:04.231349 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-03b82f7f-9f43-4b6d-b32d-5d683a26bd83 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/027e0611-05ee-493f-a704-7e2d2d2bd50c" status: 200 len: 1546 microversion: 2.1 time: 0.281591 Aug 04 17:35:04.246832 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3125/6223] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:03 2022] GET /compute/v2.1/servers/027e0611-05ee-493f-a704-7e2d2d2bd50c => generated 1546 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:04.770450 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b67658ff-77f2-4fe2-9c45-e6b0d0ee04ea tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:04.771796 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b67658ff-77f2-4fe2-9c45-e6b0d0ee04ea tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] [instance: 4c54a751-dda6-452f-a556-028fdee6f15f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:04.779219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b67658ff-77f2-4fe2-9c45-e6b0d0ee04ea tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:04.780047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b67658ff-77f2-4fe2-9c45-e6b0d0ee04ea tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:04.780794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b67658ff-77f2-4fe2-9c45-e6b0d0ee04ea tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:04.781747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b67658ff-77f2-4fe2-9c45-e6b0d0ee04ea tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:04.782352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b67658ff-77f2-4fe2-9c45-e6b0d0ee04ea tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:04.783004 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b67658ff-77f2-4fe2-9c45-e6b0d0ee04ea tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:05.004035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b67658ff-77f2-4fe2-9c45-e6b0d0ee04ea tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2210ca1cd35f43e8bc4b10710c2900ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0211a3372bae447fbdfb4cb849a265d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:05.020286 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b67658ff-77f2-4fe2-9c45-e6b0d0ee04ea tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] 10.222.0.93 "GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f" status: 200 len: 1732 microversion: 2.1 time: 0.253254 Aug 04 17:35:05.021510 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3099/6224] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:04 2022] GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f => generated 1732 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:35:06.056184 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-21a82fa1-4f32-40e2-b2fa-15bf2e7048b6 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:06.057016 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-21a82fa1-4f32-40e2-b2fa-15bf2e7048b6 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] [instance: 4c54a751-dda6-452f-a556-028fdee6f15f] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:06.071462 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-21a82fa1-4f32-40e2-b2fa-15bf2e7048b6 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:06.072274 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-21a82fa1-4f32-40e2-b2fa-15bf2e7048b6 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:06.072947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-21a82fa1-4f32-40e2-b2fa-15bf2e7048b6 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:06.074428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-21a82fa1-4f32-40e2-b2fa-15bf2e7048b6 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:06.075081 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-21a82fa1-4f32-40e2-b2fa-15bf2e7048b6 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:06.080452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-21a82fa1-4f32-40e2-b2fa-15bf2e7048b6 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:06.581888 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-21a82fa1-4f32-40e2-b2fa-15bf2e7048b6 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2210ca1cd35f43e8bc4b10710c2900ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0211a3372bae447fbdfb4cb849a265d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:06.611363 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-21a82fa1-4f32-40e2-b2fa-15bf2e7048b6 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] 10.222.0.93 "GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f" status: 200 len: 1732 microversion: 2.1 time: 0.559819 Aug 04 17:35:06.613355 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3126/6225] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:06 2022] GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f => generated 1732 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:35:07.635640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5536082c-9b95-4b47-a45c-4b8bbce8a390 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:07.637268 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5536082c-9b95-4b47-a45c-4b8bbce8a390 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] [instance: 4c54a751-dda6-452f-a556-028fdee6f15f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:07.648407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5536082c-9b95-4b47-a45c-4b8bbce8a390 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:07.649295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5536082c-9b95-4b47-a45c-4b8bbce8a390 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:07.649968 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5536082c-9b95-4b47-a45c-4b8bbce8a390 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:07.651137 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5536082c-9b95-4b47-a45c-4b8bbce8a390 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:07.651828 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5536082c-9b95-4b47-a45c-4b8bbce8a390 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:07.652455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5536082c-9b95-4b47-a45c-4b8bbce8a390 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:07.809867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5536082c-9b95-4b47-a45c-4b8bbce8a390 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2210ca1cd35f43e8bc4b10710c2900ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0211a3372bae447fbdfb4cb849a265d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:07.818998 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5536082c-9b95-4b47-a45c-4b8bbce8a390 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] 10.222.0.93 "GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f" status: 200 len: 1664 microversion: 2.1 time: 0.188715 Aug 04 17:35:07.820507 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3100/6226] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:07 2022] GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f => generated 1664 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:07.860661 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-0aff1e29-95da-4fff-b91b-bde876c36298 req-cb68b3f5-1c8e-4dcc-a770-e842ef9886d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c54a751-dda6-452f-a556-028fdee6f15f", "name": "network-vif-deleted", "tag": "43bc5202-2365-49f7-96fe-75439b20aa08"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:35:07.875566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-0aff1e29-95da-4fff-b91b-bde876c36298 req-cb68b3f5-1c8e-4dcc-a770-e842ef9886d9 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:07.877298 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-0aff1e29-95da-4fff-b91b-bde876c36298 req-cb68b3f5-1c8e-4dcc-a770-e842ef9886d9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:07.877967 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-0aff1e29-95da-4fff-b91b-bde876c36298 req-cb68b3f5-1c8e-4dcc-a770-e842ef9886d9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:07.892835 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-0aff1e29-95da-4fff-b91b-bde876c36298 req-cb68b3f5-1c8e-4dcc-a770-e842ef9886d9 service nova] Creating event network-vif-deleted:43bc5202-2365-49f7-96fe-75439b20aa08 for instance 4c54a751-dda6-452f-a556-028fdee6f15f on n-h1-851359-3 Aug 04 17:35:07.901112 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-0aff1e29-95da-4fff-b91b-bde876c36298 req-cb68b3f5-1c8e-4dcc-a770-e842ef9886d9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047912 Aug 04 17:35:07.902729 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3127/6227] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:35:08.841416 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ba1d7f2e-d13a-4607-ac60-5aa5e8bb1a4e tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:08.842642 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ba1d7f2e-d13a-4607-ac60-5aa5e8bb1a4e tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] [instance: 4c54a751-dda6-452f-a556-028fdee6f15f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:08.853621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba1d7f2e-d13a-4607-ac60-5aa5e8bb1a4e tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:08.855989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba1d7f2e-d13a-4607-ac60-5aa5e8bb1a4e tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:08.866762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba1d7f2e-d13a-4607-ac60-5aa5e8bb1a4e tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:08.867796 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba1d7f2e-d13a-4607-ac60-5aa5e8bb1a4e tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:08.868433 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba1d7f2e-d13a-4607-ac60-5aa5e8bb1a4e tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:08.869023 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba1d7f2e-d13a-4607-ac60-5aa5e8bb1a4e tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:08.903459 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-ba1d7f2e-d13a-4607-ac60-5aa5e8bb1a4e tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] HTTP exception thrown: Instance 4c54a751-dda6-452f-a556-028fdee6f15f could not be found. Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ba1d7f2e-d13a-4607-ac60-5aa5e8bb1a4e tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Request method failure captured: Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f HTTP/1.1 Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AIC2rAev-jE2xpYBVDIYCkCyyC6ZLz8-hAmpuM6aYkuCY85YQBXU3BdIaZZ6eMYlVDhKIs5WdQkHRc-ePNDpURj2xj8f_mh3l5hAQXomACxrbFjhO-oPnFpVwDiMfh-EerJNPQY8MVuw-PWnZx--m4OJ7crR36XCOGNQ8RpUguK1S0 Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 0211a3372bae447fbdfb4cb849a265d4 Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TestServerBasicOps-1509183090 Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0211a3372bae447fbdfb4cb849a265d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0211a3372bae447fbdfb4cb849a265d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0211a3372bae447fbdfb4cb849a265d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0211a3372bae447fbdfb4cb849a265d4"}]}] Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TestServerBasicOps-1509183090 Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 0211a3372bae447fbdfb4cb849a265d4 Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestServerBasicOps-1509183090 Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TestServerBasicOps-1509183090-project Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 2210ca1cd35f43e8bc4b10710c2900ed Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TestServerBasicOps-1509183090-project Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 4c54a751-dda6-452f-a556-028fdee6f15f could not be found. Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '4c54a751-dda6-452f-a556-028fdee6f15f'} Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c54a751-dda6-452f-a556-028fdee6f15f could not be found. Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c54a751-dda6-452f-a556-028fdee6f15f could not be found. Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:35:08.905411 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:35:08.909300 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:35:08.909300 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:35:08.909300 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:35:08.909300 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:35:08.909300 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:35:08.909300 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c54a751-dda6-452f-a556-028fdee6f15f could not be found. Aug 04 17:35:08.909300 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:35:08.912925 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ba1d7f2e-d13a-4607-ac60-5aa5e8bb1a4e tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Returning 404 to user: Instance 4c54a751-dda6-452f-a556-028fdee6f15f could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:35:08.914108 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ba1d7f2e-d13a-4607-ac60-5aa5e8bb1a4e tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] 10.222.0.93 "GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f" status: 404 len: 111 microversion: 2.1 time: 0.076711 Aug 04 17:35:08.918793 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3101/6228] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:08 2022] GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:35:09.878727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e83ad6fd-4096-4d3e-bd5b-1da9109ed6e0 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:09.879922 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e83ad6fd-4096-4d3e-bd5b-1da9109ed6e0 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] [instance: 4c54a751-dda6-452f-a556-028fdee6f15f] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:09.889111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e83ad6fd-4096-4d3e-bd5b-1da9109ed6e0 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:09.890214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e83ad6fd-4096-4d3e-bd5b-1da9109ed6e0 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:09.891331 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e83ad6fd-4096-4d3e-bd5b-1da9109ed6e0 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:09.892985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e83ad6fd-4096-4d3e-bd5b-1da9109ed6e0 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:09.893638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e83ad6fd-4096-4d3e-bd5b-1da9109ed6e0 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:09.894797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e83ad6fd-4096-4d3e-bd5b-1da9109ed6e0 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:09.924030 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-e83ad6fd-4096-4d3e-bd5b-1da9109ed6e0 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] HTTP exception thrown: Instance 4c54a751-dda6-452f-a556-028fdee6f15f could not be found. Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e83ad6fd-4096-4d3e-bd5b-1da9109ed6e0 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Request method failure captured: Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f HTTP/1.1 Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7AIC2rAev-jE2xpYBVDIYCkCyyC6ZLz8-hAmpuM6aYkuCY85YQBXU3BdIaZZ6eMYlVDhKIs5WdQkHRc-ePNDpURj2xj8f_mh3l5hAQXomACxrbFjhO-oPnFpVwDiMfh-EerJNPQY8MVuw-PWnZx--m4OJ7crR36XCOGNQ8RpUguK1S0 Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 0211a3372bae447fbdfb4cb849a265d4 Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-TestServerBasicOps-1509183090 Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0211a3372bae447fbdfb4cb849a265d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0211a3372bae447fbdfb4cb849a265d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0211a3372bae447fbdfb4cb849a265d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0211a3372bae447fbdfb4cb849a265d4"}]}] Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-TestServerBasicOps-1509183090 Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 0211a3372bae447fbdfb4cb849a265d4 Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-TestServerBasicOps-1509183090 Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-TestServerBasicOps-1509183090-project Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 2210ca1cd35f43e8bc4b10710c2900ed Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-TestServerBasicOps-1509183090-project Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 4c54a751-dda6-452f-a556-028fdee6f15f could not be found. Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '4c54a751-dda6-452f-a556-028fdee6f15f'} Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c54a751-dda6-452f-a556-028fdee6f15f could not be found. Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:35:09.927162 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:35:09.935435 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c54a751-dda6-452f-a556-028fdee6f15f could not be found. Aug 04 17:35:09.935435 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:35:09.935435 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:35:09.935435 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:35:09.935435 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:35:09.935435 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:35:09.935435 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:35:09.935435 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:35:09.935435 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:35:09.935435 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c54a751-dda6-452f-a556-028fdee6f15f could not be found. Aug 04 17:35:09.935435 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:35:09.935435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e83ad6fd-4096-4d3e-bd5b-1da9109ed6e0 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Returning 404 to user: Instance 4c54a751-dda6-452f-a556-028fdee6f15f could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:35:09.935435 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e83ad6fd-4096-4d3e-bd5b-1da9109ed6e0 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f" status: 404 len: 111 microversion: 2.1 time: 0.054918 Aug 04 17:35:09.935435 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3128/6229] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:35:09 2022] DELETE /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:35:09.940218 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fe2a4540-1a92-430a-890f-cfa16fcf3f71 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:09.941081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fe2a4540-1a92-430a-890f-cfa16fcf3f71 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] [instance: 4c54a751-dda6-452f-a556-028fdee6f15f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:09.949081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe2a4540-1a92-430a-890f-cfa16fcf3f71 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:09.949724 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe2a4540-1a92-430a-890f-cfa16fcf3f71 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:09.950307 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe2a4540-1a92-430a-890f-cfa16fcf3f71 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:09.951166 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe2a4540-1a92-430a-890f-cfa16fcf3f71 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:09.951754 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe2a4540-1a92-430a-890f-cfa16fcf3f71 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:09.952290 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe2a4540-1a92-430a-890f-cfa16fcf3f71 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:09.969477 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-fe2a4540-1a92-430a-890f-cfa16fcf3f71 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] HTTP exception thrown: Instance 4c54a751-dda6-452f-a556-028fdee6f15f could not be found. Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fe2a4540-1a92-430a-890f-cfa16fcf3f71 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Request method failure captured: Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f HTTP/1.1 Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AIC2rAev-jE2xpYBVDIYCkCyyC6ZLz8-hAmpuM6aYkuCY85YQBXU3BdIaZZ6eMYlVDhKIs5WdQkHRc-ePNDpURj2xj8f_mh3l5hAQXomACxrbFjhO-oPnFpVwDiMfh-EerJNPQY8MVuw-PWnZx--m4OJ7crR36XCOGNQ8RpUguK1S0 Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 0211a3372bae447fbdfb4cb849a265d4 Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TestServerBasicOps-1509183090 Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0211a3372bae447fbdfb4cb849a265d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0211a3372bae447fbdfb4cb849a265d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0211a3372bae447fbdfb4cb849a265d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0211a3372bae447fbdfb4cb849a265d4"}]}] Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TestServerBasicOps-1509183090 Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 0211a3372bae447fbdfb4cb849a265d4 Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestServerBasicOps-1509183090 Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TestServerBasicOps-1509183090-project Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 2210ca1cd35f43e8bc4b10710c2900ed Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TestServerBasicOps-1509183090-project Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 4c54a751-dda6-452f-a556-028fdee6f15f could not be found. Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '4c54a751-dda6-452f-a556-028fdee6f15f'} Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c54a751-dda6-452f-a556-028fdee6f15f could not be found. Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c54a751-dda6-452f-a556-028fdee6f15f could not be found. Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:35:09.974285 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:35:09.978599 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:35:09.978599 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:35:09.978599 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:35:09.978599 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:35:09.978599 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:35:09.978599 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c54a751-dda6-452f-a556-028fdee6f15f could not be found. Aug 04 17:35:09.978599 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:35:09.981641 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fe2a4540-1a92-430a-890f-cfa16fcf3f71 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Returning 404 to user: Instance 4c54a751-dda6-452f-a556-028fdee6f15f could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:35:09.982795 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fe2a4540-1a92-430a-890f-cfa16fcf3f71 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] 10.222.0.93 "GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f" status: 404 len: 111 microversion: 2.1 time: 0.048563 Aug 04 17:35:09.983898 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3102/6230] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:09 2022] GET /compute/v2.1/servers/4c54a751-dda6-452f-a556-028fdee6f15f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:35:10.216193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ab774ba0-cf72-4918-a2af-4f7ee07c0f95 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] Calling method '.version_select at 0x7f1e6caf4550>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:10.274055 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ab774ba0-cf72-4918-a2af-4f7ee07c0f95 tempest-TestServerBasicOps-1509183090 tempest-TestServerBasicOps-1509183090-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1890990777" status: 202 len: 0 microversion: 2.1 time: 0.064603 Aug 04 17:35:10.278841 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3129/6231] 10.222.0.93 () {58 vars in 1254 bytes} [Thu Aug 4 17:35:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1890990777 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:35:21.866385 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4a40081b-96a0-4760-847d-0690a488c449 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1158974916", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:35:21.899407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:35:21.900544 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:35:21.955297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-4a40081b-96a0-4760-847d-0690a488c449 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:35:22.211121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-4a40081b-96a0-4760-847d-0690a488c449 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:35:22.211751 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-4a40081b-96a0-4760-847d-0690a488c449 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:35:22.212230 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-4a40081b-96a0-4760-847d-0690a488c449 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:35:22.212636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-4a40081b-96a0-4760-847d-0690a488c449 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:35:22.213046 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-4a40081b-96a0-4760-847d-0690a488c449 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:35:22.224533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a40081b-96a0-4760-847d-0690a488c449 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:22.225199 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a40081b-96a0-4760-847d-0690a488c449 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:22.225646 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a40081b-96a0-4760-847d-0690a488c449 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:22.226417 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a40081b-96a0-4760-847d-0690a488c449 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:22.226914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a40081b-96a0-4760-847d-0690a488c449 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:22.227335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a40081b-96a0-4760-847d-0690a488c449 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:22.257499 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-4a40081b-96a0-4760-847d-0690a488c449 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Getting quotas for project 5e813f42a0294b2f821aefb760db376d. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:35:22.263601 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-4a40081b-96a0-4760-847d-0690a488c449 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Getting quotas for user 6900a48d2a2a4be182f166b577ad5497 and project 5e813f42a0294b2f821aefb760db376d. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:35:22.276913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4a40081b-96a0-4760-847d-0690a488c449 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:35:22.279263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4a40081b-96a0-4760-847d-0690a488c449 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] [instance: 89919c98-4850-485d-b23d-d92daba6cff8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:35:22.325947 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4a40081b-96a0-4760-847d-0690a488c449 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.471147 Aug 04 17:35:22.327315 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3103/6232] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:35:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 473 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:35:22.345489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4ba1c573-dbd6-492b-8d2a-7cffdfcee228 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:22.346686 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4ba1c573-dbd6-492b-8d2a-7cffdfcee228 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] [instance: 89919c98-4850-485d-b23d-d92daba6cff8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:22.355999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=48 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:35:22.357011 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:35:22.423155 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4ba1c573-dbd6-492b-8d2a-7cffdfcee228 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6900a48d2a2a4be182f166b577ad5497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e813f42a0294b2f821aefb760db376d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:22.432465 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4ba1c573-dbd6-492b-8d2a-7cffdfcee228 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] 10.222.0.93 "GET /compute/v2.1/servers/89919c98-4850-485d-b23d-d92daba6cff8" status: 200 len: 1215 microversion: 2.1 time: 0.098056 Aug 04 17:35:22.434654 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3130/6233] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:22 2022] GET /compute/v2.1/servers/89919c98-4850-485d-b23d-d92daba6cff8 => generated 1215 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:35:23.459211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d79f4800-e476-4535-b7b8-5d5f632a7076 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:23.460579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d79f4800-e476-4535-b7b8-5d5f632a7076 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] [instance: 89919c98-4850-485d-b23d-d92daba6cff8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:23.473595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d79f4800-e476-4535-b7b8-5d5f632a7076 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:23.474540 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d79f4800-e476-4535-b7b8-5d5f632a7076 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:23.475402 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d79f4800-e476-4535-b7b8-5d5f632a7076 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:23.476341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d79f4800-e476-4535-b7b8-5d5f632a7076 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:23.477018 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d79f4800-e476-4535-b7b8-5d5f632a7076 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:23.477662 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d79f4800-e476-4535-b7b8-5d5f632a7076 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:23.658118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d79f4800-e476-4535-b7b8-5d5f632a7076 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6900a48d2a2a4be182f166b577ad5497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e813f42a0294b2f821aefb760db376d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:23.669091 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d79f4800-e476-4535-b7b8-5d5f632a7076 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] 10.222.0.93 "GET /compute/v2.1/servers/89919c98-4850-485d-b23d-d92daba6cff8" status: 200 len: 1267 microversion: 2.1 time: 0.214918 Aug 04 17:35:23.670077 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3104/6234] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:23 2022] GET /compute/v2.1/servers/89919c98-4850-485d-b23d-d92daba6cff8 => generated 1267 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:24.709217 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5b32e0ca-b22f-42df-a49c-a7793401901b tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:24.714258 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5b32e0ca-b22f-42df-a49c-a7793401901b tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] [instance: 89919c98-4850-485d-b23d-d92daba6cff8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:24.723246 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b32e0ca-b22f-42df-a49c-a7793401901b tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:24.723767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b32e0ca-b22f-42df-a49c-a7793401901b tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:24.724385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b32e0ca-b22f-42df-a49c-a7793401901b tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:24.725140 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b32e0ca-b22f-42df-a49c-a7793401901b tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:24.726108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b32e0ca-b22f-42df-a49c-a7793401901b tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:24.726884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5b32e0ca-b22f-42df-a49c-a7793401901b tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:24.827056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5b32e0ca-b22f-42df-a49c-a7793401901b tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6900a48d2a2a4be182f166b577ad5497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e813f42a0294b2f821aefb760db376d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:24.834648 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5b32e0ca-b22f-42df-a49c-a7793401901b tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] 10.222.0.93 "GET /compute/v2.1/servers/89919c98-4850-485d-b23d-d92daba6cff8" status: 200 len: 1273 microversion: 2.1 time: 0.134776 Aug 04 17:35:24.835452 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3131/6235] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:24 2022] GET /compute/v2.1/servers/89919c98-4850-485d-b23d-d92daba6cff8 => generated 1273 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:25.859205 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-90301fae-5946-4fde-81b0-cf8b225b910e tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:25.860039 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-90301fae-5946-4fde-81b0-cf8b225b910e tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] [instance: 89919c98-4850-485d-b23d-d92daba6cff8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:25.878441 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90301fae-5946-4fde-81b0-cf8b225b910e tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:25.878828 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90301fae-5946-4fde-81b0-cf8b225b910e tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:25.879271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90301fae-5946-4fde-81b0-cf8b225b910e tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:25.879986 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90301fae-5946-4fde-81b0-cf8b225b910e tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:25.880443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90301fae-5946-4fde-81b0-cf8b225b910e tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:25.880871 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90301fae-5946-4fde-81b0-cf8b225b910e tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:26.350359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-90301fae-5946-4fde-81b0-cf8b225b910e tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6900a48d2a2a4be182f166b577ad5497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e813f42a0294b2f821aefb760db376d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:26.359765 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-90301fae-5946-4fde-81b0-cf8b225b910e tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] 10.222.0.93 "GET /compute/v2.1/servers/89919c98-4850-485d-b23d-d92daba6cff8" status: 200 len: 1315 microversion: 2.1 time: 0.506223 Aug 04 17:35:26.361025 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3105/6236] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:25 2022] GET /compute/v2.1/servers/89919c98-4850-485d-b23d-d92daba6cff8 => generated 1315 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:35:27.269997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-e34ccd5d-c5b5-4b45-8188-9245ac7cf432 req-80715ccd-dae0-4103-a2f0-fbdd7e3a2a24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89919c98-4850-485d-b23d-d92daba6cff8", "tag": "acf0f4f7-8623-4d45-913e-7b05bf3c716a"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:35:27.285454 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e34ccd5d-c5b5-4b45-8188-9245ac7cf432 req-80715ccd-dae0-4103-a2f0-fbdd7e3a2a24 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:27.287178 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e34ccd5d-c5b5-4b45-8188-9245ac7cf432 req-80715ccd-dae0-4103-a2f0-fbdd7e3a2a24 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:27.288006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e34ccd5d-c5b5-4b45-8188-9245ac7cf432 req-80715ccd-dae0-4103-a2f0-fbdd7e3a2a24 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:27.305903 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-e34ccd5d-c5b5-4b45-8188-9245ac7cf432 req-80715ccd-dae0-4103-a2f0-fbdd7e3a2a24 service nova] Creating event network-changed:acf0f4f7-8623-4d45-913e-7b05bf3c716a for instance 89919c98-4850-485d-b23d-d92daba6cff8 on n-h1-851359-3 Aug 04 17:35:27.312957 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-e34ccd5d-c5b5-4b45-8188-9245ac7cf432 req-80715ccd-dae0-4103-a2f0-fbdd7e3a2a24 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049405 Aug 04 17:35:27.313808 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3132/6237] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:35:27.384332 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-935f2b84-2515-4f15-b959-f4e963ce598e tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:27.385762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-935f2b84-2515-4f15-b959-f4e963ce598e tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] [instance: 89919c98-4850-485d-b23d-d92daba6cff8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:27.394009 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-935f2b84-2515-4f15-b959-f4e963ce598e tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:27.394935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-935f2b84-2515-4f15-b959-f4e963ce598e tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:27.395616 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-935f2b84-2515-4f15-b959-f4e963ce598e tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:27.396603 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-935f2b84-2515-4f15-b959-f4e963ce598e tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:27.397407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-935f2b84-2515-4f15-b959-f4e963ce598e tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:27.398103 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-935f2b84-2515-4f15-b959-f4e963ce598e tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:27.841236 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-935f2b84-2515-4f15-b959-f4e963ce598e tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6900a48d2a2a4be182f166b577ad5497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e813f42a0294b2f821aefb760db376d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:27.859877 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-935f2b84-2515-4f15-b959-f4e963ce598e tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] 10.222.0.93 "GET /compute/v2.1/servers/89919c98-4850-485d-b23d-d92daba6cff8" status: 200 len: 1315 microversion: 2.1 time: 0.479388 Aug 04 17:35:27.866722 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3106/6238] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:27 2022] GET /compute/v2.1/servers/89919c98-4850-485d-b23d-d92daba6cff8 => generated 1315 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:28.894993 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bb8fd5f5-e5ae-4583-bf4b-199370691aba tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:28.895723 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bb8fd5f5-e5ae-4583-bf4b-199370691aba tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] [instance: 89919c98-4850-485d-b23d-d92daba6cff8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:28.908597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bb8fd5f5-e5ae-4583-bf4b-199370691aba tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:28.909424 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bb8fd5f5-e5ae-4583-bf4b-199370691aba tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:28.910114 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bb8fd5f5-e5ae-4583-bf4b-199370691aba tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:28.911065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bb8fd5f5-e5ae-4583-bf4b-199370691aba tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:28.911539 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bb8fd5f5-e5ae-4583-bf4b-199370691aba tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:28.911973 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bb8fd5f5-e5ae-4583-bf4b-199370691aba tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:29.204836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bb8fd5f5-e5ae-4583-bf4b-199370691aba tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6900a48d2a2a4be182f166b577ad5497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e813f42a0294b2f821aefb760db376d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:29.215574 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bb8fd5f5-e5ae-4583-bf4b-199370691aba tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] 10.222.0.93 "GET /compute/v2.1/servers/89919c98-4850-485d-b23d-d92daba6cff8" status: 200 len: 1315 microversion: 2.1 time: 0.326928 Aug 04 17:35:29.228102 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3133/6239] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:28 2022] GET /compute/v2.1/servers/89919c98-4850-485d-b23d-d92daba6cff8 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:30.252553 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ce327007-6e61-4e27-a45c-c4b1aaba9840 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:30.254474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ce327007-6e61-4e27-a45c-c4b1aaba9840 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] [instance: 89919c98-4850-485d-b23d-d92daba6cff8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:30.270498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce327007-6e61-4e27-a45c-c4b1aaba9840 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:30.271351 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce327007-6e61-4e27-a45c-c4b1aaba9840 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:30.272193 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce327007-6e61-4e27-a45c-c4b1aaba9840 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:30.273492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce327007-6e61-4e27-a45c-c4b1aaba9840 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:30.274409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce327007-6e61-4e27-a45c-c4b1aaba9840 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:30.275220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce327007-6e61-4e27-a45c-c4b1aaba9840 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:30.523012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ce327007-6e61-4e27-a45c-c4b1aaba9840 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6900a48d2a2a4be182f166b577ad5497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e813f42a0294b2f821aefb760db376d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:30.538396 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ce327007-6e61-4e27-a45c-c4b1aaba9840 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] 10.222.0.93 "GET /compute/v2.1/servers/89919c98-4850-485d-b23d-d92daba6cff8" status: 200 len: 1315 microversion: 2.1 time: 0.293106 Aug 04 17:35:30.539207 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3107/6240] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:30 2022] GET /compute/v2.1/servers/89919c98-4850-485d-b23d-d92daba6cff8 => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:31.560982 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1a59c4e6-61bb-4e6c-a263-5d9d118a919b tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:31.561614 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1a59c4e6-61bb-4e6c-a263-5d9d118a919b tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] [instance: 89919c98-4850-485d-b23d-d92daba6cff8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:31.580036 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a59c4e6-61bb-4e6c-a263-5d9d118a919b tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:31.580722 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a59c4e6-61bb-4e6c-a263-5d9d118a919b tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:31.581374 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a59c4e6-61bb-4e6c-a263-5d9d118a919b tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:31.582373 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a59c4e6-61bb-4e6c-a263-5d9d118a919b tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:31.583275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a59c4e6-61bb-4e6c-a263-5d9d118a919b tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:31.583937 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1a59c4e6-61bb-4e6c-a263-5d9d118a919b tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:31.943120 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1a59c4e6-61bb-4e6c-a263-5d9d118a919b tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6900a48d2a2a4be182f166b577ad5497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e813f42a0294b2f821aefb760db376d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:31.954525 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1a59c4e6-61bb-4e6c-a263-5d9d118a919b tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] 10.222.0.93 "GET /compute/v2.1/servers/89919c98-4850-485d-b23d-d92daba6cff8" status: 200 len: 1315 microversion: 2.1 time: 0.397089 Aug 04 17:35:31.965422 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3134/6241] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:31 2022] GET /compute/v2.1/servers/89919c98-4850-485d-b23d-d92daba6cff8 => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:35:32.981895 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4ba13690-ef33-450c-8f48-ad127bab3e12 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:32.983141 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4ba13690-ef33-450c-8f48-ad127bab3e12 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] [instance: 89919c98-4850-485d-b23d-d92daba6cff8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:32.987239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:35:32.990673 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:35:33.012945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ba13690-ef33-450c-8f48-ad127bab3e12 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:33.013446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ba13690-ef33-450c-8f48-ad127bab3e12 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:33.013884 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ba13690-ef33-450c-8f48-ad127bab3e12 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:33.014623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ba13690-ef33-450c-8f48-ad127bab3e12 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:33.022815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ba13690-ef33-450c-8f48-ad127bab3e12 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:33.023527 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ba13690-ef33-450c-8f48-ad127bab3e12 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:33.337137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-d9b691fc-a3bd-44f3-bd73-ca4c282cd897 req-602666e2-7f4f-4c7f-93bb-04d7f55cc9e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89919c98-4850-485d-b23d-d92daba6cff8", "name": "network-vif-plugged", "status": "completed", "tag": "acf0f4f7-8623-4d45-913e-7b05bf3c716a"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:35:33.350737 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:35:33.354738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d9b691fc-a3bd-44f3-bd73-ca4c282cd897 req-602666e2-7f4f-4c7f-93bb-04d7f55cc9e1 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:33.355646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d9b691fc-a3bd-44f3-bd73-ca4c282cd897 req-602666e2-7f4f-4c7f-93bb-04d7f55cc9e1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:33.356321 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d9b691fc-a3bd-44f3-bd73-ca4c282cd897 req-602666e2-7f4f-4c7f-93bb-04d7f55cc9e1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:33.390344 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-d9b691fc-a3bd-44f3-bd73-ca4c282cd897 req-602666e2-7f4f-4c7f-93bb-04d7f55cc9e1 service nova] Creating event network-vif-plugged:acf0f4f7-8623-4d45-913e-7b05bf3c716a for instance 89919c98-4850-485d-b23d-d92daba6cff8 on n-h1-851359-3 Aug 04 17:35:33.400628 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-d9b691fc-a3bd-44f3-bd73-ca4c282cd897 req-602666e2-7f4f-4c7f-93bb-04d7f55cc9e1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068714 Aug 04 17:35:33.401856 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3135/6242] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:35:33.419775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4ba13690-ef33-450c-8f48-ad127bab3e12 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6900a48d2a2a4be182f166b577ad5497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e813f42a0294b2f821aefb760db376d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:33.430225 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4ba13690-ef33-450c-8f48-ad127bab3e12 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] 10.222.0.93 "GET /compute/v2.1/servers/89919c98-4850-485d-b23d-d92daba6cff8" status: 200 len: 1315 microversion: 2.1 time: 0.453226 Aug 04 17:35:33.433351 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3108/6243] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:32 2022] GET /compute/v2.1/servers/89919c98-4850-485d-b23d-d92daba6cff8 => generated 1315 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:34.460736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b3ed9c46-fa9a-4e1d-99ae-ee3066ba2abd tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:34.463621 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b3ed9c46-fa9a-4e1d-99ae-ee3066ba2abd tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] [instance: 89919c98-4850-485d-b23d-d92daba6cff8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:34.491421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3ed9c46-fa9a-4e1d-99ae-ee3066ba2abd tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:34.491948 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3ed9c46-fa9a-4e1d-99ae-ee3066ba2abd tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:34.492406 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3ed9c46-fa9a-4e1d-99ae-ee3066ba2abd tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:34.493147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3ed9c46-fa9a-4e1d-99ae-ee3066ba2abd tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:34.493615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3ed9c46-fa9a-4e1d-99ae-ee3066ba2abd tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:34.497298 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3ed9c46-fa9a-4e1d-99ae-ee3066ba2abd tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:35.055824 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b3ed9c46-fa9a-4e1d-99ae-ee3066ba2abd tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6900a48d2a2a4be182f166b577ad5497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e813f42a0294b2f821aefb760db376d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:35.069915 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b3ed9c46-fa9a-4e1d-99ae-ee3066ba2abd tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] 10.222.0.93 "GET /compute/v2.1/servers/89919c98-4850-485d-b23d-d92daba6cff8" status: 200 len: 1315 microversion: 2.1 time: 0.621637 Aug 04 17:35:35.071962 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3136/6244] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:34 2022] GET /compute/v2.1/servers/89919c98-4850-485d-b23d-d92daba6cff8 => generated 1315 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:36.092369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-96316913-6830-497e-967d-871e32221a44 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:36.093016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-96316913-6830-497e-967d-871e32221a44 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] [instance: 89919c98-4850-485d-b23d-d92daba6cff8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:36.107299 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96316913-6830-497e-967d-871e32221a44 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:36.107816 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96316913-6830-497e-967d-871e32221a44 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:36.108294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96316913-6830-497e-967d-871e32221a44 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:36.109073 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96316913-6830-497e-967d-871e32221a44 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:36.109562 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96316913-6830-497e-967d-871e32221a44 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:36.110086 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96316913-6830-497e-967d-871e32221a44 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:36.349452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-96316913-6830-497e-967d-871e32221a44 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6900a48d2a2a4be182f166b577ad5497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e813f42a0294b2f821aefb760db376d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:36.358549 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-96316913-6830-497e-967d-871e32221a44 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] 10.222.0.93 "GET /compute/v2.1/servers/89919c98-4850-485d-b23d-d92daba6cff8" status: 200 len: 1465 microversion: 2.1 time: 0.270659 Aug 04 17:35:36.376170 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3109/6245] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:36 2022] GET /compute/v2.1/servers/89919c98-4850-485d-b23d-d92daba6cff8 => generated 1465 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:36.455223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-37661110-3783-4e8e-8b95-a08b79ecdd48 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:36.456459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-37661110-3783-4e8e-8b95-a08b79ecdd48 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] [instance: 89919c98-4850-485d-b23d-d92daba6cff8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:36.463938 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37661110-3783-4e8e-8b95-a08b79ecdd48 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:36.466135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37661110-3783-4e8e-8b95-a08b79ecdd48 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:36.466909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37661110-3783-4e8e-8b95-a08b79ecdd48 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:36.468596 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37661110-3783-4e8e-8b95-a08b79ecdd48 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:36.469299 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37661110-3783-4e8e-8b95-a08b79ecdd48 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:36.469929 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37661110-3783-4e8e-8b95-a08b79ecdd48 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:36.510331 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-37661110-3783-4e8e-8b95-a08b79ecdd48 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] [instance: 89919c98-4850-485d-b23d-d92daba6cff8] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:35:36.721804 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-37661110-3783-4e8e-8b95-a08b79ecdd48 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] 10.222.0.93 "DELETE /compute/v2.1/servers/89919c98-4850-485d-b23d-d92daba6cff8" status: 204 len: 0 microversion: 2.1 time: 0.269860 Aug 04 17:35:36.737245 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3137/6246] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:35:36 2022] DELETE /compute/v2.1/servers/89919c98-4850-485d-b23d-d92daba6cff8 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:35:36.742334 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8b1e11d7-4471-4723-85dd-36049ec783d7 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:36.743045 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8b1e11d7-4471-4723-85dd-36049ec783d7 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] [instance: 89919c98-4850-485d-b23d-d92daba6cff8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:36.749815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b1e11d7-4471-4723-85dd-36049ec783d7 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:36.750401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b1e11d7-4471-4723-85dd-36049ec783d7 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:36.750927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b1e11d7-4471-4723-85dd-36049ec783d7 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:36.751749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b1e11d7-4471-4723-85dd-36049ec783d7 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:36.752282 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b1e11d7-4471-4723-85dd-36049ec783d7 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:36.752744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b1e11d7-4471-4723-85dd-36049ec783d7 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:36.968681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8b1e11d7-4471-4723-85dd-36049ec783d7 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6900a48d2a2a4be182f166b577ad5497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e813f42a0294b2f821aefb760db376d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:36.977639 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8b1e11d7-4471-4723-85dd-36049ec783d7 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] 10.222.0.93 "GET /compute/v2.1/servers/89919c98-4850-485d-b23d-d92daba6cff8" status: 200 len: 1471 microversion: 2.1 time: 0.239682 Aug 04 17:35:36.978881 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3110/6247] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:36 2022] GET /compute/v2.1/servers/89919c98-4850-485d-b23d-d92daba6cff8 => generated 1471 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:38.002169 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-de950aa7-069d-41d7-b788-34a0c700d50c tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:38.003132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-de950aa7-069d-41d7-b788-34a0c700d50c tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] [instance: 89919c98-4850-485d-b23d-d92daba6cff8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:38.012938 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de950aa7-069d-41d7-b788-34a0c700d50c tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:38.015158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de950aa7-069d-41d7-b788-34a0c700d50c tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:38.016044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de950aa7-069d-41d7-b788-34a0c700d50c tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:38.021186 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de950aa7-069d-41d7-b788-34a0c700d50c tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:38.021964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de950aa7-069d-41d7-b788-34a0c700d50c tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:38.022825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de950aa7-069d-41d7-b788-34a0c700d50c tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:38.259820 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-de950aa7-069d-41d7-b788-34a0c700d50c tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6900a48d2a2a4be182f166b577ad5497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e813f42a0294b2f821aefb760db376d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:38.271513 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-de950aa7-069d-41d7-b788-34a0c700d50c tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] 10.222.0.93 "GET /compute/v2.1/servers/89919c98-4850-485d-b23d-d92daba6cff8" status: 200 len: 1471 microversion: 2.1 time: 0.275147 Aug 04 17:35:38.272290 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3138/6248] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:37 2022] GET /compute/v2.1/servers/89919c98-4850-485d-b23d-d92daba6cff8 => generated 1471 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:39.294585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-890a1f36-bb17-4096-8460-c2ed79145663 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:39.295419 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-890a1f36-bb17-4096-8460-c2ed79145663 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] [instance: 89919c98-4850-485d-b23d-d92daba6cff8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:39.306515 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-890a1f36-bb17-4096-8460-c2ed79145663 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:39.306942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-890a1f36-bb17-4096-8460-c2ed79145663 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:39.309670 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-890a1f36-bb17-4096-8460-c2ed79145663 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:39.311509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-890a1f36-bb17-4096-8460-c2ed79145663 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:39.313962 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-890a1f36-bb17-4096-8460-c2ed79145663 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:39.315988 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-890a1f36-bb17-4096-8460-c2ed79145663 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:39.759263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-95e4fc63-f129-4270-bb71-61d6e6e1e1b0 req-a5cc97af-3f57-48e2-b5e9-07ef321c54fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89919c98-4850-485d-b23d-d92daba6cff8", "name": "network-vif-deleted", "tag": "acf0f4f7-8623-4d45-913e-7b05bf3c716a"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:35:39.794427 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-890a1f36-bb17-4096-8460-c2ed79145663 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6900a48d2a2a4be182f166b577ad5497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e813f42a0294b2f821aefb760db376d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:39.836264 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-890a1f36-bb17-4096-8460-c2ed79145663 tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] 10.222.0.93 "GET /compute/v2.1/servers/89919c98-4850-485d-b23d-d92daba6cff8" status: 200 len: 1471 microversion: 2.1 time: 0.547146 Aug 04 17:35:39.836889 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3111/6249] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:39 2022] GET /compute/v2.1/servers/89919c98-4850-485d-b23d-d92daba6cff8 => generated 1471 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:39.839299 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-95e4fc63-f129-4270-bb71-61d6e6e1e1b0 req-a5cc97af-3f57-48e2-b5e9-07ef321c54fc service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:39.855160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-95e4fc63-f129-4270-bb71-61d6e6e1e1b0 req-a5cc97af-3f57-48e2-b5e9-07ef321c54fc service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:39.857445 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-95e4fc63-f129-4270-bb71-61d6e6e1e1b0 req-a5cc97af-3f57-48e2-b5e9-07ef321c54fc service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:39.888777 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-95e4fc63-f129-4270-bb71-61d6e6e1e1b0 req-a5cc97af-3f57-48e2-b5e9-07ef321c54fc service nova] Creating event network-vif-deleted:acf0f4f7-8623-4d45-913e-7b05bf3c716a for instance 89919c98-4850-485d-b23d-d92daba6cff8 on n-h1-851359-3 Aug 04 17:35:39.910990 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-95e4fc63-f129-4270-bb71-61d6e6e1e1b0 req-a5cc97af-3f57-48e2-b5e9-07ef321c54fc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154871 Aug 04 17:35:39.915940 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3139/6250] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:35:40.862900 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cb4d3747-85ea-42a2-8a42-04d5dd26b1eb tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:40.866111 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cb4d3747-85ea-42a2-8a42-04d5dd26b1eb tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] [instance: 89919c98-4850-485d-b23d-d92daba6cff8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:40.903410 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb4d3747-85ea-42a2-8a42-04d5dd26b1eb tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:40.904554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb4d3747-85ea-42a2-8a42-04d5dd26b1eb tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:40.909235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb4d3747-85ea-42a2-8a42-04d5dd26b1eb tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:40.910183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb4d3747-85ea-42a2-8a42-04d5dd26b1eb tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:40.917176 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb4d3747-85ea-42a2-8a42-04d5dd26b1eb tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:40.918762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb4d3747-85ea-42a2-8a42-04d5dd26b1eb tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:40.975204 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-cb4d3747-85ea-42a2-8a42-04d5dd26b1eb tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] HTTP exception thrown: Instance 89919c98-4850-485d-b23d-d92daba6cff8 could not be found. Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cb4d3747-85ea-42a2-8a42-04d5dd26b1eb tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Request method failure captured: Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/89919c98-4850-485d-b23d-d92daba6cff8 HTTP/1.1 Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7ANXU2W9ZbjiKkOZeLtRYq14gb59ZeSgly2a7YCERc9eJaBXUIPmYJI6-CLK8MlYbjmm6PrKjDFQ-IE5YOvwI5Zh_IGBHkA-lX07-lYgY9pRPPgHgH3MQd7RMQNlDJ-SQ1poR2-m9wpacr71l-sDMJMBxG55-4eaMO8hpb97tb7kOlk Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 5e813f42a0294b2f821aefb760db376d Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-VolumesNegativeTest-466473287 Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5e813f42a0294b2f821aefb760db376d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5e813f42a0294b2f821aefb760db376d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5e813f42a0294b2f821aefb760db376d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5e813f42a0294b2f821aefb760db376d"}]}] Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-VolumesNegativeTest-466473287 Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 5e813f42a0294b2f821aefb760db376d Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-VolumesNegativeTest-466473287 Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-VolumesNegativeTest-466473287-project Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 6900a48d2a2a4be182f166b577ad5497 Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-VolumesNegativeTest-466473287-project Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 89919c98-4850-485d-b23d-d92daba6cff8 could not be found. Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '89919c98-4850-485d-b23d-d92daba6cff8'} Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89919c98-4850-485d-b23d-d92daba6cff8 could not be found. Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89919c98-4850-485d-b23d-d92daba6cff8 could not be found. Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:35:40.990193 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:35:41.002208 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:35:41.002208 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:35:41.002208 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:35:41.002208 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:35:41.002208 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:35:41.002208 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89919c98-4850-485d-b23d-d92daba6cff8 could not be found. Aug 04 17:35:41.002208 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:35:41.002208 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cb4d3747-85ea-42a2-8a42-04d5dd26b1eb tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] Returning 404 to user: Instance 89919c98-4850-485d-b23d-d92daba6cff8 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:35:41.002208 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cb4d3747-85ea-42a2-8a42-04d5dd26b1eb tempest-VolumesNegativeTest-466473287 tempest-VolumesNegativeTest-466473287-project] 10.222.0.93 "GET /compute/v2.1/servers/89919c98-4850-485d-b23d-d92daba6cff8" status: 404 len: 111 microversion: 2.1 time: 0.138678 Aug 04 17:35:41.002208 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3112/6251] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:40 2022] GET /compute/v2.1/servers/89919c98-4850-485d-b23d-d92daba6cff8 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:35:43.062814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f45706e0-2846-4cca-8939-2ca1a392d310 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:43.063720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f45706e0-2846-4cca-8939-2ca1a392d310 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] [instance: b49bddcd-130e-4ef2-b627-4d5c84740e36] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:43.082796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f45706e0-2846-4cca-8939-2ca1a392d310 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:43.083385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f45706e0-2846-4cca-8939-2ca1a392d310 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:43.084452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f45706e0-2846-4cca-8939-2ca1a392d310 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:43.087593 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f45706e0-2846-4cca-8939-2ca1a392d310 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:43.088194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f45706e0-2846-4cca-8939-2ca1a392d310 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:43.088722 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f45706e0-2846-4cca-8939-2ca1a392d310 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:43.226597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-f45706e0-2846-4cca-8939-2ca1a392d310 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lazy-loading 'services' on Instance uuid b49bddcd-130e-4ef2-b627-4d5c84740e36 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:35:43.376627 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f45706e0-2846-4cca-8939-2ca1a392d310 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36/os-volume_attachments/ada1f906-a60d-4ece-9230-f6be8998adc6" status: 202 len: 0 microversion: 2.1 time: 0.320186 Aug 04 17:35:43.377443 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3140/6252] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Aug 4 17:35:43 2022] DELETE /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36/os-volume_attachments/ada1f906-a60d-4ece-9230-f6be8998adc6 => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 17:35:43.643983 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b6e63899-0ba5-42c9-8753-8c9a36362c73 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:43.644498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b6e63899-0ba5-42c9-8753-8c9a36362c73 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 027e0611-05ee-493f-a704-7e2d2d2bd50c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:43.655178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6e63899-0ba5-42c9-8753-8c9a36362c73 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:43.655753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6e63899-0ba5-42c9-8753-8c9a36362c73 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:43.661005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6e63899-0ba5-42c9-8753-8c9a36362c73 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:43.662092 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6e63899-0ba5-42c9-8753-8c9a36362c73 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:43.662739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6e63899-0ba5-42c9-8753-8c9a36362c73 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:43.663337 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6e63899-0ba5-42c9-8753-8c9a36362c73 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:43.703277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b6e63899-0ba5-42c9-8753-8c9a36362c73 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 027e0611-05ee-493f-a704-7e2d2d2bd50c] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:35:43.806755 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b6e63899-0ba5-42c9-8753-8c9a36362c73 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "DELETE /compute/v2.1/servers/027e0611-05ee-493f-a704-7e2d2d2bd50c" status: 204 len: 0 microversion: 2.1 time: 0.165508 Aug 04 17:35:43.808208 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3113/6253] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:35:43 2022] DELETE /compute/v2.1/servers/027e0611-05ee-493f-a704-7e2d2d2bd50c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:35:43.820179 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-239ddd9b-1685-4916-b56f-7dd743b443fc tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:43.821281 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-239ddd9b-1685-4916-b56f-7dd743b443fc tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 027e0611-05ee-493f-a704-7e2d2d2bd50c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:43.829849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-239ddd9b-1685-4916-b56f-7dd743b443fc tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:43.831043 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-239ddd9b-1685-4916-b56f-7dd743b443fc tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:43.831999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-239ddd9b-1685-4916-b56f-7dd743b443fc tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:43.833012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-239ddd9b-1685-4916-b56f-7dd743b443fc tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:43.833753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-239ddd9b-1685-4916-b56f-7dd743b443fc tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:43.834441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-239ddd9b-1685-4916-b56f-7dd743b443fc tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:44.118326 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-239ddd9b-1685-4916-b56f-7dd743b443fc tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:44.137958 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-239ddd9b-1685-4916-b56f-7dd743b443fc tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/027e0611-05ee-493f-a704-7e2d2d2bd50c" status: 200 len: 1552 microversion: 2.1 time: 0.323199 Aug 04 17:35:44.155744 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3141/6254] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:43 2022] GET /compute/v2.1/servers/027e0611-05ee-493f-a704-7e2d2d2bd50c => generated 1552 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:35:45.186793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0f771559-0bc4-4923-b939-9481a66e689f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:45.189339 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0f771559-0bc4-4923-b939-9481a66e689f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 027e0611-05ee-493f-a704-7e2d2d2bd50c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:45.205913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f771559-0bc4-4923-b939-9481a66e689f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:45.206962 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f771559-0bc4-4923-b939-9481a66e689f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:45.211656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f771559-0bc4-4923-b939-9481a66e689f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:45.213199 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f771559-0bc4-4923-b939-9481a66e689f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:45.215584 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f771559-0bc4-4923-b939-9481a66e689f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:45.217031 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f771559-0bc4-4923-b939-9481a66e689f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:45.737510 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0f771559-0bc4-4923-b939-9481a66e689f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:45.752994 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0f771559-0bc4-4923-b939-9481a66e689f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/027e0611-05ee-493f-a704-7e2d2d2bd50c" status: 200 len: 1552 microversion: 2.1 time: 0.573350 Aug 04 17:35:45.753665 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3114/6255] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:45 2022] GET /compute/v2.1/servers/027e0611-05ee-493f-a704-7e2d2d2bd50c => generated 1552 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:46.282095 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-ab9585a7-6623-49d3-882e-695a8d602286 req-4129585c-2771-4c90-b79b-1c18bdd2f96b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "027e0611-05ee-493f-a704-7e2d2d2bd50c", "name": "network-vif-deleted", "tag": "eefd7d9f-8f1f-48ce-a8f7-7cea54d51d63"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:35:46.297469 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ab9585a7-6623-49d3-882e-695a8d602286 req-4129585c-2771-4c90-b79b-1c18bdd2f96b service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:46.299200 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ab9585a7-6623-49d3-882e-695a8d602286 req-4129585c-2771-4c90-b79b-1c18bdd2f96b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:46.299988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ab9585a7-6623-49d3-882e-695a8d602286 req-4129585c-2771-4c90-b79b-1c18bdd2f96b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:46.327359 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-ab9585a7-6623-49d3-882e-695a8d602286 req-4129585c-2771-4c90-b79b-1c18bdd2f96b service nova] Creating event network-vif-deleted:eefd7d9f-8f1f-48ce-a8f7-7cea54d51d63 for instance 027e0611-05ee-493f-a704-7e2d2d2bd50c on n-h2-851359-3 Aug 04 17:35:46.355686 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-ab9585a7-6623-49d3-882e-695a8d602286 req-4129585c-2771-4c90-b79b-1c18bdd2f96b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078072 Aug 04 17:35:46.357503 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3142/6256] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:35:46.782872 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eac9adee-fb05-4282-b6ea-e7edcfd3993f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:46.787631 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eac9adee-fb05-4282-b6ea-e7edcfd3993f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 027e0611-05ee-493f-a704-7e2d2d2bd50c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:46.804161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eac9adee-fb05-4282-b6ea-e7edcfd3993f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:46.804161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eac9adee-fb05-4282-b6ea-e7edcfd3993f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:46.810765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eac9adee-fb05-4282-b6ea-e7edcfd3993f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:46.814137 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eac9adee-fb05-4282-b6ea-e7edcfd3993f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:46.817317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eac9adee-fb05-4282-b6ea-e7edcfd3993f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:46.818219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eac9adee-fb05-4282-b6ea-e7edcfd3993f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:46.935516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eac9adee-fb05-4282-b6ea-e7edcfd3993f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:46.937748 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eac9adee-fb05-4282-b6ea-e7edcfd3993f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:46.938654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eac9adee-fb05-4282-b6ea-e7edcfd3993f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:46.939200 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-eac9adee-fb05-4282-b6ea-e7edcfd3993f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lazy-loading 'fault' on Instance uuid 027e0611-05ee-493f-a704-7e2d2d2bd50c {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:35:47.015981 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eac9adee-fb05-4282-b6ea-e7edcfd3993f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:47.032691 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eac9adee-fb05-4282-b6ea-e7edcfd3993f tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/027e0611-05ee-493f-a704-7e2d2d2bd50c" status: 200 len: 1338 microversion: 2.1 time: 0.261055 Aug 04 17:35:47.033616 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3115/6257] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:46 2022] GET /compute/v2.1/servers/027e0611-05ee-493f-a704-7e2d2d2bd50c => generated 1338 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:48.059672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2a5273f3-d3b6-4755-9285-a257430e5f41 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:48.060430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2a5273f3-d3b6-4755-9285-a257430e5f41 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 027e0611-05ee-493f-a704-7e2d2d2bd50c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:48.072816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2a5273f3-d3b6-4755-9285-a257430e5f41 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:48.073886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2a5273f3-d3b6-4755-9285-a257430e5f41 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:48.074900 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2a5273f3-d3b6-4755-9285-a257430e5f41 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:48.076639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2a5273f3-d3b6-4755-9285-a257430e5f41 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:48.077675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2a5273f3-d3b6-4755-9285-a257430e5f41 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:48.078631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2a5273f3-d3b6-4755-9285-a257430e5f41 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:48.104558 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-2a5273f3-d3b6-4755-9285-a257430e5f41 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] HTTP exception thrown: Instance 027e0611-05ee-493f-a704-7e2d2d2bd50c could not be found. Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2a5273f3-d3b6-4755-9285-a257430e5f41 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Request method failure captured: Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/027e0611-05ee-493f-a704-7e2d2d2bd50c HTTP/1.1 Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7ALNwJzdvv-vVzeBqjdd1xxJGJlBQSaBQjhZzdfpzzAM1Exn4TSYyHR4eP3Y8F9RpJZhul7UCjhtoKbfztFRuNFsrovyv0HUoevOq_nJpbMqsGWIVWHcIJbaI6vcXQCg-EH61jNq0OSe2Nfb0Zlf4DeRcGi3nHBudbsh89L5Rc1zFsY Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 12b4e49789d84ae29c3278fcb2303508 Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-TestNetworkBasicOps-1491327378 Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/12b4e49789d84ae29c3278fcb2303508"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/12b4e49789d84ae29c3278fcb2303508"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_12b4e49789d84ae29c3278fcb2303508"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/12b4e49789d84ae29c3278fcb2303508"}]}] Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-TestNetworkBasicOps-1491327378 Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 12b4e49789d84ae29c3278fcb2303508 Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-TestNetworkBasicOps-1491327378 Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-TestNetworkBasicOps-1491327378-project Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 55283f1fd1af42ef87ee70f1554b0f6e Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-TestNetworkBasicOps-1491327378-project Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 027e0611-05ee-493f-a704-7e2d2d2bd50c could not be found. Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '027e0611-05ee-493f-a704-7e2d2d2bd50c'} Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 027e0611-05ee-493f-a704-7e2d2d2bd50c could not be found. Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 027e0611-05ee-493f-a704-7e2d2d2bd50c could not be found. Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:35:48.107236 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:35:48.111911 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:35:48.111911 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:35:48.111911 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:35:48.111911 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:35:48.111911 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:35:48.111911 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 027e0611-05ee-493f-a704-7e2d2d2bd50c could not be found. Aug 04 17:35:48.111911 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:35:48.113360 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2a5273f3-d3b6-4755-9285-a257430e5f41 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Returning 404 to user: Instance 027e0611-05ee-493f-a704-7e2d2d2bd50c could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:35:48.114296 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2a5273f3-d3b6-4755-9285-a257430e5f41 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/027e0611-05ee-493f-a704-7e2d2d2bd50c" status: 404 len: 111 microversion: 2.1 time: 0.059125 Aug 04 17:35:48.114884 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3143/6258] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:48 2022] GET /compute/v2.1/servers/027e0611-05ee-493f-a704-7e2d2d2bd50c => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:35:48.423734 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1381d113-1229-4a5e-bd93-34573493371e tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '.version_select at 0x7f1e5abe0790>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:48.471145 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1381d113-1229-4a5e-bd93-34573493371e tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1337893055" status: 202 len: 0 microversion: 2.1 time: 0.051337 Aug 04 17:35:48.471998 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3116/6259] 10.222.0.93 () {58 vars in 1257 bytes} [Thu Aug 4 17:35:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1337893055 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:35:50.542347 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2d27509c-1158-457d-894f-4cdca7dc98f4 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:50.545621 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2d27509c-1158-457d-894f-4cdca7dc98f4 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] [instance: b49bddcd-130e-4ef2-b627-4d5c84740e36] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:50.577139 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d27509c-1158-457d-894f-4cdca7dc98f4 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:50.577296 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d27509c-1158-457d-894f-4cdca7dc98f4 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:50.580176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d27509c-1158-457d-894f-4cdca7dc98f4 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:50.586327 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d27509c-1158-457d-894f-4cdca7dc98f4 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:50.594693 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d27509c-1158-457d-894f-4cdca7dc98f4 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:50.595720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2d27509c-1158-457d-894f-4cdca7dc98f4 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:50.645844 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2d27509c-1158-457d-894f-4cdca7dc98f4 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] [instance: b49bddcd-130e-4ef2-b627-4d5c84740e36] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:35:50.806438 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2d27509c-1158-457d-894f-4cdca7dc98f4 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36" status: 204 len: 0 microversion: 2.1 time: 0.268134 Aug 04 17:35:50.807401 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3144/6260] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:35:50 2022] DELETE /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 17:35:50.820573 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0b8d067c-4b4c-41aa-9661-16e7e63007c0 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:50.821936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0b8d067c-4b4c-41aa-9661-16e7e63007c0 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] [instance: b49bddcd-130e-4ef2-b627-4d5c84740e36] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:50.832353 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b8d067c-4b4c-41aa-9661-16e7e63007c0 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:50.833127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b8d067c-4b4c-41aa-9661-16e7e63007c0 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:50.833778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b8d067c-4b4c-41aa-9661-16e7e63007c0 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:50.834752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b8d067c-4b4c-41aa-9661-16e7e63007c0 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:50.835608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b8d067c-4b4c-41aa-9661-16e7e63007c0 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:50.836690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b8d067c-4b4c-41aa-9661-16e7e63007c0 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:51.051726 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0b8d067c-4b4c-41aa-9661-16e7e63007c0 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffc50d4aa8047a1a1a18dd97c395431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0374197b78be4d8daf63e8b0dfc4e227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:51.062482 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0b8d067c-4b4c-41aa-9661-16e7e63007c0 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] 10.222.0.93 "GET /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36" status: 200 len: 1469 microversion: 2.1 time: 0.249824 Aug 04 17:35:51.064244 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3117/6261] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:50 2022] GET /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36 => generated 1469 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:51.330202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-721ef9b0-214d-4e65-bd29-caef52dcaf7d tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:51.330904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-721ef9b0-214d-4e65-bd29-caef52dcaf7d tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 89300174-0a17-4f0f-bfd5-40d472ae38a7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:51.352342 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-721ef9b0-214d-4e65-bd29-caef52dcaf7d tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:51.352934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-721ef9b0-214d-4e65-bd29-caef52dcaf7d tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:51.353484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-721ef9b0-214d-4e65-bd29-caef52dcaf7d tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:51.355033 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-721ef9b0-214d-4e65-bd29-caef52dcaf7d tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:51.357053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-721ef9b0-214d-4e65-bd29-caef52dcaf7d tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:51.357497 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-721ef9b0-214d-4e65-bd29-caef52dcaf7d tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:51.418808 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-721ef9b0-214d-4e65-bd29-caef52dcaf7d tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 89300174-0a17-4f0f-bfd5-40d472ae38a7] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:35:51.493557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:35:51.560270 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-721ef9b0-214d-4e65-bd29-caef52dcaf7d tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "DELETE /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7" status: 204 len: 0 microversion: 2.1 time: 0.233958 Aug 04 17:35:51.562446 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3145/6262] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:35:51 2022] DELETE /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:35:51.580991 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-166cbec0-ab76-4d39-baef-971ffcc21488 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:51.582536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-166cbec0-ab76-4d39-baef-971ffcc21488 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 89300174-0a17-4f0f-bfd5-40d472ae38a7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:51.589718 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-c12860b7-a467-45be-ae59-7c61a668cc3b req-a8ebce9f-2928-4691-b59a-464c3d6c9a18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89300174-0a17-4f0f-bfd5-40d472ae38a7", "tag": "c9515d37-34f5-4d6c-9f03-e0097c227141"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:35:51.596606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-166cbec0-ab76-4d39-baef-971ffcc21488 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:51.598308 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-166cbec0-ab76-4d39-baef-971ffcc21488 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:51.599233 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-166cbec0-ab76-4d39-baef-971ffcc21488 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:51.600467 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-166cbec0-ab76-4d39-baef-971ffcc21488 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:51.601319 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-166cbec0-ab76-4d39-baef-971ffcc21488 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:51.602397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-166cbec0-ab76-4d39-baef-971ffcc21488 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:51.608498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c12860b7-a467-45be-ae59-7c61a668cc3b req-a8ebce9f-2928-4691-b59a-464c3d6c9a18 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:51.609342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c12860b7-a467-45be-ae59-7c61a668cc3b req-a8ebce9f-2928-4691-b59a-464c3d6c9a18 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:51.610157 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c12860b7-a467-45be-ae59-7c61a668cc3b req-a8ebce9f-2928-4691-b59a-464c3d6c9a18 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:51.656719 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-c12860b7-a467-45be-ae59-7c61a668cc3b req-a8ebce9f-2928-4691-b59a-464c3d6c9a18 service nova] Creating event network-changed:c9515d37-34f5-4d6c-9f03-e0097c227141 for instance 89300174-0a17-4f0f-bfd5-40d472ae38a7 on n-h2-851359-3 Aug 04 17:35:51.670153 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-c12860b7-a467-45be-ae59-7c61a668cc3b req-a8ebce9f-2928-4691-b59a-464c3d6c9a18 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.329999 Aug 04 17:35:51.674259 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3118/6263] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:35:51.818353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-166cbec0-ab76-4d39-baef-971ffcc21488 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:51.828513 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-166cbec0-ab76-4d39-baef-971ffcc21488 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7" status: 200 len: 1669 microversion: 2.1 time: 0.260050 Aug 04 17:35:51.843071 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3146/6264] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:51 2022] GET /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7 => generated 1669 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:52.088160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-10a31c0a-1314-43af-8886-6b059ea92150 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:52.088876 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-10a31c0a-1314-43af-8886-6b059ea92150 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] [instance: b49bddcd-130e-4ef2-b627-4d5c84740e36] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:52.093608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:35:52.107312 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10a31c0a-1314-43af-8886-6b059ea92150 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:52.109081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10a31c0a-1314-43af-8886-6b059ea92150 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:52.109913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10a31c0a-1314-43af-8886-6b059ea92150 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:52.111587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10a31c0a-1314-43af-8886-6b059ea92150 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:52.112299 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10a31c0a-1314-43af-8886-6b059ea92150 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:52.113509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10a31c0a-1314-43af-8886-6b059ea92150 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:52.122048 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:35:52.303324 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-10a31c0a-1314-43af-8886-6b059ea92150 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffc50d4aa8047a1a1a18dd97c395431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0374197b78be4d8daf63e8b0dfc4e227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:52.315958 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-10a31c0a-1314-43af-8886-6b059ea92150 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] 10.222.0.93 "GET /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36" status: 200 len: 1469 microversion: 2.1 time: 0.232527 Aug 04 17:35:52.317179 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3119/6265] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:52 2022] GET /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36 => generated 1469 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:52.860368 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f9a1191e-9eea-402c-b24a-c5cf1c708fb3 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:52.864441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f9a1191e-9eea-402c-b24a-c5cf1c708fb3 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 89300174-0a17-4f0f-bfd5-40d472ae38a7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:52.869143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:35:52.889543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9a1191e-9eea-402c-b24a-c5cf1c708fb3 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:52.890750 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9a1191e-9eea-402c-b24a-c5cf1c708fb3 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:52.891428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9a1191e-9eea-402c-b24a-c5cf1c708fb3 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:52.893251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9a1191e-9eea-402c-b24a-c5cf1c708fb3 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:52.893909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9a1191e-9eea-402c-b24a-c5cf1c708fb3 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:52.895082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f9a1191e-9eea-402c-b24a-c5cf1c708fb3 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:53.338025 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dc35743c-1b03-4245-8f7a-e091d6633f55 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:53.338660 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dc35743c-1b03-4245-8f7a-e091d6633f55 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] [instance: b49bddcd-130e-4ef2-b627-4d5c84740e36] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:53.346848 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc35743c-1b03-4245-8f7a-e091d6633f55 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:53.347634 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc35743c-1b03-4245-8f7a-e091d6633f55 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:53.348081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc35743c-1b03-4245-8f7a-e091d6633f55 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:53.349177 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc35743c-1b03-4245-8f7a-e091d6633f55 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:53.349814 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc35743c-1b03-4245-8f7a-e091d6633f55 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:53.350264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc35743c-1b03-4245-8f7a-e091d6633f55 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:53.614731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f9a1191e-9eea-402c-b24a-c5cf1c708fb3 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:53.623465 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f9a1191e-9eea-402c-b24a-c5cf1c708fb3 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7" status: 200 len: 1669 microversion: 2.1 time: 0.772271 Aug 04 17:35:53.624064 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3147/6266] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:52 2022] GET /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7 => generated 1669 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:53.940246 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dc35743c-1b03-4245-8f7a-e091d6633f55 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffc50d4aa8047a1a1a18dd97c395431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0374197b78be4d8daf63e8b0dfc4e227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:35:53.954308 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dc35743c-1b03-4245-8f7a-e091d6633f55 tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] 10.222.0.93 "GET /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36" status: 200 len: 1469 microversion: 2.1 time: 0.620162 Aug 04 17:35:53.955867 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3120/6267] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:53 2022] GET /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36 => generated 1469 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:35:53.966324 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-9bbcaead-c8b3-48e2-b4ca-d89a623fd3ba req-471b9874-c785-42ba-9446-b20cd59bd3c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89300174-0a17-4f0f-bfd5-40d472ae38a7", "name": "network-vif-deleted", "tag": "c9515d37-34f5-4d6c-9f03-e0097c227141"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:35:53.978764 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9bbcaead-c8b3-48e2-b4ca-d89a623fd3ba req-471b9874-c785-42ba-9446-b20cd59bd3c9 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:53.979696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9bbcaead-c8b3-48e2-b4ca-d89a623fd3ba req-471b9874-c785-42ba-9446-b20cd59bd3c9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:53.980509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9bbcaead-c8b3-48e2-b4ca-d89a623fd3ba req-471b9874-c785-42ba-9446-b20cd59bd3c9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:54.011402 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-9bbcaead-c8b3-48e2-b4ca-d89a623fd3ba req-471b9874-c785-42ba-9446-b20cd59bd3c9 service nova] Creating event network-vif-deleted:c9515d37-34f5-4d6c-9f03-e0097c227141 for instance 89300174-0a17-4f0f-bfd5-40d472ae38a7 on n-h2-851359-3 Aug 04 17:35:54.029042 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-9bbcaead-c8b3-48e2-b4ca-d89a623fd3ba req-471b9874-c785-42ba-9446-b20cd59bd3c9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073400 Aug 04 17:35:54.030774 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3148/6268] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:35:54.229728 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-9cf3402d-3638-4143-b035-1aafeef96541 req-a6aed30c-cc3d-4f2e-9845-b6c053b65f35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b49bddcd-130e-4ef2-b627-4d5c84740e36", "name": "network-vif-deleted", "tag": "875768cf-7bf3-4cf5-9d1a-761592ff4dcc"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:35:54.245487 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9cf3402d-3638-4143-b035-1aafeef96541 req-a6aed30c-cc3d-4f2e-9845-b6c053b65f35 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:54.246305 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9cf3402d-3638-4143-b035-1aafeef96541 req-a6aed30c-cc3d-4f2e-9845-b6c053b65f35 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:54.247187 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9cf3402d-3638-4143-b035-1aafeef96541 req-a6aed30c-cc3d-4f2e-9845-b6c053b65f35 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:54.283789 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-9cf3402d-3638-4143-b035-1aafeef96541 req-a6aed30c-cc3d-4f2e-9845-b6c053b65f35 service nova] Creating event network-vif-deleted:875768cf-7bf3-4cf5-9d1a-761592ff4dcc for instance b49bddcd-130e-4ef2-b627-4d5c84740e36 on n-h1-851359-3 Aug 04 17:35:54.290338 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-9cf3402d-3638-4143-b035-1aafeef96541 req-a6aed30c-cc3d-4f2e-9845-b6c053b65f35 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067003 Aug 04 17:35:54.291977 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3121/6269] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:35:54.659087 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ac97120e-b24e-4668-96b6-85d82479daf6 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:54.660323 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ac97120e-b24e-4668-96b6-85d82479daf6 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: 89300174-0a17-4f0f-bfd5-40d472ae38a7] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:54.675576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac97120e-b24e-4668-96b6-85d82479daf6 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:54.676165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac97120e-b24e-4668-96b6-85d82479daf6 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:54.676707 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac97120e-b24e-4668-96b6-85d82479daf6 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:54.677711 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac97120e-b24e-4668-96b6-85d82479daf6 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:54.678439 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac97120e-b24e-4668-96b6-85d82479daf6 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:54.679285 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac97120e-b24e-4668-96b6-85d82479daf6 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:54.704957 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-ac97120e-b24e-4668-96b6-85d82479daf6 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] HTTP exception thrown: Instance 89300174-0a17-4f0f-bfd5-40d472ae38a7 could not be found. Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ac97120e-b24e-4668-96b6-85d82479daf6 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Request method failure captured: Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7 HTTP/1.1 Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7ALNwJzdvv-vVzeBqjdd1xxJGJlBQSaBQjhZzdfpzzAM1Exn4TSYyHR4eP3Y8F9RpJZhul7UCjhtoKbfztFRuNFsrovyv0HUoevOq_nJpbMqsGWIVWHcIJbaI6vcXQCg-EH61jNq0OSe2Nfb0Zlf4DeRcGi3nHBudbsh89L5Rc1zFsY Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 12b4e49789d84ae29c3278fcb2303508 Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-TestNetworkBasicOps-1491327378 Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/12b4e49789d84ae29c3278fcb2303508"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/12b4e49789d84ae29c3278fcb2303508"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_12b4e49789d84ae29c3278fcb2303508"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/12b4e49789d84ae29c3278fcb2303508"}]}] Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-TestNetworkBasicOps-1491327378 Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 12b4e49789d84ae29c3278fcb2303508 Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-TestNetworkBasicOps-1491327378 Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-TestNetworkBasicOps-1491327378-project Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 55283f1fd1af42ef87ee70f1554b0f6e Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-TestNetworkBasicOps-1491327378-project Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 89300174-0a17-4f0f-bfd5-40d472ae38a7 could not be found. Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '89300174-0a17-4f0f-bfd5-40d472ae38a7'} Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89300174-0a17-4f0f-bfd5-40d472ae38a7 could not be found. Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89300174-0a17-4f0f-bfd5-40d472ae38a7 could not be found. Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:35:54.707282 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:35:54.712380 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:35:54.712380 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:35:54.712380 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:35:54.712380 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:35:54.712380 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:35:54.712380 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89300174-0a17-4f0f-bfd5-40d472ae38a7 could not be found. Aug 04 17:35:54.712380 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:35:54.714407 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ac97120e-b24e-4668-96b6-85d82479daf6 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Returning 404 to user: Instance 89300174-0a17-4f0f-bfd5-40d472ae38a7 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:35:54.715700 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ac97120e-b24e-4668-96b6-85d82479daf6 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7" status: 404 len: 111 microversion: 2.1 time: 0.062766 Aug 04 17:35:54.716478 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3149/6270] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:54 2022] GET /compute/v2.1/servers/89300174-0a17-4f0f-bfd5-40d472ae38a7 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:35:54.981063 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cb5fb677-c805-45d2-bc0e-5eb95d69566a tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:54.982012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cb5fb677-c805-45d2-bc0e-5eb95d69566a tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] [instance: b49bddcd-130e-4ef2-b627-4d5c84740e36] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:35:54.983961 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ee26d766-4239-4433-a740-4f821c92d53d tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '.version_select at 0x7f1e5ac05ee0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:35:55.015270 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ee26d766-4239-4433-a740-4f821c92d53d tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1136431003" status: 202 len: 0 microversion: 2.1 time: 0.035547 Aug 04 17:35:55.015869 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3150/6271] 10.222.0.93 () {58 vars in 1257 bytes} [Thu Aug 4 17:35:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1136431003 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 17:35:55.026710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb5fb677-c805-45d2-bc0e-5eb95d69566a tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:55.038908 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb5fb677-c805-45d2-bc0e-5eb95d69566a tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:55.040373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb5fb677-c805-45d2-bc0e-5eb95d69566a tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:55.041508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb5fb677-c805-45d2-bc0e-5eb95d69566a tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:35:55.049908 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb5fb677-c805-45d2-bc0e-5eb95d69566a tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:35:55.050907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb5fb677-c805-45d2-bc0e-5eb95d69566a tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:35:55.083419 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-cb5fb677-c805-45d2-bc0e-5eb95d69566a tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] HTTP exception thrown: Instance b49bddcd-130e-4ef2-b627-4d5c84740e36 could not be found. Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cb5fb677-c805-45d2-bc0e-5eb95d69566a tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Request method failure captured: Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36 HTTP/1.1 Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AMPJvWYYhaSG-AohC5uvr81S1HqLgvHJAs8Mj0voEQe8qXd6HboElJm4LVeIIVFkSC7uTzdUewzAieAFjLIifoDFgj8UygUX-YhJBbfjQBkk1L8dEwXh2Ah4Dw9yme7GYaGR5yDhr8UMabkUjxNYYK4ZFbT0NFIUPr7WhL-v-RgWpk Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 0374197b78be4d8daf63e8b0dfc4e227 Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-VolumesBackupsTest-1167513273 Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0374197b78be4d8daf63e8b0dfc4e227"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0374197b78be4d8daf63e8b0dfc4e227"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0374197b78be4d8daf63e8b0dfc4e227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0374197b78be4d8daf63e8b0dfc4e227"}]}] Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-VolumesBackupsTest-1167513273 Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 0374197b78be4d8daf63e8b0dfc4e227 Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-VolumesBackupsTest-1167513273 Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-VolumesBackupsTest-1167513273-project Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 0ffc50d4aa8047a1a1a18dd97c395431 Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-VolumesBackupsTest-1167513273-project Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance b49bddcd-130e-4ef2-b627-4d5c84740e36 could not be found. Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'b49bddcd-130e-4ef2-b627-4d5c84740e36'} Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b49bddcd-130e-4ef2-b627-4d5c84740e36 could not be found. Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b49bddcd-130e-4ef2-b627-4d5c84740e36 could not be found. Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:35:55.086891 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:35:55.101594 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:35:55.101594 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:35:55.101594 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:35:55.101594 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:35:55.101594 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:35:55.101594 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b49bddcd-130e-4ef2-b627-4d5c84740e36 could not be found. Aug 04 17:35:55.101594 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:35:55.101594 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cb5fb677-c805-45d2-bc0e-5eb95d69566a tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] Returning 404 to user: Instance b49bddcd-130e-4ef2-b627-4d5c84740e36 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:35:55.101594 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cb5fb677-c805-45d2-bc0e-5eb95d69566a tempest-VolumesBackupsTest-1167513273 tempest-VolumesBackupsTest-1167513273-project] 10.222.0.93 "GET /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36" status: 404 len: 111 microversion: 2.1 time: 0.113617 Aug 04 17:35:55.101594 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3122/6272] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:35:54 2022] GET /compute/v2.1/servers/b49bddcd-130e-4ef2-b627-4d5c84740e36 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:36:10.457439 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:36:10.459950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:36:10.481966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a9f8a6f4-1d67-48bc-8be2-d5af99c1eb19 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Action: 'create', calling method: .version_select at 0x7f1e5af965e0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-425949011", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4tJ2C3V71vauT35JNqYNj/OTnZ8JA053VDR6lS1aCld3VYZngYNQ9hU7EJ424bEtQeuYlNR0e9VkaVThdXqTyAgoOBDbPSJA5bFwk1cZANkk98vG3V+9kwbqCqFT8jpQ=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:36:10.611657 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-a9f8a6f4-1d67-48bc-8be2-d5af99c1eb19 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Getting quotas for project 12b4e49789d84ae29c3278fcb2303508. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:36:10.620791 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-a9f8a6f4-1d67-48bc-8be2-d5af99c1eb19 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Getting quotas for user 55283f1fd1af42ef87ee70f1554b0f6e and project 12b4e49789d84ae29c3278fcb2303508. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:36:10.664138 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a9f8a6f4-1d67-48bc-8be2-d5af99c1eb19 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.214962 Aug 04 17:36:10.665165 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3151/6273] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:36:10 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:36:13.879352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7272402d-b637-4692-9607-a03b482d06a1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2025035254", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "73fe879b-3a01-4b71-8ba7-095d508846d7"}], "key_name": "tempest-TestNetworkBasicOps-425949011", "security_groups": [{"name": "tempest-secgroup-smoke-299963390"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:36:13.918428 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=7 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:36:13.922264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=15 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:36:14.219806 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-7272402d-b637-4692-9607-a03b482d06a1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] validate_networks() for [('73fe879b-3a01-4b71-8ba7-095d508846d7', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:36:15.385893 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7272402d-b637-4692-9607-a03b482d06a1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:36:15.388071 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7272402d-b637-4692-9607-a03b482d06a1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:36:15.389043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7272402d-b637-4692-9607-a03b482d06a1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:36:15.390001 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7272402d-b637-4692-9607-a03b482d06a1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:36:15.392263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7272402d-b637-4692-9607-a03b482d06a1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:36:15.418445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7272402d-b637-4692-9607-a03b482d06a1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:36:15.419939 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7272402d-b637-4692-9607-a03b482d06a1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:36:15.420908 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7272402d-b637-4692-9607-a03b482d06a1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:36:15.422950 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7272402d-b637-4692-9607-a03b482d06a1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:36:15.424012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7272402d-b637-4692-9607-a03b482d06a1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:36:15.428822 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7272402d-b637-4692-9607-a03b482d06a1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:36:15.503598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-7272402d-b637-4692-9607-a03b482d06a1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Getting quotas for project 12b4e49789d84ae29c3278fcb2303508. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:36:15.514793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-7272402d-b637-4692-9607-a03b482d06a1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Getting quotas for user 55283f1fd1af42ef87ee70f1554b0f6e and project 12b4e49789d84ae29c3278fcb2303508. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:36:15.580062 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7272402d-b637-4692-9607-a03b482d06a1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:36:15.591503 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7272402d-b637-4692-9607-a03b482d06a1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: d7e72682-94fa-4e3f-93cc-5a99f30b3cc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:36:15.724793 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7272402d-b637-4692-9607-a03b482d06a1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.861858 Aug 04 17:36:15.729322 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3123/6274] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:36:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 1868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:36:15.744404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bb50d0cc-9157-4642-b88c-96e775d1cfae tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:36:15.746253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bb50d0cc-9157-4642-b88c-96e775d1cfae tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: d7e72682-94fa-4e3f-93cc-5a99f30b3cc8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:36:15.896336 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bb50d0cc-9157-4642-b88c-96e775d1cfae tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:36:15.913809 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bb50d0cc-9157-4642-b88c-96e775d1cfae tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8" status: 200 len: 1248 microversion: 2.1 time: 0.175665 Aug 04 17:36:15.925296 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3152/6275] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:36:15 2022] GET /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8 => generated 1248 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:36:16.948866 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-93b64ee5-43b5-4425-8ecf-f01332aad9b2 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:36:16.950905 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-93b64ee5-43b5-4425-8ecf-f01332aad9b2 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: d7e72682-94fa-4e3f-93cc-5a99f30b3cc8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:36:16.976624 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93b64ee5-43b5-4425-8ecf-f01332aad9b2 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:36:16.977520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93b64ee5-43b5-4425-8ecf-f01332aad9b2 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:36:16.979780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93b64ee5-43b5-4425-8ecf-f01332aad9b2 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:36:16.980944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93b64ee5-43b5-4425-8ecf-f01332aad9b2 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:36:16.983851 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93b64ee5-43b5-4425-8ecf-f01332aad9b2 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:36:16.984585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93b64ee5-43b5-4425-8ecf-f01332aad9b2 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:36:17.146071 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-93b64ee5-43b5-4425-8ecf-f01332aad9b2 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:36:17.161105 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-93b64ee5-43b5-4425-8ecf-f01332aad9b2 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8" status: 200 len: 1244 microversion: 2.1 time: 0.219793 Aug 04 17:36:17.161716 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3124/6276] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:36:16 2022] GET /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8 => generated 1244 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:36:18.189721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b7ba62b2-8a00-4f92-b974-221176fca569 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:36:18.204983 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b7ba62b2-8a00-4f92-b974-221176fca569 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: d7e72682-94fa-4e3f-93cc-5a99f30b3cc8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:36:18.221425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b7ba62b2-8a00-4f92-b974-221176fca569 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:36:18.225427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b7ba62b2-8a00-4f92-b974-221176fca569 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:36:18.226558 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b7ba62b2-8a00-4f92-b974-221176fca569 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:36:18.228443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b7ba62b2-8a00-4f92-b974-221176fca569 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:36:18.232995 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b7ba62b2-8a00-4f92-b974-221176fca569 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:36:18.233846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b7ba62b2-8a00-4f92-b974-221176fca569 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:36:18.364876 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b7ba62b2-8a00-4f92-b974-221176fca569 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:36:18.391120 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b7ba62b2-8a00-4f92-b974-221176fca569 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8" status: 200 len: 1306 microversion: 2.1 time: 0.209625 Aug 04 17:36:18.397156 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3153/6277] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:36:18 2022] GET /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8 => generated 1306 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:36:19.422933 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0e228ce9-6652-4fec-a96a-124782675ce1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:36:19.424744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0e228ce9-6652-4fec-a96a-124782675ce1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: d7e72682-94fa-4e3f-93cc-5a99f30b3cc8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:36:19.445143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e228ce9-6652-4fec-a96a-124782675ce1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:36:19.446310 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e228ce9-6652-4fec-a96a-124782675ce1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:36:19.447249 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e228ce9-6652-4fec-a96a-124782675ce1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:36:19.448818 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e228ce9-6652-4fec-a96a-124782675ce1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:36:19.449749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e228ce9-6652-4fec-a96a-124782675ce1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:36:19.450882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e228ce9-6652-4fec-a96a-124782675ce1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:36:19.880086 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0e228ce9-6652-4fec-a96a-124782675ce1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:36:19.893075 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0e228ce9-6652-4fec-a96a-124782675ce1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8" status: 200 len: 1373 microversion: 2.1 time: 0.478846 Aug 04 17:36:19.894072 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3125/6278] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:36:19 2022] GET /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8 => generated 1373 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:36:20.811092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-05d755f5-db83-4191-b290-dd6b9a350d48 req-cff923f8-f40e-4401-a715-241c776fac8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e72682-94fa-4e3f-93cc-5a99f30b3cc8", "tag": "0ce78b6b-172a-41e6-86c6-4e657e5584e1"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:36:20.863919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-05d755f5-db83-4191-b290-dd6b9a350d48 req-cff923f8-f40e-4401-a715-241c776fac8d service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:36:20.864869 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-05d755f5-db83-4191-b290-dd6b9a350d48 req-cff923f8-f40e-4401-a715-241c776fac8d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:36:20.865915 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-05d755f5-db83-4191-b290-dd6b9a350d48 req-cff923f8-f40e-4401-a715-241c776fac8d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:36:20.905590 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-05d755f5-db83-4191-b290-dd6b9a350d48 req-cff923f8-f40e-4401-a715-241c776fac8d service nova] Creating event network-changed:0ce78b6b-172a-41e6-86c6-4e657e5584e1 for instance d7e72682-94fa-4e3f-93cc-5a99f30b3cc8 on n-h1-851359-3 Aug 04 17:36:20.920057 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-05d755f5-db83-4191-b290-dd6b9a350d48 req-cff923f8-f40e-4401-a715-241c776fac8d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109831 Aug 04 17:36:20.920238 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3154/6279] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:36:20.932031 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-54cca9c0-a294-4919-9971-52566585b905 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:36:20.934209 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-54cca9c0-a294-4919-9971-52566585b905 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: d7e72682-94fa-4e3f-93cc-5a99f30b3cc8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:36:20.966638 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54cca9c0-a294-4919-9971-52566585b905 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:36:20.969186 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54cca9c0-a294-4919-9971-52566585b905 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:36:20.971024 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54cca9c0-a294-4919-9971-52566585b905 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:36:20.973159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54cca9c0-a294-4919-9971-52566585b905 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:36:20.974306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54cca9c0-a294-4919-9971-52566585b905 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:36:20.975660 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54cca9c0-a294-4919-9971-52566585b905 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:36:21.482369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-54cca9c0-a294-4919-9971-52566585b905 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:36:21.495167 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-54cca9c0-a294-4919-9971-52566585b905 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8" status: 200 len: 1373 microversion: 2.1 time: 0.572146 Aug 04 17:36:21.495873 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3126/6280] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:36:20 2022] GET /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8 => generated 1373 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:36:22.537534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c91291ec-7f04-4f2f-ac90-efc22f09cca2 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:36:22.539832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c91291ec-7f04-4f2f-ac90-efc22f09cca2 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: d7e72682-94fa-4e3f-93cc-5a99f30b3cc8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:36:22.555537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c91291ec-7f04-4f2f-ac90-efc22f09cca2 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:36:22.561572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c91291ec-7f04-4f2f-ac90-efc22f09cca2 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:36:22.562838 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c91291ec-7f04-4f2f-ac90-efc22f09cca2 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:36:22.564546 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c91291ec-7f04-4f2f-ac90-efc22f09cca2 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:36:22.566061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c91291ec-7f04-4f2f-ac90-efc22f09cca2 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:36:22.567107 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c91291ec-7f04-4f2f-ac90-efc22f09cca2 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:36:23.059025 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c91291ec-7f04-4f2f-ac90-efc22f09cca2 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:36:23.081582 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c91291ec-7f04-4f2f-ac90-efc22f09cca2 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8" status: 200 len: 1373 microversion: 2.1 time: 0.551671 Aug 04 17:36:23.082495 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3155/6281] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:36:22 2022] GET /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8 => generated 1373 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:36:24.118454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6c313ab5-2452-4f39-acc0-2d1c5ae0f0f1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:36:24.119373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6c313ab5-2452-4f39-acc0-2d1c5ae0f0f1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: d7e72682-94fa-4e3f-93cc-5a99f30b3cc8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:36:24.130108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c313ab5-2452-4f39-acc0-2d1c5ae0f0f1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:36:24.131128 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c313ab5-2452-4f39-acc0-2d1c5ae0f0f1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:36:24.132011 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c313ab5-2452-4f39-acc0-2d1c5ae0f0f1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:36:24.133429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c313ab5-2452-4f39-acc0-2d1c5ae0f0f1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:36:24.134432 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c313ab5-2452-4f39-acc0-2d1c5ae0f0f1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:36:24.135309 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c313ab5-2452-4f39-acc0-2d1c5ae0f0f1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:36:24.505399 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6c313ab5-2452-4f39-acc0-2d1c5ae0f0f1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:36:24.518574 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6c313ab5-2452-4f39-acc0-2d1c5ae0f0f1 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8" status: 200 len: 1373 microversion: 2.1 time: 0.406274 Aug 04 17:36:24.520271 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3127/6282] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:36:24 2022] GET /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8 => generated 1373 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:36:25.543555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-12544414-e141-4526-9b85-58b871663d1d tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:36:25.545750 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-12544414-e141-4526-9b85-58b871663d1d tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: d7e72682-94fa-4e3f-93cc-5a99f30b3cc8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:36:25.553578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:36:25.556078 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:36:25.564810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12544414-e141-4526-9b85-58b871663d1d tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:36:25.567355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12544414-e141-4526-9b85-58b871663d1d tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:36:25.568791 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12544414-e141-4526-9b85-58b871663d1d tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:36:25.570630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12544414-e141-4526-9b85-58b871663d1d tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:36:25.573807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12544414-e141-4526-9b85-58b871663d1d tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:36:25.575147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12544414-e141-4526-9b85-58b871663d1d tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:36:25.695221 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-bb5314fc-4de3-4edb-a2c5-2c0827b59046 req-dc8ac539-5190-409e-b0bb-6f806c10a25b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e72682-94fa-4e3f-93cc-5a99f30b3cc8", "name": "network-vif-plugged", "status": "completed", "tag": "0ce78b6b-172a-41e6-86c6-4e657e5584e1"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:36:25.707095 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-bb5314fc-4de3-4edb-a2c5-2c0827b59046 req-dc8ac539-5190-409e-b0bb-6f806c10a25b service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:36:25.708453 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-bb5314fc-4de3-4edb-a2c5-2c0827b59046 req-dc8ac539-5190-409e-b0bb-6f806c10a25b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:36:25.709098 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-bb5314fc-4de3-4edb-a2c5-2c0827b59046 req-dc8ac539-5190-409e-b0bb-6f806c10a25b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:36:25.728669 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-bb5314fc-4de3-4edb-a2c5-2c0827b59046 req-dc8ac539-5190-409e-b0bb-6f806c10a25b service nova] Creating event network-vif-plugged:0ce78b6b-172a-41e6-86c6-4e657e5584e1 for instance d7e72682-94fa-4e3f-93cc-5a99f30b3cc8 on n-h1-851359-3 Aug 04 17:36:25.735098 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-bb5314fc-4de3-4edb-a2c5-2c0827b59046 req-dc8ac539-5190-409e-b0bb-6f806c10a25b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.273560 Aug 04 17:36:25.738932 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3156/6283] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:36:25.773805 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-12544414-e141-4526-9b85-58b871663d1d tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:36:25.790536 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-12544414-e141-4526-9b85-58b871663d1d tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8" status: 200 len: 1373 microversion: 2.1 time: 0.253290 Aug 04 17:36:25.806126 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3128/6284] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:36:25 2022] GET /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8 => generated 1373 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:36:26.821877 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:36:26.829855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e69fc963-5967-451d-83e9-ff54631a6500 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:36:26.831055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e69fc963-5967-451d-83e9-ff54631a6500 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: d7e72682-94fa-4e3f-93cc-5a99f30b3cc8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:36:26.838908 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e69fc963-5967-451d-83e9-ff54631a6500 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:36:26.839410 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e69fc963-5967-451d-83e9-ff54631a6500 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:36:26.839950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e69fc963-5967-451d-83e9-ff54631a6500 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:36:26.840781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e69fc963-5967-451d-83e9-ff54631a6500 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:36:26.841407 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e69fc963-5967-451d-83e9-ff54631a6500 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:36:26.841910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e69fc963-5967-451d-83e9-ff54631a6500 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:36:27.092156 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e69fc963-5967-451d-83e9-ff54631a6500 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:36:27.104647 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e69fc963-5967-451d-83e9-ff54631a6500 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8" status: 200 len: 1373 microversion: 2.1 time: 0.283346 Aug 04 17:36:27.111265 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3157/6285] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:36:26 2022] GET /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8 => generated 1373 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:36:28.139282 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a25a1394-d36e-4ac1-8533-aaa8b89d5ca5 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:36:28.140177 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a25a1394-d36e-4ac1-8533-aaa8b89d5ca5 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: d7e72682-94fa-4e3f-93cc-5a99f30b3cc8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:36:28.150700 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a25a1394-d36e-4ac1-8533-aaa8b89d5ca5 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:36:28.151435 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a25a1394-d36e-4ac1-8533-aaa8b89d5ca5 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:36:28.152635 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a25a1394-d36e-4ac1-8533-aaa8b89d5ca5 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:36:28.153335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a25a1394-d36e-4ac1-8533-aaa8b89d5ca5 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:36:28.154115 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a25a1394-d36e-4ac1-8533-aaa8b89d5ca5 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:36:28.155431 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a25a1394-d36e-4ac1-8533-aaa8b89d5ca5 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:36:28.365152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a25a1394-d36e-4ac1-8533-aaa8b89d5ca5 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:36:28.375764 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a25a1394-d36e-4ac1-8533-aaa8b89d5ca5 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8" status: 200 len: 1544 microversion: 2.1 time: 0.246208 Aug 04 17:36:28.391647 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3129/6286] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:36:28 2022] GET /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8 => generated 1544 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:36:28.398395 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3f77be8b-16b3-4571-b94f-0533fa2c9b50 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:36:28.400032 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3f77be8b-16b3-4571-b94f-0533fa2c9b50 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: d7e72682-94fa-4e3f-93cc-5a99f30b3cc8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:36:28.434065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f77be8b-16b3-4571-b94f-0533fa2c9b50 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:36:28.434065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f77be8b-16b3-4571-b94f-0533fa2c9b50 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:36:28.434065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f77be8b-16b3-4571-b94f-0533fa2c9b50 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:36:28.435360 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f77be8b-16b3-4571-b94f-0533fa2c9b50 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:36:28.436617 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f77be8b-16b3-4571-b94f-0533fa2c9b50 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:36:28.438142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f77be8b-16b3-4571-b94f-0533fa2c9b50 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:36:28.751923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3f77be8b-16b3-4571-b94f-0533fa2c9b50 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:36:28.766789 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3f77be8b-16b3-4571-b94f-0533fa2c9b50 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8" status: 200 len: 1544 microversion: 2.1 time: 0.371654 Aug 04 17:36:28.782876 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3158/6287] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:36:28 2022] GET /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8 => generated 1544 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:36:31.754565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-445f64dc-4690-4c75-a9f2-1543db9cdae6 req-a3b88369-52d7-42cf-b1cf-bfc35fcf568f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e72682-94fa-4e3f-93cc-5a99f30b3cc8", "tag": "0ce78b6b-172a-41e6-86c6-4e657e5584e1"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:36:31.810440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-445f64dc-4690-4c75-a9f2-1543db9cdae6 req-a3b88369-52d7-42cf-b1cf-bfc35fcf568f service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:36:31.819613 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-445f64dc-4690-4c75-a9f2-1543db9cdae6 req-a3b88369-52d7-42cf-b1cf-bfc35fcf568f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:36:31.820745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-445f64dc-4690-4c75-a9f2-1543db9cdae6 req-a3b88369-52d7-42cf-b1cf-bfc35fcf568f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:36:31.861567 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-445f64dc-4690-4c75-a9f2-1543db9cdae6 req-a3b88369-52d7-42cf-b1cf-bfc35fcf568f service nova] Creating event network-changed:0ce78b6b-172a-41e6-86c6-4e657e5584e1 for instance d7e72682-94fa-4e3f-93cc-5a99f30b3cc8 on n-h1-851359-3 Aug 04 17:36:31.874286 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-445f64dc-4690-4c75-a9f2-1543db9cdae6 req-a3b88369-52d7-42cf-b1cf-bfc35fcf568f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130913 Aug 04 17:36:31.881593 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3130/6288] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:36:51.455118 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a782b166-cb66-4ae5-b2ff-7ea3c821f206 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:36:51.455118 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a782b166-cb66-4ae5-b2ff-7ea3c821f206 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: d7e72682-94fa-4e3f-93cc-5a99f30b3cc8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:36:51.464218 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:36:51.465655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=28 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:36:51.468809 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a782b166-cb66-4ae5-b2ff-7ea3c821f206 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:36:51.469617 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a782b166-cb66-4ae5-b2ff-7ea3c821f206 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:36:51.470331 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a782b166-cb66-4ae5-b2ff-7ea3c821f206 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:36:51.471621 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a782b166-cb66-4ae5-b2ff-7ea3c821f206 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:36:51.472414 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a782b166-cb66-4ae5-b2ff-7ea3c821f206 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:36:51.473048 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a782b166-cb66-4ae5-b2ff-7ea3c821f206 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:36:51.563096 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a782b166-cb66-4ae5-b2ff-7ea3c821f206 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "POST /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8/action" status: 200 len: 24573 microversion: 2.1 time: 0.118050 Aug 04 17:36:51.564699 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3159/6289] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:36:51 2022] POST /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8/action => generated 24573 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 17:37:02.739873 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:37:02.740921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=40 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:37:02.746732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2d73eed4-ba00-44f1-9ada-da717a979af3 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:37:02.750042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2d73eed4-ba00-44f1-9ada-da717a979af3 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: d7e72682-94fa-4e3f-93cc-5a99f30b3cc8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:37:02.758141 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d73eed4-ba00-44f1-9ada-da717a979af3 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:02.767042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d73eed4-ba00-44f1-9ada-da717a979af3 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:02.767042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d73eed4-ba00-44f1-9ada-da717a979af3 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:02.769635 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d73eed4-ba00-44f1-9ada-da717a979af3 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:02.770326 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d73eed4-ba00-44f1-9ada-da717a979af3 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:02.770861 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d73eed4-ba00-44f1-9ada-da717a979af3 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:02.880388 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2d73eed4-ba00-44f1-9ada-da717a979af3 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "POST /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8/action" status: 200 len: 32652 microversion: 2.1 time: 0.142427 Aug 04 17:37:02.881376 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3131/6290] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:37:02 2022] POST /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8/action => generated 32652 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 17:37:04.841126 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-28df97f7-91ce-4502-87c4-fa7a4e84a016 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:37:04.842352 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-28df97f7-91ce-4502-87c4-fa7a4e84a016 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: d7e72682-94fa-4e3f-93cc-5a99f30b3cc8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:37:04.844764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-afe6e305-9d76-4a0e-aace-e946ac778862 req-afbfec72-31cb-4477-8168-6fd0c0b0ea17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e72682-94fa-4e3f-93cc-5a99f30b3cc8", "tag": "0ce78b6b-172a-41e6-86c6-4e657e5584e1"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:37:04.859515 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:37:04.860307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=4 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:37:04.861690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-afe6e305-9d76-4a0e-aace-e946ac778862 req-afbfec72-31cb-4477-8168-6fd0c0b0ea17 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:04.864440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-afe6e305-9d76-4a0e-aace-e946ac778862 req-afbfec72-31cb-4477-8168-6fd0c0b0ea17 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:04.865658 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-afe6e305-9d76-4a0e-aace-e946ac778862 req-afbfec72-31cb-4477-8168-6fd0c0b0ea17 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:04.872311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28df97f7-91ce-4502-87c4-fa7a4e84a016 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:04.873939 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28df97f7-91ce-4502-87c4-fa7a4e84a016 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:04.875636 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28df97f7-91ce-4502-87c4-fa7a4e84a016 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:04.878076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28df97f7-91ce-4502-87c4-fa7a4e84a016 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:04.880431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28df97f7-91ce-4502-87c4-fa7a4e84a016 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:04.882090 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-28df97f7-91ce-4502-87c4-fa7a4e84a016 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:04.882891 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-afe6e305-9d76-4a0e-aace-e946ac778862 req-afbfec72-31cb-4477-8168-6fd0c0b0ea17 service nova] Creating event network-changed:0ce78b6b-172a-41e6-86c6-4e657e5584e1 for instance d7e72682-94fa-4e3f-93cc-5a99f30b3cc8 on n-h1-851359-3 Aug 04 17:37:04.889211 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-afe6e305-9d76-4a0e-aace-e946ac778862 req-afbfec72-31cb-4477-8168-6fd0c0b0ea17 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050908 Aug 04 17:37:04.895086 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3132/6291] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:37:04.969138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-28df97f7-91ce-4502-87c4-fa7a4e84a016 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: d7e72682-94fa-4e3f-93cc-5a99f30b3cc8] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:37:05.129348 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-28df97f7-91ce-4502-87c4-fa7a4e84a016 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "DELETE /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8" status: 204 len: 0 microversion: 2.1 time: 0.293932 Aug 04 17:37:05.134119 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3160/6292] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:37:04 2022] DELETE /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:37:05.148343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-190a3cc8-1f8b-41a8-9a43-3d9d04b5ffa0 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:37:05.149428 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-190a3cc8-1f8b-41a8-9a43-3d9d04b5ffa0 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: d7e72682-94fa-4e3f-93cc-5a99f30b3cc8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:37:05.188073 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-190a3cc8-1f8b-41a8-9a43-3d9d04b5ffa0 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:05.188583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-190a3cc8-1f8b-41a8-9a43-3d9d04b5ffa0 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:05.189030 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-190a3cc8-1f8b-41a8-9a43-3d9d04b5ffa0 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:05.189749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-190a3cc8-1f8b-41a8-9a43-3d9d04b5ffa0 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:05.190241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-190a3cc8-1f8b-41a8-9a43-3d9d04b5ffa0 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:05.191579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-190a3cc8-1f8b-41a8-9a43-3d9d04b5ffa0 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:05.374497 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-190a3cc8-1f8b-41a8-9a43-3d9d04b5ffa0 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:37:05.384578 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-190a3cc8-1f8b-41a8-9a43-3d9d04b5ffa0 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8" status: 200 len: 1667 microversion: 2.1 time: 0.243309 Aug 04 17:37:05.385195 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3133/6293] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:37:05 2022] GET /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8 => generated 1667 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:37:06.410230 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e33d8564-44a1-47fa-a91f-1796a53d8a08 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:37:06.413888 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e33d8564-44a1-47fa-a91f-1796a53d8a08 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: d7e72682-94fa-4e3f-93cc-5a99f30b3cc8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:37:06.443527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e33d8564-44a1-47fa-a91f-1796a53d8a08 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:06.444048 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e33d8564-44a1-47fa-a91f-1796a53d8a08 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:06.444505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e33d8564-44a1-47fa-a91f-1796a53d8a08 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:06.445247 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e33d8564-44a1-47fa-a91f-1796a53d8a08 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:06.445721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e33d8564-44a1-47fa-a91f-1796a53d8a08 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:06.446204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e33d8564-44a1-47fa-a91f-1796a53d8a08 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:06.669336 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e33d8564-44a1-47fa-a91f-1796a53d8a08 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:37:06.678269 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e33d8564-44a1-47fa-a91f-1796a53d8a08 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8" status: 200 len: 1667 microversion: 2.1 time: 0.275224 Aug 04 17:37:06.680590 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3161/6294] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:37:06 2022] GET /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8 => generated 1667 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:37:07.504495 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-48f0cb74-b5a5-4b15-9380-c1c677100ac9 req-d55014c8-403f-4372-a568-13060857fbe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e72682-94fa-4e3f-93cc-5a99f30b3cc8", "name": "network-vif-deleted", "tag": "0ce78b6b-172a-41e6-86c6-4e657e5584e1"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:37:07.526257 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-48f0cb74-b5a5-4b15-9380-c1c677100ac9 req-d55014c8-403f-4372-a568-13060857fbe7 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:07.526762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-48f0cb74-b5a5-4b15-9380-c1c677100ac9 req-d55014c8-403f-4372-a568-13060857fbe7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:07.527201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-48f0cb74-b5a5-4b15-9380-c1c677100ac9 req-d55014c8-403f-4372-a568-13060857fbe7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:07.550692 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-48f0cb74-b5a5-4b15-9380-c1c677100ac9 req-d55014c8-403f-4372-a568-13060857fbe7 service nova] Creating event network-vif-deleted:0ce78b6b-172a-41e6-86c6-4e657e5584e1 for instance d7e72682-94fa-4e3f-93cc-5a99f30b3cc8 on n-h1-851359-3 Aug 04 17:37:07.556034 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-48f0cb74-b5a5-4b15-9380-c1c677100ac9 req-d55014c8-403f-4372-a568-13060857fbe7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055433 Aug 04 17:37:07.557214 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3134/6295] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:37:07.715359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-165687cf-9805-4b3d-875a-c5e3e703f6cf tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:37:07.716035 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-165687cf-9805-4b3d-875a-c5e3e703f6cf tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: d7e72682-94fa-4e3f-93cc-5a99f30b3cc8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:37:07.734063 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-165687cf-9805-4b3d-875a-c5e3e703f6cf tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:07.734579 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-165687cf-9805-4b3d-875a-c5e3e703f6cf tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:07.735027 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-165687cf-9805-4b3d-875a-c5e3e703f6cf tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:07.735997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-165687cf-9805-4b3d-875a-c5e3e703f6cf tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:07.736670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-165687cf-9805-4b3d-875a-c5e3e703f6cf tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:07.737278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-165687cf-9805-4b3d-875a-c5e3e703f6cf tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:07.802695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-165687cf-9805-4b3d-875a-c5e3e703f6cf tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:07.804045 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-165687cf-9805-4b3d-875a-c5e3e703f6cf tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:07.804717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-165687cf-9805-4b3d-875a-c5e3e703f6cf tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:07.805602 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-165687cf-9805-4b3d-875a-c5e3e703f6cf tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lazy-loading 'fault' on Instance uuid d7e72682-94fa-4e3f-93cc-5a99f30b3cc8 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:37:07.868889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-165687cf-9805-4b3d-875a-c5e3e703f6cf tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55283f1fd1af42ef87ee70f1554b0f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b4e49789d84ae29c3278fcb2303508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:37:07.883386 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-165687cf-9805-4b3d-875a-c5e3e703f6cf tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8" status: 200 len: 1338 microversion: 2.1 time: 0.172046 Aug 04 17:37:07.884553 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3162/6296] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:37:07 2022] GET /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8 => generated 1338 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:37:08.907471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-208528a4-a6e2-474e-8c63-807b6ae46be5 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:37:08.908785 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-208528a4-a6e2-474e-8c63-807b6ae46be5 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] [instance: d7e72682-94fa-4e3f-93cc-5a99f30b3cc8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:37:08.916469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-208528a4-a6e2-474e-8c63-807b6ae46be5 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:08.917198 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-208528a4-a6e2-474e-8c63-807b6ae46be5 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:08.917827 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-208528a4-a6e2-474e-8c63-807b6ae46be5 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:08.918707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-208528a4-a6e2-474e-8c63-807b6ae46be5 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:08.919319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-208528a4-a6e2-474e-8c63-807b6ae46be5 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:08.919945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-208528a4-a6e2-474e-8c63-807b6ae46be5 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:08.934615 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-208528a4-a6e2-474e-8c63-807b6ae46be5 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] HTTP exception thrown: Instance d7e72682-94fa-4e3f-93cc-5a99f30b3cc8 could not be found. Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-208528a4-a6e2-474e-8c63-807b6ae46be5 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Request method failure captured: Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8 HTTP/1.1 Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7ALNwJzdvv-vVzeBqjdd1xxJGJlBQSaBQjhZzdfpzzAM1Exn4TSYyHR4eP3Y8F9RpJZhul7UCjhtoKbfztFRuNFsrovyv0HUoevOq_nJpbMqsGWIVWHcIJbaI6vcXQCg-EH61jNq0OSe2Nfb0Zlf4DeRcGi3nHBudbsh89L5Rc1zFsY Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 12b4e49789d84ae29c3278fcb2303508 Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TestNetworkBasicOps-1491327378 Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/12b4e49789d84ae29c3278fcb2303508"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/12b4e49789d84ae29c3278fcb2303508"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_12b4e49789d84ae29c3278fcb2303508"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/12b4e49789d84ae29c3278fcb2303508"}]}] Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TestNetworkBasicOps-1491327378 Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 12b4e49789d84ae29c3278fcb2303508 Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestNetworkBasicOps-1491327378 Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TestNetworkBasicOps-1491327378-project Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 55283f1fd1af42ef87ee70f1554b0f6e Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TestNetworkBasicOps-1491327378-project Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance d7e72682-94fa-4e3f-93cc-5a99f30b3cc8 could not be found. Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'd7e72682-94fa-4e3f-93cc-5a99f30b3cc8'} Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7e72682-94fa-4e3f-93cc-5a99f30b3cc8 could not be found. Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7e72682-94fa-4e3f-93cc-5a99f30b3cc8 could not be found. Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:37:08.937096 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:37:08.941850 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:37:08.941850 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:37:08.941850 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:37:08.941850 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:37:08.941850 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:37:08.941850 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7e72682-94fa-4e3f-93cc-5a99f30b3cc8 could not be found. Aug 04 17:37:08.941850 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:37:08.943312 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-208528a4-a6e2-474e-8c63-807b6ae46be5 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Returning 404 to user: Instance d7e72682-94fa-4e3f-93cc-5a99f30b3cc8 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:37:08.944328 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-208528a4-a6e2-474e-8c63-807b6ae46be5 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "GET /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8" status: 404 len: 111 microversion: 2.1 time: 0.042274 Aug 04 17:37:08.945069 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3135/6297] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:37:08 2022] GET /compute/v2.1/servers/d7e72682-94fa-4e3f-93cc-5a99f30b3cc8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:37:09.242469 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2895b943-ea7d-4bd2-81f7-efb1cbcd02c7 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] Calling method '.version_select at 0x7f1e5ac540d0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:37:09.313280 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2895b943-ea7d-4bd2-81f7-efb1cbcd02c7 tempest-TestNetworkBasicOps-1491327378 tempest-TestNetworkBasicOps-1491327378-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-425949011" status: 202 len: 0 microversion: 2.1 time: 0.074990 Aug 04 17:37:09.315107 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3163/6298] 10.222.0.93 () {58 vars in 1254 bytes} [Thu Aug 4 17:37:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-425949011 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:37:19.022480 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-406b30ca-0b48-44da-a8bb-b06fbd6d50a9 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1238130124", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "8d2f9d0a-cb21-47de-9025-5745c4afed0c"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:37:19.032884 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=10 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:37:19.033801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=16 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:37:19.087401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-406b30ca-0b48-44da-a8bb-b06fbd6d50a9 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] validate_networks() for [('8d2f9d0a-cb21-47de-9025-5745c4afed0c', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:37:19.537564 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-406b30ca-0b48-44da-a8bb-b06fbd6d50a9 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:37:19.538257 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-406b30ca-0b48-44da-a8bb-b06fbd6d50a9 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:37:19.538737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-406b30ca-0b48-44da-a8bb-b06fbd6d50a9 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:37:19.539603 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-406b30ca-0b48-44da-a8bb-b06fbd6d50a9 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:37:19.540024 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-406b30ca-0b48-44da-a8bb-b06fbd6d50a9 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:37:19.559869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-406b30ca-0b48-44da-a8bb-b06fbd6d50a9 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:19.560549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-406b30ca-0b48-44da-a8bb-b06fbd6d50a9 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:19.561623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-406b30ca-0b48-44da-a8bb-b06fbd6d50a9 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:19.562491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-406b30ca-0b48-44da-a8bb-b06fbd6d50a9 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:19.563043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-406b30ca-0b48-44da-a8bb-b06fbd6d50a9 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:19.563668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-406b30ca-0b48-44da-a8bb-b06fbd6d50a9 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:19.586464 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-406b30ca-0b48-44da-a8bb-b06fbd6d50a9 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Getting quotas for project a09d3ba1af2c44df94fc95238f2bb18c. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:37:19.593188 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-406b30ca-0b48-44da-a8bb-b06fbd6d50a9 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Getting quotas for user 3bbb670b4af94c7d93b5110672eab987 and project a09d3ba1af2c44df94fc95238f2bb18c. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:37:19.609072 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-406b30ca-0b48-44da-a8bb-b06fbd6d50a9 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:37:19.612894 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-406b30ca-0b48-44da-a8bb-b06fbd6d50a9 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: 1edf4c55-238d-404b-9331-69288e4fcdf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:37:19.672370 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-406b30ca-0b48-44da-a8bb-b06fbd6d50a9 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653802 Aug 04 17:37:19.673212 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3136/6299] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:37:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:37:19.681677 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:37:19.682459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:37:19.687700 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6e9f1709-a8b9-42ce-90a4-94796646f0d7 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:37:19.688662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6e9f1709-a8b9-42ce-90a4-94796646f0d7 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: 1edf4c55-238d-404b-9331-69288e4fcdf6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:37:19.783909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6e9f1709-a8b9-42ce-90a4-94796646f0d7 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbb670b4af94c7d93b5110672eab987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09d3ba1af2c44df94fc95238f2bb18c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:37:19.792650 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6e9f1709-a8b9-42ce-90a4-94796646f0d7 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "GET /compute/v2.1/servers/1edf4c55-238d-404b-9331-69288e4fcdf6" status: 200 len: 1219 microversion: 2.1 time: 0.112698 Aug 04 17:37:19.793330 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3164/6300] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:37:19 2022] GET /compute/v2.1/servers/1edf4c55-238d-404b-9331-69288e4fcdf6 => generated 1219 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:37:20.827926 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8ac28891-434f-40d1-b663-ee314fef312a tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:37:20.829104 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8ac28891-434f-40d1-b663-ee314fef312a tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: 1edf4c55-238d-404b-9331-69288e4fcdf6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:37:20.837461 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ac28891-434f-40d1-b663-ee314fef312a tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:20.838178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ac28891-434f-40d1-b663-ee314fef312a tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:20.838823 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ac28891-434f-40d1-b663-ee314fef312a tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:20.840191 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ac28891-434f-40d1-b663-ee314fef312a tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:20.841234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ac28891-434f-40d1-b663-ee314fef312a tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:20.842734 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ac28891-434f-40d1-b663-ee314fef312a tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:20.953926 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8ac28891-434f-40d1-b663-ee314fef312a tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbb670b4af94c7d93b5110672eab987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09d3ba1af2c44df94fc95238f2bb18c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:37:20.965041 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8ac28891-434f-40d1-b663-ee314fef312a tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "GET /compute/v2.1/servers/1edf4c55-238d-404b-9331-69288e4fcdf6" status: 200 len: 1279 microversion: 2.1 time: 0.142714 Aug 04 17:37:20.966051 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3137/6301] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:37:20 2022] GET /compute/v2.1/servers/1edf4c55-238d-404b-9331-69288e4fcdf6 => generated 1279 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:37:21.990435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-327eb978-cde2-45f6-b81e-8faf8efe121b tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:37:21.993880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-327eb978-cde2-45f6-b81e-8faf8efe121b tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: 1edf4c55-238d-404b-9331-69288e4fcdf6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:37:22.004094 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-327eb978-cde2-45f6-b81e-8faf8efe121b tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:22.004863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-327eb978-cde2-45f6-b81e-8faf8efe121b tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:22.005573 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-327eb978-cde2-45f6-b81e-8faf8efe121b tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:22.006875 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-327eb978-cde2-45f6-b81e-8faf8efe121b tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:22.007473 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-327eb978-cde2-45f6-b81e-8faf8efe121b tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:22.008213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-327eb978-cde2-45f6-b81e-8faf8efe121b tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:22.136122 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-327eb978-cde2-45f6-b81e-8faf8efe121b tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbb670b4af94c7d93b5110672eab987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09d3ba1af2c44df94fc95238f2bb18c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:37:22.173392 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-327eb978-cde2-45f6-b81e-8faf8efe121b tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "GET /compute/v2.1/servers/1edf4c55-238d-404b-9331-69288e4fcdf6" status: 200 len: 1277 microversion: 2.1 time: 0.188352 Aug 04 17:37:22.174587 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3165/6302] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:37:21 2022] GET /compute/v2.1/servers/1edf4c55-238d-404b-9331-69288e4fcdf6 => generated 1277 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:37:23.133161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0a5e74cf-48a5-445d-bf9e-ab8e8edcbb5a req-19348732-f8b4-466d-8a64-a1d5862d053d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1edf4c55-238d-404b-9331-69288e4fcdf6", "tag": "6afbb5ba-4f25-4cc4-8d9e-e7bd78fb9307"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:37:23.152004 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0a5e74cf-48a5-445d-bf9e-ab8e8edcbb5a req-19348732-f8b4-466d-8a64-a1d5862d053d service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:23.152494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0a5e74cf-48a5-445d-bf9e-ab8e8edcbb5a req-19348732-f8b4-466d-8a64-a1d5862d053d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:23.152944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0a5e74cf-48a5-445d-bf9e-ab8e8edcbb5a req-19348732-f8b4-466d-8a64-a1d5862d053d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:23.167336 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0a5e74cf-48a5-445d-bf9e-ab8e8edcbb5a req-19348732-f8b4-466d-8a64-a1d5862d053d service nova] Creating event network-changed:6afbb5ba-4f25-4cc4-8d9e-e7bd78fb9307 for instance 1edf4c55-238d-404b-9331-69288e4fcdf6 on n-h1-851359-3 Aug 04 17:37:23.175598 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0a5e74cf-48a5-445d-bf9e-ab8e8edcbb5a req-19348732-f8b4-466d-8a64-a1d5862d053d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045780 Aug 04 17:37:23.176257 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3138/6303] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:37:23.199334 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b63b99dd-953b-43a6-969f-7d73a242a1e8 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:37:23.199960 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b63b99dd-953b-43a6-969f-7d73a242a1e8 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: 1edf4c55-238d-404b-9331-69288e4fcdf6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:37:23.208924 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b63b99dd-953b-43a6-969f-7d73a242a1e8 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:23.209433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b63b99dd-953b-43a6-969f-7d73a242a1e8 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:23.209916 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b63b99dd-953b-43a6-969f-7d73a242a1e8 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:23.210672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b63b99dd-953b-43a6-969f-7d73a242a1e8 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:23.211139 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b63b99dd-953b-43a6-969f-7d73a242a1e8 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:23.211573 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b63b99dd-953b-43a6-969f-7d73a242a1e8 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:23.409071 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b63b99dd-953b-43a6-969f-7d73a242a1e8 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbb670b4af94c7d93b5110672eab987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09d3ba1af2c44df94fc95238f2bb18c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:37:23.418904 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b63b99dd-953b-43a6-969f-7d73a242a1e8 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "GET /compute/v2.1/servers/1edf4c55-238d-404b-9331-69288e4fcdf6" status: 200 len: 1319 microversion: 2.1 time: 0.223654 Aug 04 17:37:23.419735 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3166/6304] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:37:23 2022] GET /compute/v2.1/servers/1edf4c55-238d-404b-9331-69288e4fcdf6 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:37:24.443167 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c24cd66c-9051-4728-ace2-f2f4240b0cd8 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:37:24.444407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c24cd66c-9051-4728-ace2-f2f4240b0cd8 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: 1edf4c55-238d-404b-9331-69288e4fcdf6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:37:24.451045 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c24cd66c-9051-4728-ace2-f2f4240b0cd8 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:24.451776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c24cd66c-9051-4728-ace2-f2f4240b0cd8 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:24.452307 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c24cd66c-9051-4728-ace2-f2f4240b0cd8 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:24.453095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c24cd66c-9051-4728-ace2-f2f4240b0cd8 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:24.453633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c24cd66c-9051-4728-ace2-f2f4240b0cd8 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:24.454175 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c24cd66c-9051-4728-ace2-f2f4240b0cd8 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:24.630546 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c24cd66c-9051-4728-ace2-f2f4240b0cd8 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbb670b4af94c7d93b5110672eab987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09d3ba1af2c44df94fc95238f2bb18c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:37:24.638995 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c24cd66c-9051-4728-ace2-f2f4240b0cd8 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "GET /compute/v2.1/servers/1edf4c55-238d-404b-9331-69288e4fcdf6" status: 200 len: 1319 microversion: 2.1 time: 0.201199 Aug 04 17:37:24.640164 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3139/6305] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:37:24 2022] GET /compute/v2.1/servers/1edf4c55-238d-404b-9331-69288e4fcdf6 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:37:25.662460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0626ff38-492c-42ec-b738-544533ce537f tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:37:25.663741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0626ff38-492c-42ec-b738-544533ce537f tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: 1edf4c55-238d-404b-9331-69288e4fcdf6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:37:25.672793 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0626ff38-492c-42ec-b738-544533ce537f tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:25.673547 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0626ff38-492c-42ec-b738-544533ce537f tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:25.674203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0626ff38-492c-42ec-b738-544533ce537f tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:25.675116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0626ff38-492c-42ec-b738-544533ce537f tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:25.675882 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0626ff38-492c-42ec-b738-544533ce537f tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:25.676472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0626ff38-492c-42ec-b738-544533ce537f tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:25.903204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0626ff38-492c-42ec-b738-544533ce537f tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbb670b4af94c7d93b5110672eab987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09d3ba1af2c44df94fc95238f2bb18c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:37:25.916306 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0626ff38-492c-42ec-b738-544533ce537f tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "GET /compute/v2.1/servers/1edf4c55-238d-404b-9331-69288e4fcdf6" status: 200 len: 1319 microversion: 2.1 time: 0.259365 Aug 04 17:37:25.917287 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3167/6306] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:37:25 2022] GET /compute/v2.1/servers/1edf4c55-238d-404b-9331-69288e4fcdf6 => generated 1319 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:37:26.942332 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-68131552-57a9-4989-afff-19bff3260362 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:37:26.943037 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-68131552-57a9-4989-afff-19bff3260362 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: 1edf4c55-238d-404b-9331-69288e4fcdf6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:37:26.950438 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68131552-57a9-4989-afff-19bff3260362 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:26.950939 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68131552-57a9-4989-afff-19bff3260362 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:26.951398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68131552-57a9-4989-afff-19bff3260362 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:26.952714 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68131552-57a9-4989-afff-19bff3260362 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:26.953178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68131552-57a9-4989-afff-19bff3260362 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:26.953610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68131552-57a9-4989-afff-19bff3260362 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:27.133071 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-68131552-57a9-4989-afff-19bff3260362 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbb670b4af94c7d93b5110672eab987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09d3ba1af2c44df94fc95238f2bb18c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:37:27.141909 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-68131552-57a9-4989-afff-19bff3260362 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "GET /compute/v2.1/servers/1edf4c55-238d-404b-9331-69288e4fcdf6" status: 200 len: 1319 microversion: 2.1 time: 0.203986 Aug 04 17:37:27.142608 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3140/6307] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:37:26 2022] GET /compute/v2.1/servers/1edf4c55-238d-404b-9331-69288e4fcdf6 => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:37:27.740826 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-d4f268ac-4b5b-457a-a620-6d8bcc0909ce req-a4c18be7-b64c-4c36-9ad6-64ca5563a911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1edf4c55-238d-404b-9331-69288e4fcdf6", "name": "network-vif-plugged", "status": "completed", "tag": "6afbb5ba-4f25-4cc4-8d9e-e7bd78fb9307"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:37:27.756583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d4f268ac-4b5b-457a-a620-6d8bcc0909ce req-a4c18be7-b64c-4c36-9ad6-64ca5563a911 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:27.757173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d4f268ac-4b5b-457a-a620-6d8bcc0909ce req-a4c18be7-b64c-4c36-9ad6-64ca5563a911 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:27.757618 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d4f268ac-4b5b-457a-a620-6d8bcc0909ce req-a4c18be7-b64c-4c36-9ad6-64ca5563a911 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:27.770029 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-d4f268ac-4b5b-457a-a620-6d8bcc0909ce req-a4c18be7-b64c-4c36-9ad6-64ca5563a911 service nova] Creating event network-vif-plugged:6afbb5ba-4f25-4cc4-8d9e-e7bd78fb9307 for instance 1edf4c55-238d-404b-9331-69288e4fcdf6 on n-h1-851359-3 Aug 04 17:37:27.775112 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-d4f268ac-4b5b-457a-a620-6d8bcc0909ce req-a4c18be7-b64c-4c36-9ad6-64ca5563a911 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038203 Aug 04 17:37:27.775879 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3168/6308] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:37:28.163192 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bf51368b-a0c9-46f6-84c5-333884819a55 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:37:28.163794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bf51368b-a0c9-46f6-84c5-333884819a55 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: 1edf4c55-238d-404b-9331-69288e4fcdf6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:37:28.171461 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf51368b-a0c9-46f6-84c5-333884819a55 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:28.171958 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf51368b-a0c9-46f6-84c5-333884819a55 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:28.172395 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf51368b-a0c9-46f6-84c5-333884819a55 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:28.173100 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf51368b-a0c9-46f6-84c5-333884819a55 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:28.173556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf51368b-a0c9-46f6-84c5-333884819a55 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:28.173996 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf51368b-a0c9-46f6-84c5-333884819a55 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:28.338499 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bf51368b-a0c9-46f6-84c5-333884819a55 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbb670b4af94c7d93b5110672eab987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09d3ba1af2c44df94fc95238f2bb18c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:37:28.346826 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bf51368b-a0c9-46f6-84c5-333884819a55 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "GET /compute/v2.1/servers/1edf4c55-238d-404b-9331-69288e4fcdf6" status: 200 len: 1319 microversion: 2.1 time: 0.187399 Aug 04 17:37:28.353942 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3141/6309] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:37:28 2022] GET /compute/v2.1/servers/1edf4c55-238d-404b-9331-69288e4fcdf6 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:37:29.371116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ed5ca1e2-3b72-43d2-8008-4a44dd595007 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:37:29.371912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ed5ca1e2-3b72-43d2-8008-4a44dd595007 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: 1edf4c55-238d-404b-9331-69288e4fcdf6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:37:29.379471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed5ca1e2-3b72-43d2-8008-4a44dd595007 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:29.379984 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed5ca1e2-3b72-43d2-8008-4a44dd595007 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:29.380613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed5ca1e2-3b72-43d2-8008-4a44dd595007 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:29.381576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed5ca1e2-3b72-43d2-8008-4a44dd595007 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:29.382086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed5ca1e2-3b72-43d2-8008-4a44dd595007 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:29.382529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed5ca1e2-3b72-43d2-8008-4a44dd595007 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:29.565297 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ed5ca1e2-3b72-43d2-8008-4a44dd595007 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbb670b4af94c7d93b5110672eab987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09d3ba1af2c44df94fc95238f2bb18c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:37:29.583153 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ed5ca1e2-3b72-43d2-8008-4a44dd595007 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "GET /compute/v2.1/servers/1edf4c55-238d-404b-9331-69288e4fcdf6" status: 200 len: 1507 microversion: 2.1 time: 0.217933 Aug 04 17:37:29.583891 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3169/6310] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:37:29 2022] GET /compute/v2.1/servers/1edf4c55-238d-404b-9331-69288e4fcdf6 => generated 1507 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:37:50.624825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e64a2ec5-7fc0-4191-bf9d-9fad9c375484 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14237f82-45a9-4cb3-9bb2-ee761f57c7f3", "device": "/dev/sdb"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:37:50.627483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e64a2ec5-7fc0-4191-bf9d-9fad9c375484 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: 1edf4c55-238d-404b-9331-69288e4fcdf6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:37:50.630002 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:37:50.630857 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:37:50.631601 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:37:50.632368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=28 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:37:50.640647 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e64a2ec5-7fc0-4191-bf9d-9fad9c375484 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:50.641246 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e64a2ec5-7fc0-4191-bf9d-9fad9c375484 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:50.642012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e64a2ec5-7fc0-4191-bf9d-9fad9c375484 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:50.642898 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e64a2ec5-7fc0-4191-bf9d-9fad9c375484 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:37:50.643359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e64a2ec5-7fc0-4191-bf9d-9fad9c375484 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:37:50.643772 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e64a2ec5-7fc0-4191-bf9d-9fad9c375484 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:37:51.002250 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e64a2ec5-7fc0-4191-bf9d-9fad9c375484 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "POST /compute/v2.1/servers/1edf4c55-238d-404b-9331-69288e4fcdf6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.381922 Aug 04 17:37:51.007952 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3142/6311] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Aug 4 17:37:50 2022] POST /compute/v2.1/servers/1edf4c55-238d-404b-9331-69288e4fcdf6/os-volume_attachments => generated 194 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:38:13.733905 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-54a61306-bbca-4a78-94b6-3575d4492b0b tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Action: 'create', calling method: .version_select at 0x7f1e5b9d8550>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-2108366700", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHl9Zk9z5jXZlF5Br8QV9GumhYx4+BXeRjIDJWoeEGP9KFjuBqW4xH0EJKmyEjxFm0tsDnCyI/6phdcmgCranWVmCd1zPlwQ3JkiDn5br1SR7I9mWuEWRJhMWxFj4WF/WA=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:38:13.743551 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:38:13.746252 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=14 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:38:13.747255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=26 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:38:13.759314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-54a61306-bbca-4a78-94b6-3575d4492b0b tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Getting quotas for project 34e8142b7e4445d2bcf865c6fd26d02f. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:38:13.765272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-54a61306-bbca-4a78-94b6-3575d4492b0b tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Getting quotas for user 57bb016e92cb46f2b1eb4f99f3f7a327 and project 34e8142b7e4445d2bcf865c6fd26d02f. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:38:13.792125 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-54a61306-bbca-4a78-94b6-3575d4492b0b tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.062309 Aug 04 17:38:13.792653 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3170/6312] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:38:13 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:38:15.211588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:38:15.212733 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:38:15.217483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bf19b4f3-2c49-4800-94c9-4bc6acbfc703 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-110745216", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "70c30b12-bdd0-49d6-8f4e-ffa68c3af48e", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-2108366700", "security_groups": [{"name": "tempest-secgroup-smoke-845323708"}], "networks": [{"uuid": "95ca6c3e-1089-4cde-8411-4d6dd3417e47"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:38:15.348952 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-bf19b4f3-2c49-4800-94c9-4bc6acbfc703 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] validate_networks() for [('95ca6c3e-1089-4cde-8411-4d6dd3417e47', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:38:15.828233 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-bf19b4f3-2c49-4800-94c9-4bc6acbfc703 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:38:15.828808 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-bf19b4f3-2c49-4800-94c9-4bc6acbfc703 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:38:15.829393 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-bf19b4f3-2c49-4800-94c9-4bc6acbfc703 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:38:15.829918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-bf19b4f3-2c49-4800-94c9-4bc6acbfc703 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:38:15.830467 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-bf19b4f3-2c49-4800-94c9-4bc6acbfc703 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:38:15.843318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf19b4f3-2c49-4800-94c9-4bc6acbfc703 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:15.843978 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf19b4f3-2c49-4800-94c9-4bc6acbfc703 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:15.844519 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf19b4f3-2c49-4800-94c9-4bc6acbfc703 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:15.845516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf19b4f3-2c49-4800-94c9-4bc6acbfc703 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:15.846116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf19b4f3-2c49-4800-94c9-4bc6acbfc703 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:15.846816 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf19b4f3-2c49-4800-94c9-4bc6acbfc703 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:15.866516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-bf19b4f3-2c49-4800-94c9-4bc6acbfc703 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Getting quotas for project 34e8142b7e4445d2bcf865c6fd26d02f. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:38:15.881887 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-bf19b4f3-2c49-4800-94c9-4bc6acbfc703 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Getting quotas for user 57bb016e92cb46f2b1eb4f99f3f7a327 and project 34e8142b7e4445d2bcf865c6fd26d02f. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:38:15.974489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bf19b4f3-2c49-4800-94c9-4bc6acbfc703 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:38:15.977365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bf19b4f3-2c49-4800-94c9-4bc6acbfc703 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='70c30b12-bdd0-49d6-8f4e-ffa68c3af48e',volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:38:16.188857 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bf19b4f3-2c49-4800-94c9-4bc6acbfc703 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.962274 Aug 04 17:38:16.195402 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3143/6313] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:38:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:38:16.203995 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f7d3fab9-0f33-42cc-b934-a78dfa316c80 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:16.205061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f7d3fab9-0f33-42cc-b934-a78dfa316c80 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:16.291247 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f7d3fab9-0f33-42cc-b934-a78dfa316c80 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bb016e92cb46f2b1eb4f99f3f7a327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e8142b7e4445d2bcf865c6fd26d02f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:16.299593 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f7d3fab9-0f33-42cc-b934-a78dfa316c80 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf" status: 200 len: 1098 microversion: 2.1 time: 0.101610 Aug 04 17:38:16.299975 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3171/6314] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:16 2022] GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf => generated 1098 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:38:17.320678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-87aaeef1-568e-40b2-a765-f5f37c90fbfb tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:17.321710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-87aaeef1-568e-40b2-a765-f5f37c90fbfb tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:17.331899 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87aaeef1-568e-40b2-a765-f5f37c90fbfb tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:17.332430 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87aaeef1-568e-40b2-a765-f5f37c90fbfb tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:17.332874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87aaeef1-568e-40b2-a765-f5f37c90fbfb tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:17.333582 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87aaeef1-568e-40b2-a765-f5f37c90fbfb tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:17.334909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87aaeef1-568e-40b2-a765-f5f37c90fbfb tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:17.334909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87aaeef1-568e-40b2-a765-f5f37c90fbfb tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:17.409779 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-87aaeef1-568e-40b2-a765-f5f37c90fbfb tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bb016e92cb46f2b1eb4f99f3f7a327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e8142b7e4445d2bcf865c6fd26d02f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:17.419401 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-87aaeef1-568e-40b2-a765-f5f37c90fbfb tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf" status: 200 len: 1196 microversion: 2.1 time: 0.102709 Aug 04 17:38:17.419989 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3144/6315] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:17 2022] GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf => generated 1196 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:38:17.692468 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-67fb283e-f8f0-4877-b137-bd54533aa9d4 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:17.693116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-67fb283e-f8f0-4877-b137-bd54533aa9d4 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: 1edf4c55-238d-404b-9331-69288e4fcdf6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:17.702795 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-67fb283e-f8f0-4877-b137-bd54533aa9d4 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:17.703544 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-67fb283e-f8f0-4877-b137-bd54533aa9d4 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:17.704209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-67fb283e-f8f0-4877-b137-bd54533aa9d4 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:17.705244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-67fb283e-f8f0-4877-b137-bd54533aa9d4 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:17.705948 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-67fb283e-f8f0-4877-b137-bd54533aa9d4 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:17.707009 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-67fb283e-f8f0-4877-b137-bd54533aa9d4 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:17.833226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-67fb283e-f8f0-4877-b137-bd54533aa9d4 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lazy-loading 'services' on Instance uuid 1edf4c55-238d-404b-9331-69288e4fcdf6 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:38:17.929038 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-67fb283e-f8f0-4877-b137-bd54533aa9d4 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "DELETE /compute/v2.1/servers/1edf4c55-238d-404b-9331-69288e4fcdf6/os-volume_attachments/14237f82-45a9-4cb3-9bb2-ee761f57c7f3" status: 202 len: 0 microversion: 2.1 time: 0.240520 Aug 04 17:38:17.930001 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3172/6316] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Aug 4 17:38:17 2022] DELETE /compute/v2.1/servers/1edf4c55-238d-404b-9331-69288e4fcdf6/os-volume_attachments/14237f82-45a9-4cb3-9bb2-ee761f57c7f3 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:38:18.442448 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f0376f31-e2f6-4caf-8b1f-0b6b02640ef2 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:18.443666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f0376f31-e2f6-4caf-8b1f-0b6b02640ef2 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:18.457837 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0376f31-e2f6-4caf-8b1f-0b6b02640ef2 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:18.468372 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0376f31-e2f6-4caf-8b1f-0b6b02640ef2 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:18.468372 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0376f31-e2f6-4caf-8b1f-0b6b02640ef2 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:18.468372 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0376f31-e2f6-4caf-8b1f-0b6b02640ef2 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:18.468372 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0376f31-e2f6-4caf-8b1f-0b6b02640ef2 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:18.468372 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0376f31-e2f6-4caf-8b1f-0b6b02640ef2 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:18.835285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f0376f31-e2f6-4caf-8b1f-0b6b02640ef2 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bb016e92cb46f2b1eb4f99f3f7a327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e8142b7e4445d2bcf865c6fd26d02f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:18.846180 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f0376f31-e2f6-4caf-8b1f-0b6b02640ef2 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf" status: 200 len: 1281 microversion: 2.1 time: 0.405289 Aug 04 17:38:18.846797 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3145/6317] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:18 2022] GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf => generated 1281 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:38:19.339027 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-797a1f27-5761-4e07-bddf-94d3cecb2dc8 req-24060675-1e2f-492b-8a9d-cb38764dbb0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54b9baeb-d558-4c57-b8c6-50188fcc8daf", "tag": "7e5274de-fa79-4c61-b8eb-3c894bec8047"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:38:19.354773 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-797a1f27-5761-4e07-bddf-94d3cecb2dc8 req-24060675-1e2f-492b-8a9d-cb38764dbb0a service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:19.355732 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-797a1f27-5761-4e07-bddf-94d3cecb2dc8 req-24060675-1e2f-492b-8a9d-cb38764dbb0a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:19.356462 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-797a1f27-5761-4e07-bddf-94d3cecb2dc8 req-24060675-1e2f-492b-8a9d-cb38764dbb0a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:19.369473 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-797a1f27-5761-4e07-bddf-94d3cecb2dc8 req-24060675-1e2f-492b-8a9d-cb38764dbb0a service nova] Creating event network-changed:7e5274de-fa79-4c61-b8eb-3c894bec8047 for instance 54b9baeb-d558-4c57-b8c6-50188fcc8daf on n-h2-851359-3 Aug 04 17:38:19.377158 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-797a1f27-5761-4e07-bddf-94d3cecb2dc8 req-24060675-1e2f-492b-8a9d-cb38764dbb0a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042731 Aug 04 17:38:19.378336 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3173/6318] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:38:19.867878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8dcba94e-778a-466d-9651-08f595eaa7cb tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:19.869274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8dcba94e-778a-466d-9651-08f595eaa7cb tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:19.877441 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dcba94e-778a-466d-9651-08f595eaa7cb tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:19.878411 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dcba94e-778a-466d-9651-08f595eaa7cb tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:19.879081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dcba94e-778a-466d-9651-08f595eaa7cb tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:19.879921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dcba94e-778a-466d-9651-08f595eaa7cb tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:19.880495 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dcba94e-778a-466d-9651-08f595eaa7cb tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:19.881154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dcba94e-778a-466d-9651-08f595eaa7cb tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:20.135291 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8dcba94e-778a-466d-9651-08f595eaa7cb tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bb016e92cb46f2b1eb4f99f3f7a327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e8142b7e4445d2bcf865c6fd26d02f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:20.142481 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8dcba94e-778a-466d-9651-08f595eaa7cb tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf" status: 200 len: 1281 microversion: 2.1 time: 0.278376 Aug 04 17:38:20.143517 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3146/6319] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:19 2022] GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf => generated 1281 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:38:21.165576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6cfbf050-4d86-45ef-a1ad-6a52573eb797 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:21.166487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6cfbf050-4d86-45ef-a1ad-6a52573eb797 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:21.173905 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6cfbf050-4d86-45ef-a1ad-6a52573eb797 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:21.174644 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6cfbf050-4d86-45ef-a1ad-6a52573eb797 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:21.175171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6cfbf050-4d86-45ef-a1ad-6a52573eb797 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:21.176670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6cfbf050-4d86-45ef-a1ad-6a52573eb797 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:21.177946 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6cfbf050-4d86-45ef-a1ad-6a52573eb797 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:21.178892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6cfbf050-4d86-45ef-a1ad-6a52573eb797 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:21.371017 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6cfbf050-4d86-45ef-a1ad-6a52573eb797 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bb016e92cb46f2b1eb4f99f3f7a327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e8142b7e4445d2bcf865c6fd26d02f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:21.379026 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6cfbf050-4d86-45ef-a1ad-6a52573eb797 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf" status: 200 len: 1281 microversion: 2.1 time: 0.218688 Aug 04 17:38:21.379865 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3174/6320] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:21 2022] GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf => generated 1281 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:38:22.402505 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8e87e2b5-155f-43e1-b624-d26a745058b0 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:22.403332 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8e87e2b5-155f-43e1-b624-d26a745058b0 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:22.412314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e87e2b5-155f-43e1-b624-d26a745058b0 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:22.412819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e87e2b5-155f-43e1-b624-d26a745058b0 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:22.413491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e87e2b5-155f-43e1-b624-d26a745058b0 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:22.414503 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e87e2b5-155f-43e1-b624-d26a745058b0 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:22.414908 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e87e2b5-155f-43e1-b624-d26a745058b0 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:22.415589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e87e2b5-155f-43e1-b624-d26a745058b0 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:22.597747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8e87e2b5-155f-43e1-b624-d26a745058b0 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bb016e92cb46f2b1eb4f99f3f7a327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e8142b7e4445d2bcf865c6fd26d02f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:22.609526 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8e87e2b5-155f-43e1-b624-d26a745058b0 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf" status: 200 len: 1281 microversion: 2.1 time: 0.212359 Aug 04 17:38:22.610855 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3147/6321] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:22 2022] GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf => generated 1281 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:38:23.255960 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c8fa40a3-517a-4a22-80f2-cf73b643551e tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:23.256576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c8fa40a3-517a-4a22-80f2-cf73b643551e tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: 1edf4c55-238d-404b-9331-69288e4fcdf6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:23.269072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8fa40a3-517a-4a22-80f2-cf73b643551e tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:23.269619 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8fa40a3-517a-4a22-80f2-cf73b643551e tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:23.270344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8fa40a3-517a-4a22-80f2-cf73b643551e tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:23.271145 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8fa40a3-517a-4a22-80f2-cf73b643551e tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:23.271558 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8fa40a3-517a-4a22-80f2-cf73b643551e tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:23.271983 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8fa40a3-517a-4a22-80f2-cf73b643551e tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:23.302492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c8fa40a3-517a-4a22-80f2-cf73b643551e tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: 1edf4c55-238d-404b-9331-69288e4fcdf6] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:38:23.416338 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c8fa40a3-517a-4a22-80f2-cf73b643551e tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "DELETE /compute/v2.1/servers/1edf4c55-238d-404b-9331-69288e4fcdf6" status: 204 len: 0 microversion: 2.1 time: 0.169510 Aug 04 17:38:23.417326 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3175/6322] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:38:23 2022] DELETE /compute/v2.1/servers/1edf4c55-238d-404b-9331-69288e4fcdf6 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:38:23.428635 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-32f0d6e9-9b1e-406b-907b-d0e29277e53e tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:23.429458 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-32f0d6e9-9b1e-406b-907b-d0e29277e53e tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: 1edf4c55-238d-404b-9331-69288e4fcdf6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:23.440214 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32f0d6e9-9b1e-406b-907b-d0e29277e53e tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:23.440873 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32f0d6e9-9b1e-406b-907b-d0e29277e53e tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:23.441408 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32f0d6e9-9b1e-406b-907b-d0e29277e53e tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:23.442258 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32f0d6e9-9b1e-406b-907b-d0e29277e53e tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:23.442828 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32f0d6e9-9b1e-406b-907b-d0e29277e53e tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:23.443342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32f0d6e9-9b1e-406b-907b-d0e29277e53e tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:23.625169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-32f0d6e9-9b1e-406b-907b-d0e29277e53e tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbb670b4af94c7d93b5110672eab987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09d3ba1af2c44df94fc95238f2bb18c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:23.640161 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-32f0d6e9-9b1e-406b-907b-d0e29277e53e tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "GET /compute/v2.1/servers/1edf4c55-238d-404b-9331-69288e4fcdf6" status: 200 len: 1513 microversion: 2.1 time: 0.216253 Aug 04 17:38:23.641470 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3148/6323] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:23 2022] GET /compute/v2.1/servers/1edf4c55-238d-404b-9331-69288e4fcdf6 => generated 1513 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:38:23.642972 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f1e92560-2039-4131-9186-1ce1362a96d1 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:23.643698 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f1e92560-2039-4131-9186-1ce1362a96d1 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:23.654252 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1e92560-2039-4131-9186-1ce1362a96d1 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:23.655041 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1e92560-2039-4131-9186-1ce1362a96d1 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:23.655253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1e92560-2039-4131-9186-1ce1362a96d1 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:23.656009 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1e92560-2039-4131-9186-1ce1362a96d1 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:23.656495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1e92560-2039-4131-9186-1ce1362a96d1 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:23.657027 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1e92560-2039-4131-9186-1ce1362a96d1 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:23.816840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f1e92560-2039-4131-9186-1ce1362a96d1 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bb016e92cb46f2b1eb4f99f3f7a327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e8142b7e4445d2bcf865c6fd26d02f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:23.826440 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f1e92560-2039-4131-9186-1ce1362a96d1 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf" status: 200 len: 1281 microversion: 2.1 time: 0.187700 Aug 04 17:38:23.827358 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3176/6324] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:23 2022] GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf => generated 1281 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:38:24.662228 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d5112ccd-666e-4baf-acc5-30b177a28bfd tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:24.662899 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d5112ccd-666e-4baf-acc5-30b177a28bfd tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: 1edf4c55-238d-404b-9331-69288e4fcdf6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:24.670255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5112ccd-666e-4baf-acc5-30b177a28bfd tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:24.670756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5112ccd-666e-4baf-acc5-30b177a28bfd tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:24.672028 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5112ccd-666e-4baf-acc5-30b177a28bfd tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:24.672849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5112ccd-666e-4baf-acc5-30b177a28bfd tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:24.673231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5112ccd-666e-4baf-acc5-30b177a28bfd tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:24.673673 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5112ccd-666e-4baf-acc5-30b177a28bfd tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:24.833003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d5112ccd-666e-4baf-acc5-30b177a28bfd tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbb670b4af94c7d93b5110672eab987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09d3ba1af2c44df94fc95238f2bb18c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:24.847324 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0ffe0d4b-f187-4dde-956f-c1dabb1d23d0 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:24.847945 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0ffe0d4b-f187-4dde-956f-c1dabb1d23d0 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:24.852346 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d5112ccd-666e-4baf-acc5-30b177a28bfd tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "GET /compute/v2.1/servers/1edf4c55-238d-404b-9331-69288e4fcdf6" status: 200 len: 1513 microversion: 2.1 time: 0.184454 Aug 04 17:38:24.852986 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3149/6325] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:24 2022] GET /compute/v2.1/servers/1edf4c55-238d-404b-9331-69288e4fcdf6 => generated 1513 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:38:24.859059 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ffe0d4b-f187-4dde-956f-c1dabb1d23d0 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:24.859849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ffe0d4b-f187-4dde-956f-c1dabb1d23d0 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:24.860505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ffe0d4b-f187-4dde-956f-c1dabb1d23d0 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:24.861433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ffe0d4b-f187-4dde-956f-c1dabb1d23d0 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:24.862171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ffe0d4b-f187-4dde-956f-c1dabb1d23d0 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:24.862815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ffe0d4b-f187-4dde-956f-c1dabb1d23d0 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:25.058293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0ffe0d4b-f187-4dde-956f-c1dabb1d23d0 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bb016e92cb46f2b1eb4f99f3f7a327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e8142b7e4445d2bcf865c6fd26d02f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:25.083677 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0ffe0d4b-f187-4dde-956f-c1dabb1d23d0 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf" status: 200 len: 1281 microversion: 2.1 time: 0.239004 Aug 04 17:38:25.098549 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3177/6326] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:24 2022] GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf => generated 1281 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:38:25.643668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-240ba0fa-5f03-4c7b-a355-7bb424e1dc75 req-039f8f18-a3a4-41f2-96fd-5ebe23f4dd90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1edf4c55-238d-404b-9331-69288e4fcdf6", "name": "network-vif-deleted", "tag": "6afbb5ba-4f25-4cc4-8d9e-e7bd78fb9307"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:38:25.658275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-240ba0fa-5f03-4c7b-a355-7bb424e1dc75 req-039f8f18-a3a4-41f2-96fd-5ebe23f4dd90 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:25.659069 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-240ba0fa-5f03-4c7b-a355-7bb424e1dc75 req-039f8f18-a3a4-41f2-96fd-5ebe23f4dd90 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:25.659762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-240ba0fa-5f03-4c7b-a355-7bb424e1dc75 req-039f8f18-a3a4-41f2-96fd-5ebe23f4dd90 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:25.673350 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-240ba0fa-5f03-4c7b-a355-7bb424e1dc75 req-039f8f18-a3a4-41f2-96fd-5ebe23f4dd90 service nova] Creating event network-vif-deleted:6afbb5ba-4f25-4cc4-8d9e-e7bd78fb9307 for instance 1edf4c55-238d-404b-9331-69288e4fcdf6 on n-h1-851359-3 Aug 04 17:38:25.679384 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-240ba0fa-5f03-4c7b-a355-7bb424e1dc75 req-039f8f18-a3a4-41f2-96fd-5ebe23f4dd90 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052870 Aug 04 17:38:25.680488 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3150/6327] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:38:25.875534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0f3fc963-d0a3-4cf1-a2dd-09ca24537d89 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:25.876172 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0f3fc963-d0a3-4cf1-a2dd-09ca24537d89 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: 1edf4c55-238d-404b-9331-69288e4fcdf6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:25.884596 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f3fc963-d0a3-4cf1-a2dd-09ca24537d89 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:25.885101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f3fc963-d0a3-4cf1-a2dd-09ca24537d89 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:25.885555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f3fc963-d0a3-4cf1-a2dd-09ca24537d89 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:25.886492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f3fc963-d0a3-4cf1-a2dd-09ca24537d89 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:25.887318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f3fc963-d0a3-4cf1-a2dd-09ca24537d89 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:25.888344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f3fc963-d0a3-4cf1-a2dd-09ca24537d89 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:25.923128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f3fc963-d0a3-4cf1-a2dd-09ca24537d89 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:25.923633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f3fc963-d0a3-4cf1-a2dd-09ca24537d89 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:25.924105 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f3fc963-d0a3-4cf1-a2dd-09ca24537d89 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:25.924548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-0f3fc963-d0a3-4cf1-a2dd-09ca24537d89 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lazy-loading 'fault' on Instance uuid 1edf4c55-238d-404b-9331-69288e4fcdf6 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:38:25.966654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0f3fc963-d0a3-4cf1-a2dd-09ca24537d89 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbb670b4af94c7d93b5110672eab987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09d3ba1af2c44df94fc95238f2bb18c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:25.974493 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0f3fc963-d0a3-4cf1-a2dd-09ca24537d89 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "GET /compute/v2.1/servers/1edf4c55-238d-404b-9331-69288e4fcdf6" status: 200 len: 1309 microversion: 2.1 time: 0.103784 Aug 04 17:38:25.975086 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3178/6328] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:25 2022] GET /compute/v2.1/servers/1edf4c55-238d-404b-9331-69288e4fcdf6 => generated 1309 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:38:26.121732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f61305d2-e754-44ae-99b8-b662e45eacf0 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:26.122831 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f61305d2-e754-44ae-99b8-b662e45eacf0 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:26.126058 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:38:26.129265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:38:26.141281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f61305d2-e754-44ae-99b8-b662e45eacf0 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:26.141790 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f61305d2-e754-44ae-99b8-b662e45eacf0 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:26.149903 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f61305d2-e754-44ae-99b8-b662e45eacf0 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:26.150819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f61305d2-e754-44ae-99b8-b662e45eacf0 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:26.151320 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f61305d2-e754-44ae-99b8-b662e45eacf0 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:26.151777 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f61305d2-e754-44ae-99b8-b662e45eacf0 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:26.393124 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f61305d2-e754-44ae-99b8-b662e45eacf0 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bb016e92cb46f2b1eb4f99f3f7a327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e8142b7e4445d2bcf865c6fd26d02f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:26.401161 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f61305d2-e754-44ae-99b8-b662e45eacf0 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf" status: 200 len: 1281 microversion: 2.1 time: 0.299466 Aug 04 17:38:26.402341 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3151/6329] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:26 2022] GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf => generated 1281 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:38:26.996926 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-defb30a6-73a0-4767-8ad7-512f0d7d6a20 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:26.997635 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-defb30a6-73a0-4767-8ad7-512f0d7d6a20 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: 1edf4c55-238d-404b-9331-69288e4fcdf6] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:27.000291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:38:27.006449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-defb30a6-73a0-4767-8ad7-512f0d7d6a20 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:27.006948 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-defb30a6-73a0-4767-8ad7-512f0d7d6a20 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:27.007392 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-defb30a6-73a0-4767-8ad7-512f0d7d6a20 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:27.008137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-defb30a6-73a0-4767-8ad7-512f0d7d6a20 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:27.008599 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-defb30a6-73a0-4767-8ad7-512f0d7d6a20 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:27.009033 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-defb30a6-73a0-4767-8ad7-512f0d7d6a20 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:27.023944 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-defb30a6-73a0-4767-8ad7-512f0d7d6a20 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] HTTP exception thrown: Instance 1edf4c55-238d-404b-9331-69288e4fcdf6 could not be found. Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-defb30a6-73a0-4767-8ad7-512f0d7d6a20 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Request method failure captured: Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/1edf4c55-238d-404b-9331-69288e4fcdf6 HTTP/1.1 Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7AN6LgkCTRusTgGcVaBONiX-tBmiufe91nqwwOftZ-KROgd36VSC5mQsZ_a7g_29kN9B0D7D6r9nkzMk5EIo2UCrGmbNq1HBsAFfl5Qe-RjdyxVjjE7TGWN-cZYZY3xyzVGLj3KUzrUQ5LpU0RodO-n6MRFIA3mAeEQct4GKHa9cuN4 Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: a09d3ba1af2c44df94fc95238f2bb18c Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-VolumesSnapshotTestJSON-782156123 Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a09d3ba1af2c44df94fc95238f2bb18c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a09d3ba1af2c44df94fc95238f2bb18c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a09d3ba1af2c44df94fc95238f2bb18c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a09d3ba1af2c44df94fc95238f2bb18c"}]}] Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-VolumesSnapshotTestJSON-782156123 Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: a09d3ba1af2c44df94fc95238f2bb18c Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-782156123 Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-VolumesSnapshotTestJSON-782156123-project Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 3bbb670b4af94c7d93b5110672eab987 Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-VolumesSnapshotTestJSON-782156123-project Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 1edf4c55-238d-404b-9331-69288e4fcdf6 could not be found. Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '1edf4c55-238d-404b-9331-69288e4fcdf6'} Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1edf4c55-238d-404b-9331-69288e4fcdf6 could not be found. Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1edf4c55-238d-404b-9331-69288e4fcdf6 could not be found. Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:38:27.025596 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:38:27.030629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:38:27.030629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:38:27.030629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:38:27.030629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:38:27.030629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:38:27.030629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1edf4c55-238d-404b-9331-69288e4fcdf6 could not be found. Aug 04 17:38:27.030629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:38:27.030629 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-defb30a6-73a0-4767-8ad7-512f0d7d6a20 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Returning 404 to user: Instance 1edf4c55-238d-404b-9331-69288e4fcdf6 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:38:27.030629 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-defb30a6-73a0-4767-8ad7-512f0d7d6a20 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "GET /compute/v2.1/servers/1edf4c55-238d-404b-9331-69288e4fcdf6" status: 404 len: 111 microversion: 2.1 time: 0.034786 Aug 04 17:38:27.030629 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3179/6330] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:26 2022] GET /compute/v2.1/servers/1edf4c55-238d-404b-9331-69288e4fcdf6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:38:27.430420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f911f2a0-9580-424b-ba41-a9bb2c955aad tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:27.431056 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f911f2a0-9580-424b-ba41-a9bb2c955aad tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:27.438213 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f911f2a0-9580-424b-ba41-a9bb2c955aad tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:27.438708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f911f2a0-9580-424b-ba41-a9bb2c955aad tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:27.439156 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f911f2a0-9580-424b-ba41-a9bb2c955aad tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:27.439906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f911f2a0-9580-424b-ba41-a9bb2c955aad tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:27.440353 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f911f2a0-9580-424b-ba41-a9bb2c955aad tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:27.440780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f911f2a0-9580-424b-ba41-a9bb2c955aad tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:27.634472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f911f2a0-9580-424b-ba41-a9bb2c955aad tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bb016e92cb46f2b1eb4f99f3f7a327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e8142b7e4445d2bcf865c6fd26d02f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:27.644993 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f911f2a0-9580-424b-ba41-a9bb2c955aad tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf" status: 200 len: 1281 microversion: 2.1 time: 0.219479 Aug 04 17:38:27.646188 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3152/6331] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:27 2022] GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf => generated 1281 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:38:28.669771 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f06a22df-08b6-42dc-81ea-26f3419750c5 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:28.671051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f06a22df-08b6-42dc-81ea-26f3419750c5 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:28.698617 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f06a22df-08b6-42dc-81ea-26f3419750c5 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:28.699232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f06a22df-08b6-42dc-81ea-26f3419750c5 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:28.699757 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f06a22df-08b6-42dc-81ea-26f3419750c5 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:28.701598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f06a22df-08b6-42dc-81ea-26f3419750c5 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:28.703002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f06a22df-08b6-42dc-81ea-26f3419750c5 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:28.703582 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f06a22df-08b6-42dc-81ea-26f3419750c5 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:28.897454 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f06a22df-08b6-42dc-81ea-26f3419750c5 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bb016e92cb46f2b1eb4f99f3f7a327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e8142b7e4445d2bcf865c6fd26d02f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:28.907556 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f06a22df-08b6-42dc-81ea-26f3419750c5 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf" status: 200 len: 1269 microversion: 2.1 time: 0.244370 Aug 04 17:38:28.908511 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3180/6332] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:28 2022] GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf => generated 1269 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:38:29.929045 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d9fefd32-7775-4fb4-a0da-d29549868231 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:29.929686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d9fefd32-7775-4fb4-a0da-d29549868231 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:29.937890 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9fefd32-7775-4fb4-a0da-d29549868231 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:29.938456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9fefd32-7775-4fb4-a0da-d29549868231 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:29.938896 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9fefd32-7775-4fb4-a0da-d29549868231 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:29.939645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9fefd32-7775-4fb4-a0da-d29549868231 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:29.940118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9fefd32-7775-4fb4-a0da-d29549868231 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:29.940560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9fefd32-7775-4fb4-a0da-d29549868231 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:30.097344 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d9fefd32-7775-4fb4-a0da-d29549868231 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bb016e92cb46f2b1eb4f99f3f7a327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e8142b7e4445d2bcf865c6fd26d02f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:30.106173 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d9fefd32-7775-4fb4-a0da-d29549868231 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf" status: 200 len: 1269 microversion: 2.1 time: 0.181051 Aug 04 17:38:30.107126 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3153/6333] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:29 2022] GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf => generated 1269 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:38:31.128962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ebb4e242-415e-4063-a93b-ece6b46b46ad tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:31.129656 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ebb4e242-415e-4063-a93b-ece6b46b46ad tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:31.136769 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ebb4e242-415e-4063-a93b-ece6b46b46ad tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:31.137299 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ebb4e242-415e-4063-a93b-ece6b46b46ad tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:31.137740 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ebb4e242-415e-4063-a93b-ece6b46b46ad tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:31.138499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ebb4e242-415e-4063-a93b-ece6b46b46ad tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:31.139060 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ebb4e242-415e-4063-a93b-ece6b46b46ad tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:31.139411 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ebb4e242-415e-4063-a93b-ece6b46b46ad tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:31.278059 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ebb4e242-415e-4063-a93b-ece6b46b46ad tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bb016e92cb46f2b1eb4f99f3f7a327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e8142b7e4445d2bcf865c6fd26d02f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:31.286872 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ebb4e242-415e-4063-a93b-ece6b46b46ad tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf" status: 200 len: 1269 microversion: 2.1 time: 0.162482 Aug 04 17:38:31.287476 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3181/6334] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:31 2022] GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf => generated 1269 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:38:32.307948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7cf50db7-0c7f-4608-a628-6cced01ae310 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:32.308591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7cf50db7-0c7f-4608-a628-6cced01ae310 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:32.316203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cf50db7-0c7f-4608-a628-6cced01ae310 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:32.316695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cf50db7-0c7f-4608-a628-6cced01ae310 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:32.317140 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cf50db7-0c7f-4608-a628-6cced01ae310 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:32.318299 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cf50db7-0c7f-4608-a628-6cced01ae310 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:32.318768 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cf50db7-0c7f-4608-a628-6cced01ae310 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:32.320147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cf50db7-0c7f-4608-a628-6cced01ae310 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:32.492524 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7cf50db7-0c7f-4608-a628-6cced01ae310 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bb016e92cb46f2b1eb4f99f3f7a327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e8142b7e4445d2bcf865c6fd26d02f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:32.502588 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7cf50db7-0c7f-4608-a628-6cced01ae310 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf" status: 200 len: 1269 microversion: 2.1 time: 0.198436 Aug 04 17:38:32.504418 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3154/6335] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:32 2022] GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf => generated 1269 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:38:33.536111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6da082eb-6cf1-450e-b54b-7a5e1ac62698 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:33.536798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6da082eb-6cf1-450e-b54b-7a5e1ac62698 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:33.544309 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6da082eb-6cf1-450e-b54b-7a5e1ac62698 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:33.544845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6da082eb-6cf1-450e-b54b-7a5e1ac62698 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:33.545292 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6da082eb-6cf1-450e-b54b-7a5e1ac62698 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:33.546061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6da082eb-6cf1-450e-b54b-7a5e1ac62698 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:33.546685 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6da082eb-6cf1-450e-b54b-7a5e1ac62698 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:33.547127 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6da082eb-6cf1-450e-b54b-7a5e1ac62698 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:33.709527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6da082eb-6cf1-450e-b54b-7a5e1ac62698 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bb016e92cb46f2b1eb4f99f3f7a327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e8142b7e4445d2bcf865c6fd26d02f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:33.721515 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6da082eb-6cf1-450e-b54b-7a5e1ac62698 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf" status: 200 len: 1269 microversion: 2.1 time: 0.189158 Aug 04 17:38:33.722172 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3182/6336] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:33 2022] GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf => generated 1269 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:38:34.001943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4dad703d-5982-4fd3-961e-53de845cbe06 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-611253880", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "8d2f9d0a-cb21-47de-9025-5745c4afed0c"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:38:34.074292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-4dad703d-5982-4fd3-961e-53de845cbe06 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] validate_networks() for [('8d2f9d0a-cb21-47de-9025-5745c4afed0c', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:38:34.470211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-4dad703d-5982-4fd3-961e-53de845cbe06 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:38:34.470918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-4dad703d-5982-4fd3-961e-53de845cbe06 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:38:34.471541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-4dad703d-5982-4fd3-961e-53de845cbe06 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:38:34.472104 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-4dad703d-5982-4fd3-961e-53de845cbe06 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:38:34.472799 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-4dad703d-5982-4fd3-961e-53de845cbe06 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:38:34.488556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dad703d-5982-4fd3-961e-53de845cbe06 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:34.489373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dad703d-5982-4fd3-961e-53de845cbe06 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:34.490160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dad703d-5982-4fd3-961e-53de845cbe06 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:34.491216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dad703d-5982-4fd3-961e-53de845cbe06 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:34.491813 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dad703d-5982-4fd3-961e-53de845cbe06 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:34.492346 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dad703d-5982-4fd3-961e-53de845cbe06 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:34.510993 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-4dad703d-5982-4fd3-961e-53de845cbe06 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Getting quotas for project a09d3ba1af2c44df94fc95238f2bb18c. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:38:34.516519 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-4dad703d-5982-4fd3-961e-53de845cbe06 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Getting quotas for user 3bbb670b4af94c7d93b5110672eab987 and project a09d3ba1af2c44df94fc95238f2bb18c. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:38:34.530007 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4dad703d-5982-4fd3-961e-53de845cbe06 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:38:34.532823 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4dad703d-5982-4fd3-961e-53de845cbe06 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: bc6fdd7e-c666-48b4-b12b-383acf30d667] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:38:34.579491 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4dad703d-5982-4fd3-961e-53de845cbe06 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.582101 Aug 04 17:38:34.580473 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3155/6337] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:38:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:38:34.591454 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5000ab3d-128c-4063-b446-975d0e4f52ce tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:34.601819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5000ab3d-128c-4063-b446-975d0e4f52ce tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: bc6fdd7e-c666-48b4-b12b-383acf30d667] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:34.666069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5000ab3d-128c-4063-b446-975d0e4f52ce tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbb670b4af94c7d93b5110672eab987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09d3ba1af2c44df94fc95238f2bb18c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:34.675074 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5000ab3d-128c-4063-b446-975d0e4f52ce tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "GET /compute/v2.1/servers/bc6fdd7e-c666-48b4-b12b-383acf30d667" status: 200 len: 1218 microversion: 2.1 time: 0.087750 Aug 04 17:38:34.682180 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3183/6338] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:34 2022] GET /compute/v2.1/servers/bc6fdd7e-c666-48b4-b12b-383acf30d667 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:38:34.743234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d728e3a2-8f1a-4158-9c1a-127184098e99 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:34.743920 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d728e3a2-8f1a-4158-9c1a-127184098e99 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:34.750596 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d728e3a2-8f1a-4158-9c1a-127184098e99 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:34.751098 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d728e3a2-8f1a-4158-9c1a-127184098e99 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:34.751550 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d728e3a2-8f1a-4158-9c1a-127184098e99 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:34.752266 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d728e3a2-8f1a-4158-9c1a-127184098e99 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:34.752734 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d728e3a2-8f1a-4158-9c1a-127184098e99 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:34.753176 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d728e3a2-8f1a-4158-9c1a-127184098e99 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:34.912570 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d728e3a2-8f1a-4158-9c1a-127184098e99 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bb016e92cb46f2b1eb4f99f3f7a327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e8142b7e4445d2bcf865c6fd26d02f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:34.924358 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d728e3a2-8f1a-4158-9c1a-127184098e99 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf" status: 200 len: 1269 microversion: 2.1 time: 0.184997 Aug 04 17:38:34.939523 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3156/6339] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:34 2022] GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf => generated 1269 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:38:35.696044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d3fa5bfd-0a5e-470f-a38a-e759fee5e1bb tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:35.696687 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d3fa5bfd-0a5e-470f-a38a-e759fee5e1bb tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: bc6fdd7e-c666-48b4-b12b-383acf30d667] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:35.710947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3fa5bfd-0a5e-470f-a38a-e759fee5e1bb tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:35.711487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3fa5bfd-0a5e-470f-a38a-e759fee5e1bb tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:35.711960 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3fa5bfd-0a5e-470f-a38a-e759fee5e1bb tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:35.714172 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3fa5bfd-0a5e-470f-a38a-e759fee5e1bb tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:35.714676 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3fa5bfd-0a5e-470f-a38a-e759fee5e1bb tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:35.715137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3fa5bfd-0a5e-470f-a38a-e759fee5e1bb tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:35.790283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d3fa5bfd-0a5e-470f-a38a-e759fee5e1bb tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbb670b4af94c7d93b5110672eab987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09d3ba1af2c44df94fc95238f2bb18c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:35.800115 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d3fa5bfd-0a5e-470f-a38a-e759fee5e1bb tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "GET /compute/v2.1/servers/bc6fdd7e-c666-48b4-b12b-383acf30d667" status: 200 len: 1278 microversion: 2.1 time: 0.108158 Aug 04 17:38:35.800875 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3184/6340] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:35 2022] GET /compute/v2.1/servers/bc6fdd7e-c666-48b4-b12b-383acf30d667 => generated 1278 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:38:35.948663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a09dce30-9382-4109-a3b7-04b4a6a5791e tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:35.949904 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a09dce30-9382-4109-a3b7-04b4a6a5791e tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:35.959940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a09dce30-9382-4109-a3b7-04b4a6a5791e tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:35.960876 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a09dce30-9382-4109-a3b7-04b4a6a5791e tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:35.961598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a09dce30-9382-4109-a3b7-04b4a6a5791e tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:35.962725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a09dce30-9382-4109-a3b7-04b4a6a5791e tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:35.963460 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a09dce30-9382-4109-a3b7-04b4a6a5791e tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:35.964252 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a09dce30-9382-4109-a3b7-04b4a6a5791e tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:36.225499 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a09dce30-9382-4109-a3b7-04b4a6a5791e tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bb016e92cb46f2b1eb4f99f3f7a327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e8142b7e4445d2bcf865c6fd26d02f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:36.241277 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a09dce30-9382-4109-a3b7-04b4a6a5791e tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf" status: 200 len: 1269 microversion: 2.1 time: 0.297312 Aug 04 17:38:36.242464 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3157/6341] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:35 2022] GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf => generated 1269 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:38:36.823355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c9a7bf26-0144-4c46-a33a-8005e8b439df tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:36.824478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c9a7bf26-0144-4c46-a33a-8005e8b439df tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: bc6fdd7e-c666-48b4-b12b-383acf30d667] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:36.834938 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9a7bf26-0144-4c46-a33a-8005e8b439df tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:36.835735 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9a7bf26-0144-4c46-a33a-8005e8b439df tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:36.836412 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9a7bf26-0144-4c46-a33a-8005e8b439df tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:36.837377 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9a7bf26-0144-4c46-a33a-8005e8b439df tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:36.838438 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9a7bf26-0144-4c46-a33a-8005e8b439df tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:36.839385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9a7bf26-0144-4c46-a33a-8005e8b439df tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:37.032021 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c9a7bf26-0144-4c46-a33a-8005e8b439df tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbb670b4af94c7d93b5110672eab987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09d3ba1af2c44df94fc95238f2bb18c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:37.040901 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c9a7bf26-0144-4c46-a33a-8005e8b439df tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "GET /compute/v2.1/servers/bc6fdd7e-c666-48b4-b12b-383acf30d667" status: 200 len: 1318 microversion: 2.1 time: 0.222863 Aug 04 17:38:37.043990 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3185/6342] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:36 2022] GET /compute/v2.1/servers/bc6fdd7e-c666-48b4-b12b-383acf30d667 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:38:37.263614 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-daafb247-798a-4e85-9d9c-a515430fe47c tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:37.264343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-daafb247-798a-4e85-9d9c-a515430fe47c tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:37.275065 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-daafb247-798a-4e85-9d9c-a515430fe47c tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:37.275776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-daafb247-798a-4e85-9d9c-a515430fe47c tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:37.276302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-daafb247-798a-4e85-9d9c-a515430fe47c tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:37.277142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-daafb247-798a-4e85-9d9c-a515430fe47c tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:37.277811 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-daafb247-798a-4e85-9d9c-a515430fe47c tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:37.278373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-daafb247-798a-4e85-9d9c-a515430fe47c tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:37.365599 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-074d43e3-17eb-42ac-9c97-c1988f74b99a req-50dcf8ba-ed63-4552-b64e-3bb8cbd01cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc6fdd7e-c666-48b4-b12b-383acf30d667", "tag": "889ab2c4-a862-403d-8cb5-41d39a002769"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:38:37.380875 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-074d43e3-17eb-42ac-9c97-c1988f74b99a req-50dcf8ba-ed63-4552-b64e-3bb8cbd01cd6 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:37.381687 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-074d43e3-17eb-42ac-9c97-c1988f74b99a req-50dcf8ba-ed63-4552-b64e-3bb8cbd01cd6 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:37.382407 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-074d43e3-17eb-42ac-9c97-c1988f74b99a req-50dcf8ba-ed63-4552-b64e-3bb8cbd01cd6 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:37.402476 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-074d43e3-17eb-42ac-9c97-c1988f74b99a req-50dcf8ba-ed63-4552-b64e-3bb8cbd01cd6 service nova] Creating event network-changed:889ab2c4-a862-403d-8cb5-41d39a002769 for instance bc6fdd7e-c666-48b4-b12b-383acf30d667 on n-h1-851359-3 Aug 04 17:38:37.408171 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-074d43e3-17eb-42ac-9c97-c1988f74b99a req-50dcf8ba-ed63-4552-b64e-3bb8cbd01cd6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046812 Aug 04 17:38:37.409130 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3186/6343] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:38:37.475800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-daafb247-798a-4e85-9d9c-a515430fe47c tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bb016e92cb46f2b1eb4f99f3f7a327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e8142b7e4445d2bcf865c6fd26d02f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:37.492644 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-daafb247-798a-4e85-9d9c-a515430fe47c tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf" status: 200 len: 1269 microversion: 2.1 time: 0.233436 Aug 04 17:38:37.493495 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3158/6344] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:37 2022] GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf => generated 1269 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:38:38.038009 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-b41cd6b4-2548-4745-a1ee-a35ee5d9dbbd req-32aedf10-0459-4342-9650-cce974e1878e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54b9baeb-d558-4c57-b8c6-50188fcc8daf", "name": "network-vif-plugged", "status": "completed", "tag": "7e5274de-fa79-4c61-b8eb-3c894bec8047"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:38:38.053379 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b41cd6b4-2548-4745-a1ee-a35ee5d9dbbd req-32aedf10-0459-4342-9650-cce974e1878e service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:38.054142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b41cd6b4-2548-4745-a1ee-a35ee5d9dbbd req-32aedf10-0459-4342-9650-cce974e1878e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:38.054872 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b41cd6b4-2548-4745-a1ee-a35ee5d9dbbd req-32aedf10-0459-4342-9650-cce974e1878e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:38.063244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a6c6d8ee-3274-4782-8127-b3f0602cb796 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:38.063648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a6c6d8ee-3274-4782-8127-b3f0602cb796 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: bc6fdd7e-c666-48b4-b12b-383acf30d667] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:38.071327 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-b41cd6b4-2548-4745-a1ee-a35ee5d9dbbd req-32aedf10-0459-4342-9650-cce974e1878e service nova] Creating event network-vif-plugged:7e5274de-fa79-4c61-b8eb-3c894bec8047 for instance 54b9baeb-d558-4c57-b8c6-50188fcc8daf on n-h2-851359-3 Aug 04 17:38:38.073910 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6c6d8ee-3274-4782-8127-b3f0602cb796 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:38.074451 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6c6d8ee-3274-4782-8127-b3f0602cb796 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:38.074903 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6c6d8ee-3274-4782-8127-b3f0602cb796 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:38.075646 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6c6d8ee-3274-4782-8127-b3f0602cb796 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:38.079807 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-b41cd6b4-2548-4745-a1ee-a35ee5d9dbbd req-32aedf10-0459-4342-9650-cce974e1878e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045605 Aug 04 17:38:38.080811 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3187/6345] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:38:38.081090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6c6d8ee-3274-4782-8127-b3f0602cb796 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:38.081749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6c6d8ee-3274-4782-8127-b3f0602cb796 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:38.291970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a6c6d8ee-3274-4782-8127-b3f0602cb796 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbb670b4af94c7d93b5110672eab987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09d3ba1af2c44df94fc95238f2bb18c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:38.301262 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a6c6d8ee-3274-4782-8127-b3f0602cb796 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "GET /compute/v2.1/servers/bc6fdd7e-c666-48b4-b12b-383acf30d667" status: 200 len: 1318 microversion: 2.1 time: 0.243032 Aug 04 17:38:38.301767 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3159/6346] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:38 2022] GET /compute/v2.1/servers/bc6fdd7e-c666-48b4-b12b-383acf30d667 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:38:38.519209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e6a760d7-53b7-4a21-9ef3-7dc9182567a7 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:38.520075 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e6a760d7-53b7-4a21-9ef3-7dc9182567a7 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:38.526791 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e6a760d7-53b7-4a21-9ef3-7dc9182567a7 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:38.527356 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e6a760d7-53b7-4a21-9ef3-7dc9182567a7 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:38.527770 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e6a760d7-53b7-4a21-9ef3-7dc9182567a7 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:38.528551 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e6a760d7-53b7-4a21-9ef3-7dc9182567a7 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:38.529035 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e6a760d7-53b7-4a21-9ef3-7dc9182567a7 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:38.529513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e6a760d7-53b7-4a21-9ef3-7dc9182567a7 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:38.683238 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e6a760d7-53b7-4a21-9ef3-7dc9182567a7 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bb016e92cb46f2b1eb4f99f3f7a327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e8142b7e4445d2bcf865c6fd26d02f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:38.691443 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e6a760d7-53b7-4a21-9ef3-7dc9182567a7 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf" status: 200 len: 1269 microversion: 2.1 time: 0.176816 Aug 04 17:38:38.692103 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3188/6347] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:38 2022] GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf => generated 1269 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:38:39.322990 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8c086f0f-12fe-4059-a2a9-dc0880fb0f41 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:39.323589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8c086f0f-12fe-4059-a2a9-dc0880fb0f41 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: bc6fdd7e-c666-48b4-b12b-383acf30d667] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:39.331719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c086f0f-12fe-4059-a2a9-dc0880fb0f41 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:39.332491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c086f0f-12fe-4059-a2a9-dc0880fb0f41 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:39.332792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c086f0f-12fe-4059-a2a9-dc0880fb0f41 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:39.333606 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c086f0f-12fe-4059-a2a9-dc0880fb0f41 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:39.334275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c086f0f-12fe-4059-a2a9-dc0880fb0f41 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:39.335056 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c086f0f-12fe-4059-a2a9-dc0880fb0f41 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:39.493019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8c086f0f-12fe-4059-a2a9-dc0880fb0f41 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbb670b4af94c7d93b5110672eab987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09d3ba1af2c44df94fc95238f2bb18c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:39.504847 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8c086f0f-12fe-4059-a2a9-dc0880fb0f41 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "GET /compute/v2.1/servers/bc6fdd7e-c666-48b4-b12b-383acf30d667" status: 200 len: 1318 microversion: 2.1 time: 0.186000 Aug 04 17:38:39.505438 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3160/6348] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:39 2022] GET /compute/v2.1/servers/bc6fdd7e-c666-48b4-b12b-383acf30d667 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:38:39.714000 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-99b79b49-e7c3-4926-8d05-1db2f4a0bbb6 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:39.714708 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-99b79b49-e7c3-4926-8d05-1db2f4a0bbb6 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:39.723629 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99b79b49-e7c3-4926-8d05-1db2f4a0bbb6 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:39.724134 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99b79b49-e7c3-4926-8d05-1db2f4a0bbb6 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:39.724598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99b79b49-e7c3-4926-8d05-1db2f4a0bbb6 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:39.725321 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99b79b49-e7c3-4926-8d05-1db2f4a0bbb6 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:39.725787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99b79b49-e7c3-4926-8d05-1db2f4a0bbb6 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:39.726247 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99b79b49-e7c3-4926-8d05-1db2f4a0bbb6 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:39.749588 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:38:39.891271 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-99b79b49-e7c3-4926-8d05-1db2f4a0bbb6 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bb016e92cb46f2b1eb4f99f3f7a327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e8142b7e4445d2bcf865c6fd26d02f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:39.901141 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-99b79b49-e7c3-4926-8d05-1db2f4a0bbb6 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf" status: 200 len: 1269 microversion: 2.1 time: 0.191360 Aug 04 17:38:39.901735 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3189/6349] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:39 2022] GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf => generated 1269 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:38:40.527516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-37581ea7-4f8f-4227-86f1-ceafd549e733 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:40.528147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-37581ea7-4f8f-4227-86f1-ceafd549e733 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: bc6fdd7e-c666-48b4-b12b-383acf30d667] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:40.542535 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37581ea7-4f8f-4227-86f1-ceafd549e733 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:40.544633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37581ea7-4f8f-4227-86f1-ceafd549e733 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:40.546886 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37581ea7-4f8f-4227-86f1-ceafd549e733 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:40.548118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37581ea7-4f8f-4227-86f1-ceafd549e733 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:40.548653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37581ea7-4f8f-4227-86f1-ceafd549e733 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:40.549088 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37581ea7-4f8f-4227-86f1-ceafd549e733 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:40.595943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:38:40.742545 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-37581ea7-4f8f-4227-86f1-ceafd549e733 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbb670b4af94c7d93b5110672eab987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09d3ba1af2c44df94fc95238f2bb18c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:40.750910 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-37581ea7-4f8f-4227-86f1-ceafd549e733 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "GET /compute/v2.1/servers/bc6fdd7e-c666-48b4-b12b-383acf30d667" status: 200 len: 1318 microversion: 2.1 time: 0.228319 Aug 04 17:38:40.751510 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3161/6350] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:40 2022] GET /compute/v2.1/servers/bc6fdd7e-c666-48b4-b12b-383acf30d667 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:38:40.924486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-58d66a2e-4bfd-46dd-ab5d-83a2b10a097e tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:40.925135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-58d66a2e-4bfd-46dd-ab5d-83a2b10a097e tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:40.932847 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-58d66a2e-4bfd-46dd-ab5d-83a2b10a097e tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:40.933344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-58d66a2e-4bfd-46dd-ab5d-83a2b10a097e tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:40.933787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-58d66a2e-4bfd-46dd-ab5d-83a2b10a097e tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:40.934674 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-58d66a2e-4bfd-46dd-ab5d-83a2b10a097e tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:40.935138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-58d66a2e-4bfd-46dd-ab5d-83a2b10a097e tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:40.935570 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-58d66a2e-4bfd-46dd-ab5d-83a2b10a097e tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:41.127497 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-58d66a2e-4bfd-46dd-ab5d-83a2b10a097e tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bb016e92cb46f2b1eb4f99f3f7a327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e8142b7e4445d2bcf865c6fd26d02f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:41.137612 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-58d66a2e-4bfd-46dd-ab5d-83a2b10a097e tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf" status: 200 len: 1458 microversion: 2.1 time: 0.217054 Aug 04 17:38:41.138509 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3190/6351] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:40 2022] GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf => generated 1458 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:38:41.162846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6f5903d6-8d83-47ae-8e03-5086527e14ff tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:41.163655 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6f5903d6-8d83-47ae-8e03-5086527e14ff tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:41.169938 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f5903d6-8d83-47ae-8e03-5086527e14ff tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:41.170656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f5903d6-8d83-47ae-8e03-5086527e14ff tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:41.171518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f5903d6-8d83-47ae-8e03-5086527e14ff tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:41.172466 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f5903d6-8d83-47ae-8e03-5086527e14ff tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:41.173431 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f5903d6-8d83-47ae-8e03-5086527e14ff tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:41.173557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f5903d6-8d83-47ae-8e03-5086527e14ff tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:41.324808 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6f5903d6-8d83-47ae-8e03-5086527e14ff tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bb016e92cb46f2b1eb4f99f3f7a327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e8142b7e4445d2bcf865c6fd26d02f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:41.335314 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6f5903d6-8d83-47ae-8e03-5086527e14ff tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf" status: 200 len: 1458 microversion: 2.1 time: 0.176553 Aug 04 17:38:41.336388 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3162/6352] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:41 2022] GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf => generated 1458 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:38:41.773441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9ff6fc59-fdc7-4345-8e8d-a6041545a01d tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:41.774277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9ff6fc59-fdc7-4345-8e8d-a6041545a01d tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: bc6fdd7e-c666-48b4-b12b-383acf30d667] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:41.784849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9ff6fc59-fdc7-4345-8e8d-a6041545a01d tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:41.785459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9ff6fc59-fdc7-4345-8e8d-a6041545a01d tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:41.786009 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9ff6fc59-fdc7-4345-8e8d-a6041545a01d tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:41.786997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9ff6fc59-fdc7-4345-8e8d-a6041545a01d tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:41.787537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9ff6fc59-fdc7-4345-8e8d-a6041545a01d tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:41.788240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9ff6fc59-fdc7-4345-8e8d-a6041545a01d tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:42.224735 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-1faec11c-1012-4b02-b519-35c2b25d2750 req-4228a41c-2115-42c9-b3b9-1815dfbf1ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc6fdd7e-c666-48b4-b12b-383acf30d667", "name": "network-vif-plugged", "status": "completed", "tag": "889ab2c4-a862-403d-8cb5-41d39a002769"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:38:42.238033 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1faec11c-1012-4b02-b519-35c2b25d2750 req-4228a41c-2115-42c9-b3b9-1815dfbf1ba0 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:42.238723 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1faec11c-1012-4b02-b519-35c2b25d2750 req-4228a41c-2115-42c9-b3b9-1815dfbf1ba0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:42.240183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1faec11c-1012-4b02-b519-35c2b25d2750 req-4228a41c-2115-42c9-b3b9-1815dfbf1ba0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:42.257160 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-1faec11c-1012-4b02-b519-35c2b25d2750 req-4228a41c-2115-42c9-b3b9-1815dfbf1ba0 service nova] Creating event network-vif-plugged:889ab2c4-a862-403d-8cb5-41d39a002769 for instance bc6fdd7e-c666-48b4-b12b-383acf30d667 on n-h1-851359-3 Aug 04 17:38:42.264011 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-1faec11c-1012-4b02-b519-35c2b25d2750 req-4228a41c-2115-42c9-b3b9-1815dfbf1ba0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042373 Aug 04 17:38:42.266014 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3163/6353] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:38:42.276987 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9ff6fc59-fdc7-4345-8e8d-a6041545a01d tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbb670b4af94c7d93b5110672eab987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09d3ba1af2c44df94fc95238f2bb18c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:42.285716 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9ff6fc59-fdc7-4345-8e8d-a6041545a01d tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "GET /compute/v2.1/servers/bc6fdd7e-c666-48b4-b12b-383acf30d667" status: 200 len: 1318 microversion: 2.1 time: 0.516242 Aug 04 17:38:42.286592 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3191/6354] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:41 2022] GET /compute/v2.1/servers/bc6fdd7e-c666-48b4-b12b-383acf30d667 => generated 1318 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:38:43.307958 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8dfa3189-d609-4daf-8600-98db6e4d3f46 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:43.310310 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8dfa3189-d609-4daf-8600-98db6e4d3f46 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: bc6fdd7e-c666-48b4-b12b-383acf30d667] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:43.326686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dfa3189-d609-4daf-8600-98db6e4d3f46 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:43.328434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dfa3189-d609-4daf-8600-98db6e4d3f46 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:43.328969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dfa3189-d609-4daf-8600-98db6e4d3f46 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:43.329725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dfa3189-d609-4daf-8600-98db6e4d3f46 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:43.330693 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dfa3189-d609-4daf-8600-98db6e4d3f46 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:43.331228 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dfa3189-d609-4daf-8600-98db6e4d3f46 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:43.616977 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8dfa3189-d609-4daf-8600-98db6e4d3f46 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbb670b4af94c7d93b5110672eab987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09d3ba1af2c44df94fc95238f2bb18c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:43.626675 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8dfa3189-d609-4daf-8600-98db6e4d3f46 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "GET /compute/v2.1/servers/bc6fdd7e-c666-48b4-b12b-383acf30d667" status: 200 len: 1318 microversion: 2.1 time: 0.323512 Aug 04 17:38:43.627547 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3164/6355] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:43 2022] GET /compute/v2.1/servers/bc6fdd7e-c666-48b4-b12b-383acf30d667 => generated 1318 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:38:43.981288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-a5afab80-b9ea-48da-a15e-a670e9df9342 req-8708b7f6-77e2-4a73-bb52-bf9c77e7181b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54b9baeb-d558-4c57-b8c6-50188fcc8daf", "tag": "7e5274de-fa79-4c61-b8eb-3c894bec8047"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:38:43.987886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:38:44.000946 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a5afab80-b9ea-48da-a15e-a670e9df9342 req-8708b7f6-77e2-4a73-bb52-bf9c77e7181b service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:44.007819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a5afab80-b9ea-48da-a15e-a670e9df9342 req-8708b7f6-77e2-4a73-bb52-bf9c77e7181b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:44.008516 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a5afab80-b9ea-48da-a15e-a670e9df9342 req-8708b7f6-77e2-4a73-bb52-bf9c77e7181b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:44.023156 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-a5afab80-b9ea-48da-a15e-a670e9df9342 req-8708b7f6-77e2-4a73-bb52-bf9c77e7181b service nova] Creating event network-changed:7e5274de-fa79-4c61-b8eb-3c894bec8047 for instance 54b9baeb-d558-4c57-b8c6-50188fcc8daf on n-h2-851359-3 Aug 04 17:38:44.030957 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-a5afab80-b9ea-48da-a15e-a670e9df9342 req-8708b7f6-77e2-4a73-bb52-bf9c77e7181b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.212493 Aug 04 17:38:44.032239 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3192/6356] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:38:44.651296 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cf118a17-97b5-4b22-a65b-31d40f410ad8 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:38:44.653483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cf118a17-97b5-4b22-a65b-31d40f410ad8 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: bc6fdd7e-c666-48b4-b12b-383acf30d667] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:44.660491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:38:44.661581 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:38:44.672665 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf118a17-97b5-4b22-a65b-31d40f410ad8 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:44.673456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf118a17-97b5-4b22-a65b-31d40f410ad8 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:44.674095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf118a17-97b5-4b22-a65b-31d40f410ad8 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:44.675118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf118a17-97b5-4b22-a65b-31d40f410ad8 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:44.675821 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf118a17-97b5-4b22-a65b-31d40f410ad8 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:44.676521 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf118a17-97b5-4b22-a65b-31d40f410ad8 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:45.038787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cf118a17-97b5-4b22-a65b-31d40f410ad8 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbb670b4af94c7d93b5110672eab987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09d3ba1af2c44df94fc95238f2bb18c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:38:45.056690 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cf118a17-97b5-4b22-a65b-31d40f410ad8 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "GET /compute/v2.1/servers/bc6fdd7e-c666-48b4-b12b-383acf30d667" status: 200 len: 1506 microversion: 2.1 time: 0.407852 Aug 04 17:38:45.056690 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3165/6357] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:38:44 2022] GET /compute/v2.1/servers/bc6fdd7e-c666-48b4-b12b-383acf30d667 => generated 1506 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:38:45.075818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a04b5bfc-d26b-4cd3-ba89-112e516f7b46 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3004d2dd-7837-4c51-80af-a675fc97f3e2", "device": "/dev/sdb"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:38:45.079559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a04b5bfc-d26b-4cd3-ba89-112e516f7b46 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: bc6fdd7e-c666-48b4-b12b-383acf30d667] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:38:45.086078 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:38:45.089710 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a04b5bfc-d26b-4cd3-ba89-112e516f7b46 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:45.090505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a04b5bfc-d26b-4cd3-ba89-112e516f7b46 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:45.093511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a04b5bfc-d26b-4cd3-ba89-112e516f7b46 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:45.094690 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a04b5bfc-d26b-4cd3-ba89-112e516f7b46 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:45.095365 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a04b5bfc-d26b-4cd3-ba89-112e516f7b46 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:45.095982 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a04b5bfc-d26b-4cd3-ba89-112e516f7b46 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:45.462170 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a04b5bfc-d26b-4cd3-ba89-112e516f7b46 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "POST /compute/v2.1/servers/bc6fdd7e-c666-48b4-b12b-383acf30d667/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.391356 Aug 04 17:38:45.463177 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3193/6358] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Aug 4 17:38:45 2022] POST /compute/v2.1/servers/bc6fdd7e-c666-48b4-b12b-383acf30d667/os-volume_attachments => generated 194 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:38:46.052178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-20ec1784-cebb-4780-82c2-c8f38a1e1be2 req-d2d37aac-cd00-43dc-9931-550f4f91c1bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54b9baeb-d558-4c57-b8c6-50188fcc8daf", "tag": "7e5274de-fa79-4c61-b8eb-3c894bec8047"}, {"name": "network-changed", "server_uuid": "54b9baeb-d558-4c57-b8c6-50188fcc8daf", "tag": "7e5274de-fa79-4c61-b8eb-3c894bec8047"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:38:46.071980 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:38:46.075443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-20ec1784-cebb-4780-82c2-c8f38a1e1be2 req-d2d37aac-cd00-43dc-9931-550f4f91c1bd service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:38:46.076245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-20ec1784-cebb-4780-82c2-c8f38a1e1be2 req-d2d37aac-cd00-43dc-9931-550f4f91c1bd service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:38:46.077023 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-20ec1784-cebb-4780-82c2-c8f38a1e1be2 req-d2d37aac-cd00-43dc-9931-550f4f91c1bd service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:38:46.112397 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-20ec1784-cebb-4780-82c2-c8f38a1e1be2 req-d2d37aac-cd00-43dc-9931-550f4f91c1bd service nova] Creating event network-changed:7e5274de-fa79-4c61-b8eb-3c894bec8047 for instance 54b9baeb-d558-4c57-b8c6-50188fcc8daf on n-h2-851359-3 Aug 04 17:38:46.118800 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-20ec1784-cebb-4780-82c2-c8f38a1e1be2 req-d2d37aac-cd00-43dc-9931-550f4f91c1bd service nova] Creating event network-changed:7e5274de-fa79-4c61-b8eb-3c894bec8047 for instance 54b9baeb-d558-4c57-b8c6-50188fcc8daf on n-h2-851359-3 Aug 04 17:38:46.131410 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-20ec1784-cebb-4780-82c2-c8f38a1e1be2 req-d2d37aac-cd00-43dc-9931-550f4f91c1bd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.083328 Aug 04 17:38:46.139702 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3166/6359] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:39:09.434882 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-634bd189-0466-4d6c-8415-6f19385fdf35 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:39:09.435626 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-634bd189-0466-4d6c-8415-6f19385fdf35 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: bc6fdd7e-c666-48b4-b12b-383acf30d667] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:39:09.439514 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:39:09.440354 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:39:09.446625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-634bd189-0466-4d6c-8415-6f19385fdf35 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:09.447135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-634bd189-0466-4d6c-8415-6f19385fdf35 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:09.447603 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-634bd189-0466-4d6c-8415-6f19385fdf35 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:09.448361 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-634bd189-0466-4d6c-8415-6f19385fdf35 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:09.449069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-634bd189-0466-4d6c-8415-6f19385fdf35 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:09.449499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-634bd189-0466-4d6c-8415-6f19385fdf35 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:09.550096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-634bd189-0466-4d6c-8415-6f19385fdf35 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lazy-loading 'services' on Instance uuid bc6fdd7e-c666-48b4-b12b-383acf30d667 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:39:09.677718 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-634bd189-0466-4d6c-8415-6f19385fdf35 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "DELETE /compute/v2.1/servers/bc6fdd7e-c666-48b4-b12b-383acf30d667/os-volume_attachments/3004d2dd-7837-4c51-80af-a675fc97f3e2" status: 202 len: 0 microversion: 2.1 time: 0.248748 Aug 04 17:39:09.678784 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3194/6360] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Aug 4 17:39:09 2022] DELETE /compute/v2.1/servers/bc6fdd7e-c666-48b4-b12b-383acf30d667/os-volume_attachments/3004d2dd-7837-4c51-80af-a675fc97f3e2 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:39:15.078865 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c73f05cd-d71a-4925-8ee2-63a33572d9a5 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:39:15.079487 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c73f05cd-d71a-4925-8ee2-63a33572d9a5 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: bc6fdd7e-c666-48b4-b12b-383acf30d667] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:39:15.082802 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=24 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:39:15.094244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c73f05cd-d71a-4925-8ee2-63a33572d9a5 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:15.094826 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c73f05cd-d71a-4925-8ee2-63a33572d9a5 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:15.095211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c73f05cd-d71a-4925-8ee2-63a33572d9a5 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:15.095961 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c73f05cd-d71a-4925-8ee2-63a33572d9a5 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:15.096426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c73f05cd-d71a-4925-8ee2-63a33572d9a5 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:15.096856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c73f05cd-d71a-4925-8ee2-63a33572d9a5 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:15.124922 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c73f05cd-d71a-4925-8ee2-63a33572d9a5 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: bc6fdd7e-c666-48b4-b12b-383acf30d667] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:39:15.210872 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c73f05cd-d71a-4925-8ee2-63a33572d9a5 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "DELETE /compute/v2.1/servers/bc6fdd7e-c666-48b4-b12b-383acf30d667" status: 204 len: 0 microversion: 2.1 time: 0.137056 Aug 04 17:39:15.211526 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3167/6361] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:39:15 2022] DELETE /compute/v2.1/servers/bc6fdd7e-c666-48b4-b12b-383acf30d667 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 17:39:15.221168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-59a569f0-90f5-4f27-bb73-980b3714d760 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:39:15.221883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-59a569f0-90f5-4f27-bb73-980b3714d760 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: bc6fdd7e-c666-48b4-b12b-383acf30d667] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:39:15.228732 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59a569f0-90f5-4f27-bb73-980b3714d760 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:15.229231 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59a569f0-90f5-4f27-bb73-980b3714d760 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:15.229681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59a569f0-90f5-4f27-bb73-980b3714d760 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:15.230420 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59a569f0-90f5-4f27-bb73-980b3714d760 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:15.230894 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59a569f0-90f5-4f27-bb73-980b3714d760 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:15.231390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59a569f0-90f5-4f27-bb73-980b3714d760 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:15.376675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-59a569f0-90f5-4f27-bb73-980b3714d760 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbb670b4af94c7d93b5110672eab987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09d3ba1af2c44df94fc95238f2bb18c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:39:15.385478 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-59a569f0-90f5-4f27-bb73-980b3714d760 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "GET /compute/v2.1/servers/bc6fdd7e-c666-48b4-b12b-383acf30d667" status: 200 len: 1512 microversion: 2.1 time: 0.169231 Aug 04 17:39:15.386299 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3195/6362] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:39:15 2022] GET /compute/v2.1/servers/bc6fdd7e-c666-48b4-b12b-383acf30d667 => generated 1512 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:39:16.408837 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-985ea52e-31d5-4d7b-9d01-54d777fe1c1f tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:39:16.409744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-985ea52e-31d5-4d7b-9d01-54d777fe1c1f tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: bc6fdd7e-c666-48b4-b12b-383acf30d667] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:39:16.417124 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-985ea52e-31d5-4d7b-9d01-54d777fe1c1f tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:16.418120 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-985ea52e-31d5-4d7b-9d01-54d777fe1c1f tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:16.418669 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-985ea52e-31d5-4d7b-9d01-54d777fe1c1f tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:16.419389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-985ea52e-31d5-4d7b-9d01-54d777fe1c1f tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:16.419846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-985ea52e-31d5-4d7b-9d01-54d777fe1c1f tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:16.420267 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-985ea52e-31d5-4d7b-9d01-54d777fe1c1f tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:16.575490 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-985ea52e-31d5-4d7b-9d01-54d777fe1c1f tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbb670b4af94c7d93b5110672eab987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09d3ba1af2c44df94fc95238f2bb18c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:39:16.583557 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-985ea52e-31d5-4d7b-9d01-54d777fe1c1f tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "GET /compute/v2.1/servers/bc6fdd7e-c666-48b4-b12b-383acf30d667" status: 200 len: 1512 microversion: 2.1 time: 0.179695 Aug 04 17:39:16.584273 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3168/6363] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:39:16 2022] GET /compute/v2.1/servers/bc6fdd7e-c666-48b4-b12b-383acf30d667 => generated 1512 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:39:17.606712 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-be042462-1250-48a0-9eb6-6c8f2353fd51 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:39:17.608030 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-be042462-1250-48a0-9eb6-6c8f2353fd51 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: bc6fdd7e-c666-48b4-b12b-383acf30d667] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:39:17.617333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be042462-1250-48a0-9eb6-6c8f2353fd51 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:17.618072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be042462-1250-48a0-9eb6-6c8f2353fd51 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:17.618502 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be042462-1250-48a0-9eb6-6c8f2353fd51 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:17.619901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be042462-1250-48a0-9eb6-6c8f2353fd51 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:17.620388 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be042462-1250-48a0-9eb6-6c8f2353fd51 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:17.620830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be042462-1250-48a0-9eb6-6c8f2353fd51 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:17.776830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-be042462-1250-48a0-9eb6-6c8f2353fd51 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbb670b4af94c7d93b5110672eab987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09d3ba1af2c44df94fc95238f2bb18c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:39:17.786932 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-be042462-1250-48a0-9eb6-6c8f2353fd51 tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "GET /compute/v2.1/servers/bc6fdd7e-c666-48b4-b12b-383acf30d667" status: 200 len: 1512 microversion: 2.1 time: 0.185783 Aug 04 17:39:17.787940 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3196/6364] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:39:17 2022] GET /compute/v2.1/servers/bc6fdd7e-c666-48b4-b12b-383acf30d667 => generated 1512 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:39:18.143987 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-12d2eef5-158b-4e6c-a06d-b293d3bcaeb6 req-e2a43611-0440-4b50-b34e-864951b247a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc6fdd7e-c666-48b4-b12b-383acf30d667", "name": "network-vif-deleted", "tag": "889ab2c4-a862-403d-8cb5-41d39a002769"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:39:18.156911 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-12d2eef5-158b-4e6c-a06d-b293d3bcaeb6 req-e2a43611-0440-4b50-b34e-864951b247a9 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:18.157851 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-12d2eef5-158b-4e6c-a06d-b293d3bcaeb6 req-e2a43611-0440-4b50-b34e-864951b247a9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:18.158439 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-12d2eef5-158b-4e6c-a06d-b293d3bcaeb6 req-e2a43611-0440-4b50-b34e-864951b247a9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:18.173020 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-12d2eef5-158b-4e6c-a06d-b293d3bcaeb6 req-e2a43611-0440-4b50-b34e-864951b247a9 service nova] Creating event network-vif-deleted:889ab2c4-a862-403d-8cb5-41d39a002769 for instance bc6fdd7e-c666-48b4-b12b-383acf30d667 on n-h1-851359-3 Aug 04 17:39:18.179737 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-12d2eef5-158b-4e6c-a06d-b293d3bcaeb6 req-e2a43611-0440-4b50-b34e-864951b247a9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040236 Aug 04 17:39:18.187239 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3169/6365] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:39:18.635652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bbe06fef-1f01-4336-be4b-e92f63a1ab03 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:39:18.636242 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bbe06fef-1f01-4336-be4b-e92f63a1ab03 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:39:18.651911 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bbe06fef-1f01-4336-be4b-e92f63a1ab03 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:18.653162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bbe06fef-1f01-4336-be4b-e92f63a1ab03 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:18.654466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bbe06fef-1f01-4336-be4b-e92f63a1ab03 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:18.656059 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bbe06fef-1f01-4336-be4b-e92f63a1ab03 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:18.658491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bbe06fef-1f01-4336-be4b-e92f63a1ab03 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:18.659505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bbe06fef-1f01-4336-be4b-e92f63a1ab03 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:18.692122 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bbe06fef-1f01-4336-be4b-e92f63a1ab03 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:39:18.800703 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bbe06fef-1f01-4336-be4b-e92f63a1ab03 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "DELETE /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf" status: 204 len: 0 microversion: 2.1 time: 0.168924 Aug 04 17:39:18.803826 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3197/6366] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:39:18 2022] DELETE /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:39:18.809729 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-48a77971-67e1-4fae-871d-6b9b2c13790f tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:39:18.810624 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-48a77971-67e1-4fae-871d-6b9b2c13790f tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] [instance: bc6fdd7e-c666-48b4-b12b-383acf30d667] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:39:18.814710 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dc69d530-8c3e-456d-b641-3ffba2d85a5d tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:39:18.816150 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dc69d530-8c3e-456d-b641-3ffba2d85a5d tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:39:18.825554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc69d530-8c3e-456d-b641-3ffba2d85a5d tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:18.826682 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc69d530-8c3e-456d-b641-3ffba2d85a5d tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:18.827472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc69d530-8c3e-456d-b641-3ffba2d85a5d tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:18.828898 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc69d530-8c3e-456d-b641-3ffba2d85a5d tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:18.829834 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc69d530-8c3e-456d-b641-3ffba2d85a5d tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:18.830561 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc69d530-8c3e-456d-b641-3ffba2d85a5d tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:18.830682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48a77971-67e1-4fae-871d-6b9b2c13790f tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:18.831140 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48a77971-67e1-4fae-871d-6b9b2c13790f tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:18.831785 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48a77971-67e1-4fae-871d-6b9b2c13790f tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:18.832720 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48a77971-67e1-4fae-871d-6b9b2c13790f tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:18.833362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48a77971-67e1-4fae-871d-6b9b2c13790f tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:18.833803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48a77971-67e1-4fae-871d-6b9b2c13790f tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:18.848877 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-48a77971-67e1-4fae-871d-6b9b2c13790f tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] HTTP exception thrown: Instance bc6fdd7e-c666-48b4-b12b-383acf30d667 could not be found. Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-48a77971-67e1-4fae-871d-6b9b2c13790f tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Request method failure captured: Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/bc6fdd7e-c666-48b4-b12b-383acf30d667 HTTP/1.1 Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AN6LgkCTRusTgGcVaBONiX-tBmiufe91nqwwOftZ-KROgd36VSC5mQsZ_a7g_29kN9B0D7D6r9nkzMk5EIo2UCrGmbNq1HBsAFfl5Qe-RjdyxVjjE7TGWN-cZYZY3xyzVGLj3KUzrUQ5LpU0RodO-n6MRFIA3mAeEQct4GKHa9cuN4 Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: a09d3ba1af2c44df94fc95238f2bb18c Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-VolumesSnapshotTestJSON-782156123 Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a09d3ba1af2c44df94fc95238f2bb18c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a09d3ba1af2c44df94fc95238f2bb18c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a09d3ba1af2c44df94fc95238f2bb18c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a09d3ba1af2c44df94fc95238f2bb18c"}]}] Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-VolumesSnapshotTestJSON-782156123 Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: a09d3ba1af2c44df94fc95238f2bb18c Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-782156123 Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-VolumesSnapshotTestJSON-782156123-project Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 3bbb670b4af94c7d93b5110672eab987 Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-VolumesSnapshotTestJSON-782156123-project Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance bc6fdd7e-c666-48b4-b12b-383acf30d667 could not be found. Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'bc6fdd7e-c666-48b4-b12b-383acf30d667'} Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc6fdd7e-c666-48b4-b12b-383acf30d667 could not be found. Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc6fdd7e-c666-48b4-b12b-383acf30d667 could not be found. Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:39:18.851005 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:39:18.855793 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:39:18.855793 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:39:18.855793 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:39:18.855793 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:39:18.855793 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:39:18.855793 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc6fdd7e-c666-48b4-b12b-383acf30d667 could not be found. Aug 04 17:39:18.855793 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:39:18.857856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-48a77971-67e1-4fae-871d-6b9b2c13790f tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] Returning 404 to user: Instance bc6fdd7e-c666-48b4-b12b-383acf30d667 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:39:18.860494 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-48a77971-67e1-4fae-871d-6b9b2c13790f tempest-VolumesSnapshotTestJSON-782156123 tempest-VolumesSnapshotTestJSON-782156123-project] 10.222.0.93 "GET /compute/v2.1/servers/bc6fdd7e-c666-48b4-b12b-383acf30d667" status: 404 len: 111 microversion: 2.1 time: 0.053840 Aug 04 17:39:18.861729 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3170/6367] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:39:18 2022] GET /compute/v2.1/servers/bc6fdd7e-c666-48b4-b12b-383acf30d667 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:39:19.038496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dc69d530-8c3e-456d-b641-3ffba2d85a5d tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bb016e92cb46f2b1eb4f99f3f7a327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e8142b7e4445d2bcf865c6fd26d02f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:39:19.049513 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dc69d530-8c3e-456d-b641-3ffba2d85a5d tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf" status: 200 len: 1583 microversion: 2.1 time: 0.242113 Aug 04 17:39:19.050643 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3198/6368] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:39:18 2022] GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf => generated 1583 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:39:20.075643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-242e9850-71fb-4f97-a215-6ae39189430b tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:39:20.077012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-242e9850-71fb-4f97-a215-6ae39189430b tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:39:20.087761 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-242e9850-71fb-4f97-a215-6ae39189430b tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:20.088472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-242e9850-71fb-4f97-a215-6ae39189430b tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:20.089024 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-242e9850-71fb-4f97-a215-6ae39189430b tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:20.089791 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-242e9850-71fb-4f97-a215-6ae39189430b tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:20.090414 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-242e9850-71fb-4f97-a215-6ae39189430b tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:20.091163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-242e9850-71fb-4f97-a215-6ae39189430b tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:20.214739 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-7c7a0447-aac9-4af3-ba9a-7d6d71bbb922 req-414f31a7-3e7a-4f70-82e1-dd929a506f9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54b9baeb-d558-4c57-b8c6-50188fcc8daf", "tag": "7e5274de-fa79-4c61-b8eb-3c894bec8047"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:39:20.239528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7c7a0447-aac9-4af3-ba9a-7d6d71bbb922 req-414f31a7-3e7a-4f70-82e1-dd929a506f9d service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:20.239963 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7c7a0447-aac9-4af3-ba9a-7d6d71bbb922 req-414f31a7-3e7a-4f70-82e1-dd929a506f9d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:20.240417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7c7a0447-aac9-4af3-ba9a-7d6d71bbb922 req-414f31a7-3e7a-4f70-82e1-dd929a506f9d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:20.253907 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-7c7a0447-aac9-4af3-ba9a-7d6d71bbb922 req-414f31a7-3e7a-4f70-82e1-dd929a506f9d service nova] Creating event network-changed:7e5274de-fa79-4c61-b8eb-3c894bec8047 for instance 54b9baeb-d558-4c57-b8c6-50188fcc8daf on n-h2-851359-3 Aug 04 17:39:20.260251 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-7c7a0447-aac9-4af3-ba9a-7d6d71bbb922 req-414f31a7-3e7a-4f70-82e1-dd929a506f9d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049852 Aug 04 17:39:20.261169 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3199/6369] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:39:20.370356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-242e9850-71fb-4f97-a215-6ae39189430b tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bb016e92cb46f2b1eb4f99f3f7a327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e8142b7e4445d2bcf865c6fd26d02f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:39:20.379099 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-242e9850-71fb-4f97-a215-6ae39189430b tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf" status: 200 len: 1583 microversion: 2.1 time: 0.308436 Aug 04 17:39:20.390879 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3171/6370] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:39:20 2022] GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf => generated 1583 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:39:21.404477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-48477eeb-15ea-4527-bd8b-0db78a94eae6 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:39:21.406402 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-48477eeb-15ea-4527-bd8b-0db78a94eae6 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:39:21.421848 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-48477eeb-15ea-4527-bd8b-0db78a94eae6 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:21.422712 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-48477eeb-15ea-4527-bd8b-0db78a94eae6 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:21.423367 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-48477eeb-15ea-4527-bd8b-0db78a94eae6 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:21.424698 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-48477eeb-15ea-4527-bd8b-0db78a94eae6 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:21.425449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-48477eeb-15ea-4527-bd8b-0db78a94eae6 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:21.425960 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-48477eeb-15ea-4527-bd8b-0db78a94eae6 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:21.507913 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-48477eeb-15ea-4527-bd8b-0db78a94eae6 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bb016e92cb46f2b1eb4f99f3f7a327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e8142b7e4445d2bcf865c6fd26d02f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:39:21.517947 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-48477eeb-15ea-4527-bd8b-0db78a94eae6 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf" status: 200 len: 1229 microversion: 2.1 time: 0.120352 Aug 04 17:39:21.519230 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3200/6371] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:39:21 2022] GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf => generated 1229 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:39:22.276880 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-f2848915-1bfd-4759-84f7-1c683c4fbd73 req-2df2bda2-649e-4bc8-a93a-8fdab53eec36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54b9baeb-d558-4c57-b8c6-50188fcc8daf", "name": "network-vif-deleted", "tag": "7e5274de-fa79-4c61-b8eb-3c894bec8047"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:39:22.289356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f2848915-1bfd-4759-84f7-1c683c4fbd73 req-2df2bda2-649e-4bc8-a93a-8fdab53eec36 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:22.289843 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f2848915-1bfd-4759-84f7-1c683c4fbd73 req-2df2bda2-649e-4bc8-a93a-8fdab53eec36 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:22.290274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f2848915-1bfd-4759-84f7-1c683c4fbd73 req-2df2bda2-649e-4bc8-a93a-8fdab53eec36 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:22.307574 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-f2848915-1bfd-4759-84f7-1c683c4fbd73 req-2df2bda2-649e-4bc8-a93a-8fdab53eec36 service nova] Creating event network-vif-deleted:7e5274de-fa79-4c61-b8eb-3c894bec8047 for instance 54b9baeb-d558-4c57-b8c6-50188fcc8daf on n-h2-851359-3 Aug 04 17:39:22.313939 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-f2848915-1bfd-4759-84f7-1c683c4fbd73 req-2df2bda2-649e-4bc8-a93a-8fdab53eec36 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041093 Aug 04 17:39:22.315674 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3172/6372] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:39:22.539426 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c9f1845f-1fd0-4b76-98a9-74d884fae53f tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:39:22.539987 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c9f1845f-1fd0-4b76-98a9-74d884fae53f tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:39:22.547598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9f1845f-1fd0-4b76-98a9-74d884fae53f tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:22.548094 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9f1845f-1fd0-4b76-98a9-74d884fae53f tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:22.548534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9f1845f-1fd0-4b76-98a9-74d884fae53f tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:22.549241 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9f1845f-1fd0-4b76-98a9-74d884fae53f tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:22.549759 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9f1845f-1fd0-4b76-98a9-74d884fae53f tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:22.550222 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c9f1845f-1fd0-4b76-98a9-74d884fae53f tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:22.617300 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c9f1845f-1fd0-4b76-98a9-74d884fae53f tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bb016e92cb46f2b1eb4f99f3f7a327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e8142b7e4445d2bcf865c6fd26d02f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:39:22.625356 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c9f1845f-1fd0-4b76-98a9-74d884fae53f tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf" status: 200 len: 1229 microversion: 2.1 time: 0.089883 Aug 04 17:39:22.626104 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3201/6373] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:39:22 2022] GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf => generated 1229 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:39:23.215968 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:39:23.216160 n-d-851359-3 devstack@n-api.service[131043]: Thu Aug 4 17:39:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 17:39:23.648585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b5fe440d-5305-483e-9648-912292369175 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:39:23.649904 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b5fe440d-5305-483e-9648-912292369175 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:39:23.659600 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5fe440d-5305-483e-9648-912292369175 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:23.660399 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5fe440d-5305-483e-9648-912292369175 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:23.661022 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5fe440d-5305-483e-9648-912292369175 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:23.662937 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5fe440d-5305-483e-9648-912292369175 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:23.663770 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5fe440d-5305-483e-9648-912292369175 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:23.664382 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5fe440d-5305-483e-9648-912292369175 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:23.771603 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b5fe440d-5305-483e-9648-912292369175 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bb016e92cb46f2b1eb4f99f3f7a327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e8142b7e4445d2bcf865c6fd26d02f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:39:23.781357 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b5fe440d-5305-483e-9648-912292369175 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf" status: 200 len: 1229 microversion: 2.1 time: 0.136805 Aug 04 17:39:23.782308 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3173/6374] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:39:23 2022] GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf => generated 1229 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:39:24.802841 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ae9d0481-e18e-4ad6-ad06-1ef93583bf22 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:39:24.803731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ae9d0481-e18e-4ad6-ad06-1ef93583bf22 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:39:24.811033 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae9d0481-e18e-4ad6-ad06-1ef93583bf22 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:24.812435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae9d0481-e18e-4ad6-ad06-1ef93583bf22 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:24.813139 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae9d0481-e18e-4ad6-ad06-1ef93583bf22 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:24.814512 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae9d0481-e18e-4ad6-ad06-1ef93583bf22 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:24.817482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae9d0481-e18e-4ad6-ad06-1ef93583bf22 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:24.818147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae9d0481-e18e-4ad6-ad06-1ef93583bf22 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:24.930235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ae9d0481-e18e-4ad6-ad06-1ef93583bf22 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bb016e92cb46f2b1eb4f99f3f7a327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e8142b7e4445d2bcf865c6fd26d02f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:39:24.940757 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ae9d0481-e18e-4ad6-ad06-1ef93583bf22 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf" status: 200 len: 1229 microversion: 2.1 time: 0.141821 Aug 04 17:39:24.956023 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3202/6375] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:39:24 2022] GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf => generated 1229 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:39:25.965397 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6763047e-4371-439b-9e1f-740e6d22ee20 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:39:25.966131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6763047e-4371-439b-9e1f-740e6d22ee20 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:39:25.973451 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6763047e-4371-439b-9e1f-740e6d22ee20 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:25.973949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6763047e-4371-439b-9e1f-740e6d22ee20 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:25.974419 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6763047e-4371-439b-9e1f-740e6d22ee20 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:25.975135 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6763047e-4371-439b-9e1f-740e6d22ee20 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:25.975734 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6763047e-4371-439b-9e1f-740e6d22ee20 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:25.976247 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6763047e-4371-439b-9e1f-740e6d22ee20 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:26.060682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6763047e-4371-439b-9e1f-740e6d22ee20 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bb016e92cb46f2b1eb4f99f3f7a327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e8142b7e4445d2bcf865c6fd26d02f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:39:26.076260 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6763047e-4371-439b-9e1f-740e6d22ee20 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf" status: 200 len: 1229 microversion: 2.1 time: 0.112808 Aug 04 17:39:26.085524 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3174/6376] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:39:25 2022] GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf => generated 1229 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:39:27.102953 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a759e86c-b785-498d-9031-8e11fed69d3e tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:39:27.104636 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a759e86c-b785-498d-9031-8e11fed69d3e tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:39:27.112508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a759e86c-b785-498d-9031-8e11fed69d3e tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:27.113308 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a759e86c-b785-498d-9031-8e11fed69d3e tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:27.114146 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a759e86c-b785-498d-9031-8e11fed69d3e tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:27.115258 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a759e86c-b785-498d-9031-8e11fed69d3e tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:27.115923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a759e86c-b785-498d-9031-8e11fed69d3e tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:27.116856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a759e86c-b785-498d-9031-8e11fed69d3e tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:27.204649 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a759e86c-b785-498d-9031-8e11fed69d3e tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57bb016e92cb46f2b1eb4f99f3f7a327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34e8142b7e4445d2bcf865c6fd26d02f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:39:27.214313 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a759e86c-b785-498d-9031-8e11fed69d3e tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf" status: 200 len: 1229 microversion: 2.1 time: 0.114671 Aug 04 17:39:27.216149 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3203/6377] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:39:27 2022] GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf => generated 1229 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:39:28.237257 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f4e908ba-5c2e-437d-acbb-7f0b381370b4 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:39:28.237887 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f4e908ba-5c2e-437d-acbb-7f0b381370b4 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] [instance: 54b9baeb-d558-4c57-b8c6-50188fcc8daf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:39:28.248684 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4e908ba-5c2e-437d-acbb-7f0b381370b4 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:28.249182 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4e908ba-5c2e-437d-acbb-7f0b381370b4 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:28.250179 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4e908ba-5c2e-437d-acbb-7f0b381370b4 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:28.252706 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4e908ba-5c2e-437d-acbb-7f0b381370b4 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:39:28.253432 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4e908ba-5c2e-437d-acbb-7f0b381370b4 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:39:28.254082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4e908ba-5c2e-437d-acbb-7f0b381370b4 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:39:28.279568 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-f4e908ba-5c2e-437d-acbb-7f0b381370b4 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] HTTP exception thrown: Instance 54b9baeb-d558-4c57-b8c6-50188fcc8daf could not be found. Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f4e908ba-5c2e-437d-acbb-7f0b381370b4 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Request method failure captured: Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf HTTP/1.1 Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7ANhDACbXjgF4xq12aKqevK6OYo9A971TJ-LZ8TT4QrTlZqMwrOfpbxdp53BamN-m7dtsWO21XSm-eK61kEOOfXmlZjQlLYkG8xof1fHM5sA-Tjo2AKU9OtFgchpjmLWXvKUSQJNAd4F_re1bFxfyCVgf-4QZZurvYTW8_jpQc8IVGo Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 34e8142b7e4445d2bcf865c6fd26d02f Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TestVolumeBackupRestore-178486550 Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/34e8142b7e4445d2bcf865c6fd26d02f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/34e8142b7e4445d2bcf865c6fd26d02f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_34e8142b7e4445d2bcf865c6fd26d02f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/34e8142b7e4445d2bcf865c6fd26d02f"}]}] Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TestVolumeBackupRestore-178486550 Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 34e8142b7e4445d2bcf865c6fd26d02f Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestVolumeBackupRestore-178486550 Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TestVolumeBackupRestore-178486550-project Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 57bb016e92cb46f2b1eb4f99f3f7a327 Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TestVolumeBackupRestore-178486550-project Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 54b9baeb-d558-4c57-b8c6-50188fcc8daf could not be found. Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '54b9baeb-d558-4c57-b8c6-50188fcc8daf'} Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54b9baeb-d558-4c57-b8c6-50188fcc8daf could not be found. Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54b9baeb-d558-4c57-b8c6-50188fcc8daf could not be found. Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:39:28.281377 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:39:28.285762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:39:28.285762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:39:28.285762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:39:28.285762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:39:28.285762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:39:28.285762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54b9baeb-d558-4c57-b8c6-50188fcc8daf could not be found. Aug 04 17:39:28.285762 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:39:28.285762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f4e908ba-5c2e-437d-acbb-7f0b381370b4 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Returning 404 to user: Instance 54b9baeb-d558-4c57-b8c6-50188fcc8daf could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:39:28.285762 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f4e908ba-5c2e-437d-acbb-7f0b381370b4 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf" status: 404 len: 111 microversion: 2.1 time: 0.050069 Aug 04 17:39:28.285762 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3175/6378] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:39:28 2022] GET /compute/v2.1/servers/54b9baeb-d558-4c57-b8c6-50188fcc8daf => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:39:28.513351 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e3a187ec-2cd9-4530-a431-9d361551ca16 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] Calling method '.version_select at 0x7f1e6c9fcf70>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:39:28.576997 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e3a187ec-2cd9-4530-a431-9d361551ca16 tempest-TestVolumeBackupRestore-178486550 tempest-TestVolumeBackupRestore-178486550-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2108366700" status: 202 len: 0 microversion: 2.1 time: 0.067288 Aug 04 17:39:28.597733 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3204/6379] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Aug 4 17:39:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2108366700 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:40:05.673613 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4778fad1-e3fb-4559-b926-08d642b56a20 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1213008183", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "9efcb65c-09bd-4981-ac34-52224df26e61", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6002cd39-a33b-430d-a6d2-0ecfe13cd1ee"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:40:05.731872 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:40:05.735731 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:40:06.208735 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-4778fad1-e3fb-4559-b926-08d642b56a20 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] validate_networks() for [('6002cd39-a33b-430d-a6d2-0ecfe13cd1ee', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:40:07.087543 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-4778fad1-e3fb-4559-b926-08d642b56a20 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:40:07.088425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-4778fad1-e3fb-4559-b926-08d642b56a20 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:40:07.088908 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-4778fad1-e3fb-4559-b926-08d642b56a20 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:40:07.089429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-4778fad1-e3fb-4559-b926-08d642b56a20 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:40:07.090410 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-4778fad1-e3fb-4559-b926-08d642b56a20 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:40:07.125084 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4778fad1-e3fb-4559-b926-08d642b56a20 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:07.125580 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4778fad1-e3fb-4559-b926-08d642b56a20 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:07.126090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4778fad1-e3fb-4559-b926-08d642b56a20 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:07.127721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4778fad1-e3fb-4559-b926-08d642b56a20 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:07.128454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4778fad1-e3fb-4559-b926-08d642b56a20 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:07.129451 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4778fad1-e3fb-4559-b926-08d642b56a20 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:07.155189 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-4778fad1-e3fb-4559-b926-08d642b56a20 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Getting quotas for project 46f694275ec441259c366f63daa4a380. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:40:07.165089 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-4778fad1-e3fb-4559-b926-08d642b56a20 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Getting quotas for user 50bf6f5281964c0b81809080bcf22bdd and project 46f694275ec441259c366f63daa4a380. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:40:07.289217 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4778fad1-e3fb-4559-b926-08d642b56a20 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:40:07.292829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4778fad1-e3fb-4559-b926-08d642b56a20 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 44101175-eaf5-47e6-8fe1-ed418894353b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9efcb65c-09bd-4981-ac34-52224df26e61',volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:40:07.585064 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4778fad1-e3fb-4559-b926-08d642b56a20 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.921954 Aug 04 17:40:07.586055 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3176/6380] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:40:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:40:07.623152 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4a518584-8869-414d-9f97-d07400c14450 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:07.623864 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4a518584-8869-414d-9f97-d07400c14450 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 44101175-eaf5-47e6-8fe1-ed418894353b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:07.651501 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=67,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:40:07.666525 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:40:08.142568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4a518584-8869-414d-9f97-d07400c14450 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:08.158099 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4a518584-8869-414d-9f97-d07400c14450 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b" status: 200 len: 1057 microversion: 2.1 time: 0.564349 Aug 04 17:40:08.158996 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3205/6381] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:07 2022] GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b => generated 1057 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:09.182392 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9f7d3f0a-1c8b-44df-9c46-e404bc3cfa0e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:09.183338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9f7d3f0a-1c8b-44df-9c46-e404bc3cfa0e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 44101175-eaf5-47e6-8fe1-ed418894353b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:09.194948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f7d3f0a-1c8b-44df-9c46-e404bc3cfa0e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:09.195702 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f7d3f0a-1c8b-44df-9c46-e404bc3cfa0e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:09.196381 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f7d3f0a-1c8b-44df-9c46-e404bc3cfa0e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:09.197472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f7d3f0a-1c8b-44df-9c46-e404bc3cfa0e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:09.198230 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f7d3f0a-1c8b-44df-9c46-e404bc3cfa0e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:09.199007 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f7d3f0a-1c8b-44df-9c46-e404bc3cfa0e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:09.320751 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9f7d3f0a-1c8b-44df-9c46-e404bc3cfa0e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:09.335150 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9f7d3f0a-1c8b-44df-9c46-e404bc3cfa0e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b" status: 200 len: 1155 microversion: 2.1 time: 0.158809 Aug 04 17:40:09.336724 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3177/6382] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:09 2022] GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b => generated 1155 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:10.362412 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fb8edfad-103d-4120-8cc6-067cc895420f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:10.363122 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fb8edfad-103d-4120-8cc6-067cc895420f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 44101175-eaf5-47e6-8fe1-ed418894353b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:10.381631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fb8edfad-103d-4120-8cc6-067cc895420f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:10.382310 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fb8edfad-103d-4120-8cc6-067cc895420f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:10.385469 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fb8edfad-103d-4120-8cc6-067cc895420f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:10.386846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fb8edfad-103d-4120-8cc6-067cc895420f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:10.387612 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fb8edfad-103d-4120-8cc6-067cc895420f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:10.388780 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fb8edfad-103d-4120-8cc6-067cc895420f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:10.492136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fb8edfad-103d-4120-8cc6-067cc895420f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:10.506535 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fb8edfad-103d-4120-8cc6-067cc895420f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b" status: 200 len: 1173 microversion: 2.1 time: 0.147714 Aug 04 17:40:10.521781 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3206/6383] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:10 2022] GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b => generated 1173 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:11.532235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-707af45c-a7e4-4473-9516-8ae6122116cf tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:11.534263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-707af45c-a7e4-4473-9516-8ae6122116cf tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 44101175-eaf5-47e6-8fe1-ed418894353b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:11.569521 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-707af45c-a7e4-4473-9516-8ae6122116cf tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:11.570043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-707af45c-a7e4-4473-9516-8ae6122116cf tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:11.570498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-707af45c-a7e4-4473-9516-8ae6122116cf tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:11.571235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-707af45c-a7e4-4473-9516-8ae6122116cf tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:11.571696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-707af45c-a7e4-4473-9516-8ae6122116cf tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:11.572162 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-707af45c-a7e4-4473-9516-8ae6122116cf tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:11.867879 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-707af45c-a7e4-4473-9516-8ae6122116cf tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:11.896462 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-707af45c-a7e4-4473-9516-8ae6122116cf tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b" status: 200 len: 1215 microversion: 2.1 time: 0.368933 Aug 04 17:40:11.898745 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3178/6384] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:11 2022] GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b => generated 1215 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:12.317827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-ed167c80-379e-4cc8-aeb1-e8f5bc34290d req-80b94984-ec2c-4e64-a02f-3943ff1ee0ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44101175-eaf5-47e6-8fe1-ed418894353b", "tag": "c0423168-8461-49da-8c66-2d731dbcd478"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:40:12.351260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ed167c80-379e-4cc8-aeb1-e8f5bc34290d req-80b94984-ec2c-4e64-a02f-3943ff1ee0ae service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:12.352107 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ed167c80-379e-4cc8-aeb1-e8f5bc34290d req-80b94984-ec2c-4e64-a02f-3943ff1ee0ae service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:12.352844 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ed167c80-379e-4cc8-aeb1-e8f5bc34290d req-80b94984-ec2c-4e64-a02f-3943ff1ee0ae service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:12.394104 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-ed167c80-379e-4cc8-aeb1-e8f5bc34290d req-80b94984-ec2c-4e64-a02f-3943ff1ee0ae service nova] Creating event network-changed:c0423168-8461-49da-8c66-2d731dbcd478 for instance 44101175-eaf5-47e6-8fe1-ed418894353b on n-h1-851359-3 Aug 04 17:40:12.400852 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-ed167c80-379e-4cc8-aeb1-e8f5bc34290d req-80b94984-ec2c-4e64-a02f-3943ff1ee0ae service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101583 Aug 04 17:40:12.401518 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3207/6385] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:40:12.930984 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-408282fd-0ea4-4890-a73f-fdc4d82e4ab5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:12.933052 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-408282fd-0ea4-4890-a73f-fdc4d82e4ab5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 44101175-eaf5-47e6-8fe1-ed418894353b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:12.944668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-408282fd-0ea4-4890-a73f-fdc4d82e4ab5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:12.945474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-408282fd-0ea4-4890-a73f-fdc4d82e4ab5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:12.947420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-408282fd-0ea4-4890-a73f-fdc4d82e4ab5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:12.948743 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-408282fd-0ea4-4890-a73f-fdc4d82e4ab5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:12.949445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-408282fd-0ea4-4890-a73f-fdc4d82e4ab5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:12.950228 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-408282fd-0ea4-4890-a73f-fdc4d82e4ab5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:13.220630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-408282fd-0ea4-4890-a73f-fdc4d82e4ab5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:13.236077 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-408282fd-0ea4-4890-a73f-fdc4d82e4ab5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b" status: 200 len: 1215 microversion: 2.1 time: 0.312223 Aug 04 17:40:13.236867 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3179/6386] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:12 2022] GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b => generated 1215 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:14.271849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-79ea7a8a-1562-4aec-946c-9bf9a53d63b9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:14.274330 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-79ea7a8a-1562-4aec-946c-9bf9a53d63b9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 44101175-eaf5-47e6-8fe1-ed418894353b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:14.295206 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79ea7a8a-1562-4aec-946c-9bf9a53d63b9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:14.297098 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79ea7a8a-1562-4aec-946c-9bf9a53d63b9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:14.297928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79ea7a8a-1562-4aec-946c-9bf9a53d63b9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:14.299473 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79ea7a8a-1562-4aec-946c-9bf9a53d63b9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:14.300398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79ea7a8a-1562-4aec-946c-9bf9a53d63b9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:14.301386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79ea7a8a-1562-4aec-946c-9bf9a53d63b9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:14.490552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-79ea7a8a-1562-4aec-946c-9bf9a53d63b9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:14.504961 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-79ea7a8a-1562-4aec-946c-9bf9a53d63b9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b" status: 200 len: 1215 microversion: 2.1 time: 0.239262 Aug 04 17:40:14.505942 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3208/6387] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:14 2022] GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b => generated 1215 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:15.528797 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c6dcbbeb-13cc-458e-8850-fc98973244aa tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:15.529855 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c6dcbbeb-13cc-458e-8850-fc98973244aa tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 44101175-eaf5-47e6-8fe1-ed418894353b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:15.538745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6dcbbeb-13cc-458e-8850-fc98973244aa tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:15.539400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6dcbbeb-13cc-458e-8850-fc98973244aa tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:15.540068 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6dcbbeb-13cc-458e-8850-fc98973244aa tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:15.540936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6dcbbeb-13cc-458e-8850-fc98973244aa tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:15.541532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6dcbbeb-13cc-458e-8850-fc98973244aa tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:15.542344 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6dcbbeb-13cc-458e-8850-fc98973244aa tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:15.732202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c6dcbbeb-13cc-458e-8850-fc98973244aa tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:15.743798 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c6dcbbeb-13cc-458e-8850-fc98973244aa tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b" status: 200 len: 1215 microversion: 2.1 time: 0.219290 Aug 04 17:40:15.744857 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3180/6388] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:15 2022] GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b => generated 1215 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:16.775734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-80d4d5f2-ffef-4097-b8e8-a8e3da9d5450 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:16.777233 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-80d4d5f2-ffef-4097-b8e8-a8e3da9d5450 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 44101175-eaf5-47e6-8fe1-ed418894353b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:16.788948 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80d4d5f2-ffef-4097-b8e8-a8e3da9d5450 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:16.789929 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80d4d5f2-ffef-4097-b8e8-a8e3da9d5450 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:16.790996 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80d4d5f2-ffef-4097-b8e8-a8e3da9d5450 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:16.792335 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80d4d5f2-ffef-4097-b8e8-a8e3da9d5450 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:16.793086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80d4d5f2-ffef-4097-b8e8-a8e3da9d5450 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:16.794428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80d4d5f2-ffef-4097-b8e8-a8e3da9d5450 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:17.033071 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-80d4d5f2-ffef-4097-b8e8-a8e3da9d5450 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:17.049100 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-80d4d5f2-ffef-4097-b8e8-a8e3da9d5450 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b" status: 200 len: 1215 microversion: 2.1 time: 0.279640 Aug 04 17:40:17.050805 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3209/6389] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:16 2022] GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b => generated 1215 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:18.089133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b2f462bc-027f-4227-9437-70df5b42efd2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:18.089932 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b2f462bc-027f-4227-9437-70df5b42efd2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 44101175-eaf5-47e6-8fe1-ed418894353b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:18.096944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:40:18.098126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:40:18.100073 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2f462bc-027f-4227-9437-70df5b42efd2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:18.100842 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2f462bc-027f-4227-9437-70df5b42efd2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:18.101530 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2f462bc-027f-4227-9437-70df5b42efd2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:18.102668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2f462bc-027f-4227-9437-70df5b42efd2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:18.103360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2f462bc-027f-4227-9437-70df5b42efd2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:18.104014 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2f462bc-027f-4227-9437-70df5b42efd2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:18.360927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b2f462bc-027f-4227-9437-70df5b42efd2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:18.378093 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b2f462bc-027f-4227-9437-70df5b42efd2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b" status: 200 len: 1215 microversion: 2.1 time: 0.292932 Aug 04 17:40:18.379107 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3181/6390] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:18 2022] GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b => generated 1215 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:40:19.399304 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-771d8e94-5232-4343-bbea-3fe42af809b2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:19.400112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-771d8e94-5232-4343-bbea-3fe42af809b2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 44101175-eaf5-47e6-8fe1-ed418894353b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:19.403362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:40:19.410744 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-771d8e94-5232-4343-bbea-3fe42af809b2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:19.411652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-771d8e94-5232-4343-bbea-3fe42af809b2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:19.412367 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-771d8e94-5232-4343-bbea-3fe42af809b2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:19.413383 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-771d8e94-5232-4343-bbea-3fe42af809b2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:19.414729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-771d8e94-5232-4343-bbea-3fe42af809b2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:19.415444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-771d8e94-5232-4343-bbea-3fe42af809b2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:19.624901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-771d8e94-5232-4343-bbea-3fe42af809b2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:19.636700 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-771d8e94-5232-4343-bbea-3fe42af809b2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b" status: 200 len: 1203 microversion: 2.1 time: 0.241367 Aug 04 17:40:19.652439 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3210/6391] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:19 2022] GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b => generated 1203 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:20.659038 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8c38777c-1342-4d85-9cb3-eb915943e203 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:20.659616 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8c38777c-1342-4d85-9cb3-eb915943e203 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 44101175-eaf5-47e6-8fe1-ed418894353b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:20.666657 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c38777c-1342-4d85-9cb3-eb915943e203 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:20.667151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c38777c-1342-4d85-9cb3-eb915943e203 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:20.667592 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c38777c-1342-4d85-9cb3-eb915943e203 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:20.668298 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c38777c-1342-4d85-9cb3-eb915943e203 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:20.668985 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c38777c-1342-4d85-9cb3-eb915943e203 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:20.669464 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c38777c-1342-4d85-9cb3-eb915943e203 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:20.812215 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8c38777c-1342-4d85-9cb3-eb915943e203 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:20.822694 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8c38777c-1342-4d85-9cb3-eb915943e203 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b" status: 200 len: 1203 microversion: 2.1 time: 0.167563 Aug 04 17:40:20.836328 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3182/6392] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:20 2022] GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b => generated 1203 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:21.844126 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-96462339-1393-4a37-94b2-13c67150ac54 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:21.844760 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-96462339-1393-4a37-94b2-13c67150ac54 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 44101175-eaf5-47e6-8fe1-ed418894353b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:21.852122 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-96462339-1393-4a37-94b2-13c67150ac54 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:21.852633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-96462339-1393-4a37-94b2-13c67150ac54 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:21.853085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-96462339-1393-4a37-94b2-13c67150ac54 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:21.853828 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-96462339-1393-4a37-94b2-13c67150ac54 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:21.854349 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-96462339-1393-4a37-94b2-13c67150ac54 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:21.854796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-96462339-1393-4a37-94b2-13c67150ac54 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:22.035155 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-96462339-1393-4a37-94b2-13c67150ac54 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:22.047854 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-96462339-1393-4a37-94b2-13c67150ac54 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b" status: 200 len: 1203 microversion: 2.1 time: 0.207348 Aug 04 17:40:22.048858 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3211/6393] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:21 2022] GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b => generated 1203 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:23.069919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a1accd73-318a-41ee-8271-d03eb52c2fc4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:23.072350 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a1accd73-318a-41ee-8271-d03eb52c2fc4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 44101175-eaf5-47e6-8fe1-ed418894353b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:23.082598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1accd73-318a-41ee-8271-d03eb52c2fc4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:23.083255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1accd73-318a-41ee-8271-d03eb52c2fc4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:23.083918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1accd73-318a-41ee-8271-d03eb52c2fc4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:23.085063 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1accd73-318a-41ee-8271-d03eb52c2fc4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:23.085838 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1accd73-318a-41ee-8271-d03eb52c2fc4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:23.086638 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1accd73-318a-41ee-8271-d03eb52c2fc4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:23.269925 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a1accd73-318a-41ee-8271-d03eb52c2fc4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:23.278491 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a1accd73-318a-41ee-8271-d03eb52c2fc4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b" status: 200 len: 1203 microversion: 2.1 time: 0.212595 Aug 04 17:40:23.279432 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3183/6394] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:23 2022] GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b => generated 1203 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:24.304844 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6c322fd9-48d6-4719-9fbd-273e1c8fb0f1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:24.305563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6c322fd9-48d6-4719-9fbd-273e1c8fb0f1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 44101175-eaf5-47e6-8fe1-ed418894353b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:24.317848 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c322fd9-48d6-4719-9fbd-273e1c8fb0f1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:24.319710 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c322fd9-48d6-4719-9fbd-273e1c8fb0f1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:24.320633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c322fd9-48d6-4719-9fbd-273e1c8fb0f1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:24.321714 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c322fd9-48d6-4719-9fbd-273e1c8fb0f1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:24.323000 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c322fd9-48d6-4719-9fbd-273e1c8fb0f1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:24.323683 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c322fd9-48d6-4719-9fbd-273e1c8fb0f1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:24.566655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6c322fd9-48d6-4719-9fbd-273e1c8fb0f1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:24.580630 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6c322fd9-48d6-4719-9fbd-273e1c8fb0f1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b" status: 200 len: 1203 microversion: 2.1 time: 0.279911 Aug 04 17:40:24.581743 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3212/6395] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:24 2022] GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b => generated 1203 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:25.606730 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4aaa84bb-222b-495c-9901-44c25ee348f8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:25.607380 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4aaa84bb-222b-495c-9901-44c25ee348f8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 44101175-eaf5-47e6-8fe1-ed418894353b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:25.616453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4aaa84bb-222b-495c-9901-44c25ee348f8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:25.616963 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4aaa84bb-222b-495c-9901-44c25ee348f8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:25.617404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4aaa84bb-222b-495c-9901-44c25ee348f8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:25.618352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4aaa84bb-222b-495c-9901-44c25ee348f8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:25.619009 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4aaa84bb-222b-495c-9901-44c25ee348f8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:25.619613 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4aaa84bb-222b-495c-9901-44c25ee348f8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:25.878952 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4aaa84bb-222b-495c-9901-44c25ee348f8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:25.901713 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4aaa84bb-222b-495c-9901-44c25ee348f8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b" status: 200 len: 1203 microversion: 2.1 time: 0.299253 Aug 04 17:40:25.914680 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3184/6396] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:25 2022] GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b => generated 1203 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:26.928789 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-91d6c275-26b7-48b1-810a-81600a364dc6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:26.929812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-91d6c275-26b7-48b1-810a-81600a364dc6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 44101175-eaf5-47e6-8fe1-ed418894353b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:26.941777 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91d6c275-26b7-48b1-810a-81600a364dc6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:26.942806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91d6c275-26b7-48b1-810a-81600a364dc6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:26.943650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91d6c275-26b7-48b1-810a-81600a364dc6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:26.944939 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91d6c275-26b7-48b1-810a-81600a364dc6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:26.945820 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91d6c275-26b7-48b1-810a-81600a364dc6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:26.946624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91d6c275-26b7-48b1-810a-81600a364dc6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:27.509910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-91d6c275-26b7-48b1-810a-81600a364dc6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:27.529807 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-91d6c275-26b7-48b1-810a-81600a364dc6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b" status: 200 len: 1203 microversion: 2.1 time: 0.608363 Aug 04 17:40:27.530901 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3213/6397] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:26 2022] GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b => generated 1203 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:28.566329 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-36b3c012-185d-47f8-8c0e-897958bce09f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:28.576199 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-36b3c012-185d-47f8-8c0e-897958bce09f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 44101175-eaf5-47e6-8fe1-ed418894353b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:28.614768 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36b3c012-185d-47f8-8c0e-897958bce09f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:28.616444 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36b3c012-185d-47f8-8c0e-897958bce09f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:28.617594 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36b3c012-185d-47f8-8c0e-897958bce09f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:28.619289 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36b3c012-185d-47f8-8c0e-897958bce09f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:28.621335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36b3c012-185d-47f8-8c0e-897958bce09f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:28.622329 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36b3c012-185d-47f8-8c0e-897958bce09f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:28.719042 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-3d3ecb11-1a3b-4b91-b5d8-39e0c09f1170 req-6c2214b0-5c17-4504-89f8-06c01a557ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44101175-eaf5-47e6-8fe1-ed418894353b", "name": "network-vif-plugged", "status": "completed", "tag": "c0423168-8461-49da-8c66-2d731dbcd478"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:40:28.754857 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-3d3ecb11-1a3b-4b91-b5d8-39e0c09f1170 req-6c2214b0-5c17-4504-89f8-06c01a557ca5 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:28.756086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-3d3ecb11-1a3b-4b91-b5d8-39e0c09f1170 req-6c2214b0-5c17-4504-89f8-06c01a557ca5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:28.756515 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-3d3ecb11-1a3b-4b91-b5d8-39e0c09f1170 req-6c2214b0-5c17-4504-89f8-06c01a557ca5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:28.769867 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-3d3ecb11-1a3b-4b91-b5d8-39e0c09f1170 req-6c2214b0-5c17-4504-89f8-06c01a557ca5 service nova] Creating event network-vif-plugged:c0423168-8461-49da-8c66-2d731dbcd478 for instance 44101175-eaf5-47e6-8fe1-ed418894353b on n-h1-851359-3 Aug 04 17:40:28.775566 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-3d3ecb11-1a3b-4b91-b5d8-39e0c09f1170 req-6c2214b0-5c17-4504-89f8-06c01a557ca5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063315 Aug 04 17:40:28.780390 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3214/6398] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:40:28.823085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-36b3c012-185d-47f8-8c0e-897958bce09f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:28.833532 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-36b3c012-185d-47f8-8c0e-897958bce09f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b" status: 200 len: 1203 microversion: 2.1 time: 0.275205 Aug 04 17:40:28.838053 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3185/6399] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:28 2022] GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b => generated 1203 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:29.859701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-584d45a3-a118-491c-9190-51f69ca5cf64 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:29.862982 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-584d45a3-a118-491c-9190-51f69ca5cf64 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 44101175-eaf5-47e6-8fe1-ed418894353b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:29.875564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-584d45a3-a118-491c-9190-51f69ca5cf64 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:29.876364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-584d45a3-a118-491c-9190-51f69ca5cf64 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:29.877313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-584d45a3-a118-491c-9190-51f69ca5cf64 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:29.879197 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-584d45a3-a118-491c-9190-51f69ca5cf64 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:29.879891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-584d45a3-a118-491c-9190-51f69ca5cf64 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:29.880543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-584d45a3-a118-491c-9190-51f69ca5cf64 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:30.063913 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-584d45a3-a118-491c-9190-51f69ca5cf64 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:30.072508 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-584d45a3-a118-491c-9190-51f69ca5cf64 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b" status: 200 len: 1203 microversion: 2.1 time: 0.219729 Aug 04 17:40:30.073442 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3215/6400] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:29 2022] GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b => generated 1203 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:40:31.096133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a99adf33-8e12-456e-8c44-e273eaf4c2e7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:31.097341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a99adf33-8e12-456e-8c44-e273eaf4c2e7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 44101175-eaf5-47e6-8fe1-ed418894353b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:31.104239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a99adf33-8e12-456e-8c44-e273eaf4c2e7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:31.104891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a99adf33-8e12-456e-8c44-e273eaf4c2e7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:31.105352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a99adf33-8e12-456e-8c44-e273eaf4c2e7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:31.106113 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a99adf33-8e12-456e-8c44-e273eaf4c2e7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:31.106586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a99adf33-8e12-456e-8c44-e273eaf4c2e7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:31.107026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a99adf33-8e12-456e-8c44-e273eaf4c2e7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:31.293093 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a99adf33-8e12-456e-8c44-e273eaf4c2e7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:31.301951 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a99adf33-8e12-456e-8c44-e273eaf4c2e7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b" status: 200 len: 1390 microversion: 2.1 time: 0.210625 Aug 04 17:40:31.316107 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3186/6401] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:31 2022] GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b => generated 1390 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:31.330217 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c8f661ca-d599-4544-9992-485e232eda5b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:31.331471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c8f661ca-d599-4544-9992-485e232eda5b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 44101175-eaf5-47e6-8fe1-ed418894353b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:31.339582 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8f661ca-d599-4544-9992-485e232eda5b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:31.340236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8f661ca-d599-4544-9992-485e232eda5b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:31.340743 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8f661ca-d599-4544-9992-485e232eda5b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:31.342375 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8f661ca-d599-4544-9992-485e232eda5b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:31.342897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8f661ca-d599-4544-9992-485e232eda5b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:31.343502 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c8f661ca-d599-4544-9992-485e232eda5b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:31.520833 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c8f661ca-d599-4544-9992-485e232eda5b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:31.534167 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c8f661ca-d599-4544-9992-485e232eda5b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b" status: 200 len: 1390 microversion: 2.1 time: 0.208740 Aug 04 17:40:31.550002 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3216/6402] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:31 2022] GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b => generated 1390 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:31.566409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-319a0b68-106b-4098-8500-2d44bed7cbd2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:31.568134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-319a0b68-106b-4098-8500-2d44bed7cbd2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 44101175-eaf5-47e6-8fe1-ed418894353b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:31.575653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-319a0b68-106b-4098-8500-2d44bed7cbd2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:31.578753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-319a0b68-106b-4098-8500-2d44bed7cbd2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:31.578873 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-319a0b68-106b-4098-8500-2d44bed7cbd2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:31.580388 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-319a0b68-106b-4098-8500-2d44bed7cbd2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:31.580942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-319a0b68-106b-4098-8500-2d44bed7cbd2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:31.582253 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-319a0b68-106b-4098-8500-2d44bed7cbd2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:31.774095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-319a0b68-106b-4098-8500-2d44bed7cbd2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:31.790652 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-319a0b68-106b-4098-8500-2d44bed7cbd2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b" status: 200 len: 1390 microversion: 2.1 time: 0.228723 Aug 04 17:40:31.791661 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3187/6403] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:31 2022] GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b => generated 1390 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:31.813698 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5121d098-ca49-4830-bad8-d025e7273031 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:31.814243 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5121d098-ca49-4830-bad8-d025e7273031 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 44101175-eaf5-47e6-8fe1-ed418894353b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:31.821474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5121d098-ca49-4830-bad8-d025e7273031 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:31.821970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5121d098-ca49-4830-bad8-d025e7273031 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:31.822445 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5121d098-ca49-4830-bad8-d025e7273031 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:31.823163 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5121d098-ca49-4830-bad8-d025e7273031 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:31.823865 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5121d098-ca49-4830-bad8-d025e7273031 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:31.824463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5121d098-ca49-4830-bad8-d025e7273031 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:31.855624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5121d098-ca49-4830-bad8-d025e7273031 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 44101175-eaf5-47e6-8fe1-ed418894353b] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:40:31.948570 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5121d098-ca49-4830-bad8-d025e7273031 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "DELETE /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b" status: 204 len: 0 microversion: 2.1 time: 0.138978 Aug 04 17:40:31.949473 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3217/6404] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:40:31 2022] DELETE /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:40:31.958294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2c9d2a24-1d5c-4eda-af5b-d0aaffbfde74 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:31.959456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2c9d2a24-1d5c-4eda-af5b-d0aaffbfde74 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 44101175-eaf5-47e6-8fe1-ed418894353b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:31.967035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c9d2a24-1d5c-4eda-af5b-d0aaffbfde74 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:31.967556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c9d2a24-1d5c-4eda-af5b-d0aaffbfde74 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:31.968011 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c9d2a24-1d5c-4eda-af5b-d0aaffbfde74 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:31.968769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c9d2a24-1d5c-4eda-af5b-d0aaffbfde74 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:31.969245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c9d2a24-1d5c-4eda-af5b-d0aaffbfde74 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:31.969685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c9d2a24-1d5c-4eda-af5b-d0aaffbfde74 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:32.152185 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2c9d2a24-1d5c-4eda-af5b-d0aaffbfde74 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:32.164354 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2c9d2a24-1d5c-4eda-af5b-d0aaffbfde74 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b" status: 200 len: 1396 microversion: 2.1 time: 0.210294 Aug 04 17:40:32.166017 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3188/6405] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:31 2022] GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b => generated 1396 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:40:33.195443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-db217fb5-8ed5-48e2-a778-b72c568cee8a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:33.196167 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-db217fb5-8ed5-48e2-a778-b72c568cee8a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 44101175-eaf5-47e6-8fe1-ed418894353b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:33.207993 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db217fb5-8ed5-48e2-a778-b72c568cee8a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:33.208770 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db217fb5-8ed5-48e2-a778-b72c568cee8a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:33.217295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db217fb5-8ed5-48e2-a778-b72c568cee8a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:33.218457 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db217fb5-8ed5-48e2-a778-b72c568cee8a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:33.218801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db217fb5-8ed5-48e2-a778-b72c568cee8a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:33.219237 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-db217fb5-8ed5-48e2-a778-b72c568cee8a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:33.493713 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-db217fb5-8ed5-48e2-a778-b72c568cee8a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:33.504225 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-db217fb5-8ed5-48e2-a778-b72c568cee8a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b" status: 200 len: 1396 microversion: 2.1 time: 0.318999 Aug 04 17:40:33.505482 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3218/6406] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:33 2022] GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b => generated 1396 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:34.492481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0c3bb3d8-6277-4b19-b054-1b5536627045 req-abb716f6-e198-46a0-a0dc-cebded70632b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44101175-eaf5-47e6-8fe1-ed418894353b", "name": "network-vif-deleted", "tag": "c0423168-8461-49da-8c66-2d731dbcd478"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:40:34.522620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0c3bb3d8-6277-4b19-b054-1b5536627045 req-abb716f6-e198-46a0-a0dc-cebded70632b service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:34.528179 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-469361fa-6d42-48cc-af35-4e399a2c199b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:34.529440 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-469361fa-6d42-48cc-af35-4e399a2c199b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 44101175-eaf5-47e6-8fe1-ed418894353b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:34.539099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0c3bb3d8-6277-4b19-b054-1b5536627045 req-abb716f6-e198-46a0-a0dc-cebded70632b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:34.539864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0c3bb3d8-6277-4b19-b054-1b5536627045 req-abb716f6-e198-46a0-a0dc-cebded70632b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:34.548670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-469361fa-6d42-48cc-af35-4e399a2c199b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:34.553957 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-469361fa-6d42-48cc-af35-4e399a2c199b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:34.562726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-469361fa-6d42-48cc-af35-4e399a2c199b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:34.563725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-469361fa-6d42-48cc-af35-4e399a2c199b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:34.576920 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0c3bb3d8-6277-4b19-b054-1b5536627045 req-abb716f6-e198-46a0-a0dc-cebded70632b service nova] Creating event network-vif-deleted:c0423168-8461-49da-8c66-2d731dbcd478 for instance 44101175-eaf5-47e6-8fe1-ed418894353b on n-h1-851359-3 Aug 04 17:40:34.578376 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-469361fa-6d42-48cc-af35-4e399a2c199b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:34.579051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-469361fa-6d42-48cc-af35-4e399a2c199b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:34.590203 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0c3bb3d8-6277-4b19-b054-1b5536627045 req-abb716f6-e198-46a0-a0dc-cebded70632b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102402 Aug 04 17:40:34.591159 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3189/6407] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:40:34.787326 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-469361fa-6d42-48cc-af35-4e399a2c199b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:34.802461 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-469361fa-6d42-48cc-af35-4e399a2c199b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b" status: 200 len: 1188 microversion: 2.1 time: 0.278394 Aug 04 17:40:34.803364 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3219/6408] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:34 2022] GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b => generated 1188 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:40:35.834556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1447e8e5-0625-42a8-9f46-dd4f0114f695 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:35.836585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1447e8e5-0625-42a8-9f46-dd4f0114f695 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 44101175-eaf5-47e6-8fe1-ed418894353b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:35.841814 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:40:35.854574 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1447e8e5-0625-42a8-9f46-dd4f0114f695 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:35.855347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1447e8e5-0625-42a8-9f46-dd4f0114f695 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:35.855971 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1447e8e5-0625-42a8-9f46-dd4f0114f695 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:35.856883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1447e8e5-0625-42a8-9f46-dd4f0114f695 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:35.857526 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1447e8e5-0625-42a8-9f46-dd4f0114f695 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:35.858236 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1447e8e5-0625-42a8-9f46-dd4f0114f695 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:35.866098 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=77 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:40:35.979286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1447e8e5-0625-42a8-9f46-dd4f0114f695 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:35.990695 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1447e8e5-0625-42a8-9f46-dd4f0114f695 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b" status: 200 len: 1188 microversion: 2.1 time: 0.169692 Aug 04 17:40:35.991300 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3190/6409] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:35 2022] GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b => generated 1188 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:37.013296 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-962064c1-2fc4-4538-b191-5c3393ead15c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:37.014835 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-962064c1-2fc4-4538-b191-5c3393ead15c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 44101175-eaf5-47e6-8fe1-ed418894353b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:37.081426 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-962064c1-2fc4-4538-b191-5c3393ead15c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:37.082503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-962064c1-2fc4-4538-b191-5c3393ead15c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:37.083356 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-962064c1-2fc4-4538-b191-5c3393ead15c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:37.095083 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-962064c1-2fc4-4538-b191-5c3393ead15c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:37.103269 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-962064c1-2fc4-4538-b191-5c3393ead15c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:37.104010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-962064c1-2fc4-4538-b191-5c3393ead15c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:37.245211 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-962064c1-2fc4-4538-b191-5c3393ead15c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:37.255823 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-962064c1-2fc4-4538-b191-5c3393ead15c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b" status: 200 len: 1188 microversion: 2.1 time: 0.246797 Aug 04 17:40:37.257547 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3220/6410] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:37 2022] GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b => generated 1188 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:38.282855 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0be5ff4e-5aa7-46bf-b9d4-a308e4a7bfbe tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:38.284088 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0be5ff4e-5aa7-46bf-b9d4-a308e4a7bfbe tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 44101175-eaf5-47e6-8fe1-ed418894353b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:38.301396 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0be5ff4e-5aa7-46bf-b9d4-a308e4a7bfbe tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:38.301814 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0be5ff4e-5aa7-46bf-b9d4-a308e4a7bfbe tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:38.302470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0be5ff4e-5aa7-46bf-b9d4-a308e4a7bfbe tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:38.303378 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0be5ff4e-5aa7-46bf-b9d4-a308e4a7bfbe tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:38.304026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0be5ff4e-5aa7-46bf-b9d4-a308e4a7bfbe tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:38.304637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0be5ff4e-5aa7-46bf-b9d4-a308e4a7bfbe tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:38.484364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0be5ff4e-5aa7-46bf-b9d4-a308e4a7bfbe tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:38.492849 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0be5ff4e-5aa7-46bf-b9d4-a308e4a7bfbe tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b" status: 200 len: 1188 microversion: 2.1 time: 0.215513 Aug 04 17:40:38.506506 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3191/6411] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:38 2022] GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b => generated 1188 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:39.514408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-02f72533-6149-476a-8cbd-fd524f2e5e2c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:39.515045 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-02f72533-6149-476a-8cbd-fd524f2e5e2c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 44101175-eaf5-47e6-8fe1-ed418894353b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:39.517969 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:40:39.527405 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02f72533-6149-476a-8cbd-fd524f2e5e2c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:39.527918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02f72533-6149-476a-8cbd-fd524f2e5e2c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:39.528374 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02f72533-6149-476a-8cbd-fd524f2e5e2c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:39.529176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02f72533-6149-476a-8cbd-fd524f2e5e2c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:39.529630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02f72533-6149-476a-8cbd-fd524f2e5e2c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:39.538477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-02f72533-6149-476a-8cbd-fd524f2e5e2c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:39.550453 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:40:40.431375 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-02f72533-6149-476a-8cbd-fd524f2e5e2c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:40.443166 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-02f72533-6149-476a-8cbd-fd524f2e5e2c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b" status: 200 len: 1188 microversion: 2.1 time: 0.932368 Aug 04 17:40:40.444042 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3221/6412] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:39 2022] GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b => generated 1188 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:41.464726 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3ef6dbcb-a67d-42aa-9b6b-01ddfc9de521 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:41.465346 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3ef6dbcb-a67d-42aa-9b6b-01ddfc9de521 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 44101175-eaf5-47e6-8fe1-ed418894353b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:41.489636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ef6dbcb-a67d-42aa-9b6b-01ddfc9de521 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:41.490183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ef6dbcb-a67d-42aa-9b6b-01ddfc9de521 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:41.490635 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ef6dbcb-a67d-42aa-9b6b-01ddfc9de521 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:41.491361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ef6dbcb-a67d-42aa-9b6b-01ddfc9de521 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:41.491827 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ef6dbcb-a67d-42aa-9b6b-01ddfc9de521 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:41.492260 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ef6dbcb-a67d-42aa-9b6b-01ddfc9de521 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:41.542365 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-3ef6dbcb-a67d-42aa-9b6b-01ddfc9de521 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] HTTP exception thrown: Instance 44101175-eaf5-47e6-8fe1-ed418894353b could not be found. Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3ef6dbcb-a67d-42aa-9b6b-01ddfc9de521 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Request method failure captured: Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b HTTP/1.1 Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7ARpoisKS8ru_ZJiIrIfjIFMRjfQL-mVrLbzAzLl4Z4wH-8ksarsVn1PTK67x0ktAL2RMgNiOghxRSfCsuIPgqi5zzrjB6PtD1ptQpXCC7QBiVIYCXgsvXv7bVdD4F6QLnLsEgFyHhnUvqqIgdfnwyBZE3QOXa1h7oqCs3SSjoPFKXM Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 46f694275ec441259c366f63daa4a380 Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TestVolumeBootPattern-275420730 Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46f694275ec441259c366f63daa4a380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46f694275ec441259c366f63daa4a380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_46f694275ec441259c366f63daa4a380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/46f694275ec441259c366f63daa4a380"}]}] Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TestVolumeBootPattern-275420730 Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 46f694275ec441259c366f63daa4a380 Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestVolumeBootPattern-275420730 Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TestVolumeBootPattern-275420730-project Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 50bf6f5281964c0b81809080bcf22bdd Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TestVolumeBootPattern-275420730-project Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 44101175-eaf5-47e6-8fe1-ed418894353b could not be found. Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '44101175-eaf5-47e6-8fe1-ed418894353b'} Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44101175-eaf5-47e6-8fe1-ed418894353b could not be found. Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44101175-eaf5-47e6-8fe1-ed418894353b could not be found. Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:40:41.544000 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:40:41.549643 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:40:41.549643 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:40:41.549643 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:40:41.549643 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:40:41.549643 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:40:41.549643 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44101175-eaf5-47e6-8fe1-ed418894353b could not be found. Aug 04 17:40:41.549643 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:40:41.549643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3ef6dbcb-a67d-42aa-9b6b-01ddfc9de521 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Returning 404 to user: Instance 44101175-eaf5-47e6-8fe1-ed418894353b could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:40:41.549643 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3ef6dbcb-a67d-42aa-9b6b-01ddfc9de521 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b" status: 404 len: 111 microversion: 2.1 time: 0.084637 Aug 04 17:40:41.581816 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3192/6413] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:41 2022] GET /compute/v2.1/servers/44101175-eaf5-47e6-8fe1-ed418894353b => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:40:45.143877 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b29aff19-c173-4cec-be49-11e814cd3a54 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:45.145088 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:40:45.145088 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 17:40:45.146851 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b29aff19-c173-4cec-be49-11e814cd3a54 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:45.147370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b29aff19-c173-4cec-be49-11e814cd3a54 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:45.147823 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b29aff19-c173-4cec-be49-11e814cd3a54 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:45.148588 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b29aff19-c173-4cec-be49-11e814cd3a54 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:45.149220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b29aff19-c173-4cec-be49-11e814cd3a54 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:45.149671 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b29aff19-c173-4cec-be49-11e814cd3a54 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:45.204646 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b29aff19-c173-4cec-be49-11e814cd3a54 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.284212 Aug 04 17:40:45.205271 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3222/6414] 10.222.0.93 () {58 vars in 1185 bytes} [Thu Aug 4 17:40:44 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:40:45.337007 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dc1d4854-2f04-42a0-80ce-c5b39965969b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-18368290", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "availability_zone": "nova:n-h1-851359-3", "networks": [{"uuid": "f192c00a-f4e0-406f-99c3-486e21b39c73"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:40:45.408279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-dc1d4854-2f04-42a0-80ce-c5b39965969b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] validate_networks() for [('f192c00a-f4e0-406f-99c3-486e21b39c73', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:40:45.996585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-dc1d4854-2f04-42a0-80ce-c5b39965969b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:40:45.997016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-dc1d4854-2f04-42a0-80ce-c5b39965969b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:40:45.997500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-dc1d4854-2f04-42a0-80ce-c5b39965969b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:40:45.997918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-dc1d4854-2f04-42a0-80ce-c5b39965969b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:40:45.998365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-dc1d4854-2f04-42a0-80ce-c5b39965969b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:40:46.013894 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc1d4854-2f04-42a0-80ce-c5b39965969b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:46.014833 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc1d4854-2f04-42a0-80ce-c5b39965969b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:46.015710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc1d4854-2f04-42a0-80ce-c5b39965969b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:46.017306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc1d4854-2f04-42a0-80ce-c5b39965969b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:46.018079 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc1d4854-2f04-42a0-80ce-c5b39965969b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:46.018749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc1d4854-2f04-42a0-80ce-c5b39965969b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:46.043191 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-dc1d4854-2f04-42a0-80ce-c5b39965969b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Getting quotas for project 0d85e1375a3449aba3bf5548d2f964e3. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:40:46.050120 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-dc1d4854-2f04-42a0-80ce-c5b39965969b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Getting quotas for user 26b0b5dea5be4e268d18e461923ef10f and project 0d85e1375a3449aba3bf5548d2f964e3. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:40:46.066231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dc1d4854-2f04-42a0-80ce-c5b39965969b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:40:46.068759 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dc1d4854-2f04-42a0-80ce-c5b39965969b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: cafaf520-c9e3-4fb4-80fc-d17c5e7041ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:40:46.146250 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dc1d4854-2f04-42a0-80ce-c5b39965969b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.812566 Aug 04 17:40:46.147936 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3193/6415] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:40:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:40:46.164355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ffd1ce09-2d39-4557-9b44-9310043c6b9c tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:46.165774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ffd1ce09-2d39-4557-9b44-9310043c6b9c tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: cafaf520-c9e3-4fb4-80fc-d17c5e7041ea] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:46.277623 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ffd1ce09-2d39-4557-9b44-9310043c6b9c tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea" status: 200 len: 1327 microversion: 2.1 time: 0.122283 Aug 04 17:40:46.279049 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3223/6416] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:46 2022] GET /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea => generated 1327 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:47.302464 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ccd0417e-dcbf-4048-bb72-fbd80f9c18b7 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:47.303515 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ccd0417e-dcbf-4048-bb72-fbd80f9c18b7 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: cafaf520-c9e3-4fb4-80fc-d17c5e7041ea] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:47.314071 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ccd0417e-dcbf-4048-bb72-fbd80f9c18b7 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:47.315086 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ccd0417e-dcbf-4048-bb72-fbd80f9c18b7 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:47.315789 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ccd0417e-dcbf-4048-bb72-fbd80f9c18b7 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:47.316740 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ccd0417e-dcbf-4048-bb72-fbd80f9c18b7 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:47.317427 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ccd0417e-dcbf-4048-bb72-fbd80f9c18b7 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:47.318170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ccd0417e-dcbf-4048-bb72-fbd80f9c18b7 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:47.514236 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ccd0417e-dcbf-4048-bb72-fbd80f9c18b7 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea" status: 200 len: 1336 microversion: 2.1 time: 0.218228 Aug 04 17:40:47.522605 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3194/6417] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:47 2022] GET /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea => generated 1336 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:48.538697 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-84be044a-81b1-4515-a480-aae5eaeb8e3c tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:48.539496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-84be044a-81b1-4515-a480-aae5eaeb8e3c tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: cafaf520-c9e3-4fb4-80fc-d17c5e7041ea] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:48.550399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84be044a-81b1-4515-a480-aae5eaeb8e3c tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:48.550902 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84be044a-81b1-4515-a480-aae5eaeb8e3c tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:48.551546 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84be044a-81b1-4515-a480-aae5eaeb8e3c tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:48.552460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84be044a-81b1-4515-a480-aae5eaeb8e3c tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:48.553107 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84be044a-81b1-4515-a480-aae5eaeb8e3c tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:48.554737 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84be044a-81b1-4515-a480-aae5eaeb8e3c tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:48.785710 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-84be044a-81b1-4515-a480-aae5eaeb8e3c tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea" status: 200 len: 1462 microversion: 2.1 time: 0.250796 Aug 04 17:40:48.787425 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3224/6418] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:48 2022] GET /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea => generated 1462 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:49.559989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-ba5ec1ce-e753-4f9b-8b74-c672585ba1b1 req-029b7bde-feed-436b-bfb8-c7d650c728e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cafaf520-c9e3-4fb4-80fc-d17c5e7041ea", "tag": "4e502dec-68a9-4cdd-8717-f9c3deca0099"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:40:49.572624 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ba5ec1ce-e753-4f9b-8b74-c672585ba1b1 req-029b7bde-feed-436b-bfb8-c7d650c728e2 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:49.573697 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ba5ec1ce-e753-4f9b-8b74-c672585ba1b1 req-029b7bde-feed-436b-bfb8-c7d650c728e2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:49.574252 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ba5ec1ce-e753-4f9b-8b74-c672585ba1b1 req-029b7bde-feed-436b-bfb8-c7d650c728e2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:49.587216 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-ba5ec1ce-e753-4f9b-8b74-c672585ba1b1 req-029b7bde-feed-436b-bfb8-c7d650c728e2 service nova] Creating event network-changed:4e502dec-68a9-4cdd-8717-f9c3deca0099 for instance cafaf520-c9e3-4fb4-80fc-d17c5e7041ea on n-h1-851359-3 Aug 04 17:40:49.592970 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-ba5ec1ce-e753-4f9b-8b74-c672585ba1b1 req-029b7bde-feed-436b-bfb8-c7d650c728e2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037088 Aug 04 17:40:49.594794 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3195/6419] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:40:49.810163 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6f886304-8182-47a0-973b-988e40fbaf99 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:49.814143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6f886304-8182-47a0-973b-988e40fbaf99 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: cafaf520-c9e3-4fb4-80fc-d17c5e7041ea] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:49.821543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f886304-8182-47a0-973b-988e40fbaf99 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:49.822463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f886304-8182-47a0-973b-988e40fbaf99 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:49.823132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f886304-8182-47a0-973b-988e40fbaf99 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:49.824127 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f886304-8182-47a0-973b-988e40fbaf99 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:49.824677 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f886304-8182-47a0-973b-988e40fbaf99 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:49.825532 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f886304-8182-47a0-973b-988e40fbaf99 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:49.996361 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6f886304-8182-47a0-973b-988e40fbaf99 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea" status: 200 len: 1462 microversion: 2.1 time: 0.190953 Aug 04 17:40:49.997146 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3225/6420] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:49 2022] GET /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea => generated 1462 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:50.625966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3153b05e-4e86-4f72-9523-19abed3edeb8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1938460099", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "31edcd79-8fbc-4336-be7e-e9d50ef6769d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6002cd39-a33b-430d-a6d2-0ecfe13cd1ee"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:40:50.741226 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-3153b05e-4e86-4f72-9523-19abed3edeb8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] validate_networks() for [('6002cd39-a33b-430d-a6d2-0ecfe13cd1ee', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:40:51.025260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ba16bfc7-eb35-4030-8f0b-ba28d9d2e0fe tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:51.027267 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ba16bfc7-eb35-4030-8f0b-ba28d9d2e0fe tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: cafaf520-c9e3-4fb4-80fc-d17c5e7041ea] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:51.040614 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba16bfc7-eb35-4030-8f0b-ba28d9d2e0fe tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:51.041558 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba16bfc7-eb35-4030-8f0b-ba28d9d2e0fe tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:51.043063 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba16bfc7-eb35-4030-8f0b-ba28d9d2e0fe tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:51.044315 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba16bfc7-eb35-4030-8f0b-ba28d9d2e0fe tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:51.045075 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba16bfc7-eb35-4030-8f0b-ba28d9d2e0fe tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:51.045804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba16bfc7-eb35-4030-8f0b-ba28d9d2e0fe tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:51.514229 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-3153b05e-4e86-4f72-9523-19abed3edeb8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:40:51.514993 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-3153b05e-4e86-4f72-9523-19abed3edeb8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:40:51.516252 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-3153b05e-4e86-4f72-9523-19abed3edeb8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:40:51.516688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-3153b05e-4e86-4f72-9523-19abed3edeb8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:40:51.517119 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-3153b05e-4e86-4f72-9523-19abed3edeb8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:40:51.540160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3153b05e-4e86-4f72-9523-19abed3edeb8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:51.542924 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3153b05e-4e86-4f72-9523-19abed3edeb8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:51.543608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3153b05e-4e86-4f72-9523-19abed3edeb8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:51.545586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3153b05e-4e86-4f72-9523-19abed3edeb8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:51.550912 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3153b05e-4e86-4f72-9523-19abed3edeb8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:51.551732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3153b05e-4e86-4f72-9523-19abed3edeb8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:51.568849 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ba16bfc7-eb35-4030-8f0b-ba28d9d2e0fe tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea" status: 200 len: 1462 microversion: 2.1 time: 0.553378 Aug 04 17:40:51.583726 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3226/6421] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:51 2022] GET /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea => generated 1462 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:51.603064 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-3153b05e-4e86-4f72-9523-19abed3edeb8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Getting quotas for project 46f694275ec441259c366f63daa4a380. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:40:51.610922 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-3153b05e-4e86-4f72-9523-19abed3edeb8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Getting quotas for user 50bf6f5281964c0b81809080bcf22bdd and project 46f694275ec441259c366f63daa4a380. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:40:51.733499 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3153b05e-4e86-4f72-9523-19abed3edeb8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:40:51.738957 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3153b05e-4e86-4f72-9523-19abed3edeb8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 133fadeb-1322-4818-bb88-41691932a451] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='31edcd79-8fbc-4336-be7e-e9d50ef6769d',volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:40:51.943969 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3153b05e-4e86-4f72-9523-19abed3edeb8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.323775 Aug 04 17:40:51.944627 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3196/6422] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:40:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1325 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:40:51.957229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9ec5722b-ca93-4c42-8428-4a1859c6fce6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:51.958227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9ec5722b-ca93-4c42-8428-4a1859c6fce6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 133fadeb-1322-4818-bb88-41691932a451] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:52.034826 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9ec5722b-ca93-4c42-8428-4a1859c6fce6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:52.044718 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9ec5722b-ca93-4c42-8428-4a1859c6fce6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451" status: 200 len: 1057 microversion: 2.1 time: 0.092680 Aug 04 17:40:52.058014 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3227/6423] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:51 2022] GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451 => generated 1057 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:52.600869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b3b88828-8e94-478f-b46b-eaaa6bcde998 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:52.601780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b3b88828-8e94-478f-b46b-eaaa6bcde998 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: cafaf520-c9e3-4fb4-80fc-d17c5e7041ea] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:52.609663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3b88828-8e94-478f-b46b-eaaa6bcde998 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:52.610207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3b88828-8e94-478f-b46b-eaaa6bcde998 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:52.610655 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3b88828-8e94-478f-b46b-eaaa6bcde998 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:52.611546 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3b88828-8e94-478f-b46b-eaaa6bcde998 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:52.612098 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3b88828-8e94-478f-b46b-eaaa6bcde998 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:52.612635 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3b88828-8e94-478f-b46b-eaaa6bcde998 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:52.808996 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b3b88828-8e94-478f-b46b-eaaa6bcde998 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea" status: 200 len: 1462 microversion: 2.1 time: 0.219708 Aug 04 17:40:52.815586 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3197/6424] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:52 2022] GET /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea => generated 1462 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:53.070583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-98398758-883d-42bf-9d83-4bd0d6f74728 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:53.071413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-98398758-883d-42bf-9d83-4bd0d6f74728 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 133fadeb-1322-4818-bb88-41691932a451] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:53.080661 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98398758-883d-42bf-9d83-4bd0d6f74728 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:53.081311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98398758-883d-42bf-9d83-4bd0d6f74728 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:53.081862 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98398758-883d-42bf-9d83-4bd0d6f74728 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:53.082984 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98398758-883d-42bf-9d83-4bd0d6f74728 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:53.083293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98398758-883d-42bf-9d83-4bd0d6f74728 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:53.083824 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98398758-883d-42bf-9d83-4bd0d6f74728 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:53.161340 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-98398758-883d-42bf-9d83-4bd0d6f74728 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:53.170513 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-98398758-883d-42bf-9d83-4bd0d6f74728 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451" status: 200 len: 1155 microversion: 2.1 time: 0.103428 Aug 04 17:40:53.171703 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3228/6425] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:53 2022] GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451 => generated 1155 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:53.839458 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-afc22e59-5189-4c7b-a604-65e00fc86c4d tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:53.840091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-afc22e59-5189-4c7b-a604-65e00fc86c4d tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: cafaf520-c9e3-4fb4-80fc-d17c5e7041ea] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:53.847988 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-afc22e59-5189-4c7b-a604-65e00fc86c4d tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:53.848581 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-afc22e59-5189-4c7b-a604-65e00fc86c4d tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:53.849299 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-afc22e59-5189-4c7b-a604-65e00fc86c4d tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:53.850097 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-afc22e59-5189-4c7b-a604-65e00fc86c4d tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:53.851798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-afc22e59-5189-4c7b-a604-65e00fc86c4d tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:53.852511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-afc22e59-5189-4c7b-a604-65e00fc86c4d tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:54.040909 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-afc22e59-5189-4c7b-a604-65e00fc86c4d tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea" status: 200 len: 1462 microversion: 2.1 time: 0.206267 Aug 04 17:40:54.058012 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3198/6426] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:53 2022] GET /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea => generated 1462 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:40:54.196924 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0ad73922-d23f-451e-b78e-a2bb5e3dba57 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:54.198140 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0ad73922-d23f-451e-b78e-a2bb5e3dba57 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 133fadeb-1322-4818-bb88-41691932a451] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:54.211370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ad73922-d23f-451e-b78e-a2bb5e3dba57 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:54.211874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ad73922-d23f-451e-b78e-a2bb5e3dba57 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:54.212319 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ad73922-d23f-451e-b78e-a2bb5e3dba57 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:54.213046 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ad73922-d23f-451e-b78e-a2bb5e3dba57 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:54.214106 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ad73922-d23f-451e-b78e-a2bb5e3dba57 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:54.214718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ad73922-d23f-451e-b78e-a2bb5e3dba57 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:54.455628 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0ad73922-d23f-451e-b78e-a2bb5e3dba57 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:54.464463 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0ad73922-d23f-451e-b78e-a2bb5e3dba57 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451" status: 200 len: 1215 microversion: 2.1 time: 0.274821 Aug 04 17:40:54.479569 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3229/6427] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:54 2022] GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451 => generated 1215 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:54.989017 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-da21624d-7291-4b14-8ce4-57acc8d18915 req-95d98a8b-e6d9-4115-bf37-941a2003a677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cafaf520-c9e3-4fb4-80fc-d17c5e7041ea", "name": "network-vif-plugged", "status": "completed", "tag": "4e502dec-68a9-4cdd-8717-f9c3deca0099"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:40:55.010446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-da21624d-7291-4b14-8ce4-57acc8d18915 req-95d98a8b-e6d9-4115-bf37-941a2003a677 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:55.012732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-da21624d-7291-4b14-8ce4-57acc8d18915 req-95d98a8b-e6d9-4115-bf37-941a2003a677 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:55.013275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-da21624d-7291-4b14-8ce4-57acc8d18915 req-95d98a8b-e6d9-4115-bf37-941a2003a677 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:55.036391 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-da21624d-7291-4b14-8ce4-57acc8d18915 req-95d98a8b-e6d9-4115-bf37-941a2003a677 service nova] Creating event network-vif-plugged:4e502dec-68a9-4cdd-8717-f9c3deca0099 for instance cafaf520-c9e3-4fb4-80fc-d17c5e7041ea on n-h1-851359-3 Aug 04 17:40:55.046291 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-da21624d-7291-4b14-8ce4-57acc8d18915 req-95d98a8b-e6d9-4115-bf37-941a2003a677 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061671 Aug 04 17:40:55.047904 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3199/6428] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:40:55.074649 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-32bc5b64-d3bd-46bd-bd4c-0bfc8b914b26 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:55.077311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-32bc5b64-d3bd-46bd-bd4c-0bfc8b914b26 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: cafaf520-c9e3-4fb4-80fc-d17c5e7041ea] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:55.092769 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32bc5b64-d3bd-46bd-bd4c-0bfc8b914b26 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:55.094702 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32bc5b64-d3bd-46bd-bd4c-0bfc8b914b26 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:55.095361 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32bc5b64-d3bd-46bd-bd4c-0bfc8b914b26 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:55.096335 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32bc5b64-d3bd-46bd-bd4c-0bfc8b914b26 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:55.097969 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32bc5b64-d3bd-46bd-bd4c-0bfc8b914b26 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:55.098680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32bc5b64-d3bd-46bd-bd4c-0bfc8b914b26 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:55.162128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:40:55.298848 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-32bc5b64-d3bd-46bd-bd4c-0bfc8b914b26 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea" status: 200 len: 1462 microversion: 2.1 time: 0.229139 Aug 04 17:40:55.299531 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3230/6429] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:55 2022] GET /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea => generated 1462 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:55.488339 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c6ee7c8a-e77e-4f41-ada2-8f5c96425eb3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:55.488899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c6ee7c8a-e77e-4f41-ada2-8f5c96425eb3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 133fadeb-1322-4818-bb88-41691932a451] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:55.499864 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6ee7c8a-e77e-4f41-ada2-8f5c96425eb3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:55.500384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6ee7c8a-e77e-4f41-ada2-8f5c96425eb3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:55.502362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6ee7c8a-e77e-4f41-ada2-8f5c96425eb3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:55.503120 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6ee7c8a-e77e-4f41-ada2-8f5c96425eb3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:55.503607 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6ee7c8a-e77e-4f41-ada2-8f5c96425eb3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:55.504050 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6ee7c8a-e77e-4f41-ada2-8f5c96425eb3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:55.684054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-8ac769a3-45a7-403b-8c52-3a65ab3f2429 req-1c203f2f-fab5-4557-a78e-69ef4800be80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "133fadeb-1322-4818-bb88-41691932a451", "tag": "dd3d54d4-14c4-4fcc-95fb-d4c0458975f4"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:40:55.696308 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8ac769a3-45a7-403b-8c52-3a65ab3f2429 req-1c203f2f-fab5-4557-a78e-69ef4800be80 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:55.697738 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8ac769a3-45a7-403b-8c52-3a65ab3f2429 req-1c203f2f-fab5-4557-a78e-69ef4800be80 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:55.698396 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8ac769a3-45a7-403b-8c52-3a65ab3f2429 req-1c203f2f-fab5-4557-a78e-69ef4800be80 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:55.711159 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-8ac769a3-45a7-403b-8c52-3a65ab3f2429 req-1c203f2f-fab5-4557-a78e-69ef4800be80 service nova] Creating event network-changed:dd3d54d4-14c4-4fcc-95fb-d4c0458975f4 for instance 133fadeb-1322-4818-bb88-41691932a451 on n-h2-851359-3 Aug 04 17:40:55.717564 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-8ac769a3-45a7-403b-8c52-3a65ab3f2429 req-1c203f2f-fab5-4557-a78e-69ef4800be80 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.313560 Aug 04 17:40:55.718508 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3200/6430] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:40:55.737388 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c6ee7c8a-e77e-4f41-ada2-8f5c96425eb3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:55.746629 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c6ee7c8a-e77e-4f41-ada2-8f5c96425eb3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451" status: 200 len: 1215 microversion: 2.1 time: 0.262763 Aug 04 17:40:55.755721 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3231/6431] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:55 2022] GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451 => generated 1215 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:56.329378 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-87f1b16b-6beb-47a4-b876-af30aaff1ab4 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:56.331421 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-87f1b16b-6beb-47a4-b876-af30aaff1ab4 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: cafaf520-c9e3-4fb4-80fc-d17c5e7041ea] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:56.340834 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87f1b16b-6beb-47a4-b876-af30aaff1ab4 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:56.341608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87f1b16b-6beb-47a4-b876-af30aaff1ab4 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:56.342392 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87f1b16b-6beb-47a4-b876-af30aaff1ab4 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:56.344197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87f1b16b-6beb-47a4-b876-af30aaff1ab4 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:56.345509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87f1b16b-6beb-47a4-b876-af30aaff1ab4 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:56.346202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87f1b16b-6beb-47a4-b876-af30aaff1ab4 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:56.534730 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-87f1b16b-6beb-47a4-b876-af30aaff1ab4 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea" status: 200 len: 1462 microversion: 2.1 time: 0.216383 Aug 04 17:40:56.535748 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3201/6432] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:56 2022] GET /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea => generated 1462 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:56.768726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3efb6929-7378-458d-9fd9-876468e061b2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:56.769363 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3efb6929-7378-458d-9fd9-876468e061b2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 133fadeb-1322-4818-bb88-41691932a451] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:56.776578 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3efb6929-7378-458d-9fd9-876468e061b2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:56.777075 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3efb6929-7378-458d-9fd9-876468e061b2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:56.777546 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3efb6929-7378-458d-9fd9-876468e061b2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:56.778278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3efb6929-7378-458d-9fd9-876468e061b2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:56.778738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3efb6929-7378-458d-9fd9-876468e061b2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:56.779471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3efb6929-7378-458d-9fd9-876468e061b2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:56.932212 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3efb6929-7378-458d-9fd9-876468e061b2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:56.942263 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3efb6929-7378-458d-9fd9-876468e061b2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451" status: 200 len: 1215 microversion: 2.1 time: 0.177784 Aug 04 17:40:56.943521 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3232/6433] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:56 2022] GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451 => generated 1215 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:57.556322 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-314ed0ef-9631-4920-9eec-ad905f86ed08 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:57.565580 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-314ed0ef-9631-4920-9eec-ad905f86ed08 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: cafaf520-c9e3-4fb4-80fc-d17c5e7041ea] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:57.582019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-314ed0ef-9631-4920-9eec-ad905f86ed08 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:57.584775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-314ed0ef-9631-4920-9eec-ad905f86ed08 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:57.585323 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-314ed0ef-9631-4920-9eec-ad905f86ed08 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:57.587315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-314ed0ef-9631-4920-9eec-ad905f86ed08 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:57.589044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-314ed0ef-9631-4920-9eec-ad905f86ed08 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:57.590318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-314ed0ef-9631-4920-9eec-ad905f86ed08 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:57.736844 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-314ed0ef-9631-4920-9eec-ad905f86ed08 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea" status: 200 len: 1647 microversion: 2.1 time: 0.184127 Aug 04 17:40:57.737377 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3202/6434] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:57 2022] GET /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea => generated 1647 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:57.756803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b70dff60-74ee-4833-bf28-bd53db172a9b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:57.757422 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b70dff60-74ee-4833-bf28-bd53db172a9b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: cafaf520-c9e3-4fb4-80fc-d17c5e7041ea] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:57.764010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b70dff60-74ee-4833-bf28-bd53db172a9b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:57.765013 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b70dff60-74ee-4833-bf28-bd53db172a9b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:57.765207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b70dff60-74ee-4833-bf28-bd53db172a9b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:57.765928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b70dff60-74ee-4833-bf28-bd53db172a9b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:57.766415 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b70dff60-74ee-4833-bf28-bd53db172a9b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:57.766852 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b70dff60-74ee-4833-bf28-bd53db172a9b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:57.946682 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b70dff60-74ee-4833-bf28-bd53db172a9b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea" status: 200 len: 1647 microversion: 2.1 time: 0.193209 Aug 04 17:40:57.959170 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3233/6435] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:57 2022] GET /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea => generated 1647 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:57.973510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-96afbc07-0b22-46bf-acda-3b396ea0f229 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:57.974494 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-96afbc07-0b22-46bf-acda-3b396ea0f229 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: cafaf520-c9e3-4fb4-80fc-d17c5e7041ea] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:57.974802 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b2d5e3be-26b3-464b-85b7-c04fea4db443 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:57.975952 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b2d5e3be-26b3-464b-85b7-c04fea4db443 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 133fadeb-1322-4818-bb88-41691932a451] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:57.983040 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-96afbc07-0b22-46bf-acda-3b396ea0f229 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:57.983927 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-96afbc07-0b22-46bf-acda-3b396ea0f229 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:57.984573 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-96afbc07-0b22-46bf-acda-3b396ea0f229 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:57.985510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-96afbc07-0b22-46bf-acda-3b396ea0f229 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:57.986205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-96afbc07-0b22-46bf-acda-3b396ea0f229 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:57.986923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-96afbc07-0b22-46bf-acda-3b396ea0f229 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:58.008731 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2d5e3be-26b3-464b-85b7-c04fea4db443 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:58.009636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2d5e3be-26b3-464b-85b7-c04fea4db443 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:58.010448 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2d5e3be-26b3-464b-85b7-c04fea4db443 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:58.012854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2d5e3be-26b3-464b-85b7-c04fea4db443 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:58.013711 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2d5e3be-26b3-464b-85b7-c04fea4db443 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:58.014537 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2d5e3be-26b3-464b-85b7-c04fea4db443 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:58.223304 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-96afbc07-0b22-46bf-acda-3b396ea0f229 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea" status: 200 len: 1647 microversion: 2.1 time: 0.253672 Aug 04 17:40:58.223991 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3234/6436] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:57 2022] GET /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea => generated 1647 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:40:58.316973 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b2d5e3be-26b3-464b-85b7-c04fea4db443 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:58.328485 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b2d5e3be-26b3-464b-85b7-c04fea4db443 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451" status: 200 len: 1215 microversion: 2.1 time: 0.365895 Aug 04 17:40:58.335966 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3203/6437] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:57 2022] GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451 => generated 1215 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:58.384701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b88e43a2-6600-41e6-8ad8-20838c89de76 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1376950882", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "availability_zone": "nova:n-h2-851359-3", "networks": [{"uuid": "f192c00a-f4e0-406f-99c3-486e21b39c73"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:40:58.453958 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-b88e43a2-6600-41e6-8ad8-20838c89de76 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] validate_networks() for [('f192c00a-f4e0-406f-99c3-486e21b39c73', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:40:58.903583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-b88e43a2-6600-41e6-8ad8-20838c89de76 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:40:58.904133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-b88e43a2-6600-41e6-8ad8-20838c89de76 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:40:58.904553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-b88e43a2-6600-41e6-8ad8-20838c89de76 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:40:58.905343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-b88e43a2-6600-41e6-8ad8-20838c89de76 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:40:58.906841 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-b88e43a2-6600-41e6-8ad8-20838c89de76 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:40:58.918745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b88e43a2-6600-41e6-8ad8-20838c89de76 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:58.919250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b88e43a2-6600-41e6-8ad8-20838c89de76 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:58.919694 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b88e43a2-6600-41e6-8ad8-20838c89de76 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:58.920449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b88e43a2-6600-41e6-8ad8-20838c89de76 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:58.920917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b88e43a2-6600-41e6-8ad8-20838c89de76 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:58.921392 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b88e43a2-6600-41e6-8ad8-20838c89de76 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:58.947888 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-b88e43a2-6600-41e6-8ad8-20838c89de76 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Getting quotas for project 0d85e1375a3449aba3bf5548d2f964e3. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:40:58.957810 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-b88e43a2-6600-41e6-8ad8-20838c89de76 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Getting quotas for user 26b0b5dea5be4e268d18e461923ef10f and project 0d85e1375a3449aba3bf5548d2f964e3. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:40:58.975966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b88e43a2-6600-41e6-8ad8-20838c89de76 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:40:58.979051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b88e43a2-6600-41e6-8ad8-20838c89de76 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: c1402ab0-1ebe-41f4-b305-bf0586a55b68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:40:59.050761 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b88e43a2-6600-41e6-8ad8-20838c89de76 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.669892 Aug 04 17:40:59.051455 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3235/6438] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:40:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:40:59.067052 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-975a0b9c-705f-408a-bef9-79bb9c940c43 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:59.068093 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-975a0b9c-705f-408a-bef9-79bb9c940c43 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: c1402ab0-1ebe-41f4-b305-bf0586a55b68] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:59.160291 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-975a0b9c-705f-408a-bef9-79bb9c940c43 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68" status: 200 len: 1329 microversion: 2.1 time: 0.101088 Aug 04 17:40:59.160894 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3204/6439] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:59 2022] GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68 => generated 1329 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:40:59.349012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-453ddc2c-7db8-4870-a64c-fc60f95a4bdb tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:40:59.349641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-453ddc2c-7db8-4870-a64c-fc60f95a4bdb tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 133fadeb-1322-4818-bb88-41691932a451] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:40:59.356333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-453ddc2c-7db8-4870-a64c-fc60f95a4bdb tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:59.356845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-453ddc2c-7db8-4870-a64c-fc60f95a4bdb tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:59.357394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-453ddc2c-7db8-4870-a64c-fc60f95a4bdb tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:59.358601 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-453ddc2c-7db8-4870-a64c-fc60f95a4bdb tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:40:59.359966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-453ddc2c-7db8-4870-a64c-fc60f95a4bdb tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:40:59.360672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-453ddc2c-7db8-4870-a64c-fc60f95a4bdb tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:40:59.529735 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-453ddc2c-7db8-4870-a64c-fc60f95a4bdb tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:40:59.538823 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-453ddc2c-7db8-4870-a64c-fc60f95a4bdb tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451" status: 200 len: 1215 microversion: 2.1 time: 0.193741 Aug 04 17:40:59.539418 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3236/6440] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:40:59 2022] GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451 => generated 1215 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:41:00.181005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ff6374dd-2f3d-4d51-a8d0-7aef535bced9 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:00.181625 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ff6374dd-2f3d-4d51-a8d0-7aef535bced9 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: c1402ab0-1ebe-41f4-b305-bf0586a55b68] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:00.189592 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff6374dd-2f3d-4d51-a8d0-7aef535bced9 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:00.190113 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff6374dd-2f3d-4d51-a8d0-7aef535bced9 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:00.190555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff6374dd-2f3d-4d51-a8d0-7aef535bced9 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:00.191250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff6374dd-2f3d-4d51-a8d0-7aef535bced9 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:00.191705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff6374dd-2f3d-4d51-a8d0-7aef535bced9 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:00.192127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff6374dd-2f3d-4d51-a8d0-7aef535bced9 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:00.262266 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ff6374dd-2f3d-4d51-a8d0-7aef535bced9 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68" status: 200 len: 1346 microversion: 2.1 time: 0.084949 Aug 04 17:41:00.262849 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3205/6441] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:00 2022] GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68 => generated 1346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:41:00.566022 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2fe011b7-24b3-4294-998f-d23072c4d5b1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:00.574031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2fe011b7-24b3-4294-998f-d23072c4d5b1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 133fadeb-1322-4818-bb88-41691932a451] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:00.578690 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2fe011b7-24b3-4294-998f-d23072c4d5b1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:00.580187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2fe011b7-24b3-4294-998f-d23072c4d5b1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:00.580687 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2fe011b7-24b3-4294-998f-d23072c4d5b1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:00.582177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2fe011b7-24b3-4294-998f-d23072c4d5b1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:00.583164 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2fe011b7-24b3-4294-998f-d23072c4d5b1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:00.584118 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2fe011b7-24b3-4294-998f-d23072c4d5b1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:00.734380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2fe011b7-24b3-4294-998f-d23072c4d5b1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:00.743747 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2fe011b7-24b3-4294-998f-d23072c4d5b1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451" status: 200 len: 1203 microversion: 2.1 time: 0.185571 Aug 04 17:41:00.758299 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3237/6442] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:00 2022] GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451 => generated 1203 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:01.285011 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-06b7a2b1-ce9b-471a-8777-b278b8b1eea2 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:01.286079 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-06b7a2b1-ce9b-471a-8777-b278b8b1eea2 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: c1402ab0-1ebe-41f4-b305-bf0586a55b68] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:01.294626 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06b7a2b1-ce9b-471a-8777-b278b8b1eea2 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:01.295687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06b7a2b1-ce9b-471a-8777-b278b8b1eea2 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:01.296327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06b7a2b1-ce9b-471a-8777-b278b8b1eea2 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:01.297926 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06b7a2b1-ce9b-471a-8777-b278b8b1eea2 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:01.298707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06b7a2b1-ce9b-471a-8777-b278b8b1eea2 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:01.299311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06b7a2b1-ce9b-471a-8777-b278b8b1eea2 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:01.387005 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-06b7a2b1-ce9b-471a-8777-b278b8b1eea2 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68" status: 200 len: 1434 microversion: 2.1 time: 0.106698 Aug 04 17:41:01.388503 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3206/6443] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:01 2022] GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68 => generated 1434 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:01.771871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-82198644-0095-4e1f-b4cc-587d0cd9a6ff tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:01.773267 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-82198644-0095-4e1f-b4cc-587d0cd9a6ff tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 133fadeb-1322-4818-bb88-41691932a451] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:01.783346 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82198644-0095-4e1f-b4cc-587d0cd9a6ff tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:01.784094 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82198644-0095-4e1f-b4cc-587d0cd9a6ff tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:01.784896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82198644-0095-4e1f-b4cc-587d0cd9a6ff tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:01.785806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82198644-0095-4e1f-b4cc-587d0cd9a6ff tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:01.786475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82198644-0095-4e1f-b4cc-587d0cd9a6ff tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:01.787282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82198644-0095-4e1f-b4cc-587d0cd9a6ff tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:01.967149 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-82198644-0095-4e1f-b4cc-587d0cd9a6ff tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:01.978011 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-82198644-0095-4e1f-b4cc-587d0cd9a6ff tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451" status: 200 len: 1203 microversion: 2.1 time: 0.216635 Aug 04 17:41:01.991024 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3238/6444] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:01 2022] GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451 => generated 1203 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:02.409388 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6a18ec88-3236-4736-a5a7-28d521eb0c37 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:02.410859 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6a18ec88-3236-4736-a5a7-28d521eb0c37 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: c1402ab0-1ebe-41f4-b305-bf0586a55b68] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:02.416862 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:41:02.422101 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a18ec88-3236-4736-a5a7-28d521eb0c37 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:02.423180 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a18ec88-3236-4736-a5a7-28d521eb0c37 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:02.423910 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a18ec88-3236-4736-a5a7-28d521eb0c37 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:02.426253 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a18ec88-3236-4736-a5a7-28d521eb0c37 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:02.427469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a18ec88-3236-4736-a5a7-28d521eb0c37 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:02.428869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a18ec88-3236-4736-a5a7-28d521eb0c37 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:02.545460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-3d471e05-78c2-4f73-b4d2-dece3ab7504c req-fb0c86b3-823a-444d-899c-61f99889fa05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1402ab0-1ebe-41f4-b305-bf0586a55b68", "tag": "7bc87193-3dff-406a-a8ff-9901bfcd9d06"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:41:02.572166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-3d471e05-78c2-4f73-b4d2-dece3ab7504c req-fb0c86b3-823a-444d-899c-61f99889fa05 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:02.573156 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-3d471e05-78c2-4f73-b4d2-dece3ab7504c req-fb0c86b3-823a-444d-899c-61f99889fa05 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:02.573797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-3d471e05-78c2-4f73-b4d2-dece3ab7504c req-fb0c86b3-823a-444d-899c-61f99889fa05 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:02.606506 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-3d471e05-78c2-4f73-b4d2-dece3ab7504c req-fb0c86b3-823a-444d-899c-61f99889fa05 service nova] Creating event network-changed:7bc87193-3dff-406a-a8ff-9901bfcd9d06 for instance c1402ab0-1ebe-41f4-b305-bf0586a55b68 on n-h2-851359-3 Aug 04 17:41:02.636259 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-3d471e05-78c2-4f73-b4d2-dece3ab7504c req-fb0c86b3-823a-444d-899c-61f99889fa05 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100593 Aug 04 17:41:02.637000 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3239/6445] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:41:02.694513 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6a18ec88-3236-4736-a5a7-28d521eb0c37 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68" status: 200 len: 1464 microversion: 2.1 time: 0.289112 Aug 04 17:41:02.706729 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3207/6446] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:02 2022] GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68 => generated 1464 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:03.001891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-403c0303-5b3a-4766-87c7-46321b9444c3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:03.002660 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-403c0303-5b3a-4766-87c7-46321b9444c3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 133fadeb-1322-4818-bb88-41691932a451] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:03.011976 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-403c0303-5b3a-4766-87c7-46321b9444c3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:03.013629 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-403c0303-5b3a-4766-87c7-46321b9444c3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:03.014422 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-403c0303-5b3a-4766-87c7-46321b9444c3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:03.016089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-403c0303-5b3a-4766-87c7-46321b9444c3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:03.017922 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-403c0303-5b3a-4766-87c7-46321b9444c3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:03.018783 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-403c0303-5b3a-4766-87c7-46321b9444c3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:03.073637 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:41:03.073917 n-d-851359-3 devstack@n-api.service[131044]: Thu Aug 4 17:41:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 17:41:03.213128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-403c0303-5b3a-4766-87c7-46321b9444c3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:03.223161 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-403c0303-5b3a-4766-87c7-46321b9444c3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451" status: 200 len: 1203 microversion: 2.1 time: 0.225800 Aug 04 17:41:03.223768 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3240/6447] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:02 2022] GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451 => generated 1203 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:03.716754 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-841f0296-9974-4681-a3fd-751437492418 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:03.717370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-841f0296-9974-4681-a3fd-751437492418 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: c1402ab0-1ebe-41f4-b305-bf0586a55b68] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:03.724229 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-841f0296-9974-4681-a3fd-751437492418 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:03.724717 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-841f0296-9974-4681-a3fd-751437492418 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:03.725154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-841f0296-9974-4681-a3fd-751437492418 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:03.725997 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-841f0296-9974-4681-a3fd-751437492418 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:03.726408 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-841f0296-9974-4681-a3fd-751437492418 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:03.726908 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-841f0296-9974-4681-a3fd-751437492418 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:03.852012 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-841f0296-9974-4681-a3fd-751437492418 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68" status: 200 len: 1464 microversion: 2.1 time: 0.138917 Aug 04 17:41:03.852582 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3208/6448] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:03 2022] GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68 => generated 1464 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:04.244604 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bcf4854c-6330-438c-a4cb-fd1876945ad5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:04.245135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bcf4854c-6330-438c-a4cb-fd1876945ad5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 133fadeb-1322-4818-bb88-41691932a451] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:04.252827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bcf4854c-6330-438c-a4cb-fd1876945ad5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:04.253337 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bcf4854c-6330-438c-a4cb-fd1876945ad5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:04.253797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bcf4854c-6330-438c-a4cb-fd1876945ad5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:04.254620 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bcf4854c-6330-438c-a4cb-fd1876945ad5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:04.255098 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bcf4854c-6330-438c-a4cb-fd1876945ad5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:04.255536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bcf4854c-6330-438c-a4cb-fd1876945ad5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:04.387888 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bcf4854c-6330-438c-a4cb-fd1876945ad5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:04.390240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=100 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:41:04.396844 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bcf4854c-6330-438c-a4cb-fd1876945ad5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451" status: 200 len: 1203 microversion: 2.1 time: 0.156254 Aug 04 17:41:04.397424 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3241/6449] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:04 2022] GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:04.872802 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-21814f35-a57c-47b1-9728-cc67b0cf5842 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:04.873361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-21814f35-a57c-47b1-9728-cc67b0cf5842 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: c1402ab0-1ebe-41f4-b305-bf0586a55b68] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:04.880265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21814f35-a57c-47b1-9728-cc67b0cf5842 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:04.880759 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21814f35-a57c-47b1-9728-cc67b0cf5842 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:04.881203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21814f35-a57c-47b1-9728-cc67b0cf5842 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:04.881905 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21814f35-a57c-47b1-9728-cc67b0cf5842 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:04.882401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21814f35-a57c-47b1-9728-cc67b0cf5842 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:04.882836 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21814f35-a57c-47b1-9728-cc67b0cf5842 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:05.014920 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-21814f35-a57c-47b1-9728-cc67b0cf5842 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68" status: 200 len: 1464 microversion: 2.1 time: 0.146013 Aug 04 17:41:05.015494 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3209/6450] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:04 2022] GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68 => generated 1464 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:05.418873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0b80d692-d448-444c-bd43-1d976fecfc07 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:05.419506 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0b80d692-d448-444c-bd43-1d976fecfc07 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 133fadeb-1322-4818-bb88-41691932a451] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:05.426651 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b80d692-d448-444c-bd43-1d976fecfc07 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:05.427208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b80d692-d448-444c-bd43-1d976fecfc07 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:05.427606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b80d692-d448-444c-bd43-1d976fecfc07 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:05.428332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b80d692-d448-444c-bd43-1d976fecfc07 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:05.428801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b80d692-d448-444c-bd43-1d976fecfc07 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:05.429239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b80d692-d448-444c-bd43-1d976fecfc07 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:05.570865 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0b80d692-d448-444c-bd43-1d976fecfc07 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:05.579931 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0b80d692-d448-444c-bd43-1d976fecfc07 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451" status: 200 len: 1203 microversion: 2.1 time: 0.165166 Aug 04 17:41:05.580537 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3242/6451] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:05 2022] GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451 => generated 1203 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:41:06.035603 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f87fd2d6-0acb-4d39-8c29-ad1914288325 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:06.036141 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f87fd2d6-0acb-4d39-8c29-ad1914288325 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: c1402ab0-1ebe-41f4-b305-bf0586a55b68] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:06.038863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:41:06.044234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f87fd2d6-0acb-4d39-8c29-ad1914288325 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:06.044721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f87fd2d6-0acb-4d39-8c29-ad1914288325 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:06.045158 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f87fd2d6-0acb-4d39-8c29-ad1914288325 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:06.045852 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f87fd2d6-0acb-4d39-8c29-ad1914288325 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:06.046339 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f87fd2d6-0acb-4d39-8c29-ad1914288325 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:06.046768 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f87fd2d6-0acb-4d39-8c29-ad1914288325 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:06.050291 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=90 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:41:06.186663 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f87fd2d6-0acb-4d39-8c29-ad1914288325 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68" status: 200 len: 1464 microversion: 2.1 time: 0.154859 Aug 04 17:41:06.187266 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3210/6452] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:06 2022] GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68 => generated 1464 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:06.603079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-052e12be-cdbe-43a5-bd26-a3ea7d6204fd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:06.603776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-052e12be-cdbe-43a5-bd26-a3ea7d6204fd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 133fadeb-1322-4818-bb88-41691932a451] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:06.611804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-052e12be-cdbe-43a5-bd26-a3ea7d6204fd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:06.612304 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-052e12be-cdbe-43a5-bd26-a3ea7d6204fd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:06.612745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-052e12be-cdbe-43a5-bd26-a3ea7d6204fd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:06.613461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-052e12be-cdbe-43a5-bd26-a3ea7d6204fd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:06.613916 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-052e12be-cdbe-43a5-bd26-a3ea7d6204fd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:06.614370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-052e12be-cdbe-43a5-bd26-a3ea7d6204fd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:06.769189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-052e12be-cdbe-43a5-bd26-a3ea7d6204fd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:06.779163 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-052e12be-cdbe-43a5-bd26-a3ea7d6204fd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451" status: 200 len: 1203 microversion: 2.1 time: 0.181737 Aug 04 17:41:06.780073 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3243/6453] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:06 2022] GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451 => generated 1203 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:07.212461 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a9015044-f4a2-434d-b29f-23a0b4f4dc51 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:07.213075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a9015044-f4a2-434d-b29f-23a0b4f4dc51 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: c1402ab0-1ebe-41f4-b305-bf0586a55b68] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:07.219924 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9015044-f4a2-434d-b29f-23a0b4f4dc51 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:07.220405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9015044-f4a2-434d-b29f-23a0b4f4dc51 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:07.220846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9015044-f4a2-434d-b29f-23a0b4f4dc51 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:07.221542 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9015044-f4a2-434d-b29f-23a0b4f4dc51 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:07.222025 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9015044-f4a2-434d-b29f-23a0b4f4dc51 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:07.222453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9015044-f4a2-434d-b29f-23a0b4f4dc51 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:07.365227 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a9015044-f4a2-434d-b29f-23a0b4f4dc51 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68" status: 200 len: 1464 microversion: 2.1 time: 0.156444 Aug 04 17:41:07.365824 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3211/6454] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:07 2022] GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68 => generated 1464 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:07.801074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9091a518-9a44-4bc8-9fb0-a80ab25d7819 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:07.801623 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9091a518-9a44-4bc8-9fb0-a80ab25d7819 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 133fadeb-1322-4818-bb88-41691932a451] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:07.809212 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9091a518-9a44-4bc8-9fb0-a80ab25d7819 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:07.809874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9091a518-9a44-4bc8-9fb0-a80ab25d7819 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:07.810352 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9091a518-9a44-4bc8-9fb0-a80ab25d7819 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:07.811080 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9091a518-9a44-4bc8-9fb0-a80ab25d7819 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:07.811552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9091a518-9a44-4bc8-9fb0-a80ab25d7819 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:07.812399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9091a518-9a44-4bc8-9fb0-a80ab25d7819 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:07.946663 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9091a518-9a44-4bc8-9fb0-a80ab25d7819 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:07.955434 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9091a518-9a44-4bc8-9fb0-a80ab25d7819 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451" status: 200 len: 1203 microversion: 2.1 time: 0.158282 Aug 04 17:41:07.956055 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3244/6455] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:07 2022] GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451 => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:08.385398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b7b570b1-83df-4ba5-a6fc-7991ba3b7a2a tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:08.386574 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b7b570b1-83df-4ba5-a6fc-7991ba3b7a2a tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: c1402ab0-1ebe-41f4-b305-bf0586a55b68] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:08.393508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7b570b1-83df-4ba5-a6fc-7991ba3b7a2a tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:08.394029 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7b570b1-83df-4ba5-a6fc-7991ba3b7a2a tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:08.394484 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7b570b1-83df-4ba5-a6fc-7991ba3b7a2a tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:08.395186 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7b570b1-83df-4ba5-a6fc-7991ba3b7a2a tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:08.395652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7b570b1-83df-4ba5-a6fc-7991ba3b7a2a tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:08.396085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7b570b1-83df-4ba5-a6fc-7991ba3b7a2a tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:08.535708 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b7b570b1-83df-4ba5-a6fc-7991ba3b7a2a tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68" status: 200 len: 1464 microversion: 2.1 time: 0.153970 Aug 04 17:41:08.536287 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3212/6456] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:08 2022] GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68 => generated 1464 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:08.977449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2998e802-e2c2-4119-8997-525d2d3dd955 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:08.978229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2998e802-e2c2-4119-8997-525d2d3dd955 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 133fadeb-1322-4818-bb88-41691932a451] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:08.980905 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:41:08.981784 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=10 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:41:08.989413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2998e802-e2c2-4119-8997-525d2d3dd955 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:08.989883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2998e802-e2c2-4119-8997-525d2d3dd955 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:08.990366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2998e802-e2c2-4119-8997-525d2d3dd955 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:08.991125 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2998e802-e2c2-4119-8997-525d2d3dd955 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:08.991771 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2998e802-e2c2-4119-8997-525d2d3dd955 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:08.992218 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2998e802-e2c2-4119-8997-525d2d3dd955 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:09.129572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2998e802-e2c2-4119-8997-525d2d3dd955 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:09.139788 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2998e802-e2c2-4119-8997-525d2d3dd955 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451" status: 200 len: 1203 microversion: 2.1 time: 0.166098 Aug 04 17:41:09.154314 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3245/6457] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:08 2022] GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451 => generated 1203 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:09.163910 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-901cd78d-3bc8-4671-80b6-6f3fd9f92c51 req-6fbffd68-d332-4a2d-a52d-3cc287ea67e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "133fadeb-1322-4818-bb88-41691932a451", "name": "network-vif-plugged", "status": "completed", "tag": "dd3d54d4-14c4-4fcc-95fb-d4c0458975f4"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:41:09.169924 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=14 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:41:09.176978 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-901cd78d-3bc8-4671-80b6-6f3fd9f92c51 req-6fbffd68-d332-4a2d-a52d-3cc287ea67e6 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:09.177670 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-901cd78d-3bc8-4671-80b6-6f3fd9f92c51 req-6fbffd68-d332-4a2d-a52d-3cc287ea67e6 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:09.178145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-901cd78d-3bc8-4671-80b6-6f3fd9f92c51 req-6fbffd68-d332-4a2d-a52d-3cc287ea67e6 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:09.191189 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-901cd78d-3bc8-4671-80b6-6f3fd9f92c51 req-6fbffd68-d332-4a2d-a52d-3cc287ea67e6 service nova] Creating event network-vif-plugged:dd3d54d4-14c4-4fcc-95fb-d4c0458975f4 for instance 133fadeb-1322-4818-bb88-41691932a451 on n-h2-851359-3 Aug 04 17:41:09.196530 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-901cd78d-3bc8-4671-80b6-6f3fd9f92c51 req-6fbffd68-d332-4a2d-a52d-3cc287ea67e6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040896 Aug 04 17:41:09.197727 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3213/6458] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:41:09.556659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-22f827a8-2e1b-415c-9c1d-b020f14c5357 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:09.557276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-22f827a8-2e1b-415c-9c1d-b020f14c5357 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: c1402ab0-1ebe-41f4-b305-bf0586a55b68] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:09.559193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:41:09.564653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-22f827a8-2e1b-415c-9c1d-b020f14c5357 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:09.565145 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-22f827a8-2e1b-415c-9c1d-b020f14c5357 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:09.565585 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-22f827a8-2e1b-415c-9c1d-b020f14c5357 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:09.566392 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-22f827a8-2e1b-415c-9c1d-b020f14c5357 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:09.566880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-22f827a8-2e1b-415c-9c1d-b020f14c5357 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:09.567311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-22f827a8-2e1b-415c-9c1d-b020f14c5357 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:09.698271 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-22f827a8-2e1b-415c-9c1d-b020f14c5357 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68" status: 200 len: 1464 microversion: 2.1 time: 0.145307 Aug 04 17:41:09.698852 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3246/6459] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:09 2022] GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68 => generated 1464 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:10.162855 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-efe9500e-c13c-4126-9088-f7a7f3e9b603 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:10.163518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-efe9500e-c13c-4126-9088-f7a7f3e9b603 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 133fadeb-1322-4818-bb88-41691932a451] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:10.169743 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-efe9500e-c13c-4126-9088-f7a7f3e9b603 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:10.170269 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-efe9500e-c13c-4126-9088-f7a7f3e9b603 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:10.170715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-efe9500e-c13c-4126-9088-f7a7f3e9b603 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:10.171415 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-efe9500e-c13c-4126-9088-f7a7f3e9b603 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:10.171884 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-efe9500e-c13c-4126-9088-f7a7f3e9b603 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:10.172321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-efe9500e-c13c-4126-9088-f7a7f3e9b603 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:10.638633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-efe9500e-c13c-4126-9088-f7a7f3e9b603 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:10.647847 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-efe9500e-c13c-4126-9088-f7a7f3e9b603 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451" status: 200 len: 1203 microversion: 2.1 time: 0.490291 Aug 04 17:41:10.649792 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3214/6460] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:10 2022] GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451 => generated 1203 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:10.719134 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c703e199-eb94-4743-b2c2-249894e03ea2 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:10.719786 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c703e199-eb94-4743-b2c2-249894e03ea2 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: c1402ab0-1ebe-41f4-b305-bf0586a55b68] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:10.727006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c703e199-eb94-4743-b2c2-249894e03ea2 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:10.727505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c703e199-eb94-4743-b2c2-249894e03ea2 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:10.728044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c703e199-eb94-4743-b2c2-249894e03ea2 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:10.728672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c703e199-eb94-4743-b2c2-249894e03ea2 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:10.729142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c703e199-eb94-4743-b2c2-249894e03ea2 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:10.729579 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c703e199-eb94-4743-b2c2-249894e03ea2 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:10.863312 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c703e199-eb94-4743-b2c2-249894e03ea2 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68" status: 200 len: 1464 microversion: 2.1 time: 0.147910 Aug 04 17:41:10.864107 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3247/6461] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:10 2022] GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68 => generated 1464 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:11.227440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0bf2b443-8db6-4412-a909-9dad636aacd4 req-279c5aa9-62fa-42e7-921d-93143a46b10d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1402ab0-1ebe-41f4-b305-bf0586a55b68", "name": "network-vif-plugged", "status": "completed", "tag": "7bc87193-3dff-406a-a8ff-9901bfcd9d06"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:41:11.238811 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0bf2b443-8db6-4412-a909-9dad636aacd4 req-279c5aa9-62fa-42e7-921d-93143a46b10d service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:11.239293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0bf2b443-8db6-4412-a909-9dad636aacd4 req-279c5aa9-62fa-42e7-921d-93143a46b10d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:11.239723 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0bf2b443-8db6-4412-a909-9dad636aacd4 req-279c5aa9-62fa-42e7-921d-93143a46b10d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:11.250563 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0bf2b443-8db6-4412-a909-9dad636aacd4 req-279c5aa9-62fa-42e7-921d-93143a46b10d service nova] Creating event network-vif-plugged:7bc87193-3dff-406a-a8ff-9901bfcd9d06 for instance c1402ab0-1ebe-41f4-b305-bf0586a55b68 on n-h2-851359-3 Aug 04 17:41:11.255533 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0bf2b443-8db6-4412-a909-9dad636aacd4 req-279c5aa9-62fa-42e7-921d-93143a46b10d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031880 Aug 04 17:41:11.256127 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3215/6462] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:41:11.673487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c6bfcfcc-d69a-4320-a189-4f929e45ead1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:11.674145 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c6bfcfcc-d69a-4320-a189-4f929e45ead1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 133fadeb-1322-4818-bb88-41691932a451] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:11.680184 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6bfcfcc-d69a-4320-a189-4f929e45ead1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:11.680709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6bfcfcc-d69a-4320-a189-4f929e45ead1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:11.681159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6bfcfcc-d69a-4320-a189-4f929e45ead1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:11.681873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6bfcfcc-d69a-4320-a189-4f929e45ead1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:11.682369 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6bfcfcc-d69a-4320-a189-4f929e45ead1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:11.682841 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6bfcfcc-d69a-4320-a189-4f929e45ead1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:11.814071 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c6bfcfcc-d69a-4320-a189-4f929e45ead1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:11.822054 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c6bfcfcc-d69a-4320-a189-4f929e45ead1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451" status: 200 len: 1390 microversion: 2.1 time: 0.152327 Aug 04 17:41:11.822655 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3248/6463] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:11 2022] GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451 => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:11.843485 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1cebd391-6371-489a-b15b-606eb3b895c8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:11.844192 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1cebd391-6371-489a-b15b-606eb3b895c8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 133fadeb-1322-4818-bb88-41691932a451] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:11.850437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cebd391-6371-489a-b15b-606eb3b895c8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:11.850958 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cebd391-6371-489a-b15b-606eb3b895c8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:11.851419 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cebd391-6371-489a-b15b-606eb3b895c8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:11.852187 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cebd391-6371-489a-b15b-606eb3b895c8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:11.852587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cebd391-6371-489a-b15b-606eb3b895c8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:11.853106 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cebd391-6371-489a-b15b-606eb3b895c8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:11.885861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-67648545-ea55-4aa0-8e3a-bb67ed601df7 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:11.886528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-67648545-ea55-4aa0-8e3a-bb67ed601df7 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: c1402ab0-1ebe-41f4-b305-bf0586a55b68] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:11.893220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-67648545-ea55-4aa0-8e3a-bb67ed601df7 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:11.893724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-67648545-ea55-4aa0-8e3a-bb67ed601df7 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:11.894207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-67648545-ea55-4aa0-8e3a-bb67ed601df7 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:11.895025 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-67648545-ea55-4aa0-8e3a-bb67ed601df7 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:11.895392 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-67648545-ea55-4aa0-8e3a-bb67ed601df7 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:11.895830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-67648545-ea55-4aa0-8e3a-bb67ed601df7 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:12.034657 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1cebd391-6371-489a-b15b-606eb3b895c8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:12.042451 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1cebd391-6371-489a-b15b-606eb3b895c8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451" status: 200 len: 1390 microversion: 2.1 time: 0.203174 Aug 04 17:41:12.043029 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3216/6464] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:11 2022] GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451 => generated 1390 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:12.063048 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-92829335-6a5c-43f9-8750-d0dab903f643 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:12.063684 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-92829335-6a5c-43f9-8750-d0dab903f643 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 133fadeb-1322-4818-bb88-41691932a451] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:12.069549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-92829335-6a5c-43f9-8750-d0dab903f643 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:12.070060 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-67648545-ea55-4aa0-8e3a-bb67ed601df7 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68" status: 200 len: 1464 microversion: 2.1 time: 0.188039 Aug 04 17:41:12.070213 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-92829335-6a5c-43f9-8750-d0dab903f643 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:12.070534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-92829335-6a5c-43f9-8750-d0dab903f643 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:12.070785 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3249/6465] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:11 2022] GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68 => generated 1464 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:12.079650 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-92829335-6a5c-43f9-8750-d0dab903f643 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:12.079650 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-92829335-6a5c-43f9-8750-d0dab903f643 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:12.079650 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-92829335-6a5c-43f9-8750-d0dab903f643 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:12.202947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-92829335-6a5c-43f9-8750-d0dab903f643 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:12.211107 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-92829335-6a5c-43f9-8750-d0dab903f643 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451" status: 200 len: 1390 microversion: 2.1 time: 0.152456 Aug 04 17:41:12.211688 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3217/6466] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:12 2022] GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451 => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:41:12.232152 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fa7632c7-94d4-4bdb-87af-4eada3ed84f9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:12.232662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fa7632c7-94d4-4bdb-87af-4eada3ed84f9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 133fadeb-1322-4818-bb88-41691932a451] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:12.239330 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fa7632c7-94d4-4bdb-87af-4eada3ed84f9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:12.239823 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fa7632c7-94d4-4bdb-87af-4eada3ed84f9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:12.240271 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fa7632c7-94d4-4bdb-87af-4eada3ed84f9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:12.240969 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fa7632c7-94d4-4bdb-87af-4eada3ed84f9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:12.241435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fa7632c7-94d4-4bdb-87af-4eada3ed84f9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:12.241915 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fa7632c7-94d4-4bdb-87af-4eada3ed84f9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:12.266504 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fa7632c7-94d4-4bdb-87af-4eada3ed84f9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 133fadeb-1322-4818-bb88-41691932a451] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:41:12.345441 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fa7632c7-94d4-4bdb-87af-4eada3ed84f9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "DELETE /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451" status: 204 len: 0 microversion: 2.1 time: 0.117502 Aug 04 17:41:12.346165 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3250/6467] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:41:12 2022] DELETE /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:41:12.354467 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c039144d-9b73-4c7e-9e07-9eea4f29f94e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:12.355084 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c039144d-9b73-4c7e-9e07-9eea4f29f94e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 133fadeb-1322-4818-bb88-41691932a451] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:12.362283 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c039144d-9b73-4c7e-9e07-9eea4f29f94e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:12.362771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c039144d-9b73-4c7e-9e07-9eea4f29f94e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:12.363207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c039144d-9b73-4c7e-9e07-9eea4f29f94e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:12.363895 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c039144d-9b73-4c7e-9e07-9eea4f29f94e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:12.364350 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c039144d-9b73-4c7e-9e07-9eea4f29f94e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:12.364776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c039144d-9b73-4c7e-9e07-9eea4f29f94e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:12.495621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c039144d-9b73-4c7e-9e07-9eea4f29f94e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:12.504006 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c039144d-9b73-4c7e-9e07-9eea4f29f94e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451" status: 200 len: 1396 microversion: 2.1 time: 0.153583 Aug 04 17:41:12.504580 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3218/6468] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:12 2022] GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451 => generated 1396 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:41:13.092469 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2f34ecf0-ead1-4912-9492-f29704a258c4 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:13.093896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2f34ecf0-ead1-4912-9492-f29704a258c4 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: c1402ab0-1ebe-41f4-b305-bf0586a55b68] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:13.100828 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f34ecf0-ead1-4912-9492-f29704a258c4 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:13.101326 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f34ecf0-ead1-4912-9492-f29704a258c4 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:13.101778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f34ecf0-ead1-4912-9492-f29704a258c4 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:13.102509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f34ecf0-ead1-4912-9492-f29704a258c4 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:13.102978 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f34ecf0-ead1-4912-9492-f29704a258c4 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:13.103418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f34ecf0-ead1-4912-9492-f29704a258c4 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:13.233484 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2f34ecf0-ead1-4912-9492-f29704a258c4 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68" status: 200 len: 1464 microversion: 2.1 time: 0.145081 Aug 04 17:41:13.234093 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3251/6469] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:13 2022] GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68 => generated 1464 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:13.525686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-59753b3b-fdc6-44a2-890d-ef7621cd9e6e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:13.526350 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-59753b3b-fdc6-44a2-890d-ef7621cd9e6e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 133fadeb-1322-4818-bb88-41691932a451] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:13.532509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59753b3b-fdc6-44a2-890d-ef7621cd9e6e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:13.532997 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59753b3b-fdc6-44a2-890d-ef7621cd9e6e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:13.533474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59753b3b-fdc6-44a2-890d-ef7621cd9e6e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:13.534200 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59753b3b-fdc6-44a2-890d-ef7621cd9e6e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:13.534672 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59753b3b-fdc6-44a2-890d-ef7621cd9e6e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:13.535542 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59753b3b-fdc6-44a2-890d-ef7621cd9e6e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:13.676123 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-59753b3b-fdc6-44a2-890d-ef7621cd9e6e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:13.684798 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-59753b3b-fdc6-44a2-890d-ef7621cd9e6e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451" status: 200 len: 1396 microversion: 2.1 time: 0.163860 Aug 04 17:41:13.685430 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3219/6470] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:13 2022] GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451 => generated 1396 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:14.254151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-10b46ad7-b9b8-45d4-8340-7f66b610bf5b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:14.254805 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-10b46ad7-b9b8-45d4-8340-7f66b610bf5b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: c1402ab0-1ebe-41f4-b305-bf0586a55b68] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:14.261808 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-10b46ad7-b9b8-45d4-8340-7f66b610bf5b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:14.262339 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-10b46ad7-b9b8-45d4-8340-7f66b610bf5b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:14.262788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-10b46ad7-b9b8-45d4-8340-7f66b610bf5b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:14.263484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-10b46ad7-b9b8-45d4-8340-7f66b610bf5b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:14.263942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-10b46ad7-b9b8-45d4-8340-7f66b610bf5b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:14.264370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-10b46ad7-b9b8-45d4-8340-7f66b610bf5b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:14.405379 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-10b46ad7-b9b8-45d4-8340-7f66b610bf5b tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68" status: 200 len: 1649 microversion: 2.1 time: 0.154935 Aug 04 17:41:14.406594 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3252/6471] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:14 2022] GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68 => generated 1649 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:41:14.426702 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8fb63777-3114-4436-9ebc-3f7b5f03c7da tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:14.427306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8fb63777-3114-4436-9ebc-3f7b5f03c7da tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: c1402ab0-1ebe-41f4-b305-bf0586a55b68] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:14.433722 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fb63777-3114-4436-9ebc-3f7b5f03c7da tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:14.434510 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fb63777-3114-4436-9ebc-3f7b5f03c7da tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:14.435012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fb63777-3114-4436-9ebc-3f7b5f03c7da tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:14.435797 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fb63777-3114-4436-9ebc-3f7b5f03c7da tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:14.436466 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fb63777-3114-4436-9ebc-3f7b5f03c7da tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:14.436906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fb63777-3114-4436-9ebc-3f7b5f03c7da tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:14.572418 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8fb63777-3114-4436-9ebc-3f7b5f03c7da tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68" status: 200 len: 1649 microversion: 2.1 time: 0.149456 Aug 04 17:41:14.582282 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3220/6472] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:14 2022] GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68 => generated 1649 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:14.597682 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fd315fd0-5785-470b-b935-e8a107714818 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:14.598357 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fd315fd0-5785-470b-b935-e8a107714818 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: c1402ab0-1ebe-41f4-b305-bf0586a55b68] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:14.606697 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd315fd0-5785-470b-b935-e8a107714818 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:14.607194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd315fd0-5785-470b-b935-e8a107714818 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:14.607643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd315fd0-5785-470b-b935-e8a107714818 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:14.608353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd315fd0-5785-470b-b935-e8a107714818 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:14.608851 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd315fd0-5785-470b-b935-e8a107714818 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:14.609277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd315fd0-5785-470b-b935-e8a107714818 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:14.707795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-984c3d7d-6e64-4f5d-9792-bbd51992a479 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:14.708428 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-984c3d7d-6e64-4f5d-9792-bbd51992a479 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 133fadeb-1322-4818-bb88-41691932a451] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:14.714954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-984c3d7d-6e64-4f5d-9792-bbd51992a479 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:14.715456 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-984c3d7d-6e64-4f5d-9792-bbd51992a479 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:14.715904 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-984c3d7d-6e64-4f5d-9792-bbd51992a479 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:14.716615 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-984c3d7d-6e64-4f5d-9792-bbd51992a479 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:14.717078 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-984c3d7d-6e64-4f5d-9792-bbd51992a479 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:14.717800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-984c3d7d-6e64-4f5d-9792-bbd51992a479 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:14.815835 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fd315fd0-5785-470b-b935-e8a107714818 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68" status: 200 len: 1649 microversion: 2.1 time: 0.222297 Aug 04 17:41:14.816769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-984c3d7d-6e64-4f5d-9792-bbd51992a479 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:14.817245 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3253/6473] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:14 2022] GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68 => generated 1649 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:14.828397 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-984c3d7d-6e64-4f5d-9792-bbd51992a479 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451" status: 200 len: 1354 microversion: 2.1 time: 0.124660 Aug 04 17:41:14.830914 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3221/6474] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:14 2022] GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451 => generated 1354 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:41:14.846682 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-01e8525a-e156-417c-a613-5ee0820bf6cf tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:14.847209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-01e8525a-e156-417c-a613-5ee0820bf6cf tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: c1402ab0-1ebe-41f4-b305-bf0586a55b68] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:14.854437 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01e8525a-e156-417c-a613-5ee0820bf6cf tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:14.854942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01e8525a-e156-417c-a613-5ee0820bf6cf tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:14.855435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01e8525a-e156-417c-a613-5ee0820bf6cf tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:14.856498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01e8525a-e156-417c-a613-5ee0820bf6cf tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:14.857098 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01e8525a-e156-417c-a613-5ee0820bf6cf tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:14.858368 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01e8525a-e156-417c-a613-5ee0820bf6cf tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:14.863701 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-e4a1e889-054f-41e6-9569-cdd7aec5ecf1 req-dd648115-cad2-4172-b593-de669a35ef8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "133fadeb-1322-4818-bb88-41691932a451", "name": "network-vif-deleted", "tag": "dd3d54d4-14c4-4fcc-95fb-d4c0458975f4"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:41:14.876157 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e4a1e889-054f-41e6-9569-cdd7aec5ecf1 req-dd648115-cad2-4172-b593-de669a35ef8e service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:14.876648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e4a1e889-054f-41e6-9569-cdd7aec5ecf1 req-dd648115-cad2-4172-b593-de669a35ef8e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:14.877091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e4a1e889-054f-41e6-9569-cdd7aec5ecf1 req-dd648115-cad2-4172-b593-de669a35ef8e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:14.891674 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-e4a1e889-054f-41e6-9569-cdd7aec5ecf1 req-dd648115-cad2-4172-b593-de669a35ef8e service nova] Creating event network-vif-deleted:dd3d54d4-14c4-4fcc-95fb-d4c0458975f4 for instance 133fadeb-1322-4818-bb88-41691932a451 on n-h2-851359-3 Aug 04 17:41:14.897665 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-e4a1e889-054f-41e6-9569-cdd7aec5ecf1 req-dd648115-cad2-4172-b593-de669a35ef8e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037408 Aug 04 17:41:14.898741 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3222/6475] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:41:14.908343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-01e8525a-e156-417c-a613-5ee0820bf6cf tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: c1402ab0-1ebe-41f4-b305-bf0586a55b68] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:41:15.017782 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-01e8525a-e156-417c-a613-5ee0820bf6cf tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "DELETE /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68" status: 204 len: 0 microversion: 2.1 time: 0.175433 Aug 04 17:41:15.019083 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3254/6476] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:41:14 2022] DELETE /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:41:15.030525 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-99b5dabe-af36-48d8-bb92-f0a40e0a2b54 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:15.031536 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-99b5dabe-af36-48d8-bb92-f0a40e0a2b54 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: c1402ab0-1ebe-41f4-b305-bf0586a55b68] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:15.040025 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99b5dabe-af36-48d8-bb92-f0a40e0a2b54 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:15.040826 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99b5dabe-af36-48d8-bb92-f0a40e0a2b54 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:15.041607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99b5dabe-af36-48d8-bb92-f0a40e0a2b54 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:15.042698 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99b5dabe-af36-48d8-bb92-f0a40e0a2b54 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:15.043544 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99b5dabe-af36-48d8-bb92-f0a40e0a2b54 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:15.044219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99b5dabe-af36-48d8-bb92-f0a40e0a2b54 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:15.182492 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-99b5dabe-af36-48d8-bb92-f0a40e0a2b54 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68" status: 200 len: 1655 microversion: 2.1 time: 0.158627 Aug 04 17:41:15.183727 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3223/6477] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:15 2022] GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68 => generated 1655 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:15.855182 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8f01a53f-a9df-47f1-a729-550759c98b0c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:15.855885 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8f01a53f-a9df-47f1-a729-550759c98b0c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 133fadeb-1322-4818-bb88-41691932a451] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:15.863415 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8f01a53f-a9df-47f1-a729-550759c98b0c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:15.863904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8f01a53f-a9df-47f1-a729-550759c98b0c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:15.864345 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8f01a53f-a9df-47f1-a729-550759c98b0c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:15.865047 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8f01a53f-a9df-47f1-a729-550759c98b0c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:15.865508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8f01a53f-a9df-47f1-a729-550759c98b0c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:15.865940 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8f01a53f-a9df-47f1-a729-550759c98b0c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:15.868922 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:41:15.934871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8f01a53f-a9df-47f1-a729-550759c98b0c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:15.942870 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8f01a53f-a9df-47f1-a729-550759c98b0c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451" status: 200 len: 1188 microversion: 2.1 time: 0.092003 Aug 04 17:41:15.943451 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3255/6478] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:15 2022] GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451 => generated 1188 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:16.205121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cb136d04-f8e5-4512-9065-f047dda73612 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:16.205665 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cb136d04-f8e5-4512-9065-f047dda73612 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: c1402ab0-1ebe-41f4-b305-bf0586a55b68] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:16.213492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb136d04-f8e5-4512-9065-f047dda73612 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:16.214021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb136d04-f8e5-4512-9065-f047dda73612 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:16.214472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb136d04-f8e5-4512-9065-f047dda73612 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:16.215233 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb136d04-f8e5-4512-9065-f047dda73612 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:16.215703 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb136d04-f8e5-4512-9065-f047dda73612 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:16.216134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb136d04-f8e5-4512-9065-f047dda73612 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:16.352134 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cb136d04-f8e5-4512-9065-f047dda73612 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68" status: 200 len: 1655 microversion: 2.1 time: 0.151663 Aug 04 17:41:16.352927 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3224/6479] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:16 2022] GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68 => generated 1655 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:16.966277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7aa4a274-1a31-4e2b-8b16-a89d5fd2194e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:16.967888 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7aa4a274-1a31-4e2b-8b16-a89d5fd2194e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 133fadeb-1322-4818-bb88-41691932a451] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:16.981029 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7aa4a274-1a31-4e2b-8b16-a89d5fd2194e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:16.981643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7aa4a274-1a31-4e2b-8b16-a89d5fd2194e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:16.982376 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7aa4a274-1a31-4e2b-8b16-a89d5fd2194e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:16.984961 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7aa4a274-1a31-4e2b-8b16-a89d5fd2194e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:16.999079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7aa4a274-1a31-4e2b-8b16-a89d5fd2194e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:17.001416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7aa4a274-1a31-4e2b-8b16-a89d5fd2194e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:17.001881 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-897c647a-2e54-4aa8-b706-1a9db0fb95d1 req-8b6cf5ae-bbee-49bf-8a58-a0920782de0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1402ab0-1ebe-41f4-b305-bf0586a55b68", "name": "network-vif-deleted", "tag": "7bc87193-3dff-406a-a8ff-9901bfcd9d06"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:41:17.030195 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-897c647a-2e54-4aa8-b706-1a9db0fb95d1 req-8b6cf5ae-bbee-49bf-8a58-a0920782de0f service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:17.031781 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-897c647a-2e54-4aa8-b706-1a9db0fb95d1 req-8b6cf5ae-bbee-49bf-8a58-a0920782de0f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:17.033377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-897c647a-2e54-4aa8-b706-1a9db0fb95d1 req-8b6cf5ae-bbee-49bf-8a58-a0920782de0f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:17.063844 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-897c647a-2e54-4aa8-b706-1a9db0fb95d1 req-8b6cf5ae-bbee-49bf-8a58-a0920782de0f service nova] Creating event network-vif-deleted:7bc87193-3dff-406a-a8ff-9901bfcd9d06 for instance c1402ab0-1ebe-41f4-b305-bf0586a55b68 on n-h2-851359-3 Aug 04 17:41:17.074652 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-897c647a-2e54-4aa8-b706-1a9db0fb95d1 req-8b6cf5ae-bbee-49bf-8a58-a0920782de0f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075416 Aug 04 17:41:17.075656 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3225/6480] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:41:17.117067 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7aa4a274-1a31-4e2b-8b16-a89d5fd2194e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:17.130051 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7aa4a274-1a31-4e2b-8b16-a89d5fd2194e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451" status: 200 len: 1188 microversion: 2.1 time: 0.168840 Aug 04 17:41:17.130801 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3256/6481] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:16 2022] GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451 => generated 1188 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:17.374498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8eb47fa1-7af7-4d02-8672-d546eec3ac64 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:17.375211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8eb47fa1-7af7-4d02-8672-d546eec3ac64 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: c1402ab0-1ebe-41f4-b305-bf0586a55b68] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:17.381795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8eb47fa1-7af7-4d02-8672-d546eec3ac64 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:17.382323 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8eb47fa1-7af7-4d02-8672-d546eec3ac64 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:17.382770 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8eb47fa1-7af7-4d02-8672-d546eec3ac64 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:17.383492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8eb47fa1-7af7-4d02-8672-d546eec3ac64 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:17.383958 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8eb47fa1-7af7-4d02-8672-d546eec3ac64 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:17.384391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8eb47fa1-7af7-4d02-8672-d546eec3ac64 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:17.419804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8eb47fa1-7af7-4d02-8672-d546eec3ac64 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:17.420281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8eb47fa1-7af7-4d02-8672-d546eec3ac64 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:17.420833 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8eb47fa1-7af7-4d02-8672-d546eec3ac64 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:17.421521 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-8eb47fa1-7af7-4d02-8672-d546eec3ac64 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lazy-loading 'fault' on Instance uuid c1402ab0-1ebe-41f4-b305-bf0586a55b68 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:41:17.476233 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8eb47fa1-7af7-4d02-8672-d546eec3ac64 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68" status: 200 len: 1454 microversion: 2.1 time: 0.106860 Aug 04 17:41:17.484890 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3226/6482] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:17 2022] GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68 => generated 1454 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:18.156806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4c39d676-487d-459b-9143-841631b9c460 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:18.157462 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4c39d676-487d-459b-9143-841631b9c460 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 133fadeb-1322-4818-bb88-41691932a451] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:18.164765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c39d676-487d-459b-9143-841631b9c460 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:18.165262 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c39d676-487d-459b-9143-841631b9c460 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:18.165709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c39d676-487d-459b-9143-841631b9c460 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:18.166520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c39d676-487d-459b-9143-841631b9c460 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:18.166987 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c39d676-487d-459b-9143-841631b9c460 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:18.167420 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c39d676-487d-459b-9143-841631b9c460 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:18.234473 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4c39d676-487d-459b-9143-841631b9c460 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:18.242541 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4c39d676-487d-459b-9143-841631b9c460 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451" status: 200 len: 1188 microversion: 2.1 time: 0.090189 Aug 04 17:41:18.243397 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3257/6483] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:18 2022] GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451 => generated 1188 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:18.501013 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-499c1e11-aa82-4a6d-a190-936f128202f7 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:18.501686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-499c1e11-aa82-4a6d-a190-936f128202f7 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: c1402ab0-1ebe-41f4-b305-bf0586a55b68] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:18.508741 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-499c1e11-aa82-4a6d-a190-936f128202f7 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:18.509241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-499c1e11-aa82-4a6d-a190-936f128202f7 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:18.509684 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-499c1e11-aa82-4a6d-a190-936f128202f7 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:18.510514 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-499c1e11-aa82-4a6d-a190-936f128202f7 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:18.510973 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-499c1e11-aa82-4a6d-a190-936f128202f7 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:18.511405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-499c1e11-aa82-4a6d-a190-936f128202f7 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:18.525673 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-499c1e11-aa82-4a6d-a190-936f128202f7 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] HTTP exception thrown: Instance c1402ab0-1ebe-41f4-b305-bf0586a55b68 could not be found. Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-499c1e11-aa82-4a6d-a190-936f128202f7 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Request method failure captured: Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68 HTTP/1.1 Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AScOqI1oEE9Zpu_lSvWzwmrXd3GSFwwrTAQOFhZjbtrhNhEa6SA_gvRwt_Swt9PjMq0fe_j8ZVK7_KXDAKcaczDhI_JOgoaNFeKjM2NcbMHg681oVRLOqgkOnwZZHcCk1BO78a6Sa-ybpZfy_zQF9qg2UWVKEwRwdBHe3JUMjXv344 Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 0d85e1375a3449aba3bf5548d2f964e3 Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TestServerMultinode-1330562132 Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: X-Role: admin,member,reader Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: admin,member,reader Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0d85e1375a3449aba3bf5548d2f964e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0d85e1375a3449aba3bf5548d2f964e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0d85e1375a3449aba3bf5548d2f964e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0d85e1375a3449aba3bf5548d2f964e3"}]}] Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TestServerMultinode-1330562132 Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 0d85e1375a3449aba3bf5548d2f964e3 Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestServerMultinode-1330562132 Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TestServerMultinode-1330562132-project-admin Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 26b0b5dea5be4e268d18e461923ef10f Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TestServerMultinode-1330562132-project-admin Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance c1402ab0-1ebe-41f4-b305-bf0586a55b68 could not be found. Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'c1402ab0-1ebe-41f4-b305-bf0586a55b68'} Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1402ab0-1ebe-41f4-b305-bf0586a55b68 could not be found. Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1402ab0-1ebe-41f4-b305-bf0586a55b68 could not be found. Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:41:18.527374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:41:18.532930 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:41:18.532930 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:41:18.532930 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:41:18.532930 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:41:18.532930 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:41:18.532930 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1402ab0-1ebe-41f4-b305-bf0586a55b68 could not be found. Aug 04 17:41:18.532930 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:41:18.532930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-499c1e11-aa82-4a6d-a190-936f128202f7 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Returning 404 to user: Instance c1402ab0-1ebe-41f4-b305-bf0586a55b68 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:41:18.532930 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-499c1e11-aa82-4a6d-a190-936f128202f7 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68" status: 404 len: 111 microversion: 2.1 time: 0.032207 Aug 04 17:41:18.532930 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3227/6484] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:18 2022] GET /compute/v2.1/servers/c1402ab0-1ebe-41f4-b305-bf0586a55b68 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:41:18.542069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-45700f29-b404-4726-b476-faaa312963a4 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:18.542742 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-45700f29-b404-4726-b476-faaa312963a4 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: cafaf520-c9e3-4fb4-80fc-d17c5e7041ea] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:18.548802 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-45700f29-b404-4726-b476-faaa312963a4 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:18.549371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-45700f29-b404-4726-b476-faaa312963a4 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:18.549914 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-45700f29-b404-4726-b476-faaa312963a4 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:18.550703 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-45700f29-b404-4726-b476-faaa312963a4 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:18.551233 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-45700f29-b404-4726-b476-faaa312963a4 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:18.551743 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-45700f29-b404-4726-b476-faaa312963a4 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:18.587443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-45700f29-b404-4726-b476-faaa312963a4 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: cafaf520-c9e3-4fb4-80fc-d17c5e7041ea] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:41:18.664608 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-45700f29-b404-4726-b476-faaa312963a4 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "DELETE /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea" status: 204 len: 0 microversion: 2.1 time: 0.125844 Aug 04 17:41:18.666227 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3258/6485] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:41:18 2022] DELETE /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:41:18.674422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c54e89ed-384a-4781-8a99-bc584da56bb1 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:18.675268 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c54e89ed-384a-4781-8a99-bc584da56bb1 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: cafaf520-c9e3-4fb4-80fc-d17c5e7041ea] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:18.681218 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c54e89ed-384a-4781-8a99-bc584da56bb1 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:18.681710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c54e89ed-384a-4781-8a99-bc584da56bb1 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:18.682182 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c54e89ed-384a-4781-8a99-bc584da56bb1 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:18.682883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c54e89ed-384a-4781-8a99-bc584da56bb1 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:18.683342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c54e89ed-384a-4781-8a99-bc584da56bb1 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:18.683771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c54e89ed-384a-4781-8a99-bc584da56bb1 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:18.816926 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c54e89ed-384a-4781-8a99-bc584da56bb1 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea" status: 200 len: 1653 microversion: 2.1 time: 0.146404 Aug 04 17:41:18.817511 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3228/6486] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:18 2022] GET /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea => generated 1653 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:19.265495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fae662f7-81bf-4ac6-a06a-208757e48586 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:19.267011 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fae662f7-81bf-4ac6-a06a-208757e48586 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 133fadeb-1322-4818-bb88-41691932a451] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:19.274949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fae662f7-81bf-4ac6-a06a-208757e48586 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:19.275762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fae662f7-81bf-4ac6-a06a-208757e48586 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:19.276211 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fae662f7-81bf-4ac6-a06a-208757e48586 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:19.276932 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fae662f7-81bf-4ac6-a06a-208757e48586 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:19.277400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fae662f7-81bf-4ac6-a06a-208757e48586 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:19.277847 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fae662f7-81bf-4ac6-a06a-208757e48586 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:19.318166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fae662f7-81bf-4ac6-a06a-208757e48586 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:19.318929 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fae662f7-81bf-4ac6-a06a-208757e48586 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:19.319353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fae662f7-81bf-4ac6-a06a-208757e48586 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:19.319822 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-fae662f7-81bf-4ac6-a06a-208757e48586 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lazy-loading 'fault' on Instance uuid 133fadeb-1322-4818-bb88-41691932a451 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:41:19.373841 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fae662f7-81bf-4ac6-a06a-208757e48586 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:19.381755 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fae662f7-81bf-4ac6-a06a-208757e48586 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451" status: 200 len: 1193 microversion: 2.1 time: 0.121284 Aug 04 17:41:19.382382 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3259/6487] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:19 2022] GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451 => generated 1193 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:19.838882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-24801573-fda3-4a82-9f90-b9ffa18f10c2 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:19.839518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-24801573-fda3-4a82-9f90-b9ffa18f10c2 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: cafaf520-c9e3-4fb4-80fc-d17c5e7041ea] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:19.846964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24801573-fda3-4a82-9f90-b9ffa18f10c2 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:19.847459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24801573-fda3-4a82-9f90-b9ffa18f10c2 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:19.847906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24801573-fda3-4a82-9f90-b9ffa18f10c2 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:19.848604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24801573-fda3-4a82-9f90-b9ffa18f10c2 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:19.849068 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24801573-fda3-4a82-9f90-b9ffa18f10c2 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:19.849500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24801573-fda3-4a82-9f90-b9ffa18f10c2 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:19.973858 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:41:19.980322 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-24801573-fda3-4a82-9f90-b9ffa18f10c2 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea" status: 200 len: 1653 microversion: 2.1 time: 0.145408 Aug 04 17:41:19.980900 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3229/6488] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:19 2022] GET /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea => generated 1653 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:20.403257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b33beced-7104-4284-8e92-41a7b833fde4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:20.403881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b33beced-7104-4284-8e92-41a7b833fde4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 133fadeb-1322-4818-bb88-41691932a451] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:20.410878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b33beced-7104-4284-8e92-41a7b833fde4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:20.411373 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b33beced-7104-4284-8e92-41a7b833fde4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:20.411815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b33beced-7104-4284-8e92-41a7b833fde4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:20.412527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b33beced-7104-4284-8e92-41a7b833fde4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:20.412990 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b33beced-7104-4284-8e92-41a7b833fde4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:20.413422 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b33beced-7104-4284-8e92-41a7b833fde4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:20.427886 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-b33beced-7104-4284-8e92-41a7b833fde4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] HTTP exception thrown: Instance 133fadeb-1322-4818-bb88-41691932a451 could not be found. Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b33beced-7104-4284-8e92-41a7b833fde4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Request method failure captured: Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451 HTTP/1.1 Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7ARpoisKS8ru_ZJiIrIfjIFMRjfQL-mVrLbzAzLl4Z4wH-8ksarsVn1PTK67x0ktAL2RMgNiOghxRSfCsuIPgqi5zzrjB6PtD1ptQpXCC7QBiVIYCXgsvXv7bVdD4F6QLnLsEgFyHhnUvqqIgdfnwyBZE3QOXa1h7oqCs3SSjoPFKXM Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 46f694275ec441259c366f63daa4a380 Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-TestVolumeBootPattern-275420730 Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46f694275ec441259c366f63daa4a380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46f694275ec441259c366f63daa4a380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_46f694275ec441259c366f63daa4a380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/46f694275ec441259c366f63daa4a380"}]}] Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-TestVolumeBootPattern-275420730 Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 46f694275ec441259c366f63daa4a380 Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-TestVolumeBootPattern-275420730 Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-TestVolumeBootPattern-275420730-project Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 50bf6f5281964c0b81809080bcf22bdd Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-TestVolumeBootPattern-275420730-project Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 133fadeb-1322-4818-bb88-41691932a451 could not be found. Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '133fadeb-1322-4818-bb88-41691932a451'} Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 133fadeb-1322-4818-bb88-41691932a451 could not be found. Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 133fadeb-1322-4818-bb88-41691932a451 could not be found. Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:41:20.429714 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:41:20.434884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:41:20.434884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:41:20.434884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:41:20.434884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:41:20.434884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:41:20.434884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 133fadeb-1322-4818-bb88-41691932a451 could not be found. Aug 04 17:41:20.434884 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:41:20.434884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b33beced-7104-4284-8e92-41a7b833fde4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Returning 404 to user: Instance 133fadeb-1322-4818-bb88-41691932a451 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:41:20.434884 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b33beced-7104-4284-8e92-41a7b833fde4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451" status: 404 len: 111 microversion: 2.1 time: 0.031898 Aug 04 17:41:20.434884 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3260/6489] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:20 2022] GET /compute/v2.1/servers/133fadeb-1322-4818-bb88-41691932a451 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:41:20.730183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-db73a78c-c39d-4034-b919-9af41e9972c6 req-642aed3d-fda4-455e-b605-b2ff0bb1b536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cafaf520-c9e3-4fb4-80fc-d17c5e7041ea", "name": "network-vif-deleted", "tag": "4e502dec-68a9-4cdd-8717-f9c3deca0099"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:41:20.746770 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-db73a78c-c39d-4034-b919-9af41e9972c6 req-642aed3d-fda4-455e-b605-b2ff0bb1b536 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:20.747370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-db73a78c-c39d-4034-b919-9af41e9972c6 req-642aed3d-fda4-455e-b605-b2ff0bb1b536 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:20.748143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-db73a78c-c39d-4034-b919-9af41e9972c6 req-642aed3d-fda4-455e-b605-b2ff0bb1b536 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:20.761677 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-db73a78c-c39d-4034-b919-9af41e9972c6 req-642aed3d-fda4-455e-b605-b2ff0bb1b536 service nova] Creating event network-vif-deleted:4e502dec-68a9-4cdd-8717-f9c3deca0099 for instance cafaf520-c9e3-4fb4-80fc-d17c5e7041ea on n-h1-851359-3 Aug 04 17:41:20.768586 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-db73a78c-c39d-4034-b919-9af41e9972c6 req-642aed3d-fda4-455e-b605-b2ff0bb1b536 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042106 Aug 04 17:41:20.769248 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3230/6490] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:41:21.001336 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2f9d0a15-ed11-4135-add2-525ad40f8d33 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:21.001965 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2f9d0a15-ed11-4135-add2-525ad40f8d33 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: cafaf520-c9e3-4fb4-80fc-d17c5e7041ea] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:21.009244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f9d0a15-ed11-4135-add2-525ad40f8d33 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:21.010203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f9d0a15-ed11-4135-add2-525ad40f8d33 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:21.010668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f9d0a15-ed11-4135-add2-525ad40f8d33 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:21.011635 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f9d0a15-ed11-4135-add2-525ad40f8d33 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:21.012111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f9d0a15-ed11-4135-add2-525ad40f8d33 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:21.012553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f9d0a15-ed11-4135-add2-525ad40f8d33 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:21.049108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f9d0a15-ed11-4135-add2-525ad40f8d33 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:21.049613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f9d0a15-ed11-4135-add2-525ad40f8d33 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:21.050085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f9d0a15-ed11-4135-add2-525ad40f8d33 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:21.050554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-2f9d0a15-ed11-4135-add2-525ad40f8d33 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lazy-loading 'fault' on Instance uuid cafaf520-c9e3-4fb4-80fc-d17c5e7041ea {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:41:21.113801 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2f9d0a15-ed11-4135-add2-525ad40f8d33 tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea" status: 200 len: 1452 microversion: 2.1 time: 0.116335 Aug 04 17:41:21.114462 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3261/6491] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:20 2022] GET /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea => generated 1452 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:22.136197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0ef0e6de-81a3-4f80-bce8-4452fe38f31a tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:22.136944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0ef0e6de-81a3-4f80-bce8-4452fe38f31a tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] [instance: cafaf520-c9e3-4fb4-80fc-d17c5e7041ea] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:22.144676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ef0e6de-81a3-4f80-bce8-4452fe38f31a tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:22.145172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ef0e6de-81a3-4f80-bce8-4452fe38f31a tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:22.145618 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ef0e6de-81a3-4f80-bce8-4452fe38f31a tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:22.146362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ef0e6de-81a3-4f80-bce8-4452fe38f31a tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:22.146829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ef0e6de-81a3-4f80-bce8-4452fe38f31a tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:22.147266 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ef0e6de-81a3-4f80-bce8-4452fe38f31a tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:22.160782 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-0ef0e6de-81a3-4f80-bce8-4452fe38f31a tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] HTTP exception thrown: Instance cafaf520-c9e3-4fb4-80fc-d17c5e7041ea could not be found. Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0ef0e6de-81a3-4f80-bce8-4452fe38f31a tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Request method failure captured: Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea HTTP/1.1 Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AScOqI1oEE9Zpu_lSvWzwmrXd3GSFwwrTAQOFhZjbtrhNhEa6SA_gvRwt_Swt9PjMq0fe_j8ZVK7_KXDAKcaczDhI_JOgoaNFeKjM2NcbMHg681oVRLOqgkOnwZZHcCk1BO78a6Sa-ybpZfy_zQF9qg2UWVKEwRwdBHe3JUMjXv344 Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 0d85e1375a3449aba3bf5548d2f964e3 Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TestServerMultinode-1330562132 Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: X-Role: admin,member,reader Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: admin,member,reader Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0d85e1375a3449aba3bf5548d2f964e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0d85e1375a3449aba3bf5548d2f964e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0d85e1375a3449aba3bf5548d2f964e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0d85e1375a3449aba3bf5548d2f964e3"}]}] Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TestServerMultinode-1330562132 Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 0d85e1375a3449aba3bf5548d2f964e3 Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestServerMultinode-1330562132 Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TestServerMultinode-1330562132-project-admin Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 26b0b5dea5be4e268d18e461923ef10f Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TestServerMultinode-1330562132-project-admin Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance cafaf520-c9e3-4fb4-80fc-d17c5e7041ea could not be found. Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'cafaf520-c9e3-4fb4-80fc-d17c5e7041ea'} Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cafaf520-c9e3-4fb4-80fc-d17c5e7041ea could not be found. Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cafaf520-c9e3-4fb4-80fc-d17c5e7041ea could not be found. Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:41:22.162514 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:41:22.168143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:41:22.168143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:41:22.168143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:41:22.168143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:41:22.168143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:41:22.168143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cafaf520-c9e3-4fb4-80fc-d17c5e7041ea could not be found. Aug 04 17:41:22.168143 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:41:22.168143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0ef0e6de-81a3-4f80-bce8-4452fe38f31a tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] Returning 404 to user: Instance cafaf520-c9e3-4fb4-80fc-d17c5e7041ea could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:41:22.168143 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0ef0e6de-81a3-4f80-bce8-4452fe38f31a tempest-TestServerMultinode-1330562132 tempest-TestServerMultinode-1330562132-project-admin] 10.222.0.93 "GET /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea" status: 404 len: 111 microversion: 2.1 time: 0.031957 Aug 04 17:41:22.168143 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3231/6492] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:22 2022] GET /compute/v2.1/servers/cafaf520-c9e3-4fb4-80fc-d17c5e7041ea => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:41:43.898956 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-951d644b-64d1-4cbc-b904-714e3f8d1d21 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1216582678", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "95425fe2-496b-44a8-9461-18670884d6c8", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "6002cd39-a33b-430d-a6d2-0ecfe13cd1ee"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:41:43.909848 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:41:43.910589 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:41:43.994852 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-951d644b-64d1-4cbc-b904-714e3f8d1d21 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] validate_networks() for [('6002cd39-a33b-430d-a6d2-0ecfe13cd1ee', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:41:44.371612 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-951d644b-64d1-4cbc-b904-714e3f8d1d21 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:41:44.372051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-951d644b-64d1-4cbc-b904-714e3f8d1d21 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:41:44.372533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-951d644b-64d1-4cbc-b904-714e3f8d1d21 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:41:44.372952 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-951d644b-64d1-4cbc-b904-714e3f8d1d21 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:41:44.373372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-951d644b-64d1-4cbc-b904-714e3f8d1d21 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:41:44.382254 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-951d644b-64d1-4cbc-b904-714e3f8d1d21 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:44.382747 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-951d644b-64d1-4cbc-b904-714e3f8d1d21 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:44.383188 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-951d644b-64d1-4cbc-b904-714e3f8d1d21 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:44.383918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-951d644b-64d1-4cbc-b904-714e3f8d1d21 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:44.384384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-951d644b-64d1-4cbc-b904-714e3f8d1d21 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:44.389840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-951d644b-64d1-4cbc-b904-714e3f8d1d21 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:44.404256 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-951d644b-64d1-4cbc-b904-714e3f8d1d21 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Getting quotas for project 46f694275ec441259c366f63daa4a380. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:41:44.410238 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-951d644b-64d1-4cbc-b904-714e3f8d1d21 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Getting quotas for user 50bf6f5281964c0b81809080bcf22bdd and project 46f694275ec441259c366f63daa4a380. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:41:44.422782 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-951d644b-64d1-4cbc-b904-714e3f8d1d21 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:41:44.425455 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-951d644b-64d1-4cbc-b904-714e3f8d1d21 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='95425fe2-496b-44a8-9461-18670884d6c8',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:41:44.503979 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-951d644b-64d1-4cbc-b904-714e3f8d1d21 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.609513 Aug 04 17:41:44.504628 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3262/6493] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:41:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:41:44.516213 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-11f04f0a-9092-47e8-9c34-669e5eeed142 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:44.517674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-11f04f0a-9092-47e8-9c34-669e5eeed142 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:44.524454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=45 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:41:44.525891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=5 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:41:44.585352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-11f04f0a-9092-47e8-9c34-669e5eeed142 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:44.594821 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-11f04f0a-9092-47e8-9c34-669e5eeed142 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1057 microversion: 2.1 time: 0.083050 Aug 04 17:41:44.602390 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3232/6494] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:44 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1057 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:45.616761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8c8d96a2-2450-4a9a-9c52-474969b7db8f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:45.617365 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8c8d96a2-2450-4a9a-9c52-474969b7db8f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:45.624209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c8d96a2-2450-4a9a-9c52-474969b7db8f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:45.624729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c8d96a2-2450-4a9a-9c52-474969b7db8f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:45.625176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c8d96a2-2450-4a9a-9c52-474969b7db8f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:45.625912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c8d96a2-2450-4a9a-9c52-474969b7db8f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:45.626403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c8d96a2-2450-4a9a-9c52-474969b7db8f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:45.626864 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8c8d96a2-2450-4a9a-9c52-474969b7db8f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:45.696240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8c8d96a2-2450-4a9a-9c52-474969b7db8f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:45.705949 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8c8d96a2-2450-4a9a-9c52-474969b7db8f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1109 microversion: 2.1 time: 0.093743 Aug 04 17:41:45.706505 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3263/6495] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:45 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1109 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:46.728639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-16cc0626-7df4-4593-a9c8-eddd140c679c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:46.733198 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-16cc0626-7df4-4593-a9c8-eddd140c679c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:46.742442 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16cc0626-7df4-4593-a9c8-eddd140c679c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:46.743311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16cc0626-7df4-4593-a9c8-eddd140c679c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:46.743986 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16cc0626-7df4-4593-a9c8-eddd140c679c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:46.745079 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16cc0626-7df4-4593-a9c8-eddd140c679c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:46.745797 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16cc0626-7df4-4593-a9c8-eddd140c679c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:46.746478 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16cc0626-7df4-4593-a9c8-eddd140c679c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:46.911547 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-16cc0626-7df4-4593-a9c8-eddd140c679c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:46.922031 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-16cc0626-7df4-4593-a9c8-eddd140c679c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1169 microversion: 2.1 time: 0.197388 Aug 04 17:41:46.934624 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3233/6496] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:46 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1169 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:47.246215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-49b22453-1b02-4a83-ba67-b97dd7bc13b0 req-92d0aac4-315b-47b1-b34f-007d584f9e1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61364dfd-cd60-4f46-a1b9-68fb76c7118a", "tag": "201a4dfa-0dcd-4011-90cf-6c6c771cb899"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:41:47.257953 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-49b22453-1b02-4a83-ba67-b97dd7bc13b0 req-92d0aac4-315b-47b1-b34f-007d584f9e1a service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:47.259210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-49b22453-1b02-4a83-ba67-b97dd7bc13b0 req-92d0aac4-315b-47b1-b34f-007d584f9e1a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:47.259653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-49b22453-1b02-4a83-ba67-b97dd7bc13b0 req-92d0aac4-315b-47b1-b34f-007d584f9e1a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:47.273116 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-49b22453-1b02-4a83-ba67-b97dd7bc13b0 req-92d0aac4-315b-47b1-b34f-007d584f9e1a service nova] Creating event network-changed:201a4dfa-0dcd-4011-90cf-6c6c771cb899 for instance 61364dfd-cd60-4f46-a1b9-68fb76c7118a on n-h1-851359-3 Aug 04 17:41:47.278919 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-49b22453-1b02-4a83-ba67-b97dd7bc13b0 req-92d0aac4-315b-47b1-b34f-007d584f9e1a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037228 Aug 04 17:41:47.279644 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3264/6497] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:41:47.944356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-adb6e9e2-ba25-476f-b20b-c90fcb8574f6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:47.944976 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-adb6e9e2-ba25-476f-b20b-c90fcb8574f6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:47.952134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adb6e9e2-ba25-476f-b20b-c90fcb8574f6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:47.953474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adb6e9e2-ba25-476f-b20b-c90fcb8574f6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:47.954227 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adb6e9e2-ba25-476f-b20b-c90fcb8574f6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:47.955574 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adb6e9e2-ba25-476f-b20b-c90fcb8574f6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:47.956187 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adb6e9e2-ba25-476f-b20b-c90fcb8574f6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:47.956616 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adb6e9e2-ba25-476f-b20b-c90fcb8574f6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:48.093515 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-adb6e9e2-ba25-476f-b20b-c90fcb8574f6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:48.103949 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-adb6e9e2-ba25-476f-b20b-c90fcb8574f6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1169 microversion: 2.1 time: 0.163134 Aug 04 17:41:48.104776 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3234/6498] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:47 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1169 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:49.128509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2ed9c5ae-31d8-4eca-a9b9-a73a6cac11fe tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:49.129215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2ed9c5ae-31d8-4eca-a9b9-a73a6cac11fe tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:49.137802 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ed9c5ae-31d8-4eca-a9b9-a73a6cac11fe tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:49.138317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ed9c5ae-31d8-4eca-a9b9-a73a6cac11fe tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:49.138768 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ed9c5ae-31d8-4eca-a9b9-a73a6cac11fe tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:49.139496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ed9c5ae-31d8-4eca-a9b9-a73a6cac11fe tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:49.140005 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ed9c5ae-31d8-4eca-a9b9-a73a6cac11fe tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:49.140445 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ed9c5ae-31d8-4eca-a9b9-a73a6cac11fe tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:49.286724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2ed9c5ae-31d8-4eca-a9b9-a73a6cac11fe tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:49.300846 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2ed9c5ae-31d8-4eca-a9b9-a73a6cac11fe tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1169 microversion: 2.1 time: 0.177437 Aug 04 17:41:49.301833 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3265/6499] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:49 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1169 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:50.326619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8ff15d1e-ce63-4211-a7f5-4f75d82f872f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:50.327508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8ff15d1e-ce63-4211-a7f5-4f75d82f872f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:50.342150 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ff15d1e-ce63-4211-a7f5-4f75d82f872f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:50.344239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ff15d1e-ce63-4211-a7f5-4f75d82f872f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:50.344838 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ff15d1e-ce63-4211-a7f5-4f75d82f872f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:50.346163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ff15d1e-ce63-4211-a7f5-4f75d82f872f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:50.347571 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ff15d1e-ce63-4211-a7f5-4f75d82f872f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:50.348761 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ff15d1e-ce63-4211-a7f5-4f75d82f872f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:50.559086 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8ff15d1e-ce63-4211-a7f5-4f75d82f872f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:50.576883 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8ff15d1e-ce63-4211-a7f5-4f75d82f872f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1169 microversion: 2.1 time: 0.256692 Aug 04 17:41:50.578092 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3235/6500] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:50 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1169 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:51.605376 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fd1d14d3-f605-4d13-b5f8-415d489f9e76 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:51.606966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fd1d14d3-f605-4d13-b5f8-415d489f9e76 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:51.617349 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd1d14d3-f605-4d13-b5f8-415d489f9e76 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:51.617859 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd1d14d3-f605-4d13-b5f8-415d489f9e76 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:51.618356 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd1d14d3-f605-4d13-b5f8-415d489f9e76 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:51.619081 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd1d14d3-f605-4d13-b5f8-415d489f9e76 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:51.619547 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd1d14d3-f605-4d13-b5f8-415d489f9e76 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:51.619978 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fd1d14d3-f605-4d13-b5f8-415d489f9e76 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:51.802182 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fd1d14d3-f605-4d13-b5f8-415d489f9e76 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:51.811783 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fd1d14d3-f605-4d13-b5f8-415d489f9e76 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1169 microversion: 2.1 time: 0.213146 Aug 04 17:41:51.812411 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3266/6501] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:51 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1169 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:52.833640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c29f9320-a235-47be-a2fd-9c7aa57a6e28 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:52.834310 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c29f9320-a235-47be-a2fd-9c7aa57a6e28 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:52.841206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c29f9320-a235-47be-a2fd-9c7aa57a6e28 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:52.841706 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c29f9320-a235-47be-a2fd-9c7aa57a6e28 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:52.842171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c29f9320-a235-47be-a2fd-9c7aa57a6e28 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:52.842875 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c29f9320-a235-47be-a2fd-9c7aa57a6e28 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:52.843899 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c29f9320-a235-47be-a2fd-9c7aa57a6e28 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:52.844514 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c29f9320-a235-47be-a2fd-9c7aa57a6e28 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:52.990775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c29f9320-a235-47be-a2fd-9c7aa57a6e28 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:52.999917 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c29f9320-a235-47be-a2fd-9c7aa57a6e28 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1169 microversion: 2.1 time: 0.169472 Aug 04 17:41:53.001342 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3236/6502] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:52 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1169 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:41:54.021654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ab536599-1b92-4487-aeb3-f88fbb990367 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:54.022959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ab536599-1b92-4487-aeb3-f88fbb990367 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:54.029949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ab536599-1b92-4487-aeb3-f88fbb990367 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:54.030525 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ab536599-1b92-4487-aeb3-f88fbb990367 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:54.030956 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ab536599-1b92-4487-aeb3-f88fbb990367 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:54.031670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ab536599-1b92-4487-aeb3-f88fbb990367 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:54.032201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ab536599-1b92-4487-aeb3-f88fbb990367 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:54.032667 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ab536599-1b92-4487-aeb3-f88fbb990367 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:54.197478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ab536599-1b92-4487-aeb3-f88fbb990367 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:54.209521 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ab536599-1b92-4487-aeb3-f88fbb990367 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1169 microversion: 2.1 time: 0.191806 Aug 04 17:41:54.210615 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3267/6503] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:54 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1169 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:55.230317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-78505ea2-2b04-40d5-a608-f272b7344089 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:55.230975 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-78505ea2-2b04-40d5-a608-f272b7344089 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:55.233692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:41:55.239371 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78505ea2-2b04-40d5-a608-f272b7344089 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:55.239866 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78505ea2-2b04-40d5-a608-f272b7344089 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:55.240314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78505ea2-2b04-40d5-a608-f272b7344089 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:55.241020 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78505ea2-2b04-40d5-a608-f272b7344089 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:55.241485 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78505ea2-2b04-40d5-a608-f272b7344089 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:55.241921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78505ea2-2b04-40d5-a608-f272b7344089 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:55.378734 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-78505ea2-2b04-40d5-a608-f272b7344089 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:55.386175 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-78505ea2-2b04-40d5-a608-f272b7344089 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1169 microversion: 2.1 time: 0.159765 Aug 04 17:41:55.386744 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3237/6504] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:55 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1169 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:56.406789 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ee9db05f-b05f-463f-b76f-bd2dac1ba461 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:56.407443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ee9db05f-b05f-463f-b76f-bd2dac1ba461 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:56.409454 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:41:56.410345 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:41:56.417784 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee9db05f-b05f-463f-b76f-bd2dac1ba461 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:56.417784 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee9db05f-b05f-463f-b76f-bd2dac1ba461 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:56.418152 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee9db05f-b05f-463f-b76f-bd2dac1ba461 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:56.418876 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee9db05f-b05f-463f-b76f-bd2dac1ba461 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:56.419343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee9db05f-b05f-463f-b76f-bd2dac1ba461 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:56.419795 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee9db05f-b05f-463f-b76f-bd2dac1ba461 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:56.567572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ee9db05f-b05f-463f-b76f-bd2dac1ba461 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:56.576581 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ee9db05f-b05f-463f-b76f-bd2dac1ba461 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1169 microversion: 2.1 time: 0.173576 Aug 04 17:41:56.577224 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3268/6505] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:56 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1169 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:57.597117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8538b499-40b0-4353-9c9a-5085feb4fed5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:57.598538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8538b499-40b0-4353-9c9a-5085feb4fed5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:57.605960 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8538b499-40b0-4353-9c9a-5085feb4fed5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:57.606488 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8538b499-40b0-4353-9c9a-5085feb4fed5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:57.606936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8538b499-40b0-4353-9c9a-5085feb4fed5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:57.607657 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8538b499-40b0-4353-9c9a-5085feb4fed5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:57.608122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8538b499-40b0-4353-9c9a-5085feb4fed5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:57.608562 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8538b499-40b0-4353-9c9a-5085feb4fed5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:57.791250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8538b499-40b0-4353-9c9a-5085feb4fed5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:57.800133 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8538b499-40b0-4353-9c9a-5085feb4fed5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1169 microversion: 2.1 time: 0.206739 Aug 04 17:41:57.800910 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3238/6506] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:57 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1169 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:41:58.821730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-24edff65-94d6-43e1-a22f-d0b724be1cac tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:41:58.822423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-24edff65-94d6-43e1-a22f-d0b724be1cac tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:41:58.835063 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-24edff65-94d6-43e1-a22f-d0b724be1cac tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:58.835614 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-24edff65-94d6-43e1-a22f-d0b724be1cac tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:58.836077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-24edff65-94d6-43e1-a22f-d0b724be1cac tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:58.836817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-24edff65-94d6-43e1-a22f-d0b724be1cac tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:41:58.837302 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-24edff65-94d6-43e1-a22f-d0b724be1cac tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:41:58.837739 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-24edff65-94d6-43e1-a22f-d0b724be1cac tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:41:58.980076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-24edff65-94d6-43e1-a22f-d0b724be1cac tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:41:58.988521 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-24edff65-94d6-43e1-a22f-d0b724be1cac tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1169 microversion: 2.1 time: 0.170691 Aug 04 17:41:58.989162 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3269/6507] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:41:58 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1169 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:00.009883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7abc710b-ebc0-4a99-800d-892df8a70b93 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:00.010524 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7abc710b-ebc0-4a99-800d-892df8a70b93 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:00.018106 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7abc710b-ebc0-4a99-800d-892df8a70b93 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:00.018611 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7abc710b-ebc0-4a99-800d-892df8a70b93 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:00.019053 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7abc710b-ebc0-4a99-800d-892df8a70b93 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:00.019774 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7abc710b-ebc0-4a99-800d-892df8a70b93 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:00.020241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7abc710b-ebc0-4a99-800d-892df8a70b93 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:00.020677 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7abc710b-ebc0-4a99-800d-892df8a70b93 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:00.151337 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7abc710b-ebc0-4a99-800d-892df8a70b93 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:00.159043 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7abc710b-ebc0-4a99-800d-892df8a70b93 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1169 microversion: 2.1 time: 0.153086 Aug 04 17:42:00.159639 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3239/6508] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:00 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1169 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:01.180363 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-167c95e0-a676-4713-89b5-0265429c6ee3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:01.180985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-167c95e0-a676-4713-89b5-0265429c6ee3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:01.187940 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-167c95e0-a676-4713-89b5-0265429c6ee3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:01.188430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-167c95e0-a676-4713-89b5-0265429c6ee3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:01.188870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-167c95e0-a676-4713-89b5-0265429c6ee3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:01.189572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-167c95e0-a676-4713-89b5-0265429c6ee3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:01.190052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-167c95e0-a676-4713-89b5-0265429c6ee3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:01.190481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-167c95e0-a676-4713-89b5-0265429c6ee3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:01.329429 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-167c95e0-a676-4713-89b5-0265429c6ee3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:01.337390 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-167c95e0-a676-4713-89b5-0265429c6ee3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1203 microversion: 2.1 time: 0.161019 Aug 04 17:42:01.337998 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3270/6509] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:01 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:02.359578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9e961283-2561-4b2b-a316-cd904f9e9dac tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:02.360198 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9e961283-2561-4b2b-a316-cd904f9e9dac tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:02.367673 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e961283-2561-4b2b-a316-cd904f9e9dac tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:02.368709 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e961283-2561-4b2b-a316-cd904f9e9dac tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:02.369068 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e961283-2561-4b2b-a316-cd904f9e9dac tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:02.369817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e961283-2561-4b2b-a316-cd904f9e9dac tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:02.370313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e961283-2561-4b2b-a316-cd904f9e9dac tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:02.370748 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e961283-2561-4b2b-a316-cd904f9e9dac tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:02.504664 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9e961283-2561-4b2b-a316-cd904f9e9dac tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:02.512280 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9e961283-2561-4b2b-a316-cd904f9e9dac tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1203 microversion: 2.1 time: 0.157229 Aug 04 17:42:02.512863 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3240/6510] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:02 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:03.533943 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e0ea5ee6-ea31-482a-a768-db6d12f1b28e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:03.534591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e0ea5ee6-ea31-482a-a768-db6d12f1b28e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:03.541443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0ea5ee6-ea31-482a-a768-db6d12f1b28e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:03.541955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0ea5ee6-ea31-482a-a768-db6d12f1b28e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:03.542432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0ea5ee6-ea31-482a-a768-db6d12f1b28e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:03.543224 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0ea5ee6-ea31-482a-a768-db6d12f1b28e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:03.543784 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0ea5ee6-ea31-482a-a768-db6d12f1b28e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:03.544223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0ea5ee6-ea31-482a-a768-db6d12f1b28e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:03.679814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e0ea5ee6-ea31-482a-a768-db6d12f1b28e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:03.687417 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e0ea5ee6-ea31-482a-a768-db6d12f1b28e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1203 microversion: 2.1 time: 0.157961 Aug 04 17:42:03.687982 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3271/6511] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:03 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:04.707849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9dd8fd44-263c-48da-8f7c-e3e990a454fa tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:04.708473 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9dd8fd44-263c-48da-8f7c-e3e990a454fa tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:04.715319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dd8fd44-263c-48da-8f7c-e3e990a454fa tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:04.715811 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dd8fd44-263c-48da-8f7c-e3e990a454fa tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:04.716257 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dd8fd44-263c-48da-8f7c-e3e990a454fa tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:04.716960 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dd8fd44-263c-48da-8f7c-e3e990a454fa tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:04.717527 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dd8fd44-263c-48da-8f7c-e3e990a454fa tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:04.717967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dd8fd44-263c-48da-8f7c-e3e990a454fa tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:04.862809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9dd8fd44-263c-48da-8f7c-e3e990a454fa tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:04.870597 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9dd8fd44-263c-48da-8f7c-e3e990a454fa tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1203 microversion: 2.1 time: 0.166888 Aug 04 17:42:04.871198 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3241/6512] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:04 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1203 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:05.892235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c6339d94-d7ee-45c8-80ad-69e34495879f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:05.892764 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c6339d94-d7ee-45c8-80ad-69e34495879f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:05.900688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6339d94-d7ee-45c8-80ad-69e34495879f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:05.901277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6339d94-d7ee-45c8-80ad-69e34495879f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:05.901736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6339d94-d7ee-45c8-80ad-69e34495879f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:05.902513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6339d94-d7ee-45c8-80ad-69e34495879f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:05.902994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6339d94-d7ee-45c8-80ad-69e34495879f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:05.903436 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6339d94-d7ee-45c8-80ad-69e34495879f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:06.054391 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c6339d94-d7ee-45c8-80ad-69e34495879f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:06.062073 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c6339d94-d7ee-45c8-80ad-69e34495879f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1203 microversion: 2.1 time: 0.173877 Aug 04 17:42:06.062657 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3272/6513] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:05 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1203 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:07.084570 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0487caa3-f971-4cad-9b4f-cabe0e0efc7d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:07.085254 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0487caa3-f971-4cad-9b4f-cabe0e0efc7d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:07.093785 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0487caa3-f971-4cad-9b4f-cabe0e0efc7d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:07.094306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0487caa3-f971-4cad-9b4f-cabe0e0efc7d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:07.094749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0487caa3-f971-4cad-9b4f-cabe0e0efc7d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:07.095470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0487caa3-f971-4cad-9b4f-cabe0e0efc7d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:07.095959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0487caa3-f971-4cad-9b4f-cabe0e0efc7d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:07.096392 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0487caa3-f971-4cad-9b4f-cabe0e0efc7d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:07.234593 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0487caa3-f971-4cad-9b4f-cabe0e0efc7d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:07.242202 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0487caa3-f971-4cad-9b4f-cabe0e0efc7d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1203 microversion: 2.1 time: 0.161813 Aug 04 17:42:07.242784 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3242/6514] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:07 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1203 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:08.263339 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-086263b5-0a38-4dc3-a1a4-dadb9bfaac56 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:08.263994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-086263b5-0a38-4dc3-a1a4-dadb9bfaac56 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:08.271823 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-086263b5-0a38-4dc3-a1a4-dadb9bfaac56 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:08.272321 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-086263b5-0a38-4dc3-a1a4-dadb9bfaac56 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:08.272769 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-086263b5-0a38-4dc3-a1a4-dadb9bfaac56 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:08.273482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-086263b5-0a38-4dc3-a1a4-dadb9bfaac56 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:08.273954 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-086263b5-0a38-4dc3-a1a4-dadb9bfaac56 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:08.274413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-086263b5-0a38-4dc3-a1a4-dadb9bfaac56 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:08.410163 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-086263b5-0a38-4dc3-a1a4-dadb9bfaac56 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:08.417983 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-086263b5-0a38-4dc3-a1a4-dadb9bfaac56 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1203 microversion: 2.1 time: 0.158512 Aug 04 17:42:08.418582 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3273/6515] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:08 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:09.439564 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7d9ef852-b7e5-4b2c-9300-e7ab8f851b3a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:09.440196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7d9ef852-b7e5-4b2c-9300-e7ab8f851b3a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:09.447485 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d9ef852-b7e5-4b2c-9300-e7ab8f851b3a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:09.447898 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d9ef852-b7e5-4b2c-9300-e7ab8f851b3a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:09.448339 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d9ef852-b7e5-4b2c-9300-e7ab8f851b3a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:09.449068 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d9ef852-b7e5-4b2c-9300-e7ab8f851b3a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:09.449536 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d9ef852-b7e5-4b2c-9300-e7ab8f851b3a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:09.449966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d9ef852-b7e5-4b2c-9300-e7ab8f851b3a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:09.624614 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7d9ef852-b7e5-4b2c-9300-e7ab8f851b3a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:09.632629 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7d9ef852-b7e5-4b2c-9300-e7ab8f851b3a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1203 microversion: 2.1 time: 0.197064 Aug 04 17:42:09.633207 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3243/6516] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:09 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1203 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:10.654037 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-77617c44-e52f-4d6a-bc25-0fd67b780307 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:10.654696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-77617c44-e52f-4d6a-bc25-0fd67b780307 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:10.662388 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77617c44-e52f-4d6a-bc25-0fd67b780307 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:10.662897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77617c44-e52f-4d6a-bc25-0fd67b780307 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:10.663433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77617c44-e52f-4d6a-bc25-0fd67b780307 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:10.664226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77617c44-e52f-4d6a-bc25-0fd67b780307 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:10.664783 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77617c44-e52f-4d6a-bc25-0fd67b780307 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:10.665275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77617c44-e52f-4d6a-bc25-0fd67b780307 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:10.794340 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-77617c44-e52f-4d6a-bc25-0fd67b780307 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:10.801933 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-77617c44-e52f-4d6a-bc25-0fd67b780307 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1203 microversion: 2.1 time: 0.151848 Aug 04 17:42:10.802531 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3274/6517] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:10 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:11.253572 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-9920e5a0-09cd-4f4c-8406-46824d87bcd3 req-fef42d12-2420-41f9-8b73-83fafa71b50b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61364dfd-cd60-4f46-a1b9-68fb76c7118a", "name": "network-vif-plugged", "status": "completed", "tag": "201a4dfa-0dcd-4011-90cf-6c6c771cb899"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:42:11.263252 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9920e5a0-09cd-4f4c-8406-46824d87bcd3 req-fef42d12-2420-41f9-8b73-83fafa71b50b service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:11.263739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9920e5a0-09cd-4f4c-8406-46824d87bcd3 req-fef42d12-2420-41f9-8b73-83fafa71b50b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:11.264179 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9920e5a0-09cd-4f4c-8406-46824d87bcd3 req-fef42d12-2420-41f9-8b73-83fafa71b50b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:11.275645 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-9920e5a0-09cd-4f4c-8406-46824d87bcd3 req-fef42d12-2420-41f9-8b73-83fafa71b50b service nova] Creating event network-vif-plugged:201a4dfa-0dcd-4011-90cf-6c6c771cb899 for instance 61364dfd-cd60-4f46-a1b9-68fb76c7118a on n-h1-851359-3 Aug 04 17:42:11.280511 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-9920e5a0-09cd-4f4c-8406-46824d87bcd3 req-fef42d12-2420-41f9-8b73-83fafa71b50b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164427 Aug 04 17:42:11.281088 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3244/6518] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:42:11.821547 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-690c2242-6e73-4056-b76f-178146d5973d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:11.822199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-690c2242-6e73-4056-b76f-178146d5973d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:11.829748 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-690c2242-6e73-4056-b76f-178146d5973d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:11.830220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-690c2242-6e73-4056-b76f-178146d5973d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:11.830940 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-690c2242-6e73-4056-b76f-178146d5973d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:11.831638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-690c2242-6e73-4056-b76f-178146d5973d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:11.832100 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-690c2242-6e73-4056-b76f-178146d5973d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:11.832531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-690c2242-6e73-4056-b76f-178146d5973d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:11.979405 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-690c2242-6e73-4056-b76f-178146d5973d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:11.987730 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-690c2242-6e73-4056-b76f-178146d5973d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1203 microversion: 2.1 time: 0.170114 Aug 04 17:42:11.988303 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3275/6519] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:11 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1203 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:13.009733 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3c7f724c-949a-4c87-948a-b754be633996 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:13.010464 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3c7f724c-949a-4c87-948a-b754be633996 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:13.016656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c7f724c-949a-4c87-948a-b754be633996 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:13.018201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c7f724c-949a-4c87-948a-b754be633996 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:13.018201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c7f724c-949a-4c87-948a-b754be633996 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:13.019149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c7f724c-949a-4c87-948a-b754be633996 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:13.019149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c7f724c-949a-4c87-948a-b754be633996 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:13.019443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c7f724c-949a-4c87-948a-b754be633996 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:13.151921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3c7f724c-949a-4c87-948a-b754be633996 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:13.160092 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3c7f724c-949a-4c87-948a-b754be633996 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1390 microversion: 2.1 time: 0.155499 Aug 04 17:42:13.160666 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3245/6520] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:13 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:13.179942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8b86967c-1249-45f0-a01c-7419a7ba1068 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:13.180570 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8b86967c-1249-45f0-a01c-7419a7ba1068 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:13.187917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8b86967c-1249-45f0-a01c-7419a7ba1068 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:13.188417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8b86967c-1249-45f0-a01c-7419a7ba1068 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:13.189352 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8b86967c-1249-45f0-a01c-7419a7ba1068 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:13.190089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8b86967c-1249-45f0-a01c-7419a7ba1068 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:13.190559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8b86967c-1249-45f0-a01c-7419a7ba1068 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:13.190995 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8b86967c-1249-45f0-a01c-7419a7ba1068 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:13.336950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8b86967c-1249-45f0-a01c-7419a7ba1068 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:13.345690 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8b86967c-1249-45f0-a01c-7419a7ba1068 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1390 microversion: 2.1 time: 0.169637 Aug 04 17:42:13.346498 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3276/6521] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:13 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1390 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:13.365785 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bb5ead17-8105-48c3-aff7-835786eda030 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:13.366464 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bb5ead17-8105-48c3-aff7-835786eda030 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:13.372484 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb5ead17-8105-48c3-aff7-835786eda030 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:13.372974 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb5ead17-8105-48c3-aff7-835786eda030 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:13.373416 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb5ead17-8105-48c3-aff7-835786eda030 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:13.374162 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb5ead17-8105-48c3-aff7-835786eda030 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:13.374630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb5ead17-8105-48c3-aff7-835786eda030 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:13.375069 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb5ead17-8105-48c3-aff7-835786eda030 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:13.505250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bb5ead17-8105-48c3-aff7-835786eda030 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:13.512811 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bb5ead17-8105-48c3-aff7-835786eda030 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1390 microversion: 2.1 time: 0.150947 Aug 04 17:42:13.513382 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3246/6522] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:13 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1390 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:13.590169 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-debf2db1-da20-44b4-9a51-82e9548c4aa9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:13.590769 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-debf2db1-da20-44b4-9a51-82e9548c4aa9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:13.597125 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-debf2db1-da20-44b4-9a51-82e9548c4aa9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:13.597756 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-debf2db1-da20-44b4-9a51-82e9548c4aa9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:13.598233 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-debf2db1-da20-44b4-9a51-82e9548c4aa9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:13.598947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-debf2db1-da20-44b4-9a51-82e9548c4aa9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:13.599406 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-debf2db1-da20-44b4-9a51-82e9548c4aa9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:13.599834 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-debf2db1-da20-44b4-9a51-82e9548c4aa9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:13.628167 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-debf2db1-da20-44b4-9a51-82e9548c4aa9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:42:13.703517 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-debf2db1-da20-44b4-9a51-82e9548c4aa9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "DELETE /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 204 len: 0 microversion: 2.1 time: 0.116907 Aug 04 17:42:13.704764 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3277/6523] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:42:13 2022] DELETE /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:42:13.712563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3c98d410-d478-4f15-bc92-033c56c4360f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:13.713192 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3c98d410-d478-4f15-bc92-033c56c4360f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:13.719384 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c98d410-d478-4f15-bc92-033c56c4360f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:13.719870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c98d410-d478-4f15-bc92-033c56c4360f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:13.720317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c98d410-d478-4f15-bc92-033c56c4360f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:13.721012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c98d410-d478-4f15-bc92-033c56c4360f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:13.721474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c98d410-d478-4f15-bc92-033c56c4360f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:13.721908 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c98d410-d478-4f15-bc92-033c56c4360f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:13.848708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3c98d410-d478-4f15-bc92-033c56c4360f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:13.856233 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3c98d410-d478-4f15-bc92-033c56c4360f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1396 microversion: 2.1 time: 0.147455 Aug 04 17:42:13.856807 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3247/6524] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:13 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1396 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:42:14.879432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bcfd5968-3753-48d4-8879-410440db7c62 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:14.880063 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bcfd5968-3753-48d4-8879-410440db7c62 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:14.882853 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:42:14.888156 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bcfd5968-3753-48d4-8879-410440db7c62 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:14.888655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bcfd5968-3753-48d4-8879-410440db7c62 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:14.889154 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bcfd5968-3753-48d4-8879-410440db7c62 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:14.889945 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bcfd5968-3753-48d4-8879-410440db7c62 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:14.890448 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bcfd5968-3753-48d4-8879-410440db7c62 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:14.890887 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bcfd5968-3753-48d4-8879-410440db7c62 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:14.897301 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:42:15.029435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bcfd5968-3753-48d4-8879-410440db7c62 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:15.039510 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bcfd5968-3753-48d4-8879-410440db7c62 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1396 microversion: 2.1 time: 0.164474 Aug 04 17:42:15.040515 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3278/6525] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:14 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1396 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:16.062996 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a2369e73-12c8-46c9-b29c-3d0ccc3f27e0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:16.064311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a2369e73-12c8-46c9-b29c-3d0ccc3f27e0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:16.066819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=35 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:42:16.072088 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2369e73-12c8-46c9-b29c-3d0ccc3f27e0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:16.072586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2369e73-12c8-46c9-b29c-3d0ccc3f27e0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:16.073031 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2369e73-12c8-46c9-b29c-3d0ccc3f27e0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:16.073740 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2369e73-12c8-46c9-b29c-3d0ccc3f27e0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:16.074257 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2369e73-12c8-46c9-b29c-3d0ccc3f27e0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:16.074696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2369e73-12c8-46c9-b29c-3d0ccc3f27e0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:16.077543 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=87 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:42:16.210096 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a2369e73-12c8-46c9-b29c-3d0ccc3f27e0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:16.222214 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a2369e73-12c8-46c9-b29c-3d0ccc3f27e0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1396 microversion: 2.1 time: 0.163127 Aug 04 17:42:16.233625 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3248/6526] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:16 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1396 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:16.289904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-04f9a38f-d7fb-4ac9-9532-f56d562d41d6 req-256cd6a0-d8a4-4a5c-82da-25d3ce9f19e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61364dfd-cd60-4f46-a1b9-68fb76c7118a", "name": "network-vif-deleted", "tag": "201a4dfa-0dcd-4011-90cf-6c6c771cb899"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:42:16.302802 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-04f9a38f-d7fb-4ac9-9532-f56d562d41d6 req-256cd6a0-d8a4-4a5c-82da-25d3ce9f19e8 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:16.303600 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-04f9a38f-d7fb-4ac9-9532-f56d562d41d6 req-256cd6a0-d8a4-4a5c-82da-25d3ce9f19e8 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:16.304043 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-04f9a38f-d7fb-4ac9-9532-f56d562d41d6 req-256cd6a0-d8a4-4a5c-82da-25d3ce9f19e8 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:16.318246 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-04f9a38f-d7fb-4ac9-9532-f56d562d41d6 req-256cd6a0-d8a4-4a5c-82da-25d3ce9f19e8 service nova] Creating event network-vif-deleted:201a4dfa-0dcd-4011-90cf-6c6c771cb899 for instance 61364dfd-cd60-4f46-a1b9-68fb76c7118a on n-h1-851359-3 Aug 04 17:42:16.324885 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-04f9a38f-d7fb-4ac9-9532-f56d562d41d6 req-256cd6a0-d8a4-4a5c-82da-25d3ce9f19e8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039737 Aug 04 17:42:16.325783 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3279/6527] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:42:17.244263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-78aa4a8e-eb99-425b-88b2-a78a077a2a03 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:17.244835 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-78aa4a8e-eb99-425b-88b2-a78a077a2a03 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:17.251830 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78aa4a8e-eb99-425b-88b2-a78a077a2a03 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:17.252312 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78aa4a8e-eb99-425b-88b2-a78a077a2a03 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:17.252755 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78aa4a8e-eb99-425b-88b2-a78a077a2a03 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:17.253443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78aa4a8e-eb99-425b-88b2-a78a077a2a03 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:17.253897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78aa4a8e-eb99-425b-88b2-a78a077a2a03 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:17.254352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78aa4a8e-eb99-425b-88b2-a78a077a2a03 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:17.316613 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-78aa4a8e-eb99-425b-88b2-a78a077a2a03 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:17.325233 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-78aa4a8e-eb99-425b-88b2-a78a077a2a03 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1188 microversion: 2.1 time: 0.084919 Aug 04 17:42:17.325814 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3249/6528] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:17 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1188 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:18.348276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5e13d24e-ff18-4a1a-94b0-84ff77d92a66 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:18.348987 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5e13d24e-ff18-4a1a-94b0-84ff77d92a66 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:18.355264 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5e13d24e-ff18-4a1a-94b0-84ff77d92a66 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:18.355761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5e13d24e-ff18-4a1a-94b0-84ff77d92a66 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:18.356209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5e13d24e-ff18-4a1a-94b0-84ff77d92a66 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:18.356949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5e13d24e-ff18-4a1a-94b0-84ff77d92a66 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:18.357420 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5e13d24e-ff18-4a1a-94b0-84ff77d92a66 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:18.357856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5e13d24e-ff18-4a1a-94b0-84ff77d92a66 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:18.428412 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5e13d24e-ff18-4a1a-94b0-84ff77d92a66 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:18.436099 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5e13d24e-ff18-4a1a-94b0-84ff77d92a66 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1188 microversion: 2.1 time: 0.093083 Aug 04 17:42:18.436681 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3280/6529] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:18 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1188 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:19.457498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3425e774-3335-492e-b1db-a911376ca70f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:19.458151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3425e774-3335-492e-b1db-a911376ca70f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:19.464689 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3425e774-3335-492e-b1db-a911376ca70f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:19.465182 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3425e774-3335-492e-b1db-a911376ca70f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:19.465616 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3425e774-3335-492e-b1db-a911376ca70f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:19.466335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3425e774-3335-492e-b1db-a911376ca70f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:19.466794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3425e774-3335-492e-b1db-a911376ca70f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:19.467221 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3425e774-3335-492e-b1db-a911376ca70f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:19.532429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3425e774-3335-492e-b1db-a911376ca70f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:19.540583 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3425e774-3335-492e-b1db-a911376ca70f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1188 microversion: 2.1 time: 0.087756 Aug 04 17:42:19.541179 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3250/6530] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:19 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1188 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:20.560715 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0aaec77d-c432-4bd8-8bbd-85d2c9912ae9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:20.561347 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0aaec77d-c432-4bd8-8bbd-85d2c9912ae9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:20.573290 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0aaec77d-c432-4bd8-8bbd-85d2c9912ae9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:20.573798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0aaec77d-c432-4bd8-8bbd-85d2c9912ae9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:20.574731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0aaec77d-c432-4bd8-8bbd-85d2c9912ae9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:20.575810 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0aaec77d-c432-4bd8-8bbd-85d2c9912ae9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:20.576289 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0aaec77d-c432-4bd8-8bbd-85d2c9912ae9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:20.576925 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0aaec77d-c432-4bd8-8bbd-85d2c9912ae9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:20.615481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0aaec77d-c432-4bd8-8bbd-85d2c9912ae9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:20.615879 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0aaec77d-c432-4bd8-8bbd-85d2c9912ae9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:20.616326 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0aaec77d-c432-4bd8-8bbd-85d2c9912ae9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:20.616783 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-0aaec77d-c432-4bd8-8bbd-85d2c9912ae9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lazy-loading 'fault' on Instance uuid 61364dfd-cd60-4f46-a1b9-68fb76c7118a {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:42:20.658642 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0aaec77d-c432-4bd8-8bbd-85d2c9912ae9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:20.666342 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0aaec77d-c432-4bd8-8bbd-85d2c9912ae9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 200 len: 1193 microversion: 2.1 time: 0.109528 Aug 04 17:42:20.667020 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3281/6531] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:20 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 1193 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:21.688265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-149c49ea-c6a1-4698-96cb-901f006c06f3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:21.689280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-149c49ea-c6a1-4698-96cb-901f006c06f3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:21.696188 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-149c49ea-c6a1-4698-96cb-901f006c06f3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:21.696677 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-149c49ea-c6a1-4698-96cb-901f006c06f3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:21.697123 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-149c49ea-c6a1-4698-96cb-901f006c06f3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:21.697832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-149c49ea-c6a1-4698-96cb-901f006c06f3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:21.698333 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-149c49ea-c6a1-4698-96cb-901f006c06f3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:21.698768 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-149c49ea-c6a1-4698-96cb-901f006c06f3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:21.713384 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-149c49ea-c6a1-4698-96cb-901f006c06f3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] HTTP exception thrown: Instance 61364dfd-cd60-4f46-a1b9-68fb76c7118a could not be found. Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-149c49ea-c6a1-4698-96cb-901f006c06f3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Request method failure captured: Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a HTTP/1.1 Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7ARpoisKS8ru_ZJiIrIfjIFMRjfQL-mVrLbzAzLl4Z4wH-8ksarsVn1PTK67x0ktAL2RMgNiOghxRSfCsuIPgqi5zzrjB6PtD1ptQpXCC7QBiVIYCXgsvXv7bVdD4F6QLnLsEgFyHhnUvqqIgdfnwyBZE3QOXa1h7oqCs3SSjoPFKXM Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 46f694275ec441259c366f63daa4a380 Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TestVolumeBootPattern-275420730 Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46f694275ec441259c366f63daa4a380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46f694275ec441259c366f63daa4a380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_46f694275ec441259c366f63daa4a380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/46f694275ec441259c366f63daa4a380"}]}] Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TestVolumeBootPattern-275420730 Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 46f694275ec441259c366f63daa4a380 Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestVolumeBootPattern-275420730 Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TestVolumeBootPattern-275420730-project Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 50bf6f5281964c0b81809080bcf22bdd Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TestVolumeBootPattern-275420730-project Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 61364dfd-cd60-4f46-a1b9-68fb76c7118a could not be found. Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '61364dfd-cd60-4f46-a1b9-68fb76c7118a'} Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61364dfd-cd60-4f46-a1b9-68fb76c7118a could not be found. Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61364dfd-cd60-4f46-a1b9-68fb76c7118a could not be found. Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:42:21.715066 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:42:21.720517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:42:21.720517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:42:21.720517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:42:21.720517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:42:21.720517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:42:21.720517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61364dfd-cd60-4f46-a1b9-68fb76c7118a could not be found. Aug 04 17:42:21.720517 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:42:21.720517 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-149c49ea-c6a1-4698-96cb-901f006c06f3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Returning 404 to user: Instance 61364dfd-cd60-4f46-a1b9-68fb76c7118a could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:42:21.720517 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-149c49ea-c6a1-4698-96cb-901f006c06f3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 404 len: 111 microversion: 2.1 time: 0.032392 Aug 04 17:42:21.720517 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3251/6532] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:21 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:42:23.858830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d6ea2508-af8f-4cf5-bd59-70c732cdf457 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:23.859329 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d6ea2508-af8f-4cf5-bd59-70c732cdf457 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:23.866129 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6ea2508-af8f-4cf5-bd59-70c732cdf457 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:23.866625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6ea2508-af8f-4cf5-bd59-70c732cdf457 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:23.867070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6ea2508-af8f-4cf5-bd59-70c732cdf457 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:23.867768 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6ea2508-af8f-4cf5-bd59-70c732cdf457 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:23.868234 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6ea2508-af8f-4cf5-bd59-70c732cdf457 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:23.868665 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6ea2508-af8f-4cf5-bd59-70c732cdf457 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:23.881955 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-d6ea2508-af8f-4cf5-bd59-70c732cdf457 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] HTTP exception thrown: Instance 61364dfd-cd60-4f46-a1b9-68fb76c7118a could not be found. Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d6ea2508-af8f-4cf5-bd59-70c732cdf457 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Request method failure captured: Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a HTTP/1.1 Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7ARpoisKS8ru_ZJiIrIfjIFMRjfQL-mVrLbzAzLl4Z4wH-8ksarsVn1PTK67x0ktAL2RMgNiOghxRSfCsuIPgqi5zzrjB6PtD1ptQpXCC7QBiVIYCXgsvXv7bVdD4F6QLnLsEgFyHhnUvqqIgdfnwyBZE3QOXa1h7oqCs3SSjoPFKXM Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 46f694275ec441259c366f63daa4a380 Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-TestVolumeBootPattern-275420730 Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46f694275ec441259c366f63daa4a380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46f694275ec441259c366f63daa4a380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_46f694275ec441259c366f63daa4a380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/46f694275ec441259c366f63daa4a380"}]}] Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-TestVolumeBootPattern-275420730 Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 46f694275ec441259c366f63daa4a380 Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-TestVolumeBootPattern-275420730 Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-TestVolumeBootPattern-275420730-project Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 50bf6f5281964c0b81809080bcf22bdd Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-TestVolumeBootPattern-275420730-project Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 61364dfd-cd60-4f46-a1b9-68fb76c7118a could not be found. Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '61364dfd-cd60-4f46-a1b9-68fb76c7118a'} Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61364dfd-cd60-4f46-a1b9-68fb76c7118a could not be found. Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:42:23.883643 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:42:23.891210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61364dfd-cd60-4f46-a1b9-68fb76c7118a could not be found. Aug 04 17:42:23.891210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:42:23.891210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:42:23.891210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:42:23.891210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:42:23.891210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:42:23.891210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:42:23.891210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:42:23.891210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:42:23.891210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61364dfd-cd60-4f46-a1b9-68fb76c7118a could not be found. Aug 04 17:42:23.891210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:42:23.891210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d6ea2508-af8f-4cf5-bd59-70c732cdf457 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Returning 404 to user: Instance 61364dfd-cd60-4f46-a1b9-68fb76c7118a could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:42:23.891210 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d6ea2508-af8f-4cf5-bd59-70c732cdf457 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "DELETE /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 404 len: 111 microversion: 2.1 time: 0.030402 Aug 04 17:42:23.891210 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3282/6533] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:42:23 2022] DELETE /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:42:23.893657 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4e0681cf-d296-4615-9abe-842acfb563c0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:23.894309 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4e0681cf-d296-4615-9abe-842acfb563c0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 61364dfd-cd60-4f46-a1b9-68fb76c7118a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:23.900773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e0681cf-d296-4615-9abe-842acfb563c0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:23.901257 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e0681cf-d296-4615-9abe-842acfb563c0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:23.901696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e0681cf-d296-4615-9abe-842acfb563c0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:23.902417 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e0681cf-d296-4615-9abe-842acfb563c0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:23.902871 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e0681cf-d296-4615-9abe-842acfb563c0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:23.903318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e0681cf-d296-4615-9abe-842acfb563c0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:23.917900 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-4e0681cf-d296-4615-9abe-842acfb563c0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] HTTP exception thrown: Instance 61364dfd-cd60-4f46-a1b9-68fb76c7118a could not be found. Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4e0681cf-d296-4615-9abe-842acfb563c0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Request method failure captured: Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a HTTP/1.1 Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7ARpoisKS8ru_ZJiIrIfjIFMRjfQL-mVrLbzAzLl4Z4wH-8ksarsVn1PTK67x0ktAL2RMgNiOghxRSfCsuIPgqi5zzrjB6PtD1ptQpXCC7QBiVIYCXgsvXv7bVdD4F6QLnLsEgFyHhnUvqqIgdfnwyBZE3QOXa1h7oqCs3SSjoPFKXM Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 46f694275ec441259c366f63daa4a380 Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TestVolumeBootPattern-275420730 Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46f694275ec441259c366f63daa4a380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46f694275ec441259c366f63daa4a380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_46f694275ec441259c366f63daa4a380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/46f694275ec441259c366f63daa4a380"}]}] Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TestVolumeBootPattern-275420730 Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 46f694275ec441259c366f63daa4a380 Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestVolumeBootPattern-275420730 Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TestVolumeBootPattern-275420730-project Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 50bf6f5281964c0b81809080bcf22bdd Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TestVolumeBootPattern-275420730-project Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 61364dfd-cd60-4f46-a1b9-68fb76c7118a could not be found. Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '61364dfd-cd60-4f46-a1b9-68fb76c7118a'} Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61364dfd-cd60-4f46-a1b9-68fb76c7118a could not be found. Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61364dfd-cd60-4f46-a1b9-68fb76c7118a could not be found. Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:42:23.919459 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:42:23.925472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:42:23.925472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:42:23.925472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:42:23.925472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:42:23.925472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:42:23.925472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61364dfd-cd60-4f46-a1b9-68fb76c7118a could not be found. Aug 04 17:42:23.925472 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:42:23.925472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4e0681cf-d296-4615-9abe-842acfb563c0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Returning 404 to user: Instance 61364dfd-cd60-4f46-a1b9-68fb76c7118a could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:42:23.925472 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4e0681cf-d296-4615-9abe-842acfb563c0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a" status: 404 len: 111 microversion: 2.1 time: 0.031552 Aug 04 17:42:23.925472 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3252/6534] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:23 2022] GET /compute/v2.1/servers/61364dfd-cd60-4f46-a1b9-68fb76c7118a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:42:43.113450 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:42:43.114406 n-d-851359-3 devstack@n-api.service[131043]: Thu Aug 4 17:42:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 17:42:43.573687 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d0775b42-664c-4021-870b-6484fbe9f452 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1837759607", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "a93861f0-0a79-41a8-bd78-94adc4d64c7c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "6002cd39-a33b-430d-a6d2-0ecfe13cd1ee"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:42:43.585659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=11 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:42:43.586324 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=23 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:42:43.638415 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-d0775b42-664c-4021-870b-6484fbe9f452 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] validate_networks() for [('6002cd39-a33b-430d-a6d2-0ecfe13cd1ee', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:42:44.009320 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-d0775b42-664c-4021-870b-6484fbe9f452 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:42:44.009754 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-d0775b42-664c-4021-870b-6484fbe9f452 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:42:44.010280 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-d0775b42-664c-4021-870b-6484fbe9f452 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:42:44.010698 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-d0775b42-664c-4021-870b-6484fbe9f452 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:42:44.011115 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-d0775b42-664c-4021-870b-6484fbe9f452 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:42:44.019931 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d0775b42-664c-4021-870b-6484fbe9f452 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:44.020420 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d0775b42-664c-4021-870b-6484fbe9f452 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:44.020866 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d0775b42-664c-4021-870b-6484fbe9f452 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:44.021606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d0775b42-664c-4021-870b-6484fbe9f452 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:44.022100 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d0775b42-664c-4021-870b-6484fbe9f452 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:44.022536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d0775b42-664c-4021-870b-6484fbe9f452 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:44.039428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-d0775b42-664c-4021-870b-6484fbe9f452 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Getting quotas for project 46f694275ec441259c366f63daa4a380. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:42:44.044534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-d0775b42-664c-4021-870b-6484fbe9f452 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Getting quotas for user 50bf6f5281964c0b81809080bcf22bdd and project 46f694275ec441259c366f63daa4a380. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:42:44.107679 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d0775b42-664c-4021-870b-6484fbe9f452 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:42:44.109751 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d0775b42-664c-4021-870b-6484fbe9f452 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 08382e6c-e2ba-4bad-9065-d213856aeda8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a93861f0-0a79-41a8-bd78-94adc4d64c7c',volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:42:44.249029 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d0775b42-664c-4021-870b-6484fbe9f452 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.679280 Aug 04 17:42:44.257428 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3283/6535] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:42:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:42:44.269787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2b3a57fe-018e-4d04-9830-f1d696405d71 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:44.270418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2b3a57fe-018e-4d04-9830-f1d696405d71 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 08382e6c-e2ba-4bad-9065-d213856aeda8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:44.273312 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=9 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:42:44.274312 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=21 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:42:44.338639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2b3a57fe-018e-4d04-9830-f1d696405d71 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:44.345345 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2b3a57fe-018e-4d04-9830-f1d696405d71 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8" status: 200 len: 1071 microversion: 2.1 time: 0.079885 Aug 04 17:42:44.345910 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3253/6536] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:44 2022] GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8 => generated 1071 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:45.368111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6338cd27-8f70-4601-8d68-be194869a660 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:45.369410 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6338cd27-8f70-4601-8d68-be194869a660 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 08382e6c-e2ba-4bad-9065-d213856aeda8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:45.376562 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6338cd27-8f70-4601-8d68-be194869a660 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:45.377187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6338cd27-8f70-4601-8d68-be194869a660 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:45.377644 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6338cd27-8f70-4601-8d68-be194869a660 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:45.378397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6338cd27-8f70-4601-8d68-be194869a660 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:45.378866 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6338cd27-8f70-4601-8d68-be194869a660 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:45.379309 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6338cd27-8f70-4601-8d68-be194869a660 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:45.456755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6338cd27-8f70-4601-8d68-be194869a660 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:45.466945 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6338cd27-8f70-4601-8d68-be194869a660 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8" status: 200 len: 1187 microversion: 2.1 time: 0.103796 Aug 04 17:42:45.480913 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3284/6537] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:45 2022] GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8 => generated 1187 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:46.490703 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c6c35f25-1b05-4c63-afa2-106bf019a3f6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:46.491573 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c6c35f25-1b05-4c63-afa2-106bf019a3f6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 08382e6c-e2ba-4bad-9065-d213856aeda8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:46.498505 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6c35f25-1b05-4c63-afa2-106bf019a3f6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:46.499123 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6c35f25-1b05-4c63-afa2-106bf019a3f6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:46.499668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6c35f25-1b05-4c63-afa2-106bf019a3f6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:46.500835 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6c35f25-1b05-4c63-afa2-106bf019a3f6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:46.501343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6c35f25-1b05-4c63-afa2-106bf019a3f6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:46.501966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6c35f25-1b05-4c63-afa2-106bf019a3f6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:46.645653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c6c35f25-1b05-4c63-afa2-106bf019a3f6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:46.656654 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c6c35f25-1b05-4c63-afa2-106bf019a3f6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8" status: 200 len: 1229 microversion: 2.1 time: 0.170665 Aug 04 17:42:46.657319 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3254/6538] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:46 2022] GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8 => generated 1229 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:46.669364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-582ce2b7-da1b-44ec-884f-eb3cd35944b0 req-1d7dfce9-c725-4be6-b150-b0583db33c13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08382e6c-e2ba-4bad-9065-d213856aeda8", "tag": "b40fb3e4-6ff1-4b0a-9228-fc3b95991c87"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:42:46.686297 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-582ce2b7-da1b-44ec-884f-eb3cd35944b0 req-1d7dfce9-c725-4be6-b150-b0583db33c13 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:46.686959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-582ce2b7-da1b-44ec-884f-eb3cd35944b0 req-1d7dfce9-c725-4be6-b150-b0583db33c13 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:46.687405 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-582ce2b7-da1b-44ec-884f-eb3cd35944b0 req-1d7dfce9-c725-4be6-b150-b0583db33c13 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:46.702263 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-582ce2b7-da1b-44ec-884f-eb3cd35944b0 req-1d7dfce9-c725-4be6-b150-b0583db33c13 service nova] Creating event network-changed:b40fb3e4-6ff1-4b0a-9228-fc3b95991c87 for instance 08382e6c-e2ba-4bad-9065-d213856aeda8 on n-h1-851359-3 Aug 04 17:42:46.713332 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-582ce2b7-da1b-44ec-884f-eb3cd35944b0 req-1d7dfce9-c725-4be6-b150-b0583db33c13 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048569 Aug 04 17:42:46.714296 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3285/6539] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:42:47.684063 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5eff901f-6d98-4835-aefd-d99bd403ebda tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:47.684697 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5eff901f-6d98-4835-aefd-d99bd403ebda tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 08382e6c-e2ba-4bad-9065-d213856aeda8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:47.693010 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5eff901f-6d98-4835-aefd-d99bd403ebda tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:47.693426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5eff901f-6d98-4835-aefd-d99bd403ebda tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:47.693868 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5eff901f-6d98-4835-aefd-d99bd403ebda tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:47.694619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5eff901f-6d98-4835-aefd-d99bd403ebda tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:47.695086 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5eff901f-6d98-4835-aefd-d99bd403ebda tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:47.695528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5eff901f-6d98-4835-aefd-d99bd403ebda tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:47.847676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5eff901f-6d98-4835-aefd-d99bd403ebda tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:47.856348 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5eff901f-6d98-4835-aefd-d99bd403ebda tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8" status: 200 len: 1229 microversion: 2.1 time: 0.176333 Aug 04 17:42:47.856942 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3255/6540] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:47 2022] GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8 => generated 1229 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:42:48.878194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-831bde95-676b-416e-8ab6-be9356590336 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:48.878837 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-831bde95-676b-416e-8ab6-be9356590336 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 08382e6c-e2ba-4bad-9065-d213856aeda8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:48.885955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-831bde95-676b-416e-8ab6-be9356590336 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:48.886423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-831bde95-676b-416e-8ab6-be9356590336 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:48.886863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-831bde95-676b-416e-8ab6-be9356590336 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:48.887559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-831bde95-676b-416e-8ab6-be9356590336 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:48.888017 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-831bde95-676b-416e-8ab6-be9356590336 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:48.888445 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-831bde95-676b-416e-8ab6-be9356590336 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:49.025714 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-831bde95-676b-416e-8ab6-be9356590336 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:49.033454 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-831bde95-676b-416e-8ab6-be9356590336 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8" status: 200 len: 1229 microversion: 2.1 time: 0.160275 Aug 04 17:42:49.034079 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3286/6541] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:48 2022] GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8 => generated 1229 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:50.055062 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c974c1df-0c1d-4bcc-8fcd-94933a8cdf92 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:50.055718 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c974c1df-0c1d-4bcc-8fcd-94933a8cdf92 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 08382e6c-e2ba-4bad-9065-d213856aeda8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:50.062574 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c974c1df-0c1d-4bcc-8fcd-94933a8cdf92 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:50.063145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c974c1df-0c1d-4bcc-8fcd-94933a8cdf92 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:50.063645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c974c1df-0c1d-4bcc-8fcd-94933a8cdf92 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:50.064428 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c974c1df-0c1d-4bcc-8fcd-94933a8cdf92 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:50.065422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c974c1df-0c1d-4bcc-8fcd-94933a8cdf92 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:50.065877 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c974c1df-0c1d-4bcc-8fcd-94933a8cdf92 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:50.202844 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c974c1df-0c1d-4bcc-8fcd-94933a8cdf92 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:50.211627 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c974c1df-0c1d-4bcc-8fcd-94933a8cdf92 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8" status: 200 len: 1229 microversion: 2.1 time: 0.160663 Aug 04 17:42:50.212207 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3256/6542] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:50 2022] GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8 => generated 1229 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:51.232886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c2ebff7b-b40e-43c7-82b8-66b05650ad82 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:51.233559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c2ebff7b-b40e-43c7-82b8-66b05650ad82 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 08382e6c-e2ba-4bad-9065-d213856aeda8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:51.240653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2ebff7b-b40e-43c7-82b8-66b05650ad82 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:51.241156 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2ebff7b-b40e-43c7-82b8-66b05650ad82 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:51.241614 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2ebff7b-b40e-43c7-82b8-66b05650ad82 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:51.242359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2ebff7b-b40e-43c7-82b8-66b05650ad82 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:51.242828 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2ebff7b-b40e-43c7-82b8-66b05650ad82 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:51.243266 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c2ebff7b-b40e-43c7-82b8-66b05650ad82 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:51.388356 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c2ebff7b-b40e-43c7-82b8-66b05650ad82 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:51.396329 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c2ebff7b-b40e-43c7-82b8-66b05650ad82 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8" status: 200 len: 1217 microversion: 2.1 time: 0.167938 Aug 04 17:42:51.396908 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3287/6543] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:51 2022] GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8 => generated 1217 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:52.417639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-365c8178-3ed2-4583-ada0-247aea378a58 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:52.418280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-365c8178-3ed2-4583-ada0-247aea378a58 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 08382e6c-e2ba-4bad-9065-d213856aeda8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:52.425000 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-365c8178-3ed2-4583-ada0-247aea378a58 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:52.425494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-365c8178-3ed2-4583-ada0-247aea378a58 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:52.425936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-365c8178-3ed2-4583-ada0-247aea378a58 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:52.426685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-365c8178-3ed2-4583-ada0-247aea378a58 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:52.427145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-365c8178-3ed2-4583-ada0-247aea378a58 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:52.427574 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-365c8178-3ed2-4583-ada0-247aea378a58 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:52.556160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-365c8178-3ed2-4583-ada0-247aea378a58 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:52.563669 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-365c8178-3ed2-4583-ada0-247aea378a58 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8" status: 200 len: 1217 microversion: 2.1 time: 0.150009 Aug 04 17:42:52.564235 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3257/6544] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:52 2022] GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8 => generated 1217 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:53.584635 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-116c0957-4c0e-450e-a1e6-ca9b1da0f477 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:53.585251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-116c0957-4c0e-450e-a1e6-ca9b1da0f477 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 08382e6c-e2ba-4bad-9065-d213856aeda8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:53.591667 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-116c0957-4c0e-450e-a1e6-ca9b1da0f477 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:53.592162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-116c0957-4c0e-450e-a1e6-ca9b1da0f477 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:53.592605 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-116c0957-4c0e-450e-a1e6-ca9b1da0f477 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:53.593305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-116c0957-4c0e-450e-a1e6-ca9b1da0f477 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:53.593780 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-116c0957-4c0e-450e-a1e6-ca9b1da0f477 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:53.594228 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-116c0957-4c0e-450e-a1e6-ca9b1da0f477 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:53.729514 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-116c0957-4c0e-450e-a1e6-ca9b1da0f477 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:53.738098 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-116c0957-4c0e-450e-a1e6-ca9b1da0f477 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8" status: 200 len: 1217 microversion: 2.1 time: 0.157610 Aug 04 17:42:53.738670 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3288/6545] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:53 2022] GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8 => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:42:54.759691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2eee8042-5d9d-44b7-94ea-481345af46a1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:54.760317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2eee8042-5d9d-44b7-94ea-481345af46a1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 08382e6c-e2ba-4bad-9065-d213856aeda8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:54.763110 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:42:54.769481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2eee8042-5d9d-44b7-94ea-481345af46a1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:54.769999 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2eee8042-5d9d-44b7-94ea-481345af46a1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:54.770453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2eee8042-5d9d-44b7-94ea-481345af46a1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:54.771154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2eee8042-5d9d-44b7-94ea-481345af46a1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:54.771621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2eee8042-5d9d-44b7-94ea-481345af46a1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:54.772054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2eee8042-5d9d-44b7-94ea-481345af46a1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:54.910090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2eee8042-5d9d-44b7-94ea-481345af46a1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:54.918232 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2eee8042-5d9d-44b7-94ea-481345af46a1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8" status: 200 len: 1217 microversion: 2.1 time: 0.162486 Aug 04 17:42:54.918810 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3258/6546] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:54 2022] GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8 => generated 1217 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:55.939012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2ffa26e5-5480-4828-88c6-c822d54bb63b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:55.939587 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2ffa26e5-5480-4828-88c6-c822d54bb63b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 08382e6c-e2ba-4bad-9065-d213856aeda8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:55.942257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:42:55.943052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:42:55.950086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ffa26e5-5480-4828-88c6-c822d54bb63b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:55.950588 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ffa26e5-5480-4828-88c6-c822d54bb63b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:55.951036 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ffa26e5-5480-4828-88c6-c822d54bb63b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:55.951748 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ffa26e5-5480-4828-88c6-c822d54bb63b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:55.952216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ffa26e5-5480-4828-88c6-c822d54bb63b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:55.952686 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ffa26e5-5480-4828-88c6-c822d54bb63b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:56.087860 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2ffa26e5-5480-4828-88c6-c822d54bb63b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:56.102734 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2ffa26e5-5480-4828-88c6-c822d54bb63b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8" status: 200 len: 1217 microversion: 2.1 time: 0.167202 Aug 04 17:42:56.104002 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3289/6547] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:55 2022] GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8 => generated 1217 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:57.125320 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-774627fa-ce23-47b1-82e2-099bf088e1fc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:57.125928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-774627fa-ce23-47b1-82e2-099bf088e1fc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 08382e6c-e2ba-4bad-9065-d213856aeda8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:57.132992 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-774627fa-ce23-47b1-82e2-099bf088e1fc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:57.133485 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-774627fa-ce23-47b1-82e2-099bf088e1fc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:57.133930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-774627fa-ce23-47b1-82e2-099bf088e1fc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:57.134663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-774627fa-ce23-47b1-82e2-099bf088e1fc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:57.135126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-774627fa-ce23-47b1-82e2-099bf088e1fc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:57.135558 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-774627fa-ce23-47b1-82e2-099bf088e1fc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:57.279792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-774627fa-ce23-47b1-82e2-099bf088e1fc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:57.288185 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-774627fa-ce23-47b1-82e2-099bf088e1fc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8" status: 200 len: 1217 microversion: 2.1 time: 0.166784 Aug 04 17:42:57.288767 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3259/6548] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:57 2022] GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8 => generated 1217 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:58.309142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-68f20466-cbab-4660-909d-abf6c4ea3b37 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:58.309706 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-68f20466-cbab-4660-909d-abf6c4ea3b37 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 08382e6c-e2ba-4bad-9065-d213856aeda8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:58.316550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-68f20466-cbab-4660-909d-abf6c4ea3b37 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:58.317048 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-68f20466-cbab-4660-909d-abf6c4ea3b37 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:58.317497 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-68f20466-cbab-4660-909d-abf6c4ea3b37 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:58.318229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-68f20466-cbab-4660-909d-abf6c4ea3b37 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:58.318700 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-68f20466-cbab-4660-909d-abf6c4ea3b37 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:58.319136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-68f20466-cbab-4660-909d-abf6c4ea3b37 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:58.454945 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-68f20466-cbab-4660-909d-abf6c4ea3b37 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:58.463582 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-68f20466-cbab-4660-909d-abf6c4ea3b37 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8" status: 200 len: 1217 microversion: 2.1 time: 0.158405 Aug 04 17:42:58.464184 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3290/6549] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:58 2022] GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8 => generated 1217 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:42:59.325556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-8b3ad3fc-089e-4a81-bdbe-6a20198e057b req-53c07d7d-8af0-4bd8-a088-d67f79e4a42d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08382e6c-e2ba-4bad-9065-d213856aeda8", "name": "network-vif-plugged", "status": "completed", "tag": "b40fb3e4-6ff1-4b0a-9228-fc3b95991c87"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:42:59.348662 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8b3ad3fc-089e-4a81-bdbe-6a20198e057b req-53c07d7d-8af0-4bd8-a088-d67f79e4a42d service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:59.349504 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8b3ad3fc-089e-4a81-bdbe-6a20198e057b req-53c07d7d-8af0-4bd8-a088-d67f79e4a42d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:59.350393 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8b3ad3fc-089e-4a81-bdbe-6a20198e057b req-53c07d7d-8af0-4bd8-a088-d67f79e4a42d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:59.365893 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-8b3ad3fc-089e-4a81-bdbe-6a20198e057b req-53c07d7d-8af0-4bd8-a088-d67f79e4a42d service nova] Creating event network-vif-plugged:b40fb3e4-6ff1-4b0a-9228-fc3b95991c87 for instance 08382e6c-e2ba-4bad-9065-d213856aeda8 on n-h1-851359-3 Aug 04 17:42:59.371847 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-8b3ad3fc-089e-4a81-bdbe-6a20198e057b req-53c07d7d-8af0-4bd8-a088-d67f79e4a42d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052713 Aug 04 17:42:59.372982 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3260/6550] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:42:59.484527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7cac0d20-f3bd-41e1-83c6-013951c485de tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:42:59.485098 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7cac0d20-f3bd-41e1-83c6-013951c485de tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 08382e6c-e2ba-4bad-9065-d213856aeda8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:42:59.492739 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7cac0d20-f3bd-41e1-83c6-013951c485de tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:59.494561 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7cac0d20-f3bd-41e1-83c6-013951c485de tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:59.495027 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7cac0d20-f3bd-41e1-83c6-013951c485de tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:59.495753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7cac0d20-f3bd-41e1-83c6-013951c485de tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:42:59.496220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7cac0d20-f3bd-41e1-83c6-013951c485de tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:42:59.496651 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7cac0d20-f3bd-41e1-83c6-013951c485de tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:42:59.638285 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7cac0d20-f3bd-41e1-83c6-013951c485de tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:42:59.646090 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7cac0d20-f3bd-41e1-83c6-013951c485de tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8" status: 200 len: 1217 microversion: 2.1 time: 0.165599 Aug 04 17:42:59.646658 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3291/6551] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:42:59 2022] GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8 => generated 1217 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:00.668945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dd599b96-e1ee-4632-b373-c5220322cd75 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:00.669728 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dd599b96-e1ee-4632-b373-c5220322cd75 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 08382e6c-e2ba-4bad-9065-d213856aeda8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:00.676176 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd599b96-e1ee-4632-b373-c5220322cd75 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:00.676674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd599b96-e1ee-4632-b373-c5220322cd75 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:00.677119 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd599b96-e1ee-4632-b373-c5220322cd75 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:00.677816 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd599b96-e1ee-4632-b373-c5220322cd75 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:00.678306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd599b96-e1ee-4632-b373-c5220322cd75 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:00.678740 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd599b96-e1ee-4632-b373-c5220322cd75 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:00.809226 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dd599b96-e1ee-4632-b373-c5220322cd75 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:00.817247 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dd599b96-e1ee-4632-b373-c5220322cd75 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8" status: 200 len: 1403 microversion: 2.1 time: 0.153865 Aug 04 17:43:00.817806 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3261/6552] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:00 2022] GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8 => generated 1403 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:00.837272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a941a81d-b35a-438f-ab74-c2df4dccb135 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:00.837866 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a941a81d-b35a-438f-ab74-c2df4dccb135 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 08382e6c-e2ba-4bad-9065-d213856aeda8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:00.844698 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a941a81d-b35a-438f-ab74-c2df4dccb135 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:00.845221 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a941a81d-b35a-438f-ab74-c2df4dccb135 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:00.845669 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a941a81d-b35a-438f-ab74-c2df4dccb135 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:00.846407 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a941a81d-b35a-438f-ab74-c2df4dccb135 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:00.846872 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a941a81d-b35a-438f-ab74-c2df4dccb135 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:00.847306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a941a81d-b35a-438f-ab74-c2df4dccb135 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:00.973887 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a941a81d-b35a-438f-ab74-c2df4dccb135 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:00.981573 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a941a81d-b35a-438f-ab74-c2df4dccb135 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8" status: 200 len: 1403 microversion: 2.1 time: 0.148225 Aug 04 17:43:00.982246 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3292/6553] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:00 2022] GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8 => generated 1403 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:01.003359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2ca9c81c-a01b-4a01-842b-654ae8d62e24 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-2077974060"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:43:01.005745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2ca9c81c-a01b-4a01-842b-654ae8d62e24 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 08382e6c-e2ba-4bad-9065-d213856aeda8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:01.011677 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ca9c81c-a01b-4a01-842b-654ae8d62e24 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:01.012170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ca9c81c-a01b-4a01-842b-654ae8d62e24 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:01.012615 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ca9c81c-a01b-4a01-842b-654ae8d62e24 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:01.013316 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ca9c81c-a01b-4a01-842b-654ae8d62e24 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:01.013779 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ca9c81c-a01b-4a01-842b-654ae8d62e24 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:01.014246 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ca9c81c-a01b-4a01-842b-654ae8d62e24 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:01.105607 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.compute.api [None req-2ca9c81c-a01b-4a01-842b-654ae8d62e24 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 08382e6c-e2ba-4bad-9065-d213856aeda8] Attempting to quiesce instance before volume snapshot. Aug 04 17:43:01.186371 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.compute.api [None req-2ca9c81c-a01b-4a01-842b-654ae8d62e24 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 08382e6c-e2ba-4bad-9065-d213856aeda8] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 04 17:43:01.255941 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2ca9c81c-a01b-4a01-842b-654ae8d62e24 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 08382e6c-e2ba-4bad-9065-d213856aeda8] Creating snapshot from volume a93861f0-0a79-41a8-bd78-94adc4d64c7c. {{(pid=131044) snapshot_instance /opt/stack/nova/nova/compute/api.py:3456}} Aug 04 17:43:02.078326 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2ca9c81c-a01b-4a01-842b-654ae8d62e24 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "POST /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8/action" status: 202 len: 0 microversion: 2.1 time: 1.079543 Aug 04 17:43:02.084818 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3262/6554] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:43:00 2022] POST /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8/action => generated 0 bytes in 1081 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 04 17:43:03.241922 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d3467fba-8ad9-420c-839e-9c852e535044 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1134852428", "imageRef": "8519bce1-fb1b-4ab7-842f-4afc67272135", "flavorRef": "452", "networks": [{"uuid": "6002cd39-a33b-430d-a6d2-0ecfe13cd1ee"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:43:03.296887 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-d3467fba-8ad9-420c-839e-9c852e535044 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] validate_networks() for [('6002cd39-a33b-430d-a6d2-0ecfe13cd1ee', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:43:03.675714 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-d3467fba-8ad9-420c-839e-9c852e535044 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:43:03.676069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-d3467fba-8ad9-420c-839e-9c852e535044 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:43:03.676550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-d3467fba-8ad9-420c-839e-9c852e535044 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:43:03.676966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-d3467fba-8ad9-420c-839e-9c852e535044 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:43:03.677387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-d3467fba-8ad9-420c-839e-9c852e535044 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:43:03.686231 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3467fba-8ad9-420c-839e-9c852e535044 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:03.686724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3467fba-8ad9-420c-839e-9c852e535044 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:03.687170 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3467fba-8ad9-420c-839e-9c852e535044 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:03.687912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3467fba-8ad9-420c-839e-9c852e535044 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:03.688375 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3467fba-8ad9-420c-839e-9c852e535044 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:03.688811 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3467fba-8ad9-420c-839e-9c852e535044 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:03.706357 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-d3467fba-8ad9-420c-839e-9c852e535044 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Getting quotas for project 46f694275ec441259c366f63daa4a380. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:43:03.711852 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-d3467fba-8ad9-420c-839e-9c852e535044 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Getting quotas for user 50bf6f5281964c0b81809080bcf22bdd and project 46f694275ec441259c366f63daa4a380. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:43:03.723978 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d3467fba-8ad9-420c-839e-9c852e535044 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:43:03.726491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d3467fba-8ad9-420c-839e-9c852e535044 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='5ce0190e-f38d-4cbe-acdf-9c0c717000a5',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:43:03.800406 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d3467fba-8ad9-420c-839e-9c852e535044 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.562322 Aug 04 17:43:03.801099 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3293/6555] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:43:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:43:03.813328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4d4552a7-7ce0-46a5-b7df-991ecd476725 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:03.814084 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4d4552a7-7ce0-46a5-b7df-991ecd476725 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:03.874266 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4d4552a7-7ce0-46a5-b7df-991ecd476725 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:03.884682 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4d4552a7-7ce0-46a5-b7df-991ecd476725 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 200 len: 1230 microversion: 2.1 time: 0.076363 Aug 04 17:43:03.885250 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3263/6556] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:03 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 1230 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:04.907792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4e6c09d3-b85b-487c-8fe6-4c8ae4c7726f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:04.908400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4e6c09d3-b85b-487c-8fe6-4c8ae4c7726f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:04.917369 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e6c09d3-b85b-487c-8fe6-4c8ae4c7726f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:04.918399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e6c09d3-b85b-487c-8fe6-4c8ae4c7726f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:04.918885 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e6c09d3-b85b-487c-8fe6-4c8ae4c7726f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:04.919583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e6c09d3-b85b-487c-8fe6-4c8ae4c7726f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:04.920046 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e6c09d3-b85b-487c-8fe6-4c8ae4c7726f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:04.920477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e6c09d3-b85b-487c-8fe6-4c8ae4c7726f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:04.988703 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4e6c09d3-b85b-487c-8fe6-4c8ae4c7726f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:04.996951 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4e6c09d3-b85b-487c-8fe6-4c8ae4c7726f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 200 len: 1290 microversion: 2.1 time: 0.095386 Aug 04 17:43:04.997758 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3294/6557] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:04 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 1290 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:06.019205 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5baeb54a-a0b7-4ab5-b8ee-200494bc74b6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:06.020139 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5baeb54a-a0b7-4ab5-b8ee-200494bc74b6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:06.027604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5baeb54a-a0b7-4ab5-b8ee-200494bc74b6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:06.028259 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5baeb54a-a0b7-4ab5-b8ee-200494bc74b6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:06.028815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5baeb54a-a0b7-4ab5-b8ee-200494bc74b6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:06.029922 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5baeb54a-a0b7-4ab5-b8ee-200494bc74b6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:06.030723 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5baeb54a-a0b7-4ab5-b8ee-200494bc74b6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:06.031233 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5baeb54a-a0b7-4ab5-b8ee-200494bc74b6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:06.211045 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5baeb54a-a0b7-4ab5-b8ee-200494bc74b6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:06.228298 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5baeb54a-a0b7-4ab5-b8ee-200494bc74b6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 200 len: 1342 microversion: 2.1 time: 0.213818 Aug 04 17:43:06.229154 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3264/6558] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:06 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 1342 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:06.348421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-f615d4d0-46ca-44ab-a893-94e3f89c46c3 req-574c48b5-b946-4140-80fb-6654cb8e7b77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4526b9be-3e4d-4ba1-b6d1-16a6131ae63a", "tag": "bdca1d75-2630-44de-a6b9-994db70a42ca"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:43:06.360633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f615d4d0-46ca-44ab-a893-94e3f89c46c3 req-574c48b5-b946-4140-80fb-6654cb8e7b77 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:06.361429 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f615d4d0-46ca-44ab-a893-94e3f89c46c3 req-574c48b5-b946-4140-80fb-6654cb8e7b77 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:06.362300 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f615d4d0-46ca-44ab-a893-94e3f89c46c3 req-574c48b5-b946-4140-80fb-6654cb8e7b77 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:06.377178 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-f615d4d0-46ca-44ab-a893-94e3f89c46c3 req-574c48b5-b946-4140-80fb-6654cb8e7b77 service nova] Creating event network-changed:bdca1d75-2630-44de-a6b9-994db70a42ca for instance 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a on n-h2-851359-3 Aug 04 17:43:06.384197 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-f615d4d0-46ca-44ab-a893-94e3f89c46c3 req-574c48b5-b946-4140-80fb-6654cb8e7b77 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040559 Aug 04 17:43:06.384336 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3295/6559] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:43:07.252970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-25004759-841f-4b90-afe5-fb2a0278c617 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:07.254374 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-25004759-841f-4b90-afe5-fb2a0278c617 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:07.262257 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25004759-841f-4b90-afe5-fb2a0278c617 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:07.262774 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25004759-841f-4b90-afe5-fb2a0278c617 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:07.263231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25004759-841f-4b90-afe5-fb2a0278c617 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:07.263977 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25004759-841f-4b90-afe5-fb2a0278c617 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:07.264446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25004759-841f-4b90-afe5-fb2a0278c617 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:07.264891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25004759-841f-4b90-afe5-fb2a0278c617 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:07.409432 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-25004759-841f-4b90-afe5-fb2a0278c617 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:07.417054 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-25004759-841f-4b90-afe5-fb2a0278c617 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 200 len: 1342 microversion: 2.1 time: 0.168246 Aug 04 17:43:07.417621 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3265/6560] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:07 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 1342 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:08.440922 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-46eeb2aa-4451-4abf-a1dc-bb915d8a2dba tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:08.441637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-46eeb2aa-4451-4abf-a1dc-bb915d8a2dba tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:08.447858 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-46eeb2aa-4451-4abf-a1dc-bb915d8a2dba tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:08.448353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-46eeb2aa-4451-4abf-a1dc-bb915d8a2dba tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:08.448820 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-46eeb2aa-4451-4abf-a1dc-bb915d8a2dba tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:08.449520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-46eeb2aa-4451-4abf-a1dc-bb915d8a2dba tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:08.450007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-46eeb2aa-4451-4abf-a1dc-bb915d8a2dba tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:08.450441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-46eeb2aa-4451-4abf-a1dc-bb915d8a2dba tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:08.613059 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-46eeb2aa-4451-4abf-a1dc-bb915d8a2dba tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:08.632013 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-46eeb2aa-4451-4abf-a1dc-bb915d8a2dba tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 200 len: 1342 microversion: 2.1 time: 0.196871 Aug 04 17:43:08.632685 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3296/6561] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:08 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 1342 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:09.657886 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4e5d0e39-9921-4e1a-93ad-314068d1a4ae tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:09.658667 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4e5d0e39-9921-4e1a-93ad-314068d1a4ae tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:09.667026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e5d0e39-9921-4e1a-93ad-314068d1a4ae tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:09.667871 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e5d0e39-9921-4e1a-93ad-314068d1a4ae tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:09.668347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e5d0e39-9921-4e1a-93ad-314068d1a4ae tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:09.669085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e5d0e39-9921-4e1a-93ad-314068d1a4ae tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:09.669572 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e5d0e39-9921-4e1a-93ad-314068d1a4ae tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:09.670227 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e5d0e39-9921-4e1a-93ad-314068d1a4ae tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:09.878463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4e5d0e39-9921-4e1a-93ad-314068d1a4ae tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:09.890765 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4e5d0e39-9921-4e1a-93ad-314068d1a4ae tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 200 len: 1342 microversion: 2.1 time: 0.237724 Aug 04 17:43:09.892273 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3266/6562] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:09 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 1342 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:10.918361 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0d6d69c0-31d5-403c-9fd3-27aca0ca4f4e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:10.919039 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0d6d69c0-31d5-403c-9fd3-27aca0ca4f4e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:10.927889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d6d69c0-31d5-403c-9fd3-27aca0ca4f4e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:10.928638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d6d69c0-31d5-403c-9fd3-27aca0ca4f4e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:10.929317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d6d69c0-31d5-403c-9fd3-27aca0ca4f4e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:10.930072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d6d69c0-31d5-403c-9fd3-27aca0ca4f4e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:10.930792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d6d69c0-31d5-403c-9fd3-27aca0ca4f4e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:10.931427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d6d69c0-31d5-403c-9fd3-27aca0ca4f4e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:11.089294 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0d6d69c0-31d5-403c-9fd3-27aca0ca4f4e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:11.098815 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0d6d69c0-31d5-403c-9fd3-27aca0ca4f4e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 200 len: 1342 microversion: 2.1 time: 0.185987 Aug 04 17:43:11.115796 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3297/6563] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:10 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 1342 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:12.121085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-84bd86e9-61a5-4ef2-a8c5-bfd954330f7e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:12.121734 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-84bd86e9-61a5-4ef2-a8c5-bfd954330f7e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:12.129739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84bd86e9-61a5-4ef2-a8c5-bfd954330f7e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:12.130276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84bd86e9-61a5-4ef2-a8c5-bfd954330f7e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:12.130727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84bd86e9-61a5-4ef2-a8c5-bfd954330f7e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:12.131499 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84bd86e9-61a5-4ef2-a8c5-bfd954330f7e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:12.134215 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84bd86e9-61a5-4ef2-a8c5-bfd954330f7e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:12.134215 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84bd86e9-61a5-4ef2-a8c5-bfd954330f7e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:12.277560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-84bd86e9-61a5-4ef2-a8c5-bfd954330f7e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:12.285491 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-84bd86e9-61a5-4ef2-a8c5-bfd954330f7e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 200 len: 1342 microversion: 2.1 time: 0.168503 Aug 04 17:43:12.293669 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3267/6564] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:12 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 1342 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:13.306484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8d518847-847a-4e52-990c-e4d945abb3cd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:13.307136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8d518847-847a-4e52-990c-e4d945abb3cd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:13.314068 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d518847-847a-4e52-990c-e4d945abb3cd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:13.314567 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d518847-847a-4e52-990c-e4d945abb3cd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:13.315534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d518847-847a-4e52-990c-e4d945abb3cd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:13.316246 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d518847-847a-4e52-990c-e4d945abb3cd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:13.316714 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d518847-847a-4e52-990c-e4d945abb3cd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:13.317152 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8d518847-847a-4e52-990c-e4d945abb3cd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:13.448811 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8d518847-847a-4e52-990c-e4d945abb3cd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:13.456960 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8d518847-847a-4e52-990c-e4d945abb3cd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 200 len: 1342 microversion: 2.1 time: 0.154422 Aug 04 17:43:13.457825 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3298/6565] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:13 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 1342 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:14.479338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b3e44f52-4f9d-4738-8e17-4a6b7b4abbc1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:14.479968 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b3e44f52-4f9d-4738-8e17-4a6b7b4abbc1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:14.482825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:43:14.483549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=35 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:43:14.489136 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3e44f52-4f9d-4738-8e17-4a6b7b4abbc1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:14.489639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3e44f52-4f9d-4738-8e17-4a6b7b4abbc1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:14.490124 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3e44f52-4f9d-4738-8e17-4a6b7b4abbc1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:14.490838 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3e44f52-4f9d-4738-8e17-4a6b7b4abbc1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:14.491314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3e44f52-4f9d-4738-8e17-4a6b7b4abbc1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:14.491756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3e44f52-4f9d-4738-8e17-4a6b7b4abbc1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:14.494577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:43:14.629346 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b3e44f52-4f9d-4738-8e17-4a6b7b4abbc1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:14.639044 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b3e44f52-4f9d-4738-8e17-4a6b7b4abbc1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 200 len: 1342 microversion: 2.1 time: 0.163786 Aug 04 17:43:14.639635 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3268/6566] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:14 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 1342 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:15.661847 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-87f35afb-4fa9-4e38-950a-ad9f58c567c3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:15.662507 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-87f35afb-4fa9-4e38-950a-ad9f58c567c3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:15.664531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:43:15.665335 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:43:15.667171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:43:15.675680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87f35afb-4fa9-4e38-950a-ad9f58c567c3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:15.676187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87f35afb-4fa9-4e38-950a-ad9f58c567c3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:15.676662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87f35afb-4fa9-4e38-950a-ad9f58c567c3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:15.677390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87f35afb-4fa9-4e38-950a-ad9f58c567c3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:15.677861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87f35afb-4fa9-4e38-950a-ad9f58c567c3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:15.678329 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87f35afb-4fa9-4e38-950a-ad9f58c567c3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:15.681638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=81 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:43:15.823652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-87f35afb-4fa9-4e38-950a-ad9f58c567c3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:15.831765 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-87f35afb-4fa9-4e38-950a-ad9f58c567c3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 200 len: 1342 microversion: 2.1 time: 0.174995 Aug 04 17:43:15.832597 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3299/6567] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:15 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 1342 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:43:16.852865 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0ffc70fc-60ff-41a5-afe1-54d3011eeb28 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:16.853418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0ffc70fc-60ff-41a5-afe1-54d3011eeb28 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:16.860373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ffc70fc-60ff-41a5-afe1-54d3011eeb28 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:16.860882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ffc70fc-60ff-41a5-afe1-54d3011eeb28 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:16.861338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ffc70fc-60ff-41a5-afe1-54d3011eeb28 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:16.862582 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ffc70fc-60ff-41a5-afe1-54d3011eeb28 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:16.863066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ffc70fc-60ff-41a5-afe1-54d3011eeb28 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:16.863517 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ffc70fc-60ff-41a5-afe1-54d3011eeb28 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:17.001897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0ffc70fc-60ff-41a5-afe1-54d3011eeb28 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:17.009944 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0ffc70fc-60ff-41a5-afe1-54d3011eeb28 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 200 len: 1342 microversion: 2.1 time: 0.161038 Aug 04 17:43:17.010595 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3269/6568] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:16 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 1342 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:18.030411 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-750346e3-dc4c-4d58-b902-32e70aeab349 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:18.031155 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-750346e3-dc4c-4d58-b902-32e70aeab349 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:18.038347 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-750346e3-dc4c-4d58-b902-32e70aeab349 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:18.038845 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-750346e3-dc4c-4d58-b902-32e70aeab349 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:18.039287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-750346e3-dc4c-4d58-b902-32e70aeab349 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:18.040043 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-750346e3-dc4c-4d58-b902-32e70aeab349 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:18.040549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-750346e3-dc4c-4d58-b902-32e70aeab349 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:18.040964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-750346e3-dc4c-4d58-b902-32e70aeab349 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:18.190933 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-750346e3-dc4c-4d58-b902-32e70aeab349 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:18.198798 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-750346e3-dc4c-4d58-b902-32e70aeab349 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 200 len: 1342 microversion: 2.1 time: 0.172617 Aug 04 17:43:18.199366 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3300/6569] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:18 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 1342 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:19.220859 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-226a5e7c-7dcc-41be-9f74-96c1d440995e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:19.221556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-226a5e7c-7dcc-41be-9f74-96c1d440995e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:19.228273 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-226a5e7c-7dcc-41be-9f74-96c1d440995e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:19.228778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-226a5e7c-7dcc-41be-9f74-96c1d440995e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:19.229230 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-226a5e7c-7dcc-41be-9f74-96c1d440995e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:19.229941 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-226a5e7c-7dcc-41be-9f74-96c1d440995e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:19.230440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-226a5e7c-7dcc-41be-9f74-96c1d440995e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:19.230883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-226a5e7c-7dcc-41be-9f74-96c1d440995e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:19.370196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-226a5e7c-7dcc-41be-9f74-96c1d440995e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:19.378435 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-226a5e7c-7dcc-41be-9f74-96c1d440995e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 200 len: 1342 microversion: 2.1 time: 0.161107 Aug 04 17:43:19.379017 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3270/6570] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:19 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 1342 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:20.400696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d973b3f5-9c3f-4e14-8813-432889ae8e00 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:20.401328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d973b3f5-9c3f-4e14-8813-432889ae8e00 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:20.408606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d973b3f5-9c3f-4e14-8813-432889ae8e00 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:20.409840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d973b3f5-9c3f-4e14-8813-432889ae8e00 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:20.410297 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d973b3f5-9c3f-4e14-8813-432889ae8e00 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:20.410981 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d973b3f5-9c3f-4e14-8813-432889ae8e00 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:20.411440 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d973b3f5-9c3f-4e14-8813-432889ae8e00 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:20.411869 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d973b3f5-9c3f-4e14-8813-432889ae8e00 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:20.545946 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d973b3f5-9c3f-4e14-8813-432889ae8e00 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:20.553505 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d973b3f5-9c3f-4e14-8813-432889ae8e00 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 200 len: 1376 microversion: 2.1 time: 0.156662 Aug 04 17:43:20.554122 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3301/6571] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:20 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 1376 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:21.575734 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-63efbe83-7bcf-41f1-85ec-26c7447622ca tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:21.576408 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-63efbe83-7bcf-41f1-85ec-26c7447622ca tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:21.583524 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63efbe83-7bcf-41f1-85ec-26c7447622ca tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:21.584223 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63efbe83-7bcf-41f1-85ec-26c7447622ca tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:21.584807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63efbe83-7bcf-41f1-85ec-26c7447622ca tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:21.585697 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63efbe83-7bcf-41f1-85ec-26c7447622ca tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:21.586471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63efbe83-7bcf-41f1-85ec-26c7447622ca tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:21.587121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63efbe83-7bcf-41f1-85ec-26c7447622ca tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:21.723106 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-63efbe83-7bcf-41f1-85ec-26c7447622ca tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:21.731033 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-63efbe83-7bcf-41f1-85ec-26c7447622ca tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 200 len: 1376 microversion: 2.1 time: 0.159799 Aug 04 17:43:21.731684 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3271/6572] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:21 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 1376 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:22.752511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-70507d44-3f60-4519-8327-96b039d6521c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:22.753132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-70507d44-3f60-4519-8327-96b039d6521c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:22.760596 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70507d44-3f60-4519-8327-96b039d6521c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:22.761089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70507d44-3f60-4519-8327-96b039d6521c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:22.761533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70507d44-3f60-4519-8327-96b039d6521c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:22.762267 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70507d44-3f60-4519-8327-96b039d6521c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:22.762734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70507d44-3f60-4519-8327-96b039d6521c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:22.763167 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70507d44-3f60-4519-8327-96b039d6521c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:22.895331 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-70507d44-3f60-4519-8327-96b039d6521c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:22.902809 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-70507d44-3f60-4519-8327-96b039d6521c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 200 len: 1376 microversion: 2.1 time: 0.154674 Aug 04 17:43:22.903380 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3302/6573] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:22 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 1376 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:23.924265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-88d43522-d9b6-4da2-b2d9-bbdab3fddd4e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:23.924863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-88d43522-d9b6-4da2-b2d9-bbdab3fddd4e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:23.932057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88d43522-d9b6-4da2-b2d9-bbdab3fddd4e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:23.932549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88d43522-d9b6-4da2-b2d9-bbdab3fddd4e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:23.933020 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88d43522-d9b6-4da2-b2d9-bbdab3fddd4e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:23.933721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88d43522-d9b6-4da2-b2d9-bbdab3fddd4e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:23.934221 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88d43522-d9b6-4da2-b2d9-bbdab3fddd4e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:23.934658 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88d43522-d9b6-4da2-b2d9-bbdab3fddd4e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:24.087159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-88d43522-d9b6-4da2-b2d9-bbdab3fddd4e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:24.098765 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-88d43522-d9b6-4da2-b2d9-bbdab3fddd4e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 200 len: 1376 microversion: 2.1 time: 0.178514 Aug 04 17:43:24.099605 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3272/6574] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:23 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 1376 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:25.127859 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4b68c9b6-1416-4cf1-b04b-38efaa31897d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:25.128560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4b68c9b6-1416-4cf1-b04b-38efaa31897d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:25.136710 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b68c9b6-1416-4cf1-b04b-38efaa31897d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:25.137207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b68c9b6-1416-4cf1-b04b-38efaa31897d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:25.137738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b68c9b6-1416-4cf1-b04b-38efaa31897d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:25.138555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b68c9b6-1416-4cf1-b04b-38efaa31897d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:25.139112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b68c9b6-1416-4cf1-b04b-38efaa31897d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:25.139679 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b68c9b6-1416-4cf1-b04b-38efaa31897d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:25.280086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4b68c9b6-1416-4cf1-b04b-38efaa31897d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:25.289054 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4b68c9b6-1416-4cf1-b04b-38efaa31897d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 200 len: 1376 microversion: 2.1 time: 0.165893 Aug 04 17:43:25.289715 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3303/6575] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:25 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 1376 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:26.310973 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a16f8a83-0bc4-4b92-94b1-fe188008c244 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:26.311610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a16f8a83-0bc4-4b92-94b1-fe188008c244 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:26.321964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a16f8a83-0bc4-4b92-94b1-fe188008c244 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:26.322766 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a16f8a83-0bc4-4b92-94b1-fe188008c244 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:26.323488 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a16f8a83-0bc4-4b92-94b1-fe188008c244 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:26.324533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a16f8a83-0bc4-4b92-94b1-fe188008c244 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:26.325017 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a16f8a83-0bc4-4b92-94b1-fe188008c244 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:26.325573 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a16f8a83-0bc4-4b92-94b1-fe188008c244 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:26.475316 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a16f8a83-0bc4-4b92-94b1-fe188008c244 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:26.482975 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a16f8a83-0bc4-4b92-94b1-fe188008c244 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 200 len: 1376 microversion: 2.1 time: 0.176253 Aug 04 17:43:26.483544 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3273/6576] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:26 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 1376 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:27.504794 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1e80475a-1604-4f30-9cc4-c5bc608e6665 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:27.505917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1e80475a-1604-4f30-9cc4-c5bc608e6665 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:27.512943 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e80475a-1604-4f30-9cc4-c5bc608e6665 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:27.513382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e80475a-1604-4f30-9cc4-c5bc608e6665 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:27.513832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e80475a-1604-4f30-9cc4-c5bc608e6665 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:27.514584 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e80475a-1604-4f30-9cc4-c5bc608e6665 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:27.515055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e80475a-1604-4f30-9cc4-c5bc608e6665 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:27.515493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e80475a-1604-4f30-9cc4-c5bc608e6665 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:27.649645 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1e80475a-1604-4f30-9cc4-c5bc608e6665 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:27.657450 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1e80475a-1604-4f30-9cc4-c5bc608e6665 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 200 len: 1376 microversion: 2.1 time: 0.156564 Aug 04 17:43:27.658179 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3304/6577] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:27 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 1376 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:28.681022 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-73349459-bf4f-403e-a023-e67ec676586e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:28.681655 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-73349459-bf4f-403e-a023-e67ec676586e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:28.689255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73349459-bf4f-403e-a023-e67ec676586e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:28.689755 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73349459-bf4f-403e-a023-e67ec676586e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:28.690294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73349459-bf4f-403e-a023-e67ec676586e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:28.691004 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73349459-bf4f-403e-a023-e67ec676586e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:28.691532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73349459-bf4f-403e-a023-e67ec676586e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:28.691970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73349459-bf4f-403e-a023-e67ec676586e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:28.841522 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-73349459-bf4f-403e-a023-e67ec676586e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:28.851557 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-73349459-bf4f-403e-a023-e67ec676586e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 200 len: 1376 microversion: 2.1 time: 0.174998 Aug 04 17:43:28.852353 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3274/6578] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:28 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 1376 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:29.732753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-6dacfa83-c132-4b82-a9b2-0bee02a9f6a0 req-cfe15f53-2cde-47ac-854c-18b9db79fee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4526b9be-3e4d-4ba1-b6d1-16a6131ae63a", "name": "network-vif-plugged", "status": "completed", "tag": "bdca1d75-2630-44de-a6b9-994db70a42ca"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:43:29.744051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6dacfa83-c132-4b82-a9b2-0bee02a9f6a0 req-cfe15f53-2cde-47ac-854c-18b9db79fee1 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:29.744584 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6dacfa83-c132-4b82-a9b2-0bee02a9f6a0 req-cfe15f53-2cde-47ac-854c-18b9db79fee1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:29.745028 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6dacfa83-c132-4b82-a9b2-0bee02a9f6a0 req-cfe15f53-2cde-47ac-854c-18b9db79fee1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:29.759236 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-6dacfa83-c132-4b82-a9b2-0bee02a9f6a0 req-cfe15f53-2cde-47ac-854c-18b9db79fee1 service nova] Creating event network-vif-plugged:bdca1d75-2630-44de-a6b9-994db70a42ca for instance 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a on n-h2-851359-3 Aug 04 17:43:29.764699 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-6dacfa83-c132-4b82-a9b2-0bee02a9f6a0 req-cfe15f53-2cde-47ac-854c-18b9db79fee1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037120 Aug 04 17:43:29.765444 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3305/6579] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:43:29.879514 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c02b0788-d81f-4004-86a3-08880e1aec07 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:29.880754 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c02b0788-d81f-4004-86a3-08880e1aec07 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:29.894146 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c02b0788-d81f-4004-86a3-08880e1aec07 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:29.895062 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c02b0788-d81f-4004-86a3-08880e1aec07 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:29.895935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c02b0788-d81f-4004-86a3-08880e1aec07 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:29.898210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c02b0788-d81f-4004-86a3-08880e1aec07 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:29.899095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c02b0788-d81f-4004-86a3-08880e1aec07 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:29.900070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c02b0788-d81f-4004-86a3-08880e1aec07 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:30.069245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c02b0788-d81f-4004-86a3-08880e1aec07 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:30.076857 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c02b0788-d81f-4004-86a3-08880e1aec07 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 200 len: 1376 microversion: 2.1 time: 0.204118 Aug 04 17:43:30.077581 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3275/6580] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:29 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 1376 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:31.100164 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dcc5c9fc-9ae1-4b15-a9ab-6bb4b6c156c6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:31.100917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dcc5c9fc-9ae1-4b15-a9ab-6bb4b6c156c6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:31.107543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcc5c9fc-9ae1-4b15-a9ab-6bb4b6c156c6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:31.108310 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcc5c9fc-9ae1-4b15-a9ab-6bb4b6c156c6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:31.108765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcc5c9fc-9ae1-4b15-a9ab-6bb4b6c156c6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:31.109468 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcc5c9fc-9ae1-4b15-a9ab-6bb4b6c156c6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:31.110084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcc5c9fc-9ae1-4b15-a9ab-6bb4b6c156c6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:31.110697 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcc5c9fc-9ae1-4b15-a9ab-6bb4b6c156c6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:31.260495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dcc5c9fc-9ae1-4b15-a9ab-6bb4b6c156c6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:31.270197 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dcc5c9fc-9ae1-4b15-a9ab-6bb4b6c156c6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 200 len: 1376 microversion: 2.1 time: 0.176147 Aug 04 17:43:31.270909 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3306/6581] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:31 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 1376 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:32.292819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d3de57af-3e61-4f3a-8336-f44e3d300ca4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:32.293453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d3de57af-3e61-4f3a-8336-f44e3d300ca4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:32.300633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3de57af-3e61-4f3a-8336-f44e3d300ca4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:32.301292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3de57af-3e61-4f3a-8336-f44e3d300ca4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:32.301715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3de57af-3e61-4f3a-8336-f44e3d300ca4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:32.302574 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3de57af-3e61-4f3a-8336-f44e3d300ca4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:32.302995 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3de57af-3e61-4f3a-8336-f44e3d300ca4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:32.303453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3de57af-3e61-4f3a-8336-f44e3d300ca4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:32.709744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d3de57af-3e61-4f3a-8336-f44e3d300ca4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:32.717344 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d3de57af-3e61-4f3a-8336-f44e3d300ca4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 200 len: 1562 microversion: 2.1 time: 0.428481 Aug 04 17:43:32.717913 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3276/6582] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:32 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 1562 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:32.737322 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3fc00022-23ad-4e55-9f33-fa1a4a5eed36 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:32.738002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3fc00022-23ad-4e55-9f33-fa1a4a5eed36 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:32.744920 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3fc00022-23ad-4e55-9f33-fa1a4a5eed36 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:32.745412 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3fc00022-23ad-4e55-9f33-fa1a4a5eed36 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:32.745861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3fc00022-23ad-4e55-9f33-fa1a4a5eed36 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:32.746594 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3fc00022-23ad-4e55-9f33-fa1a4a5eed36 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:32.747062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3fc00022-23ad-4e55-9f33-fa1a4a5eed36 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:32.747498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3fc00022-23ad-4e55-9f33-fa1a4a5eed36 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:32.879158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3fc00022-23ad-4e55-9f33-fa1a4a5eed36 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:32.887345 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3fc00022-23ad-4e55-9f33-fa1a4a5eed36 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 200 len: 1562 microversion: 2.1 time: 0.153914 Aug 04 17:43:32.887926 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3307/6583] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:32 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:32.964861 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4b864f9c-afb5-45bf-99be-d62e20fca0e2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:32.965385 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4b864f9c-afb5-45bf-99be-d62e20fca0e2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:32.971318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b864f9c-afb5-45bf-99be-d62e20fca0e2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:32.971953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b864f9c-afb5-45bf-99be-d62e20fca0e2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:32.972279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b864f9c-afb5-45bf-99be-d62e20fca0e2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:32.972985 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b864f9c-afb5-45bf-99be-d62e20fca0e2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:32.973458 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b864f9c-afb5-45bf-99be-d62e20fca0e2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:32.973931 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b864f9c-afb5-45bf-99be-d62e20fca0e2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:33.001106 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4b864f9c-afb5-45bf-99be-d62e20fca0e2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:43:33.076210 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4b864f9c-afb5-45bf-99be-d62e20fca0e2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 204 len: 0 microversion: 2.1 time: 0.114905 Aug 04 17:43:33.080030 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3277/6584] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:43:32 2022] DELETE /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:43:33.085737 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-af485a50-db54-4379-8318-a2d4ac5134e2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:33.086856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-af485a50-db54-4379-8318-a2d4ac5134e2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:33.092774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af485a50-db54-4379-8318-a2d4ac5134e2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:33.093293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af485a50-db54-4379-8318-a2d4ac5134e2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:33.093724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af485a50-db54-4379-8318-a2d4ac5134e2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:33.094509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af485a50-db54-4379-8318-a2d4ac5134e2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:33.094978 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af485a50-db54-4379-8318-a2d4ac5134e2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:33.095414 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-af485a50-db54-4379-8318-a2d4ac5134e2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:33.226369 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-af485a50-db54-4379-8318-a2d4ac5134e2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:33.234188 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-af485a50-db54-4379-8318-a2d4ac5134e2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 200 len: 1568 microversion: 2.1 time: 0.152723 Aug 04 17:43:33.234767 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3308/6585] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:33 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:34.255996 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ef7adf22-297b-4e6e-ad4a-3b9abf7e28d7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:34.256717 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ef7adf22-297b-4e6e-ad4a-3b9abf7e28d7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:34.263666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef7adf22-297b-4e6e-ad4a-3b9abf7e28d7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:34.264171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef7adf22-297b-4e6e-ad4a-3b9abf7e28d7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:34.264627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef7adf22-297b-4e6e-ad4a-3b9abf7e28d7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:34.265343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef7adf22-297b-4e6e-ad4a-3b9abf7e28d7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:34.265821 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef7adf22-297b-4e6e-ad4a-3b9abf7e28d7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:34.266292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef7adf22-297b-4e6e-ad4a-3b9abf7e28d7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:34.404050 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ef7adf22-297b-4e6e-ad4a-3b9abf7e28d7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:34.411864 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ef7adf22-297b-4e6e-ad4a-3b9abf7e28d7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 200 len: 1568 microversion: 2.1 time: 0.160139 Aug 04 17:43:34.413058 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3278/6586] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:34 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:35.323127 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-6ab1b6b0-84d3-401e-9aeb-47d9a4a3e2e6 req-6bf3f4f1-5b76-4ba6-8048-c4cf5b028af7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4526b9be-3e4d-4ba1-b6d1-16a6131ae63a", "name": "network-vif-deleted", "tag": "bdca1d75-2630-44de-a6b9-994db70a42ca"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:43:35.335421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6ab1b6b0-84d3-401e-9aeb-47d9a4a3e2e6 req-6bf3f4f1-5b76-4ba6-8048-c4cf5b028af7 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:35.335952 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6ab1b6b0-84d3-401e-9aeb-47d9a4a3e2e6 req-6bf3f4f1-5b76-4ba6-8048-c4cf5b028af7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:35.337012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6ab1b6b0-84d3-401e-9aeb-47d9a4a3e2e6 req-6bf3f4f1-5b76-4ba6-8048-c4cf5b028af7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:35.348936 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-6ab1b6b0-84d3-401e-9aeb-47d9a4a3e2e6 req-6bf3f4f1-5b76-4ba6-8048-c4cf5b028af7 service nova] Creating event network-vif-deleted:bdca1d75-2630-44de-a6b9-994db70a42ca for instance 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a on n-h2-851359-3 Aug 04 17:43:35.355009 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-6ab1b6b0-84d3-401e-9aeb-47d9a4a3e2e6 req-6bf3f4f1-5b76-4ba6-8048-c4cf5b028af7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036082 Aug 04 17:43:35.358889 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3309/6587] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:43:35.434889 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-657de7f5-8ac1-4653-8d6d-a264f94c9d45 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:35.435580 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-657de7f5-8ac1-4653-8d6d-a264f94c9d45 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:35.443136 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-657de7f5-8ac1-4653-8d6d-a264f94c9d45 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:35.444443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-657de7f5-8ac1-4653-8d6d-a264f94c9d45 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:35.445292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-657de7f5-8ac1-4653-8d6d-a264f94c9d45 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:35.446258 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-657de7f5-8ac1-4653-8d6d-a264f94c9d45 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:35.446905 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-657de7f5-8ac1-4653-8d6d-a264f94c9d45 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:35.447518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-657de7f5-8ac1-4653-8d6d-a264f94c9d45 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:35.519192 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-657de7f5-8ac1-4653-8d6d-a264f94c9d45 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:35.527435 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-657de7f5-8ac1-4653-8d6d-a264f94c9d45 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 200 len: 1361 microversion: 2.1 time: 0.096515 Aug 04 17:43:35.528024 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3279/6588] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:35 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 1361 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:36.551767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d19b4208-0d57-4fda-a8a4-2ed7f0ef26f8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:36.552461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d19b4208-0d57-4fda-a8a4-2ed7f0ef26f8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:36.559461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d19b4208-0d57-4fda-a8a4-2ed7f0ef26f8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:36.559996 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d19b4208-0d57-4fda-a8a4-2ed7f0ef26f8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:36.560521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d19b4208-0d57-4fda-a8a4-2ed7f0ef26f8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:36.561262 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d19b4208-0d57-4fda-a8a4-2ed7f0ef26f8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:36.561889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d19b4208-0d57-4fda-a8a4-2ed7f0ef26f8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:36.562434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d19b4208-0d57-4fda-a8a4-2ed7f0ef26f8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:36.632922 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d19b4208-0d57-4fda-a8a4-2ed7f0ef26f8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:36.641953 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d19b4208-0d57-4fda-a8a4-2ed7f0ef26f8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 200 len: 1361 microversion: 2.1 time: 0.095759 Aug 04 17:43:36.642576 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3310/6589] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:36 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 1361 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:37.664051 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-04910646-49f8-44f6-8dd3-e2f5fd6dd917 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:37.664700 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-04910646-49f8-44f6-8dd3-e2f5fd6dd917 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:37.671911 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04910646-49f8-44f6-8dd3-e2f5fd6dd917 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:37.672428 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04910646-49f8-44f6-8dd3-e2f5fd6dd917 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:37.672889 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04910646-49f8-44f6-8dd3-e2f5fd6dd917 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:37.673620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04910646-49f8-44f6-8dd3-e2f5fd6dd917 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:37.674233 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04910646-49f8-44f6-8dd3-e2f5fd6dd917 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:37.674681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04910646-49f8-44f6-8dd3-e2f5fd6dd917 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:37.746610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-04910646-49f8-44f6-8dd3-e2f5fd6dd917 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:37.754799 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-04910646-49f8-44f6-8dd3-e2f5fd6dd917 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 200 len: 1361 microversion: 2.1 time: 0.095303 Aug 04 17:43:37.755475 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3280/6590] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:37 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 1361 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:38.778521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-615686a9-1455-449c-9dc6-d0b3266eee1d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:38.779192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-615686a9-1455-449c-9dc6-d0b3266eee1d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:38.786331 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-615686a9-1455-449c-9dc6-d0b3266eee1d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:38.786824 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-615686a9-1455-449c-9dc6-d0b3266eee1d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:38.787336 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-615686a9-1455-449c-9dc6-d0b3266eee1d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:38.788047 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-615686a9-1455-449c-9dc6-d0b3266eee1d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:38.788670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-615686a9-1455-449c-9dc6-d0b3266eee1d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:38.789202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-615686a9-1455-449c-9dc6-d0b3266eee1d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:38.855581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-615686a9-1455-449c-9dc6-d0b3266eee1d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:38.863910 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-615686a9-1455-449c-9dc6-d0b3266eee1d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 200 len: 1361 microversion: 2.1 time: 0.089885 Aug 04 17:43:38.864598 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3311/6591] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:38 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 1361 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:39.888704 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-85fbb125-d53e-4f59-9c09-46d47d2840dc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:39.889576 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-85fbb125-d53e-4f59-9c09-46d47d2840dc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:39.897227 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85fbb125-d53e-4f59-9c09-46d47d2840dc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:39.897758 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85fbb125-d53e-4f59-9c09-46d47d2840dc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:39.898240 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85fbb125-d53e-4f59-9c09-46d47d2840dc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:39.898946 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85fbb125-d53e-4f59-9c09-46d47d2840dc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:39.899423 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85fbb125-d53e-4f59-9c09-46d47d2840dc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:39.899867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85fbb125-d53e-4f59-9c09-46d47d2840dc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:39.945927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85fbb125-d53e-4f59-9c09-46d47d2840dc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:39.946476 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85fbb125-d53e-4f59-9c09-46d47d2840dc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:39.947049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85fbb125-d53e-4f59-9c09-46d47d2840dc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:39.947413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-85fbb125-d53e-4f59-9c09-46d47d2840dc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lazy-loading 'fault' on Instance uuid 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:43:39.999489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-85fbb125-d53e-4f59-9c09-46d47d2840dc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:40.010308 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-85fbb125-d53e-4f59-9c09-46d47d2840dc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 200 len: 1366 microversion: 2.1 time: 0.128095 Aug 04 17:43:40.010969 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3281/6592] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:39 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 1366 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:41.036598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ecd4af89-4b3d-4cae-a7f3-fbd3c41c61c4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:41.037358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ecd4af89-4b3d-4cae-a7f3-fbd3c41c61c4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:41.044692 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecd4af89-4b3d-4cae-a7f3-fbd3c41c61c4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:41.045200 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecd4af89-4b3d-4cae-a7f3-fbd3c41c61c4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:41.045681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecd4af89-4b3d-4cae-a7f3-fbd3c41c61c4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:41.046441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecd4af89-4b3d-4cae-a7f3-fbd3c41c61c4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:41.046902 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecd4af89-4b3d-4cae-a7f3-fbd3c41c61c4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:41.047343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecd4af89-4b3d-4cae-a7f3-fbd3c41c61c4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:41.065662 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-ecd4af89-4b3d-4cae-a7f3-fbd3c41c61c4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] HTTP exception thrown: Instance 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a could not be found. Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ecd4af89-4b3d-4cae-a7f3-fbd3c41c61c4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Request method failure captured: Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a HTTP/1.1 Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7ARpoisKS8ru_ZJiIrIfjIFMRjfQL-mVrLbzAzLl4Z4wH-8ksarsVn1PTK67x0ktAL2RMgNiOghxRSfCsuIPgqi5zzrjB6PtD1ptQpXCC7QBiVIYCXgsvXv7bVdD4F6QLnLsEgFyHhnUvqqIgdfnwyBZE3QOXa1h7oqCs3SSjoPFKXM Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 46f694275ec441259c366f63daa4a380 Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-TestVolumeBootPattern-275420730 Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46f694275ec441259c366f63daa4a380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46f694275ec441259c366f63daa4a380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_46f694275ec441259c366f63daa4a380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/46f694275ec441259c366f63daa4a380"}]}] Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-TestVolumeBootPattern-275420730 Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 46f694275ec441259c366f63daa4a380 Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-TestVolumeBootPattern-275420730 Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-TestVolumeBootPattern-275420730-project Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 50bf6f5281964c0b81809080bcf22bdd Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-TestVolumeBootPattern-275420730-project Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a could not be found. Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '4526b9be-3e4d-4ba1-b6d1-16a6131ae63a'} Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a could not be found. Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a could not be found. Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:43:41.068015 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:43:41.080268 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:43:41.080268 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:43:41.080268 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:43:41.080268 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:43:41.080268 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:43:41.080268 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a could not be found. Aug 04 17:43:41.080268 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:43:41.080268 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ecd4af89-4b3d-4cae-a7f3-fbd3c41c61c4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Returning 404 to user: Instance 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:43:41.080268 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ecd4af89-4b3d-4cae-a7f3-fbd3c41c61c4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 404 len: 111 microversion: 2.1 time: 0.038353 Aug 04 17:43:41.086703 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3312/6593] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:41 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:43:45.384082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f8e2920c-f411-4165-bd74-9e6c66674a60 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:45.384967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f8e2920c-f411-4165-bd74-9e6c66674a60 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 08382e6c-e2ba-4bad-9065-d213856aeda8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:45.387103 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:43:45.393272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8e2920c-f411-4165-bd74-9e6c66674a60 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:45.393776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8e2920c-f411-4165-bd74-9e6c66674a60 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:45.394260 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8e2920c-f411-4165-bd74-9e6c66674a60 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:45.394977 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8e2920c-f411-4165-bd74-9e6c66674a60 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:45.395453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8e2920c-f411-4165-bd74-9e6c66674a60 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:45.395899 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8e2920c-f411-4165-bd74-9e6c66674a60 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:45.399065 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:43:45.423264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f8e2920c-f411-4165-bd74-9e6c66674a60 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 08382e6c-e2ba-4bad-9065-d213856aeda8] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:43:45.502355 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f8e2920c-f411-4165-bd74-9e6c66674a60 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "DELETE /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8" status: 204 len: 0 microversion: 2.1 time: 0.121878 Aug 04 17:43:45.503091 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3282/6594] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:43:45 2022] DELETE /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:43:45.511044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-47a104ce-bc03-46f4-ba37-2706da90461f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:45.511697 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-47a104ce-bc03-46f4-ba37-2706da90461f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 08382e6c-e2ba-4bad-9065-d213856aeda8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:45.518568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47a104ce-bc03-46f4-ba37-2706da90461f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:45.518997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47a104ce-bc03-46f4-ba37-2706da90461f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:45.519437 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47a104ce-bc03-46f4-ba37-2706da90461f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:45.520126 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47a104ce-bc03-46f4-ba37-2706da90461f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:45.520590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47a104ce-bc03-46f4-ba37-2706da90461f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:45.521014 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47a104ce-bc03-46f4-ba37-2706da90461f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:45.654303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-47a104ce-bc03-46f4-ba37-2706da90461f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:45.662721 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-47a104ce-bc03-46f4-ba37-2706da90461f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8" status: 200 len: 1409 microversion: 2.1 time: 0.155015 Aug 04 17:43:45.663285 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3313/6595] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:45 2022] GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8 => generated 1409 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:46.684572 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-72bc7bf9-666e-41dc-a68d-3980467155b5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:46.685290 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-72bc7bf9-666e-41dc-a68d-3980467155b5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 08382e6c-e2ba-4bad-9065-d213856aeda8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:46.692295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72bc7bf9-666e-41dc-a68d-3980467155b5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:46.692794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72bc7bf9-666e-41dc-a68d-3980467155b5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:46.693370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72bc7bf9-666e-41dc-a68d-3980467155b5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:46.694565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72bc7bf9-666e-41dc-a68d-3980467155b5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:46.695038 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72bc7bf9-666e-41dc-a68d-3980467155b5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:46.695502 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72bc7bf9-666e-41dc-a68d-3980467155b5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:46.843766 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-72bc7bf9-666e-41dc-a68d-3980467155b5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:46.851905 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-72bc7bf9-666e-41dc-a68d-3980467155b5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8" status: 200 len: 1409 microversion: 2.1 time: 0.171666 Aug 04 17:43:46.852472 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3283/6596] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:46 2022] GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8 => generated 1409 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:47.765785 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-c0a1bf1a-c354-4b14-97f8-d2e05d1396a0 req-979df6ae-e45e-469d-be0d-394f9c130d86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08382e6c-e2ba-4bad-9065-d213856aeda8", "name": "network-vif-deleted", "tag": "b40fb3e4-6ff1-4b0a-9228-fc3b95991c87"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:43:47.774591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=30 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:43:47.779140 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c0a1bf1a-c354-4b14-97f8-d2e05d1396a0 req-979df6ae-e45e-469d-be0d-394f9c130d86 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:47.779678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c0a1bf1a-c354-4b14-97f8-d2e05d1396a0 req-979df6ae-e45e-469d-be0d-394f9c130d86 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:47.780900 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c0a1bf1a-c354-4b14-97f8-d2e05d1396a0 req-979df6ae-e45e-469d-be0d-394f9c130d86 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:47.783996 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=78 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:43:47.795572 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-c0a1bf1a-c354-4b14-97f8-d2e05d1396a0 req-979df6ae-e45e-469d-be0d-394f9c130d86 service nova] Creating event network-vif-deleted:b40fb3e4-6ff1-4b0a-9228-fc3b95991c87 for instance 08382e6c-e2ba-4bad-9065-d213856aeda8 on n-h1-851359-3 Aug 04 17:43:47.800735 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-c0a1bf1a-c354-4b14-97f8-d2e05d1396a0 req-979df6ae-e45e-469d-be0d-394f9c130d86 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038705 Aug 04 17:43:47.801339 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3314/6597] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:43:47.873677 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aaf03240-b080-4ffe-9d58-5b1ba5002f19 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:47.874426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aaf03240-b080-4ffe-9d58-5b1ba5002f19 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 08382e6c-e2ba-4bad-9065-d213856aeda8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:47.881099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aaf03240-b080-4ffe-9d58-5b1ba5002f19 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:47.881598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aaf03240-b080-4ffe-9d58-5b1ba5002f19 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:47.882082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aaf03240-b080-4ffe-9d58-5b1ba5002f19 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:47.882796 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aaf03240-b080-4ffe-9d58-5b1ba5002f19 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:47.883265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aaf03240-b080-4ffe-9d58-5b1ba5002f19 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:47.883699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aaf03240-b080-4ffe-9d58-5b1ba5002f19 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:47.949747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-aaf03240-b080-4ffe-9d58-5b1ba5002f19 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:47.957712 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aaf03240-b080-4ffe-9d58-5b1ba5002f19 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8" status: 200 len: 1202 microversion: 2.1 time: 0.087923 Aug 04 17:43:47.958663 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3284/6598] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:47 2022] GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8 => generated 1202 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:43:48.982747 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0d385a7c-75cb-4243-b8ed-2fcdb18a71b5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:48.983359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0d385a7c-75cb-4243-b8ed-2fcdb18a71b5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 08382e6c-e2ba-4bad-9065-d213856aeda8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:48.989877 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d385a7c-75cb-4243-b8ed-2fcdb18a71b5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:48.990413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d385a7c-75cb-4243-b8ed-2fcdb18a71b5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:48.990890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d385a7c-75cb-4243-b8ed-2fcdb18a71b5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:48.991603 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d385a7c-75cb-4243-b8ed-2fcdb18a71b5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:48.992072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d385a7c-75cb-4243-b8ed-2fcdb18a71b5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:48.992508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0d385a7c-75cb-4243-b8ed-2fcdb18a71b5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:49.055012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0d385a7c-75cb-4243-b8ed-2fcdb18a71b5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:49.065066 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0d385a7c-75cb-4243-b8ed-2fcdb18a71b5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8" status: 200 len: 1202 microversion: 2.1 time: 0.087956 Aug 04 17:43:49.065650 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3315/6599] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:48 2022] GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8 => generated 1202 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:50.086397 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bb785520-3267-4e74-a912-475e9fef4cbb tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:50.087042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bb785520-3267-4e74-a912-475e9fef4cbb tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 08382e6c-e2ba-4bad-9065-d213856aeda8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:50.093911 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb785520-3267-4e74-a912-475e9fef4cbb tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:50.094393 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb785520-3267-4e74-a912-475e9fef4cbb tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:50.094848 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb785520-3267-4e74-a912-475e9fef4cbb tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:50.095565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb785520-3267-4e74-a912-475e9fef4cbb tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:50.096041 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb785520-3267-4e74-a912-475e9fef4cbb tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:50.096486 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb785520-3267-4e74-a912-475e9fef4cbb tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:50.161572 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bb785520-3267-4e74-a912-475e9fef4cbb tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:50.170266 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bb785520-3267-4e74-a912-475e9fef4cbb tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8" status: 200 len: 1202 microversion: 2.1 time: 0.088140 Aug 04 17:43:50.170949 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3285/6600] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:50 2022] GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8 => generated 1202 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:51.192246 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ca049369-706a-416d-a2c0-3f6d167f9918 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:51.193018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ca049369-706a-416d-a2c0-3f6d167f9918 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 08382e6c-e2ba-4bad-9065-d213856aeda8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:51.199779 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca049369-706a-416d-a2c0-3f6d167f9918 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:51.200276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca049369-706a-416d-a2c0-3f6d167f9918 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:51.200721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca049369-706a-416d-a2c0-3f6d167f9918 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:51.201571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca049369-706a-416d-a2c0-3f6d167f9918 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:51.202063 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca049369-706a-416d-a2c0-3f6d167f9918 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:51.202506 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ca049369-706a-416d-a2c0-3f6d167f9918 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:51.267143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ca049369-706a-416d-a2c0-3f6d167f9918 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:51.276144 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ca049369-706a-416d-a2c0-3f6d167f9918 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8" status: 200 len: 1202 microversion: 2.1 time: 0.087925 Aug 04 17:43:51.277054 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3316/6601] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:51 2022] GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8 => generated 1202 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:52.298596 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d261b859-2121-404e-bd11-cc6157a424ce tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:52.299140 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d261b859-2121-404e-bd11-cc6157a424ce tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 08382e6c-e2ba-4bad-9065-d213856aeda8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:52.307197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d261b859-2121-404e-bd11-cc6157a424ce tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:52.307717 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d261b859-2121-404e-bd11-cc6157a424ce tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:52.308185 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d261b859-2121-404e-bd11-cc6157a424ce tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:52.309105 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d261b859-2121-404e-bd11-cc6157a424ce tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:52.309598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d261b859-2121-404e-bd11-cc6157a424ce tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:52.310078 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d261b859-2121-404e-bd11-cc6157a424ce tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:52.341674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d261b859-2121-404e-bd11-cc6157a424ce tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:52.342219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d261b859-2121-404e-bd11-cc6157a424ce tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:52.342696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d261b859-2121-404e-bd11-cc6157a424ce tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:52.343155 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-d261b859-2121-404e-bd11-cc6157a424ce tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lazy-loading 'fault' on Instance uuid 08382e6c-e2ba-4bad-9065-d213856aeda8 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:43:52.387511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d261b859-2121-404e-bd11-cc6157a424ce tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:43:52.395824 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d261b859-2121-404e-bd11-cc6157a424ce tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8" status: 200 len: 1207 microversion: 2.1 time: 0.101658 Aug 04 17:43:52.396682 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3286/6602] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:52 2022] GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8 => generated 1207 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:43:53.417409 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-baa15590-adad-41d9-86e5-0484bf134ccb tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:53.418071 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-baa15590-adad-41d9-86e5-0484bf134ccb tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 08382e6c-e2ba-4bad-9065-d213856aeda8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:53.424781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-baa15590-adad-41d9-86e5-0484bf134ccb tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:53.425282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-baa15590-adad-41d9-86e5-0484bf134ccb tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:53.425757 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-baa15590-adad-41d9-86e5-0484bf134ccb tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:53.426496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-baa15590-adad-41d9-86e5-0484bf134ccb tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:53.426970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-baa15590-adad-41d9-86e5-0484bf134ccb tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:53.427412 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-baa15590-adad-41d9-86e5-0484bf134ccb tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:53.441065 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-baa15590-adad-41d9-86e5-0484bf134ccb tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] HTTP exception thrown: Instance 08382e6c-e2ba-4bad-9065-d213856aeda8 could not be found. Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-baa15590-adad-41d9-86e5-0484bf134ccb tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Request method failure captured: Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8 HTTP/1.1 Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7ARpoisKS8ru_ZJiIrIfjIFMRjfQL-mVrLbzAzLl4Z4wH-8ksarsVn1PTK67x0ktAL2RMgNiOghxRSfCsuIPgqi5zzrjB6PtD1ptQpXCC7QBiVIYCXgsvXv7bVdD4F6QLnLsEgFyHhnUvqqIgdfnwyBZE3QOXa1h7oqCs3SSjoPFKXM Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 46f694275ec441259c366f63daa4a380 Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-TestVolumeBootPattern-275420730 Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46f694275ec441259c366f63daa4a380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46f694275ec441259c366f63daa4a380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_46f694275ec441259c366f63daa4a380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/46f694275ec441259c366f63daa4a380"}]}] Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-TestVolumeBootPattern-275420730 Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 46f694275ec441259c366f63daa4a380 Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-TestVolumeBootPattern-275420730 Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-TestVolumeBootPattern-275420730-project Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 50bf6f5281964c0b81809080bcf22bdd Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-TestVolumeBootPattern-275420730-project Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 08382e6c-e2ba-4bad-9065-d213856aeda8 could not be found. Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '08382e6c-e2ba-4bad-9065-d213856aeda8'} Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08382e6c-e2ba-4bad-9065-d213856aeda8 could not be found. Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08382e6c-e2ba-4bad-9065-d213856aeda8 could not be found. Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:43:53.442745 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:43:53.447435 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:43:53.447435 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:43:53.447435 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:43:53.447435 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:43:53.447435 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:43:53.447435 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08382e6c-e2ba-4bad-9065-d213856aeda8 could not be found. Aug 04 17:43:53.447435 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:43:53.447435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-baa15590-adad-41d9-86e5-0484bf134ccb tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Returning 404 to user: Instance 08382e6c-e2ba-4bad-9065-d213856aeda8 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:43:53.447435 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-baa15590-adad-41d9-86e5-0484bf134ccb tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8" status: 404 len: 111 microversion: 2.1 time: 0.030722 Aug 04 17:43:53.447435 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3317/6603] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:53 2022] GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:43:55.588071 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-02777809-3b1b-4a98-a8a5-d64ba58ed4b6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:55.588579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-02777809-3b1b-4a98-a8a5-d64ba58ed4b6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:55.595819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02777809-3b1b-4a98-a8a5-d64ba58ed4b6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:55.596327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02777809-3b1b-4a98-a8a5-d64ba58ed4b6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:55.596895 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02777809-3b1b-4a98-a8a5-d64ba58ed4b6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:55.597850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02777809-3b1b-4a98-a8a5-d64ba58ed4b6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:55.598366 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02777809-3b1b-4a98-a8a5-d64ba58ed4b6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:55.598810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02777809-3b1b-4a98-a8a5-d64ba58ed4b6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:55.615558 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-02777809-3b1b-4a98-a8a5-d64ba58ed4b6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] HTTP exception thrown: Instance 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a could not be found. Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-02777809-3b1b-4a98-a8a5-d64ba58ed4b6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Request method failure captured: Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a HTTP/1.1 Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7ARpoisKS8ru_ZJiIrIfjIFMRjfQL-mVrLbzAzLl4Z4wH-8ksarsVn1PTK67x0ktAL2RMgNiOghxRSfCsuIPgqi5zzrjB6PtD1ptQpXCC7QBiVIYCXgsvXv7bVdD4F6QLnLsEgFyHhnUvqqIgdfnwyBZE3QOXa1h7oqCs3SSjoPFKXM Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 46f694275ec441259c366f63daa4a380 Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TestVolumeBootPattern-275420730 Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46f694275ec441259c366f63daa4a380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46f694275ec441259c366f63daa4a380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_46f694275ec441259c366f63daa4a380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/46f694275ec441259c366f63daa4a380"}]}] Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TestVolumeBootPattern-275420730 Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 46f694275ec441259c366f63daa4a380 Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestVolumeBootPattern-275420730 Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TestVolumeBootPattern-275420730-project Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 50bf6f5281964c0b81809080bcf22bdd Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TestVolumeBootPattern-275420730-project Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a could not be found. Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '4526b9be-3e4d-4ba1-b6d1-16a6131ae63a'} Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a could not be found. Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:43:55.617264 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:43:55.622815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a could not be found. Aug 04 17:43:55.622815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:43:55.622815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:43:55.622815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:43:55.622815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:43:55.622815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:43:55.622815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:43:55.622815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:43:55.622815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:43:55.622815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a could not be found. Aug 04 17:43:55.622815 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:43:55.622815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-02777809-3b1b-4a98-a8a5-d64ba58ed4b6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Returning 404 to user: Instance 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:43:55.622815 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-02777809-3b1b-4a98-a8a5-d64ba58ed4b6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 404 len: 111 microversion: 2.1 time: 0.034688 Aug 04 17:43:55.622815 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3287/6604] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:43:55 2022] DELETE /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:43:55.627394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c58e6062-5fe5-41ed-8f8b-aefeef095c80 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:55.628009 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c58e6062-5fe5-41ed-8f8b-aefeef095c80 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:55.635485 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c58e6062-5fe5-41ed-8f8b-aefeef095c80 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:55.635969 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c58e6062-5fe5-41ed-8f8b-aefeef095c80 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:55.636436 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c58e6062-5fe5-41ed-8f8b-aefeef095c80 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:55.637124 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c58e6062-5fe5-41ed-8f8b-aefeef095c80 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:55.637579 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c58e6062-5fe5-41ed-8f8b-aefeef095c80 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:55.638082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c58e6062-5fe5-41ed-8f8b-aefeef095c80 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:55.653839 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-c58e6062-5fe5-41ed-8f8b-aefeef095c80 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] HTTP exception thrown: Instance 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a could not be found. Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c58e6062-5fe5-41ed-8f8b-aefeef095c80 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Request method failure captured: Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a HTTP/1.1 Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7ARpoisKS8ru_ZJiIrIfjIFMRjfQL-mVrLbzAzLl4Z4wH-8ksarsVn1PTK67x0ktAL2RMgNiOghxRSfCsuIPgqi5zzrjB6PtD1ptQpXCC7QBiVIYCXgsvXv7bVdD4F6QLnLsEgFyHhnUvqqIgdfnwyBZE3QOXa1h7oqCs3SSjoPFKXM Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 46f694275ec441259c366f63daa4a380 Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-TestVolumeBootPattern-275420730 Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46f694275ec441259c366f63daa4a380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46f694275ec441259c366f63daa4a380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_46f694275ec441259c366f63daa4a380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/46f694275ec441259c366f63daa4a380"}]}] Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-TestVolumeBootPattern-275420730 Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 46f694275ec441259c366f63daa4a380 Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-TestVolumeBootPattern-275420730 Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-TestVolumeBootPattern-275420730-project Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 50bf6f5281964c0b81809080bcf22bdd Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-TestVolumeBootPattern-275420730-project Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a could not be found. Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '4526b9be-3e4d-4ba1-b6d1-16a6131ae63a'} Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a could not be found. Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a could not be found. Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:43:55.655404 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:43:55.662784 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:43:55.662784 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:43:55.662784 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:43:55.662784 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:43:55.662784 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:43:55.662784 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a could not be found. Aug 04 17:43:55.662784 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:43:55.662784 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c58e6062-5fe5-41ed-8f8b-aefeef095c80 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Returning 404 to user: Instance 4526b9be-3e4d-4ba1-b6d1-16a6131ae63a could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:43:55.662784 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c58e6062-5fe5-41ed-8f8b-aefeef095c80 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a" status: 404 len: 111 microversion: 2.1 time: 0.033267 Aug 04 17:43:55.662784 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3318/6605] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:55 2022] GET /compute/v2.1/servers/4526b9be-3e4d-4ba1-b6d1-16a6131ae63a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:43:56.078444 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7e67d0d4-c8be-4d07-a8a9-04fa739a90ba tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:56.078969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7e67d0d4-c8be-4d07-a8a9-04fa739a90ba tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 08382e6c-e2ba-4bad-9065-d213856aeda8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:56.085857 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e67d0d4-c8be-4d07-a8a9-04fa739a90ba tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:56.086488 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e67d0d4-c8be-4d07-a8a9-04fa739a90ba tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:56.086948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e67d0d4-c8be-4d07-a8a9-04fa739a90ba tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:56.087670 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e67d0d4-c8be-4d07-a8a9-04fa739a90ba tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:56.088150 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e67d0d4-c8be-4d07-a8a9-04fa739a90ba tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:56.088597 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e67d0d4-c8be-4d07-a8a9-04fa739a90ba tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:56.103146 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-7e67d0d4-c8be-4d07-a8a9-04fa739a90ba tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] HTTP exception thrown: Instance 08382e6c-e2ba-4bad-9065-d213856aeda8 could not be found. Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7e67d0d4-c8be-4d07-a8a9-04fa739a90ba tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Request method failure captured: Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8 HTTP/1.1 Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7ARpoisKS8ru_ZJiIrIfjIFMRjfQL-mVrLbzAzLl4Z4wH-8ksarsVn1PTK67x0ktAL2RMgNiOghxRSfCsuIPgqi5zzrjB6PtD1ptQpXCC7QBiVIYCXgsvXv7bVdD4F6QLnLsEgFyHhnUvqqIgdfnwyBZE3QOXa1h7oqCs3SSjoPFKXM Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 46f694275ec441259c366f63daa4a380 Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TestVolumeBootPattern-275420730 Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46f694275ec441259c366f63daa4a380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46f694275ec441259c366f63daa4a380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_46f694275ec441259c366f63daa4a380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/46f694275ec441259c366f63daa4a380"}]}] Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TestVolumeBootPattern-275420730 Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 46f694275ec441259c366f63daa4a380 Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestVolumeBootPattern-275420730 Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TestVolumeBootPattern-275420730-project Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 50bf6f5281964c0b81809080bcf22bdd Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TestVolumeBootPattern-275420730-project Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 08382e6c-e2ba-4bad-9065-d213856aeda8 could not be found. Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '08382e6c-e2ba-4bad-9065-d213856aeda8'} Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08382e6c-e2ba-4bad-9065-d213856aeda8 could not be found. Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:43:56.104772 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:43:56.109919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08382e6c-e2ba-4bad-9065-d213856aeda8 could not be found. Aug 04 17:43:56.109919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:43:56.109919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:43:56.109919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:43:56.109919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:43:56.109919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:43:56.109919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:43:56.109919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:43:56.109919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:43:56.109919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08382e6c-e2ba-4bad-9065-d213856aeda8 could not be found. Aug 04 17:43:56.109919 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:43:56.109919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7e67d0d4-c8be-4d07-a8a9-04fa739a90ba tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Returning 404 to user: Instance 08382e6c-e2ba-4bad-9065-d213856aeda8 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:43:56.109919 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7e67d0d4-c8be-4d07-a8a9-04fa739a90ba tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "DELETE /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8" status: 404 len: 111 microversion: 2.1 time: 0.031666 Aug 04 17:43:56.109919 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3288/6606] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:43:56 2022] DELETE /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:43:56.115700 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-42c5964b-ed94-4f4d-98a0-16af2674751f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:43:56.116328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-42c5964b-ed94-4f4d-98a0-16af2674751f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 08382e6c-e2ba-4bad-9065-d213856aeda8] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:43:56.122435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42c5964b-ed94-4f4d-98a0-16af2674751f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:56.122930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42c5964b-ed94-4f4d-98a0-16af2674751f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:56.123380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42c5964b-ed94-4f4d-98a0-16af2674751f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:56.124077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42c5964b-ed94-4f4d-98a0-16af2674751f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:43:56.124544 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42c5964b-ed94-4f4d-98a0-16af2674751f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:43:56.124977 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42c5964b-ed94-4f4d-98a0-16af2674751f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:43:56.138935 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-42c5964b-ed94-4f4d-98a0-16af2674751f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] HTTP exception thrown: Instance 08382e6c-e2ba-4bad-9065-d213856aeda8 could not be found. Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-42c5964b-ed94-4f4d-98a0-16af2674751f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Request method failure captured: Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8 HTTP/1.1 Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7ARpoisKS8ru_ZJiIrIfjIFMRjfQL-mVrLbzAzLl4Z4wH-8ksarsVn1PTK67x0ktAL2RMgNiOghxRSfCsuIPgqi5zzrjB6PtD1ptQpXCC7QBiVIYCXgsvXv7bVdD4F6QLnLsEgFyHhnUvqqIgdfnwyBZE3QOXa1h7oqCs3SSjoPFKXM Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 46f694275ec441259c366f63daa4a380 Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-TestVolumeBootPattern-275420730 Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46f694275ec441259c366f63daa4a380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46f694275ec441259c366f63daa4a380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_46f694275ec441259c366f63daa4a380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/46f694275ec441259c366f63daa4a380"}]}] Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-TestVolumeBootPattern-275420730 Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 46f694275ec441259c366f63daa4a380 Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-TestVolumeBootPattern-275420730 Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-TestVolumeBootPattern-275420730-project Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 50bf6f5281964c0b81809080bcf22bdd Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-TestVolumeBootPattern-275420730-project Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 08382e6c-e2ba-4bad-9065-d213856aeda8 could not be found. Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '08382e6c-e2ba-4bad-9065-d213856aeda8'} Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08382e6c-e2ba-4bad-9065-d213856aeda8 could not be found. Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08382e6c-e2ba-4bad-9065-d213856aeda8 could not be found. Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:43:56.140393 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:43:56.145685 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:43:56.145685 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:43:56.145685 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:43:56.145685 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:43:56.145685 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:43:56.145685 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08382e6c-e2ba-4bad-9065-d213856aeda8 could not be found. Aug 04 17:43:56.145685 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:43:56.145685 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-42c5964b-ed94-4f4d-98a0-16af2674751f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Returning 404 to user: Instance 08382e6c-e2ba-4bad-9065-d213856aeda8 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:43:56.145685 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-42c5964b-ed94-4f4d-98a0-16af2674751f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8" status: 404 len: 111 microversion: 2.1 time: 0.030021 Aug 04 17:43:56.145685 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3319/6607] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:43:56 2022] GET /compute/v2.1/servers/08382e6c-e2ba-4bad-9065-d213856aeda8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:43:56.215080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-197ba992-dc92-417f-95dc-c189c03ef8f5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Action: 'create', calling method: .version_select at 0x7f1e5828c280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1670531884", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPX+bm6LmcwO62P1ThHualTGRpsHGWqOfaJx6IAb/nMSIqhNRhdDR2yKB2k8UblTose8VEGc16r5U/5MbyT8j/fH8gvTtGll/i7oi+4doCTEBZBnAwgdzO1xoJae+D7K1w=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:43:56.230924 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-197ba992-dc92-417f-95dc-c189c03ef8f5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Getting quotas for project 46f694275ec441259c366f63daa4a380. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:43:56.236064 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-197ba992-dc92-417f-95dc-c189c03ef8f5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Getting quotas for user 50bf6f5281964c0b81809080bcf22bdd and project 46f694275ec441259c366f63daa4a380. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:43:56.262971 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-197ba992-dc92-417f-95dc-c189c03ef8f5 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.051814 Aug 04 17:43:56.263589 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3289/6608] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:43:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:44:12.536988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2df63d4f-9055-44c1-a627-93b3ee033aa9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-666547844", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1670531884", "security_groups": [{"name": "tempest-secgroup-smoke-252591706"}], "block_device_mapping_v2": [{"uuid": "fd3fa047-47f4-4fda-af2e-7f9d53a22b26", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6002cd39-a33b-430d-a6d2-0ecfe13cd1ee"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:44:12.547497 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=11 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:44:12.548298 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=19 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:44:12.653701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-2df63d4f-9055-44c1-a627-93b3ee033aa9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] validate_networks() for [('6002cd39-a33b-430d-a6d2-0ecfe13cd1ee', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:44:13.338559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-2df63d4f-9055-44c1-a627-93b3ee033aa9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:44:13.338988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-2df63d4f-9055-44c1-a627-93b3ee033aa9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:44:13.339483 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-2df63d4f-9055-44c1-a627-93b3ee033aa9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:44:13.339894 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-2df63d4f-9055-44c1-a627-93b3ee033aa9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:44:13.340306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-2df63d4f-9055-44c1-a627-93b3ee033aa9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:44:13.348932 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2df63d4f-9055-44c1-a627-93b3ee033aa9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:13.349422 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2df63d4f-9055-44c1-a627-93b3ee033aa9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:13.349860 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2df63d4f-9055-44c1-a627-93b3ee033aa9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:13.350613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2df63d4f-9055-44c1-a627-93b3ee033aa9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:13.351071 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2df63d4f-9055-44c1-a627-93b3ee033aa9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:13.351529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2df63d4f-9055-44c1-a627-93b3ee033aa9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:13.369226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-2df63d4f-9055-44c1-a627-93b3ee033aa9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Getting quotas for project 46f694275ec441259c366f63daa4a380. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:44:13.374418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-2df63d4f-9055-44c1-a627-93b3ee033aa9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Getting quotas for user 50bf6f5281964c0b81809080bcf22bdd and project 46f694275ec441259c366f63daa4a380. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:44:13.431416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2df63d4f-9055-44c1-a627-93b3ee033aa9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:44:13.433517 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2df63d4f-9055-44c1-a627-93b3ee033aa9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 37452071-3f6f-44d5-b02b-7fe959f8c4fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fd3fa047-47f4-4fda-af2e-7f9d53a22b26',volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:44:13.559135 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2df63d4f-9055-44c1-a627-93b3ee033aa9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.026373 Aug 04 17:44:13.559786 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3320/6609] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:44:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 1028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:44:13.568930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:44:13.570307 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:44:13.571287 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:44:13.576333 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-52f13a8d-03bd-42d2-ac05-780c6e4c997f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:13.577409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-52f13a8d-03bd-42d2-ac05-780c6e4c997f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 37452071-3f6f-44d5-b02b-7fe959f8c4fb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:13.639213 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-52f13a8d-03bd-42d2-ac05-780c6e4c997f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:13.645967 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-52f13a8d-03bd-42d2-ac05-780c6e4c997f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb" status: 200 len: 1094 microversion: 2.1 time: 0.079243 Aug 04 17:44:13.646563 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3290/6610] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:13 2022] GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb => generated 1094 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:14.668468 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c16bceaa-da74-4755-80cb-552544399b5c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:14.669094 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c16bceaa-da74-4755-80cb-552544399b5c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 37452071-3f6f-44d5-b02b-7fe959f8c4fb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:14.675558 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c16bceaa-da74-4755-80cb-552544399b5c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:14.676057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c16bceaa-da74-4755-80cb-552544399b5c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:14.676524 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c16bceaa-da74-4755-80cb-552544399b5c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:14.677242 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c16bceaa-da74-4755-80cb-552544399b5c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:14.677736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c16bceaa-da74-4755-80cb-552544399b5c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:14.678216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c16bceaa-da74-4755-80cb-552544399b5c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:14.741099 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c16bceaa-da74-4755-80cb-552544399b5c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:14.749392 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c16bceaa-da74-4755-80cb-552544399b5c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb" status: 200 len: 1192 microversion: 2.1 time: 0.086158 Aug 04 17:44:14.749967 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3321/6611] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:14 2022] GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:15.772671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fd6b3936-b7c3-4453-a0fd-7e4e21b1181f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:15.773487 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fd6b3936-b7c3-4453-a0fd-7e4e21b1181f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 37452071-3f6f-44d5-b02b-7fe959f8c4fb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:15.781408 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd6b3936-b7c3-4453-a0fd-7e4e21b1181f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:15.782840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd6b3936-b7c3-4453-a0fd-7e4e21b1181f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:15.783490 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd6b3936-b7c3-4453-a0fd-7e4e21b1181f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:15.784955 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd6b3936-b7c3-4453-a0fd-7e4e21b1181f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:15.785616 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd6b3936-b7c3-4453-a0fd-7e4e21b1181f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:15.786772 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd6b3936-b7c3-4453-a0fd-7e4e21b1181f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:15.936762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fd6b3936-b7c3-4453-a0fd-7e4e21b1181f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:15.944921 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fd6b3936-b7c3-4453-a0fd-7e4e21b1181f tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb" status: 200 len: 1277 microversion: 2.1 time: 0.178501 Aug 04 17:44:15.946577 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3291/6612] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:15 2022] GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb => generated 1277 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:16.313998 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-4f77fee3-d4d7-4deb-a20c-6cc4677687cf req-dbbab06f-4993-4154-b09a-2c01b5346510 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37452071-3f6f-44d5-b02b-7fe959f8c4fb", "tag": "96bbec00-ce55-4613-a0a4-c94bde798191"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:44:16.325886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-4f77fee3-d4d7-4deb-a20c-6cc4677687cf req-dbbab06f-4993-4154-b09a-2c01b5346510 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:16.326611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-4f77fee3-d4d7-4deb-a20c-6cc4677687cf req-dbbab06f-4993-4154-b09a-2c01b5346510 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:16.327198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-4f77fee3-d4d7-4deb-a20c-6cc4677687cf req-dbbab06f-4993-4154-b09a-2c01b5346510 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:16.340098 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-4f77fee3-d4d7-4deb-a20c-6cc4677687cf req-dbbab06f-4993-4154-b09a-2c01b5346510 service nova] Creating event network-changed:96bbec00-ce55-4613-a0a4-c94bde798191 for instance 37452071-3f6f-44d5-b02b-7fe959f8c4fb on n-h1-851359-3 Aug 04 17:44:16.345450 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-4f77fee3-d4d7-4deb-a20c-6cc4677687cf req-dbbab06f-4993-4154-b09a-2c01b5346510 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035475 Aug 04 17:44:16.346091 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3322/6613] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:44:16.967832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9e7c42f2-58c2-41ad-ab26-b1c08f64dd32 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:16.968487 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9e7c42f2-58c2-41ad-ab26-b1c08f64dd32 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 37452071-3f6f-44d5-b02b-7fe959f8c4fb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:16.976557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e7c42f2-58c2-41ad-ab26-b1c08f64dd32 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:16.977179 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e7c42f2-58c2-41ad-ab26-b1c08f64dd32 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:16.977712 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e7c42f2-58c2-41ad-ab26-b1c08f64dd32 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:16.978558 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e7c42f2-58c2-41ad-ab26-b1c08f64dd32 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:16.979136 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e7c42f2-58c2-41ad-ab26-b1c08f64dd32 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:16.979653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e7c42f2-58c2-41ad-ab26-b1c08f64dd32 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:17.161581 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9e7c42f2-58c2-41ad-ab26-b1c08f64dd32 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:17.170268 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9e7c42f2-58c2-41ad-ab26-b1c08f64dd32 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb" status: 200 len: 1277 microversion: 2.1 time: 0.207256 Aug 04 17:44:17.171063 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3292/6614] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:16 2022] GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb => generated 1277 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:18.193916 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b3a7b76b-013d-4c4c-822f-0e1f40aca9dd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:18.195333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b3a7b76b-013d-4c4c-822f-0e1f40aca9dd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 37452071-3f6f-44d5-b02b-7fe959f8c4fb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:18.203928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3a7b76b-013d-4c4c-822f-0e1f40aca9dd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:18.204438 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3a7b76b-013d-4c4c-822f-0e1f40aca9dd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:18.204892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3a7b76b-013d-4c4c-822f-0e1f40aca9dd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:18.205611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3a7b76b-013d-4c4c-822f-0e1f40aca9dd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:18.206505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3a7b76b-013d-4c4c-822f-0e1f40aca9dd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:18.207132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3a7b76b-013d-4c4c-822f-0e1f40aca9dd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:18.347245 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b3a7b76b-013d-4c4c-822f-0e1f40aca9dd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:18.355496 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b3a7b76b-013d-4c4c-822f-0e1f40aca9dd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb" status: 200 len: 1277 microversion: 2.1 time: 0.166718 Aug 04 17:44:18.356067 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3323/6615] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:18 2022] GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb => generated 1277 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:19.377335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8340e2f3-fed1-43b1-bc9f-f97d4bcf8007 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:19.377880 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8340e2f3-fed1-43b1-bc9f-f97d4bcf8007 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 37452071-3f6f-44d5-b02b-7fe959f8c4fb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:19.384820 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8340e2f3-fed1-43b1-bc9f-f97d4bcf8007 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:19.385329 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8340e2f3-fed1-43b1-bc9f-f97d4bcf8007 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:19.385790 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8340e2f3-fed1-43b1-bc9f-f97d4bcf8007 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:19.386548 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8340e2f3-fed1-43b1-bc9f-f97d4bcf8007 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:19.387033 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8340e2f3-fed1-43b1-bc9f-f97d4bcf8007 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:19.387483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8340e2f3-fed1-43b1-bc9f-f97d4bcf8007 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:19.520294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8340e2f3-fed1-43b1-bc9f-f97d4bcf8007 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:19.528540 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8340e2f3-fed1-43b1-bc9f-f97d4bcf8007 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb" status: 200 len: 1277 microversion: 2.1 time: 0.155586 Aug 04 17:44:19.529103 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3293/6616] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:19 2022] GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:20.550435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5244df61-8df0-4b55-b5b4-369b0d363b1b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:20.551043 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5244df61-8df0-4b55-b5b4-369b0d363b1b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 37452071-3f6f-44d5-b02b-7fe959f8c4fb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:20.558104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5244df61-8df0-4b55-b5b4-369b0d363b1b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:20.558600 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5244df61-8df0-4b55-b5b4-369b0d363b1b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:20.559046 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5244df61-8df0-4b55-b5b4-369b0d363b1b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:20.559805 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5244df61-8df0-4b55-b5b4-369b0d363b1b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:20.560375 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5244df61-8df0-4b55-b5b4-369b0d363b1b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:20.560809 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5244df61-8df0-4b55-b5b4-369b0d363b1b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:20.695599 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5244df61-8df0-4b55-b5b4-369b0d363b1b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:20.703764 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5244df61-8df0-4b55-b5b4-369b0d363b1b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb" status: 200 len: 1265 microversion: 2.1 time: 0.157235 Aug 04 17:44:20.704344 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3324/6617] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:20 2022] GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:21.726024 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-00ce5c9e-63ae-4d79-92e2-4dead5b75792 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:21.726661 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-00ce5c9e-63ae-4d79-92e2-4dead5b75792 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 37452071-3f6f-44d5-b02b-7fe959f8c4fb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:21.734238 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00ce5c9e-63ae-4d79-92e2-4dead5b75792 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:21.734755 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00ce5c9e-63ae-4d79-92e2-4dead5b75792 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:21.735216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00ce5c9e-63ae-4d79-92e2-4dead5b75792 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:21.735914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00ce5c9e-63ae-4d79-92e2-4dead5b75792 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:21.736385 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00ce5c9e-63ae-4d79-92e2-4dead5b75792 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:21.736821 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00ce5c9e-63ae-4d79-92e2-4dead5b75792 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:21.867016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-00ce5c9e-63ae-4d79-92e2-4dead5b75792 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:21.874561 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-00ce5c9e-63ae-4d79-92e2-4dead5b75792 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb" status: 200 len: 1265 microversion: 2.1 time: 0.152677 Aug 04 17:44:21.875121 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3294/6618] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:21 2022] GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:22.895049 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-14a9da86-d22e-4bd3-bfc4-6bfff42b524a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:22.895586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-14a9da86-d22e-4bd3-bfc4-6bfff42b524a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 37452071-3f6f-44d5-b02b-7fe959f8c4fb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:22.902036 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14a9da86-d22e-4bd3-bfc4-6bfff42b524a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:22.902528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14a9da86-d22e-4bd3-bfc4-6bfff42b524a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:22.902974 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14a9da86-d22e-4bd3-bfc4-6bfff42b524a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:22.903672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14a9da86-d22e-4bd3-bfc4-6bfff42b524a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:22.904137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14a9da86-d22e-4bd3-bfc4-6bfff42b524a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:22.904575 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14a9da86-d22e-4bd3-bfc4-6bfff42b524a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:23.042908 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-14a9da86-d22e-4bd3-bfc4-6bfff42b524a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:23.050334 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-14a9da86-d22e-4bd3-bfc4-6bfff42b524a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb" status: 200 len: 1265 microversion: 2.1 time: 0.159405 Aug 04 17:44:23.050915 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3325/6619] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:22 2022] GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:24.072181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7f10454b-cf9a-40f0-be6a-8229b90a8e10 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:24.072865 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7f10454b-cf9a-40f0-be6a-8229b90a8e10 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 37452071-3f6f-44d5-b02b-7fe959f8c4fb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:24.075640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:44:24.081453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f10454b-cf9a-40f0-be6a-8229b90a8e10 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:24.082006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f10454b-cf9a-40f0-be6a-8229b90a8e10 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:24.082467 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f10454b-cf9a-40f0-be6a-8229b90a8e10 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:24.083222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f10454b-cf9a-40f0-be6a-8229b90a8e10 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:24.083701 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f10454b-cf9a-40f0-be6a-8229b90a8e10 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:24.084413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f10454b-cf9a-40f0-be6a-8229b90a8e10 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:24.215936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7f10454b-cf9a-40f0-be6a-8229b90a8e10 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:24.223467 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7f10454b-cf9a-40f0-be6a-8229b90a8e10 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb" status: 200 len: 1265 microversion: 2.1 time: 0.155802 Aug 04 17:44:24.224060 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3295/6620] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:24 2022] GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:25.245226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d821db7d-6a52-4581-a7dd-2e43f63a8587 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:25.245826 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d821db7d-6a52-4581-a7dd-2e43f63a8587 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 37452071-3f6f-44d5-b02b-7fe959f8c4fb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:25.248037 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:44:25.248701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:44:25.255006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d821db7d-6a52-4581-a7dd-2e43f63a8587 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:25.255499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d821db7d-6a52-4581-a7dd-2e43f63a8587 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:25.255940 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d821db7d-6a52-4581-a7dd-2e43f63a8587 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:25.256641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d821db7d-6a52-4581-a7dd-2e43f63a8587 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:25.257101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d821db7d-6a52-4581-a7dd-2e43f63a8587 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:25.257529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d821db7d-6a52-4581-a7dd-2e43f63a8587 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:25.388409 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d821db7d-6a52-4581-a7dd-2e43f63a8587 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:25.396187 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d821db7d-6a52-4581-a7dd-2e43f63a8587 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb" status: 200 len: 1265 microversion: 2.1 time: 0.155420 Aug 04 17:44:25.396767 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3326/6621] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:25 2022] GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:26.417539 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fedd61a8-1af1-446d-99f6-11ecee8e9be2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:26.418128 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fedd61a8-1af1-446d-99f6-11ecee8e9be2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 37452071-3f6f-44d5-b02b-7fe959f8c4fb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:26.424978 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fedd61a8-1af1-446d-99f6-11ecee8e9be2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:26.425478 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fedd61a8-1af1-446d-99f6-11ecee8e9be2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:26.425933 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fedd61a8-1af1-446d-99f6-11ecee8e9be2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:26.426656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fedd61a8-1af1-446d-99f6-11ecee8e9be2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:26.427162 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fedd61a8-1af1-446d-99f6-11ecee8e9be2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:26.427604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fedd61a8-1af1-446d-99f6-11ecee8e9be2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:26.566447 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fedd61a8-1af1-446d-99f6-11ecee8e9be2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:26.574462 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fedd61a8-1af1-446d-99f6-11ecee8e9be2 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb" status: 200 len: 1265 microversion: 2.1 time: 0.160864 Aug 04 17:44:26.575046 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3296/6622] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:26 2022] GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:27.595799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fc8fc02f-1635-45f7-ab04-29b13d6e51d0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:27.596427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fc8fc02f-1635-45f7-ab04-29b13d6e51d0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 37452071-3f6f-44d5-b02b-7fe959f8c4fb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:27.603600 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc8fc02f-1635-45f7-ab04-29b13d6e51d0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:27.604095 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc8fc02f-1635-45f7-ab04-29b13d6e51d0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:27.604542 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc8fc02f-1635-45f7-ab04-29b13d6e51d0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:27.605280 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc8fc02f-1635-45f7-ab04-29b13d6e51d0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:27.605745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc8fc02f-1635-45f7-ab04-29b13d6e51d0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:27.606239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc8fc02f-1635-45f7-ab04-29b13d6e51d0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:27.739830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fc8fc02f-1635-45f7-ab04-29b13d6e51d0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:27.748196 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fc8fc02f-1635-45f7-ab04-29b13d6e51d0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb" status: 200 len: 1265 microversion: 2.1 time: 0.156333 Aug 04 17:44:27.748782 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3327/6623] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:27 2022] GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:28.769276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2631ff1f-c871-40d7-bcf5-e843aa873c96 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:28.769885 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2631ff1f-c871-40d7-bcf5-e843aa873c96 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 37452071-3f6f-44d5-b02b-7fe959f8c4fb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:28.777396 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2631ff1f-c871-40d7-bcf5-e843aa873c96 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:28.777897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2631ff1f-c871-40d7-bcf5-e843aa873c96 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:28.778376 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2631ff1f-c871-40d7-bcf5-e843aa873c96 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:28.779090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2631ff1f-c871-40d7-bcf5-e843aa873c96 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:28.779558 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2631ff1f-c871-40d7-bcf5-e843aa873c96 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:28.779999 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2631ff1f-c871-40d7-bcf5-e843aa873c96 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:28.920876 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2631ff1f-c871-40d7-bcf5-e843aa873c96 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:28.929677 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2631ff1f-c871-40d7-bcf5-e843aa873c96 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb" status: 200 len: 1265 microversion: 2.1 time: 0.164226 Aug 04 17:44:28.930313 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3297/6624] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:28 2022] GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:29.950580 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2456f776-2148-4055-add3-dd0bb97daeca tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:29.951204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2456f776-2148-4055-add3-dd0bb97daeca tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 37452071-3f6f-44d5-b02b-7fe959f8c4fb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:29.958141 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2456f776-2148-4055-add3-dd0bb97daeca tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:29.958641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2456f776-2148-4055-add3-dd0bb97daeca tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:29.959092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2456f776-2148-4055-add3-dd0bb97daeca tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:29.960052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2456f776-2148-4055-add3-dd0bb97daeca tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:29.960522 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2456f776-2148-4055-add3-dd0bb97daeca tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:29.960958 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2456f776-2148-4055-add3-dd0bb97daeca tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:30.095632 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2456f776-2148-4055-add3-dd0bb97daeca tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:30.103539 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2456f776-2148-4055-add3-dd0bb97daeca tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb" status: 200 len: 1265 microversion: 2.1 time: 0.157542 Aug 04 17:44:30.104236 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3328/6625] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:29 2022] GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:44:31.123997 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-776f97b9-daf2-4452-961c-1f1d0d30949d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:31.124678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-776f97b9-daf2-4452-961c-1f1d0d30949d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 37452071-3f6f-44d5-b02b-7fe959f8c4fb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:31.131650 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-776f97b9-daf2-4452-961c-1f1d0d30949d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:31.132145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-776f97b9-daf2-4452-961c-1f1d0d30949d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:31.132605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-776f97b9-daf2-4452-961c-1f1d0d30949d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:31.133374 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-776f97b9-daf2-4452-961c-1f1d0d30949d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:31.133871 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-776f97b9-daf2-4452-961c-1f1d0d30949d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:31.134349 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-776f97b9-daf2-4452-961c-1f1d0d30949d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:31.290837 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-776f97b9-daf2-4452-961c-1f1d0d30949d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:31.302890 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-776f97b9-daf2-4452-961c-1f1d0d30949d tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb" status: 200 len: 1265 microversion: 2.1 time: 0.182747 Aug 04 17:44:31.303504 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3298/6626] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:31 2022] GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:31.750382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-c2f603a5-2b24-4ff2-83e3-74e94137a2eb req-c10bb419-47a0-4a06-9de2-f177aa189689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37452071-3f6f-44d5-b02b-7fe959f8c4fb", "name": "network-vif-plugged", "status": "completed", "tag": "96bbec00-ce55-4613-a0a4-c94bde798191"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:44:31.761563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c2f603a5-2b24-4ff2-83e3-74e94137a2eb req-c10bb419-47a0-4a06-9de2-f177aa189689 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:31.762086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c2f603a5-2b24-4ff2-83e3-74e94137a2eb req-c10bb419-47a0-4a06-9de2-f177aa189689 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:31.762535 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c2f603a5-2b24-4ff2-83e3-74e94137a2eb req-c10bb419-47a0-4a06-9de2-f177aa189689 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:31.774881 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-c2f603a5-2b24-4ff2-83e3-74e94137a2eb req-c10bb419-47a0-4a06-9de2-f177aa189689 service nova] Creating event network-vif-plugged:96bbec00-ce55-4613-a0a4-c94bde798191 for instance 37452071-3f6f-44d5-b02b-7fe959f8c4fb on n-h1-851359-3 Aug 04 17:44:31.779969 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-c2f603a5-2b24-4ff2-83e3-74e94137a2eb req-c10bb419-47a0-4a06-9de2-f177aa189689 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033386 Aug 04 17:44:31.780607 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3329/6627] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:44:32.326613 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-be9249af-92eb-46c6-b7b1-5c476e956c9b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:32.327222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-be9249af-92eb-46c6-b7b1-5c476e956c9b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 37452071-3f6f-44d5-b02b-7fe959f8c4fb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:32.333188 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be9249af-92eb-46c6-b7b1-5c476e956c9b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:32.333863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be9249af-92eb-46c6-b7b1-5c476e956c9b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:32.334627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be9249af-92eb-46c6-b7b1-5c476e956c9b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:32.335339 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be9249af-92eb-46c6-b7b1-5c476e956c9b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:32.335808 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be9249af-92eb-46c6-b7b1-5c476e956c9b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:32.336247 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be9249af-92eb-46c6-b7b1-5c476e956c9b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:32.468478 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-be9249af-92eb-46c6-b7b1-5c476e956c9b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:32.476194 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-be9249af-92eb-46c6-b7b1-5c476e956c9b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb" status: 200 len: 1265 microversion: 2.1 time: 0.155638 Aug 04 17:44:32.476772 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3299/6628] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:32 2022] GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:33.499507 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4da83958-9732-4075-91c2-a240272fe678 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:33.500229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4da83958-9732-4075-91c2-a240272fe678 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 37452071-3f6f-44d5-b02b-7fe959f8c4fb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:33.506441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4da83958-9732-4075-91c2-a240272fe678 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:33.506939 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4da83958-9732-4075-91c2-a240272fe678 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:33.507382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4da83958-9732-4075-91c2-a240272fe678 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:33.508161 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4da83958-9732-4075-91c2-a240272fe678 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:33.509382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4da83958-9732-4075-91c2-a240272fe678 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:33.509943 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4da83958-9732-4075-91c2-a240272fe678 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:33.649465 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4da83958-9732-4075-91c2-a240272fe678 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:33.657009 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4da83958-9732-4075-91c2-a240272fe678 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb" status: 200 len: 1452 microversion: 2.1 time: 0.163156 Aug 04 17:44:33.657580 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3330/6629] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:33 2022] GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:44:33.677556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ba01988c-56d2-47fc-a196-abaddb372631 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:44:33.678225 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ba01988c-56d2-47fc-a196-abaddb372631 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 37452071-3f6f-44d5-b02b-7fe959f8c4fb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:44:33.685547 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba01988c-56d2-47fc-a196-abaddb372631 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:33.686087 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba01988c-56d2-47fc-a196-abaddb372631 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:33.686542 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba01988c-56d2-47fc-a196-abaddb372631 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:33.687249 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba01988c-56d2-47fc-a196-abaddb372631 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:33.687719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba01988c-56d2-47fc-a196-abaddb372631 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:33.688162 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba01988c-56d2-47fc-a196-abaddb372631 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:33.823198 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ba01988c-56d2-47fc-a196-abaddb372631 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:44:33.830768 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ba01988c-56d2-47fc-a196-abaddb372631 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb" status: 200 len: 1452 microversion: 2.1 time: 0.157115 Aug 04 17:44:33.831346 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3300/6630] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:44:33 2022] GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:44:35.510268 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-50b63d14-5579-42fd-8b68-a6441e2bc855 req-914eb04f-8954-4871-acfa-3b148fe31387 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37452071-3f6f-44d5-b02b-7fe959f8c4fb", "tag": "96bbec00-ce55-4613-a0a4-c94bde798191"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:44:35.519628 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-50b63d14-5579-42fd-8b68-a6441e2bc855 req-914eb04f-8954-4871-acfa-3b148fe31387 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:44:35.520043 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-50b63d14-5579-42fd-8b68-a6441e2bc855 req-914eb04f-8954-4871-acfa-3b148fe31387 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:44:35.520475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-50b63d14-5579-42fd-8b68-a6441e2bc855 req-914eb04f-8954-4871-acfa-3b148fe31387 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:44:35.532171 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-50b63d14-5579-42fd-8b68-a6441e2bc855 req-914eb04f-8954-4871-acfa-3b148fe31387 service nova] Creating event network-changed:96bbec00-ce55-4613-a0a4-c94bde798191 for instance 37452071-3f6f-44d5-b02b-7fe959f8c4fb on n-h1-851359-3 Aug 04 17:44:35.537359 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-50b63d14-5579-42fd-8b68-a6441e2bc855 req-914eb04f-8954-4871-acfa-3b148fe31387 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113322 Aug 04 17:44:35.538265 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3331/6631] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:46:03.093851 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:46:03.094512 n-d-851359-3 devstack@n-api.service[131044]: Thu Aug 4 17:46:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 17:46:03.119757 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:46:03.119958 n-d-851359-3 devstack@n-api.service[131044]: Thu Aug 4 17:46:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 17:46:03.122868 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:46:03.123395 n-d-851359-3 devstack@n-api.service[131043]: Thu Aug 4 17:46:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 17:46:27.909109 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=24 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:46:27.909900 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=60 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:46:27.975065 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f306cce1-7e7a-4f87-87df-9a2e14bd9f10 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:27.975581 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f306cce1-7e7a-4f87-87df-9a2e14bd9f10 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 37452071-3f6f-44d5-b02b-7fe959f8c4fb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:27.981585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f306cce1-7e7a-4f87-87df-9a2e14bd9f10 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:27.982126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f306cce1-7e7a-4f87-87df-9a2e14bd9f10 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:27.982583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f306cce1-7e7a-4f87-87df-9a2e14bd9f10 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:27.983295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f306cce1-7e7a-4f87-87df-9a2e14bd9f10 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:27.983768 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f306cce1-7e7a-4f87-87df-9a2e14bd9f10 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:27.984213 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f306cce1-7e7a-4f87-87df-9a2e14bd9f10 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:28.012597 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f306cce1-7e7a-4f87-87df-9a2e14bd9f10 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 37452071-3f6f-44d5-b02b-7fe959f8c4fb] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:46:28.088397 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f306cce1-7e7a-4f87-87df-9a2e14bd9f10 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "DELETE /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb" status: 204 len: 0 microversion: 2.1 time: 0.181041 Aug 04 17:46:28.088984 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3301/6632] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:46:27 2022] DELETE /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:46:28.095743 n-d-851359-3 devstack@n-api.service[131043]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f0b45cb0-ceb0-43c7-a760-628eb3be34b7] AMQP server on 10.222.0.93:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 04 17:46:28.096700 n-d-851359-3 devstack@n-api.service[131043]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d439c32e-c35d-4bcd-acc6-3613271fa0d5] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 17:46:28.097425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:46:28.098243 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=56 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:46:28.102993 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e803b9d7-bf16-43d1-b66e-350478332cdf tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:28.103741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e803b9d7-bf16-43d1-b66e-350478332cdf tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 37452071-3f6f-44d5-b02b-7fe959f8c4fb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:28.111950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e803b9d7-bf16-43d1-b66e-350478332cdf tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:28.112498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e803b9d7-bf16-43d1-b66e-350478332cdf tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:28.112977 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e803b9d7-bf16-43d1-b66e-350478332cdf tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:28.113718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e803b9d7-bf16-43d1-b66e-350478332cdf tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:28.114256 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e803b9d7-bf16-43d1-b66e-350478332cdf tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:28.114726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e803b9d7-bf16-43d1-b66e-350478332cdf tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:28.350112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e803b9d7-bf16-43d1-b66e-350478332cdf tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:28.357711 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e803b9d7-bf16-43d1-b66e-350478332cdf tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb" status: 200 len: 1577 microversion: 2.1 time: 0.264060 Aug 04 17:46:28.358301 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3332/6633] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:28 2022] GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb => generated 1577 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:29.379322 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2f7e6694-8a12-4b08-ab57-4a7d8ddf3405 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:29.380077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2f7e6694-8a12-4b08-ab57-4a7d8ddf3405 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 37452071-3f6f-44d5-b02b-7fe959f8c4fb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:29.387087 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f7e6694-8a12-4b08-ab57-4a7d8ddf3405 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:29.387588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f7e6694-8a12-4b08-ab57-4a7d8ddf3405 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:29.388038 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f7e6694-8a12-4b08-ab57-4a7d8ddf3405 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:29.388751 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f7e6694-8a12-4b08-ab57-4a7d8ddf3405 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:29.389223 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f7e6694-8a12-4b08-ab57-4a7d8ddf3405 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:29.389668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f7e6694-8a12-4b08-ab57-4a7d8ddf3405 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:29.579821 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2f7e6694-8a12-4b08-ab57-4a7d8ddf3405 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:29.587785 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2f7e6694-8a12-4b08-ab57-4a7d8ddf3405 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb" status: 200 len: 1577 microversion: 2.1 time: 0.212756 Aug 04 17:46:29.588289 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3302/6634] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:29 2022] GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb => generated 1577 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:30.608879 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-038cf43b-4257-447b-8f4c-f646692e0df0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:30.609767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-038cf43b-4257-447b-8f4c-f646692e0df0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 37452071-3f6f-44d5-b02b-7fe959f8c4fb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:30.624847 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-038cf43b-4257-447b-8f4c-f646692e0df0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:30.627554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-038cf43b-4257-447b-8f4c-f646692e0df0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:30.628031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-038cf43b-4257-447b-8f4c-f646692e0df0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:30.628767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-038cf43b-4257-447b-8f4c-f646692e0df0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:30.629237 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-038cf43b-4257-447b-8f4c-f646692e0df0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:30.629807 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-038cf43b-4257-447b-8f4c-f646692e0df0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:30.636284 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] [f0b45cb0-ceb0-43c7-a760-628eb3be34b7] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 53718. Aug 04 17:46:30.640193 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] [d439c32e-c35d-4bcd-acc6-3613271fa0d5] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 53720. Aug 04 17:46:30.703936 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-038cf43b-4257-447b-8f4c-f646692e0df0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:30.711987 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-038cf43b-4257-447b-8f4c-f646692e0df0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb" status: 200 len: 1510 microversion: 2.1 time: 0.106758 Aug 04 17:46:30.712873 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3333/6635] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:30 2022] GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb => generated 1510 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:30.872662 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-f166e06b-35cb-4186-8a40-fe4f89e6039f req-470ea83f-0868-4980-8285-c6b25e7b8fce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37452071-3f6f-44d5-b02b-7fe959f8c4fb", "name": "network-vif-deleted", "tag": "96bbec00-ce55-4613-a0a4-c94bde798191"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:46:30.882896 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f166e06b-35cb-4186-8a40-fe4f89e6039f req-470ea83f-0868-4980-8285-c6b25e7b8fce service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:30.883560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f166e06b-35cb-4186-8a40-fe4f89e6039f req-470ea83f-0868-4980-8285-c6b25e7b8fce service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:30.884278 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f166e06b-35cb-4186-8a40-fe4f89e6039f req-470ea83f-0868-4980-8285-c6b25e7b8fce service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:30.899877 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-f166e06b-35cb-4186-8a40-fe4f89e6039f req-470ea83f-0868-4980-8285-c6b25e7b8fce service nova] Creating event network-vif-deleted:96bbec00-ce55-4613-a0a4-c94bde798191 for instance 37452071-3f6f-44d5-b02b-7fe959f8c4fb on n-h1-851359-3 Aug 04 17:46:30.914440 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-f166e06b-35cb-4186-8a40-fe4f89e6039f req-470ea83f-0868-4980-8285-c6b25e7b8fce service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142244 Aug 04 17:46:30.915716 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3303/6636] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:46:31.733024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-650659da-096f-4fe3-9570-b3b8ba1936b4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:31.733647 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-650659da-096f-4fe3-9570-b3b8ba1936b4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 37452071-3f6f-44d5-b02b-7fe959f8c4fb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:31.742565 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-650659da-096f-4fe3-9570-b3b8ba1936b4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:31.743153 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-650659da-096f-4fe3-9570-b3b8ba1936b4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:31.743797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-650659da-096f-4fe3-9570-b3b8ba1936b4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:31.744584 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-650659da-096f-4fe3-9570-b3b8ba1936b4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:31.745119 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-650659da-096f-4fe3-9570-b3b8ba1936b4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:31.745623 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-650659da-096f-4fe3-9570-b3b8ba1936b4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:31.822289 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-650659da-096f-4fe3-9570-b3b8ba1936b4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:31.830471 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-650659da-096f-4fe3-9570-b3b8ba1936b4 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb" status: 200 len: 1225 microversion: 2.1 time: 0.101314 Aug 04 17:46:31.831045 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3334/6637] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:31 2022] GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:32.852919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-52932286-3175-48cf-b1bb-c7088739da52 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:32.853654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-52932286-3175-48cf-b1bb-c7088739da52 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 37452071-3f6f-44d5-b02b-7fe959f8c4fb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:32.860156 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52932286-3175-48cf-b1bb-c7088739da52 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:32.861153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52932286-3175-48cf-b1bb-c7088739da52 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:32.861610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52932286-3175-48cf-b1bb-c7088739da52 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:32.862361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52932286-3175-48cf-b1bb-c7088739da52 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:32.862844 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52932286-3175-48cf-b1bb-c7088739da52 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:32.863292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52932286-3175-48cf-b1bb-c7088739da52 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:32.925610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-52932286-3175-48cf-b1bb-c7088739da52 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:32.933386 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-52932286-3175-48cf-b1bb-c7088739da52 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb" status: 200 len: 1225 microversion: 2.1 time: 0.085609 Aug 04 17:46:32.934046 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3304/6638] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:32 2022] GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:33.955390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c169b60d-3afd-47c3-b313-adcd9cce58e0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:33.955935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c169b60d-3afd-47c3-b313-adcd9cce58e0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 37452071-3f6f-44d5-b02b-7fe959f8c4fb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:33.963009 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c169b60d-3afd-47c3-b313-adcd9cce58e0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:33.963504 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c169b60d-3afd-47c3-b313-adcd9cce58e0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:33.963949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c169b60d-3afd-47c3-b313-adcd9cce58e0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:33.964652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c169b60d-3afd-47c3-b313-adcd9cce58e0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:33.965116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c169b60d-3afd-47c3-b313-adcd9cce58e0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:33.965557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c169b60d-3afd-47c3-b313-adcd9cce58e0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:34.031605 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c169b60d-3afd-47c3-b313-adcd9cce58e0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:34.040132 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c169b60d-3afd-47c3-b313-adcd9cce58e0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb" status: 200 len: 1225 microversion: 2.1 time: 0.089226 Aug 04 17:46:34.040719 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3335/6639] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:33 2022] GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:35.060857 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-db9e1571-265f-4e0d-9097-779a7a16a142 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:35.061476 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-db9e1571-265f-4e0d-9097-779a7a16a142 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 37452071-3f6f-44d5-b02b-7fe959f8c4fb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:35.069072 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db9e1571-265f-4e0d-9097-779a7a16a142 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:35.069585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db9e1571-265f-4e0d-9097-779a7a16a142 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:35.070080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db9e1571-265f-4e0d-9097-779a7a16a142 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:35.070808 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db9e1571-265f-4e0d-9097-779a7a16a142 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:35.071285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db9e1571-265f-4e0d-9097-779a7a16a142 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:35.071732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db9e1571-265f-4e0d-9097-779a7a16a142 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:35.104810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db9e1571-265f-4e0d-9097-779a7a16a142 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:35.105319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db9e1571-265f-4e0d-9097-779a7a16a142 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:35.105790 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db9e1571-265f-4e0d-9097-779a7a16a142 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:35.106316 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-db9e1571-265f-4e0d-9097-779a7a16a142 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lazy-loading 'fault' on Instance uuid 37452071-3f6f-44d5-b02b-7fe959f8c4fb {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:46:35.152705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-db9e1571-265f-4e0d-9097-779a7a16a142 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:35.161523 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-db9e1571-265f-4e0d-9097-779a7a16a142 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb" status: 200 len: 1230 microversion: 2.1 time: 0.104632 Aug 04 17:46:35.162184 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3305/6640] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:35 2022] GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb => generated 1230 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:36.184704 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2f58b93f-0539-41c8-947f-34641fa7a81e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:36.185481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2f58b93f-0539-41c8-947f-34641fa7a81e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 37452071-3f6f-44d5-b02b-7fe959f8c4fb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:36.193364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f58b93f-0539-41c8-947f-34641fa7a81e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:36.193902 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f58b93f-0539-41c8-947f-34641fa7a81e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:36.194452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f58b93f-0539-41c8-947f-34641fa7a81e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:36.195362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f58b93f-0539-41c8-947f-34641fa7a81e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:36.196013 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f58b93f-0539-41c8-947f-34641fa7a81e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:36.196541 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2f58b93f-0539-41c8-947f-34641fa7a81e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:36.211339 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-2f58b93f-0539-41c8-947f-34641fa7a81e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] HTTP exception thrown: Instance 37452071-3f6f-44d5-b02b-7fe959f8c4fb could not be found. Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2f58b93f-0539-41c8-947f-34641fa7a81e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Request method failure captured: Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb HTTP/1.1 Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7ARpoisKS8ru_ZJiIrIfjIFMRjfQL-mVrLbzAzLl4Z4wH-8ksarsVn1PTK67x0ktAL2RMgNiOghxRSfCsuIPgqi5zzrjB6PtD1ptQpXCC7QBiVIYCXgsvXv7bVdD4F6QLnLsEgFyHhnUvqqIgdfnwyBZE3QOXa1h7oqCs3SSjoPFKXM Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 46f694275ec441259c366f63daa4a380 Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-TestVolumeBootPattern-275420730 Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46f694275ec441259c366f63daa4a380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46f694275ec441259c366f63daa4a380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_46f694275ec441259c366f63daa4a380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/46f694275ec441259c366f63daa4a380"}]}] Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-TestVolumeBootPattern-275420730 Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 46f694275ec441259c366f63daa4a380 Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-TestVolumeBootPattern-275420730 Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-TestVolumeBootPattern-275420730-project Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 50bf6f5281964c0b81809080bcf22bdd Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-TestVolumeBootPattern-275420730-project Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 37452071-3f6f-44d5-b02b-7fe959f8c4fb could not be found. Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '37452071-3f6f-44d5-b02b-7fe959f8c4fb'} Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37452071-3f6f-44d5-b02b-7fe959f8c4fb could not be found. Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37452071-3f6f-44d5-b02b-7fe959f8c4fb could not be found. Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:46:36.213313 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:46:36.219375 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:46:36.219375 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:46:36.219375 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:46:36.219375 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:46:36.219375 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:46:36.219375 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37452071-3f6f-44d5-b02b-7fe959f8c4fb could not be found. Aug 04 17:46:36.219375 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:46:36.219375 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2f58b93f-0539-41c8-947f-34641fa7a81e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Returning 404 to user: Instance 37452071-3f6f-44d5-b02b-7fe959f8c4fb could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:46:36.219375 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2f58b93f-0539-41c8-947f-34641fa7a81e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb" status: 404 len: 111 microversion: 2.1 time: 0.034144 Aug 04 17:46:36.219375 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3336/6641] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:36 2022] GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:46:36.270097 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0352d313-230f-481a-a3df-79d1d573de88 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1019267955", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1670531884", "security_groups": [{"name": "tempest-secgroup-smoke-252591706"}], "block_device_mapping_v2": [{"uuid": "fd3fa047-47f4-4fda-af2e-7f9d53a22b26", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6002cd39-a33b-430d-a6d2-0ecfe13cd1ee"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:46:36.389874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-0352d313-230f-481a-a3df-79d1d573de88 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] validate_networks() for [('6002cd39-a33b-430d-a6d2-0ecfe13cd1ee', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:46:36.866489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0352d313-230f-481a-a3df-79d1d573de88 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:46:36.866940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0352d313-230f-481a-a3df-79d1d573de88 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:46:36.867486 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0352d313-230f-481a-a3df-79d1d573de88 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:46:36.867968 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0352d313-230f-481a-a3df-79d1d573de88 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:46:36.868404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0352d313-230f-481a-a3df-79d1d573de88 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:46:36.877965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0352d313-230f-481a-a3df-79d1d573de88 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:36.878498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0352d313-230f-481a-a3df-79d1d573de88 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:36.878957 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0352d313-230f-481a-a3df-79d1d573de88 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:36.879713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0352d313-230f-481a-a3df-79d1d573de88 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:36.880192 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0352d313-230f-481a-a3df-79d1d573de88 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:36.880639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0352d313-230f-481a-a3df-79d1d573de88 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:36.898970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-0352d313-230f-481a-a3df-79d1d573de88 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Getting quotas for project 46f694275ec441259c366f63daa4a380. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:46:36.904734 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-0352d313-230f-481a-a3df-79d1d573de88 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Getting quotas for user 50bf6f5281964c0b81809080bcf22bdd and project 46f694275ec441259c366f63daa4a380. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:46:36.967843 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0352d313-230f-481a-a3df-79d1d573de88 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:46:36.970649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0352d313-230f-481a-a3df-79d1d573de88 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: a1af2259-892a-4357-9ca4-f083e88da50c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fd3fa047-47f4-4fda-af2e-7f9d53a22b26',volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:46:37.106563 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0352d313-230f-481a-a3df-79d1d573de88 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.840811 Aug 04 17:46:37.107275 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3306/6642] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:46:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 17:46:37.118890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-94af97cd-bac8-4724-b41c-b6e187bca3b0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:37.119460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-94af97cd-bac8-4724-b41c-b6e187bca3b0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: a1af2259-892a-4357-9ca4-f083e88da50c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:37.177248 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-94af97cd-bac8-4724-b41c-b6e187bca3b0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:37.183685 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-94af97cd-bac8-4724-b41c-b6e187bca3b0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c" status: 200 len: 1095 microversion: 2.1 time: 0.068724 Aug 04 17:46:37.185687 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3337/6643] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:37 2022] GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:38.204936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f2eb9232-c7d4-4baa-8ee4-7f464b394fcf tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:38.206313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f2eb9232-c7d4-4baa-8ee4-7f464b394fcf tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: a1af2259-892a-4357-9ca4-f083e88da50c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:38.214143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2eb9232-c7d4-4baa-8ee4-7f464b394fcf tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:38.214653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2eb9232-c7d4-4baa-8ee4-7f464b394fcf tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:38.215112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2eb9232-c7d4-4baa-8ee4-7f464b394fcf tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:38.216217 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2eb9232-c7d4-4baa-8ee4-7f464b394fcf tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:38.216376 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2eb9232-c7d4-4baa-8ee4-7f464b394fcf tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:38.216742 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2eb9232-c7d4-4baa-8ee4-7f464b394fcf tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:38.290732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f2eb9232-c7d4-4baa-8ee4-7f464b394fcf tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:38.300247 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f2eb9232-c7d4-4baa-8ee4-7f464b394fcf tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c" status: 200 len: 1211 microversion: 2.1 time: 0.099060 Aug 04 17:46:38.300579 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3307/6644] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:38 2022] GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c => generated 1211 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:39.324543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c6d41b3f-9e00-4999-b35f-5bdbe75d4747 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:39.325168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c6d41b3f-9e00-4999-b35f-5bdbe75d4747 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: a1af2259-892a-4357-9ca4-f083e88da50c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:39.335484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6d41b3f-9e00-4999-b35f-5bdbe75d4747 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:39.336529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6d41b3f-9e00-4999-b35f-5bdbe75d4747 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:39.338225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6d41b3f-9e00-4999-b35f-5bdbe75d4747 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:39.339382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6d41b3f-9e00-4999-b35f-5bdbe75d4747 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:39.340693 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6d41b3f-9e00-4999-b35f-5bdbe75d4747 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:39.341555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c6d41b3f-9e00-4999-b35f-5bdbe75d4747 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:39.536953 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c6d41b3f-9e00-4999-b35f-5bdbe75d4747 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:39.545620 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c6d41b3f-9e00-4999-b35f-5bdbe75d4747 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c" status: 200 len: 1278 microversion: 2.1 time: 0.226275 Aug 04 17:46:39.546673 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3338/6645] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:39 2022] GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c => generated 1278 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:46:39.609424 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-49e66233-7432-4bb8-9e97-6ef33c4cbef1 req-261f1ba2-e672-476b-990f-f412e493b647 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1af2259-892a-4357-9ca4-f083e88da50c", "tag": "4ca7e446-27cc-47d5-a9ae-e91644b040b6"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:46:39.627119 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-49e66233-7432-4bb8-9e97-6ef33c4cbef1 req-261f1ba2-e672-476b-990f-f412e493b647 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:39.627773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-49e66233-7432-4bb8-9e97-6ef33c4cbef1 req-261f1ba2-e672-476b-990f-f412e493b647 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:39.628333 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-49e66233-7432-4bb8-9e97-6ef33c4cbef1 req-261f1ba2-e672-476b-990f-f412e493b647 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:39.640558 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-49e66233-7432-4bb8-9e97-6ef33c4cbef1 req-261f1ba2-e672-476b-990f-f412e493b647 service nova] Creating event network-changed:4ca7e446-27cc-47d5-a9ae-e91644b040b6 for instance a1af2259-892a-4357-9ca4-f083e88da50c on n-h1-851359-3 Aug 04 17:46:39.656254 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-49e66233-7432-4bb8-9e97-6ef33c4cbef1 req-261f1ba2-e672-476b-990f-f412e493b647 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063738 Aug 04 17:46:39.657002 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3308/6646] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:46:40.573579 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9801b812-77da-4025-aed6-85cf83d7d9c9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:40.575151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9801b812-77da-4025-aed6-85cf83d7d9c9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: a1af2259-892a-4357-9ca4-f083e88da50c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:40.583730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9801b812-77da-4025-aed6-85cf83d7d9c9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:40.584880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9801b812-77da-4025-aed6-85cf83d7d9c9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:40.585549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9801b812-77da-4025-aed6-85cf83d7d9c9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:40.586552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9801b812-77da-4025-aed6-85cf83d7d9c9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:40.587602 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9801b812-77da-4025-aed6-85cf83d7d9c9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:40.588315 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9801b812-77da-4025-aed6-85cf83d7d9c9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:40.749522 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9801b812-77da-4025-aed6-85cf83d7d9c9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:40.758534 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9801b812-77da-4025-aed6-85cf83d7d9c9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c" status: 200 len: 1278 microversion: 2.1 time: 0.195099 Aug 04 17:46:40.759130 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3339/6647] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:40 2022] GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c => generated 1278 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:41.781601 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-63e2f49f-a611-4a2c-b615-460b999b164c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:41.782501 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-63e2f49f-a611-4a2c-b615-460b999b164c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: a1af2259-892a-4357-9ca4-f083e88da50c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:41.788817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63e2f49f-a611-4a2c-b615-460b999b164c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:41.789339 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63e2f49f-a611-4a2c-b615-460b999b164c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:41.789809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63e2f49f-a611-4a2c-b615-460b999b164c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:41.790626 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63e2f49f-a611-4a2c-b615-460b999b164c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:41.791108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63e2f49f-a611-4a2c-b615-460b999b164c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:41.791623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63e2f49f-a611-4a2c-b615-460b999b164c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:41.955605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-63e2f49f-a611-4a2c-b615-460b999b164c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:41.964402 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-63e2f49f-a611-4a2c-b615-460b999b164c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c" status: 200 len: 1278 microversion: 2.1 time: 0.188726 Aug 04 17:46:41.964982 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3309/6648] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:41 2022] GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c => generated 1278 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:42.984800 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c905e7b0-8aba-43d0-a1d9-dfb225ebcc7c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:42.985567 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c905e7b0-8aba-43d0-a1d9-dfb225ebcc7c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: a1af2259-892a-4357-9ca4-f083e88da50c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:42.992461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c905e7b0-8aba-43d0-a1d9-dfb225ebcc7c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:42.992957 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c905e7b0-8aba-43d0-a1d9-dfb225ebcc7c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:42.993425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c905e7b0-8aba-43d0-a1d9-dfb225ebcc7c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:42.994168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c905e7b0-8aba-43d0-a1d9-dfb225ebcc7c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:42.994635 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c905e7b0-8aba-43d0-a1d9-dfb225ebcc7c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:42.995069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c905e7b0-8aba-43d0-a1d9-dfb225ebcc7c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:43.141668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c905e7b0-8aba-43d0-a1d9-dfb225ebcc7c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:43.152268 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c905e7b0-8aba-43d0-a1d9-dfb225ebcc7c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c" status: 200 len: 1278 microversion: 2.1 time: 0.171317 Aug 04 17:46:43.153205 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3340/6649] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:42 2022] GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c => generated 1278 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:44.177027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a84fe92d-a97d-43f6-a5a2-29ddcc4fd948 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:44.178260 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a84fe92d-a97d-43f6-a5a2-29ddcc4fd948 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: a1af2259-892a-4357-9ca4-f083e88da50c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:44.186601 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a84fe92d-a97d-43f6-a5a2-29ddcc4fd948 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:44.187139 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a84fe92d-a97d-43f6-a5a2-29ddcc4fd948 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:44.187602 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a84fe92d-a97d-43f6-a5a2-29ddcc4fd948 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:44.188415 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a84fe92d-a97d-43f6-a5a2-29ddcc4fd948 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:44.188950 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a84fe92d-a97d-43f6-a5a2-29ddcc4fd948 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:44.189446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a84fe92d-a97d-43f6-a5a2-29ddcc4fd948 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:44.333696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a84fe92d-a97d-43f6-a5a2-29ddcc4fd948 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:44.341850 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a84fe92d-a97d-43f6-a5a2-29ddcc4fd948 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c" status: 200 len: 1266 microversion: 2.1 time: 0.171086 Aug 04 17:46:44.342479 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3310/6650] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:44 2022] GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:45.366397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4b5be9e8-1b73-4fff-bb0b-373edd16769e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:45.367074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4b5be9e8-1b73-4fff-bb0b-373edd16769e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: a1af2259-892a-4357-9ca4-f083e88da50c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:45.374151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b5be9e8-1b73-4fff-bb0b-373edd16769e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:45.374661 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b5be9e8-1b73-4fff-bb0b-373edd16769e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:45.375103 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b5be9e8-1b73-4fff-bb0b-373edd16769e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:45.375827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b5be9e8-1b73-4fff-bb0b-373edd16769e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:45.376293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b5be9e8-1b73-4fff-bb0b-373edd16769e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:45.376728 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b5be9e8-1b73-4fff-bb0b-373edd16769e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:45.518298 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4b5be9e8-1b73-4fff-bb0b-373edd16769e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:45.526431 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4b5be9e8-1b73-4fff-bb0b-373edd16769e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c" status: 200 len: 1266 microversion: 2.1 time: 0.165960 Aug 04 17:46:45.527006 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3341/6651] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:45 2022] GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:46.548923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-861fdc8f-424f-4141-b16b-778dbcb3883c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:46.549482 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-861fdc8f-424f-4141-b16b-778dbcb3883c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: a1af2259-892a-4357-9ca4-f083e88da50c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:46.556364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-861fdc8f-424f-4141-b16b-778dbcb3883c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:46.556869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-861fdc8f-424f-4141-b16b-778dbcb3883c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:46.557328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-861fdc8f-424f-4141-b16b-778dbcb3883c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:46.558078 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-861fdc8f-424f-4141-b16b-778dbcb3883c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:46.558562 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-861fdc8f-424f-4141-b16b-778dbcb3883c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:46.559028 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-861fdc8f-424f-4141-b16b-778dbcb3883c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:46.691579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-861fdc8f-424f-4141-b16b-778dbcb3883c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:46.699136 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-861fdc8f-424f-4141-b16b-778dbcb3883c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c" status: 200 len: 1266 microversion: 2.1 time: 0.154255 Aug 04 17:46:46.699710 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3311/6652] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:46 2022] GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:47.721111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e177b9a3-6481-456c-8c9b-088532109234 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:47.721741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e177b9a3-6481-456c-8c9b-088532109234 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: a1af2259-892a-4357-9ca4-f083e88da50c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:47.724721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:46:47.730359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e177b9a3-6481-456c-8c9b-088532109234 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:47.730860 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e177b9a3-6481-456c-8c9b-088532109234 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:47.731311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e177b9a3-6481-456c-8c9b-088532109234 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:47.732026 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e177b9a3-6481-456c-8c9b-088532109234 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:47.732501 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e177b9a3-6481-456c-8c9b-088532109234 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:47.732932 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e177b9a3-6481-456c-8c9b-088532109234 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:47.881846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e177b9a3-6481-456c-8c9b-088532109234 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:47.890032 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e177b9a3-6481-456c-8c9b-088532109234 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c" status: 200 len: 1266 microversion: 2.1 time: 0.172835 Aug 04 17:46:47.890616 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3342/6653] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:47 2022] GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:48.911023 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5946d525-e36b-49d7-8b24-2e0f907c2d79 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:48.911594 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5946d525-e36b-49d7-8b24-2e0f907c2d79 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: a1af2259-892a-4357-9ca4-f083e88da50c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:48.913721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:46:48.914510 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:46:48.921116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5946d525-e36b-49d7-8b24-2e0f907c2d79 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:48.921624 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5946d525-e36b-49d7-8b24-2e0f907c2d79 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:48.922116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5946d525-e36b-49d7-8b24-2e0f907c2d79 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:48.922839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5946d525-e36b-49d7-8b24-2e0f907c2d79 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:48.923319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5946d525-e36b-49d7-8b24-2e0f907c2d79 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:48.923766 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5946d525-e36b-49d7-8b24-2e0f907c2d79 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:49.060747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5946d525-e36b-49d7-8b24-2e0f907c2d79 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:49.068808 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5946d525-e36b-49d7-8b24-2e0f907c2d79 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c" status: 200 len: 1266 microversion: 2.1 time: 0.161831 Aug 04 17:46:49.069479 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3312/6654] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:48 2022] GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:46:50.092018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-77389883-c788-4f69-afee-3d1c76aaf5fd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:50.092588 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-77389883-c788-4f69-afee-3d1c76aaf5fd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: a1af2259-892a-4357-9ca4-f083e88da50c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:50.100840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77389883-c788-4f69-afee-3d1c76aaf5fd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:50.101440 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77389883-c788-4f69-afee-3d1c76aaf5fd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:50.101895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77389883-c788-4f69-afee-3d1c76aaf5fd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:50.102648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77389883-c788-4f69-afee-3d1c76aaf5fd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:50.103118 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77389883-c788-4f69-afee-3d1c76aaf5fd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:50.103553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-77389883-c788-4f69-afee-3d1c76aaf5fd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:50.243168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-77389883-c788-4f69-afee-3d1c76aaf5fd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:50.251926 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-77389883-c788-4f69-afee-3d1c76aaf5fd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c" status: 200 len: 1266 microversion: 2.1 time: 0.164417 Aug 04 17:46:50.252704 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3343/6655] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:50 2022] GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:51.276899 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ce072740-9712-4339-b6ca-77e5b1fc3965 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:51.277463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ce072740-9712-4339-b6ca-77e5b1fc3965 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: a1af2259-892a-4357-9ca4-f083e88da50c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:51.284249 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce072740-9712-4339-b6ca-77e5b1fc3965 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:51.284744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce072740-9712-4339-b6ca-77e5b1fc3965 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:51.285193 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce072740-9712-4339-b6ca-77e5b1fc3965 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:51.285897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce072740-9712-4339-b6ca-77e5b1fc3965 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:51.286386 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce072740-9712-4339-b6ca-77e5b1fc3965 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:51.287290 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce072740-9712-4339-b6ca-77e5b1fc3965 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:51.432643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ce072740-9712-4339-b6ca-77e5b1fc3965 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:51.440846 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ce072740-9712-4339-b6ca-77e5b1fc3965 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c" status: 200 len: 1266 microversion: 2.1 time: 0.167946 Aug 04 17:46:51.441411 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3313/6656] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:51 2022] GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:46:52.463530 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fc8e5ee1-4d45-4080-9da8-7761aa98214a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:52.464097 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fc8e5ee1-4d45-4080-9da8-7761aa98214a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: a1af2259-892a-4357-9ca4-f083e88da50c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:52.470905 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc8e5ee1-4d45-4080-9da8-7761aa98214a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:52.471496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc8e5ee1-4d45-4080-9da8-7761aa98214a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:52.471883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc8e5ee1-4d45-4080-9da8-7761aa98214a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:52.472600 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc8e5ee1-4d45-4080-9da8-7761aa98214a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:52.473080 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc8e5ee1-4d45-4080-9da8-7761aa98214a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:52.473509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc8e5ee1-4d45-4080-9da8-7761aa98214a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:52.620533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fc8e5ee1-4d45-4080-9da8-7761aa98214a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:52.629030 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fc8e5ee1-4d45-4080-9da8-7761aa98214a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c" status: 200 len: 1266 microversion: 2.1 time: 0.170815 Aug 04 17:46:52.629655 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3344/6657] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:52 2022] GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:53.650580 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8d6ed4e3-cd23-4606-b9a2-e5c56a3b173c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:53.651153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8d6ed4e3-cd23-4606-b9a2-e5c56a3b173c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: a1af2259-892a-4357-9ca4-f083e88da50c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:53.658548 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d6ed4e3-cd23-4606-b9a2-e5c56a3b173c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:53.659060 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d6ed4e3-cd23-4606-b9a2-e5c56a3b173c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:53.659504 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d6ed4e3-cd23-4606-b9a2-e5c56a3b173c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:53.660327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d6ed4e3-cd23-4606-b9a2-e5c56a3b173c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:53.660808 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d6ed4e3-cd23-4606-b9a2-e5c56a3b173c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:53.661249 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d6ed4e3-cd23-4606-b9a2-e5c56a3b173c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:53.802110 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8d6ed4e3-cd23-4606-b9a2-e5c56a3b173c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:53.809890 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8d6ed4e3-cd23-4606-b9a2-e5c56a3b173c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c" status: 200 len: 1266 microversion: 2.1 time: 0.163360 Aug 04 17:46:53.810517 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3314/6658] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:53 2022] GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:46:54.386140 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-3006948c-8828-4177-a617-069dfb32a742 req-f4c6174f-72d0-440a-8a64-32e8994f63cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1af2259-892a-4357-9ca4-f083e88da50c", "name": "network-vif-plugged", "status": "completed", "tag": "4ca7e446-27cc-47d5-a9ae-e91644b040b6"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:46:54.398006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-3006948c-8828-4177-a617-069dfb32a742 req-f4c6174f-72d0-440a-8a64-32e8994f63cc service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:54.398511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-3006948c-8828-4177-a617-069dfb32a742 req-f4c6174f-72d0-440a-8a64-32e8994f63cc service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:54.398947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-3006948c-8828-4177-a617-069dfb32a742 req-f4c6174f-72d0-440a-8a64-32e8994f63cc service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:54.411613 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-3006948c-8828-4177-a617-069dfb32a742 req-f4c6174f-72d0-440a-8a64-32e8994f63cc service nova] Creating event network-vif-plugged:4ca7e446-27cc-47d5-a9ae-e91644b040b6 for instance a1af2259-892a-4357-9ca4-f083e88da50c on n-h1-851359-3 Aug 04 17:46:54.417476 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-3006948c-8828-4177-a617-069dfb32a742 req-f4c6174f-72d0-440a-8a64-32e8994f63cc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035663 Aug 04 17:46:54.418106 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3345/6659] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:46:54.831922 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-28634957-a5f1-495b-aab1-f5b71a44d7df tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:54.832558 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-28634957-a5f1-495b-aab1-f5b71a44d7df tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: a1af2259-892a-4357-9ca4-f083e88da50c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:54.840620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28634957-a5f1-495b-aab1-f5b71a44d7df tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:54.841135 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28634957-a5f1-495b-aab1-f5b71a44d7df tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:54.841592 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28634957-a5f1-495b-aab1-f5b71a44d7df tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:54.842349 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28634957-a5f1-495b-aab1-f5b71a44d7df tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:54.842831 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28634957-a5f1-495b-aab1-f5b71a44d7df tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:54.843285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28634957-a5f1-495b-aab1-f5b71a44d7df tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:54.979373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-28634957-a5f1-495b-aab1-f5b71a44d7df tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:54.987795 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-28634957-a5f1-495b-aab1-f5b71a44d7df tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c" status: 200 len: 1266 microversion: 2.1 time: 0.159834 Aug 04 17:46:54.988431 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3315/6660] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:54 2022] GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:56.010700 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4a03acd2-0721-4946-92ba-066ef185035e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:56.011424 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4a03acd2-0721-4946-92ba-066ef185035e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: a1af2259-892a-4357-9ca4-f083e88da50c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:56.018421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a03acd2-0721-4946-92ba-066ef185035e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:56.018926 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a03acd2-0721-4946-92ba-066ef185035e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:56.019377 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a03acd2-0721-4946-92ba-066ef185035e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:56.020100 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a03acd2-0721-4946-92ba-066ef185035e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:56.020569 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a03acd2-0721-4946-92ba-066ef185035e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:56.021003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a03acd2-0721-4946-92ba-066ef185035e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:56.165370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4a03acd2-0721-4946-92ba-066ef185035e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:56.174300 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4a03acd2-0721-4946-92ba-066ef185035e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c" status: 200 len: 1452 microversion: 2.1 time: 0.168326 Aug 04 17:46:56.174440 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3346/6661] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:56 2022] GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:56.197539 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ed4f4021-60d9-4ec8-b353-6ea424e48de6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:46:56.198338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ed4f4021-60d9-4ec8-b353-6ea424e48de6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: a1af2259-892a-4357-9ca4-f083e88da50c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:46:56.206192 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed4f4021-60d9-4ec8-b353-6ea424e48de6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:56.206705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed4f4021-60d9-4ec8-b353-6ea424e48de6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:56.207156 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed4f4021-60d9-4ec8-b353-6ea424e48de6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:56.207884 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed4f4021-60d9-4ec8-b353-6ea424e48de6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:56.208361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed4f4021-60d9-4ec8-b353-6ea424e48de6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:56.209004 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed4f4021-60d9-4ec8-b353-6ea424e48de6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:56.350412 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ed4f4021-60d9-4ec8-b353-6ea424e48de6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:46:56.358635 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ed4f4021-60d9-4ec8-b353-6ea424e48de6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c" status: 200 len: 1452 microversion: 2.1 time: 0.165088 Aug 04 17:46:56.359221 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3316/6662] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:46:56 2022] GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:46:58.502718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-8c2a0fe4-ad5f-4187-9f9a-34cb72029734 req-83af9187-5302-42bc-a368-ec0b44498e7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1af2259-892a-4357-9ca4-f083e88da50c", "tag": "4ca7e446-27cc-47d5-a9ae-e91644b040b6"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:46:58.507750 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=33 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:46:58.514501 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8c2a0fe4-ad5f-4187-9f9a-34cb72029734 req-83af9187-5302-42bc-a368-ec0b44498e7c service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:46:58.514990 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8c2a0fe4-ad5f-4187-9f9a-34cb72029734 req-83af9187-5302-42bc-a368-ec0b44498e7c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:46:58.515432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8c2a0fe4-ad5f-4187-9f9a-34cb72029734 req-83af9187-5302-42bc-a368-ec0b44498e7c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:46:58.519130 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=77 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:46:58.532574 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-8c2a0fe4-ad5f-4187-9f9a-34cb72029734 req-83af9187-5302-42bc-a368-ec0b44498e7c service nova] Creating event network-changed:4ca7e446-27cc-47d5-a9ae-e91644b040b6 for instance a1af2259-892a-4357-9ca4-f083e88da50c on n-h1-851359-3 Aug 04 17:46:58.538204 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-8c2a0fe4-ad5f-4187-9f9a-34cb72029734 req-83af9187-5302-42bc-a368-ec0b44498e7c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041106 Aug 04 17:46:58.539208 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3347/6663] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:48:37.090731 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:48:37.091510 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:48:37.096569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9d90df05-3678-4852-98b3-fe69601df1dd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-308074093", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1670531884", "security_groups": [{"name": "tempest-secgroup-smoke-252591706"}], "block_device_mapping_v2": [{"uuid": "36015dd6-4d55-4dba-90ad-36038d28fb90", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6002cd39-a33b-430d-a6d2-0ecfe13cd1ee"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:48:37.215304 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-9d90df05-3678-4852-98b3-fe69601df1dd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] validate_networks() for [('6002cd39-a33b-430d-a6d2-0ecfe13cd1ee', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:48:37.613788 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9d90df05-3678-4852-98b3-fe69601df1dd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:48:37.614278 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9d90df05-3678-4852-98b3-fe69601df1dd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:48:37.614770 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9d90df05-3678-4852-98b3-fe69601df1dd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:48:37.615194 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9d90df05-3678-4852-98b3-fe69601df1dd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:48:37.615620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9d90df05-3678-4852-98b3-fe69601df1dd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:48:37.625026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d90df05-3678-4852-98b3-fe69601df1dd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:37.625527 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d90df05-3678-4852-98b3-fe69601df1dd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:37.626025 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d90df05-3678-4852-98b3-fe69601df1dd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:37.626776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d90df05-3678-4852-98b3-fe69601df1dd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:37.627245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d90df05-3678-4852-98b3-fe69601df1dd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:37.627686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d90df05-3678-4852-98b3-fe69601df1dd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:37.646532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-9d90df05-3678-4852-98b3-fe69601df1dd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Getting quotas for project 46f694275ec441259c366f63daa4a380. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:48:37.652580 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-9d90df05-3678-4852-98b3-fe69601df1dd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Getting quotas for user 50bf6f5281964c0b81809080bcf22bdd and project 46f694275ec441259c366f63daa4a380. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:48:37.716778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9d90df05-3678-4852-98b3-fe69601df1dd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:48:37.719108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9d90df05-3678-4852-98b3-fe69601df1dd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: e07c04d4-301f-4b46-8d61-dfccde2b419d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='36015dd6-4d55-4dba-90ad-36038d28fb90',volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:48:37.875387 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9d90df05-3678-4852-98b3-fe69601df1dd tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.787037 Aug 04 17:48:37.876042 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3317/6664] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:48:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:48:37.889174 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:48:37.890190 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:48:37.894959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-26478941-0ef0-4790-be9f-c88c78757236 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:37.895687 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-26478941-0ef0-4790-be9f-c88c78757236 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: e07c04d4-301f-4b46-8d61-dfccde2b419d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:37.955443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-26478941-0ef0-4790-be9f-c88c78757236 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:37.962425 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-26478941-0ef0-4790-be9f-c88c78757236 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d" status: 200 len: 1094 microversion: 2.1 time: 0.075554 Aug 04 17:48:37.963012 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3348/6665] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:37 2022] GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:48:38.984408 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e187388c-0044-426a-95c2-c3e09d091293 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:38.985047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e187388c-0044-426a-95c2-c3e09d091293 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: e07c04d4-301f-4b46-8d61-dfccde2b419d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:39.040736 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e187388c-0044-426a-95c2-c3e09d091293 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:39.047935 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e187388c-0044-426a-95c2-c3e09d091293 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d" status: 200 len: 1094 microversion: 2.1 time: 0.068514 Aug 04 17:48:39.049379 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3318/6666] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:38 2022] GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:40.069199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e717c7cf-4f59-4edd-b604-fe455ded1a15 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:40.069893 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e717c7cf-4f59-4edd-b604-fe455ded1a15 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: e07c04d4-301f-4b46-8d61-dfccde2b419d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:40.078066 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e717c7cf-4f59-4edd-b604-fe455ded1a15 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:40.078574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e717c7cf-4f59-4edd-b604-fe455ded1a15 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:40.079025 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e717c7cf-4f59-4edd-b604-fe455ded1a15 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:40.079736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e717c7cf-4f59-4edd-b604-fe455ded1a15 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:40.080209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e717c7cf-4f59-4edd-b604-fe455ded1a15 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:40.080648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e717c7cf-4f59-4edd-b604-fe455ded1a15 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:40.144071 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e717c7cf-4f59-4edd-b604-fe455ded1a15 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:40.152367 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e717c7cf-4f59-4edd-b604-fe455ded1a15 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d" status: 200 len: 1144 microversion: 2.1 time: 0.087362 Aug 04 17:48:40.152949 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3349/6667] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:40 2022] GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:41.175927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-93154731-b4c3-48f2-8395-377f9be14c42 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:41.177690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-93154731-b4c3-48f2-8395-377f9be14c42 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: e07c04d4-301f-4b46-8d61-dfccde2b419d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:41.201084 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93154731-b4c3-48f2-8395-377f9be14c42 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:41.201806 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93154731-b4c3-48f2-8395-377f9be14c42 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:41.202393 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93154731-b4c3-48f2-8395-377f9be14c42 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:41.207520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93154731-b4c3-48f2-8395-377f9be14c42 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:41.208233 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93154731-b4c3-48f2-8395-377f9be14c42 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:41.208797 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93154731-b4c3-48f2-8395-377f9be14c42 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:41.292719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-93154731-b4c3-48f2-8395-377f9be14c42 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:41.303496 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-93154731-b4c3-48f2-8395-377f9be14c42 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d" status: 200 len: 1210 microversion: 2.1 time: 0.132477 Aug 04 17:48:41.305944 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3319/6668] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:41 2022] GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d => generated 1210 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:42.326793 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-605e3f60-5250-4218-8984-6eac11c4f183 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:42.327409 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-605e3f60-5250-4218-8984-6eac11c4f183 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: e07c04d4-301f-4b46-8d61-dfccde2b419d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:42.334946 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-605e3f60-5250-4218-8984-6eac11c4f183 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:42.335499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-605e3f60-5250-4218-8984-6eac11c4f183 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:42.336155 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-605e3f60-5250-4218-8984-6eac11c4f183 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:42.337072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-605e3f60-5250-4218-8984-6eac11c4f183 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:42.337555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-605e3f60-5250-4218-8984-6eac11c4f183 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:42.337970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-605e3f60-5250-4218-8984-6eac11c4f183 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:42.526947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-605e3f60-5250-4218-8984-6eac11c4f183 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:42.542657 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-605e3f60-5250-4218-8984-6eac11c4f183 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d" status: 200 len: 1277 microversion: 2.1 time: 0.219695 Aug 04 17:48:42.543558 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3350/6669] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:42 2022] GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d => generated 1277 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:42.611380 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-1e860b9a-c62a-4dab-aa6e-a1b3e70444f7 req-c603dbe3-e2c7-49ee-b04c-2bfe68a570cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e07c04d4-301f-4b46-8d61-dfccde2b419d", "tag": "83d5998a-7f50-442d-bf7d-6f9efce7ef81"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:48:42.626002 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1e860b9a-c62a-4dab-aa6e-a1b3e70444f7 req-c603dbe3-e2c7-49ee-b04c-2bfe68a570cb service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:42.628093 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1e860b9a-c62a-4dab-aa6e-a1b3e70444f7 req-c603dbe3-e2c7-49ee-b04c-2bfe68a570cb service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:42.628878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1e860b9a-c62a-4dab-aa6e-a1b3e70444f7 req-c603dbe3-e2c7-49ee-b04c-2bfe68a570cb service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:42.642834 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-1e860b9a-c62a-4dab-aa6e-a1b3e70444f7 req-c603dbe3-e2c7-49ee-b04c-2bfe68a570cb service nova] Creating event network-changed:83d5998a-7f50-442d-bf7d-6f9efce7ef81 for instance e07c04d4-301f-4b46-8d61-dfccde2b419d on n-h2-851359-3 Aug 04 17:48:42.649618 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-1e860b9a-c62a-4dab-aa6e-a1b3e70444f7 req-c603dbe3-e2c7-49ee-b04c-2bfe68a570cb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043045 Aug 04 17:48:42.650943 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3320/6670] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:48:43.563835 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ea458186-5f62-47ec-b97f-9fe224a994df tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:43.564648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ea458186-5f62-47ec-b97f-9fe224a994df tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: e07c04d4-301f-4b46-8d61-dfccde2b419d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:43.586908 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea458186-5f62-47ec-b97f-9fe224a994df tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:43.586908 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea458186-5f62-47ec-b97f-9fe224a994df tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:43.587341 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea458186-5f62-47ec-b97f-9fe224a994df tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:43.588072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea458186-5f62-47ec-b97f-9fe224a994df tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:43.588549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea458186-5f62-47ec-b97f-9fe224a994df tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:43.588989 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea458186-5f62-47ec-b97f-9fe224a994df tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:43.751241 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ea458186-5f62-47ec-b97f-9fe224a994df tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:43.759258 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ea458186-5f62-47ec-b97f-9fe224a994df tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d" status: 200 len: 1277 microversion: 2.1 time: 0.199359 Aug 04 17:48:43.759842 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3351/6671] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:43 2022] GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d => generated 1277 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:44.783637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2bada0a3-b8dc-45f4-90e8-ee56696dd67a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:44.784322 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2bada0a3-b8dc-45f4-90e8-ee56696dd67a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: e07c04d4-301f-4b46-8d61-dfccde2b419d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:44.790901 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2bada0a3-b8dc-45f4-90e8-ee56696dd67a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:44.791407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2bada0a3-b8dc-45f4-90e8-ee56696dd67a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:44.791875 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2bada0a3-b8dc-45f4-90e8-ee56696dd67a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:44.792585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2bada0a3-b8dc-45f4-90e8-ee56696dd67a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:44.793059 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2bada0a3-b8dc-45f4-90e8-ee56696dd67a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:44.793512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2bada0a3-b8dc-45f4-90e8-ee56696dd67a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:44.952206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2bada0a3-b8dc-45f4-90e8-ee56696dd67a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:44.960545 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2bada0a3-b8dc-45f4-90e8-ee56696dd67a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d" status: 200 len: 1277 microversion: 2.1 time: 0.184975 Aug 04 17:48:44.961153 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3321/6672] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:44 2022] GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d => generated 1277 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:48:45.982569 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-afc53f22-8cd6-491b-8818-31b13600877a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:45.983251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-afc53f22-8cd6-491b-8818-31b13600877a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: e07c04d4-301f-4b46-8d61-dfccde2b419d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:45.990539 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-afc53f22-8cd6-491b-8818-31b13600877a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:45.991079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-afc53f22-8cd6-491b-8818-31b13600877a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:45.991554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-afc53f22-8cd6-491b-8818-31b13600877a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:45.992333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-afc53f22-8cd6-491b-8818-31b13600877a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:45.992796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-afc53f22-8cd6-491b-8818-31b13600877a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:45.993331 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-afc53f22-8cd6-491b-8818-31b13600877a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:46.137066 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-afc53f22-8cd6-491b-8818-31b13600877a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:46.146764 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-afc53f22-8cd6-491b-8818-31b13600877a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d" status: 200 len: 1277 microversion: 2.1 time: 0.168063 Aug 04 17:48:46.147357 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3352/6673] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:45 2022] GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:47.168596 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2f8846a5-332d-4de9-910d-1305b14045ab tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:47.169377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2f8846a5-332d-4de9-910d-1305b14045ab tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: e07c04d4-301f-4b46-8d61-dfccde2b419d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:47.176594 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f8846a5-332d-4de9-910d-1305b14045ab tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:47.177099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f8846a5-332d-4de9-910d-1305b14045ab tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:47.177580 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f8846a5-332d-4de9-910d-1305b14045ab tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:47.178301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f8846a5-332d-4de9-910d-1305b14045ab tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:47.178862 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f8846a5-332d-4de9-910d-1305b14045ab tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:47.179278 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f8846a5-332d-4de9-910d-1305b14045ab tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:47.321070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2f8846a5-332d-4de9-910d-1305b14045ab tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:47.329213 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2f8846a5-332d-4de9-910d-1305b14045ab tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d" status: 200 len: 1265 microversion: 2.1 time: 0.164854 Aug 04 17:48:47.329778 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3322/6674] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:47 2022] GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:48.351479 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-da2310a4-fa8b-4003-bda7-9363eb6696fc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:48.352106 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-da2310a4-fa8b-4003-bda7-9363eb6696fc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: e07c04d4-301f-4b46-8d61-dfccde2b419d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:48.354946 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:48:48.360574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-da2310a4-fa8b-4003-bda7-9363eb6696fc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:48.361078 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-da2310a4-fa8b-4003-bda7-9363eb6696fc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:48.361529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-da2310a4-fa8b-4003-bda7-9363eb6696fc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:48.362285 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-da2310a4-fa8b-4003-bda7-9363eb6696fc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:48.362758 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-da2310a4-fa8b-4003-bda7-9363eb6696fc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:48.363194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-da2310a4-fa8b-4003-bda7-9363eb6696fc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:48.517729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-da2310a4-fa8b-4003-bda7-9363eb6696fc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:48.525795 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-da2310a4-fa8b-4003-bda7-9363eb6696fc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d" status: 200 len: 1265 microversion: 2.1 time: 0.178335 Aug 04 17:48:48.526384 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3353/6675] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:48 2022] GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:49.546509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-96cf2b52-3d6a-4d57-ba6a-6cd3ed6687fa tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:49.547069 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-96cf2b52-3d6a-4d57-ba6a-6cd3ed6687fa tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: e07c04d4-301f-4b46-8d61-dfccde2b419d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:49.549176 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:48:49.550502 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=8 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:48:49.556797 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96cf2b52-3d6a-4d57-ba6a-6cd3ed6687fa tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:49.557306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96cf2b52-3d6a-4d57-ba6a-6cd3ed6687fa tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:49.557769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96cf2b52-3d6a-4d57-ba6a-6cd3ed6687fa tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:49.558526 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96cf2b52-3d6a-4d57-ba6a-6cd3ed6687fa tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:49.559004 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96cf2b52-3d6a-4d57-ba6a-6cd3ed6687fa tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:49.559451 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96cf2b52-3d6a-4d57-ba6a-6cd3ed6687fa tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:49.716900 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-96cf2b52-3d6a-4d57-ba6a-6cd3ed6687fa tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:49.724559 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-96cf2b52-3d6a-4d57-ba6a-6cd3ed6687fa tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d" status: 200 len: 1265 microversion: 2.1 time: 0.182143 Aug 04 17:48:49.725132 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3323/6676] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:49 2022] GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:50.745725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d6474bd0-b9fc-42ce-8d32-3706e88431d8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:50.746338 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d6474bd0-b9fc-42ce-8d32-3706e88431d8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: e07c04d4-301f-4b46-8d61-dfccde2b419d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:50.753699 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6474bd0-b9fc-42ce-8d32-3706e88431d8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:50.754232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6474bd0-b9fc-42ce-8d32-3706e88431d8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:50.754680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6474bd0-b9fc-42ce-8d32-3706e88431d8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:50.755403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6474bd0-b9fc-42ce-8d32-3706e88431d8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:50.755880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6474bd0-b9fc-42ce-8d32-3706e88431d8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:50.756313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6474bd0-b9fc-42ce-8d32-3706e88431d8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:50.897460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d6474bd0-b9fc-42ce-8d32-3706e88431d8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:50.905081 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d6474bd0-b9fc-42ce-8d32-3706e88431d8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d" status: 200 len: 1265 microversion: 2.1 time: 0.164063 Aug 04 17:48:50.905667 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3354/6677] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:50 2022] GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:51.926002 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6462b6b6-9717-4269-bebd-ba910dace9f1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:51.926578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6462b6b6-9717-4269-bebd-ba910dace9f1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: e07c04d4-301f-4b46-8d61-dfccde2b419d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:51.940967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6462b6b6-9717-4269-bebd-ba910dace9f1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:51.941527 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6462b6b6-9717-4269-bebd-ba910dace9f1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:51.942020 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6462b6b6-9717-4269-bebd-ba910dace9f1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:51.942761 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6462b6b6-9717-4269-bebd-ba910dace9f1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:51.943245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6462b6b6-9717-4269-bebd-ba910dace9f1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:51.943693 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6462b6b6-9717-4269-bebd-ba910dace9f1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:52.086618 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6462b6b6-9717-4269-bebd-ba910dace9f1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:52.094582 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6462b6b6-9717-4269-bebd-ba910dace9f1 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d" status: 200 len: 1265 microversion: 2.1 time: 0.172704 Aug 04 17:48:52.095148 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3324/6678] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:51 2022] GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:53.115198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dd952853-98cd-457d-b8c2-a7f1c39f66b8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:53.115818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dd952853-98cd-457d-b8c2-a7f1c39f66b8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: e07c04d4-301f-4b46-8d61-dfccde2b419d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:53.123198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd952853-98cd-457d-b8c2-a7f1c39f66b8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:53.123685 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd952853-98cd-457d-b8c2-a7f1c39f66b8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:53.124124 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd952853-98cd-457d-b8c2-a7f1c39f66b8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:53.124828 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd952853-98cd-457d-b8c2-a7f1c39f66b8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:53.125289 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd952853-98cd-457d-b8c2-a7f1c39f66b8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:53.125714 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd952853-98cd-457d-b8c2-a7f1c39f66b8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:53.258598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dd952853-98cd-457d-b8c2-a7f1c39f66b8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:53.266222 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dd952853-98cd-457d-b8c2-a7f1c39f66b8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d" status: 200 len: 1265 microversion: 2.1 time: 0.154888 Aug 04 17:48:53.266805 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3355/6679] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:53 2022] GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:54.287186 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1c962366-c2f6-478b-a781-70b83de37a50 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:54.287823 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1c962366-c2f6-478b-a781-70b83de37a50 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: e07c04d4-301f-4b46-8d61-dfccde2b419d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:54.294874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c962366-c2f6-478b-a781-70b83de37a50 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:54.295375 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c962366-c2f6-478b-a781-70b83de37a50 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:54.295825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c962366-c2f6-478b-a781-70b83de37a50 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:54.296539 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c962366-c2f6-478b-a781-70b83de37a50 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:54.297019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c962366-c2f6-478b-a781-70b83de37a50 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:54.297458 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c962366-c2f6-478b-a781-70b83de37a50 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:54.437387 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1c962366-c2f6-478b-a781-70b83de37a50 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:54.446012 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1c962366-c2f6-478b-a781-70b83de37a50 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d" status: 200 len: 1265 microversion: 2.1 time: 0.162713 Aug 04 17:48:54.446600 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3325/6680] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:54 2022] GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:55.467375 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a1a934f2-9899-4202-b55f-ce55ae642775 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:55.467985 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a1a934f2-9899-4202-b55f-ce55ae642775 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: e07c04d4-301f-4b46-8d61-dfccde2b419d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:55.475315 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a1a934f2-9899-4202-b55f-ce55ae642775 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:55.476703 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a1a934f2-9899-4202-b55f-ce55ae642775 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:55.477144 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a1a934f2-9899-4202-b55f-ce55ae642775 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:55.477841 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a1a934f2-9899-4202-b55f-ce55ae642775 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:55.478318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a1a934f2-9899-4202-b55f-ce55ae642775 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:55.478745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a1a934f2-9899-4202-b55f-ce55ae642775 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:55.613765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a1a934f2-9899-4202-b55f-ce55ae642775 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:55.621498 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a1a934f2-9899-4202-b55f-ce55ae642775 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d" status: 200 len: 1265 microversion: 2.1 time: 0.158380 Aug 04 17:48:55.622082 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3356/6681] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:55 2022] GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:56.642645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f99005e8-73c2-469c-979d-6cd8554a2ccc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:56.643286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f99005e8-73c2-469c-979d-6cd8554a2ccc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: e07c04d4-301f-4b46-8d61-dfccde2b419d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:56.650677 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f99005e8-73c2-469c-979d-6cd8554a2ccc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:56.651185 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f99005e8-73c2-469c-979d-6cd8554a2ccc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:56.651645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f99005e8-73c2-469c-979d-6cd8554a2ccc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:56.652365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f99005e8-73c2-469c-979d-6cd8554a2ccc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:56.652870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f99005e8-73c2-469c-979d-6cd8554a2ccc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:56.653319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f99005e8-73c2-469c-979d-6cd8554a2ccc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:56.791662 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f99005e8-73c2-469c-979d-6cd8554a2ccc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:56.799152 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f99005e8-73c2-469c-979d-6cd8554a2ccc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d" status: 200 len: 1265 microversion: 2.1 time: 0.160532 Aug 04 17:48:56.799911 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3326/6682] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:56 2022] GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:57.363792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-a24ca45b-b7c0-4f52-a3de-a43cc804b4bc req-8e54b377-469e-43a8-b773-784043e23750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e07c04d4-301f-4b46-8d61-dfccde2b419d", "name": "network-vif-plugged", "status": "completed", "tag": "83d5998a-7f50-442d-bf7d-6f9efce7ef81"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:48:57.375979 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a24ca45b-b7c0-4f52-a3de-a43cc804b4bc req-8e54b377-469e-43a8-b773-784043e23750 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:57.376463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a24ca45b-b7c0-4f52-a3de-a43cc804b4bc req-8e54b377-469e-43a8-b773-784043e23750 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:57.376895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a24ca45b-b7c0-4f52-a3de-a43cc804b4bc req-8e54b377-469e-43a8-b773-784043e23750 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:57.388228 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-a24ca45b-b7c0-4f52-a3de-a43cc804b4bc req-8e54b377-469e-43a8-b773-784043e23750 service nova] Creating event network-vif-plugged:83d5998a-7f50-442d-bf7d-6f9efce7ef81 for instance e07c04d4-301f-4b46-8d61-dfccde2b419d on n-h2-851359-3 Aug 04 17:48:57.393281 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-a24ca45b-b7c0-4f52-a3de-a43cc804b4bc req-8e54b377-469e-43a8-b773-784043e23750 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097354 Aug 04 17:48:57.393891 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3357/6683] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:48:57.821861 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a7587970-6cd0-406d-8b0e-3363a151addc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:57.823055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a7587970-6cd0-406d-8b0e-3363a151addc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: e07c04d4-301f-4b46-8d61-dfccde2b419d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:57.832128 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7587970-6cd0-406d-8b0e-3363a151addc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:57.832638 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7587970-6cd0-406d-8b0e-3363a151addc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:57.833102 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7587970-6cd0-406d-8b0e-3363a151addc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:57.833832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7587970-6cd0-406d-8b0e-3363a151addc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:57.834352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7587970-6cd0-406d-8b0e-3363a151addc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:57.834967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7587970-6cd0-406d-8b0e-3363a151addc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:57.978750 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a7587970-6cd0-406d-8b0e-3363a151addc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:57.986486 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a7587970-6cd0-406d-8b0e-3363a151addc tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d" status: 200 len: 1265 microversion: 2.1 time: 0.170256 Aug 04 17:48:57.987521 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3327/6684] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:57 2022] GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:59.011416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-23d8270c-3e06-4904-b0c4-ca6cafe02d53 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:59.012201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-23d8270c-3e06-4904-b0c4-ca6cafe02d53 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: e07c04d4-301f-4b46-8d61-dfccde2b419d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:59.020250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23d8270c-3e06-4904-b0c4-ca6cafe02d53 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:59.020912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23d8270c-3e06-4904-b0c4-ca6cafe02d53 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:59.021574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23d8270c-3e06-4904-b0c4-ca6cafe02d53 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:59.022491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23d8270c-3e06-4904-b0c4-ca6cafe02d53 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:59.023011 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23d8270c-3e06-4904-b0c4-ca6cafe02d53 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:59.024238 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23d8270c-3e06-4904-b0c4-ca6cafe02d53 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:59.163515 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-23d8270c-3e06-4904-b0c4-ca6cafe02d53 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:59.171107 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-23d8270c-3e06-4904-b0c4-ca6cafe02d53 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d" status: 200 len: 1451 microversion: 2.1 time: 0.168018 Aug 04 17:48:59.171687 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3358/6685] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:59 2022] GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d => generated 1451 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:48:59.192221 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a933a548-cc45-4f61-9eb1-e87c72e1fe19 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:48:59.192860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a933a548-cc45-4f61-9eb1-e87c72e1fe19 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: e07c04d4-301f-4b46-8d61-dfccde2b419d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:48:59.200849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a933a548-cc45-4f61-9eb1-e87c72e1fe19 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:59.201379 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a933a548-cc45-4f61-9eb1-e87c72e1fe19 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:59.201819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a933a548-cc45-4f61-9eb1-e87c72e1fe19 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:59.202569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a933a548-cc45-4f61-9eb1-e87c72e1fe19 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:48:59.203048 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a933a548-cc45-4f61-9eb1-e87c72e1fe19 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:48:59.203495 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a933a548-cc45-4f61-9eb1-e87c72e1fe19 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:48:59.337219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a933a548-cc45-4f61-9eb1-e87c72e1fe19 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:48:59.345128 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a933a548-cc45-4f61-9eb1-e87c72e1fe19 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d" status: 200 len: 1451 microversion: 2.1 time: 0.157055 Aug 04 17:48:59.345711 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3328/6686] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:48:59 2022] GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:49:00.998664 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-1e3b7fb6-0ccf-46f9-97e9-f0e6f16d04f7 req-c511f32d-262b-4732-8440-9e1e65e5f98b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e07c04d4-301f-4b46-8d61-dfccde2b419d", "tag": "83d5998a-7f50-442d-bf7d-6f9efce7ef81"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:49:01.009143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1e3b7fb6-0ccf-46f9-97e9-f0e6f16d04f7 req-c511f32d-262b-4732-8440-9e1e65e5f98b service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:49:01.009730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1e3b7fb6-0ccf-46f9-97e9-f0e6f16d04f7 req-c511f32d-262b-4732-8440-9e1e65e5f98b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:49:01.010285 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1e3b7fb6-0ccf-46f9-97e9-f0e6f16d04f7 req-c511f32d-262b-4732-8440-9e1e65e5f98b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:49:01.021504 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-1e3b7fb6-0ccf-46f9-97e9-f0e6f16d04f7 req-c511f32d-262b-4732-8440-9e1e65e5f98b service nova] Creating event network-changed:83d5998a-7f50-442d-bf7d-6f9efce7ef81 for instance e07c04d4-301f-4b46-8d61-dfccde2b419d on n-h2-851359-3 Aug 04 17:49:01.027278 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-1e3b7fb6-0ccf-46f9-97e9-f0e6f16d04f7 req-c511f32d-262b-4732-8440-9e1e65e5f98b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032449 Aug 04 17:49:01.028102 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3359/6687] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:49:23.102435 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:49:23.103046 n-d-851359-3 devstack@n-api.service[131044]: Thu Aug 4 17:49:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 17:49:23.132470 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:49:23.132984 n-d-851359-3 devstack@n-api.service[131043]: Thu Aug 4 17:49:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 17:49:23.233609 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:49:23.233817 n-d-851359-3 devstack@n-api.service[131043]: Thu Aug 4 17:49:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 17:50:28.941295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8441c604-6e8b-4bec-91b1-5028654c6fe7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:50:28.942457 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8441c604-6e8b-4bec-91b1-5028654c6fe7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: e07c04d4-301f-4b46-8d61-dfccde2b419d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:28.944770 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:50:28.945439 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=58 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:50:28.945581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=26 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:50:28.946914 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=58 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:50:28.952660 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8441c604-6e8b-4bec-91b1-5028654c6fe7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:28.953427 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8441c604-6e8b-4bec-91b1-5028654c6fe7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:28.954888 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8441c604-6e8b-4bec-91b1-5028654c6fe7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:28.955931 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8441c604-6e8b-4bec-91b1-5028654c6fe7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:28.956496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8441c604-6e8b-4bec-91b1-5028654c6fe7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:28.956984 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8441c604-6e8b-4bec-91b1-5028654c6fe7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:28.986541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8441c604-6e8b-4bec-91b1-5028654c6fe7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: e07c04d4-301f-4b46-8d61-dfccde2b419d] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:50:29.023908 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-5f626f8b-ebde-4b3d-a16f-7b95942d01ab req-5632023a-8278-4662-80ff-a910c57fed82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e07c04d4-301f-4b46-8d61-dfccde2b419d", "tag": "83d5998a-7f50-442d-bf7d-6f9efce7ef81"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:50:29.037209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-5f626f8b-ebde-4b3d-a16f-7b95942d01ab req-5632023a-8278-4662-80ff-a910c57fed82 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:29.037719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-5f626f8b-ebde-4b3d-a16f-7b95942d01ab req-5632023a-8278-4662-80ff-a910c57fed82 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:29.038417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-5f626f8b-ebde-4b3d-a16f-7b95942d01ab req-5632023a-8278-4662-80ff-a910c57fed82 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:29.053183 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-5f626f8b-ebde-4b3d-a16f-7b95942d01ab req-5632023a-8278-4662-80ff-a910c57fed82 service nova] Creating event network-changed:83d5998a-7f50-442d-bf7d-6f9efce7ef81 for instance e07c04d4-301f-4b46-8d61-dfccde2b419d on n-h2-851359-3 Aug 04 17:50:29.060237 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-5f626f8b-ebde-4b3d-a16f-7b95942d01ab req-5632023a-8278-4662-80ff-a910c57fed82 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120583 Aug 04 17:50:29.061187 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3360/6688] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:50:29.083923 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8441c604-6e8b-4bec-91b1-5028654c6fe7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d" status: 204 len: 0 microversion: 2.1 time: 0.147400 Aug 04 17:50:29.084626 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3329/6689] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:50:28 2022] DELETE /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:50:29.093859 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-45c77b72-ce1d-4dfd-a166-1c3bd5df011c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:50:29.094656 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-45c77b72-ce1d-4dfd-a166-1c3bd5df011c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: e07c04d4-301f-4b46-8d61-dfccde2b419d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:29.102223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-45c77b72-ce1d-4dfd-a166-1c3bd5df011c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:29.102729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-45c77b72-ce1d-4dfd-a166-1c3bd5df011c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:29.103177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-45c77b72-ce1d-4dfd-a166-1c3bd5df011c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:29.103884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-45c77b72-ce1d-4dfd-a166-1c3bd5df011c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:29.104344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-45c77b72-ce1d-4dfd-a166-1c3bd5df011c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:29.104780 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-45c77b72-ce1d-4dfd-a166-1c3bd5df011c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:29.247002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-45c77b72-ce1d-4dfd-a166-1c3bd5df011c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:50:29.254944 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-45c77b72-ce1d-4dfd-a166-1c3bd5df011c tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d" status: 200 len: 1576 microversion: 2.1 time: 0.165598 Aug 04 17:50:29.255881 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3361/6690] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:50:29 2022] GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:50:30.277503 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-209458b2-f664-4458-a009-73d071f556d8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:50:30.278182 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-209458b2-f664-4458-a009-73d071f556d8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: e07c04d4-301f-4b46-8d61-dfccde2b419d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:30.285169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-209458b2-f664-4458-a009-73d071f556d8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:30.285678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-209458b2-f664-4458-a009-73d071f556d8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:30.286171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-209458b2-f664-4458-a009-73d071f556d8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:30.286912 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-209458b2-f664-4458-a009-73d071f556d8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:30.287373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-209458b2-f664-4458-a009-73d071f556d8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:30.287816 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-209458b2-f664-4458-a009-73d071f556d8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:30.423428 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-209458b2-f664-4458-a009-73d071f556d8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:50:30.431804 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-209458b2-f664-4458-a009-73d071f556d8 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d" status: 200 len: 1576 microversion: 2.1 time: 0.158692 Aug 04 17:50:30.432380 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3330/6691] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:50:30 2022] GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:50:31.453057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e5202309-35f3-4d4c-ad14-46ca7862bef3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:50:31.453693 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e5202309-35f3-4d4c-ad14-46ca7862bef3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: e07c04d4-301f-4b46-8d61-dfccde2b419d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:31.460306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e5202309-35f3-4d4c-ad14-46ca7862bef3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:31.460801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e5202309-35f3-4d4c-ad14-46ca7862bef3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:31.461245 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e5202309-35f3-4d4c-ad14-46ca7862bef3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:31.461950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e5202309-35f3-4d4c-ad14-46ca7862bef3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:31.462436 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e5202309-35f3-4d4c-ad14-46ca7862bef3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:31.462868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e5202309-35f3-4d4c-ad14-46ca7862bef3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:31.669527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e5202309-35f3-4d4c-ad14-46ca7862bef3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:50:31.677653 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e5202309-35f3-4d4c-ad14-46ca7862bef3 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d" status: 200 len: 1457 microversion: 2.1 time: 0.228876 Aug 04 17:50:31.678607 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3362/6692] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:50:31 2022] GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d => generated 1457 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:50:31.828453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-e69d7e9a-3e68-4084-bcba-a8b790767653 req-85a5c092-77f3-477f-af66-d3a5e3b7da65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e07c04d4-301f-4b46-8d61-dfccde2b419d", "name": "network-vif-deleted", "tag": "83d5998a-7f50-442d-bf7d-6f9efce7ef81"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:50:31.839036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e69d7e9a-3e68-4084-bcba-a8b790767653 req-85a5c092-77f3-477f-af66-d3a5e3b7da65 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:31.839529 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e69d7e9a-3e68-4084-bcba-a8b790767653 req-85a5c092-77f3-477f-af66-d3a5e3b7da65 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:31.839972 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e69d7e9a-3e68-4084-bcba-a8b790767653 req-85a5c092-77f3-477f-af66-d3a5e3b7da65 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:31.851822 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-e69d7e9a-3e68-4084-bcba-a8b790767653 req-85a5c092-77f3-477f-af66-d3a5e3b7da65 service nova] Creating event network-vif-deleted:83d5998a-7f50-442d-bf7d-6f9efce7ef81 for instance e07c04d4-301f-4b46-8d61-dfccde2b419d on n-h2-851359-3 Aug 04 17:50:31.857112 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-e69d7e9a-3e68-4084-bcba-a8b790767653 req-85a5c092-77f3-477f-af66-d3a5e3b7da65 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032574 Aug 04 17:50:31.857830 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3331/6693] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:50:32.699052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-207723f6-2fea-4e98-8606-7618aa4d61b7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:50:32.699688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-207723f6-2fea-4e98-8606-7618aa4d61b7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: e07c04d4-301f-4b46-8d61-dfccde2b419d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:32.706857 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-207723f6-2fea-4e98-8606-7618aa4d61b7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:32.707350 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-207723f6-2fea-4e98-8606-7618aa4d61b7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:32.707785 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-207723f6-2fea-4e98-8606-7618aa4d61b7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:32.708489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-207723f6-2fea-4e98-8606-7618aa4d61b7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:32.708979 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-207723f6-2fea-4e98-8606-7618aa4d61b7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:32.709400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-207723f6-2fea-4e98-8606-7618aa4d61b7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:32.774618 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-207723f6-2fea-4e98-8606-7618aa4d61b7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:50:32.782197 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-207723f6-2fea-4e98-8606-7618aa4d61b7 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d" status: 200 len: 1225 microversion: 2.1 time: 0.087023 Aug 04 17:50:32.782757 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3363/6694] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:50:32 2022] GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:50:33.805328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b48c916c-7c7a-486b-ad75-ef98678464d0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:50:33.805949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b48c916c-7c7a-486b-ad75-ef98678464d0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: e07c04d4-301f-4b46-8d61-dfccde2b419d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:33.812453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b48c916c-7c7a-486b-ad75-ef98678464d0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:33.813036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b48c916c-7c7a-486b-ad75-ef98678464d0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:33.813495 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b48c916c-7c7a-486b-ad75-ef98678464d0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:33.814255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b48c916c-7c7a-486b-ad75-ef98678464d0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:33.814728 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b48c916c-7c7a-486b-ad75-ef98678464d0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:33.815173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b48c916c-7c7a-486b-ad75-ef98678464d0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:33.879572 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b48c916c-7c7a-486b-ad75-ef98678464d0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:50:33.887402 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b48c916c-7c7a-486b-ad75-ef98678464d0 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d" status: 200 len: 1225 microversion: 2.1 time: 0.087972 Aug 04 17:50:33.887975 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3332/6695] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:50:33 2022] GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:50:34.909213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-64118a55-1b92-4c8a-96ac-7b6013f0ac92 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:50:34.910288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-64118a55-1b92-4c8a-96ac-7b6013f0ac92 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: e07c04d4-301f-4b46-8d61-dfccde2b419d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:34.917253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64118a55-1b92-4c8a-96ac-7b6013f0ac92 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:34.917746 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64118a55-1b92-4c8a-96ac-7b6013f0ac92 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:34.918215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64118a55-1b92-4c8a-96ac-7b6013f0ac92 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:34.918929 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64118a55-1b92-4c8a-96ac-7b6013f0ac92 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:34.919391 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64118a55-1b92-4c8a-96ac-7b6013f0ac92 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:34.919825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64118a55-1b92-4c8a-96ac-7b6013f0ac92 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:34.985578 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-64118a55-1b92-4c8a-96ac-7b6013f0ac92 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:50:34.993898 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-64118a55-1b92-4c8a-96ac-7b6013f0ac92 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d" status: 200 len: 1225 microversion: 2.1 time: 0.088779 Aug 04 17:50:34.994480 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3364/6696] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:50:34 2022] GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:50:36.015166 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e73dd101-d384-40a5-8c75-cb7207cf10de tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:50:36.015808 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e73dd101-d384-40a5-8c75-cb7207cf10de tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: e07c04d4-301f-4b46-8d61-dfccde2b419d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:36.022947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e73dd101-d384-40a5-8c75-cb7207cf10de tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:36.023537 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e73dd101-d384-40a5-8c75-cb7207cf10de tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:36.024053 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e73dd101-d384-40a5-8c75-cb7207cf10de tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:36.024789 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e73dd101-d384-40a5-8c75-cb7207cf10de tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:36.025269 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e73dd101-d384-40a5-8c75-cb7207cf10de tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:36.025720 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e73dd101-d384-40a5-8c75-cb7207cf10de tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:36.058197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e73dd101-d384-40a5-8c75-cb7207cf10de tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:36.058811 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e73dd101-d384-40a5-8c75-cb7207cf10de tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:36.059308 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e73dd101-d384-40a5-8c75-cb7207cf10de tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:36.059747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-e73dd101-d384-40a5-8c75-cb7207cf10de tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lazy-loading 'fault' on Instance uuid e07c04d4-301f-4b46-8d61-dfccde2b419d {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:50:36.105835 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e73dd101-d384-40a5-8c75-cb7207cf10de tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:50:36.113477 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e73dd101-d384-40a5-8c75-cb7207cf10de tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d" status: 200 len: 1230 microversion: 2.1 time: 0.102342 Aug 04 17:50:36.114146 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3333/6697] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:50:36 2022] GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d => generated 1230 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:50:37.135245 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-92408d3c-eaed-40b3-92b0-b26dd750b7fe tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:50:37.135888 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-92408d3c-eaed-40b3-92b0-b26dd750b7fe tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: e07c04d4-301f-4b46-8d61-dfccde2b419d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:37.142676 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92408d3c-eaed-40b3-92b0-b26dd750b7fe tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:37.143191 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92408d3c-eaed-40b3-92b0-b26dd750b7fe tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:37.143633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92408d3c-eaed-40b3-92b0-b26dd750b7fe tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:37.144358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92408d3c-eaed-40b3-92b0-b26dd750b7fe tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:37.144817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92408d3c-eaed-40b3-92b0-b26dd750b7fe tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:37.145258 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92408d3c-eaed-40b3-92b0-b26dd750b7fe tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:37.158136 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-92408d3c-eaed-40b3-92b0-b26dd750b7fe tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] HTTP exception thrown: Instance e07c04d4-301f-4b46-8d61-dfccde2b419d could not be found. Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-92408d3c-eaed-40b3-92b0-b26dd750b7fe tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Request method failure captured: Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d HTTP/1.1 Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7ARpoisKS8ru_ZJiIrIfjIFMRjfQL-mVrLbzAzLl4Z4wH-8ksarsVn1PTK67x0ktAL2RMgNiOghxRSfCsuIPgqi5zzrjB6PtD1ptQpXCC7QBiVIYCXgsvXv7bVdD4F6QLnLsEgFyHhnUvqqIgdfnwyBZE3QOXa1h7oqCs3SSjoPFKXM Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 46f694275ec441259c366f63daa4a380 Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-TestVolumeBootPattern-275420730 Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46f694275ec441259c366f63daa4a380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46f694275ec441259c366f63daa4a380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_46f694275ec441259c366f63daa4a380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/46f694275ec441259c366f63daa4a380"}]}] Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-TestVolumeBootPattern-275420730 Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 46f694275ec441259c366f63daa4a380 Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-TestVolumeBootPattern-275420730 Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-TestVolumeBootPattern-275420730-project Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 50bf6f5281964c0b81809080bcf22bdd Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-TestVolumeBootPattern-275420730-project Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance e07c04d4-301f-4b46-8d61-dfccde2b419d could not be found. Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'e07c04d4-301f-4b46-8d61-dfccde2b419d'} Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e07c04d4-301f-4b46-8d61-dfccde2b419d could not be found. Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e07c04d4-301f-4b46-8d61-dfccde2b419d could not be found. Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:50:37.160275 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:50:37.166170 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:50:37.166170 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:50:37.166170 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:50:37.166170 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:50:37.166170 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:50:37.166170 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e07c04d4-301f-4b46-8d61-dfccde2b419d could not be found. Aug 04 17:50:37.166170 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:50:37.166170 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-92408d3c-eaed-40b3-92b0-b26dd750b7fe tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Returning 404 to user: Instance e07c04d4-301f-4b46-8d61-dfccde2b419d could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:50:37.166170 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-92408d3c-eaed-40b3-92b0-b26dd750b7fe tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d" status: 404 len: 111 microversion: 2.1 time: 0.030409 Aug 04 17:50:37.166170 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3365/6698] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:50:37 2022] GET /compute/v2.1/servers/e07c04d4-301f-4b46-8d61-dfccde2b419d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:50:43.396637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8b72facd-e2af-4333-a7f1-af43944c910e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:50:43.397168 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8b72facd-e2af-4333-a7f1-af43944c910e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: a1af2259-892a-4357-9ca4-f083e88da50c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:43.398767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-930eb651-8f01-426f-99ef-c5cdfe4d9065 req-23d509d7-2aea-42cb-a87f-e538761b5d1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1af2259-892a-4357-9ca4-f083e88da50c", "tag": "4ca7e446-27cc-47d5-a9ae-e91644b040b6"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:50:43.404422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b72facd-e2af-4333-a7f1-af43944c910e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:43.404937 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b72facd-e2af-4333-a7f1-af43944c910e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:43.405400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b72facd-e2af-4333-a7f1-af43944c910e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:43.406160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b72facd-e2af-4333-a7f1-af43944c910e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:43.406639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b72facd-e2af-4333-a7f1-af43944c910e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:43.407087 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b72facd-e2af-4333-a7f1-af43944c910e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:43.411624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-930eb651-8f01-426f-99ef-c5cdfe4d9065 req-23d509d7-2aea-42cb-a87f-e538761b5d1a service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:43.412184 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-930eb651-8f01-426f-99ef-c5cdfe4d9065 req-23d509d7-2aea-42cb-a87f-e538761b5d1a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:43.412688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-930eb651-8f01-426f-99ef-c5cdfe4d9065 req-23d509d7-2aea-42cb-a87f-e538761b5d1a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:43.423920 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-930eb651-8f01-426f-99ef-c5cdfe4d9065 req-23d509d7-2aea-42cb-a87f-e538761b5d1a service nova] Creating event network-changed:4ca7e446-27cc-47d5-a9ae-e91644b040b6 for instance a1af2259-892a-4357-9ca4-f083e88da50c on n-h1-851359-3 Aug 04 17:50:43.429783 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-930eb651-8f01-426f-99ef-c5cdfe4d9065 req-23d509d7-2aea-42cb-a87f-e538761b5d1a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034697 Aug 04 17:50:43.430717 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3366/6699] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:50:43.440509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8b72facd-e2af-4333-a7f1-af43944c910e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: a1af2259-892a-4357-9ca4-f083e88da50c] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:50:43.532122 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8b72facd-e2af-4333-a7f1-af43944c910e tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "DELETE /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c" status: 204 len: 0 microversion: 2.1 time: 0.139127 Aug 04 17:50:43.533222 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3334/6700] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:50:43 2022] DELETE /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:50:43.541964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5ab6473e-9524-4411-92be-11ad7defd368 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:50:43.542694 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5ab6473e-9524-4411-92be-11ad7defd368 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: a1af2259-892a-4357-9ca4-f083e88da50c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:43.549880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ab6473e-9524-4411-92be-11ad7defd368 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:43.550693 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ab6473e-9524-4411-92be-11ad7defd368 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:43.551666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ab6473e-9524-4411-92be-11ad7defd368 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:43.552558 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ab6473e-9524-4411-92be-11ad7defd368 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:43.553039 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ab6473e-9524-4411-92be-11ad7defd368 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:43.553656 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ab6473e-9524-4411-92be-11ad7defd368 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:43.688244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5ab6473e-9524-4411-92be-11ad7defd368 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:50:43.696408 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5ab6473e-9524-4411-92be-11ad7defd368 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c" status: 200 len: 1576 microversion: 2.1 time: 0.158660 Aug 04 17:50:43.696969 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3367/6701] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:50:43 2022] GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:50:44.720567 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-90b921cb-d306-4779-aa98-ea6df9ace3ca tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:50:44.721283 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-90b921cb-d306-4779-aa98-ea6df9ace3ca tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: a1af2259-892a-4357-9ca4-f083e88da50c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:44.728671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90b921cb-d306-4779-aa98-ea6df9ace3ca tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:44.729207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90b921cb-d306-4779-aa98-ea6df9ace3ca tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:44.729664 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90b921cb-d306-4779-aa98-ea6df9ace3ca tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:44.730415 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90b921cb-d306-4779-aa98-ea6df9ace3ca tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:44.730889 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90b921cb-d306-4779-aa98-ea6df9ace3ca tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:44.731332 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90b921cb-d306-4779-aa98-ea6df9ace3ca tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:44.869939 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-90b921cb-d306-4779-aa98-ea6df9ace3ca tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:50:44.877615 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-90b921cb-d306-4779-aa98-ea6df9ace3ca tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c" status: 200 len: 1576 microversion: 2.1 time: 0.161684 Aug 04 17:50:44.878233 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3335/6702] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:50:44 2022] GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:50:45.759568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-1ca595e1-6dbd-418a-9d2e-2af775ba7f7e req-3074a411-f95f-498b-b72c-3b6d84a1b3d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1af2259-892a-4357-9ca4-f083e88da50c", "name": "network-vif-deleted", "tag": "4ca7e446-27cc-47d5-a9ae-e91644b040b6"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:50:45.770574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1ca595e1-6dbd-418a-9d2e-2af775ba7f7e req-3074a411-f95f-498b-b72c-3b6d84a1b3d8 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:45.771055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1ca595e1-6dbd-418a-9d2e-2af775ba7f7e req-3074a411-f95f-498b-b72c-3b6d84a1b3d8 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:45.771497 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1ca595e1-6dbd-418a-9d2e-2af775ba7f7e req-3074a411-f95f-498b-b72c-3b6d84a1b3d8 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:45.782988 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-1ca595e1-6dbd-418a-9d2e-2af775ba7f7e req-3074a411-f95f-498b-b72c-3b6d84a1b3d8 service nova] Creating event network-vif-deleted:4ca7e446-27cc-47d5-a9ae-e91644b040b6 for instance a1af2259-892a-4357-9ca4-f083e88da50c on n-h1-851359-3 Aug 04 17:50:45.788139 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-1ca595e1-6dbd-418a-9d2e-2af775ba7f7e req-3074a411-f95f-498b-b72c-3b6d84a1b3d8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032233 Aug 04 17:50:45.788808 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3368/6703] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:50:45.899359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-060c9311-deb0-4ed5-8b0c-16ad15c489ef tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:50:45.899993 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-060c9311-deb0-4ed5-8b0c-16ad15c489ef tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: a1af2259-892a-4357-9ca4-f083e88da50c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:45.906548 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-060c9311-deb0-4ed5-8b0c-16ad15c489ef tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:45.907047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-060c9311-deb0-4ed5-8b0c-16ad15c489ef tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:45.907502 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-060c9311-deb0-4ed5-8b0c-16ad15c489ef tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:45.908212 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-060c9311-deb0-4ed5-8b0c-16ad15c489ef tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:45.908680 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-060c9311-deb0-4ed5-8b0c-16ad15c489ef tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:45.909119 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-060c9311-deb0-4ed5-8b0c-16ad15c489ef tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:45.976016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-060c9311-deb0-4ed5-8b0c-16ad15c489ef tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:50:45.983899 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-060c9311-deb0-4ed5-8b0c-16ad15c489ef tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c" status: 200 len: 1226 microversion: 2.1 time: 0.088655 Aug 04 17:50:45.984482 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3336/6704] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:50:45 2022] GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:50:47.006925 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-429a2626-8ba2-4902-b4e4-f949dbe2635a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:50:47.007523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-429a2626-8ba2-4902-b4e4-f949dbe2635a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: a1af2259-892a-4357-9ca4-f083e88da50c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:47.013707 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-429a2626-8ba2-4902-b4e4-f949dbe2635a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:47.014227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-429a2626-8ba2-4902-b4e4-f949dbe2635a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:47.014669 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-429a2626-8ba2-4902-b4e4-f949dbe2635a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:47.015364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-429a2626-8ba2-4902-b4e4-f949dbe2635a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:47.015822 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-429a2626-8ba2-4902-b4e4-f949dbe2635a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:47.016278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-429a2626-8ba2-4902-b4e4-f949dbe2635a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:47.088060 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-429a2626-8ba2-4902-b4e4-f949dbe2635a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:50:47.096136 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-429a2626-8ba2-4902-b4e4-f949dbe2635a tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c" status: 200 len: 1226 microversion: 2.1 time: 0.095110 Aug 04 17:50:47.096703 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3369/6705] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:50:46 2022] GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:50:48.117494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-db1dd8a2-f259-4c95-8640-2b9ad9268cc6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:50:48.118180 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-db1dd8a2-f259-4c95-8640-2b9ad9268cc6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: a1af2259-892a-4357-9ca4-f083e88da50c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:48.125218 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db1dd8a2-f259-4c95-8640-2b9ad9268cc6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:48.125740 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db1dd8a2-f259-4c95-8640-2b9ad9268cc6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:48.126240 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db1dd8a2-f259-4c95-8640-2b9ad9268cc6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:48.126983 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db1dd8a2-f259-4c95-8640-2b9ad9268cc6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:48.127470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db1dd8a2-f259-4c95-8640-2b9ad9268cc6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:48.127921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db1dd8a2-f259-4c95-8640-2b9ad9268cc6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:48.194358 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-db1dd8a2-f259-4c95-8640-2b9ad9268cc6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:50:48.202470 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-db1dd8a2-f259-4c95-8640-2b9ad9268cc6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c" status: 200 len: 1226 microversion: 2.1 time: 0.089301 Aug 04 17:50:48.203068 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3337/6706] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:50:48 2022] GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:50:49.223357 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-748e075b-a88d-4846-95ab-9cd1628702d6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:50:49.224040 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-748e075b-a88d-4846-95ab-9cd1628702d6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: a1af2259-892a-4357-9ca4-f083e88da50c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:49.230868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-748e075b-a88d-4846-95ab-9cd1628702d6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:49.231354 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-748e075b-a88d-4846-95ab-9cd1628702d6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:49.231793 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-748e075b-a88d-4846-95ab-9cd1628702d6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:49.232488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-748e075b-a88d-4846-95ab-9cd1628702d6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:49.232944 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-748e075b-a88d-4846-95ab-9cd1628702d6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:49.233370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-748e075b-a88d-4846-95ab-9cd1628702d6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:49.297016 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-748e075b-a88d-4846-95ab-9cd1628702d6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:50:49.304622 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-748e075b-a88d-4846-95ab-9cd1628702d6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c" status: 200 len: 1226 microversion: 2.1 time: 0.085196 Aug 04 17:50:49.305199 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3370/6707] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:50:49 2022] GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:50:50.326329 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-99421e83-8f8a-40b3-bca8-1781ffe5d436 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:50:50.326972 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-99421e83-8f8a-40b3-bca8-1781ffe5d436 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: a1af2259-892a-4357-9ca4-f083e88da50c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:50.338328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99421e83-8f8a-40b3-bca8-1781ffe5d436 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:50.338841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99421e83-8f8a-40b3-bca8-1781ffe5d436 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:50.339302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99421e83-8f8a-40b3-bca8-1781ffe5d436 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:50.340027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99421e83-8f8a-40b3-bca8-1781ffe5d436 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:50.340507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99421e83-8f8a-40b3-bca8-1781ffe5d436 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:50.341211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99421e83-8f8a-40b3-bca8-1781ffe5d436 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:50.373871 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99421e83-8f8a-40b3-bca8-1781ffe5d436 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:50.374464 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99421e83-8f8a-40b3-bca8-1781ffe5d436 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:50.375099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99421e83-8f8a-40b3-bca8-1781ffe5d436 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:50.375686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-99421e83-8f8a-40b3-bca8-1781ffe5d436 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lazy-loading 'fault' on Instance uuid a1af2259-892a-4357-9ca4-f083e88da50c {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:50:50.427009 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-99421e83-8f8a-40b3-bca8-1781ffe5d436 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50bf6f5281964c0b81809080bcf22bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f694275ec441259c366f63daa4a380', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:50:50.439318 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-99421e83-8f8a-40b3-bca8-1781ffe5d436 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c" status: 200 len: 1231 microversion: 2.1 time: 0.117074 Aug 04 17:50:50.439981 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3338/6708] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:50:50 2022] GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c => generated 1231 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:50:51.460644 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ea5de0fc-c8ff-4ab3-9ce9-aa75d6d90ac6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:50:51.461243 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ea5de0fc-c8ff-4ab3-9ce9-aa75d6d90ac6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: a1af2259-892a-4357-9ca4-f083e88da50c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:51.468177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea5de0fc-c8ff-4ab3-9ce9-aa75d6d90ac6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:51.468660 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea5de0fc-c8ff-4ab3-9ce9-aa75d6d90ac6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:51.469098 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea5de0fc-c8ff-4ab3-9ce9-aa75d6d90ac6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:51.469786 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea5de0fc-c8ff-4ab3-9ce9-aa75d6d90ac6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:51.470281 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea5de0fc-c8ff-4ab3-9ce9-aa75d6d90ac6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:51.470707 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ea5de0fc-c8ff-4ab3-9ce9-aa75d6d90ac6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:51.484209 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-ea5de0fc-c8ff-4ab3-9ce9-aa75d6d90ac6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] HTTP exception thrown: Instance a1af2259-892a-4357-9ca4-f083e88da50c could not be found. Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ea5de0fc-c8ff-4ab3-9ce9-aa75d6d90ac6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Request method failure captured: Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c HTTP/1.1 Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7ARpoisKS8ru_ZJiIrIfjIFMRjfQL-mVrLbzAzLl4Z4wH-8ksarsVn1PTK67x0ktAL2RMgNiOghxRSfCsuIPgqi5zzrjB6PtD1ptQpXCC7QBiVIYCXgsvXv7bVdD4F6QLnLsEgFyHhnUvqqIgdfnwyBZE3QOXa1h7oqCs3SSjoPFKXM Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 46f694275ec441259c366f63daa4a380 Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-TestVolumeBootPattern-275420730 Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46f694275ec441259c366f63daa4a380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46f694275ec441259c366f63daa4a380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_46f694275ec441259c366f63daa4a380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/46f694275ec441259c366f63daa4a380"}]}] Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-TestVolumeBootPattern-275420730 Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 46f694275ec441259c366f63daa4a380 Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-TestVolumeBootPattern-275420730 Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-TestVolumeBootPattern-275420730-project Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 50bf6f5281964c0b81809080bcf22bdd Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-TestVolumeBootPattern-275420730-project Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance a1af2259-892a-4357-9ca4-f083e88da50c could not be found. Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'a1af2259-892a-4357-9ca4-f083e88da50c'} Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1af2259-892a-4357-9ca4-f083e88da50c could not be found. Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1af2259-892a-4357-9ca4-f083e88da50c could not be found. Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:50:51.485829 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:50:51.492471 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:50:51.492471 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:50:51.492471 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:50:51.492471 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:50:51.492471 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:50:51.492471 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1af2259-892a-4357-9ca4-f083e88da50c could not be found. Aug 04 17:50:51.492471 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:50:51.492471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ea5de0fc-c8ff-4ab3-9ce9-aa75d6d90ac6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Returning 404 to user: Instance a1af2259-892a-4357-9ca4-f083e88da50c could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:50:51.492471 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ea5de0fc-c8ff-4ab3-9ce9-aa75d6d90ac6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c" status: 404 len: 111 microversion: 2.1 time: 0.030544 Aug 04 17:50:51.492471 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3371/6709] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:50:51 2022] GET /compute/v2.1/servers/a1af2259-892a-4357-9ca4-f083e88da50c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:50:51.941575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ce622c45-dd30-4e45-b74b-e7f0a9cf0eb6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:50:51.942127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ce622c45-dd30-4e45-b74b-e7f0a9cf0eb6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 37452071-3f6f-44d5-b02b-7fe959f8c4fb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:51.948975 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce622c45-dd30-4e45-b74b-e7f0a9cf0eb6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:51.949475 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce622c45-dd30-4e45-b74b-e7f0a9cf0eb6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:51.949933 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce622c45-dd30-4e45-b74b-e7f0a9cf0eb6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:51.950668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce622c45-dd30-4e45-b74b-e7f0a9cf0eb6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:51.951146 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce622c45-dd30-4e45-b74b-e7f0a9cf0eb6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:51.951592 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce622c45-dd30-4e45-b74b-e7f0a9cf0eb6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:51.965640 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-ce622c45-dd30-4e45-b74b-e7f0a9cf0eb6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] HTTP exception thrown: Instance 37452071-3f6f-44d5-b02b-7fe959f8c4fb could not be found. Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ce622c45-dd30-4e45-b74b-e7f0a9cf0eb6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Request method failure captured: Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb HTTP/1.1 Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7ARpoisKS8ru_ZJiIrIfjIFMRjfQL-mVrLbzAzLl4Z4wH-8ksarsVn1PTK67x0ktAL2RMgNiOghxRSfCsuIPgqi5zzrjB6PtD1ptQpXCC7QBiVIYCXgsvXv7bVdD4F6QLnLsEgFyHhnUvqqIgdfnwyBZE3QOXa1h7oqCs3SSjoPFKXM Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 46f694275ec441259c366f63daa4a380 Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TestVolumeBootPattern-275420730 Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46f694275ec441259c366f63daa4a380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46f694275ec441259c366f63daa4a380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_46f694275ec441259c366f63daa4a380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/46f694275ec441259c366f63daa4a380"}]}] Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TestVolumeBootPattern-275420730 Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 46f694275ec441259c366f63daa4a380 Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestVolumeBootPattern-275420730 Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TestVolumeBootPattern-275420730-project Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 50bf6f5281964c0b81809080bcf22bdd Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TestVolumeBootPattern-275420730-project Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 37452071-3f6f-44d5-b02b-7fe959f8c4fb could not be found. Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '37452071-3f6f-44d5-b02b-7fe959f8c4fb'} Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37452071-3f6f-44d5-b02b-7fe959f8c4fb could not be found. Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:50:51.967630 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:50:51.973102 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37452071-3f6f-44d5-b02b-7fe959f8c4fb could not be found. Aug 04 17:50:51.973102 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:50:51.973102 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:50:51.973102 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:50:51.973102 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:50:51.973102 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:50:51.973102 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:50:51.973102 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:50:51.973102 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:50:51.973102 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37452071-3f6f-44d5-b02b-7fe959f8c4fb could not be found. Aug 04 17:50:51.973102 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:50:51.973102 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ce622c45-dd30-4e45-b74b-e7f0a9cf0eb6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Returning 404 to user: Instance 37452071-3f6f-44d5-b02b-7fe959f8c4fb could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:50:51.973102 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ce622c45-dd30-4e45-b74b-e7f0a9cf0eb6 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "DELETE /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb" status: 404 len: 111 microversion: 2.1 time: 0.031524 Aug 04 17:50:51.973102 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3339/6710] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:50:51 2022] DELETE /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:50:51.978839 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-64db265f-bd56-4ff0-8040-9d35373e78e9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:50:51.979460 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-64db265f-bd56-4ff0-8040-9d35373e78e9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] [instance: 37452071-3f6f-44d5-b02b-7fe959f8c4fb] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:50:51.985318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64db265f-bd56-4ff0-8040-9d35373e78e9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:51.985811 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64db265f-bd56-4ff0-8040-9d35373e78e9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:51.986309 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64db265f-bd56-4ff0-8040-9d35373e78e9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:51.987008 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64db265f-bd56-4ff0-8040-9d35373e78e9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:50:51.987477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64db265f-bd56-4ff0-8040-9d35373e78e9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:50:51.987909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64db265f-bd56-4ff0-8040-9d35373e78e9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:50:52.001187 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-64db265f-bd56-4ff0-8040-9d35373e78e9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] HTTP exception thrown: Instance 37452071-3f6f-44d5-b02b-7fe959f8c4fb could not be found. Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-64db265f-bd56-4ff0-8040-9d35373e78e9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Request method failure captured: Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb HTTP/1.1 Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7ARpoisKS8ru_ZJiIrIfjIFMRjfQL-mVrLbzAzLl4Z4wH-8ksarsVn1PTK67x0ktAL2RMgNiOghxRSfCsuIPgqi5zzrjB6PtD1ptQpXCC7QBiVIYCXgsvXv7bVdD4F6QLnLsEgFyHhnUvqqIgdfnwyBZE3QOXa1h7oqCs3SSjoPFKXM Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 46f694275ec441259c366f63daa4a380 Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-TestVolumeBootPattern-275420730 Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46f694275ec441259c366f63daa4a380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/46f694275ec441259c366f63daa4a380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_46f694275ec441259c366f63daa4a380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/46f694275ec441259c366f63daa4a380"}]}] Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-TestVolumeBootPattern-275420730 Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 46f694275ec441259c366f63daa4a380 Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-TestVolumeBootPattern-275420730 Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-TestVolumeBootPattern-275420730-project Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 50bf6f5281964c0b81809080bcf22bdd Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-TestVolumeBootPattern-275420730-project Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 37452071-3f6f-44d5-b02b-7fe959f8c4fb could not be found. Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '37452071-3f6f-44d5-b02b-7fe959f8c4fb'} Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37452071-3f6f-44d5-b02b-7fe959f8c4fb could not be found. Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37452071-3f6f-44d5-b02b-7fe959f8c4fb could not be found. Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:50:52.002743 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:50:52.008247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:50:52.008247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:50:52.008247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:50:52.008247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:50:52.008247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:50:52.008247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37452071-3f6f-44d5-b02b-7fe959f8c4fb could not be found. Aug 04 17:50:52.008247 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:50:52.008247 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-64db265f-bd56-4ff0-8040-9d35373e78e9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Returning 404 to user: Instance 37452071-3f6f-44d5-b02b-7fe959f8c4fb could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:50:52.008247 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-64db265f-bd56-4ff0-8040-9d35373e78e9 tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb" status: 404 len: 111 microversion: 2.1 time: 0.029802 Aug 04 17:50:52.008247 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3372/6711] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:50:51 2022] GET /compute/v2.1/servers/37452071-3f6f-44d5-b02b-7fe959f8c4fb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:50:55.436063 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ba44808a-25ec-46dd-a85c-cd40f5c1455b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] Calling method '.version_select at 0x7f1e5ac61b80>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:50:55.471665 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ba44808a-25ec-46dd-a85c-cd40f5c1455b tempest-TestVolumeBootPattern-275420730 tempest-TestVolumeBootPattern-275420730-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1670531884" status: 202 len: 0 microversion: 2.1 time: 0.040834 Aug 04 17:50:55.472262 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3340/6712] 10.222.0.93 () {58 vars in 1263 bytes} [Thu Aug 4 17:50:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1670531884 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:51:03.132929 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:51:03.133626 n-d-851359-3 devstack@n-api.service[131044]: Thu Aug 4 17:51:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 17:51:13.919662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=26 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:51:13.920389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=54 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:51:14.036261 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-20eacaef-6776-47d3-a7e5-172d6d426cc7 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-943646358", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:51:14.090418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-20eacaef-6776-47d3-a7e5-172d6d426cc7 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] validate_networks() for None {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:51:14.288567 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-20eacaef-6776-47d3-a7e5-172d6d426cc7 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:51:14.289031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-20eacaef-6776-47d3-a7e5-172d6d426cc7 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:51:14.289513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-20eacaef-6776-47d3-a7e5-172d6d426cc7 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:51:14.289928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-20eacaef-6776-47d3-a7e5-172d6d426cc7 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:51:14.290384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-20eacaef-6776-47d3-a7e5-172d6d426cc7 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:51:14.299629 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20eacaef-6776-47d3-a7e5-172d6d426cc7 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:14.300123 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20eacaef-6776-47d3-a7e5-172d6d426cc7 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:14.300569 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20eacaef-6776-47d3-a7e5-172d6d426cc7 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:14.301308 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20eacaef-6776-47d3-a7e5-172d6d426cc7 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:14.301772 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20eacaef-6776-47d3-a7e5-172d6d426cc7 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:14.302229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20eacaef-6776-47d3-a7e5-172d6d426cc7 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:14.320244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-20eacaef-6776-47d3-a7e5-172d6d426cc7 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Getting quotas for project 51b6b8c71239489e80edc68332a03c73. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:51:14.325759 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-20eacaef-6776-47d3-a7e5-172d6d426cc7 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Getting quotas for user 577010d3687f46e982388a4f607aad4f and project 51b6b8c71239489e80edc68332a03c73. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:51:14.340774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-20eacaef-6776-47d3-a7e5-172d6d426cc7 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:51:14.343478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-20eacaef-6776-47d3-a7e5-172d6d426cc7 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] [instance: 6f8751b5-c363-4192-8390-176abf83df7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:51:14.388530 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-20eacaef-6776-47d3-a7e5-172d6d426cc7 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.473943 Aug 04 17:51:14.389176 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3373/6713] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:51:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:51:14.402232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-16a86613-17c1-4027-8af5-56abce945bbd tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:14.404530 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-16a86613-17c1-4027-8af5-56abce945bbd tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] [instance: 6f8751b5-c363-4192-8390-176abf83df7b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:14.407296 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:51:14.408151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:51:14.469074 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-16a86613-17c1-4027-8af5-56abce945bbd tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577010d3687f46e982388a4f607aad4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b6b8c71239489e80edc68332a03c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:14.476432 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-16a86613-17c1-4027-8af5-56abce945bbd tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] 10.222.0.93 "GET /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b" status: 200 len: 1221 microversion: 2.1 time: 0.078255 Aug 04 17:51:14.476995 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3341/6714] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:14 2022] GET /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b => generated 1221 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:15.498158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-55060b02-35ec-427b-b7b0-d5e6bafc1288 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:15.498726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-55060b02-35ec-427b-b7b0-d5e6bafc1288 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] [instance: 6f8751b5-c363-4192-8390-176abf83df7b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:15.560741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-55060b02-35ec-427b-b7b0-d5e6bafc1288 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577010d3687f46e982388a4f607aad4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b6b8c71239489e80edc68332a03c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:15.568696 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-55060b02-35ec-427b-b7b0-d5e6bafc1288 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] 10.222.0.93 "GET /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b" status: 200 len: 1221 microversion: 2.1 time: 0.075042 Aug 04 17:51:15.569391 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3374/6715] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:15 2022] GET /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b => generated 1221 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:16.591490 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-023160a9-c788-427f-9b01-6ed55bd7720c tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:16.592406 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-023160a9-c788-427f-9b01-6ed55bd7720c tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] [instance: 6f8751b5-c363-4192-8390-176abf83df7b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:16.645258 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-023160a9-c788-427f-9b01-6ed55bd7720c tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577010d3687f46e982388a4f607aad4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b6b8c71239489e80edc68332a03c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:16.657541 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-023160a9-c788-427f-9b01-6ed55bd7720c tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] 10.222.0.93 "GET /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b" status: 200 len: 1221 microversion: 2.1 time: 0.070414 Aug 04 17:51:16.658139 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3342/6716] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:16 2022] GET /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b => generated 1221 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:17.680466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-180948df-d298-4bec-aff3-3cbd0e7fad68 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:17.681282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-180948df-d298-4bec-aff3-3cbd0e7fad68 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] [instance: 6f8751b5-c363-4192-8390-176abf83df7b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:17.689815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-180948df-d298-4bec-aff3-3cbd0e7fad68 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:17.690550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-180948df-d298-4bec-aff3-3cbd0e7fad68 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:17.691101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-180948df-d298-4bec-aff3-3cbd0e7fad68 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:17.691961 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-180948df-d298-4bec-aff3-3cbd0e7fad68 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:17.692775 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-180948df-d298-4bec-aff3-3cbd0e7fad68 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:17.693230 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-180948df-d298-4bec-aff3-3cbd0e7fad68 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:17.776838 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-180948df-d298-4bec-aff3-3cbd0e7fad68 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577010d3687f46e982388a4f607aad4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b6b8c71239489e80edc68332a03c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:17.784718 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-180948df-d298-4bec-aff3-3cbd0e7fad68 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] 10.222.0.93 "GET /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b" status: 200 len: 1291 microversion: 2.1 time: 0.109927 Aug 04 17:51:17.785290 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3375/6717] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:17 2022] GET /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b => generated 1291 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:18.806596 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cad7e999-9fc6-47cc-acdd-46b798b95ec1 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:18.807236 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cad7e999-9fc6-47cc-acdd-46b798b95ec1 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] [instance: 6f8751b5-c363-4192-8390-176abf83df7b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:18.813857 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cad7e999-9fc6-47cc-acdd-46b798b95ec1 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:18.814406 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cad7e999-9fc6-47cc-acdd-46b798b95ec1 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:18.814864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cad7e999-9fc6-47cc-acdd-46b798b95ec1 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:18.815586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cad7e999-9fc6-47cc-acdd-46b798b95ec1 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:18.816065 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cad7e999-9fc6-47cc-acdd-46b798b95ec1 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:18.816514 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cad7e999-9fc6-47cc-acdd-46b798b95ec1 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:19.030319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cad7e999-9fc6-47cc-acdd-46b798b95ec1 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577010d3687f46e982388a4f607aad4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b6b8c71239489e80edc68332a03c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:19.037910 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cad7e999-9fc6-47cc-acdd-46b798b95ec1 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] 10.222.0.93 "GET /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b" status: 200 len: 1321 microversion: 2.1 time: 0.235862 Aug 04 17:51:19.038553 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3343/6718] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:18 2022] GET /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:19.317051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-6b7492b3-c5e0-4e32-aa45-5c2f3bcb0986 req-096dfea4-5f16-4f21-abea-263b850e30ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f8751b5-c363-4192-8390-176abf83df7b", "tag": "82e12032-faea-4b60-8f13-5f0ec3809706"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:51:19.329061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6b7492b3-c5e0-4e32-aa45-5c2f3bcb0986 req-096dfea4-5f16-4f21-abea-263b850e30ae service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:19.329569 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6b7492b3-c5e0-4e32-aa45-5c2f3bcb0986 req-096dfea4-5f16-4f21-abea-263b850e30ae service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:19.330249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6b7492b3-c5e0-4e32-aa45-5c2f3bcb0986 req-096dfea4-5f16-4f21-abea-263b850e30ae service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:19.342325 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-6b7492b3-c5e0-4e32-aa45-5c2f3bcb0986 req-096dfea4-5f16-4f21-abea-263b850e30ae service nova] Creating event network-changed:82e12032-faea-4b60-8f13-5f0ec3809706 for instance 6f8751b5-c363-4192-8390-176abf83df7b on n-h1-851359-3 Aug 04 17:51:19.358092 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-6b7492b3-c5e0-4e32-aa45-5c2f3bcb0986 req-096dfea4-5f16-4f21-abea-263b850e30ae service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034385 Aug 04 17:51:19.358763 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3376/6719] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:51:20.058805 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f57fcc92-7c16-4e57-b323-994b463718e1 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:20.059381 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f57fcc92-7c16-4e57-b323-994b463718e1 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] [instance: 6f8751b5-c363-4192-8390-176abf83df7b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:20.066245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f57fcc92-7c16-4e57-b323-994b463718e1 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:20.066749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f57fcc92-7c16-4e57-b323-994b463718e1 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:20.067201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f57fcc92-7c16-4e57-b323-994b463718e1 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:20.067905 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f57fcc92-7c16-4e57-b323-994b463718e1 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:20.068870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f57fcc92-7c16-4e57-b323-994b463718e1 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:20.069309 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f57fcc92-7c16-4e57-b323-994b463718e1 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:20.206070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f57fcc92-7c16-4e57-b323-994b463718e1 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577010d3687f46e982388a4f607aad4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b6b8c71239489e80edc68332a03c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:20.214330 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f57fcc92-7c16-4e57-b323-994b463718e1 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] 10.222.0.93 "GET /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b" status: 200 len: 1321 microversion: 2.1 time: 0.159486 Aug 04 17:51:20.214903 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3344/6720] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:20 2022] GET /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:21.236020 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-94276a3d-d817-43d5-ab8c-989205ea8bf4 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:21.236758 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-94276a3d-d817-43d5-ab8c-989205ea8bf4 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] [instance: 6f8751b5-c363-4192-8390-176abf83df7b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:21.243587 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94276a3d-d817-43d5-ab8c-989205ea8bf4 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:21.244080 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94276a3d-d817-43d5-ab8c-989205ea8bf4 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:21.244531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94276a3d-d817-43d5-ab8c-989205ea8bf4 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:21.245240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94276a3d-d817-43d5-ab8c-989205ea8bf4 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:21.245709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94276a3d-d817-43d5-ab8c-989205ea8bf4 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:21.246189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-94276a3d-d817-43d5-ab8c-989205ea8bf4 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:21.388584 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-94276a3d-d817-43d5-ab8c-989205ea8bf4 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577010d3687f46e982388a4f607aad4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b6b8c71239489e80edc68332a03c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:21.396908 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-94276a3d-d817-43d5-ab8c-989205ea8bf4 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] 10.222.0.93 "GET /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b" status: 200 len: 1321 microversion: 2.1 time: 0.165247 Aug 04 17:51:21.397520 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3377/6721] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:21 2022] GET /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:22.418062 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-803b6b0b-7c2c-486f-b2b5-b46191d978e1 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:22.418687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-803b6b0b-7c2c-486f-b2b5-b46191d978e1 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] [instance: 6f8751b5-c363-4192-8390-176abf83df7b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:22.425490 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-803b6b0b-7c2c-486f-b2b5-b46191d978e1 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:22.426026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-803b6b0b-7c2c-486f-b2b5-b46191d978e1 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:22.426488 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-803b6b0b-7c2c-486f-b2b5-b46191d978e1 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:22.427206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-803b6b0b-7c2c-486f-b2b5-b46191d978e1 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:22.428315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-803b6b0b-7c2c-486f-b2b5-b46191d978e1 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:22.428767 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-803b6b0b-7c2c-486f-b2b5-b46191d978e1 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:22.558438 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-803b6b0b-7c2c-486f-b2b5-b46191d978e1 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577010d3687f46e982388a4f607aad4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b6b8c71239489e80edc68332a03c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:22.566043 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-803b6b0b-7c2c-486f-b2b5-b46191d978e1 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] 10.222.0.93 "GET /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b" status: 200 len: 1321 microversion: 2.1 time: 0.152059 Aug 04 17:51:22.566629 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3345/6722] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:22 2022] GET /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:23.586818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4c5affe3-6249-4498-8ff7-4026b03a546f tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:23.587442 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4c5affe3-6249-4498-8ff7-4026b03a546f tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] [instance: 6f8751b5-c363-4192-8390-176abf83df7b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:23.594659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c5affe3-6249-4498-8ff7-4026b03a546f tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:23.595152 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c5affe3-6249-4498-8ff7-4026b03a546f tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:23.595622 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c5affe3-6249-4498-8ff7-4026b03a546f tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:23.596325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c5affe3-6249-4498-8ff7-4026b03a546f tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:23.596798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c5affe3-6249-4498-8ff7-4026b03a546f tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:23.597233 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c5affe3-6249-4498-8ff7-4026b03a546f tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:23.734964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4c5affe3-6249-4498-8ff7-4026b03a546f tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577010d3687f46e982388a4f607aad4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b6b8c71239489e80edc68332a03c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:23.742614 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4c5affe3-6249-4498-8ff7-4026b03a546f tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] 10.222.0.93 "GET /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b" status: 200 len: 1321 microversion: 2.1 time: 0.160201 Aug 04 17:51:23.743185 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3378/6723] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:23 2022] GET /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:24.764129 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-842a9d3b-ea36-4062-a670-926176f9db5b tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:24.764775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-842a9d3b-ea36-4062-a670-926176f9db5b tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] [instance: 6f8751b5-c363-4192-8390-176abf83df7b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:24.772506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-842a9d3b-ea36-4062-a670-926176f9db5b tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:24.773010 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-842a9d3b-ea36-4062-a670-926176f9db5b tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:24.773466 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-842a9d3b-ea36-4062-a670-926176f9db5b tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:24.774230 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-842a9d3b-ea36-4062-a670-926176f9db5b tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:24.774705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-842a9d3b-ea36-4062-a670-926176f9db5b tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:24.775152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-842a9d3b-ea36-4062-a670-926176f9db5b tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:24.907302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-842a9d3b-ea36-4062-a670-926176f9db5b tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577010d3687f46e982388a4f607aad4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b6b8c71239489e80edc68332a03c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:24.915779 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-842a9d3b-ea36-4062-a670-926176f9db5b tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] 10.222.0.93 "GET /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b" status: 200 len: 1321 microversion: 2.1 time: 0.155985 Aug 04 17:51:24.916343 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3346/6724] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:24 2022] GET /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:25.796581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-176463d6-d304-47e9-8a26-b2a850856523 req-90e37a98-6710-40a5-ba69-b18fdd9b9167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f8751b5-c363-4192-8390-176abf83df7b", "name": "network-vif-plugged", "status": "completed", "tag": "82e12032-faea-4b60-8f13-5f0ec3809706"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:51:25.801691 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:51:25.803856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=8 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:51:25.810942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-176463d6-d304-47e9-8a26-b2a850856523 req-90e37a98-6710-40a5-ba69-b18fdd9b9167 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:25.811442 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-176463d6-d304-47e9-8a26-b2a850856523 req-90e37a98-6710-40a5-ba69-b18fdd9b9167 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:25.811884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-176463d6-d304-47e9-8a26-b2a850856523 req-90e37a98-6710-40a5-ba69-b18fdd9b9167 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:25.824304 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-176463d6-d304-47e9-8a26-b2a850856523 req-90e37a98-6710-40a5-ba69-b18fdd9b9167 service nova] Creating event network-vif-plugged:82e12032-faea-4b60-8f13-5f0ec3809706 for instance 6f8751b5-c363-4192-8390-176abf83df7b on n-h1-851359-3 Aug 04 17:51:25.829581 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-176463d6-d304-47e9-8a26-b2a850856523 req-90e37a98-6710-40a5-ba69-b18fdd9b9167 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036806 Aug 04 17:51:25.830226 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3379/6725] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:51:25.936612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-deb3ae35-ef49-4e2b-b8bb-aa3ad67ec7e2 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:25.937438 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-deb3ae35-ef49-4e2b-b8bb-aa3ad67ec7e2 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] [instance: 6f8751b5-c363-4192-8390-176abf83df7b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:25.944372 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-deb3ae35-ef49-4e2b-b8bb-aa3ad67ec7e2 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:25.944894 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-deb3ae35-ef49-4e2b-b8bb-aa3ad67ec7e2 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:25.945359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-deb3ae35-ef49-4e2b-b8bb-aa3ad67ec7e2 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:25.946125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-deb3ae35-ef49-4e2b-b8bb-aa3ad67ec7e2 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:25.946609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-deb3ae35-ef49-4e2b-b8bb-aa3ad67ec7e2 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:25.947058 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-deb3ae35-ef49-4e2b-b8bb-aa3ad67ec7e2 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:26.108836 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-deb3ae35-ef49-4e2b-b8bb-aa3ad67ec7e2 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577010d3687f46e982388a4f607aad4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b6b8c71239489e80edc68332a03c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:26.117050 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-deb3ae35-ef49-4e2b-b8bb-aa3ad67ec7e2 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] 10.222.0.93 "GET /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b" status: 200 len: 1321 microversion: 2.1 time: 0.184468 Aug 04 17:51:26.117624 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3347/6726] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:25 2022] GET /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:27.139290 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4bd81298-03ac-4bc4-8efb-80fc16ddafb5 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:27.140005 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4bd81298-03ac-4bc4-8efb-80fc16ddafb5 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] [instance: 6f8751b5-c363-4192-8390-176abf83df7b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:27.146417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4bd81298-03ac-4bc4-8efb-80fc16ddafb5 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:27.146915 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4bd81298-03ac-4bc4-8efb-80fc16ddafb5 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:27.147362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4bd81298-03ac-4bc4-8efb-80fc16ddafb5 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:27.148079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4bd81298-03ac-4bc4-8efb-80fc16ddafb5 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:27.148545 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4bd81298-03ac-4bc4-8efb-80fc16ddafb5 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:27.149004 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4bd81298-03ac-4bc4-8efb-80fc16ddafb5 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:27.288787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4bd81298-03ac-4bc4-8efb-80fc16ddafb5 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577010d3687f46e982388a4f607aad4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b6b8c71239489e80edc68332a03c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:27.296823 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4bd81298-03ac-4bc4-8efb-80fc16ddafb5 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] 10.222.0.93 "GET /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b" status: 200 len: 1471 microversion: 2.1 time: 0.162538 Aug 04 17:51:27.297408 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3380/6727] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:27 2022] GET /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b => generated 1471 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:27.321703 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:51:27.379791 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7e666697-8479-457e-8ca0-d3725edb45d0 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Calling method '.version_select at 0x7f1e5aa52430>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:27.448378 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7e666697-8479-457e-8ca0-d3725edb45d0 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/fe56c61500d94c138e4fa30f5892329f" status: 200 len: 371 microversion: 2.1 time: 0.131758 Aug 04 17:51:27.448965 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3348/6728] 10.222.0.93 () {58 vars in 1242 bytes} [Thu Aug 4 17:51:27 2022] GET /compute/v2.1/os-quota-sets/fe56c61500d94c138e4fa30f5892329f => generated 371 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:51:27.460412 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2bb45e72-c5f6-492e-abb9-6050e83b7023 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1398104418", "id": 27407539, "os-flavor-access:is_public": "True"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:51:27.463376 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:51:27.463376 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 17:51:27.479978 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2bb45e72-c5f6-492e-abb9-6050e83b7023 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 432 microversion: 2.1 time: 0.023337 Aug 04 17:51:27.480581 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3381/6729] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:51:27 2022] POST /compute/v2.1/flavors => generated 432 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:51:27.493361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-530b663f-da68-47d7-a02c-1429b6476cd7 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "27407539"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:51:27.495743 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-530b663f-da68-47d7-a02c-1429b6476cd7 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] [instance: 6f8751b5-c363-4192-8390-176abf83df7b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:27.502128 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-530b663f-da68-47d7-a02c-1429b6476cd7 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:27.502637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-530b663f-da68-47d7-a02c-1429b6476cd7 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:27.503095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-530b663f-da68-47d7-a02c-1429b6476cd7 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:27.503821 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-530b663f-da68-47d7-a02c-1429b6476cd7 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:27.504295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-530b663f-da68-47d7-a02c-1429b6476cd7 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:27.504737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-530b663f-da68-47d7-a02c-1429b6476cd7 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:27.596372 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-530b663f-da68-47d7-a02c-1429b6476cd7 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b0e6b2d59f734b1a9f41f8222993b3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56c61500d94c138e4fa30f5892329f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:27.603850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-530b663f-da68-47d7-a02c-1429b6476cd7 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] [instance: 6f8751b5-c363-4192-8390-176abf83df7b] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1398104418 {{(pid=131044) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 17:51:27.612102 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-530b663f-da68-47d7-a02c-1429b6476cd7 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:27.612607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-530b663f-da68-47d7-a02c-1429b6476cd7 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:27.613050 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-530b663f-da68-47d7-a02c-1429b6476cd7 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:27.613794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-530b663f-da68-47d7-a02c-1429b6476cd7 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:27.614293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-530b663f-da68-47d7-a02c-1429b6476cd7 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:27.615305 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-530b663f-da68-47d7-a02c-1429b6476cd7 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:27.637351 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-530b663f-da68-47d7-a02c-1429b6476cd7 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Getting quotas for project 51b6b8c71239489e80edc68332a03c73. Resources: {'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:51:27.642986 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-530b663f-da68-47d7-a02c-1429b6476cd7 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Getting quotas for user 577010d3687f46e982388a4f607aad4f and project 51b6b8c71239489e80edc68332a03c73. Resources: {'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:51:27.656072 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.compute.api [None req-530b663f-da68-47d7-a02c-1429b6476cd7 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] ram quota exceeded for fe56c61500d94c138e4fa30f5892329f, tried to resize instance. Aug 04 17:51:27.656639 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-530b663f-da68-47d7-a02c-1429b6476cd7 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-530b663f-da68-47d7-a02c-1429b6476cd7 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Request method failure captured: Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b/action HTTP/1.1 Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 37 Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AcRxY5JMgGPZjUBqhw0HtA1tl556Rnh3C2hvjUAbs_2WV9SzrGIoilCNNk8R82gRITE_hyPVUxWEoZh0Bg3GwlLOwfKovzxggnEzBRf0JwJMH_hRWU4-zS_Sbk0DUP-tNplY2ceUyX1CFAl2V9D49mhNjdOAJ8xfLvBarm-4LH3jH4 Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: fe56c61500d94c138e4fa30f5892329f Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1208355462 Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: X-Role: admin,member,reader Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: admin,member,reader Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fe56c61500d94c138e4fa30f5892329f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fe56c61500d94c138e4fa30f5892329f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fe56c61500d94c138e4fa30f5892329f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fe56c61500d94c138e4fa30f5892329f"}]}] Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1208355462 Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: fe56c61500d94c138e4fa30f5892329f Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1208355462 Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersAdminNegativeTestJSON-1208355462-project-admin Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: b0e6b2d59f734b1a9f41f8222993b3cf Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1208355462-project-admin Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: {"resize": {"flavorRef": "27407539"}} Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '6f8751b5-c363-4192-8390-176abf83df7b', 'body': {'resize': {'flavorRef': '27407539'}}} Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3823, in _check_quota_for_upsize Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:51:27.669271 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4192, in resize Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3841, in _check_quota_for_upsize Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-530b663f-da68-47d7-a02c-1429b6476cd7 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-530b663f-da68-47d7-a02c-1429b6476cd7 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b/action" status: 403 len: 118 microversion: 2.1 time: 0.182366 Aug 04 17:51:27.675169 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3349/6730] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:51:27 2022] POST /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b/action => generated 118 bytes in 184 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 04 17:51:27.682016 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c7cc2760-9a5e-4471-bdbc-93a521762c72 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:27.682832 n-d-851359-3 devstack@n-api.service[131043]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:51:27.682832 n-d-851359-3 devstack@n-api.service[131043]: warnings.warn(msg) Aug 04 17:51:27.700087 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c7cc2760-9a5e-4471-bdbc-93a521762c72 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/27407539" status: 202 len: 0 microversion: 2.1 time: 0.022666 Aug 04 17:51:27.700660 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3382/6731] 10.222.0.93 () {58 vars in 1155 bytes} [Thu Aug 4 17:51:27 2022] DELETE /compute/v2.1/flavors/27407539 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:51:27.710084 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ede5414f-8456-453f-9251-0ea64c93dc72 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:27.731098 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ede5414f-8456-453f-9251-0ea64c93dc72 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025733 Aug 04 17:51:27.731683 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3350/6732] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 17:51:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:27.751441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-472a8b13-9289-4a64-8a75-be52b33ecd21 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Calling method '.version_select at 0x7f1e5a40f160>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:27.827716 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-472a8b13-9289-4a64-8a75-be52b33ecd21 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] 10.222.0.93 "GET /compute/v2.1/os-quota-sets/fe56c61500d94c138e4fa30f5892329f" status: 200 len: 371 microversion: 2.1 time: 0.079979 Aug 04 17:51:27.828296 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3383/6733] 10.222.0.93 () {58 vars in 1242 bytes} [Thu Aug 4 17:51:27 2022] GET /compute/v2.1/os-quota-sets/fe56c61500d94c138e4fa30f5892329f => generated 371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:51:27.840763 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9b933fbe-098a-4a66-a7bc-d5bea633dc7b tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-518544500", "id": 1261934542, "os-flavor-access:is_public": "True"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:51:27.844290 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:51:27.844290 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 17:51:27.861024 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9b933fbe-098a-4a66-a7bc-d5bea633dc7b tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.023949 Aug 04 17:51:27.861631 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3351/6734] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:51:27 2022] POST /compute/v2.1/flavors => generated 436 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:51:27.873870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1f7f3769-bda4-4eb4-92b9-8ff6103a0250 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1261934542"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:51:27.876601 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1f7f3769-bda4-4eb4-92b9-8ff6103a0250 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] [instance: 6f8751b5-c363-4192-8390-176abf83df7b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:27.884248 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f7f3769-bda4-4eb4-92b9-8ff6103a0250 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:27.884248 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f7f3769-bda4-4eb4-92b9-8ff6103a0250 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:27.884710 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f7f3769-bda4-4eb4-92b9-8ff6103a0250 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:27.885331 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f7f3769-bda4-4eb4-92b9-8ff6103a0250 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:27.886056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f7f3769-bda4-4eb4-92b9-8ff6103a0250 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:27.886496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f7f3769-bda4-4eb4-92b9-8ff6103a0250 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:28.036010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1f7f3769-bda4-4eb4-92b9-8ff6103a0250 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b0e6b2d59f734b1a9f41f8222993b3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56c61500d94c138e4fa30f5892329f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:28.040537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1f7f3769-bda4-4eb4-92b9-8ff6103a0250 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] [instance: 6f8751b5-c363-4192-8390-176abf83df7b] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-518544500 {{(pid=131043) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 17:51:28.047139 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f7f3769-bda4-4eb4-92b9-8ff6103a0250 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:28.047697 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f7f3769-bda4-4eb4-92b9-8ff6103a0250 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:28.048132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f7f3769-bda4-4eb4-92b9-8ff6103a0250 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:28.048857 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f7f3769-bda4-4eb4-92b9-8ff6103a0250 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:28.049309 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f7f3769-bda4-4eb4-92b9-8ff6103a0250 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:28.049734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f7f3769-bda4-4eb4-92b9-8ff6103a0250 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:28.071262 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-1f7f3769-bda4-4eb4-92b9-8ff6103a0250 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Getting quotas for project 51b6b8c71239489e80edc68332a03c73. Resources: {'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:51:28.076244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-1f7f3769-bda4-4eb4-92b9-8ff6103a0250 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Getting quotas for user 577010d3687f46e982388a4f607aad4f and project 51b6b8c71239489e80edc68332a03c73. Resources: {'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:51:28.090998 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.compute.api [None req-1f7f3769-bda4-4eb4-92b9-8ff6103a0250 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] cores quota exceeded for fe56c61500d94c138e4fa30f5892329f, tried to resize instance. Aug 04 17:51:28.091804 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-1f7f3769-bda4-4eb4-92b9-8ff6103a0250 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1f7f3769-bda4-4eb4-92b9-8ff6103a0250 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Request method failure captured: Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b/action HTTP/1.1 Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 39 Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7AcRxY5JMgGPZjUBqhw0HtA1tl556Rnh3C2hvjUAbs_2WV9SzrGIoilCNNk8R82gRITE_hyPVUxWEoZh0Bg3GwlLOwfKovzxggnEzBRf0JwJMH_hRWU4-zS_Sbk0DUP-tNplY2ceUyX1CFAl2V9D49mhNjdOAJ8xfLvBarm-4LH3jH4 Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: fe56c61500d94c138e4fa30f5892329f Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1208355462 Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: X-Role: admin,member,reader Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: admin,member,reader Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fe56c61500d94c138e4fa30f5892329f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/fe56c61500d94c138e4fa30f5892329f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_fe56c61500d94c138e4fa30f5892329f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/fe56c61500d94c138e4fa30f5892329f"}]}] Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1208355462 Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: fe56c61500d94c138e4fa30f5892329f Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1208355462 Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersAdminNegativeTestJSON-1208355462-project-admin Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: b0e6b2d59f734b1a9f41f8222993b3cf Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1208355462-project-admin Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: {"resize": {"flavorRef": "1261934542"}} Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '6f8751b5-c363-4192-8390-176abf83df7b', 'body': {'resize': {'flavorRef': '1261934542'}}} Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3823, in _check_quota_for_upsize Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:51:28.093879 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4192, in resize Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3841, in _check_quota_for_upsize Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1f7f3769-bda4-4eb4-92b9-8ff6103a0250 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1f7f3769-bda4-4eb4-92b9-8ff6103a0250 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] 10.222.0.93 "POST /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b/action" status: 403 len: 113 microversion: 2.1 time: 0.225861 Aug 04 17:51:28.099899 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3384/6735] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:51:27 2022] POST /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b/action => generated 113 bytes in 227 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:51:28.104974 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1ecb8c7f-0928-44fd-9c5c-575e4f42a195 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:28.105735 n-d-851359-3 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 17:51:28.105735 n-d-851359-3 devstack@n-api.service[131044]: warnings.warn(msg) Aug 04 17:51:28.124280 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1ecb8c7f-0928-44fd-9c5c-575e4f42a195 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] 10.222.0.93 "DELETE /compute/v2.1/flavors/1261934542" status: 202 len: 0 microversion: 2.1 time: 0.022751 Aug 04 17:51:28.124889 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3352/6736] 10.222.0.93 () {58 vars in 1161 bytes} [Thu Aug 4 17:51:28 2022] DELETE /compute/v2.1/flavors/1261934542 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:51:28.133594 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c9c1f687-0cd9-4075-9e4f-c8ece626a170 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:28.154584 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c9c1f687-0cd9-4075-9e4f-c8ece626a170 tempest-ServersAdminNegativeTestJSON-1208355462 tempest-ServersAdminNegativeTestJSON-1208355462-project-admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025257 Aug 04 17:51:28.155497 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3385/6737] 10.222.0.93 () {58 vars in 1146 bytes} [Thu Aug 4 17:51:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:28.175818 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b70d753e-5dac-40a3-b070-326d8a4fbc15 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:28.176395 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b70d753e-5dac-40a3-b070-326d8a4fbc15 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] [instance: 6f8751b5-c363-4192-8390-176abf83df7b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:28.182805 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b70d753e-5dac-40a3-b070-326d8a4fbc15 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:28.183313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b70d753e-5dac-40a3-b070-326d8a4fbc15 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:28.183771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b70d753e-5dac-40a3-b070-326d8a4fbc15 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:28.184487 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b70d753e-5dac-40a3-b070-326d8a4fbc15 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:28.184963 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b70d753e-5dac-40a3-b070-326d8a4fbc15 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:28.185410 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b70d753e-5dac-40a3-b070-326d8a4fbc15 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:28.213100 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b70d753e-5dac-40a3-b070-326d8a4fbc15 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] [instance: 6f8751b5-c363-4192-8390-176abf83df7b] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:51:28.298978 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b70d753e-5dac-40a3-b070-326d8a4fbc15 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b" status: 204 len: 0 microversion: 2.1 time: 0.126342 Aug 04 17:51:28.300372 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3353/6738] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:51:28 2022] DELETE /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 17:51:28.314182 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2c7e41fb-cb2e-4d81-bd9c-3bbc7cc82c9d tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:28.315258 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2c7e41fb-cb2e-4d81-bd9c-3bbc7cc82c9d tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] [instance: 6f8751b5-c363-4192-8390-176abf83df7b] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:28.334555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c7e41fb-cb2e-4d81-bd9c-3bbc7cc82c9d tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:28.335393 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c7e41fb-cb2e-4d81-bd9c-3bbc7cc82c9d tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:28.336158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c7e41fb-cb2e-4d81-bd9c-3bbc7cc82c9d tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:28.337356 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c7e41fb-cb2e-4d81-bd9c-3bbc7cc82c9d tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:28.338199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c7e41fb-cb2e-4d81-bd9c-3bbc7cc82c9d tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:28.338910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c7e41fb-cb2e-4d81-bd9c-3bbc7cc82c9d tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:28.552745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2c7e41fb-cb2e-4d81-bd9c-3bbc7cc82c9d tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577010d3687f46e982388a4f607aad4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b6b8c71239489e80edc68332a03c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:28.560459 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2c7e41fb-cb2e-4d81-bd9c-3bbc7cc82c9d tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] 10.222.0.93 "GET /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b" status: 200 len: 1477 microversion: 2.1 time: 0.253845 Aug 04 17:51:28.561044 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3386/6739] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:28 2022] GET /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b => generated 1477 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:29.581250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5d2cf6e8-eb69-455e-98fb-97daec1ad9fb tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:29.581999 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5d2cf6e8-eb69-455e-98fb-97daec1ad9fb tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] [instance: 6f8751b5-c363-4192-8390-176abf83df7b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:29.588850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d2cf6e8-eb69-455e-98fb-97daec1ad9fb tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:29.589348 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d2cf6e8-eb69-455e-98fb-97daec1ad9fb tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:29.589803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d2cf6e8-eb69-455e-98fb-97daec1ad9fb tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:29.590549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d2cf6e8-eb69-455e-98fb-97daec1ad9fb tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:29.591025 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d2cf6e8-eb69-455e-98fb-97daec1ad9fb tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:29.592225 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d2cf6e8-eb69-455e-98fb-97daec1ad9fb tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:29.812929 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5d2cf6e8-eb69-455e-98fb-97daec1ad9fb tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '577010d3687f46e982388a4f607aad4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51b6b8c71239489e80edc68332a03c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:29.820792 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5d2cf6e8-eb69-455e-98fb-97daec1ad9fb tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] 10.222.0.93 "GET /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b" status: 200 len: 1477 microversion: 2.1 time: 0.243692 Aug 04 17:51:29.826607 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3354/6740] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:29 2022] GET /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b => generated 1477 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:30.280276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-59170bc8-3335-4674-afb1-3de2be82dc04 req-cc48c818-88c3-4048-b065-576e2b111518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f8751b5-c363-4192-8390-176abf83df7b", "name": "network-vif-deleted", "tag": "82e12032-faea-4b60-8f13-5f0ec3809706"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:51:30.292193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-59170bc8-3335-4674-afb1-3de2be82dc04 req-cc48c818-88c3-4048-b065-576e2b111518 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:30.292682 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-59170bc8-3335-4674-afb1-3de2be82dc04 req-cc48c818-88c3-4048-b065-576e2b111518 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:30.293118 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-59170bc8-3335-4674-afb1-3de2be82dc04 req-cc48c818-88c3-4048-b065-576e2b111518 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:30.305256 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-59170bc8-3335-4674-afb1-3de2be82dc04 req-cc48c818-88c3-4048-b065-576e2b111518 service nova] Creating event network-vif-deleted:82e12032-faea-4b60-8f13-5f0ec3809706 for instance 6f8751b5-c363-4192-8390-176abf83df7b on n-h1-851359-3 Aug 04 17:51:30.311380 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-59170bc8-3335-4674-afb1-3de2be82dc04 req-cc48c818-88c3-4048-b065-576e2b111518 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035666 Aug 04 17:51:30.312187 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3387/6741] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:51:30.841534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-72b93f2e-d17e-426a-b818-20ba665fa741 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:30.842204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-72b93f2e-d17e-426a-b818-20ba665fa741 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] [instance: 6f8751b5-c363-4192-8390-176abf83df7b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:30.849888 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72b93f2e-d17e-426a-b818-20ba665fa741 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:30.850643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72b93f2e-d17e-426a-b818-20ba665fa741 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:30.851105 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72b93f2e-d17e-426a-b818-20ba665fa741 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:30.851931 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72b93f2e-d17e-426a-b818-20ba665fa741 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:30.852413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72b93f2e-d17e-426a-b818-20ba665fa741 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:30.852860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72b93f2e-d17e-426a-b818-20ba665fa741 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:30.867244 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-72b93f2e-d17e-426a-b818-20ba665fa741 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] HTTP exception thrown: Instance 6f8751b5-c363-4192-8390-176abf83df7b could not be found. Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-72b93f2e-d17e-426a-b818-20ba665fa741 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Request method failure captured: Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b HTTP/1.1 Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AcRQo4lZdWtLCRg1roaoQvzjaiuhednfjcSQVNxqJcvZK8mse-SbpVaXFVD1j0kpqTqpMOL7ExxyMj65dOKDwMo_cx8bVoBXwVUVG7eh433nPXFjK6Q9ILhkmLyOW5gyjPMrjAy9YOvvPN9yWapapBRHdSxen_Axy-wUiUpv0AUZOE Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 51b6b8c71239489e80edc68332a03c73 Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1554088485 Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/51b6b8c71239489e80edc68332a03c73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/51b6b8c71239489e80edc68332a03c73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_51b6b8c71239489e80edc68332a03c73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/51b6b8c71239489e80edc68332a03c73"}]}] Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1554088485 Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 51b6b8c71239489e80edc68332a03c73 Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1554088485 Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersAdminNegativeTestJSON-1554088485-project Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 577010d3687f46e982388a4f607aad4f Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1554088485-project Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 6f8751b5-c363-4192-8390-176abf83df7b could not be found. Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '6f8751b5-c363-4192-8390-176abf83df7b'} Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f8751b5-c363-4192-8390-176abf83df7b could not be found. Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f8751b5-c363-4192-8390-176abf83df7b could not be found. Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:51:30.868924 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:51:30.874053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:51:30.874053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:51:30.874053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:51:30.874053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:51:30.874053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:51:30.874053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:51:30.874053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f8751b5-c363-4192-8390-176abf83df7b could not be found. Aug 04 17:51:30.874053 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:51:30.874053 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-72b93f2e-d17e-426a-b818-20ba665fa741 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] Returning 404 to user: Instance 6f8751b5-c363-4192-8390-176abf83df7b could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:51:30.874053 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-72b93f2e-d17e-426a-b818-20ba665fa741 tempest-ServersAdminNegativeTestJSON-1554088485 tempest-ServersAdminNegativeTestJSON-1554088485-project] 10.222.0.93 "GET /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b" status: 404 len: 111 microversion: 2.1 time: 0.033024 Aug 04 17:51:30.874053 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3355/6742] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:30 2022] GET /compute/v2.1/servers/6f8751b5-c363-4192-8390-176abf83df7b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:51:37.299532 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6a4bde2d-1270-469f-855b-fbbfcf01a220 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1194149250", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "74b36c6d-16fe-4391-8c3a-2c03185429d4"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:51:37.359216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-6a4bde2d-1270-469f-855b-fbbfcf01a220 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] validate_networks() for [('74b36c6d-16fe-4391-8c3a-2c03185429d4', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:51:37.809143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-6a4bde2d-1270-469f-855b-fbbfcf01a220 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:51:37.809578 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-6a4bde2d-1270-469f-855b-fbbfcf01a220 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:51:37.810115 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-6a4bde2d-1270-469f-855b-fbbfcf01a220 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:51:37.810536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-6a4bde2d-1270-469f-855b-fbbfcf01a220 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:51:37.810957 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-6a4bde2d-1270-469f-855b-fbbfcf01a220 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:51:37.822042 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a4bde2d-1270-469f-855b-fbbfcf01a220 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:37.822543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a4bde2d-1270-469f-855b-fbbfcf01a220 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:37.822990 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a4bde2d-1270-469f-855b-fbbfcf01a220 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:37.823741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a4bde2d-1270-469f-855b-fbbfcf01a220 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:37.824207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a4bde2d-1270-469f-855b-fbbfcf01a220 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:37.824649 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6a4bde2d-1270-469f-855b-fbbfcf01a220 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:37.847525 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-6a4bde2d-1270-469f-855b-fbbfcf01a220 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Getting quotas for project ab36c0c6bf5d465f8e1d0a7299e251ab. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:51:37.854028 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-6a4bde2d-1270-469f-855b-fbbfcf01a220 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Getting quotas for user 69b9b290d5c04f6f923b37b015e3050d and project ab36c0c6bf5d465f8e1d0a7299e251ab. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:51:37.867954 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6a4bde2d-1270-469f-855b-fbbfcf01a220 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:51:37.870400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6a4bde2d-1270-469f-855b-fbbfcf01a220 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:51:37.917082 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6a4bde2d-1270-469f-855b-fbbfcf01a220 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.766612 Aug 04 17:51:37.918639 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3388/6743] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:51:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:51:37.929756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fd45a857-4565-4d73-b95a-e9dc82091fcf tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:37.930531 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fd45a857-4565-4d73-b95a-e9dc82091fcf tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:37.933891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:51:37.934773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:51:38.007973 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fd45a857-4565-4d73-b95a-e9dc82091fcf tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:38.015587 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fd45a857-4565-4d73-b95a-e9dc82091fcf tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1215 microversion: 2.1 time: 0.090335 Aug 04 17:51:38.016892 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3356/6744] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:37 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1215 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:39.038754 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-95e7f8d9-3f57-472f-aefa-0547e47700b0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:39.039504 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-95e7f8d9-3f57-472f-aefa-0547e47700b0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:39.046119 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95e7f8d9-3f57-472f-aefa-0547e47700b0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:39.046900 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95e7f8d9-3f57-472f-aefa-0547e47700b0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:39.047386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95e7f8d9-3f57-472f-aefa-0547e47700b0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:39.048176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95e7f8d9-3f57-472f-aefa-0547e47700b0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:39.048718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95e7f8d9-3f57-472f-aefa-0547e47700b0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:39.049226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95e7f8d9-3f57-472f-aefa-0547e47700b0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:39.395419 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-95e7f8d9-3f57-472f-aefa-0547e47700b0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:39.404290 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-95e7f8d9-3f57-472f-aefa-0547e47700b0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1273 microversion: 2.1 time: 0.371295 Aug 04 17:51:39.411832 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3389/6745] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:39 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1273 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:40.426501 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f0b501e6-15cd-42e1-98c0-6f8d68423f7b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:40.428159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f0b501e6-15cd-42e1-98c0-6f8d68423f7b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:40.452055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0b501e6-15cd-42e1-98c0-6f8d68423f7b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:40.453506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0b501e6-15cd-42e1-98c0-6f8d68423f7b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:40.454637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0b501e6-15cd-42e1-98c0-6f8d68423f7b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:40.455883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0b501e6-15cd-42e1-98c0-6f8d68423f7b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:40.458143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0b501e6-15cd-42e1-98c0-6f8d68423f7b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:40.459707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0b501e6-15cd-42e1-98c0-6f8d68423f7b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:40.732277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f0b501e6-15cd-42e1-98c0-6f8d68423f7b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:40.743644 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f0b501e6-15cd-42e1-98c0-6f8d68423f7b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1315 microversion: 2.1 time: 0.320990 Aug 04 17:51:40.745547 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3357/6746] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:40 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:40.979787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-bdc3a95c-db9b-485e-8093-1604206f42fd req-e6fb5126-71de-4e8b-b444-d633bed0079a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fe5c6c1-68ae-4585-bc6a-dc2bc156276a", "tag": "6599ab7e-6f1c-4f75-a9f0-bb0f206f8b06"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:51:41.001613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-bdc3a95c-db9b-485e-8093-1604206f42fd req-e6fb5126-71de-4e8b-b444-d633bed0079a service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:41.003969 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-bdc3a95c-db9b-485e-8093-1604206f42fd req-e6fb5126-71de-4e8b-b444-d633bed0079a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:41.006841 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-bdc3a95c-db9b-485e-8093-1604206f42fd req-e6fb5126-71de-4e8b-b444-d633bed0079a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:41.025730 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-bdc3a95c-db9b-485e-8093-1604206f42fd req-e6fb5126-71de-4e8b-b444-d633bed0079a service nova] Creating event network-changed:6599ab7e-6f1c-4f75-a9f0-bb0f206f8b06 for instance 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a on n-h1-851359-3 Aug 04 17:51:41.031547 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-bdc3a95c-db9b-485e-8093-1604206f42fd req-e6fb5126-71de-4e8b-b444-d633bed0079a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056784 Aug 04 17:51:41.033165 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3390/6747] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:51:41.765497 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cb2e52bd-0b92-4692-b691-37dbf4b515d8 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:41.766231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cb2e52bd-0b92-4692-b691-37dbf4b515d8 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:41.773618 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb2e52bd-0b92-4692-b691-37dbf4b515d8 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:41.774158 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb2e52bd-0b92-4692-b691-37dbf4b515d8 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:41.775546 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb2e52bd-0b92-4692-b691-37dbf4b515d8 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:41.775546 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb2e52bd-0b92-4692-b691-37dbf4b515d8 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:41.775999 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb2e52bd-0b92-4692-b691-37dbf4b515d8 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:41.776446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb2e52bd-0b92-4692-b691-37dbf4b515d8 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:41.916973 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cb2e52bd-0b92-4692-b691-37dbf4b515d8 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:41.925017 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cb2e52bd-0b92-4692-b691-37dbf4b515d8 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1315 microversion: 2.1 time: 0.163352 Aug 04 17:51:41.930399 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3358/6748] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:41 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:42.948632 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7022c1a3-1dcc-4a17-ae25-79bfa46e30ee tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:42.949257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7022c1a3-1dcc-4a17-ae25-79bfa46e30ee tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:42.955363 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7022c1a3-1dcc-4a17-ae25-79bfa46e30ee tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:42.955844 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7022c1a3-1dcc-4a17-ae25-79bfa46e30ee tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:42.956280 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7022c1a3-1dcc-4a17-ae25-79bfa46e30ee tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:42.956966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7022c1a3-1dcc-4a17-ae25-79bfa46e30ee tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:42.957423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7022c1a3-1dcc-4a17-ae25-79bfa46e30ee tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:42.957851 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7022c1a3-1dcc-4a17-ae25-79bfa46e30ee tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:43.088975 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7022c1a3-1dcc-4a17-ae25-79bfa46e30ee tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:43.096851 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7022c1a3-1dcc-4a17-ae25-79bfa46e30ee tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1315 microversion: 2.1 time: 0.154066 Aug 04 17:51:43.097408 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3391/6749] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:42 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:44.117291 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8fee9b50-8f0b-4fba-b110-baef9750b035 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:44.117915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8fee9b50-8f0b-4fba-b110-baef9750b035 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:44.124854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fee9b50-8f0b-4fba-b110-baef9750b035 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:44.125352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fee9b50-8f0b-4fba-b110-baef9750b035 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:44.125804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fee9b50-8f0b-4fba-b110-baef9750b035 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:44.126557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fee9b50-8f0b-4fba-b110-baef9750b035 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:44.127028 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fee9b50-8f0b-4fba-b110-baef9750b035 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:44.127470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fee9b50-8f0b-4fba-b110-baef9750b035 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:44.272637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8fee9b50-8f0b-4fba-b110-baef9750b035 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:44.283745 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8fee9b50-8f0b-4fba-b110-baef9750b035 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1315 microversion: 2.1 time: 0.170048 Aug 04 17:51:44.284771 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3359/6750] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:44 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:45.305403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1bf8a534-68cb-48d1-89c7-10051aaa1417 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:45.306105 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1bf8a534-68cb-48d1-89c7-10051aaa1417 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:45.308856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:51:45.314103 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1bf8a534-68cb-48d1-89c7-10051aaa1417 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:45.314594 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1bf8a534-68cb-48d1-89c7-10051aaa1417 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:45.315032 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1bf8a534-68cb-48d1-89c7-10051aaa1417 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:45.315734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1bf8a534-68cb-48d1-89c7-10051aaa1417 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:45.316194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1bf8a534-68cb-48d1-89c7-10051aaa1417 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:45.316618 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1bf8a534-68cb-48d1-89c7-10051aaa1417 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:45.320019 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=68 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:51:45.446547 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1bf8a534-68cb-48d1-89c7-10051aaa1417 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:45.453998 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1bf8a534-68cb-48d1-89c7-10051aaa1417 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1315 microversion: 2.1 time: 0.152506 Aug 04 17:51:45.454559 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3392/6751] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:45 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:45.872375 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-2590d1be-d11c-415f-a601-1ddac3d6c1bf req-4ce884c5-c650-4dbd-9f0d-5a951c6197cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fe5c6c1-68ae-4585-bc6a-dc2bc156276a", "name": "network-vif-plugged", "status": "completed", "tag": "6599ab7e-6f1c-4f75-a9f0-bb0f206f8b06"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:51:45.878135 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:51:45.885602 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2590d1be-d11c-415f-a601-1ddac3d6c1bf req-4ce884c5-c650-4dbd-9f0d-5a951c6197cf service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:45.886147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2590d1be-d11c-415f-a601-1ddac3d6c1bf req-4ce884c5-c650-4dbd-9f0d-5a951c6197cf service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:45.886608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2590d1be-d11c-415f-a601-1ddac3d6c1bf req-4ce884c5-c650-4dbd-9f0d-5a951c6197cf service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:45.890873 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:51:45.899439 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-2590d1be-d11c-415f-a601-1ddac3d6c1bf req-4ce884c5-c650-4dbd-9f0d-5a951c6197cf service nova] Creating event network-vif-plugged:6599ab7e-6f1c-4f75-a9f0-bb0f206f8b06 for instance 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a on n-h1-851359-3 Aug 04 17:51:45.904857 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-2590d1be-d11c-415f-a601-1ddac3d6c1bf req-4ce884c5-c650-4dbd-9f0d-5a951c6197cf service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036486 Aug 04 17:51:45.905461 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3360/6752] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:51:46.476042 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7b5241ed-f43b-4586-9509-1b817b0f1e29 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:46.476674 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7b5241ed-f43b-4586-9509-1b817b0f1e29 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:46.483639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b5241ed-f43b-4586-9509-1b817b0f1e29 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:46.484135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b5241ed-f43b-4586-9509-1b817b0f1e29 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:46.484583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b5241ed-f43b-4586-9509-1b817b0f1e29 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:46.485297 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b5241ed-f43b-4586-9509-1b817b0f1e29 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:46.485765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b5241ed-f43b-4586-9509-1b817b0f1e29 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:46.486235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b5241ed-f43b-4586-9509-1b817b0f1e29 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:46.615891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7b5241ed-f43b-4586-9509-1b817b0f1e29 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:46.623394 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7b5241ed-f43b-4586-9509-1b817b0f1e29 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1315 microversion: 2.1 time: 0.151969 Aug 04 17:51:46.623948 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3393/6753] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:46 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:51:47.647458 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c321a11c-ed58-4a32-b439-29ce1a208d0d tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:47.648219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c321a11c-ed58-4a32-b439-29ce1a208d0d tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:47.655397 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c321a11c-ed58-4a32-b439-29ce1a208d0d tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:47.655896 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c321a11c-ed58-4a32-b439-29ce1a208d0d tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:47.656346 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c321a11c-ed58-4a32-b439-29ce1a208d0d tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:47.657057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c321a11c-ed58-4a32-b439-29ce1a208d0d tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:47.657535 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c321a11c-ed58-4a32-b439-29ce1a208d0d tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:47.658025 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c321a11c-ed58-4a32-b439-29ce1a208d0d tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:47.793029 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c321a11c-ed58-4a32-b439-29ce1a208d0d tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:47.800838 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c321a11c-ed58-4a32-b439-29ce1a208d0d tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1502 microversion: 2.1 time: 0.160189 Aug 04 17:51:47.801428 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3361/6754] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:47 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:51:47.821848 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-376e2885-0f7d-412e-b159-675b74337bb3 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:51:47.824262 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-376e2885-0f7d-412e-b159-675b74337bb3 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:47.831088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-376e2885-0f7d-412e-b159-675b74337bb3 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:47.831583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-376e2885-0f7d-412e-b159-675b74337bb3 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:47.832026 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-376e2885-0f7d-412e-b159-675b74337bb3 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:47.832724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-376e2885-0f7d-412e-b159-675b74337bb3 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:47.833385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-376e2885-0f7d-412e-b159-675b74337bb3 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:47.833818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-376e2885-0f7d-412e-b159-675b74337bb3 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:47.834328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=5 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:51:47.873010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=8 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:51:47.911514 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-376e2885-0f7d-412e-b159-675b74337bb3 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:47.917451 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-376e2885-0f7d-412e-b159-675b74337bb3 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Old instance type m1.heat2, new instance type m1.heat {{(pid=131043) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 17:51:47.923633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-376e2885-0f7d-412e-b159-675b74337bb3 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:51:47.924055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-376e2885-0f7d-412e-b159-675b74337bb3 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:51:47.924531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-376e2885-0f7d-412e-b159-675b74337bb3 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:51:47.924949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-376e2885-0f7d-412e-b159-675b74337bb3 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:51:47.925361 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-376e2885-0f7d-412e-b159-675b74337bb3 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:51:48.039566 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-376e2885-0f7d-412e-b159-675b74337bb3 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "POST /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a/action" status: 202 len: 0 microversion: 2.1 time: 0.221503 Aug 04 17:51:48.040290 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3394/6755] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:51:47 2022] POST /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:51:48.048561 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-84ff25a8-e884-4a26-bbb4-562da78338c4 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:48.049406 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-84ff25a8-e884-4a26-bbb4-562da78338c4 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:48.051663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:51:48.057291 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84ff25a8-e884-4a26-bbb4-562da78338c4 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:48.057803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84ff25a8-e884-4a26-bbb4-562da78338c4 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:48.058300 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84ff25a8-e884-4a26-bbb4-562da78338c4 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:48.059085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84ff25a8-e884-4a26-bbb4-562da78338c4 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:48.059567 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84ff25a8-e884-4a26-bbb4-562da78338c4 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:48.060020 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84ff25a8-e884-4a26-bbb4-562da78338c4 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:48.232399 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-84ff25a8-e884-4a26-bbb4-562da78338c4 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:48.240960 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-84ff25a8-e884-4a26-bbb4-562da78338c4 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1511 microversion: 2.1 time: 0.196368 Aug 04 17:51:48.241545 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3362/6756] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:48 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1511 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:49.262015 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-350d5ed2-1ac8-4e09-b5d1-5acbdaf60c92 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:49.262569 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-350d5ed2-1ac8-4e09-b5d1-5acbdaf60c92 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:49.269333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-350d5ed2-1ac8-4e09-b5d1-5acbdaf60c92 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:49.269834 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-350d5ed2-1ac8-4e09-b5d1-5acbdaf60c92 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:49.270333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-350d5ed2-1ac8-4e09-b5d1-5acbdaf60c92 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:49.271055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-350d5ed2-1ac8-4e09-b5d1-5acbdaf60c92 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:49.271525 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-350d5ed2-1ac8-4e09-b5d1-5acbdaf60c92 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:49.271963 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-350d5ed2-1ac8-4e09-b5d1-5acbdaf60c92 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:49.404079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-350d5ed2-1ac8-4e09-b5d1-5acbdaf60c92 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:49.412340 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-350d5ed2-1ac8-4e09-b5d1-5acbdaf60c92 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1511 microversion: 2.1 time: 0.154918 Aug 04 17:51:49.412920 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3395/6757] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:49 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:50.433737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0e584947-88c8-4518-8341-dfe53386a7d9 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:50.434359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0e584947-88c8-4518-8341-dfe53386a7d9 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:50.441144 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e584947-88c8-4518-8341-dfe53386a7d9 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:50.441648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e584947-88c8-4518-8341-dfe53386a7d9 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:50.442150 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e584947-88c8-4518-8341-dfe53386a7d9 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:50.442865 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e584947-88c8-4518-8341-dfe53386a7d9 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:50.443346 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e584947-88c8-4518-8341-dfe53386a7d9 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:50.443793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e584947-88c8-4518-8341-dfe53386a7d9 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:50.576124 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0e584947-88c8-4518-8341-dfe53386a7d9 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:50.583665 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0e584947-88c8-4518-8341-dfe53386a7d9 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1516 microversion: 2.1 time: 0.153948 Aug 04 17:51:50.584236 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3363/6758] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:50 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:51.605249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-89b7e7c4-87b3-49a1-8f89-55b7710c793b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:51.605910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-89b7e7c4-87b3-49a1-8f89-55b7710c793b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:51.612884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89b7e7c4-87b3-49a1-8f89-55b7710c793b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:51.613383 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89b7e7c4-87b3-49a1-8f89-55b7710c793b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:51.613833 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89b7e7c4-87b3-49a1-8f89-55b7710c793b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:51.614570 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89b7e7c4-87b3-49a1-8f89-55b7710c793b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:51.615043 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89b7e7c4-87b3-49a1-8f89-55b7710c793b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:51.615487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89b7e7c4-87b3-49a1-8f89-55b7710c793b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:51.750792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-89b7e7c4-87b3-49a1-8f89-55b7710c793b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:51.760413 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-89b7e7c4-87b3-49a1-8f89-55b7710c793b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1516 microversion: 2.1 time: 0.159110 Aug 04 17:51:51.760989 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3396/6759] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:51 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:52.781008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a1e9f30e-b73d-4d80-aec6-4d88bd716443 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:52.781651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a1e9f30e-b73d-4d80-aec6-4d88bd716443 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:52.789264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1e9f30e-b73d-4d80-aec6-4d88bd716443 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:52.789768 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1e9f30e-b73d-4d80-aec6-4d88bd716443 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:52.790249 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1e9f30e-b73d-4d80-aec6-4d88bd716443 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:52.790968 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1e9f30e-b73d-4d80-aec6-4d88bd716443 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:52.791447 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1e9f30e-b73d-4d80-aec6-4d88bd716443 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:52.791893 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1e9f30e-b73d-4d80-aec6-4d88bd716443 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:52.932388 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a1e9f30e-b73d-4d80-aec6-4d88bd716443 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:52.940827 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a1e9f30e-b73d-4d80-aec6-4d88bd716443 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1516 microversion: 2.1 time: 0.163836 Aug 04 17:51:52.941413 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3364/6760] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:52 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:53.962879 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-14cffaf1-01f1-485d-8874-95361af6f2e1 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:53.963629 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-14cffaf1-01f1-485d-8874-95361af6f2e1 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:53.971332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14cffaf1-01f1-485d-8874-95361af6f2e1 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:53.971833 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14cffaf1-01f1-485d-8874-95361af6f2e1 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:53.972282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14cffaf1-01f1-485d-8874-95361af6f2e1 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:53.972998 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14cffaf1-01f1-485d-8874-95361af6f2e1 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:53.973469 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14cffaf1-01f1-485d-8874-95361af6f2e1 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:53.973907 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-14cffaf1-01f1-485d-8874-95361af6f2e1 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:54.108689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-14cffaf1-01f1-485d-8874-95361af6f2e1 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:54.116297 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-14cffaf1-01f1-485d-8874-95361af6f2e1 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1516 microversion: 2.1 time: 0.158642 Aug 04 17:51:54.116860 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3397/6761] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:53 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:55.136940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b52d3ca9-28a9-41f6-841a-9832d37e6251 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:55.137584 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b52d3ca9-28a9-41f6-841a-9832d37e6251 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:55.144756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b52d3ca9-28a9-41f6-841a-9832d37e6251 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:55.145254 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b52d3ca9-28a9-41f6-841a-9832d37e6251 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:55.145708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b52d3ca9-28a9-41f6-841a-9832d37e6251 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:55.146458 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b52d3ca9-28a9-41f6-841a-9832d37e6251 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:55.146934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b52d3ca9-28a9-41f6-841a-9832d37e6251 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:55.147442 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b52d3ca9-28a9-41f6-841a-9832d37e6251 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:55.282008 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b52d3ca9-28a9-41f6-841a-9832d37e6251 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:55.291241 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b52d3ca9-28a9-41f6-841a-9832d37e6251 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1516 microversion: 2.1 time: 0.158242 Aug 04 17:51:55.291810 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3365/6762] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:55 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:56.312722 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1e0b3398-ed98-4d35-8d41-dc4d755beb28 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:56.313362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1e0b3398-ed98-4d35-8d41-dc4d755beb28 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:56.320935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e0b3398-ed98-4d35-8d41-dc4d755beb28 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:56.321435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e0b3398-ed98-4d35-8d41-dc4d755beb28 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:56.321908 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e0b3398-ed98-4d35-8d41-dc4d755beb28 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:56.322691 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e0b3398-ed98-4d35-8d41-dc4d755beb28 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:56.323790 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e0b3398-ed98-4d35-8d41-dc4d755beb28 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:56.324444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e0b3398-ed98-4d35-8d41-dc4d755beb28 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:56.467814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1e0b3398-ed98-4d35-8d41-dc4d755beb28 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:56.479883 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1e0b3398-ed98-4d35-8d41-dc4d755beb28 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1516 microversion: 2.1 time: 0.171077 Aug 04 17:51:56.480676 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3398/6763] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:56 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:57.509221 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-429d1c13-90cb-497a-bc11-5b7d7414552a tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:57.509872 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-429d1c13-90cb-497a-bc11-5b7d7414552a tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:57.517080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-429d1c13-90cb-497a-bc11-5b7d7414552a tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:57.517582 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-429d1c13-90cb-497a-bc11-5b7d7414552a tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:57.518072 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-429d1c13-90cb-497a-bc11-5b7d7414552a tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:57.518795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-429d1c13-90cb-497a-bc11-5b7d7414552a tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:57.519276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-429d1c13-90cb-497a-bc11-5b7d7414552a tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:57.519719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-429d1c13-90cb-497a-bc11-5b7d7414552a tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:57.657509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-429d1c13-90cb-497a-bc11-5b7d7414552a tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:57.665559 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-429d1c13-90cb-497a-bc11-5b7d7414552a tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1516 microversion: 2.1 time: 0.166414 Aug 04 17:51:57.666182 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3366/6764] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:57 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:58.686697 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-682c70ac-a63c-471f-b404-f02b82d8b870 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:58.687254 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-682c70ac-a63c-471f-b404-f02b82d8b870 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:58.694297 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-682c70ac-a63c-471f-b404-f02b82d8b870 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:58.694804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-682c70ac-a63c-471f-b404-f02b82d8b870 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:58.695258 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-682c70ac-a63c-471f-b404-f02b82d8b870 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:58.695991 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-682c70ac-a63c-471f-b404-f02b82d8b870 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:58.696468 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-682c70ac-a63c-471f-b404-f02b82d8b870 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:58.696911 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-682c70ac-a63c-471f-b404-f02b82d8b870 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:58.830021 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-682c70ac-a63c-471f-b404-f02b82d8b870 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:51:58.838084 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-682c70ac-a63c-471f-b404-f02b82d8b870 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1516 microversion: 2.1 time: 0.155354 Aug 04 17:51:58.838655 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3399/6765] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:58 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:51:59.859122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6b78e5ba-e919-44cf-8aac-018b4186cb90 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:51:59.859771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6b78e5ba-e919-44cf-8aac-018b4186cb90 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:51:59.867832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b78e5ba-e919-44cf-8aac-018b4186cb90 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:59.868386 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b78e5ba-e919-44cf-8aac-018b4186cb90 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:59.868851 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b78e5ba-e919-44cf-8aac-018b4186cb90 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:51:59.869583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b78e5ba-e919-44cf-8aac-018b4186cb90 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:51:59.870095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b78e5ba-e919-44cf-8aac-018b4186cb90 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:51:59.870546 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b78e5ba-e919-44cf-8aac-018b4186cb90 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:00.009001 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6b78e5ba-e919-44cf-8aac-018b4186cb90 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:00.017181 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6b78e5ba-e919-44cf-8aac-018b4186cb90 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1516 microversion: 2.1 time: 0.162061 Aug 04 17:52:00.017759 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3367/6766] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:51:59 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:01.039233 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-019db537-6ffd-4254-8c0f-1a47029d14b7 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:01.039836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-019db537-6ffd-4254-8c0f-1a47029d14b7 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:01.046064 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-019db537-6ffd-4254-8c0f-1a47029d14b7 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:01.046566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-019db537-6ffd-4254-8c0f-1a47029d14b7 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:01.047020 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-019db537-6ffd-4254-8c0f-1a47029d14b7 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:01.047727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-019db537-6ffd-4254-8c0f-1a47029d14b7 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:01.048197 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-019db537-6ffd-4254-8c0f-1a47029d14b7 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:01.048639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-019db537-6ffd-4254-8c0f-1a47029d14b7 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:01.177401 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-019db537-6ffd-4254-8c0f-1a47029d14b7 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:01.185063 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-019db537-6ffd-4254-8c0f-1a47029d14b7 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1516 microversion: 2.1 time: 0.150572 Aug 04 17:52:01.185636 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3400/6767] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:01 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:02.206801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3830f3f2-b598-429e-9579-08bbae1080d3 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:02.207441 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3830f3f2-b598-429e-9579-08bbae1080d3 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:02.214429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3830f3f2-b598-429e-9579-08bbae1080d3 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:02.214940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3830f3f2-b598-429e-9579-08bbae1080d3 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:02.215399 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3830f3f2-b598-429e-9579-08bbae1080d3 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:02.216125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3830f3f2-b598-429e-9579-08bbae1080d3 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:02.216867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3830f3f2-b598-429e-9579-08bbae1080d3 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:02.217309 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3830f3f2-b598-429e-9579-08bbae1080d3 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:02.354124 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3830f3f2-b598-429e-9579-08bbae1080d3 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:02.362330 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3830f3f2-b598-429e-9579-08bbae1080d3 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1516 microversion: 2.1 time: 0.159383 Aug 04 17:52:02.362937 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3368/6768] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:02 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:03.384016 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9f3b0f59-f208-4d03-82e5-0bbadbe587bf tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:03.384648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9f3b0f59-f208-4d03-82e5-0bbadbe587bf tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:03.391473 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f3b0f59-f208-4d03-82e5-0bbadbe587bf tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:03.391979 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f3b0f59-f208-4d03-82e5-0bbadbe587bf tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:03.392427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f3b0f59-f208-4d03-82e5-0bbadbe587bf tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:03.393137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f3b0f59-f208-4d03-82e5-0bbadbe587bf tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:03.393605 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f3b0f59-f208-4d03-82e5-0bbadbe587bf tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:03.394072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f3b0f59-f208-4d03-82e5-0bbadbe587bf tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:03.539131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9f3b0f59-f208-4d03-82e5-0bbadbe587bf tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:03.546952 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9f3b0f59-f208-4d03-82e5-0bbadbe587bf tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1516 microversion: 2.1 time: 0.167297 Aug 04 17:52:03.547561 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3401/6769] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:03 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:04.568424 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e42e4049-9741-44fd-ba8f-fac2984c6f4b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:04.569092 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e42e4049-9741-44fd-ba8f-fac2984c6f4b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:04.577025 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e42e4049-9741-44fd-ba8f-fac2984c6f4b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:04.577533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e42e4049-9741-44fd-ba8f-fac2984c6f4b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:04.578003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e42e4049-9741-44fd-ba8f-fac2984c6f4b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:04.578774 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e42e4049-9741-44fd-ba8f-fac2984c6f4b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:04.579254 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e42e4049-9741-44fd-ba8f-fac2984c6f4b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:04.579704 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e42e4049-9741-44fd-ba8f-fac2984c6f4b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:04.727384 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e42e4049-9741-44fd-ba8f-fac2984c6f4b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:04.735756 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e42e4049-9741-44fd-ba8f-fac2984c6f4b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1516 microversion: 2.1 time: 0.171486 Aug 04 17:52:04.736331 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3369/6770] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:04 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:05.758693 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1ccc685d-4fb2-4b46-9056-162b631bf468 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:05.759631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1ccc685d-4fb2-4b46-9056-162b631bf468 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:05.771463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ccc685d-4fb2-4b46-9056-162b631bf468 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:05.772503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ccc685d-4fb2-4b46-9056-162b631bf468 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:05.773202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ccc685d-4fb2-4b46-9056-162b631bf468 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:05.774217 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ccc685d-4fb2-4b46-9056-162b631bf468 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:05.775081 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ccc685d-4fb2-4b46-9056-162b631bf468 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:05.775992 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ccc685d-4fb2-4b46-9056-162b631bf468 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:05.927642 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1ccc685d-4fb2-4b46-9056-162b631bf468 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:05.935352 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1ccc685d-4fb2-4b46-9056-162b631bf468 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1516 microversion: 2.1 time: 0.181287 Aug 04 17:52:05.935972 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3402/6771] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:05 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1516 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:06.957082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c5d9578a-0189-4285-966c-0f0d42c617a9 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:06.957753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c5d9578a-0189-4285-966c-0f0d42c617a9 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:06.966228 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5d9578a-0189-4285-966c-0f0d42c617a9 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:06.967026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5d9578a-0189-4285-966c-0f0d42c617a9 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:06.967517 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5d9578a-0189-4285-966c-0f0d42c617a9 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:06.968326 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5d9578a-0189-4285-966c-0f0d42c617a9 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:06.968822 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5d9578a-0189-4285-966c-0f0d42c617a9 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:06.969357 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5d9578a-0189-4285-966c-0f0d42c617a9 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:07.116516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c5d9578a-0189-4285-966c-0f0d42c617a9 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:07.124655 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c5d9578a-0189-4285-966c-0f0d42c617a9 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1516 microversion: 2.1 time: 0.172322 Aug 04 17:52:07.125250 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3370/6772] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:06 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:08.147306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-893a1ce3-9555-403e-a43c-497a79716225 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:08.148067 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-893a1ce3-9555-403e-a43c-497a79716225 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:08.155794 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-893a1ce3-9555-403e-a43c-497a79716225 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:08.156293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-893a1ce3-9555-403e-a43c-497a79716225 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:08.156747 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-893a1ce3-9555-403e-a43c-497a79716225 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:08.157506 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-893a1ce3-9555-403e-a43c-497a79716225 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:08.157994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-893a1ce3-9555-403e-a43c-497a79716225 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:08.158446 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-893a1ce3-9555-403e-a43c-497a79716225 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:08.297567 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-893a1ce3-9555-403e-a43c-497a79716225 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:08.305135 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-893a1ce3-9555-403e-a43c-497a79716225 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1516 microversion: 2.1 time: 0.162708 Aug 04 17:52:08.305707 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3403/6773] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:08 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:09.326739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7c538a9f-f523-4a11-8626-c68b54c67ea6 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:09.327375 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7c538a9f-f523-4a11-8626-c68b54c67ea6 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:09.334141 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c538a9f-f523-4a11-8626-c68b54c67ea6 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:09.334637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c538a9f-f523-4a11-8626-c68b54c67ea6 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:09.335082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c538a9f-f523-4a11-8626-c68b54c67ea6 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:09.335777 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c538a9f-f523-4a11-8626-c68b54c67ea6 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:09.336246 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c538a9f-f523-4a11-8626-c68b54c67ea6 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:09.337298 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c538a9f-f523-4a11-8626-c68b54c67ea6 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:09.471260 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7c538a9f-f523-4a11-8626-c68b54c67ea6 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:09.478946 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7c538a9f-f523-4a11-8626-c68b54c67ea6 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1516 microversion: 2.1 time: 0.156135 Aug 04 17:52:09.479534 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3371/6774] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:09 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:10.501123 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fe069bc4-8a22-4e40-8fa2-eae640333a98 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:10.502054 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fe069bc4-8a22-4e40-8fa2-eae640333a98 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:10.511346 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fe069bc4-8a22-4e40-8fa2-eae640333a98 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:10.511941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fe069bc4-8a22-4e40-8fa2-eae640333a98 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:10.512544 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fe069bc4-8a22-4e40-8fa2-eae640333a98 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:10.513489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fe069bc4-8a22-4e40-8fa2-eae640333a98 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:10.514111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fe069bc4-8a22-4e40-8fa2-eae640333a98 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:10.514615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fe069bc4-8a22-4e40-8fa2-eae640333a98 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:10.669345 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fe069bc4-8a22-4e40-8fa2-eae640333a98 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:10.676935 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fe069bc4-8a22-4e40-8fa2-eae640333a98 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1516 microversion: 2.1 time: 0.180519 Aug 04 17:52:10.677514 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3404/6775] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:10 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1516 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:11.698948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8828f868-9a21-4430-aac5-2079343f4e8d tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:11.699582 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8828f868-9a21-4430-aac5-2079343f4e8d tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:11.708515 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8828f868-9a21-4430-aac5-2079343f4e8d tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:11.709024 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8828f868-9a21-4430-aac5-2079343f4e8d tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:11.709482 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8828f868-9a21-4430-aac5-2079343f4e8d tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:11.710238 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8828f868-9a21-4430-aac5-2079343f4e8d tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:11.710718 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8828f868-9a21-4430-aac5-2079343f4e8d tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:11.711163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8828f868-9a21-4430-aac5-2079343f4e8d tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:11.852854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8828f868-9a21-4430-aac5-2079343f4e8d tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:11.860710 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8828f868-9a21-4430-aac5-2079343f4e8d tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1516 microversion: 2.1 time: 0.166187 Aug 04 17:52:11.861283 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3372/6776] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:11 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:12.882081 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4e35ad90-1d29-48ad-9038-d8cbbf8af4ac tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:12.882668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4e35ad90-1d29-48ad-9038-d8cbbf8af4ac tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:12.889468 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e35ad90-1d29-48ad-9038-d8cbbf8af4ac tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:12.889963 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e35ad90-1d29-48ad-9038-d8cbbf8af4ac tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:12.890438 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e35ad90-1d29-48ad-9038-d8cbbf8af4ac tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:12.891147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e35ad90-1d29-48ad-9038-d8cbbf8af4ac tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:12.891618 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e35ad90-1d29-48ad-9038-d8cbbf8af4ac tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:12.892056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4e35ad90-1d29-48ad-9038-d8cbbf8af4ac tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:13.035492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4e35ad90-1d29-48ad-9038-d8cbbf8af4ac tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:13.043230 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4e35ad90-1d29-48ad-9038-d8cbbf8af4ac tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1516 microversion: 2.1 time: 0.165241 Aug 04 17:52:13.043808 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3405/6777] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:12 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:14.067177 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ec2fcce2-b5db-44cf-8aaa-78eebad084bb tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:14.067813 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ec2fcce2-b5db-44cf-8aaa-78eebad084bb tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:14.074725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec2fcce2-b5db-44cf-8aaa-78eebad084bb tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:14.075226 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec2fcce2-b5db-44cf-8aaa-78eebad084bb tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:14.075683 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec2fcce2-b5db-44cf-8aaa-78eebad084bb tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:14.076404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec2fcce2-b5db-44cf-8aaa-78eebad084bb tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:14.076875 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec2fcce2-b5db-44cf-8aaa-78eebad084bb tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:14.077320 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec2fcce2-b5db-44cf-8aaa-78eebad084bb tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:14.212156 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ec2fcce2-b5db-44cf-8aaa-78eebad084bb tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:14.220501 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ec2fcce2-b5db-44cf-8aaa-78eebad084bb tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1516 microversion: 2.1 time: 0.157166 Aug 04 17:52:14.221071 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3373/6778] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:14 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:15.242162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f74bdf03-7daf-486d-b098-a6cf59347428 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:15.242790 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f74bdf03-7daf-486d-b098-a6cf59347428 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:15.249935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f74bdf03-7daf-486d-b098-a6cf59347428 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:15.250473 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f74bdf03-7daf-486d-b098-a6cf59347428 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:15.250924 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f74bdf03-7daf-486d-b098-a6cf59347428 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:15.251639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f74bdf03-7daf-486d-b098-a6cf59347428 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:15.252106 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f74bdf03-7daf-486d-b098-a6cf59347428 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:15.252545 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f74bdf03-7daf-486d-b098-a6cf59347428 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:15.746444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f74bdf03-7daf-486d-b098-a6cf59347428 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:15.748650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:52:15.756179 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f74bdf03-7daf-486d-b098-a6cf59347428 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1516 microversion: 2.1 time: 0.517995 Aug 04 17:52:15.756698 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3406/6779] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:15 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1516 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:16.778283 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-68bfd702-8b62-4b8e-8d0e-47ce041503b1 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:16.778923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-68bfd702-8b62-4b8e-8d0e-47ce041503b1 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:16.786148 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68bfd702-8b62-4b8e-8d0e-47ce041503b1 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:16.786637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68bfd702-8b62-4b8e-8d0e-47ce041503b1 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:16.787090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68bfd702-8b62-4b8e-8d0e-47ce041503b1 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:16.787808 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68bfd702-8b62-4b8e-8d0e-47ce041503b1 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:16.788279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68bfd702-8b62-4b8e-8d0e-47ce041503b1 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:16.788720 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68bfd702-8b62-4b8e-8d0e-47ce041503b1 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:16.931402 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-68bfd702-8b62-4b8e-8d0e-47ce041503b1 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:16.938998 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-68bfd702-8b62-4b8e-8d0e-47ce041503b1 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1516 microversion: 2.1 time: 0.165450 Aug 04 17:52:16.939565 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3374/6780] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:16 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:17.961666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ec7bd355-4c54-4e4b-b1b1-5cb49a0183e9 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:17.962836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ec7bd355-4c54-4e4b-b1b1-5cb49a0183e9 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:17.966742 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=34 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:52:17.975307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec7bd355-4c54-4e4b-b1b1-5cb49a0183e9 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:17.975818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec7bd355-4c54-4e4b-b1b1-5cb49a0183e9 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:17.976272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec7bd355-4c54-4e4b-b1b1-5cb49a0183e9 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:17.977559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec7bd355-4c54-4e4b-b1b1-5cb49a0183e9 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:17.978061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec7bd355-4c54-4e4b-b1b1-5cb49a0183e9 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:17.978511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ec7bd355-4c54-4e4b-b1b1-5cb49a0183e9 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:18.171439 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-e3837261-a719-48f3-9d24-cfada9a9d8c0 req-1bd30b45-02a7-49a3-b67b-7c4834e6091e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fe5c6c1-68ae-4585-bc6a-dc2bc156276a", "name": "network-vif-unplugged", "status": "completed", "tag": "6599ab7e-6f1c-4f75-a9f0-bb0f206f8b06"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:52:18.177488 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=30 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:52:18.183622 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e3837261-a719-48f3-9d24-cfada9a9d8c0 req-1bd30b45-02a7-49a3-b67b-7c4834e6091e service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:18.184127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e3837261-a719-48f3-9d24-cfada9a9d8c0 req-1bd30b45-02a7-49a3-b67b-7c4834e6091e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:18.184582 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e3837261-a719-48f3-9d24-cfada9a9d8c0 req-1bd30b45-02a7-49a3-b67b-7c4834e6091e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:18.188920 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=86 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:52:18.201004 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-e3837261-a719-48f3-9d24-cfada9a9d8c0 req-1bd30b45-02a7-49a3-b67b-7c4834e6091e service nova] Creating event network-vif-unplugged:6599ab7e-6f1c-4f75-a9f0-bb0f206f8b06 for instance 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a on n-h2-851359-3 Aug 04 17:52:18.201819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ec7bd355-4c54-4e4b-b1b1-5cb49a0183e9 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:18.208842 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-e3837261-a719-48f3-9d24-cfada9a9d8c0 req-1bd30b45-02a7-49a3-b67b-7c4834e6091e service nova] Instance 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:52:18.210598 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ec7bd355-4c54-4e4b-b1b1-5cb49a0183e9 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1515 microversion: 2.1 time: 0.253863 Aug 04 17:52:18.212170 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3407/6781] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:17 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1515 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:18.237159 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-e3837261-a719-48f3-9d24-cfada9a9d8c0 req-1bd30b45-02a7-49a3-b67b-7c4834e6091e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070039 Aug 04 17:52:18.238303 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3375/6782] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:52:19.233805 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-73411b04-9f3a-4f49-a995-d661f9e43d8c tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:19.234360 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-73411b04-9f3a-4f49-a995-d661f9e43d8c tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:19.241155 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73411b04-9f3a-4f49-a995-d661f9e43d8c tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:19.241644 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73411b04-9f3a-4f49-a995-d661f9e43d8c tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:19.242122 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73411b04-9f3a-4f49-a995-d661f9e43d8c tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:19.242881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73411b04-9f3a-4f49-a995-d661f9e43d8c tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:19.243343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73411b04-9f3a-4f49-a995-d661f9e43d8c tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:19.243776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-73411b04-9f3a-4f49-a995-d661f9e43d8c tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:19.389179 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-73411b04-9f3a-4f49-a995-d661f9e43d8c tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:19.398399 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-73411b04-9f3a-4f49-a995-d661f9e43d8c tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1513 microversion: 2.1 time: 0.168957 Aug 04 17:52:19.399139 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3408/6783] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:19 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:20.267670 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-22b47704-4c6f-40ac-8058-e015b74397cd req-cbcc05df-77b9-468b-9292-8b48aaced061 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fe5c6c1-68ae-4585-bc6a-dc2bc156276a", "tag": "6599ab7e-6f1c-4f75-a9f0-bb0f206f8b06"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:52:20.277541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-22b47704-4c6f-40ac-8058-e015b74397cd req-cbcc05df-77b9-468b-9292-8b48aaced061 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:20.278055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-22b47704-4c6f-40ac-8058-e015b74397cd req-cbcc05df-77b9-468b-9292-8b48aaced061 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:20.278504 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-22b47704-4c6f-40ac-8058-e015b74397cd req-cbcc05df-77b9-468b-9292-8b48aaced061 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:20.290428 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-22b47704-4c6f-40ac-8058-e015b74397cd req-cbcc05df-77b9-468b-9292-8b48aaced061 service nova] Creating event network-changed:6599ab7e-6f1c-4f75-a9f0-bb0f206f8b06 for instance 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a on n-h2-851359-3 Aug 04 17:52:20.295779 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-22b47704-4c6f-40ac-8058-e015b74397cd req-cbcc05df-77b9-468b-9292-8b48aaced061 service nova] Instance 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:52:20.307063 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-22b47704-4c6f-40ac-8058-e015b74397cd req-cbcc05df-77b9-468b-9292-8b48aaced061 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044408 Aug 04 17:52:20.307675 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3376/6784] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:52:20.420936 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-190816ce-4b5c-4b90-a2d5-1867478cfbdf tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:20.421583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-190816ce-4b5c-4b90-a2d5-1867478cfbdf tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:20.428705 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-190816ce-4b5c-4b90-a2d5-1867478cfbdf tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:20.429215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-190816ce-4b5c-4b90-a2d5-1867478cfbdf tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:20.429674 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-190816ce-4b5c-4b90-a2d5-1867478cfbdf tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:20.430477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-190816ce-4b5c-4b90-a2d5-1867478cfbdf tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:20.430946 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-190816ce-4b5c-4b90-a2d5-1867478cfbdf tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:20.431384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-190816ce-4b5c-4b90-a2d5-1867478cfbdf tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:20.664591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-190816ce-4b5c-4b90-a2d5-1867478cfbdf tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:20.672399 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-190816ce-4b5c-4b90-a2d5-1867478cfbdf tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1513 microversion: 2.1 time: 0.255559 Aug 04 17:52:20.673002 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3409/6785] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:20 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1513 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:21.696092 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cee6e5e1-e8cc-4997-ab9e-98c95b71985b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:21.697518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cee6e5e1-e8cc-4997-ab9e-98c95b71985b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:21.704687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cee6e5e1-e8cc-4997-ab9e-98c95b71985b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:21.705196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cee6e5e1-e8cc-4997-ab9e-98c95b71985b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:21.705652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cee6e5e1-e8cc-4997-ab9e-98c95b71985b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:21.706425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cee6e5e1-e8cc-4997-ab9e-98c95b71985b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:21.706896 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cee6e5e1-e8cc-4997-ab9e-98c95b71985b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:21.707338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cee6e5e1-e8cc-4997-ab9e-98c95b71985b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:21.907511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cee6e5e1-e8cc-4997-ab9e-98c95b71985b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:21.915400 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cee6e5e1-e8cc-4997-ab9e-98c95b71985b tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1513 microversion: 2.1 time: 0.225114 Aug 04 17:52:21.916158 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3377/6786] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:21 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1513 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:22.936984 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bb4d5639-bec3-469e-9e96-fa84b83a59a0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:22.937532 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bb4d5639-bec3-469e-9e96-fa84b83a59a0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:22.944809 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bb4d5639-bec3-469e-9e96-fa84b83a59a0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:22.945307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bb4d5639-bec3-469e-9e96-fa84b83a59a0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:22.945762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bb4d5639-bec3-469e-9e96-fa84b83a59a0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:22.946510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bb4d5639-bec3-469e-9e96-fa84b83a59a0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:22.946986 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bb4d5639-bec3-469e-9e96-fa84b83a59a0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:22.947426 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bb4d5639-bec3-469e-9e96-fa84b83a59a0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:23.138884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bb4d5639-bec3-469e-9e96-fa84b83a59a0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:23.147648 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bb4d5639-bec3-469e-9e96-fa84b83a59a0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1510 microversion: 2.1 time: 0.214639 Aug 04 17:52:23.148236 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3410/6787] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:22 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1510 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:23.168685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6e360124-97d1-49fa-afbe-4de7d9e87ae0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:23.169233 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6e360124-97d1-49fa-afbe-4de7d9e87ae0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:23.176071 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e360124-97d1-49fa-afbe-4de7d9e87ae0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:23.176571 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e360124-97d1-49fa-afbe-4de7d9e87ae0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:23.177026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e360124-97d1-49fa-afbe-4de7d9e87ae0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:23.177734 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e360124-97d1-49fa-afbe-4de7d9e87ae0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:23.178236 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e360124-97d1-49fa-afbe-4de7d9e87ae0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:23.178677 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e360124-97d1-49fa-afbe-4de7d9e87ae0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:23.205045 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6e360124-97d1-49fa-afbe-4de7d9e87ae0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:52:23.256725 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.compute.api [None req-6e360124-97d1-49fa-afbe-4de7d9e87ae0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Found an unconfirmed migration during delete, id: 16, status: finished Aug 04 17:52:24.771386 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6e360124-97d1-49fa-afbe-4de7d9e87ae0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 204 len: 0 microversion: 2.1 time: 1.607057 Aug 04 17:52:24.772144 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3378/6788] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:52:23 2022] DELETE /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 0 bytes in 1609 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:52:24.780793 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1f3f7c71-8d68-4ce8-8f99-bdd4c64a6d8d tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:24.781432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1f3f7c71-8d68-4ce8-8f99-bdd4c64a6d8d tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:24.788549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f3f7c71-8d68-4ce8-8f99-bdd4c64a6d8d tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:24.789638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f3f7c71-8d68-4ce8-8f99-bdd4c64a6d8d tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:24.790143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f3f7c71-8d68-4ce8-8f99-bdd4c64a6d8d tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:24.790865 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f3f7c71-8d68-4ce8-8f99-bdd4c64a6d8d tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:24.791344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f3f7c71-8d68-4ce8-8f99-bdd4c64a6d8d tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:24.791784 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f3f7c71-8d68-4ce8-8f99-bdd4c64a6d8d tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:24.934138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1f3f7c71-8d68-4ce8-8f99-bdd4c64a6d8d tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:24.942098 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1f3f7c71-8d68-4ce8-8f99-bdd4c64a6d8d tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1502 microversion: 2.1 time: 0.165235 Aug 04 17:52:24.942682 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3411/6789] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:24 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1502 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:25.963787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6a5b179e-895c-4dc9-9ad1-cfb3e1f0b08e tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:25.964634 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6a5b179e-895c-4dc9-9ad1-cfb3e1f0b08e tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:25.972273 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a5b179e-895c-4dc9-9ad1-cfb3e1f0b08e tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:25.972787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a5b179e-895c-4dc9-9ad1-cfb3e1f0b08e tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:25.973249 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a5b179e-895c-4dc9-9ad1-cfb3e1f0b08e tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:25.973995 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a5b179e-895c-4dc9-9ad1-cfb3e1f0b08e tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:25.974489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a5b179e-895c-4dc9-9ad1-cfb3e1f0b08e tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:25.974937 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a5b179e-895c-4dc9-9ad1-cfb3e1f0b08e tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:26.149908 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6a5b179e-895c-4dc9-9ad1-cfb3e1f0b08e tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b9b290d5c04f6f923b37b015e3050d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab36c0c6bf5d465f8e1d0a7299e251ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:26.157713 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6a5b179e-895c-4dc9-9ad1-cfb3e1f0b08e tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 200 len: 1502 microversion: 2.1 time: 0.198319 Aug 04 17:52:26.158334 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3379/6790] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:25 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 1502 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:26.426761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-9a409a9b-fcd1-42ad-919d-688e6ca05955 req-942796f5-5a5d-46db-a206-cca81df5d7a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fe5c6c1-68ae-4585-bc6a-dc2bc156276a", "name": "network-vif-plugged", "status": "completed", "tag": "6599ab7e-6f1c-4f75-a9f0-bb0f206f8b06"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:52:26.441287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9a409a9b-fcd1-42ad-919d-688e6ca05955 req-942796f5-5a5d-46db-a206-cca81df5d7a1 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:26.442155 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9a409a9b-fcd1-42ad-919d-688e6ca05955 req-942796f5-5a5d-46db-a206-cca81df5d7a1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:26.442747 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9a409a9b-fcd1-42ad-919d-688e6ca05955 req-942796f5-5a5d-46db-a206-cca81df5d7a1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:26.455039 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-9a409a9b-fcd1-42ad-919d-688e6ca05955 req-942796f5-5a5d-46db-a206-cca81df5d7a1 service nova] Creating event network-vif-plugged:6599ab7e-6f1c-4f75-a9f0-bb0f206f8b06 for instance 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a on n-h2-851359-3 Aug 04 17:52:26.460663 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-9a409a9b-fcd1-42ad-919d-688e6ca05955 req-942796f5-5a5d-46db-a206-cca81df5d7a1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038181 Aug 04 17:52:26.462608 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3412/6791] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:52:26.813693 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-e2e76e02-2dce-448b-927a-646960faa31e req-6ad603eb-87ff-45a2-aac1-ffbbf07782a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fe5c6c1-68ae-4585-bc6a-dc2bc156276a", "name": "network-vif-deleted", "tag": "6599ab7e-6f1c-4f75-a9f0-bb0f206f8b06"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:52:26.824413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e2e76e02-2dce-448b-927a-646960faa31e req-6ad603eb-87ff-45a2-aac1-ffbbf07782a7 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:26.824920 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e2e76e02-2dce-448b-927a-646960faa31e req-6ad603eb-87ff-45a2-aac1-ffbbf07782a7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:26.825368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e2e76e02-2dce-448b-927a-646960faa31e req-6ad603eb-87ff-45a2-aac1-ffbbf07782a7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:26.838176 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-e2e76e02-2dce-448b-927a-646960faa31e req-6ad603eb-87ff-45a2-aac1-ffbbf07782a7 service nova] Creating event network-vif-deleted:6599ab7e-6f1c-4f75-a9f0-bb0f206f8b06 for instance 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a on n-h2-851359-3 Aug 04 17:52:26.845934 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-e2e76e02-2dce-448b-927a-646960faa31e req-6ad603eb-87ff-45a2-aac1-ffbbf07782a7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035188 Aug 04 17:52:26.846799 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3380/6792] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:52:27.181360 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8472d367-d6e2-412a-a4a2-16412972be4a tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:27.182121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8472d367-d6e2-412a-a4a2-16412972be4a tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:27.188614 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8472d367-d6e2-412a-a4a2-16412972be4a tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:27.189103 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8472d367-d6e2-412a-a4a2-16412972be4a tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:27.189553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8472d367-d6e2-412a-a4a2-16412972be4a tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:27.190297 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8472d367-d6e2-412a-a4a2-16412972be4a tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:27.190759 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8472d367-d6e2-412a-a4a2-16412972be4a tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:27.191189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8472d367-d6e2-412a-a4a2-16412972be4a tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:27.206099 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-8472d367-d6e2-412a-a4a2-16412972be4a tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] HTTP exception thrown: Instance 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a could not be found. Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8472d367-d6e2-412a-a4a2-16412972be4a tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Request method failure captured: Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a HTTP/1.1 Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7AcpgWsaXKVtON1hwE8e8FBA7QjOOajSZ5FUZ7KIV9hiAx7t0lFTKYdU0VkRTfEvclaXolDHxw48jpeAavlqeA4o2hKTLoVd-Snm3viPl2v75uCIhzSCEtMxT2SBoLWIBuZH9MNmREJBbzES_3DiU469z-gAQLyDyE2DCy1UWKXfXe0 Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: ab36c0c6bf5d465f8e1d0a7299e251ab Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-DeleteServersTestJSON-2064466220 Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ab36c0c6bf5d465f8e1d0a7299e251ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ab36c0c6bf5d465f8e1d0a7299e251ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ab36c0c6bf5d465f8e1d0a7299e251ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ab36c0c6bf5d465f8e1d0a7299e251ab"}]}] Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-DeleteServersTestJSON-2064466220 Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: ab36c0c6bf5d465f8e1d0a7299e251ab Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-DeleteServersTestJSON-2064466220 Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-DeleteServersTestJSON-2064466220-project Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 69b9b290d5c04f6f923b37b015e3050d Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-DeleteServersTestJSON-2064466220-project Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a could not be found. Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '0fe5c6c1-68ae-4585-bc6a-dc2bc156276a'} Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a could not be found. Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a could not be found. Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:52:27.207804 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:52:27.211844 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:52:27.211844 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:52:27.211844 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:52:27.211844 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:52:27.211844 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:52:27.211844 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a could not be found. Aug 04 17:52:27.211844 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:52:27.211844 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8472d367-d6e2-412a-a4a2-16412972be4a tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Returning 404 to user: Instance 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:52:27.211844 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8472d367-d6e2-412a-a4a2-16412972be4a tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 404 len: 111 microversion: 2.1 time: 0.032876 Aug 04 17:52:27.211844 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3413/6793] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:27 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:52:27.223558 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7ae6e680-b636-46a1-bd6b-5554f4a1daa6 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:27.224161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7ae6e680-b636-46a1-bd6b-5554f4a1daa6 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:27.231471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ae6e680-b636-46a1-bd6b-5554f4a1daa6 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:27.231970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ae6e680-b636-46a1-bd6b-5554f4a1daa6 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:27.232418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ae6e680-b636-46a1-bd6b-5554f4a1daa6 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:27.233133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ae6e680-b636-46a1-bd6b-5554f4a1daa6 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:27.233601 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ae6e680-b636-46a1-bd6b-5554f4a1daa6 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:27.234061 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ae6e680-b636-46a1-bd6b-5554f4a1daa6 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:27.249644 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-7ae6e680-b636-46a1-bd6b-5554f4a1daa6 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] HTTP exception thrown: Instance 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a could not be found. Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7ae6e680-b636-46a1-bd6b-5554f4a1daa6 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Request method failure captured: Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a HTTP/1.1 Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AcpgWsaXKVtON1hwE8e8FBA7QjOOajSZ5FUZ7KIV9hiAx7t0lFTKYdU0VkRTfEvclaXolDHxw48jpeAavlqeA4o2hKTLoVd-Snm3viPl2v75uCIhzSCEtMxT2SBoLWIBuZH9MNmREJBbzES_3DiU469z-gAQLyDyE2DCy1UWKXfXe0 Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: ab36c0c6bf5d465f8e1d0a7299e251ab Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-DeleteServersTestJSON-2064466220 Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ab36c0c6bf5d465f8e1d0a7299e251ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ab36c0c6bf5d465f8e1d0a7299e251ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ab36c0c6bf5d465f8e1d0a7299e251ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ab36c0c6bf5d465f8e1d0a7299e251ab"}]}] Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-DeleteServersTestJSON-2064466220 Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: ab36c0c6bf5d465f8e1d0a7299e251ab Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-DeleteServersTestJSON-2064466220 Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-DeleteServersTestJSON-2064466220-project Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 69b9b290d5c04f6f923b37b015e3050d Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-DeleteServersTestJSON-2064466220-project Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a could not be found. Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '0fe5c6c1-68ae-4585-bc6a-dc2bc156276a'} Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a could not be found. Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:52:27.251372 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:52:27.254954 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a could not be found. Aug 04 17:52:27.254954 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:52:27.254954 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:52:27.254954 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:52:27.254954 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:52:27.254954 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:52:27.254954 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:52:27.254954 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:52:27.254954 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:52:27.254954 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a could not be found. Aug 04 17:52:27.254954 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:52:27.254954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7ae6e680-b636-46a1-bd6b-5554f4a1daa6 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Returning 404 to user: Instance 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:52:27.254954 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7ae6e680-b636-46a1-bd6b-5554f4a1daa6 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 404 len: 111 microversion: 2.1 time: 0.033574 Aug 04 17:52:27.254954 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3381/6794] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:52:27 2022] DELETE /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:52:27.262123 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-817d0e81-b255-4704-93d6-a91fa6cd01b0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:27.262757 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-817d0e81-b255-4704-93d6-a91fa6cd01b0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] [instance: 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:27.269532 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-817d0e81-b255-4704-93d6-a91fa6cd01b0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:27.270051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-817d0e81-b255-4704-93d6-a91fa6cd01b0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:27.270505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-817d0e81-b255-4704-93d6-a91fa6cd01b0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:27.271237 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-817d0e81-b255-4704-93d6-a91fa6cd01b0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:27.271714 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-817d0e81-b255-4704-93d6-a91fa6cd01b0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:27.272158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-817d0e81-b255-4704-93d6-a91fa6cd01b0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:27.286516 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-817d0e81-b255-4704-93d6-a91fa6cd01b0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] HTTP exception thrown: Instance 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a could not be found. Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-817d0e81-b255-4704-93d6-a91fa6cd01b0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Request method failure captured: Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a HTTP/1.1 Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7AcpgWsaXKVtON1hwE8e8FBA7QjOOajSZ5FUZ7KIV9hiAx7t0lFTKYdU0VkRTfEvclaXolDHxw48jpeAavlqeA4o2hKTLoVd-Snm3viPl2v75uCIhzSCEtMxT2SBoLWIBuZH9MNmREJBbzES_3DiU469z-gAQLyDyE2DCy1UWKXfXe0 Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: ab36c0c6bf5d465f8e1d0a7299e251ab Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-DeleteServersTestJSON-2064466220 Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ab36c0c6bf5d465f8e1d0a7299e251ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ab36c0c6bf5d465f8e1d0a7299e251ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ab36c0c6bf5d465f8e1d0a7299e251ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ab36c0c6bf5d465f8e1d0a7299e251ab"}]}] Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-DeleteServersTestJSON-2064466220 Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: ab36c0c6bf5d465f8e1d0a7299e251ab Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-DeleteServersTestJSON-2064466220 Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-DeleteServersTestJSON-2064466220-project Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 69b9b290d5c04f6f923b37b015e3050d Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-DeleteServersTestJSON-2064466220-project Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a could not be found. Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '0fe5c6c1-68ae-4585-bc6a-dc2bc156276a'} Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a could not be found. Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a could not be found. Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:52:27.288076 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:52:27.291737 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:52:27.291737 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:52:27.291737 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:52:27.291737 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:52:27.291737 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:52:27.291737 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a could not be found. Aug 04 17:52:27.291737 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:52:27.291737 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-817d0e81-b255-4704-93d6-a91fa6cd01b0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] Returning 404 to user: Instance 0fe5c6c1-68ae-4585-bc6a-dc2bc156276a could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:52:27.291737 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-817d0e81-b255-4704-93d6-a91fa6cd01b0 tempest-DeleteServersTestJSON-2064466220 tempest-DeleteServersTestJSON-2064466220-project] 10.222.0.93 "GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a" status: 404 len: 111 microversion: 2.1 time: 0.032436 Aug 04 17:52:27.291737 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3414/6795] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:27 2022] GET /compute/v2.1/servers/0fe5c6c1-68ae-4585-bc6a-dc2bc156276a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:52:36.424589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f12b5303-4a40-458f-83e1-184226721afc tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1189950745", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "d87a8e10-3bf3-41aa-9cf7-d4014f2e5c01"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:52:36.483643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-f12b5303-4a40-458f-83e1-184226721afc tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] validate_networks() for [('d87a8e10-3bf3-41aa-9cf7-d4014f2e5c01', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:52:36.932696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f12b5303-4a40-458f-83e1-184226721afc tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:52:36.933218 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f12b5303-4a40-458f-83e1-184226721afc tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:52:36.933783 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f12b5303-4a40-458f-83e1-184226721afc tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:52:36.934541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f12b5303-4a40-458f-83e1-184226721afc tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:52:36.935044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f12b5303-4a40-458f-83e1-184226721afc tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:52:36.945698 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f12b5303-4a40-458f-83e1-184226721afc tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:36.946237 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f12b5303-4a40-458f-83e1-184226721afc tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:36.946697 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f12b5303-4a40-458f-83e1-184226721afc tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:36.947449 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f12b5303-4a40-458f-83e1-184226721afc tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:36.947927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f12b5303-4a40-458f-83e1-184226721afc tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:36.948376 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f12b5303-4a40-458f-83e1-184226721afc tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:36.966640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-f12b5303-4a40-458f-83e1-184226721afc tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Getting quotas for project 479c5566b5a24b47bd9b3ff2de850c3f. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:52:36.973407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-f12b5303-4a40-458f-83e1-184226721afc tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Getting quotas for user 0043a0e11d59421c82b927e823764bda and project 479c5566b5a24b47bd9b3ff2de850c3f. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:52:36.986739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f12b5303-4a40-458f-83e1-184226721afc tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:52:36.989047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f12b5303-4a40-458f-83e1-184226721afc tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:52:37.040764 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f12b5303-4a40-458f-83e1-184226721afc tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.749069 Aug 04 17:52:37.041419 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3382/6796] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:52:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:52:37.052447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5f0ca48f-9e6d-4f80-a98e-1c6444ab4f6e tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:37.053074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5f0ca48f-9e6d-4f80-a98e-1c6444ab4f6e tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:37.209277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5f0ca48f-9e6d-4f80-a98e-1c6444ab4f6e tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:37.218239 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5f0ca48f-9e6d-4f80-a98e-1c6444ab4f6e tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1218 microversion: 2.1 time: 0.169708 Aug 04 17:52:37.218817 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3415/6797] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:37 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1218 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:38.240066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-17ec3fc7-1a60-4196-80c2-dbb562c2d71f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:38.240713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-17ec3fc7-1a60-4196-80c2-dbb562c2d71f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:38.247438 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17ec3fc7-1a60-4196-80c2-dbb562c2d71f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:38.248210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17ec3fc7-1a60-4196-80c2-dbb562c2d71f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:38.248820 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17ec3fc7-1a60-4196-80c2-dbb562c2d71f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:38.249708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17ec3fc7-1a60-4196-80c2-dbb562c2d71f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:38.250379 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17ec3fc7-1a60-4196-80c2-dbb562c2d71f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:38.250825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17ec3fc7-1a60-4196-80c2-dbb562c2d71f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:38.333420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-17ec3fc7-1a60-4196-80c2-dbb562c2d71f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:38.341879 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-17ec3fc7-1a60-4196-80c2-dbb562c2d71f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1276 microversion: 2.1 time: 0.107002 Aug 04 17:52:38.342961 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3383/6798] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:38 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1276 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:39.363892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e6a9dac8-8914-44cf-862d-63ce5d38637e tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:39.364525 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e6a9dac8-8914-44cf-862d-63ce5d38637e tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:39.366896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=37 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:52:39.380739 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e6a9dac8-8914-44cf-862d-63ce5d38637e tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:39.381255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e6a9dac8-8914-44cf-862d-63ce5d38637e tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:39.381708 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e6a9dac8-8914-44cf-862d-63ce5d38637e tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:39.382568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e6a9dac8-8914-44cf-862d-63ce5d38637e tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:39.383221 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e6a9dac8-8914-44cf-862d-63ce5d38637e tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:39.383662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e6a9dac8-8914-44cf-862d-63ce5d38637e tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:39.621091 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e6a9dac8-8914-44cf-862d-63ce5d38637e tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:39.629669 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e6a9dac8-8914-44cf-862d-63ce5d38637e tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1318 microversion: 2.1 time: 0.269651 Aug 04 17:52:39.630638 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3416/6799] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:39 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:39.875167 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-54d91b55-152d-420f-9528-c0c2518a06af req-f0775473-6bb9-4c88-9f74-e1c5fa5cd1d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b217f6ed-2122-45de-b6f2-79ce04451536", "tag": "f6825872-e1c7-4cae-867a-c8c4789990b3"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:52:39.893660 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-54d91b55-152d-420f-9528-c0c2518a06af req-f0775473-6bb9-4c88-9f74-e1c5fa5cd1d5 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:39.894771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-54d91b55-152d-420f-9528-c0c2518a06af req-f0775473-6bb9-4c88-9f74-e1c5fa5cd1d5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:39.895912 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-54d91b55-152d-420f-9528-c0c2518a06af req-f0775473-6bb9-4c88-9f74-e1c5fa5cd1d5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:39.924524 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-54d91b55-152d-420f-9528-c0c2518a06af req-f0775473-6bb9-4c88-9f74-e1c5fa5cd1d5 service nova] Creating event network-changed:f6825872-e1c7-4cae-867a-c8c4789990b3 for instance b217f6ed-2122-45de-b6f2-79ce04451536 on n-h1-851359-3 Aug 04 17:52:39.933738 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-54d91b55-152d-420f-9528-c0c2518a06af req-f0775473-6bb9-4c88-9f74-e1c5fa5cd1d5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065351 Aug 04 17:52:39.935453 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3384/6800] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:52:40.664379 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-409f8410-cce2-4f2e-a1ff-e9729f6b2743 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:40.664918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-409f8410-cce2-4f2e-a1ff-e9729f6b2743 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:40.672582 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-409f8410-cce2-4f2e-a1ff-e9729f6b2743 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:40.673079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-409f8410-cce2-4f2e-a1ff-e9729f6b2743 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:40.673533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-409f8410-cce2-4f2e-a1ff-e9729f6b2743 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:40.674274 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-409f8410-cce2-4f2e-a1ff-e9729f6b2743 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:40.674740 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-409f8410-cce2-4f2e-a1ff-e9729f6b2743 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:40.675174 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-409f8410-cce2-4f2e-a1ff-e9729f6b2743 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:40.812781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-409f8410-cce2-4f2e-a1ff-e9729f6b2743 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:40.821204 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-409f8410-cce2-4f2e-a1ff-e9729f6b2743 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1318 microversion: 2.1 time: 0.161397 Aug 04 17:52:40.821813 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3417/6801] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:40 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:41.846025 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e4a4fc53-7f70-47be-bc0e-ca20b0d5e1e2 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:41.846868 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e4a4fc53-7f70-47be-bc0e-ca20b0d5e1e2 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:41.853328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4a4fc53-7f70-47be-bc0e-ca20b0d5e1e2 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:41.854228 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4a4fc53-7f70-47be-bc0e-ca20b0d5e1e2 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:41.854798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4a4fc53-7f70-47be-bc0e-ca20b0d5e1e2 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:41.855557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4a4fc53-7f70-47be-bc0e-ca20b0d5e1e2 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:41.856111 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4a4fc53-7f70-47be-bc0e-ca20b0d5e1e2 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:41.856659 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4a4fc53-7f70-47be-bc0e-ca20b0d5e1e2 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:42.082037 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e4a4fc53-7f70-47be-bc0e-ca20b0d5e1e2 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:42.090012 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e4a4fc53-7f70-47be-bc0e-ca20b0d5e1e2 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1318 microversion: 2.1 time: 0.250227 Aug 04 17:52:42.090447 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3385/6802] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:41 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:43.111559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1da80115-22f8-4eff-9aa9-7c0bc32d1e9a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:43.112216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1da80115-22f8-4eff-9aa9-7c0bc32d1e9a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:43.119384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1da80115-22f8-4eff-9aa9-7c0bc32d1e9a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:43.119884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1da80115-22f8-4eff-9aa9-7c0bc32d1e9a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:43.120356 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1da80115-22f8-4eff-9aa9-7c0bc32d1e9a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:43.121072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1da80115-22f8-4eff-9aa9-7c0bc32d1e9a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:43.121540 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1da80115-22f8-4eff-9aa9-7c0bc32d1e9a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:43.121995 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1da80115-22f8-4eff-9aa9-7c0bc32d1e9a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:43.141708 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:52:43.142006 n-d-851359-3 devstack@n-api.service[131043]: Thu Aug 4 17:52:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 (ip 10.222.0.93) !!! Aug 04 17:52:43.260112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1da80115-22f8-4eff-9aa9-7c0bc32d1e9a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:43.267912 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1da80115-22f8-4eff-9aa9-7c0bc32d1e9a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1318 microversion: 2.1 time: 0.160675 Aug 04 17:52:43.268504 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3418/6803] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:43 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:44.289419 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3045eaea-fc3c-4946-9220-f3ccf4f20d66 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:44.290092 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3045eaea-fc3c-4946-9220-f3ccf4f20d66 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:44.297210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3045eaea-fc3c-4946-9220-f3ccf4f20d66 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:44.297721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3045eaea-fc3c-4946-9220-f3ccf4f20d66 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:44.298204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3045eaea-fc3c-4946-9220-f3ccf4f20d66 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:44.298933 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3045eaea-fc3c-4946-9220-f3ccf4f20d66 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:44.299402 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3045eaea-fc3c-4946-9220-f3ccf4f20d66 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:44.299863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3045eaea-fc3c-4946-9220-f3ccf4f20d66 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:44.439722 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3045eaea-fc3c-4946-9220-f3ccf4f20d66 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:44.447382 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3045eaea-fc3c-4946-9220-f3ccf4f20d66 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1318 microversion: 2.1 time: 0.162549 Aug 04 17:52:44.447961 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3386/6804] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:44 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:45.468236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-82c84282-0896-4118-9c3a-974a145baff0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:45.468905 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-82c84282-0896-4118-9c3a-974a145baff0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:45.475906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82c84282-0896-4118-9c3a-974a145baff0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:45.476436 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82c84282-0896-4118-9c3a-974a145baff0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:45.476889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82c84282-0896-4118-9c3a-974a145baff0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:45.477612 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82c84282-0896-4118-9c3a-974a145baff0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:45.478117 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82c84282-0896-4118-9c3a-974a145baff0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:45.478574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82c84282-0896-4118-9c3a-974a145baff0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:45.619741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-82c84282-0896-4118-9c3a-974a145baff0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:45.627227 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-82c84282-0896-4118-9c3a-974a145baff0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1318 microversion: 2.1 time: 0.163297 Aug 04 17:52:45.627804 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3419/6805] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:45 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:46.214847 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-25a0c5a7-e34d-4d2f-8db1-df7e7b4f71ab req-70c2d6a5-d7b0-4525-b1ef-ee44d25a209c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b217f6ed-2122-45de-b6f2-79ce04451536", "name": "network-vif-plugged", "status": "completed", "tag": "f6825872-e1c7-4cae-867a-c8c4789990b3"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:52:46.226593 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-25a0c5a7-e34d-4d2f-8db1-df7e7b4f71ab req-70c2d6a5-d7b0-4525-b1ef-ee44d25a209c service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:46.227702 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-25a0c5a7-e34d-4d2f-8db1-df7e7b4f71ab req-70c2d6a5-d7b0-4525-b1ef-ee44d25a209c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:46.228182 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-25a0c5a7-e34d-4d2f-8db1-df7e7b4f71ab req-70c2d6a5-d7b0-4525-b1ef-ee44d25a209c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:46.239680 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-25a0c5a7-e34d-4d2f-8db1-df7e7b4f71ab req-70c2d6a5-d7b0-4525-b1ef-ee44d25a209c service nova] Creating event network-vif-plugged:f6825872-e1c7-4cae-867a-c8c4789990b3 for instance b217f6ed-2122-45de-b6f2-79ce04451536 on n-h1-851359-3 Aug 04 17:52:46.245567 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-25a0c5a7-e34d-4d2f-8db1-df7e7b4f71ab req-70c2d6a5-d7b0-4525-b1ef-ee44d25a209c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035191 Aug 04 17:52:46.246185 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3387/6806] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:52:46.648364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1ff3fc97-a62b-463c-bb45-3bf644647e4b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:46.648993 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1ff3fc97-a62b-463c-bb45-3bf644647e4b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:46.656006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ff3fc97-a62b-463c-bb45-3bf644647e4b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:46.656526 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ff3fc97-a62b-463c-bb45-3bf644647e4b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:46.656976 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ff3fc97-a62b-463c-bb45-3bf644647e4b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:46.657685 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ff3fc97-a62b-463c-bb45-3bf644647e4b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:46.658199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ff3fc97-a62b-463c-bb45-3bf644647e4b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:46.658641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1ff3fc97-a62b-463c-bb45-3bf644647e4b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:46.802045 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1ff3fc97-a62b-463c-bb45-3bf644647e4b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:46.810300 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1ff3fc97-a62b-463c-bb45-3bf644647e4b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1318 microversion: 2.1 time: 0.165854 Aug 04 17:52:46.810872 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3420/6807] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:46 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:47.827821 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:52:47.828614 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:52:47.833554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-90dfc93b-40ad-4585-9555-c07c5fc89ec7 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:47.834292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-90dfc93b-40ad-4585-9555-c07c5fc89ec7 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:47.841302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90dfc93b-40ad-4585-9555-c07c5fc89ec7 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:47.841793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90dfc93b-40ad-4585-9555-c07c5fc89ec7 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:47.842531 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90dfc93b-40ad-4585-9555-c07c5fc89ec7 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:47.843230 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90dfc93b-40ad-4585-9555-c07c5fc89ec7 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:47.843696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90dfc93b-40ad-4585-9555-c07c5fc89ec7 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:47.844131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90dfc93b-40ad-4585-9555-c07c5fc89ec7 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:47.974495 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-90dfc93b-40ad-4585-9555-c07c5fc89ec7 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:47.982747 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-90dfc93b-40ad-4585-9555-c07c5fc89ec7 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1506 microversion: 2.1 time: 0.155877 Aug 04 17:52:47.983319 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3388/6808] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:47 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:48.003145 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4c5bbcdd-65e6-44da-af5a-5435c35fbb4f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:48.003779 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4c5bbcdd-65e6-44da-af5a-5435c35fbb4f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:48.006038 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:52:48.007696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=30 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:52:48.013908 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c5bbcdd-65e6-44da-af5a-5435c35fbb4f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:48.014432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c5bbcdd-65e6-44da-af5a-5435c35fbb4f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:48.014888 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c5bbcdd-65e6-44da-af5a-5435c35fbb4f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:48.015601 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c5bbcdd-65e6-44da-af5a-5435c35fbb4f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:48.016072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c5bbcdd-65e6-44da-af5a-5435c35fbb4f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:48.016513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c5bbcdd-65e6-44da-af5a-5435c35fbb4f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:48.161225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4c5bbcdd-65e6-44da-af5a-5435c35fbb4f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:48.169612 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4c5bbcdd-65e6-44da-af5a-5435c35fbb4f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1506 microversion: 2.1 time: 0.170359 Aug 04 17:52:48.170222 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3421/6809] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:47 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:48.189661 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-09c58f91-96ba-4422-af2c-ec77ef3a61c5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:52:48.192100 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-09c58f91-96ba-4422-af2c-ec77ef3a61c5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:48.195120 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:52:48.199290 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09c58f91-96ba-4422-af2c-ec77ef3a61c5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:48.199785 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09c58f91-96ba-4422-af2c-ec77ef3a61c5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:48.200234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09c58f91-96ba-4422-af2c-ec77ef3a61c5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:48.200945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09c58f91-96ba-4422-af2c-ec77ef3a61c5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:48.201409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09c58f91-96ba-4422-af2c-ec77ef3a61c5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:48.202042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09c58f91-96ba-4422-af2c-ec77ef3a61c5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:48.205658 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:52:48.274181 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-09c58f91-96ba-4422-af2c-ec77ef3a61c5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "PUT /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1078 microversion: 2.1 time: 0.088279 Aug 04 17:52:48.274858 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3389/6810] 10.222.0.93 () {60 vars in 1256 bytes} [Thu Aug 4 17:52:48 2022] PUT /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1078 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:48.291573 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-57454d60-a141-4412-bf88-afef36754d97 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:48.292210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-57454d60-a141-4412-bf88-afef36754d97 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:48.298314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57454d60-a141-4412-bf88-afef36754d97 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:48.298811 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57454d60-a141-4412-bf88-afef36754d97 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:48.299264 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57454d60-a141-4412-bf88-afef36754d97 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:48.299997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57454d60-a141-4412-bf88-afef36754d97 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:48.300468 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57454d60-a141-4412-bf88-afef36754d97 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:48.300911 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57454d60-a141-4412-bf88-afef36754d97 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:48.436302 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-57454d60-a141-4412-bf88-afef36754d97 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:48.443933 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-57454d60-a141-4412-bf88-afef36754d97 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1504 microversion: 2.1 time: 0.156341 Aug 04 17:52:48.444510 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3422/6811] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:48 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:48.464899 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d5edc39a-9fe9-4554-9040-c9b2efaacc47 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:48.465553 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d5edc39a-9fe9-4554-9040-c9b2efaacc47 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:48.471897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5edc39a-9fe9-4554-9040-c9b2efaacc47 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:48.472389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5edc39a-9fe9-4554-9040-c9b2efaacc47 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:48.472838 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5edc39a-9fe9-4554-9040-c9b2efaacc47 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:48.473540 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5edc39a-9fe9-4554-9040-c9b2efaacc47 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:48.474026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5edc39a-9fe9-4554-9040-c9b2efaacc47 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:48.474464 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5edc39a-9fe9-4554-9040-c9b2efaacc47 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:48.608013 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d5edc39a-9fe9-4554-9040-c9b2efaacc47 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:48.615699 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d5edc39a-9fe9-4554-9040-c9b2efaacc47 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1504 microversion: 2.1 time: 0.155576 Aug 04 17:52:48.616268 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3390/6812] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:48 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:48.636638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5ea4b9fa-4b0f-47ba-810b-49147f9b58d8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:52:48.639036 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5ea4b9fa-4b0f-47ba-810b-49147f9b58d8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:48.645078 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ea4b9fa-4b0f-47ba-810b-49147f9b58d8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:48.645587 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ea4b9fa-4b0f-47ba-810b-49147f9b58d8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:48.646067 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ea4b9fa-4b0f-47ba-810b-49147f9b58d8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:48.646786 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ea4b9fa-4b0f-47ba-810b-49147f9b58d8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:48.647258 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ea4b9fa-4b0f-47ba-810b-49147f9b58d8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:48.647700 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5ea4b9fa-4b0f-47ba-810b-49147f9b58d8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:48.676568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5ea4b9fa-4b0f-47ba-810b-49147f9b58d8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:48.683199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5ea4b9fa-4b0f-47ba-810b-49147f9b58d8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Old instance type m1.heat2, new instance type m1.heat {{(pid=131043) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 17:52:48.689687 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5ea4b9fa-4b0f-47ba-810b-49147f9b58d8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:52:48.690148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5ea4b9fa-4b0f-47ba-810b-49147f9b58d8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:52:48.690637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5ea4b9fa-4b0f-47ba-810b-49147f9b58d8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:52:48.691062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5ea4b9fa-4b0f-47ba-810b-49147f9b58d8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:52:48.691486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-5ea4b9fa-4b0f-47ba-810b-49147f9b58d8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:52:48.756658 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5ea4b9fa-4b0f-47ba-810b-49147f9b58d8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "POST /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536/action" status: 202 len: 0 microversion: 2.1 time: 0.124681 Aug 04 17:52:48.757897 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3423/6813] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:52:48 2022] POST /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:52:48.766124 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e898a06b-88b5-4b26-8f93-5c7dbc6d134c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:48.766773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e898a06b-88b5-4b26-8f93-5c7dbc6d134c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:48.772967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e898a06b-88b5-4b26-8f93-5c7dbc6d134c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:48.773465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e898a06b-88b5-4b26-8f93-5c7dbc6d134c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:48.773929 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e898a06b-88b5-4b26-8f93-5c7dbc6d134c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:48.774691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e898a06b-88b5-4b26-8f93-5c7dbc6d134c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:48.775177 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e898a06b-88b5-4b26-8f93-5c7dbc6d134c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:48.775619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e898a06b-88b5-4b26-8f93-5c7dbc6d134c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:48.941038 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e898a06b-88b5-4b26-8f93-5c7dbc6d134c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:48.950617 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e898a06b-88b5-4b26-8f93-5c7dbc6d134c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1515 microversion: 2.1 time: 0.188390 Aug 04 17:52:48.951222 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3391/6814] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:48 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1515 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:49.973626 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-74ca856e-fd36-4422-85ed-70298a7a54be tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:49.974181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-74ca856e-fd36-4422-85ed-70298a7a54be tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:49.981058 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-74ca856e-fd36-4422-85ed-70298a7a54be tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:49.981565 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-74ca856e-fd36-4422-85ed-70298a7a54be tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:49.982039 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-74ca856e-fd36-4422-85ed-70298a7a54be tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:49.982759 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-74ca856e-fd36-4422-85ed-70298a7a54be tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:49.983225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-74ca856e-fd36-4422-85ed-70298a7a54be tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:49.983662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-74ca856e-fd36-4422-85ed-70298a7a54be tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:50.122463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-74ca856e-fd36-4422-85ed-70298a7a54be tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:50.130195 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-74ca856e-fd36-4422-85ed-70298a7a54be tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1515 microversion: 2.1 time: 0.162840 Aug 04 17:52:50.130807 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3424/6815] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:49 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:51.151269 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3d6254e1-286b-43c6-b303-9b86feebe14c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:51.151920 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3d6254e1-286b-43c6-b303-9b86feebe14c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:51.158897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d6254e1-286b-43c6-b303-9b86feebe14c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:51.159396 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d6254e1-286b-43c6-b303-9b86feebe14c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:51.159849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d6254e1-286b-43c6-b303-9b86feebe14c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:51.160571 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d6254e1-286b-43c6-b303-9b86feebe14c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:51.161043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d6254e1-286b-43c6-b303-9b86feebe14c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:51.161487 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d6254e1-286b-43c6-b303-9b86feebe14c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:51.295874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3d6254e1-286b-43c6-b303-9b86feebe14c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:51.303437 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3d6254e1-286b-43c6-b303-9b86feebe14c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1520 microversion: 2.1 time: 0.156224 Aug 04 17:52:51.304552 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3392/6816] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:51 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:52:52.325456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-51fe7271-19d1-4004-9feb-384166d913aa tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:52.326108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-51fe7271-19d1-4004-9feb-384166d913aa tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:52.333157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-51fe7271-19d1-4004-9feb-384166d913aa tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:52.333659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-51fe7271-19d1-4004-9feb-384166d913aa tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:52.334154 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-51fe7271-19d1-4004-9feb-384166d913aa tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:52.334871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-51fe7271-19d1-4004-9feb-384166d913aa tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:52.335989 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-51fe7271-19d1-4004-9feb-384166d913aa tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:52.336430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-51fe7271-19d1-4004-9feb-384166d913aa tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:52.468553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-51fe7271-19d1-4004-9feb-384166d913aa tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:52.476170 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-51fe7271-19d1-4004-9feb-384166d913aa tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1520 microversion: 2.1 time: 0.154714 Aug 04 17:52:52.476750 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3425/6817] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:52 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:53.497386 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b114e85b-91fc-4976-8917-b196dd0453dd tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:53.498043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b114e85b-91fc-4976-8917-b196dd0453dd tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:53.505316 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b114e85b-91fc-4976-8917-b196dd0453dd tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:53.505827 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b114e85b-91fc-4976-8917-b196dd0453dd tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:53.506313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b114e85b-91fc-4976-8917-b196dd0453dd tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:53.507659 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b114e85b-91fc-4976-8917-b196dd0453dd tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:53.508149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b114e85b-91fc-4976-8917-b196dd0453dd tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:53.508601 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b114e85b-91fc-4976-8917-b196dd0453dd tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:53.651675 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b114e85b-91fc-4976-8917-b196dd0453dd tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:53.659336 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b114e85b-91fc-4976-8917-b196dd0453dd tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1520 microversion: 2.1 time: 0.165883 Aug 04 17:52:53.659919 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3393/6818] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:53 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:54.682366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-863dd4b0-59ae-4f24-9420-c95816d09fc3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:54.682984 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-863dd4b0-59ae-4f24-9420-c95816d09fc3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:54.690342 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-863dd4b0-59ae-4f24-9420-c95816d09fc3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:54.690846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-863dd4b0-59ae-4f24-9420-c95816d09fc3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:54.691298 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-863dd4b0-59ae-4f24-9420-c95816d09fc3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:54.692011 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-863dd4b0-59ae-4f24-9420-c95816d09fc3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:54.692481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-863dd4b0-59ae-4f24-9420-c95816d09fc3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:54.692920 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-863dd4b0-59ae-4f24-9420-c95816d09fc3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:54.827315 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-863dd4b0-59ae-4f24-9420-c95816d09fc3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:54.835368 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-863dd4b0-59ae-4f24-9420-c95816d09fc3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1520 microversion: 2.1 time: 0.157512 Aug 04 17:52:54.836064 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3426/6819] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:54 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:55.856964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e78940b6-c3bb-4d32-bd40-9d61ae6aeb31 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:55.857537 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e78940b6-c3bb-4d32-bd40-9d61ae6aeb31 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:55.864639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e78940b6-c3bb-4d32-bd40-9d61ae6aeb31 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:55.865140 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e78940b6-c3bb-4d32-bd40-9d61ae6aeb31 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:55.865597 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e78940b6-c3bb-4d32-bd40-9d61ae6aeb31 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:55.867003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e78940b6-c3bb-4d32-bd40-9d61ae6aeb31 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:55.867485 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e78940b6-c3bb-4d32-bd40-9d61ae6aeb31 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:55.867933 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e78940b6-c3bb-4d32-bd40-9d61ae6aeb31 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:56.002469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e78940b6-c3bb-4d32-bd40-9d61ae6aeb31 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:56.010121 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e78940b6-c3bb-4d32-bd40-9d61ae6aeb31 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1520 microversion: 2.1 time: 0.157282 Aug 04 17:52:56.010706 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3394/6820] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:55 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:57.030597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-66fdd2c3-d5b1-4d98-9519-bbf91d976403 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:57.031183 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-66fdd2c3-d5b1-4d98-9519-bbf91d976403 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:57.038983 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66fdd2c3-d5b1-4d98-9519-bbf91d976403 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:57.039488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66fdd2c3-d5b1-4d98-9519-bbf91d976403 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:57.039935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66fdd2c3-d5b1-4d98-9519-bbf91d976403 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:57.040657 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66fdd2c3-d5b1-4d98-9519-bbf91d976403 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:57.041122 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66fdd2c3-d5b1-4d98-9519-bbf91d976403 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:57.041563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66fdd2c3-d5b1-4d98-9519-bbf91d976403 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:57.174259 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-66fdd2c3-d5b1-4d98-9519-bbf91d976403 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:57.182088 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-66fdd2c3-d5b1-4d98-9519-bbf91d976403 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1520 microversion: 2.1 time: 0.155441 Aug 04 17:52:57.182658 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3427/6821] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:57 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:58.202634 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3d298505-f55d-4d17-86dd-075c40896fca tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:58.203263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3d298505-f55d-4d17-86dd-075c40896fca tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:58.210796 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d298505-f55d-4d17-86dd-075c40896fca tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:58.211294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d298505-f55d-4d17-86dd-075c40896fca tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:58.211744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d298505-f55d-4d17-86dd-075c40896fca tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:58.212444 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d298505-f55d-4d17-86dd-075c40896fca tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:58.212911 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d298505-f55d-4d17-86dd-075c40896fca tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:58.213349 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d298505-f55d-4d17-86dd-075c40896fca tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:58.346462 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3d298505-f55d-4d17-86dd-075c40896fca tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:58.354032 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3d298505-f55d-4d17-86dd-075c40896fca tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1520 microversion: 2.1 time: 0.155292 Aug 04 17:52:58.354607 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3395/6822] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:58 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:52:59.375735 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9d298125-60d3-4a05-b73c-2c91203c2eca tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:52:59.376358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9d298125-60d3-4a05-b73c-2c91203c2eca tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:52:59.383498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d298125-60d3-4a05-b73c-2c91203c2eca tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:59.383988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d298125-60d3-4a05-b73c-2c91203c2eca tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:59.384432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d298125-60d3-4a05-b73c-2c91203c2eca tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:59.385553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d298125-60d3-4a05-b73c-2c91203c2eca tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:52:59.386040 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d298125-60d3-4a05-b73c-2c91203c2eca tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:52:59.386477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d298125-60d3-4a05-b73c-2c91203c2eca tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:52:59.519496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9d298125-60d3-4a05-b73c-2c91203c2eca tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:52:59.528147 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9d298125-60d3-4a05-b73c-2c91203c2eca tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1520 microversion: 2.1 time: 0.156365 Aug 04 17:52:59.528742 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3428/6823] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:52:59 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:00.549057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-43231793-5236-4b50-a6e5-42177968cbc0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:00.549701 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-43231793-5236-4b50-a6e5-42177968cbc0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:00.556824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43231793-5236-4b50-a6e5-42177968cbc0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:00.557334 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43231793-5236-4b50-a6e5-42177968cbc0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:00.557794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43231793-5236-4b50-a6e5-42177968cbc0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:00.558565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43231793-5236-4b50-a6e5-42177968cbc0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:00.559047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43231793-5236-4b50-a6e5-42177968cbc0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:00.559497 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43231793-5236-4b50-a6e5-42177968cbc0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:00.701231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-43231793-5236-4b50-a6e5-42177968cbc0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:00.708931 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-43231793-5236-4b50-a6e5-42177968cbc0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1520 microversion: 2.1 time: 0.163938 Aug 04 17:53:00.709516 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3396/6824] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:00 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:01.731096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8cf85581-9217-4acb-ab7f-e1e5db02a1c6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:01.731719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8cf85581-9217-4acb-ab7f-e1e5db02a1c6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:01.737799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8cf85581-9217-4acb-ab7f-e1e5db02a1c6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:01.738371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8cf85581-9217-4acb-ab7f-e1e5db02a1c6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:01.738804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8cf85581-9217-4acb-ab7f-e1e5db02a1c6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:01.739527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8cf85581-9217-4acb-ab7f-e1e5db02a1c6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:01.739997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8cf85581-9217-4acb-ab7f-e1e5db02a1c6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:01.740425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8cf85581-9217-4acb-ab7f-e1e5db02a1c6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:01.879865 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8cf85581-9217-4acb-ab7f-e1e5db02a1c6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:01.892864 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8cf85581-9217-4acb-ab7f-e1e5db02a1c6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1520 microversion: 2.1 time: 0.166027 Aug 04 17:53:01.893458 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3429/6825] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:01 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:02.915031 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bdbee1b8-c380-4236-844f-816019a624f0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:02.916266 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bdbee1b8-c380-4236-844f-816019a624f0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:02.923271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bdbee1b8-c380-4236-844f-816019a624f0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:02.923773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bdbee1b8-c380-4236-844f-816019a624f0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:02.924225 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bdbee1b8-c380-4236-844f-816019a624f0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:02.924938 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bdbee1b8-c380-4236-844f-816019a624f0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:02.925412 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bdbee1b8-c380-4236-844f-816019a624f0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:02.925863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bdbee1b8-c380-4236-844f-816019a624f0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:03.057873 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bdbee1b8-c380-4236-844f-816019a624f0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:03.065508 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bdbee1b8-c380-4236-844f-816019a624f0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1520 microversion: 2.1 time: 0.154535 Aug 04 17:53:03.066116 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3397/6826] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:02 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:04.086482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8cbf3e6b-6288-4483-9a40-ebc80a13bc17 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:04.087237 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8cbf3e6b-6288-4483-9a40-ebc80a13bc17 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:04.094584 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8cbf3e6b-6288-4483-9a40-ebc80a13bc17 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:04.095088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8cbf3e6b-6288-4483-9a40-ebc80a13bc17 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:04.095533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8cbf3e6b-6288-4483-9a40-ebc80a13bc17 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:04.096249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8cbf3e6b-6288-4483-9a40-ebc80a13bc17 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:04.096719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8cbf3e6b-6288-4483-9a40-ebc80a13bc17 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:04.097160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8cbf3e6b-6288-4483-9a40-ebc80a13bc17 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:04.235053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8cbf3e6b-6288-4483-9a40-ebc80a13bc17 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:04.243390 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8cbf3e6b-6288-4483-9a40-ebc80a13bc17 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1520 microversion: 2.1 time: 0.161057 Aug 04 17:53:04.243969 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3430/6827] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:04 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:05.264429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5f327169-5a3c-4a54-a37c-b49515401093 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:05.265060 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5f327169-5a3c-4a54-a37c-b49515401093 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:05.272154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f327169-5a3c-4a54-a37c-b49515401093 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:05.272691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f327169-5a3c-4a54-a37c-b49515401093 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:05.273141 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f327169-5a3c-4a54-a37c-b49515401093 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:05.273859 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f327169-5a3c-4a54-a37c-b49515401093 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:05.274360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f327169-5a3c-4a54-a37c-b49515401093 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:05.274794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f327169-5a3c-4a54-a37c-b49515401093 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:05.407927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5f327169-5a3c-4a54-a37c-b49515401093 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:05.415922 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5f327169-5a3c-4a54-a37c-b49515401093 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1520 microversion: 2.1 time: 0.155540 Aug 04 17:53:05.416501 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3398/6828] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:05 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:06.440078 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7a6ba9af-df0f-44fd-bd8b-51482f70d1cd tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:06.440753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7a6ba9af-df0f-44fd-bd8b-51482f70d1cd tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:06.448533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7a6ba9af-df0f-44fd-bd8b-51482f70d1cd tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:06.449031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7a6ba9af-df0f-44fd-bd8b-51482f70d1cd tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:06.449482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7a6ba9af-df0f-44fd-bd8b-51482f70d1cd tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:06.450223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7a6ba9af-df0f-44fd-bd8b-51482f70d1cd tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:06.450697 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7a6ba9af-df0f-44fd-bd8b-51482f70d1cd tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:06.451135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7a6ba9af-df0f-44fd-bd8b-51482f70d1cd tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:06.455108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:53:06.586597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7a6ba9af-df0f-44fd-bd8b-51482f70d1cd tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:06.594429 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7a6ba9af-df0f-44fd-bd8b-51482f70d1cd tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1520 microversion: 2.1 time: 0.158484 Aug 04 17:53:06.595009 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3431/6829] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:06 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:07.617758 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-293e4ffb-acfd-499b-9998-239ba6d8220d tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:07.618438 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-293e4ffb-acfd-499b-9998-239ba6d8220d tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:07.625546 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-293e4ffb-acfd-499b-9998-239ba6d8220d tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:07.626114 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-293e4ffb-acfd-499b-9998-239ba6d8220d tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:07.626569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-293e4ffb-acfd-499b-9998-239ba6d8220d tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:07.627285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-293e4ffb-acfd-499b-9998-239ba6d8220d tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:07.627758 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-293e4ffb-acfd-499b-9998-239ba6d8220d tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:07.628204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-293e4ffb-acfd-499b-9998-239ba6d8220d tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:07.764449 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-293e4ffb-acfd-499b-9998-239ba6d8220d tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:07.772176 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-293e4ffb-acfd-499b-9998-239ba6d8220d tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1520 microversion: 2.1 time: 0.158839 Aug 04 17:53:07.772743 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3399/6830] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:07 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:08.798709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e3ff4bc3-d2e5-4b20-bf22-9b454be6f1f8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:08.799899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e3ff4bc3-d2e5-4b20-bf22-9b454be6f1f8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:08.810049 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e3ff4bc3-d2e5-4b20-bf22-9b454be6f1f8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:08.810789 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e3ff4bc3-d2e5-4b20-bf22-9b454be6f1f8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:08.811237 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e3ff4bc3-d2e5-4b20-bf22-9b454be6f1f8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:08.811978 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e3ff4bc3-d2e5-4b20-bf22-9b454be6f1f8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:08.812433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e3ff4bc3-d2e5-4b20-bf22-9b454be6f1f8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:08.812870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e3ff4bc3-d2e5-4b20-bf22-9b454be6f1f8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:08.953280 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e3ff4bc3-d2e5-4b20-bf22-9b454be6f1f8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:08.962666 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e3ff4bc3-d2e5-4b20-bf22-9b454be6f1f8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1520 microversion: 2.1 time: 0.170469 Aug 04 17:53:08.963461 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3432/6831] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:08 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:09.985612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-666d5883-3d94-4732-8b7f-97af9c9e53a2 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:09.986285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-666d5883-3d94-4732-8b7f-97af9c9e53a2 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:09.994132 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-666d5883-3d94-4732-8b7f-97af9c9e53a2 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:09.994640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-666d5883-3d94-4732-8b7f-97af9c9e53a2 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:09.995099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-666d5883-3d94-4732-8b7f-97af9c9e53a2 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:09.995833 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-666d5883-3d94-4732-8b7f-97af9c9e53a2 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:09.996305 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-666d5883-3d94-4732-8b7f-97af9c9e53a2 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:09.996752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-666d5883-3d94-4732-8b7f-97af9c9e53a2 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:10.131449 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-666d5883-3d94-4732-8b7f-97af9c9e53a2 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:10.139237 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-666d5883-3d94-4732-8b7f-97af9c9e53a2 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1520 microversion: 2.1 time: 0.157627 Aug 04 17:53:10.139819 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3400/6832] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:09 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:11.163032 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6946fc6a-aff0-4cf9-ad68-615b8ab175bb tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:11.163669 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6946fc6a-aff0-4cf9-ad68-615b8ab175bb tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:11.171313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6946fc6a-aff0-4cf9-ad68-615b8ab175bb tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:11.171832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6946fc6a-aff0-4cf9-ad68-615b8ab175bb tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:11.172279 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6946fc6a-aff0-4cf9-ad68-615b8ab175bb tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:11.173017 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6946fc6a-aff0-4cf9-ad68-615b8ab175bb tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:11.173492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6946fc6a-aff0-4cf9-ad68-615b8ab175bb tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:11.173937 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6946fc6a-aff0-4cf9-ad68-615b8ab175bb tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:11.306988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6946fc6a-aff0-4cf9-ad68-615b8ab175bb tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:11.314929 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6946fc6a-aff0-4cf9-ad68-615b8ab175bb tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1520 microversion: 2.1 time: 0.155932 Aug 04 17:53:11.315508 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3433/6833] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:11 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:12.337047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-20acab92-4b7f-4259-a343-da5a51b73453 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:12.337719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-20acab92-4b7f-4259-a343-da5a51b73453 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:12.345043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20acab92-4b7f-4259-a343-da5a51b73453 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:12.345552 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20acab92-4b7f-4259-a343-da5a51b73453 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:12.346033 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20acab92-4b7f-4259-a343-da5a51b73453 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:12.346757 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20acab92-4b7f-4259-a343-da5a51b73453 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:12.347238 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20acab92-4b7f-4259-a343-da5a51b73453 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:12.347687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20acab92-4b7f-4259-a343-da5a51b73453 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:12.480519 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-20acab92-4b7f-4259-a343-da5a51b73453 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:12.488245 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-20acab92-4b7f-4259-a343-da5a51b73453 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1520 microversion: 2.1 time: 0.155875 Aug 04 17:53:12.488832 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3401/6834] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:12 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:13.508980 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-45867546-ff40-4092-80ff-153f1a832853 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:13.509641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-45867546-ff40-4092-80ff-153f1a832853 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:13.516609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-45867546-ff40-4092-80ff-153f1a832853 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:13.517105 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-45867546-ff40-4092-80ff-153f1a832853 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:13.517553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-45867546-ff40-4092-80ff-153f1a832853 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:13.518304 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-45867546-ff40-4092-80ff-153f1a832853 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:13.518774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-45867546-ff40-4092-80ff-153f1a832853 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:13.519213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-45867546-ff40-4092-80ff-153f1a832853 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:13.656176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-45867546-ff40-4092-80ff-153f1a832853 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:13.663841 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-45867546-ff40-4092-80ff-153f1a832853 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1520 microversion: 2.1 time: 0.158760 Aug 04 17:53:13.665091 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3434/6835] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:13 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:14.686171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3aca1112-9fda-4e84-9197-1c2d820b4331 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:14.686841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3aca1112-9fda-4e84-9197-1c2d820b4331 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:14.693798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3aca1112-9fda-4e84-9197-1c2d820b4331 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:14.694337 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3aca1112-9fda-4e84-9197-1c2d820b4331 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:14.694797 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3aca1112-9fda-4e84-9197-1c2d820b4331 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:14.695549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3aca1112-9fda-4e84-9197-1c2d820b4331 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:14.696029 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3aca1112-9fda-4e84-9197-1c2d820b4331 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:14.696476 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3aca1112-9fda-4e84-9197-1c2d820b4331 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:14.833232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3aca1112-9fda-4e84-9197-1c2d820b4331 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:14.841404 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3aca1112-9fda-4e84-9197-1c2d820b4331 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1520 microversion: 2.1 time: 0.159249 Aug 04 17:53:14.842011 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3402/6836] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:14 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:15.862523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bebc1802-4c6d-4633-9c71-0e6c4863b21f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:15.863159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bebc1802-4c6d-4633-9c71-0e6c4863b21f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:15.870775 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bebc1802-4c6d-4633-9c71-0e6c4863b21f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:15.871281 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bebc1802-4c6d-4633-9c71-0e6c4863b21f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:15.871736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bebc1802-4c6d-4633-9c71-0e6c4863b21f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:15.872457 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bebc1802-4c6d-4633-9c71-0e6c4863b21f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:15.872931 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bebc1802-4c6d-4633-9c71-0e6c4863b21f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:15.873371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bebc1802-4c6d-4633-9c71-0e6c4863b21f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:16.014897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bebc1802-4c6d-4633-9c71-0e6c4863b21f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:16.022618 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bebc1802-4c6d-4633-9c71-0e6c4863b21f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1520 microversion: 2.1 time: 0.164067 Aug 04 17:53:16.023217 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3435/6837] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:15 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:17.044464 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-acccba38-bada-449b-9385-d5706a9e7705 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:17.045110 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-acccba38-bada-449b-9385-d5706a9e7705 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:17.053223 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acccba38-bada-449b-9385-d5706a9e7705 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:17.053648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acccba38-bada-449b-9385-d5706a9e7705 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:17.054090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acccba38-bada-449b-9385-d5706a9e7705 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:17.054825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acccba38-bada-449b-9385-d5706a9e7705 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:17.055303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acccba38-bada-449b-9385-d5706a9e7705 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:17.055754 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acccba38-bada-449b-9385-d5706a9e7705 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:17.195806 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-acccba38-bada-449b-9385-d5706a9e7705 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:17.204158 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-acccba38-bada-449b-9385-d5706a9e7705 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1520 microversion: 2.1 time: 0.164513 Aug 04 17:53:17.204783 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3403/6838] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:17 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:18.227015 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-839edc9c-58ae-451f-b44c-b777ebdc7f23 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:18.227645 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-839edc9c-58ae-451f-b44c-b777ebdc7f23 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:18.230546 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=34 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:53:18.236563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-839edc9c-58ae-451f-b44c-b777ebdc7f23 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:18.237065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-839edc9c-58ae-451f-b44c-b777ebdc7f23 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:18.237517 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-839edc9c-58ae-451f-b44c-b777ebdc7f23 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:18.238259 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-839edc9c-58ae-451f-b44c-b777ebdc7f23 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:18.238731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-839edc9c-58ae-451f-b44c-b777ebdc7f23 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:18.239169 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-839edc9c-58ae-451f-b44c-b777ebdc7f23 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:18.811661 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-839edc9c-58ae-451f-b44c-b777ebdc7f23 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:18.819622 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-839edc9c-58ae-451f-b44c-b777ebdc7f23 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1519 microversion: 2.1 time: 0.596508 Aug 04 17:53:18.820221 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3436/6839] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:18 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1519 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:19.111912 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-59de060e-dd7d-4610-a841-0436a00810f8 req-d64ffb49-ac2b-4269-956d-6d0edf95e6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b217f6ed-2122-45de-b6f2-79ce04451536", "name": "network-vif-unplugged", "status": "completed", "tag": "f6825872-e1c7-4cae-867a-c8c4789990b3"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:53:19.116855 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=29 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:53:19.123016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-59de060e-dd7d-4610-a841-0436a00810f8 req-d64ffb49-ac2b-4269-956d-6d0edf95e6d5 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:19.123526 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-59de060e-dd7d-4610-a841-0436a00810f8 req-d64ffb49-ac2b-4269-956d-6d0edf95e6d5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:19.123982 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-59de060e-dd7d-4610-a841-0436a00810f8 req-d64ffb49-ac2b-4269-956d-6d0edf95e6d5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:19.128603 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:53:19.138239 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-59de060e-dd7d-4610-a841-0436a00810f8 req-d64ffb49-ac2b-4269-956d-6d0edf95e6d5 service nova] Creating event network-vif-unplugged:f6825872-e1c7-4cae-867a-c8c4789990b3 for instance b217f6ed-2122-45de-b6f2-79ce04451536 on n-h2-851359-3 Aug 04 17:53:19.145001 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-59de060e-dd7d-4610-a841-0436a00810f8 req-d64ffb49-ac2b-4269-956d-6d0edf95e6d5 service nova] Instance b217f6ed-2122-45de-b6f2-79ce04451536 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:53:19.157496 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-59de060e-dd7d-4610-a841-0436a00810f8 req-d64ffb49-ac2b-4269-956d-6d0edf95e6d5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108749 Aug 04 17:53:19.158021 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3404/6840] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:53:19.841869 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-86da37fc-489a-4b8f-bcf3-aec540a37f90 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:19.842818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-86da37fc-489a-4b8f-bcf3-aec540a37f90 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:19.849533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86da37fc-489a-4b8f-bcf3-aec540a37f90 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:19.850062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86da37fc-489a-4b8f-bcf3-aec540a37f90 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:19.850686 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86da37fc-489a-4b8f-bcf3-aec540a37f90 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:19.851417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86da37fc-489a-4b8f-bcf3-aec540a37f90 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:19.851891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86da37fc-489a-4b8f-bcf3-aec540a37f90 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:19.852337 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86da37fc-489a-4b8f-bcf3-aec540a37f90 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:19.989966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-86da37fc-489a-4b8f-bcf3-aec540a37f90 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:19.997707 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-86da37fc-489a-4b8f-bcf3-aec540a37f90 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1517 microversion: 2.1 time: 0.160579 Aug 04 17:53:19.998328 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3437/6841] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:19 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:21.021037 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7c3a462d-a7f4-4364-af31-1673672fce63 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:21.021690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7c3a462d-a7f4-4364-af31-1673672fce63 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:21.028777 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c3a462d-a7f4-4364-af31-1673672fce63 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:21.029279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c3a462d-a7f4-4364-af31-1673672fce63 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:21.029742 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c3a462d-a7f4-4364-af31-1673672fce63 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:21.030655 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c3a462d-a7f4-4364-af31-1673672fce63 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:21.031135 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c3a462d-a7f4-4364-af31-1673672fce63 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:21.031582 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c3a462d-a7f4-4364-af31-1673672fce63 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:21.163771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7c3a462d-a7f4-4364-af31-1673672fce63 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:21.172127 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7c3a462d-a7f4-4364-af31-1673672fce63 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1517 microversion: 2.1 time: 0.156425 Aug 04 17:53:21.172632 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3405/6842] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:21 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:21.175904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-d74f5112-6f42-4a32-93e0-78a280fd0857 req-92796960-c8f8-4c6b-bb37-179f9298e193 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b217f6ed-2122-45de-b6f2-79ce04451536", "tag": "f6825872-e1c7-4cae-867a-c8c4789990b3"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:53:21.186309 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d74f5112-6f42-4a32-93e0-78a280fd0857 req-92796960-c8f8-4c6b-bb37-179f9298e193 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:21.186893 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d74f5112-6f42-4a32-93e0-78a280fd0857 req-92796960-c8f8-4c6b-bb37-179f9298e193 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:21.187333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d74f5112-6f42-4a32-93e0-78a280fd0857 req-92796960-c8f8-4c6b-bb37-179f9298e193 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:21.199462 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-d74f5112-6f42-4a32-93e0-78a280fd0857 req-92796960-c8f8-4c6b-bb37-179f9298e193 service nova] Creating event network-changed:f6825872-e1c7-4cae-867a-c8c4789990b3 for instance b217f6ed-2122-45de-b6f2-79ce04451536 on n-h2-851359-3 Aug 04 17:53:21.204716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [req-d74f5112-6f42-4a32-93e0-78a280fd0857 req-92796960-c8f8-4c6b-bb37-179f9298e193 service nova] Instance b217f6ed-2122-45de-b6f2-79ce04451536 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:53:21.215893 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-d74f5112-6f42-4a32-93e0-78a280fd0857 req-92796960-c8f8-4c6b-bb37-179f9298e193 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043815 Aug 04 17:53:21.216519 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3438/6843] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:53:22.193346 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d263d94c-6299-42e4-ad2c-b30c6fb3d777 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:22.193996 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d263d94c-6299-42e4-ad2c-b30c6fb3d777 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:22.201948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d263d94c-6299-42e4-ad2c-b30c6fb3d777 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:22.202504 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d263d94c-6299-42e4-ad2c-b30c6fb3d777 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:22.202964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d263d94c-6299-42e4-ad2c-b30c6fb3d777 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:22.203713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d263d94c-6299-42e4-ad2c-b30c6fb3d777 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:22.204197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d263d94c-6299-42e4-ad2c-b30c6fb3d777 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:22.204652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d263d94c-6299-42e4-ad2c-b30c6fb3d777 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:22.347983 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d263d94c-6299-42e4-ad2c-b30c6fb3d777 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:22.356664 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d263d94c-6299-42e4-ad2c-b30c6fb3d777 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1517 microversion: 2.1 time: 0.167633 Aug 04 17:53:22.357254 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3406/6844] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:22 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:23.379746 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-477e1c27-86a9-4228-baaf-dcb2e603287a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:23.380471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-477e1c27-86a9-4228-baaf-dcb2e603287a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:23.386830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-477e1c27-86a9-4228-baaf-dcb2e603287a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:23.387508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-477e1c27-86a9-4228-baaf-dcb2e603287a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:23.387959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-477e1c27-86a9-4228-baaf-dcb2e603287a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:23.388671 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-477e1c27-86a9-4228-baaf-dcb2e603287a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:23.389132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-477e1c27-86a9-4228-baaf-dcb2e603287a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:23.389562 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-477e1c27-86a9-4228-baaf-dcb2e603287a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:23.531957 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-477e1c27-86a9-4228-baaf-dcb2e603287a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:23.539763 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-477e1c27-86a9-4228-baaf-dcb2e603287a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1514 microversion: 2.1 time: 0.165149 Aug 04 17:53:23.540401 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3439/6845] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:23 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:23.560562 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-15d542e9-0e66-4a12-b043-e10e93916fb0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:53:23.561219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-15d542e9-0e66-4a12-b043-e10e93916fb0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:23.568349 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15d542e9-0e66-4a12-b043-e10e93916fb0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:23.568856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15d542e9-0e66-4a12-b043-e10e93916fb0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:23.569308 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15d542e9-0e66-4a12-b043-e10e93916fb0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:23.570045 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15d542e9-0e66-4a12-b043-e10e93916fb0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:23.570517 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15d542e9-0e66-4a12-b043-e10e93916fb0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:23.570956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15d542e9-0e66-4a12-b043-e10e93916fb0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:23.630402 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-15d542e9-0e66-4a12-b043-e10e93916fb0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "POST /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536/action" status: 204 len: 0 microversion: 2.1 time: 0.074078 Aug 04 17:53:23.630981 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3407/6846] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:53:23 2022] POST /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:53:23.639677 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3b006a61-4deb-4354-bb27-206fdc8d62a6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:23.640311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3b006a61-4deb-4354-bb27-206fdc8d62a6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:23.646925 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b006a61-4deb-4354-bb27-206fdc8d62a6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:23.647440 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b006a61-4deb-4354-bb27-206fdc8d62a6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:23.647896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b006a61-4deb-4354-bb27-206fdc8d62a6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:23.648796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b006a61-4deb-4354-bb27-206fdc8d62a6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:23.649310 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b006a61-4deb-4354-bb27-206fdc8d62a6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:23.650133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b006a61-4deb-4354-bb27-206fdc8d62a6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:23.871265 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3b006a61-4deb-4354-bb27-206fdc8d62a6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:23.879675 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3b006a61-4deb-4354-bb27-206fdc8d62a6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1514 microversion: 2.1 time: 0.243907 Aug 04 17:53:23.880276 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3440/6847] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:23 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1514 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:24.902832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-20f049d3-0299-4338-b39e-bb65f534ad1d tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:24.903580 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-20f049d3-0299-4338-b39e-bb65f534ad1d tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:24.910118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20f049d3-0299-4338-b39e-bb65f534ad1d tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:24.910623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20f049d3-0299-4338-b39e-bb65f534ad1d tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:24.911182 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20f049d3-0299-4338-b39e-bb65f534ad1d tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:24.911780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20f049d3-0299-4338-b39e-bb65f534ad1d tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:24.912247 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20f049d3-0299-4338-b39e-bb65f534ad1d tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:24.912687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20f049d3-0299-4338-b39e-bb65f534ad1d tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:25.074682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-20f049d3-0299-4338-b39e-bb65f534ad1d tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:25.082653 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-20f049d3-0299-4338-b39e-bb65f534ad1d tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1506 microversion: 2.1 time: 0.185609 Aug 04 17:53:25.083238 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3408/6848] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:24 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1506 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:25.103480 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-638b3a85-2843-4a4b-b31d-8f8d1f7c9aa3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:25.104253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-638b3a85-2843-4a4b-b31d-8f8d1f7c9aa3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:25.111436 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-638b3a85-2843-4a4b-b31d-8f8d1f7c9aa3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:25.111942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-638b3a85-2843-4a4b-b31d-8f8d1f7c9aa3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:25.112434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-638b3a85-2843-4a4b-b31d-8f8d1f7c9aa3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:25.113206 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-638b3a85-2843-4a4b-b31d-8f8d1f7c9aa3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:25.113661 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-638b3a85-2843-4a4b-b31d-8f8d1f7c9aa3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:25.114430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-638b3a85-2843-4a4b-b31d-8f8d1f7c9aa3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:25.253758 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-638b3a85-2843-4a4b-b31d-8f8d1f7c9aa3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:25.261279 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-638b3a85-2843-4a4b-b31d-8f8d1f7c9aa3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1506 microversion: 2.1 time: 0.161951 Aug 04 17:53:25.261858 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3441/6849] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:25 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:25.283995 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dcf138a5-bcee-4ce9-925c-8f8a4637a153 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Action: 'create', calling method: .version_select at 0x7f1e5a2e2af0>, body: {"keypair": {"name": "tempest-keypair-579678221", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKK0AveBgNsNvydOkleptL7zui9EGzxiBitoicd4gjom2EVfo5QZ/GeBHNQKd36MTJhBUuyeGzcH0crtJaIK9vkufoGuLY/M/vKewjJpKTmarm+vrq6Ym/Hr4zDP7F2Oug=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:53:25.299838 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-dcf138a5-bcee-4ce9-925c-8f8a4637a153 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Getting quotas for project 479c5566b5a24b47bd9b3ff2de850c3f. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:53:25.305019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-dcf138a5-bcee-4ce9-925c-8f8a4637a153 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Getting quotas for user 0043a0e11d59421c82b927e823764bda and project 479c5566b5a24b47bd9b3ff2de850c3f. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:53:25.330142 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dcf138a5-bcee-4ce9-925c-8f8a4637a153 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049888 Aug 04 17:53:25.330749 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3409/6850] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:53:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:53:26.576526 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f39f36a5-d138-4ddd-ab1f-04fc63596bde tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:26.577714 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f39f36a5-d138-4ddd-ab1f-04fc63596bde tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:26.585136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f39f36a5-d138-4ddd-ab1f-04fc63596bde tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:26.585728 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f39f36a5-d138-4ddd-ab1f-04fc63596bde tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:26.586283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f39f36a5-d138-4ddd-ab1f-04fc63596bde tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:26.587077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f39f36a5-d138-4ddd-ab1f-04fc63596bde tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:26.589012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f39f36a5-d138-4ddd-ab1f-04fc63596bde tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:26.589636 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f39f36a5-d138-4ddd-ab1f-04fc63596bde tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:26.774299 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-7f2cec88-d15a-4f0f-a669-b36e5c340615 req-cbeabc67-a192-4e28-b582-ac2d664d0a22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b217f6ed-2122-45de-b6f2-79ce04451536", "name": "network-vif-plugged", "status": "completed", "tag": "f6825872-e1c7-4cae-867a-c8c4789990b3"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:53:26.788373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7f2cec88-d15a-4f0f-a669-b36e5c340615 req-cbeabc67-a192-4e28-b582-ac2d664d0a22 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:26.788895 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7f2cec88-d15a-4f0f-a669-b36e5c340615 req-cbeabc67-a192-4e28-b582-ac2d664d0a22 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:26.789344 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7f2cec88-d15a-4f0f-a669-b36e5c340615 req-cbeabc67-a192-4e28-b582-ac2d664d0a22 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:26.800699 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-7f2cec88-d15a-4f0f-a669-b36e5c340615 req-cbeabc67-a192-4e28-b582-ac2d664d0a22 service nova] Creating event network-vif-plugged:f6825872-e1c7-4cae-867a-c8c4789990b3 for instance b217f6ed-2122-45de-b6f2-79ce04451536 on n-h2-851359-3 Aug 04 17:53:26.806687 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-7f2cec88-d15a-4f0f-a669-b36e5c340615 req-cbeabc67-a192-4e28-b582-ac2d664d0a22 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092651 Aug 04 17:53:26.807306 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3410/6851] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:53:26.825573 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f39f36a5-d138-4ddd-ab1f-04fc63596bde tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:26.833149 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f39f36a5-d138-4ddd-ab1f-04fc63596bde tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 200 len: 1506 microversion: 2.1 time: 0.260829 Aug 04 17:53:26.833722 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3442/6852] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:26 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 1506 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:26.855407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-568d71b0-b776-4293-b12d-a010bc558df7 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:26.856131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-568d71b0-b776-4293-b12d-a010bc558df7 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:26.862960 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-568d71b0-b776-4293-b12d-a010bc558df7 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:26.863467 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-568d71b0-b776-4293-b12d-a010bc558df7 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:26.863919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-568d71b0-b776-4293-b12d-a010bc558df7 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:26.864637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-568d71b0-b776-4293-b12d-a010bc558df7 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:26.865109 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-568d71b0-b776-4293-b12d-a010bc558df7 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:26.865553 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-568d71b0-b776-4293-b12d-a010bc558df7 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:26.893635 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-568d71b0-b776-4293-b12d-a010bc558df7 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:53:26.978851 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-568d71b0-b776-4293-b12d-a010bc558df7 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 204 len: 0 microversion: 2.1 time: 0.128077 Aug 04 17:53:26.980399 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3411/6853] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:53:26 2022] DELETE /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:53:27.037042 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b1548d7c-07e1-4529-a92d-a2c61498f4f1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1511009008", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "d87a8e10-3bf3-41aa-9cf7-d4014f2e5c01"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:53:27.089174 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-b1548d7c-07e1-4529-a92d-a2c61498f4f1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] validate_networks() for [('d87a8e10-3bf3-41aa-9cf7-d4014f2e5c01', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:53:27.475476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-b1548d7c-07e1-4529-a92d-a2c61498f4f1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:53:27.475941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-b1548d7c-07e1-4529-a92d-a2c61498f4f1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:53:27.476428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-b1548d7c-07e1-4529-a92d-a2c61498f4f1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:53:27.476849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-b1548d7c-07e1-4529-a92d-a2c61498f4f1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:53:27.477275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-b1548d7c-07e1-4529-a92d-a2c61498f4f1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:53:27.487225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1548d7c-07e1-4529-a92d-a2c61498f4f1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:27.487726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1548d7c-07e1-4529-a92d-a2c61498f4f1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:27.488195 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1548d7c-07e1-4529-a92d-a2c61498f4f1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:27.488935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1548d7c-07e1-4529-a92d-a2c61498f4f1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:27.489404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1548d7c-07e1-4529-a92d-a2c61498f4f1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:27.489844 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1548d7c-07e1-4529-a92d-a2c61498f4f1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:27.508128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-b1548d7c-07e1-4529-a92d-a2c61498f4f1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Getting quotas for project 479c5566b5a24b47bd9b3ff2de850c3f. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:53:27.513373 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-b1548d7c-07e1-4529-a92d-a2c61498f4f1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Getting quotas for user 0043a0e11d59421c82b927e823764bda and project 479c5566b5a24b47bd9b3ff2de850c3f. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:53:27.525999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b1548d7c-07e1-4529-a92d-a2c61498f4f1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:53:27.528337 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b1548d7c-07e1-4529-a92d-a2c61498f4f1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:53:27.572838 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b1548d7c-07e1-4529-a92d-a2c61498f4f1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.539764 Aug 04 17:53:27.573503 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3443/6854] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:53:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:53:27.584880 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c38a9ab7-19f1-45d6-b261-3352fb89bd1f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:27.585612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c38a9ab7-19f1-45d6-b261-3352fb89bd1f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:27.640807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c38a9ab7-19f1-45d6-b261-3352fb89bd1f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:27.648419 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c38a9ab7-19f1-45d6-b261-3352fb89bd1f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1218 microversion: 2.1 time: 0.067767 Aug 04 17:53:27.649034 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3412/6855] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:27 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:28.670459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4ed825bc-e724-4dbc-8a7e-535bf6f6c117 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:28.671918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4ed825bc-e724-4dbc-8a7e-535bf6f6c117 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:28.682246 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4ed825bc-e724-4dbc-8a7e-535bf6f6c117 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:28.683109 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4ed825bc-e724-4dbc-8a7e-535bf6f6c117 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:28.683988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4ed825bc-e724-4dbc-8a7e-535bf6f6c117 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:28.684883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4ed825bc-e724-4dbc-8a7e-535bf6f6c117 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:28.685517 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4ed825bc-e724-4dbc-8a7e-535bf6f6c117 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:28.686493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4ed825bc-e724-4dbc-8a7e-535bf6f6c117 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:28.776081 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4ed825bc-e724-4dbc-8a7e-535bf6f6c117 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:28.789323 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4ed825bc-e724-4dbc-8a7e-535bf6f6c117 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1288 microversion: 2.1 time: 0.123956 Aug 04 17:53:28.790992 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3444/6856] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:28 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1288 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:29.728033 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0729fbd1-f250-4ddb-b9a2-ef8eacfd5ff1 req-f8ab1826-52e8-4985-a228-510ecf657a1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b217f6ed-2122-45de-b6f2-79ce04451536", "name": "network-vif-deleted", "tag": "f6825872-e1c7-4cae-867a-c8c4789990b3"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:53:29.739549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0729fbd1-f250-4ddb-b9a2-ef8eacfd5ff1 req-f8ab1826-52e8-4985-a228-510ecf657a1b service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:29.740343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0729fbd1-f250-4ddb-b9a2-ef8eacfd5ff1 req-f8ab1826-52e8-4985-a228-510ecf657a1b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:29.740955 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0729fbd1-f250-4ddb-b9a2-ef8eacfd5ff1 req-f8ab1826-52e8-4985-a228-510ecf657a1b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:29.755558 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0729fbd1-f250-4ddb-b9a2-ef8eacfd5ff1 req-f8ab1826-52e8-4985-a228-510ecf657a1b service nova] Creating event network-vif-deleted:f6825872-e1c7-4cae-867a-c8c4789990b3 for instance b217f6ed-2122-45de-b6f2-79ce04451536 on n-h2-851359-3 Aug 04 17:53:29.763054 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0729fbd1-f250-4ddb-b9a2-ef8eacfd5ff1 req-f8ab1826-52e8-4985-a228-510ecf657a1b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039094 Aug 04 17:53:29.764180 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3413/6857] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:53:29.812706 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0e86cd03-6eee-4207-bb59-a66ba200d750 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:29.813357 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0e86cd03-6eee-4207-bb59-a66ba200d750 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:29.820417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e86cd03-6eee-4207-bb59-a66ba200d750 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:29.820919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e86cd03-6eee-4207-bb59-a66ba200d750 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:29.821430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e86cd03-6eee-4207-bb59-a66ba200d750 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:29.822672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e86cd03-6eee-4207-bb59-a66ba200d750 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:29.823137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e86cd03-6eee-4207-bb59-a66ba200d750 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:29.823748 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0e86cd03-6eee-4207-bb59-a66ba200d750 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:29.909917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0e86cd03-6eee-4207-bb59-a66ba200d750 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:29.919172 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0e86cd03-6eee-4207-bb59-a66ba200d750 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1276 microversion: 2.1 time: 0.110466 Aug 04 17:53:29.919999 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3445/6858] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:29 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1276 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:30.942006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7eed8ada-658b-4f7c-81dd-f8457455b9d8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:30.942735 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7eed8ada-658b-4f7c-81dd-f8457455b9d8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:30.950636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7eed8ada-658b-4f7c-81dd-f8457455b9d8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:30.951148 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7eed8ada-658b-4f7c-81dd-f8457455b9d8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:30.951609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7eed8ada-658b-4f7c-81dd-f8457455b9d8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:30.952331 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7eed8ada-658b-4f7c-81dd-f8457455b9d8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:30.952808 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7eed8ada-658b-4f7c-81dd-f8457455b9d8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:30.953249 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7eed8ada-658b-4f7c-81dd-f8457455b9d8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:31.162951 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7eed8ada-658b-4f7c-81dd-f8457455b9d8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:31.170829 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7eed8ada-658b-4f7c-81dd-f8457455b9d8 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1318 microversion: 2.1 time: 0.233392 Aug 04 17:53:31.171442 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3414/6859] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:30 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:53:31.781071 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-50886e0f-3d9e-4753-8ab5-7f94a1c7be1a req-72c2a2b5-b26c-4263-9b22-41f618e52427 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a449099e-7e6e-4798-bf5e-8ce5ed065965", "tag": "57aef34e-296b-40ca-b2c7-970cd1fae630"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:53:31.791341 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-50886e0f-3d9e-4753-8ab5-7f94a1c7be1a req-72c2a2b5-b26c-4263-9b22-41f618e52427 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:31.791832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-50886e0f-3d9e-4753-8ab5-7f94a1c7be1a req-72c2a2b5-b26c-4263-9b22-41f618e52427 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:31.792278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-50886e0f-3d9e-4753-8ab5-7f94a1c7be1a req-72c2a2b5-b26c-4263-9b22-41f618e52427 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:31.803041 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-50886e0f-3d9e-4753-8ab5-7f94a1c7be1a req-72c2a2b5-b26c-4263-9b22-41f618e52427 service nova] Creating event network-changed:57aef34e-296b-40ca-b2c7-970cd1fae630 for instance a449099e-7e6e-4798-bf5e-8ce5ed065965 on n-h1-851359-3 Aug 04 17:53:31.808686 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-50886e0f-3d9e-4753-8ab5-7f94a1c7be1a req-72c2a2b5-b26c-4263-9b22-41f618e52427 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031656 Aug 04 17:53:31.809271 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3446/6860] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:53:32.194847 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-636cda49-7e01-4184-90b8-39fdacd14717 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:32.195489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-636cda49-7e01-4184-90b8-39fdacd14717 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:32.202549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-636cda49-7e01-4184-90b8-39fdacd14717 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:32.203057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-636cda49-7e01-4184-90b8-39fdacd14717 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:32.203516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-636cda49-7e01-4184-90b8-39fdacd14717 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:32.204242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-636cda49-7e01-4184-90b8-39fdacd14717 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:32.204719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-636cda49-7e01-4184-90b8-39fdacd14717 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:32.205163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-636cda49-7e01-4184-90b8-39fdacd14717 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:32.428353 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-636cda49-7e01-4184-90b8-39fdacd14717 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:32.435878 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-636cda49-7e01-4184-90b8-39fdacd14717 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1318 microversion: 2.1 time: 0.244977 Aug 04 17:53:32.436484 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3415/6861] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:32 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:33.458200 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-80bb5b61-7749-4902-8dfe-954d808aad5d tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:33.458924 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-80bb5b61-7749-4902-8dfe-954d808aad5d tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:33.465536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80bb5b61-7749-4902-8dfe-954d808aad5d tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:33.466088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80bb5b61-7749-4902-8dfe-954d808aad5d tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:33.466655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80bb5b61-7749-4902-8dfe-954d808aad5d tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:33.467381 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80bb5b61-7749-4902-8dfe-954d808aad5d tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:33.468106 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80bb5b61-7749-4902-8dfe-954d808aad5d tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:33.468545 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80bb5b61-7749-4902-8dfe-954d808aad5d tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:33.615872 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-80bb5b61-7749-4902-8dfe-954d808aad5d tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:33.623563 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-80bb5b61-7749-4902-8dfe-954d808aad5d tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1318 microversion: 2.1 time: 0.170555 Aug 04 17:53:33.624140 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3447/6862] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:33 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:34.644584 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-417373df-b54b-4c51-9242-9e18d86587a5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:34.645212 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-417373df-b54b-4c51-9242-9e18d86587a5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:34.652587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-417373df-b54b-4c51-9242-9e18d86587a5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:34.653098 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-417373df-b54b-4c51-9242-9e18d86587a5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:34.653552 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-417373df-b54b-4c51-9242-9e18d86587a5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:34.654318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-417373df-b54b-4c51-9242-9e18d86587a5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:34.654799 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-417373df-b54b-4c51-9242-9e18d86587a5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:34.655244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-417373df-b54b-4c51-9242-9e18d86587a5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:34.795246 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-417373df-b54b-4c51-9242-9e18d86587a5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:34.802840 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-417373df-b54b-4c51-9242-9e18d86587a5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1318 microversion: 2.1 time: 0.162331 Aug 04 17:53:34.803777 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3416/6863] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:34 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:35.824317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d6e2a8f3-0dca-4f7d-8766-a7463abb62c1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:35.824873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d6e2a8f3-0dca-4f7d-8766-a7463abb62c1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:35.831858 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6e2a8f3-0dca-4f7d-8766-a7463abb62c1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:35.832360 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6e2a8f3-0dca-4f7d-8766-a7463abb62c1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:35.832814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6e2a8f3-0dca-4f7d-8766-a7463abb62c1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:35.833529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6e2a8f3-0dca-4f7d-8766-a7463abb62c1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:35.834021 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6e2a8f3-0dca-4f7d-8766-a7463abb62c1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:35.834493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d6e2a8f3-0dca-4f7d-8766-a7463abb62c1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:35.966891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d6e2a8f3-0dca-4f7d-8766-a7463abb62c1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:35.975147 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d6e2a8f3-0dca-4f7d-8766-a7463abb62c1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1318 microversion: 2.1 time: 0.154952 Aug 04 17:53:35.975729 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3448/6864] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:35 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:36.419144 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-72889710-37c0-4fd1-92a0-6884c272b09a req-d0cee145-982e-4165-b0f6-ec5ebca0c555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a449099e-7e6e-4798-bf5e-8ce5ed065965", "name": "network-vif-plugged", "status": "completed", "tag": "57aef34e-296b-40ca-b2c7-970cd1fae630"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:53:36.429606 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-72889710-37c0-4fd1-92a0-6884c272b09a req-d0cee145-982e-4165-b0f6-ec5ebca0c555 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:36.430137 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-72889710-37c0-4fd1-92a0-6884c272b09a req-d0cee145-982e-4165-b0f6-ec5ebca0c555 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:36.431292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-72889710-37c0-4fd1-92a0-6884c272b09a req-d0cee145-982e-4165-b0f6-ec5ebca0c555 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:36.442954 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-72889710-37c0-4fd1-92a0-6884c272b09a req-d0cee145-982e-4165-b0f6-ec5ebca0c555 service nova] Creating event network-vif-plugged:57aef34e-296b-40ca-b2c7-970cd1fae630 for instance a449099e-7e6e-4798-bf5e-8ce5ed065965 on n-h1-851359-3 Aug 04 17:53:36.448053 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-72889710-37c0-4fd1-92a0-6884c272b09a req-d0cee145-982e-4165-b0f6-ec5ebca0c555 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033213 Aug 04 17:53:36.448662 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3417/6865] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:53:36.995757 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6fb1f6eb-c7bc-449f-b94e-75dfd7166923 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:36.996332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6fb1f6eb-c7bc-449f-b94e-75dfd7166923 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:37.003333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6fb1f6eb-c7bc-449f-b94e-75dfd7166923 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:37.003831 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6fb1f6eb-c7bc-449f-b94e-75dfd7166923 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:37.004279 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6fb1f6eb-c7bc-449f-b94e-75dfd7166923 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:37.004988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6fb1f6eb-c7bc-449f-b94e-75dfd7166923 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:37.005453 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6fb1f6eb-c7bc-449f-b94e-75dfd7166923 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:37.005886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6fb1f6eb-c7bc-449f-b94e-75dfd7166923 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:37.008976 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=97 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:53:37.164044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6fb1f6eb-c7bc-449f-b94e-75dfd7166923 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:37.171880 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6fb1f6eb-c7bc-449f-b94e-75dfd7166923 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1318 microversion: 2.1 time: 0.180813 Aug 04 17:53:37.172450 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3449/6866] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:36 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:38.190684 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:53:38.195012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ed43eea2-f468-4ae2-bd21-734f14314188 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:38.195736 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ed43eea2-f468-4ae2-bd21-734f14314188 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:38.202438 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed43eea2-f468-4ae2-bd21-734f14314188 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:38.202943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed43eea2-f468-4ae2-bd21-734f14314188 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:38.203401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed43eea2-f468-4ae2-bd21-734f14314188 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:38.204115 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed43eea2-f468-4ae2-bd21-734f14314188 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:38.204593 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed43eea2-f468-4ae2-bd21-734f14314188 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:38.205040 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed43eea2-f468-4ae2-bd21-734f14314188 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:38.339203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ed43eea2-f468-4ae2-bd21-734f14314188 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:38.347035 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ed43eea2-f468-4ae2-bd21-734f14314188 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1506 microversion: 2.1 time: 0.158305 Aug 04 17:53:38.347628 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3418/6867] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:38 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:38.367691 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-693be0f2-e313-462d-9818-7d2de2769178 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:38.368358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-693be0f2-e313-462d-9818-7d2de2769178 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:38.370227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:53:38.371056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:53:38.377962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-693be0f2-e313-462d-9818-7d2de2769178 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:38.378479 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-693be0f2-e313-462d-9818-7d2de2769178 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:38.378926 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-693be0f2-e313-462d-9818-7d2de2769178 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:38.379621 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-693be0f2-e313-462d-9818-7d2de2769178 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:38.380081 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-693be0f2-e313-462d-9818-7d2de2769178 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:38.380513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-693be0f2-e313-462d-9818-7d2de2769178 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:38.516316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-693be0f2-e313-462d-9818-7d2de2769178 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:38.523857 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-693be0f2-e313-462d-9818-7d2de2769178 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1506 microversion: 2.1 time: 0.160228 Aug 04 17:53:38.525002 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3450/6868] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:38 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:38.544018 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-359788aa-5b6a-4a91-9b54-1e6d226e6ae4 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:53:38.546322 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-359788aa-5b6a-4a91-9b54-1e6d226e6ae4 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:38.552385 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-359788aa-5b6a-4a91-9b54-1e6d226e6ae4 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:38.552877 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-359788aa-5b6a-4a91-9b54-1e6d226e6ae4 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:38.553324 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-359788aa-5b6a-4a91-9b54-1e6d226e6ae4 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:38.554041 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-359788aa-5b6a-4a91-9b54-1e6d226e6ae4 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:38.554509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-359788aa-5b6a-4a91-9b54-1e6d226e6ae4 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:38.554944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-359788aa-5b6a-4a91-9b54-1e6d226e6ae4 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:38.584268 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-359788aa-5b6a-4a91-9b54-1e6d226e6ae4 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:38.590957 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-359788aa-5b6a-4a91-9b54-1e6d226e6ae4 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Old instance type m1.heat2, new instance type m1.heat {{(pid=131044) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 17:53:38.597779 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-359788aa-5b6a-4a91-9b54-1e6d226e6ae4 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:53:38.598261 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-359788aa-5b6a-4a91-9b54-1e6d226e6ae4 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:53:38.598753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-359788aa-5b6a-4a91-9b54-1e6d226e6ae4 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:53:38.599183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-359788aa-5b6a-4a91-9b54-1e6d226e6ae4 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:53:38.599612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-359788aa-5b6a-4a91-9b54-1e6d226e6ae4 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:53:38.664213 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-359788aa-5b6a-4a91-9b54-1e6d226e6ae4 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "POST /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965/action" status: 202 len: 0 microversion: 2.1 time: 0.124035 Aug 04 17:53:38.665421 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3419/6869] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:53:38 2022] POST /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:53:38.673161 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-60d2bc4c-0789-4c03-b156-902bcebf5119 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:38.673904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-60d2bc4c-0789-4c03-b156-902bcebf5119 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:38.679977 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60d2bc4c-0789-4c03-b156-902bcebf5119 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:38.680486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60d2bc4c-0789-4c03-b156-902bcebf5119 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:38.680935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60d2bc4c-0789-4c03-b156-902bcebf5119 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:38.681662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60d2bc4c-0789-4c03-b156-902bcebf5119 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:38.682160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60d2bc4c-0789-4c03-b156-902bcebf5119 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:38.682628 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60d2bc4c-0789-4c03-b156-902bcebf5119 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:38.843363 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-60d2bc4c-0789-4c03-b156-902bcebf5119 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:38.851143 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-60d2bc4c-0789-4c03-b156-902bcebf5119 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1513 microversion: 2.1 time: 0.181937 Aug 04 17:53:38.851744 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3451/6870] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:38 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1513 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:39.872018 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ad74bcaa-d4e0-4ccc-b195-8ff11782ade1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:39.872573 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ad74bcaa-d4e0-4ccc-b195-8ff11782ade1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:39.879713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad74bcaa-d4e0-4ccc-b195-8ff11782ade1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:39.880220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad74bcaa-d4e0-4ccc-b195-8ff11782ade1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:39.880680 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad74bcaa-d4e0-4ccc-b195-8ff11782ade1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:39.881401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad74bcaa-d4e0-4ccc-b195-8ff11782ade1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:39.881879 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad74bcaa-d4e0-4ccc-b195-8ff11782ade1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:39.882358 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad74bcaa-d4e0-4ccc-b195-8ff11782ade1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:40.018764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ad74bcaa-d4e0-4ccc-b195-8ff11782ade1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:40.022318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:53:40.028088 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ad74bcaa-d4e0-4ccc-b195-8ff11782ade1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1513 microversion: 2.1 time: 0.160567 Aug 04 17:53:40.028689 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3420/6871] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:39 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:41.050180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ffc910c5-b662-4126-9b19-66363873d63b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:41.050837 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ffc910c5-b662-4126-9b19-66363873d63b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:41.058778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ffc910c5-b662-4126-9b19-66363873d63b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:41.059280 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ffc910c5-b662-4126-9b19-66363873d63b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:41.059731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ffc910c5-b662-4126-9b19-66363873d63b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:41.060449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ffc910c5-b662-4126-9b19-66363873d63b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:41.060921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ffc910c5-b662-4126-9b19-66363873d63b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:41.061360 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ffc910c5-b662-4126-9b19-66363873d63b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:41.196472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ffc910c5-b662-4126-9b19-66363873d63b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:41.204439 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ffc910c5-b662-4126-9b19-66363873d63b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1518 microversion: 2.1 time: 0.158450 Aug 04 17:53:41.205017 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3452/6872] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:41 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:42.226714 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-53816b6c-8d3c-44ff-839e-5c25b0941e02 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:42.227384 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-53816b6c-8d3c-44ff-839e-5c25b0941e02 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:42.235177 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53816b6c-8d3c-44ff-839e-5c25b0941e02 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:42.235675 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53816b6c-8d3c-44ff-839e-5c25b0941e02 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:42.236121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53816b6c-8d3c-44ff-839e-5c25b0941e02 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:42.236825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53816b6c-8d3c-44ff-839e-5c25b0941e02 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:42.237293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53816b6c-8d3c-44ff-839e-5c25b0941e02 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:42.237737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53816b6c-8d3c-44ff-839e-5c25b0941e02 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:42.378311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-53816b6c-8d3c-44ff-839e-5c25b0941e02 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:42.386301 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-53816b6c-8d3c-44ff-839e-5c25b0941e02 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1518 microversion: 2.1 time: 0.164009 Aug 04 17:53:42.386870 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3421/6873] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:42 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:43.407223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fb61b915-7605-4cca-be65-86e5db13899f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:43.407869 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fb61b915-7605-4cca-be65-86e5db13899f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:43.415574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fb61b915-7605-4cca-be65-86e5db13899f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:43.416077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fb61b915-7605-4cca-be65-86e5db13899f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:43.416519 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fb61b915-7605-4cca-be65-86e5db13899f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:43.417231 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fb61b915-7605-4cca-be65-86e5db13899f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:43.417694 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fb61b915-7605-4cca-be65-86e5db13899f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:43.418159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fb61b915-7605-4cca-be65-86e5db13899f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:43.567038 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fb61b915-7605-4cca-be65-86e5db13899f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:43.575658 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fb61b915-7605-4cca-be65-86e5db13899f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1518 microversion: 2.1 time: 0.172687 Aug 04 17:53:43.576257 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3453/6874] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:43 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1518 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:44.596969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cbee2556-42b7-4148-8a9c-520db6de12c5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:44.597608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cbee2556-42b7-4148-8a9c-520db6de12c5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:44.605055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbee2556-42b7-4148-8a9c-520db6de12c5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:44.605573 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbee2556-42b7-4148-8a9c-520db6de12c5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:44.606054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbee2556-42b7-4148-8a9c-520db6de12c5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:44.606938 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbee2556-42b7-4148-8a9c-520db6de12c5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:44.607421 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbee2556-42b7-4148-8a9c-520db6de12c5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:44.607904 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbee2556-42b7-4148-8a9c-520db6de12c5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:44.774935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cbee2556-42b7-4148-8a9c-520db6de12c5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:44.783376 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cbee2556-42b7-4148-8a9c-520db6de12c5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1518 microversion: 2.1 time: 0.190111 Aug 04 17:53:44.784441 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3422/6875] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:44 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1518 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:45.804091 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-450d5db9-0b9b-4644-91df-cbb4b3e59e32 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:45.804643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-450d5db9-0b9b-4644-91df-cbb4b3e59e32 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:45.814586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-450d5db9-0b9b-4644-91df-cbb4b3e59e32 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:45.815090 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-450d5db9-0b9b-4644-91df-cbb4b3e59e32 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:45.815547 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-450d5db9-0b9b-4644-91df-cbb4b3e59e32 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:45.816267 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-450d5db9-0b9b-4644-91df-cbb4b3e59e32 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:45.816739 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-450d5db9-0b9b-4644-91df-cbb4b3e59e32 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:45.817184 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-450d5db9-0b9b-4644-91df-cbb4b3e59e32 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:45.950975 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-450d5db9-0b9b-4644-91df-cbb4b3e59e32 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:45.958682 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-450d5db9-0b9b-4644-91df-cbb4b3e59e32 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1518 microversion: 2.1 time: 0.158721 Aug 04 17:53:45.959267 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3454/6876] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:45 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:46.981060 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-08f0ebc8-8c47-4389-a60d-c22e97826b92 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:46.981841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-08f0ebc8-8c47-4389-a60d-c22e97826b92 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:46.990570 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08f0ebc8-8c47-4389-a60d-c22e97826b92 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:46.991069 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08f0ebc8-8c47-4389-a60d-c22e97826b92 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:46.991524 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08f0ebc8-8c47-4389-a60d-c22e97826b92 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:46.992274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08f0ebc8-8c47-4389-a60d-c22e97826b92 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:46.993389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08f0ebc8-8c47-4389-a60d-c22e97826b92 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:46.993842 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08f0ebc8-8c47-4389-a60d-c22e97826b92 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:47.128509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-08f0ebc8-8c47-4389-a60d-c22e97826b92 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:47.136613 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-08f0ebc8-8c47-4389-a60d-c22e97826b92 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1518 microversion: 2.1 time: 0.160164 Aug 04 17:53:47.137195 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3423/6877] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:46 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:48.158125 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e2f031a8-5d36-443c-ad01-e95c87679359 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:48.158747 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e2f031a8-5d36-443c-ad01-e95c87679359 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:48.166240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2f031a8-5d36-443c-ad01-e95c87679359 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:48.166731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2f031a8-5d36-443c-ad01-e95c87679359 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:48.167174 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2f031a8-5d36-443c-ad01-e95c87679359 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:48.167875 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2f031a8-5d36-443c-ad01-e95c87679359 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:48.168337 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2f031a8-5d36-443c-ad01-e95c87679359 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:48.168769 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2f031a8-5d36-443c-ad01-e95c87679359 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:48.302046 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e2f031a8-5d36-443c-ad01-e95c87679359 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:48.309937 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e2f031a8-5d36-443c-ad01-e95c87679359 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1518 microversion: 2.1 time: 0.155691 Aug 04 17:53:48.310547 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3455/6878] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:48 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:49.332022 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-95a46ba7-9272-4219-820e-9dae5f537a06 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:49.332664 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-95a46ba7-9272-4219-820e-9dae5f537a06 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:49.335411 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:53:49.341380 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95a46ba7-9272-4219-820e-9dae5f537a06 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:49.341888 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95a46ba7-9272-4219-820e-9dae5f537a06 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:49.342372 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95a46ba7-9272-4219-820e-9dae5f537a06 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:49.343386 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95a46ba7-9272-4219-820e-9dae5f537a06 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:49.343890 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95a46ba7-9272-4219-820e-9dae5f537a06 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:49.344340 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95a46ba7-9272-4219-820e-9dae5f537a06 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:49.481435 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-95a46ba7-9272-4219-820e-9dae5f537a06 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:49.488905 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-95a46ba7-9272-4219-820e-9dae5f537a06 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1518 microversion: 2.1 time: 0.160923 Aug 04 17:53:49.489479 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3424/6879] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:49 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:50.509634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1c411f5d-9b9f-4d7e-9b7e-1e99993be3e5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:50.510301 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1c411f5d-9b9f-4d7e-9b7e-1e99993be3e5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:50.513110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:53:50.518648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1c411f5d-9b9f-4d7e-9b7e-1e99993be3e5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:50.519137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1c411f5d-9b9f-4d7e-9b7e-1e99993be3e5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:50.519580 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1c411f5d-9b9f-4d7e-9b7e-1e99993be3e5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:50.520276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1c411f5d-9b9f-4d7e-9b7e-1e99993be3e5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:50.520734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1c411f5d-9b9f-4d7e-9b7e-1e99993be3e5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:50.521166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1c411f5d-9b9f-4d7e-9b7e-1e99993be3e5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:50.662704 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1c411f5d-9b9f-4d7e-9b7e-1e99993be3e5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:50.670314 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1c411f5d-9b9f-4d7e-9b7e-1e99993be3e5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1518 microversion: 2.1 time: 0.165112 Aug 04 17:53:50.670903 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3456/6880] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:50 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:51.691156 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-90d59131-a38c-4d2d-921e-a2d3183a9cb6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:51.691795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-90d59131-a38c-4d2d-921e-a2d3183a9cb6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:51.698717 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90d59131-a38c-4d2d-921e-a2d3183a9cb6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:51.699222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90d59131-a38c-4d2d-921e-a2d3183a9cb6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:51.699678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90d59131-a38c-4d2d-921e-a2d3183a9cb6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:51.700391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90d59131-a38c-4d2d-921e-a2d3183a9cb6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:51.700868 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90d59131-a38c-4d2d-921e-a2d3183a9cb6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:51.701316 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90d59131-a38c-4d2d-921e-a2d3183a9cb6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:51.832087 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-90d59131-a38c-4d2d-921e-a2d3183a9cb6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:51.840303 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-90d59131-a38c-4d2d-921e-a2d3183a9cb6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1518 microversion: 2.1 time: 0.153048 Aug 04 17:53:51.840882 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3425/6881] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:51 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:52.861342 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4b948b8c-05e1-4281-bbd6-af1828e420e4 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:52.861866 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4b948b8c-05e1-4281-bbd6-af1828e420e4 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:52.869594 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b948b8c-05e1-4281-bbd6-af1828e420e4 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:52.870168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b948b8c-05e1-4281-bbd6-af1828e420e4 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:52.870597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b948b8c-05e1-4281-bbd6-af1828e420e4 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:52.871316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b948b8c-05e1-4281-bbd6-af1828e420e4 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:52.871788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b948b8c-05e1-4281-bbd6-af1828e420e4 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:52.872232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b948b8c-05e1-4281-bbd6-af1828e420e4 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:53.006382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4b948b8c-05e1-4281-bbd6-af1828e420e4 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:53.015445 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4b948b8c-05e1-4281-bbd6-af1828e420e4 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1518 microversion: 2.1 time: 0.158182 Aug 04 17:53:53.016036 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3457/6882] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:52 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:54.037285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dd5045be-9a97-4d02-a219-a73a494367a0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:54.037847 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dd5045be-9a97-4d02-a219-a73a494367a0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:54.044991 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd5045be-9a97-4d02-a219-a73a494367a0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:54.045496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd5045be-9a97-4d02-a219-a73a494367a0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:54.045955 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd5045be-9a97-4d02-a219-a73a494367a0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:54.046695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd5045be-9a97-4d02-a219-a73a494367a0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:54.047173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd5045be-9a97-4d02-a219-a73a494367a0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:54.047620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd5045be-9a97-4d02-a219-a73a494367a0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:54.181002 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dd5045be-9a97-4d02-a219-a73a494367a0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:54.189136 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dd5045be-9a97-4d02-a219-a73a494367a0 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1518 microversion: 2.1 time: 0.155843 Aug 04 17:53:54.189715 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3426/6883] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:54 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:55.211182 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9d8f993f-c5a6-4f3f-a4e4-29d6b364e486 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:55.212323 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9d8f993f-c5a6-4f3f-a4e4-29d6b364e486 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:55.223207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d8f993f-c5a6-4f3f-a4e4-29d6b364e486 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:55.223711 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d8f993f-c5a6-4f3f-a4e4-29d6b364e486 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:55.225175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d8f993f-c5a6-4f3f-a4e4-29d6b364e486 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:55.225175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d8f993f-c5a6-4f3f-a4e4-29d6b364e486 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:55.225355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d8f993f-c5a6-4f3f-a4e4-29d6b364e486 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:55.225768 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d8f993f-c5a6-4f3f-a4e4-29d6b364e486 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:55.367938 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9d8f993f-c5a6-4f3f-a4e4-29d6b364e486 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:55.375704 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9d8f993f-c5a6-4f3f-a4e4-29d6b364e486 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1518 microversion: 2.1 time: 0.169394 Aug 04 17:53:55.376279 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3458/6884] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:55 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:56.401080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5d528563-8edc-405b-b1d8-1c0f7b8868aa tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:56.401714 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5d528563-8edc-405b-b1d8-1c0f7b8868aa tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:56.409602 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d528563-8edc-405b-b1d8-1c0f7b8868aa tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:56.410133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d528563-8edc-405b-b1d8-1c0f7b8868aa tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:56.410586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d528563-8edc-405b-b1d8-1c0f7b8868aa tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:56.411295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d528563-8edc-405b-b1d8-1c0f7b8868aa tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:56.411765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d528563-8edc-405b-b1d8-1c0f7b8868aa tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:56.412204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d528563-8edc-405b-b1d8-1c0f7b8868aa tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:56.547799 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5d528563-8edc-405b-b1d8-1c0f7b8868aa tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:56.555702 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5d528563-8edc-405b-b1d8-1c0f7b8868aa tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1518 microversion: 2.1 time: 0.159236 Aug 04 17:53:56.556281 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3427/6885] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:56 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:57.576766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4172b67e-cb36-4997-81db-2154ad64187b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:57.577399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4172b67e-cb36-4997-81db-2154ad64187b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:57.584340 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4172b67e-cb36-4997-81db-2154ad64187b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:57.584826 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4172b67e-cb36-4997-81db-2154ad64187b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:57.585267 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4172b67e-cb36-4997-81db-2154ad64187b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:57.585966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4172b67e-cb36-4997-81db-2154ad64187b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:57.586933 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4172b67e-cb36-4997-81db-2154ad64187b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:57.587370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4172b67e-cb36-4997-81db-2154ad64187b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:57.718330 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4172b67e-cb36-4997-81db-2154ad64187b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:57.726045 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4172b67e-cb36-4997-81db-2154ad64187b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1518 microversion: 2.1 time: 0.153229 Aug 04 17:53:57.726629 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3459/6886] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:57 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:58.747751 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8d8dc8a8-842e-4bf3-8f7b-fd3f7b57981f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:58.748396 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8d8dc8a8-842e-4bf3-8f7b-fd3f7b57981f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:58.755374 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d8dc8a8-842e-4bf3-8f7b-fd3f7b57981f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:58.755883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d8dc8a8-842e-4bf3-8f7b-fd3f7b57981f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:58.756344 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d8dc8a8-842e-4bf3-8f7b-fd3f7b57981f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:58.757067 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d8dc8a8-842e-4bf3-8f7b-fd3f7b57981f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:58.757548 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d8dc8a8-842e-4bf3-8f7b-fd3f7b57981f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:58.758178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d8dc8a8-842e-4bf3-8f7b-fd3f7b57981f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:58.892323 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8d8dc8a8-842e-4bf3-8f7b-fd3f7b57981f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:53:58.900017 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8d8dc8a8-842e-4bf3-8f7b-fd3f7b57981f tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1518 microversion: 2.1 time: 0.156267 Aug 04 17:53:58.900585 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3428/6887] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:58 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:53:59.921359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-24006c66-71af-4384-a99d-7912dd90f3b3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:53:59.922004 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-24006c66-71af-4384-a99d-7912dd90f3b3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:53:59.929135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-24006c66-71af-4384-a99d-7912dd90f3b3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:59.929624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-24006c66-71af-4384-a99d-7912dd90f3b3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:59.930605 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-24006c66-71af-4384-a99d-7912dd90f3b3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:53:59.931322 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-24006c66-71af-4384-a99d-7912dd90f3b3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:53:59.931789 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-24006c66-71af-4384-a99d-7912dd90f3b3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:53:59.932228 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-24006c66-71af-4384-a99d-7912dd90f3b3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:00.069966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-24006c66-71af-4384-a99d-7912dd90f3b3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:54:00.078513 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-24006c66-71af-4384-a99d-7912dd90f3b3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1518 microversion: 2.1 time: 0.161190 Aug 04 17:54:00.079241 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3460/6888] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:53:59 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:54:01.099369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1dff0b12-6413-4292-82ac-ebc9dd9a1640 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:01.102360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1dff0b12-6413-4292-82ac-ebc9dd9a1640 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:01.107003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dff0b12-6413-4292-82ac-ebc9dd9a1640 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:01.107509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dff0b12-6413-4292-82ac-ebc9dd9a1640 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:01.107967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dff0b12-6413-4292-82ac-ebc9dd9a1640 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:01.108693 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dff0b12-6413-4292-82ac-ebc9dd9a1640 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:01.109167 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dff0b12-6413-4292-82ac-ebc9dd9a1640 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:01.109612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dff0b12-6413-4292-82ac-ebc9dd9a1640 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:01.251167 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1dff0b12-6413-4292-82ac-ebc9dd9a1640 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:54:01.259627 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1dff0b12-6413-4292-82ac-ebc9dd9a1640 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1518 microversion: 2.1 time: 0.164161 Aug 04 17:54:01.260219 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3429/6889] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:54:01 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:54:02.280859 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fe462ace-a0e7-4c3e-83a5-fecc18adf01b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:02.281492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fe462ace-a0e7-4c3e-83a5-fecc18adf01b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:02.288447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fe462ace-a0e7-4c3e-83a5-fecc18adf01b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:02.288957 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fe462ace-a0e7-4c3e-83a5-fecc18adf01b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:02.289414 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fe462ace-a0e7-4c3e-83a5-fecc18adf01b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:02.290246 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fe462ace-a0e7-4c3e-83a5-fecc18adf01b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:02.291007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fe462ace-a0e7-4c3e-83a5-fecc18adf01b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:02.291552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fe462ace-a0e7-4c3e-83a5-fecc18adf01b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:02.436208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fe462ace-a0e7-4c3e-83a5-fecc18adf01b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:54:02.443841 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fe462ace-a0e7-4c3e-83a5-fecc18adf01b tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1518 microversion: 2.1 time: 0.166991 Aug 04 17:54:02.444419 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3461/6890] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:54:02 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:54:03.466701 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a3a34c69-5e43-49f3-8690-592fcee9fe78 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:03.467340 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a3a34c69-5e43-49f3-8690-592fcee9fe78 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:03.474633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3a34c69-5e43-49f3-8690-592fcee9fe78 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:03.475136 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3a34c69-5e43-49f3-8690-592fcee9fe78 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:03.475593 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3a34c69-5e43-49f3-8690-592fcee9fe78 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:03.476319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3a34c69-5e43-49f3-8690-592fcee9fe78 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:03.476793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3a34c69-5e43-49f3-8690-592fcee9fe78 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:03.477241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3a34c69-5e43-49f3-8690-592fcee9fe78 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:03.611812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a3a34c69-5e43-49f3-8690-592fcee9fe78 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:54:03.620041 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a3a34c69-5e43-49f3-8690-592fcee9fe78 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1518 microversion: 2.1 time: 0.157291 Aug 04 17:54:03.620629 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3430/6891] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:54:03 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:54:04.640836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a1465975-dff5-490c-8b7d-dbdafa694952 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:04.641464 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a1465975-dff5-490c-8b7d-dbdafa694952 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:04.648957 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a1465975-dff5-490c-8b7d-dbdafa694952 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:04.649459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a1465975-dff5-490c-8b7d-dbdafa694952 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:04.649907 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a1465975-dff5-490c-8b7d-dbdafa694952 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:04.650684 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a1465975-dff5-490c-8b7d-dbdafa694952 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:04.651152 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a1465975-dff5-490c-8b7d-dbdafa694952 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:04.651586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a1465975-dff5-490c-8b7d-dbdafa694952 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:04.798728 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a1465975-dff5-490c-8b7d-dbdafa694952 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:54:04.806264 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a1465975-dff5-490c-8b7d-dbdafa694952 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1518 microversion: 2.1 time: 0.169345 Aug 04 17:54:04.806886 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3462/6892] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:54:04 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:54:05.827302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8798dfbe-f980-4558-a4f1-b91e1aa653a6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:05.827889 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8798dfbe-f980-4558-a4f1-b91e1aa653a6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:05.834790 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8798dfbe-f980-4558-a4f1-b91e1aa653a6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:05.835296 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8798dfbe-f980-4558-a4f1-b91e1aa653a6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:05.835750 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8798dfbe-f980-4558-a4f1-b91e1aa653a6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:05.836960 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8798dfbe-f980-4558-a4f1-b91e1aa653a6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:05.837433 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8798dfbe-f980-4558-a4f1-b91e1aa653a6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:05.837876 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8798dfbe-f980-4558-a4f1-b91e1aa653a6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:05.965652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8798dfbe-f980-4558-a4f1-b91e1aa653a6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:54:05.973744 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8798dfbe-f980-4558-a4f1-b91e1aa653a6 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1518 microversion: 2.1 time: 0.150445 Aug 04 17:54:05.974363 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3431/6893] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:54:05 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:54:06.995831 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7b2d96d7-740f-4088-b3fa-069bd703334c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:06.996421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7b2d96d7-740f-4088-b3fa-069bd703334c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:07.003235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b2d96d7-740f-4088-b3fa-069bd703334c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:07.003726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b2d96d7-740f-4088-b3fa-069bd703334c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:07.004168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b2d96d7-740f-4088-b3fa-069bd703334c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:07.004868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b2d96d7-740f-4088-b3fa-069bd703334c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:07.005327 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b2d96d7-740f-4088-b3fa-069bd703334c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:07.005761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7b2d96d7-740f-4088-b3fa-069bd703334c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:07.020379 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=86 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:54:07.140350 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7b2d96d7-740f-4088-b3fa-069bd703334c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:54:07.148840 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7b2d96d7-740f-4088-b3fa-069bd703334c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1518 microversion: 2.1 time: 0.157505 Aug 04 17:54:07.149452 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3463/6894] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:54:06 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:54:08.169111 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-64cc15ae-0dbb-4de2-bd31-2b30341ce326 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:08.169653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-64cc15ae-0dbb-4de2-bd31-2b30341ce326 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:08.176776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64cc15ae-0dbb-4de2-bd31-2b30341ce326 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:08.177283 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64cc15ae-0dbb-4de2-bd31-2b30341ce326 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:08.177739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64cc15ae-0dbb-4de2-bd31-2b30341ce326 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:08.178506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64cc15ae-0dbb-4de2-bd31-2b30341ce326 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:08.178986 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64cc15ae-0dbb-4de2-bd31-2b30341ce326 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:08.179432 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64cc15ae-0dbb-4de2-bd31-2b30341ce326 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:08.346089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-25e67983-6c1e-40c6-9cb4-8f8f7a384027 req-5bac85b1-4941-4091-84c3-5100c0a9107f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a449099e-7e6e-4798-bf5e-8ce5ed065965", "name": "network-vif-unplugged", "status": "completed", "tag": "57aef34e-296b-40ca-b2c7-970cd1fae630"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:54:08.356639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-25e67983-6c1e-40c6-9cb4-8f8f7a384027 req-5bac85b1-4941-4091-84c3-5100c0a9107f service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:08.357519 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-25e67983-6c1e-40c6-9cb4-8f8f7a384027 req-5bac85b1-4941-4091-84c3-5100c0a9107f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:08.358000 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-25e67983-6c1e-40c6-9cb4-8f8f7a384027 req-5bac85b1-4941-4091-84c3-5100c0a9107f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:08.370342 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-25e67983-6c1e-40c6-9cb4-8f8f7a384027 req-5bac85b1-4941-4091-84c3-5100c0a9107f service nova] Creating event network-vif-unplugged:57aef34e-296b-40ca-b2c7-970cd1fae630 for instance a449099e-7e6e-4798-bf5e-8ce5ed065965 on n-h2-851359-3 Aug 04 17:54:08.378540 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-64cc15ae-0dbb-4de2-bd31-2b30341ce326 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:54:08.387265 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-64cc15ae-0dbb-4de2-bd31-2b30341ce326 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1517 microversion: 2.1 time: 0.222355 Aug 04 17:54:08.387865 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3432/6895] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:54:08 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1517 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:54:08.389220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [req-25e67983-6c1e-40c6-9cb4-8f8f7a384027 req-5bac85b1-4941-4091-84c3-5100c0a9107f service nova] Instance a449099e-7e6e-4798-bf5e-8ce5ed065965 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:54:08.400922 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-25e67983-6c1e-40c6-9cb4-8f8f7a384027 req-5bac85b1-4941-4091-84c3-5100c0a9107f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059005 Aug 04 17:54:08.401587 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3464/6896] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:54:09.408871 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5ccc05c9-3643-4f29-b5e4-4156a22e226c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:09.409501 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5ccc05c9-3643-4f29-b5e4-4156a22e226c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:09.417171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ccc05c9-3643-4f29-b5e4-4156a22e226c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:09.417801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ccc05c9-3643-4f29-b5e4-4156a22e226c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:09.418289 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ccc05c9-3643-4f29-b5e4-4156a22e226c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:09.419455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ccc05c9-3643-4f29-b5e4-4156a22e226c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:09.419969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ccc05c9-3643-4f29-b5e4-4156a22e226c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:09.420659 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ccc05c9-3643-4f29-b5e4-4156a22e226c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:09.557501 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5ccc05c9-3643-4f29-b5e4-4156a22e226c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:54:09.565498 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5ccc05c9-3643-4f29-b5e4-4156a22e226c tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1515 microversion: 2.1 time: 0.160513 Aug 04 17:54:09.566106 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3433/6897] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:54:09 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:54:10.418677 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-61c0b5ac-40c2-4a07-9e77-170b8a6932bd req-be050b94-6468-489d-b29b-b1ea84c18b65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a449099e-7e6e-4798-bf5e-8ce5ed065965", "tag": "57aef34e-296b-40ca-b2c7-970cd1fae630"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:54:10.428797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-61c0b5ac-40c2-4a07-9e77-170b8a6932bd req-be050b94-6468-489d-b29b-b1ea84c18b65 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:10.429283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-61c0b5ac-40c2-4a07-9e77-170b8a6932bd req-be050b94-6468-489d-b29b-b1ea84c18b65 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:10.430260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-61c0b5ac-40c2-4a07-9e77-170b8a6932bd req-be050b94-6468-489d-b29b-b1ea84c18b65 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:10.442715 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-61c0b5ac-40c2-4a07-9e77-170b8a6932bd req-be050b94-6468-489d-b29b-b1ea84c18b65 service nova] Creating event network-changed:57aef34e-296b-40ca-b2c7-970cd1fae630 for instance a449099e-7e6e-4798-bf5e-8ce5ed065965 on n-h2-851359-3 Aug 04 17:54:10.449537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [req-61c0b5ac-40c2-4a07-9e77-170b8a6932bd req-be050b94-6468-489d-b29b-b1ea84c18b65 service nova] Instance a449099e-7e6e-4798-bf5e-8ce5ed065965 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:54:10.460690 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-61c0b5ac-40c2-4a07-9e77-170b8a6932bd req-be050b94-6468-489d-b29b-b1ea84c18b65 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047093 Aug 04 17:54:10.461299 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3465/6898] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:54:10.589228 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f551aed6-c61c-481f-a3ad-3634568d9861 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:10.590006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f551aed6-c61c-481f-a3ad-3634568d9861 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:10.599594 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f551aed6-c61c-481f-a3ad-3634568d9861 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:10.600204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f551aed6-c61c-481f-a3ad-3634568d9861 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:10.600673 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f551aed6-c61c-481f-a3ad-3634568d9861 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:10.601415 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f551aed6-c61c-481f-a3ad-3634568d9861 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:10.601920 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f551aed6-c61c-481f-a3ad-3634568d9861 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:10.602405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f551aed6-c61c-481f-a3ad-3634568d9861 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:10.816718 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f551aed6-c61c-481f-a3ad-3634568d9861 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:54:10.824434 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f551aed6-c61c-481f-a3ad-3634568d9861 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1515 microversion: 2.1 time: 0.239092 Aug 04 17:54:10.825037 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3434/6899] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:54:10 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1515 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:54:11.846572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5d7b2948-5eeb-4117-9df6-7018d9ce7b7a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:11.847285 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5d7b2948-5eeb-4117-9df6-7018d9ce7b7a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:11.854332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d7b2948-5eeb-4117-9df6-7018d9ce7b7a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:11.854839 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d7b2948-5eeb-4117-9df6-7018d9ce7b7a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:11.855313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d7b2948-5eeb-4117-9df6-7018d9ce7b7a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:11.856015 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d7b2948-5eeb-4117-9df6-7018d9ce7b7a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:11.856487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d7b2948-5eeb-4117-9df6-7018d9ce7b7a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:11.856930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d7b2948-5eeb-4117-9df6-7018d9ce7b7a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:12.444556 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5d7b2948-5eeb-4117-9df6-7018d9ce7b7a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:54:12.452797 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5d7b2948-5eeb-4117-9df6-7018d9ce7b7a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1515 microversion: 2.1 time: 0.611730 Aug 04 17:54:12.453380 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3466/6900] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:54:11 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1515 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:54:13.474359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f02ffef6-1b5c-47fa-802b-09f2d7d0143a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:13.474926 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f02ffef6-1b5c-47fa-802b-09f2d7d0143a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:13.482647 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f02ffef6-1b5c-47fa-802b-09f2d7d0143a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:13.483155 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f02ffef6-1b5c-47fa-802b-09f2d7d0143a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:13.483611 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f02ffef6-1b5c-47fa-802b-09f2d7d0143a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:13.484333 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f02ffef6-1b5c-47fa-802b-09f2d7d0143a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:13.484812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f02ffef6-1b5c-47fa-802b-09f2d7d0143a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:13.485281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f02ffef6-1b5c-47fa-802b-09f2d7d0143a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:13.488046 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=85 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:54:13.619678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f02ffef6-1b5c-47fa-802b-09f2d7d0143a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:54:13.627436 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f02ffef6-1b5c-47fa-802b-09f2d7d0143a tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1512 microversion: 2.1 time: 0.157130 Aug 04 17:54:13.628015 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3435/6901] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:54:13 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:54:13.647620 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-028e697b-d001-4d24-84db-71b5258f5d61 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:54:13.648638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-028e697b-d001-4d24-84db-71b5258f5d61 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:13.655587 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-028e697b-d001-4d24-84db-71b5258f5d61 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:13.656082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-028e697b-d001-4d24-84db-71b5258f5d61 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:13.656532 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-028e697b-d001-4d24-84db-71b5258f5d61 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:13.657236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-028e697b-d001-4d24-84db-71b5258f5d61 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:13.657705 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-028e697b-d001-4d24-84db-71b5258f5d61 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:13.658173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-028e697b-d001-4d24-84db-71b5258f5d61 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:13.717308 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-028e697b-d001-4d24-84db-71b5258f5d61 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "POST /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965/action" status: 204 len: 0 microversion: 2.1 time: 0.073534 Aug 04 17:54:13.718300 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3467/6902] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:54:13 2022] POST /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:54:13.726517 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ea061581-8c71-43d9-b411-72179a6b5a58 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:13.727051 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ea061581-8c71-43d9-b411-72179a6b5a58 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:13.732962 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea061581-8c71-43d9-b411-72179a6b5a58 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:13.733468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea061581-8c71-43d9-b411-72179a6b5a58 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:13.733913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea061581-8c71-43d9-b411-72179a6b5a58 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:13.734683 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea061581-8c71-43d9-b411-72179a6b5a58 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:13.735150 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea061581-8c71-43d9-b411-72179a6b5a58 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:13.735586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea061581-8c71-43d9-b411-72179a6b5a58 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:13.956985 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ea061581-8c71-43d9-b411-72179a6b5a58 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:54:13.965382 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ea061581-8c71-43d9-b411-72179a6b5a58 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1512 microversion: 2.1 time: 0.242902 Aug 04 17:54:13.965963 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3436/6903] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:54:13 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1512 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:54:14.821721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-394059ad-5a70-4817-bb44-ae70305c8ee2 req-9b519be9-84e2-4be9-9f03-560fdf03c59e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a449099e-7e6e-4798-bf5e-8ce5ed065965", "name": "network-vif-plugged", "status": "completed", "tag": "57aef34e-296b-40ca-b2c7-970cd1fae630"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:54:14.832142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-394059ad-5a70-4817-bb44-ae70305c8ee2 req-9b519be9-84e2-4be9-9f03-560fdf03c59e service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:14.832635 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-394059ad-5a70-4817-bb44-ae70305c8ee2 req-9b519be9-84e2-4be9-9f03-560fdf03c59e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:14.833075 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-394059ad-5a70-4817-bb44-ae70305c8ee2 req-9b519be9-84e2-4be9-9f03-560fdf03c59e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:14.845792 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-394059ad-5a70-4817-bb44-ae70305c8ee2 req-9b519be9-84e2-4be9-9f03-560fdf03c59e service nova] Creating event network-vif-plugged:57aef34e-296b-40ca-b2c7-970cd1fae630 for instance a449099e-7e6e-4798-bf5e-8ce5ed065965 on n-h2-851359-3 Aug 04 17:54:14.851488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [req-394059ad-5a70-4817-bb44-ae70305c8ee2 req-9b519be9-84e2-4be9-9f03-560fdf03c59e service nova] Instance a449099e-7e6e-4798-bf5e-8ce5ed065965 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:54:14.862943 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-394059ad-5a70-4817-bb44-ae70305c8ee2 req-9b519be9-84e2-4be9-9f03-560fdf03c59e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046765 Aug 04 17:54:14.864073 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3468/6904] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:54:14.987707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e5d388ce-3aab-46ea-acb1-8e17320efe19 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:14.988437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e5d388ce-3aab-46ea-acb1-8e17320efe19 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:14.996142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5d388ce-3aab-46ea-acb1-8e17320efe19 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:14.996748 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5d388ce-3aab-46ea-acb1-8e17320efe19 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:14.997210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5d388ce-3aab-46ea-acb1-8e17320efe19 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:14.997953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5d388ce-3aab-46ea-acb1-8e17320efe19 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:14.998451 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5d388ce-3aab-46ea-acb1-8e17320efe19 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:14.998898 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5d388ce-3aab-46ea-acb1-8e17320efe19 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:15.157710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e5d388ce-3aab-46ea-acb1-8e17320efe19 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:54:15.166770 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e5d388ce-3aab-46ea-acb1-8e17320efe19 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1504 microversion: 2.1 time: 0.183690 Aug 04 17:54:15.167351 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3437/6905] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:54:14 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1504 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:54:15.188556 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8fb76249-83ad-4999-bb7d-eea1537cdff3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:15.189399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8fb76249-83ad-4999-bb7d-eea1537cdff3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:15.195929 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fb76249-83ad-4999-bb7d-eea1537cdff3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:15.196509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fb76249-83ad-4999-bb7d-eea1537cdff3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:15.197032 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fb76249-83ad-4999-bb7d-eea1537cdff3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:15.197895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fb76249-83ad-4999-bb7d-eea1537cdff3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:15.198459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fb76249-83ad-4999-bb7d-eea1537cdff3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:15.198958 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8fb76249-83ad-4999-bb7d-eea1537cdff3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:15.340165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8fb76249-83ad-4999-bb7d-eea1537cdff3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:54:15.347987 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8fb76249-83ad-4999-bb7d-eea1537cdff3 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1504 microversion: 2.1 time: 0.163753 Aug 04 17:54:15.348575 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3469/6906] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:54:15 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:54:15.368687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-acac9ebe-3b58-436c-a6c6-19b62ec42720 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:15.369324 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-acac9ebe-3b58-436c-a6c6-19b62ec42720 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:15.375440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acac9ebe-3b58-436c-a6c6-19b62ec42720 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:15.375941 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acac9ebe-3b58-436c-a6c6-19b62ec42720 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:15.376397 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acac9ebe-3b58-436c-a6c6-19b62ec42720 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:15.377138 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acac9ebe-3b58-436c-a6c6-19b62ec42720 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:15.377608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acac9ebe-3b58-436c-a6c6-19b62ec42720 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:15.378132 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acac9ebe-3b58-436c-a6c6-19b62ec42720 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:15.512267 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-acac9ebe-3b58-436c-a6c6-19b62ec42720 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:54:15.521299 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-acac9ebe-3b58-436c-a6c6-19b62ec42720 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1504 microversion: 2.1 time: 0.157072 Aug 04 17:54:15.521890 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3438/6907] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:54:15 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:54:15.545186 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-44b5308b-cbd7-42b2-a03e-ae9f68d0f643 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:15.547039 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-44b5308b-cbd7-42b2-a03e-ae9f68d0f643 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:15.553302 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-44b5308b-cbd7-42b2-a03e-ae9f68d0f643 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:15.553871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-44b5308b-cbd7-42b2-a03e-ae9f68d0f643 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:15.555035 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-44b5308b-cbd7-42b2-a03e-ae9f68d0f643 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:15.555939 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-44b5308b-cbd7-42b2-a03e-ae9f68d0f643 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:15.556411 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-44b5308b-cbd7-42b2-a03e-ae9f68d0f643 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:15.557080 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-44b5308b-cbd7-42b2-a03e-ae9f68d0f643 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:15.583590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-44b5308b-cbd7-42b2-a03e-ae9f68d0f643 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:54:15.661337 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-44b5308b-cbd7-42b2-a03e-ae9f68d0f643 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "DELETE /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 204 len: 0 microversion: 2.1 time: 0.123289 Aug 04 17:54:15.662229 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3470/6908] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:54:15 2022] DELETE /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:54:15.677009 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9e8fff9b-cd08-4454-a587-19a24ca477e2 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:15.677557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9e8fff9b-cd08-4454-a587-19a24ca477e2 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:15.683750 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e8fff9b-cd08-4454-a587-19a24ca477e2 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:15.684261 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e8fff9b-cd08-4454-a587-19a24ca477e2 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:15.684719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e8fff9b-cd08-4454-a587-19a24ca477e2 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:15.685431 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e8fff9b-cd08-4454-a587-19a24ca477e2 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:15.685906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e8fff9b-cd08-4454-a587-19a24ca477e2 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:15.686375 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e8fff9b-cd08-4454-a587-19a24ca477e2 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:15.712302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9e8fff9b-cd08-4454-a587-19a24ca477e2 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:54:15.757696 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.compute.api [None req-9e8fff9b-cd08-4454-a587-19a24ca477e2 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Instance is already in deleting state, ignoring this request Aug 04 17:54:15.758765 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9e8fff9b-cd08-4454-a587-19a24ca477e2 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "DELETE /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 204 len: 0 microversion: 2.1 time: 0.085871 Aug 04 17:54:15.759349 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3439/6909] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:54:15 2022] DELETE /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:54:15.768127 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-052cca93-ef6e-4d0c-8005-777f1f2f2650 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:15.768870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-052cca93-ef6e-4d0c-8005-777f1f2f2650 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:15.775431 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-052cca93-ef6e-4d0c-8005-777f1f2f2650 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:15.775927 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-052cca93-ef6e-4d0c-8005-777f1f2f2650 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:15.776377 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-052cca93-ef6e-4d0c-8005-777f1f2f2650 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:15.777078 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-052cca93-ef6e-4d0c-8005-777f1f2f2650 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:15.777540 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-052cca93-ef6e-4d0c-8005-777f1f2f2650 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:15.777988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-052cca93-ef6e-4d0c-8005-777f1f2f2650 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:15.910455 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-052cca93-ef6e-4d0c-8005-777f1f2f2650 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:54:15.918821 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-052cca93-ef6e-4d0c-8005-777f1f2f2650 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1510 microversion: 2.1 time: 0.155072 Aug 04 17:54:15.919407 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3471/6910] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:54:15 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:54:16.939616 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fe888f2a-3015-49c6-b427-6a00ff437c33 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:16.940253 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fe888f2a-3015-49c6-b427-6a00ff437c33 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:16.947649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe888f2a-3015-49c6-b427-6a00ff437c33 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:16.948141 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe888f2a-3015-49c6-b427-6a00ff437c33 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:16.948593 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe888f2a-3015-49c6-b427-6a00ff437c33 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:16.949292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe888f2a-3015-49c6-b427-6a00ff437c33 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:16.949763 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe888f2a-3015-49c6-b427-6a00ff437c33 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:16.950233 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe888f2a-3015-49c6-b427-6a00ff437c33 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:17.084307 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fe888f2a-3015-49c6-b427-6a00ff437c33 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0043a0e11d59421c82b927e823764bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479c5566b5a24b47bd9b3ff2de850c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:54:17.091986 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fe888f2a-3015-49c6-b427-6a00ff437c33 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 200 len: 1510 microversion: 2.1 time: 0.156367 Aug 04 17:54:17.092566 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3440/6911] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:54:16 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:54:17.699303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-13ad08c4-31f1-4e06-8225-7c81a78aad0c req-269cf8cd-cfec-47ad-bf1a-3931ecf93098 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a449099e-7e6e-4798-bf5e-8ce5ed065965", "name": "network-vif-deleted", "tag": "57aef34e-296b-40ca-b2c7-970cd1fae630"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:54:17.713951 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-13ad08c4-31f1-4e06-8225-7c81a78aad0c req-269cf8cd-cfec-47ad-bf1a-3931ecf93098 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:17.714469 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-13ad08c4-31f1-4e06-8225-7c81a78aad0c req-269cf8cd-cfec-47ad-bf1a-3931ecf93098 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:17.715637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-13ad08c4-31f1-4e06-8225-7c81a78aad0c req-269cf8cd-cfec-47ad-bf1a-3931ecf93098 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:17.730484 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-13ad08c4-31f1-4e06-8225-7c81a78aad0c req-269cf8cd-cfec-47ad-bf1a-3931ecf93098 service nova] Creating event network-vif-deleted:57aef34e-296b-40ca-b2c7-970cd1fae630 for instance a449099e-7e6e-4798-bf5e-8ce5ed065965 on n-h2-851359-3 Aug 04 17:54:17.737138 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-13ad08c4-31f1-4e06-8225-7c81a78aad0c req-269cf8cd-cfec-47ad-bf1a-3931ecf93098 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042413 Aug 04 17:54:17.737867 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3472/6912] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:54:18.117894 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e6b9ecfe-5c4b-4a56-aaf8-777735154bf1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:18.118465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e6b9ecfe-5c4b-4a56-aaf8-777735154bf1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: a449099e-7e6e-4798-bf5e-8ce5ed065965] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:18.125290 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6b9ecfe-5c4b-4a56-aaf8-777735154bf1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:18.125782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6b9ecfe-5c4b-4a56-aaf8-777735154bf1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:18.126261 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6b9ecfe-5c4b-4a56-aaf8-777735154bf1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:18.126966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6b9ecfe-5c4b-4a56-aaf8-777735154bf1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:18.127431 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6b9ecfe-5c4b-4a56-aaf8-777735154bf1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:18.127867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6b9ecfe-5c4b-4a56-aaf8-777735154bf1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:18.141861 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-e6b9ecfe-5c4b-4a56-aaf8-777735154bf1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] HTTP exception thrown: Instance a449099e-7e6e-4798-bf5e-8ce5ed065965 could not be found. Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e6b9ecfe-5c4b-4a56-aaf8-777735154bf1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Request method failure captured: Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 HTTP/1.1 Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7Adk6h0Aln9xI2WcQd0eWSVAZ1HpkahsZLZSBT1Ar8PllJaCvYmVGH7pqgrzVXbnLX4IpPPVnLvPjasU7zOj4W3p4sU5L7K8THttqmEmv6WhSO9TLkmLL6ZqIr4NvWnysRHCzceEmFcXf-woF2on0-E1_46QITd36lTQrTsXp2r6tKA Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 479c5566b5a24b47bd9b3ff2de850c3f Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerDiskConfigTestJSON-821570601 Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/479c5566b5a24b47bd9b3ff2de850c3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/479c5566b5a24b47bd9b3ff2de850c3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_479c5566b5a24b47bd9b3ff2de850c3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/479c5566b5a24b47bd9b3ff2de850c3f"}]}] Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServerDiskConfigTestJSON-821570601 Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 479c5566b5a24b47bd9b3ff2de850c3f Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-821570601 Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServerDiskConfigTestJSON-821570601-project Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 0043a0e11d59421c82b927e823764bda Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServerDiskConfigTestJSON-821570601-project Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance a449099e-7e6e-4798-bf5e-8ce5ed065965 could not be found. Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'a449099e-7e6e-4798-bf5e-8ce5ed065965'} Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a449099e-7e6e-4798-bf5e-8ce5ed065965 could not be found. Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a449099e-7e6e-4798-bf5e-8ce5ed065965 could not be found. Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:54:18.143568 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:54:18.147685 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:54:18.147685 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:54:18.147685 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:54:18.147685 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:54:18.147685 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:54:18.147685 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a449099e-7e6e-4798-bf5e-8ce5ed065965 could not be found. Aug 04 17:54:18.147685 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:54:18.147685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e6b9ecfe-5c4b-4a56-aaf8-777735154bf1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Returning 404 to user: Instance a449099e-7e6e-4798-bf5e-8ce5ed065965 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:54:18.147685 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e6b9ecfe-5c4b-4a56-aaf8-777735154bf1 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965" status: 404 len: 111 microversion: 2.1 time: 0.031744 Aug 04 17:54:18.148893 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3441/6913] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:54:18 2022] GET /compute/v2.1/servers/a449099e-7e6e-4798-bf5e-8ce5ed065965 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:54:18.154615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-12ea3b6c-e2f5-4609-9b62-2ff3031f6c42 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '.version_select at 0x7f1e5ac49790>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:18.180423 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-12ea3b6c-e2f5-4609-9b62-2ff3031f6c42 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-579678221" status: 202 len: 0 microversion: 2.1 time: 0.029492 Aug 04 17:54:18.181000 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3473/6914] 10.222.0.93 () {58 vars in 1218 bytes} [Thu Aug 4 17:54:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-579678221 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:54:18.797156 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4989daf9-3acf-4b4c-a9d3-d365c7d92666 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:18.797708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4989daf9-3acf-4b4c-a9d3-d365c7d92666 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:18.803940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4989daf9-3acf-4b4c-a9d3-d365c7d92666 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:18.804440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4989daf9-3acf-4b4c-a9d3-d365c7d92666 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:18.804893 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4989daf9-3acf-4b4c-a9d3-d365c7d92666 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:18.805609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4989daf9-3acf-4b4c-a9d3-d365c7d92666 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:18.806121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4989daf9-3acf-4b4c-a9d3-d365c7d92666 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:18.806569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4989daf9-3acf-4b4c-a9d3-d365c7d92666 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:18.820411 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-4989daf9-3acf-4b4c-a9d3-d365c7d92666 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] HTTP exception thrown: Instance b217f6ed-2122-45de-b6f2-79ce04451536 could not be found. Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4989daf9-3acf-4b4c-a9d3-d365c7d92666 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Request method failure captured: Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 HTTP/1.1 Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7Adk6h0Aln9xI2WcQd0eWSVAZ1HpkahsZLZSBT1Ar8PllJaCvYmVGH7pqgrzVXbnLX4IpPPVnLvPjasU7zOj4W3p4sU5L7K8THttqmEmv6WhSO9TLkmLL6ZqIr4NvWnysRHCzceEmFcXf-woF2on0-E1_46QITd36lTQrTsXp2r6tKA Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 479c5566b5a24b47bd9b3ff2de850c3f Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerDiskConfigTestJSON-821570601 Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/479c5566b5a24b47bd9b3ff2de850c3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/479c5566b5a24b47bd9b3ff2de850c3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_479c5566b5a24b47bd9b3ff2de850c3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/479c5566b5a24b47bd9b3ff2de850c3f"}]}] Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServerDiskConfigTestJSON-821570601 Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 479c5566b5a24b47bd9b3ff2de850c3f Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-821570601 Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServerDiskConfigTestJSON-821570601-project Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 0043a0e11d59421c82b927e823764bda Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServerDiskConfigTestJSON-821570601-project Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance b217f6ed-2122-45de-b6f2-79ce04451536 could not be found. Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'b217f6ed-2122-45de-b6f2-79ce04451536'} Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b217f6ed-2122-45de-b6f2-79ce04451536 could not be found. Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:54:18.822013 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:54:18.825423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b217f6ed-2122-45de-b6f2-79ce04451536 could not be found. Aug 04 17:54:18.825423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:54:18.825423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:54:18.825423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:54:18.825423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:54:18.825423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:54:18.825423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:54:18.825423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:54:18.825423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:54:18.825423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b217f6ed-2122-45de-b6f2-79ce04451536 could not be found. Aug 04 17:54:18.825423 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:54:18.825423 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4989daf9-3acf-4b4c-a9d3-d365c7d92666 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Returning 404 to user: Instance b217f6ed-2122-45de-b6f2-79ce04451536 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:54:18.825423 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4989daf9-3acf-4b4c-a9d3-d365c7d92666 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 404 len: 111 microversion: 2.1 time: 0.030308 Aug 04 17:54:18.825423 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3442/6915] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:54:18 2022] DELETE /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:54:18.833127 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4390f438-b75e-41f8-b783-58e678b638a5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:18.833865 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4390f438-b75e-41f8-b783-58e678b638a5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] [instance: b217f6ed-2122-45de-b6f2-79ce04451536] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:18.841305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4390f438-b75e-41f8-b783-58e678b638a5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:18.841865 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4390f438-b75e-41f8-b783-58e678b638a5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:18.842375 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4390f438-b75e-41f8-b783-58e678b638a5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:18.843333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4390f438-b75e-41f8-b783-58e678b638a5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:18.843794 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4390f438-b75e-41f8-b783-58e678b638a5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:18.844226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4390f438-b75e-41f8-b783-58e678b638a5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:18.858099 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-4390f438-b75e-41f8-b783-58e678b638a5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] HTTP exception thrown: Instance b217f6ed-2122-45de-b6f2-79ce04451536 could not be found. Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4390f438-b75e-41f8-b783-58e678b638a5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Request method failure captured: Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 HTTP/1.1 Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7Adk6h0Aln9xI2WcQd0eWSVAZ1HpkahsZLZSBT1Ar8PllJaCvYmVGH7pqgrzVXbnLX4IpPPVnLvPjasU7zOj4W3p4sU5L7K8THttqmEmv6WhSO9TLkmLL6ZqIr4NvWnysRHCzceEmFcXf-woF2on0-E1_46QITd36lTQrTsXp2r6tKA Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 479c5566b5a24b47bd9b3ff2de850c3f Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerDiskConfigTestJSON-821570601 Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/479c5566b5a24b47bd9b3ff2de850c3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/479c5566b5a24b47bd9b3ff2de850c3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_479c5566b5a24b47bd9b3ff2de850c3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/479c5566b5a24b47bd9b3ff2de850c3f"}]}] Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerDiskConfigTestJSON-821570601 Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 479c5566b5a24b47bd9b3ff2de850c3f Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-821570601 Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerDiskConfigTestJSON-821570601-project Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 0043a0e11d59421c82b927e823764bda Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerDiskConfigTestJSON-821570601-project Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance b217f6ed-2122-45de-b6f2-79ce04451536 could not be found. Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'b217f6ed-2122-45de-b6f2-79ce04451536'} Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b217f6ed-2122-45de-b6f2-79ce04451536 could not be found. Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b217f6ed-2122-45de-b6f2-79ce04451536 could not be found. Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:54:18.859792 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:54:18.864418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:54:18.864418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:54:18.864418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:54:18.864418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:54:18.864418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:54:18.864418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b217f6ed-2122-45de-b6f2-79ce04451536 could not be found. Aug 04 17:54:18.864418 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:54:18.864418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4390f438-b75e-41f8-b783-58e678b638a5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] Returning 404 to user: Instance b217f6ed-2122-45de-b6f2-79ce04451536 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:54:18.864418 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4390f438-b75e-41f8-b783-58e678b638a5 tempest-ServerDiskConfigTestJSON-821570601 tempest-ServerDiskConfigTestJSON-821570601-project] 10.222.0.93 "GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536" status: 404 len: 111 microversion: 2.1 time: 0.032986 Aug 04 17:54:18.864418 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3474/6916] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:54:18 2022] GET /compute/v2.1/servers/b217f6ed-2122-45de-b6f2-79ce04451536 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:54:27.651528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-be3cd00c-9794-48a7-b16e-bbd96a330b39 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Action: 'create', calling method: .version_select at 0x7f1e5ac76af0>, body: {"keypair": {"name": "tempest-keypair-2056900899", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwmRT1LhuhSXTIl1aP1RGRWdbR6LidjGYuVAWDZmlbWOc9Gms+8xtR1ZD082YQCAUPHY2wbe9HJEIbxSKEGphmZjVkV0uSzjSO1j+xr1MTjPB/C8OreGiVgqaHltv9nyw=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:54:27.657778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=38 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:54:27.675793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-be3cd00c-9794-48a7-b16e-bbd96a330b39 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Getting quotas for project c527dc233da14fc5ab203d0489a8653f. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:54:27.685138 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-be3cd00c-9794-48a7-b16e-bbd96a330b39 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Getting quotas for user 5123a91a38cf4524a1d9ae3a0ab45ee2 and project c527dc233da14fc5ab203d0489a8653f. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:54:27.718998 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-be3cd00c-9794-48a7-b16e-bbd96a330b39 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.212908 Aug 04 17:54:27.719429 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3443/6917] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 17:54:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:54:29.235994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-33bb29c8-6082-4af9-b7b6-2bbff6763195 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-119972009", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7adc776d-adf3-4203-a12e-826c1017ffea"}], "security_groups": [{"name": "tempest-securitygroup--1273216019"}], "key_name": "tempest-keypair-2056900899", "user_data": "}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:54:29.246172 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:54:29.246867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:54:29.360945 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-33bb29c8-6082-4af9-b7b6-2bbff6763195 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] validate_networks() for [('7adc776d-adf3-4203-a12e-826c1017ffea', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:54:29.940719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-33bb29c8-6082-4af9-b7b6-2bbff6763195 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:54:29.941951 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-33bb29c8-6082-4af9-b7b6-2bbff6763195 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:54:29.942684 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-33bb29c8-6082-4af9-b7b6-2bbff6763195 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:54:29.944152 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-33bb29c8-6082-4af9-b7b6-2bbff6763195 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:54:29.945534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-33bb29c8-6082-4af9-b7b6-2bbff6763195 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:54:29.959769 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33bb29c8-6082-4af9-b7b6-2bbff6763195 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:29.960417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33bb29c8-6082-4af9-b7b6-2bbff6763195 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:29.960928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33bb29c8-6082-4af9-b7b6-2bbff6763195 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:29.961805 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33bb29c8-6082-4af9-b7b6-2bbff6763195 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:29.962379 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33bb29c8-6082-4af9-b7b6-2bbff6763195 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:29.962959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-33bb29c8-6082-4af9-b7b6-2bbff6763195 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:29.984542 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-33bb29c8-6082-4af9-b7b6-2bbff6763195 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Getting quotas for project c527dc233da14fc5ab203d0489a8653f. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:54:29.990152 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-33bb29c8-6082-4af9-b7b6-2bbff6763195 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Getting quotas for user 5123a91a38cf4524a1d9ae3a0ab45ee2 and project c527dc233da14fc5ab203d0489a8653f. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:54:30.004148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-33bb29c8-6082-4af9-b7b6-2bbff6763195 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:54:30.006499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-33bb29c8-6082-4af9-b7b6-2bbff6763195 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:54:30.060143 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-33bb29c8-6082-4af9-b7b6-2bbff6763195 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.829268 Aug 04 17:54:30.060815 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3475/6918] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:54:29 2022] POST /compute/v2.1/servers => generated 409 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:54:30.069490 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:54:30.074905 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3229ccd8-0007-4a68-b50c-d938a8c6faa7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:30.075861 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3229ccd8-0007-4a68-b50c-d938a8c6faa7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:30.150808 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3229ccd8-0007-4a68-b50c-d938a8c6faa7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:54:30.158567 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3229ccd8-0007-4a68-b50c-d938a8c6faa7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1238 microversion: 2.1 time: 0.090492 Aug 04 17:54:30.159627 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3444/6919] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:54:30 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1238 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:54:31.182210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8e28f96a-7804-4b04-90ac-4176181ecc9e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:31.183525 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8e28f96a-7804-4b04-90ac-4176181ecc9e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:31.196023 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e28f96a-7804-4b04-90ac-4176181ecc9e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:31.196733 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e28f96a-7804-4b04-90ac-4176181ecc9e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:31.197811 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e28f96a-7804-4b04-90ac-4176181ecc9e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:31.198523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e28f96a-7804-4b04-90ac-4176181ecc9e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:31.199163 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e28f96a-7804-4b04-90ac-4176181ecc9e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:31.199678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e28f96a-7804-4b04-90ac-4176181ecc9e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:31.293363 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8e28f96a-7804-4b04-90ac-4176181ecc9e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:54:31.305574 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8e28f96a-7804-4b04-90ac-4176181ecc9e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1298 microversion: 2.1 time: 0.128624 Aug 04 17:54:31.306339 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3476/6920] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:54:31 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1298 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:54:32.328481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-692de65e-1083-4a06-b7ce-ed74a855a4cd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:32.329025 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-692de65e-1083-4a06-b7ce-ed74a855a4cd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:32.336988 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-692de65e-1083-4a06-b7ce-ed74a855a4cd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:32.337507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-692de65e-1083-4a06-b7ce-ed74a855a4cd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:32.337964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-692de65e-1083-4a06-b7ce-ed74a855a4cd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:32.338725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-692de65e-1083-4a06-b7ce-ed74a855a4cd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:32.339203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-692de65e-1083-4a06-b7ce-ed74a855a4cd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:32.339649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-692de65e-1083-4a06-b7ce-ed74a855a4cd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:32.555725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-692de65e-1083-4a06-b7ce-ed74a855a4cd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:54:32.563569 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-692de65e-1083-4a06-b7ce-ed74a855a4cd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1364 microversion: 2.1 time: 0.239213 Aug 04 17:54:32.564168 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3445/6921] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:54:32 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:54:32.859770 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-32a06a90-0c09-4bec-802f-7327c52cd2f2 req-31a7fd9d-070c-4a7f-b819-b3d47696b70f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "561003ab-c65c-4c83-b932-d3de9aedbbb1", "tag": "56974a51-6f27-4d9f-95ea-149dc13e45b2"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:54:32.870314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-32a06a90-0c09-4bec-802f-7327c52cd2f2 req-31a7fd9d-070c-4a7f-b819-b3d47696b70f service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:32.870816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-32a06a90-0c09-4bec-802f-7327c52cd2f2 req-31a7fd9d-070c-4a7f-b819-b3d47696b70f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:32.871443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-32a06a90-0c09-4bec-802f-7327c52cd2f2 req-31a7fd9d-070c-4a7f-b819-b3d47696b70f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:32.884688 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-32a06a90-0c09-4bec-802f-7327c52cd2f2 req-31a7fd9d-070c-4a7f-b819-b3d47696b70f service nova] Creating event network-changed:56974a51-6f27-4d9f-95ea-149dc13e45b2 for instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 on n-h1-851359-3 Aug 04 17:54:32.890193 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-32a06a90-0c09-4bec-802f-7327c52cd2f2 req-31a7fd9d-070c-4a7f-b819-b3d47696b70f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034184 Aug 04 17:54:32.890910 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3477/6922] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:54:33.591074 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-58586c13-277d-4256-b3a6-ff9578ca3b4e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:33.591708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-58586c13-277d-4256-b3a6-ff9578ca3b4e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:33.598815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58586c13-277d-4256-b3a6-ff9578ca3b4e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:33.599314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58586c13-277d-4256-b3a6-ff9578ca3b4e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:33.599762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58586c13-277d-4256-b3a6-ff9578ca3b4e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:33.600484 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58586c13-277d-4256-b3a6-ff9578ca3b4e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:33.601591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58586c13-277d-4256-b3a6-ff9578ca3b4e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:33.602062 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58586c13-277d-4256-b3a6-ff9578ca3b4e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:33.741526 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-58586c13-277d-4256-b3a6-ff9578ca3b4e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:54:33.749071 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-58586c13-277d-4256-b3a6-ff9578ca3b4e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1364 microversion: 2.1 time: 0.161901 Aug 04 17:54:33.749663 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3446/6923] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:54:33 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:54:34.770427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-15363ea2-bfca-4114-9db0-be78ed10461a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:34.771171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-15363ea2-bfca-4114-9db0-be78ed10461a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:34.778269 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-15363ea2-bfca-4114-9db0-be78ed10461a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:34.778766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-15363ea2-bfca-4114-9db0-be78ed10461a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:34.779208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-15363ea2-bfca-4114-9db0-be78ed10461a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:34.779914 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-15363ea2-bfca-4114-9db0-be78ed10461a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:34.780378 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-15363ea2-bfca-4114-9db0-be78ed10461a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:34.780807 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-15363ea2-bfca-4114-9db0-be78ed10461a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:34.919958 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-15363ea2-bfca-4114-9db0-be78ed10461a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:54:34.927573 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-15363ea2-bfca-4114-9db0-be78ed10461a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1364 microversion: 2.1 time: 0.162590 Aug 04 17:54:34.928142 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3478/6924] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:54:34 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:54:35.949582 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5fc5d407-7653-483c-b424-40ba6f463191 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:35.950240 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5fc5d407-7653-483c-b424-40ba6f463191 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:35.957155 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5fc5d407-7653-483c-b424-40ba6f463191 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:35.957658 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5fc5d407-7653-483c-b424-40ba6f463191 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:35.958151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5fc5d407-7653-483c-b424-40ba6f463191 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:35.958868 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5fc5d407-7653-483c-b424-40ba6f463191 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:35.959347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5fc5d407-7653-483c-b424-40ba6f463191 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:35.959794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5fc5d407-7653-483c-b424-40ba6f463191 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:36.091670 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5fc5d407-7653-483c-b424-40ba6f463191 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:54:36.099655 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5fc5d407-7653-483c-b424-40ba6f463191 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1364 microversion: 2.1 time: 0.154636 Aug 04 17:54:36.100233 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3447/6925] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:54:35 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:54:37.120585 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-45cc412a-7b7b-44a6-9c8f-662732d2c450 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:37.121114 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-45cc412a-7b7b-44a6-9c8f-662732d2c450 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:37.128569 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-45cc412a-7b7b-44a6-9c8f-662732d2c450 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:37.129070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-45cc412a-7b7b-44a6-9c8f-662732d2c450 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:37.129520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-45cc412a-7b7b-44a6-9c8f-662732d2c450 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:37.130269 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-45cc412a-7b7b-44a6-9c8f-662732d2c450 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:37.130738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-45cc412a-7b7b-44a6-9c8f-662732d2c450 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:37.131175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-45cc412a-7b7b-44a6-9c8f-662732d2c450 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:37.262764 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-45cc412a-7b7b-44a6-9c8f-662732d2c450 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:54:37.270332 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-45cc412a-7b7b-44a6-9c8f-662732d2c450 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1364 microversion: 2.1 time: 0.153904 Aug 04 17:54:37.270909 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3479/6926] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:54:37 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:54:38.291089 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-84f6728a-5ec3-453a-9412-b858db55fb44 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:38.291766 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-84f6728a-5ec3-453a-9412-b858db55fb44 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:38.298781 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84f6728a-5ec3-453a-9412-b858db55fb44 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:38.299286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84f6728a-5ec3-453a-9412-b858db55fb44 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:38.299748 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84f6728a-5ec3-453a-9412-b858db55fb44 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:38.300460 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84f6728a-5ec3-453a-9412-b858db55fb44 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:38.300934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84f6728a-5ec3-453a-9412-b858db55fb44 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:38.301381 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84f6728a-5ec3-453a-9412-b858db55fb44 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:38.435220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-84f6728a-5ec3-453a-9412-b858db55fb44 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:54:38.442742 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-84f6728a-5ec3-453a-9412-b858db55fb44 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1364 microversion: 2.1 time: 0.156240 Aug 04 17:54:38.443314 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3448/6927] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:54:38 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:54:38.831322 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-6db713cf-4283-48ff-b181-6baa5c152efc req-1f36e217-fc98-4996-bcac-53c3130f7dad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "561003ab-c65c-4c83-b932-d3de9aedbbb1", "name": "network-vif-plugged", "status": "completed", "tag": "56974a51-6f27-4d9f-95ea-149dc13e45b2"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:54:38.844533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6db713cf-4283-48ff-b181-6baa5c152efc req-1f36e217-fc98-4996-bcac-53c3130f7dad service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:38.845036 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6db713cf-4283-48ff-b181-6baa5c152efc req-1f36e217-fc98-4996-bcac-53c3130f7dad service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:38.845507 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6db713cf-4283-48ff-b181-6baa5c152efc req-1f36e217-fc98-4996-bcac-53c3130f7dad service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:38.857073 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-6db713cf-4283-48ff-b181-6baa5c152efc req-1f36e217-fc98-4996-bcac-53c3130f7dad service nova] Creating event network-vif-plugged:56974a51-6f27-4d9f-95ea-149dc13e45b2 for instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 on n-h1-851359-3 Aug 04 17:54:38.866688 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-6db713cf-4283-48ff-b181-6baa5c152efc req-1f36e217-fc98-4996-bcac-53c3130f7dad service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039839 Aug 04 17:54:38.867328 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3480/6928] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:54:39.464430 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1674e136-c86d-413a-a45e-a6b2cbc1d82b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:39.465088 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1674e136-c86d-413a-a45e-a6b2cbc1d82b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:39.474317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1674e136-c86d-413a-a45e-a6b2cbc1d82b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:39.474826 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1674e136-c86d-413a-a45e-a6b2cbc1d82b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:39.475286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1674e136-c86d-413a-a45e-a6b2cbc1d82b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:39.476055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1674e136-c86d-413a-a45e-a6b2cbc1d82b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:39.476533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1674e136-c86d-413a-a45e-a6b2cbc1d82b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:39.476980 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1674e136-c86d-413a-a45e-a6b2cbc1d82b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:39.628049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1674e136-c86d-413a-a45e-a6b2cbc1d82b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:54:39.636355 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1674e136-c86d-413a-a45e-a6b2cbc1d82b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1364 microversion: 2.1 time: 0.176630 Aug 04 17:54:39.636937 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3449/6929] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:54:39 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:54:40.654922 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:54:40.655757 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:54:40.660444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-260add2e-4db5-4856-b056-7b0083591324 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:40.661226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-260add2e-4db5-4856-b056-7b0083591324 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:40.670835 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-260add2e-4db5-4856-b056-7b0083591324 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:40.671341 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-260add2e-4db5-4856-b056-7b0083591324 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:40.671817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-260add2e-4db5-4856-b056-7b0083591324 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:40.672532 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-260add2e-4db5-4856-b056-7b0083591324 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:40.672999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-260add2e-4db5-4856-b056-7b0083591324 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:40.673436 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-260add2e-4db5-4856-b056-7b0083591324 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:40.822747 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-260add2e-4db5-4856-b056-7b0083591324 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:54:40.831081 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-260add2e-4db5-4856-b056-7b0083591324 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1552 microversion: 2.1 time: 0.177887 Aug 04 17:54:40.831709 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3481/6930] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:54:40 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1552 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:54:40.854905 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f865ac87-edce-4831-a2af-2ff65830b83d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:54:40.855659 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f865ac87-edce-4831-a2af-2ff65830b83d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:54:40.857445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:54:40.864128 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f865ac87-edce-4831-a2af-2ff65830b83d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:40.864644 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f865ac87-edce-4831-a2af-2ff65830b83d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:40.865101 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f865ac87-edce-4831-a2af-2ff65830b83d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:40.865829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f865ac87-edce-4831-a2af-2ff65830b83d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:40.866379 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f865ac87-edce-4831-a2af-2ff65830b83d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:40.866814 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f865ac87-edce-4831-a2af-2ff65830b83d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:40.951704 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f865ac87-edce-4831-a2af-2ff65830b83d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101319 Aug 04 17:54:40.952427 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3450/6931] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Aug 4 17:54:40 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:54:42.269880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-20010f63-f0d6-4c78-a696-7a93f44ace85 req-d8663e5b-164b-4958-b551-31ad073d8eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "561003ab-c65c-4c83-b932-d3de9aedbbb1", "tag": "56974a51-6f27-4d9f-95ea-149dc13e45b2"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:54:42.282364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-20010f63-f0d6-4c78-a696-7a93f44ace85 req-d8663e5b-164b-4958-b551-31ad073d8eb6 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:54:42.282865 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-20010f63-f0d6-4c78-a696-7a93f44ace85 req-d8663e5b-164b-4958-b551-31ad073d8eb6 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:54:42.283312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-20010f63-f0d6-4c78-a696-7a93f44ace85 req-d8663e5b-164b-4958-b551-31ad073d8eb6 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:54:42.297550 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-20010f63-f0d6-4c78-a696-7a93f44ace85 req-d8663e5b-164b-4958-b551-31ad073d8eb6 service nova] Creating event network-changed:56974a51-6f27-4d9f-95ea-149dc13e45b2 for instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 on n-h1-851359-3 Aug 04 17:54:42.303590 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-20010f63-f0d6-4c78-a696-7a93f44ace85 req-d8663e5b-164b-4958-b551-31ad073d8eb6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037372 Aug 04 17:54:42.305355 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3482/6932] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:55:18.153276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:55:18.154159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=34 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:55:18.158178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4315d79c-54aa-492c-a247-9c25b17b7e98 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:18.158817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4315d79c-54aa-492c-a247-9c25b17b7e98 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:18.166483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4315d79c-54aa-492c-a247-9c25b17b7e98 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:18.166989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4315d79c-54aa-492c-a247-9c25b17b7e98 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:18.167442 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4315d79c-54aa-492c-a247-9c25b17b7e98 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:18.168172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4315d79c-54aa-492c-a247-9c25b17b7e98 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:18.168626 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4315d79c-54aa-492c-a247-9c25b17b7e98 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:18.169066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4315d79c-54aa-492c-a247-9c25b17b7e98 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:18.391360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4315d79c-54aa-492c-a247-9c25b17b7e98 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:18.400378 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4315d79c-54aa-492c-a247-9c25b17b7e98 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1671 microversion: 2.1 time: 0.248944 Aug 04 17:55:18.400996 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3451/6933] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:18 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1671 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:18.421338 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:55:18.422220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=32 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:55:18.426907 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-76e199f9-63fe-4bc5-b15d-518559565ab8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:18.427643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-76e199f9-63fe-4bc5-b15d-518559565ab8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:18.436742 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76e199f9-63fe-4bc5-b15d-518559565ab8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:18.437590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76e199f9-63fe-4bc5-b15d-518559565ab8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:18.438386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76e199f9-63fe-4bc5-b15d-518559565ab8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:18.439605 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76e199f9-63fe-4bc5-b15d-518559565ab8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:18.440363 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76e199f9-63fe-4bc5-b15d-518559565ab8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:18.441139 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-76e199f9-63fe-4bc5-b15d-518559565ab8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:18.649599 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-76e199f9-63fe-4bc5-b15d-518559565ab8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:18.657519 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-76e199f9-63fe-4bc5-b15d-518559565ab8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1671 microversion: 2.1 time: 0.238651 Aug 04 17:55:18.658127 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3483/6934] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:18 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1671 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:18.677866 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-35acb830-2ef9-42b7-8ff9-6c4290e4ab20 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:18.678454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-35acb830-2ef9-42b7-8ff9-6c4290e4ab20 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:18.685036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35acb830-2ef9-42b7-8ff9-6c4290e4ab20 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:18.685546 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35acb830-2ef9-42b7-8ff9-6c4290e4ab20 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:18.686025 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35acb830-2ef9-42b7-8ff9-6c4290e4ab20 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:18.686759 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35acb830-2ef9-42b7-8ff9-6c4290e4ab20 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:18.687356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35acb830-2ef9-42b7-8ff9-6c4290e4ab20 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:18.687679 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35acb830-2ef9-42b7-8ff9-6c4290e4ab20 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:18.904716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-35acb830-2ef9-42b7-8ff9-6c4290e4ab20 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:18.914671 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-35acb830-2ef9-42b7-8ff9-6c4290e4ab20 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1671 microversion: 2.1 time: 0.240987 Aug 04 17:55:18.915270 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3452/6935] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:18 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1671 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:18.935162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c316ff34-c6bb-4a74-af17-a86af67ae7a5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:55:18.937363 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c316ff34-c6bb-4a74-af17-a86af67ae7a5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:18.943889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c316ff34-c6bb-4a74-af17-a86af67ae7a5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:18.944408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c316ff34-c6bb-4a74-af17-a86af67ae7a5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:18.944841 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c316ff34-c6bb-4a74-af17-a86af67ae7a5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:18.945556 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c316ff34-c6bb-4a74-af17-a86af67ae7a5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:18.946037 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c316ff34-c6bb-4a74-af17-a86af67ae7a5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:18.946478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c316ff34-c6bb-4a74-af17-a86af67ae7a5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:18.976591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c316ff34-c6bb-4a74-af17-a86af67ae7a5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:18.985600 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c316ff34-c6bb-4a74-af17-a86af67ae7a5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Old instance type m1.heat2, new instance type m1.heat {{(pid=131043) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 17:55:18.993201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-c316ff34-c6bb-4a74-af17-a86af67ae7a5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:55:18.993581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-c316ff34-c6bb-4a74-af17-a86af67ae7a5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:55:18.994082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-c316ff34-c6bb-4a74-af17-a86af67ae7a5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:55:18.994505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-c316ff34-c6bb-4a74-af17-a86af67ae7a5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:55:18.994926 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-c316ff34-c6bb-4a74-af17-a86af67ae7a5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:55:19.065005 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c316ff34-c6bb-4a74-af17-a86af67ae7a5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "POST /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1/action" status: 202 len: 0 microversion: 2.1 time: 0.133826 Aug 04 17:55:19.065629 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3484/6936] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:55:18 2022] POST /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:55:19.073869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-70c95769-e5ff-4a5c-bc9d-947b105d501f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:19.074549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-70c95769-e5ff-4a5c-bc9d-947b105d501f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:19.082325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70c95769-e5ff-4a5c-bc9d-947b105d501f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:19.082765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70c95769-e5ff-4a5c-bc9d-947b105d501f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:19.083353 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70c95769-e5ff-4a5c-bc9d-947b105d501f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:19.084176 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70c95769-e5ff-4a5c-bc9d-947b105d501f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:19.084799 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70c95769-e5ff-4a5c-bc9d-947b105d501f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:19.085332 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70c95769-e5ff-4a5c-bc9d-947b105d501f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:19.251891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-70c95769-e5ff-4a5c-bc9d-947b105d501f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:19.259775 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-70c95769-e5ff-4a5c-bc9d-947b105d501f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1680 microversion: 2.1 time: 0.189790 Aug 04 17:55:19.260360 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3453/6937] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:19 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1680 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:20.282213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-55c1c811-14a0-4643-846b-228637b8bdeb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:20.282788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-55c1c811-14a0-4643-846b-228637b8bdeb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:20.288917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-55c1c811-14a0-4643-846b-228637b8bdeb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:20.289421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-55c1c811-14a0-4643-846b-228637b8bdeb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:20.289872 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-55c1c811-14a0-4643-846b-228637b8bdeb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:20.290696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-55c1c811-14a0-4643-846b-228637b8bdeb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:20.291193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-55c1c811-14a0-4643-846b-228637b8bdeb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:20.291634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-55c1c811-14a0-4643-846b-228637b8bdeb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:20.432906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-55c1c811-14a0-4643-846b-228637b8bdeb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:20.441090 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-55c1c811-14a0-4643-846b-228637b8bdeb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1680 microversion: 2.1 time: 0.163728 Aug 04 17:55:20.441684 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3485/6938] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:20 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:21.465388 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e2512ecf-9ae4-46d1-8b04-387eddfafa26 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:21.466055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e2512ecf-9ae4-46d1-8b04-387eddfafa26 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:21.475523 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2512ecf-9ae4-46d1-8b04-387eddfafa26 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:21.476037 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2512ecf-9ae4-46d1-8b04-387eddfafa26 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:21.476495 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2512ecf-9ae4-46d1-8b04-387eddfafa26 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:21.477218 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2512ecf-9ae4-46d1-8b04-387eddfafa26 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:21.477694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2512ecf-9ae4-46d1-8b04-387eddfafa26 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:21.478169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2512ecf-9ae4-46d1-8b04-387eddfafa26 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:21.619369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e2512ecf-9ae4-46d1-8b04-387eddfafa26 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:21.627354 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e2512ecf-9ae4-46d1-8b04-387eddfafa26 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1685 microversion: 2.1 time: 0.166051 Aug 04 17:55:21.627942 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3454/6939] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:21 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1685 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:22.651078 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7528712c-617a-468b-93db-f5859e319e90 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:22.651696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7528712c-617a-468b-93db-f5859e319e90 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:22.658585 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7528712c-617a-468b-93db-f5859e319e90 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:22.659073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7528712c-617a-468b-93db-f5859e319e90 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:22.659510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7528712c-617a-468b-93db-f5859e319e90 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:22.660208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7528712c-617a-468b-93db-f5859e319e90 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:22.660667 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7528712c-617a-468b-93db-f5859e319e90 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:22.661098 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7528712c-617a-468b-93db-f5859e319e90 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:22.798339 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7528712c-617a-468b-93db-f5859e319e90 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:22.806692 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7528712c-617a-468b-93db-f5859e319e90 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1685 microversion: 2.1 time: 0.159495 Aug 04 17:55:22.807269 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3486/6940] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:22 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:55:23.827769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8a58b1b2-feb7-43ea-a93d-ad5c5f968557 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:23.828355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8a58b1b2-feb7-43ea-a93d-ad5c5f968557 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:23.835713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a58b1b2-feb7-43ea-a93d-ad5c5f968557 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:23.836215 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a58b1b2-feb7-43ea-a93d-ad5c5f968557 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:23.836676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a58b1b2-feb7-43ea-a93d-ad5c5f968557 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:23.837389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a58b1b2-feb7-43ea-a93d-ad5c5f968557 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:23.837863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a58b1b2-feb7-43ea-a93d-ad5c5f968557 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:23.838337 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a58b1b2-feb7-43ea-a93d-ad5c5f968557 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:23.968197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8a58b1b2-feb7-43ea-a93d-ad5c5f968557 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:23.976586 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8a58b1b2-feb7-43ea-a93d-ad5c5f968557 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1685 microversion: 2.1 time: 0.152974 Aug 04 17:55:23.977168 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3455/6941] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:23 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:24.998520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e2b1aeba-63e1-4a87-8304-9f4078abef53 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:24.999089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e2b1aeba-63e1-4a87-8304-9f4078abef53 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:25.005895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2b1aeba-63e1-4a87-8304-9f4078abef53 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:25.006451 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2b1aeba-63e1-4a87-8304-9f4078abef53 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:25.006901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2b1aeba-63e1-4a87-8304-9f4078abef53 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:25.007602 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2b1aeba-63e1-4a87-8304-9f4078abef53 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:25.008084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2b1aeba-63e1-4a87-8304-9f4078abef53 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:25.008524 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e2b1aeba-63e1-4a87-8304-9f4078abef53 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:25.154874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e2b1aeba-63e1-4a87-8304-9f4078abef53 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:25.162790 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e2b1aeba-63e1-4a87-8304-9f4078abef53 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1685 microversion: 2.1 time: 0.168181 Aug 04 17:55:25.163877 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3487/6942] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:24 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1685 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:26.185398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-85150727-2938-48cd-ac5d-768bf17715eb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:26.186047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-85150727-2938-48cd-ac5d-768bf17715eb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:26.192815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85150727-2938-48cd-ac5d-768bf17715eb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:26.193307 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85150727-2938-48cd-ac5d-768bf17715eb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:26.193757 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85150727-2938-48cd-ac5d-768bf17715eb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:26.195144 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85150727-2938-48cd-ac5d-768bf17715eb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:26.195611 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85150727-2938-48cd-ac5d-768bf17715eb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:26.196045 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85150727-2938-48cd-ac5d-768bf17715eb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:26.325653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-85150727-2938-48cd-ac5d-768bf17715eb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:26.333509 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-85150727-2938-48cd-ac5d-768bf17715eb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1685 microversion: 2.1 time: 0.152046 Aug 04 17:55:26.334118 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3456/6943] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:26 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:27.356488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6f88f278-ac02-4804-b073-0253de222363 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:27.357108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6f88f278-ac02-4804-b073-0253de222363 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:27.363893 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f88f278-ac02-4804-b073-0253de222363 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:27.364385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f88f278-ac02-4804-b073-0253de222363 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:27.364825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f88f278-ac02-4804-b073-0253de222363 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:27.365529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f88f278-ac02-4804-b073-0253de222363 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:27.366647 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f88f278-ac02-4804-b073-0253de222363 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:27.367044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f88f278-ac02-4804-b073-0253de222363 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:27.504387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6f88f278-ac02-4804-b073-0253de222363 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:27.512058 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6f88f278-ac02-4804-b073-0253de222363 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1685 microversion: 2.1 time: 0.159525 Aug 04 17:55:27.512631 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3488/6944] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:27 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:28.532820 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d7b8e0ef-cbca-43c9-a2e4-9b0f251f58a4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:28.533457 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d7b8e0ef-cbca-43c9-a2e4-9b0f251f58a4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:28.540463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7b8e0ef-cbca-43c9-a2e4-9b0f251f58a4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:28.540979 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7b8e0ef-cbca-43c9-a2e4-9b0f251f58a4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:28.541418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7b8e0ef-cbca-43c9-a2e4-9b0f251f58a4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:28.542155 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7b8e0ef-cbca-43c9-a2e4-9b0f251f58a4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:28.542631 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7b8e0ef-cbca-43c9-a2e4-9b0f251f58a4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:28.543076 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7b8e0ef-cbca-43c9-a2e4-9b0f251f58a4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:28.674618 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d7b8e0ef-cbca-43c9-a2e4-9b0f251f58a4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:28.682249 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d7b8e0ef-cbca-43c9-a2e4-9b0f251f58a4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1685 microversion: 2.1 time: 0.153375 Aug 04 17:55:28.682828 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3457/6945] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:28 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:29.703653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b5ceb944-e96a-432a-aca4-a0162b22e463 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:29.704276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b5ceb944-e96a-432a-aca4-a0162b22e463 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:29.711455 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b5ceb944-e96a-432a-aca4-a0162b22e463 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:29.711965 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b5ceb944-e96a-432a-aca4-a0162b22e463 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:29.712412 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b5ceb944-e96a-432a-aca4-a0162b22e463 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:29.713122 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b5ceb944-e96a-432a-aca4-a0162b22e463 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:29.713616 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b5ceb944-e96a-432a-aca4-a0162b22e463 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:29.714078 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b5ceb944-e96a-432a-aca4-a0162b22e463 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:29.849151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b5ceb944-e96a-432a-aca4-a0162b22e463 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:29.857287 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b5ceb944-e96a-432a-aca4-a0162b22e463 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1685 microversion: 2.1 time: 0.157556 Aug 04 17:55:29.857863 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3489/6946] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:29 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:30.878061 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5e3fabc9-83fb-4ad9-8e44-c2ebbed16209 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:30.878739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5e3fabc9-83fb-4ad9-8e44-c2ebbed16209 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:30.886212 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e3fabc9-83fb-4ad9-8e44-c2ebbed16209 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:30.886716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e3fabc9-83fb-4ad9-8e44-c2ebbed16209 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:30.887171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e3fabc9-83fb-4ad9-8e44-c2ebbed16209 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:30.887884 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e3fabc9-83fb-4ad9-8e44-c2ebbed16209 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:30.888362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e3fabc9-83fb-4ad9-8e44-c2ebbed16209 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:30.888811 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e3fabc9-83fb-4ad9-8e44-c2ebbed16209 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:31.026817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5e3fabc9-83fb-4ad9-8e44-c2ebbed16209 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:31.034433 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5e3fabc9-83fb-4ad9-8e44-c2ebbed16209 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1685 microversion: 2.1 time: 0.160249 Aug 04 17:55:31.035009 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3458/6947] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:30 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:32.058478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3666bfbd-4c90-4770-9d5f-3cccfcfe9b35 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:32.059085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3666bfbd-4c90-4770-9d5f-3cccfcfe9b35 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:32.065241 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3666bfbd-4c90-4770-9d5f-3cccfcfe9b35 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:32.065736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3666bfbd-4c90-4770-9d5f-3cccfcfe9b35 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:32.066251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3666bfbd-4c90-4770-9d5f-3cccfcfe9b35 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:32.066958 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3666bfbd-4c90-4770-9d5f-3cccfcfe9b35 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:32.067423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3666bfbd-4c90-4770-9d5f-3cccfcfe9b35 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:32.067856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3666bfbd-4c90-4770-9d5f-3cccfcfe9b35 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:32.201661 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3666bfbd-4c90-4770-9d5f-3cccfcfe9b35 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:32.209206 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3666bfbd-4c90-4770-9d5f-3cccfcfe9b35 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1685 microversion: 2.1 time: 0.156396 Aug 04 17:55:32.209777 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3490/6948] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:32 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:33.231151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ff0900a0-fb97-4520-8ab3-97f31b0ef7e9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:33.231952 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ff0900a0-fb97-4520-8ab3-97f31b0ef7e9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:33.238588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff0900a0-fb97-4520-8ab3-97f31b0ef7e9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:33.239082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff0900a0-fb97-4520-8ab3-97f31b0ef7e9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:33.239531 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff0900a0-fb97-4520-8ab3-97f31b0ef7e9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:33.240266 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff0900a0-fb97-4520-8ab3-97f31b0ef7e9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:33.240735 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff0900a0-fb97-4520-8ab3-97f31b0ef7e9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:33.241797 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff0900a0-fb97-4520-8ab3-97f31b0ef7e9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:33.374553 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ff0900a0-fb97-4520-8ab3-97f31b0ef7e9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:33.382121 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ff0900a0-fb97-4520-8ab3-97f31b0ef7e9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1685 microversion: 2.1 time: 0.154934 Aug 04 17:55:33.382703 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3459/6949] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:33 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:55:34.403255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-150200d8-b156-4231-b576-471fc290474a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:34.403870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-150200d8-b156-4231-b576-471fc290474a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:34.410720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-150200d8-b156-4231-b576-471fc290474a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:34.411202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-150200d8-b156-4231-b576-471fc290474a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:34.411645 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-150200d8-b156-4231-b576-471fc290474a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:34.412331 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-150200d8-b156-4231-b576-471fc290474a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:34.412794 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-150200d8-b156-4231-b576-471fc290474a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:34.413221 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-150200d8-b156-4231-b576-471fc290474a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:34.544229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-150200d8-b156-4231-b576-471fc290474a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:34.551714 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-150200d8-b156-4231-b576-471fc290474a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1685 microversion: 2.1 time: 0.152399 Aug 04 17:55:34.552290 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3491/6950] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:34 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:35.573022 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-484a2c25-a586-47bd-b2df-6831d89297e8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:35.573636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-484a2c25-a586-47bd-b2df-6831d89297e8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:35.580509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-484a2c25-a586-47bd-b2df-6831d89297e8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:35.581004 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-484a2c25-a586-47bd-b2df-6831d89297e8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:35.581452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-484a2c25-a586-47bd-b2df-6831d89297e8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:35.582196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-484a2c25-a586-47bd-b2df-6831d89297e8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:35.582673 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-484a2c25-a586-47bd-b2df-6831d89297e8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:35.583108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-484a2c25-a586-47bd-b2df-6831d89297e8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:35.714713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-484a2c25-a586-47bd-b2df-6831d89297e8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:35.722440 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-484a2c25-a586-47bd-b2df-6831d89297e8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1685 microversion: 2.1 time: 0.153317 Aug 04 17:55:35.723012 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3460/6951] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:35 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:36.743413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8557be14-fb39-4a90-b04e-deef6cacf781 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:36.744156 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8557be14-fb39-4a90-b04e-deef6cacf781 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:36.753344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8557be14-fb39-4a90-b04e-deef6cacf781 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:36.754133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8557be14-fb39-4a90-b04e-deef6cacf781 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:36.754801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8557be14-fb39-4a90-b04e-deef6cacf781 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:36.755916 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8557be14-fb39-4a90-b04e-deef6cacf781 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:36.756625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8557be14-fb39-4a90-b04e-deef6cacf781 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:36.757335 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8557be14-fb39-4a90-b04e-deef6cacf781 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:36.903405 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8557be14-fb39-4a90-b04e-deef6cacf781 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:36.911004 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8557be14-fb39-4a90-b04e-deef6cacf781 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1685 microversion: 2.1 time: 0.171604 Aug 04 17:55:36.911608 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3492/6952] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:36 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:37.932885 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-88e73ad1-80f1-4e6e-af55-d8043226b592 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:37.933420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-88e73ad1-80f1-4e6e-af55-d8043226b592 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:37.940385 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88e73ad1-80f1-4e6e-af55-d8043226b592 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:37.940893 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88e73ad1-80f1-4e6e-af55-d8043226b592 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:37.941354 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88e73ad1-80f1-4e6e-af55-d8043226b592 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:37.942110 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88e73ad1-80f1-4e6e-af55-d8043226b592 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:37.942591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88e73ad1-80f1-4e6e-af55-d8043226b592 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:37.943038 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88e73ad1-80f1-4e6e-af55-d8043226b592 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:38.079293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-88e73ad1-80f1-4e6e-af55-d8043226b592 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:38.087522 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-88e73ad1-80f1-4e6e-af55-d8043226b592 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1685 microversion: 2.1 time: 0.159292 Aug 04 17:55:38.088337 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3461/6953] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:37 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:38.910788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-8f014dfa-53f8-4d84-94e1-d8deed408d59 req-aabd7f29-2583-403f-bef3-d75dd56d4cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "561003ab-c65c-4c83-b932-d3de9aedbbb1", "name": "network-vif-unplugged", "status": "completed", "tag": "56974a51-6f27-4d9f-95ea-149dc13e45b2"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:55:38.923036 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8f014dfa-53f8-4d84-94e1-d8deed408d59 req-aabd7f29-2583-403f-bef3-d75dd56d4cae service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:38.923527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8f014dfa-53f8-4d84-94e1-d8deed408d59 req-aabd7f29-2583-403f-bef3-d75dd56d4cae service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:38.923962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8f014dfa-53f8-4d84-94e1-d8deed408d59 req-aabd7f29-2583-403f-bef3-d75dd56d4cae service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:38.935924 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-8f014dfa-53f8-4d84-94e1-d8deed408d59 req-aabd7f29-2583-403f-bef3-d75dd56d4cae service nova] Creating event network-vif-unplugged:56974a51-6f27-4d9f-95ea-149dc13e45b2 for instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 on n-h2-851359-3 Aug 04 17:55:38.941327 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [req-8f014dfa-53f8-4d84-94e1-d8deed408d59 req-aabd7f29-2583-403f-bef3-d75dd56d4cae service nova] Instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:55:38.954005 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-8f014dfa-53f8-4d84-94e1-d8deed408d59 req-aabd7f29-2583-403f-bef3-d75dd56d4cae service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047728 Aug 04 17:55:38.954627 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3493/6954] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:55:39.109077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5ebb97aa-25b1-4d2c-aa31-61f691a0172a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:39.109705 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5ebb97aa-25b1-4d2c-aa31-61f691a0172a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:39.116854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ebb97aa-25b1-4d2c-aa31-61f691a0172a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:39.117354 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ebb97aa-25b1-4d2c-aa31-61f691a0172a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:39.117809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ebb97aa-25b1-4d2c-aa31-61f691a0172a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:39.118553 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ebb97aa-25b1-4d2c-aa31-61f691a0172a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:39.119023 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ebb97aa-25b1-4d2c-aa31-61f691a0172a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:39.119464 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ebb97aa-25b1-4d2c-aa31-61f691a0172a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:39.318396 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5ebb97aa-25b1-4d2c-aa31-61f691a0172a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:39.326737 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5ebb97aa-25b1-4d2c-aa31-61f691a0172a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1684 microversion: 2.1 time: 0.221537 Aug 04 17:55:39.327399 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3462/6955] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:39 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1684 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:40.349726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-05d714ef-fd87-4dc2-af83-e13b228afdc3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:40.351079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-05d714ef-fd87-4dc2-af83-e13b228afdc3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:40.358394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05d714ef-fd87-4dc2-af83-e13b228afdc3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:40.358899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05d714ef-fd87-4dc2-af83-e13b228afdc3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:40.359347 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05d714ef-fd87-4dc2-af83-e13b228afdc3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:40.360066 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05d714ef-fd87-4dc2-af83-e13b228afdc3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:40.360536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05d714ef-fd87-4dc2-af83-e13b228afdc3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:40.360974 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05d714ef-fd87-4dc2-af83-e13b228afdc3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:40.503954 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-05d714ef-fd87-4dc2-af83-e13b228afdc3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:40.511844 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-05d714ef-fd87-4dc2-af83-e13b228afdc3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1682 microversion: 2.1 time: 0.166473 Aug 04 17:55:40.512423 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3494/6956] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:40 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:40.976303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-99cde60c-123e-4b4e-a9bc-d39541e7fe3d req-cc99521c-67fe-4d74-a21b-4103fde64348 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "561003ab-c65c-4c83-b932-d3de9aedbbb1", "tag": "56974a51-6f27-4d9f-95ea-149dc13e45b2"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:55:40.988408 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-99cde60c-123e-4b4e-a9bc-d39541e7fe3d req-cc99521c-67fe-4d74-a21b-4103fde64348 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:40.988903 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-99cde60c-123e-4b4e-a9bc-d39541e7fe3d req-cc99521c-67fe-4d74-a21b-4103fde64348 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:40.989348 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-99cde60c-123e-4b4e-a9bc-d39541e7fe3d req-cc99521c-67fe-4d74-a21b-4103fde64348 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:41.001402 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-99cde60c-123e-4b4e-a9bc-d39541e7fe3d req-cc99521c-67fe-4d74-a21b-4103fde64348 service nova] Creating event network-changed:56974a51-6f27-4d9f-95ea-149dc13e45b2 for instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 on n-h2-851359-3 Aug 04 17:55:41.007317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-99cde60c-123e-4b4e-a9bc-d39541e7fe3d req-cc99521c-67fe-4d74-a21b-4103fde64348 service nova] Instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:55:41.018771 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-99cde60c-123e-4b4e-a9bc-d39541e7fe3d req-cc99521c-67fe-4d74-a21b-4103fde64348 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046224 Aug 04 17:55:41.019391 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3463/6957] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:55:41.533248 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-563e0ea6-fa09-41eb-8458-d37073500021 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:41.533906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-563e0ea6-fa09-41eb-8458-d37073500021 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:41.541487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-563e0ea6-fa09-41eb-8458-d37073500021 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:41.542011 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-563e0ea6-fa09-41eb-8458-d37073500021 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:41.542475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-563e0ea6-fa09-41eb-8458-d37073500021 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:41.543237 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-563e0ea6-fa09-41eb-8458-d37073500021 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:41.543713 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-563e0ea6-fa09-41eb-8458-d37073500021 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:41.544273 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-563e0ea6-fa09-41eb-8458-d37073500021 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:41.681508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-563e0ea6-fa09-41eb-8458-d37073500021 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:41.689265 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-563e0ea6-fa09-41eb-8458-d37073500021 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1682 microversion: 2.1 time: 0.160042 Aug 04 17:55:41.689853 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3495/6958] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:41 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:42.713026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1abc558c-431b-4246-8e72-e5b04e37a8f0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:42.714304 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1abc558c-431b-4246-8e72-e5b04e37a8f0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:42.721130 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1abc558c-431b-4246-8e72-e5b04e37a8f0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:42.721638 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1abc558c-431b-4246-8e72-e5b04e37a8f0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:42.722139 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1abc558c-431b-4246-8e72-e5b04e37a8f0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:42.722872 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1abc558c-431b-4246-8e72-e5b04e37a8f0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:42.723349 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1abc558c-431b-4246-8e72-e5b04e37a8f0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:42.723865 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1abc558c-431b-4246-8e72-e5b04e37a8f0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:42.951662 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1abc558c-431b-4246-8e72-e5b04e37a8f0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:42.959491 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1abc558c-431b-4246-8e72-e5b04e37a8f0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1682 microversion: 2.1 time: 0.252335 Aug 04 17:55:42.960444 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3464/6959] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:42 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1682 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:43.983464 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-92576d29-d73b-40f1-9d75-9efd9c3801be tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:43.984054 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-92576d29-d73b-40f1-9d75-9efd9c3801be tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:43.991727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92576d29-d73b-40f1-9d75-9efd9c3801be tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:43.992228 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92576d29-d73b-40f1-9d75-9efd9c3801be tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:43.992680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92576d29-d73b-40f1-9d75-9efd9c3801be tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:43.993423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92576d29-d73b-40f1-9d75-9efd9c3801be tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:43.993895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92576d29-d73b-40f1-9d75-9efd9c3801be tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:43.994356 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92576d29-d73b-40f1-9d75-9efd9c3801be tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:44.123613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-92576d29-d73b-40f1-9d75-9efd9c3801be tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:44.131172 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-92576d29-d73b-40f1-9d75-9efd9c3801be tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1679 microversion: 2.1 time: 0.152521 Aug 04 17:55:44.131745 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3496/6960] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:43 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:55:44.151970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-21f8577b-618a-4841-a4be-9da831f89b00 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:55:44.152522 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-21f8577b-618a-4841-a4be-9da831f89b00 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:44.159267 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21f8577b-618a-4841-a4be-9da831f89b00 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:44.159759 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21f8577b-618a-4841-a4be-9da831f89b00 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:44.160232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21f8577b-618a-4841-a4be-9da831f89b00 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:44.160935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21f8577b-618a-4841-a4be-9da831f89b00 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:44.161404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21f8577b-618a-4841-a4be-9da831f89b00 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:44.161837 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21f8577b-618a-4841-a4be-9da831f89b00 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:44.222990 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-21f8577b-618a-4841-a4be-9da831f89b00 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "POST /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1/action" status: 204 len: 0 microversion: 2.1 time: 0.074971 Aug 04 17:55:44.223649 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3465/6961] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:55:44 2022] POST /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:55:44.233830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-70ec7dc4-6bed-416e-9165-77d00eba0947 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:44.234461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-70ec7dc4-6bed-416e-9165-77d00eba0947 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:44.240815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70ec7dc4-6bed-416e-9165-77d00eba0947 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:44.241454 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70ec7dc4-6bed-416e-9165-77d00eba0947 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:44.242054 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70ec7dc4-6bed-416e-9165-77d00eba0947 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:44.242972 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70ec7dc4-6bed-416e-9165-77d00eba0947 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:44.243521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70ec7dc4-6bed-416e-9165-77d00eba0947 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:44.244263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70ec7dc4-6bed-416e-9165-77d00eba0947 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:44.797385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-70ec7dc4-6bed-416e-9165-77d00eba0947 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:44.805831 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-70ec7dc4-6bed-416e-9165-77d00eba0947 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1679 microversion: 2.1 time: 0.577234 Aug 04 17:55:44.806654 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3497/6962] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:44 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1679 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:45.427405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-f0079efe-6512-4d5d-a7ee-4f26baa928b8 req-5a7532b8-0e3b-41b4-843e-98cc6f23e5ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "561003ab-c65c-4c83-b932-d3de9aedbbb1", "name": "network-vif-plugged", "status": "completed", "tag": "56974a51-6f27-4d9f-95ea-149dc13e45b2"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:55:45.440919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f0079efe-6512-4d5d-a7ee-4f26baa928b8 req-5a7532b8-0e3b-41b4-843e-98cc6f23e5ff service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:45.441348 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f0079efe-6512-4d5d-a7ee-4f26baa928b8 req-5a7532b8-0e3b-41b4-843e-98cc6f23e5ff service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:45.442566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f0079efe-6512-4d5d-a7ee-4f26baa928b8 req-5a7532b8-0e3b-41b4-843e-98cc6f23e5ff service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:45.457349 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-f0079efe-6512-4d5d-a7ee-4f26baa928b8 req-5a7532b8-0e3b-41b4-843e-98cc6f23e5ff service nova] Creating event network-vif-plugged:56974a51-6f27-4d9f-95ea-149dc13e45b2 for instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 on n-h2-851359-3 Aug 04 17:55:45.463959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-f0079efe-6512-4d5d-a7ee-4f26baa928b8 req-5a7532b8-0e3b-41b4-843e-98cc6f23e5ff service nova] Instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:55:45.475382 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-f0079efe-6512-4d5d-a7ee-4f26baa928b8 req-5a7532b8-0e3b-41b4-843e-98cc6f23e5ff service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053332 Aug 04 17:55:45.476005 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3466/6963] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:55:45.826953 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-169225c6-f6f6-415b-b802-d47d7ceba21d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:45.827638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-169225c6-f6f6-415b-b802-d47d7ceba21d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:45.834663 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-169225c6-f6f6-415b-b802-d47d7ceba21d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:45.835215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-169225c6-f6f6-415b-b802-d47d7ceba21d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:45.835719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-169225c6-f6f6-415b-b802-d47d7ceba21d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:45.836605 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-169225c6-f6f6-415b-b802-d47d7ceba21d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:45.836918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-169225c6-f6f6-415b-b802-d47d7ceba21d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:45.837352 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-169225c6-f6f6-415b-b802-d47d7ceba21d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:45.857416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:55:45.996649 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-169225c6-f6f6-415b-b802-d47d7ceba21d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:46.012755 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-169225c6-f6f6-415b-b802-d47d7ceba21d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1679 microversion: 2.1 time: 0.189251 Aug 04 17:55:46.014753 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3498/6964] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:45 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1679 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:47.035020 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0579f716-8d5f-49fc-9e81-c1b1b10d2952 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:47.035701 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0579f716-8d5f-49fc-9e81-c1b1b10d2952 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:47.042740 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0579f716-8d5f-49fc-9e81-c1b1b10d2952 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:47.043242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0579f716-8d5f-49fc-9e81-c1b1b10d2952 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:47.043700 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0579f716-8d5f-49fc-9e81-c1b1b10d2952 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:47.044410 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0579f716-8d5f-49fc-9e81-c1b1b10d2952 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:47.044885 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0579f716-8d5f-49fc-9e81-c1b1b10d2952 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:47.045331 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0579f716-8d5f-49fc-9e81-c1b1b10d2952 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:47.048053 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:55:47.180501 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0579f716-8d5f-49fc-9e81-c1b1b10d2952 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:47.188018 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0579f716-8d5f-49fc-9e81-c1b1b10d2952 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1671 microversion: 2.1 time: 0.157357 Aug 04 17:55:47.188589 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3467/6965] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:47 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:47.209223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6be35c02-6ae6-429c-be9d-f4d660dafdd3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:47.209849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6be35c02-6ae6-429c-be9d-f4d660dafdd3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:47.216690 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6be35c02-6ae6-429c-be9d-f4d660dafdd3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:47.217186 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6be35c02-6ae6-429c-be9d-f4d660dafdd3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:47.217634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6be35c02-6ae6-429c-be9d-f4d660dafdd3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:47.218369 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6be35c02-6ae6-429c-be9d-f4d660dafdd3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:47.219107 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6be35c02-6ae6-429c-be9d-f4d660dafdd3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:47.219536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6be35c02-6ae6-429c-be9d-f4d660dafdd3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:47.349069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6be35c02-6ae6-429c-be9d-f4d660dafdd3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:47.356794 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6be35c02-6ae6-429c-be9d-f4d660dafdd3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1671 microversion: 2.1 time: 0.151543 Aug 04 17:55:47.357377 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3499/6966] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:47 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:47.377453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-72733a68-dff5-4e24-9cad-efdea8539270 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:47.378113 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-72733a68-dff5-4e24-9cad-efdea8539270 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:47.384823 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72733a68-dff5-4e24-9cad-efdea8539270 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:47.385325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72733a68-dff5-4e24-9cad-efdea8539270 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:47.385780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72733a68-dff5-4e24-9cad-efdea8539270 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:47.386535 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72733a68-dff5-4e24-9cad-efdea8539270 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:47.387042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72733a68-dff5-4e24-9cad-efdea8539270 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:47.387486 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72733a68-dff5-4e24-9cad-efdea8539270 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:47.520060 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-72733a68-dff5-4e24-9cad-efdea8539270 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:47.527757 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-72733a68-dff5-4e24-9cad-efdea8539270 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1671 microversion: 2.1 time: 0.154343 Aug 04 17:55:47.528335 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3468/6967] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:47 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:47.548049 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-47edf3f6-f274-4d78-a5d4-f9f207acbcb1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:47.548539 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-47edf3f6-f274-4d78-a5d4-f9f207acbcb1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:47.555169 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47edf3f6-f274-4d78-a5d4-f9f207acbcb1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:47.555665 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47edf3f6-f274-4d78-a5d4-f9f207acbcb1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:47.556118 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47edf3f6-f274-4d78-a5d4-f9f207acbcb1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:47.556826 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47edf3f6-f274-4d78-a5d4-f9f207acbcb1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:47.557292 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47edf3f6-f274-4d78-a5d4-f9f207acbcb1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:47.557727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47edf3f6-f274-4d78-a5d4-f9f207acbcb1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:47.582565 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-47edf3f6-f274-4d78-a5d4-f9f207acbcb1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:55:47.658736 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-47edf3f6-f274-4d78-a5d4-f9f207acbcb1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "DELETE /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 204 len: 0 microversion: 2.1 time: 0.114326 Aug 04 17:55:47.659521 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3500/6968] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:55:47 2022] DELETE /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:55:47.668684 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-98df0997-f31e-478d-af60-23db026db43c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:47.669334 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-98df0997-f31e-478d-af60-23db026db43c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:47.675272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98df0997-f31e-478d-af60-23db026db43c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:47.675887 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98df0997-f31e-478d-af60-23db026db43c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:47.676449 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98df0997-f31e-478d-af60-23db026db43c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:47.677308 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98df0997-f31e-478d-af60-23db026db43c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:47.677861 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98df0997-f31e-478d-af60-23db026db43c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:47.678984 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98df0997-f31e-478d-af60-23db026db43c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:47.823912 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-98df0997-f31e-478d-af60-23db026db43c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:47.833216 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-98df0997-f31e-478d-af60-23db026db43c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1677 microversion: 2.1 time: 0.168587 Aug 04 17:55:47.833922 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3469/6969] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:47 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:48.860919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0ad41c10-f2bb-4c76-acb5-e28c1acbc843 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:48.861553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0ad41c10-f2bb-4c76-acb5-e28c1acbc843 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:48.864383 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:55:48.869864 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ad41c10-f2bb-4c76-acb5-e28c1acbc843 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:48.870412 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ad41c10-f2bb-4c76-acb5-e28c1acbc843 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:48.870863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ad41c10-f2bb-4c76-acb5-e28c1acbc843 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:48.871576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ad41c10-f2bb-4c76-acb5-e28c1acbc843 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:48.872049 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ad41c10-f2bb-4c76-acb5-e28c1acbc843 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:48.872487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ad41c10-f2bb-4c76-acb5-e28c1acbc843 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:49.014797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0ad41c10-f2bb-4c76-acb5-e28c1acbc843 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:49.024275 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0ad41c10-f2bb-4c76-acb5-e28c1acbc843 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1677 microversion: 2.1 time: 0.167821 Aug 04 17:55:49.024848 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3501/6970] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:48 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:50.045489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e4065a45-4841-495a-8874-d1b6e5d51066 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:50.046161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e4065a45-4841-495a-8874-d1b6e5d51066 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:50.049223 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=39 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:55:50.056073 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4065a45-4841-495a-8874-d1b6e5d51066 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:50.056583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4065a45-4841-495a-8874-d1b6e5d51066 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:50.057044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4065a45-4841-495a-8874-d1b6e5d51066 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:50.059147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4065a45-4841-495a-8874-d1b6e5d51066 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:50.059644 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4065a45-4841-495a-8874-d1b6e5d51066 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:50.060078 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4065a45-4841-495a-8874-d1b6e5d51066 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:50.113110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-3ca6d8d7-5b10-4d9e-9dfe-e54c00229684 req-e7a8a1b6-9cbd-4f65-8303-b44079c7a4c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "561003ab-c65c-4c83-b932-d3de9aedbbb1", "name": "network-vif-deleted", "tag": "56974a51-6f27-4d9f-95ea-149dc13e45b2"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:55:50.130381 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-3ca6d8d7-5b10-4d9e-9dfe-e54c00229684 req-e7a8a1b6-9cbd-4f65-8303-b44079c7a4c5 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:50.132549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-3ca6d8d7-5b10-4d9e-9dfe-e54c00229684 req-e7a8a1b6-9cbd-4f65-8303-b44079c7a4c5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:50.133044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-3ca6d8d7-5b10-4d9e-9dfe-e54c00229684 req-e7a8a1b6-9cbd-4f65-8303-b44079c7a4c5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:50.142921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e4065a45-4841-495a-8874-d1b6e5d51066 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:50.149297 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-3ca6d8d7-5b10-4d9e-9dfe-e54c00229684 req-e7a8a1b6-9cbd-4f65-8303-b44079c7a4c5 service nova] Creating event network-vif-deleted:56974a51-6f27-4d9f-95ea-149dc13e45b2 for instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 on n-h2-851359-3 Aug 04 17:55:50.154214 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e4065a45-4841-495a-8874-d1b6e5d51066 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 200 len: 1609 microversion: 2.1 time: 0.112938 Aug 04 17:55:50.154411 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-3ca6d8d7-5b10-4d9e-9dfe-e54c00229684 req-e7a8a1b6-9cbd-4f65-8303-b44079c7a4c5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045744 Aug 04 17:55:50.154879 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3470/6971] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:50 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 1609 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:50.157636 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3502/6972] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:55:51.175969 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bdd120d6-642c-4201-b544-25463cad8c33 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:51.176591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bdd120d6-642c-4201-b544-25463cad8c33 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:51.184080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bdd120d6-642c-4201-b544-25463cad8c33 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:51.184589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bdd120d6-642c-4201-b544-25463cad8c33 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:51.185056 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bdd120d6-642c-4201-b544-25463cad8c33 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:51.185779 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bdd120d6-642c-4201-b544-25463cad8c33 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:51.186359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bdd120d6-642c-4201-b544-25463cad8c33 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:51.186815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bdd120d6-642c-4201-b544-25463cad8c33 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:51.200697 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-bdd120d6-642c-4201-b544-25463cad8c33 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] HTTP exception thrown: Instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 could not be found. Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bdd120d6-642c-4201-b544-25463cad8c33 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Request method failure captured: Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 HTTP/1.1 Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AfT6zYdI3v3j-02bRJESZ0cQX8SQebuMvyOFolxezaFDG4gZ9xnd6e0qCa_-lApgDzu3pztkmmadMDNE7gcIqGRoGofJyFI-POj_4532hTw_ABv1wUgQSAdGvW5EU-lDt-gWQ_upzg4xh3TljemGdTL6S2wIV1BKopo6Mxdcy-27h8 Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: c527dc233da14fc5ab203d0489a8653f Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerActionsTestJSON-1276571273 Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c527dc233da14fc5ab203d0489a8653f"}]}] Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServerActionsTestJSON-1276571273 Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: c527dc233da14fc5ab203d0489a8653f Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerActionsTestJSON-1276571273 Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServerActionsTestJSON-1276571273-project Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 5123a91a38cf4524a1d9ae3a0ab45ee2 Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServerActionsTestJSON-1276571273-project Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 could not be found. Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '561003ab-c65c-4c83-b932-d3de9aedbbb1'} Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 could not be found. Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 could not be found. Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:55:51.202428 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:55:51.206548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:55:51.206548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:55:51.206548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:55:51.206548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:55:51.206548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:55:51.206548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 could not be found. Aug 04 17:55:51.206548 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:55:51.206548 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bdd120d6-642c-4201-b544-25463cad8c33 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Returning 404 to user: Instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:55:51.206548 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bdd120d6-642c-4201-b544-25463cad8c33 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 404 len: 111 microversion: 2.1 time: 0.031967 Aug 04 17:55:51.206548 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3471/6973] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:51 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:55:51.220303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7e6f6c36-b80a-42dd-b01d-be0364e60ab1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:51.221035 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7e6f6c36-b80a-42dd-b01d-be0364e60ab1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:51.228141 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7e6f6c36-b80a-42dd-b01d-be0364e60ab1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:51.228647 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7e6f6c36-b80a-42dd-b01d-be0364e60ab1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:51.229100 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7e6f6c36-b80a-42dd-b01d-be0364e60ab1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:51.229830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7e6f6c36-b80a-42dd-b01d-be0364e60ab1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:51.230329 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7e6f6c36-b80a-42dd-b01d-be0364e60ab1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:51.230766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7e6f6c36-b80a-42dd-b01d-be0364e60ab1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:51.246455 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-7e6f6c36-b80a-42dd-b01d-be0364e60ab1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] HTTP exception thrown: Instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 could not be found. Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7e6f6c36-b80a-42dd-b01d-be0364e60ab1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Request method failure captured: Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 HTTP/1.1 Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7AfT6zYdI3v3j-02bRJESZ0cQX8SQebuMvyOFolxezaFDG4gZ9xnd6e0qCa_-lApgDzu3pztkmmadMDNE7gcIqGRoGofJyFI-POj_4532hTw_ABv1wUgQSAdGvW5EU-lDt-gWQ_upzg4xh3TljemGdTL6S2wIV1BKopo6Mxdcy-27h8 Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: c527dc233da14fc5ab203d0489a8653f Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerActionsTestJSON-1276571273 Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c527dc233da14fc5ab203d0489a8653f"}]}] Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerActionsTestJSON-1276571273 Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: c527dc233da14fc5ab203d0489a8653f Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerActionsTestJSON-1276571273 Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerActionsTestJSON-1276571273-project Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 5123a91a38cf4524a1d9ae3a0ab45ee2 Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerActionsTestJSON-1276571273-project Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 could not be found. Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '561003ab-c65c-4c83-b932-d3de9aedbbb1'} Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 could not be found. Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 could not be found. Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:55:51.248082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:55:51.252727 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:55:51.252727 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:55:51.252727 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:55:51.252727 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:55:51.252727 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:55:51.252727 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 could not be found. Aug 04 17:55:51.252727 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:55:51.252727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7e6f6c36-b80a-42dd-b01d-be0364e60ab1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Returning 404 to user: Instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:55:51.252727 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7e6f6c36-b80a-42dd-b01d-be0364e60ab1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 404 len: 111 microversion: 2.1 time: 0.034923 Aug 04 17:55:51.252727 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3503/6974] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:51 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:55:51.297965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-29cd7a42-6427-46bf-8dcf-7991e6680f38 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-539025446", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "7adc776d-adf3-4203-a12e-826c1017ffea"}], "security_groups": [{"name": "tempest-securitygroup--1273216019"}], "key_name": "tempest-keypair-2056900899", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:55:51.406921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-29cd7a42-6427-46bf-8dcf-7991e6680f38 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] validate_networks() for [('7adc776d-adf3-4203-a12e-826c1017ffea', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:55:51.882361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-29cd7a42-6427-46bf-8dcf-7991e6680f38 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:55:51.882842 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-29cd7a42-6427-46bf-8dcf-7991e6680f38 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:55:51.883351 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-29cd7a42-6427-46bf-8dcf-7991e6680f38 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:55:51.883789 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-29cd7a42-6427-46bf-8dcf-7991e6680f38 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:55:51.884220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-29cd7a42-6427-46bf-8dcf-7991e6680f38 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:55:51.893635 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29cd7a42-6427-46bf-8dcf-7991e6680f38 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:51.894189 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29cd7a42-6427-46bf-8dcf-7991e6680f38 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:51.894652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29cd7a42-6427-46bf-8dcf-7991e6680f38 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:51.895413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29cd7a42-6427-46bf-8dcf-7991e6680f38 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:51.895891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29cd7a42-6427-46bf-8dcf-7991e6680f38 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:51.896335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29cd7a42-6427-46bf-8dcf-7991e6680f38 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:51.916849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-29cd7a42-6427-46bf-8dcf-7991e6680f38 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Getting quotas for project c527dc233da14fc5ab203d0489a8653f. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:55:51.922232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-29cd7a42-6427-46bf-8dcf-7991e6680f38 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Getting quotas for user 5123a91a38cf4524a1d9ae3a0ab45ee2 and project c527dc233da14fc5ab203d0489a8653f. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:55:51.935240 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-29cd7a42-6427-46bf-8dcf-7991e6680f38 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:55:51.937565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-29cd7a42-6427-46bf-8dcf-7991e6680f38 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:55:51.985207 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-29cd7a42-6427-46bf-8dcf-7991e6680f38 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.691204 Aug 04 17:55:51.985868 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3472/6975] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:55:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:55:51.996995 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0d8d74b1-3652-4dbd-b4cd-71d2ed360964 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:51.997627 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0d8d74b1-3652-4dbd-b4cd-71d2ed360964 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:52.052654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0d8d74b1-3652-4dbd-b4cd-71d2ed360964 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:52.059673 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0d8d74b1-3652-4dbd-b4cd-71d2ed360964 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1238 microversion: 2.1 time: 0.066456 Aug 04 17:55:52.060309 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3504/6976] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:51 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:53.085546 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cfba064d-8e2d-430d-ba35-3bb6d8c4cd0f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:53.087019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cfba064d-8e2d-430d-ba35-3bb6d8c4cd0f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:53.094627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfba064d-8e2d-430d-ba35-3bb6d8c4cd0f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:53.095221 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfba064d-8e2d-430d-ba35-3bb6d8c4cd0f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:53.095746 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfba064d-8e2d-430d-ba35-3bb6d8c4cd0f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:53.096686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfba064d-8e2d-430d-ba35-3bb6d8c4cd0f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:53.097168 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfba064d-8e2d-430d-ba35-3bb6d8c4cd0f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:53.097610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfba064d-8e2d-430d-ba35-3bb6d8c4cd0f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:53.176118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cfba064d-8e2d-430d-ba35-3bb6d8c4cd0f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:53.184369 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cfba064d-8e2d-430d-ba35-3bb6d8c4cd0f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1308 microversion: 2.1 time: 0.104771 Aug 04 17:55:53.184928 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3473/6977] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:53 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1308 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:54.205340 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cd8064c9-af4c-469b-b9a8-e34adaf02f95 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:54.206032 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cd8064c9-af4c-469b-b9a8-e34adaf02f95 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:54.214445 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd8064c9-af4c-469b-b9a8-e34adaf02f95 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:54.214842 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd8064c9-af4c-469b-b9a8-e34adaf02f95 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:54.215287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd8064c9-af4c-469b-b9a8-e34adaf02f95 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:54.216043 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd8064c9-af4c-469b-b9a8-e34adaf02f95 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:54.216507 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd8064c9-af4c-469b-b9a8-e34adaf02f95 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:54.216941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd8064c9-af4c-469b-b9a8-e34adaf02f95 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:54.452197 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cd8064c9-af4c-469b-b9a8-e34adaf02f95 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:54.460371 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cd8064c9-af4c-469b-b9a8-e34adaf02f95 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1364 microversion: 2.1 time: 0.258934 Aug 04 17:55:54.460966 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3505/6978] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:54 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1364 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:54.545318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-6421415a-886f-4166-a0e1-fef7de31b59b req-408b7d21-3cc3-49ec-9e81-5d89cdae1978 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f63415b9-a517-40b9-8089-24ec457e10c4", "tag": "f7ea1b63-860c-4cf6-a696-e17aa3ccad9c"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:55:54.557049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6421415a-886f-4166-a0e1-fef7de31b59b req-408b7d21-3cc3-49ec-9e81-5d89cdae1978 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:54.557619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6421415a-886f-4166-a0e1-fef7de31b59b req-408b7d21-3cc3-49ec-9e81-5d89cdae1978 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:54.558136 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6421415a-886f-4166-a0e1-fef7de31b59b req-408b7d21-3cc3-49ec-9e81-5d89cdae1978 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:54.570633 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-6421415a-886f-4166-a0e1-fef7de31b59b req-408b7d21-3cc3-49ec-9e81-5d89cdae1978 service nova] Creating event network-changed:f7ea1b63-860c-4cf6-a696-e17aa3ccad9c for instance f63415b9-a517-40b9-8089-24ec457e10c4 on n-h2-851359-3 Aug 04 17:55:54.575556 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-6421415a-886f-4166-a0e1-fef7de31b59b req-408b7d21-3cc3-49ec-9e81-5d89cdae1978 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034167 Aug 04 17:55:54.576363 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3474/6979] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:55:55.482086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c803c632-55ec-4d68-a558-a02f586049e9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:55.482722 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c803c632-55ec-4d68-a558-a02f586049e9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:55.489576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c803c632-55ec-4d68-a558-a02f586049e9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:55.490110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c803c632-55ec-4d68-a558-a02f586049e9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:55.490570 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c803c632-55ec-4d68-a558-a02f586049e9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:55.491282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c803c632-55ec-4d68-a558-a02f586049e9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:55.491752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c803c632-55ec-4d68-a558-a02f586049e9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:55.492191 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c803c632-55ec-4d68-a558-a02f586049e9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:55.623192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c803c632-55ec-4d68-a558-a02f586049e9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:55.631267 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c803c632-55ec-4d68-a558-a02f586049e9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1364 microversion: 2.1 time: 0.152766 Aug 04 17:55:55.631849 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3506/6980] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:55 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:55:56.654248 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e1f0b3d6-dd69-4bd1-a790-1fe29632e29f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:56.654897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e1f0b3d6-dd69-4bd1-a790-1fe29632e29f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:56.661122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1f0b3d6-dd69-4bd1-a790-1fe29632e29f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:56.661628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1f0b3d6-dd69-4bd1-a790-1fe29632e29f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:56.662125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1f0b3d6-dd69-4bd1-a790-1fe29632e29f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:56.662850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1f0b3d6-dd69-4bd1-a790-1fe29632e29f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:56.663325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1f0b3d6-dd69-4bd1-a790-1fe29632e29f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:56.663779 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1f0b3d6-dd69-4bd1-a790-1fe29632e29f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:56.798098 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e1f0b3d6-dd69-4bd1-a790-1fe29632e29f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:56.809342 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e1f0b3d6-dd69-4bd1-a790-1fe29632e29f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1364 microversion: 2.1 time: 0.160364 Aug 04 17:55:56.809937 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3475/6981] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:56 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:57.830902 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c351219a-0d16-4659-8536-f806e29d28eb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:57.831532 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c351219a-0d16-4659-8536-f806e29d28eb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:57.839234 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c351219a-0d16-4659-8536-f806e29d28eb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:57.839743 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c351219a-0d16-4659-8536-f806e29d28eb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:57.840193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c351219a-0d16-4659-8536-f806e29d28eb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:57.840907 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c351219a-0d16-4659-8536-f806e29d28eb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:57.841373 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c351219a-0d16-4659-8536-f806e29d28eb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:57.841815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c351219a-0d16-4659-8536-f806e29d28eb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:57.976988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c351219a-0d16-4659-8536-f806e29d28eb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:57.985458 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c351219a-0d16-4659-8536-f806e29d28eb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1364 microversion: 2.1 time: 0.158427 Aug 04 17:55:57.986068 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3507/6982] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:57 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:55:59.007956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aad8b420-f511-4ca5-ba97-489683c4340f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:55:59.008496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aad8b420-f511-4ca5-ba97-489683c4340f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:55:59.016869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aad8b420-f511-4ca5-ba97-489683c4340f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:59.017472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aad8b420-f511-4ca5-ba97-489683c4340f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:59.017930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aad8b420-f511-4ca5-ba97-489683c4340f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:59.018689 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aad8b420-f511-4ca5-ba97-489683c4340f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:55:59.019167 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aad8b420-f511-4ca5-ba97-489683c4340f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:55:59.019609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aad8b420-f511-4ca5-ba97-489683c4340f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:55:59.158180 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-aad8b420-f511-4ca5-ba97-489683c4340f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:55:59.165969 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aad8b420-f511-4ca5-ba97-489683c4340f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1364 microversion: 2.1 time: 0.162554 Aug 04 17:55:59.169366 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3476/6983] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:55:59 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:56:00.187148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-464057c2-27a8-4668-9b00-c81f7acbade1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:56:00.187677 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-464057c2-27a8-4668-9b00-c81f7acbade1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:56:00.194620 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-464057c2-27a8-4668-9b00-c81f7acbade1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:56:00.195124 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-464057c2-27a8-4668-9b00-c81f7acbade1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:56:00.195576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-464057c2-27a8-4668-9b00-c81f7acbade1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:56:00.196289 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-464057c2-27a8-4668-9b00-c81f7acbade1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:56:00.196764 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-464057c2-27a8-4668-9b00-c81f7acbade1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:56:00.197202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-464057c2-27a8-4668-9b00-c81f7acbade1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:56:00.337541 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-464057c2-27a8-4668-9b00-c81f7acbade1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:56:00.346097 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-464057c2-27a8-4668-9b00-c81f7acbade1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1364 microversion: 2.1 time: 0.162915 Aug 04 17:56:00.346673 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3508/6984] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:56:00 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:56:01.368525 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-400f4477-3f66-48e3-9653-6752f8f7810a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:56:01.369518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-400f4477-3f66-48e3-9653-6752f8f7810a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:56:01.376909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-400f4477-3f66-48e3-9653-6752f8f7810a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:56:01.377217 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-400f4477-3f66-48e3-9653-6752f8f7810a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:56:01.377725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-400f4477-3f66-48e3-9653-6752f8f7810a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:56:01.378505 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-400f4477-3f66-48e3-9653-6752f8f7810a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:56:01.378965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-400f4477-3f66-48e3-9653-6752f8f7810a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:56:01.379683 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-400f4477-3f66-48e3-9653-6752f8f7810a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:56:01.385949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-5b59b602-a2fe-4af1-b5b8-69dcf733325f req-7fa17fb3-720a-4991-a070-7363b500c0ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f63415b9-a517-40b9-8089-24ec457e10c4", "name": "network-vif-plugged", "status": "completed", "tag": "f7ea1b63-860c-4cf6-a696-e17aa3ccad9c"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:56:01.399663 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-5b59b602-a2fe-4af1-b5b8-69dcf733325f req-7fa17fb3-720a-4991-a070-7363b500c0ac service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:56:01.400132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-5b59b602-a2fe-4af1-b5b8-69dcf733325f req-7fa17fb3-720a-4991-a070-7363b500c0ac service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:56:01.400586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-5b59b602-a2fe-4af1-b5b8-69dcf733325f req-7fa17fb3-720a-4991-a070-7363b500c0ac service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:56:01.414919 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-5b59b602-a2fe-4af1-b5b8-69dcf733325f req-7fa17fb3-720a-4991-a070-7363b500c0ac service nova] Creating event network-vif-plugged:f7ea1b63-860c-4cf6-a696-e17aa3ccad9c for instance f63415b9-a517-40b9-8089-24ec457e10c4 on n-h2-851359-3 Aug 04 17:56:01.421008 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-5b59b602-a2fe-4af1-b5b8-69dcf733325f req-7fa17fb3-720a-4991-a070-7363b500c0ac service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040205 Aug 04 17:56:01.422147 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3509/6985] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:56:01.546794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-400f4477-3f66-48e3-9653-6752f8f7810a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:56:01.557066 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-400f4477-3f66-48e3-9653-6752f8f7810a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1364 microversion: 2.1 time: 0.194255 Aug 04 17:56:01.557659 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3477/6986] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:56:01 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1364 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:56:02.576399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:56:02.581578 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-478f9098-29c7-4029-8d2c-74a4a3cb22d6 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:56:02.582341 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-478f9098-29c7-4029-8d2c-74a4a3cb22d6 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:56:02.589612 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-478f9098-29c7-4029-8d2c-74a4a3cb22d6 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:56:02.590148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-478f9098-29c7-4029-8d2c-74a4a3cb22d6 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:56:02.590603 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-478f9098-29c7-4029-8d2c-74a4a3cb22d6 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:56:02.591316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-478f9098-29c7-4029-8d2c-74a4a3cb22d6 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:56:02.591787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-478f9098-29c7-4029-8d2c-74a4a3cb22d6 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:56:02.592265 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-478f9098-29c7-4029-8d2c-74a4a3cb22d6 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:56:02.725226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-478f9098-29c7-4029-8d2c-74a4a3cb22d6 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:56:02.733060 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-478f9098-29c7-4029-8d2c-74a4a3cb22d6 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1364 microversion: 2.1 time: 0.157606 Aug 04 17:56:02.733629 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3510/6987] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:56:02 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:56:03.754093 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f9e8bf3b-cbae-4502-bd2f-e1e653ee8897 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:56:03.754733 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f9e8bf3b-cbae-4502-bd2f-e1e653ee8897 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:56:03.756777 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:56:03.757469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:56:03.764769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9e8bf3b-cbae-4502-bd2f-e1e653ee8897 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:56:03.765274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9e8bf3b-cbae-4502-bd2f-e1e653ee8897 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:56:03.765730 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9e8bf3b-cbae-4502-bd2f-e1e653ee8897 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:56:03.766478 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9e8bf3b-cbae-4502-bd2f-e1e653ee8897 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:56:03.766952 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9e8bf3b-cbae-4502-bd2f-e1e653ee8897 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:56:03.767399 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9e8bf3b-cbae-4502-bd2f-e1e653ee8897 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:56:03.908125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f9e8bf3b-cbae-4502-bd2f-e1e653ee8897 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:56:03.915973 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f9e8bf3b-cbae-4502-bd2f-e1e653ee8897 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1551 microversion: 2.1 time: 0.165854 Aug 04 17:56:03.916549 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3478/6988] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:56:03 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1551 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:56:03.936478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5e02107e-05b3-4e78-bb95-96ecd6062059 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:56:03.937048 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5e02107e-05b3-4e78-bb95-96ecd6062059 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:56:03.944412 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5e02107e-05b3-4e78-bb95-96ecd6062059 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:56:03.944969 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5e02107e-05b3-4e78-bb95-96ecd6062059 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:56:03.945434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5e02107e-05b3-4e78-bb95-96ecd6062059 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:56:03.946187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5e02107e-05b3-4e78-bb95-96ecd6062059 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:56:03.946655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5e02107e-05b3-4e78-bb95-96ecd6062059 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:56:03.947128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5e02107e-05b3-4e78-bb95-96ecd6062059 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:56:04.029907 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5e02107e-05b3-4e78-bb95-96ecd6062059 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097317 Aug 04 17:56:04.030541 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3511/6989] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Aug 4 17:56:03 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:56:05.157827 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-26ab63ce-5888-4208-9465-fbf58ccf5600 req-2cad5865-141e-434b-b8d6-e63e2faff927 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f63415b9-a517-40b9-8089-24ec457e10c4", "tag": "f7ea1b63-860c-4cf6-a696-e17aa3ccad9c"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:56:05.167943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-26ab63ce-5888-4208-9465-fbf58ccf5600 req-2cad5865-141e-434b-b8d6-e63e2faff927 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:56:05.168451 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-26ab63ce-5888-4208-9465-fbf58ccf5600 req-2cad5865-141e-434b-b8d6-e63e2faff927 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:56:05.168907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-26ab63ce-5888-4208-9465-fbf58ccf5600 req-2cad5865-141e-434b-b8d6-e63e2faff927 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:56:05.181420 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-26ab63ce-5888-4208-9465-fbf58ccf5600 req-2cad5865-141e-434b-b8d6-e63e2faff927 service nova] Creating event network-changed:f7ea1b63-860c-4cf6-a696-e17aa3ccad9c for instance f63415b9-a517-40b9-8089-24ec457e10c4 on n-h2-851359-3 Aug 04 17:56:05.186697 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-26ab63ce-5888-4208-9465-fbf58ccf5600 req-2cad5865-141e-434b-b8d6-e63e2faff927 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086776 Aug 04 17:56:05.187315 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3479/6990] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:57:19.276657 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=23 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:57:19.277432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:57:19.282299 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7108093a-93f3-4c09-965a-ee348e43c4e2 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:57:19.291312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7108093a-93f3-4c09-965a-ee348e43c4e2 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:19.291816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7108093a-93f3-4c09-965a-ee348e43c4e2 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:19.292269 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7108093a-93f3-4c09-965a-ee348e43c4e2 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:19.318145 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7108093a-93f3-4c09-965a-ee348e43c4e2 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Going to try to stop instance {{(pid=131043) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 17:57:19.360159 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7108093a-93f3-4c09-965a-ee348e43c4e2 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "POST /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4/action" status: 202 len: 0 microversion: 2.1 time: 0.085833 Aug 04 17:57:19.360784 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3512/6991] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:57:19 2022] POST /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:57:19.368042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:57:19.368835 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=61 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:57:19.374130 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1ca16128-388c-493d-b182-8cac76aca694 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:19.374885 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1ca16128-388c-493d-b182-8cac76aca694 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:19.383374 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ca16128-388c-493d-b182-8cac76aca694 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:19.383885 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ca16128-388c-493d-b182-8cac76aca694 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:19.384342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ca16128-388c-493d-b182-8cac76aca694 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:19.385073 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ca16128-388c-493d-b182-8cac76aca694 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:19.385549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ca16128-388c-493d-b182-8cac76aca694 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:19.386015 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ca16128-388c-493d-b182-8cac76aca694 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:19.526251 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1ca16128-388c-493d-b182-8cac76aca694 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:19.533887 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1ca16128-388c-493d-b182-8cac76aca694 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1680 microversion: 2.1 time: 0.168537 Aug 04 17:57:19.534482 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3480/6992] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:19 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:57:20.556266 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fc7ca752-7a63-4bc9-96d3-f0aba64ca57c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:20.557058 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fc7ca752-7a63-4bc9-96d3-f0aba64ca57c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:20.563403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc7ca752-7a63-4bc9-96d3-f0aba64ca57c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:20.563928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc7ca752-7a63-4bc9-96d3-f0aba64ca57c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:20.564375 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc7ca752-7a63-4bc9-96d3-f0aba64ca57c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:20.565088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc7ca752-7a63-4bc9-96d3-f0aba64ca57c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:20.565550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc7ca752-7a63-4bc9-96d3-f0aba64ca57c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:20.566011 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc7ca752-7a63-4bc9-96d3-f0aba64ca57c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:20.699959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fc7ca752-7a63-4bc9-96d3-f0aba64ca57c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:20.707452 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fc7ca752-7a63-4bc9-96d3-f0aba64ca57c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1680 microversion: 2.1 time: 0.156314 Aug 04 17:57:20.708023 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3513/6993] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:20 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:57:21.730952 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9411b3ff-a2ef-47ce-b612-f3317de969a1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:21.731672 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9411b3ff-a2ef-47ce-b612-f3317de969a1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:21.738799 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9411b3ff-a2ef-47ce-b612-f3317de969a1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:21.739350 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9411b3ff-a2ef-47ce-b612-f3317de969a1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:21.739872 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9411b3ff-a2ef-47ce-b612-f3317de969a1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:21.740633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9411b3ff-a2ef-47ce-b612-f3317de969a1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:21.741102 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9411b3ff-a2ef-47ce-b612-f3317de969a1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:21.741539 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9411b3ff-a2ef-47ce-b612-f3317de969a1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:21.873210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9411b3ff-a2ef-47ce-b612-f3317de969a1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:21.880974 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9411b3ff-a2ef-47ce-b612-f3317de969a1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1680 microversion: 2.1 time: 0.154730 Aug 04 17:57:21.881539 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3481/6994] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:21 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:57:22.902208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-37bbdfcd-2957-46c7-a334-80b394c66742 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:22.902766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-37bbdfcd-2957-46c7-a334-80b394c66742 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:22.909618 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37bbdfcd-2957-46c7-a334-80b394c66742 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:22.910143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37bbdfcd-2957-46c7-a334-80b394c66742 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:22.910584 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37bbdfcd-2957-46c7-a334-80b394c66742 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:22.911282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37bbdfcd-2957-46c7-a334-80b394c66742 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:22.911742 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37bbdfcd-2957-46c7-a334-80b394c66742 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:22.912172 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-37bbdfcd-2957-46c7-a334-80b394c66742 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:23.052832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-37bbdfcd-2957-46c7-a334-80b394c66742 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:23.061285 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-37bbdfcd-2957-46c7-a334-80b394c66742 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1680 microversion: 2.1 time: 0.163127 Aug 04 17:57:23.061890 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3514/6995] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:22 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:57:24.083186 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-93f679d4-87c5-4b6b-aa7f-0e3d70d5cd65 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:24.083860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-93f679d4-87c5-4b6b-aa7f-0e3d70d5cd65 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:24.091574 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93f679d4-87c5-4b6b-aa7f-0e3d70d5cd65 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:24.092072 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93f679d4-87c5-4b6b-aa7f-0e3d70d5cd65 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:24.092545 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93f679d4-87c5-4b6b-aa7f-0e3d70d5cd65 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:24.093259 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93f679d4-87c5-4b6b-aa7f-0e3d70d5cd65 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:24.093730 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93f679d4-87c5-4b6b-aa7f-0e3d70d5cd65 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:24.094206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93f679d4-87c5-4b6b-aa7f-0e3d70d5cd65 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:24.569586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-93f679d4-87c5-4b6b-aa7f-0e3d70d5cd65 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:24.578773 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-93f679d4-87c5-4b6b-aa7f-0e3d70d5cd65 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1680 microversion: 2.1 time: 0.499758 Aug 04 17:57:24.579361 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3482/6996] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:24 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1680 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:57:25.601251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ce3a8c85-c13a-4fce-9d38-b201dca2c333 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:25.602607 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ce3a8c85-c13a-4fce-9d38-b201dca2c333 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:25.609564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ce3a8c85-c13a-4fce-9d38-b201dca2c333 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:25.610095 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ce3a8c85-c13a-4fce-9d38-b201dca2c333 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:25.610544 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ce3a8c85-c13a-4fce-9d38-b201dca2c333 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:25.611256 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ce3a8c85-c13a-4fce-9d38-b201dca2c333 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:25.611716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ce3a8c85-c13a-4fce-9d38-b201dca2c333 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:25.612148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ce3a8c85-c13a-4fce-9d38-b201dca2c333 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:25.752618 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ce3a8c85-c13a-4fce-9d38-b201dca2c333 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:25.761233 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ce3a8c85-c13a-4fce-9d38-b201dca2c333 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1680 microversion: 2.1 time: 0.163941 Aug 04 17:57:25.761818 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3515/6997] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:25 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:57:26.785253 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7d4affca-2deb-4401-9fc4-9fecd30a2291 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:26.785959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7d4affca-2deb-4401-9fc4-9fecd30a2291 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:26.794095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d4affca-2deb-4401-9fc4-9fecd30a2291 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:26.794608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d4affca-2deb-4401-9fc4-9fecd30a2291 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:26.795067 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d4affca-2deb-4401-9fc4-9fecd30a2291 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:26.795793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d4affca-2deb-4401-9fc4-9fecd30a2291 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:26.796271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d4affca-2deb-4401-9fc4-9fecd30a2291 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:26.796716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d4affca-2deb-4401-9fc4-9fecd30a2291 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:26.938558 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7d4affca-2deb-4401-9fc4-9fecd30a2291 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:26.947178 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7d4affca-2deb-4401-9fc4-9fecd30a2291 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1680 microversion: 2.1 time: 0.166048 Aug 04 17:57:26.947795 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3483/6998] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:26 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:57:27.968715 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dfe7d23e-3ef8-412b-ae96-e0ea8693b188 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:27.969251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dfe7d23e-3ef8-412b-ae96-e0ea8693b188 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:27.976520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfe7d23e-3ef8-412b-ae96-e0ea8693b188 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:27.977609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfe7d23e-3ef8-412b-ae96-e0ea8693b188 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:27.978092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfe7d23e-3ef8-412b-ae96-e0ea8693b188 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:27.978809 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfe7d23e-3ef8-412b-ae96-e0ea8693b188 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:27.979282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfe7d23e-3ef8-412b-ae96-e0ea8693b188 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:27.979724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfe7d23e-3ef8-412b-ae96-e0ea8693b188 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:28.114677 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dfe7d23e-3ef8-412b-ae96-e0ea8693b188 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:28.123847 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dfe7d23e-3ef8-412b-ae96-e0ea8693b188 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1680 microversion: 2.1 time: 0.159071 Aug 04 17:57:28.124578 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3516/6999] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:27 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:57:29.147740 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9e3830f3-6685-47b5-ad2b-adec37ca1603 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:29.148393 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9e3830f3-6685-47b5-ad2b-adec37ca1603 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:29.158751 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e3830f3-6685-47b5-ad2b-adec37ca1603 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:29.159208 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e3830f3-6685-47b5-ad2b-adec37ca1603 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:29.159667 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e3830f3-6685-47b5-ad2b-adec37ca1603 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:29.160393 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e3830f3-6685-47b5-ad2b-adec37ca1603 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:29.160900 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e3830f3-6685-47b5-ad2b-adec37ca1603 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:29.161315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e3830f3-6685-47b5-ad2b-adec37ca1603 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:29.303663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9e3830f3-6685-47b5-ad2b-adec37ca1603 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:29.312078 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9e3830f3-6685-47b5-ad2b-adec37ca1603 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1680 microversion: 2.1 time: 0.169938 Aug 04 17:57:29.312699 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3484/7000] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:29 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:57:30.339856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ba90794f-213b-421d-884f-15a0da568657 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:30.340515 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ba90794f-213b-421d-884f-15a0da568657 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:30.347814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba90794f-213b-421d-884f-15a0da568657 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:30.348307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba90794f-213b-421d-884f-15a0da568657 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:30.348754 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba90794f-213b-421d-884f-15a0da568657 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:30.349491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba90794f-213b-421d-884f-15a0da568657 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:30.349963 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba90794f-213b-421d-884f-15a0da568657 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:30.350428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba90794f-213b-421d-884f-15a0da568657 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:30.481346 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ba90794f-213b-421d-884f-15a0da568657 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:30.489145 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ba90794f-213b-421d-884f-15a0da568657 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1657 microversion: 2.1 time: 0.153652 Aug 04 17:57:30.489689 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3517/7001] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:30 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1657 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:57:30.510057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0d20d99b-1859-48a3-aa62-dc4ca5f38361 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:57:30.512390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0d20d99b-1859-48a3-aa62-dc4ca5f38361 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:30.520176 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d20d99b-1859-48a3-aa62-dc4ca5f38361 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:30.520681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d20d99b-1859-48a3-aa62-dc4ca5f38361 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:30.521140 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d20d99b-1859-48a3-aa62-dc4ca5f38361 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:30.521915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d20d99b-1859-48a3-aa62-dc4ca5f38361 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:30.522832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d20d99b-1859-48a3-aa62-dc4ca5f38361 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:30.524283 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d20d99b-1859-48a3-aa62-dc4ca5f38361 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:30.555740 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0d20d99b-1859-48a3-aa62-dc4ca5f38361 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:30.562281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0d20d99b-1859-48a3-aa62-dc4ca5f38361 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Old instance type m1.heat2, new instance type m1.heat {{(pid=131044) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 17:57:30.568751 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0d20d99b-1859-48a3-aa62-dc4ca5f38361 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:57:30.569193 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0d20d99b-1859-48a3-aa62-dc4ca5f38361 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:57:30.569687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0d20d99b-1859-48a3-aa62-dc4ca5f38361 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:57:30.570145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0d20d99b-1859-48a3-aa62-dc4ca5f38361 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:57:30.570600 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0d20d99b-1859-48a3-aa62-dc4ca5f38361 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:57:30.636241 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0d20d99b-1859-48a3-aa62-dc4ca5f38361 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "POST /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4/action" status: 202 len: 0 microversion: 2.1 time: 0.130490 Aug 04 17:57:30.637086 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3485/7002] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:57:30 2022] POST /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:57:30.645600 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e94d34b5-9944-4012-a49c-b4be78644460 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:30.646326 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e94d34b5-9944-4012-a49c-b4be78644460 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:30.653532 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e94d34b5-9944-4012-a49c-b4be78644460 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:30.653904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e94d34b5-9944-4012-a49c-b4be78644460 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:30.654387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e94d34b5-9944-4012-a49c-b4be78644460 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:30.655111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e94d34b5-9944-4012-a49c-b4be78644460 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:30.655576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e94d34b5-9944-4012-a49c-b4be78644460 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:30.656013 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e94d34b5-9944-4012-a49c-b4be78644460 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:30.804857 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e94d34b5-9944-4012-a49c-b4be78644460 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:30.813509 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e94d34b5-9944-4012-a49c-b4be78644460 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1680 microversion: 2.1 time: 0.171795 Aug 04 17:57:30.814202 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3518/7003] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:30 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:57:31.836817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-667402d4-4618-4c68-9e38-244fb84a1220 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:31.837464 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-667402d4-4618-4c68-9e38-244fb84a1220 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:31.848280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-667402d4-4618-4c68-9e38-244fb84a1220 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:31.848800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-667402d4-4618-4c68-9e38-244fb84a1220 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:31.849264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-667402d4-4618-4c68-9e38-244fb84a1220 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:31.850047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-667402d4-4618-4c68-9e38-244fb84a1220 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:31.850538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-667402d4-4618-4c68-9e38-244fb84a1220 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:31.851145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-667402d4-4618-4c68-9e38-244fb84a1220 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:31.988703 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-667402d4-4618-4c68-9e38-244fb84a1220 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:31.997407 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-667402d4-4618-4c68-9e38-244fb84a1220 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1680 microversion: 2.1 time: 0.166708 Aug 04 17:57:31.998021 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3486/7004] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:31 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:57:33.019146 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1dc1d167-a267-4a06-8bda-979c4a04286b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:33.019823 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1dc1d167-a267-4a06-8bda-979c4a04286b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:33.027233 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1dc1d167-a267-4a06-8bda-979c4a04286b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:33.027757 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1dc1d167-a267-4a06-8bda-979c4a04286b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:33.028181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1dc1d167-a267-4a06-8bda-979c4a04286b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:33.028896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1dc1d167-a267-4a06-8bda-979c4a04286b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:33.029358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1dc1d167-a267-4a06-8bda-979c4a04286b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:33.029784 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1dc1d167-a267-4a06-8bda-979c4a04286b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:33.175697 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1dc1d167-a267-4a06-8bda-979c4a04286b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:33.184808 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1dc1d167-a267-4a06-8bda-979c4a04286b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1685 microversion: 2.1 time: 0.169994 Aug 04 17:57:33.185415 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3519/7005] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:33 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1685 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:57:34.207081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4a8c983e-a1f9-499b-9b7a-53a43a4a04d2 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:34.207721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4a8c983e-a1f9-499b-9b7a-53a43a4a04d2 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:34.214631 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a8c983e-a1f9-499b-9b7a-53a43a4a04d2 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:34.215131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a8c983e-a1f9-499b-9b7a-53a43a4a04d2 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:34.215586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a8c983e-a1f9-499b-9b7a-53a43a4a04d2 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:34.216302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a8c983e-a1f9-499b-9b7a-53a43a4a04d2 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:34.216779 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a8c983e-a1f9-499b-9b7a-53a43a4a04d2 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:34.217222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a8c983e-a1f9-499b-9b7a-53a43a4a04d2 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:34.366238 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4a8c983e-a1f9-499b-9b7a-53a43a4a04d2 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:34.374869 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4a8c983e-a1f9-499b-9b7a-53a43a4a04d2 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1685 microversion: 2.1 time: 0.171671 Aug 04 17:57:34.375468 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3487/7006] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:34 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:57:35.399404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a25f0367-1e88-4951-8b01-1d7dccf88afa tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:35.400433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a25f0367-1e88-4951-8b01-1d7dccf88afa tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:35.409612 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a25f0367-1e88-4951-8b01-1d7dccf88afa tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:35.410325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a25f0367-1e88-4951-8b01-1d7dccf88afa tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:35.410897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a25f0367-1e88-4951-8b01-1d7dccf88afa tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:35.412042 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a25f0367-1e88-4951-8b01-1d7dccf88afa tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:35.412862 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a25f0367-1e88-4951-8b01-1d7dccf88afa tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:35.414963 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a25f0367-1e88-4951-8b01-1d7dccf88afa tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:35.668135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a25f0367-1e88-4951-8b01-1d7dccf88afa tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:35.678582 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a25f0367-1e88-4951-8b01-1d7dccf88afa tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1684 microversion: 2.1 time: 0.284627 Aug 04 17:57:35.679207 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3520/7007] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:35 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1684 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:57:35.770509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-482b4b79-03de-4c8a-b4d8-fdb4f9e1ba01 req-3b2adda3-57a8-461d-8453-acce48399e91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f63415b9-a517-40b9-8089-24ec457e10c4", "name": "network-vif-unplugged", "status": "completed", "tag": "f7ea1b63-860c-4cf6-a696-e17aa3ccad9c"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:57:35.784721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-482b4b79-03de-4c8a-b4d8-fdb4f9e1ba01 req-3b2adda3-57a8-461d-8453-acce48399e91 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:35.785207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-482b4b79-03de-4c8a-b4d8-fdb4f9e1ba01 req-3b2adda3-57a8-461d-8453-acce48399e91 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:35.785959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-482b4b79-03de-4c8a-b4d8-fdb4f9e1ba01 req-3b2adda3-57a8-461d-8453-acce48399e91 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:35.801816 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-482b4b79-03de-4c8a-b4d8-fdb4f9e1ba01 req-3b2adda3-57a8-461d-8453-acce48399e91 service nova] Creating event network-vif-unplugged:f7ea1b63-860c-4cf6-a696-e17aa3ccad9c for instance f63415b9-a517-40b9-8089-24ec457e10c4 on n-h1-851359-3 Aug 04 17:57:35.808725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-482b4b79-03de-4c8a-b4d8-fdb4f9e1ba01 req-3b2adda3-57a8-461d-8453-acce48399e91 service nova] Instance f63415b9-a517-40b9-8089-24ec457e10c4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:57:35.822739 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-482b4b79-03de-4c8a-b4d8-fdb4f9e1ba01 req-3b2adda3-57a8-461d-8453-acce48399e91 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057306 Aug 04 17:57:35.823531 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3488/7008] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:57:36.704890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c08e95e5-78a0-4341-af4f-3c0045e6177f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:36.707118 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c08e95e5-78a0-4341-af4f-3c0045e6177f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:36.721128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c08e95e5-78a0-4341-af4f-3c0045e6177f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:36.722132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c08e95e5-78a0-4341-af4f-3c0045e6177f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:36.723025 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c08e95e5-78a0-4341-af4f-3c0045e6177f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:36.724451 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c08e95e5-78a0-4341-af4f-3c0045e6177f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:36.725326 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c08e95e5-78a0-4341-af4f-3c0045e6177f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:36.726290 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c08e95e5-78a0-4341-af4f-3c0045e6177f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:37.131536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c08e95e5-78a0-4341-af4f-3c0045e6177f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:37.140571 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c08e95e5-78a0-4341-af4f-3c0045e6177f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1684 microversion: 2.1 time: 0.443878 Aug 04 17:57:37.141189 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3521/7009] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:36 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1684 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:57:37.853325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-765c1ea4-2a23-4ad0-aab6-f885481a10a6 req-5590a050-1f96-4a03-af1e-0cfcb0f0f710 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f63415b9-a517-40b9-8089-24ec457e10c4", "tag": "f7ea1b63-860c-4cf6-a696-e17aa3ccad9c"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:57:37.865192 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-765c1ea4-2a23-4ad0-aab6-f885481a10a6 req-5590a050-1f96-4a03-af1e-0cfcb0f0f710 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:37.865857 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-765c1ea4-2a23-4ad0-aab6-f885481a10a6 req-5590a050-1f96-4a03-af1e-0cfcb0f0f710 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:37.866342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-765c1ea4-2a23-4ad0-aab6-f885481a10a6 req-5590a050-1f96-4a03-af1e-0cfcb0f0f710 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:37.879581 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-765c1ea4-2a23-4ad0-aab6-f885481a10a6 req-5590a050-1f96-4a03-af1e-0cfcb0f0f710 service nova] Creating event network-changed:f7ea1b63-860c-4cf6-a696-e17aa3ccad9c for instance f63415b9-a517-40b9-8089-24ec457e10c4 on n-h1-851359-3 Aug 04 17:57:37.886338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-765c1ea4-2a23-4ad0-aab6-f885481a10a6 req-5590a050-1f96-4a03-af1e-0cfcb0f0f710 service nova] Instance f63415b9-a517-40b9-8089-24ec457e10c4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:57:37.897792 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-765c1ea4-2a23-4ad0-aab6-f885481a10a6 req-5590a050-1f96-4a03-af1e-0cfcb0f0f710 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049528 Aug 04 17:57:37.898692 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3489/7010] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:57:38.167362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cb07583d-aeca-4f11-9216-0dfa3fcf885e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:38.168598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cb07583d-aeca-4f11-9216-0dfa3fcf885e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:38.181271 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb07583d-aeca-4f11-9216-0dfa3fcf885e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:38.182217 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb07583d-aeca-4f11-9216-0dfa3fcf885e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:38.183152 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb07583d-aeca-4f11-9216-0dfa3fcf885e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:38.184308 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb07583d-aeca-4f11-9216-0dfa3fcf885e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:38.185190 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb07583d-aeca-4f11-9216-0dfa3fcf885e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:38.186006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cb07583d-aeca-4f11-9216-0dfa3fcf885e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:38.454918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cb07583d-aeca-4f11-9216-0dfa3fcf885e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:38.464044 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cb07583d-aeca-4f11-9216-0dfa3fcf885e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1682 microversion: 2.1 time: 0.305953 Aug 04 17:57:38.465229 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3522/7011] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:38 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1682 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:57:39.491315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dbe5f331-2680-4612-b330-6268145e52d1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:39.492196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dbe5f331-2680-4612-b330-6268145e52d1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:39.499057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbe5f331-2680-4612-b330-6268145e52d1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:39.499627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbe5f331-2680-4612-b330-6268145e52d1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:39.500167 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbe5f331-2680-4612-b330-6268145e52d1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:39.501099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbe5f331-2680-4612-b330-6268145e52d1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:39.501628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbe5f331-2680-4612-b330-6268145e52d1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:39.502209 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbe5f331-2680-4612-b330-6268145e52d1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:39.652966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dbe5f331-2680-4612-b330-6268145e52d1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:39.667355 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dbe5f331-2680-4612-b330-6268145e52d1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1678 microversion: 2.1 time: 0.181964 Aug 04 17:57:39.668448 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3490/7012] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:39 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1678 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:57:39.690987 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-da459119-3355-4e42-b33a-c5241f9bec3b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:57:39.691650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-da459119-3355-4e42-b33a-c5241f9bec3b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:39.699036 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-da459119-3355-4e42-b33a-c5241f9bec3b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:39.699530 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-da459119-3355-4e42-b33a-c5241f9bec3b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:39.699975 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-da459119-3355-4e42-b33a-c5241f9bec3b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:39.700696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-da459119-3355-4e42-b33a-c5241f9bec3b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:39.701187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-da459119-3355-4e42-b33a-c5241f9bec3b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:39.701618 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-da459119-3355-4e42-b33a-c5241f9bec3b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:39.811188 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-da459119-3355-4e42-b33a-c5241f9bec3b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "POST /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4/action" status: 204 len: 0 microversion: 2.1 time: 0.123064 Aug 04 17:57:39.812428 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3523/7013] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:57:39 2022] POST /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4/action => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:57:39.827466 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b434173b-cf46-474f-9335-b476b5eecf95 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:39.828622 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b434173b-cf46-474f-9335-b476b5eecf95 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:39.841787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b434173b-cf46-474f-9335-b476b5eecf95 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:39.843154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b434173b-cf46-474f-9335-b476b5eecf95 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:39.844260 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b434173b-cf46-474f-9335-b476b5eecf95 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:39.845858 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b434173b-cf46-474f-9335-b476b5eecf95 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:39.846781 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b434173b-cf46-474f-9335-b476b5eecf95 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:39.847820 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b434173b-cf46-474f-9335-b476b5eecf95 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:40.135432 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b434173b-cf46-474f-9335-b476b5eecf95 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:40.144846 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b434173b-cf46-474f-9335-b476b5eecf95 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1678 microversion: 2.1 time: 0.325682 Aug 04 17:57:40.145585 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3491/7014] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:39 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1678 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:57:41.174051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f1a38aae-6d0a-4a97-b26e-a05ea9913997 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:41.175018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f1a38aae-6d0a-4a97-b26e-a05ea9913997 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:41.186652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1a38aae-6d0a-4a97-b26e-a05ea9913997 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:41.187226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1a38aae-6d0a-4a97-b26e-a05ea9913997 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:41.187811 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1a38aae-6d0a-4a97-b26e-a05ea9913997 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:41.188562 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1a38aae-6d0a-4a97-b26e-a05ea9913997 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:41.189029 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1a38aae-6d0a-4a97-b26e-a05ea9913997 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:41.189457 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f1a38aae-6d0a-4a97-b26e-a05ea9913997 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:41.433676 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f1a38aae-6d0a-4a97-b26e-a05ea9913997 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:41.448678 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f1a38aae-6d0a-4a97-b26e-a05ea9913997 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1678 microversion: 2.1 time: 0.284998 Aug 04 17:57:41.449676 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3524/7015] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:41 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1678 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:57:41.987304 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-09a403bc-5644-430e-a9af-a07e2f1173e2 req-e29db6aa-6fba-4d7d-b007-b55f314b3564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f63415b9-a517-40b9-8089-24ec457e10c4", "name": "network-vif-plugged", "status": "completed", "tag": "f7ea1b63-860c-4cf6-a696-e17aa3ccad9c"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:57:42.003020 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-09a403bc-5644-430e-a9af-a07e2f1173e2 req-e29db6aa-6fba-4d7d-b007-b55f314b3564 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:42.005429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-09a403bc-5644-430e-a9af-a07e2f1173e2 req-e29db6aa-6fba-4d7d-b007-b55f314b3564 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:42.005429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-09a403bc-5644-430e-a9af-a07e2f1173e2 req-e29db6aa-6fba-4d7d-b007-b55f314b3564 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:42.023061 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-09a403bc-5644-430e-a9af-a07e2f1173e2 req-e29db6aa-6fba-4d7d-b007-b55f314b3564 service nova] Creating event network-vif-plugged:f7ea1b63-860c-4cf6-a696-e17aa3ccad9c for instance f63415b9-a517-40b9-8089-24ec457e10c4 on n-h1-851359-3 Aug 04 17:57:42.029520 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-09a403bc-5644-430e-a9af-a07e2f1173e2 req-e29db6aa-6fba-4d7d-b007-b55f314b3564 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047044 Aug 04 17:57:42.030270 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3492/7016] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:57:42.476721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b833d7ae-a758-42fe-9a13-72cdc1f31e98 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:42.477351 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b833d7ae-a758-42fe-9a13-72cdc1f31e98 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:42.484286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b833d7ae-a758-42fe-9a13-72cdc1f31e98 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:42.484785 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b833d7ae-a758-42fe-9a13-72cdc1f31e98 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:42.485236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b833d7ae-a758-42fe-9a13-72cdc1f31e98 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:42.485945 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b833d7ae-a758-42fe-9a13-72cdc1f31e98 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:42.486455 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b833d7ae-a758-42fe-9a13-72cdc1f31e98 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:42.486890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b833d7ae-a758-42fe-9a13-72cdc1f31e98 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:42.623921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b833d7ae-a758-42fe-9a13-72cdc1f31e98 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:42.631928 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b833d7ae-a758-42fe-9a13-72cdc1f31e98 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1657 microversion: 2.1 time: 0.159175 Aug 04 17:57:42.633014 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3525/7017] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:42 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1657 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:57:42.654044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-612c65cc-224b-4580-bb28-3bb05269f95e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:42.654777 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-612c65cc-224b-4580-bb28-3bb05269f95e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:42.661073 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-612c65cc-224b-4580-bb28-3bb05269f95e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:42.661586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-612c65cc-224b-4580-bb28-3bb05269f95e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:42.662082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-612c65cc-224b-4580-bb28-3bb05269f95e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:42.662802 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-612c65cc-224b-4580-bb28-3bb05269f95e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:42.663278 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-612c65cc-224b-4580-bb28-3bb05269f95e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:42.663723 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-612c65cc-224b-4580-bb28-3bb05269f95e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:42.863913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-612c65cc-224b-4580-bb28-3bb05269f95e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:42.871947 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-612c65cc-224b-4580-bb28-3bb05269f95e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1657 microversion: 2.1 time: 0.222201 Aug 04 17:57:42.872530 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3493/7018] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:42 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1657 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:57:42.892644 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d3de532c-c3d6-429b-bc10-7ea2d964c725 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:57:42.899694 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3de532c-c3d6-429b-bc10-7ea2d964c725 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:42.900202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3de532c-c3d6-429b-bc10-7ea2d964c725 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:42.900659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3de532c-c3d6-429b-bc10-7ea2d964c725 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:42.917447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:57:42.927756 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d3de532c-c3d6-429b-bc10-7ea2d964c725 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Going to try to start instance {{(pid=131043) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 17:57:42.973461 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d3de532c-c3d6-429b-bc10-7ea2d964c725 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "POST /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4/action" status: 202 len: 0 microversion: 2.1 time: 0.084639 Aug 04 17:57:42.974106 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3526/7019] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:57:42 2022] POST /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:57:42.985101 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8176abe2-b7fc-4960-bab3-4560ffc7094c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:42.986212 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8176abe2-b7fc-4960-bab3-4560ffc7094c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:42.996174 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8176abe2-b7fc-4960-bab3-4560ffc7094c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:42.996802 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8176abe2-b7fc-4960-bab3-4560ffc7094c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:42.997160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8176abe2-b7fc-4960-bab3-4560ffc7094c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:42.998039 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8176abe2-b7fc-4960-bab3-4560ffc7094c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:42.998717 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8176abe2-b7fc-4960-bab3-4560ffc7094c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:42.999213 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8176abe2-b7fc-4960-bab3-4560ffc7094c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:43.118312 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:57:43.118575 n-d-851359-3 devstack@n-api.service[131044]: Thu Aug 4 17:57:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 (ip 10.222.0.93) !!! Aug 04 17:57:43.239292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8176abe2-b7fc-4960-bab3-4560ffc7094c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:43.247777 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8176abe2-b7fc-4960-bab3-4560ffc7094c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1666 microversion: 2.1 time: 0.268036 Aug 04 17:57:43.248195 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:57:43.259218 n-d-851359-3 devstack@n-api.service[131043]: Thu Aug 4 17:57:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 17:57:43.259512 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3494/7020] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:42 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1666 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:57:44.271348 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-08274e86-d8c2-46c8-a70e-f2637f25b00c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:44.272057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-08274e86-d8c2-46c8-a70e-f2637f25b00c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:44.278780 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-08274e86-d8c2-46c8-a70e-f2637f25b00c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:44.279285 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-08274e86-d8c2-46c8-a70e-f2637f25b00c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:44.279738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-08274e86-d8c2-46c8-a70e-f2637f25b00c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:44.280464 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-08274e86-d8c2-46c8-a70e-f2637f25b00c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:44.280962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-08274e86-d8c2-46c8-a70e-f2637f25b00c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:44.281399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-08274e86-d8c2-46c8-a70e-f2637f25b00c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:44.426453 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-08274e86-d8c2-46c8-a70e-f2637f25b00c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:44.434897 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-08274e86-d8c2-46c8-a70e-f2637f25b00c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1670 microversion: 2.1 time: 0.169025 Aug 04 17:57:44.435499 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3527/7021] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:44 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1670 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:57:44.455554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3ed8cbf3-1b30-4900-b6ab-5df678f8aa24 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:44.456078 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3ed8cbf3-1b30-4900-b6ab-5df678f8aa24 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:44.463464 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ed8cbf3-1b30-4900-b6ab-5df678f8aa24 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:44.463972 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ed8cbf3-1b30-4900-b6ab-5df678f8aa24 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:44.464428 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ed8cbf3-1b30-4900-b6ab-5df678f8aa24 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:44.465150 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ed8cbf3-1b30-4900-b6ab-5df678f8aa24 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:44.465626 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ed8cbf3-1b30-4900-b6ab-5df678f8aa24 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:44.466105 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ed8cbf3-1b30-4900-b6ab-5df678f8aa24 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:44.493202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3ed8cbf3-1b30-4900-b6ab-5df678f8aa24 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:57:44.520795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:57:44.578812 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3ed8cbf3-1b30-4900-b6ab-5df678f8aa24 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 204 len: 0 microversion: 2.1 time: 0.126445 Aug 04 17:57:44.580081 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3495/7022] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:57:44 2022] DELETE /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:57:44.590633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8a9e04f9-1adb-4f2f-ab7f-d6abd30e65c4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:44.591265 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8a9e04f9-1adb-4f2f-ab7f-d6abd30e65c4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:44.598409 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a9e04f9-1adb-4f2f-ab7f-d6abd30e65c4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:44.598919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a9e04f9-1adb-4f2f-ab7f-d6abd30e65c4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:44.599373 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a9e04f9-1adb-4f2f-ab7f-d6abd30e65c4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:44.600135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a9e04f9-1adb-4f2f-ab7f-d6abd30e65c4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:44.600628 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a9e04f9-1adb-4f2f-ab7f-d6abd30e65c4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:44.601065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a9e04f9-1adb-4f2f-ab7f-d6abd30e65c4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:44.740054 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8a9e04f9-1adb-4f2f-ab7f-d6abd30e65c4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:44.747896 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8a9e04f9-1adb-4f2f-ab7f-d6abd30e65c4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1676 microversion: 2.1 time: 0.162437 Aug 04 17:57:44.748482 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3528/7023] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:44 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:57:45.771907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9215d6ef-2b63-4e8a-996e-2f77d7c0cc05 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:45.773671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9215d6ef-2b63-4e8a-996e-2f77d7c0cc05 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:45.781241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9215d6ef-2b63-4e8a-996e-2f77d7c0cc05 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:45.781753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9215d6ef-2b63-4e8a-996e-2f77d7c0cc05 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:45.782244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9215d6ef-2b63-4e8a-996e-2f77d7c0cc05 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:45.782984 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9215d6ef-2b63-4e8a-996e-2f77d7c0cc05 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:45.783487 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9215d6ef-2b63-4e8a-996e-2f77d7c0cc05 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:45.784014 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9215d6ef-2b63-4e8a-996e-2f77d7c0cc05 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:45.930769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9215d6ef-2b63-4e8a-996e-2f77d7c0cc05 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:45.938577 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9215d6ef-2b63-4e8a-996e-2f77d7c0cc05 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1676 microversion: 2.1 time: 0.172268 Aug 04 17:57:45.939156 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3496/7024] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:45 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:57:46.961325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-83ec10e7-b426-4942-8e70-314b0423bc78 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:46.962158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-83ec10e7-b426-4942-8e70-314b0423bc78 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:46.970034 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83ec10e7-b426-4942-8e70-314b0423bc78 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:46.970521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83ec10e7-b426-4942-8e70-314b0423bc78 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:46.970979 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83ec10e7-b426-4942-8e70-314b0423bc78 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:46.971718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83ec10e7-b426-4942-8e70-314b0423bc78 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:46.972191 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83ec10e7-b426-4942-8e70-314b0423bc78 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:46.972631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83ec10e7-b426-4942-8e70-314b0423bc78 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:47.198859 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-83ec10e7-b426-4942-8e70-314b0423bc78 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:47.208008 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-83ec10e7-b426-4942-8e70-314b0423bc78 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 200 len: 1608 microversion: 2.1 time: 0.250623 Aug 04 17:57:47.208837 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3529/7025] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:46 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 1608 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:57:47.407887 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-e386f90e-5ac7-4f23-9285-b3361f2d1659 req-93d1ea2b-3a51-4b45-ba12-41e410328fee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f63415b9-a517-40b9-8089-24ec457e10c4", "name": "network-vif-deleted", "tag": "f7ea1b63-860c-4cf6-a696-e17aa3ccad9c"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:57:47.421367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e386f90e-5ac7-4f23-9285-b3361f2d1659 req-93d1ea2b-3a51-4b45-ba12-41e410328fee service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:47.422303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e386f90e-5ac7-4f23-9285-b3361f2d1659 req-93d1ea2b-3a51-4b45-ba12-41e410328fee service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:47.423197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e386f90e-5ac7-4f23-9285-b3361f2d1659 req-93d1ea2b-3a51-4b45-ba12-41e410328fee service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:47.440085 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-e386f90e-5ac7-4f23-9285-b3361f2d1659 req-93d1ea2b-3a51-4b45-ba12-41e410328fee service nova] Creating event network-vif-deleted:f7ea1b63-860c-4cf6-a696-e17aa3ccad9c for instance f63415b9-a517-40b9-8089-24ec457e10c4 on n-h1-851359-3 Aug 04 17:57:47.450109 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-e386f90e-5ac7-4f23-9285-b3361f2d1659 req-93d1ea2b-3a51-4b45-ba12-41e410328fee service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045392 Aug 04 17:57:47.451706 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3497/7026] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:57:48.231280 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f33cb4a1-ec6e-40f4-8cad-fe2bfb2492cb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:48.231906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f33cb4a1-ec6e-40f4-8cad-fe2bfb2492cb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:48.239069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f33cb4a1-ec6e-40f4-8cad-fe2bfb2492cb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:48.239568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f33cb4a1-ec6e-40f4-8cad-fe2bfb2492cb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:48.240036 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f33cb4a1-ec6e-40f4-8cad-fe2bfb2492cb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:48.240763 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f33cb4a1-ec6e-40f4-8cad-fe2bfb2492cb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:48.241228 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f33cb4a1-ec6e-40f4-8cad-fe2bfb2492cb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:48.241757 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f33cb4a1-ec6e-40f4-8cad-fe2bfb2492cb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:48.256604 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-f33cb4a1-ec6e-40f4-8cad-fe2bfb2492cb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] HTTP exception thrown: Instance f63415b9-a517-40b9-8089-24ec457e10c4 could not be found. Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f33cb4a1-ec6e-40f4-8cad-fe2bfb2492cb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Request method failure captured: Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 HTTP/1.1 Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7AfT6zYdI3v3j-02bRJESZ0cQX8SQebuMvyOFolxezaFDG4gZ9xnd6e0qCa_-lApgDzu3pztkmmadMDNE7gcIqGRoGofJyFI-POj_4532hTw_ABv1wUgQSAdGvW5EU-lDt-gWQ_upzg4xh3TljemGdTL6S2wIV1BKopo6Mxdcy-27h8 Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: c527dc233da14fc5ab203d0489a8653f Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerActionsTestJSON-1276571273 Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c527dc233da14fc5ab203d0489a8653f"}]}] Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerActionsTestJSON-1276571273 Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: c527dc233da14fc5ab203d0489a8653f Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerActionsTestJSON-1276571273 Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerActionsTestJSON-1276571273-project Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 5123a91a38cf4524a1d9ae3a0ab45ee2 Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerActionsTestJSON-1276571273-project Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance f63415b9-a517-40b9-8089-24ec457e10c4 could not be found. Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'f63415b9-a517-40b9-8089-24ec457e10c4'} Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f63415b9-a517-40b9-8089-24ec457e10c4 could not be found. Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f63415b9-a517-40b9-8089-24ec457e10c4 could not be found. Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:57:48.258426 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:57:48.265605 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:57:48.265605 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:57:48.265605 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:57:48.265605 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:57:48.265605 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:57:48.265605 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f63415b9-a517-40b9-8089-24ec457e10c4 could not be found. Aug 04 17:57:48.265605 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:57:48.265605 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f33cb4a1-ec6e-40f4-8cad-fe2bfb2492cb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Returning 404 to user: Instance f63415b9-a517-40b9-8089-24ec457e10c4 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:57:48.265605 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f33cb4a1-ec6e-40f4-8cad-fe2bfb2492cb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 404 len: 111 microversion: 2.1 time: 0.032517 Aug 04 17:57:48.265605 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3530/7027] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:48 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:57:48.279338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7ae7ef8a-a3c5-4d1e-a38d-16847a9f7f4b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:48.279859 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7ae7ef8a-a3c5-4d1e-a38d-16847a9f7f4b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:48.286909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ae7ef8a-a3c5-4d1e-a38d-16847a9f7f4b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:48.292316 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ae7ef8a-a3c5-4d1e-a38d-16847a9f7f4b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:48.292949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ae7ef8a-a3c5-4d1e-a38d-16847a9f7f4b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:48.293762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ae7ef8a-a3c5-4d1e-a38d-16847a9f7f4b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:48.294436 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ae7ef8a-a3c5-4d1e-a38d-16847a9f7f4b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:48.294908 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ae7ef8a-a3c5-4d1e-a38d-16847a9f7f4b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:48.312774 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-7ae7ef8a-a3c5-4d1e-a38d-16847a9f7f4b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] HTTP exception thrown: Instance f63415b9-a517-40b9-8089-24ec457e10c4 could not be found. Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7ae7ef8a-a3c5-4d1e-a38d-16847a9f7f4b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Request method failure captured: Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 HTTP/1.1 Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AfT6zYdI3v3j-02bRJESZ0cQX8SQebuMvyOFolxezaFDG4gZ9xnd6e0qCa_-lApgDzu3pztkmmadMDNE7gcIqGRoGofJyFI-POj_4532hTw_ABv1wUgQSAdGvW5EU-lDt-gWQ_upzg4xh3TljemGdTL6S2wIV1BKopo6Mxdcy-27h8 Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: c527dc233da14fc5ab203d0489a8653f Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerActionsTestJSON-1276571273 Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c527dc233da14fc5ab203d0489a8653f"}]}] Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServerActionsTestJSON-1276571273 Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: c527dc233da14fc5ab203d0489a8653f Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerActionsTestJSON-1276571273 Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServerActionsTestJSON-1276571273-project Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 5123a91a38cf4524a1d9ae3a0ab45ee2 Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServerActionsTestJSON-1276571273-project Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance f63415b9-a517-40b9-8089-24ec457e10c4 could not be found. Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'f63415b9-a517-40b9-8089-24ec457e10c4'} Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f63415b9-a517-40b9-8089-24ec457e10c4 could not be found. Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f63415b9-a517-40b9-8089-24ec457e10c4 could not be found. Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:57:48.314543 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:57:48.319708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:57:48.319708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:57:48.319708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:57:48.319708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:57:48.319708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:57:48.319708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f63415b9-a517-40b9-8089-24ec457e10c4 could not be found. Aug 04 17:57:48.319708 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:57:48.319708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7ae7ef8a-a3c5-4d1e-a38d-16847a9f7f4b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Returning 404 to user: Instance f63415b9-a517-40b9-8089-24ec457e10c4 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:57:48.319708 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7ae7ef8a-a3c5-4d1e-a38d-16847a9f7f4b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 404 len: 111 microversion: 2.1 time: 0.043012 Aug 04 17:57:48.319708 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3498/7028] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:48 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:57:48.379350 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-70e3878b-268d-4554-8ecf-176b727e6e56 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-979178959", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "7adc776d-adf3-4203-a12e-826c1017ffea"}], "security_groups": [{"name": "tempest-securitygroup--1273216019"}], "key_name": "tempest-keypair-2056900899", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:57:48.515002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-70e3878b-268d-4554-8ecf-176b727e6e56 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] validate_networks() for [('7adc776d-adf3-4203-a12e-826c1017ffea', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:57:48.926759 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-70e3878b-268d-4554-8ecf-176b727e6e56 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:57:48.927236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-70e3878b-268d-4554-8ecf-176b727e6e56 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:57:48.927718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-70e3878b-268d-4554-8ecf-176b727e6e56 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:57:48.928139 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-70e3878b-268d-4554-8ecf-176b727e6e56 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:57:48.928582 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-70e3878b-268d-4554-8ecf-176b727e6e56 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:57:48.938318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70e3878b-268d-4554-8ecf-176b727e6e56 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:48.938809 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70e3878b-268d-4554-8ecf-176b727e6e56 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:48.939253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70e3878b-268d-4554-8ecf-176b727e6e56 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:48.939994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70e3878b-268d-4554-8ecf-176b727e6e56 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:48.940463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70e3878b-268d-4554-8ecf-176b727e6e56 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:48.940895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-70e3878b-268d-4554-8ecf-176b727e6e56 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:48.958869 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-70e3878b-268d-4554-8ecf-176b727e6e56 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Getting quotas for project c527dc233da14fc5ab203d0489a8653f. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:57:48.964444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-70e3878b-268d-4554-8ecf-176b727e6e56 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Getting quotas for user 5123a91a38cf4524a1d9ae3a0ab45ee2 and project c527dc233da14fc5ab203d0489a8653f. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:57:48.977613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-70e3878b-268d-4554-8ecf-176b727e6e56 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:57:48.980072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-70e3878b-268d-4554-8ecf-176b727e6e56 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:57:49.029356 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-70e3878b-268d-4554-8ecf-176b727e6e56 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.653981 Aug 04 17:57:49.030040 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3531/7029] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:57:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:57:49.042080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-072d348f-0cac-412d-8dfc-fb2dbaeeaab1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:49.043142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-072d348f-0cac-412d-8dfc-fb2dbaeeaab1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:49.108629 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-072d348f-0cac-412d-8dfc-fb2dbaeeaab1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:49.119360 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-072d348f-0cac-412d-8dfc-fb2dbaeeaab1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1238 microversion: 2.1 time: 0.081887 Aug 04 17:57:49.120379 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3499/7030] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:49 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1238 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:57:50.142506 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0ab9b57c-5a75-4e02-871e-82d94bb480a8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:50.143128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0ab9b57c-5a75-4e02-871e-82d94bb480a8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:50.145231 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:57:50.155432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ab9b57c-5a75-4e02-871e-82d94bb480a8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:50.155933 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ab9b57c-5a75-4e02-871e-82d94bb480a8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:50.156372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ab9b57c-5a75-4e02-871e-82d94bb480a8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:50.157085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ab9b57c-5a75-4e02-871e-82d94bb480a8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:50.157549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ab9b57c-5a75-4e02-871e-82d94bb480a8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:50.158001 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ab9b57c-5a75-4e02-871e-82d94bb480a8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:50.266673 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0ab9b57c-5a75-4e02-871e-82d94bb480a8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:50.281126 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0ab9b57c-5a75-4e02-871e-82d94bb480a8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1298 microversion: 2.1 time: 0.142972 Aug 04 17:57:50.282185 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3532/7031] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:50 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1298 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:57:51.303871 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-151d5682-816c-461e-86e0-7bdb8358fbab tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:51.305136 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-151d5682-816c-461e-86e0-7bdb8358fbab tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:51.308121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:57:51.313704 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-151d5682-816c-461e-86e0-7bdb8358fbab tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:51.314246 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-151d5682-816c-461e-86e0-7bdb8358fbab tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:51.314714 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-151d5682-816c-461e-86e0-7bdb8358fbab tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:51.315438 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-151d5682-816c-461e-86e0-7bdb8358fbab tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:51.315919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-151d5682-816c-461e-86e0-7bdb8358fbab tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:51.316366 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-151d5682-816c-461e-86e0-7bdb8358fbab tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:51.516041 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-151d5682-816c-461e-86e0-7bdb8358fbab tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:51.524182 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-151d5682-816c-461e-86e0-7bdb8358fbab tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1364 microversion: 2.1 time: 0.224606 Aug 04 17:57:51.524880 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3500/7032] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:51 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1364 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:57:51.749752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-e53b014b-7d29-440b-8074-206c8ca74ff6 req-6f8e3bca-8780-4b23-805e-9017abb73728 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e362a3bd-c00c-4743-af02-d0c97f7b63f5", "tag": "10eced95-5839-4d83-8068-5b66945ee6e0"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:57:51.761615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e53b014b-7d29-440b-8074-206c8ca74ff6 req-6f8e3bca-8780-4b23-805e-9017abb73728 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:51.762260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e53b014b-7d29-440b-8074-206c8ca74ff6 req-6f8e3bca-8780-4b23-805e-9017abb73728 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:51.762773 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e53b014b-7d29-440b-8074-206c8ca74ff6 req-6f8e3bca-8780-4b23-805e-9017abb73728 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:51.775401 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-e53b014b-7d29-440b-8074-206c8ca74ff6 req-6f8e3bca-8780-4b23-805e-9017abb73728 service nova] Creating event network-changed:10eced95-5839-4d83-8068-5b66945ee6e0 for instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 on n-h2-851359-3 Aug 04 17:57:51.781021 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-e53b014b-7d29-440b-8074-206c8ca74ff6 req-6f8e3bca-8780-4b23-805e-9017abb73728 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035720 Aug 04 17:57:51.782087 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3533/7033] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:57:52.545984 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3f33929e-2394-41d8-bf57-40c805412bd0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:52.546647 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3f33929e-2394-41d8-bf57-40c805412bd0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:52.553560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f33929e-2394-41d8-bf57-40c805412bd0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:52.554716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f33929e-2394-41d8-bf57-40c805412bd0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:52.555157 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f33929e-2394-41d8-bf57-40c805412bd0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:52.555886 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f33929e-2394-41d8-bf57-40c805412bd0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:52.556368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f33929e-2394-41d8-bf57-40c805412bd0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:52.556815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f33929e-2394-41d8-bf57-40c805412bd0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:52.696804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3f33929e-2394-41d8-bf57-40c805412bd0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:52.704324 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3f33929e-2394-41d8-bf57-40c805412bd0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1364 microversion: 2.1 time: 0.162229 Aug 04 17:57:52.704902 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3501/7034] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:52 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:57:53.727409 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9eafcd32-b8a3-4d46-a647-63ab842e96b5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:53.728136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9eafcd32-b8a3-4d46-a647-63ab842e96b5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:53.734988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9eafcd32-b8a3-4d46-a647-63ab842e96b5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:53.735582 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9eafcd32-b8a3-4d46-a647-63ab842e96b5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:53.736017 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9eafcd32-b8a3-4d46-a647-63ab842e96b5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:53.736738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9eafcd32-b8a3-4d46-a647-63ab842e96b5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:53.737206 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9eafcd32-b8a3-4d46-a647-63ab842e96b5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:53.737647 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9eafcd32-b8a3-4d46-a647-63ab842e96b5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:53.873503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9eafcd32-b8a3-4d46-a647-63ab842e96b5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:53.881760 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9eafcd32-b8a3-4d46-a647-63ab842e96b5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1364 microversion: 2.1 time: 0.159999 Aug 04 17:57:53.883051 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3534/7035] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:53 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:57:54.903929 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8c5cd316-7969-4827-bc59-ed528139b33d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:54.904557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8c5cd316-7969-4827-bc59-ed528139b33d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:54.911548 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c5cd316-7969-4827-bc59-ed528139b33d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:54.911989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c5cd316-7969-4827-bc59-ed528139b33d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:54.912433 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c5cd316-7969-4827-bc59-ed528139b33d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:54.913140 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c5cd316-7969-4827-bc59-ed528139b33d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:54.914241 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c5cd316-7969-4827-bc59-ed528139b33d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:54.914681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c5cd316-7969-4827-bc59-ed528139b33d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:55.051066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8c5cd316-7969-4827-bc59-ed528139b33d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:55.059103 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8c5cd316-7969-4827-bc59-ed528139b33d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1364 microversion: 2.1 time: 0.159096 Aug 04 17:57:55.059696 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3502/7036] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:54 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:57:56.080172 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ed69ec1f-c360-4388-ba4b-eed1893ae0af tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:56.080849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ed69ec1f-c360-4388-ba4b-eed1893ae0af tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:56.088255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed69ec1f-c360-4388-ba4b-eed1893ae0af tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:56.088747 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed69ec1f-c360-4388-ba4b-eed1893ae0af tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:56.089188 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed69ec1f-c360-4388-ba4b-eed1893ae0af tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:56.089897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed69ec1f-c360-4388-ba4b-eed1893ae0af tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:56.090425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed69ec1f-c360-4388-ba4b-eed1893ae0af tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:56.090851 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed69ec1f-c360-4388-ba4b-eed1893ae0af tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:56.235291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ed69ec1f-c360-4388-ba4b-eed1893ae0af tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:56.244489 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ed69ec1f-c360-4388-ba4b-eed1893ae0af tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1364 microversion: 2.1 time: 0.167926 Aug 04 17:57:56.245141 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3535/7037] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:56 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:57:57.264887 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-855215ac-2849-45a7-b522-efcd3a4380f4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:57.265513 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-855215ac-2849-45a7-b522-efcd3a4380f4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:57.272398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-855215ac-2849-45a7-b522-efcd3a4380f4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:57.272895 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-855215ac-2849-45a7-b522-efcd3a4380f4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:57.273342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-855215ac-2849-45a7-b522-efcd3a4380f4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:57.274275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-855215ac-2849-45a7-b522-efcd3a4380f4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:57.274747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-855215ac-2849-45a7-b522-efcd3a4380f4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:57.275185 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-855215ac-2849-45a7-b522-efcd3a4380f4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:57.407947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-855215ac-2849-45a7-b522-efcd3a4380f4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:57.415465 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-855215ac-2849-45a7-b522-efcd3a4380f4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1364 microversion: 2.1 time: 0.154493 Aug 04 17:57:57.416040 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3503/7038] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:57 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:57:57.798456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-a2f48f25-789a-4e84-8245-90da51039115 req-6ed0c878-f579-4742-8998-97127f99946a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e362a3bd-c00c-4743-af02-d0c97f7b63f5", "name": "network-vif-plugged", "status": "completed", "tag": "10eced95-5839-4d83-8068-5b66945ee6e0"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:57:57.810856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a2f48f25-789a-4e84-8245-90da51039115 req-6ed0c878-f579-4742-8998-97127f99946a service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:57.811478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a2f48f25-789a-4e84-8245-90da51039115 req-6ed0c878-f579-4742-8998-97127f99946a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:57.812033 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a2f48f25-789a-4e84-8245-90da51039115 req-6ed0c878-f579-4742-8998-97127f99946a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:57.825159 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-a2f48f25-789a-4e84-8245-90da51039115 req-6ed0c878-f579-4742-8998-97127f99946a service nova] Creating event network-vif-plugged:10eced95-5839-4d83-8068-5b66945ee6e0 for instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 on n-h2-851359-3 Aug 04 17:57:57.830444 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-a2f48f25-789a-4e84-8245-90da51039115 req-6ed0c878-f579-4742-8998-97127f99946a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035979 Aug 04 17:57:57.831216 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3536/7039] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:57:58.436080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-df32eb20-a872-4c00-8633-8fba70f95f02 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:58.437371 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-df32eb20-a872-4c00-8633-8fba70f95f02 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:58.445350 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df32eb20-a872-4c00-8633-8fba70f95f02 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:58.446058 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df32eb20-a872-4c00-8633-8fba70f95f02 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:58.446475 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df32eb20-a872-4c00-8633-8fba70f95f02 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:58.447385 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df32eb20-a872-4c00-8633-8fba70f95f02 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:58.447959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df32eb20-a872-4c00-8633-8fba70f95f02 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:58.448494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df32eb20-a872-4c00-8633-8fba70f95f02 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:58.584211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-df32eb20-a872-4c00-8633-8fba70f95f02 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:58.591960 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-df32eb20-a872-4c00-8633-8fba70f95f02 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1364 microversion: 2.1 time: 0.159786 Aug 04 17:57:58.592587 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3504/7040] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:58 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:57:59.612089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:57:59.613108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:57:59.618162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-99c7831e-ca1b-4593-98a9-566321a21326 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:57:59.618884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-99c7831e-ca1b-4593-98a9-566321a21326 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:57:59.626160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99c7831e-ca1b-4593-98a9-566321a21326 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:59.626662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99c7831e-ca1b-4593-98a9-566321a21326 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:59.627111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99c7831e-ca1b-4593-98a9-566321a21326 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:59.627827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99c7831e-ca1b-4593-98a9-566321a21326 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:57:59.628295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99c7831e-ca1b-4593-98a9-566321a21326 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:57:59.628730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99c7831e-ca1b-4593-98a9-566321a21326 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:57:59.767293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-99c7831e-ca1b-4593-98a9-566321a21326 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:57:59.775419 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-99c7831e-ca1b-4593-98a9-566321a21326 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1364 microversion: 2.1 time: 0.165099 Aug 04 17:57:59.776015 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3537/7041] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:57:59 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:58:00.796896 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5bc20547-ad00-4d59-81a2-2cedf99345db tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:58:00.797564 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5bc20547-ad00-4d59-81a2-2cedf99345db tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:58:00.799524 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:58:00.806324 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5bc20547-ad00-4d59-81a2-2cedf99345db tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:58:00.806858 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5bc20547-ad00-4d59-81a2-2cedf99345db tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:58:00.807290 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5bc20547-ad00-4d59-81a2-2cedf99345db tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:58:00.808046 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5bc20547-ad00-4d59-81a2-2cedf99345db tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:58:00.808519 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5bc20547-ad00-4d59-81a2-2cedf99345db tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:58:00.808965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5bc20547-ad00-4d59-81a2-2cedf99345db tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:58:00.954688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5bc20547-ad00-4d59-81a2-2cedf99345db tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:58:00.963133 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5bc20547-ad00-4d59-81a2-2cedf99345db tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1551 microversion: 2.1 time: 0.169998 Aug 04 17:58:00.963734 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3505/7042] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:58:00 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1551 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:58:00.984704 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3ec89837-7891-4b6c-af28-52af17c386be tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:58:00.985285 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3ec89837-7891-4b6c-af28-52af17c386be tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:58:00.992098 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ec89837-7891-4b6c-af28-52af17c386be tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:58:00.992655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ec89837-7891-4b6c-af28-52af17c386be tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:58:00.993107 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ec89837-7891-4b6c-af28-52af17c386be tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:58:00.994201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ec89837-7891-4b6c-af28-52af17c386be tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:58:00.994816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ec89837-7891-4b6c-af28-52af17c386be tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:58:00.995256 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ec89837-7891-4b6c-af28-52af17c386be tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:58:01.077067 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3ec89837-7891-4b6c-af28-52af17c386be tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096623 Aug 04 17:58:01.077681 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3538/7043] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Aug 4 17:58:00 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:58:02.045577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0e24f3af-728d-4fe4-919f-8f76b49d0ae7 req-3550eb6f-2609-4075-a378-391040c491a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e362a3bd-c00c-4743-af02-d0c97f7b63f5", "tag": "10eced95-5839-4d83-8068-5b66945ee6e0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:58:02.056258 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0e24f3af-728d-4fe4-919f-8f76b49d0ae7 req-3550eb6f-2609-4075-a378-391040c491a2 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:58:02.056812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0e24f3af-728d-4fe4-919f-8f76b49d0ae7 req-3550eb6f-2609-4075-a378-391040c491a2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:58:02.057262 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0e24f3af-728d-4fe4-919f-8f76b49d0ae7 req-3550eb6f-2609-4075-a378-391040c491a2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:58:02.068890 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0e24f3af-728d-4fe4-919f-8f76b49d0ae7 req-3550eb6f-2609-4075-a378-391040c491a2 service nova] Creating event network-changed:10eced95-5839-4d83-8068-5b66945ee6e0 for instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 on n-h2-851359-3 Aug 04 17:58:02.074699 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0e24f3af-728d-4fe4-919f-8f76b49d0ae7 req-3550eb6f-2609-4075-a378-391040c491a2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032763 Aug 04 17:58:02.075398 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3506/7044] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:59:16.132514 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=13 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:59:16.133205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:59:16.138165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0714a989-25e5-488a-a21e-d4c119275151 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:59:16.140492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0714a989-25e5-488a-a21e-d4c119275151 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:16.149177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0714a989-25e5-488a-a21e-d4c119275151 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:16.149689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0714a989-25e5-488a-a21e-d4c119275151 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:16.150173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0714a989-25e5-488a-a21e-d4c119275151 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:16.150898 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0714a989-25e5-488a-a21e-d4c119275151 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:16.151359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0714a989-25e5-488a-a21e-d4c119275151 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:16.151788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0714a989-25e5-488a-a21e-d4c119275151 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:16.188143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0714a989-25e5-488a-a21e-d4c119275151 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:16.195964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0714a989-25e5-488a-a21e-d4c119275151 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Old instance type m1.heat2, new instance type m1.heat {{(pid=131043) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 17:59:16.203114 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-0714a989-25e5-488a-a21e-d4c119275151 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:59:16.203567 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-0714a989-25e5-488a-a21e-d4c119275151 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:59:16.204047 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-0714a989-25e5-488a-a21e-d4c119275151 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:59:16.204473 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-0714a989-25e5-488a-a21e-d4c119275151 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:59:16.204891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-0714a989-25e5-488a-a21e-d4c119275151 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:59:16.284823 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0714a989-25e5-488a-a21e-d4c119275151 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "POST /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5/action" status: 202 len: 0 microversion: 2.1 time: 0.154984 Aug 04 17:59:16.285713 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3539/7045] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:59:16 2022] POST /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:59:16.296019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=13 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:59:16.297302 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=52,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:59:16.309266 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0029c352-1bf2-49f7-9522-05c9f985fd7e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:16.310238 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0029c352-1bf2-49f7-9522-05c9f985fd7e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:16.321350 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0029c352-1bf2-49f7-9522-05c9f985fd7e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:16.321997 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0029c352-1bf2-49f7-9522-05c9f985fd7e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:16.322617 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0029c352-1bf2-49f7-9522-05c9f985fd7e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:16.323524 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0029c352-1bf2-49f7-9522-05c9f985fd7e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:16.324275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0029c352-1bf2-49f7-9522-05c9f985fd7e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:16.324922 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0029c352-1bf2-49f7-9522-05c9f985fd7e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:16.545314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0029c352-1bf2-49f7-9522-05c9f985fd7e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:16.554277 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0029c352-1bf2-49f7-9522-05c9f985fd7e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1679 microversion: 2.1 time: 0.261758 Aug 04 17:59:16.554878 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3507/7046] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:16 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1679 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:59:17.580671 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5dee191c-60da-41a3-b80f-94ceb1f77031 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:17.581814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5dee191c-60da-41a3-b80f-94ceb1f77031 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:17.593436 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5dee191c-60da-41a3-b80f-94ceb1f77031 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:17.594287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5dee191c-60da-41a3-b80f-94ceb1f77031 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:17.594953 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5dee191c-60da-41a3-b80f-94ceb1f77031 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:17.596288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5dee191c-60da-41a3-b80f-94ceb1f77031 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:17.597121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5dee191c-60da-41a3-b80f-94ceb1f77031 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:17.597796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5dee191c-60da-41a3-b80f-94ceb1f77031 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:17.763646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5dee191c-60da-41a3-b80f-94ceb1f77031 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:17.777429 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5dee191c-60da-41a3-b80f-94ceb1f77031 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1679 microversion: 2.1 time: 0.203904 Aug 04 17:59:17.778488 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3540/7047] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:17 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1679 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:18.815569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-32957bc8-9c5a-4749-8883-74c18b242dff tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:18.816203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-32957bc8-9c5a-4749-8883-74c18b242dff tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:18.824309 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32957bc8-9c5a-4749-8883-74c18b242dff tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:18.824739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32957bc8-9c5a-4749-8883-74c18b242dff tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:18.825199 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32957bc8-9c5a-4749-8883-74c18b242dff tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:18.825941 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32957bc8-9c5a-4749-8883-74c18b242dff tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:18.826450 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32957bc8-9c5a-4749-8883-74c18b242dff tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:18.826899 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32957bc8-9c5a-4749-8883-74c18b242dff tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:19.002780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-32957bc8-9c5a-4749-8883-74c18b242dff tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:19.011695 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-32957bc8-9c5a-4749-8883-74c18b242dff tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1684 microversion: 2.1 time: 0.200862 Aug 04 17:59:19.012289 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3508/7048] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:18 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1684 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:59:20.047977 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d74f99f4-bc68-4607-a358-336b5917e953 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:20.048530 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d74f99f4-bc68-4607-a358-336b5917e953 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:20.059180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d74f99f4-bc68-4607-a358-336b5917e953 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:20.060076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d74f99f4-bc68-4607-a358-336b5917e953 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:20.060864 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d74f99f4-bc68-4607-a358-336b5917e953 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:20.062160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d74f99f4-bc68-4607-a358-336b5917e953 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:20.063025 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d74f99f4-bc68-4607-a358-336b5917e953 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:20.063799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d74f99f4-bc68-4607-a358-336b5917e953 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:20.234691 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d74f99f4-bc68-4607-a358-336b5917e953 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:20.242880 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d74f99f4-bc68-4607-a358-336b5917e953 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1684 microversion: 2.1 time: 0.199012 Aug 04 17:59:20.243509 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3541/7049] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:20 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1684 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:21.265073 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-38ee5181-0cc7-44de-b2c9-7c84affa0240 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:21.265699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-38ee5181-0cc7-44de-b2c9-7c84affa0240 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:21.273652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38ee5181-0cc7-44de-b2c9-7c84affa0240 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:21.274237 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38ee5181-0cc7-44de-b2c9-7c84affa0240 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:21.274699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38ee5181-0cc7-44de-b2c9-7c84affa0240 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:21.275433 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38ee5181-0cc7-44de-b2c9-7c84affa0240 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:21.275905 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38ee5181-0cc7-44de-b2c9-7c84affa0240 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:21.276382 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38ee5181-0cc7-44de-b2c9-7c84affa0240 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:21.425477 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-38ee5181-0cc7-44de-b2c9-7c84affa0240 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:21.433918 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-38ee5181-0cc7-44de-b2c9-7c84affa0240 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1684 microversion: 2.1 time: 0.172748 Aug 04 17:59:21.434589 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3509/7050] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:21 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1684 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:22.456159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e5db45cb-a49a-45a5-b90a-24192fc18d4a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:22.456813 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e5db45cb-a49a-45a5-b90a-24192fc18d4a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:22.464970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e5db45cb-a49a-45a5-b90a-24192fc18d4a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:22.465490 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e5db45cb-a49a-45a5-b90a-24192fc18d4a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:22.465953 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e5db45cb-a49a-45a5-b90a-24192fc18d4a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:22.466750 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e5db45cb-a49a-45a5-b90a-24192fc18d4a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:22.467244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e5db45cb-a49a-45a5-b90a-24192fc18d4a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:22.467684 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e5db45cb-a49a-45a5-b90a-24192fc18d4a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:22.621819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e5db45cb-a49a-45a5-b90a-24192fc18d4a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:22.630240 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e5db45cb-a49a-45a5-b90a-24192fc18d4a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1684 microversion: 2.1 time: 0.177597 Aug 04 17:59:22.630836 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3542/7051] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:22 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1684 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:23.165415 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 17:59:23.165671 n-d-851359-3 devstack@n-api.service[131043]: Thu Aug 4 17:59:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 17:59:23.652556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-26481878-a314-458b-9b77-5d88128c13a2 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:23.653305 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-26481878-a314-458b-9b77-5d88128c13a2 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:23.664632 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26481878-a314-458b-9b77-5d88128c13a2 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:23.665568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26481878-a314-458b-9b77-5d88128c13a2 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:23.666402 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26481878-a314-458b-9b77-5d88128c13a2 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:23.667946 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26481878-a314-458b-9b77-5d88128c13a2 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:23.668828 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26481878-a314-458b-9b77-5d88128c13a2 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:23.669574 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26481878-a314-458b-9b77-5d88128c13a2 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:23.855870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-26481878-a314-458b-9b77-5d88128c13a2 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:23.865196 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-26481878-a314-458b-9b77-5d88128c13a2 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1684 microversion: 2.1 time: 0.216649 Aug 04 17:59:23.865823 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3510/7052] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:23 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1684 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:24.887323 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ed78ca35-a20e-4db7-9ce5-a3e0c10e6b8a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:24.887933 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ed78ca35-a20e-4db7-9ce5-a3e0c10e6b8a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:24.895979 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed78ca35-a20e-4db7-9ce5-a3e0c10e6b8a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:24.896613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed78ca35-a20e-4db7-9ce5-a3e0c10e6b8a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:24.897181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed78ca35-a20e-4db7-9ce5-a3e0c10e6b8a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:24.897961 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed78ca35-a20e-4db7-9ce5-a3e0c10e6b8a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:24.898526 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed78ca35-a20e-4db7-9ce5-a3e0c10e6b8a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:24.899027 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed78ca35-a20e-4db7-9ce5-a3e0c10e6b8a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:25.059860 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ed78ca35-a20e-4db7-9ce5-a3e0c10e6b8a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:25.070714 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ed78ca35-a20e-4db7-9ce5-a3e0c10e6b8a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1684 microversion: 2.1 time: 0.187606 Aug 04 17:59:25.071455 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3543/7053] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:24 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1684 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:26.094106 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ee2b86f4-550b-4503-b77e-f53df1a698c6 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:26.095039 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ee2b86f4-550b-4503-b77e-f53df1a698c6 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:26.103640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee2b86f4-550b-4503-b77e-f53df1a698c6 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:26.104155 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee2b86f4-550b-4503-b77e-f53df1a698c6 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:26.104608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee2b86f4-550b-4503-b77e-f53df1a698c6 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:26.105356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee2b86f4-550b-4503-b77e-f53df1a698c6 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:26.105853 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee2b86f4-550b-4503-b77e-f53df1a698c6 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:26.106332 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee2b86f4-550b-4503-b77e-f53df1a698c6 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:26.257774 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ee2b86f4-550b-4503-b77e-f53df1a698c6 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:26.265814 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ee2b86f4-550b-4503-b77e-f53df1a698c6 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1684 microversion: 2.1 time: 0.176088 Aug 04 17:59:26.266439 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3511/7054] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:26 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:27.288863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-79042f72-80d1-42b1-945f-5cc1e3ba0e2b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:27.289547 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-79042f72-80d1-42b1-945f-5cc1e3ba0e2b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:27.299015 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79042f72-80d1-42b1-945f-5cc1e3ba0e2b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:27.299840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79042f72-80d1-42b1-945f-5cc1e3ba0e2b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:27.300490 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79042f72-80d1-42b1-945f-5cc1e3ba0e2b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:27.301470 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79042f72-80d1-42b1-945f-5cc1e3ba0e2b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:27.302357 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79042f72-80d1-42b1-945f-5cc1e3ba0e2b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:27.302954 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-79042f72-80d1-42b1-945f-5cc1e3ba0e2b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:27.505206 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-79042f72-80d1-42b1-945f-5cc1e3ba0e2b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:27.513867 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-79042f72-80d1-42b1-945f-5cc1e3ba0e2b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1684 microversion: 2.1 time: 0.230050 Aug 04 17:59:27.514562 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3544/7055] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:27 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1684 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:59:28.539581 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6762917a-424f-4cb4-87c5-d9d43fd0b4d7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:28.540820 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6762917a-424f-4cb4-87c5-d9d43fd0b4d7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:28.552175 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6762917a-424f-4cb4-87c5-d9d43fd0b4d7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:28.552690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6762917a-424f-4cb4-87c5-d9d43fd0b4d7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:28.553741 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6762917a-424f-4cb4-87c5-d9d43fd0b4d7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:28.554943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6762917a-424f-4cb4-87c5-d9d43fd0b4d7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:28.555782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6762917a-424f-4cb4-87c5-d9d43fd0b4d7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:28.556405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6762917a-424f-4cb4-87c5-d9d43fd0b4d7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:28.709426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6762917a-424f-4cb4-87c5-d9d43fd0b4d7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:28.718377 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6762917a-424f-4cb4-87c5-d9d43fd0b4d7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1684 microversion: 2.1 time: 0.184933 Aug 04 17:59:28.718981 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3512/7056] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:28 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1684 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:29.741811 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3ef5f248-ca66-4292-89b2-6a337a276879 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:29.742471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3ef5f248-ca66-4292-89b2-6a337a276879 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:29.749546 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ef5f248-ca66-4292-89b2-6a337a276879 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:29.750070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ef5f248-ca66-4292-89b2-6a337a276879 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:29.750521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ef5f248-ca66-4292-89b2-6a337a276879 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:29.751401 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ef5f248-ca66-4292-89b2-6a337a276879 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:29.751870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ef5f248-ca66-4292-89b2-6a337a276879 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:29.752308 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3ef5f248-ca66-4292-89b2-6a337a276879 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:29.908101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3ef5f248-ca66-4292-89b2-6a337a276879 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:29.918789 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3ef5f248-ca66-4292-89b2-6a337a276879 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1684 microversion: 2.1 time: 0.181373 Aug 04 17:59:29.919689 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3545/7057] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:29 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1684 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:30.942082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0cdeb5ad-fbf4-4118-a753-6a4747cafe98 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:30.942918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0cdeb5ad-fbf4-4118-a753-6a4747cafe98 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:30.952777 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0cdeb5ad-fbf4-4118-a753-6a4747cafe98 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:30.953396 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0cdeb5ad-fbf4-4118-a753-6a4747cafe98 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:30.954026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0cdeb5ad-fbf4-4118-a753-6a4747cafe98 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:30.954885 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0cdeb5ad-fbf4-4118-a753-6a4747cafe98 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:30.955481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0cdeb5ad-fbf4-4118-a753-6a4747cafe98 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:30.956027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0cdeb5ad-fbf4-4118-a753-6a4747cafe98 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:31.259194 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0cdeb5ad-fbf4-4118-a753-6a4747cafe98 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:31.268557 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0cdeb5ad-fbf4-4118-a753-6a4747cafe98 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1683 microversion: 2.1 time: 0.330697 Aug 04 17:59:31.269306 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3513/7058] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:30 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1683 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:31.469599 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-e03ebeb1-6813-4b0e-bc19-cb481df062f0 req-636abdad-e1ae-4dc1-aba3-b6ae7e124867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e362a3bd-c00c-4743-af02-d0c97f7b63f5", "name": "network-vif-unplugged", "status": "completed", "tag": "10eced95-5839-4d83-8068-5b66945ee6e0"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:59:31.488526 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e03ebeb1-6813-4b0e-bc19-cb481df062f0 req-636abdad-e1ae-4dc1-aba3-b6ae7e124867 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:31.489400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e03ebeb1-6813-4b0e-bc19-cb481df062f0 req-636abdad-e1ae-4dc1-aba3-b6ae7e124867 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:31.490190 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e03ebeb1-6813-4b0e-bc19-cb481df062f0 req-636abdad-e1ae-4dc1-aba3-b6ae7e124867 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:31.513937 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-e03ebeb1-6813-4b0e-bc19-cb481df062f0 req-636abdad-e1ae-4dc1-aba3-b6ae7e124867 service nova] Creating event network-vif-unplugged:10eced95-5839-4d83-8068-5b66945ee6e0 for instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 on n-h1-851359-3 Aug 04 17:59:31.525822 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [req-e03ebeb1-6813-4b0e-bc19-cb481df062f0 req-636abdad-e1ae-4dc1-aba3-b6ae7e124867 service nova] Instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:59:31.548146 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-e03ebeb1-6813-4b0e-bc19-cb481df062f0 req-636abdad-e1ae-4dc1-aba3-b6ae7e124867 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.179433 Aug 04 17:59:31.549228 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3546/7059] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:59:32.297799 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d48ace66-0c97-41f3-8f5c-83afe2ec030a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:32.298868 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d48ace66-0c97-41f3-8f5c-83afe2ec030a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:32.311996 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d48ace66-0c97-41f3-8f5c-83afe2ec030a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:32.312873 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d48ace66-0c97-41f3-8f5c-83afe2ec030a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:32.313696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d48ace66-0c97-41f3-8f5c-83afe2ec030a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:32.315031 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d48ace66-0c97-41f3-8f5c-83afe2ec030a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:32.315899 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d48ace66-0c97-41f3-8f5c-83afe2ec030a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:32.316703 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d48ace66-0c97-41f3-8f5c-83afe2ec030a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:32.577117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d48ace66-0c97-41f3-8f5c-83afe2ec030a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:32.587601 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d48ace66-0c97-41f3-8f5c-83afe2ec030a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1683 microversion: 2.1 time: 0.297473 Aug 04 17:59:32.588554 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3514/7060] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:32 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1683 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:33.581213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-b827a619-4564-4cd3-aa73-309a80ca5d68 req-b098bd89-5d0a-4762-8044-a1a36312b1bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e362a3bd-c00c-4743-af02-d0c97f7b63f5", "tag": "10eced95-5839-4d83-8068-5b66945ee6e0"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:59:33.593005 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b827a619-4564-4cd3-aa73-309a80ca5d68 req-b098bd89-5d0a-4762-8044-a1a36312b1bf service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:33.593807 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b827a619-4564-4cd3-aa73-309a80ca5d68 req-b098bd89-5d0a-4762-8044-a1a36312b1bf service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:33.594530 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b827a619-4564-4cd3-aa73-309a80ca5d68 req-b098bd89-5d0a-4762-8044-a1a36312b1bf service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:33.611118 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-b827a619-4564-4cd3-aa73-309a80ca5d68 req-b098bd89-5d0a-4762-8044-a1a36312b1bf service nova] Creating event network-changed:10eced95-5839-4d83-8068-5b66945ee6e0 for instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 on n-h1-851359-3 Aug 04 17:59:33.619216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [req-b827a619-4564-4cd3-aa73-309a80ca5d68 req-b098bd89-5d0a-4762-8044-a1a36312b1bf service nova] Instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:59:33.623511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a74b9c55-6e3c-4b7b-b0cb-24f3c5d7fc57 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:33.624616 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a74b9c55-6e3c-4b7b-b0cb-24f3c5d7fc57 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:33.632890 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-b827a619-4564-4cd3-aa73-309a80ca5d68 req-b098bd89-5d0a-4762-8044-a1a36312b1bf service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057613 Aug 04 17:59:33.633754 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3547/7061] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:59:33.638471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a74b9c55-6e3c-4b7b-b0cb-24f3c5d7fc57 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:33.639031 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a74b9c55-6e3c-4b7b-b0cb-24f3c5d7fc57 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:33.639759 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a74b9c55-6e3c-4b7b-b0cb-24f3c5d7fc57 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:33.640987 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a74b9c55-6e3c-4b7b-b0cb-24f3c5d7fc57 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:33.641524 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a74b9c55-6e3c-4b7b-b0cb-24f3c5d7fc57 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:33.642048 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a74b9c55-6e3c-4b7b-b0cb-24f3c5d7fc57 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:33.915072 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a74b9c55-6e3c-4b7b-b0cb-24f3c5d7fc57 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:33.925535 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a74b9c55-6e3c-4b7b-b0cb-24f3c5d7fc57 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1681 microversion: 2.1 time: 0.306158 Aug 04 17:59:33.926483 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3515/7062] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:33 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1681 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:59:34.965503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-145500d0-79c9-409b-a4f0-f77ee91df2d7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:34.966768 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-145500d0-79c9-409b-a4f0-f77ee91df2d7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:34.976801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-145500d0-79c9-409b-a4f0-f77ee91df2d7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:34.977311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-145500d0-79c9-409b-a4f0-f77ee91df2d7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:34.977764 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-145500d0-79c9-409b-a4f0-f77ee91df2d7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:34.978568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-145500d0-79c9-409b-a4f0-f77ee91df2d7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:34.979038 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-145500d0-79c9-409b-a4f0-f77ee91df2d7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:34.979474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-145500d0-79c9-409b-a4f0-f77ee91df2d7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:35.160866 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-145500d0-79c9-409b-a4f0-f77ee91df2d7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:35.169946 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-145500d0-79c9-409b-a4f0-f77ee91df2d7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1678 microversion: 2.1 time: 0.213548 Aug 04 17:59:35.170631 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3548/7063] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:34 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1678 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:35.193239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f2c3c20b-b137-4c3a-896d-cdfc22e0327a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:59:35.193936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f2c3c20b-b137-4c3a-896d-cdfc22e0327a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:35.202687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2c3c20b-b137-4c3a-896d-cdfc22e0327a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:35.203368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2c3c20b-b137-4c3a-896d-cdfc22e0327a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:35.203879 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2c3c20b-b137-4c3a-896d-cdfc22e0327a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:35.204751 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2c3c20b-b137-4c3a-896d-cdfc22e0327a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:35.205366 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2c3c20b-b137-4c3a-896d-cdfc22e0327a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:35.206164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2c3c20b-b137-4c3a-896d-cdfc22e0327a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:35.258453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2c3c20b-b137-4c3a-896d-cdfc22e0327a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:35.259003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2c3c20b-b137-4c3a-896d-cdfc22e0327a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:35.259603 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2c3c20b-b137-4c3a-896d-cdfc22e0327a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:35.260468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2c3c20b-b137-4c3a-896d-cdfc22e0327a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:35.261002 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2c3c20b-b137-4c3a-896d-cdfc22e0327a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:35.261507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2c3c20b-b137-4c3a-896d-cdfc22e0327a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:35.287041 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-f2c3c20b-b137-4c3a-896d-cdfc22e0327a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Getting quotas for project c527dc233da14fc5ab203d0489a8653f. Resources: {'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:59:35.293650 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-f2c3c20b-b137-4c3a-896d-cdfc22e0327a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Getting quotas for user 5123a91a38cf4524a1d9ae3a0ab45ee2 and project c527dc233da14fc5ab203d0489a8653f. Resources: {'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:59:35.474718 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f2c3c20b-b137-4c3a-896d-cdfc22e0327a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "POST /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5/action" status: 202 len: 0 microversion: 2.1 time: 0.285440 Aug 04 17:59:35.476719 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3516/7064] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 17:59:35 2022] POST /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 17:59:35.491134 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-93936671-751c-475a-9de9-f80c5b40ece9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:35.491769 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-93936671-751c-475a-9de9-f80c5b40ece9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:35.499975 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-93936671-751c-475a-9de9-f80c5b40ece9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:35.500905 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-93936671-751c-475a-9de9-f80c5b40ece9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:35.501364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-93936671-751c-475a-9de9-f80c5b40ece9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:35.502157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-93936671-751c-475a-9de9-f80c5b40ece9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:35.502624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-93936671-751c-475a-9de9-f80c5b40ece9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:35.503549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-93936671-751c-475a-9de9-f80c5b40ece9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:35.755305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-93936671-751c-475a-9de9-f80c5b40ece9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:35.771981 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-93936671-751c-475a-9de9-f80c5b40ece9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1677 microversion: 2.1 time: 0.288559 Aug 04 17:59:35.780215 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3549/7065] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:35 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1677 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:36.807747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dfa8f1b5-7959-4689-8d6a-c2c9f0bb363c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:36.808545 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dfa8f1b5-7959-4689-8d6a-c2c9f0bb363c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:36.819895 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfa8f1b5-7959-4689-8d6a-c2c9f0bb363c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:36.820582 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfa8f1b5-7959-4689-8d6a-c2c9f0bb363c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:36.821094 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfa8f1b5-7959-4689-8d6a-c2c9f0bb363c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:36.822019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfa8f1b5-7959-4689-8d6a-c2c9f0bb363c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:36.822561 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfa8f1b5-7959-4689-8d6a-c2c9f0bb363c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:36.823228 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfa8f1b5-7959-4689-8d6a-c2c9f0bb363c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:36.989294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dfa8f1b5-7959-4689-8d6a-c2c9f0bb363c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:36.997356 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dfa8f1b5-7959-4689-8d6a-c2c9f0bb363c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1677 microversion: 2.1 time: 0.194711 Aug 04 17:59:36.997939 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3517/7066] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:36 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1677 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:38.022706 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-be76f810-d320-4f43-bdff-a9f374c55751 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:38.023538 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-be76f810-d320-4f43-bdff-a9f374c55751 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:38.031340 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be76f810-d320-4f43-bdff-a9f374c55751 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:38.031855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be76f810-d320-4f43-bdff-a9f374c55751 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:38.032307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be76f810-d320-4f43-bdff-a9f374c55751 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:38.033050 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be76f810-d320-4f43-bdff-a9f374c55751 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:38.033522 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be76f810-d320-4f43-bdff-a9f374c55751 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:38.034166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be76f810-d320-4f43-bdff-a9f374c55751 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:38.217415 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-be76f810-d320-4f43-bdff-a9f374c55751 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:38.226758 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-be76f810-d320-4f43-bdff-a9f374c55751 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1677 microversion: 2.1 time: 0.209393 Aug 04 17:59:38.227371 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3550/7067] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:38 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1677 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:38.675201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-c1e84809-e188-451d-aa82-cf5175ff6886 req-a2f230b8-8bb7-4b5e-988c-3ec101f8b159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e362a3bd-c00c-4743-af02-d0c97f7b63f5", "name": "network-vif-plugged", "status": "completed", "tag": "10eced95-5839-4d83-8068-5b66945ee6e0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:59:38.689527 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c1e84809-e188-451d-aa82-cf5175ff6886 req-a2f230b8-8bb7-4b5e-988c-3ec101f8b159 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:38.690461 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c1e84809-e188-451d-aa82-cf5175ff6886 req-a2f230b8-8bb7-4b5e-988c-3ec101f8b159 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:38.691258 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c1e84809-e188-451d-aa82-cf5175ff6886 req-a2f230b8-8bb7-4b5e-988c-3ec101f8b159 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:38.724547 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-c1e84809-e188-451d-aa82-cf5175ff6886 req-a2f230b8-8bb7-4b5e-988c-3ec101f8b159 service nova] Creating event network-vif-plugged:10eced95-5839-4d83-8068-5b66945ee6e0 for instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 on n-h1-851359-3 Aug 04 17:59:38.734838 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-c1e84809-e188-451d-aa82-cf5175ff6886 req-a2f230b8-8bb7-4b5e-988c-3ec101f8b159 service nova] Instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:59:38.750991 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-c1e84809-e188-451d-aa82-cf5175ff6886 req-a2f230b8-8bb7-4b5e-988c-3ec101f8b159 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172148 Aug 04 17:59:38.752843 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3518/7068] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:59:39.249922 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-78fe7af9-d367-4830-91d0-5cc829fc3b36 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:39.250891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-78fe7af9-d367-4830-91d0-5cc829fc3b36 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:39.260065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78fe7af9-d367-4830-91d0-5cc829fc3b36 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:39.260570 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78fe7af9-d367-4830-91d0-5cc829fc3b36 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:39.261014 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78fe7af9-d367-4830-91d0-5cc829fc3b36 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:39.261739 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78fe7af9-d367-4830-91d0-5cc829fc3b36 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:39.262244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78fe7af9-d367-4830-91d0-5cc829fc3b36 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:39.262684 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-78fe7af9-d367-4830-91d0-5cc829fc3b36 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:39.566237 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-78fe7af9-d367-4830-91d0-5cc829fc3b36 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:39.579344 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-78fe7af9-d367-4830-91d0-5cc829fc3b36 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1677 microversion: 2.1 time: 0.333050 Aug 04 17:59:39.579582 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3551/7069] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:39 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1677 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:39.748314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-38a2c3bd-b069-45d5-9daa-4a32f45234ff req-91fed82d-0b52-46bc-b1fe-af011746c0f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e362a3bd-c00c-4743-af02-d0c97f7b63f5", "name": "network-vif-unplugged", "status": "completed", "tag": "10eced95-5839-4d83-8068-5b66945ee6e0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:59:39.765636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-38a2c3bd-b069-45d5-9daa-4a32f45234ff req-91fed82d-0b52-46bc-b1fe-af011746c0f7 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:39.766507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-38a2c3bd-b069-45d5-9daa-4a32f45234ff req-91fed82d-0b52-46bc-b1fe-af011746c0f7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:39.767375 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-38a2c3bd-b069-45d5-9daa-4a32f45234ff req-91fed82d-0b52-46bc-b1fe-af011746c0f7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:39.796122 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-38a2c3bd-b069-45d5-9daa-4a32f45234ff req-91fed82d-0b52-46bc-b1fe-af011746c0f7 service nova] Creating event network-vif-unplugged:10eced95-5839-4d83-8068-5b66945ee6e0 for instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 on n-h2-851359-3 Aug 04 17:59:39.807474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-38a2c3bd-b069-45d5-9daa-4a32f45234ff req-91fed82d-0b52-46bc-b1fe-af011746c0f7 service nova] Instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:59:39.830475 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-38a2c3bd-b069-45d5-9daa-4a32f45234ff req-91fed82d-0b52-46bc-b1fe-af011746c0f7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089419 Aug 04 17:59:39.831810 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3519/7070] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:59:40.615897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-417e2470-c9d9-4004-855b-d13946e4bdb9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:40.618045 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-417e2470-c9d9-4004-855b-d13946e4bdb9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:40.636421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-417e2470-c9d9-4004-855b-d13946e4bdb9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:40.637649 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-417e2470-c9d9-4004-855b-d13946e4bdb9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:40.639162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-417e2470-c9d9-4004-855b-d13946e4bdb9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:40.640840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-417e2470-c9d9-4004-855b-d13946e4bdb9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:40.642138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-417e2470-c9d9-4004-855b-d13946e4bdb9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:40.643224 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-417e2470-c9d9-4004-855b-d13946e4bdb9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:41.027083 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-417e2470-c9d9-4004-855b-d13946e4bdb9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:41.043182 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-417e2470-c9d9-4004-855b-d13946e4bdb9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1677 microversion: 2.1 time: 0.434914 Aug 04 17:59:41.052284 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3552/7071] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:40 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1677 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:41.848362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-a008678d-fd07-4bed-8ae8-e269e76651ae req-a84f326a-4c9f-4e03-adce-2962cb10c27c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e362a3bd-c00c-4743-af02-d0c97f7b63f5", "tag": "10eced95-5839-4d83-8068-5b66945ee6e0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:59:41.859513 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a008678d-fd07-4bed-8ae8-e269e76651ae req-a84f326a-4c9f-4e03-adce-2962cb10c27c service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:41.860007 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a008678d-fd07-4bed-8ae8-e269e76651ae req-a84f326a-4c9f-4e03-adce-2962cb10c27c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:41.860487 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a008678d-fd07-4bed-8ae8-e269e76651ae req-a84f326a-4c9f-4e03-adce-2962cb10c27c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:41.874559 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-a008678d-fd07-4bed-8ae8-e269e76651ae req-a84f326a-4c9f-4e03-adce-2962cb10c27c service nova] Creating event network-changed:10eced95-5839-4d83-8068-5b66945ee6e0 for instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 on n-h2-851359-3 Aug 04 17:59:41.883057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-a008678d-fd07-4bed-8ae8-e269e76651ae req-a84f326a-4c9f-4e03-adce-2962cb10c27c service nova] Instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 17:59:41.895910 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-a008678d-fd07-4bed-8ae8-e269e76651ae req-a84f326a-4c9f-4e03-adce-2962cb10c27c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052335 Aug 04 17:59:41.896624 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3520/7072] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:59:42.075053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4044c01d-9a57-4b90-b286-eeb1a740262c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:42.076088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4044c01d-9a57-4b90-b286-eeb1a740262c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:42.088370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4044c01d-9a57-4b90-b286-eeb1a740262c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:42.089271 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4044c01d-9a57-4b90-b286-eeb1a740262c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:42.090132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4044c01d-9a57-4b90-b286-eeb1a740262c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:42.091451 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4044c01d-9a57-4b90-b286-eeb1a740262c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:42.092248 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4044c01d-9a57-4b90-b286-eeb1a740262c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:42.093002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4044c01d-9a57-4b90-b286-eeb1a740262c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:42.297524 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4044c01d-9a57-4b90-b286-eeb1a740262c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:42.306772 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4044c01d-9a57-4b90-b286-eeb1a740262c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1677 microversion: 2.1 time: 0.236327 Aug 04 17:59:42.307550 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3553/7073] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:42 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1677 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:59:43.330775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-93bae808-7897-46fa-a1d3-223fb970954d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:43.331577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-93bae808-7897-46fa-a1d3-223fb970954d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:43.338934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93bae808-7897-46fa-a1d3-223fb970954d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:43.339488 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93bae808-7897-46fa-a1d3-223fb970954d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:43.339948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93bae808-7897-46fa-a1d3-223fb970954d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:43.340728 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93bae808-7897-46fa-a1d3-223fb970954d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:43.341246 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93bae808-7897-46fa-a1d3-223fb970954d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:43.341689 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93bae808-7897-46fa-a1d3-223fb970954d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:43.363741 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:59:43.568215 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-93bae808-7897-46fa-a1d3-223fb970954d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:43.577715 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-93bae808-7897-46fa-a1d3-223fb970954d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1677 microversion: 2.1 time: 0.252535 Aug 04 17:59:43.579525 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3521/7074] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:43 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1677 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:44.604980 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-215c7a44-d3c6-47a2-87ee-19be5a977e8c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:44.607382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-215c7a44-d3c6-47a2-87ee-19be5a977e8c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:44.622170 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-215c7a44-d3c6-47a2-87ee-19be5a977e8c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:44.622930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-215c7a44-d3c6-47a2-87ee-19be5a977e8c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:44.623751 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-215c7a44-d3c6-47a2-87ee-19be5a977e8c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:44.626406 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-215c7a44-d3c6-47a2-87ee-19be5a977e8c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:44.629322 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-215c7a44-d3c6-47a2-87ee-19be5a977e8c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:44.630766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-215c7a44-d3c6-47a2-87ee-19be5a977e8c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:45.034315 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-215c7a44-d3c6-47a2-87ee-19be5a977e8c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:45.046286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:59:45.051843 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-215c7a44-d3c6-47a2-87ee-19be5a977e8c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1677 microversion: 2.1 time: 0.451627 Aug 04 17:59:45.052847 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3554/7075] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:44 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1677 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:46.088136 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e74ee0f1-f19b-4a85-a686-a04055482999 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:46.088965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e74ee0f1-f19b-4a85-a686-a04055482999 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:46.091363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:59:46.100968 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e74ee0f1-f19b-4a85-a686-a04055482999 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:46.101583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e74ee0f1-f19b-4a85-a686-a04055482999 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:46.102400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e74ee0f1-f19b-4a85-a686-a04055482999 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:46.103791 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e74ee0f1-f19b-4a85-a686-a04055482999 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:46.104667 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e74ee0f1-f19b-4a85-a686-a04055482999 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:46.105486 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e74ee0f1-f19b-4a85-a686-a04055482999 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:46.268992 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e74ee0f1-f19b-4a85-a686-a04055482999 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:46.278806 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e74ee0f1-f19b-4a85-a686-a04055482999 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1670 microversion: 2.1 time: 0.194885 Aug 04 17:59:46.279420 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3522/7076] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:46 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1670 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:46.301254 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e0db9e98-f920-4927-ae32-a96e69032685 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:46.302244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e0db9e98-f920-4927-ae32-a96e69032685 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:46.306012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=37 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:59:46.312540 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0db9e98-f920-4927-ae32-a96e69032685 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:46.313052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0db9e98-f920-4927-ae32-a96e69032685 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:46.313500 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0db9e98-f920-4927-ae32-a96e69032685 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:46.314272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0db9e98-f920-4927-ae32-a96e69032685 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:46.315120 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0db9e98-f920-4927-ae32-a96e69032685 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:46.315233 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e0db9e98-f920-4927-ae32-a96e69032685 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:46.391069 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-fdabad5a-7f93-4b5b-a78e-069b6188ec67 req-16769635-5d8b-4014-a455-64becefb2858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e362a3bd-c00c-4743-af02-d0c97f7b63f5", "name": "network-vif-plugged", "status": "completed", "tag": "10eced95-5839-4d83-8068-5b66945ee6e0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:59:46.406401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 17:59:46.411373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fdabad5a-7f93-4b5b-a78e-069b6188ec67 req-16769635-5d8b-4014-a455-64becefb2858 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:46.412306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fdabad5a-7f93-4b5b-a78e-069b6188ec67 req-16769635-5d8b-4014-a455-64becefb2858 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:46.413138 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fdabad5a-7f93-4b5b-a78e-069b6188ec67 req-16769635-5d8b-4014-a455-64becefb2858 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:46.437750 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-fdabad5a-7f93-4b5b-a78e-069b6188ec67 req-16769635-5d8b-4014-a455-64becefb2858 service nova] Creating event network-vif-plugged:10eced95-5839-4d83-8068-5b66945ee6e0 for instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 on n-h2-851359-3 Aug 04 17:59:46.450454 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-fdabad5a-7f93-4b5b-a78e-069b6188ec67 req-16769635-5d8b-4014-a455-64becefb2858 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067253 Aug 04 17:59:46.452970 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3523/7077] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 17:59:46.494961 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e0db9e98-f920-4927-ae32-a96e69032685 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:46.505738 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e0db9e98-f920-4927-ae32-a96e69032685 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1670 microversion: 2.1 time: 0.209573 Aug 04 17:59:46.506801 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3555/7078] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:46 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1670 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:46.544152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-95baadc2-c383-418f-8aee-8d2a89c30c8a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:46.544946 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-95baadc2-c383-418f-8aee-8d2a89c30c8a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:46.553180 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95baadc2-c383-418f-8aee-8d2a89c30c8a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:46.553613 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95baadc2-c383-418f-8aee-8d2a89c30c8a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:46.554140 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95baadc2-c383-418f-8aee-8d2a89c30c8a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:46.555017 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95baadc2-c383-418f-8aee-8d2a89c30c8a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:46.555444 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95baadc2-c383-418f-8aee-8d2a89c30c8a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:46.555891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95baadc2-c383-418f-8aee-8d2a89c30c8a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:46.720727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-95baadc2-c383-418f-8aee-8d2a89c30c8a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:46.729510 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-95baadc2-c383-418f-8aee-8d2a89c30c8a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1670 microversion: 2.1 time: 0.190155 Aug 04 17:59:46.730135 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3524/7079] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:46 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1670 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:46.751003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a3fe1fad-68dc-4b3d-b2c3-ba9fa9dcb255 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:46.751521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a3fe1fad-68dc-4b3d-b2c3-ba9fa9dcb255 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:46.761236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3fe1fad-68dc-4b3d-b2c3-ba9fa9dcb255 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:46.762235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3fe1fad-68dc-4b3d-b2c3-ba9fa9dcb255 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:46.763031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3fe1fad-68dc-4b3d-b2c3-ba9fa9dcb255 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:46.764298 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3fe1fad-68dc-4b3d-b2c3-ba9fa9dcb255 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:46.765135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3fe1fad-68dc-4b3d-b2c3-ba9fa9dcb255 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:46.765918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a3fe1fad-68dc-4b3d-b2c3-ba9fa9dcb255 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:46.800500 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a3fe1fad-68dc-4b3d-b2c3-ba9fa9dcb255 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 17:59:46.910499 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a3fe1fad-68dc-4b3d-b2c3-ba9fa9dcb255 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 204 len: 0 microversion: 2.1 time: 0.163023 Aug 04 17:59:46.911040 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3556/7080] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 17:59:46 2022] DELETE /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 17:59:46.920446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ba89fda2-2c65-4eb9-85e3-f2ba3aecba02 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:46.921459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ba89fda2-2c65-4eb9-85e3-f2ba3aecba02 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:46.931304 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba89fda2-2c65-4eb9-85e3-f2ba3aecba02 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:46.931876 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba89fda2-2c65-4eb9-85e3-f2ba3aecba02 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:46.932396 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba89fda2-2c65-4eb9-85e3-f2ba3aecba02 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:46.933184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba89fda2-2c65-4eb9-85e3-f2ba3aecba02 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:46.933772 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba89fda2-2c65-4eb9-85e3-f2ba3aecba02 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:46.934449 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba89fda2-2c65-4eb9-85e3-f2ba3aecba02 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:47.102146 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ba89fda2-2c65-4eb9-85e3-f2ba3aecba02 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:47.118009 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ba89fda2-2c65-4eb9-85e3-f2ba3aecba02 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1676 microversion: 2.1 time: 0.201272 Aug 04 17:59:47.118785 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3525/7081] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:46 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1676 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:48.142081 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2790efaf-f83b-4c7e-99bc-8589244d948b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:48.142859 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2790efaf-f83b-4c7e-99bc-8589244d948b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:48.151697 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2790efaf-f83b-4c7e-99bc-8589244d948b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:48.151697 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2790efaf-f83b-4c7e-99bc-8589244d948b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:48.152285 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2790efaf-f83b-4c7e-99bc-8589244d948b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:48.153205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2790efaf-f83b-4c7e-99bc-8589244d948b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:48.154864 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2790efaf-f83b-4c7e-99bc-8589244d948b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:48.154864 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2790efaf-f83b-4c7e-99bc-8589244d948b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:48.353620 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2790efaf-f83b-4c7e-99bc-8589244d948b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:48.362181 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2790efaf-f83b-4c7e-99bc-8589244d948b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1676 microversion: 2.1 time: 0.224521 Aug 04 17:59:48.362789 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3557/7082] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:48 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1676 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:49.385692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6cae321d-6b86-4b18-b032-dfcc92b98d49 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:49.387139 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6cae321d-6b86-4b18-b032-dfcc92b98d49 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:49.394671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6cae321d-6b86-4b18-b032-dfcc92b98d49 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:49.395290 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6cae321d-6b86-4b18-b032-dfcc92b98d49 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:49.395825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6cae321d-6b86-4b18-b032-dfcc92b98d49 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:49.396654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6cae321d-6b86-4b18-b032-dfcc92b98d49 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:49.397216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6cae321d-6b86-4b18-b032-dfcc92b98d49 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:49.397925 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6cae321d-6b86-4b18-b032-dfcc92b98d49 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:49.493216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6cae321d-6b86-4b18-b032-dfcc92b98d49 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:49.505436 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6cae321d-6b86-4b18-b032-dfcc92b98d49 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1608 microversion: 2.1 time: 0.123525 Aug 04 17:59:49.506700 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3526/7083] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:49 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1608 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:49.731202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-cad5cc84-5d91-48a5-a5ef-54aaac982dcf req-38e49c49-d943-4c11-9adb-41635d276c38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e362a3bd-c00c-4743-af02-d0c97f7b63f5", "name": "network-vif-deleted", "tag": "10eced95-5839-4d83-8068-5b66945ee6e0"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:59:49.745348 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-cad5cc84-5d91-48a5-a5ef-54aaac982dcf req-38e49c49-d943-4c11-9adb-41635d276c38 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:49.745872 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-cad5cc84-5d91-48a5-a5ef-54aaac982dcf req-38e49c49-d943-4c11-9adb-41635d276c38 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:49.746382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-cad5cc84-5d91-48a5-a5ef-54aaac982dcf req-38e49c49-d943-4c11-9adb-41635d276c38 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:49.762645 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-cad5cc84-5d91-48a5-a5ef-54aaac982dcf req-38e49c49-d943-4c11-9adb-41635d276c38 service nova] Creating event network-vif-deleted:10eced95-5839-4d83-8068-5b66945ee6e0 for instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 on n-h2-851359-3 Aug 04 17:59:49.768906 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-cad5cc84-5d91-48a5-a5ef-54aaac982dcf req-38e49c49-d943-4c11-9adb-41635d276c38 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042172 Aug 04 17:59:49.773153 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3558/7084] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:59:50.527343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-62fd5d92-287e-4a5e-9d8f-0d03ea9e57d3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:50.527993 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-62fd5d92-287e-4a5e-9d8f-0d03ea9e57d3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:50.536118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62fd5d92-287e-4a5e-9d8f-0d03ea9e57d3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:50.536640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62fd5d92-287e-4a5e-9d8f-0d03ea9e57d3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:50.537103 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62fd5d92-287e-4a5e-9d8f-0d03ea9e57d3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:50.537887 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62fd5d92-287e-4a5e-9d8f-0d03ea9e57d3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:50.538421 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62fd5d92-287e-4a5e-9d8f-0d03ea9e57d3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:50.538875 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62fd5d92-287e-4a5e-9d8f-0d03ea9e57d3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:50.585370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62fd5d92-287e-4a5e-9d8f-0d03ea9e57d3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:50.586004 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62fd5d92-287e-4a5e-9d8f-0d03ea9e57d3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:50.586477 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62fd5d92-287e-4a5e-9d8f-0d03ea9e57d3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:50.587271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-62fd5d92-287e-4a5e-9d8f-0d03ea9e57d3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lazy-loading 'fault' on Instance uuid e362a3bd-c00c-4743-af02-d0c97f7b63f5 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 17:59:50.641297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-62fd5d92-287e-4a5e-9d8f-0d03ea9e57d3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:50.655211 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-62fd5d92-287e-4a5e-9d8f-0d03ea9e57d3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 200 len: 1328 microversion: 2.1 time: 0.131340 Aug 04 17:59:50.656323 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3527/7085] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:50 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 1328 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:51.680481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8972b216-6343-4578-b4ca-0a8b0d2a91ee tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:51.681220 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8972b216-6343-4578-b4ca-0a8b0d2a91ee tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:51.687678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8972b216-6343-4578-b4ca-0a8b0d2a91ee tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:51.688167 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8972b216-6343-4578-b4ca-0a8b0d2a91ee tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:51.688613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8972b216-6343-4578-b4ca-0a8b0d2a91ee tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:51.689313 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8972b216-6343-4578-b4ca-0a8b0d2a91ee tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:51.689776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8972b216-6343-4578-b4ca-0a8b0d2a91ee tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:51.690229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8972b216-6343-4578-b4ca-0a8b0d2a91ee tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:51.704535 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-8972b216-6343-4578-b4ca-0a8b0d2a91ee tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] HTTP exception thrown: Instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 could not be found. Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8972b216-6343-4578-b4ca-0a8b0d2a91ee tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Request method failure captured: Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 HTTP/1.1 Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7AfT6zYdI3v3j-02bRJESZ0cQX8SQebuMvyOFolxezaFDG4gZ9xnd6e0qCa_-lApgDzu3pztkmmadMDNE7gcIqGRoGofJyFI-POj_4532hTw_ABv1wUgQSAdGvW5EU-lDt-gWQ_upzg4xh3TljemGdTL6S2wIV1BKopo6Mxdcy-27h8 Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: c527dc233da14fc5ab203d0489a8653f Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerActionsTestJSON-1276571273 Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c527dc233da14fc5ab203d0489a8653f"}]}] Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerActionsTestJSON-1276571273 Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: c527dc233da14fc5ab203d0489a8653f Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerActionsTestJSON-1276571273 Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerActionsTestJSON-1276571273-project Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 5123a91a38cf4524a1d9ae3a0ab45ee2 Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerActionsTestJSON-1276571273-project Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 could not be found. Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'e362a3bd-c00c-4743-af02-d0c97f7b63f5'} Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 could not be found. Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 could not be found. Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:59:51.707328 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:59:51.711521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:59:51.711521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:59:51.711521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:59:51.711521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:59:51.711521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:59:51.711521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 could not be found. Aug 04 17:59:51.711521 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 17:59:51.711521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8972b216-6343-4578-b4ca-0a8b0d2a91ee tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Returning 404 to user: Instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:59:51.711521 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8972b216-6343-4578-b4ca-0a8b0d2a91ee tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 404 len: 111 microversion: 2.1 time: 0.033056 Aug 04 17:59:51.711521 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3559/7086] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:51 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:59:51.729622 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ab8e9f01-cc64-4025-8140-7ed5e0df08ed tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:51.730290 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ab8e9f01-cc64-4025-8140-7ed5e0df08ed tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:51.738872 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab8e9f01-cc64-4025-8140-7ed5e0df08ed tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:51.739385 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab8e9f01-cc64-4025-8140-7ed5e0df08ed tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:51.739844 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab8e9f01-cc64-4025-8140-7ed5e0df08ed tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:51.740573 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab8e9f01-cc64-4025-8140-7ed5e0df08ed tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:51.741052 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab8e9f01-cc64-4025-8140-7ed5e0df08ed tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:51.741499 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab8e9f01-cc64-4025-8140-7ed5e0df08ed tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:51.756122 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-ab8e9f01-cc64-4025-8140-7ed5e0df08ed tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] HTTP exception thrown: Instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 could not be found. Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ab8e9f01-cc64-4025-8140-7ed5e0df08ed tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Request method failure captured: Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 HTTP/1.1 Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AfT6zYdI3v3j-02bRJESZ0cQX8SQebuMvyOFolxezaFDG4gZ9xnd6e0qCa_-lApgDzu3pztkmmadMDNE7gcIqGRoGofJyFI-POj_4532hTw_ABv1wUgQSAdGvW5EU-lDt-gWQ_upzg4xh3TljemGdTL6S2wIV1BKopo6Mxdcy-27h8 Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: c527dc233da14fc5ab203d0489a8653f Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerActionsTestJSON-1276571273 Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c527dc233da14fc5ab203d0489a8653f"}]}] Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServerActionsTestJSON-1276571273 Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: c527dc233da14fc5ab203d0489a8653f Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerActionsTestJSON-1276571273 Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServerActionsTestJSON-1276571273-project Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 5123a91a38cf4524a1d9ae3a0ab45ee2 Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServerActionsTestJSON-1276571273-project Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 could not be found. Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'e362a3bd-c00c-4743-af02-d0c97f7b63f5'} Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 could not be found. Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 could not be found. Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 17:59:51.757859 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:59:51.763971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 17:59:51.763971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 17:59:51.763971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 17:59:51.763971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 17:59:51.763971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 17:59:51.763971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 could not be found. Aug 04 17:59:51.763971 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 17:59:51.763971 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ab8e9f01-cc64-4025-8140-7ed5e0df08ed tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Returning 404 to user: Instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 17:59:51.763971 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ab8e9f01-cc64-4025-8140-7ed5e0df08ed tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 404 len: 111 microversion: 2.1 time: 0.034921 Aug 04 17:59:51.763971 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3528/7087] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:51 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 17:59:51.811487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-71213e38-1f0c-46bd-9599-99c0a8088887 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1246059426", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "7adc776d-adf3-4203-a12e-826c1017ffea"}], "security_groups": [{"name": "tempest-securitygroup--1273216019"}], "key_name": "tempest-keypair-2056900899", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:59:51.926063 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-71213e38-1f0c-46bd-9599-99c0a8088887 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] validate_networks() for [('7adc776d-adf3-4203-a12e-826c1017ffea', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 17:59:52.403991 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-71213e38-1f0c-46bd-9599-99c0a8088887 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 17:59:52.404583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-71213e38-1f0c-46bd-9599-99c0a8088887 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 17:59:52.405109 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-71213e38-1f0c-46bd-9599-99c0a8088887 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 17:59:52.405575 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-71213e38-1f0c-46bd-9599-99c0a8088887 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 17:59:52.406103 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-71213e38-1f0c-46bd-9599-99c0a8088887 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 17:59:52.416875 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71213e38-1f0c-46bd-9599-99c0a8088887 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:52.417462 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71213e38-1f0c-46bd-9599-99c0a8088887 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:52.418030 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71213e38-1f0c-46bd-9599-99c0a8088887 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:52.418950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71213e38-1f0c-46bd-9599-99c0a8088887 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:52.419463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71213e38-1f0c-46bd-9599-99c0a8088887 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:52.420017 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71213e38-1f0c-46bd-9599-99c0a8088887 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:52.439913 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-71213e38-1f0c-46bd-9599-99c0a8088887 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Getting quotas for project c527dc233da14fc5ab203d0489a8653f. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 17:59:52.446477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-71213e38-1f0c-46bd-9599-99c0a8088887 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Getting quotas for user 5123a91a38cf4524a1d9ae3a0ab45ee2 and project c527dc233da14fc5ab203d0489a8653f. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 17:59:52.460915 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-71213e38-1f0c-46bd-9599-99c0a8088887 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 17:59:52.463322 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-71213e38-1f0c-46bd-9599-99c0a8088887 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 17:59:52.513151 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-71213e38-1f0c-46bd-9599-99c0a8088887 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.705480 Aug 04 17:59:52.513807 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3560/7088] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 17:59:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 17:59:52.529458 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6249cac0-f158-4201-ad40-19af122ac2d9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:52.530722 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6249cac0-f158-4201-ad40-19af122ac2d9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:52.623373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6249cac0-f158-4201-ad40-19af122ac2d9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:52.634162 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6249cac0-f158-4201-ad40-19af122ac2d9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1239 microversion: 2.1 time: 0.111932 Aug 04 17:59:52.635025 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3529/7089] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:52 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1239 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:59:53.672033 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a48acd06-175a-4eb8-a71c-de9ad8b66364 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:53.673099 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a48acd06-175a-4eb8-a71c-de9ad8b66364 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:53.683275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a48acd06-175a-4eb8-a71c-de9ad8b66364 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:53.684052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a48acd06-175a-4eb8-a71c-de9ad8b66364 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:53.684588 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a48acd06-175a-4eb8-a71c-de9ad8b66364 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:53.685391 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a48acd06-175a-4eb8-a71c-de9ad8b66364 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:53.686007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a48acd06-175a-4eb8-a71c-de9ad8b66364 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:53.686523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a48acd06-175a-4eb8-a71c-de9ad8b66364 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:53.784303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a48acd06-175a-4eb8-a71c-de9ad8b66364 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:53.799375 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a48acd06-175a-4eb8-a71c-de9ad8b66364 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1299 microversion: 2.1 time: 0.136526 Aug 04 17:59:53.800565 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3561/7090] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:53 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1299 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:54.833788 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9c7153da-26ad-49b4-b824-c5ebea17c47e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:54.835119 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9c7153da-26ad-49b4-b824-c5ebea17c47e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:54.853661 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c7153da-26ad-49b4-b824-c5ebea17c47e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:54.854620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c7153da-26ad-49b4-b824-c5ebea17c47e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:54.855220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c7153da-26ad-49b4-b824-c5ebea17c47e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:54.856356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c7153da-26ad-49b4-b824-c5ebea17c47e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:54.857118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c7153da-26ad-49b4-b824-c5ebea17c47e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:54.857816 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c7153da-26ad-49b4-b824-c5ebea17c47e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:55.075001 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9c7153da-26ad-49b4-b824-c5ebea17c47e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:55.086502 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9c7153da-26ad-49b4-b824-c5ebea17c47e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1365 microversion: 2.1 time: 0.262371 Aug 04 17:59:55.087222 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3530/7091] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:54 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1365 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:55.548086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-108e7787-2297-4703-81e4-11367e7964f1 req-ee37ea00-feaa-484d-b724-6e4728be214d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38021a56-404e-46b9-b0fc-b1b4c29c1406", "tag": "bfb7c1b4-b403-4744-82d7-f7c3fbe8e5d0"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 17:59:55.567005 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-108e7787-2297-4703-81e4-11367e7964f1 req-ee37ea00-feaa-484d-b724-6e4728be214d service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:55.567914 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-108e7787-2297-4703-81e4-11367e7964f1 req-ee37ea00-feaa-484d-b724-6e4728be214d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:55.568659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-108e7787-2297-4703-81e4-11367e7964f1 req-ee37ea00-feaa-484d-b724-6e4728be214d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:55.586214 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-108e7787-2297-4703-81e4-11367e7964f1 req-ee37ea00-feaa-484d-b724-6e4728be214d service nova] Creating event network-changed:bfb7c1b4-b403-4744-82d7-f7c3fbe8e5d0 for instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 on n-h1-851359-3 Aug 04 17:59:55.592561 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-108e7787-2297-4703-81e4-11367e7964f1 req-ee37ea00-feaa-484d-b724-6e4728be214d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057937 Aug 04 17:59:55.595622 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3562/7092] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 17:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 17:59:56.125058 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-859f3c87-92f4-4040-9122-dad578fb39c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:56.126219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-859f3c87-92f4-4040-9122-dad578fb39c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:56.139381 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-859f3c87-92f4-4040-9122-dad578fb39c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:56.140272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-859f3c87-92f4-4040-9122-dad578fb39c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:56.141087 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-859f3c87-92f4-4040-9122-dad578fb39c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:56.142523 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-859f3c87-92f4-4040-9122-dad578fb39c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:56.143451 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-859f3c87-92f4-4040-9122-dad578fb39c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:56.144961 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-859f3c87-92f4-4040-9122-dad578fb39c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:56.360412 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-859f3c87-92f4-4040-9122-dad578fb39c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:56.375251 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-859f3c87-92f4-4040-9122-dad578fb39c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1365 microversion: 2.1 time: 0.257168 Aug 04 17:59:56.376312 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3531/7093] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:56 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1365 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:57.403453 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a00449ba-d918-4df0-896a-ff8664eaf998 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:57.404095 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a00449ba-d918-4df0-896a-ff8664eaf998 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:57.412931 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a00449ba-d918-4df0-896a-ff8664eaf998 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:57.413575 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a00449ba-d918-4df0-896a-ff8664eaf998 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:57.414189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a00449ba-d918-4df0-896a-ff8664eaf998 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:57.415108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a00449ba-d918-4df0-896a-ff8664eaf998 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:57.415675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a00449ba-d918-4df0-896a-ff8664eaf998 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:57.416209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a00449ba-d918-4df0-896a-ff8664eaf998 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:57.624001 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a00449ba-d918-4df0-896a-ff8664eaf998 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:57.634376 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a00449ba-d918-4df0-896a-ff8664eaf998 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1365 microversion: 2.1 time: 0.236398 Aug 04 17:59:57.634376 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3563/7094] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:57 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 17:59:58.664499 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-240404b4-67d0-4197-a055-607329c7af25 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:58.666045 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-240404b4-67d0-4197-a055-607329c7af25 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:58.675800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-240404b4-67d0-4197-a055-607329c7af25 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:58.676520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-240404b4-67d0-4197-a055-607329c7af25 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:58.677077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-240404b4-67d0-4197-a055-607329c7af25 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:58.678029 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-240404b4-67d0-4197-a055-607329c7af25 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:58.678741 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-240404b4-67d0-4197-a055-607329c7af25 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:58.679220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-240404b4-67d0-4197-a055-607329c7af25 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:58.874656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-240404b4-67d0-4197-a055-607329c7af25 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 17:59:58.884738 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-240404b4-67d0-4197-a055-607329c7af25 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1365 microversion: 2.1 time: 0.226658 Aug 04 17:59:58.885445 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3532/7095] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:58 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 17:59:59.910653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d7cc37bc-0606-4401-bebc-d267e6a4e9f8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 17:59:59.911333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d7cc37bc-0606-4401-bebc-d267e6a4e9f8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 17:59:59.919191 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7cc37bc-0606-4401-bebc-d267e6a4e9f8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:59.919841 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7cc37bc-0606-4401-bebc-d267e6a4e9f8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:59.920157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7cc37bc-0606-4401-bebc-d267e6a4e9f8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 17:59:59.920887 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7cc37bc-0606-4401-bebc-d267e6a4e9f8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 17:59:59.921356 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7cc37bc-0606-4401-bebc-d267e6a4e9f8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 17:59:59.921882 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d7cc37bc-0606-4401-bebc-d267e6a4e9f8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:00:00.116517 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d7cc37bc-0606-4401-bebc-d267e6a4e9f8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:00:00.125056 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d7cc37bc-0606-4401-bebc-d267e6a4e9f8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1365 microversion: 2.1 time: 0.219289 Aug 04 18:00:00.125664 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3564/7096] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 17:59:59 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:00:00.760987 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-762fae38-cb25-4b3a-a6aa-6d999607e883 req-518bd23f-75f6-4992-a73c-d1af9e411b79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38021a56-404e-46b9-b0fc-b1b4c29c1406", "name": "network-vif-plugged", "status": "completed", "tag": "bfb7c1b4-b403-4744-82d7-f7c3fbe8e5d0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:00:00.780579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-762fae38-cb25-4b3a-a6aa-6d999607e883 req-518bd23f-75f6-4992-a73c-d1af9e411b79 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:00:00.781466 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-762fae38-cb25-4b3a-a6aa-6d999607e883 req-518bd23f-75f6-4992-a73c-d1af9e411b79 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:00:00.782282 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-762fae38-cb25-4b3a-a6aa-6d999607e883 req-518bd23f-75f6-4992-a73c-d1af9e411b79 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:00:00.803838 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-762fae38-cb25-4b3a-a6aa-6d999607e883 req-518bd23f-75f6-4992-a73c-d1af9e411b79 service nova] Creating event network-vif-plugged:bfb7c1b4-b403-4744-82d7-f7c3fbe8e5d0 for instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 on n-h1-851359-3 Aug 04 18:00:00.810636 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-762fae38-cb25-4b3a-a6aa-6d999607e883 req-518bd23f-75f6-4992-a73c-d1af9e411b79 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055493 Aug 04 18:00:00.811290 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3533/7097] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:00:01.151492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bc2c6a6c-b127-4f31-a4aa-8125de946438 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:00:01.152671 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bc2c6a6c-b127-4f31-a4aa-8125de946438 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:00:01.164155 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc2c6a6c-b127-4f31-a4aa-8125de946438 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:00:01.165570 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc2c6a6c-b127-4f31-a4aa-8125de946438 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:00:01.166389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc2c6a6c-b127-4f31-a4aa-8125de946438 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:00:01.168370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc2c6a6c-b127-4f31-a4aa-8125de946438 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:00:01.169448 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc2c6a6c-b127-4f31-a4aa-8125de946438 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:00:01.170650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc2c6a6c-b127-4f31-a4aa-8125de946438 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:00:01.372432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bc2c6a6c-b127-4f31-a4aa-8125de946438 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:00:01.381034 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bc2c6a6c-b127-4f31-a4aa-8125de946438 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1365 microversion: 2.1 time: 0.236848 Aug 04 18:00:01.381640 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3565/7098] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:00:01 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:00:02.407044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-93e5d927-d56b-4d88-9f63-2a81088204d4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:00:02.408172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-93e5d927-d56b-4d88-9f63-2a81088204d4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:00:02.416118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93e5d927-d56b-4d88-9f63-2a81088204d4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:00:02.416628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93e5d927-d56b-4d88-9f63-2a81088204d4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:00:02.417097 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93e5d927-d56b-4d88-9f63-2a81088204d4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:00:02.417840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93e5d927-d56b-4d88-9f63-2a81088204d4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:00:02.418349 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93e5d927-d56b-4d88-9f63-2a81088204d4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:00:02.418807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93e5d927-d56b-4d88-9f63-2a81088204d4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:00:02.614578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-93e5d927-d56b-4d88-9f63-2a81088204d4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:00:02.626328 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-93e5d927-d56b-4d88-9f63-2a81088204d4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1553 microversion: 2.1 time: 0.226691 Aug 04 18:00:02.627408 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3534/7099] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:00:02 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1553 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:00:02.663537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f355f4d4-0f95-42c4-84b6-9bccc168d589 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:00:02.664414 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f355f4d4-0f95-42c4-84b6-9bccc168d589 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:00:02.667265 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:00:02.667978 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:00:02.674175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f355f4d4-0f95-42c4-84b6-9bccc168d589 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:00:02.674688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f355f4d4-0f95-42c4-84b6-9bccc168d589 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:00:02.675757 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f355f4d4-0f95-42c4-84b6-9bccc168d589 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:00:02.677014 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f355f4d4-0f95-42c4-84b6-9bccc168d589 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:00:02.677014 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f355f4d4-0f95-42c4-84b6-9bccc168d589 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:00:02.677409 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f355f4d4-0f95-42c4-84b6-9bccc168d589 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:00:02.789510 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f355f4d4-0f95-42c4-84b6-9bccc168d589 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.130621 Aug 04 18:00:02.790211 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3566/7100] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Aug 4 18:00:02 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406/os-interface => generated 285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:00:04.141169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-bf9be9a0-3139-4b09-bd3d-b6b26b6c3503 req-ae89a271-547b-4a5c-8892-b90b6ae4a0b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38021a56-404e-46b9-b0fc-b1b4c29c1406", "tag": "bfb7c1b4-b403-4744-82d7-f7c3fbe8e5d0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:00:04.146259 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:00:04.153543 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-bf9be9a0-3139-4b09-bd3d-b6b26b6c3503 req-ae89a271-547b-4a5c-8892-b90b6ae4a0b0 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:00:04.154191 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-bf9be9a0-3139-4b09-bd3d-b6b26b6c3503 req-ae89a271-547b-4a5c-8892-b90b6ae4a0b0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:00:04.154644 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-bf9be9a0-3139-4b09-bd3d-b6b26b6c3503 req-ae89a271-547b-4a5c-8892-b90b6ae4a0b0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:00:04.173595 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-bf9be9a0-3139-4b09-bd3d-b6b26b6c3503 req-ae89a271-547b-4a5c-8892-b90b6ae4a0b0 service nova] Creating event network-changed:bfb7c1b4-b403-4744-82d7-f7c3fbe8e5d0 for instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 on n-h1-851359-3 Aug 04 18:00:04.184111 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-bf9be9a0-3139-4b09-bd3d-b6b26b6c3503 req-ae89a271-547b-4a5c-8892-b90b6ae4a0b0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050968 Aug 04 18:00:04.185393 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3535/7101] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:00:42.021850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:00:42.023411 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:00:42.031523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6847473f-2e0e-4e1c-b314-028a85cd88a1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:00:42.032713 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6847473f-2e0e-4e1c-b314-028a85cd88a1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:00:42.047939 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6847473f-2e0e-4e1c-b314-028a85cd88a1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:00:42.049448 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6847473f-2e0e-4e1c-b314-028a85cd88a1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:00:42.050320 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6847473f-2e0e-4e1c-b314-028a85cd88a1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:00:42.051665 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6847473f-2e0e-4e1c-b314-028a85cd88a1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:00:42.052542 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6847473f-2e0e-4e1c-b314-028a85cd88a1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:00:42.053356 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6847473f-2e0e-4e1c-b314-028a85cd88a1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:00:42.259468 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6847473f-2e0e-4e1c-b314-028a85cd88a1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:00:42.268856 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6847473f-2e0e-4e1c-b314-028a85cd88a1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1672 microversion: 2.1 time: 0.250751 Aug 04 18:00:42.269492 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3567/7102] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:00:42 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1672 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:00:42.291512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=29 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:00:42.293385 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=66 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:00:42.303035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7b6db8a1-19bd-40c4-bcfe-cb1dfd5a2d22 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "724a7488-51e6-4329-976f-fbd478bbde41"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:00:42.307555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7b6db8a1-19bd-40c4-bcfe-cb1dfd5a2d22 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:00:42.321153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b6db8a1-19bd-40c4-bcfe-cb1dfd5a2d22 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:00:42.322109 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b6db8a1-19bd-40c4-bcfe-cb1dfd5a2d22 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:00:42.322948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b6db8a1-19bd-40c4-bcfe-cb1dfd5a2d22 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:00:42.324253 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b6db8a1-19bd-40c4-bcfe-cb1dfd5a2d22 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:00:42.325121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b6db8a1-19bd-40c4-bcfe-cb1dfd5a2d22 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:00:42.325929 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b6db8a1-19bd-40c4-bcfe-cb1dfd5a2d22 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:00:42.698277 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7b6db8a1-19bd-40c4-bcfe-cb1dfd5a2d22 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "POST /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.410437 Aug 04 18:00:42.699526 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3536/7103] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Aug 4 18:00:42 2022] POST /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406/os-volume_attachments => generated 194 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:00:54.779691 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-82d96f93-5ef8-4b6b-9049-88046ccff140 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:00:54.784134 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-82d96f93-5ef8-4b6b-9049-88046ccff140 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:00:54.788672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:00:54.789898 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:00:54.800085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82d96f93-5ef8-4b6b-9049-88046ccff140 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:00:54.800900 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82d96f93-5ef8-4b6b-9049-88046ccff140 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:00:54.801626 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82d96f93-5ef8-4b6b-9049-88046ccff140 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:00:54.802865 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82d96f93-5ef8-4b6b-9049-88046ccff140 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:00:54.803640 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82d96f93-5ef8-4b6b-9049-88046ccff140 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:00:54.804335 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82d96f93-5ef8-4b6b-9049-88046ccff140 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:00:54.857112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-82d96f93-5ef8-4b6b-9049-88046ccff140 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:00:54.869855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-82d96f93-5ef8-4b6b-9049-88046ccff140 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Old instance type m1.heat2, new instance type m1.heat {{(pid=131043) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 18:00:54.884083 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-82d96f93-5ef8-4b6b-9049-88046ccff140 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 18:00:54.884822 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-82d96f93-5ef8-4b6b-9049-88046ccff140 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 18:00:54.885675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-82d96f93-5ef8-4b6b-9049-88046ccff140 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 18:00:54.886456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-82d96f93-5ef8-4b6b-9049-88046ccff140 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 18:00:54.887179 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-82d96f93-5ef8-4b6b-9049-88046ccff140 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 18:00:55.001199 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-82d96f93-5ef8-4b6b-9049-88046ccff140 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "POST /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406/action" status: 202 len: 0 microversion: 2.1 time: 0.228306 Aug 04 18:00:55.002927 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3568/7104] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:00:54 2022] POST /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 18:00:55.014296 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:00:55.015834 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:00:55.024079 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a878ee8b-5138-431c-9ad5-4361accda8dd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:00:55.025451 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a878ee8b-5138-431c-9ad5-4361accda8dd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:00:55.039391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a878ee8b-5138-431c-9ad5-4361accda8dd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:00:55.040195 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a878ee8b-5138-431c-9ad5-4361accda8dd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:00:55.040991 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a878ee8b-5138-431c-9ad5-4361accda8dd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:00:55.042268 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a878ee8b-5138-431c-9ad5-4361accda8dd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:00:55.043096 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a878ee8b-5138-431c-9ad5-4361accda8dd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:00:55.044341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a878ee8b-5138-431c-9ad5-4361accda8dd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:00:55.299514 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a878ee8b-5138-431c-9ad5-4361accda8dd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:00:55.308403 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a878ee8b-5138-431c-9ad5-4361accda8dd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1727 microversion: 2.1 time: 0.298104 Aug 04 18:00:55.309290 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3537/7105] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:00:55 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1727 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:00:56.348569 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-471f465e-df17-4cdf-bcc6-759191a9848b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:00:56.349272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-471f465e-df17-4cdf-bcc6-759191a9848b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:00:56.355433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-471f465e-df17-4cdf-bcc6-759191a9848b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:00:56.355935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-471f465e-df17-4cdf-bcc6-759191a9848b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:00:56.356388 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-471f465e-df17-4cdf-bcc6-759191a9848b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:00:56.357104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-471f465e-df17-4cdf-bcc6-759191a9848b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:00:56.357571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-471f465e-df17-4cdf-bcc6-759191a9848b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:00:56.358027 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-471f465e-df17-4cdf-bcc6-759191a9848b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:00:56.520390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-471f465e-df17-4cdf-bcc6-759191a9848b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:00:56.529315 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-471f465e-df17-4cdf-bcc6-759191a9848b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1727 microversion: 2.1 time: 0.186843 Aug 04 18:00:56.529907 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3569/7106] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:00:56 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1727 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:00:57.566023 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2a8a81a8-9276-4cd4-b28b-724dbdd095d8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:00:57.566884 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2a8a81a8-9276-4cd4-b28b-724dbdd095d8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:00:57.583021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a8a81a8-9276-4cd4-b28b-724dbdd095d8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:00:57.583021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a8a81a8-9276-4cd4-b28b-724dbdd095d8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:00:57.583021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a8a81a8-9276-4cd4-b28b-724dbdd095d8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:00:57.583021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a8a81a8-9276-4cd4-b28b-724dbdd095d8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:00:57.583021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a8a81a8-9276-4cd4-b28b-724dbdd095d8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:00:57.583021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a8a81a8-9276-4cd4-b28b-724dbdd095d8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:00:57.758026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2a8a81a8-9276-4cd4-b28b-724dbdd095d8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:00:57.769143 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2a8a81a8-9276-4cd4-b28b-724dbdd095d8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1732 microversion: 2.1 time: 0.207897 Aug 04 18:00:57.769762 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3538/7107] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:00:57 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1732 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:00:58.805884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4b6e8a13-eee3-4dcf-99ab-dfb8e4babc1d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:00:58.806685 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4b6e8a13-eee3-4dcf-99ab-dfb8e4babc1d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:00:58.814683 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b6e8a13-eee3-4dcf-99ab-dfb8e4babc1d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:00:58.815283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b6e8a13-eee3-4dcf-99ab-dfb8e4babc1d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:00:58.815846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b6e8a13-eee3-4dcf-99ab-dfb8e4babc1d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:00:58.816674 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b6e8a13-eee3-4dcf-99ab-dfb8e4babc1d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:00:58.817321 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b6e8a13-eee3-4dcf-99ab-dfb8e4babc1d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:00:58.817858 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4b6e8a13-eee3-4dcf-99ab-dfb8e4babc1d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:00:59.031576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4b6e8a13-eee3-4dcf-99ab-dfb8e4babc1d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:00:59.040689 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4b6e8a13-eee3-4dcf-99ab-dfb8e4babc1d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1732 microversion: 2.1 time: 0.238843 Aug 04 18:00:59.041315 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3570/7108] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:00:58 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1732 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:00.063055 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a5836fb7-760d-4ada-8253-2cd7d627ce9d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:00.063814 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a5836fb7-760d-4ada-8253-2cd7d627ce9d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:00.071494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5836fb7-760d-4ada-8253-2cd7d627ce9d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:00.072002 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5836fb7-760d-4ada-8253-2cd7d627ce9d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:00.072457 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5836fb7-760d-4ada-8253-2cd7d627ce9d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:00.073186 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5836fb7-760d-4ada-8253-2cd7d627ce9d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:00.073714 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5836fb7-760d-4ada-8253-2cd7d627ce9d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:00.074136 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5836fb7-760d-4ada-8253-2cd7d627ce9d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:00.224203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a5836fb7-760d-4ada-8253-2cd7d627ce9d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:00.234585 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a5836fb7-760d-4ada-8253-2cd7d627ce9d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1732 microversion: 2.1 time: 0.175725 Aug 04 18:01:00.235447 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3539/7109] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:00 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:01.259171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-89a31049-5f15-44bd-b54b-4c1181eb8368 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:01.259797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-89a31049-5f15-44bd-b54b-4c1181eb8368 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:01.266502 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89a31049-5f15-44bd-b54b-4c1181eb8368 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:01.267572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89a31049-5f15-44bd-b54b-4c1181eb8368 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:01.268026 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89a31049-5f15-44bd-b54b-4c1181eb8368 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:01.268754 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89a31049-5f15-44bd-b54b-4c1181eb8368 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:01.269229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89a31049-5f15-44bd-b54b-4c1181eb8368 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:01.269663 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-89a31049-5f15-44bd-b54b-4c1181eb8368 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:01.417829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-89a31049-5f15-44bd-b54b-4c1181eb8368 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:01.427641 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-89a31049-5f15-44bd-b54b-4c1181eb8368 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1732 microversion: 2.1 time: 0.172528 Aug 04 18:01:01.428242 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3571/7110] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:01 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:02.451487 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-979262e6-0d48-4648-abd4-2707dc889c45 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:02.452454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-979262e6-0d48-4648-abd4-2707dc889c45 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:02.462659 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-979262e6-0d48-4648-abd4-2707dc889c45 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:02.463181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-979262e6-0d48-4648-abd4-2707dc889c45 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:02.463634 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-979262e6-0d48-4648-abd4-2707dc889c45 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:02.464681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-979262e6-0d48-4648-abd4-2707dc889c45 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:02.465164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-979262e6-0d48-4648-abd4-2707dc889c45 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:02.465610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-979262e6-0d48-4648-abd4-2707dc889c45 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:02.624739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-979262e6-0d48-4648-abd4-2707dc889c45 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:02.640912 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-979262e6-0d48-4648-abd4-2707dc889c45 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1732 microversion: 2.1 time: 0.192845 Aug 04 18:01:02.641909 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3540/7111] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:02 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1732 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:03.127629 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:01:03.127964 n-d-851359-3 devstack@n-api.service[131044]: Thu Aug 4 18:01:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:01:03.666214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2c8140d4-6546-4316-9bd5-fa60882cee0d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:03.667106 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2c8140d4-6546-4316-9bd5-fa60882cee0d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:03.674866 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c8140d4-6546-4316-9bd5-fa60882cee0d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:03.675377 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c8140d4-6546-4316-9bd5-fa60882cee0d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:03.676056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c8140d4-6546-4316-9bd5-fa60882cee0d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:03.676606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c8140d4-6546-4316-9bd5-fa60882cee0d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:03.677069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c8140d4-6546-4316-9bd5-fa60882cee0d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:03.677505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c8140d4-6546-4316-9bd5-fa60882cee0d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:03.825410 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2c8140d4-6546-4316-9bd5-fa60882cee0d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:03.834630 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2c8140d4-6546-4316-9bd5-fa60882cee0d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1732 microversion: 2.1 time: 0.172435 Aug 04 18:01:03.835213 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3572/7112] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:03 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:01:04.857298 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3f45bd7f-802b-41be-a6dc-a84deed8261f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:04.857933 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3f45bd7f-802b-41be-a6dc-a84deed8261f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:04.866215 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f45bd7f-802b-41be-a6dc-a84deed8261f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:04.866757 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f45bd7f-802b-41be-a6dc-a84deed8261f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:04.867181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f45bd7f-802b-41be-a6dc-a84deed8261f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:04.867913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f45bd7f-802b-41be-a6dc-a84deed8261f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:04.868385 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f45bd7f-802b-41be-a6dc-a84deed8261f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:04.868821 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f45bd7f-802b-41be-a6dc-a84deed8261f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:05.060080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3f45bd7f-802b-41be-a6dc-a84deed8261f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:05.071758 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3f45bd7f-802b-41be-a6dc-a84deed8261f tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1732 microversion: 2.1 time: 0.218416 Aug 04 18:01:05.072356 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3541/7113] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:04 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1732 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:06.093057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3b00dae5-7fbf-4666-984d-99acadd9c651 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:06.093689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3b00dae5-7fbf-4666-984d-99acadd9c651 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:06.103407 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b00dae5-7fbf-4666-984d-99acadd9c651 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:06.104051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b00dae5-7fbf-4666-984d-99acadd9c651 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:06.104579 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b00dae5-7fbf-4666-984d-99acadd9c651 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:06.105550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b00dae5-7fbf-4666-984d-99acadd9c651 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:06.106186 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b00dae5-7fbf-4666-984d-99acadd9c651 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:06.106765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3b00dae5-7fbf-4666-984d-99acadd9c651 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:06.258342 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3b00dae5-7fbf-4666-984d-99acadd9c651 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:06.267379 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3b00dae5-7fbf-4666-984d-99acadd9c651 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1732 microversion: 2.1 time: 0.178227 Aug 04 18:01:06.267980 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3573/7114] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:06 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1732 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:07.289130 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b99d362c-240b-4ab9-b741-341653a35858 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:07.289770 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b99d362c-240b-4ab9-b741-341653a35858 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:07.297381 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b99d362c-240b-4ab9-b741-341653a35858 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:07.297906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b99d362c-240b-4ab9-b741-341653a35858 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:07.298410 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b99d362c-240b-4ab9-b741-341653a35858 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:07.299181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b99d362c-240b-4ab9-b741-341653a35858 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:07.299666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b99d362c-240b-4ab9-b741-341653a35858 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:07.300118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b99d362c-240b-4ab9-b741-341653a35858 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:07.462683 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b99d362c-240b-4ab9-b741-341653a35858 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:07.471808 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b99d362c-240b-4ab9-b741-341653a35858 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1732 microversion: 2.1 time: 0.186695 Aug 04 18:01:07.472418 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3542/7115] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:07 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1732 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:08.493796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-71a7e5d4-456a-4b08-8314-3e393dda1bf9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:08.494541 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-71a7e5d4-456a-4b08-8314-3e393dda1bf9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:08.502940 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71a7e5d4-456a-4b08-8314-3e393dda1bf9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:08.503459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71a7e5d4-456a-4b08-8314-3e393dda1bf9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:08.503980 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71a7e5d4-456a-4b08-8314-3e393dda1bf9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:08.504786 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71a7e5d4-456a-4b08-8314-3e393dda1bf9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:08.505310 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71a7e5d4-456a-4b08-8314-3e393dda1bf9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:08.505817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-71a7e5d4-456a-4b08-8314-3e393dda1bf9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:08.656088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-71a7e5d4-456a-4b08-8314-3e393dda1bf9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:08.666606 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-71a7e5d4-456a-4b08-8314-3e393dda1bf9 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1732 microversion: 2.1 time: 0.176932 Aug 04 18:01:08.667292 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3574/7116] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:08 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:09.696972 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-915b43f4-853e-463b-8a91-ee70435fd7c1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:09.697651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-915b43f4-853e-463b-8a91-ee70435fd7c1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:09.705367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-915b43f4-853e-463b-8a91-ee70435fd7c1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:09.705877 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-915b43f4-853e-463b-8a91-ee70435fd7c1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:09.706366 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-915b43f4-853e-463b-8a91-ee70435fd7c1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:09.707100 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-915b43f4-853e-463b-8a91-ee70435fd7c1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:09.707594 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-915b43f4-853e-463b-8a91-ee70435fd7c1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:09.708033 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-915b43f4-853e-463b-8a91-ee70435fd7c1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:09.886163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-915b43f4-853e-463b-8a91-ee70435fd7c1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:09.894534 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-915b43f4-853e-463b-8a91-ee70435fd7c1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1732 microversion: 2.1 time: 0.201518 Aug 04 18:01:09.895120 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3543/7117] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:09 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1732 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:10.919134 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5fd1ff3f-f0d2-46ee-a828-bd9879f158cb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:10.920086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5fd1ff3f-f0d2-46ee-a828-bd9879f158cb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:10.928104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5fd1ff3f-f0d2-46ee-a828-bd9879f158cb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:10.928619 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5fd1ff3f-f0d2-46ee-a828-bd9879f158cb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:10.929091 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5fd1ff3f-f0d2-46ee-a828-bd9879f158cb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:10.930145 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5fd1ff3f-f0d2-46ee-a828-bd9879f158cb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:10.930628 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5fd1ff3f-f0d2-46ee-a828-bd9879f158cb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:10.931067 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5fd1ff3f-f0d2-46ee-a828-bd9879f158cb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:11.102223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5fd1ff3f-f0d2-46ee-a828-bd9879f158cb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:11.111966 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5fd1ff3f-f0d2-46ee-a828-bd9879f158cb tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1732 microversion: 2.1 time: 0.199904 Aug 04 18:01:11.112570 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3575/7118] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:10 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1732 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:01:12.133027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5af7ee31-a5ca-47ab-b6ee-a052dc5693b8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:12.133601 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5af7ee31-a5ca-47ab-b6ee-a052dc5693b8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:12.140736 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5af7ee31-a5ca-47ab-b6ee-a052dc5693b8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:12.141246 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5af7ee31-a5ca-47ab-b6ee-a052dc5693b8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:12.142294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5af7ee31-a5ca-47ab-b6ee-a052dc5693b8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:12.143039 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5af7ee31-a5ca-47ab-b6ee-a052dc5693b8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:12.143515 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5af7ee31-a5ca-47ab-b6ee-a052dc5693b8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:12.143962 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5af7ee31-a5ca-47ab-b6ee-a052dc5693b8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:12.279540 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5af7ee31-a5ca-47ab-b6ee-a052dc5693b8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:12.288001 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5af7ee31-a5ca-47ab-b6ee-a052dc5693b8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1732 microversion: 2.1 time: 0.158982 Aug 04 18:01:12.288607 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3544/7119] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:12 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:13.311149 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4866a3fe-7c9d-4c50-81e0-69ee3850c32a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:13.311960 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4866a3fe-7c9d-4c50-81e0-69ee3850c32a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:13.319836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4866a3fe-7c9d-4c50-81e0-69ee3850c32a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:13.320331 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4866a3fe-7c9d-4c50-81e0-69ee3850c32a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:13.320779 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4866a3fe-7c9d-4c50-81e0-69ee3850c32a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:13.321490 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4866a3fe-7c9d-4c50-81e0-69ee3850c32a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:13.321955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4866a3fe-7c9d-4c50-81e0-69ee3850c32a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:13.322411 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4866a3fe-7c9d-4c50-81e0-69ee3850c32a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:13.469259 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4866a3fe-7c9d-4c50-81e0-69ee3850c32a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:13.478160 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4866a3fe-7c9d-4c50-81e0-69ee3850c32a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1732 microversion: 2.1 time: 0.171155 Aug 04 18:01:13.478751 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3576/7120] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:13 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:14.499723 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-39d3af6b-d558-4b45-b312-3c76cbb3c178 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:14.500369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-39d3af6b-d558-4b45-b312-3c76cbb3c178 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:14.508666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39d3af6b-d558-4b45-b312-3c76cbb3c178 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:14.509215 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39d3af6b-d558-4b45-b312-3c76cbb3c178 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:14.509675 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39d3af6b-d558-4b45-b312-3c76cbb3c178 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:14.510443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39d3af6b-d558-4b45-b312-3c76cbb3c178 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:14.510953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39d3af6b-d558-4b45-b312-3c76cbb3c178 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:14.511403 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39d3af6b-d558-4b45-b312-3c76cbb3c178 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:14.664525 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-39d3af6b-d558-4b45-b312-3c76cbb3c178 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:14.681075 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-39d3af6b-d558-4b45-b312-3c76cbb3c178 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1732 microversion: 2.1 time: 0.184851 Aug 04 18:01:14.682701 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3545/7121] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:14 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1732 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:15.704341 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c888647c-918b-49a2-a73d-89cd597c0287 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:15.704968 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c888647c-918b-49a2-a73d-89cd597c0287 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:15.711827 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c888647c-918b-49a2-a73d-89cd597c0287 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:15.712330 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c888647c-918b-49a2-a73d-89cd597c0287 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:15.712778 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c888647c-918b-49a2-a73d-89cd597c0287 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:15.713485 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c888647c-918b-49a2-a73d-89cd597c0287 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:15.713954 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c888647c-918b-49a2-a73d-89cd597c0287 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:15.714414 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c888647c-918b-49a2-a73d-89cd597c0287 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:15.855548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c888647c-918b-49a2-a73d-89cd597c0287 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:15.864718 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c888647c-918b-49a2-a73d-89cd597c0287 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1732 microversion: 2.1 time: 0.164288 Aug 04 18:01:15.865314 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3577/7122] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:15 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:16.886306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-056ca533-d22e-48c8-974b-637179a154bc tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:16.886901 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-056ca533-d22e-48c8-974b-637179a154bc tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:16.893965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-056ca533-d22e-48c8-974b-637179a154bc tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:16.894465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-056ca533-d22e-48c8-974b-637179a154bc tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:16.894892 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-056ca533-d22e-48c8-974b-637179a154bc tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:16.895576 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-056ca533-d22e-48c8-974b-637179a154bc tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:16.896048 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-056ca533-d22e-48c8-974b-637179a154bc tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:16.896494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-056ca533-d22e-48c8-974b-637179a154bc tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:17.035336 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-056ca533-d22e-48c8-974b-637179a154bc tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:17.044307 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-056ca533-d22e-48c8-974b-637179a154bc tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1732 microversion: 2.1 time: 0.162135 Aug 04 18:01:17.044877 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3546/7123] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:16 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:18.067080 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-67df342d-f08b-451c-aacf-32c9771e46c3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:18.067706 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-67df342d-f08b-451c-aacf-32c9771e46c3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:18.074898 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-67df342d-f08b-451c-aacf-32c9771e46c3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:18.075402 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-67df342d-f08b-451c-aacf-32c9771e46c3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:18.075850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-67df342d-f08b-451c-aacf-32c9771e46c3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:18.077034 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-67df342d-f08b-451c-aacf-32c9771e46c3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:18.077034 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-67df342d-f08b-451c-aacf-32c9771e46c3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:18.077467 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-67df342d-f08b-451c-aacf-32c9771e46c3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:18.217342 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-67df342d-f08b-451c-aacf-32c9771e46c3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:18.226175 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-67df342d-f08b-451c-aacf-32c9771e46c3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1732 microversion: 2.1 time: 0.163356 Aug 04 18:01:18.226898 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3578/7124] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:18 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:19.248522 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e39d95c8-8a28-46e9-aab7-c8a6567454dd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:19.249169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e39d95c8-8a28-46e9-aab7-c8a6567454dd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:19.256589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e39d95c8-8a28-46e9-aab7-c8a6567454dd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:19.257097 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e39d95c8-8a28-46e9-aab7-c8a6567454dd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:19.257549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e39d95c8-8a28-46e9-aab7-c8a6567454dd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:19.258310 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e39d95c8-8a28-46e9-aab7-c8a6567454dd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:19.258776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e39d95c8-8a28-46e9-aab7-c8a6567454dd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:19.259213 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e39d95c8-8a28-46e9-aab7-c8a6567454dd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:19.402446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e39d95c8-8a28-46e9-aab7-c8a6567454dd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:19.411533 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e39d95c8-8a28-46e9-aab7-c8a6567454dd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1732 microversion: 2.1 time: 0.167165 Aug 04 18:01:19.412135 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3547/7125] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:19 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:20.433383 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9c8bdecf-34c6-401f-af20-2c9de9a88527 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:20.434037 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9c8bdecf-34c6-401f-af20-2c9de9a88527 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:20.441754 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9c8bdecf-34c6-401f-af20-2c9de9a88527 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:20.442291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9c8bdecf-34c6-401f-af20-2c9de9a88527 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:20.442745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9c8bdecf-34c6-401f-af20-2c9de9a88527 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:20.443463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9c8bdecf-34c6-401f-af20-2c9de9a88527 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:20.443930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9c8bdecf-34c6-401f-af20-2c9de9a88527 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:20.444380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9c8bdecf-34c6-401f-af20-2c9de9a88527 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:20.580798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9c8bdecf-34c6-401f-af20-2c9de9a88527 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:20.588950 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9c8bdecf-34c6-401f-af20-2c9de9a88527 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1732 microversion: 2.1 time: 0.159526 Aug 04 18:01:20.589532 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3579/7126] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:20 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:21.610996 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f93b3418-d85c-47af-9514-cd6025c7a5fc tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:21.611630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f93b3418-d85c-47af-9514-cd6025c7a5fc tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:21.618493 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f93b3418-d85c-47af-9514-cd6025c7a5fc tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:21.618996 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f93b3418-d85c-47af-9514-cd6025c7a5fc tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:21.619452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f93b3418-d85c-47af-9514-cd6025c7a5fc tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:21.620167 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f93b3418-d85c-47af-9514-cd6025c7a5fc tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:21.620642 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f93b3418-d85c-47af-9514-cd6025c7a5fc tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:21.621087 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f93b3418-d85c-47af-9514-cd6025c7a5fc tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:21.758661 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f93b3418-d85c-47af-9514-cd6025c7a5fc tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:21.767487 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f93b3418-d85c-47af-9514-cd6025c7a5fc tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1732 microversion: 2.1 time: 0.160390 Aug 04 18:01:21.768067 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3548/7127] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:21 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:22.789224 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d0c60979-eae6-4afb-b742-99a57b07adc7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:22.789847 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d0c60979-eae6-4afb-b742-99a57b07adc7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:22.796896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d0c60979-eae6-4afb-b742-99a57b07adc7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:22.797389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d0c60979-eae6-4afb-b742-99a57b07adc7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:22.797829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d0c60979-eae6-4afb-b742-99a57b07adc7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:22.798575 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d0c60979-eae6-4afb-b742-99a57b07adc7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:22.799038 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d0c60979-eae6-4afb-b742-99a57b07adc7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:22.799470 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d0c60979-eae6-4afb-b742-99a57b07adc7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:22.930807 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d0c60979-eae6-4afb-b742-99a57b07adc7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:22.939785 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d0c60979-eae6-4afb-b742-99a57b07adc7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1732 microversion: 2.1 time: 0.154507 Aug 04 18:01:22.940378 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3580/7128] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:22 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:23.962716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ca0ab36d-8363-406e-84c9-82c7704b3c67 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:23.963345 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ca0ab36d-8363-406e-84c9-82c7704b3c67 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:23.970731 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca0ab36d-8363-406e-84c9-82c7704b3c67 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:23.971480 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca0ab36d-8363-406e-84c9-82c7704b3c67 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:23.971927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca0ab36d-8363-406e-84c9-82c7704b3c67 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:23.972631 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca0ab36d-8363-406e-84c9-82c7704b3c67 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:23.973095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca0ab36d-8363-406e-84c9-82c7704b3c67 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:23.973532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca0ab36d-8363-406e-84c9-82c7704b3c67 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:24.106779 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ca0ab36d-8363-406e-84c9-82c7704b3c67 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:24.114711 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ca0ab36d-8363-406e-84c9-82c7704b3c67 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1732 microversion: 2.1 time: 0.155904 Aug 04 18:01:24.115308 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3549/7129] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:23 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:25.136157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c610aeab-ba62-468f-8cae-c51f26e5f6fe tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:25.136769 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c610aeab-ba62-468f-8cae-c51f26e5f6fe tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:25.140088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=31 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:01:25.145373 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c610aeab-ba62-468f-8cae-c51f26e5f6fe tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:25.145885 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c610aeab-ba62-468f-8cae-c51f26e5f6fe tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:25.146374 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c610aeab-ba62-468f-8cae-c51f26e5f6fe tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:25.147100 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c610aeab-ba62-468f-8cae-c51f26e5f6fe tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:25.147567 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c610aeab-ba62-468f-8cae-c51f26e5f6fe tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:25.148002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c610aeab-ba62-468f-8cae-c51f26e5f6fe tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:25.151120 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:01:25.289253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c610aeab-ba62-468f-8cae-c51f26e5f6fe tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:25.298387 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c610aeab-ba62-468f-8cae-c51f26e5f6fe tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1732 microversion: 2.1 time: 0.165792 Aug 04 18:01:25.299064 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3581/7130] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:25 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:26.319716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1b501bd2-e3ba-483c-9e7d-5e9bf8ead753 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:26.320370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1b501bd2-e3ba-483c-9e7d-5e9bf8ead753 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:26.323113 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=27 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:01:26.329344 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b501bd2-e3ba-483c-9e7d-5e9bf8ead753 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:26.329845 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b501bd2-e3ba-483c-9e7d-5e9bf8ead753 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:26.330320 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b501bd2-e3ba-483c-9e7d-5e9bf8ead753 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:26.331041 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b501bd2-e3ba-483c-9e7d-5e9bf8ead753 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:26.331498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b501bd2-e3ba-483c-9e7d-5e9bf8ead753 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:26.331933 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b501bd2-e3ba-483c-9e7d-5e9bf8ead753 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:26.334685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=79 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:01:26.466765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1b501bd2-e3ba-483c-9e7d-5e9bf8ead753 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:26.475853 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1b501bd2-e3ba-483c-9e7d-5e9bf8ead753 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1732 microversion: 2.1 time: 0.160143 Aug 04 18:01:26.476430 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3550/7131] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:26 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:27.496880 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e8aadedd-59ff-43e1-878e-f0fffbe7eb23 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:27.497534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e8aadedd-59ff-43e1-878e-f0fffbe7eb23 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:27.505209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8aadedd-59ff-43e1-878e-f0fffbe7eb23 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:27.505717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8aadedd-59ff-43e1-878e-f0fffbe7eb23 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:27.506214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8aadedd-59ff-43e1-878e-f0fffbe7eb23 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:27.506941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8aadedd-59ff-43e1-878e-f0fffbe7eb23 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:27.507417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8aadedd-59ff-43e1-878e-f0fffbe7eb23 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:27.507858 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8aadedd-59ff-43e1-878e-f0fffbe7eb23 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:27.643655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e8aadedd-59ff-43e1-878e-f0fffbe7eb23 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:27.651818 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e8aadedd-59ff-43e1-878e-f0fffbe7eb23 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1732 microversion: 2.1 time: 0.158927 Aug 04 18:01:27.652396 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3582/7132] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:27 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:28.673061 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7de60744-c826-46b4-bc91-4cd8b392d3ba tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:28.673687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7de60744-c826-46b4-bc91-4cd8b392d3ba tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:28.680764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7de60744-c826-46b4-bc91-4cd8b392d3ba tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:28.681265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7de60744-c826-46b4-bc91-4cd8b392d3ba tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:28.681716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7de60744-c826-46b4-bc91-4cd8b392d3ba tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:28.682453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7de60744-c826-46b4-bc91-4cd8b392d3ba tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:28.682928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7de60744-c826-46b4-bc91-4cd8b392d3ba tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:28.683366 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7de60744-c826-46b4-bc91-4cd8b392d3ba tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:28.847644 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7de60744-c826-46b4-bc91-4cd8b392d3ba tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:28.856405 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7de60744-c826-46b4-bc91-4cd8b392d3ba tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1732 microversion: 2.1 time: 0.187192 Aug 04 18:01:28.857001 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3551/7133] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:28 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1732 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:29.877835 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ee03f31e-dcc5-4944-9240-87c7fee1adc5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:29.878276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ee03f31e-dcc5-4944-9240-87c7fee1adc5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:29.885427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee03f31e-dcc5-4944-9240-87c7fee1adc5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:29.885937 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee03f31e-dcc5-4944-9240-87c7fee1adc5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:29.886424 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee03f31e-dcc5-4944-9240-87c7fee1adc5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:29.887153 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee03f31e-dcc5-4944-9240-87c7fee1adc5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:29.887629 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee03f31e-dcc5-4944-9240-87c7fee1adc5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:29.888070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee03f31e-dcc5-4944-9240-87c7fee1adc5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:30.033467 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ee03f31e-dcc5-4944-9240-87c7fee1adc5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:30.042027 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ee03f31e-dcc5-4944-9240-87c7fee1adc5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1732 microversion: 2.1 time: 0.169037 Aug 04 18:01:30.042813 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3583/7134] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:29 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:31.065371 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fed9c4f8-5323-46b2-b1d8-48c136f1c62c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:31.066152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fed9c4f8-5323-46b2-b1d8-48c136f1c62c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:31.073453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fed9c4f8-5323-46b2-b1d8-48c136f1c62c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:31.074001 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fed9c4f8-5323-46b2-b1d8-48c136f1c62c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:31.074467 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fed9c4f8-5323-46b2-b1d8-48c136f1c62c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:31.075203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fed9c4f8-5323-46b2-b1d8-48c136f1c62c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:31.075682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fed9c4f8-5323-46b2-b1d8-48c136f1c62c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:31.076134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fed9c4f8-5323-46b2-b1d8-48c136f1c62c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:31.222913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fed9c4f8-5323-46b2-b1d8-48c136f1c62c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:31.232572 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fed9c4f8-5323-46b2-b1d8-48c136f1c62c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1732 microversion: 2.1 time: 0.172054 Aug 04 18:01:31.233171 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3552/7135] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:31 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:32.254970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cac99fd3-c093-4d58-b1e8-4171d995f1a5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:32.255604 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cac99fd3-c093-4d58-b1e8-4171d995f1a5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:32.262636 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cac99fd3-c093-4d58-b1e8-4171d995f1a5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:32.263143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cac99fd3-c093-4d58-b1e8-4171d995f1a5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:32.263596 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cac99fd3-c093-4d58-b1e8-4171d995f1a5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:32.264311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cac99fd3-c093-4d58-b1e8-4171d995f1a5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:32.264783 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cac99fd3-c093-4d58-b1e8-4171d995f1a5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:32.265221 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cac99fd3-c093-4d58-b1e8-4171d995f1a5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:32.513072 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cac99fd3-c093-4d58-b1e8-4171d995f1a5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:32.522074 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cac99fd3-c093-4d58-b1e8-4171d995f1a5 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1731 microversion: 2.1 time: 0.270920 Aug 04 18:01:32.522663 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3584/7136] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:32 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1731 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:32.610624 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-01f8b9a9-f76b-4fb4-b2b2-91a77f254ad5 req-0e178e29-535f-4c16-858b-ee8d7618097c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38021a56-404e-46b9-b0fc-b1b4c29c1406", "name": "network-vif-unplugged", "status": "completed", "tag": "bfb7c1b4-b403-4744-82d7-f7c3fbe8e5d0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:01:32.621306 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-01f8b9a9-f76b-4fb4-b2b2-91a77f254ad5 req-0e178e29-535f-4c16-858b-ee8d7618097c service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:32.621924 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-01f8b9a9-f76b-4fb4-b2b2-91a77f254ad5 req-0e178e29-535f-4c16-858b-ee8d7618097c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:32.622500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-01f8b9a9-f76b-4fb4-b2b2-91a77f254ad5 req-0e178e29-535f-4c16-858b-ee8d7618097c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:32.635635 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-01f8b9a9-f76b-4fb4-b2b2-91a77f254ad5 req-0e178e29-535f-4c16-858b-ee8d7618097c service nova] Creating event network-vif-unplugged:bfb7c1b4-b403-4744-82d7-f7c3fbe8e5d0 for instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 on n-h2-851359-3 Aug 04 18:01:32.641939 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-01f8b9a9-f76b-4fb4-b2b2-91a77f254ad5 req-0e178e29-535f-4c16-858b-ee8d7618097c service nova] Instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 18:01:32.653429 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-01f8b9a9-f76b-4fb4-b2b2-91a77f254ad5 req-0e178e29-535f-4c16-858b-ee8d7618097c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046638 Aug 04 18:01:32.654390 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3553/7137] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:01:33.543805 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-42599eda-6ec8-413b-88bb-b8a1326db656 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:33.544438 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-42599eda-6ec8-413b-88bb-b8a1326db656 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:33.553201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42599eda-6ec8-413b-88bb-b8a1326db656 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:33.553701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42599eda-6ec8-413b-88bb-b8a1326db656 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:33.554170 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42599eda-6ec8-413b-88bb-b8a1326db656 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:33.554890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42599eda-6ec8-413b-88bb-b8a1326db656 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:33.555355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42599eda-6ec8-413b-88bb-b8a1326db656 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:33.555785 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42599eda-6ec8-413b-88bb-b8a1326db656 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:33.708898 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-42599eda-6ec8-413b-88bb-b8a1326db656 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:33.717421 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-42599eda-6ec8-413b-88bb-b8a1326db656 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1731 microversion: 2.1 time: 0.177800 Aug 04 18:01:33.718277 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3585/7138] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:33 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:34.703870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-18d5e610-2a3a-4341-ae64-14a646b593a5 req-adc106ba-35fa-4a16-b566-7159035c98e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38021a56-404e-46b9-b0fc-b1b4c29c1406", "tag": "bfb7c1b4-b403-4744-82d7-f7c3fbe8e5d0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:01:34.714842 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-18d5e610-2a3a-4341-ae64-14a646b593a5 req-adc106ba-35fa-4a16-b566-7159035c98e2 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:34.715426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-18d5e610-2a3a-4341-ae64-14a646b593a5 req-adc106ba-35fa-4a16-b566-7159035c98e2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:34.715887 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-18d5e610-2a3a-4341-ae64-14a646b593a5 req-adc106ba-35fa-4a16-b566-7159035c98e2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:34.728578 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-18d5e610-2a3a-4341-ae64-14a646b593a5 req-adc106ba-35fa-4a16-b566-7159035c98e2 service nova] Creating event network-changed:bfb7c1b4-b403-4744-82d7-f7c3fbe8e5d0 for instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 on n-h2-851359-3 Aug 04 18:01:34.734366 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-18d5e610-2a3a-4341-ae64-14a646b593a5 req-adc106ba-35fa-4a16-b566-7159035c98e2 service nova] Instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 18:01:34.740333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-60d8a9e1-a4a3-4386-a7d5-9bcd7674f631 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:34.741104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-60d8a9e1-a4a3-4386-a7d5-9bcd7674f631 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:34.746622 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-18d5e610-2a3a-4341-ae64-14a646b593a5 req-adc106ba-35fa-4a16-b566-7159035c98e2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047638 Aug 04 18:01:34.747240 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3554/7139] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:01:34.748855 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60d8a9e1-a4a3-4386-a7d5-9bcd7674f631 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:34.749641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60d8a9e1-a4a3-4386-a7d5-9bcd7674f631 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:34.750582 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60d8a9e1-a4a3-4386-a7d5-9bcd7674f631 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:34.751472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60d8a9e1-a4a3-4386-a7d5-9bcd7674f631 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:34.752015 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60d8a9e1-a4a3-4386-a7d5-9bcd7674f631 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:34.752524 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-60d8a9e1-a4a3-4386-a7d5-9bcd7674f631 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:34.995965 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-60d8a9e1-a4a3-4386-a7d5-9bcd7674f631 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:35.007538 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-60d8a9e1-a4a3-4386-a7d5-9bcd7674f631 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1729 microversion: 2.1 time: 0.271412 Aug 04 18:01:35.008499 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3586/7140] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:34 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1729 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:36.032547 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-980f3632-1d13-4806-8b8c-c2a0c6a0df82 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:36.033265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-980f3632-1d13-4806-8b8c-c2a0c6a0df82 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:36.040455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-980f3632-1d13-4806-8b8c-c2a0c6a0df82 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:36.040962 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-980f3632-1d13-4806-8b8c-c2a0c6a0df82 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:36.041412 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-980f3632-1d13-4806-8b8c-c2a0c6a0df82 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:36.042338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-980f3632-1d13-4806-8b8c-c2a0c6a0df82 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:36.042812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-980f3632-1d13-4806-8b8c-c2a0c6a0df82 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:36.043252 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-980f3632-1d13-4806-8b8c-c2a0c6a0df82 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:36.192602 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-980f3632-1d13-4806-8b8c-c2a0c6a0df82 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:36.201486 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-980f3632-1d13-4806-8b8c-c2a0c6a0df82 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1729 microversion: 2.1 time: 0.173258 Aug 04 18:01:36.202115 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3555/7141] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:36 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:37.223803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ad0d0f1b-a908-4c1a-8bb1-f148a6c7b407 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:37.224472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ad0d0f1b-a908-4c1a-8bb1-f148a6c7b407 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:37.232594 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad0d0f1b-a908-4c1a-8bb1-f148a6c7b407 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:37.233240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad0d0f1b-a908-4c1a-8bb1-f148a6c7b407 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:37.233959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad0d0f1b-a908-4c1a-8bb1-f148a6c7b407 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:37.235155 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad0d0f1b-a908-4c1a-8bb1-f148a6c7b407 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:37.235762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad0d0f1b-a908-4c1a-8bb1-f148a6c7b407 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:37.236504 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad0d0f1b-a908-4c1a-8bb1-f148a6c7b407 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:37.383545 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ad0d0f1b-a908-4c1a-8bb1-f148a6c7b407 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:37.392997 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ad0d0f1b-a908-4c1a-8bb1-f148a6c7b407 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1729 microversion: 2.1 time: 0.173985 Aug 04 18:01:37.393605 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3587/7142] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:37 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:38.415013 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-970eba44-b242-4c93-bfd9-578067b073de tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:38.415794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-970eba44-b242-4c93-bfd9-578067b073de tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:38.423849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-970eba44-b242-4c93-bfd9-578067b073de tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:38.424360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-970eba44-b242-4c93-bfd9-578067b073de tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:38.424806 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-970eba44-b242-4c93-bfd9-578067b073de tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:38.425719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-970eba44-b242-4c93-bfd9-578067b073de tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:38.426213 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-970eba44-b242-4c93-bfd9-578067b073de tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:38.426829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-970eba44-b242-4c93-bfd9-578067b073de tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:38.595533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-970eba44-b242-4c93-bfd9-578067b073de tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:38.605180 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-970eba44-b242-4c93-bfd9-578067b073de tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1729 microversion: 2.1 time: 0.194230 Aug 04 18:01:38.606028 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3556/7143] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:38 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:01:39.628454 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a6a09940-d4df-43a8-9fd7-ca8766184206 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:39.629078 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a6a09940-d4df-43a8-9fd7-ca8766184206 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:39.636108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6a09940-d4df-43a8-9fd7-ca8766184206 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:39.636606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6a09940-d4df-43a8-9fd7-ca8766184206 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:39.637054 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6a09940-d4df-43a8-9fd7-ca8766184206 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:39.637766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6a09940-d4df-43a8-9fd7-ca8766184206 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:39.638257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6a09940-d4df-43a8-9fd7-ca8766184206 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:39.638699 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6a09940-d4df-43a8-9fd7-ca8766184206 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:39.772371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a6a09940-d4df-43a8-9fd7-ca8766184206 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:39.780571 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a6a09940-d4df-43a8-9fd7-ca8766184206 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1729 microversion: 2.1 time: 0.156710 Aug 04 18:01:39.781145 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3588/7144] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:39 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:40.802788 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c2a18f05-1309-4d56-ac93-8b25c341c574 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:40.803439 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c2a18f05-1309-4d56-ac93-8b25c341c574 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:40.810834 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2a18f05-1309-4d56-ac93-8b25c341c574 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:40.811345 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2a18f05-1309-4d56-ac93-8b25c341c574 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:40.811801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2a18f05-1309-4d56-ac93-8b25c341c574 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:40.812556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2a18f05-1309-4d56-ac93-8b25c341c574 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:40.812997 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2a18f05-1309-4d56-ac93-8b25c341c574 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:40.813450 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2a18f05-1309-4d56-ac93-8b25c341c574 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:40.955426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c2a18f05-1309-4d56-ac93-8b25c341c574 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:40.963788 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c2a18f05-1309-4d56-ac93-8b25c341c574 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1729 microversion: 2.1 time: 0.165052 Aug 04 18:01:40.964760 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3557/7145] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:40 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:41.986328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a23c7589-5a83-4a16-bf6b-0666cd608a5a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:41.986995 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a23c7589-5a83-4a16-bf6b-0666cd608a5a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:41.993837 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a23c7589-5a83-4a16-bf6b-0666cd608a5a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:41.994363 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a23c7589-5a83-4a16-bf6b-0666cd608a5a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:41.994806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a23c7589-5a83-4a16-bf6b-0666cd608a5a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:41.995507 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a23c7589-5a83-4a16-bf6b-0666cd608a5a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:41.995970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a23c7589-5a83-4a16-bf6b-0666cd608a5a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:41.996399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a23c7589-5a83-4a16-bf6b-0666cd608a5a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:42.132308 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a23c7589-5a83-4a16-bf6b-0666cd608a5a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:42.140664 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a23c7589-5a83-4a16-bf6b-0666cd608a5a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1729 microversion: 2.1 time: 0.158719 Aug 04 18:01:42.141257 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3589/7146] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:41 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:43.161867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5c8f5452-7409-46ca-b16b-fa46be8ce2bc tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:43.162568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5c8f5452-7409-46ca-b16b-fa46be8ce2bc tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:43.169922 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c8f5452-7409-46ca-b16b-fa46be8ce2bc tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:43.170468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c8f5452-7409-46ca-b16b-fa46be8ce2bc tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:43.170928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c8f5452-7409-46ca-b16b-fa46be8ce2bc tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:43.171659 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c8f5452-7409-46ca-b16b-fa46be8ce2bc tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:43.172172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c8f5452-7409-46ca-b16b-fa46be8ce2bc tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:43.172620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c8f5452-7409-46ca-b16b-fa46be8ce2bc tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:43.309461 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5c8f5452-7409-46ca-b16b-fa46be8ce2bc tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:43.318596 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5c8f5452-7409-46ca-b16b-fa46be8ce2bc tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1729 microversion: 2.1 time: 0.160656 Aug 04 18:01:43.319188 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3558/7147] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:43 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:44.339834 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-221236ae-48ae-467c-a22e-1a529720006d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:44.340542 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-221236ae-48ae-467c-a22e-1a529720006d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:44.348319 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-221236ae-48ae-467c-a22e-1a529720006d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:44.348812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-221236ae-48ae-467c-a22e-1a529720006d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:44.349250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-221236ae-48ae-467c-a22e-1a529720006d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:44.349961 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-221236ae-48ae-467c-a22e-1a529720006d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:44.350446 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-221236ae-48ae-467c-a22e-1a529720006d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:44.350877 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-221236ae-48ae-467c-a22e-1a529720006d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:44.499180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-221236ae-48ae-467c-a22e-1a529720006d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:44.507268 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-221236ae-48ae-467c-a22e-1a529720006d tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1729 microversion: 2.1 time: 0.171354 Aug 04 18:01:44.507845 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3590/7148] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:44 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:45.529350 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5de14a70-2283-4cd9-9dce-c0be691098c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:45.529997 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5de14a70-2283-4cd9-9dce-c0be691098c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:45.538248 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5de14a70-2283-4cd9-9dce-c0be691098c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:45.538682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5de14a70-2283-4cd9-9dce-c0be691098c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:45.539130 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5de14a70-2283-4cd9-9dce-c0be691098c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:45.539855 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5de14a70-2283-4cd9-9dce-c0be691098c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:45.540326 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5de14a70-2283-4cd9-9dce-c0be691098c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:45.540758 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5de14a70-2283-4cd9-9dce-c0be691098c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:45.679517 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5de14a70-2283-4cd9-9dce-c0be691098c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:45.687587 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5de14a70-2283-4cd9-9dce-c0be691098c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1729 microversion: 2.1 time: 0.163163 Aug 04 18:01:45.688160 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3559/7149] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:45 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:46.708801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0fa3f24d-c2e0-48c0-afb8-33d8d8b92d94 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:46.709420 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0fa3f24d-c2e0-48c0-afb8-33d8d8b92d94 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:46.716303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0fa3f24d-c2e0-48c0-afb8-33d8d8b92d94 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:46.716790 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0fa3f24d-c2e0-48c0-afb8-33d8d8b92d94 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:46.717232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0fa3f24d-c2e0-48c0-afb8-33d8d8b92d94 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:46.717929 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0fa3f24d-c2e0-48c0-afb8-33d8d8b92d94 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:46.718961 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0fa3f24d-c2e0-48c0-afb8-33d8d8b92d94 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:46.719340 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0fa3f24d-c2e0-48c0-afb8-33d8d8b92d94 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:46.857387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0fa3f24d-c2e0-48c0-afb8-33d8d8b92d94 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:46.866006 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0fa3f24d-c2e0-48c0-afb8-33d8d8b92d94 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1729 microversion: 2.1 time: 0.161090 Aug 04 18:01:46.866598 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3591/7150] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:46 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:47.886290 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1feda599-d14a-4bcf-bedb-fe09d39eea1b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:47.886928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1feda599-d14a-4bcf-bedb-fe09d39eea1b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:47.894375 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1feda599-d14a-4bcf-bedb-fe09d39eea1b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:47.894877 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1feda599-d14a-4bcf-bedb-fe09d39eea1b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:47.895327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1feda599-d14a-4bcf-bedb-fe09d39eea1b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:47.896044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1feda599-d14a-4bcf-bedb-fe09d39eea1b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:47.896513 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1feda599-d14a-4bcf-bedb-fe09d39eea1b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:47.896959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1feda599-d14a-4bcf-bedb-fe09d39eea1b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:48.029954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1feda599-d14a-4bcf-bedb-fe09d39eea1b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:48.038619 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1feda599-d14a-4bcf-bedb-fe09d39eea1b tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1726 microversion: 2.1 time: 0.156247 Aug 04 18:01:48.039186 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3560/7151] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:47 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:48.058941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3f8b5d51-bbf5-40b2-82bc-92ffd64c5dd8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:01:48.059571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3f8b5d51-bbf5-40b2-82bc-92ffd64c5dd8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:48.066337 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f8b5d51-bbf5-40b2-82bc-92ffd64c5dd8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:48.066836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f8b5d51-bbf5-40b2-82bc-92ffd64c5dd8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:48.067284 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f8b5d51-bbf5-40b2-82bc-92ffd64c5dd8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:48.067989 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f8b5d51-bbf5-40b2-82bc-92ffd64c5dd8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:48.068453 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f8b5d51-bbf5-40b2-82bc-92ffd64c5dd8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:48.068886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f8b5d51-bbf5-40b2-82bc-92ffd64c5dd8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:48.106800 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f8b5d51-bbf5-40b2-82bc-92ffd64c5dd8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:48.107214 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f8b5d51-bbf5-40b2-82bc-92ffd64c5dd8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:48.107663 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f8b5d51-bbf5-40b2-82bc-92ffd64c5dd8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:48.108399 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f8b5d51-bbf5-40b2-82bc-92ffd64c5dd8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:48.108870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f8b5d51-bbf5-40b2-82bc-92ffd64c5dd8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:48.109330 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f8b5d51-bbf5-40b2-82bc-92ffd64c5dd8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:48.130185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-3f8b5d51-bbf5-40b2-82bc-92ffd64c5dd8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Getting quotas for project c527dc233da14fc5ab203d0489a8653f. Resources: {'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 18:01:48.135404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-3f8b5d51-bbf5-40b2-82bc-92ffd64c5dd8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Getting quotas for user 5123a91a38cf4524a1d9ae3a0ab45ee2 and project c527dc233da14fc5ab203d0489a8653f. Resources: {'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 18:01:48.237039 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3f8b5d51-bbf5-40b2-82bc-92ffd64c5dd8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "POST /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406/action" status: 202 len: 0 microversion: 2.1 time: 0.181816 Aug 04 18:01:48.237662 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3592/7152] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:01:48 2022] POST /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 18:01:48.245905 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eaf3017f-1171-4166-bfd5-c38c7bff8a43 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:48.246809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eaf3017f-1171-4166-bfd5-c38c7bff8a43 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:48.253472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eaf3017f-1171-4166-bfd5-c38c7bff8a43 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:48.254011 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eaf3017f-1171-4166-bfd5-c38c7bff8a43 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:48.254471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eaf3017f-1171-4166-bfd5-c38c7bff8a43 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:48.255183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eaf3017f-1171-4166-bfd5-c38c7bff8a43 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:48.255653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eaf3017f-1171-4166-bfd5-c38c7bff8a43 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:48.256092 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eaf3017f-1171-4166-bfd5-c38c7bff8a43 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:48.459642 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eaf3017f-1171-4166-bfd5-c38c7bff8a43 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:48.468880 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eaf3017f-1171-4166-bfd5-c38c7bff8a43 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1725 microversion: 2.1 time: 0.226723 Aug 04 18:01:48.469705 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3561/7153] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:48 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1725 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:49.492245 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-59a927fb-8ae0-46cc-ad9a-7d4189b817ff tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:49.492992 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-59a927fb-8ae0-46cc-ad9a-7d4189b817ff tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:49.500183 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59a927fb-8ae0-46cc-ad9a-7d4189b817ff tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:49.500691 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59a927fb-8ae0-46cc-ad9a-7d4189b817ff tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:49.501136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59a927fb-8ae0-46cc-ad9a-7d4189b817ff tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:49.502086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59a927fb-8ae0-46cc-ad9a-7d4189b817ff tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:49.502561 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59a927fb-8ae0-46cc-ad9a-7d4189b817ff tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:49.503001 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-59a927fb-8ae0-46cc-ad9a-7d4189b817ff tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:49.637766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-59a927fb-8ae0-46cc-ad9a-7d4189b817ff tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:49.646556 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-59a927fb-8ae0-46cc-ad9a-7d4189b817ff tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1725 microversion: 2.1 time: 0.159500 Aug 04 18:01:49.647142 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3593/7154] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:49 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:01:50.669164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6085c494-3766-4906-af58-a56aeeba1048 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:50.669839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6085c494-3766-4906-af58-a56aeeba1048 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:50.678007 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6085c494-3766-4906-af58-a56aeeba1048 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:50.678541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6085c494-3766-4906-af58-a56aeeba1048 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:50.678993 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6085c494-3766-4906-af58-a56aeeba1048 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:50.679725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6085c494-3766-4906-af58-a56aeeba1048 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:50.680189 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6085c494-3766-4906-af58-a56aeeba1048 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:50.680608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6085c494-3766-4906-af58-a56aeeba1048 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:50.771169 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-bd479e35-5eb0-4490-a37b-0486fea1b014 req-7c2b2b17-cb31-4171-ab1a-ffeba4a45415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38021a56-404e-46b9-b0fc-b1b4c29c1406", "name": "network-vif-plugged", "status": "completed", "tag": "bfb7c1b4-b403-4744-82d7-f7c3fbe8e5d0"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:01:50.782024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-bd479e35-5eb0-4490-a37b-0486fea1b014 req-7c2b2b17-cb31-4171-ab1a-ffeba4a45415 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:50.782606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-bd479e35-5eb0-4490-a37b-0486fea1b014 req-7c2b2b17-cb31-4171-ab1a-ffeba4a45415 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:50.783032 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-bd479e35-5eb0-4490-a37b-0486fea1b014 req-7c2b2b17-cb31-4171-ab1a-ffeba4a45415 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:50.798365 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-bd479e35-5eb0-4490-a37b-0486fea1b014 req-7c2b2b17-cb31-4171-ab1a-ffeba4a45415 service nova] Creating event network-vif-plugged:bfb7c1b4-b403-4744-82d7-f7c3fbe8e5d0 for instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 on n-h2-851359-3 Aug 04 18:01:50.805308 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [req-bd479e35-5eb0-4490-a37b-0486fea1b014 req-7c2b2b17-cb31-4171-ab1a-ffeba4a45415 service nova] Instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 18:01:50.820529 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-bd479e35-5eb0-4490-a37b-0486fea1b014 req-7c2b2b17-cb31-4171-ab1a-ffeba4a45415 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055190 Aug 04 18:01:50.821374 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3594/7155] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:01:50.846844 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6085c494-3766-4906-af58-a56aeeba1048 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:50.855688 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6085c494-3766-4906-af58-a56aeeba1048 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1725 microversion: 2.1 time: 0.190914 Aug 04 18:01:50.856275 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3562/7156] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:50 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:51.878603 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f7bc9e04-7ce5-4f68-9f7c-13ca1acc485e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:51.879341 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f7bc9e04-7ce5-4f68-9f7c-13ca1acc485e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:51.886114 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7bc9e04-7ce5-4f68-9f7c-13ca1acc485e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:51.886639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7bc9e04-7ce5-4f68-9f7c-13ca1acc485e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:51.887349 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7bc9e04-7ce5-4f68-9f7c-13ca1acc485e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:51.887867 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7bc9e04-7ce5-4f68-9f7c-13ca1acc485e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:51.888337 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7bc9e04-7ce5-4f68-9f7c-13ca1acc485e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:51.888774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7bc9e04-7ce5-4f68-9f7c-13ca1acc485e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:51.892522 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:01:52.029579 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f7bc9e04-7ce5-4f68-9f7c-13ca1acc485e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:52.037910 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f7bc9e04-7ce5-4f68-9f7c-13ca1acc485e tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1725 microversion: 2.1 time: 0.164971 Aug 04 18:01:52.038514 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3595/7157] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:51 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:53.058622 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-310b5cd3-75f8-4d61-8a61-9e186c890028 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:53.059158 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-310b5cd3-75f8-4d61-8a61-9e186c890028 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:53.066114 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-310b5cd3-75f8-4d61-8a61-9e186c890028 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:53.066621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-310b5cd3-75f8-4d61-8a61-9e186c890028 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:53.067080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-310b5cd3-75f8-4d61-8a61-9e186c890028 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:53.067829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-310b5cd3-75f8-4d61-8a61-9e186c890028 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:53.068324 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-310b5cd3-75f8-4d61-8a61-9e186c890028 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:53.068770 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-310b5cd3-75f8-4d61-8a61-9e186c890028 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:53.212245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-310b5cd3-75f8-4d61-8a61-9e186c890028 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:53.221333 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-310b5cd3-75f8-4d61-8a61-9e186c890028 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1725 microversion: 2.1 time: 0.166418 Aug 04 18:01:53.221914 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3563/7158] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:53 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:54.244809 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-66c5a9aa-9292-49ec-a610-b77f636cca58 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:54.245516 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-66c5a9aa-9292-49ec-a610-b77f636cca58 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:54.253997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66c5a9aa-9292-49ec-a610-b77f636cca58 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:54.254527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66c5a9aa-9292-49ec-a610-b77f636cca58 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:54.254970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66c5a9aa-9292-49ec-a610-b77f636cca58 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:54.255697 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66c5a9aa-9292-49ec-a610-b77f636cca58 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:54.256143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66c5a9aa-9292-49ec-a610-b77f636cca58 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:54.256571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-66c5a9aa-9292-49ec-a610-b77f636cca58 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:54.308246 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-a36a4a71-5dc8-432f-b016-fd5c355ecbe8 req-6cca35ef-7bdb-40bf-ba76-f91e88605325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38021a56-404e-46b9-b0fc-b1b4c29c1406", "name": "network-vif-unplugged", "status": "completed", "tag": "bfb7c1b4-b403-4744-82d7-f7c3fbe8e5d0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:01:54.318988 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a36a4a71-5dc8-432f-b016-fd5c355ecbe8 req-6cca35ef-7bdb-40bf-ba76-f91e88605325 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:54.319671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a36a4a71-5dc8-432f-b016-fd5c355ecbe8 req-6cca35ef-7bdb-40bf-ba76-f91e88605325 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:54.320184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a36a4a71-5dc8-432f-b016-fd5c355ecbe8 req-6cca35ef-7bdb-40bf-ba76-f91e88605325 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:54.333730 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-a36a4a71-5dc8-432f-b016-fd5c355ecbe8 req-6cca35ef-7bdb-40bf-ba76-f91e88605325 service nova] Creating event network-vif-unplugged:bfb7c1b4-b403-4744-82d7-f7c3fbe8e5d0 for instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 on n-h1-851359-3 Aug 04 18:01:54.340023 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-a36a4a71-5dc8-432f-b016-fd5c355ecbe8 req-6cca35ef-7bdb-40bf-ba76-f91e88605325 service nova] Instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 18:01:54.352618 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-a36a4a71-5dc8-432f-b016-fd5c355ecbe8 req-6cca35ef-7bdb-40bf-ba76-f91e88605325 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106891 Aug 04 18:01:54.353621 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3564/7159] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:01:54.407416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-66c5a9aa-9292-49ec-a610-b77f636cca58 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:54.415514 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-66c5a9aa-9292-49ec-a610-b77f636cca58 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1725 microversion: 2.1 time: 0.176373 Aug 04 18:01:54.416115 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3596/7160] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:54 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:55.437552 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a46c1a49-5fe8-40c8-bc47-d65726ad25b1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:55.438310 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a46c1a49-5fe8-40c8-bc47-d65726ad25b1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:55.446428 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a46c1a49-5fe8-40c8-bc47-d65726ad25b1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:55.446937 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a46c1a49-5fe8-40c8-bc47-d65726ad25b1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:55.447385 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a46c1a49-5fe8-40c8-bc47-d65726ad25b1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:55.448145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a46c1a49-5fe8-40c8-bc47-d65726ad25b1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:55.448619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a46c1a49-5fe8-40c8-bc47-d65726ad25b1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:55.449235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a46c1a49-5fe8-40c8-bc47-d65726ad25b1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:55.588718 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a46c1a49-5fe8-40c8-bc47-d65726ad25b1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:55.598578 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a46c1a49-5fe8-40c8-bc47-d65726ad25b1 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1725 microversion: 2.1 time: 0.165205 Aug 04 18:01:55.599383 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3565/7161] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:55 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:56.376906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-c2388a49-d31d-4005-9418-e8a8e0890b97 req-ae64a9b3-ebe7-4c65-b5d9-4cac2047b793 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38021a56-404e-46b9-b0fc-b1b4c29c1406", "tag": "bfb7c1b4-b403-4744-82d7-f7c3fbe8e5d0"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:01:56.382962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:01:56.390868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c2388a49-d31d-4005-9418-e8a8e0890b97 req-ae64a9b3-ebe7-4c65-b5d9-4cac2047b793 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:56.390868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c2388a49-d31d-4005-9418-e8a8e0890b97 req-ae64a9b3-ebe7-4c65-b5d9-4cac2047b793 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:56.391297 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c2388a49-d31d-4005-9418-e8a8e0890b97 req-ae64a9b3-ebe7-4c65-b5d9-4cac2047b793 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:56.404526 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-c2388a49-d31d-4005-9418-e8a8e0890b97 req-ae64a9b3-ebe7-4c65-b5d9-4cac2047b793 service nova] Creating event network-changed:bfb7c1b4-b403-4744-82d7-f7c3fbe8e5d0 for instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 on n-h1-851359-3 Aug 04 18:01:56.411035 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [req-c2388a49-d31d-4005-9418-e8a8e0890b97 req-ae64a9b3-ebe7-4c65-b5d9-4cac2047b793 service nova] Instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 18:01:56.422779 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-c2388a49-d31d-4005-9418-e8a8e0890b97 req-ae64a9b3-ebe7-4c65-b5d9-4cac2047b793 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049591 Aug 04 18:01:56.423404 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3597/7162] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:01:56.621610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-31c77487-cbf2-4126-b8e3-47c2bdbe7ed7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:56.622432 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-31c77487-cbf2-4126-b8e3-47c2bdbe7ed7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:56.625620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=32 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:01:56.631718 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31c77487-cbf2-4126-b8e3-47c2bdbe7ed7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:56.632208 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31c77487-cbf2-4126-b8e3-47c2bdbe7ed7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:56.632691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31c77487-cbf2-4126-b8e3-47c2bdbe7ed7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:56.633613 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31c77487-cbf2-4126-b8e3-47c2bdbe7ed7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:56.634464 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31c77487-cbf2-4126-b8e3-47c2bdbe7ed7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:56.635122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31c77487-cbf2-4126-b8e3-47c2bdbe7ed7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:56.639229 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=90 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:01:56.879461 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-31c77487-cbf2-4126-b8e3-47c2bdbe7ed7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:56.889533 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-31c77487-cbf2-4126-b8e3-47c2bdbe7ed7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1725 microversion: 2.1 time: 0.271800 Aug 04 18:01:56.891366 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3566/7163] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:56 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1725 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:57.913046 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-edb75801-4611-4293-8d5d-0ecf0b96f488 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:57.914185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-edb75801-4611-4293-8d5d-0ecf0b96f488 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:57.920801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-edb75801-4611-4293-8d5d-0ecf0b96f488 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:57.922007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-edb75801-4611-4293-8d5d-0ecf0b96f488 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:57.922543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-edb75801-4611-4293-8d5d-0ecf0b96f488 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:57.923332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-edb75801-4611-4293-8d5d-0ecf0b96f488 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:57.923932 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-edb75801-4611-4293-8d5d-0ecf0b96f488 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:57.924437 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-edb75801-4611-4293-8d5d-0ecf0b96f488 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:58.062676 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-edb75801-4611-4293-8d5d-0ecf0b96f488 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:58.071036 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-edb75801-4611-4293-8d5d-0ecf0b96f488 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1725 microversion: 2.1 time: 0.163177 Aug 04 18:01:58.071644 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3598/7164] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:57 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:01:59.092802 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e7c29991-7454-4b8c-855d-bf73174b0310 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:01:59.093492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e7c29991-7454-4b8c-855d-bf73174b0310 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:01:59.101173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7c29991-7454-4b8c-855d-bf73174b0310 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:59.101674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7c29991-7454-4b8c-855d-bf73174b0310 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:59.102162 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7c29991-7454-4b8c-855d-bf73174b0310 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:59.102882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7c29991-7454-4b8c-855d-bf73174b0310 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:01:59.103353 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7c29991-7454-4b8c-855d-bf73174b0310 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:01:59.103791 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7c29991-7454-4b8c-855d-bf73174b0310 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:01:59.245220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e7c29991-7454-4b8c-855d-bf73174b0310 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:01:59.254534 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e7c29991-7454-4b8c-855d-bf73174b0310 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1725 microversion: 2.1 time: 0.165856 Aug 04 18:01:59.255325 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3567/7165] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:01:59 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:00.334983 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-03010b00-2ca9-446e-8050-03bfa7dc3db7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:00.335744 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-03010b00-2ca9-446e-8050-03bfa7dc3db7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:00.337748 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:02:00.344073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03010b00-2ca9-446e-8050-03bfa7dc3db7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:00.344580 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03010b00-2ca9-446e-8050-03bfa7dc3db7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:00.345031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03010b00-2ca9-446e-8050-03bfa7dc3db7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:00.345777 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03010b00-2ca9-446e-8050-03bfa7dc3db7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:00.346520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03010b00-2ca9-446e-8050-03bfa7dc3db7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:00.346957 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-03010b00-2ca9-446e-8050-03bfa7dc3db7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:00.485836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-03010b00-2ca9-446e-8050-03bfa7dc3db7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:00.494181 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-03010b00-2ca9-446e-8050-03bfa7dc3db7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1725 microversion: 2.1 time: 0.163188 Aug 04 18:02:00.494758 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3599/7166] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:00 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:02:01.515099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6aba4fcb-fc2a-47b1-8a01-968d8fef06b8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:01.515767 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6aba4fcb-fc2a-47b1-8a01-968d8fef06b8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:01.522844 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aba4fcb-fc2a-47b1-8a01-968d8fef06b8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:01.523349 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aba4fcb-fc2a-47b1-8a01-968d8fef06b8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:01.523801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aba4fcb-fc2a-47b1-8a01-968d8fef06b8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:01.524522 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aba4fcb-fc2a-47b1-8a01-968d8fef06b8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:01.524994 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aba4fcb-fc2a-47b1-8a01-968d8fef06b8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:01.525434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aba4fcb-fc2a-47b1-8a01-968d8fef06b8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:01.669807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6aba4fcb-fc2a-47b1-8a01-968d8fef06b8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:01.678831 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6aba4fcb-fc2a-47b1-8a01-968d8fef06b8 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1725 microversion: 2.1 time: 0.167783 Aug 04 18:02:01.679430 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3568/7167] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:01 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:02.704558 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-aeb6c6ed-15c8-40ed-bc31-96b13ff38ff7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:02.705367 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-aeb6c6ed-15c8-40ed-bc31-96b13ff38ff7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:02.712141 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aeb6c6ed-15c8-40ed-bc31-96b13ff38ff7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:02.712632 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aeb6c6ed-15c8-40ed-bc31-96b13ff38ff7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:02.713069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aeb6c6ed-15c8-40ed-bc31-96b13ff38ff7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:02.713784 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aeb6c6ed-15c8-40ed-bc31-96b13ff38ff7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:02.714269 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aeb6c6ed-15c8-40ed-bc31-96b13ff38ff7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:02.714700 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-aeb6c6ed-15c8-40ed-bc31-96b13ff38ff7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:02.852554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-aeb6c6ed-15c8-40ed-bc31-96b13ff38ff7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:02.862798 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-aeb6c6ed-15c8-40ed-bc31-96b13ff38ff7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1725 microversion: 2.1 time: 0.162571 Aug 04 18:02:02.863708 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3600/7168] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:02 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:03.886404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9dcfcd1d-97f2-4077-88c8-e83b113e4569 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:03.887052 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9dcfcd1d-97f2-4077-88c8-e83b113e4569 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:03.894565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dcfcd1d-97f2-4077-88c8-e83b113e4569 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:03.895084 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dcfcd1d-97f2-4077-88c8-e83b113e4569 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:03.895554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dcfcd1d-97f2-4077-88c8-e83b113e4569 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:03.896496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dcfcd1d-97f2-4077-88c8-e83b113e4569 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:03.896977 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dcfcd1d-97f2-4077-88c8-e83b113e4569 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:03.897424 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dcfcd1d-97f2-4077-88c8-e83b113e4569 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:04.032886 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9dcfcd1d-97f2-4077-88c8-e83b113e4569 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:04.041149 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9dcfcd1d-97f2-4077-88c8-e83b113e4569 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1725 microversion: 2.1 time: 0.158632 Aug 04 18:02:04.041739 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3569/7169] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:03 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:05.063290 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9d42cc3c-6ffc-46c4-926b-2b03cf89e71a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:05.063908 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9d42cc3c-6ffc-46c4-926b-2b03cf89e71a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:05.070823 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d42cc3c-6ffc-46c4-926b-2b03cf89e71a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:05.071312 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d42cc3c-6ffc-46c4-926b-2b03cf89e71a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:05.071755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d42cc3c-6ffc-46c4-926b-2b03cf89e71a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:05.072459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d42cc3c-6ffc-46c4-926b-2b03cf89e71a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:05.072917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d42cc3c-6ffc-46c4-926b-2b03cf89e71a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:05.073344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9d42cc3c-6ffc-46c4-926b-2b03cf89e71a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:05.215451 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9d42cc3c-6ffc-46c4-926b-2b03cf89e71a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:05.224074 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9d42cc3c-6ffc-46c4-926b-2b03cf89e71a tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1725 microversion: 2.1 time: 0.164669 Aug 04 18:02:05.224668 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3601/7170] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:05 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:06.248388 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0fa427d3-bd1e-4573-bd54-e72c48e62052 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:06.249096 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0fa427d3-bd1e-4573-bd54-e72c48e62052 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:06.258695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fa427d3-bd1e-4573-bd54-e72c48e62052 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:06.259415 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fa427d3-bd1e-4573-bd54-e72c48e62052 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:06.260046 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fa427d3-bd1e-4573-bd54-e72c48e62052 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:06.261415 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fa427d3-bd1e-4573-bd54-e72c48e62052 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:06.262038 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fa427d3-bd1e-4573-bd54-e72c48e62052 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:06.262575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fa427d3-bd1e-4573-bd54-e72c48e62052 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:06.439448 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0fa427d3-bd1e-4573-bd54-e72c48e62052 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:06.449161 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0fa427d3-bd1e-4573-bd54-e72c48e62052 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1725 microversion: 2.1 time: 0.205799 Aug 04 18:02:06.450232 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3570/7171] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:06 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1725 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:07.475494 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-eb127246-7a1a-43b8-9e5f-c72c8fcea81c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:07.476164 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-eb127246-7a1a-43b8-9e5f-c72c8fcea81c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:07.484051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eb127246-7a1a-43b8-9e5f-c72c8fcea81c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:07.484565 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eb127246-7a1a-43b8-9e5f-c72c8fcea81c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:07.485022 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eb127246-7a1a-43b8-9e5f-c72c8fcea81c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:07.485749 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eb127246-7a1a-43b8-9e5f-c72c8fcea81c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:07.486283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eb127246-7a1a-43b8-9e5f-c72c8fcea81c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:07.486720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-eb127246-7a1a-43b8-9e5f-c72c8fcea81c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:07.663936 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-eb127246-7a1a-43b8-9e5f-c72c8fcea81c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:07.673923 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-eb127246-7a1a-43b8-9e5f-c72c8fcea81c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1725 microversion: 2.1 time: 0.204795 Aug 04 18:02:07.674734 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3602/7172] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:07 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:08.697250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-196d3fea-a1cf-47c8-9d13-03f3f3f65f02 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:08.698035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-196d3fea-a1cf-47c8-9d13-03f3f3f65f02 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:08.705885 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-196d3fea-a1cf-47c8-9d13-03f3f3f65f02 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:08.706650 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-196d3fea-a1cf-47c8-9d13-03f3f3f65f02 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:08.706867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-196d3fea-a1cf-47c8-9d13-03f3f3f65f02 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:08.707593 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-196d3fea-a1cf-47c8-9d13-03f3f3f65f02 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:08.708436 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-196d3fea-a1cf-47c8-9d13-03f3f3f65f02 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:08.708563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-196d3fea-a1cf-47c8-9d13-03f3f3f65f02 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:08.864415 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-196d3fea-a1cf-47c8-9d13-03f3f3f65f02 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:08.873243 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-196d3fea-a1cf-47c8-9d13-03f3f3f65f02 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1718 microversion: 2.1 time: 0.179957 Aug 04 18:02:08.873857 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3571/7173] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:08 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1718 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:02:08.894450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dea5761a-3d5a-4a78-abd6-bb1ab206216c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:08.895077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dea5761a-3d5a-4a78-abd6-bb1ab206216c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:08.902319 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dea5761a-3d5a-4a78-abd6-bb1ab206216c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:08.902795 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dea5761a-3d5a-4a78-abd6-bb1ab206216c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:08.903241 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dea5761a-3d5a-4a78-abd6-bb1ab206216c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:08.903988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dea5761a-3d5a-4a78-abd6-bb1ab206216c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:08.904489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dea5761a-3d5a-4a78-abd6-bb1ab206216c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:08.904919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dea5761a-3d5a-4a78-abd6-bb1ab206216c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:09.047882 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dea5761a-3d5a-4a78-abd6-bb1ab206216c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:09.056434 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dea5761a-3d5a-4a78-abd6-bb1ab206216c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1718 microversion: 2.1 time: 0.165927 Aug 04 18:02:09.057106 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3603/7174] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:08 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1718 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:09.078114 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f70f29a7-8759-493a-affa-21778d9001e0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:09.078753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f70f29a7-8759-493a-affa-21778d9001e0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:09.084883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f70f29a7-8759-493a-affa-21778d9001e0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:09.085384 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f70f29a7-8759-493a-affa-21778d9001e0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:09.085834 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f70f29a7-8759-493a-affa-21778d9001e0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:09.086583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f70f29a7-8759-493a-affa-21778d9001e0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:09.087050 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f70f29a7-8759-493a-affa-21778d9001e0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:09.087562 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f70f29a7-8759-493a-affa-21778d9001e0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:09.235278 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f70f29a7-8759-493a-affa-21778d9001e0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:09.244512 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f70f29a7-8759-493a-affa-21778d9001e0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1718 microversion: 2.1 time: 0.170746 Aug 04 18:02:09.245161 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3572/7175] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:09 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1718 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:09.264812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ac782c7e-b42b-4000-bc36-c7e0f7179860 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:09.265323 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ac782c7e-b42b-4000-bc36-c7e0f7179860 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:09.271391 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac782c7e-b42b-4000-bc36-c7e0f7179860 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:09.271890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac782c7e-b42b-4000-bc36-c7e0f7179860 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:09.272339 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac782c7e-b42b-4000-bc36-c7e0f7179860 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:09.273062 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac782c7e-b42b-4000-bc36-c7e0f7179860 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:09.273522 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac782c7e-b42b-4000-bc36-c7e0f7179860 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:09.273960 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ac782c7e-b42b-4000-bc36-c7e0f7179860 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:09.303824 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ac782c7e-b42b-4000-bc36-c7e0f7179860 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 18:02:09.385037 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ac782c7e-b42b-4000-bc36-c7e0f7179860 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "DELETE /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 204 len: 0 microversion: 2.1 time: 0.123777 Aug 04 18:02:09.385823 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3604/7176] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 18:02:09 2022] DELETE /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 18:02:09.395632 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-15d8107b-86aa-4a75-9c7b-03f50cca7566 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:09.396278 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-15d8107b-86aa-4a75-9c7b-03f50cca7566 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:09.402634 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15d8107b-86aa-4a75-9c7b-03f50cca7566 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:09.403137 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15d8107b-86aa-4a75-9c7b-03f50cca7566 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:09.403880 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15d8107b-86aa-4a75-9c7b-03f50cca7566 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:09.404681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15d8107b-86aa-4a75-9c7b-03f50cca7566 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:09.405796 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15d8107b-86aa-4a75-9c7b-03f50cca7566 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:09.406854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15d8107b-86aa-4a75-9c7b-03f50cca7566 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:09.562993 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-15d8107b-86aa-4a75-9c7b-03f50cca7566 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:09.571471 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-15d8107b-86aa-4a75-9c7b-03f50cca7566 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1724 microversion: 2.1 time: 0.180856 Aug 04 18:02:09.572061 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3573/7177] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:09 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:10.592573 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d42f2a90-8ece-4bd7-a515-19ab72852028 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:10.593794 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d42f2a90-8ece-4bd7-a515-19ab72852028 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:10.601709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d42f2a90-8ece-4bd7-a515-19ab72852028 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:10.602266 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d42f2a90-8ece-4bd7-a515-19ab72852028 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:10.602718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d42f2a90-8ece-4bd7-a515-19ab72852028 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:10.603454 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d42f2a90-8ece-4bd7-a515-19ab72852028 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:10.603916 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d42f2a90-8ece-4bd7-a515-19ab72852028 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:10.604354 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d42f2a90-8ece-4bd7-a515-19ab72852028 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:10.742387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d42f2a90-8ece-4bd7-a515-19ab72852028 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:10.751825 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d42f2a90-8ece-4bd7-a515-19ab72852028 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1724 microversion: 2.1 time: 0.163351 Aug 04 18:02:10.752437 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3605/7178] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:10 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:11.551812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-454965f1-c3c1-4e15-9051-a96b0122e4db req-0ea43773-6524-4b97-9548-9320eb0bc625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38021a56-404e-46b9-b0fc-b1b4c29c1406", "name": "network-vif-plugged", "status": "completed", "tag": "bfb7c1b4-b403-4744-82d7-f7c3fbe8e5d0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:02:11.564935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-454965f1-c3c1-4e15-9051-a96b0122e4db req-0ea43773-6524-4b97-9548-9320eb0bc625 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:11.565433 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-454965f1-c3c1-4e15-9051-a96b0122e4db req-0ea43773-6524-4b97-9548-9320eb0bc625 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:11.565913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-454965f1-c3c1-4e15-9051-a96b0122e4db req-0ea43773-6524-4b97-9548-9320eb0bc625 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:11.583969 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-454965f1-c3c1-4e15-9051-a96b0122e4db req-0ea43773-6524-4b97-9548-9320eb0bc625 service nova] Creating event network-vif-plugged:bfb7c1b4-b403-4744-82d7-f7c3fbe8e5d0 for instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 on n-h1-851359-3 Aug 04 18:02:11.589479 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-454965f1-c3c1-4e15-9051-a96b0122e4db req-0ea43773-6524-4b97-9548-9320eb0bc625 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044167 Aug 04 18:02:11.591327 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3574/7179] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:02:11.774377 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-25bee77b-018f-469e-9905-f8ea2f1f5fbe tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:11.775420 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-25bee77b-018f-469e-9905-f8ea2f1f5fbe tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:11.784248 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25bee77b-018f-469e-9905-f8ea2f1f5fbe tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:11.785095 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25bee77b-018f-469e-9905-f8ea2f1f5fbe tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:11.785811 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25bee77b-018f-469e-9905-f8ea2f1f5fbe tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:11.786741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25bee77b-018f-469e-9905-f8ea2f1f5fbe tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:11.787378 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25bee77b-018f-469e-9905-f8ea2f1f5fbe tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:11.787904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25bee77b-018f-469e-9905-f8ea2f1f5fbe tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:11.980614 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-25bee77b-018f-469e-9905-f8ea2f1f5fbe tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:12.002641 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-25bee77b-018f-469e-9905-f8ea2f1f5fbe tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1724 microversion: 2.1 time: 0.233015 Aug 04 18:02:12.014138 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3606/7180] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:11 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:12.314992 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-56a455e0-bf3a-4908-b09c-d7230ec29018 req-67393aa7-5dbb-4f90-8e13-32dd5e70ad14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38021a56-404e-46b9-b0fc-b1b4c29c1406", "name": "network-vif-deleted", "tag": "bfb7c1b4-b403-4744-82d7-f7c3fbe8e5d0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:02:12.326414 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-56a455e0-bf3a-4908-b09c-d7230ec29018 req-67393aa7-5dbb-4f90-8e13-32dd5e70ad14 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:12.327051 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-56a455e0-bf3a-4908-b09c-d7230ec29018 req-67393aa7-5dbb-4f90-8e13-32dd5e70ad14 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:12.328100 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-56a455e0-bf3a-4908-b09c-d7230ec29018 req-67393aa7-5dbb-4f90-8e13-32dd5e70ad14 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:12.342447 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-56a455e0-bf3a-4908-b09c-d7230ec29018 req-67393aa7-5dbb-4f90-8e13-32dd5e70ad14 service nova] Creating event network-vif-deleted:bfb7c1b4-b403-4744-82d7-f7c3fbe8e5d0 for instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 on n-h1-851359-3 Aug 04 18:02:12.348583 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-56a455e0-bf3a-4908-b09c-d7230ec29018 req-67393aa7-5dbb-4f90-8e13-32dd5e70ad14 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038493 Aug 04 18:02:12.350195 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3575/7181] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:02:13.034269 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-95cf74c7-2c59-4e50-b035-518feaa56584 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:13.035669 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-95cf74c7-2c59-4e50-b035-518feaa56584 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:13.047499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95cf74c7-2c59-4e50-b035-518feaa56584 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:13.047935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95cf74c7-2c59-4e50-b035-518feaa56584 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:13.048646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95cf74c7-2c59-4e50-b035-518feaa56584 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:13.049379 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95cf74c7-2c59-4e50-b035-518feaa56584 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:13.049832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95cf74c7-2c59-4e50-b035-518feaa56584 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:13.050299 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-95cf74c7-2c59-4e50-b035-518feaa56584 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:13.122848 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-95cf74c7-2c59-4e50-b035-518feaa56584 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:13.137852 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-95cf74c7-2c59-4e50-b035-518feaa56584 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1370 microversion: 2.1 time: 0.110716 Aug 04 18:02:13.139315 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3607/7182] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:13 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1370 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:14.170537 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-87712700-8e84-4ff2-b0ea-11bc9678aff3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:14.172262 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-87712700-8e84-4ff2-b0ea-11bc9678aff3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:14.179801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87712700-8e84-4ff2-b0ea-11bc9678aff3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:14.180500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87712700-8e84-4ff2-b0ea-11bc9678aff3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:14.180958 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87712700-8e84-4ff2-b0ea-11bc9678aff3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:14.181752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87712700-8e84-4ff2-b0ea-11bc9678aff3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:14.182295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87712700-8e84-4ff2-b0ea-11bc9678aff3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:14.182796 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87712700-8e84-4ff2-b0ea-11bc9678aff3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:14.266762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-87712700-8e84-4ff2-b0ea-11bc9678aff3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:14.275729 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-87712700-8e84-4ff2-b0ea-11bc9678aff3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1370 microversion: 2.1 time: 0.110312 Aug 04 18:02:14.276533 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3576/7183] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:14 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1370 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:15.297606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-31edea75-33f6-4bd2-bcc4-2283861925f4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:15.298376 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-31edea75-33f6-4bd2-bcc4-2283861925f4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:15.305414 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31edea75-33f6-4bd2-bcc4-2283861925f4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:15.306002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31edea75-33f6-4bd2-bcc4-2283861925f4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:15.306528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31edea75-33f6-4bd2-bcc4-2283861925f4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:15.307310 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31edea75-33f6-4bd2-bcc4-2283861925f4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:15.307850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31edea75-33f6-4bd2-bcc4-2283861925f4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:15.308293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-31edea75-33f6-4bd2-bcc4-2283861925f4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:15.373095 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-31edea75-33f6-4bd2-bcc4-2283861925f4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:15.381675 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-31edea75-33f6-4bd2-bcc4-2283861925f4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1370 microversion: 2.1 time: 0.088610 Aug 04 18:02:15.382288 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3608/7184] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:15 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1370 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:16.402757 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-591e7841-dd71-40c9-b1d9-d4ea2a9eaa90 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:16.403420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-591e7841-dd71-40c9-b1d9-d4ea2a9eaa90 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:16.411050 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-591e7841-dd71-40c9-b1d9-d4ea2a9eaa90 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:16.411551 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-591e7841-dd71-40c9-b1d9-d4ea2a9eaa90 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:16.412236 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-591e7841-dd71-40c9-b1d9-d4ea2a9eaa90 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:16.412964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-591e7841-dd71-40c9-b1d9-d4ea2a9eaa90 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:16.413436 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-591e7841-dd71-40c9-b1d9-d4ea2a9eaa90 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:16.413882 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-591e7841-dd71-40c9-b1d9-d4ea2a9eaa90 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:16.478278 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-591e7841-dd71-40c9-b1d9-d4ea2a9eaa90 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5123a91a38cf4524a1d9ae3a0ab45ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c527dc233da14fc5ab203d0489a8653f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:16.487014 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-591e7841-dd71-40c9-b1d9-d4ea2a9eaa90 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 200 len: 1370 microversion: 2.1 time: 0.088243 Aug 04 18:02:16.487598 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3577/7185] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:16 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 1370 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:17.508297 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-98627df9-11d4-439f-ab6d-6fd9d295f62c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:17.508870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-98627df9-11d4-439f-ab6d-6fd9d295f62c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:17.516665 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98627df9-11d4-439f-ab6d-6fd9d295f62c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:17.517183 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98627df9-11d4-439f-ab6d-6fd9d295f62c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:17.517633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98627df9-11d4-439f-ab6d-6fd9d295f62c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:17.518370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98627df9-11d4-439f-ab6d-6fd9d295f62c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:17.518836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98627df9-11d4-439f-ab6d-6fd9d295f62c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:17.519270 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-98627df9-11d4-439f-ab6d-6fd9d295f62c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:17.533231 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-98627df9-11d4-439f-ab6d-6fd9d295f62c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] HTTP exception thrown: Instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 could not be found. Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-98627df9-11d4-439f-ab6d-6fd9d295f62c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Request method failure captured: Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 HTTP/1.1 Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7AfT6zYdI3v3j-02bRJESZ0cQX8SQebuMvyOFolxezaFDG4gZ9xnd6e0qCa_-lApgDzu3pztkmmadMDNE7gcIqGRoGofJyFI-POj_4532hTw_ABv1wUgQSAdGvW5EU-lDt-gWQ_upzg4xh3TljemGdTL6S2wIV1BKopo6Mxdcy-27h8 Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: c527dc233da14fc5ab203d0489a8653f Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerActionsTestJSON-1276571273 Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c527dc233da14fc5ab203d0489a8653f"}]}] Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerActionsTestJSON-1276571273 Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: c527dc233da14fc5ab203d0489a8653f Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerActionsTestJSON-1276571273 Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerActionsTestJSON-1276571273-project Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 5123a91a38cf4524a1d9ae3a0ab45ee2 Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerActionsTestJSON-1276571273-project Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 could not be found. Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '38021a56-404e-46b9-b0fc-b1b4c29c1406'} Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 could not be found. Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 could not be found. Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:02:17.534968 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:02:17.539210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:02:17.539210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:02:17.539210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:02:17.539210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:02:17.539210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:02:17.539210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 could not be found. Aug 04 18:02:17.539210 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:02:17.539210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-98627df9-11d4-439f-ab6d-6fd9d295f62c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Returning 404 to user: Instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:02:17.539210 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-98627df9-11d4-439f-ab6d-6fd9d295f62c tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 404 len: 111 microversion: 2.1 time: 0.032202 Aug 04 18:02:17.539210 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3609/7186] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:17 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 18:02:17.598778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-41f6c901-4348-49f5-b258-c1fe62ab79c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:17.601021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-41f6c901-4348-49f5-b258-c1fe62ab79c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:17.609147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41f6c901-4348-49f5-b258-c1fe62ab79c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:17.609653 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41f6c901-4348-49f5-b258-c1fe62ab79c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:17.610144 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41f6c901-4348-49f5-b258-c1fe62ab79c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:17.610877 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41f6c901-4348-49f5-b258-c1fe62ab79c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:17.611345 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41f6c901-4348-49f5-b258-c1fe62ab79c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:17.611787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41f6c901-4348-49f5-b258-c1fe62ab79c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:17.625467 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-41f6c901-4348-49f5-b258-c1fe62ab79c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] HTTP exception thrown: Instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 could not be found. Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-41f6c901-4348-49f5-b258-c1fe62ab79c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Request method failure captured: Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406/os-volume_attachments HTTP/1.1 Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AfT6zYdI3v3j-02bRJESZ0cQX8SQebuMvyOFolxezaFDG4gZ9xnd6e0qCa_-lApgDzu3pztkmmadMDNE7gcIqGRoGofJyFI-POj_4532hTw_ABv1wUgQSAdGvW5EU-lDt-gWQ_upzg4xh3TljemGdTL6S2wIV1BKopo6Mxdcy-27h8 Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: c527dc233da14fc5ab203d0489a8653f Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerActionsTestJSON-1276571273 Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c527dc233da14fc5ab203d0489a8653f"}]}] Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServerActionsTestJSON-1276571273 Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: c527dc233da14fc5ab203d0489a8653f Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerActionsTestJSON-1276571273 Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServerActionsTestJSON-1276571273-project Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 5123a91a38cf4524a1d9ae3a0ab45ee2 Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServerActionsTestJSON-1276571273-project Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 could not be found. Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'server_id': '38021a56-404e-46b9-b0fc-b1b4c29c1406'} Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 could not be found. Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 18:02:17.627216 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 18:02:17.630987 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 could not be found. Aug 04 18:02:17.630987 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:02:17.630987 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:02:17.630987 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:02:17.630987 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:02:17.630987 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:02:17.630987 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:02:17.630987 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:02:17.630987 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:02:17.630987 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 could not be found. Aug 04 18:02:17.630987 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:02:17.630987 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-41f6c901-4348-49f5-b258-c1fe62ab79c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Returning 404 to user: Instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:02:17.630987 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-41f6c901-4348-49f5-b258-c1fe62ab79c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034519 Aug 04 18:02:17.630987 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3578/7187] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 18:02:17 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 18:02:20.957840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1457ff46-e68d-4bf1-9629-578ac63a07bd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:20.958390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1457ff46-e68d-4bf1-9629-578ac63a07bd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:20.965447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1457ff46-e68d-4bf1-9629-578ac63a07bd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:20.965937 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1457ff46-e68d-4bf1-9629-578ac63a07bd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:20.966419 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1457ff46-e68d-4bf1-9629-578ac63a07bd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:20.967132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1457ff46-e68d-4bf1-9629-578ac63a07bd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:20.968260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1457ff46-e68d-4bf1-9629-578ac63a07bd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:20.968696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1457ff46-e68d-4bf1-9629-578ac63a07bd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:20.983365 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-1457ff46-e68d-4bf1-9629-578ac63a07bd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] HTTP exception thrown: Instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 could not be found. Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1457ff46-e68d-4bf1-9629-578ac63a07bd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Request method failure captured: Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 HTTP/1.1 Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7AfT6zYdI3v3j-02bRJESZ0cQX8SQebuMvyOFolxezaFDG4gZ9xnd6e0qCa_-lApgDzu3pztkmmadMDNE7gcIqGRoGofJyFI-POj_4532hTw_ABv1wUgQSAdGvW5EU-lDt-gWQ_upzg4xh3TljemGdTL6S2wIV1BKopo6Mxdcy-27h8 Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: c527dc233da14fc5ab203d0489a8653f Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerActionsTestJSON-1276571273 Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c527dc233da14fc5ab203d0489a8653f"}]}] Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerActionsTestJSON-1276571273 Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: c527dc233da14fc5ab203d0489a8653f Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerActionsTestJSON-1276571273 Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerActionsTestJSON-1276571273-project Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 5123a91a38cf4524a1d9ae3a0ab45ee2 Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerActionsTestJSON-1276571273-project Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 could not be found. Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '38021a56-404e-46b9-b0fc-b1b4c29c1406'} Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 could not be found. Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 18:02:20.984944 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 18:02:20.988409 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 could not be found. Aug 04 18:02:20.988409 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:02:20.988409 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:02:20.988409 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:02:20.988409 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:02:20.988409 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:02:20.988409 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:02:20.988409 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:02:20.988409 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:02:20.988409 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 could not be found. Aug 04 18:02:20.988409 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:02:20.988409 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1457ff46-e68d-4bf1-9629-578ac63a07bd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Returning 404 to user: Instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:02:20.988409 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1457ff46-e68d-4bf1-9629-578ac63a07bd tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "DELETE /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 404 len: 111 microversion: 2.1 time: 0.032443 Aug 04 18:02:20.988409 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3610/7188] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 18:02:20 2022] DELETE /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 18:02:20.995175 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d9b29de6-155f-4df9-8208-ebad81bd62c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:20.995812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d9b29de6-155f-4df9-8208-ebad81bd62c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 38021a56-404e-46b9-b0fc-b1b4c29c1406] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:21.002507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9b29de6-155f-4df9-8208-ebad81bd62c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:21.003012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9b29de6-155f-4df9-8208-ebad81bd62c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:21.003506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9b29de6-155f-4df9-8208-ebad81bd62c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:21.004196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9b29de6-155f-4df9-8208-ebad81bd62c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:21.004669 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9b29de6-155f-4df9-8208-ebad81bd62c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:21.005115 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9b29de6-155f-4df9-8208-ebad81bd62c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:21.021134 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-d9b29de6-155f-4df9-8208-ebad81bd62c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] HTTP exception thrown: Instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 could not be found. Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d9b29de6-155f-4df9-8208-ebad81bd62c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Request method failure captured: Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 HTTP/1.1 Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AfT6zYdI3v3j-02bRJESZ0cQX8SQebuMvyOFolxezaFDG4gZ9xnd6e0qCa_-lApgDzu3pztkmmadMDNE7gcIqGRoGofJyFI-POj_4532hTw_ABv1wUgQSAdGvW5EU-lDt-gWQ_upzg4xh3TljemGdTL6S2wIV1BKopo6Mxdcy-27h8 Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: c527dc233da14fc5ab203d0489a8653f Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerActionsTestJSON-1276571273 Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c527dc233da14fc5ab203d0489a8653f"}]}] Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServerActionsTestJSON-1276571273 Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: c527dc233da14fc5ab203d0489a8653f Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerActionsTestJSON-1276571273 Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServerActionsTestJSON-1276571273-project Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 5123a91a38cf4524a1d9ae3a0ab45ee2 Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServerActionsTestJSON-1276571273-project Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 could not be found. Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '38021a56-404e-46b9-b0fc-b1b4c29c1406'} Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 could not be found. Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 could not be found. Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:02:21.022842 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.026342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:02:21.026342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:02:21.026342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:02:21.026342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:02:21.026342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:02:21.026342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 could not be found. Aug 04 18:02:21.026342 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.026342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d9b29de6-155f-4df9-8208-ebad81bd62c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Returning 404 to user: Instance 38021a56-404e-46b9-b0fc-b1b4c29c1406 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:02:21.026342 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d9b29de6-155f-4df9-8208-ebad81bd62c0 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406" status: 404 len: 111 microversion: 2.1 time: 0.033219 Aug 04 18:02:21.026342 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3579/7189] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:20 2022] GET /compute/v2.1/servers/38021a56-404e-46b9-b0fc-b1b4c29c1406 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 18:02:21.033997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-87807097-2537-46ba-9256-202d8b4a5dbf tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:21.034518 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-87807097-2537-46ba-9256-202d8b4a5dbf tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:21.040548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87807097-2537-46ba-9256-202d8b4a5dbf tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:21.041043 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87807097-2537-46ba-9256-202d8b4a5dbf tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:21.041489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87807097-2537-46ba-9256-202d8b4a5dbf tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:21.042349 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87807097-2537-46ba-9256-202d8b4a5dbf tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:21.042815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87807097-2537-46ba-9256-202d8b4a5dbf tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:21.043250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-87807097-2537-46ba-9256-202d8b4a5dbf tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:21.060039 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-87807097-2537-46ba-9256-202d8b4a5dbf tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] HTTP exception thrown: Instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 could not be found. Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-87807097-2537-46ba-9256-202d8b4a5dbf tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Request method failure captured: Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 HTTP/1.1 Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7AfT6zYdI3v3j-02bRJESZ0cQX8SQebuMvyOFolxezaFDG4gZ9xnd6e0qCa_-lApgDzu3pztkmmadMDNE7gcIqGRoGofJyFI-POj_4532hTw_ABv1wUgQSAdGvW5EU-lDt-gWQ_upzg4xh3TljemGdTL6S2wIV1BKopo6Mxdcy-27h8 Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: c527dc233da14fc5ab203d0489a8653f Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerActionsTestJSON-1276571273 Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c527dc233da14fc5ab203d0489a8653f"}]}] Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerActionsTestJSON-1276571273 Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: c527dc233da14fc5ab203d0489a8653f Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerActionsTestJSON-1276571273 Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerActionsTestJSON-1276571273-project Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 5123a91a38cf4524a1d9ae3a0ab45ee2 Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerActionsTestJSON-1276571273-project Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 could not be found. Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'e362a3bd-c00c-4743-af02-d0c97f7b63f5'} Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 could not be found. Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 18:02:21.061665 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 18:02:21.065469 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 could not be found. Aug 04 18:02:21.065469 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.065469 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:02:21.065469 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.065469 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:02:21.065469 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:02:21.065469 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:02:21.065469 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:02:21.065469 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:02:21.065469 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 could not be found. Aug 04 18:02:21.065469 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.065469 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-87807097-2537-46ba-9256-202d8b4a5dbf tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Returning 404 to user: Instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:02:21.065469 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-87807097-2537-46ba-9256-202d8b4a5dbf tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 404 len: 111 microversion: 2.1 time: 0.033755 Aug 04 18:02:21.065469 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3611/7190] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 18:02:21 2022] DELETE /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 18:02:21.071742 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b82ef13a-5282-4aa6-9c82-9d5586377bf3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:21.072445 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b82ef13a-5282-4aa6-9c82-9d5586377bf3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: e362a3bd-c00c-4743-af02-d0c97f7b63f5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:21.079077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b82ef13a-5282-4aa6-9c82-9d5586377bf3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:21.079589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b82ef13a-5282-4aa6-9c82-9d5586377bf3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:21.080046 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b82ef13a-5282-4aa6-9c82-9d5586377bf3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:21.080755 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b82ef13a-5282-4aa6-9c82-9d5586377bf3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:21.081233 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b82ef13a-5282-4aa6-9c82-9d5586377bf3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:21.081676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b82ef13a-5282-4aa6-9c82-9d5586377bf3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:21.096006 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-b82ef13a-5282-4aa6-9c82-9d5586377bf3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] HTTP exception thrown: Instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 could not be found. Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b82ef13a-5282-4aa6-9c82-9d5586377bf3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Request method failure captured: Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 HTTP/1.1 Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AfT6zYdI3v3j-02bRJESZ0cQX8SQebuMvyOFolxezaFDG4gZ9xnd6e0qCa_-lApgDzu3pztkmmadMDNE7gcIqGRoGofJyFI-POj_4532hTw_ABv1wUgQSAdGvW5EU-lDt-gWQ_upzg4xh3TljemGdTL6S2wIV1BKopo6Mxdcy-27h8 Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: c527dc233da14fc5ab203d0489a8653f Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerActionsTestJSON-1276571273 Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c527dc233da14fc5ab203d0489a8653f"}]}] Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServerActionsTestJSON-1276571273 Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: c527dc233da14fc5ab203d0489a8653f Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerActionsTestJSON-1276571273 Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServerActionsTestJSON-1276571273-project Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 5123a91a38cf4524a1d9ae3a0ab45ee2 Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServerActionsTestJSON-1276571273-project Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 could not be found. Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'e362a3bd-c00c-4743-af02-d0c97f7b63f5'} Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 could not be found. Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 could not be found. Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:02:21.097861 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.101829 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:02:21.101829 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:02:21.101829 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:02:21.101829 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:02:21.101829 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:02:21.101829 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 could not be found. Aug 04 18:02:21.101829 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.101829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b82ef13a-5282-4aa6-9c82-9d5586377bf3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Returning 404 to user: Instance e362a3bd-c00c-4743-af02-d0c97f7b63f5 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:02:21.101829 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b82ef13a-5282-4aa6-9c82-9d5586377bf3 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5" status: 404 len: 111 microversion: 2.1 time: 0.031512 Aug 04 18:02:21.101829 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3580/7191] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:21 2022] GET /compute/v2.1/servers/e362a3bd-c00c-4743-af02-d0c97f7b63f5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 18:02:21.108840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-44b5d86e-0bc0-4072-8d4c-48866207fca7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:21.109422 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-44b5d86e-0bc0-4072-8d4c-48866207fca7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:21.116133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-44b5d86e-0bc0-4072-8d4c-48866207fca7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:21.116899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-44b5d86e-0bc0-4072-8d4c-48866207fca7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:21.117357 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-44b5d86e-0bc0-4072-8d4c-48866207fca7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:21.118113 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-44b5d86e-0bc0-4072-8d4c-48866207fca7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:21.118590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-44b5d86e-0bc0-4072-8d4c-48866207fca7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:21.119030 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-44b5d86e-0bc0-4072-8d4c-48866207fca7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:21.134893 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-44b5d86e-0bc0-4072-8d4c-48866207fca7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] HTTP exception thrown: Instance f63415b9-a517-40b9-8089-24ec457e10c4 could not be found. Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-44b5d86e-0bc0-4072-8d4c-48866207fca7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Request method failure captured: Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 HTTP/1.1 Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7AfT6zYdI3v3j-02bRJESZ0cQX8SQebuMvyOFolxezaFDG4gZ9xnd6e0qCa_-lApgDzu3pztkmmadMDNE7gcIqGRoGofJyFI-POj_4532hTw_ABv1wUgQSAdGvW5EU-lDt-gWQ_upzg4xh3TljemGdTL6S2wIV1BKopo6Mxdcy-27h8 Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: c527dc233da14fc5ab203d0489a8653f Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerActionsTestJSON-1276571273 Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c527dc233da14fc5ab203d0489a8653f"}]}] Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerActionsTestJSON-1276571273 Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: c527dc233da14fc5ab203d0489a8653f Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerActionsTestJSON-1276571273 Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerActionsTestJSON-1276571273-project Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 5123a91a38cf4524a1d9ae3a0ab45ee2 Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerActionsTestJSON-1276571273-project Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance f63415b9-a517-40b9-8089-24ec457e10c4 could not be found. Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'f63415b9-a517-40b9-8089-24ec457e10c4'} Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f63415b9-a517-40b9-8089-24ec457e10c4 could not be found. Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 18:02:21.136498 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 18:02:21.142116 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f63415b9-a517-40b9-8089-24ec457e10c4 could not be found. Aug 04 18:02:21.142116 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.142116 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:02:21.142116 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.142116 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:02:21.142116 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:02:21.142116 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:02:21.142116 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:02:21.142116 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:02:21.142116 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f63415b9-a517-40b9-8089-24ec457e10c4 could not be found. Aug 04 18:02:21.142116 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.142116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-44b5d86e-0bc0-4072-8d4c-48866207fca7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Returning 404 to user: Instance f63415b9-a517-40b9-8089-24ec457e10c4 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:02:21.142116 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-44b5d86e-0bc0-4072-8d4c-48866207fca7 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 404 len: 111 microversion: 2.1 time: 0.033734 Aug 04 18:02:21.142116 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3612/7192] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 18:02:21 2022] DELETE /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 18:02:21.150839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0dc91142-424b-4fb7-bb52-5d125a930218 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:21.151501 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0dc91142-424b-4fb7-bb52-5d125a930218 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: f63415b9-a517-40b9-8089-24ec457e10c4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:21.159003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0dc91142-424b-4fb7-bb52-5d125a930218 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:21.159772 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0dc91142-424b-4fb7-bb52-5d125a930218 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:21.160529 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0dc91142-424b-4fb7-bb52-5d125a930218 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:21.161439 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0dc91142-424b-4fb7-bb52-5d125a930218 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:21.161918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0dc91142-424b-4fb7-bb52-5d125a930218 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:21.162398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0dc91142-424b-4fb7-bb52-5d125a930218 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:21.177929 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-0dc91142-424b-4fb7-bb52-5d125a930218 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] HTTP exception thrown: Instance f63415b9-a517-40b9-8089-24ec457e10c4 could not be found. Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0dc91142-424b-4fb7-bb52-5d125a930218 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Request method failure captured: Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 HTTP/1.1 Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AfT6zYdI3v3j-02bRJESZ0cQX8SQebuMvyOFolxezaFDG4gZ9xnd6e0qCa_-lApgDzu3pztkmmadMDNE7gcIqGRoGofJyFI-POj_4532hTw_ABv1wUgQSAdGvW5EU-lDt-gWQ_upzg4xh3TljemGdTL6S2wIV1BKopo6Mxdcy-27h8 Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: c527dc233da14fc5ab203d0489a8653f Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerActionsTestJSON-1276571273 Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c527dc233da14fc5ab203d0489a8653f"}]}] Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServerActionsTestJSON-1276571273 Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: c527dc233da14fc5ab203d0489a8653f Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerActionsTestJSON-1276571273 Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServerActionsTestJSON-1276571273-project Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 5123a91a38cf4524a1d9ae3a0ab45ee2 Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServerActionsTestJSON-1276571273-project Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance f63415b9-a517-40b9-8089-24ec457e10c4 could not be found. Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'f63415b9-a517-40b9-8089-24ec457e10c4'} Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f63415b9-a517-40b9-8089-24ec457e10c4 could not be found. Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f63415b9-a517-40b9-8089-24ec457e10c4 could not be found. Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:02:21.179832 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.184366 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:02:21.184366 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:02:21.184366 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:02:21.184366 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:02:21.184366 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:02:21.184366 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f63415b9-a517-40b9-8089-24ec457e10c4 could not be found. Aug 04 18:02:21.184366 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.184366 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0dc91142-424b-4fb7-bb52-5d125a930218 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Returning 404 to user: Instance f63415b9-a517-40b9-8089-24ec457e10c4 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:02:21.184366 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0dc91142-424b-4fb7-bb52-5d125a930218 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4" status: 404 len: 111 microversion: 2.1 time: 0.037623 Aug 04 18:02:21.184366 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3581/7193] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:21 2022] GET /compute/v2.1/servers/f63415b9-a517-40b9-8089-24ec457e10c4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 18:02:21.191622 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e6a76b85-3e3e-4b40-990b-29db7d3d7321 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:21.192122 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e6a76b85-3e3e-4b40-990b-29db7d3d7321 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:21.198503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e6a76b85-3e3e-4b40-990b-29db7d3d7321 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:21.199293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e6a76b85-3e3e-4b40-990b-29db7d3d7321 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:21.199973 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e6a76b85-3e3e-4b40-990b-29db7d3d7321 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:21.200664 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e6a76b85-3e3e-4b40-990b-29db7d3d7321 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:21.201121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e6a76b85-3e3e-4b40-990b-29db7d3d7321 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:21.201550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e6a76b85-3e3e-4b40-990b-29db7d3d7321 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:21.204710 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:02:21.219081 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-e6a76b85-3e3e-4b40-990b-29db7d3d7321 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] HTTP exception thrown: Instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 could not be found. Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e6a76b85-3e3e-4b40-990b-29db7d3d7321 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Request method failure captured: Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 HTTP/1.1 Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7AfT6zYdI3v3j-02bRJESZ0cQX8SQebuMvyOFolxezaFDG4gZ9xnd6e0qCa_-lApgDzu3pztkmmadMDNE7gcIqGRoGofJyFI-POj_4532hTw_ABv1wUgQSAdGvW5EU-lDt-gWQ_upzg4xh3TljemGdTL6S2wIV1BKopo6Mxdcy-27h8 Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: c527dc233da14fc5ab203d0489a8653f Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServerActionsTestJSON-1276571273 Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c527dc233da14fc5ab203d0489a8653f"}]}] Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServerActionsTestJSON-1276571273 Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: c527dc233da14fc5ab203d0489a8653f Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServerActionsTestJSON-1276571273 Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServerActionsTestJSON-1276571273-project Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 5123a91a38cf4524a1d9ae3a0ab45ee2 Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServerActionsTestJSON-1276571273-project Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 could not be found. Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '561003ab-c65c-4c83-b932-d3de9aedbbb1'} Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 could not be found. Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 18:02:21.220831 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 18:02:21.228078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 could not be found. Aug 04 18:02:21.228078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.228078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:02:21.228078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.228078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:02:21.228078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:02:21.228078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:02:21.228078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:02:21.228078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:02:21.228078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 could not be found. Aug 04 18:02:21.228078 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.228078 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e6a76b85-3e3e-4b40-990b-29db7d3d7321 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Returning 404 to user: Instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:02:21.228078 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e6a76b85-3e3e-4b40-990b-29db7d3d7321 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "DELETE /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 404 len: 111 microversion: 2.1 time: 0.034878 Aug 04 18:02:21.228078 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3613/7194] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 18:02:21 2022] DELETE /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 18:02:21.235115 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-55f842df-5be7-4479-97a8-9abac30d63c4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:21.235749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-55f842df-5be7-4479-97a8-9abac30d63c4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] [instance: 561003ab-c65c-4c83-b932-d3de9aedbbb1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:21.241922 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55f842df-5be7-4479-97a8-9abac30d63c4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:21.242467 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55f842df-5be7-4479-97a8-9abac30d63c4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:21.242924 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55f842df-5be7-4479-97a8-9abac30d63c4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:21.243639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55f842df-5be7-4479-97a8-9abac30d63c4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:21.244111 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55f842df-5be7-4479-97a8-9abac30d63c4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:21.244552 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55f842df-5be7-4479-97a8-9abac30d63c4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:21.259014 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-55f842df-5be7-4479-97a8-9abac30d63c4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] HTTP exception thrown: Instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 could not be found. Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-55f842df-5be7-4479-97a8-9abac30d63c4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Request method failure captured: Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 HTTP/1.1 Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AfT6zYdI3v3j-02bRJESZ0cQX8SQebuMvyOFolxezaFDG4gZ9xnd6e0qCa_-lApgDzu3pztkmmadMDNE7gcIqGRoGofJyFI-POj_4532hTw_ABv1wUgQSAdGvW5EU-lDt-gWQ_upzg4xh3TljemGdTL6S2wIV1BKopo6Mxdcy-27h8 Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: c527dc233da14fc5ab203d0489a8653f Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerActionsTestJSON-1276571273 Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_c527dc233da14fc5ab203d0489a8653f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/c527dc233da14fc5ab203d0489a8653f"}]}] Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServerActionsTestJSON-1276571273 Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: c527dc233da14fc5ab203d0489a8653f Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerActionsTestJSON-1276571273 Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServerActionsTestJSON-1276571273-project Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 5123a91a38cf4524a1d9ae3a0ab45ee2 Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServerActionsTestJSON-1276571273-project Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 could not be found. Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '561003ab-c65c-4c83-b932-d3de9aedbbb1'} Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 could not be found. Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 could not be found. Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:02:21.260693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.265920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:02:21.265920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:02:21.265920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:02:21.265920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:02:21.265920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:02:21.265920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 could not be found. Aug 04 18:02:21.265920 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:02:21.265920 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-55f842df-5be7-4479-97a8-9abac30d63c4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Returning 404 to user: Instance 561003ab-c65c-4c83-b932-d3de9aedbbb1 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:02:21.265920 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-55f842df-5be7-4479-97a8-9abac30d63c4 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1" status: 404 len: 111 microversion: 2.1 time: 0.033531 Aug 04 18:02:21.266976 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3582/7195] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:21 2022] GET /compute/v2.1/servers/561003ab-c65c-4c83-b932-d3de9aedbbb1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 18:02:21.274297 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e901a4dc-0674-40e6-9eaa-97a5b942ad85 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] Calling method '.version_select at 0x7f1e5afb8e50>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:21.301674 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e901a4dc-0674-40e6-9eaa-97a5b942ad85 tempest-ServerActionsTestJSON-1276571273 tempest-ServerActionsTestJSON-1276571273-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2056900899" status: 202 len: 0 microversion: 2.1 time: 0.031596 Aug 04 18:02:21.302411 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3614/7196] 10.222.0.93 () {58 vars in 1221 bytes} [Thu Aug 4 18:02:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2056900899 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 18:02:31.038970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bc42ddd3-29c3-4f8f-8539-3b2c82adffcb tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2142914375", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "7668cbea-068e-46a6-834e-7c371c11c68d"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:02:31.048428 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=34 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:02:31.099355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-bc42ddd3-29c3-4f8f-8539-3b2c82adffcb tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] validate_networks() for [('7668cbea-068e-46a6-834e-7c371c11c68d', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 18:02:31.249771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=73 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:02:31.947566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-bc42ddd3-29c3-4f8f-8539-3b2c82adffcb tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 18:02:31.948202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-bc42ddd3-29c3-4f8f-8539-3b2c82adffcb tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 18:02:31.948701 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-bc42ddd3-29c3-4f8f-8539-3b2c82adffcb tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 18:02:31.949130 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-bc42ddd3-29c3-4f8f-8539-3b2c82adffcb tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 18:02:31.949565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-bc42ddd3-29c3-4f8f-8539-3b2c82adffcb tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 18:02:31.959678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc42ddd3-29c3-4f8f-8539-3b2c82adffcb tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:31.960181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc42ddd3-29c3-4f8f-8539-3b2c82adffcb tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:31.960672 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc42ddd3-29c3-4f8f-8539-3b2c82adffcb tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:31.961425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc42ddd3-29c3-4f8f-8539-3b2c82adffcb tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:31.961894 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc42ddd3-29c3-4f8f-8539-3b2c82adffcb tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:31.962548 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc42ddd3-29c3-4f8f-8539-3b2c82adffcb tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:31.991745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-bc42ddd3-29c3-4f8f-8539-3b2c82adffcb tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Getting quotas for project 48997d8c38094beda3352bc2279c87bc. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 18:02:31.998694 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-bc42ddd3-29c3-4f8f-8539-3b2c82adffcb tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Getting quotas for user 7240d2cd85c54f19b8f3e585f6452b46 and project 48997d8c38094beda3352bc2279c87bc. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 18:02:32.016405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bc42ddd3-29c3-4f8f-8539-3b2c82adffcb tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 18:02:32.025656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bc42ddd3-29c3-4f8f-8539-3b2c82adffcb tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 4bb5edb0-ce65-44f2-997f-513c02779bb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 18:02:32.074069 n-d-851359-3 devstack@n-api.service[131044]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bc42ddd3-29c3-4f8f-8539-3b2c82adffcb tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [9cfb28b1-402d-49f6-96c2-e5c0ebf7a03d] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 18:02:33.082373 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [None req-bc42ddd3-29c3-4f8f-8539-3b2c82adffcb tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [9cfb28b1-402d-49f6-96c2-e5c0ebf7a03d] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 56098. Aug 04 18:02:33.087489 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bc42ddd3-29c3-4f8f-8539-3b2c82adffcb tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.183244 Aug 04 18:02:33.088249 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3583/7197] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 18:02:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 18:02:33.098814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:02:33.099625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:02:33.103993 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4a9ddaf8-8845-4f99-beef-b647a6efcf1e tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:33.104663 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4a9ddaf8-8845-4f99-beef-b647a6efcf1e tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 4bb5edb0-ce65-44f2-997f-513c02779bb3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:33.207251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4a9ddaf8-8845-4f99-beef-b647a6efcf1e tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:33.220590 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4a9ddaf8-8845-4f99-beef-b647a6efcf1e tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3" status: 200 len: 1217 microversion: 2.1 time: 0.123550 Aug 04 18:02:33.222176 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3615/7198] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:33 2022] GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3 => generated 1217 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:34.244147 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-307303b3-d473-4564-ba7b-0c94917af880 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:34.245762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-307303b3-d473-4564-ba7b-0c94917af880 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 4bb5edb0-ce65-44f2-997f-513c02779bb3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:34.322689 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-307303b3-d473-4564-ba7b-0c94917af880 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:34.333504 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-307303b3-d473-4564-ba7b-0c94917af880 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3" status: 200 len: 1217 microversion: 2.1 time: 0.095811 Aug 04 18:02:34.334449 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3584/7199] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:34 2022] GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3 => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:35.357420 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f168fd68-7ace-4eda-9901-581653fc0ea1 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:35.358156 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f168fd68-7ace-4eda-9901-581653fc0ea1 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 4bb5edb0-ce65-44f2-997f-513c02779bb3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:35.417337 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f168fd68-7ace-4eda-9901-581653fc0ea1 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:35.425338 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f168fd68-7ace-4eda-9901-581653fc0ea1 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3" status: 200 len: 1217 microversion: 2.1 time: 0.072246 Aug 04 18:02:35.425928 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3616/7200] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:35 2022] GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3 => generated 1217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:02:36.446370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-55f88bef-581b-42d0-aa27-11f7cf41c3f5 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:36.447142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-55f88bef-581b-42d0-aa27-11f7cf41c3f5 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 4bb5edb0-ce65-44f2-997f-513c02779bb3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:36.455672 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55f88bef-581b-42d0-aa27-11f7cf41c3f5 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:36.456313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55f88bef-581b-42d0-aa27-11f7cf41c3f5 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:36.456907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55f88bef-581b-42d0-aa27-11f7cf41c3f5 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:36.457781 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55f88bef-581b-42d0-aa27-11f7cf41c3f5 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:36.458321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55f88bef-581b-42d0-aa27-11f7cf41c3f5 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:36.458778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55f88bef-581b-42d0-aa27-11f7cf41c3f5 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:36.546889 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-55f88bef-581b-42d0-aa27-11f7cf41c3f5 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:36.555447 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-55f88bef-581b-42d0-aa27-11f7cf41c3f5 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3" status: 200 len: 1275 microversion: 2.1 time: 0.113227 Aug 04 18:02:36.556074 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3585/7201] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:36 2022] GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3 => generated 1275 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:02:37.581198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0b1154a0-2e36-48cd-b401-1703af27304b tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:37.581198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0b1154a0-2e36-48cd-b401-1703af27304b tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 4bb5edb0-ce65-44f2-997f-513c02779bb3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:37.588570 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b1154a0-2e36-48cd-b401-1703af27304b tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:37.589103 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b1154a0-2e36-48cd-b401-1703af27304b tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:37.589552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b1154a0-2e36-48cd-b401-1703af27304b tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:37.590308 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b1154a0-2e36-48cd-b401-1703af27304b tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:37.590771 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b1154a0-2e36-48cd-b401-1703af27304b tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:37.591208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b1154a0-2e36-48cd-b401-1703af27304b tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:37.865007 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0f3aebcd-f932-40ac-b9e8-b9c6bab10fd5 req-49263d86-be6d-42b4-b145-1ef244fb33e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bb5edb0-ce65-44f2-997f-513c02779bb3", "tag": "76bfa4a1-bd67-4d4d-b171-a3c7fcc79df1"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:02:37.867232 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0b1154a0-2e36-48cd-b401-1703af27304b tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:37.876223 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0b1154a0-2e36-48cd-b401-1703af27304b tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3" status: 200 len: 1317 microversion: 2.1 time: 0.300581 Aug 04 18:02:37.876476 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0f3aebcd-f932-40ac-b9e8-b9c6bab10fd5 req-49263d86-be6d-42b4-b145-1ef244fb33e2 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:37.876908 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0f3aebcd-f932-40ac-b9e8-b9c6bab10fd5 req-49263d86-be6d-42b4-b145-1ef244fb33e2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:37.877548 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0f3aebcd-f932-40ac-b9e8-b9c6bab10fd5 req-49263d86-be6d-42b4-b145-1ef244fb33e2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:37.891697 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3617/7202] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:37 2022] GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3 => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:37.893509 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0f3aebcd-f932-40ac-b9e8-b9c6bab10fd5 req-49263d86-be6d-42b4-b145-1ef244fb33e2 service nova] Creating event network-changed:76bfa4a1-bd67-4d4d-b171-a3c7fcc79df1 for instance 4bb5edb0-ce65-44f2-997f-513c02779bb3 on n-h2-851359-3 Aug 04 18:02:37.900419 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0f3aebcd-f932-40ac-b9e8-b9c6bab10fd5 req-49263d86-be6d-42b4-b145-1ef244fb33e2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039515 Aug 04 18:02:37.901080 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3586/7203] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:02:38.899417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7907f734-84e1-4131-9823-4ee12a45d771 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:38.900066 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7907f734-84e1-4131-9823-4ee12a45d771 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 4bb5edb0-ce65-44f2-997f-513c02779bb3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:38.907704 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7907f734-84e1-4131-9823-4ee12a45d771 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:38.908202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7907f734-84e1-4131-9823-4ee12a45d771 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:38.908687 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7907f734-84e1-4131-9823-4ee12a45d771 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:38.909405 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7907f734-84e1-4131-9823-4ee12a45d771 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:38.910177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7907f734-84e1-4131-9823-4ee12a45d771 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:38.910625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7907f734-84e1-4131-9823-4ee12a45d771 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:39.059024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7907f734-84e1-4131-9823-4ee12a45d771 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:39.067245 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7907f734-84e1-4131-9823-4ee12a45d771 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3" status: 200 len: 1317 microversion: 2.1 time: 0.171672 Aug 04 18:02:39.067836 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3618/7204] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:38 2022] GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:40.089408 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e96a4e06-b84e-43a4-a114-44c79bf2c3a6 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:40.090164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e96a4e06-b84e-43a4-a114-44c79bf2c3a6 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 4bb5edb0-ce65-44f2-997f-513c02779bb3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:40.099133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e96a4e06-b84e-43a4-a114-44c79bf2c3a6 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:40.100032 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e96a4e06-b84e-43a4-a114-44c79bf2c3a6 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:40.100840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e96a4e06-b84e-43a4-a114-44c79bf2c3a6 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:40.101589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e96a4e06-b84e-43a4-a114-44c79bf2c3a6 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:40.102113 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e96a4e06-b84e-43a4-a114-44c79bf2c3a6 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:40.102570 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e96a4e06-b84e-43a4-a114-44c79bf2c3a6 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:40.258511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e96a4e06-b84e-43a4-a114-44c79bf2c3a6 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:40.269573 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e96a4e06-b84e-43a4-a114-44c79bf2c3a6 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3" status: 200 len: 1317 microversion: 2.1 time: 0.185180 Aug 04 18:02:40.270186 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3587/7205] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:40 2022] GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3 => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:41.291165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4a18dc91-bb79-4ca5-a6b5-60ee6740e527 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:41.291824 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4a18dc91-bb79-4ca5-a6b5-60ee6740e527 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 4bb5edb0-ce65-44f2-997f-513c02779bb3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:41.299534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a18dc91-bb79-4ca5-a6b5-60ee6740e527 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:41.300034 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a18dc91-bb79-4ca5-a6b5-60ee6740e527 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:41.300645 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a18dc91-bb79-4ca5-a6b5-60ee6740e527 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:41.301370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a18dc91-bb79-4ca5-a6b5-60ee6740e527 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:41.301837 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a18dc91-bb79-4ca5-a6b5-60ee6740e527 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:41.302304 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4a18dc91-bb79-4ca5-a6b5-60ee6740e527 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:41.442752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4a18dc91-bb79-4ca5-a6b5-60ee6740e527 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:41.450558 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4a18dc91-bb79-4ca5-a6b5-60ee6740e527 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3" status: 200 len: 1317 microversion: 2.1 time: 0.163370 Aug 04 18:02:41.451760 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3619/7206] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:41 2022] GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:42.472806 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fca49dd5-7a2f-4255-a2d2-82417d5c2753 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:42.473477 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fca49dd5-7a2f-4255-a2d2-82417d5c2753 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 4bb5edb0-ce65-44f2-997f-513c02779bb3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:42.476416 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:02:42.483020 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fca49dd5-7a2f-4255-a2d2-82417d5c2753 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:42.483537 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fca49dd5-7a2f-4255-a2d2-82417d5c2753 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:42.483990 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fca49dd5-7a2f-4255-a2d2-82417d5c2753 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:42.484766 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fca49dd5-7a2f-4255-a2d2-82417d5c2753 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:42.485235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fca49dd5-7a2f-4255-a2d2-82417d5c2753 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:42.485676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fca49dd5-7a2f-4255-a2d2-82417d5c2753 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:42.716311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fca49dd5-7a2f-4255-a2d2-82417d5c2753 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:42.725786 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fca49dd5-7a2f-4255-a2d2-82417d5c2753 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3" status: 200 len: 1317 microversion: 2.1 time: 0.257073 Aug 04 18:02:42.726332 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3588/7207] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:42 2022] GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3 => generated 1317 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:43.750673 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cbcb4c72-c2b0-43dc-8641-5c8c48c4c3a7 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:43.751335 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cbcb4c72-c2b0-43dc-8641-5c8c48c4c3a7 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 4bb5edb0-ce65-44f2-997f-513c02779bb3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:43.759293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cbcb4c72-c2b0-43dc-8641-5c8c48c4c3a7 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:43.759799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cbcb4c72-c2b0-43dc-8641-5c8c48c4c3a7 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:43.760256 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cbcb4c72-c2b0-43dc-8641-5c8c48c4c3a7 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:43.760978 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cbcb4c72-c2b0-43dc-8641-5c8c48c4c3a7 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:43.761452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cbcb4c72-c2b0-43dc-8641-5c8c48c4c3a7 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:43.761923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cbcb4c72-c2b0-43dc-8641-5c8c48c4c3a7 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:43.907793 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cbcb4c72-c2b0-43dc-8641-5c8c48c4c3a7 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:43.915720 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cbcb4c72-c2b0-43dc-8641-5c8c48c4c3a7 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3" status: 200 len: 1317 microversion: 2.1 time: 0.170566 Aug 04 18:02:43.916312 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3620/7208] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:43 2022] GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:44.938339 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-80093ab3-23bb-4cc7-8596-42cd8cb25d42 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:44.939000 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-80093ab3-23bb-4cc7-8596-42cd8cb25d42 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 4bb5edb0-ce65-44f2-997f-513c02779bb3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:44.943235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=8 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:02:44.947608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80093ab3-23bb-4cc7-8596-42cd8cb25d42 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:44.948112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80093ab3-23bb-4cc7-8596-42cd8cb25d42 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:44.948569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80093ab3-23bb-4cc7-8596-42cd8cb25d42 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:44.949329 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80093ab3-23bb-4cc7-8596-42cd8cb25d42 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:44.949795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80093ab3-23bb-4cc7-8596-42cd8cb25d42 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:44.950271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80093ab3-23bb-4cc7-8596-42cd8cb25d42 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:45.112063 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-8a60a51f-a6e4-4c2f-ba24-d8b147dedef5 req-04de6de8-628f-42df-a6f8-46acfd3bbaa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bb5edb0-ce65-44f2-997f-513c02779bb3", "name": "network-vif-plugged", "status": "completed", "tag": "76bfa4a1-bd67-4d4d-b171-a3c7fcc79df1"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:02:45.124439 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8a60a51f-a6e4-4c2f-ba24-d8b147dedef5 req-04de6de8-628f-42df-a6f8-46acfd3bbaa1 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:45.125074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8a60a51f-a6e4-4c2f-ba24-d8b147dedef5 req-04de6de8-628f-42df-a6f8-46acfd3bbaa1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:45.125500 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8a60a51f-a6e4-4c2f-ba24-d8b147dedef5 req-04de6de8-628f-42df-a6f8-46acfd3bbaa1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:45.129142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-80093ab3-23bb-4cc7-8596-42cd8cb25d42 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:45.143416 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-80093ab3-23bb-4cc7-8596-42cd8cb25d42 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3" status: 200 len: 1317 microversion: 2.1 time: 0.209821 Aug 04 18:02:45.143746 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-8a60a51f-a6e4-4c2f-ba24-d8b147dedef5 req-04de6de8-628f-42df-a6f8-46acfd3bbaa1 service nova] Creating event network-vif-plugged:76bfa4a1-bd67-4d4d-b171-a3c7fcc79df1 for instance 4bb5edb0-ce65-44f2-997f-513c02779bb3 on n-h2-851359-3 Aug 04 18:02:45.149162 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-8a60a51f-a6e4-4c2f-ba24-d8b147dedef5 req-04de6de8-628f-42df-a6f8-46acfd3bbaa1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041893 Aug 04 18:02:45.149773 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3621/7209] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:02:45.158214 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3589/7210] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:44 2022] GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3 => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:46.174301 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1d77d99c-4a1a-4b40-b630-7cd84e98900b tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:46.174945 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1d77d99c-4a1a-4b40-b630-7cd84e98900b tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 4bb5edb0-ce65-44f2-997f-513c02779bb3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:46.176961 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=4 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:02:46.183346 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d77d99c-4a1a-4b40-b630-7cd84e98900b tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:46.183859 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d77d99c-4a1a-4b40-b630-7cd84e98900b tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:46.184311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d77d99c-4a1a-4b40-b630-7cd84e98900b tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:46.185031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d77d99c-4a1a-4b40-b630-7cd84e98900b tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:46.185503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d77d99c-4a1a-4b40-b630-7cd84e98900b tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:46.185940 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1d77d99c-4a1a-4b40-b630-7cd84e98900b tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:46.333333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1d77d99c-4a1a-4b40-b630-7cd84e98900b tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:46.342758 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1d77d99c-4a1a-4b40-b630-7cd84e98900b tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3" status: 200 len: 1317 microversion: 2.1 time: 0.172704 Aug 04 18:02:46.343354 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3622/7211] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:46 2022] GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:47.366544 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a0142bec-af2a-42fb-8d17-b9633a45dc15 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:47.367111 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a0142bec-af2a-42fb-8d17-b9633a45dc15 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 4bb5edb0-ce65-44f2-997f-513c02779bb3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:47.374345 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0142bec-af2a-42fb-8d17-b9633a45dc15 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:47.374843 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0142bec-af2a-42fb-8d17-b9633a45dc15 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:47.375292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0142bec-af2a-42fb-8d17-b9633a45dc15 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:47.376006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0142bec-af2a-42fb-8d17-b9633a45dc15 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:47.376491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0142bec-af2a-42fb-8d17-b9633a45dc15 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:47.376905 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0142bec-af2a-42fb-8d17-b9633a45dc15 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:47.526958 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a0142bec-af2a-42fb-8d17-b9633a45dc15 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:47.535750 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a0142bec-af2a-42fb-8d17-b9633a45dc15 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3" status: 200 len: 1505 microversion: 2.1 time: 0.175113 Aug 04 18:02:47.536349 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3590/7212] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:47 2022] GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3 => generated 1505 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:47.599436 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0f1f43d6-ffa2-4f04-8192-870cb23cec4c tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1577548600", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "7668cbea-068e-46a6-834e-7c371c11c68d"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:02:47.657439 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-0f1f43d6-ffa2-4f04-8192-870cb23cec4c tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] validate_networks() for [('7668cbea-068e-46a6-834e-7c371c11c68d', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 18:02:48.071951 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-0f1f43d6-ffa2-4f04-8192-870cb23cec4c tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 18:02:48.072381 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-0f1f43d6-ffa2-4f04-8192-870cb23cec4c tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 18:02:48.072983 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-0f1f43d6-ffa2-4f04-8192-870cb23cec4c tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 18:02:48.073410 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-0f1f43d6-ffa2-4f04-8192-870cb23cec4c tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 18:02:48.073840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-0f1f43d6-ffa2-4f04-8192-870cb23cec4c tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 18:02:48.084604 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f1f43d6-ffa2-4f04-8192-870cb23cec4c tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:48.085102 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f1f43d6-ffa2-4f04-8192-870cb23cec4c tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:48.086283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f1f43d6-ffa2-4f04-8192-870cb23cec4c tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:48.086396 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f1f43d6-ffa2-4f04-8192-870cb23cec4c tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:48.087611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f1f43d6-ffa2-4f04-8192-870cb23cec4c tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:48.087611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0f1f43d6-ffa2-4f04-8192-870cb23cec4c tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:48.105622 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-0f1f43d6-ffa2-4f04-8192-870cb23cec4c tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Getting quotas for project 48997d8c38094beda3352bc2279c87bc. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 18:02:48.112325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-0f1f43d6-ffa2-4f04-8192-870cb23cec4c tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Getting quotas for user 7240d2cd85c54f19b8f3e585f6452b46 and project 48997d8c38094beda3352bc2279c87bc. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 18:02:48.127045 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0f1f43d6-ffa2-4f04-8192-870cb23cec4c tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 18:02:48.129416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0f1f43d6-ffa2-4f04-8192-870cb23cec4c tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 058670d2-068f-46aa-8c56-4870b874a892] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 18:02:48.175026 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0f1f43d6-ffa2-4f04-8192-870cb23cec4c tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.579767 Aug 04 18:02:48.175817 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3623/7213] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 18:02:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 18:02:48.187303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-86ef5246-3ca5-4237-a879-91cc16f63e34 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:48.187967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-86ef5246-3ca5-4237-a879-91cc16f63e34 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 058670d2-068f-46aa-8c56-4870b874a892] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:48.248525 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-86ef5246-3ca5-4237-a879-91cc16f63e34 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:48.255423 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-86ef5246-3ca5-4237-a879-91cc16f63e34 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892" status: 200 len: 1217 microversion: 2.1 time: 0.072733 Aug 04 18:02:48.256009 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3591/7214] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:48 2022] GET /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892 => generated 1217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:02:49.276815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-32b1b609-1d33-4949-8c3a-0ff129c3cd5b tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:49.277456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-32b1b609-1d33-4949-8c3a-0ff129c3cd5b tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 058670d2-068f-46aa-8c56-4870b874a892] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:49.284658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32b1b609-1d33-4949-8c3a-0ff129c3cd5b tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:49.285162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32b1b609-1d33-4949-8c3a-0ff129c3cd5b tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:49.285615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32b1b609-1d33-4949-8c3a-0ff129c3cd5b tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:49.286366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32b1b609-1d33-4949-8c3a-0ff129c3cd5b tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:49.286839 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32b1b609-1d33-4949-8c3a-0ff129c3cd5b tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:49.287276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32b1b609-1d33-4949-8c3a-0ff129c3cd5b tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:49.352502 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-32b1b609-1d33-4949-8c3a-0ff129c3cd5b tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:49.361455 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-32b1b609-1d33-4949-8c3a-0ff129c3cd5b tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892" status: 200 len: 1269 microversion: 2.1 time: 0.089476 Aug 04 18:02:49.362066 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3624/7215] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:49 2022] GET /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892 => generated 1269 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:50.385142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e6e2e27d-4d99-457e-adc4-6d5d0abe59be tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:50.386690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e6e2e27d-4d99-457e-adc4-6d5d0abe59be tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 058670d2-068f-46aa-8c56-4870b874a892] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:50.407481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6e2e27d-4d99-457e-adc4-6d5d0abe59be tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:50.408003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6e2e27d-4d99-457e-adc4-6d5d0abe59be tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:50.408460 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6e2e27d-4d99-457e-adc4-6d5d0abe59be tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:50.409204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6e2e27d-4d99-457e-adc4-6d5d0abe59be tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:50.409679 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6e2e27d-4d99-457e-adc4-6d5d0abe59be tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:50.410197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6e2e27d-4d99-457e-adc4-6d5d0abe59be tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:50.605748 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e6e2e27d-4d99-457e-adc4-6d5d0abe59be tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:50.615250 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e6e2e27d-4d99-457e-adc4-6d5d0abe59be tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892" status: 200 len: 1317 microversion: 2.1 time: 0.234437 Aug 04 18:02:50.616053 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3592/7216] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:50 2022] GET /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892 => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:51.170005 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-aaa1efc0-66d4-4a7e-a13a-acca62b401aa req-dcd85f6f-2b67-4eb2-90d2-7d014b5e698f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "058670d2-068f-46aa-8c56-4870b874a892", "tag": "dab8d6fb-1524-4d39-88d2-0f3e171895f7"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:02:51.181499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-aaa1efc0-66d4-4a7e-a13a-acca62b401aa req-dcd85f6f-2b67-4eb2-90d2-7d014b5e698f service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:51.181942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-aaa1efc0-66d4-4a7e-a13a-acca62b401aa req-dcd85f6f-2b67-4eb2-90d2-7d014b5e698f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:51.182427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-aaa1efc0-66d4-4a7e-a13a-acca62b401aa req-dcd85f6f-2b67-4eb2-90d2-7d014b5e698f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:51.195037 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-aaa1efc0-66d4-4a7e-a13a-acca62b401aa req-dcd85f6f-2b67-4eb2-90d2-7d014b5e698f service nova] Creating event network-changed:dab8d6fb-1524-4d39-88d2-0f3e171895f7 for instance 058670d2-068f-46aa-8c56-4870b874a892 on n-h1-851359-3 Aug 04 18:02:51.200116 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-aaa1efc0-66d4-4a7e-a13a-acca62b401aa req-dcd85f6f-2b67-4eb2-90d2-7d014b5e698f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034544 Aug 04 18:02:51.201756 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3625/7217] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:02:51.636597 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-da4ec9c7-be21-49a1-ac3a-d558350819a4 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:51.637355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-da4ec9c7-be21-49a1-ac3a-d558350819a4 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 058670d2-068f-46aa-8c56-4870b874a892] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:51.644524 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da4ec9c7-be21-49a1-ac3a-d558350819a4 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:51.645022 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da4ec9c7-be21-49a1-ac3a-d558350819a4 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:51.645473 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da4ec9c7-be21-49a1-ac3a-d558350819a4 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:51.646204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da4ec9c7-be21-49a1-ac3a-d558350819a4 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:51.646671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da4ec9c7-be21-49a1-ac3a-d558350819a4 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:51.647109 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da4ec9c7-be21-49a1-ac3a-d558350819a4 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:51.795688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-da4ec9c7-be21-49a1-ac3a-d558350819a4 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:51.803880 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-da4ec9c7-be21-49a1-ac3a-d558350819a4 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892" status: 200 len: 1317 microversion: 2.1 time: 0.171107 Aug 04 18:02:51.804479 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3593/7218] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:51 2022] GET /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:52.826902 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8e21e66c-dfd3-4aa9-8fed-deb1e4d1ef75 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:52.827544 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8e21e66c-dfd3-4aa9-8fed-deb1e4d1ef75 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 058670d2-068f-46aa-8c56-4870b874a892] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:52.834166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e21e66c-dfd3-4aa9-8fed-deb1e4d1ef75 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:52.834671 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e21e66c-dfd3-4aa9-8fed-deb1e4d1ef75 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:52.835122 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e21e66c-dfd3-4aa9-8fed-deb1e4d1ef75 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:52.835842 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e21e66c-dfd3-4aa9-8fed-deb1e4d1ef75 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:52.836318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e21e66c-dfd3-4aa9-8fed-deb1e4d1ef75 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:52.836755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e21e66c-dfd3-4aa9-8fed-deb1e4d1ef75 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:52.976860 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8e21e66c-dfd3-4aa9-8fed-deb1e4d1ef75 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:52.985160 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8e21e66c-dfd3-4aa9-8fed-deb1e4d1ef75 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892" status: 200 len: 1317 microversion: 2.1 time: 0.163903 Aug 04 18:02:52.985749 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3626/7219] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:52 2022] GET /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:54.006831 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8f85de03-99f2-42cf-824b-50f7892492e0 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:54.007505 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8f85de03-99f2-42cf-824b-50f7892492e0 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 058670d2-068f-46aa-8c56-4870b874a892] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:54.014920 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f85de03-99f2-42cf-824b-50f7892492e0 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:54.015472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f85de03-99f2-42cf-824b-50f7892492e0 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:54.015932 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f85de03-99f2-42cf-824b-50f7892492e0 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:54.016682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f85de03-99f2-42cf-824b-50f7892492e0 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:54.017145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f85de03-99f2-42cf-824b-50f7892492e0 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:54.017590 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f85de03-99f2-42cf-824b-50f7892492e0 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:54.156795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8f85de03-99f2-42cf-824b-50f7892492e0 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:54.164661 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8f85de03-99f2-42cf-824b-50f7892492e0 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892" status: 200 len: 1317 microversion: 2.1 time: 0.161913 Aug 04 18:02:54.165281 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3594/7220] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:54 2022] GET /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:55.188327 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-57937e02-6ee8-4719-9b08-6ff9df6c60ee tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:55.189066 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-57937e02-6ee8-4719-9b08-6ff9df6c60ee tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 058670d2-068f-46aa-8c56-4870b874a892] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:55.196379 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57937e02-6ee8-4719-9b08-6ff9df6c60ee tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:55.196892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57937e02-6ee8-4719-9b08-6ff9df6c60ee tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:55.197344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57937e02-6ee8-4719-9b08-6ff9df6c60ee tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:55.198117 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57937e02-6ee8-4719-9b08-6ff9df6c60ee tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:55.198586 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57937e02-6ee8-4719-9b08-6ff9df6c60ee tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:55.199019 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57937e02-6ee8-4719-9b08-6ff9df6c60ee tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:55.391996 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-57937e02-6ee8-4719-9b08-6ff9df6c60ee tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:55.400946 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-57937e02-6ee8-4719-9b08-6ff9df6c60ee tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892" status: 200 len: 1317 microversion: 2.1 time: 0.217698 Aug 04 18:02:55.401544 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3627/7221] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:55 2022] GET /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892 => generated 1317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:55.648804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b6b4e530-5655-46b9-adc8-66d5aa0d4643 req-a174b159-2b2e-41fa-a832-956001c78e51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "058670d2-068f-46aa-8c56-4870b874a892", "name": "network-vif-plugged", "status": "completed", "tag": "dab8d6fb-1524-4d39-88d2-0f3e171895f7"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:02:55.668506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b6b4e530-5655-46b9-adc8-66d5aa0d4643 req-a174b159-2b2e-41fa-a832-956001c78e51 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:55.670014 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b6b4e530-5655-46b9-adc8-66d5aa0d4643 req-a174b159-2b2e-41fa-a832-956001c78e51 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:55.670846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b6b4e530-5655-46b9-adc8-66d5aa0d4643 req-a174b159-2b2e-41fa-a832-956001c78e51 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:55.694545 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b6b4e530-5655-46b9-adc8-66d5aa0d4643 req-a174b159-2b2e-41fa-a832-956001c78e51 service nova] Creating event network-vif-plugged:dab8d6fb-1524-4d39-88d2-0f3e171895f7 for instance 058670d2-068f-46aa-8c56-4870b874a892 on n-h1-851359-3 Aug 04 18:02:55.704289 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b6b4e530-5655-46b9-adc8-66d5aa0d4643 req-a174b159-2b2e-41fa-a832-956001c78e51 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062766 Aug 04 18:02:55.705849 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3595/7222] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:02:56.430182 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-317f0556-0871-42fc-8fac-9cf43aa90b16 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:56.431292 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-317f0556-0871-42fc-8fac-9cf43aa90b16 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 058670d2-068f-46aa-8c56-4870b874a892] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:56.443126 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-317f0556-0871-42fc-8fac-9cf43aa90b16 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:56.443986 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-317f0556-0871-42fc-8fac-9cf43aa90b16 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:56.444770 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-317f0556-0871-42fc-8fac-9cf43aa90b16 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:56.445900 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-317f0556-0871-42fc-8fac-9cf43aa90b16 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:56.446729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-317f0556-0871-42fc-8fac-9cf43aa90b16 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:56.447496 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-317f0556-0871-42fc-8fac-9cf43aa90b16 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:56.696136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-317f0556-0871-42fc-8fac-9cf43aa90b16 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:56.709552 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-317f0556-0871-42fc-8fac-9cf43aa90b16 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892" status: 200 len: 1317 microversion: 2.1 time: 0.286266 Aug 04 18:02:56.710627 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3628/7223] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:56 2022] GET /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892 => generated 1317 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:57.748572 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eabe80a7-694e-409c-99f3-8517cabe179e tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:57.749866 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eabe80a7-694e-409c-99f3-8517cabe179e tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 058670d2-068f-46aa-8c56-4870b874a892] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:57.761079 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eabe80a7-694e-409c-99f3-8517cabe179e tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:57.762029 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eabe80a7-694e-409c-99f3-8517cabe179e tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:57.762863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eabe80a7-694e-409c-99f3-8517cabe179e tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:57.764206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eabe80a7-694e-409c-99f3-8517cabe179e tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:57.765080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eabe80a7-694e-409c-99f3-8517cabe179e tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:57.765899 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eabe80a7-694e-409c-99f3-8517cabe179e tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:57.987910 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eabe80a7-694e-409c-99f3-8517cabe179e tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:58.002924 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eabe80a7-694e-409c-99f3-8517cabe179e tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892" status: 200 len: 1505 microversion: 2.1 time: 0.263211 Aug 04 18:02:58.004040 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3596/7224] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:57 2022] GET /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892 => generated 1505 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:02:58.039504 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e311c10f-29c9-47ec-8638-0acb6ab234df tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:58.040386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e311c10f-29c9-47ec-8638-0acb6ab234df tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 058670d2-068f-46aa-8c56-4870b874a892] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:58.052684 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e311c10f-29c9-47ec-8638-0acb6ab234df tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:58.053264 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e311c10f-29c9-47ec-8638-0acb6ab234df tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:58.053819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e311c10f-29c9-47ec-8638-0acb6ab234df tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:58.054784 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e311c10f-29c9-47ec-8638-0acb6ab234df tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:58.055518 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e311c10f-29c9-47ec-8638-0acb6ab234df tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:58.056134 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e311c10f-29c9-47ec-8638-0acb6ab234df tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:58.094959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e311c10f-29c9-47ec-8638-0acb6ab234df tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 058670d2-068f-46aa-8c56-4870b874a892] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 18:02:58.100713 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:02:58.122177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:02:58.244073 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e311c10f-29c9-47ec-8638-0acb6ab234df tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "DELETE /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892" status: 204 len: 0 microversion: 2.1 time: 0.210454 Aug 04 18:02:58.245502 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3629/7225] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 18:02:58 2022] DELETE /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 18:02:58.259997 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-90d1f373-54eb-4952-9926-dd92458f496f tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:58.261250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-90d1f373-54eb-4952-9926-dd92458f496f tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 058670d2-068f-46aa-8c56-4870b874a892] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:58.267422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:02:58.275942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90d1f373-54eb-4952-9926-dd92458f496f tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:58.276943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90d1f373-54eb-4952-9926-dd92458f496f tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:58.277938 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90d1f373-54eb-4952-9926-dd92458f496f tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:58.280514 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90d1f373-54eb-4952-9926-dd92458f496f tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:58.281519 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90d1f373-54eb-4952-9926-dd92458f496f tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:58.282548 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90d1f373-54eb-4952-9926-dd92458f496f tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:58.512752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-90d1f373-54eb-4952-9926-dd92458f496f tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:58.521936 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-90d1f373-54eb-4952-9926-dd92458f496f tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892" status: 200 len: 1511 microversion: 2.1 time: 0.269916 Aug 04 18:02:58.522604 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3597/7226] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:58 2022] GET /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892 => generated 1511 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:02:59.549320 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5335db15-0d72-4065-b39f-594ecc5e7465 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:02:59.550792 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5335db15-0d72-4065-b39f-594ecc5e7465 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 058670d2-068f-46aa-8c56-4870b874a892] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:02:59.565239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5335db15-0d72-4065-b39f-594ecc5e7465 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:59.566182 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5335db15-0d72-4065-b39f-594ecc5e7465 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:59.567053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5335db15-0d72-4065-b39f-594ecc5e7465 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:59.568419 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5335db15-0d72-4065-b39f-594ecc5e7465 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:02:59.569247 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5335db15-0d72-4065-b39f-594ecc5e7465 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:02:59.570086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5335db15-0d72-4065-b39f-594ecc5e7465 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:02:59.819166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5335db15-0d72-4065-b39f-594ecc5e7465 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:02:59.832847 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5335db15-0d72-4065-b39f-594ecc5e7465 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892" status: 200 len: 1511 microversion: 2.1 time: 0.292721 Aug 04 18:02:59.833579 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3630/7227] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:02:59 2022] GET /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892 => generated 1511 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:03:00.456703 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-08c4ae45-0f8f-43b6-b115-8043430fdf7f req-7bd0b1c0-4428-4229-8baa-4dccd184173b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "058670d2-068f-46aa-8c56-4870b874a892", "name": "network-vif-deleted", "tag": "dab8d6fb-1524-4d39-88d2-0f3e171895f7"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:03:00.505498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-08c4ae45-0f8f-43b6-b115-8043430fdf7f req-7bd0b1c0-4428-4229-8baa-4dccd184173b service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:00.507315 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-08c4ae45-0f8f-43b6-b115-8043430fdf7f req-7bd0b1c0-4428-4229-8baa-4dccd184173b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:00.508708 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-08c4ae45-0f8f-43b6-b115-8043430fdf7f req-7bd0b1c0-4428-4229-8baa-4dccd184173b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:00.541696 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-08c4ae45-0f8f-43b6-b115-8043430fdf7f req-7bd0b1c0-4428-4229-8baa-4dccd184173b service nova] Creating event network-vif-deleted:dab8d6fb-1524-4d39-88d2-0f3e171895f7 for instance 058670d2-068f-46aa-8c56-4870b874a892 on n-h1-851359-3 Aug 04 18:03:00.558475 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-08c4ae45-0f8f-43b6-b115-8043430fdf7f req-7bd0b1c0-4428-4229-8baa-4dccd184173b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119649 Aug 04 18:03:00.562093 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3598/7228] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:03:00.868828 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f960ed48-bdee-4626-b58a-901606d9c59a tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:03:00.869878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f960ed48-bdee-4626-b58a-901606d9c59a tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 058670d2-068f-46aa-8c56-4870b874a892] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:03:00.879256 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f960ed48-bdee-4626-b58a-901606d9c59a tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:00.880091 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f960ed48-bdee-4626-b58a-901606d9c59a tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:00.880849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f960ed48-bdee-4626-b58a-901606d9c59a tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:00.881767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f960ed48-bdee-4626-b58a-901606d9c59a tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:00.882536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f960ed48-bdee-4626-b58a-901606d9c59a tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:00.883303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f960ed48-bdee-4626-b58a-901606d9c59a tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:00.935369 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f960ed48-bdee-4626-b58a-901606d9c59a tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:00.935873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f960ed48-bdee-4626-b58a-901606d9c59a tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:00.936316 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f960ed48-bdee-4626-b58a-901606d9c59a tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:00.936776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-f960ed48-bdee-4626-b58a-901606d9c59a tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lazy-loading 'fault' on Instance uuid 058670d2-068f-46aa-8c56-4870b874a892 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 18:03:01.005127 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f960ed48-bdee-4626-b58a-901606d9c59a tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:03:01.019799 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f960ed48-bdee-4626-b58a-901606d9c59a tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892" status: 200 len: 1307 microversion: 2.1 time: 0.158150 Aug 04 18:03:01.021168 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3631/7229] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:03:00 2022] GET /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892 => generated 1307 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:03:02.063307 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f0ef15cb-a53b-47f0-b21e-1236e3eb2290 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:03:02.064574 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f0ef15cb-a53b-47f0-b21e-1236e3eb2290 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 058670d2-068f-46aa-8c56-4870b874a892] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:03:02.067556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:03:02.076031 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0ef15cb-a53b-47f0-b21e-1236e3eb2290 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:02.076558 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0ef15cb-a53b-47f0-b21e-1236e3eb2290 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:02.077083 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0ef15cb-a53b-47f0-b21e-1236e3eb2290 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:02.078106 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0ef15cb-a53b-47f0-b21e-1236e3eb2290 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:02.079216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0ef15cb-a53b-47f0-b21e-1236e3eb2290 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:02.080173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0ef15cb-a53b-47f0-b21e-1236e3eb2290 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:02.091509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=69 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:03:02.113301 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-f0ef15cb-a53b-47f0-b21e-1236e3eb2290 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] HTTP exception thrown: Instance 058670d2-068f-46aa-8c56-4870b874a892 could not be found. Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f0ef15cb-a53b-47f0-b21e-1236e3eb2290 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Request method failure captured: Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892 HTTP/1.1 Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7Am2lzx-ZiIZmh851DhGy45GgcJjx-SbZj7VwnaDTnpjRr55YVXnag6fjlUjuje2vnTozB2iRoAkLkSa96RG2SA9dumYfbvBzAOu4ygGtx0XgxMmNuhgb7Ec1O4ebNSLBIBuImB2ZE3rl6IjpIiEAInE8xNrai0HM8X-lxMOnHZuEjc Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 48997d8c38094beda3352bc2279c87bc Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-2043650177 Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/48997d8c38094beda3352bc2279c87bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/48997d8c38094beda3352bc2279c87bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_48997d8c38094beda3352bc2279c87bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/48997d8c38094beda3352bc2279c87bc"}]}] Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-2043650177 Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 48997d8c38094beda3352bc2279c87bc Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2043650177 Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-2043650177-project Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 7240d2cd85c54f19b8f3e585f6452b46 Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-2043650177-project Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 058670d2-068f-46aa-8c56-4870b874a892 could not be found. Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '058670d2-068f-46aa-8c56-4870b874a892'} Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 058670d2-068f-46aa-8c56-4870b874a892 could not be found. Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 058670d2-068f-46aa-8c56-4870b874a892 could not be found. Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:03:02.116159 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:03:02.125054 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:03:02.125054 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:03:02.125054 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:03:02.125054 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:03:02.125054 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:03:02.125054 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 058670d2-068f-46aa-8c56-4870b874a892 could not be found. Aug 04 18:03:02.125054 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:03:02.125054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f0ef15cb-a53b-47f0-b21e-1236e3eb2290 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Returning 404 to user: Instance 058670d2-068f-46aa-8c56-4870b874a892 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:03:02.125054 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f0ef15cb-a53b-47f0-b21e-1236e3eb2290 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892" status: 404 len: 111 microversion: 2.1 time: 0.064880 Aug 04 18:03:02.125054 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3599/7230] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:03:02 2022] GET /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 18:03:02.144818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d1805401-0e8d-4c94-9aa6-a4e7c5ef428c tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:03:02.145994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d1805401-0e8d-4c94-9aa6-a4e7c5ef428c tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 4bb5edb0-ce65-44f2-997f-513c02779bb3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:03:02.157773 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1805401-0e8d-4c94-9aa6-a4e7c5ef428c tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:02.158677 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1805401-0e8d-4c94-9aa6-a4e7c5ef428c tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:02.159293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1805401-0e8d-4c94-9aa6-a4e7c5ef428c tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:02.160491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1805401-0e8d-4c94-9aa6-a4e7c5ef428c tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:02.161113 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1805401-0e8d-4c94-9aa6-a4e7c5ef428c tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:02.161649 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1805401-0e8d-4c94-9aa6-a4e7c5ef428c tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:02.355458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d1805401-0e8d-4c94-9aa6-a4e7c5ef428c tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:03:02.364310 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d1805401-0e8d-4c94-9aa6-a4e7c5ef428c tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3" status: 200 len: 1505 microversion: 2.1 time: 0.231655 Aug 04 18:03:02.364920 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3632/7231] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:03:02 2022] GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3 => generated 1505 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:03:02.388751 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-309a1c43-1695-4460-b3a8-6470dc5958a3 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:03:02.391481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-309a1c43-1695-4460-b3a8-6470dc5958a3 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 05d1a990-f24c-440e-acd8-228cca591f93] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:03:02.398073 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-309a1c43-1695-4460-b3a8-6470dc5958a3 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] HTTP exception thrown: Instance 05d1a990-f24c-440e-acd8-228cca591f93 could not be found. Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-309a1c43-1695-4460-b3a8-6470dc5958a3 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Request method failure captured: Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/05d1a990-f24c-440e-acd8-228cca591f93/action HTTP/1.1 Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 32 Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7Am2lzx-ZiIZmh851DhGy45GgcJjx-SbZj7VwnaDTnpjRr55YVXnag6fjlUjuje2vnTozB2iRoAkLkSa96RG2SA9dumYfbvBzAOu4ygGtx0XgxMmNuhgb7Ec1O4ebNSLBIBuImB2ZE3rl6IjpIiEAInE8xNrai0HM8X-lxMOnHZuEjc Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 48997d8c38094beda3352bc2279c87bc Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-2043650177 Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/48997d8c38094beda3352bc2279c87bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/48997d8c38094beda3352bc2279c87bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_48997d8c38094beda3352bc2279c87bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/48997d8c38094beda3352bc2279c87bc"}]}] Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-2043650177 Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 48997d8c38094beda3352bc2279c87bc Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2043650177 Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-2043650177-project Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 7240d2cd85c54f19b8f3e585f6452b46 Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-2043650177-project Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: {"resize": {"flavorRef": "452"}} Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 05d1a990-f24c-440e-acd8-228cca591f93 could not be found. Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '05d1a990-f24c-440e-acd8-228cca591f93', 'body': {'resize': {'flavorRef': '452'}}} Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05d1a990-f24c-440e-acd8-228cca591f93 could not be found. Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 18:03:02.399628 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 18:03:02.407065 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05d1a990-f24c-440e-acd8-228cca591f93 could not be found. Aug 04 18:03:02.407065 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:03:02.407065 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:03:02.407065 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:03:02.407065 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:03:02.407065 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:03:02.407065 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:03:02.407065 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:03:02.407065 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:03:02.407065 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05d1a990-f24c-440e-acd8-228cca591f93 could not be found. Aug 04 18:03:02.407065 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:03:02.407065 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-309a1c43-1695-4460-b3a8-6470dc5958a3 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Returning 404 to user: Instance 05d1a990-f24c-440e-acd8-228cca591f93 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:03:02.407065 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-309a1c43-1695-4460-b3a8-6470dc5958a3 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "POST /compute/v2.1/servers/05d1a990-f24c-440e-acd8-228cca591f93/action" status: 404 len: 111 microversion: 2.1 time: 0.018791 Aug 04 18:03:02.407065 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3600/7232] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:03:02 2022] POST /compute/v2.1/servers/05d1a990-f24c-440e-acd8-228cca591f93/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 18:03:02.413947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4c27686e-5b6b-4d66-b9d3-29937adb5701 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:03:02.415099 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4c27686e-5b6b-4d66-b9d3-29937adb5701 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 4bb5edb0-ce65-44f2-997f-513c02779bb3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:03:02.425243 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c27686e-5b6b-4d66-b9d3-29937adb5701 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:02.426166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c27686e-5b6b-4d66-b9d3-29937adb5701 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:02.426630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c27686e-5b6b-4d66-b9d3-29937adb5701 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:02.427663 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c27686e-5b6b-4d66-b9d3-29937adb5701 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:02.428463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c27686e-5b6b-4d66-b9d3-29937adb5701 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:02.429225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c27686e-5b6b-4d66-b9d3-29937adb5701 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:02.462350 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:03:02.644514 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4c27686e-5b6b-4d66-b9d3-29937adb5701 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:03:02.658014 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4c27686e-5b6b-4d66-b9d3-29937adb5701 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3" status: 200 len: 1505 microversion: 2.1 time: 0.250360 Aug 04 18:03:02.658852 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3633/7233] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:03:02 2022] GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3 => generated 1505 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:03:02.684914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f0246e5c-b2d7-417a-b6e9-4c1de237b04d tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:03:02.687471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f0246e5c-b2d7-417a-b6e9-4c1de237b04d tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 4bb5edb0-ce65-44f2-997f-513c02779bb3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:03:02.698322 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0246e5c-b2d7-417a-b6e9-4c1de237b04d tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:02.699037 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0246e5c-b2d7-417a-b6e9-4c1de237b04d tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:02.699715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0246e5c-b2d7-417a-b6e9-4c1de237b04d tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:02.701262 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0246e5c-b2d7-417a-b6e9-4c1de237b04d tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:02.702181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0246e5c-b2d7-417a-b6e9-4c1de237b04d tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:02.702827 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0246e5c-b2d7-417a-b6e9-4c1de237b04d tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:02.890798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f0246e5c-b2d7-417a-b6e9-4c1de237b04d tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:03:02.904064 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f0246e5c-b2d7-417a-b6e9-4c1de237b04d tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3" status: 200 len: 1505 microversion: 2.1 time: 0.225165 Aug 04 18:03:02.905169 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3601/7234] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:03:02 2022] GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3 => generated 1505 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:03:02.939326 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ee2ed6f4-b662-468f-9ed4-eeaf49c380f8 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "ecfd4a05-f652-4491-bde0-36b04ed49e64"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:03:02.943501 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ee2ed6f4-b662-468f-9ed4-eeaf49c380f8 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 4bb5edb0-ce65-44f2-997f-513c02779bb3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:03:02.955539 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee2ed6f4-b662-468f-9ed4-eeaf49c380f8 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:02.956581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee2ed6f4-b662-468f-9ed4-eeaf49c380f8 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:02.957400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee2ed6f4-b662-468f-9ed4-eeaf49c380f8 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:02.958900 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee2ed6f4-b662-468f-9ed4-eeaf49c380f8 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:02.959716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee2ed6f4-b662-468f-9ed4-eeaf49c380f8 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:02.960303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ee2ed6f4-b662-468f-9ed4-eeaf49c380f8 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:03.052115 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ee2ed6f4-b662-468f-9ed4-eeaf49c380f8 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:03:03.063505 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-ee2ed6f4-b662-468f-9ed4-eeaf49c380f8 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] HTTP exception thrown: Flavor ecfd4a05-f652-4491-bde0-36b04ed49e64 could not be found. Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ee2ed6f4-b662-468f-9ed4-eeaf49c380f8 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Request method failure captured: Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: request: POST /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3/action HTTP/1.1 Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 65 Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7Am2lzx-ZiIZmh851DhGy45GgcJjx-SbZj7VwnaDTnpjRr55YVXnag6fjlUjuje2vnTozB2iRoAkLkSa96RG2SA9dumYfbvBzAOu4ygGtx0XgxMmNuhgb7Ec1O4ebNSLBIBuImB2ZE3rl6IjpIiEAInE8xNrai0HM8X-lxMOnHZuEjc Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 48997d8c38094beda3352bc2279c87bc Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersNegativeTestJSON-2043650177 Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/48997d8c38094beda3352bc2279c87bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/48997d8c38094beda3352bc2279c87bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_48997d8c38094beda3352bc2279c87bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/48997d8c38094beda3352bc2279c87bc"}]}] Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersNegativeTestJSON-2043650177 Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 48997d8c38094beda3352bc2279c87bc Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2043650177 Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersNegativeTestJSON-2043650177-project Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 7240d2cd85c54f19b8f3e585f6452b46 Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersNegativeTestJSON-2043650177-project Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: {"resize": {"flavorRef": "ecfd4a05-f652-4491-bde0-36b04ed49e64"}} Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: exception: Flavor ecfd4a05-f652-4491-bde0-36b04ed49e64 could not be found. Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '4bb5edb0-ce65-44f2-997f-513c02779bb3', 'body': {'resize': {'flavorRef': 'ecfd4a05-f652-4491-bde0-36b04ed49e64'}}} Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4148, in resize Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 18:03:03.067631 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor ecfd4a05-f652-4491-bde0-36b04ed49e64 could not be found. Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor ecfd4a05-f652-4491-bde0-36b04ed49e64 could not be found. Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor ecfd4a05-f652-4491-bde0-36b04ed49e64 could not be found. Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ee2ed6f4-b662-468f-9ed4-eeaf49c380f8 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Returning 400 to user: Flavor ecfd4a05-f652-4491-bde0-36b04ed49e64 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ee2ed6f4-b662-468f-9ed4-eeaf49c380f8 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "POST /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3/action" status: 400 len: 107 microversion: 2.1 time: 0.137944 Aug 04 18:03:03.075891 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3634/7235] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:03:02 2022] POST /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3/action => generated 107 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 18:03:03.089455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6f952692-33ce-463d-88f9-c7832cdde3f4 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:03:03.090488 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6f952692-33ce-463d-88f9-c7832cdde3f4 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 4bb5edb0-ce65-44f2-997f-513c02779bb3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:03:03.099405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f952692-33ce-463d-88f9-c7832cdde3f4 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:03.099837 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f952692-33ce-463d-88f9-c7832cdde3f4 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:03.100303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f952692-33ce-463d-88f9-c7832cdde3f4 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:03.101098 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f952692-33ce-463d-88f9-c7832cdde3f4 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:03.101604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f952692-33ce-463d-88f9-c7832cdde3f4 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:03.102146 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f952692-33ce-463d-88f9-c7832cdde3f4 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:03.274326 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6f952692-33ce-463d-88f9-c7832cdde3f4 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:03:03.289676 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6f952692-33ce-463d-88f9-c7832cdde3f4 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3" status: 200 len: 1505 microversion: 2.1 time: 0.210365 Aug 04 18:03:03.291196 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3602/7236] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:03:03 2022] GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3 => generated 1505 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:03:03.317217 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d102053e-7889-4aa6-a6d0-f6da7a52af20 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:03:03.322319 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d102053e-7889-4aa6-a6d0-f6da7a52af20 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 4bb5edb0-ce65-44f2-997f-513c02779bb3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:03:03.325753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:03:03.334658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d102053e-7889-4aa6-a6d0-f6da7a52af20 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:03.335409 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d102053e-7889-4aa6-a6d0-f6da7a52af20 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:03.336010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d102053e-7889-4aa6-a6d0-f6da7a52af20 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:03.336842 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d102053e-7889-4aa6-a6d0-f6da7a52af20 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:03.337352 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d102053e-7889-4aa6-a6d0-f6da7a52af20 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:03.337834 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d102053e-7889-4aa6-a6d0-f6da7a52af20 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:03.523706 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d102053e-7889-4aa6-a6d0-f6da7a52af20 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:03:03.538273 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d102053e-7889-4aa6-a6d0-f6da7a52af20 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3" status: 200 len: 1505 microversion: 2.1 time: 0.226932 Aug 04 18:03:03.539320 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3635/7237] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:03:03 2022] GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3 => generated 1505 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:03:03.586821 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-709b4dbe-7fdc-47fe-9950-6b044e7b57f1 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-709b4dbe-7fdc-47fe-9950-6b044e7b57f1 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Request method failure captured: Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3/action HTTP/1.1 Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 29 Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7Am2lzx-ZiIZmh851DhGy45GgcJjx-SbZj7VwnaDTnpjRr55YVXnag6fjlUjuje2vnTozB2iRoAkLkSa96RG2SA9dumYfbvBzAOu4ygGtx0XgxMmNuhgb7Ec1O4ebNSLBIBuImB2ZE3rl6IjpIiEAInE8xNrai0HM8X-lxMOnHZuEjc Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 48997d8c38094beda3352bc2279c87bc Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-2043650177 Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/48997d8c38094beda3352bc2279c87bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/48997d8c38094beda3352bc2279c87bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_48997d8c38094beda3352bc2279c87bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/48997d8c38094beda3352bc2279c87bc"}]}] Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-2043650177 Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 48997d8c38094beda3352bc2279c87bc Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2043650177 Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-2043650177-project Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 7240d2cd85c54f19b8f3e585f6452b46 Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-2043650177-project Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: {"resize": {"flavorRef": ""}} Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '4bb5edb0-ce65-44f2-997f-513c02779bb3', 'body': {'resize': {'flavorRef': ''}}} Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi '' Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:03:03.592069 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:03:03.604474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:03:03.604474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:03:03.604474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:03:03.604474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:03:03.604474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 18:03:03.604474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 18:03:03.604474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 04 18:03:03.604474 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:03:03.604474 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-709b4dbe-7fdc-47fe-9950-6b044e7b57f1 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:03:03.604474 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-709b4dbe-7fdc-47fe-9950-6b044e7b57f1 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "POST /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3/action" status: 400 len: 113 microversion: 2.1 time: 0.013306 Aug 04 18:03:03.604474 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3603/7238] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:03:03 2022] POST /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3/action => generated 113 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 04 18:03:03.612363 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-350abd59-28d4-425a-b52c-e468424782fd tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:03:03.614582 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-350abd59-28d4-425a-b52c-e468424782fd tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 4bb5edb0-ce65-44f2-997f-513c02779bb3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:03:03.623605 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-350abd59-28d4-425a-b52c-e468424782fd tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:03.624165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-350abd59-28d4-425a-b52c-e468424782fd tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:03.624644 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-350abd59-28d4-425a-b52c-e468424782fd tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:03.625447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-350abd59-28d4-425a-b52c-e468424782fd tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:03.625922 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-350abd59-28d4-425a-b52c-e468424782fd tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:03.626384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-350abd59-28d4-425a-b52c-e468424782fd tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:03.814144 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-350abd59-28d4-425a-b52c-e468424782fd tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:03:03.834958 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-350abd59-28d4-425a-b52c-e468424782fd tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3" status: 200 len: 1505 microversion: 2.1 time: 0.229234 Aug 04 18:03:03.835973 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3636/7239] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:03:03 2022] GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3 => generated 1505 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:03:03.879327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c5f26920-cb9d-41db-b35d-28807c612ef8 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:03:03.880000 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c5f26920-cb9d-41db-b35d-28807c612ef8 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 058670d2-068f-46aa-8c56-4870b874a892] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:03:03.891716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5f26920-cb9d-41db-b35d-28807c612ef8 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:03.892587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5f26920-cb9d-41db-b35d-28807c612ef8 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:03.893120 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5f26920-cb9d-41db-b35d-28807c612ef8 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:03.894264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5f26920-cb9d-41db-b35d-28807c612ef8 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:03.894864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5f26920-cb9d-41db-b35d-28807c612ef8 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:03.896530 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5f26920-cb9d-41db-b35d-28807c612ef8 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:03.916416 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-c5f26920-cb9d-41db-b35d-28807c612ef8 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] HTTP exception thrown: Instance 058670d2-068f-46aa-8c56-4870b874a892 could not be found. Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c5f26920-cb9d-41db-b35d-28807c612ef8 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Request method failure captured: Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892 HTTP/1.1 Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7Am2lzx-ZiIZmh851DhGy45GgcJjx-SbZj7VwnaDTnpjRr55YVXnag6fjlUjuje2vnTozB2iRoAkLkSa96RG2SA9dumYfbvBzAOu4ygGtx0XgxMmNuhgb7Ec1O4ebNSLBIBuImB2ZE3rl6IjpIiEAInE8xNrai0HM8X-lxMOnHZuEjc Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 48997d8c38094beda3352bc2279c87bc Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-2043650177 Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/48997d8c38094beda3352bc2279c87bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/48997d8c38094beda3352bc2279c87bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_48997d8c38094beda3352bc2279c87bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/48997d8c38094beda3352bc2279c87bc"}]}] Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-2043650177 Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 48997d8c38094beda3352bc2279c87bc Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2043650177 Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-2043650177-project Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 7240d2cd85c54f19b8f3e585f6452b46 Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-2043650177-project Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 058670d2-068f-46aa-8c56-4870b874a892 could not be found. Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '058670d2-068f-46aa-8c56-4870b874a892'} Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 058670d2-068f-46aa-8c56-4870b874a892 could not be found. Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 18:03:03.918374 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 18:03:03.926524 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 058670d2-068f-46aa-8c56-4870b874a892 could not be found. Aug 04 18:03:03.926524 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:03:03.926524 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:03:03.926524 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:03:03.926524 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:03:03.926524 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:03:03.926524 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:03:03.926524 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:03:03.926524 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:03:03.926524 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 058670d2-068f-46aa-8c56-4870b874a892 could not be found. Aug 04 18:03:03.926524 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:03:03.926524 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c5f26920-cb9d-41db-b35d-28807c612ef8 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Returning 404 to user: Instance 058670d2-068f-46aa-8c56-4870b874a892 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:03:03.926524 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c5f26920-cb9d-41db-b35d-28807c612ef8 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "DELETE /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892" status: 404 len: 111 microversion: 2.1 time: 0.046533 Aug 04 18:03:03.926524 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3604/7240] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 18:03:03 2022] DELETE /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 18:03:03.938401 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-165192f9-c4b7-4ee1-92c4-d47b39c8f216 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:03:03.939478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-165192f9-c4b7-4ee1-92c4-d47b39c8f216 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 058670d2-068f-46aa-8c56-4870b874a892] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:03:03.946334 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-165192f9-c4b7-4ee1-92c4-d47b39c8f216 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:03.946872 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-165192f9-c4b7-4ee1-92c4-d47b39c8f216 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:03.947381 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-165192f9-c4b7-4ee1-92c4-d47b39c8f216 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:03.948563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-165192f9-c4b7-4ee1-92c4-d47b39c8f216 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:03.949395 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-165192f9-c4b7-4ee1-92c4-d47b39c8f216 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:03.950205 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-165192f9-c4b7-4ee1-92c4-d47b39c8f216 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:03.972509 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-165192f9-c4b7-4ee1-92c4-d47b39c8f216 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] HTTP exception thrown: Instance 058670d2-068f-46aa-8c56-4870b874a892 could not be found. Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-165192f9-c4b7-4ee1-92c4-d47b39c8f216 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Request method failure captured: Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892 HTTP/1.1 Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7Am2lzx-ZiIZmh851DhGy45GgcJjx-SbZj7VwnaDTnpjRr55YVXnag6fjlUjuje2vnTozB2iRoAkLkSa96RG2SA9dumYfbvBzAOu4ygGtx0XgxMmNuhgb7Ec1O4ebNSLBIBuImB2ZE3rl6IjpIiEAInE8xNrai0HM8X-lxMOnHZuEjc Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 48997d8c38094beda3352bc2279c87bc Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersNegativeTestJSON-2043650177 Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/48997d8c38094beda3352bc2279c87bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/48997d8c38094beda3352bc2279c87bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_48997d8c38094beda3352bc2279c87bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/48997d8c38094beda3352bc2279c87bc"}]}] Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersNegativeTestJSON-2043650177 Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 48997d8c38094beda3352bc2279c87bc Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2043650177 Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersNegativeTestJSON-2043650177-project Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 7240d2cd85c54f19b8f3e585f6452b46 Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersNegativeTestJSON-2043650177-project Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 058670d2-068f-46aa-8c56-4870b874a892 could not be found. Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '058670d2-068f-46aa-8c56-4870b874a892'} Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 058670d2-068f-46aa-8c56-4870b874a892 could not be found. Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 058670d2-068f-46aa-8c56-4870b874a892 could not be found. Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:03:03.974485 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:03:03.980790 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:03:03.980790 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:03:03.980790 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:03:03.980790 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:03:03.980790 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:03:03.980790 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 058670d2-068f-46aa-8c56-4870b874a892 could not be found. Aug 04 18:03:03.980790 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:03:03.980790 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-165192f9-c4b7-4ee1-92c4-d47b39c8f216 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Returning 404 to user: Instance 058670d2-068f-46aa-8c56-4870b874a892 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:03:03.980790 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-165192f9-c4b7-4ee1-92c4-d47b39c8f216 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892" status: 404 len: 111 microversion: 2.1 time: 0.046073 Aug 04 18:03:03.980790 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3637/7241] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:03:03 2022] GET /compute/v2.1/servers/058670d2-068f-46aa-8c56-4870b874a892 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 18:03:03.988404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-843cf835-1d73-4827-824e-539dd4a383ae tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:03:03.988881 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-843cf835-1d73-4827-824e-539dd4a383ae tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 4bb5edb0-ce65-44f2-997f-513c02779bb3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:03:03.996032 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-843cf835-1d73-4827-824e-539dd4a383ae tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:03.999197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-843cf835-1d73-4827-824e-539dd4a383ae tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:03.999197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-843cf835-1d73-4827-824e-539dd4a383ae tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:03.999197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-843cf835-1d73-4827-824e-539dd4a383ae tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:03.999197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-843cf835-1d73-4827-824e-539dd4a383ae tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:03.999197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-843cf835-1d73-4827-824e-539dd4a383ae tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:04.031825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-843cf835-1d73-4827-824e-539dd4a383ae tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 4bb5edb0-ce65-44f2-997f-513c02779bb3] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 18:03:04.137855 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-843cf835-1d73-4827-824e-539dd4a383ae tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3" status: 204 len: 0 microversion: 2.1 time: 0.153665 Aug 04 18:03:04.138973 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3605/7242] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 18:03:03 2022] DELETE /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 18:03:04.149473 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-de3f6927-65d6-47c4-92cf-b7a6d935c451 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:03:04.150228 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-de3f6927-65d6-47c4-92cf-b7a6d935c451 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 4bb5edb0-ce65-44f2-997f-513c02779bb3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:03:04.157104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de3f6927-65d6-47c4-92cf-b7a6d935c451 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:04.157639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de3f6927-65d6-47c4-92cf-b7a6d935c451 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:04.158276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de3f6927-65d6-47c4-92cf-b7a6d935c451 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:04.158986 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de3f6927-65d6-47c4-92cf-b7a6d935c451 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:04.159547 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de3f6927-65d6-47c4-92cf-b7a6d935c451 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:04.160124 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-de3f6927-65d6-47c4-92cf-b7a6d935c451 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:04.368485 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-de3f6927-65d6-47c4-92cf-b7a6d935c451 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:03:04.384630 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-de3f6927-65d6-47c4-92cf-b7a6d935c451 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3" status: 200 len: 1511 microversion: 2.1 time: 0.239408 Aug 04 18:03:04.385395 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3638/7243] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:03:04 2022] GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3 => generated 1511 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:03:05.423018 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-04976e18-fb22-4aa1-8d82-6c46d403b700 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:03:05.423949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-04976e18-fb22-4aa1-8d82-6c46d403b700 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 4bb5edb0-ce65-44f2-997f-513c02779bb3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:03:05.435239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04976e18-fb22-4aa1-8d82-6c46d403b700 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:05.436040 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04976e18-fb22-4aa1-8d82-6c46d403b700 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:05.436775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04976e18-fb22-4aa1-8d82-6c46d403b700 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:05.437998 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04976e18-fb22-4aa1-8d82-6c46d403b700 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:05.438796 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04976e18-fb22-4aa1-8d82-6c46d403b700 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:05.439560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04976e18-fb22-4aa1-8d82-6c46d403b700 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:05.671851 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-04976e18-fb22-4aa1-8d82-6c46d403b700 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:03:05.692067 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-04976e18-fb22-4aa1-8d82-6c46d403b700 tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3" status: 200 len: 1511 microversion: 2.1 time: 0.273905 Aug 04 18:03:05.692552 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3606/7244] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:03:05 2022] GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3 => generated 1511 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:03:06.709210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-45a457a9-8cba-4a70-a6d8-2e6262c40ec5 req-08a24a69-f1c2-4151-b23a-6453a13bc3be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bb5edb0-ce65-44f2-997f-513c02779bb3", "name": "network-vif-deleted", "tag": "76bfa4a1-bd67-4d4d-b171-a3c7fcc79df1"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:03:06.733389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2d3fd382-e9d4-40f6-a39d-ee3dc53fbc6a tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:03:06.734739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2d3fd382-e9d4-40f6-a39d-ee3dc53fbc6a tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 4bb5edb0-ce65-44f2-997f-513c02779bb3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:03:06.745012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-45a457a9-8cba-4a70-a6d8-2e6262c40ec5 req-08a24a69-f1c2-4151-b23a-6453a13bc3be service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:06.746147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-45a457a9-8cba-4a70-a6d8-2e6262c40ec5 req-08a24a69-f1c2-4151-b23a-6453a13bc3be service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:06.746376 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d3fd382-e9d4-40f6-a39d-ee3dc53fbc6a tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:06.747063 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-45a457a9-8cba-4a70-a6d8-2e6262c40ec5 req-08a24a69-f1c2-4151-b23a-6453a13bc3be service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:06.748511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d3fd382-e9d4-40f6-a39d-ee3dc53fbc6a tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:06.749455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d3fd382-e9d4-40f6-a39d-ee3dc53fbc6a tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:06.751138 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d3fd382-e9d4-40f6-a39d-ee3dc53fbc6a tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:06.752160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d3fd382-e9d4-40f6-a39d-ee3dc53fbc6a tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:06.753240 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d3fd382-e9d4-40f6-a39d-ee3dc53fbc6a tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:06.768367 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-45a457a9-8cba-4a70-a6d8-2e6262c40ec5 req-08a24a69-f1c2-4151-b23a-6453a13bc3be service nova] Creating event network-vif-deleted:76bfa4a1-bd67-4d4d-b171-a3c7fcc79df1 for instance 4bb5edb0-ce65-44f2-997f-513c02779bb3 on n-h2-851359-3 Aug 04 18:03:06.777636 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-45a457a9-8cba-4a70-a6d8-2e6262c40ec5 req-08a24a69-f1c2-4151-b23a-6453a13bc3be service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072905 Aug 04 18:03:06.779633 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3639/7245] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:03:06.871025 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2d3fd382-e9d4-40f6-a39d-ee3dc53fbc6a tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7240d2cd85c54f19b8f3e585f6452b46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48997d8c38094beda3352bc2279c87bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:03:06.881689 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2d3fd382-e9d4-40f6-a39d-ee3dc53fbc6a tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3" status: 200 len: 1302 microversion: 2.1 time: 0.155766 Aug 04 18:03:06.882628 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3607/7246] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:03:06 2022] GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3 => generated 1302 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:03:07.920128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dfdb95aa-409c-46c6-858c-7d0d19e403af tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:03:07.921437 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dfdb95aa-409c-46c6-858c-7d0d19e403af tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] [instance: 4bb5edb0-ce65-44f2-997f-513c02779bb3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:03:07.931453 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfdb95aa-409c-46c6-858c-7d0d19e403af tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:07.932052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfdb95aa-409c-46c6-858c-7d0d19e403af tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:07.932560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfdb95aa-409c-46c6-858c-7d0d19e403af tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:07.933266 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfdb95aa-409c-46c6-858c-7d0d19e403af tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:07.933742 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfdb95aa-409c-46c6-858c-7d0d19e403af tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:07.934262 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dfdb95aa-409c-46c6-858c-7d0d19e403af tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:07.955977 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-dfdb95aa-409c-46c6-858c-7d0d19e403af tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] HTTP exception thrown: Instance 4bb5edb0-ce65-44f2-997f-513c02779bb3 could not be found. Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dfdb95aa-409c-46c6-858c-7d0d19e403af tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Request method failure captured: Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3 HTTP/1.1 Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7Am2lzx-ZiIZmh851DhGy45GgcJjx-SbZj7VwnaDTnpjRr55YVXnag6fjlUjuje2vnTozB2iRoAkLkSa96RG2SA9dumYfbvBzAOu4ygGtx0XgxMmNuhgb7Ec1O4ebNSLBIBuImB2ZE3rl6IjpIiEAInE8xNrai0HM8X-lxMOnHZuEjc Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 48997d8c38094beda3352bc2279c87bc Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-ServersNegativeTestJSON-2043650177 Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/48997d8c38094beda3352bc2279c87bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/48997d8c38094beda3352bc2279c87bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_48997d8c38094beda3352bc2279c87bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/48997d8c38094beda3352bc2279c87bc"}]}] Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-ServersNegativeTestJSON-2043650177 Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 48997d8c38094beda3352bc2279c87bc Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2043650177 Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-ServersNegativeTestJSON-2043650177-project Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 7240d2cd85c54f19b8f3e585f6452b46 Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-ServersNegativeTestJSON-2043650177-project Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 4bb5edb0-ce65-44f2-997f-513c02779bb3 could not be found. Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '4bb5edb0-ce65-44f2-997f-513c02779bb3'} Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bb5edb0-ce65-44f2-997f-513c02779bb3 could not be found. Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bb5edb0-ce65-44f2-997f-513c02779bb3 could not be found. Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:03:07.957938 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:03:07.961916 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:03:07.961916 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:03:07.961916 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:03:07.961916 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:03:07.961916 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:03:07.961916 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bb5edb0-ce65-44f2-997f-513c02779bb3 could not be found. Aug 04 18:03:07.961916 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:03:07.961916 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dfdb95aa-409c-46c6-858c-7d0d19e403af tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] Returning 404 to user: Instance 4bb5edb0-ce65-44f2-997f-513c02779bb3 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:03:07.961916 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dfdb95aa-409c-46c6-858c-7d0d19e403af tempest-ServersNegativeTestJSON-2043650177 tempest-ServersNegativeTestJSON-2043650177-project] 10.222.0.93 "GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3" status: 404 len: 111 microversion: 2.1 time: 0.049846 Aug 04 18:03:07.961916 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3640/7247] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:03:07 2022] GET /compute/v2.1/servers/4bb5edb0-ce65-44f2-997f-513c02779bb3 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 18:03:50.140346 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:03:50.141121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:03:50.344905 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e5f872b9-55a5-43cc-9b6b-6c8c4a0fc8d1 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Action: 'create', calling method: .version_select at 0x7f1e5ab283a0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-101667787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8JQOqm4FrxqlLW+h/2iIkZg33/4rjGcsWYHPSZQWY4Vea59nK6B/5M9W05jVzhER4p7xBE+juqMJxE+tDErrZl62/IrPinDgXMQvrMyc+NL+vPzOmB7LrTZPeB1EefuQ=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:03:50.361654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e5f872b9-55a5-43cc-9b6b-6c8c4a0fc8d1 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Getting quotas for project 86184ad6a9c64d18a82356f3f571f1f4. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 18:03:50.367407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e5f872b9-55a5-43cc-9b6b-6c8c4a0fc8d1 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Getting quotas for user 55a7e47902524f3089a33bf65870229e and project 86184ad6a9c64d18a82356f3f571f1f4. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 18:03:50.405952 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e5f872b9-55a5-43cc-9b6b-6c8c4a0fc8d1 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.271635 Aug 04 18:03:50.406630 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3608/7248] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 18:03:50 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:03:50.462294 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2df910c6-9b40-4fd7-b8fa-894a5a78503c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1109747896", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-101667787", "networks": [{"uuid": "fc0ba368-22b5-4300-bfe5-4bc297708e32"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:03:50.471183 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=11 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:03:50.472130 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=30 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:03:50.537733 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-2df910c6-9b40-4fd7-b8fa-894a5a78503c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] validate_networks() for [('fc0ba368-22b5-4300-bfe5-4bc297708e32', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 18:03:51.072287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-2df910c6-9b40-4fd7-b8fa-894a5a78503c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 18:03:51.072728 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-2df910c6-9b40-4fd7-b8fa-894a5a78503c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 18:03:51.073472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-2df910c6-9b40-4fd7-b8fa-894a5a78503c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 18:03:51.074296 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-2df910c6-9b40-4fd7-b8fa-894a5a78503c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 18:03:51.075003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-2df910c6-9b40-4fd7-b8fa-894a5a78503c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 18:03:51.090420 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2df910c6-9b40-4fd7-b8fa-894a5a78503c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:51.090991 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2df910c6-9b40-4fd7-b8fa-894a5a78503c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:51.091498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2df910c6-9b40-4fd7-b8fa-894a5a78503c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:51.092770 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2df910c6-9b40-4fd7-b8fa-894a5a78503c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:51.093406 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2df910c6-9b40-4fd7-b8fa-894a5a78503c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:51.093960 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2df910c6-9b40-4fd7-b8fa-894a5a78503c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:51.114136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-2df910c6-9b40-4fd7-b8fa-894a5a78503c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Getting quotas for project 86184ad6a9c64d18a82356f3f571f1f4. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 18:03:51.119920 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-2df910c6-9b40-4fd7-b8fa-894a5a78503c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Getting quotas for user 55a7e47902524f3089a33bf65870229e and project 86184ad6a9c64d18a82356f3f571f1f4. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 18:03:51.134571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2df910c6-9b40-4fd7-b8fa-894a5a78503c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 18:03:51.137239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2df910c6-9b40-4fd7-b8fa-894a5a78503c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: e2a4ddb1-c1bc-4281-b581-fc07897edd57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 18:03:51.187693 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2df910c6-9b40-4fd7-b8fa-894a5a78503c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.730655 Aug 04 18:03:51.188930 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3641/7249] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 18:03:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 18:03:51.201417 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0d9b43b2-0e22-49c9-bff3-65a00df18ebc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:03:51.202786 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0d9b43b2-0e22-49c9-bff3-65a00df18ebc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: e2a4ddb1-c1bc-4281-b581-fc07897edd57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:03:51.314730 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0d9b43b2-0e22-49c9-bff3-65a00df18ebc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:03:51.335145 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0d9b43b2-0e22-49c9-bff3-65a00df18ebc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57" status: 200 len: 1262 microversion: 2.1 time: 0.138855 Aug 04 18:03:51.346697 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3609/7250] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:03:51 2022] GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57 => generated 1262 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:03:52.360144 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c13a3571-17b1-434b-b942-8f217b542758 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:03:52.361000 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c13a3571-17b1-434b-b942-8f217b542758 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: e2a4ddb1-c1bc-4281-b581-fc07897edd57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:03:52.370157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c13a3571-17b1-434b-b942-8f217b542758 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:52.371253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c13a3571-17b1-434b-b942-8f217b542758 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:52.372452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c13a3571-17b1-434b-b942-8f217b542758 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:52.373256 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c13a3571-17b1-434b-b942-8f217b542758 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:52.373736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c13a3571-17b1-434b-b942-8f217b542758 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:52.374281 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c13a3571-17b1-434b-b942-8f217b542758 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:52.448862 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c13a3571-17b1-434b-b942-8f217b542758 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:03:52.457730 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c13a3571-17b1-434b-b942-8f217b542758 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57" status: 200 len: 1314 microversion: 2.1 time: 0.103482 Aug 04 18:03:52.458480 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3642/7251] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:03:52 2022] GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57 => generated 1314 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:03:53.483947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8539db4a-aa6f-493e-8cef-edb31ecc916c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:03:53.484713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8539db4a-aa6f-493e-8cef-edb31ecc916c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: e2a4ddb1-c1bc-4281-b581-fc07897edd57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:03:53.492461 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8539db4a-aa6f-493e-8cef-edb31ecc916c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:53.492976 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8539db4a-aa6f-493e-8cef-edb31ecc916c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:53.493434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8539db4a-aa6f-493e-8cef-edb31ecc916c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:53.494222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8539db4a-aa6f-493e-8cef-edb31ecc916c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:53.494699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8539db4a-aa6f-493e-8cef-edb31ecc916c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:53.495630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8539db4a-aa6f-493e-8cef-edb31ecc916c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:53.675431 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8539db4a-aa6f-493e-8cef-edb31ecc916c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:03:53.685357 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8539db4a-aa6f-493e-8cef-edb31ecc916c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57" status: 200 len: 1362 microversion: 2.1 time: 0.210086 Aug 04 18:03:53.685867 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3610/7252] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:03:53 2022] GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57 => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:03:54.256429 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-8c29e909-63f8-476f-b5e9-9add76b24c19 req-545251ce-b151-4c48-8970-0c476643b9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2a4ddb1-c1bc-4281-b581-fc07897edd57", "tag": "6a9fdd2d-7169-4659-a3aa-7836940c1698"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:03:54.280328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8c29e909-63f8-476f-b5e9-9add76b24c19 req-545251ce-b151-4c48-8970-0c476643b9c1 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:54.280986 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8c29e909-63f8-476f-b5e9-9add76b24c19 req-545251ce-b151-4c48-8970-0c476643b9c1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:54.281616 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8c29e909-63f8-476f-b5e9-9add76b24c19 req-545251ce-b151-4c48-8970-0c476643b9c1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:54.303304 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-8c29e909-63f8-476f-b5e9-9add76b24c19 req-545251ce-b151-4c48-8970-0c476643b9c1 service nova] Creating event network-changed:6a9fdd2d-7169-4659-a3aa-7836940c1698 for instance e2a4ddb1-c1bc-4281-b581-fc07897edd57 on n-h1-851359-3 Aug 04 18:03:54.311018 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-8c29e909-63f8-476f-b5e9-9add76b24c19 req-545251ce-b151-4c48-8970-0c476643b9c1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066868 Aug 04 18:03:54.311689 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3643/7253] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:03:54.721799 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e1e4fa85-f626-4d6a-9c99-09201e972137 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:03:54.723060 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e1e4fa85-f626-4d6a-9c99-09201e972137 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: e2a4ddb1-c1bc-4281-b581-fc07897edd57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:03:54.737129 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1e4fa85-f626-4d6a-9c99-09201e972137 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:54.738240 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1e4fa85-f626-4d6a-9c99-09201e972137 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:54.739217 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1e4fa85-f626-4d6a-9c99-09201e972137 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:54.740709 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1e4fa85-f626-4d6a-9c99-09201e972137 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:54.741807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1e4fa85-f626-4d6a-9c99-09201e972137 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:54.742784 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1e4fa85-f626-4d6a-9c99-09201e972137 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:54.964340 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e1e4fa85-f626-4d6a-9c99-09201e972137 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:03:54.972936 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e1e4fa85-f626-4d6a-9c99-09201e972137 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57" status: 200 len: 1362 microversion: 2.1 time: 0.270668 Aug 04 18:03:54.973737 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3611/7254] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:03:54 2022] GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57 => generated 1362 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:03:55.997969 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6fe23176-47c6-4cc8-bcb6-3e368265a564 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:03:55.999260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6fe23176-47c6-4cc8-bcb6-3e368265a564 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: e2a4ddb1-c1bc-4281-b581-fc07897edd57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:03:56.017666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6fe23176-47c6-4cc8-bcb6-3e368265a564 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:56.021438 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6fe23176-47c6-4cc8-bcb6-3e368265a564 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:56.022303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6fe23176-47c6-4cc8-bcb6-3e368265a564 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:56.023675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6fe23176-47c6-4cc8-bcb6-3e368265a564 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:56.024604 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6fe23176-47c6-4cc8-bcb6-3e368265a564 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:56.025901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6fe23176-47c6-4cc8-bcb6-3e368265a564 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:56.278308 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6fe23176-47c6-4cc8-bcb6-3e368265a564 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:03:56.288843 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6fe23176-47c6-4cc8-bcb6-3e368265a564 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57" status: 200 len: 1362 microversion: 2.1 time: 0.296793 Aug 04 18:03:56.289452 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3644/7255] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:03:55 2022] GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57 => generated 1362 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:03:57.331714 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-925bc718-c3ba-4885-bccd-531e0b8c26a1 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:03:57.332879 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-925bc718-c3ba-4885-bccd-531e0b8c26a1 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: e2a4ddb1-c1bc-4281-b581-fc07897edd57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:03:57.342664 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-925bc718-c3ba-4885-bccd-531e0b8c26a1 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:57.343176 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-925bc718-c3ba-4885-bccd-531e0b8c26a1 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:57.343670 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-925bc718-c3ba-4885-bccd-531e0b8c26a1 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:57.344983 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-925bc718-c3ba-4885-bccd-531e0b8c26a1 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:57.345796 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-925bc718-c3ba-4885-bccd-531e0b8c26a1 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:57.346318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-925bc718-c3ba-4885-bccd-531e0b8c26a1 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:57.547179 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-925bc718-c3ba-4885-bccd-531e0b8c26a1 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:03:57.555536 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-925bc718-c3ba-4885-bccd-531e0b8c26a1 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57" status: 200 len: 1362 microversion: 2.1 time: 0.235500 Aug 04 18:03:57.556116 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3612/7256] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:03:57 2022] GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57 => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:03:58.594591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4c2003d3-f02b-49cc-9582-cf53e4193a05 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:03:58.595681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4c2003d3-f02b-49cc-9582-cf53e4193a05 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: e2a4ddb1-c1bc-4281-b581-fc07897edd57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:03:58.611557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c2003d3-f02b-49cc-9582-cf53e4193a05 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:58.612426 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c2003d3-f02b-49cc-9582-cf53e4193a05 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:58.613237 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c2003d3-f02b-49cc-9582-cf53e4193a05 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:58.614395 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c2003d3-f02b-49cc-9582-cf53e4193a05 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:58.615261 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c2003d3-f02b-49cc-9582-cf53e4193a05 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:58.615909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c2003d3-f02b-49cc-9582-cf53e4193a05 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:58.802601 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4c2003d3-f02b-49cc-9582-cf53e4193a05 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:03:58.812976 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4c2003d3-f02b-49cc-9582-cf53e4193a05 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57" status: 200 len: 1362 microversion: 2.1 time: 0.225918 Aug 04 18:03:58.813582 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3645/7257] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:03:58 2022] GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57 => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:03:59.836883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-62125922-de8e-424e-84ae-a0a9f2316bed tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:03:59.838749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-62125922-de8e-424e-84ae-a0a9f2316bed tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: e2a4ddb1-c1bc-4281-b581-fc07897edd57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:03:59.850654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62125922-de8e-424e-84ae-a0a9f2316bed tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:59.851256 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62125922-de8e-424e-84ae-a0a9f2316bed tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:59.851805 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62125922-de8e-424e-84ae-a0a9f2316bed tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:03:59.852618 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62125922-de8e-424e-84ae-a0a9f2316bed tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:03:59.853093 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62125922-de8e-424e-84ae-a0a9f2316bed tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:03:59.853577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62125922-de8e-424e-84ae-a0a9f2316bed tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:00.065318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-62125922-de8e-424e-84ae-a0a9f2316bed tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:04:00.078932 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-62125922-de8e-424e-84ae-a0a9f2316bed tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57" status: 200 len: 1362 microversion: 2.1 time: 0.246795 Aug 04 18:04:00.080343 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3613/7258] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:03:59 2022] GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57 => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:04:00.112534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-829afe40-3bbf-410c-adc5-3366cb6ec8a6 req-1d8c861c-9c58-4cb7-8849-77d3098eab31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a4ddb1-c1bc-4281-b581-fc07897edd57", "name": "network-vif-plugged", "status": "completed", "tag": "6a9fdd2d-7169-4659-a3aa-7836940c1698"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:04:00.136038 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-829afe40-3bbf-410c-adc5-3366cb6ec8a6 req-1d8c861c-9c58-4cb7-8849-77d3098eab31 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:00.137102 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-829afe40-3bbf-410c-adc5-3366cb6ec8a6 req-1d8c861c-9c58-4cb7-8849-77d3098eab31 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:00.138164 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-829afe40-3bbf-410c-adc5-3366cb6ec8a6 req-1d8c861c-9c58-4cb7-8849-77d3098eab31 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:00.154502 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-829afe40-3bbf-410c-adc5-3366cb6ec8a6 req-1d8c861c-9c58-4cb7-8849-77d3098eab31 service nova] Creating event network-vif-plugged:6a9fdd2d-7169-4659-a3aa-7836940c1698 for instance e2a4ddb1-c1bc-4281-b581-fc07897edd57 on n-h1-851359-3 Aug 04 18:04:00.160524 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-829afe40-3bbf-410c-adc5-3366cb6ec8a6 req-1d8c861c-9c58-4cb7-8849-77d3098eab31 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052283 Aug 04 18:04:00.161628 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3646/7259] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:04:01.107021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dd2ef4cf-7c4a-4cf8-949c-c26d1649e26f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:01.107895 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dd2ef4cf-7c4a-4cf8-949c-c26d1649e26f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: e2a4ddb1-c1bc-4281-b581-fc07897edd57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:01.117050 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd2ef4cf-7c4a-4cf8-949c-c26d1649e26f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:01.117678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd2ef4cf-7c4a-4cf8-949c-c26d1649e26f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:01.118234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd2ef4cf-7c4a-4cf8-949c-c26d1649e26f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:01.119303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd2ef4cf-7c4a-4cf8-949c-c26d1649e26f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:01.120127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd2ef4cf-7c4a-4cf8-949c-c26d1649e26f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:01.120869 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd2ef4cf-7c4a-4cf8-949c-c26d1649e26f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:01.307737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dd2ef4cf-7c4a-4cf8-949c-c26d1649e26f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:04:01.317120 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dd2ef4cf-7c4a-4cf8-949c-c26d1649e26f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57" status: 200 len: 1362 microversion: 2.1 time: 0.215223 Aug 04 18:04:01.320429 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3614/7260] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:04:01 2022] GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57 => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:04:02.350758 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ed9d2f45-eb96-484a-aaaa-a9e04952408f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:02.351777 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ed9d2f45-eb96-484a-aaaa-a9e04952408f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: e2a4ddb1-c1bc-4281-b581-fc07897edd57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:02.354894 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:04:02.358020 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:04:02.369117 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed9d2f45-eb96-484a-aaaa-a9e04952408f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:02.369746 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed9d2f45-eb96-484a-aaaa-a9e04952408f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:02.370236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed9d2f45-eb96-484a-aaaa-a9e04952408f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:02.371091 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed9d2f45-eb96-484a-aaaa-a9e04952408f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:02.371576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed9d2f45-eb96-484a-aaaa-a9e04952408f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:02.372087 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed9d2f45-eb96-484a-aaaa-a9e04952408f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:02.613408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ed9d2f45-eb96-484a-aaaa-a9e04952408f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:04:02.626959 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ed9d2f45-eb96-484a-aaaa-a9e04952408f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57" status: 200 len: 1553 microversion: 2.1 time: 0.285174 Aug 04 18:04:02.627885 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3647/7261] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:04:02 2022] GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57 => generated 1553 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:04:02.649001 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7e5ea328-a219-4127-ba94-62bd0cb16884 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:02.649674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7e5ea328-a219-4127-ba94-62bd0cb16884 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: e2a4ddb1-c1bc-4281-b581-fc07897edd57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:02.652358 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:04:02.663677 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e5ea328-a219-4127-ba94-62bd0cb16884 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:02.664429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e5ea328-a219-4127-ba94-62bd0cb16884 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:02.665026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e5ea328-a219-4127-ba94-62bd0cb16884 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:02.665891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e5ea328-a219-4127-ba94-62bd0cb16884 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:02.666490 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e5ea328-a219-4127-ba94-62bd0cb16884 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:02.666941 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e5ea328-a219-4127-ba94-62bd0cb16884 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:02.827682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7e5ea328-a219-4127-ba94-62bd0cb16884 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:04:02.840738 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7e5ea328-a219-4127-ba94-62bd0cb16884 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57" status: 200 len: 1553 microversion: 2.1 time: 0.195663 Aug 04 18:04:02.841823 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3615/7262] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:04:02 2022] GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57 => generated 1553 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:04:05.915866 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1f3d1fbd-6d8c-468d-9b59-3f7a0f65f66a tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89767dbe-b2dc-4912-8da9-77f5bee1f990"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:04:05.919744 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1f3d1fbd-6d8c-468d-9b59-3f7a0f65f66a tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: e2a4ddb1-c1bc-4281-b581-fc07897edd57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:05.940016 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f3d1fbd-6d8c-468d-9b59-3f7a0f65f66a tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:05.940934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f3d1fbd-6d8c-468d-9b59-3f7a0f65f66a tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:05.941718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f3d1fbd-6d8c-468d-9b59-3f7a0f65f66a tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:05.942711 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f3d1fbd-6d8c-468d-9b59-3f7a0f65f66a tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:05.943229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f3d1fbd-6d8c-468d-9b59-3f7a0f65f66a tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:05.943843 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f3d1fbd-6d8c-468d-9b59-3f7a0f65f66a tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:06.334510 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1f3d1fbd-6d8c-468d-9b59-3f7a0f65f66a tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "POST /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.424198 Aug 04 18:04:06.335558 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3648/7263] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Aug 4 18:04:05 2022] POST /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57/os-volume_attachments => generated 194 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:04:18.380614 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5733b9c1-5ad1-4441-b308-d6cdade1ce34 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:18.381323 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5733b9c1-5ad1-4441-b308-d6cdade1ce34 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: e2a4ddb1-c1bc-4281-b581-fc07897edd57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:18.384020 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:04:18.385234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=36 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:04:18.393356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5733b9c1-5ad1-4441-b308-d6cdade1ce34 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:18.393913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5733b9c1-5ad1-4441-b308-d6cdade1ce34 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:18.394413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5733b9c1-5ad1-4441-b308-d6cdade1ce34 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:18.395185 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5733b9c1-5ad1-4441-b308-d6cdade1ce34 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:18.395670 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5733b9c1-5ad1-4441-b308-d6cdade1ce34 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:18.396122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5733b9c1-5ad1-4441-b308-d6cdade1ce34 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:18.487165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-5733b9c1-5ad1-4441-b308-d6cdade1ce34 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lazy-loading 'services' on Instance uuid e2a4ddb1-c1bc-4281-b581-fc07897edd57 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 18:04:18.575914 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5733b9c1-5ad1-4441-b308-d6cdade1ce34 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57/os-volume_attachments/89767dbe-b2dc-4912-8da9-77f5bee1f990" status: 202 len: 0 microversion: 2.1 time: 0.199920 Aug 04 18:04:18.576531 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3616/7264] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Aug 4 18:04:18 2022] DELETE /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57/os-volume_attachments/89767dbe-b2dc-4912-8da9-77f5bee1f990 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 18:04:18.590310 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7d7b7224-ecfe-471d-96f9-a9303ca843f5 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:18.599292 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7d7b7224-ecfe-471d-96f9-a9303ca843f5 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: e2a4ddb1-c1bc-4281-b581-fc07897edd57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:18.602829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:04:18.603715 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:04:18.613040 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d7b7224-ecfe-471d-96f9-a9303ca843f5 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:18.613540 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d7b7224-ecfe-471d-96f9-a9303ca843f5 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:18.614014 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d7b7224-ecfe-471d-96f9-a9303ca843f5 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:18.614729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d7b7224-ecfe-471d-96f9-a9303ca843f5 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:18.615195 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d7b7224-ecfe-471d-96f9-a9303ca843f5 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:18.615623 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7d7b7224-ecfe-471d-96f9-a9303ca843f5 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:18.680661 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7d7b7224-ecfe-471d-96f9-a9303ca843f5 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097830 Aug 04 18:04:18.681711 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3649/7265] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 18:04:18 2022] GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:04:19.699416 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-58b0ccfa-4f52-4e9a-abef-830c2637f562 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:19.702245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-58b0ccfa-4f52-4e9a-abef-830c2637f562 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: e2a4ddb1-c1bc-4281-b581-fc07897edd57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:19.709300 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58b0ccfa-4f52-4e9a-abef-830c2637f562 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:19.709801 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58b0ccfa-4f52-4e9a-abef-830c2637f562 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:19.710285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58b0ccfa-4f52-4e9a-abef-830c2637f562 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:19.711066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58b0ccfa-4f52-4e9a-abef-830c2637f562 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:19.711531 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58b0ccfa-4f52-4e9a-abef-830c2637f562 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:19.711966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58b0ccfa-4f52-4e9a-abef-830c2637f562 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:19.752304 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-58b0ccfa-4f52-4e9a-abef-830c2637f562 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059078 Aug 04 18:04:19.753385 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3617/7266] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 18:04:19 2022] GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:04:20.767392 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d1c06692-e444-4e6b-871e-c6a802fad6ad tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:20.769654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d1c06692-e444-4e6b-871e-c6a802fad6ad tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: e2a4ddb1-c1bc-4281-b581-fc07897edd57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:20.778934 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1c06692-e444-4e6b-871e-c6a802fad6ad tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:20.779788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1c06692-e444-4e6b-871e-c6a802fad6ad tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:20.780341 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1c06692-e444-4e6b-871e-c6a802fad6ad tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:20.781319 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1c06692-e444-4e6b-871e-c6a802fad6ad tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:20.782012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1c06692-e444-4e6b-871e-c6a802fad6ad tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:20.782614 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1c06692-e444-4e6b-871e-c6a802fad6ad tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:20.824263 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d1c06692-e444-4e6b-871e-c6a802fad6ad tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062146 Aug 04 18:04:20.829533 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3650/7267] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 18:04:20 2022] GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:04:21.837737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-988b6194-6da7-4e0a-b441-e0b96eb1e6cd tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:21.840749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-988b6194-6da7-4e0a-b441-e0b96eb1e6cd tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: e2a4ddb1-c1bc-4281-b581-fc07897edd57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:21.848270 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-988b6194-6da7-4e0a-b441-e0b96eb1e6cd tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:21.848778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-988b6194-6da7-4e0a-b441-e0b96eb1e6cd tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:21.849305 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-988b6194-6da7-4e0a-b441-e0b96eb1e6cd tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:21.850157 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-988b6194-6da7-4e0a-b441-e0b96eb1e6cd tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:21.850676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-988b6194-6da7-4e0a-b441-e0b96eb1e6cd tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:21.851284 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-988b6194-6da7-4e0a-b441-e0b96eb1e6cd tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:21.888898 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-988b6194-6da7-4e0a-b441-e0b96eb1e6cd tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055718 Aug 04 18:04:21.889504 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3618/7268] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 18:04:21 2022] GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:04:22.911339 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-85e31c50-cc36-4a3d-a46f-25fccb6b31f3 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:22.914049 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-85e31c50-cc36-4a3d-a46f-25fccb6b31f3 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: e2a4ddb1-c1bc-4281-b581-fc07897edd57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:22.923728 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85e31c50-cc36-4a3d-a46f-25fccb6b31f3 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:22.924359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85e31c50-cc36-4a3d-a46f-25fccb6b31f3 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:22.924875 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85e31c50-cc36-4a3d-a46f-25fccb6b31f3 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:22.926130 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85e31c50-cc36-4a3d-a46f-25fccb6b31f3 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:22.926912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85e31c50-cc36-4a3d-a46f-25fccb6b31f3 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:22.927732 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-85e31c50-cc36-4a3d-a46f-25fccb6b31f3 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:22.967310 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-85e31c50-cc36-4a3d-a46f-25fccb6b31f3 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061515 Aug 04 18:04:22.967850 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3651/7269] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 18:04:22 2022] GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:04:23.176923 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:04:23.177140 n-d-851359-3 devstack@n-api.service[131043]: Thu Aug 4 18:04:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:04:23.982027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fb5be75f-363e-4271-841c-756dc4a1aafc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:23.985072 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fb5be75f-363e-4271-841c-756dc4a1aafc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: e2a4ddb1-c1bc-4281-b581-fc07897edd57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:23.995002 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb5be75f-363e-4271-841c-756dc4a1aafc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:23.995527 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb5be75f-363e-4271-841c-756dc4a1aafc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:23.995996 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb5be75f-363e-4271-841c-756dc4a1aafc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:23.996729 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb5be75f-363e-4271-841c-756dc4a1aafc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:23.997204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb5be75f-363e-4271-841c-756dc4a1aafc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:23.997699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb5be75f-363e-4271-841c-756dc4a1aafc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:24.042859 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fb5be75f-363e-4271-841c-756dc4a1aafc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066034 Aug 04 18:04:24.043971 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3619/7270] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 18:04:23 2022] GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 18:04:24.060377 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2c0a1c9b-5cfa-47f1-b82e-085d1b129468 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:24.061263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2c0a1c9b-5cfa-47f1-b82e-085d1b129468 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: e2a4ddb1-c1bc-4281-b581-fc07897edd57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:24.069750 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c0a1c9b-5cfa-47f1-b82e-085d1b129468 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:24.070530 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c0a1c9b-5cfa-47f1-b82e-085d1b129468 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:24.071259 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c0a1c9b-5cfa-47f1-b82e-085d1b129468 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:24.072269 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c0a1c9b-5cfa-47f1-b82e-085d1b129468 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:24.073268 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c0a1c9b-5cfa-47f1-b82e-085d1b129468 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:24.073841 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2c0a1c9b-5cfa-47f1-b82e-085d1b129468 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:24.159708 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-2c0a1c9b-5cfa-47f1-b82e-085d1b129468 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] HTTP exception thrown: Instance e2a4ddb1-c1bc-4281-b581-fc07897edd57 is not attached to volume 89767dbe-b2dc-4912-8da9-77f5bee1f990 Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2c0a1c9b-5cfa-47f1-b82e-085d1b129468 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Request method failure captured: Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: request: DELETE /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57/os-volume_attachments/89767dbe-b2dc-4912-8da9-77f5bee1f990 HTTP/1.1 Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7An_otiHK2ul9j7uu3DbZiQwKHZoJnCABaxZQ1j33ADFutxnP9qH3tA0_O3WDz-NYjhD_IGD19X5FOGLVkzHh1byB4mJ2wWSs6LxSDVUZ53mUHf7zDJWDFOWugGZh2K0Hovjbew9lhQfvZlvGOV0rn1mVNJNAD7pmB3wUx3Ug--yBgo Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 86184ad6a9c64d18a82356f3f571f1f4 Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-TestEncryptedCinderVolumes-610820164 Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86184ad6a9c64d18a82356f3f571f1f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86184ad6a9c64d18a82356f3f571f1f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_86184ad6a9c64d18a82356f3f571f1f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/86184ad6a9c64d18a82356f3f571f1f4"}]}] Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-TestEncryptedCinderVolumes-610820164 Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 86184ad6a9c64d18a82356f3f571f1f4 Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-610820164 Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-TestEncryptedCinderVolumes-610820164-project Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 55a7e47902524f3089a33bf65870229e Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-TestEncryptedCinderVolumes-610820164-project Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance e2a4ddb1-c1bc-4281-b581-fc07897edd57 is not attached to volume 89767dbe-b2dc-4912-8da9-77f5bee1f990 Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'server_id': 'e2a4ddb1-c1bc-4281-b581-fc07897edd57', 'id': '89767dbe-b2dc-4912-8da9-77f5bee1f990'} Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 89767dbe-b2dc-4912-8da9-77f5bee1f990. Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2a4ddb1-c1bc-4281-b581-fc07897edd57 is not attached to volume 89767dbe-b2dc-4912-8da9-77f5bee1f990 Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:04:24.178629 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:04:24.183155 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:04:24.183155 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:04:24.183155 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2a4ddb1-c1bc-4281-b581-fc07897edd57 is not attached to volume 89767dbe-b2dc-4912-8da9-77f5bee1f990 Aug 04 18:04:24.183155 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:04:24.183155 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2c0a1c9b-5cfa-47f1-b82e-085d1b129468 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Returning 404 to user: Instance e2a4ddb1-c1bc-4281-b581-fc07897edd57 is not attached to volume 89767dbe-b2dc-4912-8da9-77f5bee1f990 {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:04:24.183155 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2c0a1c9b-5cfa-47f1-b82e-085d1b129468 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57/os-volume_attachments/89767dbe-b2dc-4912-8da9-77f5bee1f990" status: 404 len: 154 microversion: 2.1 time: 0.126231 Aug 04 18:04:24.183155 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3652/7271] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Aug 4 18:04:24 2022] DELETE /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57/os-volume_attachments/89767dbe-b2dc-4912-8da9-77f5bee1f990 => generated 154 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 18:04:27.658794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1d2ee205-0e8f-406f-a849-e1d062ce930f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:27.659597 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1d2ee205-0e8f-406f-a849-e1d062ce930f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: e2a4ddb1-c1bc-4281-b581-fc07897edd57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:27.666714 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d2ee205-0e8f-406f-a849-e1d062ce930f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:27.667277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d2ee205-0e8f-406f-a849-e1d062ce930f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:27.668081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d2ee205-0e8f-406f-a849-e1d062ce930f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:27.668444 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d2ee205-0e8f-406f-a849-e1d062ce930f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:27.668870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d2ee205-0e8f-406f-a849-e1d062ce930f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:27.669312 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d2ee205-0e8f-406f-a849-e1d062ce930f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:27.710361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1d2ee205-0e8f-406f-a849-e1d062ce930f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: e2a4ddb1-c1bc-4281-b581-fc07897edd57] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 18:04:27.812469 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1d2ee205-0e8f-406f-a849-e1d062ce930f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57" status: 204 len: 0 microversion: 2.1 time: 0.157784 Aug 04 18:04:27.813627 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3620/7272] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 18:04:27 2022] DELETE /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 18:04:27.824727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-01e0c893-8380-48e4-9279-2e806fb39aa8 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:27.826054 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-01e0c893-8380-48e4-9279-2e806fb39aa8 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: e2a4ddb1-c1bc-4281-b581-fc07897edd57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:27.839541 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01e0c893-8380-48e4-9279-2e806fb39aa8 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:27.840093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01e0c893-8380-48e4-9279-2e806fb39aa8 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:27.840699 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01e0c893-8380-48e4-9279-2e806fb39aa8 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:27.841428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01e0c893-8380-48e4-9279-2e806fb39aa8 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:27.841901 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01e0c893-8380-48e4-9279-2e806fb39aa8 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:27.842378 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-01e0c893-8380-48e4-9279-2e806fb39aa8 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:27.987482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-01e0c893-8380-48e4-9279-2e806fb39aa8 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:04:27.996094 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-01e0c893-8380-48e4-9279-2e806fb39aa8 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57" status: 200 len: 1559 microversion: 2.1 time: 0.178065 Aug 04 18:04:27.996684 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3653/7273] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:04:27 2022] GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:04:29.028144 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e2f53f1b-ed97-4f51-a56c-8a780d564bb8 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:29.028858 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e2f53f1b-ed97-4f51-a56c-8a780d564bb8 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: e2a4ddb1-c1bc-4281-b581-fc07897edd57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:29.039508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2f53f1b-ed97-4f51-a56c-8a780d564bb8 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:29.040370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2f53f1b-ed97-4f51-a56c-8a780d564bb8 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:29.041148 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2f53f1b-ed97-4f51-a56c-8a780d564bb8 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:29.042980 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2f53f1b-ed97-4f51-a56c-8a780d564bb8 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:29.043800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2f53f1b-ed97-4f51-a56c-8a780d564bb8 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:29.044475 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2f53f1b-ed97-4f51-a56c-8a780d564bb8 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:29.238885 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e2f53f1b-ed97-4f51-a56c-8a780d564bb8 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:04:29.252433 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e2f53f1b-ed97-4f51-a56c-8a780d564bb8 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57" status: 200 len: 1559 microversion: 2.1 time: 0.229721 Aug 04 18:04:29.253447 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3621/7274] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:04:29 2022] GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57 => generated 1559 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:04:30.226345 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-de87d52c-1c11-41e9-9461-236d5ac53986 req-d2975dd1-04b1-4782-8d46-4ebb22994543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2a4ddb1-c1bc-4281-b581-fc07897edd57", "name": "network-vif-deleted", "tag": "6a9fdd2d-7169-4659-a3aa-7836940c1698"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:04:30.246956 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-de87d52c-1c11-41e9-9461-236d5ac53986 req-d2975dd1-04b1-4782-8d46-4ebb22994543 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:30.247498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-de87d52c-1c11-41e9-9461-236d5ac53986 req-d2975dd1-04b1-4782-8d46-4ebb22994543 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:30.247978 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-de87d52c-1c11-41e9-9461-236d5ac53986 req-d2975dd1-04b1-4782-8d46-4ebb22994543 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:30.261689 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-de87d52c-1c11-41e9-9461-236d5ac53986 req-d2975dd1-04b1-4782-8d46-4ebb22994543 service nova] Creating event network-vif-deleted:6a9fdd2d-7169-4659-a3aa-7836940c1698 for instance e2a4ddb1-c1bc-4281-b581-fc07897edd57 on n-h1-851359-3 Aug 04 18:04:30.268698 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-de87d52c-1c11-41e9-9461-236d5ac53986 req-d2975dd1-04b1-4782-8d46-4ebb22994543 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046104 Aug 04 18:04:30.269430 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3654/7275] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:04:30.285548 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7d596f67-fd38-4c39-afd9-6ec46712f881 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:30.286226 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7d596f67-fd38-4c39-afd9-6ec46712f881 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: e2a4ddb1-c1bc-4281-b581-fc07897edd57] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:30.294004 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d596f67-fd38-4c39-afd9-6ec46712f881 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:30.294516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d596f67-fd38-4c39-afd9-6ec46712f881 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:30.294985 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d596f67-fd38-4c39-afd9-6ec46712f881 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:30.295750 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d596f67-fd38-4c39-afd9-6ec46712f881 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:30.296261 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d596f67-fd38-4c39-afd9-6ec46712f881 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:30.296697 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d596f67-fd38-4c39-afd9-6ec46712f881 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:30.369640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7d596f67-fd38-4c39-afd9-6ec46712f881 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:04:30.386107 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7d596f67-fd38-4c39-afd9-6ec46712f881 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57" status: 200 len: 1347 microversion: 2.1 time: 0.104579 Aug 04 18:04:30.386710 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3622/7276] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:04:30 2022] GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57 => generated 1347 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:04:31.410218 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6921c55f-b612-4af8-907b-564f333236f0 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:31.411007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6921c55f-b612-4af8-907b-564f333236f0 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: e2a4ddb1-c1bc-4281-b581-fc07897edd57] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:31.418617 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6921c55f-b612-4af8-907b-564f333236f0 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:31.419110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6921c55f-b612-4af8-907b-564f333236f0 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:31.419560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6921c55f-b612-4af8-907b-564f333236f0 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:31.420288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6921c55f-b612-4af8-907b-564f333236f0 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:31.420754 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6921c55f-b612-4af8-907b-564f333236f0 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:31.421193 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6921c55f-b612-4af8-907b-564f333236f0 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:31.438440 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-6921c55f-b612-4af8-907b-564f333236f0 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] HTTP exception thrown: Instance e2a4ddb1-c1bc-4281-b581-fc07897edd57 could not be found. Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6921c55f-b612-4af8-907b-564f333236f0 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Request method failure captured: Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57 HTTP/1.1 Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7An_otiHK2ul9j7uu3DbZiQwKHZoJnCABaxZQ1j33ADFutxnP9qH3tA0_O3WDz-NYjhD_IGD19X5FOGLVkzHh1byB4mJ2wWSs6LxSDVUZ53mUHf7zDJWDFOWugGZh2K0Hovjbew9lhQfvZlvGOV0rn1mVNJNAD7pmB3wUx3Ug--yBgo Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 86184ad6a9c64d18a82356f3f571f1f4 Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-TestEncryptedCinderVolumes-610820164 Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86184ad6a9c64d18a82356f3f571f1f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86184ad6a9c64d18a82356f3f571f1f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_86184ad6a9c64d18a82356f3f571f1f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/86184ad6a9c64d18a82356f3f571f1f4"}]}] Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-TestEncryptedCinderVolumes-610820164 Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 86184ad6a9c64d18a82356f3f571f1f4 Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-610820164 Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-TestEncryptedCinderVolumes-610820164-project Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 55a7e47902524f3089a33bf65870229e Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-TestEncryptedCinderVolumes-610820164-project Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance e2a4ddb1-c1bc-4281-b581-fc07897edd57 could not be found. Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'e2a4ddb1-c1bc-4281-b581-fc07897edd57'} Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2a4ddb1-c1bc-4281-b581-fc07897edd57 could not be found. Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2a4ddb1-c1bc-4281-b581-fc07897edd57 could not be found. Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:04:31.440148 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:04:31.448484 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:04:31.448484 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:04:31.448484 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:04:31.448484 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:04:31.448484 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:04:31.448484 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2a4ddb1-c1bc-4281-b581-fc07897edd57 could not be found. Aug 04 18:04:31.448484 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:04:31.448484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6921c55f-b612-4af8-907b-564f333236f0 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Returning 404 to user: Instance e2a4ddb1-c1bc-4281-b581-fc07897edd57 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:04:31.448484 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6921c55f-b612-4af8-907b-564f333236f0 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57" status: 404 len: 111 microversion: 2.1 time: 0.038030 Aug 04 18:04:31.448484 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3655/7277] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:04:31 2022] GET /compute/v2.1/servers/e2a4ddb1-c1bc-4281-b581-fc07897edd57 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 18:04:31.454543 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-553e7f37-6436-48e9-85b4-527a5b91fc9f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '.version_select at 0x7f1e5a4f3a60>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:31.484669 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-553e7f37-6436-48e9-85b4-527a5b91fc9f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-101667787" status: 202 len: 0 microversion: 2.1 time: 0.035188 Aug 04 18:04:31.485586 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3623/7278] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Aug 4 18:04:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-101667787 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 18:04:31.508933 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-af01df4e-2fdd-41b7-82ac-6fc0d1066fa7 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Action: 'create', calling method: .version_select at 0x7f1e5ab64d30>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1264381417", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxOEr2eKRFU+5yh218l8CWc9CO5CKGR/k1aNsCPfSV+NCwZ2xOd483U23nQqMssIgMLtusUr2PZKukoOmDQphcP/+nt9Qqypju9+tX25DN8JuhHjQ7MoT4GHN8tcdD2DA=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:04:31.531282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-af01df4e-2fdd-41b7-82ac-6fc0d1066fa7 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Getting quotas for project 86184ad6a9c64d18a82356f3f571f1f4. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 18:04:31.538596 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-af01df4e-2fdd-41b7-82ac-6fc0d1066fa7 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Getting quotas for user 55a7e47902524f3089a33bf65870229e and project 86184ad6a9c64d18a82356f3f571f1f4. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 18:04:31.576450 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-af01df4e-2fdd-41b7-82ac-6fc0d1066fa7 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.073600 Aug 04 18:04:31.577066 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3656/7279] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 18:04:31 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:04:31.645493 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a0e6b29e-7ace-45cf-bbfe-35c3cd79ca64 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-699251439", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1264381417", "networks": [{"uuid": "fc0ba368-22b5-4300-bfe5-4bc297708e32"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:04:31.701637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-a0e6b29e-7ace-45cf-bbfe-35c3cd79ca64 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] validate_networks() for [('fc0ba368-22b5-4300-bfe5-4bc297708e32', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 18:04:32.172323 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-a0e6b29e-7ace-45cf-bbfe-35c3cd79ca64 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 18:04:32.172765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-a0e6b29e-7ace-45cf-bbfe-35c3cd79ca64 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 18:04:32.173260 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-a0e6b29e-7ace-45cf-bbfe-35c3cd79ca64 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 18:04:32.173688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-a0e6b29e-7ace-45cf-bbfe-35c3cd79ca64 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 18:04:32.174146 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-a0e6b29e-7ace-45cf-bbfe-35c3cd79ca64 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 18:04:32.185135 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0e6b29e-7ace-45cf-bbfe-35c3cd79ca64 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:32.185558 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0e6b29e-7ace-45cf-bbfe-35c3cd79ca64 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:32.186232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0e6b29e-7ace-45cf-bbfe-35c3cd79ca64 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:32.186864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0e6b29e-7ace-45cf-bbfe-35c3cd79ca64 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:32.187343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0e6b29e-7ace-45cf-bbfe-35c3cd79ca64 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:32.187904 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0e6b29e-7ace-45cf-bbfe-35c3cd79ca64 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:32.208758 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-a0e6b29e-7ace-45cf-bbfe-35c3cd79ca64 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Getting quotas for project 86184ad6a9c64d18a82356f3f571f1f4. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 18:04:32.215832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-a0e6b29e-7ace-45cf-bbfe-35c3cd79ca64 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Getting quotas for user 55a7e47902524f3089a33bf65870229e and project 86184ad6a9c64d18a82356f3f571f1f4. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 18:04:32.234198 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a0e6b29e-7ace-45cf-bbfe-35c3cd79ca64 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 18:04:32.237774 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a0e6b29e-7ace-45cf-bbfe-35c3cd79ca64 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: 31374b92-f615-4a5e-8ff3-edc572a4339d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 18:04:32.295395 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a0e6b29e-7ace-45cf-bbfe-35c3cd79ca64 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653873 Aug 04 18:04:32.296068 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3624/7280] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 18:04:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 18:04:32.307645 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d7c873e4-9497-4b1d-82da-8100ee9aa4fb tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:32.308447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d7c873e4-9497-4b1d-82da-8100ee9aa4fb tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: 31374b92-f615-4a5e-8ff3-edc572a4339d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:32.371995 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d7c873e4-9497-4b1d-82da-8100ee9aa4fb tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:04:32.379405 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d7c873e4-9497-4b1d-82da-8100ee9aa4fb tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d" status: 200 len: 1262 microversion: 2.1 time: 0.076469 Aug 04 18:04:32.380117 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3657/7281] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:04:32 2022] GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d => generated 1262 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:04:33.403125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-80bd02cc-459b-4e97-abb2-c9912aec22f9 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:33.404643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-80bd02cc-459b-4e97-abb2-c9912aec22f9 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: 31374b92-f615-4a5e-8ff3-edc572a4339d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:33.412247 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80bd02cc-459b-4e97-abb2-c9912aec22f9 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:33.412753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80bd02cc-459b-4e97-abb2-c9912aec22f9 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:33.413777 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80bd02cc-459b-4e97-abb2-c9912aec22f9 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:33.415080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80bd02cc-459b-4e97-abb2-c9912aec22f9 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:33.416534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80bd02cc-459b-4e97-abb2-c9912aec22f9 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:33.417285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80bd02cc-459b-4e97-abb2-c9912aec22f9 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:33.500959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-80bd02cc-459b-4e97-abb2-c9912aec22f9 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:04:33.511810 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-80bd02cc-459b-4e97-abb2-c9912aec22f9 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d" status: 200 len: 1322 microversion: 2.1 time: 0.113872 Aug 04 18:04:33.512702 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3625/7282] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:04:33 2022] GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d => generated 1322 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:04:34.538156 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5858dbb4-53d1-4a08-96aa-982b5777756f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:34.539188 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5858dbb4-53d1-4a08-96aa-982b5777756f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: 31374b92-f615-4a5e-8ff3-edc572a4339d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:34.553474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5858dbb4-53d1-4a08-96aa-982b5777756f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:34.554553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5858dbb4-53d1-4a08-96aa-982b5777756f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:34.555408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5858dbb4-53d1-4a08-96aa-982b5777756f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:34.556483 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5858dbb4-53d1-4a08-96aa-982b5777756f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:34.557181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5858dbb4-53d1-4a08-96aa-982b5777756f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:34.557633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5858dbb4-53d1-4a08-96aa-982b5777756f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:34.764536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5858dbb4-53d1-4a08-96aa-982b5777756f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:04:34.780444 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5858dbb4-53d1-4a08-96aa-982b5777756f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d" status: 200 len: 1362 microversion: 2.1 time: 0.246387 Aug 04 18:04:34.781515 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3658/7283] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:04:34 2022] GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:04:35.337934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-a93c1498-93c1-48b8-aab8-5ab9a7a85b8b req-9c78ef5a-3efc-4afa-8bc6-aea3dd66983b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31374b92-f615-4a5e-8ff3-edc572a4339d", "tag": "d1ac562b-3b74-4976-83c6-c6b982122a7c"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:04:35.352465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a93c1498-93c1-48b8-aab8-5ab9a7a85b8b req-9c78ef5a-3efc-4afa-8bc6-aea3dd66983b service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:35.353193 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a93c1498-93c1-48b8-aab8-5ab9a7a85b8b req-9c78ef5a-3efc-4afa-8bc6-aea3dd66983b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:35.354356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a93c1498-93c1-48b8-aab8-5ab9a7a85b8b req-9c78ef5a-3efc-4afa-8bc6-aea3dd66983b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:35.368400 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-a93c1498-93c1-48b8-aab8-5ab9a7a85b8b req-9c78ef5a-3efc-4afa-8bc6-aea3dd66983b service nova] Creating event network-changed:d1ac562b-3b74-4976-83c6-c6b982122a7c for instance 31374b92-f615-4a5e-8ff3-edc572a4339d on n-h1-851359-3 Aug 04 18:04:35.374987 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-a93c1498-93c1-48b8-aab8-5ab9a7a85b8b req-9c78ef5a-3efc-4afa-8bc6-aea3dd66983b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042698 Aug 04 18:04:35.375795 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3626/7284] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:04:35.816834 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-30d723fd-93cc-4106-a309-41bb5c85c363 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:35.818222 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-30d723fd-93cc-4106-a309-41bb5c85c363 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: 31374b92-f615-4a5e-8ff3-edc572a4339d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:35.825774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-30d723fd-93cc-4106-a309-41bb5c85c363 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:35.826388 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-30d723fd-93cc-4106-a309-41bb5c85c363 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:35.826846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-30d723fd-93cc-4106-a309-41bb5c85c363 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:35.827657 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-30d723fd-93cc-4106-a309-41bb5c85c363 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:35.828057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-30d723fd-93cc-4106-a309-41bb5c85c363 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:35.828499 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-30d723fd-93cc-4106-a309-41bb5c85c363 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:36.013584 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-30d723fd-93cc-4106-a309-41bb5c85c363 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:04:36.021872 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-30d723fd-93cc-4106-a309-41bb5c85c363 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d" status: 200 len: 1362 microversion: 2.1 time: 0.212224 Aug 04 18:04:36.022497 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3659/7285] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:04:35 2022] GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:04:37.049342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-38aadc26-954c-4641-8931-4cab56bcacbd tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:37.050380 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-38aadc26-954c-4641-8931-4cab56bcacbd tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: 31374b92-f615-4a5e-8ff3-edc572a4339d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:37.058088 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38aadc26-954c-4641-8931-4cab56bcacbd tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:37.058584 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38aadc26-954c-4641-8931-4cab56bcacbd tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:37.059035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38aadc26-954c-4641-8931-4cab56bcacbd tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:37.059772 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38aadc26-954c-4641-8931-4cab56bcacbd tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:37.060237 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38aadc26-954c-4641-8931-4cab56bcacbd tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:37.060677 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38aadc26-954c-4641-8931-4cab56bcacbd tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:37.230476 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-38aadc26-954c-4641-8931-4cab56bcacbd tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:04:37.238627 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-38aadc26-954c-4641-8931-4cab56bcacbd tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d" status: 200 len: 1362 microversion: 2.1 time: 0.198730 Aug 04 18:04:37.239227 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3627/7286] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:04:37 2022] GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:04:38.261764 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e8872060-994b-4aff-9d8f-68eaaea87862 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:38.262435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e8872060-994b-4aff-9d8f-68eaaea87862 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: 31374b92-f615-4a5e-8ff3-edc572a4339d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:38.270812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8872060-994b-4aff-9d8f-68eaaea87862 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:38.271332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8872060-994b-4aff-9d8f-68eaaea87862 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:38.271787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8872060-994b-4aff-9d8f-68eaaea87862 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:38.272556 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8872060-994b-4aff-9d8f-68eaaea87862 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:38.273036 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8872060-994b-4aff-9d8f-68eaaea87862 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:38.273511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8872060-994b-4aff-9d8f-68eaaea87862 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:38.424126 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e8872060-994b-4aff-9d8f-68eaaea87862 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:04:38.431927 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e8872060-994b-4aff-9d8f-68eaaea87862 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d" status: 200 len: 1362 microversion: 2.1 time: 0.174641 Aug 04 18:04:38.432511 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3660/7287] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:04:38 2022] GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:04:39.456693 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8d7d0fc1-8829-4dde-af35-6517dc85a7f1 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:39.457907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8d7d0fc1-8829-4dde-af35-6517dc85a7f1 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: 31374b92-f615-4a5e-8ff3-edc572a4339d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:39.467680 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d7d0fc1-8829-4dde-af35-6517dc85a7f1 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:39.469719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d7d0fc1-8829-4dde-af35-6517dc85a7f1 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:39.470260 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d7d0fc1-8829-4dde-af35-6517dc85a7f1 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:39.472598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d7d0fc1-8829-4dde-af35-6517dc85a7f1 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:39.473127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d7d0fc1-8829-4dde-af35-6517dc85a7f1 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:39.473582 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d7d0fc1-8829-4dde-af35-6517dc85a7f1 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:39.636650 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8d7d0fc1-8829-4dde-af35-6517dc85a7f1 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:04:39.644832 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8d7d0fc1-8829-4dde-af35-6517dc85a7f1 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d" status: 200 len: 1362 microversion: 2.1 time: 0.194314 Aug 04 18:04:39.645447 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3628/7288] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:04:39 2022] GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:04:40.374359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-e242884c-264d-4e6f-8bdb-4845137c9d82 req-dfc11023-2440-40fb-9667-3e847c41c336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31374b92-f615-4a5e-8ff3-edc572a4339d", "name": "network-vif-plugged", "status": "completed", "tag": "d1ac562b-3b74-4976-83c6-c6b982122a7c"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:04:40.385963 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e242884c-264d-4e6f-8bdb-4845137c9d82 req-dfc11023-2440-40fb-9667-3e847c41c336 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:40.386767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e242884c-264d-4e6f-8bdb-4845137c9d82 req-dfc11023-2440-40fb-9667-3e847c41c336 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:40.387502 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e242884c-264d-4e6f-8bdb-4845137c9d82 req-dfc11023-2440-40fb-9667-3e847c41c336 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:40.403593 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-e242884c-264d-4e6f-8bdb-4845137c9d82 req-dfc11023-2440-40fb-9667-3e847c41c336 service nova] Creating event network-vif-plugged:d1ac562b-3b74-4976-83c6-c6b982122a7c for instance 31374b92-f615-4a5e-8ff3-edc572a4339d on n-h1-851359-3 Aug 04 18:04:40.408364 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-e242884c-264d-4e6f-8bdb-4845137c9d82 req-dfc11023-2440-40fb-9667-3e847c41c336 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131989 Aug 04 18:04:40.409398 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3661/7289] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:04:40.665960 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0d7ad0d9-51de-4a06-a84e-e3a93889203e tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:40.666883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0d7ad0d9-51de-4a06-a84e-e3a93889203e tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: 31374b92-f615-4a5e-8ff3-edc572a4339d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:40.675528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d7ad0d9-51de-4a06-a84e-e3a93889203e tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:40.676085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d7ad0d9-51de-4a06-a84e-e3a93889203e tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:40.676867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d7ad0d9-51de-4a06-a84e-e3a93889203e tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:40.678469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d7ad0d9-51de-4a06-a84e-e3a93889203e tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:40.678656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d7ad0d9-51de-4a06-a84e-e3a93889203e tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:40.679439 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d7ad0d9-51de-4a06-a84e-e3a93889203e tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:40.830850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0d7ad0d9-51de-4a06-a84e-e3a93889203e tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:04:40.839681 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0d7ad0d9-51de-4a06-a84e-e3a93889203e tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d" status: 200 len: 1362 microversion: 2.1 time: 0.177909 Aug 04 18:04:40.840282 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3629/7290] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:04:40 2022] GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:04:41.863599 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fbdcdc52-cefb-4b3c-94e2-3a22b7860ba2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:41.864240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fbdcdc52-cefb-4b3c-94e2-3a22b7860ba2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: 31374b92-f615-4a5e-8ff3-edc572a4339d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:41.871705 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fbdcdc52-cefb-4b3c-94e2-3a22b7860ba2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:41.872207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fbdcdc52-cefb-4b3c-94e2-3a22b7860ba2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:41.872658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fbdcdc52-cefb-4b3c-94e2-3a22b7860ba2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:41.873372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fbdcdc52-cefb-4b3c-94e2-3a22b7860ba2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:41.873843 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fbdcdc52-cefb-4b3c-94e2-3a22b7860ba2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:41.874307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fbdcdc52-cefb-4b3c-94e2-3a22b7860ba2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:42.024335 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fbdcdc52-cefb-4b3c-94e2-3a22b7860ba2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:04:42.032935 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fbdcdc52-cefb-4b3c-94e2-3a22b7860ba2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d" status: 200 len: 1553 microversion: 2.1 time: 0.174562 Aug 04 18:04:42.033539 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3662/7291] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:04:41 2022] GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:04:42.054412 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3ccc3a88-295c-4f5d-bca2-c22d36dae178 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:42.054966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3ccc3a88-295c-4f5d-bca2-c22d36dae178 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: 31374b92-f615-4a5e-8ff3-edc572a4339d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:42.061953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ccc3a88-295c-4f5d-bca2-c22d36dae178 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:42.062492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ccc3a88-295c-4f5d-bca2-c22d36dae178 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:42.062949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ccc3a88-295c-4f5d-bca2-c22d36dae178 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:42.063675 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ccc3a88-295c-4f5d-bca2-c22d36dae178 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:42.064148 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ccc3a88-295c-4f5d-bca2-c22d36dae178 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:42.064596 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ccc3a88-295c-4f5d-bca2-c22d36dae178 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:42.195831 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:04:42.209003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3ccc3a88-295c-4f5d-bca2-c22d36dae178 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:04:42.217900 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3ccc3a88-295c-4f5d-bca2-c22d36dae178 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d" status: 200 len: 1553 microversion: 2.1 time: 0.167599 Aug 04 18:04:42.218523 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3630/7292] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:04:42 2022] GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:04:43.780495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d2539084-8a98-45da-8ae6-6e85bb23a2e8 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7eacf9af-5781-43b3-ae18-4f459b5799ac"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:04:43.783045 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d2539084-8a98-45da-8ae6-6e85bb23a2e8 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: 31374b92-f615-4a5e-8ff3-edc572a4339d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:43.785090 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:04:43.791477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d2539084-8a98-45da-8ae6-6e85bb23a2e8 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:43.791982 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d2539084-8a98-45da-8ae6-6e85bb23a2e8 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:43.792434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d2539084-8a98-45da-8ae6-6e85bb23a2e8 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:43.793153 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d2539084-8a98-45da-8ae6-6e85bb23a2e8 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:43.793627 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d2539084-8a98-45da-8ae6-6e85bb23a2e8 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:43.794088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d2539084-8a98-45da-8ae6-6e85bb23a2e8 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:44.078564 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d2539084-8a98-45da-8ae6-6e85bb23a2e8 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "POST /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301833 Aug 04 18:04:44.079198 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3663/7293] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Aug 4 18:04:43 2022] POST /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:04:54.866424 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-af4cf33e-8d5e-4687-9fab-f9d6eed96755 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:54.866987 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-af4cf33e-8d5e-4687-9fab-f9d6eed96755 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: 31374b92-f615-4a5e-8ff3-edc572a4339d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:54.868799 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:04:54.869587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:04:54.870645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:04:54.877383 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-af4cf33e-8d5e-4687-9fab-f9d6eed96755 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:54.877883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-af4cf33e-8d5e-4687-9fab-f9d6eed96755 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:54.878357 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-af4cf33e-8d5e-4687-9fab-f9d6eed96755 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:54.879065 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-af4cf33e-8d5e-4687-9fab-f9d6eed96755 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:54.879533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-af4cf33e-8d5e-4687-9fab-f9d6eed96755 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:54.879972 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-af4cf33e-8d5e-4687-9fab-f9d6eed96755 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:54.972082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-af4cf33e-8d5e-4687-9fab-f9d6eed96755 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lazy-loading 'services' on Instance uuid 31374b92-f615-4a5e-8ff3-edc572a4339d {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 18:04:55.044418 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-af4cf33e-8d5e-4687-9fab-f9d6eed96755 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "DELETE /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d/os-volume_attachments/7eacf9af-5781-43b3-ae18-4f459b5799ac" status: 202 len: 0 microversion: 2.1 time: 0.182223 Aug 04 18:04:55.045145 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3631/7294] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Aug 4 18:04:54 2022] DELETE /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d/os-volume_attachments/7eacf9af-5781-43b3-ae18-4f459b5799ac => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 18:04:55.051640 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:04:55.052522 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:04:55.057456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-53b09f94-b66c-48ff-ad98-eb9c69b8f1bf tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:55.059796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-53b09f94-b66c-48ff-ad98-eb9c69b8f1bf tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: 31374b92-f615-4a5e-8ff3-edc572a4339d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:55.067947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53b09f94-b66c-48ff-ad98-eb9c69b8f1bf tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:55.069115 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53b09f94-b66c-48ff-ad98-eb9c69b8f1bf tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:55.069115 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53b09f94-b66c-48ff-ad98-eb9c69b8f1bf tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:55.069630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53b09f94-b66c-48ff-ad98-eb9c69b8f1bf tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:55.070133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53b09f94-b66c-48ff-ad98-eb9c69b8f1bf tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:55.070570 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53b09f94-b66c-48ff-ad98-eb9c69b8f1bf tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:55.110761 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-53b09f94-b66c-48ff-ad98-eb9c69b8f1bf tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060998 Aug 04 18:04:55.111354 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3664/7295] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 18:04:55 2022] GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:04:56.125765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0a548f8a-1191-4aa0-9f2a-108418352bf7 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:56.128300 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0a548f8a-1191-4aa0-9f2a-108418352bf7 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: 31374b92-f615-4a5e-8ff3-edc572a4339d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:56.135013 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a548f8a-1191-4aa0-9f2a-108418352bf7 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:56.135524 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a548f8a-1191-4aa0-9f2a-108418352bf7 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:56.135981 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a548f8a-1191-4aa0-9f2a-108418352bf7 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:56.136744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a548f8a-1191-4aa0-9f2a-108418352bf7 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:56.137223 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a548f8a-1191-4aa0-9f2a-108418352bf7 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:56.137666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a548f8a-1191-4aa0-9f2a-108418352bf7 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:56.173943 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0a548f8a-1191-4aa0-9f2a-108418352bf7 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054386 Aug 04 18:04:56.174574 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3632/7296] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 18:04:56 2022] GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:04:57.189990 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-86773af2-d6c6-4457-ad1f-f1195fe6bf7d tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:57.193327 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-86773af2-d6c6-4457-ad1f-f1195fe6bf7d tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: 31374b92-f615-4a5e-8ff3-edc572a4339d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:57.204544 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86773af2-d6c6-4457-ad1f-f1195fe6bf7d tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:57.204544 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86773af2-d6c6-4457-ad1f-f1195fe6bf7d tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:57.205135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86773af2-d6c6-4457-ad1f-f1195fe6bf7d tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:57.206277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86773af2-d6c6-4457-ad1f-f1195fe6bf7d tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:57.207056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86773af2-d6c6-4457-ad1f-f1195fe6bf7d tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:57.207530 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-86773af2-d6c6-4457-ad1f-f1195fe6bf7d tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:57.250192 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-86773af2-d6c6-4457-ad1f-f1195fe6bf7d tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066410 Aug 04 18:04:57.250801 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3665/7297] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 18:04:57 2022] GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:04:58.271427 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0261d082-bfc5-428c-a43a-5556260fe117 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:58.276235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0261d082-bfc5-428c-a43a-5556260fe117 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: 31374b92-f615-4a5e-8ff3-edc572a4339d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:58.289318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0261d082-bfc5-428c-a43a-5556260fe117 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:58.290347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0261d082-bfc5-428c-a43a-5556260fe117 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:58.291773 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0261d082-bfc5-428c-a43a-5556260fe117 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:58.293051 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0261d082-bfc5-428c-a43a-5556260fe117 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:58.294116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0261d082-bfc5-428c-a43a-5556260fe117 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:58.294920 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0261d082-bfc5-428c-a43a-5556260fe117 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:58.357868 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0261d082-bfc5-428c-a43a-5556260fe117 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094004 Aug 04 18:04:58.358996 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3633/7298] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 18:04:58 2022] GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:04:59.377451 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e40bb0c4-4b8e-46ba-ab05-9f621eb3ad1c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:04:59.381195 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e40bb0c4-4b8e-46ba-ab05-9f621eb3ad1c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: 31374b92-f615-4a5e-8ff3-edc572a4339d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:04:59.393740 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e40bb0c4-4b8e-46ba-ab05-9f621eb3ad1c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:59.394798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e40bb0c4-4b8e-46ba-ab05-9f621eb3ad1c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:59.395612 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e40bb0c4-4b8e-46ba-ab05-9f621eb3ad1c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:59.396994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e40bb0c4-4b8e-46ba-ab05-9f621eb3ad1c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:04:59.397942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e40bb0c4-4b8e-46ba-ab05-9f621eb3ad1c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:04:59.398624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e40bb0c4-4b8e-46ba-ab05-9f621eb3ad1c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:04:59.449326 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e40bb0c4-4b8e-46ba-ab05-9f621eb3ad1c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078854 Aug 04 18:04:59.450634 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3666/7299] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 18:04:59 2022] GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:05:00.471143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-685404d3-9e62-482e-9bea-dd6df504835a tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:00.475467 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-685404d3-9e62-482e-9bea-dd6df504835a tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: 31374b92-f615-4a5e-8ff3-edc572a4339d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:00.488030 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-685404d3-9e62-482e-9bea-dd6df504835a tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:00.488914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-685404d3-9e62-482e-9bea-dd6df504835a tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:00.489788 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-685404d3-9e62-482e-9bea-dd6df504835a tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:00.491046 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-685404d3-9e62-482e-9bea-dd6df504835a tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:00.492165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-685404d3-9e62-482e-9bea-dd6df504835a tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:00.493026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-685404d3-9e62-482e-9bea-dd6df504835a tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:00.549854 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-685404d3-9e62-482e-9bea-dd6df504835a tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084335 Aug 04 18:05:00.550922 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3634/7300] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 18:05:00 2022] GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:05:01.569706 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b0814918-ab5d-4995-93f7-1a319f333742 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:01.573829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b0814918-ab5d-4995-93f7-1a319f333742 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: 31374b92-f615-4a5e-8ff3-edc572a4339d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:01.585053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0814918-ab5d-4995-93f7-1a319f333742 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:01.585728 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0814918-ab5d-4995-93f7-1a319f333742 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:01.586340 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0814918-ab5d-4995-93f7-1a319f333742 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:01.587776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0814918-ab5d-4995-93f7-1a319f333742 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:01.588508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0814918-ab5d-4995-93f7-1a319f333742 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:01.589204 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0814918-ab5d-4995-93f7-1a319f333742 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:01.635621 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b0814918-ab5d-4995-93f7-1a319f333742 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073136 Aug 04 18:05:01.636188 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3667/7301] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 18:05:01 2022] GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 18:05:01.651023 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c1ceb0af-4a25-4721-9aff-c2242532e60b tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:01.651852 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c1ceb0af-4a25-4721-9aff-c2242532e60b tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: 31374b92-f615-4a5e-8ff3-edc572a4339d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:01.662185 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c1ceb0af-4a25-4721-9aff-c2242532e60b tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:01.662759 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c1ceb0af-4a25-4721-9aff-c2242532e60b tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:01.663476 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c1ceb0af-4a25-4721-9aff-c2242532e60b tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:01.664711 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c1ceb0af-4a25-4721-9aff-c2242532e60b tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:01.665541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c1ceb0af-4a25-4721-9aff-c2242532e60b tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:01.666354 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c1ceb0af-4a25-4721-9aff-c2242532e60b tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:01.803092 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-c1ceb0af-4a25-4721-9aff-c2242532e60b tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] HTTP exception thrown: Instance 31374b92-f615-4a5e-8ff3-edc572a4339d is not attached to volume 7eacf9af-5781-43b3-ae18-4f459b5799ac Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c1ceb0af-4a25-4721-9aff-c2242532e60b tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Request method failure captured: Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d/os-volume_attachments/7eacf9af-5781-43b3-ae18-4f459b5799ac HTTP/1.1 Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7An_otiHK2ul9j7uu3DbZiQwKHZoJnCABaxZQ1j33ADFutxnP9qH3tA0_O3WDz-NYjhD_IGD19X5FOGLVkzHh1byB4mJ2wWSs6LxSDVUZ53mUHf7zDJWDFOWugGZh2K0Hovjbew9lhQfvZlvGOV0rn1mVNJNAD7pmB3wUx3Ug--yBgo Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 86184ad6a9c64d18a82356f3f571f1f4 Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TestEncryptedCinderVolumes-610820164 Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86184ad6a9c64d18a82356f3f571f1f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86184ad6a9c64d18a82356f3f571f1f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_86184ad6a9c64d18a82356f3f571f1f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/86184ad6a9c64d18a82356f3f571f1f4"}]}] Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TestEncryptedCinderVolumes-610820164 Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 86184ad6a9c64d18a82356f3f571f1f4 Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-610820164 Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TestEncryptedCinderVolumes-610820164-project Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 55a7e47902524f3089a33bf65870229e Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TestEncryptedCinderVolumes-610820164-project Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 31374b92-f615-4a5e-8ff3-edc572a4339d is not attached to volume 7eacf9af-5781-43b3-ae18-4f459b5799ac Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'server_id': '31374b92-f615-4a5e-8ff3-edc572a4339d', 'id': '7eacf9af-5781-43b3-ae18-4f459b5799ac'} Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7eacf9af-5781-43b3-ae18-4f459b5799ac. Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31374b92-f615-4a5e-8ff3-edc572a4339d is not attached to volume 7eacf9af-5781-43b3-ae18-4f459b5799ac Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:05:01.806880 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:05:01.815593 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:05:01.815593 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:05:01.815593 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31374b92-f615-4a5e-8ff3-edc572a4339d is not attached to volume 7eacf9af-5781-43b3-ae18-4f459b5799ac Aug 04 18:05:01.815593 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:05:01.815593 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c1ceb0af-4a25-4721-9aff-c2242532e60b tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Returning 404 to user: Instance 31374b92-f615-4a5e-8ff3-edc572a4339d is not attached to volume 7eacf9af-5781-43b3-ae18-4f459b5799ac {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:05:01.815593 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c1ceb0af-4a25-4721-9aff-c2242532e60b tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "DELETE /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d/os-volume_attachments/7eacf9af-5781-43b3-ae18-4f459b5799ac" status: 404 len: 154 microversion: 2.1 time: 0.165436 Aug 04 18:05:01.815593 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3635/7302] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Aug 4 18:05:01 2022] DELETE /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d/os-volume_attachments/7eacf9af-5781-43b3-ae18-4f459b5799ac => generated 154 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 18:05:06.432567 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cc9b33d6-246b-4e33-8384-930cac723b59 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:06.433597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cc9b33d6-246b-4e33-8384-930cac723b59 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: 31374b92-f615-4a5e-8ff3-edc572a4339d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:06.445646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc9b33d6-246b-4e33-8384-930cac723b59 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:06.447011 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc9b33d6-246b-4e33-8384-930cac723b59 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:06.447794 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc9b33d6-246b-4e33-8384-930cac723b59 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:06.449156 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc9b33d6-246b-4e33-8384-930cac723b59 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:06.450322 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc9b33d6-246b-4e33-8384-930cac723b59 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:06.451024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc9b33d6-246b-4e33-8384-930cac723b59 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:06.499981 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cc9b33d6-246b-4e33-8384-930cac723b59 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: 31374b92-f615-4a5e-8ff3-edc572a4339d] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 18:05:06.627737 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cc9b33d6-246b-4e33-8384-930cac723b59 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "DELETE /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d" status: 204 len: 0 microversion: 2.1 time: 0.204629 Aug 04 18:05:06.628802 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3668/7303] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 18:05:06 2022] DELETE /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 18:05:06.644620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f33dcb89-98c8-423f-b09f-fa7864ccab0b tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:06.646130 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f33dcb89-98c8-423f-b09f-fa7864ccab0b tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: 31374b92-f615-4a5e-8ff3-edc572a4339d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:06.660743 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f33dcb89-98c8-423f-b09f-fa7864ccab0b tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:06.661621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f33dcb89-98c8-423f-b09f-fa7864ccab0b tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:06.662440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f33dcb89-98c8-423f-b09f-fa7864ccab0b tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:06.664082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f33dcb89-98c8-423f-b09f-fa7864ccab0b tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:06.664902 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f33dcb89-98c8-423f-b09f-fa7864ccab0b tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:06.666273 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f33dcb89-98c8-423f-b09f-fa7864ccab0b tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:06.875498 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f33dcb89-98c8-423f-b09f-fa7864ccab0b tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:05:06.891093 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f33dcb89-98c8-423f-b09f-fa7864ccab0b tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d" status: 200 len: 1559 microversion: 2.1 time: 0.254432 Aug 04 18:05:06.891941 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3636/7304] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:05:06 2022] GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d => generated 1559 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:05:07.931576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-56ae323f-0fd2-41aa-8dfd-33e6f1610541 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:07.932719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-56ae323f-0fd2-41aa-8dfd-33e6f1610541 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: 31374b92-f615-4a5e-8ff3-edc572a4339d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:07.944335 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56ae323f-0fd2-41aa-8dfd-33e6f1610541 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:07.945175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56ae323f-0fd2-41aa-8dfd-33e6f1610541 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:07.945941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56ae323f-0fd2-41aa-8dfd-33e6f1610541 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:07.947642 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56ae323f-0fd2-41aa-8dfd-33e6f1610541 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:07.948425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56ae323f-0fd2-41aa-8dfd-33e6f1610541 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:07.949189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-56ae323f-0fd2-41aa-8dfd-33e6f1610541 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:08.099597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-56ae323f-0fd2-41aa-8dfd-33e6f1610541 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:05:08.108143 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-56ae323f-0fd2-41aa-8dfd-33e6f1610541 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d" status: 200 len: 1559 microversion: 2.1 time: 0.184580 Aug 04 18:05:08.108725 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3669/7305] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:05:07 2022] GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:05:09.050530 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-d8d9941a-251f-4537-bb09-a181ff90f54b req-e1aff845-a3bf-4b80-b7d1-b142eb087a36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31374b92-f615-4a5e-8ff3-edc572a4339d", "name": "network-vif-deleted", "tag": "d1ac562b-3b74-4976-83c6-c6b982122a7c"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:05:09.062975 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d8d9941a-251f-4537-bb09-a181ff90f54b req-e1aff845-a3bf-4b80-b7d1-b142eb087a36 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:09.063475 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d8d9941a-251f-4537-bb09-a181ff90f54b req-e1aff845-a3bf-4b80-b7d1-b142eb087a36 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:09.063929 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d8d9941a-251f-4537-bb09-a181ff90f54b req-e1aff845-a3bf-4b80-b7d1-b142eb087a36 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:09.077893 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-d8d9941a-251f-4537-bb09-a181ff90f54b req-e1aff845-a3bf-4b80-b7d1-b142eb087a36 service nova] Creating event network-vif-deleted:d1ac562b-3b74-4976-83c6-c6b982122a7c for instance 31374b92-f615-4a5e-8ff3-edc572a4339d on n-h1-851359-3 Aug 04 18:05:09.083674 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-d8d9941a-251f-4537-bb09-a181ff90f54b req-e1aff845-a3bf-4b80-b7d1-b142eb087a36 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036763 Aug 04 18:05:09.084345 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3637/7306] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:05:09.131863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-82919ece-df66-4b14-83d7-4e65066db0ec tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:09.132740 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-82919ece-df66-4b14-83d7-4e65066db0ec tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: 31374b92-f615-4a5e-8ff3-edc572a4339d] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:09.140099 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82919ece-df66-4b14-83d7-4e65066db0ec tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:09.140633 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82919ece-df66-4b14-83d7-4e65066db0ec tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:09.141074 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82919ece-df66-4b14-83d7-4e65066db0ec tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:09.141790 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82919ece-df66-4b14-83d7-4e65066db0ec tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:09.142286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82919ece-df66-4b14-83d7-4e65066db0ec tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:09.142876 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-82919ece-df66-4b14-83d7-4e65066db0ec tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:09.221604 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-82919ece-df66-4b14-83d7-4e65066db0ec tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:05:09.233046 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-82919ece-df66-4b14-83d7-4e65066db0ec tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d" status: 200 len: 1347 microversion: 2.1 time: 0.104798 Aug 04 18:05:09.234172 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3670/7307] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:05:09 2022] GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d => generated 1347 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:05:10.264223 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-773969cb-4a0e-4bec-b8e0-1aef52191ebc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:10.265442 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-773969cb-4a0e-4bec-b8e0-1aef52191ebc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: 31374b92-f615-4a5e-8ff3-edc572a4339d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:10.273122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-773969cb-4a0e-4bec-b8e0-1aef52191ebc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:10.273629 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-773969cb-4a0e-4bec-b8e0-1aef52191ebc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:10.274905 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-773969cb-4a0e-4bec-b8e0-1aef52191ebc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:10.275901 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-773969cb-4a0e-4bec-b8e0-1aef52191ebc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:10.276424 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-773969cb-4a0e-4bec-b8e0-1aef52191ebc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:10.276918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-773969cb-4a0e-4bec-b8e0-1aef52191ebc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:10.298158 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-773969cb-4a0e-4bec-b8e0-1aef52191ebc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] HTTP exception thrown: Instance 31374b92-f615-4a5e-8ff3-edc572a4339d could not be found. Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-773969cb-4a0e-4bec-b8e0-1aef52191ebc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Request method failure captured: Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d HTTP/1.1 Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7An_otiHK2ul9j7uu3DbZiQwKHZoJnCABaxZQ1j33ADFutxnP9qH3tA0_O3WDz-NYjhD_IGD19X5FOGLVkzHh1byB4mJ2wWSs6LxSDVUZ53mUHf7zDJWDFOWugGZh2K0Hovjbew9lhQfvZlvGOV0rn1mVNJNAD7pmB3wUx3Ug--yBgo Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 86184ad6a9c64d18a82356f3f571f1f4 Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TestEncryptedCinderVolumes-610820164 Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86184ad6a9c64d18a82356f3f571f1f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86184ad6a9c64d18a82356f3f571f1f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_86184ad6a9c64d18a82356f3f571f1f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/86184ad6a9c64d18a82356f3f571f1f4"}]}] Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TestEncryptedCinderVolumes-610820164 Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 86184ad6a9c64d18a82356f3f571f1f4 Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-610820164 Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TestEncryptedCinderVolumes-610820164-project Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 55a7e47902524f3089a33bf65870229e Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TestEncryptedCinderVolumes-610820164-project Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 31374b92-f615-4a5e-8ff3-edc572a4339d could not be found. Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '31374b92-f615-4a5e-8ff3-edc572a4339d'} Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31374b92-f615-4a5e-8ff3-edc572a4339d could not be found. Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31374b92-f615-4a5e-8ff3-edc572a4339d could not be found. Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:05:10.299934 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:05:10.307698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:05:10.307698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:05:10.307698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:05:10.307698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:05:10.307698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:05:10.307698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31374b92-f615-4a5e-8ff3-edc572a4339d could not be found. Aug 04 18:05:10.307698 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:05:10.307698 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-773969cb-4a0e-4bec-b8e0-1aef52191ebc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Returning 404 to user: Instance 31374b92-f615-4a5e-8ff3-edc572a4339d could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:05:10.307698 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-773969cb-4a0e-4bec-b8e0-1aef52191ebc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d" status: 404 len: 111 microversion: 2.1 time: 0.046538 Aug 04 18:05:10.307698 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3638/7308] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:05:10 2022] GET /compute/v2.1/servers/31374b92-f615-4a5e-8ff3-edc572a4339d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 18:05:10.314485 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9447a574-54d1-4b65-ba61-45c8a610028d tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '.version_select at 0x7f1e5a825af0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:10.340666 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9447a574-54d1-4b65-ba61-45c8a610028d tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1264381417" status: 202 len: 0 microversion: 2.1 time: 0.032588 Aug 04 18:05:10.341271 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3671/7309] 10.222.0.93 () {58 vars in 1278 bytes} [Thu Aug 4 18:05:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1264381417 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 18:05:10.361680 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-18c8f7a2-cd0d-4847-89aa-d7345f1c2a43 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Action: 'create', calling method: .version_select at 0x7f1e5a2e7040>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-681659439", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFR5sxTsky9fi3KGACRIbc7MBBysCqNxjMHumCrDipQjs6dzn5Yo+/SziEYZ5n01uDo+5+qf4VQjktpOSpB215NwzuGXFg3M/XJD4bUXXJ8v7cZMdfMULEg5O24Sc8BGg=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:05:10.380325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-18c8f7a2-cd0d-4847-89aa-d7345f1c2a43 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Getting quotas for project 86184ad6a9c64d18a82356f3f571f1f4. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 18:05:10.387392 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-18c8f7a2-cd0d-4847-89aa-d7345f1c2a43 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Getting quotas for user 55a7e47902524f3089a33bf65870229e and project 86184ad6a9c64d18a82356f3f571f1f4. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 18:05:10.417442 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-18c8f7a2-cd0d-4847-89aa-d7345f1c2a43 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.059787 Aug 04 18:05:10.418115 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3639/7310] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 18:05:10 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:05:10.491854 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-25a53cfb-c467-4880-8feb-04151ff6da21 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-19690256", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-681659439", "networks": [{"uuid": "fc0ba368-22b5-4300-bfe5-4bc297708e32"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:05:10.579216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-25a53cfb-c467-4880-8feb-04151ff6da21 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] validate_networks() for [('fc0ba368-22b5-4300-bfe5-4bc297708e32', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 18:05:11.182114 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-25a53cfb-c467-4880-8feb-04151ff6da21 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 18:05:11.182705 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-25a53cfb-c467-4880-8feb-04151ff6da21 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 18:05:11.183295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-25a53cfb-c467-4880-8feb-04151ff6da21 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 18:05:11.183926 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-25a53cfb-c467-4880-8feb-04151ff6da21 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 18:05:11.184467 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-25a53cfb-c467-4880-8feb-04151ff6da21 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 18:05:11.193799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25a53cfb-c467-4880-8feb-04151ff6da21 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:11.194323 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25a53cfb-c467-4880-8feb-04151ff6da21 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:11.194765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25a53cfb-c467-4880-8feb-04151ff6da21 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:11.195505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25a53cfb-c467-4880-8feb-04151ff6da21 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:11.195970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25a53cfb-c467-4880-8feb-04151ff6da21 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:11.196447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25a53cfb-c467-4880-8feb-04151ff6da21 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:11.214559 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-25a53cfb-c467-4880-8feb-04151ff6da21 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Getting quotas for project 86184ad6a9c64d18a82356f3f571f1f4. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 18:05:11.220450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-25a53cfb-c467-4880-8feb-04151ff6da21 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Getting quotas for user 55a7e47902524f3089a33bf65870229e and project 86184ad6a9c64d18a82356f3f571f1f4. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 18:05:11.234786 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-25a53cfb-c467-4880-8feb-04151ff6da21 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 18:05:11.237108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-25a53cfb-c467-4880-8feb-04151ff6da21 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: ee41a1e5-08c6-49c0-be44-9520f4e89fd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 18:05:11.286479 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-25a53cfb-c467-4880-8feb-04151ff6da21 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.801991 Aug 04 18:05:11.287153 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3672/7311] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 18:05:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 18:05:11.300770 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2b1d6fde-a7e2-497e-b93a-c087849d96a2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:11.301516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2b1d6fde-a7e2-497e-b93a-c087849d96a2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: ee41a1e5-08c6-49c0-be44-9520f4e89fd9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:11.375330 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2b1d6fde-a7e2-497e-b93a-c087849d96a2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:05:11.385041 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2b1d6fde-a7e2-497e-b93a-c087849d96a2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9" status: 200 len: 1260 microversion: 2.1 time: 0.089043 Aug 04 18:05:11.386012 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3640/7312] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:05:11 2022] GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9 => generated 1260 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:05:12.419099 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d83ac652-23b3-4be1-a822-81eece6ed9fc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:12.420003 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d83ac652-23b3-4be1-a822-81eece6ed9fc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: ee41a1e5-08c6-49c0-be44-9520f4e89fd9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:12.428252 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d83ac652-23b3-4be1-a822-81eece6ed9fc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:12.429085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d83ac652-23b3-4be1-a822-81eece6ed9fc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:12.429216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d83ac652-23b3-4be1-a822-81eece6ed9fc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:12.430004 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d83ac652-23b3-4be1-a822-81eece6ed9fc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:12.430452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d83ac652-23b3-4be1-a822-81eece6ed9fc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:12.430952 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d83ac652-23b3-4be1-a822-81eece6ed9fc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:12.506264 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d83ac652-23b3-4be1-a822-81eece6ed9fc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:05:12.517760 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d83ac652-23b3-4be1-a822-81eece6ed9fc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9" status: 200 len: 1320 microversion: 2.1 time: 0.103914 Aug 04 18:05:12.530437 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3673/7313] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:05:12 2022] GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9 => generated 1320 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:05:13.542865 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-49b3931d-d942-4688-a41e-92b1433b87d4 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:13.544134 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-49b3931d-d942-4688-a41e-92b1433b87d4 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: ee41a1e5-08c6-49c0-be44-9520f4e89fd9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:13.552506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49b3931d-d942-4688-a41e-92b1433b87d4 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:13.553484 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49b3931d-d942-4688-a41e-92b1433b87d4 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:13.554059 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49b3931d-d942-4688-a41e-92b1433b87d4 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:13.555222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49b3931d-d942-4688-a41e-92b1433b87d4 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:13.556649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49b3931d-d942-4688-a41e-92b1433b87d4 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:13.557162 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49b3931d-d942-4688-a41e-92b1433b87d4 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:13.756660 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-49b3931d-d942-4688-a41e-92b1433b87d4 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:05:13.767264 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-49b3931d-d942-4688-a41e-92b1433b87d4 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9" status: 200 len: 1360 microversion: 2.1 time: 0.229419 Aug 04 18:05:13.768325 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3641/7314] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:05:13 2022] GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9 => generated 1360 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:05:14.169040 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-5d6f0191-d2ad-471c-8f6b-f277ae973e31 req-427b4423-6b2f-4b7e-89dd-20f917491a99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee41a1e5-08c6-49c0-be44-9520f4e89fd9", "tag": "d8e5d10c-fc3d-48cd-bbe8-f9adfff5878b"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:05:14.190954 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-5d6f0191-d2ad-471c-8f6b-f277ae973e31 req-427b4423-6b2f-4b7e-89dd-20f917491a99 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:14.191835 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-5d6f0191-d2ad-471c-8f6b-f277ae973e31 req-427b4423-6b2f-4b7e-89dd-20f917491a99 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:14.192518 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-5d6f0191-d2ad-471c-8f6b-f277ae973e31 req-427b4423-6b2f-4b7e-89dd-20f917491a99 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:14.212656 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-5d6f0191-d2ad-471c-8f6b-f277ae973e31 req-427b4423-6b2f-4b7e-89dd-20f917491a99 service nova] Creating event network-changed:d8e5d10c-fc3d-48cd-bbe8-f9adfff5878b for instance ee41a1e5-08c6-49c0-be44-9520f4e89fd9 on n-h1-851359-3 Aug 04 18:05:14.218296 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-5d6f0191-d2ad-471c-8f6b-f277ae973e31 req-427b4423-6b2f-4b7e-89dd-20f917491a99 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055750 Aug 04 18:05:14.219800 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3674/7315] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:05:14.796866 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0e421b60-5ca7-40e2-8657-b2baf798cbd5 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:14.797495 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0e421b60-5ca7-40e2-8657-b2baf798cbd5 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: ee41a1e5-08c6-49c0-be44-9520f4e89fd9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:14.803981 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e421b60-5ca7-40e2-8657-b2baf798cbd5 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:14.804485 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e421b60-5ca7-40e2-8657-b2baf798cbd5 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:14.804930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e421b60-5ca7-40e2-8657-b2baf798cbd5 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:14.805648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e421b60-5ca7-40e2-8657-b2baf798cbd5 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:14.806218 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e421b60-5ca7-40e2-8657-b2baf798cbd5 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:14.806655 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e421b60-5ca7-40e2-8657-b2baf798cbd5 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:14.962516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0e421b60-5ca7-40e2-8657-b2baf798cbd5 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:05:14.972147 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0e421b60-5ca7-40e2-8657-b2baf798cbd5 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9" status: 200 len: 1360 microversion: 2.1 time: 0.182775 Aug 04 18:05:14.973208 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3642/7316] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:05:14 2022] GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9 => generated 1360 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:05:15.998577 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a699e5f5-8e12-4937-85db-2abecd85cbe0 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:16.000257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a699e5f5-8e12-4937-85db-2abecd85cbe0 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: ee41a1e5-08c6-49c0-be44-9520f4e89fd9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:16.009064 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a699e5f5-8e12-4937-85db-2abecd85cbe0 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:16.009588 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a699e5f5-8e12-4937-85db-2abecd85cbe0 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:16.010098 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a699e5f5-8e12-4937-85db-2abecd85cbe0 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:16.010823 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a699e5f5-8e12-4937-85db-2abecd85cbe0 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:16.011294 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a699e5f5-8e12-4937-85db-2abecd85cbe0 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:16.011738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a699e5f5-8e12-4937-85db-2abecd85cbe0 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:16.157757 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a699e5f5-8e12-4937-85db-2abecd85cbe0 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:05:16.166570 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a699e5f5-8e12-4937-85db-2abecd85cbe0 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9" status: 200 len: 1360 microversion: 2.1 time: 0.176573 Aug 04 18:05:16.167471 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3675/7317] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:05:15 2022] GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9 => generated 1360 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:05:17.190332 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6d2872c9-3cf0-4472-a48e-cc53b6d06cce tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:17.190947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6d2872c9-3cf0-4472-a48e-cc53b6d06cce tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: ee41a1e5-08c6-49c0-be44-9520f4e89fd9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:17.198355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d2872c9-3cf0-4472-a48e-cc53b6d06cce tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:17.198854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d2872c9-3cf0-4472-a48e-cc53b6d06cce tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:17.199371 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d2872c9-3cf0-4472-a48e-cc53b6d06cce tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:17.200097 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d2872c9-3cf0-4472-a48e-cc53b6d06cce tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:17.200571 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d2872c9-3cf0-4472-a48e-cc53b6d06cce tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:17.201083 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d2872c9-3cf0-4472-a48e-cc53b6d06cce tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:17.394853 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6d2872c9-3cf0-4472-a48e-cc53b6d06cce tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:05:17.410947 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6d2872c9-3cf0-4472-a48e-cc53b6d06cce tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9" status: 200 len: 1360 microversion: 2.1 time: 0.225371 Aug 04 18:05:17.411559 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3643/7318] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:05:17 2022] GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9 => generated 1360 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:05:18.436983 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-47828a6d-77a7-4be9-a798-5ef075402fb4 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:18.438033 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-47828a6d-77a7-4be9-a798-5ef075402fb4 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: ee41a1e5-08c6-49c0-be44-9520f4e89fd9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:18.450393 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47828a6d-77a7-4be9-a798-5ef075402fb4 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:18.451474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47828a6d-77a7-4be9-a798-5ef075402fb4 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:18.452340 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47828a6d-77a7-4be9-a798-5ef075402fb4 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:18.453696 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47828a6d-77a7-4be9-a798-5ef075402fb4 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:18.454654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47828a6d-77a7-4be9-a798-5ef075402fb4 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:18.455482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-47828a6d-77a7-4be9-a798-5ef075402fb4 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:18.461720 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-8d46294e-8ce2-4ad9-9c21-3584e4e45e8c req-a9328e3a-54d4-4e29-a425-17721cf30a1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee41a1e5-08c6-49c0-be44-9520f4e89fd9", "name": "network-vif-plugged", "status": "completed", "tag": "d8e5d10c-fc3d-48cd-bbe8-f9adfff5878b"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:05:18.474886 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8d46294e-8ce2-4ad9-9c21-3584e4e45e8c req-a9328e3a-54d4-4e29-a425-17721cf30a1e service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:18.475491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8d46294e-8ce2-4ad9-9c21-3584e4e45e8c req-a9328e3a-54d4-4e29-a425-17721cf30a1e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:18.476207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8d46294e-8ce2-4ad9-9c21-3584e4e45e8c req-a9328e3a-54d4-4e29-a425-17721cf30a1e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:18.502945 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-8d46294e-8ce2-4ad9-9c21-3584e4e45e8c req-a9328e3a-54d4-4e29-a425-17721cf30a1e service nova] Creating event network-vif-plugged:d8e5d10c-fc3d-48cd-bbe8-f9adfff5878b for instance ee41a1e5-08c6-49c0-be44-9520f4e89fd9 on n-h1-851359-3 Aug 04 18:05:18.512769 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-8d46294e-8ce2-4ad9-9c21-3584e4e45e8c req-a9328e3a-54d4-4e29-a425-17721cf30a1e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056067 Aug 04 18:05:18.513630 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3644/7319] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:05:18.657236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-47828a6d-77a7-4be9-a798-5ef075402fb4 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:05:18.667712 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-47828a6d-77a7-4be9-a798-5ef075402fb4 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9" status: 200 len: 1360 microversion: 2.1 time: 0.238846 Aug 04 18:05:18.668479 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3676/7320] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:05:18 2022] GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9 => generated 1360 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:05:19.695345 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-21594e8a-592c-4deb-a654-4e676420c7d6 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:19.696268 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-21594e8a-592c-4deb-a654-4e676420c7d6 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: ee41a1e5-08c6-49c0-be44-9520f4e89fd9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:19.706608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21594e8a-592c-4deb-a654-4e676420c7d6 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:19.707522 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21594e8a-592c-4deb-a654-4e676420c7d6 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:19.708307 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21594e8a-592c-4deb-a654-4e676420c7d6 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:19.709511 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21594e8a-592c-4deb-a654-4e676420c7d6 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:19.710293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21594e8a-592c-4deb-a654-4e676420c7d6 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:19.710999 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21594e8a-592c-4deb-a654-4e676420c7d6 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:19.906279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-21594e8a-592c-4deb-a654-4e676420c7d6 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:05:19.919194 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-21594e8a-592c-4deb-a654-4e676420c7d6 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9" status: 200 len: 1360 microversion: 2.1 time: 0.230918 Aug 04 18:05:19.920093 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3645/7321] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:05:19 2022] GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9 => generated 1360 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:05:20.951180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a4b9599d-d07c-454b-be68-b1f4a0c654d9 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:20.952216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a4b9599d-d07c-454b-be68-b1f4a0c654d9 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: ee41a1e5-08c6-49c0-be44-9520f4e89fd9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:20.963929 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a4b9599d-d07c-454b-be68-b1f4a0c654d9 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:20.964748 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a4b9599d-d07c-454b-be68-b1f4a0c654d9 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:20.965528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a4b9599d-d07c-454b-be68-b1f4a0c654d9 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:20.966824 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a4b9599d-d07c-454b-be68-b1f4a0c654d9 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:20.967840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a4b9599d-d07c-454b-be68-b1f4a0c654d9 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:20.968327 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a4b9599d-d07c-454b-be68-b1f4a0c654d9 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:21.159943 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a4b9599d-d07c-454b-be68-b1f4a0c654d9 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:05:21.170192 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a4b9599d-d07c-454b-be68-b1f4a0c654d9 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9" status: 200 len: 1552 microversion: 2.1 time: 0.225317 Aug 04 18:05:21.170847 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3677/7322] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:05:20 2022] GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9 => generated 1552 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:05:21.197215 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-93a489c6-df24-42b7-8191-9ee8eff6765a tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:21.198492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-93a489c6-df24-42b7-8191-9ee8eff6765a tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: ee41a1e5-08c6-49c0-be44-9520f4e89fd9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:21.211206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93a489c6-df24-42b7-8191-9ee8eff6765a tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:21.212580 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93a489c6-df24-42b7-8191-9ee8eff6765a tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:21.213414 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93a489c6-df24-42b7-8191-9ee8eff6765a tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:21.214764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93a489c6-df24-42b7-8191-9ee8eff6765a tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:21.215692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93a489c6-df24-42b7-8191-9ee8eff6765a tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:21.216489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93a489c6-df24-42b7-8191-9ee8eff6765a tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:21.382297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:05:21.397998 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-93a489c6-df24-42b7-8191-9ee8eff6765a tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:05:21.409133 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-93a489c6-df24-42b7-8191-9ee8eff6765a tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9" status: 200 len: 1552 microversion: 2.1 time: 0.220252 Aug 04 18:05:21.409807 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3646/7323] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:05:21 2022] GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9 => generated 1552 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:05:24.191567 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-126b0ff7-46da-42fc-8097-89bae542c5b6 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d6a4b90-edbc-4d8a-9975-509b37d268e4"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:05:24.195002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-126b0ff7-46da-42fc-8097-89bae542c5b6 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: ee41a1e5-08c6-49c0-be44-9520f4e89fd9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:24.197998 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:05:24.199061 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:05:24.209795 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-126b0ff7-46da-42fc-8097-89bae542c5b6 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:24.210557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-126b0ff7-46da-42fc-8097-89bae542c5b6 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:24.211196 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-126b0ff7-46da-42fc-8097-89bae542c5b6 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:24.212357 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-126b0ff7-46da-42fc-8097-89bae542c5b6 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:24.213327 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-126b0ff7-46da-42fc-8097-89bae542c5b6 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:24.215029 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-126b0ff7-46da-42fc-8097-89bae542c5b6 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:24.585006 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-126b0ff7-46da-42fc-8097-89bae542c5b6 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "POST /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.399164 Aug 04 18:05:24.586174 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3678/7324] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Aug 4 18:05:24 2022] POST /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9/os-volume_attachments => generated 194 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:05:36.680563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-76f78dbb-f317-4175-b783-fa165e5e84ed tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:36.681330 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-76f78dbb-f317-4175-b783-fa165e5e84ed tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: ee41a1e5-08c6-49c0-be44-9520f4e89fd9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:36.685129 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:05:36.686263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:05:36.694689 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76f78dbb-f317-4175-b783-fa165e5e84ed tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:36.695234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76f78dbb-f317-4175-b783-fa165e5e84ed tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:36.696359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76f78dbb-f317-4175-b783-fa165e5e84ed tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:36.697544 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76f78dbb-f317-4175-b783-fa165e5e84ed tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:36.698367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76f78dbb-f317-4175-b783-fa165e5e84ed tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:36.698865 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76f78dbb-f317-4175-b783-fa165e5e84ed tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:36.812004 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-76f78dbb-f317-4175-b783-fa165e5e84ed tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lazy-loading 'services' on Instance uuid ee41a1e5-08c6-49c0-be44-9520f4e89fd9 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 18:05:36.903827 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-76f78dbb-f317-4175-b783-fa165e5e84ed tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "DELETE /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9/os-volume_attachments/3d6a4b90-edbc-4d8a-9975-509b37d268e4" status: 202 len: 0 microversion: 2.1 time: 0.229676 Aug 04 18:05:36.904584 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3647/7325] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Aug 4 18:05:36 2022] DELETE /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9/os-volume_attachments/3d6a4b90-edbc-4d8a-9975-509b37d268e4 => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 18:05:36.913481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:05:36.915832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:05:36.922716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6db3e97c-27a1-4bf1-b58b-bae4c12351d5 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:36.925374 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6db3e97c-27a1-4bf1-b58b-bae4c12351d5 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: ee41a1e5-08c6-49c0-be44-9520f4e89fd9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:36.937569 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6db3e97c-27a1-4bf1-b58b-bae4c12351d5 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:36.938091 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6db3e97c-27a1-4bf1-b58b-bae4c12351d5 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:36.938543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6db3e97c-27a1-4bf1-b58b-bae4c12351d5 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:36.939257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6db3e97c-27a1-4bf1-b58b-bae4c12351d5 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:36.939761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6db3e97c-27a1-4bf1-b58b-bae4c12351d5 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:36.940285 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6db3e97c-27a1-4bf1-b58b-bae4c12351d5 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:36.982266 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6db3e97c-27a1-4bf1-b58b-bae4c12351d5 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071345 Aug 04 18:05:36.982871 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3679/7326] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 18:05:36 2022] GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:05:38.003095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-33d3d630-4964-4d41-830a-7436f25ca56f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:38.010560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-33d3d630-4964-4d41-830a-7436f25ca56f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: ee41a1e5-08c6-49c0-be44-9520f4e89fd9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:38.021057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33d3d630-4964-4d41-830a-7436f25ca56f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:38.021759 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33d3d630-4964-4d41-830a-7436f25ca56f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:38.022378 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33d3d630-4964-4d41-830a-7436f25ca56f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:38.023481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33d3d630-4964-4d41-830a-7436f25ca56f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:38.024145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33d3d630-4964-4d41-830a-7436f25ca56f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:38.024734 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33d3d630-4964-4d41-830a-7436f25ca56f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:38.088327 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-33d3d630-4964-4d41-830a-7436f25ca56f tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094209 Aug 04 18:05:38.092365 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3648/7327] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 18:05:37 2022] GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:05:39.109881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ab0d8d77-947c-4e2d-95c5-7972931fea7c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:39.114013 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ab0d8d77-947c-4e2d-95c5-7972931fea7c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: ee41a1e5-08c6-49c0-be44-9520f4e89fd9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:39.128207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ab0d8d77-947c-4e2d-95c5-7972931fea7c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:39.128921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ab0d8d77-947c-4e2d-95c5-7972931fea7c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:39.129738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ab0d8d77-947c-4e2d-95c5-7972931fea7c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:39.131119 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ab0d8d77-947c-4e2d-95c5-7972931fea7c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:39.131969 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ab0d8d77-947c-4e2d-95c5-7972931fea7c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:39.132649 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ab0d8d77-947c-4e2d-95c5-7972931fea7c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:39.176590 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ab0d8d77-947c-4e2d-95c5-7972931fea7c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075090 Aug 04 18:05:39.177206 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3680/7328] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 18:05:39 2022] GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:05:40.193807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-393067d3-6c46-4cb0-a0b9-39dee218afc2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:40.197823 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-393067d3-6c46-4cb0-a0b9-39dee218afc2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: ee41a1e5-08c6-49c0-be44-9520f4e89fd9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:40.206430 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-393067d3-6c46-4cb0-a0b9-39dee218afc2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:40.206946 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-393067d3-6c46-4cb0-a0b9-39dee218afc2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:40.207496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-393067d3-6c46-4cb0-a0b9-39dee218afc2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:40.208275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-393067d3-6c46-4cb0-a0b9-39dee218afc2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:40.208776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-393067d3-6c46-4cb0-a0b9-39dee218afc2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:40.209353 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-393067d3-6c46-4cb0-a0b9-39dee218afc2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:40.255291 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-393067d3-6c46-4cb0-a0b9-39dee218afc2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066800 Aug 04 18:05:40.256393 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3649/7329] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 18:05:40 2022] GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:05:41.274449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-851d9855-e01c-4a49-911f-4505a8c17bad tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:41.279418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-851d9855-e01c-4a49-911f-4505a8c17bad tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: ee41a1e5-08c6-49c0-be44-9520f4e89fd9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:41.288472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-851d9855-e01c-4a49-911f-4505a8c17bad tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:41.289055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-851d9855-e01c-4a49-911f-4505a8c17bad tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:41.289543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-851d9855-e01c-4a49-911f-4505a8c17bad tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:41.290734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-851d9855-e01c-4a49-911f-4505a8c17bad tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:41.291618 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-851d9855-e01c-4a49-911f-4505a8c17bad tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:41.292530 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-851d9855-e01c-4a49-911f-4505a8c17bad tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:41.349258 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-851d9855-e01c-4a49-911f-4505a8c17bad tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080990 Aug 04 18:05:41.350728 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3681/7330] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 18:05:41 2022] GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:05:42.370471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c86e20c2-4f68-40c9-bfc4-461c3b07af69 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:42.373010 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c86e20c2-4f68-40c9-bfc4-461c3b07af69 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: ee41a1e5-08c6-49c0-be44-9520f4e89fd9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:42.382440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c86e20c2-4f68-40c9-bfc4-461c3b07af69 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:42.383891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c86e20c2-4f68-40c9-bfc4-461c3b07af69 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:42.384737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c86e20c2-4f68-40c9-bfc4-461c3b07af69 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:42.386063 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c86e20c2-4f68-40c9-bfc4-461c3b07af69 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:42.386906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c86e20c2-4f68-40c9-bfc4-461c3b07af69 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:42.387677 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c86e20c2-4f68-40c9-bfc4-461c3b07af69 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:42.446294 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c86e20c2-4f68-40c9-bfc4-461c3b07af69 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082915 Aug 04 18:05:42.447423 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3650/7331] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 18:05:42 2022] GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:05:43.466808 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a63a89c4-61fd-44a0-b956-4773bd6c40c3 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:43.469734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a63a89c4-61fd-44a0-b956-4773bd6c40c3 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: ee41a1e5-08c6-49c0-be44-9520f4e89fd9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:43.482449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a63a89c4-61fd-44a0-b956-4773bd6c40c3 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:43.482898 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a63a89c4-61fd-44a0-b956-4773bd6c40c3 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:43.483782 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a63a89c4-61fd-44a0-b956-4773bd6c40c3 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:43.484919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a63a89c4-61fd-44a0-b956-4773bd6c40c3 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:43.485695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a63a89c4-61fd-44a0-b956-4773bd6c40c3 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:43.486495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a63a89c4-61fd-44a0-b956-4773bd6c40c3 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:43.529211 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a63a89c4-61fd-44a0-b956-4773bd6c40c3 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068477 Aug 04 18:05:43.529812 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3682/7332] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 18:05:43 2022] GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 18:05:43.546087 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aac0106b-0508-4359-a5e0-ff27305f77f2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:43.546903 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aac0106b-0508-4359-a5e0-ff27305f77f2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: ee41a1e5-08c6-49c0-be44-9520f4e89fd9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:43.554336 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aac0106b-0508-4359-a5e0-ff27305f77f2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:43.555025 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aac0106b-0508-4359-a5e0-ff27305f77f2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:43.555644 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aac0106b-0508-4359-a5e0-ff27305f77f2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:43.556381 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aac0106b-0508-4359-a5e0-ff27305f77f2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:43.556902 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aac0106b-0508-4359-a5e0-ff27305f77f2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:43.557352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aac0106b-0508-4359-a5e0-ff27305f77f2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:43.671735 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-aac0106b-0508-4359-a5e0-ff27305f77f2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] HTTP exception thrown: Instance ee41a1e5-08c6-49c0-be44-9520f4e89fd9 is not attached to volume 3d6a4b90-edbc-4d8a-9975-509b37d268e4 Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aac0106b-0508-4359-a5e0-ff27305f77f2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Request method failure captured: Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9/os-volume_attachments/3d6a4b90-edbc-4d8a-9975-509b37d268e4 HTTP/1.1 Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7An_otiHK2ul9j7uu3DbZiQwKHZoJnCABaxZQ1j33ADFutxnP9qH3tA0_O3WDz-NYjhD_IGD19X5FOGLVkzHh1byB4mJ2wWSs6LxSDVUZ53mUHf7zDJWDFOWugGZh2K0Hovjbew9lhQfvZlvGOV0rn1mVNJNAD7pmB3wUx3Ug--yBgo Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 86184ad6a9c64d18a82356f3f571f1f4 Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TestEncryptedCinderVolumes-610820164 Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86184ad6a9c64d18a82356f3f571f1f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86184ad6a9c64d18a82356f3f571f1f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_86184ad6a9c64d18a82356f3f571f1f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/86184ad6a9c64d18a82356f3f571f1f4"}]}] Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TestEncryptedCinderVolumes-610820164 Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 86184ad6a9c64d18a82356f3f571f1f4 Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-610820164 Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TestEncryptedCinderVolumes-610820164-project Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 55a7e47902524f3089a33bf65870229e Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TestEncryptedCinderVolumes-610820164-project Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance ee41a1e5-08c6-49c0-be44-9520f4e89fd9 is not attached to volume 3d6a4b90-edbc-4d8a-9975-509b37d268e4 Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'server_id': 'ee41a1e5-08c6-49c0-be44-9520f4e89fd9', 'id': '3d6a4b90-edbc-4d8a-9975-509b37d268e4'} Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3d6a4b90-edbc-4d8a-9975-509b37d268e4. Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee41a1e5-08c6-49c0-be44-9520f4e89fd9 is not attached to volume 3d6a4b90-edbc-4d8a-9975-509b37d268e4 Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:05:43.675127 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:05:43.683368 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:05:43.683368 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:05:43.683368 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee41a1e5-08c6-49c0-be44-9520f4e89fd9 is not attached to volume 3d6a4b90-edbc-4d8a-9975-509b37d268e4 Aug 04 18:05:43.683368 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:05:43.683368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aac0106b-0508-4359-a5e0-ff27305f77f2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Returning 404 to user: Instance ee41a1e5-08c6-49c0-be44-9520f4e89fd9 is not attached to volume 3d6a4b90-edbc-4d8a-9975-509b37d268e4 {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:05:43.683368 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aac0106b-0508-4359-a5e0-ff27305f77f2 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "DELETE /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9/os-volume_attachments/3d6a4b90-edbc-4d8a-9975-509b37d268e4" status: 404 len: 154 microversion: 2.1 time: 0.135794 Aug 04 18:05:43.683368 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3651/7333] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Aug 4 18:05:43 2022] DELETE /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9/os-volume_attachments/3d6a4b90-edbc-4d8a-9975-509b37d268e4 => generated 154 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 18:05:48.298500 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ecb98752-220b-4e04-8650-4b735ac7b41c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:48.299336 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ecb98752-220b-4e04-8650-4b735ac7b41c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: ee41a1e5-08c6-49c0-be44-9520f4e89fd9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:48.311341 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecb98752-220b-4e04-8650-4b735ac7b41c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:48.312338 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecb98752-220b-4e04-8650-4b735ac7b41c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:48.313057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecb98752-220b-4e04-8650-4b735ac7b41c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:48.314143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecb98752-220b-4e04-8650-4b735ac7b41c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:48.314769 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecb98752-220b-4e04-8650-4b735ac7b41c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:48.315521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecb98752-220b-4e04-8650-4b735ac7b41c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:48.357398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ecb98752-220b-4e04-8650-4b735ac7b41c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: ee41a1e5-08c6-49c0-be44-9520f4e89fd9] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 18:05:48.494956 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ecb98752-220b-4e04-8650-4b735ac7b41c tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "DELETE /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9" status: 204 len: 0 microversion: 2.1 time: 0.199913 Aug 04 18:05:48.495842 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3683/7334] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 18:05:48 2022] DELETE /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 18:05:48.510312 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-517460f0-074b-41f9-9600-3387dc072caf tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:48.511269 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-517460f0-074b-41f9-9600-3387dc072caf tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: ee41a1e5-08c6-49c0-be44-9520f4e89fd9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:48.522619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-517460f0-074b-41f9-9600-3387dc072caf tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:48.523713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-517460f0-074b-41f9-9600-3387dc072caf tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:48.524173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-517460f0-074b-41f9-9600-3387dc072caf tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:48.524919 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-517460f0-074b-41f9-9600-3387dc072caf tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:48.525395 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-517460f0-074b-41f9-9600-3387dc072caf tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:48.525839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-517460f0-074b-41f9-9600-3387dc072caf tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:48.717003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-517460f0-074b-41f9-9600-3387dc072caf tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:05:48.735766 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-517460f0-074b-41f9-9600-3387dc072caf tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9" status: 200 len: 1558 microversion: 2.1 time: 0.233066 Aug 04 18:05:48.737209 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3652/7335] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:05:48 2022] GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9 => generated 1558 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:05:49.765548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-16087cb8-df17-49b4-9d49-c2890d7dd086 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:49.766307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-16087cb8-df17-49b4-9d49-c2890d7dd086 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: ee41a1e5-08c6-49c0-be44-9520f4e89fd9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:49.774944 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16087cb8-df17-49b4-9d49-c2890d7dd086 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:49.775452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16087cb8-df17-49b4-9d49-c2890d7dd086 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:49.775904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16087cb8-df17-49b4-9d49-c2890d7dd086 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:49.776624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16087cb8-df17-49b4-9d49-c2890d7dd086 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:49.777087 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16087cb8-df17-49b4-9d49-c2890d7dd086 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:49.777524 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-16087cb8-df17-49b4-9d49-c2890d7dd086 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:49.947988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-16087cb8-df17-49b4-9d49-c2890d7dd086 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:05:49.956092 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-16087cb8-df17-49b4-9d49-c2890d7dd086 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9" status: 200 len: 1558 microversion: 2.1 time: 0.196073 Aug 04 18:05:49.956737 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3684/7336] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:05:49 2022] GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9 => generated 1558 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:05:50.986317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e60b70d5-c0ec-419d-82b6-9bfbc63588b6 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:50.988563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e60b70d5-c0ec-419d-82b6-9bfbc63588b6 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: ee41a1e5-08c6-49c0-be44-9520f4e89fd9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:51.001645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e60b70d5-c0ec-419d-82b6-9bfbc63588b6 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:51.002590 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e60b70d5-c0ec-419d-82b6-9bfbc63588b6 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:51.003415 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e60b70d5-c0ec-419d-82b6-9bfbc63588b6 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:51.004739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e60b70d5-c0ec-419d-82b6-9bfbc63588b6 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:51.005299 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e60b70d5-c0ec-419d-82b6-9bfbc63588b6 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:51.006126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e60b70d5-c0ec-419d-82b6-9bfbc63588b6 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:51.119753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e60b70d5-c0ec-419d-82b6-9bfbc63588b6 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7e47902524f3089a33bf65870229e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86184ad6a9c64d18a82356f3f571f1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:05:51.123895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-b16cec6e-99c2-41e2-9f4c-f76fa9712394 req-e8797b77-c684-4d61-ad82-f5a56cc17187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee41a1e5-08c6-49c0-be44-9520f4e89fd9", "name": "network-vif-deleted", "tag": "d8e5d10c-fc3d-48cd-bbe8-f9adfff5878b"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:05:51.129336 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e60b70d5-c0ec-419d-82b6-9bfbc63588b6 tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9" status: 200 len: 1516 microversion: 2.1 time: 0.151593 Aug 04 18:05:51.130551 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3653/7337] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:05:50 2022] GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:05:51.149724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b16cec6e-99c2-41e2-9f4c-f76fa9712394 req-e8797b77-c684-4d61-ad82-f5a56cc17187 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:51.150834 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b16cec6e-99c2-41e2-9f4c-f76fa9712394 req-e8797b77-c684-4d61-ad82-f5a56cc17187 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:51.152049 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b16cec6e-99c2-41e2-9f4c-f76fa9712394 req-e8797b77-c684-4d61-ad82-f5a56cc17187 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:51.171812 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-b16cec6e-99c2-41e2-9f4c-f76fa9712394 req-e8797b77-c684-4d61-ad82-f5a56cc17187 service nova] Creating event network-vif-deleted:d8e5d10c-fc3d-48cd-bbe8-f9adfff5878b for instance ee41a1e5-08c6-49c0-be44-9520f4e89fd9 on n-h1-851359-3 Aug 04 18:05:51.177859 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-b16cec6e-99c2-41e2-9f4c-f76fa9712394 req-e8797b77-c684-4d61-ad82-f5a56cc17187 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059743 Aug 04 18:05:51.178790 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3685/7338] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:05:52.168016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cfbfd1ca-3cec-4131-a116-a7f1acf707fc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:52.169157 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cfbfd1ca-3cec-4131-a116-a7f1acf707fc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] [instance: ee41a1e5-08c6-49c0-be44-9520f4e89fd9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:05:52.176222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfbfd1ca-3cec-4131-a116-a7f1acf707fc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:52.176733 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfbfd1ca-3cec-4131-a116-a7f1acf707fc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:52.177194 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfbfd1ca-3cec-4131-a116-a7f1acf707fc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:52.177941 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfbfd1ca-3cec-4131-a116-a7f1acf707fc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:05:52.178523 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfbfd1ca-3cec-4131-a116-a7f1acf707fc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:05:52.178979 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfbfd1ca-3cec-4131-a116-a7f1acf707fc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:05:52.198308 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-cfbfd1ca-3cec-4131-a116-a7f1acf707fc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] HTTP exception thrown: Instance ee41a1e5-08c6-49c0-be44-9520f4e89fd9 could not be found. Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cfbfd1ca-3cec-4131-a116-a7f1acf707fc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Request method failure captured: Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9 HTTP/1.1 Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7An_otiHK2ul9j7uu3DbZiQwKHZoJnCABaxZQ1j33ADFutxnP9qH3tA0_O3WDz-NYjhD_IGD19X5FOGLVkzHh1byB4mJ2wWSs6LxSDVUZ53mUHf7zDJWDFOWugGZh2K0Hovjbew9lhQfvZlvGOV0rn1mVNJNAD7pmB3wUx3Ug--yBgo Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 86184ad6a9c64d18a82356f3f571f1f4 Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TestEncryptedCinderVolumes-610820164 Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86184ad6a9c64d18a82356f3f571f1f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/86184ad6a9c64d18a82356f3f571f1f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_86184ad6a9c64d18a82356f3f571f1f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/86184ad6a9c64d18a82356f3f571f1f4"}]}] Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TestEncryptedCinderVolumes-610820164 Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 86184ad6a9c64d18a82356f3f571f1f4 Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-610820164 Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TestEncryptedCinderVolumes-610820164-project Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 55a7e47902524f3089a33bf65870229e Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TestEncryptedCinderVolumes-610820164-project Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance ee41a1e5-08c6-49c0-be44-9520f4e89fd9 could not be found. Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'ee41a1e5-08c6-49c0-be44-9520f4e89fd9'} Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee41a1e5-08c6-49c0-be44-9520f4e89fd9 could not be found. Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee41a1e5-08c6-49c0-be44-9520f4e89fd9 could not be found. Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:05:52.200320 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:05:52.205068 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:05:52.205068 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:05:52.205068 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:05:52.205068 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:05:52.205068 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:05:52.205068 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee41a1e5-08c6-49c0-be44-9520f4e89fd9 could not be found. Aug 04 18:05:52.205068 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:05:52.205068 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cfbfd1ca-3cec-4131-a116-a7f1acf707fc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Returning 404 to user: Instance ee41a1e5-08c6-49c0-be44-9520f4e89fd9 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:05:52.205068 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cfbfd1ca-3cec-4131-a116-a7f1acf707fc tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9" status: 404 len: 111 microversion: 2.1 time: 0.038313 Aug 04 18:05:52.205068 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3654/7339] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:05:52 2022] GET /compute/v2.1/servers/ee41a1e5-08c6-49c0-be44-9520f4e89fd9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 18:05:52.213653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c5fe8852-5226-4528-a8ef-ccde2961525a tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] Calling method '.version_select at 0x7f1e5a411a60>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:05:52.240680 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c5fe8852-5226-4528-a8ef-ccde2961525a tempest-TestEncryptedCinderVolumes-610820164 tempest-TestEncryptedCinderVolumes-610820164-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-681659439" status: 202 len: 0 microversion: 2.1 time: 0.032187 Aug 04 18:05:52.241296 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3686/7340] 10.222.0.93 () {58 vars in 1275 bytes} [Thu Aug 4 18:05:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-681659439 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 18:06:29.839668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6aaa62b4-3ef7-4ad1-8488-bb510af61c9d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Action: 'create', calling method: .version_select at 0x7f1e680e7820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-488740478", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBK8tOL7hejwDfLY/QsQNOrqNBB4Q+IS6QxsHkQIeTpeVBR3MXN5xg5Lro7I+6luHexe/UIPPWKw68G0p43j3SW5pL9tJcLb4LDUfeKoVz6G6L1rXsfk71xDbohOfA/WLg=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:06:29.845412 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=16 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:06:29.846107 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:06:29.861698 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-6aaa62b4-3ef7-4ad1-8488-bb510af61c9d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Getting quotas for project 5f56d86aa3c54de78d63221df7c9bb1f. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 18:06:29.870091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-6aaa62b4-3ef7-4ad1-8488-bb510af61c9d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Getting quotas for user fc6d59ce5a324ce2800ead7fe0d36697 and project 5f56d86aa3c54de78d63221df7c9bb1f. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 18:06:29.898458 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6aaa62b4-3ef7-4ad1-8488-bb510af61c9d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.063342 Aug 04 18:06:29.899098 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3655/7341] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 18:06:29 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:06:29.950500 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:06:29.951275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:06:29.956142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6d27ff74-6d5e-4c88-9d18-7cb29e599009 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-820651896", "imageRef": "c9731767-9308-40ee-bf7f-84f8e31c8f49", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-488740478", "networks": [{"uuid": "b4c6ab36-0367-4fec-9b2b-482bb5209715"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:06:30.015327 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-6d27ff74-6d5e-4c88-9d18-7cb29e599009 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] validate_networks() for [('b4c6ab36-0367-4fec-9b2b-482bb5209715', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 18:06:30.444068 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-6d27ff74-6d5e-4c88-9d18-7cb29e599009 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 18:06:30.444502 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-6d27ff74-6d5e-4c88-9d18-7cb29e599009 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 18:06:30.445270 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-6d27ff74-6d5e-4c88-9d18-7cb29e599009 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 18:06:30.445428 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-6d27ff74-6d5e-4c88-9d18-7cb29e599009 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 18:06:30.445822 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-6d27ff74-6d5e-4c88-9d18-7cb29e599009 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 18:06:30.457520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d27ff74-6d5e-4c88-9d18-7cb29e599009 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:30.458057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d27ff74-6d5e-4c88-9d18-7cb29e599009 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:30.458511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d27ff74-6d5e-4c88-9d18-7cb29e599009 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:30.459798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d27ff74-6d5e-4c88-9d18-7cb29e599009 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:30.460270 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d27ff74-6d5e-4c88-9d18-7cb29e599009 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:30.460710 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6d27ff74-6d5e-4c88-9d18-7cb29e599009 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:30.480760 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-6d27ff74-6d5e-4c88-9d18-7cb29e599009 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Getting quotas for project 5f56d86aa3c54de78d63221df7c9bb1f. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 18:06:30.486779 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-6d27ff74-6d5e-4c88-9d18-7cb29e599009 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Getting quotas for user fc6d59ce5a324ce2800ead7fe0d36697 and project 5f56d86aa3c54de78d63221df7c9bb1f. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 18:06:30.501413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6d27ff74-6d5e-4c88-9d18-7cb29e599009 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 18:06:30.503925 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6d27ff74-6d5e-4c88-9d18-7cb29e599009 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9731767-9308-40ee-bf7f-84f8e31c8f49',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 18:06:30.555021 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6d27ff74-6d5e-4c88-9d18-7cb29e599009 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606815 Aug 04 18:06:30.555775 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3687/7342] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 18:06:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 18:06:30.567118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f4e9e7c1-862b-446d-a89e-d0b2479ce419 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:06:30.567765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f4e9e7c1-862b-446d-a89e-d0b2479ce419 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:06:30.627847 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f4e9e7c1-862b-446d-a89e-d0b2479ce419 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:06:30.636021 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f4e9e7c1-862b-446d-a89e-d0b2479ce419 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef" status: 200 len: 1257 microversion: 2.1 time: 0.072952 Aug 04 18:06:30.636605 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3656/7343] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:06:30 2022] GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef => generated 1257 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:06:31.665897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dc79cf24-b535-400f-a221-72f4e14fd299 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:06:31.667115 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dc79cf24-b535-400f-a221-72f4e14fd299 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:06:31.679103 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc79cf24-b535-400f-a221-72f4e14fd299 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:31.679851 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc79cf24-b535-400f-a221-72f4e14fd299 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:31.680463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc79cf24-b535-400f-a221-72f4e14fd299 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:31.681365 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc79cf24-b535-400f-a221-72f4e14fd299 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:31.681994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc79cf24-b535-400f-a221-72f4e14fd299 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:31.682578 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc79cf24-b535-400f-a221-72f4e14fd299 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:31.758864 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dc79cf24-b535-400f-a221-72f4e14fd299 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:06:31.775779 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dc79cf24-b535-400f-a221-72f4e14fd299 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef" status: 200 len: 1317 microversion: 2.1 time: 0.118416 Aug 04 18:06:31.777342 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3688/7344] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:06:31 2022] GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef => generated 1317 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:06:32.802304 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e00693c0-3d85-4d96-8b54-816790c3809b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:06:32.805169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e00693c0-3d85-4d96-8b54-816790c3809b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:06:32.816558 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e00693c0-3d85-4d96-8b54-816790c3809b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:32.817427 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e00693c0-3d85-4d96-8b54-816790c3809b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:32.818934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e00693c0-3d85-4d96-8b54-816790c3809b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:32.820169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e00693c0-3d85-4d96-8b54-816790c3809b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:32.820906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e00693c0-3d85-4d96-8b54-816790c3809b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:32.821588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e00693c0-3d85-4d96-8b54-816790c3809b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:32.926372 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e00693c0-3d85-4d96-8b54-816790c3809b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:06:32.948931 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e00693c0-3d85-4d96-8b54-816790c3809b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef" status: 200 len: 1315 microversion: 2.1 time: 0.151800 Aug 04 18:06:32.962544 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3657/7345] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:06:32 2022] GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:06:33.982026 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-92f775b4-b40b-46eb-af63-a74cabc11181 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:06:33.982674 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-92f775b4-b40b-46eb-af63-a74cabc11181 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:06:33.992088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92f775b4-b40b-46eb-af63-a74cabc11181 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:33.992624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92f775b4-b40b-46eb-af63-a74cabc11181 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:33.993079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92f775b4-b40b-46eb-af63-a74cabc11181 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:33.993832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92f775b4-b40b-46eb-af63-a74cabc11181 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:33.994334 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92f775b4-b40b-46eb-af63-a74cabc11181 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:33.995005 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-92f775b4-b40b-46eb-af63-a74cabc11181 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:34.194656 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-92f775b4-b40b-46eb-af63-a74cabc11181 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:06:34.209085 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-92f775b4-b40b-46eb-af63-a74cabc11181 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef" status: 200 len: 1357 microversion: 2.1 time: 0.230679 Aug 04 18:06:34.222774 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3689/7346] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:06:33 2022] GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef => generated 1357 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:06:35.246347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b2d93bb1-48bb-45cd-89f6-6efccac390ae tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:06:35.248006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b2d93bb1-48bb-45cd-89f6-6efccac390ae tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:06:35.258180 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2d93bb1-48bb-45cd-89f6-6efccac390ae tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:35.258765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2d93bb1-48bb-45cd-89f6-6efccac390ae tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:35.259172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2d93bb1-48bb-45cd-89f6-6efccac390ae tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:35.259966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2d93bb1-48bb-45cd-89f6-6efccac390ae tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:35.260490 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2d93bb1-48bb-45cd-89f6-6efccac390ae tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:35.260945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2d93bb1-48bb-45cd-89f6-6efccac390ae tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:35.446580 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b2d93bb1-48bb-45cd-89f6-6efccac390ae tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:06:35.455616 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b2d93bb1-48bb-45cd-89f6-6efccac390ae tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef" status: 200 len: 1357 microversion: 2.1 time: 0.214487 Aug 04 18:06:35.457495 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3658/7347] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:06:35 2022] GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef => generated 1357 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:06:36.488104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dcbb25b8-5042-4dd7-8ea4-a02a15d4e548 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:06:36.488766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dcbb25b8-5042-4dd7-8ea4-a02a15d4e548 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:06:36.497400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcbb25b8-5042-4dd7-8ea4-a02a15d4e548 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:36.498054 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcbb25b8-5042-4dd7-8ea4-a02a15d4e548 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:36.498629 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcbb25b8-5042-4dd7-8ea4-a02a15d4e548 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:36.499505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcbb25b8-5042-4dd7-8ea4-a02a15d4e548 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:36.499976 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcbb25b8-5042-4dd7-8ea4-a02a15d4e548 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:36.500413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcbb25b8-5042-4dd7-8ea4-a02a15d4e548 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:36.661646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dcbb25b8-5042-4dd7-8ea4-a02a15d4e548 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:06:36.670427 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dcbb25b8-5042-4dd7-8ea4-a02a15d4e548 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef" status: 200 len: 1357 microversion: 2.1 time: 0.186199 Aug 04 18:06:36.671025 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3690/7348] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:06:36 2022] GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:06:37.706324 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3431eb10-6d83-4b8d-a9ec-9c4bf41b366b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:06:37.707332 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3431eb10-6d83-4b8d-a9ec-9c4bf41b366b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:06:37.716384 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3431eb10-6d83-4b8d-a9ec-9c4bf41b366b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:37.717078 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3431eb10-6d83-4b8d-a9ec-9c4bf41b366b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:37.717856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3431eb10-6d83-4b8d-a9ec-9c4bf41b366b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:37.719198 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3431eb10-6d83-4b8d-a9ec-9c4bf41b366b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:37.719959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3431eb10-6d83-4b8d-a9ec-9c4bf41b366b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:37.720706 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3431eb10-6d83-4b8d-a9ec-9c4bf41b366b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:37.962630 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3431eb10-6d83-4b8d-a9ec-9c4bf41b366b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:06:37.973030 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3431eb10-6d83-4b8d-a9ec-9c4bf41b366b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef" status: 200 len: 1357 microversion: 2.1 time: 0.272006 Aug 04 18:06:37.978329 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3659/7349] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:06:37 2022] GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef => generated 1357 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:06:38.997458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2075d006-46ed-4ad6-bc59-e844b392c233 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:06:38.998111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2075d006-46ed-4ad6-bc59-e844b392c233 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:06:39.006832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2075d006-46ed-4ad6-bc59-e844b392c233 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:39.007757 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2075d006-46ed-4ad6-bc59-e844b392c233 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:39.008447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2075d006-46ed-4ad6-bc59-e844b392c233 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:39.009619 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2075d006-46ed-4ad6-bc59-e844b392c233 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:39.010367 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2075d006-46ed-4ad6-bc59-e844b392c233 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:39.011055 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2075d006-46ed-4ad6-bc59-e844b392c233 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:39.258940 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2075d006-46ed-4ad6-bc59-e844b392c233 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:06:39.267339 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2075d006-46ed-4ad6-bc59-e844b392c233 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef" status: 200 len: 1357 microversion: 2.1 time: 0.273926 Aug 04 18:06:39.267983 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3691/7350] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:06:38 2022] GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef => generated 1357 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:06:40.288857 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cded5706-b144-4901-854d-578c0a4f734b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:06:40.289732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cded5706-b144-4901-854d-578c0a4f734b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:06:40.298297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cded5706-b144-4901-854d-578c0a4f734b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:40.298810 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cded5706-b144-4901-854d-578c0a4f734b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:40.299606 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cded5706-b144-4901-854d-578c0a4f734b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:40.300658 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cded5706-b144-4901-854d-578c0a4f734b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:40.301137 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cded5706-b144-4901-854d-578c0a4f734b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:40.301758 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cded5706-b144-4901-854d-578c0a4f734b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:40.508430 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cded5706-b144-4901-854d-578c0a4f734b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:06:40.520074 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cded5706-b144-4901-854d-578c0a4f734b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef" status: 200 len: 1357 microversion: 2.1 time: 0.235113 Aug 04 18:06:40.522148 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3660/7351] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:06:40 2022] GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef => generated 1357 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:06:40.563007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-9a1ce0ea-557b-45de-ac3a-10820789387b req-2cadf320-16db-4f1f-a35d-4b88f296c012 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e21c664-d7e0-48c1-931a-f049292796ef", "tag": "237a67b6-b001-4418-afaf-35b589a1e096"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:06:40.577118 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:06:40.578643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:06:40.583137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9a1ce0ea-557b-45de-ac3a-10820789387b req-2cadf320-16db-4f1f-a35d-4b88f296c012 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:40.585340 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9a1ce0ea-557b-45de-ac3a-10820789387b req-2cadf320-16db-4f1f-a35d-4b88f296c012 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:40.586384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9a1ce0ea-557b-45de-ac3a-10820789387b req-2cadf320-16db-4f1f-a35d-4b88f296c012 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:40.608095 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-9a1ce0ea-557b-45de-ac3a-10820789387b req-2cadf320-16db-4f1f-a35d-4b88f296c012 service nova] Creating event network-changed:237a67b6-b001-4418-afaf-35b589a1e096 for instance 3e21c664-d7e0-48c1-931a-f049292796ef on n-h1-851359-3 Aug 04 18:06:40.613659 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-9a1ce0ea-557b-45de-ac3a-10820789387b req-2cadf320-16db-4f1f-a35d-4b88f296c012 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055058 Aug 04 18:06:40.614578 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3692/7352] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:06:41.562500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-48549ab2-e18f-4c0b-b84d-5d2f2eb9b661 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:06:41.563138 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-48549ab2-e18f-4c0b-b84d-5d2f2eb9b661 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:06:41.565345 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:06:41.571984 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48549ab2-e18f-4c0b-b84d-5d2f2eb9b661 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:41.572517 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48549ab2-e18f-4c0b-b84d-5d2f2eb9b661 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:41.572970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48549ab2-e18f-4c0b-b84d-5d2f2eb9b661 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:41.573764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48549ab2-e18f-4c0b-b84d-5d2f2eb9b661 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:41.574254 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48549ab2-e18f-4c0b-b84d-5d2f2eb9b661 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:41.574691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48549ab2-e18f-4c0b-b84d-5d2f2eb9b661 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:41.748324 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-48549ab2-e18f-4c0b-b84d-5d2f2eb9b661 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:06:41.756752 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-48549ab2-e18f-4c0b-b84d-5d2f2eb9b661 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef" status: 200 len: 1357 microversion: 2.1 time: 0.198254 Aug 04 18:06:41.757369 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3661/7353] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:06:41 2022] GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef => generated 1357 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:06:42.789119 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5dd056ba-ca46-43ea-9f08-4c9865a27f1a tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:06:42.790667 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5dd056ba-ca46-43ea-9f08-4c9865a27f1a tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:06:42.802991 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5dd056ba-ca46-43ea-9f08-4c9865a27f1a tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:42.804170 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5dd056ba-ca46-43ea-9f08-4c9865a27f1a tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:42.805118 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5dd056ba-ca46-43ea-9f08-4c9865a27f1a tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:42.806582 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5dd056ba-ca46-43ea-9f08-4c9865a27f1a tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:42.807487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5dd056ba-ca46-43ea-9f08-4c9865a27f1a tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:42.808597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5dd056ba-ca46-43ea-9f08-4c9865a27f1a tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:42.982275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5dd056ba-ca46-43ea-9f08-4c9865a27f1a tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:06:42.990096 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5dd056ba-ca46-43ea-9f08-4c9865a27f1a tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef" status: 200 len: 1357 microversion: 2.1 time: 0.210366 Aug 04 18:06:42.990704 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3693/7354] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:06:42 2022] GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef => generated 1357 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:06:44.013927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-047a991e-8665-497b-9998-ea27b67ff30e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:06:44.013927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-047a991e-8665-497b-9998-ea27b67ff30e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:06:44.024764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-047a991e-8665-497b-9998-ea27b67ff30e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:44.025538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-047a991e-8665-497b-9998-ea27b67ff30e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:44.026378 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-047a991e-8665-497b-9998-ea27b67ff30e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:44.027478 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-047a991e-8665-497b-9998-ea27b67ff30e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:44.028272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-047a991e-8665-497b-9998-ea27b67ff30e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:44.028985 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-047a991e-8665-497b-9998-ea27b67ff30e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:44.169824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-047a991e-8665-497b-9998-ea27b67ff30e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:06:44.178440 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-047a991e-8665-497b-9998-ea27b67ff30e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef" status: 200 len: 1357 microversion: 2.1 time: 0.171285 Aug 04 18:06:44.179488 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3662/7355] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:06:44 2022] GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:06:44.789809 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-06c816e9-9f44-4e0e-bf3b-b6cbace500a7 req-267ca515-ee5e-451a-a29e-8ec330f9cefe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e21c664-d7e0-48c1-931a-f049292796ef", "name": "network-vif-plugged", "status": "completed", "tag": "237a67b6-b001-4418-afaf-35b589a1e096"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:06:44.800596 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-06c816e9-9f44-4e0e-bf3b-b6cbace500a7 req-267ca515-ee5e-451a-a29e-8ec330f9cefe service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:44.801086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-06c816e9-9f44-4e0e-bf3b-b6cbace500a7 req-267ca515-ee5e-451a-a29e-8ec330f9cefe service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:44.801541 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-06c816e9-9f44-4e0e-bf3b-b6cbace500a7 req-267ca515-ee5e-451a-a29e-8ec330f9cefe service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:44.814164 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-06c816e9-9f44-4e0e-bf3b-b6cbace500a7 req-267ca515-ee5e-451a-a29e-8ec330f9cefe service nova] Creating event network-vif-plugged:237a67b6-b001-4418-afaf-35b589a1e096 for instance 3e21c664-d7e0-48c1-931a-f049292796ef on n-h1-851359-3 Aug 04 18:06:44.819779 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-06c816e9-9f44-4e0e-bf3b-b6cbace500a7 req-267ca515-ee5e-451a-a29e-8ec330f9cefe service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033547 Aug 04 18:06:44.820559 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3694/7356] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:06:45.200625 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a54c6b61-cac9-4958-aba5-409de9a2a1be tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:06:45.201178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a54c6b61-cac9-4958-aba5-409de9a2a1be tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:06:45.208142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a54c6b61-cac9-4958-aba5-409de9a2a1be tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:45.209292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a54c6b61-cac9-4958-aba5-409de9a2a1be tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:45.209731 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a54c6b61-cac9-4958-aba5-409de9a2a1be tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:45.210493 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a54c6b61-cac9-4958-aba5-409de9a2a1be tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:45.210966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a54c6b61-cac9-4958-aba5-409de9a2a1be tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:45.211411 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a54c6b61-cac9-4958-aba5-409de9a2a1be tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:45.363128 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a54c6b61-cac9-4958-aba5-409de9a2a1be tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:06:45.371411 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a54c6b61-cac9-4958-aba5-409de9a2a1be tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef" status: 200 len: 1357 microversion: 2.1 time: 0.174855 Aug 04 18:06:45.371993 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3663/7357] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:06:45 2022] GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:06:46.402063 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-23535157-32c5-468c-8c17-02a8ced1ae8e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:06:46.403213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-23535157-32c5-468c-8c17-02a8ced1ae8e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:06:46.414476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23535157-32c5-468c-8c17-02a8ced1ae8e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:46.415318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23535157-32c5-468c-8c17-02a8ced1ae8e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:46.416106 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23535157-32c5-468c-8c17-02a8ced1ae8e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:46.417378 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23535157-32c5-468c-8c17-02a8ced1ae8e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:46.418266 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23535157-32c5-468c-8c17-02a8ced1ae8e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:46.419039 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-23535157-32c5-468c-8c17-02a8ced1ae8e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:46.568729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-23535157-32c5-468c-8c17-02a8ced1ae8e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:06:46.576626 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-23535157-32c5-468c-8c17-02a8ced1ae8e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef" status: 200 len: 1548 microversion: 2.1 time: 0.183017 Aug 04 18:06:46.577272 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3695/7358] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:06:46 2022] GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef => generated 1548 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:06:46.597711 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ef219a36-be4a-4eda-a23f-f077b28da317 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:06:46.598385 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ef219a36-be4a-4eda-a23f-f077b28da317 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:06:46.606410 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef219a36-be4a-4eda-a23f-f077b28da317 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:46.606923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef219a36-be4a-4eda-a23f-f077b28da317 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:46.607383 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef219a36-be4a-4eda-a23f-f077b28da317 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:46.608118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef219a36-be4a-4eda-a23f-f077b28da317 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:46.608589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef219a36-be4a-4eda-a23f-f077b28da317 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:46.609035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef219a36-be4a-4eda-a23f-f077b28da317 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:46.749638 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ef219a36-be4a-4eda-a23f-f077b28da317 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:06:46.758241 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ef219a36-be4a-4eda-a23f-f077b28da317 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef" status: 200 len: 1548 microversion: 2.1 time: 0.164612 Aug 04 18:06:46.758836 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3664/7359] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:06:46 2022] GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef => generated 1548 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:06:46.778890 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cddf4364-6f9f-4460-8cb5-6ec1b7333cd4 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:06:46.783747 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cddf4364-6f9f-4460-8cb5-6ec1b7333cd4 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:06:46.784551 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cddf4364-6f9f-4460-8cb5-6ec1b7333cd4 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Searching by: {'deleted': False, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f'} {{(pid=131043) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 18:06:46.790509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cddf4364-6f9f-4460-8cb5-6ec1b7333cd4 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:46.790999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cddf4364-6f9f-4460-8cb5-6ec1b7333cd4 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:46.791558 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cddf4364-6f9f-4460-8cb5-6ec1b7333cd4 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:46.792475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cddf4364-6f9f-4460-8cb5-6ec1b7333cd4 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:46.793051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cddf4364-6f9f-4460-8cb5-6ec1b7333cd4 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:46.793683 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cddf4364-6f9f-4460-8cb5-6ec1b7333cd4 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:46.820642 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.multi_cell_list [None req-cddf4364-6f9f-4460-8cb5-6ec1b7333cd4 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131043) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 18:06:46.852793 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cddf4364-6f9f-4460-8cb5-6ec1b7333cd4 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.077772 Aug 04 18:06:46.853393 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3696/7360] 10.222.0.93 () {58 vars in 1125 bytes} [Thu Aug 4 18:06:46 2022] GET /compute/v2.1/servers => generated 342 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:06:46.865326 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f4746af8-4a23-4a3e-a92d-dae0918753cf tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:06:46.865959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f4746af8-4a23-4a3e-a92d-dae0918753cf tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:06:46.872242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4746af8-4a23-4a3e-a92d-dae0918753cf tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:46.872242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4746af8-4a23-4a3e-a92d-dae0918753cf tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:46.872242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4746af8-4a23-4a3e-a92d-dae0918753cf tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:46.872242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4746af8-4a23-4a3e-a92d-dae0918753cf tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:46.872242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4746af8-4a23-4a3e-a92d-dae0918753cf tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:46.872242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4746af8-4a23-4a3e-a92d-dae0918753cf tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:47.016555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f4746af8-4a23-4a3e-a92d-dae0918753cf tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:06:47.024794 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f4746af8-4a23-4a3e-a92d-dae0918753cf tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef" status: 200 len: 1548 microversion: 2.1 time: 0.164018 Aug 04 18:06:47.025388 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3665/7361] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:06:46 2022] GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:06:48.623096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c109c856-9e12-4fbc-8fbe-43f8855acf91 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12947b0a-f20b-4dc2-8dc7-cd98d91167ed"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:06:48.625497 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c109c856-9e12-4fbc-8fbe-43f8855acf91 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:06:48.632755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c109c856-9e12-4fbc-8fbe-43f8855acf91 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:48.633325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c109c856-9e12-4fbc-8fbe-43f8855acf91 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:48.633779 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c109c856-9e12-4fbc-8fbe-43f8855acf91 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:48.634565 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c109c856-9e12-4fbc-8fbe-43f8855acf91 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:06:48.635020 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c109c856-9e12-4fbc-8fbe-43f8855acf91 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:06:48.635520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c109c856-9e12-4fbc-8fbe-43f8855acf91 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:06:48.925100 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c109c856-9e12-4fbc-8fbe-43f8855acf91 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "POST /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305637 Aug 04 18:06:48.925743 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3697/7362] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Aug 4 18:06:48 2022] POST /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:07:03.190626 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-def2c07c-9558-41ff-bc03-952b80dc029d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:07:03.191251 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-def2c07c-9558-41ff-bc03-952b80dc029d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:07:03.195215 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:07:03.195497 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=54 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:07:03.202417 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-def2c07c-9558-41ff-bc03-952b80dc029d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:07:03.202808 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-def2c07c-9558-41ff-bc03-952b80dc029d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:07:03.209649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-def2c07c-9558-41ff-bc03-952b80dc029d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:07:03.209649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-def2c07c-9558-41ff-bc03-952b80dc029d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:07:03.209649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-def2c07c-9558-41ff-bc03-952b80dc029d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:07:03.209649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-def2c07c-9558-41ff-bc03-952b80dc029d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:07:03.360409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-def2c07c-9558-41ff-bc03-952b80dc029d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:07:03.369197 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-def2c07c-9558-41ff-bc03-952b80dc029d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef" status: 200 len: 1594 microversion: 2.1 time: 0.182513 Aug 04 18:07:03.369914 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3666/7363] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:07:03 2022] GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef => generated 1594 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:07:05.309154 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:07:05.315433 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:07:05.317064 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:07:05.514745 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-4a80ad93-c861-444e-8fbb-88ebd348e464 req-9502d116-35cc-4db0-ae3d-735c1ff643c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e21c664-d7e0-48c1-931a-f049292796ef", "tag": "237a67b6-b001-4418-afaf-35b589a1e096"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:07:05.541315 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-4a80ad93-c861-444e-8fbb-88ebd348e464 req-9502d116-35cc-4db0-ae3d-735c1ff643c0 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:07:05.547432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-4a80ad93-c861-444e-8fbb-88ebd348e464 req-9502d116-35cc-4db0-ae3d-735c1ff643c0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:07:05.547432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-4a80ad93-c861-444e-8fbb-88ebd348e464 req-9502d116-35cc-4db0-ae3d-735c1ff643c0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:07:05.573201 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-4a80ad93-c861-444e-8fbb-88ebd348e464 req-9502d116-35cc-4db0-ae3d-735c1ff643c0 service nova] Creating event network-changed:237a67b6-b001-4418-afaf-35b589a1e096 for instance 3e21c664-d7e0-48c1-931a-f049292796ef on n-h1-851359-3 Aug 04 18:07:05.582232 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-4a80ad93-c861-444e-8fbb-88ebd348e464 req-9502d116-35cc-4db0-ae3d-735c1ff643c0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.277953 Aug 04 18:07:05.585133 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3698/7364] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:07:06.897533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d36055e8-d9e4-42b6-afaa-c0da47a5048f tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1942939300"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:07:06.898404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d36055e8-d9e4-42b6-afaa-c0da47a5048f tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:07:06.905605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d36055e8-d9e4-42b6-afaa-c0da47a5048f tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:07:06.906160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d36055e8-d9e4-42b6-afaa-c0da47a5048f tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:07:06.906615 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d36055e8-d9e4-42b6-afaa-c0da47a5048f tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:07:06.907341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d36055e8-d9e4-42b6-afaa-c0da47a5048f tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:07:06.907812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d36055e8-d9e4-42b6-afaa-c0da47a5048f tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:07:06.908252 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d36055e8-d9e4-42b6-afaa-c0da47a5048f tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:07:07.050596 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.network.security_group_api [None req-d36055e8-d9e4-42b6-afaa-c0da47a5048f tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Adding security group 7a2d8228-d4ea-409b-a6ac-174b4db68dd6 to port 237a67b6-b001-4418-afaf-35b589a1e096 Aug 04 18:07:07.381962 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d36055e8-d9e4-42b6-afaa-c0da47a5048f tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "POST /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef/action" status: 202 len: 0 microversion: 2.1 time: 0.488727 Aug 04 18:07:07.382792 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3667/7365] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:07:06 2022] POST /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 18:07:07.392961 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b2a3af46-ae99-4efd-b4b4-d35c4df0cf49 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:07:07.393699 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b2a3af46-ae99-4efd-b4b4-d35c4df0cf49 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:07:07.400730 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2a3af46-ae99-4efd-b4b4-d35c4df0cf49 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:07:07.401368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2a3af46-ae99-4efd-b4b4-d35c4df0cf49 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:07:07.402128 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2a3af46-ae99-4efd-b4b4-d35c4df0cf49 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:07:07.403531 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2a3af46-ae99-4efd-b4b4-d35c4df0cf49 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:07:07.403531 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2a3af46-ae99-4efd-b4b4-d35c4df0cf49 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:07:07.403880 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2a3af46-ae99-4efd-b4b4-d35c4df0cf49 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:07:07.467849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-d2f84eb1-cc9d-4f71-9b45-2c53e2dabdbb req-e1f8295b-8f0e-4195-bd86-a2a683884c32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e21c664-d7e0-48c1-931a-f049292796ef", "tag": "237a67b6-b001-4418-afaf-35b589a1e096"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:07:07.485526 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d2f84eb1-cc9d-4f71-9b45-2c53e2dabdbb req-e1f8295b-8f0e-4195-bd86-a2a683884c32 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:07:07.486642 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d2f84eb1-cc9d-4f71-9b45-2c53e2dabdbb req-e1f8295b-8f0e-4195-bd86-a2a683884c32 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:07:07.487522 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-d2f84eb1-cc9d-4f71-9b45-2c53e2dabdbb req-e1f8295b-8f0e-4195-bd86-a2a683884c32 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:07:07.512660 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-d2f84eb1-cc9d-4f71-9b45-2c53e2dabdbb req-e1f8295b-8f0e-4195-bd86-a2a683884c32 service nova] Creating event network-changed:237a67b6-b001-4418-afaf-35b589a1e096 for instance 3e21c664-d7e0-48c1-931a-f049292796ef on n-h1-851359-3 Aug 04 18:07:07.521194 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-d2f84eb1-cc9d-4f71-9b45-2c53e2dabdbb req-e1f8295b-8f0e-4195-bd86-a2a683884c32 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131783 Aug 04 18:07:07.522436 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3699/7366] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:07:07.661804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b2a3af46-ae99-4efd-b4b4-d35c4df0cf49 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:07:07.671654 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b2a3af46-ae99-4efd-b4b4-d35c4df0cf49 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef" status: 200 len: 1758 microversion: 2.1 time: 0.282953 Aug 04 18:07:07.672874 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3668/7367] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:07:07 2022] GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef => generated 1758 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:07:43.157016 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:07:43.157765 n-d-851359-3 devstack@n-api.service[131044]: Thu Aug 4 18:07:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:08:02.763429 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:08:02.764105 n-d-851359-3 devstack@n-api.service[131044]: Thu Aug 4 18:08:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:08:45.320053 n-d-851359-3 devstack@n-api.service[131043]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d439c32e-c35d-4bcd-acc6-3613271fa0d5] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 18:08:45.320597 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=4 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:08:45.321430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=4 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:08:45.326301 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3f407a1c-41fb-409d-9fd8-b105d374edae tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:08:45.328868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3f407a1c-41fb-409d-9fd8-b105d374edae tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:08:45.337361 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f407a1c-41fb-409d-9fd8-b105d374edae tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:08:45.337898 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f407a1c-41fb-409d-9fd8-b105d374edae tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:08:45.338388 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f407a1c-41fb-409d-9fd8-b105d374edae tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:08:45.339140 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f407a1c-41fb-409d-9fd8-b105d374edae tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:08:45.339658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f407a1c-41fb-409d-9fd8-b105d374edae tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:08:45.340128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f407a1c-41fb-409d-9fd8-b105d374edae tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:08:45.418834 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3f407a1c-41fb-409d-9fd8-b105d374edae tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "POST /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef/action" status: 202 len: 0 microversion: 2.1 time: 0.101257 Aug 04 18:08:45.419488 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3700/7368] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:08:45 2022] POST /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 18:08:45.426229 n-d-851359-3 devstack@n-api.service[131044]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7a822c8f-8f7d-4a50-9afd-aab5c6b46a96] AMQP server on 10.222.0.93:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 18:08:45.426745 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:08:45.427612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=16 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:08:45.431674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-77670445-69a0-458a-a22a-73486033ee63 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:08:45.432301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-77670445-69a0-458a-a22a-73486033ee63 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:08:45.438942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77670445-69a0-458a-a22a-73486033ee63 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:08:45.439436 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77670445-69a0-458a-a22a-73486033ee63 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:08:45.439886 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77670445-69a0-458a-a22a-73486033ee63 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:08:45.440585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77670445-69a0-458a-a22a-73486033ee63 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:08:45.441542 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77670445-69a0-458a-a22a-73486033ee63 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:08:45.441991 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77670445-69a0-458a-a22a-73486033ee63 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:08:45.671710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-77670445-69a0-458a-a22a-73486033ee63 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:08:45.681123 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-77670445-69a0-458a-a22a-73486033ee63 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef" status: 200 len: 1760 microversion: 2.1 time: 0.257134 Aug 04 18:08:45.681696 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3669/7369] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:08:45 2022] GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef => generated 1760 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:08:46.704715 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-feab6cba-60b8-4189-b044-e2550e2167c6 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:08:46.705432 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-feab6cba-60b8-4189-b044-e2550e2167c6 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:08:46.717471 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] [d439c32e-c35d-4bcd-acc6-3613271fa0d5] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 57350. Aug 04 18:08:46.719627 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-feab6cba-60b8-4189-b044-e2550e2167c6 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:08:46.720123 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-feab6cba-60b8-4189-b044-e2550e2167c6 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:08:46.720564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-feab6cba-60b8-4189-b044-e2550e2167c6 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:08:46.721281 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-feab6cba-60b8-4189-b044-e2550e2167c6 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:08:46.721737 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-feab6cba-60b8-4189-b044-e2550e2167c6 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:08:46.722239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-feab6cba-60b8-4189-b044-e2550e2167c6 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:08:46.930158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-feab6cba-60b8-4189-b044-e2550e2167c6 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:08:46.938350 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-feab6cba-60b8-4189-b044-e2550e2167c6 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef" status: 200 len: 1765 microversion: 2.1 time: 0.239036 Aug 04 18:08:46.938918 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3701/7370] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:08:46 2022] GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef => generated 1765 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:08:47.959404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5a20c80a-769e-4985-8c71-8548eec835d6 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:08:47.959949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5a20c80a-769e-4985-8c71-8548eec835d6 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:08:47.969251 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a20c80a-769e-4985-8c71-8548eec835d6 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:08:47.969723 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a20c80a-769e-4985-8c71-8548eec835d6 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:08:47.970206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a20c80a-769e-4985-8c71-8548eec835d6 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:08:47.970931 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a20c80a-769e-4985-8c71-8548eec835d6 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:08:47.971405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a20c80a-769e-4985-8c71-8548eec835d6 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:08:47.971848 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a20c80a-769e-4985-8c71-8548eec835d6 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:08:47.978824 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] [7a822c8f-8f7d-4a50-9afd-aab5c6b46a96] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 57356. Aug 04 18:08:48.121245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5a20c80a-769e-4985-8c71-8548eec835d6 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:08:48.129896 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5a20c80a-769e-4985-8c71-8548eec835d6 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef" status: 200 len: 1758 microversion: 2.1 time: 0.174516 Aug 04 18:08:48.130497 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3670/7371] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:08:47 2022] GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:09:23.144648 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:09:23.145483 n-d-851359-3 devstack@n-api.service[131044]: Thu Aug 4 18:09:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:09:23.273969 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:09:23.274681 n-d-851359-3 devstack@n-api.service[131043]: Thu Aug 4 18:09:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:10:01.691472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=4 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:10:01.692447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:10:01.696738 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a165c058-590d-425c-826a-979feaa7d408 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1942939300"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:10:01.697291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a165c058-590d-425c-826a-979feaa7d408 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:10:01.704630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a165c058-590d-425c-826a-979feaa7d408 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:01.705138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a165c058-590d-425c-826a-979feaa7d408 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:01.705591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a165c058-590d-425c-826a-979feaa7d408 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:01.706339 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a165c058-590d-425c-826a-979feaa7d408 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:01.706812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a165c058-590d-425c-826a-979feaa7d408 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:01.707251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a165c058-590d-425c-826a-979feaa7d408 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:01.859459 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.network.security_group_api [None req-a165c058-590d-425c-826a-979feaa7d408 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Removing security group 7a2d8228-d4ea-409b-a6ac-174b4db68dd6 from port 237a67b6-b001-4418-afaf-35b589a1e096 Aug 04 18:10:02.193519 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a165c058-590d-425c-826a-979feaa7d408 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "POST /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef/action" status: 202 len: 0 microversion: 2.1 time: 0.503495 Aug 04 18:10:02.194963 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3702/7372] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:10:01 2022] POST /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 18:10:02.200803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:10:02.202151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=12 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:10:02.206537 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-a2f2b418-541d-41a7-a233-3dbbfdb1c2a3 req-f55c4d39-9df5-4d85-8804-13daff69ac59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e21c664-d7e0-48c1-931a-f049292796ef", "tag": "237a67b6-b001-4418-afaf-35b589a1e096"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:10:02.216928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a2f2b418-541d-41a7-a233-3dbbfdb1c2a3 req-f55c4d39-9df5-4d85-8804-13daff69ac59 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:02.217401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a2f2b418-541d-41a7-a233-3dbbfdb1c2a3 req-f55c4d39-9df5-4d85-8804-13daff69ac59 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:02.217856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a2f2b418-541d-41a7-a233-3dbbfdb1c2a3 req-f55c4d39-9df5-4d85-8804-13daff69ac59 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:02.232564 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-a2f2b418-541d-41a7-a233-3dbbfdb1c2a3 req-f55c4d39-9df5-4d85-8804-13daff69ac59 service nova] Creating event network-changed:237a67b6-b001-4418-afaf-35b589a1e096 for instance 3e21c664-d7e0-48c1-931a-f049292796ef on n-h1-851359-3 Aug 04 18:10:02.239339 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-a2f2b418-541d-41a7-a233-3dbbfdb1c2a3 req-f55c4d39-9df5-4d85-8804-13daff69ac59 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040798 Aug 04 18:10:02.240353 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3671/7373] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:10:04.098424 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0dbc9e24-bb21-4041-bcab-813db0fc7b2b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:10:04.100353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0dbc9e24-bb21-4041-bcab-813db0fc7b2b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:10:04.107259 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0dbc9e24-bb21-4041-bcab-813db0fc7b2b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:04.107761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0dbc9e24-bb21-4041-bcab-813db0fc7b2b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:04.108211 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0dbc9e24-bb21-4041-bcab-813db0fc7b2b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:04.108937 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0dbc9e24-bb21-4041-bcab-813db0fc7b2b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:04.109397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0dbc9e24-bb21-4041-bcab-813db0fc7b2b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:04.109836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0dbc9e24-bb21-4041-bcab-813db0fc7b2b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:04.214878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-0dbc9e24-bb21-4041-bcab-813db0fc7b2b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lazy-loading 'services' on Instance uuid 3e21c664-d7e0-48c1-931a-f049292796ef {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 18:10:04.255611 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-fac448d3-79b3-46ab-903d-7820ae807b28 req-362f2f1c-6a19-4da8-91ed-15f0343fa98d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e21c664-d7e0-48c1-931a-f049292796ef", "tag": "237a67b6-b001-4418-afaf-35b589a1e096"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:10:04.267588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fac448d3-79b3-46ab-903d-7820ae807b28 req-362f2f1c-6a19-4da8-91ed-15f0343fa98d service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:04.268100 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fac448d3-79b3-46ab-903d-7820ae807b28 req-362f2f1c-6a19-4da8-91ed-15f0343fa98d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:04.268853 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fac448d3-79b3-46ab-903d-7820ae807b28 req-362f2f1c-6a19-4da8-91ed-15f0343fa98d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:04.283051 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-fac448d3-79b3-46ab-903d-7820ae807b28 req-362f2f1c-6a19-4da8-91ed-15f0343fa98d service nova] Creating event network-changed:237a67b6-b001-4418-afaf-35b589a1e096 for instance 3e21c664-d7e0-48c1-931a-f049292796ef on n-h1-851359-3 Aug 04 18:10:04.296838 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-fac448d3-79b3-46ab-903d-7820ae807b28 req-362f2f1c-6a19-4da8-91ed-15f0343fa98d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044554 Aug 04 18:10:04.312966 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3672/7374] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:10:04.315949 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0dbc9e24-bb21-4041-bcab-813db0fc7b2b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "DELETE /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef/os-volume_attachments/12947b0a-f20b-4dc2-8dc7-cd98d91167ed" status: 202 len: 0 microversion: 2.1 time: 0.230851 Aug 04 18:10:04.316992 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3703/7375] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Aug 4 18:10:04 2022] DELETE /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef/os-volume_attachments/12947b0a-f20b-4dc2-8dc7-cd98d91167ed => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 18:10:04.344178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c456cf19-76dc-4ae7-be32-ef39cfe1b5ce tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:10:04.353165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c456cf19-76dc-4ae7-be32-ef39cfe1b5ce tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:10:04.365130 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c456cf19-76dc-4ae7-be32-ef39cfe1b5ce tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:04.366201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c456cf19-76dc-4ae7-be32-ef39cfe1b5ce tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:04.367329 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c456cf19-76dc-4ae7-be32-ef39cfe1b5ce tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:04.368741 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c456cf19-76dc-4ae7-be32-ef39cfe1b5ce tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:04.370237 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c456cf19-76dc-4ae7-be32-ef39cfe1b5ce tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:04.371007 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c456cf19-76dc-4ae7-be32-ef39cfe1b5ce tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:04.414290 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c456cf19-76dc-4ae7-be32-ef39cfe1b5ce tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089997 Aug 04 18:10:04.415157 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3673/7376] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 18:10:04 2022] GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:10:05.431591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9188ba3f-81a5-413e-9733-e91e865e0d92 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:10:05.434303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9188ba3f-81a5-413e-9733-e91e865e0d92 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:10:05.441835 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9188ba3f-81a5-413e-9733-e91e865e0d92 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:05.442368 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9188ba3f-81a5-413e-9733-e91e865e0d92 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:05.442824 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9188ba3f-81a5-413e-9733-e91e865e0d92 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:05.443748 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9188ba3f-81a5-413e-9733-e91e865e0d92 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:05.444376 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9188ba3f-81a5-413e-9733-e91e865e0d92 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:05.444991 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9188ba3f-81a5-413e-9733-e91e865e0d92 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:05.491354 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9188ba3f-81a5-413e-9733-e91e865e0d92 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064727 Aug 04 18:10:05.492355 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3704/7377] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 18:10:05 2022] GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:10:06.507935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-05292084-68d5-4911-8f7a-349b31f75e4e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:10:06.510490 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-05292084-68d5-4911-8f7a-349b31f75e4e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:10:06.519224 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05292084-68d5-4911-8f7a-349b31f75e4e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:06.519732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05292084-68d5-4911-8f7a-349b31f75e4e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:06.520185 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05292084-68d5-4911-8f7a-349b31f75e4e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:06.520909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05292084-68d5-4911-8f7a-349b31f75e4e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:06.521378 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05292084-68d5-4911-8f7a-349b31f75e4e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:06.521816 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05292084-68d5-4911-8f7a-349b31f75e4e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:06.560266 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-05292084-68d5-4911-8f7a-349b31f75e4e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056576 Aug 04 18:10:06.561232 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3674/7378] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 18:10:06 2022] GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:10:07.574990 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-44d0cd42-700a-46d8-921c-fa1cce849526 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:10:07.578888 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-44d0cd42-700a-46d8-921c-fa1cce849526 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:10:07.586951 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-44d0cd42-700a-46d8-921c-fa1cce849526 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:07.588489 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-44d0cd42-700a-46d8-921c-fa1cce849526 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:07.589637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-44d0cd42-700a-46d8-921c-fa1cce849526 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:07.590366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-44d0cd42-700a-46d8-921c-fa1cce849526 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:07.590919 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-44d0cd42-700a-46d8-921c-fa1cce849526 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:07.591501 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-44d0cd42-700a-46d8-921c-fa1cce849526 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:07.631438 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-44d0cd42-700a-46d8-921c-fa1cce849526 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061207 Aug 04 18:10:07.632044 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3705/7379] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 18:10:07 2022] GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:10:08.644404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5076babd-7d5b-415f-bb06-e7254ba547bf tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:10:08.646671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5076babd-7d5b-415f-bb06-e7254ba547bf tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:10:08.654532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5076babd-7d5b-415f-bb06-e7254ba547bf tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:08.655042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5076babd-7d5b-415f-bb06-e7254ba547bf tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:08.655481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5076babd-7d5b-415f-bb06-e7254ba547bf tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:08.656194 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5076babd-7d5b-415f-bb06-e7254ba547bf tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:08.656656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5076babd-7d5b-415f-bb06-e7254ba547bf tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:08.657090 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5076babd-7d5b-415f-bb06-e7254ba547bf tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:08.689407 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5076babd-7d5b-415f-bb06-e7254ba547bf tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049134 Aug 04 18:10:08.690309 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3675/7380] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 18:10:08 2022] GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:10:09.701469 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bf79e05d-f292-4fcf-90ca-1e93f8ba8880 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:10:09.704333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bf79e05d-f292-4fcf-90ca-1e93f8ba8880 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:10:09.713176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf79e05d-f292-4fcf-90ca-1e93f8ba8880 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:09.713958 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf79e05d-f292-4fcf-90ca-1e93f8ba8880 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:09.714572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf79e05d-f292-4fcf-90ca-1e93f8ba8880 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:09.715535 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf79e05d-f292-4fcf-90ca-1e93f8ba8880 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:09.716236 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf79e05d-f292-4fcf-90ca-1e93f8ba8880 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:09.716750 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bf79e05d-f292-4fcf-90ca-1e93f8ba8880 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:09.755365 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bf79e05d-f292-4fcf-90ca-1e93f8ba8880 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057971 Aug 04 18:10:09.755992 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3706/7381] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 18:10:09 2022] GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 18:10:09.769654 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-770231ba-370c-4e2b-a01e-3cd85bee6c7b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:10:09.770492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-770231ba-370c-4e2b-a01e-3cd85bee6c7b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:10:09.782109 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-770231ba-370c-4e2b-a01e-3cd85bee6c7b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:09.782846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-770231ba-370c-4e2b-a01e-3cd85bee6c7b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:09.783578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-770231ba-370c-4e2b-a01e-3cd85bee6c7b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:09.784606 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-770231ba-370c-4e2b-a01e-3cd85bee6c7b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:09.785405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-770231ba-370c-4e2b-a01e-3cd85bee6c7b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:09.786039 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-770231ba-370c-4e2b-a01e-3cd85bee6c7b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:09.871535 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-770231ba-370c-4e2b-a01e-3cd85bee6c7b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] HTTP exception thrown: Instance 3e21c664-d7e0-48c1-931a-f049292796ef is not attached to volume 12947b0a-f20b-4dc2-8dc7-cd98d91167ed Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-770231ba-370c-4e2b-a01e-3cd85bee6c7b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Request method failure captured: Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef/os-volume_attachments/12947b0a-f20b-4dc2-8dc7-cd98d91167ed HTTP/1.1 Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AqTp6C4ysKBWsP7Ihj62yRoY_JChCeplpEMF2zkDMd34kakT4claYSaeW9T4G72L8Loj_5Gk4_RWjdXhCYvYrMdJL50m7kkzzsFsvnMYEdZYWrNal6gEc5moP-CO-5IVQEC7idp7C1ia7lr_0GKeG1ZEYcOpxMS5dX8-ZHDHBOqXCQ Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 5f56d86aa3c54de78d63221df7c9bb1f Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TestMinimumBasicScenario-1511987094 Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f56d86aa3c54de78d63221df7c9bb1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f56d86aa3c54de78d63221df7c9bb1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f56d86aa3c54de78d63221df7c9bb1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f56d86aa3c54de78d63221df7c9bb1f"}]}] Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TestMinimumBasicScenario-1511987094 Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 5f56d86aa3c54de78d63221df7c9bb1f Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1511987094 Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TestMinimumBasicScenario-1511987094-project Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: fc6d59ce5a324ce2800ead7fe0d36697 Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TestMinimumBasicScenario-1511987094-project Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 3e21c664-d7e0-48c1-931a-f049292796ef is not attached to volume 12947b0a-f20b-4dc2-8dc7-cd98d91167ed Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'server_id': '3e21c664-d7e0-48c1-931a-f049292796ef', 'id': '12947b0a-f20b-4dc2-8dc7-cd98d91167ed'} Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 12947b0a-f20b-4dc2-8dc7-cd98d91167ed. Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e21c664-d7e0-48c1-931a-f049292796ef is not attached to volume 12947b0a-f20b-4dc2-8dc7-cd98d91167ed Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:10:09.873223 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:10:09.881121 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:10:09.881121 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:10:09.881121 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e21c664-d7e0-48c1-931a-f049292796ef is not attached to volume 12947b0a-f20b-4dc2-8dc7-cd98d91167ed Aug 04 18:10:09.881121 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:10:09.881121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-770231ba-370c-4e2b-a01e-3cd85bee6c7b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Returning 404 to user: Instance 3e21c664-d7e0-48c1-931a-f049292796ef is not attached to volume 12947b0a-f20b-4dc2-8dc7-cd98d91167ed {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:10:09.881121 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-770231ba-370c-4e2b-a01e-3cd85bee6c7b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "DELETE /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef/os-volume_attachments/12947b0a-f20b-4dc2-8dc7-cd98d91167ed" status: 404 len: 154 microversion: 2.1 time: 0.111787 Aug 04 18:10:09.881121 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3676/7382] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Aug 4 18:10:09 2022] DELETE /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef/os-volume_attachments/12947b0a-f20b-4dc2-8dc7-cd98d91167ed => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 18:10:13.213203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5952eca0-9e91-4d24-bd05-e0d107434de8 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:10:13.213203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5952eca0-9e91-4d24-bd05-e0d107434de8 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:10:13.220504 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5952eca0-9e91-4d24-bd05-e0d107434de8 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:13.221086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5952eca0-9e91-4d24-bd05-e0d107434de8 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:13.221605 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5952eca0-9e91-4d24-bd05-e0d107434de8 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:13.222503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5952eca0-9e91-4d24-bd05-e0d107434de8 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:13.223084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5952eca0-9e91-4d24-bd05-e0d107434de8 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:13.223628 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5952eca0-9e91-4d24-bd05-e0d107434de8 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:13.252179 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5952eca0-9e91-4d24-bd05-e0d107434de8 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 18:10:13.355255 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5952eca0-9e91-4d24-bd05-e0d107434de8 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "DELETE /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef" status: 204 len: 0 microversion: 2.1 time: 0.147622 Aug 04 18:10:13.358059 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3707/7383] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 18:10:13 2022] DELETE /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 18:10:13.365015 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-73382d3d-8f59-41b3-a9b4-b260a72ad4cd tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:10:13.365651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-73382d3d-8f59-41b3-a9b4-b260a72ad4cd tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:10:13.374929 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73382d3d-8f59-41b3-a9b4-b260a72ad4cd tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:13.375439 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73382d3d-8f59-41b3-a9b4-b260a72ad4cd tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:13.375895 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73382d3d-8f59-41b3-a9b4-b260a72ad4cd tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:13.376627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73382d3d-8f59-41b3-a9b4-b260a72ad4cd tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:13.377108 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73382d3d-8f59-41b3-a9b4-b260a72ad4cd tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:13.377546 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73382d3d-8f59-41b3-a9b4-b260a72ad4cd tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:13.548906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-73382d3d-8f59-41b3-a9b4-b260a72ad4cd tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:10:13.557752 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-73382d3d-8f59-41b3-a9b4-b260a72ad4cd tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef" status: 200 len: 1554 microversion: 2.1 time: 0.196703 Aug 04 18:10:13.558473 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3677/7384] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:10:13 2022] GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef => generated 1554 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:10:14.580469 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-052fd974-5c3d-47ec-9d34-15828deddd4b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:10:14.581299 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-052fd974-5c3d-47ec-9d34-15828deddd4b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:10:14.589645 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-052fd974-5c3d-47ec-9d34-15828deddd4b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:14.590184 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-052fd974-5c3d-47ec-9d34-15828deddd4b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:14.590625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-052fd974-5c3d-47ec-9d34-15828deddd4b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:14.591350 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-052fd974-5c3d-47ec-9d34-15828deddd4b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:14.591815 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-052fd974-5c3d-47ec-9d34-15828deddd4b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:14.592244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-052fd974-5c3d-47ec-9d34-15828deddd4b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:14.744269 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-052fd974-5c3d-47ec-9d34-15828deddd4b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:10:14.753291 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-052fd974-5c3d-47ec-9d34-15828deddd4b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef" status: 200 len: 1554 microversion: 2.1 time: 0.177301 Aug 04 18:10:14.754270 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3708/7385] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:10:14 2022] GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:10:15.708964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-65e073a6-fe34-4d40-a183-e686740bf022 req-f1589144-2f24-4d5d-8865-af5d51931c4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e21c664-d7e0-48c1-931a-f049292796ef", "name": "network-vif-deleted", "tag": "237a67b6-b001-4418-afaf-35b589a1e096"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:10:15.721751 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-65e073a6-fe34-4d40-a183-e686740bf022 req-f1589144-2f24-4d5d-8865-af5d51931c4f service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:15.722417 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-65e073a6-fe34-4d40-a183-e686740bf022 req-f1589144-2f24-4d5d-8865-af5d51931c4f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:15.722886 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-65e073a6-fe34-4d40-a183-e686740bf022 req-f1589144-2f24-4d5d-8865-af5d51931c4f service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:15.738187 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-65e073a6-fe34-4d40-a183-e686740bf022 req-f1589144-2f24-4d5d-8865-af5d51931c4f service nova] Creating event network-vif-deleted:237a67b6-b001-4418-afaf-35b589a1e096 for instance 3e21c664-d7e0-48c1-931a-f049292796ef on n-h1-851359-3 Aug 04 18:10:15.744243 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-65e073a6-fe34-4d40-a183-e686740bf022 req-f1589144-2f24-4d5d-8865-af5d51931c4f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039224 Aug 04 18:10:15.745118 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3678/7386] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:10:15.781060 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9b85311d-435b-479c-8233-25a6a0fcfe24 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:10:15.782430 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9b85311d-435b-479c-8233-25a6a0fcfe24 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:10:15.793089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b85311d-435b-479c-8233-25a6a0fcfe24 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:15.794007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b85311d-435b-479c-8233-25a6a0fcfe24 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:15.794766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b85311d-435b-479c-8233-25a6a0fcfe24 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:15.795961 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b85311d-435b-479c-8233-25a6a0fcfe24 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:15.796776 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b85311d-435b-479c-8233-25a6a0fcfe24 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:15.798117 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9b85311d-435b-479c-8233-25a6a0fcfe24 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:15.871025 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9b85311d-435b-479c-8233-25a6a0fcfe24 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:10:15.879648 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9b85311d-435b-479c-8233-25a6a0fcfe24 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef" status: 200 len: 1342 microversion: 2.1 time: 0.106421 Aug 04 18:10:15.880182 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3709/7387] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:10:15 2022] GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef => generated 1342 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:10:16.906568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1f1b588c-58f8-4bfe-8828-ea97bf047ba3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:10:16.907363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1f1b588c-58f8-4bfe-8828-ea97bf047ba3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 3e21c664-d7e0-48c1-931a-f049292796ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:10:16.914171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f1b588c-58f8-4bfe-8828-ea97bf047ba3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:16.914700 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f1b588c-58f8-4bfe-8828-ea97bf047ba3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:16.915159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f1b588c-58f8-4bfe-8828-ea97bf047ba3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:16.916082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f1b588c-58f8-4bfe-8828-ea97bf047ba3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:16.916764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f1b588c-58f8-4bfe-8828-ea97bf047ba3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:16.917644 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f1b588c-58f8-4bfe-8828-ea97bf047ba3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:16.936306 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-1f1b588c-58f8-4bfe-8828-ea97bf047ba3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] HTTP exception thrown: Instance 3e21c664-d7e0-48c1-931a-f049292796ef could not be found. Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1f1b588c-58f8-4bfe-8828-ea97bf047ba3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Request method failure captured: Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef HTTP/1.1 Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AqTp6C4ysKBWsP7Ihj62yRoY_JChCeplpEMF2zkDMd34kakT4claYSaeW9T4G72L8Loj_5Gk4_RWjdXhCYvYrMdJL50m7kkzzsFsvnMYEdZYWrNal6gEc5moP-CO-5IVQEC7idp7C1ia7lr_0GKeG1ZEYcOpxMS5dX8-ZHDHBOqXCQ Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 5f56d86aa3c54de78d63221df7c9bb1f Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TestMinimumBasicScenario-1511987094 Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f56d86aa3c54de78d63221df7c9bb1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f56d86aa3c54de78d63221df7c9bb1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f56d86aa3c54de78d63221df7c9bb1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f56d86aa3c54de78d63221df7c9bb1f"}]}] Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TestMinimumBasicScenario-1511987094 Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 5f56d86aa3c54de78d63221df7c9bb1f Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1511987094 Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TestMinimumBasicScenario-1511987094-project Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: fc6d59ce5a324ce2800ead7fe0d36697 Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TestMinimumBasicScenario-1511987094-project Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 3e21c664-d7e0-48c1-931a-f049292796ef could not be found. Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '3e21c664-d7e0-48c1-931a-f049292796ef'} Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e21c664-d7e0-48c1-931a-f049292796ef could not be found. Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e21c664-d7e0-48c1-931a-f049292796ef could not be found. Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:10:16.938231 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:10:16.943945 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:10:16.943945 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:10:16.943945 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:10:16.943945 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:10:16.943945 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:10:16.943945 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e21c664-d7e0-48c1-931a-f049292796ef could not be found. Aug 04 18:10:16.943945 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:10:16.943945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1f1b588c-58f8-4bfe-8828-ea97bf047ba3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Returning 404 to user: Instance 3e21c664-d7e0-48c1-931a-f049292796ef could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:10:16.943945 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1f1b588c-58f8-4bfe-8828-ea97bf047ba3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef" status: 404 len: 111 microversion: 2.1 time: 0.040315 Aug 04 18:10:16.943945 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3679/7388] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:10:16 2022] GET /compute/v2.1/servers/3e21c664-d7e0-48c1-931a-f049292796ef => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 18:10:16.951734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8a22b759-dd3e-4aa8-9186-9ef83b427938 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '.version_select at 0x7f1e5a308dc0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:10:16.984987 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8a22b759-dd3e-4aa8-9186-9ef83b427938 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-488740478" status: 202 len: 0 microversion: 2.1 time: 0.038258 Aug 04 18:10:16.985579 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3710/7389] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Aug 4 18:10:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-488740478 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 18:10:26.543126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e326691b-50de-45aa-904f-31e9971e46b7 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Action: 'create', calling method: .version_select at 0x7f1e5a4db940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-438268119", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANIUNIr3m/AdWfcw2jCMWehc7LAYuawFU63EcUzdPR9L9JrbYEOLrjoDAgscnyaUd9zVz3rxDOyBUkFudosXPPiEVgZsQg3yKGfxWa4lpqMemVIX8odBc/XNvK/wMu2kw=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:10:26.561666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e326691b-50de-45aa-904f-31e9971e46b7 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Getting quotas for project 5f56d86aa3c54de78d63221df7c9bb1f. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 18:10:26.567561 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e326691b-50de-45aa-904f-31e9971e46b7 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Getting quotas for user fc6d59ce5a324ce2800ead7fe0d36697 and project 5f56d86aa3c54de78d63221df7c9bb1f. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 18:10:26.603595 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e326691b-50de-45aa-904f-31e9971e46b7 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.064758 Aug 04 18:10:26.604197 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3680/7390] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 18:10:26 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:10:26.666532 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8739d2fa-d784-47eb-96b9-a59c9b9671c4 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-755579576", "imageRef": "b4566dc2-89d4-4b70-b314-15004b81fd35", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-438268119", "networks": [{"uuid": "b4c6ab36-0367-4fec-9b2b-482bb5209715"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:10:26.678741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:10:26.735689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-8739d2fa-d784-47eb-96b9-a59c9b9671c4 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] validate_networks() for [('b4c6ab36-0367-4fec-9b2b-482bb5209715', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 18:10:27.278701 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-8739d2fa-d784-47eb-96b9-a59c9b9671c4 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 18:10:27.279141 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-8739d2fa-d784-47eb-96b9-a59c9b9671c4 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 18:10:27.279625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-8739d2fa-d784-47eb-96b9-a59c9b9671c4 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 18:10:27.280253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-8739d2fa-d784-47eb-96b9-a59c9b9671c4 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 18:10:27.280673 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-8739d2fa-d784-47eb-96b9-a59c9b9671c4 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 18:10:27.291395 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8739d2fa-d784-47eb-96b9-a59c9b9671c4 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:27.291896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8739d2fa-d784-47eb-96b9-a59c9b9671c4 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:27.292345 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8739d2fa-d784-47eb-96b9-a59c9b9671c4 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:27.293108 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8739d2fa-d784-47eb-96b9-a59c9b9671c4 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:27.293727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8739d2fa-d784-47eb-96b9-a59c9b9671c4 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:27.294339 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8739d2fa-d784-47eb-96b9-a59c9b9671c4 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:27.315244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-8739d2fa-d784-47eb-96b9-a59c9b9671c4 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Getting quotas for project 5f56d86aa3c54de78d63221df7c9bb1f. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 18:10:27.322206 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-8739d2fa-d784-47eb-96b9-a59c9b9671c4 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Getting quotas for user fc6d59ce5a324ce2800ead7fe0d36697 and project 5f56d86aa3c54de78d63221df7c9bb1f. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 18:10:27.337419 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8739d2fa-d784-47eb-96b9-a59c9b9671c4 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 18:10:27.340053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8739d2fa-d784-47eb-96b9-a59c9b9671c4 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b4566dc2-89d4-4b70-b314-15004b81fd35',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 18:10:27.401139 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8739d2fa-d784-47eb-96b9-a59c9b9671c4 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.738887 Aug 04 18:10:27.401858 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3711/7391] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 18:10:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 18:10:27.411000 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=38 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:10:27.417225 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-24d0e553-7617-4fa9-8992-0c32fa0b6cb3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:10:27.417748 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-24d0e553-7617-4fa9-8992-0c32fa0b6cb3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:10:27.490413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-24d0e553-7617-4fa9-8992-0c32fa0b6cb3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:10:27.506372 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-24d0e553-7617-4fa9-8992-0c32fa0b6cb3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 200 len: 1257 microversion: 2.1 time: 0.095867 Aug 04 18:10:27.507489 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3681/7392] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:10:27 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 1257 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:10:28.541874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-20ca62d8-4ab7-4fe4-8b11-7605774da0ae tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:10:28.542449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-20ca62d8-4ab7-4fe4-8b11-7605774da0ae tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:10:28.549646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20ca62d8-4ab7-4fe4-8b11-7605774da0ae tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:28.550171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20ca62d8-4ab7-4fe4-8b11-7605774da0ae tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:28.550619 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20ca62d8-4ab7-4fe4-8b11-7605774da0ae tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:28.551333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20ca62d8-4ab7-4fe4-8b11-7605774da0ae tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:28.551795 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20ca62d8-4ab7-4fe4-8b11-7605774da0ae tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:28.552230 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20ca62d8-4ab7-4fe4-8b11-7605774da0ae tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:28.642249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-20ca62d8-4ab7-4fe4-8b11-7605774da0ae tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:10:28.650573 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-20ca62d8-4ab7-4fe4-8b11-7605774da0ae tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 200 len: 1309 microversion: 2.1 time: 0.113679 Aug 04 18:10:28.651393 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3712/7393] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:10:28 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 1309 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:10:29.675607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-93e4b66f-6724-4093-8cea-66078907b2d3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:10:29.677338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-93e4b66f-6724-4093-8cea-66078907b2d3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:10:29.694416 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93e4b66f-6724-4093-8cea-66078907b2d3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:29.695488 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93e4b66f-6724-4093-8cea-66078907b2d3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:29.696023 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93e4b66f-6724-4093-8cea-66078907b2d3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:29.697603 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93e4b66f-6724-4093-8cea-66078907b2d3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:29.698183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93e4b66f-6724-4093-8cea-66078907b2d3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:29.698642 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93e4b66f-6724-4093-8cea-66078907b2d3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:29.875381 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-93e4b66f-6724-4093-8cea-66078907b2d3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:10:29.889785 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-93e4b66f-6724-4093-8cea-66078907b2d3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 200 len: 1357 microversion: 2.1 time: 0.218685 Aug 04 18:10:29.890464 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3682/7394] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:10:29 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 1357 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:10:30.915520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a46312ef-6c04-4085-9cf2-d435c44a3aac tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:10:30.916224 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a46312ef-6c04-4085-9cf2-d435c44a3aac tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:10:30.923803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a46312ef-6c04-4085-9cf2-d435c44a3aac tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:30.924451 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a46312ef-6c04-4085-9cf2-d435c44a3aac tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:30.925093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a46312ef-6c04-4085-9cf2-d435c44a3aac tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:30.926000 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a46312ef-6c04-4085-9cf2-d435c44a3aac tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:30.926470 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a46312ef-6c04-4085-9cf2-d435c44a3aac tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:30.926905 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a46312ef-6c04-4085-9cf2-d435c44a3aac tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:31.092590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a46312ef-6c04-4085-9cf2-d435c44a3aac tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:10:31.104683 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a46312ef-6c04-4085-9cf2-d435c44a3aac tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 200 len: 1357 microversion: 2.1 time: 0.193199 Aug 04 18:10:31.113799 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3713/7395] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:10:30 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 1357 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:10:32.140457 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-463370de-1c15-44ca-8a82-a2ca3a80165e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:10:32.141484 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-463370de-1c15-44ca-8a82-a2ca3a80165e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:10:32.149321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-463370de-1c15-44ca-8a82-a2ca3a80165e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:32.149871 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-463370de-1c15-44ca-8a82-a2ca3a80165e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:32.150435 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-463370de-1c15-44ca-8a82-a2ca3a80165e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:32.151116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-463370de-1c15-44ca-8a82-a2ca3a80165e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:32.151595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-463370de-1c15-44ca-8a82-a2ca3a80165e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:32.152076 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-463370de-1c15-44ca-8a82-a2ca3a80165e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:32.360737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-463370de-1c15-44ca-8a82-a2ca3a80165e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:10:32.378437 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-463370de-1c15-44ca-8a82-a2ca3a80165e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 200 len: 1357 microversion: 2.1 time: 0.241956 Aug 04 18:10:32.379765 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3683/7396] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:10:32 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 1357 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:10:33.402382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4d30e56e-1bae-4866-bcd6-090ea916c41c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:10:33.403275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4d30e56e-1bae-4866-bcd6-090ea916c41c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:10:33.405413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:10:33.417968 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d30e56e-1bae-4866-bcd6-090ea916c41c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:33.418423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d30e56e-1bae-4866-bcd6-090ea916c41c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:33.418879 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d30e56e-1bae-4866-bcd6-090ea916c41c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:33.419608 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d30e56e-1bae-4866-bcd6-090ea916c41c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:33.420080 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d30e56e-1bae-4866-bcd6-090ea916c41c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:33.420614 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d30e56e-1bae-4866-bcd6-090ea916c41c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:33.571126 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4d30e56e-1bae-4866-bcd6-090ea916c41c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:10:33.581709 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4d30e56e-1bae-4866-bcd6-090ea916c41c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 200 len: 1357 microversion: 2.1 time: 0.184747 Aug 04 18:10:33.582341 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3714/7397] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:10:33 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:10:34.606673 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1ee2050f-5ecd-4251-973c-6634e166a608 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:10:34.607878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1ee2050f-5ecd-4251-973c-6634e166a608 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:10:34.610201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:10:34.616890 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ee2050f-5ecd-4251-973c-6634e166a608 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:34.617404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ee2050f-5ecd-4251-973c-6634e166a608 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:34.617860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ee2050f-5ecd-4251-973c-6634e166a608 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:34.618618 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ee2050f-5ecd-4251-973c-6634e166a608 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:34.619091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ee2050f-5ecd-4251-973c-6634e166a608 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:34.619535 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ee2050f-5ecd-4251-973c-6634e166a608 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:34.775419 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1ee2050f-5ecd-4251-973c-6634e166a608 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:10:34.789830 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1ee2050f-5ecd-4251-973c-6634e166a608 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 200 len: 1357 microversion: 2.1 time: 0.189889 Aug 04 18:10:34.794372 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3684/7398] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:10:34 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 1357 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:10:35.816543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-890f100b-d0dc-4c15-b17d-29dffe4daff3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:10:35.818310 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-890f100b-d0dc-4c15-b17d-29dffe4daff3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:10:35.827789 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-890f100b-d0dc-4c15-b17d-29dffe4daff3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:35.828206 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-890f100b-d0dc-4c15-b17d-29dffe4daff3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:35.828656 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-890f100b-d0dc-4c15-b17d-29dffe4daff3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:35.829380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-890f100b-d0dc-4c15-b17d-29dffe4daff3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:35.829851 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-890f100b-d0dc-4c15-b17d-29dffe4daff3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:35.830320 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-890f100b-d0dc-4c15-b17d-29dffe4daff3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:35.984065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-890f100b-d0dc-4c15-b17d-29dffe4daff3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:10:35.992244 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-890f100b-d0dc-4c15-b17d-29dffe4daff3 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 200 len: 1357 microversion: 2.1 time: 0.183522 Aug 04 18:10:35.992881 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3715/7399] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:10:35 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:10:37.013696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7af399f3-5b21-4461-b320-4299f44487ca tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:10:37.014612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7af399f3-5b21-4461-b320-4299f44487ca tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:10:37.022678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7af399f3-5b21-4461-b320-4299f44487ca tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:37.023177 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7af399f3-5b21-4461-b320-4299f44487ca tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:37.023627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7af399f3-5b21-4461-b320-4299f44487ca tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:37.024397 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7af399f3-5b21-4461-b320-4299f44487ca tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:37.025546 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7af399f3-5b21-4461-b320-4299f44487ca tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:37.026000 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7af399f3-5b21-4461-b320-4299f44487ca tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:37.168851 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7af399f3-5b21-4461-b320-4299f44487ca tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:10:37.178306 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7af399f3-5b21-4461-b320-4299f44487ca tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 200 len: 1357 microversion: 2.1 time: 0.169296 Aug 04 18:10:37.179119 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3685/7400] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:10:37 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:10:37.336085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-7e4c8026-9f77-4ee7-81f4-71041f33fd6c req-27535d7a-4b5e-42b5-a0a5-f88ed9f92918 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e2f005f-6821-474f-832d-82323f05caa3", "tag": "945cf837-ea2f-44aa-a07d-91a039a14f27"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:10:37.346409 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:10:37.347159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:10:37.349301 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7e4c8026-9f77-4ee7-81f4-71041f33fd6c req-27535d7a-4b5e-42b5-a0a5-f88ed9f92918 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:37.350495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7e4c8026-9f77-4ee7-81f4-71041f33fd6c req-27535d7a-4b5e-42b5-a0a5-f88ed9f92918 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:37.351167 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-7e4c8026-9f77-4ee7-81f4-71041f33fd6c req-27535d7a-4b5e-42b5-a0a5-f88ed9f92918 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:37.364118 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-7e4c8026-9f77-4ee7-81f4-71041f33fd6c req-27535d7a-4b5e-42b5-a0a5-f88ed9f92918 service nova] Creating event network-changed:945cf837-ea2f-44aa-a07d-91a039a14f27 for instance 8e2f005f-6821-474f-832d-82323f05caa3 on n-h1-851359-3 Aug 04 18:10:37.370012 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-7e4c8026-9f77-4ee7-81f4-71041f33fd6c req-27535d7a-4b5e-42b5-a0a5-f88ed9f92918 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037840 Aug 04 18:10:37.370897 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3716/7401] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:10:38.199364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f988f602-abfb-4831-b585-c0033d81cb40 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:10:38.199996 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f988f602-abfb-4831-b585-c0033d81cb40 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:10:38.201914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:10:38.208567 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f988f602-abfb-4831-b585-c0033d81cb40 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:38.209066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f988f602-abfb-4831-b585-c0033d81cb40 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:38.209597 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f988f602-abfb-4831-b585-c0033d81cb40 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:38.210366 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f988f602-abfb-4831-b585-c0033d81cb40 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:38.210811 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f988f602-abfb-4831-b585-c0033d81cb40 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:38.211245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f988f602-abfb-4831-b585-c0033d81cb40 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:38.359499 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f988f602-abfb-4831-b585-c0033d81cb40 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:10:38.367120 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f988f602-abfb-4831-b585-c0033d81cb40 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 200 len: 1357 microversion: 2.1 time: 0.171678 Aug 04 18:10:38.367703 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3686/7402] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:10:38 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:10:39.388981 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6506f749-e443-4b88-a25a-23d7cdb26362 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:10:39.389679 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6506f749-e443-4b88-a25a-23d7cdb26362 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:10:39.395927 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6506f749-e443-4b88-a25a-23d7cdb26362 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:39.396416 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6506f749-e443-4b88-a25a-23d7cdb26362 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:39.396853 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6506f749-e443-4b88-a25a-23d7cdb26362 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:39.397554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6506f749-e443-4b88-a25a-23d7cdb26362 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:39.398030 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6506f749-e443-4b88-a25a-23d7cdb26362 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:39.398458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6506f749-e443-4b88-a25a-23d7cdb26362 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:39.547171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6506f749-e443-4b88-a25a-23d7cdb26362 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:10:39.555167 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6506f749-e443-4b88-a25a-23d7cdb26362 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 200 len: 1357 microversion: 2.1 time: 0.171198 Aug 04 18:10:39.556598 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3717/7403] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:10:39 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:10:40.577749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b2b221c8-7863-4d37-a843-02f620453eca tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:10:40.578548 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b2b221c8-7863-4d37-a843-02f620453eca tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:10:40.585931 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2b221c8-7863-4d37-a843-02f620453eca tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:40.586479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2b221c8-7863-4d37-a843-02f620453eca tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:40.586935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2b221c8-7863-4d37-a843-02f620453eca tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:40.587718 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2b221c8-7863-4d37-a843-02f620453eca tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:40.588196 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2b221c8-7863-4d37-a843-02f620453eca tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:40.588633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2b221c8-7863-4d37-a843-02f620453eca tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:40.756467 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b2b221c8-7863-4d37-a843-02f620453eca tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:10:40.765038 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b2b221c8-7863-4d37-a843-02f620453eca tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 200 len: 1357 microversion: 2.1 time: 0.191113 Aug 04 18:10:40.765613 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3687/7404] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:10:40 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 1357 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:10:41.785504 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bc233473-43b0-4637-a0d8-a80fee745d75 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:10:41.786284 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bc233473-43b0-4637-a0d8-a80fee745d75 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:10:41.792951 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc233473-43b0-4637-a0d8-a80fee745d75 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:41.793443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc233473-43b0-4637-a0d8-a80fee745d75 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:41.793877 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc233473-43b0-4637-a0d8-a80fee745d75 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:41.794619 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc233473-43b0-4637-a0d8-a80fee745d75 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:41.795079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc233473-43b0-4637-a0d8-a80fee745d75 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:41.795505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bc233473-43b0-4637-a0d8-a80fee745d75 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:41.934653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bc233473-43b0-4637-a0d8-a80fee745d75 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:10:41.942299 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bc233473-43b0-4637-a0d8-a80fee745d75 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 200 len: 1357 microversion: 2.1 time: 0.160988 Aug 04 18:10:41.942893 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3718/7405] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:10:41 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:10:42.122965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-404b9a86-dcd8-4501-b012-a84418778dfc req-f04f3e39-928c-46fe-889a-6390345fe4c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e2f005f-6821-474f-832d-82323f05caa3", "name": "network-vif-plugged", "status": "completed", "tag": "945cf837-ea2f-44aa-a07d-91a039a14f27"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:10:42.132795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-404b9a86-dcd8-4501-b012-a84418778dfc req-f04f3e39-928c-46fe-889a-6390345fe4c9 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:42.133299 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-404b9a86-dcd8-4501-b012-a84418778dfc req-f04f3e39-928c-46fe-889a-6390345fe4c9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:42.133743 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-404b9a86-dcd8-4501-b012-a84418778dfc req-f04f3e39-928c-46fe-889a-6390345fe4c9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:42.145730 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-404b9a86-dcd8-4501-b012-a84418778dfc req-f04f3e39-928c-46fe-889a-6390345fe4c9 service nova] Creating event network-vif-plugged:945cf837-ea2f-44aa-a07d-91a039a14f27 for instance 8e2f005f-6821-474f-832d-82323f05caa3 on n-h1-851359-3 Aug 04 18:10:42.150816 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-404b9a86-dcd8-4501-b012-a84418778dfc req-f04f3e39-928c-46fe-889a-6390345fe4c9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110766 Aug 04 18:10:42.151428 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3688/7406] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:10:42.964983 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6c05cc38-e62b-4f2c-9894-fcfe4fab3482 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:10:42.965601 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6c05cc38-e62b-4f2c-9894-fcfe4fab3482 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:10:42.972583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c05cc38-e62b-4f2c-9894-fcfe4fab3482 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:42.973081 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c05cc38-e62b-4f2c-9894-fcfe4fab3482 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:42.973527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c05cc38-e62b-4f2c-9894-fcfe4fab3482 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:42.974273 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c05cc38-e62b-4f2c-9894-fcfe4fab3482 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:42.974799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c05cc38-e62b-4f2c-9894-fcfe4fab3482 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:42.975448 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c05cc38-e62b-4f2c-9894-fcfe4fab3482 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:43.114566 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6c05cc38-e62b-4f2c-9894-fcfe4fab3482 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:10:43.122889 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6c05cc38-e62b-4f2c-9894-fcfe4fab3482 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 200 len: 1357 microversion: 2.1 time: 0.162255 Aug 04 18:10:43.123603 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3719/7407] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:10:42 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:10:44.144991 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e08c3237-422e-45b8-b545-c8f8388d686c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:10:44.145700 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e08c3237-422e-45b8-b545-c8f8388d686c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:10:44.151922 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e08c3237-422e-45b8-b545-c8f8388d686c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:44.152415 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e08c3237-422e-45b8-b545-c8f8388d686c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:44.152860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e08c3237-422e-45b8-b545-c8f8388d686c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:44.153568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e08c3237-422e-45b8-b545-c8f8388d686c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:44.155035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e08c3237-422e-45b8-b545-c8f8388d686c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:44.155035 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e08c3237-422e-45b8-b545-c8f8388d686c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:44.304093 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e08c3237-422e-45b8-b545-c8f8388d686c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:10:44.312625 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e08c3237-422e-45b8-b545-c8f8388d686c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 200 len: 1547 microversion: 2.1 time: 0.172688 Aug 04 18:10:44.313224 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3689/7408] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:10:44 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 1547 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:10:44.334354 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-daac7f99-7e25-44fc-b7db-a20668378853 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:10:44.335014 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-daac7f99-7e25-44fc-b7db-a20668378853 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:10:44.342081 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-daac7f99-7e25-44fc-b7db-a20668378853 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:44.342581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-daac7f99-7e25-44fc-b7db-a20668378853 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:44.343022 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-daac7f99-7e25-44fc-b7db-a20668378853 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:44.343734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-daac7f99-7e25-44fc-b7db-a20668378853 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:44.344198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-daac7f99-7e25-44fc-b7db-a20668378853 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:44.344630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-daac7f99-7e25-44fc-b7db-a20668378853 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:44.478116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-daac7f99-7e25-44fc-b7db-a20668378853 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:10:44.486898 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-daac7f99-7e25-44fc-b7db-a20668378853 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 200 len: 1547 microversion: 2.1 time: 0.156542 Aug 04 18:10:44.487562 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3720/7409] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:10:44 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:10:44.507327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ab8d5127-e111-42bd-be69-d83b3ae584ab tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:10:44.511906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ab8d5127-e111-42bd-be69-d83b3ae584ab tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:10:44.512680 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ab8d5127-e111-42bd-be69-d83b3ae584ab tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Searching by: {'deleted': False, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 18:10:44.518184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab8d5127-e111-42bd-be69-d83b3ae584ab tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:44.518895 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab8d5127-e111-42bd-be69-d83b3ae584ab tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:44.519517 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab8d5127-e111-42bd-be69-d83b3ae584ab tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:44.520270 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab8d5127-e111-42bd-be69-d83b3ae584ab tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:44.520735 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab8d5127-e111-42bd-be69-d83b3ae584ab tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:44.521171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab8d5127-e111-42bd-be69-d83b3ae584ab tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:44.546419 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-ab8d5127-e111-42bd-be69-d83b3ae584ab tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 18:10:44.577856 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ab8d5127-e111-42bd-be69-d83b3ae584ab tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.074159 Aug 04 18:10:44.578474 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3690/7410] 10.222.0.93 () {58 vars in 1125 bytes} [Thu Aug 4 18:10:44 2022] GET /compute/v2.1/servers => generated 342 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:10:44.589702 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c1aba7e4-846b-486b-ab29-8f8253692a5c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:10:44.590371 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c1aba7e4-846b-486b-ab29-8f8253692a5c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:10:44.601948 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c1aba7e4-846b-486b-ab29-8f8253692a5c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:44.602493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c1aba7e4-846b-486b-ab29-8f8253692a5c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:44.602950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c1aba7e4-846b-486b-ab29-8f8253692a5c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:44.604162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c1aba7e4-846b-486b-ab29-8f8253692a5c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:44.604628 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c1aba7e4-846b-486b-ab29-8f8253692a5c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:44.605066 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c1aba7e4-846b-486b-ab29-8f8253692a5c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:44.749516 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c1aba7e4-846b-486b-ab29-8f8253692a5c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:10:44.757878 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c1aba7e4-846b-486b-ab29-8f8253692a5c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 200 len: 1547 microversion: 2.1 time: 0.172068 Aug 04 18:10:44.759246 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3721/7411] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:10:44 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 1547 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:10:46.272575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c0c0276a-990a-4955-b853-f641d30e82bc tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9dd936f8-4df3-450f-9561-f57526f100ee"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:10:46.274954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c0c0276a-990a-4955-b853-f641d30e82bc tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:10:46.281877 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0c0276a-990a-4955-b853-f641d30e82bc tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:46.282426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0c0276a-990a-4955-b853-f641d30e82bc tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:46.282876 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0c0276a-990a-4955-b853-f641d30e82bc tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:46.283594 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0c0276a-990a-4955-b853-f641d30e82bc tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:46.284062 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0c0276a-990a-4955-b853-f641d30e82bc tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:46.284502 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0c0276a-990a-4955-b853-f641d30e82bc tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:46.568391 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c0c0276a-990a-4955-b853-f641d30e82bc tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "POST /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299632 Aug 04 18:10:46.569061 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3691/7412] 10.222.0.93 () {60 vars in 1323 bytes} [Thu Aug 4 18:10:46 2022] POST /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:10:57.430268 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1de06ee0-e3b3-461f-ac5c-72d6e5831a2d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:10:57.431084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1de06ee0-e3b3-461f-ac5c-72d6e5831a2d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:10:57.434439 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=15 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:10:57.435109 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=58 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:10:57.441130 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1de06ee0-e3b3-461f-ac5c-72d6e5831a2d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:57.441630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1de06ee0-e3b3-461f-ac5c-72d6e5831a2d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:57.442104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1de06ee0-e3b3-461f-ac5c-72d6e5831a2d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:57.442826 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1de06ee0-e3b3-461f-ac5c-72d6e5831a2d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:57.443289 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1de06ee0-e3b3-461f-ac5c-72d6e5831a2d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:57.443753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1de06ee0-e3b3-461f-ac5c-72d6e5831a2d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:57.583503 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1de06ee0-e3b3-461f-ac5c-72d6e5831a2d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:10:57.592634 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1de06ee0-e3b3-461f-ac5c-72d6e5831a2d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 200 len: 1593 microversion: 2.1 time: 0.166237 Aug 04 18:10:57.593232 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3722/7413] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:10:57 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 1593 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:10:59.394986 n-d-851359-3 devstack@n-api.service[131044]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5669b2b7-e423-4a49-b572-a6035398afb4] AMQP server on 10.222.0.93:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Aug 04 18:10:59.396598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:10:59.397175 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=15 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:10:59.398575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:10:59.402651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b6dda6db-fc09-4df1-87c0-2f01c665a98e req-a2fe0691-5abc-4005-80b7-d4be298214da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e2f005f-6821-474f-832d-82323f05caa3", "tag": "945cf837-ea2f-44aa-a07d-91a039a14f27"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:10:59.418440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b6dda6db-fc09-4df1-87c0-2f01c665a98e req-a2fe0691-5abc-4005-80b7-d4be298214da service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:10:59.419311 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b6dda6db-fc09-4df1-87c0-2f01c665a98e req-a2fe0691-5abc-4005-80b7-d4be298214da service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:10:59.419782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b6dda6db-fc09-4df1-87c0-2f01c665a98e req-a2fe0691-5abc-4005-80b7-d4be298214da service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:10:59.434090 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b6dda6db-fc09-4df1-87c0-2f01c665a98e req-a2fe0691-5abc-4005-80b7-d4be298214da service nova] Creating event network-changed:945cf837-ea2f-44aa-a07d-91a039a14f27 for instance 8e2f005f-6821-474f-832d-82323f05caa3 on n-h1-851359-3 Aug 04 18:10:59.440385 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b6dda6db-fc09-4df1-87c0-2f01c665a98e req-a2fe0691-5abc-4005-80b7-d4be298214da service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047074 Aug 04 18:10:59.441179 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3692/7414] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:11:00.651952 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4c917903-e49b-4db2-a461-e23213ea679c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-165932274"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:11:00.652588 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4c917903-e49b-4db2-a461-e23213ea679c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:11:00.661276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c917903-e49b-4db2-a461-e23213ea679c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:11:00.662317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c917903-e49b-4db2-a461-e23213ea679c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:11:00.663203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c917903-e49b-4db2-a461-e23213ea679c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:11:00.664105 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c917903-e49b-4db2-a461-e23213ea679c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:11:00.664946 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c917903-e49b-4db2-a461-e23213ea679c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:11:00.665533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c917903-e49b-4db2-a461-e23213ea679c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:11:00.802991 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.network.security_group_api [None req-4c917903-e49b-4db2-a461-e23213ea679c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Adding security group 1d14e7aa-5a44-4a81-90d5-a05121989f5f to port 945cf837-ea2f-44aa-a07d-91a039a14f27 Aug 04 18:11:01.137172 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4c917903-e49b-4db2-a461-e23213ea679c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "POST /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3/action" status: 202 len: 0 microversion: 2.1 time: 0.490018 Aug 04 18:11:01.137823 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3723/7415] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:11:00 2022] POST /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 18:11:01.148837 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7b961e69-7943-4544-b8a5-ee2660e2282c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:11:01.149967 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7b961e69-7943-4544-b8a5-ee2660e2282c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:11:01.157966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b961e69-7943-4544-b8a5-ee2660e2282c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:11:01.158739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b961e69-7943-4544-b8a5-ee2660e2282c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:11:01.159216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b961e69-7943-4544-b8a5-ee2660e2282c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:11:01.160898 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b961e69-7943-4544-b8a5-ee2660e2282c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:11:01.161580 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b961e69-7943-4544-b8a5-ee2660e2282c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:11:01.162747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b961e69-7943-4544-b8a5-ee2660e2282c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:11:01.169479 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] [5669b2b7-e423-4a49-b572-a6035398afb4] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 57698. Aug 04 18:11:01.329061 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7b961e69-7943-4544-b8a5-ee2660e2282c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:11:01.339362 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7b961e69-7943-4544-b8a5-ee2660e2282c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 200 len: 1758 microversion: 2.1 time: 0.196723 Aug 04 18:11:01.354032 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3693/7416] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:11:01 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 1758 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:11:01.458330 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-88645326-ddb9-458e-bc58-121a9c1ea7f6 req-d9180d4a-9e97-493e-a35d-581a5e90fb81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e2f005f-6821-474f-832d-82323f05caa3", "tag": "945cf837-ea2f-44aa-a07d-91a039a14f27"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:11:01.476741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-88645326-ddb9-458e-bc58-121a9c1ea7f6 req-d9180d4a-9e97-493e-a35d-581a5e90fb81 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:11:01.477607 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-88645326-ddb9-458e-bc58-121a9c1ea7f6 req-d9180d4a-9e97-493e-a35d-581a5e90fb81 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:11:01.479121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-88645326-ddb9-458e-bc58-121a9c1ea7f6 req-d9180d4a-9e97-493e-a35d-581a5e90fb81 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:11:01.495437 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-88645326-ddb9-458e-bc58-121a9c1ea7f6 req-d9180d4a-9e97-493e-a35d-581a5e90fb81 service nova] Creating event network-changed:945cf837-ea2f-44aa-a07d-91a039a14f27 for instance 8e2f005f-6821-474f-832d-82323f05caa3 on n-h1-851359-3 Aug 04 18:11:01.502421 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-88645326-ddb9-458e-bc58-121a9c1ea7f6 req-d9180d4a-9e97-493e-a35d-581a5e90fb81 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050922 Aug 04 18:11:01.503084 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3724/7417] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:11:03.166216 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:11:03.166818 n-d-851359-3 devstack@n-api.service[131044]: Thu Aug 4 18:11:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:11:16.281807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7f708201-2806-420b-9ef6-20c1748d751c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:11:16.285026 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7f708201-2806-420b-9ef6-20c1748d751c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:11:16.288939 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:11:16.289813 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=8 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:11:16.298093 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f708201-2806-420b-9ef6-20c1748d751c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:11:16.298617 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f708201-2806-420b-9ef6-20c1748d751c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:11:16.299081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f708201-2806-420b-9ef6-20c1748d751c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:11:16.299864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f708201-2806-420b-9ef6-20c1748d751c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:11:16.300672 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f708201-2806-420b-9ef6-20c1748d751c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:11:16.301124 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f708201-2806-420b-9ef6-20c1748d751c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:11:16.387837 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7f708201-2806-420b-9ef6-20c1748d751c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "POST /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3/action" status: 202 len: 0 microversion: 2.1 time: 0.109918 Aug 04 18:11:16.388565 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3694/7418] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:11:16 2022] POST /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 18:11:16.396581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:11:16.399246 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=12 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:11:16.410343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9cf0692f-356b-4c2d-98bb-2799d2ef8fb0 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:11:16.411973 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9cf0692f-356b-4c2d-98bb-2799d2ef8fb0 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:11:16.421920 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9cf0692f-356b-4c2d-98bb-2799d2ef8fb0 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:11:16.422448 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9cf0692f-356b-4c2d-98bb-2799d2ef8fb0 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:11:16.422899 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9cf0692f-356b-4c2d-98bb-2799d2ef8fb0 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:11:16.423622 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9cf0692f-356b-4c2d-98bb-2799d2ef8fb0 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:11:16.424093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9cf0692f-356b-4c2d-98bb-2799d2ef8fb0 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:11:16.424530 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9cf0692f-356b-4c2d-98bb-2799d2ef8fb0 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:11:16.609843 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9cf0692f-356b-4c2d-98bb-2799d2ef8fb0 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:11:16.621567 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9cf0692f-356b-4c2d-98bb-2799d2ef8fb0 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 200 len: 1750 microversion: 2.1 time: 0.228274 Aug 04 18:11:16.622194 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3725/7419] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:11:16 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 1750 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:11:17.694964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-64bb2711-53cf-4c35-a9ee-f714a86d7c86 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:11:17.695722 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-64bb2711-53cf-4c35-a9ee-f714a86d7c86 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:11:17.702879 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64bb2711-53cf-4c35-a9ee-f714a86d7c86 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:11:17.703534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64bb2711-53cf-4c35-a9ee-f714a86d7c86 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:11:17.703993 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64bb2711-53cf-4c35-a9ee-f714a86d7c86 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:11:17.704715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64bb2711-53cf-4c35-a9ee-f714a86d7c86 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:11:17.705192 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64bb2711-53cf-4c35-a9ee-f714a86d7c86 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:11:17.705636 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64bb2711-53cf-4c35-a9ee-f714a86d7c86 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:11:17.863278 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-64bb2711-53cf-4c35-a9ee-f714a86d7c86 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:11:17.872661 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-64bb2711-53cf-4c35-a9ee-f714a86d7c86 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 200 len: 1755 microversion: 2.1 time: 0.232557 Aug 04 18:11:17.873283 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3695/7420] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:11:17 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 1755 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:11:18.895866 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cbf95302-23e9-47b8-ae75-81529b2fbf90 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:11:18.896438 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cbf95302-23e9-47b8-ae75-81529b2fbf90 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:11:18.903661 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cbf95302-23e9-47b8-ae75-81529b2fbf90 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:11:18.904166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cbf95302-23e9-47b8-ae75-81529b2fbf90 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:11:18.904615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cbf95302-23e9-47b8-ae75-81529b2fbf90 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:11:18.905328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cbf95302-23e9-47b8-ae75-81529b2fbf90 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:11:18.905799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cbf95302-23e9-47b8-ae75-81529b2fbf90 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:11:18.906277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cbf95302-23e9-47b8-ae75-81529b2fbf90 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:11:19.056277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cbf95302-23e9-47b8-ae75-81529b2fbf90 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:11:19.064439 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cbf95302-23e9-47b8-ae75-81529b2fbf90 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 200 len: 1755 microversion: 2.1 time: 0.173172 Aug 04 18:11:19.065010 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3726/7421] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:11:18 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:11:20.086911 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a09bac14-3f55-4c52-b8c5-5d235b33732c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:11:20.087761 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a09bac14-3f55-4c52-b8c5-5d235b33732c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:11:20.095452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a09bac14-3f55-4c52-b8c5-5d235b33732c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:11:20.095962 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a09bac14-3f55-4c52-b8c5-5d235b33732c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:11:20.096419 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a09bac14-3f55-4c52-b8c5-5d235b33732c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:11:20.097143 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a09bac14-3f55-4c52-b8c5-5d235b33732c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:11:20.097617 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a09bac14-3f55-4c52-b8c5-5d235b33732c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:11:20.098086 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a09bac14-3f55-4c52-b8c5-5d235b33732c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:11:20.256781 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a09bac14-3f55-4c52-b8c5-5d235b33732c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:11:20.264967 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a09bac14-3f55-4c52-b8c5-5d235b33732c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 200 len: 1755 microversion: 2.1 time: 0.182439 Aug 04 18:11:20.265538 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3696/7422] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:11:20 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:11:21.286639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-91795a06-80b0-415e-948f-0789086ff8ea tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:11:21.287252 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-91795a06-80b0-415e-948f-0789086ff8ea tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:11:21.294689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91795a06-80b0-415e-948f-0789086ff8ea tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:11:21.295180 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91795a06-80b0-415e-948f-0789086ff8ea tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:11:21.295629 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91795a06-80b0-415e-948f-0789086ff8ea tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:11:21.296329 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91795a06-80b0-415e-948f-0789086ff8ea tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:11:21.296796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91795a06-80b0-415e-948f-0789086ff8ea tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:11:21.297222 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-91795a06-80b0-415e-948f-0789086ff8ea tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:11:21.450552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-91795a06-80b0-415e-948f-0789086ff8ea tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:11:21.459575 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-91795a06-80b0-415e-948f-0789086ff8ea tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 200 len: 1755 microversion: 2.1 time: 0.176758 Aug 04 18:11:21.460290 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3727/7423] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:11:21 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:11:22.483269 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3280da62-74da-4c73-aeb9-bba357dce00e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:11:22.483824 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3280da62-74da-4c73-aeb9-bba357dce00e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:11:22.490913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3280da62-74da-4c73-aeb9-bba357dce00e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:11:22.491410 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3280da62-74da-4c73-aeb9-bba357dce00e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:11:22.491860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3280da62-74da-4c73-aeb9-bba357dce00e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:11:22.492566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3280da62-74da-4c73-aeb9-bba357dce00e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:11:22.493062 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3280da62-74da-4c73-aeb9-bba357dce00e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:11:22.493529 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3280da62-74da-4c73-aeb9-bba357dce00e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:11:22.644589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3280da62-74da-4c73-aeb9-bba357dce00e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:11:22.653526 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3280da62-74da-4c73-aeb9-bba357dce00e tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 200 len: 1755 microversion: 2.1 time: 0.174237 Aug 04 18:11:22.654149 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3697/7424] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:11:22 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:11:23.675114 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4da75d72-f529-4521-a0c4-ee2330a392ab tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:11:23.675737 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4da75d72-f529-4521-a0c4-ee2330a392ab tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:11:23.683400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4da75d72-f529-4521-a0c4-ee2330a392ab tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:11:23.684172 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4da75d72-f529-4521-a0c4-ee2330a392ab tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:11:23.684630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4da75d72-f529-4521-a0c4-ee2330a392ab tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:11:23.685342 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4da75d72-f529-4521-a0c4-ee2330a392ab tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:11:23.685803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4da75d72-f529-4521-a0c4-ee2330a392ab tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:11:23.686275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4da75d72-f529-4521-a0c4-ee2330a392ab tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:11:23.838850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4da75d72-f529-4521-a0c4-ee2330a392ab tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:11:23.849598 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4da75d72-f529-4521-a0c4-ee2330a392ab tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 200 len: 1755 microversion: 2.1 time: 0.178665 Aug 04 18:11:23.850223 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3728/7425] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:11:23 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:11:24.874961 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9aba0548-bf10-424f-a75e-044a0184fe9c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:11:24.875555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9aba0548-bf10-424f-a75e-044a0184fe9c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:11:24.883230 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9aba0548-bf10-424f-a75e-044a0184fe9c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:11:24.883764 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9aba0548-bf10-424f-a75e-044a0184fe9c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:11:24.884785 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9aba0548-bf10-424f-a75e-044a0184fe9c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:11:24.885560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9aba0548-bf10-424f-a75e-044a0184fe9c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:11:24.886122 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9aba0548-bf10-424f-a75e-044a0184fe9c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:11:24.886599 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9aba0548-bf10-424f-a75e-044a0184fe9c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:11:25.045942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9aba0548-bf10-424f-a75e-044a0184fe9c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:11:25.054280 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9aba0548-bf10-424f-a75e-044a0184fe9c tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 200 len: 1755 microversion: 2.1 time: 0.183965 Aug 04 18:11:25.054825 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3698/7426] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:11:24 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:11:26.078160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d8908241-5d11-4f2d-89cd-2b3c3a9f3b51 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:11:26.078786 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d8908241-5d11-4f2d-89cd-2b3c3a9f3b51 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:11:26.085716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8908241-5d11-4f2d-89cd-2b3c3a9f3b51 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:11:26.086405 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8908241-5d11-4f2d-89cd-2b3c3a9f3b51 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:11:26.086775 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8908241-5d11-4f2d-89cd-2b3c3a9f3b51 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:11:26.088113 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8908241-5d11-4f2d-89cd-2b3c3a9f3b51 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:11:26.088632 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8908241-5d11-4f2d-89cd-2b3c3a9f3b51 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:11:26.089017 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d8908241-5d11-4f2d-89cd-2b3c3a9f3b51 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:11:26.265657 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d8908241-5d11-4f2d-89cd-2b3c3a9f3b51 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:11:26.277839 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d8908241-5d11-4f2d-89cd-2b3c3a9f3b51 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 200 len: 1755 microversion: 2.1 time: 0.203562 Aug 04 18:11:26.279496 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3729/7427] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:11:26 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 1755 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:11:27.302453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5367c543-41b9-4ce3-8ba7-f00853d3cafb tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:11:27.303076 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5367c543-41b9-4ce3-8ba7-f00853d3cafb tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:11:27.310100 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5367c543-41b9-4ce3-8ba7-f00853d3cafb tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:11:27.310596 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5367c543-41b9-4ce3-8ba7-f00853d3cafb tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:11:27.311040 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5367c543-41b9-4ce3-8ba7-f00853d3cafb tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:11:27.311744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5367c543-41b9-4ce3-8ba7-f00853d3cafb tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:11:27.312206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5367c543-41b9-4ce3-8ba7-f00853d3cafb tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:11:27.312649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5367c543-41b9-4ce3-8ba7-f00853d3cafb tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:11:27.459743 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5367c543-41b9-4ce3-8ba7-f00853d3cafb tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:11:27.468833 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5367c543-41b9-4ce3-8ba7-f00853d3cafb tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 200 len: 1755 microversion: 2.1 time: 0.171037 Aug 04 18:11:27.469407 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3699/7428] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:11:27 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:11:28.490282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2818db2a-61da-4c79-b95b-5c34012c82fc tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:11:28.490825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2818db2a-61da-4c79-b95b-5c34012c82fc tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:11:28.498004 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2818db2a-61da-4c79-b95b-5c34012c82fc tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:11:28.498551 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2818db2a-61da-4c79-b95b-5c34012c82fc tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:11:28.499006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2818db2a-61da-4c79-b95b-5c34012c82fc tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:11:28.499803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2818db2a-61da-4c79-b95b-5c34012c82fc tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:11:28.500184 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2818db2a-61da-4c79-b95b-5c34012c82fc tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:11:28.500619 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2818db2a-61da-4c79-b95b-5c34012c82fc tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:11:28.662869 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2818db2a-61da-4c79-b95b-5c34012c82fc tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:11:28.672429 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2818db2a-61da-4c79-b95b-5c34012c82fc tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 200 len: 1758 microversion: 2.1 time: 0.185866 Aug 04 18:11:28.672700 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3730/7429] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:11:28 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 1758 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:12:00.871471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-392ead57-8b4a-4364-b461-53a249d7ccba tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-165932274"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:12:00.872068 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-392ead57-8b4a-4364-b461-53a249d7ccba tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:12:00.874424 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=12 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:12:00.875310 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:12:00.880628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-392ead57-8b4a-4364-b461-53a249d7ccba tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:00.881343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-392ead57-8b4a-4364-b461-53a249d7ccba tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:00.881789 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-392ead57-8b4a-4364-b461-53a249d7ccba tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:00.882446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-392ead57-8b4a-4364-b461-53a249d7ccba tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:00.882916 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-392ead57-8b4a-4364-b461-53a249d7ccba tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:00.883376 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-392ead57-8b4a-4364-b461-53a249d7ccba tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:01.020177 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.network.security_group_api [None req-392ead57-8b4a-4364-b461-53a249d7ccba tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Removing security group 1d14e7aa-5a44-4a81-90d5-a05121989f5f from port 945cf837-ea2f-44aa-a07d-91a039a14f27 Aug 04 18:12:01.354719 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-392ead57-8b4a-4364-b461-53a249d7ccba tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "POST /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3/action" status: 202 len: 0 microversion: 2.1 time: 0.487809 Aug 04 18:12:01.358596 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3700/7430] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:12:00 2022] POST /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 18:12:01.368415 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-e0cc955c-ccbf-4ca0-b2ac-5ebdf7a3286e req-72792bba-836b-4cba-b0a2-4ea6487c9199 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e2f005f-6821-474f-832d-82323f05caa3", "tag": "945cf837-ea2f-44aa-a07d-91a039a14f27"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:12:01.374483 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=12 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:12:01.375226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=36 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:12:01.382868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e0cc955c-ccbf-4ca0-b2ac-5ebdf7a3286e req-72792bba-836b-4cba-b0a2-4ea6487c9199 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:01.383436 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e0cc955c-ccbf-4ca0-b2ac-5ebdf7a3286e req-72792bba-836b-4cba-b0a2-4ea6487c9199 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:01.383952 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e0cc955c-ccbf-4ca0-b2ac-5ebdf7a3286e req-72792bba-836b-4cba-b0a2-4ea6487c9199 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:01.396276 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-e0cc955c-ccbf-4ca0-b2ac-5ebdf7a3286e req-72792bba-836b-4cba-b0a2-4ea6487c9199 service nova] Creating event network-changed:945cf837-ea2f-44aa-a07d-91a039a14f27 for instance 8e2f005f-6821-474f-832d-82323f05caa3 on n-h1-851359-3 Aug 04 18:12:01.402041 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-e0cc955c-ccbf-4ca0-b2ac-5ebdf7a3286e req-72792bba-836b-4cba-b0a2-4ea6487c9199 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038011 Aug 04 18:12:01.403006 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3731/7431] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:12:02.950807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-96982787-4e69-4b28-b86a-02363825a315 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:12:02.951431 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-96982787-4e69-4b28-b86a-02363825a315 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:12:02.957767 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96982787-4e69-4b28-b86a-02363825a315 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:02.958296 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96982787-4e69-4b28-b86a-02363825a315 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:02.958744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96982787-4e69-4b28-b86a-02363825a315 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:02.959462 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96982787-4e69-4b28-b86a-02363825a315 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:02.959932 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96982787-4e69-4b28-b86a-02363825a315 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:02.960371 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96982787-4e69-4b28-b86a-02363825a315 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:03.054537 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-96982787-4e69-4b28-b86a-02363825a315 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lazy-loading 'services' on Instance uuid 8e2f005f-6821-474f-832d-82323f05caa3 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 18:12:03.132621 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-96982787-4e69-4b28-b86a-02363825a315 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3/os-volume_attachments/9dd936f8-4df3-450f-9561-f57526f100ee" status: 202 len: 0 microversion: 2.1 time: 0.186652 Aug 04 18:12:03.133380 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3701/7432] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Aug 4 18:12:02 2022] DELETE /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3/os-volume_attachments/9dd936f8-4df3-450f-9561-f57526f100ee => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 18:12:03.143596 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ba73e494-ab1d-41cd-873c-392936e3b23d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:12:03.146634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ba73e494-ab1d-41cd-873c-392936e3b23d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:12:03.153949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba73e494-ab1d-41cd-873c-392936e3b23d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:03.154389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba73e494-ab1d-41cd-873c-392936e3b23d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:03.154837 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba73e494-ab1d-41cd-873c-392936e3b23d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:03.155902 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba73e494-ab1d-41cd-873c-392936e3b23d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:03.156044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba73e494-ab1d-41cd-873c-392936e3b23d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:03.156479 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ba73e494-ab1d-41cd-873c-392936e3b23d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:03.189180 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ba73e494-ab1d-41cd-873c-392936e3b23d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051075 Aug 04 18:12:03.190119 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3732/7433] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 18:12:03 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:12:03.428204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-cb500e0e-f779-4609-b085-f361bc464477 req-00b755d2-0b09-45b9-a1df-97f8fc169ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e2f005f-6821-474f-832d-82323f05caa3", "tag": "945cf837-ea2f-44aa-a07d-91a039a14f27"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:12:03.441261 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-cb500e0e-f779-4609-b085-f361bc464477 req-00b755d2-0b09-45b9-a1df-97f8fc169ca8 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:03.441759 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-cb500e0e-f779-4609-b085-f361bc464477 req-00b755d2-0b09-45b9-a1df-97f8fc169ca8 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:03.442239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-cb500e0e-f779-4609-b085-f361bc464477 req-00b755d2-0b09-45b9-a1df-97f8fc169ca8 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:03.453854 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-cb500e0e-f779-4609-b085-f361bc464477 req-00b755d2-0b09-45b9-a1df-97f8fc169ca8 service nova] Creating event network-changed:945cf837-ea2f-44aa-a07d-91a039a14f27 for instance 8e2f005f-6821-474f-832d-82323f05caa3 on n-h1-851359-3 Aug 04 18:12:03.458820 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-cb500e0e-f779-4609-b085-f361bc464477 req-00b755d2-0b09-45b9-a1df-97f8fc169ca8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037523 Aug 04 18:12:03.459429 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3702/7434] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:12:04.201218 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2daf6939-e077-449e-afef-806f7367c184 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:12:04.203587 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2daf6939-e077-449e-afef-806f7367c184 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:12:04.212163 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2daf6939-e077-449e-afef-806f7367c184 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:04.212900 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2daf6939-e077-449e-afef-806f7367c184 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:04.213354 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2daf6939-e077-449e-afef-806f7367c184 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:04.214156 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2daf6939-e077-449e-afef-806f7367c184 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:04.214668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2daf6939-e077-449e-afef-806f7367c184 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:04.215104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2daf6939-e077-449e-afef-806f7367c184 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:04.260796 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2daf6939-e077-449e-afef-806f7367c184 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063595 Aug 04 18:12:04.262265 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3733/7435] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 18:12:04 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:12:05.276478 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eb482b0e-ae07-4337-b573-de16d8811456 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:12:05.278892 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eb482b0e-ae07-4337-b573-de16d8811456 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:12:05.286785 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb482b0e-ae07-4337-b573-de16d8811456 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:05.287344 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb482b0e-ae07-4337-b573-de16d8811456 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:05.287792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb482b0e-ae07-4337-b573-de16d8811456 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:05.288538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb482b0e-ae07-4337-b573-de16d8811456 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:05.289210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb482b0e-ae07-4337-b573-de16d8811456 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:05.289660 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb482b0e-ae07-4337-b573-de16d8811456 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:05.331354 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eb482b0e-ae07-4337-b573-de16d8811456 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061292 Aug 04 18:12:05.331956 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3703/7436] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 18:12:05 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:12:06.345424 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d0b8eb12-328c-489a-b304-0ea00891d5b8 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:12:06.347741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d0b8eb12-328c-489a-b304-0ea00891d5b8 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:12:06.355543 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d0b8eb12-328c-489a-b304-0ea00891d5b8 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:06.356052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d0b8eb12-328c-489a-b304-0ea00891d5b8 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:06.356507 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d0b8eb12-328c-489a-b304-0ea00891d5b8 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:06.357393 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d0b8eb12-328c-489a-b304-0ea00891d5b8 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:06.357819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d0b8eb12-328c-489a-b304-0ea00891d5b8 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:06.358291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d0b8eb12-328c-489a-b304-0ea00891d5b8 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:06.389589 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d0b8eb12-328c-489a-b304-0ea00891d5b8 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048763 Aug 04 18:12:06.390282 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3734/7437] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 18:12:06 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:12:07.402890 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dc98afb2-45d1-475e-8884-116f2106548b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:12:07.405091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dc98afb2-45d1-475e-8884-116f2106548b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:12:07.412051 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc98afb2-45d1-475e-8884-116f2106548b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:07.412669 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc98afb2-45d1-475e-8884-116f2106548b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:07.413014 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc98afb2-45d1-475e-8884-116f2106548b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:07.413737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc98afb2-45d1-475e-8884-116f2106548b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:07.414248 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc98afb2-45d1-475e-8884-116f2106548b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:07.414693 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc98afb2-45d1-475e-8884-116f2106548b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:07.452378 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dc98afb2-45d1-475e-8884-116f2106548b tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054043 Aug 04 18:12:07.452977 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3704/7438] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 18:12:07 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:12:08.464926 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cee7d600-0a02-4abd-841a-971c64ac658a tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:12:08.467190 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cee7d600-0a02-4abd-841a-971c64ac658a tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:12:08.474157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cee7d600-0a02-4abd-841a-971c64ac658a tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:08.474655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cee7d600-0a02-4abd-841a-971c64ac658a tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:08.475094 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cee7d600-0a02-4abd-841a-971c64ac658a tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:08.475796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cee7d600-0a02-4abd-841a-971c64ac658a tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:08.476257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cee7d600-0a02-4abd-841a-971c64ac658a tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:08.476690 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cee7d600-0a02-4abd-841a-971c64ac658a tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:08.506856 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cee7d600-0a02-4abd-841a-971c64ac658a tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045931 Aug 04 18:12:08.507336 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3735/7439] 10.222.0.93 () {58 vars in 1302 bytes} [Thu Aug 4 18:12:08 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 18:12:08.517835 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aa0544cb-a8ee-4abd-a19a-fb70cdaba789 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:12:08.518401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aa0544cb-a8ee-4abd-a19a-fb70cdaba789 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:12:08.525354 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa0544cb-a8ee-4abd-a19a-fb70cdaba789 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:08.525850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa0544cb-a8ee-4abd-a19a-fb70cdaba789 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:08.526343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa0544cb-a8ee-4abd-a19a-fb70cdaba789 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:08.527049 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa0544cb-a8ee-4abd-a19a-fb70cdaba789 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:08.527522 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa0544cb-a8ee-4abd-a19a-fb70cdaba789 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:08.527964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa0544cb-a8ee-4abd-a19a-fb70cdaba789 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:08.609512 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-aa0544cb-a8ee-4abd-a19a-fb70cdaba789 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] HTTP exception thrown: Instance 8e2f005f-6821-474f-832d-82323f05caa3 is not attached to volume 9dd936f8-4df3-450f-9561-f57526f100ee Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aa0544cb-a8ee-4abd-a19a-fb70cdaba789 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Request method failure captured: Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3/os-volume_attachments/9dd936f8-4df3-450f-9561-f57526f100ee HTTP/1.1 Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AqTp6C4ysKBWsP7Ihj62yRoY_JChCeplpEMF2zkDMd34kakT4claYSaeW9T4G72L8Loj_5Gk4_RWjdXhCYvYrMdJL50m7kkzzsFsvnMYEdZYWrNal6gEc5moP-CO-5IVQEC7idp7C1ia7lr_0GKeG1ZEYcOpxMS5dX8-ZHDHBOqXCQ Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 5f56d86aa3c54de78d63221df7c9bb1f Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TestMinimumBasicScenario-1511987094 Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f56d86aa3c54de78d63221df7c9bb1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f56d86aa3c54de78d63221df7c9bb1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f56d86aa3c54de78d63221df7c9bb1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f56d86aa3c54de78d63221df7c9bb1f"}]}] Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TestMinimumBasicScenario-1511987094 Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 5f56d86aa3c54de78d63221df7c9bb1f Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1511987094 Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TestMinimumBasicScenario-1511987094-project Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: fc6d59ce5a324ce2800ead7fe0d36697 Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TestMinimumBasicScenario-1511987094-project Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 8e2f005f-6821-474f-832d-82323f05caa3 is not attached to volume 9dd936f8-4df3-450f-9561-f57526f100ee Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'server_id': '8e2f005f-6821-474f-832d-82323f05caa3', 'id': '9dd936f8-4df3-450f-9561-f57526f100ee'} Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9dd936f8-4df3-450f-9561-f57526f100ee. Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e2f005f-6821-474f-832d-82323f05caa3 is not attached to volume 9dd936f8-4df3-450f-9561-f57526f100ee Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:12:08.611221 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:12:08.615591 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:12:08.615591 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:12:08.615591 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e2f005f-6821-474f-832d-82323f05caa3 is not attached to volume 9dd936f8-4df3-450f-9561-f57526f100ee Aug 04 18:12:08.615591 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:12:08.615591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aa0544cb-a8ee-4abd-a19a-fb70cdaba789 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Returning 404 to user: Instance 8e2f005f-6821-474f-832d-82323f05caa3 is not attached to volume 9dd936f8-4df3-450f-9561-f57526f100ee {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:12:08.615591 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aa0544cb-a8ee-4abd-a19a-fb70cdaba789 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3/os-volume_attachments/9dd936f8-4df3-450f-9561-f57526f100ee" status: 404 len: 154 microversion: 2.1 time: 0.098912 Aug 04 18:12:08.615591 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3705/7440] 10.222.0.93 () {58 vars in 1416 bytes} [Thu Aug 4 18:12:08 2022] DELETE /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3/os-volume_attachments/9dd936f8-4df3-450f-9561-f57526f100ee => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 18:12:11.869158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ecf8458f-5b6e-4d7b-ae45-71b7d93d140a tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:12:11.871051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ecf8458f-5b6e-4d7b-ae45-71b7d93d140a tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:12:11.876611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecf8458f-5b6e-4d7b-ae45-71b7d93d140a tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:11.877219 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecf8458f-5b6e-4d7b-ae45-71b7d93d140a tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:11.877987 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecf8458f-5b6e-4d7b-ae45-71b7d93d140a tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:11.878781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecf8458f-5b6e-4d7b-ae45-71b7d93d140a tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:11.879243 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecf8458f-5b6e-4d7b-ae45-71b7d93d140a tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:11.879673 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecf8458f-5b6e-4d7b-ae45-71b7d93d140a tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:11.906296 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ecf8458f-5b6e-4d7b-ae45-71b7d93d140a tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 18:12:11.990218 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ecf8458f-5b6e-4d7b-ae45-71b7d93d140a tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 204 len: 0 microversion: 2.1 time: 0.125515 Aug 04 18:12:11.990872 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3736/7441] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 18:12:11 2022] DELETE /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 18:12:12.000527 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b13e796a-e108-4b29-b847-96691548fd9d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:12:12.002309 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b13e796a-e108-4b29-b847-96691548fd9d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:12:12.011280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b13e796a-e108-4b29-b847-96691548fd9d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:12.012040 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b13e796a-e108-4b29-b847-96691548fd9d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:12.012577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b13e796a-e108-4b29-b847-96691548fd9d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:12.013408 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b13e796a-e108-4b29-b847-96691548fd9d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:12.013891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b13e796a-e108-4b29-b847-96691548fd9d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:12.014386 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b13e796a-e108-4b29-b847-96691548fd9d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:12.172199 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b13e796a-e108-4b29-b847-96691548fd9d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:12:12.182337 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b13e796a-e108-4b29-b847-96691548fd9d tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 200 len: 1553 microversion: 2.1 time: 0.186452 Aug 04 18:12:12.183598 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3706/7442] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:12:11 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 1553 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:12:13.203866 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dc692c82-c1d3-41e7-8d8e-06a6f1568e79 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:12:13.204574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dc692c82-c1d3-41e7-8d8e-06a6f1568e79 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:12:13.211474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc692c82-c1d3-41e7-8d8e-06a6f1568e79 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:13.211966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc692c82-c1d3-41e7-8d8e-06a6f1568e79 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:13.212444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc692c82-c1d3-41e7-8d8e-06a6f1568e79 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:13.213158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc692c82-c1d3-41e7-8d8e-06a6f1568e79 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:13.213658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc692c82-c1d3-41e7-8d8e-06a6f1568e79 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:13.214135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dc692c82-c1d3-41e7-8d8e-06a6f1568e79 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:13.364971 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dc692c82-c1d3-41e7-8d8e-06a6f1568e79 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:12:13.372718 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dc692c82-c1d3-41e7-8d8e-06a6f1568e79 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 200 len: 1553 microversion: 2.1 time: 0.173195 Aug 04 18:12:13.373302 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3737/7443] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:12:13 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:12:14.393800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7bdc325f-cf82-4be7-a224-ab158fc66270 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:12:14.394556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7bdc325f-cf82-4be7-a224-ab158fc66270 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:12:14.403331 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7bdc325f-cf82-4be7-a224-ab158fc66270 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:14.403927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7bdc325f-cf82-4be7-a224-ab158fc66270 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:14.404621 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7bdc325f-cf82-4be7-a224-ab158fc66270 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:14.405657 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7bdc325f-cf82-4be7-a224-ab158fc66270 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:14.406437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7bdc325f-cf82-4be7-a224-ab158fc66270 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:14.407432 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7bdc325f-cf82-4be7-a224-ab158fc66270 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:14.456450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-a3c35415-7849-4fa5-836b-d2f9f0dae639 req-3409f483-bd33-44e6-a7f2-08a1bd9f50a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e2f005f-6821-474f-832d-82323f05caa3", "name": "network-vif-deleted", "tag": "945cf837-ea2f-44aa-a07d-91a039a14f27"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:12:14.469634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a3c35415-7849-4fa5-836b-d2f9f0dae639 req-3409f483-bd33-44e6-a7f2-08a1bd9f50a3 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:14.470450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a3c35415-7849-4fa5-836b-d2f9f0dae639 req-3409f483-bd33-44e6-a7f2-08a1bd9f50a3 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:14.471083 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a3c35415-7849-4fa5-836b-d2f9f0dae639 req-3409f483-bd33-44e6-a7f2-08a1bd9f50a3 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:14.475203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7bdc325f-cf82-4be7-a224-ab158fc66270 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6d59ce5a324ce2800ead7fe0d36697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56d86aa3c54de78d63221df7c9bb1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:12:14.485946 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7bdc325f-cf82-4be7-a224-ab158fc66270 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 200 len: 1511 microversion: 2.1 time: 0.096607 Aug 04 18:12:14.486266 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-a3c35415-7849-4fa5-836b-d2f9f0dae639 req-3409f483-bd33-44e6-a7f2-08a1bd9f50a3 service nova] Creating event network-vif-deleted:945cf837-ea2f-44aa-a07d-91a039a14f27 for instance 8e2f005f-6821-474f-832d-82323f05caa3 on n-h1-851359-3 Aug 04 18:12:14.486912 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3707/7444] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:12:14 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 1511 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:12:14.503431 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-a3c35415-7849-4fa5-836b-d2f9f0dae639 req-3409f483-bd33-44e6-a7f2-08a1bd9f50a3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108793 Aug 04 18:12:14.504609 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3738/7445] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:12:15.509649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-05d13ee1-5241-4fa2-b943-f83ce25d8e71 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:12:15.510432 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-05d13ee1-5241-4fa2-b943-f83ce25d8e71 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] [instance: 8e2f005f-6821-474f-832d-82323f05caa3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:12:15.517454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05d13ee1-5241-4fa2-b943-f83ce25d8e71 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:15.517961 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05d13ee1-5241-4fa2-b943-f83ce25d8e71 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:15.518438 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05d13ee1-5241-4fa2-b943-f83ce25d8e71 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:15.519158 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05d13ee1-5241-4fa2-b943-f83ce25d8e71 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:15.519632 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05d13ee1-5241-4fa2-b943-f83ce25d8e71 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:15.520080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05d13ee1-5241-4fa2-b943-f83ce25d8e71 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:15.534063 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-05d13ee1-5241-4fa2-b943-f83ce25d8e71 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] HTTP exception thrown: Instance 8e2f005f-6821-474f-832d-82323f05caa3 could not be found. Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-05d13ee1-5241-4fa2-b943-f83ce25d8e71 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Request method failure captured: Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 HTTP/1.1 Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AqTp6C4ysKBWsP7Ihj62yRoY_JChCeplpEMF2zkDMd34kakT4claYSaeW9T4G72L8Loj_5Gk4_RWjdXhCYvYrMdJL50m7kkzzsFsvnMYEdZYWrNal6gEc5moP-CO-5IVQEC7idp7C1ia7lr_0GKeG1ZEYcOpxMS5dX8-ZHDHBOqXCQ Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 5f56d86aa3c54de78d63221df7c9bb1f Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TestMinimumBasicScenario-1511987094 Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f56d86aa3c54de78d63221df7c9bb1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5f56d86aa3c54de78d63221df7c9bb1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5f56d86aa3c54de78d63221df7c9bb1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5f56d86aa3c54de78d63221df7c9bb1f"}]}] Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TestMinimumBasicScenario-1511987094 Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 5f56d86aa3c54de78d63221df7c9bb1f Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1511987094 Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TestMinimumBasicScenario-1511987094-project Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: fc6d59ce5a324ce2800ead7fe0d36697 Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TestMinimumBasicScenario-1511987094-project Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 8e2f005f-6821-474f-832d-82323f05caa3 could not be found. Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '8e2f005f-6821-474f-832d-82323f05caa3'} Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e2f005f-6821-474f-832d-82323f05caa3 could not be found. Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e2f005f-6821-474f-832d-82323f05caa3 could not be found. Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:12:15.535693 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:12:15.540389 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:12:15.540389 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:12:15.540389 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:12:15.540389 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:12:15.540389 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:12:15.540389 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e2f005f-6821-474f-832d-82323f05caa3 could not be found. Aug 04 18:12:15.540389 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:12:15.540389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-05d13ee1-5241-4fa2-b943-f83ce25d8e71 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Returning 404 to user: Instance 8e2f005f-6821-474f-832d-82323f05caa3 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:12:15.540389 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-05d13ee1-5241-4fa2-b943-f83ce25d8e71 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3" status: 404 len: 111 microversion: 2.1 time: 0.031402 Aug 04 18:12:15.540389 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3708/7446] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:12:15 2022] GET /compute/v2.1/servers/8e2f005f-6821-474f-832d-82323f05caa3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 18:12:15.548053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4439807f-cb8b-4ef3-8c8e-0ed9ceee6d52 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] Calling method '.version_select at 0x7f1e6ca30430>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:12:15.569204 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4439807f-cb8b-4ef3-8c8e-0ed9ceee6d52 tempest-TestMinimumBasicScenario-1511987094 tempest-TestMinimumBasicScenario-1511987094-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-438268119" status: 202 len: 0 microversion: 2.1 time: 0.026149 Aug 04 18:12:15.569858 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3739/7447] 10.222.0.93 () {58 vars in 1269 bytes} [Thu Aug 4 18:12:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-438268119 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 18:12:25.128741 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-66058fc9-061a-45ce-a161-326222c99f32 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Action: 'create', calling method: .version_select at 0x7f1e5a369ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1116188971", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/NVSqerCuDEf1PxPzArOgI15fvVYMung9Ud7TgVZuCUZe/5CSEqLuvU8NvoOnQtukP3YrwZpAMNQHPVvGWu4NtB7Cng/2klFzGaQZqBGue8ycvccgdM1XcBcsmQoyStA=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:12:25.145010 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-66058fc9-061a-45ce-a161-326222c99f32 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Getting quotas for project ca6f9f1c52b34546af469a9d43d466db. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 18:12:25.154526 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-66058fc9-061a-45ce-a161-326222c99f32 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Getting quotas for user 35ad5b583f7f49e0b36ea7d3d75c9a20 and project ca6f9f1c52b34546af469a9d43d466db. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 18:12:25.179049 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-66058fc9-061a-45ce-a161-326222c99f32 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.220762 Aug 04 18:12:25.179660 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3709/7448] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 18:12:24 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:12:31.459088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:12:31.460153 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:12:31.465155 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-690c3f2c-4eb0-47da-ae5e-1b7cf27595b9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-759118176", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "f7a5ff3c-65ba-4e8b-895c-26983b5e49b0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1116188971", "security_groups": [{"name": "tempest-secgroup-smoke-2111613181"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:12:31.606718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-690c3f2c-4eb0-47da-ae5e-1b7cf27595b9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] validate_networks() for [('f7a5ff3c-65ba-4e8b-895c-26983b5e49b0', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 18:12:32.108397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-690c3f2c-4eb0-47da-ae5e-1b7cf27595b9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 18:12:32.108830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-690c3f2c-4eb0-47da-ae5e-1b7cf27595b9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 18:12:32.109424 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-690c3f2c-4eb0-47da-ae5e-1b7cf27595b9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 18:12:32.110048 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-690c3f2c-4eb0-47da-ae5e-1b7cf27595b9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 18:12:32.110621 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-690c3f2c-4eb0-47da-ae5e-1b7cf27595b9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 18:12:32.121471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-690c3f2c-4eb0-47da-ae5e-1b7cf27595b9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:32.122002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-690c3f2c-4eb0-47da-ae5e-1b7cf27595b9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:32.122441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-690c3f2c-4eb0-47da-ae5e-1b7cf27595b9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:32.123137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-690c3f2c-4eb0-47da-ae5e-1b7cf27595b9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:32.124231 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-690c3f2c-4eb0-47da-ae5e-1b7cf27595b9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:32.124561 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-690c3f2c-4eb0-47da-ae5e-1b7cf27595b9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:32.143078 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-690c3f2c-4eb0-47da-ae5e-1b7cf27595b9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Getting quotas for project ca6f9f1c52b34546af469a9d43d466db. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 18:12:32.148512 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-690c3f2c-4eb0-47da-ae5e-1b7cf27595b9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Getting quotas for user 35ad5b583f7f49e0b36ea7d3d75c9a20 and project ca6f9f1c52b34546af469a9d43d466db. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 18:12:32.161910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-690c3f2c-4eb0-47da-ae5e-1b7cf27595b9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 18:12:32.164418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-690c3f2c-4eb0-47da-ae5e-1b7cf27595b9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 44998d20-cbb6-4af4-8126-557831dc6b0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 18:12:32.222543 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-690c3f2c-4eb0-47da-ae5e-1b7cf27595b9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.765418 Aug 04 18:12:32.223834 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3740/7449] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 18:12:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 18:12:32.238348 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7eb7f548-6432-4914-bd72-2edccae37127 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:12:32.242040 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7eb7f548-6432-4914-bd72-2edccae37127 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 44998d20-cbb6-4af4-8126-557831dc6b0e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:12:32.242040 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:12:32.242820 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:12:32.332534 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7eb7f548-6432-4914-bd72-2edccae37127 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:12:32.343348 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7eb7f548-6432-4914-bd72-2edccae37127 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e" status: 200 len: 1266 microversion: 2.1 time: 0.110862 Aug 04 18:12:32.344134 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3710/7450] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:12:32 2022] GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e => generated 1266 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:12:33.365271 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cc4a23ce-28ea-4141-85cc-60e9765f97fe tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:12:33.365895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cc4a23ce-28ea-4141-85cc-60e9765f97fe tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 44998d20-cbb6-4af4-8126-557831dc6b0e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:12:33.374526 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc4a23ce-28ea-4141-85cc-60e9765f97fe tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:33.375039 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc4a23ce-28ea-4141-85cc-60e9765f97fe tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:33.375492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc4a23ce-28ea-4141-85cc-60e9765f97fe tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:33.376216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc4a23ce-28ea-4141-85cc-60e9765f97fe tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:33.376688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc4a23ce-28ea-4141-85cc-60e9765f97fe tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:33.377134 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cc4a23ce-28ea-4141-85cc-60e9765f97fe tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:33.446086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cc4a23ce-28ea-4141-85cc-60e9765f97fe tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:12:33.455689 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cc4a23ce-28ea-4141-85cc-60e9765f97fe tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e" status: 200 len: 1318 microversion: 2.1 time: 0.095053 Aug 04 18:12:33.456292 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3741/7451] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:12:33 2022] GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e => generated 1318 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:12:34.477130 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d9f697d7-c48c-4e53-8a79-96ae087ff9ae tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:12:34.486867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d9f697d7-c48c-4e53-8a79-96ae087ff9ae tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 44998d20-cbb6-4af4-8126-557831dc6b0e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:12:34.497742 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9f697d7-c48c-4e53-8a79-96ae087ff9ae tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:34.498730 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9f697d7-c48c-4e53-8a79-96ae087ff9ae tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:34.499461 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9f697d7-c48c-4e53-8a79-96ae087ff9ae tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:34.500287 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9f697d7-c48c-4e53-8a79-96ae087ff9ae tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:34.500973 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9f697d7-c48c-4e53-8a79-96ae087ff9ae tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:34.501624 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9f697d7-c48c-4e53-8a79-96ae087ff9ae tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:34.693221 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d9f697d7-c48c-4e53-8a79-96ae087ff9ae tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:12:34.702295 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d9f697d7-c48c-4e53-8a79-96ae087ff9ae tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e" status: 200 len: 1392 microversion: 2.1 time: 0.229241 Aug 04 18:12:34.703519 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3711/7452] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:12:34 2022] GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e => generated 1392 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:12:35.156422 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-bd55a4da-8ce4-473c-84ee-4b7bd314686c req-309c5905-4014-4dcf-9fc0-d517826ebe61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44998d20-cbb6-4af4-8126-557831dc6b0e", "tag": "f1c75790-5c26-4e4b-be18-ec3610f5a914"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:12:35.168619 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-bd55a4da-8ce4-473c-84ee-4b7bd314686c req-309c5905-4014-4dcf-9fc0-d517826ebe61 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:35.169103 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-bd55a4da-8ce4-473c-84ee-4b7bd314686c req-309c5905-4014-4dcf-9fc0-d517826ebe61 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:35.169537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-bd55a4da-8ce4-473c-84ee-4b7bd314686c req-309c5905-4014-4dcf-9fc0-d517826ebe61 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:35.181015 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-bd55a4da-8ce4-473c-84ee-4b7bd314686c req-309c5905-4014-4dcf-9fc0-d517826ebe61 service nova] Creating event network-changed:f1c75790-5c26-4e4b-be18-ec3610f5a914 for instance 44998d20-cbb6-4af4-8126-557831dc6b0e on n-h1-851359-3 Aug 04 18:12:35.187778 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-bd55a4da-8ce4-473c-84ee-4b7bd314686c req-309c5905-4014-4dcf-9fc0-d517826ebe61 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036995 Aug 04 18:12:35.188677 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3742/7453] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:12:35.724879 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-00798d95-e567-4fb2-b5e7-31d0c47f23b1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:12:35.725406 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-00798d95-e567-4fb2-b5e7-31d0c47f23b1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 44998d20-cbb6-4af4-8126-557831dc6b0e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:12:35.732680 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00798d95-e567-4fb2-b5e7-31d0c47f23b1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:35.733179 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00798d95-e567-4fb2-b5e7-31d0c47f23b1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:35.733625 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00798d95-e567-4fb2-b5e7-31d0c47f23b1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:35.734364 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00798d95-e567-4fb2-b5e7-31d0c47f23b1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:35.734836 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00798d95-e567-4fb2-b5e7-31d0c47f23b1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:35.735274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00798d95-e567-4fb2-b5e7-31d0c47f23b1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:35.868679 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-00798d95-e567-4fb2-b5e7-31d0c47f23b1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:12:35.876670 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-00798d95-e567-4fb2-b5e7-31d0c47f23b1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e" status: 200 len: 1392 microversion: 2.1 time: 0.155781 Aug 04 18:12:35.877246 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3712/7454] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:12:35 2022] GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:12:36.898769 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b0d6961d-1515-4b7d-b665-73fc4941f252 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:12:36.899484 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b0d6961d-1515-4b7d-b665-73fc4941f252 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 44998d20-cbb6-4af4-8126-557831dc6b0e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:12:36.909075 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0d6961d-1515-4b7d-b665-73fc4941f252 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:36.909588 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0d6961d-1515-4b7d-b665-73fc4941f252 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:36.910083 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0d6961d-1515-4b7d-b665-73fc4941f252 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:36.910801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0d6961d-1515-4b7d-b665-73fc4941f252 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:36.911271 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0d6961d-1515-4b7d-b665-73fc4941f252 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:36.911718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0d6961d-1515-4b7d-b665-73fc4941f252 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:37.060736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b0d6961d-1515-4b7d-b665-73fc4941f252 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:12:37.070491 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b0d6961d-1515-4b7d-b665-73fc4941f252 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e" status: 200 len: 1392 microversion: 2.1 time: 0.175987 Aug 04 18:12:37.071090 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3743/7455] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:12:36 2022] GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:12:38.093760 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5107ebc1-c64f-41ef-bd33-d0bf45bcd7e9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:12:38.094518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5107ebc1-c64f-41ef-bd33-d0bf45bcd7e9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 44998d20-cbb6-4af4-8126-557831dc6b0e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:12:38.102677 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5107ebc1-c64f-41ef-bd33-d0bf45bcd7e9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:38.103181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5107ebc1-c64f-41ef-bd33-d0bf45bcd7e9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:38.103641 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5107ebc1-c64f-41ef-bd33-d0bf45bcd7e9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:38.104978 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5107ebc1-c64f-41ef-bd33-d0bf45bcd7e9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:38.105453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5107ebc1-c64f-41ef-bd33-d0bf45bcd7e9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:38.105900 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5107ebc1-c64f-41ef-bd33-d0bf45bcd7e9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:38.247258 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5107ebc1-c64f-41ef-bd33-d0bf45bcd7e9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:12:38.255035 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5107ebc1-c64f-41ef-bd33-d0bf45bcd7e9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e" status: 200 len: 1392 microversion: 2.1 time: 0.165490 Aug 04 18:12:38.255606 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3713/7456] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:12:38 2022] GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:12:38.695182 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-565039c1-ea7e-4308-a3d5-6e2a0ec104ab req-dc5bd71a-3f75-4a07-99af-66e12cc873a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44998d20-cbb6-4af4-8126-557831dc6b0e", "name": "network-vif-plugged", "status": "completed", "tag": "f1c75790-5c26-4e4b-be18-ec3610f5a914"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:12:38.706755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-565039c1-ea7e-4308-a3d5-6e2a0ec104ab req-dc5bd71a-3f75-4a07-99af-66e12cc873a5 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:38.707274 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-565039c1-ea7e-4308-a3d5-6e2a0ec104ab req-dc5bd71a-3f75-4a07-99af-66e12cc873a5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:38.707719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-565039c1-ea7e-4308-a3d5-6e2a0ec104ab req-dc5bd71a-3f75-4a07-99af-66e12cc873a5 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:38.720163 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-565039c1-ea7e-4308-a3d5-6e2a0ec104ab req-dc5bd71a-3f75-4a07-99af-66e12cc873a5 service nova] Creating event network-vif-plugged:f1c75790-5c26-4e4b-be18-ec3610f5a914 for instance 44998d20-cbb6-4af4-8126-557831dc6b0e on n-h1-851359-3 Aug 04 18:12:38.725142 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-565039c1-ea7e-4308-a3d5-6e2a0ec104ab req-dc5bd71a-3f75-4a07-99af-66e12cc873a5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033736 Aug 04 18:12:38.725959 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3744/7457] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:12:39.275341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f38eb00d-9da8-4eab-9284-cc658a8dd697 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:12:39.275883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f38eb00d-9da8-4eab-9284-cc658a8dd697 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 44998d20-cbb6-4af4-8126-557831dc6b0e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:12:39.282756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f38eb00d-9da8-4eab-9284-cc658a8dd697 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:39.283264 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f38eb00d-9da8-4eab-9284-cc658a8dd697 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:39.283720 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f38eb00d-9da8-4eab-9284-cc658a8dd697 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:39.284439 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f38eb00d-9da8-4eab-9284-cc658a8dd697 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:39.284914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f38eb00d-9da8-4eab-9284-cc658a8dd697 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:39.285362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f38eb00d-9da8-4eab-9284-cc658a8dd697 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:39.422085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f38eb00d-9da8-4eab-9284-cc658a8dd697 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:12:39.429556 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f38eb00d-9da8-4eab-9284-cc658a8dd697 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e" status: 200 len: 1392 microversion: 2.1 time: 0.158233 Aug 04 18:12:39.430160 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3714/7458] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:12:39 2022] GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:12:40.452997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-84ae8eca-ea30-47c1-9b4f-d1f578a69ef9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:12:40.453706 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-84ae8eca-ea30-47c1-9b4f-d1f578a69ef9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 44998d20-cbb6-4af4-8126-557831dc6b0e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:12:40.462474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84ae8eca-ea30-47c1-9b4f-d1f578a69ef9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:40.462984 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84ae8eca-ea30-47c1-9b4f-d1f578a69ef9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:40.463442 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84ae8eca-ea30-47c1-9b4f-d1f578a69ef9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:40.464176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84ae8eca-ea30-47c1-9b4f-d1f578a69ef9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:40.464649 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84ae8eca-ea30-47c1-9b4f-d1f578a69ef9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:40.465092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84ae8eca-ea30-47c1-9b4f-d1f578a69ef9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:40.622005 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-84ae8eca-ea30-47c1-9b4f-d1f578a69ef9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:12:40.630102 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-84ae8eca-ea30-47c1-9b4f-d1f578a69ef9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e" status: 200 len: 1563 microversion: 2.1 time: 0.182934 Aug 04 18:12:40.630790 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3745/7459] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:12:40 2022] GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e => generated 1563 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:12:40.651529 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-238e15ad-e17a-4b1a-8ce6-79fe0b8b0b82 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:12:40.652160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-238e15ad-e17a-4b1a-8ce6-79fe0b8b0b82 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 44998d20-cbb6-4af4-8126-557831dc6b0e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:12:40.659481 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-238e15ad-e17a-4b1a-8ce6-79fe0b8b0b82 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:40.660059 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-238e15ad-e17a-4b1a-8ce6-79fe0b8b0b82 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:40.660583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-238e15ad-e17a-4b1a-8ce6-79fe0b8b0b82 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:40.661372 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-238e15ad-e17a-4b1a-8ce6-79fe0b8b0b82 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:40.661945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-238e15ad-e17a-4b1a-8ce6-79fe0b8b0b82 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:40.662476 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-238e15ad-e17a-4b1a-8ce6-79fe0b8b0b82 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:40.803050 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-238e15ad-e17a-4b1a-8ce6-79fe0b8b0b82 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:12:40.811531 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-238e15ad-e17a-4b1a-8ce6-79fe0b8b0b82 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e" status: 200 len: 1563 microversion: 2.1 time: 0.163952 Aug 04 18:12:40.812301 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3715/7460] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:12:40 2022] GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e => generated 1563 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:12:42.509147 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5cc2d241-7ecb-4812-a4d5-6f2560b993c6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:12:42.509688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5cc2d241-7ecb-4812-a4d5-6f2560b993c6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 44998d20-cbb6-4af4-8126-557831dc6b0e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:12:42.513079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:12:42.513771 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:12:42.515577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:12:42.523720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5cc2d241-7ecb-4812-a4d5-6f2560b993c6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:42.524227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5cc2d241-7ecb-4812-a4d5-6f2560b993c6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:42.524678 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5cc2d241-7ecb-4812-a4d5-6f2560b993c6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:42.525408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5cc2d241-7ecb-4812-a4d5-6f2560b993c6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:42.526488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5cc2d241-7ecb-4812-a4d5-6f2560b993c6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:42.526926 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5cc2d241-7ecb-4812-a4d5-6f2560b993c6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:42.581171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-3711b388-7903-4f8d-a53a-a2dc7942b700 req-97be6270-2cb1-4ab1-b11a-c1106ede226b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44998d20-cbb6-4af4-8126-557831dc6b0e", "tag": "f1c75790-5c26-4e4b-be18-ec3610f5a914"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:12:42.591909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-3711b388-7903-4f8d-a53a-a2dc7942b700 req-97be6270-2cb1-4ab1-b11a-c1106ede226b service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:12:42.597414 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-3711b388-7903-4f8d-a53a-a2dc7942b700 req-97be6270-2cb1-4ab1-b11a-c1106ede226b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:12:42.598130 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-3711b388-7903-4f8d-a53a-a2dc7942b700 req-97be6270-2cb1-4ab1-b11a-c1106ede226b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:12:42.611843 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-3711b388-7903-4f8d-a53a-a2dc7942b700 req-97be6270-2cb1-4ab1-b11a-c1106ede226b service nova] Creating event network-changed:f1c75790-5c26-4e4b-be18-ec3610f5a914 for instance 44998d20-cbb6-4af4-8126-557831dc6b0e on n-h1-851359-3 Aug 04 18:12:42.617136 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-3711b388-7903-4f8d-a53a-a2dc7942b700 req-97be6270-2cb1-4ab1-b11a-c1106ede226b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115274 Aug 04 18:12:42.618090 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3716/7461] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:12:42.676981 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5cc2d241-7ecb-4812-a4d5-6f2560b993c6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:12:42.684845 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5cc2d241-7ecb-4812-a4d5-6f2560b993c6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e" status: 200 len: 1563 microversion: 2.1 time: 0.185645 Aug 04 18:12:42.685712 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3746/7462] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:12:42 2022] GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e => generated 1563 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:13:05.939779 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=15 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:13:05.940467 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=32 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:13:05.944684 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c76c7ce1-3e3b-4aa8-b794-4394efea3719 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:13:05.947067 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c76c7ce1-3e3b-4aa8-b794-4394efea3719 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 44998d20-cbb6-4af4-8126-557831dc6b0e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:13:05.957649 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c76c7ce1-3e3b-4aa8-b794-4394efea3719 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:05.958181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c76c7ce1-3e3b-4aa8-b794-4394efea3719 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:05.958628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c76c7ce1-3e3b-4aa8-b794-4394efea3719 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:05.959342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c76c7ce1-3e3b-4aa8-b794-4394efea3719 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:05.959816 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c76c7ce1-3e3b-4aa8-b794-4394efea3719 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:05.960253 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c76c7ce1-3e3b-4aa8-b794-4394efea3719 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:06.034878 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c76c7ce1-3e3b-4aa8-b794-4394efea3719 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "POST /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e/action" status: 200 len: 24571 microversion: 2.1 time: 0.097636 Aug 04 18:13:06.035580 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3717/7463] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:13:05 2022] POST /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e/action => generated 24571 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 18:13:17.034305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:13:17.035116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=30 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:13:17.039277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-492b01ce-eb56-4921-a4a1-590021396de5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:13:17.039828 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-492b01ce-eb56-4921-a4a1-590021396de5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 44998d20-cbb6-4af4-8126-557831dc6b0e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:13:17.047137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-492b01ce-eb56-4921-a4a1-590021396de5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:17.047640 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-492b01ce-eb56-4921-a4a1-590021396de5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:17.048102 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-492b01ce-eb56-4921-a4a1-590021396de5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:17.048818 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-492b01ce-eb56-4921-a4a1-590021396de5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:17.049288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-492b01ce-eb56-4921-a4a1-590021396de5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:17.049729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-492b01ce-eb56-4921-a4a1-590021396de5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:17.120454 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-492b01ce-eb56-4921-a4a1-590021396de5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "POST /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e/action" status: 202 len: 0 microversion: 2.1 time: 0.086975 Aug 04 18:13:17.121135 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3747/7464] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:13:17 2022] POST /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 18:13:17.131140 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-25be9711-ddbb-4733-8c57-6ac27c9c153f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:13:17.131803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-25be9711-ddbb-4733-8c57-6ac27c9c153f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 44998d20-cbb6-4af4-8126-557831dc6b0e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:13:17.139347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:13:17.140629 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:13:17.142395 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25be9711-ddbb-4733-8c57-6ac27c9c153f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:17.143189 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25be9711-ddbb-4733-8c57-6ac27c9c153f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:17.143690 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25be9711-ddbb-4733-8c57-6ac27c9c153f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:17.144635 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25be9711-ddbb-4733-8c57-6ac27c9c153f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:17.145132 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25be9711-ddbb-4733-8c57-6ac27c9c153f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:17.145608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25be9711-ddbb-4733-8c57-6ac27c9c153f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:17.289178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-25be9711-ddbb-4733-8c57-6ac27c9c153f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:13:17.297823 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-25be9711-ddbb-4733-8c57-6ac27c9c153f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e" status: 200 len: 1687 microversion: 2.1 time: 0.171567 Aug 04 18:13:17.298443 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3718/7465] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:13:17 2022] GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:13:18.322172 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3d7f4b7e-535a-427f-8f69-0c0c4d5d083a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:13:18.322878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3d7f4b7e-535a-427f-8f69-0c0c4d5d083a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 44998d20-cbb6-4af4-8126-557831dc6b0e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:13:18.329727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d7f4b7e-535a-427f-8f69-0c0c4d5d083a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:18.330259 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d7f4b7e-535a-427f-8f69-0c0c4d5d083a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:18.330698 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d7f4b7e-535a-427f-8f69-0c0c4d5d083a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:18.331397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d7f4b7e-535a-427f-8f69-0c0c4d5d083a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:18.331858 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d7f4b7e-535a-427f-8f69-0c0c4d5d083a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:18.332289 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d7f4b7e-535a-427f-8f69-0c0c4d5d083a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:18.488760 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3d7f4b7e-535a-427f-8f69-0c0c4d5d083a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:13:18.496685 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3d7f4b7e-535a-427f-8f69-0c0c4d5d083a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e" status: 200 len: 1667 microversion: 2.1 time: 0.179663 Aug 04 18:13:18.497385 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3748/7466] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:13:18 2022] GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e => generated 1667 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:13:19.600294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-67e5f12b-ad32-4eed-b4a9-5801c74bc950 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:13:19.604033 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-67e5f12b-ad32-4eed-b4a9-5801c74bc950 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 44998d20-cbb6-4af4-8126-557831dc6b0e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:13:19.617335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-67e5f12b-ad32-4eed-b4a9-5801c74bc950 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:19.617846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-67e5f12b-ad32-4eed-b4a9-5801c74bc950 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:19.618376 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-67e5f12b-ad32-4eed-b4a9-5801c74bc950 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:19.619158 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-67e5f12b-ad32-4eed-b4a9-5801c74bc950 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:19.619625 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-67e5f12b-ad32-4eed-b4a9-5801c74bc950 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:19.620060 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-67e5f12b-ad32-4eed-b4a9-5801c74bc950 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:19.687657 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-67e5f12b-ad32-4eed-b4a9-5801c74bc950 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "POST /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e/action" status: 200 len: 32644 microversion: 2.1 time: 0.091386 Aug 04 18:13:19.688321 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3719/7467] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:13:19 2022] POST /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e/action => generated 32644 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 18:13:19.700552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1e9e79b6-9c63-459c-97a3-0260253a9b50 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:13:19.701101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1e9e79b6-9c63-459c-97a3-0260253a9b50 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 44998d20-cbb6-4af4-8126-557831dc6b0e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:13:19.708616 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e9e79b6-9c63-459c-97a3-0260253a9b50 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:19.709107 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e9e79b6-9c63-459c-97a3-0260253a9b50 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:19.709548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e9e79b6-9c63-459c-97a3-0260253a9b50 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:19.710279 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e9e79b6-9c63-459c-97a3-0260253a9b50 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:19.710747 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e9e79b6-9c63-459c-97a3-0260253a9b50 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:19.711179 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1e9e79b6-9c63-459c-97a3-0260253a9b50 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:19.779862 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1e9e79b6-9c63-459c-97a3-0260253a9b50 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "POST /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e/action" status: 202 len: 0 microversion: 2.1 time: 0.083147 Aug 04 18:13:19.781324 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3749/7468] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:13:19 2022] POST /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 18:13:19.791964 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dd007be1-995e-48c1-a867-87811df60af4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:13:19.792913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dd007be1-995e-48c1-a867-87811df60af4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 44998d20-cbb6-4af4-8126-557831dc6b0e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:13:19.802277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd007be1-995e-48c1-a867-87811df60af4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:19.803132 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd007be1-995e-48c1-a867-87811df60af4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:19.803833 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd007be1-995e-48c1-a867-87811df60af4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:19.804723 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd007be1-995e-48c1-a867-87811df60af4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:19.805263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd007be1-995e-48c1-a867-87811df60af4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:19.805754 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd007be1-995e-48c1-a867-87811df60af4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:19.965508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dd007be1-995e-48c1-a867-87811df60af4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:13:19.973386 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dd007be1-995e-48c1-a867-87811df60af4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e" status: 200 len: 1674 microversion: 2.1 time: 0.186309 Aug 04 18:13:19.973966 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3720/7469] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:13:19 2022] GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e => generated 1674 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:13:20.998945 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-90da8566-8fdb-4633-9e69-8e47a31af011 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:13:20.999600 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-90da8566-8fdb-4633-9e69-8e47a31af011 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 44998d20-cbb6-4af4-8126-557831dc6b0e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:13:21.006550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90da8566-8fdb-4633-9e69-8e47a31af011 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:21.007077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90da8566-8fdb-4633-9e69-8e47a31af011 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:21.007553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90da8566-8fdb-4633-9e69-8e47a31af011 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:21.008397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90da8566-8fdb-4633-9e69-8e47a31af011 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:21.008800 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90da8566-8fdb-4633-9e69-8e47a31af011 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:21.009264 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90da8566-8fdb-4633-9e69-8e47a31af011 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:21.164266 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-90da8566-8fdb-4633-9e69-8e47a31af011 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:13:21.172072 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-90da8566-8fdb-4633-9e69-8e47a31af011 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e" status: 200 len: 1682 microversion: 2.1 time: 0.179841 Aug 04 18:13:21.172644 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3750/7470] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:13:20 2022] GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:13:21.275114 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-11d4d219-73fb-4786-a381-e3c2bc42805f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:13:21.277328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-11d4d219-73fb-4786-a381-e3c2bc42805f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 44998d20-cbb6-4af4-8126-557831dc6b0e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:13:21.285707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11d4d219-73fb-4786-a381-e3c2bc42805f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:21.286248 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11d4d219-73fb-4786-a381-e3c2bc42805f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:21.286710 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11d4d219-73fb-4786-a381-e3c2bc42805f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:21.287435 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11d4d219-73fb-4786-a381-e3c2bc42805f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:21.287909 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11d4d219-73fb-4786-a381-e3c2bc42805f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:21.288363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11d4d219-73fb-4786-a381-e3c2bc42805f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:21.354495 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-11d4d219-73fb-4786-a381-e3c2bc42805f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "POST /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e/action" status: 200 len: 38455 microversion: 2.1 time: 0.083020 Aug 04 18:13:21.355180 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3721/7471] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:13:21 2022] POST /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e/action => generated 38455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 18:13:22.399077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8eb00658-9bd9-414a-a086-62def5471498 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:13:22.399870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8eb00658-9bd9-414a-a086-62def5471498 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 44998d20-cbb6-4af4-8126-557831dc6b0e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:13:22.401944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-fabd0012-8052-4e32-843c-dc3c85b5191a req-3bda9d7c-9aa4-45e7-82d1-6beef7a9ad02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44998d20-cbb6-4af4-8126-557831dc6b0e", "tag": "f1c75790-5c26-4e4b-be18-ec3610f5a914"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:13:22.408419 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8eb00658-9bd9-414a-a086-62def5471498 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:22.409353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8eb00658-9bd9-414a-a086-62def5471498 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:22.410186 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8eb00658-9bd9-414a-a086-62def5471498 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:22.411348 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8eb00658-9bd9-414a-a086-62def5471498 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:22.411624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8eb00658-9bd9-414a-a086-62def5471498 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:22.412327 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8eb00658-9bd9-414a-a086-62def5471498 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:22.414238 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fabd0012-8052-4e32-843c-dc3c85b5191a req-3bda9d7c-9aa4-45e7-82d1-6beef7a9ad02 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:22.415051 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fabd0012-8052-4e32-843c-dc3c85b5191a req-3bda9d7c-9aa4-45e7-82d1-6beef7a9ad02 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:22.415576 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fabd0012-8052-4e32-843c-dc3c85b5191a req-3bda9d7c-9aa4-45e7-82d1-6beef7a9ad02 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:22.428718 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-fabd0012-8052-4e32-843c-dc3c85b5191a req-3bda9d7c-9aa4-45e7-82d1-6beef7a9ad02 service nova] Creating event network-changed:f1c75790-5c26-4e4b-be18-ec3610f5a914 for instance 44998d20-cbb6-4af4-8126-557831dc6b0e on n-h1-851359-3 Aug 04 18:13:22.435655 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-fabd0012-8052-4e32-843c-dc3c85b5191a req-3bda9d7c-9aa4-45e7-82d1-6beef7a9ad02 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037830 Aug 04 18:13:22.436502 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3722/7472] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:13:22.442084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8eb00658-9bd9-414a-a086-62def5471498 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 44998d20-cbb6-4af4-8126-557831dc6b0e] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 18:13:22.548216 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8eb00658-9bd9-414a-a086-62def5471498 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "DELETE /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e" status: 204 len: 0 microversion: 2.1 time: 0.152842 Aug 04 18:13:22.552232 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3751/7473] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 18:13:22 2022] DELETE /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 18:13:22.558022 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f3106734-53f6-4bf2-ba74-5c8bb05aa823 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:13:22.558753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f3106734-53f6-4bf2-ba74-5c8bb05aa823 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 44998d20-cbb6-4af4-8126-557831dc6b0e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:13:22.565683 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3106734-53f6-4bf2-ba74-5c8bb05aa823 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:22.566225 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3106734-53f6-4bf2-ba74-5c8bb05aa823 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:22.566691 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3106734-53f6-4bf2-ba74-5c8bb05aa823 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:22.567432 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3106734-53f6-4bf2-ba74-5c8bb05aa823 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:22.567935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3106734-53f6-4bf2-ba74-5c8bb05aa823 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:22.568355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3106734-53f6-4bf2-ba74-5c8bb05aa823 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:22.722707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f3106734-53f6-4bf2-ba74-5c8bb05aa823 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:13:22.731901 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f3106734-53f6-4bf2-ba74-5c8bb05aa823 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e" status: 200 len: 1688 microversion: 2.1 time: 0.178141 Aug 04 18:13:22.732488 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3723/7474] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:13:22 2022] GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:13:23.754208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-80a095ea-842b-4845-aa37-7775a2833c2d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:13:23.754853 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-80a095ea-842b-4845-aa37-7775a2833c2d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 44998d20-cbb6-4af4-8126-557831dc6b0e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:13:23.761610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80a095ea-842b-4845-aa37-7775a2833c2d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:23.762215 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80a095ea-842b-4845-aa37-7775a2833c2d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:23.762666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80a095ea-842b-4845-aa37-7775a2833c2d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:23.763376 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80a095ea-842b-4845-aa37-7775a2833c2d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:23.763846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80a095ea-842b-4845-aa37-7775a2833c2d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:23.764533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-80a095ea-842b-4845-aa37-7775a2833c2d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:23.900614 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-80a095ea-842b-4845-aa37-7775a2833c2d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:13:23.908741 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-80a095ea-842b-4845-aa37-7775a2833c2d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e" status: 200 len: 1688 microversion: 2.1 time: 0.158985 Aug 04 18:13:23.909315 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3752/7475] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:13:23 2022] GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:13:24.791146 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-18faab19-ffb8-4980-9512-9d6e7f807ff0 req-37684e7e-123f-4fa7-aa80-2b44e11126c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44998d20-cbb6-4af4-8126-557831dc6b0e", "name": "network-vif-deleted", "tag": "f1c75790-5c26-4e4b-be18-ec3610f5a914"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:13:24.803173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-18faab19-ffb8-4980-9512-9d6e7f807ff0 req-37684e7e-123f-4fa7-aa80-2b44e11126c9 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:24.803676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-18faab19-ffb8-4980-9512-9d6e7f807ff0 req-37684e7e-123f-4fa7-aa80-2b44e11126c9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:24.804163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-18faab19-ffb8-4980-9512-9d6e7f807ff0 req-37684e7e-123f-4fa7-aa80-2b44e11126c9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:24.816265 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-18faab19-ffb8-4980-9512-9d6e7f807ff0 req-37684e7e-123f-4fa7-aa80-2b44e11126c9 service nova] Creating event network-vif-deleted:f1c75790-5c26-4e4b-be18-ec3610f5a914 for instance 44998d20-cbb6-4af4-8126-557831dc6b0e on n-h1-851359-3 Aug 04 18:13:24.821403 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-18faab19-ffb8-4980-9512-9d6e7f807ff0 req-37684e7e-123f-4fa7-aa80-2b44e11126c9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033966 Aug 04 18:13:24.822023 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3724/7476] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:13:24.930073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-38a2a894-51d4-4dd8-bf45-c08dcc65babd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:13:24.931057 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-38a2a894-51d4-4dd8-bf45-c08dcc65babd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 44998d20-cbb6-4af4-8126-557831dc6b0e] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:13:24.938536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38a2a894-51d4-4dd8-bf45-c08dcc65babd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:24.938974 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38a2a894-51d4-4dd8-bf45-c08dcc65babd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:24.939426 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38a2a894-51d4-4dd8-bf45-c08dcc65babd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:24.940139 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38a2a894-51d4-4dd8-bf45-c08dcc65babd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:24.940614 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38a2a894-51d4-4dd8-bf45-c08dcc65babd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:24.941053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38a2a894-51d4-4dd8-bf45-c08dcc65babd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:24.972216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38a2a894-51d4-4dd8-bf45-c08dcc65babd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:24.972706 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38a2a894-51d4-4dd8-bf45-c08dcc65babd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:24.973153 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-38a2a894-51d4-4dd8-bf45-c08dcc65babd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:24.973606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-38a2a894-51d4-4dd8-bf45-c08dcc65babd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lazy-loading 'fault' on Instance uuid 44998d20-cbb6-4af4-8126-557831dc6b0e {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 18:13:25.016065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-38a2a894-51d4-4dd8-bf45-c08dcc65babd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:13:25.023848 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-38a2a894-51d4-4dd8-bf45-c08dcc65babd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e" status: 200 len: 1356 microversion: 2.1 time: 0.097726 Aug 04 18:13:25.024468 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3753/7477] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:13:24 2022] GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e => generated 1356 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:13:26.052368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bfadb755-13f0-47fd-9627-a20104feb1ec tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:13:26.052997 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bfadb755-13f0-47fd-9627-a20104feb1ec tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 44998d20-cbb6-4af4-8126-557831dc6b0e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:13:26.059290 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bfadb755-13f0-47fd-9627-a20104feb1ec tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:26.059792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bfadb755-13f0-47fd-9627-a20104feb1ec tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:26.060248 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bfadb755-13f0-47fd-9627-a20104feb1ec tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:26.061443 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bfadb755-13f0-47fd-9627-a20104feb1ec tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:26.061932 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bfadb755-13f0-47fd-9627-a20104feb1ec tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:26.062412 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bfadb755-13f0-47fd-9627-a20104feb1ec tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:26.080762 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-bfadb755-13f0-47fd-9627-a20104feb1ec tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] HTTP exception thrown: Instance 44998d20-cbb6-4af4-8126-557831dc6b0e could not be found. Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bfadb755-13f0-47fd-9627-a20104feb1ec tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Request method failure captured: Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e HTTP/1.1 Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AwIjCsovibYcH6ErWxGJedA-SXylLsKvn2zpdpI2y0HfanfgcItDr2cHF1i3ynCG5lmDiVO7c8mMcbqfLpue1bmLw9gTl9Y1GTYLYZrG8HdwuvNirSZtowkucGnoPRO0LnscJrHruNXZPpdU2GfZAeK3oRPo9VtZizbrtXsNeEIQOc Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: ca6f9f1c52b34546af469a9d43d466db Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-103139372 Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca6f9f1c52b34546af469a9d43d466db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca6f9f1c52b34546af469a9d43d466db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ca6f9f1c52b34546af469a9d43d466db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ca6f9f1c52b34546af469a9d43d466db"}]}] Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TestNetworkAdvancedServerOps-103139372 Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: ca6f9f1c52b34546af469a9d43d466db Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-103139372 Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TestNetworkAdvancedServerOps-103139372-project Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 35ad5b583f7f49e0b36ea7d3d75c9a20 Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TestNetworkAdvancedServerOps-103139372-project Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 44998d20-cbb6-4af4-8126-557831dc6b0e could not be found. Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '44998d20-cbb6-4af4-8126-557831dc6b0e'} Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44998d20-cbb6-4af4-8126-557831dc6b0e could not be found. Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44998d20-cbb6-4af4-8126-557831dc6b0e could not be found. Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:13:26.082627 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:13:26.087585 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:13:26.087585 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:13:26.087585 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:13:26.087585 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:13:26.087585 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:13:26.087585 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:13:26.087585 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44998d20-cbb6-4af4-8126-557831dc6b0e could not be found. Aug 04 18:13:26.087585 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:13:26.087585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bfadb755-13f0-47fd-9627-a20104feb1ec tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Returning 404 to user: Instance 44998d20-cbb6-4af4-8126-557831dc6b0e could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:13:26.087585 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bfadb755-13f0-47fd-9627-a20104feb1ec tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e" status: 404 len: 111 microversion: 2.1 time: 0.036841 Aug 04 18:13:26.087585 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3725/7478] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:13:26 2022] GET /compute/v2.1/servers/44998d20-cbb6-4af4-8126-557831dc6b0e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 18:13:29.438339 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-467d7da7-e024-4d09-a661-ea15276ac64e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '.version_select at 0x7f1e5a887dc0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:13:29.463360 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-467d7da7-e024-4d09-a661-ea15276ac64e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1116188971" status: 202 len: 0 microversion: 2.1 time: 0.028983 Aug 04 18:13:29.464138 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3754/7479] 10.222.0.93 () {58 vars in 1284 bytes} [Thu Aug 4 18:13:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1116188971 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 18:13:29.492488 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3e624ff2-e97a-4e04-994b-3e926f54fe8f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Action: 'create', calling method: .version_select at 0x7f1e5a3ac4c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-57266270", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJ+4YbTxTkcAFD49CjEYt+Mb/Axt/4QTI62owtbEj0yyFtpSsJ49PCvgBC3EVgJoAp8SipkpUHv75Sma5Hj5UQwlcjbeC1hMOGdf9EyYFHH4BzyYuWygw57W1dspcFAtQ=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:13:29.510367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-3e624ff2-e97a-4e04-994b-3e926f54fe8f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Getting quotas for project ca6f9f1c52b34546af469a9d43d466db. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 18:13:29.516795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-3e624ff2-e97a-4e04-994b-3e926f54fe8f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Getting quotas for user 35ad5b583f7f49e0b36ea7d3d75c9a20 and project ca6f9f1c52b34546af469a9d43d466db. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 18:13:29.543427 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3e624ff2-e97a-4e04-994b-3e926f54fe8f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.054889 Aug 04 18:13:29.544204 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3726/7480] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 18:13:29 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:13:35.474098 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:13:35.479719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ecb837d1-80eb-4cf9-bef7-0af7845b4cd4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-525415623", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "b3b42ccd-8c2d-47ad-b611-c2721dd4d8bd"}], "key_name": "tempest-TestNetworkAdvancedServerOps-57266270", "security_groups": [{"name": "tempest-secgroup-smoke-769486464"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:13:35.620878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-ecb837d1-80eb-4cf9-bef7-0af7845b4cd4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] validate_networks() for [('b3b42ccd-8c2d-47ad-b611-c2721dd4d8bd', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 18:13:36.061697 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-ecb837d1-80eb-4cf9-bef7-0af7845b4cd4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 18:13:36.062153 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-ecb837d1-80eb-4cf9-bef7-0af7845b4cd4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 18:13:36.062635 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-ecb837d1-80eb-4cf9-bef7-0af7845b4cd4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 18:13:36.063043 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-ecb837d1-80eb-4cf9-bef7-0af7845b4cd4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 18:13:36.063455 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-ecb837d1-80eb-4cf9-bef7-0af7845b4cd4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 18:13:36.072370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecb837d1-80eb-4cf9-bef7-0af7845b4cd4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:36.073050 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecb837d1-80eb-4cf9-bef7-0af7845b4cd4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:36.073493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecb837d1-80eb-4cf9-bef7-0af7845b4cd4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:36.074259 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecb837d1-80eb-4cf9-bef7-0af7845b4cd4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:36.074719 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecb837d1-80eb-4cf9-bef7-0af7845b4cd4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:36.075149 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ecb837d1-80eb-4cf9-bef7-0af7845b4cd4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:36.092161 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-ecb837d1-80eb-4cf9-bef7-0af7845b4cd4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Getting quotas for project ca6f9f1c52b34546af469a9d43d466db. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 18:13:36.097581 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-ecb837d1-80eb-4cf9-bef7-0af7845b4cd4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Getting quotas for user 35ad5b583f7f49e0b36ea7d3d75c9a20 and project ca6f9f1c52b34546af469a9d43d466db. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 18:13:36.112419 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ecb837d1-80eb-4cf9-bef7-0af7845b4cd4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 18:13:36.114666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ecb837d1-80eb-4cf9-bef7-0af7845b4cd4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 0b69368e-88fa-48da-9be3-8292d16cefa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 18:13:36.163598 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ecb837d1-80eb-4cf9-bef7-0af7845b4cd4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.691709 Aug 04 18:13:36.164270 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3755/7481] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 18:13:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 18:13:36.194891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e88aa711-a397-410b-8ebe-6a272cf458c1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:13:36.196497 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e88aa711-a397-410b-8ebe-6a272cf458c1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 0b69368e-88fa-48da-9be3-8292d16cefa9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:13:36.202491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=32 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:13:36.271279 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e88aa711-a397-410b-8ebe-6a272cf458c1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:13:36.278728 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e88aa711-a397-410b-8ebe-6a272cf458c1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9" status: 200 len: 1264 microversion: 2.1 time: 0.090468 Aug 04 18:13:36.279418 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3727/7482] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:13:36 2022] GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9 => generated 1264 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:13:37.300756 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0fcced1e-7c04-448b-b099-552c2ecb88c8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:13:37.302101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0fcced1e-7c04-448b-b099-552c2ecb88c8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 0b69368e-88fa-48da-9be3-8292d16cefa9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:13:37.310016 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0fcced1e-7c04-448b-b099-552c2ecb88c8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:37.311188 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0fcced1e-7c04-448b-b099-552c2ecb88c8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:37.311625 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0fcced1e-7c04-448b-b099-552c2ecb88c8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:37.312358 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0fcced1e-7c04-448b-b099-552c2ecb88c8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:37.312852 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0fcced1e-7c04-448b-b099-552c2ecb88c8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:37.313268 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0fcced1e-7c04-448b-b099-552c2ecb88c8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:37.403848 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0fcced1e-7c04-448b-b099-552c2ecb88c8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:13:37.418911 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0fcced1e-7c04-448b-b099-552c2ecb88c8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9" status: 200 len: 1316 microversion: 2.1 time: 0.123011 Aug 04 18:13:37.420762 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3756/7483] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:13:37 2022] GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9 => generated 1316 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:13:38.441771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5ec24733-758f-4809-8c82-aaefcf6abd0f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:13:38.443655 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5ec24733-758f-4809-8c82-aaefcf6abd0f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 0b69368e-88fa-48da-9be3-8292d16cefa9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:13:38.455166 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ec24733-758f-4809-8c82-aaefcf6abd0f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:38.456003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ec24733-758f-4809-8c82-aaefcf6abd0f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:38.456676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ec24733-758f-4809-8c82-aaefcf6abd0f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:38.458453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ec24733-758f-4809-8c82-aaefcf6abd0f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:38.460220 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ec24733-758f-4809-8c82-aaefcf6abd0f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:38.461368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ec24733-758f-4809-8c82-aaefcf6abd0f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:39.088050 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5ec24733-758f-4809-8c82-aaefcf6abd0f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:13:39.095848 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5ec24733-758f-4809-8c82-aaefcf6abd0f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9" status: 200 len: 1389 microversion: 2.1 time: 0.658788 Aug 04 18:13:39.096534 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3728/7484] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:13:38 2022] GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9 => generated 1389 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:13:39.407231 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-14362232-550d-47c4-a4b1-7637d8c0451f req-5f0bb647-c082-4714-aa01-4c36df79b72d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b69368e-88fa-48da-9be3-8292d16cefa9", "tag": "dd4468a2-0987-4e20-81d8-9687f49cc8c5"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:13:39.418602 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-14362232-550d-47c4-a4b1-7637d8c0451f req-5f0bb647-c082-4714-aa01-4c36df79b72d service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:39.419095 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-14362232-550d-47c4-a4b1-7637d8c0451f req-5f0bb647-c082-4714-aa01-4c36df79b72d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:39.419600 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-14362232-550d-47c4-a4b1-7637d8c0451f req-5f0bb647-c082-4714-aa01-4c36df79b72d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:39.431965 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-14362232-550d-47c4-a4b1-7637d8c0451f req-5f0bb647-c082-4714-aa01-4c36df79b72d service nova] Creating event network-changed:dd4468a2-0987-4e20-81d8-9687f49cc8c5 for instance 0b69368e-88fa-48da-9be3-8292d16cefa9 on n-h1-851359-3 Aug 04 18:13:39.437427 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-14362232-550d-47c4-a4b1-7637d8c0451f req-5f0bb647-c082-4714-aa01-4c36df79b72d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034152 Aug 04 18:13:39.438062 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3757/7485] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:13:40.117774 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b68740e5-6477-447f-8d85-bbc8d37aa2df tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:13:40.118362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b68740e5-6477-447f-8d85-bbc8d37aa2df tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 0b69368e-88fa-48da-9be3-8292d16cefa9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:13:40.125210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b68740e5-6477-447f-8d85-bbc8d37aa2df tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:40.125715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b68740e5-6477-447f-8d85-bbc8d37aa2df tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:40.126208 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b68740e5-6477-447f-8d85-bbc8d37aa2df tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:40.126936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b68740e5-6477-447f-8d85-bbc8d37aa2df tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:40.127408 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b68740e5-6477-447f-8d85-bbc8d37aa2df tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:40.127853 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b68740e5-6477-447f-8d85-bbc8d37aa2df tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:40.261351 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b68740e5-6477-447f-8d85-bbc8d37aa2df tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:13:40.269288 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b68740e5-6477-447f-8d85-bbc8d37aa2df tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9" status: 200 len: 1389 microversion: 2.1 time: 0.155526 Aug 04 18:13:40.269875 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3729/7486] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:13:40 2022] GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9 => generated 1389 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:13:41.291521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-082867ec-3c2c-4783-a7fd-b306237a0c1a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:13:41.292140 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-082867ec-3c2c-4783-a7fd-b306237a0c1a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 0b69368e-88fa-48da-9be3-8292d16cefa9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:13:41.298498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-082867ec-3c2c-4783-a7fd-b306237a0c1a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:41.298990 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-082867ec-3c2c-4783-a7fd-b306237a0c1a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:41.299449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-082867ec-3c2c-4783-a7fd-b306237a0c1a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:41.300138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-082867ec-3c2c-4783-a7fd-b306237a0c1a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:41.300590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-082867ec-3c2c-4783-a7fd-b306237a0c1a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:41.301019 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-082867ec-3c2c-4783-a7fd-b306237a0c1a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:41.436325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-082867ec-3c2c-4783-a7fd-b306237a0c1a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:13:41.443976 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-082867ec-3c2c-4783-a7fd-b306237a0c1a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9" status: 200 len: 1389 microversion: 2.1 time: 0.157679 Aug 04 18:13:41.444544 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3758/7487] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:13:41 2022] GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9 => generated 1389 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:13:42.464796 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8853000c-95f0-4ed6-81ea-00c783950d8b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:13:42.465426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8853000c-95f0-4ed6-81ea-00c783950d8b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 0b69368e-88fa-48da-9be3-8292d16cefa9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:13:42.472213 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8853000c-95f0-4ed6-81ea-00c783950d8b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:42.472707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8853000c-95f0-4ed6-81ea-00c783950d8b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:42.473160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8853000c-95f0-4ed6-81ea-00c783950d8b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:42.473866 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8853000c-95f0-4ed6-81ea-00c783950d8b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:42.474355 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8853000c-95f0-4ed6-81ea-00c783950d8b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:42.474793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8853000c-95f0-4ed6-81ea-00c783950d8b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:42.618076 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8853000c-95f0-4ed6-81ea-00c783950d8b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:13:42.626468 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8853000c-95f0-4ed6-81ea-00c783950d8b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9" status: 200 len: 1389 microversion: 2.1 time: 0.165481 Aug 04 18:13:42.627044 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3730/7488] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:13:42 2022] GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9 => generated 1389 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:13:43.646771 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fe286f9d-e3eb-441a-a968-96b52391f3cd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:13:43.647389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fe286f9d-e3eb-441a-a968-96b52391f3cd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 0b69368e-88fa-48da-9be3-8292d16cefa9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:13:43.655251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fe286f9d-e3eb-441a-a968-96b52391f3cd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:43.655740 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fe286f9d-e3eb-441a-a968-96b52391f3cd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:43.656178 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fe286f9d-e3eb-441a-a968-96b52391f3cd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:43.656883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fe286f9d-e3eb-441a-a968-96b52391f3cd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:43.657340 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fe286f9d-e3eb-441a-a968-96b52391f3cd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:43.657765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fe286f9d-e3eb-441a-a968-96b52391f3cd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:43.793015 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fe286f9d-e3eb-441a-a968-96b52391f3cd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:13:43.800604 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fe286f9d-e3eb-441a-a968-96b52391f3cd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9" status: 200 len: 1389 microversion: 2.1 time: 0.157749 Aug 04 18:13:43.801180 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3759/7489] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:13:43 2022] GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9 => generated 1389 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:13:44.820786 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-60ab92e9-c4e7-455d-9deb-9143dd0aeccc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:13:44.821549 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-60ab92e9-c4e7-455d-9deb-9143dd0aeccc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 0b69368e-88fa-48da-9be3-8292d16cefa9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:13:44.828806 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60ab92e9-c4e7-455d-9deb-9143dd0aeccc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:44.829249 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60ab92e9-c4e7-455d-9deb-9143dd0aeccc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:44.829713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60ab92e9-c4e7-455d-9deb-9143dd0aeccc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:44.830468 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60ab92e9-c4e7-455d-9deb-9143dd0aeccc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:44.830945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60ab92e9-c4e7-455d-9deb-9143dd0aeccc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:44.831392 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60ab92e9-c4e7-455d-9deb-9143dd0aeccc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:44.976992 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-60ab92e9-c4e7-455d-9deb-9143dd0aeccc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:13:44.985395 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-60ab92e9-c4e7-455d-9deb-9143dd0aeccc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9" status: 200 len: 1389 microversion: 2.1 time: 0.168531 Aug 04 18:13:44.985969 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3731/7490] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:13:44 2022] GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9 => generated 1389 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:13:45.074821 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-c861c552-4a0a-4a5c-9c8e-50a14c427dda req-cc6c119a-4cd6-45dd-b61b-7448ae08d8a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b69368e-88fa-48da-9be3-8292d16cefa9", "name": "network-vif-plugged", "status": "completed", "tag": "dd4468a2-0987-4e20-81d8-9687f49cc8c5"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:13:45.085443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c861c552-4a0a-4a5c-9c8e-50a14c427dda req-cc6c119a-4cd6-45dd-b61b-7448ae08d8a7 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:45.085863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c861c552-4a0a-4a5c-9c8e-50a14c427dda req-cc6c119a-4cd6-45dd-b61b-7448ae08d8a7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:45.086521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-c861c552-4a0a-4a5c-9c8e-50a14c427dda req-cc6c119a-4cd6-45dd-b61b-7448ae08d8a7 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:45.099541 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-c861c552-4a0a-4a5c-9c8e-50a14c427dda req-cc6c119a-4cd6-45dd-b61b-7448ae08d8a7 service nova] Creating event network-vif-plugged:dd4468a2-0987-4e20-81d8-9687f49cc8c5 for instance 0b69368e-88fa-48da-9be3-8292d16cefa9 on n-h1-851359-3 Aug 04 18:13:45.105607 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-c861c552-4a0a-4a5c-9c8e-50a14c427dda req-cc6c119a-4cd6-45dd-b61b-7448ae08d8a7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034619 Aug 04 18:13:45.106246 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3760/7491] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:13:46.005825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-01bb7799-6af6-4896-b52a-c4c58e89d918 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:13:46.006590 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-01bb7799-6af6-4896-b52a-c4c58e89d918 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 0b69368e-88fa-48da-9be3-8292d16cefa9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:13:46.013237 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01bb7799-6af6-4896-b52a-c4c58e89d918 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:46.014256 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01bb7799-6af6-4896-b52a-c4c58e89d918 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:46.014715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01bb7799-6af6-4896-b52a-c4c58e89d918 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:46.015448 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01bb7799-6af6-4896-b52a-c4c58e89d918 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:46.015920 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01bb7799-6af6-4896-b52a-c4c58e89d918 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:46.016360 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01bb7799-6af6-4896-b52a-c4c58e89d918 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:46.213225 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-01bb7799-6af6-4896-b52a-c4c58e89d918 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:13:46.221581 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-01bb7799-6af6-4896-b52a-c4c58e89d918 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9" status: 200 len: 1389 microversion: 2.1 time: 0.219791 Aug 04 18:13:46.222297 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3732/7492] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:13:46 2022] GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9 => generated 1389 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:13:47.316999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:13:47.317883 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:13:47.322332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2ac15810-103f-4482-b17e-0a9581bf45b4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:13:47.323134 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2ac15810-103f-4482-b17e-0a9581bf45b4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 0b69368e-88fa-48da-9be3-8292d16cefa9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:13:47.325013 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:13:47.332857 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ac15810-103f-4482-b17e-0a9581bf45b4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:47.333424 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ac15810-103f-4482-b17e-0a9581bf45b4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:47.333903 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ac15810-103f-4482-b17e-0a9581bf45b4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:47.334658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ac15810-103f-4482-b17e-0a9581bf45b4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:47.335159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ac15810-103f-4482-b17e-0a9581bf45b4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:47.335600 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2ac15810-103f-4482-b17e-0a9581bf45b4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:47.532830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2ac15810-103f-4482-b17e-0a9581bf45b4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:13:47.540772 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2ac15810-103f-4482-b17e-0a9581bf45b4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9" status: 200 len: 1561 microversion: 2.1 time: 0.225640 Aug 04 18:13:47.541323 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3761/7493] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:13:47 2022] GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9 => generated 1561 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:13:47.560826 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f7c4e084-8e32-4a85-bbe5-b19e5c81e67c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:13:47.561586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f7c4e084-8e32-4a85-bbe5-b19e5c81e67c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 0b69368e-88fa-48da-9be3-8292d16cefa9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:13:47.563479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:13:47.564933 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:13:47.570516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7c4e084-8e32-4a85-bbe5-b19e5c81e67c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:47.571047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7c4e084-8e32-4a85-bbe5-b19e5c81e67c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:47.571483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7c4e084-8e32-4a85-bbe5-b19e5c81e67c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:47.572212 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7c4e084-8e32-4a85-bbe5-b19e5c81e67c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:47.572682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7c4e084-8e32-4a85-bbe5-b19e5c81e67c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:47.573127 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7c4e084-8e32-4a85-bbe5-b19e5c81e67c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:47.711398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f7c4e084-8e32-4a85-bbe5-b19e5c81e67c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:13:47.719506 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f7c4e084-8e32-4a85-bbe5-b19e5c81e67c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9" status: 200 len: 1561 microversion: 2.1 time: 0.162719 Aug 04 18:13:47.720079 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3733/7494] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:13:47 2022] GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:13:49.364364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8a155a31-c710-4502-9fbd-db68534b87ea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:13:49.365002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8a155a31-c710-4502-9fbd-db68534b87ea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 0b69368e-88fa-48da-9be3-8292d16cefa9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:13:49.366587 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-f3fbb3c5-1869-430d-bb22-c4c8e2df22af req-006a551c-c3c5-4c44-8320-9dd17fd544e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b69368e-88fa-48da-9be3-8292d16cefa9", "tag": "dd4468a2-0987-4e20-81d8-9687f49cc8c5"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:13:49.373679 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a155a31-c710-4502-9fbd-db68534b87ea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:49.374286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a155a31-c710-4502-9fbd-db68534b87ea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:49.374748 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a155a31-c710-4502-9fbd-db68534b87ea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:49.375478 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a155a31-c710-4502-9fbd-db68534b87ea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:49.375975 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a155a31-c710-4502-9fbd-db68534b87ea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:49.376386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8a155a31-c710-4502-9fbd-db68534b87ea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:49.383317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f3fbb3c5-1869-430d-bb22-c4c8e2df22af req-006a551c-c3c5-4c44-8320-9dd17fd544e3 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:13:49.383929 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f3fbb3c5-1869-430d-bb22-c4c8e2df22af req-006a551c-c3c5-4c44-8320-9dd17fd544e3 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:13:49.384563 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f3fbb3c5-1869-430d-bb22-c4c8e2df22af req-006a551c-c3c5-4c44-8320-9dd17fd544e3 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:13:49.397880 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-f3fbb3c5-1869-430d-bb22-c4c8e2df22af req-006a551c-c3c5-4c44-8320-9dd17fd544e3 service nova] Creating event network-changed:dd4468a2-0987-4e20-81d8-9687f49cc8c5 for instance 0b69368e-88fa-48da-9be3-8292d16cefa9 on n-h1-851359-3 Aug 04 18:13:49.405271 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-f3fbb3c5-1869-430d-bb22-c4c8e2df22af req-006a551c-c3c5-4c44-8320-9dd17fd544e3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041717 Aug 04 18:13:49.405808 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3734/7495] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:13:49.605389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8a155a31-c710-4502-9fbd-db68534b87ea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:13:49.614748 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8a155a31-c710-4502-9fbd-db68534b87ea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9" status: 200 len: 1561 microversion: 2.1 time: 0.254525 Aug 04 18:13:49.617326 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3762/7496] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:13:49 2022] GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9 => generated 1561 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:14:12.882009 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-993dcfaa-6d38-4ec6-98f4-a0ec1a70badd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:14:12.885809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-993dcfaa-6d38-4ec6-98f4-a0ec1a70badd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 0b69368e-88fa-48da-9be3-8292d16cefa9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:14:12.888617 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:14:12.889441 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=38 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:14:12.896622 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-993dcfaa-6d38-4ec6-98f4-a0ec1a70badd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:14:12.897128 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-993dcfaa-6d38-4ec6-98f4-a0ec1a70badd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:14:12.897586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-993dcfaa-6d38-4ec6-98f4-a0ec1a70badd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:14:12.898342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-993dcfaa-6d38-4ec6-98f4-a0ec1a70badd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:14:12.898819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-993dcfaa-6d38-4ec6-98f4-a0ec1a70badd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:14:12.899265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-993dcfaa-6d38-4ec6-98f4-a0ec1a70badd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:14:12.966651 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-993dcfaa-6d38-4ec6-98f4-a0ec1a70badd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "POST /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9/action" status: 200 len: 24567 microversion: 2.1 time: 0.088842 Aug 04 18:14:12.967319 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3735/7497] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:14:12 2022] POST /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9/action => generated 24567 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 18:14:19.334199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-be47512f-c54e-454e-b6b1-a91d0f2acf3e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:14:19.336422 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-be47512f-c54e-454e-b6b1-a91d0f2acf3e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 0b69368e-88fa-48da-9be3-8292d16cefa9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:14:19.338834 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:14:19.339494 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=36 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:14:19.346683 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be47512f-c54e-454e-b6b1-a91d0f2acf3e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:14:19.347188 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be47512f-c54e-454e-b6b1-a91d0f2acf3e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:14:19.347637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be47512f-c54e-454e-b6b1-a91d0f2acf3e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:14:19.348365 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be47512f-c54e-454e-b6b1-a91d0f2acf3e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:14:19.348840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be47512f-c54e-454e-b6b1-a91d0f2acf3e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:14:19.349280 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be47512f-c54e-454e-b6b1-a91d0f2acf3e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:14:19.424491 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-be47512f-c54e-454e-b6b1-a91d0f2acf3e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "POST /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9/action" status: 202 len: 0 microversion: 2.1 time: 0.094035 Aug 04 18:14:19.425196 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3763/7498] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:14:19 2022] POST /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 18:14:19.434263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ff388693-592a-4f3e-9ff5-cdab76d99e7e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:14:19.435624 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ff388693-592a-4f3e-9ff5-cdab76d99e7e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 0b69368e-88fa-48da-9be3-8292d16cefa9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:14:19.443310 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff388693-592a-4f3e-9ff5-cdab76d99e7e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:14:19.443837 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff388693-592a-4f3e-9ff5-cdab76d99e7e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:14:19.444267 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff388693-592a-4f3e-9ff5-cdab76d99e7e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:14:19.444992 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff388693-592a-4f3e-9ff5-cdab76d99e7e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:14:19.445470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff388693-592a-4f3e-9ff5-cdab76d99e7e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:14:19.445944 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff388693-592a-4f3e-9ff5-cdab76d99e7e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:14:19.676939 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ff388693-592a-4f3e-9ff5-cdab76d99e7e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:14:19.684672 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ff388693-592a-4f3e-9ff5-cdab76d99e7e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9" status: 200 len: 1671 microversion: 2.1 time: 0.254654 Aug 04 18:14:19.685262 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3736/7499] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:14:19 2022] GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9 => generated 1671 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:14:20.708868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a18542b1-755a-4fe1-b986-b2f812b67dda tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:14:20.709563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a18542b1-755a-4fe1-b986-b2f812b67dda tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 0b69368e-88fa-48da-9be3-8292d16cefa9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:14:20.716239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a18542b1-755a-4fe1-b986-b2f812b67dda tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:14:20.716729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a18542b1-755a-4fe1-b986-b2f812b67dda tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:14:20.717171 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a18542b1-755a-4fe1-b986-b2f812b67dda tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:14:20.717868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a18542b1-755a-4fe1-b986-b2f812b67dda tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:14:20.718364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a18542b1-755a-4fe1-b986-b2f812b67dda tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:14:20.718799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a18542b1-755a-4fe1-b986-b2f812b67dda tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:14:20.861944 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a18542b1-755a-4fe1-b986-b2f812b67dda tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:14:20.869686 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a18542b1-755a-4fe1-b986-b2f812b67dda tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9" status: 200 len: 1676 microversion: 2.1 time: 0.165756 Aug 04 18:14:20.870326 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3764/7500] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:14:20 2022] GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:14:21.897007 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-52929422-9eb2-4c01-aacc-18cbf17bf594 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:14:21.897560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-52929422-9eb2-4c01-aacc-18cbf17bf594 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 0b69368e-88fa-48da-9be3-8292d16cefa9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:14:21.905247 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52929422-9eb2-4c01-aacc-18cbf17bf594 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:14:21.905760 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52929422-9eb2-4c01-aacc-18cbf17bf594 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:14:21.906244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52929422-9eb2-4c01-aacc-18cbf17bf594 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:14:21.907463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52929422-9eb2-4c01-aacc-18cbf17bf594 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:14:21.907942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52929422-9eb2-4c01-aacc-18cbf17bf594 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:14:21.908386 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52929422-9eb2-4c01-aacc-18cbf17bf594 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:14:22.045868 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-52929422-9eb2-4c01-aacc-18cbf17bf594 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:14:22.054612 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-52929422-9eb2-4c01-aacc-18cbf17bf594 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9" status: 200 len: 1676 microversion: 2.1 time: 0.161572 Aug 04 18:14:22.055211 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3737/7501] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:14:21 2022] GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:14:23.077064 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-99da8124-5c45-441f-8c10-aa6d28a9bef1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:14:23.077743 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-99da8124-5c45-441f-8c10-aa6d28a9bef1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 0b69368e-88fa-48da-9be3-8292d16cefa9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:14:23.085511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99da8124-5c45-441f-8c10-aa6d28a9bef1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:14:23.086142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99da8124-5c45-441f-8c10-aa6d28a9bef1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:14:23.086630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99da8124-5c45-441f-8c10-aa6d28a9bef1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:14:23.087377 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99da8124-5c45-441f-8c10-aa6d28a9bef1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:14:23.088082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99da8124-5c45-441f-8c10-aa6d28a9bef1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:14:23.088662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-99da8124-5c45-441f-8c10-aa6d28a9bef1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:14:23.175354 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:14:23.175946 n-d-851359-3 devstack@n-api.service[131044]: Thu Aug 4 18:14:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:14:23.237676 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-99da8124-5c45-441f-8c10-aa6d28a9bef1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:14:23.245968 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-99da8124-5c45-441f-8c10-aa6d28a9bef1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9" status: 200 len: 1676 microversion: 2.1 time: 0.173787 Aug 04 18:14:23.246614 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3765/7502] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:14:23 2022] GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9 => generated 1676 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:14:24.268696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a0b4afc8-2cb2-49b8-8aba-eb5b8c3f23aa tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:14:24.269386 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a0b4afc8-2cb2-49b8-8aba-eb5b8c3f23aa tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 0b69368e-88fa-48da-9be3-8292d16cefa9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:14:24.277593 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0b4afc8-2cb2-49b8-8aba-eb5b8c3f23aa tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:14:24.278142 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0b4afc8-2cb2-49b8-8aba-eb5b8c3f23aa tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:14:24.278602 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0b4afc8-2cb2-49b8-8aba-eb5b8c3f23aa tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:14:24.279432 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0b4afc8-2cb2-49b8-8aba-eb5b8c3f23aa tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:14:24.279921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0b4afc8-2cb2-49b8-8aba-eb5b8c3f23aa tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:14:24.281048 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0b4afc8-2cb2-49b8-8aba-eb5b8c3f23aa tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:14:24.431383 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a0b4afc8-2cb2-49b8-8aba-eb5b8c3f23aa tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:14:24.441062 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a0b4afc8-2cb2-49b8-8aba-eb5b8c3f23aa tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9" status: 200 len: 1676 microversion: 2.1 time: 0.176414 Aug 04 18:14:24.441640 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3738/7503] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:14:24 2022] GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9 => generated 1676 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:14:25.463611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a6c081a8-7b25-421a-b42f-09ab6680cfd6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:14:25.464345 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a6c081a8-7b25-421a-b42f-09ab6680cfd6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 0b69368e-88fa-48da-9be3-8292d16cefa9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:14:25.471250 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6c081a8-7b25-421a-b42f-09ab6680cfd6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:14:25.471755 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6c081a8-7b25-421a-b42f-09ab6680cfd6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:14:25.472202 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6c081a8-7b25-421a-b42f-09ab6680cfd6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:14:25.472956 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6c081a8-7b25-421a-b42f-09ab6680cfd6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:14:25.473429 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6c081a8-7b25-421a-b42f-09ab6680cfd6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:14:25.473873 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a6c081a8-7b25-421a-b42f-09ab6680cfd6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:14:25.620118 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a6c081a8-7b25-421a-b42f-09ab6680cfd6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:14:25.632197 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a6c081a8-7b25-421a-b42f-09ab6680cfd6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9" status: 200 len: 1676 microversion: 2.1 time: 0.172217 Aug 04 18:14:25.633057 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3766/7504] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:14:25 2022] GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9 => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:14:26.660037 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-da3f9618-2258-4024-a0c9-d07b6f42e9bf tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:14:26.660693 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-da3f9618-2258-4024-a0c9-d07b6f42e9bf tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 0b69368e-88fa-48da-9be3-8292d16cefa9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:14:26.668423 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da3f9618-2258-4024-a0c9-d07b6f42e9bf tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:14:26.668965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da3f9618-2258-4024-a0c9-d07b6f42e9bf tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:14:26.669424 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da3f9618-2258-4024-a0c9-d07b6f42e9bf tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:14:26.670191 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da3f9618-2258-4024-a0c9-d07b6f42e9bf tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:14:26.670659 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da3f9618-2258-4024-a0c9-d07b6f42e9bf tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:14:26.671095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da3f9618-2258-4024-a0c9-d07b6f42e9bf tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:14:26.816135 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-da3f9618-2258-4024-a0c9-d07b6f42e9bf tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:14:26.823975 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-da3f9618-2258-4024-a0c9-d07b6f42e9bf tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9" status: 200 len: 1676 microversion: 2.1 time: 0.168408 Aug 04 18:14:26.824483 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3739/7505] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:14:26 2022] GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:14:27.846213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-75c5e60f-47e5-40ef-8a2c-b7b66b18d75e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:14:27.846791 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-75c5e60f-47e5-40ef-8a2c-b7b66b18d75e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 0b69368e-88fa-48da-9be3-8292d16cefa9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:14:27.853756 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75c5e60f-47e5-40ef-8a2c-b7b66b18d75e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:14:27.854537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75c5e60f-47e5-40ef-8a2c-b7b66b18d75e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:14:27.854981 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75c5e60f-47e5-40ef-8a2c-b7b66b18d75e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:14:27.855689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75c5e60f-47e5-40ef-8a2c-b7b66b18d75e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:14:27.856149 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75c5e60f-47e5-40ef-8a2c-b7b66b18d75e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:14:27.856583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-75c5e60f-47e5-40ef-8a2c-b7b66b18d75e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:14:27.990260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-75c5e60f-47e5-40ef-8a2c-b7b66b18d75e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:14:27.998045 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-75c5e60f-47e5-40ef-8a2c-b7b66b18d75e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9" status: 200 len: 1676 microversion: 2.1 time: 0.156237 Aug 04 18:14:27.998614 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3767/7506] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:14:27 2022] GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:14:29.021012 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aabe02be-6cd1-4ba0-8604-3c3763c76a8d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:14:29.021564 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aabe02be-6cd1-4ba0-8604-3c3763c76a8d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 0b69368e-88fa-48da-9be3-8292d16cefa9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:14:29.028651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aabe02be-6cd1-4ba0-8604-3c3763c76a8d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:14:29.029154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aabe02be-6cd1-4ba0-8604-3c3763c76a8d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:14:29.029610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aabe02be-6cd1-4ba0-8604-3c3763c76a8d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:14:29.030370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aabe02be-6cd1-4ba0-8604-3c3763c76a8d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:14:29.030846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aabe02be-6cd1-4ba0-8604-3c3763c76a8d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:14:29.031294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aabe02be-6cd1-4ba0-8604-3c3763c76a8d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:14:29.172337 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-aabe02be-6cd1-4ba0-8604-3c3763c76a8d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:14:29.180332 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aabe02be-6cd1-4ba0-8604-3c3763c76a8d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9" status: 200 len: 1676 microversion: 2.1 time: 0.163884 Aug 04 18:14:29.180912 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3740/7507] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:14:29 2022] GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:14:30.202992 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5199618a-b9c2-4cd6-bdb1-bf9a583fee45 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:14:30.203623 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5199618a-b9c2-4cd6-bdb1-bf9a583fee45 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 0b69368e-88fa-48da-9be3-8292d16cefa9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:14:30.211301 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5199618a-b9c2-4cd6-bdb1-bf9a583fee45 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:14:30.211799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5199618a-b9c2-4cd6-bdb1-bf9a583fee45 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:14:30.212249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5199618a-b9c2-4cd6-bdb1-bf9a583fee45 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:14:30.212962 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5199618a-b9c2-4cd6-bdb1-bf9a583fee45 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:14:30.213435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5199618a-b9c2-4cd6-bdb1-bf9a583fee45 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:14:30.213912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5199618a-b9c2-4cd6-bdb1-bf9a583fee45 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:14:30.354881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5199618a-b9c2-4cd6-bdb1-bf9a583fee45 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:14:30.362644 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5199618a-b9c2-4cd6-bdb1-bf9a583fee45 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9" status: 200 len: 1676 microversion: 2.1 time: 0.163607 Aug 04 18:14:30.363243 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3768/7508] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:14:30 2022] GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:14:31.383575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d20cdcb0-c39f-4b7c-8a3f-14d105134f09 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:14:31.384208 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d20cdcb0-c39f-4b7c-8a3f-14d105134f09 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 0b69368e-88fa-48da-9be3-8292d16cefa9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:14:31.390911 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d20cdcb0-c39f-4b7c-8a3f-14d105134f09 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:14:31.391418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d20cdcb0-c39f-4b7c-8a3f-14d105134f09 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:14:31.391874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d20cdcb0-c39f-4b7c-8a3f-14d105134f09 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:14:31.393201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d20cdcb0-c39f-4b7c-8a3f-14d105134f09 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:14:31.393674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d20cdcb0-c39f-4b7c-8a3f-14d105134f09 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:14:31.394146 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d20cdcb0-c39f-4b7c-8a3f-14d105134f09 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:14:31.529226 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d20cdcb0-c39f-4b7c-8a3f-14d105134f09 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:14:31.537057 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d20cdcb0-c39f-4b7c-8a3f-14d105134f09 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9" status: 200 len: 1679 microversion: 2.1 time: 0.157319 Aug 04 18:14:31.537637 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3741/7509] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:14:31 2022] GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:14:55.731228 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fc9fb30f-0408-4b1b-aaee-21cfda1e0ad4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:14:55.733379 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fc9fb30f-0408-4b1b-aaee-21cfda1e0ad4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 0b69368e-88fa-48da-9be3-8292d16cefa9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:14:55.735749 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=12 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:14:55.736564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:14:55.741793 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc9fb30f-0408-4b1b-aaee-21cfda1e0ad4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:14:55.742305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc9fb30f-0408-4b1b-aaee-21cfda1e0ad4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:14:55.742744 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc9fb30f-0408-4b1b-aaee-21cfda1e0ad4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:14:55.743438 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc9fb30f-0408-4b1b-aaee-21cfda1e0ad4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:14:55.743896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc9fb30f-0408-4b1b-aaee-21cfda1e0ad4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:14:55.744322 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fc9fb30f-0408-4b1b-aaee-21cfda1e0ad4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:14:55.818664 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fc9fb30f-0408-4b1b-aaee-21cfda1e0ad4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "POST /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9/action" status: 200 len: 69101 microversion: 2.1 time: 0.091551 Aug 04 18:14:55.819687 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3769/7510] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:14:55 2022] POST /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9/action => generated 69101 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 18:15:03.227999 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ff7d9674-9003-4536-a62f-a4e003fd993f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:15:03.228562 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ff7d9674-9003-4536-a62f-a4e003fd993f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 0b69368e-88fa-48da-9be3-8292d16cefa9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:15:03.231203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=14 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:15:03.231848 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-a7ad78d5-ccb6-43bb-ae2e-568cbbf488f8 req-fd1b6afa-d5db-4b89-95c6-288b73569e57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b69368e-88fa-48da-9be3-8292d16cefa9", "tag": "dd4468a2-0987-4e20-81d8-9687f49cc8c5"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:15:03.232301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=40 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:15:03.239996 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff7d9674-9003-4536-a62f-a4e003fd993f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:03.240514 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff7d9674-9003-4536-a62f-a4e003fd993f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:03.240968 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff7d9674-9003-4536-a62f-a4e003fd993f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:03.242140 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff7d9674-9003-4536-a62f-a4e003fd993f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:03.242706 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff7d9674-9003-4536-a62f-a4e003fd993f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:03.243232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff7d9674-9003-4536-a62f-a4e003fd993f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:03.243550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a7ad78d5-ccb6-43bb-ae2e-568cbbf488f8 req-fd1b6afa-d5db-4b89-95c6-288b73569e57 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:03.244308 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a7ad78d5-ccb6-43bb-ae2e-568cbbf488f8 req-fd1b6afa-d5db-4b89-95c6-288b73569e57 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:03.244746 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a7ad78d5-ccb6-43bb-ae2e-568cbbf488f8 req-fd1b6afa-d5db-4b89-95c6-288b73569e57 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:03.257012 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-a7ad78d5-ccb6-43bb-ae2e-568cbbf488f8 req-fd1b6afa-d5db-4b89-95c6-288b73569e57 service nova] Creating event network-changed:dd4468a2-0987-4e20-81d8-9687f49cc8c5 for instance 0b69368e-88fa-48da-9be3-8292d16cefa9 on n-h1-851359-3 Aug 04 18:15:03.262431 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-a7ad78d5-ccb6-43bb-ae2e-568cbbf488f8 req-fd1b6afa-d5db-4b89-95c6-288b73569e57 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036077 Aug 04 18:15:03.263217 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3770/7511] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:15:03.271286 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ff7d9674-9003-4536-a62f-a4e003fd993f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 0b69368e-88fa-48da-9be3-8292d16cefa9] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 18:15:03.364688 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ff7d9674-9003-4536-a62f-a4e003fd993f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9" status: 204 len: 0 microversion: 2.1 time: 0.140961 Aug 04 18:15:03.366233 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3742/7512] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 18:15:03 2022] DELETE /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 18:15:03.375762 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-11fdaaec-8aa7-4635-bff3-090a44ced738 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:15:03.376466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-11fdaaec-8aa7-4635-bff3-090a44ced738 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 0b69368e-88fa-48da-9be3-8292d16cefa9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:15:03.382691 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-11fdaaec-8aa7-4635-bff3-090a44ced738 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:03.383184 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-11fdaaec-8aa7-4635-bff3-090a44ced738 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:03.383835 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-11fdaaec-8aa7-4635-bff3-090a44ced738 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:03.384600 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-11fdaaec-8aa7-4635-bff3-090a44ced738 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:03.385156 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-11fdaaec-8aa7-4635-bff3-090a44ced738 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:03.385593 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-11fdaaec-8aa7-4635-bff3-090a44ced738 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:03.527334 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-11fdaaec-8aa7-4635-bff3-090a44ced738 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:15:03.535001 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-11fdaaec-8aa7-4635-bff3-090a44ced738 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9" status: 200 len: 1685 microversion: 2.1 time: 0.163947 Aug 04 18:15:03.535575 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3771/7513] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:15:03 2022] GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9 => generated 1685 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:15:04.558269 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-50583fb2-2822-4539-acf9-73f5070d10b7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:15:04.558940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-50583fb2-2822-4539-acf9-73f5070d10b7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 0b69368e-88fa-48da-9be3-8292d16cefa9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:15:04.565791 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50583fb2-2822-4539-acf9-73f5070d10b7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:04.566321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50583fb2-2822-4539-acf9-73f5070d10b7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:04.566783 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50583fb2-2822-4539-acf9-73f5070d10b7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:04.567502 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50583fb2-2822-4539-acf9-73f5070d10b7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:04.568040 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50583fb2-2822-4539-acf9-73f5070d10b7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:04.568491 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50583fb2-2822-4539-acf9-73f5070d10b7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:04.777423 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-50583fb2-2822-4539-acf9-73f5070d10b7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:15:04.785082 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-50583fb2-2822-4539-acf9-73f5070d10b7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9" status: 200 len: 1685 microversion: 2.1 time: 0.231741 Aug 04 18:15:04.785649 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3743/7514] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:15:04 2022] GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9 => generated 1685 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:15:05.482212 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-08b41708-959d-408e-95a3-654a3e6c0eed req-e1ac2997-3c73-4e77-92b8-2f6914a2786e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b69368e-88fa-48da-9be3-8292d16cefa9", "name": "network-vif-deleted", "tag": "dd4468a2-0987-4e20-81d8-9687f49cc8c5"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:15:05.493572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-08b41708-959d-408e-95a3-654a3e6c0eed req-e1ac2997-3c73-4e77-92b8-2f6914a2786e service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:05.494086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-08b41708-959d-408e-95a3-654a3e6c0eed req-e1ac2997-3c73-4e77-92b8-2f6914a2786e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:05.494527 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-08b41708-959d-408e-95a3-654a3e6c0eed req-e1ac2997-3c73-4e77-92b8-2f6914a2786e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:05.506191 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-08b41708-959d-408e-95a3-654a3e6c0eed req-e1ac2997-3c73-4e77-92b8-2f6914a2786e service nova] Creating event network-vif-deleted:dd4468a2-0987-4e20-81d8-9687f49cc8c5 for instance 0b69368e-88fa-48da-9be3-8292d16cefa9 on n-h1-851359-3 Aug 04 18:15:05.512435 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-08b41708-959d-408e-95a3-654a3e6c0eed req-e1ac2997-3c73-4e77-92b8-2f6914a2786e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034250 Aug 04 18:15:05.513418 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3772/7515] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:15:05.808937 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fb0783b5-ec43-4e24-9327-47a745c484b7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:15:05.809661 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fb0783b5-ec43-4e24-9327-47a745c484b7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 0b69368e-88fa-48da-9be3-8292d16cefa9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:15:05.817345 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb0783b5-ec43-4e24-9327-47a745c484b7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:05.817856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb0783b5-ec43-4e24-9327-47a745c484b7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:05.818350 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb0783b5-ec43-4e24-9327-47a745c484b7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:05.819084 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb0783b5-ec43-4e24-9327-47a745c484b7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:05.820406 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb0783b5-ec43-4e24-9327-47a745c484b7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:05.820406 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb0783b5-ec43-4e24-9327-47a745c484b7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:05.863003 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb0783b5-ec43-4e24-9327-47a745c484b7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:05.863515 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb0783b5-ec43-4e24-9327-47a745c484b7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:05.863971 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb0783b5-ec43-4e24-9327-47a745c484b7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:05.864441 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-fb0783b5-ec43-4e24-9327-47a745c484b7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lazy-loading 'fault' on Instance uuid 0b69368e-88fa-48da-9be3-8292d16cefa9 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 18:15:05.907463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fb0783b5-ec43-4e24-9327-47a745c484b7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:15:05.916139 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fb0783b5-ec43-4e24-9327-47a745c484b7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9" status: 200 len: 1354 microversion: 2.1 time: 0.111168 Aug 04 18:15:05.916781 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3744/7516] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:15:05 2022] GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9 => generated 1354 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:15:06.940419 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7534cdfe-33ad-42f3-96ef-422b46eb373a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:15:06.941136 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7534cdfe-33ad-42f3-96ef-422b46eb373a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 0b69368e-88fa-48da-9be3-8292d16cefa9] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:15:06.948518 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7534cdfe-33ad-42f3-96ef-422b46eb373a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:06.949019 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7534cdfe-33ad-42f3-96ef-422b46eb373a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:06.949473 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7534cdfe-33ad-42f3-96ef-422b46eb373a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:06.950234 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7534cdfe-33ad-42f3-96ef-422b46eb373a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:06.950708 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7534cdfe-33ad-42f3-96ef-422b46eb373a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:06.951145 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7534cdfe-33ad-42f3-96ef-422b46eb373a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:06.966373 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-7534cdfe-33ad-42f3-96ef-422b46eb373a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] HTTP exception thrown: Instance 0b69368e-88fa-48da-9be3-8292d16cefa9 could not be found. Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7534cdfe-33ad-42f3-96ef-422b46eb373a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Request method failure captured: Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9 HTTP/1.1 Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7AwIjCsovibYcH6ErWxGJedA-SXylLsKvn2zpdpI2y0HfanfgcItDr2cHF1i3ynCG5lmDiVO7c8mMcbqfLpue1bmLw9gTl9Y1GTYLYZrG8HdwuvNirSZtowkucGnoPRO0LnscJrHruNXZPpdU2GfZAeK3oRPo9VtZizbrtXsNeEIQOc Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: ca6f9f1c52b34546af469a9d43d466db Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-103139372 Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca6f9f1c52b34546af469a9d43d466db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca6f9f1c52b34546af469a9d43d466db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ca6f9f1c52b34546af469a9d43d466db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ca6f9f1c52b34546af469a9d43d466db"}]}] Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-TestNetworkAdvancedServerOps-103139372 Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: ca6f9f1c52b34546af469a9d43d466db Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-103139372 Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-TestNetworkAdvancedServerOps-103139372-project Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 35ad5b583f7f49e0b36ea7d3d75c9a20 Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-TestNetworkAdvancedServerOps-103139372-project Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 0b69368e-88fa-48da-9be3-8292d16cefa9 could not be found. Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '0b69368e-88fa-48da-9be3-8292d16cefa9'} Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b69368e-88fa-48da-9be3-8292d16cefa9 could not be found. Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b69368e-88fa-48da-9be3-8292d16cefa9 could not be found. Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:15:06.968071 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:15:06.972741 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:15:06.972741 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:15:06.972741 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:15:06.972741 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:15:06.972741 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:15:06.972741 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:15:06.972741 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b69368e-88fa-48da-9be3-8292d16cefa9 could not be found. Aug 04 18:15:06.972741 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:15:06.972741 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7534cdfe-33ad-42f3-96ef-422b46eb373a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Returning 404 to user: Instance 0b69368e-88fa-48da-9be3-8292d16cefa9 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:15:06.972741 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7534cdfe-33ad-42f3-96ef-422b46eb373a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9" status: 404 len: 111 microversion: 2.1 time: 0.034337 Aug 04 18:15:06.972741 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3773/7517] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:15:06 2022] GET /compute/v2.1/servers/0b69368e-88fa-48da-9be3-8292d16cefa9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 18:15:10.189076 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4665de52-605a-4416-acfc-4eab83b300ef tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '.version_select at 0x7f1e5a2c8040>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:15:10.213300 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4665de52-605a-4416-acfc-4eab83b300ef tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-57266270" status: 202 len: 0 microversion: 2.1 time: 0.028119 Aug 04 18:15:10.213895 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3745/7518] 10.222.0.93 () {58 vars in 1278 bytes} [Thu Aug 4 18:15:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-57266270 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 18:15:10.245413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d529fd61-15e3-4ff0-bb00-4f22e1b679c7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Action: 'create', calling method: .version_select at 0x7f1e5a308d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1380910720", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtOMWY+ODCEoSblwZC86WmWm7TQFOXr1resUNMpkO5gIUiK+7Sp2G/qSWHsUBEfBmJmlQjPq1P1nM6YNI9/WXUPAiaA7bf68CJPaEMz8NqZzwLftXjmsKwqrutPbeEeUg=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:15:10.262253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-d529fd61-15e3-4ff0-bb00-4f22e1b679c7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Getting quotas for project ca6f9f1c52b34546af469a9d43d466db. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 18:15:10.267454 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-d529fd61-15e3-4ff0-bb00-4f22e1b679c7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Getting quotas for user 35ad5b583f7f49e0b36ea7d3d75c9a20 and project ca6f9f1c52b34546af469a9d43d466db. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 18:15:10.291469 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d529fd61-15e3-4ff0-bb00-4f22e1b679c7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050595 Aug 04 18:15:10.292082 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3774/7519] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 18:15:10 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:15:17.127885 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:15:17.132726 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2af583a7-e89d-406a-b8f7-e67b1b3d5609 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-98460870", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "1906a9c9-6c51-4285-afb3-fc90cb10a8f8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1380910720", "security_groups": [{"name": "tempest-secgroup-smoke-477962116"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:15:17.333183 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-2af583a7-e89d-406a-b8f7-e67b1b3d5609 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] validate_networks() for [('1906a9c9-6c51-4285-afb3-fc90cb10a8f8', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 18:15:17.988985 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-2af583a7-e89d-406a-b8f7-e67b1b3d5609 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 18:15:17.989422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-2af583a7-e89d-406a-b8f7-e67b1b3d5609 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 18:15:17.989910 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-2af583a7-e89d-406a-b8f7-e67b1b3d5609 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 18:15:17.990382 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-2af583a7-e89d-406a-b8f7-e67b1b3d5609 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 18:15:17.990836 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-2af583a7-e89d-406a-b8f7-e67b1b3d5609 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 18:15:18.000645 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2af583a7-e89d-406a-b8f7-e67b1b3d5609 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:18.001137 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2af583a7-e89d-406a-b8f7-e67b1b3d5609 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:18.001583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2af583a7-e89d-406a-b8f7-e67b1b3d5609 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:18.002409 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2af583a7-e89d-406a-b8f7-e67b1b3d5609 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:18.002877 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2af583a7-e89d-406a-b8f7-e67b1b3d5609 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:18.003323 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2af583a7-e89d-406a-b8f7-e67b1b3d5609 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:18.021226 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-2af583a7-e89d-406a-b8f7-e67b1b3d5609 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Getting quotas for project ca6f9f1c52b34546af469a9d43d466db. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 18:15:18.027088 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-2af583a7-e89d-406a-b8f7-e67b1b3d5609 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Getting quotas for user 35ad5b583f7f49e0b36ea7d3d75c9a20 and project ca6f9f1c52b34546af469a9d43d466db. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 18:15:18.041473 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2af583a7-e89d-406a-b8f7-e67b1b3d5609 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 18:15:18.044138 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2af583a7-e89d-406a-b8f7-e67b1b3d5609 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 18:15:18.095827 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2af583a7-e89d-406a-b8f7-e67b1b3d5609 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.974840 Aug 04 18:15:18.103456 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3746/7520] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 18:15:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 18:15:18.106441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=16 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:15:18.116252 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f9cd09af-9863-4d16-8fbc-a1ab323439c0 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:15:18.116881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f9cd09af-9863-4d16-8fbc-a1ab323439c0 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:15:18.187862 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f9cd09af-9863-4d16-8fbc-a1ab323439c0 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:15:18.194948 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f9cd09af-9863-4d16-8fbc-a1ab323439c0 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1265 microversion: 2.1 time: 0.090565 Aug 04 18:15:18.196459 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3775/7521] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:15:18 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:15:19.228195 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-07220589-4d0c-4127-a81b-9ff400f37a42 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:15:19.229224 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-07220589-4d0c-4127-a81b-9ff400f37a42 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:15:19.238370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07220589-4d0c-4127-a81b-9ff400f37a42 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:19.239038 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07220589-4d0c-4127-a81b-9ff400f37a42 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:19.239590 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07220589-4d0c-4127-a81b-9ff400f37a42 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:19.240598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07220589-4d0c-4127-a81b-9ff400f37a42 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:19.241867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07220589-4d0c-4127-a81b-9ff400f37a42 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:19.242565 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07220589-4d0c-4127-a81b-9ff400f37a42 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:19.326145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-07220589-4d0c-4127-a81b-9ff400f37a42 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:15:19.340393 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-07220589-4d0c-4127-a81b-9ff400f37a42 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1325 microversion: 2.1 time: 0.127594 Aug 04 18:15:19.342332 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3747/7522] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:15:19 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1325 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:15:20.366368 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-937b3e4b-38ad-4a8b-b993-15f976c22868 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:15:20.367117 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-937b3e4b-38ad-4a8b-b993-15f976c22868 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:15:20.392514 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-937b3e4b-38ad-4a8b-b993-15f976c22868 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:20.393037 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-937b3e4b-38ad-4a8b-b993-15f976c22868 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:20.393490 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-937b3e4b-38ad-4a8b-b993-15f976c22868 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:20.394252 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-937b3e4b-38ad-4a8b-b993-15f976c22868 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:20.394725 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-937b3e4b-38ad-4a8b-b993-15f976c22868 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:20.395166 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-937b3e4b-38ad-4a8b-b993-15f976c22868 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:20.563563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-937b3e4b-38ad-4a8b-b993-15f976c22868 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:15:20.573680 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-937b3e4b-38ad-4a8b-b993-15f976c22868 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1390 microversion: 2.1 time: 0.211525 Aug 04 18:15:20.574799 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3776/7523] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:15:20 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1390 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:15:20.822085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-e22fc2da-9ade-4750-8beb-526d0ffc724b req-f21817d0-4126-4cd7-93b6-aa461ca11bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16c74e8e-a570-45a8-9a64-dc7cd1fa4810", "tag": "c2ab9090-43e7-4d4b-9d01-01390b9ff1b1"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:15:20.834776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e22fc2da-9ade-4750-8beb-526d0ffc724b req-f21817d0-4126-4cd7-93b6-aa461ca11bd9 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:20.835385 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e22fc2da-9ade-4750-8beb-526d0ffc724b req-f21817d0-4126-4cd7-93b6-aa461ca11bd9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:20.835818 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e22fc2da-9ade-4750-8beb-526d0ffc724b req-f21817d0-4126-4cd7-93b6-aa461ca11bd9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:20.848007 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-e22fc2da-9ade-4750-8beb-526d0ffc724b req-f21817d0-4126-4cd7-93b6-aa461ca11bd9 service nova] Creating event network-changed:c2ab9090-43e7-4d4b-9d01-01390b9ff1b1 for instance 16c74e8e-a570-45a8-9a64-dc7cd1fa4810 on n-h1-851359-3 Aug 04 18:15:20.854075 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-e22fc2da-9ade-4750-8beb-526d0ffc724b req-f21817d0-4126-4cd7-93b6-aa461ca11bd9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036412 Aug 04 18:15:20.854685 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3748/7524] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:15:21.595786 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5372a293-b5c6-4c1e-a937-378c1aa0a7b1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:15:21.596410 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5372a293-b5c6-4c1e-a937-378c1aa0a7b1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:15:21.603905 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5372a293-b5c6-4c1e-a937-378c1aa0a7b1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:21.604491 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5372a293-b5c6-4c1e-a937-378c1aa0a7b1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:21.605208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5372a293-b5c6-4c1e-a937-378c1aa0a7b1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:21.605961 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5372a293-b5c6-4c1e-a937-378c1aa0a7b1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:21.606456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5372a293-b5c6-4c1e-a937-378c1aa0a7b1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:21.606884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5372a293-b5c6-4c1e-a937-378c1aa0a7b1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:21.758015 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5372a293-b5c6-4c1e-a937-378c1aa0a7b1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:15:21.766157 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5372a293-b5c6-4c1e-a937-378c1aa0a7b1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1390 microversion: 2.1 time: 0.174267 Aug 04 18:15:21.766738 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3777/7525] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:15:21 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1390 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:15:22.790179 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6477e0a2-6460-44fa-9f92-8689d0693ff2 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:15:22.790917 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6477e0a2-6460-44fa-9f92-8689d0693ff2 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:15:22.797354 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6477e0a2-6460-44fa-9f92-8689d0693ff2 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:22.797864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6477e0a2-6460-44fa-9f92-8689d0693ff2 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:22.798354 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6477e0a2-6460-44fa-9f92-8689d0693ff2 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:22.799083 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6477e0a2-6460-44fa-9f92-8689d0693ff2 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:22.799562 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6477e0a2-6460-44fa-9f92-8689d0693ff2 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:22.800011 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6477e0a2-6460-44fa-9f92-8689d0693ff2 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:22.943492 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6477e0a2-6460-44fa-9f92-8689d0693ff2 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:15:22.952030 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6477e0a2-6460-44fa-9f92-8689d0693ff2 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1390 microversion: 2.1 time: 0.167821 Aug 04 18:15:22.952620 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3749/7526] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:15:22 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:15:23.972938 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ad5c3f6e-dc55-44b8-bc2c-0a7cf35dd0e6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:15:23.973493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ad5c3f6e-dc55-44b8-bc2c-0a7cf35dd0e6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:15:23.981298 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad5c3f6e-dc55-44b8-bc2c-0a7cf35dd0e6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:23.981802 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad5c3f6e-dc55-44b8-bc2c-0a7cf35dd0e6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:23.982290 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad5c3f6e-dc55-44b8-bc2c-0a7cf35dd0e6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:23.983016 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad5c3f6e-dc55-44b8-bc2c-0a7cf35dd0e6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:23.983483 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad5c3f6e-dc55-44b8-bc2c-0a7cf35dd0e6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:23.983931 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ad5c3f6e-dc55-44b8-bc2c-0a7cf35dd0e6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:24.130418 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ad5c3f6e-dc55-44b8-bc2c-0a7cf35dd0e6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:15:24.138252 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ad5c3f6e-dc55-44b8-bc2c-0a7cf35dd0e6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1390 microversion: 2.1 time: 0.169229 Aug 04 18:15:24.138859 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3778/7527] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:15:23 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1390 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:15:25.159255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c143ba31-c37f-40b1-8b7c-a0fd6ea39e92 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:15:25.159938 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c143ba31-c37f-40b1-8b7c-a0fd6ea39e92 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:15:25.168190 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c143ba31-c37f-40b1-8b7c-a0fd6ea39e92 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:25.168704 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c143ba31-c37f-40b1-8b7c-a0fd6ea39e92 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:25.169152 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c143ba31-c37f-40b1-8b7c-a0fd6ea39e92 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:25.169880 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c143ba31-c37f-40b1-8b7c-a0fd6ea39e92 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:25.170373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c143ba31-c37f-40b1-8b7c-a0fd6ea39e92 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:25.170812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c143ba31-c37f-40b1-8b7c-a0fd6ea39e92 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:25.309947 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c143ba31-c37f-40b1-8b7c-a0fd6ea39e92 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:15:25.317851 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c143ba31-c37f-40b1-8b7c-a0fd6ea39e92 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1390 microversion: 2.1 time: 0.162443 Aug 04 18:15:25.318748 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3750/7528] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:15:25 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:15:26.339187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e649ff79-1850-4802-9f23-64ebd6bb61a5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:15:26.339814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e649ff79-1850-4802-9f23-64ebd6bb61a5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:15:26.342601 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:15:26.348326 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e649ff79-1850-4802-9f23-64ebd6bb61a5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:26.348831 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e649ff79-1850-4802-9f23-64ebd6bb61a5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:26.349284 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e649ff79-1850-4802-9f23-64ebd6bb61a5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:26.350051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e649ff79-1850-4802-9f23-64ebd6bb61a5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:26.350572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e649ff79-1850-4802-9f23-64ebd6bb61a5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:26.351004 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e649ff79-1850-4802-9f23-64ebd6bb61a5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:26.494445 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e649ff79-1850-4802-9f23-64ebd6bb61a5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:15:26.502107 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e649ff79-1850-4802-9f23-64ebd6bb61a5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1390 microversion: 2.1 time: 0.166798 Aug 04 18:15:26.502699 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3779/7529] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:15:26 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:15:27.494739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b74398e8-b088-48c6-8985-6c6c974226e2 req-1d982e88-1c5e-4217-9f4a-db8906f3f29c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16c74e8e-a570-45a8-9a64-dc7cd1fa4810", "name": "network-vif-plugged", "status": "completed", "tag": "c2ab9090-43e7-4d4b-9d01-01390b9ff1b1"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:15:27.511159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b74398e8-b088-48c6-8985-6c6c974226e2 req-1d982e88-1c5e-4217-9f4a-db8906f3f29c service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:27.514153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b74398e8-b088-48c6-8985-6c6c974226e2 req-1d982e88-1c5e-4217-9f4a-db8906f3f29c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:27.514153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b74398e8-b088-48c6-8985-6c6c974226e2 req-1d982e88-1c5e-4217-9f4a-db8906f3f29c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:27.524402 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fcff958f-6c78-4778-8959-311500abf8dc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:15:27.525034 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fcff958f-6c78-4778-8959-311500abf8dc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:15:27.529593 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b74398e8-b088-48c6-8985-6c6c974226e2 req-1d982e88-1c5e-4217-9f4a-db8906f3f29c service nova] Creating event network-vif-plugged:c2ab9090-43e7-4d4b-9d01-01390b9ff1b1 for instance 16c74e8e-a570-45a8-9a64-dc7cd1fa4810 on n-h1-851359-3 Aug 04 18:15:27.532978 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fcff958f-6c78-4778-8959-311500abf8dc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:27.533793 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fcff958f-6c78-4778-8959-311500abf8dc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:27.534676 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fcff958f-6c78-4778-8959-311500abf8dc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:27.535300 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b74398e8-b088-48c6-8985-6c6c974226e2 req-1d982e88-1c5e-4217-9f4a-db8906f3f29c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045918 Aug 04 18:15:27.535944 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3751/7530] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:15:27.536246 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fcff958f-6c78-4778-8959-311500abf8dc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:27.536765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fcff958f-6c78-4778-8959-311500abf8dc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:27.537303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fcff958f-6c78-4778-8959-311500abf8dc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:27.694632 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fcff958f-6c78-4778-8959-311500abf8dc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:15:27.702522 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fcff958f-6c78-4778-8959-311500abf8dc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1390 microversion: 2.1 time: 0.182594 Aug 04 18:15:27.703108 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3780/7531] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:15:27 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1390 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:15:28.724397 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-33e9a5e8-8584-4459-9565-a27d46659377 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:15:28.725303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-33e9a5e8-8584-4459-9565-a27d46659377 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:15:28.728508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:15:28.729206 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:15:28.736659 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33e9a5e8-8584-4459-9565-a27d46659377 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:28.737159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33e9a5e8-8584-4459-9565-a27d46659377 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:28.737608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33e9a5e8-8584-4459-9565-a27d46659377 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:28.738357 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33e9a5e8-8584-4459-9565-a27d46659377 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:28.738828 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33e9a5e8-8584-4459-9565-a27d46659377 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:28.739270 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33e9a5e8-8584-4459-9565-a27d46659377 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:28.907263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-33e9a5e8-8584-4459-9565-a27d46659377 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:15:28.915088 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-33e9a5e8-8584-4459-9565-a27d46659377 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1561 microversion: 2.1 time: 0.195200 Aug 04 18:15:28.915677 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3752/7532] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:15:28 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1561 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:15:28.940176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4c95b4fe-3363-4d71-a882-9d3f036d728f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:15:28.941362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4c95b4fe-3363-4d71-a882-9d3f036d728f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:15:28.945449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:15:28.956915 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c95b4fe-3363-4d71-a882-9d3f036d728f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:28.957906 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c95b4fe-3363-4d71-a882-9d3f036d728f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:28.958853 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c95b4fe-3363-4d71-a882-9d3f036d728f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:28.960280 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c95b4fe-3363-4d71-a882-9d3f036d728f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:28.961141 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c95b4fe-3363-4d71-a882-9d3f036d728f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:28.961941 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4c95b4fe-3363-4d71-a882-9d3f036d728f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:29.144251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4c95b4fe-3363-4d71-a882-9d3f036d728f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:15:29.152425 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4c95b4fe-3363-4d71-a882-9d3f036d728f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1561 microversion: 2.1 time: 0.220067 Aug 04 18:15:29.153090 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3781/7533] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:15:28 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1561 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:15:31.271045 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-817af9c9-6278-470f-a08a-43152bcd3f7b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:15:31.271848 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-817af9c9-6278-470f-a08a-43152bcd3f7b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:15:31.275493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-ec427505-a690-4a71-b059-82796d09da99 req-5c6ada05-90c1-44c6-a2a0-d3f255e7b28d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16c74e8e-a570-45a8-9a64-dc7cd1fa4810", "tag": "c2ab9090-43e7-4d4b-9d01-01390b9ff1b1"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:15:31.287940 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ec427505-a690-4a71-b059-82796d09da99 req-5c6ada05-90c1-44c6-a2a0-d3f255e7b28d service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:31.288234 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-817af9c9-6278-470f-a08a-43152bcd3f7b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:31.288508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ec427505-a690-4a71-b059-82796d09da99 req-5c6ada05-90c1-44c6-a2a0-d3f255e7b28d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:31.288652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-817af9c9-6278-470f-a08a-43152bcd3f7b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:31.288977 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-817af9c9-6278-470f-a08a-43152bcd3f7b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:31.289334 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ec427505-a690-4a71-b059-82796d09da99 req-5c6ada05-90c1-44c6-a2a0-d3f255e7b28d service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:31.290200 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-817af9c9-6278-470f-a08a-43152bcd3f7b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:31.290681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-817af9c9-6278-470f-a08a-43152bcd3f7b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:31.291998 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-817af9c9-6278-470f-a08a-43152bcd3f7b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:31.302373 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-ec427505-a690-4a71-b059-82796d09da99 req-5c6ada05-90c1-44c6-a2a0-d3f255e7b28d service nova] Creating event network-changed:c2ab9090-43e7-4d4b-9d01-01390b9ff1b1 for instance 16c74e8e-a570-45a8-9a64-dc7cd1fa4810 on n-h1-851359-3 Aug 04 18:15:31.308104 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-ec427505-a690-4a71-b059-82796d09da99 req-5c6ada05-90c1-44c6-a2a0-d3f255e7b28d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045432 Aug 04 18:15:31.308980 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3782/7534] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:15:31.448500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-817af9c9-6278-470f-a08a-43152bcd3f7b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:15:31.463872 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-817af9c9-6278-470f-a08a-43152bcd3f7b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1561 microversion: 2.1 time: 0.200981 Aug 04 18:15:31.463872 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3753/7535] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:15:31 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1561 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:15:52.742551 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=7 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:15:52.743605 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=38 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:15:52.749270 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d5affac5-9d3e-4dd2-a55c-6ec8251349d7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:15:52.752067 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d5affac5-9d3e-4dd2-a55c-6ec8251349d7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:15:52.760992 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d5affac5-9d3e-4dd2-a55c-6ec8251349d7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:52.761724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d5affac5-9d3e-4dd2-a55c-6ec8251349d7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:52.762403 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d5affac5-9d3e-4dd2-a55c-6ec8251349d7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:52.763359 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d5affac5-9d3e-4dd2-a55c-6ec8251349d7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:15:52.763935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d5affac5-9d3e-4dd2-a55c-6ec8251349d7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:15:52.764473 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d5affac5-9d3e-4dd2-a55c-6ec8251349d7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:15:52.842133 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d5affac5-9d3e-4dd2-a55c-6ec8251349d7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "POST /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810/action" status: 200 len: 24572 microversion: 2.1 time: 0.102585 Aug 04 18:15:52.843351 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3783/7536] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:15:52 2022] POST /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810/action => generated 24572 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 18:16:03.892726 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c3c435e6-2d1c-4d5e-9569-4e5000ef292e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:16:03.895692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c3c435e6-2d1c-4d5e-9569-4e5000ef292e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:16:03.899088 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:16:03.900174 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=36 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:16:03.910782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3c435e6-2d1c-4d5e-9569-4e5000ef292e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:03.912328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3c435e6-2d1c-4d5e-9569-4e5000ef292e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:03.913148 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3c435e6-2d1c-4d5e-9569-4e5000ef292e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:03.914496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3c435e6-2d1c-4d5e-9569-4e5000ef292e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:03.915358 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3c435e6-2d1c-4d5e-9569-4e5000ef292e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:03.916184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3c435e6-2d1c-4d5e-9569-4e5000ef292e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:03.991662 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c3c435e6-2d1c-4d5e-9569-4e5000ef292e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:16:04.003629 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c3c435e6-2d1c-4d5e-9569-4e5000ef292e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Old instance type m1.heat2, new instance type m1.heat {{(pid=131044) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 04 18:16:04.017149 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-c3c435e6-2d1c-4d5e-9569-4e5000ef292e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 18:16:04.017907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-c3c435e6-2d1c-4d5e-9569-4e5000ef292e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 18:16:04.018795 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-c3c435e6-2d1c-4d5e-9569-4e5000ef292e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 18:16:04.019541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-c3c435e6-2d1c-4d5e-9569-4e5000ef292e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 18:16:04.020981 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-c3c435e6-2d1c-4d5e-9569-4e5000ef292e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 18:16:04.149426 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c3c435e6-2d1c-4d5e-9569-4e5000ef292e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "POST /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810/action" status: 202 len: 0 microversion: 2.1 time: 0.260489 Aug 04 18:16:04.150398 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3754/7537] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:16:03 2022] POST /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 18:16:04.165101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-50718fd3-1eee-48ae-94d0-1052fe8e7865 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:16:04.166413 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-50718fd3-1eee-48ae-94d0-1052fe8e7865 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:16:04.171447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:16:04.173110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=4 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:16:04.184249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50718fd3-1eee-48ae-94d0-1052fe8e7865 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:04.185116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50718fd3-1eee-48ae-94d0-1052fe8e7865 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:04.186226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50718fd3-1eee-48ae-94d0-1052fe8e7865 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:04.187084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50718fd3-1eee-48ae-94d0-1052fe8e7865 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:04.187084 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50718fd3-1eee-48ae-94d0-1052fe8e7865 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:04.187824 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-50718fd3-1eee-48ae-94d0-1052fe8e7865 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:04.420263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-50718fd3-1eee-48ae-94d0-1052fe8e7865 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:16:04.435025 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-50718fd3-1eee-48ae-94d0-1052fe8e7865 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1689 microversion: 2.1 time: 0.277658 Aug 04 18:16:04.436481 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3784/7538] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:16:04 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1689 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:16:05.472672 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-19cb1989-8cbf-43bc-ba17-895d6a09cd74 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:16:05.473569 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-19cb1989-8cbf-43bc-ba17-895d6a09cd74 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:16:05.481905 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19cb1989-8cbf-43bc-ba17-895d6a09cd74 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:05.482596 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19cb1989-8cbf-43bc-ba17-895d6a09cd74 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:05.483125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19cb1989-8cbf-43bc-ba17-895d6a09cd74 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:05.483950 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19cb1989-8cbf-43bc-ba17-895d6a09cd74 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:05.484488 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19cb1989-8cbf-43bc-ba17-895d6a09cd74 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:05.484963 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19cb1989-8cbf-43bc-ba17-895d6a09cd74 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:05.698913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-19cb1989-8cbf-43bc-ba17-895d6a09cd74 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:16:05.707635 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-19cb1989-8cbf-43bc-ba17-895d6a09cd74 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1689 microversion: 2.1 time: 0.241129 Aug 04 18:16:05.708244 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3755/7539] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:16:05 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1689 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:16:06.744253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1497b509-56ad-4d27-88ec-88e89f598f20 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:16:06.745047 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1497b509-56ad-4d27-88ec-88e89f598f20 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:16:06.753909 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1497b509-56ad-4d27-88ec-88e89f598f20 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:06.754539 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1497b509-56ad-4d27-88ec-88e89f598f20 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:06.755002 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1497b509-56ad-4d27-88ec-88e89f598f20 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:06.756300 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1497b509-56ad-4d27-88ec-88e89f598f20 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:06.756782 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1497b509-56ad-4d27-88ec-88e89f598f20 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:06.757229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1497b509-56ad-4d27-88ec-88e89f598f20 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:06.945694 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1497b509-56ad-4d27-88ec-88e89f598f20 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:16:06.960258 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1497b509-56ad-4d27-88ec-88e89f598f20 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1689 microversion: 2.1 time: 0.219583 Aug 04 18:16:06.961379 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3785/7540] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:16:06 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1689 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:16:08.001553 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c79db049-087b-4909-a549-6736de8fc024 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:16:08.002841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c79db049-087b-4909-a549-6736de8fc024 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:16:08.015155 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c79db049-087b-4909-a549-6736de8fc024 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:08.016071 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c79db049-087b-4909-a549-6736de8fc024 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:08.016899 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c79db049-087b-4909-a549-6736de8fc024 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:08.018252 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c79db049-087b-4909-a549-6736de8fc024 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:08.019170 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c79db049-087b-4909-a549-6736de8fc024 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:08.019975 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c79db049-087b-4909-a549-6736de8fc024 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:08.243449 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c79db049-087b-4909-a549-6736de8fc024 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:16:08.259083 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c79db049-087b-4909-a549-6736de8fc024 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1689 microversion: 2.1 time: 0.264968 Aug 04 18:16:08.259961 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3756/7541] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:16:07 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1689 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:16:09.297251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-136faf7b-94c7-425c-9826-361e11cb90d8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:16:09.298050 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-136faf7b-94c7-425c-9826-361e11cb90d8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:16:09.306384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-136faf7b-94c7-425c-9826-361e11cb90d8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:09.306891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-136faf7b-94c7-425c-9826-361e11cb90d8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:09.307346 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-136faf7b-94c7-425c-9826-361e11cb90d8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:09.308073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-136faf7b-94c7-425c-9826-361e11cb90d8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:09.308557 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-136faf7b-94c7-425c-9826-361e11cb90d8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:09.308995 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-136faf7b-94c7-425c-9826-361e11cb90d8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:09.513795 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-136faf7b-94c7-425c-9826-361e11cb90d8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:16:09.528639 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-136faf7b-94c7-425c-9826-361e11cb90d8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1689 microversion: 2.1 time: 0.236956 Aug 04 18:16:09.529766 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3786/7542] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:16:09 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1689 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:16:10.556623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-65150cc0-36b3-4d05-981b-bc70d9f99d36 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:16:10.557566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-65150cc0-36b3-4d05-981b-bc70d9f99d36 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:16:10.566830 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65150cc0-36b3-4d05-981b-bc70d9f99d36 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:10.567755 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65150cc0-36b3-4d05-981b-bc70d9f99d36 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:10.568575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65150cc0-36b3-4d05-981b-bc70d9f99d36 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:10.569860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65150cc0-36b3-4d05-981b-bc70d9f99d36 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:10.570766 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65150cc0-36b3-4d05-981b-bc70d9f99d36 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:10.571564 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65150cc0-36b3-4d05-981b-bc70d9f99d36 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:10.789579 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-65150cc0-36b3-4d05-981b-bc70d9f99d36 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:16:10.800176 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-65150cc0-36b3-4d05-981b-bc70d9f99d36 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1689 microversion: 2.1 time: 0.247958 Aug 04 18:16:10.801130 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3757/7543] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:16:10 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1689 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:16:11.833791 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5d4dec58-0a6a-4196-b6dd-b74aa2f99cdb tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:16:11.834774 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5d4dec58-0a6a-4196-b6dd-b74aa2f99cdb tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:16:11.846466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d4dec58-0a6a-4196-b6dd-b74aa2f99cdb tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:11.847302 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d4dec58-0a6a-4196-b6dd-b74aa2f99cdb tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:11.847991 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d4dec58-0a6a-4196-b6dd-b74aa2f99cdb tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:11.849707 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d4dec58-0a6a-4196-b6dd-b74aa2f99cdb tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:11.850843 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d4dec58-0a6a-4196-b6dd-b74aa2f99cdb tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:11.851037 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5d4dec58-0a6a-4196-b6dd-b74aa2f99cdb tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:12.045076 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5d4dec58-0a6a-4196-b6dd-b74aa2f99cdb tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:16:12.054072 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5d4dec58-0a6a-4196-b6dd-b74aa2f99cdb tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1694 microversion: 2.1 time: 0.224844 Aug 04 18:16:12.054842 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3787/7544] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:16:11 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1694 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:16:13.077623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-036642ef-b9e1-49a3-901e-e071897d72a0 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:16:13.078508 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-036642ef-b9e1-49a3-901e-e071897d72a0 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:16:13.086727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-036642ef-b9e1-49a3-901e-e071897d72a0 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:13.087341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-036642ef-b9e1-49a3-901e-e071897d72a0 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:13.087859 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-036642ef-b9e1-49a3-901e-e071897d72a0 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:13.088707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-036642ef-b9e1-49a3-901e-e071897d72a0 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:13.089297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-036642ef-b9e1-49a3-901e-e071897d72a0 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:13.089780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-036642ef-b9e1-49a3-901e-e071897d72a0 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:13.304109 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-036642ef-b9e1-49a3-901e-e071897d72a0 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:16:13.315474 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-036642ef-b9e1-49a3-901e-e071897d72a0 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1694 microversion: 2.1 time: 0.241855 Aug 04 18:16:13.316412 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3758/7545] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:16:13 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1694 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:16:14.344392 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9083f54d-4cab-44a5-b52d-31b6e320737d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:16:14.345480 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9083f54d-4cab-44a5-b52d-31b6e320737d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:16:14.358662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9083f54d-4cab-44a5-b52d-31b6e320737d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:14.359190 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9083f54d-4cab-44a5-b52d-31b6e320737d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:14.360113 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9083f54d-4cab-44a5-b52d-31b6e320737d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:14.360423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9083f54d-4cab-44a5-b52d-31b6e320737d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:14.361216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9083f54d-4cab-44a5-b52d-31b6e320737d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:14.361905 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9083f54d-4cab-44a5-b52d-31b6e320737d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:14.594318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9083f54d-4cab-44a5-b52d-31b6e320737d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:16:14.607475 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9083f54d-4cab-44a5-b52d-31b6e320737d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1694 microversion: 2.1 time: 0.270257 Aug 04 18:16:14.608211 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3788/7546] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:16:14 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1694 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:16:15.636765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9b5a257c-3501-4516-b921-78493b22a292 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:16:15.637788 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9b5a257c-3501-4516-b921-78493b22a292 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:16:15.652506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b5a257c-3501-4516-b921-78493b22a292 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:15.654165 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b5a257c-3501-4516-b921-78493b22a292 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:15.655382 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b5a257c-3501-4516-b921-78493b22a292 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:15.657472 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b5a257c-3501-4516-b921-78493b22a292 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:15.658401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b5a257c-3501-4516-b921-78493b22a292 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:15.659676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b5a257c-3501-4516-b921-78493b22a292 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:15.913730 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9b5a257c-3501-4516-b921-78493b22a292 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:16:15.929364 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9b5a257c-3501-4516-b921-78493b22a292 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1694 microversion: 2.1 time: 0.301061 Aug 04 18:16:15.930597 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3759/7547] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:16:15 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1694 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:16:16.969297 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5c16a6b0-b6a5-4581-8ea5-54a5c865faf6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:16:16.970030 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5c16a6b0-b6a5-4581-8ea5-54a5c865faf6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:16:16.979126 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c16a6b0-b6a5-4581-8ea5-54a5c865faf6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:16.979640 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c16a6b0-b6a5-4581-8ea5-54a5c865faf6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:16.980098 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c16a6b0-b6a5-4581-8ea5-54a5c865faf6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:16.981094 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c16a6b0-b6a5-4581-8ea5-54a5c865faf6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:16.981573 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c16a6b0-b6a5-4581-8ea5-54a5c865faf6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:16.982040 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5c16a6b0-b6a5-4581-8ea5-54a5c865faf6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:17.157929 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5c16a6b0-b6a5-4581-8ea5-54a5c865faf6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:16:17.177526 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5c16a6b0-b6a5-4581-8ea5-54a5c865faf6 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1694 microversion: 2.1 time: 0.213575 Aug 04 18:16:17.178286 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3789/7548] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:16:16 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1694 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:16:18.202936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6f71dbf5-893d-4382-9d36-5f9185fd0741 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:16:18.204058 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6f71dbf5-893d-4382-9d36-5f9185fd0741 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:16:18.213774 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f71dbf5-893d-4382-9d36-5f9185fd0741 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:18.214615 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f71dbf5-893d-4382-9d36-5f9185fd0741 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:18.215332 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f71dbf5-893d-4382-9d36-5f9185fd0741 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:18.216349 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f71dbf5-893d-4382-9d36-5f9185fd0741 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:18.216972 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f71dbf5-893d-4382-9d36-5f9185fd0741 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:18.217428 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f71dbf5-893d-4382-9d36-5f9185fd0741 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:18.467388 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6f71dbf5-893d-4382-9d36-5f9185fd0741 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:16:18.480378 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6f71dbf5-893d-4382-9d36-5f9185fd0741 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1694 microversion: 2.1 time: 0.281878 Aug 04 18:16:18.481487 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3760/7549] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:16:18 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1694 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:16:19.520153 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-83fa17bf-e508-4617-9074-9f952e186b64 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:16:19.521164 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-83fa17bf-e508-4617-9074-9f952e186b64 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:16:19.532945 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83fa17bf-e508-4617-9074-9f952e186b64 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:19.533515 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83fa17bf-e508-4617-9074-9f952e186b64 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:19.534110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83fa17bf-e508-4617-9074-9f952e186b64 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:19.535087 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83fa17bf-e508-4617-9074-9f952e186b64 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:19.536018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83fa17bf-e508-4617-9074-9f952e186b64 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:19.537103 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-83fa17bf-e508-4617-9074-9f952e186b64 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:19.803521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-83fa17bf-e508-4617-9074-9f952e186b64 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:16:19.815797 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-83fa17bf-e508-4617-9074-9f952e186b64 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1694 microversion: 2.1 time: 0.300453 Aug 04 18:16:19.816881 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3790/7550] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:16:19 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1694 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:16:20.852682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cc37d7c0-38ae-4096-af7b-443a09af87c8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:16:20.857222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cc37d7c0-38ae-4096-af7b-443a09af87c8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:16:20.863430 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc37d7c0-38ae-4096-af7b-443a09af87c8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:20.864029 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc37d7c0-38ae-4096-af7b-443a09af87c8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:20.864739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc37d7c0-38ae-4096-af7b-443a09af87c8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:20.865646 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc37d7c0-38ae-4096-af7b-443a09af87c8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:20.866248 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc37d7c0-38ae-4096-af7b-443a09af87c8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:20.866752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc37d7c0-38ae-4096-af7b-443a09af87c8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:21.062837 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cc37d7c0-38ae-4096-af7b-443a09af87c8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:16:21.077906 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cc37d7c0-38ae-4096-af7b-443a09af87c8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1694 microversion: 2.1 time: 0.232183 Aug 04 18:16:21.079149 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3761/7551] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:16:20 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1694 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:16:22.106141 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-041edb7a-deea-41f8-80eb-e8746763b561 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:16:22.107082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-041edb7a-deea-41f8-80eb-e8746763b561 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:16:22.115801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-041edb7a-deea-41f8-80eb-e8746763b561 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:22.116384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-041edb7a-deea-41f8-80eb-e8746763b561 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:22.116930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-041edb7a-deea-41f8-80eb-e8746763b561 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:22.117711 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-041edb7a-deea-41f8-80eb-e8746763b561 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:22.118339 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-041edb7a-deea-41f8-80eb-e8746763b561 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:22.118784 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-041edb7a-deea-41f8-80eb-e8746763b561 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:22.320077 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-041edb7a-deea-41f8-80eb-e8746763b561 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:16:22.329238 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-041edb7a-deea-41f8-80eb-e8746763b561 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1694 microversion: 2.1 time: 0.230302 Aug 04 18:16:22.330063 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3791/7552] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:16:22 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1694 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:16:23.372954 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4eefa05e-29be-4dce-bd6c-da634354a64e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:16:23.374128 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4eefa05e-29be-4dce-bd6c-da634354a64e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:16:23.386368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4eefa05e-29be-4dce-bd6c-da634354a64e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:23.387243 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4eefa05e-29be-4dce-bd6c-da634354a64e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:23.388023 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4eefa05e-29be-4dce-bd6c-da634354a64e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:23.389237 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4eefa05e-29be-4dce-bd6c-da634354a64e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:23.390006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4eefa05e-29be-4dce-bd6c-da634354a64e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:23.390698 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4eefa05e-29be-4dce-bd6c-da634354a64e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:23.671390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4eefa05e-29be-4dce-bd6c-da634354a64e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:16:23.686792 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4eefa05e-29be-4dce-bd6c-da634354a64e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1694 microversion: 2.1 time: 0.320891 Aug 04 18:16:23.689606 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3762/7553] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:16:23 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1694 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:16:24.680439 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-fd68f8e6-f9c6-4103-ace0-32c3e08c318c req-4b0b97db-c7dc-417f-adc2-fbd26d70cf11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16c74e8e-a570-45a8-9a64-dc7cd1fa4810", "name": "network-vif-unplugged", "status": "completed", "tag": "c2ab9090-43e7-4d4b-9d01-01390b9ff1b1"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:16:24.698831 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-fd68f8e6-f9c6-4103-ace0-32c3e08c318c req-4b0b97db-c7dc-417f-adc2-fbd26d70cf11 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:24.699382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-fd68f8e6-f9c6-4103-ace0-32c3e08c318c req-4b0b97db-c7dc-417f-adc2-fbd26d70cf11 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:24.699940 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-fd68f8e6-f9c6-4103-ace0-32c3e08c318c req-4b0b97db-c7dc-417f-adc2-fbd26d70cf11 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:24.720553 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-fd68f8e6-f9c6-4103-ace0-32c3e08c318c req-4b0b97db-c7dc-417f-adc2-fbd26d70cf11 service nova] Creating event network-vif-unplugged:c2ab9090-43e7-4d4b-9d01-01390b9ff1b1 for instance 16c74e8e-a570-45a8-9a64-dc7cd1fa4810 on n-h2-851359-3 Aug 04 18:16:24.729081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1c8f4161-34b2-4981-97e4-92b1556568c9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:16:24.729951 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [req-fd68f8e6-f9c6-4103-ace0-32c3e08c318c req-4b0b97db-c7dc-417f-adc2-fbd26d70cf11 service nova] Instance 16c74e8e-a570-45a8-9a64-dc7cd1fa4810 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131043) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 18:16:24.732033 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1c8f4161-34b2-4981-97e4-92b1556568c9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:16:24.747910 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-fd68f8e6-f9c6-4103-ace0-32c3e08c318c req-4b0b97db-c7dc-417f-adc2-fbd26d70cf11 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072214 Aug 04 18:16:24.748692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c8f4161-34b2-4981-97e4-92b1556568c9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:24.748940 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3792/7554] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:16:24.749713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c8f4161-34b2-4981-97e4-92b1556568c9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:24.750837 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c8f4161-34b2-4981-97e4-92b1556568c9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:24.752190 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c8f4161-34b2-4981-97e4-92b1556568c9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:24.753040 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c8f4161-34b2-4981-97e4-92b1556568c9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:24.753821 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c8f4161-34b2-4981-97e4-92b1556568c9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:25.249592 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1c8f4161-34b2-4981-97e4-92b1556568c9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:16:25.265627 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1c8f4161-34b2-4981-97e4-92b1556568c9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1693 microversion: 2.1 time: 0.544078 Aug 04 18:16:25.267070 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3763/7555] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:16:24 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1693 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:16:26.310926 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cbd5b682-5622-4e61-8b82-4709897abbea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:16:26.312071 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cbd5b682-5622-4e61-8b82-4709897abbea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:16:26.323463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cbd5b682-5622-4e61-8b82-4709897abbea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:26.324165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cbd5b682-5622-4e61-8b82-4709897abbea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:26.324917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cbd5b682-5622-4e61-8b82-4709897abbea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:26.325874 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cbd5b682-5622-4e61-8b82-4709897abbea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:26.326654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cbd5b682-5622-4e61-8b82-4709897abbea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:26.327251 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cbd5b682-5622-4e61-8b82-4709897abbea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:26.585997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cbd5b682-5622-4e61-8b82-4709897abbea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:16:26.597290 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cbd5b682-5622-4e61-8b82-4709897abbea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1693 microversion: 2.1 time: 0.295100 Aug 04 18:16:26.598117 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3793/7556] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:16:26 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1693 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:16:26.778229 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-4b0535f2-bfa5-4455-ae21-0ea617ed934b req-ee3ca499-2c92-4492-9489-aea41b54457b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16c74e8e-a570-45a8-9a64-dc7cd1fa4810", "tag": "c2ab9090-43e7-4d4b-9d01-01390b9ff1b1"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:16:26.797441 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4b0535f2-bfa5-4455-ae21-0ea617ed934b req-ee3ca499-2c92-4492-9489-aea41b54457b service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:26.798356 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4b0535f2-bfa5-4455-ae21-0ea617ed934b req-ee3ca499-2c92-4492-9489-aea41b54457b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:26.799113 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4b0535f2-bfa5-4455-ae21-0ea617ed934b req-ee3ca499-2c92-4492-9489-aea41b54457b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:26.825076 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-4b0535f2-bfa5-4455-ae21-0ea617ed934b req-ee3ca499-2c92-4492-9489-aea41b54457b service nova] Creating event network-changed:c2ab9090-43e7-4d4b-9d01-01390b9ff1b1 for instance 16c74e8e-a570-45a8-9a64-dc7cd1fa4810 on n-h2-851359-3 Aug 04 18:16:26.837137 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-4b0535f2-bfa5-4455-ae21-0ea617ed934b req-ee3ca499-2c92-4492-9489-aea41b54457b service nova] Instance 16c74e8e-a570-45a8-9a64-dc7cd1fa4810 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851359-3', 'n-h2-851359-3'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 04 18:16:26.859951 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-4b0535f2-bfa5-4455-ae21-0ea617ed934b req-ee3ca499-2c92-4492-9489-aea41b54457b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085671 Aug 04 18:16:26.861018 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3764/7557] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:16:27.628572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b3ec1343-fb3f-4270-98ae-5744cbca833b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:16:27.630386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b3ec1343-fb3f-4270-98ae-5744cbca833b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:16:27.643197 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3ec1343-fb3f-4270-98ae-5744cbca833b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:27.644529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3ec1343-fb3f-4270-98ae-5744cbca833b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:27.645329 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3ec1343-fb3f-4270-98ae-5744cbca833b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:27.647347 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3ec1343-fb3f-4270-98ae-5744cbca833b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:27.648355 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3ec1343-fb3f-4270-98ae-5744cbca833b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:27.649142 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b3ec1343-fb3f-4270-98ae-5744cbca833b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:27.878590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b3ec1343-fb3f-4270-98ae-5744cbca833b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:16:27.892273 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b3ec1343-fb3f-4270-98ae-5744cbca833b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1691 microversion: 2.1 time: 0.271215 Aug 04 18:16:27.893199 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3794/7558] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:16:27 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1691 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:16:28.924221 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bd18b693-562f-4e59-80dc-7daf828b2c09 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:16:28.925382 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bd18b693-562f-4e59-80dc-7daf828b2c09 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:16:28.935320 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd18b693-562f-4e59-80dc-7daf828b2c09 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:28.935841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd18b693-562f-4e59-80dc-7daf828b2c09 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:28.936303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd18b693-562f-4e59-80dc-7daf828b2c09 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:28.937054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd18b693-562f-4e59-80dc-7daf828b2c09 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:28.937520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd18b693-562f-4e59-80dc-7daf828b2c09 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:28.938200 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd18b693-562f-4e59-80dc-7daf828b2c09 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:29.166741 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bd18b693-562f-4e59-80dc-7daf828b2c09 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:16:29.175942 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bd18b693-562f-4e59-80dc-7daf828b2c09 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1691 microversion: 2.1 time: 0.258763 Aug 04 18:16:29.176446 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3765/7559] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:16:28 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1691 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:16:30.211556 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9fd5db59-b325-41d9-9d77-d1272e725331 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:16:30.213824 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9fd5db59-b325-41d9-9d77-d1272e725331 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:16:30.222918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9fd5db59-b325-41d9-9d77-d1272e725331 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:30.223398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9fd5db59-b325-41d9-9d77-d1272e725331 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:30.224393 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9fd5db59-b325-41d9-9d77-d1272e725331 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:30.225501 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9fd5db59-b325-41d9-9d77-d1272e725331 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:30.226277 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9fd5db59-b325-41d9-9d77-d1272e725331 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:30.226804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9fd5db59-b325-41d9-9d77-d1272e725331 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:30.432329 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9fd5db59-b325-41d9-9d77-d1272e725331 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:16:30.444166 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9fd5db59-b325-41d9-9d77-d1272e725331 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1688 microversion: 2.1 time: 0.239745 Aug 04 18:16:30.444859 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3795/7560] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:16:30 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1688 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:16:30.468358 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-41a0d61b-b40b-433d-bc4c-c9983ade5af1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:16:30.469216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-41a0d61b-b40b-433d-bc4c-c9983ade5af1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:16:30.481761 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41a0d61b-b40b-433d-bc4c-c9983ade5af1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:30.482724 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41a0d61b-b40b-433d-bc4c-c9983ade5af1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:30.483436 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41a0d61b-b40b-433d-bc4c-c9983ade5af1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:30.484455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41a0d61b-b40b-433d-bc4c-c9983ade5af1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:30.485239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41a0d61b-b40b-433d-bc4c-c9983ade5af1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:30.485860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41a0d61b-b40b-433d-bc4c-c9983ade5af1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:30.575225 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-41a0d61b-b40b-433d-bc4c-c9983ade5af1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "POST /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810/action" status: 204 len: 0 microversion: 2.1 time: 0.111208 Aug 04 18:16:30.578139 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3766/7561] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:16:30 2022] POST /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810/action => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 18:16:30.587727 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a376cc25-0e52-4349-a9c6-aae87497ced7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:16:30.588854 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a376cc25-0e52-4349-a9c6-aae87497ced7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:16:30.600611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a376cc25-0e52-4349-a9c6-aae87497ced7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:30.601273 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a376cc25-0e52-4349-a9c6-aae87497ced7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:30.601952 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a376cc25-0e52-4349-a9c6-aae87497ced7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:30.602897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a376cc25-0e52-4349-a9c6-aae87497ced7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:30.603832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a376cc25-0e52-4349-a9c6-aae87497ced7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:30.603968 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a376cc25-0e52-4349-a9c6-aae87497ced7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:30.889915 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a376cc25-0e52-4349-a9c6-aae87497ced7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:16:30.906263 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a376cc25-0e52-4349-a9c6-aae87497ced7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1688 microversion: 2.1 time: 0.324729 Aug 04 18:16:30.907606 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3796/7562] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:16:30 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1688 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:16:30.949271 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-394d8bb9-ac4e-4fcb-93fc-24c2891b9a4a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:16:30.951217 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-394d8bb9-ac4e-4fcb-93fc-24c2891b9a4a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:16:30.964685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-394d8bb9-ac4e-4fcb-93fc-24c2891b9a4a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:30.966110 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-394d8bb9-ac4e-4fcb-93fc-24c2891b9a4a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:30.967259 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-394d8bb9-ac4e-4fcb-93fc-24c2891b9a4a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:30.968911 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-394d8bb9-ac4e-4fcb-93fc-24c2891b9a4a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:30.970063 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-394d8bb9-ac4e-4fcb-93fc-24c2891b9a4a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:30.971146 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-394d8bb9-ac4e-4fcb-93fc-24c2891b9a4a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:31.270856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-394d8bb9-ac4e-4fcb-93fc-24c2891b9a4a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:16:31.290112 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-394d8bb9-ac4e-4fcb-93fc-24c2891b9a4a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1688 microversion: 2.1 time: 0.349499 Aug 04 18:16:31.291009 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3767/7563] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:16:30 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1688 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:16:32.319585 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d62d93c8-93c8-42ac-8a04-aa76685cbe30 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:16:32.320521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d62d93c8-93c8-42ac-8a04-aa76685cbe30 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:16:32.330389 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d62d93c8-93c8-42ac-8a04-aa76685cbe30 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:32.331086 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d62d93c8-93c8-42ac-8a04-aa76685cbe30 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:32.331692 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d62d93c8-93c8-42ac-8a04-aa76685cbe30 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:32.333401 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d62d93c8-93c8-42ac-8a04-aa76685cbe30 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:32.334330 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d62d93c8-93c8-42ac-8a04-aa76685cbe30 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:32.334925 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d62d93c8-93c8-42ac-8a04-aa76685cbe30 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:32.603025 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d62d93c8-93c8-42ac-8a04-aa76685cbe30 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:16:32.618496 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d62d93c8-93c8-42ac-8a04-aa76685cbe30 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1688 microversion: 2.1 time: 0.303045 Aug 04 18:16:32.619247 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3797/7564] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:16:32 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1688 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:16:33.073854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-9181b996-7bba-427b-ac17-ee32f0d68589 req-9edd59f5-2f39-4858-a035-cdd6930c922c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16c74e8e-a570-45a8-9a64-dc7cd1fa4810", "name": "network-vif-plugged", "status": "completed", "tag": "c2ab9090-43e7-4d4b-9d01-01390b9ff1b1"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:16:33.088052 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9181b996-7bba-427b-ac17-ee32f0d68589 req-9edd59f5-2f39-4858-a035-cdd6930c922c service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:33.088687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9181b996-7bba-427b-ac17-ee32f0d68589 req-9edd59f5-2f39-4858-a035-cdd6930c922c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:33.089379 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9181b996-7bba-427b-ac17-ee32f0d68589 req-9edd59f5-2f39-4858-a035-cdd6930c922c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:33.106967 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-9181b996-7bba-427b-ac17-ee32f0d68589 req-9edd59f5-2f39-4858-a035-cdd6930c922c service nova] Creating event network-vif-plugged:c2ab9090-43e7-4d4b-9d01-01390b9ff1b1 for instance 16c74e8e-a570-45a8-9a64-dc7cd1fa4810 on n-h2-851359-3 Aug 04 18:16:33.115806 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-9181b996-7bba-427b-ac17-ee32f0d68589 req-9edd59f5-2f39-4858-a035-cdd6930c922c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136121 Aug 04 18:16:33.116934 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3768/7565] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:16:33.655146 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-57f2f11f-7ea9-44cc-95ea-be62784fa146 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:16:33.656135 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-57f2f11f-7ea9-44cc-95ea-be62784fa146 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:16:33.666808 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57f2f11f-7ea9-44cc-95ea-be62784fa146 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:33.667348 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57f2f11f-7ea9-44cc-95ea-be62784fa146 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:33.667830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57f2f11f-7ea9-44cc-95ea-be62784fa146 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:33.668623 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57f2f11f-7ea9-44cc-95ea-be62784fa146 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:16:33.669134 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57f2f11f-7ea9-44cc-95ea-be62784fa146 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:16:33.669590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-57f2f11f-7ea9-44cc-95ea-be62784fa146 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:16:33.922720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-57f2f11f-7ea9-44cc-95ea-be62784fa146 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:16:33.931569 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-57f2f11f-7ea9-44cc-95ea-be62784fa146 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1680 microversion: 2.1 time: 0.283006 Aug 04 18:16:33.932259 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3798/7566] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:16:33 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1680 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:17:04.246278 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=34 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:17:04.247172 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:17:04.255556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-afc1136a-e061-4138-b584-cf14cf903203 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:17:04.258840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-afc1136a-e061-4138-b584-cf14cf903203 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:17:04.272849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-afc1136a-e061-4138-b584-cf14cf903203 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:17:04.273748 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-afc1136a-e061-4138-b584-cf14cf903203 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:17:04.274622 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-afc1136a-e061-4138-b584-cf14cf903203 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:17:04.275931 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-afc1136a-e061-4138-b584-cf14cf903203 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:17:04.276792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-afc1136a-e061-4138-b584-cf14cf903203 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:17:04.277614 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-afc1136a-e061-4138-b584-cf14cf903203 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:17:04.374876 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-afc1136a-e061-4138-b584-cf14cf903203 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "POST /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810/action" status: 200 len: 24575 microversion: 2.1 time: 0.129861 Aug 04 18:17:04.376044 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3769/7567] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:17:04 2022] POST /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810/action => generated 24575 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 18:17:28.813555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6f3ea155-8369-42a2-a115-d81df34a2f8c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:17:28.814834 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6f3ea155-8369-42a2-a115-d81df34a2f8c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:17:28.817681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=30 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:17:28.818452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=88 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:17:28.821819 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:17:28.823487 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:17:28.825486 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f3ea155-8369-42a2-a115-d81df34a2f8c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:17:28.826825 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f3ea155-8369-42a2-a115-d81df34a2f8c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:17:28.827519 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f3ea155-8369-42a2-a115-d81df34a2f8c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:17:28.828507 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f3ea155-8369-42a2-a115-d81df34a2f8c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:17:28.829210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f3ea155-8369-42a2-a115-d81df34a2f8c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:17:28.829869 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6f3ea155-8369-42a2-a115-d81df34a2f8c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:17:28.863024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6f3ea155-8369-42a2-a115-d81df34a2f8c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 18:17:28.938266 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-913e26ae-90c7-4474-ba65-6c9887a5efc5 req-1b7963c4-0514-46a6-9b2d-eacdc25d51b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16c74e8e-a570-45a8-9a64-dc7cd1fa4810", "tag": "c2ab9090-43e7-4d4b-9d01-01390b9ff1b1"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:17:28.952812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-913e26ae-90c7-4474-ba65-6c9887a5efc5 req-1b7963c4-0514-46a6-9b2d-eacdc25d51b1 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:17:28.953876 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-913e26ae-90c7-4474-ba65-6c9887a5efc5 req-1b7963c4-0514-46a6-9b2d-eacdc25d51b1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:17:28.954786 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-913e26ae-90c7-4474-ba65-6c9887a5efc5 req-1b7963c4-0514-46a6-9b2d-eacdc25d51b1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:17:28.978926 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-913e26ae-90c7-4474-ba65-6c9887a5efc5 req-1b7963c4-0514-46a6-9b2d-eacdc25d51b1 service nova] Creating event network-changed:c2ab9090-43e7-4d4b-9d01-01390b9ff1b1 for instance 16c74e8e-a570-45a8-9a64-dc7cd1fa4810 on n-h2-851359-3 Aug 04 18:17:28.989469 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-913e26ae-90c7-4474-ba65-6c9887a5efc5 req-1b7963c4-0514-46a6-9b2d-eacdc25d51b1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175097 Aug 04 18:17:28.990224 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6f3ea155-8369-42a2-a115-d81df34a2f8c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "DELETE /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 204 len: 0 microversion: 2.1 time: 0.179938 Aug 04 18:17:28.991291 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3799/7568] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 18:17:28 2022] DELETE /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 18:17:28.992285 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3770/7569] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:17:29.007515 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-32c83865-c2fa-4953-a89d-bd22fd2d055b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:17:29.008781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-32c83865-c2fa-4953-a89d-bd22fd2d055b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:17:29.020255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32c83865-c2fa-4953-a89d-bd22fd2d055b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:17:29.021172 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32c83865-c2fa-4953-a89d-bd22fd2d055b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:17:29.022038 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32c83865-c2fa-4953-a89d-bd22fd2d055b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:17:29.023398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32c83865-c2fa-4953-a89d-bd22fd2d055b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:17:29.024283 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32c83865-c2fa-4953-a89d-bd22fd2d055b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:17:29.025099 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-32c83865-c2fa-4953-a89d-bd22fd2d055b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:17:29.243013 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-32c83865-c2fa-4953-a89d-bd22fd2d055b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:17:29.251784 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-32c83865-c2fa-4953-a89d-bd22fd2d055b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1686 microversion: 2.1 time: 0.252951 Aug 04 18:17:29.252395 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3800/7570] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:17:28 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1686 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:17:30.278994 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c38f542f-eaa9-4c0b-8920-70d10392ea0f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:17:30.280171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c38f542f-eaa9-4c0b-8920-70d10392ea0f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:17:30.289374 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c38f542f-eaa9-4c0b-8920-70d10392ea0f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:17:30.290274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c38f542f-eaa9-4c0b-8920-70d10392ea0f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:17:30.291087 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c38f542f-eaa9-4c0b-8920-70d10392ea0f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:17:30.292689 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c38f542f-eaa9-4c0b-8920-70d10392ea0f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:17:30.293550 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c38f542f-eaa9-4c0b-8920-70d10392ea0f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:17:30.294398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c38f542f-eaa9-4c0b-8920-70d10392ea0f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:17:30.478037 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c38f542f-eaa9-4c0b-8920-70d10392ea0f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:17:30.488220 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c38f542f-eaa9-4c0b-8920-70d10392ea0f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1686 microversion: 2.1 time: 0.215567 Aug 04 18:17:30.488962 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3771/7571] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:17:30 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1686 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:17:31.389748 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-875c30b6-9430-48e1-9580-4df94bf75db9 req-0d0baaf4-b859-45e9-b00e-458e8a5a88fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16c74e8e-a570-45a8-9a64-dc7cd1fa4810", "name": "network-vif-deleted", "tag": "c2ab9090-43e7-4d4b-9d01-01390b9ff1b1"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:17:31.409945 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-875c30b6-9430-48e1-9580-4df94bf75db9 req-0d0baaf4-b859-45e9-b00e-458e8a5a88fe service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:17:31.410528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-875c30b6-9430-48e1-9580-4df94bf75db9 req-0d0baaf4-b859-45e9-b00e-458e8a5a88fe service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:17:31.411070 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-875c30b6-9430-48e1-9580-4df94bf75db9 req-0d0baaf4-b859-45e9-b00e-458e8a5a88fe service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:17:31.434391 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-875c30b6-9430-48e1-9580-4df94bf75db9 req-0d0baaf4-b859-45e9-b00e-458e8a5a88fe service nova] Creating event network-vif-deleted:c2ab9090-43e7-4d4b-9d01-01390b9ff1b1 for instance 16c74e8e-a570-45a8-9a64-dc7cd1fa4810 on n-h2-851359-3 Aug 04 18:17:31.445467 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-875c30b6-9430-48e1-9580-4df94bf75db9 req-0d0baaf4-b859-45e9-b00e-458e8a5a88fe service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063003 Aug 04 18:17:31.446622 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3801/7572] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:17:31.513907 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3883dff9-c649-4416-ae25-13de9bfe2b2f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:17:31.514945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3883dff9-c649-4416-ae25-13de9bfe2b2f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:17:31.525025 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3883dff9-c649-4416-ae25-13de9bfe2b2f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:17:31.525578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3883dff9-c649-4416-ae25-13de9bfe2b2f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:17:31.526058 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3883dff9-c649-4416-ae25-13de9bfe2b2f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:17:31.526816 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3883dff9-c649-4416-ae25-13de9bfe2b2f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:17:31.527297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3883dff9-c649-4416-ae25-13de9bfe2b2f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:17:31.527744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3883dff9-c649-4416-ae25-13de9bfe2b2f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:17:31.569526 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3883dff9-c649-4416-ae25-13de9bfe2b2f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:17:31.569943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3883dff9-c649-4416-ae25-13de9bfe2b2f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:17:31.570525 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3883dff9-c649-4416-ae25-13de9bfe2b2f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:17:31.571204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-3883dff9-c649-4416-ae25-13de9bfe2b2f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lazy-loading 'fault' on Instance uuid 16c74e8e-a570-45a8-9a64-dc7cd1fa4810 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 18:17:31.635036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3883dff9-c649-4416-ae25-13de9bfe2b2f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:17:31.647888 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3883dff9-c649-4416-ae25-13de9bfe2b2f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 200 len: 1355 microversion: 2.1 time: 0.138826 Aug 04 18:17:31.648646 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3772/7573] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:17:31 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 1355 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:17:32.674440 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cf283ab9-fb38-4e8c-aa3d-41dfcfeba614 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:17:32.675556 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cf283ab9-fb38-4e8c-aa3d-41dfcfeba614 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 16c74e8e-a570-45a8-9a64-dc7cd1fa4810] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:17:32.682525 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cf283ab9-fb38-4e8c-aa3d-41dfcfeba614 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:17:32.683584 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cf283ab9-fb38-4e8c-aa3d-41dfcfeba614 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:17:32.684106 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cf283ab9-fb38-4e8c-aa3d-41dfcfeba614 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:17:32.684896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cf283ab9-fb38-4e8c-aa3d-41dfcfeba614 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:17:32.685408 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cf283ab9-fb38-4e8c-aa3d-41dfcfeba614 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:17:32.685997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cf283ab9-fb38-4e8c-aa3d-41dfcfeba614 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:17:32.702388 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-cf283ab9-fb38-4e8c-aa3d-41dfcfeba614 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] HTTP exception thrown: Instance 16c74e8e-a570-45a8-9a64-dc7cd1fa4810 could not be found. Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cf283ab9-fb38-4e8c-aa3d-41dfcfeba614 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Request method failure captured: Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 HTTP/1.1 Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7AwIjCsovibYcH6ErWxGJedA-SXylLsKvn2zpdpI2y0HfanfgcItDr2cHF1i3ynCG5lmDiVO7c8mMcbqfLpue1bmLw9gTl9Y1GTYLYZrG8HdwuvNirSZtowkucGnoPRO0LnscJrHruNXZPpdU2GfZAeK3oRPo9VtZizbrtXsNeEIQOc Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: ca6f9f1c52b34546af469a9d43d466db Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-103139372 Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca6f9f1c52b34546af469a9d43d466db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca6f9f1c52b34546af469a9d43d466db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ca6f9f1c52b34546af469a9d43d466db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ca6f9f1c52b34546af469a9d43d466db"}]}] Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-TestNetworkAdvancedServerOps-103139372 Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: ca6f9f1c52b34546af469a9d43d466db Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-103139372 Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-TestNetworkAdvancedServerOps-103139372-project Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 35ad5b583f7f49e0b36ea7d3d75c9a20 Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-TestNetworkAdvancedServerOps-103139372-project Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 16c74e8e-a570-45a8-9a64-dc7cd1fa4810 could not be found. Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '16c74e8e-a570-45a8-9a64-dc7cd1fa4810'} Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16c74e8e-a570-45a8-9a64-dc7cd1fa4810 could not be found. Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16c74e8e-a570-45a8-9a64-dc7cd1fa4810 could not be found. Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:17:32.704111 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:17:32.710775 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:17:32.710775 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:17:32.710775 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:17:32.710775 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:17:32.710775 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:17:32.710775 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:17:32.710775 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16c74e8e-a570-45a8-9a64-dc7cd1fa4810 could not be found. Aug 04 18:17:32.710775 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:17:32.710775 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cf283ab9-fb38-4e8c-aa3d-41dfcfeba614 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Returning 404 to user: Instance 16c74e8e-a570-45a8-9a64-dc7cd1fa4810 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:17:32.710775 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cf283ab9-fb38-4e8c-aa3d-41dfcfeba614 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810" status: 404 len: 111 microversion: 2.1 time: 0.037247 Aug 04 18:17:32.710775 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3802/7574] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:17:32 2022] GET /compute/v2.1/servers/16c74e8e-a570-45a8-9a64-dc7cd1fa4810 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 18:17:37.401770 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c42bd779-e6e0-4a5c-9400-7599ac3b01bf tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '.version_select at 0x7f1e5a2c88b0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:17:37.410573 n-d-851359-3 devstack@n-api.service[131044]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c42bd779-e6e0-4a5c-9400-7599ac3b01bf tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [8b372e9a-1066-428b-b8fc-8e48f034e6de] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 18:17:38.424139 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [None req-c42bd779-e6e0-4a5c-9400-7599ac3b01bf tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [8b372e9a-1066-428b-b8fc-8e48f034e6de] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 58572. Aug 04 18:17:38.460618 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c42bd779-e6e0-4a5c-9400-7599ac3b01bf tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1380910720" status: 202 len: 0 microversion: 2.1 time: 1.066993 Aug 04 18:17:38.461598 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3773/7575] 10.222.0.93 () {58 vars in 1284 bytes} [Thu Aug 4 18:17:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1380910720 => generated 0 bytes in 1069 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 18:17:38.505643 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8af9999a-543c-4f6c-a734-e4b70ed458c7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Action: 'create', calling method: .version_select at 0x7f1e5ab64f70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1631690017", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTUuJPSGC2wELgut25wEZVXY2k6IgffgEKzx3QuW2CTPAuU8NfSBVcsDzY40kH5LqHMHRKTuJfD+AOMXd9vRubAe0Qdbni3HZ8Gua72RJzu13GxPd6MXTbYRPCYwy82hA=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:17:38.528347 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-8af9999a-543c-4f6c-a734-e4b70ed458c7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Getting quotas for project ca6f9f1c52b34546af469a9d43d466db. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 18:17:38.536082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-8af9999a-543c-4f6c-a734-e4b70ed458c7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Getting quotas for user 35ad5b583f7f49e0b36ea7d3d75c9a20 and project ca6f9f1c52b34546af469a9d43d466db. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 18:17:38.553163 n-d-851359-3 devstack@n-api.service[131043]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8af9999a-543c-4f6c-a734-e4b70ed458c7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [816f81a5-216e-4d76-a74c-6e2877133428] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 18:17:39.561926 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [None req-8af9999a-543c-4f6c-a734-e4b70ed458c7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [816f81a5-216e-4d76-a74c-6e2877133428] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 58576. Aug 04 18:17:39.586028 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8af9999a-543c-4f6c-a734-e4b70ed458c7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.084569 Aug 04 18:17:39.586958 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3803/7576] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 18:17:38 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:17:48.418535 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=16 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:17:48.429803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-96b87647-5c48-4e8e-ab6f-012e576f587c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1096343877", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "63dd7c9e-cf7d-44d2-8692-33720a4c0b83"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1631690017", "security_groups": [{"name": "tempest-secgroup-smoke-602644057"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:17:49.065043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-96b87647-5c48-4e8e-ab6f-012e576f587c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] validate_networks() for [('63dd7c9e-cf7d-44d2-8692-33720a4c0b83', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 18:17:49.642829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-96b87647-5c48-4e8e-ab6f-012e576f587c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 18:17:49.644388 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-96b87647-5c48-4e8e-ab6f-012e576f587c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 18:17:49.644388 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-96b87647-5c48-4e8e-ab6f-012e576f587c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 18:17:49.644719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-96b87647-5c48-4e8e-ab6f-012e576f587c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 18:17:49.645914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-96b87647-5c48-4e8e-ab6f-012e576f587c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 18:17:49.666602 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96b87647-5c48-4e8e-ab6f-012e576f587c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:17:49.667501 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96b87647-5c48-4e8e-ab6f-012e576f587c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:17:49.668327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96b87647-5c48-4e8e-ab6f-012e576f587c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:17:49.669845 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96b87647-5c48-4e8e-ab6f-012e576f587c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:17:49.670721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96b87647-5c48-4e8e-ab6f-012e576f587c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:17:49.671470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96b87647-5c48-4e8e-ab6f-012e576f587c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:17:49.703839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-96b87647-5c48-4e8e-ab6f-012e576f587c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Getting quotas for project ca6f9f1c52b34546af469a9d43d466db. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 18:17:49.715566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-96b87647-5c48-4e8e-ab6f-012e576f587c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Getting quotas for user 35ad5b583f7f49e0b36ea7d3d75c9a20 and project ca6f9f1c52b34546af469a9d43d466db. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 18:17:49.741388 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-96b87647-5c48-4e8e-ab6f-012e576f587c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 18:17:49.744617 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-96b87647-5c48-4e8e-ab6f-012e576f587c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 18:17:49.820222 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-96b87647-5c48-4e8e-ab6f-012e576f587c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.405199 Aug 04 18:17:49.822981 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3774/7577] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 18:17:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 1408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 18:17:49.841739 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2a4bca7a-6f84-4bbb-877d-7c7c6c649bf8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:17:49.842891 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2a4bca7a-6f84-4bbb-877d-7c7c6c649bf8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:17:49.860555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:17:49.865427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=4 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:17:49.865427 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:17:49.962255 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2a4bca7a-6f84-4bbb-877d-7c7c6c649bf8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:17:49.972950 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2a4bca7a-6f84-4bbb-877d-7c7c6c649bf8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 200 len: 1267 microversion: 2.1 time: 0.136230 Aug 04 18:17:49.974030 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3804/7578] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:17:49 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 1267 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:17:51.011408 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0a3a5dac-4992-4ff4-89ce-69d436c1479a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:17:51.013598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0a3a5dac-4992-4ff4-89ce-69d436c1479a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:17:51.027022 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a3a5dac-4992-4ff4-89ce-69d436c1479a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:17:51.028022 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a3a5dac-4992-4ff4-89ce-69d436c1479a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:17:51.028897 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a3a5dac-4992-4ff4-89ce-69d436c1479a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:17:51.030407 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a3a5dac-4992-4ff4-89ce-69d436c1479a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:17:51.031341 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a3a5dac-4992-4ff4-89ce-69d436c1479a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:17:51.032160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a3a5dac-4992-4ff4-89ce-69d436c1479a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:17:51.178889 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0a3a5dac-4992-4ff4-89ce-69d436c1479a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:17:51.188203 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0a3a5dac-4992-4ff4-89ce-69d436c1479a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 200 len: 1319 microversion: 2.1 time: 0.184463 Aug 04 18:17:51.188796 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3775/7579] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:17:51 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:17:52.217240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3d6d203c-3299-415d-a955-bda6755b74de tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:17:52.218328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3d6d203c-3299-415d-a955-bda6755b74de tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:17:52.231547 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d6d203c-3299-415d-a955-bda6755b74de tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:17:52.233127 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d6d203c-3299-415d-a955-bda6755b74de tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:17:52.234088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d6d203c-3299-415d-a955-bda6755b74de tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:17:52.235836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d6d203c-3299-415d-a955-bda6755b74de tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:17:52.236799 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d6d203c-3299-415d-a955-bda6755b74de tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:17:52.238383 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3d6d203c-3299-415d-a955-bda6755b74de tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:17:52.332705 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3d6d203c-3299-415d-a955-bda6755b74de tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:17:52.342291 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3d6d203c-3299-415d-a955-bda6755b74de tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 200 len: 1325 microversion: 2.1 time: 0.129626 Aug 04 18:17:52.350327 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3805/7580] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:17:52 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 1325 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:17:53.372221 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a02509a3-dba2-4469-9d6d-34e784b59d64 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:17:53.373601 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a02509a3-dba2-4469-9d6d-34e784b59d64 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:17:53.384021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a02509a3-dba2-4469-9d6d-34e784b59d64 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:17:53.384538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a02509a3-dba2-4469-9d6d-34e784b59d64 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:17:53.384991 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a02509a3-dba2-4469-9d6d-34e784b59d64 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:17:53.385900 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a02509a3-dba2-4469-9d6d-34e784b59d64 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:17:53.386509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a02509a3-dba2-4469-9d6d-34e784b59d64 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:17:53.387023 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a02509a3-dba2-4469-9d6d-34e784b59d64 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:17:53.558512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a02509a3-dba2-4469-9d6d-34e784b59d64 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:17:53.566999 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a02509a3-dba2-4469-9d6d-34e784b59d64 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 200 len: 1392 microversion: 2.1 time: 0.206269 Aug 04 18:17:53.567581 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3776/7581] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:17:53 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 1392 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:17:53.767134 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-9fb39080-22e6-4b13-b630-0bbe0aa75000 req-8e857352-a4bf-4b66-ad9e-0a528947150b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dca057c7-b750-49fe-b7da-cbfda59a1fd0", "tag": "5d92701c-dd16-4b49-be29-1c3bdbc2ff16"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:17:53.783498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9fb39080-22e6-4b13-b630-0bbe0aa75000 req-8e857352-a4bf-4b66-ad9e-0a528947150b service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:17:53.784829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9fb39080-22e6-4b13-b630-0bbe0aa75000 req-8e857352-a4bf-4b66-ad9e-0a528947150b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:17:53.785525 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9fb39080-22e6-4b13-b630-0bbe0aa75000 req-8e857352-a4bf-4b66-ad9e-0a528947150b service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:17:53.806129 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-9fb39080-22e6-4b13-b630-0bbe0aa75000 req-8e857352-a4bf-4b66-ad9e-0a528947150b service nova] Creating event network-changed:5d92701c-dd16-4b49-be29-1c3bdbc2ff16 for instance dca057c7-b750-49fe-b7da-cbfda59a1fd0 on n-h1-851359-3 Aug 04 18:17:53.822523 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-9fb39080-22e6-4b13-b630-0bbe0aa75000 req-8e857352-a4bf-4b66-ad9e-0a528947150b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058901 Aug 04 18:17:53.823573 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3806/7582] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:17:54.599771 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1d4f278d-43a2-49aa-9978-a4b725ca0fa1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:17:54.601871 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1d4f278d-43a2-49aa-9978-a4b725ca0fa1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:17:54.614189 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d4f278d-43a2-49aa-9978-a4b725ca0fa1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:17:54.615191 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d4f278d-43a2-49aa-9978-a4b725ca0fa1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:17:54.616100 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d4f278d-43a2-49aa-9978-a4b725ca0fa1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:17:54.617532 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d4f278d-43a2-49aa-9978-a4b725ca0fa1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:17:54.618581 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d4f278d-43a2-49aa-9978-a4b725ca0fa1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:17:54.619485 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d4f278d-43a2-49aa-9978-a4b725ca0fa1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:17:54.822916 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1d4f278d-43a2-49aa-9978-a4b725ca0fa1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:17:54.839536 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1d4f278d-43a2-49aa-9978-a4b725ca0fa1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 200 len: 1392 microversion: 2.1 time: 0.247164 Aug 04 18:17:54.840681 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3777/7583] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:17:54 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 1392 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:17:55.878209 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5481c8ca-2000-4763-80c6-1b160d9c0128 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:17:55.879179 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5481c8ca-2000-4763-80c6-1b160d9c0128 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:17:55.887264 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5481c8ca-2000-4763-80c6-1b160d9c0128 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:17:55.887910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5481c8ca-2000-4763-80c6-1b160d9c0128 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:17:55.888558 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5481c8ca-2000-4763-80c6-1b160d9c0128 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:17:55.889425 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5481c8ca-2000-4763-80c6-1b160d9c0128 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:17:55.890396 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5481c8ca-2000-4763-80c6-1b160d9c0128 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:17:55.891127 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5481c8ca-2000-4763-80c6-1b160d9c0128 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:17:56.106400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5481c8ca-2000-4763-80c6-1b160d9c0128 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:17:56.120884 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5481c8ca-2000-4763-80c6-1b160d9c0128 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 200 len: 1392 microversion: 2.1 time: 0.249000 Aug 04 18:17:56.121935 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3807/7584] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:17:55 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 1392 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:17:57.158776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3d1a4741-2a6a-412b-88ec-fa471182bfb8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:17:57.159651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3d1a4741-2a6a-412b-88ec-fa471182bfb8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:17:57.167198 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d1a4741-2a6a-412b-88ec-fa471182bfb8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:17:57.167748 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d1a4741-2a6a-412b-88ec-fa471182bfb8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:17:57.168244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d1a4741-2a6a-412b-88ec-fa471182bfb8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:17:57.169040 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d1a4741-2a6a-412b-88ec-fa471182bfb8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:17:57.169610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d1a4741-2a6a-412b-88ec-fa471182bfb8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:17:57.170194 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d1a4741-2a6a-412b-88ec-fa471182bfb8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:17:57.339747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3d1a4741-2a6a-412b-88ec-fa471182bfb8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:17:57.347773 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3d1a4741-2a6a-412b-88ec-fa471182bfb8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 200 len: 1392 microversion: 2.1 time: 0.193014 Aug 04 18:17:57.348379 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3778/7585] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:17:57 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 1392 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:17:58.376902 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-81d7ca94-9a4f-4656-90e5-8df504ed1664 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:17:58.377783 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-81d7ca94-9a4f-4656-90e5-8df504ed1664 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:17:58.388102 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81d7ca94-9a4f-4656-90e5-8df504ed1664 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:17:58.388916 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81d7ca94-9a4f-4656-90e5-8df504ed1664 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:17:58.389470 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81d7ca94-9a4f-4656-90e5-8df504ed1664 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:17:58.390608 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81d7ca94-9a4f-4656-90e5-8df504ed1664 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:17:58.391366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81d7ca94-9a4f-4656-90e5-8df504ed1664 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:17:58.391896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-81d7ca94-9a4f-4656-90e5-8df504ed1664 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:17:59.069563 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-81d7ca94-9a4f-4656-90e5-8df504ed1664 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:17:59.084704 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-81d7ca94-9a4f-4656-90e5-8df504ed1664 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 200 len: 1392 microversion: 2.1 time: 0.712614 Aug 04 18:17:59.085581 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3808/7586] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:17:58 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 1392 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:18:00.119564 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ff6bea57-0527-4af8-aaea-eafc06c09595 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:18:00.120343 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ff6bea57-0527-4af8-aaea-eafc06c09595 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:18:00.124713 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:18:00.125891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:18:00.127289 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:18:00.136444 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff6bea57-0527-4af8-aaea-eafc06c09595 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:00.136987 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff6bea57-0527-4af8-aaea-eafc06c09595 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:00.137522 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff6bea57-0527-4af8-aaea-eafc06c09595 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:00.138392 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff6bea57-0527-4af8-aaea-eafc06c09595 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:00.138952 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff6bea57-0527-4af8-aaea-eafc06c09595 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:00.139406 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff6bea57-0527-4af8-aaea-eafc06c09595 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:00.334145 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-4fa91fe4-8e62-487a-8846-21084cfb09ee req-bc70e455-d963-4ed2-bee4-f87ab7d08675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dca057c7-b750-49fe-b7da-cbfda59a1fd0", "name": "network-vif-plugged", "status": "completed", "tag": "5d92701c-dd16-4b49-be29-1c3bdbc2ff16"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:18:00.337834 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ff6bea57-0527-4af8-aaea-eafc06c09595 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:18:00.346840 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:18:00.352048 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ff6bea57-0527-4af8-aaea-eafc06c09595 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 200 len: 1392 microversion: 2.1 time: 0.236368 Aug 04 18:18:00.354056 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3779/7587] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:18:00 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 1392 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:18:00.354523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-4fa91fe4-8e62-487a-8846-21084cfb09ee req-bc70e455-d963-4ed2-bee4-f87ab7d08675 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:00.355639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-4fa91fe4-8e62-487a-8846-21084cfb09ee req-bc70e455-d963-4ed2-bee4-f87ab7d08675 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:00.356730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-4fa91fe4-8e62-487a-8846-21084cfb09ee req-bc70e455-d963-4ed2-bee4-f87ab7d08675 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:00.384347 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-4fa91fe4-8e62-487a-8846-21084cfb09ee req-bc70e455-d963-4ed2-bee4-f87ab7d08675 service nova] Creating event network-vif-plugged:5d92701c-dd16-4b49-be29-1c3bdbc2ff16 for instance dca057c7-b750-49fe-b7da-cbfda59a1fd0 on n-h1-851359-3 Aug 04 18:18:00.396143 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-4fa91fe4-8e62-487a-8846-21084cfb09ee req-bc70e455-d963-4ed2-bee4-f87ab7d08675 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070689 Aug 04 18:18:00.398134 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3809/7588] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:18:01.392951 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f05d7e72-67d2-440c-9b89-6f81e6574c69 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:18:01.393845 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f05d7e72-67d2-440c-9b89-6f81e6574c69 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:18:01.401878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f05d7e72-67d2-440c-9b89-6f81e6574c69 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:01.402739 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f05d7e72-67d2-440c-9b89-6f81e6574c69 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:01.403318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f05d7e72-67d2-440c-9b89-6f81e6574c69 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:01.404168 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f05d7e72-67d2-440c-9b89-6f81e6574c69 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:01.404757 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f05d7e72-67d2-440c-9b89-6f81e6574c69 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:01.405352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f05d7e72-67d2-440c-9b89-6f81e6574c69 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:01.586800 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f05d7e72-67d2-440c-9b89-6f81e6574c69 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:18:01.598362 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f05d7e72-67d2-440c-9b89-6f81e6574c69 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 200 len: 1392 microversion: 2.1 time: 0.209957 Aug 04 18:18:01.598956 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3780/7589] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:18:01 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 1392 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:18:02.638242 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d1892a32-7d60-4635-8d72-4d8397638f82 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:18:02.639580 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d1892a32-7d60-4635-8d72-4d8397638f82 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:18:02.652440 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1892a32-7d60-4635-8d72-4d8397638f82 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:02.653207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1892a32-7d60-4635-8d72-4d8397638f82 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:02.653998 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1892a32-7d60-4635-8d72-4d8397638f82 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:02.655272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1892a32-7d60-4635-8d72-4d8397638f82 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:02.656129 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1892a32-7d60-4635-8d72-4d8397638f82 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:02.656950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d1892a32-7d60-4635-8d72-4d8397638f82 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:02.852443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d1892a32-7d60-4635-8d72-4d8397638f82 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:18:02.866281 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d1892a32-7d60-4635-8d72-4d8397638f82 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 200 len: 1565 microversion: 2.1 time: 0.236008 Aug 04 18:18:02.867115 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3810/7590] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:18:02 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 1565 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:18:02.888948 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fb39c95a-783b-4756-8095-d36712f16625 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:18:02.889816 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fb39c95a-783b-4756-8095-d36712f16625 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:18:02.897362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb39c95a-783b-4756-8095-d36712f16625 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:02.898404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb39c95a-783b-4756-8095-d36712f16625 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:02.898888 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb39c95a-783b-4756-8095-d36712f16625 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:02.899662 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb39c95a-783b-4756-8095-d36712f16625 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:02.900154 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb39c95a-783b-4756-8095-d36712f16625 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:02.900687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb39c95a-783b-4756-8095-d36712f16625 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:03.101576 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fb39c95a-783b-4756-8095-d36712f16625 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:18:03.113167 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fb39c95a-783b-4756-8095-d36712f16625 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 200 len: 1565 microversion: 2.1 time: 0.228189 Aug 04 18:18:03.113787 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3781/7591] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:18:02 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 1565 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:18:05.350812 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-8c2b3701-0a28-4822-8358-cbb80fa8a714 req-dd8f98c0-2bfa-4a3f-a572-22c7671bbca6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dca057c7-b750-49fe-b7da-cbfda59a1fd0", "tag": "5d92701c-dd16-4b49-be29-1c3bdbc2ff16"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:18:05.351568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5e0a0d2b-6456-4cec-87fd-f21ee6888cd5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:18:05.352026 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5e0a0d2b-6456-4cec-87fd-f21ee6888cd5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:18:05.361144 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5e0a0d2b-6456-4cec-87fd-f21ee6888cd5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:05.361692 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5e0a0d2b-6456-4cec-87fd-f21ee6888cd5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:05.362377 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5e0a0d2b-6456-4cec-87fd-f21ee6888cd5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:05.363173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5e0a0d2b-6456-4cec-87fd-f21ee6888cd5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:05.363621 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5e0a0d2b-6456-4cec-87fd-f21ee6888cd5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:05.364060 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5e0a0d2b-6456-4cec-87fd-f21ee6888cd5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:05.371988 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8c2b3701-0a28-4822-8358-cbb80fa8a714 req-dd8f98c0-2bfa-4a3f-a572-22c7671bbca6 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:05.372715 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8c2b3701-0a28-4822-8358-cbb80fa8a714 req-dd8f98c0-2bfa-4a3f-a572-22c7671bbca6 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:05.373429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8c2b3701-0a28-4822-8358-cbb80fa8a714 req-dd8f98c0-2bfa-4a3f-a572-22c7671bbca6 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:05.396244 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-8c2b3701-0a28-4822-8358-cbb80fa8a714 req-dd8f98c0-2bfa-4a3f-a572-22c7671bbca6 service nova] Creating event network-changed:5d92701c-dd16-4b49-be29-1c3bdbc2ff16 for instance dca057c7-b750-49fe-b7da-cbfda59a1fd0 on n-h1-851359-3 Aug 04 18:18:05.406552 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-8c2b3701-0a28-4822-8358-cbb80fa8a714 req-dd8f98c0-2bfa-4a3f-a572-22c7671bbca6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061281 Aug 04 18:18:05.407917 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3782/7592] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:18:05.575337 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5e0a0d2b-6456-4cec-87fd-f21ee6888cd5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:18:05.589566 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5e0a0d2b-6456-4cec-87fd-f21ee6888cd5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 200 len: 1565 microversion: 2.1 time: 0.245370 Aug 04 18:18:05.591008 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3811/7593] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:18:05 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 1565 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:18:26.025258 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=7 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:18:26.026231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=46 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:18:26.031379 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6998496f-d1f4-4efa-9b3e-a1ad23e4aaf4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:18:26.034612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6998496f-d1f4-4efa-9b3e-a1ad23e4aaf4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:18:26.042542 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6998496f-d1f4-4efa-9b3e-a1ad23e4aaf4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:26.043092 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6998496f-d1f4-4efa-9b3e-a1ad23e4aaf4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:26.043558 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6998496f-d1f4-4efa-9b3e-a1ad23e4aaf4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:26.044300 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6998496f-d1f4-4efa-9b3e-a1ad23e4aaf4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:26.044782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6998496f-d1f4-4efa-9b3e-a1ad23e4aaf4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:26.045229 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6998496f-d1f4-4efa-9b3e-a1ad23e4aaf4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:26.118394 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6998496f-d1f4-4efa-9b3e-a1ad23e4aaf4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "POST /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0/action" status: 200 len: 24570 microversion: 2.1 time: 0.095069 Aug 04 18:18:26.119089 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3783/7594] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:18:26 2022] POST /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0/action => generated 24570 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 18:18:37.191804 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-876ec1a0-e4f7-42d7-ad1e-b7fa3230bbbf tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:18:37.194396 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=18 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:18:37.195079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=34 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:18:37.202237 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-876ec1a0-e4f7-42d7-ad1e-b7fa3230bbbf tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:37.202749 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-876ec1a0-e4f7-42d7-ad1e-b7fa3230bbbf tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:37.203197 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-876ec1a0-e4f7-42d7-ad1e-b7fa3230bbbf tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:37.230763 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-876ec1a0-e4f7-42d7-ad1e-b7fa3230bbbf tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Going to try to stop instance {{(pid=131043) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 18:18:37.279404 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-876ec1a0-e4f7-42d7-ad1e-b7fa3230bbbf tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "POST /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0/action" status: 202 len: 0 microversion: 2.1 time: 0.092073 Aug 04 18:18:37.280320 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3812/7595] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:18:37 2022] POST /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 18:18:37.290015 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ba591617-fc49-45e9-b4c2-32f421ddb34b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:18:37.290749 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ba591617-fc49-45e9-b4c2-32f421ddb34b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:18:37.293774 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:18:37.294553 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:18:37.301506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba591617-fc49-45e9-b4c2-32f421ddb34b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:37.302048 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba591617-fc49-45e9-b4c2-32f421ddb34b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:37.302510 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba591617-fc49-45e9-b4c2-32f421ddb34b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:37.303244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba591617-fc49-45e9-b4c2-32f421ddb34b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:37.303725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba591617-fc49-45e9-b4c2-32f421ddb34b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:37.304171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba591617-fc49-45e9-b4c2-32f421ddb34b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:37.453057 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ba591617-fc49-45e9-b4c2-32f421ddb34b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:18:37.461453 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ba591617-fc49-45e9-b4c2-32f421ddb34b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 200 len: 1694 microversion: 2.1 time: 0.175792 Aug 04 18:18:37.462111 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3784/7596] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:18:37 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 1694 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:18:38.506551 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7c5fe6ed-108b-47ad-b768-cc8f960ac672 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:18:38.507895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7c5fe6ed-108b-47ad-b768-cc8f960ac672 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:18:38.519798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c5fe6ed-108b-47ad-b768-cc8f960ac672 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:38.520700 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c5fe6ed-108b-47ad-b768-cc8f960ac672 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:38.521528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c5fe6ed-108b-47ad-b768-cc8f960ac672 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:38.522900 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c5fe6ed-108b-47ad-b768-cc8f960ac672 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:38.523796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c5fe6ed-108b-47ad-b768-cc8f960ac672 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:38.524590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c5fe6ed-108b-47ad-b768-cc8f960ac672 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:38.703695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7c5fe6ed-108b-47ad-b768-cc8f960ac672 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:18:38.712566 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7c5fe6ed-108b-47ad-b768-cc8f960ac672 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 200 len: 1694 microversion: 2.1 time: 0.216607 Aug 04 18:18:38.713236 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3813/7597] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:18:38 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 1694 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:18:39.736871 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-945d97ba-2a2a-4106-9eea-9f2b2557225e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:18:39.737845 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-945d97ba-2a2a-4106-9eea-9f2b2557225e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:18:39.746158 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-945d97ba-2a2a-4106-9eea-9f2b2557225e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:39.746685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-945d97ba-2a2a-4106-9eea-9f2b2557225e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:39.747118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-945d97ba-2a2a-4106-9eea-9f2b2557225e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:39.747841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-945d97ba-2a2a-4106-9eea-9f2b2557225e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:39.748313 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-945d97ba-2a2a-4106-9eea-9f2b2557225e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:39.748753 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-945d97ba-2a2a-4106-9eea-9f2b2557225e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:39.901088 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-945d97ba-2a2a-4106-9eea-9f2b2557225e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:18:39.911383 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-945d97ba-2a2a-4106-9eea-9f2b2557225e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 200 len: 1694 microversion: 2.1 time: 0.180167 Aug 04 18:18:39.912018 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3785/7598] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:18:39 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 1694 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:18:40.935419 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-74f2ef80-2a00-48f1-a424-166d13c19f72 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:18:40.936337 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-74f2ef80-2a00-48f1-a424-166d13c19f72 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:18:40.945595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-74f2ef80-2a00-48f1-a424-166d13c19f72 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:40.946455 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-74f2ef80-2a00-48f1-a424-166d13c19f72 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:40.947023 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-74f2ef80-2a00-48f1-a424-166d13c19f72 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:40.947986 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-74f2ef80-2a00-48f1-a424-166d13c19f72 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:40.948637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-74f2ef80-2a00-48f1-a424-166d13c19f72 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:40.949160 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-74f2ef80-2a00-48f1-a424-166d13c19f72 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:41.203653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-74f2ef80-2a00-48f1-a424-166d13c19f72 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:18:41.218435 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-74f2ef80-2a00-48f1-a424-166d13c19f72 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 200 len: 1694 microversion: 2.1 time: 0.286600 Aug 04 18:18:41.219904 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3814/7599] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:18:40 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 1694 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:18:42.241518 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-837e0071-3b88-478b-a1e6-1ba89895a8f3 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:18:42.242389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-837e0071-3b88-478b-a1e6-1ba89895a8f3 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:18:42.249586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-837e0071-3b88-478b-a1e6-1ba89895a8f3 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:42.250111 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-837e0071-3b88-478b-a1e6-1ba89895a8f3 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:42.250567 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-837e0071-3b88-478b-a1e6-1ba89895a8f3 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:42.251300 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-837e0071-3b88-478b-a1e6-1ba89895a8f3 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:42.252363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-837e0071-3b88-478b-a1e6-1ba89895a8f3 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:42.252829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-837e0071-3b88-478b-a1e6-1ba89895a8f3 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:42.417768 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-837e0071-3b88-478b-a1e6-1ba89895a8f3 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:18:42.426288 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-837e0071-3b88-478b-a1e6-1ba89895a8f3 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 200 len: 1694 microversion: 2.1 time: 0.188771 Aug 04 18:18:42.426918 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3786/7600] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:18:42 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 1694 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:18:43.448516 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-031ce672-99a5-486d-a6f5-52f3fe8bb9f8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:18:43.449248 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-031ce672-99a5-486d-a6f5-52f3fe8bb9f8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:18:43.459026 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-031ce672-99a5-486d-a6f5-52f3fe8bb9f8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:43.459534 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-031ce672-99a5-486d-a6f5-52f3fe8bb9f8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:43.459987 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-031ce672-99a5-486d-a6f5-52f3fe8bb9f8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:43.460734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-031ce672-99a5-486d-a6f5-52f3fe8bb9f8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:43.461210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-031ce672-99a5-486d-a6f5-52f3fe8bb9f8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:43.461646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-031ce672-99a5-486d-a6f5-52f3fe8bb9f8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:43.649222 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-031ce672-99a5-486d-a6f5-52f3fe8bb9f8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:18:43.657261 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-031ce672-99a5-486d-a6f5-52f3fe8bb9f8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 200 len: 1694 microversion: 2.1 time: 0.212924 Aug 04 18:18:43.658456 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3815/7601] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:18:43 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 1694 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:18:44.680320 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3be024ac-a84e-4c6d-b9dc-2e38164fa423 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:18:44.680906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3be024ac-a84e-4c6d-b9dc-2e38164fa423 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:18:44.688326 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3be024ac-a84e-4c6d-b9dc-2e38164fa423 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:44.689330 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3be024ac-a84e-4c6d-b9dc-2e38164fa423 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:44.689793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3be024ac-a84e-4c6d-b9dc-2e38164fa423 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:44.690656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3be024ac-a84e-4c6d-b9dc-2e38164fa423 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:44.691419 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3be024ac-a84e-4c6d-b9dc-2e38164fa423 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:44.691871 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3be024ac-a84e-4c6d-b9dc-2e38164fa423 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:44.865243 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3be024ac-a84e-4c6d-b9dc-2e38164fa423 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:18:44.874196 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3be024ac-a84e-4c6d-b9dc-2e38164fa423 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 200 len: 1694 microversion: 2.1 time: 0.197984 Aug 04 18:18:44.874996 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3787/7602] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:18:44 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 1694 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:18:45.896979 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b666ec77-251a-44e6-b6a1-987acbb529f1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:18:45.897634 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b666ec77-251a-44e6-b6a1-987acbb529f1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:18:45.904954 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b666ec77-251a-44e6-b6a1-987acbb529f1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:45.905471 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b666ec77-251a-44e6-b6a1-987acbb529f1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:45.905918 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b666ec77-251a-44e6-b6a1-987acbb529f1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:45.906685 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b666ec77-251a-44e6-b6a1-987acbb529f1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:45.907154 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b666ec77-251a-44e6-b6a1-987acbb529f1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:45.907595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b666ec77-251a-44e6-b6a1-987acbb529f1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:46.056115 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b666ec77-251a-44e6-b6a1-987acbb529f1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:18:46.064597 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b666ec77-251a-44e6-b6a1-987acbb529f1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 200 len: 1694 microversion: 2.1 time: 0.171039 Aug 04 18:18:46.065202 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3816/7603] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:18:45 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 1694 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:18:47.087125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1dc00dd0-bd49-454c-bea4-c88dfa50115b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:18:47.087796 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1dc00dd0-bd49-454c-bea4-c88dfa50115b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:18:47.094535 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dc00dd0-bd49-454c-bea4-c88dfa50115b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:47.095576 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dc00dd0-bd49-454c-bea4-c88dfa50115b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:47.096202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dc00dd0-bd49-454c-bea4-c88dfa50115b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:47.096789 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dc00dd0-bd49-454c-bea4-c88dfa50115b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:47.097275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dc00dd0-bd49-454c-bea4-c88dfa50115b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:47.097726 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dc00dd0-bd49-454c-bea4-c88dfa50115b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:47.371913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1dc00dd0-bd49-454c-bea4-c88dfa50115b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:18:47.382362 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1dc00dd0-bd49-454c-bea4-c88dfa50115b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 200 len: 1694 microversion: 2.1 time: 0.299664 Aug 04 18:18:47.382967 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3788/7604] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:18:47 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 1694 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:18:48.410726 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9f026999-6d9f-4fd5-a5f9-cd9b59ca7e1c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:18:48.411449 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9f026999-6d9f-4fd5-a5f9-cd9b59ca7e1c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:18:48.419000 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f026999-6d9f-4fd5-a5f9-cd9b59ca7e1c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:48.419608 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f026999-6d9f-4fd5-a5f9-cd9b59ca7e1c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:48.420092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f026999-6d9f-4fd5-a5f9-cd9b59ca7e1c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:48.420859 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f026999-6d9f-4fd5-a5f9-cd9b59ca7e1c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:48.421501 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f026999-6d9f-4fd5-a5f9-cd9b59ca7e1c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:48.421966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9f026999-6d9f-4fd5-a5f9-cd9b59ca7e1c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:48.640574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9f026999-6d9f-4fd5-a5f9-cd9b59ca7e1c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:18:48.650076 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9f026999-6d9f-4fd5-a5f9-cd9b59ca7e1c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 200 len: 1694 microversion: 2.1 time: 0.244359 Aug 04 18:18:48.651068 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3817/7605] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:18:48 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 1694 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:18:49.672604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ac309642-fccd-4b43-ae6d-a6491fbd79fe tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:18:49.673426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ac309642-fccd-4b43-ae6d-a6491fbd79fe tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:18:49.681734 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac309642-fccd-4b43-ae6d-a6491fbd79fe tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:49.682631 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac309642-fccd-4b43-ae6d-a6491fbd79fe tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:49.683281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac309642-fccd-4b43-ae6d-a6491fbd79fe tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:49.684175 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac309642-fccd-4b43-ae6d-a6491fbd79fe tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:49.684781 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac309642-fccd-4b43-ae6d-a6491fbd79fe tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:49.685487 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac309642-fccd-4b43-ae6d-a6491fbd79fe tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:49.852421 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ac309642-fccd-4b43-ae6d-a6491fbd79fe tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:18:49.861345 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ac309642-fccd-4b43-ae6d-a6491fbd79fe tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 200 len: 1694 microversion: 2.1 time: 0.193239 Aug 04 18:18:49.862157 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3789/7606] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:18:49 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 1694 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:18:50.883943 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-000f4ceb-f524-4df9-8bc6-9adce65a90ae tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:18:50.884653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-000f4ceb-f524-4df9-8bc6-9adce65a90ae tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:18:50.892487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-000f4ceb-f524-4df9-8bc6-9adce65a90ae tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:50.893252 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-000f4ceb-f524-4df9-8bc6-9adce65a90ae tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:50.894330 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-000f4ceb-f524-4df9-8bc6-9adce65a90ae tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:50.894638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-000f4ceb-f524-4df9-8bc6-9adce65a90ae tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:50.895133 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-000f4ceb-f524-4df9-8bc6-9adce65a90ae tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:50.895601 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-000f4ceb-f524-4df9-8bc6-9adce65a90ae tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:51.076684 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-000f4ceb-f524-4df9-8bc6-9adce65a90ae tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:18:51.085935 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-000f4ceb-f524-4df9-8bc6-9adce65a90ae tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 200 len: 1694 microversion: 2.1 time: 0.205954 Aug 04 18:18:51.086787 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3818/7607] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:18:50 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 1694 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:18:52.119894 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7a3aab7f-8f88-4476-9e12-dcf24d808216 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:18:52.120557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7a3aab7f-8f88-4476-9e12-dcf24d808216 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:18:52.129173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a3aab7f-8f88-4476-9e12-dcf24d808216 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:52.130016 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a3aab7f-8f88-4476-9e12-dcf24d808216 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:52.130716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a3aab7f-8f88-4476-9e12-dcf24d808216 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:52.131852 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a3aab7f-8f88-4476-9e12-dcf24d808216 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:52.132599 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a3aab7f-8f88-4476-9e12-dcf24d808216 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:52.133470 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a3aab7f-8f88-4476-9e12-dcf24d808216 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:52.296656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7a3aab7f-8f88-4476-9e12-dcf24d808216 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:18:52.305318 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7a3aab7f-8f88-4476-9e12-dcf24d808216 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 200 len: 1694 microversion: 2.1 time: 0.189429 Aug 04 18:18:52.305891 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3790/7608] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:18:52 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 1694 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:18:53.327345 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-9997fa0b-9387-44f9-8454-1126461d6cbc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:18:53.327977 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-9997fa0b-9387-44f9-8454-1126461d6cbc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:18:53.336157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9997fa0b-9387-44f9-8454-1126461d6cbc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:53.336666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9997fa0b-9387-44f9-8454-1126461d6cbc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:53.337113 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9997fa0b-9387-44f9-8454-1126461d6cbc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:53.337848 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9997fa0b-9387-44f9-8454-1126461d6cbc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:53.338343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9997fa0b-9387-44f9-8454-1126461d6cbc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:53.338780 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-9997fa0b-9387-44f9-8454-1126461d6cbc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:53.534680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-9997fa0b-9387-44f9-8454-1126461d6cbc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:18:53.544251 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-9997fa0b-9387-44f9-8454-1126461d6cbc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 200 len: 1671 microversion: 2.1 time: 0.220924 Aug 04 18:18:53.544928 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3819/7609] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:18:53 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 1671 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:18:54.651918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aab8f2ab-611e-4b8e-b8ef-894567e1b720 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:18:54.654247 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aab8f2ab-611e-4b8e-b8ef-894567e1b720 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:18:54.662464 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aab8f2ab-611e-4b8e-b8ef-894567e1b720 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:54.662987 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aab8f2ab-611e-4b8e-b8ef-894567e1b720 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:54.663450 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aab8f2ab-611e-4b8e-b8ef-894567e1b720 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:54.664201 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aab8f2ab-611e-4b8e-b8ef-894567e1b720 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:54.664686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aab8f2ab-611e-4b8e-b8ef-894567e1b720 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:54.665171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aab8f2ab-611e-4b8e-b8ef-894567e1b720 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:54.730672 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aab8f2ab-611e-4b8e-b8ef-894567e1b720 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "POST /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0/action" status: 200 len: 38438 microversion: 2.1 time: 0.082931 Aug 04 18:18:54.731357 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3791/7610] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:18:54 2022] POST /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0/action => generated 38438 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 18:18:54.745047 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7c6c11e2-1c2a-4a9e-9d08-a8ca35e6703e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:18:54.752876 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c6c11e2-1c2a-4a9e-9d08-a8ca35e6703e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:54.753372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c6c11e2-1c2a-4a9e-9d08-a8ca35e6703e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:54.754081 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7c6c11e2-1c2a-4a9e-9d08-a8ca35e6703e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:54.778765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7c6c11e2-1c2a-4a9e-9d08-a8ca35e6703e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Going to try to start instance {{(pid=131043) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 18:18:54.835148 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7c6c11e2-1c2a-4a9e-9d08-a8ca35e6703e tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "POST /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0/action" status: 202 len: 0 microversion: 2.1 time: 0.093256 Aug 04 18:18:54.840735 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3820/7611] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:18:54 2022] POST /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 18:18:54.848757 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7eabaf58-fa70-4681-ba9e-8355de62d86b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:18:54.849932 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7eabaf58-fa70-4681-ba9e-8355de62d86b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:18:54.860135 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7eabaf58-fa70-4681-ba9e-8355de62d86b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:54.861168 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7eabaf58-fa70-4681-ba9e-8355de62d86b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:54.861629 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7eabaf58-fa70-4681-ba9e-8355de62d86b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:54.862423 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7eabaf58-fa70-4681-ba9e-8355de62d86b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:54.862901 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7eabaf58-fa70-4681-ba9e-8355de62d86b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:54.863347 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7eabaf58-fa70-4681-ba9e-8355de62d86b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:55.046864 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7eabaf58-fa70-4681-ba9e-8355de62d86b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:18:55.062268 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7eabaf58-fa70-4681-ba9e-8355de62d86b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 200 len: 1680 microversion: 2.1 time: 0.218802 Aug 04 18:18:55.062888 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3792/7612] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:18:54 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 1680 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:18:56.087271 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-cd5edf28-c62d-4a21-b0d3-a98fdfe7803f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:18:56.087994 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-cd5edf28-c62d-4a21-b0d3-a98fdfe7803f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:18:56.095137 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd5edf28-c62d-4a21-b0d3-a98fdfe7803f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:56.095662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd5edf28-c62d-4a21-b0d3-a98fdfe7803f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:56.096106 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd5edf28-c62d-4a21-b0d3-a98fdfe7803f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:56.096958 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd5edf28-c62d-4a21-b0d3-a98fdfe7803f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:56.097354 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd5edf28-c62d-4a21-b0d3-a98fdfe7803f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:56.097856 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-cd5edf28-c62d-4a21-b0d3-a98fdfe7803f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:56.282334 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-cd5edf28-c62d-4a21-b0d3-a98fdfe7803f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:18:56.291616 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-cd5edf28-c62d-4a21-b0d3-a98fdfe7803f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 200 len: 1680 microversion: 2.1 time: 0.209662 Aug 04 18:18:56.292235 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3821/7613] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:18:56 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 1680 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:18:57.319365 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a4bf09f2-9e26-4bfe-8a25-56fdb397d2c4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:18:57.320373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a4bf09f2-9e26-4bfe-8a25-56fdb397d2c4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:18:57.331656 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4bf09f2-9e26-4bfe-8a25-56fdb397d2c4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:57.332564 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4bf09f2-9e26-4bfe-8a25-56fdb397d2c4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:57.333387 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4bf09f2-9e26-4bfe-8a25-56fdb397d2c4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:57.334725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4bf09f2-9e26-4bfe-8a25-56fdb397d2c4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:18:57.335531 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4bf09f2-9e26-4bfe-8a25-56fdb397d2c4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:18:57.336092 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4bf09f2-9e26-4bfe-8a25-56fdb397d2c4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:18:57.491747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a4bf09f2-9e26-4bfe-8a25-56fdb397d2c4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:18:57.506945 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a4bf09f2-9e26-4bfe-8a25-56fdb397d2c4 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 200 len: 1684 microversion: 2.1 time: 0.192823 Aug 04 18:18:57.508063 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3793/7614] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:18:57 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 1684 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:19:21.757301 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8e88a6a2-99dd-40ac-ab5b-50d102d61186 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:19:21.760225 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8e88a6a2-99dd-40ac-ab5b-50d102d61186 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:19:21.763426 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=20 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:19:21.764301 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:19:21.773477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e88a6a2-99dd-40ac-ab5b-50d102d61186 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:21.774834 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e88a6a2-99dd-40ac-ab5b-50d102d61186 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:21.775404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e88a6a2-99dd-40ac-ab5b-50d102d61186 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:21.776192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e88a6a2-99dd-40ac-ab5b-50d102d61186 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:21.776680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e88a6a2-99dd-40ac-ab5b-50d102d61186 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:21.777128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8e88a6a2-99dd-40ac-ab5b-50d102d61186 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:21.859598 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8e88a6a2-99dd-40ac-ab5b-50d102d61186 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "POST /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0/action" status: 200 len: 63006 microversion: 2.1 time: 0.106422 Aug 04 18:19:21.860647 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3822/7615] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:19:21 2022] POST /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0/action => generated 63006 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 18:19:23.296670 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:19:23.298393 n-d-851359-3 devstack@n-api.service[131043]: Thu Aug 4 18:19:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:19:29.272007 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d004de78-d780-40b7-82c7-02807226f106 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:19:29.273232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d004de78-d780-40b7-82c7-02807226f106 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:19:29.273925 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-b034de0a-9bbb-4f97-b6be-fa7fde17485f req-ba92b533-9df7-4dbe-bcf9-becf2d7c97ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dca057c7-b750-49fe-b7da-cbfda59a1fd0", "tag": "5d92701c-dd16-4b49-be29-1c3bdbc2ff16"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:19:29.278267 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=20 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:19:29.279603 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=58 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:19:29.291308 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d004de78-d780-40b7-82c7-02807226f106 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:29.292161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d004de78-d780-40b7-82c7-02807226f106 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:29.294056 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d004de78-d780-40b7-82c7-02807226f106 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:29.294405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d004de78-d780-40b7-82c7-02807226f106 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:29.295450 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d004de78-d780-40b7-82c7-02807226f106 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:29.297862 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d004de78-d780-40b7-82c7-02807226f106 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:29.298472 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b034de0a-9bbb-4f97-b6be-fa7fde17485f req-ba92b533-9df7-4dbe-bcf9-becf2d7c97ef service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:29.299553 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b034de0a-9bbb-4f97-b6be-fa7fde17485f req-ba92b533-9df7-4dbe-bcf9-becf2d7c97ef service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:29.300354 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-b034de0a-9bbb-4f97-b6be-fa7fde17485f req-ba92b533-9df7-4dbe-bcf9-becf2d7c97ef service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:29.325819 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-b034de0a-9bbb-4f97-b6be-fa7fde17485f req-ba92b533-9df7-4dbe-bcf9-becf2d7c97ef service nova] Creating event network-changed:5d92701c-dd16-4b49-be29-1c3bdbc2ff16 for instance dca057c7-b750-49fe-b7da-cbfda59a1fd0 on n-h1-851359-3 Aug 04 18:19:29.336744 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-b034de0a-9bbb-4f97-b6be-fa7fde17485f req-ba92b533-9df7-4dbe-bcf9-becf2d7c97ef service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070252 Aug 04 18:19:29.338424 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3823/7616] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:19:29.352695 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d004de78-d780-40b7-82c7-02807226f106 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 18:19:29.548571 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d004de78-d780-40b7-82c7-02807226f106 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "DELETE /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 204 len: 0 microversion: 2.1 time: 0.283358 Aug 04 18:19:29.550263 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3794/7617] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 18:19:29 2022] DELETE /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 18:19:29.564695 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3fcfd4ae-41b7-4691-9aee-190fe4e8f327 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:19:29.566631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3fcfd4ae-41b7-4691-9aee-190fe4e8f327 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:19:29.578823 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3fcfd4ae-41b7-4691-9aee-190fe4e8f327 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:29.579517 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3fcfd4ae-41b7-4691-9aee-190fe4e8f327 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:29.580376 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3fcfd4ae-41b7-4691-9aee-190fe4e8f327 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:29.581631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3fcfd4ae-41b7-4691-9aee-190fe4e8f327 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:29.582424 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3fcfd4ae-41b7-4691-9aee-190fe4e8f327 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:29.583152 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3fcfd4ae-41b7-4691-9aee-190fe4e8f327 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:29.812246 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3fcfd4ae-41b7-4691-9aee-190fe4e8f327 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:19:29.829646 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3fcfd4ae-41b7-4691-9aee-190fe4e8f327 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 200 len: 1690 microversion: 2.1 time: 0.271408 Aug 04 18:19:29.831062 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3824/7618] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:19:29 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 1690 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:19:30.869159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3a6c4de6-1676-4b7c-a5d7-2ebaa53501a5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:19:30.870896 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3a6c4de6-1676-4b7c-a5d7-2ebaa53501a5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:19:30.881231 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a6c4de6-1676-4b7c-a5d7-2ebaa53501a5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:30.882211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a6c4de6-1676-4b7c-a5d7-2ebaa53501a5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:30.883132 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a6c4de6-1676-4b7c-a5d7-2ebaa53501a5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:30.884160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a6c4de6-1676-4b7c-a5d7-2ebaa53501a5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:30.884868 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a6c4de6-1676-4b7c-a5d7-2ebaa53501a5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:30.885578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a6c4de6-1676-4b7c-a5d7-2ebaa53501a5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:31.132269 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3a6c4de6-1676-4b7c-a5d7-2ebaa53501a5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:19:31.147599 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3a6c4de6-1676-4b7c-a5d7-2ebaa53501a5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 200 len: 1690 microversion: 2.1 time: 0.282916 Aug 04 18:19:31.148651 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3795/7619] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:19:30 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 1690 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:19:31.950613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-1b01f640-c31d-431e-acc9-16f39a53bd7b req-2c096189-4a61-4652-860f-adcbe4454860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dca057c7-b750-49fe-b7da-cbfda59a1fd0", "name": "network-vif-deleted", "tag": "5d92701c-dd16-4b49-be29-1c3bdbc2ff16"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:19:31.978999 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1b01f640-c31d-431e-acc9-16f39a53bd7b req-2c096189-4a61-4652-860f-adcbe4454860 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:31.979764 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1b01f640-c31d-431e-acc9-16f39a53bd7b req-2c096189-4a61-4652-860f-adcbe4454860 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:31.980577 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1b01f640-c31d-431e-acc9-16f39a53bd7b req-2c096189-4a61-4652-860f-adcbe4454860 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:31.993634 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-1b01f640-c31d-431e-acc9-16f39a53bd7b req-2c096189-4a61-4652-860f-adcbe4454860 service nova] Creating event network-vif-deleted:5d92701c-dd16-4b49-be29-1c3bdbc2ff16 for instance dca057c7-b750-49fe-b7da-cbfda59a1fd0 on n-h1-851359-3 Aug 04 18:19:32.005220 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-1b01f640-c31d-431e-acc9-16f39a53bd7b req-2c096189-4a61-4652-860f-adcbe4454860 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166614 Aug 04 18:19:32.006689 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3825/7620] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:19:32.185902 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-48f1c833-03ea-43ad-9e95-6a085098a90f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:19:32.186959 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-48f1c833-03ea-43ad-9e95-6a085098a90f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:19:32.199162 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48f1c833-03ea-43ad-9e95-6a085098a90f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:32.200066 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48f1c833-03ea-43ad-9e95-6a085098a90f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:32.200847 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48f1c833-03ea-43ad-9e95-6a085098a90f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:32.202178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48f1c833-03ea-43ad-9e95-6a085098a90f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:32.203042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48f1c833-03ea-43ad-9e95-6a085098a90f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:32.204425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48f1c833-03ea-43ad-9e95-6a085098a90f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:32.264469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48f1c833-03ea-43ad-9e95-6a085098a90f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:32.265211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48f1c833-03ea-43ad-9e95-6a085098a90f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:32.266586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48f1c833-03ea-43ad-9e95-6a085098a90f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:32.267433 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-48f1c833-03ea-43ad-9e95-6a085098a90f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lazy-loading 'fault' on Instance uuid dca057c7-b750-49fe-b7da-cbfda59a1fd0 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 18:19:32.347367 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-48f1c833-03ea-43ad-9e95-6a085098a90f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:19:32.364325 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-48f1c833-03ea-43ad-9e95-6a085098a90f tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 200 len: 1357 microversion: 2.1 time: 0.184077 Aug 04 18:19:32.365471 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3796/7621] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:19:32 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 1357 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:19:33.401648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ed61015a-4fa5-4082-9865-5c50429b295d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:19:33.403311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ed61015a-4fa5-4082-9865-5c50429b295d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: dca057c7-b750-49fe-b7da-cbfda59a1fd0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:19:33.411594 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed61015a-4fa5-4082-9865-5c50429b295d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:33.412369 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed61015a-4fa5-4082-9865-5c50429b295d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:33.413065 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed61015a-4fa5-4082-9865-5c50429b295d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:33.414278 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed61015a-4fa5-4082-9865-5c50429b295d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:33.415009 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed61015a-4fa5-4082-9865-5c50429b295d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:33.415669 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed61015a-4fa5-4082-9865-5c50429b295d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:33.440207 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-ed61015a-4fa5-4082-9865-5c50429b295d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] HTTP exception thrown: Instance dca057c7-b750-49fe-b7da-cbfda59a1fd0 could not be found. Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ed61015a-4fa5-4082-9865-5c50429b295d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Request method failure captured: Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 HTTP/1.1 Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7AwIjCsovibYcH6ErWxGJedA-SXylLsKvn2zpdpI2y0HfanfgcItDr2cHF1i3ynCG5lmDiVO7c8mMcbqfLpue1bmLw9gTl9Y1GTYLYZrG8HdwuvNirSZtowkucGnoPRO0LnscJrHruNXZPpdU2GfZAeK3oRPo9VtZizbrtXsNeEIQOc Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: ca6f9f1c52b34546af469a9d43d466db Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-103139372 Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca6f9f1c52b34546af469a9d43d466db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca6f9f1c52b34546af469a9d43d466db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ca6f9f1c52b34546af469a9d43d466db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ca6f9f1c52b34546af469a9d43d466db"}]}] Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-TestNetworkAdvancedServerOps-103139372 Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: ca6f9f1c52b34546af469a9d43d466db Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-103139372 Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-TestNetworkAdvancedServerOps-103139372-project Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 35ad5b583f7f49e0b36ea7d3d75c9a20 Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-TestNetworkAdvancedServerOps-103139372-project Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance dca057c7-b750-49fe-b7da-cbfda59a1fd0 could not be found. Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'dca057c7-b750-49fe-b7da-cbfda59a1fd0'} Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dca057c7-b750-49fe-b7da-cbfda59a1fd0 could not be found. Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dca057c7-b750-49fe-b7da-cbfda59a1fd0 could not be found. Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:19:33.443494 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:19:33.455848 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:19:33.455848 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:19:33.455848 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:19:33.455848 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:19:33.455848 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:19:33.455848 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:19:33.455848 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dca057c7-b750-49fe-b7da-cbfda59a1fd0 could not be found. Aug 04 18:19:33.455848 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:19:33.455848 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ed61015a-4fa5-4082-9865-5c50429b295d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Returning 404 to user: Instance dca057c7-b750-49fe-b7da-cbfda59a1fd0 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:19:33.455848 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ed61015a-4fa5-4082-9865-5c50429b295d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0" status: 404 len: 111 microversion: 2.1 time: 0.049777 Aug 04 18:19:33.455848 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3826/7622] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:19:33 2022] GET /compute/v2.1/servers/dca057c7-b750-49fe-b7da-cbfda59a1fd0 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 18:19:37.804272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-84b54f2f-4f92-4f42-b5ee-21e2866027b9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '.version_select at 0x7f1e5824aca0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:19:37.840607 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-84b54f2f-4f92-4f42-b5ee-21e2866027b9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1631690017" status: 202 len: 0 microversion: 2.1 time: 0.043591 Aug 04 18:19:37.841575 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3797/7623] 10.222.0.93 () {58 vars in 1284 bytes} [Thu Aug 4 18:19:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1631690017 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 18:19:37.902287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-30b8997f-505f-4d32-882d-77650eb2d095 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Action: 'create', calling method: .version_select at 0x7f1e5a162040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1072648328", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjC43zoAW/yTJ96aBj7bUjJyQL06yjyqBSRjAEXKjmKWJUGIG3pKiEUDxl1MuEy/0Plys0VgP9F8eqq+nVQroeImJyZD8eMzNnejw/KM8BCv/fcVE52uB0mOR80Kargpw=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:19:37.925957 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-30b8997f-505f-4d32-882d-77650eb2d095 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Getting quotas for project ca6f9f1c52b34546af469a9d43d466db. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 18:19:37.933175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-30b8997f-505f-4d32-882d-77650eb2d095 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Getting quotas for user 35ad5b583f7f49e0b36ea7d3d75c9a20 and project ca6f9f1c52b34546af469a9d43d466db. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 18:19:37.973747 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-30b8997f-505f-4d32-882d-77650eb2d095 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.077881 Aug 04 18:19:37.974873 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3827/7624] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 18:19:37 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:19:46.959168 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6a38e2b2-b1b6-4fca-891f-1c7c9d447e8b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1040209729", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "networks": [{"uuid": "06402aac-a49d-4b73-8706-d2a5ad5ea6c1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1072648328", "security_groups": [{"name": "tempest-secgroup-smoke-2053364686"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:19:46.998461 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:19:47.204160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-6a38e2b2-b1b6-4fca-891f-1c7c9d447e8b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] validate_networks() for [('06402aac-a49d-4b73-8706-d2a5ad5ea6c1', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 18:19:48.375522 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6a38e2b2-b1b6-4fca-891f-1c7c9d447e8b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 18:19:48.376607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6a38e2b2-b1b6-4fca-891f-1c7c9d447e8b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 18:19:48.376607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6a38e2b2-b1b6-4fca-891f-1c7c9d447e8b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 18:19:48.376965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6a38e2b2-b1b6-4fca-891f-1c7c9d447e8b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 18:19:48.377312 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6a38e2b2-b1b6-4fca-891f-1c7c9d447e8b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 18:19:48.387366 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a38e2b2-b1b6-4fca-891f-1c7c9d447e8b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:48.387918 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a38e2b2-b1b6-4fca-891f-1c7c9d447e8b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:48.388377 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a38e2b2-b1b6-4fca-891f-1c7c9d447e8b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:48.389155 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a38e2b2-b1b6-4fca-891f-1c7c9d447e8b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:48.389637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a38e2b2-b1b6-4fca-891f-1c7c9d447e8b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:48.390116 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a38e2b2-b1b6-4fca-891f-1c7c9d447e8b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:48.419366 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-6a38e2b2-b1b6-4fca-891f-1c7c9d447e8b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Getting quotas for project ca6f9f1c52b34546af469a9d43d466db. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 18:19:48.425633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-6a38e2b2-b1b6-4fca-891f-1c7c9d447e8b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Getting quotas for user 35ad5b583f7f49e0b36ea7d3d75c9a20 and project ca6f9f1c52b34546af469a9d43d466db. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 18:19:48.441393 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6a38e2b2-b1b6-4fca-891f-1c7c9d447e8b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 18:19:48.445075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6a38e2b2-b1b6-4fca-891f-1c7c9d447e8b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 23f5197c-ecfe-44cb-861d-850368711121] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 18:19:48.497580 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6a38e2b2-b1b6-4fca-891f-1c7c9d447e8b tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.546803 Aug 04 18:19:48.498510 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3798/7625] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 18:19:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 1549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 18:19:48.521387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-75fecba4-4c82-40e1-830b-ee4040f01757 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:19:48.524179 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-75fecba4-4c82-40e1-830b-ee4040f01757 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 23f5197c-ecfe-44cb-861d-850368711121] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:19:48.531187 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=16 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:19:48.532558 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=4 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:19:48.534988 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:19:48.629720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-75fecba4-4c82-40e1-830b-ee4040f01757 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:19:48.638253 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-75fecba4-4c82-40e1-830b-ee4040f01757 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121" status: 200 len: 1267 microversion: 2.1 time: 0.126933 Aug 04 18:19:48.639600 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3828/7626] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:19:48 2022] GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121 => generated 1267 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:19:49.679561 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c19a2eb6-0204-476d-a466-1b7c67a986ea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:19:49.681163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c19a2eb6-0204-476d-a466-1b7c67a986ea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 23f5197c-ecfe-44cb-861d-850368711121] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:19:49.691309 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c19a2eb6-0204-476d-a466-1b7c67a986ea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:49.691883 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c19a2eb6-0204-476d-a466-1b7c67a986ea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:49.692668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c19a2eb6-0204-476d-a466-1b7c67a986ea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:49.693675 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c19a2eb6-0204-476d-a466-1b7c67a986ea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:49.694263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c19a2eb6-0204-476d-a466-1b7c67a986ea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:49.694940 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c19a2eb6-0204-476d-a466-1b7c67a986ea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:49.805146 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c19a2eb6-0204-476d-a466-1b7c67a986ea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:19:49.815700 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c19a2eb6-0204-476d-a466-1b7c67a986ea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121" status: 200 len: 1319 microversion: 2.1 time: 0.142411 Aug 04 18:19:49.818045 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3799/7627] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:19:49 2022] GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121 => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:19:50.841513 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-64a4f4cc-d448-4d2c-954c-0c47aa97eb3d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:19:50.842871 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-64a4f4cc-d448-4d2c-954c-0c47aa97eb3d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 23f5197c-ecfe-44cb-861d-850368711121] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:19:50.853659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64a4f4cc-d448-4d2c-954c-0c47aa97eb3d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:50.855682 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64a4f4cc-d448-4d2c-954c-0c47aa97eb3d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:50.855682 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64a4f4cc-d448-4d2c-954c-0c47aa97eb3d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:50.856476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64a4f4cc-d448-4d2c-954c-0c47aa97eb3d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:50.857170 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64a4f4cc-d448-4d2c-954c-0c47aa97eb3d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:50.857752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-64a4f4cc-d448-4d2c-954c-0c47aa97eb3d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:51.000583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-64a4f4cc-d448-4d2c-954c-0c47aa97eb3d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:19:51.032198 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-64a4f4cc-d448-4d2c-954c-0c47aa97eb3d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121" status: 200 len: 1325 microversion: 2.1 time: 0.194665 Aug 04 18:19:51.033593 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3829/7628] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:19:50 2022] GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121 => generated 1325 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:19:52.073228 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3ea4ac91-f5a0-41e0-b755-ec0814c0c7d9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:19:52.074217 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3ea4ac91-f5a0-41e0-b755-ec0814c0c7d9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 23f5197c-ecfe-44cb-861d-850368711121] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:19:52.085581 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ea4ac91-f5a0-41e0-b755-ec0814c0c7d9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:52.086278 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ea4ac91-f5a0-41e0-b755-ec0814c0c7d9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:52.086865 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ea4ac91-f5a0-41e0-b755-ec0814c0c7d9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:52.087700 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ea4ac91-f5a0-41e0-b755-ec0814c0c7d9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:52.088250 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ea4ac91-f5a0-41e0-b755-ec0814c0c7d9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:52.088982 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ea4ac91-f5a0-41e0-b755-ec0814c0c7d9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:52.427014 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3ea4ac91-f5a0-41e0-b755-ec0814c0c7d9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:19:52.442332 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3ea4ac91-f5a0-41e0-b755-ec0814c0c7d9 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121" status: 200 len: 1393 microversion: 2.1 time: 0.374306 Aug 04 18:19:52.442942 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3800/7629] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:19:52 2022] GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121 => generated 1393 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:19:52.647192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-a1cf4c48-f88f-4163-8f20-fcf83b09b22f req-b23cfdf4-a6b8-4337-bc4e-a0bc9bc52e91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23f5197c-ecfe-44cb-861d-850368711121", "tag": "26936515-cfcd-403c-9e24-707c2f137320"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:19:52.676556 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a1cf4c48-f88f-4163-8f20-fcf83b09b22f req-b23cfdf4-a6b8-4337-bc4e-a0bc9bc52e91 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:52.677468 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a1cf4c48-f88f-4163-8f20-fcf83b09b22f req-b23cfdf4-a6b8-4337-bc4e-a0bc9bc52e91 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:52.678306 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a1cf4c48-f88f-4163-8f20-fcf83b09b22f req-b23cfdf4-a6b8-4337-bc4e-a0bc9bc52e91 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:52.711558 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-a1cf4c48-f88f-4163-8f20-fcf83b09b22f req-b23cfdf4-a6b8-4337-bc4e-a0bc9bc52e91 service nova] Creating event network-changed:26936515-cfcd-403c-9e24-707c2f137320 for instance 23f5197c-ecfe-44cb-861d-850368711121 on n-h1-851359-3 Aug 04 18:19:52.726820 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-a1cf4c48-f88f-4163-8f20-fcf83b09b22f req-b23cfdf4-a6b8-4337-bc4e-a0bc9bc52e91 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092376 Aug 04 18:19:52.728246 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3830/7630] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:19:53.479473 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e940398c-e85b-4de4-bc1f-5a36a3593a40 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:19:53.480070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e940398c-e85b-4de4-bc1f-5a36a3593a40 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 23f5197c-ecfe-44cb-861d-850368711121] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:19:53.488145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e940398c-e85b-4de4-bc1f-5a36a3593a40 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:53.488663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e940398c-e85b-4de4-bc1f-5a36a3593a40 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:53.489129 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e940398c-e85b-4de4-bc1f-5a36a3593a40 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:53.489884 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e940398c-e85b-4de4-bc1f-5a36a3593a40 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:53.490483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e940398c-e85b-4de4-bc1f-5a36a3593a40 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:53.490930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e940398c-e85b-4de4-bc1f-5a36a3593a40 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:53.663338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e940398c-e85b-4de4-bc1f-5a36a3593a40 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:19:53.678244 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e940398c-e85b-4de4-bc1f-5a36a3593a40 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121" status: 200 len: 1393 microversion: 2.1 time: 0.202440 Aug 04 18:19:53.679338 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3801/7631] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:19:53 2022] GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121 => generated 1393 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:19:54.710258 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-20727175-17e8-4478-8439-fe42bc065abf tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:19:54.711492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-20727175-17e8-4478-8439-fe42bc065abf tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 23f5197c-ecfe-44cb-861d-850368711121] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:19:54.722475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20727175-17e8-4478-8439-fe42bc065abf tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:54.723320 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20727175-17e8-4478-8439-fe42bc065abf tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:54.724056 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20727175-17e8-4478-8439-fe42bc065abf tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:54.725269 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20727175-17e8-4478-8439-fe42bc065abf tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:54.726101 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20727175-17e8-4478-8439-fe42bc065abf tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:54.726881 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-20727175-17e8-4478-8439-fe42bc065abf tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:55.011787 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-20727175-17e8-4478-8439-fe42bc065abf tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:19:55.021950 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-20727175-17e8-4478-8439-fe42bc065abf tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121" status: 200 len: 1393 microversion: 2.1 time: 0.321781 Aug 04 18:19:55.022800 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3831/7632] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:19:54 2022] GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121 => generated 1393 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:19:56.053424 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-91650de9-60d9-4841-ad40-19abbb18b822 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:19:56.054285 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-91650de9-60d9-4841-ad40-19abbb18b822 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 23f5197c-ecfe-44cb-861d-850368711121] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:19:56.062591 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-91650de9-60d9-4841-ad40-19abbb18b822 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:56.063112 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-91650de9-60d9-4841-ad40-19abbb18b822 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:56.063711 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-91650de9-60d9-4841-ad40-19abbb18b822 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:56.064541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-91650de9-60d9-4841-ad40-19abbb18b822 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:56.065223 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-91650de9-60d9-4841-ad40-19abbb18b822 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:56.066044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-91650de9-60d9-4841-ad40-19abbb18b822 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:56.244339 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-91650de9-60d9-4841-ad40-19abbb18b822 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:19:56.257634 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-91650de9-60d9-4841-ad40-19abbb18b822 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121" status: 200 len: 1393 microversion: 2.1 time: 0.208532 Aug 04 18:19:56.258690 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3802/7633] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:19:56 2022] GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121 => generated 1393 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:19:57.302385 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-195922ad-adce-4ec0-9c0e-66c2fb9f0cda tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:19:57.303188 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-195922ad-adce-4ec0-9c0e-66c2fb9f0cda tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 23f5197c-ecfe-44cb-861d-850368711121] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:19:57.314964 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-195922ad-adce-4ec0-9c0e-66c2fb9f0cda tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:57.315858 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-195922ad-adce-4ec0-9c0e-66c2fb9f0cda tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:57.316673 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-195922ad-adce-4ec0-9c0e-66c2fb9f0cda tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:57.318085 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-195922ad-adce-4ec0-9c0e-66c2fb9f0cda tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:57.319104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-195922ad-adce-4ec0-9c0e-66c2fb9f0cda tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:57.319953 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-195922ad-adce-4ec0-9c0e-66c2fb9f0cda tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:57.525622 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-195922ad-adce-4ec0-9c0e-66c2fb9f0cda tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:19:57.534676 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-195922ad-adce-4ec0-9c0e-66c2fb9f0cda tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121" status: 200 len: 1393 microversion: 2.1 time: 0.236612 Aug 04 18:19:57.535296 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3832/7634] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:19:57 2022] GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121 => generated 1393 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:19:58.556978 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7f622b32-cd23-46c7-ba72-632a83cf04d5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:19:58.557839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7f622b32-cd23-46c7-ba72-632a83cf04d5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 23f5197c-ecfe-44cb-861d-850368711121] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:19:58.560628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:19:58.561414 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:19:58.570024 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f622b32-cd23-46c7-ba72-632a83cf04d5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:58.570803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f622b32-cd23-46c7-ba72-632a83cf04d5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:58.571755 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f622b32-cd23-46c7-ba72-632a83cf04d5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:58.572914 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f622b32-cd23-46c7-ba72-632a83cf04d5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:58.573927 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f622b32-cd23-46c7-ba72-632a83cf04d5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:58.574418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f622b32-cd23-46c7-ba72-632a83cf04d5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:58.803512 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7f622b32-cd23-46c7-ba72-632a83cf04d5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:19:58.822704 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7f622b32-cd23-46c7-ba72-632a83cf04d5 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121" status: 200 len: 1393 microversion: 2.1 time: 0.269569 Aug 04 18:19:58.823748 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3803/7635] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:19:58 2022] GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121 => generated 1393 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:19:58.963783 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-ee62b620-23f8-432f-a520-1819d314a893 req-fa601908-0443-4aff-bb46-311888296ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f5197c-ecfe-44cb-861d-850368711121", "name": "network-vif-plugged", "status": "completed", "tag": "26936515-cfcd-403c-9e24-707c2f137320"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:19:58.975357 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:19:58.986885 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ee62b620-23f8-432f-a520-1819d314a893 req-fa601908-0443-4aff-bb46-311888296ba4 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:58.987754 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ee62b620-23f8-432f-a520-1819d314a893 req-fa601908-0443-4aff-bb46-311888296ba4 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:58.988507 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ee62b620-23f8-432f-a520-1819d314a893 req-fa601908-0443-4aff-bb46-311888296ba4 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:59.011365 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-ee62b620-23f8-432f-a520-1819d314a893 req-fa601908-0443-4aff-bb46-311888296ba4 service nova] Creating event network-vif-plugged:26936515-cfcd-403c-9e24-707c2f137320 for instance 23f5197c-ecfe-44cb-861d-850368711121 on n-h1-851359-3 Aug 04 18:19:59.021263 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-ee62b620-23f8-432f-a520-1819d314a893 req-fa601908-0443-4aff-bb46-311888296ba4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063946 Aug 04 18:19:59.022370 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3833/7636] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:19:59.861328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d6798e44-76e4-4492-9ca5-53d7767ee00a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:19:59.862188 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d6798e44-76e4-4492-9ca5-53d7767ee00a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 23f5197c-ecfe-44cb-861d-850368711121] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:19:59.866219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:19:59.873868 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6798e44-76e4-4492-9ca5-53d7767ee00a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:59.874813 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6798e44-76e4-4492-9ca5-53d7767ee00a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:59.875382 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6798e44-76e4-4492-9ca5-53d7767ee00a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:19:59.876242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6798e44-76e4-4492-9ca5-53d7767ee00a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:19:59.876901 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6798e44-76e4-4492-9ca5-53d7767ee00a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:19:59.877423 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6798e44-76e4-4492-9ca5-53d7767ee00a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:00.117696 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d6798e44-76e4-4492-9ca5-53d7767ee00a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:20:00.127253 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d6798e44-76e4-4492-9ca5-53d7767ee00a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121" status: 200 len: 1393 microversion: 2.1 time: 0.271390 Aug 04 18:20:00.132404 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3804/7637] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:19:59 2022] GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121 => generated 1393 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:20:01.160227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-42062832-c309-49cd-8dad-1e9ee32a0d17 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:20:01.161464 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-42062832-c309-49cd-8dad-1e9ee32a0d17 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 23f5197c-ecfe-44cb-861d-850368711121] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:20:01.172834 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42062832-c309-49cd-8dad-1e9ee32a0d17 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:01.173717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42062832-c309-49cd-8dad-1e9ee32a0d17 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:01.174640 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42062832-c309-49cd-8dad-1e9ee32a0d17 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:01.175872 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42062832-c309-49cd-8dad-1e9ee32a0d17 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:01.176680 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42062832-c309-49cd-8dad-1e9ee32a0d17 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:01.177436 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-42062832-c309-49cd-8dad-1e9ee32a0d17 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:01.367144 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-42062832-c309-49cd-8dad-1e9ee32a0d17 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:20:01.381646 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-42062832-c309-49cd-8dad-1e9ee32a0d17 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121" status: 200 len: 1566 microversion: 2.1 time: 0.231143 Aug 04 18:20:01.382778 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3834/7638] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:20:01 2022] GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121 => generated 1566 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:20:01.419462 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f348303e-f6f9-48b3-b8db-f4e455fc2ce8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:20:01.420028 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f348303e-f6f9-48b3-b8db-f4e455fc2ce8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 23f5197c-ecfe-44cb-861d-850368711121] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:20:01.427249 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f348303e-f6f9-48b3-b8db-f4e455fc2ce8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:01.427765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f348303e-f6f9-48b3-b8db-f4e455fc2ce8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:01.428232 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f348303e-f6f9-48b3-b8db-f4e455fc2ce8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:01.428974 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f348303e-f6f9-48b3-b8db-f4e455fc2ce8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:01.429448 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f348303e-f6f9-48b3-b8db-f4e455fc2ce8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:01.429894 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f348303e-f6f9-48b3-b8db-f4e455fc2ce8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:01.598590 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f348303e-f6f9-48b3-b8db-f4e455fc2ce8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:20:01.607579 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f348303e-f6f9-48b3-b8db-f4e455fc2ce8 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121" status: 200 len: 1566 microversion: 2.1 time: 0.193487 Aug 04 18:20:01.608519 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3805/7639] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:20:01 2022] GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121 => generated 1566 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:20:03.906224 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-249c3f7b-44e1-419f-b949-1fef720ba923 req-458e2dc4-ece7-4edc-af8e-c7f2075be63e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23f5197c-ecfe-44cb-861d-850368711121", "tag": "26936515-cfcd-403c-9e24-707c2f137320"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:20:03.912761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3a5fa830-607e-48ec-9dd4-1c396c86e0fd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:20:03.913752 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3a5fa830-607e-48ec-9dd4-1c396c86e0fd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 23f5197c-ecfe-44cb-861d-850368711121] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:20:03.930159 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-249c3f7b-44e1-419f-b949-1fef720ba923 req-458e2dc4-ece7-4edc-af8e-c7f2075be63e service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:03.931679 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-249c3f7b-44e1-419f-b949-1fef720ba923 req-458e2dc4-ece7-4edc-af8e-c7f2075be63e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:03.932562 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-249c3f7b-44e1-419f-b949-1fef720ba923 req-458e2dc4-ece7-4edc-af8e-c7f2075be63e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:03.935495 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a5fa830-607e-48ec-9dd4-1c396c86e0fd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:03.942041 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a5fa830-607e-48ec-9dd4-1c396c86e0fd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:03.944114 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a5fa830-607e-48ec-9dd4-1c396c86e0fd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:03.947031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a5fa830-607e-48ec-9dd4-1c396c86e0fd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:03.950260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a5fa830-607e-48ec-9dd4-1c396c86e0fd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:03.951210 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a5fa830-607e-48ec-9dd4-1c396c86e0fd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:03.958758 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-249c3f7b-44e1-419f-b949-1fef720ba923 req-458e2dc4-ece7-4edc-af8e-c7f2075be63e service nova] Creating event network-changed:26936515-cfcd-403c-9e24-707c2f137320 for instance 23f5197c-ecfe-44cb-861d-850368711121 on n-h1-851359-3 Aug 04 18:20:03.968766 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-249c3f7b-44e1-419f-b949-1fef720ba923 req-458e2dc4-ece7-4edc-af8e-c7f2075be63e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066353 Aug 04 18:20:03.970209 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3806/7640] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:20:04.362771 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3a5fa830-607e-48ec-9dd4-1c396c86e0fd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:20:04.377663 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3a5fa830-607e-48ec-9dd4-1c396c86e0fd tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121" status: 200 len: 1566 microversion: 2.1 time: 0.480479 Aug 04 18:20:04.379571 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3835/7641] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:20:03 2022] GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121 => generated 1566 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:20:25.729129 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c0c55ee6-998b-4128-b496-2a0b3e530486 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:20:25.733935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c0c55ee6-998b-4128-b496-2a0b3e530486 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 23f5197c-ecfe-44cb-861d-850368711121] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:20:25.739027 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=5 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:20:25.740214 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=46 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:20:25.752062 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0c55ee6-998b-4128-b496-2a0b3e530486 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:25.752906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0c55ee6-998b-4128-b496-2a0b3e530486 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:25.753676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0c55ee6-998b-4128-b496-2a0b3e530486 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:25.754961 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0c55ee6-998b-4128-b496-2a0b3e530486 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:25.755814 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0c55ee6-998b-4128-b496-2a0b3e530486 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:25.756623 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0c55ee6-998b-4128-b496-2a0b3e530486 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:25.834989 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c0c55ee6-998b-4128-b496-2a0b3e530486 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "POST /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121/action" status: 200 len: 24574 microversion: 2.1 time: 0.113126 Aug 04 18:20:25.836524 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3807/7642] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:20:25 2022] POST /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121/action => generated 24574 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 18:20:32.230972 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ed45c0c8-b3db-4d4c-b649-cc856f1a73f7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:20:32.231691 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ed45c0c8-b3db-4d4c-b649-cc856f1a73f7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 23f5197c-ecfe-44cb-861d-850368711121] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:20:32.234515 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=18 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:20:32.235088 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=34 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:20:32.241870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed45c0c8-b3db-4d4c-b649-cc856f1a73f7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:32.242412 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed45c0c8-b3db-4d4c-b649-cc856f1a73f7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:32.242861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed45c0c8-b3db-4d4c-b649-cc856f1a73f7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:32.243605 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed45c0c8-b3db-4d4c-b649-cc856f1a73f7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:32.244079 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed45c0c8-b3db-4d4c-b649-cc856f1a73f7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:32.244521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ed45c0c8-b3db-4d4c-b649-cc856f1a73f7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:32.274167 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.objects.instance [None req-ed45c0c8-b3db-4d4c-b649-cc856f1a73f7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lazy-loading 'flavor' on Instance uuid 23f5197c-ecfe-44cb-861d-850368711121 {{(pid=131043) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 18:20:32.357813 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ed45c0c8-b3db-4d4c-b649-cc856f1a73f7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "POST /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121/action" status: 202 len: 0 microversion: 2.1 time: 0.131603 Aug 04 18:20:32.359507 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3836/7643] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:20:32 2022] POST /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 18:20:32.375658 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2cb499f6-344d-41f0-ad54-0a607eac4c8d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:20:32.377048 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2cb499f6-344d-41f0-ad54-0a607eac4c8d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 23f5197c-ecfe-44cb-861d-850368711121] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:20:32.390403 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2cb499f6-344d-41f0-ad54-0a607eac4c8d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:32.390937 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2cb499f6-344d-41f0-ad54-0a607eac4c8d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:32.391424 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2cb499f6-344d-41f0-ad54-0a607eac4c8d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:32.392186 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2cb499f6-344d-41f0-ad54-0a607eac4c8d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:32.392674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2cb499f6-344d-41f0-ad54-0a607eac4c8d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:32.393131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2cb499f6-344d-41f0-ad54-0a607eac4c8d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:32.569600 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2cb499f6-344d-41f0-ad54-0a607eac4c8d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:20:32.582802 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2cb499f6-344d-41f0-ad54-0a607eac4c8d tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121" status: 200 len: 1693 microversion: 2.1 time: 0.216654 Aug 04 18:20:32.583824 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3808/7644] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:20:32 2022] GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121 => generated 1693 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:20:33.622319 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-61cf92f7-727b-45a7-91d6-b4914bea64f1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:20:33.624105 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-61cf92f7-727b-45a7-91d6-b4914bea64f1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 23f5197c-ecfe-44cb-861d-850368711121] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:20:33.635006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61cf92f7-727b-45a7-91d6-b4914bea64f1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:33.635834 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61cf92f7-727b-45a7-91d6-b4914bea64f1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:33.636646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61cf92f7-727b-45a7-91d6-b4914bea64f1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:33.637921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61cf92f7-727b-45a7-91d6-b4914bea64f1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:33.638744 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61cf92f7-727b-45a7-91d6-b4914bea64f1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:33.640150 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-61cf92f7-727b-45a7-91d6-b4914bea64f1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:33.818320 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-61cf92f7-727b-45a7-91d6-b4914bea64f1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:20:33.827610 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-61cf92f7-727b-45a7-91d6-b4914bea64f1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121" status: 200 len: 1676 microversion: 2.1 time: 0.214936 Aug 04 18:20:33.828120 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3837/7645] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:20:33 2022] GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121 => generated 1676 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:20:34.937455 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c0b9f5a0-1b8d-44a2-b35e-c6b10355bb55 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:20:34.942380 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c0b9f5a0-1b8d-44a2-b35e-c6b10355bb55 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 23f5197c-ecfe-44cb-861d-850368711121] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:20:34.948725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0b9f5a0-1b8d-44a2-b35e-c6b10355bb55 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:34.949371 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0b9f5a0-1b8d-44a2-b35e-c6b10355bb55 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:34.949747 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0b9f5a0-1b8d-44a2-b35e-c6b10355bb55 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:34.950589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0b9f5a0-1b8d-44a2-b35e-c6b10355bb55 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:34.951081 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0b9f5a0-1b8d-44a2-b35e-c6b10355bb55 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:34.952391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0b9f5a0-1b8d-44a2-b35e-c6b10355bb55 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:35.033034 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c0b9f5a0-1b8d-44a2-b35e-c6b10355bb55 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "POST /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121/action" status: 200 len: 35247 microversion: 2.1 time: 0.102414 Aug 04 18:20:35.034029 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3809/7646] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:20:34 2022] POST /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121/action => generated 35247 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 18:20:35.047821 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c5cb6334-f9cd-408b-903b-d76ab023a5ea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:20:35.048440 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c5cb6334-f9cd-408b-903b-d76ab023a5ea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 23f5197c-ecfe-44cb-861d-850368711121] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:20:35.056113 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c5cb6334-f9cd-408b-903b-d76ab023a5ea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:35.056768 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c5cb6334-f9cd-408b-903b-d76ab023a5ea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:35.057259 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c5cb6334-f9cd-408b-903b-d76ab023a5ea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:35.058097 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c5cb6334-f9cd-408b-903b-d76ab023a5ea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:35.058655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c5cb6334-f9cd-408b-903b-d76ab023a5ea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:35.059157 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c5cb6334-f9cd-408b-903b-d76ab023a5ea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:35.153541 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c5cb6334-f9cd-408b-903b-d76ab023a5ea tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "POST /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121/action" status: 202 len: 0 microversion: 2.1 time: 0.109647 Aug 04 18:20:35.155496 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3838/7647] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:20:35 2022] POST /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 18:20:35.169211 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8a15d961-b017-489a-842f-c50bbabba787 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:20:35.170640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8a15d961-b017-489a-842f-c50bbabba787 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 23f5197c-ecfe-44cb-861d-850368711121] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:20:35.187148 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a15d961-b017-489a-842f-c50bbabba787 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:35.187148 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a15d961-b017-489a-842f-c50bbabba787 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:35.187148 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a15d961-b017-489a-842f-c50bbabba787 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:35.187148 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a15d961-b017-489a-842f-c50bbabba787 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:35.187148 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a15d961-b017-489a-842f-c50bbabba787 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:35.187148 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a15d961-b017-489a-842f-c50bbabba787 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:35.474404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8a15d961-b017-489a-842f-c50bbabba787 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:20:35.484137 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8a15d961-b017-489a-842f-c50bbabba787 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121" status: 200 len: 1682 microversion: 2.1 time: 0.321494 Aug 04 18:20:35.484756 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3810/7648] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:20:35 2022] GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121 => generated 1682 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:20:36.510816 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0ebebdfd-4b6d-4666-85b2-34939a0f19ac tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:20:36.511932 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0ebebdfd-4b6d-4666-85b2-34939a0f19ac tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 23f5197c-ecfe-44cb-861d-850368711121] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:20:36.520292 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ebebdfd-4b6d-4666-85b2-34939a0f19ac tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:36.520801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ebebdfd-4b6d-4666-85b2-34939a0f19ac tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:36.521248 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ebebdfd-4b6d-4666-85b2-34939a0f19ac tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:36.522018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ebebdfd-4b6d-4666-85b2-34939a0f19ac tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:36.522497 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ebebdfd-4b6d-4666-85b2-34939a0f19ac tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:36.522947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0ebebdfd-4b6d-4666-85b2-34939a0f19ac tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:36.699766 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0ebebdfd-4b6d-4666-85b2-34939a0f19ac tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:20:36.711424 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0ebebdfd-4b6d-4666-85b2-34939a0f19ac tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121" status: 200 len: 1682 microversion: 2.1 time: 0.205601 Aug 04 18:20:36.712534 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3839/7649] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:20:36 2022] GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121 => generated 1682 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:20:37.737069 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0661d259-6e10-4a3e-b9ec-ce29e3dda4c1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:20:37.737765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0661d259-6e10-4a3e-b9ec-ce29e3dda4c1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 23f5197c-ecfe-44cb-861d-850368711121] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:20:37.749769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0661d259-6e10-4a3e-b9ec-ce29e3dda4c1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:37.750320 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0661d259-6e10-4a3e-b9ec-ce29e3dda4c1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:37.750786 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0661d259-6e10-4a3e-b9ec-ce29e3dda4c1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:37.751550 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0661d259-6e10-4a3e-b9ec-ce29e3dda4c1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:37.752038 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0661d259-6e10-4a3e-b9ec-ce29e3dda4c1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:37.752490 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0661d259-6e10-4a3e-b9ec-ce29e3dda4c1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:37.913707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0661d259-6e10-4a3e-b9ec-ce29e3dda4c1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:20:37.923382 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0661d259-6e10-4a3e-b9ec-ce29e3dda4c1 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121" status: 200 len: 1685 microversion: 2.1 time: 0.190745 Aug 04 18:20:37.924006 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3811/7650] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:20:37 2022] GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121 => generated 1685 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:20:38.046197 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-742d60f6-4233-46a9-b2a3-7dbc6cb4483c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:20:38.048421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-742d60f6-4233-46a9-b2a3-7dbc6cb4483c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 23f5197c-ecfe-44cb-861d-850368711121] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:20:38.056442 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-742d60f6-4233-46a9-b2a3-7dbc6cb4483c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:38.056942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-742d60f6-4233-46a9-b2a3-7dbc6cb4483c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:38.057388 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-742d60f6-4233-46a9-b2a3-7dbc6cb4483c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:38.058345 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-742d60f6-4233-46a9-b2a3-7dbc6cb4483c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:38.059146 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-742d60f6-4233-46a9-b2a3-7dbc6cb4483c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:38.059926 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-742d60f6-4233-46a9-b2a3-7dbc6cb4483c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:38.140279 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-742d60f6-4233-46a9-b2a3-7dbc6cb4483c tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "POST /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121/action" status: 200 len: 35247 microversion: 2.1 time: 0.097250 Aug 04 18:20:38.140956 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3840/7651] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:20:38 2022] POST /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121/action => generated 35247 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 18:20:39.707050 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ba3b8ace-0497-4760-9e19-8760ee5b8951 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:20:39.708408 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ba3b8ace-0497-4760-9e19-8760ee5b8951 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 23f5197c-ecfe-44cb-861d-850368711121] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:20:39.713298 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-a20c819d-94f5-441e-8439-ffbe0323cbdb req-b22f01fc-452c-4de3-ac95-88c3b3675376 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23f5197c-ecfe-44cb-861d-850368711121", "tag": "26936515-cfcd-403c-9e24-707c2f137320"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:20:39.722101 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba3b8ace-0497-4760-9e19-8760ee5b8951 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:39.723173 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba3b8ace-0497-4760-9e19-8760ee5b8951 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:39.724117 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba3b8ace-0497-4760-9e19-8760ee5b8951 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:39.725538 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba3b8ace-0497-4760-9e19-8760ee5b8951 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:39.726815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba3b8ace-0497-4760-9e19-8760ee5b8951 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:39.727718 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba3b8ace-0497-4760-9e19-8760ee5b8951 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:39.735394 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a20c819d-94f5-441e-8439-ffbe0323cbdb req-b22f01fc-452c-4de3-ac95-88c3b3675376 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:39.736189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a20c819d-94f5-441e-8439-ffbe0323cbdb req-b22f01fc-452c-4de3-ac95-88c3b3675376 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:39.736921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-a20c819d-94f5-441e-8439-ffbe0323cbdb req-b22f01fc-452c-4de3-ac95-88c3b3675376 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:39.781953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ba3b8ace-0497-4760-9e19-8760ee5b8951 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 23f5197c-ecfe-44cb-861d-850368711121] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 18:20:39.919407 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ba3b8ace-0497-4760-9e19-8760ee5b8951 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "DELETE /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121" status: 204 len: 0 microversion: 2.1 time: 0.219545 Aug 04 18:20:39.920294 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3812/7652] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 18:20:39 2022] DELETE /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 18:20:39.937416 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f51af650-a2fd-4bdc-a09d-32d2f7e3f5bc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:20:39.939056 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f51af650-a2fd-4bdc-a09d-32d2f7e3f5bc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 23f5197c-ecfe-44cb-861d-850368711121] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:20:39.951099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f51af650-a2fd-4bdc-a09d-32d2f7e3f5bc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:39.952633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f51af650-a2fd-4bdc-a09d-32d2f7e3f5bc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:39.953469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f51af650-a2fd-4bdc-a09d-32d2f7e3f5bc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:39.954996 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f51af650-a2fd-4bdc-a09d-32d2f7e3f5bc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:39.955835 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f51af650-a2fd-4bdc-a09d-32d2f7e3f5bc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:39.956652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f51af650-a2fd-4bdc-a09d-32d2f7e3f5bc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:40.091633 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-a20c819d-94f5-441e-8439-ffbe0323cbdb req-b22f01fc-452c-4de3-ac95-88c3b3675376 service nova] Creating event network-changed:26936515-cfcd-403c-9e24-707c2f137320 for instance 23f5197c-ecfe-44cb-861d-850368711121 on n-h1-851359-3 Aug 04 18:20:40.098733 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-a20c819d-94f5-441e-8439-ffbe0323cbdb req-b22f01fc-452c-4de3-ac95-88c3b3675376 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.393328 Aug 04 18:20:40.099762 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3841/7653] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:20:40.174996 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f51af650-a2fd-4bdc-a09d-32d2f7e3f5bc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:20:40.190409 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f51af650-a2fd-4bdc-a09d-32d2f7e3f5bc tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121" status: 200 len: 1691 microversion: 2.1 time: 0.261372 Aug 04 18:20:40.191490 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3813/7654] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:20:39 2022] GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121 => generated 1691 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:20:41.232387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b1fe56e9-40d9-460c-8924-1ed5a9be8f02 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:20:41.234194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b1fe56e9-40d9-460c-8924-1ed5a9be8f02 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 23f5197c-ecfe-44cb-861d-850368711121] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:20:41.247483 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1fe56e9-40d9-460c-8924-1ed5a9be8f02 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:41.248377 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1fe56e9-40d9-460c-8924-1ed5a9be8f02 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:41.249172 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1fe56e9-40d9-460c-8924-1ed5a9be8f02 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:41.250529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1fe56e9-40d9-460c-8924-1ed5a9be8f02 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:41.251372 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1fe56e9-40d9-460c-8924-1ed5a9be8f02 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:41.252175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b1fe56e9-40d9-460c-8924-1ed5a9be8f02 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:41.512529 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b1fe56e9-40d9-460c-8924-1ed5a9be8f02 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:20:41.522069 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b1fe56e9-40d9-460c-8924-1ed5a9be8f02 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121" status: 200 len: 1691 microversion: 2.1 time: 0.298350 Aug 04 18:20:41.522660 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3842/7655] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:20:41 2022] GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121 => generated 1691 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:20:42.488723 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-9a6b10bc-176c-42aa-beaa-839027bd94d3 req-248e87fa-1f2d-4fa8-a476-1fac75df8579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f5197c-ecfe-44cb-861d-850368711121", "name": "network-vif-deleted", "tag": "26936515-cfcd-403c-9e24-707c2f137320"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:20:42.500803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9a6b10bc-176c-42aa-beaa-839027bd94d3 req-248e87fa-1f2d-4fa8-a476-1fac75df8579 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:42.501314 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9a6b10bc-176c-42aa-beaa-839027bd94d3 req-248e87fa-1f2d-4fa8-a476-1fac75df8579 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:42.501770 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9a6b10bc-176c-42aa-beaa-839027bd94d3 req-248e87fa-1f2d-4fa8-a476-1fac75df8579 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:42.515596 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-9a6b10bc-176c-42aa-beaa-839027bd94d3 req-248e87fa-1f2d-4fa8-a476-1fac75df8579 service nova] Creating event network-vif-deleted:26936515-cfcd-403c-9e24-707c2f137320 for instance 23f5197c-ecfe-44cb-861d-850368711121 on n-h1-851359-3 Aug 04 18:20:42.522270 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-9a6b10bc-176c-42aa-beaa-839027bd94d3 req-248e87fa-1f2d-4fa8-a476-1fac75df8579 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038243 Aug 04 18:20:42.522944 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3814/7656] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:20:42.550258 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f455c9e3-3077-4250-bf38-e97861ee3789 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:20:42.551264 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f455c9e3-3077-4250-bf38-e97861ee3789 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 23f5197c-ecfe-44cb-861d-850368711121] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:20:42.562691 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f455c9e3-3077-4250-bf38-e97861ee3789 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:42.563201 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f455c9e3-3077-4250-bf38-e97861ee3789 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:42.563649 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f455c9e3-3077-4250-bf38-e97861ee3789 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:42.564375 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f455c9e3-3077-4250-bf38-e97861ee3789 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:42.564852 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f455c9e3-3077-4250-bf38-e97861ee3789 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:42.565285 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f455c9e3-3077-4250-bf38-e97861ee3789 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:42.656555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f455c9e3-3077-4250-bf38-e97861ee3789 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ad5b583f7f49e0b36ea7d3d75c9a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6f9f1c52b34546af469a9d43d466db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:20:42.666456 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f455c9e3-3077-4250-bf38-e97861ee3789 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121" status: 200 len: 1352 microversion: 2.1 time: 0.124496 Aug 04 18:20:42.667207 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3843/7657] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:20:42 2022] GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121 => generated 1352 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:20:43.690628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-31fbe2af-b631-4c5f-a17a-0b83e3b544d7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:20:43.691850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-31fbe2af-b631-4c5f-a17a-0b83e3b544d7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] [instance: 23f5197c-ecfe-44cb-861d-850368711121] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:20:43.700324 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31fbe2af-b631-4c5f-a17a-0b83e3b544d7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:43.700901 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31fbe2af-b631-4c5f-a17a-0b83e3b544d7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:43.702267 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31fbe2af-b631-4c5f-a17a-0b83e3b544d7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:43.702984 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31fbe2af-b631-4c5f-a17a-0b83e3b544d7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:20:43.703514 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31fbe2af-b631-4c5f-a17a-0b83e3b544d7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:20:43.704001 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31fbe2af-b631-4c5f-a17a-0b83e3b544d7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:20:43.721773 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-31fbe2af-b631-4c5f-a17a-0b83e3b544d7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] HTTP exception thrown: Instance 23f5197c-ecfe-44cb-861d-850368711121 could not be found. Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-31fbe2af-b631-4c5f-a17a-0b83e3b544d7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Request method failure captured: Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121 HTTP/1.1 Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7AwIjCsovibYcH6ErWxGJedA-SXylLsKvn2zpdpI2y0HfanfgcItDr2cHF1i3ynCG5lmDiVO7c8mMcbqfLpue1bmLw9gTl9Y1GTYLYZrG8HdwuvNirSZtowkucGnoPRO0LnscJrHruNXZPpdU2GfZAeK3oRPo9VtZizbrtXsNeEIQOc Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: ca6f9f1c52b34546af469a9d43d466db Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-103139372 Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca6f9f1c52b34546af469a9d43d466db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ca6f9f1c52b34546af469a9d43d466db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ca6f9f1c52b34546af469a9d43d466db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ca6f9f1c52b34546af469a9d43d466db"}]}] Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TestNetworkAdvancedServerOps-103139372 Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: ca6f9f1c52b34546af469a9d43d466db Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-103139372 Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TestNetworkAdvancedServerOps-103139372-project Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 35ad5b583f7f49e0b36ea7d3d75c9a20 Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TestNetworkAdvancedServerOps-103139372-project Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 23f5197c-ecfe-44cb-861d-850368711121 could not be found. Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '23f5197c-ecfe-44cb-861d-850368711121'} Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23f5197c-ecfe-44cb-861d-850368711121 could not be found. Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23f5197c-ecfe-44cb-861d-850368711121 could not be found. Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:20:43.723877 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:20:43.731778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:20:43.731778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:20:43.731778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:20:43.731778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:20:43.731778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:20:43.731778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:20:43.731778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23f5197c-ecfe-44cb-861d-850368711121 could not be found. Aug 04 18:20:43.731778 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:20:43.731778 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-31fbe2af-b631-4c5f-a17a-0b83e3b544d7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Returning 404 to user: Instance 23f5197c-ecfe-44cb-861d-850368711121 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:20:43.731778 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-31fbe2af-b631-4c5f-a17a-0b83e3b544d7 tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121" status: 404 len: 111 microversion: 2.1 time: 0.041252 Aug 04 18:20:43.731778 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3815/7658] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:20:43 2022] GET /compute/v2.1/servers/23f5197c-ecfe-44cb-861d-850368711121 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 18:20:48.276152 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-64f2dfbc-986e-457f-afe0-ed64e8ab1f3a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] Calling method '.version_select at 0x7f1e5a13f9d0>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:20:48.312738 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-64f2dfbc-986e-457f-afe0-ed64e8ab1f3a tempest-TestNetworkAdvancedServerOps-103139372 tempest-TestNetworkAdvancedServerOps-103139372-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1072648328" status: 202 len: 0 microversion: 2.1 time: 0.041443 Aug 04 18:20:48.314014 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3844/7659] 10.222.0.93 () {58 vars in 1284 bytes} [Thu Aug 4 18:20:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1072648328 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 18:21:03.521943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:21:03.525878 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:21:03.808482 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0314af83-019c-4add-ad96-d33c8da28d74 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Action: 'create', calling method: .version_select at 0x7f1e5a320b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-2058376615", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP8BUyLobwSPojGxbr52t0Gxwp1w0Z68/JZM0UZQb1mWKRt2FScoWyTICiMtwprBAGYP9qoY15VLlyjxJB64BwI0EVVDCfmJbWyqrDbJ2Wo6KR+APvMU3E59fzXPQ/DeDQ=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:21:03.829504 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-0314af83-019c-4add-ad96-d33c8da28d74 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Getting quotas for project d6b1025d4b4b47878d13cc547a78e869. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 18:21:03.835668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-0314af83-019c-4add-ad96-d33c8da28d74 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Getting quotas for user 4d38392324f546cf806b6ff92738b4b9 and project d6b1025d4b4b47878d13cc547a78e869. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 18:21:03.871182 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0314af83-019c-4add-ad96-d33c8da28d74 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.362724 Aug 04 18:21:03.871796 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3816/7660] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 18:21:03 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:21:05.342222 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:21:05.344207 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:21:05.350347 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-646b407e-f5be-4e36-9e4f-c19a97c71eb9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-791957134", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2058376615", "security_groups": [{"name": "tempest-secgroup-smoke-941738353"}], "networks": [{"uuid": "53f06c27-a352-4a00-af04-c789c76cdfb1"}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:21:05.540347 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-646b407e-f5be-4e36-9e4f-c19a97c71eb9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] validate_networks() for [('53f06c27-a352-4a00-af04-c789c76cdfb1', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 18:21:06.171448 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-646b407e-f5be-4e36-9e4f-c19a97c71eb9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 18:21:06.171921 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-646b407e-f5be-4e36-9e4f-c19a97c71eb9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 18:21:06.172525 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-646b407e-f5be-4e36-9e4f-c19a97c71eb9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 18:21:06.173830 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-646b407e-f5be-4e36-9e4f-c19a97c71eb9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 18:21:06.174235 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-646b407e-f5be-4e36-9e4f-c19a97c71eb9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 18:21:06.185518 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-646b407e-f5be-4e36-9e4f-c19a97c71eb9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:21:06.186120 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-646b407e-f5be-4e36-9e4f-c19a97c71eb9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:21:06.186638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-646b407e-f5be-4e36-9e4f-c19a97c71eb9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:21:06.187555 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-646b407e-f5be-4e36-9e4f-c19a97c71eb9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:21:06.188474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-646b407e-f5be-4e36-9e4f-c19a97c71eb9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:21:06.189177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-646b407e-f5be-4e36-9e4f-c19a97c71eb9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:21:06.211239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-646b407e-f5be-4e36-9e4f-c19a97c71eb9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Getting quotas for project d6b1025d4b4b47878d13cc547a78e869. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 18:21:06.219228 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-646b407e-f5be-4e36-9e4f-c19a97c71eb9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Getting quotas for user 4d38392324f546cf806b6ff92738b4b9 and project d6b1025d4b4b47878d13cc547a78e869. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 18:21:06.235290 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-646b407e-f5be-4e36-9e4f-c19a97c71eb9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 18:21:06.237694 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-646b407e-f5be-4e36-9e4f-c19a97c71eb9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 18:21:06.293789 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-646b407e-f5be-4e36-9e4f-c19a97c71eb9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.954083 Aug 04 18:21:06.295460 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3845/7661] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 18:21:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 18:21:06.310858 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f321a6be-4235-4db4-aa3d-f996c643cf52 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:21:06.313574 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f321a6be-4235-4db4-aa3d-f996c643cf52 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:21:06.392585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f321a6be-4235-4db4-aa3d-f996c643cf52 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:21:06.412582 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f321a6be-4235-4db4-aa3d-f996c643cf52 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1246 microversion: 2.1 time: 0.107977 Aug 04 18:21:06.413680 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3817/7662] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:21:06 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1246 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:21:07.437115 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e508d586-fac3-4879-b275-cd4f5b4a3a0e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:21:07.438075 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e508d586-fac3-4879-b275-cd4f5b4a3a0e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:21:07.446995 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e508d586-fac3-4879-b275-cd4f5b4a3a0e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:21:07.447498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e508d586-fac3-4879-b275-cd4f5b4a3a0e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:21:07.448144 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e508d586-fac3-4879-b275-cd4f5b4a3a0e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:21:07.448900 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e508d586-fac3-4879-b275-cd4f5b4a3a0e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:21:07.449362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e508d586-fac3-4879-b275-cd4f5b4a3a0e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:21:07.449795 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e508d586-fac3-4879-b275-cd4f5b4a3a0e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:21:07.533451 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e508d586-fac3-4879-b275-cd4f5b4a3a0e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:21:07.549381 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e508d586-fac3-4879-b275-cd4f5b4a3a0e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1298 microversion: 2.1 time: 0.117101 Aug 04 18:21:07.550533 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3846/7663] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:21:07 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1298 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:21:08.584916 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-03a0e2f7-9823-496f-a111-a426bc99d09e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:21:08.585608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-03a0e2f7-9823-496f-a111-a426bc99d09e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:21:08.594934 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03a0e2f7-9823-496f-a111-a426bc99d09e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:21:08.595400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03a0e2f7-9823-496f-a111-a426bc99d09e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:21:08.595870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03a0e2f7-9823-496f-a111-a426bc99d09e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:21:08.596615 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03a0e2f7-9823-496f-a111-a426bc99d09e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:21:08.597100 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03a0e2f7-9823-496f-a111-a426bc99d09e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:21:08.597607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03a0e2f7-9823-496f-a111-a426bc99d09e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:21:08.825502 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-03a0e2f7-9823-496f-a111-a426bc99d09e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:21:08.837425 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-03a0e2f7-9823-496f-a111-a426bc99d09e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1371 microversion: 2.1 time: 0.256451 Aug 04 18:21:08.838143 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3818/7664] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:21:08 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1371 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:21:09.597819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-ddfc7ceb-3188-462c-a29f-659880046a43 req-9ad2d0be-7774-41b1-8161-6e9254e5c66e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f537bae-0536-4200-b5ca-bf6f0893b0c0", "tag": "12931941-925a-417e-aad2-a4a534f8093b"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:21:09.618850 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ddfc7ceb-3188-462c-a29f-659880046a43 req-9ad2d0be-7774-41b1-8161-6e9254e5c66e service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:21:09.619621 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ddfc7ceb-3188-462c-a29f-659880046a43 req-9ad2d0be-7774-41b1-8161-6e9254e5c66e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:21:09.620228 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-ddfc7ceb-3188-462c-a29f-659880046a43 req-9ad2d0be-7774-41b1-8161-6e9254e5c66e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:21:09.638247 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-ddfc7ceb-3188-462c-a29f-659880046a43 req-9ad2d0be-7774-41b1-8161-6e9254e5c66e service nova] Creating event network-changed:12931941-925a-417e-aad2-a4a534f8093b for instance 5f537bae-0536-4200-b5ca-bf6f0893b0c0 on n-h1-851359-3 Aug 04 18:21:09.648191 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-ddfc7ceb-3188-462c-a29f-659880046a43 req-9ad2d0be-7774-41b1-8161-6e9254e5c66e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057580 Aug 04 18:21:09.649145 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3847/7665] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:21:09.865486 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cad22efe-96ff-4898-a4d0-06070d0ee210 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:21:09.866402 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cad22efe-96ff-4898-a4d0-06070d0ee210 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:21:09.875793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cad22efe-96ff-4898-a4d0-06070d0ee210 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:21:09.876458 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cad22efe-96ff-4898-a4d0-06070d0ee210 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:21:09.876936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cad22efe-96ff-4898-a4d0-06070d0ee210 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:21:09.877780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cad22efe-96ff-4898-a4d0-06070d0ee210 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:21:09.878338 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cad22efe-96ff-4898-a4d0-06070d0ee210 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:21:09.878817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cad22efe-96ff-4898-a4d0-06070d0ee210 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:21:10.082297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cad22efe-96ff-4898-a4d0-06070d0ee210 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:21:10.090867 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cad22efe-96ff-4898-a4d0-06070d0ee210 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1371 microversion: 2.1 time: 0.231495 Aug 04 18:21:10.106099 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3819/7666] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:21:09 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1371 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:21:11.128920 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d9ffa08c-9208-4a8f-b5d6-818cc81275f1 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:21:11.130508 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d9ffa08c-9208-4a8f-b5d6-818cc81275f1 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:21:11.145470 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9ffa08c-9208-4a8f-b5d6-818cc81275f1 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:21:11.146509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9ffa08c-9208-4a8f-b5d6-818cc81275f1 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:21:11.147353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9ffa08c-9208-4a8f-b5d6-818cc81275f1 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:21:11.148700 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9ffa08c-9208-4a8f-b5d6-818cc81275f1 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:21:11.149878 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9ffa08c-9208-4a8f-b5d6-818cc81275f1 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:21:11.150715 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9ffa08c-9208-4a8f-b5d6-818cc81275f1 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:21:11.394117 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d9ffa08c-9208-4a8f-b5d6-818cc81275f1 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:21:11.402917 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d9ffa08c-9208-4a8f-b5d6-818cc81275f1 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1371 microversion: 2.1 time: 0.282684 Aug 04 18:21:11.403726 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3848/7667] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:21:11 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1371 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:21:12.425479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-17005f9f-dcf2-4b3d-83ed-6e6ae616ae65 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:21:12.426246 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-17005f9f-dcf2-4b3d-83ed-6e6ae616ae65 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:21:12.437453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17005f9f-dcf2-4b3d-83ed-6e6ae616ae65 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:21:12.438868 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17005f9f-dcf2-4b3d-83ed-6e6ae616ae65 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:21:12.439721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17005f9f-dcf2-4b3d-83ed-6e6ae616ae65 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:21:12.441061 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17005f9f-dcf2-4b3d-83ed-6e6ae616ae65 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:21:12.441945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17005f9f-dcf2-4b3d-83ed-6e6ae616ae65 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:21:12.442774 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17005f9f-dcf2-4b3d-83ed-6e6ae616ae65 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:21:12.630297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-17005f9f-dcf2-4b3d-83ed-6e6ae616ae65 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:21:12.639819 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-17005f9f-dcf2-4b3d-83ed-6e6ae616ae65 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1371 microversion: 2.1 time: 0.218372 Aug 04 18:21:12.640464 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3820/7668] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:21:12 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1371 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:21:13.667955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bfcbe059-481d-427a-b466-ad9d0328ae78 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:21:13.668615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bfcbe059-481d-427a-b466-ad9d0328ae78 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:21:13.676089 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bfcbe059-481d-427a-b466-ad9d0328ae78 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:21:13.676594 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bfcbe059-481d-427a-b466-ad9d0328ae78 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:21:13.677049 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bfcbe059-481d-427a-b466-ad9d0328ae78 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:21:13.677781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bfcbe059-481d-427a-b466-ad9d0328ae78 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:21:13.678310 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bfcbe059-481d-427a-b466-ad9d0328ae78 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:21:13.678748 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bfcbe059-481d-427a-b466-ad9d0328ae78 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:21:13.838178 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-bfcbe059-481d-427a-b466-ad9d0328ae78 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:21:13.856204 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bfcbe059-481d-427a-b466-ad9d0328ae78 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1371 microversion: 2.1 time: 0.191867 Aug 04 18:21:13.857163 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3849/7669] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:21:13 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:21:14.877267 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7f47629a-3e15-467b-952a-06b4e651128c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:21:14.877910 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7f47629a-3e15-467b-952a-06b4e651128c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:21:14.886319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f47629a-3e15-467b-952a-06b4e651128c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:21:14.886792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f47629a-3e15-467b-952a-06b4e651128c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:21:14.887266 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f47629a-3e15-467b-952a-06b4e651128c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:21:14.888045 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f47629a-3e15-467b-952a-06b4e651128c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:21:14.888542 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f47629a-3e15-467b-952a-06b4e651128c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:21:14.888996 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f47629a-3e15-467b-952a-06b4e651128c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:21:15.104828 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7f47629a-3e15-467b-952a-06b4e651128c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:21:15.116249 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7f47629a-3e15-467b-952a-06b4e651128c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1371 microversion: 2.1 time: 0.242804 Aug 04 18:21:15.117150 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3821/7670] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:21:14 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1371 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:21:15.303042 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-e5fa5c37-819c-4b2f-9c7f-f77f35f4998c req-7ce63286-bdb8-453c-8ac0-0898051f44fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f537bae-0536-4200-b5ca-bf6f0893b0c0", "name": "network-vif-plugged", "status": "completed", "tag": "12931941-925a-417e-aad2-a4a534f8093b"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:21:15.321273 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e5fa5c37-819c-4b2f-9c7f-f77f35f4998c req-7ce63286-bdb8-453c-8ac0-0898051f44fc service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:21:15.322213 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e5fa5c37-819c-4b2f-9c7f-f77f35f4998c req-7ce63286-bdb8-453c-8ac0-0898051f44fc service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:21:15.323025 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e5fa5c37-819c-4b2f-9c7f-f77f35f4998c req-7ce63286-bdb8-453c-8ac0-0898051f44fc service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:21:15.346917 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-e5fa5c37-819c-4b2f-9c7f-f77f35f4998c req-7ce63286-bdb8-453c-8ac0-0898051f44fc service nova] Creating event network-vif-plugged:12931941-925a-417e-aad2-a4a534f8093b for instance 5f537bae-0536-4200-b5ca-bf6f0893b0c0 on n-h1-851359-3 Aug 04 18:21:15.357573 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-e5fa5c37-819c-4b2f-9c7f-f77f35f4998c req-7ce63286-bdb8-453c-8ac0-0898051f44fc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058485 Aug 04 18:21:15.358729 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3850/7671] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:21:16.142589 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8dff95f8-2179-4bce-a980-6df6a282ee8c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:21:16.143722 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8dff95f8-2179-4bce-a980-6df6a282ee8c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:21:16.151162 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dff95f8-2179-4bce-a980-6df6a282ee8c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:21:16.151682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dff95f8-2179-4bce-a980-6df6a282ee8c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:21:16.152139 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dff95f8-2179-4bce-a980-6df6a282ee8c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:21:16.152880 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dff95f8-2179-4bce-a980-6df6a282ee8c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:21:16.153359 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dff95f8-2179-4bce-a980-6df6a282ee8c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:21:16.154400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dff95f8-2179-4bce-a980-6df6a282ee8c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:21:16.307989 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8dff95f8-2179-4bce-a980-6df6a282ee8c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:21:16.322345 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8dff95f8-2179-4bce-a980-6df6a282ee8c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1371 microversion: 2.1 time: 0.185242 Aug 04 18:21:16.322963 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3822/7672] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:21:16 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:21:17.347659 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0699ef73-f328-4823-b34d-b04af03b9640 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:21:17.348523 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0699ef73-f328-4823-b34d-b04af03b9640 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:21:17.350832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:21:17.351624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:21:17.360681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0699ef73-f328-4823-b34d-b04af03b9640 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:21:17.361325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0699ef73-f328-4823-b34d-b04af03b9640 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:21:17.362069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0699ef73-f328-4823-b34d-b04af03b9640 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:21:17.362814 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0699ef73-f328-4823-b34d-b04af03b9640 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:21:17.363407 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0699ef73-f328-4823-b34d-b04af03b9640 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:21:17.363736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0699ef73-f328-4823-b34d-b04af03b9640 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:21:17.540218 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0699ef73-f328-4823-b34d-b04af03b9640 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:21:17.548745 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0699ef73-f328-4823-b34d-b04af03b9640 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1555 microversion: 2.1 time: 0.207243 Aug 04 18:21:17.549364 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3851/7673] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:21:17 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1555 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:21:17.574070 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-70b9976f-3617-4070-a485-cee86759169d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:21:17.576130 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-70b9976f-3617-4070-a485-cee86759169d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:21:17.579609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:21:17.591976 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70b9976f-3617-4070-a485-cee86759169d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:21:17.592925 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70b9976f-3617-4070-a485-cee86759169d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:21:17.593786 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70b9976f-3617-4070-a485-cee86759169d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:21:17.595140 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70b9976f-3617-4070-a485-cee86759169d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:21:17.596047 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70b9976f-3617-4070-a485-cee86759169d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:21:17.596901 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70b9976f-3617-4070-a485-cee86759169d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:21:17.767788 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-70b9976f-3617-4070-a485-cee86759169d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:21:17.775821 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-70b9976f-3617-4070-a485-cee86759169d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1555 microversion: 2.1 time: 0.209115 Aug 04 18:21:17.776417 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3823/7674] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:21:17 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1555 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:21:20.306886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-5e9af76d-9b74-46ab-86ad-fad768a46aaf req-612c4a97-059f-427d-9b19-dd7fc0a475e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f537bae-0536-4200-b5ca-bf6f0893b0c0", "tag": "12931941-925a-417e-aad2-a4a534f8093b"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:21:20.317662 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-5e9af76d-9b74-46ab-86ad-fad768a46aaf req-612c4a97-059f-427d-9b19-dd7fc0a475e9 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:21:20.318185 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-5e9af76d-9b74-46ab-86ad-fad768a46aaf req-612c4a97-059f-427d-9b19-dd7fc0a475e9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:21:20.318639 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-5e9af76d-9b74-46ab-86ad-fad768a46aaf req-612c4a97-059f-427d-9b19-dd7fc0a475e9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:21:20.332862 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-5e9af76d-9b74-46ab-86ad-fad768a46aaf req-612c4a97-059f-427d-9b19-dd7fc0a475e9 service nova] Creating event network-changed:12931941-925a-417e-aad2-a4a534f8093b for instance 5f537bae-0536-4200-b5ca-bf6f0893b0c0 on n-h1-851359-3 Aug 04 18:21:20.340252 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-5e9af76d-9b74-46ab-86ad-fad768a46aaf req-612c4a97-059f-427d-9b19-dd7fc0a475e9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036990 Aug 04 18:21:20.341886 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3852/7675] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:22:43.191712 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:22:43.192717 n-d-851359-3 devstack@n-api.service[131044]: Thu Aug 4 18:22:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:23:02.784825 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:23:02.785573 n-d-851359-3 devstack@n-api.service[131044]: Thu Aug 4 18:23:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:23:14.787847 n-d-851359-3 devstack@n-api.service[131044]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7a822c8f-8f7d-4a50-9afd-aab5c6b46a96] AMQP server on 10.222.0.93:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 18:23:14.788825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:23:14.790327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=36 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:23:14.798103 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c3f21a99-b3c6-4d9f-9c72-39aef0f6b0a2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:23:14.799103 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c3f21a99-b3c6-4d9f-9c72-39aef0f6b0a2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:14.811955 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3f21a99-b3c6-4d9f-9c72-39aef0f6b0a2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:14.812528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3f21a99-b3c6-4d9f-9c72-39aef0f6b0a2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:14.813039 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3f21a99-b3c6-4d9f-9c72-39aef0f6b0a2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:14.813877 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3f21a99-b3c6-4d9f-9c72-39aef0f6b0a2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:14.814583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3f21a99-b3c6-4d9f-9c72-39aef0f6b0a2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:14.815373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3f21a99-b3c6-4d9f-9c72-39aef0f6b0a2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:14.846072 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-c3f21a99-b3c6-4d9f-9c72-39aef0f6b0a2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lazy-loading 'flavor' on Instance uuid 5f537bae-0536-4200-b5ca-bf6f0893b0c0 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 18:23:15.066150 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c3f21a99-b3c6-4d9f-9c72-39aef0f6b0a2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "POST /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0/action" status: 202 len: 0 microversion: 2.1 time: 0.282540 Aug 04 18:23:15.066950 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3824/7676] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:23:14 2022] POST /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 18:23:15.080249 n-d-851359-3 devstack@n-api.service[131043]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f0b45cb0-ceb0-43c7-a760-628eb3be34b7] AMQP server on 10.222.0.93:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 04 18:23:15.080249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:23:15.081552 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=32 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:23:15.091779 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dd946554-4c95-4890-9927-b121941bec78 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:15.093241 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dd946554-4c95-4890-9927-b121941bec78 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:15.107611 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd946554-4c95-4890-9927-b121941bec78 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:15.108441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd946554-4c95-4890-9927-b121941bec78 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:15.109048 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd946554-4c95-4890-9927-b121941bec78 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:15.110604 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd946554-4c95-4890-9927-b121941bec78 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:15.111477 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd946554-4c95-4890-9927-b121941bec78 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:15.112309 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dd946554-4c95-4890-9927-b121941bec78 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:15.320613 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dd946554-4c95-4890-9927-b121941bec78 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:15.330106 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dd946554-4c95-4890-9927-b121941bec78 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1680 microversion: 2.1 time: 0.256755 Aug 04 18:23:15.330712 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3853/7677] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:15 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1680 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:23:16.357758 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-25bb32da-f69c-40fa-b498-06d08f455eaa tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:16.358527 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-25bb32da-f69c-40fa-b498-06d08f455eaa tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:16.367658 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25bb32da-f69c-40fa-b498-06d08f455eaa tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:16.368217 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25bb32da-f69c-40fa-b498-06d08f455eaa tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:16.368716 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25bb32da-f69c-40fa-b498-06d08f455eaa tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:16.369494 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25bb32da-f69c-40fa-b498-06d08f455eaa tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:16.370215 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25bb32da-f69c-40fa-b498-06d08f455eaa tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:16.371029 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25bb32da-f69c-40fa-b498-06d08f455eaa tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:16.380373 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] [7a822c8f-8f7d-4a50-9afd-aab5c6b46a96] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 59172. Aug 04 18:23:16.540748 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-25bb32da-f69c-40fa-b498-06d08f455eaa tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:16.555917 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-25bb32da-f69c-40fa-b498-06d08f455eaa tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1680 microversion: 2.1 time: 0.206970 Aug 04 18:23:16.556984 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3825/7678] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:16 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1680 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:23:17.579421 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2a70ff01-2a61-4f16-81ad-9b52c97d0011 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:17.580097 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2a70ff01-2a61-4f16-81ad-9b52c97d0011 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:17.589735 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2a70ff01-2a61-4f16-81ad-9b52c97d0011 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:17.590363 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2a70ff01-2a61-4f16-81ad-9b52c97d0011 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:17.590997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2a70ff01-2a61-4f16-81ad-9b52c97d0011 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:17.591810 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2a70ff01-2a61-4f16-81ad-9b52c97d0011 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:17.592291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2a70ff01-2a61-4f16-81ad-9b52c97d0011 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:17.592783 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2a70ff01-2a61-4f16-81ad-9b52c97d0011 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:17.613458 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] [f0b45cb0-ceb0-43c7-a760-628eb3be34b7] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 59176. Aug 04 18:23:17.749598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2a70ff01-2a61-4f16-81ad-9b52c97d0011 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:17.758723 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2a70ff01-2a61-4f16-81ad-9b52c97d0011 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1680 microversion: 2.1 time: 0.183280 Aug 04 18:23:17.759627 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3854/7679] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:17 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:23:18.781296 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-766567e2-ab9b-4607-b86a-c4b513841602 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:18.782138 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-766567e2-ab9b-4607-b86a-c4b513841602 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:18.790235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-766567e2-ab9b-4607-b86a-c4b513841602 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:18.791251 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-766567e2-ab9b-4607-b86a-c4b513841602 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:18.791717 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-766567e2-ab9b-4607-b86a-c4b513841602 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:18.792483 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-766567e2-ab9b-4607-b86a-c4b513841602 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:18.792981 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-766567e2-ab9b-4607-b86a-c4b513841602 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:18.793434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-766567e2-ab9b-4607-b86a-c4b513841602 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:18.953307 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-766567e2-ab9b-4607-b86a-c4b513841602 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:18.962153 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-766567e2-ab9b-4607-b86a-c4b513841602 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1680 microversion: 2.1 time: 0.184937 Aug 04 18:23:18.962939 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3826/7680] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:18 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1680 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:23:19.988369 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-834f809a-d9bd-4f5f-a68c-3291009059ea tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:19.989078 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-834f809a-d9bd-4f5f-a68c-3291009059ea tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:20.000896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-834f809a-d9bd-4f5f-a68c-3291009059ea tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:20.001673 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-834f809a-d9bd-4f5f-a68c-3291009059ea tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:20.002308 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-834f809a-d9bd-4f5f-a68c-3291009059ea tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:20.003141 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-834f809a-d9bd-4f5f-a68c-3291009059ea tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:20.003722 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-834f809a-d9bd-4f5f-a68c-3291009059ea tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:20.004507 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-834f809a-d9bd-4f5f-a68c-3291009059ea tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:20.205624 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-834f809a-d9bd-4f5f-a68c-3291009059ea tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:20.214811 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-834f809a-d9bd-4f5f-a68c-3291009059ea tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1680 microversion: 2.1 time: 0.233765 Aug 04 18:23:20.215577 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3855/7681] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:19 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1680 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:23:21.238401 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-235a9767-3d86-4684-9a31-e701e85e2d72 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:21.239077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-235a9767-3d86-4684-9a31-e701e85e2d72 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:21.248067 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-235a9767-3d86-4684-9a31-e701e85e2d72 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:21.248586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-235a9767-3d86-4684-9a31-e701e85e2d72 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:21.249051 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-235a9767-3d86-4684-9a31-e701e85e2d72 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:21.249831 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-235a9767-3d86-4684-9a31-e701e85e2d72 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:21.250350 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-235a9767-3d86-4684-9a31-e701e85e2d72 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:21.250807 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-235a9767-3d86-4684-9a31-e701e85e2d72 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:21.453448 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-235a9767-3d86-4684-9a31-e701e85e2d72 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:21.462704 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-235a9767-3d86-4684-9a31-e701e85e2d72 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1680 microversion: 2.1 time: 0.228804 Aug 04 18:23:21.463781 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3827/7682] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:21 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1680 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:23:22.487807 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-adf9d379-9352-478a-9dab-222e3b428ecd tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:22.488542 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-adf9d379-9352-478a-9dab-222e3b428ecd tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:22.496839 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-adf9d379-9352-478a-9dab-222e3b428ecd tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:22.497406 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-adf9d379-9352-478a-9dab-222e3b428ecd tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:22.497904 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-adf9d379-9352-478a-9dab-222e3b428ecd tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:22.498720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-adf9d379-9352-478a-9dab-222e3b428ecd tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:22.499244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-adf9d379-9352-478a-9dab-222e3b428ecd tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:22.499729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-adf9d379-9352-478a-9dab-222e3b428ecd tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:22.656121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-adf9d379-9352-478a-9dab-222e3b428ecd tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:22.670496 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-adf9d379-9352-478a-9dab-222e3b428ecd tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1680 microversion: 2.1 time: 0.186893 Aug 04 18:23:22.671540 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3856/7683] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:22 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1680 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:23:23.709024 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eed0a765-e8c4-47aa-930e-b9b9ded6ced9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:23.709835 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eed0a765-e8c4-47aa-930e-b9b9ded6ced9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:23.718693 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eed0a765-e8c4-47aa-930e-b9b9ded6ced9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:23.719269 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eed0a765-e8c4-47aa-930e-b9b9ded6ced9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:23.719850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eed0a765-e8c4-47aa-930e-b9b9ded6ced9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:23.720663 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eed0a765-e8c4-47aa-930e-b9b9ded6ced9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:23.721202 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eed0a765-e8c4-47aa-930e-b9b9ded6ced9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:23.721732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eed0a765-e8c4-47aa-930e-b9b9ded6ced9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:23.886684 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eed0a765-e8c4-47aa-930e-b9b9ded6ced9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:23.898283 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eed0a765-e8c4-47aa-930e-b9b9ded6ced9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1680 microversion: 2.1 time: 0.193287 Aug 04 18:23:23.898899 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3828/7684] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:23 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1680 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:23:24.921031 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4abb1133-71e0-4354-9433-49df310d191f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:24.922665 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4abb1133-71e0-4354-9433-49df310d191f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:24.931451 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4abb1133-71e0-4354-9433-49df310d191f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:24.932066 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4abb1133-71e0-4354-9433-49df310d191f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:24.932401 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4abb1133-71e0-4354-9433-49df310d191f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:24.933164 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4abb1133-71e0-4354-9433-49df310d191f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:24.933645 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4abb1133-71e0-4354-9433-49df310d191f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:24.934121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4abb1133-71e0-4354-9433-49df310d191f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:25.106806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4abb1133-71e0-4354-9433-49df310d191f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:25.120408 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4abb1133-71e0-4354-9433-49df310d191f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1680 microversion: 2.1 time: 0.203517 Aug 04 18:23:25.121489 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3857/7685] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:24 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1680 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:23:26.156301 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6d147551-63dd-45ca-b76e-7e505652722e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:26.156952 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6d147551-63dd-45ca-b76e-7e505652722e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:26.164723 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d147551-63dd-45ca-b76e-7e505652722e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:26.165242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d147551-63dd-45ca-b76e-7e505652722e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:26.166296 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d147551-63dd-45ca-b76e-7e505652722e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:26.167041 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d147551-63dd-45ca-b76e-7e505652722e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:26.167519 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d147551-63dd-45ca-b76e-7e505652722e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:26.167966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d147551-63dd-45ca-b76e-7e505652722e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:26.364021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6d147551-63dd-45ca-b76e-7e505652722e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:26.378566 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6d147551-63dd-45ca-b76e-7e505652722e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1701 microversion: 2.1 time: 0.226547 Aug 04 18:23:26.379529 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3829/7686] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:26 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1701 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:23:27.407500 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-549651fa-6f51-4c4b-8a16-378d8b53f3c0 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:27.408162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-549651fa-6f51-4c4b-8a16-378d8b53f3c0 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:27.416331 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-549651fa-6f51-4c4b-8a16-378d8b53f3c0 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:27.416848 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-549651fa-6f51-4c4b-8a16-378d8b53f3c0 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:27.417301 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-549651fa-6f51-4c4b-8a16-378d8b53f3c0 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:27.418087 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-549651fa-6f51-4c4b-8a16-378d8b53f3c0 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:27.418569 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-549651fa-6f51-4c4b-8a16-378d8b53f3c0 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:27.419012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-549651fa-6f51-4c4b-8a16-378d8b53f3c0 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:27.585223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-549651fa-6f51-4c4b-8a16-378d8b53f3c0 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:27.603410 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-549651fa-6f51-4c4b-8a16-378d8b53f3c0 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1701 microversion: 2.1 time: 0.199457 Aug 04 18:23:27.604531 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3858/7687] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:27 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1701 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:23:28.631913 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-54416807-0760-4cfc-98fa-f17987b1c09d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:28.633051 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-54416807-0760-4cfc-98fa-f17987b1c09d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:28.645998 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54416807-0760-4cfc-98fa-f17987b1c09d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:28.646837 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54416807-0760-4cfc-98fa-f17987b1c09d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:28.647588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54416807-0760-4cfc-98fa-f17987b1c09d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:28.648855 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54416807-0760-4cfc-98fa-f17987b1c09d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:28.649684 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54416807-0760-4cfc-98fa-f17987b1c09d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:28.650990 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54416807-0760-4cfc-98fa-f17987b1c09d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:28.944102 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-54416807-0760-4cfc-98fa-f17987b1c09d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:28.960464 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-54416807-0760-4cfc-98fa-f17987b1c09d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1696 microversion: 2.1 time: 0.336712 Aug 04 18:23:28.961299 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3830/7688] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:28 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1696 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:23:29.959343 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-cd2ceb30-384f-4952-849f-cd7536543ad7 req-f5f3043f-cf0e-461a-839e-f66bc5a1001e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f537bae-0536-4200-b5ca-bf6f0893b0c0", "name": "network-vif-plugged", "status": "completed", "tag": "12931941-925a-417e-aad2-a4a534f8093b"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:23:29.971761 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-cd2ceb30-384f-4952-849f-cd7536543ad7 req-f5f3043f-cf0e-461a-839e-f66bc5a1001e service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:29.972263 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-cd2ceb30-384f-4952-849f-cd7536543ad7 req-f5f3043f-cf0e-461a-839e-f66bc5a1001e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:29.972724 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-cd2ceb30-384f-4952-849f-cd7536543ad7 req-f5f3043f-cf0e-461a-839e-f66bc5a1001e service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:29.993207 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-cd2ceb30-384f-4952-849f-cd7536543ad7 req-f5f3043f-cf0e-461a-839e-f66bc5a1001e service nova] Creating event network-vif-plugged:12931941-925a-417e-aad2-a4a534f8093b for instance 5f537bae-0536-4200-b5ca-bf6f0893b0c0 on n-h1-851359-3 Aug 04 18:23:29.999835 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-cd2ceb30-384f-4952-849f-cd7536543ad7 req-f5f3043f-cf0e-461a-839e-f66bc5a1001e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135975 Aug 04 18:23:30.001103 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3859/7689] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:23:30.007642 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9691b9ed-46c4-4f31-ad47-2219807f35b7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:30.008418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9691b9ed-46c4-4f31-ad47-2219807f35b7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:30.019362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9691b9ed-46c4-4f31-ad47-2219807f35b7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:30.019968 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9691b9ed-46c4-4f31-ad47-2219807f35b7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:30.020682 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9691b9ed-46c4-4f31-ad47-2219807f35b7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:30.021595 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9691b9ed-46c4-4f31-ad47-2219807f35b7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:30.022342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9691b9ed-46c4-4f31-ad47-2219807f35b7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:30.022974 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9691b9ed-46c4-4f31-ad47-2219807f35b7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:30.245039 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9691b9ed-46c4-4f31-ad47-2219807f35b7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:30.255216 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9691b9ed-46c4-4f31-ad47-2219807f35b7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1696 microversion: 2.1 time: 0.253972 Aug 04 18:23:30.256468 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3831/7690] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:29 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1696 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:23:31.300517 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2233c1cf-e543-49e8-8d33-527bd3f77018 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:31.301772 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2233c1cf-e543-49e8-8d33-527bd3f77018 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:31.315395 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2233c1cf-e543-49e8-8d33-527bd3f77018 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:31.316754 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2233c1cf-e543-49e8-8d33-527bd3f77018 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:31.317551 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2233c1cf-e543-49e8-8d33-527bd3f77018 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:31.319138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2233c1cf-e543-49e8-8d33-527bd3f77018 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:31.319928 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2233c1cf-e543-49e8-8d33-527bd3f77018 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:31.320987 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-2233c1cf-e543-49e8-8d33-527bd3f77018 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:31.551836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2233c1cf-e543-49e8-8d33-527bd3f77018 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:31.562587 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2233c1cf-e543-49e8-8d33-527bd3f77018 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1696 microversion: 2.1 time: 0.269876 Aug 04 18:23:31.563458 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3860/7691] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:31 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1696 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:23:32.606525 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-527593ab-b0df-48a2-a1ac-6100361675bf tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:32.607896 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-527593ab-b0df-48a2-a1ac-6100361675bf tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:32.622570 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-527593ab-b0df-48a2-a1ac-6100361675bf tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:32.624280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-527593ab-b0df-48a2-a1ac-6100361675bf tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:32.625148 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-527593ab-b0df-48a2-a1ac-6100361675bf tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:32.626184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-527593ab-b0df-48a2-a1ac-6100361675bf tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:32.626943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-527593ab-b0df-48a2-a1ac-6100361675bf tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:32.627539 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-527593ab-b0df-48a2-a1ac-6100361675bf tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:32.883249 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-527593ab-b0df-48a2-a1ac-6100361675bf tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:32.901254 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-527593ab-b0df-48a2-a1ac-6100361675bf tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1696 microversion: 2.1 time: 0.300376 Aug 04 18:23:32.902699 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3832/7692] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:32 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1696 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:23:33.945672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e8397281-8087-4f7d-ac5c-60ccd9d7324f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:33.947514 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e8397281-8087-4f7d-ac5c-60ccd9d7324f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:33.965110 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8397281-8087-4f7d-ac5c-60ccd9d7324f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:33.966257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8397281-8087-4f7d-ac5c-60ccd9d7324f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:33.967139 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8397281-8087-4f7d-ac5c-60ccd9d7324f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:33.968397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8397281-8087-4f7d-ac5c-60ccd9d7324f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:33.969189 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8397281-8087-4f7d-ac5c-60ccd9d7324f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:33.970052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e8397281-8087-4f7d-ac5c-60ccd9d7324f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:34.235844 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e8397281-8087-4f7d-ac5c-60ccd9d7324f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:34.254433 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e8397281-8087-4f7d-ac5c-60ccd9d7324f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1696 microversion: 2.1 time: 0.325050 Aug 04 18:23:34.255739 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3861/7693] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:33 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1696 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:23:35.291779 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4542e9b6-d8ba-4d2c-b73d-ff4938ca95e7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:35.293255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4542e9b6-d8ba-4d2c-b73d-ff4938ca95e7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:35.313928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4542e9b6-d8ba-4d2c-b73d-ff4938ca95e7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:35.314998 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4542e9b6-d8ba-4d2c-b73d-ff4938ca95e7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:35.315793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4542e9b6-d8ba-4d2c-b73d-ff4938ca95e7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:35.317174 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4542e9b6-d8ba-4d2c-b73d-ff4938ca95e7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:35.318457 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4542e9b6-d8ba-4d2c-b73d-ff4938ca95e7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:35.319287 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4542e9b6-d8ba-4d2c-b73d-ff4938ca95e7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:35.561888 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4542e9b6-d8ba-4d2c-b73d-ff4938ca95e7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:35.582190 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4542e9b6-d8ba-4d2c-b73d-ff4938ca95e7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1696 microversion: 2.1 time: 0.298701 Aug 04 18:23:35.606227 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3833/7694] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:35 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1696 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:23:36.639669 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6c2992a8-e575-4410-aa9b-f7c7297a3a0b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:36.640716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6c2992a8-e575-4410-aa9b-f7c7297a3a0b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:36.655051 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c2992a8-e575-4410-aa9b-f7c7297a3a0b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:36.656122 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c2992a8-e575-4410-aa9b-f7c7297a3a0b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:36.656961 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c2992a8-e575-4410-aa9b-f7c7297a3a0b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:36.658546 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c2992a8-e575-4410-aa9b-f7c7297a3a0b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:36.659516 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c2992a8-e575-4410-aa9b-f7c7297a3a0b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:36.660549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6c2992a8-e575-4410-aa9b-f7c7297a3a0b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:36.918686 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6c2992a8-e575-4410-aa9b-f7c7297a3a0b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:36.929956 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6c2992a8-e575-4410-aa9b-f7c7297a3a0b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1696 microversion: 2.1 time: 0.297944 Aug 04 18:23:36.944549 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3862/7695] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:36 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1696 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:23:37.957880 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3b5810ee-adbf-4e2c-beb4-6178ee85a77e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:37.959200 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3b5810ee-adbf-4e2c-beb4-6178ee85a77e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:37.973662 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b5810ee-adbf-4e2c-beb4-6178ee85a77e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:37.974613 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b5810ee-adbf-4e2c-beb4-6178ee85a77e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:37.975446 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b5810ee-adbf-4e2c-beb4-6178ee85a77e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:37.977727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b5810ee-adbf-4e2c-beb4-6178ee85a77e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:37.977727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b5810ee-adbf-4e2c-beb4-6178ee85a77e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:37.979171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b5810ee-adbf-4e2c-beb4-6178ee85a77e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:38.190119 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3b5810ee-adbf-4e2c-beb4-6178ee85a77e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:38.201542 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3b5810ee-adbf-4e2c-beb4-6178ee85a77e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1696 microversion: 2.1 time: 0.250557 Aug 04 18:23:38.202502 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3834/7696] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:37 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1696 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:23:39.231562 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-10e3ce9e-40fa-4d2d-b64b-bf6e042d7094 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:39.232505 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-10e3ce9e-40fa-4d2d-b64b-bf6e042d7094 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:39.241817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-10e3ce9e-40fa-4d2d-b64b-bf6e042d7094 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:39.242729 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-10e3ce9e-40fa-4d2d-b64b-bf6e042d7094 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:39.243717 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-10e3ce9e-40fa-4d2d-b64b-bf6e042d7094 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:39.244714 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-10e3ce9e-40fa-4d2d-b64b-bf6e042d7094 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:39.245317 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-10e3ce9e-40fa-4d2d-b64b-bf6e042d7094 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:39.246081 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-10e3ce9e-40fa-4d2d-b64b-bf6e042d7094 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:39.443712 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-10e3ce9e-40fa-4d2d-b64b-bf6e042d7094 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:39.453610 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-10e3ce9e-40fa-4d2d-b64b-bf6e042d7094 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1678 microversion: 2.1 time: 0.226896 Aug 04 18:23:39.454352 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3863/7697] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:39 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1678 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:23:40.476353 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b2692617-2ed0-4cba-8168-3b0801f9f990 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:40.477184 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b2692617-2ed0-4cba-8168-3b0801f9f990 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:40.485875 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2692617-2ed0-4cba-8168-3b0801f9f990 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:40.486312 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2692617-2ed0-4cba-8168-3b0801f9f990 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:40.486796 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2692617-2ed0-4cba-8168-3b0801f9f990 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:40.487577 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2692617-2ed0-4cba-8168-3b0801f9f990 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:40.488128 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2692617-2ed0-4cba-8168-3b0801f9f990 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:40.488586 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2692617-2ed0-4cba-8168-3b0801f9f990 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:40.679005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b2692617-2ed0-4cba-8168-3b0801f9f990 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:40.690657 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b2692617-2ed0-4cba-8168-3b0801f9f990 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1678 microversion: 2.1 time: 0.218264 Aug 04 18:23:40.691903 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3835/7698] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:40 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1678 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:23:41.716032 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-292729b7-83b9-46c3-bbf3-41319c688dc9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:41.717158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-292729b7-83b9-46c3-bbf3-41319c688dc9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:41.729132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-292729b7-83b9-46c3-bbf3-41319c688dc9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:41.729895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-292729b7-83b9-46c3-bbf3-41319c688dc9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:41.731287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-292729b7-83b9-46c3-bbf3-41319c688dc9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:41.732973 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-292729b7-83b9-46c3-bbf3-41319c688dc9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:41.733670 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-292729b7-83b9-46c3-bbf3-41319c688dc9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:41.734375 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-292729b7-83b9-46c3-bbf3-41319c688dc9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:41.856634 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0f6a373f-f595-448a-ac3e-ff4519f15e24 req-4dbc7ba1-5d81-415f-b7d7-ef35f945a743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f537bae-0536-4200-b5ca-bf6f0893b0c0", "name": "network-vif-unplugged", "status": "completed", "tag": "12931941-925a-417e-aad2-a4a534f8093b"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:23:41.879692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0f6a373f-f595-448a-ac3e-ff4519f15e24 req-4dbc7ba1-5d81-415f-b7d7-ef35f945a743 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:41.881210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0f6a373f-f595-448a-ac3e-ff4519f15e24 req-4dbc7ba1-5d81-415f-b7d7-ef35f945a743 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:41.882131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0f6a373f-f595-448a-ac3e-ff4519f15e24 req-4dbc7ba1-5d81-415f-b7d7-ef35f945a743 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:41.904619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.compute.server_external_events [req-0f6a373f-f595-448a-ac3e-ff4519f15e24 req-4dbc7ba1-5d81-415f-b7d7-ef35f945a743 service nova] Unable to find a host for instance 5f537bae-0536-4200-b5ca-bf6f0893b0c0. Dropping event network-vif-unplugged {{(pid=131044) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 04 18:23:41.906381 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0f6a373f-f595-448a-ac3e-ff4519f15e24 req-4dbc7ba1-5d81-415f-b7d7-ef35f945a743 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.054943 Aug 04 18:23:41.907508 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3836/7699] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 58 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 04 18:23:41.909665 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-292729b7-83b9-46c3-bbf3-41319c688dc9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:41.924208 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-292729b7-83b9-46c3-bbf3-41319c688dc9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1621 microversion: 2.1 time: 0.213756 Aug 04 18:23:41.925176 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3864/7700] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:41 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1621 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:23:41.952034 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2be50c34-6de0-44f8-9554-636212dc6063 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:23:41.953030 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2be50c34-6de0-44f8-9554-636212dc6063 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:41.962212 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2be50c34-6de0-44f8-9554-636212dc6063 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:41.963383 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2be50c34-6de0-44f8-9554-636212dc6063 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:41.964060 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2be50c34-6de0-44f8-9554-636212dc6063 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:41.965411 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2be50c34-6de0-44f8-9554-636212dc6063 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:41.966373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2be50c34-6de0-44f8-9554-636212dc6063 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:41.967213 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2be50c34-6de0-44f8-9554-636212dc6063 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:42.090235 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2be50c34-6de0-44f8-9554-636212dc6063 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=131044) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 18:23:42.193128 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2be50c34-6de0-44f8-9554-636212dc6063 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "POST /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0/action" status: 202 len: 0 microversion: 2.1 time: 0.246945 Aug 04 18:23:42.194166 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3837/7701] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:23:41 2022] POST /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 18:23:42.207409 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b0ea9d5d-8198-4797-b00f-6fc6006f6a87 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:42.207409 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b0ea9d5d-8198-4797-b00f-6fc6006f6a87 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:42.215461 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0ea9d5d-8198-4797-b00f-6fc6006f6a87 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:42.216245 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0ea9d5d-8198-4797-b00f-6fc6006f6a87 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:42.216870 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0ea9d5d-8198-4797-b00f-6fc6006f6a87 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:42.218390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0ea9d5d-8198-4797-b00f-6fc6006f6a87 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:42.219112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0ea9d5d-8198-4797-b00f-6fc6006f6a87 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:42.219777 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b0ea9d5d-8198-4797-b00f-6fc6006f6a87 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:42.408875 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b0ea9d5d-8198-4797-b00f-6fc6006f6a87 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:42.423861 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b0ea9d5d-8198-4797-b00f-6fc6006f6a87 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1629 microversion: 2.1 time: 0.223417 Aug 04 18:23:42.424938 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3865/7702] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:42 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1629 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:23:43.450321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c1e2d547-b5ea-4381-96c9-d87f7c5cdaf7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:43.451281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c1e2d547-b5ea-4381-96c9-d87f7c5cdaf7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:43.459965 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c1e2d547-b5ea-4381-96c9-d87f7c5cdaf7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:43.460738 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c1e2d547-b5ea-4381-96c9-d87f7c5cdaf7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:43.461686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c1e2d547-b5ea-4381-96c9-d87f7c5cdaf7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:43.462981 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c1e2d547-b5ea-4381-96c9-d87f7c5cdaf7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:43.463588 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c1e2d547-b5ea-4381-96c9-d87f7c5cdaf7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:43.464344 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c1e2d547-b5ea-4381-96c9-d87f7c5cdaf7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:43.471580 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:23:43.646632 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c1e2d547-b5ea-4381-96c9-d87f7c5cdaf7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:43.659994 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c1e2d547-b5ea-4381-96c9-d87f7c5cdaf7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1631 microversion: 2.1 time: 0.216769 Aug 04 18:23:43.660623 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3838/7703] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:43 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1631 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:23:44.683798 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3c7c9a0b-c455-415c-bae9-816719dc93ae tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:44.684889 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3c7c9a0b-c455-415c-bae9-816719dc93ae tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:44.693331 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3c7c9a0b-c455-415c-bae9-816719dc93ae tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:44.693868 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3c7c9a0b-c455-415c-bae9-816719dc93ae tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:44.694373 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3c7c9a0b-c455-415c-bae9-816719dc93ae tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:44.695174 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3c7c9a0b-c455-415c-bae9-816719dc93ae tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:44.695668 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3c7c9a0b-c455-415c-bae9-816719dc93ae tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:44.696112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3c7c9a0b-c455-415c-bae9-816719dc93ae tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:44.893208 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3c7c9a0b-c455-415c-bae9-816719dc93ae tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:44.911157 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3c7c9a0b-c455-415c-bae9-816719dc93ae tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1687 microversion: 2.1 time: 0.232800 Aug 04 18:23:44.911990 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3866/7704] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:44 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1687 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:23:45.946894 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6bab0615-57de-4fb5-9102-ae29ec6c04c7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:45.949072 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6bab0615-57de-4fb5-9102-ae29ec6c04c7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:45.959763 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:23:45.987276 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6bab0615-57de-4fb5-9102-ae29ec6c04c7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:45.988150 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6bab0615-57de-4fb5-9102-ae29ec6c04c7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:45.988871 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6bab0615-57de-4fb5-9102-ae29ec6c04c7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:45.989829 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6bab0615-57de-4fb5-9102-ae29ec6c04c7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:45.990509 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6bab0615-57de-4fb5-9102-ae29ec6c04c7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:45.991100 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6bab0615-57de-4fb5-9102-ae29ec6c04c7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:46.381890 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6bab0615-57de-4fb5-9102-ae29ec6c04c7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:46.397854 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6bab0615-57de-4fb5-9102-ae29ec6c04c7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1687 microversion: 2.1 time: 0.458418 Aug 04 18:23:46.410154 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3839/7705] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:45 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1687 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:23:47.427572 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f7a0e48c-7d7b-4066-b0c4-79693720ff62 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:47.429224 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f7a0e48c-7d7b-4066-b0c4-79693720ff62 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:47.434595 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=29 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:23:47.444481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7a0e48c-7d7b-4066-b0c4-79693720ff62 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:47.445628 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7a0e48c-7d7b-4066-b0c4-79693720ff62 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:47.447244 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7a0e48c-7d7b-4066-b0c4-79693720ff62 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:47.448832 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7a0e48c-7d7b-4066-b0c4-79693720ff62 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:47.449801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7a0e48c-7d7b-4066-b0c4-79693720ff62 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:47.450535 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f7a0e48c-7d7b-4066-b0c4-79693720ff62 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:47.455128 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=81 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:23:47.811060 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f7a0e48c-7d7b-4066-b0c4-79693720ff62 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:47.821058 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f7a0e48c-7d7b-4066-b0c4-79693720ff62 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1687 microversion: 2.1 time: 0.403224 Aug 04 18:23:47.838986 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3867/7706] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:47 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1687 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:23:48.862643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-51858992-dc7e-42c7-8484-bf4ec00721d6 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:48.863687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-51858992-dc7e-42c7-8484-bf4ec00721d6 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:48.877036 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51858992-dc7e-42c7-8484-bf4ec00721d6 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:48.878009 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51858992-dc7e-42c7-8484-bf4ec00721d6 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:48.878904 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51858992-dc7e-42c7-8484-bf4ec00721d6 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:48.880539 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51858992-dc7e-42c7-8484-bf4ec00721d6 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:48.881605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51858992-dc7e-42c7-8484-bf4ec00721d6 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:48.882506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51858992-dc7e-42c7-8484-bf4ec00721d6 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:49.133966 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-51858992-dc7e-42c7-8484-bf4ec00721d6 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:49.148777 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-51858992-dc7e-42c7-8484-bf4ec00721d6 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1687 microversion: 2.1 time: 0.295421 Aug 04 18:23:49.150359 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3840/7707] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:48 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1687 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:23:50.185699 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0b2c74d0-b2b3-42f4-9844-bdcb22eebaef tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:50.186536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0b2c74d0-b2b3-42f4-9844-bdcb22eebaef tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:50.194765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b2c74d0-b2b3-42f4-9844-bdcb22eebaef tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:50.195279 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b2c74d0-b2b3-42f4-9844-bdcb22eebaef tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:50.195732 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b2c74d0-b2b3-42f4-9844-bdcb22eebaef tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:50.196476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b2c74d0-b2b3-42f4-9844-bdcb22eebaef tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:50.196978 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b2c74d0-b2b3-42f4-9844-bdcb22eebaef tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:50.197423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0b2c74d0-b2b3-42f4-9844-bdcb22eebaef tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:50.426718 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0b2c74d0-b2b3-42f4-9844-bdcb22eebaef tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:50.436529 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0b2c74d0-b2b3-42f4-9844-bdcb22eebaef tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1687 microversion: 2.1 time: 0.255710 Aug 04 18:23:50.437584 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3868/7708] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:50 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1687 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:23:51.473204 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c0444002-75bd-4141-b738-cf5a6288936f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:51.474776 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c0444002-75bd-4141-b738-cf5a6288936f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:51.488514 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0444002-75bd-4141-b738-cf5a6288936f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:51.489520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0444002-75bd-4141-b738-cf5a6288936f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:51.490463 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0444002-75bd-4141-b738-cf5a6288936f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:51.491873 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0444002-75bd-4141-b738-cf5a6288936f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:51.493124 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0444002-75bd-4141-b738-cf5a6288936f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:51.494287 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0444002-75bd-4141-b738-cf5a6288936f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:51.704884 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c0444002-75bd-4141-b738-cf5a6288936f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:51.720750 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c0444002-75bd-4141-b738-cf5a6288936f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1687 microversion: 2.1 time: 0.254527 Aug 04 18:23:51.722084 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3841/7709] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:51 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1687 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:23:52.748325 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4fcd1e8e-c63d-4cf7-bac0-6fffa8417dbe tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:52.749606 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4fcd1e8e-c63d-4cf7-bac0-6fffa8417dbe tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:52.763129 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4fcd1e8e-c63d-4cf7-bac0-6fffa8417dbe tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:52.764131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4fcd1e8e-c63d-4cf7-bac0-6fffa8417dbe tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:52.765044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4fcd1e8e-c63d-4cf7-bac0-6fffa8417dbe tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:52.766295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4fcd1e8e-c63d-4cf7-bac0-6fffa8417dbe tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:52.767203 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4fcd1e8e-c63d-4cf7-bac0-6fffa8417dbe tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:52.768039 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4fcd1e8e-c63d-4cf7-bac0-6fffa8417dbe tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:52.963829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4fcd1e8e-c63d-4cf7-bac0-6fffa8417dbe tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:52.972420 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4fcd1e8e-c63d-4cf7-bac0-6fffa8417dbe tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1687 microversion: 2.1 time: 0.231791 Aug 04 18:23:52.973028 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3869/7710] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:52 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1687 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:23:54.001018 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5a1f0c84-0a06-42ef-a413-720f4de78213 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:54.002326 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5a1f0c84-0a06-42ef-a413-720f4de78213 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:54.016004 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a1f0c84-0a06-42ef-a413-720f4de78213 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:54.017021 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a1f0c84-0a06-42ef-a413-720f4de78213 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:54.017908 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a1f0c84-0a06-42ef-a413-720f4de78213 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:54.019554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a1f0c84-0a06-42ef-a413-720f4de78213 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:54.020557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a1f0c84-0a06-42ef-a413-720f4de78213 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:54.021394 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a1f0c84-0a06-42ef-a413-720f4de78213 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:54.237767 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5a1f0c84-0a06-42ef-a413-720f4de78213 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:54.248381 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5a1f0c84-0a06-42ef-a413-720f4de78213 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1687 microversion: 2.1 time: 0.256046 Aug 04 18:23:54.249047 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3842/7711] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:53 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1687 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:23:55.284937 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-be83a381-22c9-4b60-82ba-e312cfac2726 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:55.285533 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-be83a381-22c9-4b60-82ba-e312cfac2726 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:55.294099 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be83a381-22c9-4b60-82ba-e312cfac2726 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:55.294614 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be83a381-22c9-4b60-82ba-e312cfac2726 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:55.295071 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be83a381-22c9-4b60-82ba-e312cfac2726 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:55.295809 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be83a381-22c9-4b60-82ba-e312cfac2726 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:55.296282 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be83a381-22c9-4b60-82ba-e312cfac2726 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:55.296722 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-be83a381-22c9-4b60-82ba-e312cfac2726 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:55.463170 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-be83a381-22c9-4b60-82ba-e312cfac2726 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:55.478108 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-be83a381-22c9-4b60-82ba-e312cfac2726 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1687 microversion: 2.1 time: 0.196320 Aug 04 18:23:55.479154 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3870/7712] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:55 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1687 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:23:56.514373 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5e508819-86c6-4a1b-bf1a-18c63a0c6751 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:56.515067 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5e508819-86c6-4a1b-bf1a-18c63a0c6751 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:56.523308 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e508819-86c6-4a1b-bf1a-18c63a0c6751 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:56.523830 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e508819-86c6-4a1b-bf1a-18c63a0c6751 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:56.524294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e508819-86c6-4a1b-bf1a-18c63a0c6751 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:56.525054 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e508819-86c6-4a1b-bf1a-18c63a0c6751 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:56.525533 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e508819-86c6-4a1b-bf1a-18c63a0c6751 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:56.526009 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e508819-86c6-4a1b-bf1a-18c63a0c6751 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:56.716505 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5e508819-86c6-4a1b-bf1a-18c63a0c6751 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:56.725336 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5e508819-86c6-4a1b-bf1a-18c63a0c6751 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1687 microversion: 2.1 time: 0.216150 Aug 04 18:23:56.726006 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3843/7713] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:56 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1687 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:23:57.764981 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-5f263cb8-1d60-4411-a359-b6c906382b61 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:57.766199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-5f263cb8-1d60-4411-a359-b6c906382b61 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:57.778138 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5f263cb8-1d60-4411-a359-b6c906382b61 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:57.778974 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5f263cb8-1d60-4411-a359-b6c906382b61 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:57.779684 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5f263cb8-1d60-4411-a359-b6c906382b61 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:57.780886 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5f263cb8-1d60-4411-a359-b6c906382b61 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:57.781653 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5f263cb8-1d60-4411-a359-b6c906382b61 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:57.782380 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-5f263cb8-1d60-4411-a359-b6c906382b61 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:57.940317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-c03a3ba3-a3ba-4989-b605-e7c81688b261 req-03bb1002-1f46-41a2-a2e7-a2adb01e3c17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f537bae-0536-4200-b5ca-bf6f0893b0c0", "name": "network-vif-plugged", "status": "completed", "tag": "12931941-925a-417e-aad2-a4a534f8093b"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:23:57.954578 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c03a3ba3-a3ba-4989-b605-e7c81688b261 req-03bb1002-1f46-41a2-a2e7-a2adb01e3c17 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:57.955163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c03a3ba3-a3ba-4989-b605-e7c81688b261 req-03bb1002-1f46-41a2-a2e7-a2adb01e3c17 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:57.955597 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c03a3ba3-a3ba-4989-b605-e7c81688b261 req-03bb1002-1f46-41a2-a2e7-a2adb01e3c17 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:57.982893 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-c03a3ba3-a3ba-4989-b605-e7c81688b261 req-03bb1002-1f46-41a2-a2e7-a2adb01e3c17 service nova] Creating event network-vif-plugged:12931941-925a-417e-aad2-a4a534f8093b for instance 5f537bae-0536-4200-b5ca-bf6f0893b0c0 on n-h1-851359-3 Aug 04 18:23:57.986319 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-c03a3ba3-a3ba-4989-b605-e7c81688b261 req-03bb1002-1f46-41a2-a2e7-a2adb01e3c17 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050971 Aug 04 18:23:57.987330 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3844/7714] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:23:57.988896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-5f263cb8-1d60-4411-a359-b6c906382b61 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:57.997373 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-5f263cb8-1d60-4411-a359-b6c906382b61 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1687 microversion: 2.1 time: 0.239861 Aug 04 18:23:57.998309 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3871/7715] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:57 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1687 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:23:59.028072 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fb6be7d7-6ec2-45a7-8d80-eff21e70051a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:23:59.029242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fb6be7d7-6ec2-45a7-8d80-eff21e70051a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:23:59.040680 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb6be7d7-6ec2-45a7-8d80-eff21e70051a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:59.041751 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb6be7d7-6ec2-45a7-8d80-eff21e70051a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:59.042612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb6be7d7-6ec2-45a7-8d80-eff21e70051a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:59.043955 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb6be7d7-6ec2-45a7-8d80-eff21e70051a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:23:59.044825 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb6be7d7-6ec2-45a7-8d80-eff21e70051a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:23:59.045633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb6be7d7-6ec2-45a7-8d80-eff21e70051a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:23:59.282151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fb6be7d7-6ec2-45a7-8d80-eff21e70051a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:23:59.299753 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fb6be7d7-6ec2-45a7-8d80-eff21e70051a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1687 microversion: 2.1 time: 0.281488 Aug 04 18:23:59.300758 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3845/7716] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:23:59 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1687 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:24:00.338071 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3062faa7-600d-4fa2-8e1d-1f186dd4301d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:24:00.339455 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3062faa7-600d-4fa2-8e1d-1f186dd4301d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:24:00.353504 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3062faa7-600d-4fa2-8e1d-1f186dd4301d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:24:00.354463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3062faa7-600d-4fa2-8e1d-1f186dd4301d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:24:00.355262 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3062faa7-600d-4fa2-8e1d-1f186dd4301d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:24:00.356564 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3062faa7-600d-4fa2-8e1d-1f186dd4301d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:24:00.357448 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3062faa7-600d-4fa2-8e1d-1f186dd4301d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:24:00.359124 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3062faa7-600d-4fa2-8e1d-1f186dd4301d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:24:00.585069 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3062faa7-600d-4fa2-8e1d-1f186dd4301d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:24:00.597666 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3062faa7-600d-4fa2-8e1d-1f186dd4301d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1674 microversion: 2.1 time: 0.266320 Aug 04 18:24:00.598438 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3872/7717] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:24:00 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1674 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:24:23.166700 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:24:23.167440 n-d-851359-3 devstack@n-api.service[131044]: Thu Aug 4 18:24:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:24:23.312531 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:24:23.313166 n-d-851359-3 devstack@n-api.service[131043]: Thu Aug 4 18:24:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:25:10.964321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=13 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:25:10.965681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=42 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:25:10.973583 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bacd95c4-78d3-425c-9dc8-c0f934f47d6a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:25:10.974112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=11 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:25:10.974664 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bacd95c4-78d3-425c-9dc8-c0f934f47d6a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:25:10.975910 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=35 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:25:10.987848 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bacd95c4-78d3-425c-9dc8-c0f934f47d6a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:10.988700 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bacd95c4-78d3-425c-9dc8-c0f934f47d6a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:10.989435 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bacd95c4-78d3-425c-9dc8-c0f934f47d6a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:10.991737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bacd95c4-78d3-425c-9dc8-c0f934f47d6a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:10.992780 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bacd95c4-78d3-425c-9dc8-c0f934f47d6a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:10.994735 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bacd95c4-78d3-425c-9dc8-c0f934f47d6a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:11.027930 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bacd95c4-78d3-425c-9dc8-c0f934f47d6a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 18:25:11.054604 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-485262a2-f9b3-4a15-8df0-02e220a6a30f req-6f12456a-9236-43c5-b311-b5bb07361b7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f537bae-0536-4200-b5ca-bf6f0893b0c0", "tag": "12931941-925a-417e-aad2-a4a534f8093b"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:25:11.073053 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-485262a2-f9b3-4a15-8df0-02e220a6a30f req-6f12456a-9236-43c5-b311-b5bb07361b7a service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:11.074116 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-485262a2-f9b3-4a15-8df0-02e220a6a30f req-6f12456a-9236-43c5-b311-b5bb07361b7a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:11.075011 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-485262a2-f9b3-4a15-8df0-02e220a6a30f req-6f12456a-9236-43c5-b311-b5bb07361b7a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:11.099387 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-485262a2-f9b3-4a15-8df0-02e220a6a30f req-6f12456a-9236-43c5-b311-b5bb07361b7a service nova] Creating event network-changed:12931941-925a-417e-aad2-a4a534f8093b for instance 5f537bae-0536-4200-b5ca-bf6f0893b0c0 on n-h1-851359-3 Aug 04 18:25:11.108813 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-485262a2-f9b3-4a15-8df0-02e220a6a30f req-6f12456a-9236-43c5-b311-b5bb07361b7a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145299 Aug 04 18:25:11.110049 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3873/7718] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:25:11.134740 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bacd95c4-78d3-425c-9dc8-c0f934f47d6a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "DELETE /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 204 len: 0 microversion: 2.1 time: 0.173987 Aug 04 18:25:11.135449 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3846/7719] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 18:25:10 2022] DELETE /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 18:25:11.150483 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a5807b8a-47bd-4197-aad7-ba4b4a9cf27d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:25:11.151817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a5807b8a-47bd-4197-aad7-ba4b4a9cf27d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:25:11.165071 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a5807b8a-47bd-4197-aad7-ba4b4a9cf27d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:11.166176 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a5807b8a-47bd-4197-aad7-ba4b4a9cf27d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:11.166884 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a5807b8a-47bd-4197-aad7-ba4b4a9cf27d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:11.168315 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a5807b8a-47bd-4197-aad7-ba4b4a9cf27d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:11.169362 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a5807b8a-47bd-4197-aad7-ba4b4a9cf27d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:11.170257 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a5807b8a-47bd-4197-aad7-ba4b4a9cf27d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:11.363239 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a5807b8a-47bd-4197-aad7-ba4b4a9cf27d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:25:11.371772 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a5807b8a-47bd-4197-aad7-ba4b4a9cf27d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1680 microversion: 2.1 time: 0.230474 Aug 04 18:25:11.372375 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3874/7720] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:25:11 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1680 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:25:12.404805 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8ca8364c-83f1-4163-8556-6f8fb87d148b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:25:12.406374 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8ca8364c-83f1-4163-8556-6f8fb87d148b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:25:12.420849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ca8364c-83f1-4163-8556-6f8fb87d148b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:12.421362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ca8364c-83f1-4163-8556-6f8fb87d148b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:12.421822 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ca8364c-83f1-4163-8556-6f8fb87d148b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:12.422604 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ca8364c-83f1-4163-8556-6f8fb87d148b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:12.423585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ca8364c-83f1-4163-8556-6f8fb87d148b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:12.423585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ca8364c-83f1-4163-8556-6f8fb87d148b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:12.596294 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8ca8364c-83f1-4163-8556-6f8fb87d148b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:25:12.604721 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8ca8364c-83f1-4163-8556-6f8fb87d148b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 200 len: 1680 microversion: 2.1 time: 0.208594 Aug 04 18:25:12.605318 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3847/7721] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:25:12 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 1680 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:25:13.127304 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-774606c0-7b1a-424c-a29f-0c29909c079b req-5f785fdb-60ff-494a-879d-c278047cc488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f537bae-0536-4200-b5ca-bf6f0893b0c0", "name": "network-vif-deleted", "tag": "12931941-925a-417e-aad2-a4a534f8093b"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:25:13.138131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-774606c0-7b1a-424c-a29f-0c29909c079b req-5f785fdb-60ff-494a-879d-c278047cc488 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:13.138645 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-774606c0-7b1a-424c-a29f-0c29909c079b req-5f785fdb-60ff-494a-879d-c278047cc488 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:13.139109 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-774606c0-7b1a-424c-a29f-0c29909c079b req-5f785fdb-60ff-494a-879d-c278047cc488 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:13.153842 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-774606c0-7b1a-424c-a29f-0c29909c079b req-5f785fdb-60ff-494a-879d-c278047cc488 service nova] Creating event network-vif-deleted:12931941-925a-417e-aad2-a4a534f8093b for instance 5f537bae-0536-4200-b5ca-bf6f0893b0c0 on n-h1-851359-3 Aug 04 18:25:13.159906 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-774606c0-7b1a-424c-a29f-0c29909c079b req-5f785fdb-60ff-494a-879d-c278047cc488 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036279 Aug 04 18:25:13.160528 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3875/7722] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:25:13.627912 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-69b0d656-d7fc-4e88-8b34-3166ba673a07 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:25:13.628554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-69b0d656-d7fc-4e88-8b34-3166ba673a07 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: 5f537bae-0536-4200-b5ca-bf6f0893b0c0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:25:13.636384 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69b0d656-d7fc-4e88-8b34-3166ba673a07 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:13.636900 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69b0d656-d7fc-4e88-8b34-3166ba673a07 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:13.637357 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69b0d656-d7fc-4e88-8b34-3166ba673a07 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:13.638126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69b0d656-d7fc-4e88-8b34-3166ba673a07 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:13.638598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69b0d656-d7fc-4e88-8b34-3166ba673a07 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:13.639042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69b0d656-d7fc-4e88-8b34-3166ba673a07 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:13.655761 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-69b0d656-d7fc-4e88-8b34-3166ba673a07 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] HTTP exception thrown: Instance 5f537bae-0536-4200-b5ca-bf6f0893b0c0 could not be found. Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-69b0d656-d7fc-4e88-8b34-3166ba673a07 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Request method failure captured: Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 HTTP/1.1 Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7A4IDd-w7aHI7QTsm5lmI54SlvKHSEH0XTVOtjGjEW0tSazFzDWeinSOcmA6oi2WryyLi6YXS9R3qwAPAOCTrYLFenBcpPvNYfhr_HICJDkwZsPTcw6ZK8MEnl4q3aUDpgNAYNgC15bfQHzisBTfs5vF0tzbbeYScwu4ZUVveYFLlXM Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: d6b1025d4b4b47878d13cc547a78e869 Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TestShelveInstance-1305817526 Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d6b1025d4b4b47878d13cc547a78e869"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d6b1025d4b4b47878d13cc547a78e869"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d6b1025d4b4b47878d13cc547a78e869"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d6b1025d4b4b47878d13cc547a78e869"}]}] Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TestShelveInstance-1305817526 Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: d6b1025d4b4b47878d13cc547a78e869 Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestShelveInstance-1305817526 Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TestShelveInstance-1305817526-project Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 4d38392324f546cf806b6ff92738b4b9 Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TestShelveInstance-1305817526-project Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance 5f537bae-0536-4200-b5ca-bf6f0893b0c0 could not be found. Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': '5f537bae-0536-4200-b5ca-bf6f0893b0c0'} Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f537bae-0536-4200-b5ca-bf6f0893b0c0 could not be found. Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f537bae-0536-4200-b5ca-bf6f0893b0c0 could not be found. Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:25:13.657467 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:25:13.662495 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:25:13.662495 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:25:13.662495 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:25:13.662495 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:25:13.662495 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:25:13.662495 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f537bae-0536-4200-b5ca-bf6f0893b0c0 could not be found. Aug 04 18:25:13.662495 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:25:13.662495 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-69b0d656-d7fc-4e88-8b34-3166ba673a07 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Returning 404 to user: Instance 5f537bae-0536-4200-b5ca-bf6f0893b0c0 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:25:13.662495 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-69b0d656-d7fc-4e88-8b34-3166ba673a07 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0" status: 404 len: 111 microversion: 2.1 time: 0.035155 Aug 04 18:25:13.662495 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3848/7723] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:25:13 2022] GET /compute/v2.1/servers/5f537bae-0536-4200-b5ca-bf6f0893b0c0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 18:25:13.827509 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-339f58b9-b6cf-4752-98b0-6042ee6f92ac tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '.version_select at 0x7f1e5a1a0b80>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:25:13.851174 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-339f58b9-b6cf-4752-98b0-6042ee6f92ac tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2058376615" status: 202 len: 0 microversion: 2.1 time: 0.028014 Aug 04 18:25:13.851778 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3876/7724] 10.222.0.93 () {58 vars in 1254 bytes} [Thu Aug 4 18:25:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2058376615 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 18:25:13.878048 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-26d9a6ea-1ede-4a27-aa89-dadb400885a6 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Action: 'create', calling method: .version_select at 0x7f1e5a397700>, body: {"keypair": {"name": "tempest-TestShelveInstance-272367031", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClQDGHolA+EAjE/WDumCQYryxZqOZSRkAU9A8c3pOxzwTuhK/NywHPwsh6kW6gM8Itwv3g386DNE5iJI0DC6xlWTrRQGF1lcBe6WiqPwRxjtJ8x7jnSQ0dKlJHhvo7Irg=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:25:13.895126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-26d9a6ea-1ede-4a27-aa89-dadb400885a6 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Getting quotas for project d6b1025d4b4b47878d13cc547a78e869. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 18:25:13.902207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-26d9a6ea-1ede-4a27-aa89-dadb400885a6 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Getting quotas for user 4d38392324f546cf806b6ff92738b4b9 and project d6b1025d4b4b47878d13cc547a78e869. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 18:25:13.950682 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-26d9a6ea-1ede-4a27-aa89-dadb400885a6 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.076948 Aug 04 18:25:13.952042 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3849/7725] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 18:25:13 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:25:32.630159 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=10 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:25:32.631697 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:25:32.636728 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-05c94fec-a36d-4e83-a018-84e10d963b7f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-846230657", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-272367031", "security_groups": [{"name": "tempest-secgroup-smoke-1433328991"}], "networks": [{"uuid": "53f06c27-a352-4a00-af04-c789c76cdfb1"}], "block_device_mapping_v2": [{"uuid": "544e5493-de8a-4553-acba-eb553d53a32a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:25:32.790081 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.network.neutron [None req-05c94fec-a36d-4e83-a018-84e10d963b7f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] validate_networks() for [('53f06c27-a352-4a00-af04-c789c76cdfb1', None, None, None, None, None)] {{(pid=131043) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 18:25:33.284950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-05c94fec-a36d-4e83-a018-84e10d963b7f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Flavor limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 18:25:33.285387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-05c94fec-a36d-4e83-a018-84e10d963b7f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Image limits 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 18:25:33.285923 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-05c94fec-a36d-4e83-a018-84e10d963b7f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Flavor pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 18:25:33.286409 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-05c94fec-a36d-4e83-a018-84e10d963b7f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Image pref 0:0:0 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 18:25:33.287340 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.virt.hardware [None req-05c94fec-a36d-4e83-a018-84e10d963b7f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131043) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 18:25:33.298287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05c94fec-a36d-4e83-a018-84e10d963b7f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:33.298812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05c94fec-a36d-4e83-a018-84e10d963b7f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:33.299262 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05c94fec-a36d-4e83-a018-84e10d963b7f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:33.300093 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05c94fec-a36d-4e83-a018-84e10d963b7f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:33.300570 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05c94fec-a36d-4e83-a018-84e10d963b7f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:33.301041 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-05c94fec-a36d-4e83-a018-84e10d963b7f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:33.320888 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-05c94fec-a36d-4e83-a018-84e10d963b7f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Getting quotas for project d6b1025d4b4b47878d13cc547a78e869. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 18:25:33.327297 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-05c94fec-a36d-4e83-a018-84e10d963b7f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Getting quotas for user 4d38392324f546cf806b6ff92738b4b9 and project d6b1025d4b4b47878d13cc547a78e869. Resources: {'instances', 'ram', 'cores'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 18:25:33.398479 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-05c94fec-a36d-4e83-a018-84e10d963b7f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Going to run 1 instances... {{(pid=131043) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 18:25:33.401115 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-05c94fec-a36d-4e83-a018-84e10d963b7f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='544e5493-de8a-4553-acba-eb553d53a32a',volume_size=None,volume_type=None)] {{(pid=131043) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 18:25:33.559784 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-05c94fec-a36d-4e83-a018-84e10d963b7f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.931446 Aug 04 18:25:33.560456 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3877/7726] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 18:25:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 18:25:33.576044 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:25:33.576945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:25:33.577765 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:25:33.586435 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6bfce4d4-58f3-4812-b886-08702f0998d4 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:25:33.587085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6bfce4d4-58f3-4812-b886-08702f0998d4 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:25:33.661644 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6bfce4d4-58f3-4812-b886-08702f0998d4 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:25:33.671502 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6bfce4d4-58f3-4812-b886-08702f0998d4 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1087 microversion: 2.1 time: 0.098731 Aug 04 18:25:33.672094 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3850/7727] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:25:33 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1087 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:25:34.696021 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-860aeb8e-3fb6-4a2e-9965-ea5b2debde24 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:25:34.696641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-860aeb8e-3fb6-4a2e-9965-ea5b2debde24 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:25:34.704528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-860aeb8e-3fb6-4a2e-9965-ea5b2debde24 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:34.705035 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-860aeb8e-3fb6-4a2e-9965-ea5b2debde24 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:34.705488 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-860aeb8e-3fb6-4a2e-9965-ea5b2debde24 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:34.706261 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-860aeb8e-3fb6-4a2e-9965-ea5b2debde24 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:34.706731 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-860aeb8e-3fb6-4a2e-9965-ea5b2debde24 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:34.707178 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-860aeb8e-3fb6-4a2e-9965-ea5b2debde24 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:34.782861 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-860aeb8e-3fb6-4a2e-9965-ea5b2debde24 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:25:34.793056 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-860aeb8e-3fb6-4a2e-9965-ea5b2debde24 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1185 microversion: 2.1 time: 0.101114 Aug 04 18:25:34.793665 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3878/7728] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:25:34 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:25:35.832145 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4ad34baf-ec46-4699-aeb1-b6aef1cae665 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:25:35.837251 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4ad34baf-ec46-4699-aeb1-b6aef1cae665 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:25:35.857887 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ad34baf-ec46-4699-aeb1-b6aef1cae665 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:35.859242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ad34baf-ec46-4699-aeb1-b6aef1cae665 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:35.860734 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ad34baf-ec46-4699-aeb1-b6aef1cae665 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:35.865806 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ad34baf-ec46-4699-aeb1-b6aef1cae665 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:35.867160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ad34baf-ec46-4699-aeb1-b6aef1cae665 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:35.868233 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ad34baf-ec46-4699-aeb1-b6aef1cae665 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:36.141920 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4ad34baf-ec46-4699-aeb1-b6aef1cae665 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:25:36.153351 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4ad34baf-ec46-4699-aeb1-b6aef1cae665 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1271 microversion: 2.1 time: 0.331168 Aug 04 18:25:36.158103 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3851/7729] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:25:35 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1271 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:25:36.827275 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-e70b3141-de05-40c9-aaf2-639f7dfefd1d req-3f92dcc0-a2ad-4a95-8ea5-2d71f18ddaff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2204bdc-7d48-4293-a538-4ec7997d957c", "tag": "9a9ada13-e1fb-423f-a820-0d02594e5884"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:25:36.851796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e70b3141-de05-40c9-aaf2-639f7dfefd1d req-3f92dcc0-a2ad-4a95-8ea5-2d71f18ddaff service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:36.852404 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e70b3141-de05-40c9-aaf2-639f7dfefd1d req-3f92dcc0-a2ad-4a95-8ea5-2d71f18ddaff service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:36.852781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-e70b3141-de05-40c9-aaf2-639f7dfefd1d req-3f92dcc0-a2ad-4a95-8ea5-2d71f18ddaff service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:36.876920 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-e70b3141-de05-40c9-aaf2-639f7dfefd1d req-3f92dcc0-a2ad-4a95-8ea5-2d71f18ddaff service nova] Creating event network-changed:9a9ada13-e1fb-423f-a820-0d02594e5884 for instance e2204bdc-7d48-4293-a538-4ec7997d957c on n-h2-851359-3 Aug 04 18:25:36.887202 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-e70b3141-de05-40c9-aaf2-639f7dfefd1d req-3f92dcc0-a2ad-4a95-8ea5-2d71f18ddaff service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147070 Aug 04 18:25:36.887833 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3879/7730] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:25:37.177637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ea2b25ef-8172-4591-a480-07c24072450c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:25:37.178540 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ea2b25ef-8172-4591-a480-07c24072450c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:25:37.186150 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea2b25ef-8172-4591-a480-07c24072450c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:37.187171 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea2b25ef-8172-4591-a480-07c24072450c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:37.187978 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea2b25ef-8172-4591-a480-07c24072450c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:37.189126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea2b25ef-8172-4591-a480-07c24072450c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:37.189692 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea2b25ef-8172-4591-a480-07c24072450c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:37.190255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea2b25ef-8172-4591-a480-07c24072450c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:37.400162 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ea2b25ef-8172-4591-a480-07c24072450c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:25:37.409595 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ea2b25ef-8172-4591-a480-07c24072450c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1271 microversion: 2.1 time: 0.236902 Aug 04 18:25:37.410325 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3852/7731] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:25:37 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1271 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:25:38.445246 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e62a4667-6d7b-4b9b-ba00-40dfe63da715 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:25:38.446260 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e62a4667-6d7b-4b9b-ba00-40dfe63da715 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:25:38.453493 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e62a4667-6d7b-4b9b-ba00-40dfe63da715 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:38.454029 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e62a4667-6d7b-4b9b-ba00-40dfe63da715 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:38.454494 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e62a4667-6d7b-4b9b-ba00-40dfe63da715 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:38.455224 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e62a4667-6d7b-4b9b-ba00-40dfe63da715 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:38.455704 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e62a4667-6d7b-4b9b-ba00-40dfe63da715 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:38.456168 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e62a4667-6d7b-4b9b-ba00-40dfe63da715 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:38.613259 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e62a4667-6d7b-4b9b-ba00-40dfe63da715 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:25:38.623934 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e62a4667-6d7b-4b9b-ba00-40dfe63da715 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1271 microversion: 2.1 time: 0.184412 Aug 04 18:25:38.625224 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3880/7732] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:25:38 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1271 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:25:39.659640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fd248fa5-3728-4d92-819c-838d36f110e7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:25:39.660592 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fd248fa5-3728-4d92-819c-838d36f110e7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:25:39.671803 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd248fa5-3728-4d92-819c-838d36f110e7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:39.672319 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd248fa5-3728-4d92-819c-838d36f110e7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:39.672794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd248fa5-3728-4d92-819c-838d36f110e7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:39.673949 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd248fa5-3728-4d92-819c-838d36f110e7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:39.674880 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd248fa5-3728-4d92-819c-838d36f110e7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:39.675676 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd248fa5-3728-4d92-819c-838d36f110e7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:39.860042 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fd248fa5-3728-4d92-819c-838d36f110e7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:25:39.868811 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fd248fa5-3728-4d92-819c-838d36f110e7 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1271 microversion: 2.1 time: 0.213897 Aug 04 18:25:39.869458 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3853/7733] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:25:39 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1271 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:25:40.893131 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-929d9a37-c903-4102-9e90-191afda78b52 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:25:40.894698 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-929d9a37-c903-4102-9e90-191afda78b52 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:25:40.904954 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-929d9a37-c903-4102-9e90-191afda78b52 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:40.905800 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-929d9a37-c903-4102-9e90-191afda78b52 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:40.906615 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-929d9a37-c903-4102-9e90-191afda78b52 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:40.907531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-929d9a37-c903-4102-9e90-191afda78b52 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:40.908333 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-929d9a37-c903-4102-9e90-191afda78b52 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:40.908971 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-929d9a37-c903-4102-9e90-191afda78b52 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:41.155390 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-929d9a37-c903-4102-9e90-191afda78b52 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:25:41.164649 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-929d9a37-c903-4102-9e90-191afda78b52 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1271 microversion: 2.1 time: 0.276778 Aug 04 18:25:41.165718 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3881/7734] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:25:40 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1271 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:25:42.195120 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-28ba1b77-ebbb-481d-81d8-a6a87137c3f5 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:25:42.195886 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-28ba1b77-ebbb-481d-81d8-a6a87137c3f5 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:25:42.204297 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28ba1b77-ebbb-481d-81d8-a6a87137c3f5 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:42.204870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28ba1b77-ebbb-481d-81d8-a6a87137c3f5 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:42.205391 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28ba1b77-ebbb-481d-81d8-a6a87137c3f5 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:42.206259 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28ba1b77-ebbb-481d-81d8-a6a87137c3f5 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:42.206790 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28ba1b77-ebbb-481d-81d8-a6a87137c3f5 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:42.207335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28ba1b77-ebbb-481d-81d8-a6a87137c3f5 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:42.369020 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-28ba1b77-ebbb-481d-81d8-a6a87137c3f5 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:25:42.383938 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-28ba1b77-ebbb-481d-81d8-a6a87137c3f5 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1259 microversion: 2.1 time: 0.194122 Aug 04 18:25:42.385067 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3854/7735] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:25:42 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1259 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:25:43.421328 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ae7c7c52-8f15-4eee-b894-92bbd427c355 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:25:43.422177 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ae7c7c52-8f15-4eee-b894-92bbd427c355 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:25:43.425226 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:25:43.425936 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:25:43.432318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae7c7c52-8f15-4eee-b894-92bbd427c355 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:43.432829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae7c7c52-8f15-4eee-b894-92bbd427c355 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:43.433289 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae7c7c52-8f15-4eee-b894-92bbd427c355 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:43.434050 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae7c7c52-8f15-4eee-b894-92bbd427c355 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:43.434528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae7c7c52-8f15-4eee-b894-92bbd427c355 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:43.434977 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ae7c7c52-8f15-4eee-b894-92bbd427c355 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:43.946842 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ae7c7c52-8f15-4eee-b894-92bbd427c355 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:25:43.954593 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ae7c7c52-8f15-4eee-b894-92bbd427c355 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1259 microversion: 2.1 time: 0.537421 Aug 04 18:25:43.955197 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3882/7736] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:25:43 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1259 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:25:44.977759 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7b466c8a-c5bf-440f-921f-6497882df7b5 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:25:44.978390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7b466c8a-c5bf-440f-921f-6497882df7b5 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:25:44.981413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:25:44.988804 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b466c8a-c5bf-440f-921f-6497882df7b5 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:44.989517 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b466c8a-c5bf-440f-921f-6497882df7b5 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:44.990158 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b466c8a-c5bf-440f-921f-6497882df7b5 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:44.991222 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b466c8a-c5bf-440f-921f-6497882df7b5 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:44.992099 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b466c8a-c5bf-440f-921f-6497882df7b5 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:44.992860 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b466c8a-c5bf-440f-921f-6497882df7b5 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:45.148681 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7b466c8a-c5bf-440f-921f-6497882df7b5 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:25:45.159007 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7b466c8a-c5bf-440f-921f-6497882df7b5 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1259 microversion: 2.1 time: 0.186427 Aug 04 18:25:45.159633 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3855/7737] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:25:44 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1259 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:25:46.183050 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4adb5c7e-64e0-4436-a356-68ade1622197 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:25:46.183650 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4adb5c7e-64e0-4436-a356-68ade1622197 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:25:46.192020 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4adb5c7e-64e0-4436-a356-68ade1622197 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:46.192583 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4adb5c7e-64e0-4436-a356-68ade1622197 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:46.193122 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4adb5c7e-64e0-4436-a356-68ade1622197 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:46.193887 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4adb5c7e-64e0-4436-a356-68ade1622197 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:46.194436 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4adb5c7e-64e0-4436-a356-68ade1622197 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:46.194987 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4adb5c7e-64e0-4436-a356-68ade1622197 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:46.368158 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4adb5c7e-64e0-4436-a356-68ade1622197 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:25:46.383448 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4adb5c7e-64e0-4436-a356-68ade1622197 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1259 microversion: 2.1 time: 0.205501 Aug 04 18:25:46.384543 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3883/7738] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:25:46 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1259 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:25:47.406114 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a62f82b5-18c9-41d1-9332-b62e28c49fea tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:25:47.406891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a62f82b5-18c9-41d1-9332-b62e28c49fea tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:25:47.420326 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a62f82b5-18c9-41d1-9332-b62e28c49fea tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:47.420840 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a62f82b5-18c9-41d1-9332-b62e28c49fea tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:47.421292 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a62f82b5-18c9-41d1-9332-b62e28c49fea tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:47.422064 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a62f82b5-18c9-41d1-9332-b62e28c49fea tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:47.422547 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a62f82b5-18c9-41d1-9332-b62e28c49fea tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:47.422991 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a62f82b5-18c9-41d1-9332-b62e28c49fea tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:47.604834 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a62f82b5-18c9-41d1-9332-b62e28c49fea tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:25:47.613535 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a62f82b5-18c9-41d1-9332-b62e28c49fea tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1259 microversion: 2.1 time: 0.211647 Aug 04 18:25:47.614436 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3856/7739] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:25:47 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1259 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:25:48.638482 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-53cd90fe-8b4a-47f0-888b-d28d3cabab2f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:25:48.639515 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-53cd90fe-8b4a-47f0-888b-d28d3cabab2f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:25:48.646342 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53cd90fe-8b4a-47f0-888b-d28d3cabab2f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:48.646913 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53cd90fe-8b4a-47f0-888b-d28d3cabab2f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:48.647370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53cd90fe-8b4a-47f0-888b-d28d3cabab2f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:48.648121 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53cd90fe-8b4a-47f0-888b-d28d3cabab2f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:48.648593 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53cd90fe-8b4a-47f0-888b-d28d3cabab2f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:48.649032 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-53cd90fe-8b4a-47f0-888b-d28d3cabab2f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:48.848546 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-53cd90fe-8b4a-47f0-888b-d28d3cabab2f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:25:48.860030 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-53cd90fe-8b4a-47f0-888b-d28d3cabab2f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1259 microversion: 2.1 time: 0.225777 Aug 04 18:25:48.861174 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3884/7740] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:25:48 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1259 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:25:49.898607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9fb8d3c9-b443-4407-b3ef-d11a21a3b18c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:25:49.899392 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9fb8d3c9-b443-4407-b3ef-d11a21a3b18c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:25:49.907688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fb8d3c9-b443-4407-b3ef-d11a21a3b18c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:49.908244 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fb8d3c9-b443-4407-b3ef-d11a21a3b18c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:49.908712 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fb8d3c9-b443-4407-b3ef-d11a21a3b18c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:49.909560 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fb8d3c9-b443-4407-b3ef-d11a21a3b18c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:49.910082 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fb8d3c9-b443-4407-b3ef-d11a21a3b18c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:49.910540 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fb8d3c9-b443-4407-b3ef-d11a21a3b18c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:50.142554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9fb8d3c9-b443-4407-b3ef-d11a21a3b18c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:25:50.155449 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9fb8d3c9-b443-4407-b3ef-d11a21a3b18c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1259 microversion: 2.1 time: 0.264184 Aug 04 18:25:50.156149 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3857/7741] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:25:49 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1259 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:25:51.178672 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-066170d7-c55f-454d-9889-b6770b59315e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:25:51.179500 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-066170d7-c55f-454d-9889-b6770b59315e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:25:51.187332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-066170d7-c55f-454d-9889-b6770b59315e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:51.187836 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-066170d7-c55f-454d-9889-b6770b59315e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:51.188319 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-066170d7-c55f-454d-9889-b6770b59315e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:51.189067 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-066170d7-c55f-454d-9889-b6770b59315e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:51.189545 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-066170d7-c55f-454d-9889-b6770b59315e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:51.190004 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-066170d7-c55f-454d-9889-b6770b59315e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:51.348682 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-066170d7-c55f-454d-9889-b6770b59315e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:25:51.357790 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-066170d7-c55f-454d-9889-b6770b59315e tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1259 microversion: 2.1 time: 0.183526 Aug 04 18:25:51.358511 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3885/7742] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:25:51 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:25:52.379263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ea7b48ac-a6db-4410-a139-a36cd7af0764 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:25:52.379837 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ea7b48ac-a6db-4410-a139-a36cd7af0764 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:25:52.386932 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea7b48ac-a6db-4410-a139-a36cd7af0764 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:52.387471 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea7b48ac-a6db-4410-a139-a36cd7af0764 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:52.387926 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea7b48ac-a6db-4410-a139-a36cd7af0764 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:52.388679 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea7b48ac-a6db-4410-a139-a36cd7af0764 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:52.389178 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea7b48ac-a6db-4410-a139-a36cd7af0764 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:52.389616 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea7b48ac-a6db-4410-a139-a36cd7af0764 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:52.540640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ea7b48ac-a6db-4410-a139-a36cd7af0764 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:25:52.548961 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ea7b48ac-a6db-4410-a139-a36cd7af0764 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1259 microversion: 2.1 time: 0.173716 Aug 04 18:25:52.549558 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3858/7743] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:25:52 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:25:53.574931 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b5141064-cdfa-4e3b-8c69-64e65166c534 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:25:53.576102 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b5141064-cdfa-4e3b-8c69-64e65166c534 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:25:53.589351 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b5141064-cdfa-4e3b-8c69-64e65166c534 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:53.590675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b5141064-cdfa-4e3b-8c69-64e65166c534 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:53.591444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b5141064-cdfa-4e3b-8c69-64e65166c534 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:53.592803 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b5141064-cdfa-4e3b-8c69-64e65166c534 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:53.594006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b5141064-cdfa-4e3b-8c69-64e65166c534 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:53.594812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b5141064-cdfa-4e3b-8c69-64e65166c534 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:53.616784 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-a029b4fa-c4b1-4732-82f9-27261fe6fd11 req-2f461ca9-c037-41ac-bbff-0de08bc5c3f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2204bdc-7d48-4293-a538-4ec7997d957c", "name": "network-vif-plugged", "status": "completed", "tag": "9a9ada13-e1fb-423f-a820-0d02594e5884"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:25:53.630635 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a029b4fa-c4b1-4732-82f9-27261fe6fd11 req-2f461ca9-c037-41ac-bbff-0de08bc5c3f0 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:53.631219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a029b4fa-c4b1-4732-82f9-27261fe6fd11 req-2f461ca9-c037-41ac-bbff-0de08bc5c3f0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:53.631942 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a029b4fa-c4b1-4732-82f9-27261fe6fd11 req-2f461ca9-c037-41ac-bbff-0de08bc5c3f0 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:53.647682 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-a029b4fa-c4b1-4732-82f9-27261fe6fd11 req-2f461ca9-c037-41ac-bbff-0de08bc5c3f0 service nova] Creating event network-vif-plugged:9a9ada13-e1fb-423f-a820-0d02594e5884 for instance e2204bdc-7d48-4293-a538-4ec7997d957c on n-h2-851359-3 Aug 04 18:25:53.653634 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-a029b4fa-c4b1-4732-82f9-27261fe6fd11 req-2f461ca9-c037-41ac-bbff-0de08bc5c3f0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041667 Aug 04 18:25:53.654738 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3859/7744] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:25:53.815292 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b5141064-cdfa-4e3b-8c69-64e65166c534 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:25:53.830171 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b5141064-cdfa-4e3b-8c69-64e65166c534 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1259 microversion: 2.1 time: 0.263667 Aug 04 18:25:53.831010 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3886/7745] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:25:53 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1259 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:25:54.856943 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-22c9bd82-6650-4bbb-ae28-8b79200ba162 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:25:54.857792 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-22c9bd82-6650-4bbb-ae28-8b79200ba162 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:25:54.864612 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-22c9bd82-6650-4bbb-ae28-8b79200ba162 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:54.865125 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-22c9bd82-6650-4bbb-ae28-8b79200ba162 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:54.865585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-22c9bd82-6650-4bbb-ae28-8b79200ba162 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:54.866361 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-22c9bd82-6650-4bbb-ae28-8b79200ba162 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:54.866846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-22c9bd82-6650-4bbb-ae28-8b79200ba162 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:54.867295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-22c9bd82-6650-4bbb-ae28-8b79200ba162 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:55.036375 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-22c9bd82-6650-4bbb-ae28-8b79200ba162 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:25:55.045387 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-22c9bd82-6650-4bbb-ae28-8b79200ba162 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1259 microversion: 2.1 time: 0.194906 Aug 04 18:25:55.046010 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3860/7746] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:25:54 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1259 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:25:56.067485 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-29cf08a2-150a-4eb9-8244-d47ce111205a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:25:56.068443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-29cf08a2-150a-4eb9-8244-d47ce111205a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:25:56.076006 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29cf08a2-150a-4eb9-8244-d47ce111205a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:56.076515 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29cf08a2-150a-4eb9-8244-d47ce111205a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:56.076997 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29cf08a2-150a-4eb9-8244-d47ce111205a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:56.077735 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29cf08a2-150a-4eb9-8244-d47ce111205a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:56.078245 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29cf08a2-150a-4eb9-8244-d47ce111205a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:56.078690 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-29cf08a2-150a-4eb9-8244-d47ce111205a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:56.295942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-29cf08a2-150a-4eb9-8244-d47ce111205a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:25:56.304662 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-29cf08a2-150a-4eb9-8244-d47ce111205a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1444 microversion: 2.1 time: 0.241209 Aug 04 18:25:56.305279 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3887/7747] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:25:56 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1444 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:25:56.325550 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-20d84608-5219-48c7-8e04-e147fda15be8 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:25:56.326226 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-20d84608-5219-48c7-8e04-e147fda15be8 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:25:56.334153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20d84608-5219-48c7-8e04-e147fda15be8 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:56.334737 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20d84608-5219-48c7-8e04-e147fda15be8 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:56.335205 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20d84608-5219-48c7-8e04-e147fda15be8 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:56.335946 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20d84608-5219-48c7-8e04-e147fda15be8 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:56.336424 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20d84608-5219-48c7-8e04-e147fda15be8 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:56.336873 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20d84608-5219-48c7-8e04-e147fda15be8 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:56.506060 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-20d84608-5219-48c7-8e04-e147fda15be8 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:25:56.514691 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-20d84608-5219-48c7-8e04-e147fda15be8 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1444 microversion: 2.1 time: 0.193087 Aug 04 18:25:56.515430 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3861/7748] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:25:56 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1444 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:25:58.492393 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-21307824-6eb6-4ecd-a68f-b56757cb0f8e req-52056278-d068-48b9-a1a3-e942038c3b2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2204bdc-7d48-4293-a538-4ec7997d957c", "tag": "9a9ada13-e1fb-423f-a820-0d02594e5884"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:25:58.511596 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-21307824-6eb6-4ecd-a68f-b56757cb0f8e req-52056278-d068-48b9-a1a3-e942038c3b2a service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:25:58.512474 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-21307824-6eb6-4ecd-a68f-b56757cb0f8e req-52056278-d068-48b9-a1a3-e942038c3b2a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:25:58.513262 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-21307824-6eb6-4ecd-a68f-b56757cb0f8e req-52056278-d068-48b9-a1a3-e942038c3b2a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:25:58.536424 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-21307824-6eb6-4ecd-a68f-b56757cb0f8e req-52056278-d068-48b9-a1a3-e942038c3b2a service nova] Creating event network-changed:9a9ada13-e1fb-423f-a820-0d02594e5884 for instance e2204bdc-7d48-4293-a538-4ec7997d957c on n-h2-851359-3 Aug 04 18:25:58.545390 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-21307824-6eb6-4ecd-a68f-b56757cb0f8e req-52056278-d068-48b9-a1a3-e942038c3b2a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060642 Aug 04 18:25:58.546551 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3888/7749] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:26:03.203208 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:26:03.204133 n-d-851359-3 devstack@n-api.service[131044]: Thu Aug 4 18:26:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:27:43.179690 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:27:43.180760 n-d-851359-3 devstack@n-api.service[131044]: Thu Aug 4 18:27:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:27:43.209685 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:27:43.210640 n-d-851359-3 devstack@n-api.service[131043]: Thu Aug 4 18:27:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:27:55.515590 n-d-851359-3 devstack@n-api.service[131044]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7a822c8f-8f7d-4a50-9afd-aab5c6b46a96] AMQP server on 10.222.0.93:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 18:27:55.516454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=26 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:27:55.517245 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=62 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:27:55.599846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0ff7f616-4127-4ebe-ae0e-d9c5a08771f1 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:27:55.600421 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0ff7f616-4127-4ebe-ae0e-d9c5a08771f1 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:27:55.607564 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ff7f616-4127-4ebe-ae0e-d9c5a08771f1 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:27:55.608085 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ff7f616-4127-4ebe-ae0e-d9c5a08771f1 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:27:55.608547 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ff7f616-4127-4ebe-ae0e-d9c5a08771f1 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:27:55.609293 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ff7f616-4127-4ebe-ae0e-d9c5a08771f1 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:27:55.609786 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ff7f616-4127-4ebe-ae0e-d9c5a08771f1 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:27:55.610263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ff7f616-4127-4ebe-ae0e-d9c5a08771f1 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:27:55.637950 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-0ff7f616-4127-4ebe-ae0e-d9c5a08771f1 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lazy-loading 'flavor' on Instance uuid e2204bdc-7d48-4293-a538-4ec7997d957c {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 18:27:55.727321 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0ff7f616-4127-4ebe-ae0e-d9c5a08771f1 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "POST /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c/action" status: 202 len: 0 microversion: 2.1 time: 0.213694 Aug 04 18:27:55.728297 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3862/7750] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:27:55 2022] POST /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 18:27:55.735759 n-d-851359-3 devstack@n-api.service[131043]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d439c32e-c35d-4bcd-acc6-3613271fa0d5] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 18:27:55.737724 n-d-851359-3 devstack@n-api.service[131043]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f0b45cb0-ceb0-43c7-a760-628eb3be34b7] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 18:27:55.738560 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:27:55.739589 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=60 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:27:55.745490 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-ced68bf4-41de-4236-a206-530a45ccf66f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:27:55.746598 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-ced68bf4-41de-4236-a206-530a45ccf66f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:27:55.758506 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ced68bf4-41de-4236-a206-530a45ccf66f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:27:55.759146 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ced68bf4-41de-4236-a206-530a45ccf66f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:27:55.759722 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ced68bf4-41de-4236-a206-530a45ccf66f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:27:55.760576 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ced68bf4-41de-4236-a206-530a45ccf66f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:27:55.761409 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ced68bf4-41de-4236-a206-530a45ccf66f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:27:55.761947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-ced68bf4-41de-4236-a206-530a45ccf66f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:27:55.969395 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-ced68bf4-41de-4236-a206-530a45ccf66f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:27:55.978376 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-ced68bf4-41de-4236-a206-530a45ccf66f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1568 microversion: 2.1 time: 0.244884 Aug 04 18:27:55.979002 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3889/7751] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:27:55 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1568 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:27:57.006837 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c20385e8-3472-4bd2-99fc-f2d658ee9fc3 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:27:57.007570 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c20385e8-3472-4bd2-99fc-f2d658ee9fc3 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:27:57.015320 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c20385e8-3472-4bd2-99fc-f2d658ee9fc3 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:27:57.015817 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c20385e8-3472-4bd2-99fc-f2d658ee9fc3 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:27:57.016265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c20385e8-3472-4bd2-99fc-f2d658ee9fc3 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:27:57.016990 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c20385e8-3472-4bd2-99fc-f2d658ee9fc3 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:27:57.017454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c20385e8-3472-4bd2-99fc-f2d658ee9fc3 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:27:57.017915 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c20385e8-3472-4bd2-99fc-f2d658ee9fc3 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:27:57.022787 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] [7a822c8f-8f7d-4a50-9afd-aab5c6b46a96] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 59718. Aug 04 18:27:57.179454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c20385e8-3472-4bd2-99fc-f2d658ee9fc3 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:27:57.188163 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c20385e8-3472-4bd2-99fc-f2d658ee9fc3 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1568 microversion: 2.1 time: 0.190692 Aug 04 18:27:57.189013 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3863/7752] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:27:56 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:27:58.212887 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-969b9119-e12e-46b2-beb5-30de5d79267c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:27:58.213570 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-969b9119-e12e-46b2-beb5-30de5d79267c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:27:58.228775 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-969b9119-e12e-46b2-beb5-30de5d79267c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:27:58.229686 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-969b9119-e12e-46b2-beb5-30de5d79267c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:27:58.230531 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-969b9119-e12e-46b2-beb5-30de5d79267c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:27:58.231771 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-969b9119-e12e-46b2-beb5-30de5d79267c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:27:58.232641 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-969b9119-e12e-46b2-beb5-30de5d79267c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:27:58.233424 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-969b9119-e12e-46b2-beb5-30de5d79267c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:27:58.246470 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] [d439c32e-c35d-4bcd-acc6-3613271fa0d5] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 59722. Aug 04 18:27:58.277407 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] [f0b45cb0-ceb0-43c7-a760-628eb3be34b7] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 59724. Aug 04 18:27:58.440953 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-969b9119-e12e-46b2-beb5-30de5d79267c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:27:58.450176 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-969b9119-e12e-46b2-beb5-30de5d79267c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1568 microversion: 2.1 time: 0.241595 Aug 04 18:27:58.450778 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3890/7753] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:27:58 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:27:59.477174 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-207e84ac-6633-4a53-8c3c-40fa8db45eb2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:27:59.478390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-207e84ac-6633-4a53-8c3c-40fa8db45eb2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:27:59.492238 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-207e84ac-6633-4a53-8c3c-40fa8db45eb2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:27:59.493210 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-207e84ac-6633-4a53-8c3c-40fa8db45eb2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:27:59.494076 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-207e84ac-6633-4a53-8c3c-40fa8db45eb2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:27:59.495390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-207e84ac-6633-4a53-8c3c-40fa8db45eb2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:27:59.496281 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-207e84ac-6633-4a53-8c3c-40fa8db45eb2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:27:59.497136 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-207e84ac-6633-4a53-8c3c-40fa8db45eb2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:27:59.676006 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-207e84ac-6633-4a53-8c3c-40fa8db45eb2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:27:59.684483 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-207e84ac-6633-4a53-8c3c-40fa8db45eb2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1568 microversion: 2.1 time: 0.215021 Aug 04 18:27:59.685297 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3864/7754] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:27:59 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1568 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:28:00.708419 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-8f298be7-281a-446b-838a-dfc6efe11e60 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:28:00.709068 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-8f298be7-281a-446b-838a-dfc6efe11e60 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:28:00.716675 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8f298be7-281a-446b-838a-dfc6efe11e60 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:00.717198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8f298be7-281a-446b-838a-dfc6efe11e60 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:00.717756 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8f298be7-281a-446b-838a-dfc6efe11e60 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:00.718537 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8f298be7-281a-446b-838a-dfc6efe11e60 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:00.719007 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8f298be7-281a-446b-838a-dfc6efe11e60 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:00.719459 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-8f298be7-281a-446b-838a-dfc6efe11e60 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:00.922609 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-8f298be7-281a-446b-838a-dfc6efe11e60 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:28:00.931731 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-8f298be7-281a-446b-838a-dfc6efe11e60 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1568 microversion: 2.1 time: 0.228331 Aug 04 18:28:00.932361 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3891/7755] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:28:00 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:28:01.954272 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0eb33ad3-85a0-4b2d-9a5f-56ed0ffa8970 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:28:01.955730 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0eb33ad3-85a0-4b2d-9a5f-56ed0ffa8970 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:28:01.962674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0eb33ad3-85a0-4b2d-9a5f-56ed0ffa8970 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:01.963182 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0eb33ad3-85a0-4b2d-9a5f-56ed0ffa8970 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:01.963635 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0eb33ad3-85a0-4b2d-9a5f-56ed0ffa8970 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:01.964368 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0eb33ad3-85a0-4b2d-9a5f-56ed0ffa8970 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:01.964835 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0eb33ad3-85a0-4b2d-9a5f-56ed0ffa8970 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:01.965280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0eb33ad3-85a0-4b2d-9a5f-56ed0ffa8970 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:02.138335 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0eb33ad3-85a0-4b2d-9a5f-56ed0ffa8970 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:28:02.147121 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0eb33ad3-85a0-4b2d-9a5f-56ed0ffa8970 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1568 microversion: 2.1 time: 0.197246 Aug 04 18:28:02.147720 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3865/7756] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:28:01 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:28:03.169291 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-90892cd9-24fe-4259-b7dc-3932c20823e9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:28:03.170042 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-90892cd9-24fe-4259-b7dc-3932c20823e9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:28:03.177446 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90892cd9-24fe-4259-b7dc-3932c20823e9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:03.177955 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90892cd9-24fe-4259-b7dc-3932c20823e9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:03.178439 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90892cd9-24fe-4259-b7dc-3932c20823e9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:03.179175 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90892cd9-24fe-4259-b7dc-3932c20823e9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:03.179648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90892cd9-24fe-4259-b7dc-3932c20823e9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:03.180095 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-90892cd9-24fe-4259-b7dc-3932c20823e9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:03.341411 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-90892cd9-24fe-4259-b7dc-3932c20823e9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:28:03.350398 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-90892cd9-24fe-4259-b7dc-3932c20823e9 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1568 microversion: 2.1 time: 0.185213 Aug 04 18:28:03.351010 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3892/7757] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:28:03 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:28:04.374261 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bf2686c6-1d72-4bdc-b1f2-4f1f4ad0747b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:28:04.375419 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bf2686c6-1d72-4bdc-b1f2-4f1f4ad0747b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:28:04.386856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf2686c6-1d72-4bdc-b1f2-4f1f4ad0747b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:04.387507 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf2686c6-1d72-4bdc-b1f2-4f1f4ad0747b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:04.388024 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf2686c6-1d72-4bdc-b1f2-4f1f4ad0747b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:04.388886 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf2686c6-1d72-4bdc-b1f2-4f1f4ad0747b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:04.389453 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf2686c6-1d72-4bdc-b1f2-4f1f4ad0747b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:04.389956 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf2686c6-1d72-4bdc-b1f2-4f1f4ad0747b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:04.612932 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bf2686c6-1d72-4bdc-b1f2-4f1f4ad0747b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:28:04.623680 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bf2686c6-1d72-4bdc-b1f2-4f1f4ad0747b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1568 microversion: 2.1 time: 0.255753 Aug 04 18:28:04.624397 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3866/7758] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:28:04 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1568 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:28:05.648897 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3a255fdf-4400-429b-8d54-8f1ab3b8c062 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:28:05.649785 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3a255fdf-4400-429b-8d54-8f1ab3b8c062 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:28:05.657199 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a255fdf-4400-429b-8d54-8f1ab3b8c062 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:05.657732 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a255fdf-4400-429b-8d54-8f1ab3b8c062 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:05.658249 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a255fdf-4400-429b-8d54-8f1ab3b8c062 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:05.659094 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a255fdf-4400-429b-8d54-8f1ab3b8c062 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:05.659690 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a255fdf-4400-429b-8d54-8f1ab3b8c062 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:05.660305 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3a255fdf-4400-429b-8d54-8f1ab3b8c062 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:05.844258 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3a255fdf-4400-429b-8d54-8f1ab3b8c062 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:28:05.859712 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3a255fdf-4400-429b-8d54-8f1ab3b8c062 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1568 microversion: 2.1 time: 0.214990 Aug 04 18:28:05.861539 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3893/7759] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:28:05 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1568 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:28:06.896783 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-10535d0f-47c3-426d-89df-5c17664d4cbd tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:28:06.897489 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-10535d0f-47c3-426d-89df-5c17664d4cbd tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:28:06.904974 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10535d0f-47c3-426d-89df-5c17664d4cbd tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:06.905543 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10535d0f-47c3-426d-89df-5c17664d4cbd tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:06.905953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10535d0f-47c3-426d-89df-5c17664d4cbd tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:06.906720 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10535d0f-47c3-426d-89df-5c17664d4cbd tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:06.907197 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10535d0f-47c3-426d-89df-5c17664d4cbd tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:06.907648 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10535d0f-47c3-426d-89df-5c17664d4cbd tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:07.067237 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-10535d0f-47c3-426d-89df-5c17664d4cbd tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:28:07.079297 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-10535d0f-47c3-426d-89df-5c17664d4cbd tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1568 microversion: 2.1 time: 0.187064 Aug 04 18:28:07.080412 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3867/7760] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:28:06 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:28:08.117120 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-25de7b9b-bddb-4859-9beb-e8b4152bcdd0 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:28:08.118330 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-25de7b9b-bddb-4859-9beb-e8b4152bcdd0 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:28:08.127435 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25de7b9b-bddb-4859-9beb-e8b4152bcdd0 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:08.128930 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25de7b9b-bddb-4859-9beb-e8b4152bcdd0 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:08.129130 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25de7b9b-bddb-4859-9beb-e8b4152bcdd0 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:08.130030 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25de7b9b-bddb-4859-9beb-e8b4152bcdd0 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:08.130617 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25de7b9b-bddb-4859-9beb-e8b4152bcdd0 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:08.131165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-25de7b9b-bddb-4859-9beb-e8b4152bcdd0 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:08.380364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-25de7b9b-bddb-4859-9beb-e8b4152bcdd0 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:28:08.392504 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-25de7b9b-bddb-4859-9beb-e8b4152bcdd0 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1568 microversion: 2.1 time: 0.280164 Aug 04 18:28:08.393230 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3894/7761] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:28:08 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1568 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:28:09.417726 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9497eadb-5c0f-4743-9d3f-5f80d4de5e88 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:28:09.418711 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9497eadb-5c0f-4743-9d3f-5f80d4de5e88 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:28:09.427345 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9497eadb-5c0f-4743-9d3f-5f80d4de5e88 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:09.427871 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9497eadb-5c0f-4743-9d3f-5f80d4de5e88 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:09.428379 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9497eadb-5c0f-4743-9d3f-5f80d4de5e88 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:09.429182 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9497eadb-5c0f-4743-9d3f-5f80d4de5e88 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:09.429678 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9497eadb-5c0f-4743-9d3f-5f80d4de5e88 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:09.430218 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9497eadb-5c0f-4743-9d3f-5f80d4de5e88 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:09.668092 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9497eadb-5c0f-4743-9d3f-5f80d4de5e88 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:28:09.683312 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9497eadb-5c0f-4743-9d3f-5f80d4de5e88 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1568 microversion: 2.1 time: 0.269765 Aug 04 18:28:09.684372 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3868/7762] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:28:09 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1568 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:28:10.710447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-72757c99-1942-4ad3-b5f3-108310e54a4c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:28:10.711349 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-72757c99-1942-4ad3-b5f3-108310e54a4c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:28:10.718990 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-72757c99-1942-4ad3-b5f3-108310e54a4c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:10.720132 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-72757c99-1942-4ad3-b5f3-108310e54a4c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:10.720763 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-72757c99-1942-4ad3-b5f3-108310e54a4c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:10.721770 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-72757c99-1942-4ad3-b5f3-108310e54a4c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:10.722366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-72757c99-1942-4ad3-b5f3-108310e54a4c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:10.722935 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-72757c99-1942-4ad3-b5f3-108310e54a4c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:10.916112 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-72757c99-1942-4ad3-b5f3-108310e54a4c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:28:10.928072 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-72757c99-1942-4ad3-b5f3-108310e54a4c tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1568 microversion: 2.1 time: 0.226170 Aug 04 18:28:10.928936 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3895/7763] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:28:10 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:28:11.951896 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b8f2681d-beeb-4cb5-9135-9be42e21cb81 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:28:11.952493 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b8f2681d-beeb-4cb5-9135-9be42e21cb81 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:28:11.960977 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8f2681d-beeb-4cb5-9135-9be42e21cb81 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:11.961486 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8f2681d-beeb-4cb5-9135-9be42e21cb81 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:11.961938 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8f2681d-beeb-4cb5-9135-9be42e21cb81 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:11.962721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8f2681d-beeb-4cb5-9135-9be42e21cb81 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:11.963224 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8f2681d-beeb-4cb5-9135-9be42e21cb81 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:11.963662 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8f2681d-beeb-4cb5-9135-9be42e21cb81 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:12.176069 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b8f2681d-beeb-4cb5-9135-9be42e21cb81 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:28:12.190473 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b8f2681d-beeb-4cb5-9135-9be42e21cb81 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1509 microversion: 2.1 time: 0.242199 Aug 04 18:28:12.191741 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3869/7764] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:28:11 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1509 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:28:12.232134 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d37249ce-4630-4d72-8d80-5143560a40db tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:28:12.233151 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d37249ce-4630-4d72-8d80-5143560a40db tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:28:12.243549 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d37249ce-4630-4d72-8d80-5143560a40db tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:12.244103 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d37249ce-4630-4d72-8d80-5143560a40db tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:12.244805 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d37249ce-4630-4d72-8d80-5143560a40db tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:12.245744 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d37249ce-4630-4d72-8d80-5143560a40db tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:12.246288 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d37249ce-4630-4d72-8d80-5143560a40db tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:12.246716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d37249ce-4630-4d72-8d80-5143560a40db tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:12.248602 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-f0379583-e211-4806-817f-1faa2aa25ea6 req-3172290c-05f6-4cb1-9cd2-475c087f543a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2204bdc-7d48-4293-a538-4ec7997d957c", "name": "network-vif-unplugged", "status": "completed", "tag": "9a9ada13-e1fb-423f-a820-0d02594e5884"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:28:12.270320 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f0379583-e211-4806-817f-1faa2aa25ea6 req-3172290c-05f6-4cb1-9cd2-475c087f543a service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:12.271086 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f0379583-e211-4806-817f-1faa2aa25ea6 req-3172290c-05f6-4cb1-9cd2-475c087f543a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:12.271809 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f0379583-e211-4806-817f-1faa2aa25ea6 req-3172290c-05f6-4cb1-9cd2-475c087f543a service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:12.298622 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.compute.server_external_events [req-f0379583-e211-4806-817f-1faa2aa25ea6 req-3172290c-05f6-4cb1-9cd2-475c087f543a service nova] Unable to find a host for instance e2204bdc-7d48-4293-a538-4ec7997d957c. Dropping event network-vif-unplugged {{(pid=131044) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 04 18:28:12.300296 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-f0379583-e211-4806-817f-1faa2aa25ea6 req-3172290c-05f6-4cb1-9cd2-475c087f543a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.060250 Aug 04 18:28:12.301565 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3870/7765] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 63 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 04 18:28:12.356784 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d37249ce-4630-4d72-8d80-5143560a40db tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=131043) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 18:28:12.452946 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d37249ce-4630-4d72-8d80-5143560a40db tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "POST /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c/action" status: 202 len: 0 microversion: 2.1 time: 0.227183 Aug 04 18:28:12.454710 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3896/7766] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:28:12 2022] POST /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 18:28:12.467802 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-733228b4-61fa-4aef-9e0c-7aabf01ce986 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:28:12.468850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-733228b4-61fa-4aef-9e0c-7aabf01ce986 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:28:12.478330 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-733228b4-61fa-4aef-9e0c-7aabf01ce986 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:12.479094 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-733228b4-61fa-4aef-9e0c-7aabf01ce986 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:12.479848 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-733228b4-61fa-4aef-9e0c-7aabf01ce986 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:12.480962 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-733228b4-61fa-4aef-9e0c-7aabf01ce986 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:12.481762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-733228b4-61fa-4aef-9e0c-7aabf01ce986 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:12.482432 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-733228b4-61fa-4aef-9e0c-7aabf01ce986 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:12.704867 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-733228b4-61fa-4aef-9e0c-7aabf01ce986 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:28:12.720573 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-733228b4-61fa-4aef-9e0c-7aabf01ce986 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1517 microversion: 2.1 time: 0.259897 Aug 04 18:28:12.721727 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3871/7767] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:28:12 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1517 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:28:13.758480 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d9dad9b1-fb25-451f-a313-d592511e6bbf tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:28:13.759342 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d9dad9b1-fb25-451f-a313-d592511e6bbf tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:28:13.769521 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9dad9b1-fb25-451f-a313-d592511e6bbf tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:13.770485 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9dad9b1-fb25-451f-a313-d592511e6bbf tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:13.771331 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9dad9b1-fb25-451f-a313-d592511e6bbf tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:13.772669 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9dad9b1-fb25-451f-a313-d592511e6bbf tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:13.773554 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9dad9b1-fb25-451f-a313-d592511e6bbf tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:13.774397 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d9dad9b1-fb25-451f-a313-d592511e6bbf tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:14.004364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d9dad9b1-fb25-451f-a313-d592511e6bbf tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:28:14.013159 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d9dad9b1-fb25-451f-a313-d592511e6bbf tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1519 microversion: 2.1 time: 0.261603 Aug 04 18:28:14.013676 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3897/7768] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:28:13 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1519 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:28:15.038175 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fc7fc9d0-7f03-43c9-8b59-ed958c84aebb tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:28:15.039254 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fc7fc9d0-7f03-43c9-8b59-ed958c84aebb tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:28:15.049794 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc7fc9d0-7f03-43c9-8b59-ed958c84aebb tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:15.050752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc7fc9d0-7f03-43c9-8b59-ed958c84aebb tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:15.051539 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc7fc9d0-7f03-43c9-8b59-ed958c84aebb tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:15.052857 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc7fc9d0-7f03-43c9-8b59-ed958c84aebb tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:15.053718 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc7fc9d0-7f03-43c9-8b59-ed958c84aebb tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:15.054520 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc7fc9d0-7f03-43c9-8b59-ed958c84aebb tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:15.277760 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fc7fc9d0-7f03-43c9-8b59-ed958c84aebb tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:28:15.292645 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fc7fc9d0-7f03-43c9-8b59-ed958c84aebb tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1519 microversion: 2.1 time: 0.259175 Aug 04 18:28:15.293634 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3872/7769] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:28:15 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1519 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:28:16.325574 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-495581d8-6c35-41d9-9d06-e4881ab94cd4 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:28:16.326829 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-495581d8-6c35-41d9-9d06-e4881ab94cd4 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:28:16.339689 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-495581d8-6c35-41d9-9d06-e4881ab94cd4 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:16.340481 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-495581d8-6c35-41d9-9d06-e4881ab94cd4 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:16.341194 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-495581d8-6c35-41d9-9d06-e4881ab94cd4 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:16.342370 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-495581d8-6c35-41d9-9d06-e4881ab94cd4 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:16.343104 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-495581d8-6c35-41d9-9d06-e4881ab94cd4 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:16.343812 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-495581d8-6c35-41d9-9d06-e4881ab94cd4 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:16.599289 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-495581d8-6c35-41d9-9d06-e4881ab94cd4 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:28:16.618270 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-495581d8-6c35-41d9-9d06-e4881ab94cd4 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1519 microversion: 2.1 time: 0.303586 Aug 04 18:28:16.619695 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3898/7770] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:28:16 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1519 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:28:17.653891 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a0be55c6-fb2a-41aa-ab18-cd27758edac2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:28:17.655160 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a0be55c6-fb2a-41aa-ab18-cd27758edac2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:28:17.666555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0be55c6-fb2a-41aa-ab18-cd27758edac2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:17.667181 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0be55c6-fb2a-41aa-ab18-cd27758edac2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:17.667643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0be55c6-fb2a-41aa-ab18-cd27758edac2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:17.668398 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0be55c6-fb2a-41aa-ab18-cd27758edac2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:17.668879 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0be55c6-fb2a-41aa-ab18-cd27758edac2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:17.669327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0be55c6-fb2a-41aa-ab18-cd27758edac2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:17.840640 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a0be55c6-fb2a-41aa-ab18-cd27758edac2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:28:17.851347 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a0be55c6-fb2a-41aa-ab18-cd27758edac2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1519 microversion: 2.1 time: 0.202673 Aug 04 18:28:17.852222 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3873/7771] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:28:17 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1519 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:28:18.876589 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f6308b6b-c62d-4b8f-bb9e-f8e58aaefc0f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:28:18.877666 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f6308b6b-c62d-4b8f-bb9e-f8e58aaefc0f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:28:18.887073 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f6308b6b-c62d-4b8f-bb9e-f8e58aaefc0f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:18.887694 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f6308b6b-c62d-4b8f-bb9e-f8e58aaefc0f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:18.888240 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f6308b6b-c62d-4b8f-bb9e-f8e58aaefc0f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:18.889181 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f6308b6b-c62d-4b8f-bb9e-f8e58aaefc0f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:18.889757 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f6308b6b-c62d-4b8f-bb9e-f8e58aaefc0f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:18.890366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f6308b6b-c62d-4b8f-bb9e-f8e58aaefc0f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:19.108426 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f6308b6b-c62d-4b8f-bb9e-f8e58aaefc0f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:28:19.124785 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f6308b6b-c62d-4b8f-bb9e-f8e58aaefc0f tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1519 microversion: 2.1 time: 0.252582 Aug 04 18:28:19.127056 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3899/7772] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:28:18 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1519 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:28:19.489124 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:28:19.489342 n-d-851359-3 devstack@n-api.service[131043]: Thu Aug 4 18:28:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:28:20.168228 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-be808f6d-71e1-4dee-99dd-e27ebecd0a0a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:28:20.169362 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-be808f6d-71e1-4dee-99dd-e27ebecd0a0a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:28:20.182500 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be808f6d-71e1-4dee-99dd-e27ebecd0a0a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:20.183440 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be808f6d-71e1-4dee-99dd-e27ebecd0a0a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:20.184282 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be808f6d-71e1-4dee-99dd-e27ebecd0a0a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:20.185575 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be808f6d-71e1-4dee-99dd-e27ebecd0a0a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:20.186441 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be808f6d-71e1-4dee-99dd-e27ebecd0a0a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:20.187207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be808f6d-71e1-4dee-99dd-e27ebecd0a0a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:20.459457 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-be808f6d-71e1-4dee-99dd-e27ebecd0a0a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:28:20.471443 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-be808f6d-71e1-4dee-99dd-e27ebecd0a0a tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1575 microversion: 2.1 time: 0.311077 Aug 04 18:28:20.472555 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3874/7773] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:28:20 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1575 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:28:21.046094 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-68bd7a2e-e90b-4e5e-a2d2-f3de418d2ad8 req-57469fb0-6f3f-44a9-a7d1-261f8da6ecf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2204bdc-7d48-4293-a538-4ec7997d957c", "tag": "9a9ada13-e1fb-423f-a820-0d02594e5884"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:28:21.069765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-68bd7a2e-e90b-4e5e-a2d2-f3de418d2ad8 req-57469fb0-6f3f-44a9-a7d1-261f8da6ecf2 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:21.069765 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-68bd7a2e-e90b-4e5e-a2d2-f3de418d2ad8 req-57469fb0-6f3f-44a9-a7d1-261f8da6ecf2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:21.070655 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-68bd7a2e-e90b-4e5e-a2d2-f3de418d2ad8 req-57469fb0-6f3f-44a9-a7d1-261f8da6ecf2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:21.088891 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-68bd7a2e-e90b-4e5e-a2d2-f3de418d2ad8 req-57469fb0-6f3f-44a9-a7d1-261f8da6ecf2 service nova] Creating event network-changed:9a9ada13-e1fb-423f-a820-0d02594e5884 for instance e2204bdc-7d48-4293-a538-4ec7997d957c on n-h1-851359-3 Aug 04 18:28:21.097723 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-68bd7a2e-e90b-4e5e-a2d2-f3de418d2ad8 req-57469fb0-6f3f-44a9-a7d1-261f8da6ecf2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059035 Aug 04 18:28:21.098604 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3900/7774] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:28:21.496725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9caf74fa-2a0d-4c59-9901-caec32685b4b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:28:21.497555 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9caf74fa-2a0d-4c59-9901-caec32685b4b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:28:21.507370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9caf74fa-2a0d-4c59-9901-caec32685b4b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:21.508084 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9caf74fa-2a0d-4c59-9901-caec32685b4b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:21.508667 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9caf74fa-2a0d-4c59-9901-caec32685b4b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:21.509670 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9caf74fa-2a0d-4c59-9901-caec32685b4b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:21.510274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9caf74fa-2a0d-4c59-9901-caec32685b4b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:21.511023 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9caf74fa-2a0d-4c59-9901-caec32685b4b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:21.922631 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9caf74fa-2a0d-4c59-9901-caec32685b4b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:28:21.938643 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9caf74fa-2a0d-4c59-9901-caec32685b4b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1575 microversion: 2.1 time: 0.445849 Aug 04 18:28:21.939743 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3875/7775] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:28:21 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1575 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:28:22.976212 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a94e6890-76b2-42f5-afc7-25d3fccdc479 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:28:22.977324 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a94e6890-76b2-42f5-afc7-25d3fccdc479 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:28:22.987223 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a94e6890-76b2-42f5-afc7-25d3fccdc479 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:22.988063 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a94e6890-76b2-42f5-afc7-25d3fccdc479 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:22.988582 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a94e6890-76b2-42f5-afc7-25d3fccdc479 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:22.989450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a94e6890-76b2-42f5-afc7-25d3fccdc479 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:22.990092 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a94e6890-76b2-42f5-afc7-25d3fccdc479 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:22.990628 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a94e6890-76b2-42f5-afc7-25d3fccdc479 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:23.734753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a94e6890-76b2-42f5-afc7-25d3fccdc479 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:28:23.748583 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a94e6890-76b2-42f5-afc7-25d3fccdc479 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1575 microversion: 2.1 time: 0.778991 Aug 04 18:28:23.749557 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3901/7776] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:28:22 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1575 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:28:24.781657 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b8fd5dbb-baee-4074-93d7-7578c2f04910 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:28:24.783107 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b8fd5dbb-baee-4074-93d7-7578c2f04910 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:28:24.791839 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8fd5dbb-baee-4074-93d7-7578c2f04910 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:24.792425 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8fd5dbb-baee-4074-93d7-7578c2f04910 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:24.792994 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8fd5dbb-baee-4074-93d7-7578c2f04910 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:24.793872 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8fd5dbb-baee-4074-93d7-7578c2f04910 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:24.794478 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8fd5dbb-baee-4074-93d7-7578c2f04910 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:24.795017 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8fd5dbb-baee-4074-93d7-7578c2f04910 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:24.992287 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b8fd5dbb-baee-4074-93d7-7578c2f04910 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:28:25.005406 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b8fd5dbb-baee-4074-93d7-7578c2f04910 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1575 microversion: 2.1 time: 0.228480 Aug 04 18:28:25.006462 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3876/7777] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:28:24 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1575 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:28:26.041730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-fa264465-e226-4f33-870d-b8f8c4042d90 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:28:26.042417 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-fa264465-e226-4f33-870d-b8f8c4042d90 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:28:26.046010 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:28:26.054286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fa264465-e226-4f33-870d-b8f8c4042d90 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:26.054956 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fa264465-e226-4f33-870d-b8f8c4042d90 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:26.055450 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fa264465-e226-4f33-870d-b8f8c4042d90 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:26.056326 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fa264465-e226-4f33-870d-b8f8c4042d90 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:26.056849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fa264465-e226-4f33-870d-b8f8c4042d90 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:26.057286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-fa264465-e226-4f33-870d-b8f8c4042d90 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:26.061550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:28:26.251290 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-fa264465-e226-4f33-870d-b8f8c4042d90 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:28:26.260471 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-fa264465-e226-4f33-870d-b8f8c4042d90 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1575 microversion: 2.1 time: 0.223089 Aug 04 18:28:26.261154 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3902/7778] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:28:26 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1575 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:28:27.284992 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a359f64e-38d6-4454-a2f9-13a4a6ddb4a8 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:28:27.285935 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a359f64e-38d6-4454-a2f9-13a4a6ddb4a8 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:28:27.288815 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=31 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:28:27.295790 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a359f64e-38d6-4454-a2f9-13a4a6ddb4a8 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:27.296465 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a359f64e-38d6-4454-a2f9-13a4a6ddb4a8 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:27.297032 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a359f64e-38d6-4454-a2f9-13a4a6ddb4a8 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:27.298516 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a359f64e-38d6-4454-a2f9-13a4a6ddb4a8 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:27.299119 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a359f64e-38d6-4454-a2f9-13a4a6ddb4a8 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:27.299752 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a359f64e-38d6-4454-a2f9-13a4a6ddb4a8 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:27.303932 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:28:27.480506 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a359f64e-38d6-4454-a2f9-13a4a6ddb4a8 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:28:27.496113 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a359f64e-38d6-4454-a2f9-13a4a6ddb4a8 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1575 microversion: 2.1 time: 0.216426 Aug 04 18:28:27.497214 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3877/7779] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:28:27 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1575 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:28:28.529311 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-1f2bdf16-ebeb-4100-bf26-fa79c4ff7153 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:28:28.544654 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-1f2bdf16-ebeb-4100-bf26-fa79c4ff7153 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:28:28.548937 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f2bdf16-ebeb-4100-bf26-fa79c4ff7153 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:28.549492 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f2bdf16-ebeb-4100-bf26-fa79c4ff7153 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:28.550414 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f2bdf16-ebeb-4100-bf26-fa79c4ff7153 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:28.551658 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f2bdf16-ebeb-4100-bf26-fa79c4ff7153 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:28.552511 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f2bdf16-ebeb-4100-bf26-fa79c4ff7153 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:28.553299 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-1f2bdf16-ebeb-4100-bf26-fa79c4ff7153 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:28.789528 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-1f2bdf16-ebeb-4100-bf26-fa79c4ff7153 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:28:28.805140 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-1f2bdf16-ebeb-4100-bf26-fa79c4ff7153 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1575 microversion: 2.1 time: 0.283764 Aug 04 18:28:28.806221 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3903/7780] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:28:28 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1575 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:28:29.846782 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d478ab6f-cc35-4940-80df-7d5f45d6d2ca tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:28:29.847687 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d478ab6f-cc35-4940-80df-7d5f45d6d2ca tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:28:29.855080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d478ab6f-cc35-4940-80df-7d5f45d6d2ca tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:29.855702 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d478ab6f-cc35-4940-80df-7d5f45d6d2ca tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:29.856418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d478ab6f-cc35-4940-80df-7d5f45d6d2ca tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:29.857775 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d478ab6f-cc35-4940-80df-7d5f45d6d2ca tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:29.858755 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d478ab6f-cc35-4940-80df-7d5f45d6d2ca tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:29.859834 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d478ab6f-cc35-4940-80df-7d5f45d6d2ca tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:30.087270 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d478ab6f-cc35-4940-80df-7d5f45d6d2ca tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:28:30.099667 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d478ab6f-cc35-4940-80df-7d5f45d6d2ca tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1575 microversion: 2.1 time: 0.261055 Aug 04 18:28:30.100195 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3878/7781] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:28:29 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1575 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:28:31.127582 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6493ec23-2d56-438f-bbaa-3ea39d599318 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:28:31.128647 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6493ec23-2d56-438f-bbaa-3ea39d599318 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:28:31.138222 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6493ec23-2d56-438f-bbaa-3ea39d599318 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:31.138819 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6493ec23-2d56-438f-bbaa-3ea39d599318 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:31.139584 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6493ec23-2d56-438f-bbaa-3ea39d599318 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:31.140536 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6493ec23-2d56-438f-bbaa-3ea39d599318 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:31.141122 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6493ec23-2d56-438f-bbaa-3ea39d599318 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:31.141702 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6493ec23-2d56-438f-bbaa-3ea39d599318 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:31.283431 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-1f94e612-bc6a-4b56-b58b-1ff133340496 req-d27998ca-b077-42d9-b49e-4a45a87d1cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2204bdc-7d48-4293-a538-4ec7997d957c", "name": "network-vif-plugged", "status": "completed", "tag": "9a9ada13-e1fb-423f-a820-0d02594e5884"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:28:31.304620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1f94e612-bc6a-4b56-b58b-1ff133340496 req-d27998ca-b077-42d9-b49e-4a45a87d1cc1 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:31.305686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1f94e612-bc6a-4b56-b58b-1ff133340496 req-d27998ca-b077-42d9-b49e-4a45a87d1cc1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:31.306651 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1f94e612-bc6a-4b56-b58b-1ff133340496 req-d27998ca-b077-42d9-b49e-4a45a87d1cc1 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:31.329289 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-1f94e612-bc6a-4b56-b58b-1ff133340496 req-d27998ca-b077-42d9-b49e-4a45a87d1cc1 service nova] Creating event network-vif-plugged:9a9ada13-e1fb-423f-a820-0d02594e5884 for instance e2204bdc-7d48-4293-a538-4ec7997d957c on n-h1-851359-3 Aug 04 18:28:31.338356 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-1f94e612-bc6a-4b56-b58b-1ff133340496 req-d27998ca-b077-42d9-b49e-4a45a87d1cc1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144645 Aug 04 18:28:31.339399 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3879/7782] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:28:31.369754 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6493ec23-2d56-438f-bbaa-3ea39d599318 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:28:31.384389 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6493ec23-2d56-438f-bbaa-3ea39d599318 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1575 microversion: 2.1 time: 0.261151 Aug 04 18:28:31.385448 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3904/7783] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:28:31 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1575 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:28:32.417277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e4cc552f-60f9-4483-b03c-28e70d36b065 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:28:32.418994 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e4cc552f-60f9-4483-b03c-28e70d36b065 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:28:32.426515 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4cc552f-60f9-4483-b03c-28e70d36b065 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:32.427379 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4cc552f-60f9-4483-b03c-28e70d36b065 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:32.428092 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4cc552f-60f9-4483-b03c-28e70d36b065 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:32.429062 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4cc552f-60f9-4483-b03c-28e70d36b065 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:32.429685 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4cc552f-60f9-4483-b03c-28e70d36b065 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:32.430298 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4cc552f-60f9-4483-b03c-28e70d36b065 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:32.624849 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e4cc552f-60f9-4483-b03c-28e70d36b065 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:28:32.638271 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e4cc552f-60f9-4483-b03c-28e70d36b065 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1575 microversion: 2.1 time: 0.230642 Aug 04 18:28:32.639201 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3880/7784] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:28:32 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1575 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:28:33.669623 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-f720a62b-4446-4aac-8ebc-50841e21e973 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:28:33.670621 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-f720a62b-4446-4aac-8ebc-50841e21e973 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:28:33.679295 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f720a62b-4446-4aac-8ebc-50841e21e973 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:33.679879 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f720a62b-4446-4aac-8ebc-50841e21e973 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:33.680375 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f720a62b-4446-4aac-8ebc-50841e21e973 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:33.681307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f720a62b-4446-4aac-8ebc-50841e21e973 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:28:33.681834 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f720a62b-4446-4aac-8ebc-50841e21e973 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:28:33.682424 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-f720a62b-4446-4aac-8ebc-50841e21e973 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:28:33.850688 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-f720a62b-4446-4aac-8ebc-50841e21e973 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:28:33.865602 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-f720a62b-4446-4aac-8ebc-50841e21e973 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1562 microversion: 2.1 time: 0.203983 Aug 04 18:28:33.866620 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3905/7785] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:28:33 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1562 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:29:23.214702 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:29:23.215567 n-d-851359-3 devstack@n-api.service[131044]: Thu Aug 4 18:29:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:29:48.490772 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=7 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:29:48.492077 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=19 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:29:48.497630 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=7 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:29:48.498943 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=23 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:29:48.500568 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7abe0263-f73a-49f1-9d34-488af59ff4c3 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:29:48.501598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7abe0263-f73a-49f1-9d34-488af59ff4c3 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:29:48.503515 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-48c72864-6798-4270-a9be-abb2e476f1d8 req-01b14762-3e45-411a-9e70-7056888e14d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2204bdc-7d48-4293-a538-4ec7997d957c", "tag": "9a9ada13-e1fb-423f-a820-0d02594e5884"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:29:48.515321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7abe0263-f73a-49f1-9d34-488af59ff4c3 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:29:48.515953 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7abe0263-f73a-49f1-9d34-488af59ff4c3 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:29:48.516725 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7abe0263-f73a-49f1-9d34-488af59ff4c3 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:29:48.517652 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7abe0263-f73a-49f1-9d34-488af59ff4c3 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:29:48.517846 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-48c72864-6798-4270-a9be-abb2e476f1d8 req-01b14762-3e45-411a-9e70-7056888e14d9 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:29:48.518389 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7abe0263-f73a-49f1-9d34-488af59ff4c3 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:29:48.518591 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-48c72864-6798-4270-a9be-abb2e476f1d8 req-01b14762-3e45-411a-9e70-7056888e14d9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:29:48.518959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-48c72864-6798-4270-a9be-abb2e476f1d8 req-01b14762-3e45-411a-9e70-7056888e14d9 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:29:48.519163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7abe0263-f73a-49f1-9d34-488af59ff4c3 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:29:48.533307 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-48c72864-6798-4270-a9be-abb2e476f1d8 req-01b14762-3e45-411a-9e70-7056888e14d9 service nova] Creating event network-changed:9a9ada13-e1fb-423f-a820-0d02594e5884 for instance e2204bdc-7d48-4293-a538-4ec7997d957c on n-h1-851359-3 Aug 04 18:29:48.540064 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-48c72864-6798-4270-a9be-abb2e476f1d8 req-01b14762-3e45-411a-9e70-7056888e14d9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044737 Aug 04 18:29:48.540820 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3906/7786] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:29:48.561110 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7abe0263-f73a-49f1-9d34-488af59ff4c3 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 18:29:48.688575 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7abe0263-f73a-49f1-9d34-488af59ff4c3 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 204 len: 0 microversion: 2.1 time: 0.199823 Aug 04 18:29:48.692621 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3881/7787] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 18:29:48 2022] DELETE /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 18:29:48.703321 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d71904ce-1450-4033-8b14-cfcf8af048ec tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:29:48.705102 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d71904ce-1450-4033-8b14-cfcf8af048ec tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:29:48.716864 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d71904ce-1450-4033-8b14-cfcf8af048ec tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:29:48.718895 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d71904ce-1450-4033-8b14-cfcf8af048ec tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:29:48.719892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d71904ce-1450-4033-8b14-cfcf8af048ec tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:29:48.721015 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d71904ce-1450-4033-8b14-cfcf8af048ec tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:29:48.722184 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d71904ce-1450-4033-8b14-cfcf8af048ec tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:29:48.723360 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d71904ce-1450-4033-8b14-cfcf8af048ec tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:29:48.965044 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d71904ce-1450-4033-8b14-cfcf8af048ec tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:29:48.974386 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d71904ce-1450-4033-8b14-cfcf8af048ec tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1568 microversion: 2.1 time: 0.279305 Aug 04 18:29:48.975012 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3907/7788] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:29:48 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1568 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:29:50.002139 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f607670d-fc26-4daf-a593-9c94ebb9bb80 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:29:50.004121 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f607670d-fc26-4daf-a593-9c94ebb9bb80 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:29:50.014662 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f607670d-fc26-4daf-a593-9c94ebb9bb80 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:29:50.015787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f607670d-fc26-4daf-a593-9c94ebb9bb80 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:29:50.016666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f607670d-fc26-4daf-a593-9c94ebb9bb80 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:29:50.018014 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f607670d-fc26-4daf-a593-9c94ebb9bb80 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:29:50.018598 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f607670d-fc26-4daf-a593-9c94ebb9bb80 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:29:50.019280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f607670d-fc26-4daf-a593-9c94ebb9bb80 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:29:50.244755 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f607670d-fc26-4daf-a593-9c94ebb9bb80 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:29:50.254941 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f607670d-fc26-4daf-a593-9c94ebb9bb80 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1568 microversion: 2.1 time: 0.258938 Aug 04 18:29:50.255794 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3882/7789] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:29:49 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1568 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:29:50.933017 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-f5d9d8d7-06dc-4444-9fbc-9b9b665265da req-8118a74c-f6ba-441a-92a7-5a13174bec72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2204bdc-7d48-4293-a538-4ec7997d957c", "name": "network-vif-deleted", "tag": "9a9ada13-e1fb-423f-a820-0d02594e5884"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:29:50.954732 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f5d9d8d7-06dc-4444-9fbc-9b9b665265da req-8118a74c-f6ba-441a-92a7-5a13174bec72 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:29:50.955716 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f5d9d8d7-06dc-4444-9fbc-9b9b665265da req-8118a74c-f6ba-441a-92a7-5a13174bec72 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:29:50.956676 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f5d9d8d7-06dc-4444-9fbc-9b9b665265da req-8118a74c-f6ba-441a-92a7-5a13174bec72 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:29:50.979650 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-f5d9d8d7-06dc-4444-9fbc-9b9b665265da req-8118a74c-f6ba-441a-92a7-5a13174bec72 service nova] Creating event network-vif-deleted:9a9ada13-e1fb-423f-a820-0d02594e5884 for instance e2204bdc-7d48-4293-a538-4ec7997d957c on n-h1-851359-3 Aug 04 18:29:50.989865 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-f5d9d8d7-06dc-4444-9fbc-9b9b665265da req-8118a74c-f6ba-441a-92a7-5a13174bec72 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064314 Aug 04 18:29:50.991459 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3908/7790] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:29:51.294018 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c53b5808-afc5-4fd6-afa2-ca0fc60db93d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:29:51.295767 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c53b5808-afc5-4fd6-afa2-ca0fc60db93d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:29:51.304557 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c53b5808-afc5-4fd6-afa2-ca0fc60db93d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:29:51.305478 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c53b5808-afc5-4fd6-afa2-ca0fc60db93d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:29:51.306037 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c53b5808-afc5-4fd6-afa2-ca0fc60db93d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:29:51.306885 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c53b5808-afc5-4fd6-afa2-ca0fc60db93d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:29:51.307423 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c53b5808-afc5-4fd6-afa2-ca0fc60db93d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:29:51.307938 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c53b5808-afc5-4fd6-afa2-ca0fc60db93d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:29:51.386153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c53b5808-afc5-4fd6-afa2-ca0fc60db93d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:29:51.398989 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c53b5808-afc5-4fd6-afa2-ca0fc60db93d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1218 microversion: 2.1 time: 0.109938 Aug 04 18:29:51.400041 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3883/7791] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:29:51 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:29:52.434285 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-dcfb3b2c-b49c-499f-9dad-96f3eebfcd76 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:29:52.436593 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-dcfb3b2c-b49c-499f-9dad-96f3eebfcd76 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:29:52.447767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcfb3b2c-b49c-499f-9dad-96f3eebfcd76 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:29:52.448648 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcfb3b2c-b49c-499f-9dad-96f3eebfcd76 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:29:52.449444 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcfb3b2c-b49c-499f-9dad-96f3eebfcd76 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:29:52.450771 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcfb3b2c-b49c-499f-9dad-96f3eebfcd76 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:29:52.451602 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcfb3b2c-b49c-499f-9dad-96f3eebfcd76 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:29:52.452386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-dcfb3b2c-b49c-499f-9dad-96f3eebfcd76 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:29:52.564423 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-dcfb3b2c-b49c-499f-9dad-96f3eebfcd76 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:29:52.580319 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-dcfb3b2c-b49c-499f-9dad-96f3eebfcd76 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1218 microversion: 2.1 time: 0.155118 Aug 04 18:29:52.581364 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3909/7792] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:29:52 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1218 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:29:53.617040 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ec77f947-f3cc-4ccb-abb5-627c59a61ae2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:29:53.618166 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ec77f947-f3cc-4ccb-abb5-627c59a61ae2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:29:53.627542 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec77f947-f3cc-4ccb-abb5-627c59a61ae2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:29:53.628248 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec77f947-f3cc-4ccb-abb5-627c59a61ae2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:29:53.628859 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec77f947-f3cc-4ccb-abb5-627c59a61ae2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:29:53.629834 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec77f947-f3cc-4ccb-abb5-627c59a61ae2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:29:53.630496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec77f947-f3cc-4ccb-abb5-627c59a61ae2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:29:53.631096 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec77f947-f3cc-4ccb-abb5-627c59a61ae2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:29:53.705748 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ec77f947-f3cc-4ccb-abb5-627c59a61ae2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:29:53.722452 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ec77f947-f3cc-4ccb-abb5-627c59a61ae2 tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1218 microversion: 2.1 time: 0.109516 Aug 04 18:29:53.723588 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3884/7793] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:29:53 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:29:54.761400 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e39b2a00-e380-450d-a5f9-ab934a5bba9d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:29:54.762577 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e39b2a00-e380-450d-a5f9-ab934a5bba9d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:29:54.775735 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e39b2a00-e380-450d-a5f9-ab934a5bba9d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:29:54.776571 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e39b2a00-e380-450d-a5f9-ab934a5bba9d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:29:54.777318 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e39b2a00-e380-450d-a5f9-ab934a5bba9d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:29:54.778709 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e39b2a00-e380-450d-a5f9-ab934a5bba9d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:29:54.780173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e39b2a00-e380-450d-a5f9-ab934a5bba9d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:29:54.780908 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e39b2a00-e380-450d-a5f9-ab934a5bba9d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:29:54.884192 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e39b2a00-e380-450d-a5f9-ab934a5bba9d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:29:54.899833 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e39b2a00-e380-450d-a5f9-ab934a5bba9d tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1218 microversion: 2.1 time: 0.145122 Aug 04 18:29:54.900948 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3910/7794] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:29:54 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1218 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:29:55.925404 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-33af32c5-a9b0-46f0-91a7-981bfd15aeac tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:29:55.926537 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-33af32c5-a9b0-46f0-91a7-981bfd15aeac tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:29:55.937336 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33af32c5-a9b0-46f0-91a7-981bfd15aeac tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:29:55.938217 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33af32c5-a9b0-46f0-91a7-981bfd15aeac tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:29:55.939102 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33af32c5-a9b0-46f0-91a7-981bfd15aeac tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:29:55.940390 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33af32c5-a9b0-46f0-91a7-981bfd15aeac tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:29:55.941020 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33af32c5-a9b0-46f0-91a7-981bfd15aeac tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:29:55.941559 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33af32c5-a9b0-46f0-91a7-981bfd15aeac tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:29:56.054873 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-33af32c5-a9b0-46f0-91a7-981bfd15aeac tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d38392324f546cf806b6ff92738b4b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6b1025d4b4b47878d13cc547a78e869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:29:56.071131 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-33af32c5-a9b0-46f0-91a7-981bfd15aeac tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 200 len: 1218 microversion: 2.1 time: 0.151063 Aug 04 18:29:56.072696 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3885/7795] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:29:55 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 1218 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:29:57.099734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-84c966d7-f93a-4175-b8ca-5adfc1455c3b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:29:57.100465 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-84c966d7-f93a-4175-b8ca-5adfc1455c3b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] [instance: e2204bdc-7d48-4293-a538-4ec7997d957c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:29:57.107809 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84c966d7-f93a-4175-b8ca-5adfc1455c3b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:29:57.108321 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84c966d7-f93a-4175-b8ca-5adfc1455c3b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:29:57.108775 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84c966d7-f93a-4175-b8ca-5adfc1455c3b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:29:57.109510 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84c966d7-f93a-4175-b8ca-5adfc1455c3b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:29:57.110098 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84c966d7-f93a-4175-b8ca-5adfc1455c3b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:29:57.110463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-84c966d7-f93a-4175-b8ca-5adfc1455c3b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:29:57.127986 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-84c966d7-f93a-4175-b8ca-5adfc1455c3b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] HTTP exception thrown: Instance e2204bdc-7d48-4293-a538-4ec7997d957c could not be found. Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-84c966d7-f93a-4175-b8ca-5adfc1455c3b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Request method failure captured: Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c HTTP/1.1 Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7A4IDd-w7aHI7QTsm5lmI54SlvKHSEH0XTVOtjGjEW0tSazFzDWeinSOcmA6oi2WryyLi6YXS9R3qwAPAOCTrYLFenBcpPvNYfhr_HICJDkwZsPTcw6ZK8MEnl4q3aUDpgNAYNgC15bfQHzisBTfs5vF0tzbbeYScwu4ZUVveYFLlXM Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: d6b1025d4b4b47878d13cc547a78e869 Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-TestShelveInstance-1305817526 Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d6b1025d4b4b47878d13cc547a78e869"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/d6b1025d4b4b47878d13cc547a78e869"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_d6b1025d4b4b47878d13cc547a78e869"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/d6b1025d4b4b47878d13cc547a78e869"}]}] Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-TestShelveInstance-1305817526 Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: d6b1025d4b4b47878d13cc547a78e869 Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-TestShelveInstance-1305817526 Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-TestShelveInstance-1305817526-project Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 4d38392324f546cf806b6ff92738b4b9 Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-TestShelveInstance-1305817526-project Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance e2204bdc-7d48-4293-a538-4ec7997d957c could not be found. Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': 'e2204bdc-7d48-4293-a538-4ec7997d957c'} Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2204bdc-7d48-4293-a538-4ec7997d957c could not be found. Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2204bdc-7d48-4293-a538-4ec7997d957c could not be found. Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:29:57.129781 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:29:57.138227 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:29:57.138227 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:29:57.138227 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:29:57.138227 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:29:57.138227 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:29:57.138227 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2204bdc-7d48-4293-a538-4ec7997d957c could not be found. Aug 04 18:29:57.138227 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:29:57.138227 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-84c966d7-f93a-4175-b8ca-5adfc1455c3b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Returning 404 to user: Instance e2204bdc-7d48-4293-a538-4ec7997d957c could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:29:57.138227 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-84c966d7-f93a-4175-b8ca-5adfc1455c3b tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c" status: 404 len: 111 microversion: 2.1 time: 0.035796 Aug 04 18:29:57.138227 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3911/7796] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:29:57 2022] GET /compute/v2.1/servers/e2204bdc-7d48-4293-a538-4ec7997d957c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 18:29:57.350619 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6df7c5f8-d347-4ff2-8ca0-959fedfcc4ac tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] Calling method '.version_select at 0x7f1e5aae61f0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:29:57.399709 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6df7c5f8-d347-4ff2-8ca0-959fedfcc4ac tempest-TestShelveInstance-1305817526 tempest-TestShelveInstance-1305817526-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-272367031" status: 202 len: 0 microversion: 2.1 time: 0.053580 Aug 04 18:29:57.400668 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3886/7797] 10.222.0.93 () {58 vars in 1251 bytes} [Thu Aug 4 18:29:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-272367031 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 18:30:23.109052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=12 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:30:23.110060 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=24 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:30:23.450071 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-af66f9f0-9eb2-429f-9216-a7f1da865a12 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Action: 'create', calling method: .version_select at 0x7f1e5b9f9700>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-209441469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMRYgz5fG/DTGwQYiTebuUWy7uDeEx9Co9Isn8uxgVIq+iZCy2ZTvdu/TP4+NqbyLmH93wbS2ug3YiBOXnkgB5qFBFnSoE1QXQX29/Y8TyqrHH6laSAli0VkdtB2SALSbw=="}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:30:23.484115 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-af66f9f0-9eb2-429f-9216-a7f1da865a12 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Getting quotas for project 0cdb03c0ef5a4e439a2e8486ab03dcb6. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 18:30:23.491443 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.quota [None req-af66f9f0-9eb2-429f-9216-a7f1da865a12 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Getting quotas for user 6b29e5823ffa41b78d37ed0312625388 and project 0cdb03c0ef5a4e439a2e8486ab03dcb6. Resources: {'key_pairs'} {{(pid=131043) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 18:30:23.531563 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-af66f9f0-9eb2-429f-9216-a7f1da865a12 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.427686 Aug 04 18:30:23.532670 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3912/7798] 10.222.0.93 () {60 vars in 1159 bytes} [Thu Aug 4 18:30:23 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:30:25.070265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:30:25.071671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:30:25.080671 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-02a15cfa-c22a-4013-8407-4c3b61935799 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1867548261", "imageRef": "93ebc91d-2d7a-4ab2-b133-dcf9559166d9", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-209441469", "security_groups": [{"name": "tempest-secgroup-smoke-1145870585"}], "networks": [{"uuid": "bd6a2ad9-8969-477d-b1f4-ecb5b3c361a3"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:30:25.248255 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-02a15cfa-c22a-4013-8407-4c3b61935799 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] validate_networks() for [('bd6a2ad9-8969-477d-b1f4-ecb5b3c361a3', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 18:30:25.996921 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-02a15cfa-c22a-4013-8407-4c3b61935799 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 18:30:25.998275 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-02a15cfa-c22a-4013-8407-4c3b61935799 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 18:30:25.999403 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-02a15cfa-c22a-4013-8407-4c3b61935799 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 18:30:26.000219 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-02a15cfa-c22a-4013-8407-4c3b61935799 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 18:30:26.000996 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-02a15cfa-c22a-4013-8407-4c3b61935799 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 18:30:26.016674 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02a15cfa-c22a-4013-8407-4c3b61935799 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:30:26.017278 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02a15cfa-c22a-4013-8407-4c3b61935799 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:30:26.017863 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02a15cfa-c22a-4013-8407-4c3b61935799 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:30:26.018788 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02a15cfa-c22a-4013-8407-4c3b61935799 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:30:26.020005 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02a15cfa-c22a-4013-8407-4c3b61935799 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:30:26.020908 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02a15cfa-c22a-4013-8407-4c3b61935799 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:30:26.041756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-02a15cfa-c22a-4013-8407-4c3b61935799 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Getting quotas for project 0cdb03c0ef5a4e439a2e8486ab03dcb6. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 18:30:26.049274 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-02a15cfa-c22a-4013-8407-4c3b61935799 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Getting quotas for user 6b29e5823ffa41b78d37ed0312625388 and project 0cdb03c0ef5a4e439a2e8486ab03dcb6. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 18:30:26.066225 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-02a15cfa-c22a-4013-8407-4c3b61935799 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 18:30:26.069074 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-02a15cfa-c22a-4013-8407-4c3b61935799 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: ed8c085b-1f44-46ba-9d67-e48e5593972c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93ebc91d-2d7a-4ab2-b133-dcf9559166d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 18:30:26.145469 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-02a15cfa-c22a-4013-8407-4c3b61935799 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.077968 Aug 04 18:30:26.152796 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3887/7799] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 18:30:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 18:30:26.159949 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-2612b895-9a05-4682-9aee-2c527b6bd0a0 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:30:26.161857 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-2612b895-9a05-4682-9aee-2c527b6bd0a0 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: ed8c085b-1f44-46ba-9d67-e48e5593972c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:30:26.251314 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-2612b895-9a05-4682-9aee-2c527b6bd0a0 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:30:26.261937 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-2612b895-9a05-4682-9aee-2c527b6bd0a0 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/ed8c085b-1f44-46ba-9d67-e48e5593972c" status: 200 len: 1248 microversion: 2.1 time: 0.106761 Aug 04 18:30:26.265394 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3913/7800] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:30:26 2022] GET /compute/v2.1/servers/ed8c085b-1f44-46ba-9d67-e48e5593972c => generated 1248 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:30:27.295740 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9dc68557-c04c-4d3d-9776-e02018398961 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:30:27.296738 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9dc68557-c04c-4d3d-9776-e02018398961 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: ed8c085b-1f44-46ba-9d67-e48e5593972c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:30:27.321744 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dc68557-c04c-4d3d-9776-e02018398961 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:30:27.322607 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dc68557-c04c-4d3d-9776-e02018398961 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:30:27.323647 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dc68557-c04c-4d3d-9776-e02018398961 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:30:27.324936 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dc68557-c04c-4d3d-9776-e02018398961 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:30:27.325608 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dc68557-c04c-4d3d-9776-e02018398961 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:30:27.326437 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dc68557-c04c-4d3d-9776-e02018398961 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:30:27.466722 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9dc68557-c04c-4d3d-9776-e02018398961 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:30:27.483105 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9dc68557-c04c-4d3d-9776-e02018398961 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/ed8c085b-1f44-46ba-9d67-e48e5593972c" status: 200 len: 1300 microversion: 2.1 time: 0.191685 Aug 04 18:30:27.483836 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3888/7801] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:30:27 2022] GET /compute/v2.1/servers/ed8c085b-1f44-46ba-9d67-e48e5593972c => generated 1300 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:30:28.515797 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-3f2f2545-6b1a-4093-8666-b0552fbb22c1 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:30:28.517307 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-3f2f2545-6b1a-4093-8666-b0552fbb22c1 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: ed8c085b-1f44-46ba-9d67-e48e5593972c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:30:28.526842 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f2f2545-6b1a-4093-8666-b0552fbb22c1 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:30:28.527808 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f2f2545-6b1a-4093-8666-b0552fbb22c1 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:30:28.528437 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f2f2545-6b1a-4093-8666-b0552fbb22c1 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:30:28.529504 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f2f2545-6b1a-4093-8666-b0552fbb22c1 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:30:28.530422 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f2f2545-6b1a-4093-8666-b0552fbb22c1 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:30:28.531018 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-3f2f2545-6b1a-4093-8666-b0552fbb22c1 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:30:28.627441 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-3f2f2545-6b1a-4093-8666-b0552fbb22c1 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:30:28.635747 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-3f2f2545-6b1a-4093-8666-b0552fbb22c1 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/ed8c085b-1f44-46ba-9d67-e48e5593972c" status: 200 len: 1306 microversion: 2.1 time: 0.125553 Aug 04 18:30:28.637053 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3914/7802] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:30:28 2022] GET /compute/v2.1/servers/ed8c085b-1f44-46ba-9d67-e48e5593972c => generated 1306 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:30:29.670672 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9541457f-952b-4b56-8ad9-0bfb212535a0 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:30:29.671547 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9541457f-952b-4b56-8ad9-0bfb212535a0 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: ed8c085b-1f44-46ba-9d67-e48e5593972c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:30:29.680216 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9541457f-952b-4b56-8ad9-0bfb212535a0 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:30:29.680826 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9541457f-952b-4b56-8ad9-0bfb212535a0 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:30:29.681496 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9541457f-952b-4b56-8ad9-0bfb212535a0 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:30:29.682633 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9541457f-952b-4b56-8ad9-0bfb212535a0 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:30:29.683190 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9541457f-952b-4b56-8ad9-0bfb212535a0 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:30:29.683889 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9541457f-952b-4b56-8ad9-0bfb212535a0 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:30:29.791117 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-fb4cc363-1da8-493d-a8f9-c7fe19b775a4 req-80ccc431-0810-4a85-a9f1-e148ea133e77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed8c085b-1f44-46ba-9d67-e48e5593972c", "tag": "240a1311-3d49-4880-ae1c-c663efa4c2bb"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:30:29.835024 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-fb4cc363-1da8-493d-a8f9-c7fe19b775a4 req-80ccc431-0810-4a85-a9f1-e148ea133e77 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:30:29.835940 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-fb4cc363-1da8-493d-a8f9-c7fe19b775a4 req-80ccc431-0810-4a85-a9f1-e148ea133e77 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:30:29.843589 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-fb4cc363-1da8-493d-a8f9-c7fe19b775a4 req-80ccc431-0810-4a85-a9f1-e148ea133e77 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:30:29.864998 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-fb4cc363-1da8-493d-a8f9-c7fe19b775a4 req-80ccc431-0810-4a85-a9f1-e148ea133e77 service nova] Creating event network-changed:240a1311-3d49-4880-ae1c-c663efa4c2bb for instance ed8c085b-1f44-46ba-9d67-e48e5593972c on n-h1-851359-3 Aug 04 18:30:29.873009 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-fb4cc363-1da8-493d-a8f9-c7fe19b775a4 req-80ccc431-0810-4a85-a9f1-e148ea133e77 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092866 Aug 04 18:30:29.874642 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3915/7803] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:30:29.927938 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9541457f-952b-4b56-8ad9-0bfb212535a0 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:30:29.936399 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9541457f-952b-4b56-8ad9-0bfb212535a0 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/ed8c085b-1f44-46ba-9d67-e48e5593972c" status: 200 len: 1374 microversion: 2.1 time: 0.271641 Aug 04 18:30:29.937012 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3889/7804] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:30:29 2022] GET /compute/v2.1/servers/ed8c085b-1f44-46ba-9d67-e48e5593972c => generated 1374 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:30:30.967520 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-27ac95e0-d90d-4503-a510-de9a86387f0b tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:30:30.968287 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-27ac95e0-d90d-4503-a510-de9a86387f0b tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: ed8c085b-1f44-46ba-9d67-e48e5593972c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:30:30.975455 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-27ac95e0-d90d-4503-a510-de9a86387f0b tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:30:30.975970 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-27ac95e0-d90d-4503-a510-de9a86387f0b tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:30:30.976575 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-27ac95e0-d90d-4503-a510-de9a86387f0b tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:30:30.977353 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-27ac95e0-d90d-4503-a510-de9a86387f0b tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:30:30.977857 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-27ac95e0-d90d-4503-a510-de9a86387f0b tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:30:30.978229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-27ac95e0-d90d-4503-a510-de9a86387f0b tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:30:31.209705 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-27ac95e0-d90d-4503-a510-de9a86387f0b tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:30:31.222331 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-27ac95e0-d90d-4503-a510-de9a86387f0b tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/ed8c085b-1f44-46ba-9d67-e48e5593972c" status: 200 len: 1374 microversion: 2.1 time: 0.260115 Aug 04 18:30:31.223242 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3916/7805] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:30:30 2022] GET /compute/v2.1/servers/ed8c085b-1f44-46ba-9d67-e48e5593972c => generated 1374 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:30:32.253727 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b4602f6d-42cb-4775-b470-f508a94228a9 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:30:32.254659 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b4602f6d-42cb-4775-b470-f508a94228a9 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: ed8c085b-1f44-46ba-9d67-e48e5593972c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:30:32.262870 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4602f6d-42cb-4775-b470-f508a94228a9 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:30:32.263689 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4602f6d-42cb-4775-b470-f508a94228a9 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:30:32.264203 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4602f6d-42cb-4775-b470-f508a94228a9 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:30:32.265019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4602f6d-42cb-4775-b470-f508a94228a9 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:30:32.265585 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4602f6d-42cb-4775-b470-f508a94228a9 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:30:32.266317 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4602f6d-42cb-4775-b470-f508a94228a9 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:30:32.496185 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b4602f6d-42cb-4775-b470-f508a94228a9 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:30:32.508509 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b4602f6d-42cb-4775-b470-f508a94228a9 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/ed8c085b-1f44-46ba-9d67-e48e5593972c" status: 200 len: 1374 microversion: 2.1 time: 0.259504 Aug 04 18:30:32.509173 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3890/7806] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:30:32 2022] GET /compute/v2.1/servers/ed8c085b-1f44-46ba-9d67-e48e5593972c => generated 1374 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:30:33.540750 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-0dffcf89-c362-44dc-b40c-55337de988c6 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:30:33.541610 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-0dffcf89-c362-44dc-b40c-55337de988c6 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: ed8c085b-1f44-46ba-9d67-e48e5593972c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:30:33.548953 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0dffcf89-c362-44dc-b40c-55337de988c6 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:30:33.549466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0dffcf89-c362-44dc-b40c-55337de988c6 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:30:33.549920 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0dffcf89-c362-44dc-b40c-55337de988c6 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:30:33.550720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0dffcf89-c362-44dc-b40c-55337de988c6 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:30:33.551198 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0dffcf89-c362-44dc-b40c-55337de988c6 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:30:33.551646 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-0dffcf89-c362-44dc-b40c-55337de988c6 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:30:33.777500 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-0dffcf89-c362-44dc-b40c-55337de988c6 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:30:33.787520 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-0dffcf89-c362-44dc-b40c-55337de988c6 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/ed8c085b-1f44-46ba-9d67-e48e5593972c" status: 200 len: 1374 microversion: 2.1 time: 0.252076 Aug 04 18:30:33.788210 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3917/7807] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:30:33 2022] GET /compute/v2.1/servers/ed8c085b-1f44-46ba-9d67-e48e5593972c => generated 1374 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:30:34.820923 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1b371cb8-1521-4953-9837-0d8c8696e894 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:30:34.821874 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1b371cb8-1521-4953-9837-0d8c8696e894 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: ed8c085b-1f44-46ba-9d67-e48e5593972c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:30:34.833037 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b371cb8-1521-4953-9837-0d8c8696e894 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:30:34.833459 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b371cb8-1521-4953-9837-0d8c8696e894 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:30:34.834131 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b371cb8-1521-4953-9837-0d8c8696e894 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:30:34.835327 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b371cb8-1521-4953-9837-0d8c8696e894 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:30:34.835972 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b371cb8-1521-4953-9837-0d8c8696e894 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:30:34.836554 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b371cb8-1521-4953-9837-0d8c8696e894 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:30:35.064037 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1b371cb8-1521-4953-9837-0d8c8696e894 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:30:35.077654 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1b371cb8-1521-4953-9837-0d8c8696e894 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/ed8c085b-1f44-46ba-9d67-e48e5593972c" status: 200 len: 1374 microversion: 2.1 time: 0.260854 Aug 04 18:30:35.078713 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3891/7808] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:30:34 2022] GET /compute/v2.1/servers/ed8c085b-1f44-46ba-9d67-e48e5593972c => generated 1374 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:30:35.697066 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-6c72146c-7fac-49be-8de8-b24669d718b7 req-4b35b182-33b4-439b-b02b-140a5a58677c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed8c085b-1f44-46ba-9d67-e48e5593972c", "name": "network-vif-plugged", "status": "completed", "tag": "240a1311-3d49-4880-ae1c-c663efa4c2bb"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:30:35.714386 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6c72146c-7fac-49be-8de8-b24669d718b7 req-4b35b182-33b4-439b-b02b-140a5a58677c service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:30:35.714975 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6c72146c-7fac-49be-8de8-b24669d718b7 req-4b35b182-33b4-439b-b02b-140a5a58677c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:30:35.716114 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-6c72146c-7fac-49be-8de8-b24669d718b7 req-4b35b182-33b4-439b-b02b-140a5a58677c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:30:35.738041 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-6c72146c-7fac-49be-8de8-b24669d718b7 req-4b35b182-33b4-439b-b02b-140a5a58677c service nova] Creating event network-vif-plugged:240a1311-3d49-4880-ae1c-c663efa4c2bb for instance ed8c085b-1f44-46ba-9d67-e48e5593972c on n-h1-851359-3 Aug 04 18:30:35.747623 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-6c72146c-7fac-49be-8de8-b24669d718b7 req-4b35b182-33b4-439b-b02b-140a5a58677c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055840 Aug 04 18:30:35.748716 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3918/7809] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:30:36.110609 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-76eeb0d6-07f6-4e80-8ebe-c3f1f7225726 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:30:36.111289 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-76eeb0d6-07f6-4e80-8ebe-c3f1f7225726 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: ed8c085b-1f44-46ba-9d67-e48e5593972c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:30:36.119104 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:30:36.119104 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:30:36.127019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76eeb0d6-07f6-4e80-8ebe-c3f1f7225726 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:30:36.127019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76eeb0d6-07f6-4e80-8ebe-c3f1f7225726 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:30:36.127019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76eeb0d6-07f6-4e80-8ebe-c3f1f7225726 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:30:36.127019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76eeb0d6-07f6-4e80-8ebe-c3f1f7225726 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:30:36.127019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76eeb0d6-07f6-4e80-8ebe-c3f1f7225726 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:30:36.127019 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76eeb0d6-07f6-4e80-8ebe-c3f1f7225726 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:30:36.337321 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-76eeb0d6-07f6-4e80-8ebe-c3f1f7225726 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:30:36.347419 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-76eeb0d6-07f6-4e80-8ebe-c3f1f7225726 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/ed8c085b-1f44-46ba-9d67-e48e5593972c" status: 200 len: 1374 microversion: 2.1 time: 0.241754 Aug 04 18:30:36.348289 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3892/7810] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:30:36 2022] GET /compute/v2.1/servers/ed8c085b-1f44-46ba-9d67-e48e5593972c => generated 1374 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:30:37.367888 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=6 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:30:37.375387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-467c9abd-6b66-401b-b806-671e6108663b tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:30:37.376272 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-467c9abd-6b66-401b-b806-671e6108663b tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: ed8c085b-1f44-46ba-9d67-e48e5593972c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:30:37.383843 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-467c9abd-6b66-401b-b806-671e6108663b tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:30:37.384424 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-467c9abd-6b66-401b-b806-671e6108663b tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:30:37.384929 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-467c9abd-6b66-401b-b806-671e6108663b tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:30:37.385736 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-467c9abd-6b66-401b-b806-671e6108663b tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:30:37.386292 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-467c9abd-6b66-401b-b806-671e6108663b tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:30:37.386920 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-467c9abd-6b66-401b-b806-671e6108663b tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:30:37.631735 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-467c9abd-6b66-401b-b806-671e6108663b tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:30:37.646866 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-467c9abd-6b66-401b-b806-671e6108663b tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/ed8c085b-1f44-46ba-9d67-e48e5593972c" status: 200 len: 1557 microversion: 2.1 time: 0.280362 Aug 04 18:30:37.647967 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3919/7811] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:30:37 2022] GET /compute/v2.1/servers/ed8c085b-1f44-46ba-9d67-e48e5593972c => generated 1557 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:30:37.673798 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-00e6cc0c-8289-4745-af4f-35d68327815c tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:30:37.674987 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-00e6cc0c-8289-4745-af4f-35d68327815c tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: ed8c085b-1f44-46ba-9d67-e48e5593972c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:30:37.685469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00e6cc0c-8289-4745-af4f-35d68327815c tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:30:37.685999 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00e6cc0c-8289-4745-af4f-35d68327815c tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:30:37.686469 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00e6cc0c-8289-4745-af4f-35d68327815c tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:30:37.687213 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00e6cc0c-8289-4745-af4f-35d68327815c tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:30:37.687686 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00e6cc0c-8289-4745-af4f-35d68327815c tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:30:37.688164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00e6cc0c-8289-4745-af4f-35d68327815c tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:30:37.874816 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-00e6cc0c-8289-4745-af4f-35d68327815c tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:30:37.891186 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-00e6cc0c-8289-4745-af4f-35d68327815c tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/ed8c085b-1f44-46ba-9d67-e48e5593972c" status: 200 len: 1557 microversion: 2.1 time: 0.223941 Aug 04 18:30:37.892457 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3893/7812] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:30:37 2022] GET /compute/v2.1/servers/ed8c085b-1f44-46ba-9d67-e48e5593972c => generated 1557 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:30:41.114293 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-f00f250d-6ee8-4786-a696-62ece2593134 req-b2910e38-420c-4ce4-a01b-dd8ab93b4419 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed8c085b-1f44-46ba-9d67-e48e5593972c", "tag": "240a1311-3d49-4880-ae1c-c663efa4c2bb"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:30:41.132953 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f00f250d-6ee8-4786-a696-62ece2593134 req-b2910e38-420c-4ce4-a01b-dd8ab93b4419 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:30:41.133838 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f00f250d-6ee8-4786-a696-62ece2593134 req-b2910e38-420c-4ce4-a01b-dd8ab93b4419 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:30:41.134681 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-f00f250d-6ee8-4786-a696-62ece2593134 req-b2910e38-420c-4ce4-a01b-dd8ab93b4419 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:30:41.158623 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-f00f250d-6ee8-4786-a696-62ece2593134 req-b2910e38-420c-4ce4-a01b-dd8ab93b4419 service nova] Creating event network-changed:240a1311-3d49-4880-ae1c-c663efa4c2bb for instance ed8c085b-1f44-46ba-9d67-e48e5593972c on n-h1-851359-3 Aug 04 18:30:41.168851 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-f00f250d-6ee8-4786-a696-62ece2593134 req-b2910e38-420c-4ce4-a01b-dd8ab93b4419 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176170 Aug 04 18:30:41.170462 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3920/7813] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:31:03.328901 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:31:03.329663 n-d-851359-3 devstack@n-api.service[131043]: Thu Aug 4 18:31:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:32:35.833299 n-d-851359-3 devstack@n-api.service[131044]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5669b2b7-e423-4a49-b572-a6035398afb4] AMQP server on 10.222.0.93:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 18:32:35.834675 n-d-851359-3 devstack@n-api.service[131044]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7a822c8f-8f7d-4a50-9afd-aab5c6b46a96] AMQP server on 10.222.0.93:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 18:32:35.835528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:32:35.836363 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=38 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:32:35.840770 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ae5767aa-d72d-4722-9fc7-df8621d307f6 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-236718112"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:32:35.843370 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ae5767aa-d72d-4722-9fc7-df8621d307f6 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: ed8c085b-1f44-46ba-9d67-e48e5593972c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:32:35.851095 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae5767aa-d72d-4722-9fc7-df8621d307f6 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:32:35.851760 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae5767aa-d72d-4722-9fc7-df8621d307f6 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:32:35.852900 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae5767aa-d72d-4722-9fc7-df8621d307f6 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:32:35.853805 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae5767aa-d72d-4722-9fc7-df8621d307f6 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:32:35.854413 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae5767aa-d72d-4722-9fc7-df8621d307f6 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:32:35.854979 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae5767aa-d72d-4722-9fc7-df8621d307f6 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:32:36.114643 n-d-851359-3 devstack@n-api.service[131044]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ae5767aa-d72d-4722-9fc7-df8621d307f6 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [9b51d6f1-f91a-417b-8234-d6c87343b175] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 18:32:36.848208 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] [5669b2b7-e423-4a49-b572-a6035398afb4] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 60112. Aug 04 18:32:36.849602 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] [7a822c8f-8f7d-4a50-9afd-aab5c6b46a96] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 60114. Aug 04 18:32:37.124932 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [None req-ae5767aa-d72d-4722-9fc7-df8621d307f6 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [9b51d6f1-f91a-417b-8234-d6c87343b175] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 60116. Aug 04 18:32:37.132842 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ae5767aa-d72d-4722-9fc7-df8621d307f6 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "POST /compute/v2.1/servers/ed8c085b-1f44-46ba-9d67-e48e5593972c/action" status: 202 len: 0 microversion: 2.1 time: 1.301831 Aug 04 18:32:37.134579 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3894/7814] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:32:35 2022] POST /compute/v2.1/servers/ed8c085b-1f44-46ba-9d67-e48e5593972c/action => generated 0 bytes in 1305 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 04 18:32:43.193047 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:32:43.194567 n-d-851359-3 devstack@n-api.service[131044]: Thu Aug 4 18:32:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:32:43.223193 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:32:43.224078 n-d-851359-3 devstack@n-api.service[131043]: Thu Aug 4 18:32:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:32:44.252351 n-d-851359-3 devstack@n-api.service[131043]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d439c32e-c35d-4bcd-acc6-3613271fa0d5] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 18:32:44.255318 n-d-851359-3 devstack@n-api.service[131043]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f0b45cb0-ceb0-43c7-a760-628eb3be34b7] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 18:32:44.256697 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:32:44.259105 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=30 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:32:44.269498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-1da4df8d-866c-4ad0-bad1-bb992cf964c3 req-ca00f1fd-dd4c-4acd-9c3d-01776a265b54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed8c085b-1f44-46ba-9d67-e48e5593972c", "name": "network-vif-plugged", "status": "completed", "tag": "240a1311-3d49-4880-ae1c-c663efa4c2bb"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:32:44.290700 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1da4df8d-866c-4ad0-bad1-bb992cf964c3 req-ca00f1fd-dd4c-4acd-9c3d-01776a265b54 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:32:44.291972 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1da4df8d-866c-4ad0-bad1-bb992cf964c3 req-ca00f1fd-dd4c-4acd-9c3d-01776a265b54 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:32:44.293169 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1da4df8d-866c-4ad0-bad1-bb992cf964c3 req-ca00f1fd-dd4c-4acd-9c3d-01776a265b54 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:32:44.322181 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-1da4df8d-866c-4ad0-bad1-bb992cf964c3 req-ca00f1fd-dd4c-4acd-9c3d-01776a265b54 service nova] Creating event network-vif-plugged:240a1311-3d49-4880-ae1c-c663efa4c2bb for instance ed8c085b-1f44-46ba-9d67-e48e5593972c on n-h1-851359-3 Aug 04 18:32:44.333962 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-1da4df8d-866c-4ad0-bad1-bb992cf964c3 req-ca00f1fd-dd4c-4acd-9c3d-01776a265b54 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083846 Aug 04 18:32:44.335288 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3921/7815] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:32:53.088722 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:32:53.091580 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:32:53.098028 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7923879b-8e53-480b-b90d-2bda22fc9cf3 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1003949101", "imageRef": "838a1934-8804-4659-b617-3008576409bf", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-209441469", "security_groups": [{"name": "tempest-secgroup-smoke-1145870585"}], "networks": [{"uuid": "bd6a2ad9-8969-477d-b1f4-ecb5b3c361a3"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:32:53.290318 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-7923879b-8e53-480b-b90d-2bda22fc9cf3 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] validate_networks() for [('bd6a2ad9-8969-477d-b1f4-ecb5b3c361a3', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 18:32:53.833207 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7923879b-8e53-480b-b90d-2bda22fc9cf3 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 18:32:53.833688 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7923879b-8e53-480b-b90d-2bda22fc9cf3 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 18:32:53.834209 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7923879b-8e53-480b-b90d-2bda22fc9cf3 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 18:32:53.834668 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7923879b-8e53-480b-b90d-2bda22fc9cf3 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 18:32:53.835118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7923879b-8e53-480b-b90d-2bda22fc9cf3 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 18:32:53.847075 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7923879b-8e53-480b-b90d-2bda22fc9cf3 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:32:53.847730 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7923879b-8e53-480b-b90d-2bda22fc9cf3 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:32:53.848258 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7923879b-8e53-480b-b90d-2bda22fc9cf3 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:32:53.849013 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7923879b-8e53-480b-b90d-2bda22fc9cf3 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:32:53.849484 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7923879b-8e53-480b-b90d-2bda22fc9cf3 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:32:53.849922 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7923879b-8e53-480b-b90d-2bda22fc9cf3 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:32:53.879022 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-7923879b-8e53-480b-b90d-2bda22fc9cf3 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Getting quotas for project 0cdb03c0ef5a4e439a2e8486ab03dcb6. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 18:32:53.885841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.quota [None req-7923879b-8e53-480b-b90d-2bda22fc9cf3 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Getting quotas for user 6b29e5823ffa41b78d37ed0312625388 and project 0cdb03c0ef5a4e439a2e8486ab03dcb6. Resources: {'instances', 'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 18:32:53.901552 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7923879b-8e53-480b-b90d-2bda22fc9cf3 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 18:32:53.904424 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7923879b-8e53-480b-b90d-2bda22fc9cf3 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: 5d4bf21e-eee4-4163-9b8a-c8434986ba17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='838a1934-8804-4659-b617-3008576409bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 18:32:53.961464 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7923879b-8e53-480b-b90d-2bda22fc9cf3 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.876168 Aug 04 18:32:53.962318 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3895/7816] 10.222.0.93 () {60 vars in 1147 bytes} [Thu Aug 4 18:32:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 18:32:53.984276 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a07a7b4f-ca1d-46b6-8528-0ff94b3738e4 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:32:53.985917 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a07a7b4f-ca1d-46b6-8528-0ff94b3738e4 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: 5d4bf21e-eee4-4163-9b8a-c8434986ba17] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:32:54.010828 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] [d439c32e-c35d-4bcd-acc6-3613271fa0d5] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 60264. Aug 04 18:32:54.014174 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] [f0b45cb0-ceb0-43c7-a760-628eb3be34b7] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 60268. Aug 04 18:32:54.088849 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a07a7b4f-ca1d-46b6-8528-0ff94b3738e4 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:32:54.100684 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a07a7b4f-ca1d-46b6-8528-0ff94b3738e4 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17" status: 200 len: 1248 microversion: 2.1 time: 0.125035 Aug 04 18:32:54.102240 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3922/7817] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:32:53 2022] GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17 => generated 1248 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:32:55.134080 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9f04e84d-4b07-46bb-b7b6-21fb8c8b719f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:32:55.135166 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9f04e84d-4b07-46bb-b7b6-21fb8c8b719f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: 5d4bf21e-eee4-4163-9b8a-c8434986ba17] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:32:55.153669 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f04e84d-4b07-46bb-b7b6-21fb8c8b719f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:32:55.154637 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f04e84d-4b07-46bb-b7b6-21fb8c8b719f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:32:55.155452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f04e84d-4b07-46bb-b7b6-21fb8c8b719f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:32:55.156790 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f04e84d-4b07-46bb-b7b6-21fb8c8b719f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:32:55.159405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f04e84d-4b07-46bb-b7b6-21fb8c8b719f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:32:55.159405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f04e84d-4b07-46bb-b7b6-21fb8c8b719f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:32:55.249514 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9f04e84d-4b07-46bb-b7b6-21fb8c8b719f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:32:55.259137 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9f04e84d-4b07-46bb-b7b6-21fb8c8b719f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17" status: 200 len: 1300 microversion: 2.1 time: 0.134536 Aug 04 18:32:55.259750 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3896/7818] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:32:55 2022] GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17 => generated 1300 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:32:56.295350 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-7eacacb0-1d35-43a2-b001-b2a2e5614e9d tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:32:56.300888 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-7eacacb0-1d35-43a2-b001-b2a2e5614e9d tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: 5d4bf21e-eee4-4163-9b8a-c8434986ba17] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:32:56.305801 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:32:56.331866 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7eacacb0-1d35-43a2-b001-b2a2e5614e9d tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:32:56.334671 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7eacacb0-1d35-43a2-b001-b2a2e5614e9d tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:32:56.336473 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7eacacb0-1d35-43a2-b001-b2a2e5614e9d tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:32:56.339590 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7eacacb0-1d35-43a2-b001-b2a2e5614e9d tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:32:56.341054 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7eacacb0-1d35-43a2-b001-b2a2e5614e9d tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:32:56.341740 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-7eacacb0-1d35-43a2-b001-b2a2e5614e9d tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:32:56.474332 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-7eacacb0-1d35-43a2-b001-b2a2e5614e9d tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:32:56.493473 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-7eacacb0-1d35-43a2-b001-b2a2e5614e9d tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17" status: 200 len: 1306 microversion: 2.1 time: 0.213147 Aug 04 18:32:56.519565 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3923/7819] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:32:56 2022] GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17 => generated 1306 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:32:57.553458 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-64e1a589-f49a-45d8-965e-a8d950e3c409 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:32:57.558282 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-64e1a589-f49a-45d8-965e-a8d950e3c409 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: 5d4bf21e-eee4-4163-9b8a-c8434986ba17] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:32:57.585376 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64e1a589-f49a-45d8-965e-a8d950e3c409 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:32:57.588672 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64e1a589-f49a-45d8-965e-a8d950e3c409 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:32:57.589850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64e1a589-f49a-45d8-965e-a8d950e3c409 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:32:57.591707 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64e1a589-f49a-45d8-965e-a8d950e3c409 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:32:57.613328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64e1a589-f49a-45d8-965e-a8d950e3c409 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:32:57.616051 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64e1a589-f49a-45d8-965e-a8d950e3c409 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:32:57.885031 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-64e1a589-f49a-45d8-965e-a8d950e3c409 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:32:57.901289 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-64e1a589-f49a-45d8-965e-a8d950e3c409 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17" status: 200 len: 1374 microversion: 2.1 time: 0.361936 Aug 04 18:32:57.903978 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3897/7820] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:32:57 2022] GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17 => generated 1374 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:32:58.431206 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-1fe9fa28-6898-46de-a50c-a8cd4bf501e5 req-2a20c322-b6b3-435d-9b01-3f545dbf43c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed8c085b-1f44-46ba-9d67-e48e5593972c", "name": "network-vif-unplugged", "status": "completed", "tag": "240a1311-3d49-4880-ae1c-c663efa4c2bb"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:32:58.455637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1fe9fa28-6898-46de-a50c-a8cd4bf501e5 req-2a20c322-b6b3-435d-9b01-3f545dbf43c2 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:32:58.456966 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1fe9fa28-6898-46de-a50c-a8cd4bf501e5 req-2a20c322-b6b3-435d-9b01-3f545dbf43c2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:32:58.458942 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-1fe9fa28-6898-46de-a50c-a8cd4bf501e5 req-2a20c322-b6b3-435d-9b01-3f545dbf43c2 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:32:58.499723 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-1fe9fa28-6898-46de-a50c-a8cd4bf501e5 req-2a20c322-b6b3-435d-9b01-3f545dbf43c2 service nova] Creating event network-vif-unplugged:240a1311-3d49-4880-ae1c-c663efa4c2bb for instance ed8c085b-1f44-46ba-9d67-e48e5593972c on n-h1-851359-3 Aug 04 18:32:58.512681 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-1fe9fa28-6898-46de-a50c-a8cd4bf501e5 req-2a20c322-b6b3-435d-9b01-3f545dbf43c2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086286 Aug 04 18:32:58.515105 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3924/7821] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:32:58.881342 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-269514ce-0f5e-46d7-a3c3-4bf98a7c6a6a req-8cfd951c-1e8e-48f8-9796-0ae468ce0c60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d4bf21e-eee4-4163-9b8a-c8434986ba17", "tag": "eac128cb-ac21-4410-9910-324f80f4ce00"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:32:58.898062 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-269514ce-0f5e-46d7-a3c3-4bf98a7c6a6a req-8cfd951c-1e8e-48f8-9796-0ae468ce0c60 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:32:58.899524 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-269514ce-0f5e-46d7-a3c3-4bf98a7c6a6a req-8cfd951c-1e8e-48f8-9796-0ae468ce0c60 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:32:58.900635 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-269514ce-0f5e-46d7-a3c3-4bf98a7c6a6a req-8cfd951c-1e8e-48f8-9796-0ae468ce0c60 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:32:58.925329 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-269514ce-0f5e-46d7-a3c3-4bf98a7c6a6a req-8cfd951c-1e8e-48f8-9796-0ae468ce0c60 service nova] Creating event network-changed:eac128cb-ac21-4410-9910-324f80f4ce00 for instance 5d4bf21e-eee4-4163-9b8a-c8434986ba17 on n-h2-851359-3 Aug 04 18:32:58.935717 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-269514ce-0f5e-46d7-a3c3-4bf98a7c6a6a req-8cfd951c-1e8e-48f8-9796-0ae468ce0c60 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.301904 Aug 04 18:32:58.936033 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-930f39d4-0014-412b-a725-1079fd5cb1ab tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:32:58.937336 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-930f39d4-0014-412b-a725-1079fd5cb1ab tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: 5d4bf21e-eee4-4163-9b8a-c8434986ba17] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:32:58.937591 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3898/7822] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:32:58.960665 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-930f39d4-0014-412b-a725-1079fd5cb1ab tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:32:58.962463 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-930f39d4-0014-412b-a725-1079fd5cb1ab tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:32:58.963381 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-930f39d4-0014-412b-a725-1079fd5cb1ab tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:32:58.964781 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-930f39d4-0014-412b-a725-1079fd5cb1ab tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:32:58.965758 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-930f39d4-0014-412b-a725-1079fd5cb1ab tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:32:58.966721 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-930f39d4-0014-412b-a725-1079fd5cb1ab tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:32:59.303456 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-930f39d4-0014-412b-a725-1079fd5cb1ab tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:32:59.327968 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-930f39d4-0014-412b-a725-1079fd5cb1ab tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17" status: 200 len: 1374 microversion: 2.1 time: 0.400938 Aug 04 18:32:59.344311 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3925/7823] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:32:58 2022] GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17 => generated 1374 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:33:00.401528 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4540d7b7-a0fa-4916-92b9-05124dcc2416 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:33:00.406981 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4540d7b7-a0fa-4916-92b9-05124dcc2416 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: 5d4bf21e-eee4-4163-9b8a-c8434986ba17] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:33:00.424420 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4540d7b7-a0fa-4916-92b9-05124dcc2416 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:33:00.425846 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4540d7b7-a0fa-4916-92b9-05124dcc2416 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:33:00.427163 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4540d7b7-a0fa-4916-92b9-05124dcc2416 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:33:00.429164 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4540d7b7-a0fa-4916-92b9-05124dcc2416 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:33:00.430628 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4540d7b7-a0fa-4916-92b9-05124dcc2416 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:33:00.431848 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4540d7b7-a0fa-4916-92b9-05124dcc2416 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:33:00.799770 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4540d7b7-a0fa-4916-92b9-05124dcc2416 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:33:00.816536 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4540d7b7-a0fa-4916-92b9-05124dcc2416 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17" status: 200 len: 1374 microversion: 2.1 time: 0.435298 Aug 04 18:33:00.828449 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3899/7824] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:33:00 2022] GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17 => generated 1374 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:33:01.857944 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-b9470637-9d99-410a-8703-4120fbcf2f57 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:33:01.859212 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-b9470637-9d99-410a-8703-4120fbcf2f57 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: 5d4bf21e-eee4-4163-9b8a-c8434986ba17] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:33:01.872749 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9470637-9d99-410a-8703-4120fbcf2f57 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:33:01.875382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9470637-9d99-410a-8703-4120fbcf2f57 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:33:01.875382 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9470637-9d99-410a-8703-4120fbcf2f57 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:33:01.877216 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9470637-9d99-410a-8703-4120fbcf2f57 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:33:01.878114 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9470637-9d99-410a-8703-4120fbcf2f57 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:33:01.878950 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-b9470637-9d99-410a-8703-4120fbcf2f57 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:33:02.096052 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-b9470637-9d99-410a-8703-4120fbcf2f57 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:33:02.112170 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-b9470637-9d99-410a-8703-4120fbcf2f57 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17" status: 200 len: 1374 microversion: 2.1 time: 0.263395 Aug 04 18:33:02.113432 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3926/7825] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:33:01 2022] GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17 => generated 1374 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:33:03.137866 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-54645963-dcf0-4f64-87c0-031a1b39b521 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:33:03.138955 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-54645963-dcf0-4f64-87c0-031a1b39b521 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: 5d4bf21e-eee4-4163-9b8a-c8434986ba17] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:33:03.146639 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54645963-dcf0-4f64-87c0-031a1b39b521 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:33:03.147157 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54645963-dcf0-4f64-87c0-031a1b39b521 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:33:03.147766 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54645963-dcf0-4f64-87c0-031a1b39b521 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:33:03.149118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54645963-dcf0-4f64-87c0-031a1b39b521 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:33:03.149722 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54645963-dcf0-4f64-87c0-031a1b39b521 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:33:03.150646 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54645963-dcf0-4f64-87c0-031a1b39b521 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:33:03.403346 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-54645963-dcf0-4f64-87c0-031a1b39b521 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:33:03.427977 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-54645963-dcf0-4f64-87c0-031a1b39b521 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17" status: 200 len: 1374 microversion: 2.1 time: 0.295808 Aug 04 18:33:03.444297 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3900/7826] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:33:03 2022] GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17 => generated 1374 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:33:04.461660 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e905f9f2-ffb7-4b19-a51e-2288e0d214aa tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:33:04.462550 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e905f9f2-ffb7-4b19-a51e-2288e0d214aa tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: 5d4bf21e-eee4-4163-9b8a-c8434986ba17] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:33:04.465366 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell0:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:33:04.471637 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e905f9f2-ffb7-4b19-a51e-2288e0d214aa tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:33:04.472153 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e905f9f2-ffb7-4b19-a51e-2288e0d214aa tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:33:04.472601 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e905f9f2-ffb7-4b19-a51e-2288e0d214aa tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:33:04.473341 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e905f9f2-ffb7-4b19-a51e-2288e0d214aa tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:33:04.474143 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e905f9f2-ffb7-4b19-a51e-2288e0d214aa tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:33:04.474823 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e905f9f2-ffb7-4b19-a51e-2288e0d214aa tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:33:04.696661 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-e905f9f2-ffb7-4b19-a51e-2288e0d214aa tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:33:04.705844 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e905f9f2-ffb7-4b19-a51e-2288e0d214aa tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17" status: 200 len: 1374 microversion: 2.1 time: 0.249099 Aug 04 18:33:04.706636 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3927/7827] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:33:04 2022] GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17 => generated 1374 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:33:05.730295 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b51b9c9b-d3ec-4353-8aab-e15411ee5f73 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:33:05.731189 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b51b9c9b-d3ec-4353-8aab-e15411ee5f73 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: 5d4bf21e-eee4-4163-9b8a-c8434986ba17] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:33:05.733133 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:33:05.733832 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:33:05.742650 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b51b9c9b-d3ec-4353-8aab-e15411ee5f73 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:33:05.743405 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b51b9c9b-d3ec-4353-8aab-e15411ee5f73 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:33:05.743877 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b51b9c9b-d3ec-4353-8aab-e15411ee5f73 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:33:05.744635 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b51b9c9b-d3ec-4353-8aab-e15411ee5f73 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:33:05.745118 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b51b9c9b-d3ec-4353-8aab-e15411ee5f73 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:33:05.745566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b51b9c9b-d3ec-4353-8aab-e15411ee5f73 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:33:05.904479 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b51b9c9b-d3ec-4353-8aab-e15411ee5f73 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:33:05.913573 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b51b9c9b-d3ec-4353-8aab-e15411ee5f73 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17" status: 200 len: 1374 microversion: 2.1 time: 0.188347 Aug 04 18:33:05.914383 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3901/7828] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:33:05 2022] GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17 => generated 1374 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:33:06.940165 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-6b477921-7dc2-408c-84ca-0cd6f0f734af tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:33:06.940831 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-6b477921-7dc2-408c-84ca-0cd6f0f734af tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: 5d4bf21e-eee4-4163-9b8a-c8434986ba17] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:33:06.949167 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6b477921-7dc2-408c-84ca-0cd6f0f734af tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:33:06.949679 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6b477921-7dc2-408c-84ca-0cd6f0f734af tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:33:06.950178 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6b477921-7dc2-408c-84ca-0cd6f0f734af tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:33:06.950912 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6b477921-7dc2-408c-84ca-0cd6f0f734af tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:33:06.951407 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6b477921-7dc2-408c-84ca-0cd6f0f734af tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:33:06.952033 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-6b477921-7dc2-408c-84ca-0cd6f0f734af tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:33:07.141393 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-6b477921-7dc2-408c-84ca-0cd6f0f734af tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:33:07.150746 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-6b477921-7dc2-408c-84ca-0cd6f0f734af tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17" status: 200 len: 1374 microversion: 2.1 time: 0.214459 Aug 04 18:33:07.151507 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3928/7829] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:33:06 2022] GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17 => generated 1374 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:33:08.172457 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-00b0d1d2-6239-4c87-ba0b-375cccfde173 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:33:08.173239 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-00b0d1d2-6239-4c87-ba0b-375cccfde173 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: 5d4bf21e-eee4-4163-9b8a-c8434986ba17] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:33:08.180263 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00b0d1d2-6239-4c87-ba0b-375cccfde173 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:33:08.180885 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00b0d1d2-6239-4c87-ba0b-375cccfde173 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:33:08.181422 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00b0d1d2-6239-4c87-ba0b-375cccfde173 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:33:08.182762 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00b0d1d2-6239-4c87-ba0b-375cccfde173 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:33:08.183620 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00b0d1d2-6239-4c87-ba0b-375cccfde173 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:33:08.184431 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00b0d1d2-6239-4c87-ba0b-375cccfde173 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:33:08.365330 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-00b0d1d2-6239-4c87-ba0b-375cccfde173 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:33:08.375022 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-00b0d1d2-6239-4c87-ba0b-375cccfde173 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17" status: 200 len: 1374 microversion: 2.1 time: 0.206446 Aug 04 18:33:08.375646 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3902/7830] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:33:08 2022] GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17 => generated 1374 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:33:09.402447 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-4d5751c3-1104-4afc-9ee6-5e8274d95896 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:33:09.403388 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-4d5751c3-1104-4afc-9ee6-5e8274d95896 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: 5d4bf21e-eee4-4163-9b8a-c8434986ba17] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:33:09.412864 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d5751c3-1104-4afc-9ee6-5e8274d95896 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:33:09.413475 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d5751c3-1104-4afc-9ee6-5e8274d95896 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:33:09.414096 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d5751c3-1104-4afc-9ee6-5e8274d95896 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:33:09.414945 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d5751c3-1104-4afc-9ee6-5e8274d95896 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:33:09.415730 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d5751c3-1104-4afc-9ee6-5e8274d95896 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:33:09.416286 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-4d5751c3-1104-4afc-9ee6-5e8274d95896 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:33:09.620498 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-4d5751c3-1104-4afc-9ee6-5e8274d95896 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:33:09.630234 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-4d5751c3-1104-4afc-9ee6-5e8274d95896 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17" status: 200 len: 1374 microversion: 2.1 time: 0.232706 Aug 04 18:33:09.630896 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3929/7831] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:33:09 2022] GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17 => generated 1374 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:33:10.653788 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5a700532-e9f8-464b-8d6e-0c5f36fdbd25 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:33:10.654903 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5a700532-e9f8-464b-8d6e-0c5f36fdbd25 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: 5d4bf21e-eee4-4163-9b8a-c8434986ba17] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:33:10.664793 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a700532-e9f8-464b-8d6e-0c5f36fdbd25 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:33:10.665796 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a700532-e9f8-464b-8d6e-0c5f36fdbd25 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:33:10.666970 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a700532-e9f8-464b-8d6e-0c5f36fdbd25 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:33:10.668087 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a700532-e9f8-464b-8d6e-0c5f36fdbd25 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:33:10.668666 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a700532-e9f8-464b-8d6e-0c5f36fdbd25 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:33:10.669161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a700532-e9f8-464b-8d6e-0c5f36fdbd25 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:33:10.835151 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5a700532-e9f8-464b-8d6e-0c5f36fdbd25 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:33:10.844565 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5a700532-e9f8-464b-8d6e-0c5f36fdbd25 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17" status: 200 len: 1374 microversion: 2.1 time: 0.194936 Aug 04 18:33:10.845327 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3903/7832] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:33:10 2022] GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17 => generated 1374 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:33:11.800144 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-acd5b6a2-5e0d-4aed-8d3f-7050b0947edd req-7ee810c1-9761-42e1-803d-3931d78c7c9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d4bf21e-eee4-4163-9b8a-c8434986ba17", "name": "network-vif-plugged", "status": "completed", "tag": "eac128cb-ac21-4410-9910-324f80f4ce00"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:33:11.814344 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-acd5b6a2-5e0d-4aed-8d3f-7050b0947edd req-7ee810c1-9761-42e1-803d-3931d78c7c9c service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:33:11.815594 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-acd5b6a2-5e0d-4aed-8d3f-7050b0947edd req-7ee810c1-9761-42e1-803d-3931d78c7c9c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:33:11.816398 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-acd5b6a2-5e0d-4aed-8d3f-7050b0947edd req-7ee810c1-9761-42e1-803d-3931d78c7c9c service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:33:11.831429 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-acd5b6a2-5e0d-4aed-8d3f-7050b0947edd req-7ee810c1-9761-42e1-803d-3931d78c7c9c service nova] Creating event network-vif-plugged:eac128cb-ac21-4410-9910-324f80f4ce00 for instance 5d4bf21e-eee4-4163-9b8a-c8434986ba17 on n-h2-851359-3 Aug 04 18:33:11.837301 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-acd5b6a2-5e0d-4aed-8d3f-7050b0947edd req-7ee810c1-9761-42e1-803d-3931d78c7c9c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045596 Aug 04 18:33:11.838025 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3930/7833] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:33:11.866148 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-97c5356b-9fd3-49f7-842d-110c8f170199 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:33:11.867438 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-97c5356b-9fd3-49f7-842d-110c8f170199 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: 5d4bf21e-eee4-4163-9b8a-c8434986ba17] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:33:11.876760 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97c5356b-9fd3-49f7-842d-110c8f170199 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:33:11.878169 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97c5356b-9fd3-49f7-842d-110c8f170199 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:33:11.878928 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97c5356b-9fd3-49f7-842d-110c8f170199 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:33:11.879977 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97c5356b-9fd3-49f7-842d-110c8f170199 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:33:11.880856 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97c5356b-9fd3-49f7-842d-110c8f170199 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:33:11.881732 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97c5356b-9fd3-49f7-842d-110c8f170199 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:33:12.065400 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-97c5356b-9fd3-49f7-842d-110c8f170199 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:33:12.075717 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-97c5356b-9fd3-49f7-842d-110c8f170199 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17" status: 200 len: 1374 microversion: 2.1 time: 0.214206 Aug 04 18:33:12.076343 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3904/7834] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:33:11 2022] GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17 => generated 1374 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:33:13.098767 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-d3a29f35-ea73-4331-a4d6-1a0ea9792ca4 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:33:13.099652 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-d3a29f35-ea73-4331-a4d6-1a0ea9792ca4 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: 5d4bf21e-eee4-4163-9b8a-c8434986ba17] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:33:13.109863 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3a29f35-ea73-4331-a4d6-1a0ea9792ca4 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:33:13.110466 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3a29f35-ea73-4331-a4d6-1a0ea9792ca4 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:33:13.110959 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3a29f35-ea73-4331-a4d6-1a0ea9792ca4 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:33:13.111734 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3a29f35-ea73-4331-a4d6-1a0ea9792ca4 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:33:13.112345 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3a29f35-ea73-4331-a4d6-1a0ea9792ca4 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:33:13.112854 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-d3a29f35-ea73-4331-a4d6-1a0ea9792ca4 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:33:13.332720 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-d3a29f35-ea73-4331-a4d6-1a0ea9792ca4 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:33:13.351843 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-d3a29f35-ea73-4331-a4d6-1a0ea9792ca4 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17" status: 200 len: 1374 microversion: 2.1 time: 0.258500 Aug 04 18:33:13.352671 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3931/7835] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:33:13 2022] GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17 => generated 1374 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:33:14.390610 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8aada544-f303-4e3f-aa62-650022fbf74d tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:33:14.391719 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8aada544-f303-4e3f-aa62-650022fbf74d tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: 5d4bf21e-eee4-4163-9b8a-c8434986ba17] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:33:14.405056 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8aada544-f303-4e3f-aa62-650022fbf74d tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:33:14.405988 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8aada544-f303-4e3f-aa62-650022fbf74d tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:33:14.406787 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8aada544-f303-4e3f-aa62-650022fbf74d tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:33:14.408053 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8aada544-f303-4e3f-aa62-650022fbf74d tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:33:14.408902 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8aada544-f303-4e3f-aa62-650022fbf74d tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:33:14.409680 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8aada544-f303-4e3f-aa62-650022fbf74d tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:33:14.583418 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8aada544-f303-4e3f-aa62-650022fbf74d tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:33:14.602233 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8aada544-f303-4e3f-aa62-650022fbf74d tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17" status: 200 len: 1557 microversion: 2.1 time: 0.218673 Aug 04 18:33:14.603335 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3905/7836] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:33:14 2022] GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17 => generated 1557 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:33:14.638040 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a605034b-070c-4c96-87ec-0a4d7adb40ea tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:33:14.639434 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a605034b-070c-4c96-87ec-0a4d7adb40ea tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: 5d4bf21e-eee4-4163-9b8a-c8434986ba17] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:33:14.653173 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a605034b-070c-4c96-87ec-0a4d7adb40ea tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:33:14.653947 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a605034b-070c-4c96-87ec-0a4d7adb40ea tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:33:14.654817 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a605034b-070c-4c96-87ec-0a4d7adb40ea tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:33:14.656127 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a605034b-070c-4c96-87ec-0a4d7adb40ea tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:33:14.656995 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a605034b-070c-4c96-87ec-0a4d7adb40ea tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:33:14.657796 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a605034b-070c-4c96-87ec-0a4d7adb40ea tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:33:14.902636 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-a605034b-070c-4c96-87ec-0a4d7adb40ea tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:33:14.912613 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a605034b-070c-4c96-87ec-0a4d7adb40ea tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17" status: 200 len: 1557 microversion: 2.1 time: 0.281416 Aug 04 18:33:14.913339 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3932/7837] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:33:14 2022] GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17 => generated 1557 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:33:17.426972 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-890e5bc6-f0bc-423a-a0ef-95bcef140a93 req-235c85f6-b314-462d-a9b3-3ecc263106d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d4bf21e-eee4-4163-9b8a-c8434986ba17", "tag": "eac128cb-ac21-4410-9910-324f80f4ce00"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:33:17.450043 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-890e5bc6-f0bc-423a-a0ef-95bcef140a93 req-235c85f6-b314-462d-a9b3-3ecc263106d3 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:33:17.450961 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-890e5bc6-f0bc-423a-a0ef-95bcef140a93 req-235c85f6-b314-462d-a9b3-3ecc263106d3 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:33:17.451769 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-890e5bc6-f0bc-423a-a0ef-95bcef140a93 req-235c85f6-b314-462d-a9b3-3ecc263106d3 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:33:17.474827 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-890e5bc6-f0bc-423a-a0ef-95bcef140a93 req-235c85f6-b314-462d-a9b3-3ecc263106d3 service nova] Creating event network-changed:eac128cb-ac21-4410-9910-324f80f4ce00 for instance 5d4bf21e-eee4-4163-9b8a-c8434986ba17 on n-h2-851359-3 Aug 04 18:33:17.484037 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-890e5bc6-f0bc-423a-a0ef-95bcef140a93 req-235c85f6-b314-462d-a9b3-3ecc263106d3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064090 Aug 04 18:33:17.484947 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3906/7838] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:34:23.341370 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:34:23.342346 n-d-851359-3 devstack@n-api.service[131043]: Thu Aug 4 18:34:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:35:31.263129 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=26 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:35:31.263965 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=52 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:35:31.360892 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-e99d9000-9e7b-43c1-aaa7-23b609d6d3bc tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1386362914"}} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:35:31.364562 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-e99d9000-9e7b-43c1-aaa7-23b609d6d3bc tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: 5d4bf21e-eee4-4163-9b8a-c8434986ba17] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:35:31.371754 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e99d9000-9e7b-43c1-aaa7-23b609d6d3bc tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:35:31.372297 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e99d9000-9e7b-43c1-aaa7-23b609d6d3bc tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:35:31.372753 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e99d9000-9e7b-43c1-aaa7-23b609d6d3bc tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:35:31.373542 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e99d9000-9e7b-43c1-aaa7-23b609d6d3bc tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:35:31.374042 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e99d9000-9e7b-43c1-aaa7-23b609d6d3bc tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:35:31.374487 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-e99d9000-9e7b-43c1-aaa7-23b609d6d3bc tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:35:31.757480 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-e99d9000-9e7b-43c1-aaa7-23b609d6d3bc tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "POST /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17/action" status: 202 len: 0 microversion: 2.1 time: 0.496232 Aug 04 18:35:31.758191 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3933/7839] 10.222.0.93 () {60 vars in 1278 bytes} [Thu Aug 4 18:35:31 2022] POST /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 04 18:35:38.499309 n-d-851359-3 devstack@n-api.service[131044]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5669b2b7-e423-4a49-b572-a6035398afb4] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 18:35:38.500557 n-d-851359-3 devstack@n-api.service[131044]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7a822c8f-8f7d-4a50-9afd-aab5c6b46a96] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 18:35:38.501277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:35:38.502618 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=60 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:35:38.606945 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-4ce3c5d4-6dfe-4b9e-bef9-cb935bf19c62 req-0973d5df-0b55-4de4-b51b-38dc54527748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d4bf21e-eee4-4163-9b8a-c8434986ba17", "name": "network-vif-plugged", "status": "completed", "tag": "eac128cb-ac21-4410-9910-324f80f4ce00"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:35:38.619601 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4ce3c5d4-6dfe-4b9e-bef9-cb935bf19c62 req-0973d5df-0b55-4de4-b51b-38dc54527748 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:35:38.620209 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4ce3c5d4-6dfe-4b9e-bef9-cb935bf19c62 req-0973d5df-0b55-4de4-b51b-38dc54527748 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:35:38.620847 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4ce3c5d4-6dfe-4b9e-bef9-cb935bf19c62 req-0973d5df-0b55-4de4-b51b-38dc54527748 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:35:38.634463 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-4ce3c5d4-6dfe-4b9e-bef9-cb935bf19c62 req-0973d5df-0b55-4de4-b51b-38dc54527748 service nova] Creating event network-vif-plugged:eac128cb-ac21-4410-9910-324f80f4ce00 for instance 5d4bf21e-eee4-4163-9b8a-c8434986ba17 on n-h2-851359-3 Aug 04 18:35:38.638289 n-d-851359-3 devstack@n-api.service[131044]: ERROR oslo.messaging._drivers.impl_rabbit [req-4ce3c5d4-6dfe-4b9e-bef9-cb935bf19c62 req-0973d5df-0b55-4de4-b51b-38dc54527748 service nova] [9b51d6f1-f91a-417b-8234-d6c87343b175] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 18:35:39.511026 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] [5669b2b7-e423-4a49-b572-a6035398afb4] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 60452. Aug 04 18:35:39.511967 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] [7a822c8f-8f7d-4a50-9afd-aab5c6b46a96] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 60454. Aug 04 18:35:39.647012 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [req-4ce3c5d4-6dfe-4b9e-bef9-cb935bf19c62 req-0973d5df-0b55-4de4-b51b-38dc54527748 service nova] [9b51d6f1-f91a-417b-8234-d6c87343b175] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 60456. Aug 04 18:35:39.652453 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-4ce3c5d4-6dfe-4b9e-bef9-cb935bf19c62 req-0973d5df-0b55-4de4-b51b-38dc54527748 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.155480 Aug 04 18:35:39.653723 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3907/7840] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:35:53.345310 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:35:53.347018 n-d-851359-3 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:35:53.355149 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-a44e90da-ac45-4307-8a89-9c666e2840fb tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:35:53.356253 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a44e90da-ac45-4307-8a89-9c666e2840fb tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: 5d4bf21e-eee4-4163-9b8a-c8434986ba17] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:35:53.360584 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_api:SELECT=2 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:35:53.361638 n-d-851359-3 devstack@n-api.service[131043]: DEBUG dbcounter [-] [131043] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131043) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 18:35:53.365850 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-21bcae23-ad96-4df3-b0c4-9c36ad38e8e0 req-ac321e38-a0e7-4ef2-aa15-c673a3b5b7de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d4bf21e-eee4-4163-9b8a-c8434986ba17", "tag": "eac128cb-ac21-4410-9910-324f80f4ce00"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:35:53.377452 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a44e90da-ac45-4307-8a89-9c666e2840fb tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:35:53.378800 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a44e90da-ac45-4307-8a89-9c666e2840fb tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:35:53.380012 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a44e90da-ac45-4307-8a89-9c666e2840fb tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:35:53.380352 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-21bcae23-ad96-4df3-b0c4-9c36ad38e8e0 req-ac321e38-a0e7-4ef2-aa15-c673a3b5b7de service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:35:53.380969 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a44e90da-ac45-4307-8a89-9c666e2840fb tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:35:53.381153 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-21bcae23-ad96-4df3-b0c4-9c36ad38e8e0 req-ac321e38-a0e7-4ef2-aa15-c673a3b5b7de service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:35:53.381455 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a44e90da-ac45-4307-8a89-9c666e2840fb tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:35:53.381766 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-21bcae23-ad96-4df3-b0c4-9c36ad38e8e0 req-ac321e38-a0e7-4ef2-aa15-c673a3b5b7de service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:35:53.381963 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-a44e90da-ac45-4307-8a89-9c666e2840fb tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:35:53.397489 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-21bcae23-ad96-4df3-b0c4-9c36ad38e8e0 req-ac321e38-a0e7-4ef2-aa15-c673a3b5b7de service nova] Creating event network-changed:eac128cb-ac21-4410-9910-324f80f4ce00 for instance 5d4bf21e-eee4-4163-9b8a-c8434986ba17 on n-h2-851359-3 Aug 04 18:35:53.404787 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-21bcae23-ad96-4df3-b0c4-9c36ad38e8e0 req-ac321e38-a0e7-4ef2-aa15-c673a3b5b7de service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062716 Aug 04 18:35:53.405906 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3908/7841] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:35:53.427162 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-a44e90da-ac45-4307-8a89-9c666e2840fb tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: 5d4bf21e-eee4-4163-9b8a-c8434986ba17] Going to try to terminate instance {{(pid=131043) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 18:35:53.581735 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-a44e90da-ac45-4307-8a89-9c666e2840fb tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "DELETE /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17" status: 204 len: 0 microversion: 2.1 time: 0.244303 Aug 04 18:35:53.582460 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3934/7842] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 18:35:53 2022] DELETE /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 18:35:53.600385 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3c861dc9-44f0-478b-9485-85b52b64156f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:35:53.601958 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3c861dc9-44f0-478b-9485-85b52b64156f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: 5d4bf21e-eee4-4163-9b8a-c8434986ba17] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:35:53.615126 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c861dc9-44f0-478b-9485-85b52b64156f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:35:53.616168 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c861dc9-44f0-478b-9485-85b52b64156f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:35:53.617011 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c861dc9-44f0-478b-9485-85b52b64156f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:35:53.618429 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c861dc9-44f0-478b-9485-85b52b64156f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:35:53.619325 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c861dc9-44f0-478b-9485-85b52b64156f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:35:53.620141 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c861dc9-44f0-478b-9485-85b52b64156f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:35:53.953303 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3c861dc9-44f0-478b-9485-85b52b64156f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:35:53.971412 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3c861dc9-44f0-478b-9485-85b52b64156f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17" status: 200 len: 1682 microversion: 2.1 time: 0.380040 Aug 04 18:35:53.972792 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3909/7843] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:35:53 2022] GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17 => generated 1682 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 18:35:54.542599 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-9633ed52-1761-43ad-8cdf-6fd3c9af9b84 req-cd8f769f-a945-4f70-924d-4a90bf4e0367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d4bf21e-eee4-4163-9b8a-c8434986ba17", "name": "network-vif-unplugged", "status": "completed", "tag": "eac128cb-ac21-4410-9910-324f80f4ce00"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:35:54.560608 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9633ed52-1761-43ad-8cdf-6fd3c9af9b84 req-cd8f769f-a945-4f70-924d-4a90bf4e0367 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:35:54.561437 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9633ed52-1761-43ad-8cdf-6fd3c9af9b84 req-cd8f769f-a945-4f70-924d-4a90bf4e0367 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:35:54.562229 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9633ed52-1761-43ad-8cdf-6fd3c9af9b84 req-cd8f769f-a945-4f70-924d-4a90bf4e0367 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:35:54.595243 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-9633ed52-1761-43ad-8cdf-6fd3c9af9b84 req-cd8f769f-a945-4f70-924d-4a90bf4e0367 service nova] Creating event network-vif-unplugged:eac128cb-ac21-4410-9910-324f80f4ce00 for instance 5d4bf21e-eee4-4163-9b8a-c8434986ba17 on n-h2-851359-3 Aug 04 18:35:54.607178 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-9633ed52-1761-43ad-8cdf-6fd3c9af9b84 req-cd8f769f-a945-4f70-924d-4a90bf4e0367 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070353 Aug 04 18:35:54.608791 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3935/7844] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 18:35:55.008756 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-09ccb769-d01d-44b9-b0dd-b4e2fae6c79a tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:35:55.009906 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-09ccb769-d01d-44b9-b0dd-b4e2fae6c79a tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: 5d4bf21e-eee4-4163-9b8a-c8434986ba17] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:35:55.022841 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09ccb769-d01d-44b9-b0dd-b4e2fae6c79a tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:35:55.023903 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09ccb769-d01d-44b9-b0dd-b4e2fae6c79a tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:35:55.024733 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09ccb769-d01d-44b9-b0dd-b4e2fae6c79a tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:35:55.026161 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09ccb769-d01d-44b9-b0dd-b4e2fae6c79a tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:35:55.027265 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09ccb769-d01d-44b9-b0dd-b4e2fae6c79a tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:35:55.028091 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09ccb769-d01d-44b9-b0dd-b4e2fae6c79a tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:35:55.217156 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-09ccb769-d01d-44b9-b0dd-b4e2fae6c79a tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:35:55.226635 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-09ccb769-d01d-44b9-b0dd-b4e2fae6c79a tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17" status: 200 len: 1682 microversion: 2.1 time: 0.223787 Aug 04 18:35:55.227305 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3910/7845] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:35:55 2022] GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17 => generated 1682 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:35:56.201806 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-356adba7-84c6-4333-bc8d-21c6ef778f06 req-daa04645-1dc2-4e7f-99bf-e65d3dae6b74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d4bf21e-eee4-4163-9b8a-c8434986ba17", "name": "network-vif-deleted", "tag": "eac128cb-ac21-4410-9910-324f80f4ce00"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:35:56.213568 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-356adba7-84c6-4333-bc8d-21c6ef778f06 req-daa04645-1dc2-4e7f-99bf-e65d3dae6b74 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:35:56.214107 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-356adba7-84c6-4333-bc8d-21c6ef778f06 req-daa04645-1dc2-4e7f-99bf-e65d3dae6b74 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:35:56.214558 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-356adba7-84c6-4333-bc8d-21c6ef778f06 req-daa04645-1dc2-4e7f-99bf-e65d3dae6b74 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:35:56.229861 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-356adba7-84c6-4333-bc8d-21c6ef778f06 req-daa04645-1dc2-4e7f-99bf-e65d3dae6b74 service nova] Creating event network-vif-deleted:eac128cb-ac21-4410-9910-324f80f4ce00 for instance 5d4bf21e-eee4-4163-9b8a-c8434986ba17 on n-h2-851359-3 Aug 04 18:35:56.236790 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-356adba7-84c6-4333-bc8d-21c6ef778f06 req-daa04645-1dc2-4e7f-99bf-e65d3dae6b74 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115762 Aug 04 18:35:56.238307 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3936/7846] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:35:56.267510 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b68267ce-74f8-457c-851e-ed1792b4a948 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:35:56.268434 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b68267ce-74f8-457c-851e-ed1792b4a948 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: 5d4bf21e-eee4-4163-9b8a-c8434986ba17] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:35:56.276721 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b68267ce-74f8-457c-851e-ed1792b4a948 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:35:56.277478 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b68267ce-74f8-457c-851e-ed1792b4a948 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:35:56.278242 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b68267ce-74f8-457c-851e-ed1792b4a948 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:35:56.279574 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b68267ce-74f8-457c-851e-ed1792b4a948 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:35:56.280273 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b68267ce-74f8-457c-851e-ed1792b4a948 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:35:56.280605 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b68267ce-74f8-457c-851e-ed1792b4a948 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:35:56.331454 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b68267ce-74f8-457c-851e-ed1792b4a948 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:35:56.332369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b68267ce-74f8-457c-851e-ed1792b4a948 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:35:56.332369 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b68267ce-74f8-457c-851e-ed1792b4a948 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:35:56.332742 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-b68267ce-74f8-457c-851e-ed1792b4a948 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lazy-loading 'fault' on Instance uuid 5d4bf21e-eee4-4163-9b8a-c8434986ba17 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 18:35:56.384316 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b68267ce-74f8-457c-851e-ed1792b4a948 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:35:56.396370 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b68267ce-74f8-457c-851e-ed1792b4a948 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17" status: 200 len: 1338 microversion: 2.1 time: 0.133986 Aug 04 18:35:56.397658 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3911/7847] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:35:56 2022] GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17 => generated 1338 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:35:57.428548 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bcae1141-09ea-4899-b9a1-2f5245c14135 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:35:57.429458 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-bcae1141-09ea-4899-b9a1-2f5245c14135 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: 5d4bf21e-eee4-4163-9b8a-c8434986ba17] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:35:57.436384 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bcae1141-09ea-4899-b9a1-2f5245c14135 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:35:57.436896 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bcae1141-09ea-4899-b9a1-2f5245c14135 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:35:57.437352 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bcae1141-09ea-4899-b9a1-2f5245c14135 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:35:57.438141 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bcae1141-09ea-4899-b9a1-2f5245c14135 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:35:57.438628 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bcae1141-09ea-4899-b9a1-2f5245c14135 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:35:57.439075 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-bcae1141-09ea-4899-b9a1-2f5245c14135 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:35:57.454911 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.wsgi [None req-bcae1141-09ea-4899-b9a1-2f5245c14135 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] HTTP exception thrown: Instance 5d4bf21e-eee4-4163-9b8a-c8434986ba17 could not be found. Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bcae1141-09ea-4899-b9a1-2f5245c14135 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Request method failure captured: Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: request: GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17 HTTP/1.1 Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: Accept: application/json Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: Accept-Encoding: identity Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: Connection: close Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: Content-Length: 0 Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: Content-Type: application/json Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: Host: 10.222.0.93 Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: Openstack-System-Scope: None Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: User-Agent: python-urllib3/1.26.11 Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: X-Auth-Token: gAAAAABi7BA3NLjLCEKWOcckN9yd2jwojD2U3V2YL-7lLvQwiUoI1OnLpYtVCIWRS-S9k6IsDc7bNvNTwe5wpxTYzXtPe6PG9dx3wqWPouUmlxiVAIUTmJvySiSyMh59LFnEHSahg3hw68asu7JZzzMsrcQfJsrjW8A-g3JPv6xbzjWaRnCuHRk Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Id: None Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: X-Domain-Name: None Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: X-Identity-Status: Confirmed Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: X-Is-Admin-Project: True Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Id: default Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Domain-Name: Default Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Id: 0cdb03c0ef5a4e439a2e8486ab03dcb6 Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: X-Project-Name: tempest-TestSnapshotPattern-1619818997 Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: X-Role: member,reader Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: X-Roles: member,reader Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0cdb03c0ef5a4e439a2e8486ab03dcb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0cdb03c0ef5a4e439a2e8486ab03dcb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0cdb03c0ef5a4e439a2e8486ab03dcb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0cdb03c0ef5a4e439a2e8486ab03dcb6"}]}] Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant: tempest-TestSnapshotPattern-1619818997 Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Id: 0cdb03c0ef5a4e439a2e8486ab03dcb6 Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: X-Tenant-Name: tempest-TestSnapshotPattern-1619818997 Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: X-User: tempest-TestSnapshotPattern-1619818997-project Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Id: default Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: X-User-Domain-Name: Default Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: X-User-Id: 6b29e5823ffa41b78d37ed0312625388 Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: X-User-Name: tempest-TestSnapshotPattern-1619818997-project Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: method: > Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: exception: Instance 5d4bf21e-eee4-4163-9b8a-c8434986ba17 could not be found. Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: action_args: {'id': '5d4bf21e-eee4-4163-9b8a-c8434986ba17'} Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d4bf21e-eee4-4163-9b8a-c8434986ba17 could not be found. Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d4bf21e-eee4-4163-9b8a-c8434986ba17 could not be found. Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:35:57.457876 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:35:57.465082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:35:57.465082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:35:57.465082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:35:57.465082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:35:57.465082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:35:57.465082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d4bf21e-eee4-4163-9b8a-c8434986ba17 could not be found. Aug 04 18:35:57.465082 n-d-851359-3 devstack@n-api.service[131043]: ERROR nova.api.openstack.wsgi Aug 04 18:35:57.465082 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-bcae1141-09ea-4899-b9a1-2f5245c14135 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Returning 404 to user: Instance 5d4bf21e-eee4-4163-9b8a-c8434986ba17 could not be found. {{(pid=131043) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:35:57.465082 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-bcae1141-09ea-4899-b9a1-2f5245c14135 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17" status: 404 len: 111 microversion: 2.1 time: 0.036546 Aug 04 18:35:57.465082 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3937/7848] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:35:57 2022] GET /compute/v2.1/servers/5d4bf21e-eee4-4163-9b8a-c8434986ba17 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 18:35:59.717822 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-45771f34-8932-420d-90b4-83908666117f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:35:59.718886 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-45771f34-8932-420d-90b4-83908666117f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: ed8c085b-1f44-46ba-9d67-e48e5593972c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:35:59.724713 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-8dab7ed8-f085-4000-9153-726d0833d076 req-62961cf6-c7ac-42ea-811a-37fd95eccc08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed8c085b-1f44-46ba-9d67-e48e5593972c", "tag": "240a1311-3d49-4880-ae1c-c663efa4c2bb"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:35:59.733092 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45771f34-8932-420d-90b4-83908666117f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:35:59.734426 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45771f34-8932-420d-90b4-83908666117f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:35:59.735037 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45771f34-8932-420d-90b4-83908666117f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:35:59.736452 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45771f34-8932-420d-90b4-83908666117f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:35:59.737566 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45771f34-8932-420d-90b4-83908666117f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:35:59.738556 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45771f34-8932-420d-90b4-83908666117f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:35:59.747476 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8dab7ed8-f085-4000-9153-726d0833d076 req-62961cf6-c7ac-42ea-811a-37fd95eccc08 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:35:59.748387 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8dab7ed8-f085-4000-9153-726d0833d076 req-62961cf6-c7ac-42ea-811a-37fd95eccc08 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:35:59.749631 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-8dab7ed8-f085-4000-9153-726d0833d076 req-62961cf6-c7ac-42ea-811a-37fd95eccc08 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:35:59.772739 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-8dab7ed8-f085-4000-9153-726d0833d076 req-62961cf6-c7ac-42ea-811a-37fd95eccc08 service nova] Creating event network-changed:240a1311-3d49-4880-ae1c-c663efa4c2bb for instance ed8c085b-1f44-46ba-9d67-e48e5593972c on n-h1-851359-3 Aug 04 18:35:59.776277 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-45771f34-8932-420d-90b4-83908666117f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: ed8c085b-1f44-46ba-9d67-e48e5593972c] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 18:35:59.782812 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-8dab7ed8-f085-4000-9153-726d0833d076 req-62961cf6-c7ac-42ea-811a-37fd95eccc08 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066238 Aug 04 18:35:59.783971 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3938/7849] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:35:59.935623 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-45771f34-8932-420d-90b4-83908666117f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "DELETE /compute/v2.1/servers/ed8c085b-1f44-46ba-9d67-e48e5593972c" status: 204 len: 0 microversion: 2.1 time: 0.225852 Aug 04 18:35:59.938072 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3912/7850] 10.222.0.93 () {58 vars in 1239 bytes} [Thu Aug 4 18:35:59 2022] DELETE /compute/v2.1/servers/ed8c085b-1f44-46ba-9d67-e48e5593972c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 18:35:59.951933 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-c4a4bb23-3767-4a30-9842-4b5bc94c3835 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:35:59.953788 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.compute.api [None req-c4a4bb23-3767-4a30-9842-4b5bc94c3835 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: ed8c085b-1f44-46ba-9d67-e48e5593972c] Fetching instance by UUID {{(pid=131043) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:35:59.966500 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4a4bb23-3767-4a30-9842-4b5bc94c3835 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:35:59.967440 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4a4bb23-3767-4a30-9842-4b5bc94c3835 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:35:59.968266 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4a4bb23-3767-4a30-9842-4b5bc94c3835 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:35:59.969644 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4a4bb23-3767-4a30-9842-4b5bc94c3835 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:35:59.970669 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4a4bb23-3767-4a30-9842-4b5bc94c3835 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:35:59.971364 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [None req-c4a4bb23-3767-4a30-9842-4b5bc94c3835 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:36:00.174636 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.policy [None req-c4a4bb23-3767-4a30-9842-4b5bc94c3835 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131043) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:36:00.184107 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-c4a4bb23-3767-4a30-9842-4b5bc94c3835 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/ed8c085b-1f44-46ba-9d67-e48e5593972c" status: 200 len: 1681 microversion: 2.1 time: 0.240800 Aug 04 18:36:00.184709 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3939/7851] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:35:59 2022] GET /compute/v2.1/servers/ed8c085b-1f44-46ba-9d67-e48e5593972c => generated 1681 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:36:01.224451 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e3f9f1a6-0ea1-470a-ab65-009704465139 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:36:01.225790 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e3f9f1a6-0ea1-470a-ab65-009704465139 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: ed8c085b-1f44-46ba-9d67-e48e5593972c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:36:01.236854 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3f9f1a6-0ea1-470a-ab65-009704465139 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:36:01.237622 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3f9f1a6-0ea1-470a-ab65-009704465139 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:36:01.238415 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3f9f1a6-0ea1-470a-ab65-009704465139 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:36:01.239289 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3f9f1a6-0ea1-470a-ab65-009704465139 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:36:01.240214 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3f9f1a6-0ea1-470a-ab65-009704465139 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:36:01.240836 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3f9f1a6-0ea1-470a-ab65-009704465139 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:36:01.361372 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e3f9f1a6-0ea1-470a-ab65-009704465139 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b29e5823ffa41b78d37ed0312625388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdb03c0ef5a4e439a2e8486ab03dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 18:36:01.370799 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e3f9f1a6-0ea1-470a-ab65-009704465139 tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/ed8c085b-1f44-46ba-9d67-e48e5593972c" status: 200 len: 1495 microversion: 2.1 time: 0.155934 Aug 04 18:36:01.371408 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3913/7852] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:36:01 2022] GET /compute/v2.1/servers/ed8c085b-1f44-46ba-9d67-e48e5593972c => generated 1495 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 18:36:01.804834 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [req-9041f8b4-1f04-46ac-9d06-21393c47c403 req-db96f1f0-45c0-4a53-bd4a-906504cb0578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed8c085b-1f44-46ba-9d67-e48e5593972c", "name": "network-vif-deleted", "tag": "240a1311-3d49-4880-ae1c-c663efa4c2bb"}]} {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 18:36:01.823843 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9041f8b4-1f04-46ac-9d06-21393c47c403 req-db96f1f0-45c0-4a53-bd4a-906504cb0578 service nova] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:36:01.825303 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9041f8b4-1f04-46ac-9d06-21393c47c403 req-db96f1f0-45c0-4a53-bd4a-906504cb0578 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:36:01.826206 n-d-851359-3 devstack@n-api.service[131043]: DEBUG oslo_concurrency.lockutils [req-9041f8b4-1f04-46ac-9d06-21393c47c403 req-db96f1f0-45c0-4a53-bd4a-906504cb0578 service nova] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131043) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:36:01.850203 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.compute.server_external_events [req-9041f8b4-1f04-46ac-9d06-21393c47c403 req-db96f1f0-45c0-4a53-bd4a-906504cb0578 service nova] Creating event network-vif-deleted:240a1311-3d49-4880-ae1c-c663efa4c2bb for instance ed8c085b-1f44-46ba-9d67-e48e5593972c on n-h1-851359-3 Aug 04 18:36:01.858731 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [req-9041f8b4-1f04-46ac-9d06-21393c47c403 req-db96f1f0-45c0-4a53-bd4a-906504cb0578 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060552 Aug 04 18:36:01.859822 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3940/7853] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Aug 4 18:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 18:36:02.404643 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fb5a5045-73ac-4e14-927e-3301ec33a9cf tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:36:02.405280 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fb5a5045-73ac-4e14-927e-3301ec33a9cf tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [instance: ed8c085b-1f44-46ba-9d67-e48e5593972c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 18:36:02.413328 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb5a5045-73ac-4e14-927e-3301ec33a9cf tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:36:02.413836 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb5a5045-73ac-4e14-927e-3301ec33a9cf tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:36:02.414333 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb5a5045-73ac-4e14-927e-3301ec33a9cf tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:36:02.415067 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb5a5045-73ac-4e14-927e-3301ec33a9cf tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Acquiring lock "435e901d-6672-4284-ad57-58e647e6e99d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 04 18:36:02.415541 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb5a5045-73ac-4e14-927e-3301ec33a9cf tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 04 18:36:02.415987 n-d-851359-3 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb5a5045-73ac-4e14-927e-3301ec33a9cf tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Lock "435e901d-6672-4284-ad57-58e647e6e99d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 04 18:36:02.431329 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-fb5a5045-73ac-4e14-927e-3301ec33a9cf tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] HTTP exception thrown: Instance ed8c085b-1f44-46ba-9d67-e48e5593972c could not be found. Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fb5a5045-73ac-4e14-927e-3301ec33a9cf tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Request method failure captured: Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/ed8c085b-1f44-46ba-9d67-e48e5593972c HTTP/1.1 Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: Accept: application/json Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: Accept-Encoding: identity Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: Connection: close Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: Content-Length: 0 Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: Content-Type: application/json Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: Host: 10.222.0.93 Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: Openstack-System-Scope: None Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.11 Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABi7BA3NLjLCEKWOcckN9yd2jwojD2U3V2YL-7lLvQwiUoI1OnLpYtVCIWRS-S9k6IsDc7bNvNTwe5wpxTYzXtPe6PG9dx3wqWPouUmlxiVAIUTmJvySiSyMh59LFnEHSahg3hw68asu7JZzzMsrcQfJsrjW8A-g3JPv6xbzjWaRnCuHRk Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Id: None Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: X-Domain-Name: None Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: X-Is-Admin-Project: True Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Id: default Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Id: 0cdb03c0ef5a4e439a2e8486ab03dcb6 Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: X-Project-Name: tempest-TestSnapshotPattern-1619818997 Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: X-Role: member,reader Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: X-Roles: member,reader Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0cdb03c0ef5a4e439a2e8486ab03dcb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0cdb03c0ef5a4e439a2e8486ab03dcb6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0cdb03c0ef5a4e439a2e8486ab03dcb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0cdb03c0ef5a4e439a2e8486ab03dcb6"}]}] Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant: tempest-TestSnapshotPattern-1619818997 Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Id: 0cdb03c0ef5a4e439a2e8486ab03dcb6 Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestSnapshotPattern-1619818997 Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: X-User: tempest-TestSnapshotPattern-1619818997-project Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Id: default Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: X-User-Domain-Name: Default Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: X-User-Id: 6b29e5823ffa41b78d37ed0312625388 Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: X-User-Name: tempest-TestSnapshotPattern-1619818997-project Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: method: > Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: exception: Instance ed8c085b-1f44-46ba-9d67-e48e5593972c could not be found. Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: action_args: {'id': 'ed8c085b-1f44-46ba-9d67-e48e5593972c'} Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed8c085b-1f44-46ba-9d67-e48e5593972c could not be found. Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed8c085b-1f44-46ba-9d67-e48e5593972c could not be found. Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 18:36:02.433215 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:36:02.439447 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 18:36:02.439447 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 18:36:02.439447 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 18:36:02.439447 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 18:36:02.439447 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 18:36:02.439447 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed8c085b-1f44-46ba-9d67-e48e5593972c could not be found. Aug 04 18:36:02.439447 n-d-851359-3 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Aug 04 18:36:02.439447 n-d-851359-3 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fb5a5045-73ac-4e14-927e-3301ec33a9cf tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Returning 404 to user: Instance ed8c085b-1f44-46ba-9d67-e48e5593972c could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 18:36:02.439447 n-d-851359-3 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fb5a5045-73ac-4e14-927e-3301ec33a9cf tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "GET /compute/v2.1/servers/ed8c085b-1f44-46ba-9d67-e48e5593972c" status: 404 len: 111 microversion: 2.1 time: 0.034651 Aug 04 18:36:02.439447 n-d-851359-3 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3914/7854] 10.222.0.93 () {58 vars in 1236 bytes} [Thu Aug 4 18:36:02 2022] GET /compute/v2.1/servers/ed8c085b-1f44-46ba-9d67-e48e5593972c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 18:36:02.679961 n-d-851359-3 devstack@n-api.service[131043]: DEBUG nova.api.openstack.wsgi [None req-37cbf6ce-2b16-4323-861c-88402dc1e85f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] Calling method '.version_select at 0x7f1e5a866b80>' {{(pid=131043) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 18:36:02.685670 n-d-851359-3 devstack@n-api.service[131043]: ERROR oslo.messaging._drivers.impl_rabbit [None req-37cbf6ce-2b16-4323-861c-88402dc1e85f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [816f81a5-216e-4d76-a74c-6e2877133428] AMQP server on 10.222.0.93:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 18:36:03.213157 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:36:03.213400 n-d-851359-3 devstack@n-api.service[131044]: Thu Aug 4 18:36:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:36:03.230891 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:36:03.231194 n-d-851359-3 devstack@n-api.service[131044]: Thu Aug 4 18:36:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:36:03.693006 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [None req-37cbf6ce-2b16-4323-861c-88402dc1e85f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] [816f81a5-216e-4d76-a74c-6e2877133428] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 60688. Aug 04 18:36:03.721577 n-d-851359-3 devstack@n-api.service[131043]: INFO nova.api.openstack.requestlog [None req-37cbf6ce-2b16-4323-861c-88402dc1e85f tempest-TestSnapshotPattern-1619818997 tempest-TestSnapshotPattern-1619818997-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-209441469" status: 202 len: 0 microversion: 2.1 time: 1.048532 Aug 04 18:36:03.722324 n-d-851359-3 devstack@n-api.service[131043]: [pid: 131043|app: 0|req: 3941/7855] 10.222.0.93 () {58 vars in 1254 bytes} [Thu Aug 4 18:36:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-209441469 => generated 0 bytes in 1051 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 18:37:43.352312 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:37:43.353076 n-d-851359-3 devstack@n-api.service[131043]: Thu Aug 4 18:37:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:38:19.512908 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:38:19.513655 n-d-851359-3 devstack@n-api.service[131043]: Thu Aug 4 18:38:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:39:23.223131 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:39:23.223869 n-d-851359-3 devstack@n-api.service[131044]: Thu Aug 4 18:39:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:39:23.239652 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:39:23.240134 n-d-851359-3 devstack@n-api.service[131044]: Thu Aug 4 18:39:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:39:23.709426 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:39:23.710229 n-d-851359-3 devstack@n-api.service[131043]: Thu Aug 4 18:39:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:41:03.363257 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:41:03.364447 n-d-851359-3 devstack@n-api.service[131043]: Thu Aug 4 18:41:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:41:22.810406 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:41:22.811359 n-d-851359-3 devstack@n-api.service[131044]: Thu Aug 4 18:41:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:41:39.524230 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:41:39.524874 n-d-851359-3 devstack@n-api.service[131043]: Thu Aug 4 18:41:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:42:43.232953 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:42:43.233701 n-d-851359-3 devstack@n-api.service[131044]: Thu Aug 4 18:42:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:42:43.250780 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:42:43.251064 n-d-851359-3 devstack@n-api.service[131044]: Thu Aug 4 18:42:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:42:43.719860 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:42:43.720505 n-d-851359-3 devstack@n-api.service[131043]: Thu Aug 4 18:42:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:44:23.383067 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:44:23.383843 n-d-851359-3 devstack@n-api.service[131043]: Thu Aug 4 18:44:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:44:42.822198 n-d-851359-3 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:44:42.822853 n-d-851359-3 devstack@n-api.service[131044]: Thu Aug 4 18:44:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 18:44:59.534657 n-d-851359-3 devstack@n-api.service[131043]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 18:44:59.534657 n-d-851359-3 devstack@n-api.service[131043]: Thu Aug 4 18:44:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!